-- Logs begin at Wed 2022-09-07 11:39:17 UTC, end at Wed 2022-09-07 14:25:32 UTC. -- Sep 07 12:16:37.782707 n-d-852087-9 systemd[1]: Starting Devstack devstack@n-api.service... Sep 07 12:16:37.791942 n-d-852087-9 devstack@n-api.service[106308]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 07 12:16:37.794321 n-d-852087-9 devstack@n-api.service[106308]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 7 12:16:37 2022] *** Sep 07 12:16:37.794321 n-d-852087-9 devstack@n-api.service[106308]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 07 12:16:37.794321 n-d-852087-9 devstack@n-api.service[106308]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 07 12:16:37.794321 n-d-852087-9 devstack@n-api.service[106308]: nodename: n-d-852087-9 Sep 07 12:16:37.794321 n-d-852087-9 devstack@n-api.service[106308]: machine: x86_64 Sep 07 12:16:37.794321 n-d-852087-9 devstack@n-api.service[106308]: clock source: unix Sep 07 12:16:37.794321 n-d-852087-9 devstack@n-api.service[106308]: pcre jit disabled Sep 07 12:16:37.794321 n-d-852087-9 devstack@n-api.service[106308]: detected number of CPU cores: 4 Sep 07 12:16:37.794321 n-d-852087-9 devstack@n-api.service[106308]: current working directory: / Sep 07 12:16:37.794321 n-d-852087-9 devstack@n-api.service[106308]: detected binary path: /usr/bin/uwsgi-core Sep 07 12:16:37.794321 n-d-852087-9 devstack@n-api.service[106308]: your processes number limit is 47680 Sep 07 12:16:37.794321 n-d-852087-9 devstack@n-api.service[106308]: your memory page size is 4096 bytes Sep 07 12:16:37.794321 n-d-852087-9 devstack@n-api.service[106308]: detected max file descriptor number: 2048 Sep 07 12:16:37.794321 n-d-852087-9 devstack@n-api.service[106308]: lock engine: pthread robust mutexes Sep 07 12:16:37.794321 n-d-852087-9 devstack@n-api.service[106308]: thunder lock: enabled Sep 07 12:16:37.794321 n-d-852087-9 devstack@n-api.service[106308]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 07 12:16:37.795200 n-d-852087-9 devstack@n-api.service[106308]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 07 12:16:37.833153 n-d-852087-9 devstack@n-api.service[106308]: Python main interpreter initialized at 0x5569594459c0 Sep 07 12:16:37.833153 n-d-852087-9 devstack@n-api.service[106308]: python threads support enabled Sep 07 12:16:37.833153 n-d-852087-9 devstack@n-api.service[106308]: your server socket listen backlog is limited to 100 connections Sep 07 12:16:37.833153 n-d-852087-9 devstack@n-api.service[106308]: your mercy for graceful operations on workers is 90 seconds Sep 07 12:16:37.833596 n-d-852087-9 devstack@n-api.service[106308]: mapped 403077 bytes (393 KB) for 2 cores Sep 07 12:16:37.833596 n-d-852087-9 devstack@n-api.service[106308]: *** Operational MODE: preforking *** Sep 07 12:16:37.833867 n-d-852087-9 devstack@n-api.service[106308]: *** uWSGI is running in multiple interpreter mode *** Sep 07 12:16:37.833867 n-d-852087-9 devstack@n-api.service[106308]: spawned uWSGI master process (pid: 106308) Sep 07 12:16:37.834086 n-d-852087-9 systemd[1]: Started Devstack devstack@n-api.service. Sep 07 12:16:37.834990 n-d-852087-9 devstack@n-api.service[106308]: spawned uWSGI worker 1 (pid: 106309, cores: 1) Sep 07 12:16:37.837450 n-d-852087-9 devstack@n-api.service[106308]: spawned uWSGI worker 2 (pid: 106310, cores: 1) Sep 07 12:16:37.837450 n-d-852087-9 devstack@n-api.service[106308]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 07 12:16:38.492287 n-d-852087-9 devstack@n-api.service[106310]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 12:16:38.493104 n-d-852087-9 devstack@n-api.service[106309]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 12:16:39.604247 n-d-852087-9 devstack@n-api.service[106310]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 12:16:39.604247 n-d-852087-9 devstack@n-api.service[106310]: from cryptography.utils import int_from_bytes Sep 07 12:16:39.604900 n-d-852087-9 devstack@n-api.service[106310]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 12:16:39.604900 n-d-852087-9 devstack@n-api.service[106310]: from cryptography.utils import int_from_bytes Sep 07 12:16:39.610814 n-d-852087-9 devstack@n-api.service[106309]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 12:16:39.610814 n-d-852087-9 devstack@n-api.service[106309]: from cryptography.utils import int_from_bytes Sep 07 12:16:39.611285 n-d-852087-9 devstack@n-api.service[106309]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 12:16:39.611285 n-d-852087-9 devstack@n-api.service[106309]: from cryptography.utils import int_from_bytes Sep 07 12:16:42.080746 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 12:16:42.081421 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 12:16:42.081558 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 12:16:42.081959 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 12:16:42.082215 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 12:16:42.082606 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.082928 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.083255 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.083573 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.083901 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.084043 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 12:16:42.084809 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 12:16:42.084892 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.084892 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.085079 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 12:16:42.085238 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.085462 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 12:16:42.085592 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.085775 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 12:16:42.085892 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.086113 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.086208 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.086433 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852087-9 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.086535 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.086752 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.086848 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.087057 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.087149 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.087367 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.087469 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.087672 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.087767 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.087975 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.088072 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.088293 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.088393 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.088580 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.088671 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.088836 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.089089 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.089213 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.089449 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852087-9 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.089607 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.089790 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.089966 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.090088 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.090177 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.090407 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.090553 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.090687 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.090771 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.090988 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.091104 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.091304 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.091401 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.091605 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.091702 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.091976 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.092114 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.092287 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.092419 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.092691 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852087-9 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.092784 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.093007 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.093098 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.093315 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.093403 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.093660 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.093749 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.093964 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.094065 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.094278 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.094364 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.094581 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.094673 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.094898 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.095002 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.095204 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.095343 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.095592 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.095694 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852087-9 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.095898 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.095984 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.096207 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.096309 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.096513 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.096604 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.096833 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.096924 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.097135 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.097270 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.097443 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.097584 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.097778 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.097871 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.098103 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.098190 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.098399 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.098491 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.098703 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.098796 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.098964 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.099056 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.099274 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.099377 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.099592 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.099831 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.099954 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.100134 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.100221 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.100439 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.100532 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.100695 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.100832 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.101012 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.101105 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.101384 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.101555 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.101708 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.101825 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.101941 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.102034 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.102248 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.102346 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.102563 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.102656 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.102883 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.102976 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.103194 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.103287 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.103441 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.103527 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.103689 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.103797 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.104004 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.104109 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.104318 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.104406 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.104622 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.104715 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.104926 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.105025 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.105227 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.105323 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.105554 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.105726 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.105859 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.105980 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.106161 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.106289 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.106461 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.106628 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.106761 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.106948 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.107074 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.107257 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.107387 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.107578 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.107697 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.107901 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.107992 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.108210 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.108297 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.108518 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.108679 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.108827 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.108913 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.109152 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.109243 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.109498 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.109587 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.109815 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.109900 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.110067 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.110160 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.110368 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.110461 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.110676 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.110767 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.110994 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.111082 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.111303 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.111398 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.111611 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.111702 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.111918 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.112013 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.112220 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.112313 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.112527 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.112612 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.112773 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.112866 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.113070 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.113163 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.113372 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.113464 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.113710 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.113809 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.114015 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.114103 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.114318 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.114403 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.114622 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.114719 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.114920 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.115077 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.115222 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.115464 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.115564 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.115729 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.115849 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.115941 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.116158 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.116245 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.116466 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.116566 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.116828 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.116925 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.117161 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.117250 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.117523 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.117628 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.117812 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.117897 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.118117 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.118210 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.118434 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.118521 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.118739 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.118823 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.119042 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.119125 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.119346 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.119434 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.119650 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.119739 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.119955 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.120046 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.120271 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.120366 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.120571 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.120663 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.120873 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.120998 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.121185 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.121271 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.121502 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.121590 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.121804 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.121891 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.122104 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.122189 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.122408 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.122505 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.122710 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.122798 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.123012 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.123105 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.123306 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.123396 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.123607 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.123704 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.123903 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.123988 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.124206 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.124298 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.124510 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.124606 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.124811 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.124899 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.125110 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.125196 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.125410 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.125523 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.125735 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.125823 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.126031 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.126117 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.126330 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.126464 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.126627 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.126723 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.126940 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.127026 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.127264 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.127350 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.127570 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.127662 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.127873 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.127965 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.128173 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.128260 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.128487 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:16:42.128579 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.128823 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.128917 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.129151 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.129245 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.129542 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.129678 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.129824 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.129920 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.130147 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.130238 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.130467 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.130552 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.130780 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.130874 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.131107 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.131251 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.131424 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.131569 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.131747 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.131894 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.132059 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.132205 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.132406 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.132538 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.132735 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.132849 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.133058 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.133150 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.133371 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.133456 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.133748 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.133846 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.134094 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.134180 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.134406 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.134490 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.134722 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.134820 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.135032 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.135125 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.135343 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.135427 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.135655 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.135755 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.135963 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.136056 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.136271 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.136356 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.136603 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.136690 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.136914 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.137007 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.137231 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.137317 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.137646 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.137758 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.137885 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.137970 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.138193 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.138288 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.138500 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.138596 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.138808 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.138895 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.139125 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.139224 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.139435 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.139528 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.139744 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.139837 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.140059 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.140158 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.140368 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.140454 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.140677 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.140789 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.140983 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.141084 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.141288 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.141386 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.141619 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.141707 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.141930 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.142034 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.142237 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.142324 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.142539 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.142624 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.142842 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.142936 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.143147 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.143237 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.143454 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.143548 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.143758 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.143852 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.144067 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.144159 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.144376 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.144462 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.144684 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.144769 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.144991 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.145081 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.145293 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.145385 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.145616 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.145708 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.145917 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.146012 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.146220 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.146306 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.146525 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.146644 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.146837 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.147013 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.147149 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.147339 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.147452 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.147644 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.147784 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.148016 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.148128 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.148322 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.148434 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.148634 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.148759 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.148943 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.149071 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.149250 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.149377 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.149577 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.149713 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.149895 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.150029 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.150199 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.150319 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.150500 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.150634 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.150818 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.150994 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.151129 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.151270 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.151425 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.151584 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.151737 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.151882 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.152038 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.152213 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.152348 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.152542 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.152685 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.152842 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.152978 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.153152 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.153282 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.153476 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.153678 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.153814 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.153993 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.154116 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.154313 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.154422 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.154624 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.154712 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.154931 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.155018 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.155261 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.155348 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.155587 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.155674 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.155888 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.155978 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.156190 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.156277 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.156493 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.156589 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.156792 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.156878 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.157093 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.157185 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.157394 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.157510 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.157719 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.157805 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.158019 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.158127 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.158317 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.158408 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.158619 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.158713 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.158914 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.159007 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.159212 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.159299 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.159510 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.159603 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.159806 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.159964 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.160105 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.160193 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.160421 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.160507 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.160725 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.160821 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.161025 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.161119 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.161322 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.161454 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.161647 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.161737 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.161988 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.162081 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.162290 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.162384 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.162615 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.162701 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.162925 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.163018 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.163243 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.163338 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.163575 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.163669 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.163898 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.163995 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.164206 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.164292 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.164525 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.164612 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.164827 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.164914 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.165134 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.165226 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.165443 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.165564 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.165783 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.165869 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.166093 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.166192 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.166414 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.166508 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.166720 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.166814 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.167031 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.167134 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.167336 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.167421 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.167645 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.167728 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.167942 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.168094 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.168250 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.168335 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.168569 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.168655 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.168877 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.168972 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.169192 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.169278 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.169528 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.169617 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.169822 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.169910 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.170132 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.170235 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.170436 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.170523 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.170737 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.170830 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.171041 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.171126 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.171345 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.171437 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.171661 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.171756 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.171963 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.172048 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.172272 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.172365 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.172573 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.172659 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.172889 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.172985 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.173192 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.173286 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.173515 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.173670 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.173824 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.173919 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.174129 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.174227 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.174439 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.174532 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.174752 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.174848 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.175062 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.175157 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.175371 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.175465 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.175675 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.175762 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.175988 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.176084 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.176298 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.176394 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.176604 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.176690 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.176903 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.177050 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.177203 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.177290 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.177538 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.177639 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.177851 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.178038 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.178161 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.178349 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.178478 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.178655 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.178784 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.178954 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.179092 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.179314 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.179468 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.179620 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.179776 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.179921 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.180081 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.180209 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.180383 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.180515 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.180688 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.180832 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.181032 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.181131 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.181373 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.181538 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.181676 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.181794 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.181994 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.182086 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.182315 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.182417 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.182624 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.182711 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.182933 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.183017 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.183235 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.183344 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.183536 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.183616 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.183853 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.183962 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.184165 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.184331 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.184475 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.184638 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.184784 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.184937 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.185098 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.185249 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.185408 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.185587 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.185764 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.185896 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.186085 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.186208 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.186394 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.186511 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.186705 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.186816 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.187018 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.187148 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.187323 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.187409 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.187634 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.187731 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.187951 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.188050 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.188302 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.188531 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.188617 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.188869 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.188959 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.189184 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.189271 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.189531 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.189620 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.189817 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.189906 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.190125 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.190224 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.190426 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.190521 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.190729 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.190829 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.191041 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.191128 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.191393 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.191610 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.191748 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.191940 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.192037 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.192250 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.192337 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.192566 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.192651 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.192870 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.192956 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.193173 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.193268 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.193474 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.193579 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.193814 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.193981 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.194114 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.194336 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.194423 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.194639 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.194725 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.194971 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.195059 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.195274 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.195370 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.195575 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.195670 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.195883 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.195970 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.196187 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.196271 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.196482 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.196580 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.196782 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.196869 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.197085 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.197205 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.197381 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.197530 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.197704 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.197801 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.198004 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.198090 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.198302 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.198439 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.198609 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.198703 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.198907 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.198995 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.199216 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.199304 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.199513 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.199607 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.199828 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.199914 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.200131 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.200219 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.200430 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.200533 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.200726 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.200821 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.201022 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.201111 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.201339 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.201432 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.201668 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.201766 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.201966 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.202060 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.202276 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.202362 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.202582 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.202676 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.202889 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.202975 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.203194 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.203280 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.203495 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.203589 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.203842 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.203948 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.204091 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.204185 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.204388 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.204491 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.204691 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.204777 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.204991 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.205075 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.205285 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.205378 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.205613 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.205701 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.205921 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.206008 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.206223 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.206310 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.206523 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.206607 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.206819 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.206904 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.207120 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.207213 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.207418 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.207514 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.207716 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.207800 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.208016 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.208103 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.208311 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.208396 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.208610 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.208706 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.208907 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.208993 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.209207 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.209691 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.209896 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.209996 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.210203 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.210290 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.210553 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.210651 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.210858 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.210952 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.211154 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.211240 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.211455 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.211552 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.211751 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.211853 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.212064 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.212239 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.212379 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.212546 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.212679 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.212846 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.212986 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.213164 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.213289 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.213471 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.213625 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.213791 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.213931 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.214089 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.214236 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.214392 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.214537 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.214691 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.214838 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.214988 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.215139 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.215292 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.215440 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.215606 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.215741 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.215925 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.216060 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.216222 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.216367 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.216525 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.216667 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.216825 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.216970 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.217124 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.217271 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.217424 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.217631 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.217736 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.217935 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.218096 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.218292 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.218378 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.218601 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.218685 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.218899 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.218999 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.219198 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.219284 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.219509 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.219594 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.219810 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.219903 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.220109 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.220203 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.220408 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.220493 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.220704 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.220799 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.221018 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.221111 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.221325 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.221416 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.221661 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.221758 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.221962 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.222049 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.222279 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.222364 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.222589 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.222675 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.222896 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.222980 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.223319 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.223420 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.223512 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.223599 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.223800 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.223895 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.224109 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.224203 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.224412 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.224498 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.224733 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.224819 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.225014 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.225110 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.225312 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.225411 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.225653 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.225755 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.225961 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.226079 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.226301 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.226438 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.226614 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.226757 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.226924 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.227076 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.227234 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.227395 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.227529 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.227697 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.227851 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.228183 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.228283 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.228452 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.228540 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.228771 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.228878 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.229083 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.229176 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.229385 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.229471 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.229716 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.229815 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.230019 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.230105 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.230325 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.230410 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.230625 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.230718 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.230929 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.231064 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.231234 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.231380 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.231540 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.231696 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.231845 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.231999 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.232146 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.232309 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.232466 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.232622 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.232771 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.232935 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.233071 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.233249 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.233377 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.233585 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.233708 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.234001 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.234088 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.234303 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.234400 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.234613 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.234735 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.234924 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.235044 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.235229 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.235356 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.235534 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.235659 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.235844 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.235968 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.236166 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.236262 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.236469 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.236576 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.236771 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.236885 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.237071 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.237188 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.237391 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.237632 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.237750 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.237940 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.238043 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.238249 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.238433 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.238558 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.238745 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.238900 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.239040 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.239182 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.239437 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.239572 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.239741 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.239885 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.240041 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.240170 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.240342 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.240472 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.240641 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.240748 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.240959 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.241099 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.241260 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.241390 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.241583 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.241722 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.241959 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.242060 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.242287 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.242373 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.242611 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.242696 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.242924 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.243024 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.243242 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.243328 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.243549 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.243635 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.243883 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.243998 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.244196 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.244291 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.244514 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.244704 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.244835 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.245014 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.245249 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.245336 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.245595 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.245700 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.245908 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.245996 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.246231 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.246318 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.246558 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.246644 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.246864 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.246952 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.247166 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.247252 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.247474 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.247567 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.247782 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.247898 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.248085 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.248172 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.248404 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.248498 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.248706 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.248816 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.249018 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.249112 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.249326 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.249421 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.249666 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.249754 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.249970 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.250055 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.250271 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.250370 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.250590 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.250675 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.250897 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.251002 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.251215 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.251310 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.251517 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.251602 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.251835 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.251919 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.252135 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.252221 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.252446 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.252532 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.252756 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.252842 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.253061 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.253153 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.253361 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.253445 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.253686 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.253775 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.253985 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.254069 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.254294 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.254392 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.254615 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.254715 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.254923 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.255009 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.255246 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.255332 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.255564 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.255663 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.255867 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.255974 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.256182 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.256271 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.256487 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.256582 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.256787 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.256873 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.257088 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.257172 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.257410 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.257572 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.257778 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.257942 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.258083 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.258221 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.258366 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.258506 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.258668 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.258799 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.258961 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.259088 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.259264 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.259400 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.259566 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.259711 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.259874 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.260097 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.260242 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.260423 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.260553 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.260731 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.260870 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.261040 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.261184 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.261346 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.261506 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.261672 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.261771 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.261976 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.262063 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.262279 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.262363 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.262579 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.262663 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.262879 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.262967 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.263180 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.263267 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.263483 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.263569 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.263785 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.263880 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.264083 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.264171 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.264380 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.264466 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.264700 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.264789 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.265007 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.265094 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.265322 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.265415 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.265647 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.265747 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.265950 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.266037 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.266250 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.266351 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.266548 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.266642 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.266868 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.266953 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.267176 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.267269 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.267487 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.267572 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.267795 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.267880 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.268113 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.268366 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.268461 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.268697 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.268783 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.269013 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.269150 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.269325 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.269421 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.269662 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.269750 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.269973 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.270077 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.270285 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.270372 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.270590 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.270677 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.270900 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.270997 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.271211 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.271308 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.271522 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.271608 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.271855 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.272072 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.272162 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.272399 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.272486 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.272711 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.272808 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.273070 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.273182 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.273379 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.273520 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.273725 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.273854 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.274139 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.274234 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.274496 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.274596 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.274813 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.274916 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.275120 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.275216 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.275433 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.275528 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.275749 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.275855 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.276061 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.276163 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.276374 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.276475 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.276684 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.276778 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.276997 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.277092 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.277308 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.277415 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.277645 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.277740 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.278012 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.278111 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.278266 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.278368 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.278576 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.278682 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.278891 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.278988 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.279202 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.279289 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.279512 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.279606 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.279821 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.279907 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.280130 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.280218 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.280438 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.280532 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.280749 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.280959 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.281054 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.281277 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.281415 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.281633 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.281767 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.281957 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.282096 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.282267 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.282397 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.282583 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.282718 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.282903 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.283041 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.283217 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.283351 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.283524 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.283657 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.283829 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.283961 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.284137 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.284271 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.284442 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.284662 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.284840 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.284982 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.285121 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.285294 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.285430 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.285641 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.285731 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.285964 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.286060 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.286269 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.286399 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.286583 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.286799 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.286907 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.287146 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.287233 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.287461 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.287555 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.287787 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.287873 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.288090 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.288175 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.288391 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.288486 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.288736 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.288832 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.289044 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.289132 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.289346 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.289440 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.289686 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.289784 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.289989 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.290102 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.290385 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.290517 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.290655 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.290909 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.291065 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.291224 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.291350 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.291596 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.291782 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.291916 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.292030 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.292249 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.292360 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.292573 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.292704 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.292946 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.293128 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.293253 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.293435 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.293604 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.293798 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.293888 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.294161 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.294289 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.294513 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.294611 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.294816 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.294957 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.295146 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.295290 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.295471 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.295621 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.295782 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.295870 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.296086 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.296224 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.296395 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.296517 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.296693 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.296789 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.297004 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.297091 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.297306 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.297391 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.297630 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.297737 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.297934 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.298029 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.298243 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.298329 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.298544 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.298665 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.298844 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.298931 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.299145 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.299231 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.299442 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.299530 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.299747 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.299836 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.300044 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.300131 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.300347 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.300448 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.300678 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.300774 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.300951 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.301035 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.301297 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.301539 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.301632 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.301876 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.301963 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.302198 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.302297 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.302502 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.302595 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.302802 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.302896 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.303112 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.303198 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.303416 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.303511 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.303718 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.303818 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.304022 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.304123 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.304382 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.304473 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.304694 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.304780 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.305049 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.305193 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.305314 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.305652 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.305754 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.305964 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.306052 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.306276 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.306363 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.306587 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.306676 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.306902 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.306995 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.307200 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.307288 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.307510 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.307597 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.307822 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.307916 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.308136 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.308222 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.308442 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.308537 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.308749 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.308845 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.309054 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.309151 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.309359 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.309446 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.309688 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.309799 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.309992 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.310079 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.310296 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.310383 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.310600 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.310687 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.310902 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.311035 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.311207 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.311303 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.311533 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.311665 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.311821 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.311929 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.312125 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.312223 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.312425 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.312513 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.312732 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.312825 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.313063 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.313379 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.313465 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.313717 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.313821 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.314029 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.314129 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.314342 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.314437 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.314654 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.314748 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.314958 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.315065 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.315260 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.315359 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.315561 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.315647 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.315870 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.315964 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.316193 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.316288 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.316500 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.316609 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.316799 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.316894 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.317165 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.317601 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.317708 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.317885 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.318026 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.318202 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.318343 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.318533 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.318675 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.318845 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.318944 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.319162 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.319262 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.319475 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.319564 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.319805 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.319926 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.320109 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.320195 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.320420 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.320512 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.320738 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.320838 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.321030 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.321151 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.321334 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.321420 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.321666 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.321767 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.321977 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.322070 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.322263 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.322349 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.322570 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.322660 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.322874 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.322960 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.323176 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.323276 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.323482 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.323568 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.323781 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.323865 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.324082 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.324183 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.324383 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.324469 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.324684 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.324775 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.324983 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.325076 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.325285 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.325461 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.325608 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.325787 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.325940 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.326094 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.326274 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.326392 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.326606 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.326705 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.326911 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.327013 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.327222 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.327309 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.327543 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.327636 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.327839 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.327933 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.328145 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.328238 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.328443 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.328528 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.328742 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.328837 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.329041 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.329136 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.329339 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.329425 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.329714 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.329825 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.330031 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.330200 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.330345 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.330449 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.330648 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.330741 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.330948 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.331085 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.331254 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.331395 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.331581 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.331741 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.331894 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.332023 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.332202 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.332297 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.332514 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.332646 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.332822 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.332912 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.333127 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.333223 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.333440 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.333549 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.333770 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.333855 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.334080 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.334215 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.334753 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.334842 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.335097 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.335194 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.335360 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.335516 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.335742 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.335844 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.336033 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.336121 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.336351 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.336441 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.336663 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.336756 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.336974 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.337063 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.337294 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.337381 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.337629 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.337733 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.337941 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.338042 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.338256 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.338350 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.338568 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.338652 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.338874 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.338968 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.339181 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.339268 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.339486 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.339574 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.339791 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.339934 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.340101 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.340189 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.340411 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.340498 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.340717 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.340813 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.341017 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.341124 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.341329 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.341420 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.341616 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 12:16:42.341714 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.341975 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.342296 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.342605 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.342926 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.343249 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.343588 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.343899 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.344238 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.344567 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.344878 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.345185 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.345514 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:16:42.345751 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 12:16:42.501311 n-d-852087-9 devstack@n-api.service[106310]: INFO dbcounter [None req-b1f8daf3-4b21-48b4-9cc7-9c205b4647c7 None None] Registered counter for database nova_api Sep 07 12:16:42.512529 n-d-852087-9 devstack@n-api.service[106309]: INFO dbcounter [None req-bc2e2a9a-3ec5-4f4e-8625-4df4e99c4b11 None None] Registered counter for database nova_api Sep 07 12:16:42.522188 n-d-852087-9 devstack@n-api.service[106310]: DEBUG oslo_db.sqlalchemy.engines [None req-b1f8daf3-4b21-48b4-9cc7-9c205b4647c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106310) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:16:42.529289 n-d-852087-9 devstack@n-api.service[106310]: DEBUG dbcounter [-] [106310] Writer thread running {{(pid=106310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:16:42.532929 n-d-852087-9 devstack@n-api.service[106309]: DEBUG oslo_db.sqlalchemy.engines [None req-bc2e2a9a-3ec5-4f4e-8625-4df4e99c4b11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106309) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:16:42.540097 n-d-852087-9 devstack@n-api.service[106309]: DEBUG dbcounter [-] [106309] Writer thread running {{(pid=106309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:16:42.586745 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.context [None req-b1f8daf3-4b21-48b4-9cc7-9c205b4647c7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e0290a2-728a-49bc-bfb2-19275e06ed31(cell1) {{(pid=106310) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 12:16:42.590677 n-d-852087-9 devstack@n-api.service[106310]: DEBUG oslo_concurrency.lockutils [None req-b1f8daf3-4b21-48b4-9cc7-9c205b4647c7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:16:42.591150 n-d-852087-9 devstack@n-api.service[106310]: DEBUG oslo_concurrency.lockutils [None req-b1f8daf3-4b21-48b4-9cc7-9c205b4647c7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:16:42.592709 n-d-852087-9 devstack@n-api.service[106310]: DEBUG oslo_concurrency.lockutils [None req-b1f8daf3-4b21-48b4-9cc7-9c205b4647c7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:16:42.593439 n-d-852087-9 devstack@n-api.service[106310]: DEBUG oslo_concurrency.lockutils [None req-b1f8daf3-4b21-48b4-9cc7-9c205b4647c7 None None] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:16:42.593908 n-d-852087-9 devstack@n-api.service[106310]: DEBUG oslo_concurrency.lockutils [None req-b1f8daf3-4b21-48b4-9cc7-9c205b4647c7 None None] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:16:42.595904 n-d-852087-9 devstack@n-api.service[106310]: DEBUG oslo_concurrency.lockutils [None req-b1f8daf3-4b21-48b4-9cc7-9c205b4647c7 None None] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:16:42.597615 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.context [None req-bc2e2a9a-3ec5-4f4e-8625-4df4e99c4b11 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e0290a2-728a-49bc-bfb2-19275e06ed31(cell1) {{(pid=106309) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 12:16:42.597948 n-d-852087-9 devstack@n-api.service[106310]: INFO dbcounter [None req-b1f8daf3-4b21-48b4-9cc7-9c205b4647c7 None None] Registered counter for database nova_cell0 Sep 07 12:16:42.602273 n-d-852087-9 devstack@n-api.service[106309]: DEBUG oslo_concurrency.lockutils [None req-bc2e2a9a-3ec5-4f4e-8625-4df4e99c4b11 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106309) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:16:42.602439 n-d-852087-9 devstack@n-api.service[106310]: INFO dbcounter [None req-b1f8daf3-4b21-48b4-9cc7-9c205b4647c7 None None] Registered counter for database nova_cell1 Sep 07 12:16:42.602718 n-d-852087-9 devstack@n-api.service[106309]: DEBUG oslo_concurrency.lockutils [None req-bc2e2a9a-3ec5-4f4e-8625-4df4e99c4b11 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106309) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:16:42.604277 n-d-852087-9 devstack@n-api.service[106309]: DEBUG oslo_concurrency.lockutils [None req-bc2e2a9a-3ec5-4f4e-8625-4df4e99c4b11 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106309) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:16:42.605027 n-d-852087-9 devstack@n-api.service[106309]: DEBUG oslo_concurrency.lockutils [None req-bc2e2a9a-3ec5-4f4e-8625-4df4e99c4b11 None None] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106309) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:16:42.605456 n-d-852087-9 devstack@n-api.service[106309]: DEBUG oslo_concurrency.lockutils [None req-bc2e2a9a-3ec5-4f4e-8625-4df4e99c4b11 None None] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106309) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:16:42.607706 n-d-852087-9 devstack@n-api.service[106309]: DEBUG oslo_concurrency.lockutils [None req-bc2e2a9a-3ec5-4f4e-8625-4df4e99c4b11 None None] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106309) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:16:42.609815 n-d-852087-9 devstack@n-api.service[106310]: DEBUG oslo_db.sqlalchemy.engines [None req-b1f8daf3-4b21-48b4-9cc7-9c205b4647c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106310) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:16:42.609966 n-d-852087-9 devstack@n-api.service[106309]: INFO dbcounter [None req-bc2e2a9a-3ec5-4f4e-8625-4df4e99c4b11 None None] Registered counter for database nova_cell0 Sep 07 12:16:42.611624 n-d-852087-9 devstack@n-api.service[106310]: DEBUG oslo_db.sqlalchemy.engines [None req-b1f8daf3-4b21-48b4-9cc7-9c205b4647c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106310) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:16:42.614111 n-d-852087-9 devstack@n-api.service[106309]: INFO dbcounter [None req-bc2e2a9a-3ec5-4f4e-8625-4df4e99c4b11 None None] Registered counter for database nova_cell1 Sep 07 12:16:42.618021 n-d-852087-9 devstack@n-api.service[106310]: DEBUG dbcounter [-] [106310] Writer thread running {{(pid=106310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:16:42.619575 n-d-852087-9 devstack@n-api.service[106310]: DEBUG dbcounter [-] [106310] Writer thread running {{(pid=106310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:16:42.621191 n-d-852087-9 devstack@n-api.service[106309]: DEBUG oslo_db.sqlalchemy.engines [None req-bc2e2a9a-3ec5-4f4e-8625-4df4e99c4b11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106309) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:16:42.626363 n-d-852087-9 devstack@n-api.service[106309]: DEBUG dbcounter [-] [106309] Writer thread running {{(pid=106309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:16:42.627860 n-d-852087-9 devstack@n-api.service[106309]: DEBUG oslo_db.sqlalchemy.engines [None req-bc2e2a9a-3ec5-4f4e-8625-4df4e99c4b11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106309) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:16:42.769452 n-d-852087-9 devstack@n-api.service[106310]: INFO dbcounter [None req-b1f8daf3-4b21-48b4-9cc7-9c205b4647c7 None None] Registered counter for database nova_cell0 Sep 07 12:16:42.773474 n-d-852087-9 devstack@n-api.service[106309]: DEBUG dbcounter [-] [106309] Writer thread running {{(pid=106309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:16:42.776791 n-d-852087-9 devstack@n-api.service[106310]: DEBUG oslo_db.sqlalchemy.engines [None req-b1f8daf3-4b21-48b4-9cc7-9c205b4647c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106310) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:16:42.781793 n-d-852087-9 devstack@n-api.service[106310]: DEBUG dbcounter [-] [106310] Writer thread running {{(pid=106310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:16:42.783794 n-d-852087-9 devstack@n-api.service[106309]: INFO dbcounter [None req-bc2e2a9a-3ec5-4f4e-8625-4df4e99c4b11 None None] Registered counter for database nova_cell0 Sep 07 12:16:42.793034 n-d-852087-9 devstack@n-api.service[106309]: DEBUG oslo_db.sqlalchemy.engines [None req-bc2e2a9a-3ec5-4f4e-8625-4df4e99c4b11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106309) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:16:42.797681 n-d-852087-9 devstack@n-api.service[106309]: DEBUG dbcounter [-] [106309] Writer thread running {{(pid=106309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:16:43.133546 n-d-852087-9 devstack@n-api.service[106310]: WARNING keystonemiddleware.auth_token [None req-b1f8daf3-4b21-48b4-9cc7-9c205b4647c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 12:16:43.139658 n-d-852087-9 devstack@n-api.service[106309]: WARNING keystonemiddleware.auth_token [None req-bc2e2a9a-3ec5-4f4e-8625-4df4e99c4b11 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 12:16:43.140996 n-d-852087-9 devstack@n-api.service[106310]: WARNING keystonemiddleware.auth_token [None req-b1f8daf3-4b21-48b4-9cc7-9c205b4647c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 12:16:43.148384 n-d-852087-9 devstack@n-api.service[106309]: WARNING keystonemiddleware.auth_token [None req-bc2e2a9a-3ec5-4f4e-8625-4df4e99c4b11 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 12:16:43.524331 n-d-852087-9 devstack@n-api.service[106310]: WARNING keystonemiddleware.auth_token [None req-b1f8daf3-4b21-48b4-9cc7-9c205b4647c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 12:16:43.526588 n-d-852087-9 devstack@n-api.service[106309]: WARNING keystonemiddleware.auth_token [None req-bc2e2a9a-3ec5-4f4e-8625-4df4e99c4b11 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 12:16:43.532382 n-d-852087-9 devstack@n-api.service[106310]: WARNING keystonemiddleware.auth_token [None req-b1f8daf3-4b21-48b4-9cc7-9c205b4647c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 12:16:43.537968 n-d-852087-9 devstack@n-api.service[106310]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5569594459c0 pid: 106310 (default app) Sep 07 12:16:43.540110 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-b1f8daf3-4b21-48b4-9cc7-9c205b4647c7 None None] Calling method '>' {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:16:43.541303 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-b1f8daf3-4b21-48b4-9cc7-9c205b4647c7 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001769 Sep 07 12:16:43.541738 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Wed Sep 7 12:16:43 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:16:43.543545 n-d-852087-9 devstack@n-api.service[106309]: WARNING keystonemiddleware.auth_token [None req-bc2e2a9a-3ec5-4f4e-8625-4df4e99c4b11 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 12:16:43.548680 n-d-852087-9 devstack@n-api.service[106309]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5569594459c0 pid: 106309 (default app) Sep 07 12:18:10.652303 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-b1f8daf3-4b21-48b4-9cc7-9c205b4647c7 None None] Calling method '>' {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:18:10.653345 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-b1f8daf3-4b21-48b4-9cc7-9c205b4647c7 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Sep 07 12:18:10.654132 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 931 bytes} [Wed Sep 7 12:18:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:18:10.673107 n-d-852087-9 devstack@n-api.service[106309]: DEBUG dbcounter [-] [106309] Writing DB stats nova_api:SELECT=3 {{(pid=106309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:18:10.674074 n-d-852087-9 devstack@n-api.service[106309]: DEBUG dbcounter [-] [106309] Writing DB stats nova_cell0:SELECT=3 {{(pid=106309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:18:10.675121 n-d-852087-9 devstack@n-api.service[106309]: DEBUG dbcounter [-] [106309] Writing DB stats nova_cell1:SELECT=3 {{(pid=106309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:18:10.676104 n-d-852087-9 devstack@n-api.service[106309]: DEBUG dbcounter [-] [106309] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:18:11.793013 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-894d55d4-e504-49af-bce8-64526de18eb7 admin admin] Calling method '>' {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:18:11.835195 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-894d55d4-e504-49af-bce8-64526de18eb7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.169335 Sep 07 12:18:11.835807 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Sep 7 12:18:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:18:14.676390 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-b1f8daf3-4b21-48b4-9cc7-9c205b4647c7 None None] Calling method '>' {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:18:14.677412 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-b1f8daf3-4b21-48b4-9cc7-9c205b4647c7 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 07 12:18:14.678131 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 931 bytes} [Wed Sep 7 12:18:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:18:15.286207 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-314bd10f-403d-4a64-91c0-5dd26a9b02cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "id": "c1", "rxtx_factor": 1.0, "name": "cirros256", "ram": 256, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:18:15.341975 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-314bd10f-403d-4a64-91c0-5dd26a9b02cb admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.656982 Sep 07 12:18:15.342544 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Sep 7 12:18:14 2022] POST /compute/v2.1/flavors => generated 407 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:18:15.358262 n-d-852087-9 devstack@n-api.service[106310]: DEBUG dbcounter [-] [106310] Writing DB stats nova_api:SELECT=3 {{(pid=106310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:18:15.359550 n-d-852087-9 devstack@n-api.service[106310]: DEBUG dbcounter [-] [106310] Writing DB stats nova_cell0:SELECT=3 {{(pid=106310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:18:15.360343 n-d-852087-9 devstack@n-api.service[106310]: DEBUG dbcounter [-] [106310] Writing DB stats nova_cell1:SELECT=3 {{(pid=106310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:18:15.361201 n-d-852087-9 devstack@n-api.service[106310]: DEBUG dbcounter [-] [106310] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:18:15.586139 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-3f0cf258-a6ed-4b3f-a4f0-6b7f709e5c0b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:18:15.664322 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-3f0cf258-a6ed-4b3f-a4f0-6b7f709e5c0b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.312836 Sep 07 12:18:15.665116 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Sep 7 12:18:15 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:18:18.408719 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-314bd10f-403d-4a64-91c0-5dd26a9b02cb admin admin] Calling method '>' {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:18:18.410502 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-314bd10f-403d-4a64-91c0-5dd26a9b02cb admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002279 Sep 07 12:18:18.411077 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 931 bytes} [Wed Sep 7 12:18:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:18:19.265541 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-5ff7a1d3-bf3a-4043-8834-b43c1d684793 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "disk": 5, "id": "d1", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds512M"}} {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:18:19.315988 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-5ff7a1d3-bf3a-4043-8834-b43c1d684793 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.897297 Sep 07 12:18:19.317125 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Sep 7 12:18:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:18:19.343328 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-ed85b7af-06f9-4d48-858f-a3464bcadb9a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:18:19.418644 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-ed85b7af-06f9-4d48-858f-a3464bcadb9a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087255 Sep 07 12:18:19.420536 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Sep 7 12:18:19 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:18:22.483308 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-5ff7a1d3-bf3a-4043-8834-b43c1d684793 admin admin] Calling method '>' {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:18:22.484353 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-5ff7a1d3-bf3a-4043-8834-b43c1d684793 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Sep 07 12:18:22.492173 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 931 bytes} [Wed Sep 7 12:18:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:18:23.091300 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-57a24db8-b98a-4774-a31c-1c9ecadd2402 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 1024, "id": "d2", "disk": 10, "vcpus": 1, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:18:23.113115 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-57a24db8-b98a-4774-a31c-1c9ecadd2402 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.618462 Sep 07 12:18:23.113755 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Sep 7 12:18:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:18:23.126630 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-8411105c-a5e8-4ef3-9ad5-0ddd9e12050d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:18:23.154987 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-8411105c-a5e8-4ef3-9ad5-0ddd9e12050d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031069 Sep 07 12:18:23.155623 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Sep 7 12:18:23 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:18:25.833986 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-57a24db8-b98a-4774-a31c-1c9ecadd2402 admin admin] Calling method '>' {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:18:25.835119 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-57a24db8-b98a-4774-a31c-1c9ecadd2402 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001930 Sep 07 12:18:25.837542 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 931 bytes} [Wed Sep 7 12:18:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:18:26.342931 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-0f7dc4bc-758e-4fb8-987c-927868cd7a70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "os-flavor-access:is_public": true, "id": "d3", "vcpus": 2, "disk": 10, "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:18:26.382701 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-0f7dc4bc-758e-4fb8-987c-927868cd7a70 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.539559 Sep 07 12:18:26.383283 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Sep 7 12:18:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:18:26.399320 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-9efce173-96d3-4ea4-aac3-96c73ecfce64 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:18:26.434884 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-9efce173-96d3-4ea4-aac3-96c73ecfce64 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041960 Sep 07 12:18:26.435569 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Sep 7 12:18:26 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:18:29.169021 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-0f7dc4bc-758e-4fb8-987c-927868cd7a70 admin admin] Calling method '>' {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:18:29.170080 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-0f7dc4bc-758e-4fb8-987c-927868cd7a70 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Sep 07 12:18:29.170650 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 931 bytes} [Wed Sep 7 12:18:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:18:29.648574 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-fa06ea2b-926c-4582-bf54-f541a7fed951 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 4096, "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "name": "ds4G", "id": "d4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:18:29.675779 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-fa06ea2b-926c-4582-bf54-f541a7fed951 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.497625 Sep 07 12:18:29.676780 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Sep 7 12:18:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 12:18:29.691513 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-55ffcc8b-8ab8-4009-a210-00b4fc7870d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:18:29.725581 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-55ffcc8b-8ab8-4009-a210-00b4fc7870d6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038833 Sep 07 12:18:29.739176 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Sep 7 12:18:29 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:18:32.500283 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-fa06ea2b-926c-4582-bf54-f541a7fed951 admin admin] Calling method '>' {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:18:32.501270 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-fa06ea2b-926c-4582-bf54-f541a7fed951 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001700 Sep 07 12:18:32.501752 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 931 bytes} [Wed Sep 7 12:18:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:18:32.975040 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-565730c4-b0f2-4d3d-9eda-d2aa2196794b admin admin] Calling method '>' {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:18:33.002780 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-565730c4-b0f2-4d3d-9eda-d2aa2196794b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.493533 Sep 07 12:18:33.003734 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Sep 7 12:18:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:18:35.742649 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-fa06ea2b-926c-4582-bf54-f541a7fed951 admin admin] Calling method '>' {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:18:35.744242 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-fa06ea2b-926c-4582-bf54-f541a7fed951 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002256 Sep 07 12:18:35.744822 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 931 bytes} [Wed Sep 7 12:18:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:18:36.251932 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-b7064b05-f5f6-493e-9bc4-0ed5b736bac5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "m1.tiny", "vcpus": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0}} {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:18:36.273212 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-b7064b05-f5f6-493e-9bc4-0ed5b736bac5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.521681 Sep 07 12:18:36.273781 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Sep 7 12:18:35 2022] POST /compute/v2.1/flavors => generated 402 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:18:36.287380 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-3301dd2e-eaf8-4092-931e-616601a6a22b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:18:36.315682 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-3301dd2e-eaf8-4092-931e-616601a6a22b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032352 Sep 07 12:18:36.316314 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Sep 7 12:18:36 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:18:38.986502 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-b7064b05-f5f6-493e-9bc4-0ed5b736bac5 admin admin] Calling method '>' {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:18:38.987528 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-b7064b05-f5f6-493e-9bc4-0ed5b736bac5 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Sep 07 12:18:38.987910 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 931 bytes} [Wed Sep 7 12:18:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:18:39.440552 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-5aa1920a-5558-4935-b7ad-f54fd6600f25 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "disk": 20, "vcpus": 1, "id": "2", "ram": 2048}} {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:18:39.462772 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-5aa1920a-5558-4935-b7ad-f54fd6600f25 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.468066 Sep 07 12:18:39.463431 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Sep 7 12:18:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:18:39.477409 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-302609d3-34c3-4a7f-8741-2d12faf9aff6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:18:39.508660 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-302609d3-34c3-4a7f-8741-2d12faf9aff6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036531 Sep 07 12:18:39.509535 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Sep 7 12:18:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:18:42.320695 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-5aa1920a-5558-4935-b7ad-f54fd6600f25 admin admin] Calling method '>' {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:18:42.321757 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-5aa1920a-5558-4935-b7ad-f54fd6600f25 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 07 12:18:42.322169 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 931 bytes} [Wed Sep 7 12:18:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:18:42.841692 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-737c2574-9218-49d2-877f-1c82f0dfd0de admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "name": "m1.medium", "vcpus": 2, "id": "3"}} {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:18:42.864653 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-737c2574-9218-49d2-877f-1c82f0dfd0de admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.535547 Sep 07 12:18:42.865384 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Sep 7 12:18:42 2022] POST /compute/v2.1/flavors => generated 406 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 12:18:42.880779 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-012a5283-efa1-4d3e-b4ca-ffb577af06ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:18:42.893666 n-d-852087-9 devstack@n-api.service[106309]: DEBUG dbcounter [-] [106309] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:18:43.043530 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-012a5283-efa1-4d3e-b4ca-ffb577af06ed admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.167465 Sep 07 12:18:43.046747 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Sep 7 12:18:42 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:18:45.986137 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-737c2574-9218-49d2-877f-1c82f0dfd0de admin admin] Calling method '>' {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:18:45.987998 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-737c2574-9218-49d2-877f-1c82f0dfd0de admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002286 Sep 07 12:18:45.988516 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 931 bytes} [Wed Sep 7 12:18:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:18:46.555407 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-d1103816-6327-480c-8739-95526a69e29f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "swap": 0, "os-flavor-access:is_public": true, "disk": 80, "rxtx_factor": 1.0}} {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:18:46.582822 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-d1103816-6327-480c-8739-95526a69e29f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.584341 Sep 07 12:18:46.583824 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Sep 7 12:18:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 12:18:46.596932 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-195ef8f6-4fd7-4dcc-893a-5c7dc2a40428 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:18:46.603304 n-d-852087-9 devstack@n-api.service[106310]: DEBUG dbcounter [-] [106310] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=106310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:18:46.632743 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-195ef8f6-4fd7-4dcc-893a-5c7dc2a40428 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039648 Sep 07 12:18:46.633606 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Sep 7 12:18:46 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:18:49.688889 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-d1103816-6327-480c-8739-95526a69e29f admin admin] Calling method '>' {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:18:49.690925 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-d1103816-6327-480c-8739-95526a69e29f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002562 Sep 07 12:18:49.691563 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 931 bytes} [Wed Sep 7 12:18:49 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:18:50.284006 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-a84bef71-71f7-4025-a4ce-f1847c4ec7ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "swap": 0, "ram": 16384, "rxtx_factor": 1.0, "id": "5", "vcpus": 8, "os-flavor-access:is_public": true}} {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:18:50.308131 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-a84bef71-71f7-4025-a4ce-f1847c4ec7ee admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.608129 Sep 07 12:18:50.315676 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Sep 7 12:18:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:18:50.339299 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-53fae270-0ccd-4aea-a380-0948184bd925 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:18:50.371921 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-53fae270-0ccd-4aea-a380-0948184bd925 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040174 Sep 07 12:18:50.372716 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Sep 7 12:18:50 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:19:11.653325 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-a84bef71-71f7-4025-a4ce-f1847c4ec7ee admin admin] Calling method '>' {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:19:11.654404 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-a84bef71-71f7-4025-a4ce-f1847c4ec7ee admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Sep 07 12:19:11.654808 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 931 bytes} [Wed Sep 7 12:19:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:19:11.665787 n-d-852087-9 devstack@n-api.service[106309]: DEBUG dbcounter [-] [106309] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:19:12.156327 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-2a1a8fc9-ef3b-4d95-ae42-22e676d8c48c admin admin] Calling method '>' {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:19:12.175644 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-2a1a8fc9-ef3b-4d95-ae42-22e676d8c48c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.514388 Sep 07 12:19:12.176178 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Sep 7 12:19:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:19:13.571468 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-a84bef71-71f7-4025-a4ce-f1847c4ec7ee admin admin] Calling method '>' {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:19:13.572486 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-a84bef71-71f7-4025-a4ce-f1847c4ec7ee admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Sep 07 12:19:13.572925 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Sep 7 12:19:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:19:14.190412 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-9a43cda8-f77c-404e-8e3d-d79f298d6bb2 admin admin] Calling method '>' {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:19:14.196731 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.wsgi [None req-9a43cda8-f77c-404e-8e3d-d79f298d6bb2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 07 12:19:14.200628 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-9a43cda8-f77c-404e-8e3d-d79f298d6bb2 admin admin] Request method failure captured: Sep 07 12:19:14.200628 n-d-852087-9 devstack@n-api.service[106309]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 07 12:19:14.200628 n-d-852087-9 devstack@n-api.service[106309]: Accept: application/json Sep 07 12:19:14.200628 n-d-852087-9 devstack@n-api.service[106309]: Accept-Encoding: gzip, deflate Sep 07 12:19:14.200628 n-d-852087-9 devstack@n-api.service[106309]: Connection: keep-alive Sep 07 12:19:14.200628 n-d-852087-9 devstack@n-api.service[106309]: Content-Length: 0 Sep 07 12:19:14.200628 n-d-852087-9 devstack@n-api.service[106309]: Host: 10.222.0.16 Sep 07 12:19:14.200628 n-d-852087-9 devstack@n-api.service[106309]: Openstack-Api-Version: compute 2.92 Sep 07 12:19:14.200628 n-d-852087-9 devstack@n-api.service[106309]: Openstack-System-Scope: None Sep 07 12:19:14.200628 n-d-852087-9 devstack@n-api.service[106309]: User-Agent: python-novaclient Sep 07 12:19:14.200628 n-d-852087-9 devstack@n-api.service[106309]: X-Auth-Token: gAAAAABjGIxB3z81PSrCJ_a9za3FeueDMlCTclenWSjFkbQsJpeig3khD9Nhssh6lVJzJP6HoKh0TaKmQpPdfegibCe0DE5Y9_d7xSkjYc2_ISQvLhpoIPa8BNgH0L_nUL0ssBOdg8q-u3Z3OfVuhkH3qoBQveyzXaFzcF6B52whCWzIsEwzMMM Sep 07 12:19:14.200628 n-d-852087-9 devstack@n-api.service[106309]: X-Domain-Id: None Sep 07 12:19:14.200628 n-d-852087-9 devstack@n-api.service[106309]: X-Domain-Name: None Sep 07 12:19:14.200628 n-d-852087-9 devstack@n-api.service[106309]: X-Identity-Status: Confirmed Sep 07 12:19:14.200628 n-d-852087-9 devstack@n-api.service[106309]: X-Is-Admin-Project: True Sep 07 12:19:14.200628 n-d-852087-9 devstack@n-api.service[106309]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 12:19:14.200628 n-d-852087-9 devstack@n-api.service[106309]: X-Project-Domain-Id: default Sep 07 12:19:14.200628 n-d-852087-9 devstack@n-api.service[106309]: X-Project-Domain-Name: Default Sep 07 12:19:14.200628 n-d-852087-9 devstack@n-api.service[106309]: X-Project-Id: 71e01ce23845431b825d0c885c54c9d5 Sep 07 12:19:14.200628 n-d-852087-9 devstack@n-api.service[106309]: X-Project-Name: admin Sep 07 12:19:14.200628 n-d-852087-9 devstack@n-api.service[106309]: X-Role: reader,member,admin Sep 07 12:19:14.200628 n-d-852087-9 devstack@n-api.service[106309]: X-Roles: reader,member,admin Sep 07 12:19:14.202252 n-d-852087-9 devstack@n-api.service[106309]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71e01ce23845431b825d0c885c54c9d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_71e01ce23845431b825d0c885c54c9d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/71e01ce23845431b825d0c885c54c9d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71e01ce23845431b825d0c885c54c9d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:19:14.202252 n-d-852087-9 devstack@n-api.service[106309]: X-Tenant: admin Sep 07 12:19:14.202252 n-d-852087-9 devstack@n-api.service[106309]: X-Tenant-Id: 71e01ce23845431b825d0c885c54c9d5 Sep 07 12:19:14.202252 n-d-852087-9 devstack@n-api.service[106309]: X-Tenant-Name: admin Sep 07 12:19:14.202252 n-d-852087-9 devstack@n-api.service[106309]: X-User: admin Sep 07 12:19:14.202252 n-d-852087-9 devstack@n-api.service[106309]: X-User-Domain-Id: default Sep 07 12:19:14.202252 n-d-852087-9 devstack@n-api.service[106309]: X-User-Domain-Name: Default Sep 07 12:19:14.202252 n-d-852087-9 devstack@n-api.service[106309]: X-User-Id: e0757902d8cb498abbec628632bd0089 Sep 07 12:19:14.202252 n-d-852087-9 devstack@n-api.service[106309]: X-User-Name: admin Sep 07 12:19:14.202252 n-d-852087-9 devstack@n-api.service[106309]: method: > Sep 07 12:19:14.202252 n-d-852087-9 devstack@n-api.service[106309]: exception: Flavor 42 could not be found. Sep 07 12:19:14.202252 n-d-852087-9 devstack@n-api.service[106309]: action_args: {'id': '42'} Sep 07 12:19:14.202252 n-d-852087-9 devstack@n-api.service[106309]: {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:19:14.202252 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:19:14.203111 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 12:19:14.203111 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 12:19:14.203111 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 12:19:14.203111 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 12:19:14.203111 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:19:14.203111 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:19:14.203111 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 12:19:14.203111 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 12:19:14.203111 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 12:19:14.203111 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:19:14.203111 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 12:19:14.203111 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 12:19:14.203111 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 07 12:19:14.203111 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi Sep 07 12:19:14.203111 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:19:14.203111 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi Sep 07 12:19:14.203111 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:19:14.203111 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:19:14.203111 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:19:14.204395 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:19:14.204395 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:19:14.204395 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:19:14.204395 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:19:14.204395 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 12:19:14.204395 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:19:14.204395 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 07 12:19:14.204395 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi Sep 07 12:19:14.204395 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:19:14.204395 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi Sep 07 12:19:14.204395 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:19:14.204395 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:19:14.204395 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:19:14.204395 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:19:14.204395 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:19:14.204395 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 07 12:19:14.204395 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi Sep 07 12:19:14.204395 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-9a43cda8-f77c-404e-8e3d-d79f298d6bb2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106309) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:19:14.205518 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-9a43cda8-f77c-404e-8e3d-d79f298d6bb2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.431566 Sep 07 12:19:14.205518 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Sep 7 12:19:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 433 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 12:19:14.212732 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-f78cf3dc-8ae1-474e-82f8-efbd7cea3ded admin admin] Calling method '>' {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:19:14.217143 n-d-852087-9 devstack@n-api.service[106310]: DEBUG dbcounter [-] [106310] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=106310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:19:14.237119 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-f78cf3dc-8ae1-474e-82f8-efbd7cea3ded admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028268 Sep 07 12:19:14.237767 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Sep 7 12:19:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:19:14.253523 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-216e3e7c-aa10-4d40-8c38-ed057537c5cd admin admin] Calling method '>' {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:19:14.278856 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-216e3e7c-aa10-4d40-8c38-ed057537c5cd admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.029414 Sep 07 12:19:14.279436 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Sep 7 12:19:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:19:14.289516 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-2070afd1-ccd5-4b67-8840-e42c8cf72b6e admin admin] Calling method '>' {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:19:14.296235 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.wsgi [None req-2070afd1-ccd5-4b67-8840-e42c8cf72b6e admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 07 12:19:14.299590 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-2070afd1-ccd5-4b67-8840-e42c8cf72b6e admin admin] Request method failure captured: Sep 07 12:19:14.299590 n-d-852087-9 devstack@n-api.service[106310]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 07 12:19:14.299590 n-d-852087-9 devstack@n-api.service[106310]: Accept: application/json Sep 07 12:19:14.299590 n-d-852087-9 devstack@n-api.service[106310]: Accept-Encoding: gzip, deflate Sep 07 12:19:14.299590 n-d-852087-9 devstack@n-api.service[106310]: Connection: keep-alive Sep 07 12:19:14.299590 n-d-852087-9 devstack@n-api.service[106310]: Content-Length: 0 Sep 07 12:19:14.299590 n-d-852087-9 devstack@n-api.service[106310]: Host: 10.222.0.16 Sep 07 12:19:14.299590 n-d-852087-9 devstack@n-api.service[106310]: Openstack-Api-Version: compute 2.92 Sep 07 12:19:14.299590 n-d-852087-9 devstack@n-api.service[106310]: Openstack-System-Scope: None Sep 07 12:19:14.299590 n-d-852087-9 devstack@n-api.service[106310]: User-Agent: python-novaclient Sep 07 12:19:14.299590 n-d-852087-9 devstack@n-api.service[106310]: X-Auth-Token: gAAAAABjGIxB3z81PSrCJ_a9za3FeueDMlCTclenWSjFkbQsJpeig3khD9Nhssh6lVJzJP6HoKh0TaKmQpPdfegibCe0DE5Y9_d7xSkjYc2_ISQvLhpoIPa8BNgH0L_nUL0ssBOdg8q-u3Z3OfVuhkH3qoBQveyzXaFzcF6B52whCWzIsEwzMMM Sep 07 12:19:14.299590 n-d-852087-9 devstack@n-api.service[106310]: X-Domain-Id: None Sep 07 12:19:14.299590 n-d-852087-9 devstack@n-api.service[106310]: X-Domain-Name: None Sep 07 12:19:14.299590 n-d-852087-9 devstack@n-api.service[106310]: X-Identity-Status: Confirmed Sep 07 12:19:14.299590 n-d-852087-9 devstack@n-api.service[106310]: X-Is-Admin-Project: True Sep 07 12:19:14.299590 n-d-852087-9 devstack@n-api.service[106310]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 12:19:14.299590 n-d-852087-9 devstack@n-api.service[106310]: X-Project-Domain-Id: default Sep 07 12:19:14.299590 n-d-852087-9 devstack@n-api.service[106310]: X-Project-Domain-Name: Default Sep 07 12:19:14.299590 n-d-852087-9 devstack@n-api.service[106310]: X-Project-Id: 71e01ce23845431b825d0c885c54c9d5 Sep 07 12:19:14.299590 n-d-852087-9 devstack@n-api.service[106310]: X-Project-Name: admin Sep 07 12:19:14.299590 n-d-852087-9 devstack@n-api.service[106310]: X-Role: reader,member,admin Sep 07 12:19:14.299590 n-d-852087-9 devstack@n-api.service[106310]: X-Roles: reader,member,admin Sep 07 12:19:14.301215 n-d-852087-9 devstack@n-api.service[106310]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71e01ce23845431b825d0c885c54c9d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_71e01ce23845431b825d0c885c54c9d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/71e01ce23845431b825d0c885c54c9d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71e01ce23845431b825d0c885c54c9d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:19:14.301215 n-d-852087-9 devstack@n-api.service[106310]: X-Tenant: admin Sep 07 12:19:14.301215 n-d-852087-9 devstack@n-api.service[106310]: X-Tenant-Id: 71e01ce23845431b825d0c885c54c9d5 Sep 07 12:19:14.301215 n-d-852087-9 devstack@n-api.service[106310]: X-Tenant-Name: admin Sep 07 12:19:14.301215 n-d-852087-9 devstack@n-api.service[106310]: X-User: admin Sep 07 12:19:14.301215 n-d-852087-9 devstack@n-api.service[106310]: X-User-Domain-Id: default Sep 07 12:19:14.301215 n-d-852087-9 devstack@n-api.service[106310]: X-User-Domain-Name: Default Sep 07 12:19:14.301215 n-d-852087-9 devstack@n-api.service[106310]: X-User-Id: e0757902d8cb498abbec628632bd0089 Sep 07 12:19:14.301215 n-d-852087-9 devstack@n-api.service[106310]: X-User-Name: admin Sep 07 12:19:14.301215 n-d-852087-9 devstack@n-api.service[106310]: method: > Sep 07 12:19:14.301215 n-d-852087-9 devstack@n-api.service[106310]: exception: Flavor 42 could not be found. Sep 07 12:19:14.301215 n-d-852087-9 devstack@n-api.service[106310]: action_args: {'id': '42'} Sep 07 12:19:14.301215 n-d-852087-9 devstack@n-api.service[106310]: {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:19:14.301215 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:19:14.302377 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 12:19:14.302377 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 12:19:14.302377 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 12:19:14.302377 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 12:19:14.302377 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:19:14.302377 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:19:14.302377 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 12:19:14.302377 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 12:19:14.302377 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 12:19:14.302377 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:19:14.302377 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 12:19:14.302377 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 12:19:14.302377 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 07 12:19:14.302377 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi Sep 07 12:19:14.302377 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:19:14.302377 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi Sep 07 12:19:14.302377 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:19:14.302377 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:19:14.302377 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:19:14.303679 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:19:14.303679 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:19:14.303679 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:19:14.303679 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:19:14.303679 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 12:19:14.303679 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:19:14.303679 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 07 12:19:14.303679 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi Sep 07 12:19:14.303679 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:19:14.303679 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi Sep 07 12:19:14.303679 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:19:14.303679 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:19:14.303679 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:19:14.303679 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:19:14.303679 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:19:14.303679 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 07 12:19:14.303679 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi Sep 07 12:19:14.303679 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-2070afd1-ccd5-4b67-8840-e42c8cf72b6e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:19:14.304929 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-2070afd1-ccd5-4b67-8840-e42c8cf72b6e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015269 Sep 07 12:19:14.304929 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Sep 7 12:19:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 12:19:15.575788 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-216e3e7c-aa10-4d40-8c38-ed057537c5cd admin admin] Calling method '>' {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:19:15.576827 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-216e3e7c-aa10-4d40-8c38-ed057537c5cd admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Sep 07 12:19:15.577236 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Sep 7 12:19:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:19:16.140408 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-6ac435b6-dcf7-48e4-a52e-1a8b13e7ad1d admin admin] Calling method '>' {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:19:16.146541 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.wsgi [None req-6ac435b6-dcf7-48e4-a52e-1a8b13e7ad1d admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 07 12:19:16.148096 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-6ac435b6-dcf7-48e4-a52e-1a8b13e7ad1d admin admin] Request method failure captured: Sep 07 12:19:16.148096 n-d-852087-9 devstack@n-api.service[106310]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 07 12:19:16.148096 n-d-852087-9 devstack@n-api.service[106310]: Accept: application/json Sep 07 12:19:16.148096 n-d-852087-9 devstack@n-api.service[106310]: Accept-Encoding: gzip, deflate Sep 07 12:19:16.148096 n-d-852087-9 devstack@n-api.service[106310]: Connection: keep-alive Sep 07 12:19:16.148096 n-d-852087-9 devstack@n-api.service[106310]: Content-Length: 0 Sep 07 12:19:16.148096 n-d-852087-9 devstack@n-api.service[106310]: Host: 10.222.0.16 Sep 07 12:19:16.148096 n-d-852087-9 devstack@n-api.service[106310]: Openstack-Api-Version: compute 2.92 Sep 07 12:19:16.148096 n-d-852087-9 devstack@n-api.service[106310]: Openstack-System-Scope: None Sep 07 12:19:16.148096 n-d-852087-9 devstack@n-api.service[106310]: User-Agent: python-novaclient Sep 07 12:19:16.148096 n-d-852087-9 devstack@n-api.service[106310]: X-Auth-Token: gAAAAABjGIxDiuw_EjgGsGTVQVYtcbu9Pqi_g4CvJ8HUo5cT2gpkoW5EglfpGlQlyo3GQjILkHRuiJAzKTlJ5SgSZx0r5G6ktwjL656AuzXcNMrNynXke6C7fNKXSVbyf-_sjmCfjD89Add_T6rQ6gGVr4VNJICo7kJ5iLoH3jTVINNewhSgKbo Sep 07 12:19:16.148096 n-d-852087-9 devstack@n-api.service[106310]: X-Domain-Id: None Sep 07 12:19:16.148096 n-d-852087-9 devstack@n-api.service[106310]: X-Domain-Name: None Sep 07 12:19:16.148096 n-d-852087-9 devstack@n-api.service[106310]: X-Identity-Status: Confirmed Sep 07 12:19:16.148096 n-d-852087-9 devstack@n-api.service[106310]: X-Is-Admin-Project: True Sep 07 12:19:16.148096 n-d-852087-9 devstack@n-api.service[106310]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 12:19:16.148096 n-d-852087-9 devstack@n-api.service[106310]: X-Project-Domain-Id: default Sep 07 12:19:16.148096 n-d-852087-9 devstack@n-api.service[106310]: X-Project-Domain-Name: Default Sep 07 12:19:16.148096 n-d-852087-9 devstack@n-api.service[106310]: X-Project-Id: 71e01ce23845431b825d0c885c54c9d5 Sep 07 12:19:16.148096 n-d-852087-9 devstack@n-api.service[106310]: X-Project-Name: admin Sep 07 12:19:16.148096 n-d-852087-9 devstack@n-api.service[106310]: X-Role: reader,member,admin Sep 07 12:19:16.148096 n-d-852087-9 devstack@n-api.service[106310]: X-Roles: reader,member,admin Sep 07 12:19:16.149604 n-d-852087-9 devstack@n-api.service[106310]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71e01ce23845431b825d0c885c54c9d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_71e01ce23845431b825d0c885c54c9d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/71e01ce23845431b825d0c885c54c9d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71e01ce23845431b825d0c885c54c9d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:19:16.149604 n-d-852087-9 devstack@n-api.service[106310]: X-Tenant: admin Sep 07 12:19:16.149604 n-d-852087-9 devstack@n-api.service[106310]: X-Tenant-Id: 71e01ce23845431b825d0c885c54c9d5 Sep 07 12:19:16.149604 n-d-852087-9 devstack@n-api.service[106310]: X-Tenant-Name: admin Sep 07 12:19:16.149604 n-d-852087-9 devstack@n-api.service[106310]: X-User: admin Sep 07 12:19:16.149604 n-d-852087-9 devstack@n-api.service[106310]: X-User-Domain-Id: default Sep 07 12:19:16.149604 n-d-852087-9 devstack@n-api.service[106310]: X-User-Domain-Name: Default Sep 07 12:19:16.149604 n-d-852087-9 devstack@n-api.service[106310]: X-User-Id: e0757902d8cb498abbec628632bd0089 Sep 07 12:19:16.149604 n-d-852087-9 devstack@n-api.service[106310]: X-User-Name: admin Sep 07 12:19:16.149604 n-d-852087-9 devstack@n-api.service[106310]: method: > Sep 07 12:19:16.149604 n-d-852087-9 devstack@n-api.service[106310]: exception: Flavor 84 could not be found. Sep 07 12:19:16.149604 n-d-852087-9 devstack@n-api.service[106310]: action_args: {'id': '84'} Sep 07 12:19:16.149604 n-d-852087-9 devstack@n-api.service[106310]: {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:19:16.149604 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:19:16.150488 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 12:19:16.150488 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 12:19:16.150488 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 12:19:16.150488 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 12:19:16.150488 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:19:16.150488 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:19:16.150488 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 12:19:16.150488 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 12:19:16.150488 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 12:19:16.150488 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:19:16.150488 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 12:19:16.150488 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 12:19:16.150488 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 07 12:19:16.150488 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi Sep 07 12:19:16.150488 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:19:16.150488 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi Sep 07 12:19:16.150488 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:19:16.150488 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:19:16.150488 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:19:16.151612 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:19:16.151612 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:19:16.151612 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:19:16.151612 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:19:16.151612 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 12:19:16.151612 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:19:16.151612 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 07 12:19:16.151612 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi Sep 07 12:19:16.151612 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:19:16.151612 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi Sep 07 12:19:16.151612 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:19:16.151612 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:19:16.151612 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:19:16.151612 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:19:16.151612 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:19:16.151612 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 07 12:19:16.151612 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi Sep 07 12:19:16.151612 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-6ac435b6-dcf7-48e4-a52e-1a8b13e7ad1d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:19:16.152656 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-6ac435b6-dcf7-48e4-a52e-1a8b13e7ad1d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.428128 Sep 07 12:19:16.152656 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Sep 7 12:19:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 429 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 12:19:16.160221 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-c2679343-0501-48d6-a51d-66bc6b63441c admin admin] Calling method '>' {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:19:16.175934 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-c2679343-0501-48d6-a51d-66bc6b63441c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019286 Sep 07 12:19:16.176573 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Sep 7 12:19:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:19:16.186975 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-ba23026b-0816-43eb-be8d-67177632ae19 admin admin] Calling method '>' {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:19:16.202729 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-ba23026b-0816-43eb-be8d-67177632ae19 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019365 Sep 07 12:19:16.203300 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Sep 7 12:19:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:19:16.214036 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-7681d9f8-486e-48d5-9f8a-0321d7390fd2 admin admin] Calling method '>' {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:19:16.220162 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.wsgi [None req-7681d9f8-486e-48d5-9f8a-0321d7390fd2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 07 12:19:16.221729 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-7681d9f8-486e-48d5-9f8a-0321d7390fd2 admin admin] Request method failure captured: Sep 07 12:19:16.221729 n-d-852087-9 devstack@n-api.service[106309]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 07 12:19:16.221729 n-d-852087-9 devstack@n-api.service[106309]: Accept: application/json Sep 07 12:19:16.221729 n-d-852087-9 devstack@n-api.service[106309]: Accept-Encoding: gzip, deflate Sep 07 12:19:16.221729 n-d-852087-9 devstack@n-api.service[106309]: Connection: keep-alive Sep 07 12:19:16.221729 n-d-852087-9 devstack@n-api.service[106309]: Content-Length: 0 Sep 07 12:19:16.221729 n-d-852087-9 devstack@n-api.service[106309]: Host: 10.222.0.16 Sep 07 12:19:16.221729 n-d-852087-9 devstack@n-api.service[106309]: Openstack-Api-Version: compute 2.92 Sep 07 12:19:16.221729 n-d-852087-9 devstack@n-api.service[106309]: Openstack-System-Scope: None Sep 07 12:19:16.221729 n-d-852087-9 devstack@n-api.service[106309]: User-Agent: python-novaclient Sep 07 12:19:16.221729 n-d-852087-9 devstack@n-api.service[106309]: X-Auth-Token: gAAAAABjGIxDiuw_EjgGsGTVQVYtcbu9Pqi_g4CvJ8HUo5cT2gpkoW5EglfpGlQlyo3GQjILkHRuiJAzKTlJ5SgSZx0r5G6ktwjL656AuzXcNMrNynXke6C7fNKXSVbyf-_sjmCfjD89Add_T6rQ6gGVr4VNJICo7kJ5iLoH3jTVINNewhSgKbo Sep 07 12:19:16.221729 n-d-852087-9 devstack@n-api.service[106309]: X-Domain-Id: None Sep 07 12:19:16.221729 n-d-852087-9 devstack@n-api.service[106309]: X-Domain-Name: None Sep 07 12:19:16.221729 n-d-852087-9 devstack@n-api.service[106309]: X-Identity-Status: Confirmed Sep 07 12:19:16.221729 n-d-852087-9 devstack@n-api.service[106309]: X-Is-Admin-Project: True Sep 07 12:19:16.221729 n-d-852087-9 devstack@n-api.service[106309]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 12:19:16.221729 n-d-852087-9 devstack@n-api.service[106309]: X-Project-Domain-Id: default Sep 07 12:19:16.221729 n-d-852087-9 devstack@n-api.service[106309]: X-Project-Domain-Name: Default Sep 07 12:19:16.221729 n-d-852087-9 devstack@n-api.service[106309]: X-Project-Id: 71e01ce23845431b825d0c885c54c9d5 Sep 07 12:19:16.221729 n-d-852087-9 devstack@n-api.service[106309]: X-Project-Name: admin Sep 07 12:19:16.221729 n-d-852087-9 devstack@n-api.service[106309]: X-Role: reader,member,admin Sep 07 12:19:16.221729 n-d-852087-9 devstack@n-api.service[106309]: X-Roles: reader,member,admin Sep 07 12:19:16.225459 n-d-852087-9 devstack@n-api.service[106309]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71e01ce23845431b825d0c885c54c9d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_71e01ce23845431b825d0c885c54c9d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/71e01ce23845431b825d0c885c54c9d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71e01ce23845431b825d0c885c54c9d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:19:16.225459 n-d-852087-9 devstack@n-api.service[106309]: X-Tenant: admin Sep 07 12:19:16.225459 n-d-852087-9 devstack@n-api.service[106309]: X-Tenant-Id: 71e01ce23845431b825d0c885c54c9d5 Sep 07 12:19:16.225459 n-d-852087-9 devstack@n-api.service[106309]: X-Tenant-Name: admin Sep 07 12:19:16.225459 n-d-852087-9 devstack@n-api.service[106309]: X-User: admin Sep 07 12:19:16.225459 n-d-852087-9 devstack@n-api.service[106309]: X-User-Domain-Id: default Sep 07 12:19:16.225459 n-d-852087-9 devstack@n-api.service[106309]: X-User-Domain-Name: Default Sep 07 12:19:16.225459 n-d-852087-9 devstack@n-api.service[106309]: X-User-Id: e0757902d8cb498abbec628632bd0089 Sep 07 12:19:16.225459 n-d-852087-9 devstack@n-api.service[106309]: X-User-Name: admin Sep 07 12:19:16.225459 n-d-852087-9 devstack@n-api.service[106309]: method: > Sep 07 12:19:16.225459 n-d-852087-9 devstack@n-api.service[106309]: exception: Flavor 84 could not be found. Sep 07 12:19:16.225459 n-d-852087-9 devstack@n-api.service[106309]: action_args: {'id': '84'} Sep 07 12:19:16.225459 n-d-852087-9 devstack@n-api.service[106309]: {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:19:16.225459 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:19:16.227135 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 12:19:16.227135 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 12:19:16.227135 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 12:19:16.227135 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 12:19:16.227135 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:19:16.227135 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:19:16.227135 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 12:19:16.227135 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 12:19:16.227135 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 12:19:16.227135 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:19:16.227135 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 12:19:16.227135 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 12:19:16.227135 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 07 12:19:16.227135 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi Sep 07 12:19:16.227135 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:19:16.227135 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi Sep 07 12:19:16.227135 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:19:16.227135 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:19:16.227135 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:19:16.229416 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:19:16.229416 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:19:16.229416 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:19:16.229416 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:19:16.229416 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 12:19:16.229416 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:19:16.229416 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 07 12:19:16.229416 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi Sep 07 12:19:16.229416 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:19:16.229416 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi Sep 07 12:19:16.229416 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:19:16.229416 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:19:16.229416 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:19:16.229416 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:19:16.229416 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:19:16.229416 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 07 12:19:16.229416 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi Sep 07 12:19:16.229416 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-7681d9f8-486e-48d5-9f8a-0321d7390fd2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106309) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:19:16.231492 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-7681d9f8-486e-48d5-9f8a-0321d7390fd2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.013560 Sep 07 12:19:16.231492 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Sep 7 12:19:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 12:19:17.520793 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-ba23026b-0816-43eb-be8d-67177632ae19 admin admin] Calling method '>' {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:19:17.521827 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-ba23026b-0816-43eb-be8d-67177632ae19 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Sep 07 12:19:17.522233 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Sep 7 12:19:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:19:18.165596 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-1bfbaf63-1684-45e8-baec-38e70ea95e38 admin admin] Calling method '>' {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:19:18.173098 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.wsgi [None req-1bfbaf63-1684-45e8-baec-38e70ea95e38 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 07 12:19:18.174888 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-1bfbaf63-1684-45e8-baec-38e70ea95e38 admin admin] Request method failure captured: Sep 07 12:19:18.174888 n-d-852087-9 devstack@n-api.service[106309]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 07 12:19:18.174888 n-d-852087-9 devstack@n-api.service[106309]: Accept: application/json Sep 07 12:19:18.174888 n-d-852087-9 devstack@n-api.service[106309]: Accept-Encoding: gzip, deflate Sep 07 12:19:18.174888 n-d-852087-9 devstack@n-api.service[106309]: Connection: keep-alive Sep 07 12:19:18.174888 n-d-852087-9 devstack@n-api.service[106309]: Content-Length: 0 Sep 07 12:19:18.174888 n-d-852087-9 devstack@n-api.service[106309]: Host: 10.222.0.16 Sep 07 12:19:18.174888 n-d-852087-9 devstack@n-api.service[106309]: Openstack-Api-Version: compute 2.92 Sep 07 12:19:18.174888 n-d-852087-9 devstack@n-api.service[106309]: Openstack-System-Scope: None Sep 07 12:19:18.174888 n-d-852087-9 devstack@n-api.service[106309]: User-Agent: python-novaclient Sep 07 12:19:18.174888 n-d-852087-9 devstack@n-api.service[106309]: X-Auth-Token: gAAAAABjGIxFClaDVtQZ7dU6lgnPNUynE4gqmTrJX2lS2d4iZuilJdmkAchXnd7CCBFFyPviyPMtKpPUNZXX2Wt-69UHtJWdfsze1vwqms2zHApkMquLuRpd23dK7vNJVMTDGVAhbFM9tTDQdBK2VlUAJC-RoW1FRpj5MSzDslsg5NcmhPWGgiw Sep 07 12:19:18.174888 n-d-852087-9 devstack@n-api.service[106309]: X-Domain-Id: None Sep 07 12:19:18.174888 n-d-852087-9 devstack@n-api.service[106309]: X-Domain-Name: None Sep 07 12:19:18.174888 n-d-852087-9 devstack@n-api.service[106309]: X-Identity-Status: Confirmed Sep 07 12:19:18.174888 n-d-852087-9 devstack@n-api.service[106309]: X-Is-Admin-Project: True Sep 07 12:19:18.174888 n-d-852087-9 devstack@n-api.service[106309]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 12:19:18.174888 n-d-852087-9 devstack@n-api.service[106309]: X-Project-Domain-Id: default Sep 07 12:19:18.174888 n-d-852087-9 devstack@n-api.service[106309]: X-Project-Domain-Name: Default Sep 07 12:19:18.174888 n-d-852087-9 devstack@n-api.service[106309]: X-Project-Id: 71e01ce23845431b825d0c885c54c9d5 Sep 07 12:19:18.174888 n-d-852087-9 devstack@n-api.service[106309]: X-Project-Name: admin Sep 07 12:19:18.174888 n-d-852087-9 devstack@n-api.service[106309]: X-Role: reader,member,admin Sep 07 12:19:18.174888 n-d-852087-9 devstack@n-api.service[106309]: X-Roles: reader,member,admin Sep 07 12:19:18.176421 n-d-852087-9 devstack@n-api.service[106309]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71e01ce23845431b825d0c885c54c9d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_71e01ce23845431b825d0c885c54c9d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/71e01ce23845431b825d0c885c54c9d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71e01ce23845431b825d0c885c54c9d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:19:18.176421 n-d-852087-9 devstack@n-api.service[106309]: X-Tenant: admin Sep 07 12:19:18.176421 n-d-852087-9 devstack@n-api.service[106309]: X-Tenant-Id: 71e01ce23845431b825d0c885c54c9d5 Sep 07 12:19:18.176421 n-d-852087-9 devstack@n-api.service[106309]: X-Tenant-Name: admin Sep 07 12:19:18.176421 n-d-852087-9 devstack@n-api.service[106309]: X-User: admin Sep 07 12:19:18.176421 n-d-852087-9 devstack@n-api.service[106309]: X-User-Domain-Id: default Sep 07 12:19:18.176421 n-d-852087-9 devstack@n-api.service[106309]: X-User-Domain-Name: Default Sep 07 12:19:18.176421 n-d-852087-9 devstack@n-api.service[106309]: X-User-Id: e0757902d8cb498abbec628632bd0089 Sep 07 12:19:18.176421 n-d-852087-9 devstack@n-api.service[106309]: X-User-Name: admin Sep 07 12:19:18.176421 n-d-852087-9 devstack@n-api.service[106309]: method: > Sep 07 12:19:18.176421 n-d-852087-9 devstack@n-api.service[106309]: exception: Flavor 451 could not be found. Sep 07 12:19:18.176421 n-d-852087-9 devstack@n-api.service[106309]: action_args: {'id': '451'} Sep 07 12:19:18.176421 n-d-852087-9 devstack@n-api.service[106309]: {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:19:18.176421 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:19:18.177394 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 12:19:18.177394 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 12:19:18.177394 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 12:19:18.177394 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 12:19:18.177394 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:19:18.177394 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:19:18.177394 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 12:19:18.177394 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 12:19:18.177394 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 12:19:18.177394 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:19:18.177394 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 12:19:18.177394 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 12:19:18.177394 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 07 12:19:18.177394 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi Sep 07 12:19:18.177394 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:19:18.177394 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi Sep 07 12:19:18.177394 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:19:18.177394 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:19:18.177394 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:19:18.178701 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:19:18.178701 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:19:18.178701 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:19:18.178701 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:19:18.178701 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 12:19:18.178701 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:19:18.178701 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 07 12:19:18.178701 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi Sep 07 12:19:18.178701 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:19:18.178701 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi Sep 07 12:19:18.178701 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:19:18.178701 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:19:18.178701 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:19:18.178701 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:19:18.178701 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:19:18.178701 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 07 12:19:18.178701 n-d-852087-9 devstack@n-api.service[106309]: ERROR nova.api.openstack.wsgi Sep 07 12:19:18.178701 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-1bfbaf63-1684-45e8-baec-38e70ea95e38 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106309) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:19:18.180803 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-1bfbaf63-1684-45e8-baec-38e70ea95e38 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.510460 Sep 07 12:19:18.180803 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Sep 7 12:19:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 512 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 07 12:19:18.187622 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-9504679a-660e-401d-9124-8a7977e212a7 admin admin] Calling method '>' {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:19:18.205400 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-9504679a-660e-401d-9124-8a7977e212a7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021458 Sep 07 12:19:18.206047 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Sep 7 12:19:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:19:18.216501 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-d8bf4325-e4f0-47c8-ad10-05ea30131862 admin admin] Calling method '>' {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:19:18.231901 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-d8bf4325-e4f0-47c8-ad10-05ea30131862 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018916 Sep 07 12:19:18.232470 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Sep 7 12:19:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:19:18.242419 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-7613a70e-a643-4c27-b2fc-8a461263e002 admin admin] Calling method '>' {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:19:18.247906 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.wsgi [None req-7613a70e-a643-4c27-b2fc-8a461263e002 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 07 12:19:18.249432 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-7613a70e-a643-4c27-b2fc-8a461263e002 admin admin] Request method failure captured: Sep 07 12:19:18.249432 n-d-852087-9 devstack@n-api.service[106310]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 07 12:19:18.249432 n-d-852087-9 devstack@n-api.service[106310]: Accept: application/json Sep 07 12:19:18.249432 n-d-852087-9 devstack@n-api.service[106310]: Accept-Encoding: gzip, deflate Sep 07 12:19:18.249432 n-d-852087-9 devstack@n-api.service[106310]: Connection: keep-alive Sep 07 12:19:18.249432 n-d-852087-9 devstack@n-api.service[106310]: Content-Length: 0 Sep 07 12:19:18.249432 n-d-852087-9 devstack@n-api.service[106310]: Host: 10.222.0.16 Sep 07 12:19:18.249432 n-d-852087-9 devstack@n-api.service[106310]: Openstack-Api-Version: compute 2.92 Sep 07 12:19:18.249432 n-d-852087-9 devstack@n-api.service[106310]: Openstack-System-Scope: None Sep 07 12:19:18.249432 n-d-852087-9 devstack@n-api.service[106310]: User-Agent: python-novaclient Sep 07 12:19:18.249432 n-d-852087-9 devstack@n-api.service[106310]: X-Auth-Token: gAAAAABjGIxFClaDVtQZ7dU6lgnPNUynE4gqmTrJX2lS2d4iZuilJdmkAchXnd7CCBFFyPviyPMtKpPUNZXX2Wt-69UHtJWdfsze1vwqms2zHApkMquLuRpd23dK7vNJVMTDGVAhbFM9tTDQdBK2VlUAJC-RoW1FRpj5MSzDslsg5NcmhPWGgiw Sep 07 12:19:18.249432 n-d-852087-9 devstack@n-api.service[106310]: X-Domain-Id: None Sep 07 12:19:18.249432 n-d-852087-9 devstack@n-api.service[106310]: X-Domain-Name: None Sep 07 12:19:18.249432 n-d-852087-9 devstack@n-api.service[106310]: X-Identity-Status: Confirmed Sep 07 12:19:18.249432 n-d-852087-9 devstack@n-api.service[106310]: X-Is-Admin-Project: True Sep 07 12:19:18.249432 n-d-852087-9 devstack@n-api.service[106310]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 12:19:18.249432 n-d-852087-9 devstack@n-api.service[106310]: X-Project-Domain-Id: default Sep 07 12:19:18.249432 n-d-852087-9 devstack@n-api.service[106310]: X-Project-Domain-Name: Default Sep 07 12:19:18.249432 n-d-852087-9 devstack@n-api.service[106310]: X-Project-Id: 71e01ce23845431b825d0c885c54c9d5 Sep 07 12:19:18.249432 n-d-852087-9 devstack@n-api.service[106310]: X-Project-Name: admin Sep 07 12:19:18.249432 n-d-852087-9 devstack@n-api.service[106310]: X-Role: reader,member,admin Sep 07 12:19:18.249432 n-d-852087-9 devstack@n-api.service[106310]: X-Roles: reader,member,admin Sep 07 12:19:18.250928 n-d-852087-9 devstack@n-api.service[106310]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71e01ce23845431b825d0c885c54c9d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_71e01ce23845431b825d0c885c54c9d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/71e01ce23845431b825d0c885c54c9d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71e01ce23845431b825d0c885c54c9d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:19:18.250928 n-d-852087-9 devstack@n-api.service[106310]: X-Tenant: admin Sep 07 12:19:18.250928 n-d-852087-9 devstack@n-api.service[106310]: X-Tenant-Id: 71e01ce23845431b825d0c885c54c9d5 Sep 07 12:19:18.250928 n-d-852087-9 devstack@n-api.service[106310]: X-Tenant-Name: admin Sep 07 12:19:18.250928 n-d-852087-9 devstack@n-api.service[106310]: X-User: admin Sep 07 12:19:18.250928 n-d-852087-9 devstack@n-api.service[106310]: X-User-Domain-Id: default Sep 07 12:19:18.250928 n-d-852087-9 devstack@n-api.service[106310]: X-User-Domain-Name: Default Sep 07 12:19:18.250928 n-d-852087-9 devstack@n-api.service[106310]: X-User-Id: e0757902d8cb498abbec628632bd0089 Sep 07 12:19:18.250928 n-d-852087-9 devstack@n-api.service[106310]: X-User-Name: admin Sep 07 12:19:18.250928 n-d-852087-9 devstack@n-api.service[106310]: method: > Sep 07 12:19:18.250928 n-d-852087-9 devstack@n-api.service[106310]: exception: Flavor 451 could not be found. Sep 07 12:19:18.250928 n-d-852087-9 devstack@n-api.service[106310]: action_args: {'id': '451'} Sep 07 12:19:18.250928 n-d-852087-9 devstack@n-api.service[106310]: {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:19:18.250928 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:19:18.251747 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 12:19:18.251747 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 12:19:18.251747 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 12:19:18.251747 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 12:19:18.251747 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:19:18.251747 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:19:18.251747 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 12:19:18.251747 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 12:19:18.251747 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 12:19:18.251747 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:19:18.251747 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 12:19:18.251747 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 12:19:18.251747 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 07 12:19:18.251747 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi Sep 07 12:19:18.251747 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:19:18.251747 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi Sep 07 12:19:18.251747 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:19:18.251747 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:19:18.251747 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:19:18.252864 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:19:18.252864 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:19:18.252864 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:19:18.252864 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:19:18.252864 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 12:19:18.252864 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:19:18.252864 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 07 12:19:18.252864 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi Sep 07 12:19:18.252864 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:19:18.252864 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi Sep 07 12:19:18.252864 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:19:18.252864 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:19:18.252864 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:19:18.252864 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:19:18.252864 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:19:18.252864 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 07 12:19:18.252864 n-d-852087-9 devstack@n-api.service[106310]: ERROR nova.api.openstack.wsgi Sep 07 12:19:18.252864 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-7613a70e-a643-4c27-b2fc-8a461263e002 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:19:18.253888 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-7613a70e-a643-4c27-b2fc-8a461263e002 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012134 Sep 07 12:19:18.253888 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Sep 7 12:19:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 12:19:19.505332 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-d8bf4325-e4f0-47c8-ad10-05ea30131862 admin admin] Calling method '>' {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:19:19.508290 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-d8bf4325-e4f0-47c8-ad10-05ea30131862 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Sep 07 12:19:19.508290 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Sep 7 12:19:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:19:20.130365 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-7661644d-f1eb-4e7f-985e-0b1fb3b66822 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:19:20.154102 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-7661644d-f1eb-4e7f-985e-0b1fb3b66822 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.511220 Sep 07 12:19:20.154661 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Sep 7 12:19:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:19:21.460105 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-d8bf4325-e4f0-47c8-ad10-05ea30131862 admin admin] Calling method '>' {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:19:21.461441 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-d8bf4325-e4f0-47c8-ad10-05ea30131862 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001806 Sep 07 12:19:21.461900 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Sep 7 12:19:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:19:22.278120 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-33dd6c6a-dd54-4e69-88ba-6cc4eb4404fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:19:22.303190 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-33dd6c6a-dd54-4e69-88ba-6cc4eb4404fe admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.575255 Sep 07 12:19:22.303755 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Sep 7 12:19:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:19:23.595015 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-d8bf4325-e4f0-47c8-ad10-05ea30131862 admin admin] Calling method '>' {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:19:23.596151 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-d8bf4325-e4f0-47c8-ad10-05ea30131862 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Sep 07 12:19:23.596594 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Sep 7 12:19:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:19:24.197518 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-0f44ec3d-081c-4229-9598-059cea7b0317 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:19:24.220767 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-0f44ec3d-081c-4229-9598-059cea7b0317 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.484305 Sep 07 12:19:24.221325 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Sep 7 12:19:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 12:19:25.515346 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-d8bf4325-e4f0-47c8-ad10-05ea30131862 admin admin] Calling method '>' {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:19:25.516385 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-d8bf4325-e4f0-47c8-ad10-05ea30131862 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Sep 07 12:19:25.516946 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Sep 7 12:19:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:19:26.138930 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-a74d5abf-b91c-40d6-83a3-52ddae35b8a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:19:26.167161 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-a74d5abf-b91c-40d6-83a3-52ddae35b8a1 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.512929 Sep 07 12:19:26.167729 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Sep 7 12:19:25 2022] POST /compute/v2.1/flavors => generated 409 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 12:19:27.462233 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-d8bf4325-e4f0-47c8-ad10-05ea30131862 admin admin] Calling method '>' {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:19:27.463288 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-d8bf4325-e4f0-47c8-ad10-05ea30131862 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Sep 07 12:19:27.463675 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Sep 7 12:19:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:19:28.023670 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-153bbce9-e515-48c1-9642-6b176319df63 admin admin] Calling method '>' {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:19:28.044384 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-153bbce9-e515-48c1-9642-6b176319df63 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.444624 Sep 07 12:19:28.044931 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Wed Sep 7 12:19:27 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:20:29.809304 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-d8bf4325-e4f0-47c8-ad10-05ea30131862 admin admin] Calling method '>' {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:20:29.810317 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-d8bf4325-e4f0-47c8-ad10-05ea30131862 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001589 Sep 07 12:20:29.810737 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 931 bytes} [Wed Sep 7 12:20:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:20:29.820135 n-d-852087-9 devstack@n-api.service[106310]: DEBUG dbcounter [-] [106310] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:20:30.242626 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-498e7cca-f6d2-4d4d-9ab6-4158f2bea291 admin admin] Calling method '>' {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:20:30.264166 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-498e7cca-f6d2-4d4d-9ab6-4158f2bea291 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.446059 Sep 07 12:20:30.264734 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Sep 7 12:20:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:20:30.287234 n-d-852087-9 devstack@n-api.service[106309]: DEBUG dbcounter [-] [106309] Writing DB stats nova_api:SELECT=14 {{(pid=106309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:20:30.291414 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-de20fb96-d246-4e15-bdde-e0a1df6bdba7 admin admin] Calling method '>' {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:20:30.301659 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-de20fb96-d246-4e15-bdde-e0a1df6bdba7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015462 Sep 07 12:20:30.302574 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1283 bytes} [Wed Sep 7 12:20:30 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:20:30.318927 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-c6589dcf-849d-4353-8116-1d4944c1bde2 admin admin] Calling method '>' {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:20:30.328487 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-c6589dcf-849d-4353-8116-1d4944c1bde2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013830 Sep 07 12:20:30.329198 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1286 bytes} [Wed Sep 7 12:20:30 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:20:30.345994 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-50aff971-4201-40b0-aea0-00ac87942b0e admin admin] Calling method '>' {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:20:30.355302 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-50aff971-4201-40b0-aea0-00ac87942b0e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013384 Sep 07 12:20:30.355863 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1286 bytes} [Wed Sep 7 12:20:30 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:20:30.372455 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-0eeea7c2-ff68-4c5c-aa63-4fa335b4a63c admin admin] Calling method '>' {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:20:30.387005 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-0eeea7c2-ff68-4c5c-aa63-4fa335b4a63c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.021229 Sep 07 12:20:30.388024 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1283 bytes} [Wed Sep 7 12:20:30 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:26:24.118170 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-50aff971-4201-40b0-aea0-00ac87942b0e admin admin] Calling method '>' {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:26:24.119283 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-50aff971-4201-40b0-aea0-00ac87942b0e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Sep 07 12:26:24.119665 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Sep 7 12:26:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:26:24.261719 n-d-852087-9 devstack@n-api.service[106310]: DEBUG dbcounter [-] [106310] Writing DB stats nova_api:SELECT=6 {{(pid=106310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:26:24.422313 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-8d4bee6f-70e0-4fe7-a25c-6b29f31bbf26 admin admin] Calling method '>' {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:26:24.425999 n-d-852087-9 devstack@n-api.service[106310]: DEBUG oslo_concurrency.lockutils [None req-8d4bee6f-70e0-4fe7-a25c-6b29f31bbf26 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:26:24.426473 n-d-852087-9 devstack@n-api.service[106310]: DEBUG oslo_concurrency.lockutils [None req-8d4bee6f-70e0-4fe7-a25c-6b29f31bbf26 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:26:24.426896 n-d-852087-9 devstack@n-api.service[106310]: DEBUG oslo_concurrency.lockutils [None req-8d4bee6f-70e0-4fe7-a25c-6b29f31bbf26 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:26:24.427599 n-d-852087-9 devstack@n-api.service[106310]: DEBUG oslo_concurrency.lockutils [None req-8d4bee6f-70e0-4fe7-a25c-6b29f31bbf26 admin admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:26:24.428042 n-d-852087-9 devstack@n-api.service[106310]: DEBUG oslo_concurrency.lockutils [None req-8d4bee6f-70e0-4fe7-a25c-6b29f31bbf26 admin admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:26:24.428454 n-d-852087-9 devstack@n-api.service[106310]: DEBUG oslo_concurrency.lockutils [None req-8d4bee6f-70e0-4fe7-a25c-6b29f31bbf26 admin admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:26:24.471499 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-8d4bee6f-70e0-4fe7-a25c-6b29f31bbf26 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.211622 Sep 07 12:26:24.472072 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Sep 7 12:26:24 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:26:25.598761 n-d-852087-9 devstack@n-api.service[106309]: DEBUG nova.api.openstack.wsgi [None req-50aff971-4201-40b0-aea0-00ac87942b0e admin admin] Calling method '>' {{(pid=106309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:26:25.599841 n-d-852087-9 devstack@n-api.service[106309]: INFO nova.api.openstack.requestlog [None req-50aff971-4201-40b0-aea0-00ac87942b0e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Sep 07 12:26:25.600200 n-d-852087-9 devstack@n-api.service[106309]: [pid: 106309|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Sep 7 12:26:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:26:25.810729 n-d-852087-9 devstack@n-api.service[106310]: DEBUG nova.api.openstack.wsgi [None req-cf6b7607-6ddd-4643-899d-32cefbc9d6cf admin admin] Calling method '>' {{(pid=106310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:26:25.816319 n-d-852087-9 devstack@n-api.service[106310]: DEBUG oslo_concurrency.lockutils [None req-cf6b7607-6ddd-4643-899d-32cefbc9d6cf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:26:25.819174 n-d-852087-9 devstack@n-api.service[106310]: DEBUG oslo_concurrency.lockutils [None req-cf6b7607-6ddd-4643-899d-32cefbc9d6cf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:26:25.819905 n-d-852087-9 devstack@n-api.service[106310]: DEBUG oslo_concurrency.lockutils [None req-cf6b7607-6ddd-4643-899d-32cefbc9d6cf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=106310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:26:25.821099 n-d-852087-9 devstack@n-api.service[106310]: DEBUG oslo_concurrency.lockutils [None req-cf6b7607-6ddd-4643-899d-32cefbc9d6cf admin admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:26:25.821918 n-d-852087-9 devstack@n-api.service[106310]: DEBUG oslo_concurrency.lockutils [None req-cf6b7607-6ddd-4643-899d-32cefbc9d6cf admin admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:26:25.822617 n-d-852087-9 devstack@n-api.service[106310]: DEBUG oslo_concurrency.lockutils [None req-cf6b7607-6ddd-4643-899d-32cefbc9d6cf admin admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:26:25.848732 n-d-852087-9 devstack@n-api.service[106310]: INFO nova.api.openstack.requestlog [None req-cf6b7607-6ddd-4643-899d-32cefbc9d6cf admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.105608 Sep 07 12:26:25.849331 n-d-852087-9 devstack@n-api.service[106310]: [pid: 106310|app: 0|req: 37/72] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Sep 7 12:26:25 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:27:18.593988 n-d-852087-9 systemd[1]: Stopping Devstack devstack@n-api.service... Sep 07 12:27:18.595425 n-d-852087-9 devstack@n-api.service[106308]: Wed Sep 7 12:27:18 2022 - graceful shutdown triggered... Sep 07 12:27:18.595933 n-d-852087-9 devstack@n-api.service[106309]: Gracefully killing worker 1 (pid: 106309)... Sep 07 12:27:18.596650 n-d-852087-9 devstack@n-api.service[106310]: Gracefully killing worker 2 (pid: 106310)... Sep 07 12:27:19.596295 n-d-852087-9 devstack@n-api.service[106308]: worker 1 buried after 1 seconds Sep 07 12:27:19.596295 n-d-852087-9 devstack@n-api.service[106308]: worker 2 buried after 1 seconds Sep 07 12:27:19.596295 n-d-852087-9 devstack@n-api.service[106308]: goodbye to uWSGI. Sep 07 12:27:19.598019 n-d-852087-9 systemd[1]: devstack@n-api.service: Succeeded. Sep 07 12:27:19.598624 n-d-852087-9 systemd[1]: Stopped Devstack devstack@n-api.service. Sep 07 12:27:19.601693 n-d-852087-9 systemd[1]: Starting Devstack devstack@n-api.service... Sep 07 12:27:19.619577 n-d-852087-9 devstack@n-api.service[122422]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 07 12:27:19.637013 n-d-852087-9 devstack@n-api.service[122422]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 7 12:27:19 2022] *** Sep 07 12:27:19.637013 n-d-852087-9 devstack@n-api.service[122422]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 07 12:27:19.637013 n-d-852087-9 devstack@n-api.service[122422]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 07 12:27:19.637013 n-d-852087-9 devstack@n-api.service[122422]: nodename: n-d-852087-9 Sep 07 12:27:19.637013 n-d-852087-9 devstack@n-api.service[122422]: machine: x86_64 Sep 07 12:27:19.637013 n-d-852087-9 devstack@n-api.service[122422]: clock source: unix Sep 07 12:27:19.637013 n-d-852087-9 devstack@n-api.service[122422]: pcre jit disabled Sep 07 12:27:19.637013 n-d-852087-9 devstack@n-api.service[122422]: detected number of CPU cores: 4 Sep 07 12:27:19.637013 n-d-852087-9 devstack@n-api.service[122422]: current working directory: / Sep 07 12:27:19.637013 n-d-852087-9 devstack@n-api.service[122422]: detected binary path: /usr/bin/uwsgi-core Sep 07 12:27:19.637013 n-d-852087-9 devstack@n-api.service[122422]: your processes number limit is 47680 Sep 07 12:27:19.637013 n-d-852087-9 devstack@n-api.service[122422]: your memory page size is 4096 bytes Sep 07 12:27:19.637013 n-d-852087-9 devstack@n-api.service[122422]: detected max file descriptor number: 2048 Sep 07 12:27:19.637013 n-d-852087-9 devstack@n-api.service[122422]: lock engine: pthread robust mutexes Sep 07 12:27:19.638181 n-d-852087-9 devstack@n-api.service[122422]: thunder lock: enabled Sep 07 12:27:19.638181 n-d-852087-9 devstack@n-api.service[122422]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 07 12:27:19.638181 n-d-852087-9 devstack@n-api.service[122422]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 07 12:27:19.677929 n-d-852087-9 devstack@n-api.service[122422]: Python main interpreter initialized at 0x55d1b21ac9c0 Sep 07 12:27:19.677929 n-d-852087-9 devstack@n-api.service[122422]: python threads support enabled Sep 07 12:27:19.677929 n-d-852087-9 devstack@n-api.service[122422]: your server socket listen backlog is limited to 100 connections Sep 07 12:27:19.677929 n-d-852087-9 devstack@n-api.service[122422]: your mercy for graceful operations on workers is 90 seconds Sep 07 12:27:19.678392 n-d-852087-9 devstack@n-api.service[122422]: mapped 403077 bytes (393 KB) for 2 cores Sep 07 12:27:19.678392 n-d-852087-9 devstack@n-api.service[122422]: *** Operational MODE: preforking *** Sep 07 12:27:19.678650 n-d-852087-9 devstack@n-api.service[122422]: *** uWSGI is running in multiple interpreter mode *** Sep 07 12:27:19.678650 n-d-852087-9 devstack@n-api.service[122422]: spawned uWSGI master process (pid: 122422) Sep 07 12:27:19.678863 n-d-852087-9 systemd[1]: Started Devstack devstack@n-api.service. Sep 07 12:27:19.679533 n-d-852087-9 devstack@n-api.service[122422]: spawned uWSGI worker 1 (pid: 122432, cores: 1) Sep 07 12:27:19.679895 n-d-852087-9 devstack@n-api.service[122422]: spawned uWSGI worker 2 (pid: 122433, cores: 1) Sep 07 12:27:19.680059 n-d-852087-9 devstack@n-api.service[122422]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 07 12:27:20.351472 n-d-852087-9 devstack@n-api.service[122433]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 12:27:20.352065 n-d-852087-9 devstack@n-api.service[122432]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 12:27:21.503701 n-d-852087-9 devstack@n-api.service[122432]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 12:27:21.503701 n-d-852087-9 devstack@n-api.service[122432]: from cryptography.utils import int_from_bytes Sep 07 12:27:21.504463 n-d-852087-9 devstack@n-api.service[122432]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 12:27:21.504463 n-d-852087-9 devstack@n-api.service[122432]: from cryptography.utils import int_from_bytes Sep 07 12:27:21.508203 n-d-852087-9 devstack@n-api.service[122433]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 12:27:21.508203 n-d-852087-9 devstack@n-api.service[122433]: from cryptography.utils import int_from_bytes Sep 07 12:27:21.508650 n-d-852087-9 devstack@n-api.service[122433]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 12:27:21.508650 n-d-852087-9 devstack@n-api.service[122433]: from cryptography.utils import int_from_bytes Sep 07 12:27:23.955996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 12:27:23.956810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 12:27:23.956810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 12:27:23.957274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 12:27:23.957443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 12:27:23.958143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.958454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.958772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.959252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.960033 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.960033 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.960341 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.960675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.961194 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.961333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.961654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.961981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852087-9 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.962331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.962642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.962946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.963236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.963536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.963861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.964191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.964737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.966612 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.967071 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.967408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.967903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.968267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.968610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.968931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.969399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.969854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.970774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.970774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852087-9 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.970774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.971075 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.971332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.971756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.972078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.972374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.972694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.973031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.973342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.973712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.974021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.974338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.974660 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.974958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.975282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.975584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.975905 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.976228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.976520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.976774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.977085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.977402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.977748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.977848 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 12:27:23.978285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 12:27:23.978392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.978392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.978565 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.978649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 12:27:23.978917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.979025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 12:27:23.979186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.979279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 12:27:23.979454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.979551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.979763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.979862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.980067 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.980166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.980376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.980618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.980721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.980944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.981054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.981269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.981365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.981571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.981677 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.981908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.982014 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.982211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.982320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.982491 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.982635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.982777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.982917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.983102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852087-9 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.983292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.983446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.983609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.983760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.983901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.984055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.984210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.984376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.984518 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.984659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.984810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.984951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.985105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.985278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.985430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.985726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.985881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.986066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.986223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.986373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.986523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.986665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.986831 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.986984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.987166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.987317 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.987496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.987650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.987818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.987974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.988120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.988276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.988430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.988577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.988723 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.988889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.989045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.989195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.989344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.989526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852087-9 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.989686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.989836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.989976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.990124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.990265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.990431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.990586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.990751 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.990904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.991726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.991895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.992054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.992209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.992358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.992500 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.992654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.992654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.992943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.993086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.993868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.994038 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.994183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.994332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.994491 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.994641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.994791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.994934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.995080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.995221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.995605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.995799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.996036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.996249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.996751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.996919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.997086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.997238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.997392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.997588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.997747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.997906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.998056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.998206 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.998354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.998502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.998644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.998794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.999048 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.999210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.999352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.999506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.999657 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.999802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:23.999955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.000100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.000250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.000403 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.000559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.000703 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.000860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.001011 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.002074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.002244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.002397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.002547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.002697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.002846 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.003013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.004390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.004564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.004713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.004864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.005029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.005181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.005344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.005519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.005668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.005821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.005975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.006233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.006397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.006540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.006687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.006840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.006982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.007142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.007293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.007442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.007584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.007724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.007872 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.008619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.008774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.008916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.009370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.009608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.009768 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.009925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.010096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.010249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.010392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.010572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.010898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.011730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.011879 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.011980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.012058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.012179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.012281 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.012371 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.012481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.012565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.012648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.012729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.012873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.012950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.013031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.013111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.013183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.013262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.013347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.013426 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.013533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.013654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.013775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.013861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.014006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.014126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.014204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.014331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.014423 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.014550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.014664 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.014742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.014813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.014892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.014979 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.015059 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.015131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.015201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.015279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.015351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.015442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.015530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.015628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.015727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.015807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.015886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.015957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.016040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.016120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.016199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.016283 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.016355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.016449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.016555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.016637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.016726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.016816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.016905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.016992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.016992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.017148 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.017240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.017366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.017453 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.017588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.017678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.017779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.017876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.017957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.018029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.018107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.018189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.018266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.018350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.018431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.018509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.018581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.018650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.018747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.018879 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.018978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.019079 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.019169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.019246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.019350 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.019430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.019544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.019622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.019694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.019764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.019875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.019972 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.020068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.020189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.020267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.020339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.020409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.020489 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.020574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.020645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.020714 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.020792 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.020864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.020943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.021016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.021095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.021177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.021256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.021334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.021417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.021585 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.022560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.022796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.022968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.023160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:27:24.023370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.023586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.023711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.023827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.023940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.024054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.024176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.024282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.024370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.024463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.024549 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.024681 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.024795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.024892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.025013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.025110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.025204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.025304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.025400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.025400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.025630 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.025741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.025889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.025980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.026074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.026160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.026244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.026446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.026559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.026754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.026881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.027073 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.027168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.027384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.027495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.027689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.027784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.028007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.028123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.028324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.028455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.028624 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.028724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.028943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.029045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.029266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.029378 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.029600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.029717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.029888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.030019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.030311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.030635 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.030773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.030877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.030971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.031057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.031198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.031293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.031508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.031643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.031808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.031933 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.032099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.032189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.032397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.032761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.032867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.032972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.033091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.033213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.033304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.033428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.033628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.033784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.033931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.034033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.034237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.034367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.034534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.034662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.034876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.034970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.035184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.035295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.035506 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.035608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.035904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.036056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.036178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.036286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.036474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.036572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.036784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.036911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.037102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.037232 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.037415 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.037581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.037765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.037881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.038035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.038176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.038336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.038515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.038661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.038951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.039269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.039567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.039661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.039886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.039993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.040196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.040283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.040511 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.040608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.040809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.040897 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.041121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.041203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.041461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.041616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.041815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.041906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.042124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.042204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.043782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.043915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.044007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.044146 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.044236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.044330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.044430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.044516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.044600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.044683 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.044821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.044821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.044993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.045089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.045184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.045269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.045353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.045449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.046486 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.046673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.046791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.046923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.047081 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.047192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.047318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.047457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.047556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.047651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.047745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.047845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.047971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.048083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.048177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.048284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.048380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.048479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.048572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.048658 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.048748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.048843 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.048969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.049070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.049195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.049285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.049389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.049506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.049638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.049752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.049870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.049961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.050183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.050294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.050503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.050610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.050810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.050914 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.051119 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.051219 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.051422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.051529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.051732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.051841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.052037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.052176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.052335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.052451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.052639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.052789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.052944 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.053093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.053264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.053361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.053603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.053734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.054043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.054147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.054241 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.054416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.054510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.054631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.054803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.054951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.055122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.055220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.055429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.055547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.055736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.055856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.056033 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.056129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.056338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.056455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.056668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.056784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.056974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.057121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.057287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.057425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.057619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.057739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.057939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.058050 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.058245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.058343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.058562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.058680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.058873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.058997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.059182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.059298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.059487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.059581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.059798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.059908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.060104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.060222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.060408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.060516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.060716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.060824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.061025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.061225 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.061382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.061578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.061728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.061830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.062057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.062159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.062363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.062493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.062675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.062783 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.062977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.063123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.063283 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.063379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.063598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.063713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.064027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.064176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.064279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.064496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.064589 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.064811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.064945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.065129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.065262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.065443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.065647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.065789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.065914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.066111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.066214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.066426 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.066530 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.066737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.066830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.067045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.067138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.067354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.067481 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.067657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.067757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.067962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.068077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.068269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.068376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.068568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.068701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.068868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.068969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.069170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.069294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.069527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.069626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.069808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.069952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.070109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.070254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.070408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.070514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.070712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.070814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.071023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.071116 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.071323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.071417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.071633 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.071763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.071931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.072053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.072250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.072378 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.072553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.072688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.072858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.073006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.073161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.073265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.073462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.073599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.073799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.073903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.074124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.074260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.074425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.074561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.074738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.074881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.075065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.075202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.075405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.075519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.075669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.075769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.075988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.076098 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.076291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.076393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.076592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.076687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.076895 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.077023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.077231 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.077376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.077578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.077720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.077864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.078029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.078176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.078307 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.078436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.078593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.078731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.078876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.079041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.079194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.079325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.079445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.079625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.079759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.079929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.080024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.080246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.080339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.080554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.080648 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.080856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.080948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.081157 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.081250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.081465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.081590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.081795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.081889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.082094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.082203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.082407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.082501 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.082707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.083132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.083364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.083460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.083667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.083799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.083967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.084115 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.084340 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.084487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.084623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.084744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.084846 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.085023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.085125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.085336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.085437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.085684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.085780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.086057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.086267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.086374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.086637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.086738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.086941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.087040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.087243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.087345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.087548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.087688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.087871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.088014 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.088185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.088352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.088484 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.088791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.088981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.089076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.089305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.089405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.089656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.089808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.089965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.090086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.090272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.090373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.090575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.090752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.090876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.090979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.091180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.091274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.091483 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.091590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.091786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.091891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.092097 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.092192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.092400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.092506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.092753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.093041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.093134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.093392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.093557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.093807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.094105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.094236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.094639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.094754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.094973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.095077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.095298 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.095394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.095622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.095716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.095937 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.096038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.096259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.096390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.096574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.096676 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.096880 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.096983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.097174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.097269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.097528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.097638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.097823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.097914 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.098114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.098264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.098438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.098612 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.098752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.098954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.099054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.099283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.099391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.099601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.099696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.099941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.100035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.100260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.100362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.100564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.100670 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.100872 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.101004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.101180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.101263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.101505 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.101591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.101821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.101915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.102133 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.102244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.102445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.102704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.102802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.102890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.103067 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.103176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.103383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.103514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.103704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.103831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.104010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.104143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.104352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.104519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.104642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.104738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.104937 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.105053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.105246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.105340 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.105575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.105683 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.105888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.105997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.106193 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.106288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.106506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.106598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.106813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.106916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.107137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.107263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.107454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.107583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.107770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.107898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.108084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.108179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.108412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.108507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.108733 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.108826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.109046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.109148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.109382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.109520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.109722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.109814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.110038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.110143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.110362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.110465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.110681 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.110777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.110996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.111099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.111306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.111408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.111603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.111702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.111913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.112007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.112235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.112339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.112539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.112639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.112842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.112935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.113144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.113248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.113458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.113609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.113786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.113915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.114103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.114231 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.114415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.114539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.114729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.114823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.115042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.115146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.115356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.115491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.115666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.115809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.116001 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.116104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.116321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.116414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.116635 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.116740 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.116953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.117075 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.117265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.117384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.117644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.117758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.117961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.118089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.118329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.118430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.118643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.118744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.118949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.119048 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.119264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.119364 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.119570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.119676 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.119896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.119989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.120217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.120315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.120527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.120627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.120848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.120938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.121166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.121266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.121546 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.121692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.121839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.121958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.122156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.122251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.122490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.122584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.122801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.122901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.123105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.123200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.123411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.123513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.123714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.123867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.124076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.124187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.124398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.124493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.124704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.124805 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.125013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.125120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.125324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.125406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.125663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.125771 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.125972 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.126080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.126279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.126375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.126604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.126699 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.126911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.127014 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.127233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.127335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.127546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.127641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.127861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.127955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.128176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.128278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.128479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.128589 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.128800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.128906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.129103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.129202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.129405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.129528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.129742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.150279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.150564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.150740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.150740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.150740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.150740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.151403 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.151609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.151835 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.152078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.152307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.152487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.153372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.153576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.153724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.153887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.154049 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.154373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.154530 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.154685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.154835 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.154984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.155237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.155372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.155502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.155502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.155858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.156029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.156185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.156330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.156484 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.156643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.156791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.156940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.157138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.157288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.157419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.157613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.157750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.157917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.158066 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.158199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.158329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.158477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.158631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.158794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.158948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.159109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.159258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.159401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.159548 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.159709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.159990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.160130 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.160130 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.160395 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.160550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.160717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.160886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.161046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.161373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.161550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.161704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.161860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.162012 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.162163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.162316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.162474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.162628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.162781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.162930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.163091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.163283 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.163283 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.163568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.163744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.163880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.164019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.164152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.164332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.164642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.164792 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.164942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.165100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.165252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.165414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.165583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.165717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.165849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.165979 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.166109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.166266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.166404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.166404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.166700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.166841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.167025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.167025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.167349 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.167513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.167674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.167849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.168015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.168181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.168360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.168497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.168651 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.168813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.168999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.169146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.169318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.169550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.169721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.169879 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.170234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.170395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.170583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.170853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.171053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.171239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.171524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.171714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.171877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.172042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.172216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.172350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.172490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.172650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.172821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.173002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.173146 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.173318 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.173473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.173669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.173817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.174018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.174169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.174322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.175322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.175477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.175614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.175747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.175881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.176024 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.176159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.176292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.176459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.176597 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.176743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.176885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.177025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.177161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.177297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.177429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.177429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.177788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.177927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.177927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.178177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.178309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.178461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.178596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.178727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.178859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.178990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.179148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.179292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.179425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.179557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.179688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.179819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.179951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.180091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.180395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.180535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.180668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.180800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.180941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.180941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.181201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.181333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.181333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.181712 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.181824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.181824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.181962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.182039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.182111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.182180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.182321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.182395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.182465 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.182534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.182603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.182603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.182735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.182806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.182875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.182944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.183012 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.183089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.183159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.183284 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.183360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.183479 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.183479 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.183619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.183691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.183761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.183829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.183898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.183898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.184019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.184090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.184090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.184212 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.184282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.184351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.184433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.184505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.184580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.184580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.184797 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.184880 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.184956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.185026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.185097 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.185183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.185274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.185353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.185353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.185557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.185618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.185687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.185756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.185839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.185911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.185911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.186054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.186124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.186405 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.186513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.186593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.186664 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.186742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.186830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.186830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.186970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.187043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.187113 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.187182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.187182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.187307 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.187386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.187457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.187526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.187526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.187649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.187718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.187793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.187865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.187933 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.188002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.188069 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.188146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.188217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.188285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.188285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.188409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.188478 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.188571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.188645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.188887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.188972 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.189042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.189112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.189190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.189262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.189331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.189401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.189470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.189564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.189647 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.189719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.189789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.189858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.189927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.189927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.190061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.190130 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.190198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.190266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.190334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.190399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.190458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.190514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.190571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.190627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.190690 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.190760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.190828 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.190897 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.190965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.191033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.191108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.191108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.191234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.191234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.191357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.191426 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.191503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.191574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.191632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.191687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.191799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.191877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.191957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.192028 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.192097 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.192166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.192235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.192235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.192369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.192439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.192507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.192576 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.192644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.192721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.192793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.192862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.192930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.192999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.193075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.193146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.193215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.193284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.193284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.193396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.193472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.193604 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.193676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.193745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.193814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.193883 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.193964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.194036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.194105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.194174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.194243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.194311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.194388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.194388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.194598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.194671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.194751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.194865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.194944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.195021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.195092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.195163 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.195242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.195314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.195374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.195374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.195575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.195673 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.195795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.195873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.195945 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.196016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.196086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.196164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.196244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.196244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.196449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.196511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.196576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.196643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.196704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.196774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.196845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.196916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.196986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.197065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.197138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.197217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.197288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.197358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.197427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.197526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.197603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.197675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.197745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.197816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.197932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.198007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.198078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.198149 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.198219 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.198289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.198289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.198425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.198496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.198566 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.198637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.198707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.198784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.199042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.199129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.199203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.199274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.199345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.199425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.199498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.199570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.199640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.199711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.199789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.199863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.199934 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.200005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.200082 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.200153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.200231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.200304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.200375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.200446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.200505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.200649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.200803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.200953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.201127 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.201258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.201442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.201592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.201787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.201917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.202128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.202242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.202448 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.202615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.202820 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.202901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.203143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.203222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.203455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.203542 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.203777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.203893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.204086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.204168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.204396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.204482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.204712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.204790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.205026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.205104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.205336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.205423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.205686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.205765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.205994 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.206072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.206305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.206387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.206616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.206727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.206922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.207183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.207271 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.207522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.207601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.208169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.208253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.208489 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.208576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.208796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.208875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.209137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.209230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.209465 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.209641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.209800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.209880 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.210111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.210189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.210423 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.210505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.210739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.210826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.211043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.211121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.211351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.211432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.211658 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.211738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.211967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.212054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.212274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.212355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.212587 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.212664 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.212890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.212975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.213199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.213330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.213533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.213652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.213850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.213943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.214208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.214334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.214478 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.214559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.214781 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.214869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.215105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.215220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.215430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.215510 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.215748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.215863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.216069 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.216151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.216392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.216471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.216707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.216821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.217026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.217106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.217332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.217410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.217715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.217799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.217979 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 12:27:24.218065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.218387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.218702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.219013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.219449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.219766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.221256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.221256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.221256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.221256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.221565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.221674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.222001 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.222318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.222654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.222654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.222654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.222654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.224023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.224246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.224565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.224879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.225210 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.225892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.225892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.226150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.226467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.226782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.227096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.227407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.228984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.228984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.228984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.228984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.228984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.229403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.229590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.229837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.230153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.230465 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.230776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.231086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.231398 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.231708 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.232056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.234441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.234441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.234441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.234441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.234441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.234441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.234441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.234864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.234923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.235240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.235579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.235894 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.236232 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.236578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.236897 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.237216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.237552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.237893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.238227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.238537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.238870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.239193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.239520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.239843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.240158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.240493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.240809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.241137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.241441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.241781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.242099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.242420 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.242735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.243053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.243374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.243694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.244026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.244358 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.244674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.245005 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.245415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.245722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.246044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.246399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.246737 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.247061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.247381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.247690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:27:24.247942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 12:27:24.282329 n-d-852087-9 devstack@n-api.service[122432]: INFO dbcounter [None req-9cfa7f3d-558e-4343-bc67-ed0120dda5c4 None None] Registered counter for database nova_api Sep 07 12:27:24.303158 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_db.sqlalchemy.engines [None req-9cfa7f3d-558e-4343-bc67-ed0120dda5c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:27:24.310114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writer thread running {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:27:24.310582 n-d-852087-9 devstack@n-api.service[122433]: INFO dbcounter [None req-da7edbb9-300f-41d9-96e4-2925ea02d663 None None] Registered counter for database nova_api Sep 07 12:27:24.331195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_db.sqlalchemy.engines [None req-da7edbb9-300f-41d9-96e4-2925ea02d663 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122433) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:27:24.338348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writer thread running {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:27:24.367397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.context [None req-9cfa7f3d-558e-4343-bc67-ed0120dda5c4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e0290a2-728a-49bc-bfb2-19275e06ed31(cell1) {{(pid=122432) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 12:27:24.371513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9cfa7f3d-558e-4343-bc67-ed0120dda5c4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:27:24.371995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9cfa7f3d-558e-4343-bc67-ed0120dda5c4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:27:24.373788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9cfa7f3d-558e-4343-bc67-ed0120dda5c4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:27:24.374584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9cfa7f3d-558e-4343-bc67-ed0120dda5c4 None None] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:27:24.375037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9cfa7f3d-558e-4343-bc67-ed0120dda5c4 None None] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:27:24.377011 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9cfa7f3d-558e-4343-bc67-ed0120dda5c4 None None] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:27:24.379224 n-d-852087-9 devstack@n-api.service[122432]: INFO dbcounter [None req-9cfa7f3d-558e-4343-bc67-ed0120dda5c4 None None] Registered counter for database nova_cell0 Sep 07 12:27:24.383470 n-d-852087-9 devstack@n-api.service[122432]: INFO dbcounter [None req-9cfa7f3d-558e-4343-bc67-ed0120dda5c4 None None] Registered counter for database nova_cell1 Sep 07 12:27:24.391412 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_db.sqlalchemy.engines [None req-9cfa7f3d-558e-4343-bc67-ed0120dda5c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:27:24.394117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_db.sqlalchemy.engines [None req-9cfa7f3d-558e-4343-bc67-ed0120dda5c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:27:24.395305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.context [None req-da7edbb9-300f-41d9-96e4-2925ea02d663 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e0290a2-728a-49bc-bfb2-19275e06ed31(cell1) {{(pid=122433) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 12:27:24.398036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writer thread running {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:27:24.399442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da7edbb9-300f-41d9-96e4-2925ea02d663 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:27:24.399912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da7edbb9-300f-41d9-96e4-2925ea02d663 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:27:24.401513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da7edbb9-300f-41d9-96e4-2925ea02d663 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:27:24.402259 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da7edbb9-300f-41d9-96e4-2925ea02d663 None None] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:27:24.402718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da7edbb9-300f-41d9-96e4-2925ea02d663 None None] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:27:24.404783 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da7edbb9-300f-41d9-96e4-2925ea02d663 None None] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:27:24.406927 n-d-852087-9 devstack@n-api.service[122433]: INFO dbcounter [None req-da7edbb9-300f-41d9-96e4-2925ea02d663 None None] Registered counter for database nova_cell0 Sep 07 12:27:24.411106 n-d-852087-9 devstack@n-api.service[122433]: INFO dbcounter [None req-da7edbb9-300f-41d9-96e4-2925ea02d663 None None] Registered counter for database nova_cell1 Sep 07 12:27:24.418600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_db.sqlalchemy.engines [None req-da7edbb9-300f-41d9-96e4-2925ea02d663 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122433) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:27:24.420347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_db.sqlalchemy.engines [None req-da7edbb9-300f-41d9-96e4-2925ea02d663 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122433) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:27:24.426141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writer thread running {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:27:24.428713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writer thread running {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:27:24.547190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writer thread running {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:27:24.557429 n-d-852087-9 devstack@n-api.service[122432]: INFO dbcounter [None req-9cfa7f3d-558e-4343-bc67-ed0120dda5c4 None None] Registered counter for database nova_cell0 Sep 07 12:27:24.566031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_db.sqlalchemy.engines [None req-9cfa7f3d-558e-4343-bc67-ed0120dda5c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:27:24.571456 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writer thread running {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:27:24.582289 n-d-852087-9 devstack@n-api.service[122433]: INFO dbcounter [None req-da7edbb9-300f-41d9-96e4-2925ea02d663 None None] Registered counter for database nova_cell0 Sep 07 12:27:24.589673 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_db.sqlalchemy.engines [None req-da7edbb9-300f-41d9-96e4-2925ea02d663 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122433) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:27:24.594658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writer thread running {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:27:24.891198 n-d-852087-9 devstack@n-api.service[122432]: WARNING keystonemiddleware.auth_token [None req-9cfa7f3d-558e-4343-bc67-ed0120dda5c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 12:27:24.899704 n-d-852087-9 devstack@n-api.service[122432]: WARNING keystonemiddleware.auth_token [None req-9cfa7f3d-558e-4343-bc67-ed0120dda5c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 12:27:24.912721 n-d-852087-9 devstack@n-api.service[122433]: WARNING keystonemiddleware.auth_token [None req-da7edbb9-300f-41d9-96e4-2925ea02d663 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 12:27:24.920157 n-d-852087-9 devstack@n-api.service[122433]: WARNING keystonemiddleware.auth_token [None req-da7edbb9-300f-41d9-96e4-2925ea02d663 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 12:27:25.254294 n-d-852087-9 devstack@n-api.service[122432]: WARNING keystonemiddleware.auth_token [None req-9cfa7f3d-558e-4343-bc67-ed0120dda5c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 12:27:25.260542 n-d-852087-9 devstack@n-api.service[122432]: WARNING keystonemiddleware.auth_token [None req-9cfa7f3d-558e-4343-bc67-ed0120dda5c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 12:27:25.265927 n-d-852087-9 devstack@n-api.service[122432]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d1b21ac9c0 pid: 122432 (default app) Sep 07 12:27:25.276488 n-d-852087-9 devstack@n-api.service[122433]: WARNING keystonemiddleware.auth_token [None req-da7edbb9-300f-41d9-96e4-2925ea02d663 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 12:27:25.282719 n-d-852087-9 devstack@n-api.service[122433]: WARNING keystonemiddleware.auth_token [None req-da7edbb9-300f-41d9-96e4-2925ea02d663 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 12:27:25.288154 n-d-852087-9 devstack@n-api.service[122433]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d1b21ac9c0 pid: 122433 (default app) Sep 07 12:28:05.417282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:28:05.418405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:28:05.419217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:28:05.420026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:28:06.572865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:28:06.575516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:28:06.576655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:28:06.577601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:28:06.802672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-025a72c6-6bcc-4590-89c2-4ead3093439e tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Calling method '.version_select at 0x7fc41aa18ee0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:06.809643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-025a72c6-6bcc-4590-89c2-4ead3093439e tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e0290a2-728a-49bc-bfb2-19275e06ed31(cell1) {{(pid=122432) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 07 12:28:06.810474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025a72c6-6bcc-4590-89c2-4ead3093439e tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:06.810991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025a72c6-6bcc-4590-89c2-4ead3093439e tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:06.811432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025a72c6-6bcc-4590-89c2-4ead3093439e tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:06.843977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025a72c6-6bcc-4590-89c2-4ead3093439e tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:06.844475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025a72c6-6bcc-4590-89c2-4ead3093439e tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:06.844912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025a72c6-6bcc-4590-89c2-4ead3093439e tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:06.860120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025a72c6-6bcc-4590-89c2-4ead3093439e tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:06.860865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025a72c6-6bcc-4590-89c2-4ead3093439e tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:06.861521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-025a72c6-6bcc-4590-89c2-4ead3093439e tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:06.868919 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-025a72c6-6bcc-4590-89c2-4ead3093439e tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.462137 Sep 07 12:28:06.870158 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1/1] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:28:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:07.273152 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-46b8cce6-91d0-499d-b903-8cbfe69f4663 tempest-HypervisorAdminNegativeUnderV252Test-961812390 tempest-HypervisorAdminNegativeUnderV252Test-961812390-project] Calling method '.version_select at 0x7fc41a9e6a60>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:07.277375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-46b8cce6-91d0-499d-b903-8cbfe69f4663 tempest-HypervisorAdminNegativeUnderV252Test-961812390 tempest-HypervisorAdminNegativeUnderV252Test-961812390-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '10149bc255e947a383cea2731d9c4339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0e5bd2692b4da8b774bf56bbaa73a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:07.285122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-46b8cce6-91d0-499d-b903-8cbfe69f4663 tempest-HypervisorAdminNegativeUnderV252Test-961812390 tempest-HypervisorAdminNegativeUnderV252Test-961812390-project] Request method failure captured: Sep 07 12:28:07.285122 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-hypervisors/n-h1-852087-9/search HTTP/1.1 Sep 07 12:28:07.285122 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:28:07.285122 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:28:07.285122 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:28:07.285122 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:28:07.285122 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:28:07.285122 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:28:07.285122 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:28:07.285122 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:28:07.285122 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5TRZdRqc_Y4NL6iYidzS5ABYEzcFWB_ghYDl_5EkZ_IcUMt68NoyqUQ3tKSABIw343Jy-yF9mWRVCS3kGPHqFrjp6_bk4HmglFJpfN5pYeUA_CHtH88DXiqCqF81nTXtrM8xWVWpfHWZDliYEteV7CJFBjgL-wYOXpnhlZ9Ckup7s Sep 07 12:28:07.285122 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:28:07.285122 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:28:07.285122 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:28:07.285122 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:28:07.285122 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:28:07.285122 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:28:07.285122 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 9f0e5bd2692b4da8b774bf56bbaa73a4 Sep 07 12:28:07.285122 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-961812390 Sep 07 12:28:07.285122 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:28:07.285122 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:28:07.287784 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f0e5bd2692b4da8b774bf56bbaa73a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9f0e5bd2692b4da8b774bf56bbaa73a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9f0e5bd2692b4da8b774bf56bbaa73a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f0e5bd2692b4da8b774bf56bbaa73a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:28:07.287784 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-961812390 Sep 07 12:28:07.287784 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 9f0e5bd2692b4da8b774bf56bbaa73a4 Sep 07 12:28:07.287784 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-961812390 Sep 07 12:28:07.287784 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-961812390-project Sep 07 12:28:07.287784 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:28:07.287784 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:28:07.287784 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 10149bc255e947a383cea2731d9c4339 Sep 07 12:28:07.287784 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-961812390-project Sep 07 12:28:07.287784 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:28:07.287784 n-d-852087-9 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 07 12:28:07.287784 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'n-h1-852087-9'} Sep 07 12:28:07.288466 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:28:07.288466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:07.288466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:28:07.288466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:28:07.288466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:28:07.288466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:28:07.288466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:28:07.288466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:28:07.288466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:28:07.288466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:28:07.288466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Sep 07 12:28:07.288466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Sep 07 12:28:07.288466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:28:07.288466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:28:07.288466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:28:07.288466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:28:07.288466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:28:07.288466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:28:07.288466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:28:07.289377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:28:07.289377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:28:07.289377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:28:07.289377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:28:07.289377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:28:07.289377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:28:07.289377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:28:07.289377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 07 12:28:07.289377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:07.289377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:28:07.289377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:07.289377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:07.289377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:28:07.289377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:28:07.289377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:28:07.289377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:28:07.289377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 07 12:28:07.289377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:07.290274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-46b8cce6-91d0-499d-b903-8cbfe69f4663 tempest-HypervisorAdminNegativeUnderV252Test-961812390 tempest-HypervisorAdminNegativeUnderV252Test-961812390-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:28:07.290866 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-46b8cce6-91d0-499d-b903-8cbfe69f4663 tempest-HypervisorAdminNegativeUnderV252Test-961812390 tempest-HypervisorAdminNegativeUnderV252Test-961812390-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h1-852087-9/search" status: 403 len: 117 microversion: 2.1 time: 0.408603 Sep 07 12:28:07.292471 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2/2] 10.222.0.16 () {58 vars in 1209 bytes} [Wed Sep 7 12:28:06 2022] GET /compute/v2.1/os-hypervisors/n-h1-852087-9/search => generated 117 bytes in 415 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:28:07.305539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a33efe75-6b47-42a8-aaaf-fb88b4cbedf1 tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Calling method '.version_select at 0x7fc41a8be160>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:07.309047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a33efe75-6b47-42a8-aaaf-fb88b4cbedf1 tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:07.311056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a33efe75-6b47-42a8-aaaf-fb88b4cbedf1 tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:07.312558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a33efe75-6b47-42a8-aaaf-fb88b4cbedf1 tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:07.343389 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-a33efe75-6b47-42a8-aaaf-fb88b4cbedf1 tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 07 12:28:07.348565 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a33efe75-6b47-42a8-aaaf-fb88b4cbedf1 tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Request method failure captured: Sep 07 12:28:07.348565 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Sep 07 12:28:07.348565 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:28:07.348565 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:28:07.348565 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:28:07.348565 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:28:07.348565 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:28:07.348565 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:28:07.348565 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:28:07.348565 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:28:07.348565 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5VuMJl3p4yNlfX8O9Qs9lXsPDUM8VjGD8szzRsNmILEsyxbqi_XDqU0_-IqpomNZFxGSMWwo4Ft4rQEumgBYLXcacS80HqPhho9i31TQSizvApGWWVBGDhhp0KJbqauVhp-7NqwQsvs2B_3x_CO5BUSMnqRbf7SXJabMT9lMhu7Q8 Sep 07 12:28:07.348565 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:28:07.348565 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:28:07.348565 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:28:07.348565 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:28:07.348565 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:28:07.348565 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:28:07.348565 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 7ef1c3140cf64bcf90f511c673dcec2d Sep 07 12:28:07.348565 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2138174290 Sep 07 12:28:07.348565 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member,admin Sep 07 12:28:07.348565 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member,admin Sep 07 12:28:07.349687 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef1c3140cf64bcf90f511c673dcec2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ef1c3140cf64bcf90f511c673dcec2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ef1c3140cf64bcf90f511c673dcec2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef1c3140cf64bcf90f511c673dcec2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:28:07.349687 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2138174290 Sep 07 12:28:07.349687 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 7ef1c3140cf64bcf90f511c673dcec2d Sep 07 12:28:07.349687 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2138174290 Sep 07 12:28:07.349687 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin Sep 07 12:28:07.349687 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:28:07.349687 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:28:07.349687 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6629081f7c854d6182530f4b55dc320a Sep 07 12:28:07.349687 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin Sep 07 12:28:07.349687 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:28:07.349687 n-d-852087-9 devstack@n-api.service[122432]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 07 12:28:07.349687 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'nonexistent_hypervisor_name'} Sep 07 12:28:07.350282 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:28:07.350282 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:07.350282 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:28:07.350282 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:28:07.350282 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:28:07.350282 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:28:07.350282 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:28:07.350282 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:28:07.350282 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:28:07.350282 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:28:07.350282 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Sep 07 12:28:07.350282 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 07 12:28:07.350282 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 07 12:28:07.350282 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 07 12:28:07.350282 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 07 12:28:07.350282 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:07.350282 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:28:07.350282 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:07.350282 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:07.350282 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:28:07.351196 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:28:07.351196 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:28:07.351196 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:28:07.351196 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 07 12:28:07.351196 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:07.353741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a33efe75-6b47-42a8-aaaf-fb88b4cbedf1 tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:28:07.357777 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a33efe75-6b47-42a8-aaaf-fb88b4cbedf1 tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.054988 Sep 07 12:28:07.360149 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3/3] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Sep 7 12:28:07 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:28:07.374358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eaeacff2-1d2e-43f0-820a-85c527b42f7e tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Calling method '.version_select at 0x7fc41a9e6ca0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:07.379326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaeacff2-1d2e-43f0-820a-85c527b42f7e tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:07.382775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaeacff2-1d2e-43f0-820a-85c527b42f7e tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:07.383446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaeacff2-1d2e-43f0-820a-85c527b42f7e tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:07.408796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaeacff2-1d2e-43f0-820a-85c527b42f7e tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:07.414904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaeacff2-1d2e-43f0-820a-85c527b42f7e tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:07.415714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaeacff2-1d2e-43f0-820a-85c527b42f7e tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:07.436611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaeacff2-1d2e-43f0-820a-85c527b42f7e tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:07.438414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaeacff2-1d2e-43f0-820a-85c527b42f7e tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:07.440093 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaeacff2-1d2e-43f0-820a-85c527b42f7e tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:07.454481 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eaeacff2-1d2e-43f0-820a-85c527b42f7e tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.088426 Sep 07 12:28:07.459888 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 4/4] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:28:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:07.467850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b14b9489-7840-47a0-9e88-a3a0c3eea41b tempest-HypervisorAdminNegativeUnderV252Test-961812390 tempest-HypervisorAdminNegativeUnderV252Test-961812390-project] Calling method '.version_select at 0x7fc41a8bef70>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:07.474794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b14b9489-7840-47a0-9e88-a3a0c3eea41b tempest-HypervisorAdminNegativeUnderV252Test-961812390 tempest-HypervisorAdminNegativeUnderV252Test-961812390-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '10149bc255e947a383cea2731d9c4339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0e5bd2692b4da8b774bf56bbaa73a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:07.477820 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b14b9489-7840-47a0-9e88-a3a0c3eea41b tempest-HypervisorAdminNegativeUnderV252Test-961812390 tempest-HypervisorAdminNegativeUnderV252Test-961812390-project] Request method failure captured: Sep 07 12:28:07.477820 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Sep 07 12:28:07.477820 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:28:07.477820 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:28:07.477820 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:28:07.477820 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:28:07.477820 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:28:07.477820 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:28:07.477820 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:28:07.477820 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:28:07.477820 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5TRZdRqc_Y4NL6iYidzS5ABYEzcFWB_ghYDl_5EkZ_IcUMt68NoyqUQ3tKSABIw343Jy-yF9mWRVCS3kGPHqFrjp6_bk4HmglFJpfN5pYeUA_CHtH88DXiqCqF81nTXtrM8xWVWpfHWZDliYEteV7CJFBjgL-wYOXpnhlZ9Ckup7s Sep 07 12:28:07.477820 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:28:07.477820 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:28:07.477820 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:28:07.477820 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:28:07.477820 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:28:07.477820 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:28:07.477820 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 9f0e5bd2692b4da8b774bf56bbaa73a4 Sep 07 12:28:07.477820 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-961812390 Sep 07 12:28:07.477820 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:28:07.477820 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:28:07.479063 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f0e5bd2692b4da8b774bf56bbaa73a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9f0e5bd2692b4da8b774bf56bbaa73a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9f0e5bd2692b4da8b774bf56bbaa73a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f0e5bd2692b4da8b774bf56bbaa73a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:28:07.479063 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-961812390 Sep 07 12:28:07.479063 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 9f0e5bd2692b4da8b774bf56bbaa73a4 Sep 07 12:28:07.479063 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-961812390 Sep 07 12:28:07.479063 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-961812390-project Sep 07 12:28:07.479063 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:28:07.479063 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:28:07.479063 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 10149bc255e947a383cea2731d9c4339 Sep 07 12:28:07.479063 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-961812390-project Sep 07 12:28:07.479063 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:28:07.479063 n-d-852087-9 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 07 12:28:07.479063 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '1'} Sep 07 12:28:07.479745 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:28:07.479745 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:07.479745 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:28:07.479745 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:28:07.479745 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:28:07.479745 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:28:07.479745 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:28:07.479745 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:28:07.479745 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:28:07.479745 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:28:07.479745 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Sep 07 12:28:07.479745 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Sep 07 12:28:07.479745 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:28:07.479745 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:28:07.479745 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:28:07.479745 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:28:07.479745 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:28:07.479745 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:28:07.479745 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:28:07.480690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:28:07.480690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:28:07.480690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:28:07.480690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:28:07.480690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:28:07.480690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:28:07.480690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:28:07.480690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 07 12:28:07.480690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:07.480690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:28:07.480690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:07.480690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:07.480690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:28:07.480690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:28:07.480690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:28:07.480690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:28:07.480690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 07 12:28:07.480690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:07.481694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b14b9489-7840-47a0-9e88-a3a0c3eea41b tempest-HypervisorAdminNegativeUnderV252Test-961812390 tempest-HypervisorAdminNegativeUnderV252Test-961812390-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:28:07.482755 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b14b9489-7840-47a0-9e88-a3a0c3eea41b tempest-HypervisorAdminNegativeUnderV252Test-961812390 tempest-HypervisorAdminNegativeUnderV252Test-961812390-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.019898 Sep 07 12:28:07.484365 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 5/5] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Sep 7 12:28:07 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:28:07.496280 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e87ab13f-a12c-46b0-a78c-f775bcf7e267 tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Calling method '.version_select at 0x7fc41a85b9d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:07.498870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e87ab13f-a12c-46b0-a78c-f775bcf7e267 tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:07.499615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e87ab13f-a12c-46b0-a78c-f775bcf7e267 tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:07.500112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e87ab13f-a12c-46b0-a78c-f775bcf7e267 tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:07.519247 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-e87ab13f-a12c-46b0-a78c-f775bcf7e267 tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] HTTP exception thrown: No hypervisor matching 'c2de4287-6e49-4354-9dbe-68b00e5702e9' could be found. Sep 07 12:28:07.524358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e87ab13f-a12c-46b0-a78c-f775bcf7e267 tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Request method failure captured: Sep 07 12:28:07.524358 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-hypervisors/c2de4287-6e49-4354-9dbe-68b00e5702e9/servers HTTP/1.1 Sep 07 12:28:07.524358 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:28:07.524358 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:28:07.524358 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:28:07.524358 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:28:07.524358 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:28:07.524358 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:28:07.524358 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:28:07.524358 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:28:07.524358 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5VuMJl3p4yNlfX8O9Qs9lXsPDUM8VjGD8szzRsNmILEsyxbqi_XDqU0_-IqpomNZFxGSMWwo4Ft4rQEumgBYLXcacS80HqPhho9i31TQSizvApGWWVBGDhhp0KJbqauVhp-7NqwQsvs2B_3x_CO5BUSMnqRbf7SXJabMT9lMhu7Q8 Sep 07 12:28:07.524358 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:28:07.524358 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:28:07.524358 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:28:07.524358 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:28:07.524358 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:28:07.524358 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:28:07.524358 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 7ef1c3140cf64bcf90f511c673dcec2d Sep 07 12:28:07.524358 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2138174290 Sep 07 12:28:07.524358 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member,admin Sep 07 12:28:07.524358 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member,admin Sep 07 12:28:07.525730 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef1c3140cf64bcf90f511c673dcec2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ef1c3140cf64bcf90f511c673dcec2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ef1c3140cf64bcf90f511c673dcec2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ef1c3140cf64bcf90f511c673dcec2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:28:07.525730 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2138174290 Sep 07 12:28:07.525730 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 7ef1c3140cf64bcf90f511c673dcec2d Sep 07 12:28:07.525730 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2138174290 Sep 07 12:28:07.525730 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin Sep 07 12:28:07.525730 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:28:07.525730 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:28:07.525730 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6629081f7c854d6182530f4b55dc320a Sep 07 12:28:07.525730 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin Sep 07 12:28:07.525730 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:28:07.525730 n-d-852087-9 devstack@n-api.service[122432]: exception: No hypervisor matching 'c2de4287-6e49-4354-9dbe-68b00e5702e9' could be found. Sep 07 12:28:07.525730 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'c2de4287-6e49-4354-9dbe-68b00e5702e9'} Sep 07 12:28:07.526371 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:28:07.526371 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:07.526371 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:28:07.526371 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:28:07.526371 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:28:07.526371 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:28:07.526371 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:28:07.526371 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:28:07.526371 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:28:07.526371 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:28:07.526371 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Sep 07 12:28:07.526371 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 07 12:28:07.526371 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 07 12:28:07.526371 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 07 12:28:07.526371 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'c2de4287-6e49-4354-9dbe-68b00e5702e9' could be found. Sep 07 12:28:07.526371 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:07.526371 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:28:07.526371 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:07.526371 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:07.527475 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:28:07.527475 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:28:07.527475 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:28:07.527475 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:28:07.527475 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'c2de4287-6e49-4354-9dbe-68b00e5702e9' could be found. Sep 07 12:28:07.527475 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:07.530570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e87ab13f-a12c-46b0-a78c-f775bcf7e267 tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] Returning 404 to user: No hypervisor matching 'c2de4287-6e49-4354-9dbe-68b00e5702e9' could be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:28:07.533693 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e87ab13f-a12c-46b0-a78c-f775bcf7e267 tempest-HypervisorAdminNegativeUnderV252Test-2138174290 tempest-HypervisorAdminNegativeUnderV252Test-2138174290-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/c2de4287-6e49-4354-9dbe-68b00e5702e9/servers" status: 404 len: 123 microversion: 2.1 time: 0.043200 Sep 07 12:28:07.534615 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 6/6] 10.222.0.16 () {58 vars in 1281 bytes} [Wed Sep 7 12:28:07 2022] GET /compute/v2.1/os-hypervisors/c2de4287-6e49-4354-9dbe-68b00e5702e9/servers => generated 123 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:28:08.441726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-42527177-9c56-42a9-9816-bd1a230a7e4d tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] Calling method '.version_select at 0x7fc41aa1bf70>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:08.470466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-42527177-9c56-42a9-9816-bd1a230a7e4d tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e0290a2-728a-49bc-bfb2-19275e06ed31(cell1) {{(pid=122433) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 07 12:28:08.471251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42527177-9c56-42a9-9816-bd1a230a7e4d tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:08.471729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42527177-9c56-42a9-9816-bd1a230a7e4d tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:08.472275 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42527177-9c56-42a9-9816-bd1a230a7e4d tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:08.508160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42527177-9c56-42a9-9816-bd1a230a7e4d tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:08.509137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42527177-9c56-42a9-9816-bd1a230a7e4d tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:08.510040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42527177-9c56-42a9-9816-bd1a230a7e4d tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:08.522242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2c459ad3-6b7c-49e2-a274-fb5b09751bb9 tempest-AZAdminNegativeTestJSON-834581458 tempest-AZAdminNegativeTestJSON-834581458-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:08.523890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2c459ad3-6b7c-49e2-a274-fb5b09751bb9 tempest-AZAdminNegativeTestJSON-834581458 tempest-AZAdminNegativeTestJSON-834581458-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'adc33bf37e884f208504ec53c4ef6363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13106b6058e4a6e9a04936b239b5057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:08.525668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2c459ad3-6b7c-49e2-a274-fb5b09751bb9 tempest-AZAdminNegativeTestJSON-834581458 tempest-AZAdminNegativeTestJSON-834581458-project] Request method failure captured: Sep 07 12:28:08.525668 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Sep 07 12:28:08.525668 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:28:08.525668 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:28:08.525668 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:28:08.525668 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:28:08.525668 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:28:08.525668 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:28:08.525668 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:28:08.525668 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:28:08.525668 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5VT97g_-QGnO-eEb7MWYNnul_ITi9xGCnoJ6iId08YyzeP6V1Ba6Jg4i350C4nZN7rXg27a_RtwWtd5rD-kXkI2NWhA8jlnVq4b5KtIy4yDOr0IBnm8jxgsetHeqHapMRsY4JITsmf6tVIs_aji3Kl0rfbUlWmB5xKw4zoZyHE4RY Sep 07 12:28:08.525668 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:28:08.525668 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:28:08.525668 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:28:08.525668 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:28:08.525668 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:28:08.525668 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:28:08.525668 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: c13106b6058e4a6e9a04936b239b5057 Sep 07 12:28:08.525668 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-AZAdminNegativeTestJSON-834581458 Sep 07 12:28:08.525668 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:28:08.525668 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:28:08.526709 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c13106b6058e4a6e9a04936b239b5057"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c13106b6058e4a6e9a04936b239b5057"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c13106b6058e4a6e9a04936b239b5057"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c13106b6058e4a6e9a04936b239b5057"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:28:08.526709 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-AZAdminNegativeTestJSON-834581458 Sep 07 12:28:08.526709 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: c13106b6058e4a6e9a04936b239b5057 Sep 07 12:28:08.526709 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-834581458 Sep 07 12:28:08.526709 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-AZAdminNegativeTestJSON-834581458-project Sep 07 12:28:08.526709 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:28:08.526709 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:28:08.526709 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: adc33bf37e884f208504ec53c4ef6363 Sep 07 12:28:08.526709 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-AZAdminNegativeTestJSON-834581458-project Sep 07 12:28:08.526709 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:28:08.526709 n-d-852087-9 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 07 12:28:08.526709 n-d-852087-9 devstack@n-api.service[122432]: action_args: {} Sep 07 12:28:08.527285 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:28:08.527285 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:08.527285 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:28:08.527285 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:28:08.527285 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:28:08.527285 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:28:08.527285 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:28:08.527285 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:28:08.527285 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Sep 07 12:28:08.527285 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Sep 07 12:28:08.527285 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:28:08.527285 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:28:08.527285 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:28:08.527285 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:28:08.527285 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:28:08.527285 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:28:08.527285 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:28:08.527285 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:28:08.527285 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:28:08.528201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:28:08.528201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:28:08.528201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:28:08.528201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:28:08.528201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:28:08.528201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 07 12:28:08.528201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:08.528201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:28:08.528201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:08.528201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:08.528201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:28:08.528201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:28:08.528201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:28:08.528201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:28:08.528201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 07 12:28:08.528201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:08.528201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2c459ad3-6b7c-49e2-a274-fb5b09751bb9 tempest-AZAdminNegativeTestJSON-834581458 tempest-AZAdminNegativeTestJSON-834581458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:28:08.529818 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2c459ad3-6b7c-49e2-a274-fb5b09751bb9 tempest-AZAdminNegativeTestJSON-834581458 tempest-AZAdminNegativeTestJSON-834581458-project] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.471143 Sep 07 12:28:08.529818 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 7/7] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Sep 7 12:28:08 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 472 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:28:08.534799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42527177-9c56-42a9-9816-bd1a230a7e4d tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:08.535374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42527177-9c56-42a9-9816-bd1a230a7e4d tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:08.535821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42527177-9c56-42a9-9816-bd1a230a7e4d tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:08.545348 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-42527177-9c56-42a9-9816-bd1a230a7e4d tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.984778 Sep 07 12:28:08.551953 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1/8] 10.222.0.16 () {60 vars in 1208 bytes} [Wed Sep 7 12:28:06 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:28:08.570159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8dc40fdc-7dc3-405f-accf-adc2d395cf5b tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1487586604"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:08.602344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.aggregate [None req-8dc40fdc-7dc3-405f-accf-adc2d395cf5b tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] Generated uuid 9006d201-013e-4bdf-b17e-f0b0a0b17adf for aggregate {{(pid=122433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 12:28:08.745223 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8dc40fdc-7dc3-405f-accf-adc2d395cf5b tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.179376 Sep 07 12:28:08.746858 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2/9] 10.222.0.16 () {62 vars in 1205 bytes} [Wed Sep 7 12:28:08 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 12:28:08.759573 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ad6f6ce4-c139-4513-8f5e-6a96099d1f47 tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1387904405"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:08.983073 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ad6f6ce4-c139-4513-8f5e-6a96099d1f47 tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.228057 Sep 07 12:28:08.983990 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3/10] 10.222.0.16 () {62 vars in 1210 bytes} [Wed Sep 7 12:28:08 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:28:09.353503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea722877-2ea1-492c-86f8-eecc998bdb1b tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:09.362252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea722877-2ea1-492c-86f8-eecc998bdb1b tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:09.363942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea722877-2ea1-492c-86f8-eecc998bdb1b tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:09.365728 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea722877-2ea1-492c-86f8-eecc998bdb1b tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:09.367190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea722877-2ea1-492c-86f8-eecc998bdb1b tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:09.368295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea722877-2ea1-492c-86f8-eecc998bdb1b tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:09.371235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea722877-2ea1-492c-86f8-eecc998bdb1b tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:09.474554 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ea722877-2ea1-492c-86f8-eecc998bdb1b tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.945951 Sep 07 12:28:09.485939 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 8/11] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Sep 7 12:28:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:09.490730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-babb354c-7e4e-4cc5-a527-935cea36f9af tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:09.542103 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-babb354c-7e4e-4cc5-a527-935cea36f9af tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.055081 Sep 07 12:28:09.542752 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 9/12] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Sep 7 12:28:09 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:28:09.552102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d5b6fb9c-518d-4e0a-ac9d-a0bf0f541216 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Calling method '.version_select at 0x7fc41a84fee0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:09.554052 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5b6fb9c-518d-4e0a-ac9d-a0bf0f541216 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:09.554547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5b6fb9c-518d-4e0a-ac9d-a0bf0f541216 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:09.554988 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5b6fb9c-518d-4e0a-ac9d-a0bf0f541216 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:09.609955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5b6fb9c-518d-4e0a-ac9d-a0bf0f541216 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:09.610812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5b6fb9c-518d-4e0a-ac9d-a0bf0f541216 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:09.611470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5b6fb9c-518d-4e0a-ac9d-a0bf0f541216 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:09.624650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5b6fb9c-518d-4e0a-ac9d-a0bf0f541216 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:09.625242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5b6fb9c-518d-4e0a-ac9d-a0bf0f541216 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:09.625795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5b6fb9c-518d-4e0a-ac9d-a0bf0f541216 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:09.634131 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d5b6fb9c-518d-4e0a-ac9d-a0bf0f541216 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.648711 Sep 07 12:28:09.635710 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 4/13] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:28:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:09.641475 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e35e5b4a-3d1f-480e-9334-05af161937bc tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-852087-9"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:09.658279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e35e5b4a-3d1f-480e-9334-05af161937bc tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:09.659139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e35e5b4a-3d1f-480e-9334-05af161937bc tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:09.659816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e35e5b4a-3d1f-480e-9334-05af161937bc tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:09.708579 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-125ecae8-64b3-48d9-a915-4e248fb37631 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Calling method '.version_select at 0x7fc41a814ca0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:09.714437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-125ecae8-64b3-48d9-a915-4e248fb37631 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:09.714936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-125ecae8-64b3-48d9-a915-4e248fb37631 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:09.716300 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-125ecae8-64b3-48d9-a915-4e248fb37631 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:09.754867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-125ecae8-64b3-48d9-a915-4e248fb37631 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:09.755902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-125ecae8-64b3-48d9-a915-4e248fb37631 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:09.770550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-125ecae8-64b3-48d9-a915-4e248fb37631 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:09.799021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-125ecae8-64b3-48d9-a915-4e248fb37631 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:09.800501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-125ecae8-64b3-48d9-a915-4e248fb37631 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:09.801637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-125ecae8-64b3-48d9-a915-4e248fb37631 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:09.815501 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-125ecae8-64b3-48d9-a915-4e248fb37631 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.271711 Sep 07 12:28:09.816574 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 10/14] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Sep 7 12:28:09 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:09.823874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-49819720-2d98-44db-8dca-59632e04635b tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Calling method '.version_select at 0x7fc41a814dc0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:09.827042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49819720-2d98-44db-8dca-59632e04635b tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:09.827734 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49819720-2d98-44db-8dca-59632e04635b tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:09.828616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49819720-2d98-44db-8dca-59632e04635b tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:09.847433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49819720-2d98-44db-8dca-59632e04635b tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:09.848299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49819720-2d98-44db-8dca-59632e04635b tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:09.849123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49819720-2d98-44db-8dca-59632e04635b tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:09.967611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49819720-2d98-44db-8dca-59632e04635b tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:09.969684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49819720-2d98-44db-8dca-59632e04635b tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:09.970650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49819720-2d98-44db-8dca-59632e04635b tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:10.010239 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-49819720-2d98-44db-8dca-59632e04635b tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h1-852087-9/servers" status: 200 len: 104 microversion: 2.1 time: 0.190762 Sep 07 12:28:10.012531 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 11/15] 10.222.0.16 () {58 vars in 1212 bytes} [Wed Sep 7 12:28:09 2022] GET /compute/v2.1/os-hypervisors/n-h1-852087-9/servers => generated 104 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:10.035131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d5df6599-6ade-48bf-b446-44e23b5a9210 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Calling method '.version_select at 0x7fc41a8180d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:10.037877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5df6599-6ade-48bf-b446-44e23b5a9210 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:10.038640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5df6599-6ade-48bf-b446-44e23b5a9210 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:10.039364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5df6599-6ade-48bf-b446-44e23b5a9210 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:10.077120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5df6599-6ade-48bf-b446-44e23b5a9210 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:10.079431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5df6599-6ade-48bf-b446-44e23b5a9210 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:10.080142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5df6599-6ade-48bf-b446-44e23b5a9210 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:10.113374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5df6599-6ade-48bf-b446-44e23b5a9210 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:10.115724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5df6599-6ade-48bf-b446-44e23b5a9210 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:10.116579 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5df6599-6ade-48bf-b446-44e23b5a9210 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:10.135967 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d5df6599-6ade-48bf-b446-44e23b5a9210 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.104692 Sep 07 12:28:10.138715 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 12/16] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:28:10 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:10.153083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a87932e9-5757-4b7d-a012-ecde456f5542 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Calling method '.version_select at 0x7fc41a818c10>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:10.158861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a87932e9-5757-4b7d-a012-ecde456f5542 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:10.159632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a87932e9-5757-4b7d-a012-ecde456f5542 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:10.161047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a87932e9-5757-4b7d-a012-ecde456f5542 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:10.186308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a87932e9-5757-4b7d-a012-ecde456f5542 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:10.187818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a87932e9-5757-4b7d-a012-ecde456f5542 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:10.189295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a87932e9-5757-4b7d-a012-ecde456f5542 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:10.205602 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a87932e9-5757-4b7d-a012-ecde456f5542 tempest-HypervisorAdminUnderV252Test-1588135211 tempest-HypervisorAdminUnderV252Test-1588135211-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h1-852087-9/search" status: 200 len: 104 microversion: 2.1 time: 0.056516 Sep 07 12:28:10.207894 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 13/17] 10.222.0.16 () {58 vars in 1209 bytes} [Wed Sep 7 12:28:10 2022] GET /compute/v2.1/os-hypervisors/n-h1-852087-9/search => generated 104 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:10.410309 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e35e5b4a-3d1f-480e-9334-05af161937bc tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.41 time: 0.772226 Sep 07 12:28:10.410922 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 5/18] 10.222.0.16 () {62 vars in 1232 bytes} [Wed Sep 7 12:28:09 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:28:10.426459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dbc7948d-4943-4f51-b791-7676d10309d1 tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-852087-9"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:10.497641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbc7948d-4943-4f51-b791-7676d10309d1 tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:10.498598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbc7948d-4943-4f51-b791-7676d10309d1 tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:10.500488 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbc7948d-4943-4f51-b791-7676d10309d1 tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:11.861877 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dbc7948d-4943-4f51-b791-7676d10309d1 tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 1.440749 Sep 07 12:28:11.864504 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 14/19] 10.222.0.16 () {62 vars in 1232 bytes} [Wed Sep 7 12:28:10 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:28:11.877876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-90fe22e1-4046-4a3e-abe0-2a9334a96770 tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:11.945057 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-90fe22e1-4046-4a3e-abe0-2a9334a96770 tempest-AggregatesAdminTestV241-72461010 tempest-AggregatesAdminTestV241-72461010-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.072779 Sep 07 12:28:11.947796 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 6/20] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Sep 7 12:28:11 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:11.997953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e274b76a-fa95-408c-92f7-6f8c56dc38b1 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1682005143", "name": "tempest-test_aggregate-802848597"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:12.128371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.aggregate [None req-e274b76a-fa95-408c-92f7-6f8c56dc38b1 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Generated uuid 1cebe90e-6b6d-4e16-ad1b-805f68f8142c for aggregate {{(pid=122432) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 12:28:12.257196 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e274b76a-fa95-408c-92f7-6f8c56dc38b1 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.264541 Sep 07 12:28:12.270259 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7b67ea8e-a27f-4929-a1fb-ed5d67fd0405 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:12.273395 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 15/21] 10.222.0.16 () {60 vars in 1165 bytes} [Wed Sep 7 12:28:11 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:12.295720 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7b67ea8e-a27f-4929-a1fb-ed5d67fd0405 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.027035 Sep 07 12:28:12.305365 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 7/22] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Sep 7 12:28:12 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:12.334284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a67714d3-b589-4c97-9f7d-9c9828c3d87d tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-852087-9"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:12.361345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a67714d3-b589-4c97-9f7d-9c9828c3d87d tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:12.361916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a67714d3-b589-4c97-9f7d-9c9828c3d87d tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:12.362370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a67714d3-b589-4c97-9f7d-9c9828c3d87d tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:12.711724 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a67714d3-b589-4c97-9f7d-9c9828c3d87d tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 314 microversion: 2.1 time: 0.403444 Sep 07 12:28:12.717665 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 16/23] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Sep 7 12:28:12 2022] POST /compute/v2.1/os-aggregates/2/action => generated 314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:13.451531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8dd911f6-9be7-4bf2-96c5-6a85551d9bfa tempest-FlavorsAccessTestJSON-1361933440 tempest-FlavorsAccessTestJSON-1361933440-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1975023231", "id": 694108931, "os-flavor-access:is_public": "False"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:13.519976 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8dd911f6-9be7-4bf2-96c5-6a85551d9bfa tempest-FlavorsAccessTestJSON-1361933440 tempest-FlavorsAccessTestJSON-1361933440-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.908577 Sep 07 12:28:13.520571 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 8/24] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:28:12 2022] POST /compute/v2.1/flavors => generated 428 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:28:13.535661 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-70a35479-7165-42da-a90c-058a550b0ee6 tempest-FlavorsAccessTestJSON-1361933440 tempest-FlavorsAccessTestJSON-1361933440-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1b58788a8a0d4d1eb1f46eff01bd1870"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:13.836164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4a11ca31-6ea2-4592-bb18-adbc77b95222 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1378023388", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "availability_zone": "tempest-test_az-1682005143"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:13.891016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a11ca31-6ea2-4592-bb18-adbc77b95222 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:13.894642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a11ca31-6ea2-4592-bb18-adbc77b95222 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:13.895968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a11ca31-6ea2-4592-bb18-adbc77b95222 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:13.897701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a11ca31-6ea2-4592-bb18-adbc77b95222 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:13.898615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a11ca31-6ea2-4592-bb18-adbc77b95222 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:13.899496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a11ca31-6ea2-4592-bb18-adbc77b95222 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:14.270769 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-70a35479-7165-42da-a90c-058a550b0ee6 tempest-FlavorsAccessTestJSON-1361933440 tempest-FlavorsAccessTestJSON-1361933440-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/694108931/action" status: 200 len: 96 microversion: 2.1 time: 0.739363 Sep 07 12:28:14.271498 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 9/25] 10.222.0.16 () {60 vars in 1197 bytes} [Wed Sep 7 12:28:13 2022] POST /compute/v2.1/flavors/694108931/action => generated 96 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 12:28:14.808112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de70c5d5-6667-485b-b2fa-2abac769fced tempest-FlavorsAccessTestJSON-253856730 tempest-FlavorsAccessTestJSON-253856730-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:14.858564 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-de70c5d5-6667-485b-b2fa-2abac769fced tempest-FlavorsAccessTestJSON-253856730 tempest-FlavorsAccessTestJSON-253856730-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.580148 Sep 07 12:28:14.859159 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 10/26] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:28:14 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:28:14.878917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-14b6938d-3f0c-46c8-a507-83910fa90b04 tempest-FlavorsAccessTestJSON-1361933440 tempest-FlavorsAccessTestJSON-1361933440-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1b58788a8a0d4d1eb1f46eff01bd1870"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:15.187442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-4a11ca31-6ea2-4592-bb18-adbc77b95222 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:28:15.484300 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-4a11ca31-6ea2-4592-bb18-adbc77b95222 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:28:15.485045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-4a11ca31-6ea2-4592-bb18-adbc77b95222 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:28:15.486328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-4a11ca31-6ea2-4592-bb18-adbc77b95222 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:28:15.486883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-4a11ca31-6ea2-4592-bb18-adbc77b95222 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:28:15.487689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-4a11ca31-6ea2-4592-bb18-adbc77b95222 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:28:15.503592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a11ca31-6ea2-4592-bb18-adbc77b95222 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:15.504435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a11ca31-6ea2-4592-bb18-adbc77b95222 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:15.505112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a11ca31-6ea2-4592-bb18-adbc77b95222 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:15.506248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a11ca31-6ea2-4592-bb18-adbc77b95222 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:15.506910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a11ca31-6ea2-4592-bb18-adbc77b95222 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:15.507507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a11ca31-6ea2-4592-bb18-adbc77b95222 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:15.552582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-4a11ca31-6ea2-4592-bb18-adbc77b95222 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Getting quotas for project d71cb3cbb2ee4a9dbfcd16759a74b093. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:28:15.564647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-4a11ca31-6ea2-4592-bb18-adbc77b95222 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Getting quotas for user c5151bb757514a6392a0d93f2bbfe406 and project d71cb3cbb2ee4a9dbfcd16759a74b093. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:28:15.577455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4a11ca31-6ea2-4592-bb18-adbc77b95222 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:28:15.580611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4a11ca31-6ea2-4592-bb18-adbc77b95222 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:28:15.648161 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4a11ca31-6ea2-4592-bb18-adbc77b95222 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.369883 Sep 07 12:28:15.649057 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 17/27] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:28:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:28:15.664509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ce0c4eb1-031b-468a-ad02-bfa530c56776 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:15.665745 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ce0c4eb1-031b-468a-ad02-bfa530c56776 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:15.809368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ce0c4eb1-031b-468a-ad02-bfa530c56776 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5151bb757514a6392a0d93f2bbfe406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71cb3cbb2ee4a9dbfcd16759a74b093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:15.841000 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ce0c4eb1-031b-468a-ad02-bfa530c56776 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 200 len: 1243 microversion: 2.1 time: 0.181933 Sep 07 12:28:15.842821 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 18/28] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:15 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 1243 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:15.933166 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-14b6938d-3f0c-46c8-a507-83910fa90b04 tempest-FlavorsAccessTestJSON-1361933440 tempest-FlavorsAccessTestJSON-1361933440-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/694108931/action" status: 200 len: 21 microversion: 2.1 time: 1.059347 Sep 07 12:28:15.935779 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 11/29] 10.222.0.16 () {60 vars in 1197 bytes} [Wed Sep 7 12:28:14 2022] POST /compute/v2.1/flavors/694108931/action => generated 21 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 12:28:15.946550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-680ae549-8408-4e72-95b6-3cebc34b0aaf tempest-FlavorsAccessTestJSON-253856730 tempest-FlavorsAccessTestJSON-253856730-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:15.992183 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-680ae549-8408-4e72-95b6-3cebc34b0aaf tempest-FlavorsAccessTestJSON-253856730 tempest-FlavorsAccessTestJSON-253856730-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050418 Sep 07 12:28:15.993037 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 19/30] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:28:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:16.014521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-50ac1a8e-3597-4e54-afbe-325d36c463a2 tempest-FlavorsAccessTestJSON-1361933440 tempest-FlavorsAccessTestJSON-1361933440-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:16.062103 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-50ac1a8e-3597-4e54-afbe-325d36c463a2 tempest-FlavorsAccessTestJSON-1361933440 tempest-FlavorsAccessTestJSON-1361933440-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/694108931" status: 202 len: 0 microversion: 2.1 time: 0.051380 Sep 07 12:28:16.064086 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 12/31] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Sep 7 12:28:16 2022] DELETE /compute/v2.1/flavors/694108931 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:28:16.083889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6fb1a35f-ce0d-4319-8590-840f70d35277 tempest-FlavorsAccessTestJSON-1361933440 tempest-FlavorsAccessTestJSON-1361933440-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:16.142430 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6fb1a35f-ce0d-4319-8590-840f70d35277 tempest-FlavorsAccessTestJSON-1361933440 tempest-FlavorsAccessTestJSON-1361933440-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.071646 Sep 07 12:28:16.143423 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 20/32] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:28:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:16.172494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-31dec818-b7c1-49f4-aced-b12065497d25 tempest-FlavorsAccessTestJSON-1361933440 tempest-FlavorsAccessTestJSON-1361933440-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-2083630386", "id": 1661778458, "os-flavor-access:is_public": "False"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:16.213864 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-31dec818-b7c1-49f4-aced-b12065497d25 tempest-FlavorsAccessTestJSON-1361933440 tempest-FlavorsAccessTestJSON-1361933440-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.046637 Sep 07 12:28:16.214933 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 13/33] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:28:16 2022] POST /compute/v2.1/flavors => generated 431 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:16.231667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-00492046-dcd3-4618-a56c-ab7f57258226 tempest-FlavorsAccessTestJSON-1361933440 tempest-FlavorsAccessTestJSON-1361933440-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:16.297841 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-00492046-dcd3-4618-a56c-ab7f57258226 tempest-FlavorsAccessTestJSON-1361933440 tempest-FlavorsAccessTestJSON-1361933440-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1661778458/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.070506 Sep 07 12:28:16.308899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0773f2ee-fe26-461d-abbf-68f77e18dfc8 tempest-FlavorsAccessTestJSON-1361933440 tempest-FlavorsAccessTestJSON-1361933440-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:16.310778 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 21/34] 10.222.0.16 () {58 vars in 1209 bytes} [Wed Sep 7 12:28:16 2022] GET /compute/v2.1/flavors/1661778458/os-flavor-access => generated 21 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:28:16.332226 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0773f2ee-fe26-461d-abbf-68f77e18dfc8 tempest-FlavorsAccessTestJSON-1361933440 tempest-FlavorsAccessTestJSON-1361933440-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1661778458" status: 202 len: 0 microversion: 2.1 time: 0.026817 Sep 07 12:28:16.334133 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 14/35] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Sep 7 12:28:16 2022] DELETE /compute/v2.1/flavors/1661778458 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:28:16.343841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cbd26329-f992-4cdf-9191-eed0e5d30260 tempest-FlavorsAccessTestJSON-1361933440 tempest-FlavorsAccessTestJSON-1361933440-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:16.369372 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cbd26329-f992-4cdf-9191-eed0e5d30260 tempest-FlavorsAccessTestJSON-1361933440 tempest-FlavorsAccessTestJSON-1361933440-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030905 Sep 07 12:28:16.371420 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 22/36] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:28:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:28:16.870600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7bee84e0-34ae-4fa5-af55-beb611ec185a tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:16.873776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7bee84e0-34ae-4fa5-af55-beb611ec185a tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:18.585915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7bee84e0-34ae-4fa5-af55-beb611ec185a tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5151bb757514a6392a0d93f2bbfe406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71cb3cbb2ee4a9dbfcd16759a74b093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:18.634826 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7bee84e0-34ae-4fa5-af55-beb611ec185a tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 200 len: 1243 microversion: 2.1 time: 1.769583 Sep 07 12:28:18.638036 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 15/37] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:16 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 1243 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:19.661798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5a067465-f87e-445f-ae26-f66a75af94c4 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:19.662417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5a067465-f87e-445f-ae26-f66a75af94c4 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:19.677857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a067465-f87e-445f-ae26-f66a75af94c4 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:19.680510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a067465-f87e-445f-ae26-f66a75af94c4 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:19.681196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a067465-f87e-445f-ae26-f66a75af94c4 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:19.683409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a067465-f87e-445f-ae26-f66a75af94c4 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:19.684181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a067465-f87e-445f-ae26-f66a75af94c4 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:19.684636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a067465-f87e-445f-ae26-f66a75af94c4 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:19.827195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=16 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:28:20.038437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5a067465-f87e-445f-ae26-f66a75af94c4 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5151bb757514a6392a0d93f2bbfe406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71cb3cbb2ee4a9dbfcd16759a74b093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:20.061358 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5a067465-f87e-445f-ae26-f66a75af94c4 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 200 len: 1297 microversion: 2.1 time: 0.404520 Sep 07 12:28:20.061985 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 23/38] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:19 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 1297 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:20.723055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b05fc43c-03ea-43dd-8eb3-75507362de17 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Calling method '.version_select at 0x7fc419fb4af0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:20.725386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b05fc43c-03ea-43dd-8eb3-75507362de17 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:20.726075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b05fc43c-03ea-43dd-8eb3-75507362de17 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:20.726658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b05fc43c-03ea-43dd-8eb3-75507362de17 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:20.767633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b05fc43c-03ea-43dd-8eb3-75507362de17 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:20.769768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b05fc43c-03ea-43dd-8eb3-75507362de17 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:20.771041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b05fc43c-03ea-43dd-8eb3-75507362de17 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:20.796900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b05fc43c-03ea-43dd-8eb3-75507362de17 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:20.797869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b05fc43c-03ea-43dd-8eb3-75507362de17 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:20.799286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b05fc43c-03ea-43dd-8eb3-75507362de17 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:20.819869 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b05fc43c-03ea-43dd-8eb3-75507362de17 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.998996 Sep 07 12:28:20.822974 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 16/39] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:28:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:20.836591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e4362db-92fb-4eb3-a088-419a385f067d tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Calling method '.version_select at 0x7fc419e06040>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:20.840243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e4362db-92fb-4eb3-a088-419a385f067d tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:20.840990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e4362db-92fb-4eb3-a088-419a385f067d tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:20.841676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e4362db-92fb-4eb3-a088-419a385f067d tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:20.909179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e4362db-92fb-4eb3-a088-419a385f067d tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:20.910410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e4362db-92fb-4eb3-a088-419a385f067d tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:20.912106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e4362db-92fb-4eb3-a088-419a385f067d tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:20.943985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e4362db-92fb-4eb3-a088-419a385f067d tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:20.945590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e4362db-92fb-4eb3-a088-419a385f067d tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:20.947478 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e4362db-92fb-4eb3-a088-419a385f067d tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:20.959624 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6e4362db-92fb-4eb3-a088-419a385f067d tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.127700 Sep 07 12:28:20.963111 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 24/40] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Sep 7 12:28:20 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:20.984094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-99fa2aac-fd1c-4f5c-a10f-6ed7faf5d8a8 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Calling method '.version_select at 0x7fc419f0e790>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:20.988622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99fa2aac-fd1c-4f5c-a10f-6ed7faf5d8a8 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:20.989538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99fa2aac-fd1c-4f5c-a10f-6ed7faf5d8a8 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:20.990173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99fa2aac-fd1c-4f5c-a10f-6ed7faf5d8a8 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:21.010234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99fa2aac-fd1c-4f5c-a10f-6ed7faf5d8a8 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:21.010913 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99fa2aac-fd1c-4f5c-a10f-6ed7faf5d8a8 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:21.011571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99fa2aac-fd1c-4f5c-a10f-6ed7faf5d8a8 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:21.032626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99fa2aac-fd1c-4f5c-a10f-6ed7faf5d8a8 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:21.034156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99fa2aac-fd1c-4f5c-a10f-6ed7faf5d8a8 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:21.034891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99fa2aac-fd1c-4f5c-a10f-6ed7faf5d8a8 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:21.047075 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-99fa2aac-fd1c-4f5c-a10f-6ed7faf5d8a8 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.067863 Sep 07 12:28:21.048358 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 17/41] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:28:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:21.058677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f04dce79-7175-427b-a710-396edd4fda79 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Calling method '.version_select at 0x7fc419e79310>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:21.061947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f04dce79-7175-427b-a710-396edd4fda79 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:21.062734 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f04dce79-7175-427b-a710-396edd4fda79 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:21.063385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f04dce79-7175-427b-a710-396edd4fda79 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:21.088357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ff1fd8c7-fdb5-4a89-b48e-4dd563fcee80 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:21.089163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ff1fd8c7-fdb5-4a89-b48e-4dd563fcee80 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:21.105663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f04dce79-7175-427b-a710-396edd4fda79 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:21.106394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f04dce79-7175-427b-a710-396edd4fda79 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:21.110089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff1fd8c7-fdb5-4a89-b48e-4dd563fcee80 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:21.110601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff1fd8c7-fdb5-4a89-b48e-4dd563fcee80 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:21.111309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f04dce79-7175-427b-a710-396edd4fda79 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:21.111526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff1fd8c7-fdb5-4a89-b48e-4dd563fcee80 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:21.112985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff1fd8c7-fdb5-4a89-b48e-4dd563fcee80 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:21.114267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff1fd8c7-fdb5-4a89-b48e-4dd563fcee80 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:21.115057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff1fd8c7-fdb5-4a89-b48e-4dd563fcee80 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:21.126744 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f04dce79-7175-427b-a710-396edd4fda79 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.071610 Sep 07 12:28:21.127788 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 25/42] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Sep 7 12:28:21 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:21.145828 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-33ab14b6-d4c2-4ff9-9843-0926746fd908 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Calling method '.version_select at 0x7fc419e79a60>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:21.147876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33ab14b6-d4c2-4ff9-9843-0926746fd908 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:21.148582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33ab14b6-d4c2-4ff9-9843-0926746fd908 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:21.149220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33ab14b6-d4c2-4ff9-9843-0926746fd908 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:21.184977 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-33ab14b6-d4c2-4ff9-9843-0926746fd908 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.043232 Sep 07 12:28:21.186353 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 26/43] 10.222.0.16 () {58 vars in 1179 bytes} [Wed Sep 7 12:28:21 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:21.202314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8fbaf2e9-62a1-452f-ab8e-b70406f75249 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Calling method '.version_select at 0x7fc419e06700>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:21.205090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fbaf2e9-62a1-452f-ab8e-b70406f75249 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:21.206078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fbaf2e9-62a1-452f-ab8e-b70406f75249 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:21.207087 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fbaf2e9-62a1-452f-ab8e-b70406f75249 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:21.237473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:28:21.241417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fbaf2e9-62a1-452f-ab8e-b70406f75249 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:21.242242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fbaf2e9-62a1-452f-ab8e-b70406f75249 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:21.242911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fbaf2e9-62a1-452f-ab8e-b70406f75249 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:21.258174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fbaf2e9-62a1-452f-ab8e-b70406f75249 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:21.259032 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fbaf2e9-62a1-452f-ab8e-b70406f75249 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:21.259714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fbaf2e9-62a1-452f-ab8e-b70406f75249 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:21.267857 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8fbaf2e9-62a1-452f-ab8e-b70406f75249 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.069176 Sep 07 12:28:21.269162 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 27/44] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:28:21 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:21.280995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e463974-d8df-4070-9eb2-ed82c49ca7e6 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Calling method '.version_select at 0x7fc419db15e0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:21.283333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e463974-d8df-4070-9eb2-ed82c49ca7e6 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:21.284057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e463974-d8df-4070-9eb2-ed82c49ca7e6 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:21.284727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e463974-d8df-4070-9eb2-ed82c49ca7e6 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:21.300084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e463974-d8df-4070-9eb2-ed82c49ca7e6 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:21.307851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e463974-d8df-4070-9eb2-ed82c49ca7e6 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:21.308655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e463974-d8df-4070-9eb2-ed82c49ca7e6 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:21.320911 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2e463974-d8df-4070-9eb2-ed82c49ca7e6 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.044752 Sep 07 12:28:21.327774 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 28/45] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Sep 7 12:28:21 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:21.341590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-46c6eab8-4c5f-4aa4-a4e8-7aa40c14eac9 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Calling method '.version_select at 0x7fc419db19d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:21.344209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46c6eab8-4c5f-4aa4-a4e8-7aa40c14eac9 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:21.344967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46c6eab8-4c5f-4aa4-a4e8-7aa40c14eac9 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:21.345645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46c6eab8-4c5f-4aa4-a4e8-7aa40c14eac9 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:21.376718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46c6eab8-4c5f-4aa4-a4e8-7aa40c14eac9 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:21.377452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46c6eab8-4c5f-4aa4-a4e8-7aa40c14eac9 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:21.378125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46c6eab8-4c5f-4aa4-a4e8-7aa40c14eac9 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:21.404097 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-46c6eab8-4c5f-4aa4-a4e8-7aa40c14eac9 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.066305 Sep 07 12:28:21.404730 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 29/46] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Sep 7 12:28:21 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:22.045879 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8cab1af4-400a-4839-8eea-21d4b609da95 tempest-HypervisorAdminNegativeTestJSON-523644397 tempest-HypervisorAdminNegativeTestJSON-523644397-project] Calling method '.version_select at 0x7fc419db1820>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:22.047734 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8cab1af4-400a-4839-8eea-21d4b609da95 tempest-HypervisorAdminNegativeTestJSON-523644397 tempest-HypervisorAdminNegativeTestJSON-523644397-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'f0430fbf1f9c45d68fe14065dad57b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f69d93dedc14a7f8b5dc1cd506b73b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:22.049452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8cab1af4-400a-4839-8eea-21d4b609da95 tempest-HypervisorAdminNegativeTestJSON-523644397 tempest-HypervisorAdminNegativeTestJSON-523644397-project] Request method failure captured: Sep 07 12:28:22.049452 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Sep 07 12:28:22.049452 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:28:22.049452 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:28:22.049452 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:28:22.049452 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:28:22.049452 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:28:22.049452 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:28:22.049452 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:28:22.049452 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:28:22.049452 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5i_PUkMcWlSOddsoGt533uOuQtijI7sYKzaFj41mmRiTzC9u5cTmAMat18LzL5fdlz6DJNHA7-4hf4QBk9WxjjBlJGTJlC_FyjG4neERDJnzcMhtHD_AT0vHAy02V7xVxpV2HbXjuA64VO7i8byC7HaspS_M2aGD64SmqmssPZmQY Sep 07 12:28:22.049452 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:28:22.049452 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:28:22.049452 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:28:22.049452 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:28:22.049452 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:28:22.049452 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:28:22.049452 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 3f69d93dedc14a7f8b5dc1cd506b73b7 Sep 07 12:28:22.049452 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-523644397 Sep 07 12:28:22.049452 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:28:22.049452 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:28:22.053115 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f69d93dedc14a7f8b5dc1cd506b73b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f69d93dedc14a7f8b5dc1cd506b73b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f69d93dedc14a7f8b5dc1cd506b73b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f69d93dedc14a7f8b5dc1cd506b73b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:28:22.053115 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-523644397 Sep 07 12:28:22.053115 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 3f69d93dedc14a7f8b5dc1cd506b73b7 Sep 07 12:28:22.053115 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-523644397 Sep 07 12:28:22.053115 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-HypervisorAdminNegativeTestJSON-523644397-project Sep 07 12:28:22.053115 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:28:22.053115 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:28:22.053115 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: f0430fbf1f9c45d68fe14065dad57b73 Sep 07 12:28:22.053115 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-523644397-project Sep 07 12:28:22.053115 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:28:22.053115 n-d-852087-9 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 07 12:28:22.053115 n-d-852087-9 devstack@n-api.service[122432]: action_args: {} Sep 07 12:28:22.053115 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:28:22.054846 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:22.054846 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:28:22.054846 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:28:22.054846 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:28:22.054846 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:28:22.054846 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:28:22.054846 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:28:22.054846 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:28:22.054846 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:28:22.054846 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Sep 07 12:28:22.054846 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._detail(req) Sep 07 12:28:22.054846 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Sep 07 12:28:22.054846 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Sep 07 12:28:22.054846 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:28:22.054846 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:28:22.054846 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:28:22.054846 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:28:22.054846 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:28:22.054846 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:28:22.055827 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:28:22.055827 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:28:22.055827 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:28:22.055827 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:28:22.055827 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:28:22.055827 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:28:22.055827 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:28:22.055827 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:28:22.055827 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 07 12:28:22.055827 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:22.055827 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:28:22.055827 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:22.055827 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:22.055827 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:28:22.055827 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:28:22.055827 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:28:22.055827 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:28:22.055827 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 07 12:28:22.055827 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:22.059944 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8cab1af4-400a-4839-8eea-21d4b609da95 tempest-HypervisorAdminNegativeTestJSON-523644397 tempest-HypervisorAdminNegativeTestJSON-523644397-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:28:22.059944 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8cab1af4-400a-4839-8eea-21d4b609da95 tempest-HypervisorAdminNegativeTestJSON-523644397 tempest-HypervisorAdminNegativeTestJSON-523644397-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.645227 Sep 07 12:28:22.059944 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 30/47] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Sep 7 12:28:21 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 653 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:28:22.063343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d3d1dba8-f968-4c7f-a4be-89cb887bec21 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Calling method '.version_select at 0x7fc419d4ae50>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:22.065135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3d1dba8-f968-4c7f-a4be-89cb887bec21 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:22.065631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3d1dba8-f968-4c7f-a4be-89cb887bec21 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:22.073392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3d1dba8-f968-4c7f-a4be-89cb887bec21 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:22.099108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3d1dba8-f968-4c7f-a4be-89cb887bec21 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:22.099845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3d1dba8-f968-4c7f-a4be-89cb887bec21 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:22.100423 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3d1dba8-f968-4c7f-a4be-89cb887bec21 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:22.116073 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3d1dba8-f968-4c7f-a4be-89cb887bec21 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:22.116808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3d1dba8-f968-4c7f-a4be-89cb887bec21 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:22.117426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3d1dba8-f968-4c7f-a4be-89cb887bec21 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:22.133005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3d1dba8-f968-4c7f-a4be-89cb887bec21 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 12:28:22.136454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3d1dba8-f968-4c7f-a4be-89cb887bec21 tempest-HypervisorAdminTestJSON-349621024 tempest-HypervisorAdminTestJSON-349621024-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 12:28:22.140070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a53874e-dfa2-44d8-a426-0654dc58937c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:22.144276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a53874e-dfa2-44d8-a426-0654dc58937c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:22.145065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a53874e-dfa2-44d8-a426-0654dc58937c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:22.147527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a53874e-dfa2-44d8-a426-0654dc58937c None None] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:22.149960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a53874e-dfa2-44d8-a426-0654dc58937c None None] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:22.151088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a53874e-dfa2-44d8-a426-0654dc58937c None None] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:22.173498 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.compute.rpcapi [None req-7a53874e-dfa2-44d8-a426-0654dc58937c None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 07 12:28:22.174752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a53874e-dfa2-44d8-a426-0654dc58937c None None] Releasing lock "compute-rpcapi-router" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 12:28:22.239128 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7a53874e-dfa2-44d8-a426-0654dc58937c None None] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.179194 Sep 07 12:28:22.248209 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 31/48] 10.222.0.16 () {58 vars in 1173 bytes} [Wed Sep 7 12:28:22 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:22.254072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9fd23237-3ed2-4b92-b4ed-a497450625f0 tempest-HypervisorAdminNegativeTestJSON-523644397 tempest-HypervisorAdminNegativeTestJSON-523644397-project] Calling method '.version_select at 0x7fc419d4a5e0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:22.256732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9fd23237-3ed2-4b92-b4ed-a497450625f0 tempest-HypervisorAdminNegativeTestJSON-523644397 tempest-HypervisorAdminNegativeTestJSON-523644397-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'f0430fbf1f9c45d68fe14065dad57b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f69d93dedc14a7f8b5dc1cd506b73b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:22.258734 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9fd23237-3ed2-4b92-b4ed-a497450625f0 tempest-HypervisorAdminNegativeTestJSON-523644397 tempest-HypervisorAdminNegativeTestJSON-523644397-project] Request method failure captured: Sep 07 12:28:22.258734 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Sep 07 12:28:22.258734 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:28:22.258734 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:28:22.258734 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:28:22.258734 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:28:22.258734 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:28:22.258734 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:28:22.258734 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:28:22.258734 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:28:22.258734 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5i_PUkMcWlSOddsoGt533uOuQtijI7sYKzaFj41mmRiTzC9u5cTmAMat18LzL5fdlz6DJNHA7-4hf4QBk9WxjjBlJGTJlC_FyjG4neERDJnzcMhtHD_AT0vHAy02V7xVxpV2HbXjuA64VO7i8byC7HaspS_M2aGD64SmqmssPZmQY Sep 07 12:28:22.258734 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:28:22.258734 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:28:22.258734 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:28:22.258734 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:28:22.258734 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:28:22.258734 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:28:22.258734 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 3f69d93dedc14a7f8b5dc1cd506b73b7 Sep 07 12:28:22.258734 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-523644397 Sep 07 12:28:22.258734 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:28:22.258734 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:28:22.259865 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f69d93dedc14a7f8b5dc1cd506b73b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f69d93dedc14a7f8b5dc1cd506b73b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f69d93dedc14a7f8b5dc1cd506b73b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f69d93dedc14a7f8b5dc1cd506b73b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:28:22.259865 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-523644397 Sep 07 12:28:22.259865 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 3f69d93dedc14a7f8b5dc1cd506b73b7 Sep 07 12:28:22.259865 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-523644397 Sep 07 12:28:22.259865 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-HypervisorAdminNegativeTestJSON-523644397-project Sep 07 12:28:22.259865 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:28:22.259865 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:28:22.259865 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: f0430fbf1f9c45d68fe14065dad57b73 Sep 07 12:28:22.259865 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-523644397-project Sep 07 12:28:22.259865 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:28:22.259865 n-d-852087-9 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 07 12:28:22.259865 n-d-852087-9 devstack@n-api.service[122432]: action_args: {} Sep 07 12:28:22.259865 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:28:22.260484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:22.260484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:28:22.260484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:28:22.260484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:28:22.260484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:28:22.260484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:28:22.260484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:28:22.260484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:28:22.260484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:28:22.260484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Sep 07 12:28:22.260484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 07 12:28:22.260484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Sep 07 12:28:22.260484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Sep 07 12:28:22.260484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:28:22.260484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:28:22.260484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:28:22.260484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:28:22.260484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:28:22.260484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:28:22.261360 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:28:22.261360 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:28:22.261360 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:28:22.261360 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:28:22.261360 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:28:22.261360 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:28:22.261360 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:28:22.261360 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:28:22.261360 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 07 12:28:22.261360 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:22.261360 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:28:22.261360 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:22.261360 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:22.261360 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:28:22.261360 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:28:22.261360 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:28:22.261360 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:28:22.261360 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 07 12:28:22.261360 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:22.266003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9fd23237-3ed2-4b92-b4ed-a497450625f0 tempest-HypervisorAdminNegativeTestJSON-523644397 tempest-HypervisorAdminNegativeTestJSON-523644397-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:28:22.267778 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9fd23237-3ed2-4b92-b4ed-a497450625f0 tempest-HypervisorAdminNegativeTestJSON-523644397 tempest-HypervisorAdminNegativeTestJSON-523644397-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.017905 Sep 07 12:28:22.275419 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 32/49] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:28:22 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:28:22.286637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5b14ba73-36d0-496e-98b4-4a4bde1c7adc tempest-HypervisorAdminNegativeTestJSON-523644397 tempest-HypervisorAdminNegativeTestJSON-523644397-project] Calling method '.version_select at 0x7fc419cedd30>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:22.289273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5b14ba73-36d0-496e-98b4-4a4bde1c7adc tempest-HypervisorAdminNegativeTestJSON-523644397 tempest-HypervisorAdminNegativeTestJSON-523644397-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'f0430fbf1f9c45d68fe14065dad57b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f69d93dedc14a7f8b5dc1cd506b73b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:22.291763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5b14ba73-36d0-496e-98b4-4a4bde1c7adc tempest-HypervisorAdminNegativeTestJSON-523644397 tempest-HypervisorAdminNegativeTestJSON-523644397-project] Request method failure captured: Sep 07 12:28:22.291763 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Sep 07 12:28:22.291763 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:28:22.291763 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:28:22.291763 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:28:22.291763 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:28:22.291763 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:28:22.291763 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:28:22.291763 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:28:22.291763 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:28:22.291763 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5i_PUkMcWlSOddsoGt533uOuQtijI7sYKzaFj41mmRiTzC9u5cTmAMat18LzL5fdlz6DJNHA7-4hf4QBk9WxjjBlJGTJlC_FyjG4neERDJnzcMhtHD_AT0vHAy02V7xVxpV2HbXjuA64VO7i8byC7HaspS_M2aGD64SmqmssPZmQY Sep 07 12:28:22.291763 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:28:22.291763 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:28:22.291763 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:28:22.291763 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:28:22.291763 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:28:22.291763 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:28:22.291763 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 3f69d93dedc14a7f8b5dc1cd506b73b7 Sep 07 12:28:22.291763 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-523644397 Sep 07 12:28:22.291763 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:28:22.291763 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:28:22.292862 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f69d93dedc14a7f8b5dc1cd506b73b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f69d93dedc14a7f8b5dc1cd506b73b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f69d93dedc14a7f8b5dc1cd506b73b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f69d93dedc14a7f8b5dc1cd506b73b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:28:22.292862 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-523644397 Sep 07 12:28:22.292862 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 3f69d93dedc14a7f8b5dc1cd506b73b7 Sep 07 12:28:22.292862 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-523644397 Sep 07 12:28:22.292862 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-HypervisorAdminNegativeTestJSON-523644397-project Sep 07 12:28:22.292862 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:28:22.292862 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:28:22.292862 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: f0430fbf1f9c45d68fe14065dad57b73 Sep 07 12:28:22.292862 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-523644397-project Sep 07 12:28:22.292862 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:28:22.292862 n-d-852087-9 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 07 12:28:22.292862 n-d-852087-9 devstack@n-api.service[122432]: action_args: {} Sep 07 12:28:22.292862 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:28:22.294814 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:22.294814 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:28:22.294814 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:28:22.294814 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:28:22.294814 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:28:22.294814 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:28:22.294814 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:28:22.294814 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:28:22.294814 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:28:22.294814 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Sep 07 12:28:22.294814 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Sep 07 12:28:22.294814 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:28:22.294814 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:28:22.294814 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:28:22.294814 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:28:22.294814 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:28:22.294814 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:28:22.294814 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:28:22.294814 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:28:22.295793 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:28:22.295793 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:28:22.295793 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:28:22.295793 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:28:22.295793 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:28:22.295793 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:28:22.295793 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 07 12:28:22.295793 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:22.295793 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:28:22.295793 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:22.295793 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:22.295793 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:28:22.295793 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:28:22.295793 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:28:22.295793 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:28:22.295793 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 07 12:28:22.295793 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:22.298625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5b14ba73-36d0-496e-98b4-4a4bde1c7adc tempest-HypervisorAdminNegativeTestJSON-523644397 tempest-HypervisorAdminNegativeTestJSON-523644397-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:28:22.299693 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5b14ba73-36d0-496e-98b4-4a4bde1c7adc tempest-HypervisorAdminNegativeTestJSON-523644397 tempest-HypervisorAdminNegativeTestJSON-523644397-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.023167 Sep 07 12:28:22.306514 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 33/50] 10.222.0.16 () {58 vars in 1179 bytes} [Wed Sep 7 12:28:22 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:28:22.766916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a906ad80-5f45-4767-b171-ed4282092faa tempest-AZAdminV2TestJSON-2121291223 tempest-AZAdminV2TestJSON-2121291223-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:22.768943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a906ad80-5f45-4767-b171-ed4282092faa tempest-AZAdminV2TestJSON-2121291223 tempest-AZAdminV2TestJSON-2121291223-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:22.769655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a906ad80-5f45-4767-b171-ed4282092faa tempest-AZAdminV2TestJSON-2121291223 tempest-AZAdminV2TestJSON-2121291223-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:22.770231 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a906ad80-5f45-4767-b171-ed4282092faa tempest-AZAdminV2TestJSON-2121291223 tempest-AZAdminV2TestJSON-2121291223-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:22.771541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a906ad80-5f45-4767-b171-ed4282092faa tempest-AZAdminV2TestJSON-2121291223 tempest-AZAdminV2TestJSON-2121291223-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:22.772503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a906ad80-5f45-4767-b171-ed4282092faa tempest-AZAdminV2TestJSON-2121291223 tempest-AZAdminV2TestJSON-2121291223-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:22.773166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a906ad80-5f45-4767-b171-ed4282092faa tempest-AZAdminV2TestJSON-2121291223 tempest-AZAdminV2TestJSON-2121291223-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:22.842744 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a906ad80-5f45-4767-b171-ed4282092faa tempest-AZAdminV2TestJSON-2121291223 tempest-AZAdminV2TestJSON-2121291223-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone" status: 200 len: 190 microversion: 2.1 time: 0.534718 Sep 07 12:28:22.846127 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 34/51] 10.222.0.16 () {58 vars in 1164 bytes} [Wed Sep 7 12:28:22 2022] GET /compute/v2.1/os-availability-zone => generated 190 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:22.874622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ff1fd8c7-fdb5-4a89-b48e-4dd563fcee80 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5151bb757514a6392a0d93f2bbfe406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71cb3cbb2ee4a9dbfcd16759a74b093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:22.900337 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ff1fd8c7-fdb5-4a89-b48e-4dd563fcee80 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 200 len: 1339 microversion: 2.1 time: 1.817059 Sep 07 12:28:22.914598 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 18/52] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:21 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 1339 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:22.914598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd9a64ef-1594-4396-a5b7-39a6c3a6c968 tempest-AZAdminV2TestJSON-2121291223 tempest-AZAdminV2TestJSON-2121291223-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:22.914598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd9a64ef-1594-4396-a5b7-39a6c3a6c968 tempest-AZAdminV2TestJSON-2121291223 tempest-AZAdminV2TestJSON-2121291223-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:22.914598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd9a64ef-1594-4396-a5b7-39a6c3a6c968 tempest-AZAdminV2TestJSON-2121291223 tempest-AZAdminV2TestJSON-2121291223-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:22.914860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd9a64ef-1594-4396-a5b7-39a6c3a6c968 tempest-AZAdminV2TestJSON-2121291223 tempest-AZAdminV2TestJSON-2121291223-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:22.927650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd9a64ef-1594-4396-a5b7-39a6c3a6c968 tempest-AZAdminV2TestJSON-2121291223 tempest-AZAdminV2TestJSON-2121291223-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:22.935120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd9a64ef-1594-4396-a5b7-39a6c3a6c968 tempest-AZAdminV2TestJSON-2121291223 tempest-AZAdminV2TestJSON-2121291223-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:22.936187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd9a64ef-1594-4396-a5b7-39a6c3a6c968 tempest-AZAdminV2TestJSON-2121291223 tempest-AZAdminV2TestJSON-2121291223-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:23.086273 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dd9a64ef-1594-4396-a5b7-39a6c3a6c968 tempest-AZAdminV2TestJSON-2121291223 tempest-AZAdminV2TestJSON-2121291223-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 701 microversion: 2.1 time: 0.179212 Sep 07 12:28:23.086880 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 19/53] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Sep 7 12:28:22 2022] GET /compute/v2.1/os-availability-zone/detail => generated 701 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:23.411502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-07008c9a-2caa-492c-8cd2-0366bb4f9967 tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] Calling method '.version_select at 0x7fc419db1ee0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:23.415958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07008c9a-2caa-492c-8cd2-0366bb4f9967 tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:23.416915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07008c9a-2caa-492c-8cd2-0366bb4f9967 tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:23.417794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07008c9a-2caa-492c-8cd2-0366bb4f9967 tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:23.473755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07008c9a-2caa-492c-8cd2-0366bb4f9967 tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:23.475817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07008c9a-2caa-492c-8cd2-0366bb4f9967 tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:23.477936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07008c9a-2caa-492c-8cd2-0366bb4f9967 tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:23.507491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07008c9a-2caa-492c-8cd2-0366bb4f9967 tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:23.510141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07008c9a-2caa-492c-8cd2-0366bb4f9967 tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:23.510868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07008c9a-2caa-492c-8cd2-0366bb4f9967 tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:23.528049 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:28:23.533675 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-07008c9a-2caa-492c-8cd2-0366bb4f9967 tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.684747 Sep 07 12:28:23.534303 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 35/54] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:28:22 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:23.547554 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9fd079a6-2bc1-451e-b89f-7aa82e485f7d tempest-HypervisorAdminNegativeTestJSON-523644397 tempest-HypervisorAdminNegativeTestJSON-523644397-project] Calling method '.version_select at 0x7fc419e5ea60>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:23.550836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9fd079a6-2bc1-451e-b89f-7aa82e485f7d tempest-HypervisorAdminNegativeTestJSON-523644397 tempest-HypervisorAdminNegativeTestJSON-523644397-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'f0430fbf1f9c45d68fe14065dad57b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f69d93dedc14a7f8b5dc1cd506b73b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:23.565601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9fd079a6-2bc1-451e-b89f-7aa82e485f7d tempest-HypervisorAdminNegativeTestJSON-523644397 tempest-HypervisorAdminNegativeTestJSON-523644397-project] Request method failure captured: Sep 07 12:28:23.565601 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Sep 07 12:28:23.565601 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:28:23.565601 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:28:23.565601 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:28:23.565601 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:28:23.565601 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:28:23.565601 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:28:23.565601 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:28:23.565601 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:28:23.565601 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI5i_PUkMcWlSOddsoGt533uOuQtijI7sYKzaFj41mmRiTzC9u5cTmAMat18LzL5fdlz6DJNHA7-4hf4QBk9WxjjBlJGTJlC_FyjG4neERDJnzcMhtHD_AT0vHAy02V7xVxpV2HbXjuA64VO7i8byC7HaspS_M2aGD64SmqmssPZmQY Sep 07 12:28:23.565601 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:28:23.565601 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:28:23.565601 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:28:23.565601 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:28:23.565601 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:28:23.565601 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:28:23.565601 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 3f69d93dedc14a7f8b5dc1cd506b73b7 Sep 07 12:28:23.565601 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-523644397 Sep 07 12:28:23.565601 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:28:23.565601 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:28:23.566920 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f69d93dedc14a7f8b5dc1cd506b73b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f69d93dedc14a7f8b5dc1cd506b73b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f69d93dedc14a7f8b5dc1cd506b73b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f69d93dedc14a7f8b5dc1cd506b73b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:28:23.566920 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-523644397 Sep 07 12:28:23.566920 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 3f69d93dedc14a7f8b5dc1cd506b73b7 Sep 07 12:28:23.566920 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-523644397 Sep 07 12:28:23.566920 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-HypervisorAdminNegativeTestJSON-523644397-project Sep 07 12:28:23.566920 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:28:23.566920 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:28:23.566920 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: f0430fbf1f9c45d68fe14065dad57b73 Sep 07 12:28:23.566920 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-523644397-project Sep 07 12:28:23.566920 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:28:23.566920 n-d-852087-9 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 07 12:28:23.566920 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '1'} Sep 07 12:28:23.566920 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:28:23.567612 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:23.567612 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:28:23.567612 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:28:23.567612 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:28:23.567612 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:28:23.567612 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:28:23.567612 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:28:23.567612 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:28:23.567612 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:28:23.567612 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Sep 07 12:28:23.567612 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Sep 07 12:28:23.567612 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:28:23.567612 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:28:23.567612 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:28:23.567612 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:28:23.567612 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:28:23.567612 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:28:23.567612 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:28:23.567612 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:28:23.568926 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:28:23.568926 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:28:23.568926 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:28:23.568926 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:28:23.568926 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:28:23.568926 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:28:23.568926 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 07 12:28:23.568926 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:28:23.568926 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:28:23.568926 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:28:23.568926 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:23.568926 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:28:23.568926 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:28:23.568926 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:28:23.568926 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:28:23.568926 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 07 12:28:23.568926 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:28:23.570047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9fd079a6-2bc1-451e-b89f-7aa82e485f7d tempest-HypervisorAdminNegativeTestJSON-523644397 tempest-HypervisorAdminNegativeTestJSON-523644397-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:28:23.574245 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9fd079a6-2bc1-451e-b89f-7aa82e485f7d tempest-HypervisorAdminNegativeTestJSON-523644397 tempest-HypervisorAdminNegativeTestJSON-523644397-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.029672 Sep 07 12:28:23.575640 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 20/55] 10.222.0.16 () {58 vars in 1173 bytes} [Wed Sep 7 12:28:23 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:28:23.588018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-886be398-6f82-46c6-8f7d-cea896c7e35c tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] Calling method '.version_select at 0x7fc419ced1f0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:23.605177 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-886be398-6f82-46c6-8f7d-cea896c7e35c tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] HTTP exception thrown: Hypervisor with ID '5fae2ef7-a776-4eb9-904d-8a31ab199450' could not be found. Sep 07 12:28:23.631813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-886be398-6f82-46c6-8f7d-cea896c7e35c tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] Request method failure captured: Sep 07 12:28:23.631813 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-hypervisors/5fae2ef7-a776-4eb9-904d-8a31ab199450/uptime HTTP/1.1 Sep 07 12:28:23.631813 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:28:23.631813 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:28:23.631813 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:28:23.631813 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:28:23.631813 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:28:23.631813 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:28:23.631813 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:28:23.631813 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:28:23.631813 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5lZhl0qEAbYa4BgOhyf_sPXVRXkvowZZO9h6_pS2Gt2gw0Qamkh5F92JpmY7sV4msTC94cBaHfp5UXItnAzsrrxYygPmI-P3wFc9k77ju90lWe26LzUytyg0oHuzpFk2iF55JDBARQZOy8uZ2Zm9vn5VEQYksx5HS3eaIGYlN2o3s Sep 07 12:28:23.631813 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:28:23.631813 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:28:23.631813 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:28:23.631813 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:28:23.631813 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:28:23.631813 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:28:23.631813 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: e87bedcf4c4c42d481d338b8768ee8de Sep 07 12:28:23.631813 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1434687701 Sep 07 12:28:23.631813 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member,admin Sep 07 12:28:23.631813 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member,admin Sep 07 12:28:23.633793 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e87bedcf4c4c42d481d338b8768ee8de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e87bedcf4c4c42d481d338b8768ee8de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e87bedcf4c4c42d481d338b8768ee8de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e87bedcf4c4c42d481d338b8768ee8de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:28:23.633793 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1434687701 Sep 07 12:28:23.633793 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: e87bedcf4c4c42d481d338b8768ee8de Sep 07 12:28:23.633793 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1434687701 Sep 07 12:28:23.633793 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin Sep 07 12:28:23.633793 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:28:23.633793 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:28:23.633793 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: cf0580b2a65d4e0bac3c2ce50fec9951 Sep 07 12:28:23.633793 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin Sep 07 12:28:23.633793 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:28:23.633793 n-d-852087-9 devstack@n-api.service[122432]: exception: Hypervisor with ID '5fae2ef7-a776-4eb9-904d-8a31ab199450' could not be found. Sep 07 12:28:23.633793 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '5fae2ef7-a776-4eb9-904d-8a31ab199450'} Sep 07 12:28:23.634624 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:28:23.634624 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:23.634624 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 07 12:28:23.634624 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 07 12:28:23.634624 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '5fae2ef7-a776-4eb9-904d-8a31ab199450' Sep 07 12:28:23.634624 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:23.634624 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:28:23.634624 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:23.634624 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:23.634624 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 07 12:28:23.634624 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 07 12:28:23.634624 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 07 12:28:23.634624 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 07 12:28:23.634624 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 07 12:28:23.634624 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:23.634624 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:28:23.634624 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:23.634624 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:23.634624 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 07 12:28:23.634624 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 07 12:28:23.634624 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 07 12:28:23.634624 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 07 12:28:23.637429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 07 12:28:23.637429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:23.637429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:28:23.637429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:23.637429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:23.637429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:28:23.637429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:28:23.637429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:28:23.637429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:28:23.637429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:28:23.637429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:28:23.637429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:28:23.637429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:28:23.637429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Sep 07 12:28:23.637429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 07 12:28:23.637429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 07 12:28:23.637429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 07 12:28:23.637429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '5fae2ef7-a776-4eb9-904d-8a31ab199450' could not be found. Sep 07 12:28:23.637429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:23.637429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:28:23.637429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:23.639573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:23.639573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:28:23.639573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:28:23.639573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:28:23.639573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:28:23.639573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '5fae2ef7-a776-4eb9-904d-8a31ab199450' could not be found. Sep 07 12:28:23.639573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:23.647262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-886be398-6f82-46c6-8f7d-cea896c7e35c tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] Returning 404 to user: Hypervisor with ID '5fae2ef7-a776-4eb9-904d-8a31ab199450' could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:28:23.660153 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-886be398-6f82-46c6-8f7d-cea896c7e35c tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/5fae2ef7-a776-4eb9-904d-8a31ab199450/uptime" status: 404 len: 123 microversion: 2.1 time: 0.069984 Sep 07 12:28:23.662059 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 36/56] 10.222.0.16 () {58 vars in 1278 bytes} [Wed Sep 7 12:28:23 2022] GET /compute/v2.1/os-hypervisors/5fae2ef7-a776-4eb9-904d-8a31ab199450/uptime => generated 123 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:28:23.674026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f5704347-ef0d-4c9b-968d-ccee53b68ac7 tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] Calling method '.version_select at 0x7fc419de8040>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:23.676331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5704347-ef0d-4c9b-968d-ccee53b68ac7 tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:23.676972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5704347-ef0d-4c9b-968d-ccee53b68ac7 tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:23.677425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5704347-ef0d-4c9b-968d-ccee53b68ac7 tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:23.738067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5704347-ef0d-4c9b-968d-ccee53b68ac7 tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:23.739360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5704347-ef0d-4c9b-968d-ccee53b68ac7 tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:23.743265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5704347-ef0d-4c9b-968d-ccee53b68ac7 tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:23.787080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5704347-ef0d-4c9b-968d-ccee53b68ac7 tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:23.790326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5704347-ef0d-4c9b-968d-ccee53b68ac7 tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:23.790901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5704347-ef0d-4c9b-968d-ccee53b68ac7 tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:23.809627 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f5704347-ef0d-4c9b-968d-ccee53b68ac7 tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.139217 Sep 07 12:28:23.815205 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 21/57] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:28:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:23.826388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9e819397-be9c-4b07-9956-b1c89082cd5f tempest-HypervisorAdminNegativeTestJSON-523644397 tempest-HypervisorAdminNegativeTestJSON-523644397-project] Calling method '.version_select at 0x7fc419cde8b0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:23.829893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9e819397-be9c-4b07-9956-b1c89082cd5f tempest-HypervisorAdminNegativeTestJSON-523644397 tempest-HypervisorAdminNegativeTestJSON-523644397-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'f0430fbf1f9c45d68fe14065dad57b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f69d93dedc14a7f8b5dc1cd506b73b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:23.832528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9e819397-be9c-4b07-9956-b1c89082cd5f tempest-HypervisorAdminNegativeTestJSON-523644397 tempest-HypervisorAdminNegativeTestJSON-523644397-project] Request method failure captured: Sep 07 12:28:23.832528 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Sep 07 12:28:23.832528 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:28:23.832528 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:28:23.832528 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:28:23.832528 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:28:23.832528 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:28:23.832528 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:28:23.832528 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:28:23.832528 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:28:23.832528 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5i_PUkMcWlSOddsoGt533uOuQtijI7sYKzaFj41mmRiTzC9u5cTmAMat18LzL5fdlz6DJNHA7-4hf4QBk9WxjjBlJGTJlC_FyjG4neERDJnzcMhtHD_AT0vHAy02V7xVxpV2HbXjuA64VO7i8byC7HaspS_M2aGD64SmqmssPZmQY Sep 07 12:28:23.832528 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:28:23.832528 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:28:23.832528 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:28:23.832528 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:28:23.832528 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:28:23.832528 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:28:23.832528 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 3f69d93dedc14a7f8b5dc1cd506b73b7 Sep 07 12:28:23.832528 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-523644397 Sep 07 12:28:23.832528 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:28:23.832528 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:28:23.833661 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f69d93dedc14a7f8b5dc1cd506b73b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f69d93dedc14a7f8b5dc1cd506b73b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f69d93dedc14a7f8b5dc1cd506b73b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f69d93dedc14a7f8b5dc1cd506b73b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:28:23.833661 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-523644397 Sep 07 12:28:23.833661 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 3f69d93dedc14a7f8b5dc1cd506b73b7 Sep 07 12:28:23.833661 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-523644397 Sep 07 12:28:23.833661 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-HypervisorAdminNegativeTestJSON-523644397-project Sep 07 12:28:23.833661 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:28:23.833661 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:28:23.833661 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: f0430fbf1f9c45d68fe14065dad57b73 Sep 07 12:28:23.833661 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-523644397-project Sep 07 12:28:23.833661 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:28:23.833661 n-d-852087-9 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 07 12:28:23.833661 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '1'} Sep 07 12:28:23.833661 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:28:23.834333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:23.834333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:28:23.834333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:28:23.834333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:28:23.834333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:28:23.834333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:28:23.834333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:28:23.834333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:28:23.834333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:28:23.834333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 07 12:28:23.834333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 07 12:28:23.834333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Sep 07 12:28:23.834333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Sep 07 12:28:23.834333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:28:23.834333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:28:23.834333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:28:23.834333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:28:23.834333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:28:23.834333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:28:23.835277 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:28:23.835277 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:28:23.835277 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:28:23.835277 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:28:23.835277 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:28:23.835277 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:28:23.835277 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:28:23.835277 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:28:23.835277 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 07 12:28:23.835277 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:23.835277 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:28:23.835277 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:23.835277 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:23.835277 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:28:23.835277 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:28:23.835277 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:28:23.835277 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:28:23.835277 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 07 12:28:23.835277 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:28:23.838310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9e819397-be9c-4b07-9956-b1c89082cd5f tempest-HypervisorAdminNegativeTestJSON-523644397 tempest-HypervisorAdminNegativeTestJSON-523644397-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:28:23.840413 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9e819397-be9c-4b07-9956-b1c89082cd5f tempest-HypervisorAdminNegativeTestJSON-523644397 tempest-HypervisorAdminNegativeTestJSON-523644397-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.018642 Sep 07 12:28:23.842070 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 37/58] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Sep 7 12:28:23 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:28:23.856278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f77433f5-86f9-422d-a1d3-8267a8ac1914 tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] Calling method '.version_select at 0x7fc419e5eee0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:23.860733 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-f77433f5-86f9-422d-a1d3-8267a8ac1914 tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] HTTP exception thrown: Hypervisor with ID '461ca897-1f2d-4ded-abb8-92f4b9a4870e' could not be found. Sep 07 12:28:23.865167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f77433f5-86f9-422d-a1d3-8267a8ac1914 tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] Request method failure captured: Sep 07 12:28:23.865167 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-hypervisors/461ca897-1f2d-4ded-abb8-92f4b9a4870e HTTP/1.1 Sep 07 12:28:23.865167 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:28:23.865167 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:28:23.865167 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:28:23.865167 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:28:23.865167 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:28:23.865167 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:28:23.865167 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:28:23.865167 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:28:23.865167 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI5lZhl0qEAbYa4BgOhyf_sPXVRXkvowZZO9h6_pS2Gt2gw0Qamkh5F92JpmY7sV4msTC94cBaHfp5UXItnAzsrrxYygPmI-P3wFc9k77ju90lWe26LzUytyg0oHuzpFk2iF55JDBARQZOy8uZ2Zm9vn5VEQYksx5HS3eaIGYlN2o3s Sep 07 12:28:23.865167 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:28:23.865167 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:28:23.865167 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:28:23.865167 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:28:23.865167 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:28:23.865167 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:28:23.865167 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: e87bedcf4c4c42d481d338b8768ee8de Sep 07 12:28:23.865167 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1434687701 Sep 07 12:28:23.865167 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 12:28:23.865167 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 12:28:23.866316 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e87bedcf4c4c42d481d338b8768ee8de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e87bedcf4c4c42d481d338b8768ee8de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e87bedcf4c4c42d481d338b8768ee8de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e87bedcf4c4c42d481d338b8768ee8de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:28:23.866316 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1434687701 Sep 07 12:28:23.866316 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: e87bedcf4c4c42d481d338b8768ee8de Sep 07 12:28:23.866316 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1434687701 Sep 07 12:28:23.866316 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin Sep 07 12:28:23.866316 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:28:23.866316 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:28:23.866316 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: cf0580b2a65d4e0bac3c2ce50fec9951 Sep 07 12:28:23.866316 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin Sep 07 12:28:23.866316 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:28:23.866316 n-d-852087-9 devstack@n-api.service[122433]: exception: Hypervisor with ID '461ca897-1f2d-4ded-abb8-92f4b9a4870e' could not be found. Sep 07 12:28:23.866316 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '461ca897-1f2d-4ded-abb8-92f4b9a4870e'} Sep 07 12:28:23.867559 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:28:23.867559 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:23.867559 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 07 12:28:23.867559 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 07 12:28:23.867559 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '461ca897-1f2d-4ded-abb8-92f4b9a4870e' Sep 07 12:28:23.867559 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:28:23.867559 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:28:23.867559 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:28:23.867559 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:23.867559 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 07 12:28:23.867559 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 07 12:28:23.867559 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 07 12:28:23.867559 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 07 12:28:23.867559 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 07 12:28:23.867559 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:28:23.867559 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:28:23.867559 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:28:23.867559 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:23.867559 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 07 12:28:23.867559 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 07 12:28:23.867559 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 07 12:28:23.867559 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 07 12:28:23.868673 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 07 12:28:23.868673 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:28:23.868673 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:28:23.868673 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:28:23.868673 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:23.868673 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:28:23.868673 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:28:23.868673 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:28:23.868673 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:28:23.868673 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:28:23.868673 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:28:23.868673 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:28:23.868673 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:28:23.868673 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 07 12:28:23.868673 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 07 12:28:23.868673 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Sep 07 12:28:23.868673 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 07 12:28:23.868673 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 07 12:28:23.868673 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 07 12:28:23.868673 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '461ca897-1f2d-4ded-abb8-92f4b9a4870e' could not be found. Sep 07 12:28:23.874316 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:28:23.874316 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:28:23.874316 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:28:23.874316 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:28:23.874316 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:28:23.874316 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:28:23.874316 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:28:23.874316 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:28:23.874316 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '461ca897-1f2d-4ded-abb8-92f4b9a4870e' could not be found. Sep 07 12:28:23.874316 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:28:23.881599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f77433f5-86f9-422d-a1d3-8267a8ac1914 tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] Returning 404 to user: Hypervisor with ID '461ca897-1f2d-4ded-abb8-92f4b9a4870e' could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:28:23.882705 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f77433f5-86f9-422d-a1d3-8267a8ac1914 tempest-HypervisorAdminNegativeTestJSON-1434687701 tempest-HypervisorAdminNegativeTestJSON-1434687701-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/461ca897-1f2d-4ded-abb8-92f4b9a4870e" status: 404 len: 123 microversion: 2.1 time: 0.032904 Sep 07 12:28:23.884573 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 22/59] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Sep 7 12:28:23 2022] GET /compute/v2.1/os-hypervisors/461ca897-1f2d-4ded-abb8-92f4b9a4870e => generated 123 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:28:23.932164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fd20f17d-cce9-4f57-bd2e-a6e84e5cd16a tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:23.935919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fd20f17d-cce9-4f57-bd2e-a6e84e5cd16a tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:23.965216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd20f17d-cce9-4f57-bd2e-a6e84e5cd16a tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:23.967318 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd20f17d-cce9-4f57-bd2e-a6e84e5cd16a tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:23.972451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd20f17d-cce9-4f57-bd2e-a6e84e5cd16a tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:23.973621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd20f17d-cce9-4f57-bd2e-a6e84e5cd16a tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:23.975614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd20f17d-cce9-4f57-bd2e-a6e84e5cd16a tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:23.976928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd20f17d-cce9-4f57-bd2e-a6e84e5cd16a tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:24.791691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fd20f17d-cce9-4f57-bd2e-a6e84e5cd16a tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5151bb757514a6392a0d93f2bbfe406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71cb3cbb2ee4a9dbfcd16759a74b093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:24.807012 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fd20f17d-cce9-4f57-bd2e-a6e84e5cd16a tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 200 len: 1339 microversion: 2.1 time: 0.880251 Sep 07 12:28:24.810460 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 38/60] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:23 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 1339 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:25.833761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3b88d57f-2259-4810-9010-9c7a40e9d667 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:25.835013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3b88d57f-2259-4810-9010-9c7a40e9d667 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:25.854008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b88d57f-2259-4810-9010-9c7a40e9d667 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:25.854720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b88d57f-2259-4810-9010-9c7a40e9d667 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:25.855384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b88d57f-2259-4810-9010-9c7a40e9d667 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:25.857099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b88d57f-2259-4810-9010-9c7a40e9d667 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:25.857763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b88d57f-2259-4810-9010-9c7a40e9d667 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:25.858818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b88d57f-2259-4810-9010-9c7a40e9d667 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:26.702802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3b88d57f-2259-4810-9010-9c7a40e9d667 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5151bb757514a6392a0d93f2bbfe406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71cb3cbb2ee4a9dbfcd16759a74b093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:26.721004 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3b88d57f-2259-4810-9010-9c7a40e9d667 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 200 len: 1339 microversion: 2.1 time: 0.891394 Sep 07 12:28:26.747997 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 23/61] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:25 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 1339 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:27.045147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:28:27.388050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-05e27e4d-4d01-4975-af6f-f9f404ed6f75 req-3abd98c8-a4ab-4397-9647-a26912bc25a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e7d46f-e8a5-4110-b7f2-05488d1bdb8a", "tag": "6627c9a2-eaaf-4625-a051-a3236290ade7"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:27.420127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-05e27e4d-4d01-4975-af6f-f9f404ed6f75 req-3abd98c8-a4ab-4397-9647-a26912bc25a7 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:27.421134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-05e27e4d-4d01-4975-af6f-f9f404ed6f75 req-3abd98c8-a4ab-4397-9647-a26912bc25a7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:27.422679 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-05e27e4d-4d01-4975-af6f-f9f404ed6f75 req-3abd98c8-a4ab-4397-9647-a26912bc25a7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:27.473048 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-05e27e4d-4d01-4975-af6f-f9f404ed6f75 req-3abd98c8-a4ab-4397-9647-a26912bc25a7 service nova] Creating event network-changed:6627c9a2-eaaf-4625-a051-a3236290ade7 for instance 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a on n-h1-852087-9 Sep 07 12:28:27.499917 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-05e27e4d-4d01-4975-af6f-f9f404ed6f75 req-3abd98c8-a4ab-4397-9647-a26912bc25a7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.459512 Sep 07 12:28:27.505285 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 39/62] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:27.753421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3268a456-33c8-45d0-a1b3-776be52c7458 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:27.761897 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3268a456-33c8-45d0-a1b3-776be52c7458 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:27.774108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3268a456-33c8-45d0-a1b3-776be52c7458 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:27.775101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3268a456-33c8-45d0-a1b3-776be52c7458 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:27.775800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3268a456-33c8-45d0-a1b3-776be52c7458 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:27.776759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3268a456-33c8-45d0-a1b3-776be52c7458 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:27.777369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3268a456-33c8-45d0-a1b3-776be52c7458 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:27.781421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3268a456-33c8-45d0-a1b3-776be52c7458 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:28.218235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2be91807-d1b9-4537-a232-6b2d72ea12e7 tempest-FlavorsExtraSpecsTestJSON-2039557477 tempest-FlavorsExtraSpecsTestJSON-2039557477-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-2002390124", "ram": 512, "vcpus": 1, "disk": 10, "id": 751973202, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:28.282693 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2be91807-d1b9-4537-a232-6b2d72ea12e7 tempest-FlavorsExtraSpecsTestJSON-2039557477 tempest-FlavorsExtraSpecsTestJSON-2039557477-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.269971 Sep 07 12:28:28.293850 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 40/63] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:28:28 2022] POST /compute/v2.1/flavors => generated 413 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:28.316910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-88f4fa97-c98c-4089-b168-7ec3a264593c tempest-FlavorsExtraSpecsTestJSON-2039557477 tempest-FlavorsExtraSpecsTestJSON-2039557477-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:28.378494 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-88f4fa97-c98c-4089-b168-7ec3a264593c tempest-FlavorsExtraSpecsTestJSON-2039557477 tempest-FlavorsExtraSpecsTestJSON-2039557477-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/751973202/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.081391 Sep 07 12:28:28.380373 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 41/64] 10.222.0.16 () {60 vars in 1221 bytes} [Wed Sep 7 12:28:28 2022] POST /compute/v2.1/flavors/751973202/os-extra_specs => generated 66 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:28:28.628086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:28:28.750013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-beeb3fcc-97a5-4b23-aefa-dd4e840e8f16 tempest-FlavorsExtraSpecsTestJSON-535752095 tempest-FlavorsExtraSpecsTestJSON-535752095-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:28.800803 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-beeb3fcc-97a5-4b23-aefa-dd4e840e8f16 tempest-FlavorsExtraSpecsTestJSON-535752095 tempest-FlavorsExtraSpecsTestJSON-535752095-project] 10.222.0.16 "GET /compute/v2.1/flavors/751973202/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.414502 Sep 07 12:28:28.805523 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 42/65] 10.222.0.16 () {58 vars in 1200 bytes} [Wed Sep 7 12:28:28 2022] GET /compute/v2.1/flavors/751973202/os-extra_specs => generated 66 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:28:28.819338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-81562f4e-8c17-4d6a-bef1-e59a9ad7dc1e tempest-FlavorsExtraSpecsTestJSON-2039557477 tempest-FlavorsExtraSpecsTestJSON-2039557477-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:28.890388 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3268a456-33c8-45d0-a1b3-776be52c7458 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5151bb757514a6392a0d93f2bbfe406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71cb3cbb2ee4a9dbfcd16759a74b093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:28.911449 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3268a456-33c8-45d0-a1b3-776be52c7458 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 200 len: 1339 microversion: 2.1 time: 1.162210 Sep 07 12:28:28.911941 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 24/66] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:27 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 1339 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:28.988702 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-81562f4e-8c17-4d6a-bef1-e59a9ad7dc1e tempest-FlavorsExtraSpecsTestJSON-2039557477 tempest-FlavorsExtraSpecsTestJSON-2039557477-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/751973202/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.173536 Sep 07 12:28:29.000223 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 43/67] 10.222.0.16 () {60 vars in 1221 bytes} [Wed Sep 7 12:28:28 2022] POST /compute/v2.1/flavors/751973202/os-extra_specs => generated 66 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:28:29.007879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c30e51b8-da43-4b26-be67-b47cb17b705f tempest-FlavorsExtraSpecsTestJSON-535752095 tempest-FlavorsExtraSpecsTestJSON-535752095-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:29.090823 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c30e51b8-da43-4b26-be67-b47cb17b705f tempest-FlavorsExtraSpecsTestJSON-535752095 tempest-FlavorsExtraSpecsTestJSON-535752095-project] 10.222.0.16 "GET /compute/v2.1/flavors/751973202/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.086722 Sep 07 12:28:29.093656 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 25/68] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Sep 7 12:28:29 2022] GET /compute/v2.1/flavors/751973202/os-extra_specs/hw:numa_nodes => generated 22 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 12:28:29.103778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e0ff1909-0e18-4f4b-ad7d-f671e215ef91 tempest-FlavorsExtraSpecsTestJSON-2039557477 tempest-FlavorsExtraSpecsTestJSON-2039557477-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:29.190003 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e0ff1909-0e18-4f4b-ad7d-f671e215ef91 tempest-FlavorsExtraSpecsTestJSON-2039557477 tempest-FlavorsExtraSpecsTestJSON-2039557477-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/751973202/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.090318 Sep 07 12:28:29.214348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-40eac129-b510-4368-9b20-0fda576f02d5 tempest-FlavorsExtraSpecsTestJSON-2039557477 tempest-FlavorsExtraSpecsTestJSON-2039557477-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:29.225189 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 44/69] 10.222.0.16 () {60 vars in 1221 bytes} [Wed Sep 7 12:28:29 2022] POST /compute/v2.1/flavors/751973202/os-extra_specs => generated 66 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:28:29.227146 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=9 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:28:29.240956 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-40eac129-b510-4368-9b20-0fda576f02d5 tempest-FlavorsExtraSpecsTestJSON-2039557477 tempest-FlavorsExtraSpecsTestJSON-2039557477-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/751973202/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.040442 Sep 07 12:28:29.241641 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 26/70] 10.222.0.16 () {58 vars in 1200 bytes} [Wed Sep 7 12:28:29 2022] GET /compute/v2.1/flavors/751973202/os-extra_specs => generated 66 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 12:28:29.255130 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3814bb61-be95-44a9-a922-5f20c0c0b939 tempest-FlavorsExtraSpecsTestJSON-2039557477 tempest-FlavorsExtraSpecsTestJSON-2039557477-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:29.344064 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3814bb61-be95-44a9-a922-5f20c0c0b939 tempest-FlavorsExtraSpecsTestJSON-2039557477 tempest-FlavorsExtraSpecsTestJSON-2039557477-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/751973202/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.085250 Sep 07 12:28:29.345520 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 45/71] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Sep 7 12:28:29 2022] PUT /compute/v2.1/flavors/751973202/os-extra_specs/hw:numa_nodes => generated 22 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:28:29.373149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-573294f0-952c-4d88-b49e-7e2d12315bde tempest-FlavorsExtraSpecsTestJSON-2039557477 tempest-FlavorsExtraSpecsTestJSON-2039557477-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:29.413925 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-573294f0-952c-4d88-b49e-7e2d12315bde tempest-FlavorsExtraSpecsTestJSON-2039557477 tempest-FlavorsExtraSpecsTestJSON-2039557477-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/751973202/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.058816 Sep 07 12:28:29.420676 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 27/72] 10.222.0.16 () {58 vars in 1200 bytes} [Wed Sep 7 12:28:29 2022] GET /compute/v2.1/flavors/751973202/os-extra_specs => generated 66 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 12:28:29.438904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f9f817cb-9781-4a3b-9a38-2bc414a86716 tempest-FlavorsExtraSpecsTestJSON-2039557477 tempest-FlavorsExtraSpecsTestJSON-2039557477-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:29.522220 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f9f817cb-9781-4a3b-9a38-2bc414a86716 tempest-FlavorsExtraSpecsTestJSON-2039557477 tempest-FlavorsExtraSpecsTestJSON-2039557477-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/751973202/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.090359 Sep 07 12:28:29.523861 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 46/73] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Sep 7 12:28:29 2022] DELETE /compute/v2.1/flavors/751973202/os-extra_specs/hw:numa_nodes => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 12:28:29.533074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-55e75fdb-eb09-4b75-8133-db351a33ce1d tempest-FlavorsExtraSpecsTestJSON-2039557477 tempest-FlavorsExtraSpecsTestJSON-2039557477-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:29.627822 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-55e75fdb-eb09-4b75-8133-db351a33ce1d tempest-FlavorsExtraSpecsTestJSON-2039557477 tempest-FlavorsExtraSpecsTestJSON-2039557477-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/751973202/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.099725 Sep 07 12:28:29.636109 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 28/74] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Sep 7 12:28:29 2022] DELETE /compute/v2.1/flavors/751973202/os-extra_specs/hw:cpu_policy => generated 0 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 12:28:29.643761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3f7b1c19-246a-4bd3-a181-a01d8923d899 tempest-FlavorsExtraSpecsTestJSON-2039557477 tempest-FlavorsExtraSpecsTestJSON-2039557477-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:29.670185 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3f7b1c19-246a-4bd3-a181-a01d8923d899 tempest-FlavorsExtraSpecsTestJSON-2039557477 tempest-FlavorsExtraSpecsTestJSON-2039557477-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/751973202/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.027292 Sep 07 12:28:29.671159 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 47/75] 10.222.0.16 () {58 vars in 1200 bytes} [Wed Sep 7 12:28:29 2022] GET /compute/v2.1/flavors/751973202/os-extra_specs => generated 19 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 12:28:29.686054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-114c70ee-14f0-4c86-99b5-9cddb27f3477 tempest-FlavorsExtraSpecsTestJSON-2039557477 tempest-FlavorsExtraSpecsTestJSON-2039557477-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:29.759566 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-114c70ee-14f0-4c86-99b5-9cddb27f3477 tempest-FlavorsExtraSpecsTestJSON-2039557477 tempest-FlavorsExtraSpecsTestJSON-2039557477-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/751973202" status: 202 len: 0 microversion: 2.1 time: 0.073570 Sep 07 12:28:29.760350 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 29/76] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Sep 7 12:28:29 2022] DELETE /compute/v2.1/flavors/751973202 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:28:29.777205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dfd50e18-54ab-401e-a0ff-b428d5cc2b16 tempest-FlavorsExtraSpecsTestJSON-2039557477 tempest-FlavorsExtraSpecsTestJSON-2039557477-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:29.838186 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dfd50e18-54ab-401e-a0ff-b428d5cc2b16 tempest-FlavorsExtraSpecsTestJSON-2039557477 tempest-FlavorsExtraSpecsTestJSON-2039557477-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070731 Sep 07 12:28:29.845889 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 48/77] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:28:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:29.938113 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a6c64137-bd76-46c6-a209-2dd1f39b6630 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:29.938664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a6c64137-bd76-46c6-a209-2dd1f39b6630 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:29.951261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6c64137-bd76-46c6-a209-2dd1f39b6630 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:29.953229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6c64137-bd76-46c6-a209-2dd1f39b6630 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:29.956831 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6c64137-bd76-46c6-a209-2dd1f39b6630 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:29.959149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6c64137-bd76-46c6-a209-2dd1f39b6630 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:29.968834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6c64137-bd76-46c6-a209-2dd1f39b6630 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:29.971724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6c64137-bd76-46c6-a209-2dd1f39b6630 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:30.991430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a6c64137-bd76-46c6-a209-2dd1f39b6630 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5151bb757514a6392a0d93f2bbfe406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71cb3cbb2ee4a9dbfcd16759a74b093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:31.005800 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a6c64137-bd76-46c6-a209-2dd1f39b6630 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 200 len: 1339 microversion: 2.1 time: 1.072677 Sep 07 12:28:31.009923 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 30/78] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:29 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 1339 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:32.034110 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1920b937-60c1-4cbe-a990-356667eefade tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:32.034917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1920b937-60c1-4cbe-a990-356667eefade tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:32.054192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1920b937-60c1-4cbe-a990-356667eefade tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:32.055203 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1920b937-60c1-4cbe-a990-356667eefade tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:32.059231 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1920b937-60c1-4cbe-a990-356667eefade tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:32.061584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1920b937-60c1-4cbe-a990-356667eefade tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:32.063556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1920b937-60c1-4cbe-a990-356667eefade tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:32.068929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1920b937-60c1-4cbe-a990-356667eefade tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:32.782738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=10 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:28:32.804219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1920b937-60c1-4cbe-a990-356667eefade tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5151bb757514a6392a0d93f2bbfe406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71cb3cbb2ee4a9dbfcd16759a74b093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:32.817467 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1920b937-60c1-4cbe-a990-356667eefade tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 200 len: 1339 microversion: 2.1 time: 0.787685 Sep 07 12:28:32.818459 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 49/79] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:32 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 1339 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:33.724459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:28:33.844613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d4494ed-7a55-4c88-a319-1f16f6887113 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:33.845414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1d4494ed-7a55-4c88-a319-1f16f6887113 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:33.870751 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d4494ed-7a55-4c88-a319-1f16f6887113 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:33.871254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d4494ed-7a55-4c88-a319-1f16f6887113 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:33.871828 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d4494ed-7a55-4c88-a319-1f16f6887113 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:33.872558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d4494ed-7a55-4c88-a319-1f16f6887113 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:33.880878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d4494ed-7a55-4c88-a319-1f16f6887113 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:33.881511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d4494ed-7a55-4c88-a319-1f16f6887113 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:34.405473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1d4494ed-7a55-4c88-a319-1f16f6887113 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5151bb757514a6392a0d93f2bbfe406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71cb3cbb2ee4a9dbfcd16759a74b093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:34.419528 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1d4494ed-7a55-4c88-a319-1f16f6887113 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 200 len: 1339 microversion: 2.1 time: 0.580047 Sep 07 12:28:34.428461 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 50/80] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:33 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 1339 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:28:34.793034 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ac557b1-5728-44dd-93c8-83c76059fe74 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:34.807772 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ac557b1-5728-44dd-93c8-83c76059fe74 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 1.088939 Sep 07 12:28:34.811731 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 31/81] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:28:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:35.414826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-590bc887-1462-46b6-997d-ff5610dbf8c3 tempest-ServersWithSpecificFlavorTestJSON-1085658637 tempest-ServersWithSpecificFlavorTestJSON-1085658637-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1808772745", "id": 615600471, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:35.440476 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-590bc887-1462-46b6-997d-ff5610dbf8c3 tempest-ServersWithSpecificFlavorTestJSON-1085658637 tempest-ServersWithSpecificFlavorTestJSON-1085658637-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.620487 Sep 07 12:28:35.442451 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 51/82] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:28:34 2022] POST /compute/v2.1/flavors => generated 422 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:35.458127 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eed829b9-47d4-4000-85cc-1612d7224b30 tempest-ServersWithSpecificFlavorTestJSON-1085658637 tempest-ServersWithSpecificFlavorTestJSON-1085658637-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:35.475365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9f2c5a4b-13e3-48f9-b420-7113fa684ad3 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:35.475986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9f2c5a4b-13e3-48f9-b420-7113fa684ad3 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:35.478921 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eed829b9-47d4-4000-85cc-1612d7224b30 tempest-ServersWithSpecificFlavorTestJSON-1085658637 tempest-ServersWithSpecificFlavorTestJSON-1085658637-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.027359 Sep 07 12:28:35.479513 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 32/83] 10.222.0.16 () {58 vars in 1182 bytes} [Wed Sep 7 12:28:35 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:28:35.489156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f88cda5-aee6-44dd-9fdd-9c2db41b58a3 tempest-ServersWithSpecificFlavorTestJSON-1085658637 tempest-ServersWithSpecificFlavorTestJSON-1085658637-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1402415280", "id": 426701502, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:35.495707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f2c5a4b-13e3-48f9-b420-7113fa684ad3 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:35.496645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f2c5a4b-13e3-48f9-b420-7113fa684ad3 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:35.497317 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f2c5a4b-13e3-48f9-b420-7113fa684ad3 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:35.498324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f2c5a4b-13e3-48f9-b420-7113fa684ad3 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:35.499029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f2c5a4b-13e3-48f9-b420-7113fa684ad3 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:35.499675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f2c5a4b-13e3-48f9-b420-7113fa684ad3 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:35.533301 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0f88cda5-aee6-44dd-9fdd-9c2db41b58a3 tempest-ServersWithSpecificFlavorTestJSON-1085658637 tempest-ServersWithSpecificFlavorTestJSON-1085658637-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.047348 Sep 07 12:28:35.534533 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 33/84] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:28:35 2022] POST /compute/v2.1/flavors => generated 422 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:28:35.549758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ecc724ca-dee2-4e2e-ae31-78d1d93a08e0 tempest-ServersWithSpecificFlavorTestJSON-1085658637 tempest-ServersWithSpecificFlavorTestJSON-1085658637-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:35.571184 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ecc724ca-dee2-4e2e-ae31-78d1d93a08e0 tempest-ServersWithSpecificFlavorTestJSON-1085658637 tempest-ServersWithSpecificFlavorTestJSON-1085658637-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028419 Sep 07 12:28:35.571928 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 34/85] 10.222.0.16 () {58 vars in 1182 bytes} [Wed Sep 7 12:28:35 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 12:28:35.586596 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5c567591-f3ed-4c5e-a98d-ec073c935e46 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Action: 'create', calling method: .version_select at 0x7fc419dccca0>, body: {"keypair": {"name": "tempest-keypair-953815892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9lGAPBZbU3twh9P6qZJqbLQEUC//wWXJU+9kqDGb5/trzesksT9856htcm0/1qZ8gRVG29Q91AdyhlbGoX7hUHT2XrmAt+ZnJP8js6ji9ZExnPSSfVygf77KZ1bHM3+g=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:35.626919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-5c567591-f3ed-4c5e-a98d-ec073c935e46 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Getting quotas for project eeb96c3ce6734e5f94229d94bf379318. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:28:35.648572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-5c567591-f3ed-4c5e-a98d-ec073c935e46 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Getting quotas for user 02af7f40e0cc4ab7bbc06201d5e253cd and project eeb96c3ce6734e5f94229d94bf379318. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:28:35.745171 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5c567591-f3ed-4c5e-a98d-ec073c935e46 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.160223 Sep 07 12:28:35.745171 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 35/86] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 12:28:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:28:35.772749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9f2c5a4b-13e3-48f9-b420-7113fa684ad3 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5151bb757514a6392a0d93f2bbfe406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71cb3cbb2ee4a9dbfcd16759a74b093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:35.781824 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9f2c5a4b-13e3-48f9-b420-7113fa684ad3 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 200 len: 1339 microversion: 2.1 time: 0.312630 Sep 07 12:28:35.783486 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 52/87] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:35 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 1339 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:36.531736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8a2bb95c-f6ec-47e5-b674-03e43b0d5edc tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1052502633", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:36.653539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-8a2bb95c-f6ec-47e5-b674-03e43b0d5edc tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:28:37.068675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c6d90917-9c86-4161-ab19-57537ae1ed99 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1147458284", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:37.178187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-c6d90917-9c86-4161-ab19-57537ae1ed99 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:28:37.294370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8a2bb95c-f6ec-47e5-b674-03e43b0d5edc tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:28:37.294902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8a2bb95c-f6ec-47e5-b674-03e43b0d5edc tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:28:37.295386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8a2bb95c-f6ec-47e5-b674-03e43b0d5edc tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:28:37.295858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8a2bb95c-f6ec-47e5-b674-03e43b0d5edc tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:28:37.296281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8a2bb95c-f6ec-47e5-b674-03e43b0d5edc tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:28:37.314212 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a2bb95c-f6ec-47e5-b674-03e43b0d5edc tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:37.314729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a2bb95c-f6ec-47e5-b674-03e43b0d5edc tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:37.315165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a2bb95c-f6ec-47e5-b674-03e43b0d5edc tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:37.320088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a2bb95c-f6ec-47e5-b674-03e43b0d5edc tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:37.321747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a2bb95c-f6ec-47e5-b674-03e43b0d5edc tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:37.322201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a2bb95c-f6ec-47e5-b674-03e43b0d5edc tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:37.392254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-8a2bb95c-f6ec-47e5-b674-03e43b0d5edc tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Getting quotas for project 4776ccec9dd448738cf516cdd96573d2. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:28:37.402314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-8a2bb95c-f6ec-47e5-b674-03e43b0d5edc tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Getting quotas for user 84d616d33dbe4521ac53ae7566591b81 and project 4776ccec9dd448738cf516cdd96573d2. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:28:37.450672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8a2bb95c-f6ec-47e5-b674-03e43b0d5edc tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:28:37.460201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8a2bb95c-f6ec-47e5-b674-03e43b0d5edc tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:28:37.622781 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8a2bb95c-f6ec-47e5-b674-03e43b0d5edc tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.876447 Sep 07 12:28:37.634924 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 36/88] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:28:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:28:37.656013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b37e9b2b-8ea3-4a4f-b164-89f5ddc2796e tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:37.658255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b37e9b2b-8ea3-4a4f-b164-89f5ddc2796e tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:37.681426 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b37e9b2b-8ea3-4a4f-b164-89f5ddc2796e tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:37.686511 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b37e9b2b-8ea3-4a4f-b164-89f5ddc2796e tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:37.687802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b37e9b2b-8ea3-4a4f-b164-89f5ddc2796e tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:37.690623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b37e9b2b-8ea3-4a4f-b164-89f5ddc2796e tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:37.692602 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b37e9b2b-8ea3-4a4f-b164-89f5ddc2796e tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:37.694914 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b37e9b2b-8ea3-4a4f-b164-89f5ddc2796e tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:38.896050 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b37e9b2b-8ea3-4a4f-b164-89f5ddc2796e tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5151bb757514a6392a0d93f2bbfe406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71cb3cbb2ee4a9dbfcd16759a74b093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:38.919662 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b37e9b2b-8ea3-4a4f-b164-89f5ddc2796e tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 200 len: 1339 microversion: 2.1 time: 1.283189 Sep 07 12:28:38.934402 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 37/89] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:37 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 1339 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:38.934402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-07d0bbdf-dbb4-4944-8c5e-a64bb9a38e6a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:38.934402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-07d0bbdf-dbb4-4944-8c5e-a64bb9a38e6a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:38.942625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07d0bbdf-dbb4-4944-8c5e-a64bb9a38e6a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:38.943226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07d0bbdf-dbb4-4944-8c5e-a64bb9a38e6a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:38.943671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07d0bbdf-dbb4-4944-8c5e-a64bb9a38e6a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:38.944442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07d0bbdf-dbb4-4944-8c5e-a64bb9a38e6a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:38.945636 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07d0bbdf-dbb4-4944-8c5e-a64bb9a38e6a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:38.946077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07d0bbdf-dbb4-4944-8c5e-a64bb9a38e6a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:39.039465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c6d90917-9c86-4161-ab19-57537ae1ed99 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:28:39.040484 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c6d90917-9c86-4161-ab19-57537ae1ed99 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:28:39.041253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c6d90917-9c86-4161-ab19-57537ae1ed99 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:28:39.042203 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c6d90917-9c86-4161-ab19-57537ae1ed99 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:28:39.042736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c6d90917-9c86-4161-ab19-57537ae1ed99 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:28:39.057704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6d90917-9c86-4161-ab19-57537ae1ed99 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:39.058492 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6d90917-9c86-4161-ab19-57537ae1ed99 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:39.059833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6d90917-9c86-4161-ab19-57537ae1ed99 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:39.060893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6d90917-9c86-4161-ab19-57537ae1ed99 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:39.061516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6d90917-9c86-4161-ab19-57537ae1ed99 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:39.062968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6d90917-9c86-4161-ab19-57537ae1ed99 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:39.081045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4,nova_api:SAVEPOINT=9,nova_api:RELEASE=9,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:28:39.088660 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-c6d90917-9c86-4161-ab19-57537ae1ed99 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Getting quotas for project 43a1115550de4c5185de7ca86bc17a63. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:28:39.096525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-c6d90917-9c86-4161-ab19-57537ae1ed99 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Getting quotas for user 1b5c31587a37465a9becda30e417ed5b and project 43a1115550de4c5185de7ca86bc17a63. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:28:39.117849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c6d90917-9c86-4161-ab19-57537ae1ed99 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:28:39.121771 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c6d90917-9c86-4161-ab19-57537ae1ed99 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:28:39.189736 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c6d90917-9c86-4161-ab19-57537ae1ed99 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.419278 Sep 07 12:28:39.191486 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 53/90] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:28:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:28:39.390227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-07d0bbdf-dbb4-4944-8c5e-a64bb9a38e6a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:39.401296 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-07d0bbdf-dbb4-4944-8c5e-a64bb9a38e6a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac" status: 200 len: 1224 microversion: 2.1 time: 0.478710 Sep 07 12:28:39.402574 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 38/91] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:38 2022] GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac => generated 1224 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:39.407723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ff8d462a-e73a-49b0-9283-cb5fc0bb8589 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:39.408605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ff8d462a-e73a-49b0-9283-cb5fc0bb8589 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:39.495768 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b28a1899-333b-478e-9111-edcfe019b5bb tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Calling method '.version_select at 0x7fc419c59ca0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:39.500446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b28a1899-333b-478e-9111-edcfe019b5bb tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:39.501989 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b28a1899-333b-478e-9111-edcfe019b5bb tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:39.504136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b28a1899-333b-478e-9111-edcfe019b5bb tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:39.511571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b28a1899-333b-478e-9111-edcfe019b5bb tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:39.521648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b28a1899-333b-478e-9111-edcfe019b5bb tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:39.524514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b28a1899-333b-478e-9111-edcfe019b5bb tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:39.619452 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b28a1899-333b-478e-9111-edcfe019b5bb tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.426384 Sep 07 12:28:39.622774 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 54/92] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Sep 7 12:28:39 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:39.634973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aad17ecd-3f0c-4122-80f2-8ff2332370e4 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Calling method '.version_select at 0x7fc419c04430>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:39.640951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aad17ecd-3f0c-4122-80f2-8ff2332370e4 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:39.646789 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aad17ecd-3f0c-4122-80f2-8ff2332370e4 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:39.650480 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aad17ecd-3f0c-4122-80f2-8ff2332370e4 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:39.651522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aad17ecd-3f0c-4122-80f2-8ff2332370e4 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:39.658322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aad17ecd-3f0c-4122-80f2-8ff2332370e4 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:39.661124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aad17ecd-3f0c-4122-80f2-8ff2332370e4 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:39.672444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ff8d462a-e73a-49b0-9283-cb5fc0bb8589 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:39.711158 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ff8d462a-e73a-49b0-9283-cb5fc0bb8589 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1213 microversion: 2.1 time: 0.283184 Sep 07 12:28:39.716390 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 39/93] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:39 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1213 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:39.766057 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aad17ecd-3f0c-4122-80f2-8ff2332370e4 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 398 microversion: 2.1 time: 0.134099 Sep 07 12:28:39.767187 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 55/94] 10.222.0.16 () {58 vars in 1139 bytes} [Wed Sep 7 12:28:39 2022] GET /compute/v2.1/os-hosts?zone= => generated 398 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:28:39.802902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b7bd1468-79a7-4122-884c-02a443f9387a tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Calling method '.version_select at 0x7fc419d03940>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:39.810411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7bd1468-79a7-4122-884c-02a443f9387a tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:39.810937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7bd1468-79a7-4122-884c-02a443f9387a tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:39.811486 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7bd1468-79a7-4122-884c-02a443f9387a tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:39.812316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7bd1468-79a7-4122-884c-02a443f9387a tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:39.812777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7bd1468-79a7-4122-884c-02a443f9387a tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:39.813264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7bd1468-79a7-4122-884c-02a443f9387a tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:39.882504 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b7bd1468-79a7-4122-884c-02a443f9387a tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.107248 Sep 07 12:28:39.884382 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 40/95] 10.222.0.16 () {58 vars in 1145 bytes} [Wed Sep 7 12:28:39 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 12:28:39.945971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b0d890b1-9bf0-4f05-b4f2-d6ab31c50269 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:39.946704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b0d890b1-9bf0-4f05-b4f2-d6ab31c50269 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:39.958408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0d890b1-9bf0-4f05-b4f2-d6ab31c50269 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:39.980922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0d890b1-9bf0-4f05-b4f2-d6ab31c50269 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:39.980922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0d890b1-9bf0-4f05-b4f2-d6ab31c50269 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:39.980922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0d890b1-9bf0-4f05-b4f2-d6ab31c50269 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:39.980922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0d890b1-9bf0-4f05-b4f2-d6ab31c50269 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:39.981209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0d890b1-9bf0-4f05-b4f2-d6ab31c50269 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:40.207931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7687f486-18c9-40b6-8bb9-345e1830e711 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1513030625", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "426701502", "adminPass": "***", "networks": [{"uuid": "36a73972-cb95-4593-b26d-1085b64b05d0"}], "security_groups": [{"name": "tempest-securitygroup--39943928"}], "key_name": "tempest-keypair-953815892", "user_data": "}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:40.485345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b0d890b1-9bf0-4f05-b4f2-d6ab31c50269 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5151bb757514a6392a0d93f2bbfe406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71cb3cbb2ee4a9dbfcd16759a74b093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:40.499035 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b0d890b1-9bf0-4f05-b4f2-d6ab31c50269 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 200 len: 1339 microversion: 2.1 time: 0.558335 Sep 07 12:28:40.506117 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 56/96] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:39 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 1339 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:40.527370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd29f67a-c64d-451f-ae1d-848a52a5a988 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:40.531330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dd29f67a-c64d-451f-ae1d-848a52a5a988 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:40.559798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd29f67a-c64d-451f-ae1d-848a52a5a988 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:40.561160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd29f67a-c64d-451f-ae1d-848a52a5a988 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:40.561645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd29f67a-c64d-451f-ae1d-848a52a5a988 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:40.562392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd29f67a-c64d-451f-ae1d-848a52a5a988 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:40.567134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd29f67a-c64d-451f-ae1d-848a52a5a988 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:40.567888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd29f67a-c64d-451f-ae1d-848a52a5a988 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:40.963228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dd29f67a-c64d-451f-ae1d-848a52a5a988 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:40.976863 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dd29f67a-c64d-451f-ae1d-848a52a5a988 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac" status: 200 len: 1278 microversion: 2.1 time: 0.469247 Sep 07 12:28:40.981910 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 57/97] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:40 2022] GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac => generated 1278 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:40.990578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-24fedba0-447d-4bcb-a655-9ec437c69424 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:40.997965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-24fedba0-447d-4bcb-a655-9ec437c69424 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:41.026268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24fedba0-447d-4bcb-a655-9ec437c69424 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:41.027191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24fedba0-447d-4bcb-a655-9ec437c69424 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:41.028207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24fedba0-447d-4bcb-a655-9ec437c69424 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:41.032062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-7687f486-18c9-40b6-8bb9-345e1830e711 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] validate_networks() for [('36a73972-cb95-4593-b26d-1085b64b05d0', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:28:41.032637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24fedba0-447d-4bcb-a655-9ec437c69424 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:41.033304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24fedba0-447d-4bcb-a655-9ec437c69424 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:41.033982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24fedba0-447d-4bcb-a655-9ec437c69424 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:41.355605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-24fedba0-447d-4bcb-a655-9ec437c69424 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:41.374731 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-24fedba0-447d-4bcb-a655-9ec437c69424 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1209 microversion: 2.1 time: 0.389464 Sep 07 12:28:41.376602 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 58/98] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:40 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1209 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:41.526822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-01245bf2-3fe6-42b9-ae73-b7351f880302 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:41.528014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-01245bf2-3fe6-42b9-ae73-b7351f880302 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:41.542315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01245bf2-3fe6-42b9-ae73-b7351f880302 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:41.543236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01245bf2-3fe6-42b9-ae73-b7351f880302 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:41.543863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01245bf2-3fe6-42b9-ae73-b7351f880302 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:41.546394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01245bf2-3fe6-42b9-ae73-b7351f880302 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:41.547095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01245bf2-3fe6-42b9-ae73-b7351f880302 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:41.553799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01245bf2-3fe6-42b9-ae73-b7351f880302 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:41.913932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-01245bf2-3fe6-42b9-ae73-b7351f880302 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5151bb757514a6392a0d93f2bbfe406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71cb3cbb2ee4a9dbfcd16759a74b093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:41.932706 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-01245bf2-3fe6-42b9-ae73-b7351f880302 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 200 len: 1339 microversion: 2.1 time: 0.409227 Sep 07 12:28:41.934859 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 59/99] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:41 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 1339 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:28:42.007578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-735783cb-7176-4ba1-8ceb-d3f0ffde4bf5 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:42.008395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-735783cb-7176-4ba1-8ceb-d3f0ffde4bf5 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:42.028041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-735783cb-7176-4ba1-8ceb-d3f0ffde4bf5 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:42.030031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-735783cb-7176-4ba1-8ceb-d3f0ffde4bf5 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:42.032053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-735783cb-7176-4ba1-8ceb-d3f0ffde4bf5 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:42.036364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-735783cb-7176-4ba1-8ceb-d3f0ffde4bf5 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:42.038727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-735783cb-7176-4ba1-8ceb-d3f0ffde4bf5 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:42.039683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-735783cb-7176-4ba1-8ceb-d3f0ffde4bf5 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:42.439102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-735783cb-7176-4ba1-8ceb-d3f0ffde4bf5 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:42.464187 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-735783cb-7176-4ba1-8ceb-d3f0ffde4bf5 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac" status: 200 len: 1278 microversion: 2.1 time: 0.464436 Sep 07 12:28:42.465691 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 60/100] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:41 2022] GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac => generated 1278 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:28:42.470901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4fd9d94c-d0bc-45a7-9aad-ebee06a80547 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:42.477563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4fd9d94c-d0bc-45a7-9aad-ebee06a80547 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:42.489742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fd9d94c-d0bc-45a7-9aad-ebee06a80547 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:42.491806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fd9d94c-d0bc-45a7-9aad-ebee06a80547 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:42.492154 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fd9d94c-d0bc-45a7-9aad-ebee06a80547 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:42.492902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fd9d94c-d0bc-45a7-9aad-ebee06a80547 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:42.501820 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fd9d94c-d0bc-45a7-9aad-ebee06a80547 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:42.502290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fd9d94c-d0bc-45a7-9aad-ebee06a80547 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:42.656388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4fd9d94c-d0bc-45a7-9aad-ebee06a80547 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:42.676413 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4fd9d94c-d0bc-45a7-9aad-ebee06a80547 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1209 microversion: 2.1 time: 0.209368 Sep 07 12:28:42.677175 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 61/101] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:42 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1209 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:42.960641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-baa6861a-bbe5-4640-b98a-c39abf415089 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:42.961162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-baa6861a-bbe5-4640-b98a-c39abf415089 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:42.981034 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-baa6861a-bbe5-4640-b98a-c39abf415089 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:42.981860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-baa6861a-bbe5-4640-b98a-c39abf415089 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:42.983023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-baa6861a-bbe5-4640-b98a-c39abf415089 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:42.983951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-baa6861a-bbe5-4640-b98a-c39abf415089 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:42.984571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-baa6861a-bbe5-4640-b98a-c39abf415089 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:42.985150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-baa6861a-bbe5-4640-b98a-c39abf415089 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:43.216963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-7687f486-18c9-40b6-8bb9-345e1830e711 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:28:43.217539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-7687f486-18c9-40b6-8bb9-345e1830e711 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:28:43.218194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-7687f486-18c9-40b6-8bb9-345e1830e711 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:28:43.218609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-7687f486-18c9-40b6-8bb9-345e1830e711 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:28:43.219041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-7687f486-18c9-40b6-8bb9-345e1830e711 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:28:43.248777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7687f486-18c9-40b6-8bb9-345e1830e711 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:43.255865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7687f486-18c9-40b6-8bb9-345e1830e711 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:43.256351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7687f486-18c9-40b6-8bb9-345e1830e711 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:43.257183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7687f486-18c9-40b6-8bb9-345e1830e711 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:43.257706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7687f486-18c9-40b6-8bb9-345e1830e711 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:43.258162 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7687f486-18c9-40b6-8bb9-345e1830e711 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:43.318280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-7687f486-18c9-40b6-8bb9-345e1830e711 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Getting quotas for project eeb96c3ce6734e5f94229d94bf379318. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:28:43.324622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-7687f486-18c9-40b6-8bb9-345e1830e711 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Getting quotas for user 02af7f40e0cc4ab7bbc06201d5e253cd and project eeb96c3ce6734e5f94229d94bf379318. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:28:43.341751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7687f486-18c9-40b6-8bb9-345e1830e711 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:28:43.344781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7687f486-18c9-40b6-8bb9-345e1830e711 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 79881389-e6f0-43f3-96c3-fdb045bb956e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:28:43.409342 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7687f486-18c9-40b6-8bb9-345e1830e711 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 3.206531 Sep 07 12:28:43.417340 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 41/102] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:28:40 2022] POST /compute/v2.1/servers => generated 400 bytes in 3215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:28:43.425452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6ab199f9-b856-490c-b776-9d9b0834c36b tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:43.426315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6ab199f9-b856-490c-b776-9d9b0834c36b tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 79881389-e6f0-43f3-96c3-fdb045bb956e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:43.628413 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-baa6861a-bbe5-4640-b98a-c39abf415089 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5151bb757514a6392a0d93f2bbfe406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71cb3cbb2ee4a9dbfcd16759a74b093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:43.643126 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-baa6861a-bbe5-4640-b98a-c39abf415089 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 200 len: 1339 microversion: 2.1 time: 0.687202 Sep 07 12:28:43.654781 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 62/103] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:42 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 1339 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:28:43.673007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aa2dc9ef-f80d-4a27-ba00-f1ae7de9a53d tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:43.673752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aa2dc9ef-f80d-4a27-ba00-f1ae7de9a53d tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:43.690396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa2dc9ef-f80d-4a27-ba00-f1ae7de9a53d tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:43.691849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa2dc9ef-f80d-4a27-ba00-f1ae7de9a53d tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:43.691849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa2dc9ef-f80d-4a27-ba00-f1ae7de9a53d tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:43.692685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa2dc9ef-f80d-4a27-ba00-f1ae7de9a53d tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:43.698588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa2dc9ef-f80d-4a27-ba00-f1ae7de9a53d tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:43.699410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa2dc9ef-f80d-4a27-ba00-f1ae7de9a53d tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:43.793723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6ab199f9-b856-490c-b776-9d9b0834c36b tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:43.813111 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6ab199f9-b856-490c-b776-9d9b0834c36b tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e" status: 200 len: 1262 microversion: 2.1 time: 0.394000 Sep 07 12:28:43.817988 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 42/104] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:43 2022] GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e => generated 1262 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:43.834029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8da47e53-003c-440f-9dc8-dc0fa39d287a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:43.839865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8da47e53-003c-440f-9dc8-dc0fa39d287a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:43.869874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8da47e53-003c-440f-9dc8-dc0fa39d287a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:43.871111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8da47e53-003c-440f-9dc8-dc0fa39d287a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:43.871837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8da47e53-003c-440f-9dc8-dc0fa39d287a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:43.872804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8da47e53-003c-440f-9dc8-dc0fa39d287a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:43.873502 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8da47e53-003c-440f-9dc8-dc0fa39d287a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:43.874246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8da47e53-003c-440f-9dc8-dc0fa39d287a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:44.215252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8da47e53-003c-440f-9dc8-dc0fa39d287a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:44.230882 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8da47e53-003c-440f-9dc8-dc0fa39d287a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1209 microversion: 2.1 time: 0.411431 Sep 07 12:28:44.240153 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 43/105] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:43 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1209 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:44.398906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aa2dc9ef-f80d-4a27-ba00-f1ae7de9a53d tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:44.420077 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aa2dc9ef-f80d-4a27-ba00-f1ae7de9a53d tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac" status: 200 len: 1320 microversion: 2.1 time: 0.763924 Sep 07 12:28:44.420799 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 63/106] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:43 2022] GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac => generated 1320 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:44.675688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae76c6ca-3296-49c4-8995-5b5fff26bc6a tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:44.676995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ae76c6ca-3296-49c4-8995-5b5fff26bc6a tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:44.687064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae76c6ca-3296-49c4-8995-5b5fff26bc6a tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:44.689427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae76c6ca-3296-49c4-8995-5b5fff26bc6a tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:44.690142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae76c6ca-3296-49c4-8995-5b5fff26bc6a tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:44.691197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae76c6ca-3296-49c4-8995-5b5fff26bc6a tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:44.693666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae76c6ca-3296-49c4-8995-5b5fff26bc6a tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:44.695893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae76c6ca-3296-49c4-8995-5b5fff26bc6a tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:44.838855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-78a8101e-6da5-48d9-b1bf-5235a0dd7778 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:44.839998 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-78a8101e-6da5-48d9-b1bf-5235a0dd7778 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 79881389-e6f0-43f3-96c3-fdb045bb956e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:44.870273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78a8101e-6da5-48d9-b1bf-5235a0dd7778 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:44.870916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78a8101e-6da5-48d9-b1bf-5235a0dd7778 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:44.871492 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78a8101e-6da5-48d9-b1bf-5235a0dd7778 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:44.872888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78a8101e-6da5-48d9-b1bf-5235a0dd7778 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:44.873445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78a8101e-6da5-48d9-b1bf-5235a0dd7778 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:44.878180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78a8101e-6da5-48d9-b1bf-5235a0dd7778 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:45.080469 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-78a8101e-6da5-48d9-b1bf-5235a0dd7778 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:45.097279 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-78a8101e-6da5-48d9-b1bf-5235a0dd7778 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e" status: 200 len: 1266 microversion: 2.1 time: 0.264301 Sep 07 12:28:45.116545 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 64/107] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:44 2022] GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:28:45.132296 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ae76c6ca-3296-49c4-8995-5b5fff26bc6a tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5151bb757514a6392a0d93f2bbfe406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71cb3cbb2ee4a9dbfcd16759a74b093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:45.141977 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ae76c6ca-3296-49c4-8995-5b5fff26bc6a tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 200 len: 1339 microversion: 2.1 time: 0.471287 Sep 07 12:28:45.143298 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 44/108] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:44 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 1339 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:45.271239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7856b529-cd71-47a1-968b-e79f267cd864 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:45.272142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7856b529-cd71-47a1-968b-e79f267cd864 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:45.288886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7856b529-cd71-47a1-968b-e79f267cd864 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:45.292227 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7856b529-cd71-47a1-968b-e79f267cd864 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:45.294400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7856b529-cd71-47a1-968b-e79f267cd864 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:45.295397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7856b529-cd71-47a1-968b-e79f267cd864 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:45.298121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7856b529-cd71-47a1-968b-e79f267cd864 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:45.298902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7856b529-cd71-47a1-968b-e79f267cd864 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:45.450855 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-70725327-5070-4aac-9337-201ff17124a3 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:45.454189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-70725327-5070-4aac-9337-201ff17124a3 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:45.484154 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70725327-5070-4aac-9337-201ff17124a3 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:45.485011 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70725327-5070-4aac-9337-201ff17124a3 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:45.485678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70725327-5070-4aac-9337-201ff17124a3 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:45.489347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70725327-5070-4aac-9337-201ff17124a3 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:45.490224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70725327-5070-4aac-9337-201ff17124a3 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:45.490918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70725327-5070-4aac-9337-201ff17124a3 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:45.531674 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7856b529-cd71-47a1-968b-e79f267cd864 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:45.547777 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7856b529-cd71-47a1-968b-e79f267cd864 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1209 microversion: 2.1 time: 0.280987 Sep 07 12:28:45.559847 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 65/109] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:45 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1209 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:45.998136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-70725327-5070-4aac-9337-201ff17124a3 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:46.007124 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-70725327-5070-4aac-9337-201ff17124a3 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac" status: 200 len: 1320 microversion: 2.1 time: 0.561052 Sep 07 12:28:46.007761 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 45/110] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:45 2022] GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac => generated 1320 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:28:46.126126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cf8fe1a5-3027-493e-a246-1ecfaf5e5f36 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:46.126815 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cf8fe1a5-3027-493e-a246-1ecfaf5e5f36 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 79881389-e6f0-43f3-96c3-fdb045bb956e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:46.134436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf8fe1a5-3027-493e-a246-1ecfaf5e5f36 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:46.135094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf8fe1a5-3027-493e-a246-1ecfaf5e5f36 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:46.135756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf8fe1a5-3027-493e-a246-1ecfaf5e5f36 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:46.136852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf8fe1a5-3027-493e-a246-1ecfaf5e5f36 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:46.137335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf8fe1a5-3027-493e-a246-1ecfaf5e5f36 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:46.137823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf8fe1a5-3027-493e-a246-1ecfaf5e5f36 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:46.172452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-77da4399-92b5-4880-aca4-9e0180067b16 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:46.174065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-77da4399-92b5-4880-aca4-9e0180067b16 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:46.195544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77da4399-92b5-4880-aca4-9e0180067b16 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:46.197044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77da4399-92b5-4880-aca4-9e0180067b16 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:46.198059 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77da4399-92b5-4880-aca4-9e0180067b16 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:46.199981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77da4399-92b5-4880-aca4-9e0180067b16 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:46.201202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77da4399-92b5-4880-aca4-9e0180067b16 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:46.201901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77da4399-92b5-4880-aca4-9e0180067b16 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:46.231049 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cf8fe1a5-3027-493e-a246-1ecfaf5e5f36 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:46.246641 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cf8fe1a5-3027-493e-a246-1ecfaf5e5f36 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e" status: 200 len: 1266 microversion: 2.1 time: 0.125899 Sep 07 12:28:46.248926 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 66/111] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:46 2022] GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e => generated 1266 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:46.363435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-77da4399-92b5-4880-aca4-9e0180067b16 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5151bb757514a6392a0d93f2bbfe406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71cb3cbb2ee4a9dbfcd16759a74b093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:46.371505 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-77da4399-92b5-4880-aca4-9e0180067b16 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 200 len: 1339 microversion: 2.1 time: 0.203174 Sep 07 12:28:46.372435 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 46/112] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:46 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 1339 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:46.587384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5263aa72-773d-41fb-945b-78046aaaecd6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:46.588175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5263aa72-773d-41fb-945b-78046aaaecd6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:46.607162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5263aa72-773d-41fb-945b-78046aaaecd6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:46.609057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5263aa72-773d-41fb-945b-78046aaaecd6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:46.610946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5263aa72-773d-41fb-945b-78046aaaecd6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:46.618458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5263aa72-773d-41fb-945b-78046aaaecd6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:46.621658 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5263aa72-773d-41fb-945b-78046aaaecd6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:46.624820 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5263aa72-773d-41fb-945b-78046aaaecd6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:46.639277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:28:46.777570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5263aa72-773d-41fb-945b-78046aaaecd6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:46.797193 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5263aa72-773d-41fb-945b-78046aaaecd6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1209 microversion: 2.1 time: 0.214560 Sep 07 12:28:46.807774 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 67/113] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:46 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1209 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:47.039658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ef2acc3f-50e8-4103-92e2-a8c9d5be516e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:47.040284 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ef2acc3f-50e8-4103-92e2-a8c9d5be516e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:47.070704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=4,nova_api:INSERT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:28:47.085365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef2acc3f-50e8-4103-92e2-a8c9d5be516e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:47.085984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef2acc3f-50e8-4103-92e2-a8c9d5be516e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:47.086457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef2acc3f-50e8-4103-92e2-a8c9d5be516e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:47.087270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef2acc3f-50e8-4103-92e2-a8c9d5be516e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:47.087762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef2acc3f-50e8-4103-92e2-a8c9d5be516e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:47.088232 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef2acc3f-50e8-4103-92e2-a8c9d5be516e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:47.290756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ef2acc3f-50e8-4103-92e2-a8c9d5be516e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:47.297952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-18f252c5-3493-43bd-ad10-dcfea3b85e20 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:47.299299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-18f252c5-3493-43bd-ad10-dcfea3b85e20 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 79881389-e6f0-43f3-96c3-fdb045bb956e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:47.303492 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ef2acc3f-50e8-4103-92e2-a8c9d5be516e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac" status: 200 len: 1320 microversion: 2.1 time: 0.275075 Sep 07 12:28:47.304791 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 47/114] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:47 2022] GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac => generated 1320 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:47.319556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18f252c5-3493-43bd-ad10-dcfea3b85e20 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:47.320346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18f252c5-3493-43bd-ad10-dcfea3b85e20 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:47.321008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18f252c5-3493-43bd-ad10-dcfea3b85e20 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:47.322110 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18f252c5-3493-43bd-ad10-dcfea3b85e20 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:47.322901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18f252c5-3493-43bd-ad10-dcfea3b85e20 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:47.323553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18f252c5-3493-43bd-ad10-dcfea3b85e20 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:47.396910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6e297b04-5adb-4770-9ed9-5b2a3c3ccc06 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:47.399387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6e297b04-5adb-4770-9ed9-5b2a3c3ccc06 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:47.416659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-18f252c5-3493-43bd-ad10-dcfea3b85e20 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:47.418913 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e297b04-5adb-4770-9ed9-5b2a3c3ccc06 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:47.419826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e297b04-5adb-4770-9ed9-5b2a3c3ccc06 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:47.421411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e297b04-5adb-4770-9ed9-5b2a3c3ccc06 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:47.422416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e297b04-5adb-4770-9ed9-5b2a3c3ccc06 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:47.423061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e297b04-5adb-4770-9ed9-5b2a3c3ccc06 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:47.425855 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-18f252c5-3493-43bd-ad10-dcfea3b85e20 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e" status: 200 len: 1258 microversion: 2.1 time: 0.132527 Sep 07 12:28:47.427423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e297b04-5adb-4770-9ed9-5b2a3c3ccc06 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:47.438309 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 68/115] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:47 2022] GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:47.871145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-fa50f44f-6809-45df-899f-5547d133d334 req-aea49cf7-e263-4ab6-9446-16e7ba73d1f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e7d46f-e8a5-4110-b7f2-05488d1bdb8a", "name": "network-vif-plugged", "status": "completed", "tag": "6627c9a2-eaaf-4625-a051-a3236290ade7"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:47.883101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fa50f44f-6809-45df-899f-5547d133d334 req-aea49cf7-e263-4ab6-9446-16e7ba73d1f4 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:47.884647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fa50f44f-6809-45df-899f-5547d133d334 req-aea49cf7-e263-4ab6-9446-16e7ba73d1f4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:47.885136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fa50f44f-6809-45df-899f-5547d133d334 req-aea49cf7-e263-4ab6-9446-16e7ba73d1f4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:47.920253 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-fa50f44f-6809-45df-899f-5547d133d334 req-aea49cf7-e263-4ab6-9446-16e7ba73d1f4 service nova] Creating event network-vif-plugged:6627c9a2-eaaf-4625-a051-a3236290ade7 for instance 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a on n-h1-852087-9 Sep 07 12:28:47.934267 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-fa50f44f-6809-45df-899f-5547d133d334 req-aea49cf7-e263-4ab6-9446-16e7ba73d1f4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181196 Sep 07 12:28:47.940860 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 69/116] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:47.951038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6e297b04-5adb-4770-9ed9-5b2a3c3ccc06 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5151bb757514a6392a0d93f2bbfe406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71cb3cbb2ee4a9dbfcd16759a74b093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:47.966300 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e5ab3673-64e7-4924-8326-c12cc9ea8a2e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:47.969105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e5ab3673-64e7-4924-8326-c12cc9ea8a2e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:47.971900 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6e297b04-5adb-4770-9ed9-5b2a3c3ccc06 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 200 len: 1339 microversion: 2.1 time: 0.577501 Sep 07 12:28:47.974886 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 48/117] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:47 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 1339 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:47.988293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5ab3673-64e7-4924-8326-c12cc9ea8a2e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:47.989088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5ab3673-64e7-4924-8326-c12cc9ea8a2e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:47.989727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5ab3673-64e7-4924-8326-c12cc9ea8a2e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:47.994424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5ab3673-64e7-4924-8326-c12cc9ea8a2e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:47.997837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5ab3673-64e7-4924-8326-c12cc9ea8a2e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:47.999366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5ab3673-64e7-4924-8326-c12cc9ea8a2e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:48.216056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e5ab3673-64e7-4924-8326-c12cc9ea8a2e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:48.261620 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e5ab3673-64e7-4924-8326-c12cc9ea8a2e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1283 microversion: 2.1 time: 0.315851 Sep 07 12:28:48.262392 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 70/118] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:47 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1283 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:48.332220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-454dee99-775b-40eb-845e-4080f3f55f70 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:48.333439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-454dee99-775b-40eb-845e-4080f3f55f70 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:48.349893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-454dee99-775b-40eb-845e-4080f3f55f70 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:48.350914 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-454dee99-775b-40eb-845e-4080f3f55f70 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:48.352108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-454dee99-775b-40eb-845e-4080f3f55f70 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:48.354731 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-454dee99-775b-40eb-845e-4080f3f55f70 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:48.356533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-454dee99-775b-40eb-845e-4080f3f55f70 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:48.357447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-454dee99-775b-40eb-845e-4080f3f55f70 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:48.364968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:28:48.576041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c9f64f2f-8e73-4a69-a47a-f4a924209277 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1753666609", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "90fd0444-8940-4097-8547-6568e7ca00e8"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:48.678512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-c9f64f2f-8e73-4a69-a47a-f4a924209277 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] validate_networks() for [('90fd0444-8940-4097-8547-6568e7ca00e8', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:28:48.918262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-454dee99-775b-40eb-845e-4080f3f55f70 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:48.931423 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-454dee99-775b-40eb-845e-4080f3f55f70 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac" status: 200 len: 1320 microversion: 2.1 time: 0.600861 Sep 07 12:28:48.933142 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 49/119] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:48 2022] GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac => generated 1320 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:48.948498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-86d17a00-54ff-4dda-bac0-eb9f61c35cda tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:48.949405 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-86d17a00-54ff-4dda-bac0-eb9f61c35cda tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 79881389-e6f0-43f3-96c3-fdb045bb956e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:48.965024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86d17a00-54ff-4dda-bac0-eb9f61c35cda tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:48.965578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86d17a00-54ff-4dda-bac0-eb9f61c35cda tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:48.966075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86d17a00-54ff-4dda-bac0-eb9f61c35cda tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:48.966876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86d17a00-54ff-4dda-bac0-eb9f61c35cda tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:48.967830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86d17a00-54ff-4dda-bac0-eb9f61c35cda tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:48.968396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86d17a00-54ff-4dda-bac0-eb9f61c35cda tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:49.110205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:28:49.118871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-86d17a00-54ff-4dda-bac0-eb9f61c35cda tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:49.135042 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-86d17a00-54ff-4dda-bac0-eb9f61c35cda tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e" status: 200 len: 1320 microversion: 2.1 time: 0.198200 Sep 07 12:28:49.138577 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 50/120] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:48 2022] GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e => generated 1320 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:49.150554 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0780a006-07b6-4658-8aaf-0f1c33571086 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:49.151186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0780a006-07b6-4658-8aaf-0f1c33571086 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:49.164421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0780a006-07b6-4658-8aaf-0f1c33571086 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:49.164935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0780a006-07b6-4658-8aaf-0f1c33571086 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:49.165385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0780a006-07b6-4658-8aaf-0f1c33571086 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:49.166133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0780a006-07b6-4658-8aaf-0f1c33571086 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:49.166600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0780a006-07b6-4658-8aaf-0f1c33571086 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:49.167035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0780a006-07b6-4658-8aaf-0f1c33571086 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:49.657682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0780a006-07b6-4658-8aaf-0f1c33571086 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5151bb757514a6392a0d93f2bbfe406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71cb3cbb2ee4a9dbfcd16759a74b093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:49.670667 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0780a006-07b6-4658-8aaf-0f1c33571086 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 200 len: 1339 microversion: 2.1 time: 0.530301 Sep 07 12:28:49.672796 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 51/121] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:49 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 1339 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:49.699249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8c0da74e-a859-4ac5-8cbd-65aefb419926 req-fded573b-e3fa-408f-bd80-556961a24323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac", "tag": "5bf2653b-1fbc-4aec-bcac-f5564ffe6b01"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:49.720588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:28:49.749016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8c0da74e-a859-4ac5-8cbd-65aefb419926 req-fded573b-e3fa-408f-bd80-556961a24323 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:49.752083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8c0da74e-a859-4ac5-8cbd-65aefb419926 req-fded573b-e3fa-408f-bd80-556961a24323 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:49.752672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8c0da74e-a859-4ac5-8cbd-65aefb419926 req-fded573b-e3fa-408f-bd80-556961a24323 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:49.805635 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8c0da74e-a859-4ac5-8cbd-65aefb419926 req-fded573b-e3fa-408f-bd80-556961a24323 service nova] Creating event network-changed:5bf2653b-1fbc-4aec-bcac-f5564ffe6b01 for instance 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac on n-h2-852087-9 Sep 07 12:28:49.807480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8c0da74e-a859-4ac5-8cbd-65aefb419926 req-fded573b-e3fa-408f-bd80-556961a24323 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 12:28:49.808144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8c0da74e-a859-4ac5-8cbd-65aefb419926 req-fded573b-e3fa-408f-bd80-556961a24323 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 12:28:49.811055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c37a0f6d-895a-4653-aaf7-0f3ce071c02a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:49.815827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c37a0f6d-895a-4653-aaf7-0f3ce071c02a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:49.816772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c37a0f6d-895a-4653-aaf7-0f3ce071c02a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:49.821461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c37a0f6d-895a-4653-aaf7-0f3ce071c02a None None] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:49.823112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c37a0f6d-895a-4653-aaf7-0f3ce071c02a None None] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:49.824675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c37a0f6d-895a-4653-aaf7-0f3ce071c02a None None] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:49.845782 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.compute.rpcapi [None req-c37a0f6d-895a-4653-aaf7-0f3ce071c02a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 07 12:28:49.847604 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c37a0f6d-895a-4653-aaf7-0f3ce071c02a None None] Releasing lock "compute-rpcapi-router" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 12:28:49.873005 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c37a0f6d-895a-4653-aaf7-0f3ce071c02a None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195080 Sep 07 12:28:49.874217 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 52/122] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:49.885324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e63b6cb5-f461-4d1d-bb45-1a1b28b9c6f8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:49.886578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e63b6cb5-f461-4d1d-bb45-1a1b28b9c6f8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:49.894537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e63b6cb5-f461-4d1d-bb45-1a1b28b9c6f8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:49.895358 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e63b6cb5-f461-4d1d-bb45-1a1b28b9c6f8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:49.896068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e63b6cb5-f461-4d1d-bb45-1a1b28b9c6f8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:49.897213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e63b6cb5-f461-4d1d-bb45-1a1b28b9c6f8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:49.898114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e63b6cb5-f461-4d1d-bb45-1a1b28b9c6f8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:49.900678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e63b6cb5-f461-4d1d-bb45-1a1b28b9c6f8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:50.171844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e63b6cb5-f461-4d1d-bb45-1a1b28b9c6f8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:50.187429 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e63b6cb5-f461-4d1d-bb45-1a1b28b9c6f8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1271 microversion: 2.1 time: 0.306855 Sep 07 12:28:50.189916 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 53/123] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:49 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1271 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:50.210529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-816124e3-97d5-44d9-bfc7-17c7cbe76ce0 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:50.211487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-816124e3-97d5-44d9-bfc7-17c7cbe76ce0 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:50.225765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-816124e3-97d5-44d9-bfc7-17c7cbe76ce0 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:50.227405 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-816124e3-97d5-44d9-bfc7-17c7cbe76ce0 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:50.229018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-816124e3-97d5-44d9-bfc7-17c7cbe76ce0 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:50.230365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-816124e3-97d5-44d9-bfc7-17c7cbe76ce0 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:50.232479 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-816124e3-97d5-44d9-bfc7-17c7cbe76ce0 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:50.234780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-816124e3-97d5-44d9-bfc7-17c7cbe76ce0 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:50.412868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c9f64f2f-8e73-4a69-a47a-f4a924209277 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:28:50.413297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c9f64f2f-8e73-4a69-a47a-f4a924209277 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:28:50.414169 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c9f64f2f-8e73-4a69-a47a-f4a924209277 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:28:50.415223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c9f64f2f-8e73-4a69-a47a-f4a924209277 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:28:50.415831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c9f64f2f-8e73-4a69-a47a-f4a924209277 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:28:50.449852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9f64f2f-8e73-4a69-a47a-f4a924209277 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:50.451438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9f64f2f-8e73-4a69-a47a-f4a924209277 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:50.459058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9f64f2f-8e73-4a69-a47a-f4a924209277 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:50.461170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9f64f2f-8e73-4a69-a47a-f4a924209277 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:50.465199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9f64f2f-8e73-4a69-a47a-f4a924209277 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:50.465686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9f64f2f-8e73-4a69-a47a-f4a924209277 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:50.521269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-c9f64f2f-8e73-4a69-a47a-f4a924209277 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Getting quotas for project b32e8c6ba4e2486aa9769db48d2250d9. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:28:50.533020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-c9f64f2f-8e73-4a69-a47a-f4a924209277 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Getting quotas for user f009cb4fb12841a0ada96dc8c47cf2bd and project b32e8c6ba4e2486aa9769db48d2250d9. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:28:50.547427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c9f64f2f-8e73-4a69-a47a-f4a924209277 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:28:50.550679 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c9f64f2f-8e73-4a69-a47a-f4a924209277 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:28:50.648288 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c9f64f2f-8e73-4a69-a47a-f4a924209277 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.209421 Sep 07 12:28:50.650103 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 71/124] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:28:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 12:28:50.655817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3ebc9087-e652-4ea4-95e9-171c8834fa4a tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:50.656694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3ebc9087-e652-4ea4-95e9-171c8834fa4a tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 79881389-e6f0-43f3-96c3-fdb045bb956e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:50.665990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ebc9087-e652-4ea4-95e9-171c8834fa4a tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:50.667300 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ebc9087-e652-4ea4-95e9-171c8834fa4a tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:50.667961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ebc9087-e652-4ea4-95e9-171c8834fa4a tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:50.668837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ebc9087-e652-4ea4-95e9-171c8834fa4a tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:50.669474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ebc9087-e652-4ea4-95e9-171c8834fa4a tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:50.670080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ebc9087-e652-4ea4-95e9-171c8834fa4a tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:50.792726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3ebc9087-e652-4ea4-95e9-171c8834fa4a tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:50.815102 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3ebc9087-e652-4ea4-95e9-171c8834fa4a tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e" status: 200 len: 1320 microversion: 2.1 time: 0.159654 Sep 07 12:28:50.834184 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 72/125] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:50 2022] GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e => generated 1320 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:50.847521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8e21ad6f-2940-4744-9238-52dbbc51f8e1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:50.850741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8e21ad6f-2940-4744-9238-52dbbc51f8e1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:50.971050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8e21ad6f-2940-4744-9238-52dbbc51f8e1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:50.985571 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8e21ad6f-2940-4744-9238-52dbbc51f8e1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1211 microversion: 2.1 time: 0.147590 Sep 07 12:28:51.001805 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 73/126] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:50 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1211 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:51.006957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-01b898e9-0899-4dda-bb6c-e134c80bd699 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:51.007574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-01b898e9-0899-4dda-bb6c-e134c80bd699 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:51.014027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01b898e9-0899-4dda-bb6c-e134c80bd699 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:51.014518 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01b898e9-0899-4dda-bb6c-e134c80bd699 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:51.014956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01b898e9-0899-4dda-bb6c-e134c80bd699 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:51.015747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01b898e9-0899-4dda-bb6c-e134c80bd699 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:51.016088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01b898e9-0899-4dda-bb6c-e134c80bd699 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:51.017021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01b898e9-0899-4dda-bb6c-e134c80bd699 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:51.221551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-816124e3-97d5-44d9-bfc7-17c7cbe76ce0 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:51.232617 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-816124e3-97d5-44d9-bfc7-17c7cbe76ce0 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac" status: 200 len: 1320 microversion: 2.1 time: 1.040974 Sep 07 12:28:51.235726 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 54/127] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:50 2022] GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac => generated 1320 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:51.241468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e0c9295a-9cdc-4d14-8252-5191b6be1c01 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:51.242374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e0c9295a-9cdc-4d14-8252-5191b6be1c01 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:51.279029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0c9295a-9cdc-4d14-8252-5191b6be1c01 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:51.287235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0c9295a-9cdc-4d14-8252-5191b6be1c01 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:51.288234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0c9295a-9cdc-4d14-8252-5191b6be1c01 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:51.290669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0c9295a-9cdc-4d14-8252-5191b6be1c01 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:51.292036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0c9295a-9cdc-4d14-8252-5191b6be1c01 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:51.293399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0c9295a-9cdc-4d14-8252-5191b6be1c01 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:51.481838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e0c9295a-9cdc-4d14-8252-5191b6be1c01 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:51.489539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-01b898e9-0899-4dda-bb6c-e134c80bd699 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5151bb757514a6392a0d93f2bbfe406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71cb3cbb2ee4a9dbfcd16759a74b093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:51.495319 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e0c9295a-9cdc-4d14-8252-5191b6be1c01 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1271 microversion: 2.1 time: 0.258189 Sep 07 12:28:51.496977 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 55/128] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:51 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1271 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:51.498624 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-01b898e9-0899-4dda-bb6c-e134c80bd699 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 200 len: 1339 microversion: 2.1 time: 0.495610 Sep 07 12:28:51.499433 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 74/129] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:51 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 1339 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:51.846444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a916aed7-9b2a-4453-8f7a-98aabf403319 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:51.847288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a916aed7-9b2a-4453-8f7a-98aabf403319 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 79881389-e6f0-43f3-96c3-fdb045bb956e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:51.876280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a916aed7-9b2a-4453-8f7a-98aabf403319 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:51.876869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a916aed7-9b2a-4453-8f7a-98aabf403319 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:51.877336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a916aed7-9b2a-4453-8f7a-98aabf403319 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:51.882341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a916aed7-9b2a-4453-8f7a-98aabf403319 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:51.882828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a916aed7-9b2a-4453-8f7a-98aabf403319 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:51.883274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a916aed7-9b2a-4453-8f7a-98aabf403319 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:52.014074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3d9b6b0d-5b28-420b-8f4e-c011928e4d09 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:52.014690 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3d9b6b0d-5b28-420b-8f4e-c011928e4d09 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:52.042586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d9b6b0d-5b28-420b-8f4e-c011928e4d09 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:52.043181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d9b6b0d-5b28-420b-8f4e-c011928e4d09 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:52.043628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d9b6b0d-5b28-420b-8f4e-c011928e4d09 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:52.044575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d9b6b0d-5b28-420b-8f4e-c011928e4d09 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:52.044816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d9b6b0d-5b28-420b-8f4e-c011928e4d09 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:52.045236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d9b6b0d-5b28-420b-8f4e-c011928e4d09 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:52.613597 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a916aed7-9b2a-4453-8f7a-98aabf403319 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:52.625070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3d9b6b0d-5b28-420b-8f4e-c011928e4d09 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:52.630874 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a916aed7-9b2a-4453-8f7a-98aabf403319 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e" status: 200 len: 1386 microversion: 2.1 time: 0.792029 Sep 07 12:28:52.631749 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 56/130] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:51 2022] GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e => generated 1386 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:52.634619 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3d9b6b0d-5b28-420b-8f4e-c011928e4d09 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1285 microversion: 2.1 time: 0.629876 Sep 07 12:28:52.635505 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 75/131] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:52 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1285 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:28:52.641210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-796e87d8-dbc2-478a-9407-0454d2cdfb05 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:52.642300 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-796e87d8-dbc2-478a-9407-0454d2cdfb05 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:52.647424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7e06d6fd-5d9f-4263-8dae-596d71f741f1 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:52.648208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7e06d6fd-5d9f-4263-8dae-596d71f741f1 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:52.656105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-796e87d8-dbc2-478a-9407-0454d2cdfb05 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:52.657150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-796e87d8-dbc2-478a-9407-0454d2cdfb05 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:52.657778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-796e87d8-dbc2-478a-9407-0454d2cdfb05 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:52.658259 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e06d6fd-5d9f-4263-8dae-596d71f741f1 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:52.659224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-796e87d8-dbc2-478a-9407-0454d2cdfb05 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:52.659922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e06d6fd-5d9f-4263-8dae-596d71f741f1 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:52.660502 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e06d6fd-5d9f-4263-8dae-596d71f741f1 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:52.663006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-796e87d8-dbc2-478a-9407-0454d2cdfb05 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:52.664141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e06d6fd-5d9f-4263-8dae-596d71f741f1 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:52.664937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e06d6fd-5d9f-4263-8dae-596d71f741f1 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:52.665551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e06d6fd-5d9f-4263-8dae-596d71f741f1 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:52.666464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-796e87d8-dbc2-478a-9407-0454d2cdfb05 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:53.364226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-796e87d8-dbc2-478a-9407-0454d2cdfb05 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:53.380444 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-796e87d8-dbc2-478a-9407-0454d2cdfb05 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1313 microversion: 2.1 time: 0.743826 Sep 07 12:28:53.385699 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 76/132] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:52 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1313 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:53.401295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3b64b711-3921-4f5c-9624-ed50b9f73acc tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:53.401295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3b64b711-3921-4f5c-9624-ed50b9f73acc tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:53.401784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7e06d6fd-5d9f-4263-8dae-596d71f741f1 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:53.414475 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7e06d6fd-5d9f-4263-8dae-596d71f741f1 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac" status: 200 len: 1320 microversion: 2.1 time: 0.780782 Sep 07 12:28:53.429591 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 57/133] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:52 2022] GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac => generated 1320 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:53.429938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b64b711-3921-4f5c-9624-ed50b9f73acc tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:53.429938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b64b711-3921-4f5c-9624-ed50b9f73acc tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:53.429938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b64b711-3921-4f5c-9624-ed50b9f73acc tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:53.429938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b64b711-3921-4f5c-9624-ed50b9f73acc tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:53.430210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b64b711-3921-4f5c-9624-ed50b9f73acc tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:53.430210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b64b711-3921-4f5c-9624-ed50b9f73acc tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:53.669521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3f7df975-69ca-4d3c-b0ec-22048a42edc0 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:53.670238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3f7df975-69ca-4d3c-b0ec-22048a42edc0 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 79881389-e6f0-43f3-96c3-fdb045bb956e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:53.682388 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f7df975-69ca-4d3c-b0ec-22048a42edc0 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:53.683850 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f7df975-69ca-4d3c-b0ec-22048a42edc0 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:53.684708 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f7df975-69ca-4d3c-b0ec-22048a42edc0 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:53.686114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f7df975-69ca-4d3c-b0ec-22048a42edc0 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:53.686863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f7df975-69ca-4d3c-b0ec-22048a42edc0 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:53.687545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f7df975-69ca-4d3c-b0ec-22048a42edc0 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:53.800674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=20 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:28:54.002972 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3b64b711-3921-4f5c-9624-ed50b9f73acc tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5151bb757514a6392a0d93f2bbfe406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71cb3cbb2ee4a9dbfcd16759a74b093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:54.017466 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3b64b711-3921-4f5c-9624-ed50b9f73acc tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 200 len: 1489 microversion: 2.1 time: 0.630553 Sep 07 12:28:54.045511 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 77/134] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:53 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 1489 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:54.053796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d6b23969-5fe0-4ecd-bb8c-7ba8424ac03d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:54.057379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d6b23969-5fe0-4ecd-bb8c-7ba8424ac03d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:54.077277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6b23969-5fe0-4ecd-bb8c-7ba8424ac03d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:54.078258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6b23969-5fe0-4ecd-bb8c-7ba8424ac03d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:54.079207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6b23969-5fe0-4ecd-bb8c-7ba8424ac03d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:54.080101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6b23969-5fe0-4ecd-bb8c-7ba8424ac03d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:54.081246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6b23969-5fe0-4ecd-bb8c-7ba8424ac03d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:54.081889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6b23969-5fe0-4ecd-bb8c-7ba8424ac03d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:54.190238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3f7df975-69ca-4d3c-b0ec-22048a42edc0 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:54.204510 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3f7df975-69ca-4d3c-b0ec-22048a42edc0 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e" status: 200 len: 1386 microversion: 2.1 time: 0.550407 Sep 07 12:28:54.211619 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 58/135] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:53 2022] GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e => generated 1386 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:28:54.220674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4419db1a-6efb-4d08-a466-5ee00c7bd641 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:54.221954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4419db1a-6efb-4d08-a466-5ee00c7bd641 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:54.222215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d6b23969-5fe0-4ecd-bb8c-7ba8424ac03d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:54.232831 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4419db1a-6efb-4d08-a466-5ee00c7bd641 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:54.233920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4419db1a-6efb-4d08-a466-5ee00c7bd641 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:54.234134 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d6b23969-5fe0-4ecd-bb8c-7ba8424ac03d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1291 microversion: 2.1 time: 0.192085 Sep 07 12:28:54.234724 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 78/136] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:54 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1291 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:54.235158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4419db1a-6efb-4d08-a466-5ee00c7bd641 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:54.236091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4419db1a-6efb-4d08-a466-5ee00c7bd641 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:54.237053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4419db1a-6efb-4d08-a466-5ee00c7bd641 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:54.238051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4419db1a-6efb-4d08-a466-5ee00c7bd641 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:54.408416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f477072b-4a72-4b45-9834-4edb2192b3af tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:54.409031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f477072b-4a72-4b45-9834-4edb2192b3af tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:54.417762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f477072b-4a72-4b45-9834-4edb2192b3af tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:54.430303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f477072b-4a72-4b45-9834-4edb2192b3af tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:54.431047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f477072b-4a72-4b45-9834-4edb2192b3af tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:54.431973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f477072b-4a72-4b45-9834-4edb2192b3af tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:54.432637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f477072b-4a72-4b45-9834-4edb2192b3af tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:54.433266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f477072b-4a72-4b45-9834-4edb2192b3af tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:54.949106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f477072b-4a72-4b45-9834-4edb2192b3af tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:54.970363 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f477072b-4a72-4b45-9834-4edb2192b3af tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1313 microversion: 2.1 time: 0.560806 Sep 07 12:28:54.981519 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 79/137] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:54 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1313 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:28:54.981519 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1a6ff470-4c2a-4d35-94c2-6656824e6c1e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:54.981519 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1a6ff470-4c2a-4d35-94c2-6656824e6c1e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:54.994475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a6ff470-4c2a-4d35-94c2-6656824e6c1e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:54.994949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a6ff470-4c2a-4d35-94c2-6656824e6c1e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:54.995395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a6ff470-4c2a-4d35-94c2-6656824e6c1e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:54.996204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a6ff470-4c2a-4d35-94c2-6656824e6c1e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:55.005434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a6ff470-4c2a-4d35-94c2-6656824e6c1e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:55.005946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a6ff470-4c2a-4d35-94c2-6656824e6c1e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:55.483733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1a6ff470-4c2a-4d35-94c2-6656824e6c1e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:55.496511 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1a6ff470-4c2a-4d35-94c2-6656824e6c1e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac" status: 200 len: 1320 microversion: 2.1 time: 0.523626 Sep 07 12:28:55.499848 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 80/138] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:54 2022] GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac => generated 1320 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:55.508591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4c8b79f3-0e37-4ff2-9488-6a24477e83ea tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:55.509437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4c8b79f3-0e37-4ff2-9488-6a24477e83ea tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 79881389-e6f0-43f3-96c3-fdb045bb956e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:55.517025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c8b79f3-0e37-4ff2-9488-6a24477e83ea tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:55.518782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c8b79f3-0e37-4ff2-9488-6a24477e83ea tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:55.519417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c8b79f3-0e37-4ff2-9488-6a24477e83ea tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:55.520315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c8b79f3-0e37-4ff2-9488-6a24477e83ea tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:55.521817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c8b79f3-0e37-4ff2-9488-6a24477e83ea tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:55.522516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c8b79f3-0e37-4ff2-9488-6a24477e83ea tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:55.782401 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4419db1a-6efb-4d08-a466-5ee00c7bd641 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 200 len: 1640 microversion: 2.1 time: 1.557942 Sep 07 12:28:55.783678 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 59/139] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:54 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 1640 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:55.807411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ed2b1dfb-d381-4d4f-b3c2-c7da2d6c4b93 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:55.811999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ed2b1dfb-d381-4d4f-b3c2-c7da2d6c4b93 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:55.827844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed2b1dfb-d381-4d4f-b3c2-c7da2d6c4b93 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:55.830192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed2b1dfb-d381-4d4f-b3c2-c7da2d6c4b93 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:55.833985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed2b1dfb-d381-4d4f-b3c2-c7da2d6c4b93 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:55.835211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed2b1dfb-d381-4d4f-b3c2-c7da2d6c4b93 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:55.836024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed2b1dfb-d381-4d4f-b3c2-c7da2d6c4b93 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:55.837144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed2b1dfb-d381-4d4f-b3c2-c7da2d6c4b93 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:56.517932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4c8b79f3-0e37-4ff2-9488-6a24477e83ea tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:56.538315 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4c8b79f3-0e37-4ff2-9488-6a24477e83ea tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e" status: 200 len: 1386 microversion: 2.1 time: 1.036904 Sep 07 12:28:56.539654 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 81/140] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:55 2022] GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e => generated 1386 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:56.569954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9295813a-90a5-48c3-9dfd-e0a54ea9ca30 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:56.570449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9295813a-90a5-48c3-9dfd-e0a54ea9ca30 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:56.579420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9295813a-90a5-48c3-9dfd-e0a54ea9ca30 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:56.580286 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9295813a-90a5-48c3-9dfd-e0a54ea9ca30 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:56.581425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9295813a-90a5-48c3-9dfd-e0a54ea9ca30 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:56.582541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9295813a-90a5-48c3-9dfd-e0a54ea9ca30 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:56.583168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9295813a-90a5-48c3-9dfd-e0a54ea9ca30 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:56.583798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9295813a-90a5-48c3-9dfd-e0a54ea9ca30 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:56.618245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9295813a-90a5-48c3-9dfd-e0a54ea9ca30 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:28:56.807445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ed2b1dfb-d381-4d4f-b3c2-c7da2d6c4b93 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:56.821584 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ed2b1dfb-d381-4d4f-b3c2-c7da2d6c4b93 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1333 microversion: 2.1 time: 1.034444 Sep 07 12:28:56.823902 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 60/141] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:55 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1333 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:56.844299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-082e297f-ca60-4ae3-b22d-4ecf5fd6dee2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:56.848739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-082e297f-ca60-4ae3-b22d-4ecf5fd6dee2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:56.866504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-082e297f-ca60-4ae3-b22d-4ecf5fd6dee2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:56.867043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-082e297f-ca60-4ae3-b22d-4ecf5fd6dee2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:56.869248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-082e297f-ca60-4ae3-b22d-4ecf5fd6dee2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:56.872254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-082e297f-ca60-4ae3-b22d-4ecf5fd6dee2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:56.873903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-082e297f-ca60-4ae3-b22d-4ecf5fd6dee2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:56.874369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-082e297f-ca60-4ae3-b22d-4ecf5fd6dee2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:57.118482 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9295813a-90a5-48c3-9dfd-e0a54ea9ca30 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "DELETE /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 204 len: 0 microversion: 2.1 time: 0.559385 Sep 07 12:28:57.121637 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 82/142] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:28:56 2022] DELETE /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 0 bytes in 581 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:28:57.203752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e3492b9a-ad38-468b-a80e-13e9846b7e31 req-c4a9fc34-d365-4c1e-a0ea-a64bd80a9c5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79881389-e6f0-43f3-96c3-fdb045bb956e", "tag": "8a3023e7-a1f3-4157-96e9-c1135a576d1c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:57.217723 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e3492b9a-ad38-468b-a80e-13e9846b7e31 req-c4a9fc34-d365-4c1e-a0ea-a64bd80a9c5b service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:57.218352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e3492b9a-ad38-468b-a80e-13e9846b7e31 req-c4a9fc34-d365-4c1e-a0ea-a64bd80a9c5b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:57.219450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e3492b9a-ad38-468b-a80e-13e9846b7e31 req-c4a9fc34-d365-4c1e-a0ea-a64bd80a9c5b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:57.237427 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e3492b9a-ad38-468b-a80e-13e9846b7e31 req-c4a9fc34-d365-4c1e-a0ea-a64bd80a9c5b service nova] Creating event network-changed:8a3023e7-a1f3-4157-96e9-c1135a576d1c for instance 79881389-e6f0-43f3-96c3-fdb045bb956e on n-h2-852087-9 Sep 07 12:28:57.246434 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e3492b9a-ad38-468b-a80e-13e9846b7e31 req-c4a9fc34-d365-4c1e-a0ea-a64bd80a9c5b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122203 Sep 07 12:28:57.251911 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 83/143] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:57.265931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d660fb06-3ce1-4c38-a928-228dbed075b9 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:57.267101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d660fb06-3ce1-4c38-a928-228dbed075b9 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:57.276209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d660fb06-3ce1-4c38-a928-228dbed075b9 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:57.276922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d660fb06-3ce1-4c38-a928-228dbed075b9 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:57.278389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d660fb06-3ce1-4c38-a928-228dbed075b9 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:57.279999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d660fb06-3ce1-4c38-a928-228dbed075b9 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:57.280777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d660fb06-3ce1-4c38-a928-228dbed075b9 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:57.281350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d660fb06-3ce1-4c38-a928-228dbed075b9 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:57.301046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-082e297f-ca60-4ae3-b22d-4ecf5fd6dee2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:57.310723 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-082e297f-ca60-4ae3-b22d-4ecf5fd6dee2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1313 microversion: 2.1 time: 0.485356 Sep 07 12:28:57.311337 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 61/144] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:56 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1313 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:57.320724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-18045464-aede-4275-8d8f-5b283316afbd tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:57.321352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-18045464-aede-4275-8d8f-5b283316afbd tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:57.338387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18045464-aede-4275-8d8f-5b283316afbd tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:57.338892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18045464-aede-4275-8d8f-5b283316afbd tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:57.339531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18045464-aede-4275-8d8f-5b283316afbd tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:57.340403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18045464-aede-4275-8d8f-5b283316afbd tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:57.340868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18045464-aede-4275-8d8f-5b283316afbd tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:57.341297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18045464-aede-4275-8d8f-5b283316afbd tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:57.708350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d660fb06-3ce1-4c38-a928-228dbed075b9 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:57.725983 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d660fb06-3ce1-4c38-a928-228dbed075b9 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac" status: 200 len: 1320 microversion: 2.1 time: 0.471786 Sep 07 12:28:57.733515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-18045464-aede-4275-8d8f-5b283316afbd tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5151bb757514a6392a0d93f2bbfe406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71cb3cbb2ee4a9dbfcd16759a74b093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:57.761568 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 84/145] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:57 2022] GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac => generated 1320 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:57.771640 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-18045464-aede-4275-8d8f-5b283316afbd tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 200 len: 1495 microversion: 2.1 time: 0.457446 Sep 07 12:28:57.772682 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 62/146] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:57 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 1495 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:57.775796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-894156aa-a0c4-45de-93b6-6e8b9a093b3d tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:57.776809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-894156aa-a0c4-45de-93b6-6e8b9a093b3d tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 79881389-e6f0-43f3-96c3-fdb045bb956e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:57.784989 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:28:57.787694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-894156aa-a0c4-45de-93b6-6e8b9a093b3d tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:57.788456 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-894156aa-a0c4-45de-93b6-6e8b9a093b3d tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:57.789212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-894156aa-a0c4-45de-93b6-6e8b9a093b3d tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:57.791523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-894156aa-a0c4-45de-93b6-6e8b9a093b3d tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:57.792241 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-894156aa-a0c4-45de-93b6-6e8b9a093b3d tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:57.793125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-894156aa-a0c4-45de-93b6-6e8b9a093b3d tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:57.808220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:28:57.856791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-702ee9d8-d1db-4a6c-8d79-5ece067dd8d2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:57.857715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-702ee9d8-d1db-4a6c-8d79-5ece067dd8d2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:57.864412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-702ee9d8-d1db-4a6c-8d79-5ece067dd8d2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:57.864928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-702ee9d8-d1db-4a6c-8d79-5ece067dd8d2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:57.865372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-702ee9d8-d1db-4a6c-8d79-5ece067dd8d2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:57.866108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-702ee9d8-d1db-4a6c-8d79-5ece067dd8d2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:57.867083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-702ee9d8-d1db-4a6c-8d79-5ece067dd8d2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:57.868012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-702ee9d8-d1db-4a6c-8d79-5ece067dd8d2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:58.096077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-894156aa-a0c4-45de-93b6-6e8b9a093b3d tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:58.103936 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-894156aa-a0c4-45de-93b6-6e8b9a093b3d tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e" status: 200 len: 1386 microversion: 2.1 time: 0.337310 Sep 07 12:28:58.104497 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 85/147] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:57 2022] GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e => generated 1386 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:58.108773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-702ee9d8-d1db-4a6c-8d79-5ece067dd8d2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:58.109584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-f93eebc3-2870-42fa-84ed-d7fb543ca06f req-d045772c-714a-4385-b38a-e691a9b15adc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5516035a-001e-4d31-84cc-84bca52e7b1e", "tag": "f6af2e88-520d-49f5-bc3a-8bccb5d1a54b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:58.120427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f93eebc3-2870-42fa-84ed-d7fb543ca06f req-d045772c-714a-4385-b38a-e691a9b15adc service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:58.120427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f93eebc3-2870-42fa-84ed-d7fb543ca06f req-d045772c-714a-4385-b38a-e691a9b15adc service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:58.120848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f93eebc3-2870-42fa-84ed-d7fb543ca06f req-d045772c-714a-4385-b38a-e691a9b15adc service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:58.131393 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-702ee9d8-d1db-4a6c-8d79-5ece067dd8d2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1333 microversion: 2.1 time: 0.277834 Sep 07 12:28:58.132699 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-f93eebc3-2870-42fa-84ed-d7fb543ca06f req-d045772c-714a-4385-b38a-e691a9b15adc service nova] Creating event network-changed:f6af2e88-520d-49f5-bc3a-8bccb5d1a54b for instance 5516035a-001e-4d31-84cc-84bca52e7b1e on n-h1-852087-9 Sep 07 12:28:58.134369 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 63/148] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:57 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1333 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:58.147650 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-f93eebc3-2870-42fa-84ed-d7fb543ca06f req-d045772c-714a-4385-b38a-e691a9b15adc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041773 Sep 07 12:28:58.148704 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 86/149] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:28:58.342197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8bdaeca4-9e43-42ae-aff9-126dd3580a01 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:58.342891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8bdaeca4-9e43-42ae-aff9-126dd3580a01 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:58.349043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bdaeca4-9e43-42ae-aff9-126dd3580a01 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:58.349577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bdaeca4-9e43-42ae-aff9-126dd3580a01 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:58.350031 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bdaeca4-9e43-42ae-aff9-126dd3580a01 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:58.351380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bdaeca4-9e43-42ae-aff9-126dd3580a01 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:58.351380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bdaeca4-9e43-42ae-aff9-126dd3580a01 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:58.351614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bdaeca4-9e43-42ae-aff9-126dd3580a01 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:58.552330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d23f1a7f-faa6-4003-8d96-d0bc40db5471 req-8ef7a31d-da22-46c9-9f85-2d9d80c0801d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac", "name": "network-vif-plugged", "status": "completed", "tag": "5bf2653b-1fbc-4aec-bcac-f5564ffe6b01"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:28:58.573332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d23f1a7f-faa6-4003-8d96-d0bc40db5471 req-8ef7a31d-da22-46c9-9f85-2d9d80c0801d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:58.574157 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d23f1a7f-faa6-4003-8d96-d0bc40db5471 req-8ef7a31d-da22-46c9-9f85-2d9d80c0801d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:58.574723 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d23f1a7f-faa6-4003-8d96-d0bc40db5471 req-8ef7a31d-da22-46c9-9f85-2d9d80c0801d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:58.598829 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d23f1a7f-faa6-4003-8d96-d0bc40db5471 req-8ef7a31d-da22-46c9-9f85-2d9d80c0801d service nova] Creating event network-vif-plugged:5bf2653b-1fbc-4aec-bcac-f5564ffe6b01 for instance 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac on n-h2-852087-9 Sep 07 12:28:58.603802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8bdaeca4-9e43-42ae-aff9-126dd3580a01 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:58.612580 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d23f1a7f-faa6-4003-8d96-d0bc40db5471 req-8ef7a31d-da22-46c9-9f85-2d9d80c0801d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064706 Sep 07 12:28:58.613528 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 87/150] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:28:58.614459 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8bdaeca4-9e43-42ae-aff9-126dd3580a01 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1313 microversion: 2.1 time: 0.276356 Sep 07 12:28:58.615049 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 64/151] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:58 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:58.774317 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-178a62d1-7cab-4851-a3bc-15898c78c8ea tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:58.775615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-178a62d1-7cab-4851-a3bc-15898c78c8ea tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:58.799882 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c0044fea-3cae-481b-9b26-38d69d01bc9d tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:58.804684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c0044fea-3cae-481b-9b26-38d69d01bc9d tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:58.813902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-178a62d1-7cab-4851-a3bc-15898c78c8ea tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:58.814484 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-178a62d1-7cab-4851-a3bc-15898c78c8ea tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:58.814976 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-178a62d1-7cab-4851-a3bc-15898c78c8ea tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:58.822530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0044fea-3cae-481b-9b26-38d69d01bc9d tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:58.823040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0044fea-3cae-481b-9b26-38d69d01bc9d tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:58.823483 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0044fea-3cae-481b-9b26-38d69d01bc9d tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:58.824291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0044fea-3cae-481b-9b26-38d69d01bc9d tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:58.826024 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-178a62d1-7cab-4851-a3bc-15898c78c8ea tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:58.826599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-178a62d1-7cab-4851-a3bc-15898c78c8ea tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:58.827527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-178a62d1-7cab-4851-a3bc-15898c78c8ea tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:58.829641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0044fea-3cae-481b-9b26-38d69d01bc9d tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:58.830157 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0044fea-3cae-481b-9b26-38d69d01bc9d tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:59.282353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-178a62d1-7cab-4851-a3bc-15898c78c8ea tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:59.288860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c0044fea-3cae-481b-9b26-38d69d01bc9d tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5151bb757514a6392a0d93f2bbfe406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71cb3cbb2ee4a9dbfcd16759a74b093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:28:59.295407 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-178a62d1-7cab-4851-a3bc-15898c78c8ea tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac" status: 200 len: 1320 microversion: 2.1 time: 0.527607 Sep 07 12:28:59.296003 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 88/152] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:58 2022] GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac => generated 1320 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:59.301042 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c0044fea-3cae-481b-9b26-38d69d01bc9d tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 200 len: 1495 microversion: 2.1 time: 0.507846 Sep 07 12:28:59.302021 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 65/153] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:58 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 1495 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:28:59.308531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-afcb36f7-a682-44b8-b6f9-29f7ec2e5623 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:59.309570 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-afcb36f7-a682-44b8-b6f9-29f7ec2e5623 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:59.320873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-afcb36f7-a682-44b8-b6f9-29f7ec2e5623 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:59.323394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-afcb36f7-a682-44b8-b6f9-29f7ec2e5623 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:59.324040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-afcb36f7-a682-44b8-b6f9-29f7ec2e5623 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:59.325600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b1d51e76-f29c-4dd5-addd-7bff0378a80f tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:28:59.326226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b1d51e76-f29c-4dd5-addd-7bff0378a80f tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 79881389-e6f0-43f3-96c3-fdb045bb956e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:28:59.326719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-afcb36f7-a682-44b8-b6f9-29f7ec2e5623 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:59.329125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-afcb36f7-a682-44b8-b6f9-29f7ec2e5623 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:59.330968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-afcb36f7-a682-44b8-b6f9-29f7ec2e5623 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:59.339222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:28:59.339472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1d51e76-f29c-4dd5-addd-7bff0378a80f tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:59.340008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1d51e76-f29c-4dd5-addd-7bff0378a80f tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:59.340255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1d51e76-f29c-4dd5-addd-7bff0378a80f tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:59.341202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1d51e76-f29c-4dd5-addd-7bff0378a80f tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:28:59.341416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1d51e76-f29c-4dd5-addd-7bff0378a80f tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:28:59.345424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1d51e76-f29c-4dd5-addd-7bff0378a80f tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:28:59.842837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:00.034449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-afcb36f7-a682-44b8-b6f9-29f7ec2e5623 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:00.049805 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-afcb36f7-a682-44b8-b6f9-29f7ec2e5623 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1333 microversion: 2.1 time: 0.746407 Sep 07 12:29:00.067486 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 66/154] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:59 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1333 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:00.073212 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-6f1f6cdb-a570-496e-ab92-25089257b5d0 req-30bbab95-efaa-4d13-adfd-8bba6a1b3244 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc8c1c2b-eb55-4361-bcd7-e66c270b827a", "tag": "1e24dd2e-9faf-4586-ae6b-48d1499917fe"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:00.086928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6f1f6cdb-a570-496e-ab92-25089257b5d0 req-30bbab95-efaa-4d13-adfd-8bba6a1b3244 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:00.087410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6f1f6cdb-a570-496e-ab92-25089257b5d0 req-30bbab95-efaa-4d13-adfd-8bba6a1b3244 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:00.091327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6f1f6cdb-a570-496e-ab92-25089257b5d0 req-30bbab95-efaa-4d13-adfd-8bba6a1b3244 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:00.104141 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-6f1f6cdb-a570-496e-ab92-25089257b5d0 req-30bbab95-efaa-4d13-adfd-8bba6a1b3244 service nova] Creating event network-changed:1e24dd2e-9faf-4586-ae6b-48d1499917fe for instance fc8c1c2b-eb55-4361-bcd7-e66c270b827a on n-h2-852087-9 Sep 07 12:29:00.109712 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-6f1f6cdb-a570-496e-ab92-25089257b5d0 req-30bbab95-efaa-4d13-adfd-8bba6a1b3244 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040696 Sep 07 12:29:00.111347 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 67/155] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:00.121709 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-51323af0-8d48-4518-bd27-b8d4c7860bad tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:00.122175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b1d51e76-f29c-4dd5-addd-7bff0378a80f tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:00.122633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-51323af0-8d48-4518-bd27-b8d4c7860bad tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:00.131049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51323af0-8d48-4518-bd27-b8d4c7860bad tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:00.131546 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51323af0-8d48-4518-bd27-b8d4c7860bad tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:00.131983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51323af0-8d48-4518-bd27-b8d4c7860bad tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:00.132687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51323af0-8d48-4518-bd27-b8d4c7860bad tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:00.133143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51323af0-8d48-4518-bd27-b8d4c7860bad tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:00.133294 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b1d51e76-f29c-4dd5-addd-7bff0378a80f tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e" status: 200 len: 1386 microversion: 2.1 time: 0.819943 Sep 07 12:29:00.135665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51323af0-8d48-4518-bd27-b8d4c7860bad tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:00.142285 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 89/156] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:28:59 2022] GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e => generated 1386 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:00.325646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b2ceb81-95da-477f-acd2-5d6a07392733 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:00.326499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2b2ceb81-95da-477f-acd2-5d6a07392733 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:00.339365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b2ceb81-95da-477f-acd2-5d6a07392733 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:00.339871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b2ceb81-95da-477f-acd2-5d6a07392733 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:00.340311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b2ceb81-95da-477f-acd2-5d6a07392733 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:00.341034 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b2ceb81-95da-477f-acd2-5d6a07392733 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:00.341524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b2ceb81-95da-477f-acd2-5d6a07392733 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:00.341966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b2ceb81-95da-477f-acd2-5d6a07392733 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:00.490399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:00.503368 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-51323af0-8d48-4518-bd27-b8d4c7860bad tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:00.514212 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-51323af0-8d48-4518-bd27-b8d4c7860bad tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1313 microversion: 2.1 time: 0.398927 Sep 07 12:29:00.524768 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 68/157] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:00 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1313 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:00.543103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3d882fa3-f6cc-445f-9e09-d37698e9a0fd tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:00.543807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3d882fa3-f6cc-445f-9e09-d37698e9a0fd tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:00.598761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d882fa3-f6cc-445f-9e09-d37698e9a0fd tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:00.599278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d882fa3-f6cc-445f-9e09-d37698e9a0fd tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:00.599724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d882fa3-f6cc-445f-9e09-d37698e9a0fd tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:00.600455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d882fa3-f6cc-445f-9e09-d37698e9a0fd tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:00.600914 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d882fa3-f6cc-445f-9e09-d37698e9a0fd tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:00.601602 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d882fa3-f6cc-445f-9e09-d37698e9a0fd tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:00.797244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2b2ceb81-95da-477f-acd2-5d6a07392733 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:00.811039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3d882fa3-f6cc-445f-9e09-d37698e9a0fd tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5151bb757514a6392a0d93f2bbfe406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71cb3cbb2ee4a9dbfcd16759a74b093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:00.816966 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2b2ceb81-95da-477f-acd2-5d6a07392733 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac" status: 200 len: 1320 microversion: 2.1 time: 0.495305 Sep 07 12:29:00.822139 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3d882fa3-f6cc-445f-9e09-d37698e9a0fd tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 200 len: 1453 microversion: 2.1 time: 0.295115 Sep 07 12:29:00.822735 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 69/158] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:00 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 1453 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:00.837699 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 90/159] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:00 2022] GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac => generated 1320 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:00.847574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-972f462f-932f-44c5-ba09-4a84c18f5008 req-a84adb40-0ab2-42a3-bbf0-88a7f3b2fc5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e7d46f-e8a5-4110-b7f2-05488d1bdb8a", "name": "network-vif-deleted", "tag": "6627c9a2-eaaf-4625-a051-a3236290ade7"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:00.869411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-972f462f-932f-44c5-ba09-4a84c18f5008 req-a84adb40-0ab2-42a3-bbf0-88a7f3b2fc5a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:00.872114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-972f462f-932f-44c5-ba09-4a84c18f5008 req-a84adb40-0ab2-42a3-bbf0-88a7f3b2fc5a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:00.872764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-972f462f-932f-44c5-ba09-4a84c18f5008 req-a84adb40-0ab2-42a3-bbf0-88a7f3b2fc5a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:00.908634 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-972f462f-932f-44c5-ba09-4a84c18f5008 req-a84adb40-0ab2-42a3-bbf0-88a7f3b2fc5a service nova] Creating event network-vif-deleted:6627c9a2-eaaf-4625-a051-a3236290ade7 for instance 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a on n-h1-852087-9 Sep 07 12:29:00.913815 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-972f462f-932f-44c5-ba09-4a84c18f5008 req-a84adb40-0ab2-42a3-bbf0-88a7f3b2fc5a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074574 Sep 07 12:29:00.914473 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 70/160] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:01.072288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d2b6e18a-a176-4b02-bfa2-fbab1eb2a557 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:01.072914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d2b6e18a-a176-4b02-bfa2-fbab1eb2a557 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:01.075971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:01.079831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2b6e18a-a176-4b02-bfa2-fbab1eb2a557 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:01.080334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2b6e18a-a176-4b02-bfa2-fbab1eb2a557 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:01.081144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2b6e18a-a176-4b02-bfa2-fbab1eb2a557 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:01.082082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2b6e18a-a176-4b02-bfa2-fbab1eb2a557 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:01.082711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2b6e18a-a176-4b02-bfa2-fbab1eb2a557 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:01.083283 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2b6e18a-a176-4b02-bfa2-fbab1eb2a557 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:01.165122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-25f8cbb0-9029-43bb-9d91-c3a7d62d3f32 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:01.165986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-25f8cbb0-9029-43bb-9d91-c3a7d62d3f32 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 79881389-e6f0-43f3-96c3-fdb045bb956e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:01.172587 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25f8cbb0-9029-43bb-9d91-c3a7d62d3f32 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:01.173263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25f8cbb0-9029-43bb-9d91-c3a7d62d3f32 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:01.173751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25f8cbb0-9029-43bb-9d91-c3a7d62d3f32 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:01.174445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25f8cbb0-9029-43bb-9d91-c3a7d62d3f32 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:01.174894 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25f8cbb0-9029-43bb-9d91-c3a7d62d3f32 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:01.175315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25f8cbb0-9029-43bb-9d91-c3a7d62d3f32 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:01.411612 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d2b6e18a-a176-4b02-bfa2-fbab1eb2a557 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:01.418826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-25f8cbb0-9029-43bb-9d91-c3a7d62d3f32 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:01.420755 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d2b6e18a-a176-4b02-bfa2-fbab1eb2a557 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1333 microversion: 2.1 time: 0.352261 Sep 07 12:29:01.422428 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 91/161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:01 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1333 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:01.447285 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-25f8cbb0-9029-43bb-9d91-c3a7d62d3f32 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e" status: 200 len: 1386 microversion: 2.1 time: 0.286377 Sep 07 12:29:01.448232 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 71/162] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:01 2022] GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e => generated 1386 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:01.547718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f80a8be2-51e8-422d-894c-e469d4bc12b7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:01.548322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f80a8be2-51e8-422d-894c-e469d4bc12b7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:01.556471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f80a8be2-51e8-422d-894c-e469d4bc12b7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:01.560726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f80a8be2-51e8-422d-894c-e469d4bc12b7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:01.562929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f80a8be2-51e8-422d-894c-e469d4bc12b7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:01.564265 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f80a8be2-51e8-422d-894c-e469d4bc12b7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:01.565823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f80a8be2-51e8-422d-894c-e469d4bc12b7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:01.566906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f80a8be2-51e8-422d-894c-e469d4bc12b7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:01.846364 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2a067e5c-a3b5-4312-aef7-d3b97b2d0bf2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:01.848528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2a067e5c-a3b5-4312-aef7-d3b97b2d0bf2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:01.861785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a067e5c-a3b5-4312-aef7-d3b97b2d0bf2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:01.862638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a067e5c-a3b5-4312-aef7-d3b97b2d0bf2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:01.863204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a067e5c-a3b5-4312-aef7-d3b97b2d0bf2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:01.865080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a067e5c-a3b5-4312-aef7-d3b97b2d0bf2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:01.865080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a067e5c-a3b5-4312-aef7-d3b97b2d0bf2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:01.866339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a067e5c-a3b5-4312-aef7-d3b97b2d0bf2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:02.070239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f80a8be2-51e8-422d-894c-e469d4bc12b7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:02.078360 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f80a8be2-51e8-422d-894c-e469d4bc12b7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1313 microversion: 2.1 time: 0.534351 Sep 07 12:29:02.084753 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 92/163] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:01 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1313 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:02.090961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4e5defab-4ec8-4584-9af2-bc779e179d98 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:02.091982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4e5defab-4ec8-4584-9af2-bc779e179d98 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:02.105938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e5defab-4ec8-4584-9af2-bc779e179d98 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:02.106273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e5defab-4ec8-4584-9af2-bc779e179d98 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:02.106837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e5defab-4ec8-4584-9af2-bc779e179d98 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:02.107608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e5defab-4ec8-4584-9af2-bc779e179d98 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:02.108096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e5defab-4ec8-4584-9af2-bc779e179d98 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:02.108607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e5defab-4ec8-4584-9af2-bc779e179d98 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:02.139079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2a067e5c-a3b5-4312-aef7-d3b97b2d0bf2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:02.143584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e5defab-4ec8-4584-9af2-bc779e179d98 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:02.144050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e5defab-4ec8-4584-9af2-bc779e179d98 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:02.144474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e5defab-4ec8-4584-9af2-bc779e179d98 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:02.145088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-4e5defab-4ec8-4584-9af2-bc779e179d98 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lazy-loading 'fault' on Instance uuid 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:29:02.147684 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2a067e5c-a3b5-4312-aef7-d3b97b2d0bf2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac" status: 200 len: 1320 microversion: 2.1 time: 0.308868 Sep 07 12:29:02.148555 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 72/164] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:01 2022] GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac => generated 1320 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:29:02.428236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4e5defab-4ec8-4584-9af2-bc779e179d98 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5151bb757514a6392a0d93f2bbfe406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71cb3cbb2ee4a9dbfcd16759a74b093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:02.439030 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4e5defab-4ec8-4584-9af2-bc779e179d98 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 200 len: 1329 microversion: 2.1 time: 0.352184 Sep 07 12:29:02.440648 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 93/165] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:02 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 1329 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:02.446271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-efb9abd0-b1a1-49f0-8f11-adf0af6301d7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:02.447364 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-efb9abd0-b1a1-49f0-8f11-adf0af6301d7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:02.456186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efb9abd0-b1a1-49f0-8f11-adf0af6301d7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:02.456685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efb9abd0-b1a1-49f0-8f11-adf0af6301d7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:02.457386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efb9abd0-b1a1-49f0-8f11-adf0af6301d7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:02.458197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efb9abd0-b1a1-49f0-8f11-adf0af6301d7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:02.458775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efb9abd0-b1a1-49f0-8f11-adf0af6301d7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:02.459627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efb9abd0-b1a1-49f0-8f11-adf0af6301d7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:02.474234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-91453443-55c9-4cf4-b8c5-a75d24a29fad tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:02.475398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-91453443-55c9-4cf4-b8c5-a75d24a29fad tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 79881389-e6f0-43f3-96c3-fdb045bb956e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:02.482931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91453443-55c9-4cf4-b8c5-a75d24a29fad tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:02.484281 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91453443-55c9-4cf4-b8c5-a75d24a29fad tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:02.485054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91453443-55c9-4cf4-b8c5-a75d24a29fad tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:02.485991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91453443-55c9-4cf4-b8c5-a75d24a29fad tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:02.486911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91453443-55c9-4cf4-b8c5-a75d24a29fad tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:02.487630 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91453443-55c9-4cf4-b8c5-a75d24a29fad tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:02.932038 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-91453443-55c9-4cf4-b8c5-a75d24a29fad tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:02.940883 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-91453443-55c9-4cf4-b8c5-a75d24a29fad tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e" status: 200 len: 1386 microversion: 2.1 time: 0.471916 Sep 07 12:29:02.941923 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 94/166] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:02 2022] GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e => generated 1386 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:29:02.944966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-efb9abd0-b1a1-49f0-8f11-adf0af6301d7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:02.948920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-2d2d46e4-4a8f-4761-8ab5-5ee6ee3491e0 req-2434ff03-0935-4aa4-a913-c5218a8d64e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79881389-e6f0-43f3-96c3-fdb045bb956e", "name": "network-vif-plugged", "status": "completed", "tag": "8a3023e7-a1f3-4157-96e9-c1135a576d1c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:02.966105 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-efb9abd0-b1a1-49f0-8f11-adf0af6301d7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1333 microversion: 2.1 time: 0.525007 Sep 07 12:29:02.976596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2d2d46e4-4a8f-4761-8ab5-5ee6ee3491e0 req-2434ff03-0935-4aa4-a913-c5218a8d64e7 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:02.978562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2d2d46e4-4a8f-4761-8ab5-5ee6ee3491e0 req-2434ff03-0935-4aa4-a913-c5218a8d64e7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:02.980112 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 73/167] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:02 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1333 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:02.980758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2d2d46e4-4a8f-4761-8ab5-5ee6ee3491e0 req-2434ff03-0935-4aa4-a913-c5218a8d64e7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:03.007622 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-2d2d46e4-4a8f-4761-8ab5-5ee6ee3491e0 req-2434ff03-0935-4aa4-a913-c5218a8d64e7 service nova] Creating event network-vif-plugged:8a3023e7-a1f3-4157-96e9-c1135a576d1c for instance 79881389-e6f0-43f3-96c3-fdb045bb956e on n-h2-852087-9 Sep 07 12:29:03.014062 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-2d2d46e4-4a8f-4761-8ab5-5ee6ee3491e0 req-2434ff03-0935-4aa4-a913-c5218a8d64e7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070246 Sep 07 12:29:03.015093 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 95/168] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:03.103628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0835f7b3-3271-4412-b037-83dfaeb189d9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:03.104399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0835f7b3-3271-4412-b037-83dfaeb189d9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:03.113867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0835f7b3-3271-4412-b037-83dfaeb189d9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:03.114466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0835f7b3-3271-4412-b037-83dfaeb189d9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:03.115049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0835f7b3-3271-4412-b037-83dfaeb189d9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:03.116025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0835f7b3-3271-4412-b037-83dfaeb189d9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:03.116588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0835f7b3-3271-4412-b037-83dfaeb189d9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:03.117212 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0835f7b3-3271-4412-b037-83dfaeb189d9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:03.171257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e43686c5-68b6-4a33-a79e-9fc477f896ed tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:03.171989 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e43686c5-68b6-4a33-a79e-9fc477f896ed tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:03.179071 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e43686c5-68b6-4a33-a79e-9fc477f896ed tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:03.180298 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e43686c5-68b6-4a33-a79e-9fc477f896ed tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:03.180749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e43686c5-68b6-4a33-a79e-9fc477f896ed tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:03.181451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e43686c5-68b6-4a33-a79e-9fc477f896ed tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:03.181942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e43686c5-68b6-4a33-a79e-9fc477f896ed tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:03.182420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e43686c5-68b6-4a33-a79e-9fc477f896ed tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:03.641191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0835f7b3-3271-4412-b037-83dfaeb189d9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:03.649460 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0835f7b3-3271-4412-b037-83dfaeb189d9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1313 microversion: 2.1 time: 0.550500 Sep 07 12:29:03.654436 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 74/169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:03 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1313 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:03.660779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-34d20e29-808c-43c6-b45f-85f23674ec0f tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:03.663507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-34d20e29-808c-43c6-b45f-85f23674ec0f tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:03.676653 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e43686c5-68b6-4a33-a79e-9fc477f896ed tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:03.680253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34d20e29-808c-43c6-b45f-85f23674ec0f tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:03.680947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34d20e29-808c-43c6-b45f-85f23674ec0f tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:03.681688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34d20e29-808c-43c6-b45f-85f23674ec0f tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:03.688226 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e43686c5-68b6-4a33-a79e-9fc477f896ed tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac" status: 200 len: 1469 microversion: 2.1 time: 0.520902 Sep 07 12:29:03.688806 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 96/170] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:03 2022] GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac => generated 1469 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:03.690462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34d20e29-808c-43c6-b45f-85f23674ec0f tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:03.690979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34d20e29-808c-43c6-b45f-85f23674ec0f tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:03.691477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34d20e29-808c-43c6-b45f-85f23674ec0f tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:03.739077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34d20e29-808c-43c6-b45f-85f23674ec0f tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:03.739948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34d20e29-808c-43c6-b45f-85f23674ec0f tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:03.741460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34d20e29-808c-43c6-b45f-85f23674ec0f tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:03.743231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-34d20e29-808c-43c6-b45f-85f23674ec0f tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lazy-loading 'fault' on Instance uuid 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:29:03.850583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a6bc8c77-19e5-4357-b663-3bec9a710b52 tempest-DeleteServersAdminTestJSON-1528815157 tempest-DeleteServersAdminTestJSON-1528815157-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:03.851295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a6bc8c77-19e5-4357-b663-3bec9a710b52 tempest-DeleteServersAdminTestJSON-1528815157 tempest-DeleteServersAdminTestJSON-1528815157-project-admin] [instance: 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:03.858591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6bc8c77-19e5-4357-b663-3bec9a710b52 tempest-DeleteServersAdminTestJSON-1528815157 tempest-DeleteServersAdminTestJSON-1528815157-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:03.859548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6bc8c77-19e5-4357-b663-3bec9a710b52 tempest-DeleteServersAdminTestJSON-1528815157 tempest-DeleteServersAdminTestJSON-1528815157-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:03.862065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6bc8c77-19e5-4357-b663-3bec9a710b52 tempest-DeleteServersAdminTestJSON-1528815157 tempest-DeleteServersAdminTestJSON-1528815157-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:03.862988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6bc8c77-19e5-4357-b663-3bec9a710b52 tempest-DeleteServersAdminTestJSON-1528815157 tempest-DeleteServersAdminTestJSON-1528815157-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:03.863824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6bc8c77-19e5-4357-b663-3bec9a710b52 tempest-DeleteServersAdminTestJSON-1528815157 tempest-DeleteServersAdminTestJSON-1528815157-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:03.864427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6bc8c77-19e5-4357-b663-3bec9a710b52 tempest-DeleteServersAdminTestJSON-1528815157 tempest-DeleteServersAdminTestJSON-1528815157-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:03.872766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-34d20e29-808c-43c6-b45f-85f23674ec0f tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5151bb757514a6392a0d93f2bbfe406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71cb3cbb2ee4a9dbfcd16759a74b093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:03.901739 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-34d20e29-808c-43c6-b45f-85f23674ec0f tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 200 len: 1329 microversion: 2.1 time: 0.245674 Sep 07 12:29:03.915552 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 75/171] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:03 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 1329 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:03.975574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a6bc8c77-19e5-4357-b663-3bec9a710b52 tempest-DeleteServersAdminTestJSON-1528815157 tempest-DeleteServersAdminTestJSON-1528815157-project-admin] [instance: 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:29:03.977571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-76779249-c642-47e8-b996-ffcffb005a23 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:03.978862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-76779249-c642-47e8-b996-ffcffb005a23 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 79881389-e6f0-43f3-96c3-fdb045bb956e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:03.987892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76779249-c642-47e8-b996-ffcffb005a23 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:03.988734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76779249-c642-47e8-b996-ffcffb005a23 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:03.989466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76779249-c642-47e8-b996-ffcffb005a23 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:03.990519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76779249-c642-47e8-b996-ffcffb005a23 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:03.991264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76779249-c642-47e8-b996-ffcffb005a23 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:03.992626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76779249-c642-47e8-b996-ffcffb005a23 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:04.151122 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a6bc8c77-19e5-4357-b663-3bec9a710b52 tempest-DeleteServersAdminTestJSON-1528815157 tempest-DeleteServersAdminTestJSON-1528815157-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac" status: 204 len: 0 microversion: 2.1 time: 0.442489 Sep 07 12:29:04.152193 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 97/172] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:29:03 2022] DELETE /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:29:04.159780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4b97b0b0-4b16-4af5-a4f8-e6e0523573a9 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:04.160512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4b97b0b0-4b16-4af5-a4f8-e6e0523573a9 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:04.168152 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b97b0b0-4b16-4af5-a4f8-e6e0523573a9 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:04.169270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b97b0b0-4b16-4af5-a4f8-e6e0523573a9 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:04.169748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b97b0b0-4b16-4af5-a4f8-e6e0523573a9 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:04.170730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b97b0b0-4b16-4af5-a4f8-e6e0523573a9 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:04.171437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b97b0b0-4b16-4af5-a4f8-e6e0523573a9 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:04.172204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b97b0b0-4b16-4af5-a4f8-e6e0523573a9 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:04.670981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-76779249-c642-47e8-b996-ffcffb005a23 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:04.676162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4b97b0b0-4b16-4af5-a4f8-e6e0523573a9 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:04.679481 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-76779249-c642-47e8-b996-ffcffb005a23 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e" status: 200 len: 1386 microversion: 2.1 time: 0.708736 Sep 07 12:29:04.680288 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 76/173] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:03 2022] GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e => generated 1386 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:04.690675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4544d494-adfb-4055-9f26-edb2b5924964 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:04.690900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4544d494-adfb-4055-9f26-edb2b5924964 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:04.697779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4544d494-adfb-4055-9f26-edb2b5924964 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:04.698651 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4544d494-adfb-4055-9f26-edb2b5924964 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:04.699300 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4544d494-adfb-4055-9f26-edb2b5924964 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:04.700267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4544d494-adfb-4055-9f26-edb2b5924964 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:04.700945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4544d494-adfb-4055-9f26-edb2b5924964 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:04.701614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4544d494-adfb-4055-9f26-edb2b5924964 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:04.709335 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4b97b0b0-4b16-4af5-a4f8-e6e0523573a9 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1333 microversion: 2.1 time: 0.555804 Sep 07 12:29:04.715613 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 98/174] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:04 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1333 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:04.725652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c53f2027-fa14-4662-83ea-525b87e3fcbf tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:04.726520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c53f2027-fa14-4662-83ea-525b87e3fcbf tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:04.742497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c53f2027-fa14-4662-83ea-525b87e3fcbf tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:04.742997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c53f2027-fa14-4662-83ea-525b87e3fcbf tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:04.745919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c53f2027-fa14-4662-83ea-525b87e3fcbf tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:04.746981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c53f2027-fa14-4662-83ea-525b87e3fcbf tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:04.748083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c53f2027-fa14-4662-83ea-525b87e3fcbf tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:04.748763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c53f2027-fa14-4662-83ea-525b87e3fcbf tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:05.096556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4544d494-adfb-4055-9f26-edb2b5924964 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:05.105090 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4544d494-adfb-4055-9f26-edb2b5924964 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac" status: 200 len: 1475 microversion: 2.1 time: 0.423255 Sep 07 12:29:05.116622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c53f2027-fa14-4662-83ea-525b87e3fcbf tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:05.121953 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 77/175] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:04 2022] GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac => generated 1475 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:05.128657 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c53f2027-fa14-4662-83ea-525b87e3fcbf tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1313 microversion: 2.1 time: 0.410049 Sep 07 12:29:05.129796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d2e85720-85cd-42cd-bb37-99b753d05b8b tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:05.129924 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 99/176] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:04 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:05.130786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d2e85720-85cd-42cd-bb37-99b753d05b8b tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:05.137336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2e85720-85cd-42cd-bb37-99b753d05b8b tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:05.138220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2e85720-85cd-42cd-bb37-99b753d05b8b tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:05.138818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2e85720-85cd-42cd-bb37-99b753d05b8b tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:05.139707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2e85720-85cd-42cd-bb37-99b753d05b8b tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:05.140310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2e85720-85cd-42cd-bb37-99b753d05b8b tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:05.140877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2e85720-85cd-42cd-bb37-99b753d05b8b tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:05.176057 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-d2e85720-85cd-42cd-bb37-99b753d05b8b tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] HTTP exception thrown: Instance 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a could not be found. Sep 07 12:29:05.183111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d2e85720-85cd-42cd-bb37-99b753d05b8b tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Request method failure captured: Sep 07 12:29:05.183111 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a HTTP/1.1 Sep 07 12:29:05.183111 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:29:05.183111 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:29:05.183111 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:29:05.183111 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:29:05.183111 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:29:05.183111 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:29:05.183111 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:29:05.183111 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:05.183111 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI5VylYHTMNb8F6stHaGJ7PTJuUvSZWuVfQiVbW1vQgsLkOnyuLRNLc-JP_svvSoXtEUSM31gtIJ9UC5w2MwHGUi8kJH1sQ5uZseoXQjhD9Sg71lxunA1l6ZGixUB2YPveVKiG6BOtHAKTzKtUqSmI9aFIYeD9H1o2ES4ch0ESQbHzQ Sep 07 12:29:05.183111 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:29:05.183111 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:29:05.183111 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:29:05.183111 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:29:05.183111 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:29:05.183111 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:29:05.183111 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: d71cb3cbb2ee4a9dbfcd16759a74b093 Sep 07 12:29:05.183111 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminTestJSON-543211817 Sep 07 12:29:05.183111 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:29:05.183111 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:29:05.184642 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d71cb3cbb2ee4a9dbfcd16759a74b093"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d71cb3cbb2ee4a9dbfcd16759a74b093"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d71cb3cbb2ee4a9dbfcd16759a74b093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d71cb3cbb2ee4a9dbfcd16759a74b093"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:05.184642 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminTestJSON-543211817 Sep 07 12:29:05.184642 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: d71cb3cbb2ee4a9dbfcd16759a74b093 Sep 07 12:29:05.184642 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-543211817 Sep 07 12:29:05.184642 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminTestJSON-543211817-project Sep 07 12:29:05.184642 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:29:05.184642 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:29:05.184642 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: c5151bb757514a6392a0d93f2bbfe406 Sep 07 12:29:05.184642 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminTestJSON-543211817-project Sep 07 12:29:05.184642 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:29:05.184642 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a could not be found. Sep 07 12:29:05.184642 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '57e7d46f-e8a5-4110-b7f2-05488d1bdb8a'} Sep 07 12:29:05.185453 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:05.185453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:05.185453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:29:05.185453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:29:05.185453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:29:05.185453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:29:05.185453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:29:05.185453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:29:05.185453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:29:05.185453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:29:05.185453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a could not be found. Sep 07 12:29:05.185453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:05.185453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:05.185453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:05.185453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:05.185453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:05.185453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:05.185453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:05.185453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:05.185453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:05.186845 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:05.186845 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:29:05.186845 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:29:05.186845 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:29:05.186845 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:29:05.186845 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:29:05.186845 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:29:05.186845 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a could not be found. Sep 07 12:29:05.186845 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:05.186845 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:05.186845 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:05.186845 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:05.186845 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:05.186845 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:05.186845 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:29:05.186845 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:29:05.186845 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a could not be found. Sep 07 12:29:05.186845 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:05.188105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d2e85720-85cd-42cd-bb37-99b753d05b8b tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Returning 404 to user: Instance 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:05.188105 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d2e85720-85cd-42cd-bb37-99b753d05b8b tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 404 len: 111 microversion: 2.1 time: 0.061774 Sep 07 12:29:05.188105 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 78/177] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:05 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:29:05.217528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b54d167b-60b9-4e53-a908-835097494995 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-852087-9"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:05.239372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b54d167b-60b9-4e53-a908-835097494995 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:05.240138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b54d167b-60b9-4e53-a908-835097494995 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:05.240938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b54d167b-60b9-4e53-a908-835097494995 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:05.244660 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-4fb36540-5cec-4119-a795-d75ce3662c84 req-86e5f628-a147-4b02-9623-499d26ff827d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc8c1c2b-eb55-4361-bcd7-e66c270b827a", "name": "network-vif-plugged", "status": "completed", "tag": "1e24dd2e-9faf-4586-ae6b-48d1499917fe"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:05.262448 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4fb36540-5cec-4119-a795-d75ce3662c84 req-86e5f628-a147-4b02-9623-499d26ff827d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:05.263206 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4fb36540-5cec-4119-a795-d75ce3662c84 req-86e5f628-a147-4b02-9623-499d26ff827d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:05.263849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4fb36540-5cec-4119-a795-d75ce3662c84 req-86e5f628-a147-4b02-9623-499d26ff827d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:05.290788 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-4fb36540-5cec-4119-a795-d75ce3662c84 req-86e5f628-a147-4b02-9623-499d26ff827d service nova] Creating event network-vif-plugged:1e24dd2e-9faf-4586-ae6b-48d1499917fe for instance fc8c1c2b-eb55-4361-bcd7-e66c270b827a on n-h2-852087-9 Sep 07 12:29:05.297368 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-4fb36540-5cec-4119-a795-d75ce3662c84 req-86e5f628-a147-4b02-9623-499d26ff827d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059123 Sep 07 12:29:05.298781 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 79/178] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 07 12:29:05.422791 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b54d167b-60b9-4e53-a908-835097494995 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 299 microversion: 2.1 time: 0.231148 Sep 07 12:29:05.423828 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 100/179] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Sep 7 12:29:05 2022] POST /compute/v2.1/os-aggregates/2/action => generated 299 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:05.435872 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2f5ed0e5-2b95-4c3b-b329-f2befbba2332 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:05.474293 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2f5ed0e5-2b95-4c3b-b329-f2befbba2332 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.042408 Sep 07 12:29:05.475062 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 80/180] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Sep 7 12:29:05 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 07 12:29:05.492839 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ac8801de-84a4-42d7-8cc4-27825fdc9e4f tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2046713201"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:05.496958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.aggregate [None req-ac8801de-84a4-42d7-8cc4-27825fdc9e4f tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Generated uuid 7ee01ca5-d221-4d3b-913f-6a5a99c55ce7 for aggregate {{(pid=122432) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 12:29:05.521660 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ac8801de-84a4-42d7-8cc4-27825fdc9e4f tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.033391 Sep 07 12:29:05.522439 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 101/181] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Sep 7 12:29:05 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:05.534014 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fa0044a8-9430-42f8-8611-37818e397056 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-852087-9"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:05.545439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa0044a8-9430-42f8-8611-37818e397056 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:05.546139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa0044a8-9430-42f8-8611-37818e397056 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:05.546531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa0044a8-9430-42f8-8611-37818e397056 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:05.695875 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fa0044a8-9430-42f8-8611-37818e397056 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.165641 Sep 07 12:29:05.703152 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 81/182] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Sep 7 12:29:05 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:05.711020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6275bffe-694e-4229-afab-25567e127b37 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:05.721115 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5dda9d09-cd65-416b-90cd-389a179ef3f6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:05.722124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5dda9d09-cd65-416b-90cd-389a179ef3f6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 79881389-e6f0-43f3-96c3-fdb045bb956e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:05.722755 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6275bffe-694e-4229-afab-25567e127b37 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 242 microversion: 2.1 time: 0.017450 Sep 07 12:29:05.725527 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 102/183] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Sep 7 12:29:05 2022] GET /compute/v2.1/os-aggregates/3 => generated 242 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:05.733274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dda9d09-cd65-416b-90cd-389a179ef3f6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:05.734014 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dda9d09-cd65-416b-90cd-389a179ef3f6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:05.734511 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dda9d09-cd65-416b-90cd-389a179ef3f6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:05.735233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dda9d09-cd65-416b-90cd-389a179ef3f6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:05.735690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dda9d09-cd65-416b-90cd-389a179ef3f6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:05.736120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dda9d09-cd65-416b-90cd-389a179ef3f6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:05.738174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bbf0a78f-f3cf-4dd7-8a64-e71401c72b6e tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-852087-9"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:05.751481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbf0a78f-f3cf-4dd7-8a64-e71401c72b6e tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:05.752550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbf0a78f-f3cf-4dd7-8a64-e71401c72b6e tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:05.753218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbf0a78f-f3cf-4dd7-8a64-e71401c72b6e tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:05.924839 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bbf0a78f-f3cf-4dd7-8a64-e71401c72b6e tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.192822 Sep 07 12:29:05.932096 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 103/184] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Sep 7 12:29:05 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:05.936663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4b0e3283-9ed6-4048-bf4f-4901409deaf6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:05.937557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4b0e3283-9ed6-4048-bf4f-4901409deaf6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:05.950113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b0e3283-9ed6-4048-bf4f-4901409deaf6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:05.951282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b0e3283-9ed6-4048-bf4f-4901409deaf6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:05.952577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b0e3283-9ed6-4048-bf4f-4901409deaf6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:05.953497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b0e3283-9ed6-4048-bf4f-4901409deaf6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:05.953985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b0e3283-9ed6-4048-bf4f-4901409deaf6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:05.956135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b0e3283-9ed6-4048-bf4f-4901409deaf6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:05.995615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:06.064317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5dda9d09-cd65-416b-90cd-389a179ef3f6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:06.073253 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5dda9d09-cd65-416b-90cd-389a179ef3f6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e" status: 200 len: 1386 microversion: 2.1 time: 0.358353 Sep 07 12:29:06.077350 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 82/185] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:05 2022] GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e => generated 1386 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:06.085443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-372f85ca-79b1-4803-8bd0-821227767d9d tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:06.148994 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-372f85ca-79b1-4803-8bd0-821227767d9d tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.070172 Sep 07 12:29:06.155065 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 83/186] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Sep 7 12:29:06 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 12:29:06.173547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-137068bc-cd55-4d03-849a-5324c867d9df tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:06.174187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-137068bc-cd55-4d03-849a-5324c867d9df tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:06.186483 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-137068bc-cd55-4d03-849a-5324c867d9df tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:06.186983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-137068bc-cd55-4d03-849a-5324c867d9df tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:06.187421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-137068bc-cd55-4d03-849a-5324c867d9df tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:06.188138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-137068bc-cd55-4d03-849a-5324c867d9df tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:06.190502 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-137068bc-cd55-4d03-849a-5324c867d9df tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:06.196220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-137068bc-cd55-4d03-849a-5324c867d9df tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:06.239436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4b0e3283-9ed6-4048-bf4f-4901409deaf6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:06.255908 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4b0e3283-9ed6-4048-bf4f-4901409deaf6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1311 microversion: 2.1 time: 0.322985 Sep 07 12:29:06.257007 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 104/187] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:05 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1311 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:06.274147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-75b2a438-b270-4605-8ce1-6ee40bcfeeca tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:06.275081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-75b2a438-b270-4605-8ce1-6ee40bcfeeca tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:06.299719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75b2a438-b270-4605-8ce1-6ee40bcfeeca tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:06.300403 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75b2a438-b270-4605-8ce1-6ee40bcfeeca tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:06.300963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75b2a438-b270-4605-8ce1-6ee40bcfeeca tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:06.301886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75b2a438-b270-4605-8ce1-6ee40bcfeeca tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:06.302466 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75b2a438-b270-4605-8ce1-6ee40bcfeeca tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:06.306575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75b2a438-b270-4605-8ce1-6ee40bcfeeca tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:06.526867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-137068bc-cd55-4d03-849a-5324c867d9df tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:06.535314 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-137068bc-cd55-4d03-849a-5324c867d9df tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac" status: 200 len: 1475 microversion: 2.1 time: 0.378967 Sep 07 12:29:06.546302 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 84/188] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:06 2022] GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac => generated 1475 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:06.558949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9b450c92-8c97-4d04-ab40-eb7cdcb429ee tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-21990520"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:06.564133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.aggregate [None req-9b450c92-8c97-4d04-ab40-eb7cdcb429ee tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Generated uuid 2cd594ef-e4e3-49ac-822b-dc3708ef9f76 for aggregate {{(pid=122433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 12:29:06.577590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-75b2a438-b270-4605-8ce1-6ee40bcfeeca tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:06.588302 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-75b2a438-b270-4605-8ce1-6ee40bcfeeca tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1313 microversion: 2.1 time: 0.329756 Sep 07 12:29:06.605323 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9b450c92-8c97-4d04-ab40-eb7cdcb429ee tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.050061 Sep 07 12:29:06.605323 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 85/189] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Sep 7 12:29:06 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:06.606621 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 105/190] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:06 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:06.610853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0fa225a6-4432-47be-9b33-72827b23b437 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-852087-9"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:06.624223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fa225a6-4432-47be-9b33-72827b23b437 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:06.624869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fa225a6-4432-47be-9b33-72827b23b437 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:06.625410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fa225a6-4432-47be-9b33-72827b23b437 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:06.756590 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0fa225a6-4432-47be-9b33-72827b23b437 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 240 microversion: 2.1 time: 0.149928 Sep 07 12:29:06.757365 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 86/191] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Sep 7 12:29:06 2022] POST /compute/v2.1/os-aggregates/4/action => generated 240 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:06.769310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f25afc89-7539-4228-a741-3a7a7942337a tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:06.782673 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f25afc89-7539-4228-a741-3a7a7942337a tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 243 microversion: 2.1 time: 0.017301 Sep 07 12:29:06.785543 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 106/192] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Sep 7 12:29:06 2022] GET /compute/v2.1/os-aggregates => generated 243 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:29:06.796532 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c9fdde2c-a845-4d50-9734-841a3e0d25b0 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-852087-9"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:06.806809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:06.823812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9fdde2c-a845-4d50-9734-841a3e0d25b0 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:06.828142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9fdde2c-a845-4d50-9734-841a3e0d25b0 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:06.831425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9fdde2c-a845-4d50-9734-841a3e0d25b0 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:06.988897 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c9fdde2c-a845-4d50-9734-841a3e0d25b0 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 225 microversion: 2.1 time: 0.196680 Sep 07 12:29:06.989655 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 87/193] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Sep 7 12:29:06 2022] POST /compute/v2.1/os-aggregates/4/action => generated 225 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:29:07.002236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-61e8f9cf-090a-4e58-ba33-e035076a79ec tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:07.045064 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-61e8f9cf-090a-4e58-ba33-e035076a79ec tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.046545 Sep 07 12:29:07.045902 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 107/194] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Sep 7 12:29:06 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 07 12:29:07.056548 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-413e0521-0fbf-4b8a-8a3b-cb34e0ffd2b4 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1821021137"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:07.060744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.aggregate [None req-413e0521-0fbf-4b8a-8a3b-cb34e0ffd2b4 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Generated uuid f739b8fe-f633-4d37-b6b1-40beb5aeaaea for aggregate {{(pid=122433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 12:29:07.105557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d618a86b-5782-443e-aee7-23a6566e6735 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:07.106249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d618a86b-5782-443e-aee7-23a6566e6735 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 79881389-e6f0-43f3-96c3-fdb045bb956e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:07.122781 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d618a86b-5782-443e-aee7-23a6566e6735 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:07.123487 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-413e0521-0fbf-4b8a-8a3b-cb34e0ffd2b4 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.065205 Sep 07 12:29:07.124467 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 88/195] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Sep 7 12:29:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:29:07.125109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d618a86b-5782-443e-aee7-23a6566e6735 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:07.125658 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d618a86b-5782-443e-aee7-23a6566e6735 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:07.126685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d618a86b-5782-443e-aee7-23a6566e6735 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:07.127185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d618a86b-5782-443e-aee7-23a6566e6735 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:07.127692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d618a86b-5782-443e-aee7-23a6566e6735 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:07.136574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b55effdc-41e4-4053-8dac-b55c3b1bd92e tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-852087-9"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:07.147834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b55effdc-41e4-4053-8dac-b55c3b1bd92e tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:07.148489 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b55effdc-41e4-4053-8dac-b55c3b1bd92e tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:07.148919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b55effdc-41e4-4053-8dac-b55c3b1bd92e tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:07.347293 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b55effdc-41e4-4053-8dac-b55c3b1bd92e tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 242 microversion: 2.1 time: 0.214837 Sep 07 12:29:07.347899 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 89/196] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Sep 7 12:29:07 2022] POST /compute/v2.1/os-aggregates/5/action => generated 242 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:07.353392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-98784c59-9c4a-438d-9f92-e739e95c0958 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:07.359242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-98784c59-9c4a-438d-9f92-e739e95c0958 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:07.387159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98784c59-9c4a-438d-9f92-e739e95c0958 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:07.388226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98784c59-9c4a-438d-9f92-e739e95c0958 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:07.389653 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98784c59-9c4a-438d-9f92-e739e95c0958 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:07.395806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98784c59-9c4a-438d-9f92-e739e95c0958 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:07.396564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98784c59-9c4a-438d-9f92-e739e95c0958 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:07.397192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98784c59-9c4a-438d-9f92-e739e95c0958 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:07.420583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d618a86b-5782-443e-aee7-23a6566e6735 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:07.432088 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d618a86b-5782-443e-aee7-23a6566e6735 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e" status: 200 len: 1585 microversion: 2.1 time: 0.334108 Sep 07 12:29:07.435617 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 108/197] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:07 2022] GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e => generated 1585 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:07.440419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:07.443434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-6d73ddfe-cede-4782-b5be-d5342cd6a7db req-658f00f4-76cb-48f7-991e-a9d9b4e6033d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5516035a-001e-4d31-84cc-84bca52e7b1e", "name": "network-vif-plugged", "status": "completed", "tag": "f6af2e88-520d-49f5-bc3a-8bccb5d1a54b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:07.469473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6d73ddfe-cede-4782-b5be-d5342cd6a7db req-658f00f4-76cb-48f7-991e-a9d9b4e6033d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:07.470166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6d73ddfe-cede-4782-b5be-d5342cd6a7db req-658f00f4-76cb-48f7-991e-a9d9b4e6033d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:07.470670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6d73ddfe-cede-4782-b5be-d5342cd6a7db req-658f00f4-76cb-48f7-991e-a9d9b4e6033d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:07.482748 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-6d73ddfe-cede-4782-b5be-d5342cd6a7db req-658f00f4-76cb-48f7-991e-a9d9b4e6033d service nova] Creating event network-vif-plugged:f6af2e88-520d-49f5-bc3a-8bccb5d1a54b for instance 5516035a-001e-4d31-84cc-84bca52e7b1e on n-h1-852087-9 Sep 07 12:29:07.488061 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-6d73ddfe-cede-4782-b5be-d5342cd6a7db req-658f00f4-76cb-48f7-991e-a9d9b4e6033d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048882 Sep 07 12:29:07.489324 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 109/198] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:07.495932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-949d02a5-2292-41dd-9d72-39f55791f006 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-852087-9"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:07.507985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-949d02a5-2292-41dd-9d72-39f55791f006 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:07.508719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-949d02a5-2292-41dd-9d72-39f55791f006 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:07.509388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-949d02a5-2292-41dd-9d72-39f55791f006 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:07.664276 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-949d02a5-2292-41dd-9d72-39f55791f006 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.172044 Sep 07 12:29:07.671885 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 110/199] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Sep 7 12:29:07 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:07.678886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b22bb5dd-480c-4d60-900d-3c7c75e848ff tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:07.679317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-98784c59-9c4a-438d-9f92-e739e95c0958 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:07.680181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b22bb5dd-480c-4d60-900d-3c7c75e848ff tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 79881389-e6f0-43f3-96c3-fdb045bb956e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:07.687399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b22bb5dd-480c-4d60-900d-3c7c75e848ff tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:07.687942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b22bb5dd-480c-4d60-900d-3c7c75e848ff tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:07.688436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b22bb5dd-480c-4d60-900d-3c7c75e848ff tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:07.689146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b22bb5dd-480c-4d60-900d-3c7c75e848ff tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:07.689396 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-98784c59-9c4a-438d-9f92-e739e95c0958 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1311 microversion: 2.1 time: 0.339840 Sep 07 12:29:07.689736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b22bb5dd-480c-4d60-900d-3c7c75e848ff tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:07.689957 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 90/200] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:07 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1311 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:07.690487 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b22bb5dd-480c-4d60-900d-3c7c75e848ff tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:07.700169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a9a3805f-61c3-44fa-9fc6-d570dabde987 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:07.702498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a9a3805f-61c3-44fa-9fc6-d570dabde987 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:07.713262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9a3805f-61c3-44fa-9fc6-d570dabde987 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:07.714532 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9a3805f-61c3-44fa-9fc6-d570dabde987 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:07.715350 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9a3805f-61c3-44fa-9fc6-d570dabde987 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:07.716279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9a3805f-61c3-44fa-9fc6-d570dabde987 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:07.716980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9a3805f-61c3-44fa-9fc6-d570dabde987 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:07.717643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9a3805f-61c3-44fa-9fc6-d570dabde987 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:07.815964 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b22bb5dd-480c-4d60-900d-3c7c75e848ff tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143431 Sep 07 12:29:07.816643 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 111/201] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Sep 7 12:29:07 2022] GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:07.829590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a7c1cd48-e51e-45ad-bb1e-d1ff7e90d3da tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:07.830249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a7c1cd48-e51e-45ad-bb1e-d1ff7e90d3da tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:07.841265 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7c1cd48-e51e-45ad-bb1e-d1ff7e90d3da tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:07.841792 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7c1cd48-e51e-45ad-bb1e-d1ff7e90d3da tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:07.842228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7c1cd48-e51e-45ad-bb1e-d1ff7e90d3da tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:07.842931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7c1cd48-e51e-45ad-bb1e-d1ff7e90d3da tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:07.843389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7c1cd48-e51e-45ad-bb1e-d1ff7e90d3da tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:07.843816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7c1cd48-e51e-45ad-bb1e-d1ff7e90d3da tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:08.192406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a9a3805f-61c3-44fa-9fc6-d570dabde987 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:08.204477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a7c1cd48-e51e-45ad-bb1e-d1ff7e90d3da tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:08.209822 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a9a3805f-61c3-44fa-9fc6-d570dabde987 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac" status: 200 len: 1475 microversion: 2.1 time: 0.514870 Sep 07 12:29:08.210411 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 91/202] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:07 2022] GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac => generated 1475 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:08.217462 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a7c1cd48-e51e-45ad-bb1e-d1ff7e90d3da tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1313 microversion: 2.1 time: 0.391527 Sep 07 12:29:08.228421 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 112/203] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:07 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1313 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:08.228421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-21158235-e57d-4605-ac07-5e27ba407efd req-7265b592-59f6-4e21-9f9e-71afeeda8759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac", "name": "network-vif-deleted", "tag": "5bf2653b-1fbc-4aec-bcac-f5564ffe6b01"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:08.228712 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9abb2e9c-26d9-418e-b2a3-ef6e9873fab4 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:08.256588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-21158235-e57d-4605-ac07-5e27ba407efd req-7265b592-59f6-4e21-9f9e-71afeeda8759 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:08.257985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-21158235-e57d-4605-ac07-5e27ba407efd req-7265b592-59f6-4e21-9f9e-71afeeda8759 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:08.258671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-21158235-e57d-4605-ac07-5e27ba407efd req-7265b592-59f6-4e21-9f9e-71afeeda8759 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:08.271328 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9abb2e9c-26d9-418e-b2a3-ef6e9873fab4 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.051672 Sep 07 12:29:08.273196 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 92/204] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Sep 7 12:29:08 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 12:29:08.285189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f4540a5c-243c-4dc4-9bc3-f58ea39dc199 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1276061395"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:08.286349 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-21158235-e57d-4605-ac07-5e27ba407efd req-7265b592-59f6-4e21-9f9e-71afeeda8759 service nova] Creating event network-vif-deleted:5bf2653b-1fbc-4aec-bcac-f5564ffe6b01 for instance 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac on n-h2-852087-9 Sep 07 12:29:08.290381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.aggregate [None req-f4540a5c-243c-4dc4-9bc3-f58ea39dc199 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Generated uuid 2f3ac661-20b3-4da2-a1df-fd1b875ad237 for aggregate {{(pid=122433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 12:29:08.293708 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-21158235-e57d-4605-ac07-5e27ba407efd req-7265b592-59f6-4e21-9f9e-71afeeda8759 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070461 Sep 07 12:29:08.294663 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 113/205] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:08.314751 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e82d0cbb-29c3-4d13-8949-2e5040170af6 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Calling method '.version_select at 0x7fc419c3ddc0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:08.320037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e82d0cbb-29c3-4d13-8949-2e5040170af6 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:08.320608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e82d0cbb-29c3-4d13-8949-2e5040170af6 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:08.321164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e82d0cbb-29c3-4d13-8949-2e5040170af6 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:08.322563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e82d0cbb-29c3-4d13-8949-2e5040170af6 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:08.323311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e82d0cbb-29c3-4d13-8949-2e5040170af6 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:08.323802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e82d0cbb-29c3-4d13-8949-2e5040170af6 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:08.324454 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f4540a5c-243c-4dc4-9bc3-f58ea39dc199 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.046301 Sep 07 12:29:08.325064 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 93/206] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Sep 7 12:29:08 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:08.341879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3133a1e5-c5f3-4162-bd7f-550c528b7174 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:08.357623 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e82d0cbb-29c3-4d13-8949-2e5040170af6 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.051722 Sep 07 12:29:08.358347 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 114/207] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Sep 7 12:29:08 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:08.370702 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3133a1e5-c5f3-4162-bd7f-550c528b7174 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.032693 Sep 07 12:29:08.376052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e19a89b7-0a5b-4ddb-9147-18d1d9fa01e4 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Calling method '.version_select at 0x7fc419ced700>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:08.376245 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 94/208] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Sep 7 12:29:08 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 12:29:08.380722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e19a89b7-0a5b-4ddb-9147-18d1d9fa01e4 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:08.381548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e19a89b7-0a5b-4ddb-9147-18d1d9fa01e4 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:08.382031 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-63c6c2e0-8424-427f-b944-fda999094fc3 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:08.382214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e19a89b7-0a5b-4ddb-9147-18d1d9fa01e4 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:08.383417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e19a89b7-0a5b-4ddb-9147-18d1d9fa01e4 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:08.385272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e19a89b7-0a5b-4ddb-9147-18d1d9fa01e4 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:08.386103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e19a89b7-0a5b-4ddb-9147-18d1d9fa01e4 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:08.391904 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-63c6c2e0-8424-427f-b944-fda999094fc3 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Sep 07 12:29:08.398138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-63c6c2e0-8424-427f-b944-fda999094fc3 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Request method failure captured: Sep 07 12:29:08.398138 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Sep 07 12:29:08.398138 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:29:08.398138 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:29:08.398138 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:29:08.398138 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:29:08.398138 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:29:08.398138 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:29:08.398138 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:29:08.398138 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:08.398138 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI5ZQVAO5Px7qRVk0udvw41NXGxo6ch5yN1rz9cslviXxY-O364M_-VkETy-3j-gAjvPolAEAr4lW7tVc4BY48bkMiFxikxBrtaIvKYk4_dYAFECSZlRpHC-arFQyPxeYl8XVFPkHBPiuzmf60cqfMMqnQFK76HxBG_djP3Bbga6lRE Sep 07 12:29:08.398138 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:29:08.398138 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:29:08.398138 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:29:08.398138 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:29:08.398138 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:29:08.398138 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:29:08.398138 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 91cc65aa24d5433fb5d75a1e4a012447 Sep 07 12:29:08.398138 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminTestJSON-1722419006 Sep 07 12:29:08.398138 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 12:29:08.398138 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 12:29:08.399510 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91cc65aa24d5433fb5d75a1e4a012447"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_91cc65aa24d5433fb5d75a1e4a012447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/91cc65aa24d5433fb5d75a1e4a012447"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91cc65aa24d5433fb5d75a1e4a012447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:08.399510 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminTestJSON-1722419006 Sep 07 12:29:08.399510 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 91cc65aa24d5433fb5d75a1e4a012447 Sep 07 12:29:08.399510 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1722419006 Sep 07 12:29:08.399510 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminTestJSON-1722419006-project-admin Sep 07 12:29:08.399510 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:29:08.399510 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:29:08.399510 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 8162ae770be3403aba8d497f7114ec3d Sep 07 12:29:08.399510 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminTestJSON-1722419006-project-admin Sep 07 12:29:08.399510 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:29:08.399510 n-d-852087-9 devstack@n-api.service[122433]: exception: Aggregate 6 could not be found. Sep 07 12:29:08.399510 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '6'} Sep 07 12:29:08.399510 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:08.400304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:08.400304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 07 12:29:08.400304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 07 12:29:08.400304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 07 12:29:08.400304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 07 12:29:08.400304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:29:08.400304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:29:08.400304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 07 12:29:08.400304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 07 12:29:08.400304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 12:29:08.400304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 12:29:08.400304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 07 12:29:08.400304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 07 12:29:08.400304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Sep 07 12:29:08.400304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.400304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:08.400304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.400304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:08.400304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:08.401395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:08.401395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:08.401395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:08.401395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:08.401395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:08.401395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 07 12:29:08.401395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:29:08.401395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Sep 07 12:29:08.401395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.401395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:08.401395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.401395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:08.401395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:08.401395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:08.401395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:29:08.401395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:29:08.401395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Sep 07 12:29:08.401395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.404512 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-63c6c2e0-8424-427f-b944-fda999094fc3 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:08.405812 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-63c6c2e0-8424-427f-b944-fda999094fc3 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.028088 Sep 07 12:29:08.407329 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 95/209] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Sep 7 12:29:08 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:29:08.417467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8750b370-9f9d-4272-bbab-a9fe6a1c1202 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:08.421796 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e19a89b7-0a5b-4ddb-9147-18d1d9fa01e4 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.056055 Sep 07 12:29:08.429054 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 115/210] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Sep 7 12:29:08 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:29:08.437445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-497d479d-0c77-4804-a395-907187e71d7d tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Calling method '.version_select at 0x7fc419c79ee0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:08.443894 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-8750b370-9f9d-4272-bbab-a9fe6a1c1202 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Sep 07 12:29:08.446650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8750b370-9f9d-4272-bbab-a9fe6a1c1202 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Request method failure captured: Sep 07 12:29:08.446650 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Sep 07 12:29:08.446650 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:29:08.446650 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:29:08.446650 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:29:08.446650 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:29:08.446650 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:29:08.446650 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:29:08.446650 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:29:08.446650 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:08.446650 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI5ZQVAO5Px7qRVk0udvw41NXGxo6ch5yN1rz9cslviXxY-O364M_-VkETy-3j-gAjvPolAEAr4lW7tVc4BY48bkMiFxikxBrtaIvKYk4_dYAFECSZlRpHC-arFQyPxeYl8XVFPkHBPiuzmf60cqfMMqnQFK76HxBG_djP3Bbga6lRE Sep 07 12:29:08.446650 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:29:08.446650 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:29:08.446650 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:29:08.446650 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:29:08.446650 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:29:08.446650 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:29:08.446650 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 91cc65aa24d5433fb5d75a1e4a012447 Sep 07 12:29:08.446650 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminTestJSON-1722419006 Sep 07 12:29:08.446650 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 12:29:08.446650 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 12:29:08.447841 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91cc65aa24d5433fb5d75a1e4a012447"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_91cc65aa24d5433fb5d75a1e4a012447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/91cc65aa24d5433fb5d75a1e4a012447"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91cc65aa24d5433fb5d75a1e4a012447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:08.447841 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminTestJSON-1722419006 Sep 07 12:29:08.447841 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 91cc65aa24d5433fb5d75a1e4a012447 Sep 07 12:29:08.447841 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1722419006 Sep 07 12:29:08.447841 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminTestJSON-1722419006-project-admin Sep 07 12:29:08.447841 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:29:08.447841 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:29:08.447841 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 8162ae770be3403aba8d497f7114ec3d Sep 07 12:29:08.447841 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminTestJSON-1722419006-project-admin Sep 07 12:29:08.447841 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:29:08.447841 n-d-852087-9 devstack@n-api.service[122433]: exception: Aggregate 6 could not be found. Sep 07 12:29:08.447841 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '6'} Sep 07 12:29:08.447841 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:08.448566 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:08.448566 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 07 12:29:08.448566 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 07 12:29:08.448566 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 12:29:08.448566 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 12:29:08.448566 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:29:08.448566 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:29:08.448566 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:29:08.448566 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:29:08.448566 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 12:29:08.448566 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 12:29:08.448566 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 07 12:29:08.448566 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 07 12:29:08.448566 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:29:08.448566 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:29:08.448566 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 07 12:29:08.448566 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 07 12:29:08.448566 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 12:29:08.448566 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 12:29:08.449634 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 07 12:29:08.449634 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 07 12:29:08.449634 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Sep 07 12:29:08.449634 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.449634 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:08.449634 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.449634 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:08.449634 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:08.449634 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:08.449634 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:08.449634 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:08.449634 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:08.449634 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:08.449634 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 07 12:29:08.449634 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:29:08.449634 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Sep 07 12:29:08.449634 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.449634 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:08.449634 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.449634 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:08.449634 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:08.450751 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:08.450751 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:29:08.450751 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:29:08.450751 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Sep 07 12:29:08.450751 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.451025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-497d479d-0c77-4804-a395-907187e71d7d tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:08.451025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-497d479d-0c77-4804-a395-907187e71d7d tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:08.451025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-497d479d-0c77-4804-a395-907187e71d7d tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:08.451025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-497d479d-0c77-4804-a395-907187e71d7d tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:08.451283 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-497d479d-0c77-4804-a395-907187e71d7d tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:08.451350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-497d479d-0c77-4804-a395-907187e71d7d tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:08.453155 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8750b370-9f9d-4272-bbab-a9fe6a1c1202 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:08.454739 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8750b370-9f9d-4272-bbab-a9fe6a1c1202 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.042722 Sep 07 12:29:08.461522 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 96/211] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Sep 7 12:29:08 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:29:08.468352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2438c1ed-ba0c-444d-b0d7-a49d512f2151 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1900025824", "name": "tempest-test_aggregate-1290743600"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:08.479226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=5,nova_api:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:08.497529 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-497d479d-0c77-4804-a395-907187e71d7d tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.067023 Sep 07 12:29:08.503619 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 116/212] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Sep 7 12:29:08 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:08.503823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.aggregate [None req-2438c1ed-ba0c-444d-b0d7-a49d512f2151 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Generated uuid a4a72883-b226-4822-badf-815ea22cfe08 for aggregate {{(pid=122433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 12:29:08.509439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b10bfde4-ee09-49cd-b8b1-5b7474be3b50 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1283789997"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:08.513303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.aggregate [None req-b10bfde4-ee09-49cd-b8b1-5b7474be3b50 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Generated uuid 0d7521ff-26e9-44ac-a150-7182617f7ec1 for aggregate {{(pid=122432) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 12:29:08.551162 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b10bfde4-ee09-49cd-b8b1-5b7474be3b50 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.051537 Sep 07 12:29:08.552218 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 117/213] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Sep 7 12:29:08 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:08.562559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7a1e9062-7811-439a-8ce2-af64299cf0e1 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Calling method '.version_select at 0x7fc419c79160>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:08.563929 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2438c1ed-ba0c-444d-b0d7-a49d512f2151 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.100392 Sep 07 12:29:08.572623 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 97/214] 10.222.0.16 () {60 vars in 1165 bytes} [Wed Sep 7 12:29:08 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:08.583783 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0cfb317a-0a40-4249-8013-2a0c81aeb57e tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-852087-9"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:08.594693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a1e9062-7811-439a-8ce2-af64299cf0e1 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:08.597891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a1e9062-7811-439a-8ce2-af64299cf0e1 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:08.598692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a1e9062-7811-439a-8ce2-af64299cf0e1 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:08.617650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cfb317a-0a40-4249-8013-2a0c81aeb57e tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:08.620965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a1e9062-7811-439a-8ce2-af64299cf0e1 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:08.621568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cfb317a-0a40-4249-8013-2a0c81aeb57e tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:08.622642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cfb317a-0a40-4249-8013-2a0c81aeb57e tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:08.623431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a1e9062-7811-439a-8ce2-af64299cf0e1 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:08.624586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a1e9062-7811-439a-8ce2-af64299cf0e1 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:08.652422 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7a1e9062-7811-439a-8ce2-af64299cf0e1 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-h1-852087-9" status: 200 len: 467 microversion: 2.1 time: 0.098112 Sep 07 12:29:08.653877 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 118/215] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Sep 7 12:29:08 2022] GET /compute/v2.1/os-hosts/n-h1-852087-9 => generated 467 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:08.663493 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-003e0a66-07d9-4d8d-8df5-8fa7efe33a3e tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:08.694463 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-003e0a66-07d9-4d8d-8df5-8fa7efe33a3e tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.038387 Sep 07 12:29:08.695798 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 119/216] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Sep 7 12:29:08 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 12:29:08.705110 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-230378ca-2a1c-4fd9-8e37-f0d5b0f1c9b4 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Calling method '.version_select at 0x7fc419c79b80>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:08.717869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-230378ca-2a1c-4fd9-8e37-f0d5b0f1c9b4 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:08.718658 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-230378ca-2a1c-4fd9-8e37-f0d5b0f1c9b4 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:08.719400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-230378ca-2a1c-4fd9-8e37-f0d5b0f1c9b4 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:08.737316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-230378ca-2a1c-4fd9-8e37-f0d5b0f1c9b4 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:08.737891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-230378ca-2a1c-4fd9-8e37-f0d5b0f1c9b4 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:08.738329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-230378ca-2a1c-4fd9-8e37-f0d5b0f1c9b4 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:08.786624 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-230378ca-2a1c-4fd9-8e37-f0d5b0f1c9b4 tempest-HostsAdminTestJSON-996654271 tempest-HostsAdminTestJSON-996654271-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-h2-852087-9" status: 200 len: 729 microversion: 2.1 time: 0.089216 Sep 07 12:29:08.787719 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 120/217] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Sep 7 12:29:08 2022] GET /compute/v2.1/os-hosts/n-h2-852087-9 => generated 729 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:08.797191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e7793a6e-d3d2-4bfb-a0c0-c001c205f51b tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:08.805437 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-e7793a6e-d3d2-4bfb-a0c0-c001c205f51b tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Sep 07 12:29:08.815371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e7793a6e-d3d2-4bfb-a0c0-c001c205f51b tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Request method failure captured: Sep 07 12:29:08.815371 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 07 12:29:08.815371 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:29:08.815371 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:29:08.815371 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:29:08.815371 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:29:08.815371 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:29:08.815371 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:29:08.815371 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:29:08.815371 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:08.815371 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5ZQVAO5Px7qRVk0udvw41NXGxo6ch5yN1rz9cslviXxY-O364M_-VkETy-3j-gAjvPolAEAr4lW7tVc4BY48bkMiFxikxBrtaIvKYk4_dYAFECSZlRpHC-arFQyPxeYl8XVFPkHBPiuzmf60cqfMMqnQFK76HxBG_djP3Bbga6lRE Sep 07 12:29:08.815371 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:29:08.815371 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:29:08.815371 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:29:08.815371 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:29:08.815371 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:29:08.815371 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:29:08.815371 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 91cc65aa24d5433fb5d75a1e4a012447 Sep 07 12:29:08.815371 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-AggregatesAdminTestJSON-1722419006 Sep 07 12:29:08.815371 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member,admin Sep 07 12:29:08.815371 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member,admin Sep 07 12:29:08.817035 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91cc65aa24d5433fb5d75a1e4a012447"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_91cc65aa24d5433fb5d75a1e4a012447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/91cc65aa24d5433fb5d75a1e4a012447"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91cc65aa24d5433fb5d75a1e4a012447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:08.817035 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-AggregatesAdminTestJSON-1722419006 Sep 07 12:29:08.817035 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 91cc65aa24d5433fb5d75a1e4a012447 Sep 07 12:29:08.817035 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1722419006 Sep 07 12:29:08.817035 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-AggregatesAdminTestJSON-1722419006-project-admin Sep 07 12:29:08.817035 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:29:08.817035 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:29:08.817035 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 8162ae770be3403aba8d497f7114ec3d Sep 07 12:29:08.817035 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-AggregatesAdminTestJSON-1722419006-project-admin Sep 07 12:29:08.817035 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:29:08.817035 n-d-852087-9 devstack@n-api.service[122432]: exception: Aggregate 7 could not be found. Sep 07 12:29:08.817035 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '7'} Sep 07 12:29:08.817035 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:08.817768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:08.817768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 07 12:29:08.817768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 07 12:29:08.817768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 07 12:29:08.817768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 07 12:29:08.817768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:29:08.817768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:29:08.817768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 07 12:29:08.817768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 07 12:29:08.817768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 12:29:08.817768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 12:29:08.817768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 07 12:29:08.817768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 07 12:29:08.817768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Sep 07 12:29:08.817768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.817768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:08.817768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.817768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:08.817768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:08.818920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:08.818920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:08.818920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:08.818920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:08.818920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:08.818920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 07 12:29:08.818920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:29:08.818920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Sep 07 12:29:08.818920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.818920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:08.818920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.818920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:08.818920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:08.818920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:08.818920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:29:08.818920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:29:08.818920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Sep 07 12:29:08.818920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.819852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e7793a6e-d3d2-4bfb-a0c0-c001c205f51b tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:08.819852 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e7793a6e-d3d2-4bfb-a0c0-c001c205f51b tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.028076 Sep 07 12:29:08.822070 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 121/218] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Sep 7 12:29:08 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:29:08.828768 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-107c589a-86e6-471d-b86b-f1faf45ec465 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:08.829643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-107c589a-86e6-471d-b86b-f1faf45ec465 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:08.835887 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0cfb317a-0a40-4249-8013-2a0c81aeb57e tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 242 microversion: 2.1 time: 0.267092 Sep 07 12:29:08.836599 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 98/219] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Sep 7 12:29:08 2022] POST /compute/v2.1/os-aggregates/8/action => generated 242 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:08.843228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2e5443cc-db89-4b34-8ff6-474f43877193 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:08.845136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-107c589a-86e6-471d-b86b-f1faf45ec465 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:08.845260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-107c589a-86e6-471d-b86b-f1faf45ec465 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:08.845961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-107c589a-86e6-471d-b86b-f1faf45ec465 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:08.846691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-107c589a-86e6-471d-b86b-f1faf45ec465 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:08.847213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-107c589a-86e6-471d-b86b-f1faf45ec465 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:08.847652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-107c589a-86e6-471d-b86b-f1faf45ec465 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:08.867443 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-2e5443cc-db89-4b34-8ff6-474f43877193 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Sep 07 12:29:08.869129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2e5443cc-db89-4b34-8ff6-474f43877193 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Request method failure captured: Sep 07 12:29:08.869129 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 07 12:29:08.869129 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:29:08.869129 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:29:08.869129 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:29:08.869129 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:29:08.869129 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:29:08.869129 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:29:08.869129 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:29:08.869129 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:08.869129 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI5ZQVAO5Px7qRVk0udvw41NXGxo6ch5yN1rz9cslviXxY-O364M_-VkETy-3j-gAjvPolAEAr4lW7tVc4BY48bkMiFxikxBrtaIvKYk4_dYAFECSZlRpHC-arFQyPxeYl8XVFPkHBPiuzmf60cqfMMqnQFK76HxBG_djP3Bbga6lRE Sep 07 12:29:08.869129 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:29:08.869129 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:29:08.869129 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:29:08.869129 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:29:08.869129 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:29:08.869129 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:29:08.869129 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 91cc65aa24d5433fb5d75a1e4a012447 Sep 07 12:29:08.869129 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminTestJSON-1722419006 Sep 07 12:29:08.869129 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 12:29:08.869129 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 12:29:08.870846 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91cc65aa24d5433fb5d75a1e4a012447"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_91cc65aa24d5433fb5d75a1e4a012447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/91cc65aa24d5433fb5d75a1e4a012447"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91cc65aa24d5433fb5d75a1e4a012447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:08.870846 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminTestJSON-1722419006 Sep 07 12:29:08.870846 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 91cc65aa24d5433fb5d75a1e4a012447 Sep 07 12:29:08.870846 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1722419006 Sep 07 12:29:08.870846 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminTestJSON-1722419006-project-admin Sep 07 12:29:08.870846 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:29:08.870846 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:29:08.870846 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 8162ae770be3403aba8d497f7114ec3d Sep 07 12:29:08.870846 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminTestJSON-1722419006-project-admin Sep 07 12:29:08.870846 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:29:08.870846 n-d-852087-9 devstack@n-api.service[122433]: exception: Aggregate 7 could not be found. Sep 07 12:29:08.870846 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '7'} Sep 07 12:29:08.870846 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:08.871535 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:08.871535 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 07 12:29:08.871535 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 07 12:29:08.871535 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 12:29:08.871535 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 12:29:08.871535 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:29:08.871535 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:29:08.871535 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:29:08.871535 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:29:08.871535 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 12:29:08.871535 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 12:29:08.871535 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 07 12:29:08.871535 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 07 12:29:08.871535 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:29:08.871535 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:29:08.871535 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 07 12:29:08.871535 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 07 12:29:08.871535 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 12:29:08.871535 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 12:29:08.872522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 07 12:29:08.872522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 07 12:29:08.872522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Sep 07 12:29:08.872522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.872522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:08.872522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.872522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:08.872522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:08.872522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:08.872522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:08.872522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:08.872522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:08.872522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:08.872522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 07 12:29:08.872522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:29:08.872522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Sep 07 12:29:08.872522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.872522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:08.872522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.872522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:08.872522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:08.875375 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:08.875375 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:29:08.875375 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:29:08.875375 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Sep 07 12:29:08.875375 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.875375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2e5443cc-db89-4b34-8ff6-474f43877193 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:08.875375 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2e5443cc-db89-4b34-8ff6-474f43877193 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.035905 Sep 07 12:29:08.876236 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 99/220] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Sep 7 12:29:08 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:29:08.887588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ce0d6d3-0438-4089-8b13-308d24667317 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-852087-9"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:08.908166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ce0d6d3-0438-4089-8b13-308d24667317 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:08.908740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ce0d6d3-0438-4089-8b13-308d24667317 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:08.909189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ce0d6d3-0438-4089-8b13-308d24667317 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:08.938553 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-0ce0d6d3-0438-4089-8b13-308d24667317 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] HTTP exception thrown: Aggregate 8 already has host n-h1-852087-9. Sep 07 12:29:08.970456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ce0d6d3-0438-4089-8b13-308d24667317 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Request method failure captured: Sep 07 12:29:08.970456 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-aggregates/8/action HTTP/1.1 Sep 07 12:29:08.970456 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:29:08.970456 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:29:08.970456 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:29:08.970456 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 39 Sep 07 12:29:08.970456 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:29:08.970456 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:29:08.970456 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:29:08.970456 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:08.970456 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI5Y2qiDoilOiPt-B04kuSh7w5pTv6e-eW_PCdQK2yzbR1GQrvWnWKVPpBQbgr3zmageY16ZWq0ymrZpbH-N_htLj-5iT-QBgHzOJIZPzW3Sz-gnUeyvEXbUTC2RcbACQwOhKvNFxsgPr9b10g9bMYOjt8soFnxQztWJzQO71rudcCg Sep 07 12:29:08.970456 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:29:08.970456 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:29:08.970456 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:29:08.970456 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:29:08.970456 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:29:08.970456 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:29:08.970456 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 4b74e7a228654a05ad77f48e90607537 Sep 07 12:29:08.970456 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1655925943 Sep 07 12:29:08.970456 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 12:29:08.970456 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 12:29:08.971699 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b74e7a228654a05ad77f48e90607537"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b74e7a228654a05ad77f48e90607537"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b74e7a228654a05ad77f48e90607537"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b74e7a228654a05ad77f48e90607537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:08.971699 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1655925943 Sep 07 12:29:08.971699 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 4b74e7a228654a05ad77f48e90607537 Sep 07 12:29:08.971699 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1655925943 Sep 07 12:29:08.971699 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin Sep 07 12:29:08.971699 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:29:08.971699 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:29:08.971699 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 237c96c5e3714471b3d8a1a423035ca2 Sep 07 12:29:08.971699 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin Sep 07 12:29:08.971699 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:29:08.971699 n-d-852087-9 devstack@n-api.service[122433]: {"add_host": {"host": "n-h1-852087-9"}} Sep 07 12:29:08.971699 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:29:08.971699 n-d-852087-9 devstack@n-api.service[122433]: exception: Aggregate 8 already has host n-h1-852087-9. Sep 07 12:29:08.972504 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '8', 'body': {'add_host': {'host': 'n-h1-852087-9'}}} Sep 07 12:29:08.972504 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:08.972504 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:08.972504 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 12:29:08.972504 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 07 12:29:08.972504 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 12:29:08.972504 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 07 12:29:08.972504 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 12:29:08.972504 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 07 12:29:08.972504 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 12:29:08.972504 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 07 12:29:08.972504 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 12:29:08.972504 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 12:29:08.972504 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 12:29:08.972504 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result.read() Sep 07 12:29:08.972504 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 12:29:08.972504 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 07 12:29:08.972504 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 12:29:08.972504 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 07 12:29:08.977802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 12:29:08.977802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 07 12:29:08.977802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 12:29:08.977802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 07 12:29:08.977802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-852087-9-8' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 07 12:29:08.977802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.977802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 07 12:29:08.977802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.977802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:08.977802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Sep 07 12:29:08.977802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Sep 07 12:29:08.977802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 07 12:29:08.977802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi session.flush() Sep 07 12:29:08.977802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 07 12:29:08.977802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 07 12:29:08.977802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 07 12:29:08.977802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 07 12:29:08.977802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 07 12:29:08.977802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 07 12:29:08.978827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 12:29:08.978827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception Sep 07 12:29:08.978827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 07 12:29:08.978827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 07 12:29:08.978827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 07 12:29:08.978827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 07 12:29:08.978827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 07 12:29:08.978827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 07 12:29:08.978827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 07 12:29:08.978827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 07 12:29:08.978827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 07 12:29:08.978827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 07 12:29:08.978827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 07 12:29:08.978827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 07 12:29:08.978827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 07 12:29:08.978827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 07 12:29:08.978827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 07 12:29:08.978827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 07 12:29:08.979861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 07 12:29:08.979861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 07 12:29:08.979861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 07 12:29:08.979861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 07 12:29:08.979861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 12:29:08.979861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception Sep 07 12:29:08.979861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 12:29:08.979861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 07 12:29:08.979861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 12:29:08.979861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 07 12:29:08.979861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 12:29:08.979861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 07 12:29:08.979861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 12:29:08.979861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 07 12:29:08.979861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 12:29:08.979861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 12:29:08.979861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 12:29:08.979861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result.read() Sep 07 12:29:08.983028 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 12:29:08.983028 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 07 12:29:08.983028 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 12:29:08.983028 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 07 12:29:08.983028 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 12:29:08.983028 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 07 12:29:08.983028 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 12:29:08.983028 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 07 12:29:08.983028 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-852087-9-8' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 07 12:29:08.983028 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Sep 07 12:29:08.983028 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 7, 12, 29, 8, 925424), 'updated_at': None, 'host': 'n-h1-852087-9', 'aggregate_id': 8}] Sep 07 12:29:08.983028 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 07 12:29:08.983028 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.983028 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:08.983028 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.983028 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:08.983028 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 07 12:29:08.986304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 07 12:29:08.986304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 12:29:08.986304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 12:29:08.986304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:29:08.986304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:29:08.986304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:29:08.986304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:29:08.986304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 12:29:08.986304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 12:29:08.986304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Sep 07 12:29:08.986304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Sep 07 12:29:08.986304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 07 12:29:08.986304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 07 12:29:08.986304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Sep 07 12:29:08.986304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Sep 07 12:29:08.986304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Sep 07 12:29:08.986304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Sep 07 12:29:08.986304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 8 already has host n-h1-852087-9. Sep 07 12:29:08.986304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.986304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:08.989428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.989428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:08.989428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:08.989428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:08.989428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:08.989428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:08.989428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:08.989428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:08.989428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:29:08.989428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:29:08.989428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Sep 07 12:29:08.989428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 07 12:29:08.989428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 8 already has host n-h1-852087-9. Sep 07 12:29:08.989428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.989428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:08.989428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.989428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:08.989428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:08.989428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:08.989428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:29:08.989428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:29:08.993436 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 already has host n-h1-852087-9. Sep 07 12:29:08.993436 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:08.993436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ce0d6d3-0438-4089-8b13-308d24667317 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Returning 409 to user: Aggregate 8 already has host n-h1-852087-9. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:08.993436 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ce0d6d3-0438-4089-8b13-308d24667317 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/8/action" status: 409 len: 95 microversion: 2.1 time: 0.092029 Sep 07 12:29:08.993436 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 100/221] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Sep 7 12:29:08 2022] POST /compute/v2.1/os-aggregates/8/action => generated 95 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Sep 07 12:29:08.999464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4619bfec-a6da-4d6f-bd09-77320f3e6472 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-318479293"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:09.011409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.aggregate [None req-4619bfec-a6da-4d6f-bd09-77320f3e6472 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Generated uuid 34455a8d-9e6d-486f-8055-3f1a35f963ab for aggregate {{(pid=122433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 12:29:09.057083 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4619bfec-a6da-4d6f-bd09-77320f3e6472 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.081730 Sep 07 12:29:09.057886 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 101/222] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Sep 7 12:29:08 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:09.067690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ff64bd6d-faeb-4606-9c4a-236893271250 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-852087-9"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:09.092911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff64bd6d-faeb-4606-9c4a-236893271250 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:09.096881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff64bd6d-faeb-4606-9c4a-236893271250 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:09.097969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff64bd6d-faeb-4606-9c4a-236893271250 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:09.127589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-107c589a-86e6-471d-b86b-f1faf45ec465 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:09.142295 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-107c589a-86e6-471d-b86b-f1faf45ec465 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1311 microversion: 2.1 time: 0.318978 Sep 07 12:29:09.143018 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 122/223] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:08 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1311 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:09.162855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-76050c9e-7604-48f1-b082-b07c7486bb75 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:09.182403 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-76050c9e-7604-48f1-b082-b07c7486bb75 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 226 microversion: 2.1 time: 0.021014 Sep 07 12:29:09.183379 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 123/224] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Sep 7 12:29:09 2022] GET /compute/v2.1/os-aggregates/9 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:09.196804 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-11b700e3-78fc-4399-8c3a-3dd0e3db5880 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:09.256084 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-11b700e3-78fc-4399-8c3a-3dd0e3db5880 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 264 microversion: 2.1 time: 0.064190 Sep 07 12:29:09.263667 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 124/225] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Sep 7 12:29:09 2022] POST /compute/v2.1/os-aggregates/9/action => generated 264 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:29:09.278205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d329cf74-5c40-4c97-be5f-a457fc211f60 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:09.278898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d329cf74-5c40-4c97-be5f-a457fc211f60 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:09.292448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d329cf74-5c40-4c97-be5f-a457fc211f60 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:09.293427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d329cf74-5c40-4c97-be5f-a457fc211f60 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:09.293831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d329cf74-5c40-4c97-be5f-a457fc211f60 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:09.299065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d329cf74-5c40-4c97-be5f-a457fc211f60 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:09.299637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d329cf74-5c40-4c97-be5f-a457fc211f60 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:09.300082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d329cf74-5c40-4c97-be5f-a457fc211f60 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:09.388690 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ff64bd6d-faeb-4606-9c4a-236893271250 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 227 microversion: 2.1 time: 0.329693 Sep 07 12:29:09.389349 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 102/226] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Sep 7 12:29:09 2022] POST /compute/v2.1/os-aggregates/8/action => generated 227 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:09.393907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-01c908e7-f47f-4c64-a5b6-3122ddab903f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:09.394531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-01c908e7-f47f-4c64-a5b6-3122ddab903f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:09.409791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01c908e7-f47f-4c64-a5b6-3122ddab903f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:09.410290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01c908e7-f47f-4c64-a5b6-3122ddab903f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:09.411772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01c908e7-f47f-4c64-a5b6-3122ddab903f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:09.415393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d329cf74-5c40-4c97-be5f-a457fc211f60 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:09.416425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01c908e7-f47f-4c64-a5b6-3122ddab903f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:09.417343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01c908e7-f47f-4c64-a5b6-3122ddab903f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:09.417959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01c908e7-f47f-4c64-a5b6-3122ddab903f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:09.418657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d329cf74-5c40-4c97-be5f-a457fc211f60 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:09.421881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d329cf74-5c40-4c97-be5f-a457fc211f60 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:09.422535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-d329cf74-5c40-4c97-be5f-a457fc211f60 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lazy-loading 'fault' on Instance uuid 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:29:09.479697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d329cf74-5c40-4c97-be5f-a457fc211f60 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:09.492098 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d329cf74-5c40-4c97-be5f-a457fc211f60 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac" status: 200 len: 1310 microversion: 2.1 time: 0.231319 Sep 07 12:29:09.495241 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 125/227] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:09 2022] GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac => generated 1310 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:09.507617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-41ec9df1-a2cd-40fb-bb17-1366f773bdfd tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:09.532350 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-41ec9df1-a2cd-40fb-bb17-1366f773bdfd tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 240 microversion: 2.1 time: 0.035722 Sep 07 12:29:09.533548 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 126/228] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Sep 7 12:29:09 2022] GET /compute/v2.1/os-aggregates/9 => generated 240 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:09.557623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e973e243-a4f7-4030-9563-c0e59051072c tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:09.606107 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e973e243-a4f7-4030-9563-c0e59051072c tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.068443 Sep 07 12:29:09.608826 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 127/229] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Sep 7 12:29:09 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 12:29:09.619639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fd1cb370-2028-471f-bd56-3df9e57553be tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:09.671050 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fd1cb370-2028-471f-bd56-3df9e57553be tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.062009 Sep 07 12:29:09.673054 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 128/230] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Sep 7 12:29:09 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 12:29:09.682687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-28717b50-633a-4ef9-95ce-44f03364b661 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-887332770"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:09.686866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.aggregate [None req-28717b50-633a-4ef9-95ce-44f03364b661 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Generated uuid b05ef6fe-7024-4324-afb9-e7a34e87c3a8 for aggregate {{(pid=122432) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 12:29:09.727897 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-28717b50-633a-4ef9-95ce-44f03364b661 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.051898 Sep 07 12:29:09.728977 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 129/231] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Sep 7 12:29:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:09.736851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a2841fcb-be95-4b79-bb22-2f7b69e63939 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-846958556", "availability_zone": "tempest-test_az-983368265"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:09.759967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.aggregate [None req-a2841fcb-be95-4b79-bb22-2f7b69e63939 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Generated uuid 230d1d5f-a450-4693-bdd2-cc6fc23c0ae6 for aggregate {{(pid=122432) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 12:29:09.794551 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a2841fcb-be95-4b79-bb22-2f7b69e63939 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.062061 Sep 07 12:29:09.797906 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 130/232] 10.222.0.16 () {60 vars in 1165 bytes} [Wed Sep 7 12:29:09 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:10.051024 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b5b0fc45-dc16-41d2-86fa-684d5274d338 tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-852087-9"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:10.054417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b5b0fc45-dc16-41d2-86fa-684d5274d338 tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'fc22089559554620a12e1825d049e9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f16b15df1a4eae9052a0df1721ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:10.064299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b5b0fc45-dc16-41d2-86fa-684d5274d338 tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] Request method failure captured: Sep 07 12:29:10.064299 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Sep 07 12:29:10.064299 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:29:10.064299 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:29:10.064299 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:29:10.064299 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 39 Sep 07 12:29:10.064299 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:29:10.064299 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:29:10.064299 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:29:10.064299 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:10.064299 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5VsDM0mJmzWG8YdZN99uX1wpy_CeJtUlDC0He-KQ1qyZAYLVwCPLHA9f-QX8ePDdDqLKKaUYO35nbKJUvQcbF8OtUOba2-RqpRPAPgQFOKABvJop4mZPBJNAJ30yXJcTS3cNzvK58Jk3MMD2B1oJIkulBYTfLJzKyI9V9xLGPVOhk Sep 07 12:29:10.064299 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:29:10.064299 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:29:10.064299 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:29:10.064299 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:29:10.064299 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:29:10.064299 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:29:10.064299 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 54f16b15df1a4eae9052a0df1721ec67 Sep 07 12:29:10.064299 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1762963671 Sep 07 12:29:10.064299 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:29:10.064299 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:29:10.065771 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54f16b15df1a4eae9052a0df1721ec67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_54f16b15df1a4eae9052a0df1721ec67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/54f16b15df1a4eae9052a0df1721ec67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54f16b15df1a4eae9052a0df1721ec67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:10.065771 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1762963671 Sep 07 12:29:10.065771 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 54f16b15df1a4eae9052a0df1721ec67 Sep 07 12:29:10.065771 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1762963671 Sep 07 12:29:10.065771 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-AggregatesAdminNegativeTestJSON-1762963671-project Sep 07 12:29:10.065771 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:29:10.065771 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:29:10.065771 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: fc22089559554620a12e1825d049e9b8 Sep 07 12:29:10.065771 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1762963671-project Sep 07 12:29:10.065771 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:29:10.065771 n-d-852087-9 devstack@n-api.service[122432]: {"add_host": {"host": "n-h1-852087-9"}} Sep 07 12:29:10.065771 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:29:10.065771 n-d-852087-9 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 07 12:29:10.066516 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '10', 'body': {'add_host': {'host': 'n-h1-852087-9'}}} Sep 07 12:29:10.066516 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:10.066516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:10.066516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:10.066516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:10.066516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:10.066516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:10.066516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:10.066516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:10.066516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:29:10.066516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:29:10.066516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Sep 07 12:29:10.066516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Sep 07 12:29:10.066516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:29:10.066516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:29:10.066516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:29:10.066516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:29:10.066516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:29:10.066516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:29:10.067592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:29:10.067592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:29:10.067592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:29:10.067592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:29:10.067592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:29:10.067592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:29:10.067592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:29:10.067592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:29:10.067592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 07 12:29:10.067592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:10.067592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:10.067592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:10.067592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:10.067592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:10.067592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:10.067592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:29:10.067592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:29:10.067592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 07 12:29:10.067592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:10.068582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b5b0fc45-dc16-41d2-86fa-684d5274d338 tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:10.068582 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b5b0fc45-dc16-41d2-86fa-684d5274d338 tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates/10/action" status: 403 len: 118 microversion: 2.1 time: 0.267088 Sep 07 12:29:10.068582 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 131/233] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Sep 7 12:29:09 2022] POST /compute/v2.1/os-aggregates/10/action => generated 118 bytes in 270 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:29:10.073564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4d7e130a-1c4e-462d-8a94-baf9e95d9e4b tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-846958556_new", "availability_zone": "tempest-test_az-983368265_new"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:10.165451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-01c908e7-f47f-4c64-a5b6-3122ddab903f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:10.174313 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-01c908e7-f47f-4c64-a5b6-3122ddab903f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1463 microversion: 2.1 time: 0.783866 Sep 07 12:29:10.175079 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 103/234] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:09 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1463 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:10.180068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-08220e17-3552-42ad-8f8d-96b106cc9090 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:10.201086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4d7e130a-1c4e-462d-8a94-baf9e95d9e4b tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:10.201669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4d7e130a-1c4e-462d-8a94-baf9e95d9e4b tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:10.202114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4d7e130a-1c4e-462d-8a94-baf9e95d9e4b tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:10.217589 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-08220e17-3552-42ad-8f8d-96b106cc9090 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.040832 Sep 07 12:29:10.218231 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 104/235] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Sep 7 12:29:10 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 12:29:10.228774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5edf6e66-fc80-4b94-970a-c30ea45ed779 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:10.229643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5edf6e66-fc80-4b94-970a-c30ea45ed779 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 79881389-e6f0-43f3-96c3-fdb045bb956e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:10.238271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5edf6e66-fc80-4b94-970a-c30ea45ed779 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:10.239035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5edf6e66-fc80-4b94-970a-c30ea45ed779 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:10.239668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5edf6e66-fc80-4b94-970a-c30ea45ed779 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:10.240920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5edf6e66-fc80-4b94-970a-c30ea45ed779 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:10.241714 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5edf6e66-fc80-4b94-970a-c30ea45ed779 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:10.242310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5edf6e66-fc80-4b94-970a-c30ea45ed779 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:10.250122 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4d7e130a-1c4e-462d-8a94-baf9e95d9e4b tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 334 microversion: 2.1 time: 0.180443 Sep 07 12:29:10.261681 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 132/236] 10.222.0.16 () {60 vars in 1173 bytes} [Wed Sep 7 12:29:10 2022] PUT /compute/v2.1/os-aggregates/11 => generated 334 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:10.267950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e54ca594-d511-4109-9339-cefd0d78b4d3 req-8a84c0f0-9abc-4dc7-ad83-5015b07c1e9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79881389-e6f0-43f3-96c3-fdb045bb956e", "tag": "8a3023e7-a1f3-4157-96e9-c1135a576d1c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:10.280241 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e54ca594-d511-4109-9339-cefd0d78b4d3 req-8a84c0f0-9abc-4dc7-ad83-5015b07c1e9f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:10.280728 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e54ca594-d511-4109-9339-cefd0d78b4d3 req-8a84c0f0-9abc-4dc7-ad83-5015b07c1e9f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:10.281154 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e54ca594-d511-4109-9339-cefd0d78b4d3 req-8a84c0f0-9abc-4dc7-ad83-5015b07c1e9f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:10.295171 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e54ca594-d511-4109-9339-cefd0d78b4d3 req-8a84c0f0-9abc-4dc7-ad83-5015b07c1e9f service nova] Creating event network-changed:8a3023e7-a1f3-4157-96e9-c1135a576d1c for instance 79881389-e6f0-43f3-96c3-fdb045bb956e on n-h2-852087-9 Sep 07 12:29:10.301125 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e54ca594-d511-4109-9339-cefd0d78b4d3 req-8a84c0f0-9abc-4dc7-ad83-5015b07c1e9f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038102 Sep 07 12:29:10.304175 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 133/237] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:10.310066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8d1a9638-e221-41a8-8a5a-6b2c23d185d4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:10.310762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8d1a9638-e221-41a8-8a5a-6b2c23d185d4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:10.318210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d1a9638-e221-41a8-8a5a-6b2c23d185d4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:10.318863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d1a9638-e221-41a8-8a5a-6b2c23d185d4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:10.319437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d1a9638-e221-41a8-8a5a-6b2c23d185d4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:10.320268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d1a9638-e221-41a8-8a5a-6b2c23d185d4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:10.320790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d1a9638-e221-41a8-8a5a-6b2c23d185d4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:10.321280 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d1a9638-e221-41a8-8a5a-6b2c23d185d4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:10.711303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5edf6e66-fc80-4b94-970a-c30ea45ed779 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:10.716709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8d1a9638-e221-41a8-8a5a-6b2c23d185d4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:10.727391 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5edf6e66-fc80-4b94-970a-c30ea45ed779 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e" status: 200 len: 1585 microversion: 2.1 time: 0.502729 Sep 07 12:29:10.727989 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 105/238] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:10 2022] GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e => generated 1585 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:10.734594 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8d1a9638-e221-41a8-8a5a-6b2c23d185d4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1495 microversion: 2.1 time: 0.429088 Sep 07 12:29:10.738673 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 134/239] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:10 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1495 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:10.756952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7b3a6be7-260a-4732-99a9-00c04eba2eb6 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1714984529"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:10.766280 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.aggregate [None req-7b3a6be7-260a-4732-99a9-00c04eba2eb6 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Generated uuid 4de43fda-f417-4a10-a0b1-da28b034db3e for aggregate {{(pid=122432) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 12:29:10.806833 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7b3a6be7-260a-4732-99a9-00c04eba2eb6 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.057453 Sep 07 12:29:10.809735 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 135/240] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Sep 7 12:29:10 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:10.820263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea2c1442-93d4-4248-a5c5-03f4668c735c tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:10.841099 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ea2c1442-93d4-4248-a5c5-03f4668c735c tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 552 microversion: 2.1 time: 0.027222 Sep 07 12:29:10.843780 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 136/241] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Sep 7 12:29:10 2022] GET /compute/v2.1/os-aggregates => generated 552 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:10.854882 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-036e6c54-c56b-4751-9874-15fafabe686e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:10.856375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-036e6c54-c56b-4751-9874-15fafabe686e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:10.868342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-036e6c54-c56b-4751-9874-15fafabe686e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:10.869187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-036e6c54-c56b-4751-9874-15fafabe686e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:10.872016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-036e6c54-c56b-4751-9874-15fafabe686e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:10.874145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-036e6c54-c56b-4751-9874-15fafabe686e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:10.879507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-036e6c54-c56b-4751-9874-15fafabe686e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:10.880162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-036e6c54-c56b-4751-9874-15fafabe686e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:10.909120 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-036e6c54-c56b-4751-9874-15fafabe686e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] HTTP exception thrown: Instance 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac could not be found. Sep 07 12:29:10.914477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-036e6c54-c56b-4751-9874-15fafabe686e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Request method failure captured: Sep 07 12:29:10.914477 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac HTTP/1.1 Sep 07 12:29:10.914477 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:29:10.914477 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:29:10.914477 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:29:10.914477 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:29:10.914477 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:29:10.914477 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:29:10.914477 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:29:10.914477 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:10.914477 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5vrNAtLrvnS2mLr2eH1sHGdCHiiq6ihJHwa7Ii5X5y-e_PRT9DOhZAriwcztAr0w95NRniJ3h5WTLTA4JTBM32Nr-ZZBnWA0TTf1WCHu56YRoGmIcPuyld0NACed19sW_ab9VXLGIxLm6OMzIzbwar75KiG2RcEg5NiaAioi2oxTY Sep 07 12:29:10.914477 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:29:10.914477 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:29:10.914477 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:29:10.914477 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:29:10.914477 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:29:10.914477 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:29:10.914477 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 4776ccec9dd448738cf516cdd96573d2 Sep 07 12:29:10.914477 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1795891865 Sep 07 12:29:10.914477 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:29:10.914477 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:29:10.915813 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4776ccec9dd448738cf516cdd96573d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4776ccec9dd448738cf516cdd96573d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4776ccec9dd448738cf516cdd96573d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4776ccec9dd448738cf516cdd96573d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:10.915813 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersAdminTestJSON-1795891865 Sep 07 12:29:10.915813 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 4776ccec9dd448738cf516cdd96573d2 Sep 07 12:29:10.915813 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1795891865 Sep 07 12:29:10.915813 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-DeleteServersAdminTestJSON-1795891865-project Sep 07 12:29:10.915813 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:29:10.915813 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:29:10.915813 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 84d616d33dbe4521ac53ae7566591b81 Sep 07 12:29:10.915813 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersAdminTestJSON-1795891865-project Sep 07 12:29:10.915813 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:29:10.915813 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac could not be found. Sep 07 12:29:10.915813 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac'} Sep 07 12:29:10.916707 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:10.916707 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:10.916707 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:29:10.916707 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:29:10.916707 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:29:10.916707 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:29:10.916707 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:29:10.916707 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:29:10.916707 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:29:10.916707 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:29:10.916707 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac could not be found. Sep 07 12:29:10.916707 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:10.916707 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:10.916707 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:10.916707 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:10.916707 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:10.916707 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:10.916707 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:10.916707 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:10.916707 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:10.917854 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:10.917854 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:29:10.917854 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:29:10.917854 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:29:10.917854 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:29:10.917854 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:29:10.917854 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:29:10.917854 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac could not be found. Sep 07 12:29:10.917854 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:10.917854 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:10.917854 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:10.917854 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:10.917854 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:10.917854 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:10.917854 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:29:10.917854 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:29:10.917854 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac could not be found. Sep 07 12:29:10.917854 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:10.920688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-036e6c54-c56b-4751-9874-15fafabe686e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Returning 404 to user: Instance 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:10.923413 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-036e6c54-c56b-4751-9874-15fafabe686e tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac" status: 404 len: 111 microversion: 2.1 time: 0.074245 Sep 07 12:29:10.924655 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 137/242] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:10 2022] GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:29:10.974386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f3c0b3ee-3f45-4b04-9d70-41666c4f25fd tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:10.975258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f3c0b3ee-3f45-4b04-9d70-41666c4f25fd tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:10.988091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3c0b3ee-3f45-4b04-9d70-41666c4f25fd tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:10.991691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3c0b3ee-3f45-4b04-9d70-41666c4f25fd tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:10.994705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3c0b3ee-3f45-4b04-9d70-41666c4f25fd tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:10.997025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3c0b3ee-3f45-4b04-9d70-41666c4f25fd tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:11.001219 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3c0b3ee-3f45-4b04-9d70-41666c4f25fd tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:11.002778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3c0b3ee-3f45-4b04-9d70-41666c4f25fd tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:11.128364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b1c85bda-40b9-440f-a540-05bfc454680f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:11.129012 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b1c85bda-40b9-440f-a540-05bfc454680f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:11.136585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1c85bda-40b9-440f-a540-05bfc454680f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:11.137252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1c85bda-40b9-440f-a540-05bfc454680f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:11.137958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1c85bda-40b9-440f-a540-05bfc454680f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:11.139228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1c85bda-40b9-440f-a540-05bfc454680f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:11.139903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1c85bda-40b9-440f-a540-05bfc454680f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:11.140447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1c85bda-40b9-440f-a540-05bfc454680f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:11.558291 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b1c85bda-40b9-440f-a540-05bfc454680f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1646 microversion: 2.1 time: 0.631752 Sep 07 12:29:11.559299 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 138/243] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:10 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1646 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:11.564573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c0d44d67-ca5a-4aa7-a887-fcf944c8201d tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-731500725"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:11.581982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0d44d67-ca5a-4aa7-a887-fcf944c8201d tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:11.582781 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0d44d67-ca5a-4aa7-a887-fcf944c8201d tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:11.582944 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0d44d67-ca5a-4aa7-a887-fcf944c8201d tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:11.595947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0d44d67-ca5a-4aa7-a887-fcf944c8201d tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:11.596482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0d44d67-ca5a-4aa7-a887-fcf944c8201d tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:11.596876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0d44d67-ca5a-4aa7-a887-fcf944c8201d tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:11.617796 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-c0d44d67-ca5a-4aa7-a887-fcf944c8201d tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-731500725 could not be found. Sep 07 12:29:11.621022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c0d44d67-ca5a-4aa7-a887-fcf944c8201d tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Request method failure captured: Sep 07 12:29:11.621022 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Sep 07 12:29:11.621022 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:29:11.621022 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:29:11.621022 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:29:11.621022 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 57 Sep 07 12:29:11.621022 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:29:11.621022 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:29:11.621022 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:29:11.621022 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:11.621022 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5Y2qiDoilOiPt-B04kuSh7w5pTv6e-eW_PCdQK2yzbR1GQrvWnWKVPpBQbgr3zmageY16ZWq0ymrZpbH-N_htLj-5iT-QBgHzOJIZPzW3Sz-gnUeyvEXbUTC2RcbACQwOhKvNFxsgPr9b10g9bMYOjt8soFnxQztWJzQO71rudcCg Sep 07 12:29:11.621022 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:29:11.621022 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:29:11.621022 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:29:11.621022 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:29:11.621022 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:29:11.621022 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:29:11.621022 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 4b74e7a228654a05ad77f48e90607537 Sep 07 12:29:11.621022 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1655925943 Sep 07 12:29:11.621022 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member,admin Sep 07 12:29:11.621022 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member,admin Sep 07 12:29:11.622716 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b74e7a228654a05ad77f48e90607537"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b74e7a228654a05ad77f48e90607537"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b74e7a228654a05ad77f48e90607537"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b74e7a228654a05ad77f48e90607537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:11.622716 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1655925943 Sep 07 12:29:11.622716 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 4b74e7a228654a05ad77f48e90607537 Sep 07 12:29:11.622716 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1655925943 Sep 07 12:29:11.622716 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin Sep 07 12:29:11.622716 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:29:11.622716 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:29:11.622716 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 237c96c5e3714471b3d8a1a423035ca2 Sep 07 12:29:11.622716 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin Sep 07 12:29:11.622716 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:29:11.622716 n-d-852087-9 devstack@n-api.service[122432]: {"add_host": {"host": "tempest-nonexist_host-731500725"}} Sep 07 12:29:11.622716 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:29:11.623530 n-d-852087-9 devstack@n-api.service[122432]: exception: Compute host tempest-nonexist_host-731500725 could not be found. Sep 07 12:29:11.623530 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '12', 'body': {'add_host': {'host': 'tempest-nonexist_host-731500725'}}} Sep 07 12:29:11.623530 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:11.623530 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:11.623530 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 07 12:29:11.623530 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 07 12:29:11.623530 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:29:11.623530 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:29:11.623530 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 07 12:29:11.623530 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 07 12:29:11.623530 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 12:29:11.623530 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 12:29:11.623530 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 07 12:29:11.623530 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 07 12:29:11.623530 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-731500725' is not mapped to any cell Sep 07 12:29:11.623530 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:11.623530 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:11.623530 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:11.623530 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:11.623530 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 07 12:29:11.624853 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 07 12:29:11.624853 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 07 12:29:11.624853 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 07 12:29:11.624853 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 07 12:29:11.624853 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:11.624853 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:11.624853 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:11.624853 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:11.624853 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 07 12:29:11.624853 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 07 12:29:11.624853 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 12:29:11.624853 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 12:29:11.624853 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:29:11.624853 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:29:11.624853 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:29:11.624853 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:29:11.624853 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 12:29:11.624853 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 12:29:11.624853 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Sep 07 12:29:11.624853 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Sep 07 12:29:11.626317 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 07 12:29:11.626317 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 07 12:29:11.626317 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-731500725 could not be found. Sep 07 12:29:11.626317 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:11.626317 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:11.626317 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:11.626317 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:11.626317 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:11.626317 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:11.626317 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:11.626317 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:11.626317 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:11.626317 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:11.626317 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:29:11.626317 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:29:11.626317 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Sep 07 12:29:11.626317 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:29:11.626317 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-731500725 could not be found. Sep 07 12:29:11.626317 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:11.626317 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:11.626317 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:11.627727 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:11.627727 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:11.627727 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:11.627727 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:29:11.627727 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:29:11.627727 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-731500725 could not be found. Sep 07 12:29:11.627727 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:11.629088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c0d44d67-ca5a-4aa7-a887-fcf944c8201d tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-731500725 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:11.630168 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c0d44d67-ca5a-4aa7-a887-fcf944c8201d tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/12/action" status: 404 len: 110 microversion: 2.1 time: 0.069604 Sep 07 12:29:11.630911 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 139/244] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Sep 7 12:29:11 2022] POST /compute/v2.1/os-aggregates/12/action => generated 110 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:29:11.647363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3e1f01d6-eda3-4d74-8244-0d28712d54f3 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:11.682101 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f3c0b3ee-3f45-4b04-9d70-41666c4f25fd tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1614 microversion: 2.1 time: 0.952806 Sep 07 12:29:11.684042 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 106/245] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:10 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1614 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:11.692355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-58de3ef7-3de9-4395-9b7b-8765de7ed8e6 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-973952331", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:11.696599 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3e1f01d6-eda3-4d74-8244-0d28712d54f3 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.064428 Sep 07 12:29:11.698145 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 140/246] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Sep 7 12:29:11 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 12:29:11.707922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6c832fcf-3076-40ba-b44e-a2e5e3d5ff15 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:11.708543 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6c832fcf-3076-40ba-b44e-a2e5e3d5ff15 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:11.717770 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6,nova_api:DELETE=8,nova_api:UPDATE=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:11.733343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c832fcf-3076-40ba-b44e-a2e5e3d5ff15 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:11.734214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c832fcf-3076-40ba-b44e-a2e5e3d5ff15 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:11.735902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c832fcf-3076-40ba-b44e-a2e5e3d5ff15 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:11.736644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c832fcf-3076-40ba-b44e-a2e5e3d5ff15 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:11.737111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c832fcf-3076-40ba-b44e-a2e5e3d5ff15 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:11.737740 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c832fcf-3076-40ba-b44e-a2e5e3d5ff15 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:11.786447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-58de3ef7-3de9-4395-9b7b-8765de7ed8e6 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:29:12.065961 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6c832fcf-3076-40ba-b44e-a2e5e3d5ff15 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1646 microversion: 2.1 time: 0.366103 Sep 07 12:29:12.069396 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 141/247] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:11 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1646 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:12.080052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1db7f5d9-b8b4-4e7a-943d-c364578efee2 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:12.111779 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1db7f5d9-b8b4-4e7a-943d-c364578efee2 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.040943 Sep 07 12:29:12.112383 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 142/248] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Sep 7 12:29:12 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 12:29:12.124033 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1aa09645-c2f1-4665-85e7-d6c260785cde tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-459839407"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:12.129114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.aggregate [None req-1aa09645-c2f1-4665-85e7-d6c260785cde tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Generated uuid 2d7a0c2f-2057-4f97-8575-903692877b17 for aggregate {{(pid=122432) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 12:29:12.163859 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1aa09645-c2f1-4665-85e7-d6c260785cde tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.044755 Sep 07 12:29:12.170498 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 143/249] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Sep 7 12:29:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:12.171234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dcaa7c3e-8c88-4348-8aff-e3ae72bc8d1c tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:12.171890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dcaa7c3e-8c88-4348-8aff-e3ae72bc8d1c tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:12.178834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dcaa7c3e-8c88-4348-8aff-e3ae72bc8d1c tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:12.179567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dcaa7c3e-8c88-4348-8aff-e3ae72bc8d1c tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:12.180016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dcaa7c3e-8c88-4348-8aff-e3ae72bc8d1c tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:12.180822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dcaa7c3e-8c88-4348-8aff-e3ae72bc8d1c tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:12.181293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dcaa7c3e-8c88-4348-8aff-e3ae72bc8d1c tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:12.181742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dcaa7c3e-8c88-4348-8aff-e3ae72bc8d1c tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:12.218623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-58de3ef7-3de9-4395-9b7b-8765de7ed8e6 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:29:12.219224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-58de3ef7-3de9-4395-9b7b-8765de7ed8e6 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:29:12.219800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-58de3ef7-3de9-4395-9b7b-8765de7ed8e6 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:29:12.220387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-58de3ef7-3de9-4395-9b7b-8765de7ed8e6 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:29:12.220990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-58de3ef7-3de9-4395-9b7b-8765de7ed8e6 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:29:12.237798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58de3ef7-3de9-4395-9b7b-8765de7ed8e6 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:12.240177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58de3ef7-3de9-4395-9b7b-8765de7ed8e6 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:12.240738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58de3ef7-3de9-4395-9b7b-8765de7ed8e6 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:12.241699 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58de3ef7-3de9-4395-9b7b-8765de7ed8e6 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:12.245444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58de3ef7-3de9-4395-9b7b-8765de7ed8e6 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:12.246253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58de3ef7-3de9-4395-9b7b-8765de7ed8e6 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:12.293308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dcaa7c3e-8c88-4348-8aff-e3ae72bc8d1c tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b934700cad97473f92324e3b71a9ece4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c281c5da5fa467ba95cc00a54c408ae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:12.294057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dcaa7c3e-8c88-4348-8aff-e3ae72bc8d1c tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] flavor_id is None. Assuming migration. {{(pid=122432) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 07 12:29:12.294582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dcaa7c3e-8c88-4348-8aff-e3ae72bc8d1c tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122432) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 12:29:12.477874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:12.497320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-58de3ef7-3de9-4395-9b7b-8765de7ed8e6 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Getting quotas for project 4776ccec9dd448738cf516cdd96573d2. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:29:12.501735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-58de3ef7-3de9-4395-9b7b-8765de7ed8e6 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Getting quotas for user 84d616d33dbe4521ac53ae7566591b81 and project 4776ccec9dd448738cf516cdd96573d2. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:29:12.505863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=8,nova_api:INSERT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:12.517825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-58de3ef7-3de9-4395-9b7b-8765de7ed8e6 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:29:12.520313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-58de3ef7-3de9-4395-9b7b-8765de7ed8e6 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 5d805427-079e-4967-be30-5d5c8eb38517] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:29:12.561541 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dcaa7c3e-8c88-4348-8aff-e3ae72bc8d1c tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a/action" status: 202 len: 0 microversion: 2.1 time: 0.394033 Sep 07 12:29:12.562361 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 144/250] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:29:12 2022] POST /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:29:12.574286 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-22ffc1a3-adc5-4484-b2c5-f85c4a9d12fc tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:12.576350 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-58de3ef7-3de9-4395-9b7b-8765de7ed8e6 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.891083 Sep 07 12:29:12.577577 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 107/251] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:29:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:29:12.582915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd30e2a8-3a6d-4661-bfce-371249d1ddea tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:12.584939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22ffc1a3-adc5-4484-b2c5-f85c4a9d12fc tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:12.586605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22ffc1a3-adc5-4484-b2c5-f85c4a9d12fc tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:12.587047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22ffc1a3-adc5-4484-b2c5-f85c4a9d12fc tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:12.587811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22ffc1a3-adc5-4484-b2c5-f85c4a9d12fc tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:12.593111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22ffc1a3-adc5-4484-b2c5-f85c4a9d12fc tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:12.593579 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22ffc1a3-adc5-4484-b2c5-f85c4a9d12fc tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:12.593884 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd30e2a8-3a6d-4661-bfce-371249d1ddea tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Request method failure captured: Sep 07 12:29:12.593884 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 07 12:29:12.593884 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:29:12.593884 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:29:12.593884 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:29:12.593884 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 283 Sep 07 12:29:12.593884 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:29:12.593884 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:29:12.593884 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:29:12.593884 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:12.593884 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI5Y2qiDoilOiPt-B04kuSh7w5pTv6e-eW_PCdQK2yzbR1GQrvWnWKVPpBQbgr3zmageY16ZWq0ymrZpbH-N_htLj-5iT-QBgHzOJIZPzW3Sz-gnUeyvEXbUTC2RcbACQwOhKvNFxsgPr9b10g9bMYOjt8soFnxQztWJzQO71rudcCg Sep 07 12:29:12.593884 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:29:12.593884 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:29:12.593884 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:29:12.593884 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:29:12.593884 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:29:12.593884 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:29:12.593884 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 4b74e7a228654a05ad77f48e90607537 Sep 07 12:29:12.593884 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1655925943 Sep 07 12:29:12.593884 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 12:29:12.593884 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 12:29:12.595094 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b74e7a228654a05ad77f48e90607537"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b74e7a228654a05ad77f48e90607537"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b74e7a228654a05ad77f48e90607537"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b74e7a228654a05ad77f48e90607537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:12.595094 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1655925943 Sep 07 12:29:12.595094 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 4b74e7a228654a05ad77f48e90607537 Sep 07 12:29:12.595094 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1655925943 Sep 07 12:29:12.595094 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin Sep 07 12:29:12.595094 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:29:12.595094 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:29:12.595094 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 237c96c5e3714471b3d8a1a423035ca2 Sep 07 12:29:12.595094 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin Sep 07 12:29:12.595094 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:29:12.595740 n-d-852087-9 devstack@n-api.service[122433]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 07 12:29:12.595740 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:29:12.595740 n-d-852087-9 devstack@n-api.service[122433]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 12:29:12.595740 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 07 12:29:12.595740 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:12.595740 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:12.595740 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:29:12.595740 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:29:12.595740 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:29:12.595740 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:29:12.596320 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 12:29:12.596320 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:12.596320 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Sep 07 12:29:12.596320 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 07 12:29:12.596320 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:12.596320 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 07 12:29:12.596320 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 07 12:29:12.596320 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:12.596320 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:12.596320 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:12.596320 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:12.596320 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:12.596320 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:12.596320 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:12.596320 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:12.596320 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:12.596320 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:12.597248 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:29:12.597248 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:29:12.597248 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:29:12.597248 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:29:12.597248 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:29:12.597248 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:29:12.597248 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:29:12.597248 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:29:12.597248 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 12:29:12.597248 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:12.597248 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:12.597248 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:12.597248 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:12.597248 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:12.597248 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:12.599474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:29:12.599474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:29:12.599474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 12:29:12.599474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:12.599474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd30e2a8-3a6d-4661-bfce-371249d1ddea tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:12.601053 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dd30e2a8-3a6d-4661-bfce-371249d1ddea tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.020419 Sep 07 12:29:12.601053 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 108/252] 10.222.0.16 () {60 vars in 1165 bytes} [Wed Sep 7 12:29:12 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:29:12.609324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e962908b-e4eb-4c70-875d-2a37c9ea928c tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:12.618229 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e962908b-e4eb-4c70-875d-2a37c9ea928c tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.016726 Sep 07 12:29:12.618969 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 109/253] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Sep 7 12:29:12 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:12.624242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2a7e8e35-376a-4f63-b30e-36d753a600b8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:12.624859 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2a7e8e35-376a-4f63-b30e-36d753a600b8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:12.632261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a7e8e35-376a-4f63-b30e-36d753a600b8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:12.632836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a7e8e35-376a-4f63-b30e-36d753a600b8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:12.633274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a7e8e35-376a-4f63-b30e-36d753a600b8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:12.634264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a7e8e35-376a-4f63-b30e-36d753a600b8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:12.634641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a7e8e35-376a-4f63-b30e-36d753a600b8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:12.635052 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a7e8e35-376a-4f63-b30e-36d753a600b8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:12.651994 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-22ffc1a3-adc5-4484-b2c5-f85c4a9d12fc tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.084135 Sep 07 12:29:12.654296 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 145/254] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Sep 7 12:29:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:12.659460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e09d9f46-3efb-4199-96fe-23f956c512f7 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:12.663925 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e09d9f46-3efb-4199-96fe-23f956c512f7 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 5d805427-079e-4967-be30-5d5c8eb38517] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:12.743354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e09d9f46-3efb-4199-96fe-23f956c512f7 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:12.756736 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e09d9f46-3efb-4199-96fe-23f956c512f7 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517" status: 200 len: 1219 microversion: 2.1 time: 0.101211 Sep 07 12:29:12.757745 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 146/255] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:12 2022] GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517 => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:12.778340 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a5fa4a04-f3bd-4454-a140-c1f2e9d68889 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:12.785276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a5fa4a04-f3bd-4454-a140-c1f2e9d68889 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Request method failure captured: Sep 07 12:29:12.785276 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 07 12:29:12.785276 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:29:12.785276 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:29:12.785276 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:29:12.785276 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 27 Sep 07 12:29:12.785276 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:29:12.785276 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:29:12.785276 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:29:12.785276 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:12.785276 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5Y2qiDoilOiPt-B04kuSh7w5pTv6e-eW_PCdQK2yzbR1GQrvWnWKVPpBQbgr3zmageY16ZWq0ymrZpbH-N_htLj-5iT-QBgHzOJIZPzW3Sz-gnUeyvEXbUTC2RcbACQwOhKvNFxsgPr9b10g9bMYOjt8soFnxQztWJzQO71rudcCg Sep 07 12:29:12.785276 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:29:12.785276 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:29:12.785276 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:29:12.785276 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:29:12.785276 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:29:12.785276 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:29:12.785276 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 4b74e7a228654a05ad77f48e90607537 Sep 07 12:29:12.785276 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1655925943 Sep 07 12:29:12.785276 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member,admin Sep 07 12:29:12.785276 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member,admin Sep 07 12:29:12.787655 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b74e7a228654a05ad77f48e90607537"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b74e7a228654a05ad77f48e90607537"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b74e7a228654a05ad77f48e90607537"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b74e7a228654a05ad77f48e90607537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:12.787655 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1655925943 Sep 07 12:29:12.787655 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 4b74e7a228654a05ad77f48e90607537 Sep 07 12:29:12.787655 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1655925943 Sep 07 12:29:12.787655 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin Sep 07 12:29:12.787655 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:29:12.787655 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:29:12.787655 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 237c96c5e3714471b3d8a1a423035ca2 Sep 07 12:29:12.787655 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin Sep 07 12:29:12.787655 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:29:12.787655 n-d-852087-9 devstack@n-api.service[122432]: {"aggregate": {"name": ""}} Sep 07 12:29:12.787655 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:29:12.787655 n-d-852087-9 devstack@n-api.service[122432]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 07 12:29:12.788464 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'aggregate': {'name': ''}}} Sep 07 12:29:12.788464 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:12.788464 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:12.788464 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:29:12.788464 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:29:12.788464 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:29:12.788464 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:29:12.788464 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 07 12:29:12.788464 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:12.788464 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Sep 07 12:29:12.788464 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 07 12:29:12.788464 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:12.788464 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 07 12:29:12.788464 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi '' Sep 07 12:29:12.788464 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:12.788464 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:12.788464 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:12.788464 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:12.788464 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:12.788464 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:12.788464 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:12.788464 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:12.788464 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:12.790704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:12.790704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:29:12.790704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:29:12.790704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:29:12.790704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:29:12.790704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:29:12.790704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:29:12.790704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:29:12.790704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:29:12.790704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 07 12:29:12.790704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:12.790704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:12.790704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:12.790704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:12.790704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:12.790704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:12.790704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:29:12.790704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:29:12.790704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 07 12:29:12.790704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:12.791991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a5fa4a04-f3bd-4454-a140-c1f2e9d68889 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:12.791991 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a5fa4a04-f3bd-4454-a140-c1f2e9d68889 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.028111 Sep 07 12:29:12.804031 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 147/256] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Sep 7 12:29:12 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:29:12.811087 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f3c71969-bd5f-4390-a725-ec2029b38c05 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:12.858897 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f3c71969-bd5f-4390-a725-ec2029b38c05 tempest-AggregatesAdminTestJSON-1722419006 tempest-AggregatesAdminTestJSON-1722419006-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.053501 Sep 07 12:29:12.869025 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 148/257] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Sep 7 12:29:12 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 12:29:12.875175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2bae9fa5-6e1d-4342-ac05-2a930659143f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852087-9", "block_migration": true, "disk_over_commit": false}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:12.882593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2bae9fa5-6e1d-4342-ac05-2a930659143f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:12.902864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bae9fa5-6e1d-4342-ac05-2a930659143f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:12.903475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bae9fa5-6e1d-4342-ac05-2a930659143f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:12.904956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bae9fa5-6e1d-4342-ac05-2a930659143f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:12.905980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bae9fa5-6e1d-4342-ac05-2a930659143f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:12.907141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bae9fa5-6e1d-4342-ac05-2a930659143f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:12.907887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bae9fa5-6e1d-4342-ac05-2a930659143f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:12.995143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2a7e8e35-376a-4f63-b30e-36d753a600b8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:13.006446 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2a7e8e35-376a-4f63-b30e-36d753a600b8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1472 microversion: 2.1 time: 0.386404 Sep 07 12:29:13.007665 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 110/258] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:12 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1472 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:13.024423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e262463b-1634-42f1-8f4a-f052fdb1246a tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-544212370"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:13.030795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e262463b-1634-42f1-8f4a-f052fdb1246a tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'fc22089559554620a12e1825d049e9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f16b15df1a4eae9052a0df1721ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:13.038938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e262463b-1634-42f1-8f4a-f052fdb1246a tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] Request method failure captured: Sep 07 12:29:13.038938 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 07 12:29:13.038938 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:29:13.038938 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:29:13.038938 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:29:13.038938 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 59 Sep 07 12:29:13.038938 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:29:13.038938 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:29:13.038938 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:29:13.038938 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:13.038938 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI5VsDM0mJmzWG8YdZN99uX1wpy_CeJtUlDC0He-KQ1qyZAYLVwCPLHA9f-QX8ePDdDqLKKaUYO35nbKJUvQcbF8OtUOba2-RqpRPAPgQFOKABvJop4mZPBJNAJ30yXJcTS3cNzvK58Jk3MMD2B1oJIkulBYTfLJzKyI9V9xLGPVOhk Sep 07 12:29:13.038938 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:29:13.038938 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:29:13.038938 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:29:13.038938 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:29:13.038938 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:29:13.038938 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:29:13.038938 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 54f16b15df1a4eae9052a0df1721ec67 Sep 07 12:29:13.038938 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1762963671 Sep 07 12:29:13.038938 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:29:13.038938 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:29:13.040559 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54f16b15df1a4eae9052a0df1721ec67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_54f16b15df1a4eae9052a0df1721ec67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/54f16b15df1a4eae9052a0df1721ec67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54f16b15df1a4eae9052a0df1721ec67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:13.040559 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1762963671 Sep 07 12:29:13.040559 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 54f16b15df1a4eae9052a0df1721ec67 Sep 07 12:29:13.040559 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1762963671 Sep 07 12:29:13.040559 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminNegativeTestJSON-1762963671-project Sep 07 12:29:13.040559 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:29:13.040559 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:29:13.040559 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: fc22089559554620a12e1825d049e9b8 Sep 07 12:29:13.040559 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1762963671-project Sep 07 12:29:13.040559 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:29:13.040559 n-d-852087-9 devstack@n-api.service[122433]: {"aggregate": {"name": "tempest-test_aggregate-544212370"}} Sep 07 12:29:13.040559 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:29:13.040559 n-d-852087-9 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 07 12:29:13.041801 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-544212370'}}} Sep 07 12:29:13.041801 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:13.041801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:13.041801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:13.041801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:13.041801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:13.041801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:13.041801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:13.041801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:13.041801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:29:13.041801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:29:13.041801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:29:13.041801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:29:13.041801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Sep 07 12:29:13.041801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Sep 07 12:29:13.041801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:29:13.041801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:29:13.041801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:29:13.041801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:29:13.043029 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:29:13.043029 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:29:13.043029 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:29:13.043029 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:29:13.043029 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:29:13.043029 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:29:13.043029 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:29:13.043029 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:29:13.043029 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:29:13.043029 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:29:13.043029 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 07 12:29:13.043029 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:13.043029 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:13.043029 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:13.043029 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:13.043029 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:13.043029 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:13.043029 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:29:13.043029 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:29:13.043029 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 07 12:29:13.044304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:13.046389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-2bae9fa5-6e1d-4342-ac05-2a930659143f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lazy-loading 'flavor' on Instance uuid 5516035a-001e-4d31-84cc-84bca52e7b1e {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:29:13.059727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e262463b-1634-42f1-8f4a-f052fdb1246a tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:13.064719 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e262463b-1634-42f1-8f4a-f052fdb1246a tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.052879 Sep 07 12:29:13.066792 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 111/259] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Sep 7 12:29:13 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 58 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:29:13.078145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd8d813a-d4fa-4a5e-9ba3-32acf734c426 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:13.081356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dd8d813a-d4fa-4a5e-9ba3-32acf734c426 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:13.093630 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd8d813a-d4fa-4a5e-9ba3-32acf734c426 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:13.094309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd8d813a-d4fa-4a5e-9ba3-32acf734c426 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:13.095013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd8d813a-d4fa-4a5e-9ba3-32acf734c426 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:13.096091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd8d813a-d4fa-4a5e-9ba3-32acf734c426 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:13.096713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd8d813a-d4fa-4a5e-9ba3-32acf734c426 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:13.097295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd8d813a-d4fa-4a5e-9ba3-32acf734c426 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:13.116628 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-dd8d813a-d4fa-4a5e-9ba3-32acf734c426 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] HTTP exception thrown: Instance 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a could not be found. Sep 07 12:29:13.118642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd8d813a-d4fa-4a5e-9ba3-32acf734c426 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Request method failure captured: Sep 07 12:29:13.118642 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a HTTP/1.1 Sep 07 12:29:13.118642 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:29:13.118642 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:29:13.118642 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:29:13.118642 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:29:13.118642 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:29:13.118642 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:29:13.118642 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:29:13.118642 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:13.118642 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI5VylYHTMNb8F6stHaGJ7PTJuUvSZWuVfQiVbW1vQgsLkOnyuLRNLc-JP_svvSoXtEUSM31gtIJ9UC5w2MwHGUi8kJH1sQ5uZseoXQjhD9Sg71lxunA1l6ZGixUB2YPveVKiG6BOtHAKTzKtUqSmI9aFIYeD9H1o2ES4ch0ESQbHzQ Sep 07 12:29:13.118642 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:29:13.118642 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:29:13.118642 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:29:13.118642 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:29:13.118642 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:29:13.118642 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:29:13.118642 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: d71cb3cbb2ee4a9dbfcd16759a74b093 Sep 07 12:29:13.118642 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminTestJSON-543211817 Sep 07 12:29:13.118642 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:29:13.118642 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:29:13.120091 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d71cb3cbb2ee4a9dbfcd16759a74b093"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d71cb3cbb2ee4a9dbfcd16759a74b093"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d71cb3cbb2ee4a9dbfcd16759a74b093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d71cb3cbb2ee4a9dbfcd16759a74b093"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:13.120091 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminTestJSON-543211817 Sep 07 12:29:13.120091 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: d71cb3cbb2ee4a9dbfcd16759a74b093 Sep 07 12:29:13.120091 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-543211817 Sep 07 12:29:13.120091 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminTestJSON-543211817-project Sep 07 12:29:13.120091 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:29:13.120091 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:29:13.120091 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: c5151bb757514a6392a0d93f2bbfe406 Sep 07 12:29:13.120091 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminTestJSON-543211817-project Sep 07 12:29:13.120091 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:29:13.120091 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a could not be found. Sep 07 12:29:13.120091 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '57e7d46f-e8a5-4110-b7f2-05488d1bdb8a'} Sep 07 12:29:13.120892 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:13.120892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:13.120892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:29:13.120892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:29:13.120892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:29:13.120892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:29:13.120892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:29:13.120892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:29:13.120892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:29:13.120892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:29:13.120892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a could not be found. Sep 07 12:29:13.120892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:13.120892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:13.120892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:13.120892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:13.120892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:13.120892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:13.120892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:13.120892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:13.120892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:13.122206 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:13.122206 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:29:13.122206 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:29:13.122206 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:29:13.122206 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:29:13.122206 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:29:13.122206 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:29:13.122206 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:29:13.122206 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:29:13.122206 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a could not be found. Sep 07 12:29:13.122206 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:13.122206 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:13.122206 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:13.122206 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:13.122206 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:13.122206 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:13.122206 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:29:13.122206 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:29:13.122206 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a could not be found. Sep 07 12:29:13.122206 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:13.123620 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2bae9fa5-6e1d-4342-ac05-2a930659143f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Going to try to live migrate instance to n-h2-852087-9 {{(pid=122432) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 07 12:29:13.125204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd8d813a-d4fa-4a5e-9ba3-32acf734c426 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Returning 404 to user: Instance 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:13.126421 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dd8d813a-d4fa-4a5e-9ba3-32acf734c426 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "DELETE /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 404 len: 111 microversion: 2.1 time: 0.057793 Sep 07 12:29:13.127444 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 112/260] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:29:13 2022] DELETE /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:29:13.132644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-14a8638b-2423-4a37-894e-60ce9a4aff09 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1765333808"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:13.137529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.aggregate [None req-14a8638b-2423-4a37-894e-60ce9a4aff09 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Generated uuid 0984dd6a-b2d5-4333-9641-ec5465342ecc for aggregate {{(pid=122433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 12:29:13.172689 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-14a8638b-2423-4a37-894e-60ce9a4aff09 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.043736 Sep 07 12:29:13.175985 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 113/261] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Sep 7 12:29:13 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:13.190536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-03960a87-f0ce-4e9a-b808-6190c938b8e2 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:13.191412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-03960a87-f0ce-4e9a-b808-6190c938b8e2 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] [instance: 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:13.208821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03960a87-f0ce-4e9a-b808-6190c938b8e2 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:13.214089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03960a87-f0ce-4e9a-b808-6190c938b8e2 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:13.216505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03960a87-f0ce-4e9a-b808-6190c938b8e2 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:13.217974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03960a87-f0ce-4e9a-b808-6190c938b8e2 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:13.220758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03960a87-f0ce-4e9a-b808-6190c938b8e2 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:13.231932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03960a87-f0ce-4e9a-b808-6190c938b8e2 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:13.298266 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-03960a87-f0ce-4e9a-b808-6190c938b8e2 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] HTTP exception thrown: Instance 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a could not be found. Sep 07 12:29:13.300231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-03960a87-f0ce-4e9a-b808-6190c938b8e2 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Request method failure captured: Sep 07 12:29:13.300231 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a HTTP/1.1 Sep 07 12:29:13.300231 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:29:13.300231 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:29:13.300231 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:29:13.300231 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:29:13.300231 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:29:13.300231 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:29:13.300231 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:29:13.300231 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:13.300231 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI5VylYHTMNb8F6stHaGJ7PTJuUvSZWuVfQiVbW1vQgsLkOnyuLRNLc-JP_svvSoXtEUSM31gtIJ9UC5w2MwHGUi8kJH1sQ5uZseoXQjhD9Sg71lxunA1l6ZGixUB2YPveVKiG6BOtHAKTzKtUqSmI9aFIYeD9H1o2ES4ch0ESQbHzQ Sep 07 12:29:13.300231 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:29:13.300231 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:29:13.300231 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:29:13.300231 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:29:13.300231 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:29:13.300231 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:29:13.300231 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: d71cb3cbb2ee4a9dbfcd16759a74b093 Sep 07 12:29:13.300231 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminTestJSON-543211817 Sep 07 12:29:13.300231 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:29:13.300231 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:29:13.301845 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d71cb3cbb2ee4a9dbfcd16759a74b093"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d71cb3cbb2ee4a9dbfcd16759a74b093"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d71cb3cbb2ee4a9dbfcd16759a74b093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d71cb3cbb2ee4a9dbfcd16759a74b093"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:13.301845 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminTestJSON-543211817 Sep 07 12:29:13.301845 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: d71cb3cbb2ee4a9dbfcd16759a74b093 Sep 07 12:29:13.301845 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-543211817 Sep 07 12:29:13.301845 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminTestJSON-543211817-project Sep 07 12:29:13.301845 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:29:13.301845 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:29:13.301845 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: c5151bb757514a6392a0d93f2bbfe406 Sep 07 12:29:13.301845 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminTestJSON-543211817-project Sep 07 12:29:13.301845 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:29:13.301845 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a could not be found. Sep 07 12:29:13.301845 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '57e7d46f-e8a5-4110-b7f2-05488d1bdb8a'} Sep 07 12:29:13.302658 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:13.302658 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:13.302658 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:29:13.302658 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:29:13.302658 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:29:13.302658 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:29:13.302658 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:29:13.302658 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:29:13.302658 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:29:13.302658 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:29:13.302658 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a could not be found. Sep 07 12:29:13.302658 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:13.302658 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:13.302658 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:13.302658 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:13.302658 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:13.302658 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:13.302658 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:13.302658 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:13.302658 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:13.303938 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:13.303938 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:29:13.303938 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:29:13.303938 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:29:13.303938 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:29:13.303938 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:29:13.303938 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:29:13.303938 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a could not be found. Sep 07 12:29:13.303938 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:13.303938 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:13.303938 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:13.303938 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:13.303938 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:13.303938 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:13.303938 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:29:13.303938 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:29:13.303938 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a could not be found. Sep 07 12:29:13.303938 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:13.306916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-03960a87-f0ce-4e9a-b808-6190c938b8e2 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] Returning 404 to user: Instance 57e7d46f-e8a5-4110-b7f2-05488d1bdb8a could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:13.313696 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-03960a87-f0ce-4e9a-b808-6190c938b8e2 tempest-AggregatesAdminTestJSON-543211817 tempest-AggregatesAdminTestJSON-543211817-project] 10.222.0.16 "GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a" status: 404 len: 111 microversion: 2.1 time: 0.134863 Sep 07 12:29:13.314641 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 114/262] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:13 2022] GET /compute/v2.1/servers/57e7d46f-e8a5-4110-b7f2-05488d1bdb8a => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:29:13.329983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c5288997-4df0-4a58-89c9-2dcfbcd3c399 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1765333808"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:13.337843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.aggregate [None req-c5288997-4df0-4a58-89c9-2dcfbcd3c399 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Generated uuid 3e7f03d2-6d11-4cc8-8bcc-80ba3487c044 for aggregate {{(pid=122433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 12:29:13.358075 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-c5288997-4df0-4a58-89c9-2dcfbcd3c399 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1765333808 already exists. Sep 07 12:29:13.364240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c5288997-4df0-4a58-89c9-2dcfbcd3c399 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Request method failure captured: Sep 07 12:29:13.364240 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 07 12:29:13.364240 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:29:13.364240 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:29:13.364240 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:29:13.364240 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 60 Sep 07 12:29:13.364240 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:29:13.364240 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:29:13.364240 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:29:13.364240 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:13.364240 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI5Y2qiDoilOiPt-B04kuSh7w5pTv6e-eW_PCdQK2yzbR1GQrvWnWKVPpBQbgr3zmageY16ZWq0ymrZpbH-N_htLj-5iT-QBgHzOJIZPzW3Sz-gnUeyvEXbUTC2RcbACQwOhKvNFxsgPr9b10g9bMYOjt8soFnxQztWJzQO71rudcCg Sep 07 12:29:13.364240 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:29:13.364240 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:29:13.364240 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:29:13.364240 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:29:13.364240 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:29:13.364240 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:29:13.364240 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 4b74e7a228654a05ad77f48e90607537 Sep 07 12:29:13.364240 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1655925943 Sep 07 12:29:13.364240 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 12:29:13.364240 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 12:29:13.365738 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b74e7a228654a05ad77f48e90607537"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b74e7a228654a05ad77f48e90607537"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b74e7a228654a05ad77f48e90607537"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b74e7a228654a05ad77f48e90607537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:13.365738 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1655925943 Sep 07 12:29:13.365738 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 4b74e7a228654a05ad77f48e90607537 Sep 07 12:29:13.365738 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1655925943 Sep 07 12:29:13.365738 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin Sep 07 12:29:13.365738 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:29:13.365738 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:29:13.365738 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 237c96c5e3714471b3d8a1a423035ca2 Sep 07 12:29:13.365738 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin Sep 07 12:29:13.365738 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:29:13.365738 n-d-852087-9 devstack@n-api.service[122433]: {"aggregate": {"name": "tempest-test_aggregate-1765333808"}} Sep 07 12:29:13.365738 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:29:13.365738 n-d-852087-9 devstack@n-api.service[122433]: exception: Aggregate tempest-test_aggregate-1765333808 already exists. Sep 07 12:29:13.368906 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1765333808'}}} Sep 07 12:29:13.368906 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:13.368906 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:13.368906 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Sep 07 12:29:13.368906 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Sep 07 12:29:13.368906 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 12:29:13.368906 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 12:29:13.368906 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:29:13.368906 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:29:13.368906 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:29:13.368906 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:29:13.368906 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 12:29:13.368906 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 12:29:13.368906 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Sep 07 12:29:13.368906 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi aggregate.create() Sep 07 12:29:13.368906 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 07 12:29:13.368906 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 07 12:29:13.368906 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Sep 07 12:29:13.368906 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Sep 07 12:29:13.370461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 12:29:13.370461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 12:29:13.370461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Sep 07 12:29:13.370461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Sep 07 12:29:13.370461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1765333808 already exists. Sep 07 12:29:13.370461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:13.370461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:13.370461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:13.370461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:13.370461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:13.370461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:13.370461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:13.370461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:13.370461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:13.370461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:13.370461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:29:13.370461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:29:13.370461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:29:13.370461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:29:13.370461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Sep 07 12:29:13.371904 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 07 12:29:13.371904 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1765333808 already exists. Sep 07 12:29:13.371904 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:13.371904 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:13.371904 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:13.371904 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:13.371904 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:13.371904 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:13.371904 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:29:13.371904 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:29:13.371904 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1765333808 already exists. Sep 07 12:29:13.371904 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:13.378492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c5288997-4df0-4a58-89c9-2dcfbcd3c399 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1765333808 already exists. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:13.380039 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c5288997-4df0-4a58-89c9-2dcfbcd3c399 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.059767 Sep 07 12:29:13.389949 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 115/263] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Sep 7 12:29:13 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:29:13.406898 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a614968a-4407-487a-8797-8f152c347965 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:13.449997 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a614968a-4407-487a-8797-8f152c347965 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.058014 Sep 07 12:29:13.451268 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 116/264] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Sep 7 12:29:13 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 12:29:13.466341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e9433590-3536-41e7-94d3-84945dffa18a tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-228259633"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:13.477697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.aggregate [None req-e9433590-3536-41e7-94d3-84945dffa18a tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Generated uuid 8071743e-35da-4f4c-8605-17810f61e39a for aggregate {{(pid=122433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 12:29:13.542131 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e9433590-3536-41e7-94d3-84945dffa18a tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.081875 Sep 07 12:29:13.546891 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 117/265] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Sep 7 12:29:13 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:29:13.554316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec5aa886-d559-4db4-8719-28533a77ab83 tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:13.560513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ec5aa886-d559-4db4-8719-28533a77ab83 tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'fc22089559554620a12e1825d049e9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f16b15df1a4eae9052a0df1721ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:13.563788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec5aa886-d559-4db4-8719-28533a77ab83 tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] Request method failure captured: Sep 07 12:29:13.563788 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Sep 07 12:29:13.563788 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:29:13.563788 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:29:13.563788 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:29:13.563788 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:29:13.563788 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:29:13.563788 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:29:13.563788 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:29:13.563788 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:13.563788 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI5VsDM0mJmzWG8YdZN99uX1wpy_CeJtUlDC0He-KQ1qyZAYLVwCPLHA9f-QX8ePDdDqLKKaUYO35nbKJUvQcbF8OtUOba2-RqpRPAPgQFOKABvJop4mZPBJNAJ30yXJcTS3cNzvK58Jk3MMD2B1oJIkulBYTfLJzKyI9V9xLGPVOhk Sep 07 12:29:13.563788 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:29:13.563788 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:29:13.563788 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:29:13.563788 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:29:13.563788 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:29:13.563788 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:29:13.563788 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 54f16b15df1a4eae9052a0df1721ec67 Sep 07 12:29:13.563788 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1762963671 Sep 07 12:29:13.563788 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:29:13.563788 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:29:13.565266 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54f16b15df1a4eae9052a0df1721ec67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_54f16b15df1a4eae9052a0df1721ec67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/54f16b15df1a4eae9052a0df1721ec67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54f16b15df1a4eae9052a0df1721ec67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:13.565266 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1762963671 Sep 07 12:29:13.565266 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 54f16b15df1a4eae9052a0df1721ec67 Sep 07 12:29:13.565266 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1762963671 Sep 07 12:29:13.565266 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminNegativeTestJSON-1762963671-project Sep 07 12:29:13.565266 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:29:13.565266 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:29:13.565266 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: fc22089559554620a12e1825d049e9b8 Sep 07 12:29:13.565266 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1762963671-project Sep 07 12:29:13.565266 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:29:13.565266 n-d-852087-9 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 07 12:29:13.565266 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '15'} Sep 07 12:29:13.566225 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:13.566225 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:13.566225 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:13.566225 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:13.566225 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:13.566225 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:13.566225 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:13.566225 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:13.566225 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Sep 07 12:29:13.566225 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Sep 07 12:29:13.566225 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:29:13.566225 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:29:13.566225 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:29:13.566225 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:29:13.566225 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:29:13.566225 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:29:13.566225 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:29:13.566225 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:29:13.566225 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:29:13.567473 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:29:13.567473 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:29:13.567473 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:29:13.567473 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:29:13.567473 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:29:13.567473 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 07 12:29:13.567473 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:13.567473 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:13.567473 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:13.567473 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:13.567473 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:13.567473 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:13.567473 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:29:13.567473 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:29:13.567473 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 07 12:29:13.567473 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:13.573219 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec5aa886-d559-4db4-8719-28533a77ab83 tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:13.576384 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ec5aa886-d559-4db4-8719-28533a77ab83 tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.025971 Sep 07 12:29:13.579917 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 118/266] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Sep 7 12:29:13 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:29:13.592963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-be921bba-4a89-4755-b5d8-4d81ccc51a6d tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:13.648057 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-be921bba-4a89-4755-b5d8-4d81ccc51a6d tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.064835 Sep 07 12:29:13.652490 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 119/267] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Sep 7 12:29:13 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 12:29:13.664237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4c0f115e-366a-4f25-ba76-99b1a4665d34 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:13.690666 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-4c0f115e-366a-4f25-ba76-99b1a4665d34 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 07 12:29:13.692515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4c0f115e-366a-4f25-ba76-99b1a4665d34 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Request method failure captured: Sep 07 12:29:13.692515 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 07 12:29:13.692515 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:29:13.692515 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:29:13.692515 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:29:13.692515 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:29:13.692515 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:29:13.692515 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:29:13.692515 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:29:13.692515 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:13.692515 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI5Y2qiDoilOiPt-B04kuSh7w5pTv6e-eW_PCdQK2yzbR1GQrvWnWKVPpBQbgr3zmageY16ZWq0ymrZpbH-N_htLj-5iT-QBgHzOJIZPzW3Sz-gnUeyvEXbUTC2RcbACQwOhKvNFxsgPr9b10g9bMYOjt8soFnxQztWJzQO71rudcCg Sep 07 12:29:13.692515 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:29:13.692515 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:29:13.692515 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:29:13.692515 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:29:13.692515 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:29:13.692515 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:29:13.692515 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 4b74e7a228654a05ad77f48e90607537 Sep 07 12:29:13.692515 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1655925943 Sep 07 12:29:13.692515 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 12:29:13.692515 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 12:29:13.693732 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b74e7a228654a05ad77f48e90607537"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b74e7a228654a05ad77f48e90607537"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b74e7a228654a05ad77f48e90607537"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b74e7a228654a05ad77f48e90607537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:13.693732 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1655925943 Sep 07 12:29:13.693732 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 4b74e7a228654a05ad77f48e90607537 Sep 07 12:29:13.693732 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1655925943 Sep 07 12:29:13.693732 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin Sep 07 12:29:13.693732 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:29:13.693732 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:29:13.693732 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 237c96c5e3714471b3d8a1a423035ca2 Sep 07 12:29:13.693732 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin Sep 07 12:29:13.693732 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:29:13.693732 n-d-852087-9 devstack@n-api.service[122433]: exception: Aggregate -1 could not be found. Sep 07 12:29:13.693732 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '-1'} Sep 07 12:29:13.694373 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:13.694373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:13.694373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 07 12:29:13.694373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 07 12:29:13.694373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 12:29:13.694373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 12:29:13.694373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:29:13.694373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:29:13.694373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:29:13.694373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:29:13.694373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 12:29:13.694373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 12:29:13.694373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 07 12:29:13.694373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 07 12:29:13.694373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:29:13.694373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:29:13.694373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 07 12:29:13.694373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 07 12:29:13.694373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 12:29:13.695357 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 12:29:13.695357 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 07 12:29:13.695357 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 07 12:29:13.695357 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 07 12:29:13.695357 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:13.695357 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:13.695357 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:13.695357 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:13.695357 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:13.695357 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:13.695357 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:13.695357 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:13.695357 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:13.695357 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:13.695357 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 07 12:29:13.695357 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:29:13.695357 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 07 12:29:13.695357 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:13.695357 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:13.695357 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:13.695357 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:13.696393 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:13.696393 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:13.696393 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:29:13.696393 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:29:13.696393 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 07 12:29:13.696393 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:13.699387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4c0f115e-366a-4f25-ba76-99b1a4665d34 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:13.700687 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4c0f115e-366a-4f25-ba76-99b1a4665d34 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.041569 Sep 07 12:29:13.701537 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 120/268] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Sep 7 12:29:13 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:29:13.718213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-50b61a56-46c9-4383-ae1b-d1c5fa3efe60 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1870517480"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:13.730150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.aggregate [None req-50b61a56-46c9-4383-ae1b-d1c5fa3efe60 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Generated uuid 564d6753-4761-4148-a77e-f35a56de1e00 for aggregate {{(pid=122433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 12:29:13.782876 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-50b61a56-46c9-4383-ae1b-d1c5fa3efe60 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.065720 Sep 07 12:29:13.784086 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 121/269] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Sep 7 12:29:13 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:13.800104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9e6c00b9-ace1-4637-a4b5-f5355964e973 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:13.801179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9e6c00b9-ace1-4637-a4b5-f5355964e973 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 5d805427-079e-4967-be30-5d5c8eb38517] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:13.817227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e6c00b9-ace1-4637-a4b5-f5355964e973 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:13.817931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e6c00b9-ace1-4637-a4b5-f5355964e973 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:13.819813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e6c00b9-ace1-4637-a4b5-f5355964e973 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:13.847788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e6c00b9-ace1-4637-a4b5-f5355964e973 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:13.848519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e6c00b9-ace1-4637-a4b5-f5355964e973 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:13.849466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e6c00b9-ace1-4637-a4b5-f5355964e973 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:14.006180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9e6c00b9-ace1-4637-a4b5-f5355964e973 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:14.053227 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9e6c00b9-ace1-4637-a4b5-f5355964e973 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517" status: 200 len: 1223 microversion: 2.1 time: 0.265990 Sep 07 12:29:14.056717 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 122/270] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:13 2022] GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517 => generated 1223 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:14.066197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ac286136-f536-480f-b3d5-4fce5c5814be tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:14.069253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ac286136-f536-480f-b3d5-4fce5c5814be tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'fc22089559554620a12e1825d049e9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f16b15df1a4eae9052a0df1721ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:14.072208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ac286136-f536-480f-b3d5-4fce5c5814be tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] Request method failure captured: Sep 07 12:29:14.072208 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Sep 07 12:29:14.072208 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:29:14.072208 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:29:14.072208 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:29:14.072208 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:29:14.072208 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:29:14.072208 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:29:14.072208 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:29:14.072208 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:14.072208 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI5VsDM0mJmzWG8YdZN99uX1wpy_CeJtUlDC0He-KQ1qyZAYLVwCPLHA9f-QX8ePDdDqLKKaUYO35nbKJUvQcbF8OtUOba2-RqpRPAPgQFOKABvJop4mZPBJNAJ30yXJcTS3cNzvK58Jk3MMD2B1oJIkulBYTfLJzKyI9V9xLGPVOhk Sep 07 12:29:14.072208 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:29:14.072208 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:29:14.072208 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:29:14.072208 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:29:14.072208 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:29:14.072208 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:29:14.072208 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 54f16b15df1a4eae9052a0df1721ec67 Sep 07 12:29:14.072208 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1762963671 Sep 07 12:29:14.072208 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:29:14.072208 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:29:14.073888 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54f16b15df1a4eae9052a0df1721ec67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_54f16b15df1a4eae9052a0df1721ec67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/54f16b15df1a4eae9052a0df1721ec67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54f16b15df1a4eae9052a0df1721ec67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:14.073888 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1762963671 Sep 07 12:29:14.073888 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 54f16b15df1a4eae9052a0df1721ec67 Sep 07 12:29:14.073888 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1762963671 Sep 07 12:29:14.073888 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminNegativeTestJSON-1762963671-project Sep 07 12:29:14.073888 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:29:14.073888 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:29:14.073888 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: fc22089559554620a12e1825d049e9b8 Sep 07 12:29:14.073888 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1762963671-project Sep 07 12:29:14.073888 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:29:14.073888 n-d-852087-9 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 07 12:29:14.073888 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '16'} Sep 07 12:29:14.074570 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:14.074570 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:14.074570 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:14.074570 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:14.074570 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:14.074570 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:14.074570 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:14.074570 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:14.074570 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Sep 07 12:29:14.074570 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Sep 07 12:29:14.074570 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:29:14.074570 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:29:14.074570 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:29:14.074570 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:29:14.074570 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:29:14.074570 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:29:14.074570 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:29:14.074570 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:29:14.074570 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:29:14.075548 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:29:14.075548 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:29:14.075548 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:29:14.075548 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:29:14.075548 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:29:14.075548 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 07 12:29:14.075548 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:14.075548 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:14.075548 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:14.075548 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:14.075548 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:14.075548 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:14.075548 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:29:14.075548 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:29:14.075548 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 07 12:29:14.075548 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:14.078684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ac286136-f536-480f-b3d5-4fce5c5814be tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:14.081014 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ac286136-f536-480f-b3d5-4fce5c5814be tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] 10.222.0.16 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.021912 Sep 07 12:29:14.082645 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 123/271] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Sep 7 12:29:14 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:29:14.092416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ebead313-104f-48f5-b900-f19542b0b80a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:14.093215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ebead313-104f-48f5-b900-f19542b0b80a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:14.103312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebead313-104f-48f5-b900-f19542b0b80a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:14.104764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebead313-104f-48f5-b900-f19542b0b80a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:14.105462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebead313-104f-48f5-b900-f19542b0b80a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:14.117615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebead313-104f-48f5-b900-f19542b0b80a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:14.118587 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebead313-104f-48f5-b900-f19542b0b80a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:14.120606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebead313-104f-48f5-b900-f19542b0b80a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:14.338094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ebead313-104f-48f5-b900-f19542b0b80a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:14.363513 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ebead313-104f-48f5-b900-f19542b0b80a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1472 microversion: 2.1 time: 0.276271 Sep 07 12:29:14.368053 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 124/272] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:14 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1472 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:14.373820 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-92a52e79-15de-4ffc-ac68-477b0ff522b8 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:14.407218 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-92a52e79-15de-4ffc-ac68-477b0ff522b8 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.037331 Sep 07 12:29:14.409045 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 125/273] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Sep 7 12:29:14 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 12:29:14.424919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a0d0ee1f-a49d-451e-9145-2da7a4ca8581 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:14.451445 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-a0d0ee1f-a49d-451e-9145-2da7a4ca8581 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 07 12:29:14.454383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a0d0ee1f-a49d-451e-9145-2da7a4ca8581 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Request method failure captured: Sep 07 12:29:14.454383 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 07 12:29:14.454383 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:29:14.454383 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:29:14.454383 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:29:14.454383 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:29:14.454383 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:29:14.454383 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:29:14.454383 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:29:14.454383 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:14.454383 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI5Y2qiDoilOiPt-B04kuSh7w5pTv6e-eW_PCdQK2yzbR1GQrvWnWKVPpBQbgr3zmageY16ZWq0ymrZpbH-N_htLj-5iT-QBgHzOJIZPzW3Sz-gnUeyvEXbUTC2RcbACQwOhKvNFxsgPr9b10g9bMYOjt8soFnxQztWJzQO71rudcCg Sep 07 12:29:14.454383 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:29:14.454383 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:29:14.454383 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:29:14.454383 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:29:14.454383 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:29:14.454383 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:29:14.454383 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 4b74e7a228654a05ad77f48e90607537 Sep 07 12:29:14.454383 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1655925943 Sep 07 12:29:14.454383 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 12:29:14.454383 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 12:29:14.456216 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b74e7a228654a05ad77f48e90607537"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b74e7a228654a05ad77f48e90607537"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b74e7a228654a05ad77f48e90607537"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b74e7a228654a05ad77f48e90607537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:14.456216 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1655925943 Sep 07 12:29:14.456216 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 4b74e7a228654a05ad77f48e90607537 Sep 07 12:29:14.456216 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1655925943 Sep 07 12:29:14.456216 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin Sep 07 12:29:14.456216 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:29:14.456216 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:29:14.456216 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 237c96c5e3714471b3d8a1a423035ca2 Sep 07 12:29:14.456216 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin Sep 07 12:29:14.456216 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:29:14.456216 n-d-852087-9 devstack@n-api.service[122433]: exception: Aggregate -1 could not be found. Sep 07 12:29:14.456216 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '-1'} Sep 07 12:29:14.457253 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:14.457253 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:14.457253 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 07 12:29:14.457253 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 07 12:29:14.457253 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 07 12:29:14.457253 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 07 12:29:14.457253 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:29:14.457253 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:29:14.457253 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 07 12:29:14.457253 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 07 12:29:14.457253 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 12:29:14.457253 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 12:29:14.457253 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 07 12:29:14.457253 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 07 12:29:14.457253 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 07 12:29:14.457253 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:14.457253 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:14.457253 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:14.457253 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:14.457253 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:14.458628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:14.458628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:14.458628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:14.458628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:14.458628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:14.458628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 07 12:29:14.458628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:29:14.458628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 07 12:29:14.458628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:14.458628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:14.458628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:14.458628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:14.458628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:14.458628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:14.458628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:29:14.458628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:29:14.458628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 07 12:29:14.458628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:14.465510 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a0d0ee1f-a49d-451e-9145-2da7a4ca8581 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:14.466816 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a0d0ee1f-a49d-451e-9145-2da7a4ca8581 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.052161 Sep 07 12:29:14.468024 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 126/274] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Sep 7 12:29:14 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:29:14.482805 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f2682ba-a51f-46d0-91e3-0d8154233447 tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:14.484849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0f2682ba-a51f-46d0-91e3-0d8154233447 tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'fc22089559554620a12e1825d049e9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f16b15df1a4eae9052a0df1721ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:14.486885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f2682ba-a51f-46d0-91e3-0d8154233447 tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] Request method failure captured: Sep 07 12:29:14.486885 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Sep 07 12:29:14.486885 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:29:14.486885 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:29:14.486885 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:29:14.486885 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:29:14.486885 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:29:14.486885 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:29:14.486885 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:29:14.486885 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:14.486885 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI5VsDM0mJmzWG8YdZN99uX1wpy_CeJtUlDC0He-KQ1qyZAYLVwCPLHA9f-QX8ePDdDqLKKaUYO35nbKJUvQcbF8OtUOba2-RqpRPAPgQFOKABvJop4mZPBJNAJ30yXJcTS3cNzvK58Jk3MMD2B1oJIkulBYTfLJzKyI9V9xLGPVOhk Sep 07 12:29:14.486885 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:29:14.486885 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:29:14.486885 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:29:14.486885 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:29:14.486885 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:29:14.486885 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:29:14.486885 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 54f16b15df1a4eae9052a0df1721ec67 Sep 07 12:29:14.486885 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1762963671 Sep 07 12:29:14.486885 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:29:14.486885 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:29:14.488337 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54f16b15df1a4eae9052a0df1721ec67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_54f16b15df1a4eae9052a0df1721ec67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/54f16b15df1a4eae9052a0df1721ec67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54f16b15df1a4eae9052a0df1721ec67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:14.488337 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1762963671 Sep 07 12:29:14.488337 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 54f16b15df1a4eae9052a0df1721ec67 Sep 07 12:29:14.488337 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1762963671 Sep 07 12:29:14.488337 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminNegativeTestJSON-1762963671-project Sep 07 12:29:14.488337 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:29:14.488337 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:29:14.488337 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: fc22089559554620a12e1825d049e9b8 Sep 07 12:29:14.488337 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1762963671-project Sep 07 12:29:14.488337 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:29:14.488337 n-d-852087-9 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 07 12:29:14.488337 n-d-852087-9 devstack@n-api.service[122433]: action_args: {} Sep 07 12:29:14.489135 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:14.489135 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:14.489135 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:14.489135 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:14.489135 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:14.489135 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:14.489135 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:14.489135 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:14.489135 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Sep 07 12:29:14.489135 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Sep 07 12:29:14.489135 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:29:14.489135 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:29:14.489135 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:29:14.489135 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:29:14.489135 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:29:14.489135 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:29:14.489135 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:29:14.489135 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:29:14.489135 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:29:14.490376 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:29:14.490376 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:29:14.490376 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:29:14.490376 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:29:14.490376 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:29:14.490376 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 07 12:29:14.490376 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:14.490376 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:14.490376 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:14.490376 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:14.490376 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:14.490376 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:14.490376 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:29:14.490376 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:29:14.490376 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 07 12:29:14.490376 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:14.493915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f2682ba-a51f-46d0-91e3-0d8154233447 tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:14.496844 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0f2682ba-a51f-46d0-91e3-0d8154233447 tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.020552 Sep 07 12:29:14.498453 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 127/275] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Sep 7 12:29:14 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:29:14.514287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4c5cac98-b25b-44d2-8169-789008f4516b tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-879547632"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:14.519108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.aggregate [None req-4c5cac98-b25b-44d2-8169-789008f4516b tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Generated uuid 2557037b-f7fb-4d9f-84a2-6674e50d5ef9 for aggregate {{(pid=122433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 12:29:14.573097 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4c5cac98-b25b-44d2-8169-789008f4516b tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.060008 Sep 07 12:29:14.574470 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 128/276] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Sep 7 12:29:14 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:14.587559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-61a65aec-111d-401e-a282-c8cee118d626 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-852087-9"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:14.602376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61a65aec-111d-401e-a282-c8cee118d626 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:14.603017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61a65aec-111d-401e-a282-c8cee118d626 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:14.603646 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61a65aec-111d-401e-a282-c8cee118d626 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:14.798333 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-61a65aec-111d-401e-a282-c8cee118d626 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.214622 Sep 07 12:29:14.799404 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 129/277] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Sep 7 12:29:14 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:14.812487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-54b45a38-39ef-4e64-8516-097eed6448aa tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-852087-9"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:14.816589 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-54b45a38-39ef-4e64-8516-097eed6448aa tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'fc22089559554620a12e1825d049e9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f16b15df1a4eae9052a0df1721ec67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:14.821204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-54b45a38-39ef-4e64-8516-097eed6448aa tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] Request method failure captured: Sep 07 12:29:14.821204 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Sep 07 12:29:14.821204 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:29:14.821204 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:29:14.821204 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:29:14.821204 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 42 Sep 07 12:29:14.821204 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:29:14.821204 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:29:14.821204 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:29:14.821204 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:14.821204 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI5VsDM0mJmzWG8YdZN99uX1wpy_CeJtUlDC0He-KQ1qyZAYLVwCPLHA9f-QX8ePDdDqLKKaUYO35nbKJUvQcbF8OtUOba2-RqpRPAPgQFOKABvJop4mZPBJNAJ30yXJcTS3cNzvK58Jk3MMD2B1oJIkulBYTfLJzKyI9V9xLGPVOhk Sep 07 12:29:14.821204 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:29:14.821204 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:29:14.821204 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:29:14.821204 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:29:14.821204 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:29:14.821204 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:29:14.821204 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 54f16b15df1a4eae9052a0df1721ec67 Sep 07 12:29:14.821204 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1762963671 Sep 07 12:29:14.821204 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:29:14.821204 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:29:14.822475 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54f16b15df1a4eae9052a0df1721ec67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_54f16b15df1a4eae9052a0df1721ec67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/54f16b15df1a4eae9052a0df1721ec67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54f16b15df1a4eae9052a0df1721ec67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:14.822475 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1762963671 Sep 07 12:29:14.822475 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 54f16b15df1a4eae9052a0df1721ec67 Sep 07 12:29:14.822475 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1762963671 Sep 07 12:29:14.822475 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminNegativeTestJSON-1762963671-project Sep 07 12:29:14.822475 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:29:14.822475 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:29:14.822475 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: fc22089559554620a12e1825d049e9b8 Sep 07 12:29:14.822475 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1762963671-project Sep 07 12:29:14.822475 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:29:14.822475 n-d-852087-9 devstack@n-api.service[122433]: {"remove_host": {"host": "n-h1-852087-9"}} Sep 07 12:29:14.822475 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:29:14.822475 n-d-852087-9 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 07 12:29:14.823304 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-852087-9'}}} Sep 07 12:29:14.823304 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:14.823304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:14.823304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:14.823304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:14.823304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:14.823304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:14.823304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:14.823304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:14.823304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:29:14.823304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:29:14.823304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Sep 07 12:29:14.823304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Sep 07 12:29:14.823304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:29:14.823304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:29:14.823304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:29:14.823304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:29:14.823304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:29:14.823304 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:29:14.824332 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:29:14.824332 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:29:14.824332 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:29:14.824332 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:29:14.824332 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:29:14.824332 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:29:14.824332 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:29:14.824332 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:29:14.824332 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 07 12:29:14.824332 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:14.824332 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:14.824332 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:14.824332 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:14.824332 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:14.824332 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:14.824332 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:29:14.824332 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:29:14.824332 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 07 12:29:14.824332 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:14.826910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-54b45a38-39ef-4e64-8516-097eed6448aa tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:14.828548 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-54b45a38-39ef-4e64-8516-097eed6448aa tempest-AggregatesAdminNegativeTestJSON-1762963671 tempest-AggregatesAdminNegativeTestJSON-1762963671-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.021580 Sep 07 12:29:14.830847 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 130/278] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Sep 7 12:29:14 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:29:14.878180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-387b00ab-91a0-4f53-8546-6415929e57ab tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-852087-9"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:14.918952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-387b00ab-91a0-4f53-8546-6415929e57ab tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:14.922142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-387b00ab-91a0-4f53-8546-6415929e57ab tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:14.923432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-387b00ab-91a0-4f53-8546-6415929e57ab tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:15.213039 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-387b00ab-91a0-4f53-8546-6415929e57ab tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.376102 Sep 07 12:29:15.216311 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 131/279] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Sep 7 12:29:14 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:15.229693 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-efdfb7c3-92c6-481e-b334-32e85f672ce0 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:15.231845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-efdfb7c3-92c6-481e-b334-32e85f672ce0 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 5d805427-079e-4967-be30-5d5c8eb38517] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:15.247408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efdfb7c3-92c6-481e-b334-32e85f672ce0 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:15.249794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efdfb7c3-92c6-481e-b334-32e85f672ce0 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:15.250610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efdfb7c3-92c6-481e-b334-32e85f672ce0 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:15.254321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efdfb7c3-92c6-481e-b334-32e85f672ce0 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:15.258189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efdfb7c3-92c6-481e-b334-32e85f672ce0 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:15.258966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efdfb7c3-92c6-481e-b334-32e85f672ce0 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:15.375073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-efdfb7c3-92c6-481e-b334-32e85f672ce0 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:15.390619 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-efdfb7c3-92c6-481e-b334-32e85f672ce0 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517" status: 200 len: 1279 microversion: 2.1 time: 0.172669 Sep 07 12:29:15.394356 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 132/280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:15 2022] GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517 => generated 1279 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:15.407124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-21439644-53a9-45cd-b988-f60876e2598a tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:15.453720 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-21439644-53a9-45cd-b988-f60876e2598a tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.055937 Sep 07 12:29:15.455905 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 133/281] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Sep 7 12:29:15 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 12:29:15.463157 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-49ee0e8b-6545-448b-b7cc-39fa222986d2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:15.464847 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-49ee0e8b-6545-448b-b7cc-39fa222986d2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:15.473519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49ee0e8b-6545-448b-b7cc-39fa222986d2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:15.474478 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49ee0e8b-6545-448b-b7cc-39fa222986d2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:15.475228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49ee0e8b-6545-448b-b7cc-39fa222986d2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:15.476088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49ee0e8b-6545-448b-b7cc-39fa222986d2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:15.476715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49ee0e8b-6545-448b-b7cc-39fa222986d2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:15.477278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49ee0e8b-6545-448b-b7cc-39fa222986d2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:15.923959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-49ee0e8b-6545-448b-b7cc-39fa222986d2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:15.937931 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-49ee0e8b-6545-448b-b7cc-39fa222986d2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1472 microversion: 2.1 time: 0.475271 Sep 07 12:29:15.939475 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 134/282] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:15 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1472 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:15.948813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b15fd8e2-313f-4562-99d7-d13f9fb863b9 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-524546258"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:15.953292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.aggregate [None req-b15fd8e2-313f-4562-99d7-d13f9fb863b9 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Generated uuid e6fe9a64-1454-46c8-a577-6e9ad4be1b25 for aggregate {{(pid=122433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 12:29:15.983961 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b15fd8e2-313f-4562-99d7-d13f9fb863b9 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.042309 Sep 07 12:29:15.987143 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 135/283] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Sep 7 12:29:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:16.357403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bdfd3613-6f2a-47d8-a189-ce5b59d46737 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Calling method '.version_select at 0x7fc4198b8d30>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:16.363553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdfd3613-6f2a-47d8-a189-ce5b59d46737 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:16.364052 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdfd3613-6f2a-47d8-a189-ce5b59d46737 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:16.364537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdfd3613-6f2a-47d8-a189-ce5b59d46737 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:16.414090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdfd3613-6f2a-47d8-a189-ce5b59d46737 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:16.414605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdfd3613-6f2a-47d8-a189-ce5b59d46737 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:16.415049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdfd3613-6f2a-47d8-a189-ce5b59d46737 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:16.548869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdfd3613-6f2a-47d8-a189-ce5b59d46737 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:16.549999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdfd3613-6f2a-47d8-a189-ce5b59d46737 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:16.550653 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdfd3613-6f2a-47d8-a189-ce5b59d46737 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:16.573569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdfd3613-6f2a-47d8-a189-ce5b59d46737 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:16.574472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdfd3613-6f2a-47d8-a189-ce5b59d46737 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:16.575158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdfd3613-6f2a-47d8-a189-ce5b59d46737 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:16.603537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdfd3613-6f2a-47d8-a189-ce5b59d46737 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:16.604296 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdfd3613-6f2a-47d8-a189-ce5b59d46737 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:16.604833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bdfd3613-6f2a-47d8-a189-ce5b59d46737 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:16.612157 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bdfd3613-6f2a-47d8-a189-ce5b59d46737 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1915 microversion: 2.53 time: 0.623951 Sep 07 12:29:16.613271 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 136/284] 10.222.0.16 () {60 vars in 1243 bytes} [Wed Sep 7 12:29:15 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1915 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:29:16.618909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf738b5a-7a42-4b8c-8be8-0289ed1c82b4 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:16.632700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf738b5a-7a42-4b8c-8be8-0289ed1c82b4 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:16.633423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf738b5a-7a42-4b8c-8be8-0289ed1c82b4 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:16.634679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf738b5a-7a42-4b8c-8be8-0289ed1c82b4 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:16.645524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf738b5a-7a42-4b8c-8be8-0289ed1c82b4 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:16.646114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf738b5a-7a42-4b8c-8be8-0289ed1c82b4 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:16.646621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf738b5a-7a42-4b8c-8be8-0289ed1c82b4 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:16.658884 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.compute.aggregates [None req-cf738b5a-7a42-4b8c-8be8-0289ed1c82b4 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 07 12:29:16.659550 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-cf738b5a-7a42-4b8c-8be8-0289ed1c82b4 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Sep 07 12:29:16.662660 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf738b5a-7a42-4b8c-8be8-0289ed1c82b4 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Request method failure captured: Sep 07 12:29:16.662660 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Sep 07 12:29:16.662660 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:29:16.662660 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:29:16.662660 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:29:16.662660 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 42 Sep 07 12:29:16.662660 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:29:16.662660 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:29:16.662660 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:29:16.662660 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:16.662660 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI5Y2qiDoilOiPt-B04kuSh7w5pTv6e-eW_PCdQK2yzbR1GQrvWnWKVPpBQbgr3zmageY16ZWq0ymrZpbH-N_htLj-5iT-QBgHzOJIZPzW3Sz-gnUeyvEXbUTC2RcbACQwOhKvNFxsgPr9b10g9bMYOjt8soFnxQztWJzQO71rudcCg Sep 07 12:29:16.662660 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:29:16.662660 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:29:16.662660 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:29:16.662660 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:29:16.662660 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:29:16.662660 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:29:16.662660 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 4b74e7a228654a05ad77f48e90607537 Sep 07 12:29:16.662660 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1655925943 Sep 07 12:29:16.662660 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 12:29:16.662660 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 12:29:16.663919 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b74e7a228654a05ad77f48e90607537"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b74e7a228654a05ad77f48e90607537"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b74e7a228654a05ad77f48e90607537"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b74e7a228654a05ad77f48e90607537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:16.663919 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1655925943 Sep 07 12:29:16.663919 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 4b74e7a228654a05ad77f48e90607537 Sep 07 12:29:16.663919 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1655925943 Sep 07 12:29:16.663919 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin Sep 07 12:29:16.663919 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:29:16.663919 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:29:16.663919 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 237c96c5e3714471b3d8a1a423035ca2 Sep 07 12:29:16.663919 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin Sep 07 12:29:16.663919 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:29:16.663919 n-d-852087-9 devstack@n-api.service[122433]: {"remove_host": {"host": "nonexist_host"}} Sep 07 12:29:16.663919 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:29:16.663919 n-d-852087-9 devstack@n-api.service[122433]: exception: Cannot remove host nonexist_host in aggregate 18 Sep 07 12:29:16.664817 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Sep 07 12:29:16.664817 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:16.664817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:16.664817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 07 12:29:16.664817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 07 12:29:16.664817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:29:16.664817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:29:16.664817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 07 12:29:16.664817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 07 12:29:16.664817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 12:29:16.664817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 12:29:16.664817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 07 12:29:16.664817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 07 12:29:16.664817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Sep 07 12:29:16.664817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:16.664817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:16.664817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:16.664817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:16.664817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 07 12:29:16.664817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 07 12:29:16.666686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 07 12:29:16.666686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 07 12:29:16.666686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 07 12:29:16.666686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:16.666686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:16.666686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:16.666686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:16.666686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Sep 07 12:29:16.666686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Sep 07 12:29:16.666686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 12:29:16.666686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 12:29:16.666686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:29:16.666686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:29:16.666686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:29:16.666686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:29:16.666686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 12:29:16.666686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 12:29:16.666686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Sep 07 12:29:16.666686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Sep 07 12:29:16.666686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 07 12:29:16.669464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 07 12:29:16.669464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 07 12:29:16.669464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:16.669464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:16.669464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:16.669464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:16.669464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:16.669464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:16.669464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:16.669464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:16.669464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:16.669464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:16.669464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:29:16.669464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:29:16.669464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Sep 07 12:29:16.669464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 12:29:16.669464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Sep 07 12:29:16.669464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:16.669464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:16.669464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:16.669464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:16.672125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:16.672125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:16.672125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:29:16.672125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:29:16.672125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Sep 07 12:29:16.672125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:16.672125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf738b5a-7a42-4b8c-8be8-0289ed1c82b4 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:16.672125 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cf738b5a-7a42-4b8c-8be8-0289ed1c82b4 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.049667 Sep 07 12:29:16.672125 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 137/285] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Sep 7 12:29:16 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:29:16.674493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f618bc72-06cf-4ea6-98d5-d0ed738b0b4b tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:16.675556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f618bc72-06cf-4ea6-98d5-d0ed738b0b4b tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 5d805427-079e-4967-be30-5d5c8eb38517] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:16.683426 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f618bc72-06cf-4ea6-98d5-d0ed738b0b4b tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:16.683738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f618bc72-06cf-4ea6-98d5-d0ed738b0b4b tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:16.684355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f618bc72-06cf-4ea6-98d5-d0ed738b0b4b tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:16.685409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f618bc72-06cf-4ea6-98d5-d0ed738b0b4b tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:16.686727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f618bc72-06cf-4ea6-98d5-d0ed738b0b4b tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:16.687412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f618bc72-06cf-4ea6-98d5-d0ed738b0b4b tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:16.719245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:17.377303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f618bc72-06cf-4ea6-98d5-d0ed738b0b4b tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:17.391838 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f618bc72-06cf-4ea6-98d5-d0ed738b0b4b tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517" status: 200 len: 1319 microversion: 2.1 time: 0.724561 Sep 07 12:29:17.394094 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 138/286] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:16 2022] GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517 => generated 1319 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:17.409111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a340a77b-90c3-4f01-b161-22a5fd075f36 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Calling method '.version_select at 0x7fc419a91670>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:17.413528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a340a77b-90c3-4f01-b161-22a5fd075f36 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:17.414672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a340a77b-90c3-4f01-b161-22a5fd075f36 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:17.415119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a340a77b-90c3-4f01-b161-22a5fd075f36 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:17.432008 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2bae9fa5-6e1d-4342-ac05-2a930659143f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e/action" status: 202 len: 0 microversion: 2.1 time: 4.560579 Sep 07 12:29:17.432757 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 149/287] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:29:12 2022] POST /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e/action => generated 0 bytes in 4563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:29:17.438682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=9,nova_api:DELETE=9 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:17.441006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a340a77b-90c3-4f01-b161-22a5fd075f36 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:17.441603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a340a77b-90c3-4f01-b161-22a5fd075f36 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:17.441875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6df933b5-acbb-4844-a2ed-0b9d77776056 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:17.442025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a340a77b-90c3-4f01-b161-22a5fd075f36 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:17.511303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a340a77b-90c3-4f01-b161-22a5fd075f36 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:17.512432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a340a77b-90c3-4f01-b161-22a5fd075f36 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:17.513090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a340a77b-90c3-4f01-b161-22a5fd075f36 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:17.528918 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6df933b5-acbb-4844-a2ed-0b9d77776056 tempest-AggregatesAdminNegativeTestJSON-1655925943 tempest-AggregatesAdminNegativeTestJSON-1655925943-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.091814 Sep 07 12:29:17.531824 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 150/288] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Sep 7 12:29:17 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 12:29:17.540509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a340a77b-90c3-4f01-b161-22a5fd075f36 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:17.541012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a340a77b-90c3-4f01-b161-22a5fd075f36 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:17.541540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a340a77b-90c3-4f01-b161-22a5fd075f36 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:17.541973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ef3d301d-6044-4391-ae34-a19e7aad1b8f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:17.545967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ef3d301d-6044-4391-ae34-a19e7aad1b8f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:17.571730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef3d301d-6044-4391-ae34-a19e7aad1b8f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:17.572288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef3d301d-6044-4391-ae34-a19e7aad1b8f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:17.572800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef3d301d-6044-4391-ae34-a19e7aad1b8f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:17.573636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef3d301d-6044-4391-ae34-a19e7aad1b8f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:17.574166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef3d301d-6044-4391-ae34-a19e7aad1b8f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:17.574624 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef3d301d-6044-4391-ae34-a19e7aad1b8f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:17.600234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a340a77b-90c3-4f01-b161-22a5fd075f36 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:17.600763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a340a77b-90c3-4f01-b161-22a5fd075f36 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:17.601227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a340a77b-90c3-4f01-b161-22a5fd075f36 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:17.616732 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a340a77b-90c3-4f01-b161-22a5fd075f36 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 607 microversion: 2.53 time: 0.218643 Sep 07 12:29:17.627250 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 139/289] 10.222.0.16 () {60 vars in 1222 bytes} [Wed Sep 7 12:29:17 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 607 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:29:17.641270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-380987d4-256a-4eed-b20a-89fb57596b40 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:17.642136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-380987d4-256a-4eed-b20a-89fb57596b40 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:17.662328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-380987d4-256a-4eed-b20a-89fb57596b40 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:17.662823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-380987d4-256a-4eed-b20a-89fb57596b40 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:17.663252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-380987d4-256a-4eed-b20a-89fb57596b40 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:17.663950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-380987d4-256a-4eed-b20a-89fb57596b40 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:17.664398 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-380987d4-256a-4eed-b20a-89fb57596b40 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:17.664815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-380987d4-256a-4eed-b20a-89fb57596b40 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:17.915474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ef3d301d-6044-4391-ae34-a19e7aad1b8f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:17.930650 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ef3d301d-6044-4391-ae34-a19e7aad1b8f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1472 microversion: 2.1 time: 0.397666 Sep 07 12:29:17.931337 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 151/290] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:17 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1472 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:17.948564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c49002c0-02c9-4975-90b7-854c96a761e9 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Calling method '.version_select at 0x7fc4198ceee0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:17.953941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c49002c0-02c9-4975-90b7-854c96a761e9 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:17.953941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c49002c0-02c9-4975-90b7-854c96a761e9 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:17.954305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c49002c0-02c9-4975-90b7-854c96a761e9 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:18.009367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c49002c0-02c9-4975-90b7-854c96a761e9 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:18.011973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c49002c0-02c9-4975-90b7-854c96a761e9 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:18.012766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c49002c0-02c9-4975-90b7-854c96a761e9 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:18.033755 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c49002c0-02c9-4975-90b7-854c96a761e9 tempest-HypervisorAdminV253TestBase-271008446 tempest-HypervisorAdminV253TestBase-271008446-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/00f6ac3f-c4e0-488e-964a-6a6ddcaf5d65" status: 200 len: 792 microversion: 2.53 time: 0.101285 Sep 07 12:29:18.037600 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 152/291] 10.222.0.16 () {60 vars in 1298 bytes} [Wed Sep 7 12:29:17 2022] GET /compute/v2.1/os-hypervisors/00f6ac3f-c4e0-488e-964a-6a6ddcaf5d65 => generated 792 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:29:18.209083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-380987d4-256a-4eed-b20a-89fb57596b40 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:18.221845 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-380987d4-256a-4eed-b20a-89fb57596b40 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1505 microversion: 2.1 time: 0.591686 Sep 07 12:29:18.222557 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 140/292] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:17 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1505 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:18.233236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-68d5e24a-6ca0-4c76-b8f4-cd2efed950c6 req-7e79e246-7695-47fa-a65c-90b47375ff3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d805427-079e-4967-be30-5d5c8eb38517", "tag": "e3d02637-9e31-486a-bd2d-7b8356c6942f"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:18.264538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-68d5e24a-6ca0-4c76-b8f4-cd2efed950c6 req-7e79e246-7695-47fa-a65c-90b47375ff3f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:18.265031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-68d5e24a-6ca0-4c76-b8f4-cd2efed950c6 req-7e79e246-7695-47fa-a65c-90b47375ff3f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:18.265471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-68d5e24a-6ca0-4c76-b8f4-cd2efed950c6 req-7e79e246-7695-47fa-a65c-90b47375ff3f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:18.316457 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-68d5e24a-6ca0-4c76-b8f4-cd2efed950c6 req-7e79e246-7695-47fa-a65c-90b47375ff3f service nova] Creating event network-changed:e3d02637-9e31-486a-bd2d-7b8356c6942f for instance 5d805427-079e-4967-be30-5d5c8eb38517 on n-h1-852087-9 Sep 07 12:29:18.328058 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-68d5e24a-6ca0-4c76-b8f4-cd2efed950c6 req-7e79e246-7695-47fa-a65c-90b47375ff3f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105951 Sep 07 12:29:18.328694 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 153/293] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:18.418261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5a245133-7cab-476f-82fb-bc54dfc85119 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:18.419182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5a245133-7cab-476f-82fb-bc54dfc85119 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 5d805427-079e-4967-be30-5d5c8eb38517] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:18.428868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a245133-7cab-476f-82fb-bc54dfc85119 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:18.429955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a245133-7cab-476f-82fb-bc54dfc85119 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:18.432114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a245133-7cab-476f-82fb-bc54dfc85119 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:18.433329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a245133-7cab-476f-82fb-bc54dfc85119 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:18.434663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a245133-7cab-476f-82fb-bc54dfc85119 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:18.435249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a245133-7cab-476f-82fb-bc54dfc85119 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:18.615647 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5a245133-7cab-476f-82fb-bc54dfc85119 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:18.626535 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5a245133-7cab-476f-82fb-bc54dfc85119 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517" status: 200 len: 1319 microversion: 2.1 time: 0.213901 Sep 07 12:29:18.628178 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 141/294] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:18 2022] GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:18.956059 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-73792ace-c47e-4243-bcb1-b4c54cbceb45 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:18.956940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-73792ace-c47e-4243-bcb1-b4c54cbceb45 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:18.963786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73792ace-c47e-4243-bcb1-b4c54cbceb45 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:18.964667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73792ace-c47e-4243-bcb1-b4c54cbceb45 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:18.965548 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73792ace-c47e-4243-bcb1-b4c54cbceb45 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:18.966467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73792ace-c47e-4243-bcb1-b4c54cbceb45 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:18.967013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73792ace-c47e-4243-bcb1-b4c54cbceb45 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:18.967817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73792ace-c47e-4243-bcb1-b4c54cbceb45 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:19.199416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-73792ace-c47e-4243-bcb1-b4c54cbceb45 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:19.214675 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-73792ace-c47e-4243-bcb1-b4c54cbceb45 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1477 microversion: 2.1 time: 0.262110 Sep 07 12:29:19.215289 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 142/295] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:18 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1477 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:19.245968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-87159bb0-ecf0-4a08-b000-8be0e2419253 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:19.246764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-87159bb0-ecf0-4a08-b000-8be0e2419253 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:19.253590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87159bb0-ecf0-4a08-b000-8be0e2419253 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:19.254315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87159bb0-ecf0-4a08-b000-8be0e2419253 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:19.254841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87159bb0-ecf0-4a08-b000-8be0e2419253 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:19.255776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87159bb0-ecf0-4a08-b000-8be0e2419253 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:19.256494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87159bb0-ecf0-4a08-b000-8be0e2419253 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:19.256983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87159bb0-ecf0-4a08-b000-8be0e2419253 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:19.289000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-901177bf-d533-4754-ab11-e25a779eeb5a tempest-FlavorMetadataValidation-1368577464 tempest-FlavorMetadataValidation-1368577464-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1776240396", "id": 294076297, "os-flavor-access:is_public": "True"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:19.312785 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-901177bf-d533-4754-ab11-e25a779eeb5a tempest-FlavorMetadataValidation-1368577464 tempest-FlavorMetadataValidation-1368577464-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.394026 Sep 07 12:29:19.313430 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 154/296] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Sep 7 12:29:18 2022] POST /compute/v2.1/flavors => generated 468 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:29:19.327346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-80146abf-eb89-4a30-9b5e-f78a696a69e0 tempest-FlavorMetadataValidation-1368577464 tempest-FlavorMetadataValidation-1368577464-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:19.541580 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-80146abf-eb89-4a30-9b5e-f78a696a69e0 tempest-FlavorMetadataValidation-1368577464 tempest-FlavorMetadataValidation-1368577464-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/294076297/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.218138 Sep 07 12:29:19.550750 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 155/297] 10.222.0.16 () {62 vars in 1262 bytes} [Wed Sep 7 12:29:19 2022] POST /compute/v2.1/flavors/294076297/os-extra_specs => generated 62 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:29:19.561493 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7f7a8225-eca5-43d2-b14c-8df07222b183 tempest-FlavorMetadataValidation-1368577464 tempest-FlavorMetadataValidation-1368577464-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:19.596679 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7f7a8225-eca5-43d2-b14c-8df07222b183 tempest-FlavorMetadataValidation-1368577464 tempest-FlavorMetadataValidation-1368577464-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/294076297" status: 202 len: 0 microversion: 2.86 time: 0.043094 Sep 07 12:29:19.597702 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 156/298] 10.222.0.16 () {60 vars in 1199 bytes} [Wed Sep 7 12:29:19 2022] DELETE /compute/v2.1/flavors/294076297 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:29:19.615161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5aeb1dbb-a49a-4b72-b060-f40247204132 tempest-FlavorMetadataValidation-1368577464 tempest-FlavorMetadataValidation-1368577464-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:19.654040 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5aeb1dbb-a49a-4b72-b060-f40247204132 tempest-FlavorMetadataValidation-1368577464 tempest-FlavorMetadataValidation-1368577464-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6679 microversion: 2.86 time: 0.049905 Sep 07 12:29:19.655170 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 157/299] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Sep 7 12:29:19 2022] GET /compute/v2.1/flavors/detail => generated 6679 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:29:19.661987 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2bb3f728-346b-4722-9085-ef8843ad5b5a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:19.663416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2bb3f728-346b-4722-9085-ef8843ad5b5a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 5d805427-079e-4967-be30-5d5c8eb38517] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:19.677924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bb3f728-346b-4722-9085-ef8843ad5b5a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:19.678680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bb3f728-346b-4722-9085-ef8843ad5b5a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:19.679801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bb3f728-346b-4722-9085-ef8843ad5b5a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:19.682372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bb3f728-346b-4722-9085-ef8843ad5b5a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:19.683894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bb3f728-346b-4722-9085-ef8843ad5b5a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:19.686047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bb3f728-346b-4722-9085-ef8843ad5b5a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:19.688684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-87159bb0-ecf0-4a08-b000-8be0e2419253 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:19.696939 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-87159bb0-ecf0-4a08-b000-8be0e2419253 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1505 microversion: 2.1 time: 0.455333 Sep 07 12:29:19.702305 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 143/300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:19 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1505 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:29:19.926860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2bb3f728-346b-4722-9085-ef8843ad5b5a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:19.939607 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2bb3f728-346b-4722-9085-ef8843ad5b5a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517" status: 200 len: 1319 microversion: 2.1 time: 0.283088 Sep 07 12:29:19.940339 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 158/301] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:19 2022] GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:20.239465 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e2c6638b-3a17-4e23-96ec-26f3fd386012 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:20.240091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e2c6638b-3a17-4e23-96ec-26f3fd386012 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:20.247492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2c6638b-3a17-4e23-96ec-26f3fd386012 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:20.247997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2c6638b-3a17-4e23-96ec-26f3fd386012 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:20.248444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2c6638b-3a17-4e23-96ec-26f3fd386012 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:20.249212 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2c6638b-3a17-4e23-96ec-26f3fd386012 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:20.249975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2c6638b-3a17-4e23-96ec-26f3fd386012 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:20.250415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2c6638b-3a17-4e23-96ec-26f3fd386012 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:20.364066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-524e25b9-3610-46a0-b88d-f4d51c639510 req-00eaa3a2-b3bd-433a-913a-37f5084dd197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5516035a-001e-4d31-84cc-84bca52e7b1e", "name": "network-vif-unplugged", "status": "completed", "tag": "f6af2e88-520d-49f5-bc3a-8bccb5d1a54b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:20.378916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-524e25b9-3610-46a0-b88d-f4d51c639510 req-00eaa3a2-b3bd-433a-913a-37f5084dd197 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:20.383879 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-524e25b9-3610-46a0-b88d-f4d51c639510 req-00eaa3a2-b3bd-433a-913a-37f5084dd197 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:20.384410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-524e25b9-3610-46a0-b88d-f4d51c639510 req-00eaa3a2-b3bd-433a-913a-37f5084dd197 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:20.413327 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-524e25b9-3610-46a0-b88d-f4d51c639510 req-00eaa3a2-b3bd-433a-913a-37f5084dd197 service nova] Creating event network-vif-unplugged:f6af2e88-520d-49f5-bc3a-8bccb5d1a54b for instance 5516035a-001e-4d31-84cc-84bca52e7b1e on n-h1-852087-9 Sep 07 12:29:20.419662 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-524e25b9-3610-46a0-b88d-f4d51c639510 req-00eaa3a2-b3bd-433a-913a-37f5084dd197 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059047 Sep 07 12:29:20.420631 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 159/302] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:29:20.445729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e2c6638b-3a17-4e23-96ec-26f3fd386012 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:20.454913 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e2c6638b-3a17-4e23-96ec-26f3fd386012 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1477 microversion: 2.1 time: 0.219079 Sep 07 12:29:20.457624 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 144/303] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:20 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1477 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:20.732465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b31bb17d-1f59-42cf-9969-38cf54f30971 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:20.733660 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b31bb17d-1f59-42cf-9969-38cf54f30971 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:20.742989 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b31bb17d-1f59-42cf-9969-38cf54f30971 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:20.743649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b31bb17d-1f59-42cf-9969-38cf54f30971 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:20.747876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b31bb17d-1f59-42cf-9969-38cf54f30971 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:20.748931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b31bb17d-1f59-42cf-9969-38cf54f30971 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:20.749656 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b31bb17d-1f59-42cf-9969-38cf54f30971 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:20.750457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b31bb17d-1f59-42cf-9969-38cf54f30971 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:20.969061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-152a6ca1-77e8-4518-ac8c-56ac58189623 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:20.969748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-152a6ca1-77e8-4518-ac8c-56ac58189623 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 5d805427-079e-4967-be30-5d5c8eb38517] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:20.976389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-152a6ca1-77e8-4518-ac8c-56ac58189623 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:20.977061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-152a6ca1-77e8-4518-ac8c-56ac58189623 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:20.979618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-152a6ca1-77e8-4518-ac8c-56ac58189623 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:20.981968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-152a6ca1-77e8-4518-ac8c-56ac58189623 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:20.982629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-152a6ca1-77e8-4518-ac8c-56ac58189623 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:20.983425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-152a6ca1-77e8-4518-ac8c-56ac58189623 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:21.086716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b31bb17d-1f59-42cf-9969-38cf54f30971 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:21.102389 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b31bb17d-1f59-42cf-9969-38cf54f30971 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1505 microversion: 2.1 time: 0.380130 Sep 07 12:29:21.122380 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 160/304] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:20 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1505 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:21.224551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-152a6ca1-77e8-4518-ac8c-56ac58189623 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:21.232987 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-152a6ca1-77e8-4518-ac8c-56ac58189623 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517" status: 200 len: 1319 microversion: 2.1 time: 0.268723 Sep 07 12:29:21.236082 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 145/305] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:20 2022] GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517 => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:21.481555 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fb26d191-b9cd-4002-a758-a43428e9a699 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:21.482252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fb26d191-b9cd-4002-a758-a43428e9a699 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:21.488582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb26d191-b9cd-4002-a758-a43428e9a699 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:21.489273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb26d191-b9cd-4002-a758-a43428e9a699 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:21.489944 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb26d191-b9cd-4002-a758-a43428e9a699 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:21.491231 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb26d191-b9cd-4002-a758-a43428e9a699 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:21.491760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb26d191-b9cd-4002-a758-a43428e9a699 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:21.492258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb26d191-b9cd-4002-a758-a43428e9a699 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:21.646333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fb26d191-b9cd-4002-a758-a43428e9a699 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:21.655429 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fb26d191-b9cd-4002-a758-a43428e9a699 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1477 microversion: 2.1 time: 0.178635 Sep 07 12:29:21.656018 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 161/306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:21 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1477 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:22.130416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ba263b4e-83c3-428d-8bcb-08e392c250d6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:22.137997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ba263b4e-83c3-428d-8bcb-08e392c250d6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:22.145983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba263b4e-83c3-428d-8bcb-08e392c250d6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:22.147063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba263b4e-83c3-428d-8bcb-08e392c250d6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:22.148292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba263b4e-83c3-428d-8bcb-08e392c250d6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:22.149365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba263b4e-83c3-428d-8bcb-08e392c250d6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:22.150328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba263b4e-83c3-428d-8bcb-08e392c250d6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:22.150762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba263b4e-83c3-428d-8bcb-08e392c250d6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:22.303375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ba263b4e-83c3-428d-8bcb-08e392c250d6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:22.312101 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ba263b4e-83c3-428d-8bcb-08e392c250d6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1505 microversion: 2.1 time: 0.185967 Sep 07 12:29:22.328884 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 146/307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:22 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1505 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:22.335042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-58be6ff7-4634-4dee-8e3f-481a44e4669d tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:22.335899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-58be6ff7-4634-4dee-8e3f-481a44e4669d tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 5d805427-079e-4967-be30-5d5c8eb38517] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:22.342565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58be6ff7-4634-4dee-8e3f-481a44e4669d tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:22.343138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58be6ff7-4634-4dee-8e3f-481a44e4669d tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:22.343836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58be6ff7-4634-4dee-8e3f-481a44e4669d tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:22.344765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58be6ff7-4634-4dee-8e3f-481a44e4669d tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:22.345395 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58be6ff7-4634-4dee-8e3f-481a44e4669d tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:22.346040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58be6ff7-4634-4dee-8e3f-481a44e4669d tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:22.514788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-58be6ff7-4634-4dee-8e3f-481a44e4669d tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:22.519915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:22.525148 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-58be6ff7-4634-4dee-8e3f-481a44e4669d tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517" status: 200 len: 1319 microversion: 2.1 time: 0.194802 Sep 07 12:29:22.538106 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 147/308] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:22 2022] GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:22.546593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9a916fe1-6529-44f7-a5c3-e8df60a8d4dd tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1741186235", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:22.548361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-4e2fb3e2-3c12-4924-866f-31e957302b1c req-522da8c2-f717-4566-a61c-79327115fb16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5516035a-001e-4d31-84cc-84bca52e7b1e", "tag": "f6af2e88-520d-49f5-bc3a-8bccb5d1a54b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:22.559286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4e2fb3e2-3c12-4924-866f-31e957302b1c req-522da8c2-f717-4566-a61c-79327115fb16 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:22.559773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4e2fb3e2-3c12-4924-866f-31e957302b1c req-522da8c2-f717-4566-a61c-79327115fb16 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:22.560201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4e2fb3e2-3c12-4924-866f-31e957302b1c req-522da8c2-f717-4566-a61c-79327115fb16 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:22.575294 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-4e2fb3e2-3c12-4924-866f-31e957302b1c req-522da8c2-f717-4566-a61c-79327115fb16 service nova] Creating event network-changed:f6af2e88-520d-49f5-bc3a-8bccb5d1a54b for instance 5516035a-001e-4d31-84cc-84bca52e7b1e on n-h1-852087-9 Sep 07 12:29:22.593022 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-4e2fb3e2-3c12-4924-866f-31e957302b1c req-522da8c2-f717-4566-a61c-79327115fb16 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052980 Sep 07 12:29:22.594031 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 148/309] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:22.613784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=10 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:22.641463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-9a916fe1-6529-44f7-a5c3-e8df60a8d4dd tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:29:22.684627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cba0c01f-08d4-40c7-bf1b-022828112ccb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:22.685456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cba0c01f-08d4-40c7-bf1b-022828112ccb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:22.696715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cba0c01f-08d4-40c7-bf1b-022828112ccb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:22.699603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cba0c01f-08d4-40c7-bf1b-022828112ccb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:22.700326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cba0c01f-08d4-40c7-bf1b-022828112ccb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:22.702362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cba0c01f-08d4-40c7-bf1b-022828112ccb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:22.703013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cba0c01f-08d4-40c7-bf1b-022828112ccb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:22.704368 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cba0c01f-08d4-40c7-bf1b-022828112ccb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:22.748833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:22.992339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9a916fe1-6529-44f7-a5c3-e8df60a8d4dd tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:29:22.995242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9a916fe1-6529-44f7-a5c3-e8df60a8d4dd tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:29:22.996092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9a916fe1-6529-44f7-a5c3-e8df60a8d4dd tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:29:22.996662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9a916fe1-6529-44f7-a5c3-e8df60a8d4dd tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:29:22.999166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9a916fe1-6529-44f7-a5c3-e8df60a8d4dd tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:29:23.009990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a916fe1-6529-44f7-a5c3-e8df60a8d4dd tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:23.012414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a916fe1-6529-44f7-a5c3-e8df60a8d4dd tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:23.012874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a916fe1-6529-44f7-a5c3-e8df60a8d4dd tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:23.013961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a916fe1-6529-44f7-a5c3-e8df60a8d4dd tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:23.014644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a916fe1-6529-44f7-a5c3-e8df60a8d4dd tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:23.015637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a916fe1-6529-44f7-a5c3-e8df60a8d4dd tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:23.017221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cba0c01f-08d4-40c7-bf1b-022828112ccb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:23.028955 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cba0c01f-08d4-40c7-bf1b-022828112ccb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1477 microversion: 2.1 time: 0.352903 Sep 07 12:29:23.030031 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 149/310] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:22 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1477 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:23.056996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-9a916fe1-6529-44f7-a5c3-e8df60a8d4dd tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Getting quotas for project 3d676a2aa1bf4032965482efdd697502. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:29:23.065068 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-9a916fe1-6529-44f7-a5c3-e8df60a8d4dd tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Getting quotas for user 4f867ffebff94e3785cbaf0dc19f518d and project 3d676a2aa1bf4032965482efdd697502. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:29:23.083066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9a916fe1-6529-44f7-a5c3-e8df60a8d4dd tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:29:23.086264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9a916fe1-6529-44f7-a5c3-e8df60a8d4dd tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] [instance: 3922432a-d58f-4f0a-9471-5c8c210caa9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:29:23.151500 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9a916fe1-6529-44f7-a5c3-e8df60a8d4dd tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.019099 Sep 07 12:29:23.155634 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 162/311] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:29:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 12:29:23.166273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-29aa00c6-b715-43af-a92c-4697549db800 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:23.167830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-29aa00c6-b715-43af-a92c-4697549db800 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] [instance: 3922432a-d58f-4f0a-9471-5c8c210caa9e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:23.246382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-29aa00c6-b715-43af-a92c-4697549db800 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f867ffebff94e3785cbaf0dc19f518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d676a2aa1bf4032965482efdd697502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:23.255706 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-29aa00c6-b715-43af-a92c-4697549db800 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] 10.222.0.16 "GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e" status: 200 len: 1223 microversion: 2.1 time: 0.095407 Sep 07 12:29:23.270580 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 150/312] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:23 2022] GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e => generated 1223 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:23.338067 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d5dbacbc-62c2-4c02-8df5-6215a8b17482 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:23.338960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d5dbacbc-62c2-4c02-8df5-6215a8b17482 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:23.349436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5dbacbc-62c2-4c02-8df5-6215a8b17482 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:23.350257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5dbacbc-62c2-4c02-8df5-6215a8b17482 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:23.350852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5dbacbc-62c2-4c02-8df5-6215a8b17482 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:23.351592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5dbacbc-62c2-4c02-8df5-6215a8b17482 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:23.352213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5dbacbc-62c2-4c02-8df5-6215a8b17482 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:23.352795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5dbacbc-62c2-4c02-8df5-6215a8b17482 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:23.398524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=9,nova_api:INSERT=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:23.554549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-87c8577b-2b05-4a1d-bf81-bb5407a7a8f2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:23.554549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-87c8577b-2b05-4a1d-bf81-bb5407a7a8f2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 5d805427-079e-4967-be30-5d5c8eb38517] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:23.563319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87c8577b-2b05-4a1d-bf81-bb5407a7a8f2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:23.565935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87c8577b-2b05-4a1d-bf81-bb5407a7a8f2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:23.566334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87c8577b-2b05-4a1d-bf81-bb5407a7a8f2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:23.569975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87c8577b-2b05-4a1d-bf81-bb5407a7a8f2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:23.571688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87c8577b-2b05-4a1d-bf81-bb5407a7a8f2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:23.572141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87c8577b-2b05-4a1d-bf81-bb5407a7a8f2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:23.620217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d5dbacbc-62c2-4c02-8df5-6215a8b17482 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:23.629285 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d5dbacbc-62c2-4c02-8df5-6215a8b17482 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1505 microversion: 2.1 time: 0.296554 Sep 07 12:29:23.629892 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 163/313] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:23 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1505 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:23.818449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-87c8577b-2b05-4a1d-bf81-bb5407a7a8f2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:23.828641 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-87c8577b-2b05-4a1d-bf81-bb5407a7a8f2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517" status: 200 len: 1319 microversion: 2.1 time: 0.281301 Sep 07 12:29:23.843534 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 151/314] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:23 2022] GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517 => generated 1319 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:24.058014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d76ac7d-1f33-4b23-97e5-7b1abb641f79 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:24.058987 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1d76ac7d-1f33-4b23-97e5-7b1abb641f79 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:24.065599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d76ac7d-1f33-4b23-97e5-7b1abb641f79 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:24.066367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d76ac7d-1f33-4b23-97e5-7b1abb641f79 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:24.067137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d76ac7d-1f33-4b23-97e5-7b1abb641f79 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:24.068062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d76ac7d-1f33-4b23-97e5-7b1abb641f79 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:24.069055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d76ac7d-1f33-4b23-97e5-7b1abb641f79 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:24.069721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d76ac7d-1f33-4b23-97e5-7b1abb641f79 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:24.270990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1d76ac7d-1f33-4b23-97e5-7b1abb641f79 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:24.279926 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1d76ac7d-1f33-4b23-97e5-7b1abb641f79 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1477 microversion: 2.1 time: 0.226929 Sep 07 12:29:24.280853 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 164/315] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:24 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1477 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:24.283767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ff3d8635-1d33-49d2-b511-12dd37b10e60 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:24.284383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ff3d8635-1d33-49d2-b511-12dd37b10e60 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] [instance: 3922432a-d58f-4f0a-9471-5c8c210caa9e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:24.297301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff3d8635-1d33-49d2-b511-12dd37b10e60 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:24.297947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff3d8635-1d33-49d2-b511-12dd37b10e60 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:24.298394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff3d8635-1d33-49d2-b511-12dd37b10e60 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:24.299152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff3d8635-1d33-49d2-b511-12dd37b10e60 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:24.301904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff3d8635-1d33-49d2-b511-12dd37b10e60 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:24.302486 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff3d8635-1d33-49d2-b511-12dd37b10e60 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:24.372764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ff3d8635-1d33-49d2-b511-12dd37b10e60 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f867ffebff94e3785cbaf0dc19f518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d676a2aa1bf4032965482efdd697502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:24.381715 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ff3d8635-1d33-49d2-b511-12dd37b10e60 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] 10.222.0.16 "GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e" status: 200 len: 1275 microversion: 2.1 time: 0.103380 Sep 07 12:29:24.382707 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 152/316] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:24 2022] GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e => generated 1275 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:29:24.653959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-00a3ceb6-6571-45d4-a6fc-e6d4f4602875 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:24.654729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-00a3ceb6-6571-45d4-a6fc-e6d4f4602875 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:24.661215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00a3ceb6-6571-45d4-a6fc-e6d4f4602875 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:24.661750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00a3ceb6-6571-45d4-a6fc-e6d4f4602875 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:24.662193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00a3ceb6-6571-45d4-a6fc-e6d4f4602875 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:24.662888 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00a3ceb6-6571-45d4-a6fc-e6d4f4602875 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:24.663545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00a3ceb6-6571-45d4-a6fc-e6d4f4602875 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:24.664155 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00a3ceb6-6571-45d4-a6fc-e6d4f4602875 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:24.671660 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eebfccf2-0020-43ff-b290-bed4f7245939 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-2023963490", "ram": 512, "vcpus": 1, "disk": 10, "id": 2016863168, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:24.701364 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eebfccf2-0020-43ff-b290-bed4f7245939 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.341605 Sep 07 12:29:24.711480 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 165/317] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:29:24 2022] POST /compute/v2.1/flavors => generated 416 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:24.841836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-00a3ceb6-6571-45d4-a6fc-e6d4f4602875 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:24.851090 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-00a3ceb6-6571-45d4-a6fc-e6d4f4602875 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1505 microversion: 2.1 time: 0.201172 Sep 07 12:29:24.851960 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 153/318] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:24 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1505 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:24.954589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d15414b4-3375-4603-942e-2e5a1afa2196 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:24.963727 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-d15414b4-3375-4603-942e-2e5a1afa2196 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project] HTTP exception thrown: Flavor 2016863168 has no extra specs with key hw:cpu_thread_policy. Sep 07 12:29:24.965511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d15414b4-3375-4603-942e-2e5a1afa2196 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project] Request method failure captured: Sep 07 12:29:24.965511 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/flavors/2016863168/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 07 12:29:24.965511 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:29:24.965511 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:29:24.965511 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:29:24.965511 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:29:24.965511 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:29:24.965511 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:29:24.965511 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:29:24.965511 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:24.965511 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI6i1DfeSUHiT6iXjJDSmc7zv8Nck_WpD5oOdJgTbgk5QJdDDYV-TkkC2U6V1OelnWeVnqzHPyNG_2jFNXy6B3TDnAyn96tQ5vggvKJWp2MGpkX48Ue5UvnpP7DHBGdTErMluwjkNm_eWcsfOWdd3D9fzYpwqXWPrCUB14A5vOZ0yU8 Sep 07 12:29:24.965511 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:29:24.965511 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:29:24.965511 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:29:24.965511 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:29:24.965511 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:29:24.965511 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:29:24.965511 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 066902757df54f628405de52a9c6bea6 Sep 07 12:29:24.965511 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 Sep 07 12:29:24.965511 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:29:24.965511 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:29:24.966813 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/066902757df54f628405de52a9c6bea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_066902757df54f628405de52a9c6bea6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/066902757df54f628405de52a9c6bea6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/066902757df54f628405de52a9c6bea6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:24.966813 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 Sep 07 12:29:24.966813 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 066902757df54f628405de52a9c6bea6 Sep 07 12:29:24.966813 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 Sep 07 12:29:24.966813 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project Sep 07 12:29:24.966813 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:29:24.966813 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:29:24.966813 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: d0df9f3b71014ec29e462431e3759a92 Sep 07 12:29:24.966813 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project Sep 07 12:29:24.966813 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:29:24.966813 n-d-852087-9 devstack@n-api.service[122432]: exception: Flavor 2016863168 has no extra specs with key hw:cpu_thread_policy. Sep 07 12:29:24.967433 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'flavor_id': '2016863168', 'id': 'hw:cpu_thread_policy'} Sep 07 12:29:24.967433 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:24.967433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:24.967433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Sep 07 12:29:24.967433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Sep 07 12:29:24.967433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 07 12:29:24.967433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:24.967433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:24.967433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:24.967433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:24.967433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:24.967433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:24.967433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:24.967433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:24.967433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:24.967433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:24.967433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Sep 07 12:29:24.967433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 07 12:29:24.967433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2016863168 has no extra specs with key hw:cpu_thread_policy. Sep 07 12:29:24.967433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:24.967433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:24.967433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:24.968619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:24.968619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:24.968619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:24.968619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:29:24.968619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:29:24.968619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2016863168 has no extra specs with key hw:cpu_thread_policy. Sep 07 12:29:24.968619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:24.968619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d15414b4-3375-4603-942e-2e5a1afa2196 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project] Returning 404 to user: Flavor 2016863168 has no extra specs with key hw:cpu_thread_policy. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:24.968619 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d15414b4-3375-4603-942e-2e5a1afa2196 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project] 10.222.0.16 "GET /compute/v2.1/flavors/2016863168/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.254114 Sep 07 12:29:24.968619 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 166/319] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Sep 7 12:29:24 2022] GET /compute/v2.1/flavors/2016863168/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 255 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:29:24.976711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4fe65baa-574f-454b-814d-7c40d56ed8de tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:24.977326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4fe65baa-574f-454b-814d-7c40d56ed8de tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 5d805427-079e-4967-be30-5d5c8eb38517] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:24.995435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fe65baa-574f-454b-814d-7c40d56ed8de tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:24.995916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fe65baa-574f-454b-814d-7c40d56ed8de tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:24.996524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fe65baa-574f-454b-814d-7c40d56ed8de tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:24.997223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fe65baa-574f-454b-814d-7c40d56ed8de tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:24.997714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fe65baa-574f-454b-814d-7c40d56ed8de tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:25.002921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fe65baa-574f-454b-814d-7c40d56ed8de tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:25.003140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3e6fa00b-3b17-4428-b4e3-accc2edf42de tempest-FlavorsV261TestJSON-1335488594 tempest-FlavorsV261TestJSON-1335488594-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-613407596", "id": 569484675, "os-flavor-access:is_public": "True"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:25.022935 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3e6fa00b-3b17-4428-b4e3-accc2edf42de tempest-FlavorsV261TestJSON-1335488594 tempest-FlavorsV261TestJSON-1335488594-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.169503 Sep 07 12:29:25.023499 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 154/320] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Sep 7 12:29:24 2022] POST /compute/v2.1/flavors => generated 464 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:29:25.088319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ba9516d7-732c-46df-a702-fa97e9b6ee2a tempest-InstanceUsageAuditLogTestJSON-110327866 tempest-InstanceUsageAuditLogTestJSON-110327866-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:25.112538 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ba9516d7-732c-46df-a702-fa97e9b6ee2a tempest-InstanceUsageAuditLogTestJSON-110327866 tempest-InstanceUsageAuditLogTestJSON-110327866-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-07 12:29:24" status: 200 len: 318 microversion: 2.1 time: 0.087937 Sep 07 12:29:25.113120 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 155/321] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Sep 7 12:29:25 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-07%2012%3A29%3A24 => generated 318 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:25.118144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0118fa5b-8dff-4091-a6a3-d11a1a9c02c2 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:25.121953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0118fa5b-8dff-4091-a6a3-d11a1a9c02c2 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'd0df9f3b71014ec29e462431e3759a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066902757df54f628405de52a9c6bea6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:25.123918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0118fa5b-8dff-4091-a6a3-d11a1a9c02c2 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project] Request method failure captured: Sep 07 12:29:25.123918 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/flavors/2016863168/os-extra_specs HTTP/1.1 Sep 07 12:29:25.123918 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:29:25.123918 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:29:25.123918 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:29:25.123918 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 66 Sep 07 12:29:25.123918 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:29:25.123918 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:29:25.123918 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:29:25.123918 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:25.123918 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI6i1DfeSUHiT6iXjJDSmc7zv8Nck_WpD5oOdJgTbgk5QJdDDYV-TkkC2U6V1OelnWeVnqzHPyNG_2jFNXy6B3TDnAyn96tQ5vggvKJWp2MGpkX48Ue5UvnpP7DHBGdTErMluwjkNm_eWcsfOWdd3D9fzYpwqXWPrCUB14A5vOZ0yU8 Sep 07 12:29:25.123918 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:29:25.123918 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:29:25.123918 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:29:25.123918 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:29:25.123918 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:29:25.123918 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:29:25.123918 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 066902757df54f628405de52a9c6bea6 Sep 07 12:29:25.123918 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 Sep 07 12:29:25.123918 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:29:25.123918 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:29:25.125112 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/066902757df54f628405de52a9c6bea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_066902757df54f628405de52a9c6bea6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/066902757df54f628405de52a9c6bea6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/066902757df54f628405de52a9c6bea6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:25.125112 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 Sep 07 12:29:25.125112 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 066902757df54f628405de52a9c6bea6 Sep 07 12:29:25.125112 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 Sep 07 12:29:25.125112 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project Sep 07 12:29:25.125112 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:29:25.125112 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:29:25.125112 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: d0df9f3b71014ec29e462431e3759a92 Sep 07 12:29:25.125112 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project Sep 07 12:29:25.125112 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:29:25.125112 n-d-852087-9 devstack@n-api.service[122433]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Sep 07 12:29:25.125112 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:29:25.125855 n-d-852087-9 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 07 12:29:25.125855 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'flavor_id': '2016863168', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Sep 07 12:29:25.125855 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:25.125855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:25.125855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:25.125855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:25.125855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:25.125855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:25.125855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:25.125855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:25.125855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:29:25.125855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:29:25.125855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Sep 07 12:29:25.125855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Sep 07 12:29:25.125855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:29:25.125855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:29:25.125855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:29:25.125855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:29:25.125855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:29:25.126846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:29:25.126846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:29:25.126846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:29:25.126846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:29:25.126846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:29:25.126846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:29:25.126846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:29:25.126846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:29:25.126846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:29:25.126846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 07 12:29:25.126846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:25.126846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:25.126846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:25.126846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:25.126846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:25.126846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:25.126846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:29:25.126846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:29:25.126846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 07 12:29:25.126846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:25.127904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0118fa5b-8dff-4091-a6a3-d11a1a9c02c2 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:25.127904 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0118fa5b-8dff-4091-a6a3-d11a1a9c02c2 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project] 10.222.0.16 "POST /compute/v2.1/flavors/2016863168/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.011187 Sep 07 12:29:25.127904 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 156/322] 10.222.0.16 () {60 vars in 1224 bytes} [Wed Sep 7 12:29:25 2022] POST /compute/v2.1/flavors/2016863168/os-extra_specs => generated 124 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:29:25.176378 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4fe65baa-574f-454b-814d-7c40d56ed8de tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:25.184996 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4fe65baa-574f-454b-814d-7c40d56ed8de tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517" status: 200 len: 1319 microversion: 2.1 time: 0.211910 Sep 07 12:29:25.185598 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 167/323] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:24 2022] GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:25.215474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aee44ddb-2ca3-4e64-8a4f-957f89314d6a tempest-InstanceUsageAuditLogTestJSON-110327866 tempest-InstanceUsageAuditLogTestJSON-110327866-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:25.239027 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aee44ddb-2ca3-4e64-8a4f-957f89314d6a tempest-InstanceUsageAuditLogTestJSON-110327866 tempest-InstanceUsageAuditLogTestJSON-110327866-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.052319 Sep 07 12:29:25.240542 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 168/324] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Sep 7 12:29:25 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:25.247434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5b6681df-c9e8-4484-a7e7-32165af1bb93 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:25.286497 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5b6681df-c9e8-4484-a7e7-32165af1bb93 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/2016863168/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.044196 Sep 07 12:29:25.288005 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 169/325] 10.222.0.16 () {60 vars in 1224 bytes} [Wed Sep 7 12:29:25 2022] POST /compute/v2.1/flavors/2016863168/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:29:25.311297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ee2b9730-3b27-42d1-a695-fbf027731a24 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:25.317831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ee2b9730-3b27-42d1-a695-fbf027731a24 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'd0df9f3b71014ec29e462431e3759a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066902757df54f628405de52a9c6bea6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:25.323352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ee2b9730-3b27-42d1-a695-fbf027731a24 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project] Request method failure captured: Sep 07 12:29:25.323352 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/flavors/2016863168/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 07 12:29:25.323352 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:29:25.323352 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:29:25.323352 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:29:25.323352 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:29:25.323352 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:29:25.323352 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:29:25.323352 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:29:25.323352 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:25.323352 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI6i1DfeSUHiT6iXjJDSmc7zv8Nck_WpD5oOdJgTbgk5QJdDDYV-TkkC2U6V1OelnWeVnqzHPyNG_2jFNXy6B3TDnAyn96tQ5vggvKJWp2MGpkX48Ue5UvnpP7DHBGdTErMluwjkNm_eWcsfOWdd3D9fzYpwqXWPrCUB14A5vOZ0yU8 Sep 07 12:29:25.323352 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:29:25.323352 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:29:25.323352 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:29:25.323352 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:29:25.323352 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:29:25.323352 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:29:25.323352 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 066902757df54f628405de52a9c6bea6 Sep 07 12:29:25.323352 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 Sep 07 12:29:25.323352 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:29:25.323352 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:29:25.324779 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/066902757df54f628405de52a9c6bea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_066902757df54f628405de52a9c6bea6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/066902757df54f628405de52a9c6bea6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/066902757df54f628405de52a9c6bea6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:25.324779 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 Sep 07 12:29:25.324779 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 066902757df54f628405de52a9c6bea6 Sep 07 12:29:25.324779 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 Sep 07 12:29:25.324779 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project Sep 07 12:29:25.324779 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:29:25.324779 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:29:25.324779 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: d0df9f3b71014ec29e462431e3759a92 Sep 07 12:29:25.324779 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project Sep 07 12:29:25.324779 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:29:25.324779 n-d-852087-9 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 07 12:29:25.325538 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'flavor_id': '2016863168', 'id': 'hw:numa_nodes'} Sep 07 12:29:25.325538 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:25.325538 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:25.325538 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:25.325538 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:25.325538 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:25.325538 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:25.325538 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:25.325538 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:25.325538 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Sep 07 12:29:25.325538 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Sep 07 12:29:25.325538 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:29:25.325538 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:29:25.325538 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:29:25.325538 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:29:25.325538 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:29:25.325538 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:29:25.325538 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:29:25.325538 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:29:25.325538 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:29:25.326796 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:29:25.326796 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:29:25.326796 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:29:25.326796 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:29:25.326796 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:29:25.326796 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 07 12:29:25.326796 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:25.326796 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:25.326796 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:25.326796 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:25.326796 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:25.326796 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:25.326796 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:29:25.326796 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:29:25.326796 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 07 12:29:25.326796 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:25.328177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ee2b9730-3b27-42d1-a695-fbf027731a24 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:25.329037 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ee2b9730-3b27-42d1-a695-fbf027731a24 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project] 10.222.0.16 "DELETE /compute/v2.1/flavors/2016863168/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.032737 Sep 07 12:29:25.333900 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 170/326] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Sep 7 12:29:25 2022] DELETE /compute/v2.1/flavors/2016863168/os-extra_specs/hw:numa_nodes => generated 124 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:29:25.347085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-43daf634-e4bb-41da-8ec6-27a452861413 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:25.347705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-43daf634-e4bb-41da-8ec6-27a452861413 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:25.349677 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-11e607c7-ca22-48d9-8388-66c0be72996a tempest-FlavorsV261TestJSON-504103856 tempest-FlavorsV261TestJSON-504103856-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:25.360159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43daf634-e4bb-41da-8ec6-27a452861413 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:25.360906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43daf634-e4bb-41da-8ec6-27a452861413 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:25.361684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43daf634-e4bb-41da-8ec6-27a452861413 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:25.364346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43daf634-e4bb-41da-8ec6-27a452861413 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:25.365015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43daf634-e4bb-41da-8ec6-27a452861413 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:25.366356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43daf634-e4bb-41da-8ec6-27a452861413 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:25.371117 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-11e607c7-ca22-48d9-8388-66c0be72996a tempest-FlavorsV261TestJSON-504103856 tempest-FlavorsV261TestJSON-504103856-project] 10.222.0.16 "GET /compute/v2.1/flavors/569484675" status: 200 len: 464 microversion: 2.61 time: 0.241555 Sep 07 12:29:25.372276 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 157/327] 10.222.0.16 () {60 vars in 1196 bytes} [Wed Sep 7 12:29:25 2022] GET /compute/v2.1/flavors/569484675 => generated 464 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:29:25.382810 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b1ea03c1-be06-4e80-97c1-21b3610ab90a tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:25.412929 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b1ea03c1-be06-4e80-97c1-21b3610ab90a tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/2016863168/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.039349 Sep 07 12:29:25.414138 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 158/328] 10.222.0.16 () {60 vars in 1224 bytes} [Wed Sep 7 12:29:25 2022] POST /compute/v2.1/flavors/2016863168/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:29:25.433830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8f7b20a2-f4b2-4816-a88e-e952871b1de1 req-28b4435b-c6a2-4285-a233-bdd7a1e02b4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d805427-079e-4967-be30-5d5c8eb38517", "name": "network-vif-plugged", "status": "completed", "tag": "e3d02637-9e31-486a-bd2d-7b8356c6942f"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:25.457524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8f7b20a2-f4b2-4816-a88e-e952871b1de1 req-28b4435b-c6a2-4285-a233-bdd7a1e02b4f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:25.458163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8f7b20a2-f4b2-4816-a88e-e952871b1de1 req-28b4435b-c6a2-4285-a233-bdd7a1e02b4f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:25.458742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8f7b20a2-f4b2-4816-a88e-e952871b1de1 req-28b4435b-c6a2-4285-a233-bdd7a1e02b4f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:25.472402 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8f7b20a2-f4b2-4816-a88e-e952871b1de1 req-28b4435b-c6a2-4285-a233-bdd7a1e02b4f service nova] Creating event network-vif-plugged:e3d02637-9e31-486a-bd2d-7b8356c6942f for instance 5d805427-079e-4967-be30-5d5c8eb38517 on n-h1-852087-9 Sep 07 12:29:25.478998 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8f7b20a2-f4b2-4816-a88e-e952871b1de1 req-28b4435b-c6a2-4285-a233-bdd7a1e02b4f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062854 Sep 07 12:29:25.479620 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 159/329] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:25.485346 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-879c8ad0-866f-4798-bb1b-ecd6c735d57b tempest-FlavorsV261TestJSON-1335488594 tempest-FlavorsV261TestJSON-1335488594-project-admin] Action: 'update', calling method: .version_select at 0x7fc41adf3550>, body: {"flavor": {"description": "new"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:25.538370 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-879c8ad0-866f-4798-bb1b-ecd6c735d57b tempest-FlavorsV261TestJSON-1335488594 tempest-FlavorsV261TestJSON-1335488594-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/569484675" status: 200 len: 465 microversion: 2.61 time: 0.057330 Sep 07 12:29:25.539504 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 160/330] 10.222.0.16 () {62 vars in 1216 bytes} [Wed Sep 7 12:29:25 2022] PUT /compute/v2.1/flavors/569484675 => generated 465 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:29:25.544349 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bee2aa78-c4a0-46e8-915a-5d4ebfae9946 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:25.545625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bee2aa78-c4a0-46e8-915a-5d4ebfae9946 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] [instance: 3922432a-d58f-4f0a-9471-5c8c210caa9e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:25.552683 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bee2aa78-c4a0-46e8-915a-5d4ebfae9946 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:25.553434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bee2aa78-c4a0-46e8-915a-5d4ebfae9946 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:25.554228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bee2aa78-c4a0-46e8-915a-5d4ebfae9946 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:25.555576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bee2aa78-c4a0-46e8-915a-5d4ebfae9946 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:25.556180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bee2aa78-c4a0-46e8-915a-5d4ebfae9946 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:25.556629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bee2aa78-c4a0-46e8-915a-5d4ebfae9946 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:25.572556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-43daf634-e4bb-41da-8ec6-27a452861413 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:25.585744 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-43daf634-e4bb-41da-8ec6-27a452861413 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1477 microversion: 2.1 time: 0.254534 Sep 07 12:29:25.597516 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 171/331] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:25 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1477 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:25.607256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4229c1cd-6577-44cc-96fc-4d89222cf694 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:25.614223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4229c1cd-6577-44cc-96fc-4d89222cf694 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'd0df9f3b71014ec29e462431e3759a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '066902757df54f628405de52a9c6bea6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:25.616404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4229c1cd-6577-44cc-96fc-4d89222cf694 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project] Request method failure captured: Sep 07 12:29:25.616404 n-d-852087-9 devstack@n-api.service[122432]: request: PUT /compute/v2.1/flavors/2016863168/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 07 12:29:25.616404 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:29:25.616404 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:29:25.616404 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:29:25.616404 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 22 Sep 07 12:29:25.616404 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:29:25.616404 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:29:25.616404 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:29:25.616404 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:25.616404 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI6i1DfeSUHiT6iXjJDSmc7zv8Nck_WpD5oOdJgTbgk5QJdDDYV-TkkC2U6V1OelnWeVnqzHPyNG_2jFNXy6B3TDnAyn96tQ5vggvKJWp2MGpkX48Ue5UvnpP7DHBGdTErMluwjkNm_eWcsfOWdd3D9fzYpwqXWPrCUB14A5vOZ0yU8 Sep 07 12:29:25.616404 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:29:25.616404 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:29:25.616404 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:29:25.616404 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:29:25.616404 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:29:25.616404 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:29:25.616404 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 066902757df54f628405de52a9c6bea6 Sep 07 12:29:25.616404 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 Sep 07 12:29:25.616404 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:29:25.616404 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:29:25.617891 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/066902757df54f628405de52a9c6bea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_066902757df54f628405de52a9c6bea6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/066902757df54f628405de52a9c6bea6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/066902757df54f628405de52a9c6bea6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:25.617891 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 Sep 07 12:29:25.617891 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 066902757df54f628405de52a9c6bea6 Sep 07 12:29:25.617891 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 Sep 07 12:29:25.617891 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project Sep 07 12:29:25.617891 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:29:25.617891 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:29:25.617891 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: d0df9f3b71014ec29e462431e3759a92 Sep 07 12:29:25.617891 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project Sep 07 12:29:25.617891 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:29:25.617891 n-d-852087-9 devstack@n-api.service[122432]: {"hw:numa_nodes": "1"} Sep 07 12:29:25.617891 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:29:25.617891 n-d-852087-9 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 07 12:29:25.618705 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'flavor_id': '2016863168', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Sep 07 12:29:25.618705 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:25.618705 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:25.618705 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:25.618705 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:25.618705 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:25.618705 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:25.618705 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:25.618705 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:25.618705 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:29:25.618705 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:29:25.618705 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Sep 07 12:29:25.618705 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Sep 07 12:29:25.618705 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:29:25.618705 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:29:25.618705 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:29:25.618705 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:29:25.618705 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:29:25.618705 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:29:25.619910 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:29:25.619910 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:29:25.619910 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:29:25.619910 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:29:25.619910 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:29:25.619910 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:29:25.619910 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:29:25.619910 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:29:25.619910 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 07 12:29:25.619910 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:25.619910 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:25.619910 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:25.619910 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:25.619910 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:25.619910 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:25.619910 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:29:25.619910 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:29:25.619910 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 07 12:29:25.619910 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:25.629876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4229c1cd-6577-44cc-96fc-4d89222cf694 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:25.632193 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4229c1cd-6577-44cc-96fc-4d89222cf694 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783 tempest-FlavorsExtraSpecsNegativeTestJSON-730983783-project] 10.222.0.16 "PUT /compute/v2.1/flavors/2016863168/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.042503 Sep 07 12:29:25.632851 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 172/332] 10.222.0.16 () {60 vars in 1265 bytes} [Wed Sep 7 12:29:25 2022] PUT /compute/v2.1/flavors/2016863168/os-extra_specs/hw:numa_nodes => generated 124 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:29:25.640540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-568e1ad4-acff-4846-b202-5717e83b965f tempest-FlavorsV261TestJSON-504103856 tempest-FlavorsV261TestJSON-504103856-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:25.646617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bee2aa78-c4a0-46e8-915a-5d4ebfae9946 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f867ffebff94e3785cbaf0dc19f518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d676a2aa1bf4032965482efdd697502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:25.656491 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bee2aa78-c4a0-46e8-915a-5d4ebfae9946 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] 10.222.0.16 "GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e" status: 200 len: 1281 microversion: 2.1 time: 0.115716 Sep 07 12:29:25.669510 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 161/333] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:25 2022] GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e => generated 1281 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:25.669510 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b1924f5c-49a6-4d5b-9414-b5b02e8e00bc tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:25.669970 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-568e1ad4-acff-4846-b202-5717e83b965f tempest-FlavorsV261TestJSON-504103856 tempest-FlavorsV261TestJSON-504103856-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 7643 microversion: 2.61 time: 0.033456 Sep 07 12:29:25.669970 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 173/334] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Sep 7 12:29:25 2022] GET /compute/v2.1/flavors/detail => generated 7643 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:29:25.677374 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-b1924f5c-49a6-4d5b-9414-b5b02e8e00bc tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin] HTTP exception thrown: Flavor 2016863168 has no extra specs with key hw:cpu_thread_policy. Sep 07 12:29:25.679458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b1924f5c-49a6-4d5b-9414-b5b02e8e00bc tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin] Request method failure captured: Sep 07 12:29:25.679458 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/flavors/2016863168/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 07 12:29:25.679458 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:29:25.679458 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:29:25.679458 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:29:25.679458 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:29:25.679458 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:29:25.679458 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:29:25.679458 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:29:25.679458 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:25.679458 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI6kRMuaNd23v2ShrzwFIA-4Criak_8JZ-I05y5oiNmkIWmCOOlHAuP0EXTuRTCPImESqWXirFkOldJlkrqe9Ej1v0yla93vJswWC7fDKA_MAWYfBCYpAGQ-3Cp44SDN0IseNG7LodSxn-LxPKtJnBCXKQlXY3XAigVyhJ0jsU0rzz0 Sep 07 12:29:25.679458 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:29:25.679458 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:29:25.679458 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:29:25.679458 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:29:25.679458 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:29:25.679458 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:29:25.679458 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 519cb33419334d9aa5ee78f73791903b Sep 07 12:29:25.679458 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 Sep 07 12:29:25.679458 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 12:29:25.679458 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 12:29:25.680670 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/519cb33419334d9aa5ee78f73791903b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_519cb33419334d9aa5ee78f73791903b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/519cb33419334d9aa5ee78f73791903b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/519cb33419334d9aa5ee78f73791903b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:25.680670 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 Sep 07 12:29:25.680670 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 519cb33419334d9aa5ee78f73791903b Sep 07 12:29:25.680670 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 Sep 07 12:29:25.680670 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin Sep 07 12:29:25.680670 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:29:25.680670 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:29:25.680670 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 05820b7b70184f188a93d99c5bd54360 Sep 07 12:29:25.680670 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin Sep 07 12:29:25.680670 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:29:25.680670 n-d-852087-9 devstack@n-api.service[122433]: exception: Flavor 2016863168 has no extra specs with key hw:cpu_thread_policy. Sep 07 12:29:25.681335 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'flavor_id': '2016863168', 'id': 'hw:cpu_thread_policy'} Sep 07 12:29:25.681335 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:25.681335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:25.681335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Sep 07 12:29:25.681335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Sep 07 12:29:25.681335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 07 12:29:25.681335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:25.681335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:25.681335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:25.681335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:25.681335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:25.681335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:25.681335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:25.681335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:25.681335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:25.681335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:25.681335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Sep 07 12:29:25.681335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 07 12:29:25.681335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2016863168 has no extra specs with key hw:cpu_thread_policy. Sep 07 12:29:25.681335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:25.681335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:25.681335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:25.682607 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:25.682607 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:25.682607 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:25.682607 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:29:25.682607 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:29:25.682607 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2016863168 has no extra specs with key hw:cpu_thread_policy. Sep 07 12:29:25.682607 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:25.687618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b1924f5c-49a6-4d5b-9414-b5b02e8e00bc tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin] Returning 404 to user: Flavor 2016863168 has no extra specs with key hw:cpu_thread_policy. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:25.688686 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b1924f5c-49a6-4d5b-9414-b5b02e8e00bc tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2016863168/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.029110 Sep 07 12:29:25.690148 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 162/335] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Sep 7 12:29:25 2022] DELETE /compute/v2.1/flavors/2016863168/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:29:25.696292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-081fe690-ac84-4ed1-b279-1d72334e3a91 tempest-FlavorsV261TestJSON-504103856 tempest-FlavorsV261TestJSON-504103856-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:25.705971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c59c2d9e-6b39-4cc2-834f-141de079a09b tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:25.712679 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-c59c2d9e-6b39-4cc2-834f-141de079a09b tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin] HTTP exception thrown: Request body and URI mismatch Sep 07 12:29:25.715007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c59c2d9e-6b39-4cc2-834f-141de079a09b tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin] Request method failure captured: Sep 07 12:29:25.715007 n-d-852087-9 devstack@n-api.service[122433]: request: PUT /compute/v2.1/flavors/2016863168/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 07 12:29:25.715007 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:29:25.715007 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:29:25.715007 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:29:25.715007 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 27 Sep 07 12:29:25.715007 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:29:25.715007 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:29:25.715007 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:29:25.715007 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:25.715007 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI6kRMuaNd23v2ShrzwFIA-4Criak_8JZ-I05y5oiNmkIWmCOOlHAuP0EXTuRTCPImESqWXirFkOldJlkrqe9Ej1v0yla93vJswWC7fDKA_MAWYfBCYpAGQ-3Cp44SDN0IseNG7LodSxn-LxPKtJnBCXKQlXY3XAigVyhJ0jsU0rzz0 Sep 07 12:29:25.715007 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:29:25.715007 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:29:25.715007 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:29:25.715007 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:29:25.715007 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:29:25.715007 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:29:25.715007 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 519cb33419334d9aa5ee78f73791903b Sep 07 12:29:25.715007 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 Sep 07 12:29:25.715007 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 12:29:25.715007 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 12:29:25.716566 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/519cb33419334d9aa5ee78f73791903b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_519cb33419334d9aa5ee78f73791903b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/519cb33419334d9aa5ee78f73791903b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/519cb33419334d9aa5ee78f73791903b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:25.716566 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 Sep 07 12:29:25.716566 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 519cb33419334d9aa5ee78f73791903b Sep 07 12:29:25.716566 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 Sep 07 12:29:25.716566 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin Sep 07 12:29:25.716566 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:29:25.716566 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:29:25.716566 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 05820b7b70184f188a93d99c5bd54360 Sep 07 12:29:25.716566 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin Sep 07 12:29:25.716566 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:29:25.716566 n-d-852087-9 devstack@n-api.service[122433]: {"hw:cpu_policy": "shared"} Sep 07 12:29:25.716566 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:29:25.716566 n-d-852087-9 devstack@n-api.service[122433]: exception: Request body and URI mismatch Sep 07 12:29:25.717450 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'flavor_id': '2016863168', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Sep 07 12:29:25.717450 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:25.717450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:25.717450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:25.717450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:25.717450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:25.717450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:25.717450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:25.717450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:25.717450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:29:25.717450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:29:25.717450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Sep 07 12:29:25.717450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Sep 07 12:29:25.717450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Sep 07 12:29:25.717450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:25.717450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:25.717450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:25.717450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:25.717450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:25.717450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:25.718663 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:29:25.718663 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:29:25.718663 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Sep 07 12:29:25.718663 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:25.719752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c59c2d9e-6b39-4cc2-834f-141de079a09b tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:25.721844 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c59c2d9e-6b39-4cc2-834f-141de079a09b tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/2016863168/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.019693 Sep 07 12:29:25.722329 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-081fe690-ac84-4ed1-b279-1d72334e3a91 tempest-FlavorsV261TestJSON-504103856 tempest-FlavorsV261TestJSON-504103856-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3930 microversion: 2.61 time: 0.035764 Sep 07 12:29:25.724099 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 163/336] 10.222.0.16 () {60 vars in 1265 bytes} [Wed Sep 7 12:29:25 2022] PUT /compute/v2.1/flavors/2016863168/os-extra_specs/hw:numa_nodes => generated 73 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 07 12:29:25.726350 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 174/337] 10.222.0.16 () {60 vars in 1166 bytes} [Wed Sep 7 12:29:25 2022] GET /compute/v2.1/flavors => generated 3930 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:29:25.733601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b4ac503c-989c-4697-93c1-c1590d526d5e tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:25.742392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cf8f8ee4-3064-4bfb-9ca1-27584268534b tempest-FlavorsV261TestJSON-1335488594 tempest-FlavorsV261TestJSON-1335488594-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:25.749595 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b4ac503c-989c-4697-93c1-c1590d526d5e tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin] Request method failure captured: Sep 07 12:29:25.749595 n-d-852087-9 devstack@n-api.service[122433]: request: PUT /compute/v2.1/flavors/2016863168/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 07 12:29:25.749595 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:29:25.749595 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:29:25.749595 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:29:25.749595 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 49 Sep 07 12:29:25.749595 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:29:25.749595 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:29:25.749595 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:29:25.749595 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:25.749595 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI6kRMuaNd23v2ShrzwFIA-4Criak_8JZ-I05y5oiNmkIWmCOOlHAuP0EXTuRTCPImESqWXirFkOldJlkrqe9Ej1v0yla93vJswWC7fDKA_MAWYfBCYpAGQ-3Cp44SDN0IseNG7LodSxn-LxPKtJnBCXKQlXY3XAigVyhJ0jsU0rzz0 Sep 07 12:29:25.749595 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:29:25.749595 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:29:25.749595 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:29:25.749595 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:29:25.749595 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:29:25.749595 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:29:25.749595 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 519cb33419334d9aa5ee78f73791903b Sep 07 12:29:25.749595 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 Sep 07 12:29:25.749595 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 12:29:25.749595 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 12:29:25.751097 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/519cb33419334d9aa5ee78f73791903b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_519cb33419334d9aa5ee78f73791903b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/519cb33419334d9aa5ee78f73791903b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/519cb33419334d9aa5ee78f73791903b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:25.751097 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 Sep 07 12:29:25.751097 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 519cb33419334d9aa5ee78f73791903b Sep 07 12:29:25.751097 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 Sep 07 12:29:25.751097 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin Sep 07 12:29:25.751097 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:29:25.751097 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:29:25.751097 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 05820b7b70184f188a93d99c5bd54360 Sep 07 12:29:25.751097 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin Sep 07 12:29:25.751097 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:29:25.751097 n-d-852087-9 devstack@n-api.service[122433]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Sep 07 12:29:25.751097 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:29:25.751863 n-d-852087-9 devstack@n-api.service[122433]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 07 12:29:25.751863 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'flavor_id': '2016863168', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Sep 07 12:29:25.751863 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:25.751863 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:25.751863 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:29:25.751863 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:29:25.751863 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:29:25.751863 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:29:25.751863 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 07 12:29:25.751863 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:25.751863 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Sep 07 12:29:25.751863 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 07 12:29:25.751863 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Sep 07 12:29:25.751863 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Sep 07 12:29:25.751863 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 07 12:29:25.751863 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'type': ['string', Sep 07 12:29:25.751863 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'number']}}, Sep 07 12:29:25.751863 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 07 12:29:25.751863 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:25.751863 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance: Sep 07 12:29:25.751863 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Sep 07 12:29:25.751863 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:25.753301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:25.753301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:25.753301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:25.753301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:25.753301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:25.753301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:25.753301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:25.753301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:25.753301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:25.753301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:29:25.753301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:29:25.753301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:29:25.753301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:29:25.753301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:29:25.753301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:29:25.753301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 07 12:29:25.753301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:25.753301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:25.753301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:25.753301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:25.754640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:25.754640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:25.754640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:29:25.754640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:29:25.754640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 07 12:29:25.754640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:25.757459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b4ac503c-989c-4697-93c1-c1590d526d5e tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:25.759057 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b4ac503c-989c-4697-93c1-c1590d526d5e tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/2016863168/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.030027 Sep 07 12:29:25.759896 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 164/338] 10.222.0.16 () {60 vars in 1265 bytes} [Wed Sep 7 12:29:25 2022] PUT /compute/v2.1/flavors/2016863168/os-extra_specs/hw:numa_nodes => generated 117 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:29:25.772681 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-64e16914-3f1f-4aa6-b4cb-466e615e4d9e tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:25.777549 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cf8f8ee4-3064-4bfb-9ca1-27584268534b tempest-FlavorsV261TestJSON-1335488594 tempest-FlavorsV261TestJSON-1335488594-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/569484675" status: 202 len: 0 microversion: 2.61 time: 0.038861 Sep 07 12:29:25.782721 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 175/339] 10.222.0.16 () {60 vars in 1199 bytes} [Wed Sep 7 12:29:25 2022] DELETE /compute/v2.1/flavors/569484675 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 07 12:29:25.792032 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5f9427b4-2585-44bd-8032-3991261a7203 tempest-FlavorsV261TestJSON-1335488594 tempest-FlavorsV261TestJSON-1335488594-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:25.797785 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-64e16914-3f1f-4aa6-b4cb-466e615e4d9e tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2016863168" status: 202 len: 0 microversion: 2.1 time: 0.031568 Sep 07 12:29:25.798997 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 165/340] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Sep 7 12:29:25 2022] DELETE /compute/v2.1/flavors/2016863168 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:29:25.806786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5c05daf8-ac39-41ac-a284-08b3d6088287 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:25.823362 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5f9427b4-2585-44bd-8032-3991261a7203 tempest-FlavorsV261TestJSON-1335488594 tempest-FlavorsV261TestJSON-1335488594-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6695 microversion: 2.61 time: 0.039168 Sep 07 12:29:25.823946 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 176/341] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Sep 7 12:29:25 2022] GET /compute/v2.1/flavors/detail => generated 6695 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:29:25.840546 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5c05daf8-ac39-41ac-a284-08b3d6088287 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145 tempest-FlavorsExtraSpecsNegativeTestJSON-1838130145-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.037555 Sep 07 12:29:25.845613 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 166/342] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:29:25 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:29:25.882731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-40768701-d641-4315-aa9d-e52d85516d99 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:25.883742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-40768701-d641-4315-aa9d-e52d85516d99 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:25.893303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40768701-d641-4315-aa9d-e52d85516d99 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:25.893890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40768701-d641-4315-aa9d-e52d85516d99 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:25.894421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40768701-d641-4315-aa9d-e52d85516d99 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:25.895252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40768701-d641-4315-aa9d-e52d85516d99 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:25.895831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40768701-d641-4315-aa9d-e52d85516d99 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:25.896350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40768701-d641-4315-aa9d-e52d85516d99 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:26.079348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-40768701-d641-4315-aa9d-e52d85516d99 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:26.090108 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-40768701-d641-4315-aa9d-e52d85516d99 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1505 microversion: 2.1 time: 0.218350 Sep 07 12:29:26.091164 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 177/343] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:25 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1505 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:26.215398 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9a8b8ca8-5cc6-4787-a41d-f614c55667b4 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:26.216137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9a8b8ca8-5cc6-4787-a41d-f614c55667b4 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 5d805427-079e-4967-be30-5d5c8eb38517] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:26.223660 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a8b8ca8-5cc6-4787-a41d-f614c55667b4 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:26.224775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a8b8ca8-5cc6-4787-a41d-f614c55667b4 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:26.225429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a8b8ca8-5cc6-4787-a41d-f614c55667b4 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:26.226511 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a8b8ca8-5cc6-4787-a41d-f614c55667b4 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:26.227072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a8b8ca8-5cc6-4787-a41d-f614c55667b4 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:26.227691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a8b8ca8-5cc6-4787-a41d-f614c55667b4 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:26.233099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:26.543023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9a8b8ca8-5cc6-4787-a41d-f614c55667b4 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:26.552006 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9a8b8ca8-5cc6-4787-a41d-f614c55667b4 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517" status: 200 len: 1319 microversion: 2.1 time: 0.344350 Sep 07 12:29:26.567470 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 167/344] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:26 2022] GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:26.611535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-72b71dc3-ef2c-4b5c-821c-afae2772dd3a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:26.612176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-72b71dc3-ef2c-4b5c-821c-afae2772dd3a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:26.619705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72b71dc3-ef2c-4b5c-821c-afae2772dd3a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:26.620486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72b71dc3-ef2c-4b5c-821c-afae2772dd3a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:26.621074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72b71dc3-ef2c-4b5c-821c-afae2772dd3a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:26.621998 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72b71dc3-ef2c-4b5c-821c-afae2772dd3a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:26.622641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72b71dc3-ef2c-4b5c-821c-afae2772dd3a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:26.623274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72b71dc3-ef2c-4b5c-821c-afae2772dd3a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:26.682074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1a2e6665-04f6-4f8d-894f-6aadbf7a958b tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:26.682757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1a2e6665-04f6-4f8d-894f-6aadbf7a958b tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] [instance: 3922432a-d58f-4f0a-9471-5c8c210caa9e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:26.684959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:26.698832 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a2e6665-04f6-4f8d-894f-6aadbf7a958b tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:26.699258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a2e6665-04f6-4f8d-894f-6aadbf7a958b tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:26.700195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a2e6665-04f6-4f8d-894f-6aadbf7a958b tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:26.701699 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a2e6665-04f6-4f8d-894f-6aadbf7a958b tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:26.702478 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a2e6665-04f6-4f8d-894f-6aadbf7a958b tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:26.703460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a2e6665-04f6-4f8d-894f-6aadbf7a958b tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:27.024171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-72b71dc3-ef2c-4b5c-821c-afae2772dd3a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:27.032504 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-72b71dc3-ef2c-4b5c-821c-afae2772dd3a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1477 microversion: 2.1 time: 0.425357 Sep 07 12:29:27.035701 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 178/345] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:26 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1477 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:27.067719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1a2e6665-04f6-4f8d-894f-6aadbf7a958b tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f867ffebff94e3785cbaf0dc19f518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d676a2aa1bf4032965482efdd697502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:27.078261 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1a2e6665-04f6-4f8d-894f-6aadbf7a958b tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] 10.222.0.16 "GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e" status: 200 len: 1323 microversion: 2.1 time: 0.400639 Sep 07 12:29:27.085577 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 168/346] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:26 2022] GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e => generated 1323 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:27.120155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7950831b-328b-429f-87f0-4033a3818cd7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:27.120995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7950831b-328b-429f-87f0-4033a3818cd7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:27.128656 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7950831b-328b-429f-87f0-4033a3818cd7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:27.129747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7950831b-328b-429f-87f0-4033a3818cd7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:27.130389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7950831b-328b-429f-87f0-4033a3818cd7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:27.131929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7950831b-328b-429f-87f0-4033a3818cd7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:27.132643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7950831b-328b-429f-87f0-4033a3818cd7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:27.133605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7950831b-328b-429f-87f0-4033a3818cd7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:27.158189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:27.323024 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7950831b-328b-429f-87f0-4033a3818cd7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:27.332240 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7950831b-328b-429f-87f0-4033a3818cd7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1505 microversion: 2.1 time: 0.220196 Sep 07 12:29:27.334055 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 179/347] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:27 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1505 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:27.457329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a80605f1-eeee-438d-9e19-0e1e37975bef req-7d8aa4a8-e1dd-4d4f-8dc8-26a0ca34db9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3922432a-d58f-4f0a-9471-5c8c210caa9e", "tag": "283d983c-1d5a-4725-8ab1-a48b9ed5b74c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:27.486976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a80605f1-eeee-438d-9e19-0e1e37975bef req-7d8aa4a8-e1dd-4d4f-8dc8-26a0ca34db9f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:27.488407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a80605f1-eeee-438d-9e19-0e1e37975bef req-7d8aa4a8-e1dd-4d4f-8dc8-26a0ca34db9f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:27.489033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a80605f1-eeee-438d-9e19-0e1e37975bef req-7d8aa4a8-e1dd-4d4f-8dc8-26a0ca34db9f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:27.513747 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a80605f1-eeee-438d-9e19-0e1e37975bef req-7d8aa4a8-e1dd-4d4f-8dc8-26a0ca34db9f service nova] Creating event network-changed:283d983c-1d5a-4725-8ab1-a48b9ed5b74c for instance 3922432a-d58f-4f0a-9471-5c8c210caa9e on n-h2-852087-9 Sep 07 12:29:27.519741 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a80605f1-eeee-438d-9e19-0e1e37975bef req-7d8aa4a8-e1dd-4d4f-8dc8-26a0ca34db9f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072387 Sep 07 12:29:27.520524 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 169/348] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:27.576463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-661c9ad1-eb8f-433f-ac80-8062274b8f66 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:27.578090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-661c9ad1-eb8f-433f-ac80-8062274b8f66 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 5d805427-079e-4967-be30-5d5c8eb38517] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:27.587223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-661c9ad1-eb8f-433f-ac80-8062274b8f66 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:27.588125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-661c9ad1-eb8f-433f-ac80-8062274b8f66 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:27.588754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-661c9ad1-eb8f-433f-ac80-8062274b8f66 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:27.590153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-661c9ad1-eb8f-433f-ac80-8062274b8f66 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:27.590808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-661c9ad1-eb8f-433f-ac80-8062274b8f66 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:27.591450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-661c9ad1-eb8f-433f-ac80-8062274b8f66 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:27.784694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-661c9ad1-eb8f-433f-ac80-8062274b8f66 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:27.794964 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-661c9ad1-eb8f-433f-ac80-8062274b8f66 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517" status: 200 len: 1469 microversion: 2.1 time: 0.223175 Sep 07 12:29:27.795735 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 180/349] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:27 2022] GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517 => generated 1469 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:27.821818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae05a7ba-1e10-424c-8e51-d4ce127499f7 tempest-DeleteServersAdminTestJSON-1528815157 tempest-DeleteServersAdminTestJSON-1528815157-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:27.825207 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ae05a7ba-1e10-424c-8e51-d4ce127499f7 tempest-DeleteServersAdminTestJSON-1528815157 tempest-DeleteServersAdminTestJSON-1528815157-project-admin] [instance: 5d805427-079e-4967-be30-5d5c8eb38517] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:27.832769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae05a7ba-1e10-424c-8e51-d4ce127499f7 tempest-DeleteServersAdminTestJSON-1528815157 tempest-DeleteServersAdminTestJSON-1528815157-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:27.833843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae05a7ba-1e10-424c-8e51-d4ce127499f7 tempest-DeleteServersAdminTestJSON-1528815157 tempest-DeleteServersAdminTestJSON-1528815157-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:27.834627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae05a7ba-1e10-424c-8e51-d4ce127499f7 tempest-DeleteServersAdminTestJSON-1528815157 tempest-DeleteServersAdminTestJSON-1528815157-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:27.835612 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae05a7ba-1e10-424c-8e51-d4ce127499f7 tempest-DeleteServersAdminTestJSON-1528815157 tempest-DeleteServersAdminTestJSON-1528815157-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:27.836285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae05a7ba-1e10-424c-8e51-d4ce127499f7 tempest-DeleteServersAdminTestJSON-1528815157 tempest-DeleteServersAdminTestJSON-1528815157-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:27.836904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae05a7ba-1e10-424c-8e51-d4ce127499f7 tempest-DeleteServersAdminTestJSON-1528815157 tempest-DeleteServersAdminTestJSON-1528815157-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:27.997084 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ae05a7ba-1e10-424c-8e51-d4ce127499f7 tempest-DeleteServersAdminTestJSON-1528815157 tempest-DeleteServersAdminTestJSON-1528815157-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517/action" status: 202 len: 0 microversion: 2.1 time: 0.179334 Sep 07 12:29:27.997666 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 170/350] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:29:27 2022] POST /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:29:28.007146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8f9ef576-b023-4deb-9c5e-edc0aafcdedd tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:28.008001 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8f9ef576-b023-4deb-9c5e-edc0aafcdedd tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 5d805427-079e-4967-be30-5d5c8eb38517] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:28.014367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f9ef576-b023-4deb-9c5e-edc0aafcdedd tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:28.014884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f9ef576-b023-4deb-9c5e-edc0aafcdedd tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:28.015312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f9ef576-b023-4deb-9c5e-edc0aafcdedd tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:28.016345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f9ef576-b023-4deb-9c5e-edc0aafcdedd tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:28.016796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f9ef576-b023-4deb-9c5e-edc0aafcdedd tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:28.017212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f9ef576-b023-4deb-9c5e-edc0aafcdedd tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:28.057822 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-797f88fb-c62f-4b20-9eda-21ca3700d157 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:28.058273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-797f88fb-c62f-4b20-9eda-21ca3700d157 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:28.066240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f9ef576-b023-4deb-9c5e-edc0aafcdedd tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:28.070477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f9ef576-b023-4deb-9c5e-edc0aafcdedd tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:28.071114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f9ef576-b023-4deb-9c5e-edc0aafcdedd tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:28.071930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-8f9ef576-b023-4deb-9c5e-edc0aafcdedd tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lazy-loading 'fault' on Instance uuid 5d805427-079e-4967-be30-5d5c8eb38517 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:29:28.091001 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-797f88fb-c62f-4b20-9eda-21ca3700d157 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:28.092301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-797f88fb-c62f-4b20-9eda-21ca3700d157 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:28.093163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-797f88fb-c62f-4b20-9eda-21ca3700d157 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:28.094301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-797f88fb-c62f-4b20-9eda-21ca3700d157 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:28.095105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-797f88fb-c62f-4b20-9eda-21ca3700d157 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:28.095548 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-797f88fb-c62f-4b20-9eda-21ca3700d157 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:28.461666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8f9ef576-b023-4deb-9c5e-edc0aafcdedd tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:28.475647 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8f9ef576-b023-4deb-9c5e-edc0aafcdedd tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517" status: 200 len: 1452 microversion: 2.1 time: 0.473408 Sep 07 12:29:28.480826 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 181/351] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:28 2022] GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517 => generated 1452 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:28.490735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bbffb6e4-1340-4f19-8fdc-8445bcbd0e49 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:28.491777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bbffb6e4-1340-4f19-8fdc-8445bcbd0e49 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] [instance: 3922432a-d58f-4f0a-9471-5c8c210caa9e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:28.506547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbffb6e4-1340-4f19-8fdc-8445bcbd0e49 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:28.507778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbffb6e4-1340-4f19-8fdc-8445bcbd0e49 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:28.508451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbffb6e4-1340-4f19-8fdc-8445bcbd0e49 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:28.509527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbffb6e4-1340-4f19-8fdc-8445bcbd0e49 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:28.510218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbffb6e4-1340-4f19-8fdc-8445bcbd0e49 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:28.510864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbffb6e4-1340-4f19-8fdc-8445bcbd0e49 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:28.537062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-797f88fb-c62f-4b20-9eda-21ca3700d157 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:28.547745 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-797f88fb-c62f-4b20-9eda-21ca3700d157 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1477 microversion: 2.1 time: 0.495365 Sep 07 12:29:28.549511 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 171/352] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:28 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1477 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:29:28.561910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4038e540-4bad-41d9-8664-2f73692d784e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:28.562518 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4038e540-4bad-41d9-8664-2f73692d784e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:28.582766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4038e540-4bad-41d9-8664-2f73692d784e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:28.583470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4038e540-4bad-41d9-8664-2f73692d784e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:28.583922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4038e540-4bad-41d9-8664-2f73692d784e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:28.586311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4038e540-4bad-41d9-8664-2f73692d784e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:28.588055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4038e540-4bad-41d9-8664-2f73692d784e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:28.588498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4038e540-4bad-41d9-8664-2f73692d784e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:28.850070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bbffb6e4-1340-4f19-8fdc-8445bcbd0e49 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f867ffebff94e3785cbaf0dc19f518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d676a2aa1bf4032965482efdd697502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:28.869427 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bbffb6e4-1340-4f19-8fdc-8445bcbd0e49 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] 10.222.0.16 "GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e" status: 200 len: 1323 microversion: 2.1 time: 0.386818 Sep 07 12:29:28.870059 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 182/353] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:28 2022] GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e => generated 1323 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:28.895981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-01185bf9-5716-4f52-b930-fd4f1f8d93e2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:28.896572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-01185bf9-5716-4f52-b930-fd4f1f8d93e2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 5d805427-079e-4967-be30-5d5c8eb38517] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:28.899099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4038e540-4bad-41d9-8664-2f73692d784e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:28.907251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01185bf9-5716-4f52-b930-fd4f1f8d93e2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:28.907753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01185bf9-5716-4f52-b930-fd4f1f8d93e2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:28.908256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01185bf9-5716-4f52-b930-fd4f1f8d93e2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:28.908876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01185bf9-5716-4f52-b930-fd4f1f8d93e2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:28.909333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01185bf9-5716-4f52-b930-fd4f1f8d93e2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:28.909786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01185bf9-5716-4f52-b930-fd4f1f8d93e2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:28.919993 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4038e540-4bad-41d9-8664-2f73692d784e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1505 microversion: 2.1 time: 0.367182 Sep 07 12:29:28.923094 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 172/354] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:28 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1505 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:28.965955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-01185bf9-5716-4f52-b930-fd4f1f8d93e2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 5d805427-079e-4967-be30-5d5c8eb38517] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:29:29.054001 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-01185bf9-5716-4f52-b930-fd4f1f8d93e2 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517" status: 204 len: 0 microversion: 2.1 time: 0.174018 Sep 07 12:29:29.055018 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 183/355] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:29:28 2022] DELETE /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:29:29.063730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4d2cdc8c-717b-44d0-868a-087190b1e80f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:29.064389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4d2cdc8c-717b-44d0-868a-087190b1e80f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 5d805427-079e-4967-be30-5d5c8eb38517] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:29.071694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d2cdc8c-717b-44d0-868a-087190b1e80f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:29.072534 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d2cdc8c-717b-44d0-868a-087190b1e80f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:29.073028 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d2cdc8c-717b-44d0-868a-087190b1e80f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:29.073936 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d2cdc8c-717b-44d0-868a-087190b1e80f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:29.074639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d2cdc8c-717b-44d0-868a-087190b1e80f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:29.075376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d2cdc8c-717b-44d0-868a-087190b1e80f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:29.108796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:29.115113 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d2cdc8c-717b-44d0-868a-087190b1e80f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:29.115601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d2cdc8c-717b-44d0-868a-087190b1e80f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:29.116043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d2cdc8c-717b-44d0-868a-087190b1e80f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:29.116507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-4d2cdc8c-717b-44d0-868a-087190b1e80f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lazy-loading 'fault' on Instance uuid 5d805427-079e-4967-be30-5d5c8eb38517 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:29:29.236627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4d2cdc8c-717b-44d0-868a-087190b1e80f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:29.245378 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4d2cdc8c-717b-44d0-868a-087190b1e80f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517" status: 200 len: 1458 microversion: 2.1 time: 0.186099 Sep 07 12:29:29.246170 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 173/356] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:29 2022] GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517 => generated 1458 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:29.579452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2833bfcb-0a66-4e61-a367-19de4cbc566b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:29.580657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2833bfcb-0a66-4e61-a367-19de4cbc566b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:29.587112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2833bfcb-0a66-4e61-a367-19de4cbc566b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:29.587619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2833bfcb-0a66-4e61-a367-19de4cbc566b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:29.588265 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2833bfcb-0a66-4e61-a367-19de4cbc566b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:29.589427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2833bfcb-0a66-4e61-a367-19de4cbc566b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:29.589935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2833bfcb-0a66-4e61-a367-19de4cbc566b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:29.590362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2833bfcb-0a66-4e61-a367-19de4cbc566b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:29.742549 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2833bfcb-0a66-4e61-a367-19de4cbc566b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:29.753267 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2833bfcb-0a66-4e61-a367-19de4cbc566b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1477 microversion: 2.1 time: 0.179000 Sep 07 12:29:29.754479 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 184/357] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:29 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1477 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:29.902349 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6bba17e4-7d85-41df-bce3-04bda400aebf tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:29.903575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6bba17e4-7d85-41df-bce3-04bda400aebf tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] [instance: 3922432a-d58f-4f0a-9471-5c8c210caa9e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:29.911014 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bba17e4-7d85-41df-bce3-04bda400aebf tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:29.911612 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bba17e4-7d85-41df-bce3-04bda400aebf tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:29.912342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bba17e4-7d85-41df-bce3-04bda400aebf tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:29.913062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bba17e4-7d85-41df-bce3-04bda400aebf tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:29.913555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bba17e4-7d85-41df-bce3-04bda400aebf tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:29.914065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bba17e4-7d85-41df-bce3-04bda400aebf tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:29.946061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e4a330f-fa53-4b3f-99f5-fd5753ea0c74 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:29.947114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6e4a330f-fa53-4b3f-99f5-fd5753ea0c74 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:29.953701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e4a330f-fa53-4b3f-99f5-fd5753ea0c74 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:29.954561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e4a330f-fa53-4b3f-99f5-fd5753ea0c74 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:29.955600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e4a330f-fa53-4b3f-99f5-fd5753ea0c74 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:29.956498 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e4a330f-fa53-4b3f-99f5-fd5753ea0c74 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:29.957155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e4a330f-fa53-4b3f-99f5-fd5753ea0c74 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:29.957848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e4a330f-fa53-4b3f-99f5-fd5753ea0c74 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:30.161301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6bba17e4-7d85-41df-bce3-04bda400aebf tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f867ffebff94e3785cbaf0dc19f518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d676a2aa1bf4032965482efdd697502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:30.170821 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6bba17e4-7d85-41df-bce3-04bda400aebf tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] 10.222.0.16 "GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e" status: 200 len: 1323 microversion: 2.1 time: 0.279061 Sep 07 12:29:30.171790 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 174/358] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:29 2022] GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e => generated 1323 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:30.184795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6e4a330f-fa53-4b3f-99f5-fd5753ea0c74 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:30.197038 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6e4a330f-fa53-4b3f-99f5-fd5753ea0c74 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1505 microversion: 2.1 time: 0.257322 Sep 07 12:29:30.198188 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 185/359] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:29 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1505 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:30.268771 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e3b41038-f97d-424e-a79d-204a1af8828f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:30.269757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e3b41038-f97d-424e-a79d-204a1af8828f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 5d805427-079e-4967-be30-5d5c8eb38517] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:30.276696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3b41038-f97d-424e-a79d-204a1af8828f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:30.277234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3b41038-f97d-424e-a79d-204a1af8828f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:30.277791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3b41038-f97d-424e-a79d-204a1af8828f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:30.278600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3b41038-f97d-424e-a79d-204a1af8828f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:30.279386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3b41038-f97d-424e-a79d-204a1af8828f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:30.279531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3b41038-f97d-424e-a79d-204a1af8828f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:30.317386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3b41038-f97d-424e-a79d-204a1af8828f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:30.317936 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3b41038-f97d-424e-a79d-204a1af8828f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:30.318357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3b41038-f97d-424e-a79d-204a1af8828f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:30.318793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-e3b41038-f97d-424e-a79d-204a1af8828f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lazy-loading 'fault' on Instance uuid 5d805427-079e-4967-be30-5d5c8eb38517 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:29:30.475742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e3b41038-f97d-424e-a79d-204a1af8828f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:30.486877 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e3b41038-f97d-424e-a79d-204a1af8828f tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517" status: 200 len: 1458 microversion: 2.1 time: 0.222259 Sep 07 12:29:30.488237 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 175/360] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:30 2022] GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517 => generated 1458 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:30.778873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cd15e8dd-2129-45b9-bedd-5674431c9892 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:30.779551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cd15e8dd-2129-45b9-bedd-5674431c9892 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:30.791595 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd15e8dd-2129-45b9-bedd-5674431c9892 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:30.792120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd15e8dd-2129-45b9-bedd-5674431c9892 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:30.792567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd15e8dd-2129-45b9-bedd-5674431c9892 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:30.793304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd15e8dd-2129-45b9-bedd-5674431c9892 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:30.793804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd15e8dd-2129-45b9-bedd-5674431c9892 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:30.796557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd15e8dd-2129-45b9-bedd-5674431c9892 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:31.033892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aac682b4-9f5e-4294-8a6d-fbb5f3e0925e tempest-KeyPairsV210TestJSON-1579557067 tempest-KeyPairsV210TestJSON-1579557067-project-admin] Action: 'create', calling method: .version_select at 0x7fc41971b3a0>, body: {"keypair": {"name": "tempest-keypair-2042717547", "type": "ssh", "user_id": "387b41ef132747dda2223bb923848e4b", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgfJzof1QM/OQCNck2Q5kKkTrLJdfshmxtzanNd8y4Z/Y5ZQUEJoHiwV3FUjGjyLbjT+guBsZeNQ2dHT0cI0etiFaryJRR9SOifu4B8pNzHTeroGjh0CGxrO7nhqgdz/g=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:31.097753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-aac682b4-9f5e-4294-8a6d-fbb5f3e0925e tempest-KeyPairsV210TestJSON-1579557067 tempest-KeyPairsV210TestJSON-1579557067-project-admin] Getting quotas for project 8fd20aeee6b5414686ccb86a4b6418e5. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:29:31.112638 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-aac682b4-9f5e-4294-8a6d-fbb5f3e0925e tempest-KeyPairsV210TestJSON-1579557067 tempest-KeyPairsV210TestJSON-1579557067-project-admin] Getting quotas for user 7ca70832f6284e9cb05eb74c4cef20f8 and project 8fd20aeee6b5414686ccb86a4b6418e5. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:29:31.184603 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aac682b4-9f5e-4294-8a6d-fbb5f3e0925e tempest-KeyPairsV210TestJSON-1579557067 tempest-KeyPairsV210TestJSON-1579557067-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.571409 Sep 07 12:29:31.186026 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 186/361] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Sep 7 12:29:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 573 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 12:29:31.202039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2a7c10c8-a4f8-47f3-90a8-6b6b7d4af0a0 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:31.203289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2a7c10c8-a4f8-47f3-90a8-6b6b7d4af0a0 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] [instance: 3922432a-d58f-4f0a-9471-5c8c210caa9e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:31.212737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a7c10c8-a4f8-47f3-90a8-6b6b7d4af0a0 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:31.213731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a7c10c8-a4f8-47f3-90a8-6b6b7d4af0a0 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:31.214517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a7c10c8-a4f8-47f3-90a8-6b6b7d4af0a0 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:31.215780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a7c10c8-a4f8-47f3-90a8-6b6b7d4af0a0 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:31.219291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a7c10c8-a4f8-47f3-90a8-6b6b7d4af0a0 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:31.219981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a7c10c8-a4f8-47f3-90a8-6b6b7d4af0a0 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:31.378605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cd15e8dd-2129-45b9-bedd-5674431c9892 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:31.393503 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cd15e8dd-2129-45b9-bedd-5674431c9892 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1477 microversion: 2.1 time: 0.619458 Sep 07 12:29:31.406153 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 176/362] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:30 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1477 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:31.416513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ec7658f-9350-4b33-97a6-acf40be115d1 tempest-KeyPairsV210TestJSON-1579557067 tempest-KeyPairsV210TestJSON-1579557067-project-admin] Action: 'create', calling method: .version_select at 0x7fc419ad38b0>, body: {"keypair": {"name": "tempest-keypair-914759636", "type": "ssh", "user_id": "387b41ef132747dda2223bb923848e4b", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCBzflonJxGME2TOp66Ai6yemuRKMA8e+bbWU63P+yW8fw87jovWdfu86+YJrTokS5n+roV0lfbtqguttFpST7NqPtYOVPHvWbrkv7lgNV6QQqjjDyL82cuMLys2hCf5w=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:31.435868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-8ec7658f-9350-4b33-97a6-acf40be115d1 tempest-KeyPairsV210TestJSON-1579557067 tempest-KeyPairsV210TestJSON-1579557067-project-admin] Getting quotas for project 8fd20aeee6b5414686ccb86a4b6418e5. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:29:31.444687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-8ec7658f-9350-4b33-97a6-acf40be115d1 tempest-KeyPairsV210TestJSON-1579557067 tempest-KeyPairsV210TestJSON-1579557067-project-admin] Getting quotas for user 7ca70832f6284e9cb05eb74c4cef20f8 and project 8fd20aeee6b5414686ccb86a4b6418e5. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:29:31.479412 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8ec7658f-9350-4b33-97a6-acf40be115d1 tempest-KeyPairsV210TestJSON-1579557067 tempest-KeyPairsV210TestJSON-1579557067-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.071687 Sep 07 12:29:31.480295 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 177/363] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Sep 7 12:29:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 12:29:31.483850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2a7c10c8-a4f8-47f3-90a8-6b6b7d4af0a0 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f867ffebff94e3785cbaf0dc19f518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d676a2aa1bf4032965482efdd697502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:31.485902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-60e75d04-29f8-4725-8586-bb8877cf0b35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:31.489391 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-60e75d04-29f8-4725-8586-bb8877cf0b35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:31.492568 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2a7c10c8-a4f8-47f3-90a8-6b6b7d4af0a0 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] 10.222.0.16 "GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e" status: 200 len: 1323 microversion: 2.1 time: 0.296373 Sep 07 12:29:31.497636 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 187/364] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:31 2022] GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e => generated 1323 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:31.514241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60e75d04-29f8-4725-8586-bb8877cf0b35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:31.514963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60e75d04-29f8-4725-8586-bb8877cf0b35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:31.515579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60e75d04-29f8-4725-8586-bb8877cf0b35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:31.516584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60e75d04-29f8-4725-8586-bb8877cf0b35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:31.517044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60e75d04-29f8-4725-8586-bb8877cf0b35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:31.517664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60e75d04-29f8-4725-8586-bb8877cf0b35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:31.721443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0f589d82-da22-4b4a-92de-3e841c24f783 tempest-HypervisorAdminV228Test-1455289540 tempest-HypervisorAdminV228Test-1455289540-project-admin] Calling method '.version_select at 0x7fc419670af0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:31.723427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f589d82-da22-4b4a-92de-3e841c24f783 tempest-HypervisorAdminV228Test-1455289540 tempest-HypervisorAdminV228Test-1455289540-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:31.724212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f589d82-da22-4b4a-92de-3e841c24f783 tempest-HypervisorAdminV228Test-1455289540 tempest-HypervisorAdminV228Test-1455289540-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:31.724673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f589d82-da22-4b4a-92de-3e841c24f783 tempest-HypervisorAdminV228Test-1455289540 tempest-HypervisorAdminV228Test-1455289540-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:31.735111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-60e75d04-29f8-4725-8586-bb8877cf0b35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:31.744766 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-60e75d04-29f8-4725-8586-bb8877cf0b35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1505 microversion: 2.1 time: 0.263243 Sep 07 12:29:31.749059 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 178/365] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:31 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1505 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:31.767381 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f589d82-da22-4b4a-92de-3e841c24f783 tempest-HypervisorAdminV228Test-1455289540 tempest-HypervisorAdminV228Test-1455289540-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:31.767884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f589d82-da22-4b4a-92de-3e841c24f783 tempest-HypervisorAdminV228Test-1455289540 tempest-HypervisorAdminV228Test-1455289540-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:31.768323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f589d82-da22-4b4a-92de-3e841c24f783 tempest-HypervisorAdminV228Test-1455289540 tempest-HypervisorAdminV228Test-1455289540-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:31.786026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f589d82-da22-4b4a-92de-3e841c24f783 tempest-HypervisorAdminV228Test-1455289540 tempest-HypervisorAdminV228Test-1455289540-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:31.786525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f589d82-da22-4b4a-92de-3e841c24f783 tempest-HypervisorAdminV228Test-1455289540 tempest-HypervisorAdminV228Test-1455289540-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:31.786958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f589d82-da22-4b4a-92de-3e841c24f783 tempest-HypervisorAdminV228Test-1455289540 tempest-HypervisorAdminV228Test-1455289540-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:31.794460 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0f589d82-da22-4b4a-92de-3e841c24f783 tempest-HypervisorAdminV228Test-1455289540 tempest-HypervisorAdminV228Test-1455289540-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.295477 Sep 07 12:29:31.795637 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 188/366] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Sep 7 12:29:31 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:29:31.800417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c522452b-66b3-48db-8c44-1264d8a402cb tempest-KeyPairsV210TestJSON-1579557067 tempest-KeyPairsV210TestJSON-1579557067-project-admin] Calling method '.version_select at 0x7fc419670550>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:31.813847 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c522452b-66b3-48db-8c44-1264d8a402cb tempest-KeyPairsV210TestJSON-1579557067 tempest-KeyPairsV210TestJSON-1579557067-project-admin] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-2042717547?user_id=387b41ef132747dda2223bb923848e4b" status: 200 len: 512 microversion: 2.10 time: 0.016874 Sep 07 12:29:31.814781 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 189/367] 10.222.0.16 () {60 vars in 1340 bytes} [Wed Sep 7 12:29:31 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2042717547?user_id=387b41ef132747dda2223bb923848e4b => generated 512 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:29:31.819625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b0c0fea3-edb7-43c6-9d64-8a298eb202a4 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:31.820415 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b0c0fea3-edb7-43c6-9d64-8a298eb202a4 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 5d805427-079e-4967-be30-5d5c8eb38517] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:31.826973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0c0fea3-edb7-43c6-9d64-8a298eb202a4 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:31.827861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0c0fea3-edb7-43c6-9d64-8a298eb202a4 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:31.828438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0c0fea3-edb7-43c6-9d64-8a298eb202a4 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:31.829632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0c0fea3-edb7-43c6-9d64-8a298eb202a4 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:31.830562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0c0fea3-edb7-43c6-9d64-8a298eb202a4 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:31.831198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0c0fea3-edb7-43c6-9d64-8a298eb202a4 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:31.850883 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c9f1fd03-a3ae-4372-a2cd-efcd9bb09eaf tempest-NetworksTest-758213005 tempest-NetworksTest-758213005-project-admin] Calling method '.version_select at 0x7fc419795430>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:31.871743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0c0fea3-edb7-43c6-9d64-8a298eb202a4 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:31.872515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0c0fea3-edb7-43c6-9d64-8a298eb202a4 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:31.873094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0c0fea3-edb7-43c6-9d64-8a298eb202a4 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:31.873714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-b0c0fea3-edb7-43c6-9d64-8a298eb202a4 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lazy-loading 'fault' on Instance uuid 5d805427-079e-4967-be30-5d5c8eb38517 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:29:32.011378 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b0c0fea3-edb7-43c6-9d64-8a298eb202a4 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d616d33dbe4521ac53ae7566591b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4776ccec9dd448738cf516cdd96573d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:32.025102 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b0c0fea3-edb7-43c6-9d64-8a298eb202a4 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517" status: 200 len: 1416 microversion: 2.1 time: 0.209155 Sep 07 12:29:32.030033 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 190/368] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:31 2022] GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517 => generated 1416 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:32.040881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2fbed8bd-70d9-4b2a-b0d0-0875450dfdc6 tempest-HypervisorAdminV228Test-1455289540 tempest-HypervisorAdminV228Test-1455289540-project-admin] Calling method '.version_select at 0x7fc419640af0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:32.047272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fbed8bd-70d9-4b2a-b0d0-0875450dfdc6 tempest-HypervisorAdminV228Test-1455289540 tempest-HypervisorAdminV228Test-1455289540-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:32.047272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fbed8bd-70d9-4b2a-b0d0-0875450dfdc6 tempest-HypervisorAdminV228Test-1455289540 tempest-HypervisorAdminV228Test-1455289540-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:32.047272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fbed8bd-70d9-4b2a-b0d0-0875450dfdc6 tempest-HypervisorAdminV228Test-1455289540 tempest-HypervisorAdminV228Test-1455289540-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:32.070072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fbed8bd-70d9-4b2a-b0d0-0875450dfdc6 tempest-HypervisorAdminV228Test-1455289540 tempest-HypervisorAdminV228Test-1455289540-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:32.071694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fbed8bd-70d9-4b2a-b0d0-0875450dfdc6 tempest-HypervisorAdminV228Test-1455289540 tempest-HypervisorAdminV228Test-1455289540-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:32.072614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fbed8bd-70d9-4b2a-b0d0-0875450dfdc6 tempest-HypervisorAdminV228Test-1455289540 tempest-HypervisorAdminV228Test-1455289540-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:32.083699 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2fbed8bd-70d9-4b2a-b0d0-0875450dfdc6 tempest-HypervisorAdminV228Test-1455289540 tempest-HypervisorAdminV228Test-1455289540-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.051874 Sep 07 12:29:32.085458 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 191/369] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Sep 7 12:29:32 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:29:32.093207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a089f26e-91e6-4318-8429-fc6d442a6ee7 tempest-KeyPairsV210TestJSON-1579557067 tempest-KeyPairsV210TestJSON-1579557067-project-admin] Action: 'create', calling method: .version_select at 0x7fc41971b790>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-558116596", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPqkLfZEt6hLDC6LAUfIDsqdC5CGAIBNJwTFEmZKXDsbPVYnc9jH6acC0w8sdRgzytXxyyBYNE0x9/Y/hMTUuYAPtwc3kJbNDTBcbVsd4B8Cm3OBQC5bkc53ra6a5SXGQ=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:32.120829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-a089f26e-91e6-4318-8429-fc6d442a6ee7 tempest-KeyPairsV210TestJSON-1579557067 tempest-KeyPairsV210TestJSON-1579557067-project-admin] Getting quotas for project 8fd20aeee6b5414686ccb86a4b6418e5. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:29:32.124584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:32.127444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-a089f26e-91e6-4318-8429-fc6d442a6ee7 tempest-KeyPairsV210TestJSON-1579557067 tempest-KeyPairsV210TestJSON-1579557067-project-admin] Getting quotas for user 7ca70832f6284e9cb05eb74c4cef20f8 and project 8fd20aeee6b5414686ccb86a4b6418e5. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:29:32.162502 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a089f26e-91e6-4318-8429-fc6d442a6ee7 tempest-KeyPairsV210TestJSON-1579557067 tempest-KeyPairsV210TestJSON-1579557067-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.075380 Sep 07 12:29:32.163334 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 192/370] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Sep 7 12:29:32 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 77 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 12:29:32.170083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c2f5b14d-4b80-484b-919e-16bf0efaa21f req-69f674c2-39a8-426d-8d10-c09566c8cd3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d805427-079e-4967-be30-5d5c8eb38517", "name": "network-vif-deleted", "tag": "e3d02637-9e31-486a-bd2d-7b8356c6942f"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:32.183950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c2f5b14d-4b80-484b-919e-16bf0efaa21f req-69f674c2-39a8-426d-8d10-c09566c8cd3c service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:32.185325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c2f5b14d-4b80-484b-919e-16bf0efaa21f req-69f674c2-39a8-426d-8d10-c09566c8cd3c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:32.186099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c2f5b14d-4b80-484b-919e-16bf0efaa21f req-69f674c2-39a8-426d-8d10-c09566c8cd3c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:32.205844 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c2f5b14d-4b80-484b-919e-16bf0efaa21f req-69f674c2-39a8-426d-8d10-c09566c8cd3c service nova] Creating event network-vif-deleted:e3d02637-9e31-486a-bd2d-7b8356c6942f for instance 5d805427-079e-4967-be30-5d5c8eb38517 on n-h1-852087-9 Sep 07 12:29:32.214109 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c2f5b14d-4b80-484b-919e-16bf0efaa21f req-69f674c2-39a8-426d-8d10-c09566c8cd3c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047059 Sep 07 12:29:32.214109 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 193/371] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:32.214911 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c9f1fd03-a3ae-4372-a2cd-efcd9bb09eaf tempest-NetworksTest-758213005 tempest-NetworksTest-758213005-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks" status: 200 len: 4685 microversion: 2.1 time: 0.464688 Sep 07 12:29:32.215511 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 179/372] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:29:31 2022] GET /compute/v2.1/os-networks => generated 4685 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:32.220101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b6e8aac8-617e-455d-86a5-fff2d7c3044f tempest-KeyPairsV210TestJSON-1579557067 tempest-KeyPairsV210TestJSON-1579557067-project-admin] Calling method '.version_select at 0x7fc419640af0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:32.223807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-80531058-a361-4a50-ab4f-93fff1aa0cfd tempest-NetworksTest-758213005 tempest-NetworksTest-758213005-project-admin] Calling method '.version_select at 0x7fc41982ae50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:32.225838 n-d-852087-9 devstack@n-api.service[122432]: WARNING oslo_db.sqlalchemy.utils [None req-b6e8aac8-617e-455d-86a5-fff2d7c3044f tempest-KeyPairsV210TestJSON-1579557067 tempest-KeyPairsV210TestJSON-1579557067-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Sep 07 12:29:32.234702 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b6e8aac8-617e-455d-86a5-fff2d7c3044f tempest-KeyPairsV210TestJSON-1579557067 tempest-KeyPairsV210TestJSON-1579557067-project-admin] 10.222.0.16 "GET /compute/v2.1/os-keypairs?user_id=387b41ef132747dda2223bb923848e4b" status: 200 len: 725 microversion: 2.10 time: 0.019334 Sep 07 12:29:32.241800 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 194/373] 10.222.0.16 () {60 vars in 1259 bytes} [Wed Sep 7 12:29:32 2022] GET /compute/v2.1/os-keypairs?user_id=387b41ef132747dda2223bb923848e4b => generated 725 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:29:32.250168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c3b6e11a-beaf-4b06-b27c-f1b25c350ca3 tempest-KeyPairsV210TestJSON-1579557067 tempest-KeyPairsV210TestJSON-1579557067-project-admin] Calling method '.version_select at 0x7fc41971bc10>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:32.279407 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c3b6e11a-beaf-4b06-b27c-f1b25c350ca3 tempest-KeyPairsV210TestJSON-1579557067 tempest-KeyPairsV210TestJSON-1579557067-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-558116596" status: 204 len: 0 microversion: 2.10 time: 0.035445 Sep 07 12:29:32.283478 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 195/374] 10.222.0.16 () {60 vars in 1322 bytes} [Wed Sep 7 12:29:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-558116596 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 07 12:29:32.294659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd22d666-86d6-4aa4-bee4-c1761cf69848 tempest-KeyPairsV210TestJSON-1579557067 tempest-KeyPairsV210TestJSON-1579557067-project-admin] Calling method '.version_select at 0x7fc419670f70>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:32.323008 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dd22d666-86d6-4aa4-bee4-c1761cf69848 tempest-KeyPairsV210TestJSON-1579557067 tempest-KeyPairsV210TestJSON-1579557067-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-914759636?user_id=387b41ef132747dda2223bb923848e4b" status: 204 len: 0 microversion: 2.10 time: 0.032223 Sep 07 12:29:32.323862 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 196/375] 10.222.0.16 () {60 vars in 1340 bytes} [Wed Sep 7 12:29:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-914759636?user_id=387b41ef132747dda2223bb923848e4b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:29:32.334417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e49a7cfe-06a9-4cf1-a0f0-386c8f113159 tempest-KeyPairsV210TestJSON-1579557067 tempest-KeyPairsV210TestJSON-1579557067-project-admin] Calling method '.version_select at 0x7fc41971baf0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:32.360811 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e49a7cfe-06a9-4cf1-a0f0-386c8f113159 tempest-KeyPairsV210TestJSON-1579557067 tempest-KeyPairsV210TestJSON-1579557067-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2042717547?user_id=387b41ef132747dda2223bb923848e4b" status: 204 len: 0 microversion: 2.10 time: 0.031484 Sep 07 12:29:32.362446 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 197/376] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Sep 7 12:29:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2042717547?user_id=387b41ef132747dda2223bb923848e4b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:29:32.371443 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-80531058-a361-4a50-ab4f-93fff1aa0cfd tempest-NetworksTest-758213005 tempest-NetworksTest-758213005-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks/5faca153-d2fc-423d-9176-48ca0ab99907" status: 200 len: 652 microversion: 2.1 time: 0.151231 Sep 07 12:29:32.372390 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 180/377] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Sep 7 12:29:32 2022] GET /compute/v2.1/os-networks/5faca153-d2fc-423d-9176-48ca0ab99907 => generated 652 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:32.383671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9ba1345d-5edd-4515-adb7-4220df98694c tempest-NetworksTest-758213005 tempest-NetworksTest-758213005-project-admin] Calling method '.version_select at 0x7fc4199b3790>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:32.420223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-388a895d-12a1-4b82-baf9-cf7432e60d43 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:32.421609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-388a895d-12a1-4b82-baf9-cf7432e60d43 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:32.427820 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-388a895d-12a1-4b82-baf9-cf7432e60d43 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:32.428565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-388a895d-12a1-4b82-baf9-cf7432e60d43 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:32.429177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-388a895d-12a1-4b82-baf9-cf7432e60d43 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:32.430135 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-388a895d-12a1-4b82-baf9-cf7432e60d43 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:32.430732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-388a895d-12a1-4b82-baf9-cf7432e60d43 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:32.431414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-388a895d-12a1-4b82-baf9-cf7432e60d43 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:32.600801 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9ba1345d-5edd-4515-adb7-4220df98694c tempest-NetworksTest-758213005 tempest-NetworksTest-758213005-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks" status: 200 len: 4685 microversion: 2.1 time: 0.221160 Sep 07 12:29:32.600801 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 198/378] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:29:32 2022] GET /compute/v2.1/os-networks => generated 4685 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:32.606266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e8df3809-9e28-4cb2-b78b-7f42bb2dc961 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:32.614437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e8df3809-9e28-4cb2-b78b-7f42bb2dc961 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] [instance: 3922432a-d58f-4f0a-9471-5c8c210caa9e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:32.626307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8df3809-9e28-4cb2-b78b-7f42bb2dc961 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:32.627194 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8df3809-9e28-4cb2-b78b-7f42bb2dc961 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:32.627392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8df3809-9e28-4cb2-b78b-7f42bb2dc961 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:32.628110 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8df3809-9e28-4cb2-b78b-7f42bb2dc961 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:32.628570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8df3809-9e28-4cb2-b78b-7f42bb2dc961 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:32.628993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8df3809-9e28-4cb2-b78b-7f42bb2dc961 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:32.673093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-388a895d-12a1-4b82-baf9-cf7432e60d43 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:32.681879 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-388a895d-12a1-4b82-baf9-cf7432e60d43 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1477 microversion: 2.1 time: 0.265450 Sep 07 12:29:32.694222 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 181/379] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:32 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1477 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:29:32.779115 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9f64f445-057f-4ce5-bf11-0524a4aa5409 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:32.782551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9f64f445-057f-4ce5-bf11-0524a4aa5409 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:32.799271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f64f445-057f-4ce5-bf11-0524a4aa5409 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:32.799714 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f64f445-057f-4ce5-bf11-0524a4aa5409 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:32.805770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f64f445-057f-4ce5-bf11-0524a4aa5409 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:32.806693 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f64f445-057f-4ce5-bf11-0524a4aa5409 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:32.807259 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f64f445-057f-4ce5-bf11-0524a4aa5409 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:32.813123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f64f445-057f-4ce5-bf11-0524a4aa5409 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:32.839642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e8df3809-9e28-4cb2-b78b-7f42bb2dc961 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f867ffebff94e3785cbaf0dc19f518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d676a2aa1bf4032965482efdd697502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:32.851078 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e8df3809-9e28-4cb2-b78b-7f42bb2dc961 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] 10.222.0.16 "GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e" status: 200 len: 1323 microversion: 2.1 time: 0.248530 Sep 07 12:29:32.854978 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 199/380] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:32 2022] GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e => generated 1323 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:33.049252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-629aa7c4-6a90-4ae5-bb9b-5eebbbab74c3 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:33.049973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-629aa7c4-6a90-4ae5-bb9b-5eebbbab74c3 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 5d805427-079e-4967-be30-5d5c8eb38517] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:33.052234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:33.066965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-629aa7c4-6a90-4ae5-bb9b-5eebbbab74c3 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:33.068028 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-629aa7c4-6a90-4ae5-bb9b-5eebbbab74c3 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:33.068485 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-629aa7c4-6a90-4ae5-bb9b-5eebbbab74c3 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:33.069261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-629aa7c4-6a90-4ae5-bb9b-5eebbbab74c3 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:33.071525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-629aa7c4-6a90-4ae5-bb9b-5eebbbab74c3 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:33.072095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-629aa7c4-6a90-4ae5-bb9b-5eebbbab74c3 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:33.103031 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-629aa7c4-6a90-4ae5-bb9b-5eebbbab74c3 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] HTTP exception thrown: Instance 5d805427-079e-4967-be30-5d5c8eb38517 could not be found. Sep 07 12:29:33.104803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-629aa7c4-6a90-4ae5-bb9b-5eebbbab74c3 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Request method failure captured: Sep 07 12:29:33.104803 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517 HTTP/1.1 Sep 07 12:29:33.104803 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:29:33.104803 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:29:33.104803 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:29:33.104803 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:29:33.104803 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:29:33.104803 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:29:33.104803 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:29:33.104803 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:33.104803 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5vrNAtLrvnS2mLr2eH1sHGdCHiiq6ihJHwa7Ii5X5y-e_PRT9DOhZAriwcztAr0w95NRniJ3h5WTLTA4JTBM32Nr-ZZBnWA0TTf1WCHu56YRoGmIcPuyld0NACed19sW_ab9VXLGIxLm6OMzIzbwar75KiG2RcEg5NiaAioi2oxTY Sep 07 12:29:33.104803 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:29:33.104803 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:29:33.104803 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:29:33.104803 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:29:33.104803 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:29:33.104803 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:29:33.104803 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 4776ccec9dd448738cf516cdd96573d2 Sep 07 12:29:33.104803 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1795891865 Sep 07 12:29:33.104803 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:29:33.104803 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:29:33.106204 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4776ccec9dd448738cf516cdd96573d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4776ccec9dd448738cf516cdd96573d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4776ccec9dd448738cf516cdd96573d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4776ccec9dd448738cf516cdd96573d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:33.106204 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersAdminTestJSON-1795891865 Sep 07 12:29:33.106204 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 4776ccec9dd448738cf516cdd96573d2 Sep 07 12:29:33.106204 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1795891865 Sep 07 12:29:33.106204 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-DeleteServersAdminTestJSON-1795891865-project Sep 07 12:29:33.106204 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:29:33.106204 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:29:33.106204 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 84d616d33dbe4521ac53ae7566591b81 Sep 07 12:29:33.106204 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersAdminTestJSON-1795891865-project Sep 07 12:29:33.106204 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:29:33.106204 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 5d805427-079e-4967-be30-5d5c8eb38517 could not be found. Sep 07 12:29:33.106204 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '5d805427-079e-4967-be30-5d5c8eb38517'} Sep 07 12:29:33.106992 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:33.106992 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:33.106992 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:29:33.106992 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:29:33.106992 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:29:33.106992 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:29:33.106992 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:29:33.106992 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:29:33.106992 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:29:33.106992 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:29:33.106992 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d805427-079e-4967-be30-5d5c8eb38517 could not be found. Sep 07 12:29:33.106992 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:33.106992 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:33.106992 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:33.106992 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:33.106992 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:33.106992 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:33.106992 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:33.106992 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:33.106992 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:33.108252 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:33.108252 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:29:33.108252 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:29:33.108252 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:29:33.108252 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:29:33.108252 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:29:33.108252 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:29:33.108252 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d805427-079e-4967-be30-5d5c8eb38517 could not be found. Sep 07 12:29:33.108252 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:33.108252 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:33.108252 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:33.108252 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:33.108252 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:33.108252 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:33.108252 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:29:33.108252 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:29:33.108252 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d805427-079e-4967-be30-5d5c8eb38517 could not be found. Sep 07 12:29:33.108252 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:33.109657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-629aa7c4-6a90-4ae5-bb9b-5eebbbab74c3 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Returning 404 to user: Instance 5d805427-079e-4967-be30-5d5c8eb38517 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:33.110646 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-629aa7c4-6a90-4ae5-bb9b-5eebbbab74c3 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517" status: 404 len: 111 microversion: 2.1 time: 0.066420 Sep 07 12:29:33.117650 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 200/381] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:33 2022] GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:29:33.131377 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f22398f3-3500-4b7e-a5b1-7f51b7315c53 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:33.134931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f22398f3-3500-4b7e-a5b1-7f51b7315c53 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 5d805427-079e-4967-be30-5d5c8eb38517] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:33.147633 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f22398f3-3500-4b7e-a5b1-7f51b7315c53 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:33.149261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f22398f3-3500-4b7e-a5b1-7f51b7315c53 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:33.150659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f22398f3-3500-4b7e-a5b1-7f51b7315c53 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:33.152425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f22398f3-3500-4b7e-a5b1-7f51b7315c53 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:33.154402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f22398f3-3500-4b7e-a5b1-7f51b7315c53 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:33.155540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f22398f3-3500-4b7e-a5b1-7f51b7315c53 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:33.177638 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-f22398f3-3500-4b7e-a5b1-7f51b7315c53 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] HTTP exception thrown: Instance 5d805427-079e-4967-be30-5d5c8eb38517 could not be found. Sep 07 12:29:33.179512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f22398f3-3500-4b7e-a5b1-7f51b7315c53 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Request method failure captured: Sep 07 12:29:33.179512 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517 HTTP/1.1 Sep 07 12:29:33.179512 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:29:33.179512 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:29:33.179512 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:29:33.179512 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:29:33.179512 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:29:33.179512 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:29:33.179512 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:29:33.179512 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:33.179512 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5vrNAtLrvnS2mLr2eH1sHGdCHiiq6ihJHwa7Ii5X5y-e_PRT9DOhZAriwcztAr0w95NRniJ3h5WTLTA4JTBM32Nr-ZZBnWA0TTf1WCHu56YRoGmIcPuyld0NACed19sW_ab9VXLGIxLm6OMzIzbwar75KiG2RcEg5NiaAioi2oxTY Sep 07 12:29:33.179512 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:29:33.179512 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:29:33.179512 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:29:33.179512 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:29:33.179512 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:29:33.179512 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:29:33.179512 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 4776ccec9dd448738cf516cdd96573d2 Sep 07 12:29:33.179512 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1795891865 Sep 07 12:29:33.179512 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:29:33.179512 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:29:33.180891 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4776ccec9dd448738cf516cdd96573d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4776ccec9dd448738cf516cdd96573d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4776ccec9dd448738cf516cdd96573d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4776ccec9dd448738cf516cdd96573d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:33.180891 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersAdminTestJSON-1795891865 Sep 07 12:29:33.180891 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 4776ccec9dd448738cf516cdd96573d2 Sep 07 12:29:33.180891 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1795891865 Sep 07 12:29:33.180891 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-DeleteServersAdminTestJSON-1795891865-project Sep 07 12:29:33.180891 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:29:33.180891 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:29:33.180891 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 84d616d33dbe4521ac53ae7566591b81 Sep 07 12:29:33.180891 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersAdminTestJSON-1795891865-project Sep 07 12:29:33.180891 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:29:33.180891 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 5d805427-079e-4967-be30-5d5c8eb38517 could not be found. Sep 07 12:29:33.180891 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '5d805427-079e-4967-be30-5d5c8eb38517'} Sep 07 12:29:33.181825 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:33.181825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:33.181825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:29:33.181825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:29:33.181825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:29:33.181825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:29:33.181825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:29:33.181825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:29:33.181825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:29:33.181825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:29:33.181825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d805427-079e-4967-be30-5d5c8eb38517 could not be found. Sep 07 12:29:33.181825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:33.181825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:33.181825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:33.181825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:33.181825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:33.181825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:33.181825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:33.181825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:33.181825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:33.182872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:33.182872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:29:33.182872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:29:33.182872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:29:33.182872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:29:33.182872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:29:33.182872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:29:33.182872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:29:33.182872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:29:33.182872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d805427-079e-4967-be30-5d5c8eb38517 could not be found. Sep 07 12:29:33.182872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:33.182872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:33.182872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:33.182872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:33.182872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:33.182872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:33.182872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:29:33.182872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:29:33.182872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d805427-079e-4967-be30-5d5c8eb38517 could not be found. Sep 07 12:29:33.182872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:33.186193 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f22398f3-3500-4b7e-a5b1-7f51b7315c53 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Returning 404 to user: Instance 5d805427-079e-4967-be30-5d5c8eb38517 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:33.187309 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f22398f3-3500-4b7e-a5b1-7f51b7315c53 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517" status: 404 len: 111 microversion: 2.1 time: 0.063491 Sep 07 12:29:33.188694 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 201/382] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:29:33 2022] DELETE /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:29:33.200654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df0f4433-7915-4f60-b86c-140f45c44356 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:33.201471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-df0f4433-7915-4f60-b86c-140f45c44356 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 5d805427-079e-4967-be30-5d5c8eb38517] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:33.219173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df0f4433-7915-4f60-b86c-140f45c44356 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:33.220229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df0f4433-7915-4f60-b86c-140f45c44356 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:33.220875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df0f4433-7915-4f60-b86c-140f45c44356 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:33.221868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df0f4433-7915-4f60-b86c-140f45c44356 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:33.224942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df0f4433-7915-4f60-b86c-140f45c44356 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:33.225714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df0f4433-7915-4f60-b86c-140f45c44356 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:33.256781 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-df0f4433-7915-4f60-b86c-140f45c44356 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] HTTP exception thrown: Instance 5d805427-079e-4967-be30-5d5c8eb38517 could not be found. Sep 07 12:29:33.261187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df0f4433-7915-4f60-b86c-140f45c44356 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Request method failure captured: Sep 07 12:29:33.261187 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517 HTTP/1.1 Sep 07 12:29:33.261187 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:29:33.261187 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:29:33.261187 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:29:33.261187 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:29:33.261187 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:29:33.261187 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:29:33.261187 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:29:33.261187 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:33.261187 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5vrNAtLrvnS2mLr2eH1sHGdCHiiq6ihJHwa7Ii5X5y-e_PRT9DOhZAriwcztAr0w95NRniJ3h5WTLTA4JTBM32Nr-ZZBnWA0TTf1WCHu56YRoGmIcPuyld0NACed19sW_ab9VXLGIxLm6OMzIzbwar75KiG2RcEg5NiaAioi2oxTY Sep 07 12:29:33.261187 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:29:33.261187 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:29:33.261187 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:29:33.261187 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:29:33.261187 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:29:33.261187 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:29:33.261187 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 4776ccec9dd448738cf516cdd96573d2 Sep 07 12:29:33.261187 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1795891865 Sep 07 12:29:33.261187 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:29:33.261187 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:29:33.262687 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4776ccec9dd448738cf516cdd96573d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4776ccec9dd448738cf516cdd96573d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4776ccec9dd448738cf516cdd96573d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4776ccec9dd448738cf516cdd96573d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:33.262687 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersAdminTestJSON-1795891865 Sep 07 12:29:33.262687 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 4776ccec9dd448738cf516cdd96573d2 Sep 07 12:29:33.262687 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1795891865 Sep 07 12:29:33.262687 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-DeleteServersAdminTestJSON-1795891865-project Sep 07 12:29:33.262687 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:29:33.262687 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:29:33.262687 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 84d616d33dbe4521ac53ae7566591b81 Sep 07 12:29:33.262687 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersAdminTestJSON-1795891865-project Sep 07 12:29:33.262687 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:29:33.262687 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 5d805427-079e-4967-be30-5d5c8eb38517 could not be found. Sep 07 12:29:33.262687 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '5d805427-079e-4967-be30-5d5c8eb38517'} Sep 07 12:29:33.263938 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:33.263938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:33.263938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:29:33.263938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:29:33.263938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:29:33.263938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:29:33.263938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:29:33.263938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:29:33.263938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:29:33.263938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:29:33.263938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d805427-079e-4967-be30-5d5c8eb38517 could not be found. Sep 07 12:29:33.263938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:33.263938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:33.263938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:33.263938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:33.263938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:33.263938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:33.263938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:33.263938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:33.263938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:33.265314 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:33.265314 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:29:33.265314 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:29:33.265314 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:29:33.265314 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:29:33.265314 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:29:33.265314 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:29:33.265314 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d805427-079e-4967-be30-5d5c8eb38517 could not be found. Sep 07 12:29:33.265314 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:33.265314 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:33.265314 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:33.265314 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:33.265314 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:33.265314 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:33.265314 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:29:33.265314 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:29:33.265314 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d805427-079e-4967-be30-5d5c8eb38517 could not be found. Sep 07 12:29:33.265314 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:33.266556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9f64f445-057f-4ce5-bf11-0524a4aa5409 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:33.269915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df0f4433-7915-4f60-b86c-140f45c44356 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Returning 404 to user: Instance 5d805427-079e-4967-be30-5d5c8eb38517 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:33.270835 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-df0f4433-7915-4f60-b86c-140f45c44356 tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517" status: 404 len: 111 microversion: 2.1 time: 0.078431 Sep 07 12:29:33.271399 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 202/383] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:33 2022] GET /compute/v2.1/servers/5d805427-079e-4967-be30-5d5c8eb38517 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:29:33.278803 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9f64f445-057f-4ce5-bf11-0524a4aa5409 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1495 microversion: 2.1 time: 0.511639 Sep 07 12:29:33.279818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5859b19f-558f-4d7c-8a89-c432fa33ee7a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:33.280320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5859b19f-558f-4d7c-8a89-c432fa33ee7a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:33.280824 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 182/384] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:32 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1495 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:29:33.302668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5859b19f-558f-4d7c-8a89-c432fa33ee7a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:33.303201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5859b19f-558f-4d7c-8a89-c432fa33ee7a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:33.303637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5859b19f-558f-4d7c-8a89-c432fa33ee7a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:33.304335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5859b19f-558f-4d7c-8a89-c432fa33ee7a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:33.304973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5859b19f-558f-4d7c-8a89-c432fa33ee7a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:33.305393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5859b19f-558f-4d7c-8a89-c432fa33ee7a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:33.319159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e26f9e7b-8095-4589-9a0a-9765e3111d72 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Calling method '.version_select at 0x7fc4197fe670>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:33.323485 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e26f9e7b-8095-4589-9a0a-9765e3111d72 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:33.323995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e26f9e7b-8095-4589-9a0a-9765e3111d72 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:33.324440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e26f9e7b-8095-4589-9a0a-9765e3111d72 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:33.328872 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-5859b19f-558f-4d7c-8a89-c432fa33ee7a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] HTTP exception thrown: Instance 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac could not be found. Sep 07 12:29:33.330809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5859b19f-558f-4d7c-8a89-c432fa33ee7a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Request method failure captured: Sep 07 12:29:33.330809 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac HTTP/1.1 Sep 07 12:29:33.330809 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:29:33.330809 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:29:33.330809 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:29:33.330809 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:29:33.330809 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:29:33.330809 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:29:33.330809 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:29:33.330809 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:33.330809 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5vrNAtLrvnS2mLr2eH1sHGdCHiiq6ihJHwa7Ii5X5y-e_PRT9DOhZAriwcztAr0w95NRniJ3h5WTLTA4JTBM32Nr-ZZBnWA0TTf1WCHu56YRoGmIcPuyld0NACed19sW_ab9VXLGIxLm6OMzIzbwar75KiG2RcEg5NiaAioi2oxTY Sep 07 12:29:33.330809 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:29:33.330809 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:29:33.330809 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:29:33.330809 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:29:33.330809 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:29:33.330809 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:29:33.330809 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 4776ccec9dd448738cf516cdd96573d2 Sep 07 12:29:33.330809 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1795891865 Sep 07 12:29:33.330809 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:29:33.330809 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:29:33.331994 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4776ccec9dd448738cf516cdd96573d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4776ccec9dd448738cf516cdd96573d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4776ccec9dd448738cf516cdd96573d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4776ccec9dd448738cf516cdd96573d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:33.331994 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersAdminTestJSON-1795891865 Sep 07 12:29:33.331994 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 4776ccec9dd448738cf516cdd96573d2 Sep 07 12:29:33.331994 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1795891865 Sep 07 12:29:33.331994 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-DeleteServersAdminTestJSON-1795891865-project Sep 07 12:29:33.331994 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:29:33.331994 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:29:33.331994 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 84d616d33dbe4521ac53ae7566591b81 Sep 07 12:29:33.331994 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersAdminTestJSON-1795891865-project Sep 07 12:29:33.331994 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:29:33.331994 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac could not be found. Sep 07 12:29:33.331994 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac'} Sep 07 12:29:33.332628 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:33.332628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:33.332628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:29:33.332628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:29:33.332628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:29:33.332628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:29:33.332628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:29:33.332628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:29:33.332628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:29:33.332628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:29:33.332628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac could not be found. Sep 07 12:29:33.332628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:33.332628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:33.332628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:33.332628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:33.332628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:33.332628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:33.332628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:33.332628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:33.332628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:33.333817 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:33.333817 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:29:33.333817 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:29:33.333817 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:29:33.333817 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:29:33.333817 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:29:33.333817 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:29:33.333817 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:29:33.333817 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:29:33.333817 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac could not be found. Sep 07 12:29:33.333817 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:33.333817 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:33.333817 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:33.333817 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:33.333817 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:33.333817 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:33.333817 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:29:33.333817 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:29:33.333817 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac could not be found. Sep 07 12:29:33.333817 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:33.334894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5859b19f-558f-4d7c-8a89-c432fa33ee7a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Returning 404 to user: Instance 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:33.334894 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5859b19f-558f-4d7c-8a89-c432fa33ee7a tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac" status: 404 len: 111 microversion: 2.1 time: 0.056295 Sep 07 12:29:33.337910 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 203/385] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:29:33 2022] DELETE /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:29:33.343914 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e26f9e7b-8095-4589-9a0a-9765e3111d72 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 791 microversion: 2.1 time: 0.042451 Sep 07 12:29:33.345000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0c4375d2-ae78-4261-9d23-f687a7d752ec tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:33.345557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0c4375d2-ae78-4261-9d23-f687a7d752ec tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] [instance: 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:33.350451 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 183/386] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Sep 7 12:29:33 2022] GET /compute/v2.1/os-migrations => generated 791 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:33.364642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5f46a489-b709-4f48-9a98-c1cb471a1d8b tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:33.365270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5f46a489-b709-4f48-9a98-c1cb471a1d8b tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:33.369471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c4375d2-ae78-4261-9d23-f687a7d752ec tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:33.371545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c4375d2-ae78-4261-9d23-f687a7d752ec tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:33.371978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f46a489-b709-4f48-9a98-c1cb471a1d8b tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:33.372791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f46a489-b709-4f48-9a98-c1cb471a1d8b tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:33.373237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f46a489-b709-4f48-9a98-c1cb471a1d8b tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:33.373993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f46a489-b709-4f48-9a98-c1cb471a1d8b tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:33.374436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f46a489-b709-4f48-9a98-c1cb471a1d8b tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:33.374988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c4375d2-ae78-4261-9d23-f687a7d752ec tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:33.375529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f46a489-b709-4f48-9a98-c1cb471a1d8b tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:33.376350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c4375d2-ae78-4261-9d23-f687a7d752ec tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:33.377639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c4375d2-ae78-4261-9d23-f687a7d752ec tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:33.378595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c4375d2-ae78-4261-9d23-f687a7d752ec tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:33.406494 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-0c4375d2-ae78-4261-9d23-f687a7d752ec tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] HTTP exception thrown: Instance 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac could not be found. Sep 07 12:29:33.409235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0c4375d2-ae78-4261-9d23-f687a7d752ec tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Request method failure captured: Sep 07 12:29:33.409235 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac HTTP/1.1 Sep 07 12:29:33.409235 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:29:33.409235 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:29:33.409235 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:29:33.409235 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:29:33.409235 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:29:33.409235 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:29:33.409235 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:29:33.409235 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:33.409235 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5vrNAtLrvnS2mLr2eH1sHGdCHiiq6ihJHwa7Ii5X5y-e_PRT9DOhZAriwcztAr0w95NRniJ3h5WTLTA4JTBM32Nr-ZZBnWA0TTf1WCHu56YRoGmIcPuyld0NACed19sW_ab9VXLGIxLm6OMzIzbwar75KiG2RcEg5NiaAioi2oxTY Sep 07 12:29:33.409235 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:29:33.409235 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:29:33.409235 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:29:33.409235 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:29:33.409235 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:29:33.409235 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:29:33.409235 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 4776ccec9dd448738cf516cdd96573d2 Sep 07 12:29:33.409235 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1795891865 Sep 07 12:29:33.409235 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:29:33.409235 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:29:33.410515 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4776ccec9dd448738cf516cdd96573d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4776ccec9dd448738cf516cdd96573d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4776ccec9dd448738cf516cdd96573d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4776ccec9dd448738cf516cdd96573d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:33.410515 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersAdminTestJSON-1795891865 Sep 07 12:29:33.410515 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 4776ccec9dd448738cf516cdd96573d2 Sep 07 12:29:33.410515 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1795891865 Sep 07 12:29:33.410515 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-DeleteServersAdminTestJSON-1795891865-project Sep 07 12:29:33.410515 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:29:33.410515 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:29:33.410515 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 84d616d33dbe4521ac53ae7566591b81 Sep 07 12:29:33.410515 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersAdminTestJSON-1795891865-project Sep 07 12:29:33.410515 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:29:33.410515 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac could not be found. Sep 07 12:29:33.410515 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac'} Sep 07 12:29:33.411157 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:33.411157 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:33.411157 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:29:33.411157 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:29:33.411157 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:29:33.411157 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:29:33.411157 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:29:33.411157 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:29:33.411157 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:29:33.411157 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:29:33.411157 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac could not be found. Sep 07 12:29:33.411157 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:33.411157 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:33.411157 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:33.411157 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:33.411157 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:33.411157 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:33.411157 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:33.411157 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:33.411157 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:33.412215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:33.412215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:29:33.412215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:29:33.412215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:29:33.412215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:29:33.412215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:29:33.412215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:29:33.412215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac could not be found. Sep 07 12:29:33.412215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:33.412215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:33.412215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:33.412215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:33.412215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:33.412215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:33.412215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:29:33.412215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:29:33.412215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac could not be found. Sep 07 12:29:33.412215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:33.415909 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0c4375d2-ae78-4261-9d23-f687a7d752ec tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] Returning 404 to user: Instance 6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:33.417693 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0c4375d2-ae78-4261-9d23-f687a7d752ec tempest-DeleteServersAdminTestJSON-1795891865 tempest-DeleteServersAdminTestJSON-1795891865-project] 10.222.0.16 "GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac" status: 404 len: 111 microversion: 2.1 time: 0.076145 Sep 07 12:29:33.419138 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 204/387] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:33 2022] GET /compute/v2.1/servers/6c9e14a6-c0cc-438f-bdb7-d44ab409e8ac => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:29:33.550173 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5f46a489-b709-4f48-9a98-c1cb471a1d8b tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1646 microversion: 2.1 time: 0.193915 Sep 07 12:29:33.568111 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 184/388] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:33 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1646 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:33.718314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-89f099f2-612a-4a39-a7db-f3001aed797e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:33.719363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-89f099f2-612a-4a39-a7db-f3001aed797e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:33.732845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89f099f2-612a-4a39-a7db-f3001aed797e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:33.734659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89f099f2-612a-4a39-a7db-f3001aed797e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:33.735568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89f099f2-612a-4a39-a7db-f3001aed797e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:33.738366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89f099f2-612a-4a39-a7db-f3001aed797e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:33.740632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89f099f2-612a-4a39-a7db-f3001aed797e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:33.741667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89f099f2-612a-4a39-a7db-f3001aed797e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:33.880023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-76b19098-1485-42d8-9183-52d6969e20e0 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:33.881874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-76b19098-1485-42d8-9183-52d6969e20e0 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] [instance: 3922432a-d58f-4f0a-9471-5c8c210caa9e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:33.913628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76b19098-1485-42d8-9183-52d6969e20e0 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:33.914503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76b19098-1485-42d8-9183-52d6969e20e0 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:33.915276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76b19098-1485-42d8-9183-52d6969e20e0 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:33.916310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76b19098-1485-42d8-9183-52d6969e20e0 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:33.916929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76b19098-1485-42d8-9183-52d6969e20e0 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:33.917624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76b19098-1485-42d8-9183-52d6969e20e0 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:34.160577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-89f099f2-612a-4a39-a7db-f3001aed797e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:34.169343 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-89f099f2-612a-4a39-a7db-f3001aed797e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1477 microversion: 2.1 time: 0.455822 Sep 07 12:29:34.169979 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 205/389] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:33 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1477 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:34.204713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-837cffc0-bf39-41d0-a57d-1cdd1e8c430d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2018436492", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "90fd0444-8940-4097-8547-6568e7ca00e8"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:34.287858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-837cffc0-bf39-41d0-a57d-1cdd1e8c430d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] validate_networks() for [('90fd0444-8940-4097-8547-6568e7ca00e8', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:29:34.291885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-76b19098-1485-42d8-9183-52d6969e20e0 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f867ffebff94e3785cbaf0dc19f518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d676a2aa1bf4032965482efdd697502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:34.304226 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-76b19098-1485-42d8-9183-52d6969e20e0 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] 10.222.0.16 "GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e" status: 200 len: 1323 microversion: 2.1 time: 0.429444 Sep 07 12:29:34.306305 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 185/390] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:33 2022] GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e => generated 1323 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:34.850204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-837cffc0-bf39-41d0-a57d-1cdd1e8c430d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:29:34.850638 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-837cffc0-bf39-41d0-a57d-1cdd1e8c430d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:29:34.851111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-837cffc0-bf39-41d0-a57d-1cdd1e8c430d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:29:34.851521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-837cffc0-bf39-41d0-a57d-1cdd1e8c430d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:29:34.852401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-837cffc0-bf39-41d0-a57d-1cdd1e8c430d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:29:34.868412 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-837cffc0-bf39-41d0-a57d-1cdd1e8c430d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:34.868945 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-837cffc0-bf39-41d0-a57d-1cdd1e8c430d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:34.869394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-837cffc0-bf39-41d0-a57d-1cdd1e8c430d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:34.874433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-837cffc0-bf39-41d0-a57d-1cdd1e8c430d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:34.874935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-837cffc0-bf39-41d0-a57d-1cdd1e8c430d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:34.875548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-837cffc0-bf39-41d0-a57d-1cdd1e8c430d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:34.896113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:34.925060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-837cffc0-bf39-41d0-a57d-1cdd1e8c430d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Getting quotas for project b32e8c6ba4e2486aa9769db48d2250d9. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:29:34.930640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-837cffc0-bf39-41d0-a57d-1cdd1e8c430d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Getting quotas for user f009cb4fb12841a0ada96dc8c47cf2bd and project b32e8c6ba4e2486aa9769db48d2250d9. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:29:34.958428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-837cffc0-bf39-41d0-a57d-1cdd1e8c430d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:29:34.962252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-837cffc0-bf39-41d0-a57d-1cdd1e8c430d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:29:35.046333 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-837cffc0-bf39-41d0-a57d-1cdd1e8c430d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.850588 Sep 07 12:29:35.047829 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 206/391] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:29:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:29:35.060717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d8dab7e6-a084-4b2e-900f-f7085b96b04c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:35.061776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d8dab7e6-a084-4b2e-900f-f7085b96b04c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:35.196065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2eb02d3f-3519-41f1-b4d9-39f14ab9e536 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:35.197475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2eb02d3f-3519-41f1-b4d9-39f14ab9e536 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:35.201654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d8dab7e6-a084-4b2e-900f-f7085b96b04c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:35.221139 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d8dab7e6-a084-4b2e-900f-f7085b96b04c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1211 microversion: 2.1 time: 0.166171 Sep 07 12:29:35.228813 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 186/392] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:35 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1211 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:35.233243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2eb02d3f-3519-41f1-b4d9-39f14ab9e536 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:35.235998 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2eb02d3f-3519-41f1-b4d9-39f14ab9e536 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:35.236520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2eb02d3f-3519-41f1-b4d9-39f14ab9e536 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:35.238999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2eb02d3f-3519-41f1-b4d9-39f14ab9e536 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:35.239364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2eb02d3f-3519-41f1-b4d9-39f14ab9e536 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:35.239974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2eb02d3f-3519-41f1-b4d9-39f14ab9e536 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:35.332636 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7277938e-461f-4756-a1e5-a1beafc2b5dc tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:35.333567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7277938e-461f-4756-a1e5-a1beafc2b5dc tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] [instance: 3922432a-d58f-4f0a-9471-5c8c210caa9e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:35.348155 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7277938e-461f-4756-a1e5-a1beafc2b5dc tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:35.349509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7277938e-461f-4756-a1e5-a1beafc2b5dc tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:35.350837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7277938e-461f-4756-a1e5-a1beafc2b5dc tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:35.352409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7277938e-461f-4756-a1e5-a1beafc2b5dc tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:35.353308 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7277938e-461f-4756-a1e5-a1beafc2b5dc tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:35.354566 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7277938e-461f-4756-a1e5-a1beafc2b5dc tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:35.362547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:35.609451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2eb02d3f-3519-41f1-b4d9-39f14ab9e536 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:35.622813 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2eb02d3f-3519-41f1-b4d9-39f14ab9e536 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1477 microversion: 2.1 time: 0.432647 Sep 07 12:29:35.640792 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 207/393] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:35 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1477 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:29:35.648900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-4fcf8727-7779-4f43-bcbc-55df9100bb28 req-8835df14-2317-4392-a813-cb5d3872a839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3922432a-d58f-4f0a-9471-5c8c210caa9e", "name": "network-vif-plugged", "status": "completed", "tag": "283d983c-1d5a-4725-8ab1-a48b9ed5b74c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:35.675947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4fcf8727-7779-4f43-bcbc-55df9100bb28 req-8835df14-2317-4392-a813-cb5d3872a839 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:35.676433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4fcf8727-7779-4f43-bcbc-55df9100bb28 req-8835df14-2317-4392-a813-cb5d3872a839 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:35.676865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4fcf8727-7779-4f43-bcbc-55df9100bb28 req-8835df14-2317-4392-a813-cb5d3872a839 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:35.685728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7277938e-461f-4756-a1e5-a1beafc2b5dc tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f867ffebff94e3785cbaf0dc19f518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d676a2aa1bf4032965482efdd697502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:35.703449 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-4fcf8727-7779-4f43-bcbc-55df9100bb28 req-8835df14-2317-4392-a813-cb5d3872a839 service nova] Creating event network-vif-plugged:283d983c-1d5a-4725-8ab1-a48b9ed5b74c for instance 3922432a-d58f-4f0a-9471-5c8c210caa9e on n-h2-852087-9 Sep 07 12:29:35.704125 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7277938e-461f-4756-a1e5-a1beafc2b5dc tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] 10.222.0.16 "GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e" status: 200 len: 1323 microversion: 2.1 time: 0.377836 Sep 07 12:29:35.705415 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 187/394] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:35 2022] GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e => generated 1323 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:29:35.726598 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-4fcf8727-7779-4f43-bcbc-55df9100bb28 req-8835df14-2317-4392-a813-cb5d3872a839 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079960 Sep 07 12:29:35.727512 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 208/395] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:36.253261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-63ad8662-efdc-4bcb-bb6d-8485ec78d5ba tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:36.253890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-63ad8662-efdc-4bcb-bb6d-8485ec78d5ba tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:36.260443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63ad8662-efdc-4bcb-bb6d-8485ec78d5ba tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:36.261297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63ad8662-efdc-4bcb-bb6d-8485ec78d5ba tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:36.262000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63ad8662-efdc-4bcb-bb6d-8485ec78d5ba tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:36.262972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63ad8662-efdc-4bcb-bb6d-8485ec78d5ba tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:36.263571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63ad8662-efdc-4bcb-bb6d-8485ec78d5ba tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:36.264201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63ad8662-efdc-4bcb-bb6d-8485ec78d5ba tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:36.343451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-63ad8662-efdc-4bcb-bb6d-8485ec78d5ba tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:36.352441 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-63ad8662-efdc-4bcb-bb6d-8485ec78d5ba tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1263 microversion: 2.1 time: 0.103871 Sep 07 12:29:36.353407 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 188/396] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:36 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1263 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:36.653089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-abd47ad9-762a-40b2-8537-2218a50326c5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:36.653987 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-abd47ad9-762a-40b2-8537-2218a50326c5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:36.660894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abd47ad9-762a-40b2-8537-2218a50326c5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:36.661578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abd47ad9-762a-40b2-8537-2218a50326c5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:36.662253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abd47ad9-762a-40b2-8537-2218a50326c5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:36.663170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abd47ad9-762a-40b2-8537-2218a50326c5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:36.663830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abd47ad9-762a-40b2-8537-2218a50326c5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:36.664449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abd47ad9-762a-40b2-8537-2218a50326c5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:36.731190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-554f4181-1c6f-4b6e-994d-20d28c93d72f tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:36.732287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-554f4181-1c6f-4b6e-994d-20d28c93d72f tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] [instance: 3922432a-d58f-4f0a-9471-5c8c210caa9e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:36.740259 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-554f4181-1c6f-4b6e-994d-20d28c93d72f tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:36.760757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-554f4181-1c6f-4b6e-994d-20d28c93d72f tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:36.762096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-554f4181-1c6f-4b6e-994d-20d28c93d72f tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:36.764413 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-554f4181-1c6f-4b6e-994d-20d28c93d72f tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:36.766582 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-554f4181-1c6f-4b6e-994d-20d28c93d72f tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:36.767335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-554f4181-1c6f-4b6e-994d-20d28c93d72f tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:36.847390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-abd47ad9-762a-40b2-8537-2218a50326c5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:36.871522 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-abd47ad9-762a-40b2-8537-2218a50326c5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1477 microversion: 2.1 time: 0.225824 Sep 07 12:29:36.874923 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 209/397] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:36 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1477 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:37.032573 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-554f4181-1c6f-4b6e-994d-20d28c93d72f tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f867ffebff94e3785cbaf0dc19f518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d676a2aa1bf4032965482efdd697502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:37.043564 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-554f4181-1c6f-4b6e-994d-20d28c93d72f tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] 10.222.0.16 "GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e" status: 200 len: 1323 microversion: 2.1 time: 0.317089 Sep 07 12:29:37.044276 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 189/398] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:36 2022] GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e => generated 1323 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:29:37.379217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fbb07be8-2950-4ed7-ad5a-85a817316629 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:37.380121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fbb07be8-2950-4ed7-ad5a-85a817316629 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:37.387913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbb07be8-2950-4ed7-ad5a-85a817316629 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:37.388573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbb07be8-2950-4ed7-ad5a-85a817316629 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:37.389160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbb07be8-2950-4ed7-ad5a-85a817316629 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:37.390328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbb07be8-2950-4ed7-ad5a-85a817316629 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:37.390950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbb07be8-2950-4ed7-ad5a-85a817316629 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:37.391521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbb07be8-2950-4ed7-ad5a-85a817316629 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:37.490702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fbb07be8-2950-4ed7-ad5a-85a817316629 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:37.500180 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fbb07be8-2950-4ed7-ad5a-85a817316629 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1269 microversion: 2.1 time: 0.125372 Sep 07 12:29:37.514690 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 210/399] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:37 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1269 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:37.903792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-645f154f-bbc8-4eff-9d48-fa658f4d74ab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:37.905880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-645f154f-bbc8-4eff-9d48-fa658f4d74ab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:37.915638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-645f154f-bbc8-4eff-9d48-fa658f4d74ab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:37.916431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-645f154f-bbc8-4eff-9d48-fa658f4d74ab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:37.917003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-645f154f-bbc8-4eff-9d48-fa658f4d74ab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:37.917943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-645f154f-bbc8-4eff-9d48-fa658f4d74ab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:37.918720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-645f154f-bbc8-4eff-9d48-fa658f4d74ab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:37.919492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-645f154f-bbc8-4eff-9d48-fa658f4d74ab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:38.069103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3f1ed400-e9a4-4269-a47a-26c7c1bafd6a tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:38.070201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3f1ed400-e9a4-4269-a47a-26c7c1bafd6a tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] [instance: 3922432a-d58f-4f0a-9471-5c8c210caa9e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:38.086046 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f1ed400-e9a4-4269-a47a-26c7c1bafd6a tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:38.086558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f1ed400-e9a4-4269-a47a-26c7c1bafd6a tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:38.086998 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f1ed400-e9a4-4269-a47a-26c7c1bafd6a tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:38.088539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f1ed400-e9a4-4269-a47a-26c7c1bafd6a tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:38.089010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f1ed400-e9a4-4269-a47a-26c7c1bafd6a tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:38.089435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f1ed400-e9a4-4269-a47a-26c7c1bafd6a tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:38.193830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-645f154f-bbc8-4eff-9d48-fa658f4d74ab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:38.207881 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-645f154f-bbc8-4eff-9d48-fa658f4d74ab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1477 microversion: 2.1 time: 0.312341 Sep 07 12:29:38.216037 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 190/400] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:37 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1477 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:29:38.308308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3f1ed400-e9a4-4269-a47a-26c7c1bafd6a tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f867ffebff94e3785cbaf0dc19f518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d676a2aa1bf4032965482efdd697502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:38.317839 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3f1ed400-e9a4-4269-a47a-26c7c1bafd6a tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] 10.222.0.16 "GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e" status: 200 len: 1323 microversion: 2.1 time: 0.254511 Sep 07 12:29:38.319009 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 211/401] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:38 2022] GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e => generated 1323 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:38.530879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9a0fb214-cc7d-4e37-8970-3035e4d36918 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:38.532337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9a0fb214-cc7d-4e37-8970-3035e4d36918 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:38.545352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a0fb214-cc7d-4e37-8970-3035e4d36918 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:38.546443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a0fb214-cc7d-4e37-8970-3035e4d36918 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:38.548797 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a0fb214-cc7d-4e37-8970-3035e4d36918 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:38.550163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a0fb214-cc7d-4e37-8970-3035e4d36918 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:38.551102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a0fb214-cc7d-4e37-8970-3035e4d36918 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:38.551786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a0fb214-cc7d-4e37-8970-3035e4d36918 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:38.739610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-a402e285-e3ba-4e24-ab7a-1c549aacb2ac req-5419b133-2538-4ad5-8276-f5606ed28a5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74efffee-c688-4fe1-88dd-a49eaa3d940e", "tag": "53a321bf-b211-4774-a021-98fa126748f1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:38.760735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a402e285-e3ba-4e24-ab7a-1c549aacb2ac req-5419b133-2538-4ad5-8276-f5606ed28a5a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:38.762514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a402e285-e3ba-4e24-ab7a-1c549aacb2ac req-5419b133-2538-4ad5-8276-f5606ed28a5a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:38.764895 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a402e285-e3ba-4e24-ab7a-1c549aacb2ac req-5419b133-2538-4ad5-8276-f5606ed28a5a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:38.779695 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-a402e285-e3ba-4e24-ab7a-1c549aacb2ac req-5419b133-2538-4ad5-8276-f5606ed28a5a service nova] Creating event network-changed:53a321bf-b211-4774-a021-98fa126748f1 for instance 74efffee-c688-4fe1-88dd-a49eaa3d940e on n-h1-852087-9 Sep 07 12:29:38.792873 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-a402e285-e3ba-4e24-ab7a-1c549aacb2ac req-5419b133-2538-4ad5-8276-f5606ed28a5a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058609 Sep 07 12:29:38.794343 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 212/402] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:38.808838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9a0fb214-cc7d-4e37-8970-3035e4d36918 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:38.818358 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9a0fb214-cc7d-4e37-8970-3035e4d36918 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1311 microversion: 2.1 time: 0.294432 Sep 07 12:29:38.819503 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 191/403] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:38 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1311 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:39.236897 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-095d49c5-1fae-456b-8999-4486dbae1319 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:39.240662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-095d49c5-1fae-456b-8999-4486dbae1319 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:39.249865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-095d49c5-1fae-456b-8999-4486dbae1319 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:39.250763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-095d49c5-1fae-456b-8999-4486dbae1319 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:39.251216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-095d49c5-1fae-456b-8999-4486dbae1319 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:39.251926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-095d49c5-1fae-456b-8999-4486dbae1319 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:39.252392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-095d49c5-1fae-456b-8999-4486dbae1319 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:39.252853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-095d49c5-1fae-456b-8999-4486dbae1319 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:39.397287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-095d49c5-1fae-456b-8999-4486dbae1319 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:39.408830 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-095d49c5-1fae-456b-8999-4486dbae1319 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1476 microversion: 2.1 time: 0.177758 Sep 07 12:29:39.416134 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 192/404] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:39 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1476 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:39.416134 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-92b7070a-6729-4830-bca9-4a707d590043 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:39.416134 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-92b7070a-6729-4830-bca9-4a707d590043 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] [instance: 3922432a-d58f-4f0a-9471-5c8c210caa9e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:39.421325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92b7070a-6729-4830-bca9-4a707d590043 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:39.421848 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92b7070a-6729-4830-bca9-4a707d590043 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:39.422283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92b7070a-6729-4830-bca9-4a707d590043 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:39.422968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92b7070a-6729-4830-bca9-4a707d590043 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:39.423560 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92b7070a-6729-4830-bca9-4a707d590043 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:39.423982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92b7070a-6729-4830-bca9-4a707d590043 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:39.558665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a4843030-3b7a-4884-8af2-23e1e25fab23 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2078741524", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:39.648853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-92b7070a-6729-4830-bca9-4a707d590043 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f867ffebff94e3785cbaf0dc19f518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d676a2aa1bf4032965482efdd697502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:39.659240 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-92b7070a-6729-4830-bca9-4a707d590043 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] 10.222.0.16 "GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e" status: 200 len: 1323 microversion: 2.1 time: 0.248724 Sep 07 12:29:39.660394 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 193/405] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:39 2022] GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e => generated 1323 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:39.697550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-a4843030-3b7a-4884-8af2-23e1e25fab23 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:29:39.930629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-a4843030-3b7a-4884-8af2-23e1e25fab23 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:29:39.931543 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-a4843030-3b7a-4884-8af2-23e1e25fab23 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:29:39.932362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-a4843030-3b7a-4884-8af2-23e1e25fab23 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:29:39.932920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-a4843030-3b7a-4884-8af2-23e1e25fab23 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:29:39.933538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-a4843030-3b7a-4884-8af2-23e1e25fab23 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:29:39.946115 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4843030-3b7a-4884-8af2-23e1e25fab23 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:39.946811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4843030-3b7a-4884-8af2-23e1e25fab23 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:39.952538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4843030-3b7a-4884-8af2-23e1e25fab23 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:39.953391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4843030-3b7a-4884-8af2-23e1e25fab23 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:39.953929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4843030-3b7a-4884-8af2-23e1e25fab23 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:39.954525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4843030-3b7a-4884-8af2-23e1e25fab23 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:39.974723 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-a4843030-3b7a-4884-8af2-23e1e25fab23 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Getting quotas for project 53b6f3dbd50d41d69a47e6184f9abe52. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:29:39.979686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-a4843030-3b7a-4884-8af2-23e1e25fab23 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Getting quotas for user 433722ee7f084b8aa1decba3f1572934 and project 53b6f3dbd50d41d69a47e6184f9abe52. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:29:39.979884 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-32705225-4d61-4ea1-998f-06858f265fe6 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Calling method '.version_select at 0x7fc419795af0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:40.000406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a4843030-3b7a-4884-8af2-23e1e25fab23 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:29:40.003180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a4843030-3b7a-4884-8af2-23e1e25fab23 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 8ecbad38-98de-4c5d-b656-07e102181e62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:29:40.057732 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a4843030-3b7a-4884-8af2-23e1e25fab23 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.840111 Sep 07 12:29:40.058697 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 213/406] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:29:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:29:40.063546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b26daf4d-604a-4106-afa8-5144fa2213dd tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:40.064145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b26daf4d-604a-4106-afa8-5144fa2213dd tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:40.071662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b26daf4d-604a-4106-afa8-5144fa2213dd tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:40.072459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b26daf4d-604a-4106-afa8-5144fa2213dd tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:40.073058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b26daf4d-604a-4106-afa8-5144fa2213dd tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:40.073962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b26daf4d-604a-4106-afa8-5144fa2213dd tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:40.074575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b26daf4d-604a-4106-afa8-5144fa2213dd tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:40.075137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b26daf4d-604a-4106-afa8-5144fa2213dd tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:40.275856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b26daf4d-604a-4106-afa8-5144fa2213dd tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:40.290656 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b26daf4d-604a-4106-afa8-5144fa2213dd tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1311 microversion: 2.1 time: 0.230522 Sep 07 12:29:40.292126 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 214/407] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:40 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1311 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:40.503729 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-32705225-4d61-4ea1-998f-06858f265fe6 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/d70d2a47759743b496f63ddbae89a90c" status: 200 len: 371 microversion: 2.1 time: 0.841293 Sep 07 12:29:40.507205 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 194/408] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Sep 7 12:29:39 2022] GET /compute/v2.1/os-quota-sets/d70d2a47759743b496f63ddbae89a90c => generated 371 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:40.529313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c08a2f5c-b188-4c6d-aecc-e359f43cd46e tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:40.530485 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c08a2f5c-b188-4c6d-aecc-e359f43cd46e tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 8ecbad38-98de-4c5d-b656-07e102181e62] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:40.621317 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-078cb364-51ad-4041-bb29-d1f66636789f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-520867010", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:40.658140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c08a2f5c-b188-4c6d-aecc-e359f43cd46e tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:40.676229 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c08a2f5c-b188-4c6d-aecc-e359f43cd46e tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62" status: 200 len: 1222 microversion: 2.1 time: 0.166969 Sep 07 12:29:40.679704 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 195/409] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:40 2022] GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62 => generated 1222 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:40.687975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0734abd4-bce9-4922-8e0c-d89aebd509d5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:40.688728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0734abd4-bce9-4922-8e0c-d89aebd509d5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:40.709842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0734abd4-bce9-4922-8e0c-d89aebd509d5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:40.710900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0734abd4-bce9-4922-8e0c-d89aebd509d5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:40.713851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0734abd4-bce9-4922-8e0c-d89aebd509d5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:40.715105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0734abd4-bce9-4922-8e0c-d89aebd509d5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:40.716983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0734abd4-bce9-4922-8e0c-d89aebd509d5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:40.719820 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0734abd4-bce9-4922-8e0c-d89aebd509d5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:40.724925 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-078cb364-51ad-4041-bb29-d1f66636789f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:29:41.043950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0734abd4-bce9-4922-8e0c-d89aebd509d5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:41.051918 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0734abd4-bce9-4922-8e0c-d89aebd509d5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1476 microversion: 2.1 time: 0.370412 Sep 07 12:29:41.052486 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 196/410] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:40 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1476 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:41.057108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c889f2cb-819b-4300-a763-6e137367c044 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Action: 'update', calling method: .version_select at 0x7fc4198b8820>, body: {"quota_set": {"ram": "5120"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:41.093367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-078cb364-51ad-4041-bb29-d1f66636789f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:29:41.094018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-078cb364-51ad-4041-bb29-d1f66636789f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:29:41.094411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-078cb364-51ad-4041-bb29-d1f66636789f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:29:41.094766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-078cb364-51ad-4041-bb29-d1f66636789f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:29:41.095908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-078cb364-51ad-4041-bb29-d1f66636789f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:29:41.105294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-078cb364-51ad-4041-bb29-d1f66636789f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:41.105815 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-078cb364-51ad-4041-bb29-d1f66636789f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:41.106299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-078cb364-51ad-4041-bb29-d1f66636789f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:41.107031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-078cb364-51ad-4041-bb29-d1f66636789f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:41.107490 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-078cb364-51ad-4041-bb29-d1f66636789f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:41.107914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-078cb364-51ad-4041-bb29-d1f66636789f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:41.125498 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-078cb364-51ad-4041-bb29-d1f66636789f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Getting quotas for project 850b3068e7bd4e11b737c74c14f40f70. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:29:41.129628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-078cb364-51ad-4041-bb29-d1f66636789f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Getting quotas for user 6f0d61feae834d42a5607d482a3a8353 and project 850b3068e7bd4e11b737c74c14f40f70. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:29:41.140901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-078cb364-51ad-4041-bb29-d1f66636789f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:29:41.143364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-078cb364-51ad-4041-bb29-d1f66636789f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:29:41.192781 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-078cb364-51ad-4041-bb29-d1f66636789f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.898922 Sep 07 12:29:41.193732 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 215/411] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:29:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:29:41.198422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c7db7105-332e-4c16-af9f-f93f9315cd3d tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:41.199019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c7db7105-332e-4c16-af9f-f93f9315cd3d tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] [instance: 3922432a-d58f-4f0a-9471-5c8c210caa9e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:41.201567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10,nova_api:DELETE=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:41.208707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7db7105-332e-4c16-af9f-f93f9315cd3d tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:41.209250 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7db7105-332e-4c16-af9f-f93f9315cd3d tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:41.209727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7db7105-332e-4c16-af9f-f93f9315cd3d tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:41.210466 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7db7105-332e-4c16-af9f-f93f9315cd3d tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:41.210873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7db7105-332e-4c16-af9f-f93f9315cd3d tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:41.211310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7db7105-332e-4c16-af9f-f93f9315cd3d tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:41.269275 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c889f2cb-819b-4300-a763-6e137367c044 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:41.269927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c889f2cb-819b-4300-a763-6e137367c044 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:41.270440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c889f2cb-819b-4300-a763-6e137367c044 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:41.271310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c889f2cb-819b-4300-a763-6e137367c044 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:41.271829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c889f2cb-819b-4300-a763-6e137367c044 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:41.272320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c889f2cb-819b-4300-a763-6e137367c044 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:41.356369 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c889f2cb-819b-4300-a763-6e137367c044 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/d70d2a47759743b496f63ddbae89a90c" status: 200 len: 328 microversion: 2.1 time: 0.302770 Sep 07 12:29:41.357155 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 197/412] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Sep 7 12:29:41 2022] PUT /compute/v2.1/os-quota-sets/d70d2a47759743b496f63ddbae89a90c => generated 328 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:41.368027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c7db7105-332e-4c16-af9f-f93f9315cd3d tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f867ffebff94e3785cbaf0dc19f518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d676a2aa1bf4032965482efdd697502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:41.377065 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c7db7105-332e-4c16-af9f-f93f9315cd3d tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] 10.222.0.16 "GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e" status: 200 len: 1473 microversion: 2.1 time: 0.182295 Sep 07 12:29:41.378897 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 216/413] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:41 2022] GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e => generated 1473 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:41.383629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-79e7b198-dcae-4d44-86a9-1da5f73c71f2 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:41.384357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-79e7b198-dcae-4d44-86a9-1da5f73c71f2 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:41.447485 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-79e7b198-dcae-4d44-86a9-1da5f73c71f2 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:41.455427 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-79e7b198-dcae-4d44-86a9-1da5f73c71f2 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657" status: 200 len: 1218 microversion: 2.1 time: 0.075114 Sep 07 12:29:41.470375 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 217/414] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:41 2022] GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:41.482005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9b0065dc-5bc6-44ba-90a6-c4c4fbfe5525 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:41.482745 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9b0065dc-5bc6-44ba-90a6-c4c4fbfe5525 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:41.490086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b0065dc-5bc6-44ba-90a6-c4c4fbfe5525 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:41.491270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b0065dc-5bc6-44ba-90a6-c4c4fbfe5525 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:41.491901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b0065dc-5bc6-44ba-90a6-c4c4fbfe5525 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:41.492792 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b0065dc-5bc6-44ba-90a6-c4c4fbfe5525 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:41.493579 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b0065dc-5bc6-44ba-90a6-c4c4fbfe5525 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:41.494221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b0065dc-5bc6-44ba-90a6-c4c4fbfe5525 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:41.628715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-91978013-5ff7-4d30-8398-ff71b0da74d6 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-702913636", "id": 1294395112, "os-flavor-access:is_public": "False"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:41.661030 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-91978013-5ff7-4d30-8398-ff71b0da74d6 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.302567 Sep 07 12:29:41.667487 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 198/415] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:29:41 2022] POST /compute/v2.1/flavors => generated 438 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:41.684956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dfc61d82-179b-490c-8483-35484631bc7c tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:41.700110 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9b0065dc-5bc6-44ba-90a6-c4c4fbfe5525 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:41.710033 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9b0065dc-5bc6-44ba-90a6-c4c4fbfe5525 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1311 microversion: 2.1 time: 0.237842 Sep 07 12:29:41.710676 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 218/416] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:41 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1311 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:41.724277 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dfc61d82-179b-490c-8483-35484631bc7c tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-quota-sets/d70d2a47759743b496f63ddbae89a90c" status: 202 len: 0 microversion: 2.1 time: 0.054587 Sep 07 12:29:41.728423 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 199/417] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Sep 7 12:29:41 2022] DELETE /compute/v2.1/os-quota-sets/d70d2a47759743b496f63ddbae89a90c => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:29:41.732458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2b37fbd7-a6ef-4628-8794-8d9d0217e9e4 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "389d9738b0a646ff85e56a6c800e3521"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:41.734948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fbf60d7a-016f-4d76-861f-97ede1182c8e tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:41.735472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fbf60d7a-016f-4d76-861f-97ede1182c8e tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] [instance: 3922432a-d58f-4f0a-9471-5c8c210caa9e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:41.743877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbf60d7a-016f-4d76-861f-97ede1182c8e tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:41.744662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbf60d7a-016f-4d76-861f-97ede1182c8e tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:41.745299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbf60d7a-016f-4d76-861f-97ede1182c8e tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:41.746427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbf60d7a-016f-4d76-861f-97ede1182c8e tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:41.747160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbf60d7a-016f-4d76-861f-97ede1182c8e tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:41.747863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbf60d7a-016f-4d76-861f-97ede1182c8e tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:41.799228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fbf60d7a-016f-4d76-861f-97ede1182c8e tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '4f867ffebff94e3785cbaf0dc19f518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d676a2aa1bf4032965482efdd697502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:41.802029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fbf60d7a-016f-4d76-861f-97ede1182c8e tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Request method failure captured: Sep 07 12:29:41.802029 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e/diagnostics HTTP/1.1 Sep 07 12:29:41.802029 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:29:41.802029 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:29:41.802029 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:29:41.802029 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:29:41.802029 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:29:41.802029 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:29:41.802029 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:29:41.802029 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:41.802029 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI6gXAXeHB2jFEW8ME-mV2LwuHdHFPNpK3VdOP5jlHpWUCp6joNViFaKZXrdPi6galQKiTKT7sjcY0dP85Oh7gkObRbEm508_kqGw4nIGRw2cDbMty8k2wMeTY5mIxqKaksTUG4FHo2xN2290jztY3K-J_SjXwONBiebfjCUx5yySUs Sep 07 12:29:41.802029 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:29:41.802029 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:29:41.802029 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:29:41.802029 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:29:41.802029 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:29:41.802029 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:29:41.802029 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 3d676a2aa1bf4032965482efdd697502 Sep 07 12:29:41.802029 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1022963101 Sep 07 12:29:41.802029 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:29:41.802029 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:29:41.804190 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d676a2aa1bf4032965482efdd697502"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3d676a2aa1bf4032965482efdd697502"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3d676a2aa1bf4032965482efdd697502"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d676a2aa1bf4032965482efdd697502"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:41.804190 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1022963101 Sep 07 12:29:41.804190 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 3d676a2aa1bf4032965482efdd697502 Sep 07 12:29:41.804190 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1022963101 Sep 07 12:29:41.804190 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerDiagnosticsNegativeTest-1022963101-project Sep 07 12:29:41.804190 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:29:41.804190 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:29:41.804190 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 4f867ffebff94e3785cbaf0dc19f518d Sep 07 12:29:41.804190 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1022963101-project Sep 07 12:29:41.804190 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:29:41.804190 n-d-852087-9 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 07 12:29:41.804973 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'server_id': '3922432a-d58f-4f0a-9471-5c8c210caa9e'} Sep 07 12:29:41.804973 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:41.804973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:41.804973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:41.804973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:41.804973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:41.804973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:41.804973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:41.804973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:41.804973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Sep 07 12:29:41.804973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Sep 07 12:29:41.804973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:29:41.804973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:29:41.804973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:29:41.804973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:29:41.804973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:29:41.804973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:29:41.804973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:29:41.804973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:29:41.804973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:29:41.806438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:29:41.806438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:29:41.806438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:29:41.806438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:29:41.806438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:29:41.806438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 07 12:29:41.806438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:41.806438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:41.806438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:41.806438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:41.806438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:41.806438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:41.806438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:29:41.806438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:29:41.806438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 07 12:29:41.806438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:41.807413 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fbf60d7a-016f-4d76-861f-97ede1182c8e tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:41.809672 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fbf60d7a-016f-4d76-861f-97ede1182c8e tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] 10.222.0.16 "GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.079525 Sep 07 12:29:41.815759 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 219/418] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:29:41 2022] GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e/diagnostics => generated 117 bytes in 103 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:29:41.825083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e658e66f-9811-4da4-b76a-58e8251064a9 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:41.825744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e658e66f-9811-4da4-b76a-58e8251064a9 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 8ecbad38-98de-4c5d-b656-07e102181e62] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:41.834036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e658e66f-9811-4da4-b76a-58e8251064a9 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:41.834667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e658e66f-9811-4da4-b76a-58e8251064a9 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:41.835199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e658e66f-9811-4da4-b76a-58e8251064a9 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:41.836916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e658e66f-9811-4da4-b76a-58e8251064a9 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:41.837547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e658e66f-9811-4da4-b76a-58e8251064a9 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:41.838360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e658e66f-9811-4da4-b76a-58e8251064a9 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:41.838574 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2b37fbd7-a6ef-4628-8794-8d9d0217e9e4 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1294395112/action" status: 200 len: 97 microversion: 2.1 time: 0.111770 Sep 07 12:29:41.839504 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 200/419] 10.222.0.16 () {60 vars in 1200 bytes} [Wed Sep 7 12:29:41 2022] POST /compute/v2.1/flavors/1294395112/action => generated 97 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:29:41.851794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5da5794c-f815-4be7-939d-3f32e71e1ffe tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Calling method '.version_select at 0x7fc419763430>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:41.950842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e658e66f-9811-4da4-b76a-58e8251064a9 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:41.963806 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e658e66f-9811-4da4-b76a-58e8251064a9 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62" status: 200 len: 1274 microversion: 2.1 time: 0.147896 Sep 07 12:29:41.964548 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 220/420] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:41 2022] GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62 => generated 1274 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:41.969766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d20e6b69-a1e3-4e14-a990-c53660af8292 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:41.970474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d20e6b69-a1e3-4e14-a990-c53660af8292 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] [instance: 3922432a-d58f-4f0a-9471-5c8c210caa9e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:41.979056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d20e6b69-a1e3-4e14-a990-c53660af8292 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:41.979770 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d20e6b69-a1e3-4e14-a990-c53660af8292 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:41.980426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d20e6b69-a1e3-4e14-a990-c53660af8292 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:41.981323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d20e6b69-a1e3-4e14-a990-c53660af8292 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:41.982371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d20e6b69-a1e3-4e14-a990-c53660af8292 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:41.983410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d20e6b69-a1e3-4e14-a990-c53660af8292 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:42.013321 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5da5794c-f815-4be7-939d-3f32e71e1ffe tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/d70d2a47759743b496f63ddbae89a90c" status: 200 len: 371 microversion: 2.1 time: 0.172361 Sep 07 12:29:42.024338 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 201/421] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Sep 7 12:29:41 2022] GET /compute/v2.1/os-quota-sets/d70d2a47759743b496f63ddbae89a90c => generated 371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:42.024338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-716e7152-f726-4aab-bc99-08476eac9df0 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "389d9738b0a646ff85e56a6c800e3521"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:42.039504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d20e6b69-a1e3-4e14-a990-c53660af8292 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] [instance: 3922432a-d58f-4f0a-9471-5c8c210caa9e] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:29:42.178343 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d20e6b69-a1e3-4e14-a990-c53660af8292 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e" status: 204 len: 0 microversion: 2.1 time: 0.210839 Sep 07 12:29:42.181420 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-716e7152-f726-4aab-bc99-08476eac9df0 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] HTTP exception thrown: Flavor access already exists for flavor 23 and project 389d9738b0a646ff85e56a6c800e3521 combination. Sep 07 12:29:42.183887 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 221/422] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:29:41 2022] DELETE /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:29:42.188688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-716e7152-f726-4aab-bc99-08476eac9df0 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Request method failure captured: Sep 07 12:29:42.188688 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/flavors/1294395112/action HTTP/1.1 Sep 07 12:29:42.188688 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:29:42.188688 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:29:42.188688 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:29:42.188688 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 67 Sep 07 12:29:42.188688 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:29:42.188688 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:29:42.188688 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:29:42.188688 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:42.188688 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI60ZXwZDBZK634O6F20Qpx9xuS7oNUEcKFYu-VaG0UFd5QA0K2JWpyEW2qzVWg0IUr27RAEYGpgmR1lsnx6XTe3JnsnedaYFBaDvAgb_Qa2JSB7eKkMbyt9kONFlH0Q8xL8fgs7L0i7s4SH1bsJ6mbFBO6uhBdXc69qZSXiV9JMeFI Sep 07 12:29:42.188688 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:29:42.188688 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:29:42.188688 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:29:42.188688 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:29:42.188688 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:29:42.188688 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:29:42.188688 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 5a1138edc1464a74834c5ba40cf7aec5 Sep 07 12:29:42.188688 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1392180977 Sep 07 12:29:42.188688 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 12:29:42.188688 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 12:29:42.190489 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a1138edc1464a74834c5ba40cf7aec5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a1138edc1464a74834c5ba40cf7aec5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a1138edc1464a74834c5ba40cf7aec5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a1138edc1464a74834c5ba40cf7aec5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:42.190489 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1392180977 Sep 07 12:29:42.190489 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 5a1138edc1464a74834c5ba40cf7aec5 Sep 07 12:29:42.190489 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1392180977 Sep 07 12:29:42.190489 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin Sep 07 12:29:42.190489 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:29:42.190489 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:29:42.190489 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: c27b3cad228a49a3bb4b33e4543b6125 Sep 07 12:29:42.190489 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin Sep 07 12:29:42.190489 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:29:42.190489 n-d-852087-9 devstack@n-api.service[122433]: {"addTenantAccess": {"tenant": "389d9738b0a646ff85e56a6c800e3521"}} Sep 07 12:29:42.190489 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:29:42.191172 n-d-852087-9 devstack@n-api.service[122433]: exception: Flavor access already exists for flavor 23 and project 389d9738b0a646ff85e56a6c800e3521 combination. Sep 07 12:29:42.191172 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '1294395112', 'body': {'addTenantAccess': {'tenant': '389d9738b0a646ff85e56a6c800e3521'}}} Sep 07 12:29:42.191172 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:42.191172 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:42.191172 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 12:29:42.191172 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 07 12:29:42.191172 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 12:29:42.191172 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 07 12:29:42.191172 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 12:29:42.191172 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 07 12:29:42.191172 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 12:29:42.191172 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 07 12:29:42.191172 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 12:29:42.191172 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 12:29:42.191172 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 12:29:42.191172 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result.read() Sep 07 12:29:42.191172 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 12:29:42.191172 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 07 12:29:42.192829 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 12:29:42.192829 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 07 12:29:42.192829 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 12:29:42.192829 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 07 12:29:42.192829 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 12:29:42.192829 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 07 12:29:42.192829 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '23-389d9738b0a646ff85e56a6c800e3521' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 07 12:29:42.192829 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:42.192829 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 07 12:29:42.192829 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:42.192829 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:42.192829 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Sep 07 12:29:42.192829 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi project.save(context.session) Sep 07 12:29:42.192829 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 07 12:29:42.192829 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi session.flush() Sep 07 12:29:42.192829 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 07 12:29:42.192829 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 07 12:29:42.192829 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 07 12:29:42.192829 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 07 12:29:42.193916 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 07 12:29:42.193916 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 07 12:29:42.193916 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 12:29:42.193916 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception Sep 07 12:29:42.193916 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 07 12:29:42.193916 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 07 12:29:42.193916 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 07 12:29:42.193916 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 07 12:29:42.193916 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 07 12:29:42.193916 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 07 12:29:42.193916 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 07 12:29:42.193916 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 07 12:29:42.193916 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 07 12:29:42.193916 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 07 12:29:42.193916 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 07 12:29:42.193916 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 07 12:29:42.193916 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 07 12:29:42.193916 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 07 12:29:42.194942 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 07 12:29:42.194942 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 07 12:29:42.194942 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 07 12:29:42.194942 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 07 12:29:42.194942 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 07 12:29:42.194942 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 07 12:29:42.194942 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 12:29:42.194942 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception Sep 07 12:29:42.194942 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 12:29:42.194942 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 07 12:29:42.194942 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 12:29:42.194942 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 07 12:29:42.194942 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 12:29:42.194942 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 07 12:29:42.194942 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 12:29:42.194942 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 07 12:29:42.194942 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 12:29:42.194942 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 12:29:42.197450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 12:29:42.197450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result.read() Sep 07 12:29:42.197450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 12:29:42.197450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 07 12:29:42.197450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 12:29:42.197450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 07 12:29:42.197450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 12:29:42.197450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 07 12:29:42.197450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 12:29:42.197450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 07 12:29:42.197450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '23-389d9738b0a646ff85e56a6c800e3521' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 07 12:29:42.197450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Sep 07 12:29:42.197450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 7, 12, 29, 42, 177049), 'updated_at': None, 'flavor_id': 23, 'project_id': '389d9738b0a646ff85e56a6c800e3521'}] Sep 07 12:29:42.197450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 07 12:29:42.197450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:42.197450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:42.197450 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:42.199233 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:42.199233 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Sep 07 12:29:42.199233 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Sep 07 12:29:42.199233 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 07 12:29:42.199233 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 07 12:29:42.199233 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Sep 07 12:29:42.199233 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Sep 07 12:29:42.199233 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Sep 07 12:29:42.199233 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Sep 07 12:29:42.199233 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Sep 07 12:29:42.199233 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Sep 07 12:29:42.199233 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 12:29:42.199233 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 12:29:42.199233 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Sep 07 12:29:42.199233 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Sep 07 12:29:42.199233 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 23 and project 389d9738b0a646ff85e56a6c800e3521 combination. Sep 07 12:29:42.199233 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:42.199233 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:42.199233 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:42.204426 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:42.204426 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:42.204426 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:42.204426 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:42.204426 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:42.204426 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:42.204426 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:42.204426 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:29:42.204426 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:29:42.204426 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Sep 07 12:29:42.204426 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Sep 07 12:29:42.204426 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 23 and project 389d9738b0a646ff85e56a6c800e3521 combination. Sep 07 12:29:42.204426 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:42.204426 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:42.204426 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:42.204426 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:42.204426 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:42.204426 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:42.204426 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:29:42.204426 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:29:42.206525 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 23 and project 389d9738b0a646ff85e56a6c800e3521 combination. Sep 07 12:29:42.206525 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:42.206674 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e212e8d3-f4f6-4e6a-ad15-4ca641752f4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:42.206674 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e212e8d3-f4f6-4e6a-ad15-4ca641752f4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:42.206674 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e212e8d3-f4f6-4e6a-ad15-4ca641752f4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:42.206674 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e212e8d3-f4f6-4e6a-ad15-4ca641752f4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:42.207078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e212e8d3-f4f6-4e6a-ad15-4ca641752f4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:42.207078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e212e8d3-f4f6-4e6a-ad15-4ca641752f4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:42.207078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e212e8d3-f4f6-4e6a-ad15-4ca641752f4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:42.207078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e212e8d3-f4f6-4e6a-ad15-4ca641752f4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:42.207601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-716e7152-f726-4aab-bc99-08476eac9df0 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Returning 409 to user: Flavor access already exists for flavor 23 and project 389d9738b0a646ff85e56a6c800e3521 combination. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:42.207601 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-716e7152-f726-4aab-bc99-08476eac9df0 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1294395112/action" status: 409 len: 152 microversion: 2.1 time: 0.185448 Sep 07 12:29:42.212707 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 202/423] 10.222.0.16 () {60 vars in 1200 bytes} [Wed Sep 7 12:29:42 2022] POST /compute/v2.1/flavors/1294395112/action => generated 152 bytes in 197 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:29:42.219109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8d2a4e70-e659-43d3-ae62-da79c099a8e5 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:42.219786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8d2a4e70-e659-43d3-ae62-da79c099a8e5 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] [instance: 3922432a-d58f-4f0a-9471-5c8c210caa9e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:42.226130 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d2a4e70-e659-43d3-ae62-da79c099a8e5 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:42.226619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d2a4e70-e659-43d3-ae62-da79c099a8e5 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:42.227051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d2a4e70-e659-43d3-ae62-da79c099a8e5 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:42.227984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d2a4e70-e659-43d3-ae62-da79c099a8e5 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:42.228627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d2a4e70-e659-43d3-ae62-da79c099a8e5 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:42.229200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d2a4e70-e659-43d3-ae62-da79c099a8e5 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:42.433138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8d2a4e70-e659-43d3-ae62-da79c099a8e5 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f867ffebff94e3785cbaf0dc19f518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d676a2aa1bf4032965482efdd697502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:42.434791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e212e8d3-f4f6-4e6a-ad15-4ca641752f4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:42.442509 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8d2a4e70-e659-43d3-ae62-da79c099a8e5 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] 10.222.0.16 "GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e" status: 200 len: 1479 microversion: 2.1 time: 0.227572 Sep 07 12:29:42.443008 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 203/424] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:42 2022] GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e => generated 1479 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:42.448536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fccdbed0-ebac-4c0f-b5d4-9536def59f54 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "389d9738b0a646ff85e56a6c800e3521"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:42.478127 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e212e8d3-f4f6-4e6a-ad15-4ca641752f4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1476 microversion: 2.1 time: 0.291892 Sep 07 12:29:42.489650 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 222/425] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:42 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1476 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:42.499592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f9ce0762-9568-4291-9ced-04565253ec87 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Calling method '.version_select at 0x7fc419640550>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:42.907727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:42.930297 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fccdbed0-ebac-4c0f-b5d4-9536def59f54 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1294395112/action" status: 200 len: 21 microversion: 2.1 time: 0.486188 Sep 07 12:29:42.936013 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f9ce0762-9568-4291-9ced-04565253ec87 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/54638ceb8f7b403baf346d505566cf72/defaults" status: 200 len: 371 microversion: 2.1 time: 0.441918 Sep 07 12:29:42.936013 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 223/426] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Sep 7 12:29:42 2022] GET /compute/v2.1/os-quota-sets/54638ceb8f7b403baf346d505566cf72/defaults => generated 371 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:42.937541 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 204/427] 10.222.0.16 () {60 vars in 1200 bytes} [Wed Sep 7 12:29:42 2022] POST /compute/v2.1/flavors/1294395112/action => generated 21 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:29:42.940510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5e07e9cf-4013-4b2c-be35-b7b6447760cb tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:42.941468 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5e07e9cf-4013-4b2c-be35-b7b6447760cb tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:42.943078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-e6cd9c19-be8d-46e4-9d16-96904fa89012 req-ff82821c-22dd-4bd4-976f-38b18fc80f95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc8c1c2b-eb55-4361-bcd7-e66c270b827a", "name": "network-vif-unplugged", "status": "completed", "tag": "1e24dd2e-9faf-4586-ae6b-48d1499917fe"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:42.950791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e07e9cf-4013-4b2c-be35-b7b6447760cb tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:42.951427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e07e9cf-4013-4b2c-be35-b7b6447760cb tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:42.951958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e07e9cf-4013-4b2c-be35-b7b6447760cb tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:42.953125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e07e9cf-4013-4b2c-be35-b7b6447760cb tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:42.953732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e07e9cf-4013-4b2c-be35-b7b6447760cb tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:42.954256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e07e9cf-4013-4b2c-be35-b7b6447760cb tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:42.956100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e6cd9c19-be8d-46e4-9d16-96904fa89012 req-ff82821c-22dd-4bd4-976f-38b18fc80f95 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:42.958117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e6cd9c19-be8d-46e4-9d16-96904fa89012 req-ff82821c-22dd-4bd4-976f-38b18fc80f95 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:42.958862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e6cd9c19-be8d-46e4-9d16-96904fa89012 req-ff82821c-22dd-4bd4-976f-38b18fc80f95 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:42.981379 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-e6cd9c19-be8d-46e4-9d16-96904fa89012 req-ff82821c-22dd-4bd4-976f-38b18fc80f95 service nova] Creating event network-vif-unplugged:1e24dd2e-9faf-4586-ae6b-48d1499917fe for instance fc8c1c2b-eb55-4361-bcd7-e66c270b827a on n-h1-852087-9 Sep 07 12:29:42.991131 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-e6cd9c19-be8d-46e4-9d16-96904fa89012 req-ff82821c-22dd-4bd4-976f-38b18fc80f95 service nova] Instance fc8c1c2b-eb55-4361-bcd7-e66c270b827a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 12:29:43.005988 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-e6cd9c19-be8d-46e4-9d16-96904fa89012 req-ff82821c-22dd-4bd4-976f-38b18fc80f95 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066919 Sep 07 12:29:43.006737 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 205/428] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:43.012908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-858e4804-6bde-40e2-bb0c-92b4db9422db tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:43.013738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-858e4804-6bde-40e2-bb0c-92b4db9422db tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:43.021131 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-858e4804-6bde-40e2-bb0c-92b4db9422db tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:43.021753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-858e4804-6bde-40e2-bb0c-92b4db9422db tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:43.022309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-858e4804-6bde-40e2-bb0c-92b4db9422db tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:43.023116 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-858e4804-6bde-40e2-bb0c-92b4db9422db tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:43.023727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-858e4804-6bde-40e2-bb0c-92b4db9422db tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:43.024478 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-858e4804-6bde-40e2-bb0c-92b4db9422db tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:43.048999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5e07e9cf-4013-4b2c-be35-b7b6447760cb tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:43.059000 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5e07e9cf-4013-4b2c-be35-b7b6447760cb tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657" status: 200 len: 1270 microversion: 2.1 time: 0.124133 Sep 07 12:29:43.064853 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 224/429] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:42 2022] GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 => generated 1270 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:43.072628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c0e641fe-e63d-4b9d-b616-bd7e443040d9 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:43.100015 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c0e641fe-e63d-4b9d-b616-bd7e443040d9 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1294395112" status: 202 len: 0 microversion: 2.1 time: 0.033060 Sep 07 12:29:43.100900 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 225/430] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Sep 7 12:29:43 2022] DELETE /compute/v2.1/flavors/1294395112 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:29:43.107593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-31eaf487-b1c0-47ea-831a-905abe1c635b tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:43.108282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-31eaf487-b1c0-47ea-831a-905abe1c635b tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 8ecbad38-98de-4c5d-b656-07e102181e62] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:43.115537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31eaf487-b1c0-47ea-831a-905abe1c635b tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:43.116474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31eaf487-b1c0-47ea-831a-905abe1c635b tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:43.117422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31eaf487-b1c0-47ea-831a-905abe1c635b tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:43.118472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31eaf487-b1c0-47ea-831a-905abe1c635b tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:43.119109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31eaf487-b1c0-47ea-831a-905abe1c635b tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:43.119764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31eaf487-b1c0-47ea-831a-905abe1c635b tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:43.310542 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-31eaf487-b1c0-47ea-831a-905abe1c635b tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:43.331983 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-31eaf487-b1c0-47ea-831a-905abe1c635b tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62" status: 200 len: 1280 microversion: 2.1 time: 0.229577 Sep 07 12:29:43.349817 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 226/431] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:43 2022] GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62 => generated 1280 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:43.356804 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cea997bb-5a84-40e8-a888-a395a24b06e7 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:43.382720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-858e4804-6bde-40e2-bb0c-92b4db9422db tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:43.388202 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cea997bb-5a84-40e8-a888-a395a24b06e7 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.036911 Sep 07 12:29:43.400280 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-858e4804-6bde-40e2-bb0c-92b4db9422db tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1311 microversion: 2.1 time: 0.391745 Sep 07 12:29:43.402954 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 206/432] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:43 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1311 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:43.414938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5c8d02ae-4fc2-4cf9-83d2-31bf38a8a0dd tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Action: 'update', calling method: .version_select at 0x7fc41982aca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:43.422876 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 227/433] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:29:43 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:43.428662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-330f15a0-48f1-48a1-a3db-10e17b405958 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2030003769", "id": 617217374, "os-flavor-access:is_public": "True"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:43.466520 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-330f15a0-48f1-48a1-a3db-10e17b405958 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.041829 Sep 07 12:29:43.488991 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 228/434] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:29:43 2022] POST /compute/v2.1/flavors => generated 435 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:43.505724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2748afbc-d3a8-4b0f-97d4-e3ff99ba1f68 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:43.529774 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-2748afbc-d3a8-4b0f-97d4-e3ff99ba1f68 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] HTTP exception thrown: Access list not available for public flavors. Sep 07 12:29:43.534689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2748afbc-d3a8-4b0f-97d4-e3ff99ba1f68 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Request method failure captured: Sep 07 12:29:43.534689 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/flavors/617217374/os-flavor-access HTTP/1.1 Sep 07 12:29:43.534689 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:29:43.534689 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:29:43.534689 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:29:43.534689 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:29:43.534689 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:29:43.534689 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:29:43.534689 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:29:43.534689 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:43.534689 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI60ZXwZDBZK634O6F20Qpx9xuS7oNUEcKFYu-VaG0UFd5QA0K2JWpyEW2qzVWg0IUr27RAEYGpgmR1lsnx6XTe3JnsnedaYFBaDvAgb_Qa2JSB7eKkMbyt9kONFlH0Q8xL8fgs7L0i7s4SH1bsJ6mbFBO6uhBdXc69qZSXiV9JMeFI Sep 07 12:29:43.534689 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:29:43.534689 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:29:43.534689 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:29:43.534689 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:29:43.534689 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:29:43.534689 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:29:43.534689 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 5a1138edc1464a74834c5ba40cf7aec5 Sep 07 12:29:43.534689 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1392180977 Sep 07 12:29:43.534689 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member,admin Sep 07 12:29:43.534689 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member,admin Sep 07 12:29:43.535916 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a1138edc1464a74834c5ba40cf7aec5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a1138edc1464a74834c5ba40cf7aec5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a1138edc1464a74834c5ba40cf7aec5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a1138edc1464a74834c5ba40cf7aec5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:43.535916 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1392180977 Sep 07 12:29:43.535916 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 5a1138edc1464a74834c5ba40cf7aec5 Sep 07 12:29:43.535916 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1392180977 Sep 07 12:29:43.535916 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin Sep 07 12:29:43.535916 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:29:43.535916 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:29:43.535916 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: c27b3cad228a49a3bb4b33e4543b6125 Sep 07 12:29:43.535916 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin Sep 07 12:29:43.535916 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:29:43.535916 n-d-852087-9 devstack@n-api.service[122432]: exception: Access list not available for public flavors. Sep 07 12:29:43.535916 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'flavor_id': '617217374'} Sep 07 12:29:43.536592 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:43.536592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:43.536592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:43.536592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:43.536592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:43.536592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:43.536592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:43.536592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:43.536592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Sep 07 12:29:43.536592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 12:29:43.536592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Sep 07 12:29:43.536592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:43.536592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:43.536592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:43.536592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:43.536592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:43.536592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:43.536592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:29:43.536592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:29:43.536592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Sep 07 12:29:43.536592 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:43.537777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2748afbc-d3a8-4b0f-97d4-e3ff99ba1f68 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:43.541741 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2748afbc-d3a8-4b0f-97d4-e3ff99ba1f68 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/617217374/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.042031 Sep 07 12:29:43.542703 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 229/435] 10.222.0.16 () {58 vars in 1206 bytes} [Wed Sep 7 12:29:43 2022] GET /compute/v2.1/flavors/617217374/os-flavor-access => generated 91 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:29:43.556483 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-03a5d1bb-8b3f-416a-b442-be1fd325df91 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:43.557247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-03a5d1bb-8b3f-416a-b442-be1fd325df91 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] [instance: 3922432a-d58f-4f0a-9471-5c8c210caa9e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:43.568741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03a5d1bb-8b3f-416a-b442-be1fd325df91 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:43.576601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03a5d1bb-8b3f-416a-b442-be1fd325df91 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:43.577157 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03a5d1bb-8b3f-416a-b442-be1fd325df91 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:43.582323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03a5d1bb-8b3f-416a-b442-be1fd325df91 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:43.583310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03a5d1bb-8b3f-416a-b442-be1fd325df91 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:43.583780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03a5d1bb-8b3f-416a-b442-be1fd325df91 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:43.775002 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c8d02ae-4fc2-4cf9-83d2-31bf38a8a0dd tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:43.777283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c8d02ae-4fc2-4cf9-83d2-31bf38a8a0dd tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:43.780686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c8d02ae-4fc2-4cf9-83d2-31bf38a8a0dd tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:43.782251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c8d02ae-4fc2-4cf9-83d2-31bf38a8a0dd tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:43.783079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c8d02ae-4fc2-4cf9-83d2-31bf38a8a0dd tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:43.783721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c8d02ae-4fc2-4cf9-83d2-31bf38a8a0dd tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:43.875856 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5c8d02ae-4fc2-4cf9-83d2-31bf38a8a0dd tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/277e5bc8bf794673a297aa015783518f" status: 200 len: 328 microversion: 2.1 time: 0.470155 Sep 07 12:29:43.875856 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 207/436] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Sep 7 12:29:43 2022] PUT /compute/v2.1/os-quota-sets/277e5bc8bf794673a297aa015783518f => generated 328 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:43.883833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f476e67b-f464-4c51-a8e4-d6140d4be072 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:43.885158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f476e67b-f464-4c51-a8e4-d6140d4be072 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:43.894618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f476e67b-f464-4c51-a8e4-d6140d4be072 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:43.896163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f476e67b-f464-4c51-a8e4-d6140d4be072 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:43.896844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f476e67b-f464-4c51-a8e4-d6140d4be072 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:43.897875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f476e67b-f464-4c51-a8e4-d6140d4be072 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:43.898592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f476e67b-f464-4c51-a8e4-d6140d4be072 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:43.899269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f476e67b-f464-4c51-a8e4-d6140d4be072 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:43.922376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-03a5d1bb-8b3f-416a-b442-be1fd325df91 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f867ffebff94e3785cbaf0dc19f518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d676a2aa1bf4032965482efdd697502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:43.926265 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:43.931923 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-03a5d1bb-8b3f-416a-b442-be1fd325df91 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] 10.222.0.16 "GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e" status: 200 len: 1479 microversion: 2.1 time: 0.388100 Sep 07 12:29:43.950242 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 230/437] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:43 2022] GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e => generated 1479 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:43.957321 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5f780d5f-e8c0-4baa-8d6b-2bf25091da3f tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:43.979817 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5f780d5f-e8c0-4baa-8d6b-2bf25091da3f tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/617217374" status: 202 len: 0 microversion: 2.1 time: 0.027348 Sep 07 12:29:43.980702 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 231/438] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Sep 7 12:29:43 2022] DELETE /compute/v2.1/flavors/617217374 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:29:43.990305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7d7eb125-9aec-445d-9d1a-701b91947206 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Calling method '.version_select at 0x7fc419640c10>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:44.115865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d7eb125-9aec-445d-9d1a-701b91947206 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:44.117259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d7eb125-9aec-445d-9d1a-701b91947206 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:44.118418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d7eb125-9aec-445d-9d1a-701b91947206 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:44.120141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d7eb125-9aec-445d-9d1a-701b91947206 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:44.121326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d7eb125-9aec-445d-9d1a-701b91947206 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:44.122562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d7eb125-9aec-445d-9d1a-701b91947206 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:44.165182 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7d7eb125-9aec-445d-9d1a-701b91947206 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/277e5bc8bf794673a297aa015783518f/detail" status: 200 len: 916 microversion: 2.1 time: 0.182132 Sep 07 12:29:44.190490 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 232/439] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Sep 7 12:29:43 2022] GET /compute/v2.1/os-quota-sets/277e5bc8bf794673a297aa015783518f/detail => generated 916 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:44.202924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a75901b8-79c8-429d-a572-e2bffbe0c1c5 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:44.251711 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a75901b8-79c8-429d-a572-e2bffbe0c1c5 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.058509 Sep 07 12:29:44.254270 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 233/440] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:29:44 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:44.260883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-85e71564-e0b6-4789-a1ba-7f87e5c3dad8 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:44.261805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-85e71564-e0b6-4789-a1ba-7f87e5c3dad8 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:44.274331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85e71564-e0b6-4789-a1ba-7f87e5c3dad8 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:44.281733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85e71564-e0b6-4789-a1ba-7f87e5c3dad8 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:44.284134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85e71564-e0b6-4789-a1ba-7f87e5c3dad8 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:44.285682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85e71564-e0b6-4789-a1ba-7f87e5c3dad8 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:44.290856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85e71564-e0b6-4789-a1ba-7f87e5c3dad8 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:44.291993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85e71564-e0b6-4789-a1ba-7f87e5c3dad8 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:44.483778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-85e71564-e0b6-4789-a1ba-7f87e5c3dad8 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:44.495369 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-85e71564-e0b6-4789-a1ba-7f87e5c3dad8 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657" status: 200 len: 1276 microversion: 2.1 time: 0.239148 Sep 07 12:29:44.505553 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 234/441] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:44 2022] GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 => generated 1276 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:44.505553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-818032ff-41eb-4899-9874-b982ad00c34c tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1762710534", "id": 2102963321, "os-flavor-access:is_public": "False"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:44.534264 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-818032ff-41eb-4899-9874-b982ad00c34c tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.035689 Sep 07 12:29:44.536881 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 235/442] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:29:44 2022] POST /compute/v2.1/flavors => generated 439 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:44.554600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-10bb0f88-ec90-4ade-b8bd-5e5e7d40eb72 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:44.555598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-10bb0f88-ec90-4ade-b8bd-5e5e7d40eb72 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 8ecbad38-98de-4c5d-b656-07e102181e62] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:44.559947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f476e67b-f464-4c51-a8e4-d6140d4be072 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:44.569243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10bb0f88-ec90-4ade-b8bd-5e5e7d40eb72 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:44.570286 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10bb0f88-ec90-4ade-b8bd-5e5e7d40eb72 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:44.570996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10bb0f88-ec90-4ade-b8bd-5e5e7d40eb72 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:44.572321 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10bb0f88-ec90-4ade-b8bd-5e5e7d40eb72 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:44.574330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10bb0f88-ec90-4ade-b8bd-5e5e7d40eb72 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:44.574330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10bb0f88-ec90-4ade-b8bd-5e5e7d40eb72 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:44.575867 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f476e67b-f464-4c51-a8e4-d6140d4be072 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1476 microversion: 2.1 time: 0.696733 Sep 07 12:29:44.577579 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 208/443] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:43 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1476 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:44.589724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1488cbb7-f796-4ede-b7f5-08dfbc74e4a7 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Action: 'update', calling method: .version_select at 0x7fc419adb670>, body: {"quota_set": {"ram": "2048"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:44.710209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1488cbb7-f796-4ede-b7f5-08dfbc74e4a7 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:44.711231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1488cbb7-f796-4ede-b7f5-08dfbc74e4a7 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:44.712617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1488cbb7-f796-4ede-b7f5-08dfbc74e4a7 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:44.713605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1488cbb7-f796-4ede-b7f5-08dfbc74e4a7 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:44.715400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1488cbb7-f796-4ede-b7f5-08dfbc74e4a7 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:44.716235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1488cbb7-f796-4ede-b7f5-08dfbc74e4a7 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:44.727472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-10bb0f88-ec90-4ade-b8bd-5e5e7d40eb72 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:44.745725 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-10bb0f88-ec90-4ade-b8bd-5e5e7d40eb72 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62" status: 200 len: 1280 microversion: 2.1 time: 0.202824 Sep 07 12:29:44.755693 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 236/444] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:44 2022] GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62 => generated 1280 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:44.771198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0dfbc031-d00d-46ba-8dcb-796339cc9f35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:44.772096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0dfbc031-d00d-46ba-8dcb-796339cc9f35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:44.787500 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dfbc031-d00d-46ba-8dcb-796339cc9f35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:44.788197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1488cbb7-f796-4ede-b7f5-08dfbc74e4a7 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:44.788370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dfbc031-d00d-46ba-8dcb-796339cc9f35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:44.789038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1488cbb7-f796-4ede-b7f5-08dfbc74e4a7 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:44.789172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dfbc031-d00d-46ba-8dcb-796339cc9f35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:44.789848 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1488cbb7-f796-4ede-b7f5-08dfbc74e4a7 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:44.790544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dfbc031-d00d-46ba-8dcb-796339cc9f35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:44.791356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1488cbb7-f796-4ede-b7f5-08dfbc74e4a7 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:44.792022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1488cbb7-f796-4ede-b7f5-08dfbc74e4a7 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:44.792224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dfbc031-d00d-46ba-8dcb-796339cc9f35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:44.793208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dfbc031-d00d-46ba-8dcb-796339cc9f35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:44.793662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1488cbb7-f796-4ede-b7f5-08dfbc74e4a7 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:44.886971 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1488cbb7-f796-4ede-b7f5-08dfbc74e4a7 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/277e5bc8bf794673a297aa015783518f?user_id=4ae874c5d2604d46bbcc5be143c97be0" status: 200 len: 328 microversion: 2.1 time: 0.307611 Sep 07 12:29:44.888061 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 209/445] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Sep 7 12:29:44 2022] PUT /compute/v2.1/os-quota-sets/277e5bc8bf794673a297aa015783518f?user_id=4ae874c5d2604d46bbcc5be143c97be0 => generated 328 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:45.082490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d0fa277a-c591-42b4-9a84-42171eed6b7c tempest-FlavorsAccessNegativeTestJSON-493849479 tempest-FlavorsAccessNegativeTestJSON-493849479-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "389d9738b0a646ff85e56a6c800e3521"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:45.086329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d0fa277a-c591-42b4-9a84-42171eed6b7c tempest-FlavorsAccessNegativeTestJSON-493849479 tempest-FlavorsAccessNegativeTestJSON-493849479-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'ee663c7ec14e45d48731cf3cb55c8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389d9738b0a646ff85e56a6c800e3521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:45.097098 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d0fa277a-c591-42b4-9a84-42171eed6b7c tempest-FlavorsAccessNegativeTestJSON-493849479 tempest-FlavorsAccessNegativeTestJSON-493849479-project] Request method failure captured: Sep 07 12:29:45.097098 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/flavors/2102963321/action HTTP/1.1 Sep 07 12:29:45.097098 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:29:45.097098 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:29:45.097098 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:29:45.097098 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 67 Sep 07 12:29:45.097098 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:29:45.097098 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:29:45.097098 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:29:45.097098 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:45.097098 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI6yxsSU8QpfWnQsrXJBEN2zGS2gKsMctX48f08qsh9PVHRAkX5KxVKXra-E89Khj_TKL65lCVOCr8zUlzYCRA_qeiZoUhZ4v_nn7zmqCf7ktz81Po_40-jlCb-XE8i1kYhPlLkltzNQf7rg4eMndBt6WgbE9bEJCHIXo8xHNj2WOVw Sep 07 12:29:45.097098 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:29:45.097098 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:29:45.097098 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:29:45.097098 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:29:45.097098 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:29:45.097098 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:29:45.097098 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 389d9738b0a646ff85e56a6c800e3521 Sep 07 12:29:45.097098 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-493849479 Sep 07 12:29:45.097098 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:29:45.097098 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:29:45.099793 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/389d9738b0a646ff85e56a6c800e3521"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_389d9738b0a646ff85e56a6c800e3521"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/389d9738b0a646ff85e56a6c800e3521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/389d9738b0a646ff85e56a6c800e3521"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:45.099793 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-493849479 Sep 07 12:29:45.099793 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 389d9738b0a646ff85e56a6c800e3521 Sep 07 12:29:45.099793 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-493849479 Sep 07 12:29:45.099793 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-FlavorsAccessNegativeTestJSON-493849479-project Sep 07 12:29:45.099793 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:29:45.099793 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:29:45.099793 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: ee663c7ec14e45d48731cf3cb55c8804 Sep 07 12:29:45.099793 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-493849479-project Sep 07 12:29:45.099793 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:29:45.099793 n-d-852087-9 devstack@n-api.service[122433]: {"addTenantAccess": {"tenant": "389d9738b0a646ff85e56a6c800e3521"}} Sep 07 12:29:45.099793 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:29:45.101069 n-d-852087-9 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 07 12:29:45.101069 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '2102963321', 'body': {'addTenantAccess': {'tenant': '389d9738b0a646ff85e56a6c800e3521'}}} Sep 07 12:29:45.101069 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:45.101069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:45.101069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:45.101069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:45.101069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:45.101069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:45.101069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:45.101069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:45.101069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:29:45.101069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:29:45.101069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Sep 07 12:29:45.101069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Sep 07 12:29:45.101069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:29:45.101069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:29:45.101069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:29:45.101069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:29:45.101069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:29:45.105757 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:29:45.105757 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:29:45.105757 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:29:45.105757 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:29:45.105757 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:29:45.105757 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:29:45.105757 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:29:45.105757 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:29:45.105757 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:29:45.105757 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 07 12:29:45.105757 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:45.105757 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:45.105757 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:45.105757 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:45.105757 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:45.105757 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:45.105757 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:29:45.105757 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:29:45.105757 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 07 12:29:45.105757 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:45.109637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d0fa277a-c591-42b4-9a84-42171eed6b7c tempest-FlavorsAccessNegativeTestJSON-493849479 tempest-FlavorsAccessNegativeTestJSON-493849479-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:45.109637 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d0fa277a-c591-42b4-9a84-42171eed6b7c tempest-FlavorsAccessNegativeTestJSON-493849479 tempest-FlavorsAccessNegativeTestJSON-493849479-project] 10.222.0.16 "POST /compute/v2.1/flavors/2102963321/action" status: 403 len: 130 microversion: 2.1 time: 0.210452 Sep 07 12:29:45.109637 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 210/446] 10.222.0.16 () {60 vars in 1200 bytes} [Wed Sep 7 12:29:44 2022] POST /compute/v2.1/flavors/2102963321/action => generated 130 bytes in 213 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:29:45.111398 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-670056d0-9f12-4a94-bf75-da25babe19fd tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Calling method '.version_select at 0x7fc41977b550>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:45.133345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0dfbc031-d00d-46ba-8dcb-796339cc9f35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:45.154554 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0dfbc031-d00d-46ba-8dcb-796339cc9f35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1311 microversion: 2.1 time: 0.405512 Sep 07 12:29:45.155517 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 237/447] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:44 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1311 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:45.160800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8dfd0b85-3e75-45ba-9b81-15dd04894c19 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:45.161414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8dfd0b85-3e75-45ba-9b81-15dd04894c19 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] [instance: 3922432a-d58f-4f0a-9471-5c8c210caa9e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:45.167851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dfd0b85-3e75-45ba-9b81-15dd04894c19 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:45.168359 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dfd0b85-3e75-45ba-9b81-15dd04894c19 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:45.168966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dfd0b85-3e75-45ba-9b81-15dd04894c19 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:45.170179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dfd0b85-3e75-45ba-9b81-15dd04894c19 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:45.170650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dfd0b85-3e75-45ba-9b81-15dd04894c19 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:45.171080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dfd0b85-3e75-45ba-9b81-15dd04894c19 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:45.322929 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-670056d0-9f12-4a94-bf75-da25babe19fd tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/277e5bc8bf794673a297aa015783518f?user_id=4ae874c5d2604d46bbcc5be143c97be0" status: 200 len: 370 microversion: 2.1 time: 0.215878 Sep 07 12:29:45.327134 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 211/448] 10.222.0.16 () {58 vars in 1323 bytes} [Wed Sep 7 12:29:45 2022] GET /compute/v2.1/os-quota-sets/277e5bc8bf794673a297aa015783518f?user_id=4ae874c5d2604d46bbcc5be143c97be0 => generated 370 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:45.372778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-527f990b-cba6-4ea0-b99d-4d68e32a284e req-5e4143b6-3b6b-4789-ad7c-ad1332a99286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc8c1c2b-eb55-4361-bcd7-e66c270b827a", "tag": "1e24dd2e-9faf-4586-ae6b-48d1499917fe"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:45.431066 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-527f990b-cba6-4ea0-b99d-4d68e32a284e req-5e4143b6-3b6b-4789-ad7c-ad1332a99286 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:45.432246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-527f990b-cba6-4ea0-b99d-4d68e32a284e req-5e4143b6-3b6b-4789-ad7c-ad1332a99286 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:45.432913 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-527f990b-cba6-4ea0-b99d-4d68e32a284e req-5e4143b6-3b6b-4789-ad7c-ad1332a99286 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:45.466373 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-527f990b-cba6-4ea0-b99d-4d68e32a284e req-5e4143b6-3b6b-4789-ad7c-ad1332a99286 service nova] Creating event network-changed:1e24dd2e-9faf-4586-ae6b-48d1499917fe for instance fc8c1c2b-eb55-4361-bcd7-e66c270b827a on n-h1-852087-9 Sep 07 12:29:45.470264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8dfd0b85-3e75-45ba-9b81-15dd04894c19 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f867ffebff94e3785cbaf0dc19f518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d676a2aa1bf4032965482efdd697502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:45.476288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-527f990b-cba6-4ea0-b99d-4d68e32a284e req-5e4143b6-3b6b-4789-ad7c-ad1332a99286 service nova] Instance fc8c1c2b-eb55-4361-bcd7-e66c270b827a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 12:29:45.484969 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8dfd0b85-3e75-45ba-9b81-15dd04894c19 tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] 10.222.0.16 "GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e" status: 200 len: 1479 microversion: 2.1 time: 0.328140 Sep 07 12:29:45.488474 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 238/449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:45 2022] GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e => generated 1479 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:45.499938 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-527f990b-cba6-4ea0-b99d-4d68e32a284e req-5e4143b6-3b6b-4789-ad7c-ad1332a99286 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170984 Sep 07 12:29:45.501665 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 212/450] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:45.505275 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-773d178a-e74a-4880-a8fa-414fc6c05d2f tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:45.539807 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-773d178a-e74a-4880-a8fa-414fc6c05d2f tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2102963321" status: 202 len: 0 microversion: 2.1 time: 0.049898 Sep 07 12:29:45.546377 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 239/451] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Sep 7 12:29:45 2022] DELETE /compute/v2.1/flavors/2102963321 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:29:45.557430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3fc3df15-40a0-4322-a631-16f166377ef4 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:45.559449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cdd5d9f3-7b2e-470f-bd1a-3ea2a25fc847 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:45.565119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cdd5d9f3-7b2e-470f-bd1a-3ea2a25fc847 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:45.585127 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdd5d9f3-7b2e-470f-bd1a-3ea2a25fc847 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:45.586387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdd5d9f3-7b2e-470f-bd1a-3ea2a25fc847 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:45.588373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdd5d9f3-7b2e-470f-bd1a-3ea2a25fc847 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:45.590788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdd5d9f3-7b2e-470f-bd1a-3ea2a25fc847 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:45.592048 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdd5d9f3-7b2e-470f-bd1a-3ea2a25fc847 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:45.610252 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3fc3df15-40a0-4322-a631-16f166377ef4 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.062314 Sep 07 12:29:45.620295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdd5d9f3-7b2e-470f-bd1a-3ea2a25fc847 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:45.621978 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 240/452] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:29:45 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:45.639229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ae8e073a-55f5-4005-ae3b-9a4fbae43417 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:45.642137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ae8e073a-55f5-4005-ae3b-9a4fbae43417 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:45.654795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae8e073a-55f5-4005-ae3b-9a4fbae43417 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:45.656816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae8e073a-55f5-4005-ae3b-9a4fbae43417 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:45.658750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae8e073a-55f5-4005-ae3b-9a4fbae43417 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:45.661995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae8e073a-55f5-4005-ae3b-9a4fbae43417 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:45.662729 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae8e073a-55f5-4005-ae3b-9a4fbae43417 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:45.663463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae8e073a-55f5-4005-ae3b-9a4fbae43417 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:45.915307 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cdd5d9f3-7b2e-470f-bd1a-3ea2a25fc847 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:45.941178 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cdd5d9f3-7b2e-470f-bd1a-3ea2a25fc847 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657" status: 200 len: 1276 microversion: 2.1 time: 0.391114 Sep 07 12:29:45.954968 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 213/453] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:45 2022] GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 => generated 1276 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:45.971267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-728cef4a-91d0-4189-a339-9646efb8a519 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-162019025", "id": 1557441439, "os-flavor-access:is_public": "False"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:45.999625 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-728cef4a-91d0-4189-a339-9646efb8a519 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.040738 Sep 07 12:29:46.010016 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 214/454] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:29:45 2022] POST /compute/v2.1/flavors => generated 438 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:46.012617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-34c55266-22c4-4a13-bd88-c0b1735dc68e tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:46.014321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-34c55266-22c4-4a13-bd88-c0b1735dc68e tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 8ecbad38-98de-4c5d-b656-07e102181e62] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:46.024426 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34c55266-22c4-4a13-bd88-c0b1735dc68e tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:46.025227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34c55266-22c4-4a13-bd88-c0b1735dc68e tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:46.026074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34c55266-22c4-4a13-bd88-c0b1735dc68e tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:46.027222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34c55266-22c4-4a13-bd88-c0b1735dc68e tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:46.027686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34c55266-22c4-4a13-bd88-c0b1735dc68e tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:46.028285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34c55266-22c4-4a13-bd88-c0b1735dc68e tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:46.116655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ae8e073a-55f5-4005-ae3b-9a4fbae43417 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:46.128248 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ae8e073a-55f5-4005-ae3b-9a4fbae43417 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1476 microversion: 2.1 time: 0.495389 Sep 07 12:29:46.131366 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 241/455] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:45 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1476 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:46.145805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-5af002be-350a-4c7e-9c15-4155019bbe84 req-ae88717c-03c4-4b09-9e89-b5b3f60d0d9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74efffee-c688-4fe1-88dd-a49eaa3d940e", "name": "network-vif-plugged", "status": "completed", "tag": "53a321bf-b211-4774-a021-98fa126748f1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:46.170242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5af002be-350a-4c7e-9c15-4155019bbe84 req-ae88717c-03c4-4b09-9e89-b5b3f60d0d9a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:46.170881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5af002be-350a-4c7e-9c15-4155019bbe84 req-ae88717c-03c4-4b09-9e89-b5b3f60d0d9a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:46.172039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5af002be-350a-4c7e-9c15-4155019bbe84 req-ae88717c-03c4-4b09-9e89-b5b3f60d0d9a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:46.197997 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-5af002be-350a-4c7e-9c15-4155019bbe84 req-ae88717c-03c4-4b09-9e89-b5b3f60d0d9a service nova] Creating event network-vif-plugged:53a321bf-b211-4774-a021-98fa126748f1 for instance 74efffee-c688-4fe1-88dd-a49eaa3d940e on n-h1-852087-9 Sep 07 12:29:46.214986 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-5af002be-350a-4c7e-9c15-4155019bbe84 req-ae88717c-03c4-4b09-9e89-b5b3f60d0d9a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082121 Sep 07 12:29:46.219652 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 242/456] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:46.226156 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c3407523-f830-47f9-a5e4-f8edf76428e1 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "389d9738b0a646ff85e56a6c800e3521"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:46.576335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-34c55266-22c4-4a13-bd88-c0b1735dc68e tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:46.586567 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-34c55266-22c4-4a13-bd88-c0b1735dc68e tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62" status: 200 len: 1322 microversion: 2.1 time: 0.583689 Sep 07 12:29:46.587631 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 215/457] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:46 2022] GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62 => generated 1322 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:46.596369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-63f419a0-fbce-4728-bc73-db587033eacf tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:46.597430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-63f419a0-fbce-4728-bc73-db587033eacf tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:46.613594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63f419a0-fbce-4728-bc73-db587033eacf tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:46.617349 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63f419a0-fbce-4728-bc73-db587033eacf tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:46.617527 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63f419a0-fbce-4728-bc73-db587033eacf tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:46.622924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63f419a0-fbce-4728-bc73-db587033eacf tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:46.623527 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63f419a0-fbce-4728-bc73-db587033eacf tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:46.623976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63f419a0-fbce-4728-bc73-db587033eacf tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:46.709038 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c3407523-f830-47f9-a5e4-f8edf76428e1 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1557441439/action" status: 200 len: 97 microversion: 2.1 time: 0.486661 Sep 07 12:29:46.709797 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 243/458] 10.222.0.16 () {60 vars in 1200 bytes} [Wed Sep 7 12:29:46 2022] POST /compute/v2.1/flavors/1557441439/action => generated 97 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:29:46.715407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-81c5eebc-0c63-464f-8e34-a7135491f4d5 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Calling method '.version_select at 0x7fc41971eee0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:46.949809 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-81c5eebc-0c63-464f-8e34-a7135491f4d5 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/54638ceb8f7b403baf346d505566cf72/defaults" status: 200 len: 371 microversion: 2.1 time: 0.237996 Sep 07 12:29:46.965518 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 244/459] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Sep 7 12:29:46 2022] GET /compute/v2.1/os-quota-sets/54638ceb8f7b403baf346d505566cf72/defaults => generated 371 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:46.977100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6d95c56b-42b2-4c30-bca1-3aa3cf4de7df tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:46.978923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6d95c56b-42b2-4c30-bca1-3aa3cf4de7df tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] [instance: 3922432a-d58f-4f0a-9471-5c8c210caa9e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:46.991936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d95c56b-42b2-4c30-bca1-3aa3cf4de7df tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:46.993865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d95c56b-42b2-4c30-bca1-3aa3cf4de7df tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:46.995974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d95c56b-42b2-4c30-bca1-3aa3cf4de7df tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:46.999095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d95c56b-42b2-4c30-bca1-3aa3cf4de7df tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:46.999644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d95c56b-42b2-4c30-bca1-3aa3cf4de7df tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:47.000106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d95c56b-42b2-4c30-bca1-3aa3cf4de7df tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:47.047753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d95c56b-42b2-4c30-bca1-3aa3cf4de7df tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:47.048402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d95c56b-42b2-4c30-bca1-3aa3cf4de7df tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:47.049090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d95c56b-42b2-4c30-bca1-3aa3cf4de7df tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:47.049738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-6d95c56b-42b2-4c30-bca1-3aa3cf4de7df tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lazy-loading 'fault' on Instance uuid 3922432a-d58f-4f0a-9471-5c8c210caa9e {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:29:47.180076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6d95c56b-42b2-4c30-bca1-3aa3cf4de7df tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f867ffebff94e3785cbaf0dc19f518d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d676a2aa1bf4032965482efdd697502', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:47.188713 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6d95c56b-42b2-4c30-bca1-3aa3cf4de7df tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] 10.222.0.16 "GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e" status: 200 len: 1313 microversion: 2.1 time: 0.221440 Sep 07 12:29:47.189309 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 245/460] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:46 2022] GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:47.193716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-63f419a0-fbce-4728-bc73-db587033eacf tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:47.204952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:47.212494 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-63f419a0-fbce-4728-bc73-db587033eacf tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1311 microversion: 2.1 time: 0.623614 Sep 07 12:29:47.212602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0ccff29f-85bb-4b58-86f4-aab496d635c5 tempest-FlavorsAccessNegativeTestJSON-493849479 tempest-FlavorsAccessNegativeTestJSON-493849479-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "389d9738b0a646ff85e56a6c800e3521"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:47.212973 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 216/461] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:46 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1311 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:47.218626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0ccff29f-85bb-4b58-86f4-aab496d635c5 tempest-FlavorsAccessNegativeTestJSON-493849479 tempest-FlavorsAccessNegativeTestJSON-493849479-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'ee663c7ec14e45d48731cf3cb55c8804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389d9738b0a646ff85e56a6c800e3521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:47.223901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0ccff29f-85bb-4b58-86f4-aab496d635c5 tempest-FlavorsAccessNegativeTestJSON-493849479 tempest-FlavorsAccessNegativeTestJSON-493849479-project] Request method failure captured: Sep 07 12:29:47.223901 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/flavors/1557441439/action HTTP/1.1 Sep 07 12:29:47.223901 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:29:47.223901 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:29:47.223901 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:29:47.223901 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 70 Sep 07 12:29:47.223901 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:29:47.223901 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:29:47.223901 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:29:47.223901 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:47.223901 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI6yxsSU8QpfWnQsrXJBEN2zGS2gKsMctX48f08qsh9PVHRAkX5KxVKXra-E89Khj_TKL65lCVOCr8zUlzYCRA_qeiZoUhZ4v_nn7zmqCf7ktz81Po_40-jlCb-XE8i1kYhPlLkltzNQf7rg4eMndBt6WgbE9bEJCHIXo8xHNj2WOVw Sep 07 12:29:47.223901 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:29:47.223901 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:29:47.223901 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:29:47.223901 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:29:47.223901 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:29:47.223901 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:29:47.223901 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 389d9738b0a646ff85e56a6c800e3521 Sep 07 12:29:47.223901 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-493849479 Sep 07 12:29:47.223901 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:29:47.223901 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:29:47.225347 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/389d9738b0a646ff85e56a6c800e3521"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_389d9738b0a646ff85e56a6c800e3521"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/389d9738b0a646ff85e56a6c800e3521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/389d9738b0a646ff85e56a6c800e3521"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:47.225347 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-493849479 Sep 07 12:29:47.225347 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 389d9738b0a646ff85e56a6c800e3521 Sep 07 12:29:47.225347 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-493849479 Sep 07 12:29:47.225347 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-FlavorsAccessNegativeTestJSON-493849479-project Sep 07 12:29:47.225347 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:29:47.225347 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:29:47.225347 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: ee663c7ec14e45d48731cf3cb55c8804 Sep 07 12:29:47.225347 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-493849479-project Sep 07 12:29:47.225347 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:29:47.225347 n-d-852087-9 devstack@n-api.service[122432]: {"removeTenantAccess": {"tenant": "389d9738b0a646ff85e56a6c800e3521"}} Sep 07 12:29:47.225347 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:29:47.226922 n-d-852087-9 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 07 12:29:47.226922 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '1557441439', 'body': {'removeTenantAccess': {'tenant': '389d9738b0a646ff85e56a6c800e3521'}}} Sep 07 12:29:47.226922 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:47.226922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:47.226922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:47.226922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:47.226922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:47.226922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:47.226922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:47.226922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:47.226922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:29:47.226922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:29:47.226922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Sep 07 12:29:47.226922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can( Sep 07 12:29:47.226922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:29:47.226922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:29:47.226922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:29:47.226922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:29:47.226922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:29:47.226922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:29:47.228258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:29:47.228258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:29:47.228258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:29:47.228258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:29:47.228258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:29:47.228258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:29:47.228258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:29:47.228258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:29:47.228258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 07 12:29:47.228258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:47.228258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:47.228258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:47.228258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:47.228258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:47.228258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:47.228258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:29:47.228258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:29:47.228258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 07 12:29:47.228258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:29:47.229409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0ccff29f-85bb-4b58-86f4-aab496d635c5 tempest-FlavorsAccessNegativeTestJSON-493849479 tempest-FlavorsAccessNegativeTestJSON-493849479-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:47.229409 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0ccff29f-85bb-4b58-86f4-aab496d635c5 tempest-FlavorsAccessNegativeTestJSON-493849479 tempest-FlavorsAccessNegativeTestJSON-493849479-project] 10.222.0.16 "POST /compute/v2.1/flavors/1557441439/action" status: 403 len: 133 microversion: 2.1 time: 0.022361 Sep 07 12:29:47.229817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-408d6628-1f7b-4a18-97f4-5ca6557e5b02 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Action: 'update', calling method: .version_select at 0x7fc4197fedc0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:47.232253 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 246/462] 10.222.0.16 () {60 vars in 1200 bytes} [Wed Sep 7 12:29:47 2022] POST /compute/v2.1/flavors/1557441439/action => generated 133 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:29:47.239371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6b549763-02bd-4b48-a210-3d9c18130712 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:47.243490 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6b549763-02bd-4b48-a210-3d9c18130712 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:47.264410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b549763-02bd-4b48-a210-3d9c18130712 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:47.265210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b549763-02bd-4b48-a210-3d9c18130712 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:47.266475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b549763-02bd-4b48-a210-3d9c18130712 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:47.268962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b549763-02bd-4b48-a210-3d9c18130712 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:47.269995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b549763-02bd-4b48-a210-3d9c18130712 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:47.270709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b549763-02bd-4b48-a210-3d9c18130712 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:47.316215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-408d6628-1f7b-4a18-97f4-5ca6557e5b02 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:47.316793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-408d6628-1f7b-4a18-97f4-5ca6557e5b02 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:47.317262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-408d6628-1f7b-4a18-97f4-5ca6557e5b02 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:47.318046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-408d6628-1f7b-4a18-97f4-5ca6557e5b02 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:47.318503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-408d6628-1f7b-4a18-97f4-5ca6557e5b02 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:47.318946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-408d6628-1f7b-4a18-97f4-5ca6557e5b02 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:47.519529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6b549763-02bd-4b48-a210-3d9c18130712 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:47.536409 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6b549763-02bd-4b48-a210-3d9c18130712 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657" status: 200 len: 1318 microversion: 2.1 time: 0.302696 Sep 07 12:29:47.549952 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 247/463] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:47 2022] GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:47.560673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-897e5e12-dbdc-48b8-ac7b-bcd30cc3d486 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:47.563668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-897e5e12-dbdc-48b8-ac7b-bcd30cc3d486 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:47.568004 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:DELETE=9,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:47.571721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-897e5e12-dbdc-48b8-ac7b-bcd30cc3d486 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:47.572222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-897e5e12-dbdc-48b8-ac7b-bcd30cc3d486 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:47.572658 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-897e5e12-dbdc-48b8-ac7b-bcd30cc3d486 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:47.573633 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-897e5e12-dbdc-48b8-ac7b-bcd30cc3d486 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:47.574097 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-897e5e12-dbdc-48b8-ac7b-bcd30cc3d486 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:47.574687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-897e5e12-dbdc-48b8-ac7b-bcd30cc3d486 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:47.587263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1,nova_api:INSERT=16 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:47.624104 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-408d6628-1f7b-4a18-97f4-5ca6557e5b02 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/54638ceb8f7b403baf346d505566cf72" status: 200 len: 329 microversion: 2.1 time: 0.409635 Sep 07 12:29:47.630107 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 217/464] 10.222.0.16 () {60 vars in 1263 bytes} [Wed Sep 7 12:29:47 2022] PUT /compute/v2.1/os-quota-sets/54638ceb8f7b403baf346d505566cf72 => generated 329 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:47.637137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8a9bd5f6-3a9d-463d-af08-49f2fefb2b69 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "389d9738b0a646ff85e56a6c800e3521"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:47.731437 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8a9bd5f6-3a9d-463d-af08-49f2fefb2b69 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1557441439/action" status: 200 len: 21 microversion: 2.1 time: 0.099550 Sep 07 12:29:47.731871 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 218/465] 10.222.0.16 () {60 vars in 1200 bytes} [Wed Sep 7 12:29:47 2022] POST /compute/v2.1/flavors/1557441439/action => generated 21 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:29:47.736473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-038f9b10-ef08-4912-b9c6-bf476d43063b req-bb8baf66-f593-43ee-b28c-0dcaa9e67f44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3922432a-d58f-4f0a-9471-5c8c210caa9e", "name": "network-vif-deleted", "tag": "283d983c-1d5a-4725-8ab1-a48b9ed5b74c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:47.748234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-038f9b10-ef08-4912-b9c6-bf476d43063b req-bb8baf66-f593-43ee-b28c-0dcaa9e67f44 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:47.748858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-038f9b10-ef08-4912-b9c6-bf476d43063b req-bb8baf66-f593-43ee-b28c-0dcaa9e67f44 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:47.749363 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-038f9b10-ef08-4912-b9c6-bf476d43063b req-bb8baf66-f593-43ee-b28c-0dcaa9e67f44 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:47.764079 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-038f9b10-ef08-4912-b9c6-bf476d43063b req-bb8baf66-f593-43ee-b28c-0dcaa9e67f44 service nova] Creating event network-vif-deleted:283d983c-1d5a-4725-8ab1-a48b9ed5b74c for instance 3922432a-d58f-4f0a-9471-5c8c210caa9e on n-h2-852087-9 Sep 07 12:29:47.769356 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-038f9b10-ef08-4912-b9c6-bf476d43063b req-bb8baf66-f593-43ee-b28c-0dcaa9e67f44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036196 Sep 07 12:29:47.770187 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 219/466] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:47.775021 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-88608494-6863-4085-8abc-70fded4a29a5 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:47.775724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-88608494-6863-4085-8abc-70fded4a29a5 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 8ecbad38-98de-4c5d-b656-07e102181e62] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:47.782148 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88608494-6863-4085-8abc-70fded4a29a5 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:47.782675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88608494-6863-4085-8abc-70fded4a29a5 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:47.783093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88608494-6863-4085-8abc-70fded4a29a5 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:47.783786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88608494-6863-4085-8abc-70fded4a29a5 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:47.784245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88608494-6863-4085-8abc-70fded4a29a5 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:47.784672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88608494-6863-4085-8abc-70fded4a29a5 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:47.846431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-897e5e12-dbdc-48b8-ac7b-bcd30cc3d486 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:47.854876 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-897e5e12-dbdc-48b8-ac7b-bcd30cc3d486 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1474 microversion: 2.1 time: 0.303773 Sep 07 12:29:47.855444 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 248/467] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:47 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1474 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:47.860390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c965aff1-e3e5-4425-9668-213e6cb136c9 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Action: 'update', calling method: .version_select at 0x7fc4195ca040>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:47.936247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c965aff1-e3e5-4425-9668-213e6cb136c9 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:47.936762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c965aff1-e3e5-4425-9668-213e6cb136c9 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:47.937562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c965aff1-e3e5-4425-9668-213e6cb136c9 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:47.938280 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c965aff1-e3e5-4425-9668-213e6cb136c9 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:47.938731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c965aff1-e3e5-4425-9668-213e6cb136c9 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:47.939166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c965aff1-e3e5-4425-9668-213e6cb136c9 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:47.958064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-88608494-6863-4085-8abc-70fded4a29a5 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:47.966288 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-88608494-6863-4085-8abc-70fded4a29a5 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62" status: 200 len: 1322 microversion: 2.1 time: 0.195150 Sep 07 12:29:47.966951 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 220/468] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:47 2022] GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:47.971840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0298fcdd-1a9d-42cd-ac9d-5ee35d6e2709 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:47.990240 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0298fcdd-1a9d-42cd-ac9d-5ee35d6e2709 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1557441439" status: 202 len: 0 microversion: 2.1 time: 0.022163 Sep 07 12:29:47.991109 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 221/469] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Sep 7 12:29:47 2022] DELETE /compute/v2.1/flavors/1557441439 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:29:48.000432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-1141b61e-0e5c-4b36-8312-7d49e2edad96 req-dee551d0-9011-43eb-8df1-068d6b147d0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ecbad38-98de-4c5d-b656-07e102181e62", "tag": "293cc6aa-a17a-4b27-8edc-1a5155708f68"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:48.010687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1141b61e-0e5c-4b36-8312-7d49e2edad96 req-dee551d0-9011-43eb-8df1-068d6b147d0a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:48.011217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1141b61e-0e5c-4b36-8312-7d49e2edad96 req-dee551d0-9011-43eb-8df1-068d6b147d0a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:48.011650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1141b61e-0e5c-4b36-8312-7d49e2edad96 req-dee551d0-9011-43eb-8df1-068d6b147d0a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:48.023869 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-1141b61e-0e5c-4b36-8312-7d49e2edad96 req-dee551d0-9011-43eb-8df1-068d6b147d0a service nova] Creating event network-changed:293cc6aa-a17a-4b27-8edc-1a5155708f68 for instance 8ecbad38-98de-4c5d-b656-07e102181e62 on n-h1-852087-9 Sep 07 12:29:48.029762 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-1141b61e-0e5c-4b36-8312-7d49e2edad96 req-dee551d0-9011-43eb-8df1-068d6b147d0a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033841 Sep 07 12:29:48.030516 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 222/470] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:48.035879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e9fb958f-0a6c-4941-aefb-873e90ac8d5f tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:48.058010 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e9fb958f-0a6c-4941-aefb-873e90ac8d5f tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.026149 Sep 07 12:29:48.058594 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 223/471] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:29:48 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:48.078629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e6c4f410-5ddd-4543-af88-f06d866438ce tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1314786535", "id": 714473912, "os-flavor-access:is_public": "False"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:48.099114 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e6c4f410-5ddd-4543-af88-f06d866438ce tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.024228 Sep 07 12:29:48.099987 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 224/472] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:29:48 2022] POST /compute/v2.1/flavors => generated 436 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:29:48.112784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-695470a4-5089-4e26-9c78-73bde3ffec47 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7898adc0d1b84be6b4f3b6ce70903806"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:48.182148 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-695470a4-5089-4e26-9c78-73bde3ffec47 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] HTTP exception thrown: Flavor access not found for 27 / 7898adc0d1b84be6b4f3b6ce70903806 combination. Sep 07 12:29:48.184005 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-695470a4-5089-4e26-9c78-73bde3ffec47 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Request method failure captured: Sep 07 12:29:48.184005 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/flavors/714473912/action HTTP/1.1 Sep 07 12:29:48.184005 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:29:48.184005 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:29:48.184005 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:29:48.184005 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 70 Sep 07 12:29:48.184005 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:29:48.184005 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:29:48.184005 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:29:48.184005 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:48.184005 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI60ZXwZDBZK634O6F20Qpx9xuS7oNUEcKFYu-VaG0UFd5QA0K2JWpyEW2qzVWg0IUr27RAEYGpgmR1lsnx6XTe3JnsnedaYFBaDvAgb_Qa2JSB7eKkMbyt9kONFlH0Q8xL8fgs7L0i7s4SH1bsJ6mbFBO6uhBdXc69qZSXiV9JMeFI Sep 07 12:29:48.184005 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:29:48.184005 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:29:48.184005 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:29:48.184005 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:29:48.184005 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:29:48.184005 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:29:48.184005 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 5a1138edc1464a74834c5ba40cf7aec5 Sep 07 12:29:48.184005 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1392180977 Sep 07 12:29:48.184005 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 12:29:48.184005 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 12:29:48.185265 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a1138edc1464a74834c5ba40cf7aec5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a1138edc1464a74834c5ba40cf7aec5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a1138edc1464a74834c5ba40cf7aec5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a1138edc1464a74834c5ba40cf7aec5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:48.185265 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1392180977 Sep 07 12:29:48.185265 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 5a1138edc1464a74834c5ba40cf7aec5 Sep 07 12:29:48.185265 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1392180977 Sep 07 12:29:48.185265 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin Sep 07 12:29:48.185265 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:29:48.185265 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:29:48.185265 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: c27b3cad228a49a3bb4b33e4543b6125 Sep 07 12:29:48.185265 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin Sep 07 12:29:48.185265 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:29:48.185265 n-d-852087-9 devstack@n-api.service[122433]: {"removeTenantAccess": {"tenant": "7898adc0d1b84be6b4f3b6ce70903806"}} Sep 07 12:29:48.185265 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:29:48.186026 n-d-852087-9 devstack@n-api.service[122433]: exception: Flavor access not found for 27 / 7898adc0d1b84be6b4f3b6ce70903806 combination. Sep 07 12:29:48.186026 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '714473912', 'body': {'removeTenantAccess': {'tenant': '7898adc0d1b84be6b4f3b6ce70903806'}}} Sep 07 12:29:48.186026 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:48.186026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:48.186026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Sep 07 12:29:48.186026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Sep 07 12:29:48.186026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 07 12:29:48.186026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 07 12:29:48.186026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Sep 07 12:29:48.186026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Sep 07 12:29:48.186026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Sep 07 12:29:48.186026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Sep 07 12:29:48.186026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Sep 07 12:29:48.186026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Sep 07 12:29:48.186026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 12:29:48.186026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 12:29:48.186026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Sep 07 12:29:48.186026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Sep 07 12:29:48.187151 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 27 / 7898adc0d1b84be6b4f3b6ce70903806 combination. Sep 07 12:29:48.187151 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:48.187151 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:48.187151 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:48.187151 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:48.187151 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:48.187151 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:48.187151 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:48.187151 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:48.187151 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:48.187151 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:48.187151 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:29:48.187151 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:29:48.187151 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Sep 07 12:29:48.187151 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:29:48.187151 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 27 / 7898adc0d1b84be6b4f3b6ce70903806 combination. Sep 07 12:29:48.187151 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:48.187151 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:48.187151 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:48.187151 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:48.188287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:48.188287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:48.188287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:29:48.188287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:29:48.188287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 27 / 7898adc0d1b84be6b4f3b6ce70903806 combination. Sep 07 12:29:48.188287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:48.188287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-695470a4-5089-4e26-9c78-73bde3ffec47 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Returning 404 to user: Flavor access not found for 27 / 7898adc0d1b84be6b4f3b6ce70903806 combination. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:48.188287 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-695470a4-5089-4e26-9c78-73bde3ffec47 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/714473912/action" status: 404 len: 124 microversion: 2.1 time: 0.076790 Sep 07 12:29:48.188287 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 225/473] 10.222.0.16 () {60 vars in 1197 bytes} [Wed Sep 7 12:29:48 2022] POST /compute/v2.1/flavors/714473912/action => generated 124 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:29:48.195190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eda98052-42bd-411b-b39f-783e9ddd106a tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:48.216498 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eda98052-42bd-411b-b39f-783e9ddd106a tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/714473912" status: 202 len: 0 microversion: 2.1 time: 0.024785 Sep 07 12:29:48.216924 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 226/474] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Sep 7 12:29:48 2022] DELETE /compute/v2.1/flavors/714473912 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 12:29:48.221833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1434b47c-68a4-44b5-9253-7037eb7ab12d tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:48.222555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1434b47c-68a4-44b5-9253-7037eb7ab12d tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] [instance: 3922432a-d58f-4f0a-9471-5c8c210caa9e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:48.229882 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1434b47c-68a4-44b5-9253-7037eb7ab12d tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:48.230373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1434b47c-68a4-44b5-9253-7037eb7ab12d tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:48.230966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1434b47c-68a4-44b5-9253-7037eb7ab12d tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:48.231700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1434b47c-68a4-44b5-9253-7037eb7ab12d tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:48.232476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1434b47c-68a4-44b5-9253-7037eb7ab12d tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:48.232907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1434b47c-68a4-44b5-9253-7037eb7ab12d tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:48.248084 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-1434b47c-68a4-44b5-9253-7037eb7ab12d tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] HTTP exception thrown: Instance 3922432a-d58f-4f0a-9471-5c8c210caa9e could not be found. Sep 07 12:29:48.249671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1434b47c-68a4-44b5-9253-7037eb7ab12d tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Request method failure captured: Sep 07 12:29:48.249671 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e HTTP/1.1 Sep 07 12:29:48.249671 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:29:48.249671 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:29:48.249671 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:29:48.249671 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:29:48.249671 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:29:48.249671 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:29:48.249671 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:29:48.249671 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:29:48.249671 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI6gXAXeHB2jFEW8ME-mV2LwuHdHFPNpK3VdOP5jlHpWUCp6joNViFaKZXrdPi6galQKiTKT7sjcY0dP85Oh7gkObRbEm508_kqGw4nIGRw2cDbMty8k2wMeTY5mIxqKaksTUG4FHo2xN2290jztY3K-J_SjXwONBiebfjCUx5yySUs Sep 07 12:29:48.249671 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:29:48.249671 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:29:48.249671 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:29:48.249671 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:29:48.249671 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:29:48.249671 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:29:48.249671 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 3d676a2aa1bf4032965482efdd697502 Sep 07 12:29:48.249671 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1022963101 Sep 07 12:29:48.249671 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:29:48.249671 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:29:48.250943 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d676a2aa1bf4032965482efdd697502"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3d676a2aa1bf4032965482efdd697502"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3d676a2aa1bf4032965482efdd697502"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d676a2aa1bf4032965482efdd697502"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:29:48.250943 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1022963101 Sep 07 12:29:48.250943 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 3d676a2aa1bf4032965482efdd697502 Sep 07 12:29:48.250943 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1022963101 Sep 07 12:29:48.250943 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerDiagnosticsNegativeTest-1022963101-project Sep 07 12:29:48.250943 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:29:48.250943 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:29:48.250943 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 4f867ffebff94e3785cbaf0dc19f518d Sep 07 12:29:48.250943 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1022963101-project Sep 07 12:29:48.250943 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:29:48.250943 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 3922432a-d58f-4f0a-9471-5c8c210caa9e could not be found. Sep 07 12:29:48.250943 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '3922432a-d58f-4f0a-9471-5c8c210caa9e'} Sep 07 12:29:48.251703 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:29:48.251703 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:48.251703 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:29:48.251703 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:29:48.251703 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:29:48.251703 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:29:48.251703 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:29:48.251703 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:29:48.251703 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:29:48.251703 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:29:48.251703 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3922432a-d58f-4f0a-9471-5c8c210caa9e could not be found. Sep 07 12:29:48.251703 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:48.251703 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:48.251703 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:48.251703 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:48.251703 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:48.251703 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:48.251703 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:29:48.251703 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:29:48.251703 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:29:48.252817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:29:48.252817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:29:48.252817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:29:48.252817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:29:48.252817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:29:48.252817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:29:48.252817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:29:48.252817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3922432a-d58f-4f0a-9471-5c8c210caa9e could not be found. Sep 07 12:29:48.252817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:48.252817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:29:48.252817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:48.252817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:29:48.252817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:29:48.252817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:29:48.252817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:29:48.252817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:29:48.252817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3922432a-d58f-4f0a-9471-5c8c210caa9e could not be found. Sep 07 12:29:48.252817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:29:48.253871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1434b47c-68a4-44b5-9253-7037eb7ab12d tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] Returning 404 to user: Instance 3922432a-d58f-4f0a-9471-5c8c210caa9e could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:29:48.253871 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1434b47c-68a4-44b5-9253-7037eb7ab12d tempest-ServerDiagnosticsNegativeTest-1022963101 tempest-ServerDiagnosticsNegativeTest-1022963101-project] 10.222.0.16 "GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e" status: 404 len: 111 microversion: 2.1 time: 0.033213 Sep 07 12:29:48.253871 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 227/475] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:48 2022] GET /compute/v2.1/servers/3922432a-d58f-4f0a-9471-5c8c210caa9e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:29:48.256480 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c965aff1-e3e5-4425-9668-213e6cb136c9 tempest-QuotasAdminTestJSON-340747746 tempest-QuotasAdminTestJSON-340747746-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/54638ceb8f7b403baf346d505566cf72" status: 200 len: 329 microversion: 2.1 time: 0.399546 Sep 07 12:29:48.265544 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 249/476] 10.222.0.16 () {60 vars in 1263 bytes} [Wed Sep 7 12:29:47 2022] PUT /compute/v2.1/os-quota-sets/54638ceb8f7b403baf346d505566cf72 => generated 329 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:48.265745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f39d9b5c-0eda-4c8d-95ff-7874e8c22a17 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:48.265869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e699ac64-8d64-4839-b167-94a40ca351c4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:48.265869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e699ac64-8d64-4839-b167-94a40ca351c4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:48.269774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e699ac64-8d64-4839-b167-94a40ca351c4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:48.270304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e699ac64-8d64-4839-b167-94a40ca351c4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:48.270759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e699ac64-8d64-4839-b167-94a40ca351c4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:48.271440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e699ac64-8d64-4839-b167-94a40ca351c4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:48.271925 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e699ac64-8d64-4839-b167-94a40ca351c4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:48.272304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e699ac64-8d64-4839-b167-94a40ca351c4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:48.283214 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f39d9b5c-0eda-4c8d-95ff-7874e8c22a17 tempest-FlavorsAccessNegativeTestJSON-1392180977 tempest-FlavorsAccessNegativeTestJSON-1392180977-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.030557 Sep 07 12:29:48.284138 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 228/477] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:29:48 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:48.444647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e699ac64-8d64-4839-b167-94a40ca351c4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:48.453174 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e699ac64-8d64-4839-b167-94a40ca351c4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1311 microversion: 2.1 time: 0.195050 Sep 07 12:29:48.453787 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 250/478] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:48 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1311 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:48.566195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-09df2dba-62c7-4a4c-b026-31eb1cd25ef7 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:48.567158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-09df2dba-62c7-4a4c-b026-31eb1cd25ef7 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:48.577609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09df2dba-62c7-4a4c-b026-31eb1cd25ef7 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:48.578456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09df2dba-62c7-4a4c-b026-31eb1cd25ef7 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:48.579102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09df2dba-62c7-4a4c-b026-31eb1cd25ef7 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:48.580362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09df2dba-62c7-4a4c-b026-31eb1cd25ef7 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:48.580981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09df2dba-62c7-4a4c-b026-31eb1cd25ef7 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:48.581525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09df2dba-62c7-4a4c-b026-31eb1cd25ef7 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:48.858418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-09df2dba-62c7-4a4c-b026-31eb1cd25ef7 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:48.870613 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-09df2dba-62c7-4a4c-b026-31eb1cd25ef7 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657" status: 200 len: 1318 microversion: 2.1 time: 0.308152 Sep 07 12:29:48.872250 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 229/479] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:48 2022] GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:48.880645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d5cf5a3a-f37e-494a-8ee6-4534894f2e79 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:48.881928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d5cf5a3a-f37e-494a-8ee6-4534894f2e79 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:48.889754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5cf5a3a-f37e-494a-8ee6-4534894f2e79 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:48.890621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5cf5a3a-f37e-494a-8ee6-4534894f2e79 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:48.891596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5cf5a3a-f37e-494a-8ee6-4534894f2e79 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:48.892739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5cf5a3a-f37e-494a-8ee6-4534894f2e79 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:48.893438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5cf5a3a-f37e-494a-8ee6-4534894f2e79 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:48.894255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5cf5a3a-f37e-494a-8ee6-4534894f2e79 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:48.992851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-954d0e7e-318f-4c54-9f28-0135a4c24031 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:48.994050 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-954d0e7e-318f-4c54-9f28-0135a4c24031 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 8ecbad38-98de-4c5d-b656-07e102181e62] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:49.006428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-954d0e7e-318f-4c54-9f28-0135a4c24031 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:49.007246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-954d0e7e-318f-4c54-9f28-0135a4c24031 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:49.008836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-954d0e7e-318f-4c54-9f28-0135a4c24031 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:49.013569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-954d0e7e-318f-4c54-9f28-0135a4c24031 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:49.015732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-954d0e7e-318f-4c54-9f28-0135a4c24031 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:49.018102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-954d0e7e-318f-4c54-9f28-0135a4c24031 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:49.531020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d5cf5a3a-f37e-494a-8ee6-4534894f2e79 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:49.539254 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d5cf5a3a-f37e-494a-8ee6-4534894f2e79 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1474 microversion: 2.1 time: 0.662889 Sep 07 12:29:49.552248 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 251/480] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:48 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1474 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:49.552248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8597b888-1dc1-4137-ad11-152a27865490 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:49.552248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8597b888-1dc1-4137-ad11-152a27865490 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:49.560913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8597b888-1dc1-4137-ad11-152a27865490 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:49.562039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8597b888-1dc1-4137-ad11-152a27865490 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:49.562751 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8597b888-1dc1-4137-ad11-152a27865490 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:49.563378 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8597b888-1dc1-4137-ad11-152a27865490 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:49.563850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8597b888-1dc1-4137-ad11-152a27865490 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:49.564278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8597b888-1dc1-4137-ad11-152a27865490 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:49.577306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-954d0e7e-318f-4c54-9f28-0135a4c24031 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:49.594286 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-954d0e7e-318f-4c54-9f28-0135a4c24031 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62" status: 200 len: 1322 microversion: 2.1 time: 0.607560 Sep 07 12:29:49.595908 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 230/481] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:48 2022] GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62 => generated 1322 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:29:49.846234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8597b888-1dc1-4137-ad11-152a27865490 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:49.861876 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8597b888-1dc1-4137-ad11-152a27865490 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1311 microversion: 2.1 time: 0.319695 Sep 07 12:29:49.863437 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 252/482] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:49 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1311 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:49.905697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7976de16-9f5b-42c3-bbaf-402db5ed7f2c tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:49.907139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7976de16-9f5b-42c3-bbaf-402db5ed7f2c tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:49.916521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7976de16-9f5b-42c3-bbaf-402db5ed7f2c tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:49.917327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7976de16-9f5b-42c3-bbaf-402db5ed7f2c tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:49.918005 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7976de16-9f5b-42c3-bbaf-402db5ed7f2c tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:49.919033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7976de16-9f5b-42c3-bbaf-402db5ed7f2c tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:49.919715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7976de16-9f5b-42c3-bbaf-402db5ed7f2c tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:49.920593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7976de16-9f5b-42c3-bbaf-402db5ed7f2c tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:50.122025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-7b0d6769-9f44-465c-a65e-4a64dc4c20fe req-2cdca277-c2fe-4b5c-b24f-377dc16891ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657", "tag": "bec29315-bf97-4789-9f2c-6e8ebb4250a5"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:50.148893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7976de16-9f5b-42c3-bbaf-402db5ed7f2c tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:50.156065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7b0d6769-9f44-465c-a65e-4a64dc4c20fe req-2cdca277-c2fe-4b5c-b24f-377dc16891ee service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:50.159892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7b0d6769-9f44-465c-a65e-4a64dc4c20fe req-2cdca277-c2fe-4b5c-b24f-377dc16891ee service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:50.161568 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7976de16-9f5b-42c3-bbaf-402db5ed7f2c tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657" status: 200 len: 1318 microversion: 2.1 time: 0.267485 Sep 07 12:29:50.161710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7b0d6769-9f44-465c-a65e-4a64dc4c20fe req-2cdca277-c2fe-4b5c-b24f-377dc16891ee service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:50.162813 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 231/483] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:49 2022] GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:50.185822 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7b0d6769-9f44-465c-a65e-4a64dc4c20fe req-2cdca277-c2fe-4b5c-b24f-377dc16891ee service nova] Creating event network-changed:bec29315-bf97-4789-9f2c-6e8ebb4250a5 for instance 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 on n-h1-852087-9 Sep 07 12:29:50.194143 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-7b0d6769-9f44-465c-a65e-4a64dc4c20fe req-2cdca277-c2fe-4b5c-b24f-377dc16891ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082474 Sep 07 12:29:50.195445 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 253/484] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:29:50.571844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-db9ba932-8cfd-4dc9-b99c-0d89fd282745 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:50.572462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-db9ba932-8cfd-4dc9-b99c-0d89fd282745 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:50.585195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db9ba932-8cfd-4dc9-b99c-0d89fd282745 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:50.585760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db9ba932-8cfd-4dc9-b99c-0d89fd282745 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:50.586445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db9ba932-8cfd-4dc9-b99c-0d89fd282745 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:50.587493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db9ba932-8cfd-4dc9-b99c-0d89fd282745 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:50.588103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db9ba932-8cfd-4dc9-b99c-0d89fd282745 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:50.588711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db9ba932-8cfd-4dc9-b99c-0d89fd282745 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:50.622417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8d83456c-759b-4b1b-8789-eac5ddcb8a22 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:50.623850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8d83456c-759b-4b1b-8789-eac5ddcb8a22 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 8ecbad38-98de-4c5d-b656-07e102181e62] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:50.643056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d83456c-759b-4b1b-8789-eac5ddcb8a22 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:50.643903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d83456c-759b-4b1b-8789-eac5ddcb8a22 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:50.644887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d83456c-759b-4b1b-8789-eac5ddcb8a22 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:50.645978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d83456c-759b-4b1b-8789-eac5ddcb8a22 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:50.646960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d83456c-759b-4b1b-8789-eac5ddcb8a22 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:50.647721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d83456c-759b-4b1b-8789-eac5ddcb8a22 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:50.983903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-db9ba932-8cfd-4dc9-b99c-0d89fd282745 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:50.994470 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-db9ba932-8cfd-4dc9-b99c-0d89fd282745 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1471 microversion: 2.1 time: 0.426840 Sep 07 12:29:50.995426 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 232/485] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:50 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1471 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:29:51.010308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8d83456c-759b-4b1b-8789-eac5ddcb8a22 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:51.029023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a9379c43-6a4e-448a-8a89-88de35ea67e6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:51.033225 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8d83456c-759b-4b1b-8789-eac5ddcb8a22 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62" status: 200 len: 1322 microversion: 2.1 time: 0.414712 Sep 07 12:29:51.036036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a9379c43-6a4e-448a-8a89-88de35ea67e6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:51.039309 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 254/486] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:50 2022] GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62 => generated 1322 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:29:51.059097 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9379c43-6a4e-448a-8a89-88de35ea67e6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:51.059803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ee10245-76ae-4cd4-b79a-2805041f93b3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:51.060906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6ee10245-76ae-4cd4-b79a-2805041f93b3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:51.066191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9379c43-6a4e-448a-8a89-88de35ea67e6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:51.066995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9379c43-6a4e-448a-8a89-88de35ea67e6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:51.068322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9379c43-6a4e-448a-8a89-88de35ea67e6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:51.069145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9379c43-6a4e-448a-8a89-88de35ea67e6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:51.069949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9379c43-6a4e-448a-8a89-88de35ea67e6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:51.083017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ee10245-76ae-4cd4-b79a-2805041f93b3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:51.087312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ee10245-76ae-4cd4-b79a-2805041f93b3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:51.089030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ee10245-76ae-4cd4-b79a-2805041f93b3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:51.093951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ee10245-76ae-4cd4-b79a-2805041f93b3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:51.106186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ee10245-76ae-4cd4-b79a-2805041f93b3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:51.107289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ee10245-76ae-4cd4-b79a-2805041f93b3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:51.278809 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6ee10245-76ae-4cd4-b79a-2805041f93b3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "POST /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a/action" status: 204 len: 0 microversion: 2.1 time: 0.234907 Sep 07 12:29:51.283183 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 255/487] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:29:51 2022] POST /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a/action => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:29:51.315187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aa6a64a4-cca5-40eb-9282-1286234d7a68 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:51.317133 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aa6a64a4-cca5-40eb-9282-1286234d7a68 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:51.337051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa6a64a4-cca5-40eb-9282-1286234d7a68 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:51.343385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa6a64a4-cca5-40eb-9282-1286234d7a68 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:51.345789 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa6a64a4-cca5-40eb-9282-1286234d7a68 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:51.348908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa6a64a4-cca5-40eb-9282-1286234d7a68 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:51.350384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa6a64a4-cca5-40eb-9282-1286234d7a68 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:51.352758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa6a64a4-cca5-40eb-9282-1286234d7a68 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:51.561831 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a9379c43-6a4e-448a-8a89-88de35ea67e6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:51.571893 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a9379c43-6a4e-448a-8a89-88de35ea67e6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1311 microversion: 2.1 time: 0.557965 Sep 07 12:29:51.578409 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 233/488] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:51 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1311 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:51.591955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-19fab5ae-126b-4911-b3a9-d17341ee527b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:51.595224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-19fab5ae-126b-4911-b3a9-d17341ee527b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:51.613046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19fab5ae-126b-4911-b3a9-d17341ee527b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:51.613590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19fab5ae-126b-4911-b3a9-d17341ee527b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:51.614037 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19fab5ae-126b-4911-b3a9-d17341ee527b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:51.614792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19fab5ae-126b-4911-b3a9-d17341ee527b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:51.615266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19fab5ae-126b-4911-b3a9-d17341ee527b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:51.615702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19fab5ae-126b-4911-b3a9-d17341ee527b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:52.178865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aa6a64a4-cca5-40eb-9282-1286234d7a68 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:52.185208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:52.188222 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aa6a64a4-cca5-40eb-9282-1286234d7a68 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657" status: 200 len: 1318 microversion: 2.1 time: 0.900923 Sep 07 12:29:52.201519 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 256/489] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:51 2022] GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 => generated 1318 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:52.214575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-4f8cea54-8e0f-4f10-9b59-6a65780023cd req-591626bd-a89c-44bd-808c-bc2c80233a26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc8c1c2b-eb55-4361-bcd7-e66c270b827a", "name": "network-vif-plugged", "status": "completed", "tag": "1e24dd2e-9faf-4586-ae6b-48d1499917fe"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:52.238432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4f8cea54-8e0f-4f10-9b59-6a65780023cd req-591626bd-a89c-44bd-808c-bc2c80233a26 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:52.242251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4f8cea54-8e0f-4f10-9b59-6a65780023cd req-591626bd-a89c-44bd-808c-bc2c80233a26 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:52.243165 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4f8cea54-8e0f-4f10-9b59-6a65780023cd req-591626bd-a89c-44bd-808c-bc2c80233a26 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:52.287056 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-4f8cea54-8e0f-4f10-9b59-6a65780023cd req-591626bd-a89c-44bd-808c-bc2c80233a26 service nova] Creating event network-vif-plugged:1e24dd2e-9faf-4586-ae6b-48d1499917fe for instance fc8c1c2b-eb55-4361-bcd7-e66c270b827a on n-h1-852087-9 Sep 07 12:29:52.295478 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-4f8cea54-8e0f-4f10-9b59-6a65780023cd req-591626bd-a89c-44bd-808c-bc2c80233a26 service nova] Instance fc8c1c2b-eb55-4361-bcd7-e66c270b827a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 12:29:52.314212 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-4f8cea54-8e0f-4f10-9b59-6a65780023cd req-591626bd-a89c-44bd-808c-bc2c80233a26 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123336 Sep 07 12:29:52.315635 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 257/490] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:52.323603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-067ce5da-c834-4380-94b7-07c132c502e6 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:52.324775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-067ce5da-c834-4380-94b7-07c132c502e6 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 8ecbad38-98de-4c5d-b656-07e102181e62] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:52.333166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-067ce5da-c834-4380-94b7-07c132c502e6 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:52.334101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-067ce5da-c834-4380-94b7-07c132c502e6 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:52.334851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-067ce5da-c834-4380-94b7-07c132c502e6 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:52.335958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-067ce5da-c834-4380-94b7-07c132c502e6 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:52.336891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-067ce5da-c834-4380-94b7-07c132c502e6 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:52.337864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-067ce5da-c834-4380-94b7-07c132c502e6 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:52.384744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-19fab5ae-126b-4911-b3a9-d17341ee527b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:52.395357 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-19fab5ae-126b-4911-b3a9-d17341ee527b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1471 microversion: 2.1 time: 0.812431 Sep 07 12:29:52.396859 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 234/491] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:51 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1471 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:52.537388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-067ce5da-c834-4380-94b7-07c132c502e6 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:52.547346 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-067ce5da-c834-4380-94b7-07c132c502e6 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62" status: 200 len: 1322 microversion: 2.1 time: 0.229894 Sep 07 12:29:52.548680 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 258/492] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:52 2022] GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:52.607075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-745fca13-f4be-4441-8c5a-555809049234 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:52.608813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-745fca13-f4be-4441-8c5a-555809049234 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:52.620910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-745fca13-f4be-4441-8c5a-555809049234 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:52.620910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-745fca13-f4be-4441-8c5a-555809049234 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:52.621320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-745fca13-f4be-4441-8c5a-555809049234 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:52.625061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-745fca13-f4be-4441-8c5a-555809049234 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:52.625565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-745fca13-f4be-4441-8c5a-555809049234 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:52.626103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-745fca13-f4be-4441-8c5a-555809049234 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:52.865199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-745fca13-f4be-4441-8c5a-555809049234 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:52.875505 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-745fca13-f4be-4441-8c5a-555809049234 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1494 microversion: 2.1 time: 0.271655 Sep 07 12:29:52.876307 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 235/493] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:52 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1494 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:29:52.907750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-69fbd1d2-1d2e-437f-aaef-c948ab0ab3ef tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:52.909047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-69fbd1d2-1d2e-437f-aaef-c948ab0ab3ef tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:52.918274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69fbd1d2-1d2e-437f-aaef-c948ab0ab3ef tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:52.928988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69fbd1d2-1d2e-437f-aaef-c948ab0ab3ef tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:52.929629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69fbd1d2-1d2e-437f-aaef-c948ab0ab3ef tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:52.931989 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69fbd1d2-1d2e-437f-aaef-c948ab0ab3ef tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:52.934362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69fbd1d2-1d2e-437f-aaef-c948ab0ab3ef tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:52.935681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69fbd1d2-1d2e-437f-aaef-c948ab0ab3ef tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:53.216901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8473f925-de2d-4b74-af9c-4018706e22f1 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:53.217633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8473f925-de2d-4b74-af9c-4018706e22f1 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:53.226854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8473f925-de2d-4b74-af9c-4018706e22f1 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:53.228987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8473f925-de2d-4b74-af9c-4018706e22f1 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:53.229795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8473f925-de2d-4b74-af9c-4018706e22f1 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:53.230800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8473f925-de2d-4b74-af9c-4018706e22f1 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:53.231449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8473f925-de2d-4b74-af9c-4018706e22f1 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:53.232081 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8473f925-de2d-4b74-af9c-4018706e22f1 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:53.326091 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-69fbd1d2-1d2e-437f-aaef-c948ab0ab3ef tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1645 microversion: 2.1 time: 0.422426 Sep 07 12:29:53.329650 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 259/494] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:52 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1645 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:53.360765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a644a604-c3c9-4df0-8fa8-8f3876d2edb9 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:53.365316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a644a604-c3c9-4df0-8fa8-8f3876d2edb9 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:53.392186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a644a604-c3c9-4df0-8fa8-8f3876d2edb9 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:53.393855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a644a604-c3c9-4df0-8fa8-8f3876d2edb9 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:53.394994 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a644a604-c3c9-4df0-8fa8-8f3876d2edb9 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:53.396669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a644a604-c3c9-4df0-8fa8-8f3876d2edb9 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:53.397911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a644a604-c3c9-4df0-8fa8-8f3876d2edb9 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:53.399515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a644a604-c3c9-4df0-8fa8-8f3876d2edb9 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:53.645660 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8473f925-de2d-4b74-af9c-4018706e22f1 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:53.655956 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8473f925-de2d-4b74-af9c-4018706e22f1 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657" status: 200 len: 1318 microversion: 2.1 time: 0.444014 Sep 07 12:29:53.673559 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 236/495] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:53 2022] GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 => generated 1318 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:29:53.673559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c15f67fa-f164-43c5-8d78-18be9ba5e333 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:53.673559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c15f67fa-f164-43c5-8d78-18be9ba5e333 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:53.676244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c15f67fa-f164-43c5-8d78-18be9ba5e333 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:53.677135 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c15f67fa-f164-43c5-8d78-18be9ba5e333 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:53.677716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c15f67fa-f164-43c5-8d78-18be9ba5e333 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:53.678883 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c15f67fa-f164-43c5-8d78-18be9ba5e333 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:53.679474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c15f67fa-f164-43c5-8d78-18be9ba5e333 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:53.679982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c15f67fa-f164-43c5-8d78-18be9ba5e333 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:53.753110 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a644a604-c3c9-4df0-8fa8-8f3876d2edb9 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1645 microversion: 2.1 time: 0.406446 Sep 07 12:29:53.753691 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 260/496] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:53 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1645 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:53.758180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f71f8e12-05f7-4b6b-b236-a4c18563108f tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:53.758866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f71f8e12-05f7-4b6b-b236-a4c18563108f tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 8ecbad38-98de-4c5d-b656-07e102181e62] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:53.779354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f71f8e12-05f7-4b6b-b236-a4c18563108f tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:53.780180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f71f8e12-05f7-4b6b-b236-a4c18563108f tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:53.785410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f71f8e12-05f7-4b6b-b236-a4c18563108f tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:53.786531 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f71f8e12-05f7-4b6b-b236-a4c18563108f tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:53.787215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f71f8e12-05f7-4b6b-b236-a4c18563108f tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:53.787654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f71f8e12-05f7-4b6b-b236-a4c18563108f tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:53.941333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c15f67fa-f164-43c5-8d78-18be9ba5e333 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:53.963453 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c15f67fa-f164-43c5-8d78-18be9ba5e333 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1471 microversion: 2.1 time: 0.299304 Sep 07 12:29:53.964717 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 237/497] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:53 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1471 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:53.974139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-068833f0-1a0d-4db2-afc5-074b5c1a97d5 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:53.983019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-068833f0-1a0d-4db2-afc5-074b5c1a97d5 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:53.984301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-068833f0-1a0d-4db2-afc5-074b5c1a97d5 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:53.985104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-068833f0-1a0d-4db2-afc5-074b5c1a97d5 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:53.986805 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-068833f0-1a0d-4db2-afc5-074b5c1a97d5 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:53.987918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-068833f0-1a0d-4db2-afc5-074b5c1a97d5 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:53.988929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-068833f0-1a0d-4db2-afc5-074b5c1a97d5 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:54.012007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f71f8e12-05f7-4b6b-b236-a4c18563108f tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:54.020361 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f71f8e12-05f7-4b6b-b236-a4c18563108f tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62" status: 200 len: 1322 microversion: 2.1 time: 0.265649 Sep 07 12:29:54.022566 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 261/498] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:53 2022] GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:54.043159 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-068833f0-1a0d-4db2-afc5-074b5c1a97d5 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.076222 Sep 07 12:29:54.045678 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 238/499] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Sep 7 12:29:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:54.060146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-33dad808-b4e3-4cce-8e2e-526249f001c4 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:54.061911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-33dad808-b4e3-4cce-8e2e-526249f001c4 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:54.070611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33dad808-b4e3-4cce-8e2e-526249f001c4 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:54.071181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33dad808-b4e3-4cce-8e2e-526249f001c4 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:54.071774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33dad808-b4e3-4cce-8e2e-526249f001c4 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:54.072476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33dad808-b4e3-4cce-8e2e-526249f001c4 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:54.072930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33dad808-b4e3-4cce-8e2e-526249f001c4 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:54.073348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33dad808-b4e3-4cce-8e2e-526249f001c4 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:54.193115 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-33dad808-b4e3-4cce-8e2e-526249f001c4 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e/action" status: 202 len: 0 microversion: 2.1 time: 0.138229 Sep 07 12:29:54.194299 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 262/500] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:29:54 2022] POST /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:29:54.209706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ee08c70f-98da-47f2-9d6b-5d507b8d1ab8 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:54.211239 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ee08c70f-98da-47f2-9d6b-5d507b8d1ab8 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:54.222344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee08c70f-98da-47f2-9d6b-5d507b8d1ab8 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:54.223233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee08c70f-98da-47f2-9d6b-5d507b8d1ab8 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:54.224326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee08c70f-98da-47f2-9d6b-5d507b8d1ab8 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:54.225649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee08c70f-98da-47f2-9d6b-5d507b8d1ab8 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:54.226497 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee08c70f-98da-47f2-9d6b-5d507b8d1ab8 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:54.227341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee08c70f-98da-47f2-9d6b-5d507b8d1ab8 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:54.423700 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ee08c70f-98da-47f2-9d6b-5d507b8d1ab8 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1650 microversion: 2.1 time: 0.221053 Sep 07 12:29:54.424359 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 239/501] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:54 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1650 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:54.686131 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f2a60919-5c9d-4967-a964-fffe1afd7b30 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:54.686776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f2a60919-5c9d-4967-a964-fffe1afd7b30 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:54.697815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2a60919-5c9d-4967-a964-fffe1afd7b30 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:54.698669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2a60919-5c9d-4967-a964-fffe1afd7b30 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:54.699193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2a60919-5c9d-4967-a964-fffe1afd7b30 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:54.699998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2a60919-5c9d-4967-a964-fffe1afd7b30 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:54.700540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2a60919-5c9d-4967-a964-fffe1afd7b30 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:54.701078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2a60919-5c9d-4967-a964-fffe1afd7b30 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:54.889078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f2a60919-5c9d-4967-a964-fffe1afd7b30 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:54.908616 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f2a60919-5c9d-4967-a964-fffe1afd7b30 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657" status: 200 len: 1318 microversion: 2.1 time: 0.227252 Sep 07 12:29:54.909318 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 240/502] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:54 2022] GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:54.961602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e6f2fd92-cc50-4b26-8e4c-eceeb045da37 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1653518065", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": "none"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:54.995816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-36b84441-68a9-47a4-9bbf-e1f620d9ae91 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:54.998059 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-36b84441-68a9-47a4-9bbf-e1f620d9ae91 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:55.006579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36b84441-68a9-47a4-9bbf-e1f620d9ae91 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:55.012592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36b84441-68a9-47a4-9bbf-e1f620d9ae91 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:55.012592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36b84441-68a9-47a4-9bbf-e1f620d9ae91 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:55.012592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36b84441-68a9-47a4-9bbf-e1f620d9ae91 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:55.012592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36b84441-68a9-47a4-9bbf-e1f620d9ae91 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:55.012964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36b84441-68a9-47a4-9bbf-e1f620d9ae91 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:55.040365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e6f2fd92-cc50-4b26-8e4c-eceeb045da37 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:29:55.041237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e6f2fd92-cc50-4b26-8e4c-eceeb045da37 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:29:55.042039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e6f2fd92-cc50-4b26-8e4c-eceeb045da37 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:29:55.042638 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e6f2fd92-cc50-4b26-8e4c-eceeb045da37 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:29:55.043354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e6f2fd92-cc50-4b26-8e4c-eceeb045da37 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:29:55.051317 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=75 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:55.055401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6f2fd92-cc50-4b26-8e4c-eceeb045da37 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:55.055933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6f2fd92-cc50-4b26-8e4c-eceeb045da37 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:55.056474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6f2fd92-cc50-4b26-8e4c-eceeb045da37 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:55.057270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6f2fd92-cc50-4b26-8e4c-eceeb045da37 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:55.057963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6f2fd92-cc50-4b26-8e4c-eceeb045da37 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:55.058557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6f2fd92-cc50-4b26-8e4c-eceeb045da37 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:55.073500 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=14,nova_api:UPDATE=14 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:55.085344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-e6f2fd92-cc50-4b26-8e4c-eceeb045da37 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Getting quotas for project a211dad35e6f4610a329a0f481373807. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:29:55.094090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-e6f2fd92-cc50-4b26-8e4c-eceeb045da37 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Getting quotas for user b04a91795e984d1795d27bd654eedf5d and project a211dad35e6f4610a329a0f481373807. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:29:55.112381 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e6f2fd92-cc50-4b26-8e4c-eceeb045da37 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:29:55.118336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e6f2fd92-cc50-4b26-8e4c-eceeb045da37 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:29:55.181128 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e6f2fd92-cc50-4b26-8e4c-eceeb045da37 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.655441 Sep 07 12:29:55.182572 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 263/503] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Sep 7 12:29:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 12:29:55.187613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-70933fbf-b404-42d8-8994-f330d4a9cb69 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:55.189279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-70933fbf-b404-42d8-8994-f330d4a9cb69 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 8ecbad38-98de-4c5d-b656-07e102181e62] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:55.196841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70933fbf-b404-42d8-8994-f330d4a9cb69 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:55.197348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70933fbf-b404-42d8-8994-f330d4a9cb69 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:55.197817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70933fbf-b404-42d8-8994-f330d4a9cb69 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:55.198529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70933fbf-b404-42d8-8994-f330d4a9cb69 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:55.198983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70933fbf-b404-42d8-8994-f330d4a9cb69 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:55.199404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70933fbf-b404-42d8-8994-f330d4a9cb69 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:55.252702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-36b84441-68a9-47a4-9bbf-e1f620d9ae91 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:55.267227 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-36b84441-68a9-47a4-9bbf-e1f620d9ae91 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1463 microversion: 2.1 time: 0.280828 Sep 07 12:29:55.267829 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 241/504] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:54 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1463 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:29:55.290337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6b039e32-534b-46c5-98a5-1d90f79ca184 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:55.294603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6b039e32-534b-46c5-98a5-1d90f79ca184 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:55.413018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-70933fbf-b404-42d8-8994-f330d4a9cb69 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:55.423747 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-70933fbf-b404-42d8-8994-f330d4a9cb69 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62" status: 200 len: 1322 microversion: 2.1 time: 0.237590 Sep 07 12:29:55.424819 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 264/505] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:55 2022] GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:55.441871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2caed9ac-6502-4aef-a15c-e3df4a0e2590 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:55.442590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2caed9ac-6502-4aef-a15c-e3df4a0e2590 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:55.451927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6b039e32-534b-46c5-98a5-1d90f79ca184 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:55.453231 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2caed9ac-6502-4aef-a15c-e3df4a0e2590 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:55.453718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2caed9ac-6502-4aef-a15c-e3df4a0e2590 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:55.454157 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2caed9ac-6502-4aef-a15c-e3df4a0e2590 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:55.455187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2caed9ac-6502-4aef-a15c-e3df4a0e2590 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:55.455733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2caed9ac-6502-4aef-a15c-e3df4a0e2590 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:55.456049 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2caed9ac-6502-4aef-a15c-e3df4a0e2590 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:55.457065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=85 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:55.466821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6b039e32-534b-46c5-98a5-1d90f79ca184 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:55.469445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6b039e32-534b-46c5-98a5-1d90f79ca184 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:55.481821 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6b039e32-534b-46c5-98a5-1d90f79ca184 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "PUT /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1359 microversion: 2.75 time: 0.205022 Sep 07 12:29:55.483066 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 242/506] 10.222.0.16 () {62 vars in 1297 bytes} [Wed Sep 7 12:29:55 2022] PUT /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1359 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:29:55.493240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8299daef-7c97-4dd9-abba-6f303604ece1 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:55.495910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8299daef-7c97-4dd9-abba-6f303604ece1 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:55.524727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8299daef-7c97-4dd9-abba-6f303604ece1 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:55.525641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8299daef-7c97-4dd9-abba-6f303604ece1 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:55.526146 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8299daef-7c97-4dd9-abba-6f303604ece1 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:55.526958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8299daef-7c97-4dd9-abba-6f303604ece1 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:55.527361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8299daef-7c97-4dd9-abba-6f303604ece1 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:55.527832 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8299daef-7c97-4dd9-abba-6f303604ece1 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:55.706496 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2caed9ac-6502-4aef-a15c-e3df4a0e2590 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1614 microversion: 2.1 time: 0.278124 Sep 07 12:29:55.710841 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 265/507] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:55 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1614 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:55.721157 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d95dfcbc-a90e-45d1-b2af-39f9b71fb9b6 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:55.722149 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d95dfcbc-a90e-45d1-b2af-39f9b71fb9b6 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:55.789928 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8299daef-7c97-4dd9-abba-6f303604ece1 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1650 microversion: 2.1 time: 0.304536 Sep 07 12:29:55.790448 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 243/508] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:55 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1650 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:55.802311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-478a8dac-4db3-411a-98d7-a3c973c58694 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Calling method '.version_select at 0x7fc419c510d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:55.805722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d95dfcbc-a90e-45d1-b2af-39f9b71fb9b6 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:55.809327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-478a8dac-4db3-411a-98d7-a3c973c58694 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:55.809865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-478a8dac-4db3-411a-98d7-a3c973c58694 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:55.810303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-478a8dac-4db3-411a-98d7-a3c973c58694 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:55.815112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d95dfcbc-a90e-45d1-b2af-39f9b71fb9b6 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:55.816819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d95dfcbc-a90e-45d1-b2af-39f9b71fb9b6 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:55.821558 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-478a8dac-4db3-411a-98d7-a3c973c58694 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.028333 Sep 07 12:29:55.822166 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 244/509] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Sep 7 12:29:55 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:29:55.833695 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d95dfcbc-a90e-45d1-b2af-39f9b71fb9b6 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1359 microversion: 2.75 time: 0.117609 Sep 07 12:29:55.844909 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 266/510] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:29:55 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1359 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:29:55.931886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a0480f9e-b6c2-47d7-a9e5-35cb6428dfa9 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:55.932505 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a0480f9e-b6c2-47d7-a9e5-35cb6428dfa9 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:55.941136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0480f9e-b6c2-47d7-a9e5-35cb6428dfa9 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:55.941767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0480f9e-b6c2-47d7-a9e5-35cb6428dfa9 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:55.942629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0480f9e-b6c2-47d7-a9e5-35cb6428dfa9 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:55.943335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0480f9e-b6c2-47d7-a9e5-35cb6428dfa9 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:55.943793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0480f9e-b6c2-47d7-a9e5-35cb6428dfa9 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:55.944228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0480f9e-b6c2-47d7-a9e5-35cb6428dfa9 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:56.022858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e7cf10b8-c028-430f-b069-bc7410827aa6 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Action: 'update', calling method: .version_select at 0x7fc4197633a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:56.101733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a0480f9e-b6c2-47d7-a9e5-35cb6428dfa9 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:56.112531 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a0480f9e-b6c2-47d7-a9e5-35cb6428dfa9 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657" status: 200 len: 1318 microversion: 2.1 time: 0.184486 Sep 07 12:29:56.113146 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 267/511] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:55 2022] GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:29:56.118143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cdb7b863-a56f-4362-b44c-bedd96149ffc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1353225227", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:56.175050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-cdb7b863-a56f-4362-b44c-bedd96149ffc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:29:56.248088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7cf10b8-c028-430f-b069-bc7410827aa6 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:56.248571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7cf10b8-c028-430f-b069-bc7410827aa6 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:56.249128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7cf10b8-c028-430f-b069-bc7410827aa6 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:56.250101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7cf10b8-c028-430f-b069-bc7410827aa6 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:56.250701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7cf10b8-c028-430f-b069-bc7410827aa6 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:56.251271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7cf10b8-c028-430f-b069-bc7410827aa6 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:56.301109 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e7cf10b8-c028-430f-b069-bc7410827aa6 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/cc412f1212ea4226bddfc2d8bf140f42" status: 200 len: 240 microversion: 2.36 time: 0.466000 Sep 07 12:29:56.302435 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 245/512] 10.222.0.16 () {62 vars in 1303 bytes} [Wed Sep 7 12:29:55 2022] PUT /compute/v2.1/os-quota-sets/cc412f1212ea4226bddfc2d8bf140f42 => generated 240 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:29:56.360374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0fddec39-cb97-44ed-9ef9-aa6ee0ed10ea tempest-FlavorsV255TestJSON-812673031 tempest-FlavorsV255TestJSON-812673031-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1941715342", "id": 1040882007, "os-flavor-access:is_public": "True"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:56.366030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=89,nova_api:DELETE=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:56.381077 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0fddec39-cb97-44ed-9ef9-aa6ee0ed10ea tempest-FlavorsV255TestJSON-812673031 tempest-FlavorsV255TestJSON-812673031-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.077028 Sep 07 12:29:56.382008 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 246/513] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Sep 7 12:29:56 2022] POST /compute/v2.1/flavors => generated 449 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:29:56.386779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8aee1608-8688-4563-9529-3a309c9f3812 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Calling method '.version_select at 0x7fc41968daf0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:56.421083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cdb7b863-a56f-4362-b44c-bedd96149ffc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:29:56.421866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cdb7b863-a56f-4362-b44c-bedd96149ffc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:29:56.422395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cdb7b863-a56f-4362-b44c-bedd96149ffc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:29:56.423105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cdb7b863-a56f-4362-b44c-bedd96149ffc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:29:56.423665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cdb7b863-a56f-4362-b44c-bedd96149ffc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:29:56.434010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdb7b863-a56f-4362-b44c-bedd96149ffc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:56.434568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdb7b863-a56f-4362-b44c-bedd96149ffc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:56.435006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdb7b863-a56f-4362-b44c-bedd96149ffc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:56.435720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdb7b863-a56f-4362-b44c-bedd96149ffc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:56.436214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdb7b863-a56f-4362-b44c-bedd96149ffc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:56.436633 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdb7b863-a56f-4362-b44c-bedd96149ffc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:56.455425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8aee1608-8688-4563-9529-3a309c9f3812 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:56.455765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8aee1608-8688-4563-9529-3a309c9f3812 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:56.456207 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8aee1608-8688-4563-9529-3a309c9f3812 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:56.456929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8aee1608-8688-4563-9529-3a309c9f3812 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:56.457439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8aee1608-8688-4563-9529-3a309c9f3812 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:56.457833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8aee1608-8688-4563-9529-3a309c9f3812 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:56.459205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-cdb7b863-a56f-4362-b44c-bedd96149ffc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Getting quotas for project 43a1115550de4c5185de7ca86bc17a63. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:29:56.463484 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-cdb7b863-a56f-4362-b44c-bedd96149ffc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Getting quotas for user 1b5c31587a37465a9becda30e417ed5b and project 43a1115550de4c5185de7ca86bc17a63. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:29:56.465641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:56.481300 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8aee1608-8688-4563-9529-3a309c9f3812 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/cc412f1212ea4226bddfc2d8bf140f42/detail" status: 200 len: 672 microversion: 2.36 time: 0.098201 Sep 07 12:29:56.481945 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 247/514] 10.222.0.16 () {60 vars in 1304 bytes} [Wed Sep 7 12:29:56 2022] GET /compute/v2.1/os-quota-sets/cc412f1212ea4226bddfc2d8bf140f42/detail => generated 672 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:29:56.493963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cdb7b863-a56f-4362-b44c-bedd96149ffc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:29:56.497317 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cdb7b863-a56f-4362-b44c-bedd96149ffc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:29:56.547824 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cdb7b863-a56f-4362-b44c-bedd96149ffc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.433370 Sep 07 12:29:56.549169 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 268/515] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:29:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 435 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:29:56.559910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-74fe782a-5463-4c6e-90b3-f8a4d9ec2181 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:56.560789 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-74fe782a-5463-4c6e-90b3-f8a4d9ec2181 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 8ecbad38-98de-4c5d-b656-07e102181e62] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:56.568483 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74fe782a-5463-4c6e-90b3-f8a4d9ec2181 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:56.570523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74fe782a-5463-4c6e-90b3-f8a4d9ec2181 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:56.571708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74fe782a-5463-4c6e-90b3-f8a4d9ec2181 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:56.573071 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74fe782a-5463-4c6e-90b3-f8a4d9ec2181 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:56.573840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74fe782a-5463-4c6e-90b3-f8a4d9ec2181 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:56.574454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74fe782a-5463-4c6e-90b3-f8a4d9ec2181 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:56.600533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e44be494-9fcd-4438-aeaa-52b2b7982571 tempest-FlavorsV255TestJSON-624862310 tempest-FlavorsV255TestJSON-624862310-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:56.615220 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e44be494-9fcd-4438-aeaa-52b2b7982571 tempest-FlavorsV255TestJSON-624862310 tempest-FlavorsV255TestJSON-624862310-project] 10.222.0.16 "GET /compute/v2.1/flavors/1040882007" status: 200 len: 449 microversion: 2.55 time: 0.130324 Sep 07 12:29:56.615813 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 248/516] 10.222.0.16 () {60 vars in 1199 bytes} [Wed Sep 7 12:29:56 2022] GET /compute/v2.1/flavors/1040882007 => generated 449 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:29:56.625011 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6a961e95-ae1c-4e50-9b01-66069afa1b60 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:56.625669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6a961e95-ae1c-4e50-9b01-66069afa1b60 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:56.699802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6a961e95-ae1c-4e50-9b01-66069afa1b60 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:56.708159 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6a961e95-ae1c-4e50-9b01-66069afa1b60 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1213 microversion: 2.1 time: 0.091307 Sep 07 12:29:56.708840 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 249/517] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:56 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:56.726550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-961e4e94-864d-448b-9103-3f710652ca2e tempest-FlavorsV255TestJSON-812673031 tempest-FlavorsV255TestJSON-812673031-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:56.755830 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-961e4e94-864d-448b-9103-3f710652ca2e tempest-FlavorsV255TestJSON-812673031 tempest-FlavorsV255TestJSON-812673031-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1040882007" status: 200 len: 450 microversion: 2.55 time: 0.033913 Sep 07 12:29:56.756611 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 250/518] 10.222.0.16 () {62 vars in 1219 bytes} [Wed Sep 7 12:29:56 2022] PUT /compute/v2.1/flavors/1040882007 => generated 450 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:29:56.766601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-74fe782a-5463-4c6e-90b3-f8a4d9ec2181 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:56.768208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d5960793-f746-42d1-b887-482959675d65 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Action: 'update', calling method: .version_select at 0x7fc419795820>, body: {"quota_set": {"ram": "2048"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:56.775626 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-74fe782a-5463-4c6e-90b3-f8a4d9ec2181 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62" status: 200 len: 1322 microversion: 2.1 time: 0.225185 Sep 07 12:29:56.776207 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 269/519] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:56 2022] GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:56.781125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-538369f7-b44f-4485-907a-fb70228357e8 tempest-FlavorsV255TestJSON-624862310 tempest-FlavorsV255TestJSON-624862310-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:56.805744 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-538369f7-b44f-4485-907a-fb70228357e8 tempest-FlavorsV255TestJSON-624862310 tempest-FlavorsV255TestJSON-624862310-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6591 microversion: 2.55 time: 0.028137 Sep 07 12:29:56.806349 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 270/520] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Sep 7 12:29:56 2022] GET /compute/v2.1/flavors/detail => generated 6591 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:29:56.814118 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ecf55a7-f2d9-4e87-aea8-32c02dfa7996 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:56.814768 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6ecf55a7-f2d9-4e87-aea8-32c02dfa7996 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:56.824710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ecf55a7-f2d9-4e87-aea8-32c02dfa7996 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:56.825081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ecf55a7-f2d9-4e87-aea8-32c02dfa7996 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:56.825760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ecf55a7-f2d9-4e87-aea8-32c02dfa7996 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:56.827247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ecf55a7-f2d9-4e87-aea8-32c02dfa7996 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:56.827833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ecf55a7-f2d9-4e87-aea8-32c02dfa7996 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:56.828264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ecf55a7-f2d9-4e87-aea8-32c02dfa7996 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:56.869725 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5960793-f746-42d1-b887-482959675d65 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:56.870909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5960793-f746-42d1-b887-482959675d65 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:56.871930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5960793-f746-42d1-b887-482959675d65 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:56.873207 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5960793-f746-42d1-b887-482959675d65 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:56.873710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5960793-f746-42d1-b887-482959675d65 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:56.875085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5960793-f746-42d1-b887-482959675d65 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:56.919031 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5960793-f746-42d1-b887-482959675d65 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:56.919528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5960793-f746-42d1-b887-482959675d65 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:56.919969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5960793-f746-42d1-b887-482959675d65 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:56.920720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5960793-f746-42d1-b887-482959675d65 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:56.921188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5960793-f746-42d1-b887-482959675d65 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:56.921827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5960793-f746-42d1-b887-482959675d65 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:56.987494 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d5960793-f746-42d1-b887-482959675d65 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/cc412f1212ea4226bddfc2d8bf140f42?user_id=c6aa9fa2abb8452ebd08c99a1911197c" status: 200 len: 240 microversion: 2.36 time: 0.229896 Sep 07 12:29:56.988139 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 251/521] 10.222.0.16 () {62 vars in 1384 bytes} [Wed Sep 7 12:29:56 2022] PUT /compute/v2.1/os-quota-sets/cc412f1212ea4226bddfc2d8bf140f42?user_id=c6aa9fa2abb8452ebd08c99a1911197c => generated 240 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:29:56.992988 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-67116fe3-9c17-4931-b6a9-ba277116cc56 tempest-FlavorsV255TestJSON-624862310 tempest-FlavorsV255TestJSON-624862310-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:56.993158 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6ecf55a7-f2d9-4e87-aea8-32c02dfa7996 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1650 microversion: 2.1 time: 0.181579 Sep 07 12:29:56.994633 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 271/522] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:56 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1650 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:56.999535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e222fe7e-848c-4ffd-a301-0ab1dd42d571 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:57.000964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e222fe7e-848c-4ffd-a301-0ab1dd42d571 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:57.009296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e222fe7e-848c-4ffd-a301-0ab1dd42d571 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:57.009889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e222fe7e-848c-4ffd-a301-0ab1dd42d571 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:57.010325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e222fe7e-848c-4ffd-a301-0ab1dd42d571 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:57.013462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e222fe7e-848c-4ffd-a301-0ab1dd42d571 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:57.014038 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e222fe7e-848c-4ffd-a301-0ab1dd42d571 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:57.014667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e222fe7e-848c-4ffd-a301-0ab1dd42d571 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:57.018557 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-67116fe3-9c17-4931-b6a9-ba277116cc56 tempest-FlavorsV255TestJSON-624862310 tempest-FlavorsV255TestJSON-624862310-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3681 microversion: 2.55 time: 0.029298 Sep 07 12:29:57.031343 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 252/523] 10.222.0.16 () {60 vars in 1166 bytes} [Wed Sep 7 12:29:56 2022] GET /compute/v2.1/flavors => generated 3681 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:29:57.031343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-27dc960d-f801-4ab5-afcb-9752dafb1cc7 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] Calling method '.version_select at 0x7fc419ca63a0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:57.126950 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-27dc960d-f801-4ab5-afcb-9752dafb1cc7 tempest-QuotasAdminTestV236-124582305 tempest-QuotasAdminTestV236-124582305-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/cc412f1212ea4226bddfc2d8bf140f42?user_id=c6aa9fa2abb8452ebd08c99a1911197c" status: 200 len: 282 microversion: 2.36 time: 0.103778 Sep 07 12:29:57.127734 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 253/524] 10.222.0.16 () {60 vars in 1364 bytes} [Wed Sep 7 12:29:57 2022] GET /compute/v2.1/os-quota-sets/cc412f1212ea4226bddfc2d8bf140f42?user_id=c6aa9fa2abb8452ebd08c99a1911197c => generated 282 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:29:57.135180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1a861f6c-7d0e-4502-8c7e-d4d872f2d8fc tempest-FlavorsV255TestJSON-812673031 tempest-FlavorsV255TestJSON-812673031-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:57.152296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e222fe7e-848c-4ffd-a301-0ab1dd42d571 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:57.159856 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1a861f6c-7d0e-4502-8c7e-d4d872f2d8fc tempest-FlavorsV255TestJSON-812673031 tempest-FlavorsV255TestJSON-812673031-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1040882007" status: 202 len: 0 microversion: 2.55 time: 0.030216 Sep 07 12:29:57.160747 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 254/525] 10.222.0.16 () {60 vars in 1202 bytes} [Wed Sep 7 12:29:57 2022] DELETE /compute/v2.1/flavors/1040882007 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:29:57.164903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e222fe7e-848c-4ffd-a301-0ab1dd42d571 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:57.166579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fdff022e-9981-4df2-b709-d43e12a65b8f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:57.167087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fdff022e-9981-4df2-b709-d43e12a65b8f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:57.168188 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e222fe7e-848c-4ffd-a301-0ab1dd42d571 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:57.174184 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e222fe7e-848c-4ffd-a301-0ab1dd42d571 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1419 microversion: 2.75 time: 0.178492 Sep 07 12:29:57.175486 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 272/526] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:29:56 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1419 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:29:57.175923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdff022e-9981-4df2-b709-d43e12a65b8f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:57.176672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdff022e-9981-4df2-b709-d43e12a65b8f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:57.177256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdff022e-9981-4df2-b709-d43e12a65b8f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:57.178209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdff022e-9981-4df2-b709-d43e12a65b8f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:57.178855 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdff022e-9981-4df2-b709-d43e12a65b8f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:57.179424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdff022e-9981-4df2-b709-d43e12a65b8f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:57.180843 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fd4565cb-1433-47ee-8099-16805c8fcfd3 tempest-FlavorsV255TestJSON-812673031 tempest-FlavorsV255TestJSON-812673031-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:57.203419 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fd4565cb-1433-47ee-8099-16805c8fcfd3 tempest-FlavorsV255TestJSON-812673031 tempest-FlavorsV255TestJSON-812673031-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6151 microversion: 2.55 time: 0.026059 Sep 07 12:29:57.204667 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 273/527] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Sep 7 12:29:57 2022] GET /compute/v2.1/flavors/detail => generated 6151 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:29:57.357915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fdff022e-9981-4df2-b709-d43e12a65b8f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:57.369337 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fdff022e-9981-4df2-b709-d43e12a65b8f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657" status: 200 len: 1318 microversion: 2.1 time: 0.207454 Sep 07 12:29:57.371901 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 255/528] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:57 2022] GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:57.733498 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a06d3c81-0a81-48f7-a027-4d740c8af317 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:57.734472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a06d3c81-0a81-48f7-a027-4d740c8af317 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:57.745508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a06d3c81-0a81-48f7-a027-4d740c8af317 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:57.746959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a06d3c81-0a81-48f7-a027-4d740c8af317 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:57.747520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a06d3c81-0a81-48f7-a027-4d740c8af317 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:57.748919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a06d3c81-0a81-48f7-a027-4d740c8af317 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:57.749472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a06d3c81-0a81-48f7-a027-4d740c8af317 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:57.750159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a06d3c81-0a81-48f7-a027-4d740c8af317 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:57.799034 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-831b0311-f7b8-4580-ae15-c0514ba620cc tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:57.799974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-831b0311-f7b8-4580-ae15-c0514ba620cc tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 8ecbad38-98de-4c5d-b656-07e102181e62] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:57.807269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-831b0311-f7b8-4580-ae15-c0514ba620cc tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:57.812600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-831b0311-f7b8-4580-ae15-c0514ba620cc tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:57.813034 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-831b0311-f7b8-4580-ae15-c0514ba620cc tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:57.813858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-831b0311-f7b8-4580-ae15-c0514ba620cc tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:57.814316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-831b0311-f7b8-4580-ae15-c0514ba620cc tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:57.814743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-831b0311-f7b8-4580-ae15-c0514ba620cc tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:57.832391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a06d3c81-0a81-48f7-a027-4d740c8af317 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:57.841823 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a06d3c81-0a81-48f7-a027-4d740c8af317 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1209 microversion: 2.1 time: 0.113838 Sep 07 12:29:57.842601 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 274/529] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:57 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1209 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:57.983042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-831b0311-f7b8-4580-ae15-c0514ba620cc tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:57.992278 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-831b0311-f7b8-4580-ae15-c0514ba620cc tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62" status: 200 len: 1322 microversion: 2.1 time: 0.197347 Sep 07 12:29:58.005589 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 256/530] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:57 2022] GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:58.018368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fe493856-0159-4144-9642-1426f39c54f9 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:58.020564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fe493856-0159-4144-9642-1426f39c54f9 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:58.028462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe493856-0159-4144-9642-1426f39c54f9 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:58.030530 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe493856-0159-4144-9642-1426f39c54f9 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:58.032009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe493856-0159-4144-9642-1426f39c54f9 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:58.033121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe493856-0159-4144-9642-1426f39c54f9 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:58.033618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe493856-0159-4144-9642-1426f39c54f9 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:58.034048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe493856-0159-4144-9642-1426f39c54f9 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:58.185936 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fe493856-0159-4144-9642-1426f39c54f9 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1630 microversion: 2.1 time: 0.171915 Sep 07 12:29:58.200339 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 275/531] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:58 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1630 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:58.206961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3b4a7f90-fee2-4ad2-af24-9090e8ee6686 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:58.207953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3b4a7f90-fee2-4ad2-af24-9090e8ee6686 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:58.211443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2bef7a99-1208-4de7-b0c6-3f2a7c2d2d40 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852087-9", "block_migration": true, "disk_over_commit": false}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:58.215367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2bef7a99-1208-4de7-b0c6-3f2a7c2d2d40 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:58.217967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b4a7f90-fee2-4ad2-af24-9090e8ee6686 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:58.219203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b4a7f90-fee2-4ad2-af24-9090e8ee6686 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:58.221268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b4a7f90-fee2-4ad2-af24-9090e8ee6686 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:58.221696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bef7a99-1208-4de7-b0c6-3f2a7c2d2d40 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:58.222187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bef7a99-1208-4de7-b0c6-3f2a7c2d2d40 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:58.222621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bef7a99-1208-4de7-b0c6-3f2a7c2d2d40 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:58.222979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b4a7f90-fee2-4ad2-af24-9090e8ee6686 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:58.223317 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bef7a99-1208-4de7-b0c6-3f2a7c2d2d40 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:58.223766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bef7a99-1208-4de7-b0c6-3f2a7c2d2d40 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:58.224186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bef7a99-1208-4de7-b0c6-3f2a7c2d2d40 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:58.224463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b4a7f90-fee2-4ad2-af24-9090e8ee6686 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:58.225108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b4a7f90-fee2-4ad2-af24-9090e8ee6686 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:58.257944 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-2bef7a99-1208-4de7-b0c6-3f2a7c2d2d40 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lazy-loading 'flavor' on Instance uuid 74efffee-c688-4fe1-88dd-a49eaa3d940e {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:29:58.273459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2bef7a99-1208-4de7-b0c6-3f2a7c2d2d40 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Going to try to live migrate instance to n-h2-852087-9 {{(pid=122432) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 07 12:29:58.280735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:29:58.418073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3b4a7f90-fee2-4ad2-af24-9090e8ee6686 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:58.431442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3b4a7f90-fee2-4ad2-af24-9090e8ee6686 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:58.433619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3b4a7f90-fee2-4ad2-af24-9090e8ee6686 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:58.439576 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3b4a7f90-fee2-4ad2-af24-9090e8ee6686 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1417 microversion: 2.75 time: 0.237173 Sep 07 12:29:58.440104 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 257/532] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:29:58 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1417 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:29:58.445357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b0a9190a-afb0-4088-b46d-8c519c5d8d9f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:58.446253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b0a9190a-afb0-4088-b46d-8c519c5d8d9f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:58.454699 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0a9190a-afb0-4088-b46d-8c519c5d8d9f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:58.455186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0a9190a-afb0-4088-b46d-8c519c5d8d9f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:58.455775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0a9190a-afb0-4088-b46d-8c519c5d8d9f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:58.456475 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0a9190a-afb0-4088-b46d-8c519c5d8d9f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:58.457276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0a9190a-afb0-4088-b46d-8c519c5d8d9f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:58.457787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0a9190a-afb0-4088-b46d-8c519c5d8d9f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:58.632574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b0a9190a-afb0-4088-b46d-8c519c5d8d9f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:58.642802 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b0a9190a-afb0-4088-b46d-8c519c5d8d9f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657" status: 200 len: 1318 microversion: 2.1 time: 0.200146 Sep 07 12:29:58.643620 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 258/533] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:58 2022] GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:58.868920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8b76e8e3-91ba-4490-9be6-26a5eb4fa006 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:58.869361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8b76e8e3-91ba-4490-9be6-26a5eb4fa006 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:58.883314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b76e8e3-91ba-4490-9be6-26a5eb4fa006 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:58.893461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b76e8e3-91ba-4490-9be6-26a5eb4fa006 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:58.894032 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b76e8e3-91ba-4490-9be6-26a5eb4fa006 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:58.894864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b76e8e3-91ba-4490-9be6-26a5eb4fa006 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:58.910558 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b76e8e3-91ba-4490-9be6-26a5eb4fa006 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:58.911281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b76e8e3-91ba-4490-9be6-26a5eb4fa006 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:59.056724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8b76e8e3-91ba-4490-9be6-26a5eb4fa006 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:59.064552 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8b76e8e3-91ba-4490-9be6-26a5eb4fa006 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1209 microversion: 2.1 time: 0.201490 Sep 07 12:29:59.065125 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 259/534] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:58 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1209 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:59.086181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bcaf1e3f-b133-46c3-ab8f-6013871c70d4 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:59.087002 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bcaf1e3f-b133-46c3-ab8f-6013871c70d4 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 8ecbad38-98de-4c5d-b656-07e102181e62] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:59.093183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcaf1e3f-b133-46c3-ab8f-6013871c70d4 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:59.093822 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcaf1e3f-b133-46c3-ab8f-6013871c70d4 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:59.094152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcaf1e3f-b133-46c3-ab8f-6013871c70d4 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:59.094852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcaf1e3f-b133-46c3-ab8f-6013871c70d4 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:59.095276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcaf1e3f-b133-46c3-ab8f-6013871c70d4 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:59.095680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcaf1e3f-b133-46c3-ab8f-6013871c70d4 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:59.302328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bcaf1e3f-b133-46c3-ab8f-6013871c70d4 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:59.310930 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bcaf1e3f-b133-46c3-ab8f-6013871c70d4 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62" status: 200 len: 1322 microversion: 2.1 time: 0.231828 Sep 07 12:29:59.311707 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 260/535] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:59 2022] GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:29:59.474107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d34d41be-0576-4e12-ae8d-06502e2301f5 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:59.474790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d34d41be-0576-4e12-ae8d-06502e2301f5 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:59.485692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d34d41be-0576-4e12-ae8d-06502e2301f5 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:59.486194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d34d41be-0576-4e12-ae8d-06502e2301f5 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:59.489961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d34d41be-0576-4e12-ae8d-06502e2301f5 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:59.490795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d34d41be-0576-4e12-ae8d-06502e2301f5 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:59.493741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d34d41be-0576-4e12-ae8d-06502e2301f5 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:59.494222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d34d41be-0576-4e12-ae8d-06502e2301f5 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:59.617220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d34d41be-0576-4e12-ae8d-06502e2301f5 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:59.628520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d34d41be-0576-4e12-ae8d-06502e2301f5 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:59.630125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d34d41be-0576-4e12-ae8d-06502e2301f5 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:59.636868 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d34d41be-0576-4e12-ae8d-06502e2301f5 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1417 microversion: 2.75 time: 0.167858 Sep 07 12:29:59.642271 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 261/536] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:29:59 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1417 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:29:59.666356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-706e060a-8035-473e-a4e1-3869718fb488 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:29:59.666963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-706e060a-8035-473e-a4e1-3869718fb488 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:29:59.693755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-706e060a-8035-473e-a4e1-3869718fb488 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:59.694259 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-706e060a-8035-473e-a4e1-3869718fb488 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:59.694736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-706e060a-8035-473e-a4e1-3869718fb488 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:59.695816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-706e060a-8035-473e-a4e1-3869718fb488 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:59.695964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-706e060a-8035-473e-a4e1-3869718fb488 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:59.696433 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-706e060a-8035-473e-a4e1-3869718fb488 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:59.953436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-706e060a-8035-473e-a4e1-3869718fb488 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:29:59.962613 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-706e060a-8035-473e-a4e1-3869718fb488 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657" status: 200 len: 1318 microversion: 2.1 time: 0.300648 Sep 07 12:29:59.963611 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 262/537] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:29:59 2022] GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:29:59.968622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-99554e9d-d798-4b97-b492-28b12b37cd13 req-30983180-e67f-4696-984e-0b606ca46806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ecbad38-98de-4c5d-b656-07e102181e62", "name": "network-vif-plugged", "status": "completed", "tag": "293cc6aa-a17a-4b27-8edc-1a5155708f68"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:29:59.978881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-99554e9d-d798-4b97-b492-28b12b37cd13 req-30983180-e67f-4696-984e-0b606ca46806 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:29:59.979362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-99554e9d-d798-4b97-b492-28b12b37cd13 req-30983180-e67f-4696-984e-0b606ca46806 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:29:59.979789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-99554e9d-d798-4b97-b492-28b12b37cd13 req-30983180-e67f-4696-984e-0b606ca46806 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:29:59.993185 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-99554e9d-d798-4b97-b492-28b12b37cd13 req-30983180-e67f-4696-984e-0b606ca46806 service nova] Creating event network-vif-plugged:293cc6aa-a17a-4b27-8edc-1a5155708f68 for instance 8ecbad38-98de-4c5d-b656-07e102181e62 on n-h1-852087-9 Sep 07 12:29:59.998636 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-99554e9d-d798-4b97-b492-28b12b37cd13 req-30983180-e67f-4696-984e-0b606ca46806 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033719 Sep 07 12:29:59.999237 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 263/538] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:30:00.091004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ee796b03-c134-44d9-9d66-8b2d8903ca20 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:00.091872 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ee796b03-c134-44d9-9d66-8b2d8903ca20 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:00.099225 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee796b03-c134-44d9-9d66-8b2d8903ca20 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:00.099723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee796b03-c134-44d9-9d66-8b2d8903ca20 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:00.100366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee796b03-c134-44d9-9d66-8b2d8903ca20 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:00.101242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee796b03-c134-44d9-9d66-8b2d8903ca20 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:00.102001 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee796b03-c134-44d9-9d66-8b2d8903ca20 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:00.102603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee796b03-c134-44d9-9d66-8b2d8903ca20 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:00.179886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ee796b03-c134-44d9-9d66-8b2d8903ca20 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:00.190371 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ee796b03-c134-44d9-9d66-8b2d8903ca20 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1265 microversion: 2.1 time: 0.104078 Sep 07 12:30:00.206028 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 264/539] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:00 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1265 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:30:00.332417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d81dec2e-a5e3-428f-94f0-4027a56cb155 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:00.332871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d81dec2e-a5e3-428f-94f0-4027a56cb155 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 79881389-e6f0-43f3-96c3-fdb045bb956e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:00.345087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d81dec2e-a5e3-428f-94f0-4027a56cb155 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:00.345644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d81dec2e-a5e3-428f-94f0-4027a56cb155 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:00.346282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d81dec2e-a5e3-428f-94f0-4027a56cb155 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:00.347438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d81dec2e-a5e3-428f-94f0-4027a56cb155 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:00.347912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d81dec2e-a5e3-428f-94f0-4027a56cb155 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:00.348340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d81dec2e-a5e3-428f-94f0-4027a56cb155 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:00.400782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d81dec2e-a5e3-428f-94f0-4027a56cb155 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 79881389-e6f0-43f3-96c3-fdb045bb956e] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:30:00.580312 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d81dec2e-a5e3-428f-94f0-4027a56cb155 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "DELETE /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e" status: 204 len: 0 microversion: 2.1 time: 0.251886 Sep 07 12:30:00.581236 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 265/540] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:30:00 2022] DELETE /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 12:30:00.593962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0362034f-a4fa-44d7-aac6-2c9f5830f464 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:00.595454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0362034f-a4fa-44d7-aac6-2c9f5830f464 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 8ecbad38-98de-4c5d-b656-07e102181e62] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:00.602167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0362034f-a4fa-44d7-aac6-2c9f5830f464 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:00.604445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0362034f-a4fa-44d7-aac6-2c9f5830f464 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:00.604908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0362034f-a4fa-44d7-aac6-2c9f5830f464 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:00.606276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0362034f-a4fa-44d7-aac6-2c9f5830f464 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:00.606754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0362034f-a4fa-44d7-aac6-2c9f5830f464 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:00.607570 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0362034f-a4fa-44d7-aac6-2c9f5830f464 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:00.801817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0362034f-a4fa-44d7-aac6-2c9f5830f464 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:00.810874 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0362034f-a4fa-44d7-aac6-2c9f5830f464 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62" status: 200 len: 1322 microversion: 2.1 time: 0.228188 Sep 07 12:30:00.811468 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 266/541] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:00 2022] GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:00.816563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c2374619-cd70-41d6-b6ca-85131e3e1a24 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:00.817200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c2374619-cd70-41d6-b6ca-85131e3e1a24 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:00.832102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2374619-cd70-41d6-b6ca-85131e3e1a24 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:00.832727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2374619-cd70-41d6-b6ca-85131e3e1a24 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:00.833239 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2374619-cd70-41d6-b6ca-85131e3e1a24 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:00.834084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2374619-cd70-41d6-b6ca-85131e3e1a24 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:00.834620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2374619-cd70-41d6-b6ca-85131e3e1a24 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:00.835119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2374619-cd70-41d6-b6ca-85131e3e1a24 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:00.923981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c2374619-cd70-41d6-b6ca-85131e3e1a24 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:00.933875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c2374619-cd70-41d6-b6ca-85131e3e1a24 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:00.935901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c2374619-cd70-41d6-b6ca-85131e3e1a24 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:00.941642 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c2374619-cd70-41d6-b6ca-85131e3e1a24 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1438 microversion: 2.75 time: 0.129132 Sep 07 12:30:00.942461 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 267/542] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:00 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1438 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:30:00.947796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-33b44f39-50d8-4723-9b16-16de17b76f26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1116434131", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "615600471", "adminPass": "***", "networks": [{"uuid": "36a73972-cb95-4593-b26d-1085b64b05d0"}], "security_groups": [{"name": "tempest-securitygroup--39943928"}], "key_name": "tempest-keypair-953815892", "user_data": "}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:00.961891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:30:01.078795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-33b44f39-50d8-4723-9b16-16de17b76f26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] validate_networks() for [('36a73972-cb95-4593-b26d-1085b64b05d0', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:30:01.577096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-33b44f39-50d8-4723-9b16-16de17b76f26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:30:01.578236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-33b44f39-50d8-4723-9b16-16de17b76f26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:30:01.578749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-33b44f39-50d8-4723-9b16-16de17b76f26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:30:01.579694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-33b44f39-50d8-4723-9b16-16de17b76f26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:30:01.580257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-33b44f39-50d8-4723-9b16-16de17b76f26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:30:01.591584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33b44f39-50d8-4723-9b16-16de17b76f26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:01.592209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33b44f39-50d8-4723-9b16-16de17b76f26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:01.592647 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33b44f39-50d8-4723-9b16-16de17b76f26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:01.593390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33b44f39-50d8-4723-9b16-16de17b76f26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:01.593895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33b44f39-50d8-4723-9b16-16de17b76f26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:01.594320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33b44f39-50d8-4723-9b16-16de17b76f26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:01.626471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-33b44f39-50d8-4723-9b16-16de17b76f26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Getting quotas for project eeb96c3ce6734e5f94229d94bf379318. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:30:01.631074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-33b44f39-50d8-4723-9b16-16de17b76f26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Getting quotas for user 02af7f40e0cc4ab7bbc06201d5e253cd and project eeb96c3ce6734e5f94229d94bf379318. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:30:01.643079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-33b44f39-50d8-4723-9b16-16de17b76f26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:30:01.645894 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-33b44f39-50d8-4723-9b16-16de17b76f26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 97552bf3-7814-403e-b66c-582b2f4f703f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:30:01.704533 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-33b44f39-50d8-4723-9b16-16de17b76f26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.760111 Sep 07 12:30:01.704926 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 268/543] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:30:00 2022] POST /compute/v2.1/servers => generated 400 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:30:01.709910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dad330f0-d3ae-46bf-a6c4-336fa0d383c4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:01.712863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dad330f0-d3ae-46bf-a6c4-336fa0d383c4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:01.728895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dad330f0-d3ae-46bf-a6c4-336fa0d383c4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:01.728895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dad330f0-d3ae-46bf-a6c4-336fa0d383c4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:01.728895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dad330f0-d3ae-46bf-a6c4-336fa0d383c4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:01.728895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dad330f0-d3ae-46bf-a6c4-336fa0d383c4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:01.729554 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dad330f0-d3ae-46bf-a6c4-336fa0d383c4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:01.729554 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dad330f0-d3ae-46bf-a6c4-336fa0d383c4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:01.836174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-dad330f0-d3ae-46bf-a6c4-336fa0d383c4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:30:01.836882 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-dad330f0-d3ae-46bf-a6c4-336fa0d383c4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:30:01.837752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-dad330f0-d3ae-46bf-a6c4-336fa0d383c4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:30:01.838350 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-dad330f0-d3ae-46bf-a6c4-336fa0d383c4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:30:01.838947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-dad330f0-d3ae-46bf-a6c4-336fa0d383c4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:30:01.865856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:30:01.940999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dad330f0-d3ae-46bf-a6c4-336fa0d383c4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:01.955812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dad330f0-d3ae-46bf-a6c4-336fa0d383c4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:01.959051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dad330f0-d3ae-46bf-a6c4-336fa0d383c4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:01.960480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dad330f0-d3ae-46bf-a6c4-336fa0d383c4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:01.961655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dad330f0-d3ae-46bf-a6c4-336fa0d383c4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:01.965219 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dad330f0-d3ae-46bf-a6c4-336fa0d383c4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:01.967385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dad330f0-d3ae-46bf-a6c4-336fa0d383c4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:02.071694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dad330f0-d3ae-46bf-a6c4-336fa0d383c4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:02.086749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dad330f0-d3ae-46bf-a6c4-336fa0d383c4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:02.088679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dad330f0-d3ae-46bf-a6c4-336fa0d383c4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:02.095341 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dad330f0-d3ae-46bf-a6c4-336fa0d383c4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "POST /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f/action" status: 202 len: 1495 microversion: 2.75 time: 0.388952 Sep 07 12:30:02.096752 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 269/544] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Sep 7 12:30:01 2022] POST /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f/action => generated 1495 bytes in 391 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 07 12:30:02.102340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-12d1641d-66b3-4ccd-8d08-825e6ca2bf43 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:02.103176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-12d1641d-66b3-4ccd-8d08-825e6ca2bf43 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:02.111491 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12d1641d-66b3-4ccd-8d08-825e6ca2bf43 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:02.112147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12d1641d-66b3-4ccd-8d08-825e6ca2bf43 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:02.112785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12d1641d-66b3-4ccd-8d08-825e6ca2bf43 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:02.113930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12d1641d-66b3-4ccd-8d08-825e6ca2bf43 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:02.115470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12d1641d-66b3-4ccd-8d08-825e6ca2bf43 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:02.116194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12d1641d-66b3-4ccd-8d08-825e6ca2bf43 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:02.350517 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-12d1641d-66b3-4ccd-8d08-825e6ca2bf43 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:02.371133 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-12d1641d-66b3-4ccd-8d08-825e6ca2bf43 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657" status: 200 len: 1318 microversion: 2.1 time: 0.268735 Sep 07 12:30:02.386891 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 270/545] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:02 2022] GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:02.398786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7adfd1e0-a810-41bd-9721-f9d660042660 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:02.403101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7adfd1e0-a810-41bd-9721-f9d660042660 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:02.411402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7adfd1e0-a810-41bd-9721-f9d660042660 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:02.412444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7adfd1e0-a810-41bd-9721-f9d660042660 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:02.413116 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7adfd1e0-a810-41bd-9721-f9d660042660 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:02.414930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7adfd1e0-a810-41bd-9721-f9d660042660 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:02.415615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7adfd1e0-a810-41bd-9721-f9d660042660 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:02.416187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7adfd1e0-a810-41bd-9721-f9d660042660 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:02.505322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7adfd1e0-a810-41bd-9721-f9d660042660 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:02.514260 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7adfd1e0-a810-41bd-9721-f9d660042660 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1265 microversion: 2.1 time: 0.125595 Sep 07 12:30:02.514854 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 271/546] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:02 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:02.515960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7adfd1e0-a810-41bd-9721-f9d660042660 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:02.516848 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7adfd1e0-a810-41bd-9721-f9d660042660 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001041 Sep 07 12:30:02.517165 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 272/547] 10.222.0.16 () {56 vars in 886 bytes} [Wed Sep 7 12:30:02 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 07 12:30:02.528613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5aeda9bf-2c8c-49b8-95c2-0c22d8998524 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:02.529318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5aeda9bf-2c8c-49b8-95c2-0c22d8998524 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 97552bf3-7814-403e-b66c-582b2f4f703f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:02.537700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5aeda9bf-2c8c-49b8-95c2-0c22d8998524 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:02.538304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5aeda9bf-2c8c-49b8-95c2-0c22d8998524 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:02.538817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5aeda9bf-2c8c-49b8-95c2-0c22d8998524 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:02.539763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5aeda9bf-2c8c-49b8-95c2-0c22d8998524 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:02.540307 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5aeda9bf-2c8c-49b8-95c2-0c22d8998524 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:02.540811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5aeda9bf-2c8c-49b8-95c2-0c22d8998524 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:02.624030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5aeda9bf-2c8c-49b8-95c2-0c22d8998524 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:02.633672 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5aeda9bf-2c8c-49b8-95c2-0c22d8998524 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f" status: 200 len: 1266 microversion: 2.1 time: 0.115171 Sep 07 12:30:02.645948 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 273/548] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:02 2022] GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f => generated 1266 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:02.656618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6ad6e75b-c147-4651-a896-935672e256c2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:02.657409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6ad6e75b-c147-4651-a896-935672e256c2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 8ecbad38-98de-4c5d-b656-07e102181e62] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:02.664807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ad6e75b-c147-4651-a896-935672e256c2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:02.665997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ad6e75b-c147-4651-a896-935672e256c2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:02.666519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ad6e75b-c147-4651-a896-935672e256c2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:02.667246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ad6e75b-c147-4651-a896-935672e256c2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:02.667780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ad6e75b-c147-4651-a896-935672e256c2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:02.668183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ad6e75b-c147-4651-a896-935672e256c2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:02.909290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6ad6e75b-c147-4651-a896-935672e256c2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:02.921051 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6ad6e75b-c147-4651-a896-935672e256c2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62" status: 200 len: 1471 microversion: 2.1 time: 0.273371 Sep 07 12:30:02.922792 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 274/549] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:02 2022] GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62 => generated 1471 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:02.931696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-fda1a7ab-e1a4-4961-8f5c-b9227403bb0a req-44264be6-cf5e-45b0-9d33-fc5dc70c1d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657", "name": "network-vif-plugged", "status": "completed", "tag": "bec29315-bf97-4789-9f2c-6e8ebb4250a5"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:02.956274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fda1a7ab-e1a4-4961-8f5c-b9227403bb0a req-44264be6-cf5e-45b0-9d33-fc5dc70c1d76 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:02.957606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fda1a7ab-e1a4-4961-8f5c-b9227403bb0a req-44264be6-cf5e-45b0-9d33-fc5dc70c1d76 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:02.959881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fda1a7ab-e1a4-4961-8f5c-b9227403bb0a req-44264be6-cf5e-45b0-9d33-fc5dc70c1d76 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:02.983572 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-fda1a7ab-e1a4-4961-8f5c-b9227403bb0a req-44264be6-cf5e-45b0-9d33-fc5dc70c1d76 service nova] Creating event network-vif-plugged:bec29315-bf97-4789-9f2c-6e8ebb4250a5 for instance 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 on n-h1-852087-9 Sep 07 12:30:02.990981 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-fda1a7ab-e1a4-4961-8f5c-b9227403bb0a req-44264be6-cf5e-45b0-9d33-fc5dc70c1d76 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066117 Sep 07 12:30:02.992288 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 275/550] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:30:02.998508 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c900a0e8-2446-457b-b257-a5b1c1ced08f tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:03.000023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c900a0e8-2446-457b-b257-a5b1c1ced08f tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:03.008631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c900a0e8-2446-457b-b257-a5b1c1ced08f tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:03.009994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c900a0e8-2446-457b-b257-a5b1c1ced08f tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:03.010472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c900a0e8-2446-457b-b257-a5b1c1ced08f tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:03.011202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c900a0e8-2446-457b-b257-a5b1c1ced08f tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:03.011666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c900a0e8-2446-457b-b257-a5b1c1ced08f tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:03.012857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c900a0e8-2446-457b-b257-a5b1c1ced08f tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:03.115508 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c900a0e8-2446-457b-b257-a5b1c1ced08f tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:03.136254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c900a0e8-2446-457b-b257-a5b1c1ced08f tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:03.139750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c900a0e8-2446-457b-b257-a5b1c1ced08f tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:03.157244 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c900a0e8-2446-457b-b257-a5b1c1ced08f tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1447 microversion: 2.75 time: 0.162429 Sep 07 12:30:03.161881 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 276/551] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:02 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1447 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:30:03.393395 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e74a6a5b-0d40-4115-8049-604556bcd037 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:03.394003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e74a6a5b-0d40-4115-8049-604556bcd037 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] [instance: 53866cb4-d4db-4ab8-9184-2125bd9dc7c4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:03.400160 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-e74a6a5b-0d40-4115-8049-604556bcd037 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] HTTP exception thrown: Instance 53866cb4-d4db-4ab8-9184-2125bd9dc7c4 could not be found. Sep 07 12:30:03.402703 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e74a6a5b-0d40-4115-8049-604556bcd037 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Request method failure captured: Sep 07 12:30:03.402703 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/53866cb4-d4db-4ab8-9184-2125bd9dc7c4/action HTTP/1.1 Sep 07 12:30:03.402703 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:30:03.402703 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:30:03.402703 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:30:03.402703 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 15 Sep 07 12:30:03.402703 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:30:03.402703 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:30:03.402703 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:30:03.402703 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:30:03.402703 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI6yfJ4p29mo6MTgYh57jAAahNOmSJWXe-C48KldK40f8pEtyKVeGDXTgQ3GsIaFAuJcIwpdxvJtUV6maL0YjfyVoCWP2VzejeLxaHPJZujdB2pcKIH6ZGOvGL_iRIKVANOnsXnn_zPful94Ay-k59zk0CfwaEY5rpvPgMdMuk7OKCc Sep 07 12:30:03.402703 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:30:03.402703 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:30:03.402703 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:30:03.402703 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:30:03.402703 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:30:03.402703 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:30:03.402703 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 85061b82e9564713afecd7fd257d5052 Sep 07 12:30:03.402703 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1908632660 Sep 07 12:30:03.402703 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 12:30:03.402703 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 12:30:03.404399 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/85061b82e9564713afecd7fd257d5052"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_85061b82e9564713afecd7fd257d5052"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/85061b82e9564713afecd7fd257d5052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/85061b82e9564713afecd7fd257d5052"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:30:03.404399 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1908632660 Sep 07 12:30:03.404399 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 85061b82e9564713afecd7fd257d5052 Sep 07 12:30:03.404399 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1908632660 Sep 07 12:30:03.404399 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersAdminNegativeTestJSON-1908632660-project-admin Sep 07 12:30:03.404399 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:30:03.404399 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:30:03.404399 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: ed1b99b8e79e463c991ee466e918feca Sep 07 12:30:03.404399 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1908632660-project-admin Sep 07 12:30:03.404399 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:30:03.404399 n-d-852087-9 devstack@n-api.service[122433]: {"migrate": {}} Sep 07 12:30:03.404399 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:30:03.404399 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 53866cb4-d4db-4ab8-9184-2125bd9dc7c4 could not be found. Sep 07 12:30:03.405503 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '53866cb4-d4db-4ab8-9184-2125bd9dc7c4', 'body': {'migrate': {}}} Sep 07 12:30:03.405503 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:30:03.405503 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:03.405503 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:30:03.405503 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:30:03.405503 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:30:03.405503 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:30:03.405503 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 12:30:03.405503 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 12:30:03.405503 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53866cb4-d4db-4ab8-9184-2125bd9dc7c4 could not be found. Sep 07 12:30:03.405503 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:03.405503 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:03.405503 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:03.405503 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:03.405503 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:03.405503 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:03.405503 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:30:03.405503 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:30:03.405503 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:30:03.405503 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:03.406930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:30:03.406930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:30:03.406930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Sep 07 12:30:03.406930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Sep 07 12:30:03.406930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:30:03.406930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:30:03.406930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53866cb4-d4db-4ab8-9184-2125bd9dc7c4 could not be found. Sep 07 12:30:03.406930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:03.406930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:03.406930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:03.406930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:03.406930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:03.406930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:03.406930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:30:03.406930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:30:03.406930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53866cb4-d4db-4ab8-9184-2125bd9dc7c4 could not be found. Sep 07 12:30:03.406930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:03.410382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e74a6a5b-0d40-4115-8049-604556bcd037 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Returning 404 to user: Instance 53866cb4-d4db-4ab8-9184-2125bd9dc7c4 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:30:03.412820 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e74a6a5b-0d40-4115-8049-604556bcd037 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/53866cb4-d4db-4ab8-9184-2125bd9dc7c4/action" status: 404 len: 111 microversion: 2.1 time: 0.249339 Sep 07 12:30:03.413742 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 277/552] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:30:03 2022] POST /compute/v2.1/servers/53866cb4-d4db-4ab8-9184-2125bd9dc7c4/action => generated 111 bytes in 251 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:30:03.421682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9b6df8b0-bcc3-409b-a4a1-5c7bdfe7ee3b tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:03.422869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9b6df8b0-bcc3-409b-a4a1-5c7bdfe7ee3b tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:03.430916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b6df8b0-bcc3-409b-a4a1-5c7bdfe7ee3b tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:03.431680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b6df8b0-bcc3-409b-a4a1-5c7bdfe7ee3b tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:03.432286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b6df8b0-bcc3-409b-a4a1-5c7bdfe7ee3b tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:03.433369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b6df8b0-bcc3-409b-a4a1-5c7bdfe7ee3b tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:03.434138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b6df8b0-bcc3-409b-a4a1-5c7bdfe7ee3b tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:03.434721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b6df8b0-bcc3-409b-a4a1-5c7bdfe7ee3b tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:03.821868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9b6df8b0-bcc3-409b-a4a1-5c7bdfe7ee3b tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:03.836474 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9b6df8b0-bcc3-409b-a4a1-5c7bdfe7ee3b tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657" status: 200 len: 1318 microversion: 2.1 time: 0.421389 Sep 07 12:30:03.837403 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 278/553] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:03 2022] GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 => generated 1318 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:03.849719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bf951528-259f-455d-9bbc-8d637ebf61cc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:03.850680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bf951528-259f-455d-9bbc-8d637ebf61cc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:03.865050 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf951528-259f-455d-9bbc-8d637ebf61cc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:03.866014 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf951528-259f-455d-9bbc-8d637ebf61cc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:03.866451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf951528-259f-455d-9bbc-8d637ebf61cc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:03.867294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf951528-259f-455d-9bbc-8d637ebf61cc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:03.871062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf951528-259f-455d-9bbc-8d637ebf61cc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:03.871664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf951528-259f-455d-9bbc-8d637ebf61cc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:04.026009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bf951528-259f-455d-9bbc-8d637ebf61cc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:04.040231 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bf951528-259f-455d-9bbc-8d637ebf61cc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1271 microversion: 2.1 time: 0.194084 Sep 07 12:30:04.040936 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 279/554] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:03 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1271 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:04.045721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d8721e25-ec74-4a30-9567-9795ec214fd1 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:04.050209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d8721e25-ec74-4a30-9567-9795ec214fd1 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 97552bf3-7814-403e-b66c-582b2f4f703f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:04.083108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8721e25-ec74-4a30-9567-9795ec214fd1 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:04.091056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8721e25-ec74-4a30-9567-9795ec214fd1 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:04.094214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8721e25-ec74-4a30-9567-9795ec214fd1 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:04.095255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8721e25-ec74-4a30-9567-9795ec214fd1 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:04.097094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8721e25-ec74-4a30-9567-9795ec214fd1 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:04.099226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8721e25-ec74-4a30-9567-9795ec214fd1 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:04.517378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d8721e25-ec74-4a30-9567-9795ec214fd1 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:04.527697 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d8721e25-ec74-4a30-9567-9795ec214fd1 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f" status: 200 len: 1332 microversion: 2.1 time: 0.485570 Sep 07 12:30:04.529391 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 280/555] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:04 2022] GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f => generated 1332 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:04.534644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-db450daf-c0b0-49be-a1f5-e4abdada5cf2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2073538558", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:04.604453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-db450daf-c0b0-49be-a1f5-e4abdada5cf2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:30:05.426031 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-db450daf-c0b0-49be-a1f5-e4abdada5cf2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:30:05.427499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-db450daf-c0b0-49be-a1f5-e4abdada5cf2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:30:05.428427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-db450daf-c0b0-49be-a1f5-e4abdada5cf2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:30:05.429037 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-db450daf-c0b0-49be-a1f5-e4abdada5cf2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:30:05.429976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-db450daf-c0b0-49be-a1f5-e4abdada5cf2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:30:05.440447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db450daf-c0b0-49be-a1f5-e4abdada5cf2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:05.441298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db450daf-c0b0-49be-a1f5-e4abdada5cf2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:05.441929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db450daf-c0b0-49be-a1f5-e4abdada5cf2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:05.442697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db450daf-c0b0-49be-a1f5-e4abdada5cf2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:05.443228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db450daf-c0b0-49be-a1f5-e4abdada5cf2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:05.443762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db450daf-c0b0-49be-a1f5-e4abdada5cf2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:05.485892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-db450daf-c0b0-49be-a1f5-e4abdada5cf2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Getting quotas for project 53b6f3dbd50d41d69a47e6184f9abe52. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:30:05.494805 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-db450daf-c0b0-49be-a1f5-e4abdada5cf2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Getting quotas for user 433722ee7f084b8aa1decba3f1572934 and project 53b6f3dbd50d41d69a47e6184f9abe52. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:30:05.527593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-db450daf-c0b0-49be-a1f5-e4abdada5cf2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:30:05.534488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-db450daf-c0b0-49be-a1f5-e4abdada5cf2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 2f60a676-5df0-44d4-b97f-4248a08a9f59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:30:05.714633 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-db450daf-c0b0-49be-a1f5-e4abdada5cf2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.178697 Sep 07 12:30:05.721675 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 281/556] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:30:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:30:05.782311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8b3f3aa6-ff38-4da3-9dbb-1776140ca0ee tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:05.782932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8b3f3aa6-ff38-4da3-9dbb-1776140ca0ee tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:05.805812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b3f3aa6-ff38-4da3-9dbb-1776140ca0ee tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:05.806328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b3f3aa6-ff38-4da3-9dbb-1776140ca0ee tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:05.806765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b3f3aa6-ff38-4da3-9dbb-1776140ca0ee tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:05.819819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b3f3aa6-ff38-4da3-9dbb-1776140ca0ee tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:05.820436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b3f3aa6-ff38-4da3-9dbb-1776140ca0ee tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:05.821257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b3f3aa6-ff38-4da3-9dbb-1776140ca0ee tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:05.906508 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2bef7a99-1208-4de7-b0c6-3f2a7c2d2d40 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e/action" status: 202 len: 0 microversion: 2.1 time: 7.699737 Sep 07 12:30:05.908635 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 276/557] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:29:58 2022] POST /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e/action => generated 0 bytes in 7702 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:30:05.915986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b31b4884-4a46-42d2-a15d-f53cfa51e5cc tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:05.917117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b31b4884-4a46-42d2-a15d-f53cfa51e5cc tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:05.950675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b31b4884-4a46-42d2-a15d-f53cfa51e5cc tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:05.953842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b31b4884-4a46-42d2-a15d-f53cfa51e5cc tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:05.957990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b31b4884-4a46-42d2-a15d-f53cfa51e5cc tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:05.960769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b31b4884-4a46-42d2-a15d-f53cfa51e5cc tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:05.968519 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b31b4884-4a46-42d2-a15d-f53cfa51e5cc tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:05.970160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b31b4884-4a46-42d2-a15d-f53cfa51e5cc tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:06.094235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8b3f3aa6-ff38-4da3-9dbb-1776140ca0ee tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:06.105850 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8b3f3aa6-ff38-4da3-9dbb-1776140ca0ee tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:06.122096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8b3f3aa6-ff38-4da3-9dbb-1776140ca0ee tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:06.141830 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8b3f3aa6-ff38-4da3-9dbb-1776140ca0ee tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1447 microversion: 2.75 time: 0.418202 Sep 07 12:30:06.144891 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 282/558] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:05 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1447 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:30:06.165774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9f2aedd7-71f4-4ce0-aae4-110c819c9cca tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:06.166732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9f2aedd7-71f4-4ce0-aae4-110c819c9cca tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:06.194263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f2aedd7-71f4-4ce0-aae4-110c819c9cca tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:06.195351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f2aedd7-71f4-4ce0-aae4-110c819c9cca tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:06.196136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f2aedd7-71f4-4ce0-aae4-110c819c9cca tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:06.197098 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f2aedd7-71f4-4ce0-aae4-110c819c9cca tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:06.197833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f2aedd7-71f4-4ce0-aae4-110c819c9cca tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:06.199092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f2aedd7-71f4-4ce0-aae4-110c819c9cca tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:06.447869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=14 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:30:06.473273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=13 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:30:07.208600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b31b4884-4a46-42d2-a15d-f53cfa51e5cc tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:07.221131 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b31b4884-4a46-42d2-a15d-f53cfa51e5cc tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657" status: 200 len: 1468 microversion: 2.1 time: 1.310895 Sep 07 12:30:07.221870 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 277/559] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:05 2022] GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 => generated 1468 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:07.256596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-316b6a5c-db64-4606-b0b2-54249f10ab42 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:07.256596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-316b6a5c-db64-4606-b0b2-54249f10ab42 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 97552bf3-7814-403e-b66c-582b2f4f703f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:07.297787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-316b6a5c-db64-4606-b0b2-54249f10ab42 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:07.298693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-316b6a5c-db64-4606-b0b2-54249f10ab42 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:07.299457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-316b6a5c-db64-4606-b0b2-54249f10ab42 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:07.304187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-316b6a5c-db64-4606-b0b2-54249f10ab42 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:07.305080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-316b6a5c-db64-4606-b0b2-54249f10ab42 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:07.306034 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-316b6a5c-db64-4606-b0b2-54249f10ab42 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:07.667180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9f2aedd7-71f4-4ce0-aae4-110c819c9cca tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:07.678520 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9f2aedd7-71f4-4ce0-aae4-110c819c9cca tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1313 microversion: 2.1 time: 1.531642 Sep 07 12:30:07.690182 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 283/560] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:06 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1313 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:07.705142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ccf29bf-1f6c-482d-9d1f-d45598cdc436 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:07.710055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0ccf29bf-1f6c-482d-9d1f-d45598cdc436 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 2f60a676-5df0-44d4-b97f-4248a08a9f59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:07.736886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ccf29bf-1f6c-482d-9d1f-d45598cdc436 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:07.748925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ccf29bf-1f6c-482d-9d1f-d45598cdc436 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:07.749389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ccf29bf-1f6c-482d-9d1f-d45598cdc436 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:07.753551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ccf29bf-1f6c-482d-9d1f-d45598cdc436 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:07.753954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ccf29bf-1f6c-482d-9d1f-d45598cdc436 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:07.754277 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ccf29bf-1f6c-482d-9d1f-d45598cdc436 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:08.070436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0ccf29bf-1f6c-482d-9d1f-d45598cdc436 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:08.091474 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ccf29bf-1f6c-482d-9d1f-d45598cdc436 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59" status: 200 len: 1274 microversion: 2.1 time: 0.398098 Sep 07 12:30:08.092100 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 284/561] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:07 2022] GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59 => generated 1274 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:08.112063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-550c35d9-da7f-42f6-8527-32d5cc25c217 req-4b6dee4b-a3a3-4ade-8c51-2b2b13a3a00a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79881389-e6f0-43f3-96c3-fdb045bb956e", "name": "network-vif-deleted", "tag": "8a3023e7-a1f3-4157-96e9-c1135a576d1c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:08.141474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-550c35d9-da7f-42f6-8527-32d5cc25c217 req-4b6dee4b-a3a3-4ade-8c51-2b2b13a3a00a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:08.143850 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-550c35d9-da7f-42f6-8527-32d5cc25c217 req-4b6dee4b-a3a3-4ade-8c51-2b2b13a3a00a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:08.147072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-550c35d9-da7f-42f6-8527-32d5cc25c217 req-4b6dee4b-a3a3-4ade-8c51-2b2b13a3a00a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:08.203232 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-550c35d9-da7f-42f6-8527-32d5cc25c217 req-4b6dee4b-a3a3-4ade-8c51-2b2b13a3a00a service nova] Creating event network-vif-deleted:8a3023e7-a1f3-4157-96e9-c1135a576d1c for instance 79881389-e6f0-43f3-96c3-fdb045bb956e on n-h2-852087-9 Sep 07 12:30:08.215705 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-550c35d9-da7f-42f6-8527-32d5cc25c217 req-4b6dee4b-a3a3-4ade-8c51-2b2b13a3a00a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121922 Sep 07 12:30:08.223746 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 285/562] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:30:08.249340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-168f7b6b-d6d2-4040-b2c5-183c2484223f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:08.251989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-168f7b6b-d6d2-4040-b2c5-183c2484223f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:08.272119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-168f7b6b-d6d2-4040-b2c5-183c2484223f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:08.272938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-168f7b6b-d6d2-4040-b2c5-183c2484223f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:08.273711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-168f7b6b-d6d2-4040-b2c5-183c2484223f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:08.274711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-168f7b6b-d6d2-4040-b2c5-183c2484223f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:08.275331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-168f7b6b-d6d2-4040-b2c5-183c2484223f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:08.275996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-168f7b6b-d6d2-4040-b2c5-183c2484223f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:08.283530 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-316b6a5c-db64-4606-b0b2-54249f10ab42 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:08.304770 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-316b6a5c-db64-4606-b0b2-54249f10ab42 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f" status: 200 len: 1386 microversion: 2.1 time: 1.065085 Sep 07 12:30:08.308170 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 278/563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:07 2022] GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f => generated 1386 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:08.314436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-18fd4196-b610-478f-9158-553bd1dee55a tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:08.321853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-18fd4196-b610-478f-9158-553bd1dee55a tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:08.349830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18fd4196-b610-478f-9158-553bd1dee55a tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:08.350428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18fd4196-b610-478f-9158-553bd1dee55a tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:08.350876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18fd4196-b610-478f-9158-553bd1dee55a tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:08.351785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18fd4196-b610-478f-9158-553bd1dee55a tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:08.352234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18fd4196-b610-478f-9158-553bd1dee55a tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:08.353013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18fd4196-b610-478f-9158-553bd1dee55a tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:08.597973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-18fd4196-b610-478f-9158-553bd1dee55a tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:08.610244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-18fd4196-b610-478f-9158-553bd1dee55a tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:08.611718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-18fd4196-b610-478f-9158-553bd1dee55a tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:08.631611 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-18fd4196-b610-478f-9158-553bd1dee55a tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1447 microversion: 2.75 time: 0.322030 Sep 07 12:30:08.632176 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 279/564] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:08 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1447 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:30:08.795012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-168f7b6b-d6d2-4040-b2c5-183c2484223f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:08.804095 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-168f7b6b-d6d2-4040-b2c5-183c2484223f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1504 microversion: 2.1 time: 0.576695 Sep 07 12:30:08.814576 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 286/565] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:08 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1504 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:08.825567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cc19ab4d-aabf-4e1e-8ad8-5517769a9b4f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:08.826100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cc19ab4d-aabf-4e1e-8ad8-5517769a9b4f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:08.851199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc19ab4d-aabf-4e1e-8ad8-5517769a9b4f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:08.851738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc19ab4d-aabf-4e1e-8ad8-5517769a9b4f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:08.852183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc19ab4d-aabf-4e1e-8ad8-5517769a9b4f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:08.852901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc19ab4d-aabf-4e1e-8ad8-5517769a9b4f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:08.853377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc19ab4d-aabf-4e1e-8ad8-5517769a9b4f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:08.860743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc19ab4d-aabf-4e1e-8ad8-5517769a9b4f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:09.137959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c26081c4-f8f5-4d92-8bc5-4f0a9ea1d821 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-298292544", "block_migration": true, "disk_over_commit": false}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:09.141533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c26081c4-f8f5-4d92-8bc5-4f0a9ea1d821 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:09.165170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c26081c4-f8f5-4d92-8bc5-4f0a9ea1d821 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:09.167993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c26081c4-f8f5-4d92-8bc5-4f0a9ea1d821 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:09.168745 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c26081c4-f8f5-4d92-8bc5-4f0a9ea1d821 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:09.170727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c26081c4-f8f5-4d92-8bc5-4f0a9ea1d821 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:09.173405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c26081c4-f8f5-4d92-8bc5-4f0a9ea1d821 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:09.174245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c26081c4-f8f5-4d92-8bc5-4f0a9ea1d821 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:09.257735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-c26081c4-f8f5-4d92-8bc5-4f0a9ea1d821 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Lazy-loading 'flavor' on Instance uuid 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:30:09.296035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c26081c4-f8f5-4d92-8bc5-4f0a9ea1d821 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Going to try to live migrate instance to tempest-host-298292544 {{(pid=122432) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 07 12:30:09.335825 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-c26081c4-f8f5-4d92-8bc5-4f0a9ea1d821 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] HTTP exception thrown: Compute host tempest-host-298292544 could not be found. Sep 07 12:30:09.347717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c26081c4-f8f5-4d92-8bc5-4f0a9ea1d821 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Request method failure captured: Sep 07 12:30:09.347717 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657/action HTTP/1.1 Sep 07 12:30:09.347717 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:30:09.347717 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:30:09.347717 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:30:09.347717 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 106 Sep 07 12:30:09.347717 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:30:09.347717 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:30:09.347717 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:30:09.347717 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:30:09.347717 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI6zuAoMbXZq0kmCn-tWXJOs9zG8i-BtZsEIEZipVmEaZpYMpqLASq69Ugy3_PDBoUUDUPlj2go5cTb2nyPV7cankvbYNigVOYkzWbgmRP3GbVDchjcMlVEju51xWw12aWFbfYYaNZX3VrwoNktuoWkYNkNmfukO1yk6B-iV9DdyvrY Sep 07 12:30:09.347717 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:30:09.347717 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:30:09.347717 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:30:09.347717 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:30:09.347717 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:30:09.347717 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:30:09.347717 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 2f9041c5ee2344cba301e8c922688254 Sep 07 12:30:09.347717 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-LiveMigrationNegativeTest-752588552 Sep 07 12:30:09.347717 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member,admin Sep 07 12:30:09.347717 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member,admin Sep 07 12:30:09.349800 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f9041c5ee2344cba301e8c922688254"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2f9041c5ee2344cba301e8c922688254"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2f9041c5ee2344cba301e8c922688254"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f9041c5ee2344cba301e8c922688254"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:30:09.349800 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-LiveMigrationNegativeTest-752588552 Sep 07 12:30:09.349800 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 2f9041c5ee2344cba301e8c922688254 Sep 07 12:30:09.349800 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-752588552 Sep 07 12:30:09.349800 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-LiveMigrationNegativeTest-752588552-project-admin Sep 07 12:30:09.349800 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:30:09.349800 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:30:09.349800 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 5949de773f1d4514b43da40bdf169f31 Sep 07 12:30:09.349800 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-LiveMigrationNegativeTest-752588552-project-admin Sep 07 12:30:09.349800 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:30:09.349800 n-d-852087-9 devstack@n-api.service[122432]: {"os-migrateLive": {"host": "tempest-host-298292544", "block_migration": true, "disk_over_commit": false}} Sep 07 12:30:09.349800 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:30:09.351350 n-d-852087-9 devstack@n-api.service[122432]: exception: Compute host tempest-host-298292544 could not be found. Sep 07 12:30:09.351350 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657', 'body': {'os-migrateLive': {'host': 'tempest-host-298292544', 'block_migration': True, 'disk_over_commit': False}}} Sep 07 12:30:09.351350 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:30:09.351350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:09.351350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 07 12:30:09.351350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 07 12:30:09.351350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 07 12:30:09.351350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 12:30:09.351350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 07 12:30:09.351350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 12:30:09.351350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 07 12:30:09.351350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 12:30:09.351350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 07 12:30:09.351350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 12:30:09.351350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 07 12:30:09.351350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 12:30:09.351350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 07 12:30:09.351350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 12:30:09.351350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 12:30:09.352682 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 12:30:09.352682 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 12:30:09.352682 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 12:30:09.352682 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Sep 07 12:30:09.352682 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Sep 07 12:30:09.352682 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:30:09.352682 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:30:09.352682 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Sep 07 12:30:09.352682 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Sep 07 12:30:09.352682 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Sep 07 12:30:09.352682 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:09.352682 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Sep 07 12:30:09.352682 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Sep 07 12:30:09.352682 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Sep 07 12:30:09.352682 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Sep 07 12:30:09.352682 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Sep 07 12:30:09.352682 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Sep 07 12:30:09.352682 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-298292544 could not be found. Sep 07 12:30:09.352682 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:09.356621 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:09.356621 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:09.356621 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:09.356621 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:09.356621 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:09.356621 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:30:09.356621 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:30:09.356621 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:30:09.356621 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:09.356621 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:30:09.356621 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:30:09.356621 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:30:09.356621 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:30:09.356621 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:30:09.356621 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:30:09.356621 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 07 12:30:09.356621 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Sep 07 12:30:09.356621 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 12:30:09.356621 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-298292544 could not be found. Sep 07 12:30:09.356621 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:09.360163 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:09.360163 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:09.360163 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:09.360163 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:09.360163 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:09.360163 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:30:09.360163 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:30:09.360163 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-298292544 could not be found. Sep 07 12:30:09.360163 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:09.360163 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c26081c4-f8f5-4d92-8bc5-4f0a9ea1d821 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Returning 400 to user: Compute host tempest-host-298292544 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:30:09.360163 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c26081c4-f8f5-4d92-8bc5-4f0a9ea1d821 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657/action" status: 400 len: 99 microversion: 2.1 time: 0.718652 Sep 07 12:30:09.360163 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 280/566] 10.222.0.16 () {60 vars in 1279 bytes} [Wed Sep 7 12:30:08 2022] POST /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657/action => generated 99 bytes in 723 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 07 12:30:09.365948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8fce95db-394d-451d-887b-31d121fbe161 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:09.367976 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8fce95db-394d-451d-887b-31d121fbe161 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 2f60a676-5df0-44d4-b97f-4248a08a9f59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:09.396027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fce95db-394d-451d-887b-31d121fbe161 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:09.396948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fce95db-394d-451d-887b-31d121fbe161 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:09.397646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fce95db-394d-451d-887b-31d121fbe161 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:09.399230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fce95db-394d-451d-887b-31d121fbe161 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:09.399869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fce95db-394d-451d-887b-31d121fbe161 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:09.400306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fce95db-394d-451d-887b-31d121fbe161 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:09.601756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8fce95db-394d-451d-887b-31d121fbe161 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:09.612147 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8fce95db-394d-451d-887b-31d121fbe161 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59" status: 200 len: 1280 microversion: 2.1 time: 0.254747 Sep 07 12:30:09.613193 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 281/567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:09 2022] GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59 => generated 1280 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:09.639578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f9010907-88d0-4e36-8074-1ee93db4a15a tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:09.642310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f9010907-88d0-4e36-8074-1ee93db4a15a tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 97552bf3-7814-403e-b66c-582b2f4f703f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:09.650312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9010907-88d0-4e36-8074-1ee93db4a15a tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:09.651324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9010907-88d0-4e36-8074-1ee93db4a15a tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:09.653116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9010907-88d0-4e36-8074-1ee93db4a15a tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:09.654621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9010907-88d0-4e36-8074-1ee93db4a15a tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:09.655117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9010907-88d0-4e36-8074-1ee93db4a15a tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:09.655714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9010907-88d0-4e36-8074-1ee93db4a15a tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:10.015612 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cc19ab4d-aabf-4e1e-8ad8-5517769a9b4f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:10.026738 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cc19ab4d-aabf-4e1e-8ad8-5517769a9b4f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1313 microversion: 2.1 time: 1.210729 Sep 07 12:30:10.027718 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 287/568] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:08 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1313 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:10.033072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4be95774-5296-406b-aea8-8e81257d5459 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:10.033921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4be95774-5296-406b-aea8-8e81257d5459 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:10.043746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4be95774-5296-406b-aea8-8e81257d5459 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:10.044253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4be95774-5296-406b-aea8-8e81257d5459 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:10.044866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4be95774-5296-406b-aea8-8e81257d5459 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:10.045682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4be95774-5296-406b-aea8-8e81257d5459 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:10.046086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4be95774-5296-406b-aea8-8e81257d5459 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:10.046517 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4be95774-5296-406b-aea8-8e81257d5459 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:10.369199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f9010907-88d0-4e36-8074-1ee93db4a15a tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:10.380620 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f9010907-88d0-4e36-8074-1ee93db4a15a tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f" status: 200 len: 1386 microversion: 2.1 time: 0.765097 Sep 07 12:30:10.382394 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 282/569] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:09 2022] GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f => generated 1386 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:10.566373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4be95774-5296-406b-aea8-8e81257d5459 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:10.569108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:30:10.579570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f39997d2-06b4-470e-aeb6-f0dca6b3d3fe tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Calling method '.version_select at 0x7fc419670d30>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:10.584362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f39997d2-06b4-470e-aeb6-f0dca6b3d3fe tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:10.604479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f39997d2-06b4-470e-aeb6-f0dca6b3d3fe tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:10.606914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f39997d2-06b4-470e-aeb6-f0dca6b3d3fe tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:10.608134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f39997d2-06b4-470e-aeb6-f0dca6b3d3fe tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:10.610024 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4be95774-5296-406b-aea8-8e81257d5459 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657" status: 200 len: 1468 microversion: 2.1 time: 0.581018 Sep 07 12:30:10.610751 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f39997d2-06b4-470e-aeb6-f0dca6b3d3fe tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:10.611421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f39997d2-06b4-470e-aeb6-f0dca6b3d3fe tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:10.615179 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 288/570] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:10 2022] GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 => generated 1468 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:10.638275 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-22d541a9-074a-466d-90d1-f42b85ad8cbd tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:10.639231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-22d541a9-074a-466d-90d1-f42b85ad8cbd tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:10.659539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22d541a9-074a-466d-90d1-f42b85ad8cbd tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:10.660098 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22d541a9-074a-466d-90d1-f42b85ad8cbd tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:10.661175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22d541a9-074a-466d-90d1-f42b85ad8cbd tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:10.666522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22d541a9-074a-466d-90d1-f42b85ad8cbd tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:10.667242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22d541a9-074a-466d-90d1-f42b85ad8cbd tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:10.667993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22d541a9-074a-466d-90d1-f42b85ad8cbd tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:10.700679 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f39997d2-06b4-470e-aeb6-f0dca6b3d3fe tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.314805 Sep 07 12:30:10.702329 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 283/571] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Sep 7 12:30:10 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:30:10.714171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b3bb92b-c8f3-41ea-adba-91a97d0bc8e5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:10.715681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2b3bb92b-c8f3-41ea-adba-91a97d0bc8e5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:10.734238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b3bb92b-c8f3-41ea-adba-91a97d0bc8e5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:10.735504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b3bb92b-c8f3-41ea-adba-91a97d0bc8e5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:10.740125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b3bb92b-c8f3-41ea-adba-91a97d0bc8e5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:10.741462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b3bb92b-c8f3-41ea-adba-91a97d0bc8e5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:10.743520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b3bb92b-c8f3-41ea-adba-91a97d0bc8e5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:10.744224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b3bb92b-c8f3-41ea-adba-91a97d0bc8e5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:10.839142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-22d541a9-074a-466d-90d1-f42b85ad8cbd tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:10.851159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-22d541a9-074a-466d-90d1-f42b85ad8cbd tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:10.858606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-22d541a9-074a-466d-90d1-f42b85ad8cbd tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:10.865168 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-22d541a9-074a-466d-90d1-f42b85ad8cbd tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1447 microversion: 2.75 time: 0.248655 Sep 07 12:30:10.866756 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 289/572] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:10 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1447 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:30:10.873261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c00a505f-e8a5-4e38-b2c4-5da9f250df90 req-da2370ff-1527-4dfc-98ae-91db3a510983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97552bf3-7814-403e-b66c-582b2f4f703f", "tag": "6577c68c-93a9-4100-9045-b5fed985d7db"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:10.898846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c00a505f-e8a5-4e38-b2c4-5da9f250df90 req-da2370ff-1527-4dfc-98ae-91db3a510983 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:10.900847 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c00a505f-e8a5-4e38-b2c4-5da9f250df90 req-da2370ff-1527-4dfc-98ae-91db3a510983 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:10.906444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c00a505f-e8a5-4e38-b2c4-5da9f250df90 req-da2370ff-1527-4dfc-98ae-91db3a510983 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:10.940012 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c00a505f-e8a5-4e38-b2c4-5da9f250df90 req-da2370ff-1527-4dfc-98ae-91db3a510983 service nova] Creating event network-changed:6577c68c-93a9-4100-9045-b5fed985d7db for instance 97552bf3-7814-403e-b66c-582b2f4f703f on n-h1-852087-9 Sep 07 12:30:10.946947 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c00a505f-e8a5-4e38-b2c4-5da9f250df90 req-da2370ff-1527-4dfc-98ae-91db3a510983 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078662 Sep 07 12:30:10.950771 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 290/573] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:30:10.963883 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de777965-5b28-4f84-a07f-3b6af626f99e tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:10.965080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-de777965-5b28-4f84-a07f-3b6af626f99e tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 2f60a676-5df0-44d4-b97f-4248a08a9f59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:10.973937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de777965-5b28-4f84-a07f-3b6af626f99e tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:10.974879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de777965-5b28-4f84-a07f-3b6af626f99e tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:10.975858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de777965-5b28-4f84-a07f-3b6af626f99e tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:10.980279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de777965-5b28-4f84-a07f-3b6af626f99e tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:10.980950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de777965-5b28-4f84-a07f-3b6af626f99e tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:10.983811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de777965-5b28-4f84-a07f-3b6af626f99e tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:11.147306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2b3bb92b-c8f3-41ea-adba-91a97d0bc8e5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:11.159224 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2b3bb92b-c8f3-41ea-adba-91a97d0bc8e5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1504 microversion: 2.1 time: 0.455375 Sep 07 12:30:11.167692 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 284/574] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:10 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1504 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:11.382540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-01dbd7d8-5cb2-4a3f-9dae-73df6087583b tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] Calling method '.version_select at 0x7fc4194da4c0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:11.390401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-01dbd7d8-5cb2-4a3f-9dae-73df6087583b tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '70f3bfa4a5b645c1b0f32e05dc36d63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f7ff61d23540469554f9609c857c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:11.394507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-01dbd7d8-5cb2-4a3f-9dae-73df6087583b tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] Request method failure captured: Sep 07 12:30:11.394507 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Sep 07 12:30:11.394507 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:30:11.394507 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:30:11.394507 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:30:11.394507 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:30:11.394507 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:30:11.394507 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:30:11.394507 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:30:11.394507 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:30:11.394507 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI7PVztdY3xBDWZCaD1KrwTs7sNreRAy3xPivnxfBW75ALeMHUIHBDCwJrB1uCv9pL9zAYT3_JpWyMe8kCh08VmHU-PLLsTfBTExUQI9jsETZedI54t0ut6Skny4czn19QJa2E8rIfB7kf9rWIvWIGPl9Ur7wlH5fw3qAVtaQmemqFU Sep 07 12:30:11.394507 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:30:11.394507 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:30:11.394507 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:30:11.394507 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:30:11.394507 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:30:11.394507 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:30:11.394507 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: b3f7ff61d23540469554f9609c857c52 Sep 07 12:30:11.394507 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-955394105 Sep 07 12:30:11.394507 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:30:11.394507 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:30:11.396963 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3f7ff61d23540469554f9609c857c52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3f7ff61d23540469554f9609c857c52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3f7ff61d23540469554f9609c857c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3f7ff61d23540469554f9609c857c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:30:11.396963 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-HostsAdminNegativeTestJSON-955394105 Sep 07 12:30:11.396963 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: b3f7ff61d23540469554f9609c857c52 Sep 07 12:30:11.396963 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-955394105 Sep 07 12:30:11.396963 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-HostsAdminNegativeTestJSON-955394105-project Sep 07 12:30:11.396963 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:30:11.396963 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:30:11.396963 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 70f3bfa4a5b645c1b0f32e05dc36d63a Sep 07 12:30:11.396963 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-HostsAdminNegativeTestJSON-955394105-project Sep 07 12:30:11.396963 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:30:11.396963 n-d-852087-9 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 07 12:30:11.396963 n-d-852087-9 devstack@n-api.service[122432]: action_args: {} Sep 07 12:30:11.396963 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:30:11.401286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:11.401286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:11.401286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:11.401286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:30:11.401286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:30:11.401286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:30:11.401286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:30:11.401286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 12:30:11.401286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:30:11.401286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:30:11.401286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:11.401286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Sep 07 12:30:11.401286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Sep 07 12:30:11.401286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:30:11.401286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:30:11.401286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:30:11.401286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:30:11.401286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:30:11.401286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:30:11.403482 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:30:11.403482 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:30:11.403482 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:30:11.403482 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:30:11.403482 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:30:11.403482 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:30:11.403482 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:30:11.403482 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:30:11.403482 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 07 12:30:11.403482 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:11.403482 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:11.403482 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:11.403482 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:11.403482 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:11.403482 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:11.403482 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:30:11.403482 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:30:11.403482 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 07 12:30:11.403482 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:11.408650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-01dbd7d8-5cb2-4a3f-9dae-73df6087583b tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:30:11.410548 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-01dbd7d8-5cb2-4a3f-9dae-73df6087583b tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.241282 Sep 07 12:30:11.412050 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 285/575] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Sep 7 12:30:11 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 244 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:30:11.420563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0a3a5370-55a8-4ed8-9995-b12f6edaa643 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1633681012", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:11.518123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-de777965-5b28-4f84-a07f-3b6af626f99e tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:11.528252 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-de777965-5b28-4f84-a07f-3b6af626f99e tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59" status: 200 len: 1322 microversion: 2.1 time: 0.575638 Sep 07 12:30:11.530477 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 291/576] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:10 2022] GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59 => generated 1322 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:11.546254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1384fde0-bc4c-457a-8836-d9f3f9bf97ae tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:11.547158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1384fde0-bc4c-457a-8836-d9f3f9bf97ae tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:11.558624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1384fde0-bc4c-457a-8836-d9f3f9bf97ae tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:11.558980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1384fde0-bc4c-457a-8836-d9f3f9bf97ae tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:11.559420 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1384fde0-bc4c-457a-8836-d9f3f9bf97ae tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:11.567064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1384fde0-bc4c-457a-8836-d9f3f9bf97ae tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:11.567755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1384fde0-bc4c-457a-8836-d9f3f9bf97ae tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:11.568214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1384fde0-bc4c-457a-8836-d9f3f9bf97ae tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:11.583988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-0a3a5370-55a8-4ed8-9995-b12f6edaa643 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:30:12.106995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1384fde0-bc4c-457a-8836-d9f3f9bf97ae tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:12.116737 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1384fde0-bc4c-457a-8836-d9f3f9bf97ae tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1313 microversion: 2.1 time: 0.582289 Sep 07 12:30:12.132713 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 292/577] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:11 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1313 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:12.138038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-29c8bbf4-aabb-4e63-a9a2-4d4f510ce01f req-cbbf310b-0a4d-4048-8553-013fc4c39259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd64235e-b7e5-4a81-a2f8-49bb09fecdf9", "tag": "f96d9d76-2187-4026-8333-d92e5985ac08"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:12.148694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-29c8bbf4-aabb-4e63-a9a2-4d4f510ce01f req-cbbf310b-0a4d-4048-8553-013fc4c39259 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:12.149430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-29c8bbf4-aabb-4e63-a9a2-4d4f510ce01f req-cbbf310b-0a4d-4048-8553-013fc4c39259 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:12.150030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-29c8bbf4-aabb-4e63-a9a2-4d4f510ce01f req-cbbf310b-0a4d-4048-8553-013fc4c39259 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:12.171697 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-29c8bbf4-aabb-4e63-a9a2-4d4f510ce01f req-cbbf310b-0a4d-4048-8553-013fc4c39259 service nova] Creating event network-changed:f96d9d76-2187-4026-8333-d92e5985ac08 for instance bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 on n-h2-852087-9 Sep 07 12:30:12.179185 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-29c8bbf4-aabb-4e63-a9a2-4d4f510ce01f req-cbbf310b-0a4d-4048-8553-013fc4c39259 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044776 Sep 07 12:30:12.181640 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 293/578] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:30:12.186985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f75045cb-f63f-436c-a123-6dd8413a6a7c tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:12.188652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f75045cb-f63f-436c-a123-6dd8413a6a7c tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 97552bf3-7814-403e-b66c-582b2f4f703f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:12.196484 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f75045cb-f63f-436c-a123-6dd8413a6a7c tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:12.197067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f75045cb-f63f-436c-a123-6dd8413a6a7c tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:12.197579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f75045cb-f63f-436c-a123-6dd8413a6a7c tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:12.198382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f75045cb-f63f-436c-a123-6dd8413a6a7c tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:12.198920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f75045cb-f63f-436c-a123-6dd8413a6a7c tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:12.199396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f75045cb-f63f-436c-a123-6dd8413a6a7c tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:12.320700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0a3a5370-55a8-4ed8-9995-b12f6edaa643 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:30:12.321405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0a3a5370-55a8-4ed8-9995-b12f6edaa643 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:30:12.322151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0a3a5370-55a8-4ed8-9995-b12f6edaa643 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:30:12.322938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0a3a5370-55a8-4ed8-9995-b12f6edaa643 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:30:12.323524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0a3a5370-55a8-4ed8-9995-b12f6edaa643 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:30:12.347825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a3a5370-55a8-4ed8-9995-b12f6edaa643 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:12.348578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a3a5370-55a8-4ed8-9995-b12f6edaa643 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:12.350226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a3a5370-55a8-4ed8-9995-b12f6edaa643 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:12.351547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a3a5370-55a8-4ed8-9995-b12f6edaa643 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:12.352177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a3a5370-55a8-4ed8-9995-b12f6edaa643 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:12.352888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a3a5370-55a8-4ed8-9995-b12f6edaa643 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:12.377470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-0a3a5370-55a8-4ed8-9995-b12f6edaa643 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Getting quotas for project 850b3068e7bd4e11b737c74c14f40f70. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:30:12.382902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-0a3a5370-55a8-4ed8-9995-b12f6edaa643 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Getting quotas for user 6f0d61feae834d42a5607d482a3a8353 and project 850b3068e7bd4e11b737c74c14f40f70. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:30:12.397760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0a3a5370-55a8-4ed8-9995-b12f6edaa643 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:30:12.400189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0a3a5370-55a8-4ed8-9995-b12f6edaa643 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: e640bc92-0f42-4b0c-b725-9f8d9955e599] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:30:12.467428 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0a3a5370-55a8-4ed8-9995-b12f6edaa643 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.053534 Sep 07 12:30:12.479351 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 286/579] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:30:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:30:12.487110 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-10e661de-1127-4127-9e19-961bae408524 tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] Calling method '.version_select at 0x7fc41953faf0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:12.502703 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-10e661de-1127-4127-9e19-961bae408524 tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '70f3bfa4a5b645c1b0f32e05dc36d63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f7ff61d23540469554f9609c857c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:12.505809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-10e661de-1127-4127-9e19-961bae408524 tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] Request method failure captured: Sep 07 12:30:12.505809 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-hosts/n-d-852087-9/reboot HTTP/1.1 Sep 07 12:30:12.505809 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:30:12.505809 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:30:12.505809 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:30:12.505809 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:30:12.505809 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:30:12.505809 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:30:12.505809 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:30:12.505809 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:30:12.505809 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI7PVztdY3xBDWZCaD1KrwTs7sNreRAy3xPivnxfBW75ALeMHUIHBDCwJrB1uCv9pL9zAYT3_JpWyMe8kCh08VmHU-PLLsTfBTExUQI9jsETZedI54t0ut6Skny4czn19QJa2E8rIfB7kf9rWIvWIGPl9Ur7wlH5fw3qAVtaQmemqFU Sep 07 12:30:12.505809 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:30:12.505809 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:30:12.505809 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:30:12.505809 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:30:12.505809 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:30:12.505809 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:30:12.505809 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: b3f7ff61d23540469554f9609c857c52 Sep 07 12:30:12.505809 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-955394105 Sep 07 12:30:12.505809 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:30:12.505809 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:30:12.507239 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3f7ff61d23540469554f9609c857c52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3f7ff61d23540469554f9609c857c52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3f7ff61d23540469554f9609c857c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3f7ff61d23540469554f9609c857c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:30:12.507239 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-HostsAdminNegativeTestJSON-955394105 Sep 07 12:30:12.507239 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: b3f7ff61d23540469554f9609c857c52 Sep 07 12:30:12.507239 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-955394105 Sep 07 12:30:12.507239 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-HostsAdminNegativeTestJSON-955394105-project Sep 07 12:30:12.507239 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:30:12.507239 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:30:12.507239 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 70f3bfa4a5b645c1b0f32e05dc36d63a Sep 07 12:30:12.507239 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-HostsAdminNegativeTestJSON-955394105-project Sep 07 12:30:12.507239 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:30:12.507239 n-d-852087-9 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 07 12:30:12.507239 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'n-d-852087-9'} Sep 07 12:30:12.507239 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:30:12.508001 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:12.508001 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:12.508001 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:12.508001 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:30:12.508001 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:30:12.508001 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:30:12.508001 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:30:12.508001 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:30:12.508001 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:12.508001 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Sep 07 12:30:12.508001 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Sep 07 12:30:12.508001 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:30:12.508001 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:30:12.508001 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:30:12.508001 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:30:12.508001 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:30:12.508001 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:30:12.508001 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:30:12.508001 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:30:12.509119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:30:12.509119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:30:12.509119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:30:12.509119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:30:12.509119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:30:12.509119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:30:12.509119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 07 12:30:12.509119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:12.509119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:12.509119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:12.509119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:12.509119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:12.509119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:12.509119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:30:12.509119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:30:12.509119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 07 12:30:12.509119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:12.513913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-10e661de-1127-4127-9e19-961bae408524 tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:30:12.514852 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-10e661de-1127-4127-9e19-961bae408524 tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-852087-9/reboot" status: 403 len: 111 microversion: 2.1 time: 0.034012 Sep 07 12:30:12.515420 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 287/580] 10.222.0.16 () {58 vars in 1188 bytes} [Wed Sep 7 12:30:12 2022] GET /compute/v2.1/os-hosts/n-d-852087-9/reboot => generated 111 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:30:12.520856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b984f96-b725-4050-9cf9-39ceba2cc429 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:12.521474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2b984f96-b725-4050-9cf9-39ceba2cc429 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:12.529617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b984f96-b725-4050-9cf9-39ceba2cc429 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:12.530456 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b984f96-b725-4050-9cf9-39ceba2cc429 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:12.531064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b984f96-b725-4050-9cf9-39ceba2cc429 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:12.533408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b984f96-b725-4050-9cf9-39ceba2cc429 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:12.534292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b984f96-b725-4050-9cf9-39ceba2cc429 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:12.534889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b984f96-b725-4050-9cf9-39ceba2cc429 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:12.704949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f75045cb-f63f-436c-a123-6dd8413a6a7c tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:12.715818 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f75045cb-f63f-436c-a123-6dd8413a6a7c tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f" status: 200 len: 1386 microversion: 2.1 time: 0.533024 Sep 07 12:30:12.732498 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 294/581] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:12 2022] GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f => generated 1386 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:12.745041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-451711e4-bea1-41a9-b1c6-d9b90454b26c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:12.746818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2b984f96-b725-4050-9cf9-39ceba2cc429 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:12.771606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-451711e4-bea1-41a9-b1c6-d9b90454b26c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:12.784024 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2b984f96-b725-4050-9cf9-39ceba2cc429 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:12.790533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2b984f96-b725-4050-9cf9-39ceba2cc429 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:12.796612 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-451711e4-bea1-41a9-b1c6-d9b90454b26c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:12.799616 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-451711e4-bea1-41a9-b1c6-d9b90454b26c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:12.800446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-451711e4-bea1-41a9-b1c6-d9b90454b26c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:12.801729 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2b984f96-b725-4050-9cf9-39ceba2cc429 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1447 microversion: 2.75 time: 0.285030 Sep 07 12:30:12.802462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-451711e4-bea1-41a9-b1c6-d9b90454b26c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:12.804901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-451711e4-bea1-41a9-b1c6-d9b90454b26c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:12.806766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-451711e4-bea1-41a9-b1c6-d9b90454b26c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:12.815932 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 288/582] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:12 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1447 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:30:12.832578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-18e19d49-cfd2-4510-8db4-4c939d1952a4 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:12.833211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-18e19d49-cfd2-4510-8db4-4c939d1952a4 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: e640bc92-0f42-4b0c-b725-9f8d9955e599] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:12.846254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:30:13.031325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-18e19d49-cfd2-4510-8db4-4c939d1952a4 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:13.040440 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-18e19d49-cfd2-4510-8db4-4c939d1952a4 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599" status: 200 len: 1219 microversion: 2.1 time: 0.220335 Sep 07 12:30:13.045833 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 289/583] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:12 2022] GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599 => generated 1219 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:13.065926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3a61d78f-e11b-4841-b32a-c6caf1cc207e tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Calling method '.version_select at 0x7fc4194dfd30>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:13.089385 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-3a61d78f-e11b-4841-b32a-c6caf1cc207e tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 12:30:13.095429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3a61d78f-e11b-4841-b32a-c6caf1cc207e tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Request method failure captured: Sep 07 12:30:13.095429 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Sep 07 12:30:13.095429 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:30:13.095429 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:30:13.095429 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:30:13.095429 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:30:13.095429 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:30:13.095429 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:30:13.095429 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:30:13.095429 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:30:13.095429 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI7RwfEqsjp_OLURlHSOiTUQrY_UC1CoweahxaNsPVOwahwea6k4Suye5MyD-Htn5541voMJ4Owvi5BgfXzcNRSQ1br3J3xnQzq7ROpXC_tZ9vta_vhvw8JggdgQ2mmgY6SkUusfQqiUIS3ut5nEEkDjmX-Ck39L2HLafsjBzUsgXPk Sep 07 12:30:13.095429 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:30:13.095429 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:30:13.095429 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:30:13.095429 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:30:13.095429 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:30:13.095429 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:30:13.095429 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 6b723fb4cad04219b990c95be091faa4 Sep 07 12:30:13.095429 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-906743245 Sep 07 12:30:13.095429 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member,admin Sep 07 12:30:13.095429 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member,admin Sep 07 12:30:13.096872 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b723fb4cad04219b990c95be091faa4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6b723fb4cad04219b990c95be091faa4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6b723fb4cad04219b990c95be091faa4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b723fb4cad04219b990c95be091faa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:30:13.096872 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-HostsAdminNegativeTestJSON-906743245 Sep 07 12:30:13.096872 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 6b723fb4cad04219b990c95be091faa4 Sep 07 12:30:13.096872 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-906743245 Sep 07 12:30:13.096872 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-HostsAdminNegativeTestJSON-906743245-project-admin Sep 07 12:30:13.096872 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:30:13.096872 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:30:13.096872 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: e2ac1d26ee4241d2ad3aa35456416270 Sep 07 12:30:13.096872 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-HostsAdminNegativeTestJSON-906743245-project-admin Sep 07 12:30:13.096872 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:30:13.096872 n-d-852087-9 devstack@n-api.service[122432]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 12:30:13.096872 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'nonexistent_hostname'} Sep 07 12:30:13.096872 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:30:13.097755 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:13.097755 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 07 12:30:13.097755 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 07 12:30:13.097755 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 12:30:13.097755 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 12:30:13.097755 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:30:13.097755 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:30:13.097755 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:30:13.097755 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:30:13.097755 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 12:30:13.097755 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 12:30:13.097755 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 07 12:30:13.097755 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 07 12:30:13.097755 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:30:13.097755 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:30:13.097755 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 07 12:30:13.097755 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 07 12:30:13.097755 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 12:30:13.097755 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 12:30:13.098920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 07 12:30:13.098920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 07 12:30:13.098920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 12:30:13.098920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:13.098920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:13.098920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:13.098920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:13.098920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:13.098920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:13.098920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:30:13.098920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:30:13.098920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:30:13.098920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:30:13.098920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:30:13.098920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:13.098920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Sep 07 12:30:13.098920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Sep 07 12:30:13.098920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 07 12:30:13.098920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:30:13.099996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 12:30:13.099996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:13.099996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:13.099996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:13.099996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:13.099996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:13.099996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:13.099996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:30:13.099996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:30:13.099996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 12:30:13.099996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:13.102320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3a61d78f-e11b-4841-b32a-c6caf1cc207e tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:30:13.103624 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3a61d78f-e11b-4841-b32a-c6caf1cc207e tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.056715 Sep 07 12:30:13.106189 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 290/584] 10.222.0.16 () {58 vars in 1212 bytes} [Wed Sep 7 12:30:13 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:30:13.123295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5f775660-1e81-4bb3-b887-304eb50f7e71 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:13.124248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5f775660-1e81-4bb3-b887-304eb50f7e71 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 2f60a676-5df0-44d4-b97f-4248a08a9f59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:13.143131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f775660-1e81-4bb3-b887-304eb50f7e71 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:13.145858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f775660-1e81-4bb3-b887-304eb50f7e71 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:13.146731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f775660-1e81-4bb3-b887-304eb50f7e71 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:13.147753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f775660-1e81-4bb3-b887-304eb50f7e71 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:13.148977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f775660-1e81-4bb3-b887-304eb50f7e71 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:13.149752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f775660-1e81-4bb3-b887-304eb50f7e71 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:13.662860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-451711e4-bea1-41a9-b1c6-d9b90454b26c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:13.680455 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-451711e4-bea1-41a9-b1c6-d9b90454b26c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1504 microversion: 2.1 time: 0.946044 Sep 07 12:30:13.705085 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 295/585] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:12 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1504 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:13.728155 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e4221a5f-49dc-4523-b170-af991aab2da8 tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] Calling method '.version_select at 0x7fc419795940>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:13.730381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e4221a5f-49dc-4523-b170-af991aab2da8 tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '70f3bfa4a5b645c1b0f32e05dc36d63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f7ff61d23540469554f9609c857c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:13.741765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e4221a5f-49dc-4523-b170-af991aab2da8 tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] Request method failure captured: Sep 07 12:30:13.741765 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-hosts/n-d-852087-9 HTTP/1.1 Sep 07 12:30:13.741765 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:30:13.741765 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:30:13.741765 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:30:13.741765 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:30:13.741765 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:30:13.741765 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:30:13.741765 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:30:13.741765 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:30:13.741765 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI7PVztdY3xBDWZCaD1KrwTs7sNreRAy3xPivnxfBW75ALeMHUIHBDCwJrB1uCv9pL9zAYT3_JpWyMe8kCh08VmHU-PLLsTfBTExUQI9jsETZedI54t0ut6Skny4czn19QJa2E8rIfB7kf9rWIvWIGPl9Ur7wlH5fw3qAVtaQmemqFU Sep 07 12:30:13.741765 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:30:13.741765 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:30:13.741765 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:30:13.741765 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:30:13.741765 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:30:13.741765 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:30:13.741765 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: b3f7ff61d23540469554f9609c857c52 Sep 07 12:30:13.741765 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-955394105 Sep 07 12:30:13.741765 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:30:13.741765 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:30:13.743399 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3f7ff61d23540469554f9609c857c52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3f7ff61d23540469554f9609c857c52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3f7ff61d23540469554f9609c857c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3f7ff61d23540469554f9609c857c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:30:13.743399 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-HostsAdminNegativeTestJSON-955394105 Sep 07 12:30:13.743399 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: b3f7ff61d23540469554f9609c857c52 Sep 07 12:30:13.743399 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-955394105 Sep 07 12:30:13.743399 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-HostsAdminNegativeTestJSON-955394105-project Sep 07 12:30:13.743399 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:30:13.743399 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:30:13.743399 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 70f3bfa4a5b645c1b0f32e05dc36d63a Sep 07 12:30:13.743399 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-HostsAdminNegativeTestJSON-955394105-project Sep 07 12:30:13.743399 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:30:13.743399 n-d-852087-9 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 07 12:30:13.743399 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'n-d-852087-9'} Sep 07 12:30:13.743399 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:30:13.744182 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:13.744182 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:13.744182 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:13.744182 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:30:13.744182 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:30:13.744182 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:30:13.744182 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:30:13.744182 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:30:13.744182 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:13.744182 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Sep 07 12:30:13.744182 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Sep 07 12:30:13.744182 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:30:13.744182 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:30:13.744182 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:30:13.744182 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:30:13.744182 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:30:13.744182 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:30:13.744182 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:30:13.744182 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:30:13.746123 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:30:13.746123 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:30:13.746123 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:30:13.746123 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:30:13.746123 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:30:13.746123 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:30:13.746123 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 07 12:30:13.746123 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:13.746123 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:13.746123 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:13.746123 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:13.746123 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:13.746123 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:13.746123 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:30:13.746123 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:30:13.746123 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 07 12:30:13.746123 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:13.753818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e4221a5f-49dc-4523-b170-af991aab2da8 tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:30:13.756796 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e4221a5f-49dc-4523-b170-af991aab2da8 tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-852087-9" status: 403 len: 109 microversion: 2.1 time: 0.049345 Sep 07 12:30:13.758977 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 296/586] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Sep 7 12:30:13 2022] GET /compute/v2.1/os-hosts/n-d-852087-9 => generated 109 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:30:13.773699 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9fcc6990-6ef2-455d-9e2e-a48ae4e6974b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:13.774487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9fcc6990-6ef2-455d-9e2e-a48ae4e6974b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:13.799265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9fcc6990-6ef2-455d-9e2e-a48ae4e6974b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:13.800381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9fcc6990-6ef2-455d-9e2e-a48ae4e6974b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:13.801107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9fcc6990-6ef2-455d-9e2e-a48ae4e6974b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:13.802144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9fcc6990-6ef2-455d-9e2e-a48ae4e6974b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:13.802815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9fcc6990-6ef2-455d-9e2e-a48ae4e6974b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:13.803391 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9fcc6990-6ef2-455d-9e2e-a48ae4e6974b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:14.065681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5f775660-1e81-4bb3-b887-304eb50f7e71 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:14.080091 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5f775660-1e81-4bb3-b887-304eb50f7e71 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59" status: 200 len: 1322 microversion: 2.1 time: 0.969070 Sep 07 12:30:14.094064 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 291/587] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:13 2022] GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59 => generated 1322 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:14.121559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e1f1350e-8bea-4f4c-adde-4ffbe0c603d8 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:14.128051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e1f1350e-8bea-4f4c-adde-4ffbe0c603d8 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 97552bf3-7814-403e-b66c-582b2f4f703f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:14.155524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1f1350e-8bea-4f4c-adde-4ffbe0c603d8 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:14.156320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1f1350e-8bea-4f4c-adde-4ffbe0c603d8 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:14.158248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1f1350e-8bea-4f4c-adde-4ffbe0c603d8 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:14.160799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1f1350e-8bea-4f4c-adde-4ffbe0c603d8 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:14.161455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1f1350e-8bea-4f4c-adde-4ffbe0c603d8 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:14.163521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1f1350e-8bea-4f4c-adde-4ffbe0c603d8 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:14.470536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9fcc6990-6ef2-455d-9e2e-a48ae4e6974b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:14.483524 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9fcc6990-6ef2-455d-9e2e-a48ae4e6974b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1313 microversion: 2.1 time: 0.723150 Sep 07 12:30:14.484688 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 297/588] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:13 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1313 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:14.490332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-30d0d462-fc51-4af4-bcb5-7aca32aafad8 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Calling method '.version_select at 0x7fc419763820>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:14.499182 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-30d0d462-fc51-4af4-bcb5-7aca32aafad8 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 12:30:14.505253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-30d0d462-fc51-4af4-bcb5-7aca32aafad8 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Request method failure captured: Sep 07 12:30:14.505253 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 07 12:30:14.505253 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:30:14.505253 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:30:14.505253 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:30:14.505253 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:30:14.505253 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:30:14.505253 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:30:14.505253 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:30:14.505253 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:30:14.505253 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI7RwfEqsjp_OLURlHSOiTUQrY_UC1CoweahxaNsPVOwahwea6k4Suye5MyD-Htn5541voMJ4Owvi5BgfXzcNRSQ1br3J3xnQzq7ROpXC_tZ9vta_vhvw8JggdgQ2mmgY6SkUusfQqiUIS3ut5nEEkDjmX-Ck39L2HLafsjBzUsgXPk Sep 07 12:30:14.505253 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:30:14.505253 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:30:14.505253 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:30:14.505253 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:30:14.505253 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:30:14.505253 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:30:14.505253 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 6b723fb4cad04219b990c95be091faa4 Sep 07 12:30:14.505253 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-906743245 Sep 07 12:30:14.505253 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 12:30:14.505253 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 12:30:14.506856 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b723fb4cad04219b990c95be091faa4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6b723fb4cad04219b990c95be091faa4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6b723fb4cad04219b990c95be091faa4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b723fb4cad04219b990c95be091faa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:30:14.506856 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-HostsAdminNegativeTestJSON-906743245 Sep 07 12:30:14.506856 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 6b723fb4cad04219b990c95be091faa4 Sep 07 12:30:14.506856 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-906743245 Sep 07 12:30:14.506856 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-HostsAdminNegativeTestJSON-906743245-project-admin Sep 07 12:30:14.506856 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:30:14.506856 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:30:14.506856 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: e2ac1d26ee4241d2ad3aa35456416270 Sep 07 12:30:14.506856 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-HostsAdminNegativeTestJSON-906743245-project-admin Sep 07 12:30:14.506856 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:30:14.506856 n-d-852087-9 devstack@n-api.service[122433]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 12:30:14.506856 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'nonexistent_hostname'} Sep 07 12:30:14.506856 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:30:14.507855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:14.507855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Sep 07 12:30:14.507855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 07 12:30:14.507855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:30:14.507855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:30:14.507855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 07 12:30:14.507855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 07 12:30:14.507855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 12:30:14.507855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 12:30:14.507855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 07 12:30:14.507855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 07 12:30:14.507855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 12:30:14.507855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:14.507855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:14.507855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:14.507855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:14.507855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:14.507855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:14.507855 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:30:14.510008 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:30:14.510008 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:30:14.510008 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:30:14.510008 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:30:14.510008 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:14.510008 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Sep 07 12:30:14.510008 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:30:14.510008 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 12:30:14.510008 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:14.510008 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:14.510008 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:14.510008 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:14.510008 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:14.510008 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:14.510008 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:30:14.510008 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:30:14.510008 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 12:30:14.510008 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:14.513672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-30d0d462-fc51-4af4-bcb5-7aca32aafad8 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:30:14.514768 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-30d0d462-fc51-4af4-bcb5-7aca32aafad8 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.028862 Sep 07 12:30:14.515342 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 298/589] 10.222.0.16 () {58 vars in 1191 bytes} [Wed Sep 7 12:30:14 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:30:14.524064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-910310f4-fd52-49d0-ba07-050637ea5005 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:14.525010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-910310f4-fd52-49d0-ba07-050637ea5005 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:14.536141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:30:14.538817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-910310f4-fd52-49d0-ba07-050637ea5005 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:14.540054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-910310f4-fd52-49d0-ba07-050637ea5005 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:14.540747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-910310f4-fd52-49d0-ba07-050637ea5005 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:14.541750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-910310f4-fd52-49d0-ba07-050637ea5005 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:14.542674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-910310f4-fd52-49d0-ba07-050637ea5005 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:14.543707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-910310f4-fd52-49d0-ba07-050637ea5005 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:14.673388 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-910310f4-fd52-49d0-ba07-050637ea5005 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:14.687780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-910310f4-fd52-49d0-ba07-050637ea5005 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:14.694494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-910310f4-fd52-49d0-ba07-050637ea5005 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:14.707833 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-910310f4-fd52-49d0-ba07-050637ea5005 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1447 microversion: 2.75 time: 0.188881 Sep 07 12:30:14.714515 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 299/590] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:14 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1447 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:30:14.733292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9b8fe123-0cca-4944-a6ba-b19be6a60aeb tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:14.736499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9b8fe123-0cca-4944-a6ba-b19be6a60aeb tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: e640bc92-0f42-4b0c-b725-9f8d9955e599] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:14.752772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b8fe123-0cca-4944-a6ba-b19be6a60aeb tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:14.753620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b8fe123-0cca-4944-a6ba-b19be6a60aeb tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:14.754250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b8fe123-0cca-4944-a6ba-b19be6a60aeb tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:14.755144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b8fe123-0cca-4944-a6ba-b19be6a60aeb tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:14.755778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b8fe123-0cca-4944-a6ba-b19be6a60aeb tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:14.763044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b8fe123-0cca-4944-a6ba-b19be6a60aeb tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:14.777678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e1f1350e-8bea-4f4c-adde-4ffbe0c603d8 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:14.796588 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e1f1350e-8bea-4f4c-adde-4ffbe0c603d8 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f" status: 200 len: 1386 microversion: 2.1 time: 0.696956 Sep 07 12:30:14.797762 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 292/591] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:14 2022] GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f => generated 1386 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:14.809839 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-a0013012-12c7-45b6-b3ee-761fcb4edd1d req-d475393c-b492-4a4d-a6e8-30c5a9a939b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74efffee-c688-4fe1-88dd-a49eaa3d940e", "name": "network-vif-unplugged", "status": "completed", "tag": "53a321bf-b211-4774-a021-98fa126748f1"}, {"name": "network-changed", "server_uuid": "74efffee-c688-4fe1-88dd-a49eaa3d940e", "tag": "53a321bf-b211-4774-a021-98fa126748f1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:14.834486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a0013012-12c7-45b6-b3ee-761fcb4edd1d req-d475393c-b492-4a4d-a6e8-30c5a9a939b9 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:14.835143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a0013012-12c7-45b6-b3ee-761fcb4edd1d req-d475393c-b492-4a4d-a6e8-30c5a9a939b9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:14.835799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a0013012-12c7-45b6-b3ee-761fcb4edd1d req-d475393c-b492-4a4d-a6e8-30c5a9a939b9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:14.862758 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-a0013012-12c7-45b6-b3ee-761fcb4edd1d req-d475393c-b492-4a4d-a6e8-30c5a9a939b9 service nova] Creating event network-vif-unplugged:53a321bf-b211-4774-a021-98fa126748f1 for instance 74efffee-c688-4fe1-88dd-a49eaa3d940e on n-h1-852087-9 Sep 07 12:30:14.865883 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-a0013012-12c7-45b6-b3ee-761fcb4edd1d req-d475393c-b492-4a4d-a6e8-30c5a9a939b9 service nova] Creating event network-changed:53a321bf-b211-4774-a021-98fa126748f1 for instance 74efffee-c688-4fe1-88dd-a49eaa3d940e on n-h1-852087-9 Sep 07 12:30:14.876957 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-a0013012-12c7-45b6-b3ee-761fcb4edd1d req-d475393c-b492-4a4d-a6e8-30c5a9a939b9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.077535 Sep 07 12:30:14.880348 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 293/592] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:30:14.942050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-489eab05-4226-45ac-83c3-b6300f9e8e8c tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] Calling method '.version_select at 0x7fc4195aa670>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:14.944374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-489eab05-4226-45ac-83c3-b6300f9e8e8c tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '70f3bfa4a5b645c1b0f32e05dc36d63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f7ff61d23540469554f9609c857c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:14.948817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-489eab05-4226-45ac-83c3-b6300f9e8e8c tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] Request method failure captured: Sep 07 12:30:14.948817 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-hosts/n-d-852087-9/shutdown HTTP/1.1 Sep 07 12:30:14.948817 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:30:14.948817 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:30:14.948817 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:30:14.948817 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:30:14.948817 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:30:14.948817 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:30:14.948817 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:30:14.948817 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:30:14.948817 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI7PVztdY3xBDWZCaD1KrwTs7sNreRAy3xPivnxfBW75ALeMHUIHBDCwJrB1uCv9pL9zAYT3_JpWyMe8kCh08VmHU-PLLsTfBTExUQI9jsETZedI54t0ut6Skny4czn19QJa2E8rIfB7kf9rWIvWIGPl9Ur7wlH5fw3qAVtaQmemqFU Sep 07 12:30:14.948817 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:30:14.948817 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:30:14.948817 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:30:14.948817 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:30:14.948817 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:30:14.948817 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:30:14.948817 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: b3f7ff61d23540469554f9609c857c52 Sep 07 12:30:14.948817 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-955394105 Sep 07 12:30:14.948817 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:30:14.948817 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:30:14.950462 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3f7ff61d23540469554f9609c857c52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3f7ff61d23540469554f9609c857c52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3f7ff61d23540469554f9609c857c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3f7ff61d23540469554f9609c857c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:30:14.950462 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-HostsAdminNegativeTestJSON-955394105 Sep 07 12:30:14.950462 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: b3f7ff61d23540469554f9609c857c52 Sep 07 12:30:14.950462 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-955394105 Sep 07 12:30:14.950462 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-HostsAdminNegativeTestJSON-955394105-project Sep 07 12:30:14.950462 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:30:14.950462 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:30:14.950462 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 70f3bfa4a5b645c1b0f32e05dc36d63a Sep 07 12:30:14.950462 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-HostsAdminNegativeTestJSON-955394105-project Sep 07 12:30:14.950462 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:30:14.950462 n-d-852087-9 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 07 12:30:14.950462 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'n-d-852087-9'} Sep 07 12:30:14.950462 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:30:14.951256 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:14.951256 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:14.951256 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:14.951256 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:30:14.951256 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:30:14.951256 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:30:14.951256 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:30:14.951256 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:30:14.951256 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:14.951256 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Sep 07 12:30:14.951256 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Sep 07 12:30:14.951256 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:30:14.951256 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:30:14.951256 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:30:14.951256 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:30:14.951256 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:30:14.951256 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:30:14.951256 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:30:14.951256 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:30:14.952419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:30:14.952419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:30:14.952419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:30:14.952419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:30:14.952419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:30:14.952419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:30:14.952419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 07 12:30:14.952419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:14.952419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:14.952419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:14.952419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:14.952419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:14.952419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:14.952419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:30:14.952419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:30:14.952419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 07 12:30:14.952419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:14.965373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-489eab05-4226-45ac-83c3-b6300f9e8e8c tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:30:14.969554 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-489eab05-4226-45ac-83c3-b6300f9e8e8c tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-852087-9/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.087249 Sep 07 12:30:14.976384 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 294/593] 10.222.0.16 () {58 vars in 1194 bytes} [Wed Sep 7 12:30:14 2022] GET /compute/v2.1/os-hosts/n-d-852087-9/shutdown => generated 113 bytes in 95 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:30:14.984204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-831a8fcc-71b9-4a1a-aa15-5188b490c009 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:14.985293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-831a8fcc-71b9-4a1a-aa15-5188b490c009 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:14.989407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9b8fe123-0cca-4944-a6ba-b19be6a60aeb tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:14.995424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-831a8fcc-71b9-4a1a-aa15-5188b490c009 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:14.996078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-831a8fcc-71b9-4a1a-aa15-5188b490c009 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:14.996618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-831a8fcc-71b9-4a1a-aa15-5188b490c009 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:14.997629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-831a8fcc-71b9-4a1a-aa15-5188b490c009 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:14.998137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-831a8fcc-71b9-4a1a-aa15-5188b490c009 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:15.001778 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9b8fe123-0cca-4944-a6ba-b19be6a60aeb tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599" status: 200 len: 1271 microversion: 2.1 time: 0.286149 Sep 07 12:30:15.010961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-831a8fcc-71b9-4a1a-aa15-5188b490c009 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:15.017592 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 300/594] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:14 2022] GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599 => generated 1271 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:15.022600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0d234c16-02be-4c8b-b4e0-0f2d53c741a5 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Calling method '.version_select at 0x7fc4195ea940>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:15.050079 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-0d234c16-02be-4c8b-b4e0-0f2d53c741a5 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 12:30:15.051811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0d234c16-02be-4c8b-b4e0-0f2d53c741a5 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Request method failure captured: Sep 07 12:30:15.051811 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Sep 07 12:30:15.051811 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:30:15.051811 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:30:15.051811 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:30:15.051811 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:30:15.051811 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:30:15.051811 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:30:15.051811 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:30:15.051811 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:30:15.051811 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI7RwfEqsjp_OLURlHSOiTUQrY_UC1CoweahxaNsPVOwahwea6k4Suye5MyD-Htn5541voMJ4Owvi5BgfXzcNRSQ1br3J3xnQzq7ROpXC_tZ9vta_vhvw8JggdgQ2mmgY6SkUusfQqiUIS3ut5nEEkDjmX-Ck39L2HLafsjBzUsgXPk Sep 07 12:30:15.051811 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:30:15.051811 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:30:15.051811 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:30:15.051811 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:30:15.051811 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:30:15.051811 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:30:15.051811 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 6b723fb4cad04219b990c95be091faa4 Sep 07 12:30:15.051811 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-906743245 Sep 07 12:30:15.051811 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 12:30:15.051811 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 12:30:15.053336 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b723fb4cad04219b990c95be091faa4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6b723fb4cad04219b990c95be091faa4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6b723fb4cad04219b990c95be091faa4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b723fb4cad04219b990c95be091faa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:30:15.053336 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-HostsAdminNegativeTestJSON-906743245 Sep 07 12:30:15.053336 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 6b723fb4cad04219b990c95be091faa4 Sep 07 12:30:15.053336 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-906743245 Sep 07 12:30:15.053336 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-HostsAdminNegativeTestJSON-906743245-project-admin Sep 07 12:30:15.053336 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:30:15.053336 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:30:15.053336 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: e2ac1d26ee4241d2ad3aa35456416270 Sep 07 12:30:15.053336 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-HostsAdminNegativeTestJSON-906743245-project-admin Sep 07 12:30:15.053336 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:30:15.053336 n-d-852087-9 devstack@n-api.service[122433]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 12:30:15.053336 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'nonexistent_hostname'} Sep 07 12:30:15.053336 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:30:15.054445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:15.054445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 07 12:30:15.054445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 07 12:30:15.054445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 12:30:15.054445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 12:30:15.054445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:30:15.054445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:30:15.054445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:30:15.054445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:30:15.054445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 12:30:15.054445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 12:30:15.054445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 07 12:30:15.054445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 07 12:30:15.054445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:30:15.054445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:30:15.054445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 07 12:30:15.054445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 07 12:30:15.054445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 12:30:15.054445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 12:30:15.055806 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 07 12:30:15.055806 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 07 12:30:15.055806 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 12:30:15.055806 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:15.055806 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:15.055806 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:15.055806 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:15.055806 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:15.055806 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:15.055806 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:30:15.055806 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:30:15.055806 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:30:15.055806 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:30:15.055806 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:30:15.055806 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:15.055806 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Sep 07 12:30:15.055806 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Sep 07 12:30:15.055806 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 07 12:30:15.055806 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:30:15.057063 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 12:30:15.057063 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:15.057063 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:15.057063 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:15.057063 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:15.057063 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:15.057063 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:15.057063 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:30:15.057063 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:30:15.057063 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 12:30:15.057063 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:15.057063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0d234c16-02be-4c8b-b4e0-0f2d53c741a5 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:30:15.057063 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0d234c16-02be-4c8b-b4e0-0f2d53c741a5 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.034575 Sep 07 12:30:15.057063 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 301/595] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Sep 7 12:30:15 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:30:15.108636 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-28c1ae1c-5a2a-480d-8f37-520fc1f49b92 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:15.109431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-28c1ae1c-5a2a-480d-8f37-520fc1f49b92 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 2f60a676-5df0-44d4-b97f-4248a08a9f59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:15.123368 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28c1ae1c-5a2a-480d-8f37-520fc1f49b92 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:15.123872 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28c1ae1c-5a2a-480d-8f37-520fc1f49b92 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:15.124316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28c1ae1c-5a2a-480d-8f37-520fc1f49b92 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:15.125049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28c1ae1c-5a2a-480d-8f37-520fc1f49b92 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:15.125540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28c1ae1c-5a2a-480d-8f37-520fc1f49b92 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:15.125979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28c1ae1c-5a2a-480d-8f37-520fc1f49b92 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:15.461745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=26 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:30:15.517787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=41 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:30:15.528714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-831a8fcc-71b9-4a1a-aa15-5188b490c009 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:15.538550 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-831a8fcc-71b9-4a1a-aa15-5188b490c009 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1504 microversion: 2.1 time: 0.560557 Sep 07 12:30:15.542647 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 295/596] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:14 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1504 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:15.563822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bc2e1d39-a77e-4af9-b73a-7b3a7955d6ea tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] Calling method '.version_select at 0x7fc4194df430>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:15.566278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bc2e1d39-a77e-4af9-b73a-7b3a7955d6ea tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '70f3bfa4a5b645c1b0f32e05dc36d63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f7ff61d23540469554f9609c857c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:15.576747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bc2e1d39-a77e-4af9-b73a-7b3a7955d6ea tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] Request method failure captured: Sep 07 12:30:15.576747 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-hosts/n-d-852087-9/startup HTTP/1.1 Sep 07 12:30:15.576747 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:30:15.576747 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:30:15.576747 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:30:15.576747 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:30:15.576747 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:30:15.576747 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:30:15.576747 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:30:15.576747 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:30:15.576747 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI7PVztdY3xBDWZCaD1KrwTs7sNreRAy3xPivnxfBW75ALeMHUIHBDCwJrB1uCv9pL9zAYT3_JpWyMe8kCh08VmHU-PLLsTfBTExUQI9jsETZedI54t0ut6Skny4czn19QJa2E8rIfB7kf9rWIvWIGPl9Ur7wlH5fw3qAVtaQmemqFU Sep 07 12:30:15.576747 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:30:15.576747 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:30:15.576747 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:30:15.576747 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:30:15.576747 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:30:15.576747 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:30:15.576747 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: b3f7ff61d23540469554f9609c857c52 Sep 07 12:30:15.576747 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-955394105 Sep 07 12:30:15.576747 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:30:15.576747 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:30:15.579886 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3f7ff61d23540469554f9609c857c52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3f7ff61d23540469554f9609c857c52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3f7ff61d23540469554f9609c857c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3f7ff61d23540469554f9609c857c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:30:15.579886 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-HostsAdminNegativeTestJSON-955394105 Sep 07 12:30:15.579886 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: b3f7ff61d23540469554f9609c857c52 Sep 07 12:30:15.579886 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-955394105 Sep 07 12:30:15.579886 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-HostsAdminNegativeTestJSON-955394105-project Sep 07 12:30:15.579886 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:30:15.579886 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:30:15.579886 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 70f3bfa4a5b645c1b0f32e05dc36d63a Sep 07 12:30:15.579886 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-HostsAdminNegativeTestJSON-955394105-project Sep 07 12:30:15.579886 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:30:15.579886 n-d-852087-9 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 07 12:30:15.579886 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'n-d-852087-9'} Sep 07 12:30:15.579886 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:30:15.581828 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:15.581828 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:15.581828 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:15.581828 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:30:15.581828 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:30:15.581828 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:30:15.581828 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:30:15.581828 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:30:15.581828 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:15.581828 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Sep 07 12:30:15.581828 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Sep 07 12:30:15.581828 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:30:15.581828 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:30:15.581828 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:30:15.581828 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:30:15.581828 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:30:15.581828 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:30:15.581828 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:30:15.581828 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:30:15.584516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:30:15.584516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:30:15.584516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:30:15.584516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:30:15.584516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:30:15.584516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:30:15.584516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 07 12:30:15.584516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:15.584516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:15.584516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:15.584516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:15.584516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:15.584516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:15.584516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:30:15.584516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:30:15.584516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 07 12:30:15.584516 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:15.588605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bc2e1d39-a77e-4af9-b73a-7b3a7955d6ea tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:30:15.588605 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bc2e1d39-a77e-4af9-b73a-7b3a7955d6ea tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-852087-9/startup" status: 403 len: 110 microversion: 2.1 time: 0.034461 Sep 07 12:30:15.588605 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 296/597] 10.222.0.16 () {58 vars in 1191 bytes} [Wed Sep 7 12:30:15 2022] GET /compute/v2.1/os-hosts/n-d-852087-9/startup => generated 110 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:30:15.626957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c815168e-3958-4a37-a768-fa6adc450655 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:15.627629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c815168e-3958-4a37-a768-fa6adc450655 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:15.661843 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c815168e-3958-4a37-a768-fa6adc450655 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:15.662350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c815168e-3958-4a37-a768-fa6adc450655 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:15.662799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c815168e-3958-4a37-a768-fa6adc450655 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:15.663518 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c815168e-3958-4a37-a768-fa6adc450655 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:15.664014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c815168e-3958-4a37-a768-fa6adc450655 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:15.664447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c815168e-3958-4a37-a768-fa6adc450655 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:16.135915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-28c1ae1c-5a2a-480d-8f37-520fc1f49b92 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:16.159795 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-28c1ae1c-5a2a-480d-8f37-520fc1f49b92 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59" status: 200 len: 1322 microversion: 2.1 time: 1.054780 Sep 07 12:30:16.160856 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 302/598] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:15 2022] GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59 => generated 1322 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:16.184698 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eb64d0d0-89f6-4727-a21c-82fe0ce6ae7a tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Calling method '.version_select at 0x7fc4195eab80>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:16.212429 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-eb64d0d0-89f6-4727-a21c-82fe0ce6ae7a tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 12:30:16.224022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eb64d0d0-89f6-4727-a21c-82fe0ce6ae7a tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Request method failure captured: Sep 07 12:30:16.224022 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Sep 07 12:30:16.224022 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:30:16.224022 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:30:16.224022 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:30:16.224022 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:30:16.224022 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:30:16.224022 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:30:16.224022 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:30:16.224022 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:30:16.224022 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI7RwfEqsjp_OLURlHSOiTUQrY_UC1CoweahxaNsPVOwahwea6k4Suye5MyD-Htn5541voMJ4Owvi5BgfXzcNRSQ1br3J3xnQzq7ROpXC_tZ9vta_vhvw8JggdgQ2mmgY6SkUusfQqiUIS3ut5nEEkDjmX-Ck39L2HLafsjBzUsgXPk Sep 07 12:30:16.224022 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:30:16.224022 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:30:16.224022 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:30:16.224022 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:30:16.224022 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:30:16.224022 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:30:16.224022 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 6b723fb4cad04219b990c95be091faa4 Sep 07 12:30:16.224022 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-906743245 Sep 07 12:30:16.224022 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 12:30:16.224022 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 12:30:16.227037 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b723fb4cad04219b990c95be091faa4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6b723fb4cad04219b990c95be091faa4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6b723fb4cad04219b990c95be091faa4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b723fb4cad04219b990c95be091faa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:30:16.227037 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-HostsAdminNegativeTestJSON-906743245 Sep 07 12:30:16.227037 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 6b723fb4cad04219b990c95be091faa4 Sep 07 12:30:16.227037 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-906743245 Sep 07 12:30:16.227037 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-HostsAdminNegativeTestJSON-906743245-project-admin Sep 07 12:30:16.227037 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:30:16.227037 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:30:16.227037 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: e2ac1d26ee4241d2ad3aa35456416270 Sep 07 12:30:16.227037 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-HostsAdminNegativeTestJSON-906743245-project-admin Sep 07 12:30:16.227037 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:30:16.227037 n-d-852087-9 devstack@n-api.service[122433]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 12:30:16.227037 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'nonexistent_hostname'} Sep 07 12:30:16.227037 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:30:16.228644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:16.228644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 07 12:30:16.228644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 07 12:30:16.228644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 12:30:16.228644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 12:30:16.228644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:30:16.228644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:30:16.228644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:30:16.228644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:30:16.228644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 12:30:16.228644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 12:30:16.228644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 07 12:30:16.228644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 07 12:30:16.228644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:30:16.228644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:30:16.228644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 07 12:30:16.228644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 07 12:30:16.228644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 12:30:16.228644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 12:30:16.230955 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 07 12:30:16.230955 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 07 12:30:16.230955 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 12:30:16.230955 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:16.230955 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:16.230955 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:16.230955 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:16.230955 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:16.230955 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:16.230955 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:30:16.230955 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:30:16.230955 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:30:16.230955 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:30:16.230955 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:30:16.230955 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:16.230955 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Sep 07 12:30:16.230955 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Sep 07 12:30:16.230955 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 07 12:30:16.230955 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:30:16.233521 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 12:30:16.233521 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:16.233521 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:16.233521 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:16.233521 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:16.233521 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:16.233521 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:16.233521 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:30:16.233521 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:30:16.233521 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 12:30:16.233521 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:16.241460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eb64d0d0-89f6-4727-a21c-82fe0ce6ae7a tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:30:16.241460 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eb64d0d0-89f6-4727-a21c-82fe0ce6ae7a tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.070839 Sep 07 12:30:16.241460 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 303/599] 10.222.0.16 () {58 vars in 1215 bytes} [Wed Sep 7 12:30:16 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:30:16.253717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6028e265-5f81-4998-8790-3b7c97362842 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:16.255165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6028e265-5f81-4998-8790-3b7c97362842 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:16.277383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6028e265-5f81-4998-8790-3b7c97362842 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:16.279851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6028e265-5f81-4998-8790-3b7c97362842 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:16.280723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6028e265-5f81-4998-8790-3b7c97362842 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:16.282266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6028e265-5f81-4998-8790-3b7c97362842 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:16.283135 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6028e265-5f81-4998-8790-3b7c97362842 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:16.283989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6028e265-5f81-4998-8790-3b7c97362842 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:16.352401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c815168e-3958-4a37-a768-fa6adc450655 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:16.363416 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c815168e-3958-4a37-a768-fa6adc450655 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1313 microversion: 2.1 time: 0.783078 Sep 07 12:30:16.363999 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 297/600] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:15 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1313 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:16.369217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-103537ae-00b6-4658-b61c-3a4e630793a6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:16.369769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-103537ae-00b6-4658-b61c-3a4e630793a6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 97552bf3-7814-403e-b66c-582b2f4f703f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:16.384710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-103537ae-00b6-4658-b61c-3a4e630793a6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:16.385380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-103537ae-00b6-4658-b61c-3a4e630793a6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:16.385959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-103537ae-00b6-4658-b61c-3a4e630793a6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:16.386808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-103537ae-00b6-4658-b61c-3a4e630793a6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:16.387399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-103537ae-00b6-4658-b61c-3a4e630793a6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:16.387929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-103537ae-00b6-4658-b61c-3a4e630793a6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:16.472136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6028e265-5f81-4998-8790-3b7c97362842 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:16.482589 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6028e265-5f81-4998-8790-3b7c97362842 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:16.495457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6028e265-5f81-4998-8790-3b7c97362842 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:16.502565 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6028e265-5f81-4998-8790-3b7c97362842 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1447 microversion: 2.75 time: 0.261799 Sep 07 12:30:16.503863 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 304/601] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:16 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1447 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:30:16.509358 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-02cef4e8-edf8-40e0-ad90-b729eec42578 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:16.510338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-02cef4e8-edf8-40e0-ad90-b729eec42578 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: e640bc92-0f42-4b0c-b725-9f8d9955e599] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:16.517286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02cef4e8-edf8-40e0-ad90-b729eec42578 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:16.518401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02cef4e8-edf8-40e0-ad90-b729eec42578 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:16.520158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02cef4e8-edf8-40e0-ad90-b729eec42578 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:16.521185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02cef4e8-edf8-40e0-ad90-b729eec42578 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:16.521944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02cef4e8-edf8-40e0-ad90-b729eec42578 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:16.522584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02cef4e8-edf8-40e0-ad90-b729eec42578 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:16.797071 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-02cef4e8-edf8-40e0-ad90-b729eec42578 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:16.813909 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-02cef4e8-edf8-40e0-ad90-b729eec42578 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599" status: 200 len: 1277 microversion: 2.1 time: 0.308585 Sep 07 12:30:16.816316 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 305/602] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:16 2022] GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599 => generated 1277 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:16.832286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-688ce00b-6b87-466e-b84b-7e1ac2a3d0c1 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Action: 'update', calling method: .version_select at 0x7fc4197631f0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:16.843421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-688ce00b-6b87-466e-b84b-7e1ac2a3d0c1 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Request method failure captured: Sep 07 12:30:16.843421 n-d-852087-9 devstack@n-api.service[122433]: request: PUT /compute/v2.1/os-hosts/n-d-852087-9 HTTP/1.1 Sep 07 12:30:16.843421 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:30:16.843421 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:30:16.843421 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:30:16.843421 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 51 Sep 07 12:30:16.843421 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:30:16.843421 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:30:16.843421 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:30:16.843421 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:30:16.843421 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI7RwfEqsjp_OLURlHSOiTUQrY_UC1CoweahxaNsPVOwahwea6k4Suye5MyD-Htn5541voMJ4Owvi5BgfXzcNRSQ1br3J3xnQzq7ROpXC_tZ9vta_vhvw8JggdgQ2mmgY6SkUusfQqiUIS3ut5nEEkDjmX-Ck39L2HLafsjBzUsgXPk Sep 07 12:30:16.843421 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:30:16.843421 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:30:16.843421 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:30:16.843421 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:30:16.843421 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:30:16.843421 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:30:16.843421 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 6b723fb4cad04219b990c95be091faa4 Sep 07 12:30:16.843421 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-906743245 Sep 07 12:30:16.843421 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 12:30:16.843421 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 12:30:16.844786 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b723fb4cad04219b990c95be091faa4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6b723fb4cad04219b990c95be091faa4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6b723fb4cad04219b990c95be091faa4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b723fb4cad04219b990c95be091faa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:30:16.844786 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-HostsAdminNegativeTestJSON-906743245 Sep 07 12:30:16.844786 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 6b723fb4cad04219b990c95be091faa4 Sep 07 12:30:16.844786 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-906743245 Sep 07 12:30:16.844786 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-HostsAdminNegativeTestJSON-906743245-project-admin Sep 07 12:30:16.844786 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:30:16.844786 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:30:16.844786 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: e2ac1d26ee4241d2ad3aa35456416270 Sep 07 12:30:16.844786 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-HostsAdminNegativeTestJSON-906743245-project-admin Sep 07 12:30:16.844786 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:30:16.844786 n-d-852087-9 devstack@n-api.service[122433]: {"status": "enable", "maintenance_mode": "invalid"} Sep 07 12:30:16.844786 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:30:16.844786 n-d-852087-9 devstack@n-api.service[122433]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 07 12:30:16.845553 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'n-d-852087-9', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Sep 07 12:30:16.845553 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:30:16.845553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:16.845553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:30:16.845553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:30:16.845553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:30:16.845553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:30:16.845553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 07 12:30:16.845553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:16.845553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Sep 07 12:30:16.845553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 07 12:30:16.845553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'disable', Sep 07 12:30:16.845553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'Enable', Sep 07 12:30:16.845553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'Disable', Sep 07 12:30:16.845553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 07 12:30:16.845553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 07 12:30:16.845553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 07 12:30:16.845553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:16.845553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance: Sep 07 12:30:16.845553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'invalid' Sep 07 12:30:16.845553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:16.845553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:16.845553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:16.845553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:16.845553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:16.846967 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:16.846967 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:30:16.846967 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:30:16.846967 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:30:16.846967 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:30:16.846967 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:30:16.846967 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:16.846967 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:30:16.846967 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:30:16.846967 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:30:16.846967 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:30:16.846967 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:30:16.846967 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:30:16.846967 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 07 12:30:16.846967 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:16.846967 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:16.846967 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:16.846967 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:16.846967 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:16.848301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:16.848301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:30:16.848301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:30:16.848301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 07 12:30:16.848301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:16.848301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-688ce00b-6b87-466e-b84b-7e1ac2a3d0c1 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:30:16.848301 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-688ce00b-6b87-466e-b84b-7e1ac2a3d0c1 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-852087-9" status: 400 len: 199 microversion: 2.1 time: 0.029669 Sep 07 12:30:16.848301 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 306/603] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Sep 7 12:30:16 2022] PUT /compute/v2.1/os-hosts/n-d-852087-9 => generated 199 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:30:16.860323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c124d773-77c8-495e-a046-9e93c6b99b86 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:16.870692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c124d773-77c8-495e-a046-9e93c6b99b86 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:16.879826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c124d773-77c8-495e-a046-9e93c6b99b86 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:16.880942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c124d773-77c8-495e-a046-9e93c6b99b86 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:16.881652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c124d773-77c8-495e-a046-9e93c6b99b86 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:16.882666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c124d773-77c8-495e-a046-9e93c6b99b86 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:16.883334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c124d773-77c8-495e-a046-9e93c6b99b86 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:16.885560 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c124d773-77c8-495e-a046-9e93c6b99b86 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:17.476444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-103537ae-00b6-4658-b61c-3a4e630793a6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:17.489842 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-103537ae-00b6-4658-b61c-3a4e630793a6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f" status: 200 len: 1386 microversion: 2.1 time: 1.124563 Sep 07 12:30:17.494306 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 298/604] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:16 2022] GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f => generated 1386 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:17.514102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-384de27b-b734-4936-90ba-4ad930bd05a4 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Action: 'update', calling method: .version_select at 0x7fc4194134c0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:17.531295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-384de27b-b734-4936-90ba-4ad930bd05a4 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Request method failure captured: Sep 07 12:30:17.531295 n-d-852087-9 devstack@n-api.service[122432]: request: PUT /compute/v2.1/os-hosts/n-d-852087-9 HTTP/1.1 Sep 07 12:30:17.531295 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:30:17.531295 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:30:17.531295 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:30:17.531295 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 51 Sep 07 12:30:17.531295 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:30:17.531295 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:30:17.531295 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:30:17.531295 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:30:17.531295 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI7RwfEqsjp_OLURlHSOiTUQrY_UC1CoweahxaNsPVOwahwea6k4Suye5MyD-Htn5541voMJ4Owvi5BgfXzcNRSQ1br3J3xnQzq7ROpXC_tZ9vta_vhvw8JggdgQ2mmgY6SkUusfQqiUIS3ut5nEEkDjmX-Ck39L2HLafsjBzUsgXPk Sep 07 12:30:17.531295 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:30:17.531295 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:30:17.531295 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:30:17.531295 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:30:17.531295 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:30:17.531295 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:30:17.531295 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 6b723fb4cad04219b990c95be091faa4 Sep 07 12:30:17.531295 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-906743245 Sep 07 12:30:17.531295 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member,admin Sep 07 12:30:17.531295 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member,admin Sep 07 12:30:17.532539 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b723fb4cad04219b990c95be091faa4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6b723fb4cad04219b990c95be091faa4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6b723fb4cad04219b990c95be091faa4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b723fb4cad04219b990c95be091faa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:30:17.532539 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-HostsAdminNegativeTestJSON-906743245 Sep 07 12:30:17.532539 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 6b723fb4cad04219b990c95be091faa4 Sep 07 12:30:17.532539 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-906743245 Sep 07 12:30:17.532539 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-HostsAdminNegativeTestJSON-906743245-project-admin Sep 07 12:30:17.532539 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:30:17.532539 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:30:17.532539 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: e2ac1d26ee4241d2ad3aa35456416270 Sep 07 12:30:17.532539 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-HostsAdminNegativeTestJSON-906743245-project-admin Sep 07 12:30:17.532539 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:30:17.532539 n-d-852087-9 devstack@n-api.service[122432]: {"status": "invalid", "maintenance_mode": "enable"} Sep 07 12:30:17.532539 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:30:17.532539 n-d-852087-9 devstack@n-api.service[122432]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 07 12:30:17.533281 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'n-d-852087-9', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Sep 07 12:30:17.533281 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:30:17.533281 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:17.533281 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:30:17.533281 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:30:17.533281 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:30:17.533281 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:30:17.533281 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 07 12:30:17.533281 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:17.533281 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Sep 07 12:30:17.533281 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 07 12:30:17.533281 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'disable', Sep 07 12:30:17.533281 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'Enable', Sep 07 12:30:17.533281 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'Disable', Sep 07 12:30:17.533281 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 07 12:30:17.533281 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 07 12:30:17.533281 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 07 12:30:17.533281 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:17.533281 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance: Sep 07 12:30:17.533281 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'invalid' Sep 07 12:30:17.533281 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:17.533281 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:17.533281 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:17.533281 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:17.533281 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:17.534721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:17.534721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:30:17.534721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:30:17.534721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:30:17.534721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:30:17.534721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:30:17.534721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:17.534721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:30:17.534721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:30:17.534721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:30:17.534721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:30:17.534721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:30:17.534721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:30:17.534721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 07 12:30:17.534721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:17.534721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:17.534721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:17.534721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:17.534721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:17.535751 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:17.535751 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:30:17.535751 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:30:17.535751 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 07 12:30:17.535751 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:17.540720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-384de27b-b734-4936-90ba-4ad930bd05a4 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:30:17.542217 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-384de27b-b734-4936-90ba-4ad930bd05a4 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-852087-9" status: 400 len: 189 microversion: 2.1 time: 0.046603 Sep 07 12:30:17.543354 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 299/605] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Sep 7 12:30:17 2022] PUT /compute/v2.1/os-hosts/n-d-852087-9 => generated 189 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:30:17.548871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-08b6059d-14c2-48bb-8ddf-e3c384a43132 req-471281d6-1a0c-4cfd-9b38-a26816a20bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f60a676-5df0-44d4-b97f-4248a08a9f59", "tag": "0f1b146e-906f-46c2-b83b-28bbca816276"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:17.561251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-08b6059d-14c2-48bb-8ddf-e3c384a43132 req-471281d6-1a0c-4cfd-9b38-a26816a20bf7 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:17.562404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-08b6059d-14c2-48bb-8ddf-e3c384a43132 req-471281d6-1a0c-4cfd-9b38-a26816a20bf7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:17.563196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-08b6059d-14c2-48bb-8ddf-e3c384a43132 req-471281d6-1a0c-4cfd-9b38-a26816a20bf7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:17.577453 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-08b6059d-14c2-48bb-8ddf-e3c384a43132 req-471281d6-1a0c-4cfd-9b38-a26816a20bf7 service nova] Creating event network-changed:0f1b146e-906f-46c2-b83b-28bbca816276 for instance 2f60a676-5df0-44d4-b97f-4248a08a9f59 on n-h1-852087-9 Sep 07 12:30:17.584365 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-08b6059d-14c2-48bb-8ddf-e3c384a43132 req-471281d6-1a0c-4cfd-9b38-a26816a20bf7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039485 Sep 07 12:30:17.585699 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 300/606] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:30:17.595762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cf530c56-6e69-47a1-a10f-31b9cca877e0 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:17.596816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cf530c56-6e69-47a1-a10f-31b9cca877e0 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 2f60a676-5df0-44d4-b97f-4248a08a9f59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:17.603919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf530c56-6e69-47a1-a10f-31b9cca877e0 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:17.604816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf530c56-6e69-47a1-a10f-31b9cca877e0 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:17.605476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf530c56-6e69-47a1-a10f-31b9cca877e0 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:17.606545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf530c56-6e69-47a1-a10f-31b9cca877e0 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:17.607488 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf530c56-6e69-47a1-a10f-31b9cca877e0 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:17.608146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf530c56-6e69-47a1-a10f-31b9cca877e0 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:17.613572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:30:17.627484 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c124d773-77c8-495e-a046-9e93c6b99b86 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:17.642258 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c124d773-77c8-495e-a046-9e93c6b99b86 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1504 microversion: 2.1 time: 0.791376 Sep 07 12:30:17.654237 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 307/607] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:16 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1504 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:17.667741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-df0086a6-cd4a-437a-9288-917ecf8262d6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:17.707503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-df0086a6-cd4a-437a-9288-917ecf8262d6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:17.722076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df0086a6-cd4a-437a-9288-917ecf8262d6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:17.723563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df0086a6-cd4a-437a-9288-917ecf8262d6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:17.724012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df0086a6-cd4a-437a-9288-917ecf8262d6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:17.724877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df0086a6-cd4a-437a-9288-917ecf8262d6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:17.725202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df0086a6-cd4a-437a-9288-917ecf8262d6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:17.725669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df0086a6-cd4a-437a-9288-917ecf8262d6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:18.064506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cf530c56-6e69-47a1-a10f-31b9cca877e0 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:18.077457 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cf530c56-6e69-47a1-a10f-31b9cca877e0 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59" status: 200 len: 1322 microversion: 2.1 time: 0.489935 Sep 07 12:30:18.079809 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 301/608] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:17 2022] GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59 => generated 1322 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:18.085757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-df0086a6-cd4a-437a-9288-917ecf8262d6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:18.091060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-36920f8c-e4fc-4d3a-8595-eeadcaa22376 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:18.092776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-36920f8c-e4fc-4d3a-8595-eeadcaa22376 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:18.093871 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-df0086a6-cd4a-437a-9288-917ecf8262d6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1313 microversion: 2.1 time: 0.438479 Sep 07 12:30:18.094465 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 308/609] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:17 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1313 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:18.107715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cde56c17-7823-4310-b8c6-8d6649f1fff6 tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] Action: 'update', calling method: .version_select at 0x7fc41977b670>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:18.118053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36920f8c-e4fc-4d3a-8595-eeadcaa22376 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:18.118880 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36920f8c-e4fc-4d3a-8595-eeadcaa22376 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:18.119527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36920f8c-e4fc-4d3a-8595-eeadcaa22376 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:18.120378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cde56c17-7823-4310-b8c6-8d6649f1fff6 tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '70f3bfa4a5b645c1b0f32e05dc36d63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f7ff61d23540469554f9609c857c52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:18.120734 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36920f8c-e4fc-4d3a-8595-eeadcaa22376 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:18.121354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36920f8c-e4fc-4d3a-8595-eeadcaa22376 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:18.122160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cde56c17-7823-4310-b8c6-8d6649f1fff6 tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] Request method failure captured: Sep 07 12:30:18.122160 n-d-852087-9 devstack@n-api.service[122433]: request: PUT /compute/v2.1/os-hosts/n-d-852087-9 HTTP/1.1 Sep 07 12:30:18.122160 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:30:18.122160 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:30:18.122160 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:30:18.122160 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 50 Sep 07 12:30:18.122160 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:30:18.122160 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:30:18.122160 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:30:18.122160 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:30:18.122160 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI7PVztdY3xBDWZCaD1KrwTs7sNreRAy3xPivnxfBW75ALeMHUIHBDCwJrB1uCv9pL9zAYT3_JpWyMe8kCh08VmHU-PLLsTfBTExUQI9jsETZedI54t0ut6Skny4czn19QJa2E8rIfB7kf9rWIvWIGPl9Ur7wlH5fw3qAVtaQmemqFU Sep 07 12:30:18.122160 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:30:18.122160 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:30:18.122160 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:30:18.122160 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:30:18.122160 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:30:18.122160 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:30:18.122160 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: b3f7ff61d23540469554f9609c857c52 Sep 07 12:30:18.122160 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-955394105 Sep 07 12:30:18.122160 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:30:18.122160 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:30:18.123867 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3f7ff61d23540469554f9609c857c52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3f7ff61d23540469554f9609c857c52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3f7ff61d23540469554f9609c857c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3f7ff61d23540469554f9609c857c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:30:18.123867 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-HostsAdminNegativeTestJSON-955394105 Sep 07 12:30:18.123867 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: b3f7ff61d23540469554f9609c857c52 Sep 07 12:30:18.123867 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-955394105 Sep 07 12:30:18.123867 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-HostsAdminNegativeTestJSON-955394105-project Sep 07 12:30:18.123867 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:30:18.123867 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:30:18.123867 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 70f3bfa4a5b645c1b0f32e05dc36d63a Sep 07 12:30:18.123867 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-HostsAdminNegativeTestJSON-955394105-project Sep 07 12:30:18.123867 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:30:18.123867 n-d-852087-9 devstack@n-api.service[122433]: {"status": "enable", "maintenance_mode": "enable"} Sep 07 12:30:18.123867 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:30:18.123867 n-d-852087-9 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 07 12:30:18.123867 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'n-d-852087-9', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 07 12:30:18.124836 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:30:18.124836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:18.124836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:18.124836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:18.124836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:30:18.124836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:30:18.124836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:30:18.124836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:30:18.124836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:30:18.124836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:18.124836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:30:18.124836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:30:18.124836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Sep 07 12:30:18.124836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Sep 07 12:30:18.124836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:30:18.124836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:30:18.124836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:30:18.124836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:30:18.124836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:30:18.124836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:30:18.126214 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:30:18.126214 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:30:18.126214 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:30:18.126214 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:30:18.126214 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:30:18.126214 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:30:18.126214 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:30:18.126214 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:30:18.126214 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 07 12:30:18.126214 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:18.126214 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:18.126214 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:18.126214 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:18.126214 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:18.126214 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:18.126214 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:30:18.126214 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:30:18.126214 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 07 12:30:18.126214 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:18.127436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36920f8c-e4fc-4d3a-8595-eeadcaa22376 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:18.131336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cde56c17-7823-4310-b8c6-8d6649f1fff6 tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:30:18.132393 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cde56c17-7823-4310-b8c6-8d6649f1fff6 tempest-HostsAdminNegativeTestJSON-955394105 tempest-HostsAdminNegativeTestJSON-955394105-project] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-852087-9" status: 403 len: 111 microversion: 2.1 time: 0.036902 Sep 07 12:30:18.133636 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 309/610] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Sep 7 12:30:18 2022] PUT /compute/v2.1/os-hosts/n-d-852087-9 => generated 111 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:30:18.139602 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2517991f-ba1e-4f85-a0e7-ccf169e4bb9f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:18.140231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2517991f-ba1e-4f85-a0e7-ccf169e4bb9f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: e640bc92-0f42-4b0c-b725-9f8d9955e599] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:18.150033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2517991f-ba1e-4f85-a0e7-ccf169e4bb9f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:18.151201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2517991f-ba1e-4f85-a0e7-ccf169e4bb9f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:18.151960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2517991f-ba1e-4f85-a0e7-ccf169e4bb9f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:18.153824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2517991f-ba1e-4f85-a0e7-ccf169e4bb9f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:18.154634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2517991f-ba1e-4f85-a0e7-ccf169e4bb9f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:18.155308 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2517991f-ba1e-4f85-a0e7-ccf169e4bb9f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:18.284349 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2517991f-ba1e-4f85-a0e7-ccf169e4bb9f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:18.295061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-36920f8c-e4fc-4d3a-8595-eeadcaa22376 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:18.304127 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2517991f-ba1e-4f85-a0e7-ccf169e4bb9f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599" status: 200 len: 1277 microversion: 2.1 time: 0.168848 Sep 07 12:30:18.309761 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 310/611] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:18 2022] GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:18.315334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-36920f8c-e4fc-4d3a-8595-eeadcaa22376 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:18.316789 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-36920f8c-e4fc-4d3a-8595-eeadcaa22376 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:18.324783 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-36920f8c-e4fc-4d3a-8595-eeadcaa22376 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1447 microversion: 2.75 time: 0.242573 Sep 07 12:30:18.326068 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 302/612] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:18 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1447 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:30:18.337198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5d04a928-3efa-4839-bbaf-fd9c1ae89252 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Action: 'update', calling method: .version_select at 0x7fc41977bdc0>, body: {"status": null, "maintenance_mode": null} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:18.346910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5d04a928-3efa-4839-bbaf-fd9c1ae89252 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Request method failure captured: Sep 07 12:30:18.346910 n-d-852087-9 devstack@n-api.service[122433]: request: PUT /compute/v2.1/os-hosts/n-d-852087-9 HTTP/1.1 Sep 07 12:30:18.346910 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:30:18.346910 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:30:18.346910 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:30:18.346910 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 42 Sep 07 12:30:18.346910 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:30:18.346910 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:30:18.346910 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:30:18.346910 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:30:18.346910 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI7RwfEqsjp_OLURlHSOiTUQrY_UC1CoweahxaNsPVOwahwea6k4Suye5MyD-Htn5541voMJ4Owvi5BgfXzcNRSQ1br3J3xnQzq7ROpXC_tZ9vta_vhvw8JggdgQ2mmgY6SkUusfQqiUIS3ut5nEEkDjmX-Ck39L2HLafsjBzUsgXPk Sep 07 12:30:18.346910 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:30:18.346910 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:30:18.346910 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:30:18.346910 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:30:18.346910 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:30:18.346910 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:30:18.346910 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 6b723fb4cad04219b990c95be091faa4 Sep 07 12:30:18.346910 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-906743245 Sep 07 12:30:18.346910 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 12:30:18.346910 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 12:30:18.348479 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b723fb4cad04219b990c95be091faa4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6b723fb4cad04219b990c95be091faa4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6b723fb4cad04219b990c95be091faa4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b723fb4cad04219b990c95be091faa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:30:18.348479 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-HostsAdminNegativeTestJSON-906743245 Sep 07 12:30:18.348479 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 6b723fb4cad04219b990c95be091faa4 Sep 07 12:30:18.348479 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-906743245 Sep 07 12:30:18.348479 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-HostsAdminNegativeTestJSON-906743245-project-admin Sep 07 12:30:18.348479 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:30:18.348479 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:30:18.348479 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: e2ac1d26ee4241d2ad3aa35456416270 Sep 07 12:30:18.348479 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-HostsAdminNegativeTestJSON-906743245-project-admin Sep 07 12:30:18.348479 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:30:18.348479 n-d-852087-9 devstack@n-api.service[122433]: {"status": null, "maintenance_mode": null} Sep 07 12:30:18.348479 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:30:18.348479 n-d-852087-9 devstack@n-api.service[122433]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 07 12:30:18.348479 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'n-d-852087-9', 'body': {'status': None, 'maintenance_mode': None}} Sep 07 12:30:18.349333 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:30:18.349333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:18.349333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:30:18.349333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:30:18.349333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:30:18.349333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:30:18.349333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Sep 07 12:30:18.349333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:18.349333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Sep 07 12:30:18.349333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 07 12:30:18.349333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'disable', Sep 07 12:30:18.349333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'Enable', Sep 07 12:30:18.349333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'Disable', Sep 07 12:30:18.349333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 07 12:30:18.349333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 07 12:30:18.349333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 07 12:30:18.349333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:18.349333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance: Sep 07 12:30:18.349333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi None Sep 07 12:30:18.349333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:18.349333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:18.349333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:18.349333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:18.349333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:18.349333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:18.351162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:30:18.351162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:30:18.351162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:30:18.351162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:30:18.351162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:30:18.351162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:18.351162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:30:18.351162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:30:18.351162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:30:18.351162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:30:18.351162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:30:18.351162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:30:18.351162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 07 12:30:18.351162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:18.351162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:18.351162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:18.351162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:18.351162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:18.351162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:18.352666 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:30:18.352666 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:30:18.352666 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 07 12:30:18.352666 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:18.352666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5d04a928-3efa-4839-bbaf-fd9c1ae89252 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:30:18.352666 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5d04a928-3efa-4839-bbaf-fd9c1ae89252 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-852087-9" status: 400 len: 127 microversion: 2.1 time: 0.019320 Sep 07 12:30:18.360012 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-123bbcc5-6457-44f2-8003-8a419b925c85 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Action: 'update', calling method: .version_select at 0x7fc4194251f0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:18.363491 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 311/613] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Sep 7 12:30:18 2022] PUT /compute/v2.1/os-hosts/n-d-852087-9 => generated 127 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:30:18.363716 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.hosts [None req-123bbcc5-6457-44f2-8003-8a419b925c85 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Enabling host nonexistent_hostname. Sep 07 12:30:18.375116 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-123bbcc5-6457-44f2-8003-8a419b925c85 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 12:30:18.377327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-123bbcc5-6457-44f2-8003-8a419b925c85 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Request method failure captured: Sep 07 12:30:18.377327 n-d-852087-9 devstack@n-api.service[122432]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 07 12:30:18.377327 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:30:18.377327 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:30:18.377327 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:30:18.377327 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 50 Sep 07 12:30:18.377327 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:30:18.377327 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:30:18.377327 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:30:18.377327 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:30:18.377327 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI7RwfEqsjp_OLURlHSOiTUQrY_UC1CoweahxaNsPVOwahwea6k4Suye5MyD-Htn5541voMJ4Owvi5BgfXzcNRSQ1br3J3xnQzq7ROpXC_tZ9vta_vhvw8JggdgQ2mmgY6SkUusfQqiUIS3ut5nEEkDjmX-Ck39L2HLafsjBzUsgXPk Sep 07 12:30:18.377327 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:30:18.377327 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:30:18.377327 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:30:18.377327 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:30:18.377327 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:30:18.377327 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:30:18.377327 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 6b723fb4cad04219b990c95be091faa4 Sep 07 12:30:18.377327 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-906743245 Sep 07 12:30:18.377327 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member,admin Sep 07 12:30:18.377327 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member,admin Sep 07 12:30:18.378891 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b723fb4cad04219b990c95be091faa4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6b723fb4cad04219b990c95be091faa4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6b723fb4cad04219b990c95be091faa4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b723fb4cad04219b990c95be091faa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:30:18.378891 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-HostsAdminNegativeTestJSON-906743245 Sep 07 12:30:18.378891 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 6b723fb4cad04219b990c95be091faa4 Sep 07 12:30:18.378891 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-906743245 Sep 07 12:30:18.378891 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-HostsAdminNegativeTestJSON-906743245-project-admin Sep 07 12:30:18.378891 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:30:18.378891 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:30:18.378891 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: e2ac1d26ee4241d2ad3aa35456416270 Sep 07 12:30:18.378891 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-HostsAdminNegativeTestJSON-906743245-project-admin Sep 07 12:30:18.378891 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:30:18.378891 n-d-852087-9 devstack@n-api.service[122432]: {"status": "enable", "maintenance_mode": "enable"} Sep 07 12:30:18.378891 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:30:18.378891 n-d-852087-9 devstack@n-api.service[122432]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 12:30:18.378891 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 07 12:30:18.379849 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:30:18.379849 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:18.379849 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Sep 07 12:30:18.379849 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Sep 07 12:30:18.379849 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 12:30:18.379849 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 12:30:18.379849 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:30:18.379849 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:30:18.379849 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:30:18.379849 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:30:18.379849 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 12:30:18.379849 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 12:30:18.379849 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 07 12:30:18.379849 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 07 12:30:18.379849 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:30:18.379849 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:30:18.379849 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 07 12:30:18.379849 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 07 12:30:18.381052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 12:30:18.381052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 12:30:18.381052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 07 12:30:18.381052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 07 12:30:18.381052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 12:30:18.381052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:18.381052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:18.381052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:18.381052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:18.381052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:18.381052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:18.381052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:30:18.381052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:30:18.381052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:30:18.381052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:30:18.381052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:30:18.381052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:18.381052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:30:18.381052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:30:18.381052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Sep 07 12:30:18.382515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Sep 07 12:30:18.382515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Sep 07 12:30:18.382515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:30:18.382515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 12:30:18.382515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:18.382515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:18.382515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:18.382515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:18.382515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:18.382515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:18.382515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:30:18.382515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:30:18.382515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 07 12:30:18.382515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:18.384484 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-123bbcc5-6457-44f2-8003-8a419b925c85 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:30:18.385760 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-123bbcc5-6457-44f2-8003-8a419b925c85 tempest-HostsAdminNegativeTestJSON-906743245 tempest-HostsAdminNegativeTestJSON-906743245-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.029696 Sep 07 12:30:18.386865 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 303/614] 10.222.0.16 () {60 vars in 1211 bytes} [Wed Sep 7 12:30:18 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 07 12:30:18.538493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-413c971b-8285-4f12-b5f4-6850d8ac0c26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:18.539859 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-413c971b-8285-4f12-b5f4-6850d8ac0c26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 97552bf3-7814-403e-b66c-582b2f4f703f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:18.561323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-413c971b-8285-4f12-b5f4-6850d8ac0c26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:18.562418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-413c971b-8285-4f12-b5f4-6850d8ac0c26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:18.566446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-413c971b-8285-4f12-b5f4-6850d8ac0c26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:18.573895 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e04ee4c6-0e1d-44c1-bbce-71904d8c7928 req-8a22630d-ff41-461a-9108-bd8f6ec1ea22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97552bf3-7814-403e-b66c-582b2f4f703f", "name": "network-vif-plugged", "status": "completed", "tag": "6577c68c-93a9-4100-9045-b5fed985d7db"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:18.585840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-413c971b-8285-4f12-b5f4-6850d8ac0c26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:18.587065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-413c971b-8285-4f12-b5f4-6850d8ac0c26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:18.592478 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-413c971b-8285-4f12-b5f4-6850d8ac0c26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:18.628710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e04ee4c6-0e1d-44c1-bbce-71904d8c7928 req-8a22630d-ff41-461a-9108-bd8f6ec1ea22 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:18.632985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e04ee4c6-0e1d-44c1-bbce-71904d8c7928 req-8a22630d-ff41-461a-9108-bd8f6ec1ea22 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:18.635664 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e04ee4c6-0e1d-44c1-bbce-71904d8c7928 req-8a22630d-ff41-461a-9108-bd8f6ec1ea22 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:18.675700 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e04ee4c6-0e1d-44c1-bbce-71904d8c7928 req-8a22630d-ff41-461a-9108-bd8f6ec1ea22 service nova] Creating event network-vif-plugged:6577c68c-93a9-4100-9045-b5fed985d7db for instance 97552bf3-7814-403e-b66c-582b2f4f703f on n-h1-852087-9 Sep 07 12:30:18.684758 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e04ee4c6-0e1d-44c1-bbce-71904d8c7928 req-8a22630d-ff41-461a-9108-bd8f6ec1ea22 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114859 Sep 07 12:30:18.686488 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 304/615] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:30:18.699641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5cc6175b-3629-4178-bb8a-0fb93bc308f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:18.700616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5cc6175b-3629-4178-bb8a-0fb93bc308f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:18.709999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cc6175b-3629-4178-bb8a-0fb93bc308f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:18.711273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cc6175b-3629-4178-bb8a-0fb93bc308f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:18.712178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cc6175b-3629-4178-bb8a-0fb93bc308f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:18.715718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cc6175b-3629-4178-bb8a-0fb93bc308f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:18.716507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cc6175b-3629-4178-bb8a-0fb93bc308f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:18.717475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cc6175b-3629-4178-bb8a-0fb93bc308f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:19.150279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5cc6175b-3629-4178-bb8a-0fb93bc308f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:19.158907 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5cc6175b-3629-4178-bb8a-0fb93bc308f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1504 microversion: 2.1 time: 0.469671 Sep 07 12:30:19.160180 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 305/616] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:18 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1504 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:19.174022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5f445e80-2818-4583-89c9-cb407a56a15c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:19.179464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5f445e80-2818-4583-89c9-cb407a56a15c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 2f60a676-5df0-44d4-b97f-4248a08a9f59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:19.196294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f445e80-2818-4583-89c9-cb407a56a15c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:19.197071 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f445e80-2818-4583-89c9-cb407a56a15c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:19.197972 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f445e80-2818-4583-89c9-cb407a56a15c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:19.199545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f445e80-2818-4583-89c9-cb407a56a15c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:19.200253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f445e80-2818-4583-89c9-cb407a56a15c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:19.200897 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f445e80-2818-4583-89c9-cb407a56a15c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:19.205049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-413c971b-8285-4f12-b5f4-6850d8ac0c26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:19.217554 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-413c971b-8285-4f12-b5f4-6850d8ac0c26 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f" status: 200 len: 1386 microversion: 2.1 time: 0.684513 Sep 07 12:30:19.237513 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 312/617] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:18 2022] GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f => generated 1386 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:19.242397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f4d32d58-1b97-42f7-8243-6e7a64a978b2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:19.243025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f4d32d58-1b97-42f7-8243-6e7a64a978b2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:19.252810 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4d32d58-1b97-42f7-8243-6e7a64a978b2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:19.253357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4d32d58-1b97-42f7-8243-6e7a64a978b2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:19.253922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4d32d58-1b97-42f7-8243-6e7a64a978b2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:19.255693 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4d32d58-1b97-42f7-8243-6e7a64a978b2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:19.256172 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4d32d58-1b97-42f7-8243-6e7a64a978b2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:19.256598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4d32d58-1b97-42f7-8243-6e7a64a978b2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:19.951564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5f445e80-2818-4583-89c9-cb407a56a15c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:19.965874 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5f445e80-2818-4583-89c9-cb407a56a15c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59" status: 200 len: 1322 microversion: 2.1 time: 0.804155 Sep 07 12:30:19.967816 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 306/618] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:19 2022] GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59 => generated 1322 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:19.975376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f4d32d58-1b97-42f7-8243-6e7a64a978b2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:19.977858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:30:19.978712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8bb781a9-822b-4ad3-9112-4929ee20036c tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:19.979888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8bb781a9-822b-4ad3-9112-4929ee20036c tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: e640bc92-0f42-4b0c-b725-9f8d9955e599] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:19.990543 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f4d32d58-1b97-42f7-8243-6e7a64a978b2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1313 microversion: 2.1 time: 0.763397 Sep 07 12:30:19.995328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bb781a9-822b-4ad3-9112-4929ee20036c tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:20.005851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bb781a9-822b-4ad3-9112-4929ee20036c tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:20.006520 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 313/619] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:19 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1313 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:20.012954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2829f47d-2a90-4bb8-9926-db17f8e50062 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:20.013614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2829f47d-2a90-4bb8-9926-db17f8e50062 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:20.016011 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bb781a9-822b-4ad3-9112-4929ee20036c tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:20.019940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bb781a9-822b-4ad3-9112-4929ee20036c tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:20.021097 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2829f47d-2a90-4bb8-9926-db17f8e50062 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:20.021786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2829f47d-2a90-4bb8-9926-db17f8e50062 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:20.022257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2829f47d-2a90-4bb8-9926-db17f8e50062 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:20.022564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bb781a9-822b-4ad3-9112-4929ee20036c tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:20.023041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2829f47d-2a90-4bb8-9926-db17f8e50062 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:20.023462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bb781a9-822b-4ad3-9112-4929ee20036c tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:20.023586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2829f47d-2a90-4bb8-9926-db17f8e50062 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:20.024010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2829f47d-2a90-4bb8-9926-db17f8e50062 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:20.239881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2829f47d-2a90-4bb8-9926-db17f8e50062 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:20.264274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2829f47d-2a90-4bb8-9926-db17f8e50062 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:20.268746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2829f47d-2a90-4bb8-9926-db17f8e50062 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:20.291481 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2829f47d-2a90-4bb8-9926-db17f8e50062 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1447 microversion: 2.75 time: 0.283498 Sep 07 12:30:20.294850 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 314/620] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:20 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1447 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:30:20.313172 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4701cb64-43ab-4e27-a1fe-72cdbff6db73 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:20.314251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4701cb64-43ab-4e27-a1fe-72cdbff6db73 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:20.323520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4701cb64-43ab-4e27-a1fe-72cdbff6db73 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:20.328968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4701cb64-43ab-4e27-a1fe-72cdbff6db73 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:20.329748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4701cb64-43ab-4e27-a1fe-72cdbff6db73 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:20.330928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4701cb64-43ab-4e27-a1fe-72cdbff6db73 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:20.332143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4701cb64-43ab-4e27-a1fe-72cdbff6db73 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:20.333987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4701cb64-43ab-4e27-a1fe-72cdbff6db73 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:20.576116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8bb781a9-822b-4ad3-9112-4929ee20036c tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:20.591410 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8bb781a9-822b-4ad3-9112-4929ee20036c tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599" status: 200 len: 1319 microversion: 2.1 time: 0.621999 Sep 07 12:30:20.610792 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 307/621] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:19 2022] GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599 => generated 1319 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:20.617678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d49db166-c43e-4550-b055-a90b367ccc36 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:20.619077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d49db166-c43e-4550-b055-a90b367ccc36 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 97552bf3-7814-403e-b66c-582b2f4f703f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:20.629086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d49db166-c43e-4550-b055-a90b367ccc36 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:20.629906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d49db166-c43e-4550-b055-a90b367ccc36 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:20.630573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d49db166-c43e-4550-b055-a90b367ccc36 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:20.632390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d49db166-c43e-4550-b055-a90b367ccc36 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:20.633546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d49db166-c43e-4550-b055-a90b367ccc36 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:20.635061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d49db166-c43e-4550-b055-a90b367ccc36 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:20.670321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4701cb64-43ab-4e27-a1fe-72cdbff6db73 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:20.684446 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4701cb64-43ab-4e27-a1fe-72cdbff6db73 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1504 microversion: 2.1 time: 0.387229 Sep 07 12:30:20.686183 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 315/622] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:20 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1504 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:20.980331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d49db166-c43e-4550-b055-a90b367ccc36 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:20.989468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bf78a5cf-8a5f-47dd-8b59-a3f51b352a50 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:20.990384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bf78a5cf-8a5f-47dd-8b59-a3f51b352a50 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 2f60a676-5df0-44d4-b97f-4248a08a9f59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:20.997291 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d49db166-c43e-4550-b055-a90b367ccc36 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f" status: 200 len: 1386 microversion: 2.1 time: 0.384751 Sep 07 12:30:20.997680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf78a5cf-8a5f-47dd-8b59-a3f51b352a50 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:21.013511 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 308/623] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:20 2022] GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f => generated 1386 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:21.020289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ebfcff48-c659-4a31-aa39-efc69313659f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:21.021701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ebfcff48-c659-4a31-aa39-efc69313659f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:21.029548 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf78a5cf-8a5f-47dd-8b59-a3f51b352a50 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:21.030457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf78a5cf-8a5f-47dd-8b59-a3f51b352a50 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:21.032710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf78a5cf-8a5f-47dd-8b59-a3f51b352a50 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:21.033557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf78a5cf-8a5f-47dd-8b59-a3f51b352a50 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:21.034258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf78a5cf-8a5f-47dd-8b59-a3f51b352a50 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:21.041659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebfcff48-c659-4a31-aa39-efc69313659f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:21.044020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebfcff48-c659-4a31-aa39-efc69313659f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:21.044892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebfcff48-c659-4a31-aa39-efc69313659f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:21.048538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebfcff48-c659-4a31-aa39-efc69313659f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:21.050686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebfcff48-c659-4a31-aa39-efc69313659f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:21.052900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebfcff48-c659-4a31-aa39-efc69313659f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:21.730440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bf78a5cf-8a5f-47dd-8b59-a3f51b352a50 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:21.751352 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bf78a5cf-8a5f-47dd-8b59-a3f51b352a50 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59" status: 200 len: 1322 microversion: 2.1 time: 0.765115 Sep 07 12:30:21.756454 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 316/624] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:20 2022] GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59 => generated 1322 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:30:21.773862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-691b7d29-d7fa-44c1-b136-98625e363821 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:21.776065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-691b7d29-d7fa-44c1-b136-98625e363821 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:21.784419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-691b7d29-d7fa-44c1-b136-98625e363821 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:21.793126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-691b7d29-d7fa-44c1-b136-98625e363821 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:21.794649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-691b7d29-d7fa-44c1-b136-98625e363821 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:21.795847 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-691b7d29-d7fa-44c1-b136-98625e363821 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:21.803339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-691b7d29-d7fa-44c1-b136-98625e363821 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:21.804394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-691b7d29-d7fa-44c1-b136-98625e363821 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:21.846778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ebfcff48-c659-4a31-aa39-efc69313659f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:21.873720 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ebfcff48-c659-4a31-aa39-efc69313659f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1313 microversion: 2.1 time: 0.857376 Sep 07 12:30:21.879333 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 309/625] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:21 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1313 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:30:21.915047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ba1a8dc6-7f6e-43d3-8e83-113ca7f95d0a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:21.919377 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ba1a8dc6-7f6e-43d3-8e83-113ca7f95d0a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: e640bc92-0f42-4b0c-b725-9f8d9955e599] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:21.938118 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba1a8dc6-7f6e-43d3-8e83-113ca7f95d0a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:21.939805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba1a8dc6-7f6e-43d3-8e83-113ca7f95d0a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:21.947767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba1a8dc6-7f6e-43d3-8e83-113ca7f95d0a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:21.948934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba1a8dc6-7f6e-43d3-8e83-113ca7f95d0a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:21.949639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba1a8dc6-7f6e-43d3-8e83-113ca7f95d0a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:21.950309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba1a8dc6-7f6e-43d3-8e83-113ca7f95d0a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:22.031561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-691b7d29-d7fa-44c1-b136-98625e363821 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:22.049008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-691b7d29-d7fa-44c1-b136-98625e363821 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:22.051662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-691b7d29-d7fa-44c1-b136-98625e363821 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:22.063711 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-691b7d29-d7fa-44c1-b136-98625e363821 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1447 microversion: 2.75 time: 0.304135 Sep 07 12:30:22.070496 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 317/626] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:21 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1447 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:30:22.087581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-59e0681f-d394-405d-a73c-7c2bd0fae288 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:22.088202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-59e0681f-d394-405d-a73c-7c2bd0fae288 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:22.111303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59e0681f-d394-405d-a73c-7c2bd0fae288 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:22.111726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59e0681f-d394-405d-a73c-7c2bd0fae288 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:22.113999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59e0681f-d394-405d-a73c-7c2bd0fae288 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:22.115668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59e0681f-d394-405d-a73c-7c2bd0fae288 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:22.116909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59e0681f-d394-405d-a73c-7c2bd0fae288 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:22.117637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59e0681f-d394-405d-a73c-7c2bd0fae288 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:22.366955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:30:22.687436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ba1a8dc6-7f6e-43d3-8e83-113ca7f95d0a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:22.697605 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ba1a8dc6-7f6e-43d3-8e83-113ca7f95d0a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599" status: 200 len: 1319 microversion: 2.1 time: 0.816639 Sep 07 12:30:22.714504 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 310/627] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:21 2022] GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599 => generated 1319 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:22.721319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b5990f75-0204-4d95-94e1-d8fbd93cd5bb req-e17da13f-a088-48e3-be04-ecb376316504 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e640bc92-0f42-4b0c-b725-9f8d9955e599", "tag": "a7abd528-ecb2-410d-9bea-fe337eeae72b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:22.742230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b5990f75-0204-4d95-94e1-d8fbd93cd5bb req-e17da13f-a088-48e3-be04-ecb376316504 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:22.743238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b5990f75-0204-4d95-94e1-d8fbd93cd5bb req-e17da13f-a088-48e3-be04-ecb376316504 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:22.743962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b5990f75-0204-4d95-94e1-d8fbd93cd5bb req-e17da13f-a088-48e3-be04-ecb376316504 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:22.766239 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b5990f75-0204-4d95-94e1-d8fbd93cd5bb req-e17da13f-a088-48e3-be04-ecb376316504 service nova] Creating event network-changed:a7abd528-ecb2-410d-9bea-fe337eeae72b for instance e640bc92-0f42-4b0c-b725-9f8d9955e599 on n-h2-852087-9 Sep 07 12:30:22.785864 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b5990f75-0204-4d95-94e1-d8fbd93cd5bb req-e17da13f-a088-48e3-be04-ecb376316504 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069619 Sep 07 12:30:22.786796 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 311/628] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:30:22.792593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-259a4f9f-0818-4219-94f0-f72b14678b9b tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:22.793309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-259a4f9f-0818-4219-94f0-f72b14678b9b tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 97552bf3-7814-403e-b66c-582b2f4f703f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:22.809335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-259a4f9f-0818-4219-94f0-f72b14678b9b tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:22.809885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-259a4f9f-0818-4219-94f0-f72b14678b9b tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:22.810356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-259a4f9f-0818-4219-94f0-f72b14678b9b tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:22.811081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-259a4f9f-0818-4219-94f0-f72b14678b9b tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:22.811561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-259a4f9f-0818-4219-94f0-f72b14678b9b tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:22.811978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-259a4f9f-0818-4219-94f0-f72b14678b9b tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:23.006299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-59e0681f-d394-405d-a73c-7c2bd0fae288 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:23.031211 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-59e0681f-d394-405d-a73c-7c2bd0fae288 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1504 microversion: 2.1 time: 0.959270 Sep 07 12:30:23.033862 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 318/629] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:22 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1504 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:23.040039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:30:23.047246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-57f98948-155d-4735-8ed8-46d67063ab9f req-7f0ccbc1-a155-4226-ba33-17fb1281c8cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd64235e-b7e5-4a81-a2f8-49bb09fecdf9", "name": "network-vif-plugged", "status": "completed", "tag": "f96d9d76-2187-4026-8333-d92e5985ac08"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:23.087797 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-57f98948-155d-4735-8ed8-46d67063ab9f req-7f0ccbc1-a155-4226-ba33-17fb1281c8cb service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:23.090073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-57f98948-155d-4735-8ed8-46d67063ab9f req-7f0ccbc1-a155-4226-ba33-17fb1281c8cb service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:23.091829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-57f98948-155d-4735-8ed8-46d67063ab9f req-7f0ccbc1-a155-4226-ba33-17fb1281c8cb service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:23.128051 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-57f98948-155d-4735-8ed8-46d67063ab9f req-7f0ccbc1-a155-4226-ba33-17fb1281c8cb service nova] Creating event network-vif-plugged:f96d9d76-2187-4026-8333-d92e5985ac08 for instance bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 on n-h2-852087-9 Sep 07 12:30:23.138353 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-57f98948-155d-4735-8ed8-46d67063ab9f req-7f0ccbc1-a155-4226-ba33-17fb1281c8cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100799 Sep 07 12:30:23.139806 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 319/630] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:30:23.155839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c81ab33b-5343-4f0e-af5f-1612906934fe tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:23.158694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c81ab33b-5343-4f0e-af5f-1612906934fe tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 2f60a676-5df0-44d4-b97f-4248a08a9f59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:23.177500 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c81ab33b-5343-4f0e-af5f-1612906934fe tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:23.178046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c81ab33b-5343-4f0e-af5f-1612906934fe tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:23.178505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c81ab33b-5343-4f0e-af5f-1612906934fe tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:23.179318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c81ab33b-5343-4f0e-af5f-1612906934fe tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:23.179787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c81ab33b-5343-4f0e-af5f-1612906934fe tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:23.180219 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c81ab33b-5343-4f0e-af5f-1612906934fe tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:23.872178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-259a4f9f-0818-4219-94f0-f72b14678b9b tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:23.897434 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-259a4f9f-0818-4219-94f0-f72b14678b9b tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f" status: 200 len: 1386 microversion: 2.1 time: 1.109313 Sep 07 12:30:23.899147 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 312/631] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:22 2022] GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f => generated 1386 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:23.904083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9ffb5b63-36b9-4861-bac9-a4e35ad7cc4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:23.904927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9ffb5b63-36b9-4861-bac9-a4e35ad7cc4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:23.915786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ffb5b63-36b9-4861-bac9-a4e35ad7cc4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:23.916529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ffb5b63-36b9-4861-bac9-a4e35ad7cc4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:23.917219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ffb5b63-36b9-4861-bac9-a4e35ad7cc4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:23.918173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ffb5b63-36b9-4861-bac9-a4e35ad7cc4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:23.918813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ffb5b63-36b9-4861-bac9-a4e35ad7cc4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:23.919444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ffb5b63-36b9-4861-bac9-a4e35ad7cc4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:24.063675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c81ab33b-5343-4f0e-af5f-1612906934fe tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:24.075390 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c81ab33b-5343-4f0e-af5f-1612906934fe tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59" status: 200 len: 1322 microversion: 2.1 time: 0.932184 Sep 07 12:30:24.076739 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 320/632] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:23 2022] GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59 => generated 1322 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:24.082930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3d4866e3-518b-41da-9f44-dc84d3416791 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:24.084672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3d4866e3-518b-41da-9f44-dc84d3416791 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:24.099501 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d4866e3-518b-41da-9f44-dc84d3416791 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:24.100434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d4866e3-518b-41da-9f44-dc84d3416791 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:24.101136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d4866e3-518b-41da-9f44-dc84d3416791 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:24.103051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d4866e3-518b-41da-9f44-dc84d3416791 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:24.103741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d4866e3-518b-41da-9f44-dc84d3416791 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:24.104360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d4866e3-518b-41da-9f44-dc84d3416791 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:24.311732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3d4866e3-518b-41da-9f44-dc84d3416791 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:24.321686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3d4866e3-518b-41da-9f44-dc84d3416791 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:24.323625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3d4866e3-518b-41da-9f44-dc84d3416791 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:24.329280 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3d4866e3-518b-41da-9f44-dc84d3416791 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1447 microversion: 2.75 time: 0.250727 Sep 07 12:30:24.330039 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 321/633] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:24 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1447 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:30:24.493603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9ffb5b63-36b9-4861-bac9-a4e35ad7cc4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:24.511962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-63e34beb-112e-4a06-b2dc-1d6ff521b5f1 tempest-InstanceUsageAuditLogNegativeTestJSON-1850951252 tempest-InstanceUsageAuditLogNegativeTestJSON-1850951252-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:24.514303 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-63e34beb-112e-4a06-b2dc-1d6ff521b5f1 tempest-InstanceUsageAuditLogNegativeTestJSON-1850951252 tempest-InstanceUsageAuditLogNegativeTestJSON-1850951252-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Sep 07 12:30:24.521952 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9ffb5b63-36b9-4861-bac9-a4e35ad7cc4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1313 microversion: 2.1 time: 0.618627 Sep 07 12:30:24.525323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-63e34beb-112e-4a06-b2dc-1d6ff521b5f1 tempest-InstanceUsageAuditLogNegativeTestJSON-1850951252 tempest-InstanceUsageAuditLogNegativeTestJSON-1850951252-project-admin] Request method failure captured: Sep 07 12:30:24.525323 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Sep 07 12:30:24.525323 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:30:24.525323 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:30:24.525323 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:30:24.525323 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:30:24.525323 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:30:24.525323 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:30:24.525323 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:30:24.525323 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:30:24.525323 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI7fYzeuK56BJ9L6_ucuOEB52ZKR4UHMG46wLid8wFforpJWuTG5zGdTZlAteP_MLd_UylucerI891XegQq_a1HQaxC9M94K4jRtHqrQzT_LB66VDfrHQA_nkLZAM_s70Yce-5UEarZ99RPkDC4thoDYcH0ExnFXtMsQUesWFMweSzM Sep 07 12:30:24.525323 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:30:24.525323 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:30:24.525323 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:30:24.525323 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:30:24.525323 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:30:24.525323 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:30:24.525323 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: c94d56ae135940feabef9a8302ec1f3d Sep 07 12:30:24.525323 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1850951252 Sep 07 12:30:24.525323 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 12:30:24.525323 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 12:30:24.526728 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c94d56ae135940feabef9a8302ec1f3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c94d56ae135940feabef9a8302ec1f3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c94d56ae135940feabef9a8302ec1f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c94d56ae135940feabef9a8302ec1f3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:30:24.526728 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1850951252 Sep 07 12:30:24.526728 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: c94d56ae135940feabef9a8302ec1f3d Sep 07 12:30:24.526728 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1850951252 Sep 07 12:30:24.526728 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1850951252-project-admin Sep 07 12:30:24.526728 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:30:24.526728 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:30:24.526728 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 32e897e9ba8d4aaf915bc3ae212be79b Sep 07 12:30:24.526728 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1850951252-project-admin Sep 07 12:30:24.526728 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:30:24.526728 n-d-852087-9 devstack@n-api.service[122433]: exception: Invalid timestamp for date invalid_time Sep 07 12:30:24.527395 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'invalid_time'} Sep 07 12:30:24.527395 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:30:24.527395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:24.527395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Sep 07 12:30:24.527395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Sep 07 12:30:24.527395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Sep 07 12:30:24.527395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Sep 07 12:30:24.527395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Sep 07 12:30:24.527395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Sep 07 12:30:24.527395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Sep 07 12:30:24.527395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:24.527395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:24.527395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:24.527395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:24.527395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:24.527395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:24.527395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:30:24.527395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:30:24.527395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:30:24.527395 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:24.528603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Sep 07 12:30:24.528603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Sep 07 12:30:24.528603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Sep 07 12:30:24.528603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:24.528603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:24.528603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:24.528603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:24.528603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:24.528603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:24.528603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:30:24.528603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:30:24.528603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Sep 07 12:30:24.528603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:24.530935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-63e34beb-112e-4a06-b2dc-1d6ff521b5f1 tempest-InstanceUsageAuditLogNegativeTestJSON-1850951252 tempest-InstanceUsageAuditLogNegativeTestJSON-1850951252-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:30:24.532098 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-63e34beb-112e-4a06-b2dc-1d6ff521b5f1 tempest-InstanceUsageAuditLogNegativeTestJSON-1850951252 tempest-InstanceUsageAuditLogNegativeTestJSON-1850951252-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.200792 Sep 07 12:30:24.533191 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 322/634] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 12:30:24 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 202 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 07 12:30:24.535354 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 313/635] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:23 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1313 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:24.540846 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-199512ac-1ee4-487b-8390-535bb6625ef3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:24.541472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-199512ac-1ee4-487b-8390-535bb6625ef3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:24.546198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3765af60-ebfd-4bd5-99a0-87a4e20cd58a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:24.546808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3765af60-ebfd-4bd5-99a0-87a4e20cd58a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: e640bc92-0f42-4b0c-b725-9f8d9955e599] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:24.553607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-199512ac-1ee4-487b-8390-535bb6625ef3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:24.554068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3765af60-ebfd-4bd5-99a0-87a4e20cd58a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:24.554634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-199512ac-1ee4-487b-8390-535bb6625ef3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:24.555015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3765af60-ebfd-4bd5-99a0-87a4e20cd58a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:24.555670 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3765af60-ebfd-4bd5-99a0-87a4e20cd58a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:24.556621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3765af60-ebfd-4bd5-99a0-87a4e20cd58a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:24.557294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3765af60-ebfd-4bd5-99a0-87a4e20cd58a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:24.557698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-199512ac-1ee4-487b-8390-535bb6625ef3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:24.558194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3765af60-ebfd-4bd5-99a0-87a4e20cd58a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:24.590288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-199512ac-1ee4-487b-8390-535bb6625ef3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:24.590971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-199512ac-1ee4-487b-8390-535bb6625ef3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:24.592297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-199512ac-1ee4-487b-8390-535bb6625ef3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:24.958187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3765af60-ebfd-4bd5-99a0-87a4e20cd58a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:24.966776 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3765af60-ebfd-4bd5-99a0-87a4e20cd58a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599" status: 200 len: 1319 microversion: 2.1 time: 0.424392 Sep 07 12:30:24.967428 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 323/636] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:24 2022] GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599 => generated 1319 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:25.010234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-199512ac-1ee4-487b-8390-535bb6625ef3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:25.024935 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-199512ac-1ee4-487b-8390-535bb6625ef3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1504 microversion: 2.1 time: 0.488013 Sep 07 12:30:25.026193 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 314/637] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:24 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1504 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:25.035917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-99604200-4d1c-4709-a6eb-27a1f435d916 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:25.037477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-99604200-4d1c-4709-a6eb-27a1f435d916 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 97552bf3-7814-403e-b66c-582b2f4f703f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:25.047599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99604200-4d1c-4709-a6eb-27a1f435d916 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:25.049111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99604200-4d1c-4709-a6eb-27a1f435d916 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:25.049873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99604200-4d1c-4709-a6eb-27a1f435d916 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:25.051789 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99604200-4d1c-4709-a6eb-27a1f435d916 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:25.052868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99604200-4d1c-4709-a6eb-27a1f435d916 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:25.053514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99604200-4d1c-4709-a6eb-27a1f435d916 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:25.132285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de9db297-1013-4d78-8d20-1d6538320f7c tempest-InstanceUsageAuditLogNegativeTestJSON-473031234 tempest-InstanceUsageAuditLogNegativeTestJSON-473031234-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:25.133910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-de9db297-1013-4d78-8d20-1d6538320f7c tempest-InstanceUsageAuditLogNegativeTestJSON-473031234 tempest-InstanceUsageAuditLogNegativeTestJSON-473031234-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'f6122e4149024c1694d4a805cb22b6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d28e844978e4e2593968d1c97e3614c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:25.135539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de9db297-1013-4d78-8d20-1d6538320f7c tempest-InstanceUsageAuditLogNegativeTestJSON-473031234 tempest-InstanceUsageAuditLogNegativeTestJSON-473031234-project] Request method failure captured: Sep 07 12:30:25.135539 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Sep 07 12:30:25.135539 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:30:25.135539 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:30:25.135539 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:30:25.135539 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:30:25.135539 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:30:25.135539 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:30:25.135539 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:30:25.135539 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:30:25.135539 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI7eMiKVa-_qK63Ed5MEM_0w8g25vwFSsZKiQnW4Ck0PV5WNbidTAvmW37DuKEYJoT-eGjjfgv51Far8A6UPmOyvdn5DMIwNu9al6K20GwcK8bjxsrQtRAoc_Iyrvv_bKhTLxxSnZI9axuI8mdWTFF7FaW4XSUcmKdrmlQH15jXlLY8 Sep 07 12:30:25.135539 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:30:25.135539 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:30:25.135539 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:30:25.135539 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:30:25.135539 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:30:25.135539 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:30:25.135539 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 9d28e844978e4e2593968d1c97e3614c Sep 07 12:30:25.135539 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-473031234 Sep 07 12:30:25.135539 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:30:25.135539 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:30:25.136921 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9d28e844978e4e2593968d1c97e3614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9d28e844978e4e2593968d1c97e3614c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9d28e844978e4e2593968d1c97e3614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9d28e844978e4e2593968d1c97e3614c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:30:25.136921 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-473031234 Sep 07 12:30:25.136921 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 9d28e844978e4e2593968d1c97e3614c Sep 07 12:30:25.136921 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-473031234 Sep 07 12:30:25.136921 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-473031234-project Sep 07 12:30:25.136921 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:30:25.136921 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:30:25.136921 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: f6122e4149024c1694d4a805cb22b6ef Sep 07 12:30:25.136921 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-473031234-project Sep 07 12:30:25.136921 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:30:25.137569 n-d-852087-9 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 07 12:30:25.137569 n-d-852087-9 devstack@n-api.service[122433]: action_args: {} Sep 07 12:30:25.137569 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:30:25.137569 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:25.137569 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:25.137569 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:25.137569 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:30:25.137569 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:30:25.137569 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:30:25.137569 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:25.137569 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Sep 07 12:30:25.137569 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Sep 07 12:30:25.137569 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:30:25.137569 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:30:25.137569 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:30:25.137569 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:30:25.137569 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:30:25.137569 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:30:25.137569 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:30:25.137569 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:30:25.138724 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:30:25.138724 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:30:25.138724 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:30:25.138724 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:30:25.138724 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:30:25.138724 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:30:25.138724 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 07 12:30:25.138724 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:25.138724 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:25.138724 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:25.138724 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:25.138724 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:25.138724 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:25.138724 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:30:25.138724 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:30:25.138724 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 07 12:30:25.138724 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:25.141221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de9db297-1013-4d78-8d20-1d6538320f7c tempest-InstanceUsageAuditLogNegativeTestJSON-473031234 tempest-InstanceUsageAuditLogNegativeTestJSON-473031234-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:30:25.142407 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-de9db297-1013-4d78-8d20-1d6538320f7c tempest-InstanceUsageAuditLogNegativeTestJSON-473031234 tempest-InstanceUsageAuditLogNegativeTestJSON-473031234-project] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.173582 Sep 07 12:30:25.142894 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 324/638] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Sep 7 12:30:24 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 175 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:30:25.148174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d380153d-0531-44ac-97e9-8a59579bc96c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:25.148822 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d380153d-0531-44ac-97e9-8a59579bc96c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 2f60a676-5df0-44d4-b97f-4248a08a9f59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:25.160367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d380153d-0531-44ac-97e9-8a59579bc96c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:25.161254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d380153d-0531-44ac-97e9-8a59579bc96c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:25.161889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d380153d-0531-44ac-97e9-8a59579bc96c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:25.163825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d380153d-0531-44ac-97e9-8a59579bc96c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:25.164549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d380153d-0531-44ac-97e9-8a59579bc96c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:25.165186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d380153d-0531-44ac-97e9-8a59579bc96c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:25.400299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-99604200-4d1c-4709-a6eb-27a1f435d916 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:25.415711 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-99604200-4d1c-4709-a6eb-27a1f435d916 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f" status: 200 len: 1585 microversion: 2.1 time: 0.387822 Sep 07 12:30:25.417027 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 315/639] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:25 2022] GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f => generated 1585 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:25.427172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c2e74432-02f3-4e95-9c8a-895c67e63786 tempest-InstanceUsageAuditLogNegativeTestJSON-473031234 tempest-InstanceUsageAuditLogNegativeTestJSON-473031234-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:25.430864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c2e74432-02f3-4e95-9c8a-895c67e63786 tempest-InstanceUsageAuditLogNegativeTestJSON-473031234 tempest-InstanceUsageAuditLogNegativeTestJSON-473031234-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'f6122e4149024c1694d4a805cb22b6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d28e844978e4e2593968d1c97e3614c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:25.434602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c2e74432-02f3-4e95-9c8a-895c67e63786 tempest-InstanceUsageAuditLogNegativeTestJSON-473031234 tempest-InstanceUsageAuditLogNegativeTestJSON-473031234-project] Request method failure captured: Sep 07 12:30:25.434602 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-09-07%2012:30:25 HTTP/1.1 Sep 07 12:30:25.434602 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:30:25.434602 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:30:25.434602 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:30:25.434602 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:30:25.434602 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:30:25.434602 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:30:25.434602 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:30:25.434602 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:30:25.434602 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI7eMiKVa-_qK63Ed5MEM_0w8g25vwFSsZKiQnW4Ck0PV5WNbidTAvmW37DuKEYJoT-eGjjfgv51Far8A6UPmOyvdn5DMIwNu9al6K20GwcK8bjxsrQtRAoc_Iyrvv_bKhTLxxSnZI9axuI8mdWTFF7FaW4XSUcmKdrmlQH15jXlLY8 Sep 07 12:30:25.434602 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:30:25.434602 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:30:25.434602 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:30:25.434602 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:30:25.434602 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:30:25.434602 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:30:25.434602 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 9d28e844978e4e2593968d1c97e3614c Sep 07 12:30:25.434602 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-473031234 Sep 07 12:30:25.434602 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:30:25.434602 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:30:25.437093 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9d28e844978e4e2593968d1c97e3614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9d28e844978e4e2593968d1c97e3614c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9d28e844978e4e2593968d1c97e3614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9d28e844978e4e2593968d1c97e3614c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:30:25.437093 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-473031234 Sep 07 12:30:25.437093 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 9d28e844978e4e2593968d1c97e3614c Sep 07 12:30:25.437093 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-473031234 Sep 07 12:30:25.437093 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-473031234-project Sep 07 12:30:25.437093 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:30:25.437093 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:30:25.437093 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: f6122e4149024c1694d4a805cb22b6ef Sep 07 12:30:25.437093 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-473031234-project Sep 07 12:30:25.437093 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:30:25.438721 n-d-852087-9 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 07 12:30:25.438721 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '2022-09-07 12:30:25'} Sep 07 12:30:25.438721 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:30:25.438721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:25.438721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:25.438721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:25.438721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:30:25.438721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:30:25.438721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:30:25.438721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:25.438721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Sep 07 12:30:25.438721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Sep 07 12:30:25.438721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:30:25.438721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:30:25.438721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:30:25.438721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:30:25.438721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:30:25.438721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:30:25.438721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:30:25.438721 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:30:25.442301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:30:25.442301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:30:25.442301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:30:25.442301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:30:25.442301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:30:25.442301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:30:25.442301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 07 12:30:25.442301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:25.442301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:25.442301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:25.442301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:25.442301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:25.442301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:25.442301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:30:25.442301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:30:25.442301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 07 12:30:25.442301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:25.445629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c2e74432-02f3-4e95-9c8a-895c67e63786 tempest-InstanceUsageAuditLogNegativeTestJSON-473031234 tempest-InstanceUsageAuditLogNegativeTestJSON-473031234-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:30:25.445629 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c2e74432-02f3-4e95-9c8a-895c67e63786 tempest-InstanceUsageAuditLogNegativeTestJSON-473031234 tempest-InstanceUsageAuditLogNegativeTestJSON-473031234-project] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-07 12:30:25" status: 403 len: 128 microversion: 2.1 time: 0.018249 Sep 07 12:30:25.445629 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 316/640] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Sep 7 12:30:25 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-07%2012%3A30%3A25 => generated 128 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:30:25.454239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-ce72b15b-b0b9-4840-b963-37756cda7f96 req-dcae26d8-73b5-400a-b260-39bdfc8ec4e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f60a676-5df0-44d4-b97f-4248a08a9f59", "name": "network-vif-plugged", "status": "completed", "tag": "0f1b146e-906f-46c2-b83b-28bbca816276"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:25.461583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d380153d-0531-44ac-97e9-8a59579bc96c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:25.473959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ce72b15b-b0b9-4840-b963-37756cda7f96 req-dcae26d8-73b5-400a-b260-39bdfc8ec4e3 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:25.474769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ce72b15b-b0b9-4840-b963-37756cda7f96 req-dcae26d8-73b5-400a-b260-39bdfc8ec4e3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:25.475940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ce72b15b-b0b9-4840-b963-37756cda7f96 req-dcae26d8-73b5-400a-b260-39bdfc8ec4e3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:25.479772 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d380153d-0531-44ac-97e9-8a59579bc96c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59" status: 200 len: 1322 microversion: 2.1 time: 0.329855 Sep 07 12:30:25.480465 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 325/641] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:25 2022] GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59 => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:25.500591 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-ce72b15b-b0b9-4840-b963-37756cda7f96 req-dcae26d8-73b5-400a-b260-39bdfc8ec4e3 service nova] Creating event network-vif-plugged:0f1b146e-906f-46c2-b83b-28bbca816276 for instance 2f60a676-5df0-44d4-b97f-4248a08a9f59 on n-h1-852087-9 Sep 07 12:30:25.507474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ff519cf-02b3-40e9-b6a0-ccd61f2e5ffb tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:25.508827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8ff519cf-02b3-40e9-b6a0-ccd61f2e5ffb tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:25.515612 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-ce72b15b-b0b9-4840-b963-37756cda7f96 req-dcae26d8-73b5-400a-b260-39bdfc8ec4e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066615 Sep 07 12:30:25.517850 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ff519cf-02b3-40e9-b6a0-ccd61f2e5ffb tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:25.519366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ff519cf-02b3-40e9-b6a0-ccd61f2e5ffb tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:25.520423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ff519cf-02b3-40e9-b6a0-ccd61f2e5ffb tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:25.522672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ff519cf-02b3-40e9-b6a0-ccd61f2e5ffb tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:25.525143 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 317/642] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:30:25.526557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ff519cf-02b3-40e9-b6a0-ccd61f2e5ffb tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:25.527693 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ff519cf-02b3-40e9-b6a0-ccd61f2e5ffb tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:25.545860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-21db22d7-e672-4a2e-80ca-950a930dba90 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:25.548873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-21db22d7-e672-4a2e-80ca-950a930dba90 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 97552bf3-7814-403e-b66c-582b2f4f703f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:25.568611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21db22d7-e672-4a2e-80ca-950a930dba90 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:25.569191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21db22d7-e672-4a2e-80ca-950a930dba90 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:25.569721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21db22d7-e672-4a2e-80ca-950a930dba90 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:25.570438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21db22d7-e672-4a2e-80ca-950a930dba90 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:25.570900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21db22d7-e672-4a2e-80ca-950a930dba90 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:25.571323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21db22d7-e672-4a2e-80ca-950a930dba90 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:25.812098 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8ff519cf-02b3-40e9-b6a0-ccd61f2e5ffb tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:25.841085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8ff519cf-02b3-40e9-b6a0-ccd61f2e5ffb tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:25.844044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8ff519cf-02b3-40e9-b6a0-ccd61f2e5ffb tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:25.854287 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8ff519cf-02b3-40e9-b6a0-ccd61f2e5ffb tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1447 microversion: 2.75 time: 0.364525 Sep 07 12:30:25.855919 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 326/643] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:25 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1447 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:30:25.865410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-52fed3ac-dc01-449e-aa94-ea04417a4146 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:25.867169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-52fed3ac-dc01-449e-aa94-ea04417a4146 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:25.875584 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-21db22d7-e672-4a2e-80ca-950a930dba90 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.347675 Sep 07 12:30:25.876532 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 318/644] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Sep 7 12:30:25 2022] GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f/os-interface => generated 284 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:30:25.881015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52fed3ac-dc01-449e-aa94-ea04417a4146 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:25.882326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52fed3ac-dc01-449e-aa94-ea04417a4146 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:25.883279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52fed3ac-dc01-449e-aa94-ea04417a4146 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:25.884750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52fed3ac-dc01-449e-aa94-ea04417a4146 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:25.885875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52fed3ac-dc01-449e-aa94-ea04417a4146 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:25.886987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52fed3ac-dc01-449e-aa94-ea04417a4146 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:25.997153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-62d4d669-6e5d-4184-ac17-4dd3d3f4a072 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:25.997153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-62d4d669-6e5d-4184-ac17-4dd3d3f4a072 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: e640bc92-0f42-4b0c-b725-9f8d9955e599] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:26.008681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62d4d669-6e5d-4184-ac17-4dd3d3f4a072 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:26.009562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62d4d669-6e5d-4184-ac17-4dd3d3f4a072 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:26.010298 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62d4d669-6e5d-4184-ac17-4dd3d3f4a072 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:26.011849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62d4d669-6e5d-4184-ac17-4dd3d3f4a072 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:26.012682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62d4d669-6e5d-4184-ac17-4dd3d3f4a072 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:26.013330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62d4d669-6e5d-4184-ac17-4dd3d3f4a072 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:26.979451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-52fed3ac-dc01-449e-aa94-ea04417a4146 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:26.992244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-62d4d669-6e5d-4184-ac17-4dd3d3f4a072 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:27.003600 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-62d4d669-6e5d-4184-ac17-4dd3d3f4a072 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599" status: 200 len: 1319 microversion: 2.1 time: 1.014483 Sep 07 12:30:27.023476 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 319/645] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:25 2022] GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599 => generated 1319 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:27.028984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-207dc60f-ebfa-4ade-bc49-1309af77f0f8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:27.042288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-207dc60f-ebfa-4ade-bc49-1309af77f0f8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:27.048841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-207dc60f-ebfa-4ade-bc49-1309af77f0f8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:27.049455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-207dc60f-ebfa-4ade-bc49-1309af77f0f8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:27.049956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-207dc60f-ebfa-4ade-bc49-1309af77f0f8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:27.050681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-207dc60f-ebfa-4ade-bc49-1309af77f0f8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:27.051144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-207dc60f-ebfa-4ade-bc49-1309af77f0f8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:27.051575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-207dc60f-ebfa-4ade-bc49-1309af77f0f8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:27.056317 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-52fed3ac-dc01-449e-aa94-ea04417a4146 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1313 microversion: 2.1 time: 1.198094 Sep 07 12:30:27.070690 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 327/646] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:25 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1313 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:27.085159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7d3c8fa7-8d77-4cc2-9f02-2f6d23a32061 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:27.087542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7d3c8fa7-8d77-4cc2-9f02-2f6d23a32061 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 2f60a676-5df0-44d4-b97f-4248a08a9f59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:27.103152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d3c8fa7-8d77-4cc2-9f02-2f6d23a32061 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:27.104418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d3c8fa7-8d77-4cc2-9f02-2f6d23a32061 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:27.105442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d3c8fa7-8d77-4cc2-9f02-2f6d23a32061 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:27.107547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d3c8fa7-8d77-4cc2-9f02-2f6d23a32061 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:27.109255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d3c8fa7-8d77-4cc2-9f02-2f6d23a32061 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:27.110287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d3c8fa7-8d77-4cc2-9f02-2f6d23a32061 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:28.115076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7d3c8fa7-8d77-4cc2-9f02-2f6d23a32061 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:28.125243 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7d3c8fa7-8d77-4cc2-9f02-2f6d23a32061 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59" status: 200 len: 1322 microversion: 2.1 time: 1.053184 Sep 07 12:30:28.143198 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 328/647] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:27 2022] GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59 => generated 1322 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:28.155987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7324b9e6-53f9-4db9-8234-c10211ba78bf tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:28.158202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7324b9e6-53f9-4db9-8234-c10211ba78bf tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:28.169945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7324b9e6-53f9-4db9-8234-c10211ba78bf tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:28.170728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7324b9e6-53f9-4db9-8234-c10211ba78bf tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:28.171365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7324b9e6-53f9-4db9-8234-c10211ba78bf tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:28.172301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7324b9e6-53f9-4db9-8234-c10211ba78bf tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:28.173655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7324b9e6-53f9-4db9-8234-c10211ba78bf tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:28.174286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7324b9e6-53f9-4db9-8234-c10211ba78bf tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:28.194507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-207dc60f-ebfa-4ade-bc49-1309af77f0f8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:28.213075 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-207dc60f-ebfa-4ade-bc49-1309af77f0f8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1504 microversion: 2.1 time: 1.188279 Sep 07 12:30:28.222048 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 320/648] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:27 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1504 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:28.241385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d8115178-e1c6-4aaa-bed1-98c63e45e2bc tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:28.243753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d8115178-e1c6-4aaa-bed1-98c63e45e2bc tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 97552bf3-7814-403e-b66c-582b2f4f703f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:28.261507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8115178-e1c6-4aaa-bed1-98c63e45e2bc tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:28.265112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8115178-e1c6-4aaa-bed1-98c63e45e2bc tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:28.266638 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8115178-e1c6-4aaa-bed1-98c63e45e2bc tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:28.267609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8115178-e1c6-4aaa-bed1-98c63e45e2bc tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:28.268248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8115178-e1c6-4aaa-bed1-98c63e45e2bc tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:28.269844 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8115178-e1c6-4aaa-bed1-98c63e45e2bc tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:28.449534 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7324b9e6-53f9-4db9-8234-c10211ba78bf tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:28.483338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7324b9e6-53f9-4db9-8234-c10211ba78bf tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:28.490766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7324b9e6-53f9-4db9-8234-c10211ba78bf tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:28.507877 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7324b9e6-53f9-4db9-8234-c10211ba78bf tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1447 microversion: 2.75 time: 0.362478 Sep 07 12:30:28.509843 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 329/649] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:28 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1447 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:30:28.519864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c32e5c26-1f6c-4662-be9f-98ac1b8b2f27 req-8adfab44-7c0a-4f87-8b5a-b1ab74803c20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97552bf3-7814-403e-b66c-582b2f4f703f", "tag": "6577c68c-93a9-4100-9045-b5fed985d7db"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:28.562101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c32e5c26-1f6c-4662-be9f-98ac1b8b2f27 req-8adfab44-7c0a-4f87-8b5a-b1ab74803c20 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:28.567637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c32e5c26-1f6c-4662-be9f-98ac1b8b2f27 req-8adfab44-7c0a-4f87-8b5a-b1ab74803c20 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:28.569678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c32e5c26-1f6c-4662-be9f-98ac1b8b2f27 req-8adfab44-7c0a-4f87-8b5a-b1ab74803c20 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:28.592874 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c32e5c26-1f6c-4662-be9f-98ac1b8b2f27 req-8adfab44-7c0a-4f87-8b5a-b1ab74803c20 service nova] Creating event network-changed:6577c68c-93a9-4100-9045-b5fed985d7db for instance 97552bf3-7814-403e-b66c-582b2f4f703f on n-h1-852087-9 Sep 07 12:30:28.601582 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c32e5c26-1f6c-4662-be9f-98ac1b8b2f27 req-8adfab44-7c0a-4f87-8b5a-b1ab74803c20 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089939 Sep 07 12:30:28.605013 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 330/650] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:30:28.615019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6b82eb74-2b3f-4800-bcfc-de73e8e1ae2e tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:28.617128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6b82eb74-2b3f-4800-bcfc-de73e8e1ae2e tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: e640bc92-0f42-4b0c-b725-9f8d9955e599] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:28.627747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b82eb74-2b3f-4800-bcfc-de73e8e1ae2e tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:28.628349 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b82eb74-2b3f-4800-bcfc-de73e8e1ae2e tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:28.628918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b82eb74-2b3f-4800-bcfc-de73e8e1ae2e tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:28.629794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b82eb74-2b3f-4800-bcfc-de73e8e1ae2e tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:28.630721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b82eb74-2b3f-4800-bcfc-de73e8e1ae2e tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:28.631765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b82eb74-2b3f-4800-bcfc-de73e8e1ae2e tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:29.682695 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6b82eb74-2b3f-4800-bcfc-de73e8e1ae2e tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:29.743565 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6b82eb74-2b3f-4800-bcfc-de73e8e1ae2e tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599" status: 200 len: 1319 microversion: 2.1 time: 1.136484 Sep 07 12:30:29.768554 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 331/651] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:28 2022] GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599 => generated 1319 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:29.795529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f7010d6c-277e-4f89-917c-ca287354f619 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:29.798994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f7010d6c-277e-4f89-917c-ca287354f619 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:29.862998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7010d6c-277e-4f89-917c-ca287354f619 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:29.863981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7010d6c-277e-4f89-917c-ca287354f619 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:29.864653 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7010d6c-277e-4f89-917c-ca287354f619 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:29.880145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7010d6c-277e-4f89-917c-ca287354f619 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:29.883373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7010d6c-277e-4f89-917c-ca287354f619 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:29.888545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7010d6c-277e-4f89-917c-ca287354f619 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:30.331409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d8115178-e1c6-4aaa-bed1-98c63e45e2bc tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:30.359686 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d8115178-e1c6-4aaa-bed1-98c63e45e2bc tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f" status: 200 len: 1585 microversion: 2.1 time: 2.135185 Sep 07 12:30:30.370135 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 321/652] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:28 2022] GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f => generated 1585 bytes in 2147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:30.399413 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8ec100b1-7bb1-4a3c-a93b-25d3d9c0ed91 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:30.403642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8ec100b1-7bb1-4a3c-a93b-25d3d9c0ed91 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 2f60a676-5df0-44d4-b97f-4248a08a9f59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:30.416635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ec100b1-7bb1-4a3c-a93b-25d3d9c0ed91 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:30.418425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ec100b1-7bb1-4a3c-a93b-25d3d9c0ed91 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:30.425324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ec100b1-7bb1-4a3c-a93b-25d3d9c0ed91 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:30.426445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ec100b1-7bb1-4a3c-a93b-25d3d9c0ed91 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:30.427102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ec100b1-7bb1-4a3c-a93b-25d3d9c0ed91 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:30.427713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ec100b1-7bb1-4a3c-a93b-25d3d9c0ed91 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:30.442660 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:30:31.648420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8ec100b1-7bb1-4a3c-a93b-25d3d9c0ed91 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:31.649001 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f7010d6c-277e-4f89-917c-ca287354f619 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:31.657312 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f7010d6c-277e-4f89-917c-ca287354f619 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1463 microversion: 2.1 time: 1.880770 Sep 07 12:30:31.661779 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8ec100b1-7bb1-4a3c-a93b-25d3d9c0ed91 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59" status: 200 len: 1472 microversion: 2.1 time: 1.290414 Sep 07 12:30:31.663107 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 322/653] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:30 2022] GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59 => generated 1472 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:31.666628 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 332/654] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:29 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1463 bytes in 1916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:31.672011 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c33be26-f761-41df-8982-b12161bd009d tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:31.672560 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2c33be26-f761-41df-8982-b12161bd009d tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:31.673539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6c0148e2-5704-4d91-8a75-6f9d3b39066b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:31.675242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6c0148e2-5704-4d91-8a75-6f9d3b39066b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:31.689187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c33be26-f761-41df-8982-b12161bd009d tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:31.689935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c33be26-f761-41df-8982-b12161bd009d tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:31.690384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c33be26-f761-41df-8982-b12161bd009d tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:31.691111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c33be26-f761-41df-8982-b12161bd009d tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:31.693800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c0148e2-5704-4d91-8a75-6f9d3b39066b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:31.694391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c0148e2-5704-4d91-8a75-6f9d3b39066b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:31.694834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c0148e2-5704-4d91-8a75-6f9d3b39066b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:31.696076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c0148e2-5704-4d91-8a75-6f9d3b39066b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:31.696698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c0148e2-5704-4d91-8a75-6f9d3b39066b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:31.697267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c0148e2-5704-4d91-8a75-6f9d3b39066b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:31.698421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c33be26-f761-41df-8982-b12161bd009d tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:31.698883 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c33be26-f761-41df-8982-b12161bd009d tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:32.002518 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2c33be26-f761-41df-8982-b12161bd009d tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:32.005220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:30:32.028178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2c33be26-f761-41df-8982-b12161bd009d tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:32.031527 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2c33be26-f761-41df-8982-b12161bd009d tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:32.043799 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2c33be26-f761-41df-8982-b12161bd009d tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1447 microversion: 2.75 time: 0.375839 Sep 07 12:30:32.060010 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 333/655] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:31 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1447 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:30:32.060010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-32a0ed5c-c835-4800-ac99-223848ed535a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:32.062109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-32a0ed5c-c835-4800-ac99-223848ed535a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: e640bc92-0f42-4b0c-b725-9f8d9955e599] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:32.075738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32a0ed5c-c835-4800-ac99-223848ed535a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:32.081162 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32a0ed5c-c835-4800-ac99-223848ed535a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:32.087414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32a0ed5c-c835-4800-ac99-223848ed535a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:32.088409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32a0ed5c-c835-4800-ac99-223848ed535a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:32.089311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32a0ed5c-c835-4800-ac99-223848ed535a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:32.090023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32a0ed5c-c835-4800-ac99-223848ed535a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:32.670390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6c0148e2-5704-4d91-8a75-6f9d3b39066b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:32.689126 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6c0148e2-5704-4d91-8a75-6f9d3b39066b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1479 microversion: 2.1 time: 1.022201 Sep 07 12:30:32.690113 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 323/656] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:31 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1479 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:32.701358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8079278e-94d0-4146-8efa-b29d839f7d55 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:32.715941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8079278e-94d0-4146-8efa-b29d839f7d55 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] [instance: 2f60a676-5df0-44d4-b97f-4248a08a9f59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:32.743490 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8079278e-94d0-4146-8efa-b29d839f7d55 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:32.746779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8079278e-94d0-4146-8efa-b29d839f7d55 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:32.747541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8079278e-94d0-4146-8efa-b29d839f7d55 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:32.755178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8079278e-94d0-4146-8efa-b29d839f7d55 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:32.758731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8079278e-94d0-4146-8efa-b29d839f7d55 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:32.762084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8079278e-94d0-4146-8efa-b29d839f7d55 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:32.892962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-8079278e-94d0-4146-8efa-b29d839f7d55 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Lazy-loading 'flavor' on Instance uuid 2f60a676-5df0-44d4-b97f-4248a08a9f59 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:30:32.902032 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-32a0ed5c-c835-4800-ac99-223848ed535a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:32.953177 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-32a0ed5c-c835-4800-ac99-223848ed535a tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599" status: 200 len: 1319 microversion: 2.1 time: 0.905855 Sep 07 12:30:32.957936 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 334/657] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:32 2022] GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599 => generated 1319 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:32.968114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e1d693b9-95ec-4e4c-9d9d-ed81b1c8df6e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:32.978181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e1d693b9-95ec-4e4c-9d9d-ed81b1c8df6e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:33.002242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1d693b9-95ec-4e4c-9d9d-ed81b1c8df6e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:33.003164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1d693b9-95ec-4e4c-9d9d-ed81b1c8df6e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:33.003838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1d693b9-95ec-4e4c-9d9d-ed81b1c8df6e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:33.006624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1d693b9-95ec-4e4c-9d9d-ed81b1c8df6e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:33.007342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1d693b9-95ec-4e4c-9d9d-ed81b1c8df6e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:33.010279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1d693b9-95ec-4e4c-9d9d-ed81b1c8df6e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:33.189053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e1d693b9-95ec-4e4c-9d9d-ed81b1c8df6e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:33.213955 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8079278e-94d0-4146-8efa-b29d839f7d55 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59/action" status: 202 len: 0 microversion: 2.1 time: 0.512941 Sep 07 12:30:33.217886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e1d693b9-95ec-4e4c-9d9d-ed81b1c8df6e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Old instance type m1.heat2, new instance type m1.heat {{(pid=122433) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 12:30:33.218445 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 324/658] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:30:32 2022] POST /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:30:33.228250 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-5ec7e2a9-e467-49e1-b703-480b0e5de5a2 req-1bb8a94b-07b5-4a11-9eb5-beb64f0ab8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e640bc92-0f42-4b0c-b725-9f8d9955e599", "name": "network-vif-plugged", "status": "completed", "tag": "a7abd528-ecb2-410d-9bea-fe337eeae72b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:33.240245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e1d693b9-95ec-4e4c-9d9d-ed81b1c8df6e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:30:33.241795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e1d693b9-95ec-4e4c-9d9d-ed81b1c8df6e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:30:33.244840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e1d693b9-95ec-4e4c-9d9d-ed81b1c8df6e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:30:33.246414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e1d693b9-95ec-4e4c-9d9d-ed81b1c8df6e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:30:33.247718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e1d693b9-95ec-4e4c-9d9d-ed81b1c8df6e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:30:33.262559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5ec7e2a9-e467-49e1-b703-480b0e5de5a2 req-1bb8a94b-07b5-4a11-9eb5-beb64f0ab8d7 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:33.263607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5ec7e2a9-e467-49e1-b703-480b0e5de5a2 req-1bb8a94b-07b5-4a11-9eb5-beb64f0ab8d7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:33.264325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5ec7e2a9-e467-49e1-b703-480b0e5de5a2 req-1bb8a94b-07b5-4a11-9eb5-beb64f0ab8d7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:33.284459 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-5ec7e2a9-e467-49e1-b703-480b0e5de5a2 req-1bb8a94b-07b5-4a11-9eb5-beb64f0ab8d7 service nova] Creating event network-vif-plugged:a7abd528-ecb2-410d-9bea-fe337eeae72b for instance e640bc92-0f42-4b0c-b725-9f8d9955e599 on n-h2-852087-9 Sep 07 12:30:33.306210 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-5ec7e2a9-e467-49e1-b703-480b0e5de5a2 req-1bb8a94b-07b5-4a11-9eb5-beb64f0ab8d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085592 Sep 07 12:30:33.311132 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 325/659] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:30:33.334244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1f75c052-dc93-451b-9992-fa85ddf7ea86 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Calling method '.version_select at 0x7fc4194e44c0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:33.341667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f75c052-dc93-451b-9992-fa85ddf7ea86 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:33.342491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f75c052-dc93-451b-9992-fa85ddf7ea86 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:33.343196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f75c052-dc93-451b-9992-fa85ddf7ea86 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:33.360456 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1f75c052-dc93-451b-9992-fa85ddf7ea86 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1175 microversion: 2.1 time: 0.047222 Sep 07 12:30:33.381852 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 326/660] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Sep 7 12:30:33 2022] GET /compute/v2.1/os-migrations => generated 1175 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:33.395011 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-24e36b5b-7346-46d9-b2d1-62290e114e09 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:33.398202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-24e36b5b-7346-46d9-b2d1-62290e114e09 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:33.411567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24e36b5b-7346-46d9-b2d1-62290e114e09 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:33.412368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24e36b5b-7346-46d9-b2d1-62290e114e09 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:33.413026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24e36b5b-7346-46d9-b2d1-62290e114e09 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:33.414151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24e36b5b-7346-46d9-b2d1-62290e114e09 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:33.414878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24e36b5b-7346-46d9-b2d1-62290e114e09 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:33.415530 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24e36b5b-7346-46d9-b2d1-62290e114e09 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:33.612898 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e1d693b9-95ec-4e4c-9d9d-ed81b1c8df6e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "POST /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9/action" status: 202 len: 0 microversion: 2.1 time: 0.651373 Sep 07 12:30:33.613775 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 335/661] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:30:32 2022] POST /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9/action => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:30:33.631634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e7fbdb79-2fcb-4d3f-b3bf-acccf7b3785f tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:33.632276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e7fbdb79-2fcb-4d3f-b3bf-acccf7b3785f tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] [instance: 2f60a676-5df0-44d4-b97f-4248a08a9f59] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:33.651693 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7fbdb79-2fcb-4d3f-b3bf-acccf7b3785f tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:33.652204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7fbdb79-2fcb-4d3f-b3bf-acccf7b3785f tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:33.652650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7fbdb79-2fcb-4d3f-b3bf-acccf7b3785f tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:33.653369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7fbdb79-2fcb-4d3f-b3bf-acccf7b3785f tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:33.660090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7fbdb79-2fcb-4d3f-b3bf-acccf7b3785f tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:33.660090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7fbdb79-2fcb-4d3f-b3bf-acccf7b3785f tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:33.818714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-24e36b5b-7346-46d9-b2d1-62290e114e09 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:33.836017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-24e36b5b-7346-46d9-b2d1-62290e114e09 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:33.848483 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-24e36b5b-7346-46d9-b2d1-62290e114e09 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:33.858211 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-24e36b5b-7346-46d9-b2d1-62290e114e09 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1447 microversion: 2.75 time: 0.472620 Sep 07 12:30:33.860818 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 327/662] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:33 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1447 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:30:33.870752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b1e75c70-7509-468e-aefd-3d9283fd8ada tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:33.873242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b1e75c70-7509-468e-aefd-3d9283fd8ada tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:33.906719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1e75c70-7509-468e-aefd-3d9283fd8ada tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:33.911223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1e75c70-7509-468e-aefd-3d9283fd8ada tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:33.911738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1e75c70-7509-468e-aefd-3d9283fd8ada tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:33.912494 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1e75c70-7509-468e-aefd-3d9283fd8ada tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:33.913038 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1e75c70-7509-468e-aefd-3d9283fd8ada tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:33.913475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1e75c70-7509-468e-aefd-3d9283fd8ada tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:34.560025 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b1e75c70-7509-468e-aefd-3d9283fd8ada tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1630 microversion: 2.1 time: 0.696478 Sep 07 12:30:34.563181 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 328/663] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:33 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1630 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:34.590222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f4503b19-a007-4c6d-b81a-8024d22823f9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:34.591944 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f4503b19-a007-4c6d-b81a-8024d22823f9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:34.633776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4503b19-a007-4c6d-b81a-8024d22823f9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:34.634292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4503b19-a007-4c6d-b81a-8024d22823f9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:34.634737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4503b19-a007-4c6d-b81a-8024d22823f9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:34.635469 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4503b19-a007-4c6d-b81a-8024d22823f9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:34.636629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4503b19-a007-4c6d-b81a-8024d22823f9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:34.637070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4503b19-a007-4c6d-b81a-8024d22823f9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:35.574684 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e7fbdb79-2fcb-4d3f-b3bf-acccf7b3785f tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59" status: 200 len: 1631 microversion: 2.1 time: 1.960018 Sep 07 12:30:35.576239 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 336/664] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:33 2022] GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59 => generated 1631 bytes in 1962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:35.583241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0a165488-0578-4ad3-9c1e-83b543334379 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:35.586299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0a165488-0578-4ad3-9c1e-83b543334379 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: e640bc92-0f42-4b0c-b725-9f8d9955e599] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:35.601334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a165488-0578-4ad3-9c1e-83b543334379 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:35.601890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a165488-0578-4ad3-9c1e-83b543334379 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:35.602618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a165488-0578-4ad3-9c1e-83b543334379 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:35.603443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a165488-0578-4ad3-9c1e-83b543334379 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:35.604141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a165488-0578-4ad3-9c1e-83b543334379 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:35.604579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a165488-0578-4ad3-9c1e-83b543334379 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:35.671197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f4503b19-a007-4c6d-b81a-8024d22823f9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:35.694679 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f4503b19-a007-4c6d-b81a-8024d22823f9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1472 microversion: 2.1 time: 1.129655 Sep 07 12:30:35.695413 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 329/665] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:34 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1472 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:35.718652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d5f471f8-bcd5-4f4c-b531-39573678743e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Action: 'create', calling method: .version_select at 0x7fc419549e50>, body: {"keypair": {"name": "tempest-keypair-1146664546", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdEr9Yd0WtE1+mztqqygpYB7mAJ09gGwBaSPlOxkHdhmvTxukdyfPx+xYlJJ1ZQ1D0db64RE7xo3yJpgOlkDvGNGk7Z1u9DAzCOsKylqGSbjc/2vS8gvQwMoZzn+8ExqQ=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:35.769139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-d5f471f8-bcd5-4f4c-b531-39573678743e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Getting quotas for project b32e8c6ba4e2486aa9769db48d2250d9. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:30:35.799807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-d5f471f8-bcd5-4f4c-b531-39573678743e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Getting quotas for user f009cb4fb12841a0ada96dc8c47cf2bd and project b32e8c6ba4e2486aa9769db48d2250d9. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:30:35.862628 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d5f471f8-bcd5-4f4c-b531-39573678743e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.160300 Sep 07 12:30:35.865293 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 330/666] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 12:30:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:30:35.925688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7c068e4d-6f6d-4da8-9b59-f204196f628c tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:35.927706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7c068e4d-6f6d-4da8-9b59-f204196f628c tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:35.955979 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c068e4d-6f6d-4da8-9b59-f204196f628c tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:35.957743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c068e4d-6f6d-4da8-9b59-f204196f628c tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:35.959661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c068e4d-6f6d-4da8-9b59-f204196f628c tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:35.962963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c068e4d-6f6d-4da8-9b59-f204196f628c tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:35.964485 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c068e4d-6f6d-4da8-9b59-f204196f628c tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:35.965859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c068e4d-6f6d-4da8-9b59-f204196f628c tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:36.401723 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7c068e4d-6f6d-4da8-9b59-f204196f628c tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:36.422896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7c068e4d-6f6d-4da8-9b59-f204196f628c tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:36.426608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7c068e4d-6f6d-4da8-9b59-f204196f628c tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:36.452965 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7c068e4d-6f6d-4da8-9b59-f204196f628c tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1447 microversion: 2.75 time: 0.583251 Sep 07 12:30:36.464269 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 331/667] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:35 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1447 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:30:36.520993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0a165488-0578-4ad3-9c1e-83b543334379 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:36.548736 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0a165488-0578-4ad3-9c1e-83b543334379 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599" status: 200 len: 1319 microversion: 2.1 time: 0.970703 Sep 07 12:30:36.555908 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 337/668] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:35 2022] GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599 => generated 1319 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:36.605749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-60fa5010-9a0f-4bcc-9252-57730435ab2d tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:36.609746 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-60fa5010-9a0f-4bcc-9252-57730435ab2d tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] [instance: 2f60a676-5df0-44d4-b97f-4248a08a9f59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:36.641799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60fa5010-9a0f-4bcc-9252-57730435ab2d tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:36.642299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60fa5010-9a0f-4bcc-9252-57730435ab2d tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:36.646760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60fa5010-9a0f-4bcc-9252-57730435ab2d tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:36.650003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60fa5010-9a0f-4bcc-9252-57730435ab2d tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:36.650721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60fa5010-9a0f-4bcc-9252-57730435ab2d tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:36.651780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60fa5010-9a0f-4bcc-9252-57730435ab2d tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:36.726359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-44bd00d0-0140-4b23-878d-0b1dea38b1c8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:36.732447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-44bd00d0-0140-4b23-878d-0b1dea38b1c8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:36.759872 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44bd00d0-0140-4b23-878d-0b1dea38b1c8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:36.764964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44bd00d0-0140-4b23-878d-0b1dea38b1c8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:36.771233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44bd00d0-0140-4b23-878d-0b1dea38b1c8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:36.781159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44bd00d0-0140-4b23-878d-0b1dea38b1c8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:36.782565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44bd00d0-0140-4b23-878d-0b1dea38b1c8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:36.785103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44bd00d0-0140-4b23-878d-0b1dea38b1c8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:37.095750 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-60fa5010-9a0f-4bcc-9252-57730435ab2d tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59" status: 200 len: 1614 microversion: 2.1 time: 0.498659 Sep 07 12:30:37.109771 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 332/669] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:36 2022] GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59 => generated 1614 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:37.121841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9553cc01-1e0c-4ca8-aac4-0fd2037f0bc1 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:37.122431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9553cc01-1e0c-4ca8-aac4-0fd2037f0bc1 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] [instance: 2f60a676-5df0-44d4-b97f-4248a08a9f59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:37.140200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9553cc01-1e0c-4ca8-aac4-0fd2037f0bc1 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:37.140714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9553cc01-1e0c-4ca8-aac4-0fd2037f0bc1 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:37.141167 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9553cc01-1e0c-4ca8-aac4-0fd2037f0bc1 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:37.143956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9553cc01-1e0c-4ca8-aac4-0fd2037f0bc1 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:37.144495 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9553cc01-1e0c-4ca8-aac4-0fd2037f0bc1 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:37.144867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9553cc01-1e0c-4ca8-aac4-0fd2037f0bc1 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:37.205421 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-9553cc01-1e0c-4ca8-aac4-0fd2037f0bc1 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] HTTP exception thrown: Cannot 'migrate' instance 2f60a676-5df0-44d4-b97f-4248a08a9f59 while it is in vm_state suspended Sep 07 12:30:37.208289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9553cc01-1e0c-4ca8-aac4-0fd2037f0bc1 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Request method failure captured: Sep 07 12:30:37.208289 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59/action HTTP/1.1 Sep 07 12:30:37.208289 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:30:37.208289 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:30:37.208289 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:30:37.208289 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 15 Sep 07 12:30:37.208289 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:30:37.208289 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:30:37.208289 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:30:37.208289 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:30:37.208289 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI6yfJ4p29mo6MTgYh57jAAahNOmSJWXe-C48KldK40f8pEtyKVeGDXTgQ3GsIaFAuJcIwpdxvJtUV6maL0YjfyVoCWP2VzejeLxaHPJZujdB2pcKIH6ZGOvGL_iRIKVANOnsXnn_zPful94Ay-k59zk0CfwaEY5rpvPgMdMuk7OKCc Sep 07 12:30:37.208289 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:30:37.208289 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:30:37.208289 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:30:37.208289 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:30:37.208289 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:30:37.208289 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:30:37.208289 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 85061b82e9564713afecd7fd257d5052 Sep 07 12:30:37.208289 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1908632660 Sep 07 12:30:37.208289 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member,admin Sep 07 12:30:37.208289 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member,admin Sep 07 12:30:37.210028 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/85061b82e9564713afecd7fd257d5052"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_85061b82e9564713afecd7fd257d5052"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/85061b82e9564713afecd7fd257d5052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/85061b82e9564713afecd7fd257d5052"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:30:37.210028 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1908632660 Sep 07 12:30:37.210028 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 85061b82e9564713afecd7fd257d5052 Sep 07 12:30:37.210028 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1908632660 Sep 07 12:30:37.210028 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersAdminNegativeTestJSON-1908632660-project-admin Sep 07 12:30:37.210028 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:30:37.210028 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:30:37.210028 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: ed1b99b8e79e463c991ee466e918feca Sep 07 12:30:37.210028 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1908632660-project-admin Sep 07 12:30:37.210028 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:30:37.210028 n-d-852087-9 devstack@n-api.service[122432]: {"migrate": {}} Sep 07 12:30:37.210028 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:30:37.210028 n-d-852087-9 devstack@n-api.service[122432]: exception: Cannot 'migrate' instance 2f60a676-5df0-44d4-b97f-4248a08a9f59 while it is in vm_state suspended Sep 07 12:30:37.210959 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '2f60a676-5df0-44d4-b97f-4248a08a9f59', 'body': {'migrate': {}}} Sep 07 12:30:37.210959 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:30:37.210959 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:37.210959 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Sep 07 12:30:37.210959 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Sep 07 12:30:37.210959 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 07 12:30:37.210959 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 12:30:37.210959 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 07 12:30:37.210959 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 12:30:37.210959 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 07 12:30:37.210959 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 12:30:37.210959 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 12:30:37.210959 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 12:30:37.210959 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 12:30:37.210959 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 12:30:37.210959 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2f60a676-5df0-44d4-b97f-4248a08a9f59 in vm_state suspended. Cannot resize while the instance is in this state. Sep 07 12:30:37.210959 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:37.210959 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:37.210959 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:37.210959 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:37.212474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:37.212474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:37.212474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:30:37.212474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:30:37.212474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:30:37.212474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:37.212474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:30:37.212474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:30:37.212474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Sep 07 12:30:37.212474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 12:30:37.212474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 12:30:37.212474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 12:30:37.212474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 2f60a676-5df0-44d4-b97f-4248a08a9f59 while it is in vm_state suspended Sep 07 12:30:37.212474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:37.212474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:37.212474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:37.212474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:37.212474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:37.212474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:37.213628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:30:37.213628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:30:37.213628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 2f60a676-5df0-44d4-b97f-4248a08a9f59 while it is in vm_state suspended Sep 07 12:30:37.213628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:37.215851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9553cc01-1e0c-4ca8-aac4-0fd2037f0bc1 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Returning 409 to user: Cannot 'migrate' instance 2f60a676-5df0-44d4-b97f-4248a08a9f59 while it is in vm_state suspended {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:30:37.217059 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9553cc01-1e0c-4ca8-aac4-0fd2037f0bc1 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59/action" status: 409 len: 148 microversion: 2.1 time: 0.100202 Sep 07 12:30:37.219196 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 333/670] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:30:37 2022] POST /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59/action => generated 148 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:30:37.236304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e30432f1-ea55-4de5-834d-55b6ecbe87c2 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:37.251877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e30432f1-ea55-4de5-834d-55b6ecbe87c2 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Request method failure captured: Sep 07 12:30:37.251877 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62/action HTTP/1.1 Sep 07 12:30:37.251877 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:30:37.251877 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:30:37.251877 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:30:37.251877 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 39 Sep 07 12:30:37.251877 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:30:37.251877 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:30:37.251877 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:30:37.251877 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:30:37.251877 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI6yfJ4p29mo6MTgYh57jAAahNOmSJWXe-C48KldK40f8pEtyKVeGDXTgQ3GsIaFAuJcIwpdxvJtUV6maL0YjfyVoCWP2VzejeLxaHPJZujdB2pcKIH6ZGOvGL_iRIKVANOnsXnn_zPful94Ay-k59zk0CfwaEY5rpvPgMdMuk7OKCc Sep 07 12:30:37.251877 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:30:37.251877 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:30:37.251877 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:30:37.251877 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:30:37.251877 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:30:37.251877 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:30:37.251877 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 85061b82e9564713afecd7fd257d5052 Sep 07 12:30:37.251877 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1908632660 Sep 07 12:30:37.251877 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member,admin Sep 07 12:30:37.251877 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member,admin Sep 07 12:30:37.253140 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/85061b82e9564713afecd7fd257d5052"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_85061b82e9564713afecd7fd257d5052"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/85061b82e9564713afecd7fd257d5052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/85061b82e9564713afecd7fd257d5052"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:30:37.253140 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1908632660 Sep 07 12:30:37.253140 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 85061b82e9564713afecd7fd257d5052 Sep 07 12:30:37.253140 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1908632660 Sep 07 12:30:37.253140 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersAdminNegativeTestJSON-1908632660-project-admin Sep 07 12:30:37.253140 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:30:37.253140 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:30:37.253140 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: ed1b99b8e79e463c991ee466e918feca Sep 07 12:30:37.253140 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1908632660-project-admin Sep 07 12:30:37.253140 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:30:37.253140 n-d-852087-9 devstack@n-api.service[122432]: {"os-resetState": {"state": "invalid"}} Sep 07 12:30:37.253140 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:30:37.254002 n-d-852087-9 devstack@n-api.service[122432]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 07 12:30:37.254002 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '8ecbad38-98de-4c5d-b656-07e102181e62', 'body': {'os-resetState': {'state': 'invalid'}}} Sep 07 12:30:37.254002 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:30:37.254002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:37.254002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:30:37.254002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:30:37.254002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:30:37.254002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:30:37.254002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Sep 07 12:30:37.254002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:37.254002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Sep 07 12:30:37.254002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 07 12:30:37.254002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:37.254002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 07 12:30:37.254002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'invalid' Sep 07 12:30:37.254002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:37.254002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:37.254002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:37.254002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:37.254002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:37.254002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:37.254002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:30:37.255284 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:30:37.255284 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:30:37.255284 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:37.255284 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:30:37.255284 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:30:37.255284 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:30:37.255284 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:30:37.255284 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:30:37.255284 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:30:37.255284 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 07 12:30:37.255284 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:37.255284 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:37.255284 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:37.255284 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:37.255284 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:37.255284 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:37.255284 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:30:37.255284 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:30:37.255284 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 07 12:30:37.256379 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:37.256379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e30432f1-ea55-4de5-834d-55b6ecbe87c2 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:30:37.256379 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e30432f1-ea55-4de5-834d-55b6ecbe87c2 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62/action" status: 400 len: 144 microversion: 2.1 time: 0.020992 Sep 07 12:30:37.260634 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 334/671] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:30:37 2022] POST /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62/action => generated 144 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:30:37.278528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aae1c129-7021-403d-ace9-ec19589f6d29 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:37.283226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aae1c129-7021-403d-ace9-ec19589f6d29 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Request method failure captured: Sep 07 12:30:37.283226 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62/action HTTP/1.1 Sep 07 12:30:37.283226 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:30:37.283226 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:30:37.283226 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:30:37.283226 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 31 Sep 07 12:30:37.283226 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:30:37.283226 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:30:37.283226 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:30:37.283226 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:30:37.283226 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI6yfJ4p29mo6MTgYh57jAAahNOmSJWXe-C48KldK40f8pEtyKVeGDXTgQ3GsIaFAuJcIwpdxvJtUV6maL0YjfyVoCWP2VzejeLxaHPJZujdB2pcKIH6ZGOvGL_iRIKVANOnsXnn_zPful94Ay-k59zk0CfwaEY5rpvPgMdMuk7OKCc Sep 07 12:30:37.283226 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:30:37.283226 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:30:37.283226 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:30:37.283226 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:30:37.283226 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:30:37.283226 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:30:37.283226 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 85061b82e9564713afecd7fd257d5052 Sep 07 12:30:37.283226 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1908632660 Sep 07 12:30:37.283226 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member,admin Sep 07 12:30:37.283226 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member,admin Sep 07 12:30:37.284626 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/85061b82e9564713afecd7fd257d5052"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_85061b82e9564713afecd7fd257d5052"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/85061b82e9564713afecd7fd257d5052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/85061b82e9564713afecd7fd257d5052"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:30:37.284626 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1908632660 Sep 07 12:30:37.284626 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 85061b82e9564713afecd7fd257d5052 Sep 07 12:30:37.284626 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1908632660 Sep 07 12:30:37.284626 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersAdminNegativeTestJSON-1908632660-project-admin Sep 07 12:30:37.284626 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:30:37.284626 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:30:37.284626 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: ed1b99b8e79e463c991ee466e918feca Sep 07 12:30:37.284626 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1908632660-project-admin Sep 07 12:30:37.284626 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:30:37.284626 n-d-852087-9 devstack@n-api.service[122432]: {"os-resetState": {"state": 1}} Sep 07 12:30:37.284626 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:30:37.284626 n-d-852087-9 devstack@n-api.service[122432]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 07 12:30:37.285377 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '8ecbad38-98de-4c5d-b656-07e102181e62', 'body': {'os-resetState': {'state': 1}}} Sep 07 12:30:37.285377 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:30:37.285377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:37.285377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:30:37.285377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:30:37.285377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:30:37.285377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:30:37.285377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Sep 07 12:30:37.285377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:37.285377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Sep 07 12:30:37.285377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 07 12:30:37.285377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:37.285377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 07 12:30:37.285377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 1 Sep 07 12:30:37.285377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:37.285377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:37.285377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:37.285377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:37.285377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:37.285377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:37.285377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:30:37.285377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:30:37.286649 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:30:37.286649 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:37.286649 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:30:37.286649 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:30:37.286649 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:30:37.286649 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:30:37.286649 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:30:37.286649 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:30:37.286649 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 07 12:30:37.286649 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:37.286649 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:37.286649 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:37.286649 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:37.286649 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:37.286649 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:37.286649 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:30:37.286649 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:30:37.286649 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 07 12:30:37.286649 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:37.289435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aae1c129-7021-403d-ace9-ec19589f6d29 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:30:37.290568 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aae1c129-7021-403d-ace9-ec19589f6d29 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62/action" status: 400 len: 120 microversion: 2.1 time: 0.021898 Sep 07 12:30:37.291538 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 335/672] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:30:37 2022] POST /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62/action => generated 120 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:30:37.303932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad2853c6-8a7e-4a4e-a751-81cab1ec6829 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:37.306738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ad2853c6-8a7e-4a4e-a751-81cab1ec6829 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Failed to fetch instance by id 999 {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 07 12:30:37.307706 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-ad2853c6-8a7e-4a4e-a751-81cab1ec6829 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] HTTP exception thrown: Instance 999 could not be found. Sep 07 12:30:37.310270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad2853c6-8a7e-4a4e-a751-81cab1ec6829 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Request method failure captured: Sep 07 12:30:37.310270 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Sep 07 12:30:37.310270 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:30:37.310270 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:30:37.310270 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:30:37.310270 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 37 Sep 07 12:30:37.310270 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:30:37.310270 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:30:37.310270 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:30:37.310270 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:30:37.310270 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI6yfJ4p29mo6MTgYh57jAAahNOmSJWXe-C48KldK40f8pEtyKVeGDXTgQ3GsIaFAuJcIwpdxvJtUV6maL0YjfyVoCWP2VzejeLxaHPJZujdB2pcKIH6ZGOvGL_iRIKVANOnsXnn_zPful94Ay-k59zk0CfwaEY5rpvPgMdMuk7OKCc Sep 07 12:30:37.310270 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:30:37.310270 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:30:37.310270 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:30:37.310270 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:30:37.310270 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:30:37.310270 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:30:37.310270 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 85061b82e9564713afecd7fd257d5052 Sep 07 12:30:37.310270 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1908632660 Sep 07 12:30:37.310270 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member,admin Sep 07 12:30:37.310270 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member,admin Sep 07 12:30:37.311489 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/85061b82e9564713afecd7fd257d5052"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_85061b82e9564713afecd7fd257d5052"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/85061b82e9564713afecd7fd257d5052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/85061b82e9564713afecd7fd257d5052"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:30:37.311489 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1908632660 Sep 07 12:30:37.311489 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 85061b82e9564713afecd7fd257d5052 Sep 07 12:30:37.311489 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1908632660 Sep 07 12:30:37.311489 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersAdminNegativeTestJSON-1908632660-project-admin Sep 07 12:30:37.311489 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:30:37.311489 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:30:37.311489 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: ed1b99b8e79e463c991ee466e918feca Sep 07 12:30:37.311489 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1908632660-project-admin Sep 07 12:30:37.311489 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:30:37.311489 n-d-852087-9 devstack@n-api.service[122432]: {"os-resetState": {"state": "error"}} Sep 07 12:30:37.311489 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:30:37.311489 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 999 could not be found. Sep 07 12:30:37.312232 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Sep 07 12:30:37.312232 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:30:37.312232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:37.312232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:30:37.312232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:30:37.312232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 07 12:30:37.312232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 07 12:30:37.312232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 07 12:30:37.312232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:37.312232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:37.312232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:37.312232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:37.312232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:37.312232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:37.312232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:30:37.312232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:30:37.312232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:30:37.312232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:37.312232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:30:37.312232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:30:37.312232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Sep 07 12:30:37.313444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 07 12:30:37.313444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:30:37.313444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:30:37.313444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 07 12:30:37.313444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:37.313444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:37.313444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:37.313444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:37.313444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:37.313444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:37.313444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:30:37.313444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:30:37.313444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 07 12:30:37.313444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:37.313444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad2853c6-8a7e-4a4e-a751-81cab1ec6829 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:30:37.313444 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ad2853c6-8a7e-4a4e-a751-81cab1ec6829 tempest-ServersAdminNegativeTestJSON-1908632660 tempest-ServersAdminNegativeTestJSON-1908632660-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.012493 Sep 07 12:30:37.317888 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 336/673] 10.222.0.16 () {60 vars in 1179 bytes} [Wed Sep 7 12:30:37 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 07 12:30:37.323501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0a9702c4-4ae5-41ed-892f-5cccdd50d1f9 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:37.324905 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0a9702c4-4ae5-41ed-892f-5cccdd50d1f9 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 2f60a676-5df0-44d4-b97f-4248a08a9f59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:37.333437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a9702c4-4ae5-41ed-892f-5cccdd50d1f9 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:37.334471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a9702c4-4ae5-41ed-892f-5cccdd50d1f9 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:37.335159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a9702c4-4ae5-41ed-892f-5cccdd50d1f9 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:37.336168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a9702c4-4ae5-41ed-892f-5cccdd50d1f9 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:37.336857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a9702c4-4ae5-41ed-892f-5cccdd50d1f9 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:37.337527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a9702c4-4ae5-41ed-892f-5cccdd50d1f9 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:37.389512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0a9702c4-4ae5-41ed-892f-5cccdd50d1f9 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 2f60a676-5df0-44d4-b97f-4248a08a9f59] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:30:37.502738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-44bd00d0-0140-4b23-878d-0b1dea38b1c8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:37.515267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:30:37.538576 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-44bd00d0-0140-4b23-878d-0b1dea38b1c8 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1472 microversion: 2.1 time: 0.820230 Sep 07 12:30:37.542499 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 338/674] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:36 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1472 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:30:37.549655 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0a9702c4-4ae5-41ed-892f-5cccdd50d1f9 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59" status: 204 len: 0 microversion: 2.1 time: 0.230124 Sep 07 12:30:37.550402 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 337/675] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:30:37 2022] DELETE /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:30:37.555451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a9162a6-70c0-4bed-8cd5-91b1c5618236 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:37.556502 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4a9162a6-70c0-4bed-8cd5-91b1c5618236 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:37.560527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d9de6aa5-e089-4a11-8988-39f8521947e2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:37.563824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a9162a6-70c0-4bed-8cd5-91b1c5618236 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:37.565001 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a9162a6-70c0-4bed-8cd5-91b1c5618236 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:37.565707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a9162a6-70c0-4bed-8cd5-91b1c5618236 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:37.566835 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a9162a6-70c0-4bed-8cd5-91b1c5618236 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:37.567540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a9162a6-70c0-4bed-8cd5-91b1c5618236 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:37.568185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a9162a6-70c0-4bed-8cd5-91b1c5618236 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:37.572287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d9de6aa5-e089-4a11-8988-39f8521947e2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 2f60a676-5df0-44d4-b97f-4248a08a9f59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:37.590077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9de6aa5-e089-4a11-8988-39f8521947e2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:37.590622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9de6aa5-e089-4a11-8988-39f8521947e2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:37.591095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9de6aa5-e089-4a11-8988-39f8521947e2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:37.591903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9de6aa5-e089-4a11-8988-39f8521947e2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:37.592362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9de6aa5-e089-4a11-8988-39f8521947e2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:37.595965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9de6aa5-e089-4a11-8988-39f8521947e2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:37.935965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4a9162a6-70c0-4bed-8cd5-91b1c5618236 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:37.958153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4a9162a6-70c0-4bed-8cd5-91b1c5618236 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:37.962435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4a9162a6-70c0-4bed-8cd5-91b1c5618236 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:37.978505 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4a9162a6-70c0-4bed-8cd5-91b1c5618236 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1453 microversion: 2.75 time: 0.433220 Sep 07 12:30:37.980512 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 339/676] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:37 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1453 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:30:37.990397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-243a8e5a-823d-43a0-99a5-3572ffe4a67f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:37.991921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-243a8e5a-823d-43a0-99a5-3572ffe4a67f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: e640bc92-0f42-4b0c-b725-9f8d9955e599] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:38.004726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-243a8e5a-823d-43a0-99a5-3572ffe4a67f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:38.006127 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-243a8e5a-823d-43a0-99a5-3572ffe4a67f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:38.007722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-243a8e5a-823d-43a0-99a5-3572ffe4a67f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:38.010624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-243a8e5a-823d-43a0-99a5-3572ffe4a67f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:38.012194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-243a8e5a-823d-43a0-99a5-3572ffe4a67f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:38.014321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-243a8e5a-823d-43a0-99a5-3572ffe4a67f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:38.545754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d9de6aa5-e089-4a11-8988-39f8521947e2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:38.592673 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d9de6aa5-e089-4a11-8988-39f8521947e2 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59" status: 200 len: 1469 microversion: 2.1 time: 1.035765 Sep 07 12:30:38.594376 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 338/677] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:37 2022] GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59 => generated 1469 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:38.634220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-44d5944b-f9cd-4823-a1e1-dd8edc2643d7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:38.635184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-44d5944b-f9cd-4823-a1e1-dd8edc2643d7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:38.646708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44d5944b-f9cd-4823-a1e1-dd8edc2643d7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:38.649903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44d5944b-f9cd-4823-a1e1-dd8edc2643d7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:38.650379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44d5944b-f9cd-4823-a1e1-dd8edc2643d7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:38.651284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44d5944b-f9cd-4823-a1e1-dd8edc2643d7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:38.652147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44d5944b-f9cd-4823-a1e1-dd8edc2643d7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:38.652940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44d5944b-f9cd-4823-a1e1-dd8edc2643d7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:38.793450 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-243a8e5a-823d-43a0-99a5-3572ffe4a67f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:38.815423 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-243a8e5a-823d-43a0-99a5-3572ffe4a67f tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599" status: 200 len: 1469 microversion: 2.1 time: 0.832374 Sep 07 12:30:38.816522 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 340/678] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:37 2022] GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599 => generated 1469 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:38.844433 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e43ff0f4-aaca-4a76-ac5a-09ad63e9edbc tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:38.845408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e43ff0f4-aaca-4a76-ac5a-09ad63e9edbc tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] [instance: e640bc92-0f42-4b0c-b725-9f8d9955e599] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:38.858157 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e43ff0f4-aaca-4a76-ac5a-09ad63e9edbc tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:38.859053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e43ff0f4-aaca-4a76-ac5a-09ad63e9edbc tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:38.859723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e43ff0f4-aaca-4a76-ac5a-09ad63e9edbc tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:38.860727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e43ff0f4-aaca-4a76-ac5a-09ad63e9edbc tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:38.861820 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e43ff0f4-aaca-4a76-ac5a-09ad63e9edbc tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:38.862533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e43ff0f4-aaca-4a76-ac5a-09ad63e9edbc tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:38.896401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-e43ff0f4-aaca-4a76-ac5a-09ad63e9edbc tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Lazy-loading 'flavor' on Instance uuid e640bc92-0f42-4b0c-b725-9f8d9955e599 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:30:39.199314 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e43ff0f4-aaca-4a76-ac5a-09ad63e9edbc tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599/action" status: 202 len: 0 microversion: 2.1 time: 0.358612 Sep 07 12:30:39.203515 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 341/679] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:30:38 2022] POST /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 12:30:39.219304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8cd58848-4a59-42f8-85fa-ad7d8d6dce03 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:39.225866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8cd58848-4a59-42f8-85fa-ad7d8d6dce03 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:39.241455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8cd58848-4a59-42f8-85fa-ad7d8d6dce03 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:39.242889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8cd58848-4a59-42f8-85fa-ad7d8d6dce03 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:39.243986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8cd58848-4a59-42f8-85fa-ad7d8d6dce03 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:39.247301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8cd58848-4a59-42f8-85fa-ad7d8d6dce03 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:39.248746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8cd58848-4a59-42f8-85fa-ad7d8d6dce03 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:39.251803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8cd58848-4a59-42f8-85fa-ad7d8d6dce03 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:39.387654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8cd58848-4a59-42f8-85fa-ad7d8d6dce03 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:39.413035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8cd58848-4a59-42f8-85fa-ad7d8d6dce03 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:39.416409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8cd58848-4a59-42f8-85fa-ad7d8d6dce03 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:39.422909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:30:39.424569 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8cd58848-4a59-42f8-85fa-ad7d8d6dce03 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1453 microversion: 2.75 time: 0.218425 Sep 07 12:30:39.427121 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 342/680] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:39 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1453 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:30:39.433096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-19e8fe26-72c1-4881-8d41-c65093a8be0e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-238377195", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "90fd0444-8940-4097-8547-6568e7ca00e8"}], "security_groups": [{"name": "tempest-securitygroup--907569679"}], "key_name": "tempest-keypair-1146664546", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:39.940768 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-44d5944b-f9cd-4823-a1e1-dd8edc2643d7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:39.953928 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-44d5944b-f9cd-4823-a1e1-dd8edc2643d7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1472 microversion: 2.1 time: 1.357482 Sep 07 12:30:39.957176 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 339/681] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:38 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1472 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:39.970131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-08e96f67-9386-460e-a8d5-36732576dd75 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:39.977171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-08e96f67-9386-460e-a8d5-36732576dd75 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: e640bc92-0f42-4b0c-b725-9f8d9955e599] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:39.988912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08e96f67-9386-460e-a8d5-36732576dd75 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:39.996308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08e96f67-9386-460e-a8d5-36732576dd75 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:39.997362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08e96f67-9386-460e-a8d5-36732576dd75 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:39.998498 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08e96f67-9386-460e-a8d5-36732576dd75 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:39.999152 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08e96f67-9386-460e-a8d5-36732576dd75 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:39.999874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08e96f67-9386-460e-a8d5-36732576dd75 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:40.071873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-19e8fe26-72c1-4881-8d41-c65093a8be0e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] validate_networks() for [('90fd0444-8940-4097-8547-6568e7ca00e8', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:30:40.617049 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-08e96f67-9386-460e-a8d5-36732576dd75 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:40.625642 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-08e96f67-9386-460e-a8d5-36732576dd75 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599" status: 200 len: 1460 microversion: 2.1 time: 0.661894 Sep 07 12:30:40.629241 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 340/682] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:39 2022] GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599 => generated 1460 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:41.052363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0765aeb7-ce36-4c74-98a4-35442869ac5a tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Action: 'create', calling method: .version_select at 0x7fc419428040>, body: {"keypair": {"name": "tempest-keypair-903806393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgyjTj/UJ2E1YpGsly1Vi8h7c3Nqo/qH6oFhLG0EU0OtbG7SSfzNJRsqeNWLGXXZyLmfg1Hokv4cc1rrRD2EjvCLDPzc2AlNEnuFH+srLGsKyhFVpKFSrfsZ1bfAtHfBg=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:41.085304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-0765aeb7-ce36-4c74-98a4-35442869ac5a tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Getting quotas for project 6c950a615d6a4b67a93a60f7969b6e6e. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:30:41.093395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-0765aeb7-ce36-4c74-98a4-35442869ac5a tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Getting quotas for user 239d71c912c749e7afe0f791db5c18f9 and project 6c950a615d6a4b67a93a60f7969b6e6e. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:30:41.140305 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0765aeb7-ce36-4c74-98a4-35442869ac5a tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.498120 Sep 07 12:30:41.141613 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 341/683] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 12:30:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:30:41.148291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1371a8ee-b3c7-49b6-b9fd-38ff88197151 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:41.150486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1371a8ee-b3c7-49b6-b9fd-38ff88197151 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 2f60a676-5df0-44d4-b97f-4248a08a9f59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:41.160890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1371a8ee-b3c7-49b6-b9fd-38ff88197151 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:41.161769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1371a8ee-b3c7-49b6-b9fd-38ff88197151 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:41.162447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1371a8ee-b3c7-49b6-b9fd-38ff88197151 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:41.164103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1371a8ee-b3c7-49b6-b9fd-38ff88197151 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:41.164921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1371a8ee-b3c7-49b6-b9fd-38ff88197151 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:41.165551 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1371a8ee-b3c7-49b6-b9fd-38ff88197151 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:41.171893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:30:41.735479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1371a8ee-b3c7-49b6-b9fd-38ff88197151 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:41.754910 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1371a8ee-b3c7-49b6-b9fd-38ff88197151 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59" status: 200 len: 1427 microversion: 2.1 time: 0.608712 Sep 07 12:30:41.759625 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 342/684] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:41 2022] GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59 => generated 1427 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:41.791230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b5e61888-6aa8-481b-8b1e-a97f77832075 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:41.799065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b5e61888-6aa8-481b-8b1e-a97f77832075 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:41.845325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5e61888-6aa8-481b-8b1e-a97f77832075 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:41.849253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5e61888-6aa8-481b-8b1e-a97f77832075 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:41.850293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5e61888-6aa8-481b-8b1e-a97f77832075 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:41.853292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5e61888-6aa8-481b-8b1e-a97f77832075 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:41.855221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5e61888-6aa8-481b-8b1e-a97f77832075 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:41.858236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5e61888-6aa8-481b-8b1e-a97f77832075 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:42.063237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-19e8fe26-72c1-4881-8d41-c65093a8be0e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:30:42.065153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-19e8fe26-72c1-4881-8d41-c65093a8be0e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:30:42.066429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-19e8fe26-72c1-4881-8d41-c65093a8be0e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:30:42.067352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-19e8fe26-72c1-4881-8d41-c65093a8be0e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:30:42.067982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-19e8fe26-72c1-4881-8d41-c65093a8be0e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:30:42.095453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19e8fe26-72c1-4881-8d41-c65093a8be0e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:42.096240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19e8fe26-72c1-4881-8d41-c65093a8be0e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:42.098526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19e8fe26-72c1-4881-8d41-c65093a8be0e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:42.100752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19e8fe26-72c1-4881-8d41-c65093a8be0e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:42.114487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19e8fe26-72c1-4881-8d41-c65093a8be0e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:42.117740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19e8fe26-72c1-4881-8d41-c65093a8be0e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:42.187811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-19e8fe26-72c1-4881-8d41-c65093a8be0e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Getting quotas for project b32e8c6ba4e2486aa9769db48d2250d9. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:30:42.199376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-19e8fe26-72c1-4881-8d41-c65093a8be0e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Getting quotas for user f009cb4fb12841a0ada96dc8c47cf2bd and project b32e8c6ba4e2486aa9769db48d2250d9. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:30:42.243268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-19e8fe26-72c1-4881-8d41-c65093a8be0e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:30:42.255455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-19e8fe26-72c1-4881-8d41-c65093a8be0e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:30:42.474851 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-19e8fe26-72c1-4881-8d41-c65093a8be0e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.043157 Sep 07 12:30:42.480327 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 343/685] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:30:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 3052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:30:42.496374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-781690d4-7903-4a54-a33d-be3661adbdc8 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:42.499511 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-781690d4-7903-4a54-a33d-be3661adbdc8 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] [instance: e640bc92-0f42-4b0c-b725-9f8d9955e599] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:42.510977 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-781690d4-7903-4a54-a33d-be3661adbdc8 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:42.511938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-781690d4-7903-4a54-a33d-be3661adbdc8 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:42.512627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-781690d4-7903-4a54-a33d-be3661adbdc8 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:42.513674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-781690d4-7903-4a54-a33d-be3661adbdc8 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:42.514380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-781690d4-7903-4a54-a33d-be3661adbdc8 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:42.515034 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-781690d4-7903-4a54-a33d-be3661adbdc8 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:43.087184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b5e61888-6aa8-481b-8b1e-a97f77832075 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:43.106629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b5e61888-6aa8-481b-8b1e-a97f77832075 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:43.130450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b5e61888-6aa8-481b-8b1e-a97f77832075 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:43.161741 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b5e61888-6aa8-481b-8b1e-a97f77832075 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1453 microversion: 2.75 time: 1.399282 Sep 07 12:30:43.175141 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 343/686] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:41 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1453 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:30:43.211971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-55201e81-3d6e-4f0d-9b66-64fb33a6eb28 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:43.221102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-55201e81-3d6e-4f0d-9b66-64fb33a6eb28 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:43.254585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55201e81-3d6e-4f0d-9b66-64fb33a6eb28 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:43.269738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55201e81-3d6e-4f0d-9b66-64fb33a6eb28 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:43.271987 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55201e81-3d6e-4f0d-9b66-64fb33a6eb28 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:43.280997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55201e81-3d6e-4f0d-9b66-64fb33a6eb28 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:43.282349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55201e81-3d6e-4f0d-9b66-64fb33a6eb28 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:43.283550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55201e81-3d6e-4f0d-9b66-64fb33a6eb28 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:44.401615 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-781690d4-7903-4a54-a33d-be3661adbdc8 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599" status: 200 len: 1611 microversion: 2.1 time: 1.917211 Sep 07 12:30:44.431983 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 344/687] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:42 2022] GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599 => generated 1611 bytes in 1950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:44.437972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-613358fc-049d-4449-834e-7caeedf5cc11 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:44.438833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-613358fc-049d-4449-834e-7caeedf5cc11 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:44.458098 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-613358fc-049d-4449-834e-7caeedf5cc11 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:44.469247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-613358fc-049d-4449-834e-7caeedf5cc11 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:44.473960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-613358fc-049d-4449-834e-7caeedf5cc11 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:44.476150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-613358fc-049d-4449-834e-7caeedf5cc11 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:44.479518 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-613358fc-049d-4449-834e-7caeedf5cc11 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:44.480611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-613358fc-049d-4449-834e-7caeedf5cc11 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:44.581546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-55201e81-3d6e-4f0d-9b66-64fb33a6eb28 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:44.595082 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-55201e81-3d6e-4f0d-9b66-64fb33a6eb28 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1472 microversion: 2.1 time: 1.416481 Sep 07 12:30:44.596169 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 344/688] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:43 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1472 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:44.606410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a5fbc7b5-849a-4372-8bd9-7a348eb3a5e8 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:44.607035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a5fbc7b5-849a-4372-8bd9-7a348eb3a5e8 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 2f60a676-5df0-44d4-b97f-4248a08a9f59] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:44.634955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5fbc7b5-849a-4372-8bd9-7a348eb3a5e8 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:44.635494 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5fbc7b5-849a-4372-8bd9-7a348eb3a5e8 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:44.636118 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5fbc7b5-849a-4372-8bd9-7a348eb3a5e8 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:44.637069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5fbc7b5-849a-4372-8bd9-7a348eb3a5e8 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:44.638570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5fbc7b5-849a-4372-8bd9-7a348eb3a5e8 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:44.639186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5fbc7b5-849a-4372-8bd9-7a348eb3a5e8 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:44.663577 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-a5fbc7b5-849a-4372-8bd9-7a348eb3a5e8 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] HTTP exception thrown: Instance 2f60a676-5df0-44d4-b97f-4248a08a9f59 could not be found. Sep 07 12:30:44.665769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a5fbc7b5-849a-4372-8bd9-7a348eb3a5e8 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Request method failure captured: Sep 07 12:30:44.665769 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59 HTTP/1.1 Sep 07 12:30:44.665769 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:30:44.665769 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:30:44.665769 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:30:44.665769 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:30:44.665769 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:30:44.665769 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:30:44.665769 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:30:44.665769 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:30:44.665769 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI6xdHsWgfr6cpipKa02Y78ORxjHy__l_vCYhmq8KHyVl1aZN4PFj0yakAuyi4oNY7cvhrsbRIEAhlTD0ftTI8wvSSEMmaqF2KATTmJ27XWFj92_XGpB8UQchuXKAKr_Iopv_1nKLjRuZFJaNMHdRuME5W3BObBBFeFwR0MriTXhqfw Sep 07 12:30:44.665769 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:30:44.665769 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:30:44.665769 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:30:44.665769 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:30:44.665769 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:30:44.665769 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:30:44.665769 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 53b6f3dbd50d41d69a47e6184f9abe52 Sep 07 12:30:44.665769 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1099232976 Sep 07 12:30:44.665769 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:30:44.665769 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:30:44.667400 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/53b6f3dbd50d41d69a47e6184f9abe52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_53b6f3dbd50d41d69a47e6184f9abe52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/53b6f3dbd50d41d69a47e6184f9abe52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/53b6f3dbd50d41d69a47e6184f9abe52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:30:44.667400 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1099232976 Sep 07 12:30:44.667400 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 53b6f3dbd50d41d69a47e6184f9abe52 Sep 07 12:30:44.667400 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1099232976 Sep 07 12:30:44.667400 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersAdminNegativeTestJSON-1099232976-project Sep 07 12:30:44.667400 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:30:44.667400 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:30:44.667400 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 433722ee7f084b8aa1decba3f1572934 Sep 07 12:30:44.667400 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1099232976-project Sep 07 12:30:44.667400 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:30:44.667400 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 2f60a676-5df0-44d4-b97f-4248a08a9f59 could not be found. Sep 07 12:30:44.667400 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '2f60a676-5df0-44d4-b97f-4248a08a9f59'} Sep 07 12:30:44.668541 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:30:44.668541 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:44.668541 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:30:44.668541 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:30:44.668541 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:30:44.668541 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:30:44.668541 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:30:44.668541 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:30:44.668541 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:30:44.668541 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:30:44.668541 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f60a676-5df0-44d4-b97f-4248a08a9f59 could not be found. Sep 07 12:30:44.668541 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:44.668541 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:44.668541 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:44.668541 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:44.668541 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:44.668541 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:44.668541 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:30:44.668541 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:30:44.668541 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:30:44.670105 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:44.670105 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:30:44.670105 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:30:44.670105 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:30:44.670105 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:30:44.670105 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:30:44.670105 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:30:44.670105 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f60a676-5df0-44d4-b97f-4248a08a9f59 could not be found. Sep 07 12:30:44.670105 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:44.670105 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:44.670105 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:44.670105 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:44.670105 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:44.670105 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:44.670105 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:30:44.670105 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:30:44.670105 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f60a676-5df0-44d4-b97f-4248a08a9f59 could not be found. Sep 07 12:30:44.670105 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:44.673249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a5fbc7b5-849a-4372-8bd9-7a348eb3a5e8 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Returning 404 to user: Instance 2f60a676-5df0-44d4-b97f-4248a08a9f59 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:30:44.675949 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a5fbc7b5-849a-4372-8bd9-7a348eb3a5e8 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59" status: 404 len: 111 microversion: 2.1 time: 0.078621 Sep 07 12:30:44.678584 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 345/689] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:44 2022] GET /compute/v2.1/servers/2f60a676-5df0-44d4-b97f-4248a08a9f59 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:30:44.686095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-ac7c84fb-6b9b-4dab-a0c4-53f8e8d489f7 req-800d85ca-0d4f-4466-9447-1d76d140d24d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f60a676-5df0-44d4-b97f-4248a08a9f59", "name": "network-vif-deleted", "tag": "0f1b146e-906f-46c2-b83b-28bbca816276"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:44.700026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ac7c84fb-6b9b-4dab-a0c4-53f8e8d489f7 req-800d85ca-0d4f-4466-9447-1d76d140d24d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:44.701275 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ac7c84fb-6b9b-4dab-a0c4-53f8e8d489f7 req-800d85ca-0d4f-4466-9447-1d76d140d24d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:44.702316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ac7c84fb-6b9b-4dab-a0c4-53f8e8d489f7 req-800d85ca-0d4f-4466-9447-1d76d140d24d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:44.720430 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-ac7c84fb-6b9b-4dab-a0c4-53f8e8d489f7 req-800d85ca-0d4f-4466-9447-1d76d140d24d service nova] Creating event network-vif-deleted:0f1b146e-906f-46c2-b83b-28bbca816276 for instance 2f60a676-5df0-44d4-b97f-4248a08a9f59 on n-h1-852087-9 Sep 07 12:30:44.732220 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-ac7c84fb-6b9b-4dab-a0c4-53f8e8d489f7 req-800d85ca-0d4f-4466-9447-1d76d140d24d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052089 Sep 07 12:30:44.733014 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 346/690] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:30:44.735140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-613358fc-049d-4449-834e-7caeedf5cc11 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:44.746033 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-613358fc-049d-4449-834e-7caeedf5cc11 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1230 microversion: 2.1 time: 0.312404 Sep 07 12:30:44.747499 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 345/691] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:44 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1230 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:44.750554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-53da3588-9b46-4527-ba50-3f2e55dbb8f7 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:44.751854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-53da3588-9b46-4527-ba50-3f2e55dbb8f7 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:44.753087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-01f7a572-c480-4d94-af32-ec8a16cdc4da tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-672671821", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "aaa729e9-8d48-4aa2-8aa2-9ecb06a1fa06"}], "security_groups": [{"name": "tempest-securitygroup--901092677"}], "key_name": "tempest-keypair-903806393", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:44.773356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53da3588-9b46-4527-ba50-3f2e55dbb8f7 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:44.777148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53da3588-9b46-4527-ba50-3f2e55dbb8f7 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:44.778306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53da3588-9b46-4527-ba50-3f2e55dbb8f7 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:44.778941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53da3588-9b46-4527-ba50-3f2e55dbb8f7 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:44.779853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53da3588-9b46-4527-ba50-3f2e55dbb8f7 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:44.780528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53da3588-9b46-4527-ba50-3f2e55dbb8f7 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:45.290044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-53da3588-9b46-4527-ba50-3f2e55dbb8f7 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:45.312258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-53da3588-9b46-4527-ba50-3f2e55dbb8f7 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:45.315549 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-53da3588-9b46-4527-ba50-3f2e55dbb8f7 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:45.322882 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-53da3588-9b46-4527-ba50-3f2e55dbb8f7 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1438 microversion: 2.75 time: 0.585768 Sep 07 12:30:45.323649 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 347/692] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:44 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1438 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:30:45.333071 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4d020601-5d40-40c8-9be7-d269cda81f99 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:45.343131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4d020601-5d40-40c8-9be7-d269cda81f99 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:45.345589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4d020601-5d40-40c8-9be7-d269cda81f99 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:45.347712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4d020601-5d40-40c8-9be7-d269cda81f99 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:45.351973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4d020601-5d40-40c8-9be7-d269cda81f99 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:45.353069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4d020601-5d40-40c8-9be7-d269cda81f99 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:45.354086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4d020601-5d40-40c8-9be7-d269cda81f99 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:45.399798 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4d020601-5d40-40c8-9be7-d269cda81f99 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.074077 Sep 07 12:30:45.401236 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 348/693] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Sep 7 12:30:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:30:45.408271 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6d9a1205-7ca7-4aff-8a05-0072ceb180d1 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:45.409171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6d9a1205-7ca7-4aff-8a05-0072ceb180d1 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 8ecbad38-98de-4c5d-b656-07e102181e62] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:45.425782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d9a1205-7ca7-4aff-8a05-0072ceb180d1 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:45.426724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d9a1205-7ca7-4aff-8a05-0072ceb180d1 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:45.427268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d9a1205-7ca7-4aff-8a05-0072ceb180d1 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:45.428228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d9a1205-7ca7-4aff-8a05-0072ceb180d1 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:45.428795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d9a1205-7ca7-4aff-8a05-0072ceb180d1 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:45.429329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d9a1205-7ca7-4aff-8a05-0072ceb180d1 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:45.448926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-01f7a572-c480-4d94-af32-ec8a16cdc4da tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] validate_networks() for [('aaa729e9-8d48-4aa2-8aa2-9ecb06a1fa06', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:30:45.480990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6d9a1205-7ca7-4aff-8a05-0072ceb180d1 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 8ecbad38-98de-4c5d-b656-07e102181e62] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:30:45.708772 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6d9a1205-7ca7-4aff-8a05-0072ceb180d1 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62" status: 204 len: 0 microversion: 2.1 time: 0.305023 Sep 07 12:30:45.709849 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 349/694] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:30:45 2022] DELETE /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:30:45.983405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-66e7c827-d612-40fb-a6af-c25ef0b5dde3 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:45.987128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-66e7c827-d612-40fb-a6af-c25ef0b5dde3 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:45.998303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e7c827-d612-40fb-a6af-c25ef0b5dde3 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:45.999600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e7c827-d612-40fb-a6af-c25ef0b5dde3 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:46.000240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e7c827-d612-40fb-a6af-c25ef0b5dde3 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:46.001290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e7c827-d612-40fb-a6af-c25ef0b5dde3 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:46.001979 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e7c827-d612-40fb-a6af-c25ef0b5dde3 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:46.002672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e7c827-d612-40fb-a6af-c25ef0b5dde3 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:46.139641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-66e7c827-d612-40fb-a6af-c25ef0b5dde3 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:30:46.140417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-66e7c827-d612-40fb-a6af-c25ef0b5dde3 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:30:46.141711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-66e7c827-d612-40fb-a6af-c25ef0b5dde3 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:30:46.142364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-66e7c827-d612-40fb-a6af-c25ef0b5dde3 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:30:46.142984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-66e7c827-d612-40fb-a6af-c25ef0b5dde3 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:30:46.276584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-66e7c827-d612-40fb-a6af-c25ef0b5dde3 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:46.291233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e7c827-d612-40fb-a6af-c25ef0b5dde3 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:46.292113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e7c827-d612-40fb-a6af-c25ef0b5dde3 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:46.292904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e7c827-d612-40fb-a6af-c25ef0b5dde3 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:46.298272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e7c827-d612-40fb-a6af-c25ef0b5dde3 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:46.299672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e7c827-d612-40fb-a6af-c25ef0b5dde3 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:46.302965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e7c827-d612-40fb-a6af-c25ef0b5dde3 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:46.544323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-66e7c827-d612-40fb-a6af-c25ef0b5dde3 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lazy-loading 'services' on Instance uuid 7e48b0d0-a574-476c-8054-97b544b3d24f {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:30:46.635741 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-66e7c827-d612-40fb-a6af-c25ef0b5dde3 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f/action" status: 202 len: 1942 microversion: 2.75 time: 0.923740 Sep 07 12:30:46.638597 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 350/695] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Sep 7 12:30:45 2022] POST /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f/action => generated 1942 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 07 12:30:46.638796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-01f7a572-c480-4d94-af32-ec8a16cdc4da tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:30:46.638796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-01f7a572-c480-4d94-af32-ec8a16cdc4da tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:30:46.638796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-01f7a572-c480-4d94-af32-ec8a16cdc4da tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:30:46.639392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-01f7a572-c480-4d94-af32-ec8a16cdc4da tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:30:46.639595 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-01f7a572-c480-4d94-af32-ec8a16cdc4da tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:30:46.646252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b9669615-fd55-45fc-9556-5ef4ac0a75f4 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852087-9", "block_migration": true, "disk_over_commit": false}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:46.649518 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01f7a572-c480-4d94-af32-ec8a16cdc4da tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:46.651132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01f7a572-c480-4d94-af32-ec8a16cdc4da tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:46.651590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01f7a572-c480-4d94-af32-ec8a16cdc4da tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:46.652634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01f7a572-c480-4d94-af32-ec8a16cdc4da tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:46.652813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b9669615-fd55-45fc-9556-5ef4ac0a75f4 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] [instance: e640bc92-0f42-4b0c-b725-9f8d9955e599] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:46.653455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01f7a572-c480-4d94-af32-ec8a16cdc4da tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:46.654180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01f7a572-c480-4d94-af32-ec8a16cdc4da tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:46.676008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-01f7a572-c480-4d94-af32-ec8a16cdc4da tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Getting quotas for project 6c950a615d6a4b67a93a60f7969b6e6e. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:30:46.681049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-01f7a572-c480-4d94-af32-ec8a16cdc4da tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Getting quotas for user 239d71c912c749e7afe0f791db5c18f9 and project 6c950a615d6a4b67a93a60f7969b6e6e. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:30:46.684171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9669615-fd55-45fc-9556-5ef4ac0a75f4 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:46.686221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9669615-fd55-45fc-9556-5ef4ac0a75f4 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:46.686836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9669615-fd55-45fc-9556-5ef4ac0a75f4 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:46.687420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9669615-fd55-45fc-9556-5ef4ac0a75f4 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:46.687907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9669615-fd55-45fc-9556-5ef4ac0a75f4 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:46.688485 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9669615-fd55-45fc-9556-5ef4ac0a75f4 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:46.698706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-01f7a572-c480-4d94-af32-ec8a16cdc4da tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:30:46.701366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-01f7a572-c480-4d94-af32-ec8a16cdc4da tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:30:46.720460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-b9669615-fd55-45fc-9556-5ef4ac0a75f4 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Lazy-loading 'flavor' on Instance uuid e640bc92-0f42-4b0c-b725-9f8d9955e599 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:30:46.739116 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-b9669615-fd55-45fc-9556-5ef4ac0a75f4 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance e640bc92-0f42-4b0c-b725-9f8d9955e599 while it is in vm_state suspended Sep 07 12:30:46.742584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b9669615-fd55-45fc-9556-5ef4ac0a75f4 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Request method failure captured: Sep 07 12:30:46.742584 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599/action HTTP/1.1 Sep 07 12:30:46.742584 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:30:46.742584 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:30:46.742584 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:30:46.742584 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 97 Sep 07 12:30:46.742584 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:30:46.742584 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:30:46.742584 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:30:46.742584 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:30:46.742584 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI6zuAoMbXZq0kmCn-tWXJOs9zG8i-BtZsEIEZipVmEaZpYMpqLASq69Ugy3_PDBoUUDUPlj2go5cTb2nyPV7cankvbYNigVOYkzWbgmRP3GbVDchjcMlVEju51xWw12aWFbfYYaNZX3VrwoNktuoWkYNkNmfukO1yk6B-iV9DdyvrY Sep 07 12:30:46.742584 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:30:46.742584 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:30:46.742584 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:30:46.742584 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:30:46.742584 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:30:46.742584 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:30:46.742584 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 2f9041c5ee2344cba301e8c922688254 Sep 07 12:30:46.742584 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-LiveMigrationNegativeTest-752588552 Sep 07 12:30:46.742584 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member,admin Sep 07 12:30:46.742584 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member,admin Sep 07 12:30:46.744425 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f9041c5ee2344cba301e8c922688254"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2f9041c5ee2344cba301e8c922688254"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2f9041c5ee2344cba301e8c922688254"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f9041c5ee2344cba301e8c922688254"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:30:46.744425 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-LiveMigrationNegativeTest-752588552 Sep 07 12:30:46.744425 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 2f9041c5ee2344cba301e8c922688254 Sep 07 12:30:46.744425 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-752588552 Sep 07 12:30:46.744425 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-LiveMigrationNegativeTest-752588552-project-admin Sep 07 12:30:46.744425 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:30:46.744425 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:30:46.744425 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 5949de773f1d4514b43da40bdf169f31 Sep 07 12:30:46.744425 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-LiveMigrationNegativeTest-752588552-project-admin Sep 07 12:30:46.744425 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:30:46.744425 n-d-852087-9 devstack@n-api.service[122432]: {"os-migrateLive": {"host": "n-h1-852087-9", "block_migration": true, "disk_over_commit": false}} Sep 07 12:30:46.744425 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:30:46.745258 n-d-852087-9 devstack@n-api.service[122432]: exception: Cannot 'os-migrateLive' instance e640bc92-0f42-4b0c-b725-9f8d9955e599 while it is in vm_state suspended Sep 07 12:30:46.745258 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'e640bc92-0f42-4b0c-b725-9f8d9955e599', 'body': {'os-migrateLive': {'host': 'n-h1-852087-9', 'block_migration': True, 'disk_over_commit': False}}} Sep 07 12:30:46.745258 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:30:46.745258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:46.745258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 07 12:30:46.745258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 07 12:30:46.745258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 07 12:30:46.745258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 12:30:46.745258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 07 12:30:46.745258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 12:30:46.745258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 07 12:30:46.745258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 12:30:46.745258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 07 12:30:46.745258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 12:30:46.745258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 07 12:30:46.745258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 12:30:46.745258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 07 12:30:46.745258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 12:30:46.746643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 12:30:46.746643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 12:30:46.746643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 12:30:46.746643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 12:30:46.746643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e640bc92-0f42-4b0c-b725-9f8d9955e599 in vm_state suspended. Cannot live_migrate while the instance is in this state. Sep 07 12:30:46.746643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:46.746643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:46.746643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:46.746643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:46.746643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:46.746643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:46.746643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:30:46.746643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:30:46.746643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:30:46.746643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:46.746643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:30:46.746643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:30:46.746643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:30:46.746643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:30:46.746643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:30:46.748436 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:30:46.748436 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 07 12:30:46.748436 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Sep 07 12:30:46.748436 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 12:30:46.748436 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 12:30:46.748436 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 12:30:46.748436 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance e640bc92-0f42-4b0c-b725-9f8d9955e599 while it is in vm_state suspended Sep 07 12:30:46.748436 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:46.748436 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:46.748436 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:46.748436 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:46.748436 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:46.748436 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:46.748436 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:30:46.748436 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:30:46.748436 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance e640bc92-0f42-4b0c-b725-9f8d9955e599 while it is in vm_state suspended Sep 07 12:30:46.748436 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:46.750055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b9669615-fd55-45fc-9556-5ef4ac0a75f4 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance e640bc92-0f42-4b0c-b725-9f8d9955e599 while it is in vm_state suspended {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:30:46.750055 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b9669615-fd55-45fc-9556-5ef4ac0a75f4 tempest-LiveMigrationNegativeTest-752588552 tempest-LiveMigrationNegativeTest-752588552-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599/action" status: 409 len: 155 microversion: 2.1 time: 0.105777 Sep 07 12:30:46.750876 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 351/696] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:30:46 2022] POST /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599/action => generated 155 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:30:46.756994 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f055198f-d9ff-42ec-afda-4f654ea00f88 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:46.757670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f055198f-d9ff-42ec-afda-4f654ea00f88 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:46.765116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f055198f-d9ff-42ec-afda-4f654ea00f88 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:46.765724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f055198f-d9ff-42ec-afda-4f654ea00f88 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:46.766147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f055198f-d9ff-42ec-afda-4f654ea00f88 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:46.766887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f055198f-d9ff-42ec-afda-4f654ea00f88 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:46.767364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f055198f-d9ff-42ec-afda-4f654ea00f88 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:46.767837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f055198f-d9ff-42ec-afda-4f654ea00f88 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:46.792290 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-01f7a572-c480-4d94-af32-ec8a16cdc4da tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.037873 Sep 07 12:30:46.795943 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 346/697] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:30:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 2048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:30:46.822924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7cd945a5-5361-4674-a8ce-105403ace6d1 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:46.824048 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7cd945a5-5361-4674-a8ce-105403ace6d1 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 8ecbad38-98de-4c5d-b656-07e102181e62] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:46.842285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7cd945a5-5361-4674-a8ce-105403ace6d1 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:46.843220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7cd945a5-5361-4674-a8ce-105403ace6d1 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:46.844048 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7cd945a5-5361-4674-a8ce-105403ace6d1 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:46.845668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7cd945a5-5361-4674-a8ce-105403ace6d1 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:46.846787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7cd945a5-5361-4674-a8ce-105403ace6d1 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:46.848441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7cd945a5-5361-4674-a8ce-105403ace6d1 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:47.203974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f055198f-d9ff-42ec-afda-4f654ea00f88 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:47.231855 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f055198f-d9ff-42ec-afda-4f654ea00f88 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1477 microversion: 2.1 time: 0.478883 Sep 07 12:30:47.242440 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 352/698] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:46 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1477 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:47.248142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0f8a99d6-2d36-4b1b-aa41-a4a114a8ac5f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:47.249646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0f8a99d6-2d36-4b1b-aa41-a4a114a8ac5f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:47.279490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7cd945a5-5361-4674-a8ce-105403ace6d1 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:47.284280 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f8a99d6-2d36-4b1b-aa41-a4a114a8ac5f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:47.289930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f8a99d6-2d36-4b1b-aa41-a4a114a8ac5f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:47.290878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f8a99d6-2d36-4b1b-aa41-a4a114a8ac5f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:47.291938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f8a99d6-2d36-4b1b-aa41-a4a114a8ac5f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:47.293074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f8a99d6-2d36-4b1b-aa41-a4a114a8ac5f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:47.294254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f8a99d6-2d36-4b1b-aa41-a4a114a8ac5f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:47.300300 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7cd945a5-5361-4674-a8ce-105403ace6d1 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62" status: 200 len: 1477 microversion: 2.1 time: 0.485342 Sep 07 12:30:47.335484 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 347/699] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:46 2022] GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62 => generated 1477 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:47.343012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f1aff304-3e34-4006-b97e-16d42159594b tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:47.344401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f1aff304-3e34-4006-b97e-16d42159594b tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:47.352126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1aff304-3e34-4006-b97e-16d42159594b tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:47.353090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1aff304-3e34-4006-b97e-16d42159594b tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:47.353841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1aff304-3e34-4006-b97e-16d42159594b tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:47.354898 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1aff304-3e34-4006-b97e-16d42159594b tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:47.356024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1aff304-3e34-4006-b97e-16d42159594b tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:47.356987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1aff304-3e34-4006-b97e-16d42159594b tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:47.517300 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0f8a99d6-2d36-4b1b-aa41-a4a114a8ac5f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:47.535054 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0f8a99d6-2d36-4b1b-aa41-a4a114a8ac5f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1292 microversion: 2.1 time: 0.290673 Sep 07 12:30:47.536118 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 353/700] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:47 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1292 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:47.557433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-199451d2-5b6e-4343-851c-4b708d66c3f5 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:47.558214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-199451d2-5b6e-4343-851c-4b708d66c3f5 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: e640bc92-0f42-4b0c-b725-9f8d9955e599] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:47.569190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:30:47.584997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-f1aff304-3e34-4006-b97e-16d42159594b tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lazy-loading 'services' on Instance uuid 7e48b0d0-a574-476c-8054-97b544b3d24f {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:30:47.587414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-199451d2-5b6e-4343-851c-4b708d66c3f5 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:47.587916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-199451d2-5b6e-4343-851c-4b708d66c3f5 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:47.588389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-199451d2-5b6e-4343-851c-4b708d66c3f5 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:47.593093 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-199451d2-5b6e-4343-851c-4b708d66c3f5 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:47.593692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-199451d2-5b6e-4343-851c-4b708d66c3f5 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:47.594140 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-199451d2-5b6e-4343-851c-4b708d66c3f5 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:47.634866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-199451d2-5b6e-4343-851c-4b708d66c3f5 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: e640bc92-0f42-4b0c-b725-9f8d9955e599] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:30:47.683333 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f1aff304-3e34-4006-b97e-16d42159594b tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1929 microversion: 2.75 time: 0.346078 Sep 07 12:30:47.686162 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 348/701] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:47 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1929 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:30:47.695828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4b6fea86-b64c-4012-80bc-8cb603ab24ac tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:47.697342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4b6fea86-b64c-4012-80bc-8cb603ab24ac tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:47.710580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b6fea86-b64c-4012-80bc-8cb603ab24ac tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:47.712117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b6fea86-b64c-4012-80bc-8cb603ab24ac tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:47.713341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b6fea86-b64c-4012-80bc-8cb603ab24ac tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:47.715387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b6fea86-b64c-4012-80bc-8cb603ab24ac tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:47.717039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b6fea86-b64c-4012-80bc-8cb603ab24ac tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:47.718170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b6fea86-b64c-4012-80bc-8cb603ab24ac tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:47.766738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:30:47.831496 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-199451d2-5b6e-4343-851c-4b708d66c3f5 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599" status: 204 len: 0 microversion: 2.1 time: 0.293571 Sep 07 12:30:47.833759 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 354/702] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:30:47 2022] DELETE /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:30:47.843806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1461554c-ec14-489a-b872-41cda45c14c5 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:47.844817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1461554c-ec14-489a-b872-41cda45c14c5 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: e640bc92-0f42-4b0c-b725-9f8d9955e599] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:47.854684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1461554c-ec14-489a-b872-41cda45c14c5 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:47.855557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1461554c-ec14-489a-b872-41cda45c14c5 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:47.856365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1461554c-ec14-489a-b872-41cda45c14c5 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:47.858460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1461554c-ec14-489a-b872-41cda45c14c5 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:47.859335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1461554c-ec14-489a-b872-41cda45c14c5 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:47.859972 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1461554c-ec14-489a-b872-41cda45c14c5 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:48.019382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4b6fea86-b64c-4012-80bc-8cb603ab24ac tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:48.036677 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4b6fea86-b64c-4012-80bc-8cb603ab24ac tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9" status: 200 len: 1244 microversion: 2.1 time: 0.348168 Sep 07 12:30:48.053089 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 349/703] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:47 2022] GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9 => generated 1244 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:48.267208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1461554c-ec14-489a-b872-41cda45c14c5 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:48.282505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ac660595-45d7-46d7-ace0-29d3cfac099d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:48.283126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ac660595-45d7-46d7-ace0-29d3cfac099d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:48.288165 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1461554c-ec14-489a-b872-41cda45c14c5 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599" status: 200 len: 1466 microversion: 2.1 time: 0.449142 Sep 07 12:30:48.289640 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 355/704] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:47 2022] GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599 => generated 1466 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:48.301064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac660595-45d7-46d7-ace0-29d3cfac099d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:48.301622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac660595-45d7-46d7-ace0-29d3cfac099d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:48.302079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac660595-45d7-46d7-ace0-29d3cfac099d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:48.302980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac660595-45d7-46d7-ace0-29d3cfac099d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:48.303601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac660595-45d7-46d7-ace0-29d3cfac099d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:48.304436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac660595-45d7-46d7-ace0-29d3cfac099d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:48.347375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-000c02bb-5eed-4add-a333-30082b45d8e6 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:48.348371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-000c02bb-5eed-4add-a333-30082b45d8e6 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 8ecbad38-98de-4c5d-b656-07e102181e62] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:48.357222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-000c02bb-5eed-4add-a333-30082b45d8e6 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:48.358072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-000c02bb-5eed-4add-a333-30082b45d8e6 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:48.358997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-000c02bb-5eed-4add-a333-30082b45d8e6 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:48.360162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-000c02bb-5eed-4add-a333-30082b45d8e6 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:48.361138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-000c02bb-5eed-4add-a333-30082b45d8e6 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:48.361831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-000c02bb-5eed-4add-a333-30082b45d8e6 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:48.533798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-000c02bb-5eed-4add-a333-30082b45d8e6 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:48.543518 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-000c02bb-5eed-4add-a333-30082b45d8e6 tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62" status: 200 len: 1435 microversion: 2.1 time: 0.200320 Sep 07 12:30:48.545408 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 356/705] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:48 2022] GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62 => generated 1435 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:48.551242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-5dde9546-f89b-4147-8ec3-1fe9a5a216ca req-9ba67de3-3dc1-4124-ab48-772ce858afd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ecbad38-98de-4c5d-b656-07e102181e62", "name": "network-vif-deleted", "tag": "293cc6aa-a17a-4b27-8edc-1a5155708f68"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:48.566103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5dde9546-f89b-4147-8ec3-1fe9a5a216ca req-9ba67de3-3dc1-4124-ab48-772ce858afd7 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:48.566857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5dde9546-f89b-4147-8ec3-1fe9a5a216ca req-9ba67de3-3dc1-4124-ab48-772ce858afd7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:48.567441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5dde9546-f89b-4147-8ec3-1fe9a5a216ca req-9ba67de3-3dc1-4124-ab48-772ce858afd7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:48.582705 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-5dde9546-f89b-4147-8ec3-1fe9a5a216ca req-9ba67de3-3dc1-4124-ab48-772ce858afd7 service nova] Creating event network-vif-deleted:293cc6aa-a17a-4b27-8edc-1a5155708f68 for instance 8ecbad38-98de-4c5d-b656-07e102181e62 on n-h1-852087-9 Sep 07 12:30:48.589142 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-5dde9546-f89b-4147-8ec3-1fe9a5a216ca req-9ba67de3-3dc1-4124-ab48-772ce858afd7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042052 Sep 07 12:30:48.589820 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 357/706] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:30:48.595805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5a706a76-88e3-4c0d-ba73-86c687bea696 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:48.596500 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5a706a76-88e3-4c0d-ba73-86c687bea696 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:48.603837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a706a76-88e3-4c0d-ba73-86c687bea696 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:48.604504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a706a76-88e3-4c0d-ba73-86c687bea696 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:48.604971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a706a76-88e3-4c0d-ba73-86c687bea696 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:48.606058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a706a76-88e3-4c0d-ba73-86c687bea696 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:48.606697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a706a76-88e3-4c0d-ba73-86c687bea696 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:48.607282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a706a76-88e3-4c0d-ba73-86c687bea696 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:48.822281 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5a706a76-88e3-4c0d-ba73-86c687bea696 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:48.843617 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5a706a76-88e3-4c0d-ba73-86c687bea696 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1292 microversion: 2.1 time: 0.251607 Sep 07 12:30:48.865944 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 358/707] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:48 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1292 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:48.865944 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c0b71857-5083-441f-ae28-bf20e703fb88 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:48.865944 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c0b71857-5083-441f-ae28-bf20e703fb88 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:48.877460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0b71857-5083-441f-ae28-bf20e703fb88 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:48.879480 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0b71857-5083-441f-ae28-bf20e703fb88 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:48.880892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0b71857-5083-441f-ae28-bf20e703fb88 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:48.882672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0b71857-5083-441f-ae28-bf20e703fb88 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:48.883662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0b71857-5083-441f-ae28-bf20e703fb88 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:48.884575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0b71857-5083-441f-ae28-bf20e703fb88 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:48.968353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ac660595-45d7-46d7-ace0-29d3cfac099d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:48.988116 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ac660595-45d7-46d7-ace0-29d3cfac099d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1477 microversion: 2.1 time: 0.708442 Sep 07 12:30:48.990021 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 350/708] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:48 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1477 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:30:49.068456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ed883022-1608-4a44-b5a8-cea0e7482a34 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:49.069197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ed883022-1608-4a44-b5a8-cea0e7482a34 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:49.086406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed883022-1608-4a44-b5a8-cea0e7482a34 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:49.087861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed883022-1608-4a44-b5a8-cea0e7482a34 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:49.088983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed883022-1608-4a44-b5a8-cea0e7482a34 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:49.090609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed883022-1608-4a44-b5a8-cea0e7482a34 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:49.091720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed883022-1608-4a44-b5a8-cea0e7482a34 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:49.092752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed883022-1608-4a44-b5a8-cea0e7482a34 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:49.179142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-c0b71857-5083-441f-ae28-bf20e703fb88 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lazy-loading 'services' on Instance uuid 7e48b0d0-a574-476c-8054-97b544b3d24f {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:30:49.214079 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c0b71857-5083-441f-ae28-bf20e703fb88 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1929 microversion: 2.75 time: 0.361589 Sep 07 12:30:49.215173 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 359/709] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:48 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1929 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:30:49.284094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ed883022-1608-4a44-b5a8-cea0e7482a34 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:49.305517 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ed883022-1608-4a44-b5a8-cea0e7482a34 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9" status: 200 len: 1300 microversion: 2.1 time: 0.247422 Sep 07 12:30:49.329322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b0c9e499-2003-4197-a281-8695ca9aa968 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:49.331344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b0c9e499-2003-4197-a281-8695ca9aa968 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: e640bc92-0f42-4b0c-b725-9f8d9955e599] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:49.333694 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 351/710] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:49 2022] GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9 => generated 1300 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:49.354557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0c9e499-2003-4197-a281-8695ca9aa968 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:49.358427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0c9e499-2003-4197-a281-8695ca9aa968 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:49.366492 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0c9e499-2003-4197-a281-8695ca9aa968 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:49.368127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0c9e499-2003-4197-a281-8695ca9aa968 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:49.368956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0c9e499-2003-4197-a281-8695ca9aa968 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:49.369873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0c9e499-2003-4197-a281-8695ca9aa968 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:49.600971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-27ccd339-8976-469e-b14a-1ab1e3e6a07c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:49.602512 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-27ccd339-8976-469e-b14a-1ab1e3e6a07c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 8ecbad38-98de-4c5d-b656-07e102181e62] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:49.622807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27ccd339-8976-469e-b14a-1ab1e3e6a07c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:49.623682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27ccd339-8976-469e-b14a-1ab1e3e6a07c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:49.624782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27ccd339-8976-469e-b14a-1ab1e3e6a07c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:49.626568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27ccd339-8976-469e-b14a-1ab1e3e6a07c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:49.628156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27ccd339-8976-469e-b14a-1ab1e3e6a07c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:49.629263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27ccd339-8976-469e-b14a-1ab1e3e6a07c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:49.775180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27ccd339-8976-469e-b14a-1ab1e3e6a07c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:49.779159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27ccd339-8976-469e-b14a-1ab1e3e6a07c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:49.789709 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27ccd339-8976-469e-b14a-1ab1e3e6a07c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:49.792658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-27ccd339-8976-469e-b14a-1ab1e3e6a07c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lazy-loading 'fault' on Instance uuid 8ecbad38-98de-4c5d-b656-07e102181e62 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:30:50.012839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-27ccd339-8976-469e-b14a-1ab1e3e6a07c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '433722ee7f084b8aa1decba3f1572934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b6f3dbd50d41d69a47e6184f9abe52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:50.034832 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-27ccd339-8976-469e-b14a-1ab1e3e6a07c tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62" status: 200 len: 1312 microversion: 2.1 time: 0.448067 Sep 07 12:30:50.036613 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 352/711] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:49 2022] GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62 => generated 1312 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:50.050643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d6fa1d8b-4692-48ce-b398-577652b89383 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:50.052328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d6fa1d8b-4692-48ce-b398-577652b89383 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:50.065659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6fa1d8b-4692-48ce-b398-577652b89383 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:50.067283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6fa1d8b-4692-48ce-b398-577652b89383 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:50.068431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6fa1d8b-4692-48ce-b398-577652b89383 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:50.069954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6fa1d8b-4692-48ce-b398-577652b89383 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:50.071037 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6fa1d8b-4692-48ce-b398-577652b89383 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:50.071845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6fa1d8b-4692-48ce-b398-577652b89383 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:50.109003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b0c9e499-2003-4197-a281-8695ca9aa968 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:50.139284 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b0c9e499-2003-4197-a281-8695ca9aa968 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599" status: 200 len: 1466 microversion: 2.1 time: 0.820496 Sep 07 12:30:50.140355 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 360/712] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:49 2022] GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599 => generated 1466 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:50.155573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8916a1b5-4ba0-4410-aaa1-fdcea62b7592 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:50.158502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8916a1b5-4ba0-4410-aaa1-fdcea62b7592 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:50.184306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8916a1b5-4ba0-4410-aaa1-fdcea62b7592 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:50.190847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8916a1b5-4ba0-4410-aaa1-fdcea62b7592 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:50.192005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8916a1b5-4ba0-4410-aaa1-fdcea62b7592 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:50.193717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8916a1b5-4ba0-4410-aaa1-fdcea62b7592 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:50.194815 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8916a1b5-4ba0-4410-aaa1-fdcea62b7592 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:50.195840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8916a1b5-4ba0-4410-aaa1-fdcea62b7592 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:50.770083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d6fa1d8b-4692-48ce-b398-577652b89383 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:50.810351 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d6fa1d8b-4692-48ce-b398-577652b89383 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1359 microversion: 2.1 time: 0.771658 Sep 07 12:30:50.812597 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 353/713] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:50 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1359 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:50.829382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ef73ee82-efa2-40d9-abf1-973b6d302e9b tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:50.834705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ef73ee82-efa2-40d9-abf1-973b6d302e9b tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:50.851551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef73ee82-efa2-40d9-abf1-973b6d302e9b tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:50.853800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef73ee82-efa2-40d9-abf1-973b6d302e9b tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:50.856366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef73ee82-efa2-40d9-abf1-973b6d302e9b tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:50.865578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef73ee82-efa2-40d9-abf1-973b6d302e9b tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:50.866659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef73ee82-efa2-40d9-abf1-973b6d302e9b tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:50.868334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef73ee82-efa2-40d9-abf1-973b6d302e9b tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:51.111384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:30:51.141997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-ef73ee82-efa2-40d9-abf1-973b6d302e9b tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lazy-loading 'services' on Instance uuid 7e48b0d0-a574-476c-8054-97b544b3d24f {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:30:51.204892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8916a1b5-4ba0-4410-aaa1-fdcea62b7592 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:51.219248 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ef73ee82-efa2-40d9-abf1-973b6d302e9b tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1929 microversion: 2.75 time: 0.402996 Sep 07 12:30:51.225841 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 354/714] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:50 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1929 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:30:51.242450 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8916a1b5-4ba0-4410-aaa1-fdcea62b7592 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1477 microversion: 2.1 time: 1.093984 Sep 07 12:30:51.244795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d189cd52-bb99-4fd2-87b5-885cf3cc0ba6 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:51.247054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d189cd52-bb99-4fd2-87b5-885cf3cc0ba6 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:51.250043 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 361/715] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:50 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1477 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:51.281082 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d189cd52-bb99-4fd2-87b5-885cf3cc0ba6 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:51.286808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d189cd52-bb99-4fd2-87b5-885cf3cc0ba6 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:51.287942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d189cd52-bb99-4fd2-87b5-885cf3cc0ba6 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:51.289334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d189cd52-bb99-4fd2-87b5-885cf3cc0ba6 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:51.290193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d189cd52-bb99-4fd2-87b5-885cf3cc0ba6 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:51.290956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d189cd52-bb99-4fd2-87b5-885cf3cc0ba6 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:51.291089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0010a21b-30b5-410c-8fce-ed0a7cbd7cdc tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:51.292027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0010a21b-30b5-410c-8fce-ed0a7cbd7cdc tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] [instance: 8ecbad38-98de-4c5d-b656-07e102181e62] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:51.311390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0010a21b-30b5-410c-8fce-ed0a7cbd7cdc tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:51.328599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0010a21b-30b5-410c-8fce-ed0a7cbd7cdc tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:51.329328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0010a21b-30b5-410c-8fce-ed0a7cbd7cdc tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:51.330948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0010a21b-30b5-410c-8fce-ed0a7cbd7cdc tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:51.331687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0010a21b-30b5-410c-8fce-ed0a7cbd7cdc tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:51.332447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0010a21b-30b5-410c-8fce-ed0a7cbd7cdc tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:51.379857 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-0010a21b-30b5-410c-8fce-ed0a7cbd7cdc tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] HTTP exception thrown: Instance 8ecbad38-98de-4c5d-b656-07e102181e62 could not be found. Sep 07 12:30:51.392213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0010a21b-30b5-410c-8fce-ed0a7cbd7cdc tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Request method failure captured: Sep 07 12:30:51.392213 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62 HTTP/1.1 Sep 07 12:30:51.392213 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:30:51.392213 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:30:51.392213 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:30:51.392213 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:30:51.392213 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:30:51.392213 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:30:51.392213 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:30:51.392213 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:30:51.392213 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI6xdHsWgfr6cpipKa02Y78ORxjHy__l_vCYhmq8KHyVl1aZN4PFj0yakAuyi4oNY7cvhrsbRIEAhlTD0ftTI8wvSSEMmaqF2KATTmJ27XWFj92_XGpB8UQchuXKAKr_Iopv_1nKLjRuZFJaNMHdRuME5W3BObBBFeFwR0MriTXhqfw Sep 07 12:30:51.392213 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:30:51.392213 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:30:51.392213 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:30:51.392213 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:30:51.392213 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:30:51.392213 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:30:51.392213 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 53b6f3dbd50d41d69a47e6184f9abe52 Sep 07 12:30:51.392213 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1099232976 Sep 07 12:30:51.392213 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:30:51.392213 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:30:51.393756 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/53b6f3dbd50d41d69a47e6184f9abe52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_53b6f3dbd50d41d69a47e6184f9abe52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/53b6f3dbd50d41d69a47e6184f9abe52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/53b6f3dbd50d41d69a47e6184f9abe52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:30:51.393756 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1099232976 Sep 07 12:30:51.393756 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 53b6f3dbd50d41d69a47e6184f9abe52 Sep 07 12:30:51.393756 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1099232976 Sep 07 12:30:51.393756 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersAdminNegativeTestJSON-1099232976-project Sep 07 12:30:51.393756 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:30:51.393756 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:30:51.393756 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 433722ee7f084b8aa1decba3f1572934 Sep 07 12:30:51.393756 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1099232976-project Sep 07 12:30:51.393756 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:30:51.393756 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 8ecbad38-98de-4c5d-b656-07e102181e62 could not be found. Sep 07 12:30:51.393756 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '8ecbad38-98de-4c5d-b656-07e102181e62'} Sep 07 12:30:51.394511 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:30:51.394511 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:51.394511 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:30:51.394511 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:30:51.394511 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:30:51.394511 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:30:51.394511 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:30:51.394511 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:30:51.394511 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:30:51.394511 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:30:51.394511 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ecbad38-98de-4c5d-b656-07e102181e62 could not be found. Sep 07 12:30:51.394511 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:51.394511 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:51.394511 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:51.394511 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:51.394511 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:51.394511 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:51.394511 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:30:51.394511 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:30:51.394511 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:30:51.395708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:51.395708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:30:51.395708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:30:51.395708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:30:51.395708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:30:51.395708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:30:51.395708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:30:51.395708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ecbad38-98de-4c5d-b656-07e102181e62 could not be found. Sep 07 12:30:51.395708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:51.395708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:51.395708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:51.395708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:51.395708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:51.395708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:51.395708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:30:51.395708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:30:51.395708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ecbad38-98de-4c5d-b656-07e102181e62 could not be found. Sep 07 12:30:51.395708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:30:51.396966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0010a21b-30b5-410c-8fce-ed0a7cbd7cdc tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] Returning 404 to user: Instance 8ecbad38-98de-4c5d-b656-07e102181e62 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:30:51.396966 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0010a21b-30b5-410c-8fce-ed0a7cbd7cdc tempest-ServersAdminNegativeTestJSON-1099232976 tempest-ServersAdminNegativeTestJSON-1099232976-project] 10.222.0.16 "GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62" status: 404 len: 111 microversion: 2.1 time: 0.143083 Sep 07 12:30:51.403677 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 362/716] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:51 2022] GET /compute/v2.1/servers/8ecbad38-98de-4c5d-b656-07e102181e62 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:30:51.420001 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f7bbb5cd-94b6-42e7-b00a-1bf562ca078d tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:51.420730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f7bbb5cd-94b6-42e7-b00a-1bf562ca078d tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: e640bc92-0f42-4b0c-b725-9f8d9955e599] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:51.441228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f7bbb5cd-94b6-42e7-b00a-1bf562ca078d tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:51.442662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f7bbb5cd-94b6-42e7-b00a-1bf562ca078d tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:51.443866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f7bbb5cd-94b6-42e7-b00a-1bf562ca078d tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:51.445786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f7bbb5cd-94b6-42e7-b00a-1bf562ca078d tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:51.447027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f7bbb5cd-94b6-42e7-b00a-1bf562ca078d tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:51.448356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f7bbb5cd-94b6-42e7-b00a-1bf562ca078d tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:52.835125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f7bbb5cd-94b6-42e7-b00a-1bf562ca078d tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:52.853678 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f7bbb5cd-94b6-42e7-b00a-1bf562ca078d tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599" status: 200 len: 1466 microversion: 2.1 time: 1.448156 Sep 07 12:30:52.855264 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 363/717] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:51 2022] GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599 => generated 1466 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:52.862415 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-96391ed5-918d-432e-a942-430118971069 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:52.863750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-96391ed5-918d-432e-a942-430118971069 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:52.874968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96391ed5-918d-432e-a942-430118971069 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:52.875740 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96391ed5-918d-432e-a942-430118971069 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:52.876446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96391ed5-918d-432e-a942-430118971069 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:52.885254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d189cd52-bb99-4fd2-87b5-885cf3cc0ba6 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:52.905786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96391ed5-918d-432e-a942-430118971069 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:52.910945 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96391ed5-918d-432e-a942-430118971069 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:52.918452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96391ed5-918d-432e-a942-430118971069 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:52.920824 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d189cd52-bb99-4fd2-87b5-885cf3cc0ba6 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9" status: 200 len: 1365 microversion: 2.1 time: 1.693006 Sep 07 12:30:52.941528 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 355/718] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:51 2022] GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9 => generated 1365 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:52.951490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-fb75d622-1a24-4e29-80a4-32011fde453f req-7982cbb2-c8b0-4dcb-ab58-4cfb2b77fb39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8042e17-76ed-448e-bca1-331aa1f708c9", "tag": "46a7707b-e590-4c61-a29f-5120d570e51b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:52.994463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fb75d622-1a24-4e29-80a4-32011fde453f req-7982cbb2-c8b0-4dcb-ab58-4cfb2b77fb39 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:52.995319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fb75d622-1a24-4e29-80a4-32011fde453f req-7982cbb2-c8b0-4dcb-ab58-4cfb2b77fb39 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:52.996113 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fb75d622-1a24-4e29-80a4-32011fde453f req-7982cbb2-c8b0-4dcb-ab58-4cfb2b77fb39 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:53.035665 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-fb75d622-1a24-4e29-80a4-32011fde453f req-7982cbb2-c8b0-4dcb-ab58-4cfb2b77fb39 service nova] Creating event network-changed:46a7707b-e590-4c61-a29f-5120d570e51b for instance d8042e17-76ed-448e-bca1-331aa1f708c9 on n-h1-852087-9 Sep 07 12:30:53.056675 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-fb75d622-1a24-4e29-80a4-32011fde453f req-7982cbb2-c8b0-4dcb-ab58-4cfb2b77fb39 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123681 Sep 07 12:30:53.058720 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 356/719] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:30:53.074376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e935d52b-66c3-4588-a210-20df82631d13 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:53.087186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e935d52b-66c3-4588-a210-20df82631d13 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:53.117449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e935d52b-66c3-4588-a210-20df82631d13 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:53.118360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e935d52b-66c3-4588-a210-20df82631d13 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:53.119487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e935d52b-66c3-4588-a210-20df82631d13 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:53.120825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e935d52b-66c3-4588-a210-20df82631d13 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:53.121694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e935d52b-66c3-4588-a210-20df82631d13 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:53.123125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e935d52b-66c3-4588-a210-20df82631d13 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:53.424825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-e935d52b-66c3-4588-a210-20df82631d13 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lazy-loading 'services' on Instance uuid 7e48b0d0-a574-476c-8054-97b544b3d24f {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:30:53.489753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-96391ed5-918d-432e-a942-430118971069 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:53.501705 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e935d52b-66c3-4588-a210-20df82631d13 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1929 microversion: 2.75 time: 0.441126 Sep 07 12:30:53.504954 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-96391ed5-918d-432e-a942-430118971069 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1359 microversion: 2.1 time: 0.647235 Sep 07 12:30:53.512524 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 357/720] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:53 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1929 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:30:53.522193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bb56515d-b499-433b-8464-d8218f10f9fb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:53.522941 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 364/721] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:52 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1359 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:53.534287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bb56515d-b499-433b-8464-d8218f10f9fb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:53.553765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-0d9defd0-ce7d-412f-b57c-15eed821b4dd req-a6dbcabd-bd97-444a-a150-b77166bb4038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e640bc92-0f42-4b0c-b725-9f8d9955e599", "name": "network-vif-deleted", "tag": "a7abd528-ecb2-410d-9bea-fe337eeae72b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:53.559943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb56515d-b499-433b-8464-d8218f10f9fb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:53.562927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb56515d-b499-433b-8464-d8218f10f9fb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:53.564537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb56515d-b499-433b-8464-d8218f10f9fb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:53.566315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb56515d-b499-433b-8464-d8218f10f9fb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:53.567556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb56515d-b499-433b-8464-d8218f10f9fb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:53.568741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb56515d-b499-433b-8464-d8218f10f9fb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:53.598151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0d9defd0-ce7d-412f-b57c-15eed821b4dd req-a6dbcabd-bd97-444a-a150-b77166bb4038 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:53.599562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0d9defd0-ce7d-412f-b57c-15eed821b4dd req-a6dbcabd-bd97-444a-a150-b77166bb4038 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:53.600749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0d9defd0-ce7d-412f-b57c-15eed821b4dd req-a6dbcabd-bd97-444a-a150-b77166bb4038 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:53.629050 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-0d9defd0-ce7d-412f-b57c-15eed821b4dd req-a6dbcabd-bd97-444a-a150-b77166bb4038 service nova] Creating event network-vif-deleted:a7abd528-ecb2-410d-9bea-fe337eeae72b for instance e640bc92-0f42-4b0c-b725-9f8d9955e599 on n-h2-852087-9 Sep 07 12:30:53.641220 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-0d9defd0-ce7d-412f-b57c-15eed821b4dd req-a6dbcabd-bd97-444a-a150-b77166bb4038 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115378 Sep 07 12:30:53.643972 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 365/722] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:30:53.900931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6faa3ba6-a095-433f-afde-43304de375a9 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:53.902338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6faa3ba6-a095-433f-afde-43304de375a9 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: e640bc92-0f42-4b0c-b725-9f8d9955e599] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:53.923932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6faa3ba6-a095-433f-afde-43304de375a9 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:53.926423 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6faa3ba6-a095-433f-afde-43304de375a9 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:53.928058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6faa3ba6-a095-433f-afde-43304de375a9 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:53.930621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6faa3ba6-a095-433f-afde-43304de375a9 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:53.932052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6faa3ba6-a095-433f-afde-43304de375a9 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:53.933121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6faa3ba6-a095-433f-afde-43304de375a9 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:54.016904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bb56515d-b499-433b-8464-d8218f10f9fb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:54.018033 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:30:54.033535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6faa3ba6-a095-433f-afde-43304de375a9 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:54.035726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6faa3ba6-a095-433f-afde-43304de375a9 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:54.037470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6faa3ba6-a095-433f-afde-43304de375a9 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:54.039426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-6faa3ba6-a095-433f-afde-43304de375a9 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lazy-loading 'fault' on Instance uuid e640bc92-0f42-4b0c-b725-9f8d9955e599 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:30:54.051552 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bb56515d-b499-433b-8464-d8218f10f9fb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1477 microversion: 2.1 time: 0.534905 Sep 07 12:30:54.055388 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 358/723] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:53 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1477 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:54.076513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-090e42be-328b-40d9-bb30-9975b2b4de55 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:54.079888 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-090e42be-328b-40d9-bb30-9975b2b4de55 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:54.106446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-090e42be-328b-40d9-bb30-9975b2b4de55 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:54.107849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-090e42be-328b-40d9-bb30-9975b2b4de55 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:54.108896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-090e42be-328b-40d9-bb30-9975b2b4de55 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:54.110512 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-090e42be-328b-40d9-bb30-9975b2b4de55 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:54.111665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-090e42be-328b-40d9-bb30-9975b2b4de55 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:54.112648 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-090e42be-328b-40d9-bb30-9975b2b4de55 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:54.348558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6faa3ba6-a095-433f-afde-43304de375a9 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:54.379058 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6faa3ba6-a095-433f-afde-43304de375a9 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599" status: 200 len: 1309 microversion: 2.1 time: 0.484938 Sep 07 12:30:54.387377 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 366/724] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:53 2022] GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599 => generated 1309 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:30:54.552085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4c1df9f8-7683-4edd-9a28-c1257ce7313e tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:54.552874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4c1df9f8-7683-4edd-9a28-c1257ce7313e tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:54.570267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-090e42be-328b-40d9-bb30-9975b2b4de55 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:54.576662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c1df9f8-7683-4edd-9a28-c1257ce7313e tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:54.577401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c1df9f8-7683-4edd-9a28-c1257ce7313e tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:54.578208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c1df9f8-7683-4edd-9a28-c1257ce7313e tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:54.578956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c1df9f8-7683-4edd-9a28-c1257ce7313e tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:54.579432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c1df9f8-7683-4edd-9a28-c1257ce7313e tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:54.579864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c1df9f8-7683-4edd-9a28-c1257ce7313e tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:54.596754 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-090e42be-328b-40d9-bb30-9975b2b4de55 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9" status: 200 len: 1365 microversion: 2.1 time: 0.535948 Sep 07 12:30:54.633328 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 359/725] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:54 2022] GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9 => generated 1365 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:54.642637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-376286cd-cc26-47f9-8e31-d00a54a31fd0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:54.644029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-376286cd-cc26-47f9-8e31-d00a54a31fd0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:54.658026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376286cd-cc26-47f9-8e31-d00a54a31fd0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:54.659131 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376286cd-cc26-47f9-8e31-d00a54a31fd0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:54.660069 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376286cd-cc26-47f9-8e31-d00a54a31fd0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:54.668284 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376286cd-cc26-47f9-8e31-d00a54a31fd0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:54.669465 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376286cd-cc26-47f9-8e31-d00a54a31fd0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:54.670488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-376286cd-cc26-47f9-8e31-d00a54a31fd0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:54.814876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-4c1df9f8-7683-4edd-9a28-c1257ce7313e tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lazy-loading 'services' on Instance uuid 7e48b0d0-a574-476c-8054-97b544b3d24f {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:30:54.907688 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4c1df9f8-7683-4edd-9a28-c1257ce7313e tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1929 microversion: 2.75 time: 0.360151 Sep 07 12:30:54.910820 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 367/726] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:54 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1929 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:30:55.098378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-376286cd-cc26-47f9-8e31-d00a54a31fd0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:55.102345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-856d3b31-9796-4bc6-abab-b1beaedf3e50 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:55.112015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-856d3b31-9796-4bc6-abab-b1beaedf3e50 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:55.140326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-856d3b31-9796-4bc6-abab-b1beaedf3e50 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:55.141647 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-376286cd-cc26-47f9-8e31-d00a54a31fd0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1359 microversion: 2.1 time: 0.502596 Sep 07 12:30:55.142588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-856d3b31-9796-4bc6-abab-b1beaedf3e50 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:55.143406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-856d3b31-9796-4bc6-abab-b1beaedf3e50 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:55.145114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-856d3b31-9796-4bc6-abab-b1beaedf3e50 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:55.146001 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-856d3b31-9796-4bc6-abab-b1beaedf3e50 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:55.146981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-856d3b31-9796-4bc6-abab-b1beaedf3e50 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:55.162436 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 360/727] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:54 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1359 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:55.379391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:30:55.411097 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-856d3b31-9796-4bc6-abab-b1beaedf3e50 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:55.424286 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-856d3b31-9796-4bc6-abab-b1beaedf3e50 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1477 microversion: 2.1 time: 0.330933 Sep 07 12:30:55.440840 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 368/728] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:55 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1477 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:55.441257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-40217e68-d8b7-4348-9d55-bd215518466d tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:55.442510 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-40217e68-d8b7-4348-9d55-bd215518466d tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: e640bc92-0f42-4b0c-b725-9f8d9955e599] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:55.458307 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40217e68-d8b7-4348-9d55-bd215518466d tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:55.459964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40217e68-d8b7-4348-9d55-bd215518466d tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:55.462947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40217e68-d8b7-4348-9d55-bd215518466d tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:55.464866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40217e68-d8b7-4348-9d55-bd215518466d tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:55.466046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40217e68-d8b7-4348-9d55-bd215518466d tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:55.467312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40217e68-d8b7-4348-9d55-bd215518466d tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:55.517387 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-40217e68-d8b7-4348-9d55-bd215518466d tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] HTTP exception thrown: Instance e640bc92-0f42-4b0c-b725-9f8d9955e599 could not be found. Sep 07 12:30:55.522067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-40217e68-d8b7-4348-9d55-bd215518466d tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Request method failure captured: Sep 07 12:30:55.522067 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599 HTTP/1.1 Sep 07 12:30:55.522067 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:30:55.522067 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:30:55.522067 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:30:55.522067 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:30:55.522067 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:30:55.522067 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:30:55.522067 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:30:55.522067 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:30:55.522067 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI6x8K5t7ai3xrpQhsVR08RRGlmGiAll9tZQFEJMvvzr8gY2rlsCDQszP5JltwYFiOhkVD9twMgCBqjsiZoChFt6mwh7m5Or9md3Opv0tm2dGPcaErUfkangVvPdHojcFGsAyPR93tjvS-V8SwFEkqwLmAPDvr4HwjfR-mu3ntf-YIo Sep 07 12:30:55.522067 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:30:55.522067 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:30:55.522067 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:30:55.522067 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:30:55.522067 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:30:55.522067 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:30:55.522067 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 850b3068e7bd4e11b737c74c14f40f70 Sep 07 12:30:55.522067 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-LiveMigrationNegativeTest-1179014478 Sep 07 12:30:55.522067 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:30:55.522067 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:30:55.524895 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/850b3068e7bd4e11b737c74c14f40f70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_850b3068e7bd4e11b737c74c14f40f70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/850b3068e7bd4e11b737c74c14f40f70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/850b3068e7bd4e11b737c74c14f40f70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:30:55.524895 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-LiveMigrationNegativeTest-1179014478 Sep 07 12:30:55.524895 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 850b3068e7bd4e11b737c74c14f40f70 Sep 07 12:30:55.524895 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1179014478 Sep 07 12:30:55.524895 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-LiveMigrationNegativeTest-1179014478-project Sep 07 12:30:55.524895 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:30:55.524895 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:30:55.524895 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6f0d61feae834d42a5607d482a3a8353 Sep 07 12:30:55.524895 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-LiveMigrationNegativeTest-1179014478-project Sep 07 12:30:55.524895 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:30:55.524895 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance e640bc92-0f42-4b0c-b725-9f8d9955e599 could not be found. Sep 07 12:30:55.524895 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'e640bc92-0f42-4b0c-b725-9f8d9955e599'} Sep 07 12:30:55.526626 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:30:55.526626 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:55.526626 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:30:55.526626 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:30:55.526626 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:30:55.526626 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:30:55.526626 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:30:55.526626 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:30:55.526626 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:30:55.526626 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:30:55.526626 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e640bc92-0f42-4b0c-b725-9f8d9955e599 could not be found. Sep 07 12:30:55.526626 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:55.526626 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:55.526626 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:55.526626 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:55.526626 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:55.526626 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:55.526626 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:30:55.526626 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:30:55.526626 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:30:55.529062 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:30:55.529062 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:30:55.529062 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:30:55.529062 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:30:55.529062 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:30:55.529062 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:30:55.529062 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:30:55.529062 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e640bc92-0f42-4b0c-b725-9f8d9955e599 could not be found. Sep 07 12:30:55.529062 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:55.529062 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:30:55.529062 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:55.529062 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:30:55.529062 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:30:55.529062 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:30:55.529062 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:30:55.529062 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:30:55.529062 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e640bc92-0f42-4b0c-b725-9f8d9955e599 could not be found. Sep 07 12:30:55.529062 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:30:55.533926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-40217e68-d8b7-4348-9d55-bd215518466d tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Returning 404 to user: Instance e640bc92-0f42-4b0c-b725-9f8d9955e599 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:30:55.536414 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-40217e68-d8b7-4348-9d55-bd215518466d tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599" status: 404 len: 111 microversion: 2.1 time: 0.103360 Sep 07 12:30:55.537912 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 361/729] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:55 2022] GET /compute/v2.1/servers/e640bc92-0f42-4b0c-b725-9f8d9955e599 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:30:55.554087 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bbd33272-a7f3-481a-9b13-9ce3e9618eb6 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:55.555609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bbd33272-a7f3-481a-9b13-9ce3e9618eb6 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:55.585809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd33272-a7f3-481a-9b13-9ce3e9618eb6 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:55.586814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd33272-a7f3-481a-9b13-9ce3e9618eb6 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:55.587723 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd33272-a7f3-481a-9b13-9ce3e9618eb6 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:55.589192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd33272-a7f3-481a-9b13-9ce3e9618eb6 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:55.590187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd33272-a7f3-481a-9b13-9ce3e9618eb6 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:55.590990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd33272-a7f3-481a-9b13-9ce3e9618eb6 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:55.645446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-57b6c111-bde7-46a6-bdd5-4ba554e227fa tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:55.648476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-57b6c111-bde7-46a6-bdd5-4ba554e227fa tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:55.655593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bbd33272-a7f3-481a-9b13-9ce3e9618eb6 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:30:55.665694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57b6c111-bde7-46a6-bdd5-4ba554e227fa tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:55.667764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57b6c111-bde7-46a6-bdd5-4ba554e227fa tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:55.680980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57b6c111-bde7-46a6-bdd5-4ba554e227fa tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:55.683378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57b6c111-bde7-46a6-bdd5-4ba554e227fa tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:55.684608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57b6c111-bde7-46a6-bdd5-4ba554e227fa tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:55.685942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57b6c111-bde7-46a6-bdd5-4ba554e227fa tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:55.785184 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bbd33272-a7f3-481a-9b13-9ce3e9618eb6 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "DELETE /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657" status: 204 len: 0 microversion: 2.1 time: 0.239494 Sep 07 12:30:55.786585 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 369/730] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:30:55 2022] DELETE /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:30:55.796226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-40971296-c7c3-4fb9-87b2-d64911ac1ce7 req-e83a960f-1049-451f-ae04-9c5322b8e5e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3", "tag": "93de5379-dbd9-4a2c-ae2f-9b0113b9607c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:30:55.854675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-40971296-c7c3-4fb9-87b2-d64911ac1ce7 req-e83a960f-1049-451f-ae04-9c5322b8e5e7 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:55.857352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-40971296-c7c3-4fb9-87b2-d64911ac1ce7 req-e83a960f-1049-451f-ae04-9c5322b8e5e7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:55.859326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-40971296-c7c3-4fb9-87b2-d64911ac1ce7 req-e83a960f-1049-451f-ae04-9c5322b8e5e7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:55.888941 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-40971296-c7c3-4fb9-87b2-d64911ac1ce7 req-e83a960f-1049-451f-ae04-9c5322b8e5e7 service nova] Creating event network-changed:93de5379-dbd9-4a2c-ae2f-9b0113b9607c for instance 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 on n-h1-852087-9 Sep 07 12:30:55.912378 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-40971296-c7c3-4fb9-87b2-d64911ac1ce7 req-e83a960f-1049-451f-ae04-9c5322b8e5e7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123977 Sep 07 12:30:55.920334 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 370/731] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:30:55.935688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ef07f0f-c557-4652-8937-3bd0c167dd78 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:55.936438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5ef07f0f-c557-4652-8937-3bd0c167dd78 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:55.953039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ef07f0f-c557-4652-8937-3bd0c167dd78 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:55.956870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ef07f0f-c557-4652-8937-3bd0c167dd78 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:55.957318 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ef07f0f-c557-4652-8937-3bd0c167dd78 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:55.958151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ef07f0f-c557-4652-8937-3bd0c167dd78 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:55.958728 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ef07f0f-c557-4652-8937-3bd0c167dd78 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:55.959183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ef07f0f-c557-4652-8937-3bd0c167dd78 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:56.000041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:30:56.046871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-57b6c111-bde7-46a6-bdd5-4ba554e227fa tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:56.060060 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-57b6c111-bde7-46a6-bdd5-4ba554e227fa tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9" status: 200 len: 1365 microversion: 2.1 time: 0.422223 Sep 07 12:30:56.060708 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 362/732] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:55 2022] GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9 => generated 1365 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:56.070674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b32d8b47-358d-44ff-8421-6cf7a276db3e tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:56.078976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b32d8b47-358d-44ff-8421-6cf7a276db3e tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:56.094496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b32d8b47-358d-44ff-8421-6cf7a276db3e tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:56.095376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b32d8b47-358d-44ff-8421-6cf7a276db3e tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:56.096345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b32d8b47-358d-44ff-8421-6cf7a276db3e tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:56.097148 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b32d8b47-358d-44ff-8421-6cf7a276db3e tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:56.097674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b32d8b47-358d-44ff-8421-6cf7a276db3e tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:56.098108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b32d8b47-358d-44ff-8421-6cf7a276db3e tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:56.241143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-b32d8b47-358d-44ff-8421-6cf7a276db3e tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lazy-loading 'services' on Instance uuid 7e48b0d0-a574-476c-8054-97b544b3d24f {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:30:56.283349 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b32d8b47-358d-44ff-8421-6cf7a276db3e tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1929 microversion: 2.75 time: 0.219928 Sep 07 12:30:56.284001 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 363/733] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:56 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1929 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:30:56.302674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8313ccaf-1321-48fe-8ac2-7074d5e123f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:56.303638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8313ccaf-1321-48fe-8ac2-7074d5e123f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:56.326077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8313ccaf-1321-48fe-8ac2-7074d5e123f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:56.326871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8313ccaf-1321-48fe-8ac2-7074d5e123f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:56.327521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8313ccaf-1321-48fe-8ac2-7074d5e123f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:56.328774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8313ccaf-1321-48fe-8ac2-7074d5e123f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:56.329443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8313ccaf-1321-48fe-8ac2-7074d5e123f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:56.329936 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8313ccaf-1321-48fe-8ac2-7074d5e123f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:56.567284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5ef07f0f-c557-4652-8937-3bd0c167dd78 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:56.591948 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5ef07f0f-c557-4652-8937-3bd0c167dd78 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657" status: 200 len: 1474 microversion: 2.1 time: 0.669895 Sep 07 12:30:56.595171 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 371/734] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:55 2022] GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 => generated 1474 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:56.606894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-62c14d18-f80f-47ba-9b21-b30faaeda147 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:56.608260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-62c14d18-f80f-47ba-9b21-b30faaeda147 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:56.624255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62c14d18-f80f-47ba-9b21-b30faaeda147 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:56.625396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62c14d18-f80f-47ba-9b21-b30faaeda147 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:56.626245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62c14d18-f80f-47ba-9b21-b30faaeda147 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:56.628405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62c14d18-f80f-47ba-9b21-b30faaeda147 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:56.631058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62c14d18-f80f-47ba-9b21-b30faaeda147 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:56.631058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62c14d18-f80f-47ba-9b21-b30faaeda147 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:56.670853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:30:56.695695 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=12 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:30:57.008501 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8313ccaf-1321-48fe-8ac2-7074d5e123f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:57.030162 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8313ccaf-1321-48fe-8ac2-7074d5e123f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1359 microversion: 2.1 time: 0.744701 Sep 07 12:30:57.038448 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 364/735] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:56 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1359 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:57.107343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6b563f70-1c9b-4a68-98f2-6e7a91adb0d9 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:57.108773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6b563f70-1c9b-4a68-98f2-6e7a91adb0d9 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:57.143633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b563f70-1c9b-4a68-98f2-6e7a91adb0d9 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:57.144145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b563f70-1c9b-4a68-98f2-6e7a91adb0d9 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:57.144620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b563f70-1c9b-4a68-98f2-6e7a91adb0d9 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:57.145366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b563f70-1c9b-4a68-98f2-6e7a91adb0d9 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:57.145889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b563f70-1c9b-4a68-98f2-6e7a91adb0d9 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:57.146362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b563f70-1c9b-4a68-98f2-6e7a91adb0d9 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:57.149533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:30:57.253678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-62c14d18-f80f-47ba-9b21-b30faaeda147 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:57.269213 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-62c14d18-f80f-47ba-9b21-b30faaeda147 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1477 microversion: 2.1 time: 0.672115 Sep 07 12:30:57.305777 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 372/736] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:56 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1477 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:57.336590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-34451ed7-7bf6-43be-85ff-98d7febe1524 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:57.337884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-34451ed7-7bf6-43be-85ff-98d7febe1524 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:57.353382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34451ed7-7bf6-43be-85ff-98d7febe1524 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:57.356440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34451ed7-7bf6-43be-85ff-98d7febe1524 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:57.358025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34451ed7-7bf6-43be-85ff-98d7febe1524 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:57.359448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34451ed7-7bf6-43be-85ff-98d7febe1524 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:57.361110 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34451ed7-7bf6-43be-85ff-98d7febe1524 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:57.363058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34451ed7-7bf6-43be-85ff-98d7febe1524 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:57.509414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6b563f70-1c9b-4a68-98f2-6e7a91adb0d9 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:57.528987 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6b563f70-1c9b-4a68-98f2-6e7a91adb0d9 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9" status: 200 len: 1365 microversion: 2.1 time: 0.428849 Sep 07 12:30:57.534193 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 365/737] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:57 2022] GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9 => generated 1365 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:57.573524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-34451ed7-7bf6-43be-85ff-98d7febe1524 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lazy-loading 'services' on Instance uuid 7e48b0d0-a574-476c-8054-97b544b3d24f {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:30:57.610011 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-34451ed7-7bf6-43be-85ff-98d7febe1524 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1929 microversion: 2.75 time: 0.277734 Sep 07 12:30:57.611387 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 373/738] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:57 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1929 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:30:57.645374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-34f0cc1a-ffc3-48a8-af70-e230463f4b23 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:57.649019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-34f0cc1a-ffc3-48a8-af70-e230463f4b23 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:57.666052 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34f0cc1a-ffc3-48a8-af70-e230463f4b23 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:57.667331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34f0cc1a-ffc3-48a8-af70-e230463f4b23 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:57.668727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34f0cc1a-ffc3-48a8-af70-e230463f4b23 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:57.671691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34f0cc1a-ffc3-48a8-af70-e230463f4b23 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:57.672801 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34f0cc1a-ffc3-48a8-af70-e230463f4b23 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:57.673809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34f0cc1a-ffc3-48a8-af70-e230463f4b23 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:58.009721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-34f0cc1a-ffc3-48a8-af70-e230463f4b23 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:58.037304 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-34f0cc1a-ffc3-48a8-af70-e230463f4b23 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657" status: 200 len: 1474 microversion: 2.1 time: 0.401164 Sep 07 12:30:58.053655 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 366/739] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:57 2022] GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 => generated 1474 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:58.096437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f0f92856-2611-4e07-855a-045bd96f95c6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:58.097583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f0f92856-2611-4e07-855a-045bd96f95c6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:58.115220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0f92856-2611-4e07-855a-045bd96f95c6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:58.121846 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0f92856-2611-4e07-855a-045bd96f95c6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:58.122936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0f92856-2611-4e07-855a-045bd96f95c6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:58.128271 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0f92856-2611-4e07-855a-045bd96f95c6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:58.129555 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0f92856-2611-4e07-855a-045bd96f95c6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:58.132245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0f92856-2611-4e07-855a-045bd96f95c6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:58.314454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bd1e1344-b4a9-42c1-9a98-9be681bf8f5d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:58.322187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bd1e1344-b4a9-42c1-9a98-9be681bf8f5d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:58.338584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd1e1344-b4a9-42c1-9a98-9be681bf8f5d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:58.343525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd1e1344-b4a9-42c1-9a98-9be681bf8f5d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:58.344912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd1e1344-b4a9-42c1-9a98-9be681bf8f5d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:58.348796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd1e1344-b4a9-42c1-9a98-9be681bf8f5d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:58.352277 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd1e1344-b4a9-42c1-9a98-9be681bf8f5d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:58.358909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd1e1344-b4a9-42c1-9a98-9be681bf8f5d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:59.023979 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f0f92856-2611-4e07-855a-045bd96f95c6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:59.045799 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f0f92856-2611-4e07-855a-045bd96f95c6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1359 microversion: 2.1 time: 0.959956 Sep 07 12:30:59.052857 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 374/740] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:58 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1359 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:30:59.060865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bd1e1344-b4a9-42c1-9a98-9be681bf8f5d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:59.069571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2c19de18-ede4-4947-abbb-bcd516a61d65 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:59.070494 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2c19de18-ede4-4947-abbb-bcd516a61d65 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:59.111848 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bd1e1344-b4a9-42c1-9a98-9be681bf8f5d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1477 microversion: 2.1 time: 0.815050 Sep 07 12:30:59.115710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c19de18-ede4-4947-abbb-bcd516a61d65 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:59.116268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c19de18-ede4-4947-abbb-bcd516a61d65 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:59.116722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c19de18-ede4-4947-abbb-bcd516a61d65 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:59.118102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c19de18-ede4-4947-abbb-bcd516a61d65 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:59.118594 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c19de18-ede4-4947-abbb-bcd516a61d65 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:59.119037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c19de18-ede4-4947-abbb-bcd516a61d65 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:59.123359 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 367/741] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:58 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1477 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:59.162159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e7d95b5f-05da-495f-adcf-30814692747c tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:59.163628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e7d95b5f-05da-495f-adcf-30814692747c tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:59.201426 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7d95b5f-05da-495f-adcf-30814692747c tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:59.202503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7d95b5f-05da-495f-adcf-30814692747c tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:59.203684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7d95b5f-05da-495f-adcf-30814692747c tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:59.205728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7d95b5f-05da-495f-adcf-30814692747c tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:59.222026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7d95b5f-05da-495f-adcf-30814692747c tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:59.232121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7d95b5f-05da-495f-adcf-30814692747c tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:59.475700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2c19de18-ede4-4947-abbb-bcd516a61d65 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:59.489824 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2c19de18-ede4-4947-abbb-bcd516a61d65 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9" status: 200 len: 1365 microversion: 2.1 time: 0.433571 Sep 07 12:30:59.490794 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 375/742] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:59 2022] GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9 => generated 1365 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:30:59.502522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9ae61940-4d1c-4483-8d0b-af1e2fda14ba tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:30:59.503316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9ae61940-4d1c-4483-8d0b-af1e2fda14ba tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:30:59.522005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ae61940-4d1c-4483-8d0b-af1e2fda14ba tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:59.522818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ae61940-4d1c-4483-8d0b-af1e2fda14ba tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:59.523524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ae61940-4d1c-4483-8d0b-af1e2fda14ba tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:59.524532 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ae61940-4d1c-4483-8d0b-af1e2fda14ba tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:30:59.529741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ae61940-4d1c-4483-8d0b-af1e2fda14ba tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:30:59.530473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ae61940-4d1c-4483-8d0b-af1e2fda14ba tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:30:59.607441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-e7d95b5f-05da-495f-adcf-30814692747c tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lazy-loading 'services' on Instance uuid 7e48b0d0-a574-476c-8054-97b544b3d24f {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:30:59.679411 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e7d95b5f-05da-495f-adcf-30814692747c tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1929 microversion: 2.75 time: 0.549055 Sep 07 12:30:59.684101 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 368/743] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:30:59 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1929 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:30:59.770893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9ae61940-4d1c-4483-8d0b-af1e2fda14ba tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:30:59.798293 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9ae61940-4d1c-4483-8d0b-af1e2fda14ba tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657" status: 200 len: 1474 microversion: 2.1 time: 0.305665 Sep 07 12:30:59.815142 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 376/744] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:30:59 2022] GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 => generated 1474 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:00.106334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d2cc0518-3c7c-4d36-a1be-769ecbec1b9e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:00.107946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d2cc0518-3c7c-4d36-a1be-769ecbec1b9e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:00.117717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2cc0518-3c7c-4d36-a1be-769ecbec1b9e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:00.118676 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2cc0518-3c7c-4d36-a1be-769ecbec1b9e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:00.119435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2cc0518-3c7c-4d36-a1be-769ecbec1b9e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:00.121040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2cc0518-3c7c-4d36-a1be-769ecbec1b9e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:00.121841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2cc0518-3c7c-4d36-a1be-769ecbec1b9e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:00.123589 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2cc0518-3c7c-4d36-a1be-769ecbec1b9e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:00.154915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b7b38346-ef46-49bd-b8eb-c5c56b573c95 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:00.158088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b7b38346-ef46-49bd-b8eb-c5c56b573c95 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:00.174399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7b38346-ef46-49bd-b8eb-c5c56b573c95 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:00.175765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7b38346-ef46-49bd-b8eb-c5c56b573c95 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:00.176003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7b38346-ef46-49bd-b8eb-c5c56b573c95 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:00.177176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7b38346-ef46-49bd-b8eb-c5c56b573c95 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:00.178025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7b38346-ef46-49bd-b8eb-c5c56b573c95 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:00.178990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7b38346-ef46-49bd-b8eb-c5c56b573c95 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:00.443804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d2cc0518-3c7c-4d36-a1be-769ecbec1b9e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:00.457651 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d2cc0518-3c7c-4d36-a1be-769ecbec1b9e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1359 microversion: 2.1 time: 0.356511 Sep 07 12:31:00.459851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b7b38346-ef46-49bd-b8eb-c5c56b573c95 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:00.460179 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 369/745] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:00 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1359 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:00.484521 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b7b38346-ef46-49bd-b8eb-c5c56b573c95 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1477 microversion: 2.1 time: 0.336905 Sep 07 12:31:00.485971 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 377/746] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:00 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1477 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:00.518336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b04566b6-15e5-4edc-924e-de5212d9cd6c tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:00.519499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b04566b6-15e5-4edc-924e-de5212d9cd6c tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:00.527887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b04566b6-15e5-4edc-924e-de5212d9cd6c tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:00.528777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b04566b6-15e5-4edc-924e-de5212d9cd6c tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:00.529649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b04566b6-15e5-4edc-924e-de5212d9cd6c tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:00.531056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b04566b6-15e5-4edc-924e-de5212d9cd6c tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:00.531915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b04566b6-15e5-4edc-924e-de5212d9cd6c tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:00.532648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b04566b6-15e5-4edc-924e-de5212d9cd6c tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:00.844637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8aad2521-55aa-4e20-9c5c-172bed1fe46e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-620780716", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": "none"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:00.872079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:00.919926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b04566b6-15e5-4edc-924e-de5212d9cd6c tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:00.932459 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b04566b6-15e5-4edc-924e-de5212d9cd6c tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9" status: 200 len: 1365 microversion: 2.1 time: 0.419211 Sep 07 12:31:00.936373 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 378/747] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:00 2022] GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9 => generated 1365 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:31:00.947144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-88321643-bdb6-48ee-ab5b-d224b3b157de req-ab819f85-a9a4-4149-a553-b26808deea8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657", "name": "network-vif-deleted", "tag": "bec29315-bf97-4789-9f2c-6e8ebb4250a5"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:00.965621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-88321643-bdb6-48ee-ab5b-d224b3b157de req-ab819f85-a9a4-4149-a553-b26808deea8d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:00.968111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-88321643-bdb6-48ee-ab5b-d224b3b157de req-ab819f85-a9a4-4149-a553-b26808deea8d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:00.968809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-88321643-bdb6-48ee-ab5b-d224b3b157de req-ab819f85-a9a4-4149-a553-b26808deea8d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:00.993695 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-88321643-bdb6-48ee-ab5b-d224b3b157de req-ab819f85-a9a4-4149-a553-b26808deea8d service nova] Creating event network-vif-deleted:bec29315-bf97-4789-9f2c-6e8ebb4250a5 for instance 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 on n-h1-852087-9 Sep 07 12:31:00.999680 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-88321643-bdb6-48ee-ab5b-d224b3b157de req-ab819f85-a9a4-4149-a553-b26808deea8d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061474 Sep 07 12:31:01.000261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8aad2521-55aa-4e20-9c5c-172bed1fe46e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:31:01.000953 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 379/748] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:31:01.006972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8aad2521-55aa-4e20-9c5c-172bed1fe46e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:31:01.007950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1f573daf-620b-49f1-81fb-34cd0682861f tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:01.008669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1f573daf-620b-49f1-81fb-34cd0682861f tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:01.013957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8aad2521-55aa-4e20-9c5c-172bed1fe46e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:31:01.015765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8aad2521-55aa-4e20-9c5c-172bed1fe46e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:31:01.022449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f573daf-620b-49f1-81fb-34cd0682861f tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:01.023417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f573daf-620b-49f1-81fb-34cd0682861f tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:01.024030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f573daf-620b-49f1-81fb-34cd0682861f tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:01.025019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f573daf-620b-49f1-81fb-34cd0682861f tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:01.025538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8aad2521-55aa-4e20-9c5c-172bed1fe46e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:31:01.025879 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f573daf-620b-49f1-81fb-34cd0682861f tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:01.026566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f573daf-620b-49f1-81fb-34cd0682861f tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:01.058584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8aad2521-55aa-4e20-9c5c-172bed1fe46e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:01.065123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8aad2521-55aa-4e20-9c5c-172bed1fe46e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:01.066319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8aad2521-55aa-4e20-9c5c-172bed1fe46e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:01.068615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8aad2521-55aa-4e20-9c5c-172bed1fe46e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:01.069735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8aad2521-55aa-4e20-9c5c-172bed1fe46e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:01.070728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8aad2521-55aa-4e20-9c5c-172bed1fe46e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:01.126248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-8aad2521-55aa-4e20-9c5c-172bed1fe46e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Getting quotas for project 90a410106c7d4a1883dc5b812abe8c9b. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:31:01.137382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-8aad2521-55aa-4e20-9c5c-172bed1fe46e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Getting quotas for user 5e1c5da4dd85442e985ace34b5b625fd and project 90a410106c7d4a1883dc5b812abe8c9b. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:31:01.164276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8aad2521-55aa-4e20-9c5c-172bed1fe46e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:31:01.173739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8aad2521-55aa-4e20-9c5c-172bed1fe46e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:31:01.296005 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8aad2521-55aa-4e20-9c5c-172bed1fe46e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.834922 Sep 07 12:31:01.297164 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 370/749] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Sep 7 12:31:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 12:31:01.321764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9e536071-603e-4b07-afbc-d41f7a3ec829 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:01.331228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9e536071-603e-4b07-afbc-d41f7a3ec829 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:01.345813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e536071-603e-4b07-afbc-d41f7a3ec829 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:01.346715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e536071-603e-4b07-afbc-d41f7a3ec829 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:01.347519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e536071-603e-4b07-afbc-d41f7a3ec829 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:01.348825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e536071-603e-4b07-afbc-d41f7a3ec829 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:01.349728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e536071-603e-4b07-afbc-d41f7a3ec829 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:01.350522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e536071-603e-4b07-afbc-d41f7a3ec829 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:01.676511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-1f573daf-620b-49f1-81fb-34cd0682861f tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lazy-loading 'services' on Instance uuid 7e48b0d0-a574-476c-8054-97b544b3d24f {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:31:01.744868 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1f573daf-620b-49f1-81fb-34cd0682861f tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1929 microversion: 2.75 time: 0.742161 Sep 07 12:31:01.765518 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 380/750] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:01 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1929 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:01.775163 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9b4f15d4-c4cd-4cc2-819c-794509ebc178 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:01.776617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9b4f15d4-c4cd-4cc2-819c-794509ebc178 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:01.795953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9e536071-603e-4b07-afbc-d41f7a3ec829 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:01.823816 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9e536071-603e-4b07-afbc-d41f7a3ec829 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657" status: 200 len: 1432 microversion: 2.1 time: 0.523381 Sep 07 12:31:01.828587 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 371/751] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:01 2022] GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 => generated 1432 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:01.879259 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f06570e4-c675-48da-a255-b39fbc004a10 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:01.880373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f06570e4-c675-48da-a255-b39fbc004a10 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:01.932193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f06570e4-c675-48da-a255-b39fbc004a10 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:01.935199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f06570e4-c675-48da-a255-b39fbc004a10 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:01.937157 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f06570e4-c675-48da-a255-b39fbc004a10 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:01.945397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f06570e4-c675-48da-a255-b39fbc004a10 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:01.946753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f06570e4-c675-48da-a255-b39fbc004a10 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:01.952418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f06570e4-c675-48da-a255-b39fbc004a10 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:02.088298 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9b4f15d4-c4cd-4cc2-819c-794509ebc178 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:02.137719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9b4f15d4-c4cd-4cc2-819c-794509ebc178 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:02.146457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9b4f15d4-c4cd-4cc2-819c-794509ebc178 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:02.235189 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9b4f15d4-c4cd-4cc2-819c-794509ebc178 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1452 microversion: 2.91 time: 0.479910 Sep 07 12:31:02.247806 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 381/752] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:01 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1452 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:02.283999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a9b6857c-0c77-4eda-b423-adb5e5731e15 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:02.301965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a9b6857c-0c77-4eda-b423-adb5e5731e15 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:02.349978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9b6857c-0c77-4eda-b423-adb5e5731e15 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:02.369289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9b6857c-0c77-4eda-b423-adb5e5731e15 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:02.370801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9b6857c-0c77-4eda-b423-adb5e5731e15 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:02.384824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9b6857c-0c77-4eda-b423-adb5e5731e15 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:02.397631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9b6857c-0c77-4eda-b423-adb5e5731e15 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:02.398684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9b6857c-0c77-4eda-b423-adb5e5731e15 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:03.116291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a9b6857c-0c77-4eda-b423-adb5e5731e15 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:03.132753 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a9b6857c-0c77-4eda-b423-adb5e5731e15 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1477 microversion: 2.1 time: 0.883182 Sep 07 12:31:03.134052 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 382/753] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:02 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1477 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:03.144766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f06570e4-c675-48da-a255-b39fbc004a10 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:03.153008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5befd1bd-eed9-45fb-b799-69311f329544 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:03.154587 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5befd1bd-eed9-45fb-b799-69311f329544 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:03.165266 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f06570e4-c675-48da-a255-b39fbc004a10 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1359 microversion: 2.1 time: 1.331963 Sep 07 12:31:03.171085 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 372/754] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:01 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1359 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:03.173805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5befd1bd-eed9-45fb-b799-69311f329544 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:03.178111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-70c11167-6a9f-4ea0-b82b-1ae243bbb4d4 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:03.179197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5befd1bd-eed9-45fb-b799-69311f329544 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:03.179893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5befd1bd-eed9-45fb-b799-69311f329544 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:03.180884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5befd1bd-eed9-45fb-b799-69311f329544 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:03.181636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5befd1bd-eed9-45fb-b799-69311f329544 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:03.182316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5befd1bd-eed9-45fb-b799-69311f329544 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:03.187957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-70c11167-6a9f-4ea0-b82b-1ae243bbb4d4 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:03.195643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70c11167-6a9f-4ea0-b82b-1ae243bbb4d4 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:03.202033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70c11167-6a9f-4ea0-b82b-1ae243bbb4d4 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:03.203265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70c11167-6a9f-4ea0-b82b-1ae243bbb4d4 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:03.204276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70c11167-6a9f-4ea0-b82b-1ae243bbb4d4 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:03.210435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70c11167-6a9f-4ea0-b82b-1ae243bbb4d4 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:03.211299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70c11167-6a9f-4ea0-b82b-1ae243bbb4d4 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:03.400659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-70c11167-6a9f-4ea0-b82b-1ae243bbb4d4 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lazy-loading 'services' on Instance uuid 7e48b0d0-a574-476c-8054-97b544b3d24f {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:31:03.458047 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-70c11167-6a9f-4ea0-b82b-1ae243bbb4d4 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1929 microversion: 2.75 time: 0.283634 Sep 07 12:31:03.459179 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 373/755] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:03 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1929 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:03.465472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c3e31709-0361-4080-88c0-69b436c56eff tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:03.466164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c3e31709-0361-4080-88c0-69b436c56eff tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:03.474774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3e31709-0361-4080-88c0-69b436c56eff tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:03.475281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3e31709-0361-4080-88c0-69b436c56eff tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:03.476700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3e31709-0361-4080-88c0-69b436c56eff tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:03.477892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3e31709-0361-4080-88c0-69b436c56eff tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:03.478905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3e31709-0361-4080-88c0-69b436c56eff tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:03.479503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3e31709-0361-4080-88c0-69b436c56eff tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:03.526566 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3e31709-0361-4080-88c0-69b436c56eff tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:03.527464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3e31709-0361-4080-88c0-69b436c56eff tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:03.528310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3e31709-0361-4080-88c0-69b436c56eff tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:03.529023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-c3e31709-0361-4080-88c0-69b436c56eff tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lazy-loading 'fault' on Instance uuid 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:31:03.557314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5befd1bd-eed9-45fb-b799-69311f329544 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:03.600035 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5befd1bd-eed9-45fb-b799-69311f329544 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9" status: 200 len: 1365 microversion: 2.1 time: 0.459091 Sep 07 12:31:03.600815 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 383/756] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:03 2022] GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9 => generated 1365 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:03.612253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c3e31709-0361-4080-88c0-69b436c56eff tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:03.626471 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c3e31709-0361-4080-88c0-69b436c56eff tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657" status: 200 len: 1308 microversion: 2.1 time: 0.165975 Sep 07 12:31:03.627416 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 374/757] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:03 2022] GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 => generated 1308 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:03.636376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e92ce454-bdfb-4d5e-a305-429546df8d8f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:03.637526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e92ce454-bdfb-4d5e-a305-429546df8d8f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:03.648792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e92ce454-bdfb-4d5e-a305-429546df8d8f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:03.649841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e92ce454-bdfb-4d5e-a305-429546df8d8f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:03.650558 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e92ce454-bdfb-4d5e-a305-429546df8d8f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:03.652524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e92ce454-bdfb-4d5e-a305-429546df8d8f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:03.653888 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e92ce454-bdfb-4d5e-a305-429546df8d8f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:03.655107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e92ce454-bdfb-4d5e-a305-429546df8d8f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:03.656800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-5ed071e1-b7bd-4dcc-b598-eb1a2e71d083 req-af71e6b0-f20e-46ce-bbe0-2cb7abb5b46d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8042e17-76ed-448e-bca1-331aa1f708c9", "name": "network-vif-plugged", "status": "completed", "tag": "46a7707b-e590-4c61-a29f-5120d570e51b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:03.693250 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5ed071e1-b7bd-4dcc-b598-eb1a2e71d083 req-af71e6b0-f20e-46ce-bbe0-2cb7abb5b46d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:03.694547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5ed071e1-b7bd-4dcc-b598-eb1a2e71d083 req-af71e6b0-f20e-46ce-bbe0-2cb7abb5b46d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:03.696228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5ed071e1-b7bd-4dcc-b598-eb1a2e71d083 req-af71e6b0-f20e-46ce-bbe0-2cb7abb5b46d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:03.756212 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-5ed071e1-b7bd-4dcc-b598-eb1a2e71d083 req-af71e6b0-f20e-46ce-bbe0-2cb7abb5b46d service nova] Creating event network-vif-plugged:46a7707b-e590-4c61-a29f-5120d570e51b for instance d8042e17-76ed-448e-bca1-331aa1f708c9 on n-h1-852087-9 Sep 07 12:31:03.782984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e92ce454-bdfb-4d5e-a305-429546df8d8f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:03.791554 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-5ed071e1-b7bd-4dcc-b598-eb1a2e71d083 req-af71e6b0-f20e-46ce-bbe0-2cb7abb5b46d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164019 Sep 07 12:31:03.795128 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 384/758] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:31:03.796295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e92ce454-bdfb-4d5e-a305-429546df8d8f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:03.798221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e92ce454-bdfb-4d5e-a305-429546df8d8f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:03.811676 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e92ce454-bdfb-4d5e-a305-429546df8d8f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1456 microversion: 2.91 time: 0.180360 Sep 07 12:31:03.812768 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 375/759] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:03 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1456 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:04.178663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-735f8933-4679-47c0-ae60-494b46f736b4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:04.179928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-735f8933-4679-47c0-ae60-494b46f736b4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:04.231996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b07c3bc1-1bde-4dc5-a8e0-662598e33794 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:04.233208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b07c3bc1-1bde-4dc5-a8e0-662598e33794 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:04.235618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-735f8933-4679-47c0-ae60-494b46f736b4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:04.236747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-735f8933-4679-47c0-ae60-494b46f736b4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:04.242978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-735f8933-4679-47c0-ae60-494b46f736b4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:04.250395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-735f8933-4679-47c0-ae60-494b46f736b4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:04.256863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-735f8933-4679-47c0-ae60-494b46f736b4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:04.257959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-735f8933-4679-47c0-ae60-494b46f736b4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:04.277309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b07c3bc1-1bde-4dc5-a8e0-662598e33794 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:04.278666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b07c3bc1-1bde-4dc5-a8e0-662598e33794 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:04.279544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b07c3bc1-1bde-4dc5-a8e0-662598e33794 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:04.281445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b07c3bc1-1bde-4dc5-a8e0-662598e33794 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:04.286092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b07c3bc1-1bde-4dc5-a8e0-662598e33794 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:04.287503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b07c3bc1-1bde-4dc5-a8e0-662598e33794 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:04.741983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-735f8933-4679-47c0-ae60-494b46f736b4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:04.780298 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-735f8933-4679-47c0-ae60-494b46f736b4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1477 microversion: 2.1 time: 0.608675 Sep 07 12:31:04.785363 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 385/760] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:04 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1477 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:04.818904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b07c3bc1-1bde-4dc5-a8e0-662598e33794 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:04.822463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a5abe89f-6757-4d6c-8362-e2e644cd1126 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:04.823146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a5abe89f-6757-4d6c-8362-e2e644cd1126 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:04.840009 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b07c3bc1-1bde-4dc5-a8e0-662598e33794 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1359 microversion: 2.1 time: 0.622170 Sep 07 12:31:04.841436 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 376/761] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:04 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1359 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:04.850164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2fd3783f-cb38-4fda-a033-531f5a9a56e3 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:04.851475 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2fd3783f-cb38-4fda-a033-531f5a9a56e3 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:04.865776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5abe89f-6757-4d6c-8362-e2e644cd1126 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:04.866663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5abe89f-6757-4d6c-8362-e2e644cd1126 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:04.867380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5abe89f-6757-4d6c-8362-e2e644cd1126 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:04.868406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5abe89f-6757-4d6c-8362-e2e644cd1126 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:04.869113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5abe89f-6757-4d6c-8362-e2e644cd1126 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:04.872892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5abe89f-6757-4d6c-8362-e2e644cd1126 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:04.886420 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fd3783f-cb38-4fda-a033-531f5a9a56e3 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:04.888143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fd3783f-cb38-4fda-a033-531f5a9a56e3 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:04.889238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fd3783f-cb38-4fda-a033-531f5a9a56e3 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:04.890859 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fd3783f-cb38-4fda-a033-531f5a9a56e3 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:04.891950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fd3783f-cb38-4fda-a033-531f5a9a56e3 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:04.894125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fd3783f-cb38-4fda-a033-531f5a9a56e3 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:04.986416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-a5abe89f-6757-4d6c-8362-e2e644cd1126 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lazy-loading 'services' on Instance uuid 7e48b0d0-a574-476c-8054-97b544b3d24f {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:31:05.014945 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a5abe89f-6757-4d6c-8362-e2e644cd1126 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1929 microversion: 2.75 time: 0.227193 Sep 07 12:31:05.030581 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 386/762] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:04 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1929 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:05.036119 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-69928f91-70d9-4359-8c82-923d71a524fe tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:05.036790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-69928f91-70d9-4359-8c82-923d71a524fe tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:05.064498 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69928f91-70d9-4359-8c82-923d71a524fe tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:05.065120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69928f91-70d9-4359-8c82-923d71a524fe tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:05.065684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69928f91-70d9-4359-8c82-923d71a524fe tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:05.067957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69928f91-70d9-4359-8c82-923d71a524fe tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:05.068537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69928f91-70d9-4359-8c82-923d71a524fe tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:05.068985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69928f91-70d9-4359-8c82-923d71a524fe tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:05.140221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69928f91-70d9-4359-8c82-923d71a524fe tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:05.141151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69928f91-70d9-4359-8c82-923d71a524fe tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:05.141853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69928f91-70d9-4359-8c82-923d71a524fe tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:05.143787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-69928f91-70d9-4359-8c82-923d71a524fe tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lazy-loading 'fault' on Instance uuid 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:31:05.243191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-69928f91-70d9-4359-8c82-923d71a524fe tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0d61feae834d42a5607d482a3a8353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850b3068e7bd4e11b737c74c14f40f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:05.255340 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-69928f91-70d9-4359-8c82-923d71a524fe tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657" status: 200 len: 1308 microversion: 2.1 time: 0.222257 Sep 07 12:31:05.258172 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 387/763] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:05 2022] GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 => generated 1308 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:05.266659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bbfae158-e439-41aa-a32a-00b0ba6e54ff tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:05.267627 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bbfae158-e439-41aa-a32a-00b0ba6e54ff tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:05.276698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbfae158-e439-41aa-a32a-00b0ba6e54ff tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:05.277635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbfae158-e439-41aa-a32a-00b0ba6e54ff tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:05.279150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbfae158-e439-41aa-a32a-00b0ba6e54ff tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:05.280274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbfae158-e439-41aa-a32a-00b0ba6e54ff tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:05.281076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbfae158-e439-41aa-a32a-00b0ba6e54ff tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:05.281771 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbfae158-e439-41aa-a32a-00b0ba6e54ff tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:05.484612 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bbfae158-e439-41aa-a32a-00b0ba6e54ff tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:05.515001 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bbfae158-e439-41aa-a32a-00b0ba6e54ff tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:05.518239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bbfae158-e439-41aa-a32a-00b0ba6e54ff tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:05.529584 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bbfae158-e439-41aa-a32a-00b0ba6e54ff tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1504 microversion: 2.91 time: 0.268463 Sep 07 12:31:05.530766 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 388/764] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:05 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1504 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:05.679833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2fd3783f-cb38-4fda-a033-531f5a9a56e3 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:05.701073 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2fd3783f-cb38-4fda-a033-531f5a9a56e3 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9" status: 200 len: 1365 microversion: 2.1 time: 0.857516 Sep 07 12:31:05.702931 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 377/765] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:04 2022] GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9 => generated 1365 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:05.829449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-83f08733-5d41-4361-95bf-eaa7cb9eb192 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:05.831437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-83f08733-5d41-4361-95bf-eaa7cb9eb192 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:05.842354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83f08733-5d41-4361-95bf-eaa7cb9eb192 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:05.844758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83f08733-5d41-4361-95bf-eaa7cb9eb192 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:05.846507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83f08733-5d41-4361-95bf-eaa7cb9eb192 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:05.848360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83f08733-5d41-4361-95bf-eaa7cb9eb192 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:05.849951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83f08733-5d41-4361-95bf-eaa7cb9eb192 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:05.850872 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83f08733-5d41-4361-95bf-eaa7cb9eb192 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:05.859914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:05.874155 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7624020a-62b5-44ff-bbb0-e1dcb791a14b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:05.875304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7624020a-62b5-44ff-bbb0-e1dcb791a14b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:05.911619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7624020a-62b5-44ff-bbb0-e1dcb791a14b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:05.917111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7624020a-62b5-44ff-bbb0-e1dcb791a14b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:05.917999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7624020a-62b5-44ff-bbb0-e1dcb791a14b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:05.919312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7624020a-62b5-44ff-bbb0-e1dcb791a14b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:05.923100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7624020a-62b5-44ff-bbb0-e1dcb791a14b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:05.924082 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7624020a-62b5-44ff-bbb0-e1dcb791a14b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:06.454326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7624020a-62b5-44ff-bbb0-e1dcb791a14b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:06.466670 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7624020a-62b5-44ff-bbb0-e1dcb791a14b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1359 microversion: 2.1 time: 0.600743 Sep 07 12:31:06.471117 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 378/766] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:05 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1359 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:06.478194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4c7a4d67-f26a-47a4-bb85-e6ed691ca905 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:06.483297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4c7a4d67-f26a-47a4-bb85-e6ed691ca905 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:06.497164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c7a4d67-f26a-47a4-bb85-e6ed691ca905 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:06.499233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c7a4d67-f26a-47a4-bb85-e6ed691ca905 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:06.500189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c7a4d67-f26a-47a4-bb85-e6ed691ca905 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:06.501669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c7a4d67-f26a-47a4-bb85-e6ed691ca905 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:06.504529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c7a4d67-f26a-47a4-bb85-e6ed691ca905 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:06.505328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c7a4d67-f26a-47a4-bb85-e6ed691ca905 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:06.510568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-83f08733-5d41-4361-95bf-eaa7cb9eb192 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:06.520385 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-83f08733-5d41-4361-95bf-eaa7cb9eb192 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1477 microversion: 2.1 time: 0.698570 Sep 07 12:31:06.521535 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 389/767] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:05 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1477 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:06.529988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bcb5e75d-3ea5-4ab7-8b36-3aac7bdf78a7 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:06.535022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bcb5e75d-3ea5-4ab7-8b36-3aac7bdf78a7 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] [instance: 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:06.567633 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcb5e75d-3ea5-4ab7-8b36-3aac7bdf78a7 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:06.568934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcb5e75d-3ea5-4ab7-8b36-3aac7bdf78a7 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:06.576191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcb5e75d-3ea5-4ab7-8b36-3aac7bdf78a7 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:06.578255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcb5e75d-3ea5-4ab7-8b36-3aac7bdf78a7 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:06.582978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcb5e75d-3ea5-4ab7-8b36-3aac7bdf78a7 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:06.585964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcb5e75d-3ea5-4ab7-8b36-3aac7bdf78a7 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:06.615474 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-bcb5e75d-3ea5-4ab7-8b36-3aac7bdf78a7 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] HTTP exception thrown: Instance 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 could not be found. Sep 07 12:31:06.617604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bcb5e75d-3ea5-4ab7-8b36-3aac7bdf78a7 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Request method failure captured: Sep 07 12:31:06.617604 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 HTTP/1.1 Sep 07 12:31:06.617604 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:31:06.617604 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:31:06.617604 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:31:06.617604 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:31:06.617604 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:31:06.617604 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:31:06.617604 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:31:06.617604 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:31:06.617604 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI6x8K5t7ai3xrpQhsVR08RRGlmGiAll9tZQFEJMvvzr8gY2rlsCDQszP5JltwYFiOhkVD9twMgCBqjsiZoChFt6mwh7m5Or9md3Opv0tm2dGPcaErUfkangVvPdHojcFGsAyPR93tjvS-V8SwFEkqwLmAPDvr4HwjfR-mu3ntf-YIo Sep 07 12:31:06.617604 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:31:06.617604 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:31:06.617604 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:31:06.617604 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:31:06.617604 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:31:06.617604 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:31:06.617604 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 850b3068e7bd4e11b737c74c14f40f70 Sep 07 12:31:06.617604 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-LiveMigrationNegativeTest-1179014478 Sep 07 12:31:06.617604 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:31:06.617604 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:31:06.619016 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/850b3068e7bd4e11b737c74c14f40f70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_850b3068e7bd4e11b737c74c14f40f70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/850b3068e7bd4e11b737c74c14f40f70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/850b3068e7bd4e11b737c74c14f40f70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:31:06.619016 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-LiveMigrationNegativeTest-1179014478 Sep 07 12:31:06.619016 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 850b3068e7bd4e11b737c74c14f40f70 Sep 07 12:31:06.619016 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1179014478 Sep 07 12:31:06.619016 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-LiveMigrationNegativeTest-1179014478-project Sep 07 12:31:06.619016 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:31:06.619016 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:31:06.619016 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6f0d61feae834d42a5607d482a3a8353 Sep 07 12:31:06.619016 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-LiveMigrationNegativeTest-1179014478-project Sep 07 12:31:06.619016 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:31:06.619016 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 could not be found. Sep 07 12:31:06.619016 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657'} Sep 07 12:31:06.619746 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:31:06.619746 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:31:06.619746 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:31:06.619746 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:31:06.619746 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:31:06.619746 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:31:06.619746 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:31:06.619746 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:31:06.619746 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:31:06.619746 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:31:06.619746 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 could not be found. Sep 07 12:31:06.619746 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:31:06.619746 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:31:06.619746 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:31:06.619746 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:31:06.619746 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:31:06.619746 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:31:06.619746 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:31:06.619746 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:31:06.619746 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:31:06.620952 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:31:06.620952 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:31:06.620952 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:31:06.620952 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:31:06.620952 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:31:06.620952 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:31:06.620952 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:31:06.620952 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 could not be found. Sep 07 12:31:06.620952 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:31:06.620952 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:31:06.620952 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:31:06.620952 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:31:06.620952 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:31:06.620952 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:31:06.620952 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:31:06.620952 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:31:06.620952 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 could not be found. Sep 07 12:31:06.620952 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:31:06.623048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bcb5e75d-3ea5-4ab7-8b36-3aac7bdf78a7 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] Returning 404 to user: Instance 71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:31:06.624572 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bcb5e75d-3ea5-4ab7-8b36-3aac7bdf78a7 tempest-LiveMigrationNegativeTest-1179014478 tempest-LiveMigrationNegativeTest-1179014478-project] 10.222.0.16 "GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657" status: 404 len: 111 microversion: 2.1 time: 0.101792 Sep 07 12:31:06.625387 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 390/768] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:06 2022] GET /compute/v2.1/servers/71ef6aa4-07b3-4ffd-a0af-9bd8f0d57657 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:31:06.649665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-19c2bb4a-0602-4aed-83f5-78175d4f26e6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:06.650305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-19c2bb4a-0602-4aed-83f5-78175d4f26e6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:06.668653 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19c2bb4a-0602-4aed-83f5-78175d4f26e6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:06.669169 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19c2bb4a-0602-4aed-83f5-78175d4f26e6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:06.669641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19c2bb4a-0602-4aed-83f5-78175d4f26e6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:06.670380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19c2bb4a-0602-4aed-83f5-78175d4f26e6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:06.670848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19c2bb4a-0602-4aed-83f5-78175d4f26e6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:06.671278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19c2bb4a-0602-4aed-83f5-78175d4f26e6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:06.711908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-4c7a4d67-f26a-47a4-bb85-e6ed691ca905 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lazy-loading 'services' on Instance uuid 7e48b0d0-a574-476c-8054-97b544b3d24f {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:31:06.768735 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4c7a4d67-f26a-47a4-bb85-e6ed691ca905 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1929 microversion: 2.75 time: 0.284395 Sep 07 12:31:06.771581 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 379/769] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:06 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1929 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:06.777103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bf9c0be9-b7f6-45d2-a5ab-a81b3917ea36 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:06.777771 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bf9c0be9-b7f6-45d2-a5ab-a81b3917ea36 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:06.789276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf9c0be9-b7f6-45d2-a5ab-a81b3917ea36 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:06.789809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf9c0be9-b7f6-45d2-a5ab-a81b3917ea36 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:06.790259 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf9c0be9-b7f6-45d2-a5ab-a81b3917ea36 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:06.791007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf9c0be9-b7f6-45d2-a5ab-a81b3917ea36 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:06.794013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf9c0be9-b7f6-45d2-a5ab-a81b3917ea36 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:06.799735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf9c0be9-b7f6-45d2-a5ab-a81b3917ea36 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:06.821301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-19c2bb4a-0602-4aed-83f5-78175d4f26e6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:06.839085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-19c2bb4a-0602-4aed-83f5-78175d4f26e6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:06.843667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-19c2bb4a-0602-4aed-83f5-78175d4f26e6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:06.861699 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-19c2bb4a-0602-4aed-83f5-78175d4f26e6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1504 microversion: 2.91 time: 0.221749 Sep 07 12:31:06.862399 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 391/770] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:06 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1504 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:07.066162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-09e65b20-ee3e-48ac-9fdb-6fd554ea234e req-db1dc640-c064-4010-8fe5-c48e7a1c5da2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3", "name": "network-vif-plugged", "status": "completed", "tag": "93de5379-dbd9-4a2c-ae2f-9b0113b9607c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:07.101306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-09e65b20-ee3e-48ac-9fdb-6fd554ea234e req-db1dc640-c064-4010-8fe5-c48e7a1c5da2 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:07.102695 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-09e65b20-ee3e-48ac-9fdb-6fd554ea234e req-db1dc640-c064-4010-8fe5-c48e7a1c5da2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:07.104936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-09e65b20-ee3e-48ac-9fdb-6fd554ea234e req-db1dc640-c064-4010-8fe5-c48e7a1c5da2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:07.138354 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-09e65b20-ee3e-48ac-9fdb-6fd554ea234e req-db1dc640-c064-4010-8fe5-c48e7a1c5da2 service nova] Creating event network-vif-plugged:93de5379-dbd9-4a2c-ae2f-9b0113b9607c for instance 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 on n-h1-852087-9 Sep 07 12:31:07.156825 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-09e65b20-ee3e-48ac-9fdb-6fd554ea234e req-db1dc640-c064-4010-8fe5-c48e7a1c5da2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103241 Sep 07 12:31:07.157811 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 392/771] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:31:07.247402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bf9c0be9-b7f6-45d2-a5ab-a81b3917ea36 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:07.284451 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bf9c0be9-b7f6-45d2-a5ab-a81b3917ea36 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9" status: 200 len: 1555 microversion: 2.1 time: 0.511298 Sep 07 12:31:07.306558 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 380/772] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:06 2022] GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9 => generated 1555 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:07.333373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bd7ce81d-4b9e-4702-8bfe-e7191cf93f2d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:07.334348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bd7ce81d-4b9e-4702-8bfe-e7191cf93f2d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:07.379415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd7ce81d-4b9e-4702-8bfe-e7191cf93f2d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:07.380338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd7ce81d-4b9e-4702-8bfe-e7191cf93f2d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:07.381140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd7ce81d-4b9e-4702-8bfe-e7191cf93f2d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:07.382747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd7ce81d-4b9e-4702-8bfe-e7191cf93f2d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:07.383584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd7ce81d-4b9e-4702-8bfe-e7191cf93f2d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:07.384406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd7ce81d-4b9e-4702-8bfe-e7191cf93f2d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:07.398893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:07.670238 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bd7ce81d-4b9e-4702-8bfe-e7191cf93f2d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.344048 Sep 07 12:31:07.671396 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 381/773] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Sep 7 12:31:07 2022] GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9/os-interface => generated 285 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:31:07.680993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-941d79d2-7366-4027-8c3c-c6c5403e3c37 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:07.682187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-941d79d2-7366-4027-8c3c-c6c5403e3c37 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:07.694211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-941d79d2-7366-4027-8c3c-c6c5403e3c37 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:07.695342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-941d79d2-7366-4027-8c3c-c6c5403e3c37 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:07.696848 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-941d79d2-7366-4027-8c3c-c6c5403e3c37 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:07.698551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-941d79d2-7366-4027-8c3c-c6c5403e3c37 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:07.699731 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-941d79d2-7366-4027-8c3c-c6c5403e3c37 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:07.700781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-941d79d2-7366-4027-8c3c-c6c5403e3c37 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:07.755739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-49cae3f3-6f64-4640-b684-00feda0bf9b3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-424021280", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "782fe665-49dc-454e-a75e-cbb471a251fc"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:07.886206 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-49cae3f3-6f64-4640-b684-00feda0bf9b3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] validate_networks() for [('782fe665-49dc-454e-a75e-cbb471a251fc', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:31:08.511211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-941d79d2-7366-4027-8c3c-c6c5403e3c37 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:08.523197 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-941d79d2-7366-4027-8c3c-c6c5403e3c37 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1359 microversion: 2.1 time: 0.850228 Sep 07 12:31:08.525856 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 382/774] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:07 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1359 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:08.533717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5226efbb-5216-4794-8524-5305f82e6df5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:08.534532 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5226efbb-5216-4794-8524-5305f82e6df5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:08.564963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5226efbb-5216-4794-8524-5305f82e6df5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:08.568092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5226efbb-5216-4794-8524-5305f82e6df5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:08.568519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5226efbb-5216-4794-8524-5305f82e6df5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:08.570777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5226efbb-5216-4794-8524-5305f82e6df5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:08.571629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5226efbb-5216-4794-8524-5305f82e6df5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:08.576471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5226efbb-5216-4794-8524-5305f82e6df5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:09.254970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5226efbb-5216-4794-8524-5305f82e6df5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:09.271507 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5226efbb-5216-4794-8524-5305f82e6df5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1476 microversion: 2.1 time: 0.743611 Sep 07 12:31:09.272483 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 383/775] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:08 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1476 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:09.279440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2fd79e12-7d6b-4b82-8d8b-0f56a027562a tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:09.280765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2fd79e12-7d6b-4b82-8d8b-0f56a027562a tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:09.291594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fd79e12-7d6b-4b82-8d8b-0f56a027562a tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:09.292555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fd79e12-7d6b-4b82-8d8b-0f56a027562a tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:09.293204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fd79e12-7d6b-4b82-8d8b-0f56a027562a tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:09.294432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fd79e12-7d6b-4b82-8d8b-0f56a027562a tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:09.295150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fd79e12-7d6b-4b82-8d8b-0f56a027562a tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:09.296217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fd79e12-7d6b-4b82-8d8b-0f56a027562a tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:09.554399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-2fd79e12-7d6b-4b82-8d8b-0f56a027562a tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lazy-loading 'services' on Instance uuid 7e48b0d0-a574-476c-8054-97b544b3d24f {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:31:09.602198 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2fd79e12-7d6b-4b82-8d8b-0f56a027562a tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1929 microversion: 2.75 time: 0.328064 Sep 07 12:31:09.602697 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 384/776] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:09 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1929 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:09.647158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9b11a9aa-cfc9-4e01-8286-72ab28da3999 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:09.652100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9b11a9aa-cfc9-4e01-8286-72ab28da3999 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:09.669292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b11a9aa-cfc9-4e01-8286-72ab28da3999 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:09.670455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b11a9aa-cfc9-4e01-8286-72ab28da3999 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:09.675523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b11a9aa-cfc9-4e01-8286-72ab28da3999 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:09.677348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b11a9aa-cfc9-4e01-8286-72ab28da3999 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:09.678095 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b11a9aa-cfc9-4e01-8286-72ab28da3999 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:09.679849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b11a9aa-cfc9-4e01-8286-72ab28da3999 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:10.290188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9b11a9aa-cfc9-4e01-8286-72ab28da3999 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:10.322990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9b11a9aa-cfc9-4e01-8286-72ab28da3999 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:10.331285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9b11a9aa-cfc9-4e01-8286-72ab28da3999 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:10.370716 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9b11a9aa-cfc9-4e01-8286-72ab28da3999 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1510 microversion: 2.91 time: 0.745057 Sep 07 12:31:10.371846 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 385/777] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:09 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1510 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:10.392438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-3e8a3a6a-6071-4241-9923-16570e7a8012 req-d19cf430-21d5-41da-a6e5-7c32efacaa20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd64235e-b7e5-4a81-a2f8-49bb09fecdf9", "name": "network-vif-unplugged", "status": "completed", "tag": "f96d9d76-2187-4026-8333-d92e5985ac08"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:10.428236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3e8a3a6a-6071-4241-9923-16570e7a8012 req-d19cf430-21d5-41da-a6e5-7c32efacaa20 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:10.429042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3e8a3a6a-6071-4241-9923-16570e7a8012 req-d19cf430-21d5-41da-a6e5-7c32efacaa20 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:10.429869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3e8a3a6a-6071-4241-9923-16570e7a8012 req-d19cf430-21d5-41da-a6e5-7c32efacaa20 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:10.455515 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-3e8a3a6a-6071-4241-9923-16570e7a8012 req-d19cf430-21d5-41da-a6e5-7c32efacaa20 service nova] Creating event network-vif-unplugged:f96d9d76-2187-4026-8333-d92e5985ac08 for instance bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 on n-h1-852087-9 Sep 07 12:31:10.467345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-3e8a3a6a-6071-4241-9923-16570e7a8012 req-d19cf430-21d5-41da-a6e5-7c32efacaa20 service nova] Instance bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 12:31:10.494804 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-3e8a3a6a-6071-4241-9923-16570e7a8012 req-d19cf430-21d5-41da-a6e5-7c32efacaa20 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120703 Sep 07 12:31:10.496576 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 386/778] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:31:10.510508 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6c798567-0389-4b00-8742-75f07b3f3a38 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:10.511959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6c798567-0389-4b00-8742-75f07b3f3a38 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:10.512386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-49cae3f3-6f64-4640-b684-00feda0bf9b3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:31:10.513149 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-49cae3f3-6f64-4640-b684-00feda0bf9b3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:31:10.514068 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-49cae3f3-6f64-4640-b684-00feda0bf9b3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:31:10.514810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-49cae3f3-6f64-4640-b684-00feda0bf9b3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:31:10.516613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-49cae3f3-6f64-4640-b684-00feda0bf9b3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:31:10.523669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c798567-0389-4b00-8742-75f07b3f3a38 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:10.524914 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c798567-0389-4b00-8742-75f07b3f3a38 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:10.526009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c798567-0389-4b00-8742-75f07b3f3a38 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:10.527519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c798567-0389-4b00-8742-75f07b3f3a38 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:10.528607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c798567-0389-4b00-8742-75f07b3f3a38 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:10.529771 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c798567-0389-4b00-8742-75f07b3f3a38 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:10.584374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49cae3f3-6f64-4640-b684-00feda0bf9b3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:10.589220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49cae3f3-6f64-4640-b684-00feda0bf9b3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:10.590260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49cae3f3-6f64-4640-b684-00feda0bf9b3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:10.591685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49cae3f3-6f64-4640-b684-00feda0bf9b3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:10.592525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49cae3f3-6f64-4640-b684-00feda0bf9b3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:10.593289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49cae3f3-6f64-4640-b684-00feda0bf9b3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:10.628487 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-49cae3f3-6f64-4640-b684-00feda0bf9b3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Getting quotas for project 6d7695bab2d84b35bf92bd035da71dc3. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:31:10.634494 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-49cae3f3-6f64-4640-b684-00feda0bf9b3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Getting quotas for user cf3ae3d912b84a8f906b31874668b740 and project 6d7695bab2d84b35bf92bd035da71dc3. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:31:10.649832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-49cae3f3-6f64-4640-b684-00feda0bf9b3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:31:10.652545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-49cae3f3-6f64-4640-b684-00feda0bf9b3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:31:10.726334 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-49cae3f3-6f64-4640-b684-00feda0bf9b3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.567215 Sep 07 12:31:10.730274 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 393/779] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Sep 7 12:31:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 3572 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 12:31:10.746695 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-af2a0ce4-8d00-4216-a905-e4c78c823919 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:10.749424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-af2a0ce4-8d00-4216-a905-e4c78c823919 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:10.760927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af2a0ce4-8d00-4216-a905-e4c78c823919 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:10.761438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af2a0ce4-8d00-4216-a905-e4c78c823919 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:10.761906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af2a0ce4-8d00-4216-a905-e4c78c823919 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:10.762833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af2a0ce4-8d00-4216-a905-e4c78c823919 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:10.764325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af2a0ce4-8d00-4216-a905-e4c78c823919 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:10.768214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af2a0ce4-8d00-4216-a905-e4c78c823919 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:11.045220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6c798567-0389-4b00-8742-75f07b3f3a38 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:11.076453 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6c798567-0389-4b00-8742-75f07b3f3a38 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1542 microversion: 2.1 time: 0.575252 Sep 07 12:31:11.090043 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 387/780] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:10 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1542 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:11.130688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c09ce5e9-30df-4346-8f6b-eb0e1a726e50 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:11.136413 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c09ce5e9-30df-4346-8f6b-eb0e1a726e50 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:11.145856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:11.156999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:11.162451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c09ce5e9-30df-4346-8f6b-eb0e1a726e50 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:11.163797 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c09ce5e9-30df-4346-8f6b-eb0e1a726e50 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:11.164584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c09ce5e9-30df-4346-8f6b-eb0e1a726e50 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:11.165999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c09ce5e9-30df-4346-8f6b-eb0e1a726e50 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:11.166833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c09ce5e9-30df-4346-8f6b-eb0e1a726e50 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:11.167601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c09ce5e9-30df-4346-8f6b-eb0e1a726e50 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:11.355938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-af2a0ce4-8d00-4216-a905-e4c78c823919 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:11.381025 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-af2a0ce4-8d00-4216-a905-e4c78c823919 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1476 microversion: 2.1 time: 0.636879 Sep 07 12:31:11.383176 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 394/781] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:10 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1476 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:11.405825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aed86543-87b7-48de-8037-76687be762aa tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:11.407479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aed86543-87b7-48de-8037-76687be762aa tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:11.454547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-c09ce5e9-30df-4346-8f6b-eb0e1a726e50 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lazy-loading 'services' on Instance uuid 7e48b0d0-a574-476c-8054-97b544b3d24f {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:31:11.525521 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c09ce5e9-30df-4346-8f6b-eb0e1a726e50 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1929 microversion: 2.75 time: 0.433431 Sep 07 12:31:11.539413 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 388/782] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:11 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1929 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:11.580250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9c947378-d56b-4e4a-9e33-630d0b105cac tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:11.581348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aed86543-87b7-48de-8037-76687be762aa tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:11.582699 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9c947378-d56b-4e4a-9e33-630d0b105cac tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:11.597033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c947378-d56b-4e4a-9e33-630d0b105cac tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:11.598773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c947378-d56b-4e4a-9e33-630d0b105cac tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:11.600304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c947378-d56b-4e4a-9e33-630d0b105cac tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:11.602358 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c947378-d56b-4e4a-9e33-630d0b105cac tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:11.603437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aed86543-87b7-48de-8037-76687be762aa tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:11.604421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c947378-d56b-4e4a-9e33-630d0b105cac tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:11.605636 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c947378-d56b-4e4a-9e33-630d0b105cac tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:11.615795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aed86543-87b7-48de-8037-76687be762aa tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:11.617929 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aed86543-87b7-48de-8037-76687be762aa tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1261 microversion: 2.25 time: 0.229975 Sep 07 12:31:11.618913 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 395/783] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:11 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1261 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:11.635119 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6a20db47-e792-427c-8443-86b63f7a0c66 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:11.636095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6a20db47-e792-427c-8443-86b63f7a0c66 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:11.648171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:11.651384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a20db47-e792-427c-8443-86b63f7a0c66 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:11.655045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a20db47-e792-427c-8443-86b63f7a0c66 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:11.655737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a20db47-e792-427c-8443-86b63f7a0c66 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:11.656544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a20db47-e792-427c-8443-86b63f7a0c66 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:11.658852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a20db47-e792-427c-8443-86b63f7a0c66 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:11.659844 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a20db47-e792-427c-8443-86b63f7a0c66 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:11.901984 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9c947378-d56b-4e4a-9e33-630d0b105cac tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.360455 Sep 07 12:31:11.903673 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 389/784] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Sep 7 12:31:11 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-interface => generated 284 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:31:11.914224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6a20db47-e792-427c-8443-86b63f7a0c66 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:11.931484 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6a20db47-e792-427c-8443-86b63f7a0c66 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:11.937968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6a20db47-e792-427c-8443-86b63f7a0c66 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:11.952704 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6a20db47-e792-427c-8443-86b63f7a0c66 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1510 microversion: 2.91 time: 0.323722 Sep 07 12:31:11.955401 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 396/785] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:11 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1510 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:12.317787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a373512e-93fc-408a-b183-d74715cd1cbb req-3239eed1-5230-4d18-ab7f-575f7857eac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8042e17-76ed-448e-bca1-331aa1f708c9", "tag": "46a7707b-e590-4c61-a29f-5120d570e51b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:12.336706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a373512e-93fc-408a-b183-d74715cd1cbb req-3239eed1-5230-4d18-ab7f-575f7857eac7 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:12.337666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a373512e-93fc-408a-b183-d74715cd1cbb req-3239eed1-5230-4d18-ab7f-575f7857eac7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:12.338862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a373512e-93fc-408a-b183-d74715cd1cbb req-3239eed1-5230-4d18-ab7f-575f7857eac7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:12.380783 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a373512e-93fc-408a-b183-d74715cd1cbb req-3239eed1-5230-4d18-ab7f-575f7857eac7 service nova] Creating event network-changed:46a7707b-e590-4c61-a29f-5120d570e51b for instance d8042e17-76ed-448e-bca1-331aa1f708c9 on n-h1-852087-9 Sep 07 12:31:12.405751 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a373512e-93fc-408a-b183-d74715cd1cbb req-3239eed1-5230-4d18-ab7f-575f7857eac7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092194 Sep 07 12:31:12.406958 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 390/786] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:31:12.437093 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-49a8a5ea-1f16-4867-b25d-0ff60d60f8b1 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:12.438243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-49a8a5ea-1f16-4867-b25d-0ff60d60f8b1 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:12.448420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49a8a5ea-1f16-4867-b25d-0ff60d60f8b1 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:12.449750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49a8a5ea-1f16-4867-b25d-0ff60d60f8b1 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:12.451240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49a8a5ea-1f16-4867-b25d-0ff60d60f8b1 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:12.452699 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49a8a5ea-1f16-4867-b25d-0ff60d60f8b1 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:12.453464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49a8a5ea-1f16-4867-b25d-0ff60d60f8b1 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:12.454083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49a8a5ea-1f16-4867-b25d-0ff60d60f8b1 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:12.566088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-6e738101-90d2-4c65-a6f2-928abf4e3ec5 req-9c19a093-e473-4a53-9cc3-2445e750e003 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd64235e-b7e5-4a81-a2f8-49bb09fecdf9", "tag": "f96d9d76-2187-4026-8333-d92e5985ac08"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:12.609661 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6e738101-90d2-4c65-a6f2-928abf4e3ec5 req-9c19a093-e473-4a53-9cc3-2445e750e003 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:12.611699 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6e738101-90d2-4c65-a6f2-928abf4e3ec5 req-9c19a093-e473-4a53-9cc3-2445e750e003 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:12.615500 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6e738101-90d2-4c65-a6f2-928abf4e3ec5 req-9c19a093-e473-4a53-9cc3-2445e750e003 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:12.695942 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-6e738101-90d2-4c65-a6f2-928abf4e3ec5 req-9c19a093-e473-4a53-9cc3-2445e750e003 service nova] Creating event network-changed:f96d9d76-2187-4026-8333-d92e5985ac08 for instance bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 on n-h1-852087-9 Sep 07 12:31:12.727113 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-6e738101-90d2-4c65-a6f2-928abf4e3ec5 req-9c19a093-e473-4a53-9cc3-2445e750e003 service nova] Instance bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 12:31:12.759953 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-6e738101-90d2-4c65-a6f2-928abf4e3ec5 req-9c19a093-e473-4a53-9cc3-2445e750e003 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200155 Sep 07 12:31:12.763654 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 391/787] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:31:12.779574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae525493-e96a-4c51-a546-aa40eb6960f8 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:12.780951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ae525493-e96a-4c51-a546-aa40eb6960f8 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:12.791029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae525493-e96a-4c51-a546-aa40eb6960f8 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:12.791800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae525493-e96a-4c51-a546-aa40eb6960f8 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:12.792397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae525493-e96a-4c51-a546-aa40eb6960f8 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:12.793446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae525493-e96a-4c51-a546-aa40eb6960f8 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:12.794339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae525493-e96a-4c51-a546-aa40eb6960f8 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:12.794926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae525493-e96a-4c51-a546-aa40eb6960f8 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:12.989689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-49a8a5ea-1f16-4867-b25d-0ff60d60f8b1 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:13.020414 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-49a8a5ea-1f16-4867-b25d-0ff60d60f8b1 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1474 microversion: 2.1 time: 0.590426 Sep 07 12:31:13.021862 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 397/788] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:12 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1474 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:13.032155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d5be6a49-6aac-4420-804f-28cfe4ec1ecd tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:13.034018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d5be6a49-6aac-4420-804f-28cfe4ec1ecd tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:13.049470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5be6a49-6aac-4420-804f-28cfe4ec1ecd tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:13.050657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5be6a49-6aac-4420-804f-28cfe4ec1ecd tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:13.051877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5be6a49-6aac-4420-804f-28cfe4ec1ecd tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:13.053379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5be6a49-6aac-4420-804f-28cfe4ec1ecd tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:13.054654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5be6a49-6aac-4420-804f-28cfe4ec1ecd tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:13.056835 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5be6a49-6aac-4420-804f-28cfe4ec1ecd tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:13.084617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-ae525493-e96a-4c51-a546-aa40eb6960f8 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lazy-loading 'services' on Instance uuid 7e48b0d0-a574-476c-8054-97b544b3d24f {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:31:13.145282 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ae525493-e96a-4c51-a546-aa40eb6960f8 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1929 microversion: 2.75 time: 0.375431 Sep 07 12:31:13.152557 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 392/789] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:12 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1929 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:13.167711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0d922e02-9933-4bba-852d-1b8ced5e66fc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:13.175385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0d922e02-9933-4bba-852d-1b8ced5e66fc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:13.195846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d922e02-9933-4bba-852d-1b8ced5e66fc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:13.196644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d922e02-9933-4bba-852d-1b8ced5e66fc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:13.197445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d922e02-9933-4bba-852d-1b8ced5e66fc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:13.198824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d922e02-9933-4bba-852d-1b8ced5e66fc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:13.199705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d922e02-9933-4bba-852d-1b8ced5e66fc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:13.200496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d922e02-9933-4bba-852d-1b8ced5e66fc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:13.271773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d5be6a49-6aac-4420-804f-28cfe4ec1ecd tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:13.290613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d5be6a49-6aac-4420-804f-28cfe4ec1ecd tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:13.293310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d5be6a49-6aac-4420-804f-28cfe4ec1ecd tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:13.299135 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d5be6a49-6aac-4420-804f-28cfe4ec1ecd tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1257 microversion: 2.25 time: 0.275042 Sep 07 12:31:13.300626 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 398/790] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:13 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1257 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:13.403158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0d922e02-9933-4bba-852d-1b8ced5e66fc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:13.424463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0d922e02-9933-4bba-852d-1b8ced5e66fc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:13.428379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0d922e02-9933-4bba-852d-1b8ced5e66fc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:13.446094 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0d922e02-9933-4bba-852d-1b8ced5e66fc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1531 microversion: 2.91 time: 0.290751 Sep 07 12:31:13.448237 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 393/791] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:13 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1531 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:13.852132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9bab0eed-fed4-4b93-aac6-3ffa90572776 tempest-QuotaClassesAdminTestJSON-1332876966 tempest-QuotaClassesAdminTestJSON-1332876966-project-admin] Calling method '.version_select at 0x7fc4196eef70>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:13.902841 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9bab0eed-fed4-4b93-aac6-3ffa90572776 tempest-QuotaClassesAdminTestJSON-1332876966 tempest-QuotaClassesAdminTestJSON-1332876966-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.252385 Sep 07 12:31:13.920878 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 394/792] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Sep 7 12:31:13 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:31:13.931640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ca09cc52-05a6-4997-ba25-b3e0086007b9 tempest-QuotaClassesAdminTestJSON-1332876966 tempest-QuotaClassesAdminTestJSON-1332876966-project-admin] Action: 'update', calling method: .version_select at 0x7fc419622820>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:13.979928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e0950772-bdfc-464c-8da5-e72510387d72 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:13.983255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e0950772-bdfc-464c-8da5-e72510387d72 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:14.015625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0950772-bdfc-464c-8da5-e72510387d72 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:14.016834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0950772-bdfc-464c-8da5-e72510387d72 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:14.017282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0950772-bdfc-464c-8da5-e72510387d72 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:14.018394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0950772-bdfc-464c-8da5-e72510387d72 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:14.018862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0950772-bdfc-464c-8da5-e72510387d72 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:14.019334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0950772-bdfc-464c-8da5-e72510387d72 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:14.185974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:UPDATE=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:14.196348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-e0950772-bdfc-464c-8da5-e72510387d72 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lazy-loading 'services' on Instance uuid b8038c3c-8b64-4a94-84ad-41654d2d53ca {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:31:14.257147 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e0950772-bdfc-464c-8da5-e72510387d72 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1936 microversion: 2.91 time: 0.782853 Sep 07 12:31:14.259025 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 399/793] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:13 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1936 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:14.269318 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6f08205e-d5d3-4a0f-9f6f-bec781516dee tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:14.269993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6f08205e-d5d3-4a0f-9f6f-bec781516dee tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:14.277973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f08205e-d5d3-4a0f-9f6f-bec781516dee tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:14.278494 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f08205e-d5d3-4a0f-9f6f-bec781516dee tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:14.278949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f08205e-d5d3-4a0f-9f6f-bec781516dee tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:14.279704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f08205e-d5d3-4a0f-9f6f-bec781516dee tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:14.280183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f08205e-d5d3-4a0f-9f6f-bec781516dee tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:14.280622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f08205e-d5d3-4a0f-9f6f-bec781516dee tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:14.460542 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6f08205e-d5d3-4a0f-9f6f-bec781516dee tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:14.470953 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6f08205e-d5d3-4a0f-9f6f-bec781516dee tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1474 microversion: 2.1 time: 0.210052 Sep 07 12:31:14.472268 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 400/794] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:14 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1474 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:14.478536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b00835c9-7e6f-47ce-8343-07b656cae574 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:14.479630 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b00835c9-7e6f-47ce-8343-07b656cae574 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:14.488954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b00835c9-7e6f-47ce-8343-07b656cae574 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:14.491480 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b00835c9-7e6f-47ce-8343-07b656cae574 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:14.492763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b00835c9-7e6f-47ce-8343-07b656cae574 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:14.493790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b00835c9-7e6f-47ce-8343-07b656cae574 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:14.495390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b00835c9-7e6f-47ce-8343-07b656cae574 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:14.496110 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b00835c9-7e6f-47ce-8343-07b656cae574 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:14.591025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-b00835c9-7e6f-47ce-8343-07b656cae574 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lazy-loading 'services' on Instance uuid 7e48b0d0-a574-476c-8054-97b544b3d24f {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:31:14.642320 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b00835c9-7e6f-47ce-8343-07b656cae574 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1929 microversion: 2.75 time: 0.168692 Sep 07 12:31:14.654043 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 401/795] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:14 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1929 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:14.675793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5192bb38-d1ea-4652-be16-bb613bc78896 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:14.677515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5192bb38-d1ea-4652-be16-bb613bc78896 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:14.690570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5192bb38-d1ea-4652-be16-bb613bc78896 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:14.692079 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5192bb38-d1ea-4652-be16-bb613bc78896 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:14.693256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5192bb38-d1ea-4652-be16-bb613bc78896 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:14.694891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5192bb38-d1ea-4652-be16-bb613bc78896 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:14.696077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5192bb38-d1ea-4652-be16-bb613bc78896 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:14.697175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5192bb38-d1ea-4652-be16-bb613bc78896 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:14.724780 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ca09cc52-05a6-4997-ba25-b3e0086007b9 tempest-QuotaClassesAdminTestJSON-1332876966 tempest-QuotaClassesAdminTestJSON-1332876966-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.801524 Sep 07 12:31:14.725887 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 395/796] 10.222.0.16 () {60 vars in 1206 bytes} [Wed Sep 7 12:31:13 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:31:14.734658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5880c6ac-2825-400c-adcb-d851a59907e0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:14.736314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5880c6ac-2825-400c-adcb-d851a59907e0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:14.747972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5880c6ac-2825-400c-adcb-d851a59907e0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:14.749341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5880c6ac-2825-400c-adcb-d851a59907e0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:14.750562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5880c6ac-2825-400c-adcb-d851a59907e0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:14.752152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5880c6ac-2825-400c-adcb-d851a59907e0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:14.753221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5880c6ac-2825-400c-adcb-d851a59907e0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:14.754190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5880c6ac-2825-400c-adcb-d851a59907e0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:14.824687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-5192bb38-d1ea-4652-be16-bb613bc78896 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lazy-loading 'services' on Instance uuid b8038c3c-8b64-4a94-84ad-41654d2d53ca {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:31:14.845146 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5192bb38-d1ea-4652-be16-bb613bc78896 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1936 microversion: 2.91 time: 0.189165 Sep 07 12:31:14.846019 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 402/797] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:14 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1936 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:14.850488 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ce0e398-0b18-40f8-96d3-aeb52317f289 tempest-QuotaClassesAdminTestJSON-1332876966 tempest-QuotaClassesAdminTestJSON-1332876966-project-admin] Calling method '.version_select at 0x7fc41952e790>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:14.870425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5880c6ac-2825-400c-adcb-d851a59907e0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:14.874313 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6ce0e398-0b18-40f8-96d3-aeb52317f289 tempest-QuotaClassesAdminTestJSON-1332876966 tempest-QuotaClassesAdminTestJSON-1332876966-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.026868 Sep 07 12:31:14.875666 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 403/798] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Sep 7 12:31:14 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:31:14.881947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-0ace690b-6e50-4bff-b392-760089431a14 req-ff311efe-c94b-4900-9a25-524ba8d3d77b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3", "tag": "93de5379-dbd9-4a2c-ae2f-9b0113b9607c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:14.894555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5880c6ac-2825-400c-adcb-d851a59907e0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:14.896304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5880c6ac-2825-400c-adcb-d851a59907e0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:14.898054 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5880c6ac-2825-400c-adcb-d851a59907e0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1257 microversion: 2.25 time: 0.170539 Sep 07 12:31:14.900332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0ace690b-6e50-4bff-b392-760089431a14 req-ff311efe-c94b-4900-9a25-524ba8d3d77b service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:14.901086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0ace690b-6e50-4bff-b392-760089431a14 req-ff311efe-c94b-4900-9a25-524ba8d3d77b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:14.901848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0ace690b-6e50-4bff-b392-760089431a14 req-ff311efe-c94b-4900-9a25-524ba8d3d77b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:14.909458 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 396/799] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:14 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1257 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:14.915017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-922482a3-4b05-445f-b4d1-0f73c2033a14 tempest-QuotaClassesAdminTestJSON-1332876966 tempest-QuotaClassesAdminTestJSON-1332876966-project-admin] Action: 'update', calling method: .version_select at 0x7fc419453550>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:14.923771 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-0ace690b-6e50-4bff-b392-760089431a14 req-ff311efe-c94b-4900-9a25-524ba8d3d77b service nova] Creating event network-changed:93de5379-dbd9-4a2c-ae2f-9b0113b9607c for instance 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 on n-h1-852087-9 Sep 07 12:31:14.933571 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-0ace690b-6e50-4bff-b392-760089431a14 req-ff311efe-c94b-4900-9a25-524ba8d3d77b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056014 Sep 07 12:31:14.934210 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 404/800] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:31:14.940151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dbe638bf-1d15-4377-909c-ea0e74ab8349 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:14.944307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbe638bf-1d15-4377-909c-ea0e74ab8349 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:14.944823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbe638bf-1d15-4377-909c-ea0e74ab8349 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:14.945314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbe638bf-1d15-4377-909c-ea0e74ab8349 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:14.946232 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbe638bf-1d15-4377-909c-ea0e74ab8349 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:14.946661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbe638bf-1d15-4377-909c-ea0e74ab8349 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:14.947139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbe638bf-1d15-4377-909c-ea0e74ab8349 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:14.984557 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dbe638bf-1d15-4377-909c-ea0e74ab8349 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.048687 Sep 07 12:31:14.997675 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 405/801] 10.222.0.16 () {60 vars in 1217 bytes} [Wed Sep 7 12:31:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:31:15.006140 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-66afd099-a457-470e-8ce9-535f65743327 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:15.006793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-66afd099-a457-470e-8ce9-535f65743327 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:15.014842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66afd099-a457-470e-8ce9-535f65743327 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:15.015353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66afd099-a457-470e-8ce9-535f65743327 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:15.015854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66afd099-a457-470e-8ce9-535f65743327 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:15.016812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66afd099-a457-470e-8ce9-535f65743327 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:15.016985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66afd099-a457-470e-8ce9-535f65743327 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:15.017428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66afd099-a457-470e-8ce9-535f65743327 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:15.069351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-66afd099-a457-470e-8ce9-535f65743327 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lazy-loading 'flavor' on Instance uuid b8038c3c-8b64-4a94-84ad-41654d2d53ca {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:31:15.106735 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-922482a3-4b05-445f-b4d1-0f73c2033a14 tempest-QuotaClassesAdminTestJSON-1332876966 tempest-QuotaClassesAdminTestJSON-1332876966-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.193308 Sep 07 12:31:15.107562 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 397/802] 10.222.0.16 () {60 vars in 1206 bytes} [Wed Sep 7 12:31:14 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:31:15.483465 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-66afd099-a457-470e-8ce9-535f65743327 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "POST /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca/action" status: 202 len: 0 microversion: 2.91 time: 0.481407 Sep 07 12:31:15.485576 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 406/803] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Sep 7 12:31:15 2022] POST /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 07 12:31:15.505795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-804a8e81-c28f-437c-a522-400f0c085385 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:15.509550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-804a8e81-c28f-437c-a522-400f0c085385 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:15.531886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-804a8e81-c28f-437c-a522-400f0c085385 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:15.534463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b5a6f999-25b6-46f2-85cb-08336391559b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:15.536294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b5a6f999-25b6-46f2-85cb-08336391559b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:15.542678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-804a8e81-c28f-437c-a522-400f0c085385 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:15.543494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-804a8e81-c28f-437c-a522-400f0c085385 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:15.544849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-804a8e81-c28f-437c-a522-400f0c085385 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:15.545760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-804a8e81-c28f-437c-a522-400f0c085385 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:15.546567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-804a8e81-c28f-437c-a522-400f0c085385 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:15.584646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5a6f999-25b6-46f2-85cb-08336391559b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:15.590485 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5a6f999-25b6-46f2-85cb-08336391559b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:15.593183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5a6f999-25b6-46f2-85cb-08336391559b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:15.597531 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5a6f999-25b6-46f2-85cb-08336391559b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:15.601321 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5a6f999-25b6-46f2-85cb-08336391559b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:15.606090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5a6f999-25b6-46f2-85cb-08336391559b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:15.711536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-804a8e81-c28f-437c-a522-400f0c085385 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:15.723379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-804a8e81-c28f-437c-a522-400f0c085385 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:15.725216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-804a8e81-c28f-437c-a522-400f0c085385 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:15.739171 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-804a8e81-c28f-437c-a522-400f0c085385 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.246499 Sep 07 12:31:15.740785 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 398/804] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:15 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:15.757981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-170bd35e-c781-4a97-94a3-4e05f0da894d tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:15.759191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-170bd35e-c781-4a97-94a3-4e05f0da894d tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:15.772681 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-170bd35e-c781-4a97-94a3-4e05f0da894d tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:15.773802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-170bd35e-c781-4a97-94a3-4e05f0da894d tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:15.774096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-170bd35e-c781-4a97-94a3-4e05f0da894d tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:15.775000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-170bd35e-c781-4a97-94a3-4e05f0da894d tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:15.775732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-170bd35e-c781-4a97-94a3-4e05f0da894d tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:15.779588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-170bd35e-c781-4a97-94a3-4e05f0da894d tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:16.003305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-170bd35e-c781-4a97-94a3-4e05f0da894d tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lazy-loading 'services' on Instance uuid 7e48b0d0-a574-476c-8054-97b544b3d24f {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:31:16.084756 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-170bd35e-c781-4a97-94a3-4e05f0da894d tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1929 microversion: 2.75 time: 0.340588 Sep 07 12:31:16.086445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b5a6f999-25b6-46f2-85cb-08336391559b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:16.091753 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 399/805] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:15 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1929 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:16.102252 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b5a6f999-25b6-46f2-85cb-08336391559b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1474 microversion: 2.1 time: 0.590343 Sep 07 12:31:16.112234 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 407/806] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:15 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1474 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:16.131383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3820ca21-23af-4c4d-9c79-389b07eaa931 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:16.136319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3820ca21-23af-4c4d-9c79-389b07eaa931 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:16.155981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3820ca21-23af-4c4d-9c79-389b07eaa931 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:16.156973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3820ca21-23af-4c4d-9c79-389b07eaa931 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:16.157919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3820ca21-23af-4c4d-9c79-389b07eaa931 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:16.159228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3820ca21-23af-4c4d-9c79-389b07eaa931 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:16.160094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3820ca21-23af-4c4d-9c79-389b07eaa931 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:16.160930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3820ca21-23af-4c4d-9c79-389b07eaa931 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:16.330606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3820ca21-23af-4c4d-9c79-389b07eaa931 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:16.350330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3820ca21-23af-4c4d-9c79-389b07eaa931 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:16.353521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3820ca21-23af-4c4d-9c79-389b07eaa931 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:16.355971 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3820ca21-23af-4c4d-9c79-389b07eaa931 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1313 microversion: 2.25 time: 0.260891 Sep 07 12:31:16.357042 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 400/807] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:16 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:16.791180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e19a628-80e1-442e-af78-a1d9c83077c3 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:16.792144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2e19a628-80e1-442e-af78-a1d9c83077c3 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:16.801333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e19a628-80e1-442e-af78-a1d9c83077c3 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:16.801859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e19a628-80e1-442e-af78-a1d9c83077c3 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:16.802499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e19a628-80e1-442e-af78-a1d9c83077c3 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:16.803442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e19a628-80e1-442e-af78-a1d9c83077c3 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:16.803907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e19a628-80e1-442e-af78-a1d9c83077c3 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:16.804519 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e19a628-80e1-442e-af78-a1d9c83077c3 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:16.834777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:16.901877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2e19a628-80e1-442e-af78-a1d9c83077c3 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:16.915135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2e19a628-80e1-442e-af78-a1d9c83077c3 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:16.917059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2e19a628-80e1-442e-af78-a1d9c83077c3 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:16.925339 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2e19a628-80e1-442e-af78-a1d9c83077c3 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.138102 Sep 07 12:31:16.926508 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 408/808] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:16 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:17.137200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bbf05c76-15ed-453f-9f98-e0a16ec4fb41 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:17.138189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bbf05c76-15ed-453f-9f98-e0a16ec4fb41 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:17.149208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-71285639-0c1a-486c-b717-48f1dbb358c4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:17.150111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-71285639-0c1a-486c-b717-48f1dbb358c4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:17.165080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbf05c76-15ed-453f-9f98-e0a16ec4fb41 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:17.168938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71285639-0c1a-486c-b717-48f1dbb358c4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:17.169450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71285639-0c1a-486c-b717-48f1dbb358c4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:17.169932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71285639-0c1a-486c-b717-48f1dbb358c4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:17.170932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71285639-0c1a-486c-b717-48f1dbb358c4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:17.171338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71285639-0c1a-486c-b717-48f1dbb358c4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:17.172565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbf05c76-15ed-453f-9f98-e0a16ec4fb41 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:17.173209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbf05c76-15ed-453f-9f98-e0a16ec4fb41 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:17.174265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbf05c76-15ed-453f-9f98-e0a16ec4fb41 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:17.174743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbf05c76-15ed-453f-9f98-e0a16ec4fb41 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:17.180175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71285639-0c1a-486c-b717-48f1dbb358c4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:17.181960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbf05c76-15ed-453f-9f98-e0a16ec4fb41 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:17.228118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:17.548066 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-bbf05c76-15ed-453f-9f98-e0a16ec4fb41 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lazy-loading 'services' on Instance uuid 7e48b0d0-a574-476c-8054-97b544b3d24f {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:31:17.610169 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bbf05c76-15ed-453f-9f98-e0a16ec4fb41 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1929 microversion: 2.75 time: 0.477397 Sep 07 12:31:17.611236 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 401/809] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:17 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1929 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:31:17.646797 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1b97f057-d1a3-4015-b048-8b0ad03752e2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:17.648189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1b97f057-d1a3-4015-b048-8b0ad03752e2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:17.661015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b97f057-d1a3-4015-b048-8b0ad03752e2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:17.663293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b97f057-d1a3-4015-b048-8b0ad03752e2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:17.664630 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b97f057-d1a3-4015-b048-8b0ad03752e2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:17.666699 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b97f057-d1a3-4015-b048-8b0ad03752e2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:17.667997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b97f057-d1a3-4015-b048-8b0ad03752e2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:17.669793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b97f057-d1a3-4015-b048-8b0ad03752e2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:17.865456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1b97f057-d1a3-4015-b048-8b0ad03752e2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:17.875501 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1b97f057-d1a3-4015-b048-8b0ad03752e2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:17.877007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1b97f057-d1a3-4015-b048-8b0ad03752e2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:17.878368 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1b97f057-d1a3-4015-b048-8b0ad03752e2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1331 microversion: 2.25 time: 0.265466 Sep 07 12:31:17.879488 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 402/810] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:17 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1331 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:17.907615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-71285639-0c1a-486c-b717-48f1dbb358c4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:17.926459 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-71285639-0c1a-486c-b717-48f1dbb358c4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1471 microversion: 2.1 time: 0.782004 Sep 07 12:31:17.927611 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 409/811] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:17 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1471 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:31:17.959151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e59fe578-3bbb-4cdc-bae9-1fe3a4162561 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:17.960244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e59fe578-3bbb-4cdc-bae9-1fe3a4162561 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:17.973476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f9f18482-fb90-47ea-ad41-69df1f50fda5 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:17.975099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f9f18482-fb90-47ea-ad41-69df1f50fda5 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:17.978654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e59fe578-3bbb-4cdc-bae9-1fe3a4162561 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:17.980663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e59fe578-3bbb-4cdc-bae9-1fe3a4162561 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:17.981644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e59fe578-3bbb-4cdc-bae9-1fe3a4162561 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:17.984075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e59fe578-3bbb-4cdc-bae9-1fe3a4162561 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:17.985391 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e59fe578-3bbb-4cdc-bae9-1fe3a4162561 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:17.986441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e59fe578-3bbb-4cdc-bae9-1fe3a4162561 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:17.990949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9f18482-fb90-47ea-ad41-69df1f50fda5 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:17.992341 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9f18482-fb90-47ea-ad41-69df1f50fda5 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:17.993594 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9f18482-fb90-47ea-ad41-69df1f50fda5 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:17.995491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9f18482-fb90-47ea-ad41-69df1f50fda5 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:17.996755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9f18482-fb90-47ea-ad41-69df1f50fda5 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:17.997917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9f18482-fb90-47ea-ad41-69df1f50fda5 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:18.140499 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e59fe578-3bbb-4cdc-bae9-1fe3a4162561 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "POST /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9/action" status: 204 len: 0 microversion: 2.1 time: 0.190661 Sep 07 12:31:18.142559 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 403/812] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:31:17 2022] POST /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9/action => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:31:18.159037 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-11539d25-036e-42fb-9ab6-8543ea6c199e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:18.160146 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-11539d25-036e-42fb-9ab6-8543ea6c199e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:18.176411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11539d25-036e-42fb-9ab6-8543ea6c199e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:18.178452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11539d25-036e-42fb-9ab6-8543ea6c199e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:18.179156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11539d25-036e-42fb-9ab6-8543ea6c199e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:18.181576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11539d25-036e-42fb-9ab6-8543ea6c199e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:18.183114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11539d25-036e-42fb-9ab6-8543ea6c199e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:18.184645 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11539d25-036e-42fb-9ab6-8543ea6c199e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:18.234801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f9f18482-fb90-47ea-ad41-69df1f50fda5 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:18.266186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f9f18482-fb90-47ea-ad41-69df1f50fda5 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:18.272009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f9f18482-fb90-47ea-ad41-69df1f50fda5 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:18.285994 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f9f18482-fb90-47ea-ad41-69df1f50fda5 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.320255 Sep 07 12:31:18.287894 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 410/813] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:17 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:18.553787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-11539d25-036e-42fb-9ab6-8543ea6c199e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:18.567718 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-11539d25-036e-42fb-9ab6-8543ea6c199e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1471 microversion: 2.1 time: 0.417148 Sep 07 12:31:18.568592 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 404/814] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:18 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1471 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:18.663983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b1185f68-3003-45ad-a2f8-0487831666de tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:18.677644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b1185f68-3003-45ad-a2f8-0487831666de tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:18.699672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1185f68-3003-45ad-a2f8-0487831666de tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:18.700771 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1185f68-3003-45ad-a2f8-0487831666de tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:18.701811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1185f68-3003-45ad-a2f8-0487831666de tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:18.703333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1185f68-3003-45ad-a2f8-0487831666de tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:18.704114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1185f68-3003-45ad-a2f8-0487831666de tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:18.705063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1185f68-3003-45ad-a2f8-0487831666de tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:18.846191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-b1185f68-3003-45ad-a2f8-0487831666de tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lazy-loading 'services' on Instance uuid 7e48b0d0-a574-476c-8054-97b544b3d24f {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:31:18.881908 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b1185f68-3003-45ad-a2f8-0487831666de tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1929 microversion: 2.75 time: 0.226398 Sep 07 12:31:18.883836 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 411/815] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:18 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1929 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:18.919054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-71605b37-2b0d-4914-9a9d-dbc08b195b20 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:18.919567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-71605b37-2b0d-4914-9a9d-dbc08b195b20 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:18.926441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71605b37-2b0d-4914-9a9d-dbc08b195b20 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:18.926976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71605b37-2b0d-4914-9a9d-dbc08b195b20 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:18.927421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71605b37-2b0d-4914-9a9d-dbc08b195b20 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:18.928215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71605b37-2b0d-4914-9a9d-dbc08b195b20 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:18.928686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71605b37-2b0d-4914-9a9d-dbc08b195b20 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:18.929121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71605b37-2b0d-4914-9a9d-dbc08b195b20 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:19.065243 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-71605b37-2b0d-4914-9a9d-dbc08b195b20 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:19.075229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-71605b37-2b0d-4914-9a9d-dbc08b195b20 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:19.077407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-71605b37-2b0d-4914-9a9d-dbc08b195b20 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:19.085053 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-71605b37-2b0d-4914-9a9d-dbc08b195b20 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1319 microversion: 2.25 time: 0.170334 Sep 07 12:31:19.086267 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 405/816] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:18 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:19.315368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-67ad699d-66ae-4519-beee-37a492ac2091 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:19.317220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-67ad699d-66ae-4519-beee-37a492ac2091 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:19.324719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67ad699d-66ae-4519-beee-37a492ac2091 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:19.325711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67ad699d-66ae-4519-beee-37a492ac2091 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:19.326724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67ad699d-66ae-4519-beee-37a492ac2091 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:19.328065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67ad699d-66ae-4519-beee-37a492ac2091 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:19.328786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67ad699d-66ae-4519-beee-37a492ac2091 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:19.329895 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67ad699d-66ae-4519-beee-37a492ac2091 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:19.481884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-67ad699d-66ae-4519-beee-37a492ac2091 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:19.506189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-67ad699d-66ae-4519-beee-37a492ac2091 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:19.509387 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-67ad699d-66ae-4519-beee-37a492ac2091 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:19.521344 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-67ad699d-66ae-4519-beee-37a492ac2091 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.209465 Sep 07 12:31:19.524278 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 412/817] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:19 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:19.604852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6aa8c1ec-95e9-4383-8b8f-e309481417c9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:19.605726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6aa8c1ec-95e9-4383-8b8f-e309481417c9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:19.616830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa8c1ec-95e9-4383-8b8f-e309481417c9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:19.618429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa8c1ec-95e9-4383-8b8f-e309481417c9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:19.619895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa8c1ec-95e9-4383-8b8f-e309481417c9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:19.623049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa8c1ec-95e9-4383-8b8f-e309481417c9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:19.623970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa8c1ec-95e9-4383-8b8f-e309481417c9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:19.625094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa8c1ec-95e9-4383-8b8f-e309481417c9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:19.805768 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-208f2cdf-73f5-4faf-b763-2c390fa56c93 req-b0a46c47-fd69-47fa-98d7-69420da50a67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd64235e-b7e5-4a81-a2f8-49bb09fecdf9", "name": "network-vif-plugged", "status": "completed", "tag": "f96d9d76-2187-4026-8333-d92e5985ac08"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:19.831268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-208f2cdf-73f5-4faf-b763-2c390fa56c93 req-b0a46c47-fd69-47fa-98d7-69420da50a67 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:19.831992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-208f2cdf-73f5-4faf-b763-2c390fa56c93 req-b0a46c47-fd69-47fa-98d7-69420da50a67 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:19.832910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-208f2cdf-73f5-4faf-b763-2c390fa56c93 req-b0a46c47-fd69-47fa-98d7-69420da50a67 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:19.852834 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-208f2cdf-73f5-4faf-b763-2c390fa56c93 req-b0a46c47-fd69-47fa-98d7-69420da50a67 service nova] Creating event network-vif-plugged:f96d9d76-2187-4026-8333-d92e5985ac08 for instance bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 on n-h1-852087-9 Sep 07 12:31:19.865689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-208f2cdf-73f5-4faf-b763-2c390fa56c93 req-b0a46c47-fd69-47fa-98d7-69420da50a67 service nova] Instance bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 12:31:19.890106 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-208f2cdf-73f5-4faf-b763-2c390fa56c93 req-b0a46c47-fd69-47fa-98d7-69420da50a67 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088173 Sep 07 12:31:19.891778 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 413/818] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:31:19.918235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-056c1763-656f-4ce5-a728-001941579a07 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:19.918962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-056c1763-656f-4ce5-a728-001941579a07 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:19.926230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-056c1763-656f-4ce5-a728-001941579a07 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:19.926734 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-056c1763-656f-4ce5-a728-001941579a07 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:19.927178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-056c1763-656f-4ce5-a728-001941579a07 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:19.928097 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-056c1763-656f-4ce5-a728-001941579a07 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:19.928567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-056c1763-656f-4ce5-a728-001941579a07 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:19.928999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-056c1763-656f-4ce5-a728-001941579a07 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:20.154442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-056c1763-656f-4ce5-a728-001941579a07 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lazy-loading 'services' on Instance uuid 7e48b0d0-a574-476c-8054-97b544b3d24f {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:31:20.187293 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-056c1763-656f-4ce5-a728-001941579a07 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1935 microversion: 2.75 time: 0.273231 Sep 07 12:31:20.189506 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 414/819] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:19 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1935 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:31:20.199876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f582f59e-c452-4b83-903c-5a9224ed875c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:20.201397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f582f59e-c452-4b83-903c-5a9224ed875c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:20.217196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f582f59e-c452-4b83-903c-5a9224ed875c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:20.218704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f582f59e-c452-4b83-903c-5a9224ed875c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:20.219809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f582f59e-c452-4b83-903c-5a9224ed875c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:20.221352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f582f59e-c452-4b83-903c-5a9224ed875c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:20.222339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f582f59e-c452-4b83-903c-5a9224ed875c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:20.223187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f582f59e-c452-4b83-903c-5a9224ed875c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:20.371969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6aa8c1ec-95e9-4383-8b8f-e309481417c9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:20.387761 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6aa8c1ec-95e9-4383-8b8f-e309481417c9 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1471 microversion: 2.1 time: 0.786556 Sep 07 12:31:20.389273 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 406/820] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:19 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1471 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:31:20.544546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f582f59e-c452-4b83-903c-5a9224ed875c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:20.556205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-60b16c14-1e6a-4fc5-a081-d7ca2a1098ee tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:20.557196 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-60b16c14-1e6a-4fc5-a081-d7ca2a1098ee tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:20.563714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f582f59e-c452-4b83-903c-5a9224ed875c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:20.565793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f582f59e-c452-4b83-903c-5a9224ed875c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:20.569603 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f582f59e-c452-4b83-903c-5a9224ed875c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1361 microversion: 2.25 time: 0.376399 Sep 07 12:31:20.570581 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 415/821] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:20 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1361 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:20.571463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60b16c14-1e6a-4fc5-a081-d7ca2a1098ee tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:20.572087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60b16c14-1e6a-4fc5-a081-d7ca2a1098ee tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:20.572921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60b16c14-1e6a-4fc5-a081-d7ca2a1098ee tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:20.574176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60b16c14-1e6a-4fc5-a081-d7ca2a1098ee tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:20.574907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60b16c14-1e6a-4fc5-a081-d7ca2a1098ee tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:20.575480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60b16c14-1e6a-4fc5-a081-d7ca2a1098ee tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:20.694664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-60b16c14-1e6a-4fc5-a081-d7ca2a1098ee tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:20.710539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-60b16c14-1e6a-4fc5-a081-d7ca2a1098ee tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:20.712625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-60b16c14-1e6a-4fc5-a081-d7ca2a1098ee tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:20.719837 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-60b16c14-1e6a-4fc5-a081-d7ca2a1098ee tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.169950 Sep 07 12:31:20.720780 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 407/822] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:20 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:21.223296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-638e28a5-143a-47ea-8063-84c53123dea4 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:21.224487 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-638e28a5-143a-47ea-8063-84c53123dea4 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:21.236948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-638e28a5-143a-47ea-8063-84c53123dea4 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:21.237848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-638e28a5-143a-47ea-8063-84c53123dea4 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:21.238693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-638e28a5-143a-47ea-8063-84c53123dea4 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:21.239996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-638e28a5-143a-47ea-8063-84c53123dea4 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:21.240853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-638e28a5-143a-47ea-8063-84c53123dea4 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:21.241707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-638e28a5-143a-47ea-8063-84c53123dea4 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:21.406663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-638e28a5-143a-47ea-8063-84c53123dea4 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lazy-loading 'services' on Instance uuid 7e48b0d0-a574-476c-8054-97b544b3d24f {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:31:21.419248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5e05d865-c424-4c3f-83b8-6b032561a2b0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:21.420460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5e05d865-c424-4c3f-83b8-6b032561a2b0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:21.434542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=20,nova_api:INSERT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:21.439756 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-638e28a5-143a-47ea-8063-84c53123dea4 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1935 microversion: 2.75 time: 0.223878 Sep 07 12:31:21.441075 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 416/823] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:21 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1935 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:21.446314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e05d865-c424-4c3f-83b8-6b032561a2b0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:21.447062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e05d865-c424-4c3f-83b8-6b032561a2b0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:21.447689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e05d865-c424-4c3f-83b8-6b032561a2b0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:21.448778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e05d865-c424-4c3f-83b8-6b032561a2b0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:21.450094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e05d865-c424-4c3f-83b8-6b032561a2b0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:21.452550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e05d865-c424-4c3f-83b8-6b032561a2b0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:21.598381 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-15cf323b-8c3f-4b0c-8caf-3a2f52458032 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:21.599494 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-15cf323b-8c3f-4b0c-8caf-3a2f52458032 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:21.608244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15cf323b-8c3f-4b0c-8caf-3a2f52458032 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:21.608860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15cf323b-8c3f-4b0c-8caf-3a2f52458032 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:21.609532 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15cf323b-8c3f-4b0c-8caf-3a2f52458032 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:21.610812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15cf323b-8c3f-4b0c-8caf-3a2f52458032 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:21.611423 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15cf323b-8c3f-4b0c-8caf-3a2f52458032 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:21.611987 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15cf323b-8c3f-4b0c-8caf-3a2f52458032 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:21.861861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5e05d865-c424-4c3f-83b8-6b032561a2b0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:21.884695 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5e05d865-c424-4c3f-83b8-6b032561a2b0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1471 microversion: 2.1 time: 0.472630 Sep 07 12:31:21.907300 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 408/824] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:21 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1471 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:21.937877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-323d8a37-2d48-41c4-9477-ee8556e81ee2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:21.943247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-323d8a37-2d48-41c4-9477-ee8556e81ee2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:21.964786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-323d8a37-2d48-41c4-9477-ee8556e81ee2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:21.965729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-323d8a37-2d48-41c4-9477-ee8556e81ee2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:21.968942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-323d8a37-2d48-41c4-9477-ee8556e81ee2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:21.970482 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-323d8a37-2d48-41c4-9477-ee8556e81ee2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:21.971583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-323d8a37-2d48-41c4-9477-ee8556e81ee2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:21.972912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-323d8a37-2d48-41c4-9477-ee8556e81ee2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:22.017109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-15cf323b-8c3f-4b0c-8caf-3a2f52458032 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:22.037063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-15cf323b-8c3f-4b0c-8caf-3a2f52458032 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:22.038683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-15cf323b-8c3f-4b0c-8caf-3a2f52458032 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:22.039901 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-15cf323b-8c3f-4b0c-8caf-3a2f52458032 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1361 microversion: 2.25 time: 0.447453 Sep 07 12:31:22.045649 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 417/825] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:21 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1361 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:31:22.046025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e3d2b30e-1448-4e3c-b961-bd4562239c86 req-42b3407f-429d-4030-bfc6-23811c4eea81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a72bc8e2-53a9-4c43-83b1-c86bfef2e918", "tag": "840128a7-29eb-4c42-8c9d-e4c58a31e527"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:22.078526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e3d2b30e-1448-4e3c-b961-bd4562239c86 req-42b3407f-429d-4030-bfc6-23811c4eea81 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:22.079285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e3d2b30e-1448-4e3c-b961-bd4562239c86 req-42b3407f-429d-4030-bfc6-23811c4eea81 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:22.079873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e3d2b30e-1448-4e3c-b961-bd4562239c86 req-42b3407f-429d-4030-bfc6-23811c4eea81 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:22.110777 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e3d2b30e-1448-4e3c-b961-bd4562239c86 req-42b3407f-429d-4030-bfc6-23811c4eea81 service nova] Creating event network-changed:840128a7-29eb-4c42-8c9d-e4c58a31e527 for instance a72bc8e2-53a9-4c43-83b1-c86bfef2e918 on n-h1-852087-9 Sep 07 12:31:22.118153 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e3d2b30e-1448-4e3c-b961-bd4562239c86 req-42b3407f-429d-4030-bfc6-23811c4eea81 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075836 Sep 07 12:31:22.119386 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 418/826] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:31:22.252273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-323d8a37-2d48-41c4-9477-ee8556e81ee2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:22.279541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-323d8a37-2d48-41c4-9477-ee8556e81ee2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:22.283862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-323d8a37-2d48-41c4-9477-ee8556e81ee2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:22.296182 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-323d8a37-2d48-41c4-9477-ee8556e81ee2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.387138 Sep 07 12:31:22.298027 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 409/827] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:21 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:22.490305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7366c61c-15c0-46e4-9065-544f9dfe8eda tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:22.492655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7366c61c-15c0-46e4-9065-544f9dfe8eda tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:22.506971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7366c61c-15c0-46e4-9065-544f9dfe8eda tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:22.509676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7366c61c-15c0-46e4-9065-544f9dfe8eda tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:22.510875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7366c61c-15c0-46e4-9065-544f9dfe8eda tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:22.512539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7366c61c-15c0-46e4-9065-544f9dfe8eda tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:22.513754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7366c61c-15c0-46e4-9065-544f9dfe8eda tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:22.514901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7366c61c-15c0-46e4-9065-544f9dfe8eda tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:22.872804 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-7366c61c-15c0-46e4-9065-544f9dfe8eda tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lazy-loading 'services' on Instance uuid 7e48b0d0-a574-476c-8054-97b544b3d24f {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:31:22.912723 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7366c61c-15c0-46e4-9065-544f9dfe8eda tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1935 microversion: 2.75 time: 0.433493 Sep 07 12:31:22.915481 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 419/828] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:22 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1935 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:22.936598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1dace25a-4745-4db6-a8eb-5fb02c3b24e3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:22.940089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1dace25a-4745-4db6-a8eb-5fb02c3b24e3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:22.956581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dace25a-4745-4db6-a8eb-5fb02c3b24e3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:22.958212 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dace25a-4745-4db6-a8eb-5fb02c3b24e3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:22.962415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dace25a-4745-4db6-a8eb-5fb02c3b24e3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:22.970370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dace25a-4745-4db6-a8eb-5fb02c3b24e3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:22.974527 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dace25a-4745-4db6-a8eb-5fb02c3b24e3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:22.978447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dace25a-4745-4db6-a8eb-5fb02c3b24e3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:23.101425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4a3ae09d-fe9d-496b-ae32-f27244c41879 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:23.103409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4a3ae09d-fe9d-496b-ae32-f27244c41879 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:23.120087 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a3ae09d-fe9d-496b-ae32-f27244c41879 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:23.121096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a3ae09d-fe9d-496b-ae32-f27244c41879 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:23.122297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a3ae09d-fe9d-496b-ae32-f27244c41879 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:23.123964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a3ae09d-fe9d-496b-ae32-f27244c41879 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:23.125351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a3ae09d-fe9d-496b-ae32-f27244c41879 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:23.126471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a3ae09d-fe9d-496b-ae32-f27244c41879 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:23.276165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1dace25a-4745-4db6-a8eb-5fb02c3b24e3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:23.290532 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1dace25a-4745-4db6-a8eb-5fb02c3b24e3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1471 microversion: 2.1 time: 0.363000 Sep 07 12:31:23.291628 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 410/829] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:22 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1471 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:23.351051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-405d4340-6653-4361-b112-644bccbd7ba4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:23.351957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-405d4340-6653-4361-b112-644bccbd7ba4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:23.358925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-405d4340-6653-4361-b112-644bccbd7ba4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:23.359426 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-405d4340-6653-4361-b112-644bccbd7ba4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:23.360106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-405d4340-6653-4361-b112-644bccbd7ba4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:23.360842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-405d4340-6653-4361-b112-644bccbd7ba4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:23.361310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-405d4340-6653-4361-b112-644bccbd7ba4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:23.363030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-405d4340-6653-4361-b112-644bccbd7ba4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:23.529188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-405d4340-6653-4361-b112-644bccbd7ba4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:23.560694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-405d4340-6653-4361-b112-644bccbd7ba4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:23.562661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4a3ae09d-fe9d-496b-ae32-f27244c41879 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:23.564408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-405d4340-6653-4361-b112-644bccbd7ba4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:23.572020 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-405d4340-6653-4361-b112-644bccbd7ba4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.225199 Sep 07 12:31:23.573627 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 411/830] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:23 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:31:23.597056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4a3ae09d-fe9d-496b-ae32-f27244c41879 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:23.599090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4a3ae09d-fe9d-496b-ae32-f27244c41879 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:23.600511 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4a3ae09d-fe9d-496b-ae32-f27244c41879 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1361 microversion: 2.25 time: 0.506855 Sep 07 12:31:23.601770 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 420/831] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:23 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1361 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:23.971990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3fc9a962-021e-49e0-875d-736b228a2a71 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:23.972973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3fc9a962-021e-49e0-875d-736b228a2a71 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:23.979999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fc9a962-021e-49e0-875d-736b228a2a71 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:23.980559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fc9a962-021e-49e0-875d-736b228a2a71 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:23.981201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fc9a962-021e-49e0-875d-736b228a2a71 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:23.981993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fc9a962-021e-49e0-875d-736b228a2a71 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:23.982437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fc9a962-021e-49e0-875d-736b228a2a71 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:23.983066 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fc9a962-021e-49e0-875d-736b228a2a71 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:24.073320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-3fc9a962-021e-49e0-875d-736b228a2a71 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] Lazy-loading 'services' on Instance uuid 7e48b0d0-a574-476c-8054-97b544b3d24f {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:31:24.099212 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3fc9a962-021e-49e0-875d-736b228a2a71 tempest-ServersAdmin275Test-290861574 tempest-ServersAdmin275Test-290861574-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1920 microversion: 2.75 time: 0.130798 Sep 07 12:31:24.100497 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 412/832] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:23 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1920 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:31:24.147239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ec3b0b02-5799-44f8-961e-a528c731c318 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:24.148799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ec3b0b02-5799-44f8-961e-a528c731c318 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:24.157521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec3b0b02-5799-44f8-961e-a528c731c318 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:24.158141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec3b0b02-5799-44f8-961e-a528c731c318 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:24.158706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec3b0b02-5799-44f8-961e-a528c731c318 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:24.159490 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec3b0b02-5799-44f8-961e-a528c731c318 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:24.160029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec3b0b02-5799-44f8-961e-a528c731c318 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:24.160744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec3b0b02-5799-44f8-961e-a528c731c318 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:24.218046 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ec3b0b02-5799-44f8-961e-a528c731c318 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:31:24.322306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e5a4b6c1-f3ba-4ddd-b7de-a2262cec15ba tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:24.328345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e5a4b6c1-f3ba-4ddd-b7de-a2262cec15ba tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:24.344900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5a4b6c1-f3ba-4ddd-b7de-a2262cec15ba tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:24.346256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5a4b6c1-f3ba-4ddd-b7de-a2262cec15ba tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:24.347095 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5a4b6c1-f3ba-4ddd-b7de-a2262cec15ba tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:24.348624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5a4b6c1-f3ba-4ddd-b7de-a2262cec15ba tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:24.349774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5a4b6c1-f3ba-4ddd-b7de-a2262cec15ba tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:24.350692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5a4b6c1-f3ba-4ddd-b7de-a2262cec15ba tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:24.400463 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ec3b0b02-5799-44f8-961e-a528c731c318 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 204 len: 0 microversion: 2.75 time: 0.259869 Sep 07 12:31:24.401108 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 421/833] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 12:31:24 2022] DELETE /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:31:24.414382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a194d00f-e7d1-4b1a-ac32-7a849f8ae87a tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:24.415500 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a194d00f-e7d1-4b1a-ac32-7a849f8ae87a tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:24.424285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a194d00f-e7d1-4b1a-ac32-7a849f8ae87a tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:24.425265 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a194d00f-e7d1-4b1a-ac32-7a849f8ae87a tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:24.426040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a194d00f-e7d1-4b1a-ac32-7a849f8ae87a tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:24.427094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a194d00f-e7d1-4b1a-ac32-7a849f8ae87a tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:24.427628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a194d00f-e7d1-4b1a-ac32-7a849f8ae87a tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:24.428144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a194d00f-e7d1-4b1a-ac32-7a849f8ae87a tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:24.586900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a194d00f-e7d1-4b1a-ac32-7a849f8ae87a tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:24.603490 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:24.624016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a194d00f-e7d1-4b1a-ac32-7a849f8ae87a tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:24.626278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a194d00f-e7d1-4b1a-ac32-7a849f8ae87a tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:24.638819 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a194d00f-e7d1-4b1a-ac32-7a849f8ae87a tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1444 microversion: 2.75 time: 0.230765 Sep 07 12:31:24.640324 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 422/834] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:24 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1444 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:24.655481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d5d216f8-fd58-4483-9a53-8dc6392995e6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:24.656496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d5d216f8-fd58-4483-9a53-8dc6392995e6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:24.667704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5d216f8-fd58-4483-9a53-8dc6392995e6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:24.670761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5d216f8-fd58-4483-9a53-8dc6392995e6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:24.671393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5d216f8-fd58-4483-9a53-8dc6392995e6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:24.672886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5d216f8-fd58-4483-9a53-8dc6392995e6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:24.674636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5d216f8-fd58-4483-9a53-8dc6392995e6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:24.675548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5d216f8-fd58-4483-9a53-8dc6392995e6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:24.711724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e5a4b6c1-f3ba-4ddd-b7de-a2262cec15ba tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:24.729901 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e5a4b6c1-f3ba-4ddd-b7de-a2262cec15ba tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1471 microversion: 2.1 time: 0.414738 Sep 07 12:31:24.745517 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 413/835] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:24 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1471 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:24.774890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ceb864e-5c6f-41dd-8ed8-2c21a3653454 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:24.779858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3ceb864e-5c6f-41dd-8ed8-2c21a3653454 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:24.813713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ceb864e-5c6f-41dd-8ed8-2c21a3653454 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:24.814594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ceb864e-5c6f-41dd-8ed8-2c21a3653454 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:24.815774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ceb864e-5c6f-41dd-8ed8-2c21a3653454 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:24.816859 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ceb864e-5c6f-41dd-8ed8-2c21a3653454 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:24.822488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ceb864e-5c6f-41dd-8ed8-2c21a3653454 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:24.823488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ceb864e-5c6f-41dd-8ed8-2c21a3653454 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:24.864317 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=12 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:24.951706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d5d216f8-fd58-4483-9a53-8dc6392995e6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:24.955122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:24.972960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d5d216f8-fd58-4483-9a53-8dc6392995e6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:24.976620 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d5d216f8-fd58-4483-9a53-8dc6392995e6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:24.993724 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d5d216f8-fd58-4483-9a53-8dc6392995e6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.351511 Sep 07 12:31:24.995048 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 423/836] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:24 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:25.100540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=42,nova_cell0:UPDATE=12 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:25.460912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3ceb864e-5c6f-41dd-8ed8-2c21a3653454 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:25.495185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3ceb864e-5c6f-41dd-8ed8-2c21a3653454 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:25.504940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3ceb864e-5c6f-41dd-8ed8-2c21a3653454 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:25.508198 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ceb864e-5c6f-41dd-8ed8-2c21a3653454 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1361 microversion: 2.25 time: 0.774184 Sep 07 12:31:25.514177 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 414/837] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:24 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1361 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:25.671784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e4eff8df-e3a4-496f-a4d8-ffc96da40ac4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:25.679481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e4eff8df-e3a4-496f-a4d8-ffc96da40ac4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:25.698430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4eff8df-e3a4-496f-a4d8-ffc96da40ac4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:25.700422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4eff8df-e3a4-496f-a4d8-ffc96da40ac4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:25.701393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4eff8df-e3a4-496f-a4d8-ffc96da40ac4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:25.704086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4eff8df-e3a4-496f-a4d8-ffc96da40ac4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:25.705243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4eff8df-e3a4-496f-a4d8-ffc96da40ac4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:25.705830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4eff8df-e3a4-496f-a4d8-ffc96da40ac4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:25.767379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0adcbc2c-4669-4600-8588-3d648b8deaed tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:25.771660 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0adcbc2c-4669-4600-8588-3d648b8deaed tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:25.811069 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0adcbc2c-4669-4600-8588-3d648b8deaed tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:25.812295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0adcbc2c-4669-4600-8588-3d648b8deaed tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:25.813315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0adcbc2c-4669-4600-8588-3d648b8deaed tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:25.817100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0adcbc2c-4669-4600-8588-3d648b8deaed tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:25.818378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0adcbc2c-4669-4600-8588-3d648b8deaed tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:25.819382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0adcbc2c-4669-4600-8588-3d648b8deaed tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:25.880079 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e4eff8df-e3a4-496f-a4d8-ffc96da40ac4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:25.929117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e4eff8df-e3a4-496f-a4d8-ffc96da40ac4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:25.931106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e4eff8df-e3a4-496f-a4d8-ffc96da40ac4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:25.950972 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e4eff8df-e3a4-496f-a4d8-ffc96da40ac4 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1444 microversion: 2.75 time: 0.277276 Sep 07 12:31:25.952663 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 424/838] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:25 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1444 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:26.052806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f2dc2194-67ee-4a84-b5c9-17736f79a8f3 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:26.057717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f2dc2194-67ee-4a84-b5c9-17736f79a8f3 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:26.082675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2dc2194-67ee-4a84-b5c9-17736f79a8f3 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:26.083557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2dc2194-67ee-4a84-b5c9-17736f79a8f3 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:26.084394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2dc2194-67ee-4a84-b5c9-17736f79a8f3 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:26.093784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2dc2194-67ee-4a84-b5c9-17736f79a8f3 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:26.095002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2dc2194-67ee-4a84-b5c9-17736f79a8f3 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:26.095547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2dc2194-67ee-4a84-b5c9-17736f79a8f3 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:26.262170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f2dc2194-67ee-4a84-b5c9-17736f79a8f3 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:26.278979 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f2dc2194-67ee-4a84-b5c9-17736f79a8f3 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:26.282829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f2dc2194-67ee-4a84-b5c9-17736f79a8f3 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:26.294229 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f2dc2194-67ee-4a84-b5c9-17736f79a8f3 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.248276 Sep 07 12:31:26.295232 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 425/839] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:26 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:26.413876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0adcbc2c-4669-4600-8588-3d648b8deaed tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:26.428786 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0adcbc2c-4669-4600-8588-3d648b8deaed tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1463 microversion: 2.1 time: 0.672357 Sep 07 12:31:26.429418 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 415/840] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:25 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1463 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:26.452879 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-78b963bd-0d8d-43d7-b03b-6239a6eebdf5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:26.454010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-78b963bd-0d8d-43d7-b03b-6239a6eebdf5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:26.474165 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78b963bd-0d8d-43d7-b03b-6239a6eebdf5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:26.475964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78b963bd-0d8d-43d7-b03b-6239a6eebdf5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:26.478889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78b963bd-0d8d-43d7-b03b-6239a6eebdf5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:26.480719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78b963bd-0d8d-43d7-b03b-6239a6eebdf5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:26.482037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78b963bd-0d8d-43d7-b03b-6239a6eebdf5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:26.484549 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78b963bd-0d8d-43d7-b03b-6239a6eebdf5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:26.561222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-90a8c50c-5f95-4242-8584-e82a4526e9ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:26.561894 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-90a8c50c-5f95-4242-8584-e82a4526e9ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:26.588423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90a8c50c-5f95-4242-8584-e82a4526e9ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:26.591727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90a8c50c-5f95-4242-8584-e82a4526e9ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:26.592563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90a8c50c-5f95-4242-8584-e82a4526e9ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:26.594043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90a8c50c-5f95-4242-8584-e82a4526e9ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:26.595960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90a8c50c-5f95-4242-8584-e82a4526e9ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:26.598670 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90a8c50c-5f95-4242-8584-e82a4526e9ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:26.611425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:26.923923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-78b963bd-0d8d-43d7-b03b-6239a6eebdf5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:26.932147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-90a8c50c-5f95-4242-8584-e82a4526e9ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:26.934518 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-78b963bd-0d8d-43d7-b03b-6239a6eebdf5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1463 microversion: 2.1 time: 0.486878 Sep 07 12:31:26.935510 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 426/841] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:26 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1463 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:26.956795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-90a8c50c-5f95-4242-8584-e82a4526e9ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:26.963610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b531e965-fe6b-4a30-825a-6b9758eec803 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Action: 'create', calling method: .version_select at 0x7fc4199a6310>, body: {"keypair": {"name": "tempest-keypair-103927303", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA2tf9g04PRvAy4xI0K6a/nAq4+/+jk2y/EEpyVulGTZfqZrVqMQsW7wPQayymS+HHuYHwVgby/4R8/uHC4hDP1/hM/ztBRxfOofK7hDz1zf5CNk0Zyy50hjmV7ujlTFw=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:26.973096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:26.978858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-90a8c50c-5f95-4242-8584-e82a4526e9ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:26.981147 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-90a8c50c-5f95-4242-8584-e82a4526e9ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1361 microversion: 2.25 time: 0.423782 Sep 07 12:31:26.994790 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 416/842] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:26 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1361 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:31:27.015503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-359e7ff8-380a-4735-bbc3-4af7ec421045 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:27.016331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-359e7ff8-380a-4735-bbc3-4af7ec421045 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:27.022855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-b531e965-fe6b-4a30-825a-6b9758eec803 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Getting quotas for project 43a1115550de4c5185de7ca86bc17a63. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:31:27.028295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-359e7ff8-380a-4735-bbc3-4af7ec421045 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:27.030226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-359e7ff8-380a-4735-bbc3-4af7ec421045 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:27.031387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-359e7ff8-380a-4735-bbc3-4af7ec421045 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:27.032369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-b531e965-fe6b-4a30-825a-6b9758eec803 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Getting quotas for user 1b5c31587a37465a9becda30e417ed5b and project 43a1115550de4c5185de7ca86bc17a63. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:31:27.033372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-359e7ff8-380a-4735-bbc3-4af7ec421045 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:27.035818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-359e7ff8-380a-4735-bbc3-4af7ec421045 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:27.037290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-359e7ff8-380a-4735-bbc3-4af7ec421045 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:27.094009 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b531e965-fe6b-4a30-825a-6b9758eec803 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.135224 Sep 07 12:31:27.102551 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 427/843] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 12:31:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:31:27.323778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3036f25a-d309-490b-bd5c-90d5145ac80d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:27.324380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3036f25a-d309-490b-bd5c-90d5145ac80d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:27.346512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3036f25a-d309-490b-bd5c-90d5145ac80d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:27.347214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3036f25a-d309-490b-bd5c-90d5145ac80d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:27.350822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3036f25a-d309-490b-bd5c-90d5145ac80d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:27.352841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3036f25a-d309-490b-bd5c-90d5145ac80d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:27.353352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3036f25a-d309-490b-bd5c-90d5145ac80d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:27.353845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3036f25a-d309-490b-bd5c-90d5145ac80d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:27.758026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-359e7ff8-380a-4735-bbc3-4af7ec421045 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:27.784578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-359e7ff8-380a-4735-bbc3-4af7ec421045 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:27.790954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-359e7ff8-380a-4735-bbc3-4af7ec421045 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:27.817952 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-359e7ff8-380a-4735-bbc3-4af7ec421045 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1444 microversion: 2.75 time: 0.821224 Sep 07 12:31:27.829559 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 417/844] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:26 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1444 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:27.866400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3036f25a-d309-490b-bd5c-90d5145ac80d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:27.881373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3036f25a-d309-490b-bd5c-90d5145ac80d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:27.883173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3036f25a-d309-490b-bd5c-90d5145ac80d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:27.908182 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3036f25a-d309-490b-bd5c-90d5145ac80d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.589208 Sep 07 12:31:27.908800 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 428/845] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:27 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:28.025808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ceb8a29a-204c-4587-881c-af913ef456a2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:28.026656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ceb8a29a-204c-4587-881c-af913ef456a2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:28.037268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ceb8a29a-204c-4587-881c-af913ef456a2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:28.041919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ceb8a29a-204c-4587-881c-af913ef456a2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:28.042531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ceb8a29a-204c-4587-881c-af913ef456a2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:28.043393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ceb8a29a-204c-4587-881c-af913ef456a2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:28.046274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ceb8a29a-204c-4587-881c-af913ef456a2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:28.047008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ceb8a29a-204c-4587-881c-af913ef456a2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:28.345790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ceb8a29a-204c-4587-881c-af913ef456a2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:28.359750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ceb8a29a-204c-4587-881c-af913ef456a2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:28.361265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ceb8a29a-204c-4587-881c-af913ef456a2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:28.362524 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ceb8a29a-204c-4587-881c-af913ef456a2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1361 microversion: 2.25 time: 0.342125 Sep 07 12:31:28.363102 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 418/846] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:28 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1361 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:28.869973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4ae1d74c-6bd1-41e0-90cf-2aa3c6710272 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:28.870986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4ae1d74c-6bd1-41e0-90cf-2aa3c6710272 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:28.894107 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ae1d74c-6bd1-41e0-90cf-2aa3c6710272 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:28.896040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ae1d74c-6bd1-41e0-90cf-2aa3c6710272 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:28.897635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ae1d74c-6bd1-41e0-90cf-2aa3c6710272 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:28.899288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ae1d74c-6bd1-41e0-90cf-2aa3c6710272 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:28.902752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ae1d74c-6bd1-41e0-90cf-2aa3c6710272 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:28.915462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ae1d74c-6bd1-41e0-90cf-2aa3c6710272 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:28.992949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c18246ee-0491-4f0c-b3cb-5024d7e80412 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:28.995765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c18246ee-0491-4f0c-b3cb-5024d7e80412 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:29.017241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c18246ee-0491-4f0c-b3cb-5024d7e80412 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:29.018181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c18246ee-0491-4f0c-b3cb-5024d7e80412 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:29.019269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c18246ee-0491-4f0c-b3cb-5024d7e80412 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:29.019610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ae1d74c-6bd1-41e0-90cf-2aa3c6710272 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:29.020362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ae1d74c-6bd1-41e0-90cf-2aa3c6710272 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:29.020944 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ae1d74c-6bd1-41e0-90cf-2aa3c6710272 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:29.021335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c18246ee-0491-4f0c-b3cb-5024d7e80412 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:29.021569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-4ae1d74c-6bd1-41e0-90cf-2aa3c6710272 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lazy-loading 'fault' on Instance uuid 7e48b0d0-a574-476c-8054-97b544b3d24f {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:31:29.022591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c18246ee-0491-4f0c-b3cb-5024d7e80412 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:29.023564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c18246ee-0491-4f0c-b3cb-5024d7e80412 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:29.096986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4ae1d74c-6bd1-41e0-90cf-2aa3c6710272 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:29.121834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4ae1d74c-6bd1-41e0-90cf-2aa3c6710272 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:29.124377 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4ae1d74c-6bd1-41e0-90cf-2aa3c6710272 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b04a91795e984d1795d27bd654eedf5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a211dad35e6f4610a329a0f481373807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:29.133822 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4ae1d74c-6bd1-41e0-90cf-2aa3c6710272 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 200 len: 1449 microversion: 2.75 time: 0.271766 Sep 07 12:31:29.158259 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 429/847] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:28 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 1449 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:29.172893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c18246ee-0491-4f0c-b3cb-5024d7e80412 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:29.210877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c18246ee-0491-4f0c-b3cb-5024d7e80412 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:29.216169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c18246ee-0491-4f0c-b3cb-5024d7e80412 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:29.227803 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c18246ee-0491-4f0c-b3cb-5024d7e80412 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.251956 Sep 07 12:31:29.242756 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 419/848] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:28 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:29.401240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b2da873-d767-4e80-ab39-d2e31c73615b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:29.403399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2b2da873-d767-4e80-ab39-d2e31c73615b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:29.416985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b2da873-d767-4e80-ab39-d2e31c73615b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:29.418491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b2da873-d767-4e80-ab39-d2e31c73615b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:29.419586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b2da873-d767-4e80-ab39-d2e31c73615b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:29.421150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b2da873-d767-4e80-ab39-d2e31c73615b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:29.422732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b2da873-d767-4e80-ab39-d2e31c73615b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:29.424558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b2da873-d767-4e80-ab39-d2e31c73615b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:29.723924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0b652f89-0a1c-4be6-8a37-836c2192e3e6 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Calling method '.version_select at 0x7fc4193fc3a0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:29.727873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b652f89-0a1c-4be6-8a37-836c2192e3e6 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:29.728947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b652f89-0a1c-4be6-8a37-836c2192e3e6 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:29.731468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b652f89-0a1c-4be6-8a37-836c2192e3e6 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:29.744064 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0b652f89-0a1c-4be6-8a37-836c2192e3e6 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1570 microversion: 2.1 time: 0.024733 Sep 07 12:31:29.745292 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 420/849] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Sep 7 12:31:29 2022] GET /compute/v2.1/os-migrations => generated 1570 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:31:29.769263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5c677026-cfd4-4cb8-8bc7-645f1a86e337 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:29.779566 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5c677026-cfd4-4cb8-8bc7-645f1a86e337 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014183 Sep 07 12:31:29.780846 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 421/850] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:31:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:31:29.796316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0e5b96c0-d552-44d3-a699-87ee0d27ad8f tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1335368208", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:29.818761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2b2da873-d767-4e80-ab39-d2e31c73615b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:29.827912 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0e5b96c0-d552-44d3-a699-87ee0d27ad8f tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.038651 Sep 07 12:31:29.829283 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 422/851] 10.222.0.16 () {60 vars in 1146 bytes} [Wed Sep 7 12:31:29 2022] POST /compute/v2.1/flavors => generated 499 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:31:29.842632 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9e19aa31-edc4-44b1-992a-7a3a2e2d03e2 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:29.847718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2b2da873-d767-4e80-ab39-d2e31c73615b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:29.852099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2b2da873-d767-4e80-ab39-d2e31c73615b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:29.853053 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9e19aa31-edc4-44b1-992a-7a3a2e2d03e2 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014269 Sep 07 12:31:29.859734 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2b2da873-d767-4e80-ab39-d2e31c73615b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1361 microversion: 2.25 time: 0.462124 Sep 07 12:31:29.863585 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 430/852] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:29 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1361 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:29.872772 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 423/853] 10.222.0.16 () {58 vars in 1182 bytes} [Wed Sep 7 12:31:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:31:30.005055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2ced4b06-3690-46cd-b81f-69dfcd0ec197 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2084030939", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "14658a2f-eb75-442b-89ee-ecf1d26c9c1e"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:30.082235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-2ced4b06-3690-46cd-b81f-69dfcd0ec197 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:31:30.164365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f4c9fed9-caa9-44e8-a955-dfc58a357c08 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:30.166193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f4c9fed9-caa9-44e8-a955-dfc58a357c08 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] [instance: 7e48b0d0-a574-476c-8054-97b544b3d24f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:30.173817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4c9fed9-caa9-44e8-a955-dfc58a357c08 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:30.174629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4c9fed9-caa9-44e8-a955-dfc58a357c08 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:30.175235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4c9fed9-caa9-44e8-a955-dfc58a357c08 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:30.176427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4c9fed9-caa9-44e8-a955-dfc58a357c08 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:30.177304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4c9fed9-caa9-44e8-a955-dfc58a357c08 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:30.177911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4c9fed9-caa9-44e8-a955-dfc58a357c08 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:30.211378 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-f4c9fed9-caa9-44e8-a955-dfc58a357c08 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] HTTP exception thrown: Instance 7e48b0d0-a574-476c-8054-97b544b3d24f could not be found. Sep 07 12:31:30.215194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f4c9fed9-caa9-44e8-a955-dfc58a357c08 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Request method failure captured: Sep 07 12:31:30.215194 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f HTTP/1.1 Sep 07 12:31:30.215194 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:31:30.215194 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:31:30.215194 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:31:30.215194 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:31:30.215194 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:31:30.215194 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:31:30.215194 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:31:30.215194 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:31:30.215194 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI7AwdI1Z6yC4GYFu5cPq9CA84cM1EF4CHEOnWewznN7tJ4Oi7VJKqMozGDCxF9eeg7smBN3U8f87Ld6lEkR9qWak-x4CcjwDWKDxbFrJgkSdCT2kk1rVexnKbOL_M_aO8EdhNexiz9_v6_dVZUhhe-QuK_AxZiR9TsT02hDUVv8F0M Sep 07 12:31:30.215194 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:31:30.215194 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:31:30.215194 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:31:30.215194 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:31:30.215194 n-d-852087-9 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.75 Sep 07 12:31:30.215194 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:31:30.215194 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:31:30.215194 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: a211dad35e6f4610a329a0f481373807 Sep 07 12:31:30.215194 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersAdmin275Test-58682786 Sep 07 12:31:30.215194 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:31:30.215194 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:31:30.218102 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a211dad35e6f4610a329a0f481373807"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a211dad35e6f4610a329a0f481373807"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a211dad35e6f4610a329a0f481373807"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a211dad35e6f4610a329a0f481373807"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:31:30.218102 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersAdmin275Test-58682786 Sep 07 12:31:30.218102 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: a211dad35e6f4610a329a0f481373807 Sep 07 12:31:30.218102 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersAdmin275Test-58682786 Sep 07 12:31:30.218102 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersAdmin275Test-58682786-project Sep 07 12:31:30.218102 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:31:30.218102 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:31:30.218102 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: b04a91795e984d1795d27bd654eedf5d Sep 07 12:31:30.218102 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersAdmin275Test-58682786-project Sep 07 12:31:30.218102 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:31:30.218102 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 7e48b0d0-a574-476c-8054-97b544b3d24f could not be found. Sep 07 12:31:30.218102 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '7e48b0d0-a574-476c-8054-97b544b3d24f'} Sep 07 12:31:30.219671 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:31:30.219671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:31:30.219671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:31:30.219671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:31:30.219671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:31:30.219671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:31:30.219671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:31:30.219671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:31:30.219671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:31:30.219671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:31:30.219671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e48b0d0-a574-476c-8054-97b544b3d24f could not be found. Sep 07 12:31:30.219671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:31:30.219671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:31:30.219671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:31:30.219671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:31:30.219671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:31:30.219671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:31:30.219671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:31:30.219671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:31:30.219671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:31:30.222378 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:31:30.222378 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:31:30.222378 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:31:30.222378 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:31:30.222378 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:31:30.222378 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:31:30.222378 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:31:30.222378 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e48b0d0-a574-476c-8054-97b544b3d24f could not be found. Sep 07 12:31:30.222378 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:31:30.222378 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:31:30.222378 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:31:30.222378 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:31:30.222378 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:31:30.222378 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:31:30.222378 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:31:30.222378 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:31:30.222378 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e48b0d0-a574-476c-8054-97b544b3d24f could not be found. Sep 07 12:31:30.222378 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:31:30.226373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f4c9fed9-caa9-44e8-a955-dfc58a357c08 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] Returning 404 to user: Instance 7e48b0d0-a574-476c-8054-97b544b3d24f could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:31:30.228361 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f4c9fed9-caa9-44e8-a955-dfc58a357c08 tempest-ServersAdmin275Test-58682786 tempest-ServersAdmin275Test-58682786-project] 10.222.0.16 "GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f" status: 404 len: 111 microversion: 2.75 time: 0.068132 Sep 07 12:31:30.232716 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 424/854] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:30 2022] GET /compute/v2.1/servers/7e48b0d0-a574-476c-8054-97b544b3d24f => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 07 12:31:30.285348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-43c2bbdd-62b7-41dd-a15e-848d2fcd1565 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:30.289623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-43c2bbdd-62b7-41dd-a15e-848d2fcd1565 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:30.309395 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43c2bbdd-62b7-41dd-a15e-848d2fcd1565 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:30.311385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43c2bbdd-62b7-41dd-a15e-848d2fcd1565 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:30.316802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43c2bbdd-62b7-41dd-a15e-848d2fcd1565 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:30.318505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43c2bbdd-62b7-41dd-a15e-848d2fcd1565 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:30.319556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43c2bbdd-62b7-41dd-a15e-848d2fcd1565 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:30.320496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43c2bbdd-62b7-41dd-a15e-848d2fcd1565 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:30.464885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-43c2bbdd-62b7-41dd-a15e-848d2fcd1565 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:30.483162 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-43c2bbdd-62b7-41dd-a15e-848d2fcd1565 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:30.489354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-43c2bbdd-62b7-41dd-a15e-848d2fcd1565 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:30.500526 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-43c2bbdd-62b7-41dd-a15e-848d2fcd1565 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.226858 Sep 07 12:31:30.520738 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 425/855] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:30 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:31:30.563945 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2ced4b06-3690-46cd-b81f-69dfcd0ec197 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:31:30.564993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2ced4b06-3690-46cd-b81f-69dfcd0ec197 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:31:30.566567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2ced4b06-3690-46cd-b81f-69dfcd0ec197 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:31:30.567715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2ced4b06-3690-46cd-b81f-69dfcd0ec197 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:31:30.568528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2ced4b06-3690-46cd-b81f-69dfcd0ec197 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:31:30.586559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ced4b06-3690-46cd-b81f-69dfcd0ec197 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:30.588152 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ced4b06-3690-46cd-b81f-69dfcd0ec197 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:30.589220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ced4b06-3690-46cd-b81f-69dfcd0ec197 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:30.591112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ced4b06-3690-46cd-b81f-69dfcd0ec197 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:30.592140 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ced4b06-3690-46cd-b81f-69dfcd0ec197 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:30.592904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ced4b06-3690-46cd-b81f-69dfcd0ec197 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:30.655722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-2ced4b06-3690-46cd-b81f-69dfcd0ec197 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Getting quotas for project 43a1115550de4c5185de7ca86bc17a63. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:31:30.668260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-2ced4b06-3690-46cd-b81f-69dfcd0ec197 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Getting quotas for user 1b5c31587a37465a9becda30e417ed5b and project 43a1115550de4c5185de7ca86bc17a63. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:31:30.700061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2ced4b06-3690-46cd-b81f-69dfcd0ec197 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:31:30.706294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2ced4b06-3690-46cd-b81f-69dfcd0ec197 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:31:30.803611 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2ced4b06-3690-46cd-b81f-69dfcd0ec197 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.802624 Sep 07 12:31:30.805620 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 431/856] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:31:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:31:30.819860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a006efbb-9295-4aac-abb2-d8c6e5d0b3be tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:30.820794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a006efbb-9295-4aac-abb2-d8c6e5d0b3be tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:30.908559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-628bb4c6-0b53-413f-b657-cdb5aa97658b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:30.910656 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-628bb4c6-0b53-413f-b657-cdb5aa97658b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:30.949868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-628bb4c6-0b53-413f-b657-cdb5aa97658b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:30.952313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-628bb4c6-0b53-413f-b657-cdb5aa97658b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:30.953612 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-628bb4c6-0b53-413f-b657-cdb5aa97658b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:30.955451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-628bb4c6-0b53-413f-b657-cdb5aa97658b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:30.956904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-628bb4c6-0b53-413f-b657-cdb5aa97658b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:30.962043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-628bb4c6-0b53-413f-b657-cdb5aa97658b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:31.059019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a006efbb-9295-4aac-abb2-d8c6e5d0b3be tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:31.076760 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a006efbb-9295-4aac-abb2-d8c6e5d0b3be tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1279 microversion: 2.1 time: 0.260104 Sep 07 12:31:31.080226 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 426/857] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:30 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1279 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:31.318478 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-628bb4c6-0b53-413f-b657-cdb5aa97658b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:31.339329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-628bb4c6-0b53-413f-b657-cdb5aa97658b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:31.342824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-628bb4c6-0b53-413f-b657-cdb5aa97658b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:31.346714 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-628bb4c6-0b53-413f-b657-cdb5aa97658b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1361 microversion: 2.25 time: 0.455097 Sep 07 12:31:31.355496 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 432/858] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:30 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1361 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:31.513154 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-b9719a5b-f0c7-4d58-9ae9-1ef504032b8a req-baadf2b4-665f-401f-9a51-b2a6dca4beda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a72bc8e2-53a9-4c43-83b1-c86bfef2e918", "name": "network-vif-plugged", "status": "completed", "tag": "840128a7-29eb-4c42-8c9d-e4c58a31e527"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:31.531214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b9719a5b-f0c7-4d58-9ae9-1ef504032b8a req-baadf2b4-665f-401f-9a51-b2a6dca4beda service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:31.532497 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b9719a5b-f0c7-4d58-9ae9-1ef504032b8a req-baadf2b4-665f-401f-9a51-b2a6dca4beda service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:31.533298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b9719a5b-f0c7-4d58-9ae9-1ef504032b8a req-baadf2b4-665f-401f-9a51-b2a6dca4beda service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:31.558574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-17c3e063-9217-4167-b0fd-2b28472afdb4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:31.559686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-17c3e063-9217-4167-b0fd-2b28472afdb4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:31.570690 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-b9719a5b-f0c7-4d58-9ae9-1ef504032b8a req-baadf2b4-665f-401f-9a51-b2a6dca4beda service nova] Creating event network-vif-plugged:840128a7-29eb-4c42-8c9d-e4c58a31e527 for instance a72bc8e2-53a9-4c43-83b1-c86bfef2e918 on n-h1-852087-9 Sep 07 12:31:31.590503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17c3e063-9217-4167-b0fd-2b28472afdb4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:31.595165 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17c3e063-9217-4167-b0fd-2b28472afdb4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:31.596457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17c3e063-9217-4167-b0fd-2b28472afdb4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:31.598495 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17c3e063-9217-4167-b0fd-2b28472afdb4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:31.598886 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-b9719a5b-f0c7-4d58-9ae9-1ef504032b8a req-baadf2b4-665f-401f-9a51-b2a6dca4beda service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088895 Sep 07 12:31:31.601737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17c3e063-9217-4167-b0fd-2b28472afdb4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:31.602611 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 427/859] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:31:31.604089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17c3e063-9217-4167-b0fd-2b28472afdb4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:31.820254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-17c3e063-9217-4167-b0fd-2b28472afdb4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:31.851183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-17c3e063-9217-4167-b0fd-2b28472afdb4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:31.856950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-17c3e063-9217-4167-b0fd-2b28472afdb4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:31.880460 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-17c3e063-9217-4167-b0fd-2b28472afdb4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.330700 Sep 07 12:31:31.883437 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 433/860] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:31 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:31:32.117163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f42a5d90-1655-4067-b980-24455dea1c81 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:32.118763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f42a5d90-1655-4067-b980-24455dea1c81 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:32.132970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f42a5d90-1655-4067-b980-24455dea1c81 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:32.134019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f42a5d90-1655-4067-b980-24455dea1c81 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:32.135076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f42a5d90-1655-4067-b980-24455dea1c81 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:32.136854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f42a5d90-1655-4067-b980-24455dea1c81 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:32.151112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f42a5d90-1655-4067-b980-24455dea1c81 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:32.152340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f42a5d90-1655-4067-b980-24455dea1c81 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:32.338808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f42a5d90-1655-4067-b980-24455dea1c81 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:32.380221 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f42a5d90-1655-4067-b980-24455dea1c81 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1283 microversion: 2.1 time: 0.270090 Sep 07 12:31:32.381254 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 428/861] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:32 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1283 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:32.402038 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2393c7a9-16ee-4dfb-83cb-4702cc2444ff tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:32.403226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2393c7a9-16ee-4dfb-83cb-4702cc2444ff tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:32.425899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2393c7a9-16ee-4dfb-83cb-4702cc2444ff tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:32.426729 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2393c7a9-16ee-4dfb-83cb-4702cc2444ff tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:32.427720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2393c7a9-16ee-4dfb-83cb-4702cc2444ff tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:32.429653 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2393c7a9-16ee-4dfb-83cb-4702cc2444ff tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:32.430757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2393c7a9-16ee-4dfb-83cb-4702cc2444ff tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:32.431641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2393c7a9-16ee-4dfb-83cb-4702cc2444ff tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:32.875460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2393c7a9-16ee-4dfb-83cb-4702cc2444ff tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:32.919322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-105cca36-f74c-4766-b6f3-4302ce421e09 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:32.920627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-105cca36-f74c-4766-b6f3-4302ce421e09 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:32.926065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2393c7a9-16ee-4dfb-83cb-4702cc2444ff tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:32.930076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2393c7a9-16ee-4dfb-83cb-4702cc2444ff tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:32.932852 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2393c7a9-16ee-4dfb-83cb-4702cc2444ff tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1361 microversion: 2.25 time: 0.540422 Sep 07 12:31:32.951510 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-105cca36-f74c-4766-b6f3-4302ce421e09 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:32.952374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-105cca36-f74c-4766-b6f3-4302ce421e09 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:32.952828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-105cca36-f74c-4766-b6f3-4302ce421e09 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:32.953786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-105cca36-f74c-4766-b6f3-4302ce421e09 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:32.954295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-105cca36-f74c-4766-b6f3-4302ce421e09 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:32.955124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-105cca36-f74c-4766-b6f3-4302ce421e09 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:32.963492 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 434/862] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:32 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1361 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:33.064555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-105cca36-f74c-4766-b6f3-4302ce421e09 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:33.086274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-105cca36-f74c-4766-b6f3-4302ce421e09 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:33.088794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-105cca36-f74c-4766-b6f3-4302ce421e09 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:33.098468 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-105cca36-f74c-4766-b6f3-4302ce421e09 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.184017 Sep 07 12:31:33.110062 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 429/863] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:32 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:31:33.423855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e46edc7b-9afa-4ea5-818c-8380e9bef584 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:33.426677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e46edc7b-9afa-4ea5-818c-8380e9bef584 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:33.447435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e46edc7b-9afa-4ea5-818c-8380e9bef584 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:33.448925 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e46edc7b-9afa-4ea5-818c-8380e9bef584 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:33.450054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e46edc7b-9afa-4ea5-818c-8380e9bef584 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:33.452618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e46edc7b-9afa-4ea5-818c-8380e9bef584 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:33.454033 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e46edc7b-9afa-4ea5-818c-8380e9bef584 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:33.455443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e46edc7b-9afa-4ea5-818c-8380e9bef584 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:33.639893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e46edc7b-9afa-4ea5-818c-8380e9bef584 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:33.676544 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e46edc7b-9afa-4ea5-818c-8380e9bef584 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1331 microversion: 2.1 time: 0.256997 Sep 07 12:31:33.683566 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 435/864] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:33 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1331 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:33.991325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a28ac3e8-065c-4e17-8951-953cdcce903b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:33.993731 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a28ac3e8-065c-4e17-8951-953cdcce903b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:34.019682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a28ac3e8-065c-4e17-8951-953cdcce903b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:34.022268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a28ac3e8-065c-4e17-8951-953cdcce903b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:34.023012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a28ac3e8-065c-4e17-8951-953cdcce903b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:34.024003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a28ac3e8-065c-4e17-8951-953cdcce903b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:34.024736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a28ac3e8-065c-4e17-8951-953cdcce903b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:34.025641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a28ac3e8-065c-4e17-8951-953cdcce903b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:34.160288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-78f174d3-a742-453e-a0fb-3fbaceafe016 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:34.161039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-78f174d3-a742-453e-a0fb-3fbaceafe016 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:34.200103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78f174d3-a742-453e-a0fb-3fbaceafe016 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:34.201069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78f174d3-a742-453e-a0fb-3fbaceafe016 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:34.201560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78f174d3-a742-453e-a0fb-3fbaceafe016 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:34.202994 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78f174d3-a742-453e-a0fb-3fbaceafe016 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:34.209142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78f174d3-a742-453e-a0fb-3fbaceafe016 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:34.210233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78f174d3-a742-453e-a0fb-3fbaceafe016 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:34.376316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-78f174d3-a742-453e-a0fb-3fbaceafe016 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:34.413502 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a28ac3e8-065c-4e17-8951-953cdcce903b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:34.430915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-78f174d3-a742-453e-a0fb-3fbaceafe016 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:34.433690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a28ac3e8-065c-4e17-8951-953cdcce903b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:34.437412 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-78f174d3-a742-453e-a0fb-3fbaceafe016 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:34.439329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a28ac3e8-065c-4e17-8951-953cdcce903b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:34.440603 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a28ac3e8-065c-4e17-8951-953cdcce903b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1556 microversion: 2.25 time: 0.461046 Sep 07 12:31:34.443564 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 430/865] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:33 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1556 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:34.458530 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-78f174d3-a742-453e-a0fb-3fbaceafe016 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.301493 Sep 07 12:31:34.461024 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 436/866] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:34 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:31:34.715411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f0d3b487-a954-4928-8373-4a0113652d42 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:34.717628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f0d3b487-a954-4928-8373-4a0113652d42 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:34.751584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0d3b487-a954-4928-8373-4a0113652d42 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:34.752426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0d3b487-a954-4928-8373-4a0113652d42 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:34.753184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0d3b487-a954-4928-8373-4a0113652d42 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:34.754563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0d3b487-a954-4928-8373-4a0113652d42 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:34.755419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0d3b487-a954-4928-8373-4a0113652d42 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:34.756172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0d3b487-a954-4928-8373-4a0113652d42 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:34.875963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ef7bfc4-b6c0-41c0-a454-d0d591a3a9f3 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:34.876748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0ef7bfc4-b6c0-41c0-a454-d0d591a3a9f3 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:34.901377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ef7bfc4-b6c0-41c0-a454-d0d591a3a9f3 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:34.902301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ef7bfc4-b6c0-41c0-a454-d0d591a3a9f3 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:34.903018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ef7bfc4-b6c0-41c0-a454-d0d591a3a9f3 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:34.904201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ef7bfc4-b6c0-41c0-a454-d0d591a3a9f3 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:34.904920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ef7bfc4-b6c0-41c0-a454-d0d591a3a9f3 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:34.905649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ef7bfc4-b6c0-41c0-a454-d0d591a3a9f3 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:35.124491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f0d3b487-a954-4928-8373-4a0113652d42 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:35.142873 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f0d3b487-a954-4928-8373-4a0113652d42 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1337 microversion: 2.1 time: 0.434846 Sep 07 12:31:35.143712 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 437/867] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:34 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1337 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:35.293200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-0ef7bfc4-b6c0-41c0-a454-d0d591a3a9f3 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lazy-loading 'services' on Instance uuid a72bc8e2-53a9-4c43-83b1-c86bfef2e918 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:31:35.348381 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ef7bfc4-b6c0-41c0-a454-d0d591a3a9f3 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 2048 microversion: 2.25 time: 0.880520 Sep 07 12:31:35.349357 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 431/868] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:34 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 2048 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:35.396665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b8ea3218-1878-4515-ac60-7bcc1b48f4ca tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:35.397991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b8ea3218-1878-4515-ac60-7bcc1b48f4ca tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:35.409757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8ea3218-1878-4515-ac60-7bcc1b48f4ca tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:35.411115 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8ea3218-1878-4515-ac60-7bcc1b48f4ca tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:35.412279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8ea3218-1878-4515-ac60-7bcc1b48f4ca tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:35.414344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8ea3218-1878-4515-ac60-7bcc1b48f4ca tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:35.415542 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8ea3218-1878-4515-ac60-7bcc1b48f4ca tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:35.416554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8ea3218-1878-4515-ac60-7bcc1b48f4ca tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:35.495943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-60dba005-51c7-47ef-bcfb-40eed49f4a02 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:35.500935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-60dba005-51c7-47ef-bcfb-40eed49f4a02 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:35.520552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60dba005-51c7-47ef-bcfb-40eed49f4a02 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:35.522664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60dba005-51c7-47ef-bcfb-40eed49f4a02 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:35.523909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60dba005-51c7-47ef-bcfb-40eed49f4a02 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:35.525950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60dba005-51c7-47ef-bcfb-40eed49f4a02 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:35.527180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60dba005-51c7-47ef-bcfb-40eed49f4a02 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:35.528184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60dba005-51c7-47ef-bcfb-40eed49f4a02 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:35.716967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-60dba005-51c7-47ef-bcfb-40eed49f4a02 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:35.749599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-60dba005-51c7-47ef-bcfb-40eed49f4a02 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:35.753796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-60dba005-51c7-47ef-bcfb-40eed49f4a02 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:35.768778 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-60dba005-51c7-47ef-bcfb-40eed49f4a02 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.280837 Sep 07 12:31:35.771184 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 432/869] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:35 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:36.067607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-b8ea3218-1878-4515-ac60-7bcc1b48f4ca tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lazy-loading 'services' on Instance uuid a72bc8e2-53a9-4c43-83b1-c86bfef2e918 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:31:36.107526 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b8ea3218-1878-4515-ac60-7bcc1b48f4ca tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 2048 microversion: 2.25 time: 0.717334 Sep 07 12:31:36.109983 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 438/870] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:35 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 2048 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:36.157044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-96f995d2-d447-46f2-89df-2b55c3fdec07 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:36.165430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96f995d2-d447-46f2-89df-2b55c3fdec07 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:36.166769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96f995d2-d447-46f2-89df-2b55c3fdec07 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:36.167982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96f995d2-d447-46f2-89df-2b55c3fdec07 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:36.173854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96f995d2-d447-46f2-89df-2b55c3fdec07 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:36.175504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96f995d2-d447-46f2-89df-2b55c3fdec07 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:36.178525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96f995d2-d447-46f2-89df-2b55c3fdec07 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:36.211433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a9ac9dde-d596-470f-bd70-50496123dddc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:36.217352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a9ac9dde-d596-470f-bd70-50496123dddc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:36.237285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9ac9dde-d596-470f-bd70-50496123dddc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:36.241978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9ac9dde-d596-470f-bd70-50496123dddc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:36.242566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9ac9dde-d596-470f-bd70-50496123dddc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:36.245758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9ac9dde-d596-470f-bd70-50496123dddc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:36.246327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9ac9dde-d596-470f-bd70-50496123dddc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:36.249090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9ac9dde-d596-470f-bd70-50496123dddc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:36.252378 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-96f995d2-d447-46f2-89df-2b55c3fdec07 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.098778 Sep 07 12:31:36.259982 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 433/871] 10.222.0.16 () {60 vars in 1217 bytes} [Wed Sep 7 12:31:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:31:36.280525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0a7691e4-07eb-467c-9514-e32e9234f3c3 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852087-9", "block_migration": "auto"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:36.289955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0a7691e4-07eb-467c-9514-e32e9234f3c3 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:36.313172 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a7691e4-07eb-467c-9514-e32e9234f3c3 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:36.318424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a7691e4-07eb-467c-9514-e32e9234f3c3 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:36.319628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a7691e4-07eb-467c-9514-e32e9234f3c3 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:36.322227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a7691e4-07eb-467c-9514-e32e9234f3c3 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:36.323962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a7691e4-07eb-467c-9514-e32e9234f3c3 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:36.324543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a7691e4-07eb-467c-9514-e32e9234f3c3 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:36.771513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-0a7691e4-07eb-467c-9514-e32e9234f3c3 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lazy-loading 'flavor' on Instance uuid a72bc8e2-53a9-4c43-83b1-c86bfef2e918 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:31:36.834960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0a7691e4-07eb-467c-9514-e32e9234f3c3 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Going to try to live migrate instance to n-h2-852087-9 {{(pid=122433) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 07 12:31:36.919035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a9ac9dde-d596-470f-bd70-50496123dddc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:36.953144 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a9ac9dde-d596-470f-bd70-50496123dddc tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1379 microversion: 2.1 time: 0.755067 Sep 07 12:31:36.962411 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 439/872] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:36 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1379 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:31:36.980129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-03d6db47-124f-4b75-a020-776366e40f48 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:36.981249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-03d6db47-124f-4b75-a020-776366e40f48 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:37.030015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03d6db47-124f-4b75-a020-776366e40f48 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:37.032176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03d6db47-124f-4b75-a020-776366e40f48 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:37.035636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03d6db47-124f-4b75-a020-776366e40f48 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:37.043236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03d6db47-124f-4b75-a020-776366e40f48 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:37.045096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03d6db47-124f-4b75-a020-776366e40f48 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:37.048088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03d6db47-124f-4b75-a020-776366e40f48 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:37.131795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:37.300763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-03d6db47-124f-4b75-a020-776366e40f48 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:37.330693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-03d6db47-124f-4b75-a020-776366e40f48 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:37.338914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-03d6db47-124f-4b75-a020-776366e40f48 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:37.358127 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-03d6db47-124f-4b75-a020-776366e40f48 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.393696 Sep 07 12:31:37.359148 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 440/873] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:36 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:37.997160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cae2b11b-825e-4476-8ef7-6a6a670a8757 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:38.001960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cae2b11b-825e-4476-8ef7-6a6a670a8757 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:38.055448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cae2b11b-825e-4476-8ef7-6a6a670a8757 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:38.056832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cae2b11b-825e-4476-8ef7-6a6a670a8757 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:38.061350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cae2b11b-825e-4476-8ef7-6a6a670a8757 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:38.066067 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cae2b11b-825e-4476-8ef7-6a6a670a8757 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:38.070959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cae2b11b-825e-4476-8ef7-6a6a670a8757 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:38.072276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cae2b11b-825e-4476-8ef7-6a6a670a8757 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:38.686086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cae2b11b-825e-4476-8ef7-6a6a670a8757 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:38.708425 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cae2b11b-825e-4476-8ef7-6a6a670a8757 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1379 microversion: 2.1 time: 0.717410 Sep 07 12:31:38.711347 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 441/874] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:37 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1379 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:38.727297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-886c85c6-370a-46a4-9388-96d7344b5a18 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:38.729046 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-886c85c6-370a-46a4-9388-96d7344b5a18 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:38.745396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-886c85c6-370a-46a4-9388-96d7344b5a18 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:38.747504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-886c85c6-370a-46a4-9388-96d7344b5a18 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:38.748605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-886c85c6-370a-46a4-9388-96d7344b5a18 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:38.749951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-886c85c6-370a-46a4-9388-96d7344b5a18 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:38.752044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-886c85c6-370a-46a4-9388-96d7344b5a18 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:38.754060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-886c85c6-370a-46a4-9388-96d7344b5a18 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:39.016334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-886c85c6-370a-46a4-9388-96d7344b5a18 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:39.058397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-886c85c6-370a-46a4-9388-96d7344b5a18 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:39.060091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-886c85c6-370a-46a4-9388-96d7344b5a18 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:39.084039 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-886c85c6-370a-46a4-9388-96d7344b5a18 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.369082 Sep 07 12:31:39.093687 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 442/875] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:38 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:39.105890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b37e9c07-6919-4466-8d8a-08b6d884a091 req-e7eff282-b858-42f0-af3b-a0174072483c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "128cc68c-e4de-4502-8e18-d84f25904060", "tag": "45364459-d3da-4357-9b05-ec8cab358164"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:39.141331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b37e9c07-6919-4466-8d8a-08b6d884a091 req-e7eff282-b858-42f0-af3b-a0174072483c service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:39.142215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b37e9c07-6919-4466-8d8a-08b6d884a091 req-e7eff282-b858-42f0-af3b-a0174072483c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:39.143229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b37e9c07-6919-4466-8d8a-08b6d884a091 req-e7eff282-b858-42f0-af3b-a0174072483c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:39.168546 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b37e9c07-6919-4466-8d8a-08b6d884a091 req-e7eff282-b858-42f0-af3b-a0174072483c service nova] Creating event network-changed:45364459-d3da-4357-9b05-ec8cab358164 for instance 128cc68c-e4de-4502-8e18-d84f25904060 on n-h2-852087-9 Sep 07 12:31:39.195553 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b37e9c07-6919-4466-8d8a-08b6d884a091 req-e7eff282-b858-42f0-af3b-a0174072483c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097826 Sep 07 12:31:39.199106 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 443/876] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:31:39.754522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c58ec387-613b-45ba-bf04-2173d3a93114 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:39.756514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c58ec387-613b-45ba-bf04-2173d3a93114 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:39.774550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c58ec387-613b-45ba-bf04-2173d3a93114 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:39.775058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c58ec387-613b-45ba-bf04-2173d3a93114 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:39.775506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c58ec387-613b-45ba-bf04-2173d3a93114 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:39.776235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c58ec387-613b-45ba-bf04-2173d3a93114 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:39.776702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c58ec387-613b-45ba-bf04-2173d3a93114 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:39.777139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c58ec387-613b-45ba-bf04-2173d3a93114 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:40.276663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c58ec387-613b-45ba-bf04-2173d3a93114 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:40.296560 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c58ec387-613b-45ba-bf04-2173d3a93114 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1379 microversion: 2.1 time: 0.546548 Sep 07 12:31:40.319842 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 444/877] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:39 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1379 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:40.540316 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0a7691e4-07eb-467c-9514-e32e9234f3c3 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918/action" status: 202 len: 0 microversion: 2.25 time: 4.259602 Sep 07 12:31:40.541197 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 434/878] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Sep 7 12:31:36 2022] POST /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918/action => generated 0 bytes in 4272 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:31:40.567265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7d1ad89b-b145-4422-8075-c64c842a5049 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:40.570386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7d1ad89b-b145-4422-8075-c64c842a5049 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:40.581911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d1ad89b-b145-4422-8075-c64c842a5049 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:40.583673 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d1ad89b-b145-4422-8075-c64c842a5049 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:40.584377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d1ad89b-b145-4422-8075-c64c842a5049 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:40.585321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d1ad89b-b145-4422-8075-c64c842a5049 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:40.585999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d1ad89b-b145-4422-8075-c64c842a5049 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:40.586759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d1ad89b-b145-4422-8075-c64c842a5049 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:40.616078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:40.703845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=10 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:40.722245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-60c6d727-b8a1-44e9-b007-db024553c648 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1382054178", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:40.800760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7d1ad89b-b145-4422-8075-c64c842a5049 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:40.802599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-60c6d727-b8a1-44e9-b007-db024553c648 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:31:40.821591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7d1ad89b-b145-4422-8075-c64c842a5049 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:40.824623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7d1ad89b-b145-4422-8075-c64c842a5049 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:40.846870 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7d1ad89b-b145-4422-8075-c64c842a5049 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.300891 Sep 07 12:31:40.849057 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 435/879] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:40 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:40.865347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b6f34603-f465-43fd-908f-41a810f8f67f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:40.866900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b6f34603-f465-43fd-908f-41a810f8f67f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:40.895627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6f34603-f465-43fd-908f-41a810f8f67f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:40.896430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6f34603-f465-43fd-908f-41a810f8f67f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:40.898221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6f34603-f465-43fd-908f-41a810f8f67f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:40.899406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6f34603-f465-43fd-908f-41a810f8f67f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:40.905260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6f34603-f465-43fd-908f-41a810f8f67f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:40.906008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6f34603-f465-43fd-908f-41a810f8f67f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:41.064079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:41.248825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b6f34603-f465-43fd-908f-41a810f8f67f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:41.291980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b6f34603-f465-43fd-908f-41a810f8f67f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:41.297211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b6f34603-f465-43fd-908f-41a810f8f67f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:41.299668 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b6f34603-f465-43fd-908f-41a810f8f67f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1566 microversion: 2.25 time: 0.448595 Sep 07 12:31:41.343637 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 436/880] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:40 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1566 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:41.371874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fc820ef6-f452-42e5-9226-24c9bad0cd61 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:41.373160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fc820ef6-f452-42e5-9226-24c9bad0cd61 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:41.390972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc820ef6-f452-42e5-9226-24c9bad0cd61 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:41.391875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc820ef6-f452-42e5-9226-24c9bad0cd61 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:41.392602 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc820ef6-f452-42e5-9226-24c9bad0cd61 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:41.393950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc820ef6-f452-42e5-9226-24c9bad0cd61 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:41.396316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc820ef6-f452-42e5-9226-24c9bad0cd61 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:41.397227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc820ef6-f452-42e5-9226-24c9bad0cd61 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:41.439415 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-60c6d727-b8a1-44e9-b007-db024553c648 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:31:41.440226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-60c6d727-b8a1-44e9-b007-db024553c648 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:31:41.441011 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-60c6d727-b8a1-44e9-b007-db024553c648 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:31:41.441971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-60c6d727-b8a1-44e9-b007-db024553c648 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:31:41.442934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-60c6d727-b8a1-44e9-b007-db024553c648 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:31:41.458470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60c6d727-b8a1-44e9-b007-db024553c648 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:41.459422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60c6d727-b8a1-44e9-b007-db024553c648 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:41.460092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60c6d727-b8a1-44e9-b007-db024553c648 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:41.461133 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60c6d727-b8a1-44e9-b007-db024553c648 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:41.462480 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60c6d727-b8a1-44e9-b007-db024553c648 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:41.463164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60c6d727-b8a1-44e9-b007-db024553c648 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:41.485834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:41.494865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-60c6d727-b8a1-44e9-b007-db024553c648 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Getting quotas for project 7d8dd874b3674087a3e969424a561530. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:31:41.501998 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-60c6d727-b8a1-44e9-b007-db024553c648 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Getting quotas for user 50d97d3b953f4690b54fde1a4da81cd4 and project 7d8dd874b3674087a3e969424a561530. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:31:41.552007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-60c6d727-b8a1-44e9-b007-db024553c648 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:31:41.565738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-60c6d727-b8a1-44e9-b007-db024553c648 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:31:41.770881 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-60c6d727-b8a1-44e9-b007-db024553c648 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.449023 Sep 07 12:31:41.775558 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 445/881] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:31:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:31:41.879050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1c39679b-b759-493a-aa4e-0c65d71adecb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:41.879719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1c39679b-b759-493a-aa4e-0c65d71adecb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:41.905602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c39679b-b759-493a-aa4e-0c65d71adecb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:41.909277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c39679b-b759-493a-aa4e-0c65d71adecb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:41.910804 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c39679b-b759-493a-aa4e-0c65d71adecb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:41.911801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c39679b-b759-493a-aa4e-0c65d71adecb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:41.912648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c39679b-b759-493a-aa4e-0c65d71adecb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:41.918659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c39679b-b759-493a-aa4e-0c65d71adecb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:42.384615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1c39679b-b759-493a-aa4e-0c65d71adecb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:42.404419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1c39679b-b759-493a-aa4e-0c65d71adecb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:42.424511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1c39679b-b759-493a-aa4e-0c65d71adecb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:42.483920 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1c39679b-b759-493a-aa4e-0c65d71adecb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.606301 Sep 07 12:31:42.494457 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 446/882] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:41 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:31:42.511050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-56fb3ab8-6937-41b3-b452-85afb46217c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-431040231", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:42.541100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fc820ef6-f452-42e5-9226-24c9bad0cd61 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:42.555708 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fc820ef6-f452-42e5-9226-24c9bad0cd61 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1379 microversion: 2.1 time: 1.206806 Sep 07 12:31:42.570496 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 437/883] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:41 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1379 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:42.600722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-64f1fa59-93f4-44fa-9577-b3f023e07831 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:42.602954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-64f1fa59-93f4-44fa-9577-b3f023e07831 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:42.617095 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64f1fa59-93f4-44fa-9577-b3f023e07831 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:42.618585 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64f1fa59-93f4-44fa-9577-b3f023e07831 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:42.619712 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64f1fa59-93f4-44fa-9577-b3f023e07831 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:42.621813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64f1fa59-93f4-44fa-9577-b3f023e07831 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:42.622903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64f1fa59-93f4-44fa-9577-b3f023e07831 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:42.623902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64f1fa59-93f4-44fa-9577-b3f023e07831 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:42.685834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-56fb3ab8-6937-41b3-b452-85afb46217c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:31:43.694547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-64f1fa59-93f4-44fa-9577-b3f023e07831 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:43.711092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-64f1fa59-93f4-44fa-9577-b3f023e07831 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:43.723499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-64f1fa59-93f4-44fa-9577-b3f023e07831 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:43.730810 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-64f1fa59-93f4-44fa-9577-b3f023e07831 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1566 microversion: 2.25 time: 1.158227 Sep 07 12:31:43.732001 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 438/884] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:42 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1566 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:43.754566 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3fe7ec6f-903a-4fed-9d0e-44182243ce48 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:43.755268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3fe7ec6f-903a-4fed-9d0e-44182243ce48 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:43.776037 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fe7ec6f-903a-4fed-9d0e-44182243ce48 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:43.776569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fe7ec6f-903a-4fed-9d0e-44182243ce48 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:43.777106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fe7ec6f-903a-4fed-9d0e-44182243ce48 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:43.783516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fe7ec6f-903a-4fed-9d0e-44182243ce48 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:43.798323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fe7ec6f-903a-4fed-9d0e-44182243ce48 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:43.799059 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fe7ec6f-903a-4fed-9d0e-44182243ce48 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:44.002009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3fe7ec6f-903a-4fed-9d0e-44182243ce48 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:44.032931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3fe7ec6f-903a-4fed-9d0e-44182243ce48 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:44.036634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-56fb3ab8-6937-41b3-b452-85afb46217c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:31:44.037248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-56fb3ab8-6937-41b3-b452-85afb46217c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:31:44.039413 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3fe7ec6f-903a-4fed-9d0e-44182243ce48 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:44.043041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-56fb3ab8-6937-41b3-b452-85afb46217c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:31:44.043481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-56fb3ab8-6937-41b3-b452-85afb46217c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:31:44.044034 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-56fb3ab8-6937-41b3-b452-85afb46217c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:31:44.053908 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3fe7ec6f-903a-4fed-9d0e-44182243ce48 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.320513 Sep 07 12:31:44.061101 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 439/885] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:43 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:44.073660 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-18c1782d-d97e-4fb4-be63-c1a27b123c4a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:44.084376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56fb3ab8-6937-41b3-b452-85afb46217c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:44.085453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-18c1782d-d97e-4fb4-be63-c1a27b123c4a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:44.086223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56fb3ab8-6937-41b3-b452-85afb46217c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:44.087626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56fb3ab8-6937-41b3-b452-85afb46217c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:44.089898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56fb3ab8-6937-41b3-b452-85afb46217c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:44.092246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56fb3ab8-6937-41b3-b452-85afb46217c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:44.094859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56fb3ab8-6937-41b3-b452-85afb46217c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:44.103439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18c1782d-d97e-4fb4-be63-c1a27b123c4a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:44.107299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18c1782d-d97e-4fb4-be63-c1a27b123c4a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:44.108865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18c1782d-d97e-4fb4-be63-c1a27b123c4a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:44.110342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18c1782d-d97e-4fb4-be63-c1a27b123c4a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:44.118627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18c1782d-d97e-4fb4-be63-c1a27b123c4a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:44.119077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18c1782d-d97e-4fb4-be63-c1a27b123c4a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:44.198320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-56fb3ab8-6937-41b3-b452-85afb46217c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Getting quotas for project 7d8dd874b3674087a3e969424a561530. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:31:44.202935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:44.224476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-56fb3ab8-6937-41b3-b452-85afb46217c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Getting quotas for user 50d97d3b953f4690b54fde1a4da81cd4 and project 7d8dd874b3674087a3e969424a561530. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:31:44.261960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-56fb3ab8-6937-41b3-b452-85afb46217c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:31:44.270726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-56fb3ab8-6937-41b3-b452-85afb46217c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b65cf6c-5a50-4c86-9255-c7d712522cfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:31:44.364241 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-56fb3ab8-6937-41b3-b452-85afb46217c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.864825 Sep 07 12:31:44.367558 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 447/886] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:31:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:31:44.386757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-40a11cf6-9cca-42dc-9472-fc7678b1ba2f tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:44.388097 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-40a11cf6-9cca-42dc-9472-fc7678b1ba2f tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b65cf6c-5a50-4c86-9255-c7d712522cfe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:44.979595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-40a11cf6-9cca-42dc-9472-fc7678b1ba2f tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:45.010281 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-40a11cf6-9cca-42dc-9472-fc7678b1ba2f tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe" status: 200 len: 1213 microversion: 2.1 time: 0.630275 Sep 07 12:31:45.011697 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 448/887] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:44 2022] GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe => generated 1213 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:45.026365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-052854bf-8364-4a5a-95df-a00fbf7f0fc4 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:45.027919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-052854bf-8364-4a5a-95df-a00fbf7f0fc4 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:45.046315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-052854bf-8364-4a5a-95df-a00fbf7f0fc4 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:45.048777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-052854bf-8364-4a5a-95df-a00fbf7f0fc4 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:45.049870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-052854bf-8364-4a5a-95df-a00fbf7f0fc4 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:45.052551 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-052854bf-8364-4a5a-95df-a00fbf7f0fc4 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:45.053804 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-052854bf-8364-4a5a-95df-a00fbf7f0fc4 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:45.054804 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-052854bf-8364-4a5a-95df-a00fbf7f0fc4 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:45.294756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-18c1782d-d97e-4fb4-be63-c1a27b123c4a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:45.314776 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-18c1782d-d97e-4fb4-be63-c1a27b123c4a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1379 microversion: 2.1 time: 1.248797 Sep 07 12:31:45.318087 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 440/888] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:44 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1379 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:45.332672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-10207bf5-0b39-417e-9f7f-2d09606a894a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:45.335757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-10207bf5-0b39-417e-9f7f-2d09606a894a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:45.354072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10207bf5-0b39-417e-9f7f-2d09606a894a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:45.356207 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10207bf5-0b39-417e-9f7f-2d09606a894a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:45.359060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10207bf5-0b39-417e-9f7f-2d09606a894a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:45.360992 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10207bf5-0b39-417e-9f7f-2d09606a894a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:45.362990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10207bf5-0b39-417e-9f7f-2d09606a894a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:45.363920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10207bf5-0b39-417e-9f7f-2d09606a894a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:45.586905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-10207bf5-0b39-417e-9f7f-2d09606a894a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:45.600012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-10207bf5-0b39-417e-9f7f-2d09606a894a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:45.619928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-10207bf5-0b39-417e-9f7f-2d09606a894a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:45.669966 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-10207bf5-0b39-417e-9f7f-2d09606a894a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.348542 Sep 07 12:31:45.683693 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 441/889] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:45 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:45.798451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-052854bf-8364-4a5a-95df-a00fbf7f0fc4 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:45.808803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-052854bf-8364-4a5a-95df-a00fbf7f0fc4 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:45.830427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-052854bf-8364-4a5a-95df-a00fbf7f0fc4 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:45.832428 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-052854bf-8364-4a5a-95df-a00fbf7f0fc4 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1566 microversion: 2.25 time: 0.819376 Sep 07 12:31:45.842801 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 449/890] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:45 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1566 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:46.067190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cbb31bb3-8f65-43fe-8ace-810cf92f1066 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:46.068327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cbb31bb3-8f65-43fe-8ace-810cf92f1066 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b65cf6c-5a50-4c86-9255-c7d712522cfe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:46.076956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbb31bb3-8f65-43fe-8ace-810cf92f1066 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:46.077786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbb31bb3-8f65-43fe-8ace-810cf92f1066 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:46.078468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbb31bb3-8f65-43fe-8ace-810cf92f1066 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:46.079472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbb31bb3-8f65-43fe-8ace-810cf92f1066 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:46.080176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbb31bb3-8f65-43fe-8ace-810cf92f1066 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:46.080818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbb31bb3-8f65-43fe-8ace-810cf92f1066 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:46.207261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:46.370089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aa41a5f4-7ab6-4cf7-bc75-a6effd66192d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:46.371568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aa41a5f4-7ab6-4cf7-bc75-a6effd66192d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:46.384969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa41a5f4-7ab6-4cf7-bc75-a6effd66192d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:46.385768 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa41a5f4-7ab6-4cf7-bc75-a6effd66192d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:46.386402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa41a5f4-7ab6-4cf7-bc75-a6effd66192d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:46.387315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa41a5f4-7ab6-4cf7-bc75-a6effd66192d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:46.387948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa41a5f4-7ab6-4cf7-bc75-a6effd66192d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:46.388538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa41a5f4-7ab6-4cf7-bc75-a6effd66192d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:46.672417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cbb31bb3-8f65-43fe-8ace-810cf92f1066 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:46.714353 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cbb31bb3-8f65-43fe-8ace-810cf92f1066 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe" status: 200 len: 1265 microversion: 2.1 time: 0.651178 Sep 07 12:31:46.719698 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 442/891] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:46 2022] GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe => generated 1265 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:31:46.779998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-373cf042-91fb-409a-bee7-e7bab837524f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:46.781226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-373cf042-91fb-409a-bee7-e7bab837524f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:46.830728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-373cf042-91fb-409a-bee7-e7bab837524f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:46.835537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-373cf042-91fb-409a-bee7-e7bab837524f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:46.838473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-373cf042-91fb-409a-bee7-e7bab837524f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:46.845156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-373cf042-91fb-409a-bee7-e7bab837524f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:46.847118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-373cf042-91fb-409a-bee7-e7bab837524f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:46.850494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-373cf042-91fb-409a-bee7-e7bab837524f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:47.312683 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-373cf042-91fb-409a-bee7-e7bab837524f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:47.332552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-373cf042-91fb-409a-bee7-e7bab837524f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:47.334192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-373cf042-91fb-409a-bee7-e7bab837524f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:47.362228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:47.368559 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-373cf042-91fb-409a-bee7-e7bab837524f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.628603 Sep 07 12:31:47.369093 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 443/892] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:46 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:47.384437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-78d34c79-b128-47d8-bd14-da8e6116d333 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:47.385377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-78d34c79-b128-47d8-bd14-da8e6116d333 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:47.422280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78d34c79-b128-47d8-bd14-da8e6116d333 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:47.423026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78d34c79-b128-47d8-bd14-da8e6116d333 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:47.423629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78d34c79-b128-47d8-bd14-da8e6116d333 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:47.424569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78d34c79-b128-47d8-bd14-da8e6116d333 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:47.431074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78d34c79-b128-47d8-bd14-da8e6116d333 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:47.431074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78d34c79-b128-47d8-bd14-da8e6116d333 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:48.067179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aa41a5f4-7ab6-4cf7-bc75-a6effd66192d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:48.083636 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aa41a5f4-7ab6-4cf7-bc75-a6effd66192d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1379 microversion: 2.1 time: 1.715700 Sep 07 12:31:48.088192 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 450/893] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:46 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1379 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:48.099533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-6dcc66cd-5eb9-44a9-bf0e-ca60a8d7d8eb req-292bc7e8-4f85-4773-a0ca-46f5cb5ff36d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "128cc68c-e4de-4502-8e18-d84f25904060", "name": "network-vif-plugged", "status": "completed", "tag": "45364459-d3da-4357-9b05-ec8cab358164"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:48.138263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6dcc66cd-5eb9-44a9-bf0e-ca60a8d7d8eb req-292bc7e8-4f85-4773-a0ca-46f5cb5ff36d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:48.139725 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6dcc66cd-5eb9-44a9-bf0e-ca60a8d7d8eb req-292bc7e8-4f85-4773-a0ca-46f5cb5ff36d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:48.140391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6dcc66cd-5eb9-44a9-bf0e-ca60a8d7d8eb req-292bc7e8-4f85-4773-a0ca-46f5cb5ff36d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:48.170896 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-6dcc66cd-5eb9-44a9-bf0e-ca60a8d7d8eb req-292bc7e8-4f85-4773-a0ca-46f5cb5ff36d service nova] Creating event network-vif-plugged:45364459-d3da-4357-9b05-ec8cab358164 for instance 128cc68c-e4de-4502-8e18-d84f25904060 on n-h2-852087-9 Sep 07 12:31:48.184457 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-6dcc66cd-5eb9-44a9-bf0e-ca60a8d7d8eb req-292bc7e8-4f85-4773-a0ca-46f5cb5ff36d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094682 Sep 07 12:31:48.185471 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 451/894] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:31:48.193413 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-26acc50e-ea1e-48aa-b5b6-133b874a0f0b req-a18bd236-abaf-4f4c-9132-7052b0467325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a72bc8e2-53a9-4c43-83b1-c86bfef2e918", "name": "network-vif-unplugged", "status": "completed", "tag": "840128a7-29eb-4c42-8c9d-e4c58a31e527"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:48.213224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-26acc50e-ea1e-48aa-b5b6-133b874a0f0b req-a18bd236-abaf-4f4c-9132-7052b0467325 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:48.213777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-26acc50e-ea1e-48aa-b5b6-133b874a0f0b req-a18bd236-abaf-4f4c-9132-7052b0467325 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:48.214374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-26acc50e-ea1e-48aa-b5b6-133b874a0f0b req-a18bd236-abaf-4f4c-9132-7052b0467325 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:48.230680 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-26acc50e-ea1e-48aa-b5b6-133b874a0f0b req-a18bd236-abaf-4f4c-9132-7052b0467325 service nova] Creating event network-vif-unplugged:840128a7-29eb-4c42-8c9d-e4c58a31e527 for instance a72bc8e2-53a9-4c43-83b1-c86bfef2e918 on n-h1-852087-9 Sep 07 12:31:48.254887 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-26acc50e-ea1e-48aa-b5b6-133b874a0f0b req-a18bd236-abaf-4f4c-9132-7052b0467325 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062033 Sep 07 12:31:48.256372 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 452/895] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:31:48.266574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d0ce6e41-c706-4002-82bc-64adff39fa4c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:48.267303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d0ce6e41-c706-4002-82bc-64adff39fa4c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b65cf6c-5a50-4c86-9255-c7d712522cfe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:48.277093 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0ce6e41-c706-4002-82bc-64adff39fa4c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:48.278078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0ce6e41-c706-4002-82bc-64adff39fa4c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:48.278697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0ce6e41-c706-4002-82bc-64adff39fa4c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:48.280187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0ce6e41-c706-4002-82bc-64adff39fa4c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:48.281379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0ce6e41-c706-4002-82bc-64adff39fa4c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:48.281878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0ce6e41-c706-4002-82bc-64adff39fa4c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:48.589070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d0ce6e41-c706-4002-82bc-64adff39fa4c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:48.602049 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d0ce6e41-c706-4002-82bc-64adff39fa4c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe" status: 200 len: 1271 microversion: 2.1 time: 0.343842 Sep 07 12:31:48.602681 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 453/896] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:48 2022] GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe => generated 1271 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:48.608996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6cb725e7-1ccc-4026-8dff-909cb548d890 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:48.609983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6cb725e7-1ccc-4026-8dff-909cb548d890 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:48.617361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cb725e7-1ccc-4026-8dff-909cb548d890 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:48.618350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cb725e7-1ccc-4026-8dff-909cb548d890 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:48.619222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cb725e7-1ccc-4026-8dff-909cb548d890 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:48.620299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cb725e7-1ccc-4026-8dff-909cb548d890 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:48.621012 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cb725e7-1ccc-4026-8dff-909cb548d890 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:48.622150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cb725e7-1ccc-4026-8dff-909cb548d890 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:48.689996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-78d34c79-b128-47d8-bd14-da8e6116d333 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:48.700555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-78d34c79-b128-47d8-bd14-da8e6116d333 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:48.703484 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-78d34c79-b128-47d8-bd14-da8e6116d333 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:48.705607 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-78d34c79-b128-47d8-bd14-da8e6116d333 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1566 microversion: 2.25 time: 1.331091 Sep 07 12:31:48.706962 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 444/897] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:47 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1566 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:48.800764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6cb725e7-1ccc-4026-8dff-909cb548d890 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:48.819144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6cb725e7-1ccc-4026-8dff-909cb548d890 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:48.826016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6cb725e7-1ccc-4026-8dff-909cb548d890 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:48.838866 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6cb725e7-1ccc-4026-8dff-909cb548d890 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1558 microversion: 2.91 time: 0.231881 Sep 07 12:31:48.841126 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 454/898] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:48 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1558 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:48.984685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-da2b34ab-a9a0-4966-9674-083f3bb4dc64 req-d99d696b-e6cc-45d0-a380-3e5aea9f3f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b849d7d-db03-43d3-b94c-3808ea7ae0cb", "tag": "d76c4cb6-1ff0-4c6b-9d8f-eb2ec1601a0d"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:49.036309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-da2b34ab-a9a0-4966-9674-083f3bb4dc64 req-d99d696b-e6cc-45d0-a380-3e5aea9f3f2d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:49.037886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-da2b34ab-a9a0-4966-9674-083f3bb4dc64 req-d99d696b-e6cc-45d0-a380-3e5aea9f3f2d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:49.039234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-da2b34ab-a9a0-4966-9674-083f3bb4dc64 req-d99d696b-e6cc-45d0-a380-3e5aea9f3f2d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:49.077672 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-da2b34ab-a9a0-4966-9674-083f3bb4dc64 req-d99d696b-e6cc-45d0-a380-3e5aea9f3f2d service nova] Creating event network-changed:d76c4cb6-1ff0-4c6b-9d8f-eb2ec1601a0d for instance 7b849d7d-db03-43d3-b94c-3808ea7ae0cb on n-h2-852087-9 Sep 07 12:31:49.087719 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-da2b34ab-a9a0-4966-9674-083f3bb4dc64 req-d99d696b-e6cc-45d0-a380-3e5aea9f3f2d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115283 Sep 07 12:31:49.088678 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 445/899] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:31:49.147952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-942bbb24-63e2-4160-91c7-e5286d0bf578 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:49.150384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-942bbb24-63e2-4160-91c7-e5286d0bf578 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:49.163710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-942bbb24-63e2-4160-91c7-e5286d0bf578 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:49.164592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-942bbb24-63e2-4160-91c7-e5286d0bf578 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:49.165719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-942bbb24-63e2-4160-91c7-e5286d0bf578 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:49.167027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-942bbb24-63e2-4160-91c7-e5286d0bf578 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:49.167886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-942bbb24-63e2-4160-91c7-e5286d0bf578 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:49.168905 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-942bbb24-63e2-4160-91c7-e5286d0bf578 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:49.444308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-942bbb24-63e2-4160-91c7-e5286d0bf578 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:49.464675 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-942bbb24-63e2-4160-91c7-e5286d0bf578 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1379 microversion: 2.1 time: 0.326440 Sep 07 12:31:49.466447 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 455/900] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:49 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1379 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:49.637604 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d2048258-e81a-4780-a3d1-c425607fefe8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:49.639258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d2048258-e81a-4780-a3d1-c425607fefe8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b65cf6c-5a50-4c86-9255-c7d712522cfe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:49.648970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2048258-e81a-4780-a3d1-c425607fefe8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:49.649929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2048258-e81a-4780-a3d1-c425607fefe8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:49.650601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2048258-e81a-4780-a3d1-c425607fefe8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:49.651624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2048258-e81a-4780-a3d1-c425607fefe8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:49.652333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2048258-e81a-4780-a3d1-c425607fefe8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:49.652994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2048258-e81a-4780-a3d1-c425607fefe8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:49.739689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8b236043-f23d-4fdb-b2c4-636e2993e26e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:49.740594 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8b236043-f23d-4fdb-b2c4-636e2993e26e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:49.754963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b236043-f23d-4fdb-b2c4-636e2993e26e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:49.757663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b236043-f23d-4fdb-b2c4-636e2993e26e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:49.758988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b236043-f23d-4fdb-b2c4-636e2993e26e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:49.760629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b236043-f23d-4fdb-b2c4-636e2993e26e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:49.761741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b236043-f23d-4fdb-b2c4-636e2993e26e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:49.763702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b236043-f23d-4fdb-b2c4-636e2993e26e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:50.523813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d2048258-e81a-4780-a3d1-c425607fefe8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:50.534401 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d2048258-e81a-4780-a3d1-c425607fefe8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe" status: 200 len: 1313 microversion: 2.1 time: 0.902959 Sep 07 12:31:50.543914 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 446/901] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:49 2022] GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe => generated 1313 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:50.577789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6964d7e5-199f-4b42-9a76-fd489381d8be tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:50.578508 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6964d7e5-199f-4b42-9a76-fd489381d8be tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:50.587486 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6964d7e5-199f-4b42-9a76-fd489381d8be tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:50.588013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6964d7e5-199f-4b42-9a76-fd489381d8be tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:50.588533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6964d7e5-199f-4b42-9a76-fd489381d8be tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:50.589397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6964d7e5-199f-4b42-9a76-fd489381d8be tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:50.589909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6964d7e5-199f-4b42-9a76-fd489381d8be tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:50.590398 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6964d7e5-199f-4b42-9a76-fd489381d8be tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:50.614097 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8b236043-f23d-4fdb-b2c4-636e2993e26e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:50.639454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8b236043-f23d-4fdb-b2c4-636e2993e26e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:50.651094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8b236043-f23d-4fdb-b2c4-636e2993e26e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:50.653831 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8b236043-f23d-4fdb-b2c4-636e2993e26e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1566 microversion: 2.25 time: 0.918661 Sep 07 12:31:50.664260 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 456/902] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:49 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1566 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:31:50.688916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-a9075c29-b495-4db2-8090-b9c0b13c05c8 req-35162aa2-a4d1-4179-b802-57f938c00f47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a72bc8e2-53a9-4c43-83b1-c86bfef2e918", "tag": "840128a7-29eb-4c42-8c9d-e4c58a31e527"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:50.720566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a9075c29-b495-4db2-8090-b9c0b13c05c8 req-35162aa2-a4d1-4179-b802-57f938c00f47 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:50.721361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a9075c29-b495-4db2-8090-b9c0b13c05c8 req-35162aa2-a4d1-4179-b802-57f938c00f47 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:50.722048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a9075c29-b495-4db2-8090-b9c0b13c05c8 req-35162aa2-a4d1-4179-b802-57f938c00f47 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:50.737567 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-a9075c29-b495-4db2-8090-b9c0b13c05c8 req-35162aa2-a4d1-4179-b802-57f938c00f47 service nova] Creating event network-changed:840128a7-29eb-4c42-8c9d-e4c58a31e527 for instance a72bc8e2-53a9-4c43-83b1-c86bfef2e918 on n-h1-852087-9 Sep 07 12:31:50.746720 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-a9075c29-b495-4db2-8090-b9c0b13c05c8 req-35162aa2-a4d1-4179-b802-57f938c00f47 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072862 Sep 07 12:31:50.747720 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 457/903] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:31:50.757750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f5cdc494-1d7e-4dc5-b13b-f9408460afc6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:50.758821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f5cdc494-1d7e-4dc5-b13b-f9408460afc6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:50.778284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5cdc494-1d7e-4dc5-b13b-f9408460afc6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:50.779820 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5cdc494-1d7e-4dc5-b13b-f9408460afc6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:50.792984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5cdc494-1d7e-4dc5-b13b-f9408460afc6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:50.794840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5cdc494-1d7e-4dc5-b13b-f9408460afc6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:50.798614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5cdc494-1d7e-4dc5-b13b-f9408460afc6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:50.802178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5cdc494-1d7e-4dc5-b13b-f9408460afc6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:50.808114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6964d7e5-199f-4b42-9a76-fd489381d8be tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:50.822989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6964d7e5-199f-4b42-9a76-fd489381d8be tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:50.833569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6964d7e5-199f-4b42-9a76-fd489381d8be tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:50.853015 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6964d7e5-199f-4b42-9a76-fd489381d8be tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1558 microversion: 2.91 time: 0.307693 Sep 07 12:31:50.855131 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 447/904] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:50 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1558 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:51.303486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f5cdc494-1d7e-4dc5-b13b-f9408460afc6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:51.312467 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f5cdc494-1d7e-4dc5-b13b-f9408460afc6 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1379 microversion: 2.1 time: 0.563052 Sep 07 12:31:51.320835 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 458/905] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:50 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1379 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:51.567833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b450d099-f86a-4e54-8993-7154f8464b13 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:51.568656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b450d099-f86a-4e54-8993-7154f8464b13 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b65cf6c-5a50-4c86-9255-c7d712522cfe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:51.586497 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b450d099-f86a-4e54-8993-7154f8464b13 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:51.597566 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b450d099-f86a-4e54-8993-7154f8464b13 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:51.598520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b450d099-f86a-4e54-8993-7154f8464b13 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:51.599578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b450d099-f86a-4e54-8993-7154f8464b13 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:51.600333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b450d099-f86a-4e54-8993-7154f8464b13 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:51.601025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b450d099-f86a-4e54-8993-7154f8464b13 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:51.707931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5bf4a999-be21-4723-8359-8b0cc6592730 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:51.708724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5bf4a999-be21-4723-8359-8b0cc6592730 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:51.728732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bf4a999-be21-4723-8359-8b0cc6592730 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:51.729439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bf4a999-be21-4723-8359-8b0cc6592730 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:51.731731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bf4a999-be21-4723-8359-8b0cc6592730 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:51.733754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bf4a999-be21-4723-8359-8b0cc6592730 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:51.734278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bf4a999-be21-4723-8359-8b0cc6592730 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:51.736716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bf4a999-be21-4723-8359-8b0cc6592730 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:52.200215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b450d099-f86a-4e54-8993-7154f8464b13 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:52.240943 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b450d099-f86a-4e54-8993-7154f8464b13 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe" status: 200 len: 1313 microversion: 2.1 time: 0.677879 Sep 07 12:31:52.246880 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5bf4a999-be21-4723-8359-8b0cc6592730 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:52.248877 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 448/906] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:51 2022] GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe => generated 1313 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:52.265988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5bf4a999-be21-4723-8359-8b0cc6592730 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:52.273550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e5cd6927-ef48-4180-9317-b7ad662ad141 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:52.276531 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5bf4a999-be21-4723-8359-8b0cc6592730 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:52.278839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e5cd6927-ef48-4180-9317-b7ad662ad141 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:52.280213 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5bf4a999-be21-4723-8359-8b0cc6592730 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1566 microversion: 2.25 time: 0.581746 Sep 07 12:31:52.286625 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 459/907] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:51 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1566 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:52.315542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5cd6927-ef48-4180-9317-b7ad662ad141 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:52.318477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5cd6927-ef48-4180-9317-b7ad662ad141 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:52.322197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5cd6927-ef48-4180-9317-b7ad662ad141 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:52.325600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5cd6927-ef48-4180-9317-b7ad662ad141 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:52.329795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5cd6927-ef48-4180-9317-b7ad662ad141 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:52.330775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5cd6927-ef48-4180-9317-b7ad662ad141 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:52.378198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f3af6e59-e878-491d-9e1e-cb2fdf121423 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:52.378891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f3af6e59-e878-491d-9e1e-cb2fdf121423 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:52.394734 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3af6e59-e878-491d-9e1e-cb2fdf121423 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:52.400371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3af6e59-e878-491d-9e1e-cb2fdf121423 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:52.401516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3af6e59-e878-491d-9e1e-cb2fdf121423 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:52.401876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3af6e59-e878-491d-9e1e-cb2fdf121423 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:52.402466 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3af6e59-e878-491d-9e1e-cb2fdf121423 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:52.404652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3af6e59-e878-491d-9e1e-cb2fdf121423 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:52.562129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e5cd6927-ef48-4180-9317-b7ad662ad141 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:52.597508 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e5cd6927-ef48-4180-9317-b7ad662ad141 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:52.603533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e5cd6927-ef48-4180-9317-b7ad662ad141 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:52.621905 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e5cd6927-ef48-4180-9317-b7ad662ad141 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1553 microversion: 2.91 time: 0.369792 Sep 07 12:31:52.625996 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 449/908] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:52 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1553 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:52.788744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-4682f89c-4d95-4985-8cbf-86f26f6494d6 req-141e8385-59c6-49ed-a4fc-bffc7f471de6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b65cf6c-5a50-4c86-9255-c7d712522cfe", "tag": "da45972a-1a94-47cc-8816-2b02beeab531"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:52.818158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4682f89c-4d95-4985-8cbf-86f26f6494d6 req-141e8385-59c6-49ed-a4fc-bffc7f471de6 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:52.819200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4682f89c-4d95-4985-8cbf-86f26f6494d6 req-141e8385-59c6-49ed-a4fc-bffc7f471de6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:52.820872 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4682f89c-4d95-4985-8cbf-86f26f6494d6 req-141e8385-59c6-49ed-a4fc-bffc7f471de6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:52.825335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f3af6e59-e878-491d-9e1e-cb2fdf121423 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:52.858072 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f3af6e59-e878-491d-9e1e-cb2fdf121423 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1529 microversion: 2.1 time: 0.485923 Sep 07 12:31:52.859614 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 460/909] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:52 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1529 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:52.904890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c9edf42a-1d39-42ab-b2e8-dcbcfba55b4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:52.907161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c9edf42a-1d39-42ab-b2e8-dcbcfba55b4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:52.910865 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-4682f89c-4d95-4985-8cbf-86f26f6494d6 req-141e8385-59c6-49ed-a4fc-bffc7f471de6 service nova] Creating event network-changed:da45972a-1a94-47cc-8816-2b02beeab531 for instance 7b65cf6c-5a50-4c86-9255-c7d712522cfe on n-h1-852087-9 Sep 07 12:31:52.926809 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-4682f89c-4d95-4985-8cbf-86f26f6494d6 req-141e8385-59c6-49ed-a4fc-bffc7f471de6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144880 Sep 07 12:31:52.933643 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 450/910] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:31:52.934196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9edf42a-1d39-42ab-b2e8-dcbcfba55b4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:52.941298 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9edf42a-1d39-42ab-b2e8-dcbcfba55b4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:52.946941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9edf42a-1d39-42ab-b2e8-dcbcfba55b4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:52.948279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9edf42a-1d39-42ab-b2e8-dcbcfba55b4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:52.949007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9edf42a-1d39-42ab-b2e8-dcbcfba55b4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:52.949720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9edf42a-1d39-42ab-b2e8-dcbcfba55b4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:53.284337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-66d225fb-5c78-4df4-8466-d0c6282724f8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:53.285499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-66d225fb-5c78-4df4-8466-d0c6282724f8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b65cf6c-5a50-4c86-9255-c7d712522cfe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:53.297258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66d225fb-5c78-4df4-8466-d0c6282724f8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:53.298637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66d225fb-5c78-4df4-8466-d0c6282724f8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:53.299345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66d225fb-5c78-4df4-8466-d0c6282724f8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:53.304001 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66d225fb-5c78-4df4-8466-d0c6282724f8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:53.311552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66d225fb-5c78-4df4-8466-d0c6282724f8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:53.312507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66d225fb-5c78-4df4-8466-d0c6282724f8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:53.540825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c9edf42a-1d39-42ab-b2e8-dcbcfba55b4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:53.561743 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c9edf42a-1d39-42ab-b2e8-dcbcfba55b4b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1529 microversion: 2.1 time: 0.666917 Sep 07 12:31:53.562740 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 461/911] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:52 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1529 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:53.577256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e0435597-6e17-45e9-b462-02d749950efc tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:53.591405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e0435597-6e17-45e9-b462-02d749950efc tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:53.626699 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0435597-6e17-45e9-b462-02d749950efc tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:53.633887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0435597-6e17-45e9-b462-02d749950efc tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:53.634797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0435597-6e17-45e9-b462-02d749950efc tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:53.635825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0435597-6e17-45e9-b462-02d749950efc tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:53.636547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0435597-6e17-45e9-b462-02d749950efc tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:53.637264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0435597-6e17-45e9-b462-02d749950efc tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:53.644444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:53.760335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-66d225fb-5c78-4df4-8466-d0c6282724f8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:53.800494 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-66d225fb-5c78-4df4-8466-d0c6282724f8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe" status: 200 len: 1313 microversion: 2.1 time: 0.523064 Sep 07 12:31:53.809636 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 451/912] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:53 2022] GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe => generated 1313 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:31:53.820270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-55edbfc6-e647-42f7-8d4c-82a389df57c0 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:53.862162 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-55edbfc6-e647-42f7-8d4c-82a389df57c0 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/14658a2f-eb75-442b-89ee-ecf1d26c9c1e" status: 202 len: 0 microversion: 2.1 time: 0.051024 Sep 07 12:31:53.864414 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 452/913] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:31:53 2022] DELETE /compute/v2.1/flavors/14658a2f-eb75-442b-89ee-ecf1d26c9c1e => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:31:53.899863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de1da151-dffb-4cd3-8306-aae899671774 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:53.901126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-de1da151-dffb-4cd3-8306-aae899671774 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:53.917224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de1da151-dffb-4cd3-8306-aae899671774 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:53.918074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de1da151-dffb-4cd3-8306-aae899671774 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:53.918782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de1da151-dffb-4cd3-8306-aae899671774 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:53.920062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de1da151-dffb-4cd3-8306-aae899671774 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:53.920748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de1da151-dffb-4cd3-8306-aae899671774 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:53.921373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de1da151-dffb-4cd3-8306-aae899671774 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:54.105874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-de1da151-dffb-4cd3-8306-aae899671774 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:54.124730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:54.127191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-de1da151-dffb-4cd3-8306-aae899671774 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:54.130707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-de1da151-dffb-4cd3-8306-aae899671774 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:54.142471 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-de1da151-dffb-4cd3-8306-aae899671774 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1553 microversion: 2.91 time: 0.276624 Sep 07 12:31:54.152414 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 453/914] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:53 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1553 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:54.167235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2fba1ec8-4ddc-4754-8c69-193d3c182291 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:54.200519 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e0435597-6e17-45e9-b462-02d749950efc tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:54.210682 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2fba1ec8-4ddc-4754-8c69-193d3c182291 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.056747 Sep 07 12:31:54.226702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e0435597-6e17-45e9-b462-02d749950efc tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:54.228246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e0435597-6e17-45e9-b462-02d749950efc tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:54.228734 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 454/915] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:31:54 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:54.229694 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e0435597-6e17-45e9-b462-02d749950efc tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1566 microversion: 2.25 time: 0.665695 Sep 07 12:31:54.240778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-83898e68-06b2-44e9-a5a6-da41fe86df43 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:31:54.243309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-83898e68-06b2-44e9-a5a6-da41fe86df43 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:54.244102 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 462/916] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:53 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1566 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:54.254148 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83898e68-06b2-44e9-a5a6-da41fe86df43 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:54.255102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83898e68-06b2-44e9-a5a6-da41fe86df43 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:54.255835 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83898e68-06b2-44e9-a5a6-da41fe86df43 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:54.256592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83898e68-06b2-44e9-a5a6-da41fe86df43 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:54.257072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83898e68-06b2-44e9-a5a6-da41fe86df43 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:54.257521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83898e68-06b2-44e9-a5a6-da41fe86df43 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:54.297016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-83898e68-06b2-44e9-a5a6-da41fe86df43 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:54.305072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-83898e68-06b2-44e9-a5a6-da41fe86df43 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Old instance type tempest-test_resize_flavor_-1335368208, new instance type m1.heat {{(pid=122433) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 12:31:54.317163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-83898e68-06b2-44e9-a5a6-da41fe86df43 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:31:54.317847 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-83898e68-06b2-44e9-a5a6-da41fe86df43 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:31:54.318123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-83898e68-06b2-44e9-a5a6-da41fe86df43 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:31:54.318607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-83898e68-06b2-44e9-a5a6-da41fe86df43 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:31:54.319159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-83898e68-06b2-44e9-a5a6-da41fe86df43 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:31:54.471518 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:54.588042 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-83898e68-06b2-44e9-a5a6-da41fe86df43 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "POST /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060/action" status: 202 len: 0 microversion: 2.1 time: 0.347892 Sep 07 12:31:54.592116 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 455/917] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:31:54 2022] POST /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:31:54.598262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1854b30e-3b7c-438b-8ad2-ddde1fe6f196 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:54.599118 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1854b30e-3b7c-438b-8ad2-ddde1fe6f196 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:54.613500 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1854b30e-3b7c-438b-8ad2-ddde1fe6f196 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:54.614011 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1854b30e-3b7c-438b-8ad2-ddde1fe6f196 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:54.614461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1854b30e-3b7c-438b-8ad2-ddde1fe6f196 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:54.615363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1854b30e-3b7c-438b-8ad2-ddde1fe6f196 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:54.615637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1854b30e-3b7c-438b-8ad2-ddde1fe6f196 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:54.616099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1854b30e-3b7c-438b-8ad2-ddde1fe6f196 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:54.839117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9a3b7e13-34c9-41b3-afab-30628609ec37 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:54.840019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9a3b7e13-34c9-41b3-afab-30628609ec37 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b65cf6c-5a50-4c86-9255-c7d712522cfe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:54.853882 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a3b7e13-34c9-41b3-afab-30628609ec37 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:54.854524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a3b7e13-34c9-41b3-afab-30628609ec37 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:54.855056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a3b7e13-34c9-41b3-afab-30628609ec37 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:54.855905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a3b7e13-34c9-41b3-afab-30628609ec37 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:54.856416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a3b7e13-34c9-41b3-afab-30628609ec37 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:54.857026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a3b7e13-34c9-41b3-afab-30628609ec37 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:55.007276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=14 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:31:55.150160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1854b30e-3b7c-438b-8ad2-ddde1fe6f196 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:55.161891 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1854b30e-3b7c-438b-8ad2-ddde1fe6f196 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1538 microversion: 2.1 time: 0.568018 Sep 07 12:31:55.170736 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 463/918] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:54 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1538 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:55.181423 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cadde15d-c32a-44fe-9f5c-ca0fdeb8b810 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:55.199231 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cadde15d-c32a-44fe-9f5c-ca0fdeb8b810 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:55.219160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cadde15d-c32a-44fe-9f5c-ca0fdeb8b810 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:55.222351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cadde15d-c32a-44fe-9f5c-ca0fdeb8b810 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:55.226503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cadde15d-c32a-44fe-9f5c-ca0fdeb8b810 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:55.228332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cadde15d-c32a-44fe-9f5c-ca0fdeb8b810 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:55.234420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cadde15d-c32a-44fe-9f5c-ca0fdeb8b810 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:55.237502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cadde15d-c32a-44fe-9f5c-ca0fdeb8b810 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:55.356591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9a3b7e13-34c9-41b3-afab-30628609ec37 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:55.477049 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9a3b7e13-34c9-41b3-afab-30628609ec37 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe" status: 200 len: 1313 microversion: 2.1 time: 0.640622 Sep 07 12:31:55.497709 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 456/919] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:54 2022] GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe => generated 1313 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:55.556348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-12a67a85-1313-4d40-845f-d158a6cbf726 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:55.557607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-12a67a85-1313-4d40-845f-d158a6cbf726 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:55.562419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cadde15d-c32a-44fe-9f5c-ca0fdeb8b810 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:55.574744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cadde15d-c32a-44fe-9f5c-ca0fdeb8b810 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:55.585008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cadde15d-c32a-44fe-9f5c-ca0fdeb8b810 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:55.586231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12a67a85-1313-4d40-845f-d158a6cbf726 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:55.587107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12a67a85-1313-4d40-845f-d158a6cbf726 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:55.587887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12a67a85-1313-4d40-845f-d158a6cbf726 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:55.589215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12a67a85-1313-4d40-845f-d158a6cbf726 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:55.598471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12a67a85-1313-4d40-845f-d158a6cbf726 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:55.602053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12a67a85-1313-4d40-845f-d158a6cbf726 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:55.634254 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cadde15d-c32a-44fe-9f5c-ca0fdeb8b810 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1553 microversion: 2.91 time: 0.456805 Sep 07 12:31:55.647356 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 464/920] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:55 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1553 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:55.652201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32d1dae4-f46e-4b44-b218-99e12b9abcf8 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:55.663211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-32d1dae4-f46e-4b44-b218-99e12b9abcf8 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 97552bf3-7814-403e-b66c-582b2f4f703f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:55.681569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d1dae4-f46e-4b44-b218-99e12b9abcf8 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:55.694506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d1dae4-f46e-4b44-b218-99e12b9abcf8 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:55.696857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d1dae4-f46e-4b44-b218-99e12b9abcf8 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:55.703202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d1dae4-f46e-4b44-b218-99e12b9abcf8 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:55.704042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d1dae4-f46e-4b44-b218-99e12b9abcf8 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:55.705914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d1dae4-f46e-4b44-b218-99e12b9abcf8 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:55.813726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-32d1dae4-f46e-4b44-b218-99e12b9abcf8 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 97552bf3-7814-403e-b66c-582b2f4f703f] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:31:56.005532 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-32d1dae4-f46e-4b44-b218-99e12b9abcf8 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "DELETE /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f" status: 204 len: 0 microversion: 2.1 time: 0.356895 Sep 07 12:31:56.010267 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 465/921] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:31:55 2022] DELETE /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:31:56.018447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6a7f5553-bdfc-4fcd-9209-3a9118ecace1 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:56.019202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6a7f5553-bdfc-4fcd-9209-3a9118ecace1 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 97552bf3-7814-403e-b66c-582b2f4f703f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:56.044277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a7f5553-bdfc-4fcd-9209-3a9118ecace1 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:56.044787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a7f5553-bdfc-4fcd-9209-3a9118ecace1 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:56.045225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a7f5553-bdfc-4fcd-9209-3a9118ecace1 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:56.046621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a7f5553-bdfc-4fcd-9209-3a9118ecace1 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:56.047097 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a7f5553-bdfc-4fcd-9209-3a9118ecace1 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:56.047529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6a7f5553-bdfc-4fcd-9209-3a9118ecace1 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:56.275546 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-12a67a85-1313-4d40-845f-d158a6cbf726 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:56.308898 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-12a67a85-1313-4d40-845f-d158a6cbf726 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:56.328027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-12a67a85-1313-4d40-845f-d158a6cbf726 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:56.334285 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-12a67a85-1313-4d40-845f-d158a6cbf726 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1566 microversion: 2.25 time: 0.833262 Sep 07 12:31:56.334796 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 457/922] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:55 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1566 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:56.370980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c143e62e-8cc9-4db2-a062-076640f4fa4a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:56.378788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c143e62e-8cc9-4db2-a062-076640f4fa4a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:56.398381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c143e62e-8cc9-4db2-a062-076640f4fa4a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:56.399919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c143e62e-8cc9-4db2-a062-076640f4fa4a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:56.401007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c143e62e-8cc9-4db2-a062-076640f4fa4a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:56.403001 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c143e62e-8cc9-4db2-a062-076640f4fa4a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:56.404951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c143e62e-8cc9-4db2-a062-076640f4fa4a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:56.406424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c143e62e-8cc9-4db2-a062-076640f4fa4a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:56.582501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6a7f5553-bdfc-4fcd-9209-3a9118ecace1 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:56.616728 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6a7f5553-bdfc-4fcd-9209-3a9118ecace1 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f" status: 200 len: 1708 microversion: 2.1 time: 0.604161 Sep 07 12:31:56.631917 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 466/923] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:56 2022] GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f => generated 1708 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:56.652696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a405a75f-7b40-4d55-ba3e-8bd937a5c806 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:56.654115 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a405a75f-7b40-4d55-ba3e-8bd937a5c806 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b65cf6c-5a50-4c86-9255-c7d712522cfe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:56.672603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a405a75f-7b40-4d55-ba3e-8bd937a5c806 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:56.673366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a405a75f-7b40-4d55-ba3e-8bd937a5c806 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:56.674939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a405a75f-7b40-4d55-ba3e-8bd937a5c806 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:56.680220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a405a75f-7b40-4d55-ba3e-8bd937a5c806 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:56.682189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a405a75f-7b40-4d55-ba3e-8bd937a5c806 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:56.683407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a405a75f-7b40-4d55-ba3e-8bd937a5c806 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:56.928817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c143e62e-8cc9-4db2-a062-076640f4fa4a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:56.941194 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c143e62e-8cc9-4db2-a062-076640f4fa4a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1538 microversion: 2.1 time: 0.585514 Sep 07 12:31:56.956614 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 458/924] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:56 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1538 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:56.956614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-890d197b-089d-4959-b79d-27c1e488e615 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:56.956614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-890d197b-089d-4959-b79d-27c1e488e615 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:56.990854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-890d197b-089d-4959-b79d-27c1e488e615 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:56.991441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-890d197b-089d-4959-b79d-27c1e488e615 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:56.991884 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-890d197b-089d-4959-b79d-27c1e488e615 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:56.992858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-890d197b-089d-4959-b79d-27c1e488e615 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:56.993328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-890d197b-089d-4959-b79d-27c1e488e615 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:56.996769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-890d197b-089d-4959-b79d-27c1e488e615 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:57.104380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a405a75f-7b40-4d55-ba3e-8bd937a5c806 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:57.126238 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a405a75f-7b40-4d55-ba3e-8bd937a5c806 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe" status: 200 len: 1313 microversion: 2.1 time: 0.491713 Sep 07 12:31:57.145674 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 467/925] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:56 2022] GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe => generated 1313 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:57.235415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-890d197b-089d-4959-b79d-27c1e488e615 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:57.278194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-890d197b-089d-4959-b79d-27c1e488e615 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:57.296452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-890d197b-089d-4959-b79d-27c1e488e615 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:57.329757 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-890d197b-089d-4959-b79d-27c1e488e615 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1553 microversion: 2.91 time: 0.385056 Sep 07 12:31:57.332634 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 459/926] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:56 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1553 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:57.364710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aeb0f8cc-033a-4c18-b8cc-c06b742a8b94 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:57.365909 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aeb0f8cc-033a-4c18-b8cc-c06b742a8b94 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:57.379866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aeb0f8cc-033a-4c18-b8cc-c06b742a8b94 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:57.381397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aeb0f8cc-033a-4c18-b8cc-c06b742a8b94 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:57.383634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aeb0f8cc-033a-4c18-b8cc-c06b742a8b94 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:57.385193 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aeb0f8cc-033a-4c18-b8cc-c06b742a8b94 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:57.387567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aeb0f8cc-033a-4c18-b8cc-c06b742a8b94 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:57.390176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aeb0f8cc-033a-4c18-b8cc-c06b742a8b94 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:57.633244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aeb0f8cc-033a-4c18-b8cc-c06b742a8b94 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:57.645056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aeb0f8cc-033a-4c18-b8cc-c06b742a8b94 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:57.648800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aeb0f8cc-033a-4c18-b8cc-c06b742a8b94 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:57.650490 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aeb0f8cc-033a-4c18-b8cc-c06b742a8b94 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1566 microversion: 2.25 time: 0.289922 Sep 07 12:31:57.651528 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 468/927] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:57 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1566 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:57.671155 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-111c6044-0d01-402b-9f9f-3ee668911de2 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:57.672611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-111c6044-0d01-402b-9f9f-3ee668911de2 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 97552bf3-7814-403e-b66c-582b2f4f703f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:57.696110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-111c6044-0d01-402b-9f9f-3ee668911de2 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:57.700228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-111c6044-0d01-402b-9f9f-3ee668911de2 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:57.700760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-111c6044-0d01-402b-9f9f-3ee668911de2 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:57.702139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-111c6044-0d01-402b-9f9f-3ee668911de2 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:57.707700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-111c6044-0d01-402b-9f9f-3ee668911de2 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:57.709680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-111c6044-0d01-402b-9f9f-3ee668911de2 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:57.944626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-111c6044-0d01-402b-9f9f-3ee668911de2 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:57.960925 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-111c6044-0d01-402b-9f9f-3ee668911de2 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f" status: 200 len: 1708 microversion: 2.1 time: 0.293271 Sep 07 12:31:57.980551 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 460/928] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:57 2022] GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f => generated 1708 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:57.980763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-06221674-1b29-4093-9da9-c24834b51697 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:57.980763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-06221674-1b29-4093-9da9-c24834b51697 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:57.989669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06221674-1b29-4093-9da9-c24834b51697 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:57.990502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06221674-1b29-4093-9da9-c24834b51697 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:57.991065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06221674-1b29-4093-9da9-c24834b51697 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:57.992022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06221674-1b29-4093-9da9-c24834b51697 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:57.992646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06221674-1b29-4093-9da9-c24834b51697 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:57.993436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06221674-1b29-4093-9da9-c24834b51697 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:58.154165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fab908da-4e58-4ddb-966a-61589e989036 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:58.155278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fab908da-4e58-4ddb-966a-61589e989036 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b65cf6c-5a50-4c86-9255-c7d712522cfe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:58.180823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fab908da-4e58-4ddb-966a-61589e989036 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:58.182180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fab908da-4e58-4ddb-966a-61589e989036 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:58.188040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fab908da-4e58-4ddb-966a-61589e989036 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:58.189376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fab908da-4e58-4ddb-966a-61589e989036 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:58.190183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fab908da-4e58-4ddb-966a-61589e989036 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:58.190942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fab908da-4e58-4ddb-966a-61589e989036 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:58.280188 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-06221674-1b29-4093-9da9-c24834b51697 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:58.294551 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-06221674-1b29-4093-9da9-c24834b51697 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1538 microversion: 2.1 time: 0.322144 Sep 07 12:31:58.295465 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 469/929] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:57 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1538 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:31:58.375525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-301e01db-f8a1-4f26-a0b4-a7d1d51a26ec tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:58.376521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-301e01db-f8a1-4f26-a0b4-a7d1d51a26ec tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:58.389192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-301e01db-f8a1-4f26-a0b4-a7d1d51a26ec tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:58.393333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-301e01db-f8a1-4f26-a0b4-a7d1d51a26ec tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:58.394112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-301e01db-f8a1-4f26-a0b4-a7d1d51a26ec tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:58.398330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-301e01db-f8a1-4f26-a0b4-a7d1d51a26ec tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:58.399096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-301e01db-f8a1-4f26-a0b4-a7d1d51a26ec tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:58.402968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-301e01db-f8a1-4f26-a0b4-a7d1d51a26ec tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:58.664297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-301e01db-f8a1-4f26-a0b4-a7d1d51a26ec tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:58.702588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-301e01db-f8a1-4f26-a0b4-a7d1d51a26ec tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:58.709361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-301e01db-f8a1-4f26-a0b4-a7d1d51a26ec tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:58.735460 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-301e01db-f8a1-4f26-a0b4-a7d1d51a26ec tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1553 microversion: 2.91 time: 0.364414 Sep 07 12:31:58.773157 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 470/930] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:58 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1553 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:58.785092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-35e2f1dc-ad00-4965-a8e5-42e4e53cff19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:58.796580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-35e2f1dc-ad00-4965-a8e5-42e4e53cff19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:58.824179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fab908da-4e58-4ddb-966a-61589e989036 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:58.832406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35e2f1dc-ad00-4965-a8e5-42e4e53cff19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:58.836916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35e2f1dc-ad00-4965-a8e5-42e4e53cff19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:58.840472 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fab908da-4e58-4ddb-966a-61589e989036 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe" status: 200 len: 1313 microversion: 2.1 time: 0.690594 Sep 07 12:31:58.840706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35e2f1dc-ad00-4965-a8e5-42e4e53cff19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:58.842270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35e2f1dc-ad00-4965-a8e5-42e4e53cff19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:58.843536 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 461/931] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:58 2022] GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe => generated 1313 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:31:58.850694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35e2f1dc-ad00-4965-a8e5-42e4e53cff19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:58.852114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35e2f1dc-ad00-4965-a8e5-42e4e53cff19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:58.990745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ba90311c-a126-44ba-b142-b69923cc4f85 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:58.991780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ba90311c-a126-44ba-b142-b69923cc4f85 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 97552bf3-7814-403e-b66c-582b2f4f703f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:59.004758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba90311c-a126-44ba-b142-b69923cc4f85 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:59.009598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba90311c-a126-44ba-b142-b69923cc4f85 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:59.010598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba90311c-a126-44ba-b142-b69923cc4f85 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:59.011994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba90311c-a126-44ba-b142-b69923cc4f85 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:59.012711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba90311c-a126-44ba-b142-b69923cc4f85 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:59.016341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba90311c-a126-44ba-b142-b69923cc4f85 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:59.778535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-35e2f1dc-ad00-4965-a8e5-42e4e53cff19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:59.822625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-35e2f1dc-ad00-4965-a8e5-42e4e53cff19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:59.826962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-35e2f1dc-ad00-4965-a8e5-42e4e53cff19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:31:59.830079 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-35e2f1dc-ad00-4965-a8e5-42e4e53cff19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1566 microversion: 2.25 time: 1.053961 Sep 07 12:31:59.831176 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 471/932] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:31:58 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1566 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:31:59.841907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d4186b8d-acae-4428-b14e-fe1257194841 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:31:59.842980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d4186b8d-acae-4428-b14e-fe1257194841 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:31:59.859221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4186b8d-acae-4428-b14e-fe1257194841 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:59.870425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4186b8d-acae-4428-b14e-fe1257194841 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:59.871420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4186b8d-acae-4428-b14e-fe1257194841 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:31:59.872843 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4186b8d-acae-4428-b14e-fe1257194841 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:31:59.873782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4186b8d-acae-4428-b14e-fe1257194841 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:31:59.921572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4186b8d-acae-4428-b14e-fe1257194841 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:00.050900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ba90311c-a126-44ba-b142-b69923cc4f85 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:00.072449 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ba90311c-a126-44ba-b142-b69923cc4f85 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f" status: 200 len: 1708 microversion: 2.1 time: 1.085942 Sep 07 12:32:00.082891 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 462/933] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:58 2022] GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f => generated 1708 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:32:00.088434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-6633fb0b-0a75-40b2-94fb-2fa60ea91c10 req-aca1a430-6b49-4782-94dd-bbd0914feef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b849d7d-db03-43d3-b94c-3808ea7ae0cb", "name": "network-vif-plugged", "status": "completed", "tag": "d76c4cb6-1ff0-4c6b-9d8f-eb2ec1601a0d"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:00.138403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6633fb0b-0a75-40b2-94fb-2fa60ea91c10 req-aca1a430-6b49-4782-94dd-bbd0914feef0 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:00.139229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6633fb0b-0a75-40b2-94fb-2fa60ea91c10 req-aca1a430-6b49-4782-94dd-bbd0914feef0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:00.139871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6633fb0b-0a75-40b2-94fb-2fa60ea91c10 req-aca1a430-6b49-4782-94dd-bbd0914feef0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:00.186517 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-6633fb0b-0a75-40b2-94fb-2fa60ea91c10 req-aca1a430-6b49-4782-94dd-bbd0914feef0 service nova] Creating event network-vif-plugged:d76c4cb6-1ff0-4c6b-9d8f-eb2ec1601a0d for instance 7b849d7d-db03-43d3-b94c-3808ea7ae0cb on n-h2-852087-9 Sep 07 12:32:00.203107 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-6633fb0b-0a75-40b2-94fb-2fa60ea91c10 req-aca1a430-6b49-4782-94dd-bbd0914feef0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110138 Sep 07 12:32:00.204395 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 463/934] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:00.222341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eb313764-4b54-4f35-8de1-5a7d1e2bf8a4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:00.224410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-eb313764-4b54-4f35-8de1-5a7d1e2bf8a4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:00.241581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb313764-4b54-4f35-8de1-5a7d1e2bf8a4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:00.242429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb313764-4b54-4f35-8de1-5a7d1e2bf8a4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:00.243142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb313764-4b54-4f35-8de1-5a7d1e2bf8a4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:00.244146 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb313764-4b54-4f35-8de1-5a7d1e2bf8a4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:00.245671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb313764-4b54-4f35-8de1-5a7d1e2bf8a4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:00.246409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb313764-4b54-4f35-8de1-5a7d1e2bf8a4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:00.959530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-eb313764-4b54-4f35-8de1-5a7d1e2bf8a4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:00.973903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-eb313764-4b54-4f35-8de1-5a7d1e2bf8a4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:00.996043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-eb313764-4b54-4f35-8de1-5a7d1e2bf8a4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:01.015474 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eb313764-4b54-4f35-8de1-5a7d1e2bf8a4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1553 microversion: 2.91 time: 0.804250 Sep 07 12:32:01.016870 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 464/935] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:00 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1553 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:01.029160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-59f3a2ca-f559-4315-8905-1f66ed755531 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:01.038720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-59f3a2ca-f559-4315-8905-1f66ed755531 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b65cf6c-5a50-4c86-9255-c7d712522cfe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:01.046322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59f3a2ca-f559-4315-8905-1f66ed755531 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:01.049158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59f3a2ca-f559-4315-8905-1f66ed755531 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:01.050222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59f3a2ca-f559-4315-8905-1f66ed755531 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:01.062350 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59f3a2ca-f559-4315-8905-1f66ed755531 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:01.064002 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59f3a2ca-f559-4315-8905-1f66ed755531 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:01.064897 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59f3a2ca-f559-4315-8905-1f66ed755531 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:01.330174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d4186b8d-acae-4428-b14e-fe1257194841 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:01.378214 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d4186b8d-acae-4428-b14e-fe1257194841 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1538 microversion: 2.1 time: 1.541584 Sep 07 12:32:01.394213 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 472/936] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:31:59 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1538 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:01.426835 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-128517fc-3831-49db-ad1d-ddcd7a608529 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:01.428826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-128517fc-3831-49db-ad1d-ddcd7a608529 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:01.446443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-128517fc-3831-49db-ad1d-ddcd7a608529 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:01.447674 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-128517fc-3831-49db-ad1d-ddcd7a608529 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:01.448852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-128517fc-3831-49db-ad1d-ddcd7a608529 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:01.450511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-128517fc-3831-49db-ad1d-ddcd7a608529 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:01.452030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-128517fc-3831-49db-ad1d-ddcd7a608529 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:01.454144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-128517fc-3831-49db-ad1d-ddcd7a608529 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:02.086321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-59f3a2ca-f559-4315-8905-1f66ed755531 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:02.139752 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-59f3a2ca-f559-4315-8905-1f66ed755531 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe" status: 200 len: 1313 microversion: 2.1 time: 1.113639 Sep 07 12:32:02.153719 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 465/937] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:01 2022] GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe => generated 1313 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:02.153997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6c910f7c-4eb7-45b5-b2f8-9fb94ea86abb tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:02.156494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6c910f7c-4eb7-45b5-b2f8-9fb94ea86abb tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 97552bf3-7814-403e-b66c-582b2f4f703f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:02.178123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c910f7c-4eb7-45b5-b2f8-9fb94ea86abb tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:02.181137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c910f7c-4eb7-45b5-b2f8-9fb94ea86abb tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:02.182500 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c910f7c-4eb7-45b5-b2f8-9fb94ea86abb tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:02.184325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c910f7c-4eb7-45b5-b2f8-9fb94ea86abb tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:02.185216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c910f7c-4eb7-45b5-b2f8-9fb94ea86abb tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:02.186043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c910f7c-4eb7-45b5-b2f8-9fb94ea86abb tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:02.959321 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-128517fc-3831-49db-ad1d-ddcd7a608529 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:02.971452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-128517fc-3831-49db-ad1d-ddcd7a608529 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:02.978597 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-128517fc-3831-49db-ad1d-ddcd7a608529 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:02.980480 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-128517fc-3831-49db-ad1d-ddcd7a608529 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1566 microversion: 2.25 time: 1.584268 Sep 07 12:32:02.995290 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 473/938] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:01 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1566 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:03.011677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eb519c84-adec-4a8a-b418-9298fbbc5dae tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:03.012894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eb519c84-adec-4a8a-b418-9298fbbc5dae tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:03.026891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb519c84-adec-4a8a-b418-9298fbbc5dae tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:03.028200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb519c84-adec-4a8a-b418-9298fbbc5dae tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:03.028900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb519c84-adec-4a8a-b418-9298fbbc5dae tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:03.031300 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb519c84-adec-4a8a-b418-9298fbbc5dae tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:03.032093 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb519c84-adec-4a8a-b418-9298fbbc5dae tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:03.032751 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb519c84-adec-4a8a-b418-9298fbbc5dae tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:03.585758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eb519c84-adec-4a8a-b418-9298fbbc5dae tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:03.586425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6c910f7c-4eb7-45b5-b2f8-9fb94ea86abb tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:03.604748 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6c910f7c-4eb7-45b5-b2f8-9fb94ea86abb tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f" status: 200 len: 1708 microversion: 2.1 time: 1.461410 Sep 07 12:32:03.622074 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 466/939] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:02 2022] GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f => generated 1708 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:03.637379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-9b4c0e1f-4dd9-4eb7-839f-7141f15f2960 req-5503e20b-98bf-40bf-b164-ec802b337c00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97552bf3-7814-403e-b66c-582b2f4f703f", "name": "network-vif-unplugged", "status": "completed", "tag": "6577c68c-93a9-4100-9045-b5fed985d7db"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:03.666997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eb519c84-adec-4a8a-b418-9298fbbc5dae tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:03.671328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eb519c84-adec-4a8a-b418-9298fbbc5dae tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:03.697287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9b4c0e1f-4dd9-4eb7-839f-7141f15f2960 req-5503e20b-98bf-40bf-b164-ec802b337c00 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:03.711190 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eb519c84-adec-4a8a-b418-9298fbbc5dae tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1553 microversion: 2.91 time: 0.713885 Sep 07 12:32:03.714993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9b4c0e1f-4dd9-4eb7-839f-7141f15f2960 req-5503e20b-98bf-40bf-b164-ec802b337c00 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:03.716007 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 474/940] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:02 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1553 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:03.721629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9b4c0e1f-4dd9-4eb7-839f-7141f15f2960 req-5503e20b-98bf-40bf-b164-ec802b337c00 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:03.739362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-50fcc310-4fde-4df8-b282-32d9ca6b2cab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:03.740528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-50fcc310-4fde-4df8-b282-32d9ca6b2cab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:03.775706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50fcc310-4fde-4df8-b282-32d9ca6b2cab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:03.776684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50fcc310-4fde-4df8-b282-32d9ca6b2cab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:03.777544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50fcc310-4fde-4df8-b282-32d9ca6b2cab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:03.781826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50fcc310-4fde-4df8-b282-32d9ca6b2cab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:03.784408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50fcc310-4fde-4df8-b282-32d9ca6b2cab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:03.790823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50fcc310-4fde-4df8-b282-32d9ca6b2cab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:03.833981 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-9b4c0e1f-4dd9-4eb7-839f-7141f15f2960 req-5503e20b-98bf-40bf-b164-ec802b337c00 service nova] Creating event network-vif-unplugged:6577c68c-93a9-4100-9045-b5fed985d7db for instance 97552bf3-7814-403e-b66c-582b2f4f703f on n-h1-852087-9 Sep 07 12:32:03.854439 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-9b4c0e1f-4dd9-4eb7-839f-7141f15f2960 req-5503e20b-98bf-40bf-b164-ec802b337c00 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.230093 Sep 07 12:32:03.862459 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 467/941] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:03.892854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-54653e9e-54ee-4780-9d07-fdc169c5616c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:03.905763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-54653e9e-54ee-4780-9d07-fdc169c5616c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b65cf6c-5a50-4c86-9255-c7d712522cfe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:03.951828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54653e9e-54ee-4780-9d07-fdc169c5616c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:03.952632 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54653e9e-54ee-4780-9d07-fdc169c5616c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:03.953445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54653e9e-54ee-4780-9d07-fdc169c5616c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:03.954788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54653e9e-54ee-4780-9d07-fdc169c5616c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:03.955690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54653e9e-54ee-4780-9d07-fdc169c5616c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:03.956468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54653e9e-54ee-4780-9d07-fdc169c5616c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:04.538007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-50fcc310-4fde-4df8-b282-32d9ca6b2cab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:04.549063 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-50fcc310-4fde-4df8-b282-32d9ca6b2cab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1543 microversion: 2.1 time: 0.830354 Sep 07 12:32:04.552050 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 475/942] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:03 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1543 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:04.569956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-11409247-bafa-4e20-9fd6-3cfd6e20f880 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:04.570876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-11409247-bafa-4e20-9fd6-3cfd6e20f880 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:04.592005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11409247-bafa-4e20-9fd6-3cfd6e20f880 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:04.595937 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11409247-bafa-4e20-9fd6-3cfd6e20f880 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:04.596779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11409247-bafa-4e20-9fd6-3cfd6e20f880 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:04.598554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11409247-bafa-4e20-9fd6-3cfd6e20f880 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:04.602819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11409247-bafa-4e20-9fd6-3cfd6e20f880 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:04.603496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11409247-bafa-4e20-9fd6-3cfd6e20f880 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:04.838967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-54653e9e-54ee-4780-9d07-fdc169c5616c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:04.861386 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-54653e9e-54ee-4780-9d07-fdc169c5616c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe" status: 200 len: 1313 microversion: 2.1 time: 0.985366 Sep 07 12:32:04.882453 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 468/943] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:03 2022] GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe => generated 1313 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:04.898984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ddba7bd-9da2-4e71-beb1-512edb8e0dd3 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:04.899770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3ddba7bd-9da2-4e71-beb1-512edb8e0dd3 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 97552bf3-7814-403e-b66c-582b2f4f703f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:04.910490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ddba7bd-9da2-4e71-beb1-512edb8e0dd3 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:04.911022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ddba7bd-9da2-4e71-beb1-512edb8e0dd3 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:04.911478 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ddba7bd-9da2-4e71-beb1-512edb8e0dd3 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:04.912216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ddba7bd-9da2-4e71-beb1-512edb8e0dd3 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:04.912694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ddba7bd-9da2-4e71-beb1-512edb8e0dd3 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:04.913137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ddba7bd-9da2-4e71-beb1-512edb8e0dd3 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:05.309442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3ddba7bd-9da2-4e71-beb1-512edb8e0dd3 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:05.325299 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ddba7bd-9da2-4e71-beb1-512edb8e0dd3 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f" status: 200 len: 1642 microversion: 2.1 time: 0.441471 Sep 07 12:32:05.326573 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 469/944] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:04 2022] GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f => generated 1642 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:05.341726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0deeee2a-3140-4485-b274-132f3a03f36c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:05.342389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0deeee2a-3140-4485-b274-132f3a03f36c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:05.349152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0deeee2a-3140-4485-b274-132f3a03f36c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:05.349714 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0deeee2a-3140-4485-b274-132f3a03f36c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:05.350166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0deeee2a-3140-4485-b274-132f3a03f36c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:05.350909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0deeee2a-3140-4485-b274-132f3a03f36c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:05.351379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0deeee2a-3140-4485-b274-132f3a03f36c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:05.351811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0deeee2a-3140-4485-b274-132f3a03f36c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:05.570418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0deeee2a-3140-4485-b274-132f3a03f36c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:05.590256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-11409247-bafa-4e20-9fd6-3cfd6e20f880 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:05.604708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-11409247-bafa-4e20-9fd6-3cfd6e20f880 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:05.605766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-11409247-bafa-4e20-9fd6-3cfd6e20f880 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:05.607205 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-11409247-bafa-4e20-9fd6-3cfd6e20f880 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1566 microversion: 2.25 time: 1.053780 Sep 07 12:32:05.617897 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 476/945] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:04 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1566 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:05.623294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-24488103-0c31-4561-bbbd-59a078100441 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:05.623938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-24488103-0c31-4561-bbbd-59a078100441 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:05.627955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0deeee2a-3140-4485-b274-132f3a03f36c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:05.629911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0deeee2a-3140-4485-b274-132f3a03f36c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:05.639214 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0deeee2a-3140-4485-b274-132f3a03f36c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1553 microversion: 2.91 time: 0.311501 Sep 07 12:32:05.646190 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 470/946] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:05 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1553 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:05.647244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24488103-0c31-4561-bbbd-59a078100441 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:05.647762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24488103-0c31-4561-bbbd-59a078100441 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:05.648212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24488103-0c31-4561-bbbd-59a078100441 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:05.648946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24488103-0c31-4561-bbbd-59a078100441 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:05.649693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24488103-0c31-4561-bbbd-59a078100441 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:05.650338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24488103-0c31-4561-bbbd-59a078100441 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:05.653983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:32:05.812083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-1bd06151-c9a0-4df8-93ae-61d807d33a7a req-1cbd7bcb-ff6f-4164-a399-7a6fada349e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97552bf3-7814-403e-b66c-582b2f4f703f", "name": "network-vif-deleted", "tag": "6577c68c-93a9-4100-9045-b5fed985d7db"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:05.850057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1bd06151-c9a0-4df8-93ae-61d807d33a7a req-1cbd7bcb-ff6f-4164-a399-7a6fada349e9 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:05.853822 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1bd06151-c9a0-4df8-93ae-61d807d33a7a req-1cbd7bcb-ff6f-4164-a399-7a6fada349e9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:05.854804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1bd06151-c9a0-4df8-93ae-61d807d33a7a req-1cbd7bcb-ff6f-4164-a399-7a6fada349e9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:05.885468 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-1bd06151-c9a0-4df8-93ae-61d807d33a7a req-1cbd7bcb-ff6f-4164-a399-7a6fada349e9 service nova] Creating event network-vif-deleted:6577c68c-93a9-4100-9045-b5fed985d7db for instance 97552bf3-7814-403e-b66c-582b2f4f703f on n-h1-852087-9 Sep 07 12:32:05.896326 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-1bd06151-c9a0-4df8-93ae-61d807d33a7a req-1cbd7bcb-ff6f-4164-a399-7a6fada349e9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097425 Sep 07 12:32:05.897340 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 471/947] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:32:05.911683 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-017dc0e9-71df-4ffe-9f48-0d091ece2a0b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:05.918337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-017dc0e9-71df-4ffe-9f48-0d091ece2a0b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b65cf6c-5a50-4c86-9255-c7d712522cfe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:05.937548 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-017dc0e9-71df-4ffe-9f48-0d091ece2a0b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:05.938203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-017dc0e9-71df-4ffe-9f48-0d091ece2a0b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:05.938756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-017dc0e9-71df-4ffe-9f48-0d091ece2a0b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:05.940492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-017dc0e9-71df-4ffe-9f48-0d091ece2a0b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:05.940492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-017dc0e9-71df-4ffe-9f48-0d091ece2a0b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:05.940935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-017dc0e9-71df-4ffe-9f48-0d091ece2a0b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:06.262288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-24488103-0c31-4561-bbbd-59a078100441 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:06.282484 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-24488103-0c31-4561-bbbd-59a078100441 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1543 microversion: 2.1 time: 0.659493 Sep 07 12:32:06.285470 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 477/948] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:05 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1543 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:06.299404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-15b0b70a-90e6-4e87-9c5a-6f1a6f2ae90d req-48196f13-0d55-430d-91d0-2c7f67b18308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b65cf6c-5a50-4c86-9255-c7d712522cfe", "name": "network-vif-plugged", "status": "completed", "tag": "da45972a-1a94-47cc-8816-2b02beeab531"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:06.344569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-15b0b70a-90e6-4e87-9c5a-6f1a6f2ae90d req-48196f13-0d55-430d-91d0-2c7f67b18308 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:06.351993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-15b0b70a-90e6-4e87-9c5a-6f1a6f2ae90d req-48196f13-0d55-430d-91d0-2c7f67b18308 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:06.352751 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-15b0b70a-90e6-4e87-9c5a-6f1a6f2ae90d req-48196f13-0d55-430d-91d0-2c7f67b18308 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:06.392076 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-15b0b70a-90e6-4e87-9c5a-6f1a6f2ae90d req-48196f13-0d55-430d-91d0-2c7f67b18308 service nova] Creating event network-vif-plugged:da45972a-1a94-47cc-8816-2b02beeab531 for instance 7b65cf6c-5a50-4c86-9255-c7d712522cfe on n-h1-852087-9 Sep 07 12:32:06.394593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-017dc0e9-71df-4ffe-9f48-0d091ece2a0b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:06.406207 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-017dc0e9-71df-4ffe-9f48-0d091ece2a0b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe" status: 200 len: 1313 microversion: 2.1 time: 0.507342 Sep 07 12:32:06.417884 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 472/949] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:05 2022] GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe => generated 1313 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:06.431755 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-15b0b70a-90e6-4e87-9c5a-6f1a6f2ae90d req-48196f13-0d55-430d-91d0-2c7f67b18308 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144452 Sep 07 12:32:06.432413 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 478/950] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:06.434414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3a6220c6-6d84-45e0-bfa6-8d9d542fb162 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:06.436554 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3a6220c6-6d84-45e0-bfa6-8d9d542fb162 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 97552bf3-7814-403e-b66c-582b2f4f703f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:06.457297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a6220c6-6d84-45e0-bfa6-8d9d542fb162 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:06.458221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a6220c6-6d84-45e0-bfa6-8d9d542fb162 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:06.458949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a6220c6-6d84-45e0-bfa6-8d9d542fb162 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:06.460105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a6220c6-6d84-45e0-bfa6-8d9d542fb162 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:06.460853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a6220c6-6d84-45e0-bfa6-8d9d542fb162 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:06.461619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a6220c6-6d84-45e0-bfa6-8d9d542fb162 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:06.539224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a6220c6-6d84-45e0-bfa6-8d9d542fb162 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:06.540046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a6220c6-6d84-45e0-bfa6-8d9d542fb162 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:06.540738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a6220c6-6d84-45e0-bfa6-8d9d542fb162 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:06.541432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-3a6220c6-6d84-45e0-bfa6-8d9d542fb162 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lazy-loading 'fault' on Instance uuid 97552bf3-7814-403e-b66c-582b2f4f703f {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:32:06.641343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eb77e095-29f5-411c-8640-c050caa8cb37 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:06.642136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eb77e095-29f5-411c-8640-c050caa8cb37 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:06.660559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb77e095-29f5-411c-8640-c050caa8cb37 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:06.666494 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb77e095-29f5-411c-8640-c050caa8cb37 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:06.668693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb77e095-29f5-411c-8640-c050caa8cb37 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:06.670397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb77e095-29f5-411c-8640-c050caa8cb37 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:06.675162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb77e095-29f5-411c-8640-c050caa8cb37 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:06.675875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb77e095-29f5-411c-8640-c050caa8cb37 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:07.487161 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3a6220c6-6d84-45e0-bfa6-8d9d542fb162 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af7f40e0cc4ab7bbc06201d5e253cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb96c3ce6734e5f94229d94bf379318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:07.499415 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3a6220c6-6d84-45e0-bfa6-8d9d542fb162 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f" status: 200 len: 1352 microversion: 2.1 time: 1.079773 Sep 07 12:32:07.500849 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 473/951] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:06 2022] GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f => generated 1352 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:07.512304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e4c3edd1-cb79-4935-9694-395f1ee2e4f1 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:07.513234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e4c3edd1-cb79-4935-9694-395f1ee2e4f1 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:07.524524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4c3edd1-cb79-4935-9694-395f1ee2e4f1 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:07.525427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4c3edd1-cb79-4935-9694-395f1ee2e4f1 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:07.526073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4c3edd1-cb79-4935-9694-395f1ee2e4f1 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:07.528726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4c3edd1-cb79-4935-9694-395f1ee2e4f1 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:07.561516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4c3edd1-cb79-4935-9694-395f1ee2e4f1 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:07.561904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4c3edd1-cb79-4935-9694-395f1ee2e4f1 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:07.592903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:32:07.771689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e4c3edd1-cb79-4935-9694-395f1ee2e4f1 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:07.788539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e4c3edd1-cb79-4935-9694-395f1ee2e4f1 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:07.790206 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e4c3edd1-cb79-4935-9694-395f1ee2e4f1 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:07.805201 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e4c3edd1-cb79-4935-9694-395f1ee2e4f1 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1553 microversion: 2.91 time: 0.302503 Sep 07 12:32:07.821858 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 474/952] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:07 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1553 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:07.835743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-884818b1-0f33-4cbe-8b7a-33dc40f36b2f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:07.836375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-884818b1-0f33-4cbe-8b7a-33dc40f36b2f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:07.848650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-884818b1-0f33-4cbe-8b7a-33dc40f36b2f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:07.849236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-884818b1-0f33-4cbe-8b7a-33dc40f36b2f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:07.849718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-884818b1-0f33-4cbe-8b7a-33dc40f36b2f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:07.850443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-884818b1-0f33-4cbe-8b7a-33dc40f36b2f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:07.850902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-884818b1-0f33-4cbe-8b7a-33dc40f36b2f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:07.851330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-884818b1-0f33-4cbe-8b7a-33dc40f36b2f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:07.864163 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eb77e095-29f5-411c-8640-c050caa8cb37 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:07.873849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eb77e095-29f5-411c-8640-c050caa8cb37 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:07.876148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eb77e095-29f5-411c-8640-c050caa8cb37 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:07.877877 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eb77e095-29f5-411c-8640-c050caa8cb37 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1566 microversion: 2.25 time: 1.240906 Sep 07 12:32:07.890125 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 479/953] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:06 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1566 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:07.904176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c84407e4-7ff8-4e5c-a0e1-88d2239620e0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:07.905219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c84407e4-7ff8-4e5c-a0e1-88d2239620e0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b65cf6c-5a50-4c86-9255-c7d712522cfe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:07.913036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c84407e4-7ff8-4e5c-a0e1-88d2239620e0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:07.914080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c84407e4-7ff8-4e5c-a0e1-88d2239620e0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:07.914762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c84407e4-7ff8-4e5c-a0e1-88d2239620e0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:07.915758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c84407e4-7ff8-4e5c-a0e1-88d2239620e0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:07.916484 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c84407e4-7ff8-4e5c-a0e1-88d2239620e0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:07.917125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c84407e4-7ff8-4e5c-a0e1-88d2239620e0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:08.224040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c84407e4-7ff8-4e5c-a0e1-88d2239620e0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:08.239238 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c84407e4-7ff8-4e5c-a0e1-88d2239620e0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe" status: 200 len: 1313 microversion: 2.1 time: 0.347559 Sep 07 12:32:08.246080 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 480/954] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:07 2022] GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe => generated 1313 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:08.288193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-884818b1-0f33-4cbe-8b7a-33dc40f36b2f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:08.298464 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-884818b1-0f33-4cbe-8b7a-33dc40f36b2f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1543 microversion: 2.1 time: 0.474442 Sep 07 12:32:08.299720 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 475/955] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:07 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1543 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:08.528327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1dbcecac-bbe6-45f6-b338-17ae1f316fb4 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:08.529088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1dbcecac-bbe6-45f6-b338-17ae1f316fb4 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 97552bf3-7814-403e-b66c-582b2f4f703f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:08.542914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1dbcecac-bbe6-45f6-b338-17ae1f316fb4 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:08.549197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1dbcecac-bbe6-45f6-b338-17ae1f316fb4 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:08.549829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1dbcecac-bbe6-45f6-b338-17ae1f316fb4 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:08.550765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1dbcecac-bbe6-45f6-b338-17ae1f316fb4 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:08.553868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1dbcecac-bbe6-45f6-b338-17ae1f316fb4 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:08.555936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1dbcecac-bbe6-45f6-b338-17ae1f316fb4 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:08.597710 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-1dbcecac-bbe6-45f6-b338-17ae1f316fb4 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] HTTP exception thrown: Instance 97552bf3-7814-403e-b66c-582b2f4f703f could not be found. Sep 07 12:32:08.603085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1dbcecac-bbe6-45f6-b338-17ae1f316fb4 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Request method failure captured: Sep 07 12:32:08.603085 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f HTTP/1.1 Sep 07 12:32:08.603085 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:32:08.603085 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:32:08.603085 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:32:08.603085 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:32:08.603085 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:32:08.603085 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:32:08.603085 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:32:08.603085 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:32:08.603085 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5dJb1OTudr_44cyeTAHiYfk7VwKMo6rRo2qsVYfhcQZuSgxztk_8VwpZaEk4SWo1BL4sx_z3ZNyUqZIj8bhLkqxQVaJjUcXOR3WLGKotUVUnKFu0uvV2x2PIFcY74J-Hj3_WS1b27IDp9v8TDB3ny3VpEfKHfWVVu0ExsyK3DV3M8 Sep 07 12:32:08.603085 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:32:08.603085 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:32:08.603085 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:32:08.603085 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:32:08.603085 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:32:08.603085 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:32:08.603085 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: eeb96c3ce6734e5f94229d94bf379318 Sep 07 12:32:08.603085 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-52478584 Sep 07 12:32:08.603085 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:32:08.603085 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:32:08.604986 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:32:08.604986 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-52478584 Sep 07 12:32:08.604986 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: eeb96c3ce6734e5f94229d94bf379318 Sep 07 12:32:08.604986 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-52478584 Sep 07 12:32:08.604986 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersWithSpecificFlavorTestJSON-52478584-project Sep 07 12:32:08.604986 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:32:08.604986 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:32:08.604986 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 02af7f40e0cc4ab7bbc06201d5e253cd Sep 07 12:32:08.604986 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-52478584-project Sep 07 12:32:08.604986 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:32:08.604986 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 97552bf3-7814-403e-b66c-582b2f4f703f could not be found. Sep 07 12:32:08.604986 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '97552bf3-7814-403e-b66c-582b2f4f703f'} Sep 07 12:32:08.605938 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:32:08.605938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:32:08.605938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:32:08.605938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:32:08.605938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:32:08.605938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:32:08.605938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:32:08.605938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:32:08.605938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:32:08.605938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:32:08.605938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97552bf3-7814-403e-b66c-582b2f4f703f could not be found. Sep 07 12:32:08.605938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:32:08.605938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:32:08.605938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:32:08.605938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:32:08.605938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:32:08.605938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:32:08.605938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:32:08.605938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:32:08.605938 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:32:08.607743 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:32:08.607743 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:32:08.607743 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:32:08.607743 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:32:08.607743 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:32:08.607743 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:32:08.607743 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:32:08.607743 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97552bf3-7814-403e-b66c-582b2f4f703f could not be found. Sep 07 12:32:08.607743 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:32:08.607743 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:32:08.607743 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:32:08.607743 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:32:08.607743 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:32:08.607743 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:32:08.607743 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:32:08.607743 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:32:08.607743 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97552bf3-7814-403e-b66c-582b2f4f703f could not be found. Sep 07 12:32:08.607743 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:32:08.609585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1dbcecac-bbe6-45f6-b338-17ae1f316fb4 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Returning 404 to user: Instance 97552bf3-7814-403e-b66c-582b2f4f703f could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:32:08.610529 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1dbcecac-bbe6-45f6-b338-17ae1f316fb4 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f" status: 404 len: 111 microversion: 2.1 time: 0.085743 Sep 07 12:32:08.616500 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 481/956] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:08 2022] GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:32:08.629322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c979a06c-c8ae-480d-9802-864a7639b4e4 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:08.635440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c979a06c-c8ae-480d-9802-864a7639b4e4 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 79881389-e6f0-43f3-96c3-fdb045bb956e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:08.659706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c979a06c-c8ae-480d-9802-864a7639b4e4 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:08.660735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c979a06c-c8ae-480d-9802-864a7639b4e4 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:08.661703 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c979a06c-c8ae-480d-9802-864a7639b4e4 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:08.663100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c979a06c-c8ae-480d-9802-864a7639b4e4 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:08.663933 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c979a06c-c8ae-480d-9802-864a7639b4e4 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:08.664759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c979a06c-c8ae-480d-9802-864a7639b4e4 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:08.699957 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-c979a06c-c8ae-480d-9802-864a7639b4e4 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] HTTP exception thrown: Instance 79881389-e6f0-43f3-96c3-fdb045bb956e could not be found. Sep 07 12:32:08.702674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c979a06c-c8ae-480d-9802-864a7639b4e4 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Request method failure captured: Sep 07 12:32:08.702674 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e HTTP/1.1 Sep 07 12:32:08.702674 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:32:08.702674 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:32:08.702674 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:32:08.702674 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:32:08.702674 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:32:08.702674 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:32:08.702674 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:32:08.702674 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:32:08.702674 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI5dJb1OTudr_44cyeTAHiYfk7VwKMo6rRo2qsVYfhcQZuSgxztk_8VwpZaEk4SWo1BL4sx_z3ZNyUqZIj8bhLkqxQVaJjUcXOR3WLGKotUVUnKFu0uvV2x2PIFcY74J-Hj3_WS1b27IDp9v8TDB3ny3VpEfKHfWVVu0ExsyK3DV3M8 Sep 07 12:32:08.702674 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:32:08.702674 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:32:08.702674 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:32:08.702674 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:32:08.702674 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:32:08.702674 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:32:08.702674 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: eeb96c3ce6734e5f94229d94bf379318 Sep 07 12:32:08.702674 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-52478584 Sep 07 12:32:08.702674 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:32:08.702674 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:32:08.704128 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:32:08.704128 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-52478584 Sep 07 12:32:08.704128 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: eeb96c3ce6734e5f94229d94bf379318 Sep 07 12:32:08.704128 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-52478584 Sep 07 12:32:08.704128 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersWithSpecificFlavorTestJSON-52478584-project Sep 07 12:32:08.704128 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:32:08.704128 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:32:08.704128 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 02af7f40e0cc4ab7bbc06201d5e253cd Sep 07 12:32:08.704128 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-52478584-project Sep 07 12:32:08.704128 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:32:08.704128 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 79881389-e6f0-43f3-96c3-fdb045bb956e could not be found. Sep 07 12:32:08.704128 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '79881389-e6f0-43f3-96c3-fdb045bb956e'} Sep 07 12:32:08.704912 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:32:08.704912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:32:08.704912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:32:08.704912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:32:08.704912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:32:08.704912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:32:08.704912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:32:08.704912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:32:08.704912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:32:08.704912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:32:08.704912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79881389-e6f0-43f3-96c3-fdb045bb956e could not be found. Sep 07 12:32:08.704912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:32:08.704912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:32:08.704912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:32:08.704912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:32:08.704912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:32:08.704912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:32:08.704912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:32:08.704912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:32:08.704912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:32:08.706358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:32:08.706358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:32:08.706358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:32:08.706358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:32:08.706358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:32:08.706358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:32:08.706358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:32:08.706358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:32:08.706358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:32:08.706358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79881389-e6f0-43f3-96c3-fdb045bb956e could not be found. Sep 07 12:32:08.706358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:32:08.706358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:32:08.706358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:32:08.706358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:32:08.706358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:32:08.706358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:32:08.706358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:32:08.706358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:32:08.706358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79881389-e6f0-43f3-96c3-fdb045bb956e could not be found. Sep 07 12:32:08.706358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:32:08.708315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c979a06c-c8ae-480d-9802-864a7639b4e4 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Returning 404 to user: Instance 79881389-e6f0-43f3-96c3-fdb045bb956e could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:32:08.708315 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c979a06c-c8ae-480d-9802-864a7639b4e4 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "DELETE /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e" status: 404 len: 111 microversion: 2.1 time: 0.086290 Sep 07 12:32:08.717523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3659f65d-46f3-4050-bf52-5c90a9d24bb6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:08.719663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3659f65d-46f3-4050-bf52-5c90a9d24bb6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 79881389-e6f0-43f3-96c3-fdb045bb956e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:08.720995 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 476/957] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:32:08 2022] DELETE /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:32:08.754140 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3659f65d-46f3-4050-bf52-5c90a9d24bb6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:08.754717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3659f65d-46f3-4050-bf52-5c90a9d24bb6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:08.755336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3659f65d-46f3-4050-bf52-5c90a9d24bb6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:08.756216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3659f65d-46f3-4050-bf52-5c90a9d24bb6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:08.756850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3659f65d-46f3-4050-bf52-5c90a9d24bb6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:08.759424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3659f65d-46f3-4050-bf52-5c90a9d24bb6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:08.794616 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-3659f65d-46f3-4050-bf52-5c90a9d24bb6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] HTTP exception thrown: Instance 79881389-e6f0-43f3-96c3-fdb045bb956e could not be found. Sep 07 12:32:08.796218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3659f65d-46f3-4050-bf52-5c90a9d24bb6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Request method failure captured: Sep 07 12:32:08.796218 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e HTTP/1.1 Sep 07 12:32:08.796218 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:32:08.796218 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:32:08.796218 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:32:08.796218 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:32:08.796218 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:32:08.796218 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:32:08.796218 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:32:08.796218 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:32:08.796218 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5dJb1OTudr_44cyeTAHiYfk7VwKMo6rRo2qsVYfhcQZuSgxztk_8VwpZaEk4SWo1BL4sx_z3ZNyUqZIj8bhLkqxQVaJjUcXOR3WLGKotUVUnKFu0uvV2x2PIFcY74J-Hj3_WS1b27IDp9v8TDB3ny3VpEfKHfWVVu0ExsyK3DV3M8 Sep 07 12:32:08.796218 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:32:08.796218 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:32:08.796218 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:32:08.796218 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:32:08.796218 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:32:08.796218 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:32:08.796218 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: eeb96c3ce6734e5f94229d94bf379318 Sep 07 12:32:08.796218 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-52478584 Sep 07 12:32:08.796218 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:32:08.796218 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:32:08.797639 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:32:08.797639 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-52478584 Sep 07 12:32:08.797639 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: eeb96c3ce6734e5f94229d94bf379318 Sep 07 12:32:08.797639 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-52478584 Sep 07 12:32:08.797639 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersWithSpecificFlavorTestJSON-52478584-project Sep 07 12:32:08.797639 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:32:08.797639 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:32:08.797639 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 02af7f40e0cc4ab7bbc06201d5e253cd Sep 07 12:32:08.797639 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-52478584-project Sep 07 12:32:08.797639 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:32:08.797639 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 79881389-e6f0-43f3-96c3-fdb045bb956e could not be found. Sep 07 12:32:08.797639 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '79881389-e6f0-43f3-96c3-fdb045bb956e'} Sep 07 12:32:08.798435 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:32:08.798435 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:32:08.798435 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:32:08.798435 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:32:08.798435 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:32:08.798435 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:32:08.798435 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:32:08.798435 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:32:08.798435 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:32:08.798435 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:32:08.798435 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79881389-e6f0-43f3-96c3-fdb045bb956e could not be found. Sep 07 12:32:08.798435 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:32:08.798435 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:32:08.798435 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:32:08.798435 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:32:08.798435 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:32:08.798435 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:32:08.798435 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:32:08.798435 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:32:08.798435 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:32:08.799837 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:32:08.799837 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:32:08.799837 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:32:08.799837 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:32:08.799837 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:32:08.799837 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:32:08.799837 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:32:08.799837 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79881389-e6f0-43f3-96c3-fdb045bb956e could not be found. Sep 07 12:32:08.799837 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:32:08.799837 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:32:08.799837 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:32:08.799837 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:32:08.799837 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:32:08.799837 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:32:08.799837 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:32:08.799837 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:32:08.799837 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79881389-e6f0-43f3-96c3-fdb045bb956e could not be found. Sep 07 12:32:08.799837 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:32:08.800871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3659f65d-46f3-4050-bf52-5c90a9d24bb6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Returning 404 to user: Instance 79881389-e6f0-43f3-96c3-fdb045bb956e could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:32:08.808222 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3659f65d-46f3-4050-bf52-5c90a9d24bb6 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e" status: 404 len: 111 microversion: 2.1 time: 0.085175 Sep 07 12:32:08.821039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-08ede372-9660-4d10-8eaf-7c8637672e5f tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '.version_select at 0x7fc419795310>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:08.825582 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 482/958] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:08 2022] GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:32:08.842935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d6948000-8907-4a7a-802b-4b60ee9b3fb0 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:08.844050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d6948000-8907-4a7a-802b-4b60ee9b3fb0 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:08.861213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6948000-8907-4a7a-802b-4b60ee9b3fb0 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:08.863716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6948000-8907-4a7a-802b-4b60ee9b3fb0 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:08.865101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6948000-8907-4a7a-802b-4b60ee9b3fb0 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:08.866646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6948000-8907-4a7a-802b-4b60ee9b3fb0 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:08.867520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6948000-8907-4a7a-802b-4b60ee9b3fb0 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:08.868139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6948000-8907-4a7a-802b-4b60ee9b3fb0 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:09.131356 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-08ede372-9660-4d10-8eaf-7c8637672e5f tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-953815892" status: 202 len: 0 microversion: 2.1 time: 0.314090 Sep 07 12:32:09.161777 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 477/959] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Sep 7 12:32:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-953815892 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:32:09.185696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c31b08b3-8d7d-418c-9ccc-cfdf1c427212 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:09.188415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c31b08b3-8d7d-418c-9ccc-cfdf1c427212 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:09.194589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d6948000-8907-4a7a-802b-4b60ee9b3fb0 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:09.231831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d6948000-8907-4a7a-802b-4b60ee9b3fb0 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:09.246919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c31b08b3-8d7d-418c-9ccc-cfdf1c427212 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:09.251358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d6948000-8907-4a7a-802b-4b60ee9b3fb0 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:09.253063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c31b08b3-8d7d-418c-9ccc-cfdf1c427212 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:09.255956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c31b08b3-8d7d-418c-9ccc-cfdf1c427212 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:09.258841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c31b08b3-8d7d-418c-9ccc-cfdf1c427212 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:09.265318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c31b08b3-8d7d-418c-9ccc-cfdf1c427212 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:09.266561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c31b08b3-8d7d-418c-9ccc-cfdf1c427212 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:09.272471 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d6948000-8907-4a7a-802b-4b60ee9b3fb0 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1553 microversion: 2.91 time: 0.434674 Sep 07 12:32:09.290475 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 483/960] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:08 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1553 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:32:09.313686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-250603a6-13b2-41a5-a471-3b08f1e84da5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:09.317578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-250603a6-13b2-41a5-a471-3b08f1e84da5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b65cf6c-5a50-4c86-9255-c7d712522cfe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:09.342359 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:32:09.344058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-250603a6-13b2-41a5-a471-3b08f1e84da5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:09.362101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-250603a6-13b2-41a5-a471-3b08f1e84da5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:09.366780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-250603a6-13b2-41a5-a471-3b08f1e84da5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:09.367681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-250603a6-13b2-41a5-a471-3b08f1e84da5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:09.368192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-250603a6-13b2-41a5-a471-3b08f1e84da5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:09.368656 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-250603a6-13b2-41a5-a471-3b08f1e84da5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:09.782716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c31b08b3-8d7d-418c-9ccc-cfdf1c427212 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:09.803375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c31b08b3-8d7d-418c-9ccc-cfdf1c427212 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:09.824220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c31b08b3-8d7d-418c-9ccc-cfdf1c427212 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:09.831762 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c31b08b3-8d7d-418c-9ccc-cfdf1c427212 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1566 microversion: 2.25 time: 0.660147 Sep 07 12:32:09.832455 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 478/961] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:09 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1566 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:09.854284 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-77d79dfc-c523-4827-a129-5c7852749b17 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:09.867336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-77d79dfc-c523-4827-a129-5c7852749b17 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:09.888110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77d79dfc-c523-4827-a129-5c7852749b17 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:09.904672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77d79dfc-c523-4827-a129-5c7852749b17 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:09.905523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77d79dfc-c523-4827-a129-5c7852749b17 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:09.906653 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77d79dfc-c523-4827-a129-5c7852749b17 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:09.907382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77d79dfc-c523-4827-a129-5c7852749b17 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:09.908233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77d79dfc-c523-4827-a129-5c7852749b17 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:09.961756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-250603a6-13b2-41a5-a471-3b08f1e84da5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:09.987263 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-250603a6-13b2-41a5-a471-3b08f1e84da5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe" status: 200 len: 1313 microversion: 2.1 time: 0.694366 Sep 07 12:32:09.993715 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 484/962] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:09 2022] GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe => generated 1313 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:10.266921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-77d79dfc-c523-4827-a129-5c7852749b17 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:10.279294 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-77d79dfc-c523-4827-a129-5c7852749b17 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1543 microversion: 2.1 time: 0.445707 Sep 07 12:32:10.281947 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 479/963] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:09 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1543 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:10.311504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e420fa5d-945d-4417-9cd9-65d0662ed95d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:10.319348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e420fa5d-945d-4417-9cd9-65d0662ed95d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:10.350149 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e420fa5d-945d-4417-9cd9-65d0662ed95d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:10.354766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e420fa5d-945d-4417-9cd9-65d0662ed95d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:10.362114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e420fa5d-945d-4417-9cd9-65d0662ed95d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:10.382594 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e420fa5d-945d-4417-9cd9-65d0662ed95d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:10.384111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e420fa5d-945d-4417-9cd9-65d0662ed95d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:10.385144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e420fa5d-945d-4417-9cd9-65d0662ed95d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:10.526948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e420fa5d-945d-4417-9cd9-65d0662ed95d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:10.536476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e420fa5d-945d-4417-9cd9-65d0662ed95d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:10.543084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e420fa5d-945d-4417-9cd9-65d0662ed95d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:10.561119 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e420fa5d-945d-4417-9cd9-65d0662ed95d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1553 microversion: 2.91 time: 0.257886 Sep 07 12:32:10.564777 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 485/964] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:10 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1553 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:10.730254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-05f2afcc-466a-42d7-92af-8d28632bf869 tempest-ServersWithSpecificFlavorTestJSON-1085658637 tempest-ServersWithSpecificFlavorTestJSON-1085658637-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:10.787674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:32:10.804668 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-05f2afcc-466a-42d7-92af-8d28632bf869 tempest-ServersWithSpecificFlavorTestJSON-1085658637 tempest-ServersWithSpecificFlavorTestJSON-1085658637-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/426701502" status: 202 len: 0 microversion: 2.1 time: 0.081230 Sep 07 12:32:10.808871 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 480/965] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Sep 7 12:32:10 2022] DELETE /compute/v2.1/flavors/426701502 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:32:10.848917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b6921bee-4f32-4619-b0ae-7df366a7285e tempest-ServersWithSpecificFlavorTestJSON-1085658637 tempest-ServersWithSpecificFlavorTestJSON-1085658637-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:10.904683 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-39c15563-65a8-43e6-b5b6-75835d6bfa61 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:10.918542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-39c15563-65a8-43e6-b5b6-75835d6bfa61 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:10.918726 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b6921bee-4f32-4619-b0ae-7df366a7285e tempest-ServersWithSpecificFlavorTestJSON-1085658637 tempest-ServersWithSpecificFlavorTestJSON-1085658637-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.096913 Sep 07 12:32:10.918726 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 486/966] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:32:10 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:10.925287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39c15563-65a8-43e6-b5b6-75835d6bfa61 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:10.926611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39c15563-65a8-43e6-b5b6-75835d6bfa61 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:10.927379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39c15563-65a8-43e6-b5b6-75835d6bfa61 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:10.928343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39c15563-65a8-43e6-b5b6-75835d6bfa61 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:10.929096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39c15563-65a8-43e6-b5b6-75835d6bfa61 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:10.929771 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39c15563-65a8-43e6-b5b6-75835d6bfa61 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:10.940365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-beb7e1f1-7b2d-45ce-99c0-4f1c8af66e87 tempest-ServersWithSpecificFlavorTestJSON-1085658637 tempest-ServersWithSpecificFlavorTestJSON-1085658637-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:10.968119 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-beb7e1f1-7b2d-45ce-99c0-4f1c8af66e87 tempest-ServersWithSpecificFlavorTestJSON-1085658637 tempest-ServersWithSpecificFlavorTestJSON-1085658637-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/615600471" status: 202 len: 0 microversion: 2.1 time: 0.033250 Sep 07 12:32:10.972912 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 487/967] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Sep 7 12:32:10 2022] DELETE /compute/v2.1/flavors/615600471 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:32:10.978344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4537c1fa-ac23-410f-a75f-febbe7b56fa5 tempest-ServersWithSpecificFlavorTestJSON-1085658637 tempest-ServersWithSpecificFlavorTestJSON-1085658637-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:11.002003 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4537c1fa-ac23-410f-a75f-febbe7b56fa5 tempest-ServersWithSpecificFlavorTestJSON-1085658637 tempest-ServersWithSpecificFlavorTestJSON-1085658637-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027219 Sep 07 12:32:11.017737 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 488/968] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:32:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:11.026196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eabc3c80-b01a-40a0-b387-b62562b5fb42 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:11.027034 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eabc3c80-b01a-40a0-b387-b62562b5fb42 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b65cf6c-5a50-4c86-9255-c7d712522cfe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:11.035553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eabc3c80-b01a-40a0-b387-b62562b5fb42 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:11.046204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eabc3c80-b01a-40a0-b387-b62562b5fb42 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:11.046935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eabc3c80-b01a-40a0-b387-b62562b5fb42 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:11.048129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eabc3c80-b01a-40a0-b387-b62562b5fb42 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:11.049689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eabc3c80-b01a-40a0-b387-b62562b5fb42 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:11.050477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eabc3c80-b01a-40a0-b387-b62562b5fb42 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:11.164076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-39c15563-65a8-43e6-b5b6-75835d6bfa61 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:11.177736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-39c15563-65a8-43e6-b5b6-75835d6bfa61 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:11.181350 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-39c15563-65a8-43e6-b5b6-75835d6bfa61 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:11.185963 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-39c15563-65a8-43e6-b5b6-75835d6bfa61 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1556 microversion: 2.25 time: 0.300031 Sep 07 12:32:11.189869 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 481/969] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:10 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1556 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:11.204307 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-62031568-42ee-46eb-9bfa-58a3d9e0e4f9 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:11.205502 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-62031568-42ee-46eb-9bfa-58a3d9e0e4f9 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 97552bf3-7814-403e-b66c-582b2f4f703f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:11.223016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62031568-42ee-46eb-9bfa-58a3d9e0e4f9 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:11.225347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62031568-42ee-46eb-9bfa-58a3d9e0e4f9 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:11.226840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62031568-42ee-46eb-9bfa-58a3d9e0e4f9 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:11.228565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62031568-42ee-46eb-9bfa-58a3d9e0e4f9 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:11.229914 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62031568-42ee-46eb-9bfa-58a3d9e0e4f9 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:11.232859 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62031568-42ee-46eb-9bfa-58a3d9e0e4f9 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:11.251281 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-62031568-42ee-46eb-9bfa-58a3d9e0e4f9 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] HTTP exception thrown: Instance 97552bf3-7814-403e-b66c-582b2f4f703f could not be found. Sep 07 12:32:11.262500 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-62031568-42ee-46eb-9bfa-58a3d9e0e4f9 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Request method failure captured: Sep 07 12:32:11.262500 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f HTTP/1.1 Sep 07 12:32:11.262500 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:32:11.262500 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:32:11.262500 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:32:11.262500 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:32:11.262500 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:32:11.262500 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:32:11.262500 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:32:11.262500 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:32:11.262500 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI5dJb1OTudr_44cyeTAHiYfk7VwKMo6rRo2qsVYfhcQZuSgxztk_8VwpZaEk4SWo1BL4sx_z3ZNyUqZIj8bhLkqxQVaJjUcXOR3WLGKotUVUnKFu0uvV2x2PIFcY74J-Hj3_WS1b27IDp9v8TDB3ny3VpEfKHfWVVu0ExsyK3DV3M8 Sep 07 12:32:11.262500 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:32:11.262500 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:32:11.262500 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:32:11.262500 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:32:11.262500 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:32:11.262500 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:32:11.262500 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: eeb96c3ce6734e5f94229d94bf379318 Sep 07 12:32:11.262500 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-52478584 Sep 07 12:32:11.262500 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:32:11.262500 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:32:11.264078 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:32:11.264078 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-52478584 Sep 07 12:32:11.264078 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: eeb96c3ce6734e5f94229d94bf379318 Sep 07 12:32:11.264078 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-52478584 Sep 07 12:32:11.264078 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersWithSpecificFlavorTestJSON-52478584-project Sep 07 12:32:11.264078 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:32:11.264078 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:32:11.264078 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 02af7f40e0cc4ab7bbc06201d5e253cd Sep 07 12:32:11.264078 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-52478584-project Sep 07 12:32:11.264078 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:32:11.264078 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 97552bf3-7814-403e-b66c-582b2f4f703f could not be found. Sep 07 12:32:11.264078 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '97552bf3-7814-403e-b66c-582b2f4f703f'} Sep 07 12:32:11.264811 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:32:11.264811 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:32:11.264811 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:32:11.264811 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:32:11.264811 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:32:11.264811 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:32:11.264811 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:32:11.264811 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:32:11.264811 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:32:11.264811 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:32:11.264811 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97552bf3-7814-403e-b66c-582b2f4f703f could not be found. Sep 07 12:32:11.264811 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:32:11.264811 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:32:11.264811 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:32:11.264811 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:32:11.264811 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:32:11.264811 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:32:11.264811 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:32:11.264811 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:32:11.264811 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:32:11.266013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:32:11.266013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:32:11.266013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:32:11.266013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:32:11.266013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:32:11.266013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:32:11.266013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:32:11.266013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:32:11.266013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:32:11.266013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97552bf3-7814-403e-b66c-582b2f4f703f could not be found. Sep 07 12:32:11.266013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:32:11.266013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:32:11.266013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:32:11.266013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:32:11.266013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:32:11.266013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:32:11.266013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:32:11.266013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:32:11.266013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97552bf3-7814-403e-b66c-582b2f4f703f could not be found. Sep 07 12:32:11.266013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:32:11.269036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-62031568-42ee-46eb-9bfa-58a3d9e0e4f9 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Returning 404 to user: Instance 97552bf3-7814-403e-b66c-582b2f4f703f could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:32:11.270309 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-62031568-42ee-46eb-9bfa-58a3d9e0e4f9 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "DELETE /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f" status: 404 len: 111 microversion: 2.1 time: 0.079113 Sep 07 12:32:11.271577 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 482/970] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:32:11 2022] DELETE /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:32:11.276807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ccff3bc-67e6-4abd-acaa-27352a7705f8 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Calling method '.version_select at 0x7fc419795f70>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:11.281079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ccff3bc-67e6-4abd-acaa-27352a7705f8 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:11.281941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ccff3bc-67e6-4abd-acaa-27352a7705f8 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:11.282634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ccff3bc-67e6-4abd-acaa-27352a7705f8 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:11.295015 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ccff3bc-67e6-4abd-acaa-27352a7705f8 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2786 microversion: 2.25 time: 0.021953 Sep 07 12:32:11.296330 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 483/971] 10.222.0.16 () {60 vars in 1184 bytes} [Wed Sep 7 12:32:11 2022] GET /compute/v2.1/os-migrations => generated 2786 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:11.301454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-69f837a2-694f-41ef-aa9d-b5a1f4371c27 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:11.302453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-69f837a2-694f-41ef-aa9d-b5a1f4371c27 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 97552bf3-7814-403e-b66c-582b2f4f703f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:11.309767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69f837a2-694f-41ef-aa9d-b5a1f4371c27 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:11.310630 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69f837a2-694f-41ef-aa9d-b5a1f4371c27 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:11.311295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69f837a2-694f-41ef-aa9d-b5a1f4371c27 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:11.312279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69f837a2-694f-41ef-aa9d-b5a1f4371c27 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:11.312996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69f837a2-694f-41ef-aa9d-b5a1f4371c27 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:11.313704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69f837a2-694f-41ef-aa9d-b5a1f4371c27 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:11.353150 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-69f837a2-694f-41ef-aa9d-b5a1f4371c27 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] HTTP exception thrown: Instance 97552bf3-7814-403e-b66c-582b2f4f703f could not be found. Sep 07 12:32:11.356219 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-69f837a2-694f-41ef-aa9d-b5a1f4371c27 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Request method failure captured: Sep 07 12:32:11.356219 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f HTTP/1.1 Sep 07 12:32:11.356219 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:32:11.356219 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:32:11.356219 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:32:11.356219 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:32:11.356219 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:32:11.356219 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:32:11.356219 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:32:11.356219 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:32:11.356219 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI5dJb1OTudr_44cyeTAHiYfk7VwKMo6rRo2qsVYfhcQZuSgxztk_8VwpZaEk4SWo1BL4sx_z3ZNyUqZIj8bhLkqxQVaJjUcXOR3WLGKotUVUnKFu0uvV2x2PIFcY74J-Hj3_WS1b27IDp9v8TDB3ny3VpEfKHfWVVu0ExsyK3DV3M8 Sep 07 12:32:11.356219 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:32:11.356219 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:32:11.356219 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:32:11.356219 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:32:11.356219 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:32:11.356219 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:32:11.356219 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: eeb96c3ce6734e5f94229d94bf379318 Sep 07 12:32:11.356219 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-52478584 Sep 07 12:32:11.356219 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:32:11.356219 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:32:11.357615 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:32:11.357615 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-52478584 Sep 07 12:32:11.357615 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: eeb96c3ce6734e5f94229d94bf379318 Sep 07 12:32:11.357615 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-52478584 Sep 07 12:32:11.357615 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersWithSpecificFlavorTestJSON-52478584-project Sep 07 12:32:11.357615 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:32:11.357615 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:32:11.357615 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 02af7f40e0cc4ab7bbc06201d5e253cd Sep 07 12:32:11.357615 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-52478584-project Sep 07 12:32:11.357615 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:32:11.357615 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 97552bf3-7814-403e-b66c-582b2f4f703f could not be found. Sep 07 12:32:11.357615 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '97552bf3-7814-403e-b66c-582b2f4f703f'} Sep 07 12:32:11.358367 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:32:11.358367 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:32:11.358367 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:32:11.358367 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:32:11.358367 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:32:11.358367 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:32:11.358367 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:32:11.358367 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:32:11.358367 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:32:11.358367 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:32:11.358367 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97552bf3-7814-403e-b66c-582b2f4f703f could not be found. Sep 07 12:32:11.358367 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:32:11.358367 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:32:11.358367 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:32:11.358367 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:32:11.358367 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:32:11.358367 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:32:11.358367 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:32:11.358367 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:32:11.358367 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:32:11.359553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:32:11.359553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:32:11.359553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:32:11.359553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:32:11.359553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:32:11.359553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:32:11.359553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:32:11.359553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97552bf3-7814-403e-b66c-582b2f4f703f could not be found. Sep 07 12:32:11.359553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:32:11.359553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:32:11.359553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:32:11.359553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:32:11.359553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:32:11.359553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:32:11.359553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:32:11.359553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:32:11.359553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97552bf3-7814-403e-b66c-582b2f4f703f could not be found. Sep 07 12:32:11.359553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:32:11.360619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-69f837a2-694f-41ef-aa9d-b5a1f4371c27 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Returning 404 to user: Instance 97552bf3-7814-403e-b66c-582b2f4f703f could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:32:11.360619 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-69f837a2-694f-41ef-aa9d-b5a1f4371c27 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f" status: 404 len: 111 microversion: 2.1 time: 0.060968 Sep 07 12:32:11.360619 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 484/972] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:11 2022] GET /compute/v2.1/servers/97552bf3-7814-403e-b66c-582b2f4f703f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:32:11.382414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3eb3ea22-b962-4542-8d6f-049c08b41865 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:11.383071 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3eb3ea22-b962-4542-8d6f-049c08b41865 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:11.395322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eabc3c80-b01a-40a0-b387-b62562b5fb42 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:11.406114 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eabc3c80-b01a-40a0-b387-b62562b5fb42 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe" status: 200 len: 1463 microversion: 2.1 time: 0.386607 Sep 07 12:32:11.406708 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 489/973] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:11 2022] GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe => generated 1463 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:11.408794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3eb3ea22-b962-4542-8d6f-049c08b41865 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:11.415106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3eb3ea22-b962-4542-8d6f-049c08b41865 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:11.417236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3eb3ea22-b962-4542-8d6f-049c08b41865 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:11.418214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3eb3ea22-b962-4542-8d6f-049c08b41865 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:11.422100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3ced2cca-7120-4c1a-a7e4-c88e1cb27b2b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:11.422939 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3eb3ea22-b962-4542-8d6f-049c08b41865 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:11.423773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3eb3ea22-b962-4542-8d6f-049c08b41865 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:11.429236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3ced2cca-7120-4c1a-a7e4-c88e1cb27b2b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:11.452752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ced2cca-7120-4c1a-a7e4-c88e1cb27b2b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:11.453610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ced2cca-7120-4c1a-a7e4-c88e1cb27b2b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:11.454206 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ced2cca-7120-4c1a-a7e4-c88e1cb27b2b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:11.455196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ced2cca-7120-4c1a-a7e4-c88e1cb27b2b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:11.455832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ced2cca-7120-4c1a-a7e4-c88e1cb27b2b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:11.456409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ced2cca-7120-4c1a-a7e4-c88e1cb27b2b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:11.764849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-3eb3ea22-b962-4542-8d6f-049c08b41865 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lazy-loading 'services' on Instance uuid a72bc8e2-53a9-4c43-83b1-c86bfef2e918 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:32:11.801929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3ced2cca-7120-4c1a-a7e4-c88e1cb27b2b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:11.816881 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3ced2cca-7120-4c1a-a7e4-c88e1cb27b2b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1543 microversion: 2.1 time: 0.406744 Sep 07 12:32:11.828668 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3eb3ea22-b962-4542-8d6f-049c08b41865 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 2048 microversion: 2.25 time: 0.453463 Sep 07 12:32:11.830766 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 490/974] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:11 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1543 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:11.832695 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 485/975] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:11 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 2048 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:11.850632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d35c06f8-8cf1-4af2-9486-381b92830e29 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:11.852214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-14186841-9f94-4d08-9093-8744e0bdab97 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:11.853137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d35c06f8-8cf1-4af2-9486-381b92830e29 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 79881389-e6f0-43f3-96c3-fdb045bb956e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:11.856993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-14186841-9f94-4d08-9093-8744e0bdab97 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:11.876678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d35c06f8-8cf1-4af2-9486-381b92830e29 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:11.878437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14186841-9f94-4d08-9093-8744e0bdab97 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:11.879249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d35c06f8-8cf1-4af2-9486-381b92830e29 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:11.880434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d35c06f8-8cf1-4af2-9486-381b92830e29 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:11.880807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14186841-9f94-4d08-9093-8744e0bdab97 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:11.882266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14186841-9f94-4d08-9093-8744e0bdab97 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:11.883411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14186841-9f94-4d08-9093-8744e0bdab97 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:11.884264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d35c06f8-8cf1-4af2-9486-381b92830e29 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:11.885027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d35c06f8-8cf1-4af2-9486-381b92830e29 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:11.885829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14186841-9f94-4d08-9093-8744e0bdab97 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:11.886544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d35c06f8-8cf1-4af2-9486-381b92830e29 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:11.887252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14186841-9f94-4d08-9093-8744e0bdab97 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:11.924145 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-d35c06f8-8cf1-4af2-9486-381b92830e29 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] HTTP exception thrown: Instance 79881389-e6f0-43f3-96c3-fdb045bb956e could not be found. Sep 07 12:32:11.926143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d35c06f8-8cf1-4af2-9486-381b92830e29 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Request method failure captured: Sep 07 12:32:11.926143 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e HTTP/1.1 Sep 07 12:32:11.926143 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:32:11.926143 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:32:11.926143 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:32:11.926143 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:32:11.926143 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:32:11.926143 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:32:11.926143 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:32:11.926143 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:32:11.926143 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5dJb1OTudr_44cyeTAHiYfk7VwKMo6rRo2qsVYfhcQZuSgxztk_8VwpZaEk4SWo1BL4sx_z3ZNyUqZIj8bhLkqxQVaJjUcXOR3WLGKotUVUnKFu0uvV2x2PIFcY74J-Hj3_WS1b27IDp9v8TDB3ny3VpEfKHfWVVu0ExsyK3DV3M8 Sep 07 12:32:11.926143 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:32:11.926143 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:32:11.926143 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:32:11.926143 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:32:11.926143 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:32:11.926143 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:32:11.926143 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: eeb96c3ce6734e5f94229d94bf379318 Sep 07 12:32:11.926143 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-52478584 Sep 07 12:32:11.926143 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:32:11.926143 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:32:11.927623 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:32:11.927623 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-52478584 Sep 07 12:32:11.927623 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: eeb96c3ce6734e5f94229d94bf379318 Sep 07 12:32:11.927623 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-52478584 Sep 07 12:32:11.927623 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersWithSpecificFlavorTestJSON-52478584-project Sep 07 12:32:11.927623 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:32:11.927623 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:32:11.927623 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 02af7f40e0cc4ab7bbc06201d5e253cd Sep 07 12:32:11.927623 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-52478584-project Sep 07 12:32:11.927623 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:32:11.927623 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 79881389-e6f0-43f3-96c3-fdb045bb956e could not be found. Sep 07 12:32:11.927623 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '79881389-e6f0-43f3-96c3-fdb045bb956e'} Sep 07 12:32:11.928801 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:32:11.928801 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:32:11.928801 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:32:11.928801 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:32:11.928801 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:32:11.928801 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:32:11.928801 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:32:11.928801 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:32:11.928801 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:32:11.928801 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:32:11.928801 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79881389-e6f0-43f3-96c3-fdb045bb956e could not be found. Sep 07 12:32:11.928801 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:32:11.928801 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:32:11.928801 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:32:11.928801 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:32:11.928801 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:32:11.928801 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:32:11.928801 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:32:11.928801 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:32:11.928801 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:32:11.930088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:32:11.930088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:32:11.930088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:32:11.930088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:32:11.930088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:32:11.930088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:32:11.930088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:32:11.930088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:32:11.930088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:32:11.930088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79881389-e6f0-43f3-96c3-fdb045bb956e could not be found. Sep 07 12:32:11.930088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:32:11.930088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:32:11.930088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:32:11.930088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:32:11.930088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:32:11.930088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:32:11.930088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:32:11.930088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:32:11.930088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79881389-e6f0-43f3-96c3-fdb045bb956e could not be found. Sep 07 12:32:11.930088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:32:11.937239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d35c06f8-8cf1-4af2-9486-381b92830e29 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Returning 404 to user: Instance 79881389-e6f0-43f3-96c3-fdb045bb956e could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:32:11.938279 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d35c06f8-8cf1-4af2-9486-381b92830e29 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "DELETE /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e" status: 404 len: 111 microversion: 2.1 time: 0.104499 Sep 07 12:32:11.943645 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 491/976] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:32:11 2022] DELETE /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:32:11.949069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-33324334-8a2e-4078-bfae-38fd495b7349 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:11.949713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-33324334-8a2e-4078-bfae-38fd495b7349 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:11.965333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33324334-8a2e-4078-bfae-38fd495b7349 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:11.968508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33324334-8a2e-4078-bfae-38fd495b7349 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:11.969200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33324334-8a2e-4078-bfae-38fd495b7349 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:11.969926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33324334-8a2e-4078-bfae-38fd495b7349 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:11.970492 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33324334-8a2e-4078-bfae-38fd495b7349 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:11.970948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33324334-8a2e-4078-bfae-38fd495b7349 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:12.147077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-33324334-8a2e-4078-bfae-38fd495b7349 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:12.161827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-33324334-8a2e-4078-bfae-38fd495b7349 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:12.164776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-33324334-8a2e-4078-bfae-38fd495b7349 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:12.173404 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-33324334-8a2e-4078-bfae-38fd495b7349 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1553 microversion: 2.91 time: 0.230789 Sep 07 12:32:12.175157 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 492/977] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:11 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1553 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:12.182289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5131f59f-b117-4289-8ab9-f07c9dbaba89 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:12.183384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5131f59f-b117-4289-8ab9-f07c9dbaba89 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] [instance: 79881389-e6f0-43f3-96c3-fdb045bb956e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:12.199178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5131f59f-b117-4289-8ab9-f07c9dbaba89 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:12.200128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5131f59f-b117-4289-8ab9-f07c9dbaba89 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:12.201709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5131f59f-b117-4289-8ab9-f07c9dbaba89 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:12.203146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5131f59f-b117-4289-8ab9-f07c9dbaba89 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:12.204073 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5131f59f-b117-4289-8ab9-f07c9dbaba89 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:12.205290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5131f59f-b117-4289-8ab9-f07c9dbaba89 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:12.224403 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-5131f59f-b117-4289-8ab9-f07c9dbaba89 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] HTTP exception thrown: Instance 79881389-e6f0-43f3-96c3-fdb045bb956e could not be found. Sep 07 12:32:12.226401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5131f59f-b117-4289-8ab9-f07c9dbaba89 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Request method failure captured: Sep 07 12:32:12.226401 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e HTTP/1.1 Sep 07 12:32:12.226401 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:32:12.226401 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:32:12.226401 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:32:12.226401 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:32:12.226401 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:32:12.226401 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:32:12.226401 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:32:12.226401 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:32:12.226401 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5dJb1OTudr_44cyeTAHiYfk7VwKMo6rRo2qsVYfhcQZuSgxztk_8VwpZaEk4SWo1BL4sx_z3ZNyUqZIj8bhLkqxQVaJjUcXOR3WLGKotUVUnKFu0uvV2x2PIFcY74J-Hj3_WS1b27IDp9v8TDB3ny3VpEfKHfWVVu0ExsyK3DV3M8 Sep 07 12:32:12.226401 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:32:12.226401 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:32:12.226401 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:32:12.226401 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:32:12.226401 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:32:12.226401 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:32:12.226401 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: eeb96c3ce6734e5f94229d94bf379318 Sep 07 12:32:12.226401 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-52478584 Sep 07 12:32:12.226401 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:32:12.226401 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:32:12.227720 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eeb96c3ce6734e5f94229d94bf379318"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:32:12.227720 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-52478584 Sep 07 12:32:12.227720 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: eeb96c3ce6734e5f94229d94bf379318 Sep 07 12:32:12.227720 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-52478584 Sep 07 12:32:12.227720 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersWithSpecificFlavorTestJSON-52478584-project Sep 07 12:32:12.227720 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:32:12.227720 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:32:12.227720 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 02af7f40e0cc4ab7bbc06201d5e253cd Sep 07 12:32:12.227720 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-52478584-project Sep 07 12:32:12.227720 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:32:12.227720 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 79881389-e6f0-43f3-96c3-fdb045bb956e could not be found. Sep 07 12:32:12.227720 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '79881389-e6f0-43f3-96c3-fdb045bb956e'} Sep 07 12:32:12.228425 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:32:12.228425 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:32:12.228425 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:32:12.228425 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:32:12.228425 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:32:12.228425 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:32:12.228425 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:32:12.228425 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:32:12.228425 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:32:12.228425 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:32:12.228425 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79881389-e6f0-43f3-96c3-fdb045bb956e could not be found. Sep 07 12:32:12.228425 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:32:12.228425 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:32:12.228425 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:32:12.228425 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:32:12.228425 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:32:12.228425 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:32:12.228425 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:32:12.228425 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:32:12.228425 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:32:12.230379 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:32:12.230379 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:32:12.230379 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:32:12.230379 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:32:12.230379 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:32:12.230379 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:32:12.230379 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:32:12.230379 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79881389-e6f0-43f3-96c3-fdb045bb956e could not be found. Sep 07 12:32:12.230379 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:32:12.230379 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:32:12.230379 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:32:12.230379 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:32:12.230379 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:32:12.230379 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:32:12.230379 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:32:12.230379 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:32:12.230379 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79881389-e6f0-43f3-96c3-fdb045bb956e could not be found. Sep 07 12:32:12.230379 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:32:12.233347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5131f59f-b117-4289-8ab9-f07c9dbaba89 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] Returning 404 to user: Instance 79881389-e6f0-43f3-96c3-fdb045bb956e could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:32:12.234701 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5131f59f-b117-4289-8ab9-f07c9dbaba89 tempest-ServersWithSpecificFlavorTestJSON-52478584 tempest-ServersWithSpecificFlavorTestJSON-52478584-project] 10.222.0.16 "GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e" status: 404 len: 111 microversion: 2.1 time: 0.058069 Sep 07 12:32:12.236105 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 493/978] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:12 2022] GET /compute/v2.1/servers/79881389-e6f0-43f3-96c3-fdb045bb956e => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:32:12.243207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d4653c84-ae07-4b47-8c0d-471a963bff50 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1877906708", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "782fe665-49dc-454e-a75e-cbb471a251fc"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:12.340781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-14186841-9f94-4d08-9093-8744e0bdab97 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:12.350340 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-d4653c84-ae07-4b47-8c0d-471a963bff50 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] validate_networks() for [('782fe665-49dc-454e-a75e-cbb471a251fc', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:32:12.371874 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-14186841-9f94-4d08-9093-8744e0bdab97 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1463 microversion: 2.1 time: 0.536025 Sep 07 12:32:12.378797 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 486/979] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:11 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1463 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:12.457362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-054bc7e4-083a-4f94-9f18-7a8c39dd819e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1345186854", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "7b849d7d-db03-43d3-b94c-3808ea7ae0cb"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:12.622844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-054bc7e4-083a-4f94-9f18-7a8c39dd819e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:32:13.236824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-054bc7e4-083a-4f94-9f18-7a8c39dd819e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:32:13.237976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-054bc7e4-083a-4f94-9f18-7a8c39dd819e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:32:13.238347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-054bc7e4-083a-4f94-9f18-7a8c39dd819e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:32:13.239057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-054bc7e4-083a-4f94-9f18-7a8c39dd819e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:32:13.239624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-054bc7e4-083a-4f94-9f18-7a8c39dd819e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:32:13.311077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-054bc7e4-083a-4f94-9f18-7a8c39dd819e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:13.311936 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-054bc7e4-083a-4f94-9f18-7a8c39dd819e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:13.312771 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-054bc7e4-083a-4f94-9f18-7a8c39dd819e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:13.314337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-054bc7e4-083a-4f94-9f18-7a8c39dd819e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:13.315169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-054bc7e4-083a-4f94-9f18-7a8c39dd819e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:13.315940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-054bc7e4-083a-4f94-9f18-7a8c39dd819e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:13.378287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-054bc7e4-083a-4f94-9f18-7a8c39dd819e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Getting quotas for project 7d8dd874b3674087a3e969424a561530. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:32:13.385072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-054bc7e4-083a-4f94-9f18-7a8c39dd819e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Getting quotas for user 50d97d3b953f4690b54fde1a4da81cd4 and project 7d8dd874b3674087a3e969424a561530. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:32:13.400587 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-054bc7e4-083a-4f94-9f18-7a8c39dd819e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:32:13.403625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-054bc7e4-083a-4f94-9f18-7a8c39dd819e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:32:13.477292 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-054bc7e4-083a-4f94-9f18-7a8c39dd819e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.026150 Sep 07 12:32:13.481051 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 487/980] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:32:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:32:13.489173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8d4e7e0a-2d31-4cac-86d8-c0198e98068a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:13.492535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8d4e7e0a-2d31-4cac-86d8-c0198e98068a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:13.511910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d4e7e0a-2d31-4cac-86d8-c0198e98068a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:13.512734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d4e7e0a-2d31-4cac-86d8-c0198e98068a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:13.513430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d4e7e0a-2d31-4cac-86d8-c0198e98068a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:13.514633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d4e7e0a-2d31-4cac-86d8-c0198e98068a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:13.515631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d4e7e0a-2d31-4cac-86d8-c0198e98068a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:13.516559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d4e7e0a-2d31-4cac-86d8-c0198e98068a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:13.934443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8d4e7e0a-2d31-4cac-86d8-c0198e98068a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:13.947789 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8d4e7e0a-2d31-4cac-86d8-c0198e98068a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1543 microversion: 2.1 time: 0.464503 Sep 07 12:32:13.961961 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 488/981] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:13 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1543 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:13.969616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d4653c84-ae07-4b47-8c0d-471a963bff50 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:32:13.970213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c7031062-f556-48ca-b0a8-9c470bdcb13d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:13.970376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d4653c84-ae07-4b47-8c0d-471a963bff50 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:32:13.971013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c7031062-f556-48ca-b0a8-9c470bdcb13d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:13.973457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d4653c84-ae07-4b47-8c0d-471a963bff50 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:32:13.974161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d4653c84-ae07-4b47-8c0d-471a963bff50 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:32:13.974966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d4653c84-ae07-4b47-8c0d-471a963bff50 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:32:13.982862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7031062-f556-48ca-b0a8-9c470bdcb13d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:13.983374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7031062-f556-48ca-b0a8-9c470bdcb13d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:13.987835 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7031062-f556-48ca-b0a8-9c470bdcb13d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:13.988938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7031062-f556-48ca-b0a8-9c470bdcb13d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:13.993052 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7031062-f556-48ca-b0a8-9c470bdcb13d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:13.996056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7031062-f556-48ca-b0a8-9c470bdcb13d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:14.010311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4653c84-ae07-4b47-8c0d-471a963bff50 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:14.011574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4653c84-ae07-4b47-8c0d-471a963bff50 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:14.013513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4653c84-ae07-4b47-8c0d-471a963bff50 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:14.017334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4653c84-ae07-4b47-8c0d-471a963bff50 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:14.018260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4653c84-ae07-4b47-8c0d-471a963bff50 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:14.019195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4653c84-ae07-4b47-8c0d-471a963bff50 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:14.041176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-d4653c84-ae07-4b47-8c0d-471a963bff50 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Getting quotas for project 6d7695bab2d84b35bf92bd035da71dc3. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:32:14.048760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-d4653c84-ae07-4b47-8c0d-471a963bff50 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Getting quotas for user cf3ae3d912b84a8f906b31874668b740 and project 6d7695bab2d84b35bf92bd035da71dc3. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:32:14.073533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d4653c84-ae07-4b47-8c0d-471a963bff50 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:32:14.077267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d4653c84-ae07-4b47-8c0d-471a963bff50 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:32:14.133955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c7031062-f556-48ca-b0a8-9c470bdcb13d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:14.149359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c7031062-f556-48ca-b0a8-9c470bdcb13d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:14.151886 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d4653c84-ae07-4b47-8c0d-471a963bff50 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.914255 Sep 07 12:32:14.152727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c7031062-f556-48ca-b0a8-9c470bdcb13d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:14.153404 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 494/982] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Sep 7 12:32:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1916 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 12:32:14.158566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f881b271-f6bd-4218-861b-1b73f4995e5e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:14.159487 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f881b271-f6bd-4218-861b-1b73f4995e5e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:14.170509 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c7031062-f556-48ca-b0a8-9c470bdcb13d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1535 microversion: 2.91 time: 0.206136 Sep 07 12:32:14.174092 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 489/983] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:13 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1535 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:14.186224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-82b027f1-2d71-467f-8ca6-adf7b381d9ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:14.187032 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-82b027f1-2d71-467f-8ca6-adf7b381d9ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:14.267029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f881b271-f6bd-4218-861b-1b73f4995e5e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:14.275431 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f881b271-f6bd-4218-861b-1b73f4995e5e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1214 microversion: 2.1 time: 0.120579 Sep 07 12:32:14.282587 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 495/984] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:14 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1214 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:14.352669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-82b027f1-2d71-467f-8ca6-adf7b381d9ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:14.365747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-82b027f1-2d71-467f-8ca6-adf7b381d9ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:14.369603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-82b027f1-2d71-467f-8ca6-adf7b381d9ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:14.377570 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-82b027f1-2d71-467f-8ca6-adf7b381d9ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1262 microversion: 2.25 time: 0.196551 Sep 07 12:32:14.378668 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 490/985] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:14 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1262 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:14.978680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3fdbe2fe-47e6-4fb1-bdd8-e207f74cdf64 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:14.979826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3fdbe2fe-47e6-4fb1-bdd8-e207f74cdf64 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:15.005156 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fdbe2fe-47e6-4fb1-bdd8-e207f74cdf64 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:15.007735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fdbe2fe-47e6-4fb1-bdd8-e207f74cdf64 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:15.008756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fdbe2fe-47e6-4fb1-bdd8-e207f74cdf64 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:15.010445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fdbe2fe-47e6-4fb1-bdd8-e207f74cdf64 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:15.011142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fdbe2fe-47e6-4fb1-bdd8-e207f74cdf64 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:15.012153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fdbe2fe-47e6-4fb1-bdd8-e207f74cdf64 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:15.209878 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3185e761-5995-44c8-9b06-3586349ebc2a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:15.210549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3185e761-5995-44c8-9b06-3586349ebc2a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:15.232755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3185e761-5995-44c8-9b06-3586349ebc2a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:15.235101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3185e761-5995-44c8-9b06-3586349ebc2a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:15.235875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3185e761-5995-44c8-9b06-3586349ebc2a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:15.238712 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3185e761-5995-44c8-9b06-3586349ebc2a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:15.239627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3185e761-5995-44c8-9b06-3586349ebc2a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:15.241383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3185e761-5995-44c8-9b06-3586349ebc2a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:15.377730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3185e761-5995-44c8-9b06-3586349ebc2a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:15.389863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3185e761-5995-44c8-9b06-3586349ebc2a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:15.399651 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3185e761-5995-44c8-9b06-3586349ebc2a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:15.452043 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3185e761-5995-44c8-9b06-3586349ebc2a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1535 microversion: 2.91 time: 0.241305 Sep 07 12:32:15.458305 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 491/986] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:15 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1535 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:15.458598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3fdbe2fe-47e6-4fb1-bdd8-e207f74cdf64 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:15.465918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-270c1756-651f-49ba-b623-b0eb82d937cf tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:15.473469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-270c1756-651f-49ba-b623-b0eb82d937cf tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:15.487733 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-270c1756-651f-49ba-b623-b0eb82d937cf tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:15.490201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-270c1756-651f-49ba-b623-b0eb82d937cf tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:15.493852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-270c1756-651f-49ba-b623-b0eb82d937cf tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:15.494947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-270c1756-651f-49ba-b623-b0eb82d937cf tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:15.495799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-270c1756-651f-49ba-b623-b0eb82d937cf tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:15.500190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-270c1756-651f-49ba-b623-b0eb82d937cf tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:15.511024 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3fdbe2fe-47e6-4fb1-bdd8-e207f74cdf64 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1543 microversion: 2.1 time: 0.540917 Sep 07 12:32:15.513134 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 496/987] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:14 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1543 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:15.534661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ef8a4bfd-215f-4547-b863-9e899326f1c5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:15.536042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ef8a4bfd-215f-4547-b863-9e899326f1c5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:15.561209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef8a4bfd-215f-4547-b863-9e899326f1c5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:15.562076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef8a4bfd-215f-4547-b863-9e899326f1c5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:15.562847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef8a4bfd-215f-4547-b863-9e899326f1c5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:15.563876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef8a4bfd-215f-4547-b863-9e899326f1c5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:15.564713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef8a4bfd-215f-4547-b863-9e899326f1c5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:15.565428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef8a4bfd-215f-4547-b863-9e899326f1c5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:15.641545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-270c1756-651f-49ba-b623-b0eb82d937cf tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:15.661844 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-270c1756-651f-49ba-b623-b0eb82d937cf tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1218 microversion: 2.1 time: 0.200026 Sep 07 12:32:15.662447 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 492/988] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:15 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1218 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:15.758470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ef8a4bfd-215f-4547-b863-9e899326f1c5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:15.770598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ef8a4bfd-215f-4547-b863-9e899326f1c5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:15.775091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ef8a4bfd-215f-4547-b863-9e899326f1c5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:15.776456 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ef8a4bfd-215f-4547-b863-9e899326f1c5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1314 microversion: 2.25 time: 0.261306 Sep 07 12:32:15.777297 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 497/989] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:15 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:16.470355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dcd4ac8f-c5d6-4fa5-96ac-484d84c922e5 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Action: 'create', calling method: .version_select at 0x7fc41930c670>, body: {"keypair": {"name": "tempest-keypair-1989835296", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB2aK62FGiE1QMmAtoHI1NUG5ovijdfudqLGnomVXmefZnah93F6bx7BIQ0N7onJevK6ZfVyEoDVYNrku2fmEtPhVR5zWEVlzgBHS0g6oGMn8puKqzunT0TXfeXGk0y3g=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:16.490008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad772247-aead-4518-9df3-533fc2cc06cf tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:16.490854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ad772247-aead-4518-9df3-533fc2cc06cf tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:16.500642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-dcd4ac8f-c5d6-4fa5-96ac-484d84c922e5 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Getting quotas for project 16b6f7d9efc940449d014d41cf2f18c2. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:32:16.508340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-dcd4ac8f-c5d6-4fa5-96ac-484d84c922e5 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Getting quotas for user 0c7ad5e634ea41e3aed6caa5652e784e and project 16b6f7d9efc940449d014d41cf2f18c2. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:32:16.520229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad772247-aead-4518-9df3-533fc2cc06cf tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:16.521474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad772247-aead-4518-9df3-533fc2cc06cf tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:16.523026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad772247-aead-4518-9df3-533fc2cc06cf tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:16.524655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad772247-aead-4518-9df3-533fc2cc06cf tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:16.526873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad772247-aead-4518-9df3-533fc2cc06cf tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:16.527821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad772247-aead-4518-9df3-533fc2cc06cf tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:16.539852 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dcd4ac8f-c5d6-4fa5-96ac-484d84c922e5 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.275846 Sep 07 12:32:16.541869 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 493/990] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 12:32:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:16.567218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ffa13bf8-939e-4c2c-a161-688a813e4703 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:16.568390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ffa13bf8-939e-4c2c-a161-688a813e4703 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:16.598694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffa13bf8-939e-4c2c-a161-688a813e4703 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:16.599521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffa13bf8-939e-4c2c-a161-688a813e4703 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:16.600356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffa13bf8-939e-4c2c-a161-688a813e4703 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:16.601474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffa13bf8-939e-4c2c-a161-688a813e4703 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:16.605262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffa13bf8-939e-4c2c-a161-688a813e4703 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:16.605869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffa13bf8-939e-4c2c-a161-688a813e4703 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:16.691806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ad772247-aead-4518-9df3-533fc2cc06cf tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:16.708003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ad772247-aead-4518-9df3-533fc2cc06cf tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:16.709592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ad772247-aead-4518-9df3-533fc2cc06cf tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:16.715964 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ad772247-aead-4518-9df3-533fc2cc06cf tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1535 microversion: 2.91 time: 0.231082 Sep 07 12:32:16.716628 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 498/991] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:16 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1535 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:16.728888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cc9d121e-2374-41d4-a6b1-36e20322c98a tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:16.729924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cc9d121e-2374-41d4-a6b1-36e20322c98a tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:16.739641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc9d121e-2374-41d4-a6b1-36e20322c98a tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:16.740324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc9d121e-2374-41d4-a6b1-36e20322c98a tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:16.740873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc9d121e-2374-41d4-a6b1-36e20322c98a tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:16.741986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc9d121e-2374-41d4-a6b1-36e20322c98a tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:16.742491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc9d121e-2374-41d4-a6b1-36e20322c98a tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:16.743748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc9d121e-2374-41d4-a6b1-36e20322c98a tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:16.953388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cc9d121e-2374-41d4-a6b1-36e20322c98a tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:16.987734 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cc9d121e-2374-41d4-a6b1-36e20322c98a tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1266 microversion: 2.1 time: 0.269258 Sep 07 12:32:16.989189 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 499/992] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:16 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:17.001299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f865572b-7926-46c4-a99f-1b4aba6497b5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:17.002023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f865572b-7926-46c4-a99f-1b4aba6497b5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:17.018458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ffa13bf8-939e-4c2c-a161-688a813e4703 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:17.019195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f865572b-7926-46c4-a99f-1b4aba6497b5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:17.020044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f865572b-7926-46c4-a99f-1b4aba6497b5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:17.020667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f865572b-7926-46c4-a99f-1b4aba6497b5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:17.021395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f865572b-7926-46c4-a99f-1b4aba6497b5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:17.021894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f865572b-7926-46c4-a99f-1b4aba6497b5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:17.022327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f865572b-7926-46c4-a99f-1b4aba6497b5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:17.038325 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ffa13bf8-939e-4c2c-a161-688a813e4703 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1543 microversion: 2.1 time: 0.479388 Sep 07 12:32:17.038936 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 494/993] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:16 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1543 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:17.135684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f865572b-7926-46c4-a99f-1b4aba6497b5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:17.145879 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f865572b-7926-46c4-a99f-1b4aba6497b5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:17.147355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f865572b-7926-46c4-a99f-1b4aba6497b5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:17.148627 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f865572b-7926-46c4-a99f-1b4aba6497b5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1320 microversion: 2.25 time: 0.158133 Sep 07 12:32:17.149528 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 500/994] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:16 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1320 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:17.792431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5df05a35-6535-467e-8ecd-4104495e24cb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:17.799356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5df05a35-6535-467e-8ecd-4104495e24cb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:17.841630 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5df05a35-6535-467e-8ecd-4104495e24cb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:17.842468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5df05a35-6535-467e-8ecd-4104495e24cb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:17.843283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5df05a35-6535-467e-8ecd-4104495e24cb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:17.844591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5df05a35-6535-467e-8ecd-4104495e24cb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:17.853679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5df05a35-6535-467e-8ecd-4104495e24cb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:17.855918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5df05a35-6535-467e-8ecd-4104495e24cb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:18.053289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-67bb9b80-3580-4ed2-9c7c-75f46b96adb8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:18.054264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-67bb9b80-3580-4ed2-9c7c-75f46b96adb8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:18.077950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67bb9b80-3580-4ed2-9c7c-75f46b96adb8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:18.078735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67bb9b80-3580-4ed2-9c7c-75f46b96adb8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:18.079604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67bb9b80-3580-4ed2-9c7c-75f46b96adb8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:18.083302 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67bb9b80-3580-4ed2-9c7c-75f46b96adb8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:18.085168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67bb9b80-3580-4ed2-9c7c-75f46b96adb8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:18.086908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67bb9b80-3580-4ed2-9c7c-75f46b96adb8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:18.697271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5df05a35-6535-467e-8ecd-4104495e24cb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:18.714334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5df05a35-6535-467e-8ecd-4104495e24cb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:18.717613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5df05a35-6535-467e-8ecd-4104495e24cb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:18.727637 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5df05a35-6535-467e-8ecd-4104495e24cb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1538 microversion: 2.91 time: 0.980803 Sep 07 12:32:18.741676 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 495/995] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:17 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1538 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:18.741676 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-73b2ff4a-5d59-4334-9675-12309e874b62 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:18.742517 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-73b2ff4a-5d59-4334-9675-12309e874b62 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:18.744982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-67bb9b80-3580-4ed2-9c7c-75f46b96adb8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:18.748787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:32:18.760023 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-67bb9b80-3580-4ed2-9c7c-75f46b96adb8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1266 microversion: 2.1 time: 0.723433 Sep 07 12:32:18.760296 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73b2ff4a-5d59-4334-9675-12309e874b62 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:18.760814 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 501/996] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:18 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1266 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:18.762038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73b2ff4a-5d59-4334-9675-12309e874b62 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:18.762793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73b2ff4a-5d59-4334-9675-12309e874b62 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:18.763800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73b2ff4a-5d59-4334-9675-12309e874b62 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:18.764685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73b2ff4a-5d59-4334-9675-12309e874b62 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:18.765348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73b2ff4a-5d59-4334-9675-12309e874b62 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:18.765894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b2a5d49b-2002-4a54-b6cc-bb9040507c09 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:18.766518 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b2a5d49b-2002-4a54-b6cc-bb9040507c09 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:18.774421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2a5d49b-2002-4a54-b6cc-bb9040507c09 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:18.774956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2a5d49b-2002-4a54-b6cc-bb9040507c09 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:18.775407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2a5d49b-2002-4a54-b6cc-bb9040507c09 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:18.776137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2a5d49b-2002-4a54-b6cc-bb9040507c09 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:18.776731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2a5d49b-2002-4a54-b6cc-bb9040507c09 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:18.777202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2a5d49b-2002-4a54-b6cc-bb9040507c09 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:19.336247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b2a5d49b-2002-4a54-b6cc-bb9040507c09 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:19.349557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b2a5d49b-2002-4a54-b6cc-bb9040507c09 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:19.352270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b2a5d49b-2002-4a54-b6cc-bb9040507c09 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:19.354957 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b2a5d49b-2002-4a54-b6cc-bb9040507c09 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1362 microversion: 2.25 time: 0.592809 Sep 07 12:32:19.356296 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 502/997] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:18 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1362 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:19.364950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b7fa9d1f-90a2-43fb-8962-1bb36ecdca48 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-852087-9"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:19.371667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-73b2ff4a-5d59-4334-9675-12309e874b62 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:19.375076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b7fa9d1f-90a2-43fb-8962-1bb36ecdca48 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:19.385705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7fa9d1f-90a2-43fb-8962-1bb36ecdca48 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:19.386854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7fa9d1f-90a2-43fb-8962-1bb36ecdca48 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:19.387291 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-73b2ff4a-5d59-4334-9675-12309e874b62 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1543 microversion: 2.1 time: 0.656007 Sep 07 12:32:19.387851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7fa9d1f-90a2-43fb-8962-1bb36ecdca48 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:19.388686 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 496/998] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:18 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1543 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:19.389381 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7fa9d1f-90a2-43fb-8962-1bb36ecdca48 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:19.390236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7fa9d1f-90a2-43fb-8962-1bb36ecdca48 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:19.390877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7fa9d1f-90a2-43fb-8962-1bb36ecdca48 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:19.478941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b7fa9d1f-90a2-43fb-8962-1bb36ecdca48 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-852087-9". {{(pid=122432) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 12:32:19.575050 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b7fa9d1f-90a2-43fb-8962-1bb36ecdca48 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca/action" status: 202 len: 0 microversion: 2.91 time: 0.217231 Sep 07 12:32:19.581327 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 503/999] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Sep 7 12:32:19 2022] POST /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:32:19.593917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-52c45d67-a077-4738-95d0-83970afc6a7f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:19.595170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-52c45d67-a077-4738-95d0-83970afc6a7f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:19.608748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52c45d67-a077-4738-95d0-83970afc6a7f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:19.609799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52c45d67-a077-4738-95d0-83970afc6a7f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:19.611076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52c45d67-a077-4738-95d0-83970afc6a7f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:19.612498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52c45d67-a077-4738-95d0-83970afc6a7f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:19.613411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52c45d67-a077-4738-95d0-83970afc6a7f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:19.614302 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52c45d67-a077-4738-95d0-83970afc6a7f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:19.804333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ecea8e9a-cc7f-4d23-bdaa-f6abd11b928d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:19.806224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ecea8e9a-cc7f-4d23-bdaa-f6abd11b928d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:19.819981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecea8e9a-cc7f-4d23-bdaa-f6abd11b928d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:19.820960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecea8e9a-cc7f-4d23-bdaa-f6abd11b928d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:19.822094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecea8e9a-cc7f-4d23-bdaa-f6abd11b928d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:19.823591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecea8e9a-cc7f-4d23-bdaa-f6abd11b928d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:19.824616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecea8e9a-cc7f-4d23-bdaa-f6abd11b928d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:19.825401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecea8e9a-cc7f-4d23-bdaa-f6abd11b928d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:19.948167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-52c45d67-a077-4738-95d0-83970afc6a7f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:19.954685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:32:19.962197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-52c45d67-a077-4738-95d0-83970afc6a7f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:19.963915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-52c45d67-a077-4738-95d0-83970afc6a7f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:19.970370 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-52c45d67-a077-4738-95d0-83970afc6a7f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1486 microversion: 2.91 time: 0.385962 Sep 07 12:32:19.971163 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 497/1000] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:19 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1486 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:32:20.134107 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ecea8e9a-cc7f-4d23-bdaa-f6abd11b928d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:20.157829 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ecea8e9a-cc7f-4d23-bdaa-f6abd11b928d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1272 microversion: 2.1 time: 0.363528 Sep 07 12:32:20.159863 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 504/1001] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:19 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1272 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:20.389044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb4d2cea-9317-4485-b186-381c2e341099 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:20.390525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cb4d2cea-9317-4485-b186-381c2e341099 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:20.398186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb4d2cea-9317-4485-b186-381c2e341099 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:20.399016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb4d2cea-9317-4485-b186-381c2e341099 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:20.399659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb4d2cea-9317-4485-b186-381c2e341099 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:20.400624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb4d2cea-9317-4485-b186-381c2e341099 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:20.401477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb4d2cea-9317-4485-b186-381c2e341099 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:20.402208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb4d2cea-9317-4485-b186-381c2e341099 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:20.414684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-737ae895-b525-48de-a0b5-33f91c06433b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:20.417175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-737ae895-b525-48de-a0b5-33f91c06433b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:20.428464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-737ae895-b525-48de-a0b5-33f91c06433b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:20.429424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-737ae895-b525-48de-a0b5-33f91c06433b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:20.430007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-737ae895-b525-48de-a0b5-33f91c06433b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:20.431479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-737ae895-b525-48de-a0b5-33f91c06433b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:20.432137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-737ae895-b525-48de-a0b5-33f91c06433b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:20.433024 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-737ae895-b525-48de-a0b5-33f91c06433b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:21.464088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cb4d2cea-9317-4485-b186-381c2e341099 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:21.475245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cb4d2cea-9317-4485-b186-381c2e341099 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:21.477198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cb4d2cea-9317-4485-b186-381c2e341099 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:21.478677 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cb4d2cea-9317-4485-b186-381c2e341099 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1362 microversion: 2.25 time: 1.094166 Sep 07 12:32:21.479440 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 498/1002] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:20 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1362 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:21.485090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-86979826-27c9-432a-bbd6-c2dedfcadc86 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:21.486550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-86979826-27c9-432a-bbd6-c2dedfcadc86 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:21.493973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86979826-27c9-432a-bbd6-c2dedfcadc86 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:21.494481 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86979826-27c9-432a-bbd6-c2dedfcadc86 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:21.494914 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86979826-27c9-432a-bbd6-c2dedfcadc86 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:21.495820 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86979826-27c9-432a-bbd6-c2dedfcadc86 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:21.496772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86979826-27c9-432a-bbd6-c2dedfcadc86 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:21.497087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86979826-27c9-432a-bbd6-c2dedfcadc86 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:21.511319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-737ae895-b525-48de-a0b5-33f91c06433b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:21.523661 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-737ae895-b525-48de-a0b5-33f91c06433b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1543 microversion: 2.1 time: 1.115664 Sep 07 12:32:21.525323 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 505/1003] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:20 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1543 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:21.532843 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-596835f2-8ada-45fa-9008-6c32968b67f5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:21.533923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-596835f2-8ada-45fa-9008-6c32968b67f5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:21.546725 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-596835f2-8ada-45fa-9008-6c32968b67f5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:21.547527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-596835f2-8ada-45fa-9008-6c32968b67f5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:21.548649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-596835f2-8ada-45fa-9008-6c32968b67f5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:21.550197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-596835f2-8ada-45fa-9008-6c32968b67f5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:21.551025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-596835f2-8ada-45fa-9008-6c32968b67f5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:21.551752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-596835f2-8ada-45fa-9008-6c32968b67f5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:22.457469 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-596835f2-8ada-45fa-9008-6c32968b67f5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:22.466865 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-596835f2-8ada-45fa-9008-6c32968b67f5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1272 microversion: 2.1 time: 0.939969 Sep 07 12:32:22.467492 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 506/1004] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:21 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1272 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:22.517891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7c2e5aad-6022-4a34-a8bf-abba4091d52b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:22.518666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7c2e5aad-6022-4a34-a8bf-abba4091d52b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:22.526181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c2e5aad-6022-4a34-a8bf-abba4091d52b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:22.527105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c2e5aad-6022-4a34-a8bf-abba4091d52b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:22.527593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c2e5aad-6022-4a34-a8bf-abba4091d52b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:22.528383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c2e5aad-6022-4a34-a8bf-abba4091d52b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:22.528900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c2e5aad-6022-4a34-a8bf-abba4091d52b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:22.529379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c2e5aad-6022-4a34-a8bf-abba4091d52b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:22.638255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-86979826-27c9-432a-bbd6-c2dedfcadc86 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:22.648122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-86979826-27c9-432a-bbd6-c2dedfcadc86 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:22.649527 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-86979826-27c9-432a-bbd6-c2dedfcadc86 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:22.655890 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-86979826-27c9-432a-bbd6-c2dedfcadc86 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 1.175306 Sep 07 12:32:22.656476 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 499/1005] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:21 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:22.661542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-af1e7d3b-d8e8-4047-8a4d-9e062c529cf4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:22.662172 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-af1e7d3b-d8e8-4047-8a4d-9e062c529cf4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:22.671995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af1e7d3b-d8e8-4047-8a4d-9e062c529cf4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:22.672500 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af1e7d3b-d8e8-4047-8a4d-9e062c529cf4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:22.673222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af1e7d3b-d8e8-4047-8a4d-9e062c529cf4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:22.674047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af1e7d3b-d8e8-4047-8a4d-9e062c529cf4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:22.674517 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af1e7d3b-d8e8-4047-8a4d-9e062c529cf4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:22.674950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af1e7d3b-d8e8-4047-8a4d-9e062c529cf4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:23.360656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:32:23.893558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7c2e5aad-6022-4a34-a8bf-abba4091d52b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:23.909061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7c2e5aad-6022-4a34-a8bf-abba4091d52b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:23.910814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7c2e5aad-6022-4a34-a8bf-abba4091d52b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:23.912346 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7c2e5aad-6022-4a34-a8bf-abba4091d52b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1362 microversion: 2.25 time: 1.399385 Sep 07 12:32:23.913373 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 507/1006] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:22 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1362 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:32:23.923174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c627f533-be52-45b2-9327-1c1f19bdd440 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:23.924546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c627f533-be52-45b2-9327-1c1f19bdd440 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:23.937520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c627f533-be52-45b2-9327-1c1f19bdd440 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:23.938421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c627f533-be52-45b2-9327-1c1f19bdd440 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:23.939497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c627f533-be52-45b2-9327-1c1f19bdd440 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:23.940782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c627f533-be52-45b2-9327-1c1f19bdd440 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:23.941666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c627f533-be52-45b2-9327-1c1f19bdd440 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:23.942452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c627f533-be52-45b2-9327-1c1f19bdd440 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:24.008768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-af1e7d3b-d8e8-4047-8a4d-9e062c529cf4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:24.018522 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-af1e7d3b-d8e8-4047-8a4d-9e062c529cf4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1543 microversion: 2.1 time: 1.360873 Sep 07 12:32:24.019463 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 500/1007] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:22 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1543 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:24.026201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-41280117-76f2-4fd1-bc06-b1226ceea90f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:24.026201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-41280117-76f2-4fd1-bc06-b1226ceea90f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:24.030804 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:32:24.032624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41280117-76f2-4fd1-bc06-b1226ceea90f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:24.033429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41280117-76f2-4fd1-bc06-b1226ceea90f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:24.034098 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41280117-76f2-4fd1-bc06-b1226ceea90f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:24.035514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41280117-76f2-4fd1-bc06-b1226ceea90f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:24.036235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41280117-76f2-4fd1-bc06-b1226ceea90f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:24.036865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41280117-76f2-4fd1-bc06-b1226ceea90f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:24.214389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c627f533-be52-45b2-9327-1c1f19bdd440 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:24.230372 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c627f533-be52-45b2-9327-1c1f19bdd440 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1272 microversion: 2.1 time: 0.314380 Sep 07 12:32:24.245458 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 508/1008] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:23 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1272 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:24.314611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-41280117-76f2-4fd1-bc06-b1226ceea90f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:24.331182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-41280117-76f2-4fd1-bc06-b1226ceea90f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:24.333960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-41280117-76f2-4fd1-bc06-b1226ceea90f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:24.341568 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-41280117-76f2-4fd1-bc06-b1226ceea90f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 0.320484 Sep 07 12:32:24.343102 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 501/1009] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:24 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:24.930478 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d3111b69-59df-449c-9c5d-3c5b63bcb5ea tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-293219316", "imageRef": "96d6d8e8-b37b-4eb8-b45e-a29d0968d0c4", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "73a0d599-6776-4613-9bf0-775000448adb"}], "security_groups": [{"name": "tempest-securitygroup--1422571175"}], "key_name": "tempest-keypair-1989835296", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:24.966246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d25d8bbf-499e-4388-b7cc-93aa076fcb1f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:24.977724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d25d8bbf-499e-4388-b7cc-93aa076fcb1f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:24.994848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:32:25.007830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d25d8bbf-499e-4388-b7cc-93aa076fcb1f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:25.010700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d25d8bbf-499e-4388-b7cc-93aa076fcb1f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:25.016188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d25d8bbf-499e-4388-b7cc-93aa076fcb1f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:25.022788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d25d8bbf-499e-4388-b7cc-93aa076fcb1f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:25.024046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d25d8bbf-499e-4388-b7cc-93aa076fcb1f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:25.025060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d25d8bbf-499e-4388-b7cc-93aa076fcb1f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:25.882881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-d3111b69-59df-449c-9c5d-3c5b63bcb5ea tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] validate_networks() for [('73a0d599-6776-4613-9bf0-775000448adb', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:32:26.205046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d25d8bbf-499e-4388-b7cc-93aa076fcb1f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:26.215180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d25d8bbf-499e-4388-b7cc-93aa076fcb1f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:26.216738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d25d8bbf-499e-4388-b7cc-93aa076fcb1f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:26.217964 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d25d8bbf-499e-4388-b7cc-93aa076fcb1f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1362 microversion: 2.25 time: 1.262356 Sep 07 12:32:26.218544 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 502/1010] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:24 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1362 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:26.223607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8d5c3aed-6489-4beb-a427-cf6a3b0ba8c0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:26.224222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8d5c3aed-6489-4beb-a427-cf6a3b0ba8c0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:26.231599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d5c3aed-6489-4beb-a427-cf6a3b0ba8c0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:26.232089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d5c3aed-6489-4beb-a427-cf6a3b0ba8c0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:26.232719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d5c3aed-6489-4beb-a427-cf6a3b0ba8c0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:26.233704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d5c3aed-6489-4beb-a427-cf6a3b0ba8c0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:26.234485 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d5c3aed-6489-4beb-a427-cf6a3b0ba8c0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:26.234945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d5c3aed-6489-4beb-a427-cf6a3b0ba8c0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:26.518823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=12 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:32:27.254976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8d5c3aed-6489-4beb-a427-cf6a3b0ba8c0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:27.301259 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8d5c3aed-6489-4beb-a427-cf6a3b0ba8c0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1543 microversion: 2.1 time: 1.081228 Sep 07 12:32:27.306274 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 503/1011] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:26 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1543 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:27.313682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-da59b31e-5e4e-4b07-b7ee-6312cedb31dc req-c0420b7e-f50e-45fc-bb2a-729abe1dbe71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81fe7509-9012-4fcc-9f06-26693494f535", "tag": "e45111b2-8436-42bb-872d-704690a433d6"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:27.352158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-da59b31e-5e4e-4b07-b7ee-6312cedb31dc req-c0420b7e-f50e-45fc-bb2a-729abe1dbe71 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:27.360307 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-da59b31e-5e4e-4b07-b7ee-6312cedb31dc req-c0420b7e-f50e-45fc-bb2a-729abe1dbe71 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:27.360850 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-da59b31e-5e4e-4b07-b7ee-6312cedb31dc req-c0420b7e-f50e-45fc-bb2a-729abe1dbe71 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:27.399905 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-da59b31e-5e4e-4b07-b7ee-6312cedb31dc req-c0420b7e-f50e-45fc-bb2a-729abe1dbe71 service nova] Creating event network-changed:e45111b2-8436-42bb-872d-704690a433d6 for instance 81fe7509-9012-4fcc-9f06-26693494f535 on n-h1-852087-9 Sep 07 12:32:27.411388 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-da59b31e-5e4e-4b07-b7ee-6312cedb31dc req-c0420b7e-f50e-45fc-bb2a-729abe1dbe71 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103092 Sep 07 12:32:27.412849 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 504/1012] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:27.430407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d74b2e27-99ca-410b-9d4e-cad4f18fd1a0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:27.431453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d74b2e27-99ca-410b-9d4e-cad4f18fd1a0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:27.439562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d74b2e27-99ca-410b-9d4e-cad4f18fd1a0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:27.440428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d74b2e27-99ca-410b-9d4e-cad4f18fd1a0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:27.441104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d74b2e27-99ca-410b-9d4e-cad4f18fd1a0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:27.442188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d74b2e27-99ca-410b-9d4e-cad4f18fd1a0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:27.443743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d74b2e27-99ca-410b-9d4e-cad4f18fd1a0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:27.454546 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d74b2e27-99ca-410b-9d4e-cad4f18fd1a0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:27.875242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d3111b69-59df-449c-9c5d-3c5b63bcb5ea tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:32:27.880164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d3111b69-59df-449c-9c5d-3c5b63bcb5ea tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:32:27.882903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d3111b69-59df-449c-9c5d-3c5b63bcb5ea tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:32:27.883948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d3111b69-59df-449c-9c5d-3c5b63bcb5ea tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:32:27.885446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d3111b69-59df-449c-9c5d-3c5b63bcb5ea tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:32:27.914257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3111b69-59df-449c-9c5d-3c5b63bcb5ea tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:27.915471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3111b69-59df-449c-9c5d-3c5b63bcb5ea tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:27.916616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3111b69-59df-449c-9c5d-3c5b63bcb5ea tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:27.918642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3111b69-59df-449c-9c5d-3c5b63bcb5ea tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:27.919987 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3111b69-59df-449c-9c5d-3c5b63bcb5ea tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:27.921202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3111b69-59df-449c-9c5d-3c5b63bcb5ea tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:27.981376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-d3111b69-59df-449c-9c5d-3c5b63bcb5ea tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Getting quotas for project 16b6f7d9efc940449d014d41cf2f18c2. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:32:27.987981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-d3111b69-59df-449c-9c5d-3c5b63bcb5ea tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Getting quotas for user 0c7ad5e634ea41e3aed6caa5652e784e and project 16b6f7d9efc940449d014d41cf2f18c2. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:32:28.003515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d3111b69-59df-449c-9c5d-3c5b63bcb5ea tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:32:28.005896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d3111b69-59df-449c-9c5d-3c5b63bcb5ea tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='96d6d8e8-b37b-4eb8-b45e-a29d0968d0c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:32:28.052249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d74b2e27-99ca-410b-9d4e-cad4f18fd1a0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:28.063886 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d74b2e27-99ca-410b-9d4e-cad4f18fd1a0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1314 microversion: 2.1 time: 0.649233 Sep 07 12:32:28.064916 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 505/1013] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:27 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1314 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:28.078055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5cf5a76a-eba8-4dd7-8f79-5be851420708 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:28.080504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5cf5a76a-eba8-4dd7-8f79-5be851420708 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:28.091783 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5cf5a76a-eba8-4dd7-8f79-5be851420708 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:28.092367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5cf5a76a-eba8-4dd7-8f79-5be851420708 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:28.093129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5cf5a76a-eba8-4dd7-8f79-5be851420708 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:28.095329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5cf5a76a-eba8-4dd7-8f79-5be851420708 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:28.120406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5cf5a76a-eba8-4dd7-8f79-5be851420708 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:28.122097 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5cf5a76a-eba8-4dd7-8f79-5be851420708 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:28.151268 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d3111b69-59df-449c-9c5d-3c5b63bcb5ea tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.226598 Sep 07 12:32:28.163392 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 509/1014] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:32:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 3242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:32:28.174479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aef08798-494e-45dd-ba65-365ed41f3ff2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:28.176046 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aef08798-494e-45dd-ba65-365ed41f3ff2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:28.182069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=3,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:32:28.219434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aef08798-494e-45dd-ba65-365ed41f3ff2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:28.222290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aef08798-494e-45dd-ba65-365ed41f3ff2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:28.224733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aef08798-494e-45dd-ba65-365ed41f3ff2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:28.227419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aef08798-494e-45dd-ba65-365ed41f3ff2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:28.238802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aef08798-494e-45dd-ba65-365ed41f3ff2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:28.240082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aef08798-494e-45dd-ba65-365ed41f3ff2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:28.375216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5cf5a76a-eba8-4dd7-8f79-5be851420708 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:28.396389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5cf5a76a-eba8-4dd7-8f79-5be851420708 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:28.400499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5cf5a76a-eba8-4dd7-8f79-5be851420708 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:28.417630 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5cf5a76a-eba8-4dd7-8f79-5be851420708 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 0.349645 Sep 07 12:32:28.418666 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 506/1015] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:28 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:28.452315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c0d1fc7d-bae5-4544-a6cd-a78c800e14c4 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:28.453911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c0d1fc7d-bae5-4544-a6cd-a78c800e14c4 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:28.468071 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:32:28.624870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c0d1fc7d-bae5-4544-a6cd-a78c800e14c4 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7ad5e634ea41e3aed6caa5652e784e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6f7d9efc940449d014d41cf2f18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:28.637426 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c0d1fc7d-bae5-4544-a6cd-a78c800e14c4 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec" status: 200 len: 1245 microversion: 2.1 time: 0.216873 Sep 07 12:32:28.639469 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 507/1016] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:28 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec => generated 1245 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:28.649408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b0e2c88a-585d-4a7f-97bf-84207b1046a7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:28.650659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b0e2c88a-585d-4a7f-97bf-84207b1046a7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:28.666326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0e2c88a-585d-4a7f-97bf-84207b1046a7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:28.667252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0e2c88a-585d-4a7f-97bf-84207b1046a7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:28.668252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0e2c88a-585d-4a7f-97bf-84207b1046a7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:28.669422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0e2c88a-585d-4a7f-97bf-84207b1046a7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:28.670334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0e2c88a-585d-4a7f-97bf-84207b1046a7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:28.671212 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0e2c88a-585d-4a7f-97bf-84207b1046a7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:28.786819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aef08798-494e-45dd-ba65-365ed41f3ff2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:28.802906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aef08798-494e-45dd-ba65-365ed41f3ff2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:28.806625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aef08798-494e-45dd-ba65-365ed41f3ff2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:28.809190 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aef08798-494e-45dd-ba65-365ed41f3ff2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1362 microversion: 2.25 time: 0.643568 Sep 07 12:32:28.810973 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 510/1017] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:28 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1362 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:29.106728 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f41e30aa-ddc6-4277-81d4-15fb2be98568 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:29.108267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f41e30aa-ddc6-4277-81d4-15fb2be98568 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:29.120672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f41e30aa-ddc6-4277-81d4-15fb2be98568 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:29.121462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f41e30aa-ddc6-4277-81d4-15fb2be98568 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:29.122093 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f41e30aa-ddc6-4277-81d4-15fb2be98568 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:29.123993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f41e30aa-ddc6-4277-81d4-15fb2be98568 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:29.124684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f41e30aa-ddc6-4277-81d4-15fb2be98568 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:29.125367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f41e30aa-ddc6-4277-81d4-15fb2be98568 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:29.164812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b0e2c88a-585d-4a7f-97bf-84207b1046a7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:29.210818 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b0e2c88a-585d-4a7f-97bf-84207b1046a7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1543 microversion: 2.1 time: 0.569234 Sep 07 12:32:29.218573 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 508/1018] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:28 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1543 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:29.437398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f41e30aa-ddc6-4277-81d4-15fb2be98568 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:29.461021 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f41e30aa-ddc6-4277-81d4-15fb2be98568 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1314 microversion: 2.1 time: 0.360895 Sep 07 12:32:29.463521 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 511/1019] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:29 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:29.466406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec34e344-9634-4f42-946a-8e41f79378c2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:29.467252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ec34e344-9634-4f42-946a-8e41f79378c2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:29.481673 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec34e344-9634-4f42-946a-8e41f79378c2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:29.482188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec34e344-9634-4f42-946a-8e41f79378c2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:29.482633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec34e344-9634-4f42-946a-8e41f79378c2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:29.494441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec34e344-9634-4f42-946a-8e41f79378c2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:29.495508 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec34e344-9634-4f42-946a-8e41f79378c2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:29.495966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec34e344-9634-4f42-946a-8e41f79378c2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:29.625560 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ec34e344-9634-4f42-946a-8e41f79378c2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:29.635690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ec34e344-9634-4f42-946a-8e41f79378c2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:29.637853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ec34e344-9634-4f42-946a-8e41f79378c2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:29.644802 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ec34e344-9634-4f42-946a-8e41f79378c2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 0.184941 Sep 07 12:32:29.659807 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 509/1020] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:29 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:29.674997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-438f7678-0689-4c48-a143-e1a0ca35502b tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:29.676795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-438f7678-0689-4c48-a143-e1a0ca35502b tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:29.689876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-438f7678-0689-4c48-a143-e1a0ca35502b tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:29.691795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-438f7678-0689-4c48-a143-e1a0ca35502b tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:29.692902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-438f7678-0689-4c48-a143-e1a0ca35502b tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:29.695043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-438f7678-0689-4c48-a143-e1a0ca35502b tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:29.696254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-438f7678-0689-4c48-a143-e1a0ca35502b tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:29.697254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-438f7678-0689-4c48-a143-e1a0ca35502b tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:29.859665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e9d63278-62bd-477b-9e35-bd597fd82fac tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:29.864781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e9d63278-62bd-477b-9e35-bd597fd82fac tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:29.879426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-438f7678-0689-4c48-a143-e1a0ca35502b tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7ad5e634ea41e3aed6caa5652e784e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6f7d9efc940449d014d41cf2f18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:29.891759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9d63278-62bd-477b-9e35-bd597fd82fac tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:29.892692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9d63278-62bd-477b-9e35-bd597fd82fac tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:29.896044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9d63278-62bd-477b-9e35-bd597fd82fac tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:29.907553 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-438f7678-0689-4c48-a143-e1a0ca35502b tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec" status: 200 len: 1249 microversion: 2.1 time: 0.229887 Sep 07 12:32:29.907902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9d63278-62bd-477b-9e35-bd597fd82fac tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:29.907902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9d63278-62bd-477b-9e35-bd597fd82fac tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:29.907902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9d63278-62bd-477b-9e35-bd597fd82fac tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:29.914777 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 512/1021] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:29 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec => generated 1249 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:30.172617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e9d63278-62bd-477b-9e35-bd597fd82fac tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:30.194354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e9d63278-62bd-477b-9e35-bd597fd82fac tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:30.195950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e9d63278-62bd-477b-9e35-bd597fd82fac tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:30.198962 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e9d63278-62bd-477b-9e35-bd597fd82fac tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1362 microversion: 2.25 time: 0.349984 Sep 07 12:32:30.200712 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 510/1022] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:29 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1362 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:30.265673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ec299d3-9f24-46bd-8464-3b7c4eee612a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:30.269591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5ec299d3-9f24-46bd-8464-3b7c4eee612a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:30.337371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ec299d3-9f24-46bd-8464-3b7c4eee612a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:30.338359 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ec299d3-9f24-46bd-8464-3b7c4eee612a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:30.341890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ec299d3-9f24-46bd-8464-3b7c4eee612a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:30.343021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ec299d3-9f24-46bd-8464-3b7c4eee612a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:30.346350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ec299d3-9f24-46bd-8464-3b7c4eee612a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:30.347055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ec299d3-9f24-46bd-8464-3b7c4eee612a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:30.493752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-118b8b05-085b-434c-a747-c05c49771231 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:30.502428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-118b8b05-085b-434c-a747-c05c49771231 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:30.547605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-118b8b05-085b-434c-a747-c05c49771231 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:30.564905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-118b8b05-085b-434c-a747-c05c49771231 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:30.570906 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-118b8b05-085b-434c-a747-c05c49771231 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:30.576530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-118b8b05-085b-434c-a747-c05c49771231 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:30.580030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-118b8b05-085b-434c-a747-c05c49771231 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:30.584635 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-118b8b05-085b-434c-a747-c05c49771231 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:31.042034 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5ec299d3-9f24-46bd-8464-3b7c4eee612a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:31.058760 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5ec299d3-9f24-46bd-8464-3b7c4eee612a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1543 microversion: 2.1 time: 0.803669 Sep 07 12:32:31.058923 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 513/1023] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:30 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1543 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:31.095248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b6bcce5e-4a5d-4a18-965a-1fa90bcf5802 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:31.095870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b6bcce5e-4a5d-4a18-965a-1fa90bcf5802 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:31.113322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6bcce5e-4a5d-4a18-965a-1fa90bcf5802 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:31.116137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6bcce5e-4a5d-4a18-965a-1fa90bcf5802 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:31.118295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6bcce5e-4a5d-4a18-965a-1fa90bcf5802 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:31.120704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6bcce5e-4a5d-4a18-965a-1fa90bcf5802 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:31.122061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6bcce5e-4a5d-4a18-965a-1fa90bcf5802 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:31.123924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6bcce5e-4a5d-4a18-965a-1fa90bcf5802 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:31.335218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b6bcce5e-4a5d-4a18-965a-1fa90bcf5802 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:31.350515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b6bcce5e-4a5d-4a18-965a-1fa90bcf5802 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:31.352401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b6bcce5e-4a5d-4a18-965a-1fa90bcf5802 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:31.370243 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b6bcce5e-4a5d-4a18-965a-1fa90bcf5802 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 0.310307 Sep 07 12:32:31.370866 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 514/1024] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:31 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:31.390168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4790c7c5-23e1-400f-ade9-7d768c2567e6 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:31.390302 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4790c7c5-23e1-400f-ade9-7d768c2567e6 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:31.430534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4790c7c5-23e1-400f-ade9-7d768c2567e6 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:31.431042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4790c7c5-23e1-400f-ade9-7d768c2567e6 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:31.435214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4790c7c5-23e1-400f-ade9-7d768c2567e6 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:31.443167 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4790c7c5-23e1-400f-ade9-7d768c2567e6 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:31.444284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4790c7c5-23e1-400f-ade9-7d768c2567e6 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:31.450653 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4790c7c5-23e1-400f-ade9-7d768c2567e6 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:31.459817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-118b8b05-085b-434c-a747-c05c49771231 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:31.472359 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-118b8b05-085b-434c-a747-c05c49771231 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1314 microversion: 2.1 time: 0.989985 Sep 07 12:32:31.490448 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 511/1025] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:30 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1314 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:31.522051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6f1acbd5-796c-4b4d-96cf-9938ad6051f5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:31.523891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6f1acbd5-796c-4b4d-96cf-9938ad6051f5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:31.540947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f1acbd5-796c-4b4d-96cf-9938ad6051f5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:31.545263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f1acbd5-796c-4b4d-96cf-9938ad6051f5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:31.546162 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f1acbd5-796c-4b4d-96cf-9938ad6051f5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:31.548917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f1acbd5-796c-4b4d-96cf-9938ad6051f5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:31.549784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f1acbd5-796c-4b4d-96cf-9938ad6051f5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:31.550450 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f1acbd5-796c-4b4d-96cf-9938ad6051f5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:31.849893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4790c7c5-23e1-400f-ade9-7d768c2567e6 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7ad5e634ea41e3aed6caa5652e784e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6f7d9efc940449d014d41cf2f18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:31.887280 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4790c7c5-23e1-400f-ade9-7d768c2567e6 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec" status: 200 len: 1297 microversion: 2.1 time: 0.501610 Sep 07 12:32:31.892863 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 515/1026] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:31 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec => generated 1297 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:32.020122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6f1acbd5-796c-4b4d-96cf-9938ad6051f5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:32.035498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6f1acbd5-796c-4b4d-96cf-9938ad6051f5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:32.038204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6f1acbd5-796c-4b4d-96cf-9938ad6051f5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:32.040512 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6f1acbd5-796c-4b4d-96cf-9938ad6051f5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1362 microversion: 2.25 time: 0.548142 Sep 07 12:32:32.065363 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 512/1027] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:31 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1362 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:32.128747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1c89f00e-3678-4201-827a-6e1a9715c145 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:32.130395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1c89f00e-3678-4201-827a-6e1a9715c145 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:32.162867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c89f00e-3678-4201-827a-6e1a9715c145 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:32.164448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c89f00e-3678-4201-827a-6e1a9715c145 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:32.165833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c89f00e-3678-4201-827a-6e1a9715c145 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:32.169920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c89f00e-3678-4201-827a-6e1a9715c145 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:32.173932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c89f00e-3678-4201-827a-6e1a9715c145 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:32.174748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c89f00e-3678-4201-827a-6e1a9715c145 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:32.429253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2e33167e-3033-4e59-b458-9b17ee9bc1b4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:32.430594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2e33167e-3033-4e59-b458-9b17ee9bc1b4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:32.438178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e33167e-3033-4e59-b458-9b17ee9bc1b4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:32.439295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e33167e-3033-4e59-b458-9b17ee9bc1b4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:32.440247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e33167e-3033-4e59-b458-9b17ee9bc1b4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:32.441203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e33167e-3033-4e59-b458-9b17ee9bc1b4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:32.441880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e33167e-3033-4e59-b458-9b17ee9bc1b4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:32.442575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e33167e-3033-4e59-b458-9b17ee9bc1b4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:32.709870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2e33167e-3033-4e59-b458-9b17ee9bc1b4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:32.742465 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2e33167e-3033-4e59-b458-9b17ee9bc1b4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:32.756456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2e33167e-3033-4e59-b458-9b17ee9bc1b4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:32.796135 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2e33167e-3033-4e59-b458-9b17ee9bc1b4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 0.370563 Sep 07 12:32:32.798377 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 513/1028] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:32 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:32.820604 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-56a3fa06-0e29-43af-ad31-2b83c29e0812 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:32.828941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-56a3fa06-0e29-43af-ad31-2b83c29e0812 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:32.860459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56a3fa06-0e29-43af-ad31-2b83c29e0812 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:32.866922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56a3fa06-0e29-43af-ad31-2b83c29e0812 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:32.871599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56a3fa06-0e29-43af-ad31-2b83c29e0812 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:32.874094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56a3fa06-0e29-43af-ad31-2b83c29e0812 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:32.880032 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56a3fa06-0e29-43af-ad31-2b83c29e0812 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:32.881309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56a3fa06-0e29-43af-ad31-2b83c29e0812 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:33.104301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1c89f00e-3678-4201-827a-6e1a9715c145 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:33.152793 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1c89f00e-3678-4201-827a-6e1a9715c145 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1543 microversion: 2.1 time: 1.030512 Sep 07 12:32:33.171122 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 516/1029] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:32 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1543 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:33.210457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-68c95f67-4d04-418d-adfb-89c260999dc3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:33.213711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-68c95f67-4d04-418d-adfb-89c260999dc3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:33.235480 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68c95f67-4d04-418d-adfb-89c260999dc3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:33.241939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68c95f67-4d04-418d-adfb-89c260999dc3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:33.242602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68c95f67-4d04-418d-adfb-89c260999dc3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:33.243552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68c95f67-4d04-418d-adfb-89c260999dc3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:33.244150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68c95f67-4d04-418d-adfb-89c260999dc3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:33.244986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68c95f67-4d04-418d-adfb-89c260999dc3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:33.376979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-56a3fa06-0e29-43af-ad31-2b83c29e0812 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:33.414251 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-56a3fa06-0e29-43af-ad31-2b83c29e0812 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1314 microversion: 2.1 time: 0.611314 Sep 07 12:32:33.433524 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 514/1030] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:32 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1314 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:33.478907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5a750314-855b-4560-b92a-6f073886525d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:33.480542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5a750314-855b-4560-b92a-6f073886525d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:33.494816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-68c95f67-4d04-418d-adfb-89c260999dc3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7ad5e634ea41e3aed6caa5652e784e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6f7d9efc940449d014d41cf2f18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:33.500361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a750314-855b-4560-b92a-6f073886525d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:33.501894 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a750314-855b-4560-b92a-6f073886525d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:33.506304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a750314-855b-4560-b92a-6f073886525d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:33.508555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a750314-855b-4560-b92a-6f073886525d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:33.515189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a750314-855b-4560-b92a-6f073886525d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:33.516468 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:32:33.517224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a750314-855b-4560-b92a-6f073886525d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:33.525035 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-68c95f67-4d04-418d-adfb-89c260999dc3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec" status: 200 len: 1303 microversion: 2.1 time: 0.350854 Sep 07 12:32:33.538587 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 517/1031] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:33 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec => generated 1303 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:33.842875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a60bbaa5-a385-4ddd-b1c4-85440c166e78 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:33.850314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a60bbaa5-a385-4ddd-b1c4-85440c166e78 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:33.919749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a60bbaa5-a385-4ddd-b1c4-85440c166e78 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:33.921588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a60bbaa5-a385-4ddd-b1c4-85440c166e78 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:33.922948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a60bbaa5-a385-4ddd-b1c4-85440c166e78 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:33.927835 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a60bbaa5-a385-4ddd-b1c4-85440c166e78 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:33.929156 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a60bbaa5-a385-4ddd-b1c4-85440c166e78 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:33.930312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a60bbaa5-a385-4ddd-b1c4-85440c166e78 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:34.043351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5a750314-855b-4560-b92a-6f073886525d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:34.101241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5a750314-855b-4560-b92a-6f073886525d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:34.106154 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5a750314-855b-4560-b92a-6f073886525d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:34.109187 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5a750314-855b-4560-b92a-6f073886525d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1362 microversion: 2.25 time: 0.673159 Sep 07 12:32:34.126120 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 515/1032] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:33 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1362 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:34.212321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-87888b7d-3be4-4fe8-bf98-ac5c729a2d5c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:34.218890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-87888b7d-3be4-4fe8-bf98-ac5c729a2d5c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:34.267555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87888b7d-3be4-4fe8-bf98-ac5c729a2d5c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:34.268683 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87888b7d-3be4-4fe8-bf98-ac5c729a2d5c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:34.271399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87888b7d-3be4-4fe8-bf98-ac5c729a2d5c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:34.276559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87888b7d-3be4-4fe8-bf98-ac5c729a2d5c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:34.278889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87888b7d-3be4-4fe8-bf98-ac5c729a2d5c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:34.280692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87888b7d-3be4-4fe8-bf98-ac5c729a2d5c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:34.294096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a60bbaa5-a385-4ddd-b1c4-85440c166e78 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:34.313000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:32:34.313868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a60bbaa5-a385-4ddd-b1c4-85440c166e78 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:34.315732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a60bbaa5-a385-4ddd-b1c4-85440c166e78 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:34.322259 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a60bbaa5-a385-4ddd-b1c4-85440c166e78 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 0.495222 Sep 07 12:32:34.337533 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 518/1033] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:33 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:34.337533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-22d5e2e9-4243-4d91-b914-2bfef945d218 req-8571433b-10fd-4a9d-9d86-089de9ed8cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81fe7509-9012-4fcc-9f06-26693494f535", "name": "network-vif-plugged", "status": "completed", "tag": "e45111b2-8436-42bb-872d-704690a433d6"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:34.340307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-22d5e2e9-4243-4d91-b914-2bfef945d218 req-8571433b-10fd-4a9d-9d86-089de9ed8cc3 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:34.340800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-22d5e2e9-4243-4d91-b914-2bfef945d218 req-8571433b-10fd-4a9d-9d86-089de9ed8cc3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:34.341233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-22d5e2e9-4243-4d91-b914-2bfef945d218 req-8571433b-10fd-4a9d-9d86-089de9ed8cc3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:34.357031 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-22d5e2e9-4243-4d91-b914-2bfef945d218 req-8571433b-10fd-4a9d-9d86-089de9ed8cc3 service nova] Creating event network-vif-plugged:e45111b2-8436-42bb-872d-704690a433d6 for instance 81fe7509-9012-4fcc-9f06-26693494f535 on n-h1-852087-9 Sep 07 12:32:34.372307 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-22d5e2e9-4243-4d91-b914-2bfef945d218 req-8571433b-10fd-4a9d-9d86-089de9ed8cc3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047760 Sep 07 12:32:34.373629 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 519/1034] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:34.489609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-457064f0-22f1-4184-9d4b-77aed70ec4bb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:34.490767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-457064f0-22f1-4184-9d4b-77aed70ec4bb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:34.555929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-457064f0-22f1-4184-9d4b-77aed70ec4bb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:34.566092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-457064f0-22f1-4184-9d4b-77aed70ec4bb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:34.566579 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-457064f0-22f1-4184-9d4b-77aed70ec4bb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:34.567554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-457064f0-22f1-4184-9d4b-77aed70ec4bb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:34.570204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-457064f0-22f1-4184-9d4b-77aed70ec4bb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:34.573798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-457064f0-22f1-4184-9d4b-77aed70ec4bb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:35.165528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-457064f0-22f1-4184-9d4b-77aed70ec4bb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:35.178691 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-457064f0-22f1-4184-9d4b-77aed70ec4bb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1314 microversion: 2.1 time: 0.712527 Sep 07 12:32:35.179361 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 520/1035] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:34 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1314 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:35.189772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b26021e6-7582-41c6-86e3-ddc4b1c39f51 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:35.189772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b26021e6-7582-41c6-86e3-ddc4b1c39f51 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:35.210400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b26021e6-7582-41c6-86e3-ddc4b1c39f51 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:35.210658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-87888b7d-3be4-4fe8-bf98-ac5c729a2d5c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:35.211878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b26021e6-7582-41c6-86e3-ddc4b1c39f51 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:35.214221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b26021e6-7582-41c6-86e3-ddc4b1c39f51 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:35.221678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b26021e6-7582-41c6-86e3-ddc4b1c39f51 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:35.222840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b26021e6-7582-41c6-86e3-ddc4b1c39f51 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:35.223683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b26021e6-7582-41c6-86e3-ddc4b1c39f51 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:35.245887 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-87888b7d-3be4-4fe8-bf98-ac5c729a2d5c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1543 microversion: 2.1 time: 1.044894 Sep 07 12:32:35.248445 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 516/1036] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:34 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1543 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:32:35.269226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-46d4a5d4-399b-47ec-8790-20e592632e06 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:35.271046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-46d4a5d4-399b-47ec-8790-20e592632e06 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:35.289581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46d4a5d4-399b-47ec-8790-20e592632e06 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:35.291156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46d4a5d4-399b-47ec-8790-20e592632e06 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:35.292819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46d4a5d4-399b-47ec-8790-20e592632e06 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:35.296559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46d4a5d4-399b-47ec-8790-20e592632e06 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:35.298596 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46d4a5d4-399b-47ec-8790-20e592632e06 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:35.299778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46d4a5d4-399b-47ec-8790-20e592632e06 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:35.387649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b26021e6-7582-41c6-86e3-ddc4b1c39f51 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7ad5e634ea41e3aed6caa5652e784e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6f7d9efc940449d014d41cf2f18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:35.406565 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b26021e6-7582-41c6-86e3-ddc4b1c39f51 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec" status: 200 len: 1303 microversion: 2.1 time: 0.225859 Sep 07 12:32:35.422360 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 521/1037] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:35 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec => generated 1303 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:35.431548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-779f0f1c-13d6-48fc-8dd7-2a22aab105dc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:35.432638 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-779f0f1c-13d6-48fc-8dd7-2a22aab105dc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:35.440482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-779f0f1c-13d6-48fc-8dd7-2a22aab105dc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:35.441283 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-779f0f1c-13d6-48fc-8dd7-2a22aab105dc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:35.441967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-779f0f1c-13d6-48fc-8dd7-2a22aab105dc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:35.442900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-779f0f1c-13d6-48fc-8dd7-2a22aab105dc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:35.443630 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-779f0f1c-13d6-48fc-8dd7-2a22aab105dc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:35.444257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-779f0f1c-13d6-48fc-8dd7-2a22aab105dc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:36.367839 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-779f0f1c-13d6-48fc-8dd7-2a22aab105dc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:36.387566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-779f0f1c-13d6-48fc-8dd7-2a22aab105dc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:36.392399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-779f0f1c-13d6-48fc-8dd7-2a22aab105dc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:36.406509 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-779f0f1c-13d6-48fc-8dd7-2a22aab105dc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 0.982883 Sep 07 12:32:36.407228 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 522/1038] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:35 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:36.419255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f358907d-3235-434b-bd4f-0530483e7a29 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:36.419890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f358907d-3235-434b-bd4f-0530483e7a29 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:36.438878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f358907d-3235-434b-bd4f-0530483e7a29 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:36.439884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f358907d-3235-434b-bd4f-0530483e7a29 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:36.440504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f358907d-3235-434b-bd4f-0530483e7a29 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:36.441416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f358907d-3235-434b-bd4f-0530483e7a29 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:36.442272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f358907d-3235-434b-bd4f-0530483e7a29 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:36.444628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f358907d-3235-434b-bd4f-0530483e7a29 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:36.470058 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-46d4a5d4-399b-47ec-8790-20e592632e06 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:36.487226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-46d4a5d4-399b-47ec-8790-20e592632e06 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:36.489277 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-46d4a5d4-399b-47ec-8790-20e592632e06 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:36.491763 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-46d4a5d4-399b-47ec-8790-20e592632e06 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1362 microversion: 2.25 time: 1.241239 Sep 07 12:32:36.497468 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 517/1039] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:35 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1362 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:36.518146 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1bde6dff-0c3c-455a-b3e3-d38fae6b6d5e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:36.522808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1bde6dff-0c3c-455a-b3e3-d38fae6b6d5e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:36.550869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bde6dff-0c3c-455a-b3e3-d38fae6b6d5e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:36.551681 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bde6dff-0c3c-455a-b3e3-d38fae6b6d5e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:36.557292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bde6dff-0c3c-455a-b3e3-d38fae6b6d5e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:36.558417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bde6dff-0c3c-455a-b3e3-d38fae6b6d5e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:36.559128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bde6dff-0c3c-455a-b3e3-d38fae6b6d5e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:36.559728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bde6dff-0c3c-455a-b3e3-d38fae6b6d5e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:37.345666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1bde6dff-0c3c-455a-b3e3-d38fae6b6d5e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:37.380779 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1bde6dff-0c3c-455a-b3e3-d38fae6b6d5e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1543 microversion: 2.1 time: 0.878013 Sep 07 12:32:37.384336 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 518/1040] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:36 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1543 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:37.394388 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-850a635d-d628-4ef9-8e4e-3b236887beae tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:37.400478 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-850a635d-d628-4ef9-8e4e-3b236887beae tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:37.427604 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-850a635d-d628-4ef9-8e4e-3b236887beae tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:37.428113 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-850a635d-d628-4ef9-8e4e-3b236887beae tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:37.428564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-850a635d-d628-4ef9-8e4e-3b236887beae tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:37.429295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-850a635d-d628-4ef9-8e4e-3b236887beae tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:37.430092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-850a635d-d628-4ef9-8e4e-3b236887beae tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:37.430684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-850a635d-d628-4ef9-8e4e-3b236887beae tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:37.899047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f358907d-3235-434b-bd4f-0530483e7a29 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:37.913945 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f358907d-3235-434b-bd4f-0530483e7a29 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1314 microversion: 2.1 time: 1.502048 Sep 07 12:32:37.917919 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 523/1041] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:36 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1314 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:37.934777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f3628a44-c27e-4b69-9580-512a3c16eec8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:37.935794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f3628a44-c27e-4b69-9580-512a3c16eec8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:37.953185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3628a44-c27e-4b69-9580-512a3c16eec8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:37.958445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3628a44-c27e-4b69-9580-512a3c16eec8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:37.959519 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3628a44-c27e-4b69-9580-512a3c16eec8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:37.962173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3628a44-c27e-4b69-9580-512a3c16eec8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:37.964640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3628a44-c27e-4b69-9580-512a3c16eec8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:37.966912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3628a44-c27e-4b69-9580-512a3c16eec8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:37.972038 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:32:38.025384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:32:38.289082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f3628a44-c27e-4b69-9580-512a3c16eec8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:38.319539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f3628a44-c27e-4b69-9580-512a3c16eec8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:38.334062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f3628a44-c27e-4b69-9580-512a3c16eec8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:38.347026 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f3628a44-c27e-4b69-9580-512a3c16eec8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 0.425243 Sep 07 12:32:38.401676 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 524/1042] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:37 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:38.411974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6dc057b5-8f31-4eb6-b734-5fd79eb2b8a3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:38.413760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6dc057b5-8f31-4eb6-b734-5fd79eb2b8a3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:38.426026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6dc057b5-8f31-4eb6-b734-5fd79eb2b8a3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:38.428054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6dc057b5-8f31-4eb6-b734-5fd79eb2b8a3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:38.429895 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6dc057b5-8f31-4eb6-b734-5fd79eb2b8a3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:38.431503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6dc057b5-8f31-4eb6-b734-5fd79eb2b8a3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:38.432626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6dc057b5-8f31-4eb6-b734-5fd79eb2b8a3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:38.433816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6dc057b5-8f31-4eb6-b734-5fd79eb2b8a3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:38.473810 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-850a635d-d628-4ef9-8e4e-3b236887beae tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7ad5e634ea41e3aed6caa5652e784e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6f7d9efc940449d014d41cf2f18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:38.498795 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-850a635d-d628-4ef9-8e4e-3b236887beae tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec" status: 200 len: 1371 microversion: 2.1 time: 1.112727 Sep 07 12:32:38.513836 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 519/1043] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:37 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec => generated 1371 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:38.529987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-971021bf-576e-4a8c-aa78-8135021ae990 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:38.543373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-971021bf-576e-4a8c-aa78-8135021ae990 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:38.561879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-971021bf-576e-4a8c-aa78-8135021ae990 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:38.563323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-971021bf-576e-4a8c-aa78-8135021ae990 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:38.564557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-971021bf-576e-4a8c-aa78-8135021ae990 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:38.567490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-971021bf-576e-4a8c-aa78-8135021ae990 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:38.568626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-971021bf-576e-4a8c-aa78-8135021ae990 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:38.570492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-971021bf-576e-4a8c-aa78-8135021ae990 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:38.649870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:32:39.265185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6dc057b5-8f31-4eb6-b734-5fd79eb2b8a3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:39.278577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6dc057b5-8f31-4eb6-b734-5fd79eb2b8a3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:39.285116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6dc057b5-8f31-4eb6-b734-5fd79eb2b8a3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:39.286832 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6dc057b5-8f31-4eb6-b734-5fd79eb2b8a3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1362 microversion: 2.25 time: 0.883043 Sep 07 12:32:39.295504 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 525/1044] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:38 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1362 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:39.301011 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c1d1c14f-b908-48d9-a153-0157c8f5d1e4 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:39.301672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c1d1c14f-b908-48d9-a153-0157c8f5d1e4 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:39.315904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1d1c14f-b908-48d9-a153-0157c8f5d1e4 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:39.326453 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1d1c14f-b908-48d9-a153-0157c8f5d1e4 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:39.327425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1d1c14f-b908-48d9-a153-0157c8f5d1e4 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:39.328736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1d1c14f-b908-48d9-a153-0157c8f5d1e4 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:39.329556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1d1c14f-b908-48d9-a153-0157c8f5d1e4 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:39.330324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1d1c14f-b908-48d9-a153-0157c8f5d1e4 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:39.809742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-971021bf-576e-4a8c-aa78-8135021ae990 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:39.862264 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-971021bf-576e-4a8c-aa78-8135021ae990 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1542 microversion: 2.1 time: 1.350494 Sep 07 12:32:39.866723 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 520/1045] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:38 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1542 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:39.887726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1fb744a3-d887-4834-8cc9-5c811bcad680 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:39.894182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1fb744a3-d887-4834-8cc9-5c811bcad680 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:39.922497 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fb744a3-d887-4834-8cc9-5c811bcad680 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:39.925950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fb744a3-d887-4834-8cc9-5c811bcad680 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:39.929887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fb744a3-d887-4834-8cc9-5c811bcad680 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:39.932203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fb744a3-d887-4834-8cc9-5c811bcad680 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:39.938424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fb744a3-d887-4834-8cc9-5c811bcad680 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:39.939904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fb744a3-d887-4834-8cc9-5c811bcad680 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:40.330007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1fb744a3-d887-4834-8cc9-5c811bcad680 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:40.358294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1fb744a3-d887-4834-8cc9-5c811bcad680 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:40.365579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1fb744a3-d887-4834-8cc9-5c811bcad680 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:40.390295 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1fb744a3-d887-4834-8cc9-5c811bcad680 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 0.520378 Sep 07 12:32:40.401599 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 521/1046] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:39 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:40.411825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fc8844bb-3155-42ad-8a96-05b3b67d5d71 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:40.414361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fc8844bb-3155-42ad-8a96-05b3b67d5d71 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:40.437045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc8844bb-3155-42ad-8a96-05b3b67d5d71 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:40.438490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc8844bb-3155-42ad-8a96-05b3b67d5d71 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:40.439728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc8844bb-3155-42ad-8a96-05b3b67d5d71 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:40.441318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc8844bb-3155-42ad-8a96-05b3b67d5d71 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:40.442556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc8844bb-3155-42ad-8a96-05b3b67d5d71 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:40.443705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc8844bb-3155-42ad-8a96-05b3b67d5d71 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:40.736055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c1d1c14f-b908-48d9-a153-0157c8f5d1e4 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:40.784006 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c1d1c14f-b908-48d9-a153-0157c8f5d1e4 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1314 microversion: 2.1 time: 1.474698 Sep 07 12:32:40.790829 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 526/1047] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:39 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1314 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:40.835957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fc8844bb-3155-42ad-8a96-05b3b67d5d71 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7ad5e634ea41e3aed6caa5652e784e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6f7d9efc940449d014d41cf2f18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:40.851918 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fc8844bb-3155-42ad-8a96-05b3b67d5d71 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec" status: 200 len: 1371 microversion: 2.1 time: 0.448393 Sep 07 12:32:40.855054 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 522/1048] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:40 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec => generated 1371 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:40.868316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-98781856-0195-4695-ba13-d4dffb48b5cd req-7db1ff20-d169-4d3c-9a6a-dd12ed9a5fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5667e371-cd91-4e33-99ca-635189b98be7", "tag": "a98d5f3e-3d10-41a7-ae5b-f31024e7555a"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:40.890091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-98781856-0195-4695-ba13-d4dffb48b5cd req-7db1ff20-d169-4d3c-9a6a-dd12ed9a5fc1 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:40.893016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-98781856-0195-4695-ba13-d4dffb48b5cd req-7db1ff20-d169-4d3c-9a6a-dd12ed9a5fc1 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:40.893759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-98781856-0195-4695-ba13-d4dffb48b5cd req-7db1ff20-d169-4d3c-9a6a-dd12ed9a5fc1 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:40.928273 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-98781856-0195-4695-ba13-d4dffb48b5cd req-7db1ff20-d169-4d3c-9a6a-dd12ed9a5fc1 service nova] Creating event network-changed:a98d5f3e-3d10-41a7-ae5b-f31024e7555a for instance 5667e371-cd91-4e33-99ca-635189b98be7 on n-h2-852087-9 Sep 07 12:32:40.934383 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-98781856-0195-4695-ba13-d4dffb48b5cd req-7db1ff20-d169-4d3c-9a6a-dd12ed9a5fc1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077544 Sep 07 12:32:40.935628 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 523/1049] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:40.942343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-08223a34-c435-4077-89ca-af1b934d9aec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:40.947669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-08223a34-c435-4077-89ca-af1b934d9aec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:40.955291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08223a34-c435-4077-89ca-af1b934d9aec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:40.961137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08223a34-c435-4077-89ca-af1b934d9aec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:40.962089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08223a34-c435-4077-89ca-af1b934d9aec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:40.963215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08223a34-c435-4077-89ca-af1b934d9aec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:40.963917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08223a34-c435-4077-89ca-af1b934d9aec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:40.964557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08223a34-c435-4077-89ca-af1b934d9aec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:41.184948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fd9cfa01-a3a1-43de-843d-3c54cd667be5 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1641602445", "id": 1307264646, "os-flavor-access:is_public": "True"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:41.253667 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fd9cfa01-a3a1-43de-843d-3c54cd667be5 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.459186 Sep 07 12:32:41.257971 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 527/1050] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:32:40 2022] POST /compute/v2.1/flavors => generated 430 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:41.280257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1fe241ee-80a3-4b71-a993-d8ea6711f7b7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:41.299335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1fe241ee-80a3-4b71-a993-d8ea6711f7b7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:41.325951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fe241ee-80a3-4b71-a993-d8ea6711f7b7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:41.330627 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fe241ee-80a3-4b71-a993-d8ea6711f7b7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:41.332385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fe241ee-80a3-4b71-a993-d8ea6711f7b7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:41.341075 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fe241ee-80a3-4b71-a993-d8ea6711f7b7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:41.343315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fe241ee-80a3-4b71-a993-d8ea6711f7b7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:41.344429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fe241ee-80a3-4b71-a993-d8ea6711f7b7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:41.780530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-08223a34-c435-4077-89ca-af1b934d9aec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:41.795006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-08223a34-c435-4077-89ca-af1b934d9aec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:41.801173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-08223a34-c435-4077-89ca-af1b934d9aec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:41.802468 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-08223a34-c435-4077-89ca-af1b934d9aec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1557 microversion: 2.25 time: 0.864925 Sep 07 12:32:41.819797 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 524/1051] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:40 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1557 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:41.840278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-6a4c48b7-72d9-4147-98dd-1e484b591d5f req-669f80c8-e856-47f1-8253-89b298c37e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "128cc68c-e4de-4502-8e18-d84f25904060", "name": "network-vif-unplugged", "status": "completed", "tag": "45364459-d3da-4357-9b05-ec8cab358164"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:41.852471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6a4c48b7-72d9-4147-98dd-1e484b591d5f req-669f80c8-e856-47f1-8253-89b298c37e6a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:41.853218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6a4c48b7-72d9-4147-98dd-1e484b591d5f req-669f80c8-e856-47f1-8253-89b298c37e6a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:41.854110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6a4c48b7-72d9-4147-98dd-1e484b591d5f req-669f80c8-e856-47f1-8253-89b298c37e6a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:41.873974 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-6a4c48b7-72d9-4147-98dd-1e484b591d5f req-669f80c8-e856-47f1-8253-89b298c37e6a service nova] Creating event network-vif-unplugged:45364459-d3da-4357-9b05-ec8cab358164 for instance 128cc68c-e4de-4502-8e18-d84f25904060 on n-h2-852087-9 Sep 07 12:32:41.881421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-6a4c48b7-72d9-4147-98dd-1e484b591d5f req-669f80c8-e856-47f1-8253-89b298c37e6a service nova] Instance 128cc68c-e4de-4502-8e18-d84f25904060 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 12:32:41.906611 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-6a4c48b7-72d9-4147-98dd-1e484b591d5f req-669f80c8-e856-47f1-8253-89b298c37e6a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085289 Sep 07 12:32:41.907475 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 525/1052] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:41.915466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d1f5b56e-743a-49f6-8985-087857de471b tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:41.939297 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d1f5b56e-743a-49f6-8985-087857de471b tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1307264646" status: 202 len: 0 microversion: 2.1 time: 0.029301 Sep 07 12:32:41.945751 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 526/1053] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Sep 7 12:32:41 2022] DELETE /compute/v2.1/flavors/1307264646 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:32:41.955964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ed2cbde2-c3c8-4bbe-86aa-c01dac8d44cf tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:41.958324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ed2cbde2-c3c8-4bbe-86aa-c01dac8d44cf tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:41.967064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed2cbde2-c3c8-4bbe-86aa-c01dac8d44cf tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:41.968682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed2cbde2-c3c8-4bbe-86aa-c01dac8d44cf tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:41.969451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed2cbde2-c3c8-4bbe-86aa-c01dac8d44cf tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:41.972740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed2cbde2-c3c8-4bbe-86aa-c01dac8d44cf tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:41.973556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed2cbde2-c3c8-4bbe-86aa-c01dac8d44cf tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:41.974775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed2cbde2-c3c8-4bbe-86aa-c01dac8d44cf tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:42.255408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ed2cbde2-c3c8-4bbe-86aa-c01dac8d44cf tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:42.278632 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ed2cbde2-c3c8-4bbe-86aa-c01dac8d44cf tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:42.280166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ed2cbde2-c3c8-4bbe-86aa-c01dac8d44cf tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:42.283166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1fe241ee-80a3-4b71-a993-d8ea6711f7b7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:42.286513 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ed2cbde2-c3c8-4bbe-86aa-c01dac8d44cf tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 0.339242 Sep 07 12:32:42.287496 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 527/1054] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:41 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:42.292664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2150a2c9-94d0-4289-bfcd-8906a27aaeea tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:42.293634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2150a2c9-94d0-4289-bfcd-8906a27aaeea tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:42.299323 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1fe241ee-80a3-4b71-a993-d8ea6711f7b7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1542 microversion: 2.1 time: 1.030348 Sep 07 12:32:42.300786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2150a2c9-94d0-4289-bfcd-8906a27aaeea tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:42.301507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2150a2c9-94d0-4289-bfcd-8906a27aaeea tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:42.302145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2150a2c9-94d0-4289-bfcd-8906a27aaeea tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:42.303047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2150a2c9-94d0-4289-bfcd-8906a27aaeea tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:42.303697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2150a2c9-94d0-4289-bfcd-8906a27aaeea tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:42.304281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2150a2c9-94d0-4289-bfcd-8906a27aaeea tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:42.315439 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 528/1055] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:41 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1542 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:42.332360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0cd40047-da45-4188-9690-7c22f2515a4b tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:42.333877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0cd40047-da45-4188-9690-7c22f2515a4b tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:42.354866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cd40047-da45-4188-9690-7c22f2515a4b tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:42.356459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cd40047-da45-4188-9690-7c22f2515a4b tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:42.357825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cd40047-da45-4188-9690-7c22f2515a4b tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:42.358892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cd40047-da45-4188-9690-7c22f2515a4b tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:42.359586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cd40047-da45-4188-9690-7c22f2515a4b tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:42.360180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cd40047-da45-4188-9690-7c22f2515a4b tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:42.574638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2150a2c9-94d0-4289-bfcd-8906a27aaeea tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:42.584702 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2150a2c9-94d0-4289-bfcd-8906a27aaeea tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1314 microversion: 2.1 time: 0.295883 Sep 07 12:32:42.604041 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 528/1056] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:42 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:42.621541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f74a4e4d-590e-4a1a-ba73-58c333cda1c9 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:42.622258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f74a4e4d-590e-4a1a-ba73-58c333cda1c9 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:42.629716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-0cd40047-da45-4188-9690-7c22f2515a4b tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lazy-loading 'services' on Instance uuid 81fe7509-9012-4fcc-9f06-26693494f535 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:32:42.630675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f74a4e4d-590e-4a1a-ba73-58c333cda1c9 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:42.631405 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f74a4e4d-590e-4a1a-ba73-58c333cda1c9 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:42.631930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f74a4e4d-590e-4a1a-ba73-58c333cda1c9 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:42.633453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f74a4e4d-590e-4a1a-ba73-58c333cda1c9 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:42.634057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f74a4e4d-590e-4a1a-ba73-58c333cda1c9 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:42.634636 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f74a4e4d-590e-4a1a-ba73-58c333cda1c9 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:42.691062 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0cd40047-da45-4188-9690-7c22f2515a4b tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 2050 microversion: 2.25 time: 0.373637 Sep 07 12:32:42.692064 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 529/1057] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:42 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 2050 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:42.702293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b5c9ba86-a0a1-4999-be6b-e78f453d301d tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:42.743939 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b5c9ba86-a0a1-4999-be6b-e78f453d301d tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049771 Sep 07 12:32:42.783984 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 530/1058] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:32:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:42.805137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-82a95d17-be76-4585-b360-d050178d07b4 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:42.806528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-82a95d17-be76-4585-b360-d050178d07b4 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:42.833131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a95d17-be76-4585-b360-d050178d07b4 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:42.833886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a95d17-be76-4585-b360-d050178d07b4 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:42.834494 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a95d17-be76-4585-b360-d050178d07b4 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:42.835368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a95d17-be76-4585-b360-d050178d07b4 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:42.835948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a95d17-be76-4585-b360-d050178d07b4 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:42.836491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a95d17-be76-4585-b360-d050178d07b4 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:42.948677 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f74a4e4d-590e-4a1a-ba73-58c333cda1c9 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7ad5e634ea41e3aed6caa5652e784e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6f7d9efc940449d014d41cf2f18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:42.962483 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f74a4e4d-590e-4a1a-ba73-58c333cda1c9 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec" status: 200 len: 1371 microversion: 2.1 time: 0.356792 Sep 07 12:32:42.963974 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 529/1059] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:42 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec => generated 1371 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:42.972366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-14283336-b49a-43d0-be3b-b11eaeeb5fa7 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2032539592", "id": 253132236, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:42.999926 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-14283336-b49a-43d0-be3b-b11eaeeb5fa7 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.031634 Sep 07 12:32:43.001118 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 530/1060] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:32:42 2022] POST /compute/v2.1/flavors => generated 414 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:43.031491 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-820aba78-6976-4150-948f-e962273df389 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:43.138195 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-820aba78-6976-4150-948f-e962273df389 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.102344 Sep 07 12:32:43.138195 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 531/1061] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:32:43 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:43.151102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-96ba7af6-7a8a-4bd8-a3db-7afab325baf7 req-e00593d5-d619-4f9e-a7e3-3d7de2d554c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9916ff29-8e9b-41f7-bbde-3f987cd0c9ec", "tag": "7120d1ee-a3b5-4407-ba59-4de91da3dd76"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:43.185471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-96ba7af6-7a8a-4bd8-a3db-7afab325baf7 req-e00593d5-d619-4f9e-a7e3-3d7de2d554c8 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:43.186302 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-96ba7af6-7a8a-4bd8-a3db-7afab325baf7 req-e00593d5-d619-4f9e-a7e3-3d7de2d554c8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:43.187066 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-96ba7af6-7a8a-4bd8-a3db-7afab325baf7 req-e00593d5-d619-4f9e-a7e3-3d7de2d554c8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:43.243588 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-96ba7af6-7a8a-4bd8-a3db-7afab325baf7 req-e00593d5-d619-4f9e-a7e3-3d7de2d554c8 service nova] Creating event network-changed:7120d1ee-a3b5-4407-ba59-4de91da3dd76 for instance 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec on n-h1-852087-9 Sep 07 12:32:43.253005 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-96ba7af6-7a8a-4bd8-a3db-7afab325baf7 req-e00593d5-d619-4f9e-a7e3-3d7de2d554c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117905 Sep 07 12:32:43.254075 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 532/1062] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:43.264932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a0f5d51e-a22d-46c8-9865-90d238f8761e tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:43.318397 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a0f5d51e-a22d-46c8-9865-90d238f8761e tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/253132236" status: 202 len: 0 microversion: 2.1 time: 0.061402 Sep 07 12:32:43.324741 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 533/1063] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Sep 7 12:32:43 2022] DELETE /compute/v2.1/flavors/253132236 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:32:43.334752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d9405398-0991-464f-b0f5-8650c0d564d5 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:43.336430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d9405398-0991-464f-b0f5-8650c0d564d5 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:43.362832 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9405398-0991-464f-b0f5-8650c0d564d5 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:43.363873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9405398-0991-464f-b0f5-8650c0d564d5 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:43.364515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9405398-0991-464f-b0f5-8650c0d564d5 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:43.365662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9405398-0991-464f-b0f5-8650c0d564d5 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:43.369063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9405398-0991-464f-b0f5-8650c0d564d5 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:43.369063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9405398-0991-464f-b0f5-8650c0d564d5 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:43.392608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-82a95d17-be76-4585-b360-d050178d07b4 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lazy-loading 'services' on Instance uuid 81fe7509-9012-4fcc-9f06-26693494f535 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:32:43.416123 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-82a95d17-be76-4585-b360-d050178d07b4 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 2050 microversion: 2.25 time: 0.630063 Sep 07 12:32:43.422344 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 531/1064] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:42 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 2050 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:43.443686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7f3ef1a8-233b-4888-a30f-eebe051b0208 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:43.504003 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7f3ef1a8-233b-4888-a30f-eebe051b0208 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.079644 Sep 07 12:32:43.520043 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 532/1065] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:32:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:43.529717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0ca27250-0e42-4126-a8f3-d205ad8b6442 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:43.530647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0ca27250-0e42-4126-a8f3-d205ad8b6442 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:43.538171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ca27250-0e42-4126-a8f3-d205ad8b6442 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:43.539008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ca27250-0e42-4126-a8f3-d205ad8b6442 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:43.539651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ca27250-0e42-4126-a8f3-d205ad8b6442 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:43.540714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ca27250-0e42-4126-a8f3-d205ad8b6442 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:43.541428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ca27250-0e42-4126-a8f3-d205ad8b6442 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:43.542183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ca27250-0e42-4126-a8f3-d205ad8b6442 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:43.737900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d9405398-0991-464f-b0f5-8650c0d564d5 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:43.766790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d9405398-0991-464f-b0f5-8650c0d564d5 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:43.768348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d9405398-0991-464f-b0f5-8650c0d564d5 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:43.802915 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d9405398-0991-464f-b0f5-8650c0d564d5 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 0.475087 Sep 07 12:32:43.806749 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 534/1066] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:43 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:43.819586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c9a2f820-2035-49c7-85cb-b98251525572 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:43.856145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9a2f820-2035-49c7-85cb-b98251525572 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:43.857240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9a2f820-2035-49c7-85cb-b98251525572 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:43.858720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9a2f820-2035-49c7-85cb-b98251525572 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:43.860392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9a2f820-2035-49c7-85cb-b98251525572 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:43.861238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9a2f820-2035-49c7-85cb-b98251525572 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:43.862173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9a2f820-2035-49c7-85cb-b98251525572 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:43.929064 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c9a2f820-2035-49c7-85cb-b98251525572 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.119097 Sep 07 12:32:43.930983 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 535/1067] 10.222.0.16 () {60 vars in 1217 bytes} [Wed Sep 7 12:32:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:32:43.940977 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-23b881e9-72fb-460f-b593-011434d91b44 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:43.942157 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-23b881e9-72fb-460f-b593-011434d91b44 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:43.956020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23b881e9-72fb-460f-b593-011434d91b44 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:43.956897 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23b881e9-72fb-460f-b593-011434d91b44 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:43.957661 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23b881e9-72fb-460f-b593-011434d91b44 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:43.959865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23b881e9-72fb-460f-b593-011434d91b44 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:43.960235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23b881e9-72fb-460f-b593-011434d91b44 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:43.961363 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23b881e9-72fb-460f-b593-011434d91b44 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:44.025456 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0ca27250-0e42-4126-a8f3-d205ad8b6442 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:44.041736 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0ca27250-0e42-4126-a8f3-d205ad8b6442 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1542 microversion: 2.1 time: 0.519948 Sep 07 12:32:44.046426 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 533/1068] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:43 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1542 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:44.064063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b394fa29-a89a-473d-baf2-01cfe3e113ab tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1549520774", "id": 741126122, "os-flavor-access:is_public": "True"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:44.105118 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b394fa29-a89a-473d-baf2-01cfe3e113ab tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.056592 Sep 07 12:32:44.112404 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 534/1069] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:32:44 2022] POST /compute/v2.1/flavors => generated 426 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:44.119063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9124fde1-07a9-4cb4-ae44-fdd2be98e673 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:44.130137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9124fde1-07a9-4cb4-ae44-fdd2be98e673 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:44.144776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9124fde1-07a9-4cb4-ae44-fdd2be98e673 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:44.145337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9124fde1-07a9-4cb4-ae44-fdd2be98e673 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:44.145819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9124fde1-07a9-4cb4-ae44-fdd2be98e673 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:44.146636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9124fde1-07a9-4cb4-ae44-fdd2be98e673 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:44.147136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9124fde1-07a9-4cb4-ae44-fdd2be98e673 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:44.147863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9124fde1-07a9-4cb4-ae44-fdd2be98e673 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:44.356371 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-23b881e9-72fb-460f-b593-011434d91b44 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1811 microversion: 2.1 time: 0.423447 Sep 07 12:32:44.379130 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 536/1070] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:43 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1811 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:44.384711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a971fb82-1652-4413-b6d5-58963c67b5cb tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:44.385310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a971fb82-1652-4413-b6d5-58963c67b5cb tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:44.406475 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a971fb82-1652-4413-b6d5-58963c67b5cb tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:44.407024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a971fb82-1652-4413-b6d5-58963c67b5cb tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:44.407288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a971fb82-1652-4413-b6d5-58963c67b5cb tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:44.408030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a971fb82-1652-4413-b6d5-58963c67b5cb tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:44.408490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a971fb82-1652-4413-b6d5-58963c67b5cb tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:44.408916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a971fb82-1652-4413-b6d5-58963c67b5cb tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:44.505812 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a971fb82-1652-4413-b6d5-58963c67b5cb tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535/action" status: 202 len: 0 microversion: 2.25 time: 0.123432 Sep 07 12:32:44.508239 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 537/1071] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Sep 7 12:32:44 2022] POST /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:32:44.515209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c2f9b4a0-211c-48b4-95d0-36af7aacecad tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:44.520144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c2f9b4a0-211c-48b4-95d0-36af7aacecad tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:44.537783 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2f9b4a0-211c-48b4-95d0-36af7aacecad tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:44.540792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2f9b4a0-211c-48b4-95d0-36af7aacecad tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:44.544343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2f9b4a0-211c-48b4-95d0-36af7aacecad tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:44.551339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2f9b4a0-211c-48b4-95d0-36af7aacecad tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:44.551339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2f9b4a0-211c-48b4-95d0-36af7aacecad tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:44.552789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2f9b4a0-211c-48b4-95d0-36af7aacecad tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:44.561020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9124fde1-07a9-4cb4-ae44-fdd2be98e673 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:44.568559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:32:44.576421 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9124fde1-07a9-4cb4-ae44-fdd2be98e673 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1314 microversion: 2.1 time: 0.462374 Sep 07 12:32:44.577793 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 535/1072] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:44 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:44.584279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a418cc6d-c157-4fe8-802a-c7633a0eae7c tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:44.610602 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a418cc6d-c157-4fe8-802a-c7633a0eae7c tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/741126122" status: 202 len: 0 microversion: 2.1 time: 0.031473 Sep 07 12:32:44.614923 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 536/1073] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Sep 7 12:32:44 2022] DELETE /compute/v2.1/flavors/741126122 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:32:44.620270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-20cc882d-1d8b-47f5-a0a3-0a5a07934aaa tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:44.626197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20cc882d-1d8b-47f5-a0a3-0a5a07934aaa tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:44.627500 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20cc882d-1d8b-47f5-a0a3-0a5a07934aaa tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:44.628240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20cc882d-1d8b-47f5-a0a3-0a5a07934aaa tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:44.629461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20cc882d-1d8b-47f5-a0a3-0a5a07934aaa tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:44.630195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20cc882d-1d8b-47f5-a0a3-0a5a07934aaa tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:44.630796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20cc882d-1d8b-47f5-a0a3-0a5a07934aaa tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:44.683060 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-20cc882d-1d8b-47f5-a0a3-0a5a07934aaa tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.068353 Sep 07 12:32:44.685071 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 537/1074] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Sep 7 12:32:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:44.727069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-89d71d9c-d0ad-4315-8eaf-c3da4f625911 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:44.733547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-89d71d9c-d0ad-4315-8eaf-c3da4f625911 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:44.771998 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89d71d9c-d0ad-4315-8eaf-c3da4f625911 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:44.777940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89d71d9c-d0ad-4315-8eaf-c3da4f625911 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:44.778686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89d71d9c-d0ad-4315-8eaf-c3da4f625911 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:44.785067 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89d71d9c-d0ad-4315-8eaf-c3da4f625911 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:44.787091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89d71d9c-d0ad-4315-8eaf-c3da4f625911 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:44.793919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89d71d9c-d0ad-4315-8eaf-c3da4f625911 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:45.195238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c2f9b4a0-211c-48b4-95d0-36af7aacecad tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7ad5e634ea41e3aed6caa5652e784e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6f7d9efc940449d014d41cf2f18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:45.206776 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c2f9b4a0-211c-48b4-95d0-36af7aacecad tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec" status: 200 len: 1371 microversion: 2.1 time: 0.696549 Sep 07 12:32:45.213350 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 538/1075] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:44 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec => generated 1371 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:45.219701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-adcdc225-7550-4bb2-bf6c-a10ee6ef247d tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:45.275332 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-adcdc225-7550-4bb2-bf6c-a10ee6ef247d tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060341 Sep 07 12:32:45.275946 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 539/1076] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:32:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:45.281445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-746ef379-3e92-46f6-92ec-752ff25c8e10 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:45.282105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-746ef379-3e92-46f6-92ec-752ff25c8e10 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:45.303821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-746ef379-3e92-46f6-92ec-752ff25c8e10 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:45.307303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-746ef379-3e92-46f6-92ec-752ff25c8e10 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:45.308130 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-746ef379-3e92-46f6-92ec-752ff25c8e10 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:45.309226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-746ef379-3e92-46f6-92ec-752ff25c8e10 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:45.309962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-746ef379-3e92-46f6-92ec-752ff25c8e10 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:45.310617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-746ef379-3e92-46f6-92ec-752ff25c8e10 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:45.824330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-89d71d9c-d0ad-4315-8eaf-c3da4f625911 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lazy-loading 'services' on Instance uuid 81fe7509-9012-4fcc-9f06-26693494f535 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:32:45.874216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-746ef379-3e92-46f6-92ec-752ff25c8e10 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:45.877769 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-89d71d9c-d0ad-4315-8eaf-c3da4f625911 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 2055 microversion: 2.25 time: 1.166307 Sep 07 12:32:45.880469 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 538/1077] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:44 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 2055 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:45.889182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-746ef379-3e92-46f6-92ec-752ff25c8e10 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:45.891139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-746ef379-3e92-46f6-92ec-752ff25c8e10 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:45.909050 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-746ef379-3e92-46f6-92ec-752ff25c8e10 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 0.631839 Sep 07 12:32:45.912407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bcaa8866-c8d6-4477-85f5-c579c2cb9baf tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:45.914596 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 540/1078] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:45 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:45.925222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bcaa8866-c8d6-4477-85f5-c579c2cb9baf tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:45.940850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcaa8866-c8d6-4477-85f5-c579c2cb9baf tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:45.943466 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcaa8866-c8d6-4477-85f5-c579c2cb9baf tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:45.944112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-731fd47e-4e8d-4b66-8a5f-9d61b8620963 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-818367166", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:45.944955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcaa8866-c8d6-4477-85f5-c579c2cb9baf tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:45.945925 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcaa8866-c8d6-4477-85f5-c579c2cb9baf tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:45.946570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcaa8866-c8d6-4477-85f5-c579c2cb9baf tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:45.947285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcaa8866-c8d6-4477-85f5-c579c2cb9baf tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:46.000137 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-731fd47e-4e8d-4b66-8a5f-9d61b8620963 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.083796 Sep 07 12:32:46.001422 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 541/1079] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:32:45 2022] POST /compute/v2.1/flavors => generated 506 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:46.019001 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f9dce788-1597-4a88-91ff-41fb48462d3e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:46.019825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f9dce788-1597-4a88-91ff-41fb48462d3e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:46.028943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9dce788-1597-4a88-91ff-41fb48462d3e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:46.029252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9dce788-1597-4a88-91ff-41fb48462d3e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:46.029476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9dce788-1597-4a88-91ff-41fb48462d3e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:46.030272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9dce788-1597-4a88-91ff-41fb48462d3e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:46.030746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9dce788-1597-4a88-91ff-41fb48462d3e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:46.031243 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9dce788-1597-4a88-91ff-41fb48462d3e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:46.589663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bcaa8866-c8d6-4477-85f5-c579c2cb9baf tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:46.592232 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:32:46.612776 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bcaa8866-c8d6-4477-85f5-c579c2cb9baf tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1474 microversion: 2.1 time: 0.728777 Sep 07 12:32:46.613416 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 539/1080] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:45 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1474 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:46.631119 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8faabb2a-20ed-49b0-b2eb-55f06a7a45ff tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:46.675470 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8faabb2a-20ed-49b0-b2eb-55f06a7a45ff tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/3fb7cda8-0e16-4781-9eeb-d8e65dce007f" status: 202 len: 0 microversion: 2.1 time: 0.060373 Sep 07 12:32:46.682489 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 540/1081] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:32:46 2022] DELETE /compute/v2.1/flavors/3fb7cda8-0e16-4781-9eeb-d8e65dce007f => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:32:46.692842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a896bf14-ab74-485e-8b54-3416da7914ec tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:46.704759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a896bf14-ab74-485e-8b54-3416da7914ec tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:46.705024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f9dce788-1597-4a88-91ff-41fb48462d3e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:46.728699 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a896bf14-ab74-485e-8b54-3416da7914ec tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:46.729650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a896bf14-ab74-485e-8b54-3416da7914ec tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:46.730736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a896bf14-ab74-485e-8b54-3416da7914ec tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:46.732971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a896bf14-ab74-485e-8b54-3416da7914ec tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:46.734084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a896bf14-ab74-485e-8b54-3416da7914ec tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:46.735258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a896bf14-ab74-485e-8b54-3416da7914ec tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:46.738347 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f9dce788-1597-4a88-91ff-41fb48462d3e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1314 microversion: 2.1 time: 0.734928 Sep 07 12:32:46.743555 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 542/1082] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:46 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1314 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:46.752938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5eaaf2e5-efeb-4d03-974d-00d948147322 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:46.766513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=6,nova_api:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:32:46.798618 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5eaaf2e5-efeb-4d03-974d-00d948147322 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052925 Sep 07 12:32:46.814818 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 543/1083] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:32:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:46.845729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-735a84c5-8c09-4d7d-af32-bac5a4f7959b tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-129882053", "id": "229bc0ab-a194-454e-a9ce-d9079ffade92", "os-flavor-access:is_public": "True"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:46.884630 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-735a84c5-8c09-4d7d-af32-bac5a4f7959b tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.044522 Sep 07 12:32:46.886147 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 544/1084] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:32:46 2022] POST /compute/v2.1/flavors => generated 506 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:32:46.916117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e898db25-e489-43a8-b954-1d4ceb45fc1b tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:46.947845 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e898db25-e489-43a8-b954-1d4ceb45fc1b tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/229bc0ab-a194-454e-a9ce-d9079ffade92" status: 202 len: 0 microversion: 2.1 time: 0.043976 Sep 07 12:32:46.952302 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 545/1085] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:32:46 2022] DELETE /compute/v2.1/flavors/229bc0ab-a194-454e-a9ce-d9079ffade92 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:32:46.959301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-577515d7-11fb-4b11-9138-b6c3fcc75ccd tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:46.961070 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-577515d7-11fb-4b11-9138-b6c3fcc75ccd tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:46.976932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-577515d7-11fb-4b11-9138-b6c3fcc75ccd tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:46.977603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-577515d7-11fb-4b11-9138-b6c3fcc75ccd tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:46.978403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-577515d7-11fb-4b11-9138-b6c3fcc75ccd tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:46.998286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-577515d7-11fb-4b11-9138-b6c3fcc75ccd tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:46.999191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-577515d7-11fb-4b11-9138-b6c3fcc75ccd tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:47.000003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-577515d7-11fb-4b11-9138-b6c3fcc75ccd tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:47.132775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a896bf14-ab74-485e-8b54-3416da7914ec tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7ad5e634ea41e3aed6caa5652e784e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6f7d9efc940449d014d41cf2f18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:47.145858 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a896bf14-ab74-485e-8b54-3416da7914ec tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec" status: 200 len: 1371 microversion: 2.1 time: 0.467011 Sep 07 12:32:47.146619 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 541/1086] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:46 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec => generated 1371 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:47.156750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-37e232ac-1f7c-4861-a1c1-e19df67e4bd6 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:47.196645 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-37e232ac-1f7c-4861-a1c1-e19df67e4bd6 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047525 Sep 07 12:32:47.210137 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 542/1087] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:32:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:47.234864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b42dfe56-1aa2-42bc-bfba-c78358c5fe2c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:47.236088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b42dfe56-1aa2-42bc-bfba-c78358c5fe2c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:47.246740 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b42dfe56-1aa2-42bc-bfba-c78358c5fe2c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:47.247856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b42dfe56-1aa2-42bc-bfba-c78358c5fe2c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:47.248805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b42dfe56-1aa2-42bc-bfba-c78358c5fe2c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:47.254519 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b42dfe56-1aa2-42bc-bfba-c78358c5fe2c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:47.255455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b42dfe56-1aa2-42bc-bfba-c78358c5fe2c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:47.256487 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b42dfe56-1aa2-42bc-bfba-c78358c5fe2c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:47.258330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-577515d7-11fb-4b11-9138-b6c3fcc75ccd tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lazy-loading 'services' on Instance uuid 81fe7509-9012-4fcc-9f06-26693494f535 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:32:47.287074 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-577515d7-11fb-4b11-9138-b6c3fcc75ccd tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 2035 microversion: 2.25 time: 0.335441 Sep 07 12:32:47.288845 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 546/1088] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:46 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 2035 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:47.296671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2b9873db-e891-4372-93db-a84101694c3b tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2082535036", "id": 1805761755, "os-flavor-access:is_public": "True"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:47.330978 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2b9873db-e891-4372-93db-a84101694c3b tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.040253 Sep 07 12:32:47.332142 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 547/1089] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:32:47 2022] POST /compute/v2.1/flavors => generated 414 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:47.338559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f384bf81-ac58-43b5-bcf9-3db1449f93c6 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852087-9", "block_migration": "auto"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:47.341358 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f384bf81-ac58-43b5-bcf9-3db1449f93c6 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:47.350151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f384bf81-ac58-43b5-bcf9-3db1449f93c6 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:47.350758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f384bf81-ac58-43b5-bcf9-3db1449f93c6 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:47.351476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f384bf81-ac58-43b5-bcf9-3db1449f93c6 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:47.352362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f384bf81-ac58-43b5-bcf9-3db1449f93c6 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:47.352910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f384bf81-ac58-43b5-bcf9-3db1449f93c6 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:47.353439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f384bf81-ac58-43b5-bcf9-3db1449f93c6 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:47.391916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-f384bf81-ac58-43b5-bcf9-3db1449f93c6 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lazy-loading 'flavor' on Instance uuid 81fe7509-9012-4fcc-9f06-26693494f535 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:32:47.411519 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b42dfe56-1aa2-42bc-bfba-c78358c5fe2c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:47.411851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f384bf81-ac58-43b5-bcf9-3db1449f93c6 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Going to try to live migrate instance to n-h2-852087-9 {{(pid=122433) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 07 12:32:47.422510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b42dfe56-1aa2-42bc-bfba-c78358c5fe2c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:47.424087 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b42dfe56-1aa2-42bc-bfba-c78358c5fe2c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:47.430823 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b42dfe56-1aa2-42bc-bfba-c78358c5fe2c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1531 microversion: 2.91 time: 0.218917 Sep 07 12:32:47.431434 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 543/1090] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:47 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1531 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:47.446349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3a413a85-c012-471e-b6ae-e0355d174637 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:47.446349 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3a413a85-c012-471e-b6ae-e0355d174637 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1805761755" status: 200 len: 414 microversion: 2.1 time: 0.012995 Sep 07 12:32:47.446972 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 544/1091] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Sep 7 12:32:47 2022] GET /compute/v2.1/flavors/1805761755 => generated 414 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:47.693557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-995c398c-1fa8-414d-b027-ffff1c1cced7 tempest-FlavorsAdminTestJSON-1431161782 tempest-FlavorsAdminTestJSON-1431161782-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:47.726784 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-995c398c-1fa8-414d-b027-ffff1c1cced7 tempest-FlavorsAdminTestJSON-1431161782 tempest-FlavorsAdminTestJSON-1431161782-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.252307 Sep 07 12:32:47.730284 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 545/1092] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:32:47 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:32:47.748743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ee63f096-57bf-485c-83b5-cc68f77095ae tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:47.750396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ee63f096-57bf-485c-83b5-cc68f77095ae tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:47.780305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee63f096-57bf-485c-83b5-cc68f77095ae tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:47.781189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee63f096-57bf-485c-83b5-cc68f77095ae tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:47.782008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee63f096-57bf-485c-83b5-cc68f77095ae tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:47.783367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee63f096-57bf-485c-83b5-cc68f77095ae tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:47.784284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee63f096-57bf-485c-83b5-cc68f77095ae tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:47.785053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee63f096-57bf-485c-83b5-cc68f77095ae tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:47.905765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-ee63f096-57bf-485c-83b5-cc68f77095ae tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lazy-loading 'services' on Instance uuid b8038c3c-8b64-4a94-84ad-41654d2d53ca {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:32:47.924625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=2,nova_api:DELETE=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:32:47.930686 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ee63f096-57bf-485c-83b5-cc68f77095ae tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1936 microversion: 2.91 time: 0.197369 Sep 07 12:32:47.932255 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 546/1093] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:47 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1936 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:47.937767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-69677d54-5367-4859-97df-418bd69c2b66 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:47.938665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-69677d54-5367-4859-97df-418bd69c2b66 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:47.948050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69677d54-5367-4859-97df-418bd69c2b66 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:47.950042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69677d54-5367-4859-97df-418bd69c2b66 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:47.950731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69677d54-5367-4859-97df-418bd69c2b66 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:47.951664 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69677d54-5367-4859-97df-418bd69c2b66 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:47.952680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69677d54-5367-4859-97df-418bd69c2b66 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:47.953357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69677d54-5367-4859-97df-418bd69c2b66 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:48.164451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-69677d54-5367-4859-97df-418bd69c2b66 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:48.174643 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-69677d54-5367-4859-97df-418bd69c2b66 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1474 microversion: 2.1 time: 0.241007 Sep 07 12:32:48.191643 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 547/1094] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:47 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1474 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:48.191643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5d65ff72-4b61-47d3-add5-fe895beb873f tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:48.210439 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5d65ff72-4b61-47d3-add5-fe895beb873f tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1805761755" status: 202 len: 0 microversion: 2.1 time: 0.029158 Sep 07 12:32:48.211532 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 548/1095] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Sep 7 12:32:48 2022] DELETE /compute/v2.1/flavors/1805761755 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:32:48.219063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5f6240b6-ba99-42c3-98b3-c8b45269d0ac tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:48.220289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5f6240b6-ba99-42c3-98b3-c8b45269d0ac tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:48.229461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f6240b6-ba99-42c3-98b3-c8b45269d0ac tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:48.230096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f6240b6-ba99-42c3-98b3-c8b45269d0ac tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:48.230977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f6240b6-ba99-42c3-98b3-c8b45269d0ac tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:48.232071 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f6240b6-ba99-42c3-98b3-c8b45269d0ac tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:48.232673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f6240b6-ba99-42c3-98b3-c8b45269d0ac tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:48.233293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f6240b6-ba99-42c3-98b3-c8b45269d0ac tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:48.452707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5f6240b6-ba99-42c3-98b3-c8b45269d0ac tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:48.468324 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5f6240b6-ba99-42c3-98b3-c8b45269d0ac tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1314 microversion: 2.1 time: 0.255373 Sep 07 12:32:48.476746 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 549/1096] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:48 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:48.478046 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1ac2dbc0-0a26-4e88-95d3-457f8e02f181 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:48.478941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1ac2dbc0-0a26-4e88-95d3-457f8e02f181 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:48.489360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ac2dbc0-0a26-4e88-95d3-457f8e02f181 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:48.490206 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ac2dbc0-0a26-4e88-95d3-457f8e02f181 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:48.491010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ac2dbc0-0a26-4e88-95d3-457f8e02f181 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:48.492093 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ac2dbc0-0a26-4e88-95d3-457f8e02f181 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:48.492825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ac2dbc0-0a26-4e88-95d3-457f8e02f181 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:48.493581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ac2dbc0-0a26-4e88-95d3-457f8e02f181 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:48.545145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-1ac2dbc0-0a26-4e88-95d3-457f8e02f181 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lazy-loading 'flavor' on Instance uuid b8038c3c-8b64-4a94-84ad-41654d2d53ca {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:32:48.912733 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1ac2dbc0-0a26-4e88-95d3-457f8e02f181 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "POST /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca/action" status: 202 len: 0 microversion: 2.91 time: 0.441246 Sep 07 12:32:48.913690 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 550/1097] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Sep 7 12:32:48 2022] POST /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:32:48.924098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-066a556f-3f43-4c88-bbe4-b255f8b387a5 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:48.925174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-066a556f-3f43-4c88-bbe4-b255f8b387a5 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:48.933245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-066a556f-3f43-4c88-bbe4-b255f8b387a5 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:48.934069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-066a556f-3f43-4c88-bbe4-b255f8b387a5 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:48.934679 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-066a556f-3f43-4c88-bbe4-b255f8b387a5 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:48.935857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-066a556f-3f43-4c88-bbe4-b255f8b387a5 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:48.936418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-066a556f-3f43-4c88-bbe4-b255f8b387a5 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:48.936857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-066a556f-3f43-4c88-bbe4-b255f8b387a5 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:49.161716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-066a556f-3f43-4c88-bbe4-b255f8b387a5 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7ad5e634ea41e3aed6caa5652e784e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6f7d9efc940449d014d41cf2f18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:49.187976 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-066a556f-3f43-4c88-bbe4-b255f8b387a5 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec" status: 200 len: 1371 microversion: 2.1 time: 0.269670 Sep 07 12:32:49.203748 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 551/1098] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:48 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec => generated 1371 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:49.221685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-50c90919-4f9a-41f0-a1ae-75d5bf227d28 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:49.287095 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-50c90919-4f9a-41f0-a1ae-75d5bf227d28 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.080514 Sep 07 12:32:49.288642 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 552/1099] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:32:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:49.300212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1278209f-3dd0-4535-b06c-e2756538adad tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:49.301559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1278209f-3dd0-4535-b06c-e2756538adad tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:49.329563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1278209f-3dd0-4535-b06c-e2756538adad tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:49.329563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1278209f-3dd0-4535-b06c-e2756538adad tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:49.330393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1278209f-3dd0-4535-b06c-e2756538adad tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:49.337245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1278209f-3dd0-4535-b06c-e2756538adad tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:49.337245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1278209f-3dd0-4535-b06c-e2756538adad tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:49.337245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1278209f-3dd0-4535-b06c-e2756538adad tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:49.552941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1278209f-3dd0-4535-b06c-e2756538adad tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:49.590833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1278209f-3dd0-4535-b06c-e2756538adad tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:49.597157 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1278209f-3dd0-4535-b06c-e2756538adad tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:49.615875 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1278209f-3dd0-4535-b06c-e2756538adad tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.320944 Sep 07 12:32:49.617810 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 553/1100] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:49 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:49.638113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4520872d-3378-41dc-990d-25c525551cfb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:49.642691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4520872d-3378-41dc-990d-25c525551cfb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:49.665164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4520872d-3378-41dc-990d-25c525551cfb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:49.666368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4520872d-3378-41dc-990d-25c525551cfb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:49.667593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4520872d-3378-41dc-990d-25c525551cfb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:49.669793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4520872d-3378-41dc-990d-25c525551cfb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:49.671100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4520872d-3378-41dc-990d-25c525551cfb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:49.673230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4520872d-3378-41dc-990d-25c525551cfb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:50.023569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4520872d-3378-41dc-990d-25c525551cfb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:50.034638 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4520872d-3378-41dc-990d-25c525551cfb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1471 microversion: 2.1 time: 0.414852 Sep 07 12:32:50.035649 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 554/1101] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:49 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1471 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:50.044238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9cb9b233-9bb6-43a7-ab3f-cff2a79e4a1b tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-244123846", "id": 418941419, "os-flavor-access:is_public": "False"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:50.076884 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9cb9b233-9bb6-43a7-ab3f-cff2a79e4a1b tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.039601 Sep 07 12:32:50.078081 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 555/1102] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:32:50 2022] POST /compute/v2.1/flavors => generated 426 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:50.089532 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2713baf4-9361-4993-9c93-b3f8eea58681 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:50.090456 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2713baf4-9361-4993-9c93-b3f8eea58681 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:50.101878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2713baf4-9361-4993-9c93-b3f8eea58681 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:50.102796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2713baf4-9361-4993-9c93-b3f8eea58681 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:50.103667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2713baf4-9361-4993-9c93-b3f8eea58681 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:50.104866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2713baf4-9361-4993-9c93-b3f8eea58681 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:50.105730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2713baf4-9361-4993-9c93-b3f8eea58681 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:50.106502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2713baf4-9361-4993-9c93-b3f8eea58681 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:50.372249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2713baf4-9361-4993-9c93-b3f8eea58681 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:50.387255 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2713baf4-9361-4993-9c93-b3f8eea58681 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1314 microversion: 2.1 time: 0.307260 Sep 07 12:32:50.388002 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 556/1103] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:50 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:50.397449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b4f2dbb1-de41-43f2-b276-a796ced7fe03 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e746707e-5337-41cc-ab63-601c8da6b9c8"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:50.401100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b4f2dbb1-de41-43f2-b276-a796ced7fe03 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:50.410148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4f2dbb1-de41-43f2-b276-a796ced7fe03 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:50.411113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4f2dbb1-de41-43f2-b276-a796ced7fe03 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:50.411625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4f2dbb1-de41-43f2-b276-a796ced7fe03 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:50.412576 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4f2dbb1-de41-43f2-b276-a796ced7fe03 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:50.414020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4f2dbb1-de41-43f2-b276-a796ced7fe03 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:50.414750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4f2dbb1-de41-43f2-b276-a796ced7fe03 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:50.444535 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f384bf81-ac58-43b5-bcf9-3db1449f93c6 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535/action" status: 202 len: 0 microversion: 2.25 time: 3.110925 Sep 07 12:32:50.445878 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 548/1104] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Sep 7 12:32:47 2022] POST /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535/action => generated 0 bytes in 3113 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:32:50.453142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f95128bb-9911-45c2-8ed4-2b8d84937584 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:50.453955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f95128bb-9911-45c2-8ed4-2b8d84937584 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:50.464520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f95128bb-9911-45c2-8ed4-2b8d84937584 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:50.465163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f95128bb-9911-45c2-8ed4-2b8d84937584 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:50.465867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f95128bb-9911-45c2-8ed4-2b8d84937584 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:50.466784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f95128bb-9911-45c2-8ed4-2b8d84937584 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:50.467339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f95128bb-9911-45c2-8ed4-2b8d84937584 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:50.467978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f95128bb-9911-45c2-8ed4-2b8d84937584 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:50.527074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f95128bb-9911-45c2-8ed4-2b8d84937584 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:50.527778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f95128bb-9911-45c2-8ed4-2b8d84937584 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:50.528480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f95128bb-9911-45c2-8ed4-2b8d84937584 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:50.529762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f95128bb-9911-45c2-8ed4-2b8d84937584 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:50.530553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f95128bb-9911-45c2-8ed4-2b8d84937584 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:50.531317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f95128bb-9911-45c2-8ed4-2b8d84937584 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:50.564651 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f95128bb-9911-45c2-8ed4-2b8d84937584 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Getting quotas for project 43a1115550de4c5185de7ca86bc17a63. Resources: {'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:32:50.571562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f95128bb-9911-45c2-8ed4-2b8d84937584 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Getting quotas for user 1b5c31587a37465a9becda30e417ed5b and project 43a1115550de4c5185de7ca86bc17a63. Resources: {'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:32:50.691729 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f95128bb-9911-45c2-8ed4-2b8d84937584 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "POST /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060/action" status: 202 len: 0 microversion: 2.1 time: 0.244213 Sep 07 12:32:50.692336 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 549/1105] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:32:50 2022] POST /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:32:50.698102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-52c14ded-a859-438a-ab44-f197853c7c6c tempest-FlavorsAdminTestJSON-1431161782 tempest-FlavorsAdminTestJSON-1431161782-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "418941419"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:50.711601 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-52c14ded-a859-438a-ab44-f197853c7c6c tempest-FlavorsAdminTestJSON-1431161782 tempest-FlavorsAdminTestJSON-1431161782-project] HTTP exception thrown: Flavor 418941419 could not be found. Sep 07 12:32:50.717189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-52c14ded-a859-438a-ab44-f197853c7c6c tempest-FlavorsAdminTestJSON-1431161782 tempest-FlavorsAdminTestJSON-1431161782-project] Request method failure captured: Sep 07 12:32:50.717189 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:32:50.717189 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:32:50.717189 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:32:50.717189 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:32:50.717189 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 106 Sep 07 12:32:50.717189 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:32:50.717189 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:32:50.717189 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:32:50.717189 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:32:50.717189 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI9mkXgF9iQQqByYdH5sL4Q6FLS1ChshYgEU_RwwX600daemHtCqEith4zzSziXGpY0uyjMLyhXCuc1fJ8oWfHJyW7YG3VNiBUY3rPsrjANWOo7VucYJCDI0Ipg3rUsvr_4X1TbGyQM1nCom_ap667RvKDE54X3C_dC5YhMMtsh5EqI Sep 07 12:32:50.717189 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:32:50.717189 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:32:50.717189 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:32:50.717189 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:32:50.717189 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:32:50.717189 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:32:50.717189 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: b37b1c9ba3e24528b5428867248a4c19 Sep 07 12:32:50.717189 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-FlavorsAdminTestJSON-1431161782 Sep 07 12:32:50.717189 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:32:50.717189 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:32:50.718928 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b37b1c9ba3e24528b5428867248a4c19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b37b1c9ba3e24528b5428867248a4c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b37b1c9ba3e24528b5428867248a4c19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b37b1c9ba3e24528b5428867248a4c19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:32:50.718928 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-FlavorsAdminTestJSON-1431161782 Sep 07 12:32:50.718928 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: b37b1c9ba3e24528b5428867248a4c19 Sep 07 12:32:50.718928 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1431161782 Sep 07 12:32:50.718928 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-FlavorsAdminTestJSON-1431161782-project Sep 07 12:32:50.718928 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:32:50.718928 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:32:50.718928 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5d6062fa59b04ec88ed72c56fe5e4c78 Sep 07 12:32:50.718928 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-FlavorsAdminTestJSON-1431161782-project Sep 07 12:32:50.718928 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:32:50.718928 n-d-852087-9 devstack@n-api.service[122433]: {"server": {"name": "test", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "418941419"}} Sep 07 12:32:50.718928 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:32:50.718928 n-d-852087-9 devstack@n-api.service[122433]: exception: Flavor 418941419 could not be found. Sep 07 12:32:50.719892 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f', 'flavorRef': '418941419'}}} Sep 07 12:32:50.719892 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:32:50.719892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:32:50.719892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 07 12:32:50.719892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 07 12:32:50.719892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 12:32:50.719892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 12:32:50.719892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:32:50.719892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:32:50.719892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 12:32:50.719892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 12:32:50.719892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 12:32:50.719892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:32:50.719892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 12:32:50.719892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 12:32:50.719892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 418941419 could not be found. Sep 07 12:32:50.719892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:32:50.719892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:32:50.719892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:32:50.719892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:32:50.725543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:32:50.725543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:32:50.725543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:32:50.725543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:32:50.725543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:32:50.725543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:32:50.725543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:32:50.725543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:32:50.725543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:32:50.725543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:32:50.725543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:32:50.725543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:32:50.725543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 07 12:32:50.725543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 07 12:32:50.725543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 07 12:32:50.725543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 418941419 could not be found. Sep 07 12:32:50.725543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:32:50.725543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:32:50.725543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:32:50.725543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:32:50.725543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:32:50.727203 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:32:50.727203 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:32:50.727203 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:32:50.727203 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 418941419 could not be found. Sep 07 12:32:50.727203 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:32:50.727203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-52c14ded-a859-438a-ab44-f197853c7c6c tempest-FlavorsAdminTestJSON-1431161782 tempest-FlavorsAdminTestJSON-1431161782-project] Returning 400 to user: Flavor 418941419 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:32:50.727203 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-52c14ded-a859-438a-ab44-f197853c7c6c tempest-FlavorsAdminTestJSON-1431161782 tempest-FlavorsAdminTestJSON-1431161782-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.026037 Sep 07 12:32:50.727203 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 550/1106] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:32:50 2022] POST /compute/v2.1/servers => generated 80 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 07 12:32:50.728112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-88212288-661c-4b27-a3b3-ae270900d47a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:50.729054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-88212288-661c-4b27-a3b3-ae270900d47a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:50.736284 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88212288-661c-4b27-a3b3-ae270900d47a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:50.736790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88212288-661c-4b27-a3b3-ae270900d47a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:50.737246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88212288-661c-4b27-a3b3-ae270900d47a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:50.738190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88212288-661c-4b27-a3b3-ae270900d47a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:50.738456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88212288-661c-4b27-a3b3-ae270900d47a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:50.738886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88212288-661c-4b27-a3b3-ae270900d47a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:50.962621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-88212288-661c-4b27-a3b3-ae270900d47a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7ad5e634ea41e3aed6caa5652e784e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6f7d9efc940449d014d41cf2f18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:50.975075 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-88212288-661c-4b27-a3b3-ae270900d47a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec" status: 200 len: 1371 microversion: 2.1 time: 0.252415 Sep 07 12:32:50.976301 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 551/1107] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:50 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec => generated 1371 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:50.985234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b7c59466-39e4-41a4-96bb-2ba7f8dc0c34 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:50.986618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b7c59466-39e4-41a4-96bb-2ba7f8dc0c34 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:50.998000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7c59466-39e4-41a4-96bb-2ba7f8dc0c34 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:50.998877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7c59466-39e4-41a4-96bb-2ba7f8dc0c34 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:50.999655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7c59466-39e4-41a4-96bb-2ba7f8dc0c34 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:51.001015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7c59466-39e4-41a4-96bb-2ba7f8dc0c34 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:51.001900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7c59466-39e4-41a4-96bb-2ba7f8dc0c34 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:51.002665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7c59466-39e4-41a4-96bb-2ba7f8dc0c34 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:51.286867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b7c59466-39e4-41a4-96bb-2ba7f8dc0c34 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:51.300544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b7c59466-39e4-41a4-96bb-2ba7f8dc0c34 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:51.302579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b7c59466-39e4-41a4-96bb-2ba7f8dc0c34 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:51.304990 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b7c59466-39e4-41a4-96bb-2ba7f8dc0c34 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1567 microversion: 2.25 time: 0.326928 Sep 07 12:32:51.305923 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 552/1108] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:50 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1567 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:51.315749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5e969b63-be36-4010-89a4-79d6df751833 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:51.316903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5e969b63-be36-4010-89a4-79d6df751833 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:51.330283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e969b63-be36-4010-89a4-79d6df751833 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:51.331592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e969b63-be36-4010-89a4-79d6df751833 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:51.333124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e969b63-be36-4010-89a4-79d6df751833 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:51.337454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e969b63-be36-4010-89a4-79d6df751833 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:51.338971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e969b63-be36-4010-89a4-79d6df751833 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:51.340073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e969b63-be36-4010-89a4-79d6df751833 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:51.493714 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5e969b63-be36-4010-89a4-79d6df751833 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:51.508581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5e969b63-be36-4010-89a4-79d6df751833 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:51.510820 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5e969b63-be36-4010-89a4-79d6df751833 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:51.519960 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5e969b63-be36-4010-89a4-79d6df751833 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.212084 Sep 07 12:32:51.520636 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 553/1109] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:51 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:51.525476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8e90cc8f-e0b5-4fda-bf68-e99f8cbbb686 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:51.526201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8e90cc8f-e0b5-4fda-bf68-e99f8cbbb686 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:51.533282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e90cc8f-e0b5-4fda-bf68-e99f8cbbb686 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:51.534137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e90cc8f-e0b5-4fda-bf68-e99f8cbbb686 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:51.534896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e90cc8f-e0b5-4fda-bf68-e99f8cbbb686 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:51.535831 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e90cc8f-e0b5-4fda-bf68-e99f8cbbb686 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:51.536497 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e90cc8f-e0b5-4fda-bf68-e99f8cbbb686 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:51.537172 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e90cc8f-e0b5-4fda-bf68-e99f8cbbb686 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:51.819448 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8e90cc8f-e0b5-4fda-bf68-e99f8cbbb686 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:51.832431 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8e90cc8f-e0b5-4fda-bf68-e99f8cbbb686 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1470 microversion: 2.1 time: 0.310544 Sep 07 12:32:51.833187 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 554/1110] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:51 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1470 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:51.847238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-20072236-a22b-4683-9231-9e9298b40dd1 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:51.882025 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-20072236-a22b-4683-9231-9e9298b40dd1 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/418941419" status: 202 len: 0 microversion: 2.1 time: 0.047174 Sep 07 12:32:51.882857 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 555/1111] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Sep 7 12:32:51 2022] DELETE /compute/v2.1/flavors/418941419 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:32:51.892717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5089f4c5-4c32-4ecc-924a-ffed2336afc4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1545ae2-46de-4ccf-bcc2-86d62580a2a9", "device": "/dev/xvdb"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:51.898303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5089f4c5-4c32-4ecc-924a-ffed2336afc4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:51.910432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5089f4c5-4c32-4ecc-924a-ffed2336afc4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:51.911335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5089f4c5-4c32-4ecc-924a-ffed2336afc4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:51.912138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5089f4c5-4c32-4ecc-924a-ffed2336afc4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:51.913507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5089f4c5-4c32-4ecc-924a-ffed2336afc4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:51.914369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5089f4c5-4c32-4ecc-924a-ffed2336afc4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:51.915190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5089f4c5-4c32-4ecc-924a-ffed2336afc4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:53.291124 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b4f2dbb1-de41-43f2-b276-a796ced7fe03 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "POST /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.901436 Sep 07 12:32:53.293688 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 557/1112] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Sep 7 12:32:50 2022] POST /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9/os-volume_attachments => generated 194 bytes in 2903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:53.298005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6174a2af-b744-4fb4-a4d0-27914d830d5c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:53.298817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6174a2af-b744-4fb4-a4d0-27914d830d5c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:53.307597 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6174a2af-b744-4fb4-a4d0-27914d830d5c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:53.308239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6174a2af-b744-4fb4-a4d0-27914d830d5c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:53.308746 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6174a2af-b744-4fb4-a4d0-27914d830d5c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:53.309753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6174a2af-b744-4fb4-a4d0-27914d830d5c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:53.310475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6174a2af-b744-4fb4-a4d0-27914d830d5c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:53.311223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6174a2af-b744-4fb4-a4d0-27914d830d5c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:53.468756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:32:53.500498 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6174a2af-b744-4fb4-a4d0-27914d830d5c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:53.500956 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5089f4c5-4c32-4ecc-924a-ffed2336afc4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "POST /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.615284 Sep 07 12:32:53.501833 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 556/1113] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Sep 7 12:32:51 2022] POST /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-volume_attachments => generated 194 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:53.511466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-e8827c63-0528-46c9-9bc4-979c88d9503a req-d7e40022-a9af-444b-adba-ed23051229c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "128cc68c-e4de-4502-8e18-d84f25904060", "name": "network-vif-plugged", "status": "completed", "tag": "45364459-d3da-4357-9b05-ec8cab358164"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:53.518979 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6174a2af-b744-4fb4-a4d0-27914d830d5c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1314 microversion: 2.1 time: 0.225421 Sep 07 12:32:53.532044 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 558/1114] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:53 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:53.532044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e2bc4e7c-d223-443f-a8a4-7910a248b0b9 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:53.532935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e8827c63-0528-46c9-9bc4-979c88d9503a req-d7e40022-a9af-444b-adba-ed23051229c8 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:53.532935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e8827c63-0528-46c9-9bc4-979c88d9503a req-d7e40022-a9af-444b-adba-ed23051229c8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:53.532935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e8827c63-0528-46c9-9bc4-979c88d9503a req-d7e40022-a9af-444b-adba-ed23051229c8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:53.552374 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-e8827c63-0528-46c9-9bc4-979c88d9503a req-d7e40022-a9af-444b-adba-ed23051229c8 service nova] Creating event network-vif-plugged:45364459-d3da-4357-9b05-ec8cab358164 for instance 128cc68c-e4de-4502-8e18-d84f25904060 on n-h2-852087-9 Sep 07 12:32:53.554217 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e2bc4e7c-d223-443f-a8a4-7910a248b0b9 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032481 Sep 07 12:32:53.556029 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 559/1115] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:32:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:53.561574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-e8827c63-0528-46c9-9bc4-979c88d9503a req-d7e40022-a9af-444b-adba-ed23051229c8 service nova] Instance 128cc68c-e4de-4502-8e18-d84f25904060 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 12:32:53.567782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-493d3c72-013a-4793-9e9f-64dfcbb26ce5 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:53.569667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-493d3c72-013a-4793-9e9f-64dfcbb26ce5 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:53.574339 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-e8827c63-0528-46c9-9bc4-979c88d9503a req-d7e40022-a9af-444b-adba-ed23051229c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070200 Sep 07 12:32:53.576035 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 557/1116] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:53.583751 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-493d3c72-013a-4793-9e9f-64dfcbb26ce5 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:53.584458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-493d3c72-013a-4793-9e9f-64dfcbb26ce5 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:53.584979 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-493d3c72-013a-4793-9e9f-64dfcbb26ce5 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:53.585753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-04db7188-f8f9-4461-a48b-ca5a86e4aa01 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:53.586410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-493d3c72-013a-4793-9e9f-64dfcbb26ce5 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:53.586878 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-04db7188-f8f9-4461-a48b-ca5a86e4aa01 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:53.587078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-493d3c72-013a-4793-9e9f-64dfcbb26ce5 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:53.587950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-493d3c72-013a-4793-9e9f-64dfcbb26ce5 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:53.598381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04db7188-f8f9-4461-a48b-ca5a86e4aa01 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:53.600215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04db7188-f8f9-4461-a48b-ca5a86e4aa01 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:53.600722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04db7188-f8f9-4461-a48b-ca5a86e4aa01 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:53.601822 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04db7188-f8f9-4461-a48b-ca5a86e4aa01 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:53.602403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04db7188-f8f9-4461-a48b-ca5a86e4aa01 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:53.602960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04db7188-f8f9-4461-a48b-ca5a86e4aa01 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:53.826775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-493d3c72-013a-4793-9e9f-64dfcbb26ce5 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7ad5e634ea41e3aed6caa5652e784e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6f7d9efc940449d014d41cf2f18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:53.848730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-04db7188-f8f9-4461-a48b-ca5a86e4aa01 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:53.849057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:32:53.865156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-04db7188-f8f9-4461-a48b-ca5a86e4aa01 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:53.867856 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-493d3c72-013a-4793-9e9f-64dfcbb26ce5 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec" status: 200 len: 1371 microversion: 2.1 time: 0.309154 Sep 07 12:32:53.868365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-04db7188-f8f9-4461-a48b-ca5a86e4aa01 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:53.868541 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 560/1117] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:53 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec => generated 1371 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:53.872107 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-04db7188-f8f9-4461-a48b-ca5a86e4aa01 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1567 microversion: 2.25 time: 0.293411 Sep 07 12:32:53.883508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f2aefa5f-0849-4518-a567-d4fafe3024d4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:53.887631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f2aefa5f-0849-4518-a567-d4fafe3024d4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:53.897085 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 558/1118] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:53 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1567 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:53.903842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2aefa5f-0849-4518-a567-d4fafe3024d4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:53.904340 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2aefa5f-0849-4518-a567-d4fafe3024d4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:53.904772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2aefa5f-0849-4518-a567-d4fafe3024d4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:53.905518 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2aefa5f-0849-4518-a567-d4fafe3024d4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:53.906013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2aefa5f-0849-4518-a567-d4fafe3024d4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:53.906438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2aefa5f-0849-4518-a567-d4fafe3024d4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:53.914759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-233bb11c-5271-4bb7-8db6-cad75aca1dc0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:53.914759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-233bb11c-5271-4bb7-8db6-cad75aca1dc0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:53.922240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-233bb11c-5271-4bb7-8db6-cad75aca1dc0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:53.922678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-233bb11c-5271-4bb7-8db6-cad75aca1dc0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:53.923102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-233bb11c-5271-4bb7-8db6-cad75aca1dc0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:53.923874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-233bb11c-5271-4bb7-8db6-cad75aca1dc0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:53.924389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-233bb11c-5271-4bb7-8db6-cad75aca1dc0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:53.924827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-233bb11c-5271-4bb7-8db6-cad75aca1dc0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:54.056171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f2aefa5f-0849-4518-a567-d4fafe3024d4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:54.098828 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f2aefa5f-0849-4518-a567-d4fafe3024d4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:54.103330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f2aefa5f-0849-4518-a567-d4fafe3024d4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:54.111140 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f2aefa5f-0849-4518-a567-d4fafe3024d4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.241491 Sep 07 12:32:54.111804 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 561/1119] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:53 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:54.118893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e88a248-89e2-4532-81c1-f03a71243879 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1046366909", "id": 2134466639, "os-flavor-access:is_public": "False"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:54.160912 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2e88a248-89e2-4532-81c1-f03a71243879 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.047956 Sep 07 12:32:54.163233 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 562/1120] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:32:54 2022] POST /compute/v2.1/flavors => generated 415 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:54.179735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0d61ea36-75a5-43a0-bde0-291001f91585 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1176944604", "id": 892926362, "os-flavor-access:is_public": "True"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:54.210703 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0d61ea36-75a5-43a0-bde0-291001f91585 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.036959 Sep 07 12:32:54.212021 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 563/1121] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:32:54 2022] POST /compute/v2.1/flavors => generated 411 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:54.223786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-233bb11c-5271-4bb7-8db6-cad75aca1dc0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:54.230815 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-64281b40-b1b0-4e8f-af7a-f9e536b4d31e tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:54.240284 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-233bb11c-5271-4bb7-8db6-cad75aca1dc0 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1470 microversion: 2.1 time: 0.340601 Sep 07 12:32:54.244029 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 559/1122] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:53 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1470 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:54.251161 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-64281b40-b1b0-4e8f-af7a-f9e536b4d31e tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.030679 Sep 07 12:32:54.252027 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 564/1123] 10.222.0.16 () {58 vars in 1169 bytes} [Wed Sep 7 12:32:54 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:32:54.268838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-03bb4030-0c85-4a6b-a335-f2e3c81697bc tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:54.307344 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-03bb4030-0c85-4a6b-a335-f2e3c81697bc tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.045580 Sep 07 12:32:54.316335 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 560/1124] 10.222.0.16 () {58 vars in 1177 bytes} [Wed Sep 7 12:32:54 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:54.322570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0f58e80f-5d02-43af-971e-7a7e1efbe1f8 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:54.336530 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0f58e80f-5d02-43af-971e-7a7e1efbe1f8 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.018599 Sep 07 12:32:54.337122 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 565/1125] 10.222.0.16 () {58 vars in 1171 bytes} [Wed Sep 7 12:32:54 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:32:54.353543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5234717d-487e-4421-8c55-2847047c433d tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:54.365323 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5234717d-487e-4421-8c55-2847047c433d tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.016090 Sep 07 12:32:54.365964 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 561/1126] 10.222.0.16 () {58 vars in 1169 bytes} [Wed Sep 7 12:32:54 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:54.380850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cdd0b00c-e541-440f-a07a-91d10535984d tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:54.410226 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cdd0b00c-e541-440f-a07a-91d10535984d tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.033933 Sep 07 12:32:54.411242 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 566/1127] 10.222.0.16 () {58 vars in 1169 bytes} [Wed Sep 7 12:32:54 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:32:54.433777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6190c934-c241-4295-9a1c-e5edc2676d92 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:54.475167 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6190c934-c241-4295-9a1c-e5edc2676d92 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.047905 Sep 07 12:32:54.479170 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 562/1128] 10.222.0.16 () {58 vars in 1175 bytes} [Wed Sep 7 12:32:54 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:54.512376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-31817585-f090-4de4-845b-0f7a81acc407 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:54.561165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f5b4ce0e-d276-4b86-85db-466d99e43ba2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:54.562691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f5b4ce0e-d276-4b86-85db-466d99e43ba2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:54.565669 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-31817585-f090-4de4-845b-0f7a81acc407 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.060256 Sep 07 12:32:54.585737 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 567/1129] 10.222.0.16 () {58 vars in 1173 bytes} [Wed Sep 7 12:32:54 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:54.604725 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-008a7be6-d74f-4624-8623-8a8f4ead2501 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:54.639871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5b4ce0e-d276-4b86-85db-466d99e43ba2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:54.643964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5b4ce0e-d276-4b86-85db-466d99e43ba2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:54.651641 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-008a7be6-d74f-4624-8623-8a8f4ead2501 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.053360 Sep 07 12:32:54.651958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5b4ce0e-d276-4b86-85db-466d99e43ba2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:54.652886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5b4ce0e-d276-4b86-85db-466d99e43ba2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:54.655519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5b4ce0e-d276-4b86-85db-466d99e43ba2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:54.656467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5b4ce0e-d276-4b86-85db-466d99e43ba2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:54.670832 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 568/1130] 10.222.0.16 () {58 vars in 1169 bytes} [Wed Sep 7 12:32:54 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:32:54.693667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d61bd727-721e-46b1-a6bb-ed8de05183c9 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:54.699941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:32:54.733759 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d61bd727-721e-46b1-a6bb-ed8de05183c9 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/892926362" status: 202 len: 0 microversion: 2.1 time: 0.047832 Sep 07 12:32:54.740393 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 569/1131] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Sep 7 12:32:54 2022] DELETE /compute/v2.1/flavors/892926362 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:32:54.752262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0dcadcb9-c712-4a8f-a2d0-a1dffeeff147 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:54.814739 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0dcadcb9-c712-4a8f-a2d0-a1dffeeff147 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069156 Sep 07 12:32:54.817597 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 570/1132] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:32:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:54.854803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6014db8d-3602-402d-a15f-795dfafa1361 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:54.909798 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6014db8d-3602-402d-a15f-795dfafa1361 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2134466639" status: 202 len: 0 microversion: 2.1 time: 0.058729 Sep 07 12:32:54.915654 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 571/1133] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Sep 7 12:32:54 2022] DELETE /compute/v2.1/flavors/2134466639 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:32:54.925400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1147534d-2ec5-486a-86f2-2cc384bfe6b3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:54.927437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1147534d-2ec5-486a-86f2-2cc384bfe6b3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:54.943760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1147534d-2ec5-486a-86f2-2cc384bfe6b3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:54.944689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1147534d-2ec5-486a-86f2-2cc384bfe6b3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:54.945801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1147534d-2ec5-486a-86f2-2cc384bfe6b3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:54.947195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1147534d-2ec5-486a-86f2-2cc384bfe6b3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:54.948442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1147534d-2ec5-486a-86f2-2cc384bfe6b3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:54.949358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1147534d-2ec5-486a-86f2-2cc384bfe6b3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:55.239429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1147534d-2ec5-486a-86f2-2cc384bfe6b3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7ad5e634ea41e3aed6caa5652e784e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6f7d9efc940449d014d41cf2f18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:55.240129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f5b4ce0e-d276-4b86-85db-466d99e43ba2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:55.251607 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f5b4ce0e-d276-4b86-85db-466d99e43ba2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1314 microversion: 2.1 time: 0.698748 Sep 07 12:32:55.253642 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1147534d-2ec5-486a-86f2-2cc384bfe6b3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec" status: 200 len: 1371 microversion: 2.1 time: 0.339047 Sep 07 12:32:55.272759 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 563/1134] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:54 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1314 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:32:55.273724 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 572/1135] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:54 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec => generated 1371 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:55.283694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1a629966-6147-4f7e-b9be-cf75e1a492b0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:55.287049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1a629966-6147-4f7e-b9be-cf75e1a492b0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:55.291917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6438c10d-56b9-4d02-ad32-065457f1063a tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:55.298133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a629966-6147-4f7e-b9be-cf75e1a492b0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:55.299639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a629966-6147-4f7e-b9be-cf75e1a492b0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:55.300518 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a629966-6147-4f7e-b9be-cf75e1a492b0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:55.302149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a629966-6147-4f7e-b9be-cf75e1a492b0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:55.303085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a629966-6147-4f7e-b9be-cf75e1a492b0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:55.304148 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a629966-6147-4f7e-b9be-cf75e1a492b0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:55.352871 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6438c10d-56b9-4d02-ad32-065457f1063a tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.076193 Sep 07 12:32:55.354697 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 573/1136] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:32:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:55.364337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2bf6e667-954b-4e90-90ad-8e57b8b35d39 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:55.365087 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2bf6e667-954b-4e90-90ad-8e57b8b35d39 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:55.377864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bf6e667-954b-4e90-90ad-8e57b8b35d39 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:55.378778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bf6e667-954b-4e90-90ad-8e57b8b35d39 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:55.379697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bf6e667-954b-4e90-90ad-8e57b8b35d39 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:55.380944 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bf6e667-954b-4e90-90ad-8e57b8b35d39 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:55.381804 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bf6e667-954b-4e90-90ad-8e57b8b35d39 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:55.382516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bf6e667-954b-4e90-90ad-8e57b8b35d39 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:55.608098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2bf6e667-954b-4e90-90ad-8e57b8b35d39 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:55.625104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2bf6e667-954b-4e90-90ad-8e57b8b35d39 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:55.628244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2bf6e667-954b-4e90-90ad-8e57b8b35d39 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:55.639147 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2bf6e667-954b-4e90-90ad-8e57b8b35d39 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.282484 Sep 07 12:32:55.640337 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 574/1137] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:55 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:55.656256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-038aec39-0ee1-4d56-971a-1c001848940f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:55.657585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-038aec39-0ee1-4d56-971a-1c001848940f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:55.687521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-038aec39-0ee1-4d56-971a-1c001848940f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:55.688371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-038aec39-0ee1-4d56-971a-1c001848940f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:55.688909 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-038aec39-0ee1-4d56-971a-1c001848940f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:55.689813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-038aec39-0ee1-4d56-971a-1c001848940f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:55.690830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-038aec39-0ee1-4d56-971a-1c001848940f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:55.691630 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-038aec39-0ee1-4d56-971a-1c001848940f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:55.824999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1a629966-6147-4f7e-b9be-cf75e1a492b0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:55.840265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1a629966-6147-4f7e-b9be-cf75e1a492b0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:55.843607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1a629966-6147-4f7e-b9be-cf75e1a492b0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:55.849080 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1a629966-6147-4f7e-b9be-cf75e1a492b0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1567 microversion: 2.25 time: 0.575049 Sep 07 12:32:55.851624 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 564/1138] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:55 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1567 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:55.857168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-67b38bfa-a138-46db-89b0-f1dfd06156fb tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-14131026", "id": 308524198, "os-flavor-access:is_public": "False"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:55.892185 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-67b38bfa-a138-46db-89b0-f1dfd06156fb tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.039081 Sep 07 12:32:55.893233 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 565/1139] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:32:55 2022] POST /compute/v2.1/flavors => generated 410 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:55.907257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-13ca104f-028e-4fc6-a70c-2cc3f099a463 req-65104f45-da48-48b8-b34b-e0f922b8eca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5667e371-cd91-4e33-99ca-635189b98be7", "name": "network-vif-plugged", "status": "completed", "tag": "a98d5f3e-3d10-41a7-ae5b-f31024e7555a"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:55.920763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-13ca104f-028e-4fc6-a70c-2cc3f099a463 req-65104f45-da48-48b8-b34b-e0f922b8eca3 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:55.921672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-13ca104f-028e-4fc6-a70c-2cc3f099a463 req-65104f45-da48-48b8-b34b-e0f922b8eca3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:55.922301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-13ca104f-028e-4fc6-a70c-2cc3f099a463 req-65104f45-da48-48b8-b34b-e0f922b8eca3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:55.938178 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-13ca104f-028e-4fc6-a70c-2cc3f099a463 req-65104f45-da48-48b8-b34b-e0f922b8eca3 service nova] Creating event network-vif-plugged:a98d5f3e-3d10-41a7-ae5b-f31024e7555a for instance 5667e371-cd91-4e33-99ca-635189b98be7 on n-h2-852087-9 Sep 07 12:32:55.943944 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-13ca104f-028e-4fc6-a70c-2cc3f099a463 req-65104f45-da48-48b8-b34b-e0f922b8eca3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041162 Sep 07 12:32:55.944922 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 566/1140] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:55.954637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec471044-f386-493a-97fe-15cffdae8285 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:55.982583 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ec471044-f386-493a-97fe-15cffdae8285 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033409 Sep 07 12:32:55.983124 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 567/1141] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:32:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:56.013646 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9fa40b35-3843-4899-ab5a-3f05e196bf4c tempest-FlavorsAdminTestJSON-1431161782 tempest-FlavorsAdminTestJSON-1431161782-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:56.137363 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9fa40b35-3843-4899-ab5a-3f05e196bf4c tempest-FlavorsAdminTestJSON-1431161782 tempest-FlavorsAdminTestJSON-1431161782-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.128015 Sep 07 12:32:56.140139 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 568/1142] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:32:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:32:56.173040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-71b5adcb-99bf-42c2-b869-ee66ae82f071 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:56.210659 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-71b5adcb-99bf-42c2-b869-ee66ae82f071 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/308524198" status: 202 len: 0 microversion: 2.1 time: 0.045769 Sep 07 12:32:56.218376 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 569/1143] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Sep 7 12:32:56 2022] DELETE /compute/v2.1/flavors/308524198 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 12:32:56.229531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7decb587-c74e-4daf-af06-8554cc64a1d6 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:56.263790 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7decb587-c74e-4daf-af06-8554cc64a1d6 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043527 Sep 07 12:32:56.270372 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 570/1144] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:32:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:56.307460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0537758b-1b67-4649-a42b-3286d3631da1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:56.310272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0537758b-1b67-4649-a42b-3286d3631da1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:56.323618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0537758b-1b67-4649-a42b-3286d3631da1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:56.324926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0537758b-1b67-4649-a42b-3286d3631da1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:56.325850 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0537758b-1b67-4649-a42b-3286d3631da1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:56.327223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0537758b-1b67-4649-a42b-3286d3631da1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:56.328195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0537758b-1b67-4649-a42b-3286d3631da1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:56.329366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0537758b-1b67-4649-a42b-3286d3631da1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:56.385374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-038aec39-0ee1-4d56-971a-1c001848940f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:56.430128 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-038aec39-0ee1-4d56-971a-1c001848940f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1470 microversion: 2.1 time: 0.786155 Sep 07 12:32:56.433605 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 575/1145] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:55 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1470 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:56.443252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cb08bb51-0f86-4156-890f-b0dd771b048c tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:56.444403 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cb08bb51-0f86-4156-890f-b0dd771b048c tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:56.466462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb08bb51-0f86-4156-890f-b0dd771b048c tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:56.467007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb08bb51-0f86-4156-890f-b0dd771b048c tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:56.468786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb08bb51-0f86-4156-890f-b0dd771b048c tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:56.469242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb08bb51-0f86-4156-890f-b0dd771b048c tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:56.470107 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb08bb51-0f86-4156-890f-b0dd771b048c tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:56.470911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb08bb51-0f86-4156-890f-b0dd771b048c tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:56.799991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0537758b-1b67-4649-a42b-3286d3631da1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:56.837754 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0537758b-1b67-4649-a42b-3286d3631da1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1314 microversion: 2.1 time: 0.560294 Sep 07 12:32:56.839116 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 571/1146] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:56 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1314 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:32:56.847993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ffc6b0a-4c15-41fd-ab24-8609f67da168 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-430655774", "id": 1548849094, "os-flavor-access:is_public": "True"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:56.885580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4,nova_api:DELETE=9,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:32:56.893867 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ffc6b0a-4c15-41fd-ab24-8609f67da168 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.051301 Sep 07 12:32:56.895873 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 572/1147] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:32:56 2022] POST /compute/v2.1/flavors => generated 413 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:56.905847 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd7bc0ac-5e2e-47fc-8cfb-5ead1983436d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:56.907140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dd7bc0ac-5e2e-47fc-8cfb-5ead1983436d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:56.927083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd7bc0ac-5e2e-47fc-8cfb-5ead1983436d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:56.928215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd7bc0ac-5e2e-47fc-8cfb-5ead1983436d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:56.929241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd7bc0ac-5e2e-47fc-8cfb-5ead1983436d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:56.930586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd7bc0ac-5e2e-47fc-8cfb-5ead1983436d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:56.931417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd7bc0ac-5e2e-47fc-8cfb-5ead1983436d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:56.932117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd7bc0ac-5e2e-47fc-8cfb-5ead1983436d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:56.968582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cb08bb51-0f86-4156-890f-b0dd771b048c tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7ad5e634ea41e3aed6caa5652e784e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6f7d9efc940449d014d41cf2f18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:56.984673 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cb08bb51-0f86-4156-890f-b0dd771b048c tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec" status: 200 len: 1371 microversion: 2.1 time: 0.549017 Sep 07 12:32:57.009873 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 576/1148] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:56 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec => generated 1371 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:57.015574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-219c132f-0240-46a2-b880-55fb87e9a2bf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:57.018050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-219c132f-0240-46a2-b880-55fb87e9a2bf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:57.030062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-219c132f-0240-46a2-b880-55fb87e9a2bf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:57.030816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-219c132f-0240-46a2-b880-55fb87e9a2bf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:57.031526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-219c132f-0240-46a2-b880-55fb87e9a2bf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:57.033201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-219c132f-0240-46a2-b880-55fb87e9a2bf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:57.033958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-219c132f-0240-46a2-b880-55fb87e9a2bf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:57.034613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-219c132f-0240-46a2-b880-55fb87e9a2bf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:57.061223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dd7bc0ac-5e2e-47fc-8cfb-5ead1983436d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:57.077764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dd7bc0ac-5e2e-47fc-8cfb-5ead1983436d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:57.080837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dd7bc0ac-5e2e-47fc-8cfb-5ead1983436d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:57.091844 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dd7bc0ac-5e2e-47fc-8cfb-5ead1983436d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.193230 Sep 07 12:32:57.093268 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 573/1149] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:56 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:57.102395 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b0ff5b35-4faf-470b-b078-26324d379bb9 tempest-FlavorsAdminTestJSON-1431161782 tempest-FlavorsAdminTestJSON-1431161782-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:57.141957 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b0ff5b35-4faf-470b-b078-26324d379bb9 tempest-FlavorsAdminTestJSON-1431161782 tempest-FlavorsAdminTestJSON-1431161782-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.047141 Sep 07 12:32:57.142838 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 574/1150] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:32:57 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:57.165007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-22b94f6d-6279-4780-918d-ae0cf029ccde tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:57.193930 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-22b94f6d-6279-4780-918d-ae0cf029ccde tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1548849094" status: 202 len: 0 microversion: 2.1 time: 0.033288 Sep 07 12:32:57.199079 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 575/1151] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Sep 7 12:32:57 2022] DELETE /compute/v2.1/flavors/1548849094 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 12:32:57.210594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3f62b9d-6b84-43be-a7bb-4f13718403a3 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:57.238262 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d3f62b9d-6b84-43be-a7bb-4f13718403a3 tempest-FlavorsAdminTestJSON-867783197 tempest-FlavorsAdminTestJSON-867783197-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036532 Sep 07 12:32:57.239766 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 576/1152] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:32:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:32:57.463553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-571b0ed8-00f3-42bd-92ba-df93f5566baa tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:57.464650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-571b0ed8-00f3-42bd-92ba-df93f5566baa tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:57.490604 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-571b0ed8-00f3-42bd-92ba-df93f5566baa tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:57.500871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-571b0ed8-00f3-42bd-92ba-df93f5566baa tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:57.504101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-571b0ed8-00f3-42bd-92ba-df93f5566baa tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:57.507409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-571b0ed8-00f3-42bd-92ba-df93f5566baa tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:57.511576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-571b0ed8-00f3-42bd-92ba-df93f5566baa tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:57.512847 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-571b0ed8-00f3-42bd-92ba-df93f5566baa tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:57.639501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-219c132f-0240-46a2-b880-55fb87e9a2bf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:57.657264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-219c132f-0240-46a2-b880-55fb87e9a2bf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:57.664378 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-219c132f-0240-46a2-b880-55fb87e9a2bf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:57.667513 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-219c132f-0240-46a2-b880-55fb87e9a2bf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1567 microversion: 2.25 time: 0.655715 Sep 07 12:32:57.681525 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 577/1153] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:57 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1567 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:57.808438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-571b0ed8-00f3-42bd-92ba-df93f5566baa tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:57.818351 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-571b0ed8-00f3-42bd-92ba-df93f5566baa tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1536 microversion: 2.1 time: 0.361721 Sep 07 12:32:57.834731 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 577/1154] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:57 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1536 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:32:57.874946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f733a2b6-1d3b-4a50-a986-d9db1af98c99 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:57.877293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f733a2b6-1d3b-4a50-a986-d9db1af98c99 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:57.892370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f733a2b6-1d3b-4a50-a986-d9db1af98c99 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:57.900325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f733a2b6-1d3b-4a50-a986-d9db1af98c99 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:57.901169 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f733a2b6-1d3b-4a50-a986-d9db1af98c99 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:57.903072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f733a2b6-1d3b-4a50-a986-d9db1af98c99 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:57.903972 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f733a2b6-1d3b-4a50-a986-d9db1af98c99 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:57.908940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f733a2b6-1d3b-4a50-a986-d9db1af98c99 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:57.971138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-29dfca91-9d88-408f-a16c-4726e685f850 req-12597234-5005-4afe-8626-90f791fad2e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "128cc68c-e4de-4502-8e18-d84f25904060", "name": "network-vif-unplugged", "status": "completed", "tag": "45364459-d3da-4357-9b05-ec8cab358164"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:57.995744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-29dfca91-9d88-408f-a16c-4726e685f850 req-12597234-5005-4afe-8626-90f791fad2e0 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:57.996402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-29dfca91-9d88-408f-a16c-4726e685f850 req-12597234-5005-4afe-8626-90f791fad2e0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:57.996713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-29dfca91-9d88-408f-a16c-4726e685f850 req-12597234-5005-4afe-8626-90f791fad2e0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:58.024618 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-29dfca91-9d88-408f-a16c-4726e685f850 req-12597234-5005-4afe-8626-90f791fad2e0 service nova] Creating event network-vif-unplugged:45364459-d3da-4357-9b05-ec8cab358164 for instance 128cc68c-e4de-4502-8e18-d84f25904060 on n-h2-852087-9 Sep 07 12:32:58.041376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-29dfca91-9d88-408f-a16c-4726e685f850 req-12597234-5005-4afe-8626-90f791fad2e0 service nova] Instance 128cc68c-e4de-4502-8e18-d84f25904060 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 12:32:58.048811 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-29dfca91-9d88-408f-a16c-4726e685f850 req-12597234-5005-4afe-8626-90f791fad2e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081767 Sep 07 12:32:58.049775 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 578/1155] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:32:58.065106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-94e9f3a2-d60d-4848-8322-ee383f445d6c tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:58.066004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-94e9f3a2-d60d-4848-8322-ee383f445d6c tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:58.079385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94e9f3a2-d60d-4848-8322-ee383f445d6c tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:58.080948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94e9f3a2-d60d-4848-8322-ee383f445d6c tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:58.082458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94e9f3a2-d60d-4848-8322-ee383f445d6c tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:58.084258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94e9f3a2-d60d-4848-8322-ee383f445d6c tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:58.085781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94e9f3a2-d60d-4848-8322-ee383f445d6c tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:58.087972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94e9f3a2-d60d-4848-8322-ee383f445d6c tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:58.217326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f733a2b6-1d3b-4a50-a986-d9db1af98c99 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:58.234406 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f733a2b6-1d3b-4a50-a986-d9db1af98c99 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1314 microversion: 2.1 time: 0.372683 Sep 07 12:32:58.235118 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 578/1156] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:57 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:58.241834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-903869dd-8af7-409f-8ac1-bedb97708539 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:58.241834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-903869dd-8af7-409f-8ac1-bedb97708539 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:58.259189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-903869dd-8af7-409f-8ac1-bedb97708539 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:58.259696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-903869dd-8af7-409f-8ac1-bedb97708539 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:58.260143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-903869dd-8af7-409f-8ac1-bedb97708539 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:58.260883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-903869dd-8af7-409f-8ac1-bedb97708539 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:58.261344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-903869dd-8af7-409f-8ac1-bedb97708539 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:58.261815 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-903869dd-8af7-409f-8ac1-bedb97708539 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:58.444963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-903869dd-8af7-409f-8ac1-bedb97708539 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:58.457098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-903869dd-8af7-409f-8ac1-bedb97708539 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:58.459659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-903869dd-8af7-409f-8ac1-bedb97708539 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:58.466518 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-903869dd-8af7-409f-8ac1-bedb97708539 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.230296 Sep 07 12:32:58.467478 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 579/1157] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:58 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:58.575694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-94e9f3a2-d60d-4848-8322-ee383f445d6c tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7ad5e634ea41e3aed6caa5652e784e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6f7d9efc940449d014d41cf2f18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:58.589796 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-94e9f3a2-d60d-4848-8322-ee383f445d6c tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec" status: 200 len: 1371 microversion: 2.1 time: 0.538659 Sep 07 12:32:58.606505 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 579/1158] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:58 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec => generated 1371 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:58.715580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f304e573-04b0-4f2d-8e54-a975c33d4b6e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:58.717129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f304e573-04b0-4f2d-8e54-a975c33d4b6e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:58.733395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f304e573-04b0-4f2d-8e54-a975c33d4b6e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:58.734445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f304e573-04b0-4f2d-8e54-a975c33d4b6e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:58.735201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f304e573-04b0-4f2d-8e54-a975c33d4b6e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:58.738440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f304e573-04b0-4f2d-8e54-a975c33d4b6e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:58.739389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f304e573-04b0-4f2d-8e54-a975c33d4b6e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:58.741044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f304e573-04b0-4f2d-8e54-a975c33d4b6e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:58.847680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ad88ca3d-30a3-4280-9645-c20fbc74b7ff tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:58.848264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ad88ca3d-30a3-4280-9645-c20fbc74b7ff tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:58.858151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad88ca3d-30a3-4280-9645-c20fbc74b7ff tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:58.858777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad88ca3d-30a3-4280-9645-c20fbc74b7ff tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:58.859989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad88ca3d-30a3-4280-9645-c20fbc74b7ff tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:58.860195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad88ca3d-30a3-4280-9645-c20fbc74b7ff tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:58.863095 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad88ca3d-30a3-4280-9645-c20fbc74b7ff tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:58.864281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad88ca3d-30a3-4280-9645-c20fbc74b7ff tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:59.201869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f304e573-04b0-4f2d-8e54-a975c33d4b6e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:59.214669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f304e573-04b0-4f2d-8e54-a975c33d4b6e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:59.216504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f304e573-04b0-4f2d-8e54-a975c33d4b6e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:59.218745 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f304e573-04b0-4f2d-8e54-a975c33d4b6e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1567 microversion: 2.25 time: 0.507720 Sep 07 12:32:59.229908 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 580/1159] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:58 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1567 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:32:59.242408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-73d8364c-adb3-43e8-ac66-0d541d50d566 req-076f8948-d7f4-45af-ac19-8920f7edd2ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81fe7509-9012-4fcc-9f06-26693494f535", "name": "network-vif-unplugged", "status": "completed", "tag": "e45111b2-8436-42bb-872d-704690a433d6"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:32:59.250357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-73d8364c-adb3-43e8-ac66-0d541d50d566 req-076f8948-d7f4-45af-ac19-8920f7edd2ca service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:59.251139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-73d8364c-adb3-43e8-ac66-0d541d50d566 req-076f8948-d7f4-45af-ac19-8920f7edd2ca service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:59.251488 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-73d8364c-adb3-43e8-ac66-0d541d50d566 req-076f8948-d7f4-45af-ac19-8920f7edd2ca service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:59.272230 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-73d8364c-adb3-43e8-ac66-0d541d50d566 req-076f8948-d7f4-45af-ac19-8920f7edd2ca service nova] Creating event network-vif-unplugged:e45111b2-8436-42bb-872d-704690a433d6 for instance 81fe7509-9012-4fcc-9f06-26693494f535 on n-h1-852087-9 Sep 07 12:32:59.279431 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-73d8364c-adb3-43e8-ac66-0d541d50d566 req-076f8948-d7f4-45af-ac19-8920f7edd2ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056809 Sep 07 12:32:59.280727 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 581/1160] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:32:59.286735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a2121723-9047-497a-b7dd-657ff2287073 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:59.288312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a2121723-9047-497a-b7dd-657ff2287073 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:59.292536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=9,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:32:59.299085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2121723-9047-497a-b7dd-657ff2287073 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:59.300079 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2121723-9047-497a-b7dd-657ff2287073 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:59.300684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2121723-9047-497a-b7dd-657ff2287073 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:59.301802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2121723-9047-497a-b7dd-657ff2287073 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:59.302604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2121723-9047-497a-b7dd-657ff2287073 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:59.303258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2121723-9047-497a-b7dd-657ff2287073 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:59.356160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ad88ca3d-30a3-4280-9645-c20fbc74b7ff tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:59.376713 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ad88ca3d-30a3-4280-9645-c20fbc74b7ff tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1536 microversion: 2.1 time: 0.532489 Sep 07 12:32:59.390237 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 580/1161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:58 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1536 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:59.507995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a9641d3-be77-48ab-a39c-5339ad2d2737 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:59.508817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7a9641d3-be77-48ab-a39c-5339ad2d2737 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:59.519584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a9641d3-be77-48ab-a39c-5339ad2d2737 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:59.520945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a9641d3-be77-48ab-a39c-5339ad2d2737 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:59.521772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a9641d3-be77-48ab-a39c-5339ad2d2737 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:59.523383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a9641d3-be77-48ab-a39c-5339ad2d2737 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:59.524254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a9641d3-be77-48ab-a39c-5339ad2d2737 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:59.524987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a9641d3-be77-48ab-a39c-5339ad2d2737 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:59.645294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a2121723-9047-497a-b7dd-657ff2287073 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:59.660798 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a2121723-9047-497a-b7dd-657ff2287073 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1463 microversion: 2.1 time: 0.377971 Sep 07 12:32:59.662443 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 582/1162] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:59 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1463 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:32:59.675675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7a9641d3-be77-48ab-a39c-5339ad2d2737 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:59.679229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-37ed1b26-6fa6-42a5-a9fe-0d985bfc10ee tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:32:59.680899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-37ed1b26-6fa6-42a5-a9fe-0d985bfc10ee tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:32:59.696125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37ed1b26-6fa6-42a5-a9fe-0d985bfc10ee tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:59.698879 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37ed1b26-6fa6-42a5-a9fe-0d985bfc10ee tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:59.700533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37ed1b26-6fa6-42a5-a9fe-0d985bfc10ee tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:59.711076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37ed1b26-6fa6-42a5-a9fe-0d985bfc10ee tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:32:59.715308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37ed1b26-6fa6-42a5-a9fe-0d985bfc10ee tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:32:59.717457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37ed1b26-6fa6-42a5-a9fe-0d985bfc10ee tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:32:59.730521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7a9641d3-be77-48ab-a39c-5339ad2d2737 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:59.736128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7a9641d3-be77-48ab-a39c-5339ad2d2737 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:32:59.749331 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7a9641d3-be77-48ab-a39c-5339ad2d2737 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.253451 Sep 07 12:32:59.755083 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 581/1163] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:32:59 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:33:00.248922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37ed1b26-6fa6-42a5-a9fe-0d985bfc10ee tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7ad5e634ea41e3aed6caa5652e784e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6f7d9efc940449d014d41cf2f18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:00.270598 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-37ed1b26-6fa6-42a5-a9fe-0d985bfc10ee tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec" status: 200 len: 1371 microversion: 2.1 time: 0.606113 Sep 07 12:33:00.283274 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 583/1164] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:32:59 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec => generated 1371 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:00.289541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-196700af-7021-4044-b804-05572fdba8d8 req-67eed303-6b54-44b8-a6f7-876f9fa27bcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9916ff29-8e9b-41f7-bbde-3f987cd0c9ec", "name": "network-vif-plugged", "status": "completed", "tag": "7120d1ee-a3b5-4407-ba59-4de91da3dd76"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:00.296627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-79b2b0d6-158c-4e75-8930-7630539c1d7b tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:00.312532 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-79b2b0d6-158c-4e75-8930-7630539c1d7b tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Searching by: {'deleted': False, 'project_id': '6dd91a3f3f744b1494d0db4d5a4c5c79'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:33:00.323828 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-196700af-7021-4044-b804-05572fdba8d8 req-67eed303-6b54-44b8-a6f7-876f9fa27bcc service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:00.325158 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-196700af-7021-4044-b804-05572fdba8d8 req-67eed303-6b54-44b8-a6f7-876f9fa27bcc service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:00.325519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79b2b0d6-158c-4e75-8930-7630539c1d7b tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:00.325709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-196700af-7021-4044-b804-05572fdba8d8 req-67eed303-6b54-44b8-a6f7-876f9fa27bcc service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:00.326878 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79b2b0d6-158c-4e75-8930-7630539c1d7b tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:00.327987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79b2b0d6-158c-4e75-8930-7630539c1d7b tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:00.329438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79b2b0d6-158c-4e75-8930-7630539c1d7b tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:00.330361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79b2b0d6-158c-4e75-8930-7630539c1d7b tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:00.331222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79b2b0d6-158c-4e75-8930-7630539c1d7b tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:00.341636 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-196700af-7021-4044-b804-05572fdba8d8 req-67eed303-6b54-44b8-a6f7-876f9fa27bcc service nova] Creating event network-vif-plugged:7120d1ee-a3b5-4407-ba59-4de91da3dd76 for instance 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec on n-h1-852087-9 Sep 07 12:33:00.348560 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-196700af-7021-4044-b804-05572fdba8d8 req-67eed303-6b54-44b8-a6f7-876f9fa27bcc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063643 Sep 07 12:33:00.350555 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 584/1165] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:33:00.356562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-60b82985-a91e-4c19-bd5d-b8820b4bc649 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:00.357820 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-60b82985-a91e-4c19-bd5d-b8820b4bc649 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:00.370159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60b82985-a91e-4c19-bd5d-b8820b4bc649 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:00.370867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60b82985-a91e-4c19-bd5d-b8820b4bc649 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:00.371564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60b82985-a91e-4c19-bd5d-b8820b4bc649 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:00.372544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60b82985-a91e-4c19-bd5d-b8820b4bc649 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:00.373423 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60b82985-a91e-4c19-bd5d-b8820b4bc649 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:00.374101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60b82985-a91e-4c19-bd5d-b8820b4bc649 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:00.648219 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-79b2b0d6-158c-4e75-8930-7630539c1d7b tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.880649 Sep 07 12:33:00.651177 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 582/1166] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:32:59 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:33:00.661643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1cb8c8fd-d568-45d2-ae81-4e4bfa7ab23a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:00.662665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1cb8c8fd-d568-45d2-ae81-4e4bfa7ab23a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:00.677984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cb8c8fd-d568-45d2-ae81-4e4bfa7ab23a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:00.679379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cb8c8fd-d568-45d2-ae81-4e4bfa7ab23a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:00.681019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cb8c8fd-d568-45d2-ae81-4e4bfa7ab23a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:00.682788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cb8c8fd-d568-45d2-ae81-4e4bfa7ab23a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:00.684008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cb8c8fd-d568-45d2-ae81-4e4bfa7ab23a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:00.685094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cb8c8fd-d568-45d2-ae81-4e4bfa7ab23a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:01.184230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-60b82985-a91e-4c19-bd5d-b8820b4bc649 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:01.209421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-60b82985-a91e-4c19-bd5d-b8820b4bc649 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:01.215666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-60b82985-a91e-4c19-bd5d-b8820b4bc649 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:01.225874 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-60b82985-a91e-4c19-bd5d-b8820b4bc649 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1567 microversion: 2.25 time: 0.868586 Sep 07 12:33:01.226951 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 585/1167] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:00 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1567 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:01.228649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1cb8c8fd-d568-45d2-ae81-4e4bfa7ab23a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:01.237527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-407b8c11-4854-4fe5-bab7-494b1bbb5706 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:01.241355 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1cb8c8fd-d568-45d2-ae81-4e4bfa7ab23a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1536 microversion: 2.1 time: 0.584651 Sep 07 12:33:01.242457 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 583/1168] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:00 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1536 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:01.257627 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-407b8c11-4854-4fe5-bab7-494b1bbb5706 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Searching by: {'deleted': False} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:33:01.273923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e11411ad-15b0-4e5b-a927-3c762be2f77e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:01.275103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e11411ad-15b0-4e5b-a927-3c762be2f77e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:01.286687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e11411ad-15b0-4e5b-a927-3c762be2f77e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:01.287545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e11411ad-15b0-4e5b-a927-3c762be2f77e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:01.288217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e11411ad-15b0-4e5b-a927-3c762be2f77e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:01.289198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e11411ad-15b0-4e5b-a927-3c762be2f77e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:01.290925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e11411ad-15b0-4e5b-a927-3c762be2f77e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:01.291604 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e11411ad-15b0-4e5b-a927-3c762be2f77e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:01.299195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-407b8c11-4854-4fe5-bab7-494b1bbb5706 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:01.300056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-407b8c11-4854-4fe5-bab7-494b1bbb5706 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:01.300613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-407b8c11-4854-4fe5-bab7-494b1bbb5706 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:01.303065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-407b8c11-4854-4fe5-bab7-494b1bbb5706 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:01.303903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-407b8c11-4854-4fe5-bab7-494b1bbb5706 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:01.304583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-407b8c11-4854-4fe5-bab7-494b1bbb5706 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:01.450992 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e11411ad-15b0-4e5b-a927-3c762be2f77e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:01.474029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e11411ad-15b0-4e5b-a927-3c762be2f77e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:01.477535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e11411ad-15b0-4e5b-a927-3c762be2f77e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:01.486363 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e11411ad-15b0-4e5b-a927-3c762be2f77e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.227258 Sep 07 12:33:01.487671 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 584/1169] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:01 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:01.501730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-1f5106e8-3973-4ea4-a8e5-6d70560f1b3c req-51881d57-432b-40d0-9d8f-1c670d2bfa29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81fe7509-9012-4fcc-9f06-26693494f535", "tag": "e45111b2-8436-42bb-872d-704690a433d6"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:01.517636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-407b8c11-4854-4fe5-bab7-494b1bbb5706 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Listed batch of 14 results from cell out of 1000 limit. Returned 14 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:33:01.532001 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1f5106e8-3973-4ea4-a8e5-6d70560f1b3c req-51881d57-432b-40d0-9d8f-1c670d2bfa29 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:01.532386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1f5106e8-3973-4ea4-a8e5-6d70560f1b3c req-51881d57-432b-40d0-9d8f-1c670d2bfa29 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:01.532736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1f5106e8-3973-4ea4-a8e5-6d70560f1b3c req-51881d57-432b-40d0-9d8f-1c670d2bfa29 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:01.547284 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-1f5106e8-3973-4ea4-a8e5-6d70560f1b3c req-51881d57-432b-40d0-9d8f-1c670d2bfa29 service nova] Creating event network-changed:e45111b2-8436-42bb-872d-704690a433d6 for instance 81fe7509-9012-4fcc-9f06-26693494f535 on n-h1-852087-9 Sep 07 12:33:01.553538 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-1f5106e8-3973-4ea4-a8e5-6d70560f1b3c req-51881d57-432b-40d0-9d8f-1c670d2bfa29 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064356 Sep 07 12:33:01.554702 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 585/1170] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:33:01.560260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-30c391b9-3671-4e91-8fcd-703b74fbc88a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:01.561556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-30c391b9-3671-4e91-8fcd-703b74fbc88a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:01.569851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30c391b9-3671-4e91-8fcd-703b74fbc88a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:01.570856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30c391b9-3671-4e91-8fcd-703b74fbc88a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:01.571924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30c391b9-3671-4e91-8fcd-703b74fbc88a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:01.572887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30c391b9-3671-4e91-8fcd-703b74fbc88a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:01.573613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30c391b9-3671-4e91-8fcd-703b74fbc88a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:01.574287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30c391b9-3671-4e91-8fcd-703b74fbc88a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:01.732940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-407b8c11-4854-4fe5-bab7-494b1bbb5706 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:01.735455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-407b8c11-4854-4fe5-bab7-494b1bbb5706 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:01.737424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-407b8c11-4854-4fe5-bab7-494b1bbb5706 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:01.925815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-30c391b9-3671-4e91-8fcd-703b74fbc88a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7ad5e634ea41e3aed6caa5652e784e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6f7d9efc940449d014d41cf2f18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:01.946158 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-30c391b9-3671-4e91-8fcd-703b74fbc88a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec" status: 200 len: 1371 microversion: 2.1 time: 0.389476 Sep 07 12:33:01.967085 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 586/1171] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:01 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec => generated 1371 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:02.278504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b622dec3-f2fe-459f-b891-09149e7f988d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:02.280239 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b622dec3-f2fe-459f-b891-09149e7f988d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:02.311475 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b622dec3-f2fe-459f-b891-09149e7f988d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:02.312750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b622dec3-f2fe-459f-b891-09149e7f988d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:02.315425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b622dec3-f2fe-459f-b891-09149e7f988d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:02.317542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b622dec3-f2fe-459f-b891-09149e7f988d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:02.319564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b622dec3-f2fe-459f-b891-09149e7f988d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:02.320190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b622dec3-f2fe-459f-b891-09149e7f988d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:02.367986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:33:03.002593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b622dec3-f2fe-459f-b891-09149e7f988d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:03.048068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b622dec3-f2fe-459f-b891-09149e7f988d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:03.062833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b622dec3-f2fe-459f-b891-09149e7f988d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:03.065791 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b622dec3-f2fe-459f-b891-09149e7f988d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1567 microversion: 2.25 time: 0.799226 Sep 07 12:33:03.070823 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 587/1172] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:02 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1567 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:03.119381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9f105468-de4e-49fd-a0c7-3eadd257fcbe tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:03.125165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9f105468-de4e-49fd-a0c7-3eadd257fcbe tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:03.165033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f105468-de4e-49fd-a0c7-3eadd257fcbe tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:03.165945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f105468-de4e-49fd-a0c7-3eadd257fcbe tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:03.173364 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f105468-de4e-49fd-a0c7-3eadd257fcbe tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:03.174778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f105468-de4e-49fd-a0c7-3eadd257fcbe tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:03.178212 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f105468-de4e-49fd-a0c7-3eadd257fcbe tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:03.179299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f105468-de4e-49fd-a0c7-3eadd257fcbe tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:03.206026 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-407b8c11-4854-4fe5-bab7-494b1bbb5706 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 22961 microversion: 2.1 time: 1.977497 Sep 07 12:33:03.207418 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 586/1173] 10.222.0.16 () {58 vars in 1171 bytes} [Wed Sep 7 12:33:01 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 22961 bytes in 1980 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:33:03.213517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e648b03b-3c36-426e-b18b-0587948e3689 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:03.214584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e648b03b-3c36-426e-b18b-0587948e3689 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:03.222395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e648b03b-3c36-426e-b18b-0587948e3689 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:03.223237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e648b03b-3c36-426e-b18b-0587948e3689 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:03.223904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e648b03b-3c36-426e-b18b-0587948e3689 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:03.224917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e648b03b-3c36-426e-b18b-0587948e3689 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:03.225619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e648b03b-3c36-426e-b18b-0587948e3689 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:03.226287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e648b03b-3c36-426e-b18b-0587948e3689 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:03.481142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e648b03b-3c36-426e-b18b-0587948e3689 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:03.492805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e648b03b-3c36-426e-b18b-0587948e3689 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:03.495164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e648b03b-3c36-426e-b18b-0587948e3689 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:03.502107 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e648b03b-3c36-426e-b18b-0587948e3689 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.292545 Sep 07 12:33:03.503023 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 587/1174] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:03 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:03.518206 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ac6f986-dd84-4d9b-ab9f-0dfb7eff7bb0 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:03.519832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5ac6f986-dd84-4d9b-ab9f-0dfb7eff7bb0 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:03.545648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ac6f986-dd84-4d9b-ab9f-0dfb7eff7bb0 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:03.546851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ac6f986-dd84-4d9b-ab9f-0dfb7eff7bb0 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:03.547826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ac6f986-dd84-4d9b-ab9f-0dfb7eff7bb0 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:03.549950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ac6f986-dd84-4d9b-ab9f-0dfb7eff7bb0 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:03.550681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ac6f986-dd84-4d9b-ab9f-0dfb7eff7bb0 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:03.551341 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ac6f986-dd84-4d9b-ab9f-0dfb7eff7bb0 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:03.862452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9f105468-de4e-49fd-a0c7-3eadd257fcbe tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:03.885590 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9f105468-de4e-49fd-a0c7-3eadd257fcbe tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1529 microversion: 2.1 time: 0.812742 Sep 07 12:33:03.887390 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 588/1175] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:03 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1529 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:04.115747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5ac6f986-dd84-4d9b-ab9f-0dfb7eff7bb0 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7ad5e634ea41e3aed6caa5652e784e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6f7d9efc940449d014d41cf2f18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:04.130849 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5ac6f986-dd84-4d9b-ab9f-0dfb7eff7bb0 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec" status: 200 len: 1557 microversion: 2.1 time: 0.625029 Sep 07 12:33:04.131842 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 588/1176] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:03 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec => generated 1557 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:04.136727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b206c382-f332-47aa-92f8-fd9948b29a56 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:04.150932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b206c382-f332-47aa-92f8-fd9948b29a56 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Searching by: {'deleted': False, 'project_id': '6dd91a3f3f744b1494d0db4d5a4c5c79'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:33:04.190471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b206c382-f332-47aa-92f8-fd9948b29a56 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:04.190471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b206c382-f332-47aa-92f8-fd9948b29a56 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:04.190471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b206c382-f332-47aa-92f8-fd9948b29a56 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:04.191883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b206c382-f332-47aa-92f8-fd9948b29a56 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:04.192756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b206c382-f332-47aa-92f8-fd9948b29a56 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:04.193578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b206c382-f332-47aa-92f8-fd9948b29a56 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:04.404755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aeb74a98-1ef9-4a67-9b84-e165c8d90fd7 tempest-SecurityGroupsTestAdminJSON-1944242648 tempest-SecurityGroupsTestAdminJSON-1944242648-project] Action: 'create', calling method: .version_select at 0x7fc41928ea60>, body: {"security_group": {"name": "tempest-securitygroup-1563771729", "description": "tempest-description-297171300"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:04.456608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:33:04.515843 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b206c382-f332-47aa-92f8-fd9948b29a56 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?tenant_id=7d8dd874b3674087a3e969424a561530" status: 200 len: 15 microversion: 2.1 time: 0.381039 Sep 07 12:33:04.517476 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 589/1177] 10.222.0.16 () {58 vars in 1231 bytes} [Wed Sep 7 12:33:04 2022] GET /compute/v2.1/servers/detail?tenant_id=7d8dd874b3674087a3e969424a561530 => generated 15 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:33:04.538222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8d7326fc-8952-4499-8bea-fce3ea57513b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:04.540156 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8d7326fc-8952-4499-8bea-fce3ea57513b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:04.562786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d7326fc-8952-4499-8bea-fce3ea57513b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:04.563113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d7326fc-8952-4499-8bea-fce3ea57513b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:04.563481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d7326fc-8952-4499-8bea-fce3ea57513b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:04.568351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d7326fc-8952-4499-8bea-fce3ea57513b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:04.569308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d7326fc-8952-4499-8bea-fce3ea57513b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:04.572159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d7326fc-8952-4499-8bea-fce3ea57513b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:05.439205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8d7326fc-8952-4499-8bea-fce3ea57513b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:05.449787 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8d7326fc-8952-4499-8bea-fce3ea57513b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1529 microversion: 2.1 time: 0.929471 Sep 07 12:33:05.462205 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 590/1178] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:04 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1529 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:05.476612 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4e31d204-4ed6-47b6-be2e-7e1643673412 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:05.477761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4e31d204-4ed6-47b6-be2e-7e1643673412 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:05.491922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e31d204-4ed6-47b6-be2e-7e1643673412 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:05.493034 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e31d204-4ed6-47b6-be2e-7e1643673412 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:05.493902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e31d204-4ed6-47b6-be2e-7e1643673412 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:05.495620 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e31d204-4ed6-47b6-be2e-7e1643673412 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:05.496471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e31d204-4ed6-47b6-be2e-7e1643673412 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:05.497263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e31d204-4ed6-47b6-be2e-7e1643673412 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:05.675527 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aeb74a98-1ef9-4a67-9b84-e165c8d90fd7 tempest-SecurityGroupsTestAdminJSON-1944242648 tempest-SecurityGroupsTestAdminJSON-1944242648-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.783008 Sep 07 12:33:05.696830 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 589/1179] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Sep 7 12:33:03 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:33:05.696830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-76b326c9-6fcb-4b56-924d-7634a74ad8c1 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:05.696830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-76b326c9-6fcb-4b56-924d-7634a74ad8c1 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:05.720018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76b326c9-6fcb-4b56-924d-7634a74ad8c1 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:05.721039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76b326c9-6fcb-4b56-924d-7634a74ad8c1 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:05.721923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76b326c9-6fcb-4b56-924d-7634a74ad8c1 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:05.723469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76b326c9-6fcb-4b56-924d-7634a74ad8c1 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:05.724356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76b326c9-6fcb-4b56-924d-7634a74ad8c1 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:05.725571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76b326c9-6fcb-4b56-924d-7634a74ad8c1 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:05.777069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4e31d204-4ed6-47b6-be2e-7e1643673412 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:05.792811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4e31d204-4ed6-47b6-be2e-7e1643673412 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:05.795010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4e31d204-4ed6-47b6-be2e-7e1643673412 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:05.796454 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4e31d204-4ed6-47b6-be2e-7e1643673412 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1567 microversion: 2.25 time: 0.332482 Sep 07 12:33:05.797114 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 591/1180] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:05 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1567 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:05.814849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e9a1702a-d2af-4f7a-a5a4-5e98d0779564 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:05.829845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e9a1702a-d2af-4f7a-a5a4-5e98d0779564 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Searching by: {'tenant_id': '7d8dd874b3674087a3e969424a561530', 'deleted': False} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:33:05.844178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9a1702a-d2af-4f7a-a5a4-5e98d0779564 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:05.845107 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9a1702a-d2af-4f7a-a5a4-5e98d0779564 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:05.849599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9a1702a-d2af-4f7a-a5a4-5e98d0779564 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:05.851667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9a1702a-d2af-4f7a-a5a4-5e98d0779564 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:05.852868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9a1702a-d2af-4f7a-a5a4-5e98d0779564 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:05.853961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9a1702a-d2af-4f7a-a5a4-5e98d0779564 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:05.911478 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-76b326c9-6fcb-4b56-924d-7634a74ad8c1 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.232055 Sep 07 12:33:05.913261 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 590/1181] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Sep 7 12:33:05 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec/os-interface => generated 285 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:33:05.918479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-e9a1702a-d2af-4f7a-a5a4-5e98d0779564 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:33:05.918809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4fb70b01-be7e-4f45-bef9-e4f5a8f7a64f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:05.919339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4fb70b01-be7e-4f45-bef9-e4f5a8f7a64f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:05.934574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fb70b01-be7e-4f45-bef9-e4f5a8f7a64f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:05.935755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fb70b01-be7e-4f45-bef9-e4f5a8f7a64f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:05.936812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fb70b01-be7e-4f45-bef9-e4f5a8f7a64f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:05.938329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fb70b01-be7e-4f45-bef9-e4f5a8f7a64f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:05.939568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fb70b01-be7e-4f45-bef9-e4f5a8f7a64f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:05.942212 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fb70b01-be7e-4f45-bef9-e4f5a8f7a64f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:06.046660 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9a1702a-d2af-4f7a-a5a4-5e98d0779564 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:06.047263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9a1702a-d2af-4f7a-a5a4-5e98d0779564 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:06.047781 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9a1702a-d2af-4f7a-a5a4-5e98d0779564 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:06.138891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4fb70b01-be7e-4f45-bef9-e4f5a8f7a64f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:06.161259 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4fb70b01-be7e-4f45-bef9-e4f5a8f7a64f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:06.164336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4fb70b01-be7e-4f45-bef9-e4f5a8f7a64f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:06.180654 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4fb70b01-be7e-4f45-bef9-e4f5a8f7a64f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.258980 Sep 07 12:33:06.193650 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 591/1182] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:05 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:06.219201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8fdcbab6-c639-4879-a1f8-9eb2f058d0d2 req-a21f2628-2687-42dc-b4dc-b3abd88cc7e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "128cc68c-e4de-4502-8e18-d84f25904060", "name": "network-vif-plugged", "status": "completed", "tag": "45364459-d3da-4357-9b05-ec8cab358164"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:06.246881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8fdcbab6-c639-4879-a1f8-9eb2f058d0d2 req-a21f2628-2687-42dc-b4dc-b3abd88cc7e3 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:06.247761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8fdcbab6-c639-4879-a1f8-9eb2f058d0d2 req-a21f2628-2687-42dc-b4dc-b3abd88cc7e3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:06.248881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8fdcbab6-c639-4879-a1f8-9eb2f058d0d2 req-a21f2628-2687-42dc-b4dc-b3abd88cc7e3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:06.264389 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8fdcbab6-c639-4879-a1f8-9eb2f058d0d2 req-a21f2628-2687-42dc-b4dc-b3abd88cc7e3 service nova] Creating event network-vif-plugged:45364459-d3da-4357-9b05-ec8cab358164 for instance 128cc68c-e4de-4502-8e18-d84f25904060 on n-h2-852087-9 Sep 07 12:33:06.270746 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8fdcbab6-c639-4879-a1f8-9eb2f058d0d2 req-a21f2628-2687-42dc-b4dc-b3abd88cc7e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078907 Sep 07 12:33:06.273188 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 592/1183] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:33:06.281523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7049a915-1e20-4a6d-8a2b-1ec57b051d7d tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:06.294218 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-7049a915-1e20-4a6d-8a2b-1ec57b051d7d tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] HTTP exception thrown: Flavor 14658a2f-eb75-442b-89ee-ecf1d26c9c1e could not be found. Sep 07 12:33:06.300373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7049a915-1e20-4a6d-8a2b-1ec57b051d7d tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Request method failure captured: Sep 07 12:33:06.300373 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/flavors/14658a2f-eb75-442b-89ee-ecf1d26c9c1e HTTP/1.1 Sep 07 12:33:06.300373 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:33:06.300373 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:33:06.300373 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:33:06.300373 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:33:06.300373 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:33:06.300373 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:33:06.300373 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:33:06.300373 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:33:06.300373 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI50ukRAAHpu1-S7U9ZOci_CzrfvLgNKEpfevqN3UGeAK3BWt3tzffrONt42GmMLdrw4yfAHdLfXdaaIBG6F4aNjD2-HvvYzlzk2syYeVJrKr82LlMheSlW9xr545rbV606E51pjcWz2b8nO1-NatbsXc5rqrLXx7YMRoZH6BM7D8Wg Sep 07 12:33:06.300373 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:33:06.300373 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:33:06.300373 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:33:06.300373 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:33:06.300373 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:33:06.300373 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:33:06.300373 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 9c281c5da5fa467ba95cc00a54c408ae Sep 07 12:33:06.300373 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-MigrationsAdminTest-226331028 Sep 07 12:33:06.300373 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 12:33:06.300373 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 12:33:06.303320 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c281c5da5fa467ba95cc00a54c408ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9c281c5da5fa467ba95cc00a54c408ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9c281c5da5fa467ba95cc00a54c408ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c281c5da5fa467ba95cc00a54c408ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:33:06.303320 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-MigrationsAdminTest-226331028 Sep 07 12:33:06.303320 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 9c281c5da5fa467ba95cc00a54c408ae Sep 07 12:33:06.303320 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-MigrationsAdminTest-226331028 Sep 07 12:33:06.303320 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-MigrationsAdminTest-226331028-project-admin Sep 07 12:33:06.303320 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:33:06.303320 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:33:06.303320 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: b934700cad97473f92324e3b71a9ece4 Sep 07 12:33:06.303320 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-MigrationsAdminTest-226331028-project-admin Sep 07 12:33:06.303320 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:33:06.303320 n-d-852087-9 devstack@n-api.service[122433]: exception: Flavor 14658a2f-eb75-442b-89ee-ecf1d26c9c1e could not be found. Sep 07 12:33:06.303320 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '14658a2f-eb75-442b-89ee-ecf1d26c9c1e'} Sep 07 12:33:06.304962 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:33:06.304962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:33:06.304962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Sep 07 12:33:06.304962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi flavor.destroy() Sep 07 12:33:06.304962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 07 12:33:06.304962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 07 12:33:06.304962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Sep 07 12:33:06.304962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Sep 07 12:33:06.304962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Sep 07 12:33:06.304962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Sep 07 12:33:06.304962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 12:33:06.304962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 12:33:06.304962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Sep 07 12:33:06.304962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Sep 07 12:33:06.304962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 14658a2f-eb75-442b-89ee-ecf1d26c9c1e could not be found. Sep 07 12:33:06.304962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:33:06.304962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:33:06.304962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:33:06.304962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:33:06.304962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:33:06.307963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:33:06.307963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:33:06.307963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:33:06.307963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:33:06.307963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:33:06.307963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Sep 07 12:33:06.307963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:33:06.307963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 14658a2f-eb75-442b-89ee-ecf1d26c9c1e could not be found. Sep 07 12:33:06.307963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:33:06.307963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:33:06.307963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:33:06.307963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:33:06.307963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:33:06.307963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:33:06.307963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:33:06.307963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:33:06.307963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 14658a2f-eb75-442b-89ee-ecf1d26c9c1e could not be found. Sep 07 12:33:06.307963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:33:06.310316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7049a915-1e20-4a6d-8a2b-1ec57b051d7d tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Returning 404 to user: Flavor 14658a2f-eb75-442b-89ee-ecf1d26c9c1e could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:33:06.310316 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7049a915-1e20-4a6d-8a2b-1ec57b051d7d tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/14658a2f-eb75-442b-89ee-ecf1d26c9c1e" status: 404 len: 109 microversion: 2.1 time: 0.028758 Sep 07 12:33:06.310316 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 593/1184] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:33:06 2022] DELETE /compute/v2.1/flavors/14658a2f-eb75-442b-89ee-ecf1d26c9c1e => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:33:06.325525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d316cd74-66d9-43fc-80c5-098b3c485b75 tempest-SecurityGroupsTestAdminJSON-1944242648 tempest-SecurityGroupsTestAdminJSON-1944242648-project] Action: 'create', calling method: .version_select at 0x7fc4192beb80>, body: {"security_group": {"name": "tempest-securitygroup-1207357248", "description": "tempest-description-1899244656"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:06.697075 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e9a1702a-d2af-4f7a-a5a4-5e98d0779564 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=7d8dd874b3674087a3e969424a561530" status: 200 len: 4825 microversion: 2.1 time: 0.898230 Sep 07 12:33:06.698319 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 592/1185] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Sep 7 12:33:05 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=7d8dd874b3674087a3e969424a561530 => generated 4825 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:06.708315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-417b685b-8660-410c-8b2c-a2e68e3675bb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1753573316", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:06.799258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-417b685b-8660-410c-8b2c-a2e68e3675bb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:33:07.085734 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d316cd74-66d9-43fc-80c5-098b3c485b75 tempest-SecurityGroupsTestAdminJSON-1944242648 tempest-SecurityGroupsTestAdminJSON-1944242648-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.778052 Sep 07 12:33:07.086529 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 594/1186] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Sep 7 12:33:06 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:33:07.093958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a2ce23ca-ba19-42c9-bca9-ed51e3998dea tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:07.104567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a2ce23ca-ba19-42c9-bca9-ed51e3998dea tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Searching by: {'tenant_id': '6dd91a3f3f744b1494d0db4d5a4c5c79', 'deleted': False} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:33:07.110943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2ce23ca-ba19-42c9-bca9-ed51e3998dea tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:07.111592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2ce23ca-ba19-42c9-bca9-ed51e3998dea tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:07.112339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2ce23ca-ba19-42c9-bca9-ed51e3998dea tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:07.113442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2ce23ca-ba19-42c9-bca9-ed51e3998dea tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:07.114318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2ce23ca-ba19-42c9-bca9-ed51e3998dea tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:07.114776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2ce23ca-ba19-42c9-bca9-ed51e3998dea tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:07.154683 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a2ce23ca-ba19-42c9-bca9-ed51e3998dea tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6dd91a3f3f744b1494d0db4d5a4c5c79" status: 200 len: 15 microversion: 2.1 time: 0.065850 Sep 07 12:33:07.156149 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 595/1187] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Sep 7 12:33:07 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6dd91a3f3f744b1494d0db4d5a4c5c79 => generated 15 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:33:07.162156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f1728107-a1e6-4808-95af-8cafc97a9773 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:07.163257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f1728107-a1e6-4808-95af-8cafc97a9773 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:07.173197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1728107-a1e6-4808-95af-8cafc97a9773 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:07.174367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1728107-a1e6-4808-95af-8cafc97a9773 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:07.175141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1728107-a1e6-4808-95af-8cafc97a9773 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:07.176117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1728107-a1e6-4808-95af-8cafc97a9773 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:07.176790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1728107-a1e6-4808-95af-8cafc97a9773 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:07.177422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1728107-a1e6-4808-95af-8cafc97a9773 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:07.624287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-417b685b-8660-410c-8b2c-a2e68e3675bb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:33:07.624788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-417b685b-8660-410c-8b2c-a2e68e3675bb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:33:07.625270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-417b685b-8660-410c-8b2c-a2e68e3675bb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:33:07.625718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-417b685b-8660-410c-8b2c-a2e68e3675bb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:33:07.626202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-417b685b-8660-410c-8b2c-a2e68e3675bb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:33:07.647794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-417b685b-8660-410c-8b2c-a2e68e3675bb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:07.648473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-417b685b-8660-410c-8b2c-a2e68e3675bb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:07.649186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-417b685b-8660-410c-8b2c-a2e68e3675bb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:07.651074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-417b685b-8660-410c-8b2c-a2e68e3675bb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:07.651621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-417b685b-8660-410c-8b2c-a2e68e3675bb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:07.652060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-417b685b-8660-410c-8b2c-a2e68e3675bb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:07.672182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-417b685b-8660-410c-8b2c-a2e68e3675bb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Getting quotas for project 43a1115550de4c5185de7ca86bc17a63. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:33:07.678884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-417b685b-8660-410c-8b2c-a2e68e3675bb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Getting quotas for user 1b5c31587a37465a9becda30e417ed5b and project 43a1115550de4c5185de7ca86bc17a63. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:33:07.681932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f1728107-a1e6-4808-95af-8cafc97a9773 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:07.695420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-417b685b-8660-410c-8b2c-a2e68e3675bb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:33:07.697860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-417b685b-8660-410c-8b2c-a2e68e3675bb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:33:07.703720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f1728107-a1e6-4808-95af-8cafc97a9773 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:07.714030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f1728107-a1e6-4808-95af-8cafc97a9773 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:07.718925 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f1728107-a1e6-4808-95af-8cafc97a9773 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1567 microversion: 2.25 time: 0.559984 Sep 07 12:33:07.722956 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 596/1188] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:07 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1567 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:07.784504 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-417b685b-8660-410c-8b2c-a2e68e3675bb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.083869 Sep 07 12:33:07.789952 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 593/1189] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:33:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:33:07.799464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df295948-60ed-4c3f-93f6-b47e877be3f1 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:07.812186 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-df295948-60ed-4c3f-93f6-b47e877be3f1 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.019341 Sep 07 12:33:07.813687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-520a0cf8-061b-477a-abf6-3d7b12308f83 tempest-SecurityGroupsTestAdminJSON-1336352882 tempest-SecurityGroupsTestAdminJSON-1336352882-project-admin] Action: 'create', calling method: .version_select at 0x7fc41d164dc0>, body: {"security_group": {"name": "tempest-securitygroup-1873973100", "description": "tempest-description-1928756179"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:07.814245 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 594/1190] 10.222.0.16 () {58 vars in 1189 bytes} [Wed Sep 7 12:33:07 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:33:07.826027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7fc4d240-c361-437a-aff1-250e4c2cb6a1 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:07.828810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7fc4d240-c361-437a-aff1-250e4c2cb6a1 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:07.846726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fc4d240-c361-437a-aff1-250e4c2cb6a1 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:07.847689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fc4d240-c361-437a-aff1-250e4c2cb6a1 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:07.848472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fc4d240-c361-437a-aff1-250e4c2cb6a1 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:07.849998 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fc4d240-c361-437a-aff1-250e4c2cb6a1 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:07.850816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fc4d240-c361-437a-aff1-250e4c2cb6a1 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:07.851558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fc4d240-c361-437a-aff1-250e4c2cb6a1 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:08.035444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7fc4d240-c361-437a-aff1-250e4c2cb6a1 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:08.065579 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7fc4d240-c361-437a-aff1-250e4c2cb6a1 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:08.069061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7fc4d240-c361-437a-aff1-250e4c2cb6a1 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:08.082789 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7fc4d240-c361-437a-aff1-250e4c2cb6a1 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.263524 Sep 07 12:33:08.099657 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 595/1191] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:07 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:08.119195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2a674825-2862-4fca-a6fa-0a1cdf01cb0f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:08.127347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2a674825-2862-4fca-a6fa-0a1cdf01cb0f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:08.273924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2a674825-2862-4fca-a6fa-0a1cdf01cb0f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:08.289237 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2a674825-2862-4fca-a6fa-0a1cdf01cb0f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1213 microversion: 2.1 time: 0.187814 Sep 07 12:33:08.293429 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 596/1192] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:08 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1213 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:08.302369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0d3f1478-d513-4e03-920b-78805a5b046a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:08.306743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0d3f1478-d513-4e03-920b-78805a5b046a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:08.334874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d3f1478-d513-4e03-920b-78805a5b046a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:08.335971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d3f1478-d513-4e03-920b-78805a5b046a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:08.336845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d3f1478-d513-4e03-920b-78805a5b046a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:08.339195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d3f1478-d513-4e03-920b-78805a5b046a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:08.341857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d3f1478-d513-4e03-920b-78805a5b046a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:08.342969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d3f1478-d513-4e03-920b-78805a5b046a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:08.486978 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0d3f1478-d513-4e03-920b-78805a5b046a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb/action" status: 202 len: 0 microversion: 2.1 time: 0.191695 Sep 07 12:33:08.489584 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 597/1193] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:33:08 2022] POST /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:33:08.497267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-95d090a2-49a9-4199-8103-4cbcf17ab410 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:08.501735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-95d090a2-49a9-4199-8103-4cbcf17ab410 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:08.502464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-95d090a2-49a9-4199-8103-4cbcf17ab410 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '7d8dd874b3674087a3e969424a561530'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:33:08.511411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95d090a2-49a9-4199-8103-4cbcf17ab410 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:08.511905 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95d090a2-49a9-4199-8103-4cbcf17ab410 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:08.512420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95d090a2-49a9-4199-8103-4cbcf17ab410 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:08.513169 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95d090a2-49a9-4199-8103-4cbcf17ab410 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:08.513676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95d090a2-49a9-4199-8103-4cbcf17ab410 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:08.514136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95d090a2-49a9-4199-8103-4cbcf17ab410 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:08.717410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-95d090a2-49a9-4199-8103-4cbcf17ab410 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:33:08.804226 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-95d090a2-49a9-4199-8103-4cbcf17ab410 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.311265 Sep 07 12:33:08.805813 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 598/1194] 10.222.0.16 () {58 vars in 1150 bytes} [Wed Sep 7 12:33:08 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:33:08.815452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2134133d-3d11-4ff6-a651-ad381ea1a90b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:08.816555 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2134133d-3d11-4ff6-a651-ad381ea1a90b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:08.831117 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-520a0cf8-061b-477a-abf6-3d7b12308f83 tempest-SecurityGroupsTestAdminJSON-1336352882 tempest-SecurityGroupsTestAdminJSON-1336352882-project-admin] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.103471 Sep 07 12:33:08.832223 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 597/1195] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Sep 7 12:33:07 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:33:08.840022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2134133d-3d11-4ff6-a651-ad381ea1a90b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:08.841340 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2134133d-3d11-4ff6-a651-ad381ea1a90b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:08.842195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2134133d-3d11-4ff6-a651-ad381ea1a90b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:08.843472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2134133d-3d11-4ff6-a651-ad381ea1a90b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:08.844138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2134133d-3d11-4ff6-a651-ad381ea1a90b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:08.844685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2134133d-3d11-4ff6-a651-ad381ea1a90b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:08.848124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-29774715-e1b2-4d16-ada9-013757e32dd7 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:08.870881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-29774715-e1b2-4d16-ada9-013757e32dd7 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:08.927145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29774715-e1b2-4d16-ada9-013757e32dd7 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:08.930238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29774715-e1b2-4d16-ada9-013757e32dd7 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:08.930860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29774715-e1b2-4d16-ada9-013757e32dd7 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:08.931673 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29774715-e1b2-4d16-ada9-013757e32dd7 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:08.932163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29774715-e1b2-4d16-ada9-013757e32dd7 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:08.932598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29774715-e1b2-4d16-ada9-013757e32dd7 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:09.084525 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-29774715-e1b2-4d16-ada9-013757e32dd7 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb/action" status: 202 len: 0 microversion: 2.1 time: 0.250259 Sep 07 12:33:09.088541 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 598/1196] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:33:08 2022] POST /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:33:09.093893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7fff2355-1c15-4ab0-9630-5b1da672ec43 tempest-SecurityGroupsTestAdminJSON-1336352882 tempest-SecurityGroupsTestAdminJSON-1336352882-project-admin] Action: 'create', calling method: .version_select at 0x7fc41d1ce9d0>, body: {"security_group": {"name": "tempest-securitygroup-1536449852", "description": "tempest-description-1688440955"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:09.400313 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7fff2355-1c15-4ab0-9630-5b1da672ec43 tempest-SecurityGroupsTestAdminJSON-1336352882 tempest-SecurityGroupsTestAdminJSON-1336352882-project-admin] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.312274 Sep 07 12:33:09.408883 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 599/1197] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Sep 7 12:33:09 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:33:09.408883 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-05244083-c785-403b-9547-ad1065aa7332 req-d409b08d-1f53-4f66-9c83-6f735fc21557 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9916ff29-8e9b-41f7-bbde-3f987cd0c9ec", "tag": "7120d1ee-a3b5-4407-ba59-4de91da3dd76"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:09.420885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-05244083-c785-403b-9547-ad1065aa7332 req-d409b08d-1f53-4f66-9c83-6f735fc21557 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:09.421527 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-05244083-c785-403b-9547-ad1065aa7332 req-d409b08d-1f53-4f66-9c83-6f735fc21557 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:09.422152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-05244083-c785-403b-9547-ad1065aa7332 req-d409b08d-1f53-4f66-9c83-6f735fc21557 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:09.434792 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-05244083-c785-403b-9547-ad1065aa7332 req-d409b08d-1f53-4f66-9c83-6f735fc21557 service nova] Creating event network-changed:7120d1ee-a3b5-4407-ba59-4de91da3dd76 for instance 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec on n-h1-852087-9 Sep 07 12:33:09.440350 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-05244083-c785-403b-9547-ad1065aa7332 req-d409b08d-1f53-4f66-9c83-6f735fc21557 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037503 Sep 07 12:33:09.441438 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 600/1198] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:33:09.446398 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-12c508c9-9156-41ae-a5a5-9d169114cc43 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:09.447240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-12c508c9-9156-41ae-a5a5-9d169114cc43 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:09.456071 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12c508c9-9156-41ae-a5a5-9d169114cc43 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:09.456730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12c508c9-9156-41ae-a5a5-9d169114cc43 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:09.458049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12c508c9-9156-41ae-a5a5-9d169114cc43 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:09.458997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12c508c9-9156-41ae-a5a5-9d169114cc43 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:09.459570 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12c508c9-9156-41ae-a5a5-9d169114cc43 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:09.460101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12c508c9-9156-41ae-a5a5-9d169114cc43 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:09.474320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2134133d-3d11-4ff6-a651-ad381ea1a90b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:09.483944 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2134133d-3d11-4ff6-a651-ad381ea1a90b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:09.485551 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2134133d-3d11-4ff6-a651-ad381ea1a90b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:09.486855 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2134133d-3d11-4ff6-a651-ad381ea1a90b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1567 microversion: 2.25 time: 0.679394 Sep 07 12:33:09.492488 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 599/1199] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:08 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1567 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:09.503461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d4518f7-2650-472e-95e9-559072b38789 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:09.504255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9d4518f7-2650-472e-95e9-559072b38789 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:09.512744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d4518f7-2650-472e-95e9-559072b38789 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:09.513429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d4518f7-2650-472e-95e9-559072b38789 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:09.514042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d4518f7-2650-472e-95e9-559072b38789 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:09.515074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d4518f7-2650-472e-95e9-559072b38789 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:09.515940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d4518f7-2650-472e-95e9-559072b38789 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:09.516183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d4518f7-2650-472e-95e9-559072b38789 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:09.592183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9d4518f7-2650-472e-95e9-559072b38789 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:09.602280 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9d4518f7-2650-472e-95e9-559072b38789 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:09.603826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9d4518f7-2650-472e-95e9-559072b38789 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:09.611257 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9d4518f7-2650-472e-95e9-559072b38789 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.116841 Sep 07 12:33:09.612293 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 600/1200] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:09 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:09.617398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ae835b72-e2eb-495c-aa45-22afa2129298 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:09.618238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ae835b72-e2eb-495c-aa45-22afa2129298 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:09.624525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae835b72-e2eb-495c-aa45-22afa2129298 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:09.625171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae835b72-e2eb-495c-aa45-22afa2129298 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:09.625668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae835b72-e2eb-495c-aa45-22afa2129298 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:09.626388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae835b72-e2eb-495c-aa45-22afa2129298 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:09.626855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae835b72-e2eb-495c-aa45-22afa2129298 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:09.627287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae835b72-e2eb-495c-aa45-22afa2129298 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:09.658250 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-12c508c9-9156-41ae-a5a5-9d169114cc43 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1614 microversion: 2.1 time: 0.215771 Sep 07 12:33:09.659521 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 601/1201] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:09 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1614 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:09.664445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ba89bd2-4bbf-43e3-b358-9770be29ccdc tempest-SecurityGroupsTestAdminJSON-1336352882 tempest-SecurityGroupsTestAdminJSON-1336352882-project-admin] Calling method '.version_select at 0x7fc41d1643a0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:09.743176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ae835b72-e2eb-495c-aa45-22afa2129298 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:09.758464 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ae835b72-e2eb-495c-aa45-22afa2129298 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1265 microversion: 2.1 time: 0.145005 Sep 07 12:33:09.777241 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 601/1202] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:09 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:09.785455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d3be99e3-4115-4271-bd22-0bc50163e113 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:09.787343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d3be99e3-4115-4271-bd22-0bc50163e113 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:09.794386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3be99e3-4115-4271-bd22-0bc50163e113 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:09.794890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3be99e3-4115-4271-bd22-0bc50163e113 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:09.795330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3be99e3-4115-4271-bd22-0bc50163e113 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:09.797061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3be99e3-4115-4271-bd22-0bc50163e113 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:09.797784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3be99e3-4115-4271-bd22-0bc50163e113 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:09.798379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3be99e3-4115-4271-bd22-0bc50163e113 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:10.875058 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d3be99e3-4115-4271-bd22-0bc50163e113 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1614 microversion: 2.1 time: 1.096156 Sep 07 12:33:10.876085 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 602/1203] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:09 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1614 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:10.882909 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0ef722c0-2cd2-4820-86d2-6d7c2c535a47 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:10.883547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0ef722c0-2cd2-4820-86d2-6d7c2c535a47 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:10.892132 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ef722c0-2cd2-4820-86d2-6d7c2c535a47 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:10.893402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ef722c0-2cd2-4820-86d2-6d7c2c535a47 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:10.894355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ef722c0-2cd2-4820-86d2-6d7c2c535a47 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:10.895663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ef722c0-2cd2-4820-86d2-6d7c2c535a47 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:10.896582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ef722c0-2cd2-4820-86d2-6d7c2c535a47 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:10.897361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ef722c0-2cd2-4820-86d2-6d7c2c535a47 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:11.464828 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0ef722c0-2cd2-4820-86d2-6d7c2c535a47 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:11.481046 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0ef722c0-2cd2-4820-86d2-6d7c2c535a47 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:11.484892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0ef722c0-2cd2-4820-86d2-6d7c2c535a47 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:11.487126 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0ef722c0-2cd2-4820-86d2-6d7c2c535a47 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1567 microversion: 2.25 time: 0.609291 Sep 07 12:33:11.488774 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 603/1204] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:10 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1567 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:11.497606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ec7c8001-7452-4846-a883-4db31839ee3a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:11.498502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ec7c8001-7452-4846-a883-4db31839ee3a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:11.510580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec7c8001-7452-4846-a883-4db31839ee3a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:11.511642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec7c8001-7452-4846-a883-4db31839ee3a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:11.512606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec7c8001-7452-4846-a883-4db31839ee3a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:11.514336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec7c8001-7452-4846-a883-4db31839ee3a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:11.515221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec7c8001-7452-4846-a883-4db31839ee3a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:11.515966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec7c8001-7452-4846-a883-4db31839ee3a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:11.661178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ec7c8001-7452-4846-a883-4db31839ee3a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:11.678589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ec7c8001-7452-4846-a883-4db31839ee3a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:11.681716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ec7c8001-7452-4846-a883-4db31839ee3a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:11.691323 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ec7c8001-7452-4846-a883-4db31839ee3a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.200766 Sep 07 12:33:11.692354 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 604/1205] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:11 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:11.703509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cd05a13e-c540-46f5-9d6f-af6b06ba2aa5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:11.704601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cd05a13e-c540-46f5-9d6f-af6b06ba2aa5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:11.716613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd05a13e-c540-46f5-9d6f-af6b06ba2aa5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:11.717670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd05a13e-c540-46f5-9d6f-af6b06ba2aa5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:11.718617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd05a13e-c540-46f5-9d6f-af6b06ba2aa5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:11.720392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd05a13e-c540-46f5-9d6f-af6b06ba2aa5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:11.720919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd05a13e-c540-46f5-9d6f-af6b06ba2aa5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:11.721374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd05a13e-c540-46f5-9d6f-af6b06ba2aa5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:11.896676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cd05a13e-c540-46f5-9d6f-af6b06ba2aa5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:11.906107 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cd05a13e-c540-46f5-9d6f-af6b06ba2aa5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1271 microversion: 2.1 time: 0.212204 Sep 07 12:33:11.906709 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 605/1206] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:11 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1271 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:11.912405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1ed1e434-7c32-41c7-97cb-3219080e2c3a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:11.919386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1ed1e434-7c32-41c7-97cb-3219080e2c3a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Searching by: {'host': 'n-h2-852087-9', 'deleted': False} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:33:11.925113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ed1e434-7c32-41c7-97cb-3219080e2c3a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:11.925712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ed1e434-7c32-41c7-97cb-3219080e2c3a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:11.926210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ed1e434-7c32-41c7-97cb-3219080e2c3a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:11.926921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ed1e434-7c32-41c7-97cb-3219080e2c3a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:11.928051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ed1e434-7c32-41c7-97cb-3219080e2c3a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:11.928490 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ed1e434-7c32-41c7-97cb-3219080e2c3a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:12.058585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-1ed1e434-7c32-41c7-97cb-3219080e2c3a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:33:12.077838 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:33:12.130452 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1ed1e434-7c32-41c7-97cb-3219080e2c3a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers?host=n-h2-852087-9&all_tenants=1" status: 200 len: 2304 microversion: 2.1 time: 0.222432 Sep 07 12:33:12.132374 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 606/1207] 10.222.0.16 () {58 vars in 1190 bytes} [Wed Sep 7 12:33:11 2022] GET /compute/v2.1/servers?host=n-h2-852087-9&all_tenants=1 => generated 2304 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:12.146482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ab40187-24a3-4ff6-9e09-3d0fd09d100f tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:12.152971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5ab40187-24a3-4ff6-9e09-3d0fd09d100f tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:33:12.159139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ab40187-24a3-4ff6-9e09-3d0fd09d100f tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:12.159707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ab40187-24a3-4ff6-9e09-3d0fd09d100f tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:12.160163 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ab40187-24a3-4ff6-9e09-3d0fd09d100f tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:12.160921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ab40187-24a3-4ff6-9e09-3d0fd09d100f tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:12.161379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ab40187-24a3-4ff6-9e09-3d0fd09d100f tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:12.161894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ab40187-24a3-4ff6-9e09-3d0fd09d100f tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:12.185225 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5ab40187-24a3-4ff6-9e09-3d0fd09d100f tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.042504 Sep 07 12:33:12.186177 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 607/1208] 10.222.0.16 () {58 vars in 1196 bytes} [Wed Sep 7 12:33:12 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 12:33:12.200020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-21ddd4c6-2456-4be1-ad83-4a28c30713f5 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:12.202800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-21ddd4c6-2456-4be1-ad83-4a28c30713f5 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:12.209811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21ddd4c6-2456-4be1-ad83-4a28c30713f5 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:12.210315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21ddd4c6-2456-4be1-ad83-4a28c30713f5 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:12.210923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21ddd4c6-2456-4be1-ad83-4a28c30713f5 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:12.211708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21ddd4c6-2456-4be1-ad83-4a28c30713f5 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:12.212224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21ddd4c6-2456-4be1-ad83-4a28c30713f5 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:12.212718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21ddd4c6-2456-4be1-ad83-4a28c30713f5 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:12.327054 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-21ddd4c6-2456-4be1-ad83-4a28c30713f5 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb/action" status: 202 len: 0 microversion: 2.1 time: 0.131752 Sep 07 12:33:12.331928 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 608/1209] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:33:12 2022] POST /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 12:33:12.338668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b92636ef-7c49-4253-bb28-b11f030cd7c3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:12.341667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b92636ef-7c49-4253-bb28-b11f030cd7c3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:12.348320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b92636ef-7c49-4253-bb28-b11f030cd7c3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:12.348829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b92636ef-7c49-4253-bb28-b11f030cd7c3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:12.349268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b92636ef-7c49-4253-bb28-b11f030cd7c3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:12.350041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b92636ef-7c49-4253-bb28-b11f030cd7c3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:12.350502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b92636ef-7c49-4253-bb28-b11f030cd7c3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:12.350932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b92636ef-7c49-4253-bb28-b11f030cd7c3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:12.452490 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b92636ef-7c49-4253-bb28-b11f030cd7c3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:33:12.453007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b92636ef-7c49-4253-bb28-b11f030cd7c3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:33:12.454124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b92636ef-7c49-4253-bb28-b11f030cd7c3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:33:12.454847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b92636ef-7c49-4253-bb28-b11f030cd7c3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:33:12.455680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b92636ef-7c49-4253-bb28-b11f030cd7c3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:33:12.546466 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b92636ef-7c49-4253-bb28-b11f030cd7c3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:12.558015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b92636ef-7c49-4253-bb28-b11f030cd7c3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:12.559249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b92636ef-7c49-4253-bb28-b11f030cd7c3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:12.560192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b92636ef-7c49-4253-bb28-b11f030cd7c3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:12.561712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b92636ef-7c49-4253-bb28-b11f030cd7c3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:12.562724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b92636ef-7c49-4253-bb28-b11f030cd7c3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:12.563595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b92636ef-7c49-4253-bb28-b11f030cd7c3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:12.616501 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b92636ef-7c49-4253-bb28-b11f030cd7c3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "POST /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb/action" status: 202 len: 1067 microversion: 2.1 time: 0.283089 Sep 07 12:33:12.617731 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 609/1210] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:33:12 2022] POST /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb/action => generated 1067 bytes in 285 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Sep 07 12:33:12.640058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ebb7a4be-71f3-444b-ba37-e39e5f2a922f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:12.640906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ebb7a4be-71f3-444b-ba37-e39e5f2a922f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:12.649781 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebb7a4be-71f3-444b-ba37-e39e5f2a922f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:12.650709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebb7a4be-71f3-444b-ba37-e39e5f2a922f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:12.651482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebb7a4be-71f3-444b-ba37-e39e5f2a922f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:12.652419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebb7a4be-71f3-444b-ba37-e39e5f2a922f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:12.653064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebb7a4be-71f3-444b-ba37-e39e5f2a922f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:12.654214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebb7a4be-71f3-444b-ba37-e39e5f2a922f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:13.265561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ebb7a4be-71f3-444b-ba37-e39e5f2a922f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:13.285361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ebb7a4be-71f3-444b-ba37-e39e5f2a922f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:13.288298 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ebb7a4be-71f3-444b-ba37-e39e5f2a922f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:13.290707 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ebb7a4be-71f3-444b-ba37-e39e5f2a922f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1567 microversion: 2.25 time: 0.671263 Sep 07 12:33:13.293434 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 610/1211] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:12 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1567 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:13.301995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-323a9250-232d-4296-addf-7e92342187dc tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:13.303290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-323a9250-232d-4296-addf-7e92342187dc tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:13.321521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-323a9250-232d-4296-addf-7e92342187dc tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:13.321521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-323a9250-232d-4296-addf-7e92342187dc tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:13.321521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-323a9250-232d-4296-addf-7e92342187dc tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:13.321521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-323a9250-232d-4296-addf-7e92342187dc tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:13.322493 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-323a9250-232d-4296-addf-7e92342187dc tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:13.322493 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-323a9250-232d-4296-addf-7e92342187dc tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:13.594663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-323a9250-232d-4296-addf-7e92342187dc tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:13.604571 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-323a9250-232d-4296-addf-7e92342187dc tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1471 microversion: 2.1 time: 0.310637 Sep 07 12:33:13.623373 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 611/1212] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:13 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1471 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:13.623373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df45a58e-b26b-4e39-ba99-122d1a25114e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:13.623373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-df45a58e-b26b-4e39-ba99-122d1a25114e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:13.636382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df45a58e-b26b-4e39-ba99-122d1a25114e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:13.637324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df45a58e-b26b-4e39-ba99-122d1a25114e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:13.638419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df45a58e-b26b-4e39-ba99-122d1a25114e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:13.639921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df45a58e-b26b-4e39-ba99-122d1a25114e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:13.641220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df45a58e-b26b-4e39-ba99-122d1a25114e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:13.642761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df45a58e-b26b-4e39-ba99-122d1a25114e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:13.787179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-df45a58e-b26b-4e39-ba99-122d1a25114e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:13.799374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-df45a58e-b26b-4e39-ba99-122d1a25114e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:13.801075 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-df45a58e-b26b-4e39-ba99-122d1a25114e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:13.807414 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-df45a58e-b26b-4e39-ba99-122d1a25114e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.199119 Sep 07 12:33:13.822132 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 612/1213] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:13 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:13.830961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a5baf591-c867-4973-9637-a8f7c3606a69 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:13.832509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a5baf591-c867-4973-9637-a8f7c3606a69 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:13.842734 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5baf591-c867-4973-9637-a8f7c3606a69 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:13.843736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5baf591-c867-4973-9637-a8f7c3606a69 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:13.844586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5baf591-c867-4973-9637-a8f7c3606a69 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:13.846609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5baf591-c867-4973-9637-a8f7c3606a69 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:13.847712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5baf591-c867-4973-9637-a8f7c3606a69 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:13.848157 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5baf591-c867-4973-9637-a8f7c3606a69 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:14.716409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a5baf591-c867-4973-9637-a8f7c3606a69 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:14.729681 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a5baf591-c867-4973-9637-a8f7c3606a69 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1313 microversion: 2.1 time: 0.904723 Sep 07 12:33:14.731383 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 613/1214] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:13 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1313 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:14.742172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-109dce45-fdea-42d7-b636-e198d2acf31c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:14.743648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-109dce45-fdea-42d7-b636-e198d2acf31c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:14.760554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-109dce45-fdea-42d7-b636-e198d2acf31c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:14.761603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-109dce45-fdea-42d7-b636-e198d2acf31c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:14.762696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-109dce45-fdea-42d7-b636-e198d2acf31c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:14.764169 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-109dce45-fdea-42d7-b636-e198d2acf31c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:14.765088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-109dce45-fdea-42d7-b636-e198d2acf31c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:14.765927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-109dce45-fdea-42d7-b636-e198d2acf31c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:15.315799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-109dce45-fdea-42d7-b636-e198d2acf31c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:15.360018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-109dce45-fdea-42d7-b636-e198d2acf31c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:15.362280 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-109dce45-fdea-42d7-b636-e198d2acf31c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:15.363835 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-109dce45-fdea-42d7-b636-e198d2acf31c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1542 microversion: 2.25 time: 0.630439 Sep 07 12:33:15.364603 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 614/1215] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:14 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1542 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:15.376555 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-65e2f73c-156d-416d-9955-a6dcccfc1553 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:15.377394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-65e2f73c-156d-416d-9955-a6dcccfc1553 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:15.380000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:33:15.392365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65e2f73c-156d-416d-9955-a6dcccfc1553 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:15.393537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65e2f73c-156d-416d-9955-a6dcccfc1553 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:15.394221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65e2f73c-156d-416d-9955-a6dcccfc1553 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:15.395556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65e2f73c-156d-416d-9955-a6dcccfc1553 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:15.396273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65e2f73c-156d-416d-9955-a6dcccfc1553 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:15.396927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65e2f73c-156d-416d-9955-a6dcccfc1553 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:15.726329 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-65e2f73c-156d-416d-9955-a6dcccfc1553 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1857 microversion: 2.1 time: 0.360322 Sep 07 12:33:15.742175 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 615/1216] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:15 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1857 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:15.749706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6666ef11-6895-4fcd-8c8a-665e2db53783 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:15.750506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6666ef11-6895-4fcd-8c8a-665e2db53783 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:15.761422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6666ef11-6895-4fcd-8c8a-665e2db53783 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:15.761990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6666ef11-6895-4fcd-8c8a-665e2db53783 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:15.762442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6666ef11-6895-4fcd-8c8a-665e2db53783 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:15.763538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6666ef11-6895-4fcd-8c8a-665e2db53783 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:15.764517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6666ef11-6895-4fcd-8c8a-665e2db53783 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:15.765561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6666ef11-6895-4fcd-8c8a-665e2db53783 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:16.107098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6666ef11-6895-4fcd-8c8a-665e2db53783 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:16.119299 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6666ef11-6895-4fcd-8c8a-665e2db53783 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1471 microversion: 2.1 time: 0.375846 Sep 07 12:33:16.120233 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 616/1217] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:15 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1471 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:16.132841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-65049ac8-6540-4a2a-81a9-0c87e5d6115e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:16.136194 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-65049ac8-6540-4a2a-81a9-0c87e5d6115e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:16.168192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65049ac8-6540-4a2a-81a9-0c87e5d6115e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:16.169078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65049ac8-6540-4a2a-81a9-0c87e5d6115e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:16.170036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65049ac8-6540-4a2a-81a9-0c87e5d6115e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:16.171296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65049ac8-6540-4a2a-81a9-0c87e5d6115e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:16.174224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65049ac8-6540-4a2a-81a9-0c87e5d6115e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:16.175029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65049ac8-6540-4a2a-81a9-0c87e5d6115e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:16.302551 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-65049ac8-6540-4a2a-81a9-0c87e5d6115e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:16.313455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-65049ac8-6540-4a2a-81a9-0c87e5d6115e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:16.315265 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-65049ac8-6540-4a2a-81a9-0c87e5d6115e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:16.322184 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-65049ac8-6540-4a2a-81a9-0c87e5d6115e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.200563 Sep 07 12:33:16.322797 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 617/1218] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:16 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:16.329971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-34fc8d85-a842-4781-bbab-f318879d3844 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Calling method '.version_select at 0x7fc4192fda60>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:16.334691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34fc8d85-a842-4781-bbab-f318879d3844 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:16.336039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34fc8d85-a842-4781-bbab-f318879d3844 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:16.336646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34fc8d85-a842-4781-bbab-f318879d3844 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:16.362262 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-34fc8d85-a842-4781-bbab-f318879d3844 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2961 microversion: 2.25 time: 0.038124 Sep 07 12:33:16.363642 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 618/1219] 10.222.0.16 () {60 vars in 1184 bytes} [Wed Sep 7 12:33:16 2022] GET /compute/v2.1/os-migrations => generated 2961 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:16.507362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ec88bbac-6f4a-4790-b8d6-8493dd49e810 tempest-VolumesAdminNegativeTest-836581950 tempest-VolumesAdminNegativeTest-836581950-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "639c61b0-e22d-44b6-9f1b-4d4185bd665e"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:16.510878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ec88bbac-6f4a-4790-b8d6-8493dd49e810 tempest-VolumesAdminNegativeTest-836581950 tempest-VolumesAdminNegativeTest-836581950-project-admin] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:16.518457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec88bbac-6f4a-4790-b8d6-8493dd49e810 tempest-VolumesAdminNegativeTest-836581950 tempest-VolumesAdminNegativeTest-836581950-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:16.518962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec88bbac-6f4a-4790-b8d6-8493dd49e810 tempest-VolumesAdminNegativeTest-836581950 tempest-VolumesAdminNegativeTest-836581950-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:16.519396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec88bbac-6f4a-4790-b8d6-8493dd49e810 tempest-VolumesAdminNegativeTest-836581950 tempest-VolumesAdminNegativeTest-836581950-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:16.520113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec88bbac-6f4a-4790-b8d6-8493dd49e810 tempest-VolumesAdminNegativeTest-836581950 tempest-VolumesAdminNegativeTest-836581950-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:16.520571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec88bbac-6f4a-4790-b8d6-8493dd49e810 tempest-VolumesAdminNegativeTest-836581950 tempest-VolumesAdminNegativeTest-836581950-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:16.521001 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec88bbac-6f4a-4790-b8d6-8493dd49e810 tempest-VolumesAdminNegativeTest-836581950 tempest-VolumesAdminNegativeTest-836581950-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:16.732929 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-ec88bbac-6f4a-4790-b8d6-8493dd49e810 tempest-VolumesAdminNegativeTest-836581950 tempest-VolumesAdminNegativeTest-836581950-project-admin] HTTP exception thrown: Volume 639c61b0-e22d-44b6-9f1b-4d4185bd665e could not be found. Sep 07 12:33:16.793730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ec88bbac-6f4a-4790-b8d6-8493dd49e810 tempest-VolumesAdminNegativeTest-836581950 tempest-VolumesAdminNegativeTest-836581950-project-admin] Request method failure captured: Sep 07 12:33:16.793730 n-d-852087-9 devstack@n-api.service[122432]: request: PUT /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9/os-volume_attachments/e746707e-5337-41cc-ab63-601c8da6b9c8 HTTP/1.1 Sep 07 12:33:16.793730 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:33:16.793730 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:33:16.793730 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:33:16.793730 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 74 Sep 07 12:33:16.793730 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:33:16.793730 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:33:16.793730 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:33:16.793730 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:33:16.793730 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI7vsNA2B4j3Jgtww0yYV2-SNyVTEm9WFWr9ZSj3tAgxES5DoZ1FeV039YIMwaXfYyhl_mhF6HicF9CLiopmx7ctE0gyZrvv4GgkfCMMI2UwkJW4l3HePsj3KrmfufexApUX8LBRqnCcDabFBvDqOX0WYprfQ8HviIHLyAeKLs4S4PI Sep 07 12:33:16.793730 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:33:16.793730 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:33:16.793730 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:33:16.793730 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:33:16.793730 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:33:16.793730 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:33:16.793730 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 88fb85e95388477eba2678bb14aa8f19 Sep 07 12:33:16.793730 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-VolumesAdminNegativeTest-836581950 Sep 07 12:33:16.793730 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member,admin Sep 07 12:33:16.793730 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member,admin Sep 07 12:33:16.796637 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/88fb85e95388477eba2678bb14aa8f19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_88fb85e95388477eba2678bb14aa8f19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/88fb85e95388477eba2678bb14aa8f19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/88fb85e95388477eba2678bb14aa8f19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:33:16.796637 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-VolumesAdminNegativeTest-836581950 Sep 07 12:33:16.796637 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 88fb85e95388477eba2678bb14aa8f19 Sep 07 12:33:16.796637 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-836581950 Sep 07 12:33:16.796637 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-VolumesAdminNegativeTest-836581950-project-admin Sep 07 12:33:16.796637 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:33:16.796637 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:33:16.796637 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 7e4a29379b2f4f088e715c982351d971 Sep 07 12:33:16.796637 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-VolumesAdminNegativeTest-836581950-project-admin Sep 07 12:33:16.796637 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:33:16.796637 n-d-852087-9 devstack@n-api.service[122432]: {"volumeAttachment": {"volumeId": "639c61b0-e22d-44b6-9f1b-4d4185bd665e"}} Sep 07 12:33:16.796637 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:33:16.796637 n-d-852087-9 devstack@n-api.service[122432]: exception: Volume 639c61b0-e22d-44b6-9f1b-4d4185bd665e could not be found. Sep 07 12:33:16.798498 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'server_id': 'd8042e17-76ed-448e-bca1-331aa1f708c9', 'id': 'e746707e-5337-41cc-ab63-601c8da6b9c8', 'body': {'volumeAttachment': {'volumeId': '639c61b0-e22d-44b6-9f1b-4d4185bd665e'}}} Sep 07 12:33:16.798498 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:33:16.798498 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:33:16.798498 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 12:33:16.798498 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 12:33:16.798498 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 12:33:16.798498 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 12:33:16.798498 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 12:33:16.798498 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 12:33:16.798498 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 12:33:16.798498 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 12:33:16.798498 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 12:33:16.798498 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 12:33:16.798498 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 12:33:16.798498 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 12:33:16.798498 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 12:33:16.798498 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 12:33:16.801723 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 639c61b0-e22d-44b6-9f1b-4d4185bd665e could not be found. (HTTP 404) (Request-ID: req-8692385f-7503-4385-8833-934f3ccfde6f) Sep 07 12:33:16.801723 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:33:16.801723 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:33:16.801723 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:33:16.801723 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:33:16.801723 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Sep 07 12:33:16.801723 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Sep 07 12:33:16.801723 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 12:33:16.801723 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 12:33:16.801723 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 12:33:16.801723 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 12:33:16.801723 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 12:33:16.801723 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 12:33:16.801723 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 12:33:16.801723 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 12:33:16.801723 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 12:33:16.801723 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 12:33:16.801723 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 12:33:16.801723 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 12:33:16.804225 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 12:33:16.804225 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 12:33:16.804225 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 12:33:16.804225 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 12:33:16.804225 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 12:33:16.804225 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 12:33:16.804225 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 12:33:16.804225 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 12:33:16.804225 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 639c61b0-e22d-44b6-9f1b-4d4185bd665e could not be found. Sep 07 12:33:16.804225 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:33:16.804225 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:33:16.804225 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:33:16.804225 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:33:16.804225 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:33:16.804225 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:33:16.804225 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:33:16.804225 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:33:16.804225 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:33:16.804225 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:33:16.806595 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:33:16.806595 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:33:16.806595 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:33:16.806595 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:33:16.806595 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 07 12:33:16.806595 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 07 12:33:16.806595 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Sep 07 12:33:16.806595 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 12:33:16.806595 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 639c61b0-e22d-44b6-9f1b-4d4185bd665e could not be found. Sep 07 12:33:16.806595 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:33:16.806595 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:33:16.806595 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:33:16.806595 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:33:16.806595 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:33:16.806595 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:33:16.806595 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:33:16.806595 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:33:16.806595 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 639c61b0-e22d-44b6-9f1b-4d4185bd665e could not be found. Sep 07 12:33:16.806595 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:33:16.813544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ec88bbac-6f4a-4790-b8d6-8493dd49e810 tempest-VolumesAdminNegativeTest-836581950 tempest-VolumesAdminNegativeTest-836581950-project-admin] Returning 400 to user: Volume 639c61b0-e22d-44b6-9f1b-4d4185bd665e could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:33:16.813544 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ec88bbac-6f4a-4790-b8d6-8493dd49e810 tempest-VolumesAdminNegativeTest-836581950 tempest-VolumesAdminNegativeTest-836581950-project-admin] 10.222.0.16 "PUT /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9/os-volume_attachments/e746707e-5337-41cc-ab63-601c8da6b9c8" status: 400 len: 107 microversion: 2.1 time: 0.431690 Sep 07 12:33:16.813544 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 619/1220] 10.222.0.16 () {60 vars in 1433 bytes} [Wed Sep 7 12:33:16 2022] PUT /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9/os-volume_attachments/e746707e-5337-41cc-ab63-601c8da6b9c8 => generated 107 bytes in 434 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:33:16.813544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9be78872-f793-4687-9258-3bede91b3f67 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852087-9", "block_migration": true, "disk_over_commit": false}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:16.814311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9be78872-f793-4687-9258-3bede91b3f67 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:16.826967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9be78872-f793-4687-9258-3bede91b3f67 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:16.827809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9be78872-f793-4687-9258-3bede91b3f67 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:16.828697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9be78872-f793-4687-9258-3bede91b3f67 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:16.829912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9be78872-f793-4687-9258-3bede91b3f67 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:16.830726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9be78872-f793-4687-9258-3bede91b3f67 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:16.832784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9be78872-f793-4687-9258-3bede91b3f67 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:16.883352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-9be78872-f793-4687-9258-3bede91b3f67 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lazy-loading 'flavor' on Instance uuid 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:33:16.902409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9be78872-f793-4687-9258-3bede91b3f67 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Going to try to live migrate instance to n-h2-852087-9 {{(pid=122432) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 07 12:33:16.908853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:33:16.959009 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ba89bd2-4bbf-43e3-b358-9770be29ccdc tempest-SecurityGroupsTestAdminJSON-1336352882 tempest-SecurityGroupsTestAdminJSON-1336352882-project-admin] 10.222.0.16 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 14979 microversion: 2.1 time: 7.297877 Sep 07 12:33:16.960026 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 602/1221] 10.222.0.16 () {58 vars in 1191 bytes} [Wed Sep 7 12:33:09 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 14979 bytes in 7300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:33:16.968884 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d75f5fa7-f8da-4b16-8dd0-7cedbd8508e5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:16.970445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d75f5fa7-f8da-4b16-8dd0-7cedbd8508e5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:16.982980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d75f5fa7-f8da-4b16-8dd0-7cedbd8508e5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:16.984431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d75f5fa7-f8da-4b16-8dd0-7cedbd8508e5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:16.985900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d75f5fa7-f8da-4b16-8dd0-7cedbd8508e5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:16.987504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d75f5fa7-f8da-4b16-8dd0-7cedbd8508e5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:16.988291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d75f5fa7-f8da-4b16-8dd0-7cedbd8508e5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:16.989161 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d75f5fa7-f8da-4b16-8dd0-7cedbd8508e5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:17.135145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=9 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:33:17.176838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d75f5fa7-f8da-4b16-8dd0-7cedbd8508e5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:17.189687 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d75f5fa7-f8da-4b16-8dd0-7cedbd8508e5 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1313 microversion: 2.1 time: 0.227859 Sep 07 12:33:17.190315 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 603/1222] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:16 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:17.196944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c007c605-7ac7-4fec-bee9-43b383d6704a req-67e2fb67-190b-4a74-8e85-78e22cf40f13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d12be6f4-80c9-404a-b6c4-d1e94e25daa9", "tag": "50b3c60a-51cc-4ed6-8a42-813229cfb0f8"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:17.209638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c007c605-7ac7-4fec-bee9-43b383d6704a req-67e2fb67-190b-4a74-8e85-78e22cf40f13 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:17.210341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c007c605-7ac7-4fec-bee9-43b383d6704a req-67e2fb67-190b-4a74-8e85-78e22cf40f13 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:17.210896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c007c605-7ac7-4fec-bee9-43b383d6704a req-67e2fb67-190b-4a74-8e85-78e22cf40f13 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:17.225563 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c007c605-7ac7-4fec-bee9-43b383d6704a req-67e2fb67-190b-4a74-8e85-78e22cf40f13 service nova] Creating event network-changed:50b3c60a-51cc-4ed6-8a42-813229cfb0f8 for instance d12be6f4-80c9-404a-b6c4-d1e94e25daa9 on n-h1-852087-9 Sep 07 12:33:17.231232 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c007c605-7ac7-4fec-bee9-43b383d6704a req-67e2fb67-190b-4a74-8e85-78e22cf40f13 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039643 Sep 07 12:33:17.231893 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 604/1223] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:33:17.237569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f350ab8-90c7-4a92-ad7f-0a14a7f88319 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:17.238378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0f350ab8-90c7-4a92-ad7f-0a14a7f88319 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:17.245436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f350ab8-90c7-4a92-ad7f-0a14a7f88319 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:17.246002 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f350ab8-90c7-4a92-ad7f-0a14a7f88319 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:17.246498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f350ab8-90c7-4a92-ad7f-0a14a7f88319 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:17.247224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f350ab8-90c7-4a92-ad7f-0a14a7f88319 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:17.247682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f350ab8-90c7-4a92-ad7f-0a14a7f88319 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:17.248154 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f350ab8-90c7-4a92-ad7f-0a14a7f88319 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:17.413842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-0f350ab8-90c7-4a92-ad7f-0a14a7f88319 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lazy-loading 'services' on Instance uuid 81fe7509-9012-4fcc-9f06-26693494f535 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:33:17.433143 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0f350ab8-90c7-4a92-ad7f-0a14a7f88319 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 2035 microversion: 2.25 time: 0.199728 Sep 07 12:33:17.434248 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 605/1224] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:17 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 2035 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:17.440629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ef407026-1279-4006-9b89-51fd124d1929 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:17.441285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ef407026-1279-4006-9b89-51fd124d1929 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:17.451060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef407026-1279-4006-9b89-51fd124d1929 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:17.451953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef407026-1279-4006-9b89-51fd124d1929 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:17.452551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef407026-1279-4006-9b89-51fd124d1929 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:17.453749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef407026-1279-4006-9b89-51fd124d1929 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:17.454880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef407026-1279-4006-9b89-51fd124d1929 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:17.455924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef407026-1279-4006-9b89-51fd124d1929 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:17.623205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-ef407026-1279-4006-9b89-51fd124d1929 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lazy-loading 'services' on Instance uuid d8042e17-76ed-448e-bca1-331aa1f708c9 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:33:17.761600 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ef407026-1279-4006-9b89-51fd124d1929 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9/os-volume_attachments/e746707e-5337-41cc-ab63-601c8da6b9c8" status: 202 len: 0 microversion: 2.1 time: 0.325819 Sep 07 12:33:17.762235 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 606/1225] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Sep 7 12:33:17 2022] DELETE /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9/os-volume_attachments/e746707e-5337-41cc-ab63-601c8da6b9c8 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:33:17.767904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-df6b546e-4cdc-4b6c-b513-32d7e96e2b59 tempest-SecurityGroupsTestAdminJSON-1944242648 tempest-SecurityGroupsTestAdminJSON-1944242648-project] Calling method '.version_select at 0x7fc41d22d8b0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:18.051649 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-df6b546e-4cdc-4b6c-b513-32d7e96e2b59 tempest-SecurityGroupsTestAdminJSON-1944242648 tempest-SecurityGroupsTestAdminJSON-1944242648-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.288058 Sep 07 12:33:18.052280 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 607/1226] 10.222.0.16 () {58 vars in 1191 bytes} [Wed Sep 7 12:33:17 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:18.057088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c57e2388-2fee-47fe-a3be-9bf1f59f3315 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:18.057873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c57e2388-2fee-47fe-a3be-9bf1f59f3315 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:18.068343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57e2388-2fee-47fe-a3be-9bf1f59f3315 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:18.068920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57e2388-2fee-47fe-a3be-9bf1f59f3315 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:18.069365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57e2388-2fee-47fe-a3be-9bf1f59f3315 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:18.070213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57e2388-2fee-47fe-a3be-9bf1f59f3315 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:18.070673 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57e2388-2fee-47fe-a3be-9bf1f59f3315 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:18.071179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57e2388-2fee-47fe-a3be-9bf1f59f3315 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:18.233155 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c57e2388-2fee-47fe-a3be-9bf1f59f3315 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:18.242397 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c57e2388-2fee-47fe-a3be-9bf1f59f3315 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1471 microversion: 2.1 time: 0.189057 Sep 07 12:33:18.242988 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 608/1227] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:18 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1471 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:18.247964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-96f9014a-2354-444f-ae3d-c50f3578b7d4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:18.248739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-96f9014a-2354-444f-ae3d-c50f3578b7d4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:18.256180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96f9014a-2354-444f-ae3d-c50f3578b7d4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:18.256689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96f9014a-2354-444f-ae3d-c50f3578b7d4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:18.257139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96f9014a-2354-444f-ae3d-c50f3578b7d4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:18.257950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96f9014a-2354-444f-ae3d-c50f3578b7d4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:18.258425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96f9014a-2354-444f-ae3d-c50f3578b7d4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:18.259371 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96f9014a-2354-444f-ae3d-c50f3578b7d4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:18.279108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=12 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:33:18.335760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-96f9014a-2354-444f-ae3d-c50f3578b7d4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:18.344716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-96f9014a-2354-444f-ae3d-c50f3578b7d4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:18.346218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-96f9014a-2354-444f-ae3d-c50f3578b7d4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:18.352961 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-96f9014a-2354-444f-ae3d-c50f3578b7d4 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.108829 Sep 07 12:33:18.353864 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 609/1228] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:18 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:18.359363 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dbf66f90-776c-40a6-bcb7-7cf5b01b958e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Action: 'create', calling method: .version_select at 0x7fc41d2b2dc0>, body: {"keypair": {"name": "tempest-keypair-1984585193", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIiCxTjfwpeyH7LvsQ1C2T2fF0DkY0amwg8owEQgVhmL2njqNPZun8MRgG3JsrRRQNmXNQABmdgUhBe3ZTKW7kPzQ7v38KaaUbJ1hzgMfHfaDI0jH9V1bkCpCvdKwcr3YQ=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:18.378203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-dbf66f90-776c-40a6-bcb7-7cf5b01b958e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Getting quotas for project 6d7695bab2d84b35bf92bd035da71dc3. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:33:18.384190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-dbf66f90-776c-40a6-bcb7-7cf5b01b958e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Getting quotas for user cf3ae3d912b84a8f906b31874668b740 and project 6d7695bab2d84b35bf92bd035da71dc3. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:33:18.411595 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dbf66f90-776c-40a6-bcb7-7cf5b01b958e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.056519 Sep 07 12:33:18.412149 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 610/1229] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Sep 7 12:33:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 12:33:18.417072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5ed0b11d-b6e8-4044-be29-332b8f3e7cbd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:18.425987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5ed0b11d-b6e8-4044-be29-332b8f3e7cbd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:18.437158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ed0b11d-b6e8-4044-be29-332b8f3e7cbd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:18.437997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ed0b11d-b6e8-4044-be29-332b8f3e7cbd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:18.438903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ed0b11d-b6e8-4044-be29-332b8f3e7cbd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:18.440269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ed0b11d-b6e8-4044-be29-332b8f3e7cbd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:18.441029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ed0b11d-b6e8-4044-be29-332b8f3e7cbd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:18.441717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ed0b11d-b6e8-4044-be29-332b8f3e7cbd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:18.506625 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5ed0b11d-b6e8-4044-be29-332b8f3e7cbd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092859 Sep 07 12:33:18.507803 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 611/1230] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:33:18 2022] GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:33:18.518284 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b94e71fe-456b-49ea-b4d4-1d774dc91e64 tempest-SecurityGroupsTestAdminJSON-1336352882 tempest-SecurityGroupsTestAdminJSON-1336352882-project-admin] Calling method '.version_select at 0x7fc4192ac1f0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:18.830417 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b94e71fe-456b-49ea-b4d4-1d774dc91e64 tempest-SecurityGroupsTestAdminJSON-1336352882 tempest-SecurityGroupsTestAdminJSON-1336352882-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/9cbc47da-2db5-4aae-92e4-c45fe57d83af" status: 202 len: 0 microversion: 2.1 time: 0.320721 Sep 07 12:33:18.831496 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 612/1231] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:33:18 2022] DELETE /compute/v2.1/os-security-groups/9cbc47da-2db5-4aae-92e4-c45fe57d83af => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:33:18.847114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-02061733-d04d-497b-a084-eccf4c38698d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:18.847947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-02061733-d04d-497b-a084-eccf4c38698d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:18.857319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02061733-d04d-497b-a084-eccf4c38698d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:18.859046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02061733-d04d-497b-a084-eccf4c38698d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:18.860329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02061733-d04d-497b-a084-eccf4c38698d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:18.862394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02061733-d04d-497b-a084-eccf4c38698d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:18.867032 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02061733-d04d-497b-a084-eccf4c38698d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:18.867951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02061733-d04d-497b-a084-eccf4c38698d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:19.095391 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-02061733-d04d-497b-a084-eccf4c38698d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:19.098109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:33:19.106200 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-02061733-d04d-497b-a084-eccf4c38698d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1313 microversion: 2.1 time: 0.268260 Sep 07 12:33:19.106889 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 613/1232] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:18 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:19.112214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9fcf035c-8fee-4bc1-aa2e-1ce3c3dac8ab tempest-SecurityGroupsTestAdminJSON-1336352882 tempest-SecurityGroupsTestAdminJSON-1336352882-project-admin] Calling method '.version_select at 0x7fc41d1ce8b0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:19.362398 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9fcf035c-8fee-4bc1-aa2e-1ce3c3dac8ab tempest-SecurityGroupsTestAdminJSON-1336352882 tempest-SecurityGroupsTestAdminJSON-1336352882-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/d8e5c411-76d5-48cb-bb72-49aefc758962" status: 202 len: 0 microversion: 2.1 time: 0.252985 Sep 07 12:33:19.369213 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 614/1233] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:33:19 2022] DELETE /compute/v2.1/os-security-groups/d8e5c411-76d5-48cb-bb72-49aefc758962 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:33:19.384608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b30a650a-814d-4fc8-872d-369c158f1f61 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:19.385792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b30a650a-814d-4fc8-872d-369c158f1f61 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:19.400801 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b30a650a-814d-4fc8-872d-369c158f1f61 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:19.402333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b30a650a-814d-4fc8-872d-369c158f1f61 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:19.404077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b30a650a-814d-4fc8-872d-369c158f1f61 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:19.406106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b30a650a-814d-4fc8-872d-369c158f1f61 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:19.407768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b30a650a-814d-4fc8-872d-369c158f1f61 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:19.409068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b30a650a-814d-4fc8-872d-369c158f1f61 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:19.861276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b30a650a-814d-4fc8-872d-369c158f1f61 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:19.872247 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b30a650a-814d-4fc8-872d-369c158f1f61 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1471 microversion: 2.1 time: 0.499579 Sep 07 12:33:19.890489 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 615/1234] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:19 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1471 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:19.900198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3a82a1bf-9208-48d3-84e7-2ed1b4cdea46 tempest-SecurityGroupsTestAdminJSON-1944242648 tempest-SecurityGroupsTestAdminJSON-1944242648-project] Calling method '.version_select at 0x7fc41d2cfc10>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:20.561341 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3a82a1bf-9208-48d3-84e7-2ed1b4cdea46 tempest-SecurityGroupsTestAdminJSON-1944242648 tempest-SecurityGroupsTestAdminJSON-1944242648-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/a4d82c29-d868-43e5-a698-a6dfda8873ae" status: 202 len: 0 microversion: 2.1 time: 0.667258 Sep 07 12:33:20.583568 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 616/1235] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:33:19 2022] DELETE /compute/v2.1/os-security-groups/a4d82c29-d868-43e5-a698-a6dfda8873ae => generated 0 bytes in 692 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:33:20.627276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7b876b25-6943-4ef0-a69a-0049f49e7b3b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:20.636320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7b876b25-6943-4ef0-a69a-0049f49e7b3b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:20.648268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:33:20.678397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b876b25-6943-4ef0-a69a-0049f49e7b3b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:20.679360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b876b25-6943-4ef0-a69a-0049f49e7b3b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:20.680182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b876b25-6943-4ef0-a69a-0049f49e7b3b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:20.682593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b876b25-6943-4ef0-a69a-0049f49e7b3b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:20.684017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b876b25-6943-4ef0-a69a-0049f49e7b3b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:20.685000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b876b25-6943-4ef0-a69a-0049f49e7b3b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:20.777018 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9be78872-f793-4687-9258-3bede91b3f67 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/action" status: 202 len: 0 microversion: 2.1 time: 3.976363 Sep 07 12:33:20.778325 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 620/1236] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:33:16 2022] POST /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/action => generated 0 bytes in 3979 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:33:20.788525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7da6cc49-d448-48f8-8e5c-f5757d5e1f73 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:20.794483 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7da6cc49-d448-48f8-8e5c-f5757d5e1f73 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:20.809750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7da6cc49-d448-48f8-8e5c-f5757d5e1f73 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:20.811822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7da6cc49-d448-48f8-8e5c-f5757d5e1f73 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:20.813325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7da6cc49-d448-48f8-8e5c-f5757d5e1f73 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:20.815216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7da6cc49-d448-48f8-8e5c-f5757d5e1f73 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:20.816449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7da6cc49-d448-48f8-8e5c-f5757d5e1f73 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:20.817744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7da6cc49-d448-48f8-8e5c-f5757d5e1f73 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:20.871523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7b876b25-6943-4ef0-a69a-0049f49e7b3b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:20.882542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7b876b25-6943-4ef0-a69a-0049f49e7b3b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:20.884438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7b876b25-6943-4ef0-a69a-0049f49e7b3b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:20.920802 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7b876b25-6943-4ef0-a69a-0049f49e7b3b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.315661 Sep 07 12:33:20.921879 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7da6cc49-d448-48f8-8e5c-f5757d5e1f73 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136804 Sep 07 12:33:20.923707 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 621/1237] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:33:20 2022] GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:33:20.927902 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 617/1238] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:20 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:20.934176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-02540dd0-e825-4242-b943-b18c1d4c8a6a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1096525242", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "782fe665-49dc-454e-a75e-cbb471a251fc"}], "security_groups": [{"name": "tempest-securitygroup--924502158"}], "key_name": "tempest-keypair-1984585193", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:20.935919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7f2dcf51-1b56-4a8e-afb9-d148e5d53a66 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:20.938786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7f2dcf51-1b56-4a8e-afb9-d148e5d53a66 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:20.953700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f2dcf51-1b56-4a8e-afb9-d148e5d53a66 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:20.954955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f2dcf51-1b56-4a8e-afb9-d148e5d53a66 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:20.955969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f2dcf51-1b56-4a8e-afb9-d148e5d53a66 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:20.958514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f2dcf51-1b56-4a8e-afb9-d148e5d53a66 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:20.960075 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f2dcf51-1b56-4a8e-afb9-d148e5d53a66 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:20.961105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f2dcf51-1b56-4a8e-afb9-d148e5d53a66 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:21.237407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-02540dd0-e825-4242-b943-b18c1d4c8a6a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] validate_networks() for [('782fe665-49dc-454e-a75e-cbb471a251fc', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:33:21.387189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7f2dcf51-1b56-4a8e-afb9-d148e5d53a66 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:21.403690 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7f2dcf51-1b56-4a8e-afb9-d148e5d53a66 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1313 microversion: 2.1 time: 0.477649 Sep 07 12:33:21.405378 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 622/1239] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:20 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1313 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:21.414872 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6eb4ee45-48ca-4d93-9b79-2adf10a87e5b tempest-SecurityGroupsTestAdminJSON-1944242648 tempest-SecurityGroupsTestAdminJSON-1944242648-project] Calling method '.version_select at 0x7fc4192bb790>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:21.987395 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6eb4ee45-48ca-4d93-9b79-2adf10a87e5b tempest-SecurityGroupsTestAdminJSON-1944242648 tempest-SecurityGroupsTestAdminJSON-1944242648-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/da578eae-4a0f-4c43-9d27-dea4cdd4cb0c" status: 202 len: 0 microversion: 2.1 time: 0.580027 Sep 07 12:33:21.988931 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 623/1240] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:33:21 2022] DELETE /compute/v2.1/os-security-groups/da578eae-4a0f-4c43-9d27-dea4cdd4cb0c => generated 0 bytes in 582 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:33:21.999588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-21e369ed-18e2-48ba-8fa3-65ecb37a3b70 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:22.002699 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-21e369ed-18e2-48ba-8fa3-65ecb37a3b70 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:22.022447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21e369ed-18e2-48ba-8fa3-65ecb37a3b70 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:22.024640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21e369ed-18e2-48ba-8fa3-65ecb37a3b70 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:22.024640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21e369ed-18e2-48ba-8fa3-65ecb37a3b70 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:22.044417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21e369ed-18e2-48ba-8fa3-65ecb37a3b70 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:22.045648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21e369ed-18e2-48ba-8fa3-65ecb37a3b70 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:22.046772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21e369ed-18e2-48ba-8fa3-65ecb37a3b70 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:22.170480 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=14 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:33:22.176605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-02540dd0-e825-4242-b943-b18c1d4c8a6a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:33:22.178339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-02540dd0-e825-4242-b943-b18c1d4c8a6a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:33:22.179439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-02540dd0-e825-4242-b943-b18c1d4c8a6a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:33:22.180365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-02540dd0-e825-4242-b943-b18c1d4c8a6a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:33:22.181331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-02540dd0-e825-4242-b943-b18c1d4c8a6a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:33:22.206481 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02540dd0-e825-4242-b943-b18c1d4c8a6a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:22.207717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02540dd0-e825-4242-b943-b18c1d4c8a6a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:22.209349 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02540dd0-e825-4242-b943-b18c1d4c8a6a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:22.211109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02540dd0-e825-4242-b943-b18c1d4c8a6a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:22.212295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02540dd0-e825-4242-b943-b18c1d4c8a6a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:22.213265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02540dd0-e825-4242-b943-b18c1d4c8a6a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:22.256986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-02540dd0-e825-4242-b943-b18c1d4c8a6a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Getting quotas for project 6d7695bab2d84b35bf92bd035da71dc3. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:33:22.271742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-02540dd0-e825-4242-b943-b18c1d4c8a6a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Getting quotas for user cf3ae3d912b84a8f906b31874668b740 and project 6d7695bab2d84b35bf92bd035da71dc3. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:33:22.314270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-02540dd0-e825-4242-b943-b18c1d4c8a6a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:33:22.320232 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-02540dd0-e825-4242-b943-b18c1d4c8a6a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:33:22.465275 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-02540dd0-e825-4242-b943-b18c1d4c8a6a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.535911 Sep 07 12:33:22.467643 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 618/1241] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Sep 7 12:33:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 1538 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 12:33:22.485902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-09ac3dba-f47b-4075-8f22-12eabd54d7ac tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:22.490575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-09ac3dba-f47b-4075-8f22-12eabd54d7ac tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:22.525657 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09ac3dba-f47b-4075-8f22-12eabd54d7ac tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:22.526748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09ac3dba-f47b-4075-8f22-12eabd54d7ac tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:22.529016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09ac3dba-f47b-4075-8f22-12eabd54d7ac tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:22.529931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09ac3dba-f47b-4075-8f22-12eabd54d7ac tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:22.530427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09ac3dba-f47b-4075-8f22-12eabd54d7ac tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:22.531216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09ac3dba-f47b-4075-8f22-12eabd54d7ac tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:22.575976 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-21e369ed-18e2-48ba-8fa3-65ecb37a3b70 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:22.615427 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-21e369ed-18e2-48ba-8fa3-65ecb37a3b70 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1716 microversion: 2.1 time: 0.606905 Sep 07 12:33:22.619676 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 624/1242] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:21 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1716 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:22.629075 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-970c3bea-202c-467f-9650-373de82b9ff4 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:22.655791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-970c3bea-202c-467f-9650-373de82b9ff4 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:22.701068 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-970c3bea-202c-467f-9650-373de82b9ff4 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:22.702013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-970c3bea-202c-467f-9650-373de82b9ff4 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:22.702872 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-970c3bea-202c-467f-9650-373de82b9ff4 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:22.704178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-970c3bea-202c-467f-9650-373de82b9ff4 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:22.705264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-970c3bea-202c-467f-9650-373de82b9ff4 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:22.707736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-970c3bea-202c-467f-9650-373de82b9ff4 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:22.829343 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-970c3bea-202c-467f-9650-373de82b9ff4 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.207396 Sep 07 12:33:22.835201 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 625/1243] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:33:22 2022] GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9/os-volume_attachments => generated 197 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:33:22.864847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2a76e6fb-332f-4335-87bd-f38f7a819362 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:22.866628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2a76e6fb-332f-4335-87bd-f38f7a819362 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:22.909521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a76e6fb-332f-4335-87bd-f38f7a819362 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:22.910769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a76e6fb-332f-4335-87bd-f38f7a819362 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:22.911806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a76e6fb-332f-4335-87bd-f38f7a819362 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:22.913387 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a76e6fb-332f-4335-87bd-f38f7a819362 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:22.914531 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a76e6fb-332f-4335-87bd-f38f7a819362 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:22.915554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a76e6fb-332f-4335-87bd-f38f7a819362 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:23.561707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2a76e6fb-332f-4335-87bd-f38f7a819362 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:23.579464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2a76e6fb-332f-4335-87bd-f38f7a819362 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:23.585516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2a76e6fb-332f-4335-87bd-f38f7a819362 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:23.586608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-09ac3dba-f47b-4075-8f22-12eabd54d7ac tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:23.599975 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-09ac3dba-f47b-4075-8f22-12eabd54d7ac tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1471 microversion: 2.1 time: 1.130763 Sep 07 12:33:23.601412 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 619/1244] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:22 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1471 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:23.604422 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2a76e6fb-332f-4335-87bd-f38f7a819362 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1558 microversion: 2.91 time: 0.761851 Sep 07 12:33:23.605190 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 626/1245] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:22 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1558 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:23.608813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d99eab73-f997-4771-a060-9c92662db5f4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:23.609635 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d99eab73-f997-4771-a060-9c92662db5f4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:23.612379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-62c1e9e9-4705-4ea0-8957-61154418c949 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:23.613243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-62c1e9e9-4705-4ea0-8957-61154418c949 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:23.621167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d99eab73-f997-4771-a060-9c92662db5f4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:23.622178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d99eab73-f997-4771-a060-9c92662db5f4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:23.624917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d99eab73-f997-4771-a060-9c92662db5f4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:23.629027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d99eab73-f997-4771-a060-9c92662db5f4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:23.630324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d99eab73-f997-4771-a060-9c92662db5f4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:23.631201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d99eab73-f997-4771-a060-9c92662db5f4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:23.745946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-62c1e9e9-4705-4ea0-8957-61154418c949 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:23.769431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-62c1e9e9-4705-4ea0-8957-61154418c949 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:23.781078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-62c1e9e9-4705-4ea0-8957-61154418c949 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:23.789563 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-62c1e9e9-4705-4ea0-8957-61154418c949 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1286 microversion: 2.25 time: 0.179926 Sep 07 12:33:23.798444 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 627/1246] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:23 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1286 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:23.813235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b4a0c748-6009-47bb-bf72-f749a8b0d254 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:23.814875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b4a0c748-6009-47bb-bf72-f749a8b0d254 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:23.827745 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4a0c748-6009-47bb-bf72-f749a8b0d254 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:23.828890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4a0c748-6009-47bb-bf72-f749a8b0d254 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:23.829932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4a0c748-6009-47bb-bf72-f749a8b0d254 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:23.832817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4a0c748-6009-47bb-bf72-f749a8b0d254 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:23.834459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4a0c748-6009-47bb-bf72-f749a8b0d254 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:23.835257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4a0c748-6009-47bb-bf72-f749a8b0d254 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:23.930544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d99eab73-f997-4771-a060-9c92662db5f4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:23.964507 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d99eab73-f997-4771-a060-9c92662db5f4 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1313 microversion: 2.1 time: 0.360026 Sep 07 12:33:23.966384 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 620/1247] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:23 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:23.980334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e2360e87-375b-4964-8ef9-b4a76cc2a9b0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:23.996776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e2360e87-375b-4964-8ef9-b4a76cc2a9b0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:24.021248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2360e87-375b-4964-8ef9-b4a76cc2a9b0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:24.025825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2360e87-375b-4964-8ef9-b4a76cc2a9b0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:24.027271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2360e87-375b-4964-8ef9-b4a76cc2a9b0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:24.033740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2360e87-375b-4964-8ef9-b4a76cc2a9b0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:24.034569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2360e87-375b-4964-8ef9-b4a76cc2a9b0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:24.035800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2360e87-375b-4964-8ef9-b4a76cc2a9b0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:24.166331 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e2360e87-375b-4964-8ef9-b4a76cc2a9b0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.194828 Sep 07 12:33:24.167518 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 621/1248] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:33:23 2022] GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:33:24.243129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b4a0c748-6009-47bb-bf72-f749a8b0d254 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:24.262992 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b4a0c748-6009-47bb-bf72-f749a8b0d254 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1716 microversion: 2.1 time: 0.462615 Sep 07 12:33:24.267971 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 628/1249] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:23 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1716 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:24.628789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-52a020b9-d0bc-47db-b111-aedf958ec9c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:24.630101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-52a020b9-d0bc-47db-b111-aedf958ec9c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:24.637473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52a020b9-d0bc-47db-b111-aedf958ec9c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:24.638368 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52a020b9-d0bc-47db-b111-aedf958ec9c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:24.639360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52a020b9-d0bc-47db-b111-aedf958ec9c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:24.640234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52a020b9-d0bc-47db-b111-aedf958ec9c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:24.640921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52a020b9-d0bc-47db-b111-aedf958ec9c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:24.641667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52a020b9-d0bc-47db-b111-aedf958ec9c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:24.675385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1f5f5af3-0cd8-4569-851b-966639761e40 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:24.678418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1f5f5af3-0cd8-4569-851b-966639761e40 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:24.719471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f5f5af3-0cd8-4569-851b-966639761e40 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:24.722930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f5f5af3-0cd8-4569-851b-966639761e40 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:24.726782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f5f5af3-0cd8-4569-851b-966639761e40 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:24.730975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f5f5af3-0cd8-4569-851b-966639761e40 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:24.732140 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f5f5af3-0cd8-4569-851b-966639761e40 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:24.735891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f5f5af3-0cd8-4569-851b-966639761e40 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:24.951103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1f5f5af3-0cd8-4569-851b-966639761e40 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:24.964986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1f5f5af3-0cd8-4569-851b-966639761e40 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:24.966635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1f5f5af3-0cd8-4569-851b-966639761e40 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:24.985923 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1f5f5af3-0cd8-4569-851b-966639761e40 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1558 microversion: 2.91 time: 0.324036 Sep 07 12:33:24.987112 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 629/1250] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:24 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1558 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:24.997162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ab3753a-f2ec-41a7-bac8-b21dde9a4791 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:24.998159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5ab3753a-f2ec-41a7-bac8-b21dde9a4791 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:25.021298 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ab3753a-f2ec-41a7-bac8-b21dde9a4791 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:25.023440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ab3753a-f2ec-41a7-bac8-b21dde9a4791 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:25.024645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ab3753a-f2ec-41a7-bac8-b21dde9a4791 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:25.025955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ab3753a-f2ec-41a7-bac8-b21dde9a4791 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:25.032608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ab3753a-f2ec-41a7-bac8-b21dde9a4791 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:25.033433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ab3753a-f2ec-41a7-bac8-b21dde9a4791 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:25.226512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5ab3753a-f2ec-41a7-bac8-b21dde9a4791 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:25.232050 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-52a020b9-d0bc-47db-b111-aedf958ec9c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:25.244049 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-52a020b9-d0bc-47db-b111-aedf958ec9c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1471 microversion: 2.1 time: 0.619118 Sep 07 12:33:25.261190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5ab3753a-f2ec-41a7-bac8-b21dde9a4791 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:25.261190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5ab3753a-f2ec-41a7-bac8-b21dde9a4791 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:25.261190 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5ab3753a-f2ec-41a7-bac8-b21dde9a4791 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1338 microversion: 2.25 time: 0.264946 Sep 07 12:33:25.261856 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 630/1251] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:24 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1338 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:25.262554 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 622/1252] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:24 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1471 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:33:25.271473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3575b240-5fb3-4666-89d9-96aca8525752 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:25.276532 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3575b240-5fb3-4666-89d9-96aca8525752 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:25.289253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-62bc398b-4704-481a-836a-b792374439e7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:25.290275 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-62bc398b-4704-481a-836a-b792374439e7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:25.304897 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3575b240-5fb3-4666-89d9-96aca8525752 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:25.305777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3575b240-5fb3-4666-89d9-96aca8525752 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:25.306364 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3575b240-5fb3-4666-89d9-96aca8525752 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:25.307276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3575b240-5fb3-4666-89d9-96aca8525752 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:25.307890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3575b240-5fb3-4666-89d9-96aca8525752 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:25.308505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3575b240-5fb3-4666-89d9-96aca8525752 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:25.313579 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62bc398b-4704-481a-836a-b792374439e7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:25.314094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62bc398b-4704-481a-836a-b792374439e7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:25.314545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62bc398b-4704-481a-836a-b792374439e7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:25.324588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62bc398b-4704-481a-836a-b792374439e7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:25.325706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62bc398b-4704-481a-836a-b792374439e7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:25.326249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62bc398b-4704-481a-836a-b792374439e7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:25.402920 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3575b240-5fb3-4666-89d9-96aca8525752 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137664 Sep 07 12:33:25.420652 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 623/1253] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:33:25 2022] GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:33:25.449683 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7d68d4c2-2160-4240-a5a1-bae00c08d717 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:25.451815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7d68d4c2-2160-4240-a5a1-bae00c08d717 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:25.474461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d68d4c2-2160-4240-a5a1-bae00c08d717 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:25.479477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d68d4c2-2160-4240-a5a1-bae00c08d717 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:25.480201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d68d4c2-2160-4240-a5a1-bae00c08d717 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:25.484418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d68d4c2-2160-4240-a5a1-bae00c08d717 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:25.485809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d68d4c2-2160-4240-a5a1-bae00c08d717 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:25.488289 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d68d4c2-2160-4240-a5a1-bae00c08d717 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:25.760649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-62bc398b-4704-481a-836a-b792374439e7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:25.789628 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-62bc398b-4704-481a-836a-b792374439e7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1313 microversion: 2.1 time: 0.525188 Sep 07 12:33:25.791326 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 631/1254] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:25 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1313 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:25.811602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-af6d7d05-1c00-4151-9743-a65855a3e053 req-4f3ec290-6eb1-4266-af2b-f82ee46ec5e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d12be6f4-80c9-404a-b6c4-d1e94e25daa9", "name": "network-vif-plugged", "status": "completed", "tag": "50b3c60a-51cc-4ed6-8a42-813229cfb0f8"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:25.838588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-af6d7d05-1c00-4151-9743-a65855a3e053 req-4f3ec290-6eb1-4266-af2b-f82ee46ec5e9 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:25.839110 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-af6d7d05-1c00-4151-9743-a65855a3e053 req-4f3ec290-6eb1-4266-af2b-f82ee46ec5e9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:25.839553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-af6d7d05-1c00-4151-9743-a65855a3e053 req-4f3ec290-6eb1-4266-af2b-f82ee46ec5e9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:25.854647 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-af6d7d05-1c00-4151-9743-a65855a3e053 req-4f3ec290-6eb1-4266-af2b-f82ee46ec5e9 service nova] Creating event network-vif-plugged:50b3c60a-51cc-4ed6-8a42-813229cfb0f8 for instance d12be6f4-80c9-404a-b6c4-d1e94e25daa9 on n-h1-852087-9 Sep 07 12:33:25.860514 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-af6d7d05-1c00-4151-9743-a65855a3e053 req-4f3ec290-6eb1-4266-af2b-f82ee46ec5e9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065669 Sep 07 12:33:25.864565 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 632/1255] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:33:25.869744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7d68d4c2-2160-4240-a5a1-bae00c08d717 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:25.894252 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7d68d4c2-2160-4240-a5a1-bae00c08d717 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1716 microversion: 2.1 time: 0.472177 Sep 07 12:33:25.898301 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 624/1256] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:25 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1716 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:26.042431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-37ffa6dc-90d0-45f3-886e-0d3b9603529b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:26.044299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-37ffa6dc-90d0-45f3-886e-0d3b9603529b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:26.055811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37ffa6dc-90d0-45f3-886e-0d3b9603529b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:26.056190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37ffa6dc-90d0-45f3-886e-0d3b9603529b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:26.056941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37ffa6dc-90d0-45f3-886e-0d3b9603529b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:26.058244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37ffa6dc-90d0-45f3-886e-0d3b9603529b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:26.059351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37ffa6dc-90d0-45f3-886e-0d3b9603529b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:26.060583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37ffa6dc-90d0-45f3-886e-0d3b9603529b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:26.246007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37ffa6dc-90d0-45f3-886e-0d3b9603529b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:26.265074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37ffa6dc-90d0-45f3-886e-0d3b9603529b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:26.269702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37ffa6dc-90d0-45f3-886e-0d3b9603529b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:26.279770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-01cf73ab-feba-41b0-8a0f-5cca4e280f80 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:26.281243 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-01cf73ab-feba-41b0-8a0f-5cca4e280f80 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:26.316253 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-37ffa6dc-90d0-45f3-886e-0d3b9603529b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1553 microversion: 2.91 time: 0.281438 Sep 07 12:33:26.339385 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 633/1257] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:26 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1553 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:26.341012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01cf73ab-feba-41b0-8a0f-5cca4e280f80 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:26.344899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01cf73ab-feba-41b0-8a0f-5cca4e280f80 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:26.347102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01cf73ab-feba-41b0-8a0f-5cca4e280f80 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:26.351585 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01cf73ab-feba-41b0-8a0f-5cca4e280f80 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:26.354682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01cf73ab-feba-41b0-8a0f-5cca4e280f80 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:26.356557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01cf73ab-feba-41b0-8a0f-5cca4e280f80 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:26.360471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd29333e-7aaf-4f16-8ab0-104f07e14fad tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:26.366481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dd29333e-7aaf-4f16-8ab0-104f07e14fad tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:26.390226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd29333e-7aaf-4f16-8ab0-104f07e14fad tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:26.390750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd29333e-7aaf-4f16-8ab0-104f07e14fad tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:26.391207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd29333e-7aaf-4f16-8ab0-104f07e14fad tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:26.391958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd29333e-7aaf-4f16-8ab0-104f07e14fad tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:26.392428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd29333e-7aaf-4f16-8ab0-104f07e14fad tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:26.392929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd29333e-7aaf-4f16-8ab0-104f07e14fad tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:26.648678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dd29333e-7aaf-4f16-8ab0-104f07e14fad tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:26.680496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dd29333e-7aaf-4f16-8ab0-104f07e14fad tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:26.683344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dd29333e-7aaf-4f16-8ab0-104f07e14fad tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:26.692204 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dd29333e-7aaf-4f16-8ab0-104f07e14fad tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1356 microversion: 2.25 time: 0.348778 Sep 07 12:33:26.695690 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 634/1258] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:26 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1356 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:26.721858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-be2b3c5e-3f23-426b-a253-c6abf2213b7d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:26.730989 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-be2b3c5e-3f23-426b-a253-c6abf2213b7d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:26.745898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be2b3c5e-3f23-426b-a253-c6abf2213b7d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:26.747587 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be2b3c5e-3f23-426b-a253-c6abf2213b7d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:26.749072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be2b3c5e-3f23-426b-a253-c6abf2213b7d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:26.752371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be2b3c5e-3f23-426b-a253-c6abf2213b7d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:26.753692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be2b3c5e-3f23-426b-a253-c6abf2213b7d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:26.754715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be2b3c5e-3f23-426b-a253-c6abf2213b7d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:26.779750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-01cf73ab-feba-41b0-8a0f-5cca4e280f80 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:26.789401 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-01cf73ab-feba-41b0-8a0f-5cca4e280f80 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1471 microversion: 2.1 time: 0.516656 Sep 07 12:33:26.794331 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 625/1259] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:26 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1471 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:26.836421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bb18c694-9450-4387-bd09-979595f6c0c2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:26.837073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bb18c694-9450-4387-bd09-979595f6c0c2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:26.852792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb18c694-9450-4387-bd09-979595f6c0c2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:26.853532 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb18c694-9450-4387-bd09-979595f6c0c2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:26.854136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb18c694-9450-4387-bd09-979595f6c0c2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:26.855408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb18c694-9450-4387-bd09-979595f6c0c2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:26.856336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb18c694-9450-4387-bd09-979595f6c0c2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:26.856927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb18c694-9450-4387-bd09-979595f6c0c2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:26.897994 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-be2b3c5e-3f23-426b-a253-c6abf2213b7d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.196628 Sep 07 12:33:26.904906 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 635/1260] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:33:26 2022] GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:33:26.923837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4e04f2a6-e10a-49f5-9da5-065f16148e27 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:26.928994 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4e04f2a6-e10a-49f5-9da5-065f16148e27 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:26.943609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e04f2a6-e10a-49f5-9da5-065f16148e27 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:26.944352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e04f2a6-e10a-49f5-9da5-065f16148e27 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:26.945053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e04f2a6-e10a-49f5-9da5-065f16148e27 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:26.946782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e04f2a6-e10a-49f5-9da5-065f16148e27 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:26.947488 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e04f2a6-e10a-49f5-9da5-065f16148e27 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:26.950472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e04f2a6-e10a-49f5-9da5-065f16148e27 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:27.555135 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bb18c694-9450-4387-bd09-979595f6c0c2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:27.586097 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bb18c694-9450-4387-bd09-979595f6c0c2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1313 microversion: 2.1 time: 0.753983 Sep 07 12:33:27.587934 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 626/1261] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:26 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1313 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:27.610668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-00ba44a9-5dc7-4c6e-a988-ef81d78c44ae tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:27.613460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-00ba44a9-5dc7-4c6e-a988-ef81d78c44ae tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:27.645706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00ba44a9-5dc7-4c6e-a988-ef81d78c44ae tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:27.647067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00ba44a9-5dc7-4c6e-a988-ef81d78c44ae tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:27.648160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00ba44a9-5dc7-4c6e-a988-ef81d78c44ae tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:27.651492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00ba44a9-5dc7-4c6e-a988-ef81d78c44ae tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:27.656659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00ba44a9-5dc7-4c6e-a988-ef81d78c44ae tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:27.663806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00ba44a9-5dc7-4c6e-a988-ef81d78c44ae tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:27.664087 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4e04f2a6-e10a-49f5-9da5-065f16148e27 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:27.684344 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4e04f2a6-e10a-49f5-9da5-065f16148e27 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1716 microversion: 2.1 time: 0.763650 Sep 07 12:33:27.705449 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 636/1262] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:26 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1716 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:27.742225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9c584580-814b-4e78-be46-d4e15fcb107b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:27.743292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9c584580-814b-4e78-be46-d4e15fcb107b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:27.787157 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c584580-814b-4e78-be46-d4e15fcb107b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:27.790496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c584580-814b-4e78-be46-d4e15fcb107b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:27.794015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c584580-814b-4e78-be46-d4e15fcb107b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:27.799065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c584580-814b-4e78-be46-d4e15fcb107b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:27.799880 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c584580-814b-4e78-be46-d4e15fcb107b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:27.800710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c584580-814b-4e78-be46-d4e15fcb107b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:28.052901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-00ba44a9-5dc7-4c6e-a988-ef81d78c44ae tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:28.094125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-00ba44a9-5dc7-4c6e-a988-ef81d78c44ae tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:28.101056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-00ba44a9-5dc7-4c6e-a988-ef81d78c44ae tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:28.129037 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-00ba44a9-5dc7-4c6e-a988-ef81d78c44ae tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1553 microversion: 2.91 time: 0.538841 Sep 07 12:33:28.131557 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 627/1263] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:27 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1553 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:28.151867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-67b4e2bd-b031-47ed-8e32-6121f751f983 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:28.153461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-67b4e2bd-b031-47ed-8e32-6121f751f983 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:28.182394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67b4e2bd-b031-47ed-8e32-6121f751f983 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:28.186742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67b4e2bd-b031-47ed-8e32-6121f751f983 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:28.192845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67b4e2bd-b031-47ed-8e32-6121f751f983 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:28.203273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67b4e2bd-b031-47ed-8e32-6121f751f983 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:28.204719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67b4e2bd-b031-47ed-8e32-6121f751f983 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:28.205770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67b4e2bd-b031-47ed-8e32-6121f751f983 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:28.225023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9c584580-814b-4e78-be46-d4e15fcb107b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:28.244397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9c584580-814b-4e78-be46-d4e15fcb107b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:28.249568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9c584580-814b-4e78-be46-d4e15fcb107b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:28.252001 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9c584580-814b-4e78-be46-d4e15fcb107b tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1344 microversion: 2.25 time: 0.521901 Sep 07 12:33:28.253442 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 637/1264] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:27 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1344 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:28.292093 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-53d2c661-2646-481f-ae0f-ec69585d96a0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:28.299563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-53d2c661-2646-481f-ae0f-ec69585d96a0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:28.317294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53d2c661-2646-481f-ae0f-ec69585d96a0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:28.318511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53d2c661-2646-481f-ae0f-ec69585d96a0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:28.319988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53d2c661-2646-481f-ae0f-ec69585d96a0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:28.323517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53d2c661-2646-481f-ae0f-ec69585d96a0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:28.326655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53d2c661-2646-481f-ae0f-ec69585d96a0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:28.327315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53d2c661-2646-481f-ae0f-ec69585d96a0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:28.409850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:33:28.531281 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-53d2c661-2646-481f-ae0f-ec69585d96a0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.256927 Sep 07 12:33:28.538056 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 638/1265] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:33:28 2022] GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9/os-volume_attachments => generated 197 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:33:28.554636 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-67b4e2bd-b031-47ed-8e32-6121f751f983 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:28.568201 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-67b4e2bd-b031-47ed-8e32-6121f751f983 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1471 microversion: 2.1 time: 0.432275 Sep 07 12:33:28.570127 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 628/1266] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:28 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1471 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:28.620883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c856d366-635d-4cf6-9c6d-f2a05df59b9b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:28.624169 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c856d366-635d-4cf6-9c6d-f2a05df59b9b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:28.637893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c856d366-635d-4cf6-9c6d-f2a05df59b9b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:28.638984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c856d366-635d-4cf6-9c6d-f2a05df59b9b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:28.639897 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c856d366-635d-4cf6-9c6d-f2a05df59b9b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:28.641366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c856d366-635d-4cf6-9c6d-f2a05df59b9b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:28.642385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c856d366-635d-4cf6-9c6d-f2a05df59b9b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:28.643309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c856d366-635d-4cf6-9c6d-f2a05df59b9b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:28.715564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b958a222-ed59-467f-a1c1-2fe057176b50 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:28.717277 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b958a222-ed59-467f-a1c1-2fe057176b50 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:28.743943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b958a222-ed59-467f-a1c1-2fe057176b50 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:28.752602 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b958a222-ed59-467f-a1c1-2fe057176b50 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:28.753945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b958a222-ed59-467f-a1c1-2fe057176b50 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:28.755644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b958a222-ed59-467f-a1c1-2fe057176b50 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:28.756913 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b958a222-ed59-467f-a1c1-2fe057176b50 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:28.758036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b958a222-ed59-467f-a1c1-2fe057176b50 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:29.697136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c856d366-635d-4cf6-9c6d-f2a05df59b9b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:29.731041 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c856d366-635d-4cf6-9c6d-f2a05df59b9b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1462 microversion: 2.1 time: 1.113363 Sep 07 12:33:29.735165 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 639/1267] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:28 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1462 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:29.751495 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ef650478-f6db-400e-b37c-3e1ad22980d0 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:29.754305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ef650478-f6db-400e-b37c-3e1ad22980d0 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:29.785390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef650478-f6db-400e-b37c-3e1ad22980d0 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:29.786699 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef650478-f6db-400e-b37c-3e1ad22980d0 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:29.789707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef650478-f6db-400e-b37c-3e1ad22980d0 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:29.793530 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef650478-f6db-400e-b37c-3e1ad22980d0 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:29.797024 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef650478-f6db-400e-b37c-3e1ad22980d0 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:29.797937 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef650478-f6db-400e-b37c-3e1ad22980d0 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:30.034993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b958a222-ed59-467f-a1c1-2fe057176b50 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:30.065975 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b958a222-ed59-467f-a1c1-2fe057176b50 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1716 microversion: 2.1 time: 1.358132 Sep 07 12:33:30.101201 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 629/1268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:28 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1716 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:30.147226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-26862cd0-83ab-4e81-ab4b-dd3edb61cdd3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:30.159137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-26862cd0-83ab-4e81-ab4b-dd3edb61cdd3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:30.204936 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26862cd0-83ab-4e81-ab4b-dd3edb61cdd3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:30.208392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26862cd0-83ab-4e81-ab4b-dd3edb61cdd3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:30.211320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26862cd0-83ab-4e81-ab4b-dd3edb61cdd3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:30.212542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26862cd0-83ab-4e81-ab4b-dd3edb61cdd3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:30.215482 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26862cd0-83ab-4e81-ab4b-dd3edb61cdd3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:30.217964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26862cd0-83ab-4e81-ab4b-dd3edb61cdd3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:30.229963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ef650478-f6db-400e-b37c-3e1ad22980d0 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:30.265773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ef650478-f6db-400e-b37c-3e1ad22980d0 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:30.280890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ef650478-f6db-400e-b37c-3e1ad22980d0 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:30.306052 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ef650478-f6db-400e-b37c-3e1ad22980d0 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1553 microversion: 2.91 time: 0.569054 Sep 07 12:33:30.306665 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 640/1269] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:29 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1553 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:30.324309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-11489302-2ea4-4b64-81b5-215f2e630516 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:30.336297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-11489302-2ea4-4b64-81b5-215f2e630516 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:30.363851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11489302-2ea4-4b64-81b5-215f2e630516 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:30.364365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11489302-2ea4-4b64-81b5-215f2e630516 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:30.364808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11489302-2ea4-4b64-81b5-215f2e630516 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:30.365572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11489302-2ea4-4b64-81b5-215f2e630516 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:30.374589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11489302-2ea4-4b64-81b5-215f2e630516 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:30.378460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11489302-2ea4-4b64-81b5-215f2e630516 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:30.468284 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-11489302-2ea4-4b64-81b5-215f2e630516 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.160474 Sep 07 12:33:30.469899 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 641/1270] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:33:30 2022] GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9/os-volume_attachments => generated 25 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:33:30.475791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7c16a014-1b21-44ed-8d82-947f3c66f14c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:30.476692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7c16a014-1b21-44ed-8d82-947f3c66f14c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:30.486047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c16a014-1b21-44ed-8d82-947f3c66f14c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:30.486885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c16a014-1b21-44ed-8d82-947f3c66f14c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:30.487507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c16a014-1b21-44ed-8d82-947f3c66f14c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:30.488416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c16a014-1b21-44ed-8d82-947f3c66f14c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:30.489083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c16a014-1b21-44ed-8d82-947f3c66f14c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:30.490666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c16a014-1b21-44ed-8d82-947f3c66f14c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:30.783324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-26862cd0-83ab-4e81-ab4b-dd3edb61cdd3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:30.816437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7c16a014-1b21-44ed-8d82-947f3c66f14c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:30.826864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-26862cd0-83ab-4e81-ab4b-dd3edb61cdd3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:30.828968 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7c16a014-1b21-44ed-8d82-947f3c66f14c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1471 microversion: 2.1 time: 0.357738 Sep 07 12:33:30.829800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-26862cd0-83ab-4e81-ab4b-dd3edb61cdd3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:30.831935 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-26862cd0-83ab-4e81-ab4b-dd3edb61cdd3 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1411 microversion: 2.25 time: 0.723918 Sep 07 12:33:30.841101 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 630/1271] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:30 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1411 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:30.842262 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 642/1272] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:30 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1471 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:30.888443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b631faa9-05e6-44e2-b442-8e9b8d56a039 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:30.892895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b631faa9-05e6-44e2-b442-8e9b8d56a039 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:30.925835 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b631faa9-05e6-44e2-b442-8e9b8d56a039 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:30.927486 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b631faa9-05e6-44e2-b442-8e9b8d56a039 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:30.929054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b631faa9-05e6-44e2-b442-8e9b8d56a039 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:30.934784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b631faa9-05e6-44e2-b442-8e9b8d56a039 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:30.936125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b631faa9-05e6-44e2-b442-8e9b8d56a039 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:30.937112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b631faa9-05e6-44e2-b442-8e9b8d56a039 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:30.980512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e66a947c-f7ae-4b7f-b978-27b6f048658f tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2052895263", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "aaa729e9-8d48-4aa2-8aa2-9ecb06a1fa06"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:31.133206 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-e66a947c-f7ae-4b7f-b978-27b6f048658f tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] validate_networks() for [('aaa729e9-8d48-4aa2-8aa2-9ecb06a1fa06', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:33:31.400256 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b631faa9-05e6-44e2-b442-8e9b8d56a039 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1613 microversion: 2.1 time: 0.556099 Sep 07 12:33:31.402528 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 631/1273] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:30 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1613 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:31.450618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b5bf0656-4f35-4693-aecf-3c88de64fa4a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:31.455863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b5bf0656-4f35-4693-aecf-3c88de64fa4a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:31.490526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5bf0656-4f35-4693-aecf-3c88de64fa4a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:31.491886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5bf0656-4f35-4693-aecf-3c88de64fa4a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:31.492868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5bf0656-4f35-4693-aecf-3c88de64fa4a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:31.494474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5bf0656-4f35-4693-aecf-3c88de64fa4a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:31.495620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5bf0656-4f35-4693-aecf-3c88de64fa4a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:31.496652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5bf0656-4f35-4693-aecf-3c88de64fa4a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:32.141455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b5bf0656-4f35-4693-aecf-3c88de64fa4a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:32.164038 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b5bf0656-4f35-4693-aecf-3c88de64fa4a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1716 microversion: 2.1 time: 0.740150 Sep 07 12:33:32.183868 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 632/1274] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:31 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1716 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:32.189282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5b9fd782-0b08-492c-b05a-6e75e2dc16c7 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:32.190196 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5b9fd782-0b08-492c-b05a-6e75e2dc16c7 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:32.210142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b9fd782-0b08-492c-b05a-6e75e2dc16c7 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:32.210964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b9fd782-0b08-492c-b05a-6e75e2dc16c7 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:32.211600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b9fd782-0b08-492c-b05a-6e75e2dc16c7 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:32.212537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b9fd782-0b08-492c-b05a-6e75e2dc16c7 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:32.213195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b9fd782-0b08-492c-b05a-6e75e2dc16c7 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:32.213823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b9fd782-0b08-492c-b05a-6e75e2dc16c7 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:32.262165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:33:32.274708 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:33:32.302339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=10 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:33:32.785357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5b9fd782-0b08-492c-b05a-6e75e2dc16c7 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:32.795071 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5b9fd782-0b08-492c-b05a-6e75e2dc16c7 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:32.804995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5b9fd782-0b08-492c-b05a-6e75e2dc16c7 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:32.818354 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5b9fd782-0b08-492c-b05a-6e75e2dc16c7 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1553 microversion: 2.91 time: 0.632957 Sep 07 12:33:32.819394 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 633/1275] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:32 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1553 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:32.833814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5d71b668-59e6-4269-832f-62081d91d3ca tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:32.838112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5d71b668-59e6-4269-832f-62081d91d3ca tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:32.866451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d71b668-59e6-4269-832f-62081d91d3ca tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:32.867298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d71b668-59e6-4269-832f-62081d91d3ca tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:32.867978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d71b668-59e6-4269-832f-62081d91d3ca tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:32.869026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d71b668-59e6-4269-832f-62081d91d3ca tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:32.869731 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d71b668-59e6-4269-832f-62081d91d3ca tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:32.870403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d71b668-59e6-4269-832f-62081d91d3ca tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:33.024505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5d71b668-59e6-4269-832f-62081d91d3ca tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b934700cad97473f92324e3b71a9ece4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c281c5da5fa467ba95cc00a54c408ae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:33.027612 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5d71b668-59e6-4269-832f-62081d91d3ca tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] flavor_id is None. Assuming migration. {{(pid=122433) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 07 12:33:33.028409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5d71b668-59e6-4269-832f-62081d91d3ca tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122433) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 12:33:33.047330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e66a947c-f7ae-4b7f-b978-27b6f048658f tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:33:33.047923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e66a947c-f7ae-4b7f-b978-27b6f048658f tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:33:33.048215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e66a947c-f7ae-4b7f-b978-27b6f048658f tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:33:33.048629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e66a947c-f7ae-4b7f-b978-27b6f048658f tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:33:33.049037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e66a947c-f7ae-4b7f-b978-27b6f048658f tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:33:33.063245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e66a947c-f7ae-4b7f-b978-27b6f048658f tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:33.064145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e66a947c-f7ae-4b7f-b978-27b6f048658f tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:33.064862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e66a947c-f7ae-4b7f-b978-27b6f048658f tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:33.066707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e66a947c-f7ae-4b7f-b978-27b6f048658f tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:33.068729 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e66a947c-f7ae-4b7f-b978-27b6f048658f tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:33.069443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e66a947c-f7ae-4b7f-b978-27b6f048658f tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:33.129176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-e66a947c-f7ae-4b7f-b978-27b6f048658f tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Getting quotas for project 6c950a615d6a4b67a93a60f7969b6e6e. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:33:33.142257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-e66a947c-f7ae-4b7f-b978-27b6f048658f tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Getting quotas for user 239d71c912c749e7afe0f791db5c18f9 and project 6c950a615d6a4b67a93a60f7969b6e6e. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:33:33.174119 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e66a947c-f7ae-4b7f-b978-27b6f048658f tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:33:33.180511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e66a947c-f7ae-4b7f-b978-27b6f048658f tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:33:33.295611 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e66a947c-f7ae-4b7f-b978-27b6f048658f tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.317163 Sep 07 12:33:33.298830 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 643/1276] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:33:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:33:33.310532 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-73dab62f-9599-4608-8acf-30dc5c49a784 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:33.314440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-73dab62f-9599-4608-8acf-30dc5c49a784 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:33.327622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73dab62f-9599-4608-8acf-30dc5c49a784 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:33.329337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73dab62f-9599-4608-8acf-30dc5c49a784 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:33.330042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73dab62f-9599-4608-8acf-30dc5c49a784 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:33.334734 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73dab62f-9599-4608-8acf-30dc5c49a784 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:33.335490 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73dab62f-9599-4608-8acf-30dc5c49a784 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:33.336088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73dab62f-9599-4608-8acf-30dc5c49a784 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:33.690886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-73dab62f-9599-4608-8acf-30dc5c49a784 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:33.707602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-73dab62f-9599-4608-8acf-30dc5c49a784 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:33.713411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-73dab62f-9599-4608-8acf-30dc5c49a784 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:33.715085 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-73dab62f-9599-4608-8acf-30dc5c49a784 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1411 microversion: 2.25 time: 0.414497 Sep 07 12:33:33.716527 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 644/1277] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:33 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1411 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:33.729289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b00e8c50-0632-4e7a-aa35-9ac50d260bf5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:33.734228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b00e8c50-0632-4e7a-aa35-9ac50d260bf5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:33.750376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b00e8c50-0632-4e7a-aa35-9ac50d260bf5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:33.750896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b00e8c50-0632-4e7a-aa35-9ac50d260bf5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:33.751301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b00e8c50-0632-4e7a-aa35-9ac50d260bf5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:33.755527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b00e8c50-0632-4e7a-aa35-9ac50d260bf5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:33.756191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b00e8c50-0632-4e7a-aa35-9ac50d260bf5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:33.756790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b00e8c50-0632-4e7a-aa35-9ac50d260bf5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:34.064938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b00e8c50-0632-4e7a-aa35-9ac50d260bf5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:34.075237 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5d71b668-59e6-4269-832f-62081d91d3ca tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9/action" status: 202 len: 0 microversion: 2.1 time: 1.254097 Sep 07 12:33:34.080309 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 634/1278] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:33:32 2022] POST /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9/action => generated 0 bytes in 1260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:33:34.092522 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b00e8c50-0632-4e7a-aa35-9ac50d260bf5 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1477 microversion: 2.1 time: 0.374427 Sep 07 12:33:34.100578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-62a17629-297a-4b91-ab8d-5568fdc1338e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:34.102355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-62a17629-297a-4b91-ab8d-5568fdc1338e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:34.107108 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 645/1279] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:33 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1477 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:34.125203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62a17629-297a-4b91-ab8d-5568fdc1338e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:34.127272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62a17629-297a-4b91-ab8d-5568fdc1338e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:34.127843 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-00a7684f-c288-41e6-a514-603b0ab1ecdc tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:34.128571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-00a7684f-c288-41e6-a514-603b0ab1ecdc tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:34.129322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62a17629-297a-4b91-ab8d-5568fdc1338e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:34.132475 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62a17629-297a-4b91-ab8d-5568fdc1338e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:34.134344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62a17629-297a-4b91-ab8d-5568fdc1338e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:34.137884 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62a17629-297a-4b91-ab8d-5568fdc1338e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:34.637018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-00a7684f-c288-41e6-a514-603b0ab1ecdc tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:34.669337 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-00a7684f-c288-41e6-a514-603b0ab1ecdc tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4" status: 200 len: 1218 microversion: 2.1 time: 0.560617 Sep 07 12:33:34.683019 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 646/1280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:34 2022] GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 => generated 1218 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:34.704593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-10007ca7-96de-49d1-928b-fcb41d254517 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:34.719741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-10007ca7-96de-49d1-928b-fcb41d254517 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:34.764842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10007ca7-96de-49d1-928b-fcb41d254517 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:34.769003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10007ca7-96de-49d1-928b-fcb41d254517 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:34.772434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10007ca7-96de-49d1-928b-fcb41d254517 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:34.776016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10007ca7-96de-49d1-928b-fcb41d254517 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:34.779757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10007ca7-96de-49d1-928b-fcb41d254517 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:34.785305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10007ca7-96de-49d1-928b-fcb41d254517 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:35.210029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-10007ca7-96de-49d1-928b-fcb41d254517 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:35.265257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-10007ca7-96de-49d1-928b-fcb41d254517 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:35.270319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-10007ca7-96de-49d1-928b-fcb41d254517 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:35.316846 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-10007ca7-96de-49d1-928b-fcb41d254517 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1553 microversion: 2.91 time: 0.631587 Sep 07 12:33:35.331680 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 647/1281] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:34 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1553 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:35.356963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f54c6238-309d-4a32-ab76-2fc754af4068 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:35.362887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f54c6238-309d-4a32-ab76-2fc754af4068 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:35.401160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f54c6238-309d-4a32-ab76-2fc754af4068 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:35.423364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f54c6238-309d-4a32-ab76-2fc754af4068 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:35.425279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f54c6238-309d-4a32-ab76-2fc754af4068 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:35.429947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f54c6238-309d-4a32-ab76-2fc754af4068 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:35.434303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f54c6238-309d-4a32-ab76-2fc754af4068 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:35.441255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f54c6238-309d-4a32-ab76-2fc754af4068 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:35.722281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-62a17629-297a-4b91-ab8d-5568fdc1338e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:35.761884 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-62a17629-297a-4b91-ab8d-5568fdc1338e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1716 microversion: 2.1 time: 1.679565 Sep 07 12:33:35.784640 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 635/1282] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:34 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1716 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:35.818105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4183c124-9f80-4112-b3d0-2a9c56fd4e11 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:35.831465 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4183c124-9f80-4112-b3d0-2a9c56fd4e11 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:35.863278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4183c124-9f80-4112-b3d0-2a9c56fd4e11 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:35.864615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4183c124-9f80-4112-b3d0-2a9c56fd4e11 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:35.866021 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4183c124-9f80-4112-b3d0-2a9c56fd4e11 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:35.869103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4183c124-9f80-4112-b3d0-2a9c56fd4e11 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:35.870427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4183c124-9f80-4112-b3d0-2a9c56fd4e11 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:35.871600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4183c124-9f80-4112-b3d0-2a9c56fd4e11 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:36.968951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4183c124-9f80-4112-b3d0-2a9c56fd4e11 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:37.005567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4183c124-9f80-4112-b3d0-2a9c56fd4e11 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:37.019996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4183c124-9f80-4112-b3d0-2a9c56fd4e11 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:37.028343 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4183c124-9f80-4112-b3d0-2a9c56fd4e11 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1411 microversion: 2.25 time: 1.235834 Sep 07 12:33:37.030544 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 636/1283] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:35 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1411 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:37.060277 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c3781979-a9be-40bc-9c38-8a3b168559c1 req-34240350-c07a-440c-bae6-fba58bf68844 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f070fedf-8028-43e3-97f9-8955e81dc84b", "tag": "236bdb6a-10c1-409a-9ceb-084851be8590"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:37.109847 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c3781979-a9be-40bc-9c38-8a3b168559c1 req-34240350-c07a-440c-bae6-fba58bf68844 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:37.118531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c3781979-a9be-40bc-9c38-8a3b168559c1 req-34240350-c07a-440c-bae6-fba58bf68844 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:37.121554 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c3781979-a9be-40bc-9c38-8a3b168559c1 req-34240350-c07a-440c-bae6-fba58bf68844 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:37.220837 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c3781979-a9be-40bc-9c38-8a3b168559c1 req-34240350-c07a-440c-bae6-fba58bf68844 service nova] Creating event network-changed:236bdb6a-10c1-409a-9ceb-084851be8590 for instance f070fedf-8028-43e3-97f9-8955e81dc84b on n-h2-852087-9 Sep 07 12:33:37.234335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f54c6238-309d-4a32-ab76-2fc754af4068 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:37.285360 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c3781979-a9be-40bc-9c38-8a3b168559c1 req-34240350-c07a-440c-bae6-fba58bf68844 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.247989 Sep 07 12:33:37.295548 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 637/1284] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:33:37.296319 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f54c6238-309d-4a32-ab76-2fc754af4068 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1471 microversion: 2.1 time: 1.952271 Sep 07 12:33:37.310831 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 648/1285] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:35 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1471 bytes in 1976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:37.347375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2d718ad4-9a75-4ff2-9fe7-4ef882397f7c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:37.349524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3a833582-3701-408e-bcb6-c138c1df1df1 req-e00f26d3-7fb2-4168-8c0e-86d897400b6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b849d7d-db03-43d3-b94c-3808ea7ae0cb", "name": "network-vif-unplugged", "status": "completed", "tag": "d76c4cb6-1ff0-4c6b-9d8f-eb2ec1601a0d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:37.354767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2d718ad4-9a75-4ff2-9fe7-4ef882397f7c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:37.400938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3a833582-3701-408e-bcb6-c138c1df1df1 req-e00f26d3-7fb2-4168-8c0e-86d897400b6e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:37.403399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d718ad4-9a75-4ff2-9fe7-4ef882397f7c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:37.405181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3a833582-3701-408e-bcb6-c138c1df1df1 req-e00f26d3-7fb2-4168-8c0e-86d897400b6e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:37.408201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3a833582-3701-408e-bcb6-c138c1df1df1 req-e00f26d3-7fb2-4168-8c0e-86d897400b6e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:37.409376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d718ad4-9a75-4ff2-9fe7-4ef882397f7c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:37.416616 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d718ad4-9a75-4ff2-9fe7-4ef882397f7c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:37.418293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d718ad4-9a75-4ff2-9fe7-4ef882397f7c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:37.418883 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d718ad4-9a75-4ff2-9fe7-4ef882397f7c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:37.422531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d718ad4-9a75-4ff2-9fe7-4ef882397f7c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:37.463316 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3a833582-3701-408e-bcb6-c138c1df1df1 req-e00f26d3-7fb2-4168-8c0e-86d897400b6e service nova] Creating event network-vif-unplugged:d76c4cb6-1ff0-4c6b-9d8f-eb2ec1601a0d for instance 7b849d7d-db03-43d3-b94c-3808ea7ae0cb on n-h2-852087-9 Sep 07 12:33:37.491638 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3a833582-3701-408e-bcb6-c138c1df1df1 req-e00f26d3-7fb2-4168-8c0e-86d897400b6e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.163558 Sep 07 12:33:37.497425 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 649/1286] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:33:37.539524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ce36a407-11dd-4e4a-be8c-150c3a2f50ec tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:37.544917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ce36a407-11dd-4e4a-be8c-150c3a2f50ec tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:37.596245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce36a407-11dd-4e4a-be8c-150c3a2f50ec tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:37.607635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce36a407-11dd-4e4a-be8c-150c3a2f50ec tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:37.620226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce36a407-11dd-4e4a-be8c-150c3a2f50ec tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:37.626055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce36a407-11dd-4e4a-be8c-150c3a2f50ec tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:37.628702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce36a407-11dd-4e4a-be8c-150c3a2f50ec tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:37.630197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce36a407-11dd-4e4a-be8c-150c3a2f50ec tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:38.429187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ce36a407-11dd-4e4a-be8c-150c3a2f50ec tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:38.494915 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ce36a407-11dd-4e4a-be8c-150c3a2f50ec tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4" status: 200 len: 1288 microversion: 2.1 time: 0.987701 Sep 07 12:33:38.508625 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 650/1287] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:37 2022] GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 => generated 1288 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:38.547831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b1bf8cd2-05c8-4055-8215-67dbfc736790 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:38.554172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b1bf8cd2-05c8-4055-8215-67dbfc736790 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:38.588040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:33:38.601434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1bf8cd2-05c8-4055-8215-67dbfc736790 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:38.603684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1bf8cd2-05c8-4055-8215-67dbfc736790 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:38.606399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1bf8cd2-05c8-4055-8215-67dbfc736790 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:38.610380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1bf8cd2-05c8-4055-8215-67dbfc736790 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:38.611780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1bf8cd2-05c8-4055-8215-67dbfc736790 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:38.614731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1bf8cd2-05c8-4055-8215-67dbfc736790 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:39.488676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b1bf8cd2-05c8-4055-8215-67dbfc736790 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:39.505967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b1bf8cd2-05c8-4055-8215-67dbfc736790 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:39.511081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b1bf8cd2-05c8-4055-8215-67dbfc736790 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:39.527115 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b1bf8cd2-05c8-4055-8215-67dbfc736790 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1553 microversion: 2.91 time: 1.013762 Sep 07 12:33:39.529048 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 651/1288] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:38 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1553 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:39.541083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2d718ad4-9a75-4ff2-9fe7-4ef882397f7c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:39.559823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e40afc30-5a92-45c7-95c1-da2394f24264 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:39.578810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e40afc30-5a92-45c7-95c1-da2394f24264 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:39.582745 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2d718ad4-9a75-4ff2-9fe7-4ef882397f7c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1477 microversion: 2.1 time: 2.279701 Sep 07 12:33:39.600655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e40afc30-5a92-45c7-95c1-da2394f24264 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:39.602305 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 638/1289] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:37 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1477 bytes in 2299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:39.606167 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e40afc30-5a92-45c7-95c1-da2394f24264 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:39.608057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e40afc30-5a92-45c7-95c1-da2394f24264 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:39.613745 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e40afc30-5a92-45c7-95c1-da2394f24264 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:39.614777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b3d40595-e3f6-4fe9-8112-cc7155e2e976 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:39.615432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b3d40595-e3f6-4fe9-8112-cc7155e2e976 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:39.615653 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e40afc30-5a92-45c7-95c1-da2394f24264 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:39.616665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e40afc30-5a92-45c7-95c1-da2394f24264 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:39.651743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3d40595-e3f6-4fe9-8112-cc7155e2e976 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:39.652257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3d40595-e3f6-4fe9-8112-cc7155e2e976 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:39.652704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3d40595-e3f6-4fe9-8112-cc7155e2e976 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:39.653472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3d40595-e3f6-4fe9-8112-cc7155e2e976 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:39.653968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3d40595-e3f6-4fe9-8112-cc7155e2e976 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:39.659898 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3d40595-e3f6-4fe9-8112-cc7155e2e976 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:41.573102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b3d40595-e3f6-4fe9-8112-cc7155e2e976 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:41.588117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b3d40595-e3f6-4fe9-8112-cc7155e2e976 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:41.593853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e40afc30-5a92-45c7-95c1-da2394f24264 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:41.601709 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b3d40595-e3f6-4fe9-8112-cc7155e2e976 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:41.607709 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e40afc30-5a92-45c7-95c1-da2394f24264 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1716 microversion: 2.1 time: 2.077140 Sep 07 12:33:41.611554 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b3d40595-e3f6-4fe9-8112-cc7155e2e976 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1411 microversion: 2.25 time: 2.003702 Sep 07 12:33:41.615364 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 639/1290] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:39 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1411 bytes in 2012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:41.626032 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 652/1291] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:39 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1716 bytes in 2096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:41.645915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aa47179a-ee77-4946-a485-0634e63cdb53 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:41.649607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c4a87beb-16ed-4326-a0ca-b16f3735f4f8 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:41.650260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c4a87beb-16ed-4326-a0ca-b16f3735f4f8 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:41.650935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aa47179a-ee77-4946-a485-0634e63cdb53 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:41.666253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4a87beb-16ed-4326-a0ca-b16f3735f4f8 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:41.667102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4a87beb-16ed-4326-a0ca-b16f3735f4f8 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:41.667744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4a87beb-16ed-4326-a0ca-b16f3735f4f8 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:41.670619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4a87beb-16ed-4326-a0ca-b16f3735f4f8 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:41.671405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4a87beb-16ed-4326-a0ca-b16f3735f4f8 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:41.678022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4a87beb-16ed-4326-a0ca-b16f3735f4f8 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:41.679260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa47179a-ee77-4946-a485-0634e63cdb53 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:41.679773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa47179a-ee77-4946-a485-0634e63cdb53 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:41.680222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa47179a-ee77-4946-a485-0634e63cdb53 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:41.680966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa47179a-ee77-4946-a485-0634e63cdb53 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:41.681438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa47179a-ee77-4946-a485-0634e63cdb53 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:41.682149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa47179a-ee77-4946-a485-0634e63cdb53 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:42.722692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c4a87beb-16ed-4326-a0ca-b16f3735f4f8 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:42.733336 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c4a87beb-16ed-4326-a0ca-b16f3735f4f8 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4" status: 200 len: 1318 microversion: 2.1 time: 1.105793 Sep 07 12:33:42.744377 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 653/1292] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:41 2022] GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 => generated 1318 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:42.755045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d5360fd-0283-4409-a4cf-d890a5d99274 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:42.756343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1d5360fd-0283-4409-a4cf-d890a5d99274 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:42.765271 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d5360fd-0283-4409-a4cf-d890a5d99274 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:42.766345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d5360fd-0283-4409-a4cf-d890a5d99274 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:42.767049 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d5360fd-0283-4409-a4cf-d890a5d99274 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:42.768302 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d5360fd-0283-4409-a4cf-d890a5d99274 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:42.769370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d5360fd-0283-4409-a4cf-d890a5d99274 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:42.770773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d5360fd-0283-4409-a4cf-d890a5d99274 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:42.816131 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aa47179a-ee77-4946-a485-0634e63cdb53 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:42.835087 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aa47179a-ee77-4946-a485-0634e63cdb53 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1471 microversion: 2.1 time: 1.218085 Sep 07 12:33:42.841083 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 640/1293] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:41 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1471 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:42.861556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c83bc2d6-968a-4296-959e-d010b6a8f90d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:42.864670 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c83bc2d6-968a-4296-959e-d010b6a8f90d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:42.885156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c83bc2d6-968a-4296-959e-d010b6a8f90d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:42.886170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c83bc2d6-968a-4296-959e-d010b6a8f90d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:42.886902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c83bc2d6-968a-4296-959e-d010b6a8f90d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:42.888011 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c83bc2d6-968a-4296-959e-d010b6a8f90d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:42.888780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c83bc2d6-968a-4296-959e-d010b6a8f90d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:42.890054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c83bc2d6-968a-4296-959e-d010b6a8f90d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:43.095398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:33:43.128938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1d5360fd-0283-4409-a4cf-d890a5d99274 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:43.147393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1d5360fd-0283-4409-a4cf-d890a5d99274 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:43.150135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1d5360fd-0283-4409-a4cf-d890a5d99274 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:43.171708 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1d5360fd-0283-4409-a4cf-d890a5d99274 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1553 microversion: 2.91 time: 0.424943 Sep 07 12:33:43.172755 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 654/1294] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:42 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1553 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:43.445943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c83bc2d6-968a-4296-959e-d010b6a8f90d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:43.505737 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c83bc2d6-968a-4296-959e-d010b6a8f90d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1477 microversion: 2.1 time: 0.661909 Sep 07 12:33:43.517091 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 641/1295] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:42 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1477 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:43.551021 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-2fd82c05-79d9-43dd-95ec-589f924e61e1 req-6cff435b-04a0-4231-be2c-aa21446d7c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b849d7d-db03-43d3-b94c-3808ea7ae0cb", "name": "network-vif-plugged", "status": "completed", "tag": "d76c4cb6-1ff0-4c6b-9d8f-eb2ec1601a0d"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:43.597906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fbbdeb58-16c4-49e8-bdc6-a8b784d8ead2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-496927734", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "d72920fd-5bbc-4fad-ab8f-6932e7c7ba21"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:43.621758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2fd82c05-79d9-43dd-95ec-589f924e61e1 req-6cff435b-04a0-4231-be2c-aa21446d7c04 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:43.622775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2fd82c05-79d9-43dd-95ec-589f924e61e1 req-6cff435b-04a0-4231-be2c-aa21446d7c04 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:43.623639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2fd82c05-79d9-43dd-95ec-589f924e61e1 req-6cff435b-04a0-4231-be2c-aa21446d7c04 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:43.691114 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-2fd82c05-79d9-43dd-95ec-589f924e61e1 req-6cff435b-04a0-4231-be2c-aa21446d7c04 service nova] Creating event network-vif-plugged:d76c4cb6-1ff0-4c6b-9d8f-eb2ec1601a0d for instance 7b849d7d-db03-43d3-b94c-3808ea7ae0cb on n-h2-852087-9 Sep 07 12:33:43.723376 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-2fd82c05-79d9-43dd-95ec-589f924e61e1 req-6cff435b-04a0-4231-be2c-aa21446d7c04 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203420 Sep 07 12:33:43.729916 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 642/1296] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:33:43.748946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c0d4f2d7-adb7-429f-ab0c-0227777bf7da tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:43.751645 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c0d4f2d7-adb7-429f-ab0c-0227777bf7da tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:43.770233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0d4f2d7-adb7-429f-ab0c-0227777bf7da tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:43.771568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0d4f2d7-adb7-429f-ab0c-0227777bf7da tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:43.772569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0d4f2d7-adb7-429f-ab0c-0227777bf7da tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:43.774479 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0d4f2d7-adb7-429f-ab0c-0227777bf7da tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:43.820953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0d4f2d7-adb7-429f-ab0c-0227777bf7da tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:43.822506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-fbbdeb58-16c4-49e8-bdc6-a8b784d8ead2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] validate_networks() for [('d72920fd-5bbc-4fad-ab8f-6932e7c7ba21', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:33:43.845843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0d4f2d7-adb7-429f-ab0c-0227777bf7da tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.061s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:44.669454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=10 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:33:44.697093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c0d4f2d7-adb7-429f-ab0c-0227777bf7da tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:44.718854 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c0d4f2d7-adb7-429f-ab0c-0227777bf7da tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1716 microversion: 2.1 time: 0.985358 Sep 07 12:33:44.737528 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 643/1297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:43 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1716 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:44.745723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c73d9c58-70e4-40b6-9abf-ed0134ed469e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:44.746849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c73d9c58-70e4-40b6-9abf-ed0134ed469e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:44.753918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c73d9c58-70e4-40b6-9abf-ed0134ed469e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:44.755633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c73d9c58-70e4-40b6-9abf-ed0134ed469e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:44.756192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c73d9c58-70e4-40b6-9abf-ed0134ed469e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:44.757090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c73d9c58-70e4-40b6-9abf-ed0134ed469e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:44.757729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c73d9c58-70e4-40b6-9abf-ed0134ed469e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:44.760948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c73d9c58-70e4-40b6-9abf-ed0134ed469e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:45.343255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c73d9c58-70e4-40b6-9abf-ed0134ed469e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:45.367632 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c73d9c58-70e4-40b6-9abf-ed0134ed469e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:45.372496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c73d9c58-70e4-40b6-9abf-ed0134ed469e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:45.376574 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c73d9c58-70e4-40b6-9abf-ed0134ed469e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1411 microversion: 2.25 time: 0.635800 Sep 07 12:33:45.378569 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 644/1298] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:44 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1411 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:45.396620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-097e2377-dc8c-49e8-9e91-16549fe66361 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:45.398302 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-097e2377-dc8c-49e8-9e91-16549fe66361 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:45.435209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fbbdeb58-16c4-49e8-bdc6-a8b784d8ead2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:33:45.436144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fbbdeb58-16c4-49e8-bdc6-a8b784d8ead2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:33:45.437105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fbbdeb58-16c4-49e8-bdc6-a8b784d8ead2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:33:45.437968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fbbdeb58-16c4-49e8-bdc6-a8b784d8ead2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:33:45.438124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-097e2377-dc8c-49e8-9e91-16549fe66361 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:45.438894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fbbdeb58-16c4-49e8-bdc6-a8b784d8ead2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:33:45.439036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-097e2377-dc8c-49e8-9e91-16549fe66361 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:45.439690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-097e2377-dc8c-49e8-9e91-16549fe66361 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:45.440965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-097e2377-dc8c-49e8-9e91-16549fe66361 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:45.441819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-097e2377-dc8c-49e8-9e91-16549fe66361 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:45.442804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-097e2377-dc8c-49e8-9e91-16549fe66361 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:45.484591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbbdeb58-16c4-49e8-bdc6-a8b784d8ead2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:45.487027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbbdeb58-16c4-49e8-bdc6-a8b784d8ead2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:45.493596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbbdeb58-16c4-49e8-bdc6-a8b784d8ead2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:45.496675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbbdeb58-16c4-49e8-bdc6-a8b784d8ead2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:45.498060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbbdeb58-16c4-49e8-bdc6-a8b784d8ead2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:45.501072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbbdeb58-16c4-49e8-bdc6-a8b784d8ead2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:45.589213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-fbbdeb58-16c4-49e8-bdc6-a8b784d8ead2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Getting quotas for project 081286d7e4664e239ace13466a4a9c50. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:33:45.597934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-fbbdeb58-16c4-49e8-bdc6-a8b784d8ead2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Getting quotas for user 3d68cf87771f4e9f9caab95adf58b129 and project 081286d7e4664e239ace13466a4a9c50. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:33:45.627441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fbbdeb58-16c4-49e8-bdc6-a8b784d8ead2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:33:45.630370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fbbdeb58-16c4-49e8-bdc6-a8b784d8ead2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2f6ee92e-b663-4984-9198-d2ca0f8b3892] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:33:45.690640 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fbbdeb58-16c4-49e8-bdc6-a8b784d8ead2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.511414 Sep 07 12:33:45.691924 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 655/1299] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:33:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:33:45.697932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b6f08fcd-1963-40a0-a4df-489bef261f48 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:45.699179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b6f08fcd-1963-40a0-a4df-489bef261f48 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:45.711026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6f08fcd-1963-40a0-a4df-489bef261f48 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:45.711939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6f08fcd-1963-40a0-a4df-489bef261f48 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:45.712645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6f08fcd-1963-40a0-a4df-489bef261f48 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:45.713829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6f08fcd-1963-40a0-a4df-489bef261f48 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:45.714549 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6f08fcd-1963-40a0-a4df-489bef261f48 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:45.715143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6f08fcd-1963-40a0-a4df-489bef261f48 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:47.276389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-097e2377-dc8c-49e8-9e91-16549fe66361 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:47.290392 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-097e2377-dc8c-49e8-9e91-16549fe66361 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4" status: 200 len: 1318 microversion: 2.1 time: 1.909914 Sep 07 12:33:47.296792 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 645/1300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:45 2022] GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 => generated 1318 bytes in 1917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:47.312785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8b6a30e2-fe1e-4d4e-b1fc-5ad00eeabbfb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:47.313696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8b6a30e2-fe1e-4d4e-b1fc-5ad00eeabbfb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:47.328880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b6a30e2-fe1e-4d4e-b1fc-5ad00eeabbfb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:47.329400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b6a30e2-fe1e-4d4e-b1fc-5ad00eeabbfb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:47.329888 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b6a30e2-fe1e-4d4e-b1fc-5ad00eeabbfb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:47.334636 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b6a30e2-fe1e-4d4e-b1fc-5ad00eeabbfb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:47.340948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b6a30e2-fe1e-4d4e-b1fc-5ad00eeabbfb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:47.347390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b6a30e2-fe1e-4d4e-b1fc-5ad00eeabbfb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:47.517118 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b6f08fcd-1963-40a0-a4df-489bef261f48 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:47.556466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8b6a30e2-fe1e-4d4e-b1fc-5ad00eeabbfb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:47.566851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8b6a30e2-fe1e-4d4e-b1fc-5ad00eeabbfb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:47.567095 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b6f08fcd-1963-40a0-a4df-489bef261f48 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1476 microversion: 2.1 time: 1.873523 Sep 07 12:33:47.568101 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 656/1301] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:45 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1476 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:47.569184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8b6a30e2-fe1e-4d4e-b1fc-5ad00eeabbfb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:47.581762 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8b6a30e2-fe1e-4d4e-b1fc-5ad00eeabbfb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1553 microversion: 2.91 time: 0.281805 Sep 07 12:33:47.600529 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 646/1302] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:47 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1553 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:47.614710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-56b0bbbc-fc02-4ff7-b7d8-6e0c286af1c0 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:47.615885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-56b0bbbc-fc02-4ff7-b7d8-6e0c286af1c0 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2f6ee92e-b663-4984-9198-d2ca0f8b3892] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:47.623815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56b0bbbc-fc02-4ff7-b7d8-6e0c286af1c0 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:47.624720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56b0bbbc-fc02-4ff7-b7d8-6e0c286af1c0 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:47.625369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56b0bbbc-fc02-4ff7-b7d8-6e0c286af1c0 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:47.626336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56b0bbbc-fc02-4ff7-b7d8-6e0c286af1c0 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:47.627166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56b0bbbc-fc02-4ff7-b7d8-6e0c286af1c0 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:47.628030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56b0bbbc-fc02-4ff7-b7d8-6e0c286af1c0 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:47.637335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1e5c8f2f-6483-4c62-9e3e-3b661220e333 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:47.642198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1e5c8f2f-6483-4c62-9e3e-3b661220e333 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:47.672610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e5c8f2f-6483-4c62-9e3e-3b661220e333 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:47.673465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e5c8f2f-6483-4c62-9e3e-3b661220e333 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:47.674253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e5c8f2f-6483-4c62-9e3e-3b661220e333 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:47.675552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e5c8f2f-6483-4c62-9e3e-3b661220e333 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:47.677143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e5c8f2f-6483-4c62-9e3e-3b661220e333 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:47.677143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e5c8f2f-6483-4c62-9e3e-3b661220e333 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:47.905956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-56b0bbbc-fc02-4ff7-b7d8-6e0c286af1c0 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:47.928555 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-56b0bbbc-fc02-4ff7-b7d8-6e0c286af1c0 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892" status: 200 len: 1259 microversion: 2.1 time: 0.326340 Sep 07 12:33:47.931935 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 647/1303] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:47 2022] GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892 => generated 1259 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:48.238196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1e5c8f2f-6483-4c62-9e3e-3b661220e333 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:48.280429 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1e5c8f2f-6483-4c62-9e3e-3b661220e333 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1463 microversion: 2.1 time: 0.647233 Sep 07 12:33:48.298997 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 657/1304] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:47 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1463 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:48.325189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-59b40c47-66b8-4b69-b64a-edb69d2ec794 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:48.325727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-891eec74-da85-481c-aadc-f88fb5e54b1e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:48.326468 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-59b40c47-66b8-4b69-b64a-edb69d2ec794 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:48.326652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-891eec74-da85-481c-aadc-f88fb5e54b1e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:48.334372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-891eec74-da85-481c-aadc-f88fb5e54b1e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:48.343727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-891eec74-da85-481c-aadc-f88fb5e54b1e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:48.347555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-891eec74-da85-481c-aadc-f88fb5e54b1e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:48.351284 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-891eec74-da85-481c-aadc-f88fb5e54b1e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:48.354779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-891eec74-da85-481c-aadc-f88fb5e54b1e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:48.358535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-891eec74-da85-481c-aadc-f88fb5e54b1e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:48.374047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59b40c47-66b8-4b69-b64a-edb69d2ec794 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:48.374974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59b40c47-66b8-4b69-b64a-edb69d2ec794 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:48.375961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59b40c47-66b8-4b69-b64a-edb69d2ec794 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:48.377162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59b40c47-66b8-4b69-b64a-edb69d2ec794 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:48.385044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59b40c47-66b8-4b69-b64a-edb69d2ec794 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:48.388099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59b40c47-66b8-4b69-b64a-edb69d2ec794 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:48.405354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:33:48.739031 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-891eec74-da85-481c-aadc-f88fb5e54b1e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:48.755143 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-891eec74-da85-481c-aadc-f88fb5e54b1e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1716 microversion: 2.1 time: 0.821605 Sep 07 12:33:48.758336 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 648/1305] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:47 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1716 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:48.767680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-4c9aaa4c-0d4d-4d68-817d-c2b198da59e9 req-3ec0825f-c56d-495b-a4aa-e5318c0233e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f8cd2a9-2d75-4dee-b17d-434f35f15ba4", "tag": "308f2d25-df8e-4168-b05c-f1c950dbcca9"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:48.792857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4c9aaa4c-0d4d-4d68-817d-c2b198da59e9 req-3ec0825f-c56d-495b-a4aa-e5318c0233e3 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:48.796007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4c9aaa4c-0d4d-4d68-817d-c2b198da59e9 req-3ec0825f-c56d-495b-a4aa-e5318c0233e3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:48.798797 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4c9aaa4c-0d4d-4d68-817d-c2b198da59e9 req-3ec0825f-c56d-495b-a4aa-e5318c0233e3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:48.831123 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-4c9aaa4c-0d4d-4d68-817d-c2b198da59e9 req-3ec0825f-c56d-495b-a4aa-e5318c0233e3 service nova] Creating event network-changed:308f2d25-df8e-4168-b05c-f1c950dbcca9 for instance 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 on n-h1-852087-9 Sep 07 12:33:48.849311 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-4c9aaa4c-0d4d-4d68-817d-c2b198da59e9 req-3ec0825f-c56d-495b-a4aa-e5318c0233e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088905 Sep 07 12:33:48.850658 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 649/1306] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:33:48.864288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-917b24a4-8600-4edc-a492-aa3711ace51b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:48.866855 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-917b24a4-8600-4edc-a492-aa3711ace51b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:48.890124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-917b24a4-8600-4edc-a492-aa3711ace51b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:48.890999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-917b24a4-8600-4edc-a492-aa3711ace51b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:48.891701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-917b24a4-8600-4edc-a492-aa3711ace51b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:48.892667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-917b24a4-8600-4edc-a492-aa3711ace51b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:48.892997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-59b40c47-66b8-4b69-b64a-edb69d2ec794 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:48.894452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-917b24a4-8600-4edc-a492-aa3711ace51b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:48.895133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-917b24a4-8600-4edc-a492-aa3711ace51b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:48.898941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:33:48.933903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-59b40c47-66b8-4b69-b64a-edb69d2ec794 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:48.942829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-59b40c47-66b8-4b69-b64a-edb69d2ec794 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:48.945127 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-59b40c47-66b8-4b69-b64a-edb69d2ec794 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1411 microversion: 2.25 time: 0.644044 Sep 07 12:33:48.991321 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 658/1307] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:48 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1411 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:49.025682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-83d67760-592d-4339-b7e1-c3923b391776 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:49.027174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-83d67760-592d-4339-b7e1-c3923b391776 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:49.074569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83d67760-592d-4339-b7e1-c3923b391776 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:49.100769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83d67760-592d-4339-b7e1-c3923b391776 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:49.103419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83d67760-592d-4339-b7e1-c3923b391776 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:49.109289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83d67760-592d-4339-b7e1-c3923b391776 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:49.110431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83d67760-592d-4339-b7e1-c3923b391776 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:49.121848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83d67760-592d-4339-b7e1-c3923b391776 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:49.279999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-917b24a4-8600-4edc-a492-aa3711ace51b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:49.299600 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-917b24a4-8600-4edc-a492-aa3711ace51b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1463 microversion: 2.1 time: 0.447090 Sep 07 12:33:49.300951 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 650/1308] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:48 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1463 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:49.308528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e7cf03f9-4b6c-4dc5-ae5a-4f585f9f9dc3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:49.309820 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e7cf03f9-4b6c-4dc5-ae5a-4f585f9f9dc3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:49.333426 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7cf03f9-4b6c-4dc5-ae5a-4f585f9f9dc3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:49.336075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7cf03f9-4b6c-4dc5-ae5a-4f585f9f9dc3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:49.337197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7cf03f9-4b6c-4dc5-ae5a-4f585f9f9dc3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:49.343700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7cf03f9-4b6c-4dc5-ae5a-4f585f9f9dc3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:49.346611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7cf03f9-4b6c-4dc5-ae5a-4f585f9f9dc3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:49.347213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7cf03f9-4b6c-4dc5-ae5a-4f585f9f9dc3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:49.598292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-83d67760-592d-4339-b7e1-c3923b391776 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:49.609019 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-83d67760-592d-4339-b7e1-c3923b391776 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4" status: 200 len: 1318 microversion: 2.1 time: 0.614987 Sep 07 12:33:49.628583 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 659/1309] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:48 2022] GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 => generated 1318 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:49.637412 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-82d68972-d2e8-4856-9900-ab2687bf4f69 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:49.638283 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-82d68972-d2e8-4856-9900-ab2687bf4f69 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:49.649595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82d68972-d2e8-4856-9900-ab2687bf4f69 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:49.656069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82d68972-d2e8-4856-9900-ab2687bf4f69 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:49.656769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82d68972-d2e8-4856-9900-ab2687bf4f69 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:49.657790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82d68972-d2e8-4856-9900-ab2687bf4f69 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:49.662101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82d68972-d2e8-4856-9900-ab2687bf4f69 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:49.662720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82d68972-d2e8-4856-9900-ab2687bf4f69 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:49.715490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e7cf03f9-4b6c-4dc5-ae5a-4f585f9f9dc3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:49.731541 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e7cf03f9-4b6c-4dc5-ae5a-4f585f9f9dc3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1476 microversion: 2.1 time: 0.429066 Sep 07 12:33:49.732861 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 651/1310] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:49 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1476 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:49.742338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a5da57af-2ee2-4799-80a3-ff52b30e4b0f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:49.745303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a5da57af-2ee2-4799-80a3-ff52b30e4b0f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2f6ee92e-b663-4984-9198-d2ca0f8b3892] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:49.759396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5da57af-2ee2-4799-80a3-ff52b30e4b0f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:49.762244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5da57af-2ee2-4799-80a3-ff52b30e4b0f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:49.762991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5da57af-2ee2-4799-80a3-ff52b30e4b0f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:49.769927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5da57af-2ee2-4799-80a3-ff52b30e4b0f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:49.770795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5da57af-2ee2-4799-80a3-ff52b30e4b0f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:49.771415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5da57af-2ee2-4799-80a3-ff52b30e4b0f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:49.819736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-82d68972-d2e8-4856-9900-ab2687bf4f69 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:49.830818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-82d68972-d2e8-4856-9900-ab2687bf4f69 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:49.832345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-82d68972-d2e8-4856-9900-ab2687bf4f69 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:49.839183 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-82d68972-d2e8-4856-9900-ab2687bf4f69 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1553 microversion: 2.91 time: 0.209193 Sep 07 12:33:49.854125 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 660/1311] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:49 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1553 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:49.947435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-678d36f4-3f76-4c53-bd96-de8b3d8c193e req-130639f8-df89-4403-aff9-354cf364e90b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f070fedf-8028-43e3-97f9-8955e81dc84b", "name": "network-vif-plugged", "status": "completed", "tag": "236bdb6a-10c1-409a-9ceb-084851be8590"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:49.950994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a5da57af-2ee2-4799-80a3-ff52b30e4b0f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:49.969524 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a5da57af-2ee2-4799-80a3-ff52b30e4b0f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892" status: 200 len: 1267 microversion: 2.1 time: 0.235262 Sep 07 12:33:49.970620 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 652/1312] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:49 2022] GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892 => generated 1267 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:49.977703 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c3818eec-d8e5-49f7-b77a-9004251869c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:49.980694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c3818eec-d8e5-49f7-b77a-9004251869c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:49.983520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-678d36f4-3f76-4c53-bd96-de8b3d8c193e req-130639f8-df89-4403-aff9-354cf364e90b service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:49.984216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-678d36f4-3f76-4c53-bd96-de8b3d8c193e req-130639f8-df89-4403-aff9-354cf364e90b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:49.984671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-678d36f4-3f76-4c53-bd96-de8b3d8c193e req-130639f8-df89-4403-aff9-354cf364e90b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:50.001927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3818eec-d8e5-49f7-b77a-9004251869c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:50.002813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3818eec-d8e5-49f7-b77a-9004251869c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:50.004251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3818eec-d8e5-49f7-b77a-9004251869c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:50.006467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3818eec-d8e5-49f7-b77a-9004251869c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:50.007932 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-678d36f4-3f76-4c53-bd96-de8b3d8c193e req-130639f8-df89-4403-aff9-354cf364e90b service nova] Creating event network-vif-plugged:236bdb6a-10c1-409a-9ceb-084851be8590 for instance f070fedf-8028-43e3-97f9-8955e81dc84b on n-h2-852087-9 Sep 07 12:33:50.011680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3818eec-d8e5-49f7-b77a-9004251869c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:50.012209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3818eec-d8e5-49f7-b77a-9004251869c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:50.018351 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-678d36f4-3f76-4c53-bd96-de8b3d8c193e req-130639f8-df89-4403-aff9-354cf364e90b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162207 Sep 07 12:33:50.021334 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 661/1313] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:33:50.040179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f3ec252d-561e-4572-852f-abc1e7c1d781 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:50.040726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f3ec252d-561e-4572-852f-abc1e7c1d781 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:50.050490 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3ec252d-561e-4572-852f-abc1e7c1d781 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:50.050998 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3ec252d-561e-4572-852f-abc1e7c1d781 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:50.051447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3ec252d-561e-4572-852f-abc1e7c1d781 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:50.052192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3ec252d-561e-4572-852f-abc1e7c1d781 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:50.052656 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3ec252d-561e-4572-852f-abc1e7c1d781 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:50.053091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3ec252d-561e-4572-852f-abc1e7c1d781 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:50.165762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:33:50.170548 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c3818eec-d8e5-49f7-b77a-9004251869c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:33:50.171316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c3818eec-d8e5-49f7-b77a-9004251869c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:33:50.171939 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c3818eec-d8e5-49f7-b77a-9004251869c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:33:50.172488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c3818eec-d8e5-49f7-b77a-9004251869c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:33:50.173237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c3818eec-d8e5-49f7-b77a-9004251869c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:33:50.291319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c3818eec-d8e5-49f7-b77a-9004251869c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:50.313303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3818eec-d8e5-49f7-b77a-9004251869c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:50.313986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3818eec-d8e5-49f7-b77a-9004251869c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:50.314575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3818eec-d8e5-49f7-b77a-9004251869c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:50.315853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3818eec-d8e5-49f7-b77a-9004251869c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:50.316520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3818eec-d8e5-49f7-b77a-9004251869c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:50.317062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3818eec-d8e5-49f7-b77a-9004251869c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:50.354990 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c3818eec-d8e5-49f7-b77a-9004251869c1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "POST /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb/action" status: 202 len: 1067 microversion: 2.1 time: 0.383135 Sep 07 12:33:50.374745 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 653/1314] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:33:49 2022] POST /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb/action => generated 1067 bytes in 403 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 07 12:33:50.382669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9d4875f4-59d7-45fe-8c27-3b4e045b25d0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:50.383335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9d4875f4-59d7-45fe-8c27-3b4e045b25d0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:50.393664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d4875f4-59d7-45fe-8c27-3b4e045b25d0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:50.394375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d4875f4-59d7-45fe-8c27-3b4e045b25d0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:50.394955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d4875f4-59d7-45fe-8c27-3b4e045b25d0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:50.395815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d4875f4-59d7-45fe-8c27-3b4e045b25d0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:50.396889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d4875f4-59d7-45fe-8c27-3b4e045b25d0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:50.397449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d4875f4-59d7-45fe-8c27-3b4e045b25d0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:50.503100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f3ec252d-561e-4572-852f-abc1e7c1d781 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:50.516918 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f3ec252d-561e-4572-852f-abc1e7c1d781 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1716 microversion: 2.1 time: 0.493205 Sep 07 12:33:50.518300 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 662/1315] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:50 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1716 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:50.523956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9b989af4-5371-44ff-8c2a-f94c0922d20b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:50.524590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9b989af4-5371-44ff-8c2a-f94c0922d20b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:50.532633 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b989af4-5371-44ff-8c2a-f94c0922d20b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:50.533925 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b989af4-5371-44ff-8c2a-f94c0922d20b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:50.534584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b989af4-5371-44ff-8c2a-f94c0922d20b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:50.535842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b989af4-5371-44ff-8c2a-f94c0922d20b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:50.536327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b989af4-5371-44ff-8c2a-f94c0922d20b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:50.536767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b989af4-5371-44ff-8c2a-f94c0922d20b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:50.700017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9d4875f4-59d7-45fe-8c27-3b4e045b25d0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:50.710646 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9d4875f4-59d7-45fe-8c27-3b4e045b25d0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:50.713533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9d4875f4-59d7-45fe-8c27-3b4e045b25d0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:50.713533 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9d4875f4-59d7-45fe-8c27-3b4e045b25d0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1411 microversion: 2.25 time: 0.336817 Sep 07 12:33:50.715007 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 654/1316] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:50 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1411 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:50.725096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-98d4cb3f-5150-463c-99e9-48a84f2db0ab tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:50.726670 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-98d4cb3f-5150-463c-99e9-48a84f2db0ab tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:50.737897 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98d4cb3f-5150-463c-99e9-48a84f2db0ab tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:50.743660 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98d4cb3f-5150-463c-99e9-48a84f2db0ab tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:50.745786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98d4cb3f-5150-463c-99e9-48a84f2db0ab tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:50.750205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98d4cb3f-5150-463c-99e9-48a84f2db0ab tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:50.752364 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98d4cb3f-5150-463c-99e9-48a84f2db0ab tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:50.753428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98d4cb3f-5150-463c-99e9-48a84f2db0ab tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:50.794665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9b989af4-5371-44ff-8c2a-f94c0922d20b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:50.811930 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9b989af4-5371-44ff-8c2a-f94c0922d20b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.292430 Sep 07 12:33:50.813024 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 663/1317] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:50 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:50.831138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-828d58aa-b8da-47b8-b17a-6bbff2bc18cd tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:50.832053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-828d58aa-b8da-47b8-b17a-6bbff2bc18cd tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:50.853519 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-828d58aa-b8da-47b8-b17a-6bbff2bc18cd tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:50.854396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-828d58aa-b8da-47b8-b17a-6bbff2bc18cd tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:50.855157 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-828d58aa-b8da-47b8-b17a-6bbff2bc18cd tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:50.856483 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-828d58aa-b8da-47b8-b17a-6bbff2bc18cd tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:50.857336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-828d58aa-b8da-47b8-b17a-6bbff2bc18cd tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:50.858186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-828d58aa-b8da-47b8-b17a-6bbff2bc18cd tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:51.089249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-98d4cb3f-5150-463c-99e9-48a84f2db0ab tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:51.100426 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-98d4cb3f-5150-463c-99e9-48a84f2db0ab tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4" status: 200 len: 1318 microversion: 2.1 time: 0.382067 Sep 07 12:33:51.101255 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 655/1318] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:50 2022] GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:51.121824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ea81fa2-52ed-469e-a3d8-ff6d69037254 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:51.138452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0ea81fa2-52ed-469e-a3d8-ff6d69037254 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:51.152374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ea81fa2-52ed-469e-a3d8-ff6d69037254 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:51.153337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ea81fa2-52ed-469e-a3d8-ff6d69037254 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:51.154042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ea81fa2-52ed-469e-a3d8-ff6d69037254 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:51.155089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ea81fa2-52ed-469e-a3d8-ff6d69037254 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:51.155584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ea81fa2-52ed-469e-a3d8-ff6d69037254 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:51.156028 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ea81fa2-52ed-469e-a3d8-ff6d69037254 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:51.404967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0ea81fa2-52ed-469e-a3d8-ff6d69037254 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:51.444299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0ea81fa2-52ed-469e-a3d8-ff6d69037254 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:51.447487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0ea81fa2-52ed-469e-a3d8-ff6d69037254 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:51.458542 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ea81fa2-52ed-469e-a3d8-ff6d69037254 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1553 microversion: 2.91 time: 0.343317 Sep 07 12:33:51.473000 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 656/1319] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:51 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1553 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:51.496677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-828d58aa-b8da-47b8-b17a-6bbff2bc18cd tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:51.505178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f3a2a777-8706-42f8-a02b-12c1c06f1efc tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:51.507258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f3a2a777-8706-42f8-a02b-12c1c06f1efc tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2f6ee92e-b663-4984-9198-d2ca0f8b3892] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:51.516534 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-828d58aa-b8da-47b8-b17a-6bbff2bc18cd tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1476 microversion: 2.1 time: 0.701516 Sep 07 12:33:51.518544 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 664/1320] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:50 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1476 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:51.558343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c347b65a-cd68-410f-8347-beb090bcddcd tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:51.558661 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3a2a777-8706-42f8-a02b-12c1c06f1efc tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:51.560073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3a2a777-8706-42f8-a02b-12c1c06f1efc tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:51.560644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c347b65a-cd68-410f-8347-beb090bcddcd tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:51.560929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3a2a777-8706-42f8-a02b-12c1c06f1efc tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:51.562318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3a2a777-8706-42f8-a02b-12c1c06f1efc tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:51.565713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3a2a777-8706-42f8-a02b-12c1c06f1efc tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:51.566633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3a2a777-8706-42f8-a02b-12c1c06f1efc tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:51.590861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c347b65a-cd68-410f-8347-beb090bcddcd tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:51.592477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c347b65a-cd68-410f-8347-beb090bcddcd tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:51.596455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c347b65a-cd68-410f-8347-beb090bcddcd tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:51.600983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c347b65a-cd68-410f-8347-beb090bcddcd tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:51.604608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c347b65a-cd68-410f-8347-beb090bcddcd tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:51.610234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c347b65a-cd68-410f-8347-beb090bcddcd tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:51.797784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f3a2a777-8706-42f8-a02b-12c1c06f1efc tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:51.808998 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f3a2a777-8706-42f8-a02b-12c1c06f1efc tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892" status: 200 len: 1265 microversion: 2.1 time: 0.334199 Sep 07 12:33:51.827787 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 657/1321] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:51 2022] GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892 => generated 1265 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:51.838043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-13219c3f-eaeb-4e81-a9a1-f9de1617d460 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:51.838670 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-13219c3f-eaeb-4e81-a9a1-f9de1617d460 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:51.846516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13219c3f-eaeb-4e81-a9a1-f9de1617d460 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:51.847293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13219c3f-eaeb-4e81-a9a1-f9de1617d460 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:51.847944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13219c3f-eaeb-4e81-a9a1-f9de1617d460 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:51.848891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13219c3f-eaeb-4e81-a9a1-f9de1617d460 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:51.849577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13219c3f-eaeb-4e81-a9a1-f9de1617d460 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:51.850178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13219c3f-eaeb-4e81-a9a1-f9de1617d460 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:52.194706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c347b65a-cd68-410f-8347-beb090bcddcd tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:52.239178 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c347b65a-cd68-410f-8347-beb090bcddcd tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1716 microversion: 2.1 time: 0.696912 Sep 07 12:33:52.253524 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 665/1322] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:51 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1716 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:52.255356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2ba57d1e-60ec-45d9-a6cf-f638743a69ce tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:52.266172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2ba57d1e-60ec-45d9-a6cf-f638743a69ce tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:52.292069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ba57d1e-60ec-45d9-a6cf-f638743a69ce tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:52.297000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ba57d1e-60ec-45d9-a6cf-f638743a69ce tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:52.298122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ba57d1e-60ec-45d9-a6cf-f638743a69ce tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:52.303184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ba57d1e-60ec-45d9-a6cf-f638743a69ce tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:52.305059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ba57d1e-60ec-45d9-a6cf-f638743a69ce tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:52.305059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ba57d1e-60ec-45d9-a6cf-f638743a69ce tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:52.660528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-13219c3f-eaeb-4e81-a9a1-f9de1617d460 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:52.675312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-13219c3f-eaeb-4e81-a9a1-f9de1617d460 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:52.678626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-13219c3f-eaeb-4e81-a9a1-f9de1617d460 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:52.680792 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-13219c3f-eaeb-4e81-a9a1-f9de1617d460 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1411 microversion: 2.25 time: 0.849812 Sep 07 12:33:52.682636 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 658/1323] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:51 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1411 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:52.691469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c6c4c0c-9fc5-49f0-963e-f76281af8137 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:52.692956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7c6c4c0c-9fc5-49f0-963e-f76281af8137 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:52.704715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c6c4c0c-9fc5-49f0-963e-f76281af8137 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:52.706052 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c6c4c0c-9fc5-49f0-963e-f76281af8137 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:52.717778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c6c4c0c-9fc5-49f0-963e-f76281af8137 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:52.718757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c6c4c0c-9fc5-49f0-963e-f76281af8137 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:52.735850 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c6c4c0c-9fc5-49f0-963e-f76281af8137 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:52.737141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c6c4c0c-9fc5-49f0-963e-f76281af8137 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:52.920998 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2ba57d1e-60ec-45d9-a6cf-f638743a69ce tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:52.958936 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2ba57d1e-60ec-45d9-a6cf-f638743a69ce tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.715222 Sep 07 12:33:52.973807 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 666/1324] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:52 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:52.973807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-af17c993-b1da-456a-9150-ac53226bff31 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:52.973807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-af17c993-b1da-456a-9150-ac53226bff31 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:52.986960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af17c993-b1da-456a-9150-ac53226bff31 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:52.987538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af17c993-b1da-456a-9150-ac53226bff31 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:52.987968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af17c993-b1da-456a-9150-ac53226bff31 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:52.994772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af17c993-b1da-456a-9150-ac53226bff31 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:52.998192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af17c993-b1da-456a-9150-ac53226bff31 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:52.999041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af17c993-b1da-456a-9150-ac53226bff31 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:53.208200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-af17c993-b1da-456a-9150-ac53226bff31 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:53.229062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-af17c993-b1da-456a-9150-ac53226bff31 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:53.233897 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-af17c993-b1da-456a-9150-ac53226bff31 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:53.247157 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-af17c993-b1da-456a-9150-ac53226bff31 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1553 microversion: 2.91 time: 0.285537 Sep 07 12:33:53.248373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7c6c4c0c-9fc5-49f0-963e-f76281af8137 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:53.266619 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7c6c4c0c-9fc5-49f0-963e-f76281af8137 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4" status: 200 len: 1318 microversion: 2.1 time: 0.582074 Sep 07 12:33:53.271988 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 667/1325] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:52 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1553 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:53.281888 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 659/1326] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:52 2022] GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 => generated 1318 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:53.289134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cc0a8463-6ece-400f-95c0-dc0467a72025 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:53.289453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9f3aa7b3-9a9c-4df0-b5da-771e43364a6a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:53.290318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9f3aa7b3-9a9c-4df0-b5da-771e43364a6a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2f6ee92e-b663-4984-9198-d2ca0f8b3892] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:53.290437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cc0a8463-6ece-400f-95c0-dc0467a72025 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:53.304289 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f3aa7b3-9a9c-4df0-b5da-771e43364a6a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:53.305087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f3aa7b3-9a9c-4df0-b5da-771e43364a6a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:53.305567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f3aa7b3-9a9c-4df0-b5da-771e43364a6a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:53.306315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f3aa7b3-9a9c-4df0-b5da-771e43364a6a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:53.306779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f3aa7b3-9a9c-4df0-b5da-771e43364a6a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:53.307209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f3aa7b3-9a9c-4df0-b5da-771e43364a6a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:53.323696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc0a8463-6ece-400f-95c0-dc0467a72025 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:53.325039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc0a8463-6ece-400f-95c0-dc0467a72025 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:53.326232 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc0a8463-6ece-400f-95c0-dc0467a72025 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:53.327933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc0a8463-6ece-400f-95c0-dc0467a72025 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:53.329718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc0a8463-6ece-400f-95c0-dc0467a72025 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:53.331158 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc0a8463-6ece-400f-95c0-dc0467a72025 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:53.483216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9f3aa7b3-9a9c-4df0-b5da-771e43364a6a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:53.493441 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9f3aa7b3-9a9c-4df0-b5da-771e43364a6a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892" status: 200 len: 1265 microversion: 2.1 time: 0.209600 Sep 07 12:33:53.494948 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 660/1327] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:53 2022] GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:53.500252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb2bab7f-3cac-4aa3-a6bf-ebae613b2de5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:53.500941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cb2bab7f-3cac-4aa3-a6bf-ebae613b2de5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:53.508233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb2bab7f-3cac-4aa3-a6bf-ebae613b2de5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:53.508893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb2bab7f-3cac-4aa3-a6bf-ebae613b2de5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:53.510410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb2bab7f-3cac-4aa3-a6bf-ebae613b2de5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:53.511216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb2bab7f-3cac-4aa3-a6bf-ebae613b2de5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:53.511821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb2bab7f-3cac-4aa3-a6bf-ebae613b2de5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:53.512531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb2bab7f-3cac-4aa3-a6bf-ebae613b2de5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:53.981913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cc0a8463-6ece-400f-95c0-dc0467a72025 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:53.998573 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cc0a8463-6ece-400f-95c0-dc0467a72025 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1476 microversion: 2.1 time: 0.724842 Sep 07 12:33:53.999210 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 668/1328] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:53 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1476 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:54.102132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cb2bab7f-3cac-4aa3-a6bf-ebae613b2de5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:54.118356 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cb2bab7f-3cac-4aa3-a6bf-ebae613b2de5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1716 microversion: 2.1 time: 0.621887 Sep 07 12:33:54.120415 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 661/1329] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:53 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1716 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:54.141618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ddd2578d-0d86-48c7-b490-edfdb26410c6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:54.144548 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ddd2578d-0d86-48c7-b490-edfdb26410c6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:54.162722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddd2578d-0d86-48c7-b490-edfdb26410c6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:54.163309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddd2578d-0d86-48c7-b490-edfdb26410c6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:54.163762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddd2578d-0d86-48c7-b490-edfdb26410c6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:54.164762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddd2578d-0d86-48c7-b490-edfdb26410c6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:54.171946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-94ba5222-abaa-4571-b225-94341ed0cec5 req-63d6f54f-376b-4c51-9105-efbc5286de1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3", "name": "network-vif-unplugged", "status": "completed", "tag": "93de5379-dbd9-4a2c-ae2f-9b0113b9607c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:54.179952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddd2578d-0d86-48c7-b490-edfdb26410c6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:54.181016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddd2578d-0d86-48c7-b490-edfdb26410c6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:54.204804 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-94ba5222-abaa-4571-b225-94341ed0cec5 req-63d6f54f-376b-4c51-9105-efbc5286de1e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:54.212869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-94ba5222-abaa-4571-b225-94341ed0cec5 req-63d6f54f-376b-4c51-9105-efbc5286de1e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:54.213883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-94ba5222-abaa-4571-b225-94341ed0cec5 req-63d6f54f-376b-4c51-9105-efbc5286de1e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:54.253224 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-94ba5222-abaa-4571-b225-94341ed0cec5 req-63d6f54f-376b-4c51-9105-efbc5286de1e service nova] Creating event network-vif-unplugged:93de5379-dbd9-4a2c-ae2f-9b0113b9607c for instance 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 on n-h1-852087-9 Sep 07 12:33:54.265985 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-94ba5222-abaa-4571-b225-94341ed0cec5 req-63d6f54f-376b-4c51-9105-efbc5286de1e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.264760 Sep 07 12:33:54.268004 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 669/1330] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:33:54.278760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1ef823d1-051c-4931-8bd2-6c67ed482598 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:54.280517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1ef823d1-051c-4931-8bd2-6c67ed482598 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:54.290626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ef823d1-051c-4931-8bd2-6c67ed482598 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:54.291131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ef823d1-051c-4931-8bd2-6c67ed482598 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:54.291581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ef823d1-051c-4931-8bd2-6c67ed482598 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:54.292328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ef823d1-051c-4931-8bd2-6c67ed482598 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:54.292810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ef823d1-051c-4931-8bd2-6c67ed482598 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:54.293231 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ef823d1-051c-4931-8bd2-6c67ed482598 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:54.521611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ddd2578d-0d86-48c7-b490-edfdb26410c6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:54.532989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ddd2578d-0d86-48c7-b490-edfdb26410c6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:54.535257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ddd2578d-0d86-48c7-b490-edfdb26410c6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:54.536671 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ddd2578d-0d86-48c7-b490-edfdb26410c6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1411 microversion: 2.25 time: 0.414131 Sep 07 12:33:54.537793 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 662/1331] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:54 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1411 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:54.547133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-77f070ea-1963-4774-a28e-5e4d246da7c1 req-4de3503f-77c9-402f-bfc8-a6d33c43f73b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8cd2a9-2d75-4dee-b17d-434f35f15ba4", "name": "network-vif-plugged", "status": "completed", "tag": "308f2d25-df8e-4168-b05c-f1c950dbcca9"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:54.569920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-77f070ea-1963-4774-a28e-5e4d246da7c1 req-4de3503f-77c9-402f-bfc8-a6d33c43f73b service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:54.571107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-77f070ea-1963-4774-a28e-5e4d246da7c1 req-4de3503f-77c9-402f-bfc8-a6d33c43f73b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:54.571724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-77f070ea-1963-4774-a28e-5e4d246da7c1 req-4de3503f-77c9-402f-bfc8-a6d33c43f73b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:54.573394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1ef823d1-051c-4931-8bd2-6c67ed482598 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:54.587822 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1ef823d1-051c-4931-8bd2-6c67ed482598 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.317604 Sep 07 12:33:54.588427 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 670/1332] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:54 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:54.592717 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-77f070ea-1963-4774-a28e-5e4d246da7c1 req-4de3503f-77c9-402f-bfc8-a6d33c43f73b service nova] Creating event network-vif-plugged:308f2d25-df8e-4168-b05c-f1c950dbcca9 for instance 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 on n-h1-852087-9 Sep 07 12:33:54.594925 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-edc5d293-ad3f-4259-98d2-85753e3f3d22 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:54.595550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-edc5d293-ad3f-4259-98d2-85753e3f3d22 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:54.602723 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-77f070ea-1963-4774-a28e-5e4d246da7c1 req-4de3503f-77c9-402f-bfc8-a6d33c43f73b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063227 Sep 07 12:33:54.603986 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 663/1333] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:33:54.607580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edc5d293-ad3f-4259-98d2-85753e3f3d22 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:54.608534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edc5d293-ad3f-4259-98d2-85753e3f3d22 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:54.609353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edc5d293-ad3f-4259-98d2-85753e3f3d22 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:54.610799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f26f5442-fd4d-4ab9-92ee-84034fc7b3dc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:54.611154 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edc5d293-ad3f-4259-98d2-85753e3f3d22 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:54.611683 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f26f5442-fd4d-4ab9-92ee-84034fc7b3dc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:54.612006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edc5d293-ad3f-4259-98d2-85753e3f3d22 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:54.613364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edc5d293-ad3f-4259-98d2-85753e3f3d22 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:54.619019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f26f5442-fd4d-4ab9-92ee-84034fc7b3dc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:54.619556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f26f5442-fd4d-4ab9-92ee-84034fc7b3dc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:54.620165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f26f5442-fd4d-4ab9-92ee-84034fc7b3dc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:54.620887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f26f5442-fd4d-4ab9-92ee-84034fc7b3dc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:54.621347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f26f5442-fd4d-4ab9-92ee-84034fc7b3dc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:54.622075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f26f5442-fd4d-4ab9-92ee-84034fc7b3dc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:54.711769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f26f5442-fd4d-4ab9-92ee-84034fc7b3dc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:54.722989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f26f5442-fd4d-4ab9-92ee-84034fc7b3dc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:54.725352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f26f5442-fd4d-4ab9-92ee-84034fc7b3dc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:54.731230 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f26f5442-fd4d-4ab9-92ee-84034fc7b3dc tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1535 microversion: 2.91 time: 0.125766 Sep 07 12:33:54.732637 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 664/1334] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:54 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1535 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:54.737776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf7b1e03-c326-4c17-b0f7-0ac092b2fe22 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:54.738492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cf7b1e03-c326-4c17-b0f7-0ac092b2fe22 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2f6ee92e-b663-4984-9198-d2ca0f8b3892] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:54.748765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf7b1e03-c326-4c17-b0f7-0ac092b2fe22 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:54.754435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf7b1e03-c326-4c17-b0f7-0ac092b2fe22 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:54.762482 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf7b1e03-c326-4c17-b0f7-0ac092b2fe22 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:54.763825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf7b1e03-c326-4c17-b0f7-0ac092b2fe22 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:54.764331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf7b1e03-c326-4c17-b0f7-0ac092b2fe22 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:54.764817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf7b1e03-c326-4c17-b0f7-0ac092b2fe22 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:54.785563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:33:55.505953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-edc5d293-ad3f-4259-98d2-85753e3f3d22 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:55.521347 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-edc5d293-ad3f-4259-98d2-85753e3f3d22 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4" status: 200 len: 1318 microversion: 2.1 time: 0.929960 Sep 07 12:33:55.523304 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 671/1335] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:54 2022] GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 => generated 1318 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:55.533056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e42c2761-8a95-4dca-afb0-b8a5a2e9ce2f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:55.534369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e42c2761-8a95-4dca-afb0-b8a5a2e9ce2f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:55.543925 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e42c2761-8a95-4dca-afb0-b8a5a2e9ce2f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:55.544435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e42c2761-8a95-4dca-afb0-b8a5a2e9ce2f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:55.544882 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e42c2761-8a95-4dca-afb0-b8a5a2e9ce2f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:55.546049 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e42c2761-8a95-4dca-afb0-b8a5a2e9ce2f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:55.546728 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e42c2761-8a95-4dca-afb0-b8a5a2e9ce2f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:55.547367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e42c2761-8a95-4dca-afb0-b8a5a2e9ce2f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:55.558340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cf7b1e03-c326-4c17-b0f7-0ac092b2fe22 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:55.585595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:33:55.592768 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cf7b1e03-c326-4c17-b0f7-0ac092b2fe22 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892" status: 200 len: 1307 microversion: 2.1 time: 0.858338 Sep 07 12:33:55.594735 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 665/1336] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:54 2022] GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892 => generated 1307 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:55.603706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2d133716-e586-4105-8537-f62e592c1687 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:55.613339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:33:55.619038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2d133716-e586-4105-8537-f62e592c1687 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:55.634196 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d133716-e586-4105-8537-f62e592c1687 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:55.635027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d133716-e586-4105-8537-f62e592c1687 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:55.635767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d133716-e586-4105-8537-f62e592c1687 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:55.637367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d133716-e586-4105-8537-f62e592c1687 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:55.638507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d133716-e586-4105-8537-f62e592c1687 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:55.639910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d133716-e586-4105-8537-f62e592c1687 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:55.972825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e42c2761-8a95-4dca-afb0-b8a5a2e9ce2f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:55.981642 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e42c2761-8a95-4dca-afb0-b8a5a2e9ce2f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1476 microversion: 2.1 time: 0.456725 Sep 07 12:33:55.982505 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 672/1337] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:55 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1476 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:55.986145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2d133716-e586-4105-8537-f62e592c1687 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:55.989540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e0e94d23-a0ae-4048-8979-059207c6cdcf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:55.990176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e0e94d23-a0ae-4048-8979-059207c6cdcf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:56.003922 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2d133716-e586-4105-8537-f62e592c1687 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1716 microversion: 2.1 time: 0.406939 Sep 07 12:33:56.005430 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 666/1338] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:55 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1716 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:56.013604 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-23d7ec35-8025-4a44-8a40-1f9944ce7b6b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:56.014745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-23d7ec35-8025-4a44-8a40-1f9944ce7b6b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:56.021143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23d7ec35-8025-4a44-8a40-1f9944ce7b6b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:56.021855 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23d7ec35-8025-4a44-8a40-1f9944ce7b6b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:56.023030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23d7ec35-8025-4a44-8a40-1f9944ce7b6b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:56.023186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23d7ec35-8025-4a44-8a40-1f9944ce7b6b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:56.024434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23d7ec35-8025-4a44-8a40-1f9944ce7b6b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:56.024434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23d7ec35-8025-4a44-8a40-1f9944ce7b6b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:56.028867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0e94d23-a0ae-4048-8979-059207c6cdcf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:56.030542 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0e94d23-a0ae-4048-8979-059207c6cdcf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:56.031016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0e94d23-a0ae-4048-8979-059207c6cdcf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:56.031778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0e94d23-a0ae-4048-8979-059207c6cdcf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:56.032255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0e94d23-a0ae-4048-8979-059207c6cdcf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:56.032698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0e94d23-a0ae-4048-8979-059207c6cdcf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:56.383970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-23d7ec35-8025-4a44-8a40-1f9944ce7b6b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:56.397473 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-23d7ec35-8025-4a44-8a40-1f9944ce7b6b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.389669 Sep 07 12:33:56.405866 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 667/1339] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:56 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:56.419131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e0e94d23-a0ae-4048-8979-059207c6cdcf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:56.421658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-364e0a7a-374d-4f89-aa69-8e76c3576088 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:56.422546 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-364e0a7a-374d-4f89-aa69-8e76c3576088 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:56.429324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-364e0a7a-374d-4f89-aa69-8e76c3576088 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:56.429871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-364e0a7a-374d-4f89-aa69-8e76c3576088 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:56.430538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-364e0a7a-374d-4f89-aa69-8e76c3576088 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:56.431481 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-364e0a7a-374d-4f89-aa69-8e76c3576088 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:56.432107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-364e0a7a-374d-4f89-aa69-8e76c3576088 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:56.432705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-364e0a7a-374d-4f89-aa69-8e76c3576088 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:56.436083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e0e94d23-a0ae-4048-8979-059207c6cdcf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:56.439269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e0e94d23-a0ae-4048-8979-059207c6cdcf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:56.440856 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e0e94d23-a0ae-4048-8979-059207c6cdcf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1411 microversion: 2.25 time: 0.457019 Sep 07 12:33:56.441805 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 673/1340] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:55 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1411 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:56.447157 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-5e2be14a-90bf-417a-b8bd-9c3cc0be91e2 req-4c5d95bd-170f-484b-a0e4-9cbbcb3e1668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3", "tag": "93de5379-dbd9-4a2c-ae2f-9b0113b9607c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:56.462369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5e2be14a-90bf-417a-b8bd-9c3cc0be91e2 req-4c5d95bd-170f-484b-a0e4-9cbbcb3e1668 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:56.462898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5e2be14a-90bf-417a-b8bd-9c3cc0be91e2 req-4c5d95bd-170f-484b-a0e4-9cbbcb3e1668 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:56.463331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5e2be14a-90bf-417a-b8bd-9c3cc0be91e2 req-4c5d95bd-170f-484b-a0e4-9cbbcb3e1668 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:56.477936 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-5e2be14a-90bf-417a-b8bd-9c3cc0be91e2 req-4c5d95bd-170f-484b-a0e4-9cbbcb3e1668 service nova] Creating event network-changed:93de5379-dbd9-4a2c-ae2f-9b0113b9607c for instance 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 on n-h1-852087-9 Sep 07 12:33:56.483576 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-5e2be14a-90bf-417a-b8bd-9c3cc0be91e2 req-4c5d95bd-170f-484b-a0e4-9cbbcb3e1668 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040064 Sep 07 12:33:56.484195 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 674/1341] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:33:56.533616 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-364e0a7a-374d-4f89-aa69-8e76c3576088 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:56.552945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-364e0a7a-374d-4f89-aa69-8e76c3576088 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:56.555302 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cdcb3f5f-1ab0-4c0e-90d8-75e0664d5e8d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:56.556593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cdcb3f5f-1ab0-4c0e-90d8-75e0664d5e8d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:56.557752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-364e0a7a-374d-4f89-aa69-8e76c3576088 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:56.568754 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-364e0a7a-374d-4f89-aa69-8e76c3576088 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1535 microversion: 2.91 time: 0.160925 Sep 07 12:33:56.570172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdcb3f5f-1ab0-4c0e-90d8-75e0664d5e8d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:56.571296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdcb3f5f-1ab0-4c0e-90d8-75e0664d5e8d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:56.571791 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 668/1342] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:56 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1535 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:56.578398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdcb3f5f-1ab0-4c0e-90d8-75e0664d5e8d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:56.579442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdcb3f5f-1ab0-4c0e-90d8-75e0664d5e8d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:56.580048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdcb3f5f-1ab0-4c0e-90d8-75e0664d5e8d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:56.580596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdcb3f5f-1ab0-4c0e-90d8-75e0664d5e8d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:56.621923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c63930c5-bf60-40f4-864a-556c52ee3d8e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:56.623009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c63930c5-bf60-40f4-864a-556c52ee3d8e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2f6ee92e-b663-4984-9198-d2ca0f8b3892] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:56.634010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c63930c5-bf60-40f4-864a-556c52ee3d8e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:56.634896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c63930c5-bf60-40f4-864a-556c52ee3d8e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:56.635668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c63930c5-bf60-40f4-864a-556c52ee3d8e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:56.636961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c63930c5-bf60-40f4-864a-556c52ee3d8e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:56.637847 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c63930c5-bf60-40f4-864a-556c52ee3d8e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:56.638612 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c63930c5-bf60-40f4-864a-556c52ee3d8e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:56.964088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cdcb3f5f-1ab0-4c0e-90d8-75e0664d5e8d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:56.975416 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cdcb3f5f-1ab0-4c0e-90d8-75e0664d5e8d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4" status: 200 len: 1318 microversion: 2.1 time: 0.430322 Sep 07 12:33:56.976048 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 675/1343] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:56 2022] GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:57.079891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-53bfb21e-fabe-4b1b-8759-b2de1b84d7d7 req-1453d45c-b5c5-47ba-91cf-94be97fa7504 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f6ee92e-b663-4984-9198-d2ca0f8b3892", "tag": "07e0fa79-d940-418d-b2f3-f85b6ee4dffd"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:57.098748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-53bfb21e-fabe-4b1b-8759-b2de1b84d7d7 req-1453d45c-b5c5-47ba-91cf-94be97fa7504 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:57.099633 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-53bfb21e-fabe-4b1b-8759-b2de1b84d7d7 req-1453d45c-b5c5-47ba-91cf-94be97fa7504 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:57.100469 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-53bfb21e-fabe-4b1b-8759-b2de1b84d7d7 req-1453d45c-b5c5-47ba-91cf-94be97fa7504 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:57.118451 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-53bfb21e-fabe-4b1b-8759-b2de1b84d7d7 req-1453d45c-b5c5-47ba-91cf-94be97fa7504 service nova] Creating event network-changed:07e0fa79-d940-418d-b2f3-f85b6ee4dffd for instance 2f6ee92e-b663-4984-9198-d2ca0f8b3892 on n-h2-852087-9 Sep 07 12:33:57.125761 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-53bfb21e-fabe-4b1b-8759-b2de1b84d7d7 req-1453d45c-b5c5-47ba-91cf-94be97fa7504 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131135 Sep 07 12:33:57.126818 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 676/1344] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:33:57.133144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bbd79b12-7fa5-4b1e-be0d-3617f889d0ba tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:57.134151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bbd79b12-7fa5-4b1e-be0d-3617f889d0ba tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:57.142486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd79b12-7fa5-4b1e-be0d-3617f889d0ba tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:57.143163 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd79b12-7fa5-4b1e-be0d-3617f889d0ba tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:57.144285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd79b12-7fa5-4b1e-be0d-3617f889d0ba tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:57.144433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd79b12-7fa5-4b1e-be0d-3617f889d0ba tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:57.144841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd79b12-7fa5-4b1e-be0d-3617f889d0ba tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:57.145326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd79b12-7fa5-4b1e-be0d-3617f889d0ba tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:57.163267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:33:57.191353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c63930c5-bf60-40f4-864a-556c52ee3d8e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:57.204004 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c63930c5-bf60-40f4-864a-556c52ee3d8e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892" status: 200 len: 1307 microversion: 2.1 time: 0.589149 Sep 07 12:33:57.205597 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 669/1345] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:56 2022] GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892 => generated 1307 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:57.211828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ca99747-d680-453e-8143-833a52689678 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:57.212842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3ca99747-d680-453e-8143-833a52689678 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:57.219588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ca99747-d680-453e-8143-833a52689678 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:57.220324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ca99747-d680-453e-8143-833a52689678 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:57.220948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ca99747-d680-453e-8143-833a52689678 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:57.221689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ca99747-d680-453e-8143-833a52689678 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:57.222210 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ca99747-d680-453e-8143-833a52689678 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:57.222572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ca99747-d680-453e-8143-833a52689678 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:57.497383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bbd79b12-7fa5-4b1e-be0d-3617f889d0ba tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:57.511806 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bbd79b12-7fa5-4b1e-be0d-3617f889d0ba tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1476 microversion: 2.1 time: 0.383435 Sep 07 12:33:57.526069 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 677/1346] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:57 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1476 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:57.526069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d70732fc-d167-4a5d-883d-8d34b27d0918 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:57.526069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d70732fc-d167-4a5d-883d-8d34b27d0918 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:57.536911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d70732fc-d167-4a5d-883d-8d34b27d0918 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:57.537931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d70732fc-d167-4a5d-883d-8d34b27d0918 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:57.539036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d70732fc-d167-4a5d-883d-8d34b27d0918 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:57.540631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d70732fc-d167-4a5d-883d-8d34b27d0918 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:57.542047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d70732fc-d167-4a5d-883d-8d34b27d0918 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:57.542711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d70732fc-d167-4a5d-883d-8d34b27d0918 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:57.558263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3ca99747-d680-453e-8143-833a52689678 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:57.570994 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ca99747-d680-453e-8143-833a52689678 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1716 microversion: 2.1 time: 0.363642 Sep 07 12:33:57.578904 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 670/1347] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:57 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1716 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:57.589521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2fecd115-0115-4b7e-b14c-2c232487644d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:57.591471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2fecd115-0115-4b7e-b14c-2c232487644d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:57.603234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fecd115-0115-4b7e-b14c-2c232487644d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:57.604186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fecd115-0115-4b7e-b14c-2c232487644d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:57.605027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fecd115-0115-4b7e-b14c-2c232487644d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:57.606568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fecd115-0115-4b7e-b14c-2c232487644d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:57.607461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fecd115-0115-4b7e-b14c-2c232487644d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:57.608250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fecd115-0115-4b7e-b14c-2c232487644d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:57.851273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d70732fc-d167-4a5d-883d-8d34b27d0918 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:57.861903 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d70732fc-d167-4a5d-883d-8d34b27d0918 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.347597 Sep 07 12:33:57.863567 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 678/1348] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:57 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:57.869018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-37b3e44e-aa30-4471-890f-91b488e80e93 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:57.870060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-37b3e44e-aa30-4471-890f-91b488e80e93 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:57.877577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37b3e44e-aa30-4471-890f-91b488e80e93 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:57.878203 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37b3e44e-aa30-4471-890f-91b488e80e93 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:57.878724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37b3e44e-aa30-4471-890f-91b488e80e93 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:57.879527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37b3e44e-aa30-4471-890f-91b488e80e93 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:57.880061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37b3e44e-aa30-4471-890f-91b488e80e93 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:57.880587 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37b3e44e-aa30-4471-890f-91b488e80e93 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:57.939249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2fecd115-0115-4b7e-b14c-2c232487644d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:57.951360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2fecd115-0115-4b7e-b14c-2c232487644d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:57.953144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2fecd115-0115-4b7e-b14c-2c232487644d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:57.954568 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2fecd115-0115-4b7e-b14c-2c232487644d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1411 microversion: 2.25 time: 0.372947 Sep 07 12:33:57.955162 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 671/1349] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:57 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1411 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:57.982413 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37b3e44e-aa30-4471-890f-91b488e80e93 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:57.993005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37b3e44e-aa30-4471-890f-91b488e80e93 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:57.994525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37b3e44e-aa30-4471-890f-91b488e80e93 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:58.000799 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-37b3e44e-aa30-4471-890f-91b488e80e93 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1535 microversion: 2.91 time: 0.135625 Sep 07 12:33:58.001417 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 679/1350] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:57 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1535 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:58.006408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e28fc4ec-d048-4e1a-8214-83acaa7f91f0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:58.007193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e28fc4ec-d048-4e1a-8214-83acaa7f91f0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:58.014177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e28fc4ec-d048-4e1a-8214-83acaa7f91f0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:58.014829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e28fc4ec-d048-4e1a-8214-83acaa7f91f0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:58.015374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e28fc4ec-d048-4e1a-8214-83acaa7f91f0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:58.016198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e28fc4ec-d048-4e1a-8214-83acaa7f91f0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:58.016793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e28fc4ec-d048-4e1a-8214-83acaa7f91f0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:58.017334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e28fc4ec-d048-4e1a-8214-83acaa7f91f0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:58.205397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e28fc4ec-d048-4e1a-8214-83acaa7f91f0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:58.213906 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e28fc4ec-d048-4e1a-8214-83acaa7f91f0 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4" status: 200 len: 1507 microversion: 2.1 time: 0.212687 Sep 07 12:33:58.214497 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 672/1351] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:57 2022] GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 => generated 1507 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:58.246308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fa1a11d2-03cc-4883-83ea-bdb4bf1588c5 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:58.247540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fa1a11d2-03cc-4883-83ea-bdb4bf1588c5 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2f6ee92e-b663-4984-9198-d2ca0f8b3892] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:58.258996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa1a11d2-03cc-4883-83ea-bdb4bf1588c5 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:58.259528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa1a11d2-03cc-4883-83ea-bdb4bf1588c5 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:58.260237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa1a11d2-03cc-4883-83ea-bdb4bf1588c5 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:58.261412 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa1a11d2-03cc-4883-83ea-bdb4bf1588c5 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:58.262271 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa1a11d2-03cc-4883-83ea-bdb4bf1588c5 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:58.262980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa1a11d2-03cc-4883-83ea-bdb4bf1588c5 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:58.471210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fa1a11d2-03cc-4883-83ea-bdb4bf1588c5 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:58.488066 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fa1a11d2-03cc-4883-83ea-bdb4bf1588c5 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892" status: 200 len: 1307 microversion: 2.1 time: 0.248367 Sep 07 12:33:58.489280 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 680/1352] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:58 2022] GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892 => generated 1307 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:33:58.557881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0765ab1e-474f-477c-b25f-dc86984bd663 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:58.559256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0765ab1e-474f-477c-b25f-dc86984bd663 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:58.575890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0765ab1e-474f-477c-b25f-dc86984bd663 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:58.576933 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0765ab1e-474f-477c-b25f-dc86984bd663 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:58.576933 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0765ab1e-474f-477c-b25f-dc86984bd663 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:58.577627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0765ab1e-474f-477c-b25f-dc86984bd663 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:58.578092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0765ab1e-474f-477c-b25f-dc86984bd663 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:58.578523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0765ab1e-474f-477c-b25f-dc86984bd663 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:58.597617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e80252a3-6a8a-4c06-89dd-fb48f54ba34b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:58.598869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e80252a3-6a8a-4c06-89dd-fb48f54ba34b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:58.606945 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e80252a3-6a8a-4c06-89dd-fb48f54ba34b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:58.607939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e80252a3-6a8a-4c06-89dd-fb48f54ba34b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:58.608810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e80252a3-6a8a-4c06-89dd-fb48f54ba34b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:58.610251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e80252a3-6a8a-4c06-89dd-fb48f54ba34b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:58.611396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e80252a3-6a8a-4c06-89dd-fb48f54ba34b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:58.612336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e80252a3-6a8a-4c06-89dd-fb48f54ba34b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:58.826729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0765ab1e-474f-477c-b25f-dc86984bd663 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:58.841839 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0765ab1e-474f-477c-b25f-dc86984bd663 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1476 microversion: 2.1 time: 0.292635 Sep 07 12:33:58.842770 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 673/1353] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:58 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1476 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:58.859355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e80252a3-6a8a-4c06-89dd-fb48f54ba34b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:58.870025 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e80252a3-6a8a-4c06-89dd-fb48f54ba34b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1716 microversion: 2.1 time: 0.276340 Sep 07 12:33:58.874385 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 681/1354] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:58 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1716 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:33:58.902842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bb7b4555-224e-416d-bd15-a7f812853267 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:58.903335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bb7b4555-224e-416d-bd15-a7f812853267 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:58.910047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb7b4555-224e-416d-bd15-a7f812853267 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:58.910548 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb7b4555-224e-416d-bd15-a7f812853267 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:58.910996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb7b4555-224e-416d-bd15-a7f812853267 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:58.911732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb7b4555-224e-416d-bd15-a7f812853267 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:58.912195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb7b4555-224e-416d-bd15-a7f812853267 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:58.912628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb7b4555-224e-416d-bd15-a7f812853267 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:58.995574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bc73c247-c2e8-4406-a057-ca8ecf61ffaa tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:59.001638 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bc73c247-c2e8-4406-a057-ca8ecf61ffaa tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:59.025132 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc73c247-c2e8-4406-a057-ca8ecf61ffaa tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:59.027236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc73c247-c2e8-4406-a057-ca8ecf61ffaa tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:59.028749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc73c247-c2e8-4406-a057-ca8ecf61ffaa tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:59.031525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc73c247-c2e8-4406-a057-ca8ecf61ffaa tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:59.032851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc73c247-c2e8-4406-a057-ca8ecf61ffaa tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:59.033589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc73c247-c2e8-4406-a057-ca8ecf61ffaa tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:59.161519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bb7b4555-224e-416d-bd15-a7f812853267 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:59.177292 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bb7b4555-224e-416d-bd15-a7f812853267 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.279582 Sep 07 12:33:59.189611 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 674/1355] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:58 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:33:59.189611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-397a8ff1-e9b8-4643-8e58-22fb681e34d6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:59.189611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-397a8ff1-e9b8-4643-8e58-22fb681e34d6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:59.200629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-397a8ff1-e9b8-4643-8e58-22fb681e34d6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:59.201279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-397a8ff1-e9b8-4643-8e58-22fb681e34d6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:59.202103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-397a8ff1-e9b8-4643-8e58-22fb681e34d6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:59.203478 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-397a8ff1-e9b8-4643-8e58-22fb681e34d6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:59.204436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-397a8ff1-e9b8-4643-8e58-22fb681e34d6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:59.205224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-397a8ff1-e9b8-4643-8e58-22fb681e34d6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:59.287624 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bc73c247-c2e8-4406-a057-ca8ecf61ffaa tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:59.305418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bc73c247-c2e8-4406-a057-ca8ecf61ffaa tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:59.305744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-397a8ff1-e9b8-4643-8e58-22fb681e34d6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:59.308630 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bc73c247-c2e8-4406-a057-ca8ecf61ffaa tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:59.311043 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bc73c247-c2e8-4406-a057-ca8ecf61ffaa tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1411 microversion: 2.25 time: 0.322987 Sep 07 12:33:59.312079 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 682/1356] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:58 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1411 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:33:59.325217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-397a8ff1-e9b8-4643-8e58-22fb681e34d6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:59.329208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-397a8ff1-e9b8-4643-8e58-22fb681e34d6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:59.340362 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-397a8ff1-e9b8-4643-8e58-22fb681e34d6 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1535 microversion: 2.91 time: 0.159332 Sep 07 12:33:59.350203 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 675/1357] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:33:59 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1535 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:33:59.517843 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d7e07131-2820-4aad-a6fb-5fef8b608360 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:59.519197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d7e07131-2820-4aad-a6fb-5fef8b608360 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2f6ee92e-b663-4984-9198-d2ca0f8b3892] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:59.530576 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7e07131-2820-4aad-a6fb-5fef8b608360 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:59.531292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7e07131-2820-4aad-a6fb-5fef8b608360 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:59.531906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7e07131-2820-4aad-a6fb-5fef8b608360 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:59.532753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7e07131-2820-4aad-a6fb-5fef8b608360 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:59.533277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7e07131-2820-4aad-a6fb-5fef8b608360 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:59.533814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7e07131-2820-4aad-a6fb-5fef8b608360 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:59.657805 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5ed77368-6afb-488e-ad2d-65744d814e15 tempest-VolumesAdminNegativeTest-836581950 tempest-VolumesAdminNegativeTest-836581950-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "44484751-d66e-4a12-a058-c41c75627228"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:33:59.663577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5ed77368-6afb-488e-ad2d-65744d814e15 tempest-VolumesAdminNegativeTest-836581950 tempest-VolumesAdminNegativeTest-836581950-project-admin] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:59.676391 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ed77368-6afb-488e-ad2d-65744d814e15 tempest-VolumesAdminNegativeTest-836581950 tempest-VolumesAdminNegativeTest-836581950-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:59.677254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ed77368-6afb-488e-ad2d-65744d814e15 tempest-VolumesAdminNegativeTest-836581950 tempest-VolumesAdminNegativeTest-836581950-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:59.678080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ed77368-6afb-488e-ad2d-65744d814e15 tempest-VolumesAdminNegativeTest-836581950 tempest-VolumesAdminNegativeTest-836581950-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:59.679331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ed77368-6afb-488e-ad2d-65744d814e15 tempest-VolumesAdminNegativeTest-836581950 tempest-VolumesAdminNegativeTest-836581950-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:59.680167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ed77368-6afb-488e-ad2d-65744d814e15 tempest-VolumesAdminNegativeTest-836581950 tempest-VolumesAdminNegativeTest-836581950-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:59.680938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ed77368-6afb-488e-ad2d-65744d814e15 tempest-VolumesAdminNegativeTest-836581950 tempest-VolumesAdminNegativeTest-836581950-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:59.773271 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-5ed77368-6afb-488e-ad2d-65744d814e15 tempest-VolumesAdminNegativeTest-836581950 tempest-VolumesAdminNegativeTest-836581950-project-admin] HTTP exception thrown: Volume b45df03f-af14-46d9-b707-c1ffcac3f394 could not be found. Sep 07 12:33:59.779993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5ed77368-6afb-488e-ad2d-65744d814e15 tempest-VolumesAdminNegativeTest-836581950 tempest-VolumesAdminNegativeTest-836581950-project-admin] Request method failure captured: Sep 07 12:33:59.779993 n-d-852087-9 devstack@n-api.service[122433]: request: PUT /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4/os-volume_attachments/b45df03f-af14-46d9-b707-c1ffcac3f394 HTTP/1.1 Sep 07 12:33:59.779993 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:33:59.779993 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:33:59.779993 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:33:59.779993 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 74 Sep 07 12:33:59.779993 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:33:59.779993 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:33:59.779993 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:33:59.779993 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:33:59.779993 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI7vsNA2B4j3Jgtww0yYV2-SNyVTEm9WFWr9ZSj3tAgxES5DoZ1FeV039YIMwaXfYyhl_mhF6HicF9CLiopmx7ctE0gyZrvv4GgkfCMMI2UwkJW4l3HePsj3KrmfufexApUX8LBRqnCcDabFBvDqOX0WYprfQ8HviIHLyAeKLs4S4PI Sep 07 12:33:59.779993 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:33:59.779993 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:33:59.779993 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:33:59.779993 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:33:59.779993 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:33:59.779993 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:33:59.779993 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 88fb85e95388477eba2678bb14aa8f19 Sep 07 12:33:59.779993 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-VolumesAdminNegativeTest-836581950 Sep 07 12:33:59.779993 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 12:33:59.779993 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 12:33:59.783232 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/88fb85e95388477eba2678bb14aa8f19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_88fb85e95388477eba2678bb14aa8f19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/88fb85e95388477eba2678bb14aa8f19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/88fb85e95388477eba2678bb14aa8f19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:33:59.783232 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-VolumesAdminNegativeTest-836581950 Sep 07 12:33:59.783232 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 88fb85e95388477eba2678bb14aa8f19 Sep 07 12:33:59.783232 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-836581950 Sep 07 12:33:59.783232 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-VolumesAdminNegativeTest-836581950-project-admin Sep 07 12:33:59.783232 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:33:59.783232 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:33:59.783232 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 7e4a29379b2f4f088e715c982351d971 Sep 07 12:33:59.783232 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-VolumesAdminNegativeTest-836581950-project-admin Sep 07 12:33:59.783232 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:33:59.783232 n-d-852087-9 devstack@n-api.service[122433]: {"volumeAttachment": {"volumeId": "44484751-d66e-4a12-a058-c41c75627228"}} Sep 07 12:33:59.783232 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:33:59.783232 n-d-852087-9 devstack@n-api.service[122433]: exception: Volume b45df03f-af14-46d9-b707-c1ffcac3f394 could not be found. Sep 07 12:33:59.784892 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'server_id': '6f8cd2a9-2d75-4dee-b17d-434f35f15ba4', 'id': 'b45df03f-af14-46d9-b707-c1ffcac3f394', 'body': {'volumeAttachment': {'volumeId': '44484751-d66e-4a12-a058-c41c75627228'}}} Sep 07 12:33:59.784892 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:33:59.784892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:33:59.784892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 12:33:59.784892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 12:33:59.784892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 12:33:59.784892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 12:33:59.784892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 12:33:59.784892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 12:33:59.784892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 12:33:59.784892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 12:33:59.784892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 12:33:59.784892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 12:33:59.784892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 12:33:59.784892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 12:33:59.784892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 12:33:59.784892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 12:33:59.793804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b45df03f-af14-46d9-b707-c1ffcac3f394 could not be found. (HTTP 404) (Request-ID: req-cde83060-6eb7-42fa-98cc-1dabd0630ce2) Sep 07 12:33:59.793804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:33:59.793804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:33:59.793804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:33:59.793804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:33:59.793804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Sep 07 12:33:59.793804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Sep 07 12:33:59.793804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 12:33:59.793804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 12:33:59.793804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 12:33:59.793804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 12:33:59.793804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 12:33:59.793804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 12:33:59.793804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 12:33:59.793804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 12:33:59.793804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 12:33:59.793804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 12:33:59.793804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 12:33:59.793804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 12:33:59.796671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 12:33:59.796671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 12:33:59.796671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 12:33:59.796671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 12:33:59.796671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 12:33:59.796671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 12:33:59.796671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 12:33:59.796671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 12:33:59.796671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b45df03f-af14-46d9-b707-c1ffcac3f394 could not be found. Sep 07 12:33:59.796671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:33:59.796671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:33:59.796671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:33:59.796671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:33:59.796671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:33:59.796671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:33:59.796671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:33:59.796671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:33:59.796671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:33:59.796671 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:33:59.800510 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:33:59.800510 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:33:59.800510 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:33:59.800510 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:33:59.800510 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 07 12:33:59.800510 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 07 12:33:59.800510 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Sep 07 12:33:59.800510 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:33:59.800510 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b45df03f-af14-46d9-b707-c1ffcac3f394 could not be found. Sep 07 12:33:59.800510 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:33:59.800510 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:33:59.800510 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:33:59.800510 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:33:59.800510 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:33:59.800510 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:33:59.800510 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:33:59.800510 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:33:59.800510 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b45df03f-af14-46d9-b707-c1ffcac3f394 could not be found. Sep 07 12:33:59.800510 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:33:59.802626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5ed77368-6afb-488e-ad2d-65744d814e15 tempest-VolumesAdminNegativeTest-836581950 tempest-VolumesAdminNegativeTest-836581950-project-admin] Returning 404 to user: Volume b45df03f-af14-46d9-b707-c1ffcac3f394 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:33:59.802626 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5ed77368-6afb-488e-ad2d-65744d814e15 tempest-VolumesAdminNegativeTest-836581950 tempest-VolumesAdminNegativeTest-836581950-project-admin] 10.222.0.16 "PUT /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4/os-volume_attachments/b45df03f-af14-46d9-b707-c1ffcac3f394" status: 404 len: 109 microversion: 2.1 time: 0.132904 Sep 07 12:33:59.802626 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 676/1358] 10.222.0.16 () {60 vars in 1433 bytes} [Wed Sep 7 12:33:59 2022] PUT /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4/os-volume_attachments/b45df03f-af14-46d9-b707-c1ffcac3f394 => generated 109 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:33:59.807841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d7e07131-2820-4aad-a6fb-5fef8b608360 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:33:59.825422 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d7e07131-2820-4aad-a6fb-5fef8b608360 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892" status: 200 len: 1307 microversion: 2.1 time: 0.314198 Sep 07 12:33:59.826948 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 683/1359] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:59 2022] GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892 => generated 1307 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:33:59.898303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2eaebf2d-2307-4519-ac4b-e8f5a2ba60f2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:59.900352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2eaebf2d-2307-4519-ac4b-e8f5a2ba60f2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:59.901469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8f4c2eca-56d7-4477-a5e2-44740283d971 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:33:59.903941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8f4c2eca-56d7-4477-a5e2-44740283d971 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:33:59.922532 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f4c2eca-56d7-4477-a5e2-44740283d971 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:59.923448 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f4c2eca-56d7-4477-a5e2-44740283d971 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:59.924286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f4c2eca-56d7-4477-a5e2-44740283d971 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:59.925632 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f4c2eca-56d7-4477-a5e2-44740283d971 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:59.926505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f4c2eca-56d7-4477-a5e2-44740283d971 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:59.927343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f4c2eca-56d7-4477-a5e2-44740283d971 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:59.940862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2eaebf2d-2307-4519-ac4b-e8f5a2ba60f2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:59.941404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2eaebf2d-2307-4519-ac4b-e8f5a2ba60f2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:59.941974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2eaebf2d-2307-4519-ac4b-e8f5a2ba60f2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:33:59.942816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2eaebf2d-2307-4519-ac4b-e8f5a2ba60f2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:33:59.943299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2eaebf2d-2307-4519-ac4b-e8f5a2ba60f2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:33:59.943744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2eaebf2d-2307-4519-ac4b-e8f5a2ba60f2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:00.251187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8f4c2eca-56d7-4477-a5e2-44740283d971 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:00.272299 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8f4c2eca-56d7-4477-a5e2-44740283d971 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1476 microversion: 2.1 time: 0.392546 Sep 07 12:34:00.275985 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 677/1360] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:59 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1476 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:00.278707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2eaebf2d-2307-4519-ac4b-e8f5a2ba60f2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:00.281526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f54ee980-cc7a-47cf-acf4-b7d0935128e2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:00.282408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f54ee980-cc7a-47cf-acf4-b7d0935128e2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:00.298761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f54ee980-cc7a-47cf-acf4-b7d0935128e2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:00.298761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f54ee980-cc7a-47cf-acf4-b7d0935128e2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:00.298761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f54ee980-cc7a-47cf-acf4-b7d0935128e2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:00.298761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f54ee980-cc7a-47cf-acf4-b7d0935128e2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:00.299394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f54ee980-cc7a-47cf-acf4-b7d0935128e2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:00.299394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f54ee980-cc7a-47cf-acf4-b7d0935128e2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:00.309179 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2eaebf2d-2307-4519-ac4b-e8f5a2ba60f2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1716 microversion: 2.1 time: 0.410453 Sep 07 12:34:00.319735 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 684/1361] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:33:59 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1716 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:00.365414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-35584376-a2c0-4e9f-879c-83dd460c5528 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:00.366559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-35584376-a2c0-4e9f-879c-83dd460c5528 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:00.380615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35584376-a2c0-4e9f-879c-83dd460c5528 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:00.381508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35584376-a2c0-4e9f-879c-83dd460c5528 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:00.382293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35584376-a2c0-4e9f-879c-83dd460c5528 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:00.383739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35584376-a2c0-4e9f-879c-83dd460c5528 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:00.384623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35584376-a2c0-4e9f-879c-83dd460c5528 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:00.385629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-35584376-a2c0-4e9f-879c-83dd460c5528 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:00.518926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f54ee980-cc7a-47cf-acf4-b7d0935128e2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:00.535595 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f54ee980-cc7a-47cf-acf4-b7d0935128e2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.257854 Sep 07 12:34:00.541550 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 678/1362] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:00 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:00.551099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-92a134db-bbf9-4831-8b9f-a375b2a67f44 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:00.552296 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-92a134db-bbf9-4831-8b9f-a375b2a67f44 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:00.566574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92a134db-bbf9-4831-8b9f-a375b2a67f44 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:00.567612 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92a134db-bbf9-4831-8b9f-a375b2a67f44 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:00.568505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92a134db-bbf9-4831-8b9f-a375b2a67f44 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:00.570094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92a134db-bbf9-4831-8b9f-a375b2a67f44 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:00.571309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92a134db-bbf9-4831-8b9f-a375b2a67f44 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:00.572046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92a134db-bbf9-4831-8b9f-a375b2a67f44 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:00.744017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-92a134db-bbf9-4831-8b9f-a375b2a67f44 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:00.763110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-92a134db-bbf9-4831-8b9f-a375b2a67f44 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:00.766218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-92a134db-bbf9-4831-8b9f-a375b2a67f44 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:00.774631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-35584376-a2c0-4e9f-879c-83dd460c5528 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:00.778023 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-92a134db-bbf9-4831-8b9f-a375b2a67f44 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1538 microversion: 2.91 time: 0.238035 Sep 07 12:34:00.778939 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 679/1363] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:34:00 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1538 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:34:00.784017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-35584376-a2c0-4e9f-879c-83dd460c5528 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:00.785969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-35584376-a2c0-4e9f-879c-83dd460c5528 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:00.787468 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-35584376-a2c0-4e9f-879c-83dd460c5528 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1607 microversion: 2.25 time: 0.434391 Sep 07 12:34:00.801955 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 685/1364] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:34:00 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1607 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:34:00.810793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-32ec33b3-55db-4e31-99f1-5ff5ad6e7a05 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-852087-9"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:34:00.813456 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7ed14ccc-7738-49b0-afb3-46147534dbe2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:00.813997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7ed14ccc-7738-49b0-afb3-46147534dbe2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:00.821112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-32ec33b3-55db-4e31-99f1-5ff5ad6e7a05 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:00.821427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ed14ccc-7738-49b0-afb3-46147534dbe2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:00.821639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ed14ccc-7738-49b0-afb3-46147534dbe2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:00.822093 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ed14ccc-7738-49b0-afb3-46147534dbe2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:00.823338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ed14ccc-7738-49b0-afb3-46147534dbe2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:00.823986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ed14ccc-7738-49b0-afb3-46147534dbe2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:00.824642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ed14ccc-7738-49b0-afb3-46147534dbe2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:00.833911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32ec33b3-55db-4e31-99f1-5ff5ad6e7a05 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:00.835192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32ec33b3-55db-4e31-99f1-5ff5ad6e7a05 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:00.836333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32ec33b3-55db-4e31-99f1-5ff5ad6e7a05 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:00.837949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32ec33b3-55db-4e31-99f1-5ff5ad6e7a05 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:00.839024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32ec33b3-55db-4e31-99f1-5ff5ad6e7a05 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:00.840126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32ec33b3-55db-4e31-99f1-5ff5ad6e7a05 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:00.978500 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7ed14ccc-7738-49b0-afb3-46147534dbe2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.168505 Sep 07 12:34:00.979733 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 686/1365] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Sep 7 12:34:00 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-interface => generated 285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 12:34:00.991075 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f23385c0-d53c-49d2-9691-869f111fd79a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:00.992691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f23385c0-d53c-49d2-9691-869f111fd79a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2f6ee92e-b663-4984-9198-d2ca0f8b3892] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:00.998389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-32ec33b3-55db-4e31-99f1-5ff5ad6e7a05 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-852087-9". {{(pid=122433) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 12:34:01.007427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f23385c0-d53c-49d2-9691-869f111fd79a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:01.008528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f23385c0-d53c-49d2-9691-869f111fd79a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:01.009791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f23385c0-d53c-49d2-9691-869f111fd79a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:01.011853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f23385c0-d53c-49d2-9691-869f111fd79a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:01.013181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f23385c0-d53c-49d2-9691-869f111fd79a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:01.014870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f23385c0-d53c-49d2-9691-869f111fd79a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:01.155102 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-32ec33b3-55db-4e31-99f1-5ff5ad6e7a05 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca/action" status: 202 len: 0 microversion: 2.91 time: 0.351739 Sep 07 12:34:01.156261 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 680/1366] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Sep 7 12:34:00 2022] POST /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 07 12:34:01.168905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-95bd254c-e9c8-420a-91aa-96029ca8b2d8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:01.169562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-95bd254c-e9c8-420a-91aa-96029ca8b2d8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:01.211094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95bd254c-e9c8-420a-91aa-96029ca8b2d8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:01.211627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95bd254c-e9c8-420a-91aa-96029ca8b2d8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:01.212085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95bd254c-e9c8-420a-91aa-96029ca8b2d8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:01.217570 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95bd254c-e9c8-420a-91aa-96029ca8b2d8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:01.218074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95bd254c-e9c8-420a-91aa-96029ca8b2d8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:01.218522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95bd254c-e9c8-420a-91aa-96029ca8b2d8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:01.222403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:34:01.663611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-95bd254c-e9c8-420a-91aa-96029ca8b2d8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:01.696961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f23385c0-d53c-49d2-9691-869f111fd79a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:01.699258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-95bd254c-e9c8-420a-91aa-96029ca8b2d8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:01.701974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-95bd254c-e9c8-420a-91aa-96029ca8b2d8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:01.709779 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-95bd254c-e9c8-420a-91aa-96029ca8b2d8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1546 microversion: 2.91 time: 0.546820 Sep 07 12:34:01.729522 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f23385c0-d53c-49d2-9691-869f111fd79a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892" status: 200 len: 1307 microversion: 2.1 time: 0.729235 Sep 07 12:34:01.729907 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 681/1367] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:34:01 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1546 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:34:01.729907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c614fcec-65e4-4171-9af1-363a10f9a01c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:01.729907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c614fcec-65e4-4171-9af1-363a10f9a01c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:01.729907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c614fcec-65e4-4171-9af1-363a10f9a01c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:01.729907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c614fcec-65e4-4171-9af1-363a10f9a01c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:01.730284 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c614fcec-65e4-4171-9af1-363a10f9a01c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:01.731538 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 687/1368] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:00 2022] GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892 => generated 1307 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:01.733055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c614fcec-65e4-4171-9af1-363a10f9a01c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:01.741565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c614fcec-65e4-4171-9af1-363a10f9a01c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:01.741565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c614fcec-65e4-4171-9af1-363a10f9a01c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:01.753659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9f98a8fa-204b-47a9-b70b-fdebdd7debe0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:01.754791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9f98a8fa-204b-47a9-b70b-fdebdd7debe0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:01.770436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f98a8fa-204b-47a9-b70b-fdebdd7debe0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:01.771045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f98a8fa-204b-47a9-b70b-fdebdd7debe0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:01.771498 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f98a8fa-204b-47a9-b70b-fdebdd7debe0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:01.772521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f98a8fa-204b-47a9-b70b-fdebdd7debe0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:01.773207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f98a8fa-204b-47a9-b70b-fdebdd7debe0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:01.773907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f98a8fa-204b-47a9-b70b-fdebdd7debe0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:02.697092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c614fcec-65e4-4171-9af1-363a10f9a01c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:02.717363 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c614fcec-65e4-4171-9af1-363a10f9a01c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1476 microversion: 2.1 time: 1.001565 Sep 07 12:34:02.734120 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 682/1369] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:01 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1476 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:02.745304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5140db5c-dd91-4f4d-9465-cc0ec628eb31 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:02.747411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5140db5c-dd91-4f4d-9465-cc0ec628eb31 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:02.773167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5140db5c-dd91-4f4d-9465-cc0ec628eb31 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:02.774333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5140db5c-dd91-4f4d-9465-cc0ec628eb31 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:02.781063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5140db5c-dd91-4f4d-9465-cc0ec628eb31 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:02.782700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5140db5c-dd91-4f4d-9465-cc0ec628eb31 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:02.787408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5140db5c-dd91-4f4d-9465-cc0ec628eb31 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:02.789100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5140db5c-dd91-4f4d-9465-cc0ec628eb31 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:03.062579 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9f98a8fa-204b-47a9-b70b-fdebdd7debe0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:03.117904 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9f98a8fa-204b-47a9-b70b-fdebdd7debe0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1716 microversion: 2.1 time: 1.377576 Sep 07 12:34:03.122416 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 688/1370] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:01 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1716 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:03.155769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ee65de83-6d6f-4c69-9a58-fa9cecca27f9 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:03.160217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ee65de83-6d6f-4c69-9a58-fa9cecca27f9 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:03.172632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:34:03.212965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee65de83-6d6f-4c69-9a58-fa9cecca27f9 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:03.220785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee65de83-6d6f-4c69-9a58-fa9cecca27f9 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:03.224008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee65de83-6d6f-4c69-9a58-fa9cecca27f9 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:03.225890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee65de83-6d6f-4c69-9a58-fa9cecca27f9 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:03.227141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee65de83-6d6f-4c69-9a58-fa9cecca27f9 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:03.228724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee65de83-6d6f-4c69-9a58-fa9cecca27f9 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:03.232689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5140db5c-dd91-4f4d-9465-cc0ec628eb31 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:03.252315 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5140db5c-dd91-4f4d-9465-cc0ec628eb31 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.514324 Sep 07 12:34:03.270738 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 683/1371] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:02 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:03.297142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6322cbb7-674c-43d5-9185-565319d8d8ea tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:03.300732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6322cbb7-674c-43d5-9185-565319d8d8ea tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2f6ee92e-b663-4984-9198-d2ca0f8b3892] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:03.318816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6322cbb7-674c-43d5-9185-565319d8d8ea tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:03.319378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6322cbb7-674c-43d5-9185-565319d8d8ea tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:03.319868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6322cbb7-674c-43d5-9185-565319d8d8ea tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:03.320650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6322cbb7-674c-43d5-9185-565319d8d8ea tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:03.321139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6322cbb7-674c-43d5-9185-565319d8d8ea tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:03.321623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6322cbb7-674c-43d5-9185-565319d8d8ea tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:03.412098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ee65de83-6d6f-4c69-9a58-fa9cecca27f9 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:03.436303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ee65de83-6d6f-4c69-9a58-fa9cecca27f9 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:03.441604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ee65de83-6d6f-4c69-9a58-fa9cecca27f9 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:03.454271 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ee65de83-6d6f-4c69-9a58-fa9cecca27f9 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 0.328373 Sep 07 12:34:03.456518 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 689/1372] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:34:03 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:34:03.467840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-406c3034-909a-4763-babe-822226f61795 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:03.470151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-406c3034-909a-4763-babe-822226f61795 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:03.499194 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-406c3034-909a-4763-babe-822226f61795 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:03.500237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-406c3034-909a-4763-babe-822226f61795 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:03.501064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-406c3034-909a-4763-babe-822226f61795 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:03.506435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-406c3034-909a-4763-babe-822226f61795 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:03.507303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-406c3034-909a-4763-babe-822226f61795 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:03.508090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-406c3034-909a-4763-babe-822226f61795 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:03.609812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-406c3034-909a-4763-babe-822226f61795 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:34:03.727659 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-406c3034-909a-4763-babe-822226f61795 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4" status: 204 len: 0 microversion: 2.1 time: 0.267672 Sep 07 12:34:03.733186 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 690/1373] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:34:03 2022] DELETE /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:34:03.737059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-8e865f46-d1b5-4bb4-81eb-5ddcff998fd9 req-67d88f1a-64c5-488f-8e5b-392b3a9f62c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f070fedf-8028-43e3-97f9-8955e81dc84b", "tag": "236bdb6a-10c1-409a-9ceb-084851be8590"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:34:03.750560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8e865f46-d1b5-4bb4-81eb-5ddcff998fd9 req-67d88f1a-64c5-488f-8e5b-392b3a9f62c6 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:03.751083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8e865f46-d1b5-4bb4-81eb-5ddcff998fd9 req-67d88f1a-64c5-488f-8e5b-392b3a9f62c6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:03.751719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8e865f46-d1b5-4bb4-81eb-5ddcff998fd9 req-67d88f1a-64c5-488f-8e5b-392b3a9f62c6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:03.766959 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-8e865f46-d1b5-4bb4-81eb-5ddcff998fd9 req-67d88f1a-64c5-488f-8e5b-392b3a9f62c6 service nova] Creating event network-changed:236bdb6a-10c1-409a-9ceb-084851be8590 for instance f070fedf-8028-43e3-97f9-8955e81dc84b on n-h2-852087-9 Sep 07 12:34:03.774227 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-8e865f46-d1b5-4bb4-81eb-5ddcff998fd9 req-67d88f1a-64c5-488f-8e5b-392b3a9f62c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043999 Sep 07 12:34:03.775366 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 691/1374] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:03.782436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5a871379-0073-4846-a3b2-60ad62e508d2 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:03.783393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5a871379-0073-4846-a3b2-60ad62e508d2 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:03.792026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a871379-0073-4846-a3b2-60ad62e508d2 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:03.792892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a871379-0073-4846-a3b2-60ad62e508d2 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:03.793462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a871379-0073-4846-a3b2-60ad62e508d2 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:03.794375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a871379-0073-4846-a3b2-60ad62e508d2 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:03.794970 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a871379-0073-4846-a3b2-60ad62e508d2 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:03.795557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a871379-0073-4846-a3b2-60ad62e508d2 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:03.813435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6322cbb7-674c-43d5-9185-565319d8d8ea tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:03.836207 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6322cbb7-674c-43d5-9185-565319d8d8ea tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892" status: 200 len: 1307 microversion: 2.1 time: 0.563239 Sep 07 12:34:03.844863 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 684/1375] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:03 2022] GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892 => generated 1307 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:03.871674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c8c576c7-e40f-493e-8e5f-b11733a95380 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:03.875460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c8c576c7-e40f-493e-8e5f-b11733a95380 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:03.904702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8c576c7-e40f-493e-8e5f-b11733a95380 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:03.905940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8c576c7-e40f-493e-8e5f-b11733a95380 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:03.906951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8c576c7-e40f-493e-8e5f-b11733a95380 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:03.909601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8c576c7-e40f-493e-8e5f-b11733a95380 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:03.914376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8c576c7-e40f-493e-8e5f-b11733a95380 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:03.915645 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8c576c7-e40f-493e-8e5f-b11733a95380 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:04.347762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5a871379-0073-4846-a3b2-60ad62e508d2 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:04.379746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c8c576c7-e40f-493e-8e5f-b11733a95380 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:04.380857 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5a871379-0073-4846-a3b2-60ad62e508d2 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4" status: 200 len: 1513 microversion: 2.1 time: 0.603460 Sep 07 12:34:04.395973 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c8c576c7-e40f-493e-8e5f-b11733a95380 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1476 microversion: 2.1 time: 0.546704 Sep 07 12:34:04.396942 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 685/1376] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:03 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1476 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:04.398266 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 692/1377] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:03 2022] GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 => generated 1513 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:04.406591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dc7395f1-a9be-4651-af2f-f5b410d97347 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:04.407776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dc7395f1-a9be-4651-af2f-f5b410d97347 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:04.413409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8fb6016b-d71a-4d1f-a799-4830b484f6b0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:04.418839 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8fb6016b-d71a-4d1f-a799-4830b484f6b0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:04.424895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc7395f1-a9be-4651-af2f-f5b410d97347 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:04.425890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc7395f1-a9be-4651-af2f-f5b410d97347 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:04.426616 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc7395f1-a9be-4651-af2f-f5b410d97347 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:04.427599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc7395f1-a9be-4651-af2f-f5b410d97347 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:04.428321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc7395f1-a9be-4651-af2f-f5b410d97347 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:04.428988 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc7395f1-a9be-4651-af2f-f5b410d97347 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:04.431529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fb6016b-d71a-4d1f-a799-4830b484f6b0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:04.432738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fb6016b-d71a-4d1f-a799-4830b484f6b0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:04.433599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fb6016b-d71a-4d1f-a799-4830b484f6b0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:04.435079 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fb6016b-d71a-4d1f-a799-4830b484f6b0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:04.435950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fb6016b-d71a-4d1f-a799-4830b484f6b0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:04.436716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fb6016b-d71a-4d1f-a799-4830b484f6b0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:04.477139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:34:04.740276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8fb6016b-d71a-4d1f-a799-4830b484f6b0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:04.754071 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8fb6016b-d71a-4d1f-a799-4830b484f6b0 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.354140 Sep 07 12:34:04.766748 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 693/1378] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:04 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:04.778125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3428c37f-8b1d-4ec4-972f-5f0fae03a565 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:04.780060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3428c37f-8b1d-4ec4-972f-5f0fae03a565 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:04.790511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3428c37f-8b1d-4ec4-972f-5f0fae03a565 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:04.791023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3428c37f-8b1d-4ec4-972f-5f0fae03a565 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:04.791469 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3428c37f-8b1d-4ec4-972f-5f0fae03a565 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:04.792239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3428c37f-8b1d-4ec4-972f-5f0fae03a565 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:04.792708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3428c37f-8b1d-4ec4-972f-5f0fae03a565 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:04.793190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3428c37f-8b1d-4ec4-972f-5f0fae03a565 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:04.810201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dc7395f1-a9be-4651-af2f-f5b410d97347 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:04.823337 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dc7395f1-a9be-4651-af2f-f5b410d97347 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1716 microversion: 2.1 time: 0.424532 Sep 07 12:34:04.833964 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 686/1379] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:04 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1716 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:04.875192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4e1dd4e5-b815-4758-96ed-366679ad8ce4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:04.879429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4e1dd4e5-b815-4758-96ed-366679ad8ce4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2f6ee92e-b663-4984-9198-d2ca0f8b3892] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:04.914934 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e1dd4e5-b815-4758-96ed-366679ad8ce4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:04.916308 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e1dd4e5-b815-4758-96ed-366679ad8ce4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:04.916859 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e1dd4e5-b815-4758-96ed-366679ad8ce4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:04.920610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e1dd4e5-b815-4758-96ed-366679ad8ce4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:04.921523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e1dd4e5-b815-4758-96ed-366679ad8ce4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:04.922380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e1dd4e5-b815-4758-96ed-366679ad8ce4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:04.947121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3428c37f-8b1d-4ec4-972f-5f0fae03a565 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:04.964711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3428c37f-8b1d-4ec4-972f-5f0fae03a565 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:04.966122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3428c37f-8b1d-4ec4-972f-5f0fae03a565 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:04.982529 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3428c37f-8b1d-4ec4-972f-5f0fae03a565 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 0.212924 Sep 07 12:34:04.983892 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 694/1380] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:34:04 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:34:05.163691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4e1dd4e5-b815-4758-96ed-366679ad8ce4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:05.174056 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4e1dd4e5-b815-4758-96ed-366679ad8ce4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892" status: 200 len: 1307 microversion: 2.1 time: 0.305984 Sep 07 12:34:05.175049 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 687/1381] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:04 2022] GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892 => generated 1307 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:05.427134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-55594f2e-2a61-4696-8aab-b1ae1eaa9776 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:05.428183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-55594f2e-2a61-4696-8aab-b1ae1eaa9776 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:05.433689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3d3a26cd-ef63-4336-9c5e-eea980c87c55 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:05.434640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3d3a26cd-ef63-4336-9c5e-eea980c87c55 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:05.440445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55594f2e-2a61-4696-8aab-b1ae1eaa9776 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:05.441376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55594f2e-2a61-4696-8aab-b1ae1eaa9776 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:05.442174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55594f2e-2a61-4696-8aab-b1ae1eaa9776 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:05.443429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55594f2e-2a61-4696-8aab-b1ae1eaa9776 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:05.444292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55594f2e-2a61-4696-8aab-b1ae1eaa9776 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:05.445233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55594f2e-2a61-4696-8aab-b1ae1eaa9776 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:05.445540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d3a26cd-ef63-4336-9c5e-eea980c87c55 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:05.446319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d3a26cd-ef63-4336-9c5e-eea980c87c55 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:05.458247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d3a26cd-ef63-4336-9c5e-eea980c87c55 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:05.460055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d3a26cd-ef63-4336-9c5e-eea980c87c55 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:05.460899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d3a26cd-ef63-4336-9c5e-eea980c87c55 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:05.463561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d3a26cd-ef63-4336-9c5e-eea980c87c55 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:05.708567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3d3a26cd-ef63-4336-9c5e-eea980c87c55 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:05.709141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-55594f2e-2a61-4696-8aab-b1ae1eaa9776 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:05.725803 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-55594f2e-2a61-4696-8aab-b1ae1eaa9776 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1476 microversion: 2.1 time: 0.307303 Sep 07 12:34:05.734136 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3d3a26cd-ef63-4336-9c5e-eea980c87c55 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4" status: 200 len: 1513 microversion: 2.1 time: 0.308476 Sep 07 12:34:05.736293 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 695/1382] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:05 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1476 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:05.750812 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 688/1383] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:05 2022] GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 => generated 1513 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:34:05.788098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-129f5a0a-988e-48be-acc0-7e0e4618d2bc tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:05.789710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-129f5a0a-988e-48be-acc0-7e0e4618d2bc tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:05.802689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-129f5a0a-988e-48be-acc0-7e0e4618d2bc tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:05.803514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-129f5a0a-988e-48be-acc0-7e0e4618d2bc tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:05.804400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-129f5a0a-988e-48be-acc0-7e0e4618d2bc tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:05.806061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-129f5a0a-988e-48be-acc0-7e0e4618d2bc tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:05.806908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-129f5a0a-988e-48be-acc0-7e0e4618d2bc tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:05.807704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-129f5a0a-988e-48be-acc0-7e0e4618d2bc tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:05.873422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1a9c13f1-ee9c-411a-aa07-0b3e6e0d0886 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:05.874572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1a9c13f1-ee9c-411a-aa07-0b3e6e0d0886 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:05.885904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a9c13f1-ee9c-411a-aa07-0b3e6e0d0886 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:05.886914 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a9c13f1-ee9c-411a-aa07-0b3e6e0d0886 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:05.887675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a9c13f1-ee9c-411a-aa07-0b3e6e0d0886 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:05.888938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a9c13f1-ee9c-411a-aa07-0b3e6e0d0886 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:05.889813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a9c13f1-ee9c-411a-aa07-0b3e6e0d0886 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:05.890724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a9c13f1-ee9c-411a-aa07-0b3e6e0d0886 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:06.269441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-129f5a0a-988e-48be-acc0-7e0e4618d2bc tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:06.283865 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-129f5a0a-988e-48be-acc0-7e0e4618d2bc tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.505130 Sep 07 12:34:06.293640 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 696/1384] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:05 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:06.295080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bf434863-b41f-4510-8438-91ef54b8a846 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:06.296244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bf434863-b41f-4510-8438-91ef54b8a846 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:06.312033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1a9c13f1-ee9c-411a-aa07-0b3e6e0d0886 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:06.312832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf434863-b41f-4510-8438-91ef54b8a846 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:06.313908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf434863-b41f-4510-8438-91ef54b8a846 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:06.314741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf434863-b41f-4510-8438-91ef54b8a846 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:06.316364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf434863-b41f-4510-8438-91ef54b8a846 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:06.317170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf434863-b41f-4510-8438-91ef54b8a846 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:06.317969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf434863-b41f-4510-8438-91ef54b8a846 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:06.324314 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1a9c13f1-ee9c-411a-aa07-0b3e6e0d0886 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1716 microversion: 2.1 time: 0.456987 Sep 07 12:34:06.325524 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 689/1385] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:05 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1716 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:34:06.333426 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-88034178-aa90-4747-abb9-d90614e83cd8 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:06.334793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-88034178-aa90-4747-abb9-d90614e83cd8 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2f6ee92e-b663-4984-9198-d2ca0f8b3892] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:06.346129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88034178-aa90-4747-abb9-d90614e83cd8 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:06.347290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88034178-aa90-4747-abb9-d90614e83cd8 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:06.348148 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88034178-aa90-4747-abb9-d90614e83cd8 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:06.349475 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88034178-aa90-4747-abb9-d90614e83cd8 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:06.350420 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88034178-aa90-4747-abb9-d90614e83cd8 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:06.351262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88034178-aa90-4747-abb9-d90614e83cd8 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:06.573306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bf434863-b41f-4510-8438-91ef54b8a846 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:06.591037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bf434863-b41f-4510-8438-91ef54b8a846 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:06.593740 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bf434863-b41f-4510-8438-91ef54b8a846 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:06.604937 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bf434863-b41f-4510-8438-91ef54b8a846 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 0.316983 Sep 07 12:34:06.606468 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 697/1386] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:34:06 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:34:06.775412 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e95d3e78-a1ac-4ce3-88c1-45a0bdccb0aa tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:06.776197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-88034178-aa90-4747-abb9-d90614e83cd8 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:06.776401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e95d3e78-a1ac-4ce3-88c1-45a0bdccb0aa tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:06.784488 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e95d3e78-a1ac-4ce3-88c1-45a0bdccb0aa tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:06.785032 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e95d3e78-a1ac-4ce3-88c1-45a0bdccb0aa tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:06.785753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e95d3e78-a1ac-4ce3-88c1-45a0bdccb0aa tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:06.786764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e95d3e78-a1ac-4ce3-88c1-45a0bdccb0aa tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:06.787224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e95d3e78-a1ac-4ce3-88c1-45a0bdccb0aa tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:06.787902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e95d3e78-a1ac-4ce3-88c1-45a0bdccb0aa tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:06.792224 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-88034178-aa90-4747-abb9-d90614e83cd8 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892" status: 200 len: 1307 microversion: 2.1 time: 0.465130 Sep 07 12:34:06.794029 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 690/1387] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:06 2022] GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892 => generated 1307 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:06.802774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-87c85dca-9fc8-4b9b-ad43-1ece240cbd1a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:06.804238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-87c85dca-9fc8-4b9b-ad43-1ece240cbd1a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:06.817198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87c85dca-9fc8-4b9b-ad43-1ece240cbd1a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:06.818488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87c85dca-9fc8-4b9b-ad43-1ece240cbd1a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:06.819552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87c85dca-9fc8-4b9b-ad43-1ece240cbd1a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:06.821076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87c85dca-9fc8-4b9b-ad43-1ece240cbd1a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:06.821913 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87c85dca-9fc8-4b9b-ad43-1ece240cbd1a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:06.823165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87c85dca-9fc8-4b9b-ad43-1ece240cbd1a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:07.187121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-87c85dca-9fc8-4b9b-ad43-1ece240cbd1a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:07.195810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e95d3e78-a1ac-4ce3-88c1-45a0bdccb0aa tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:07.205945 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-87c85dca-9fc8-4b9b-ad43-1ece240cbd1a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1476 microversion: 2.1 time: 0.409803 Sep 07 12:34:07.207080 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 691/1388] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:06 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1476 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:07.211335 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e95d3e78-a1ac-4ce3-88c1-45a0bdccb0aa tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4" status: 200 len: 1513 microversion: 2.1 time: 0.439867 Sep 07 12:34:07.212051 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 698/1389] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:06 2022] GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 => generated 1513 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:07.319682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-551bdd4e-1496-44cd-85b2-b7ee2bd6b60b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:07.320910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-551bdd4e-1496-44cd-85b2-b7ee2bd6b60b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:07.332839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-551bdd4e-1496-44cd-85b2-b7ee2bd6b60b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:07.333816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-551bdd4e-1496-44cd-85b2-b7ee2bd6b60b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:07.334628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-551bdd4e-1496-44cd-85b2-b7ee2bd6b60b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:07.335991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-551bdd4e-1496-44cd-85b2-b7ee2bd6b60b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:07.336803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-551bdd4e-1496-44cd-85b2-b7ee2bd6b60b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:07.337621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-551bdd4e-1496-44cd-85b2-b7ee2bd6b60b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:07.364416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-689f798e-402c-4638-b90e-d4751b453742 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:07.365396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-689f798e-402c-4638-b90e-d4751b453742 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:07.371851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-689f798e-402c-4638-b90e-d4751b453742 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:07.372365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-689f798e-402c-4638-b90e-d4751b453742 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:07.372798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-689f798e-402c-4638-b90e-d4751b453742 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:07.373524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-689f798e-402c-4638-b90e-d4751b453742 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:07.373984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-689f798e-402c-4638-b90e-d4751b453742 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:07.374407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-689f798e-402c-4638-b90e-d4751b453742 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:07.588424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-551bdd4e-1496-44cd-85b2-b7ee2bd6b60b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:07.600998 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-689f798e-402c-4638-b90e-d4751b453742 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:07.602375 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-551bdd4e-1496-44cd-85b2-b7ee2bd6b60b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.290518 Sep 07 12:34:07.603495 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 692/1390] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:07 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:07.610945 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-689f798e-402c-4638-b90e-d4751b453742 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1716 microversion: 2.1 time: 0.250942 Sep 07 12:34:07.611740 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 699/1391] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:07 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1716 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:34:07.635270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e4980c09-8f46-4987-82fe-8d839ee044a2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:07.635948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e4980c09-8f46-4987-82fe-8d839ee044a2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:07.645245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4980c09-8f46-4987-82fe-8d839ee044a2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:07.645803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4980c09-8f46-4987-82fe-8d839ee044a2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:07.646257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4980c09-8f46-4987-82fe-8d839ee044a2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:07.646998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4980c09-8f46-4987-82fe-8d839ee044a2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:07.647471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4980c09-8f46-4987-82fe-8d839ee044a2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:07.647895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4980c09-8f46-4987-82fe-8d839ee044a2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:07.829633 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5a334829-6364-43fb-b16a-e0bb9694989d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:07.830612 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5a334829-6364-43fb-b16a-e0bb9694989d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2f6ee92e-b663-4984-9198-d2ca0f8b3892] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:07.838117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a334829-6364-43fb-b16a-e0bb9694989d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:07.838927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a334829-6364-43fb-b16a-e0bb9694989d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:07.839768 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a334829-6364-43fb-b16a-e0bb9694989d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:07.840979 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a334829-6364-43fb-b16a-e0bb9694989d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:07.842194 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a334829-6364-43fb-b16a-e0bb9694989d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:07.843150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a334829-6364-43fb-b16a-e0bb9694989d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:07.844600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e4980c09-8f46-4987-82fe-8d839ee044a2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:07.868016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e4980c09-8f46-4987-82fe-8d839ee044a2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:07.871589 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e4980c09-8f46-4987-82fe-8d839ee044a2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:07.880281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:34:07.883737 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e4980c09-8f46-4987-82fe-8d839ee044a2 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 0.252125 Sep 07 12:34:07.899569 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 693/1392] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:34:07 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:34:08.241696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4f97073a-385e-4032-a0ac-0ddef1d9bbae tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:08.242314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4f97073a-385e-4032-a0ac-0ddef1d9bbae tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:08.273327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f97073a-385e-4032-a0ac-0ddef1d9bbae tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:08.274181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f97073a-385e-4032-a0ac-0ddef1d9bbae tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:08.274547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f97073a-385e-4032-a0ac-0ddef1d9bbae tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:08.275305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f97073a-385e-4032-a0ac-0ddef1d9bbae tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:08.275779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f97073a-385e-4032-a0ac-0ddef1d9bbae tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:08.276213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f97073a-385e-4032-a0ac-0ddef1d9bbae tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:08.746896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5a334829-6364-43fb-b16a-e0bb9694989d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:08.772818 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5a334829-6364-43fb-b16a-e0bb9694989d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892" status: 200 len: 1307 microversion: 2.1 time: 0.947678 Sep 07 12:34:08.778629 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 700/1393] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:07 2022] GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892 => generated 1307 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:34:08.798147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a0307b5e-29ba-4f7c-bbb3-f5cea82d2913 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:08.810603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a0307b5e-29ba-4f7c-bbb3-f5cea82d2913 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:08.842842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0307b5e-29ba-4f7c-bbb3-f5cea82d2913 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:08.843717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0307b5e-29ba-4f7c-bbb3-f5cea82d2913 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:08.844443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0307b5e-29ba-4f7c-bbb3-f5cea82d2913 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:08.845824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0307b5e-29ba-4f7c-bbb3-f5cea82d2913 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:08.846619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0307b5e-29ba-4f7c-bbb3-f5cea82d2913 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:08.847395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0307b5e-29ba-4f7c-bbb3-f5cea82d2913 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:09.287293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4f97073a-385e-4032-a0ac-0ddef1d9bbae tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:09.329818 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4f97073a-385e-4032-a0ac-0ddef1d9bbae tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1476 microversion: 2.1 time: 1.091757 Sep 07 12:34:09.333767 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 694/1394] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:08 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1476 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:09.348919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-09e6bf06-9e6b-4a65-970b-3777f77d0cf1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:09.352606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-09e6bf06-9e6b-4a65-970b-3777f77d0cf1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:09.374251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09e6bf06-9e6b-4a65-970b-3777f77d0cf1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:09.376851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09e6bf06-9e6b-4a65-970b-3777f77d0cf1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:09.381118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09e6bf06-9e6b-4a65-970b-3777f77d0cf1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:09.383222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09e6bf06-9e6b-4a65-970b-3777f77d0cf1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:09.384766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09e6bf06-9e6b-4a65-970b-3777f77d0cf1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:09.385892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09e6bf06-9e6b-4a65-970b-3777f77d0cf1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:09.661313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a0307b5e-29ba-4f7c-bbb3-f5cea82d2913 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:09.679183 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a0307b5e-29ba-4f7c-bbb3-f5cea82d2913 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4" status: 200 len: 1513 microversion: 2.1 time: 0.898348 Sep 07 12:34:09.682312 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 701/1395] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:08 2022] GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 => generated 1513 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:09.722138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-68b0dd2d-4a22-4d68-8c0e-8f4b8c9064cd tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:09.727667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-68b0dd2d-4a22-4d68-8c0e-8f4b8c9064cd tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:09.743869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68b0dd2d-4a22-4d68-8c0e-8f4b8c9064cd tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:09.744801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68b0dd2d-4a22-4d68-8c0e-8f4b8c9064cd tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:09.745510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68b0dd2d-4a22-4d68-8c0e-8f4b8c9064cd tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:09.746569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68b0dd2d-4a22-4d68-8c0e-8f4b8c9064cd tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:09.747284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68b0dd2d-4a22-4d68-8c0e-8f4b8c9064cd tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:09.748450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68b0dd2d-4a22-4d68-8c0e-8f4b8c9064cd tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:10.194627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-09e6bf06-9e6b-4a65-970b-3777f77d0cf1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:10.269717 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-09e6bf06-9e6b-4a65-970b-3777f77d0cf1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1716 microversion: 2.1 time: 0.933062 Sep 07 12:34:10.270574 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 695/1396] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:09 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1716 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:10.278796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c4c18f71-8aa6-4db9-9cfd-8837e35a249c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:10.279425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c4c18f71-8aa6-4db9-9cfd-8837e35a249c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:10.333901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4c18f71-8aa6-4db9-9cfd-8837e35a249c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:10.334928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4c18f71-8aa6-4db9-9cfd-8837e35a249c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:10.334928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4c18f71-8aa6-4db9-9cfd-8837e35a249c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:10.335673 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4c18f71-8aa6-4db9-9cfd-8837e35a249c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:10.336154 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4c18f71-8aa6-4db9-9cfd-8837e35a249c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:10.336605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4c18f71-8aa6-4db9-9cfd-8837e35a249c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:10.824626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-68b0dd2d-4a22-4d68-8c0e-8f4b8c9064cd tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:10.844451 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-68b0dd2d-4a22-4d68-8c0e-8f4b8c9064cd tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 1.160087 Sep 07 12:34:10.845365 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 702/1397] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:09 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:10.850614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8e0deb0b-94e9-4425-9224-e496ee389c71 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:10.857391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8e0deb0b-94e9-4425-9224-e496ee389c71 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2f6ee92e-b663-4984-9198-d2ca0f8b3892] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:10.876959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e0deb0b-94e9-4425-9224-e496ee389c71 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:10.877649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e0deb0b-94e9-4425-9224-e496ee389c71 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:10.878118 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e0deb0b-94e9-4425-9224-e496ee389c71 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:10.878876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e0deb0b-94e9-4425-9224-e496ee389c71 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:10.879351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e0deb0b-94e9-4425-9224-e496ee389c71 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:10.886436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e0deb0b-94e9-4425-9224-e496ee389c71 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:10.895198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c4c18f71-8aa6-4db9-9cfd-8837e35a249c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:10.918130 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c4c18f71-8aa6-4db9-9cfd-8837e35a249c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:10.919760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c4c18f71-8aa6-4db9-9cfd-8837e35a249c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:10.943733 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c4c18f71-8aa6-4db9-9cfd-8837e35a249c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 0.668977 Sep 07 12:34:10.975148 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 696/1398] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:34:10 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:34:10.984977 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-b27f2a46-d2f2-421e-9db7-0ad1810ffc74 req-56369e87-ec24-433e-8d26-44cddbaad62a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d12be6f4-80c9-404a-b6c4-d1e94e25daa9", "name": "network-vif-unplugged", "status": "completed", "tag": "50b3c60a-51cc-4ed6-8a42-813229cfb0f8"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:34:11.029724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b27f2a46-d2f2-421e-9db7-0ad1810ffc74 req-56369e87-ec24-433e-8d26-44cddbaad62a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:11.030524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b27f2a46-d2f2-421e-9db7-0ad1810ffc74 req-56369e87-ec24-433e-8d26-44cddbaad62a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:11.031158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b27f2a46-d2f2-421e-9db7-0ad1810ffc74 req-56369e87-ec24-433e-8d26-44cddbaad62a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:11.060732 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-b27f2a46-d2f2-421e-9db7-0ad1810ffc74 req-56369e87-ec24-433e-8d26-44cddbaad62a service nova] Creating event network-vif-unplugged:50b3c60a-51cc-4ed6-8a42-813229cfb0f8 for instance d12be6f4-80c9-404a-b6c4-d1e94e25daa9 on n-h2-852087-9 Sep 07 12:34:11.077551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-b27f2a46-d2f2-421e-9db7-0ad1810ffc74 req-56369e87-ec24-433e-8d26-44cddbaad62a service nova] Instance d12be6f4-80c9-404a-b6c4-d1e94e25daa9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 12:34:11.100500 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-b27f2a46-d2f2-421e-9db7-0ad1810ffc74 req-56369e87-ec24-433e-8d26-44cddbaad62a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122588 Sep 07 12:34:11.103976 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 697/1399] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:11.118384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d120cd4d-8261-4838-b07b-2040f1c8c1ab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:11.119932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d120cd4d-8261-4838-b07b-2040f1c8c1ab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:11.136246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d120cd4d-8261-4838-b07b-2040f1c8c1ab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:11.138971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d120cd4d-8261-4838-b07b-2040f1c8c1ab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:11.139763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d120cd4d-8261-4838-b07b-2040f1c8c1ab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:11.140708 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d120cd4d-8261-4838-b07b-2040f1c8c1ab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:11.144447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d120cd4d-8261-4838-b07b-2040f1c8c1ab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:11.145179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d120cd4d-8261-4838-b07b-2040f1c8c1ab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:11.149883 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:34:12.463002 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d120cd4d-8261-4838-b07b-2040f1c8c1ab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:12.497131 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d120cd4d-8261-4838-b07b-2040f1c8c1ab tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1475 microversion: 2.1 time: 1.387761 Sep 07 12:34:12.526080 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 698/1400] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:11 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1475 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:12.554049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4743ebca-84b8-48dc-8cf1-9de2b0f8f32d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:12.555461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4743ebca-84b8-48dc-8cf1-9de2b0f8f32d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:12.577641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4743ebca-84b8-48dc-8cf1-9de2b0f8f32d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:12.578789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4743ebca-84b8-48dc-8cf1-9de2b0f8f32d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:12.585759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4743ebca-84b8-48dc-8cf1-9de2b0f8f32d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:12.589550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4743ebca-84b8-48dc-8cf1-9de2b0f8f32d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:12.591886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4743ebca-84b8-48dc-8cf1-9de2b0f8f32d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:12.593541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4743ebca-84b8-48dc-8cf1-9de2b0f8f32d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:12.672146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8e0deb0b-94e9-4425-9224-e496ee389c71 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:12.704938 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8e0deb0b-94e9-4425-9224-e496ee389c71 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892" status: 200 len: 1307 microversion: 2.1 time: 1.857542 Sep 07 12:34:12.712499 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 703/1401] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:10 2022] GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892 => generated 1307 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:12.726168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-35e41624-a487-4601-a47f-309138f15bc2 req-1adc8c7a-f705-4246-bfbc-fb7f17d769a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8cd2a9-2d75-4dee-b17d-434f35f15ba4", "name": "network-vif-deleted", "tag": "308f2d25-df8e-4168-b05c-f1c950dbcca9"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:34:12.748940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4743ebca-84b8-48dc-8cf1-9de2b0f8f32d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:12.749446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4743ebca-84b8-48dc-8cf1-9de2b0f8f32d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:12.753799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4743ebca-84b8-48dc-8cf1-9de2b0f8f32d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:12.754681 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-4743ebca-84b8-48dc-8cf1-9de2b0f8f32d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lazy-loading 'fault' on Instance uuid 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:34:12.767802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-35e41624-a487-4601-a47f-309138f15bc2 req-1adc8c7a-f705-4246-bfbc-fb7f17d769a7 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:12.769133 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-35e41624-a487-4601-a47f-309138f15bc2 req-1adc8c7a-f705-4246-bfbc-fb7f17d769a7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:12.770806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-35e41624-a487-4601-a47f-309138f15bc2 req-1adc8c7a-f705-4246-bfbc-fb7f17d769a7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:12.799472 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-35e41624-a487-4601-a47f-309138f15bc2 req-1adc8c7a-f705-4246-bfbc-fb7f17d769a7 service nova] Creating event network-vif-deleted:308f2d25-df8e-4168-b05c-f1c950dbcca9 for instance 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 on n-h1-852087-9 Sep 07 12:34:12.809207 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-35e41624-a487-4601-a47f-309138f15bc2 req-1adc8c7a-f705-4246-bfbc-fb7f17d769a7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093563 Sep 07 12:34:12.811505 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 704/1402] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:12.820379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c8d6b2d4-8447-40bb-b6fd-b621441d1b27 req-c18ed4c5-d4a9-489c-bd7e-fb9c00bcefdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6ee92e-b663-4984-9198-d2ca0f8b3892", "name": "network-vif-plugged", "status": "completed", "tag": "07e0fa79-d940-418d-b2f3-f85b6ee4dffd"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:34:12.850238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c8d6b2d4-8447-40bb-b6fd-b621441d1b27 req-c18ed4c5-d4a9-489c-bd7e-fb9c00bcefdb service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:12.851685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c8d6b2d4-8447-40bb-b6fd-b621441d1b27 req-c18ed4c5-d4a9-489c-bd7e-fb9c00bcefdb service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:12.852836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c8d6b2d4-8447-40bb-b6fd-b621441d1b27 req-c18ed4c5-d4a9-489c-bd7e-fb9c00bcefdb service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:12.901081 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c8d6b2d4-8447-40bb-b6fd-b621441d1b27 req-c18ed4c5-d4a9-489c-bd7e-fb9c00bcefdb service nova] Creating event network-vif-plugged:07e0fa79-d940-418d-b2f3-f85b6ee4dffd for instance 2f6ee92e-b663-4984-9198-d2ca0f8b3892 on n-h2-852087-9 Sep 07 12:34:12.901905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4743ebca-84b8-48dc-8cf1-9de2b0f8f32d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:12.918893 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c8d6b2d4-8447-40bb-b6fd-b621441d1b27 req-c18ed4c5-d4a9-489c-bd7e-fb9c00bcefdb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102468 Sep 07 12:34:12.920277 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 705/1403] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:12.924693 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4743ebca-84b8-48dc-8cf1-9de2b0f8f32d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4" status: 200 len: 1308 microversion: 2.1 time: 0.396819 Sep 07 12:34:12.925332 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 699/1404] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:12 2022] GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 => generated 1308 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:12.931216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fc774377-67d1-4f32-aa1b-317198e7f36e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:12.937556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fc774377-67d1-4f32-aa1b-317198e7f36e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:12.959704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc774377-67d1-4f32-aa1b-317198e7f36e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:12.960620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc774377-67d1-4f32-aa1b-317198e7f36e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:12.961272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc774377-67d1-4f32-aa1b-317198e7f36e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:12.963037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df35ab16-c167-4185-a9de-5fe9ae76f3d0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:12.964508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-df35ab16-c167-4185-a9de-5fe9ae76f3d0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:12.964755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc774377-67d1-4f32-aa1b-317198e7f36e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:12.966097 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc774377-67d1-4f32-aa1b-317198e7f36e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:12.969193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc774377-67d1-4f32-aa1b-317198e7f36e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:12.990592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df35ab16-c167-4185-a9de-5fe9ae76f3d0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:12.991296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df35ab16-c167-4185-a9de-5fe9ae76f3d0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:12.991840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df35ab16-c167-4185-a9de-5fe9ae76f3d0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:12.994603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df35ab16-c167-4185-a9de-5fe9ae76f3d0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:12.995356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df35ab16-c167-4185-a9de-5fe9ae76f3d0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:12.996021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df35ab16-c167-4185-a9de-5fe9ae76f3d0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:13.329430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fc774377-67d1-4f32-aa1b-317198e7f36e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:13.340521 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fc774377-67d1-4f32-aa1b-317198e7f36e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.413785 Sep 07 12:34:13.341429 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 700/1405] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:12 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:13.377588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0d2045c8-45e8-40ea-b1c6-bad97d73aace tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:13.377588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0d2045c8-45e8-40ea-b1c6-bad97d73aace tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:13.393876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d2045c8-45e8-40ea-b1c6-bad97d73aace tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:13.394394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d2045c8-45e8-40ea-b1c6-bad97d73aace tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:13.394840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d2045c8-45e8-40ea-b1c6-bad97d73aace tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:13.395593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d2045c8-45e8-40ea-b1c6-bad97d73aace tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:13.396067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d2045c8-45e8-40ea-b1c6-bad97d73aace tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:13.396521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d2045c8-45e8-40ea-b1c6-bad97d73aace tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:13.407315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-df35ab16-c167-4185-a9de-5fe9ae76f3d0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:13.420545 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-df35ab16-c167-4185-a9de-5fe9ae76f3d0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1716 microversion: 2.1 time: 0.498497 Sep 07 12:34:13.437574 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 706/1406] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:12 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1716 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:13.437574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-60e3490a-0164-460a-bf27-826dd189efcb req-1d62fad0-3ea9-42dc-b0a2-45247c696455 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d12be6f4-80c9-404a-b6c4-d1e94e25daa9", "tag": "50b3c60a-51cc-4ed6-8a42-813229cfb0f8"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:34:13.459871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-60e3490a-0164-460a-bf27-826dd189efcb req-1d62fad0-3ea9-42dc-b0a2-45247c696455 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:13.460365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-60e3490a-0164-460a-bf27-826dd189efcb req-1d62fad0-3ea9-42dc-b0a2-45247c696455 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:13.460794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-60e3490a-0164-460a-bf27-826dd189efcb req-1d62fad0-3ea9-42dc-b0a2-45247c696455 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:13.481273 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-60e3490a-0164-460a-bf27-826dd189efcb req-1d62fad0-3ea9-42dc-b0a2-45247c696455 service nova] Creating event network-changed:50b3c60a-51cc-4ed6-8a42-813229cfb0f8 for instance d12be6f4-80c9-404a-b6c4-d1e94e25daa9 on n-h2-852087-9 Sep 07 12:34:13.500281 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-60e3490a-0164-460a-bf27-826dd189efcb req-1d62fad0-3ea9-42dc-b0a2-45247c696455 service nova] Instance d12be6f4-80c9-404a-b6c4-d1e94e25daa9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 12:34:13.527712 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0d2045c8-45e8-40ea-b1c6-bad97d73aace tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:13.529067 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-60e3490a-0164-460a-bf27-826dd189efcb req-1d62fad0-3ea9-42dc-b0a2-45247c696455 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103648 Sep 07 12:34:13.530379 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 707/1407] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:13.578679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0d2045c8-45e8-40ea-b1c6-bad97d73aace tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:13.581801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9fd1f292-8cf3-4082-a063-674fccbe1bd3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:13.583078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0d2045c8-45e8-40ea-b1c6-bad97d73aace tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:13.584432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9fd1f292-8cf3-4082-a063-674fccbe1bd3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:13.593567 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0d2045c8-45e8-40ea-b1c6-bad97d73aace tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 0.250209 Sep 07 12:34:13.595519 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 701/1408] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:34:13 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:34:13.619833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fd1f292-8cf3-4082-a063-674fccbe1bd3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:13.620365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fd1f292-8cf3-4082-a063-674fccbe1bd3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:13.621233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fd1f292-8cf3-4082-a063-674fccbe1bd3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:13.622177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fd1f292-8cf3-4082-a063-674fccbe1bd3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:13.622747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fd1f292-8cf3-4082-a063-674fccbe1bd3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:13.623265 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fd1f292-8cf3-4082-a063-674fccbe1bd3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:13.741585 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-47fdbf10-1baa-4796-8bcd-2bafb4a78f1d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:13.742573 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-47fdbf10-1baa-4796-8bcd-2bafb4a78f1d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2f6ee92e-b663-4984-9198-d2ca0f8b3892] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:13.767708 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47fdbf10-1baa-4796-8bcd-2bafb4a78f1d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:13.774996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47fdbf10-1baa-4796-8bcd-2bafb4a78f1d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:13.776067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47fdbf10-1baa-4796-8bcd-2bafb4a78f1d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:13.777827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47fdbf10-1baa-4796-8bcd-2bafb4a78f1d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:13.778960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47fdbf10-1baa-4796-8bcd-2bafb4a78f1d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:13.779977 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47fdbf10-1baa-4796-8bcd-2bafb4a78f1d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:14.009425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9fd1f292-8cf3-4082-a063-674fccbe1bd3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:14.039692 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9fd1f292-8cf3-4082-a063-674fccbe1bd3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1473 microversion: 2.1 time: 0.468497 Sep 07 12:34:14.046746 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 708/1409] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:13 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1473 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:14.052517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b44aa707-606c-4ea0-a551-f724de7e28c8 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:14.053433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b44aa707-606c-4ea0-a551-f724de7e28c8 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:14.085043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b44aa707-606c-4ea0-a551-f724de7e28c8 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:14.085892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b44aa707-606c-4ea0-a551-f724de7e28c8 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:14.087444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b44aa707-606c-4ea0-a551-f724de7e28c8 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:14.091875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b44aa707-606c-4ea0-a551-f724de7e28c8 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:14.091875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b44aa707-606c-4ea0-a551-f724de7e28c8 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:14.091875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b44aa707-606c-4ea0-a551-f724de7e28c8 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:14.152173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-47fdbf10-1baa-4796-8bcd-2bafb4a78f1d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:14.167355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b44aa707-606c-4ea0-a551-f724de7e28c8 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:14.172136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b44aa707-606c-4ea0-a551-f724de7e28c8 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:14.172136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b44aa707-606c-4ea0-a551-f724de7e28c8 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:14.172136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-b44aa707-606c-4ea0-a551-f724de7e28c8 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lazy-loading 'fault' on Instance uuid 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:34:14.179143 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-47fdbf10-1baa-4796-8bcd-2bafb4a78f1d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892" status: 200 len: 1307 microversion: 2.1 time: 0.448989 Sep 07 12:34:14.181018 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 702/1410] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:13 2022] GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892 => generated 1307 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:34:14.279374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b44aa707-606c-4ea0-a551-f724de7e28c8 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:14.289535 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b44aa707-606c-4ea0-a551-f724de7e28c8 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4" status: 200 len: 1308 microversion: 2.1 time: 0.241420 Sep 07 12:34:14.290940 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 709/1411] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:14 2022] GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 => generated 1308 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:14.390726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fc4fcd8b-d0f0-498c-b67a-798227c96638 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:14.394912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fc4fcd8b-d0f0-498c-b67a-798227c96638 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:14.411209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc4fcd8b-d0f0-498c-b67a-798227c96638 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:14.422801 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc4fcd8b-d0f0-498c-b67a-798227c96638 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:14.424033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc4fcd8b-d0f0-498c-b67a-798227c96638 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:14.425772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc4fcd8b-d0f0-498c-b67a-798227c96638 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:14.436047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc4fcd8b-d0f0-498c-b67a-798227c96638 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:14.437655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc4fcd8b-d0f0-498c-b67a-798227c96638 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:14.449762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ef920be-c66b-48d3-ab08-6b2799ba4356 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:14.450924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6ef920be-c66b-48d3-ab08-6b2799ba4356 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:14.477858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ef920be-c66b-48d3-ab08-6b2799ba4356 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:14.478788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ef920be-c66b-48d3-ab08-6b2799ba4356 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:14.479584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ef920be-c66b-48d3-ab08-6b2799ba4356 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:14.480979 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ef920be-c66b-48d3-ab08-6b2799ba4356 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:14.482885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ef920be-c66b-48d3-ab08-6b2799ba4356 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:14.487437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ef920be-c66b-48d3-ab08-6b2799ba4356 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:14.880345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fc4fcd8b-d0f0-498c-b67a-798227c96638 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:14.896727 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fc4fcd8b-d0f0-498c-b67a-798227c96638 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.514959 Sep 07 12:34:14.906181 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 703/1412] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:14 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:34:14.914971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6ef920be-c66b-48d3-ab08-6b2799ba4356 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:14.919340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b4a9d997-88bf-458c-b25d-083c7344d186 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:14.920171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b4a9d997-88bf-458c-b25d-083c7344d186 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:14.938607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4a9d997-88bf-458c-b25d-083c7344d186 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:14.940067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4a9d997-88bf-458c-b25d-083c7344d186 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:14.944149 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6ef920be-c66b-48d3-ab08-6b2799ba4356 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1716 microversion: 2.1 time: 0.501794 Sep 07 12:34:14.945939 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 710/1413] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:14 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1716 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:14.946151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4a9d997-88bf-458c-b25d-083c7344d186 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:14.948220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4a9d997-88bf-458c-b25d-083c7344d186 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:14.949292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4a9d997-88bf-458c-b25d-083c7344d186 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:14.950182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4a9d997-88bf-458c-b25d-083c7344d186 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:15.076988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-093d929d-b875-4672-9589-76262e632182 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:15.078117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-093d929d-b875-4672-9589-76262e632182 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:15.099534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-093d929d-b875-4672-9589-76262e632182 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:15.102023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-093d929d-b875-4672-9589-76262e632182 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:15.102023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-093d929d-b875-4672-9589-76262e632182 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:15.102787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-093d929d-b875-4672-9589-76262e632182 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:15.103642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-093d929d-b875-4672-9589-76262e632182 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:15.104557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-093d929d-b875-4672-9589-76262e632182 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:15.125018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b4a9d997-88bf-458c-b25d-083c7344d186 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:15.142006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:34:15.152580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b4a9d997-88bf-458c-b25d-083c7344d186 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:15.156395 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b4a9d997-88bf-458c-b25d-083c7344d186 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:15.171469 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b4a9d997-88bf-458c-b25d-083c7344d186 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 0.256538 Sep 07 12:34:15.173398 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 704/1414] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:34:14 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:34:15.226483 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-75c1133a-f18d-4591-ab3b-09ac108cf914 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:15.229917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-75c1133a-f18d-4591-ab3b-09ac108cf914 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2f6ee92e-b663-4984-9198-d2ca0f8b3892] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:15.246549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75c1133a-f18d-4591-ab3b-09ac108cf914 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:15.247777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75c1133a-f18d-4591-ab3b-09ac108cf914 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:15.249087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75c1133a-f18d-4591-ab3b-09ac108cf914 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:15.251152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75c1133a-f18d-4591-ab3b-09ac108cf914 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:15.252448 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75c1133a-f18d-4591-ab3b-09ac108cf914 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:15.253732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75c1133a-f18d-4591-ab3b-09ac108cf914 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:15.511032 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-093d929d-b875-4672-9589-76262e632182 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:15.537092 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-093d929d-b875-4672-9589-76262e632182 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1473 microversion: 2.1 time: 0.465980 Sep 07 12:34:15.557522 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 711/1415] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:15 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1473 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:34:15.566550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5088e6b8-3cdb-4603-bb4e-a80b1710105d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:15.572924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5088e6b8-3cdb-4603-bb4e-a80b1710105d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:15.580800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5088e6b8-3cdb-4603-bb4e-a80b1710105d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:15.581936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5088e6b8-3cdb-4603-bb4e-a80b1710105d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:15.582859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5088e6b8-3cdb-4603-bb4e-a80b1710105d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:15.584505 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5088e6b8-3cdb-4603-bb4e-a80b1710105d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:15.585557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5088e6b8-3cdb-4603-bb4e-a80b1710105d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:15.586692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5088e6b8-3cdb-4603-bb4e-a80b1710105d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:15.723613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5088e6b8-3cdb-4603-bb4e-a80b1710105d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:15.724741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5088e6b8-3cdb-4603-bb4e-a80b1710105d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:15.725944 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5088e6b8-3cdb-4603-bb4e-a80b1710105d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:15.727237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-5088e6b8-3cdb-4603-bb4e-a80b1710105d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lazy-loading 'fault' on Instance uuid 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:34:15.960366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5088e6b8-3cdb-4603-bb4e-a80b1710105d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:15.984678 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5088e6b8-3cdb-4603-bb4e-a80b1710105d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4" status: 200 len: 1308 microversion: 2.1 time: 0.439881 Sep 07 12:34:16.002047 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 712/1416] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:15 2022] GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 => generated 1308 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:16.012400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1e51f9d0-65cb-4e1a-9633-374019966cc6 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:16.016874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1e51f9d0-65cb-4e1a-9633-374019966cc6 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:16.040733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e51f9d0-65cb-4e1a-9633-374019966cc6 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:16.043171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e51f9d0-65cb-4e1a-9633-374019966cc6 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:16.047129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e51f9d0-65cb-4e1a-9633-374019966cc6 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:16.048714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e51f9d0-65cb-4e1a-9633-374019966cc6 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:16.051845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e51f9d0-65cb-4e1a-9633-374019966cc6 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:16.054506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e51f9d0-65cb-4e1a-9633-374019966cc6 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:16.168263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-75c1133a-f18d-4591-ab3b-09ac108cf914 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:16.180135 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-75c1133a-f18d-4591-ab3b-09ac108cf914 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892" status: 200 len: 1307 microversion: 2.1 time: 0.963403 Sep 07 12:34:16.181029 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 705/1417] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:15 2022] GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892 => generated 1307 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:16.201617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a8fb5b0-ef64-4479-b4e8-f14406db1b36 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:16.202465 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4a8fb5b0-ef64-4479-b4e8-f14406db1b36 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:16.215774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a8fb5b0-ef64-4479-b4e8-f14406db1b36 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:16.216819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a8fb5b0-ef64-4479-b4e8-f14406db1b36 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:16.217758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a8fb5b0-ef64-4479-b4e8-f14406db1b36 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:16.218318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a8fb5b0-ef64-4479-b4e8-f14406db1b36 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:16.218823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a8fb5b0-ef64-4479-b4e8-f14406db1b36 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:16.219597 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a8fb5b0-ef64-4479-b4e8-f14406db1b36 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:16.553004 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1e51f9d0-65cb-4e1a-9633-374019966cc6 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:16.607342 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1e51f9d0-65cb-4e1a-9633-374019966cc6 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.601955 Sep 07 12:34:16.608508 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 713/1418] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:16 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:16.629402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bee2407d-acda-4791-8838-d0f3c8a3838b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:16.641233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bee2407d-acda-4791-8838-d0f3c8a3838b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:16.654168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4a8fb5b0-ef64-4479-b4e8-f14406db1b36 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:16.656116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bee2407d-acda-4791-8838-d0f3c8a3838b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:16.657018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bee2407d-acda-4791-8838-d0f3c8a3838b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:16.657857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bee2407d-acda-4791-8838-d0f3c8a3838b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:16.665546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bee2407d-acda-4791-8838-d0f3c8a3838b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:16.666432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bee2407d-acda-4791-8838-d0f3c8a3838b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:16.667268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bee2407d-acda-4791-8838-d0f3c8a3838b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:16.675201 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4a8fb5b0-ef64-4479-b4e8-f14406db1b36 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1716 microversion: 2.1 time: 0.477623 Sep 07 12:34:16.693652 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 706/1419] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:16 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1716 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:16.693652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0496f1dd-5046-467f-b54b-be66d2b77979 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:16.693652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0496f1dd-5046-467f-b54b-be66d2b77979 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:16.699147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0496f1dd-5046-467f-b54b-be66d2b77979 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:16.699655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0496f1dd-5046-467f-b54b-be66d2b77979 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:16.700104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0496f1dd-5046-467f-b54b-be66d2b77979 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:16.700835 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0496f1dd-5046-467f-b54b-be66d2b77979 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:16.701304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0496f1dd-5046-467f-b54b-be66d2b77979 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:16.703804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0496f1dd-5046-467f-b54b-be66d2b77979 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:16.896626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bee2407d-acda-4791-8838-d0f3c8a3838b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:16.914166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bee2407d-acda-4791-8838-d0f3c8a3838b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:16.917613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bee2407d-acda-4791-8838-d0f3c8a3838b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:16.925362 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bee2407d-acda-4791-8838-d0f3c8a3838b tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 0.315247 Sep 07 12:34:16.927318 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 714/1420] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:34:16 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:34:17.013367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e18e4f55-73aa-4a8c-923a-1febbd4efc20 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:17.014258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e18e4f55-73aa-4a8c-923a-1febbd4efc20 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:17.027343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e18e4f55-73aa-4a8c-923a-1febbd4efc20 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:17.032742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e18e4f55-73aa-4a8c-923a-1febbd4efc20 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:17.036530 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e18e4f55-73aa-4a8c-923a-1febbd4efc20 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:17.050716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e18e4f55-73aa-4a8c-923a-1febbd4efc20 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:17.051472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e18e4f55-73aa-4a8c-923a-1febbd4efc20 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:17.052205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e18e4f55-73aa-4a8c-923a-1febbd4efc20 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:17.140042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e18e4f55-73aa-4a8c-923a-1febbd4efc20 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:17.142780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e18e4f55-73aa-4a8c-923a-1febbd4efc20 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:17.143955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e18e4f55-73aa-4a8c-923a-1febbd4efc20 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:17.145021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-e18e4f55-73aa-4a8c-923a-1febbd4efc20 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lazy-loading 'fault' on Instance uuid 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:34:17.316912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e18e4f55-73aa-4a8c-923a-1febbd4efc20 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:17.364066 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e18e4f55-73aa-4a8c-923a-1febbd4efc20 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4" status: 200 len: 1308 microversion: 2.1 time: 0.355437 Sep 07 12:34:17.365102 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 715/1421] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:17 2022] GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 => generated 1308 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:17.375229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0496f1dd-5046-467f-b54b-be66d2b77979 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:17.378185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-59ccd9eb-d92f-4454-a23b-b5d1727f30c2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:17.378960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-59ccd9eb-d92f-4454-a23b-b5d1727f30c2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2f6ee92e-b663-4984-9198-d2ca0f8b3892] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:17.397814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59ccd9eb-d92f-4454-a23b-b5d1727f30c2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:17.398931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59ccd9eb-d92f-4454-a23b-b5d1727f30c2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:17.399790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59ccd9eb-d92f-4454-a23b-b5d1727f30c2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:17.401128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59ccd9eb-d92f-4454-a23b-b5d1727f30c2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:17.401342 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0496f1dd-5046-467f-b54b-be66d2b77979 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1473 microversion: 2.1 time: 0.719718 Sep 07 12:34:17.402303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59ccd9eb-d92f-4454-a23b-b5d1727f30c2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:17.402504 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 707/1422] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:16 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1473 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:17.403297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59ccd9eb-d92f-4454-a23b-b5d1727f30c2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:17.638848 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d5deb533-96dd-4f13-bd1e-5b9572db54eb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:17.651046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d5deb533-96dd-4f13-bd1e-5b9572db54eb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:17.673035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5deb533-96dd-4f13-bd1e-5b9572db54eb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:17.674130 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-59ccd9eb-d92f-4454-a23b-b5d1727f30c2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:17.675023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5deb533-96dd-4f13-bd1e-5b9572db54eb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:17.675023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5deb533-96dd-4f13-bd1e-5b9572db54eb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:17.676240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5deb533-96dd-4f13-bd1e-5b9572db54eb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:17.677087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5deb533-96dd-4f13-bd1e-5b9572db54eb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:17.677897 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5deb533-96dd-4f13-bd1e-5b9572db54eb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:17.700881 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-59ccd9eb-d92f-4454-a23b-b5d1727f30c2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892" status: 200 len: 1307 microversion: 2.1 time: 0.334175 Sep 07 12:34:17.702577 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 716/1423] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:17 2022] GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892 => generated 1307 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:17.725521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ebaa6c4d-ff6f-46ce-a75a-1b146587fd8b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:17.731093 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ebaa6c4d-ff6f-46ce-a75a-1b146587fd8b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:17.751447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebaa6c4d-ff6f-46ce-a75a-1b146587fd8b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:17.752177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebaa6c4d-ff6f-46ce-a75a-1b146587fd8b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:17.752909 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebaa6c4d-ff6f-46ce-a75a-1b146587fd8b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:17.754259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebaa6c4d-ff6f-46ce-a75a-1b146587fd8b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:17.755060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebaa6c4d-ff6f-46ce-a75a-1b146587fd8b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:17.755759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebaa6c4d-ff6f-46ce-a75a-1b146587fd8b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:18.038590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d5deb533-96dd-4f13-bd1e-5b9572db54eb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:18.067931 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d5deb533-96dd-4f13-bd1e-5b9572db54eb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.418821 Sep 07 12:34:18.087694 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 708/1424] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:17 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:34:18.095150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3158e1b-419b-483f-bf75-00e386222f6f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:18.095804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d3158e1b-419b-483f-bf75-00e386222f6f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:18.104136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3158e1b-419b-483f-bf75-00e386222f6f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:18.105138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3158e1b-419b-483f-bf75-00e386222f6f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:18.105978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3158e1b-419b-483f-bf75-00e386222f6f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:18.108431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3158e1b-419b-483f-bf75-00e386222f6f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:18.109347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3158e1b-419b-483f-bf75-00e386222f6f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:18.109859 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3158e1b-419b-483f-bf75-00e386222f6f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:18.206176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d3158e1b-419b-483f-bf75-00e386222f6f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:18.220583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ebaa6c4d-ff6f-46ce-a75a-1b146587fd8b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:18.221978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d3158e1b-419b-483f-bf75-00e386222f6f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:18.223519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d3158e1b-419b-483f-bf75-00e386222f6f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:18.229819 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d3158e1b-419b-483f-bf75-00e386222f6f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 0.140741 Sep 07 12:34:18.238436 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 709/1425] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:34:18 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:34:18.240426 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ebaa6c4d-ff6f-46ce-a75a-1b146587fd8b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1716 microversion: 2.1 time: 0.522364 Sep 07 12:34:18.241272 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 717/1426] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:17 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1716 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:34:18.293889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-92692060-0fd4-402a-a89b-a3899733aa77 req-cd3eeda2-d41e-4eb0-877e-085f2f3a858e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d12be6f4-80c9-404a-b6c4-d1e94e25daa9", "name": "network-vif-plugged", "status": "completed", "tag": "50b3c60a-51cc-4ed6-8a42-813229cfb0f8"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:34:18.307658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-92692060-0fd4-402a-a89b-a3899733aa77 req-cd3eeda2-d41e-4eb0-877e-085f2f3a858e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:18.308333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-92692060-0fd4-402a-a89b-a3899733aa77 req-cd3eeda2-d41e-4eb0-877e-085f2f3a858e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:18.308852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-92692060-0fd4-402a-a89b-a3899733aa77 req-cd3eeda2-d41e-4eb0-877e-085f2f3a858e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:18.327134 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-92692060-0fd4-402a-a89b-a3899733aa77 req-cd3eeda2-d41e-4eb0-877e-085f2f3a858e service nova] Creating event network-vif-plugged:50b3c60a-51cc-4ed6-8a42-813229cfb0f8 for instance d12be6f4-80c9-404a-b6c4-d1e94e25daa9 on n-h2-852087-9 Sep 07 12:34:18.336870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-92692060-0fd4-402a-a89b-a3899733aa77 req-cd3eeda2-d41e-4eb0-877e-085f2f3a858e service nova] Instance d12be6f4-80c9-404a-b6c4-d1e94e25daa9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 12:34:18.356983 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-92692060-0fd4-402a-a89b-a3899733aa77 req-cd3eeda2-d41e-4eb0-877e-085f2f3a858e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068434 Sep 07 12:34:18.358117 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 710/1427] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:18.412963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-47945e92-c63a-4c2f-a59f-518c1e7edd8e tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:18.413752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-47945e92-c63a-4c2f-a59f-518c1e7edd8e tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:18.422427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47945e92-c63a-4c2f-a59f-518c1e7edd8e tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:18.423281 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47945e92-c63a-4c2f-a59f-518c1e7edd8e tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:18.429008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47945e92-c63a-4c2f-a59f-518c1e7edd8e tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:18.430276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c9cd0811-7dbf-47aa-9e22-ed14b8f98010 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:18.431037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47945e92-c63a-4c2f-a59f-518c1e7edd8e tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:18.431439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47945e92-c63a-4c2f-a59f-518c1e7edd8e tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:18.431574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c9cd0811-7dbf-47aa-9e22-ed14b8f98010 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:18.432258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47945e92-c63a-4c2f-a59f-518c1e7edd8e tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:18.442026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9cd0811-7dbf-47aa-9e22-ed14b8f98010 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:18.442716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9cd0811-7dbf-47aa-9e22-ed14b8f98010 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:18.443318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9cd0811-7dbf-47aa-9e22-ed14b8f98010 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:18.444525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9cd0811-7dbf-47aa-9e22-ed14b8f98010 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:18.446200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9cd0811-7dbf-47aa-9e22-ed14b8f98010 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:18.447193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9cd0811-7dbf-47aa-9e22-ed14b8f98010 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:18.495052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47945e92-c63a-4c2f-a59f-518c1e7edd8e tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:18.495892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47945e92-c63a-4c2f-a59f-518c1e7edd8e tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:18.496621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47945e92-c63a-4c2f-a59f-518c1e7edd8e tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:18.497370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-47945e92-c63a-4c2f-a59f-518c1e7edd8e tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lazy-loading 'fault' on Instance uuid 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:34:18.573079 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-47945e92-c63a-4c2f-a59f-518c1e7edd8e tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:18.585931 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-47945e92-c63a-4c2f-a59f-518c1e7edd8e tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4" status: 200 len: 1308 microversion: 2.1 time: 0.186584 Sep 07 12:34:18.600773 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 718/1428] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:18 2022] GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 => generated 1308 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:34:18.675134 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c9cd0811-7dbf-47aa-9e22-ed14b8f98010 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:18.683590 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c9cd0811-7dbf-47aa-9e22-ed14b8f98010 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1470 microversion: 2.1 time: 0.258561 Sep 07 12:34:18.684190 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 711/1429] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:18 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1470 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:18.709664 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fb489ddb-22a7-4aa5-b19b-dbf28af5903d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:34:18.711130 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fb489ddb-22a7-4aa5-b19b-dbf28af5903d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:18.719417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb489ddb-22a7-4aa5-b19b-dbf28af5903d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:18.720336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb489ddb-22a7-4aa5-b19b-dbf28af5903d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:18.720828 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb489ddb-22a7-4aa5-b19b-dbf28af5903d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:18.721773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb489ddb-22a7-4aa5-b19b-dbf28af5903d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:18.722280 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb489ddb-22a7-4aa5-b19b-dbf28af5903d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:18.722868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb489ddb-22a7-4aa5-b19b-dbf28af5903d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:18.748409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-100917d3-9e39-4d24-a8c3-05e48e504fba tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:18.749328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-100917d3-9e39-4d24-a8c3-05e48e504fba tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2f6ee92e-b663-4984-9198-d2ca0f8b3892] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:18.757748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-100917d3-9e39-4d24-a8c3-05e48e504fba tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:18.758342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-100917d3-9e39-4d24-a8c3-05e48e504fba tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:18.758796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-100917d3-9e39-4d24-a8c3-05e48e504fba tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:18.759531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-100917d3-9e39-4d24-a8c3-05e48e504fba tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:18.759996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-100917d3-9e39-4d24-a8c3-05e48e504fba tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:18.760447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-100917d3-9e39-4d24-a8c3-05e48e504fba tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:18.985449 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fb489ddb-22a7-4aa5-b19b-dbf28af5903d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "POST /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9/action" status: 202 len: 0 microversion: 2.1 time: 0.279261 Sep 07 12:34:18.987495 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 719/1430] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:34:18 2022] POST /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 12:34:19.002090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-adb7cf9f-c2b3-43a1-823e-495f9edad0f7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:19.003532 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-adb7cf9f-c2b3-43a1-823e-495f9edad0f7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:19.015388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adb7cf9f-c2b3-43a1-823e-495f9edad0f7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:19.016060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adb7cf9f-c2b3-43a1-823e-495f9edad0f7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:19.016812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adb7cf9f-c2b3-43a1-823e-495f9edad0f7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:19.017823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adb7cf9f-c2b3-43a1-823e-495f9edad0f7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:19.018413 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adb7cf9f-c2b3-43a1-823e-495f9edad0f7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:19.018964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adb7cf9f-c2b3-43a1-823e-495f9edad0f7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:19.019710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-100917d3-9e39-4d24-a8c3-05e48e504fba tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:19.030944 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-100917d3-9e39-4d24-a8c3-05e48e504fba tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892" status: 200 len: 1486 microversion: 2.1 time: 0.287079 Sep 07 12:34:19.031699 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 712/1431] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:18 2022] GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892 => generated 1486 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:34:19.070554 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f8d2e3a0-44b6-4a46-ba9b-4ac507d6760b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:34:19.071319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f8d2e3a0-44b6-4a46-ba9b-4ac507d6760b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2f6ee92e-b663-4984-9198-d2ca0f8b3892] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:19.079498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8d2e3a0-44b6-4a46-ba9b-4ac507d6760b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:19.080275 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8d2e3a0-44b6-4a46-ba9b-4ac507d6760b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:19.080928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8d2e3a0-44b6-4a46-ba9b-4ac507d6760b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:19.081815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8d2e3a0-44b6-4a46-ba9b-4ac507d6760b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:19.082392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8d2e3a0-44b6-4a46-ba9b-4ac507d6760b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:19.082928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8d2e3a0-44b6-4a46-ba9b-4ac507d6760b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:19.162277 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:34:19.178268 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f8d2e3a0-44b6-4a46-ba9b-4ac507d6760b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "POST /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892/action" status: 202 len: 0 microversion: 2.1 time: 0.112745 Sep 07 12:34:19.183596 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 713/1432] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:34:19 2022] POST /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:34:19.188781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4f4b077b-aa8b-436c-a847-dfbd72f96c14 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:19.189591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4f4b077b-aa8b-436c-a847-dfbd72f96c14 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:19.196650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f4b077b-aa8b-436c-a847-dfbd72f96c14 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:19.197169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f4b077b-aa8b-436c-a847-dfbd72f96c14 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:19.197981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f4b077b-aa8b-436c-a847-dfbd72f96c14 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:19.199015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f4b077b-aa8b-436c-a847-dfbd72f96c14 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:19.199342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f4b077b-aa8b-436c-a847-dfbd72f96c14 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:19.199767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f4b077b-aa8b-436c-a847-dfbd72f96c14 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:19.207748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-adb7cf9f-c2b3-43a1-823e-495f9edad0f7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:19.216611 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-adb7cf9f-c2b3-43a1-823e-495f9edad0f7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1469 microversion: 2.1 time: 0.223425 Sep 07 12:34:19.217421 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 720/1433] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:18 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1469 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:34:19.224236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-12e36800-046d-4c4a-851e-7b93ef08701f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:19.225187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-12e36800-046d-4c4a-851e-7b93ef08701f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2f6ee92e-b663-4984-9198-d2ca0f8b3892] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:19.232656 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12e36800-046d-4c4a-851e-7b93ef08701f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:19.233440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12e36800-046d-4c4a-851e-7b93ef08701f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:19.235600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12e36800-046d-4c4a-851e-7b93ef08701f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:19.236921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12e36800-046d-4c4a-851e-7b93ef08701f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:19.237769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12e36800-046d-4c4a-851e-7b93ef08701f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:19.238372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12e36800-046d-4c4a-851e-7b93ef08701f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:19.595886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4f4b077b-aa8b-436c-a847-dfbd72f96c14 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:19.610396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-12e36800-046d-4c4a-851e-7b93ef08701f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:19.610677 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4f4b077b-aa8b-436c-a847-dfbd72f96c14 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.428921 Sep 07 12:34:19.611409 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 714/1434] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:19 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:19.620302 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-07c23138-8ae5-4890-a504-34f610aa655d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:19.621458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-07c23138-8ae5-4890-a504-34f610aa655d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:19.628621 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-12e36800-046d-4c4a-851e-7b93ef08701f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892" status: 200 len: 1491 microversion: 2.1 time: 0.409616 Sep 07 12:34:19.631313 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 721/1435] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:19 2022] GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892 => generated 1491 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:19.632660 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07c23138-8ae5-4890-a504-34f610aa655d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:19.633874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07c23138-8ae5-4890-a504-34f610aa655d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:19.634682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07c23138-8ae5-4890-a504-34f610aa655d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:19.636004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07c23138-8ae5-4890-a504-34f610aa655d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:19.636947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07c23138-8ae5-4890-a504-34f610aa655d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:19.637914 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07c23138-8ae5-4890-a504-34f610aa655d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:19.639880 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-14c36f24-abe7-4541-a5bf-5ed9b6e1b652 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:19.640796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-14c36f24-abe7-4541-a5bf-5ed9b6e1b652 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:19.648112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14c36f24-abe7-4541-a5bf-5ed9b6e1b652 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:19.649007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14c36f24-abe7-4541-a5bf-5ed9b6e1b652 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:19.649809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14c36f24-abe7-4541-a5bf-5ed9b6e1b652 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:19.650640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14c36f24-abe7-4541-a5bf-5ed9b6e1b652 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:19.651205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14c36f24-abe7-4541-a5bf-5ed9b6e1b652 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:19.651971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14c36f24-abe7-4541-a5bf-5ed9b6e1b652 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:19.805345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-07c23138-8ae5-4890-a504-34f610aa655d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:19.822829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-07c23138-8ae5-4890-a504-34f610aa655d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:19.825568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-07c23138-8ae5-4890-a504-34f610aa655d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:19.843177 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-07c23138-8ae5-4890-a504-34f610aa655d tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 0.230288 Sep 07 12:34:19.852634 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 715/1436] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:34:19 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:34:19.855313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d7ffb394-07a2-4681-b657-e15a2b24e0dd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:19.856594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d7ffb394-07a2-4681-b657-e15a2b24e0dd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:19.870330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7ffb394-07a2-4681-b657-e15a2b24e0dd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:19.872478 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7ffb394-07a2-4681-b657-e15a2b24e0dd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:19.874373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7ffb394-07a2-4681-b657-e15a2b24e0dd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:19.876552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7ffb394-07a2-4681-b657-e15a2b24e0dd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:19.877787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7ffb394-07a2-4681-b657-e15a2b24e0dd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:19.879242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7ffb394-07a2-4681-b657-e15a2b24e0dd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:19.943674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7ffb394-07a2-4681-b657-e15a2b24e0dd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:19.944306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7ffb394-07a2-4681-b657-e15a2b24e0dd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:19.944673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-14c36f24-abe7-4541-a5bf-5ed9b6e1b652 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:19.945477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7ffb394-07a2-4681-b657-e15a2b24e0dd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:19.945779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-d7ffb394-07a2-4681-b657-e15a2b24e0dd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lazy-loading 'fault' on Instance uuid 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:34:19.965003 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-14c36f24-abe7-4541-a5bf-5ed9b6e1b652 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1716 microversion: 2.1 time: 0.331589 Sep 07 12:34:19.966205 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 722/1437] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:19 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1716 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:20.008788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d7ffb394-07a2-4681-b657-e15a2b24e0dd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:20.019443 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d7ffb394-07a2-4681-b657-e15a2b24e0dd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4" status: 200 len: 1308 microversion: 2.1 time: 0.172644 Sep 07 12:34:20.020377 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 716/1438] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:19 2022] GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 => generated 1308 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:20.255096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8e6e3102-810b-4941-96f0-cd6002a3836f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:20.255855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8e6e3102-810b-4941-96f0-cd6002a3836f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:20.263096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e6e3102-810b-4941-96f0-cd6002a3836f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:20.263715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e6e3102-810b-4941-96f0-cd6002a3836f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:20.264240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e6e3102-810b-4941-96f0-cd6002a3836f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:20.265128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e6e3102-810b-4941-96f0-cd6002a3836f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:20.265713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e6e3102-810b-4941-96f0-cd6002a3836f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:20.266217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e6e3102-810b-4941-96f0-cd6002a3836f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:20.470136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8e6e3102-810b-4941-96f0-cd6002a3836f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:20.480437 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8e6e3102-810b-4941-96f0-cd6002a3836f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1469 microversion: 2.1 time: 0.229589 Sep 07 12:34:20.481070 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 723/1439] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:20 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1469 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:20.649204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4bd931c9-c06b-4013-b525-6ac8dd5a3c74 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:20.650151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4bd931c9-c06b-4013-b525-6ac8dd5a3c74 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:20.663535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ec6c2948-7ce6-415a-b8f3-2e60625e4278 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:20.664325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ec6c2948-7ce6-415a-b8f3-2e60625e4278 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2f6ee92e-b663-4984-9198-d2ca0f8b3892] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:20.669981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bd931c9-c06b-4013-b525-6ac8dd5a3c74 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:20.670504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bd931c9-c06b-4013-b525-6ac8dd5a3c74 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:20.670937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bd931c9-c06b-4013-b525-6ac8dd5a3c74 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:20.671679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bd931c9-c06b-4013-b525-6ac8dd5a3c74 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:20.672136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bd931c9-c06b-4013-b525-6ac8dd5a3c74 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:20.672564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bd931c9-c06b-4013-b525-6ac8dd5a3c74 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:20.691502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec6c2948-7ce6-415a-b8f3-2e60625e4278 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:20.691983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec6c2948-7ce6-415a-b8f3-2e60625e4278 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:20.692424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec6c2948-7ce6-415a-b8f3-2e60625e4278 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:20.693131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec6c2948-7ce6-415a-b8f3-2e60625e4278 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:20.693628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec6c2948-7ce6-415a-b8f3-2e60625e4278 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:20.694390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec6c2948-7ce6-415a-b8f3-2e60625e4278 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:20.923341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4bd931c9-c06b-4013-b525-6ac8dd5a3c74 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:20.933007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ec6c2948-7ce6-415a-b8f3-2e60625e4278 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:20.934695 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4bd931c9-c06b-4013-b525-6ac8dd5a3c74 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.289520 Sep 07 12:34:20.935798 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 717/1440] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:20 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:20.941136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c5317f2e-e189-476c-aa6c-26ee6cbe7442 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:20.941798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c5317f2e-e189-476c-aa6c-26ee6cbe7442 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:20.949073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5317f2e-e189-476c-aa6c-26ee6cbe7442 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:20.949642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5317f2e-e189-476c-aa6c-26ee6cbe7442 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:20.950096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5317f2e-e189-476c-aa6c-26ee6cbe7442 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:20.950838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5317f2e-e189-476c-aa6c-26ee6cbe7442 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:20.951311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5317f2e-e189-476c-aa6c-26ee6cbe7442 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:20.951900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5317f2e-e189-476c-aa6c-26ee6cbe7442 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:20.953702 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ec6c2948-7ce6-415a-b8f3-2e60625e4278 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892" status: 200 len: 1471 microversion: 2.1 time: 0.295365 Sep 07 12:34:20.955787 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 724/1441] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:20 2022] GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892 => generated 1471 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:20.983699 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-045d20a3-553f-46a6-be51-245c0e48d295 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1057640325"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:34:20.988320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-045d20a3-553f-46a6-be51-245c0e48d295 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2f6ee92e-b663-4984-9198-d2ca0f8b3892] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:20.999940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-045d20a3-553f-46a6-be51-245c0e48d295 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:21.000835 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-045d20a3-553f-46a6-be51-245c0e48d295 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:21.001605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-045d20a3-553f-46a6-be51-245c0e48d295 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:21.002847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-045d20a3-553f-46a6-be51-245c0e48d295 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:21.003920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-045d20a3-553f-46a6-be51-245c0e48d295 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:21.004600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-045d20a3-553f-46a6-be51-245c0e48d295 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:21.010452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:34:21.070258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c5317f2e-e189-476c-aa6c-26ee6cbe7442 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:21.088569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c5317f2e-e189-476c-aa6c-26ee6cbe7442 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:21.092311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c5317f2e-e189-476c-aa6c-26ee6cbe7442 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:21.105304 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c5317f2e-e189-476c-aa6c-26ee6cbe7442 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 0.168117 Sep 07 12:34:21.107220 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 718/1442] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:34:20 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:34:21.116840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8e96b275-d651-4923-bc16-2ddc2d28aaf3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:21.118541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8e96b275-d651-4923-bc16-2ddc2d28aaf3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:21.130363 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e96b275-d651-4923-bc16-2ddc2d28aaf3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:21.131637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e96b275-d651-4923-bc16-2ddc2d28aaf3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:21.132673 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e96b275-d651-4923-bc16-2ddc2d28aaf3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:21.134466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e96b275-d651-4923-bc16-2ddc2d28aaf3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:21.135916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e96b275-d651-4923-bc16-2ddc2d28aaf3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:21.137179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e96b275-d651-4923-bc16-2ddc2d28aaf3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:21.364775 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-045d20a3-553f-46a6-be51-245c0e48d295 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "POST /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892/action" status: 202 len: 0 microversion: 2.1 time: 0.389646 Sep 07 12:34:21.366253 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 725/1443] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:34:20 2022] POST /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 07 12:34:21.371035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd30cc75-e723-41a0-bfd0-1fabcc73217d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:21.371765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dd30cc75-e723-41a0-bfd0-1fabcc73217d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:21.374201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:34:21.385408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd30cc75-e723-41a0-bfd0-1fabcc73217d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:21.386488 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd30cc75-e723-41a0-bfd0-1fabcc73217d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:21.388973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd30cc75-e723-41a0-bfd0-1fabcc73217d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:21.391139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd30cc75-e723-41a0-bfd0-1fabcc73217d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:21.391758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd30cc75-e723-41a0-bfd0-1fabcc73217d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:21.392329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd30cc75-e723-41a0-bfd0-1fabcc73217d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:21.430318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8e96b275-d651-4923-bc16-2ddc2d28aaf3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:21.440104 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8e96b275-d651-4923-bc16-2ddc2d28aaf3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1706 microversion: 2.1 time: 0.330498 Sep 07 12:34:21.450121 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 719/1444] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:21 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1706 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:21.464554 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5d288a2e-ff7d-4aa4-bd22-ce9e79b1e3b3 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41d187160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:21.467251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd30cc75-e723-41a0-bfd0-1fabcc73217d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:21.468506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd30cc75-e723-41a0-bfd0-1fabcc73217d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:21.472114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd30cc75-e723-41a0-bfd0-1fabcc73217d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:21.485423 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-dd30cc75-e723-41a0-bfd0-1fabcc73217d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lazy-loading 'fault' on Instance uuid 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:34:21.546283 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5d288a2e-ff7d-4aa4-bd22-ce9e79b1e3b3 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60" status: 200 len: 1412 microversion: 2.1 time: 0.093085 Sep 07 12:34:21.547108 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 720/1445] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:34:21 2022] GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60 => generated 1412 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:21.556050 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-52662a6e-381f-4989-8501-cd65c3a52477 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Calling method '.version_select at 0x7fc41d190160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:21.563099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52662a6e-381f-4989-8501-cd65c3a52477 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:21.564795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52662a6e-381f-4989-8501-cd65c3a52477 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:21.565987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52662a6e-381f-4989-8501-cd65c3a52477 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:21.575953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dd30cc75-e723-41a0-bfd0-1fabcc73217d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:21.589171 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dd30cc75-e723-41a0-bfd0-1fabcc73217d tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4" status: 200 len: 1308 microversion: 2.1 time: 0.222110 Sep 07 12:34:21.591677 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 726/1446] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:21 2022] GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 => generated 1308 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:21.598072 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-52662a6e-381f-4989-8501-cd65c3a52477 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 3505 microversion: 2.1 time: 0.048790 Sep 07 12:34:21.607379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ee4ac34f-b632-42c7-ba62-8d963394896a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:21.607379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ee4ac34f-b632-42c7-ba62-8d963394896a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:21.607734 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 721/1447] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Sep 7 12:34:21 2022] GET /compute/v2.1/os-migrations => generated 3505 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:21.618078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee4ac34f-b632-42c7-ba62-8d963394896a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:21.618966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee4ac34f-b632-42c7-ba62-8d963394896a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:21.619747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee4ac34f-b632-42c7-ba62-8d963394896a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:21.621047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee4ac34f-b632-42c7-ba62-8d963394896a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:21.622886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee4ac34f-b632-42c7-ba62-8d963394896a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:21.623714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee4ac34f-b632-42c7-ba62-8d963394896a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:21.630549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9670253d-be06-487d-8bb1-79e3efbfc741 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:21.632805 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9670253d-be06-487d-8bb1-79e3efbfc741 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:21.645119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9670253d-be06-487d-8bb1-79e3efbfc741 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:21.646516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9670253d-be06-487d-8bb1-79e3efbfc741 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:21.647346 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9670253d-be06-487d-8bb1-79e3efbfc741 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:21.648719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9670253d-be06-487d-8bb1-79e3efbfc741 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:21.649667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9670253d-be06-487d-8bb1-79e3efbfc741 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:21.650766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9670253d-be06-487d-8bb1-79e3efbfc741 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:21.890035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ee4ac34f-b632-42c7-ba62-8d963394896a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:21.904556 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ee4ac34f-b632-42c7-ba62-8d963394896a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1469 microversion: 2.1 time: 0.309732 Sep 07 12:34:21.905011 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9670253d-be06-487d-8bb1-79e3efbfc741 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1857 microversion: 2.1 time: 0.280892 Sep 07 12:34:21.905819 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 727/1448] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:21 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1469 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:21.906893 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 722/1449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:21 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1857 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:21.932144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-476be35d-b9ad-428d-9fde-bf3dc408ace3 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:21.932826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-476be35d-b9ad-428d-9fde-bf3dc408ace3 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:21.939687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-476be35d-b9ad-428d-9fde-bf3dc408ace3 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:21.940217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-476be35d-b9ad-428d-9fde-bf3dc408ace3 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:21.940779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-476be35d-b9ad-428d-9fde-bf3dc408ace3 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:21.941658 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-476be35d-b9ad-428d-9fde-bf3dc408ace3 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:21.942215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-476be35d-b9ad-428d-9fde-bf3dc408ace3 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:21.942750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-476be35d-b9ad-428d-9fde-bf3dc408ace3 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:21.981988 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7fabb761-2c2a-4864-bd69-30f114bce098 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:21.983088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7fabb761-2c2a-4864-bd69-30f114bce098 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:21.992024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7fabb761-2c2a-4864-bd69-30f114bce098 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:21.992918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7fabb761-2c2a-4864-bd69-30f114bce098 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:21.993766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7fabb761-2c2a-4864-bd69-30f114bce098 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:21.995238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7fabb761-2c2a-4864-bd69-30f114bce098 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:21.996136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7fabb761-2c2a-4864-bd69-30f114bce098 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:21.996932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7fabb761-2c2a-4864-bd69-30f114bce098 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:22.179469 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-476be35d-b9ad-428d-9fde-bf3dc408ace3 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1857 microversion: 2.1 time: 0.251243 Sep 07 12:34:22.193534 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 728/1450] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:21 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1857 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:22.193534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-37bd2c61-8bb5-4362-9f94-09a38a7c52d8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:22.193534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-37bd2c61-8bb5-4362-9f94-09a38a7c52d8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:22.204621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37bd2c61-8bb5-4362-9f94-09a38a7c52d8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:22.206185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37bd2c61-8bb5-4362-9f94-09a38a7c52d8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:22.206929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37bd2c61-8bb5-4362-9f94-09a38a7c52d8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:22.208332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37bd2c61-8bb5-4362-9f94-09a38a7c52d8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:22.209231 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37bd2c61-8bb5-4362-9f94-09a38a7c52d8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:22.210103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37bd2c61-8bb5-4362-9f94-09a38a7c52d8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:22.217125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7fabb761-2c2a-4864-bd69-30f114bce098 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:22.241047 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7fabb761-2c2a-4864-bd69-30f114bce098 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.266008 Sep 07 12:34:22.242775 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 723/1451] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:21 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:34:22.303805 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ad73f97-48bf-4f7e-90bf-75d91e3a4167 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:22.304499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4ad73f97-48bf-4f7e-90bf-75d91e3a4167 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:22.311446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ad73f97-48bf-4f7e-90bf-75d91e3a4167 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:22.311946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ad73f97-48bf-4f7e-90bf-75d91e3a4167 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:22.312386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ad73f97-48bf-4f7e-90bf-75d91e3a4167 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:22.313123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ad73f97-48bf-4f7e-90bf-75d91e3a4167 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:22.313634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ad73f97-48bf-4f7e-90bf-75d91e3a4167 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:22.314070 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ad73f97-48bf-4f7e-90bf-75d91e3a4167 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:22.323914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37bd2c61-8bb5-4362-9f94-09a38a7c52d8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:22.333884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37bd2c61-8bb5-4362-9f94-09a38a7c52d8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:22.335659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37bd2c61-8bb5-4362-9f94-09a38a7c52d8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:22.341882 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-37bd2c61-8bb5-4362-9f94-09a38a7c52d8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 0.159096 Sep 07 12:34:22.342482 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 729/1452] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:34:22 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:34:22.420452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-4ad73f97-48bf-4f7e-90bf-75d91e3a4167 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lazy-loading 'services' on Instance uuid 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:34:22.518473 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ad73f97-48bf-4f7e-90bf-75d91e3a4167 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-volume_attachments/f1545ae2-46de-4ccf-bcc2-86d62580a2a9" status: 202 len: 0 microversion: 2.1 time: 0.218969 Sep 07 12:34:22.519332 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 724/1453] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Sep 7 12:34:22 2022] DELETE /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-volume_attachments/f1545ae2-46de-4ccf-bcc2-86d62580a2a9 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 12:34:22.528814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-341a7657-643e-452e-a684-d32cb227e3bc tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:22.531394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-341a7657-643e-452e-a684-d32cb227e3bc tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:22.538793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-341a7657-643e-452e-a684-d32cb227e3bc tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:22.539353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-341a7657-643e-452e-a684-d32cb227e3bc tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:22.539919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-341a7657-643e-452e-a684-d32cb227e3bc tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:22.540773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-341a7657-643e-452e-a684-d32cb227e3bc tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:22.541341 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-341a7657-643e-452e-a684-d32cb227e3bc tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:22.542031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-341a7657-643e-452e-a684-d32cb227e3bc tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:22.570969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9c4c79c0-1154-44a3-a265-90f7b14124e2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41d10ac10>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:22.577880 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-341a7657-643e-452e-a684-d32cb227e3bc tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053117 Sep 07 12:34:22.578610 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 730/1454] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:34:22 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:22.615932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-09f057fc-4cb1-4cbd-8d7c-0f942d2bd868 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:22.616567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-09f057fc-4cb1-4cbd-8d7c-0f942d2bd868 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:22.623797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09f057fc-4cb1-4cbd-8d7c-0f942d2bd868 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:22.624461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09f057fc-4cb1-4cbd-8d7c-0f942d2bd868 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:22.624890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09f057fc-4cb1-4cbd-8d7c-0f942d2bd868 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:22.626092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09f057fc-4cb1-4cbd-8d7c-0f942d2bd868 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:22.626525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09f057fc-4cb1-4cbd-8d7c-0f942d2bd868 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:22.627062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09f057fc-4cb1-4cbd-8d7c-0f942d2bd868 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:22.630008 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9c4c79c0-1154-44a3-a265-90f7b14124e2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60" status: 200 len: 1412 microversion: 2.1 time: 0.063412 Sep 07 12:34:22.630984 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 725/1455] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:34:22 2022] GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60 => generated 1412 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:22.663749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09f057fc-4cb1-4cbd-8d7c-0f942d2bd868 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:22.664143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09f057fc-4cb1-4cbd-8d7c-0f942d2bd868 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:22.664585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09f057fc-4cb1-4cbd-8d7c-0f942d2bd868 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:22.665082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-09f057fc-4cb1-4cbd-8d7c-0f942d2bd868 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lazy-loading 'fault' on Instance uuid 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:34:22.711572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-09f057fc-4cb1-4cbd-8d7c-0f942d2bd868 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:22.726335 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-09f057fc-4cb1-4cbd-8d7c-0f942d2bd868 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4" status: 200 len: 1308 microversion: 2.1 time: 0.114485 Sep 07 12:34:22.727543 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 731/1456] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:22 2022] GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 => generated 1308 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:34:22.931482 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c82afeeb-3e90-4e1d-bf49-d8e273923778 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:22.932135 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c82afeeb-3e90-4e1d-bf49-d8e273923778 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:22.939226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c82afeeb-3e90-4e1d-bf49-d8e273923778 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:22.939709 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c82afeeb-3e90-4e1d-bf49-d8e273923778 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:22.940168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c82afeeb-3e90-4e1d-bf49-d8e273923778 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:22.940918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c82afeeb-3e90-4e1d-bf49-d8e273923778 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:22.941374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c82afeeb-3e90-4e1d-bf49-d8e273923778 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:22.941862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c82afeeb-3e90-4e1d-bf49-d8e273923778 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:23.111121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c82afeeb-3e90-4e1d-bf49-d8e273923778 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:23.125520 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c82afeeb-3e90-4e1d-bf49-d8e273923778 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1469 microversion: 2.1 time: 0.198463 Sep 07 12:34:23.126578 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 726/1457] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:22 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1469 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:23.288504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-64763bd7-d1d8-4efd-8f72-440c539d34b9 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:23.289162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-64763bd7-d1d8-4efd-8f72-440c539d34b9 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:23.298304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64763bd7-d1d8-4efd-8f72-440c539d34b9 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:23.298824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64763bd7-d1d8-4efd-8f72-440c539d34b9 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:23.299265 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64763bd7-d1d8-4efd-8f72-440c539d34b9 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:23.300054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64763bd7-d1d8-4efd-8f72-440c539d34b9 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:23.300536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64763bd7-d1d8-4efd-8f72-440c539d34b9 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:23.300968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64763bd7-d1d8-4efd-8f72-440c539d34b9 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:23.375529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-19be5ad2-1d5f-41fc-b09c-b674c06485bb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:23.376715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-19be5ad2-1d5f-41fc-b09c-b674c06485bb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:23.388327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19be5ad2-1d5f-41fc-b09c-b674c06485bb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:23.389162 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19be5ad2-1d5f-41fc-b09c-b674c06485bb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:23.390025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19be5ad2-1d5f-41fc-b09c-b674c06485bb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:23.391339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19be5ad2-1d5f-41fc-b09c-b674c06485bb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:23.392198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19be5ad2-1d5f-41fc-b09c-b674c06485bb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:23.392972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19be5ad2-1d5f-41fc-b09c-b674c06485bb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:23.489014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-64763bd7-d1d8-4efd-8f72-440c539d34b9 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:23.499287 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-64763bd7-d1d8-4efd-8f72-440c539d34b9 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.214874 Sep 07 12:34:23.500019 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 732/1458] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:23 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:23.518617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-19be5ad2-1d5f-41fc-b09c-b674c06485bb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:23.528175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-19be5ad2-1d5f-41fc-b09c-b674c06485bb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:23.529658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-19be5ad2-1d5f-41fc-b09c-b674c06485bb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:23.535274 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-19be5ad2-1d5f-41fc-b09c-b674c06485bb tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 0.167976 Sep 07 12:34:23.535864 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 727/1459] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:34:23 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:34:23.594222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-25aa22b5-0c9f-4257-9f22-31e93540a672 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:23.596610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-25aa22b5-0c9f-4257-9f22-31e93540a672 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:23.604141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25aa22b5-0c9f-4257-9f22-31e93540a672 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:23.604732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25aa22b5-0c9f-4257-9f22-31e93540a672 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:23.605255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25aa22b5-0c9f-4257-9f22-31e93540a672 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:23.606042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25aa22b5-0c9f-4257-9f22-31e93540a672 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:23.606876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25aa22b5-0c9f-4257-9f22-31e93540a672 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:23.607372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25aa22b5-0c9f-4257-9f22-31e93540a672 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:23.642062 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-25aa22b5-0c9f-4257-9f22-31e93540a672 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053055 Sep 07 12:34:23.642819 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 733/1460] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:34:23 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:23.652200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0fc29daa-9a63-4262-897c-b368494e7f1a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41d2d3dc0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:23.706617 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0fc29daa-9a63-4262-897c-b368494e7f1a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60" status: 200 len: 1412 microversion: 2.1 time: 0.058863 Sep 07 12:34:23.707215 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 728/1461] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:34:23 2022] GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60 => generated 1412 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:34:23.761613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7fa175bd-2a3a-4e7c-91a4-71e23e916df2 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:23.762267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7fa175bd-2a3a-4e7c-91a4-71e23e916df2 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:23.769402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fa175bd-2a3a-4e7c-91a4-71e23e916df2 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:23.770097 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fa175bd-2a3a-4e7c-91a4-71e23e916df2 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:23.770542 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fa175bd-2a3a-4e7c-91a4-71e23e916df2 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:23.771275 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fa175bd-2a3a-4e7c-91a4-71e23e916df2 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:23.771727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fa175bd-2a3a-4e7c-91a4-71e23e916df2 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:23.772169 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fa175bd-2a3a-4e7c-91a4-71e23e916df2 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:23.808321 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fa175bd-2a3a-4e7c-91a4-71e23e916df2 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:23.808807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fa175bd-2a3a-4e7c-91a4-71e23e916df2 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:23.809228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fa175bd-2a3a-4e7c-91a4-71e23e916df2 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:23.809738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-7fa175bd-2a3a-4e7c-91a4-71e23e916df2 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lazy-loading 'fault' on Instance uuid 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:34:23.856083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7fa175bd-2a3a-4e7c-91a4-71e23e916df2 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:23.864549 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7fa175bd-2a3a-4e7c-91a4-71e23e916df2 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4" status: 200 len: 1308 microversion: 2.1 time: 0.107225 Sep 07 12:34:23.865147 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 734/1462] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:23 2022] GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:24.155513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-217d3b5e-a57e-4727-9b7f-79d4e71512f3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:24.156227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-217d3b5e-a57e-4727-9b7f-79d4e71512f3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:24.164131 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-217d3b5e-a57e-4727-9b7f-79d4e71512f3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:24.164637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-217d3b5e-a57e-4727-9b7f-79d4e71512f3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:24.165081 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-217d3b5e-a57e-4727-9b7f-79d4e71512f3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:24.165844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-217d3b5e-a57e-4727-9b7f-79d4e71512f3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:24.166295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-217d3b5e-a57e-4727-9b7f-79d4e71512f3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:24.166725 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-217d3b5e-a57e-4727-9b7f-79d4e71512f3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:24.503845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-217d3b5e-a57e-4727-9b7f-79d4e71512f3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:24.512961 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-217d3b5e-a57e-4727-9b7f-79d4e71512f3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1469 microversion: 2.1 time: 0.362444 Sep 07 12:34:24.513634 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 729/1463] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:24 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1469 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:24.533523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-be87976d-328b-498d-bd96-9a16d9eb0588 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:24.534162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-be87976d-328b-498d-bd96-9a16d9eb0588 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:24.541757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be87976d-328b-498d-bd96-9a16d9eb0588 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:24.542399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be87976d-328b-498d-bd96-9a16d9eb0588 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:24.542856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be87976d-328b-498d-bd96-9a16d9eb0588 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:24.543588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be87976d-328b-498d-bd96-9a16d9eb0588 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:24.544048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be87976d-328b-498d-bd96-9a16d9eb0588 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:24.544475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be87976d-328b-498d-bd96-9a16d9eb0588 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:24.565215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-da07ba04-8c5d-404f-b4e6-697cdc4cec9a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:24.566418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-da07ba04-8c5d-404f-b4e6-697cdc4cec9a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:24.575192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da07ba04-8c5d-404f-b4e6-697cdc4cec9a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:24.575869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da07ba04-8c5d-404f-b4e6-697cdc4cec9a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:24.576527 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da07ba04-8c5d-404f-b4e6-697cdc4cec9a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:24.577416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da07ba04-8c5d-404f-b4e6-697cdc4cec9a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:24.578110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da07ba04-8c5d-404f-b4e6-697cdc4cec9a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:24.578665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da07ba04-8c5d-404f-b4e6-697cdc4cec9a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:24.674313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da07ba04-8c5d-404f-b4e6-697cdc4cec9a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:24.684432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da07ba04-8c5d-404f-b4e6-697cdc4cec9a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:24.685974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da07ba04-8c5d-404f-b4e6-697cdc4cec9a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:24.692324 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-da07ba04-8c5d-404f-b4e6-697cdc4cec9a tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 0.132575 Sep 07 12:34:24.693267 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 730/1464] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:34:24 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:34:24.698412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-92cab2b6-cd26-447d-98d7-1c696df4ae35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:24.700812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-92cab2b6-cd26-447d-98d7-1c696df4ae35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:24.707677 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92cab2b6-cd26-447d-98d7-1c696df4ae35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:24.708252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92cab2b6-cd26-447d-98d7-1c696df4ae35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:24.708687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92cab2b6-cd26-447d-98d7-1c696df4ae35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:24.709530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92cab2b6-cd26-447d-98d7-1c696df4ae35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:24.709969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92cab2b6-cd26-447d-98d7-1c696df4ae35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:24.710392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92cab2b6-cd26-447d-98d7-1c696df4ae35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:24.758098 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-92cab2b6-cd26-447d-98d7-1c696df4ae35 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063914 Sep 07 12:34:24.758706 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 731/1465] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:34:24 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:24.763992 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9ffe1011-7cdd-4d54-acbb-2854bbebc131 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41d328a60>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:24.784004 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-be87976d-328b-498d-bd96-9a16d9eb0588 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:24.794516 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-be87976d-328b-498d-bd96-9a16d9eb0588 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.266329 Sep 07 12:34:24.795408 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 735/1466] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:24 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:24.819860 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9ffe1011-7cdd-4d54-acbb-2854bbebc131 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60" status: 200 len: 1412 microversion: 2.1 time: 0.060037 Sep 07 12:34:24.820703 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 732/1467] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:34:24 2022] GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60 => generated 1412 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:24.891190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-75497775-6450-4c4e-917b-7155d509c569 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:24.891190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-75497775-6450-4c4e-917b-7155d509c569 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:24.900444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75497775-6450-4c4e-917b-7155d509c569 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:24.902000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75497775-6450-4c4e-917b-7155d509c569 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:24.902984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75497775-6450-4c4e-917b-7155d509c569 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:24.904617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75497775-6450-4c4e-917b-7155d509c569 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:24.906793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75497775-6450-4c4e-917b-7155d509c569 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:24.907586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75497775-6450-4c4e-917b-7155d509c569 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:24.935541 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-75497775-6450-4c4e-917b-7155d509c569 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] HTTP exception thrown: Instance 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 could not be found. Sep 07 12:34:24.938586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-75497775-6450-4c4e-917b-7155d509c569 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Request method failure captured: Sep 07 12:34:24.938586 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 HTTP/1.1 Sep 07 12:34:24.938586 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:34:24.938586 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:34:24.938586 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:34:24.938586 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:34:24.938586 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:34:24.938586 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:34:24.938586 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:34:24.938586 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:34:24.938586 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI7a_SgfvazlsNUq8Ml3ORQ8zQ7SG_06Ln9QYLqwP2kD_ySXSJRWhGGwUntP2NyCRHjBetp_HnNYddQs2DUhXPVwhy2lhcUSnaxjdHoOJGs2X9PvTlBBZPzREoU-_0gYtmg8EYu-HrVFymBMICNiui6mb3pJGLgRsnea0_M2EpBlB9Y Sep 07 12:34:24.938586 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:34:24.938586 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:34:24.938586 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:34:24.938586 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:34:24.938586 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:34:24.938586 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:34:24.938586 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 6c950a615d6a4b67a93a60f7969b6e6e Sep 07 12:34:24.938586 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-VolumesAdminNegativeTest-211770377 Sep 07 12:34:24.938586 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:34:24.938586 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:34:24.940202 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6c950a615d6a4b67a93a60f7969b6e6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6c950a615d6a4b67a93a60f7969b6e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6c950a615d6a4b67a93a60f7969b6e6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6c950a615d6a4b67a93a60f7969b6e6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:34:24.940202 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-VolumesAdminNegativeTest-211770377 Sep 07 12:34:24.940202 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 6c950a615d6a4b67a93a60f7969b6e6e Sep 07 12:34:24.940202 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-211770377 Sep 07 12:34:24.940202 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-VolumesAdminNegativeTest-211770377-project Sep 07 12:34:24.940202 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:34:24.940202 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:34:24.940202 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 239d71c912c749e7afe0f791db5c18f9 Sep 07 12:34:24.940202 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-VolumesAdminNegativeTest-211770377-project Sep 07 12:34:24.940202 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:34:24.940202 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 could not be found. Sep 07 12:34:24.940202 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '6f8cd2a9-2d75-4dee-b17d-434f35f15ba4'} Sep 07 12:34:24.941011 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:34:24.941011 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:34:24.941011 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:34:24.941011 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:34:24.941011 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:34:24.941011 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:34:24.941011 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:34:24.941011 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:34:24.941011 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:34:24.941011 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:34:24.941011 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 could not be found. Sep 07 12:34:24.941011 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:34:24.941011 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:34:24.941011 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:34:24.941011 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:34:24.941011 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:34:24.941011 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:34:24.941011 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:34:24.941011 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:34:24.941011 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:34:24.943192 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:34:24.943192 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:34:24.943192 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:34:24.943192 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:34:24.943192 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:34:24.943192 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:34:24.943192 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:34:24.943192 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 could not be found. Sep 07 12:34:24.943192 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:34:24.943192 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:34:24.943192 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:34:24.943192 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:34:24.943192 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:34:24.943192 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:34:24.943192 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:34:24.943192 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:34:24.943192 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 could not be found. Sep 07 12:34:24.943192 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:34:24.945787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-75497775-6450-4c4e-917b-7155d509c569 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Returning 404 to user: Instance 6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:34:24.945787 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-75497775-6450-4c4e-917b-7155d509c569 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4" status: 404 len: 111 microversion: 2.1 time: 0.055878 Sep 07 12:34:24.945787 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 736/1468] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:24 2022] GET /compute/v2.1/servers/6f8cd2a9-2d75-4dee-b17d-434f35f15ba4 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:34:25.545417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c3644e8f-f4f5-47c6-bd37-c870761b028f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:25.549912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c3644e8f-f4f5-47c6-bd37-c870761b028f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:25.571803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3644e8f-f4f5-47c6-bd37-c870761b028f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:25.572746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3644e8f-f4f5-47c6-bd37-c870761b028f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:25.576966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3644e8f-f4f5-47c6-bd37-c870761b028f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:25.577784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3644e8f-f4f5-47c6-bd37-c870761b028f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:25.578538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3644e8f-f4f5-47c6-bd37-c870761b028f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:25.578989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3644e8f-f4f5-47c6-bd37-c870761b028f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:25.725129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d2d5c1a3-944f-4aa9-923c-61f8f240c66c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:25.726823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d2d5c1a3-944f-4aa9-923c-61f8f240c66c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:25.755890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2d5c1a3-944f-4aa9-923c-61f8f240c66c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:25.757056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2d5c1a3-944f-4aa9-923c-61f8f240c66c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:25.758431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2d5c1a3-944f-4aa9-923c-61f8f240c66c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:25.760058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2d5c1a3-944f-4aa9-923c-61f8f240c66c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:25.761274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2d5c1a3-944f-4aa9-923c-61f8f240c66c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:25.762548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2d5c1a3-944f-4aa9-923c-61f8f240c66c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:25.812659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c3644e8f-f4f5-47c6-bd37-c870761b028f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:25.829522 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c3644e8f-f4f5-47c6-bd37-c870761b028f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1469 microversion: 2.1 time: 0.292917 Sep 07 12:34:25.839437 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 733/1469] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:25 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1469 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:25.839437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3fba42ea-736b-4d06-b359-acc0ea726ed8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:25.839972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3fba42ea-736b-4d06-b359-acc0ea726ed8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:25.856710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fba42ea-736b-4d06-b359-acc0ea726ed8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:25.857838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fba42ea-736b-4d06-b359-acc0ea726ed8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:25.858557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fba42ea-736b-4d06-b359-acc0ea726ed8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:25.859575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fba42ea-736b-4d06-b359-acc0ea726ed8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:25.860281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fba42ea-736b-4d06-b359-acc0ea726ed8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:25.861056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fba42ea-736b-4d06-b359-acc0ea726ed8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:25.866468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=98 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:34:25.901680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d2d5c1a3-944f-4aa9-923c-61f8f240c66c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:25.913121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d2d5c1a3-944f-4aa9-923c-61f8f240c66c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:25.914715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d2d5c1a3-944f-4aa9-923c-61f8f240c66c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:25.924578 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d2d5c1a3-944f-4aa9-923c-61f8f240c66c tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1544 microversion: 2.91 time: 0.205197 Sep 07 12:34:25.931266 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 737/1470] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:34:25 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1544 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:34:25.934042 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3fba42ea-736b-4d06-b359-acc0ea726ed8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102422 Sep 07 12:34:25.934700 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 734/1471] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:34:25 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:25.938694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3d453bfc-c44b-459d-86a0-0726c6d89f7e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:25.939650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3d453bfc-c44b-459d-86a0-0726c6d89f7e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:25.946655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e1b731ff-3f87-49fd-8854-eee85ccf8b5b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41d2d3160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:25.952048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d453bfc-c44b-459d-86a0-0726c6d89f7e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:25.952908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d453bfc-c44b-459d-86a0-0726c6d89f7e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:25.953714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d453bfc-c44b-459d-86a0-0726c6d89f7e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:25.955060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d453bfc-c44b-459d-86a0-0726c6d89f7e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:25.956464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d453bfc-c44b-459d-86a0-0726c6d89f7e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:25.957604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d453bfc-c44b-459d-86a0-0726c6d89f7e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:26.002712 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e1b731ff-3f87-49fd-8854-eee85ccf8b5b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60" status: 200 len: 1412 microversion: 2.1 time: 0.066810 Sep 07 12:34:26.003317 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 735/1472] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:34:25 2022] GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60 => generated 1412 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:26.698341 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3d453bfc-c44b-459d-86a0-0726c6d89f7e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:26.738195 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3d453bfc-c44b-459d-86a0-0726c6d89f7e tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.794046 Sep 07 12:34:26.741506 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 738/1473] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:25 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:26.873843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-71cadec0-251b-4612-996c-20719795bd68 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:26.874741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-71cadec0-251b-4612-996c-20719795bd68 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:26.890916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71cadec0-251b-4612-996c-20719795bd68 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:26.891438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71cadec0-251b-4612-996c-20719795bd68 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:26.899303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71cadec0-251b-4612-996c-20719795bd68 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:26.900851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71cadec0-251b-4612-996c-20719795bd68 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:26.901786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71cadec0-251b-4612-996c-20719795bd68 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:26.902609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71cadec0-251b-4612-996c-20719795bd68 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:26.968031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-305313ae-4c20-49fa-a169-a607ff018caa tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:26.972732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-305313ae-4c20-49fa-a169-a607ff018caa tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:26.986166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-305313ae-4c20-49fa-a169-a607ff018caa tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:26.987583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-305313ae-4c20-49fa-a169-a607ff018caa tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:26.988861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-305313ae-4c20-49fa-a169-a607ff018caa tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:26.990513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-305313ae-4c20-49fa-a169-a607ff018caa tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:27.002537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-305313ae-4c20-49fa-a169-a607ff018caa tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:27.003359 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-305313ae-4c20-49fa-a169-a607ff018caa tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:27.070692 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-305313ae-4c20-49fa-a169-a607ff018caa tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124583 Sep 07 12:34:27.072948 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 739/1474] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:34:26 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:27.089183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-48e0f4e1-0219-457a-8e90-8d49cbb8772f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:27.090753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-48e0f4e1-0219-457a-8e90-8d49cbb8772f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:27.106302 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48e0f4e1-0219-457a-8e90-8d49cbb8772f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:27.107862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48e0f4e1-0219-457a-8e90-8d49cbb8772f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:27.110552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48e0f4e1-0219-457a-8e90-8d49cbb8772f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:27.113908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48e0f4e1-0219-457a-8e90-8d49cbb8772f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:27.115466 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48e0f4e1-0219-457a-8e90-8d49cbb8772f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:27.116615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48e0f4e1-0219-457a-8e90-8d49cbb8772f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:27.156196 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-71cadec0-251b-4612-996c-20719795bd68 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:27.177289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:34:27.198337 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-71cadec0-251b-4612-996c-20719795bd68 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1469 microversion: 2.1 time: 0.312171 Sep 07 12:34:27.199395 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 736/1475] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:26 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1469 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:34:27.239331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-993a5746-68a7-45a6-8dca-6c7417cefa9c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41d3289d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:27.256688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-48e0f4e1-0219-457a-8e90-8d49cbb8772f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:27.274162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-48e0f4e1-0219-457a-8e90-8d49cbb8772f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:27.278892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-48e0f4e1-0219-457a-8e90-8d49cbb8772f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:27.291137 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-48e0f4e1-0219-457a-8e90-8d49cbb8772f tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1531 microversion: 2.91 time: 0.215831 Sep 07 12:34:27.307186 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 740/1476] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:34:27 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1531 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:34:27.329723 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-993a5746-68a7-45a6-8dca-6c7417cefa9c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60" status: 200 len: 1412 microversion: 2.1 time: 0.121272 Sep 07 12:34:27.331213 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 737/1477] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:34:27 2022] GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60 => generated 1412 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:27.351205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-64ea4b46-5e69-4436-8f76-44c5ca33c5a2 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:27.352666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-64ea4b46-5e69-4436-8f76-44c5ca33c5a2 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:27.364744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64ea4b46-5e69-4436-8f76-44c5ca33c5a2 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:27.365966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64ea4b46-5e69-4436-8f76-44c5ca33c5a2 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:27.367131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64ea4b46-5e69-4436-8f76-44c5ca33c5a2 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:27.369697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64ea4b46-5e69-4436-8f76-44c5ca33c5a2 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:27.370862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64ea4b46-5e69-4436-8f76-44c5ca33c5a2 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:27.371810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64ea4b46-5e69-4436-8f76-44c5ca33c5a2 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:27.520057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-64ea4b46-5e69-4436-8f76-44c5ca33c5a2 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] Lazy-loading 'services' on Instance uuid b8038c3c-8b64-4a94-84ad-41654d2d53ca {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:34:27.542007 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-64ea4b46-5e69-4436-8f76-44c5ca33c5a2 tempest-UnshelveToHostMultiNodesTest-820604981 tempest-UnshelveToHostMultiNodesTest-820604981-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1936 microversion: 2.91 time: 0.198771 Sep 07 12:34:27.543222 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 741/1478] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:34:27 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1936 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:34:27.602299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e685489c-7b13-40f0-972c-d290911241ef tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:27.603211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e685489c-7b13-40f0-972c-d290911241ef tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:27.611164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e685489c-7b13-40f0-972c-d290911241ef tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:27.612393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e685489c-7b13-40f0-972c-d290911241ef tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:27.613134 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e685489c-7b13-40f0-972c-d290911241ef tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:27.614151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e685489c-7b13-40f0-972c-d290911241ef tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:27.614921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e685489c-7b13-40f0-972c-d290911241ef tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:27.615583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e685489c-7b13-40f0-972c-d290911241ef tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:27.649204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e685489c-7b13-40f0-972c-d290911241ef tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:34:27.778950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd99bccc-eb0e-4a70-af1c-02b2b167a071 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:27.780552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:34:27.785346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dd99bccc-eb0e-4a70-af1c-02b2b167a071 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:27.790768 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e685489c-7b13-40f0-972c-d290911241ef tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 204 len: 0 microversion: 2.91 time: 0.194534 Sep 07 12:34:27.798270 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 738/1479] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 12:34:27 2022] DELETE /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 07 12:34:27.800178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd99bccc-eb0e-4a70-af1c-02b2b167a071 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:27.800735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd99bccc-eb0e-4a70-af1c-02b2b167a071 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:27.801578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd99bccc-eb0e-4a70-af1c-02b2b167a071 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:27.802191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd99bccc-eb0e-4a70-af1c-02b2b167a071 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:27.802676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd99bccc-eb0e-4a70-af1c-02b2b167a071 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:27.803222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd99bccc-eb0e-4a70-af1c-02b2b167a071 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:27.811410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-63773b93-97ac-4705-946e-09624c983767 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:27.812817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-63773b93-97ac-4705-946e-09624c983767 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:27.826184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63773b93-97ac-4705-946e-09624c983767 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:27.827187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63773b93-97ac-4705-946e-09624c983767 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:27.828063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63773b93-97ac-4705-946e-09624c983767 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:27.830039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63773b93-97ac-4705-946e-09624c983767 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:27.831003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63773b93-97ac-4705-946e-09624c983767 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:27.832043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63773b93-97ac-4705-946e-09624c983767 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:28.011136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-63773b93-97ac-4705-946e-09624c983767 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:28.043183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-63773b93-97ac-4705-946e-09624c983767 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:28.052550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-63773b93-97ac-4705-946e-09624c983767 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:28.087108 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-63773b93-97ac-4705-946e-09624c983767 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.286617 Sep 07 12:34:28.088230 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 739/1480] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:34:27 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:34:28.106308 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-34dc068c-bfa9-411a-a996-725330c3ad94 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:28.109404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-34dc068c-bfa9-411a-a996-725330c3ad94 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:28.125638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34dc068c-bfa9-411a-a996-725330c3ad94 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:28.126189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34dc068c-bfa9-411a-a996-725330c3ad94 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:28.126722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34dc068c-bfa9-411a-a996-725330c3ad94 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:28.127496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34dc068c-bfa9-411a-a996-725330c3ad94 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:28.127948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34dc068c-bfa9-411a-a996-725330c3ad94 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:28.128378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34dc068c-bfa9-411a-a996-725330c3ad94 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:28.156191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dd99bccc-eb0e-4a70-af1c-02b2b167a071 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:28.179192 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dd99bccc-eb0e-4a70-af1c-02b2b167a071 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.416737 Sep 07 12:34:28.187433 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 742/1481] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:27 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:34:28.216688 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-34dc068c-bfa9-411a-a996-725330c3ad94 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126918 Sep 07 12:34:28.222902 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 740/1482] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:34:28 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:28.232634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a15d0353-e474-46b8-80d1-8a76bc267897 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:28.235735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a15d0353-e474-46b8-80d1-8a76bc267897 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:28.257784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a15d0353-e474-46b8-80d1-8a76bc267897 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:28.260815 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a15d0353-e474-46b8-80d1-8a76bc267897 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:28.265374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a15d0353-e474-46b8-80d1-8a76bc267897 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:28.266648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a15d0353-e474-46b8-80d1-8a76bc267897 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:28.267359 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a15d0353-e474-46b8-80d1-8a76bc267897 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:28.269204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a15d0353-e474-46b8-80d1-8a76bc267897 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:28.356168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e84ea31a-5eb7-4ae0-9148-d3a83be673e7 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc4192fb160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:28.460155 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e84ea31a-5eb7-4ae0-9148-d3a83be673e7 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60" status: 200 len: 1412 microversion: 2.1 time: 0.108433 Sep 07 12:34:28.462226 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 741/1483] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:34:28 2022] GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60 => generated 1412 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:34:28.639255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-4747a64b-6ccc-4a95-aaec-21cede1bbcad req-217a6487-b309-4653-b134-103a4d9d2123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d12be6f4-80c9-404a-b6c4-d1e94e25daa9", "name": "network-vif-unplugged", "status": "completed", "tag": "50b3c60a-51cc-4ed6-8a42-813229cfb0f8"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:34:28.696477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4747a64b-6ccc-4a95-aaec-21cede1bbcad req-217a6487-b309-4653-b134-103a4d9d2123 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:28.699641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4747a64b-6ccc-4a95-aaec-21cede1bbcad req-217a6487-b309-4653-b134-103a4d9d2123 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:28.700268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4747a64b-6ccc-4a95-aaec-21cede1bbcad req-217a6487-b309-4653-b134-103a4d9d2123 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:28.751006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a15d0353-e474-46b8-80d1-8a76bc267897 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:28.754389 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-4747a64b-6ccc-4a95-aaec-21cede1bbcad req-217a6487-b309-4653-b134-103a4d9d2123 service nova] Creating event network-vif-unplugged:50b3c60a-51cc-4ed6-8a42-813229cfb0f8 for instance d12be6f4-80c9-404a-b6c4-d1e94e25daa9 on n-h1-852087-9 Sep 07 12:34:28.776089 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a15d0353-e474-46b8-80d1-8a76bc267897 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1469 microversion: 2.1 time: 0.550551 Sep 07 12:34:28.779735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-4747a64b-6ccc-4a95-aaec-21cede1bbcad req-217a6487-b309-4653-b134-103a4d9d2123 service nova] Instance d12be6f4-80c9-404a-b6c4-d1e94e25daa9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 12:34:28.786184 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 743/1484] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:28 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1469 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:28.811000 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-4747a64b-6ccc-4a95-aaec-21cede1bbcad req-217a6487-b309-4653-b134-103a4d9d2123 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.180341 Sep 07 12:34:28.814578 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 742/1485] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:34:29.162419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e557152-061a-441e-a1b6-36528c2f74db tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:29.167324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2e557152-061a-441e-a1b6-36528c2f74db tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:29.187444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e557152-061a-441e-a1b6-36528c2f74db tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:29.188533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e557152-061a-441e-a1b6-36528c2f74db tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:29.189907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e557152-061a-441e-a1b6-36528c2f74db tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:29.191568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e557152-061a-441e-a1b6-36528c2f74db tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:29.193111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e557152-061a-441e-a1b6-36528c2f74db tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:29.194232 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e557152-061a-441e-a1b6-36528c2f74db tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:29.224171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8e3a22eb-9a2e-46e8-9796-d80c39584a12 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:29.226103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8e3a22eb-9a2e-46e8-9796-d80c39584a12 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:29.245385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e3a22eb-9a2e-46e8-9796-d80c39584a12 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:29.251457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e3a22eb-9a2e-46e8-9796-d80c39584a12 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:29.252059 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e3a22eb-9a2e-46e8-9796-d80c39584a12 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:29.253711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e3a22eb-9a2e-46e8-9796-d80c39584a12 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:29.254272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e3a22eb-9a2e-46e8-9796-d80c39584a12 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:29.254748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e3a22eb-9a2e-46e8-9796-d80c39584a12 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:29.428151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2e557152-061a-441e-a1b6-36528c2f74db tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:29.446205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2e557152-061a-441e-a1b6-36528c2f74db tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:29.450035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2e557152-061a-441e-a1b6-36528c2f74db tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:29.460350 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2e557152-061a-441e-a1b6-36528c2f74db tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.325729 Sep 07 12:34:29.462367 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 744/1486] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:34:29 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:34:29.482404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-70db88a4-76cf-4d74-a71c-a57b93535ba4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:29.501361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-70db88a4-76cf-4d74-a71c-a57b93535ba4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:29.521430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70db88a4-76cf-4d74-a71c-a57b93535ba4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:29.526819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70db88a4-76cf-4d74-a71c-a57b93535ba4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:29.530405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70db88a4-76cf-4d74-a71c-a57b93535ba4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:29.532005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70db88a4-76cf-4d74-a71c-a57b93535ba4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:29.535603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70db88a4-76cf-4d74-a71c-a57b93535ba4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:29.536771 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70db88a4-76cf-4d74-a71c-a57b93535ba4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:29.650290 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-70db88a4-76cf-4d74-a71c-a57b93535ba4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.184557 Sep 07 12:34:29.655974 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 745/1487] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:34:29 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:29.670684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-577b4c9d-e7ee-41ba-b8b8-4a511b399854 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc4197a7c10>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:29.773140 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-577b4c9d-e7ee-41ba-b8b8-4a511b399854 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60" status: 200 len: 1412 microversion: 2.1 time: 0.115516 Sep 07 12:34:29.782567 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 746/1488] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:34:29 2022] GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60 => generated 1412 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:29.790063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-440b90b4-0a7f-42cb-9f38-6e36b3b67095 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:29.796651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-440b90b4-0a7f-42cb-9f38-6e36b3b67095 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:29.814408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-440b90b4-0a7f-42cb-9f38-6e36b3b67095 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:29.815671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-440b90b4-0a7f-42cb-9f38-6e36b3b67095 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:29.816436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-440b90b4-0a7f-42cb-9f38-6e36b3b67095 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:29.817531 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-440b90b4-0a7f-42cb-9f38-6e36b3b67095 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:29.823165 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-440b90b4-0a7f-42cb-9f38-6e36b3b67095 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:29.824039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-440b90b4-0a7f-42cb-9f38-6e36b3b67095 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:29.898550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-440b90b4-0a7f-42cb-9f38-6e36b3b67095 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:34:30.097908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8e3a22eb-9a2e-46e8-9796-d80c39584a12 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:30.117201 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8e3a22eb-9a2e-46e8-9796-d80c39584a12 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.897981 Sep 07 12:34:30.119256 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 743/1489] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:29 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:30.128694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec4b0957-041a-4b4d-8433-818431623a6e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:30.130317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ec4b0957-041a-4b4d-8433-818431623a6e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:30.208471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec4b0957-041a-4b4d-8433-818431623a6e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:30.210508 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec4b0957-041a-4b4d-8433-818431623a6e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:30.220960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec4b0957-041a-4b4d-8433-818431623a6e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:30.224540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec4b0957-041a-4b4d-8433-818431623a6e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:30.225577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec4b0957-041a-4b4d-8433-818431623a6e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:30.230644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec4b0957-041a-4b4d-8433-818431623a6e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:30.249940 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-440b90b4-0a7f-42cb-9f38-6e36b3b67095 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9" status: 204 len: 0 microversion: 2.1 time: 0.465122 Sep 07 12:34:30.266103 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 747/1490] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:34:29 2022] DELETE /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:34:30.323837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f94576c5-574a-4297-ac79-3a7709ee91dd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:30.332681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f94576c5-574a-4297-ac79-3a7709ee91dd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:30.366274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f94576c5-574a-4297-ac79-3a7709ee91dd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:30.376493 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f94576c5-574a-4297-ac79-3a7709ee91dd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:30.379015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f94576c5-574a-4297-ac79-3a7709ee91dd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:30.382241 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f94576c5-574a-4297-ac79-3a7709ee91dd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:30.383197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f94576c5-574a-4297-ac79-3a7709ee91dd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:30.383963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f94576c5-574a-4297-ac79-3a7709ee91dd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:30.825132 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f94576c5-574a-4297-ac79-3a7709ee91dd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:30.840172 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f94576c5-574a-4297-ac79-3a7709ee91dd tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9" status: 200 len: 1679 microversion: 2.1 time: 0.562255 Sep 07 12:34:30.842802 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 748/1491] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:30 2022] GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9 => generated 1679 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:30.850945 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9e9b7c01-86c9-436a-9fee-894a29fbcb60 req-43ab165c-2f73-4dce-84ce-85d1a0f144c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6ee92e-b663-4984-9198-d2ca0f8b3892", "name": "network-vif-plugged", "status": "completed", "tag": "07e0fa79-d940-418d-b2f3-f85b6ee4dffd"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:34:30.892365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9e9b7c01-86c9-436a-9fee-894a29fbcb60 req-43ab165c-2f73-4dce-84ce-85d1a0f144c4 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:30.901556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9e9b7c01-86c9-436a-9fee-894a29fbcb60 req-43ab165c-2f73-4dce-84ce-85d1a0f144c4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:30.901556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9e9b7c01-86c9-436a-9fee-894a29fbcb60 req-43ab165c-2f73-4dce-84ce-85d1a0f144c4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:30.931066 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9e9b7c01-86c9-436a-9fee-894a29fbcb60 req-43ab165c-2f73-4dce-84ce-85d1a0f144c4 service nova] Creating event network-vif-plugged:07e0fa79-d940-418d-b2f3-f85b6ee4dffd for instance 2f6ee92e-b663-4984-9198-d2ca0f8b3892 on n-h2-852087-9 Sep 07 12:34:30.950727 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9e9b7c01-86c9-436a-9fee-894a29fbcb60 req-43ab165c-2f73-4dce-84ce-85d1a0f144c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105592 Sep 07 12:34:30.952146 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 749/1492] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:30.961906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2dbbc718-8860-4532-b333-286851e2e13e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:30.963235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2dbbc718-8860-4532-b333-286851e2e13e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:30.977371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dbbc718-8860-4532-b333-286851e2e13e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:30.979495 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dbbc718-8860-4532-b333-286851e2e13e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:30.980487 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dbbc718-8860-4532-b333-286851e2e13e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:30.981878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dbbc718-8860-4532-b333-286851e2e13e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:30.982743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dbbc718-8860-4532-b333-286851e2e13e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:30.983515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dbbc718-8860-4532-b333-286851e2e13e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:31.009028 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ec4b0957-041a-4b4d-8433-818431623a6e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:31.025086 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ec4b0957-041a-4b4d-8433-818431623a6e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1469 microversion: 2.1 time: 0.903497 Sep 07 12:34:31.042625 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 744/1493] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:30 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1469 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:31.066943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5680db8e-4d4b-407c-9670-f609069bb4e6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:31.076208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5680db8e-4d4b-407c-9670-f609069bb4e6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:31.085260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5680db8e-4d4b-407c-9670-f609069bb4e6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:31.085823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5680db8e-4d4b-407c-9670-f609069bb4e6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:31.086268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5680db8e-4d4b-407c-9670-f609069bb4e6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:31.087015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5680db8e-4d4b-407c-9670-f609069bb4e6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:31.087483 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5680db8e-4d4b-407c-9670-f609069bb4e6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:31.094261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5680db8e-4d4b-407c-9670-f609069bb4e6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:31.122504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2dbbc718-8860-4532-b333-286851e2e13e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:31.144950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2dbbc718-8860-4532-b333-286851e2e13e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:31.148416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2dbbc718-8860-4532-b333-286851e2e13e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e1c5da4dd85442e985ace34b5b625fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a410106c7d4a1883dc5b812abe8c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:31.160832 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2dbbc718-8860-4532-b333-286851e2e13e tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 200 len: 1537 microversion: 2.91 time: 0.206401 Sep 07 12:34:31.169560 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 750/1494] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:34:30 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 1537 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:34:31.169855 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5680db8e-4d4b-407c-9670-f609069bb4e6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120882 Sep 07 12:34:31.171049 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 745/1495] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:34:31 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:31.185692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-408025f4-d5ff-42f9-918c-c048e47d29df tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41971bf70>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:31.189637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-aa29bd67-fb63-47c5-91f3-ed01591b3ae4 req-23d21541-a0ab-48d1-bdc3-3cc293aef108 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d12be6f4-80c9-404a-b6c4-d1e94e25daa9", "tag": "50b3c60a-51cc-4ed6-8a42-813229cfb0f8"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:34:31.217270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-aa29bd67-fb63-47c5-91f3-ed01591b3ae4 req-23d21541-a0ab-48d1-bdc3-3cc293aef108 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:31.218128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-aa29bd67-fb63-47c5-91f3-ed01591b3ae4 req-23d21541-a0ab-48d1-bdc3-3cc293aef108 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:31.219222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-aa29bd67-fb63-47c5-91f3-ed01591b3ae4 req-23d21541-a0ab-48d1-bdc3-3cc293aef108 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:31.251844 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-aa29bd67-fb63-47c5-91f3-ed01591b3ae4 req-23d21541-a0ab-48d1-bdc3-3cc293aef108 service nova] Creating event network-changed:50b3c60a-51cc-4ed6-8a42-813229cfb0f8 for instance d12be6f4-80c9-404a-b6c4-d1e94e25daa9 on n-h1-852087-9 Sep 07 12:34:31.277944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-aa29bd67-fb63-47c5-91f3-ed01591b3ae4 req-23d21541-a0ab-48d1-bdc3-3cc293aef108 service nova] Instance d12be6f4-80c9-404a-b6c4-d1e94e25daa9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 12:34:31.311881 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-aa29bd67-fb63-47c5-91f3-ed01591b3ae4 req-23d21541-a0ab-48d1-bdc3-3cc293aef108 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137923 Sep 07 12:34:31.313939 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 746/1496] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:31.329378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2d9f4c6e-6384-47a2-b390-ae56ba1bde7a tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:31.331281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2d9f4c6e-6384-47a2-b390-ae56ba1bde7a tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:31.332582 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-408025f4-d5ff-42f9-918c-c048e47d29df tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60" status: 200 len: 1412 microversion: 2.1 time: 0.168158 Sep 07 12:34:31.334068 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 751/1497] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:34:31 2022] GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60 => generated 1412 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:31.345062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d9f4c6e-6384-47a2-b390-ae56ba1bde7a tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:31.346478 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d9f4c6e-6384-47a2-b390-ae56ba1bde7a tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:31.347792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d9f4c6e-6384-47a2-b390-ae56ba1bde7a tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:31.349748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d9f4c6e-6384-47a2-b390-ae56ba1bde7a tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:31.350910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d9f4c6e-6384-47a2-b390-ae56ba1bde7a tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:31.352067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d9f4c6e-6384-47a2-b390-ae56ba1bde7a tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:31.699494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2d9f4c6e-6384-47a2-b390-ae56ba1bde7a tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:31.736194 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2d9f4c6e-6384-47a2-b390-ae56ba1bde7a tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.412391 Sep 07 12:34:31.737741 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 747/1498] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:31 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:31.890061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ca16d1d9-c316-4809-91d7-5d9d3a904431 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:31.892043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ca16d1d9-c316-4809-91d7-5d9d3a904431 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:31.918859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca16d1d9-c316-4809-91d7-5d9d3a904431 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:31.919952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca16d1d9-c316-4809-91d7-5d9d3a904431 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:31.923080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca16d1d9-c316-4809-91d7-5d9d3a904431 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:31.924654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca16d1d9-c316-4809-91d7-5d9d3a904431 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:31.928199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca16d1d9-c316-4809-91d7-5d9d3a904431 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:31.933040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca16d1d9-c316-4809-91d7-5d9d3a904431 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:32.070565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b46dae14-d4d2-422b-a90d-17c1fbab8f20 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:32.071292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b46dae14-d4d2-422b-a90d-17c1fbab8f20 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:32.090564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b46dae14-d4d2-422b-a90d-17c1fbab8f20 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:32.094231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b46dae14-d4d2-422b-a90d-17c1fbab8f20 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:32.094907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b46dae14-d4d2-422b-a90d-17c1fbab8f20 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:32.095768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b46dae14-d4d2-422b-a90d-17c1fbab8f20 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:32.097696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b46dae14-d4d2-422b-a90d-17c1fbab8f20 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:32.098942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b46dae14-d4d2-422b-a90d-17c1fbab8f20 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:32.523122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b46dae14-d4d2-422b-a90d-17c1fbab8f20 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:32.544817 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b46dae14-d4d2-422b-a90d-17c1fbab8f20 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1469 microversion: 2.1 time: 0.479780 Sep 07 12:34:32.545423 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 748/1499] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:32 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1469 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:32.551992 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7021062f-e3d2-4afe-8d7a-665311d6144a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:32.554613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7021062f-e3d2-4afe-8d7a-665311d6144a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:32.574437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7021062f-e3d2-4afe-8d7a-665311d6144a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:32.575341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7021062f-e3d2-4afe-8d7a-665311d6144a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:32.576013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7021062f-e3d2-4afe-8d7a-665311d6144a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:32.577116 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7021062f-e3d2-4afe-8d7a-665311d6144a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:32.578406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7021062f-e3d2-4afe-8d7a-665311d6144a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:32.579608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7021062f-e3d2-4afe-8d7a-665311d6144a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:32.670105 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7021062f-e3d2-4afe-8d7a-665311d6144a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123038 Sep 07 12:34:32.671586 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 749/1500] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:34:32 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:32.686566 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3bd3275f-c06d-4b95-9730-8057e53c02f8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:32.687583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3bd3275f-c06d-4b95-9730-8057e53c02f8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] [instance: b8038c3c-8b64-4a94-84ad-41654d2d53ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:32.702096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bd3275f-c06d-4b95-9730-8057e53c02f8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:32.702951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bd3275f-c06d-4b95-9730-8057e53c02f8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:32.703706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bd3275f-c06d-4b95-9730-8057e53c02f8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:32.704713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bd3275f-c06d-4b95-9730-8057e53c02f8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:32.718362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bd3275f-c06d-4b95-9730-8057e53c02f8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:32.719182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bd3275f-c06d-4b95-9730-8057e53c02f8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:32.747341 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-3bd3275f-c06d-4b95-9730-8057e53c02f8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] HTTP exception thrown: Instance b8038c3c-8b64-4a94-84ad-41654d2d53ca could not be found. Sep 07 12:34:32.749594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3bd3275f-c06d-4b95-9730-8057e53c02f8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Request method failure captured: Sep 07 12:34:32.749594 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca HTTP/1.1 Sep 07 12:34:32.749594 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:34:32.749594 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:34:32.749594 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:34:32.749594 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:34:32.749594 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:34:32.749594 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:34:32.749594 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:34:32.749594 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:34:32.749594 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI8C4mcW2Y-Myt2CrvD2C3Gvey_zrJ-JugZSO7pjAt8dyUEUkPeIgaPl5_Z2pUodjpsEwNUl_fs8wZN4lOhjXRSxBJrJLl0QHQngDqNzHVyZuiNE68jdr9qPfwJdIQzaR061fEsTAchdzPcpTaRQ6pDMuS2qcUED25J9CZ54YwqZd10 Sep 07 12:34:32.749594 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:34:32.749594 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:34:32.749594 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:34:32.749594 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:34:32.749594 n-d-852087-9 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.91 Sep 07 12:34:32.749594 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:34:32.749594 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:34:32.749594 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 90a410106c7d4a1883dc5b812abe8c9b Sep 07 12:34:32.749594 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1390033031 Sep 07 12:34:32.749594 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:34:32.749594 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:34:32.751007 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90a410106c7d4a1883dc5b812abe8c9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_90a410106c7d4a1883dc5b812abe8c9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/90a410106c7d4a1883dc5b812abe8c9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90a410106c7d4a1883dc5b812abe8c9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:34:32.751007 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1390033031 Sep 07 12:34:32.751007 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 90a410106c7d4a1883dc5b812abe8c9b Sep 07 12:34:32.751007 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1390033031 Sep 07 12:34:32.751007 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-UnshelveToHostMultiNodesTest-1390033031-project Sep 07 12:34:32.751007 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:34:32.751007 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:34:32.751007 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5e1c5da4dd85442e985ace34b5b625fd Sep 07 12:34:32.751007 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1390033031-project Sep 07 12:34:32.751007 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:34:32.751007 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance b8038c3c-8b64-4a94-84ad-41654d2d53ca could not be found. Sep 07 12:34:32.751007 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'b8038c3c-8b64-4a94-84ad-41654d2d53ca'} Sep 07 12:34:32.751836 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:34:32.751836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:34:32.751836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:34:32.751836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:34:32.751836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:34:32.751836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:34:32.751836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:34:32.751836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:34:32.751836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:34:32.751836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:34:32.751836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8038c3c-8b64-4a94-84ad-41654d2d53ca could not be found. Sep 07 12:34:32.751836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:34:32.751836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:34:32.751836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:34:32.751836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:34:32.751836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:34:32.751836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:34:32.751836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:34:32.751836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:34:32.751836 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:34:32.753091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:34:32.753091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:34:32.753091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:34:32.753091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:34:32.753091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:34:32.753091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:34:32.753091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:34:32.753091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8038c3c-8b64-4a94-84ad-41654d2d53ca could not be found. Sep 07 12:34:32.753091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:34:32.753091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:34:32.753091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:34:32.753091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:34:32.753091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:34:32.753091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:34:32.753091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:34:32.753091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:34:32.753091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8038c3c-8b64-4a94-84ad-41654d2d53ca could not be found. Sep 07 12:34:32.753091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:34:32.758035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3bd3275f-c06d-4b95-9730-8057e53c02f8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] Returning 404 to user: Instance b8038c3c-8b64-4a94-84ad-41654d2d53ca could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:34:32.758837 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3bd3275f-c06d-4b95-9730-8057e53c02f8 tempest-UnshelveToHostMultiNodesTest-1390033031 tempest-UnshelveToHostMultiNodesTest-1390033031-project] 10.222.0.16 "GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca" status: 404 len: 111 microversion: 2.91 time: 0.085491 Sep 07 12:34:32.762533 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 750/1501] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:34:32 2022] GET /compute/v2.1/servers/b8038c3c-8b64-4a94-84ad-41654d2d53ca => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:34:32.767076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0cdf693d-2b68-4402-9918-78d71c2dcb92 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41d328f70>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:32.792125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ca16d1d9-c316-4809-91d7-5d9d3a904431 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:32.802695 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ca16d1d9-c316-4809-91d7-5d9d3a904431 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9" status: 200 len: 1679 microversion: 2.1 time: 0.916471 Sep 07 12:34:32.809869 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 752/1502] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:31 2022] GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9 => generated 1679 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:34:32.815161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a61ff497-1028-4a26-9cc3-de7f1e750928 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:32.815631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a61ff497-1028-4a26-9cc3-de7f1e750928 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:32.832928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a61ff497-1028-4a26-9cc3-de7f1e750928 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:32.833475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a61ff497-1028-4a26-9cc3-de7f1e750928 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:32.833954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a61ff497-1028-4a26-9cc3-de7f1e750928 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:32.834708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a61ff497-1028-4a26-9cc3-de7f1e750928 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:32.835180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a61ff497-1028-4a26-9cc3-de7f1e750928 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:32.835614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a61ff497-1028-4a26-9cc3-de7f1e750928 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:32.888181 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0cdf693d-2b68-4402-9918-78d71c2dcb92 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60" status: 200 len: 1412 microversion: 2.1 time: 0.127162 Sep 07 12:34:32.890783 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 751/1503] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:34:32 2022] GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60 => generated 1412 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:33.267354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a61ff497-1028-4a26-9cc3-de7f1e750928 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:33.278015 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a61ff497-1028-4a26-9cc3-de7f1e750928 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.466573 Sep 07 12:34:33.293529 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 753/1504] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:32 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:33.594849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6a2246fe-dd4a-40db-bd67-540e5fa52278 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:33.596226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6a2246fe-dd4a-40db-bd67-540e5fa52278 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:33.616871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a2246fe-dd4a-40db-bd67-540e5fa52278 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:33.617904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a2246fe-dd4a-40db-bd67-540e5fa52278 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:33.618685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a2246fe-dd4a-40db-bd67-540e5fa52278 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:33.619900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a2246fe-dd4a-40db-bd67-540e5fa52278 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:33.623512 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a2246fe-dd4a-40db-bd67-540e5fa52278 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:33.624340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a2246fe-dd4a-40db-bd67-540e5fa52278 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:33.688280 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d053d59-7adb-4f53-a166-9cc4aad40532 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:33.692122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1d053d59-7adb-4f53-a166-9cc4aad40532 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:33.738868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d053d59-7adb-4f53-a166-9cc4aad40532 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:33.743917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d053d59-7adb-4f53-a166-9cc4aad40532 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:33.747800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d053d59-7adb-4f53-a166-9cc4aad40532 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:33.753964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d053d59-7adb-4f53-a166-9cc4aad40532 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:33.755304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d053d59-7adb-4f53-a166-9cc4aad40532 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:33.757521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d053d59-7adb-4f53-a166-9cc4aad40532 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:33.984097 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1d053d59-7adb-4f53-a166-9cc4aad40532 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.300642 Sep 07 12:34:33.990246 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 754/1505] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:34:33 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-volume_attachments => generated 197 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:34.008966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32bdf8dd-889c-4277-bd2d-9fea32691f72 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:34.011550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-32bdf8dd-889c-4277-bd2d-9fea32691f72 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:34.026074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32bdf8dd-889c-4277-bd2d-9fea32691f72 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:34.031297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32bdf8dd-889c-4277-bd2d-9fea32691f72 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:34.032217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32bdf8dd-889c-4277-bd2d-9fea32691f72 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:34.034966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32bdf8dd-889c-4277-bd2d-9fea32691f72 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:34.036066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32bdf8dd-889c-4277-bd2d-9fea32691f72 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:34.036941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32bdf8dd-889c-4277-bd2d-9fea32691f72 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:34.225468 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-32bdf8dd-889c-4277-bd2d-9fea32691f72 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:34.257918 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-32bdf8dd-889c-4277-bd2d-9fea32691f72 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9" status: 200 len: 1612 microversion: 2.1 time: 0.265086 Sep 07 12:34:34.259396 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 755/1506] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:33 2022] GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9 => generated 1612 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:34.283520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bfe11ff9-55e6-492a-a901-f9400c2c683e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc419b9a3a0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:34.417318 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bfe11ff9-55e6-492a-a901-f9400c2c683e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60" status: 200 len: 1412 microversion: 2.1 time: 0.156300 Sep 07 12:34:34.420752 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 756/1507] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:34:34 2022] GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60 => generated 1412 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:34.426139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-dd97bd31-9c6b-4f2c-b04c-37c239e5ac0b req-f89f0292-5854-46e4-8627-5db23a8738b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8042e17-76ed-448e-bca1-331aa1f708c9", "name": "network-vif-deleted", "tag": "46a7707b-e590-4c61-a29f-5120d570e51b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:34:34.447398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dd97bd31-9c6b-4f2c-b04c-37c239e5ac0b req-f89f0292-5854-46e4-8627-5db23a8738b9 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:34.448198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dd97bd31-9c6b-4f2c-b04c-37c239e5ac0b req-f89f0292-5854-46e4-8627-5db23a8738b9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:34.449138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dd97bd31-9c6b-4f2c-b04c-37c239e5ac0b req-f89f0292-5854-46e4-8627-5db23a8738b9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:34.463377 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-dd97bd31-9c6b-4f2c-b04c-37c239e5ac0b req-f89f0292-5854-46e4-8627-5db23a8738b9 service nova] Creating event network-vif-deleted:46a7707b-e590-4c61-a29f-5120d570e51b for instance d8042e17-76ed-448e-bca1-331aa1f708c9 on n-h1-852087-9 Sep 07 12:34:34.470203 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-dd97bd31-9c6b-4f2c-b04c-37c239e5ac0b req-f89f0292-5854-46e4-8627-5db23a8738b9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047621 Sep 07 12:34:34.471985 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 757/1508] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:34.479669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-74497f0d-400b-4a57-92da-203682be442c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:34.480613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-74497f0d-400b-4a57-92da-203682be442c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:34.488813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6a2246fe-dd4a-40db-bd67-540e5fa52278 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:34.490123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74497f0d-400b-4a57-92da-203682be442c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:34.490727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74497f0d-400b-4a57-92da-203682be442c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:34.491652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74497f0d-400b-4a57-92da-203682be442c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:34.494219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74497f0d-400b-4a57-92da-203682be442c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:34.495215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74497f0d-400b-4a57-92da-203682be442c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:34.496343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74497f0d-400b-4a57-92da-203682be442c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:34.506253 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6a2246fe-dd4a-40db-bd67-540e5fa52278 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1469 microversion: 2.1 time: 0.919011 Sep 07 12:34:34.508748 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 752/1509] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:33 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1469 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:34.752759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-74497f0d-400b-4a57-92da-203682be442c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:34.765469 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-74497f0d-400b-4a57-92da-203682be442c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.291041 Sep 07 12:34:34.773616 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 758/1510] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:34 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:35.009307 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b792228b-3ffc-40d1-a25f-afa6f0ee2f77 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:35.013069 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b792228b-3ffc-40d1-a25f-afa6f0ee2f77 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:35.028273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b792228b-3ffc-40d1-a25f-afa6f0ee2f77 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:35.037870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b792228b-3ffc-40d1-a25f-afa6f0ee2f77 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:35.038769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b792228b-3ffc-40d1-a25f-afa6f0ee2f77 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:35.040442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b792228b-3ffc-40d1-a25f-afa6f0ee2f77 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:35.041233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b792228b-3ffc-40d1-a25f-afa6f0ee2f77 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:35.041985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b792228b-3ffc-40d1-a25f-afa6f0ee2f77 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:35.128864 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b792228b-3ffc-40d1-a25f-afa6f0ee2f77 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.127785 Sep 07 12:34:35.130715 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 753/1511] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:34:34 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:34:35.290249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-90ee14e2-dc73-4e0a-b317-7951e9890945 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:35.292461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-90ee14e2-dc73-4e0a-b317-7951e9890945 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:35.307309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90ee14e2-dc73-4e0a-b317-7951e9890945 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:35.311304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90ee14e2-dc73-4e0a-b317-7951e9890945 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:35.312958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90ee14e2-dc73-4e0a-b317-7951e9890945 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:35.314226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90ee14e2-dc73-4e0a-b317-7951e9890945 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:35.317573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90ee14e2-dc73-4e0a-b317-7951e9890945 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:35.318431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90ee14e2-dc73-4e0a-b317-7951e9890945 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:35.352300 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:34:35.415582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-90ee14e2-dc73-4e0a-b317-7951e9890945 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:35.433045 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-90ee14e2-dc73-4e0a-b317-7951e9890945 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9" status: 200 len: 1612 microversion: 2.1 time: 0.151732 Sep 07 12:34:35.446070 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 759/1512] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:35 2022] GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9 => generated 1612 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:35.450063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-10b753f0-7f52-4ece-8a7a-f0240177b2de tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41d2fddc0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:35.539067 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0c6552e1-887a-458a-a2ad-9eb2dabf67be tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:35.540826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0c6552e1-887a-458a-a2ad-9eb2dabf67be tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:35.557319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c6552e1-887a-458a-a2ad-9eb2dabf67be tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:35.558463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c6552e1-887a-458a-a2ad-9eb2dabf67be tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:35.559682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c6552e1-887a-458a-a2ad-9eb2dabf67be tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:35.561794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c6552e1-887a-458a-a2ad-9eb2dabf67be tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:35.563064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c6552e1-887a-458a-a2ad-9eb2dabf67be tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:35.564104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c6552e1-887a-458a-a2ad-9eb2dabf67be tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:35.616942 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-10b753f0-7f52-4ece-8a7a-f0240177b2de tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60" status: 200 len: 1412 microversion: 2.1 time: 0.164940 Sep 07 12:34:35.617669 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 754/1513] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:34:35 2022] GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60 => generated 1412 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:35.817193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-73cb8bd3-0d00-4ea5-a780-f298187d7573 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:35.829617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-73cb8bd3-0d00-4ea5-a780-f298187d7573 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:35.852428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73cb8bd3-0d00-4ea5-a780-f298187d7573 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:35.853925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73cb8bd3-0d00-4ea5-a780-f298187d7573 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:35.855055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73cb8bd3-0d00-4ea5-a780-f298187d7573 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:35.856724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73cb8bd3-0d00-4ea5-a780-f298187d7573 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:35.857904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73cb8bd3-0d00-4ea5-a780-f298187d7573 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:35.858926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73cb8bd3-0d00-4ea5-a780-f298187d7573 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:35.948922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:34:36.431326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0c6552e1-887a-458a-a2ad-9eb2dabf67be tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:36.472907 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0c6552e1-887a-458a-a2ad-9eb2dabf67be tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1469 microversion: 2.1 time: 0.944405 Sep 07 12:34:36.474387 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 760/1514] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:35 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1469 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:36.554301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-58d88bbc-9cbb-4895-bb12-277b9aac5230 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:36.560695 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-58d88bbc-9cbb-4895-bb12-277b9aac5230 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:36.607680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58d88bbc-9cbb-4895-bb12-277b9aac5230 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:36.608274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58d88bbc-9cbb-4895-bb12-277b9aac5230 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:36.614742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58d88bbc-9cbb-4895-bb12-277b9aac5230 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:36.623611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58d88bbc-9cbb-4895-bb12-277b9aac5230 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:36.624654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58d88bbc-9cbb-4895-bb12-277b9aac5230 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:36.629294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58d88bbc-9cbb-4895-bb12-277b9aac5230 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:36.684671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-73cb8bd3-0d00-4ea5-a780-f298187d7573 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:36.733253 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-73cb8bd3-0d00-4ea5-a780-f298187d7573 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.943948 Sep 07 12:34:36.737414 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 755/1515] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:35 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:36.748362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8f1fdb55-df58-4fb4-9c07-1ed5e147aeb4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41928e940>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:36.933967 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8f1fdb55-df58-4fb4-9c07-1ed5e147aeb4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60" status: 200 len: 1412 microversion: 2.1 time: 0.189734 Sep 07 12:34:36.935735 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 756/1516] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:34:36 2022] GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60 => generated 1412 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:36.959055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58d88bbc-9cbb-4895-bb12-277b9aac5230 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:36.974866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58d88bbc-9cbb-4895-bb12-277b9aac5230 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:36.976668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58d88bbc-9cbb-4895-bb12-277b9aac5230 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:36.979357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-58d88bbc-9cbb-4895-bb12-277b9aac5230 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lazy-loading 'fault' on Instance uuid d8042e17-76ed-448e-bca1-331aa1f708c9 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:34:37.214759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-58d88bbc-9cbb-4895-bb12-277b9aac5230 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '239d71c912c749e7afe0f791db5c18f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c950a615d6a4b67a93a60f7969b6e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:37.230641 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-58d88bbc-9cbb-4895-bb12-277b9aac5230 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9" status: 200 len: 1330 microversion: 2.1 time: 0.710644 Sep 07 12:34:37.235805 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 761/1517] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:36 2022] GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9 => generated 1330 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:37.525798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d6ac8a5a-e6a4-4ddb-9b5f-d550f545572a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:37.533970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d6ac8a5a-e6a4-4ddb-9b5f-d550f545572a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:37.593755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6ac8a5a-e6a4-4ddb-9b5f-d550f545572a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:37.594744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6ac8a5a-e6a4-4ddb-9b5f-d550f545572a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:37.595528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6ac8a5a-e6a4-4ddb-9b5f-d550f545572a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:37.606253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6ac8a5a-e6a4-4ddb-9b5f-d550f545572a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:37.609350 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6ac8a5a-e6a4-4ddb-9b5f-d550f545572a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:37.610456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6ac8a5a-e6a4-4ddb-9b5f-d550f545572a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:37.787582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-37f4f794-78c4-4519-8e0a-5b312468b52b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:37.788910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-37f4f794-78c4-4519-8e0a-5b312468b52b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:37.808324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37f4f794-78c4-4519-8e0a-5b312468b52b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:37.808836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37f4f794-78c4-4519-8e0a-5b312468b52b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:37.809311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37f4f794-78c4-4519-8e0a-5b312468b52b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:37.827289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37f4f794-78c4-4519-8e0a-5b312468b52b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:37.827977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37f4f794-78c4-4519-8e0a-5b312468b52b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:37.828460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37f4f794-78c4-4519-8e0a-5b312468b52b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:38.425368 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d6ac8a5a-e6a4-4ddb-9b5f-d550f545572a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:38.442384 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d6ac8a5a-e6a4-4ddb-9b5f-d550f545572a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1462 microversion: 2.1 time: 0.928401 Sep 07 12:34:38.459354 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 757/1518] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:37 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1462 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:38.475144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a56858b-ff19-48e2-9772-b150d6fb2dc3 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc4192ac670>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:38.745209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37f4f794-78c4-4519-8e0a-5b312468b52b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:38.771613 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-37f4f794-78c4-4519-8e0a-5b312468b52b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1472 microversion: 2.1 time: 0.989722 Sep 07 12:34:38.772780 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 762/1519] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:37 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1472 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:38.781208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-707b8ce4-d304-4ee3-892b-1bba433018a7 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:38.781873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-707b8ce4-d304-4ee3-892b-1bba433018a7 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] [instance: d8042e17-76ed-448e-bca1-331aa1f708c9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:38.794878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-707b8ce4-d304-4ee3-892b-1bba433018a7 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:38.794878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-707b8ce4-d304-4ee3-892b-1bba433018a7 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:38.794878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-707b8ce4-d304-4ee3-892b-1bba433018a7 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:38.794878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-707b8ce4-d304-4ee3-892b-1bba433018a7 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:38.796457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-707b8ce4-d304-4ee3-892b-1bba433018a7 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:38.796457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-707b8ce4-d304-4ee3-892b-1bba433018a7 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:38.820273 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-707b8ce4-d304-4ee3-892b-1bba433018a7 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] HTTP exception thrown: Instance d8042e17-76ed-448e-bca1-331aa1f708c9 could not be found. Sep 07 12:34:38.822463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-707b8ce4-d304-4ee3-892b-1bba433018a7 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Request method failure captured: Sep 07 12:34:38.822463 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9 HTTP/1.1 Sep 07 12:34:38.822463 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:34:38.822463 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:34:38.822463 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:34:38.822463 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:34:38.822463 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:34:38.822463 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:34:38.822463 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:34:38.822463 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:34:38.822463 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI7a_SgfvazlsNUq8Ml3ORQ8zQ7SG_06Ln9QYLqwP2kD_ySXSJRWhGGwUntP2NyCRHjBetp_HnNYddQs2DUhXPVwhy2lhcUSnaxjdHoOJGs2X9PvTlBBZPzREoU-_0gYtmg8EYu-HrVFymBMICNiui6mb3pJGLgRsnea0_M2EpBlB9Y Sep 07 12:34:38.822463 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:34:38.822463 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:34:38.822463 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:34:38.822463 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:34:38.822463 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:34:38.822463 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:34:38.822463 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 6c950a615d6a4b67a93a60f7969b6e6e Sep 07 12:34:38.822463 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-VolumesAdminNegativeTest-211770377 Sep 07 12:34:38.822463 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:34:38.822463 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:34:38.824222 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6c950a615d6a4b67a93a60f7969b6e6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6c950a615d6a4b67a93a60f7969b6e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6c950a615d6a4b67a93a60f7969b6e6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6c950a615d6a4b67a93a60f7969b6e6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:34:38.824222 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-VolumesAdminNegativeTest-211770377 Sep 07 12:34:38.824222 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 6c950a615d6a4b67a93a60f7969b6e6e Sep 07 12:34:38.824222 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-211770377 Sep 07 12:34:38.824222 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-VolumesAdminNegativeTest-211770377-project Sep 07 12:34:38.824222 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:34:38.824222 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:34:38.824222 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 239d71c912c749e7afe0f791db5c18f9 Sep 07 12:34:38.824222 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-VolumesAdminNegativeTest-211770377-project Sep 07 12:34:38.824222 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:34:38.824222 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance d8042e17-76ed-448e-bca1-331aa1f708c9 could not be found. Sep 07 12:34:38.824222 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'd8042e17-76ed-448e-bca1-331aa1f708c9'} Sep 07 12:34:38.824986 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:34:38.824986 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:34:38.824986 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:34:38.824986 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:34:38.824986 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:34:38.824986 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:34:38.824986 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:34:38.824986 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:34:38.824986 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:34:38.824986 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:34:38.824986 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8042e17-76ed-448e-bca1-331aa1f708c9 could not be found. Sep 07 12:34:38.824986 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:34:38.824986 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:34:38.824986 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:34:38.824986 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:34:38.824986 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:34:38.824986 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:34:38.824986 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:34:38.824986 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:34:38.824986 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:34:38.827782 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:34:38.827782 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:34:38.827782 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:34:38.827782 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:34:38.827782 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:34:38.827782 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:34:38.827782 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:34:38.827782 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8042e17-76ed-448e-bca1-331aa1f708c9 could not be found. Sep 07 12:34:38.827782 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:34:38.827782 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:34:38.827782 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:34:38.827782 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:34:38.827782 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:34:38.827782 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:34:38.827782 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:34:38.827782 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:34:38.827782 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8042e17-76ed-448e-bca1-331aa1f708c9 could not be found. Sep 07 12:34:38.827782 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:34:38.831896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-707b8ce4-d304-4ee3-892b-1bba433018a7 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Returning 404 to user: Instance d8042e17-76ed-448e-bca1-331aa1f708c9 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:34:38.831896 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-707b8ce4-d304-4ee3-892b-1bba433018a7 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9" status: 404 len: 111 microversion: 2.1 time: 0.050012 Sep 07 12:34:38.831896 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 763/1520] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:38 2022] GET /compute/v2.1/servers/d8042e17-76ed-448e-bca1-331aa1f708c9 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:34:39.607774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a3e6ddd1-aa18-438d-ba2a-2b1f518a9359 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:39.609709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a3e6ddd1-aa18-438d-ba2a-2b1f518a9359 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:39.653803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3e6ddd1-aa18-438d-ba2a-2b1f518a9359 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:39.657448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3e6ddd1-aa18-438d-ba2a-2b1f518a9359 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:39.666204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3e6ddd1-aa18-438d-ba2a-2b1f518a9359 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:39.674106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3e6ddd1-aa18-438d-ba2a-2b1f518a9359 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:39.677027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3e6ddd1-aa18-438d-ba2a-2b1f518a9359 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:39.677909 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3e6ddd1-aa18-438d-ba2a-2b1f518a9359 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:40.176174 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a3e6ddd1-aa18-438d-ba2a-2b1f518a9359 tempest-MigrationsAdminTest-226331028 tempest-MigrationsAdminTest-226331028-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1613 microversion: 2.1 time: 1.348746 Sep 07 12:34:40.178443 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 764/1521] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:38 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1613 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:40.196502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-26922b3d-5562-4314-b62e-3a2d6b612752 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] Calling method '.version_select at 0x7fc41941a310>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:40.226374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:34:40.241529 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-26922b3d-5562-4314-b62e-3a2d6b612752 tempest-VolumesAdminNegativeTest-211770377 tempest-VolumesAdminNegativeTest-211770377-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-903806393" status: 202 len: 0 microversion: 2.1 time: 0.056493 Sep 07 12:34:40.246594 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 765/1522] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Sep 7 12:34:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-903806393 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:34:40.264776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e2154843-4815-4cd5-bde7-71b7b3c93cad tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1e62c4a-2ef5-4970-a41c-dbe43562bfbb"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:34:40.272573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e2154843-4815-4cd5-bde7-71b7b3c93cad tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:40.296449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2154843-4815-4cd5-bde7-71b7b3c93cad tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:40.299236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2154843-4815-4cd5-bde7-71b7b3c93cad tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:40.303134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2154843-4815-4cd5-bde7-71b7b3c93cad tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:40.304209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2154843-4815-4cd5-bde7-71b7b3c93cad tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:40.305022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2154843-4815-4cd5-bde7-71b7b3c93cad tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:40.307896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2154843-4815-4cd5-bde7-71b7b3c93cad tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:41.121643 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e2154843-4815-4cd5-bde7-71b7b3c93cad tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "POST /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.872631 Sep 07 12:34:41.122403 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 766/1523] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Sep 7 12:34:40 2022] POST /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec/os-volume_attachments => generated 194 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:41.139727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2dd003a6-d6ca-40bf-9a29-d8473bcb39e3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:41.141021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2dd003a6-d6ca-40bf-9a29-d8473bcb39e3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:41.150055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dd003a6-d6ca-40bf-9a29-d8473bcb39e3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:41.151153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dd003a6-d6ca-40bf-9a29-d8473bcb39e3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:41.151790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dd003a6-d6ca-40bf-9a29-d8473bcb39e3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:41.152701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dd003a6-d6ca-40bf-9a29-d8473bcb39e3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:41.153335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dd003a6-d6ca-40bf-9a29-d8473bcb39e3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:41.154205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dd003a6-d6ca-40bf-9a29-d8473bcb39e3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:41.984544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2dd003a6-d6ca-40bf-9a29-d8473bcb39e3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:42.052489 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2dd003a6-d6ca-40bf-9a29-d8473bcb39e3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1478 microversion: 2.1 time: 0.903525 Sep 07 12:34:42.057021 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 767/1524] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:41 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1478 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:42.086836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b4290c8d-7652-4da5-8bb5-ce54ef0bb069 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:42.088388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b4290c8d-7652-4da5-8bb5-ce54ef0bb069 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:42.115912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4290c8d-7652-4da5-8bb5-ce54ef0bb069 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:42.117720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4290c8d-7652-4da5-8bb5-ce54ef0bb069 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:42.121084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4290c8d-7652-4da5-8bb5-ce54ef0bb069 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:42.123106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4290c8d-7652-4da5-8bb5-ce54ef0bb069 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:42.126504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4290c8d-7652-4da5-8bb5-ce54ef0bb069 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:42.127598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4290c8d-7652-4da5-8bb5-ce54ef0bb069 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:42.270164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b4290c8d-7652-4da5-8bb5-ce54ef0bb069 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:34:42.450116 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b4290c8d-7652-4da5-8bb5-ce54ef0bb069 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 204 len: 0 microversion: 2.1 time: 0.389749 Sep 07 12:34:42.455016 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 768/1525] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:34:42 2022] DELETE /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:34:42.464534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-407de22e-9bc9-42ff-9f62-1d7e4dca22a0 req-2516e4b5-5e8c-4d42-9bb6-a3811ae8fc3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d12be6f4-80c9-404a-b6c4-d1e94e25daa9", "name": "network-vif-plugged", "status": "completed", "tag": "50b3c60a-51cc-4ed6-8a42-813229cfb0f8"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:34:42.493055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-407de22e-9bc9-42ff-9f62-1d7e4dca22a0 req-2516e4b5-5e8c-4d42-9bb6-a3811ae8fc3c service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:42.494677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-407de22e-9bc9-42ff-9f62-1d7e4dca22a0 req-2516e4b5-5e8c-4d42-9bb6-a3811ae8fc3c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:42.497435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-407de22e-9bc9-42ff-9f62-1d7e4dca22a0 req-2516e4b5-5e8c-4d42-9bb6-a3811ae8fc3c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:42.526708 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-407de22e-9bc9-42ff-9f62-1d7e4dca22a0 req-2516e4b5-5e8c-4d42-9bb6-a3811ae8fc3c service nova] Creating event network-vif-plugged:50b3c60a-51cc-4ed6-8a42-813229cfb0f8 for instance d12be6f4-80c9-404a-b6c4-d1e94e25daa9 on n-h1-852087-9 Sep 07 12:34:42.555905 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-407de22e-9bc9-42ff-9f62-1d7e4dca22a0 req-2516e4b5-5e8c-4d42-9bb6-a3811ae8fc3c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095076 Sep 07 12:34:42.561792 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 769/1526] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:43.008239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df42b9d3-a22f-4131-a8c9-d097fd7d33c4 tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:43.012387 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df42b9d3-a22f-4131-a8c9-d097fd7d33c4 tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:43.012889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df42b9d3-a22f-4131-a8c9-d097fd7d33c4 tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:43.013345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df42b9d3-a22f-4131-a8c9-d097fd7d33c4 tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:43.014123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df42b9d3-a22f-4131-a8c9-d097fd7d33c4 tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:43.018553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df42b9d3-a22f-4131-a8c9-d097fd7d33c4 tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:43.019049 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df42b9d3-a22f-4131-a8c9-d097fd7d33c4 tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:43.083230 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-df42b9d3-a22f-4131-a8c9-d097fd7d33c4 tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.519859 Sep 07 12:34:43.083842 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 770/1527] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:34:42 2022] GET /compute/v2.1/os-services => generated 944 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:43.096119 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-64e4f46a-add6-4963-9891-fa3e0cba6ce7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:43.100024 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-64e4f46a-add6-4963-9891-fa3e0cba6ce7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:43.121708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64e4f46a-add6-4963-9891-fa3e0cba6ce7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:43.122566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64e4f46a-add6-4963-9891-fa3e0cba6ce7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:43.123249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64e4f46a-add6-4963-9891-fa3e0cba6ce7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:43.124218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64e4f46a-add6-4963-9891-fa3e0cba6ce7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:43.124867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64e4f46a-add6-4963-9891-fa3e0cba6ce7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:43.125509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64e4f46a-add6-4963-9891-fa3e0cba6ce7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:43.541311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-64e4f46a-add6-4963-9891-fa3e0cba6ce7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:43.570256 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-64e4f46a-add6-4963-9891-fa3e0cba6ce7 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1468 microversion: 2.1 time: 0.483265 Sep 07 12:34:43.575150 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 771/1528] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:43 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1468 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:43.598943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7717b588-b333-4a7a-9c26-b231d8cb4907 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:43.599970 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7717b588-b333-4a7a-9c26-b231d8cb4907 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:43.610339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7717b588-b333-4a7a-9c26-b231d8cb4907 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:43.611688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7717b588-b333-4a7a-9c26-b231d8cb4907 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:43.612364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7717b588-b333-4a7a-9c26-b231d8cb4907 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:43.613325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7717b588-b333-4a7a-9c26-b231d8cb4907 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:43.614056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7717b588-b333-4a7a-9c26-b231d8cb4907 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:43.615238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7717b588-b333-4a7a-9c26-b231d8cb4907 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:43.842918 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7717b588-b333-4a7a-9c26-b231d8cb4907 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:43.852808 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7717b588-b333-4a7a-9c26-b231d8cb4907 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1478 microversion: 2.1 time: 0.266194 Sep 07 12:34:43.859017 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 772/1529] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:43 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1478 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:43.869332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3691e7db-cb22-47e0-8458-d22509bf2827 tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:43.893282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3691e7db-cb22-47e0-8458-d22509bf2827 tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:43.894102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3691e7db-cb22-47e0-8458-d22509bf2827 tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:43.894725 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3691e7db-cb22-47e0-8458-d22509bf2827 tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:43.902042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3691e7db-cb22-47e0-8458-d22509bf2827 tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:43.902842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3691e7db-cb22-47e0-8458-d22509bf2827 tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:43.904051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3691e7db-cb22-47e0-8458-d22509bf2827 tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:43.956974 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3691e7db-cb22-47e0-8458-d22509bf2827 tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-852087-9" status: 200 len: 578 microversion: 2.1 time: 0.096400 Sep 07 12:34:43.959138 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 773/1530] 10.222.0.16 () {58 vars in 1172 bytes} [Wed Sep 7 12:34:43 2022] GET /compute/v2.1/os-services?host=n-d-852087-9 => generated 578 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:43.981867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b1072e85-350e-4efa-8462-6a59645e8aa4 tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:44.014623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1072e85-350e-4efa-8462-6a59645e8aa4 tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:44.016558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1072e85-350e-4efa-8462-6a59645e8aa4 tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:44.018713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1072e85-350e-4efa-8462-6a59645e8aa4 tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:44.019580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1072e85-350e-4efa-8462-6a59645e8aa4 tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:44.020057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1072e85-350e-4efa-8462-6a59645e8aa4 tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:44.020491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1072e85-350e-4efa-8462-6a59645e8aa4 tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:44.109747 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b1072e85-350e-4efa-8462-6a59645e8aa4 tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.138952 Sep 07 12:34:44.124789 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 774/1531] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Sep 7 12:34:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:44.129859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-40a8ac31-a6ea-44bb-b6e7-bad1e3bc083d tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:44.135267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40a8ac31-a6ea-44bb-b6e7-bad1e3bc083d tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:44.135837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40a8ac31-a6ea-44bb-b6e7-bad1e3bc083d tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:44.137163 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40a8ac31-a6ea-44bb-b6e7-bad1e3bc083d tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:44.137982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40a8ac31-a6ea-44bb-b6e7-bad1e3bc083d tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:44.138448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40a8ac31-a6ea-44bb-b6e7-bad1e3bc083d tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:44.138876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40a8ac31-a6ea-44bb-b6e7-bad1e3bc083d tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:44.208823 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-40a8ac31-a6ea-44bb-b6e7-bad1e3bc083d tempest-ServicesAdminTestJSON-1946124079 tempest-ServicesAdminTestJSON-1946124079-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.082771 Sep 07 12:34:44.234240 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 775/1532] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:34:44 2022] GET /compute/v2.1/os-services => generated 944 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:44.601245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bb4a5f31-e659-4834-8532-ab32eba47431 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:44.602116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bb4a5f31-e659-4834-8532-ab32eba47431 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:44.619175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb4a5f31-e659-4834-8532-ab32eba47431 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:44.630253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb4a5f31-e659-4834-8532-ab32eba47431 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:44.630791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb4a5f31-e659-4834-8532-ab32eba47431 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:44.631584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb4a5f31-e659-4834-8532-ab32eba47431 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:44.632168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb4a5f31-e659-4834-8532-ab32eba47431 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:44.633861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb4a5f31-e659-4834-8532-ab32eba47431 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:46.449181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bb4a5f31-e659-4834-8532-ab32eba47431 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:46.466187 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bb4a5f31-e659-4834-8532-ab32eba47431 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 200 len: 1468 microversion: 2.1 time: 1.868610 Sep 07 12:34:46.472062 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 776/1533] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:44 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 1468 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:46.479930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b176815c-4173-4b90-8920-94adcd4dff52 req-f74f3c0f-5dc2-4afd-a76e-b3ed0a400c64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b849d7d-db03-43d3-b94c-3808ea7ae0cb", "name": "network-vif-unplugged", "status": "completed", "tag": "d76c4cb6-1ff0-4c6b-9d8f-eb2ec1601a0d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:34:46.513515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b176815c-4173-4b90-8920-94adcd4dff52 req-f74f3c0f-5dc2-4afd-a76e-b3ed0a400c64 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:46.517534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b176815c-4173-4b90-8920-94adcd4dff52 req-f74f3c0f-5dc2-4afd-a76e-b3ed0a400c64 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:46.520693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b176815c-4173-4b90-8920-94adcd4dff52 req-f74f3c0f-5dc2-4afd-a76e-b3ed0a400c64 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:46.562048 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b176815c-4173-4b90-8920-94adcd4dff52 req-f74f3c0f-5dc2-4afd-a76e-b3ed0a400c64 service nova] Creating event network-vif-unplugged:d76c4cb6-1ff0-4c6b-9d8f-eb2ec1601a0d for instance 7b849d7d-db03-43d3-b94c-3808ea7ae0cb on n-h2-852087-9 Sep 07 12:34:46.574854 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b176815c-4173-4b90-8920-94adcd4dff52 req-f74f3c0f-5dc2-4afd-a76e-b3ed0a400c64 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100018 Sep 07 12:34:46.576793 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 777/1534] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:46.590646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7178109d-a97f-4d26-8224-4d7742072069 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:46.599458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7178109d-a97f-4d26-8224-4d7742072069 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:46.616437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7178109d-a97f-4d26-8224-4d7742072069 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:46.619267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7178109d-a97f-4d26-8224-4d7742072069 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:46.620500 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7178109d-a97f-4d26-8224-4d7742072069 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:46.624866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7178109d-a97f-4d26-8224-4d7742072069 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:46.628765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7178109d-a97f-4d26-8224-4d7742072069 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:46.631889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7178109d-a97f-4d26-8224-4d7742072069 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:46.658996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:34:47.592176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:34:48.111901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7178109d-a97f-4d26-8224-4d7742072069 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:48.124380 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7178109d-a97f-4d26-8224-4d7742072069 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1478 microversion: 2.1 time: 1.545518 Sep 07 12:34:48.125574 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 778/1535] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:46 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1478 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:48.137749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-7cc81136-02e0-4ab4-be7f-94a279206233 req-2295db17-d5d0-4890-bce4-ddfdf0a71882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d12be6f4-80c9-404a-b6c4-d1e94e25daa9", "name": "network-vif-deleted", "tag": "50b3c60a-51cc-4ed6-8a42-813229cfb0f8"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:34:48.182578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7cc81136-02e0-4ab4-be7f-94a279206233 req-2295db17-d5d0-4890-bce4-ddfdf0a71882 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:48.183389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7cc81136-02e0-4ab4-be7f-94a279206233 req-2295db17-d5d0-4890-bce4-ddfdf0a71882 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:48.186098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7cc81136-02e0-4ab4-be7f-94a279206233 req-2295db17-d5d0-4890-bce4-ddfdf0a71882 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:48.212245 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7cc81136-02e0-4ab4-be7f-94a279206233 req-2295db17-d5d0-4890-bce4-ddfdf0a71882 service nova] Creating event network-vif-deleted:50b3c60a-51cc-4ed6-8a42-813229cfb0f8 for instance d12be6f4-80c9-404a-b6c4-d1e94e25daa9 on n-h1-852087-9 Sep 07 12:34:48.219324 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-7cc81136-02e0-4ab4-be7f-94a279206233 req-2295db17-d5d0-4890-bce4-ddfdf0a71882 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091986 Sep 07 12:34:48.222118 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 779/1536] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:48.231570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fb21cce5-b99c-4aab-97dc-982ce0fa3740 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:48.233516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fb21cce5-b99c-4aab-97dc-982ce0fa3740 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: d12be6f4-80c9-404a-b6c4-d1e94e25daa9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:48.241219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb21cce5-b99c-4aab-97dc-982ce0fa3740 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:48.242044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb21cce5-b99c-4aab-97dc-982ce0fa3740 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:48.243058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb21cce5-b99c-4aab-97dc-982ce0fa3740 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:48.244105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb21cce5-b99c-4aab-97dc-982ce0fa3740 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:48.244768 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb21cce5-b99c-4aab-97dc-982ce0fa3740 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:48.245367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb21cce5-b99c-4aab-97dc-982ce0fa3740 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:48.266458 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-fb21cce5-b99c-4aab-97dc-982ce0fa3740 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] HTTP exception thrown: Instance d12be6f4-80c9-404a-b6c4-d1e94e25daa9 could not be found. Sep 07 12:34:48.268471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fb21cce5-b99c-4aab-97dc-982ce0fa3740 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Request method failure captured: Sep 07 12:34:48.268471 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 HTTP/1.1 Sep 07 12:34:48.268471 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:34:48.268471 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:34:48.268471 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:34:48.268471 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:34:48.268471 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:34:48.268471 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:34:48.268471 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:34:48.268471 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:34:48.268471 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5wW3nECT65O0DrkDd5K_rP0D9OKKXyE-Sgm4NuZpa5ysf0UzVj7q_5NJl0y7FFG2b_o4YrA0QI-fx342SEE0uGoZcm1jE49sMgaFW0I096i_a2T98OyBypM7Ivm5ONeAQfiRnahsaWv36gDyrCE9mIO1dC4rUTAKTA1nBQ3fIVlSY Sep 07 12:34:48.268471 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:34:48.268471 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:34:48.268471 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:34:48.268471 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:34:48.268471 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:34:48.268471 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:34:48.268471 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 43a1115550de4c5185de7ca86bc17a63 Sep 07 12:34:48.268471 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-MigrationsAdminTest-1611333289 Sep 07 12:34:48.268471 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:34:48.268471 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:34:48.269966 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43a1115550de4c5185de7ca86bc17a63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_43a1115550de4c5185de7ca86bc17a63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/43a1115550de4c5185de7ca86bc17a63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43a1115550de4c5185de7ca86bc17a63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:34:48.269966 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-MigrationsAdminTest-1611333289 Sep 07 12:34:48.269966 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 43a1115550de4c5185de7ca86bc17a63 Sep 07 12:34:48.269966 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-MigrationsAdminTest-1611333289 Sep 07 12:34:48.269966 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-MigrationsAdminTest-1611333289-project Sep 07 12:34:48.269966 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:34:48.269966 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:34:48.269966 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 1b5c31587a37465a9becda30e417ed5b Sep 07 12:34:48.269966 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-MigrationsAdminTest-1611333289-project Sep 07 12:34:48.269966 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:34:48.269966 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance d12be6f4-80c9-404a-b6c4-d1e94e25daa9 could not be found. Sep 07 12:34:48.269966 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'd12be6f4-80c9-404a-b6c4-d1e94e25daa9'} Sep 07 12:34:48.271631 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:34:48.271631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:34:48.271631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:34:48.271631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:34:48.271631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:34:48.271631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:34:48.271631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:34:48.271631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:34:48.271631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:34:48.271631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:34:48.271631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d12be6f4-80c9-404a-b6c4-d1e94e25daa9 could not be found. Sep 07 12:34:48.271631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:34:48.271631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:34:48.271631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:34:48.271631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:34:48.271631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:34:48.271631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:34:48.271631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:34:48.271631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:34:48.271631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:34:48.272913 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:34:48.272913 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:34:48.272913 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:34:48.272913 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:34:48.272913 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:34:48.272913 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:34:48.272913 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:34:48.272913 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d12be6f4-80c9-404a-b6c4-d1e94e25daa9 could not be found. Sep 07 12:34:48.272913 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:34:48.272913 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:34:48.272913 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:34:48.272913 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:34:48.272913 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:34:48.272913 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:34:48.272913 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:34:48.272913 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:34:48.272913 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d12be6f4-80c9-404a-b6c4-d1e94e25daa9 could not be found. Sep 07 12:34:48.272913 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:34:48.276981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fb21cce5-b99c-4aab-97dc-982ce0fa3740 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Returning 404 to user: Instance d12be6f4-80c9-404a-b6c4-d1e94e25daa9 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:34:48.279107 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fb21cce5-b99c-4aab-97dc-982ce0fa3740 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9" status: 404 len: 111 microversion: 2.1 time: 0.054461 Sep 07 12:34:48.285825 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 780/1537] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:48 2022] GET /compute/v2.1/servers/d12be6f4-80c9-404a-b6c4-d1e94e25daa9 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:34:48.296323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5a2f3e20-1be7-48ac-b681-d5988eaee5e2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:48.296833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5a2f3e20-1be7-48ac-b681-d5988eaee5e2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:48.306116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a2f3e20-1be7-48ac-b681-d5988eaee5e2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:48.307665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a2f3e20-1be7-48ac-b681-d5988eaee5e2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:48.308386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a2f3e20-1be7-48ac-b681-d5988eaee5e2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:48.309352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a2f3e20-1be7-48ac-b681-d5988eaee5e2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:48.310070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a2f3e20-1be7-48ac-b681-d5988eaee5e2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:48.315272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a2f3e20-1be7-48ac-b681-d5988eaee5e2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:48.351328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5a2f3e20-1be7-48ac-b681-d5988eaee5e2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:34:48.440365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=9 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:34:48.537211 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5a2f3e20-1be7-48ac-b681-d5988eaee5e2 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "DELETE /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 204 len: 0 microversion: 2.1 time: 0.248837 Sep 07 12:34:48.539045 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 781/1538] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:34:48 2022] DELETE /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:34:48.560487 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5f168caf-1fef-43de-a683-e4df452402df tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:48.564254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5f168caf-1fef-43de-a683-e4df452402df tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:48.586872 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f168caf-1fef-43de-a683-e4df452402df tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:48.588755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f168caf-1fef-43de-a683-e4df452402df tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:48.591199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f168caf-1fef-43de-a683-e4df452402df tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:48.596710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f168caf-1fef-43de-a683-e4df452402df tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:48.598215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f168caf-1fef-43de-a683-e4df452402df tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:48.599533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f168caf-1fef-43de-a683-e4df452402df tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:48.954726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5f168caf-1fef-43de-a683-e4df452402df tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:48.966907 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5f168caf-1fef-43de-a683-e4df452402df tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1535 microversion: 2.1 time: 0.417391 Sep 07 12:34:48.970611 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 782/1539] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:48 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1535 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:48.987661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-ac6057e0-5268-4acb-bb3f-99357c9d5e6f req-8a97166a-7495-4720-991b-1d7dbe9893c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b849d7d-db03-43d3-b94c-3808ea7ae0cb", "name": "network-vif-plugged", "status": "completed", "tag": "d76c4cb6-1ff0-4c6b-9d8f-eb2ec1601a0d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:34:49.017338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ac6057e0-5268-4acb-bb3f-99357c9d5e6f req-8a97166a-7495-4720-991b-1d7dbe9893c1 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:49.017863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ac6057e0-5268-4acb-bb3f-99357c9d5e6f req-8a97166a-7495-4720-991b-1d7dbe9893c1 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:49.018309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ac6057e0-5268-4acb-bb3f-99357c9d5e6f req-8a97166a-7495-4720-991b-1d7dbe9893c1 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:49.048699 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-ac6057e0-5268-4acb-bb3f-99357c9d5e6f req-8a97166a-7495-4720-991b-1d7dbe9893c1 service nova] Creating event network-vif-plugged:d76c4cb6-1ff0-4c6b-9d8f-eb2ec1601a0d for instance 7b849d7d-db03-43d3-b94c-3808ea7ae0cb on n-h2-852087-9 Sep 07 12:34:49.054910 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-ac6057e0-5268-4acb-bb3f-99357c9d5e6f req-8a97166a-7495-4720-991b-1d7dbe9893c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080370 Sep 07 12:34:49.055538 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 783/1540] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:49.159625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-52198751-97e0-4c66-b9cf-8dad519ac070 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:49.161348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-52198751-97e0-4c66-b9cf-8dad519ac070 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:49.170492 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52198751-97e0-4c66-b9cf-8dad519ac070 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:49.186100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52198751-97e0-4c66-b9cf-8dad519ac070 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:49.188959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52198751-97e0-4c66-b9cf-8dad519ac070 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:49.192062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52198751-97e0-4c66-b9cf-8dad519ac070 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:49.199446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52198751-97e0-4c66-b9cf-8dad519ac070 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:49.202684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52198751-97e0-4c66-b9cf-8dad519ac070 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:49.752384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-52198751-97e0-4c66-b9cf-8dad519ac070 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:49.765994 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-52198751-97e0-4c66-b9cf-8dad519ac070 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1478 microversion: 2.1 time: 0.612186 Sep 07 12:34:49.766717 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 784/1541] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:49 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1478 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:34:49.998593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fa1e43c5-cca8-48e0-b02e-6cd1bae7887d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:49.999795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fa1e43c5-cca8-48e0-b02e-6cd1bae7887d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:50.015855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa1e43c5-cca8-48e0-b02e-6cd1bae7887d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:50.018404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa1e43c5-cca8-48e0-b02e-6cd1bae7887d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:50.020019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa1e43c5-cca8-48e0-b02e-6cd1bae7887d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:50.022067 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa1e43c5-cca8-48e0-b02e-6cd1bae7887d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:50.022579 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa1e43c5-cca8-48e0-b02e-6cd1bae7887d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:50.023131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa1e43c5-cca8-48e0-b02e-6cd1bae7887d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:50.434002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fa1e43c5-cca8-48e0-b02e-6cd1bae7887d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:50.447268 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fa1e43c5-cca8-48e0-b02e-6cd1bae7887d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1535 microversion: 2.1 time: 0.454462 Sep 07 12:34:50.449242 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 785/1542] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:49 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1535 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:34:50.813953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2cf9b64c-d0ee-4f89-9d02-a45810dfbd9c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:50.823393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2cf9b64c-d0ee-4f89-9d02-a45810dfbd9c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:50.861541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cf9b64c-d0ee-4f89-9d02-a45810dfbd9c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:50.868006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cf9b64c-d0ee-4f89-9d02-a45810dfbd9c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:50.870370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cf9b64c-d0ee-4f89-9d02-a45810dfbd9c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:50.882672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cf9b64c-d0ee-4f89-9d02-a45810dfbd9c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:50.918263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cf9b64c-d0ee-4f89-9d02-a45810dfbd9c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:50.919164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cf9b64c-d0ee-4f89-9d02-a45810dfbd9c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:51.327985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2cf9b64c-d0ee-4f89-9d02-a45810dfbd9c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:51.353231 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2cf9b64c-d0ee-4f89-9d02-a45810dfbd9c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1478 microversion: 2.1 time: 0.546782 Sep 07 12:34:51.371664 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 786/1543] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:50 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1478 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:34:51.491103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-711515fc-fd21-4292-b52e-240df986c86f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:51.492020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-711515fc-fd21-4292-b52e-240df986c86f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:51.517318 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-711515fc-fd21-4292-b52e-240df986c86f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:51.517682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-711515fc-fd21-4292-b52e-240df986c86f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:51.519291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-711515fc-fd21-4292-b52e-240df986c86f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:51.521285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-711515fc-fd21-4292-b52e-240df986c86f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:51.526398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-711515fc-fd21-4292-b52e-240df986c86f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:51.526987 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-711515fc-fd21-4292-b52e-240df986c86f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:51.870101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-711515fc-fd21-4292-b52e-240df986c86f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:51.880124 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-711515fc-fd21-4292-b52e-240df986c86f tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1535 microversion: 2.1 time: 0.396389 Sep 07 12:34:51.881375 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 787/1544] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:51 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1535 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:34:52.384470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7327c3e2-b8e1-4a56-9042-1816cf18699d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:52.385103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7327c3e2-b8e1-4a56-9042-1816cf18699d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:52.403631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7327c3e2-b8e1-4a56-9042-1816cf18699d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:52.404148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7327c3e2-b8e1-4a56-9042-1816cf18699d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:52.404592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7327c3e2-b8e1-4a56-9042-1816cf18699d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:52.423531 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7327c3e2-b8e1-4a56-9042-1816cf18699d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:52.424063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7327c3e2-b8e1-4a56-9042-1816cf18699d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:52.424510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7327c3e2-b8e1-4a56-9042-1816cf18699d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:52.962334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7327c3e2-b8e1-4a56-9042-1816cf18699d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:52.990867 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7327c3e2-b8e1-4a56-9042-1816cf18699d tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1478 microversion: 2.1 time: 0.610227 Sep 07 12:34:53.021318 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 788/1545] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:52 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1478 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:34:53.055455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-44140c50-bb36-4a69-aba0-a6f4668ebccb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:53.071896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-44140c50-bb36-4a69-aba0-a6f4668ebccb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:53.128337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44140c50-bb36-4a69-aba0-a6f4668ebccb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:53.131747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44140c50-bb36-4a69-aba0-a6f4668ebccb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:53.141253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44140c50-bb36-4a69-aba0-a6f4668ebccb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:53.143239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44140c50-bb36-4a69-aba0-a6f4668ebccb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:53.146663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44140c50-bb36-4a69-aba0-a6f4668ebccb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:53.153135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44140c50-bb36-4a69-aba0-a6f4668ebccb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:53.836051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-44140c50-bb36-4a69-aba0-a6f4668ebccb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:53.868150 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-44140c50-bb36-4a69-aba0-a6f4668ebccb tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1535 microversion: 2.1 time: 0.843339 Sep 07 12:34:53.875744 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 789/1546] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:53 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1535 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:54.143703 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:34:54.175604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-38d851a9-c4f5-4364-94c0-a06ddff6060d tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:54.180634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38d851a9-c4f5-4364-94c0-a06ddff6060d tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:54.181213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38d851a9-c4f5-4364-94c0-a06ddff6060d tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:54.181701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38d851a9-c4f5-4364-94c0-a06ddff6060d tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:54.182458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38d851a9-c4f5-4364-94c0-a06ddff6060d tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:54.182922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38d851a9-c4f5-4364-94c0-a06ddff6060d tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:54.183355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38d851a9-c4f5-4364-94c0-a06ddff6060d tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:54.276115 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-38d851a9-c4f5-4364-94c0-a06ddff6060d tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.398540 Sep 07 12:34:54.278544 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 790/1547] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:34:53 2022] GET /compute/v2.1/os-services => generated 944 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:54.290392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7fe3f9f7-da17-41d7-8dc2-c20466dae2fe tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:54.300161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7fe3f9f7-da17-41d7-8dc2-c20466dae2fe tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:54.314056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fe3f9f7-da17-41d7-8dc2-c20466dae2fe tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:54.315685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fe3f9f7-da17-41d7-8dc2-c20466dae2fe tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:54.317052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fe3f9f7-da17-41d7-8dc2-c20466dae2fe tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:54.318069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fe3f9f7-da17-41d7-8dc2-c20466dae2fe tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:54.318720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fe3f9f7-da17-41d7-8dc2-c20466dae2fe tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:54.319333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fe3f9f7-da17-41d7-8dc2-c20466dae2fe tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:54.734094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7fe3f9f7-da17-41d7-8dc2-c20466dae2fe tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:54.746828 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7fe3f9f7-da17-41d7-8dc2-c20466dae2fe tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1478 microversion: 2.1 time: 0.466210 Sep 07 12:34:54.750828 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 791/1548] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:54 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1478 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:54.765301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-176b9ee8-c418-40cb-851c-bf6797b19c73 req-d37607e5-f300-4a50-a0a7-7b0ba7bcce0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "128cc68c-e4de-4502-8e18-d84f25904060", "name": "network-vif-deleted", "tag": "45364459-d3da-4357-9b05-ec8cab358164"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:34:54.776324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-176b9ee8-c418-40cb-851c-bf6797b19c73 req-d37607e5-f300-4a50-a0a7-7b0ba7bcce0f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:54.777234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-176b9ee8-c418-40cb-851c-bf6797b19c73 req-d37607e5-f300-4a50-a0a7-7b0ba7bcce0f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:54.777873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-176b9ee8-c418-40cb-851c-bf6797b19c73 req-d37607e5-f300-4a50-a0a7-7b0ba7bcce0f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:54.791884 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-176b9ee8-c418-40cb-851c-bf6797b19c73 req-d37607e5-f300-4a50-a0a7-7b0ba7bcce0f service nova] Creating event network-vif-deleted:45364459-d3da-4357-9b05-ec8cab358164 for instance 128cc68c-e4de-4502-8e18-d84f25904060 on n-h2-852087-9 Sep 07 12:34:54.797788 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-176b9ee8-c418-40cb-851c-bf6797b19c73 req-d37607e5-f300-4a50-a0a7-7b0ba7bcce0f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045362 Sep 07 12:34:54.799357 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 792/1549] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:54.804882 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e3e30822-db96-4c3a-ac55-245c8c5657b3 tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:54.810073 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3e30822-db96-4c3a-ac55-245c8c5657b3 tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:54.810858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3e30822-db96-4c3a-ac55-245c8c5657b3 tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:54.811498 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3e30822-db96-4c3a-ac55-245c8c5657b3 tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:54.812458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3e30822-db96-4c3a-ac55-245c8c5657b3 tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:54.813111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3e30822-db96-4c3a-ac55-245c8c5657b3 tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:54.813747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3e30822-db96-4c3a-ac55-245c8c5657b3 tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:54.860590 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e3e30822-db96-4c3a-ac55-245c8c5657b3 tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.059602 Sep 07 12:34:54.861874 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 793/1550] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Sep 7 12:34:54 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:54.879957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4c17aa89-7236-43e4-8f5c-e1e91762b7fb tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:54.886314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c17aa89-7236-43e4-8f5c-e1e91762b7fb tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:54.887318 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c17aa89-7236-43e4-8f5c-e1e91762b7fb tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:54.888023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c17aa89-7236-43e4-8f5c-e1e91762b7fb tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:54.889361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c17aa89-7236-43e4-8f5c-e1e91762b7fb tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:54.891284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c17aa89-7236-43e4-8f5c-e1e91762b7fb tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:54.892099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c17aa89-7236-43e4-8f5c-e1e91762b7fb tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:54.927238 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4c17aa89-7236-43e4-8f5c-e1e91762b7fb tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.052357 Sep 07 12:34:54.930385 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 794/1551] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:34:54 2022] GET /compute/v2.1/os-services => generated 944 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:34:54.939222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-718dfeb0-9d74-427e-9897-2eda2edd4f63 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:54.940282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-718dfeb0-9d74-427e-9897-2eda2edd4f63 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:54.948194 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-718dfeb0-9d74-427e-9897-2eda2edd4f63 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:54.948996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-718dfeb0-9d74-427e-9897-2eda2edd4f63 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:54.949631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-718dfeb0-9d74-427e-9897-2eda2edd4f63 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:54.950654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-718dfeb0-9d74-427e-9897-2eda2edd4f63 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:54.951927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-718dfeb0-9d74-427e-9897-2eda2edd4f63 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:54.952558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-718dfeb0-9d74-427e-9897-2eda2edd4f63 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:55.163201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-718dfeb0-9d74-427e-9897-2eda2edd4f63 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:55.181184 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-718dfeb0-9d74-427e-9897-2eda2edd4f63 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1364 microversion: 2.1 time: 0.246035 Sep 07 12:34:55.184589 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 795/1552] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:54 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1364 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:55.201769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-62c853df-da7b-4ae4-951a-c1c5a1b7f79b tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:55.208866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62c853df-da7b-4ae4-951a-c1c5a1b7f79b tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:55.210977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62c853df-da7b-4ae4-951a-c1c5a1b7f79b tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:55.212146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62c853df-da7b-4ae4-951a-c1c5a1b7f79b tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:55.213922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62c853df-da7b-4ae4-951a-c1c5a1b7f79b tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:55.215122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62c853df-da7b-4ae4-951a-c1c5a1b7f79b tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:55.216254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62c853df-da7b-4ae4-951a-c1c5a1b7f79b tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:55.316382 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-62c853df-da7b-4ae4-951a-c1c5a1b7f79b tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-852087-9&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.125529 Sep 07 12:34:55.329526 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 796/1553] 10.222.0.16 () {58 vars in 1194 bytes} [Wed Sep 7 12:34:55 2022] GET /compute/v2.1/os-services?host=n-d-852087-9&binary=xxx => generated 16 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:34:55.341069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-82b51d02-c54f-4124-a874-49ca80cbcd35 tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:55.348602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82b51d02-c54f-4124-a874-49ca80cbcd35 tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:55.349465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82b51d02-c54f-4124-a874-49ca80cbcd35 tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:55.350262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82b51d02-c54f-4124-a874-49ca80cbcd35 tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:55.352491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82b51d02-c54f-4124-a874-49ca80cbcd35 tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:55.353426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82b51d02-c54f-4124-a874-49ca80cbcd35 tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:55.354250 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82b51d02-c54f-4124-a874-49ca80cbcd35 tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:55.429230 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-82b51d02-c54f-4124-a874-49ca80cbcd35 tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.095572 Sep 07 12:34:55.433545 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 797/1554] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:34:55 2022] GET /compute/v2.1/os-services => generated 944 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:34:55.466059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-90e7e2e8-ee01-4cf0-a425-8042563390f3 tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:55.486155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90e7e2e8-ee01-4cf0-a425-8042563390f3 tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:55.491140 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90e7e2e8-ee01-4cf0-a425-8042563390f3 tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:55.495809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90e7e2e8-ee01-4cf0-a425-8042563390f3 tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:55.500125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90e7e2e8-ee01-4cf0-a425-8042563390f3 tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:55.505539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90e7e2e8-ee01-4cf0-a425-8042563390f3 tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:55.507058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90e7e2e8-ee01-4cf0-a425-8042563390f3 tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:55.620741 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-90e7e2e8-ee01-4cf0-a425-8042563390f3 tempest-ServicesAdminNegativeTestJSON-1371763688 tempest-ServicesAdminNegativeTestJSON-1371763688-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.1 time: 0.173976 Sep 07 12:34:55.623269 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 798/1555] 10.222.0.16 () {58 vars in 1198 bytes} [Wed Sep 7 12:34:55 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:34:55.971709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c9801e17-2a0c-4df0-b6fd-5b102950bdfc tempest-ServicesAdminNegativeTestJSON-471546618 tempest-ServicesAdminNegativeTestJSON-471546618-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:55.977218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c9801e17-2a0c-4df0-b6fd-5b102950bdfc tempest-ServicesAdminNegativeTestJSON-471546618 tempest-ServicesAdminNegativeTestJSON-471546618-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'db73bbeaa47d4880829b8f935572d5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6801ab928c437688624eb72f2a8bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:55.995562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c9801e17-2a0c-4df0-b6fd-5b102950bdfc tempest-ServicesAdminNegativeTestJSON-471546618 tempest-ServicesAdminNegativeTestJSON-471546618-project] Request method failure captured: Sep 07 12:34:55.995562 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 07 12:34:55.995562 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:34:55.995562 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:34:55.995562 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:34:55.995562 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:34:55.995562 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:34:55.995562 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:34:55.995562 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:34:55.995562 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:34:55.995562 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI_rdGTYfTQ2cZugXPvA-Xc-wzxx2RwDCYw2pH86dYdSYsC3whYtTvx8SgpCaoGyRfG3Ssrpa7n822fYjdnaX-u_MX2Pf8FItaQxL-ABMkE8_lsWPEalK-fROOVyQghWCRpQVzNaMpGCj6w04kyJVSHTMnTxtU-o9xrT_JI8bt82JFg Sep 07 12:34:55.995562 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:34:55.995562 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:34:55.995562 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:34:55.995562 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:34:55.995562 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:34:55.995562 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:34:55.995562 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 1b6801ab928c437688624eb72f2a8bf8 Sep 07 12:34:55.995562 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-471546618 Sep 07 12:34:55.995562 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:34:55.995562 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:34:55.998587 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b6801ab928c437688624eb72f2a8bf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1b6801ab928c437688624eb72f2a8bf8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1b6801ab928c437688624eb72f2a8bf8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1b6801ab928c437688624eb72f2a8bf8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:34:55.998587 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-471546618 Sep 07 12:34:55.998587 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 1b6801ab928c437688624eb72f2a8bf8 Sep 07 12:34:55.998587 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-471546618 Sep 07 12:34:55.998587 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServicesAdminNegativeTestJSON-471546618-project Sep 07 12:34:55.998587 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:34:55.998587 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:34:55.998587 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: db73bbeaa47d4880829b8f935572d5f1 Sep 07 12:34:55.998587 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-471546618-project Sep 07 12:34:55.998587 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:34:55.998587 n-d-852087-9 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 07 12:34:55.998587 n-d-852087-9 devstack@n-api.service[122432]: action_args: {} Sep 07 12:34:56.000272 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:34:56.000272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:34:56.000272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:34:56.000272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:34:56.000272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:34:56.000272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:34:56.000272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 12:34:56.000272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:34:56.000272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 12:34:56.000272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:34:56.000272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:34:56.000272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:34:56.000272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 07 12:34:56.000272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 07 12:34:56.000272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:34:56.000272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:34:56.000272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:34:56.000272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:34:56.000272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:34:56.008002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:34:56.008002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:34:56.008002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:34:56.008002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:34:56.008002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:34:56.008002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:34:56.008002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:34:56.008002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:34:56.008002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:34:56.008002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 07 12:34:56.008002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:34:56.008002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:34:56.008002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:34:56.008002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:34:56.008002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:34:56.008002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:34:56.008002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:34:56.008002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:34:56.008002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 07 12:34:56.008002 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:34:56.012244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c9801e17-2a0c-4df0-b6fd-5b102950bdfc tempest-ServicesAdminNegativeTestJSON-471546618 tempest-ServicesAdminNegativeTestJSON-471546618-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:34:56.012244 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c9801e17-2a0c-4df0-b6fd-5b102950bdfc tempest-ServicesAdminNegativeTestJSON-471546618 tempest-ServicesAdminNegativeTestJSON-471546618-project] 10.222.0.16 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.356528 Sep 07 12:34:56.012244 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 799/1556] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:34:55 2022] GET /compute/v2.1/os-services => generated 112 bytes in 363 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:34:56.012244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dfdb8990-75c9-41a0-8ac0-a48d021f23af tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:56.021896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dfdb8990-75c9-41a0-8ac0-a48d021f23af tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:56.042146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=97,nova_api:UPDATE=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:34:56.109678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfdb8990-75c9-41a0-8ac0-a48d021f23af tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:56.116458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfdb8990-75c9-41a0-8ac0-a48d021f23af tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:56.119555 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfdb8990-75c9-41a0-8ac0-a48d021f23af tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:56.124374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfdb8990-75c9-41a0-8ac0-a48d021f23af tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:56.127184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfdb8990-75c9-41a0-8ac0-a48d021f23af tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:56.129307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfdb8990-75c9-41a0-8ac0-a48d021f23af tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:56.712936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dfdb8990-75c9-41a0-8ac0-a48d021f23af tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:56.716812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:34:56.728343 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dfdb8990-75c9-41a0-8ac0-a48d021f23af tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1463 microversion: 2.1 time: 0.727912 Sep 07 12:34:56.746401 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 800/1557] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:55 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1463 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:56.760441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f2afaea3-4bc9-4867-ab8a-a9372e9725a3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:56.761765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f2afaea3-4bc9-4867-ab8a-a9372e9725a3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:56.769581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2afaea3-4bc9-4867-ab8a-a9372e9725a3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:56.770553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2afaea3-4bc9-4867-ab8a-a9372e9725a3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:56.771262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2afaea3-4bc9-4867-ab8a-a9372e9725a3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:56.772352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2afaea3-4bc9-4867-ab8a-a9372e9725a3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:56.773069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2afaea3-4bc9-4867-ab8a-a9372e9725a3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:56.773781 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2afaea3-4bc9-4867-ab8a-a9372e9725a3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:56.843278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2afaea3-4bc9-4867-ab8a-a9372e9725a3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:56.843770 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2afaea3-4bc9-4867-ab8a-a9372e9725a3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:56.844552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2afaea3-4bc9-4867-ab8a-a9372e9725a3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:56.845442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-f2afaea3-4bc9-4867-ab8a-a9372e9725a3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lazy-loading 'fault' on Instance uuid 128cc68c-e4de-4502-8e18-d84f25904060 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:34:56.927637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f2afaea3-4bc9-4867-ab8a-a9372e9725a3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:56.959210 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f2afaea3-4bc9-4867-ab8a-a9372e9725a3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 200 len: 1369 microversion: 2.1 time: 0.210867 Sep 07 12:34:57.019966 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 801/1558] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:56 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 1369 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:57.035972 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a1437cb4-8dae-49d9-87c3-91679f96323f tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:34:57.048916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a1437cb4-8dae-49d9-87c3-91679f96323f tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:57.077207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1437cb4-8dae-49d9-87c3-91679f96323f tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:57.079501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1437cb4-8dae-49d9-87c3-91679f96323f tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:57.085891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1437cb4-8dae-49d9-87c3-91679f96323f tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:57.091098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1437cb4-8dae-49d9-87c3-91679f96323f tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:57.092156 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1437cb4-8dae-49d9-87c3-91679f96323f tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:57.095189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1437cb4-8dae-49d9-87c3-91679f96323f tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:57.280652 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a1437cb4-8dae-49d9-87c3-91679f96323f tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb/action" status: 202 len: 0 microversion: 2.1 time: 0.256235 Sep 07 12:34:57.285946 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 802/1559] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:34:57 2022] POST /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:34:57.291891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c2bd0a4d-b697-46a9-acf9-9aa29c63ae4a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:57.292684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c2bd0a4d-b697-46a9-acf9-9aa29c63ae4a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:57.305440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2bd0a4d-b697-46a9-acf9-9aa29c63ae4a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:57.307405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2bd0a4d-b697-46a9-acf9-9aa29c63ae4a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:57.308012 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2bd0a4d-b697-46a9-acf9-9aa29c63ae4a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:57.312742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2bd0a4d-b697-46a9-acf9-9aa29c63ae4a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:57.313763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2bd0a4d-b697-46a9-acf9-9aa29c63ae4a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:57.315252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2bd0a4d-b697-46a9-acf9-9aa29c63ae4a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:57.365405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2bd0a4d-b697-46a9-acf9-9aa29c63ae4a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:57.366112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2bd0a4d-b697-46a9-acf9-9aa29c63ae4a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:57.366643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2bd0a4d-b697-46a9-acf9-9aa29c63ae4a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:57.367460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-c2bd0a4d-b697-46a9-acf9-9aa29c63ae4a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lazy-loading 'fault' on Instance uuid 7b849d7d-db03-43d3-b94c-3808ea7ae0cb {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:34:57.691381 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c2bd0a4d-b697-46a9-acf9-9aa29c63ae4a tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1597 microversion: 2.1 time: 0.399814 Sep 07 12:34:57.696352 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 803/1560] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:57 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1597 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:57.719860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd2812ab-e560-45d1-89fa-694e24ceaf44 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:34:57.724260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dd2812ab-e560-45d1-89fa-694e24ceaf44 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:57.740476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd2812ab-e560-45d1-89fa-694e24ceaf44 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:57.741745 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd2812ab-e560-45d1-89fa-694e24ceaf44 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:57.743225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd2812ab-e560-45d1-89fa-694e24ceaf44 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:57.744317 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd2812ab-e560-45d1-89fa-694e24ceaf44 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:57.750699 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd2812ab-e560-45d1-89fa-694e24ceaf44 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:57.751668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd2812ab-e560-45d1-89fa-694e24ceaf44 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:57.909467 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dd2812ab-e560-45d1-89fa-694e24ceaf44 tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb/action" status: 202 len: 0 microversion: 2.1 time: 0.194324 Sep 07 12:34:57.913249 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 804/1561] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:34:57 2022] POST /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 12:34:57.923924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fe10365d-e89c-4195-b5c0-b1ce4719ae2d tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:57.924574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fe10365d-e89c-4195-b5c0-b1ce4719ae2d tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:57.932323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe10365d-e89c-4195-b5c0-b1ce4719ae2d tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:57.932819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe10365d-e89c-4195-b5c0-b1ce4719ae2d tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:57.933337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe10365d-e89c-4195-b5c0-b1ce4719ae2d tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:57.934119 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe10365d-e89c-4195-b5c0-b1ce4719ae2d tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:57.934595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe10365d-e89c-4195-b5c0-b1ce4719ae2d tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:57.935028 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe10365d-e89c-4195-b5c0-b1ce4719ae2d tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:58.299684 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fe10365d-e89c-4195-b5c0-b1ce4719ae2d tempest-ServersAdminTestJSON-233605906 tempest-ServersAdminTestJSON-233605906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1614 microversion: 2.1 time: 0.384069 Sep 07 12:34:58.314701 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 805/1562] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:57 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1614 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:34:58.326773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c76c8f78-baad-4b88-92f8-6e4ba781283a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:58.327331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c76c8f78-baad-4b88-92f8-6e4ba781283a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: 128cc68c-e4de-4502-8e18-d84f25904060] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:58.335189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c76c8f78-baad-4b88-92f8-6e4ba781283a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:58.335791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c76c8f78-baad-4b88-92f8-6e4ba781283a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:58.336261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c76c8f78-baad-4b88-92f8-6e4ba781283a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:58.337068 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c76c8f78-baad-4b88-92f8-6e4ba781283a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:58.337819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c76c8f78-baad-4b88-92f8-6e4ba781283a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:58.338268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c76c8f78-baad-4b88-92f8-6e4ba781283a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:58.358648 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-c76c8f78-baad-4b88-92f8-6e4ba781283a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] HTTP exception thrown: Instance 128cc68c-e4de-4502-8e18-d84f25904060 could not be found. Sep 07 12:34:58.360841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c76c8f78-baad-4b88-92f8-6e4ba781283a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Request method failure captured: Sep 07 12:34:58.360841 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 HTTP/1.1 Sep 07 12:34:58.360841 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:34:58.360841 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:34:58.360841 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:34:58.360841 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:34:58.360841 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:34:58.360841 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:34:58.360841 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:34:58.360841 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:34:58.360841 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5wW3nECT65O0DrkDd5K_rP0D9OKKXyE-Sgm4NuZpa5ysf0UzVj7q_5NJl0y7FFG2b_o4YrA0QI-fx342SEE0uGoZcm1jE49sMgaFW0I096i_a2T98OyBypM7Ivm5ONeAQfiRnahsaWv36gDyrCE9mIO1dC4rUTAKTA1nBQ3fIVlSY Sep 07 12:34:58.360841 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:34:58.360841 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:34:58.360841 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:34:58.360841 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:34:58.360841 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:34:58.360841 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:34:58.360841 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 43a1115550de4c5185de7ca86bc17a63 Sep 07 12:34:58.360841 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-MigrationsAdminTest-1611333289 Sep 07 12:34:58.360841 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:34:58.360841 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:34:58.362555 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43a1115550de4c5185de7ca86bc17a63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_43a1115550de4c5185de7ca86bc17a63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/43a1115550de4c5185de7ca86bc17a63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43a1115550de4c5185de7ca86bc17a63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:34:58.362555 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-MigrationsAdminTest-1611333289 Sep 07 12:34:58.362555 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 43a1115550de4c5185de7ca86bc17a63 Sep 07 12:34:58.362555 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-MigrationsAdminTest-1611333289 Sep 07 12:34:58.362555 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-MigrationsAdminTest-1611333289-project Sep 07 12:34:58.362555 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:34:58.362555 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:34:58.362555 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 1b5c31587a37465a9becda30e417ed5b Sep 07 12:34:58.362555 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-MigrationsAdminTest-1611333289-project Sep 07 12:34:58.362555 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:34:58.362555 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 128cc68c-e4de-4502-8e18-d84f25904060 could not be found. Sep 07 12:34:58.362555 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '128cc68c-e4de-4502-8e18-d84f25904060'} Sep 07 12:34:58.363438 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:34:58.363438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:34:58.363438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:34:58.363438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:34:58.363438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:34:58.363438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:34:58.363438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:34:58.363438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:34:58.363438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:34:58.363438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:34:58.363438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 128cc68c-e4de-4502-8e18-d84f25904060 could not be found. Sep 07 12:34:58.363438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:34:58.363438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:34:58.363438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:34:58.363438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:34:58.363438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:34:58.363438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:34:58.363438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:34:58.363438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:34:58.363438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:34:58.364932 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:34:58.364932 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:34:58.364932 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:34:58.364932 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:34:58.364932 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:34:58.364932 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:34:58.364932 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:34:58.364932 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 128cc68c-e4de-4502-8e18-d84f25904060 could not be found. Sep 07 12:34:58.364932 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:34:58.364932 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:34:58.364932 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:34:58.364932 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:34:58.364932 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:34:58.364932 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:34:58.364932 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:34:58.364932 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:34:58.364932 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 128cc68c-e4de-4502-8e18-d84f25904060 could not be found. Sep 07 12:34:58.364932 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:34:58.366285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c76c8f78-baad-4b88-92f8-6e4ba781283a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Returning 404 to user: Instance 128cc68c-e4de-4502-8e18-d84f25904060 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:34:58.366285 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c76c8f78-baad-4b88-92f8-6e4ba781283a tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060" status: 404 len: 111 microversion: 2.1 time: 0.045874 Sep 07 12:34:58.366285 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 806/1563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:58 2022] GET /compute/v2.1/servers/128cc68c-e4de-4502-8e18-d84f25904060 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:34:58.376644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d54facf2-05f3-4faf-946e-2473f3c3ea37 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:58.376981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d54facf2-05f3-4faf-946e-2473f3c3ea37 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:58.384461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d54facf2-05f3-4faf-946e-2473f3c3ea37 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:58.385042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d54facf2-05f3-4faf-946e-2473f3c3ea37 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:58.385566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d54facf2-05f3-4faf-946e-2473f3c3ea37 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:58.386463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d54facf2-05f3-4faf-946e-2473f3c3ea37 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:58.386937 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d54facf2-05f3-4faf-946e-2473f3c3ea37 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:58.387370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d54facf2-05f3-4faf-946e-2473f3c3ea37 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:58.418551 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d54facf2-05f3-4faf-946e-2473f3c3ea37 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:34:58.430604 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7a56858b-ff19-48e2-9772-b150d6fb2dc3 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60" status: 200 len: 1412 microversion: 2.1 time: 19.969398 Sep 07 12:34:58.433863 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 758/1564] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:34:38 2022] GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60 => generated 1412 bytes in 19973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:58.465144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ff826b6-13ca-4f07-b7fe-d9a5a87b4349 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '.version_select at 0x7fc4192d5310>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:58.510583 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ff826b6-13ca-4f07-b7fe-d9a5a87b4349 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-103927303" status: 202 len: 0 microversion: 2.1 time: 0.075098 Sep 07 12:34:58.511500 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 759/1565] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Sep 7 12:34:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-103927303 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:34:58.551002 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d54facf2-05f3-4faf-946e-2473f3c3ea37 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 204 len: 0 microversion: 2.1 time: 0.183171 Sep 07 12:34:58.552465 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 807/1566] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:34:58 2022] DELETE /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:34:58.565536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6c54ed08-e3fa-4243-bbee-a080d4b50469 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:58.567283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6c54ed08-e3fa-4243-bbee-a080d4b50469 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:34:58.584117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c54ed08-e3fa-4243-bbee-a080d4b50469 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:58.585102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c54ed08-e3fa-4243-bbee-a080d4b50469 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:58.586400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c54ed08-e3fa-4243-bbee-a080d4b50469 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:58.587747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c54ed08-e3fa-4243-bbee-a080d4b50469 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:34:58.588937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c54ed08-e3fa-4243-bbee-a080d4b50469 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:34:58.590899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c54ed08-e3fa-4243-bbee-a080d4b50469 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:34:58.978972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6c54ed08-e3fa-4243-bbee-a080d4b50469 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:34:59.004889 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6c54ed08-e3fa-4243-bbee-a080d4b50469 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1469 microversion: 2.1 time: 0.446537 Sep 07 12:34:59.006726 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 760/1567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:58 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1469 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:59.468248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a9599626-da59-495a-9b31-731990341ae7 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc419662310>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:59.583518 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a9599626-da59-495a-9b31-731990341ae7 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60" status: 200 len: 1421 microversion: 2.1 time: 0.123645 Sep 07 12:34:59.598584 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 808/1568] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:34:59 2022] GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60 => generated 1421 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:59.610795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-13c32db4-4786-40a0-9b24-f66ddf7e597e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc4192ac700>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:34:59.705203 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-13c32db4-4786-40a0-9b24-f66ddf7e597e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60" status: 200 len: 1421 microversion: 2.1 time: 0.103778 Sep 07 12:34:59.710222 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 761/1569] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:34:59 2022] GET /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60 => generated 1421 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:34:59.735021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0119cd87-51fa-4ea7-9cd9-5fd21f534b3e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc419559670>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:00.030976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d7f54e25-87fb-455e-8cf3-6ad5c9cdb481 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:00.031909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d7f54e25-87fb-455e-8cf3-6ad5c9cdb481 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:00.063278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7f54e25-87fb-455e-8cf3-6ad5c9cdb481 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:00.063783 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7f54e25-87fb-455e-8cf3-6ad5c9cdb481 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:00.064224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7f54e25-87fb-455e-8cf3-6ad5c9cdb481 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:00.064950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7f54e25-87fb-455e-8cf3-6ad5c9cdb481 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:00.065590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7f54e25-87fb-455e-8cf3-6ad5c9cdb481 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:00.066291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7f54e25-87fb-455e-8cf3-6ad5c9cdb481 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:00.480713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d7f54e25-87fb-455e-8cf3-6ad5c9cdb481 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:00.519337 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d7f54e25-87fb-455e-8cf3-6ad5c9cdb481 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1469 microversion: 2.1 time: 0.481776 Sep 07 12:35:00.527371 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 762/1570] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:00 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1469 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:00.550469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb8adb5e-de66-47c7-8f75-9addc796d617 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:00.551594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cb8adb5e-de66-47c7-8f75-9addc796d617 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:00.577137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb8adb5e-de66-47c7-8f75-9addc796d617 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:00.585440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb8adb5e-de66-47c7-8f75-9addc796d617 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:00.586375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb8adb5e-de66-47c7-8f75-9addc796d617 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:00.599173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb8adb5e-de66-47c7-8f75-9addc796d617 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:00.606780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb8adb5e-de66-47c7-8f75-9addc796d617 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:00.610010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb8adb5e-de66-47c7-8f75-9addc796d617 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:00.714465 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cb8adb5e-de66-47c7-8f75-9addc796d617 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:35:00.966569 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cb8adb5e-de66-47c7-8f75-9addc796d617 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 204 len: 0 microversion: 2.1 time: 0.434294 Sep 07 12:35:00.973836 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 763/1571] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:35:00 2022] DELETE /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:35:00.984595 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-38916a87-6eb7-473d-a077-9110b8ae6610 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:00.985329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-38916a87-6eb7-473d-a077-9110b8ae6610 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:01.017131 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38916a87-6eb7-473d-a077-9110b8ae6610 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:01.022248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38916a87-6eb7-473d-a077-9110b8ae6610 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:01.022404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38916a87-6eb7-473d-a077-9110b8ae6610 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:01.023173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38916a87-6eb7-473d-a077-9110b8ae6610 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:01.023665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38916a87-6eb7-473d-a077-9110b8ae6610 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:01.024107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38916a87-6eb7-473d-a077-9110b8ae6610 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:01.535601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-38916a87-6eb7-473d-a077-9110b8ae6610 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lazy-loading 'services' on Instance uuid f070fedf-8028-43e3-97f9-8955e81dc84b {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:35:01.588322 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0119cd87-51fa-4ea7-9cd9-5fd21f534b3e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "DELETE /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60" status: 204 len: 0 microversion: 2.1 time: 1.862808 Sep 07 12:35:01.589297 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 809/1572] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:34:59 2022] DELETE /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60 => generated 0 bytes in 1865 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:35:01.608946 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-38916a87-6eb7-473d-a077-9110b8ae6610 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 2345 microversion: 2.25 time: 0.631431 Sep 07 12:35:01.610443 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 764/1573] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:35:00 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 2345 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:35:01.621316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-38f0b81c-8e8c-4d2c-a347-18e2dfc9f87b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:01.622285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-38f0b81c-8e8c-4d2c-a347-18e2dfc9f87b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:01.633990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aa60e1f2-e352-4212-b0c9-e8bfc8a11879 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:01.635953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aa60e1f2-e352-4212-b0c9-e8bfc8a11879 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:01.640966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38f0b81c-8e8c-4d2c-a347-18e2dfc9f87b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:01.641591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38f0b81c-8e8c-4d2c-a347-18e2dfc9f87b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:01.642241 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38f0b81c-8e8c-4d2c-a347-18e2dfc9f87b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:01.643051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38f0b81c-8e8c-4d2c-a347-18e2dfc9f87b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:01.643530 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38f0b81c-8e8c-4d2c-a347-18e2dfc9f87b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:01.650943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38f0b81c-8e8c-4d2c-a347-18e2dfc9f87b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:01.664366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa60e1f2-e352-4212-b0c9-e8bfc8a11879 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:01.665694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa60e1f2-e352-4212-b0c9-e8bfc8a11879 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:01.667742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa60e1f2-e352-4212-b0c9-e8bfc8a11879 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:01.669717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa60e1f2-e352-4212-b0c9-e8bfc8a11879 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:01.670852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa60e1f2-e352-4212-b0c9-e8bfc8a11879 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:01.671957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa60e1f2-e352-4212-b0c9-e8bfc8a11879 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:02.680969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-38f0b81c-8e8c-4d2c-a347-18e2dfc9f87b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:02.694823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aa60e1f2-e352-4212-b0c9-e8bfc8a11879 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:02.698303 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-38f0b81c-8e8c-4d2c-a347-18e2dfc9f87b tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1469 microversion: 2.1 time: 1.100801 Sep 07 12:35:02.702262 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 810/1574] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:01 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1469 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:02.713379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-246f032e-1d0b-4cd7-98c4-a75980bcd6b6 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:02.718670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-246f032e-1d0b-4cd7-98c4-a75980bcd6b6 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2f6ee92e-b663-4984-9198-d2ca0f8b3892] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:02.720991 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aa60e1f2-e352-4212-b0c9-e8bfc8a11879 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1469 microversion: 2.1 time: 1.105854 Sep 07 12:35:02.721970 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 765/1575] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:01 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1469 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:02.737949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-246f032e-1d0b-4cd7-98c4-a75980bcd6b6 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:02.738528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-246f032e-1d0b-4cd7-98c4-a75980bcd6b6 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:02.738986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-246f032e-1d0b-4cd7-98c4-a75980bcd6b6 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:02.739750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-246f032e-1d0b-4cd7-98c4-a75980bcd6b6 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:02.740223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-246f032e-1d0b-4cd7-98c4-a75980bcd6b6 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:02.740654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-246f032e-1d0b-4cd7-98c4-a75980bcd6b6 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:02.748275 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f4f3f31b-c0c3-4b2d-bd04-a7a00fcb143d tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:02.761009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4f3f31b-c0c3-4b2d-bd04-a7a00fcb143d tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:02.761962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4f3f31b-c0c3-4b2d-bd04-a7a00fcb143d tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:02.763245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4f3f31b-c0c3-4b2d-bd04-a7a00fcb143d tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:02.764794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4f3f31b-c0c3-4b2d-bd04-a7a00fcb143d tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:02.766234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4f3f31b-c0c3-4b2d-bd04-a7a00fcb143d tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:02.767265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4f3f31b-c0c3-4b2d-bd04-a7a00fcb143d tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:02.780440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-246f032e-1d0b-4cd7-98c4-a75980bcd6b6 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2f6ee92e-b663-4984-9198-d2ca0f8b3892] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:35:02.824967 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f4f3f31b-c0c3-4b2d-bd04-a7a00fcb143d tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.097155 Sep 07 12:35:02.826792 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 766/1576] 10.222.0.16 () {60 vars in 1217 bytes} [Wed Sep 7 12:35:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:35:02.836764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-87984ff8-d715-4985-8ab9-db18ff3f8538 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:02.840744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-87984ff8-d715-4985-8ab9-db18ff3f8538 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:02.883818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87984ff8-d715-4985-8ab9-db18ff3f8538 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:02.885631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87984ff8-d715-4985-8ab9-db18ff3f8538 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:02.886950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87984ff8-d715-4985-8ab9-db18ff3f8538 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:02.888411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87984ff8-d715-4985-8ab9-db18ff3f8538 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:02.894425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87984ff8-d715-4985-8ab9-db18ff3f8538 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:02.896112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87984ff8-d715-4985-8ab9-db18ff3f8538 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:03.034938 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-246f032e-1d0b-4cd7-98c4-a75980bcd6b6 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892" status: 204 len: 0 microversion: 2.1 time: 0.330052 Sep 07 12:35:03.035886 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 811/1577] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:35:02 2022] DELETE /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:35:03.049626 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-87984ff8-d715-4985-8ab9-db18ff3f8538 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.209555 Sep 07 12:35:03.053843 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 767/1578] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:35:02 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec/os-volume_attachments => generated 197 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:35:03.071264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0bf92d7e-2bf8-4b5b-80fe-ef3eaaee7ff9 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:03.072714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0bf92d7e-2bf8-4b5b-80fe-ef3eaaee7ff9 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:03.091256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0bf92d7e-2bf8-4b5b-80fe-ef3eaaee7ff9 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:03.093206 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0bf92d7e-2bf8-4b5b-80fe-ef3eaaee7ff9 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:03.094596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0bf92d7e-2bf8-4b5b-80fe-ef3eaaee7ff9 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:03.096650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0bf92d7e-2bf8-4b5b-80fe-ef3eaaee7ff9 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:03.098496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0bf92d7e-2bf8-4b5b-80fe-ef3eaaee7ff9 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:03.099535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0bf92d7e-2bf8-4b5b-80fe-ef3eaaee7ff9 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:03.369926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-961780ae-d403-4cc2-806d-ae6d996f6ab4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1757437722", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "d72920fd-5bbc-4fad-ab8f-6932e7c7ba21"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:03.567922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-961780ae-d403-4cc2-806d-ae6d996f6ab4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] validate_networks() for [('d72920fd-5bbc-4fad-ab8f-6932e7c7ba21', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:35:03.702734 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-0bf92d7e-2bf8-4b5b-80fe-ef3eaaee7ff9 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lazy-loading 'services' on Instance uuid 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:35:03.829763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:35:04.141669 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0bf92d7e-2bf8-4b5b-80fe-ef3eaaee7ff9 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec/os-volume_attachments/a1e62c4a-2ef5-4970-a41c-dbe43562bfbb" status: 202 len: 0 microversion: 2.1 time: 1.079265 Sep 07 12:35:04.147027 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 812/1579] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Sep 7 12:35:03 2022] DELETE /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec/os-volume_attachments/a1e62c4a-2ef5-4970-a41c-dbe43562bfbb => generated 0 bytes in 1086 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:35:04.167380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-5c58a584-4dea-4edf-8a95-56560d6e2037 req-cd23b252-56d6-4cb9-9cac-63f4120e9bba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6ee92e-b663-4984-9198-d2ca0f8b3892", "name": "network-vif-unplugged", "status": "completed", "tag": "07e0fa79-d940-418d-b2f3-f85b6ee4dffd"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:04.208091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5c58a584-4dea-4edf-8a95-56560d6e2037 req-cd23b252-56d6-4cb9-9cac-63f4120e9bba service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:04.210831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5c58a584-4dea-4edf-8a95-56560d6e2037 req-cd23b252-56d6-4cb9-9cac-63f4120e9bba service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:04.212943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5c58a584-4dea-4edf-8a95-56560d6e2037 req-cd23b252-56d6-4cb9-9cac-63f4120e9bba service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:04.281937 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-5c58a584-4dea-4edf-8a95-56560d6e2037 req-cd23b252-56d6-4cb9-9cac-63f4120e9bba service nova] Creating event network-vif-unplugged:07e0fa79-d940-418d-b2f3-f85b6ee4dffd for instance 2f6ee92e-b663-4984-9198-d2ca0f8b3892 on n-h2-852087-9 Sep 07 12:35:04.299662 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-5c58a584-4dea-4edf-8a95-56560d6e2037 req-cd23b252-56d6-4cb9-9cac-63f4120e9bba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.146803 Sep 07 12:35:04.300886 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 813/1580] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:35:04.318813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-59c13255-0d3d-411a-8a2e-dab8cacc7c91 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:04.326691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-59c13255-0d3d-411a-8a2e-dab8cacc7c91 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:04.362863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59c13255-0d3d-411a-8a2e-dab8cacc7c91 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:04.363921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59c13255-0d3d-411a-8a2e-dab8cacc7c91 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:04.367153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59c13255-0d3d-411a-8a2e-dab8cacc7c91 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:04.390499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59c13255-0d3d-411a-8a2e-dab8cacc7c91 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:04.406463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59c13255-0d3d-411a-8a2e-dab8cacc7c91 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:04.407539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59c13255-0d3d-411a-8a2e-dab8cacc7c91 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:05.258008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-59c13255-0d3d-411a-8a2e-dab8cacc7c91 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:05.293841 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-59c13255-0d3d-411a-8a2e-dab8cacc7c91 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1469 microversion: 2.1 time: 0.987046 Sep 07 12:35:05.318268 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 814/1581] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:04 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1469 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:05.340995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-efa400f2-ab54-4810-8cb6-a3b6587bd6b1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:05.343309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-efa400f2-ab54-4810-8cb6-a3b6587bd6b1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:05.379220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-efa400f2-ab54-4810-8cb6-a3b6587bd6b1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:05.383935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-efa400f2-ab54-4810-8cb6-a3b6587bd6b1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:05.384446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-efa400f2-ab54-4810-8cb6-a3b6587bd6b1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:05.385227 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-efa400f2-ab54-4810-8cb6-a3b6587bd6b1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:05.385748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-efa400f2-ab54-4810-8cb6-a3b6587bd6b1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:05.396042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-efa400f2-ab54-4810-8cb6-a3b6587bd6b1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:05.501608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-961780ae-d403-4cc2-806d-ae6d996f6ab4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:35:05.502250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-961780ae-d403-4cc2-806d-ae6d996f6ab4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:35:05.502648 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-961780ae-d403-4cc2-806d-ae6d996f6ab4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:35:05.503133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-961780ae-d403-4cc2-806d-ae6d996f6ab4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:35:05.503905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-961780ae-d403-4cc2-806d-ae6d996f6ab4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:35:05.524771 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-961780ae-d403-4cc2-806d-ae6d996f6ab4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:05.536601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=12 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:35:05.555591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-961780ae-d403-4cc2-806d-ae6d996f6ab4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:05.569420 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-961780ae-d403-4cc2-806d-ae6d996f6ab4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:05.574365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-961780ae-d403-4cc2-806d-ae6d996f6ab4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:05.582972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-961780ae-d403-4cc2-806d-ae6d996f6ab4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:05.585866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-961780ae-d403-4cc2-806d-ae6d996f6ab4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:05.753823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-efa400f2-ab54-4810-8cb6-a3b6587bd6b1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:05.790341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-961780ae-d403-4cc2-806d-ae6d996f6ab4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Getting quotas for project 081286d7e4664e239ace13466a4a9c50. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:35:05.824683 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-efa400f2-ab54-4810-8cb6-a3b6587bd6b1 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1427 microversion: 2.1 time: 0.504436 Sep 07 12:35:05.826743 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 815/1582] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:05 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1427 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:05.831910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-961780ae-d403-4cc2-806d-ae6d996f6ab4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Getting quotas for user 3d68cf87771f4e9f9caab95adf58b129 and project 081286d7e4664e239ace13466a4a9c50. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:35:05.872443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-af38105a-16dd-425d-af51-daf89a822f2e req-659c01ec-efdc-4afd-a28c-061112dd0956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5667e371-cd91-4e33-99ca-635189b98be7", "name": "network-vif-deleted", "tag": "a98d5f3e-3d10-41a7-ae5b-f31024e7555a"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:06.000522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-af38105a-16dd-425d-af51-daf89a822f2e req-659c01ec-efdc-4afd-a28c-061112dd0956 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:06.001405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-af38105a-16dd-425d-af51-daf89a822f2e req-659c01ec-efdc-4afd-a28c-061112dd0956 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:06.005060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-961780ae-d403-4cc2-806d-ae6d996f6ab4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:35:06.028055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-af38105a-16dd-425d-af51-daf89a822f2e req-659c01ec-efdc-4afd-a28c-061112dd0956 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:06.043739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-961780ae-d403-4cc2-806d-ae6d996f6ab4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:35:06.174501 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-af38105a-16dd-425d-af51-daf89a822f2e req-659c01ec-efdc-4afd-a28c-061112dd0956 service nova] Creating event network-vif-deleted:a98d5f3e-3d10-41a7-ae5b-f31024e7555a for instance 5667e371-cd91-4e33-99ca-635189b98be7 on n-h2-852087-9 Sep 07 12:35:06.216599 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-af38105a-16dd-425d-af51-daf89a822f2e req-659c01ec-efdc-4afd-a28c-061112dd0956 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.386103 Sep 07 12:35:06.228605 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 816/1583] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:35:06.322276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1af6ac41-42e1-453a-84f2-7a83c2fdc00e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:06.323014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1af6ac41-42e1-453a-84f2-7a83c2fdc00e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:06.340834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1af6ac41-42e1-453a-84f2-7a83c2fdc00e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:06.341642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1af6ac41-42e1-453a-84f2-7a83c2fdc00e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:06.351543 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1af6ac41-42e1-453a-84f2-7a83c2fdc00e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:06.352981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1af6ac41-42e1-453a-84f2-7a83c2fdc00e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:06.353838 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1af6ac41-42e1-453a-84f2-7a83c2fdc00e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:06.354539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1af6ac41-42e1-453a-84f2-7a83c2fdc00e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:06.397754 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-961780ae-d403-4cc2-806d-ae6d996f6ab4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.038543 Sep 07 12:35:06.407039 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 768/1584] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:35:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:35:06.421945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-680d0392-a389-4257-a178-813d2ea66be8 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:06.433765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-680d0392-a389-4257-a178-813d2ea66be8 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:06.542858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-680d0392-a389-4257-a178-813d2ea66be8 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:06.553782 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-680d0392-a389-4257-a178-813d2ea66be8 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 200 len: 1208 microversion: 2.1 time: 0.145085 Sep 07 12:35:06.555742 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 769/1585] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:06 2022] GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 1208 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:06.677325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1af6ac41-42e1-453a-84f2-7a83c2fdc00e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:06.700020 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1af6ac41-42e1-453a-84f2-7a83c2fdc00e tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1298 microversion: 2.1 time: 0.379254 Sep 07 12:35:06.701723 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 817/1586] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:06 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1298 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:35:06.866563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2fdad9e6-9d34-4538-a090-398c22fe414f tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:06.867243 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2fdad9e6-9d34-4538-a090-398c22fe414f tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:06.899744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fdad9e6-9d34-4538-a090-398c22fe414f tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:06.900377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fdad9e6-9d34-4538-a090-398c22fe414f tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:06.900855 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fdad9e6-9d34-4538-a090-398c22fe414f tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:06.901697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fdad9e6-9d34-4538-a090-398c22fe414f tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:06.902186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fdad9e6-9d34-4538-a090-398c22fe414f tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:06.902643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fdad9e6-9d34-4538-a090-398c22fe414f tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:07.065017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2fdad9e6-9d34-4538-a090-398c22fe414f tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:07.073594 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2fdad9e6-9d34-4538-a090-398c22fe414f tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1299 microversion: 2.1 time: 0.211451 Sep 07 12:35:07.074193 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 770/1587] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:06 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1299 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:07.582434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a037043f-7ea2-40bb-bf0c-6cd6d79e0336 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:07.583785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a037043f-7ea2-40bb-bf0c-6cd6d79e0336 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:07.629126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-098f8872-80fb-42c0-8262-074608d8c3bf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "147ce838-e7e7-465e-813a-7cce3b867577", "device": "/dev/xvdb"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:07.634867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-098f8872-80fb-42c0-8262-074608d8c3bf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:07.688928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a037043f-7ea2-40bb-bf0c-6cd6d79e0336 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:07.701178 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a037043f-7ea2-40bb-bf0c-6cd6d79e0336 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 200 len: 1208 microversion: 2.1 time: 0.125234 Sep 07 12:35:07.701329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-098f8872-80fb-42c0-8262-074608d8c3bf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:07.702198 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 818/1588] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:07 2022] GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 1208 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:07.719618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-098f8872-80fb-42c0-8262-074608d8c3bf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:07.728828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-098f8872-80fb-42c0-8262-074608d8c3bf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:07.730778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-098f8872-80fb-42c0-8262-074608d8c3bf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:07.737416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-098f8872-80fb-42c0-8262-074608d8c3bf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:07.738309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-098f8872-80fb-42c0-8262-074608d8c3bf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:07.747434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bf434631-413b-4eb1-914f-0d4e0a236e13 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:07.748407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bf434631-413b-4eb1-914f-0d4e0a236e13 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:07.762688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf434631-413b-4eb1-914f-0d4e0a236e13 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:07.766780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf434631-413b-4eb1-914f-0d4e0a236e13 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:07.768994 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf434631-413b-4eb1-914f-0d4e0a236e13 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:07.770720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf434631-413b-4eb1-914f-0d4e0a236e13 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:07.774183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf434631-413b-4eb1-914f-0d4e0a236e13 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:07.774916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf434631-413b-4eb1-914f-0d4e0a236e13 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:07.922127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf434631-413b-4eb1-914f-0d4e0a236e13 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:07.930424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf434631-413b-4eb1-914f-0d4e0a236e13 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:07.931671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf434631-413b-4eb1-914f-0d4e0a236e13 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:07.932650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-bf434631-413b-4eb1-914f-0d4e0a236e13 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lazy-loading 'fault' on Instance uuid bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:35:08.080356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bf434631-413b-4eb1-914f-0d4e0a236e13 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:08.108344 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bf434631-413b-4eb1-914f-0d4e0a236e13 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 200 len: 1303 microversion: 2.1 time: 0.365026 Sep 07 12:35:08.113676 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 819/1589] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:07 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 1303 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:08.137788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1f685409-9188-4072-b3de-fa1d675809eb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:08.140446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1f685409-9188-4072-b3de-fa1d675809eb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:08.221724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f685409-9188-4072-b3de-fa1d675809eb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:08.224774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f685409-9188-4072-b3de-fa1d675809eb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:08.229002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f685409-9188-4072-b3de-fa1d675809eb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:08.230567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f685409-9188-4072-b3de-fa1d675809eb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:08.237237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f685409-9188-4072-b3de-fa1d675809eb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:08.237968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f685409-9188-4072-b3de-fa1d675809eb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:08.405353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f685409-9188-4072-b3de-fa1d675809eb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:08.405870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f685409-9188-4072-b3de-fa1d675809eb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:08.406320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f685409-9188-4072-b3de-fa1d675809eb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:08.406789 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-1f685409-9188-4072-b3de-fa1d675809eb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lazy-loading 'fault' on Instance uuid 5667e371-cd91-4e33-99ca-635189b98be7 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:35:08.496843 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1f685409-9188-4072-b3de-fa1d675809eb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:08.511474 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1f685409-9188-4072-b3de-fa1d675809eb tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1304 microversion: 2.1 time: 0.392640 Sep 07 12:35:08.512954 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 820/1590] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:08 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1304 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:35:08.558584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c9744a5e-8ec3-455e-8bf8-90e723ce07ec req-5c99e27b-8df4-407e-ba50-1dbedbb707e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd64235e-b7e5-4a81-a2f8-49bb09fecdf9", "name": "network-vif-deleted", "tag": "f96d9d76-2187-4026-8333-d92e5985ac08"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:08.642605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c9744a5e-8ec3-455e-8bf8-90e723ce07ec req-5c99e27b-8df4-407e-ba50-1dbedbb707e0 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:08.651236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c9744a5e-8ec3-455e-8bf8-90e723ce07ec req-5c99e27b-8df4-407e-ba50-1dbedbb707e0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:08.656596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c9744a5e-8ec3-455e-8bf8-90e723ce07ec req-5c99e27b-8df4-407e-ba50-1dbedbb707e0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:08.727368 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c9744a5e-8ec3-455e-8bf8-90e723ce07ec req-5c99e27b-8df4-407e-ba50-1dbedbb707e0 service nova] Creating event network-vif-deleted:f96d9d76-2187-4026-8333-d92e5985ac08 for instance bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 on n-h1-852087-9 Sep 07 12:35:08.750672 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c9744a5e-8ec3-455e-8bf8-90e723ce07ec req-5c99e27b-8df4-407e-ba50-1dbedbb707e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235219 Sep 07 12:35:08.756660 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 821/1591] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:35:08.779050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e0418c24-fb9b-476e-bcbd-b2d6c87c8572 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:08.788077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e0418c24-fb9b-476e-bcbd-b2d6c87c8572 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:08.812481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0418c24-fb9b-476e-bcbd-b2d6c87c8572 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:08.816805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0418c24-fb9b-476e-bcbd-b2d6c87c8572 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:08.828629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0418c24-fb9b-476e-bcbd-b2d6c87c8572 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:08.828629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0418c24-fb9b-476e-bcbd-b2d6c87c8572 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:08.828629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0418c24-fb9b-476e-bcbd-b2d6c87c8572 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:08.828629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0418c24-fb9b-476e-bcbd-b2d6c87c8572 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:09.057353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e0418c24-fb9b-476e-bcbd-b2d6c87c8572 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:09.083942 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e0418c24-fb9b-476e-bcbd-b2d6c87c8572 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 200 len: 1260 microversion: 2.1 time: 0.324469 Sep 07 12:35:09.112049 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 822/1592] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:08 2022] GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 1260 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:09.126674 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-098f8872-80fb-42c0-8262-074608d8c3bf tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "POST /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.512222 Sep 07 12:35:09.145345 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 771/1593] 10.222.0.16 () {62 vars in 1364 bytes} [Wed Sep 7 12:35:07 2022] POST /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-volume_attachments => generated 194 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:35:09.163083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5d2da75e-7e3f-49be-8497-7f0af3ed6b98 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:09.167123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5d2da75e-7e3f-49be-8497-7f0af3ed6b98 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: bd64235e-b7e5-4a81-a2f8-49bb09fecdf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:09.202500 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d2da75e-7e3f-49be-8497-7f0af3ed6b98 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:09.203370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d2da75e-7e3f-49be-8497-7f0af3ed6b98 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:09.204006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d2da75e-7e3f-49be-8497-7f0af3ed6b98 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:09.204950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d2da75e-7e3f-49be-8497-7f0af3ed6b98 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:09.212851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d2da75e-7e3f-49be-8497-7f0af3ed6b98 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:09.213560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d2da75e-7e3f-49be-8497-7f0af3ed6b98 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:09.246597 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-5d2da75e-7e3f-49be-8497-7f0af3ed6b98 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] HTTP exception thrown: Instance bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 could not be found. Sep 07 12:35:09.248578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5d2da75e-7e3f-49be-8497-7f0af3ed6b98 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Request method failure captured: Sep 07 12:35:09.248578 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 HTTP/1.1 Sep 07 12:35:09.248578 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:35:09.248578 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:35:09.248578 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:35:09.248578 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:35:09.248578 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:35:09.248578 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:35:09.248578 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:35:09.248578 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:35:09.248578 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5wW3nECT65O0DrkDd5K_rP0D9OKKXyE-Sgm4NuZpa5ysf0UzVj7q_5NJl0y7FFG2b_o4YrA0QI-fx342SEE0uGoZcm1jE49sMgaFW0I096i_a2T98OyBypM7Ivm5ONeAQfiRnahsaWv36gDyrCE9mIO1dC4rUTAKTA1nBQ3fIVlSY Sep 07 12:35:09.248578 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:35:09.248578 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:35:09.248578 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:35:09.248578 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:35:09.248578 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:35:09.248578 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:35:09.248578 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 43a1115550de4c5185de7ca86bc17a63 Sep 07 12:35:09.248578 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-MigrationsAdminTest-1611333289 Sep 07 12:35:09.248578 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:35:09.248578 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:35:09.250224 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43a1115550de4c5185de7ca86bc17a63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_43a1115550de4c5185de7ca86bc17a63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/43a1115550de4c5185de7ca86bc17a63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43a1115550de4c5185de7ca86bc17a63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:35:09.250224 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-MigrationsAdminTest-1611333289 Sep 07 12:35:09.250224 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 43a1115550de4c5185de7ca86bc17a63 Sep 07 12:35:09.250224 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-MigrationsAdminTest-1611333289 Sep 07 12:35:09.250224 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-MigrationsAdminTest-1611333289-project Sep 07 12:35:09.250224 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:35:09.250224 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:35:09.250224 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 1b5c31587a37465a9becda30e417ed5b Sep 07 12:35:09.250224 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-MigrationsAdminTest-1611333289-project Sep 07 12:35:09.250224 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:35:09.250224 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 could not be found. Sep 07 12:35:09.250224 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'bd64235e-b7e5-4a81-a2f8-49bb09fecdf9'} Sep 07 12:35:09.250973 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:35:09.250973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:09.250973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:35:09.250973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:35:09.250973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:35:09.250973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:35:09.250973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:35:09.250973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:35:09.250973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:35:09.250973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:35:09.250973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 could not be found. Sep 07 12:35:09.250973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:09.250973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:09.250973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:09.250973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:09.250973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:35:09.250973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:35:09.250973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:35:09.250973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:35:09.250973 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:35:09.252286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:35:09.252286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:35:09.252286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:35:09.252286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:35:09.252286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:35:09.252286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:35:09.252286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:35:09.252286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 could not be found. Sep 07 12:35:09.252286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:09.252286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:09.252286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:09.252286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:09.252286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:35:09.252286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:35:09.252286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:35:09.252286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:35:09.252286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 could not be found. Sep 07 12:35:09.252286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:09.254571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5d2da75e-7e3f-49be-8497-7f0af3ed6b98 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Returning 404 to user: Instance bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:35:09.256949 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5d2da75e-7e3f-49be-8497-7f0af3ed6b98 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9" status: 404 len: 111 microversion: 2.1 time: 0.102458 Sep 07 12:35:09.269923 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 823/1594] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:09 2022] GET /compute/v2.1/servers/bd64235e-b7e5-4a81-a2f8-49bb09fecdf9 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:35:09.287904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b8857f5f-d66e-4e2c-a8f6-e9f4fae1f25d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:09.289038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b8857f5f-d66e-4e2c-a8f6-e9f4fae1f25d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:09.310325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8857f5f-d66e-4e2c-a8f6-e9f4fae1f25d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:09.313233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8857f5f-d66e-4e2c-a8f6-e9f4fae1f25d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:09.315457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8857f5f-d66e-4e2c-a8f6-e9f4fae1f25d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:09.316955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8857f5f-d66e-4e2c-a8f6-e9f4fae1f25d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:09.322696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8857f5f-d66e-4e2c-a8f6-e9f4fae1f25d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:09.323585 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8857f5f-d66e-4e2c-a8f6-e9f4fae1f25d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:09.453007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b8857f5f-d66e-4e2c-a8f6-e9f4fae1f25d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:35:09.542061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bcaaf585-06c5-4bb3-bf46-a59a991843a3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:09.542699 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bcaaf585-06c5-4bb3-bf46-a59a991843a3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:09.562008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcaaf585-06c5-4bb3-bf46-a59a991843a3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:09.562514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcaaf585-06c5-4bb3-bf46-a59a991843a3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:09.562955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcaaf585-06c5-4bb3-bf46-a59a991843a3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:09.563983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcaaf585-06c5-4bb3-bf46-a59a991843a3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:09.564449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcaaf585-06c5-4bb3-bf46-a59a991843a3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:09.564874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcaaf585-06c5-4bb3-bf46-a59a991843a3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:09.692829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcaaf585-06c5-4bb3-bf46-a59a991843a3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:09.694795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcaaf585-06c5-4bb3-bf46-a59a991843a3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:09.695840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcaaf585-06c5-4bb3-bf46-a59a991843a3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:09.700101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-bcaaf585-06c5-4bb3-bf46-a59a991843a3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lazy-loading 'fault' on Instance uuid 5667e371-cd91-4e33-99ca-635189b98be7 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:35:09.829226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bcaaf585-06c5-4bb3-bf46-a59a991843a3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:09.843763 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bcaaf585-06c5-4bb3-bf46-a59a991843a3 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 200 len: 1304 microversion: 2.1 time: 0.306697 Sep 07 12:35:09.845673 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 824/1595] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:09 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 1304 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:09.920099 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b8857f5f-d66e-4e2c-a8f6-e9f4fae1f25d tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 204 len: 0 microversion: 2.1 time: 0.641541 Sep 07 12:35:09.931525 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 772/1596] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:35:09 2022] DELETE /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 0 bytes in 653 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:35:09.937659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e80d9ae-d97a-4953-bd14-d41e43430e1c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:09.938474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6e80d9ae-d97a-4953-bd14-d41e43430e1c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:09.955847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e80d9ae-d97a-4953-bd14-d41e43430e1c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:09.959216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e80d9ae-d97a-4953-bd14-d41e43430e1c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:09.960239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e80d9ae-d97a-4953-bd14-d41e43430e1c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:09.961296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e80d9ae-d97a-4953-bd14-d41e43430e1c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:09.962055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e80d9ae-d97a-4953-bd14-d41e43430e1c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:09.970340 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e80d9ae-d97a-4953-bd14-d41e43430e1c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:10.146504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a1e8396f-abcf-4a19-854d-98ba7d3a0522 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:10.149843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a1e8396f-abcf-4a19-854d-98ba7d3a0522 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:10.182538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1e8396f-abcf-4a19-854d-98ba7d3a0522 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:10.184006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1e8396f-abcf-4a19-854d-98ba7d3a0522 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:10.188967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1e8396f-abcf-4a19-854d-98ba7d3a0522 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:10.193667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1e8396f-abcf-4a19-854d-98ba7d3a0522 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:10.194902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1e8396f-abcf-4a19-854d-98ba7d3a0522 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:10.200831 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1e8396f-abcf-4a19-854d-98ba7d3a0522 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:10.320454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6e80d9ae-d97a-4953-bd14-d41e43430e1c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:10.346415 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6e80d9ae-d97a-4953-bd14-d41e43430e1c tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1469 microversion: 2.1 time: 0.413775 Sep 07 12:35:10.367188 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 825/1597] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:09 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1469 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:10.512319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a1e8396f-abcf-4a19-854d-98ba7d3a0522 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:10.547233 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a1e8396f-abcf-4a19-854d-98ba7d3a0522 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 200 len: 1278 microversion: 2.1 time: 0.415841 Sep 07 12:35:10.548887 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 773/1598] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:10 2022] GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 1278 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:10.886498 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1eb0c135-80cb-4c9c-ac67-3c67c75dc732 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:10.888674 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1eb0c135-80cb-4c9c-ac67-3c67c75dc732 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 5667e371-cd91-4e33-99ca-635189b98be7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:10.945522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eb0c135-80cb-4c9c-ac67-3c67c75dc732 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:10.946643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eb0c135-80cb-4c9c-ac67-3c67c75dc732 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:10.947930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eb0c135-80cb-4c9c-ac67-3c67c75dc732 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:10.949324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eb0c135-80cb-4c9c-ac67-3c67c75dc732 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:10.950277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eb0c135-80cb-4c9c-ac67-3c67c75dc732 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:10.951123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eb0c135-80cb-4c9c-ac67-3c67c75dc732 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:11.009586 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-1eb0c135-80cb-4c9c-ac67-3c67c75dc732 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] HTTP exception thrown: Instance 5667e371-cd91-4e33-99ca-635189b98be7 could not be found. Sep 07 12:35:11.012772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1eb0c135-80cb-4c9c-ac67-3c67c75dc732 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Request method failure captured: Sep 07 12:35:11.012772 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 HTTP/1.1 Sep 07 12:35:11.012772 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:35:11.012772 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:35:11.012772 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:35:11.012772 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:35:11.012772 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:35:11.012772 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:35:11.012772 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:35:11.012772 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:35:11.012772 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI8q7yUnzgHWZvYeTcnyQarqcnB_Ztsqtibb942yg6cqDTJlhk8qfTZn2bxhyk11cA6j_S4hfMqtTOG-G5_ClyfZkPg9vODiEtxsdX3AfIWhEPMch4seCj0iIUSi1_ZdXyAVaUVVtPFdTVsXm5t2HXazb63J5VXYtOUDGnld4W7doEE Sep 07 12:35:11.012772 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:35:11.012772 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:35:11.012772 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:35:11.012772 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:35:11.012772 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:35:11.012772 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:35:11.012772 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 7d8dd874b3674087a3e969424a561530 Sep 07 12:35:11.012772 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersAdminTestJSON-340496789 Sep 07 12:35:11.012772 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:35:11.012772 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:35:11.015807 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d8dd874b3674087a3e969424a561530"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d8dd874b3674087a3e969424a561530"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d8dd874b3674087a3e969424a561530"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d8dd874b3674087a3e969424a561530"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:35:11.015807 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersAdminTestJSON-340496789 Sep 07 12:35:11.015807 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 7d8dd874b3674087a3e969424a561530 Sep 07 12:35:11.015807 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersAdminTestJSON-340496789 Sep 07 12:35:11.015807 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersAdminTestJSON-340496789-project Sep 07 12:35:11.015807 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:35:11.015807 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:35:11.015807 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 50d97d3b953f4690b54fde1a4da81cd4 Sep 07 12:35:11.015807 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersAdminTestJSON-340496789-project Sep 07 12:35:11.015807 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:35:11.015807 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 5667e371-cd91-4e33-99ca-635189b98be7 could not be found. Sep 07 12:35:11.015807 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '5667e371-cd91-4e33-99ca-635189b98be7'} Sep 07 12:35:11.017537 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:35:11.017537 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:11.017537 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:35:11.017537 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:35:11.017537 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:35:11.017537 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:35:11.017537 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:35:11.017537 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:35:11.017537 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:35:11.017537 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:35:11.017537 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5667e371-cd91-4e33-99ca-635189b98be7 could not be found. Sep 07 12:35:11.017537 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:11.017537 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:11.017537 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:11.017537 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:11.017537 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:35:11.017537 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:35:11.017537 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:35:11.017537 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:35:11.017537 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:35:11.020257 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:35:11.020257 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:35:11.020257 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:35:11.020257 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:35:11.020257 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:35:11.020257 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:35:11.020257 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:35:11.020257 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5667e371-cd91-4e33-99ca-635189b98be7 could not be found. Sep 07 12:35:11.020257 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:11.020257 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:11.020257 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:11.020257 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:11.020257 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:35:11.020257 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:35:11.020257 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:35:11.020257 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:35:11.020257 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5667e371-cd91-4e33-99ca-635189b98be7 could not be found. Sep 07 12:35:11.020257 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:11.022659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1eb0c135-80cb-4c9c-ac67-3c67c75dc732 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Returning 404 to user: Instance 5667e371-cd91-4e33-99ca-635189b98be7 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:35:11.028868 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1eb0c135-80cb-4c9c-ac67-3c67c75dc732 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7" status: 404 len: 111 microversion: 2.1 time: 0.148654 Sep 07 12:35:11.030117 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 826/1599] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:10 2022] GET /compute/v2.1/servers/5667e371-cd91-4e33-99ca-635189b98be7 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:35:11.044143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5b69d8d1-33b9-4426-a1fa-81f5df89746c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:11.044709 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5b69d8d1-33b9-4426-a1fa-81f5df89746c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b65cf6c-5a50-4c86-9255-c7d712522cfe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:11.062501 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b69d8d1-33b9-4426-a1fa-81f5df89746c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:11.063021 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b69d8d1-33b9-4426-a1fa-81f5df89746c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:11.063477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b69d8d1-33b9-4426-a1fa-81f5df89746c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:11.068765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b69d8d1-33b9-4426-a1fa-81f5df89746c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:11.070011 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b69d8d1-33b9-4426-a1fa-81f5df89746c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:11.072304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b69d8d1-33b9-4426-a1fa-81f5df89746c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:11.159824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5b69d8d1-33b9-4426-a1fa-81f5df89746c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b65cf6c-5a50-4c86-9255-c7d712522cfe] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:35:11.178517 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:35:11.379936 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5b69d8d1-33b9-4426-a1fa-81f5df89746c tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe" status: 204 len: 0 microversion: 2.1 time: 0.335274 Sep 07 12:35:11.381660 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 774/1600] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:35:11 2022] DELETE /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:35:11.387066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bc197dd8-2763-4cb0-b408-b01bafb87d74 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:11.392805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bc197dd8-2763-4cb0-b408-b01bafb87d74 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:11.432838 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc197dd8-2763-4cb0-b408-b01bafb87d74 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:11.436971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc197dd8-2763-4cb0-b408-b01bafb87d74 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:11.437982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc197dd8-2763-4cb0-b408-b01bafb87d74 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:11.441805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc197dd8-2763-4cb0-b408-b01bafb87d74 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:11.445384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc197dd8-2763-4cb0-b408-b01bafb87d74 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:11.449596 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eb7a6adb-edd8-4c9a-93a3-2862a49c367f tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:11.450131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc197dd8-2763-4cb0-b408-b01bafb87d74 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:11.456124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-eb7a6adb-edd8-4c9a-93a3-2862a49c367f tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b65cf6c-5a50-4c86-9255-c7d712522cfe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:11.500507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb7a6adb-edd8-4c9a-93a3-2862a49c367f tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:11.519065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb7a6adb-edd8-4c9a-93a3-2862a49c367f tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:11.520962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb7a6adb-edd8-4c9a-93a3-2862a49c367f tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:11.522506 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb7a6adb-edd8-4c9a-93a3-2862a49c367f tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:11.529724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb7a6adb-edd8-4c9a-93a3-2862a49c367f tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:11.540714 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb7a6adb-edd8-4c9a-93a3-2862a49c367f tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:12.498043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-eb7a6adb-edd8-4c9a-93a3-2862a49c367f tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:12.513923 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eb7a6adb-edd8-4c9a-93a3-2862a49c367f tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe" status: 200 len: 1469 microversion: 2.1 time: 1.105460 Sep 07 12:35:12.517124 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 775/1601] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:11 2022] GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe => generated 1469 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:12.534557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-537e1877-54b6-4741-afa2-c4dc5daa8283 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:12.535770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-537e1877-54b6-4741-afa2-c4dc5daa8283 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:12.553678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-537e1877-54b6-4741-afa2-c4dc5daa8283 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:12.554216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-537e1877-54b6-4741-afa2-c4dc5daa8283 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:12.554673 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-537e1877-54b6-4741-afa2-c4dc5daa8283 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:12.555426 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-537e1877-54b6-4741-afa2-c4dc5daa8283 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:12.561862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-537e1877-54b6-4741-afa2-c4dc5daa8283 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:12.562429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-537e1877-54b6-4741-afa2-c4dc5daa8283 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:12.768146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bc197dd8-2763-4cb0-b408-b01bafb87d74 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:12.788411 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bc197dd8-2763-4cb0-b408-b01bafb87d74 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1469 microversion: 2.1 time: 1.413682 Sep 07 12:35:12.796327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-537e1877-54b6-4741-afa2-c4dc5daa8283 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:12.814837 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 827/1602] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:11 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1469 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:35:12.825155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-cc31a477-7dcb-4771-98a9-2958df135bf4 req-e5f41f40-0a95-4bcf-85f3-18713a561644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6ee92e-b663-4984-9198-d2ca0f8b3892", "name": "network-vif-deleted", "tag": "07e0fa79-d940-418d-b2f3-f85b6ee4dffd"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:12.829307 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-537e1877-54b6-4741-afa2-c4dc5daa8283 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 200 len: 1266 microversion: 2.1 time: 0.309735 Sep 07 12:35:12.832864 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 776/1603] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:12 2022] GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 1266 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:12.883575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0a57b659-3ffa-4c0c-8428-c2869c58889f req-004e137b-8a1c-47ef-a97e-d717ba02abb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc8c1c2b-eb55-4361-bcd7-e66c270b827a", "name": "network-vif-deleted", "tag": "1e24dd2e-9faf-4586-ae6b-48d1499917fe"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:12.892055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cc31a477-7dcb-4771-98a9-2958df135bf4 req-e5f41f40-0a95-4bcf-85f3-18713a561644 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:12.893437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cc31a477-7dcb-4771-98a9-2958df135bf4 req-e5f41f40-0a95-4bcf-85f3-18713a561644 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:12.905299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cc31a477-7dcb-4771-98a9-2958df135bf4 req-e5f41f40-0a95-4bcf-85f3-18713a561644 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:12.941588 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-cc31a477-7dcb-4771-98a9-2958df135bf4 req-e5f41f40-0a95-4bcf-85f3-18713a561644 service nova] Creating event network-vif-deleted:07e0fa79-d940-418d-b2f3-f85b6ee4dffd for instance 2f6ee92e-b663-4984-9198-d2ca0f8b3892 on n-h2-852087-9 Sep 07 12:35:12.963574 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-cc31a477-7dcb-4771-98a9-2958df135bf4 req-e5f41f40-0a95-4bcf-85f3-18713a561644 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145356 Sep 07 12:35:12.965924 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 828/1604] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:35:13.021235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0a57b659-3ffa-4c0c-8428-c2869c58889f req-004e137b-8a1c-47ef-a97e-d717ba02abb3 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:13.026471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0a57b659-3ffa-4c0c-8428-c2869c58889f req-004e137b-8a1c-47ef-a97e-d717ba02abb3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:13.031169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0a57b659-3ffa-4c0c-8428-c2869c58889f req-004e137b-8a1c-47ef-a97e-d717ba02abb3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:13.107576 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0a57b659-3ffa-4c0c-8428-c2869c58889f req-004e137b-8a1c-47ef-a97e-d717ba02abb3 service nova] Creating event network-vif-deleted:1e24dd2e-9faf-4586-ae6b-48d1499917fe for instance fc8c1c2b-eb55-4361-bcd7-e66c270b827a on n-h1-852087-9 Sep 07 12:35:13.135919 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0a57b659-3ffa-4c0c-8428-c2869c58889f req-004e137b-8a1c-47ef-a97e-d717ba02abb3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.299899 Sep 07 12:35:13.138934 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 777/1605] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:35:13.550051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-80321ec7-1b9d-497c-80af-8a4998fb7be8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:13.551762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-80321ec7-1b9d-497c-80af-8a4998fb7be8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b65cf6c-5a50-4c86-9255-c7d712522cfe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:13.564189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80321ec7-1b9d-497c-80af-8a4998fb7be8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:13.564874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80321ec7-1b9d-497c-80af-8a4998fb7be8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:13.565660 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80321ec7-1b9d-497c-80af-8a4998fb7be8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:13.569437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80321ec7-1b9d-497c-80af-8a4998fb7be8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:13.571137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80321ec7-1b9d-497c-80af-8a4998fb7be8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:13.572636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80321ec7-1b9d-497c-80af-8a4998fb7be8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:13.835770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-05a0c50a-7574-487f-8233-89ca894c53e3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:13.838156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-05a0c50a-7574-487f-8233-89ca894c53e3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:13.856201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05a0c50a-7574-487f-8233-89ca894c53e3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:13.857928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05a0c50a-7574-487f-8233-89ca894c53e3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:13.858690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05a0c50a-7574-487f-8233-89ca894c53e3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:13.860493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05a0c50a-7574-487f-8233-89ca894c53e3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:13.863808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05a0c50a-7574-487f-8233-89ca894c53e3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:13.864715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05a0c50a-7574-487f-8233-89ca894c53e3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:14.004498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05a0c50a-7574-487f-8233-89ca894c53e3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:14.005462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05a0c50a-7574-487f-8233-89ca894c53e3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:14.012481 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05a0c50a-7574-487f-8233-89ca894c53e3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:14.024326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-05a0c50a-7574-487f-8233-89ca894c53e3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lazy-loading 'fault' on Instance uuid fc8c1c2b-eb55-4361-bcd7-e66c270b827a {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:35:14.383417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-05a0c50a-7574-487f-8233-89ca894c53e3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5c31587a37465a9becda30e417ed5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a1115550de4c5185de7ca86bc17a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:14.400925 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-05a0c50a-7574-487f-8233-89ca894c53e3 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 200 len: 1303 microversion: 2.1 time: 0.569096 Sep 07 12:35:14.405118 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 778/1606] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:13 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 1303 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:14.419433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-80321ec7-1b9d-497c-80af-8a4998fb7be8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:14.426965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9451f17f-7035-44d2-8c45-2cf2485c321b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:14.429142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9451f17f-7035-44d2-8c45-2cf2485c321b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:14.433906 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-80321ec7-1b9d-497c-80af-8a4998fb7be8 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe" status: 200 len: 1469 microversion: 2.1 time: 0.894794 Sep 07 12:35:14.451256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9451f17f-7035-44d2-8c45-2cf2485c321b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:14.451489 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 829/1607] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:13 2022] GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe => generated 1469 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:14.452166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9451f17f-7035-44d2-8c45-2cf2485c321b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:14.452792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9451f17f-7035-44d2-8c45-2cf2485c321b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:14.453972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9451f17f-7035-44d2-8c45-2cf2485c321b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:14.454615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9451f17f-7035-44d2-8c45-2cf2485c321b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:14.458096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9451f17f-7035-44d2-8c45-2cf2485c321b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:14.680470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9451f17f-7035-44d2-8c45-2cf2485c321b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:14.715552 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9451f17f-7035-44d2-8c45-2cf2485c321b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 200 len: 1266 microversion: 2.1 time: 0.303876 Sep 07 12:35:14.733597 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 779/1608] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:14 2022] GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 1266 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:15.160886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-8869e0a1-2d9e-4809-80b4-568d74e3a215 req-230d0c99-4fd0-448b-b0eb-1fab06058309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b65cf6c-5a50-4c86-9255-c7d712522cfe", "name": "network-vif-deleted", "tag": "da45972a-1a94-47cc-8816-2b02beeab531"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:15.207668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8869e0a1-2d9e-4809-80b4-568d74e3a215 req-230d0c99-4fd0-448b-b0eb-1fab06058309 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:15.208460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8869e0a1-2d9e-4809-80b4-568d74e3a215 req-230d0c99-4fd0-448b-b0eb-1fab06058309 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:15.209173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8869e0a1-2d9e-4809-80b4-568d74e3a215 req-230d0c99-4fd0-448b-b0eb-1fab06058309 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:15.258844 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-8869e0a1-2d9e-4809-80b4-568d74e3a215 req-230d0c99-4fd0-448b-b0eb-1fab06058309 service nova] Creating event network-vif-deleted:da45972a-1a94-47cc-8816-2b02beeab531 for instance 7b65cf6c-5a50-4c86-9255-c7d712522cfe on n-h1-852087-9 Sep 07 12:35:15.280092 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-8869e0a1-2d9e-4809-80b4-568d74e3a215 req-230d0c99-4fd0-448b-b0eb-1fab06058309 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124438 Sep 07 12:35:15.283948 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 830/1609] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:35:15.425379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4bfb252c-46bc-4d1a-8b52-a71dbc1a3597 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:15.426212 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4bfb252c-46bc-4d1a-8b52-a71dbc1a3597 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] [instance: fc8c1c2b-eb55-4361-bcd7-e66c270b827a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:15.453365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bfb252c-46bc-4d1a-8b52-a71dbc1a3597 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:15.454188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bfb252c-46bc-4d1a-8b52-a71dbc1a3597 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:15.456190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bfb252c-46bc-4d1a-8b52-a71dbc1a3597 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:15.458288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bfb252c-46bc-4d1a-8b52-a71dbc1a3597 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:15.467384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bbb3b649-31e3-4a90-8c8c-b0e057e075b6 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:15.469301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bbb3b649-31e3-4a90-8c8c-b0e057e075b6 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b65cf6c-5a50-4c86-9255-c7d712522cfe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:15.473727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bfb252c-46bc-4d1a-8b52-a71dbc1a3597 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:15.474641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bfb252c-46bc-4d1a-8b52-a71dbc1a3597 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:15.498160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbb3b649-31e3-4a90-8c8c-b0e057e075b6 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:15.498976 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbb3b649-31e3-4a90-8c8c-b0e057e075b6 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:15.499511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbb3b649-31e3-4a90-8c8c-b0e057e075b6 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:15.500342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbb3b649-31e3-4a90-8c8c-b0e057e075b6 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:15.500822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbb3b649-31e3-4a90-8c8c-b0e057e075b6 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:15.510759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbb3b649-31e3-4a90-8c8c-b0e057e075b6 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:15.550572 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-4bfb252c-46bc-4d1a-8b52-a71dbc1a3597 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] HTTP exception thrown: Instance fc8c1c2b-eb55-4361-bcd7-e66c270b827a could not be found. Sep 07 12:35:15.566268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4bfb252c-46bc-4d1a-8b52-a71dbc1a3597 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Request method failure captured: Sep 07 12:35:15.566268 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a HTTP/1.1 Sep 07 12:35:15.566268 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:35:15.566268 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:35:15.566268 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:35:15.566268 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:35:15.566268 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:35:15.566268 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:35:15.566268 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:35:15.566268 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:35:15.566268 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI5wW3nECT65O0DrkDd5K_rP0D9OKKXyE-Sgm4NuZpa5ysf0UzVj7q_5NJl0y7FFG2b_o4YrA0QI-fx342SEE0uGoZcm1jE49sMgaFW0I096i_a2T98OyBypM7Ivm5ONeAQfiRnahsaWv36gDyrCE9mIO1dC4rUTAKTA1nBQ3fIVlSY Sep 07 12:35:15.566268 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:35:15.566268 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:35:15.566268 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:35:15.566268 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:35:15.566268 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:35:15.566268 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:35:15.566268 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 43a1115550de4c5185de7ca86bc17a63 Sep 07 12:35:15.566268 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-MigrationsAdminTest-1611333289 Sep 07 12:35:15.566268 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:35:15.566268 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:35:15.567739 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43a1115550de4c5185de7ca86bc17a63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_43a1115550de4c5185de7ca86bc17a63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/43a1115550de4c5185de7ca86bc17a63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43a1115550de4c5185de7ca86bc17a63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:35:15.567739 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-MigrationsAdminTest-1611333289 Sep 07 12:35:15.567739 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 43a1115550de4c5185de7ca86bc17a63 Sep 07 12:35:15.567739 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-MigrationsAdminTest-1611333289 Sep 07 12:35:15.567739 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-MigrationsAdminTest-1611333289-project Sep 07 12:35:15.567739 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:35:15.567739 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:35:15.567739 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 1b5c31587a37465a9becda30e417ed5b Sep 07 12:35:15.567739 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-MigrationsAdminTest-1611333289-project Sep 07 12:35:15.567739 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:35:15.567739 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance fc8c1c2b-eb55-4361-bcd7-e66c270b827a could not be found. Sep 07 12:35:15.567739 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'fc8c1c2b-eb55-4361-bcd7-e66c270b827a'} Sep 07 12:35:15.568546 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:35:15.568546 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:15.568546 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:35:15.568546 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:35:15.568546 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:35:15.568546 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:35:15.568546 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:35:15.568546 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:35:15.568546 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:35:15.568546 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:35:15.568546 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc8c1c2b-eb55-4361-bcd7-e66c270b827a could not be found. Sep 07 12:35:15.568546 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:15.568546 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:15.568546 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:15.568546 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:15.568546 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:35:15.568546 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:35:15.568546 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:35:15.568546 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:35:15.568546 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:35:15.569886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:35:15.569886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:35:15.569886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:35:15.569886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:35:15.569886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:35:15.569886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:35:15.569886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:35:15.569886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc8c1c2b-eb55-4361-bcd7-e66c270b827a could not be found. Sep 07 12:35:15.569886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:15.569886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:15.569886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:15.569886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:15.569886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:35:15.569886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:35:15.569886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:35:15.569886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:35:15.569886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc8c1c2b-eb55-4361-bcd7-e66c270b827a could not be found. Sep 07 12:35:15.569886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:15.573407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4bfb252c-46bc-4d1a-8b52-a71dbc1a3597 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] Returning 404 to user: Instance fc8c1c2b-eb55-4361-bcd7-e66c270b827a could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:35:15.576922 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4bfb252c-46bc-4d1a-8b52-a71dbc1a3597 tempest-MigrationsAdminTest-1611333289 tempest-MigrationsAdminTest-1611333289-project] 10.222.0.16 "GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a" status: 404 len: 111 microversion: 2.1 time: 0.155191 Sep 07 12:35:15.581059 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 780/1610] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:15 2022] GET /compute/v2.1/servers/fc8c1c2b-eb55-4361-bcd7-e66c270b827a => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:35:15.672590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbb3b649-31e3-4a90-8c8c-b0e057e075b6 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:15.673472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbb3b649-31e3-4a90-8c8c-b0e057e075b6 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:15.674302 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbb3b649-31e3-4a90-8c8c-b0e057e075b6 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:15.675349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-bbb3b649-31e3-4a90-8c8c-b0e057e075b6 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lazy-loading 'fault' on Instance uuid 7b65cf6c-5a50-4c86-9255-c7d712522cfe {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:35:15.775093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-79ab7a9c-19dc-4220-b932-18fb47f7b79c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:15.779531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-79ab7a9c-19dc-4220-b932-18fb47f7b79c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:15.802794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:35:15.813579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79ab7a9c-19dc-4220-b932-18fb47f7b79c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:15.831697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bbb3b649-31e3-4a90-8c8c-b0e057e075b6 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:15.838580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79ab7a9c-19dc-4220-b932-18fb47f7b79c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:15.839385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79ab7a9c-19dc-4220-b932-18fb47f7b79c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:15.840698 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79ab7a9c-19dc-4220-b932-18fb47f7b79c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:15.841587 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79ab7a9c-19dc-4220-b932-18fb47f7b79c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:15.842676 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79ab7a9c-19dc-4220-b932-18fb47f7b79c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:15.850473 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bbb3b649-31e3-4a90-8c8c-b0e057e075b6 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe" status: 200 len: 1303 microversion: 2.1 time: 0.387735 Sep 07 12:35:15.851424 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 831/1611] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:15 2022] GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe => generated 1303 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:35:16.064610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-79ab7a9c-19dc-4220-b932-18fb47f7b79c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:16.098794 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-79ab7a9c-19dc-4220-b932-18fb47f7b79c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 200 len: 1266 microversion: 2.1 time: 0.334599 Sep 07 12:35:16.104509 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 781/1612] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:15 2022] GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 1266 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:35:16.903597 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c06f8251-bd55-485e-8bbb-2e605190ed1b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:16.906299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c06f8251-bd55-485e-8bbb-2e605190ed1b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b65cf6c-5a50-4c86-9255-c7d712522cfe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:16.922211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c06f8251-bd55-485e-8bbb-2e605190ed1b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:16.923427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c06f8251-bd55-485e-8bbb-2e605190ed1b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:16.924135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c06f8251-bd55-485e-8bbb-2e605190ed1b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:16.925738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c06f8251-bd55-485e-8bbb-2e605190ed1b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:16.926578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c06f8251-bd55-485e-8bbb-2e605190ed1b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:16.927262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c06f8251-bd55-485e-8bbb-2e605190ed1b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:16.952033 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-c06f8251-bd55-485e-8bbb-2e605190ed1b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] HTTP exception thrown: Instance 7b65cf6c-5a50-4c86-9255-c7d712522cfe could not be found. Sep 07 12:35:16.955344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c06f8251-bd55-485e-8bbb-2e605190ed1b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Request method failure captured: Sep 07 12:35:16.955344 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe HTTP/1.1 Sep 07 12:35:16.955344 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:35:16.955344 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:35:16.955344 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:35:16.955344 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:35:16.955344 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:35:16.955344 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:35:16.955344 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:35:16.955344 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:35:16.955344 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI8q7yUnzgHWZvYeTcnyQarqcnB_Ztsqtibb942yg6cqDTJlhk8qfTZn2bxhyk11cA6j_S4hfMqtTOG-G5_ClyfZkPg9vODiEtxsdX3AfIWhEPMch4seCj0iIUSi1_ZdXyAVaUVVtPFdTVsXm5t2HXazb63J5VXYtOUDGnld4W7doEE Sep 07 12:35:16.955344 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:35:16.955344 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:35:16.955344 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:35:16.955344 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:35:16.955344 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:35:16.955344 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:35:16.955344 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 7d8dd874b3674087a3e969424a561530 Sep 07 12:35:16.955344 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersAdminTestJSON-340496789 Sep 07 12:35:16.955344 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:35:16.955344 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:35:16.957203 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d8dd874b3674087a3e969424a561530"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d8dd874b3674087a3e969424a561530"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d8dd874b3674087a3e969424a561530"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d8dd874b3674087a3e969424a561530"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:35:16.957203 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersAdminTestJSON-340496789 Sep 07 12:35:16.957203 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 7d8dd874b3674087a3e969424a561530 Sep 07 12:35:16.957203 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersAdminTestJSON-340496789 Sep 07 12:35:16.957203 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersAdminTestJSON-340496789-project Sep 07 12:35:16.957203 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:35:16.957203 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:35:16.957203 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 50d97d3b953f4690b54fde1a4da81cd4 Sep 07 12:35:16.957203 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersAdminTestJSON-340496789-project Sep 07 12:35:16.957203 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:35:16.957203 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 7b65cf6c-5a50-4c86-9255-c7d712522cfe could not be found. Sep 07 12:35:16.957203 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '7b65cf6c-5a50-4c86-9255-c7d712522cfe'} Sep 07 12:35:16.958460 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:35:16.958460 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:16.958460 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:35:16.958460 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:35:16.958460 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:35:16.958460 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:35:16.958460 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:35:16.958460 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:35:16.958460 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:35:16.958460 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:35:16.958460 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b65cf6c-5a50-4c86-9255-c7d712522cfe could not be found. Sep 07 12:35:16.958460 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:16.958460 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:16.958460 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:16.958460 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:16.958460 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:35:16.958460 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:35:16.958460 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:35:16.958460 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:35:16.958460 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:35:16.959888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:35:16.959888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:35:16.959888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:35:16.959888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:35:16.959888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:35:16.959888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:35:16.959888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:35:16.959888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b65cf6c-5a50-4c86-9255-c7d712522cfe could not be found. Sep 07 12:35:16.959888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:16.959888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:16.959888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:16.959888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:16.959888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:35:16.959888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:35:16.959888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:35:16.959888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:35:16.959888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b65cf6c-5a50-4c86-9255-c7d712522cfe could not be found. Sep 07 12:35:16.959888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:16.969614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c06f8251-bd55-485e-8bbb-2e605190ed1b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Returning 404 to user: Instance 7b65cf6c-5a50-4c86-9255-c7d712522cfe could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:35:16.972369 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c06f8251-bd55-485e-8bbb-2e605190ed1b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe" status: 404 len: 111 microversion: 2.1 time: 0.082287 Sep 07 12:35:16.974232 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 832/1613] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:16 2022] GET /compute/v2.1/servers/7b65cf6c-5a50-4c86-9255-c7d712522cfe => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:35:16.989342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a76f8e59-9279-4b0f-97a9-a45286e99bc2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:17.000464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a76f8e59-9279-4b0f-97a9-a45286e99bc2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:17.007577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:35:17.045706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a76f8e59-9279-4b0f-97a9-a45286e99bc2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:17.046883 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a76f8e59-9279-4b0f-97a9-a45286e99bc2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:17.047998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a76f8e59-9279-4b0f-97a9-a45286e99bc2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:17.052735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a76f8e59-9279-4b0f-97a9-a45286e99bc2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:17.054087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a76f8e59-9279-4b0f-97a9-a45286e99bc2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:17.055754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a76f8e59-9279-4b0f-97a9-a45286e99bc2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:17.150306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a76f8e59-9279-4b0f-97a9-a45286e99bc2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:35:17.154301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f93e302c-a603-4c80-a9d4-e501503acdea tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:17.159244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f93e302c-a603-4c80-a9d4-e501503acdea tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:17.194308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f93e302c-a603-4c80-a9d4-e501503acdea tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:17.195472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f93e302c-a603-4c80-a9d4-e501503acdea tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:17.196788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f93e302c-a603-4c80-a9d4-e501503acdea tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:17.202801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f93e302c-a603-4c80-a9d4-e501503acdea tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:17.207470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f93e302c-a603-4c80-a9d4-e501503acdea tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:17.221002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f93e302c-a603-4c80-a9d4-e501503acdea tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:17.390900 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a76f8e59-9279-4b0f-97a9-a45286e99bc2 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 204 len: 0 microversion: 2.1 time: 0.409015 Sep 07 12:35:17.395271 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 782/1614] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:35:16 2022] DELETE /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:35:17.401521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-98894b2e-904d-4e02-bd38-d83845ed659b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:17.422650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-98894b2e-904d-4e02-bd38-d83845ed659b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:17.437459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98894b2e-904d-4e02-bd38-d83845ed659b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:17.438383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98894b2e-904d-4e02-bd38-d83845ed659b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:17.439034 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98894b2e-904d-4e02-bd38-d83845ed659b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:17.439999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98894b2e-904d-4e02-bd38-d83845ed659b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:17.440665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98894b2e-904d-4e02-bd38-d83845ed659b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:17.441300 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98894b2e-904d-4e02-bd38-d83845ed659b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:17.699853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:35:18.203255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-98894b2e-904d-4e02-bd38-d83845ed659b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:18.215815 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-98894b2e-904d-4e02-bd38-d83845ed659b tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1469 microversion: 2.1 time: 0.817677 Sep 07 12:35:18.229514 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 783/1615] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:17 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1469 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:18.230407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-81324a17-5806-409b-8ac7-4a0325728fc4 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:18.234332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-81324a17-5806-409b-8ac7-4a0325728fc4 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:18.278401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81324a17-5806-409b-8ac7-4a0325728fc4 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:18.283056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81324a17-5806-409b-8ac7-4a0325728fc4 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:18.283671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81324a17-5806-409b-8ac7-4a0325728fc4 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:18.291275 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81324a17-5806-409b-8ac7-4a0325728fc4 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:18.292021 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81324a17-5806-409b-8ac7-4a0325728fc4 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:18.292518 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81324a17-5806-409b-8ac7-4a0325728fc4 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:18.403449 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-81324a17-5806-409b-8ac7-4a0325728fc4 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.182867 Sep 07 12:35:18.403951 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 784/1616] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:35:18 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec/os-volume_attachments => generated 25 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:35:18.565471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c183bb3e-38e0-4705-a660-e03249ff4515 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:18.570610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c183bb3e-38e0-4705-a660-e03249ff4515 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:18.594998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c183bb3e-38e0-4705-a660-e03249ff4515 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:18.596781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c183bb3e-38e0-4705-a660-e03249ff4515 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:18.598017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c183bb3e-38e0-4705-a660-e03249ff4515 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:18.599812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c183bb3e-38e0-4705-a660-e03249ff4515 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:18.600969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c183bb3e-38e0-4705-a660-e03249ff4515 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:18.609192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c183bb3e-38e0-4705-a660-e03249ff4515 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:18.724334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f93e302c-a603-4c80-a9d4-e501503acdea tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:18.727695 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c183bb3e-38e0-4705-a660-e03249ff4515 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.166200 Sep 07 12:35:18.736465 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 785/1617] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:35:18 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec/os-volume_attachments => generated 25 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 12:35:18.738907 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f93e302c-a603-4c80-a9d4-e501503acdea tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 200 len: 1308 microversion: 2.1 time: 1.593901 Sep 07 12:35:18.759028 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 833/1618] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:17 2022] GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 1308 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:35:18.910608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-81dc5664-77c8-4f35-9e19-e1fc31f58123 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:18.911479 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-81dc5664-77c8-4f35-9e19-e1fc31f58123 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:18.917542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:35:18.937222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81dc5664-77c8-4f35-9e19-e1fc31f58123 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:18.937222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81dc5664-77c8-4f35-9e19-e1fc31f58123 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:18.938836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81dc5664-77c8-4f35-9e19-e1fc31f58123 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:18.942329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81dc5664-77c8-4f35-9e19-e1fc31f58123 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:18.945343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81dc5664-77c8-4f35-9e19-e1fc31f58123 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:18.946417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81dc5664-77c8-4f35-9e19-e1fc31f58123 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:19.023429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-81dc5664-77c8-4f35-9e19-e1fc31f58123 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:35:19.223617 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-81dc5664-77c8-4f35-9e19-e1fc31f58123 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec" status: 204 len: 0 microversion: 2.1 time: 0.317764 Sep 07 12:35:19.228514 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 786/1619] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:35:18 2022] DELETE /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:35:19.237068 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e31be721-4762-46c6-aba3-090d93d0405a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:19.255840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e31be721-4762-46c6-aba3-090d93d0405a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:19.269563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae780933-ce74-4458-8d92-5a41c886d249 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:19.274489 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ae780933-ce74-4458-8d92-5a41c886d249 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:19.293194 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e31be721-4762-46c6-aba3-090d93d0405a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:19.301441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae780933-ce74-4458-8d92-5a41c886d249 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:19.302698 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae780933-ce74-4458-8d92-5a41c886d249 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:19.306727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae780933-ce74-4458-8d92-5a41c886d249 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:19.308991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae780933-ce74-4458-8d92-5a41c886d249 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:19.309160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e31be721-4762-46c6-aba3-090d93d0405a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:19.312464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e31be721-4762-46c6-aba3-090d93d0405a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:19.314790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae780933-ce74-4458-8d92-5a41c886d249 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:19.315636 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae780933-ce74-4458-8d92-5a41c886d249 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:19.319996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e31be721-4762-46c6-aba3-090d93d0405a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:19.320882 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e31be721-4762-46c6-aba3-090d93d0405a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:19.321640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e31be721-4762-46c6-aba3-090d93d0405a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:19.367167 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:35:19.410183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:35:20.376178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ae780933-ce74-4458-8d92-5a41c886d249 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:20.400951 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ae780933-ce74-4458-8d92-5a41c886d249 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1469 microversion: 2.1 time: 1.156316 Sep 07 12:35:20.418871 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 787/1620] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:19 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1469 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:20.422383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f9d128f-8bd5-4789-bdbc-39d953f4258b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:20.423472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0f9d128f-8bd5-4789-bdbc-39d953f4258b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:20.468177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f9d128f-8bd5-4789-bdbc-39d953f4258b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:20.472229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f9d128f-8bd5-4789-bdbc-39d953f4258b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:20.476363 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f9d128f-8bd5-4789-bdbc-39d953f4258b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:20.481973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f9d128f-8bd5-4789-bdbc-39d953f4258b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:20.485594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f9d128f-8bd5-4789-bdbc-39d953f4258b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:20.492586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f9d128f-8bd5-4789-bdbc-39d953f4258b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:21.093928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e31be721-4762-46c6-aba3-090d93d0405a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7ad5e634ea41e3aed6caa5652e784e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6f7d9efc940449d014d41cf2f18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:21.153934 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e31be721-4762-46c6-aba3-090d93d0405a tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec" status: 200 len: 1681 microversion: 2.1 time: 1.926485 Sep 07 12:35:21.182800 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 834/1621] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:19 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec => generated 1681 bytes in 1957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:21.445115 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1c7c72b4-6c90-429b-b4d2-1c73428b5346 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:21.454457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1c7c72b4-6c90-429b-b4d2-1c73428b5346 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:21.495065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c7c72b4-6c90-429b-b4d2-1c73428b5346 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:21.506157 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c7c72b4-6c90-429b-b4d2-1c73428b5346 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:21.507035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c7c72b4-6c90-429b-b4d2-1c73428b5346 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:21.514175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c7c72b4-6c90-429b-b4d2-1c73428b5346 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:21.515222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c7c72b4-6c90-429b-b4d2-1c73428b5346 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:21.516874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c7c72b4-6c90-429b-b4d2-1c73428b5346 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:21.764827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0f9d128f-8bd5-4789-bdbc-39d953f4258b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:21.781520 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0f9d128f-8bd5-4789-bdbc-39d953f4258b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 200 len: 1308 microversion: 2.1 time: 1.376082 Sep 07 12:35:21.786945 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 788/1622] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:20 2022] GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 1308 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:21.819116 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-755a1c99-1c2e-44a5-94d0-32808475d177 req-2f34fc97-dbfc-4f8d-8303-a2c30e57a06e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03263c2b-a3d1-4f6c-a5c9-ee201f82bb81", "tag": "50a71a57-d6a7-4fc4-884d-37725c6e2f65"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:21.912780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1c7c72b4-6c90-429b-b4d2-1c73428b5346 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d97d3b953f4690b54fde1a4da81cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8dd874b3674087a3e969424a561530', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:21.938073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-755a1c99-1c2e-44a5-94d0-32808475d177 req-2f34fc97-dbfc-4f8d-8303-a2c30e57a06e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:21.941678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-755a1c99-1c2e-44a5-94d0-32808475d177 req-2f34fc97-dbfc-4f8d-8303-a2c30e57a06e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:21.945115 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-755a1c99-1c2e-44a5-94d0-32808475d177 req-2f34fc97-dbfc-4f8d-8303-a2c30e57a06e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:21.972703 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1c7c72b4-6c90-429b-b4d2-1c73428b5346 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 200 len: 1427 microversion: 2.1 time: 0.534328 Sep 07 12:35:22.017385 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 835/1623] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:21 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 1427 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:22.078642 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-755a1c99-1c2e-44a5-94d0-32808475d177 req-2f34fc97-dbfc-4f8d-8303-a2c30e57a06e service nova] Creating event network-changed:50a71a57-d6a7-4fc4-884d-37725c6e2f65 for instance 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 on n-h1-852087-9 Sep 07 12:35:22.107830 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-755a1c99-1c2e-44a5-94d0-32808475d177 req-2f34fc97-dbfc-4f8d-8303-a2c30e57a06e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.296844 Sep 07 12:35:22.109155 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 789/1624] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:35:22.223708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-889d54b9-9d1d-4124-9d66-b6b1724b6b4f tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:22.234930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-889d54b9-9d1d-4124-9d66-b6b1724b6b4f tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:22.312526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-889d54b9-9d1d-4124-9d66-b6b1724b6b4f tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:22.323206 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-889d54b9-9d1d-4124-9d66-b6b1724b6b4f tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:22.324829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-889d54b9-9d1d-4124-9d66-b6b1724b6b4f tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:22.326784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-889d54b9-9d1d-4124-9d66-b6b1724b6b4f tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:22.330822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-889d54b9-9d1d-4124-9d66-b6b1724b6b4f tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:22.335632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-889d54b9-9d1d-4124-9d66-b6b1724b6b4f tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:22.816258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-abb49965-51e0-4fc7-ace1-4c04f80176e0 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:22.817148 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-abb49965-51e0-4fc7-ace1-4c04f80176e0 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:22.843636 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abb49965-51e0-4fc7-ace1-4c04f80176e0 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:22.848464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abb49965-51e0-4fc7-ace1-4c04f80176e0 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:22.850102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abb49965-51e0-4fc7-ace1-4c04f80176e0 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:22.851408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abb49965-51e0-4fc7-ace1-4c04f80176e0 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:22.854399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abb49965-51e0-4fc7-ace1-4c04f80176e0 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:22.856791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abb49965-51e0-4fc7-ace1-4c04f80176e0 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:24.259753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-889d54b9-9d1d-4124-9d66-b6b1724b6b4f tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7ad5e634ea41e3aed6caa5652e784e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6f7d9efc940449d014d41cf2f18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:24.302700 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-889d54b9-9d1d-4124-9d66-b6b1724b6b4f tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec" status: 200 len: 1681 microversion: 2.1 time: 2.088564 Sep 07 12:35:24.312124 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 836/1625] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:22 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec => generated 1681 bytes in 2100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:24.353303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ed6e461e-8706-4dad-bb8c-1428ef62d786 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:24.400324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ed6e461e-8706-4dad-bb8c-1428ef62d786 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] [instance: 7b849d7d-db03-43d3-b94c-3808ea7ae0cb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:24.416055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed6e461e-8706-4dad-bb8c-1428ef62d786 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:24.417953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed6e461e-8706-4dad-bb8c-1428ef62d786 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:24.418746 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed6e461e-8706-4dad-bb8c-1428ef62d786 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:24.419961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed6e461e-8706-4dad-bb8c-1428ef62d786 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:24.420640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed6e461e-8706-4dad-bb8c-1428ef62d786 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:24.422726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed6e461e-8706-4dad-bb8c-1428ef62d786 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:24.443723 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-ed6e461e-8706-4dad-bb8c-1428ef62d786 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] HTTP exception thrown: Instance 7b849d7d-db03-43d3-b94c-3808ea7ae0cb could not be found. Sep 07 12:35:24.445766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ed6e461e-8706-4dad-bb8c-1428ef62d786 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Request method failure captured: Sep 07 12:35:24.445766 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb HTTP/1.1 Sep 07 12:35:24.445766 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:35:24.445766 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:35:24.445766 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:35:24.445766 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:35:24.445766 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:35:24.445766 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:35:24.445766 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:35:24.445766 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:35:24.445766 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI8q7yUnzgHWZvYeTcnyQarqcnB_Ztsqtibb942yg6cqDTJlhk8qfTZn2bxhyk11cA6j_S4hfMqtTOG-G5_ClyfZkPg9vODiEtxsdX3AfIWhEPMch4seCj0iIUSi1_ZdXyAVaUVVtPFdTVsXm5t2HXazb63J5VXYtOUDGnld4W7doEE Sep 07 12:35:24.445766 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:35:24.445766 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:35:24.445766 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:35:24.445766 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:35:24.445766 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:35:24.445766 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:35:24.445766 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 7d8dd874b3674087a3e969424a561530 Sep 07 12:35:24.445766 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersAdminTestJSON-340496789 Sep 07 12:35:24.445766 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:35:24.445766 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:35:24.447350 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d8dd874b3674087a3e969424a561530"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d8dd874b3674087a3e969424a561530"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d8dd874b3674087a3e969424a561530"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d8dd874b3674087a3e969424a561530"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:35:24.447350 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersAdminTestJSON-340496789 Sep 07 12:35:24.447350 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 7d8dd874b3674087a3e969424a561530 Sep 07 12:35:24.447350 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersAdminTestJSON-340496789 Sep 07 12:35:24.447350 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersAdminTestJSON-340496789-project Sep 07 12:35:24.447350 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:35:24.447350 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:35:24.447350 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 50d97d3b953f4690b54fde1a4da81cd4 Sep 07 12:35:24.447350 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersAdminTestJSON-340496789-project Sep 07 12:35:24.447350 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:35:24.447350 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 7b849d7d-db03-43d3-b94c-3808ea7ae0cb could not be found. Sep 07 12:35:24.447350 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '7b849d7d-db03-43d3-b94c-3808ea7ae0cb'} Sep 07 12:35:24.448466 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:35:24.448466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:24.448466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:35:24.448466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:35:24.448466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:35:24.448466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:35:24.448466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:35:24.448466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:35:24.448466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:35:24.448466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:35:24.448466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b849d7d-db03-43d3-b94c-3808ea7ae0cb could not be found. Sep 07 12:35:24.448466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:24.448466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:24.448466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:24.448466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:24.448466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:35:24.448466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:35:24.448466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:35:24.448466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:35:24.448466 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:35:24.449939 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:35:24.449939 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:35:24.449939 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:35:24.449939 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:35:24.449939 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:35:24.449939 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:35:24.449939 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:35:24.449939 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b849d7d-db03-43d3-b94c-3808ea7ae0cb could not be found. Sep 07 12:35:24.449939 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:24.449939 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:24.449939 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:24.449939 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:24.449939 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:35:24.449939 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:35:24.449939 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:35:24.449939 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:35:24.449939 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b849d7d-db03-43d3-b94c-3808ea7ae0cb could not be found. Sep 07 12:35:24.449939 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:24.453948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ed6e461e-8706-4dad-bb8c-1428ef62d786 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] Returning 404 to user: Instance 7b849d7d-db03-43d3-b94c-3808ea7ae0cb could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:35:24.455667 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ed6e461e-8706-4dad-bb8c-1428ef62d786 tempest-ServersAdminTestJSON-340496789 tempest-ServersAdminTestJSON-340496789-project] 10.222.0.16 "GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb" status: 404 len: 111 microversion: 2.1 time: 0.139491 Sep 07 12:35:24.457106 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 837/1626] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:24 2022] GET /compute/v2.1/servers/7b849d7d-db03-43d3-b94c-3808ea7ae0cb => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:35:24.597838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-abb49965-51e0-4fc7-ace1-4c04f80176e0 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:24.671986 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-abb49965-51e0-4fc7-ace1-4c04f80176e0 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 200 len: 1308 microversion: 2.1 time: 1.827554 Sep 07 12:35:24.678377 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 790/1627] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:22 2022] GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 1308 bytes in 1868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:24.707992 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8c839428-1649-4ca1-836c-976b8c285c8e req-83d61dec-4d9e-4110-b1da-018239d781eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b849d7d-db03-43d3-b94c-3808ea7ae0cb", "name": "network-vif-deleted", "tag": "d76c4cb6-1ff0-4c6b-9d8f-eb2ec1601a0d"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:24.756071 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8c839428-1649-4ca1-836c-976b8c285c8e req-83d61dec-4d9e-4110-b1da-018239d781eb service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:24.756868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8c839428-1649-4ca1-836c-976b8c285c8e req-83d61dec-4d9e-4110-b1da-018239d781eb service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:24.757629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8c839428-1649-4ca1-836c-976b8c285c8e req-83d61dec-4d9e-4110-b1da-018239d781eb service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:24.823401 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8c839428-1649-4ca1-836c-976b8c285c8e req-83d61dec-4d9e-4110-b1da-018239d781eb service nova] Creating event network-vif-deleted:d76c4cb6-1ff0-4c6b-9d8f-eb2ec1601a0d for instance 7b849d7d-db03-43d3-b94c-3808ea7ae0cb on n-h2-852087-9 Sep 07 12:35:24.844383 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8c839428-1649-4ca1-836c-976b8c285c8e req-83d61dec-4d9e-4110-b1da-018239d781eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163340 Sep 07 12:35:24.845394 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 791/1628] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:35:24.909652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-54092382-c288-461e-89a1-7b05d2cea8ff req-c2e50c78-e708-46c6-b4ff-1d75fb80e8d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9916ff29-8e9b-41f7-bbde-3f987cd0c9ec", "name": "network-vif-unplugged", "status": "completed", "tag": "7120d1ee-a3b5-4407-ba59-4de91da3dd76"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:24.946360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-54092382-c288-461e-89a1-7b05d2cea8ff req-c2e50c78-e708-46c6-b4ff-1d75fb80e8d6 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:24.949461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-54092382-c288-461e-89a1-7b05d2cea8ff req-c2e50c78-e708-46c6-b4ff-1d75fb80e8d6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:24.950625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-54092382-c288-461e-89a1-7b05d2cea8ff req-c2e50c78-e708-46c6-b4ff-1d75fb80e8d6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:25.009143 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-54092382-c288-461e-89a1-7b05d2cea8ff req-c2e50c78-e708-46c6-b4ff-1d75fb80e8d6 service nova] Creating event network-vif-unplugged:7120d1ee-a3b5-4407-ba59-4de91da3dd76 for instance 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec on n-h1-852087-9 Sep 07 12:35:25.021065 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-54092382-c288-461e-89a1-7b05d2cea8ff req-c2e50c78-e708-46c6-b4ff-1d75fb80e8d6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.164828 Sep 07 12:35:25.024960 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 792/1629] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:35:25.035684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4de14bf7-27b0-474f-a0df-736277f40322 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1394813707", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "90fd0444-8940-4097-8547-6568e7ca00e8"}], "block_device_mapping_v2": [{"uuid": "843c6f33-ec39-4a39-8b1b-2819cdaeaa4b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:25.257387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-4de14bf7-27b0-474f-a0df-736277f40322 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] validate_networks() for [('90fd0444-8940-4097-8547-6568e7ca00e8', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:35:25.763869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-da6509cb-1a0b-4707-b1a0-d2ab9f861f0d tempest-FlavorsV2NegativeTest-537078818 tempest-FlavorsV2NegativeTest-537078818-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:25.806055 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-da6509cb-1a0b-4707-b1a0-d2ab9f861f0d tempest-FlavorsV2NegativeTest-537078818 tempest-FlavorsV2NegativeTest-537078818-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 1.347313 Sep 07 12:35:25.807854 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 838/1630] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:35:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:35:25.813929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cdfbd22d-4a18-4509-b451-40c4e6ef2b66 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:25.815089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cdfbd22d-4a18-4509-b451-40c4e6ef2b66 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:25.821766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:35:25.850223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdfbd22d-4a18-4509-b451-40c4e6ef2b66 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:25.851147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdfbd22d-4a18-4509-b451-40c4e6ef2b66 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:25.851777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdfbd22d-4a18-4509-b451-40c4e6ef2b66 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:25.852825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdfbd22d-4a18-4509-b451-40c4e6ef2b66 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:25.853552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdfbd22d-4a18-4509-b451-40c4e6ef2b66 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:25.854673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdfbd22d-4a18-4509-b451-40c4e6ef2b66 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:26.363621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cdfbd22d-4a18-4509-b451-40c4e6ef2b66 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7ad5e634ea41e3aed6caa5652e784e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6f7d9efc940449d014d41cf2f18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:26.378809 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cdfbd22d-4a18-4509-b451-40c4e6ef2b66 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec" status: 200 len: 1613 microversion: 2.1 time: 0.566289 Sep 07 12:35:26.382715 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 839/1631] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:25 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec => generated 1613 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:26.408259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-444d753c-d898-4fcb-ac83-149ec6ce3ef1 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:26.411822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-444d753c-d898-4fcb-ac83-149ec6ce3ef1 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:26.439633 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-444d753c-d898-4fcb-ac83-149ec6ce3ef1 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:26.442491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-444d753c-d898-4fcb-ac83-149ec6ce3ef1 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:26.443016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-444d753c-d898-4fcb-ac83-149ec6ce3ef1 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:26.443776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-444d753c-d898-4fcb-ac83-149ec6ce3ef1 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:26.446705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-444d753c-d898-4fcb-ac83-149ec6ce3ef1 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:26.447247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-444d753c-d898-4fcb-ac83-149ec6ce3ef1 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:27.352338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-444d753c-d898-4fcb-ac83-149ec6ce3ef1 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:27.400507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-4de14bf7-27b0-474f-a0df-736277f40322 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:35:27.401222 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-444d753c-d898-4fcb-ac83-149ec6ce3ef1 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 200 len: 1308 microversion: 2.1 time: 1.012434 Sep 07 12:35:27.401639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-4de14bf7-27b0-474f-a0df-736277f40322 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:35:27.402170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-4de14bf7-27b0-474f-a0df-736277f40322 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:35:27.402589 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-4de14bf7-27b0-474f-a0df-736277f40322 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:35:27.403020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-4de14bf7-27b0-474f-a0df-736277f40322 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:35:27.405392 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 840/1632] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:26 2022] GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 1308 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:27.424719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4de14bf7-27b0-474f-a0df-736277f40322 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:27.430914 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4de14bf7-27b0-474f-a0df-736277f40322 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:27.431660 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4de14bf7-27b0-474f-a0df-736277f40322 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:27.432513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4de14bf7-27b0-474f-a0df-736277f40322 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:27.433005 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4de14bf7-27b0-474f-a0df-736277f40322 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:27.433441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4de14bf7-27b0-474f-a0df-736277f40322 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:27.494608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-4de14bf7-27b0-474f-a0df-736277f40322 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Getting quotas for project b32e8c6ba4e2486aa9769db48d2250d9. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:35:27.502996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-4de14bf7-27b0-474f-a0df-736277f40322 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Getting quotas for user f009cb4fb12841a0ada96dc8c47cf2bd and project b32e8c6ba4e2486aa9769db48d2250d9. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:35:27.714439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4de14bf7-27b0-474f-a0df-736277f40322 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:35:27.721046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4de14bf7-27b0-474f-a0df-736277f40322 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='843c6f33-ec39-4a39-8b1b-2819cdaeaa4b',volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:35:28.070866 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4de14bf7-27b0-474f-a0df-736277f40322 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.043151 Sep 07 12:35:28.072768 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 793/1633] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:35:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:35:28.078765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-44ccc7c8-c3d4-4d20-a841-75b64ea35e71 tempest-FlavorsV2NegativeTest-537078818 tempest-FlavorsV2NegativeTest-537078818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-2057319307", "imageRef": "a52b9290-a2c3-429a-9e2a-71f5b8b5c5f1", "flavorRef": "452"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:28.147240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-44ccc7c8-c3d4-4d20-a841-75b64ea35e71 tempest-FlavorsV2NegativeTest-537078818 tempest-FlavorsV2NegativeTest-537078818-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:35:28.296489 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-899cda1f-879e-4e26-a7b8-6b237d4149cd tempest-QuotaClassesAdmin257Test-1201851238 tempest-QuotaClassesAdmin257Test-1201851238-project-admin] Calling method '.version_select at 0x7fc41d24cca0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:28.349977 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-899cda1f-879e-4e26-a7b8-6b237d4149cd tempest-QuotaClassesAdmin257Test-1201851238 tempest-QuotaClassesAdmin257Test-1201851238-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.939600 Sep 07 12:35:28.356865 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 841/1634] 10.222.0.16 () {60 vars in 1226 bytes} [Wed Sep 7 12:35:27 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:35:28.377624 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df51a604-dcc2-4efc-85e2-3b4836c03a48 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:28.379549 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-df51a604-dcc2-4efc-85e2-3b4836c03a48 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:28.409673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df51a604-dcc2-4efc-85e2-3b4836c03a48 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:28.410652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df51a604-dcc2-4efc-85e2-3b4836c03a48 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:28.411659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df51a604-dcc2-4efc-85e2-3b4836c03a48 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:28.413143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df51a604-dcc2-4efc-85e2-3b4836c03a48 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:28.420000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df51a604-dcc2-4efc-85e2-3b4836c03a48 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:28.421414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df51a604-dcc2-4efc-85e2-3b4836c03a48 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:28.596914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df51a604-dcc2-4efc-85e2-3b4836c03a48 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:28.605845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df51a604-dcc2-4efc-85e2-3b4836c03a48 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:28.606733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df51a604-dcc2-4efc-85e2-3b4836c03a48 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:28.607553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-df51a604-dcc2-4efc-85e2-3b4836c03a48 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lazy-loading 'fault' on Instance uuid 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:35:28.760026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-df51a604-dcc2-4efc-85e2-3b4836c03a48 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7ad5e634ea41e3aed6caa5652e784e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b6f7d9efc940449d014d41cf2f18c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:28.789475 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-df51a604-dcc2-4efc-85e2-3b4836c03a48 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec" status: 200 len: 1331 microversion: 2.1 time: 0.429319 Sep 07 12:35:28.793563 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 842/1635] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:28 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec => generated 1331 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:28.816338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-a8d7abba-46e4-472b-b311-778157764bb3 req-8fdb8411-ba1b-4c9c-9ca1-e0cb4636e680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9916ff29-8e9b-41f7-bbde-3f987cd0c9ec", "name": "network-vif-deleted", "tag": "7120d1ee-a3b5-4407-ba59-4de91da3dd76"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:28.863969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a8d7abba-46e4-472b-b311-778157764bb3 req-8fdb8411-ba1b-4c9c-9ca1-e0cb4636e680 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:28.864842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a8d7abba-46e4-472b-b311-778157764bb3 req-8fdb8411-ba1b-4c9c-9ca1-e0cb4636e680 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:28.865649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a8d7abba-46e4-472b-b311-778157764bb3 req-8fdb8411-ba1b-4c9c-9ca1-e0cb4636e680 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:28.922478 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-a8d7abba-46e4-472b-b311-778157764bb3 req-8fdb8411-ba1b-4c9c-9ca1-e0cb4636e680 service nova] Creating event network-vif-deleted:7120d1ee-a3b5-4407-ba59-4de91da3dd76 for instance 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec on n-h1-852087-9 Sep 07 12:35:28.933254 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-a8d7abba-46e4-472b-b311-778157764bb3 req-8fdb8411-ba1b-4c9c-9ca1-e0cb4636e680 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137177 Sep 07 12:35:28.935296 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 843/1636] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:35:29.283094 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-44ccc7c8-c3d4-4d20-a841-75b64ea35e71 tempest-FlavorsV2NegativeTest-537078818 tempest-FlavorsV2NegativeTest-537078818-project] HTTP exception thrown: Flavor's memory is too small for requested image. Sep 07 12:35:29.287170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-44ccc7c8-c3d4-4d20-a841-75b64ea35e71 tempest-FlavorsV2NegativeTest-537078818 tempest-FlavorsV2NegativeTest-537078818-project] Request method failure captured: Sep 07 12:35:29.287170 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:35:29.287170 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:35:29.287170 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:35:29.287170 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:35:29.287170 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 143 Sep 07 12:35:29.287170 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:35:29.287170 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:35:29.287170 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:35:29.287170 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:35:29.287170 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJAK68-CIFWQFcFvCVhCer-ENQdPjKUECNgOexyLO2siXTw0tqKhmUdt-EPIE2GDkWhqMztXKa140-vPgKkPWHSbb1SDWV-nhjesoGIxwDD-pOsucWOhXnpmivKg-yOsNohYMN6S9ZW1_CW9EYnNuLizt2o0ndQIuphCB6A-m-5Pc0Q Sep 07 12:35:29.287170 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:35:29.287170 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:35:29.287170 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:35:29.287170 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:35:29.287170 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:35:29.287170 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:35:29.287170 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 18728b0f33e4440a83e8be1fc5b94e7a Sep 07 12:35:29.287170 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-FlavorsV2NegativeTest-537078818 Sep 07 12:35:29.287170 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:35:29.287170 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:35:29.288689 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18728b0f33e4440a83e8be1fc5b94e7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_18728b0f33e4440a83e8be1fc5b94e7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/18728b0f33e4440a83e8be1fc5b94e7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18728b0f33e4440a83e8be1fc5b94e7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:35:29.288689 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-FlavorsV2NegativeTest-537078818 Sep 07 12:35:29.288689 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 18728b0f33e4440a83e8be1fc5b94e7a Sep 07 12:35:29.288689 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-537078818 Sep 07 12:35:29.288689 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-FlavorsV2NegativeTest-537078818-project Sep 07 12:35:29.288689 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:35:29.288689 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:35:29.288689 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 0b3abe2e65c9427fb9323d2a3ed3fa0c Sep 07 12:35:29.288689 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-FlavorsV2NegativeTest-537078818-project Sep 07 12:35:29.288689 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:35:29.288689 n-d-852087-9 devstack@n-api.service[122433]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-2057319307", "imageRef": "a52b9290-a2c3-429a-9e2a-71f5b8b5c5f1", "flavorRef": "452"}} Sep 07 12:35:29.288689 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:35:29.289742 n-d-852087-9 devstack@n-api.service[122433]: exception: Flavor's memory is too small for requested image. Sep 07 12:35:29.289742 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-2057319307', 'imageRef': 'a52b9290-a2c3-429a-9e2a-71f5b8b5c5f1', 'flavorRef': '452'}}} Sep 07 12:35:29.289742 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:35:29.289742 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:29.289742 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 07 12:35:29.289742 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 07 12:35:29.289742 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 07 12:35:29.289742 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 07 12:35:29.289742 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 07 12:35:29.289742 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 07 12:35:29.289742 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Sep 07 12:35:29.289742 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Sep 07 12:35:29.289742 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Sep 07 12:35:29.289742 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Sep 07 12:35:29.289742 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Sep 07 12:35:29.289742 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Sep 07 12:35:29.289742 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Sep 07 12:35:29.289742 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:29.289742 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:29.289742 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:29.291330 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:29.291330 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:35:29.291330 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:35:29.291330 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:35:29.291330 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:35:29.291330 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:35:29.291330 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:35:29.291330 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:35:29.291330 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:35:29.291330 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:35:29.291330 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:35:29.291330 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:35:29.291330 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:35:29.291330 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 07 12:35:29.291330 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Sep 07 12:35:29.291330 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 07 12:35:29.291330 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Sep 07 12:35:29.291330 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:29.291330 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:29.291330 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:29.291330 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:29.296232 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:35:29.296232 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:35:29.296232 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:35:29.296232 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:35:29.296232 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Sep 07 12:35:29.296232 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:29.296232 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-44ccc7c8-c3d4-4d20-a841-75b64ea35e71 tempest-FlavorsV2NegativeTest-537078818 tempest-FlavorsV2NegativeTest-537078818-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:35:29.303851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8aaa899f-e0f1-4987-a847-1221d5ebaa4c tempest-FloatingIPsTestJSON-1110706936 tempest-FloatingIPsTestJSON-1110706936-project] Action: 'create', calling method: .version_select at 0x7fc41d292040>, body: {"pool": null} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:29.305414 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-44ccc7c8-c3d4-4d20-a841-75b64ea35e71 tempest-FlavorsV2NegativeTest-537078818 tempest-FlavorsV2NegativeTest-537078818-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.215516 Sep 07 12:35:29.310973 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 794/1637] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:35:28 2022] POST /compute/v2.1/servers => generated 93 bytes in 1234 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 07 12:35:29.318355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ad318c55-b754-4ce8-aa74-71a5b4d0d8ec tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:29.318979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ad318c55-b754-4ce8-aa74-71a5b4d0d8ec tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:29.565054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ad318c55-b754-4ce8-aa74-71a5b4d0d8ec tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:29.596394 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ad318c55-b754-4ce8-aa74-71a5b4d0d8ec tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1053 microversion: 2.1 time: 0.278502 Sep 07 12:35:29.600638 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 795/1638] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:29 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1053 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:29.618396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4c6bf3b2-57f8-403d-8b86-f0ca82fb5f5f tempest-QuotaClassesAdmin257Test-1201851238 tempest-QuotaClassesAdmin257Test-1201851238-project-admin] Action: 'update', calling method: .version_select at 0x7fc419795ee0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:29.924885 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4c6bf3b2-57f8-403d-8b86-f0ca82fb5f5f tempest-QuotaClassesAdmin257Test-1201851238 tempest-QuotaClassesAdmin257Test-1201851238-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.317517 Sep 07 12:35:29.928778 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 796/1639] 10.222.0.16 () {62 vars in 1247 bytes} [Wed Sep 7 12:35:29 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:35:29.956670 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-10aa6028-94e7-47f6-ba2f-65675795e859 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:29.958233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-10aa6028-94e7-47f6-ba2f-65675795e859 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:29.994429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10aa6028-94e7-47f6-ba2f-65675795e859 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:29.997414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10aa6028-94e7-47f6-ba2f-65675795e859 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:29.998420 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10aa6028-94e7-47f6-ba2f-65675795e859 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:30.002738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10aa6028-94e7-47f6-ba2f-65675795e859 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:30.003924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10aa6028-94e7-47f6-ba2f-65675795e859 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:30.006197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10aa6028-94e7-47f6-ba2f-65675795e859 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:30.579828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-10aa6028-94e7-47f6-ba2f-65675795e859 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:30.611404 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-10aa6028-94e7-47f6-ba2f-65675795e859 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 200 len: 1308 microversion: 2.1 time: 0.680102 Sep 07 12:35:30.612448 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 797/1640] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:29 2022] GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 1308 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:30.641329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-d79133ec-2248-4678-9533-562c85033c91 req-71f8996c-05bb-45b4-959f-f2d9b27b6d68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03263c2b-a3d1-4f6c-a5c9-ee201f82bb81", "name": "network-vif-plugged", "status": "completed", "tag": "50a71a57-d6a7-4fc4-884d-37725c6e2f65"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:30.686387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d79133ec-2248-4678-9533-562c85033c91 req-71f8996c-05bb-45b4-959f-f2d9b27b6d68 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:30.693112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d79133ec-2248-4678-9533-562c85033c91 req-71f8996c-05bb-45b4-959f-f2d9b27b6d68 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:30.700685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d79133ec-2248-4678-9533-562c85033c91 req-71f8996c-05bb-45b4-959f-f2d9b27b6d68 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:30.742705 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-d79133ec-2248-4678-9533-562c85033c91 req-71f8996c-05bb-45b4-959f-f2d9b27b6d68 service nova] Creating event network-vif-plugged:50a71a57-d6a7-4fc4-884d-37725c6e2f65 for instance 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 on n-h1-852087-9 Sep 07 12:35:30.768484 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-d79133ec-2248-4678-9533-562c85033c91 req-71f8996c-05bb-45b4-959f-f2d9b27b6d68 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139129 Sep 07 12:35:30.769539 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 798/1641] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:35:30.787004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f83420ef-0322-4664-b19a-d3467760e047 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:30.787827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f83420ef-0322-4664-b19a-d3467760e047 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:30.800763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f83420ef-0322-4664-b19a-d3467760e047 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:30.809784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f83420ef-0322-4664-b19a-d3467760e047 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:30.811058 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f83420ef-0322-4664-b19a-d3467760e047 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:30.813206 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f83420ef-0322-4664-b19a-d3467760e047 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:30.814588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f83420ef-0322-4664-b19a-d3467760e047 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:30.815761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f83420ef-0322-4664-b19a-d3467760e047 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:30.932166 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-f83420ef-0322-4664-b19a-d3467760e047 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] HTTP exception thrown: Instance 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec could not be found. Sep 07 12:35:30.942730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f83420ef-0322-4664-b19a-d3467760e047 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Request method failure captured: Sep 07 12:35:30.942730 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec HTTP/1.1 Sep 07 12:35:30.942730 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:35:30.942730 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:35:30.942730 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:35:30.942730 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:35:30.942730 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:35:30.942730 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:35:30.942730 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:35:30.942730 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:35:30.942730 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI8f60Q_R3LzLp3jAIc0-tjl1pfIhEvJf4LtwnqXAv9cjAwUkkuV_aPDdMFnT4YDUr0-zEP8cXZ_PJaZ1HQS5MgfJVo2PrKdQsL2QC0fahtgIv40-eN4IIyScdtKmywJFuVi_mT7Z4qa1PTze2yjRnUzu7adQ9WXSMMUz3AQlTtNDUc Sep 07 12:35:30.942730 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:35:30.942730 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:35:30.942730 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:35:30.942730 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:35:30.942730 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:35:30.942730 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:35:30.942730 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 16b6f7d9efc940449d014d41cf2f18c2 Sep 07 12:35:30.942730 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1507282915 Sep 07 12:35:30.942730 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:35:30.942730 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:35:30.945732 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/16b6f7d9efc940449d014d41cf2f18c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_16b6f7d9efc940449d014d41cf2f18c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/16b6f7d9efc940449d014d41cf2f18c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/16b6f7d9efc940449d014d41cf2f18c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:35:30.945732 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1507282915 Sep 07 12:35:30.945732 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 16b6f7d9efc940449d014d41cf2f18c2 Sep 07 12:35:30.945732 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1507282915 Sep 07 12:35:30.945732 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AttachSCSIVolumeTestJSON-1507282915-project Sep 07 12:35:30.945732 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:35:30.945732 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:35:30.945732 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 0c7ad5e634ea41e3aed6caa5652e784e Sep 07 12:35:30.945732 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1507282915-project Sep 07 12:35:30.945732 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:35:30.945732 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec could not be found. Sep 07 12:35:30.945732 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '9916ff29-8e9b-41f7-bbde-3f987cd0c9ec'} Sep 07 12:35:30.947540 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:35:30.947540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:30.947540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:35:30.947540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:35:30.947540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:35:30.947540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:35:30.947540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:35:30.947540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:35:30.947540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:35:30.947540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:35:30.947540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec could not be found. Sep 07 12:35:30.947540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:30.947540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:30.947540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:30.947540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:30.947540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:35:30.947540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:35:30.947540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:35:30.947540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:35:30.947540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:35:30.950590 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:35:30.950590 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:35:30.950590 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:35:30.950590 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:35:30.950590 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:35:30.950590 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:35:30.950590 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:35:30.950590 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec could not be found. Sep 07 12:35:30.950590 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:30.950590 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:30.950590 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:30.950590 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:30.950590 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:35:30.950590 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:35:30.950590 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:35:30.950590 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:35:30.950590 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec could not be found. Sep 07 12:35:30.950590 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:30.959690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f83420ef-0322-4664-b19a-d3467760e047 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Returning 404 to user: Instance 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:35:30.964479 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f83420ef-0322-4664-b19a-d3467760e047 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec" status: 404 len: 111 microversion: 2.1 time: 0.190117 Sep 07 12:35:30.975560 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 799/1642] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:30 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec => generated 111 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:35:31.008545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-321bac53-77c4-40f0-96c5-f82ff4888628 tempest-QuotaClassesAdmin257Test-1201851238 tempest-QuotaClassesAdmin257Test-1201851238-project-admin] Calling method '.version_select at 0x7fc41d2b29d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:31.062782 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-321bac53-77c4-40f0-96c5-f82ff4888628 tempest-QuotaClassesAdmin257Test-1201851238 tempest-QuotaClassesAdmin257Test-1201851238-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.085027 Sep 07 12:35:31.063812 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 800/1643] 10.222.0.16 () {60 vars in 1226 bytes} [Wed Sep 7 12:35:30 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:35:31.084922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-04cf252c-9df0-467b-b729-2634ab095e34 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:31.086272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-04cf252c-9df0-467b-b729-2634ab095e34 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:31.099231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04cf252c-9df0-467b-b729-2634ab095e34 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:31.100533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04cf252c-9df0-467b-b729-2634ab095e34 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:31.107357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04cf252c-9df0-467b-b729-2634ab095e34 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:31.111738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04cf252c-9df0-467b-b729-2634ab095e34 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:31.116490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04cf252c-9df0-467b-b729-2634ab095e34 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:31.117804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04cf252c-9df0-467b-b729-2634ab095e34 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:31.541677 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-04cf252c-9df0-467b-b729-2634ab095e34 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:31.550922 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-04cf252c-9df0-467b-b729-2634ab095e34 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1159 microversion: 2.1 time: 0.475028 Sep 07 12:35:31.556782 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 801/1644] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:31 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1159 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:31.567752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-30b69c53-b6d0-48d1-95f8-3119efbdf2d5 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '.version_select at 0x7fc418c5be50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:31.623869 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-30b69c53-b6d0-48d1-95f8-3119efbdf2d5 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1989835296" status: 202 len: 0 microversion: 2.1 time: 0.059999 Sep 07 12:35:31.626630 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 802/1645] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Sep 7 12:35:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1989835296 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:35:31.636319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a6af23df-b57e-427f-b0c5-0e8c6d0a4798 tempest-QuotaClassesAdmin257Test-1201851238 tempest-QuotaClassesAdmin257Test-1201851238-project-admin] Action: 'update', calling method: .version_select at 0x7fc419523550>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:31.803488 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a6af23df-b57e-427f-b0c5-0e8c6d0a4798 tempest-QuotaClassesAdmin257Test-1201851238 tempest-QuotaClassesAdmin257Test-1201851238-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.170814 Sep 07 12:35:31.808106 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 803/1646] 10.222.0.16 () {62 vars in 1247 bytes} [Wed Sep 7 12:35:31 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:35:31.827505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dbf933a2-2351-49d8-ad7b-9d4b8e08ae17 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:31.830023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dbf933a2-2351-49d8-ad7b-9d4b8e08ae17 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:31.850182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dbf933a2-2351-49d8-ad7b-9d4b8e08ae17 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:31.850764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dbf933a2-2351-49d8-ad7b-9d4b8e08ae17 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:31.851303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dbf933a2-2351-49d8-ad7b-9d4b8e08ae17 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:31.852060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dbf933a2-2351-49d8-ad7b-9d4b8e08ae17 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:31.852523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dbf933a2-2351-49d8-ad7b-9d4b8e08ae17 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:31.853898 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dbf933a2-2351-49d8-ad7b-9d4b8e08ae17 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:32.223650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dbf933a2-2351-49d8-ad7b-9d4b8e08ae17 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:32.252915 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dbf933a2-2351-49d8-ad7b-9d4b8e08ae17 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 200 len: 1308 microversion: 2.1 time: 0.443267 Sep 07 12:35:32.254021 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 804/1647] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:31 2022] GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 1308 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:32.610718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4da1c9b0-4f73-430d-b8f3-a9fa7a1dfdce tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:32.611215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4da1c9b0-4f73-430d-b8f3-a9fa7a1dfdce tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:32.622446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4da1c9b0-4f73-430d-b8f3-a9fa7a1dfdce tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:32.622958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4da1c9b0-4f73-430d-b8f3-a9fa7a1dfdce tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:32.628069 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4da1c9b0-4f73-430d-b8f3-a9fa7a1dfdce tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:32.632445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4da1c9b0-4f73-430d-b8f3-a9fa7a1dfdce tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:32.634189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4da1c9b0-4f73-430d-b8f3-a9fa7a1dfdce tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:32.634733 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4da1c9b0-4f73-430d-b8f3-a9fa7a1dfdce tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:32.833567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4da1c9b0-4f73-430d-b8f3-a9fa7a1dfdce tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:32.850997 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4da1c9b0-4f73-430d-b8f3-a9fa7a1dfdce tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1169 microversion: 2.1 time: 0.245744 Sep 07 12:35:32.856415 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 805/1648] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:32 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1169 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:33.301102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-50be9e98-5189-4d20-8fb5-75ab5c2038fb tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:33.302161 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-50be9e98-5189-4d20-8fb5-75ab5c2038fb tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:33.325385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50be9e98-5189-4d20-8fb5-75ab5c2038fb tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:33.325975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50be9e98-5189-4d20-8fb5-75ab5c2038fb tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:33.326447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50be9e98-5189-4d20-8fb5-75ab5c2038fb tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:33.327221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50be9e98-5189-4d20-8fb5-75ab5c2038fb tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:33.327706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50be9e98-5189-4d20-8fb5-75ab5c2038fb tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:33.328207 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50be9e98-5189-4d20-8fb5-75ab5c2038fb tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:34.879586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-50be9e98-5189-4d20-8fb5-75ab5c2038fb tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:34.895185 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-50be9e98-5189-4d20-8fb5-75ab5c2038fb tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 200 len: 1308 microversion: 2.1 time: 1.598460 Sep 07 12:35:34.911670 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 806/1649] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:33 2022] GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 1308 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:35:35.151594 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8aaa899f-e0f1-4987-a847-1221d5ebaa4c tempest-FloatingIPsTestJSON-1110706936 tempest-FloatingIPsTestJSON-1110706936-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.213424 Sep 07 12:35:35.152477 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 844/1650] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Sep 7 12:35:28 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:35:35.157381 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e4eb4bf0-3885-4397-971c-58c3bfebeea5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:35.158259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e4eb4bf0-3885-4397-971c-58c3bfebeea5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:35.166971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4eb4bf0-3885-4397-971c-58c3bfebeea5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:35.167783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4eb4bf0-3885-4397-971c-58c3bfebeea5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:35.168402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4eb4bf0-3885-4397-971c-58c3bfebeea5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:35.169339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4eb4bf0-3885-4397-971c-58c3bfebeea5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:35.170022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4eb4bf0-3885-4397-971c-58c3bfebeea5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:35.170614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4eb4bf0-3885-4397-971c-58c3bfebeea5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:35.390763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e4eb4bf0-3885-4397-971c-58c3bfebeea5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:35.402958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1c8133c2-4a92-4266-b88c-de851ab44083 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1565636736", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:35.428609 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e4eb4bf0-3885-4397-971c-58c3bfebeea5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1211 microversion: 2.1 time: 0.269080 Sep 07 12:35:35.441518 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 845/1651] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:35 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1211 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:35.453295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4802fde6-edb6-440f-a503-780fd10b1edf tempest-FloatingIPsTestJSON-1110706936 tempest-FloatingIPsTestJSON-1110706936-project] Calling method '.version_select at 0x7fc41d2ef3a0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:35.470210 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=15,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:35:35.646723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-1c8133c2-4a92-4266-b88c-de851ab44083 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:35:35.892953 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4802fde6-edb6-440f-a503-780fd10b1edf tempest-FloatingIPsTestJSON-1110706936 tempest-FloatingIPsTestJSON-1110706936-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/5558fefa-3e29-4cf7-8441-bcd2addba4f5" status: 200 len: 141 microversion: 2.1 time: 0.461271 Sep 07 12:35:35.893769 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 846/1652] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Sep 7 12:35:35 2022] GET /compute/v2.1/os-floating-ips/5558fefa-3e29-4cf7-8441-bcd2addba4f5 => generated 141 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:35:35.918571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0e6cb595-e01e-461c-99ac-2caf6fe935c0 tempest-FloatingIPsTestJSON-1110706936 tempest-FloatingIPsTestJSON-1110706936-project] Calling method '.version_select at 0x7fc41d2920d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:36.617698 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-1c8133c2-4a92-4266-b88c-de851ab44083 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:35:36.618805 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-1c8133c2-4a92-4266-b88c-de851ab44083 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:35:36.620362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-1c8133c2-4a92-4266-b88c-de851ab44083 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:35:36.621236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-1c8133c2-4a92-4266-b88c-de851ab44083 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:35:36.622928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-1c8133c2-4a92-4266-b88c-de851ab44083 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:35:36.664288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c8133c2-4a92-4266-b88c-de851ab44083 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:36.665159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c8133c2-4a92-4266-b88c-de851ab44083 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:36.665988 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c8133c2-4a92-4266-b88c-de851ab44083 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:36.667047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c8133c2-4a92-4266-b88c-de851ab44083 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:36.667778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c8133c2-4a92-4266-b88c-de851ab44083 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:36.668537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c8133c2-4a92-4266-b88c-de851ab44083 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:36.728053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-1c8133c2-4a92-4266-b88c-de851ab44083 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Getting quotas for project f448aeb9b2f84f6caabfb642a0219854. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:35:36.738451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-1c8133c2-4a92-4266-b88c-de851ab44083 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Getting quotas for user dc75f20bc8dc4bbd8c96e8780970b0b7 and project f448aeb9b2f84f6caabfb642a0219854. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:35:36.789978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1c8133c2-4a92-4266-b88c-de851ab44083 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:35:36.792728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1c8133c2-4a92-4266-b88c-de851ab44083 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] [instance: 5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:35:36.808118 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0e6cb595-e01e-461c-99ac-2caf6fe935c0 tempest-FloatingIPsTestJSON-1110706936 tempest-FloatingIPsTestJSON-1110706936-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.896018 Sep 07 12:35:36.809463 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 847/1653] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Sep 7 12:35:35 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:35:36.834888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f9447a55-ff9f-4339-81a2-ee0def70edb7 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:36.836177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f9447a55-ff9f-4339-81a2-ee0def70edb7 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:36.850573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9447a55-ff9f-4339-81a2-ee0def70edb7 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:36.852568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9447a55-ff9f-4339-81a2-ee0def70edb7 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:36.853908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9447a55-ff9f-4339-81a2-ee0def70edb7 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:36.855786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9447a55-ff9f-4339-81a2-ee0def70edb7 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:36.858429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9447a55-ff9f-4339-81a2-ee0def70edb7 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:36.859991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9447a55-ff9f-4339-81a2-ee0def70edb7 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:36.881200 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1c8133c2-4a92-4266-b88c-de851ab44083 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.968013 Sep 07 12:35:36.887585 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 807/1654] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:35:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:35:36.894169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-309ec899-2662-4301-9b9c-aba98fcedea1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:36.894880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-309ec899-2662-4301-9b9c-aba98fcedea1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:36.914919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-309ec899-2662-4301-9b9c-aba98fcedea1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:36.915607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-309ec899-2662-4301-9b9c-aba98fcedea1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:36.916292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-309ec899-2662-4301-9b9c-aba98fcedea1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:36.917197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-309ec899-2662-4301-9b9c-aba98fcedea1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:36.935495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-309ec899-2662-4301-9b9c-aba98fcedea1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:36.936214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-309ec899-2662-4301-9b9c-aba98fcedea1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:37.306815 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f9447a55-ff9f-4339-81a2-ee0def70edb7 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:37.328171 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f9447a55-ff9f-4339-81a2-ee0def70edb7 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 200 len: 1488 microversion: 2.1 time: 0.516948 Sep 07 12:35:37.329249 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 848/1655] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:36 2022] GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 1488 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:37.338625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-309ec899-2662-4301-9b9c-aba98fcedea1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:37.352780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd913b0f-5afd-4d77-b5a6-c8d73d7021f4 tempest-FloatingIPsTestJSON-1110706936 tempest-FloatingIPsTestJSON-1110706936-project] Calling method '.version_select at 0x7fc41d1dea60>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:37.385183 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-309ec899-2662-4301-9b9c-aba98fcedea1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1211 microversion: 2.1 time: 0.496325 Sep 07 12:35:37.394799 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 808/1656] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:36 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1211 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:37.409988 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-801038b6-4ee2-4090-a351-ec63b3604cab tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:37.411078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-801038b6-4ee2-4090-a351-ec63b3604cab tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:37.432497 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-801038b6-4ee2-4090-a351-ec63b3604cab tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:37.437102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-801038b6-4ee2-4090-a351-ec63b3604cab tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:37.438167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-801038b6-4ee2-4090-a351-ec63b3604cab tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:37.439358 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-801038b6-4ee2-4090-a351-ec63b3604cab tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:37.440981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-801038b6-4ee2-4090-a351-ec63b3604cab tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:37.441413 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-801038b6-4ee2-4090-a351-ec63b3604cab tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:38.267093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-801038b6-4ee2-4090-a351-ec63b3604cab tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lazy-loading 'services' on Instance uuid f070fedf-8028-43e3-97f9-8955e81dc84b {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:35:38.295040 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-801038b6-4ee2-4090-a351-ec63b3604cab tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 2423 microversion: 2.25 time: 0.897290 Sep 07 12:35:38.296163 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 809/1657] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:35:37 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 2423 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:35:38.303553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ebb014c9-6f52-4a4c-8745-982cf77a3660 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:38.304376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ebb014c9-6f52-4a4c-8745-982cf77a3660 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] [instance: 5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:38.318104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebb014c9-6f52-4a4c-8745-982cf77a3660 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:38.319091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebb014c9-6f52-4a4c-8745-982cf77a3660 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:38.320777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebb014c9-6f52-4a4c-8745-982cf77a3660 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:38.324422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebb014c9-6f52-4a4c-8745-982cf77a3660 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:38.326223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebb014c9-6f52-4a4c-8745-982cf77a3660 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:38.329532 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebb014c9-6f52-4a4c-8745-982cf77a3660 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:38.344758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:35:38.606975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ebb014c9-6f52-4a4c-8745-982cf77a3660 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc75f20bc8dc4bbd8c96e8780970b0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f448aeb9b2f84f6caabfb642a0219854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:38.659375 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ebb014c9-6f52-4a4c-8745-982cf77a3660 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] 10.222.0.16 "GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa" status: 200 len: 1210 microversion: 2.1 time: 0.361107 Sep 07 12:35:38.690359 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 810/1658] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:38 2022] GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa => generated 1210 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:38.696227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a988bf82-3f09-411c-b477-4207fe3ed8f6 req-c0e0f329-d6e8-4c82-9125-4d867d469724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48217fe9-fd3c-4c7c-aa31-f7c93c9873ae", "tag": "20b0a985-e074-4d7c-935a-40f22026e773"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:38.722791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a988bf82-3f09-411c-b477-4207fe3ed8f6 req-c0e0f329-d6e8-4c82-9125-4d867d469724 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:38.724535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a988bf82-3f09-411c-b477-4207fe3ed8f6 req-c0e0f329-d6e8-4c82-9125-4d867d469724 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:38.725437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a988bf82-3f09-411c-b477-4207fe3ed8f6 req-c0e0f329-d6e8-4c82-9125-4d867d469724 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:38.758957 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a988bf82-3f09-411c-b477-4207fe3ed8f6 req-c0e0f329-d6e8-4c82-9125-4d867d469724 service nova] Creating event network-changed:20b0a985-e074-4d7c-935a-40f22026e773 for instance 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae on n-h2-852087-9 Sep 07 12:35:38.766573 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a988bf82-3f09-411c-b477-4207fe3ed8f6 req-c0e0f329-d6e8-4c82-9125-4d867d469724 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077490 Sep 07 12:35:38.767283 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 811/1659] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:35:38.774681 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-80faeded-231f-4b22-8549-3b43a30ccd8e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:38.783093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80faeded-231f-4b22-8549-3b43a30ccd8e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:38.783930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80faeded-231f-4b22-8549-3b43a30ccd8e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:38.784545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80faeded-231f-4b22-8549-3b43a30ccd8e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:38.868654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-80faeded-231f-4b22-8549-3b43a30ccd8e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Going to try to stop instance {{(pid=122433) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 12:35:39.029179 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-80faeded-231f-4b22-8549-3b43a30ccd8e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "POST /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81/action" status: 202 len: 0 microversion: 2.1 time: 0.256589 Sep 07 12:35:39.032415 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 812/1660] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:35:38 2022] POST /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:35:39.052946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b38f87fc-11c1-4513-b851-e13f494935ef tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852087-9", "block_migration": "auto"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:39.056015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b38f87fc-11c1-4513-b851-e13f494935ef tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:39.082540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b38f87fc-11c1-4513-b851-e13f494935ef tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:39.094191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b38f87fc-11c1-4513-b851-e13f494935ef tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:39.095650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b38f87fc-11c1-4513-b851-e13f494935ef tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:39.100285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b38f87fc-11c1-4513-b851-e13f494935ef tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:39.103109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b38f87fc-11c1-4513-b851-e13f494935ef tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:39.106904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b38f87fc-11c1-4513-b851-e13f494935ef tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:39.195602 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-b38f87fc-11c1-4513-b851-e13f494935ef tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lazy-loading 'flavor' on Instance uuid f070fedf-8028-43e3-97f9-8955e81dc84b {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:35:39.228753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b38f87fc-11c1-4513-b851-e13f494935ef tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Going to try to live migrate instance to n-h1-852087-9 {{(pid=122433) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 07 12:35:39.244124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:35:41.623555 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dd913b0f-5afd-4d77-b5a6-c8d73d7021f4 tempest-FloatingIPsTestJSON-1110706936 tempest-FloatingIPsTestJSON-1110706936-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/5558fefa-3e29-4cf7-8441-bcd2addba4f5" status: 202 len: 0 microversion: 2.1 time: 4.276052 Sep 07 12:35:41.626356 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 849/1661] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Sep 7 12:35:37 2022] DELETE /compute/v2.1/os-floating-ips/5558fefa-3e29-4cf7-8441-bcd2addba4f5 => generated 0 bytes in 4297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:35:41.642592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-81a2c563-48c8-4e9e-a946-cb719607cb02 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:41.646192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-81a2c563-48c8-4e9e-a946-cb719607cb02 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:41.688002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81a2c563-48c8-4e9e-a946-cb719607cb02 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:41.703482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81a2c563-48c8-4e9e-a946-cb719607cb02 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:41.704336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81a2c563-48c8-4e9e-a946-cb719607cb02 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:41.711013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81a2c563-48c8-4e9e-a946-cb719607cb02 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:41.717234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81a2c563-48c8-4e9e-a946-cb719607cb02 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:41.718582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81a2c563-48c8-4e9e-a946-cb719607cb02 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:42.333331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-81a2c563-48c8-4e9e-a946-cb719607cb02 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:42.344162 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-81a2c563-48c8-4e9e-a946-cb719607cb02 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1211 microversion: 2.1 time: 0.715770 Sep 07 12:35:42.344775 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 850/1662] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:41 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1211 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:42.350827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9b321756-c646-4951-a3e6-0877159b7806 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:42.351985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9b321756-c646-4951-a3e6-0877159b7806 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:42.362737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b321756-c646-4951-a3e6-0877159b7806 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:42.365040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b321756-c646-4951-a3e6-0877159b7806 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:42.375145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b321756-c646-4951-a3e6-0877159b7806 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:42.382860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b321756-c646-4951-a3e6-0877159b7806 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:42.384050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b321756-c646-4951-a3e6-0877159b7806 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:42.384802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b321756-c646-4951-a3e6-0877159b7806 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:42.902066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9b321756-c646-4951-a3e6-0877159b7806 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:42.948314 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9b321756-c646-4951-a3e6-0877159b7806 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 200 len: 1498 microversion: 2.1 time: 0.589074 Sep 07 12:35:42.949946 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 851/1663] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:42 2022] GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 1498 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:42.959571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-851f9ecd-9668-4a4d-8f6e-8b20fe088848 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:42.974327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-851f9ecd-9668-4a4d-8f6e-8b20fe088848 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] [instance: 5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:42.992154 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-851f9ecd-9668-4a4d-8f6e-8b20fe088848 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:42.992667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-851f9ecd-9668-4a4d-8f6e-8b20fe088848 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:42.993112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-851f9ecd-9668-4a4d-8f6e-8b20fe088848 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:42.998694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-851f9ecd-9668-4a4d-8f6e-8b20fe088848 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:42.999198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-851f9ecd-9668-4a4d-8f6e-8b20fe088848 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:42.999645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-851f9ecd-9668-4a4d-8f6e-8b20fe088848 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:43.142260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-851f9ecd-9668-4a4d-8f6e-8b20fe088848 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc75f20bc8dc4bbd8c96e8780970b0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f448aeb9b2f84f6caabfb642a0219854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:43.151851 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-851f9ecd-9668-4a4d-8f6e-8b20fe088848 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] 10.222.0.16 "GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa" status: 200 len: 1272 microversion: 2.1 time: 0.199531 Sep 07 12:35:43.158399 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 852/1664] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:42 2022] GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa => generated 1272 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:43.174003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-98c565b0-83c0-4ac1-a73f-629d8c5e4cd6 tempest-FloatingIPsTestJSON-1110706936 tempest-FloatingIPsTestJSON-1110706936-project] Action: 'create', calling method: .version_select at 0x7fc41d1de9d0>, body: {"pool": null} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:44.998640 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b38f87fc-11c1-4513-b851-e13f494935ef tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/action" status: 202 len: 0 microversion: 2.25 time: 5.963554 Sep 07 12:35:45.002362 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 813/1665] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Sep 7 12:35:39 2022] POST /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/action => generated 0 bytes in 5969 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:35:45.296391 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c385e31-d9ae-4836-8b56-bfc9c60775f3 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Calling method '.version_select at 0x7fc41d2cc430>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:45.536939 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7c385e31-d9ae-4836-8b56-bfc9c60775f3 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/b4dce044771b427cb0690355cb06524f" status: 200 len: 371 microversion: 2.1 time: 0.531142 Sep 07 12:35:45.538909 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 814/1666] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Sep 7 12:35:45 2022] GET /compute/v2.1/os-quota-sets/b4dce044771b427cb0690355cb06524f => generated 371 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:35:45.559534 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b7b8c960-216f-49d4-a2f0-e24e472d4454 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:45.560622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b7b8c960-216f-49d4-a2f0-e24e472d4454 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:45.591446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7b8c960-216f-49d4-a2f0-e24e472d4454 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:45.592543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7b8c960-216f-49d4-a2f0-e24e472d4454 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:45.603305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7b8c960-216f-49d4-a2f0-e24e472d4454 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:45.607344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7b8c960-216f-49d4-a2f0-e24e472d4454 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:45.610466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7b8c960-216f-49d4-a2f0-e24e472d4454 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:45.611490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7b8c960-216f-49d4-a2f0-e24e472d4454 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:46.436985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b7b8c960-216f-49d4-a2f0-e24e472d4454 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:46.463147 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b7b8c960-216f-49d4-a2f0-e24e472d4454 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1199 microversion: 2.1 time: 0.919194 Sep 07 12:35:46.481531 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 815/1667] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:45 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1199 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:46.490430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-77f307fc-1e20-4675-9f95-e0b88c011475 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:46.492143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-77f307fc-1e20-4675-9f95-e0b88c011475 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:46.517680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77f307fc-1e20-4675-9f95-e0b88c011475 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:46.524761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77f307fc-1e20-4675-9f95-e0b88c011475 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:46.526779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77f307fc-1e20-4675-9f95-e0b88c011475 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:46.528663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77f307fc-1e20-4675-9f95-e0b88c011475 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:46.529785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77f307fc-1e20-4675-9f95-e0b88c011475 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:46.533528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77f307fc-1e20-4675-9f95-e0b88c011475 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:46.692664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:35:47.648947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-77f307fc-1e20-4675-9f95-e0b88c011475 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:47.667214 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-77f307fc-1e20-4675-9f95-e0b88c011475 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 200 len: 1498 microversion: 2.1 time: 1.194257 Sep 07 12:35:47.681975 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 816/1668] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:46 2022] GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 1498 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:47.687739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4e817fe8-a2c2-4321-9202-3f3a96e580ac tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:47.689747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4e817fe8-a2c2-4321-9202-3f3a96e580ac tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] [instance: 5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:47.707406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e817fe8-a2c2-4321-9202-3f3a96e580ac tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:47.712921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e817fe8-a2c2-4321-9202-3f3a96e580ac tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:47.713770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e817fe8-a2c2-4321-9202-3f3a96e580ac tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:47.714744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e817fe8-a2c2-4321-9202-3f3a96e580ac tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:47.715413 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e817fe8-a2c2-4321-9202-3f3a96e580ac tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:47.716031 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e817fe8-a2c2-4321-9202-3f3a96e580ac tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:48.180296 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4e817fe8-a2c2-4321-9202-3f3a96e580ac tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc75f20bc8dc4bbd8c96e8780970b0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f448aeb9b2f84f6caabfb642a0219854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:48.206486 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4e817fe8-a2c2-4321-9202-3f3a96e580ac tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] 10.222.0.16 "GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa" status: 200 len: 1314 microversion: 2.1 time: 0.522750 Sep 07 12:35:48.224478 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 817/1669] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:47 2022] GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:48.232918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-50e340c7-54a8-4837-85a5-9a46ee22cb71 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:48.232918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-50e340c7-54a8-4837-85a5-9a46ee22cb71 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:48.254853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50e340c7-54a8-4837-85a5-9a46ee22cb71 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:48.255768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50e340c7-54a8-4837-85a5-9a46ee22cb71 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:48.256567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50e340c7-54a8-4837-85a5-9a46ee22cb71 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:48.257949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50e340c7-54a8-4837-85a5-9a46ee22cb71 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:48.265704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50e340c7-54a8-4837-85a5-9a46ee22cb71 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:48.266215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50e340c7-54a8-4837-85a5-9a46ee22cb71 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:48.290181 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-98c565b0-83c0-4ac1-a73f-629d8c5e4cd6 tempest-FloatingIPsTestJSON-1110706936 tempest-FloatingIPsTestJSON-1110706936-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.129056 Sep 07 12:35:48.291984 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 853/1670] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Sep 7 12:35:43 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:35:48.298960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b706166-cf90-4ee3-9102-5b77ca8919d3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:48.299610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2b706166-cf90-4ee3-9102-5b77ca8919d3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:48.313192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b706166-cf90-4ee3-9102-5b77ca8919d3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:48.313963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b706166-cf90-4ee3-9102-5b77ca8919d3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:48.314685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b706166-cf90-4ee3-9102-5b77ca8919d3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:48.317126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b706166-cf90-4ee3-9102-5b77ca8919d3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:48.318659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b706166-cf90-4ee3-9102-5b77ca8919d3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:48.320570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b706166-cf90-4ee3-9102-5b77ca8919d3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:48.350179 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-2b706166-cf90-4ee3-9102-5b77ca8919d3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] HTTP exception thrown: Instance 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec could not be found. Sep 07 12:35:48.352460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b706166-cf90-4ee3-9102-5b77ca8919d3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Request method failure captured: Sep 07 12:35:48.352460 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec HTTP/1.1 Sep 07 12:35:48.352460 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:35:48.352460 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:35:48.352460 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:35:48.352460 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:35:48.352460 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:35:48.352460 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:35:48.352460 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:35:48.352460 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:35:48.352460 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI8f60Q_R3LzLp3jAIc0-tjl1pfIhEvJf4LtwnqXAv9cjAwUkkuV_aPDdMFnT4YDUr0-zEP8cXZ_PJaZ1HQS5MgfJVo2PrKdQsL2QC0fahtgIv40-eN4IIyScdtKmywJFuVi_mT7Z4qa1PTze2yjRnUzu7adQ9WXSMMUz3AQlTtNDUc Sep 07 12:35:48.352460 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:35:48.352460 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:35:48.352460 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:35:48.352460 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:35:48.352460 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:35:48.352460 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:35:48.352460 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 16b6f7d9efc940449d014d41cf2f18c2 Sep 07 12:35:48.352460 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1507282915 Sep 07 12:35:48.352460 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:35:48.352460 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:35:48.356753 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/16b6f7d9efc940449d014d41cf2f18c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_16b6f7d9efc940449d014d41cf2f18c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/16b6f7d9efc940449d014d41cf2f18c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/16b6f7d9efc940449d014d41cf2f18c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:35:48.356753 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1507282915 Sep 07 12:35:48.356753 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 16b6f7d9efc940449d014d41cf2f18c2 Sep 07 12:35:48.356753 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1507282915 Sep 07 12:35:48.356753 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-AttachSCSIVolumeTestJSON-1507282915-project Sep 07 12:35:48.356753 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:35:48.356753 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:35:48.356753 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 0c7ad5e634ea41e3aed6caa5652e784e Sep 07 12:35:48.356753 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1507282915-project Sep 07 12:35:48.356753 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:35:48.356753 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec could not be found. Sep 07 12:35:48.356753 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '9916ff29-8e9b-41f7-bbde-3f987cd0c9ec'} Sep 07 12:35:48.358340 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:35:48.358340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:48.358340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:35:48.358340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:35:48.358340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:35:48.358340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:35:48.358340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:35:48.358340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:35:48.358340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:35:48.358340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:35:48.358340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec could not be found. Sep 07 12:35:48.358340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:48.358340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:48.358340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:48.358340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:48.358340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:35:48.358340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:35:48.358340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:35:48.358340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:35:48.358340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:35:48.361052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:35:48.361052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:35:48.361052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:35:48.361052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:35:48.361052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:35:48.361052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:35:48.361052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:35:48.361052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:35:48.361052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:35:48.361052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec could not be found. Sep 07 12:35:48.361052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:48.361052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:48.361052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:48.361052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:48.361052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:35:48.361052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:35:48.361052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:35:48.361052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:35:48.361052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec could not be found. Sep 07 12:35:48.361052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:48.365650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b706166-cf90-4ee3-9102-5b77ca8919d3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Returning 404 to user: Instance 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:35:48.365650 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2b706166-cf90-4ee3-9102-5b77ca8919d3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec" status: 404 len: 111 microversion: 2.1 time: 0.061027 Sep 07 12:35:48.365650 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 854/1671] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:35:48 2022] DELETE /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:35:48.367642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-735945cc-afb3-4e58-9da4-9b9d51128ed5 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Action: 'update', calling method: .version_select at 0x7fc41d1f7c10>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:48.496229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-735945cc-afb3-4e58-9da4-9b9d51128ed5 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:48.500671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-735945cc-afb3-4e58-9da4-9b9d51128ed5 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:48.502428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-735945cc-afb3-4e58-9da4-9b9d51128ed5 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:48.503941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-735945cc-afb3-4e58-9da4-9b9d51128ed5 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:48.504571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-735945cc-afb3-4e58-9da4-9b9d51128ed5 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:48.505108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-735945cc-afb3-4e58-9da4-9b9d51128ed5 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:48.587382 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-735945cc-afb3-4e58-9da4-9b9d51128ed5 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/b4dce044771b427cb0690355cb06524f" status: 200 len: 328 microversion: 2.1 time: 0.230136 Sep 07 12:35:48.589085 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 855/1672] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Sep 7 12:35:48 2022] PUT /compute/v2.1/os-quota-sets/b4dce044771b427cb0690355cb06524f => generated 328 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:35:48.596759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f3512eca-2dc2-4ab1-9131-e3516b2573e0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:48.597946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f3512eca-2dc2-4ab1-9131-e3516b2573e0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:48.607886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3512eca-2dc2-4ab1-9131-e3516b2573e0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:48.608597 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3512eca-2dc2-4ab1-9131-e3516b2573e0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:48.609201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3512eca-2dc2-4ab1-9131-e3516b2573e0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:48.611734 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3512eca-2dc2-4ab1-9131-e3516b2573e0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:48.612361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3512eca-2dc2-4ab1-9131-e3516b2573e0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:48.614268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3512eca-2dc2-4ab1-9131-e3516b2573e0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:48.792181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-50e340c7-54a8-4837-85a5-9a46ee22cb71 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:48.829197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-50e340c7-54a8-4837-85a5-9a46ee22cb71 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:48.833048 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-50e340c7-54a8-4837-85a5-9a46ee22cb71 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:48.835417 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-50e340c7-54a8-4837-85a5-9a46ee22cb71 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1814 microversion: 2.25 time: 0.620474 Sep 07 12:35:48.836673 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 818/1673] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:35:48 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1814 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:35:48.853073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6e23ec94-a43a-4c82-89e2-33c74ab2b622 tempest-FloatingIPsTestJSON-1110706936 tempest-FloatingIPsTestJSON-1110706936-project] Calling method '.version_select at 0x7fc418beeb80>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:49.270581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f3512eca-2dc2-4ab1-9131-e3516b2573e0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:49.293110 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f3512eca-2dc2-4ab1-9131-e3516b2573e0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1199 microversion: 2.1 time: 0.698608 Sep 07 12:35:49.295011 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 856/1674] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:48 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1199 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:49.300859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-79a1a15d-bf8a-406d-bf65-f6ebdbf8c68b req-2006e3b0-5381-4267-aa32-9347b7900786 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa", "tag": "53b4757a-5166-4c5a-b917-1bcaea866869"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:49.318725 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-79a1a15d-bf8a-406d-bf65-f6ebdbf8c68b req-2006e3b0-5381-4267-aa32-9347b7900786 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:49.320167 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-79a1a15d-bf8a-406d-bf65-f6ebdbf8c68b req-2006e3b0-5381-4267-aa32-9347b7900786 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:49.320851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-79a1a15d-bf8a-406d-bf65-f6ebdbf8c68b req-2006e3b0-5381-4267-aa32-9347b7900786 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:49.353238 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-79a1a15d-bf8a-406d-bf65-f6ebdbf8c68b req-2006e3b0-5381-4267-aa32-9347b7900786 service nova] Creating event network-changed:53b4757a-5166-4c5a-b917-1bcaea866869 for instance 5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa on n-h1-852087-9 Sep 07 12:35:49.377922 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-79a1a15d-bf8a-406d-bf65-f6ebdbf8c68b req-2006e3b0-5381-4267-aa32-9347b7900786 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079703 Sep 07 12:35:49.382304 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 857/1675] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:35:49.401513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-101d1a36-526d-4411-ad9f-8c23b48641a3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:49.404005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-101d1a36-526d-4411-ad9f-8c23b48641a3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] [instance: 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:49.434941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-101d1a36-526d-4411-ad9f-8c23b48641a3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:49.437794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-101d1a36-526d-4411-ad9f-8c23b48641a3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:49.439351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-101d1a36-526d-4411-ad9f-8c23b48641a3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:49.440897 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-101d1a36-526d-4411-ad9f-8c23b48641a3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:49.442388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-101d1a36-526d-4411-ad9f-8c23b48641a3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:49.451607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-101d1a36-526d-4411-ad9f-8c23b48641a3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:49.498411 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-101d1a36-526d-4411-ad9f-8c23b48641a3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] HTTP exception thrown: Instance 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec could not be found. Sep 07 12:35:49.503174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-101d1a36-526d-4411-ad9f-8c23b48641a3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Request method failure captured: Sep 07 12:35:49.503174 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec HTTP/1.1 Sep 07 12:35:49.503174 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:35:49.503174 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:35:49.503174 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:35:49.503174 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:35:49.503174 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:35:49.503174 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:35:49.503174 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:35:49.503174 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:35:49.503174 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI8f60Q_R3LzLp3jAIc0-tjl1pfIhEvJf4LtwnqXAv9cjAwUkkuV_aPDdMFnT4YDUr0-zEP8cXZ_PJaZ1HQS5MgfJVo2PrKdQsL2QC0fahtgIv40-eN4IIyScdtKmywJFuVi_mT7Z4qa1PTze2yjRnUzu7adQ9WXSMMUz3AQlTtNDUc Sep 07 12:35:49.503174 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:35:49.503174 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:35:49.503174 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:35:49.503174 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:35:49.503174 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:35:49.503174 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:35:49.503174 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 16b6f7d9efc940449d014d41cf2f18c2 Sep 07 12:35:49.503174 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1507282915 Sep 07 12:35:49.503174 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:35:49.503174 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:35:49.505898 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/16b6f7d9efc940449d014d41cf2f18c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_16b6f7d9efc940449d014d41cf2f18c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/16b6f7d9efc940449d014d41cf2f18c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/16b6f7d9efc940449d014d41cf2f18c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:35:49.505898 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1507282915 Sep 07 12:35:49.505898 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 16b6f7d9efc940449d014d41cf2f18c2 Sep 07 12:35:49.505898 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1507282915 Sep 07 12:35:49.505898 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-AttachSCSIVolumeTestJSON-1507282915-project Sep 07 12:35:49.505898 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:35:49.505898 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:35:49.505898 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 0c7ad5e634ea41e3aed6caa5652e784e Sep 07 12:35:49.505898 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1507282915-project Sep 07 12:35:49.505898 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:35:49.505898 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec could not be found. Sep 07 12:35:49.505898 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '9916ff29-8e9b-41f7-bbde-3f987cd0c9ec'} Sep 07 12:35:49.511832 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:35:49.511832 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:49.511832 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:35:49.511832 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:35:49.511832 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:35:49.511832 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:35:49.511832 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:35:49.511832 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:35:49.511832 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:35:49.511832 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:35:49.511832 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec could not be found. Sep 07 12:35:49.511832 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:49.511832 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:49.511832 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:49.511832 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:49.511832 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:35:49.511832 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:35:49.511832 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:35:49.511832 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:35:49.511832 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:35:49.513653 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:35:49.513653 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:35:49.513653 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:35:49.513653 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:35:49.513653 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:35:49.513653 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:35:49.513653 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:35:49.513653 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec could not be found. Sep 07 12:35:49.513653 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:49.513653 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:49.513653 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:49.513653 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:49.513653 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:35:49.513653 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:35:49.513653 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:35:49.513653 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:35:49.513653 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec could not be found. Sep 07 12:35:49.513653 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:49.515744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-101d1a36-526d-4411-ad9f-8c23b48641a3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] Returning 404 to user: Instance 9916ff29-8e9b-41f7-bbde-3f987cd0c9ec could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:35:49.515744 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-101d1a36-526d-4411-ad9f-8c23b48641a3 tempest-AttachSCSIVolumeTestJSON-1507282915 tempest-AttachSCSIVolumeTestJSON-1507282915-project] 10.222.0.16 "GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec" status: 404 len: 111 microversion: 2.1 time: 0.113622 Sep 07 12:35:49.515744 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 858/1676] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:49 2022] GET /compute/v2.1/servers/9916ff29-8e9b-41f7-bbde-3f987cd0c9ec => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:35:49.516205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c8935932-1ef0-44a8-9ffc-e85c18efa13b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:49.517148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c8935932-1ef0-44a8-9ffc-e85c18efa13b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:49.532604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8935932-1ef0-44a8-9ffc-e85c18efa13b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:49.533459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8935932-1ef0-44a8-9ffc-e85c18efa13b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:49.534574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8935932-1ef0-44a8-9ffc-e85c18efa13b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:49.535919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8935932-1ef0-44a8-9ffc-e85c18efa13b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:49.536823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8935932-1ef0-44a8-9ffc-e85c18efa13b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:49.537823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8935932-1ef0-44a8-9ffc-e85c18efa13b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:50.147265 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c8935932-1ef0-44a8-9ffc-e85c18efa13b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:50.160214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=89 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:35:50.174190 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c8935932-1ef0-44a8-9ffc-e85c18efa13b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 200 len: 1498 microversion: 2.1 time: 0.665523 Sep 07 12:35:50.175709 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 859/1677] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:49 2022] GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 1498 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:50.348557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7d9bf4a7-4f1d-4160-bbef-90e3a98b9bbd tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-737689937", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:50.422726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-7d9bf4a7-4f1d-4160-bbef-90e3a98b9bbd tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:35:51.309705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7d9bf4a7-4f1d-4160-bbef-90e3a98b9bbd tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:35:51.310934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7d9bf4a7-4f1d-4160-bbef-90e3a98b9bbd tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:35:51.312078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7d9bf4a7-4f1d-4160-bbef-90e3a98b9bbd tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:35:51.313509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7d9bf4a7-4f1d-4160-bbef-90e3a98b9bbd tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:35:51.314504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7d9bf4a7-4f1d-4160-bbef-90e3a98b9bbd tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:35:51.338451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d9bf4a7-4f1d-4160-bbef-90e3a98b9bbd tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:51.339924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d9bf4a7-4f1d-4160-bbef-90e3a98b9bbd tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:51.342138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d9bf4a7-4f1d-4160-bbef-90e3a98b9bbd tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:51.344922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d9bf4a7-4f1d-4160-bbef-90e3a98b9bbd tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:51.347302 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d9bf4a7-4f1d-4160-bbef-90e3a98b9bbd tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:51.349414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d9bf4a7-4f1d-4160-bbef-90e3a98b9bbd tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:51.427211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-7d9bf4a7-4f1d-4160-bbef-90e3a98b9bbd tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Getting quotas for project b4dce044771b427cb0690355cb06524f. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:35:51.442633 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-7d9bf4a7-4f1d-4160-bbef-90e3a98b9bbd tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Getting quotas for user 6a4f3324072d4b268778dfe47b103b17 and project b4dce044771b427cb0690355cb06524f. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:35:51.497316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.utils [None req-7d9bf4a7-4f1d-4160-bbef-90e3a98b9bbd tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] cores quota exceeded for b4dce044771b427cb0690355cb06524f, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122432) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 07 12:35:51.499218 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-7d9bf4a7-4f1d-4160-bbef-90e3a98b9bbd tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 07 12:35:51.549363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7d9bf4a7-4f1d-4160-bbef-90e3a98b9bbd tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Request method failure captured: Sep 07 12:35:51.549363 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:35:51.549363 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:35:51.549363 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:35:51.549363 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:35:51.549363 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 144 Sep 07 12:35:51.549363 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:35:51.549363 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:35:51.549363 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:35:51.549363 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:35:51.549363 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJAcoAPfNQb19abQzHbARuCxPehaS0X_gY2NvaM5R40oLHYs9zXX_TsITQuo2ZM9GyUEkqTlp9oHwTdmUIet_2gCldhrvxsmQFWnhjmSdFqJNS5sbxR9a870SbJBu0WRPwXCFo3yE6dLX2cgd77_EAVosIXbRMXoG3kqdR1AgMXKcQw Sep 07 12:35:51.549363 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:35:51.549363 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:35:51.549363 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:35:51.549363 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:35:51.549363 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:35:51.549363 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:35:51.549363 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: b4dce044771b427cb0690355cb06524f Sep 07 12:35:51.549363 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-QuotasAdminNegativeTest-1023818843 Sep 07 12:35:51.549363 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:35:51.549363 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:35:51.552409 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b4dce044771b427cb0690355cb06524f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b4dce044771b427cb0690355cb06524f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b4dce044771b427cb0690355cb06524f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b4dce044771b427cb0690355cb06524f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:35:51.552409 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-QuotasAdminNegativeTest-1023818843 Sep 07 12:35:51.552409 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: b4dce044771b427cb0690355cb06524f Sep 07 12:35:51.552409 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1023818843 Sep 07 12:35:51.552409 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-QuotasAdminNegativeTest-1023818843-project Sep 07 12:35:51.552409 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:35:51.552409 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:35:51.552409 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6a4f3324072d4b268778dfe47b103b17 Sep 07 12:35:51.552409 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-QuotasAdminNegativeTest-1023818843-project Sep 07 12:35:51.552409 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:35:51.552409 n-d-852087-9 devstack@n-api.service[122432]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-737689937", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}} Sep 07 12:35:51.552409 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:35:51.554679 n-d-852087-9 devstack@n-api.service[122432]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 07 12:35:51.554679 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-737689937', 'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f', 'flavorRef': '452'}}} Sep 07 12:35:51.554679 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:35:51.554679 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:51.554679 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 07 12:35:51.554679 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 07 12:35:51.554679 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:35:51.554679 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:35:51.554679 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 07 12:35:51.554679 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc Sep 07 12:35:51.554679 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 07 12:35:51.554679 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 07 12:35:51.554679 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:35:51.554679 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:35:51.554679 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 07 12:35:51.554679 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 07 12:35:51.554679 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 07 12:35:51.554679 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 07 12:35:51.557183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 07 12:35:51.557183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 07 12:35:51.557183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 07 12:35:51.557183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:51.557183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:51.557183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:51.557183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:51.557183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 07 12:35:51.557183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 07 12:35:51.557183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 07 12:35:51.557183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 07 12:35:51.557183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 07 12:35:51.557183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 07 12:35:51.557183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 07 12:35:51.557183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 07 12:35:51.557183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 07 12:35:51.557183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 07 12:35:51.557183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 07 12:35:51.557183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:51.557183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:51.557183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:51.560036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:51.560036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:35:51.560036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:35:51.560036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:35:51.560036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:35:51.560036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:35:51.560036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:35:51.560036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:35:51.560036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:35:51.560036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:35:51.560036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:35:51.560036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:35:51.560036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:35:51.560036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 07 12:35:51.560036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 07 12:35:51.560036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 07 12:35:51.560036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 07 12:35:51.560036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:51.560036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:51.560036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:51.560036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:51.562927 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:35:51.562927 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:35:51.562927 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:35:51.562927 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:35:51.562927 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 07 12:35:51.562927 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:35:51.565297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7d9bf4a7-4f1d-4160-bbef-90e3a98b9bbd tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:35:51.567431 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7d9bf4a7-4f1d-4160-bbef-90e3a98b9bbd tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.389652 Sep 07 12:35:51.569346 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 860/1678] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:35:50 2022] POST /compute/v2.1/servers => generated 111 bytes in 1393 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:35:51.580771 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0524f288-3ae5-4c89-93b0-42ba45448210 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:51.582878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0524f288-3ae5-4c89-93b0-42ba45448210 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] [instance: 5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:51.600471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0524f288-3ae5-4c89-93b0-42ba45448210 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:51.601950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0524f288-3ae5-4c89-93b0-42ba45448210 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:51.603057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0524f288-3ae5-4c89-93b0-42ba45448210 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:51.605145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0524f288-3ae5-4c89-93b0-42ba45448210 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:51.606448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0524f288-3ae5-4c89-93b0-42ba45448210 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:51.607474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0524f288-3ae5-4c89-93b0-42ba45448210 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:51.864821 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6e23ec94-a43a-4c82-89e2-33c74ab2b622 tempest-FloatingIPsTestJSON-1110706936 tempest-FloatingIPsTestJSON-1110706936-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/f6b7484e-3f97-4f49-bf17-c35b6cb3b92e" status: 202 len: 0 microversion: 2.1 time: 3.025704 Sep 07 12:35:51.866021 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 819/1679] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Sep 7 12:35:48 2022] DELETE /compute/v2.1/os-floating-ips/f6b7484e-3f97-4f49-bf17-c35b6cb3b92e => generated 0 bytes in 3028 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:35:51.875011 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-df554af0-4d5f-4005-8cc6-08d68e0f35b6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:51.876813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-df554af0-4d5f-4005-8cc6-08d68e0f35b6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:51.900403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df554af0-4d5f-4005-8cc6-08d68e0f35b6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:51.902491 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df554af0-4d5f-4005-8cc6-08d68e0f35b6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:51.903669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df554af0-4d5f-4005-8cc6-08d68e0f35b6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:51.906678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df554af0-4d5f-4005-8cc6-08d68e0f35b6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:51.908291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df554af0-4d5f-4005-8cc6-08d68e0f35b6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:51.910845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df554af0-4d5f-4005-8cc6-08d68e0f35b6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:51.973271 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0524f288-3ae5-4c89-93b0-42ba45448210 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc75f20bc8dc4bbd8c96e8780970b0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f448aeb9b2f84f6caabfb642a0219854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:51.982558 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0524f288-3ae5-4c89-93b0-42ba45448210 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] 10.222.0.16 "GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa" status: 200 len: 1314 microversion: 2.1 time: 0.411256 Sep 07 12:35:51.984123 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 861/1680] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:51 2022] GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:51.989774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b7f3d318-2fb8-4db2-89fb-b215170d4082 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:51.990916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b7f3d318-2fb8-4db2-89fb-b215170d4082 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:51.999820 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7f3d318-2fb8-4db2-89fb-b215170d4082 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:52.000873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7f3d318-2fb8-4db2-89fb-b215170d4082 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:52.001655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7f3d318-2fb8-4db2-89fb-b215170d4082 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:52.006098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7f3d318-2fb8-4db2-89fb-b215170d4082 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:52.007009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7f3d318-2fb8-4db2-89fb-b215170d4082 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:52.007699 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b7f3d318-2fb8-4db2-89fb-b215170d4082 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:52.208617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-df554af0-4d5f-4005-8cc6-08d68e0f35b6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:52.250417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-df554af0-4d5f-4005-8cc6-08d68e0f35b6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:52.253791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-df554af0-4d5f-4005-8cc6-08d68e0f35b6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:52.255462 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-df554af0-4d5f-4005-8cc6-08d68e0f35b6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1814 microversion: 2.25 time: 0.387967 Sep 07 12:35:52.256582 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 820/1681] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:35:51 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1814 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:35:52.283181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-80686635-42ed-40ce-8276-9b65d26bbc12 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:52.284154 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-80686635-42ed-40ce-8276-9b65d26bbc12 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:52.291324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80686635-42ed-40ce-8276-9b65d26bbc12 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:52.292437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80686635-42ed-40ce-8276-9b65d26bbc12 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:52.293139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80686635-42ed-40ce-8276-9b65d26bbc12 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:52.294095 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80686635-42ed-40ce-8276-9b65d26bbc12 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:52.294750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80686635-42ed-40ce-8276-9b65d26bbc12 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:52.295347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80686635-42ed-40ce-8276-9b65d26bbc12 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:52.312505 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b7f3d318-2fb8-4db2-89fb-b215170d4082 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:52.375321 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b7f3d318-2fb8-4db2-89fb-b215170d4082 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1199 microversion: 2.1 time: 0.388609 Sep 07 12:35:52.380681 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 862/1682] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:51 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1199 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:52.391731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-51d46170-f206-4619-8209-7f4de2f2af29 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Action: 'update', calling method: .version_select at 0x7fc41d252820>, body: {"quota_set": {"cores": 20}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:52.593840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-80686635-42ed-40ce-8276-9b65d26bbc12 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:52.603243 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-80686635-42ed-40ce-8276-9b65d26bbc12 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 200 len: 1498 microversion: 2.1 time: 0.330329 Sep 07 12:35:52.614304 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 821/1683] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:52 2022] GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 1498 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:52.624951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a18de118-3b8a-4f3d-8e16-928a6e4e962b tempest-FloatingIPsTestJSON-1110706936 tempest-FloatingIPsTestJSON-1110706936-project] Calling method '.version_select at 0x7fc419795ee0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:52.660553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51d46170-f206-4619-8209-7f4de2f2af29 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:52.661345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51d46170-f206-4619-8209-7f4de2f2af29 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:52.666712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51d46170-f206-4619-8209-7f4de2f2af29 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:52.668510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51d46170-f206-4619-8209-7f4de2f2af29 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:52.669626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51d46170-f206-4619-8209-7f4de2f2af29 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:52.670615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51d46170-f206-4619-8209-7f4de2f2af29 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:52.745715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG neutronclient.v2_0.client [None req-a18de118-3b8a-4f3d-8e16-928a6e4e962b tempest-FloatingIPsTestJSON-1110706936 tempest-FloatingIPsTestJSON-1110706936-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f6b7484e-3f97-4f49-bf17-c35b6cb3b92e could not be found", "detail": ""}} {{(pid=122433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 12:35:52.746430 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-a18de118-3b8a-4f3d-8e16-928a6e4e962b tempest-FloatingIPsTestJSON-1110706936 tempest-FloatingIPsTestJSON-1110706936-project] HTTP exception thrown: Floating IP not found for ID f6b7484e-3f97-4f49-bf17-c35b6cb3b92e Sep 07 12:35:52.779550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a18de118-3b8a-4f3d-8e16-928a6e4e962b tempest-FloatingIPsTestJSON-1110706936 tempest-FloatingIPsTestJSON-1110706936-project] Request method failure captured: Sep 07 12:35:52.779550 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-floating-ips/f6b7484e-3f97-4f49-bf17-c35b6cb3b92e HTTP/1.1 Sep 07 12:35:52.779550 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:35:52.779550 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:35:52.779550 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:35:52.779550 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:35:52.779550 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:35:52.779550 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:35:52.779550 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:35:52.779550 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:35:52.779550 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJAPIHlOfenI7zK7yrg8DhghDqVm5bZHC-Iq_4V0sdsBDoIotAy0s84xBXtbbg3f5Psf78GP_av7fEhxl5rQbRw-7ymE_Fd7hBzLlMj7-vXyDvYMwJIkDZ3BsAYBMx9hC1UDS3p5kmcHgSGN07szXNoCqXiqke8a4piUTGpT2ey2iQ8 Sep 07 12:35:52.779550 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:35:52.779550 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:35:52.779550 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:35:52.779550 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:35:52.779550 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:35:52.779550 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:35:52.779550 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 0a354b79f1964eb696a44564370dff79 Sep 07 12:35:52.779550 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-FloatingIPsTestJSON-1110706936 Sep 07 12:35:52.779550 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:35:52.779550 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:35:52.781321 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a354b79f1964eb696a44564370dff79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0a354b79f1964eb696a44564370dff79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0a354b79f1964eb696a44564370dff79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a354b79f1964eb696a44564370dff79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:35:52.781321 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-FloatingIPsTestJSON-1110706936 Sep 07 12:35:52.781321 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 0a354b79f1964eb696a44564370dff79 Sep 07 12:35:52.781321 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1110706936 Sep 07 12:35:52.781321 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-FloatingIPsTestJSON-1110706936-project Sep 07 12:35:52.781321 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:35:52.781321 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:35:52.781321 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: b822bfa40c5b4fb489836bd6246347d2 Sep 07 12:35:52.781321 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-FloatingIPsTestJSON-1110706936-project Sep 07 12:35:52.781321 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:35:52.781321 n-d-852087-9 devstack@n-api.service[122433]: exception: Floating IP not found for ID f6b7484e-3f97-4f49-bf17-c35b6cb3b92e Sep 07 12:35:52.781321 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'f6b7484e-3f97-4f49-bf17-c35b6cb3b92e'} Sep 07 12:35:52.781321 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:35:52.782358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:52.782358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 07 12:35:52.782358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 07 12:35:52.782358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:35:52.782358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:35:52.782358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 07 12:35:52.782358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 07 12:35:52.782358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:35:52.782358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:35:52.782358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 12:35:52.782358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 12:35:52.782358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:35:52.782358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:35:52.782358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 12:35:52.782358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 12:35:52.782358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:35:52.782358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:35:52.782358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 12:35:52.782358 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 12:35:52.783675 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:35:52.783675 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:35:52.783675 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 12:35:52.783675 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 12:35:52.783675 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 12:35:52.783675 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 12:35:52.783675 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f6b7484e-3f97-4f49-bf17-c35b6cb3b92e could not be found Sep 07 12:35:52.783675 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02b78d44-6b97-4a71-8624-946cc8917bed'] Sep 07 12:35:52.783675 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:52.783675 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:52.783675 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:52.783675 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:52.783675 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 07 12:35:52.783675 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 07 12:35:52.783675 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 07 12:35:52.783675 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 07 12:35:52.783675 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f6b7484e-3f97-4f49-bf17-c35b6cb3b92e. Sep 07 12:35:52.783675 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:52.783675 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:52.783675 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:52.785531 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:52.785531 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:35:52.785531 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:35:52.785531 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:35:52.785531 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:35:52.785531 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:35:52.785531 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:35:52.785531 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:35:52.785531 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:35:52.785531 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 07 12:35:52.785531 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 07 12:35:52.785531 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f6b7484e-3f97-4f49-bf17-c35b6cb3b92e Sep 07 12:35:52.785531 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:52.785531 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:52.785531 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:52.785531 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:52.785531 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:35:52.785531 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:35:52.785531 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:35:52.785531 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:35:52.787089 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f6b7484e-3f97-4f49-bf17-c35b6cb3b92e Sep 07 12:35:52.787089 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:52.789918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a18de118-3b8a-4f3d-8e16-928a6e4e962b tempest-FloatingIPsTestJSON-1110706936 tempest-FloatingIPsTestJSON-1110706936-project] Returning 404 to user: Floating IP not found for ID f6b7484e-3f97-4f49-bf17-c35b6cb3b92e {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:35:52.791398 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a18de118-3b8a-4f3d-8e16-928a6e4e962b tempest-FloatingIPsTestJSON-1110706936 tempest-FloatingIPsTestJSON-1110706936-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/f6b7484e-3f97-4f49-bf17-c35b6cb3b92e" status: 404 len: 111 microversion: 2.1 time: 0.175852 Sep 07 12:35:52.792501 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 822/1684] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Sep 7 12:35:52 2022] GET /compute/v2.1/os-floating-ips/f6b7484e-3f97-4f49-bf17-c35b6cb3b92e => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:35:52.802639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9d4dd79a-820e-4008-b2a5-8c8bec5bea3c tempest-FloatingIPsTestJSON-1110706936 tempest-FloatingIPsTestJSON-1110706936-project] Calling method '.version_select at 0x7fc4196ce4c0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:52.837261 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-51d46170-f206-4619-8209-7f4de2f2af29 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/b4dce044771b427cb0690355cb06524f" status: 200 len: 329 microversion: 2.1 time: 0.454595 Sep 07 12:35:52.838411 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 863/1685] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Sep 7 12:35:52 2022] PUT /compute/v2.1/os-quota-sets/b4dce044771b427cb0690355cb06524f => generated 329 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:35:52.859250 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0744f6f4-2341-4830-9771-5335d1d3c979 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Calling method '.version_select at 0x7fc41d28eb80>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:52.999246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG neutronclient.v2_0.client [None req-9d4dd79a-820e-4008-b2a5-8c8bec5bea3c tempest-FloatingIPsTestJSON-1110706936 tempest-FloatingIPsTestJSON-1110706936-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f6b7484e-3f97-4f49-bf17-c35b6cb3b92e could not be found", "detail": ""}} {{(pid=122433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 12:35:53.000070 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-9d4dd79a-820e-4008-b2a5-8c8bec5bea3c tempest-FloatingIPsTestJSON-1110706936 tempest-FloatingIPsTestJSON-1110706936-project] HTTP exception thrown: Floating IP not found for ID f6b7484e-3f97-4f49-bf17-c35b6cb3b92e Sep 07 12:35:53.005727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9d4dd79a-820e-4008-b2a5-8c8bec5bea3c tempest-FloatingIPsTestJSON-1110706936 tempest-FloatingIPsTestJSON-1110706936-project] Request method failure captured: Sep 07 12:35:53.005727 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-floating-ips/f6b7484e-3f97-4f49-bf17-c35b6cb3b92e HTTP/1.1 Sep 07 12:35:53.005727 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:35:53.005727 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:35:53.005727 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:35:53.005727 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:35:53.005727 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:35:53.005727 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:35:53.005727 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:35:53.005727 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:35:53.005727 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJAPIHlOfenI7zK7yrg8DhghDqVm5bZHC-Iq_4V0sdsBDoIotAy0s84xBXtbbg3f5Psf78GP_av7fEhxl5rQbRw-7ymE_Fd7hBzLlMj7-vXyDvYMwJIkDZ3BsAYBMx9hC1UDS3p5kmcHgSGN07szXNoCqXiqke8a4piUTGpT2ey2iQ8 Sep 07 12:35:53.005727 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:35:53.005727 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:35:53.005727 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:35:53.005727 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:35:53.005727 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:35:53.005727 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:35:53.005727 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 0a354b79f1964eb696a44564370dff79 Sep 07 12:35:53.005727 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-FloatingIPsTestJSON-1110706936 Sep 07 12:35:53.005727 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:35:53.005727 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:35:53.007234 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a354b79f1964eb696a44564370dff79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0a354b79f1964eb696a44564370dff79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0a354b79f1964eb696a44564370dff79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a354b79f1964eb696a44564370dff79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:35:53.007234 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-FloatingIPsTestJSON-1110706936 Sep 07 12:35:53.007234 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 0a354b79f1964eb696a44564370dff79 Sep 07 12:35:53.007234 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1110706936 Sep 07 12:35:53.007234 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-FloatingIPsTestJSON-1110706936-project Sep 07 12:35:53.007234 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:35:53.007234 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:35:53.007234 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: b822bfa40c5b4fb489836bd6246347d2 Sep 07 12:35:53.007234 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-FloatingIPsTestJSON-1110706936-project Sep 07 12:35:53.007234 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:35:53.007234 n-d-852087-9 devstack@n-api.service[122433]: exception: Floating IP not found for ID f6b7484e-3f97-4f49-bf17-c35b6cb3b92e Sep 07 12:35:53.007234 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'f6b7484e-3f97-4f49-bf17-c35b6cb3b92e'} Sep 07 12:35:53.007234 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:35:53.008162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:53.008162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 07 12:35:53.008162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 07 12:35:53.008162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:35:53.008162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:35:53.008162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 07 12:35:53.008162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 07 12:35:53.008162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:35:53.008162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:35:53.008162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 12:35:53.008162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 12:35:53.008162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:35:53.008162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:35:53.008162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 12:35:53.008162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 12:35:53.008162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:35:53.008162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:35:53.008162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 12:35:53.008162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 12:35:53.012051 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:35:53.012051 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:35:53.012051 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 12:35:53.012051 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 12:35:53.012051 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 12:35:53.012051 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 12:35:53.012051 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f6b7484e-3f97-4f49-bf17-c35b6cb3b92e could not be found Sep 07 12:35:53.012051 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-36a25d24-e1b9-4124-90fc-d4bca9c18314'] Sep 07 12:35:53.012051 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:53.012051 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:53.012051 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:53.012051 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:53.012051 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 07 12:35:53.012051 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 07 12:35:53.012051 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 07 12:35:53.012051 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 07 12:35:53.012051 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f6b7484e-3f97-4f49-bf17-c35b6cb3b92e. Sep 07 12:35:53.012051 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:53.012051 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:53.012051 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:53.013370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:53.013370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:35:53.013370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:35:53.013370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:35:53.013370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:35:53.013370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:35:53.013370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:35:53.013370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:35:53.013370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:35:53.013370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 07 12:35:53.013370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 07 12:35:53.013370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f6b7484e-3f97-4f49-bf17-c35b6cb3b92e Sep 07 12:35:53.013370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:53.013370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:53.013370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:53.013370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:53.013370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:35:53.013370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:35:53.013370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:35:53.013370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:35:53.016251 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f6b7484e-3f97-4f49-bf17-c35b6cb3b92e Sep 07 12:35:53.016251 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:53.019367 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0744f6f4-2341-4830-9771-5335d1d3c979 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/b4dce044771b427cb0690355cb06524f" status: 200 len: 371 microversion: 2.1 time: 0.164017 Sep 07 12:35:53.019664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9d4dd79a-820e-4008-b2a5-8c8bec5bea3c tempest-FloatingIPsTestJSON-1110706936 tempest-FloatingIPsTestJSON-1110706936-project] Returning 404 to user: Floating IP not found for ID f6b7484e-3f97-4f49-bf17-c35b6cb3b92e {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:35:53.019991 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 864/1686] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Sep 7 12:35:52 2022] GET /compute/v2.1/os-quota-sets/b4dce044771b427cb0690355cb06524f => generated 371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:35:53.021413 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9d4dd79a-820e-4008-b2a5-8c8bec5bea3c tempest-FloatingIPsTestJSON-1110706936 tempest-FloatingIPsTestJSON-1110706936-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/f6b7484e-3f97-4f49-bf17-c35b6cb3b92e" status: 404 len: 111 microversion: 2.1 time: 0.224471 Sep 07 12:35:53.022559 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 823/1687] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Sep 7 12:35:52 2022] DELETE /compute/v2.1/os-floating-ips/f6b7484e-3f97-4f49-bf17-c35b6cb3b92e => generated 111 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:35:53.027902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-80b89776-e2a0-4ea6-b550-58c56197174f tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:53.032762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-80b89776-e2a0-4ea6-b550-58c56197174f tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] [instance: 5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:53.043806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5caa6941-dccf-42ac-86c1-57e05fe98005 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Action: 'update', calling method: .version_select at 0x7fc419adb9d0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:53.052736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80b89776-e2a0-4ea6-b550-58c56197174f tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:53.054085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80b89776-e2a0-4ea6-b550-58c56197174f tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:53.066729 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80b89776-e2a0-4ea6-b550-58c56197174f tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:53.068427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80b89776-e2a0-4ea6-b550-58c56197174f tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:53.069603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80b89776-e2a0-4ea6-b550-58c56197174f tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:53.070686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80b89776-e2a0-4ea6-b550-58c56197174f tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:53.237695 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5caa6941-dccf-42ac-86c1-57e05fe98005 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:53.239570 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5caa6941-dccf-42ac-86c1-57e05fe98005 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:53.240590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5caa6941-dccf-42ac-86c1-57e05fe98005 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:53.241639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5caa6941-dccf-42ac-86c1-57e05fe98005 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:53.242297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5caa6941-dccf-42ac-86c1-57e05fe98005 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:53.242902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5caa6941-dccf-42ac-86c1-57e05fe98005 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:53.478118 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5caa6941-dccf-42ac-86c1-57e05fe98005 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/b4dce044771b427cb0690355cb06524f" status: 200 len: 328 microversion: 2.1 time: 0.433415 Sep 07 12:35:53.481438 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 824/1688] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Sep 7 12:35:53 2022] PUT /compute/v2.1/os-quota-sets/b4dce044771b427cb0690355cb06524f => generated 328 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:35:53.494900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2526a645-3329-490a-9e30-c30387ace829 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:53.496199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2526a645-3329-490a-9e30-c30387ace829 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:53.514159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2526a645-3329-490a-9e30-c30387ace829 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:53.517430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2526a645-3329-490a-9e30-c30387ace829 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:53.521376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2526a645-3329-490a-9e30-c30387ace829 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:53.531113 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2526a645-3329-490a-9e30-c30387ace829 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:53.533537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2526a645-3329-490a-9e30-c30387ace829 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:53.534511 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2526a645-3329-490a-9e30-c30387ace829 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:54.024689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-80b89776-e2a0-4ea6-b550-58c56197174f tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc75f20bc8dc4bbd8c96e8780970b0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f448aeb9b2f84f6caabfb642a0219854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:54.042475 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-80b89776-e2a0-4ea6-b550-58c56197174f tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] 10.222.0.16 "GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa" status: 200 len: 1314 microversion: 2.1 time: 1.020798 Sep 07 12:35:54.043435 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 865/1689] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:53 2022] GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa => generated 1314 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:54.101433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-341dec9b-350a-4271-be83-3f85247d4961 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:54.102974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-341dec9b-350a-4271-be83-3f85247d4961 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:54.131942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-341dec9b-350a-4271-be83-3f85247d4961 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:54.133071 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-341dec9b-350a-4271-be83-3f85247d4961 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:54.134175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-341dec9b-350a-4271-be83-3f85247d4961 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:54.135966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-341dec9b-350a-4271-be83-3f85247d4961 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:54.137014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-341dec9b-350a-4271-be83-3f85247d4961 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:54.138035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-341dec9b-350a-4271-be83-3f85247d4961 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:55.118253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-341dec9b-350a-4271-be83-3f85247d4961 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:55.150697 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-341dec9b-350a-4271-be83-3f85247d4961 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1199 microversion: 2.1 time: 1.064545 Sep 07 12:35:55.153471 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 866/1690] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:54 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1199 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:55.163268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7a3d2caf-6c44-4983-b8c3-4d7f31602372 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:55.163899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7a3d2caf-6c44-4983-b8c3-4d7f31602372 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:55.179277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a3d2caf-6c44-4983-b8c3-4d7f31602372 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:55.179789 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a3d2caf-6c44-4983-b8c3-4d7f31602372 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:55.180228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a3d2caf-6c44-4983-b8c3-4d7f31602372 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:55.180953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a3d2caf-6c44-4983-b8c3-4d7f31602372 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:55.189271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2526a645-3329-490a-9e30-c30387ace829 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:55.190330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a3d2caf-6c44-4983-b8c3-4d7f31602372 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:55.190639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a3d2caf-6c44-4983-b8c3-4d7f31602372 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:55.212999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2526a645-3329-490a-9e30-c30387ace829 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:55.219840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2526a645-3329-490a-9e30-c30387ace829 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:55.221329 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2526a645-3329-490a-9e30-c30387ace829 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1814 microversion: 2.25 time: 1.738321 Sep 07 12:35:55.223356 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 825/1691] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:35:53 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1814 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:35:55.240958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d64e1955-a6b1-48a3-99f3-7f653099c858 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-629330748", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:55.405282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-d64e1955-a6b1-48a3-99f3-7f653099c858 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:35:56.101879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d64e1955-a6b1-48a3-99f3-7f653099c858 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:35:56.102622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d64e1955-a6b1-48a3-99f3-7f653099c858 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:35:56.103289 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d64e1955-a6b1-48a3-99f3-7f653099c858 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:35:56.103960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d64e1955-a6b1-48a3-99f3-7f653099c858 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:35:56.105298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d64e1955-a6b1-48a3-99f3-7f653099c858 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:35:56.132119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d64e1955-a6b1-48a3-99f3-7f653099c858 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:56.136132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d64e1955-a6b1-48a3-99f3-7f653099c858 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:56.137198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d64e1955-a6b1-48a3-99f3-7f653099c858 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:56.139121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d64e1955-a6b1-48a3-99f3-7f653099c858 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:56.141667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d64e1955-a6b1-48a3-99f3-7f653099c858 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:56.144743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d64e1955-a6b1-48a3-99f3-7f653099c858 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:56.164993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7a3d2caf-6c44-4983-b8c3-4d7f31602372 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:56.192020 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7a3d2caf-6c44-4983-b8c3-4d7f31602372 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 200 len: 1498 microversion: 2.1 time: 1.037348 Sep 07 12:35:56.210269 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 867/1692] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:55 2022] GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 1498 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:56.296125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-d64e1955-a6b1-48a3-99f3-7f653099c858 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Getting quotas for project b4dce044771b427cb0690355cb06524f. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:35:56.320119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-d64e1955-a6b1-48a3-99f3-7f653099c858 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Getting quotas for user 6a4f3324072d4b268778dfe47b103b17 and project b4dce044771b427cb0690355cb06524f. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:35:56.394949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.utils [None req-d64e1955-a6b1-48a3-99f3-7f653099c858 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] instances quota exceeded for b4dce044771b427cb0690355cb06524f, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122433) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 07 12:35:56.397561 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-d64e1955-a6b1-48a3-99f3-7f653099c858 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 07 12:35:56.409614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d64e1955-a6b1-48a3-99f3-7f653099c858 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Request method failure captured: Sep 07 12:35:56.409614 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:35:56.409614 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:35:56.409614 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:35:56.409614 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:35:56.409614 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 144 Sep 07 12:35:56.409614 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:35:56.409614 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:35:56.409614 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:35:56.409614 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:35:56.409614 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJAcoAPfNQb19abQzHbARuCxPehaS0X_gY2NvaM5R40oLHYs9zXX_TsITQuo2ZM9GyUEkqTlp9oHwTdmUIet_2gCldhrvxsmQFWnhjmSdFqJNS5sbxR9a870SbJBu0WRPwXCFo3yE6dLX2cgd77_EAVosIXbRMXoG3kqdR1AgMXKcQw Sep 07 12:35:56.409614 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:35:56.409614 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:35:56.409614 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:35:56.409614 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:35:56.409614 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:35:56.409614 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:35:56.409614 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: b4dce044771b427cb0690355cb06524f Sep 07 12:35:56.409614 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-QuotasAdminNegativeTest-1023818843 Sep 07 12:35:56.409614 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:35:56.409614 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:35:56.412369 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b4dce044771b427cb0690355cb06524f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b4dce044771b427cb0690355cb06524f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b4dce044771b427cb0690355cb06524f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b4dce044771b427cb0690355cb06524f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:35:56.412369 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-QuotasAdminNegativeTest-1023818843 Sep 07 12:35:56.412369 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: b4dce044771b427cb0690355cb06524f Sep 07 12:35:56.412369 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1023818843 Sep 07 12:35:56.412369 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-QuotasAdminNegativeTest-1023818843-project Sep 07 12:35:56.412369 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:35:56.412369 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:35:56.412369 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6a4f3324072d4b268778dfe47b103b17 Sep 07 12:35:56.412369 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-QuotasAdminNegativeTest-1023818843-project Sep 07 12:35:56.412369 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:35:56.412369 n-d-852087-9 devstack@n-api.service[122433]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-629330748", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}} Sep 07 12:35:56.412369 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:35:56.413828 n-d-852087-9 devstack@n-api.service[122433]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 07 12:35:56.413828 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-629330748', 'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f', 'flavorRef': '452'}}} Sep 07 12:35:56.413828 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:35:56.413828 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:56.413828 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 07 12:35:56.413828 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 07 12:35:56.413828 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:35:56.413828 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:35:56.413828 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 07 12:35:56.413828 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc Sep 07 12:35:56.413828 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 07 12:35:56.413828 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 07 12:35:56.413828 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:35:56.413828 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:35:56.413828 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 07 12:35:56.413828 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 07 12:35:56.413828 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 07 12:35:56.413828 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 07 12:35:56.416009 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 07 12:35:56.416009 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 07 12:35:56.416009 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Sep 07 12:35:56.416009 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:56.416009 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:56.416009 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:56.416009 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:56.416009 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 07 12:35:56.416009 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 07 12:35:56.416009 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 07 12:35:56.416009 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 07 12:35:56.416009 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 07 12:35:56.416009 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 07 12:35:56.416009 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 07 12:35:56.416009 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 07 12:35:56.416009 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 07 12:35:56.416009 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 07 12:35:56.416009 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 07 12:35:56.416009 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:56.416009 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:56.416009 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:56.426155 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:56.426155 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:35:56.426155 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:35:56.426155 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:35:56.426155 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:35:56.426155 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:35:56.426155 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:35:56.426155 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:35:56.426155 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:35:56.426155 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:35:56.426155 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:35:56.426155 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:35:56.426155 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:35:56.426155 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 07 12:35:56.426155 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 07 12:35:56.426155 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 07 12:35:56.426155 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 07 12:35:56.426155 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:56.426155 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:35:56.426155 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:56.426155 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:35:56.431179 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:35:56.431179 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:35:56.431179 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:35:56.431179 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:35:56.431179 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 07 12:35:56.431179 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:35:56.438531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d64e1955-a6b1-48a3-99f3-7f653099c858 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:35:56.441838 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d64e1955-a6b1-48a3-99f3-7f653099c858 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.216185 Sep 07 12:35:56.455273 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 826/1693] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:35:55 2022] POST /compute/v2.1/servers => generated 119 bytes in 1229 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:35:56.467895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-62621029-3a47-4cdb-b763-c5a183b7f9bd tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:56.469667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-62621029-3a47-4cdb-b763-c5a183b7f9bd tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] [instance: 5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:56.470754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-be567285-62d5-4cd3-9f02-1f10ac485c68 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Action: 'create', calling method: .version_select at 0x7fc41d1f1160>, body: {"keypair": {"name": "tempest-keypair-686004982", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDu+PO2/VZBVjcAAWULIigyb4vaiEvQWZRO6HGYAI/NVZ/KGf8E90Evq6i1eGbN/W/f4IjMyA8MHoQhAq4IAmTCJVNlrxFEtPIvV94gBEqeNDMpMd+Jyn+S0rT7jAjQgFA=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:56.481985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62621029-3a47-4cdb-b763-c5a183b7f9bd tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:56.483260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62621029-3a47-4cdb-b763-c5a183b7f9bd tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:56.483978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62621029-3a47-4cdb-b763-c5a183b7f9bd tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:56.485543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62621029-3a47-4cdb-b763-c5a183b7f9bd tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:56.486299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62621029-3a47-4cdb-b763-c5a183b7f9bd tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:56.486987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62621029-3a47-4cdb-b763-c5a183b7f9bd tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:56.508307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:35:56.545560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-be567285-62d5-4cd3-9f02-1f10ac485c68 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Getting quotas for project da99763bdb3740a9af4a779ffc8238ef. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:35:56.592293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-be567285-62d5-4cd3-9f02-1f10ac485c68 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Getting quotas for user da21307adfcf48aca8a08c1ef316ff7a and project da99763bdb3740a9af4a779ffc8238ef. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:35:56.663928 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-be567285-62d5-4cd3-9f02-1f10ac485c68 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.450616 Sep 07 12:35:56.671472 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 868/1694] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 12:35:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:35:56.679589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e9c1a7ac-5d15-4cba-a949-873d0473b2a2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:56.682003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e9c1a7ac-5d15-4cba-a949-873d0473b2a2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:56.698973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9c1a7ac-5d15-4cba-a949-873d0473b2a2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:56.699903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9c1a7ac-5d15-4cba-a949-873d0473b2a2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:56.701844 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9c1a7ac-5d15-4cba-a949-873d0473b2a2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:56.704246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9c1a7ac-5d15-4cba-a949-873d0473b2a2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:56.706274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9c1a7ac-5d15-4cba-a949-873d0473b2a2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:56.707394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9c1a7ac-5d15-4cba-a949-873d0473b2a2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:57.279861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-62621029-3a47-4cdb-b763-c5a183b7f9bd tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc75f20bc8dc4bbd8c96e8780970b0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f448aeb9b2f84f6caabfb642a0219854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:57.294606 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-62621029-3a47-4cdb-b763-c5a183b7f9bd tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] 10.222.0.16 "GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa" status: 200 len: 1314 microversion: 2.1 time: 0.837183 Sep 07 12:35:57.295218 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 827/1695] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:56 2022] GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa => generated 1314 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:57.306402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9cecf86c-9021-40b4-baca-dee92241c8b5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:57.307480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9cecf86c-9021-40b4-baca-dee92241c8b5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:57.333761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cecf86c-9021-40b4-baca-dee92241c8b5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:57.334257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cecf86c-9021-40b4-baca-dee92241c8b5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:57.334879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cecf86c-9021-40b4-baca-dee92241c8b5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:57.335819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cecf86c-9021-40b4-baca-dee92241c8b5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:57.336450 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cecf86c-9021-40b4-baca-dee92241c8b5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:57.337038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cecf86c-9021-40b4-baca-dee92241c8b5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:57.801676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e9c1a7ac-5d15-4cba-a949-873d0473b2a2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:57.840503 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e9c1a7ac-5d15-4cba-a949-873d0473b2a2 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1199 microversion: 2.1 time: 1.172647 Sep 07 12:35:57.858165 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 869/1696] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:56 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1199 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:57.912542 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-74cd4195-3a7a-4798-b503-a9f2e3b8e744 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Action: 'update', calling method: .version_select at 0x7fc41d2c0a60>, body: {"quota_set": {"instances": 10}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:58.155425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74cd4195-3a7a-4798-b503-a9f2e3b8e744 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:58.166859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74cd4195-3a7a-4798-b503-a9f2e3b8e744 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:58.168232 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74cd4195-3a7a-4798-b503-a9f2e3b8e744 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:58.170045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74cd4195-3a7a-4798-b503-a9f2e3b8e744 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:58.171299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74cd4195-3a7a-4798-b503-a9f2e3b8e744 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:58.172416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74cd4195-3a7a-4798-b503-a9f2e3b8e744 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:58.395156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9cecf86c-9021-40b4-baca-dee92241c8b5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:58.396979 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-74cd4195-3a7a-4798-b503-a9f2e3b8e744 tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/b4dce044771b427cb0690355cb06524f" status: 200 len: 329 microversion: 2.1 time: 0.536580 Sep 07 12:35:58.426199 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 870/1697] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Sep 7 12:35:57 2022] PUT /compute/v2.1/os-quota-sets/b4dce044771b427cb0690355cb06524f => generated 329 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:35:58.426853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9cecf86c-9021-40b4-baca-dee92241c8b5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:58.426853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9cecf86c-9021-40b4-baca-dee92241c8b5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:58.426853 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9cecf86c-9021-40b4-baca-dee92241c8b5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1814 microversion: 2.25 time: 1.118969 Sep 07 12:35:58.427140 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 828/1698] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:35:57 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1814 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:35:58.427226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3d0436fb-5340-4086-a906-849bf596758f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:58.427226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3d0436fb-5340-4086-a906-849bf596758f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:58.430443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-266a17d7-a2f3-4e4e-acca-b613654aeda3 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:58.432072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-266a17d7-a2f3-4e4e-acca-b613654aeda3 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] [instance: 5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:58.450755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-266a17d7-a2f3-4e4e-acca-b613654aeda3 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:58.452073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-266a17d7-a2f3-4e4e-acca-b613654aeda3 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:58.454234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-266a17d7-a2f3-4e4e-acca-b613654aeda3 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:58.456404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-266a17d7-a2f3-4e4e-acca-b613654aeda3 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:58.458176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-266a17d7-a2f3-4e4e-acca-b613654aeda3 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:58.461040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-266a17d7-a2f3-4e4e-acca-b613654aeda3 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:58.462547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d0436fb-5340-4086-a906-849bf596758f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:58.466086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d0436fb-5340-4086-a906-849bf596758f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:58.469995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d0436fb-5340-4086-a906-849bf596758f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:58.472153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d0436fb-5340-4086-a906-849bf596758f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:58.472797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d0436fb-5340-4086-a906-849bf596758f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:58.473725 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d0436fb-5340-4086-a906-849bf596758f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:58.957733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3d0436fb-5340-4086-a906-849bf596758f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:58.968884 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-266a17d7-a2f3-4e4e-acca-b613654aeda3 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc75f20bc8dc4bbd8c96e8780970b0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f448aeb9b2f84f6caabfb642a0219854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:58.969522 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3d0436fb-5340-4086-a906-849bf596758f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 200 len: 1498 microversion: 2.1 time: 0.559477 Sep 07 12:35:58.970672 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 871/1699] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:58 2022] GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 1498 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:58.978220 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-266a17d7-a2f3-4e4e-acca-b613654aeda3 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] 10.222.0.16 "GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa" status: 200 len: 1314 microversion: 2.1 time: 0.558566 Sep 07 12:35:58.979512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-08105be6-d19c-49cb-b2da-8c22a2a90a6f tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Calling method '.version_select at 0x7fc41d2efb80>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:58.983169 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 829/1700] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:58 2022] GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:59.013300 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e5c06df5-afc0-4ff6-bf98-90ecd8299d24 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:59.014780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e5c06df5-afc0-4ff6-bf98-90ecd8299d24 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:59.028273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5c06df5-afc0-4ff6-bf98-90ecd8299d24 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:59.029150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5c06df5-afc0-4ff6-bf98-90ecd8299d24 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:59.029942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5c06df5-afc0-4ff6-bf98-90ecd8299d24 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:59.031435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5c06df5-afc0-4ff6-bf98-90ecd8299d24 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:59.032507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5c06df5-afc0-4ff6-bf98-90ecd8299d24 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:59.033531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5c06df5-afc0-4ff6-bf98-90ecd8299d24 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:59.217199 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-08105be6-d19c-49cb-b2da-8c22a2a90a6f tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/b4dce044771b427cb0690355cb06524f" status: 200 len: 371 microversion: 2.1 time: 0.238718 Sep 07 12:35:59.219139 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 872/1701] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Sep 7 12:35:58 2022] GET /compute/v2.1/os-quota-sets/b4dce044771b427cb0690355cb06524f => generated 371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:35:59.247552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-412af6a8-da6f-462a-bee0-6dac92149c7c tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Action: 'update', calling method: .version_select at 0x7fc41d188280>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:59.409011 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e5c06df5-afc0-4ff6-bf98-90ecd8299d24 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:59.432170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-412af6a8-da6f-462a-bee0-6dac92149c7c tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:59.432958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-412af6a8-da6f-462a-bee0-6dac92149c7c tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:59.433731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-412af6a8-da6f-462a-bee0-6dac92149c7c tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:59.434988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-412af6a8-da6f-462a-bee0-6dac92149c7c tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:59.435805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-412af6a8-da6f-462a-bee0-6dac92149c7c tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:59.436000 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e5c06df5-afc0-4ff6-bf98-90ecd8299d24 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1199 microversion: 2.1 time: 0.433663 Sep 07 12:35:59.436554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-412af6a8-da6f-462a-bee0-6dac92149c7c tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:59.436864 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 830/1702] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:35:58 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1199 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:35:59.460518 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8f3f340d-b2c6-4257-9f93-9cadc3196bd5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:35:59.464931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8f3f340d-b2c6-4257-9f93-9cadc3196bd5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:35:59.489408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f3f340d-b2c6-4257-9f93-9cadc3196bd5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:59.490323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f3f340d-b2c6-4257-9f93-9cadc3196bd5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:59.491103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f3f340d-b2c6-4257-9f93-9cadc3196bd5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:59.492384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f3f340d-b2c6-4257-9f93-9cadc3196bd5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:35:59.493205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f3f340d-b2c6-4257-9f93-9cadc3196bd5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:35:59.494007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f3f340d-b2c6-4257-9f93-9cadc3196bd5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:35:59.625977 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-412af6a8-da6f-462a-bee0-6dac92149c7c tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/b4dce044771b427cb0690355cb06524f" status: 200 len: 325 microversion: 2.1 time: 0.388202 Sep 07 12:35:59.628847 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 873/1703] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Sep 7 12:35:59 2022] PUT /compute/v2.1/os-quota-sets/b4dce044771b427cb0690355cb06524f => generated 325 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:35:59.762836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32fd3ca9-ecec-4670-b35d-4e98652abbe8 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1760758506", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:35:59.952017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8f3f340d-b2c6-4257-9f93-9cadc3196bd5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:59.965061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-32fd3ca9-ecec-4670-b35d-4e98652abbe8 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:35:59.967533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8f3f340d-b2c6-4257-9f93-9cadc3196bd5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:59.971315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8f3f340d-b2c6-4257-9f93-9cadc3196bd5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:35:59.977522 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8f3f340d-b2c6-4257-9f93-9cadc3196bd5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1814 microversion: 2.25 time: 0.527437 Sep 07 12:35:59.978424 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 831/1704] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:35:59 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1814 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:35:59.984564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-db0d3d18-645d-457e-8869-688879f72f31 req-7cb5b1f0-278a-40fb-aaa1-77162ff65c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa", "name": "network-vif-plugged", "status": "completed", "tag": "53b4757a-5166-4c5a-b917-1bcaea866869"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:36:00.018672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-db0d3d18-645d-457e-8869-688879f72f31 req-7cb5b1f0-278a-40fb-aaa1-77162ff65c7f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:00.021923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-db0d3d18-645d-457e-8869-688879f72f31 req-7cb5b1f0-278a-40fb-aaa1-77162ff65c7f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:00.022892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-db0d3d18-645d-457e-8869-688879f72f31 req-7cb5b1f0-278a-40fb-aaa1-77162ff65c7f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:00.062095 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-db0d3d18-645d-457e-8869-688879f72f31 req-7cb5b1f0-278a-40fb-aaa1-77162ff65c7f service nova] Creating event network-vif-plugged:53b4757a-5166-4c5a-b917-1bcaea866869 for instance 5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa on n-h1-852087-9 Sep 07 12:36:00.071212 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-db0d3d18-645d-457e-8869-688879f72f31 req-7cb5b1f0-278a-40fb-aaa1-77162ff65c7f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089989 Sep 07 12:36:00.072541 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 832/1705] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:00.079145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-04f0ab09-2182-4c35-bdd2-42246bc55a77 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:00.080398 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-04f0ab09-2182-4c35-bdd2-42246bc55a77 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] [instance: 5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:00.090161 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04f0ab09-2182-4c35-bdd2-42246bc55a77 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:00.091070 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04f0ab09-2182-4c35-bdd2-42246bc55a77 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:00.091773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04f0ab09-2182-4c35-bdd2-42246bc55a77 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:00.092904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04f0ab09-2182-4c35-bdd2-42246bc55a77 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:00.093713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04f0ab09-2182-4c35-bdd2-42246bc55a77 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:00.094391 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04f0ab09-2182-4c35-bdd2-42246bc55a77 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:00.502008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-32fd3ca9-ecec-4670-b35d-4e98652abbe8 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:36:00.502672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-32fd3ca9-ecec-4670-b35d-4e98652abbe8 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:36:00.503735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-32fd3ca9-ecec-4670-b35d-4e98652abbe8 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:36:00.504871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-32fd3ca9-ecec-4670-b35d-4e98652abbe8 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:36:00.505848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-32fd3ca9-ecec-4670-b35d-4e98652abbe8 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:36:00.544714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32fd3ca9-ecec-4670-b35d-4e98652abbe8 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:00.545598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32fd3ca9-ecec-4670-b35d-4e98652abbe8 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:00.557875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32fd3ca9-ecec-4670-b35d-4e98652abbe8 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:00.559342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32fd3ca9-ecec-4670-b35d-4e98652abbe8 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:00.560292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32fd3ca9-ecec-4670-b35d-4e98652abbe8 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:00.561076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32fd3ca9-ecec-4670-b35d-4e98652abbe8 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:00.661521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-32fd3ca9-ecec-4670-b35d-4e98652abbe8 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Getting quotas for project b4dce044771b427cb0690355cb06524f. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:36:00.688485 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-32fd3ca9-ecec-4670-b35d-4e98652abbe8 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Getting quotas for user 6a4f3324072d4b268778dfe47b103b17 and project b4dce044771b427cb0690355cb06524f. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:36:00.723147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-04f0ab09-2182-4c35-bdd2-42246bc55a77 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc75f20bc8dc4bbd8c96e8780970b0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f448aeb9b2f84f6caabfb642a0219854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:00.731083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.utils [None req-32fd3ca9-ecec-4670-b35d-4e98652abbe8 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] ram quota exceeded for b4dce044771b427cb0690355cb06524f, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122432) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 07 12:36:00.732259 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-32fd3ca9-ecec-4670-b35d-4e98652abbe8 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 07 12:36:00.735257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32fd3ca9-ecec-4670-b35d-4e98652abbe8 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Request method failure captured: Sep 07 12:36:00.735257 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:36:00.735257 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:36:00.735257 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:36:00.735257 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:36:00.735257 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 145 Sep 07 12:36:00.735257 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:36:00.735257 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:36:00.735257 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:36:00.735257 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:36:00.735257 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJAcoAPfNQb19abQzHbARuCxPehaS0X_gY2NvaM5R40oLHYs9zXX_TsITQuo2ZM9GyUEkqTlp9oHwTdmUIet_2gCldhrvxsmQFWnhjmSdFqJNS5sbxR9a870SbJBu0WRPwXCFo3yE6dLX2cgd77_EAVosIXbRMXoG3kqdR1AgMXKcQw Sep 07 12:36:00.735257 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:36:00.735257 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:36:00.735257 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:36:00.735257 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:36:00.735257 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:36:00.735257 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:36:00.735257 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: b4dce044771b427cb0690355cb06524f Sep 07 12:36:00.735257 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-QuotasAdminNegativeTest-1023818843 Sep 07 12:36:00.735257 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:36:00.735257 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:36:00.736791 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b4dce044771b427cb0690355cb06524f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b4dce044771b427cb0690355cb06524f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b4dce044771b427cb0690355cb06524f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b4dce044771b427cb0690355cb06524f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:36:00.736791 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-QuotasAdminNegativeTest-1023818843 Sep 07 12:36:00.736791 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: b4dce044771b427cb0690355cb06524f Sep 07 12:36:00.736791 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1023818843 Sep 07 12:36:00.736791 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-QuotasAdminNegativeTest-1023818843-project Sep 07 12:36:00.736791 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:36:00.736791 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:36:00.736791 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6a4f3324072d4b268778dfe47b103b17 Sep 07 12:36:00.736791 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-QuotasAdminNegativeTest-1023818843-project Sep 07 12:36:00.736791 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:36:00.736791 n-d-852087-9 devstack@n-api.service[122432]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1760758506", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}} Sep 07 12:36:00.736791 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:36:00.737654 n-d-852087-9 devstack@n-api.service[122432]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 07 12:36:00.737654 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1760758506', 'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f', 'flavorRef': '452'}}} Sep 07 12:36:00.737654 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:36:00.737654 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:00.737654 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 07 12:36:00.737654 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 07 12:36:00.737654 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:36:00.737654 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:36:00.737654 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 07 12:36:00.737654 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc Sep 07 12:36:00.737654 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 07 12:36:00.737654 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 07 12:36:00.737654 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:36:00.737654 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:36:00.737654 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 07 12:36:00.737654 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 07 12:36:00.737654 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 07 12:36:00.737654 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 07 12:36:00.738830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 07 12:36:00.738830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 07 12:36:00.738830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 07 12:36:00.738830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:00.738830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:00.738830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:00.738830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:00.738830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 07 12:36:00.738830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 07 12:36:00.738830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 07 12:36:00.738830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 07 12:36:00.738830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 07 12:36:00.738830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 07 12:36:00.738830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 07 12:36:00.738830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 07 12:36:00.738830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 07 12:36:00.738830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 07 12:36:00.738830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 07 12:36:00.738830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:00.738830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:00.738830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:00.742294 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:00.742294 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:36:00.742294 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:36:00.742294 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:36:00.742294 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:36:00.742294 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:36:00.742294 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:36:00.742294 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:36:00.742294 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:36:00.742294 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:36:00.742294 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:36:00.742294 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:36:00.742294 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:36:00.742294 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 07 12:36:00.742294 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 07 12:36:00.742294 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 07 12:36:00.742294 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 07 12:36:00.742294 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:00.742294 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:00.742294 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:00.742294 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:00.745450 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:36:00.745450 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:36:00.745450 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:36:00.745450 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:36:00.745450 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 07 12:36:00.745450 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:00.760866 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-04f0ab09-2182-4c35-bdd2-42246bc55a77 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] 10.222.0.16 "GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa" status: 200 len: 1314 microversion: 2.1 time: 0.684584 Sep 07 12:36:00.770003 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 833/1706] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:00 2022] GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa => generated 1314 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:00.772050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32fd3ca9-ecec-4670-b35d-4e98652abbe8 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:36:00.773643 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-32fd3ca9-ecec-4670-b35d-4e98652abbe8 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.020342 Sep 07 12:36:00.776472 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 874/1707] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:35:59 2022] POST /compute/v2.1/servers => generated 110 bytes in 1023 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:36:00.784428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-765d6d2e-c6fb-4813-891d-3480e1ca0fcd tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:00.785640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-765d6d2e-c6fb-4813-891d-3480e1ca0fcd tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:00.797761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d21cc4f-5aad-4aca-8023-08dfc2c1f2fb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:00.800845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9d21cc4f-5aad-4aca-8023-08dfc2c1f2fb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:00.809447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-765d6d2e-c6fb-4813-891d-3480e1ca0fcd tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:00.810748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-765d6d2e-c6fb-4813-891d-3480e1ca0fcd tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:00.811751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-765d6d2e-c6fb-4813-891d-3480e1ca0fcd tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:00.813833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-765d6d2e-c6fb-4813-891d-3480e1ca0fcd tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:00.814963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-765d6d2e-c6fb-4813-891d-3480e1ca0fcd tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:00.815889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d21cc4f-5aad-4aca-8023-08dfc2c1f2fb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:00.816232 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-765d6d2e-c6fb-4813-891d-3480e1ca0fcd tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:00.816703 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d21cc4f-5aad-4aca-8023-08dfc2c1f2fb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:00.817775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d21cc4f-5aad-4aca-8023-08dfc2c1f2fb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:00.819413 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d21cc4f-5aad-4aca-8023-08dfc2c1f2fb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:00.822875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d21cc4f-5aad-4aca-8023-08dfc2c1f2fb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:00.824530 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d21cc4f-5aad-4aca-8023-08dfc2c1f2fb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:01.239207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9d21cc4f-5aad-4aca-8023-08dfc2c1f2fb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:01.240935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-765d6d2e-c6fb-4813-891d-3480e1ca0fcd tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:01.246074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:36:01.258943 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-765d6d2e-c6fb-4813-891d-3480e1ca0fcd tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 200 len: 1498 microversion: 2.1 time: 0.489886 Sep 07 12:36:01.259605 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9d21cc4f-5aad-4aca-8023-08dfc2c1f2fb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1199 microversion: 2.1 time: 0.481154 Sep 07 12:36:01.270040 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 834/1708] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:00 2022] GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 1498 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:01.284766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb612cda-b13d-4478-843e-9a7f23f96caa tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Action: 'update', calling method: .version_select at 0x7fc418b81a60>, body: {"quota_set": {"ram": 51200}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:36:01.285187 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 875/1709] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:00 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1199 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:01.306754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-910fd350-cb3e-45a0-b5c6-bb41081cf81c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:01.308978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-910fd350-cb3e-45a0-b5c6-bb41081cf81c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:01.323928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910fd350-cb3e-45a0-b5c6-bb41081cf81c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:01.324543 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910fd350-cb3e-45a0-b5c6-bb41081cf81c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:01.324848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910fd350-cb3e-45a0-b5c6-bb41081cf81c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:01.326667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910fd350-cb3e-45a0-b5c6-bb41081cf81c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:01.327991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910fd350-cb3e-45a0-b5c6-bb41081cf81c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:01.329030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910fd350-cb3e-45a0-b5c6-bb41081cf81c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:01.447310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=43,nova_cell0:UPDATE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:36:01.460849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb612cda-b13d-4478-843e-9a7f23f96caa tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:01.462494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb612cda-b13d-4478-843e-9a7f23f96caa tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:01.463556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb612cda-b13d-4478-843e-9a7f23f96caa tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:01.468179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb612cda-b13d-4478-843e-9a7f23f96caa tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:01.469002 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb612cda-b13d-4478-843e-9a7f23f96caa tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:01.470202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb612cda-b13d-4478-843e-9a7f23f96caa tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:01.592403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:36:01.633563 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cb612cda-b13d-4478-843e-9a7f23f96caa tempest-QuotasAdminNegativeTest-836891166 tempest-QuotasAdminNegativeTest-836891166-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/b4dce044771b427cb0690355cb06524f" status: 200 len: 329 microversion: 2.1 time: 0.362198 Sep 07 12:36:01.634496 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 835/1710] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Sep 7 12:36:01 2022] PUT /compute/v2.1/os-quota-sets/b4dce044771b427cb0690355cb06524f => generated 329 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:01.651624 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-910fd350-cb3e-45a0-b5c6-bb41081cf81c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:01.663496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7e0c927d-1069-4409-84f5-ed534873a911 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Action: 'update', calling method: .version_select at 0x7fc418b1b1f0>, body: {"quota_set": {"ram": 0}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:36:01.666257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-910fd350-cb3e-45a0-b5c6-bb41081cf81c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:01.668940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-910fd350-cb3e-45a0-b5c6-bb41081cf81c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:01.672075 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-910fd350-cb3e-45a0-b5c6-bb41081cf81c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1814 microversion: 2.25 time: 0.385090 Sep 07 12:36:01.673340 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 876/1711] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:36:01 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1814 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:36:01.702318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7e0c927d-1069-4409-84f5-ed534873a911 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '6a4f3324072d4b268778dfe47b103b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4dce044771b427cb0690355cb06524f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:01.716122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7e0c927d-1069-4409-84f5-ed534873a911 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Request method failure captured: Sep 07 12:36:01.716122 n-d-852087-9 devstack@n-api.service[122433]: request: PUT /compute/v2.1/os-quota-sets/b4dce044771b427cb0690355cb06524f HTTP/1.1 Sep 07 12:36:01.716122 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:36:01.716122 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:36:01.716122 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:36:01.716122 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 25 Sep 07 12:36:01.716122 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:36:01.716122 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:36:01.716122 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:36:01.716122 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:36:01.716122 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJAcoAPfNQb19abQzHbARuCxPehaS0X_gY2NvaM5R40oLHYs9zXX_TsITQuo2ZM9GyUEkqTlp9oHwTdmUIet_2gCldhrvxsmQFWnhjmSdFqJNS5sbxR9a870SbJBu0WRPwXCFo3yE6dLX2cgd77_EAVosIXbRMXoG3kqdR1AgMXKcQw Sep 07 12:36:01.716122 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:36:01.716122 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:36:01.716122 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:36:01.716122 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:36:01.716122 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:36:01.716122 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:36:01.716122 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: b4dce044771b427cb0690355cb06524f Sep 07 12:36:01.716122 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-QuotasAdminNegativeTest-1023818843 Sep 07 12:36:01.716122 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:36:01.716122 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:36:01.719053 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b4dce044771b427cb0690355cb06524f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b4dce044771b427cb0690355cb06524f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b4dce044771b427cb0690355cb06524f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b4dce044771b427cb0690355cb06524f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:36:01.719053 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-QuotasAdminNegativeTest-1023818843 Sep 07 12:36:01.719053 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: b4dce044771b427cb0690355cb06524f Sep 07 12:36:01.719053 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1023818843 Sep 07 12:36:01.719053 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-QuotasAdminNegativeTest-1023818843-project Sep 07 12:36:01.719053 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:36:01.719053 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:36:01.719053 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6a4f3324072d4b268778dfe47b103b17 Sep 07 12:36:01.719053 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-QuotasAdminNegativeTest-1023818843-project Sep 07 12:36:01.719053 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:36:01.719053 n-d-852087-9 devstack@n-api.service[122433]: {"quota_set": {"ram": 0}} Sep 07 12:36:01.719053 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:36:01.719053 n-d-852087-9 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 07 12:36:01.719053 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'b4dce044771b427cb0690355cb06524f', 'body': {'quota_set': {'ram': 0}}} Sep 07 12:36:01.720698 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:36:01.720698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:01.720698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:36:01.720698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:36:01.720698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:36:01.720698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:36:01.720698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:36:01.720698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:36:01.720698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:36:01.720698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:36:01.720698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:36:01.720698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:36:01.720698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Sep 07 12:36:01.720698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Sep 07 12:36:01.720698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 12:36:01.720698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:36:01.720698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 12:36:01.720698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:36:01.720698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Sep 07 12:36:01.724963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Sep 07 12:36:01.724963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:36:01.724963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:36:01.724963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:36:01.724963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:36:01.724963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:36:01.724963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:36:01.724963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:36:01.724963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:36:01.724963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:36:01.724963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:36:01.724963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:36:01.724963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:36:01.724963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:36:01.724963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:36:01.724963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 07 12:36:01.724963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:36:01.724963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:01.724963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:36:01.724963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:01.731314 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:36:01.731314 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:36:01.731314 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:36:01.731314 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:36:01.731314 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 07 12:36:01.731314 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:36:01.731314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7e0c927d-1069-4409-84f5-ed534873a911 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:36:01.731314 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7e0c927d-1069-4409-84f5-ed534873a911 tempest-QuotasAdminNegativeTest-1023818843 tempest-QuotasAdminNegativeTest-1023818843-project] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/b4dce044771b427cb0690355cb06524f" status: 403 len: 116 microversion: 2.1 time: 0.062316 Sep 07 12:36:01.731314 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 836/1712] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Sep 7 12:36:01 2022] PUT /compute/v2.1/os-quota-sets/b4dce044771b427cb0690355cb06524f => generated 116 bytes in 64 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:36:01.789995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a6c05ba4-d882-4dd0-acc5-e18efcafe734 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:01.790857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a6c05ba4-d882-4dd0-acc5-e18efcafe734 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] [instance: 5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:01.801243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6c05ba4-d882-4dd0-acc5-e18efcafe734 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:01.807227 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6c05ba4-d882-4dd0-acc5-e18efcafe734 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:01.814070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6c05ba4-d882-4dd0-acc5-e18efcafe734 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:01.816019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6c05ba4-d882-4dd0-acc5-e18efcafe734 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:01.816538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6c05ba4-d882-4dd0-acc5-e18efcafe734 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:01.816994 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6c05ba4-d882-4dd0-acc5-e18efcafe734 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:02.105780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-dfa6429a-ab1e-4a01-9cb5-0fb043a0aae4 req-079fcc0e-d009-40ec-872d-39060f2e5416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48217fe9-fd3c-4c7c-aa31-f7c93c9873ae", "name": "network-vif-plugged", "status": "completed", "tag": "20b0a985-e074-4d7c-935a-40f22026e773"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:36:02.127675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-dfa6429a-ab1e-4a01-9cb5-0fb043a0aae4 req-079fcc0e-d009-40ec-872d-39060f2e5416 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:02.129559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-dfa6429a-ab1e-4a01-9cb5-0fb043a0aae4 req-079fcc0e-d009-40ec-872d-39060f2e5416 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:02.134862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-dfa6429a-ab1e-4a01-9cb5-0fb043a0aae4 req-079fcc0e-d009-40ec-872d-39060f2e5416 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:02.164645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a6c05ba4-d882-4dd0-acc5-e18efcafe734 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc75f20bc8dc4bbd8c96e8780970b0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f448aeb9b2f84f6caabfb642a0219854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:02.170765 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-dfa6429a-ab1e-4a01-9cb5-0fb043a0aae4 req-079fcc0e-d009-40ec-872d-39060f2e5416 service nova] Creating event network-vif-plugged:20b0a985-e074-4d7c-935a-40f22026e773 for instance 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae on n-h2-852087-9 Sep 07 12:36:02.184170 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a6c05ba4-d882-4dd0-acc5-e18efcafe734 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] 10.222.0.16 "GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa" status: 200 len: 1314 microversion: 2.1 time: 0.398560 Sep 07 12:36:02.185057 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-dfa6429a-ab1e-4a01-9cb5-0fb043a0aae4 req-079fcc0e-d009-40ec-872d-39060f2e5416 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083910 Sep 07 12:36:02.187630 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 837/1713] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:02.193809 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 877/1714] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:01 2022] GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:36:02.290221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b71b6cdc-f25a-4d89-a055-2398f1934813 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:02.291295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b71b6cdc-f25a-4d89-a055-2398f1934813 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:02.311149 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ae8c7975-88a9-4cbf-b710-af7945413473 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:02.312177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ae8c7975-88a9-4cbf-b710-af7945413473 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:02.332743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae8c7975-88a9-4cbf-b710-af7945413473 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:02.337540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b71b6cdc-f25a-4d89-a055-2398f1934813 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:02.341909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b71b6cdc-f25a-4d89-a055-2398f1934813 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:02.342610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b71b6cdc-f25a-4d89-a055-2398f1934813 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:02.343624 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae8c7975-88a9-4cbf-b710-af7945413473 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:02.344568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b71b6cdc-f25a-4d89-a055-2398f1934813 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:02.345210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae8c7975-88a9-4cbf-b710-af7945413473 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:02.345872 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b71b6cdc-f25a-4d89-a055-2398f1934813 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:02.346797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae8c7975-88a9-4cbf-b710-af7945413473 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:02.347365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b71b6cdc-f25a-4d89-a055-2398f1934813 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:02.350292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae8c7975-88a9-4cbf-b710-af7945413473 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:02.353957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae8c7975-88a9-4cbf-b710-af7945413473 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:03.360886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b71b6cdc-f25a-4d89-a055-2398f1934813 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:03.380849 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b71b6cdc-f25a-4d89-a055-2398f1934813 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 200 len: 1498 microversion: 2.1 time: 1.096318 Sep 07 12:36:03.381510 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 838/1715] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:02 2022] GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 1498 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:03.398710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-607a71ff-7161-4a35-9f5c-0f4a3d4c72a5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:03.399670 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-607a71ff-7161-4a35-9f5c-0f4a3d4c72a5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:03.407342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-607a71ff-7161-4a35-9f5c-0f4a3d4c72a5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:03.408255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-607a71ff-7161-4a35-9f5c-0f4a3d4c72a5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:03.408918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-607a71ff-7161-4a35-9f5c-0f4a3d4c72a5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:03.409890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-607a71ff-7161-4a35-9f5c-0f4a3d4c72a5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:03.415151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-607a71ff-7161-4a35-9f5c-0f4a3d4c72a5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:03.416020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-607a71ff-7161-4a35-9f5c-0f4a3d4c72a5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:03.427502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ae8c7975-88a9-4cbf-b710-af7945413473 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:03.457683 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ae8c7975-88a9-4cbf-b710-af7945413473 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1199 microversion: 2.1 time: 1.153515 Sep 07 12:36:03.464136 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 878/1716] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:02 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1199 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:36:03.480138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-56515c1c-6dfb-40b3-9766-bdbe45958b86 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:03.481084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-56515c1c-6dfb-40b3-9766-bdbe45958b86 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] [instance: 5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:03.487786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56515c1c-6dfb-40b3-9766-bdbe45958b86 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:03.488627 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56515c1c-6dfb-40b3-9766-bdbe45958b86 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:03.489070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56515c1c-6dfb-40b3-9766-bdbe45958b86 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:03.489830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56515c1c-6dfb-40b3-9766-bdbe45958b86 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:03.490295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56515c1c-6dfb-40b3-9766-bdbe45958b86 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:03.490715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56515c1c-6dfb-40b3-9766-bdbe45958b86 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:03.827854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-607a71ff-7161-4a35-9f5c-0f4a3d4c72a5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:03.843003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-607a71ff-7161-4a35-9f5c-0f4a3d4c72a5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:03.845345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-607a71ff-7161-4a35-9f5c-0f4a3d4c72a5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:03.847304 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-607a71ff-7161-4a35-9f5c-0f4a3d4c72a5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1814 microversion: 2.25 time: 0.464599 Sep 07 12:36:03.857714 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 839/1717] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:36:03 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1814 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:36:03.889259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-56515c1c-6dfb-40b3-9766-bdbe45958b86 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc75f20bc8dc4bbd8c96e8780970b0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f448aeb9b2f84f6caabfb642a0219854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:03.912523 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-56515c1c-6dfb-40b3-9766-bdbe45958b86 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] 10.222.0.16 "GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa" status: 200 len: 1464 microversion: 2.1 time: 0.436548 Sep 07 12:36:03.913176 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 879/1718] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:03 2022] GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa => generated 1464 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:04.243546 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ffdde1c-9ffe-4337-a83b-95a442e577b6 tempest-TenantUsagesTestJSON-763712915 tempest-TenantUsagesTestJSON-763712915-project-admin] Calling method '.version_select at 0x7fc418af99d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:04.274358 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ffdde1c-9ffe-4337-a83b-95a442e577b6 tempest-TenantUsagesTestJSON-763712915 tempest-TenantUsagesTestJSON-763712915-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:04.274858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ffdde1c-9ffe-4337-a83b-95a442e577b6 tempest-TenantUsagesTestJSON-763712915 tempest-TenantUsagesTestJSON-763712915-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:04.275329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ffdde1c-9ffe-4337-a83b-95a442e577b6 tempest-TenantUsagesTestJSON-763712915 tempest-TenantUsagesTestJSON-763712915-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:04.301809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ffdde1c-9ffe-4337-a83b-95a442e577b6 tempest-TenantUsagesTestJSON-763712915 tempest-TenantUsagesTestJSON-763712915-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:04.303494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ffdde1c-9ffe-4337-a83b-95a442e577b6 tempest-TenantUsagesTestJSON-763712915 tempest-TenantUsagesTestJSON-763712915-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:04.304608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ffdde1c-9ffe-4337-a83b-95a442e577b6 tempest-TenantUsagesTestJSON-763712915 tempest-TenantUsagesTestJSON-763712915-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:04.340602 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ffdde1c-9ffe-4337-a83b-95a442e577b6 tempest-TenantUsagesTestJSON-763712915 tempest-TenantUsagesTestJSON-763712915-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/f448aeb9b2f84f6caabfb642a0219854?start=2022-09-06T12%3A36%3A03.941229&end=2022-09-08T12%3A36%3A03.941229" status: 200 len: 651 microversion: 2.1 time: 0.395049 Sep 07 12:36:04.352580 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 840/1719] 10.222.0.16 () {58 vars in 1412 bytes} [Wed Sep 7 12:36:03 2022] GET /compute/v2.1/os-simple-tenant-usage/f448aeb9b2f84f6caabfb642a0219854?start=2022-09-06T12%3A36%3A03.941229&end=2022-09-08T12%3A36%3A03.941229 => generated 651 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:04.359900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5abdda81-cecb-4c83-a42b-c4ec0839681f tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Calling method '.version_select at 0x7fc41d252f70>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:04.425756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5e859fb7-ac94-4f80-90c4-e62e9f77fd35 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:04.427422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5abdda81-cecb-4c83-a42b-c4ec0839681f tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:04.428081 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5e859fb7-ac94-4f80-90c4-e62e9f77fd35 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:04.429822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5abdda81-cecb-4c83-a42b-c4ec0839681f tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:04.430385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5abdda81-cecb-4c83-a42b-c4ec0839681f tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:04.458467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e859fb7-ac94-4f80-90c4-e62e9f77fd35 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:04.459603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e859fb7-ac94-4f80-90c4-e62e9f77fd35 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:04.460324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e859fb7-ac94-4f80-90c4-e62e9f77fd35 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:04.461230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e859fb7-ac94-4f80-90c4-e62e9f77fd35 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:04.461904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e859fb7-ac94-4f80-90c4-e62e9f77fd35 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:04.463252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e859fb7-ac94-4f80-90c4-e62e9f77fd35 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:04.492544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5abdda81-cecb-4c83-a42b-c4ec0839681f tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:04.494236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5abdda81-cecb-4c83-a42b-c4ec0839681f tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:04.497577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5abdda81-cecb-4c83-a42b-c4ec0839681f tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:04.545970 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5abdda81-cecb-4c83-a42b-c4ec0839681f tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/f448aeb9b2f84f6caabfb642a0219854?start=2022-09-06T12%3A36%3A03.941229&end=2022-09-08T12%3A36%3A03.941229" status: 200 len: 638 microversion: 2.1 time: 0.191982 Sep 07 12:36:04.557850 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 880/1720] 10.222.0.16 () {58 vars in 1412 bytes} [Wed Sep 7 12:36:04 2022] GET /compute/v2.1/os-simple-tenant-usage/f448aeb9b2f84f6caabfb642a0219854?start=2022-09-06T12%3A36%3A03.941229&end=2022-09-08T12%3A36%3A03.941229 => generated 638 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:04.567405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fbad7b12-a157-4619-9de9-64e83fe2afb7 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-968294575", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a4e98004-d66e-4b1c-9205-8a114ca32ed3"}], "security_groups": [{"name": "tempest-securitygroup--717657520"}], "key_name": "tempest-keypair-686004982", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:36:04.923799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-fbad7b12-a157-4619-9de9-64e83fe2afb7 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] validate_networks() for [('a4e98004-d66e-4b1c-9205-8a114ca32ed3', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:36:05.101331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5e859fb7-ac94-4f80-90c4-e62e9f77fd35 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:05.132777 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5e859fb7-ac94-4f80-90c4-e62e9f77fd35 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 200 len: 1498 microversion: 2.1 time: 0.717439 Sep 07 12:36:05.136749 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 841/1721] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:04 2022] GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 1498 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:05.166533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c80105fc-7c70-4c09-8e7d-c28af65ab3fb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:05.171494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c80105fc-7c70-4c09-8e7d-c28af65ab3fb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:05.207354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c80105fc-7c70-4c09-8e7d-c28af65ab3fb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:05.208319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c80105fc-7c70-4c09-8e7d-c28af65ab3fb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:05.208982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c80105fc-7c70-4c09-8e7d-c28af65ab3fb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:05.217053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c80105fc-7c70-4c09-8e7d-c28af65ab3fb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:05.217969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c80105fc-7c70-4c09-8e7d-c28af65ab3fb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:05.218769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c80105fc-7c70-4c09-8e7d-c28af65ab3fb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:05.745200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c80105fc-7c70-4c09-8e7d-c28af65ab3fb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:05.771527 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c80105fc-7c70-4c09-8e7d-c28af65ab3fb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1383 microversion: 2.1 time: 0.632391 Sep 07 12:36:05.789529 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 842/1722] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:05 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1383 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:05.797128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fe89450a-f05d-495a-a96b-8740c94f08ab tempest-TenantUsagesTestJSON-763712915 tempest-TenantUsagesTestJSON-763712915-project-admin] Calling method '.version_select at 0x7fc418af9160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:05.818871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe89450a-f05d-495a-a96b-8740c94f08ab tempest-TenantUsagesTestJSON-763712915 tempest-TenantUsagesTestJSON-763712915-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:05.824547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe89450a-f05d-495a-a96b-8740c94f08ab tempest-TenantUsagesTestJSON-763712915 tempest-TenantUsagesTestJSON-763712915-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:05.827000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe89450a-f05d-495a-a96b-8740c94f08ab tempest-TenantUsagesTestJSON-763712915 tempest-TenantUsagesTestJSON-763712915-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:05.961031 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe89450a-f05d-495a-a96b-8740c94f08ab tempest-TenantUsagesTestJSON-763712915 tempest-TenantUsagesTestJSON-763712915-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:05.963707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe89450a-f05d-495a-a96b-8740c94f08ab tempest-TenantUsagesTestJSON-763712915 tempest-TenantUsagesTestJSON-763712915-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:05.965575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe89450a-f05d-495a-a96b-8740c94f08ab tempest-TenantUsagesTestJSON-763712915 tempest-TenantUsagesTestJSON-763712915-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:06.154247 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fe89450a-f05d-495a-a96b-8740c94f08ab tempest-TenantUsagesTestJSON-763712915 tempest-TenantUsagesTestJSON-763712915-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-06T12%3A36%3A03.941229&end=2022-09-08T12%3A36%3A03.941229&detailed=1" status: 200 len: 17272 microversion: 2.1 time: 0.373952 Sep 07 12:36:06.157912 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 843/1723] 10.222.0.16 () {58 vars in 1335 bytes} [Wed Sep 7 12:36:05 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-06T12%3A36%3A03.941229&end=2022-09-08T12%3A36%3A03.941229&detailed=1 => generated 17272 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:36:06.166530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-107c53c3-19eb-453e-97c0-73322b2fe282 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:06.169879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-107c53c3-19eb-453e-97c0-73322b2fe282 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:06.208720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-107c53c3-19eb-453e-97c0-73322b2fe282 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:06.211285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-107c53c3-19eb-453e-97c0-73322b2fe282 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:06.212974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-107c53c3-19eb-453e-97c0-73322b2fe282 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:06.219525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-107c53c3-19eb-453e-97c0-73322b2fe282 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:06.222267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-107c53c3-19eb-453e-97c0-73322b2fe282 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:06.223256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-107c53c3-19eb-453e-97c0-73322b2fe282 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:06.799330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-107c53c3-19eb-453e-97c0-73322b2fe282 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:06.816741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-107c53c3-19eb-453e-97c0-73322b2fe282 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:06.819975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-107c53c3-19eb-453e-97c0-73322b2fe282 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:06.825003 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-107c53c3-19eb-453e-97c0-73322b2fe282 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1814 microversion: 2.25 time: 0.665635 Sep 07 12:36:06.831501 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 844/1724] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:36:06 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1814 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:36:06.856151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fec1d974-3b07-4ca7-9617-8dee85e25353 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:06.858790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fec1d974-3b07-4ca7-9617-8dee85e25353 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:06.880646 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fec1d974-3b07-4ca7-9617-8dee85e25353 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:06.884801 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fec1d974-3b07-4ca7-9617-8dee85e25353 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:06.892263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fec1d974-3b07-4ca7-9617-8dee85e25353 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:06.894986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fec1d974-3b07-4ca7-9617-8dee85e25353 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:06.900635 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fec1d974-3b07-4ca7-9617-8dee85e25353 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:06.901444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fec1d974-3b07-4ca7-9617-8dee85e25353 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:07.499040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-fbad7b12-a157-4619-9de9-64e83fe2afb7 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Getting quotas for project da99763bdb3740a9af4a779ffc8238ef. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:36:07.508014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-fbad7b12-a157-4619-9de9-64e83fe2afb7 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Getting quotas for user da21307adfcf48aca8a08c1ef316ff7a and project da99763bdb3740a9af4a779ffc8238ef. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:36:07.534190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fbad7b12-a157-4619-9de9-64e83fe2afb7 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:36:07.540191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fbad7b12-a157-4619-9de9-64e83fe2afb7 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:36:07.541080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fbad7b12-a157-4619-9de9-64e83fe2afb7 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:36:07.541887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fbad7b12-a157-4619-9de9-64e83fe2afb7 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:36:07.542562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fbad7b12-a157-4619-9de9-64e83fe2afb7 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:36:07.555154 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbad7b12-a157-4619-9de9-64e83fe2afb7 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:07.556022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbad7b12-a157-4619-9de9-64e83fe2afb7 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:07.556526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbad7b12-a157-4619-9de9-64e83fe2afb7 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:07.557528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbad7b12-a157-4619-9de9-64e83fe2afb7 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:07.558055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbad7b12-a157-4619-9de9-64e83fe2afb7 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:07.558628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbad7b12-a157-4619-9de9-64e83fe2afb7 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:07.581338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-fbad7b12-a157-4619-9de9-64e83fe2afb7 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Getting quotas for project da99763bdb3740a9af4a779ffc8238ef. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:36:07.583661 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fec1d974-3b07-4ca7-9617-8dee85e25353 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1534 microversion: 2.1 time: 0.745637 Sep 07 12:36:07.588376 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 845/1725] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:06 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1534 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:07.591971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-fbad7b12-a157-4619-9de9-64e83fe2afb7 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Getting quotas for user da21307adfcf48aca8a08c1ef316ff7a and project da99763bdb3740a9af4a779ffc8238ef. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:36:07.604723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e6e48224-f317-49ae-9b61-d0ba992e9a13 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:07.605954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e6e48224-f317-49ae-9b61-d0ba992e9a13 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:07.624315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6e48224-f317-49ae-9b61-d0ba992e9a13 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:07.625766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6e48224-f317-49ae-9b61-d0ba992e9a13 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:07.628399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6e48224-f317-49ae-9b61-d0ba992e9a13 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:07.631523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6e48224-f317-49ae-9b61-d0ba992e9a13 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:07.633653 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6e48224-f317-49ae-9b61-d0ba992e9a13 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:07.636019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6e48224-f317-49ae-9b61-d0ba992e9a13 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:07.637773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fbad7b12-a157-4619-9de9-64e83fe2afb7 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:36:07.640754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fbad7b12-a157-4619-9de9-64e83fe2afb7 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] [instance: e068f19a-c0b5-4648-be84-71deaa1b580e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:36:07.784897 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fbad7b12-a157-4619-9de9-64e83fe2afb7 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.235178 Sep 07 12:36:07.786471 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 881/1726] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:36:04 2022] POST /compute/v2.1/servers => generated 408 bytes in 3238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:36:07.794350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-462d5878-9897-4a9c-bc6d-b5e6e1c2c1ed tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:07.795014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-462d5878-9897-4a9c-bc6d-b5e6e1c2c1ed tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] [instance: 5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:07.798364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:36:07.815237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-462d5878-9897-4a9c-bc6d-b5e6e1c2c1ed tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:07.816440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-462d5878-9897-4a9c-bc6d-b5e6e1c2c1ed tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:07.817377 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-462d5878-9897-4a9c-bc6d-b5e6e1c2c1ed tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:07.818814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-462d5878-9897-4a9c-bc6d-b5e6e1c2c1ed tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:07.819794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-462d5878-9897-4a9c-bc6d-b5e6e1c2c1ed tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:07.820667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-462d5878-9897-4a9c-bc6d-b5e6e1c2c1ed tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:07.932222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-462d5878-9897-4a9c-bc6d-b5e6e1c2c1ed tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] [instance: 5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:36:08.019849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:36:08.079717 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-462d5878-9897-4a9c-bc6d-b5e6e1c2c1ed tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa" status: 204 len: 0 microversion: 2.1 time: 0.291818 Sep 07 12:36:08.080753 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 882/1727] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:36:07 2022] DELETE /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:36:08.091533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c0bc5c83-6f43-4a5b-9806-76c37152a5b2 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:08.093583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c0bc5c83-6f43-4a5b-9806-76c37152a5b2 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:08.111738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0bc5c83-6f43-4a5b-9806-76c37152a5b2 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:08.113069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0bc5c83-6f43-4a5b-9806-76c37152a5b2 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:08.114489 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0bc5c83-6f43-4a5b-9806-76c37152a5b2 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:08.116812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0bc5c83-6f43-4a5b-9806-76c37152a5b2 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:08.117313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0bc5c83-6f43-4a5b-9806-76c37152a5b2 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:08.117814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0bc5c83-6f43-4a5b-9806-76c37152a5b2 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:08.456290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e6e48224-f317-49ae-9b61-d0ba992e9a13 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:08.500084 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e6e48224-f317-49ae-9b61-d0ba992e9a13 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 200 len: 1475 microversion: 2.1 time: 0.909579 Sep 07 12:36:08.502614 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 846/1728] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:07 2022] GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 1475 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:08.529756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0276d46d-a601-46c7-a03b-6e6a6e8db3ac req-d252c467-0852-4b68-ba88-fa6001330ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f070fedf-8028-43e3-97f9-8955e81dc84b", "name": "network-vif-unplugged", "status": "completed", "tag": "236bdb6a-10c1-409a-9ceb-084851be8590"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:36:08.563317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0276d46d-a601-46c7-a03b-6e6a6e8db3ac req-d252c467-0852-4b68-ba88-fa6001330ee7 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:08.570967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0276d46d-a601-46c7-a03b-6e6a6e8db3ac req-d252c467-0852-4b68-ba88-fa6001330ee7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:08.571996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0276d46d-a601-46c7-a03b-6e6a6e8db3ac req-d252c467-0852-4b68-ba88-fa6001330ee7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:08.631402 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0276d46d-a601-46c7-a03b-6e6a6e8db3ac req-d252c467-0852-4b68-ba88-fa6001330ee7 service nova] Creating event network-vif-unplugged:236bdb6a-10c1-409a-9ceb-084851be8590 for instance f070fedf-8028-43e3-97f9-8955e81dc84b on n-h2-852087-9 Sep 07 12:36:08.654005 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0276d46d-a601-46c7-a03b-6e6a6e8db3ac req-d252c467-0852-4b68-ba88-fa6001330ee7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145976 Sep 07 12:36:08.657186 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 847/1729] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:08.681147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4fe5be33-4888-4864-ae5f-152249812040 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:08.683546 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4fe5be33-4888-4864-ae5f-152249812040 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] [instance: e068f19a-c0b5-4648-be84-71deaa1b580e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:08.719619 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c0bc5c83-6f43-4a5b-9806-76c37152a5b2 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1534 microversion: 2.1 time: 0.636726 Sep 07 12:36:08.729863 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 883/1730] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:08 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1534 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:08.868363 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4fe5be33-4888-4864-ae5f-152249812040 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da21307adfcf48aca8a08c1ef316ff7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99763bdb3740a9af4a779ffc8238ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:08.898757 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4fe5be33-4888-4864-ae5f-152249812040 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] 10.222.0.16 "GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e" status: 200 len: 1276 microversion: 2.1 time: 0.238330 Sep 07 12:36:08.903688 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 848/1731] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:08 2022] GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e => generated 1276 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:08.920586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e51ae580-7344-4952-ba1d-f7dfd4269757 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:08.924212 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e51ae580-7344-4952-ba1d-f7dfd4269757 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] [instance: 5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:08.951271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e51ae580-7344-4952-ba1d-f7dfd4269757 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:08.952476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e51ae580-7344-4952-ba1d-f7dfd4269757 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:08.953411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e51ae580-7344-4952-ba1d-f7dfd4269757 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:08.955458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e51ae580-7344-4952-ba1d-f7dfd4269757 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:08.956599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e51ae580-7344-4952-ba1d-f7dfd4269757 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:08.957578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e51ae580-7344-4952-ba1d-f7dfd4269757 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:09.158813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-463cb6f3-9eb9-41ee-a233-6536ca38d6e8 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:09.162305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-463cb6f3-9eb9-41ee-a233-6536ca38d6e8 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:09.190269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-463cb6f3-9eb9-41ee-a233-6536ca38d6e8 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:09.193202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-463cb6f3-9eb9-41ee-a233-6536ca38d6e8 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:09.195561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-463cb6f3-9eb9-41ee-a233-6536ca38d6e8 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:09.200726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-463cb6f3-9eb9-41ee-a233-6536ca38d6e8 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:09.203598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-463cb6f3-9eb9-41ee-a233-6536ca38d6e8 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:09.207735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-463cb6f3-9eb9-41ee-a233-6536ca38d6e8 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:09.255739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e51ae580-7344-4952-ba1d-f7dfd4269757 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc75f20bc8dc4bbd8c96e8780970b0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f448aeb9b2f84f6caabfb642a0219854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:09.280918 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e51ae580-7344-4952-ba1d-f7dfd4269757 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] 10.222.0.16 "GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa" status: 200 len: 1470 microversion: 2.1 time: 0.373870 Sep 07 12:36:09.282604 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 849/1732] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:08 2022] GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa => generated 1470 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:09.291538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-293d444a-a2e1-477f-9f52-be03933fe94b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-104861897"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:36:09.298051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-293d444a-a2e1-477f-9f52-be03933fe94b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:09.310647 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-293d444a-a2e1-477f-9f52-be03933fe94b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:09.311828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-293d444a-a2e1-477f-9f52-be03933fe94b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:09.312859 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-293d444a-a2e1-477f-9f52-be03933fe94b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:09.314334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-293d444a-a2e1-477f-9f52-be03933fe94b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:09.315493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-293d444a-a2e1-477f-9f52-be03933fe94b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:09.316488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-293d444a-a2e1-477f-9f52-be03933fe94b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:09.643951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-463cb6f3-9eb9-41ee-a233-6536ca38d6e8 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:09.672144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-463cb6f3-9eb9-41ee-a233-6536ca38d6e8 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:09.675296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-463cb6f3-9eb9-41ee-a233-6536ca38d6e8 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:09.682530 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-463cb6f3-9eb9-41ee-a233-6536ca38d6e8 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1814 microversion: 2.25 time: 0.947956 Sep 07 12:36:09.697528 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 884/1733] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:36:08 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1814 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:36:09.703505 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eda70569-caca-4956-a11f-800439762c5f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:09.725452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eda70569-caca-4956-a11f-800439762c5f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:09.727212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eda70569-caca-4956-a11f-800439762c5f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:09.729435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eda70569-caca-4956-a11f-800439762c5f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:09.737022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eda70569-caca-4956-a11f-800439762c5f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:09.738573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eda70569-caca-4956-a11f-800439762c5f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:09.739127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eda70569-caca-4956-a11f-800439762c5f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:09.769573 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eda70569-caca-4956-a11f-800439762c5f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.084136 Sep 07 12:36:09.770534 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 885/1734] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Sep 7 12:36:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:09.791359 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b78caaf7-6537-406b-9074-e4facd32ffb6 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852087-9", "block_migration": false, "disk_over_commit": false}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:36:09.796739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b78caaf7-6537-406b-9074-e4facd32ffb6 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:09.809971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b78caaf7-6537-406b-9074-e4facd32ffb6 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:09.811634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b78caaf7-6537-406b-9074-e4facd32ffb6 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:09.813083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b78caaf7-6537-406b-9074-e4facd32ffb6 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:09.815832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b78caaf7-6537-406b-9074-e4facd32ffb6 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:09.817005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b78caaf7-6537-406b-9074-e4facd32ffb6 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:09.818088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b78caaf7-6537-406b-9074-e4facd32ffb6 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:09.876011 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-b78caaf7-6537-406b-9074-e4facd32ffb6 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lazy-loading 'flavor' on Instance uuid 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:36:09.901077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b78caaf7-6537-406b-9074-e4facd32ffb6 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Going to try to live migrate instance to n-h1-852087-9 {{(pid=122432) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 07 12:36:09.982249 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-293d444a-a2e1-477f-9f52-be03933fe94b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "POST /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81/action" status: 202 len: 0 microversion: 2.1 time: 0.695193 Sep 07 12:36:09.985900 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 850/1735] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:36:09 2022] POST /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81/action => generated 0 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 07 12:36:10.001886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eb339b55-090a-4028-8b3f-4101a70080cb tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:10.007862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-eb339b55-090a-4028-8b3f-4101a70080cb tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] [instance: e068f19a-c0b5-4648-be84-71deaa1b580e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:10.023997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb339b55-090a-4028-8b3f-4101a70080cb tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:10.025398 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb339b55-090a-4028-8b3f-4101a70080cb tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:10.026401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb339b55-090a-4028-8b3f-4101a70080cb tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:10.027721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb339b55-090a-4028-8b3f-4101a70080cb tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:10.028464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb339b55-090a-4028-8b3f-4101a70080cb tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:10.029092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb339b55-090a-4028-8b3f-4101a70080cb tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:10.309729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-eb339b55-090a-4028-8b3f-4101a70080cb tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da21307adfcf48aca8a08c1ef316ff7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99763bdb3740a9af4a779ffc8238ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:10.333517 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eb339b55-090a-4028-8b3f-4101a70080cb tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] 10.222.0.16 "GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e" status: 200 len: 1272 microversion: 2.1 time: 0.344043 Sep 07 12:36:10.339231 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 851/1736] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:09 2022] GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e => generated 1272 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:10.356605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5bba1890-c003-4909-aee1-fb1a5ef0d461 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc418a48700>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:10.505512 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5bba1890-c003-4909-aee1-fb1a5ef0d461 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.161950 Sep 07 12:36:10.512324 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 852/1737] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:10 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:10.540022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2132785c-2df6-44d1-ada6-33af586be370 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:10.541181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2132785c-2df6-44d1-ada6-33af586be370 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] [instance: 5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:10.593406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2132785c-2df6-44d1-ada6-33af586be370 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:10.611287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2132785c-2df6-44d1-ada6-33af586be370 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:10.612305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2132785c-2df6-44d1-ada6-33af586be370 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:10.613689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2132785c-2df6-44d1-ada6-33af586be370 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:10.614574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2132785c-2df6-44d1-ada6-33af586be370 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:10.622623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2132785c-2df6-44d1-ada6-33af586be370 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:11.320358 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2132785c-2df6-44d1-ada6-33af586be370 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc75f20bc8dc4bbd8c96e8780970b0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f448aeb9b2f84f6caabfb642a0219854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:11.348414 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2132785c-2df6-44d1-ada6-33af586be370 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] 10.222.0.16 "GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa" status: 200 len: 1470 microversion: 2.1 time: 0.831554 Sep 07 12:36:11.349145 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 853/1738] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:10 2022] GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa => generated 1470 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:11.384941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-61e53c12-edb9-403f-baab-520e35a79339 req-8ed9b085-8e9f-4efd-b8d1-8b88e4eb0919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f070fedf-8028-43e3-97f9-8955e81dc84b", "tag": "236bdb6a-10c1-409a-9ceb-084851be8590"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:36:11.412319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-61e53c12-edb9-403f-baab-520e35a79339 req-8ed9b085-8e9f-4efd-b8d1-8b88e4eb0919 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:11.413915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-61e53c12-edb9-403f-baab-520e35a79339 req-8ed9b085-8e9f-4efd-b8d1-8b88e4eb0919 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:11.414369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-61e53c12-edb9-403f-baab-520e35a79339 req-8ed9b085-8e9f-4efd-b8d1-8b88e4eb0919 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:11.449456 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-61e53c12-edb9-403f-baab-520e35a79339 req-8ed9b085-8e9f-4efd-b8d1-8b88e4eb0919 service nova] Creating event network-changed:236bdb6a-10c1-409a-9ceb-084851be8590 for instance f070fedf-8028-43e3-97f9-8955e81dc84b on n-h2-852087-9 Sep 07 12:36:11.462892 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-61e53c12-edb9-403f-baab-520e35a79339 req-8ed9b085-8e9f-4efd-b8d1-8b88e4eb0919 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093895 Sep 07 12:36:11.464028 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 854/1739] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:11.476409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6a185a2f-260e-4db6-aea4-bb49d4709cf6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:11.485700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6a185a2f-260e-4db6-aea4-bb49d4709cf6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:11.507995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a185a2f-260e-4db6-aea4-bb49d4709cf6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:11.518860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a185a2f-260e-4db6-aea4-bb49d4709cf6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:11.519675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a185a2f-260e-4db6-aea4-bb49d4709cf6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:11.520450 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a185a2f-260e-4db6-aea4-bb49d4709cf6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:11.520980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a185a2f-260e-4db6-aea4-bb49d4709cf6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:11.521695 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a185a2f-260e-4db6-aea4-bb49d4709cf6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:12.672783 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6a185a2f-260e-4db6-aea4-bb49d4709cf6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:12.710495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6a185a2f-260e-4db6-aea4-bb49d4709cf6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:12.720588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6a185a2f-260e-4db6-aea4-bb49d4709cf6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:12.725723 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6a185a2f-260e-4db6-aea4-bb49d4709cf6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1814 microversion: 2.25 time: 1.257238 Sep 07 12:36:12.732268 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 855/1740] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:36:11 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1814 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:36:12.762487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f60ae80e-ddc5-441a-b8b1-065783bee053 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:12.765629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f60ae80e-ddc5-441a-b8b1-065783bee053 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] [instance: e068f19a-c0b5-4648-be84-71deaa1b580e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:12.796117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f60ae80e-ddc5-441a-b8b1-065783bee053 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:12.797025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f60ae80e-ddc5-441a-b8b1-065783bee053 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:12.797691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f60ae80e-ddc5-441a-b8b1-065783bee053 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:12.798624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f60ae80e-ddc5-441a-b8b1-065783bee053 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:12.799307 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f60ae80e-ddc5-441a-b8b1-065783bee053 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:12.801306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f60ae80e-ddc5-441a-b8b1-065783bee053 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:13.036664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f60ae80e-ddc5-441a-b8b1-065783bee053 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da21307adfcf48aca8a08c1ef316ff7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99763bdb3740a9af4a779ffc8238ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:13.052535 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f60ae80e-ddc5-441a-b8b1-065783bee053 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] 10.222.0.16 "GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e" status: 200 len: 1334 microversion: 2.1 time: 0.315806 Sep 07 12:36:13.053132 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 856/1741] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:12 2022] GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e => generated 1334 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:13.058418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b1461668-a2d5-4265-a95d-746ef364af82 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc418b1baf0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:13.166460 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b1461668-a2d5-4265-a95d-746ef364af82 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.111345 Sep 07 12:36:13.176130 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 857/1742] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:13 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:13.791682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-72c9ed01-50ac-486e-a2e8-c0c4cdaf5e42 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Action: 'update', calling method: .version_select at 0x7fc418a48e50>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:36:13.795734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72c9ed01-50ac-486e-a2e8-c0c4cdaf5e42 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:13.796232 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72c9ed01-50ac-486e-a2e8-c0c4cdaf5e42 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:13.796827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72c9ed01-50ac-486e-a2e8-c0c4cdaf5e42 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:13.843960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72c9ed01-50ac-486e-a2e8-c0c4cdaf5e42 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:13.845005 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72c9ed01-50ac-486e-a2e8-c0c4cdaf5e42 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:13.845707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72c9ed01-50ac-486e-a2e8-c0c4cdaf5e42 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:13.858149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:36:13.871972 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-72c9ed01-50ac-486e-a2e8-c0c4cdaf5e42 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] HTTP exception thrown: Service 8f7517db-5905-449e-9047-60fdb6df039a could not be found. Sep 07 12:36:13.879155 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-72c9ed01-50ac-486e-a2e8-c0c4cdaf5e42 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Request method failure captured: Sep 07 12:36:13.879155 n-d-852087-9 devstack@n-api.service[122433]: request: PUT /compute/v2.1/os-services/8f7517db-5905-449e-9047-60fdb6df039a HTTP/1.1 Sep 07 12:36:13.879155 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:36:13.879155 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:36:13.879155 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:36:13.879155 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 56 Sep 07 12:36:13.879155 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:36:13.879155 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:36:13.879155 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:36:13.879155 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:36:13.879155 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJA7UhUXhBW8dbRVXY6hLodprRmX5daLMQ5yL7y6a8uqX4OIUz6XRWUs5QMGSLKaAASPQCWUQZjJhA71ln8bEksfh51YEeXnor65t1CsdT9ybxaF5hfOSPQyi8O6WvtFP0p3n_ZbiozXzi9bK2XpreDrE0h917FQMJ1uqYv0gQY1ZcE Sep 07 12:36:13.879155 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:36:13.879155 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:36:13.879155 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:36:13.879155 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:36:13.879155 n-d-852087-9 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.53 Sep 07 12:36:13.879155 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:36:13.879155 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:36:13.879155 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: ad8bd248d3ec4e478fc4613a48b6423e Sep 07 12:36:13.879155 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-718096427 Sep 07 12:36:13.879155 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 12:36:13.879155 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 12:36:13.882587 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad8bd248d3ec4e478fc4613a48b6423e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ad8bd248d3ec4e478fc4613a48b6423e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ad8bd248d3ec4e478fc4613a48b6423e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad8bd248d3ec4e478fc4613a48b6423e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:36:13.882587 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-718096427 Sep 07 12:36:13.882587 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: ad8bd248d3ec4e478fc4613a48b6423e Sep 07 12:36:13.882587 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-718096427 Sep 07 12:36:13.882587 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin Sep 07 12:36:13.882587 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:36:13.882587 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:36:13.882587 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: c69608da0ff5422793b726d299305e05 Sep 07 12:36:13.882587 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin Sep 07 12:36:13.882587 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:36:13.882587 n-d-852087-9 devstack@n-api.service[122433]: {"status": "disabled", "disabled_reason": "maintenance"} Sep 07 12:36:13.882587 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:36:13.882587 n-d-852087-9 devstack@n-api.service[122433]: exception: Service 8f7517db-5905-449e-9047-60fdb6df039a could not be found. Sep 07 12:36:13.885189 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '8f7517db-5905-449e-9047-60fdb6df039a', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Sep 07 12:36:13.885189 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:36:13.885189 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:13.885189 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 07 12:36:13.885189 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 07 12:36:13.885189 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 07 12:36:13.885189 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 07 12:36:13.885189 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 07 12:36:13.885189 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:36:13.885189 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:13.885189 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:36:13.885189 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:13.885189 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 07 12:36:13.885189 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 07 12:36:13.885189 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 07 12:36:13.885189 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:36:13.885189 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 8f7517db-5905-449e-9047-60fdb6df039a could not be found. Sep 07 12:36:13.885189 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:36:13.885189 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:13.885189 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:36:13.885189 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:13.889005 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:36:13.889005 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:36:13.889005 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:36:13.889005 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:36:13.889005 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:36:13.889005 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:36:13.889005 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:36:13.889005 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:36:13.889005 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:36:13.889005 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:36:13.889005 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 07 12:36:13.889005 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:36:13.889005 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 8f7517db-5905-449e-9047-60fdb6df039a could not be found. Sep 07 12:36:13.889005 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:36:13.889005 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:13.889005 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:36:13.889005 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:13.889005 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:36:13.889005 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:36:13.889005 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:36:13.897725 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:36:13.897725 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 8f7517db-5905-449e-9047-60fdb6df039a could not be found. Sep 07 12:36:13.897725 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:36:13.897725 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-72c9ed01-50ac-486e-a2e8-c0c4cdaf5e42 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Returning 404 to user: Service 8f7517db-5905-449e-9047-60fdb6df039a could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:36:13.897725 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-72c9ed01-50ac-486e-a2e8-c0c4cdaf5e42 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/8f7517db-5905-449e-9047-60fdb6df039a" status: 404 len: 110 microversion: 2.53 time: 0.706823 Sep 07 12:36:13.897725 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 858/1743] 10.222.0.16 () {62 vars in 1309 bytes} [Wed Sep 7 12:36:13 2022] PUT /compute/v2.1/os-services/8f7517db-5905-449e-9047-60fdb6df039a => generated 110 bytes in 711 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:36:13.899732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-65c60d3c-36de-40ab-98d6-23b297014dd9 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:13.900577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-65c60d3c-36de-40ab-98d6-23b297014dd9 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] [instance: 5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:13.933231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65c60d3c-36de-40ab-98d6-23b297014dd9 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:13.933770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65c60d3c-36de-40ab-98d6-23b297014dd9 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:13.934215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65c60d3c-36de-40ab-98d6-23b297014dd9 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:13.935259 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65c60d3c-36de-40ab-98d6-23b297014dd9 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:13.936031 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65c60d3c-36de-40ab-98d6-23b297014dd9 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:13.936710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65c60d3c-36de-40ab-98d6-23b297014dd9 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:14.193310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-65c60d3c-36de-40ab-98d6-23b297014dd9 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc75f20bc8dc4bbd8c96e8780970b0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f448aeb9b2f84f6caabfb642a0219854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:14.221312 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-65c60d3c-36de-40ab-98d6-23b297014dd9 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] 10.222.0.16 "GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa" status: 200 len: 1428 microversion: 2.1 time: 0.331049 Sep 07 12:36:14.225527 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 859/1744] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:13 2022] GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa => generated 1428 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:14.258248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b62e0566-eb0e-4ea3-82dd-cc513c9d9113 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:14.259311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b62e0566-eb0e-4ea3-82dd-cc513c9d9113 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:14.281419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b62e0566-eb0e-4ea3-82dd-cc513c9d9113 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:14.281988 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b62e0566-eb0e-4ea3-82dd-cc513c9d9113 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:14.282537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b62e0566-eb0e-4ea3-82dd-cc513c9d9113 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:14.283474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b62e0566-eb0e-4ea3-82dd-cc513c9d9113 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:14.283946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b62e0566-eb0e-4ea3-82dd-cc513c9d9113 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:14.285736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b62e0566-eb0e-4ea3-82dd-cc513c9d9113 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:14.525394 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b78caaf7-6537-406b-9074-e4facd32ffb6 tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae/action" status: 202 len: 0 microversion: 2.1 time: 4.736166 Sep 07 12:36:14.534683 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 886/1745] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:36:09 2022] POST /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae/action => generated 0 bytes in 4750 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 12:36:14.597470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3264eed3-2134-464c-9e54-dde09a40b5cc tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Action: 'update', calling method: .version_select at 0x7fc41d1f7940>, body: {"status": "disabled"} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:36:14.653563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3264eed3-2134-464c-9e54-dde09a40b5cc tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:14.654627 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3264eed3-2134-464c-9e54-dde09a40b5cc tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:14.661370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3264eed3-2134-464c-9e54-dde09a40b5cc tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:14.706209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3264eed3-2134-464c-9e54-dde09a40b5cc tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:14.706993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3264eed3-2134-464c-9e54-dde09a40b5cc tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:14.707711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3264eed3-2134-464c-9e54-dde09a40b5cc tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:14.720482 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-3264eed3-2134-464c-9e54-dde09a40b5cc tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] HTTP exception thrown: Service 8f7517db-5905-449e-9047-60fdb6df039a could not be found. Sep 07 12:36:14.722714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3264eed3-2134-464c-9e54-dde09a40b5cc tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Request method failure captured: Sep 07 12:36:14.722714 n-d-852087-9 devstack@n-api.service[122432]: request: PUT /compute/v2.1/os-services/8f7517db-5905-449e-9047-60fdb6df039a HTTP/1.1 Sep 07 12:36:14.722714 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:36:14.722714 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:36:14.722714 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:36:14.722714 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 22 Sep 07 12:36:14.722714 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:36:14.722714 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:36:14.722714 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:36:14.722714 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:36:14.722714 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJA7UhUXhBW8dbRVXY6hLodprRmX5daLMQ5yL7y6a8uqX4OIUz6XRWUs5QMGSLKaAASPQCWUQZjJhA71ln8bEksfh51YEeXnor65t1CsdT9ybxaF5hfOSPQyi8O6WvtFP0p3n_ZbiozXzi9bK2XpreDrE0h917FQMJ1uqYv0gQY1ZcE Sep 07 12:36:14.722714 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:36:14.722714 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:36:14.722714 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:36:14.722714 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:36:14.722714 n-d-852087-9 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.53 Sep 07 12:36:14.722714 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:36:14.722714 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:36:14.722714 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: ad8bd248d3ec4e478fc4613a48b6423e Sep 07 12:36:14.722714 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-718096427 Sep 07 12:36:14.722714 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member,admin Sep 07 12:36:14.722714 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member,admin Sep 07 12:36:14.724251 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad8bd248d3ec4e478fc4613a48b6423e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ad8bd248d3ec4e478fc4613a48b6423e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ad8bd248d3ec4e478fc4613a48b6423e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad8bd248d3ec4e478fc4613a48b6423e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:36:14.724251 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-718096427 Sep 07 12:36:14.724251 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: ad8bd248d3ec4e478fc4613a48b6423e Sep 07 12:36:14.724251 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-718096427 Sep 07 12:36:14.724251 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin Sep 07 12:36:14.724251 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:36:14.724251 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:36:14.724251 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: c69608da0ff5422793b726d299305e05 Sep 07 12:36:14.724251 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin Sep 07 12:36:14.724251 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:36:14.724251 n-d-852087-9 devstack@n-api.service[122432]: {"status": "disabled"} Sep 07 12:36:14.724251 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:36:14.724251 n-d-852087-9 devstack@n-api.service[122432]: exception: Service 8f7517db-5905-449e-9047-60fdb6df039a could not be found. Sep 07 12:36:14.724251 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '8f7517db-5905-449e-9047-60fdb6df039a', 'body': {'status': 'disabled'}} Sep 07 12:36:14.725293 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:36:14.725293 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:14.725293 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 07 12:36:14.725293 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 07 12:36:14.725293 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 07 12:36:14.725293 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 07 12:36:14.725293 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 07 12:36:14.725293 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:14.725293 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:14.725293 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:14.725293 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:14.725293 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 07 12:36:14.725293 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 07 12:36:14.725293 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 07 12:36:14.725293 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:36:14.725293 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 8f7517db-5905-449e-9047-60fdb6df039a could not be found. Sep 07 12:36:14.725293 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:14.725293 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:14.725293 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:14.725293 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:14.725293 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:36:14.726687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:36:14.726687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:36:14.726687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:36:14.726687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:36:14.726687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:36:14.726687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:36:14.726687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:36:14.726687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:36:14.726687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:36:14.726687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 07 12:36:14.726687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:36:14.726687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 8f7517db-5905-449e-9047-60fdb6df039a could not be found. Sep 07 12:36:14.726687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:14.726687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:14.726687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:14.726687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:14.726687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:36:14.726687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:36:14.726687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:36:14.726687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:36:14.727956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 8f7517db-5905-449e-9047-60fdb6df039a could not be found. Sep 07 12:36:14.727956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:14.729899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3264eed3-2134-464c-9e54-dde09a40b5cc tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Returning 404 to user: Service 8f7517db-5905-449e-9047-60fdb6df039a could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:36:14.731224 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3264eed3-2134-464c-9e54-dde09a40b5cc tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/8f7517db-5905-449e-9047-60fdb6df039a" status: 404 len: 110 microversion: 2.53 time: 0.194769 Sep 07 12:36:14.732586 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 887/1746] 10.222.0.16 () {62 vars in 1309 bytes} [Wed Sep 7 12:36:14 2022] PUT /compute/v2.1/os-services/8f7517db-5905-449e-9047-60fdb6df039a => generated 110 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:36:14.739741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c2f160cc-0927-4c7d-b568-562ae8ba08e3 req-68154568-e0b2-42cf-b075-96696a50000f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa", "name": "network-vif-deleted", "tag": "53b4757a-5166-4c5a-b917-1bcaea866869"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:36:14.752043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b62e0566-eb0e-4ea3-82dd-cc513c9d9113 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:14.766340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b62e0566-eb0e-4ea3-82dd-cc513c9d9113 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:14.768323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b62e0566-eb0e-4ea3-82dd-cc513c9d9113 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:14.769912 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b62e0566-eb0e-4ea3-82dd-cc513c9d9113 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1814 microversion: 2.25 time: 0.538654 Sep 07 12:36:14.771078 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 860/1747] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:36:14 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1814 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:36:14.782234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-32ca4265-9efc-49f7-95cd-110ee1647566 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:14.788868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c2f160cc-0927-4c7d-b568-562ae8ba08e3 req-68154568-e0b2-42cf-b075-96696a50000f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:14.789692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-32ca4265-9efc-49f7-95cd-110ee1647566 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] [instance: e068f19a-c0b5-4648-be84-71deaa1b580e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:14.802698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c2f160cc-0927-4c7d-b568-562ae8ba08e3 req-68154568-e0b2-42cf-b075-96696a50000f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:14.803749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c2f160cc-0927-4c7d-b568-562ae8ba08e3 req-68154568-e0b2-42cf-b075-96696a50000f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:14.815935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32ca4265-9efc-49f7-95cd-110ee1647566 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:14.818021 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32ca4265-9efc-49f7-95cd-110ee1647566 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:14.823443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32ca4265-9efc-49f7-95cd-110ee1647566 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:14.825017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32ca4265-9efc-49f7-95cd-110ee1647566 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:14.828678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32ca4265-9efc-49f7-95cd-110ee1647566 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:14.829440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32ca4265-9efc-49f7-95cd-110ee1647566 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:14.840622 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c2f160cc-0927-4c7d-b568-562ae8ba08e3 req-68154568-e0b2-42cf-b075-96696a50000f service nova] Creating event network-vif-deleted:53b4757a-5166-4c5a-b917-1bcaea866869 for instance 5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa on n-h1-852087-9 Sep 07 12:36:14.871127 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c2f160cc-0927-4c7d-b568-562ae8ba08e3 req-68154568-e0b2-42cf-b075-96696a50000f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136291 Sep 07 12:36:14.879903 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 888/1748] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:14.905584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-746ef1de-929f-45c6-a994-aeacce457208 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41d1f74c0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:15.003625 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-746ef1de-929f-45c6-a994-aeacce457208 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.120055 Sep 07 12:36:15.013701 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 889/1749] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:14 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:15.025065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a4543b2f-b108-434b-8f46-a7f6a4e6f02c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:15.028064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a4543b2f-b108-434b-8f46-a7f6a4e6f02c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:15.040972 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4543b2f-b108-434b-8f46-a7f6a4e6f02c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:15.048349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4543b2f-b108-434b-8f46-a7f6a4e6f02c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:15.049350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4543b2f-b108-434b-8f46-a7f6a4e6f02c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:15.050475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4543b2f-b108-434b-8f46-a7f6a4e6f02c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:15.051296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4543b2f-b108-434b-8f46-a7f6a4e6f02c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:15.051824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4543b2f-b108-434b-8f46-a7f6a4e6f02c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:15.322655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-32ca4265-9efc-49f7-95cd-110ee1647566 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da21307adfcf48aca8a08c1ef316ff7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99763bdb3740a9af4a779ffc8238ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:15.332479 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-32ca4265-9efc-49f7-95cd-110ee1647566 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] 10.222.0.16 "GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e" status: 200 len: 1401 microversion: 2.1 time: 0.560017 Sep 07 12:36:15.336545 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 861/1750] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:14 2022] GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e => generated 1401 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:15.353725 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ace19e3c-0162-4b5f-979e-594af0eb468c tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Action: 'update', calling method: .version_select at 0x7fc418a48a60>, body: {"status": "enabled"} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:36:15.366176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ace19e3c-0162-4b5f-979e-594af0eb468c tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:15.367303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ace19e3c-0162-4b5f-979e-594af0eb468c tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:15.368255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ace19e3c-0162-4b5f-979e-594af0eb468c tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:15.390048 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ace19e3c-0162-4b5f-979e-594af0eb468c tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:15.391199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ace19e3c-0162-4b5f-979e-594af0eb468c tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:15.391879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ace19e3c-0162-4b5f-979e-594af0eb468c tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:15.405183 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-ace19e3c-0162-4b5f-979e-594af0eb468c tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] HTTP exception thrown: Service 8f7517db-5905-449e-9047-60fdb6df039a could not be found. Sep 07 12:36:15.407447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ace19e3c-0162-4b5f-979e-594af0eb468c tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Request method failure captured: Sep 07 12:36:15.407447 n-d-852087-9 devstack@n-api.service[122433]: request: PUT /compute/v2.1/os-services/8f7517db-5905-449e-9047-60fdb6df039a HTTP/1.1 Sep 07 12:36:15.407447 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:36:15.407447 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:36:15.407447 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:36:15.407447 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 21 Sep 07 12:36:15.407447 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:36:15.407447 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:36:15.407447 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:36:15.407447 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:36:15.407447 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJA7UhUXhBW8dbRVXY6hLodprRmX5daLMQ5yL7y6a8uqX4OIUz6XRWUs5QMGSLKaAASPQCWUQZjJhA71ln8bEksfh51YEeXnor65t1CsdT9ybxaF5hfOSPQyi8O6WvtFP0p3n_ZbiozXzi9bK2XpreDrE0h917FQMJ1uqYv0gQY1ZcE Sep 07 12:36:15.407447 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:36:15.407447 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:36:15.407447 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:36:15.407447 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:36:15.407447 n-d-852087-9 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.53 Sep 07 12:36:15.407447 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:36:15.407447 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:36:15.407447 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: ad8bd248d3ec4e478fc4613a48b6423e Sep 07 12:36:15.407447 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-718096427 Sep 07 12:36:15.407447 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 12:36:15.407447 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 12:36:15.408967 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad8bd248d3ec4e478fc4613a48b6423e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ad8bd248d3ec4e478fc4613a48b6423e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ad8bd248d3ec4e478fc4613a48b6423e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad8bd248d3ec4e478fc4613a48b6423e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:36:15.408967 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-718096427 Sep 07 12:36:15.408967 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: ad8bd248d3ec4e478fc4613a48b6423e Sep 07 12:36:15.408967 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-718096427 Sep 07 12:36:15.408967 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin Sep 07 12:36:15.408967 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:36:15.408967 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:36:15.408967 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: c69608da0ff5422793b726d299305e05 Sep 07 12:36:15.408967 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin Sep 07 12:36:15.408967 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:36:15.408967 n-d-852087-9 devstack@n-api.service[122433]: {"status": "enabled"} Sep 07 12:36:15.408967 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:36:15.408967 n-d-852087-9 devstack@n-api.service[122433]: exception: Service 8f7517db-5905-449e-9047-60fdb6df039a could not be found. Sep 07 12:36:15.408967 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '8f7517db-5905-449e-9047-60fdb6df039a', 'body': {'status': 'enabled'}} Sep 07 12:36:15.410057 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:36:15.410057 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:15.410057 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 07 12:36:15.410057 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 07 12:36:15.410057 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 07 12:36:15.410057 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 07 12:36:15.410057 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 07 12:36:15.410057 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:36:15.410057 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:15.410057 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:36:15.410057 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:15.410057 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 07 12:36:15.410057 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 07 12:36:15.410057 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 07 12:36:15.410057 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:36:15.410057 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 8f7517db-5905-449e-9047-60fdb6df039a could not be found. Sep 07 12:36:15.410057 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:36:15.410057 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:15.410057 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:36:15.410057 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:15.410057 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:36:15.411399 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:36:15.411399 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:36:15.411399 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:36:15.411399 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:36:15.411399 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:36:15.411399 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:36:15.411399 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:36:15.411399 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:36:15.411399 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:36:15.411399 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 07 12:36:15.411399 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:36:15.411399 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 8f7517db-5905-449e-9047-60fdb6df039a could not be found. Sep 07 12:36:15.411399 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:36:15.411399 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:15.411399 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:36:15.411399 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:15.411399 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:36:15.411399 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:36:15.411399 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:36:15.411399 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:36:15.412677 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 8f7517db-5905-449e-9047-60fdb6df039a could not be found. Sep 07 12:36:15.412677 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:36:15.422342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ace19e3c-0162-4b5f-979e-594af0eb468c tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Returning 404 to user: Service 8f7517db-5905-449e-9047-60fdb6df039a could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:36:15.423652 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ace19e3c-0162-4b5f-979e-594af0eb468c tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/8f7517db-5905-449e-9047-60fdb6df039a" status: 404 len: 110 microversion: 2.53 time: 0.080947 Sep 07 12:36:15.424853 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 862/1751] 10.222.0.16 () {62 vars in 1309 bytes} [Wed Sep 7 12:36:15 2022] PUT /compute/v2.1/os-services/8f7517db-5905-449e-9047-60fdb6df039a => generated 110 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:36:15.433250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-d4553c79-b54b-4e18-a2db-caa1f2756aa0 req-6665207b-48c3-4a96-90f2-e568da0100c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03263c2b-a3d1-4f6c-a5c9-ee201f82bb81", "name": "network-vif-plugged", "status": "completed", "tag": "50a71a57-d6a7-4fc4-884d-37725c6e2f65"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:36:15.456508 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d4553c79-b54b-4e18-a2db-caa1f2756aa0 req-6665207b-48c3-4a96-90f2-e568da0100c7 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:15.468721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d4553c79-b54b-4e18-a2db-caa1f2756aa0 req-6665207b-48c3-4a96-90f2-e568da0100c7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:15.469819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d4553c79-b54b-4e18-a2db-caa1f2756aa0 req-6665207b-48c3-4a96-90f2-e568da0100c7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:15.477334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a4543b2f-b108-434b-8f46-a7f6a4e6f02c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:15.485113 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-d4553c79-b54b-4e18-a2db-caa1f2756aa0 req-6665207b-48c3-4a96-90f2-e568da0100c7 service nova] Creating event network-vif-plugged:50a71a57-d6a7-4fc4-884d-37725c6e2f65 for instance 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 on n-h1-852087-9 Sep 07 12:36:15.493156 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-d4553c79-b54b-4e18-a2db-caa1f2756aa0 req-6665207b-48c3-4a96-90f2-e568da0100c7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066501 Sep 07 12:36:15.495514 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a4543b2f-b108-434b-8f46-a7f6a4e6f02c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 0.480151 Sep 07 12:36:15.496128 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 890/1752] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:15 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:15.496670 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 863/1753] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:15.501254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-002d249d-504b-4b44-98ae-42c7f2c0c3f5 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:15.501923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-002d249d-504b-4b44-98ae-42c7f2c0c3f5 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] [instance: 5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:15.519037 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d8ecdfa5-0f7a-4c6d-bfbe-7e70b7353816 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:15.522949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8ecdfa5-0f7a-4c6d-bfbe-7e70b7353816 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:15.523432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8ecdfa5-0f7a-4c6d-bfbe-7e70b7353816 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:15.528382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8ecdfa5-0f7a-4c6d-bfbe-7e70b7353816 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:15.529230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8ecdfa5-0f7a-4c6d-bfbe-7e70b7353816 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:15.529760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8ecdfa5-0f7a-4c6d-bfbe-7e70b7353816 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:15.530197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8ecdfa5-0f7a-4c6d-bfbe-7e70b7353816 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:15.531949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-002d249d-504b-4b44-98ae-42c7f2c0c3f5 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:15.533082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-002d249d-504b-4b44-98ae-42c7f2c0c3f5 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:15.533807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-002d249d-504b-4b44-98ae-42c7f2c0c3f5 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:15.534779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-002d249d-504b-4b44-98ae-42c7f2c0c3f5 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:15.535478 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-002d249d-504b-4b44-98ae-42c7f2c0c3f5 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:15.536097 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-002d249d-504b-4b44-98ae-42c7f2c0c3f5 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:15.555154 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-002d249d-504b-4b44-98ae-42c7f2c0c3f5 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] HTTP exception thrown: Instance 5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa could not be found. Sep 07 12:36:15.558638 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-002d249d-504b-4b44-98ae-42c7f2c0c3f5 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Request method failure captured: Sep 07 12:36:15.558638 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa HTTP/1.1 Sep 07 12:36:15.558638 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:36:15.558638 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:36:15.558638 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:36:15.558638 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:36:15.558638 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:36:15.558638 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:36:15.558638 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:36:15.558638 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:36:15.558638 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJASi7Vrgm_9_EzK2gsBlgwyvrbYltOIXU7OEhVc3_We9b8Oi1I_QrI7aMKKYTwj3fFxF_k3JoyyorWThSUndL4UlYqiuooLJwVu-RQk1TT_jTqSSo34IorPEgg46J1794Yn9DdoboN_8rpqY5kX6vTPqr5d_rDXbTc_1onouw6KuE0 Sep 07 12:36:15.558638 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:36:15.558638 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:36:15.558638 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:36:15.558638 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:36:15.558638 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:36:15.558638 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:36:15.558638 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: f448aeb9b2f84f6caabfb642a0219854 Sep 07 12:36:15.558638 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TenantUsagesTestJSON-796471821 Sep 07 12:36:15.558638 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:36:15.558638 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:36:15.560668 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f448aeb9b2f84f6caabfb642a0219854"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f448aeb9b2f84f6caabfb642a0219854"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f448aeb9b2f84f6caabfb642a0219854"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f448aeb9b2f84f6caabfb642a0219854"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:36:15.560668 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TenantUsagesTestJSON-796471821 Sep 07 12:36:15.560668 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: f448aeb9b2f84f6caabfb642a0219854 Sep 07 12:36:15.560668 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TenantUsagesTestJSON-796471821 Sep 07 12:36:15.560668 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TenantUsagesTestJSON-796471821-project Sep 07 12:36:15.560668 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:36:15.560668 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:36:15.560668 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: dc75f20bc8dc4bbd8c96e8780970b0b7 Sep 07 12:36:15.560668 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TenantUsagesTestJSON-796471821-project Sep 07 12:36:15.560668 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:36:15.560668 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa could not be found. Sep 07 12:36:15.560668 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa'} Sep 07 12:36:15.561729 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:36:15.561729 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:15.561729 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:36:15.561729 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:36:15.561729 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:36:15.561729 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:36:15.561729 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:36:15.561729 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:36:15.561729 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:36:15.561729 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:36:15.561729 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa could not be found. Sep 07 12:36:15.561729 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:15.561729 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:15.561729 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:15.561729 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:15.561729 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:36:15.561729 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:36:15.561729 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:36:15.561729 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:36:15.561729 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:36:15.563467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:36:15.563467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:36:15.563467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:36:15.563467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:36:15.563467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:36:15.563467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:36:15.563467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:36:15.563467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa could not be found. Sep 07 12:36:15.563467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:15.563467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:15.563467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:15.563467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:15.563467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:36:15.563467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:36:15.563467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:36:15.563467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:36:15.563467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa could not be found. Sep 07 12:36:15.563467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:15.567673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-002d249d-504b-4b44-98ae-42c7f2c0c3f5 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] Returning 404 to user: Instance 5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:36:15.568900 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-002d249d-504b-4b44-98ae-42c7f2c0c3f5 tempest-TenantUsagesTestJSON-796471821 tempest-TenantUsagesTestJSON-796471821-project] 10.222.0.16 "GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa" status: 404 len: 111 microversion: 2.1 time: 0.071786 Sep 07 12:36:15.570164 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 891/1754] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:15 2022] GET /compute/v2.1/servers/5b31e4f6-e7d2-4a34-a0ec-4ec0d24441fa => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:36:15.588747 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d8ecdfa5-0f7a-4c6d-bfbe-7e70b7353816 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.090477 Sep 07 12:36:15.589399 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 864/1755] 10.222.0.16 () {60 vars in 1178 bytes} [Wed Sep 7 12:36:15 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:36:15.607332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-332ce291-4099-44fe-b017-2a10b50d8353 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:15.622588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-332ce291-4099-44fe-b017-2a10b50d8353 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:15.623697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-332ce291-4099-44fe-b017-2a10b50d8353 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:15.625919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-332ce291-4099-44fe-b017-2a10b50d8353 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:15.627738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-332ce291-4099-44fe-b017-2a10b50d8353 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:15.629653 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-332ce291-4099-44fe-b017-2a10b50d8353 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:15.630113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-332ce291-4099-44fe-b017-2a10b50d8353 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:15.652371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=21 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:36:15.703267 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-332ce291-4099-44fe-b017-2a10b50d8353 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.102652 Sep 07 12:36:15.708074 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 892/1756] 10.222.0.16 () {60 vars in 1211 bytes} [Wed Sep 7 12:36:15 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:36:15.722725 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8c3dfb4b-a441-42e9-822e-0da2130b49cf tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:15.727119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c3dfb4b-a441-42e9-822e-0da2130b49cf tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:15.729569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c3dfb4b-a441-42e9-822e-0da2130b49cf tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:15.730030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c3dfb4b-a441-42e9-822e-0da2130b49cf tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:15.730837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c3dfb4b-a441-42e9-822e-0da2130b49cf tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:15.731341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c3dfb4b-a441-42e9-822e-0da2130b49cf tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:15.737921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c3dfb4b-a441-42e9-822e-0da2130b49cf tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:15.802284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-86fb439b-d4b7-4522-a75e-cdc498bdb717 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:15.802915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-86fb439b-d4b7-4522-a75e-cdc498bdb717 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:15.816467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86fb439b-d4b7-4522-a75e-cdc498bdb717 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:15.816975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86fb439b-d4b7-4522-a75e-cdc498bdb717 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:15.817414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86fb439b-d4b7-4522-a75e-cdc498bdb717 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:15.818184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86fb439b-d4b7-4522-a75e-cdc498bdb717 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:15.818648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86fb439b-d4b7-4522-a75e-cdc498bdb717 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:15.824510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86fb439b-d4b7-4522-a75e-cdc498bdb717 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:15.859558 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8c3dfb4b-a441-42e9-822e-0da2130b49cf tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.138141 Sep 07 12:36:15.863811 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 865/1757] 10.222.0.16 () {60 vars in 1178 bytes} [Wed Sep 7 12:36:15 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:36:15.887836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6d81e0bb-96ab-4114-a54b-7b0e278c968a tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:15.901194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d81e0bb-96ab-4114-a54b-7b0e278c968a tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:15.902717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d81e0bb-96ab-4114-a54b-7b0e278c968a tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:15.906099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d81e0bb-96ab-4114-a54b-7b0e278c968a tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:15.908500 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d81e0bb-96ab-4114-a54b-7b0e278c968a tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:15.915201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d81e0bb-96ab-4114-a54b-7b0e278c968a tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:15.918377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d81e0bb-96ab-4114-a54b-7b0e278c968a tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:16.034752 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6d81e0bb-96ab-4114-a54b-7b0e278c968a tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-852087-9&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.153573 Sep 07 12:36:16.037590 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 866/1758] 10.222.0.16 () {60 vars in 1235 bytes} [Wed Sep 7 12:36:15 2022] GET /compute/v2.1/os-services?host=n-d-852087-9&binary=xxx => generated 16 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:16.047729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-26a376bf-ed3f-423e-8b85-0adffa63a942 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc418a48550>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:16.120092 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-26a376bf-ed3f-423e-8b85-0adffa63a942 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.079721 Sep 07 12:36:16.121568 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 867/1759] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:16 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:16.134515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d7cf4d7e-b96d-4d7d-9c00-ba9369bc23e2 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:16.141084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7cf4d7e-b96d-4d7d-9c00-ba9369bc23e2 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:16.142165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7cf4d7e-b96d-4d7d-9c00-ba9369bc23e2 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:16.142873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7cf4d7e-b96d-4d7d-9c00-ba9369bc23e2 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:16.143966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7cf4d7e-b96d-4d7d-9c00-ba9369bc23e2 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:16.144773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7cf4d7e-b96d-4d7d-9c00-ba9369bc23e2 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:16.145672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7cf4d7e-b96d-4d7d-9c00-ba9369bc23e2 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:16.181040 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d7cf4d7e-b96d-4d7d-9c00-ba9369bc23e2 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.057886 Sep 07 12:36:16.183386 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 868/1760] 10.222.0.16 () {60 vars in 1178 bytes} [Wed Sep 7 12:36:16 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:36:16.203289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-86fb439b-d4b7-4522-a75e-cdc498bdb717 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:16.213640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-86fb439b-d4b7-4522-a75e-cdc498bdb717 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:16.214287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0e6d44fc-33fd-466b-a121-5c2c1a4fa6c9 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:16.227429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-86fb439b-d4b7-4522-a75e-cdc498bdb717 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:16.229383 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-86fb439b-d4b7-4522-a75e-cdc498bdb717 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1814 microversion: 2.25 time: 0.436058 Sep 07 12:36:16.230175 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 893/1761] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:36:15 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1814 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:36:16.249054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e6d44fc-33fd-466b-a121-5c2c1a4fa6c9 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:16.261897 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e6d44fc-33fd-466b-a121-5c2c1a4fa6c9 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:16.262938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e6d44fc-33fd-466b-a121-5c2c1a4fa6c9 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:16.263870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e6d44fc-33fd-466b-a121-5c2c1a4fa6c9 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:16.264487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e6d44fc-33fd-466b-a121-5c2c1a4fa6c9 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:16.265114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e6d44fc-33fd-466b-a121-5c2c1a4fa6c9 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:16.300978 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0e6d44fc-33fd-466b-a121-5c2c1a4fa6c9 tempest-ServicesAdminNegativeV253TestJSON-718096427 tempest-ServicesAdminNegativeV253TestJSON-718096427-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.099378 Sep 07 12:36:16.303992 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 869/1762] 10.222.0.16 () {60 vars in 1239 bytes} [Wed Sep 7 12:36:16 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:16.362742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7fa2d578-9d5d-4f0d-bf44-b84806cd443b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:16.363887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7fa2d578-9d5d-4f0d-bf44-b84806cd443b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] [instance: e068f19a-c0b5-4648-be84-71deaa1b580e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:16.380792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7fa2d578-9d5d-4f0d-bf44-b84806cd443b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:16.382201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7fa2d578-9d5d-4f0d-bf44-b84806cd443b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:16.383194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7fa2d578-9d5d-4f0d-bf44-b84806cd443b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:16.384503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7fa2d578-9d5d-4f0d-bf44-b84806cd443b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:16.397000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7fa2d578-9d5d-4f0d-bf44-b84806cd443b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:16.397461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7fa2d578-9d5d-4f0d-bf44-b84806cd443b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:16.702248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7fa2d578-9d5d-4f0d-bf44-b84806cd443b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da21307adfcf48aca8a08c1ef316ff7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99763bdb3740a9af4a779ffc8238ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:16.720341 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7fa2d578-9d5d-4f0d-bf44-b84806cd443b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] 10.222.0.16 "GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e" status: 200 len: 1401 microversion: 2.1 time: 0.362109 Sep 07 12:36:16.721607 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 870/1763] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:16 2022] GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e => generated 1401 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:36:16.740857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-52247d94-0c64-465b-a251-d122ac2a253f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:16.743368 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-52247d94-0c64-465b-a251-d122ac2a253f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:16.761613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52247d94-0c64-465b-a251-d122ac2a253f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:16.763018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52247d94-0c64-465b-a251-d122ac2a253f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:16.764338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52247d94-0c64-465b-a251-d122ac2a253f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:16.766219 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52247d94-0c64-465b-a251-d122ac2a253f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:16.768110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52247d94-0c64-465b-a251-d122ac2a253f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:16.769277 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-52247d94-0c64-465b-a251-d122ac2a253f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:16.865272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-078568b9-6be5-4225-9a58-17a344ed2fb4 tempest-ServicesAdminNegativeV253TestJSON-983089794 tempest-ServicesAdminNegativeV253TestJSON-983089794-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:16.884964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-078568b9-6be5-4225-9a58-17a344ed2fb4 tempest-ServicesAdminNegativeV253TestJSON-983089794 tempest-ServicesAdminNegativeV253TestJSON-983089794-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '5731252bd16945bba0fb051fb7e63878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00895be22c64848bee73b5c613743a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:16.896683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-078568b9-6be5-4225-9a58-17a344ed2fb4 tempest-ServicesAdminNegativeV253TestJSON-983089794 tempest-ServicesAdminNegativeV253TestJSON-983089794-project] Request method failure captured: Sep 07 12:36:16.896683 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 07 12:36:16.896683 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:36:16.896683 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:36:16.896683 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:36:16.896683 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:36:16.896683 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:36:16.896683 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:36:16.896683 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:36:16.896683 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:36:16.896683 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJA6gj67isHCHOlg7b7LufPZEMFsbxzKOe2cx1b0WxzBEX8JgpSgDNggz_aADB6yk3LwWddJqlRSaRjAmJSvTpXBKM20Ew3_x7F9Y7ltIWc0O0JJaoAs3TgXA0Y7cD-IDARBLU4I95IM6jUP-ci577BUAAgov-_N5KM1cxvzD7gTHKo Sep 07 12:36:16.896683 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:36:16.896683 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:36:16.896683 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:36:16.896683 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:36:16.896683 n-d-852087-9 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.53 Sep 07 12:36:16.896683 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:36:16.896683 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:36:16.896683 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: e00895be22c64848bee73b5c613743a4 Sep 07 12:36:16.896683 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-983089794 Sep 07 12:36:16.896683 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:36:16.896683 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:36:16.898320 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e00895be22c64848bee73b5c613743a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e00895be22c64848bee73b5c613743a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e00895be22c64848bee73b5c613743a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e00895be22c64848bee73b5c613743a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:36:16.898320 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-983089794 Sep 07 12:36:16.898320 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: e00895be22c64848bee73b5c613743a4 Sep 07 12:36:16.898320 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-983089794 Sep 07 12:36:16.898320 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServicesAdminNegativeV253TestJSON-983089794-project Sep 07 12:36:16.898320 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:36:16.898320 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:36:16.898320 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 5731252bd16945bba0fb051fb7e63878 Sep 07 12:36:16.898320 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-983089794-project Sep 07 12:36:16.898320 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:36:16.898320 n-d-852087-9 devstack@n-api.service[122432]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 07 12:36:16.898320 n-d-852087-9 devstack@n-api.service[122432]: action_args: {} Sep 07 12:36:16.899171 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:36:16.899171 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:16.899171 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:36:16.899171 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:36:16.899171 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:36:16.899171 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:36:16.899171 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 12:36:16.899171 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:36:16.899171 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 12:36:16.899171 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:36:16.899171 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:36:16.899171 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:36:16.899171 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 07 12:36:16.899171 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 07 12:36:16.899171 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:36:16.899171 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:36:16.899171 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:36:16.899171 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:36:16.899171 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:36:16.900689 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:36:16.900689 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:36:16.900689 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:36:16.900689 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:36:16.900689 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:36:16.900689 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:36:16.900689 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:36:16.900689 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:36:16.900689 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:36:16.900689 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 07 12:36:16.900689 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:16.900689 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:16.900689 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:16.900689 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:16.900689 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:36:16.900689 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:36:16.900689 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:36:16.900689 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:36:16.900689 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 07 12:36:16.900689 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:16.903863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-078568b9-6be5-4225-9a58-17a344ed2fb4 tempest-ServicesAdminNegativeV253TestJSON-983089794 tempest-ServicesAdminNegativeV253TestJSON-983089794-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:36:16.903863 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-078568b9-6be5-4225-9a58-17a344ed2fb4 tempest-ServicesAdminNegativeV253TestJSON-983089794 tempest-ServicesAdminNegativeV253TestJSON-983089794-project] 10.222.0.16 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.585313 Sep 07 12:36:16.915190 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 894/1764] 10.222.0.16 () {60 vars in 1178 bytes} [Wed Sep 7 12:36:16 2022] GET /compute/v2.1/os-services => generated 112 bytes in 598 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:36:17.136484 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-52247d94-0c64-465b-a251-d122ac2a253f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:17.137647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9cf76134-bfb7-4c02-a262-f57cc6db1684 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41d191040>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:17.148422 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-52247d94-0c64-465b-a251-d122ac2a253f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 0.424393 Sep 07 12:36:17.149471 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 871/1765] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:16 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:17.247090 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9cf76134-bfb7-4c02-a262-f57cc6db1684 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.114633 Sep 07 12:36:17.247692 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 895/1766] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:17 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:36:17.260767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1e45bbac-e54f-4a59-ba18-e6f31a4cfc9d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:17.262585 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1e45bbac-e54f-4a59-ba18-e6f31a4cfc9d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:17.284696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e45bbac-e54f-4a59-ba18-e6f31a4cfc9d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:17.285216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e45bbac-e54f-4a59-ba18-e6f31a4cfc9d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:17.285703 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e45bbac-e54f-4a59-ba18-e6f31a4cfc9d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:17.292366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e45bbac-e54f-4a59-ba18-e6f31a4cfc9d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:17.296363 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e45bbac-e54f-4a59-ba18-e6f31a4cfc9d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:17.302139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e45bbac-e54f-4a59-ba18-e6f31a4cfc9d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:17.462289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c5851136-f773-4487-9be0-2693d79c32ca req-fdb561b7-850c-4136-9e37-1c666c059165 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e068f19a-c0b5-4648-be84-71deaa1b580e", "tag": "8f6bb4ac-83bd-4502-ad70-a17a49f4f319"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:36:17.480798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c5851136-f773-4487-9be0-2693d79c32ca req-fdb561b7-850c-4136-9e37-1c666c059165 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:17.481528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c5851136-f773-4487-9be0-2693d79c32ca req-fdb561b7-850c-4136-9e37-1c666c059165 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:17.482171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c5851136-f773-4487-9be0-2693d79c32ca req-fdb561b7-850c-4136-9e37-1c666c059165 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:17.509172 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c5851136-f773-4487-9be0-2693d79c32ca req-fdb561b7-850c-4136-9e37-1c666c059165 service nova] Creating event network-changed:8f6bb4ac-83bd-4502-ad70-a17a49f4f319 for instance e068f19a-c0b5-4648-be84-71deaa1b580e on n-h1-852087-9 Sep 07 12:36:17.518741 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c5851136-f773-4487-9be0-2693d79c32ca req-fdb561b7-850c-4136-9e37-1c666c059165 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060441 Sep 07 12:36:17.521213 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 896/1767] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:17.657244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1e45bbac-e54f-4a59-ba18-e6f31a4cfc9d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:17.681511 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1e45bbac-e54f-4a59-ba18-e6f31a4cfc9d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:17.685605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1e45bbac-e54f-4a59-ba18-e6f31a4cfc9d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:17.691219 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1e45bbac-e54f-4a59-ba18-e6f31a4cfc9d tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1814 microversion: 2.25 time: 0.434922 Sep 07 12:36:17.694204 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 872/1768] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:36:17 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1814 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:36:17.746423 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bfe87059-a139-43d3-a397-89258c246236 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:17.747152 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bfe87059-a139-43d3-a397-89258c246236 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] [instance: e068f19a-c0b5-4648-be84-71deaa1b580e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:17.749808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=62 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:36:17.767189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfe87059-a139-43d3-a397-89258c246236 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:17.768225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfe87059-a139-43d3-a397-89258c246236 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:17.770015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfe87059-a139-43d3-a397-89258c246236 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:17.771771 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfe87059-a139-43d3-a397-89258c246236 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:17.773267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfe87059-a139-43d3-a397-89258c246236 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:17.774490 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfe87059-a139-43d3-a397-89258c246236 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:18.020428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bfe87059-a139-43d3-a397-89258c246236 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da21307adfcf48aca8a08c1ef316ff7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99763bdb3740a9af4a779ffc8238ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:18.036089 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bfe87059-a139-43d3-a397-89258c246236 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] 10.222.0.16 "GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e" status: 200 len: 1401 microversion: 2.1 time: 0.294811 Sep 07 12:36:18.037227 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 897/1769] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:17 2022] GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e => generated 1401 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:18.177353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5acf61fa-7671-4dca-b0d7-7ced6ca0366e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:18.178317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5acf61fa-7671-4dca-b0d7-7ced6ca0366e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:18.187657 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5acf61fa-7671-4dca-b0d7-7ced6ca0366e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:18.193044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5acf61fa-7671-4dca-b0d7-7ced6ca0366e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:18.196345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5acf61fa-7671-4dca-b0d7-7ced6ca0366e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:18.197943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5acf61fa-7671-4dca-b0d7-7ced6ca0366e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:18.198451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5acf61fa-7671-4dca-b0d7-7ced6ca0366e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:18.199300 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5acf61fa-7671-4dca-b0d7-7ced6ca0366e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:18.267973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-af9569e5-3a9c-4504-a3a8-4778598d34f3 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41d252040>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:18.365420 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-af9569e5-3a9c-4504-a3a8-4778598d34f3 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.103981 Sep 07 12:36:18.368443 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 898/1770] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:18 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:36:18.657839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5acf61fa-7671-4dca-b0d7-7ced6ca0366e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:18.673453 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5acf61fa-7671-4dca-b0d7-7ced6ca0366e tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 0.500233 Sep 07 12:36:18.674481 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 873/1771] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:18 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:18.700847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4638baf6-aa7d-45a4-b239-77e8b85801e2 tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] Action: 'create', calling method: .version_select at 0x7fc41d20fca0>, body: {"keypair": {"name": "tempest-keypair-1579469800", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKQfQfSCQpbPL4v/iuPiggk+Hj0+gHOTMDoM0pt6W5y3YiZ5+awKZsSD6Boocic7QMAwaLYMZStMU5uiTnYjGJD7OlwNs56A465xSiDYUo7c/bnlwixATLaBQggwtGFlA=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:36:18.727644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f28e18ee-b5e9-4aa3-91ec-1c52306e3370 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:18.736341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f28e18ee-b5e9-4aa3-91ec-1c52306e3370 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:18.755465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-4638baf6-aa7d-45a4-b239-77e8b85801e2 tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] Getting quotas for project f32126a743804d1bb12dd1b37e6a21e1. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:36:18.764540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f28e18ee-b5e9-4aa3-91ec-1c52306e3370 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:18.769294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f28e18ee-b5e9-4aa3-91ec-1c52306e3370 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:18.774574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f28e18ee-b5e9-4aa3-91ec-1c52306e3370 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:18.777778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-4638baf6-aa7d-45a4-b239-77e8b85801e2 tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] Getting quotas for user 7d4657e0441e413ea0dfa8eaa5f9c063 and project f32126a743804d1bb12dd1b37e6a21e1. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:36:18.797063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f28e18ee-b5e9-4aa3-91ec-1c52306e3370 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:18.799870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f28e18ee-b5e9-4aa3-91ec-1c52306e3370 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:18.806184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f28e18ee-b5e9-4aa3-91ec-1c52306e3370 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:18.853547 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4638baf6-aa7d-45a4-b239-77e8b85801e2 tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.408866 Sep 07 12:36:18.855975 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 899/1772] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 12:36:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:18.907414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f2af2494-aed1-47dc-b48d-16e4bc25908e tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] Calling method '.version_select at 0x7fc41d191d30>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:18.937129 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f2af2494-aed1-47dc-b48d-16e4bc25908e tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-1579469800" status: 200 len: 498 microversion: 2.1 time: 0.068059 Sep 07 12:36:18.939043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=9 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:36:18.952466 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 900/1773] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Sep 7 12:36:18 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1579469800 => generated 498 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:18.961252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f7f23803-f394-424b-a92c-313f325b2472 tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] Calling method '.version_select at 0x7fc419559a60>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:18.992261 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f7f23803-f394-424b-a92c-313f325b2472 tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1579469800" status: 202 len: 0 microversion: 2.1 time: 0.035731 Sep 07 12:36:18.993836 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 901/1774] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Sep 7 12:36:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1579469800 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:36:19.015888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5aac8224-4fad-43f4-b31d-cc832636c5f2 tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] Action: 'create', calling method: .version_select at 0x7fc41d107ca0>, body: {"keypair": {"name": "tempest-keypair-1054746595", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxeYHu9i0s0KATutQN7fxXbxEmLA9YLpe8eelXXsYUoSSC0A9MoLMUlFdKwxX4fCXS14A1XMMdXb6kCZEukh4tYwe8d45az0kAmbJXY8VN6iMeRoTaXdiqHZnyJBQ1m6g=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:36:19.057632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-5aac8224-4fad-43f4-b31d-cc832636c5f2 tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] Getting quotas for project f32126a743804d1bb12dd1b37e6a21e1. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:36:19.067404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-5aac8224-4fad-43f4-b31d-cc832636c5f2 tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] Getting quotas for user 7d4657e0441e413ea0dfa8eaa5f9c063 and project f32126a743804d1bb12dd1b37e6a21e1. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:36:19.119128 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5aac8224-4fad-43f4-b31d-cc832636c5f2 tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114319 Sep 07 12:36:19.121214 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 902/1775] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 12:36:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:19.141386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2d8fb52d-c56b-46a9-a2a5-d47d6f18f037 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:19.148140 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2d8fb52d-c56b-46a9-a2a5-d47d6f18f037 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] [instance: e068f19a-c0b5-4648-be84-71deaa1b580e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:19.165785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d8fb52d-c56b-46a9-a2a5-d47d6f18f037 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:19.167038 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d8fb52d-c56b-46a9-a2a5-d47d6f18f037 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:19.168026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d8fb52d-c56b-46a9-a2a5-d47d6f18f037 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:19.169052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d8fb52d-c56b-46a9-a2a5-d47d6f18f037 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:19.171995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d8fb52d-c56b-46a9-a2a5-d47d6f18f037 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:19.172763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d8fb52d-c56b-46a9-a2a5-d47d6f18f037 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:19.242791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f28e18ee-b5e9-4aa3-91ec-1c52306e3370 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:19.264203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f28e18ee-b5e9-4aa3-91ec-1c52306e3370 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:19.270086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f28e18ee-b5e9-4aa3-91ec-1c52306e3370 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:19.272226 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f28e18ee-b5e9-4aa3-91ec-1c52306e3370 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1814 microversion: 2.25 time: 0.552850 Sep 07 12:36:19.277828 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 874/1776] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:36:18 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1814 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:36:19.294728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2faf272f-9bba-406a-b3c9-a439623b54ab tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] Calling method '.version_select at 0x7fc418a00b80>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:19.359174 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2faf272f-9bba-406a-b3c9-a439623b54ab tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1054746595" status: 202 len: 0 microversion: 2.1 time: 0.078117 Sep 07 12:36:19.361943 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 875/1777] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Sep 7 12:36:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1054746595 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:36:19.378662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e416f017-9a2b-4de2-854b-fd95fd3d055d tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] Action: 'create', calling method: .version_select at 0x7fc418a18430>, body: {"keypair": {"name": "tempest-keypair-1106782346", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:36:19.415923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e416f017-9a2b-4de2-854b-fd95fd3d055d tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] Getting quotas for project f32126a743804d1bb12dd1b37e6a21e1. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:36:19.424332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e416f017-9a2b-4de2-854b-fd95fd3d055d tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] Getting quotas for user 7d4657e0441e413ea0dfa8eaa5f9c063 and project f32126a743804d1bb12dd1b37e6a21e1. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:36:19.460913 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e416f017-9a2b-4de2-854b-fd95fd3d055d tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.093139 Sep 07 12:36:19.465951 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 876/1778] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 12:36:19 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:19.479121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2aa8832d-40d1-4607-bffc-8a44c808d1df tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc418a1a040>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:19.500376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2d8fb52d-c56b-46a9-a2a5-d47d6f18f037 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da21307adfcf48aca8a08c1ef316ff7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99763bdb3740a9af4a779ffc8238ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:19.532776 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2aa8832d-40d1-4607-bffc-8a44c808d1df tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.064183 Sep 07 12:36:19.534031 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 877/1779] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:19 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:19.540014 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-861d0e8d-0a3f-4bc5-b8ad-71c23c797de5 tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] Calling method '.version_select at 0x7fc418af9550>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:19.543272 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2d8fb52d-c56b-46a9-a2a5-d47d6f18f037 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] 10.222.0.16 "GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e" status: 200 len: 1401 microversion: 2.1 time: 0.419725 Sep 07 12:36:19.550967 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 903/1780] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:19 2022] GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e => generated 1401 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:19.569993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:36:19.592786 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-861d0e8d-0a3f-4bc5-b8ad-71c23c797de5 tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1106782346" status: 202 len: 0 microversion: 2.1 time: 0.056920 Sep 07 12:36:19.595077 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 878/1781] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Sep 7 12:36:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1106782346 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:36:19.609820 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-40024570-7d45-4db9-af08-f7b1d7ff05bb tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] Action: 'create', calling method: .version_select at 0x7fc41d1070d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1183133968", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWESMGabPIvucR//KfSxcp0TaaLYILjwmXvsYlDqEsZ4Q5nUl5ibUEavh1oHSXqYXXDxKByYdNL1qgeYN0SQv2Cz7rdL4OT0Ns97wDjhQl9+GkZRmwE9tvelMb2VO6RKA=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:36:19.627705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-40024570-7d45-4db9-af08-f7b1d7ff05bb tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] Getting quotas for project f32126a743804d1bb12dd1b37e6a21e1. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:36:19.635679 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-40024570-7d45-4db9-af08-f7b1d7ff05bb tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] Getting quotas for user 7d4657e0441e413ea0dfa8eaa5f9c063 and project f32126a743804d1bb12dd1b37e6a21e1. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:36:19.678031 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-40024570-7d45-4db9-af08-f7b1d7ff05bb tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.073282 Sep 07 12:36:19.687370 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 904/1782] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 12:36:19 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:19.696586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1546ca1a-d98b-4f65-ab01-544a4805178d tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] Action: 'create', calling method: .version_select at 0x7fc418a008b0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-686251051", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBn8kwjbQ6LhaiUvp8PP16K+ERCY8wH4am4i2G3l0RHVGWPf88VVS00/IsCK4S51VVINyz3obSpm7qG1pBtOdjP6G8yClRzimVPtNLcQRkNJrqg7WE4ITk1Ef2AEl+NweA=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:36:19.723999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-71e217f1-7adc-41fc-9f2e-dcc7cd072125 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:19.726334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-71e217f1-7adc-41fc-9f2e-dcc7cd072125 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:19.739790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-1546ca1a-d98b-4f65-ab01-544a4805178d tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] Getting quotas for project f32126a743804d1bb12dd1b37e6a21e1. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:36:19.744619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71e217f1-7adc-41fc-9f2e-dcc7cd072125 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:19.745556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71e217f1-7adc-41fc-9f2e-dcc7cd072125 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:19.746244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71e217f1-7adc-41fc-9f2e-dcc7cd072125 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:19.747128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71e217f1-7adc-41fc-9f2e-dcc7cd072125 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:19.747533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71e217f1-7adc-41fc-9f2e-dcc7cd072125 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:19.747966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71e217f1-7adc-41fc-9f2e-dcc7cd072125 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:19.757153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-1546ca1a-d98b-4f65-ab01-544a4805178d tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] Getting quotas for user 7d4657e0441e413ea0dfa8eaa5f9c063 and project f32126a743804d1bb12dd1b37e6a21e1. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:36:19.821193 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1546ca1a-d98b-4f65-ab01-544a4805178d tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.130903 Sep 07 12:36:19.823584 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 879/1783] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 12:36:19 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:19.855050 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-609b6526-c07d-4446-8de7-f393618a7c24 tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] Action: 'create', calling method: .version_select at 0x7fc418a003a0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1101757888", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGc27FTERmMO3wyWzUl4EJE4h8cUjdAjBmKV9WrxjMy46pvziLe/I0y/WrTIg74wiKW57qQO0EWnShtCARLv+Qz8nKzrX+idBrtKvyOiILFN4aX4a8ZdIlv4d3XXaloYQg=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:36:19.913250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-609b6526-c07d-4446-8de7-f393618a7c24 tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] Getting quotas for project f32126a743804d1bb12dd1b37e6a21e1. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:36:19.925807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-609b6526-c07d-4446-8de7-f393618a7c24 tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] Getting quotas for user 7d4657e0441e413ea0dfa8eaa5f9c063 and project f32126a743804d1bb12dd1b37e6a21e1. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:36:19.989229 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-609b6526-c07d-4446-8de7-f393618a7c24 tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.154437 Sep 07 12:36:19.992447 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 880/1784] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 12:36:19 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:20.007641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0d6eb220-6763-4b8b-aaad-ab4391049202 tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] Calling method '.version_select at 0x7fc418a181f0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:20.022501 n-d-852087-9 devstack@n-api.service[122433]: WARNING oslo_db.sqlalchemy.utils [None req-0d6eb220-6763-4b8b-aaad-ab4391049202 tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 07 12:36:20.041830 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0d6eb220-6763-4b8b-aaad-ab4391049202 tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.042526 Sep 07 12:36:20.043270 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 881/1785] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:36:19 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:36:20.069974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8a623469-30e0-4a15-b694-6851c3a38ee5 tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] Calling method '.version_select at 0x7fc418a17700>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:20.083863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-71e217f1-7adc-41fc-9f2e-dcc7cd072125 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:20.093412 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-71e217f1-7adc-41fc-9f2e-dcc7cd072125 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 0.376710 Sep 07 12:36:20.097444 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 905/1786] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:19 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:20.144551 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8a623469-30e0-4a15-b694-6851c3a38ee5 tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1101757888" status: 202 len: 0 microversion: 2.1 time: 0.093253 Sep 07 12:36:20.150739 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 882/1787] 10.222.0.16 () {58 vars in 1278 bytes} [Wed Sep 7 12:36:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1101757888 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:36:20.157004 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d3d94f55-c2e9-4d71-925e-df4b0c48acae tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] Calling method '.version_select at 0x7fc41d2924c0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:20.215354 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d3d94f55-c2e9-4d71-925e-df4b0c48acae tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-686251051" status: 202 len: 0 microversion: 2.1 time: 0.063262 Sep 07 12:36:20.217986 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 906/1788] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Sep 7 12:36:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-686251051 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 12:36:20.252830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-588ba10a-c636-42e0-8971-a57826cf559c tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] Calling method '.version_select at 0x7fc418a1ae50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:20.282370 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-588ba10a-c636-42e0-8971-a57826cf559c tempest-KeyPairsV2TestJSON-1938857489 tempest-KeyPairsV2TestJSON-1938857489-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1183133968" status: 202 len: 0 microversion: 2.1 time: 0.043612 Sep 07 12:36:20.283583 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 883/1789] 10.222.0.16 () {58 vars in 1278 bytes} [Wed Sep 7 12:36:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1183133968 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:36:20.315608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-41b7d061-2ea8-4a21-8824-42f686e38f7f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:20.317791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-41b7d061-2ea8-4a21-8824-42f686e38f7f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:20.347039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41b7d061-2ea8-4a21-8824-42f686e38f7f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:20.348044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41b7d061-2ea8-4a21-8824-42f686e38f7f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:20.351813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41b7d061-2ea8-4a21-8824-42f686e38f7f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:20.353205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41b7d061-2ea8-4a21-8824-42f686e38f7f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:20.354980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41b7d061-2ea8-4a21-8824-42f686e38f7f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:20.355770 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41b7d061-2ea8-4a21-8824-42f686e38f7f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:20.558668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c55ffe69-bbca-4e60-afef-37f0041749e1 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc418a18310>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:20.704329 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c55ffe69-bbca-4e60-afef-37f0041749e1 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.154938 Sep 07 12:36:20.714491 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 884/1790] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:20 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:20.727152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-80bbed70-5ab9-46c7-a996-8855c267bdff tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:20.732073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-80bbed70-5ab9-46c7-a996-8855c267bdff tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] [instance: e068f19a-c0b5-4648-be84-71deaa1b580e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:20.746929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80bbed70-5ab9-46c7-a996-8855c267bdff tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:20.747609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80bbed70-5ab9-46c7-a996-8855c267bdff tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:20.748065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80bbed70-5ab9-46c7-a996-8855c267bdff tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:20.748814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80bbed70-5ab9-46c7-a996-8855c267bdff tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:20.749477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80bbed70-5ab9-46c7-a996-8855c267bdff tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:20.754493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80bbed70-5ab9-46c7-a996-8855c267bdff tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:20.797139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-41b7d061-2ea8-4a21-8824-42f686e38f7f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:20.809767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-41b7d061-2ea8-4a21-8824-42f686e38f7f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:20.811698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-41b7d061-2ea8-4a21-8824-42f686e38f7f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:20.815910 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-41b7d061-2ea8-4a21-8824-42f686e38f7f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1814 microversion: 2.25 time: 0.510748 Sep 07 12:36:20.818435 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 907/1791] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:36:20 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1814 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:36:21.141057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-021cc9fc-896e-41d3-9b18-4e01490a7dc7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:21.143499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-021cc9fc-896e-41d3-9b18-4e01490a7dc7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:21.156562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-021cc9fc-896e-41d3-9b18-4e01490a7dc7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:21.158547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-021cc9fc-896e-41d3-9b18-4e01490a7dc7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:21.159673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-021cc9fc-896e-41d3-9b18-4e01490a7dc7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:21.161422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-021cc9fc-896e-41d3-9b18-4e01490a7dc7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:21.162565 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-021cc9fc-896e-41d3-9b18-4e01490a7dc7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:21.164292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-021cc9fc-896e-41d3-9b18-4e01490a7dc7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:21.291616 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-80bbed70-5ab9-46c7-a996-8855c267bdff tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da21307adfcf48aca8a08c1ef316ff7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99763bdb3740a9af4a779ffc8238ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:21.313351 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-80bbed70-5ab9-46c7-a996-8855c267bdff tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] 10.222.0.16 "GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e" status: 200 len: 1401 microversion: 2.1 time: 0.590003 Sep 07 12:36:21.316035 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 885/1792] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:20 2022] GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e => generated 1401 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:21.615899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-021cc9fc-896e-41d3-9b18-4e01490a7dc7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:21.634013 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-021cc9fc-896e-41d3-9b18-4e01490a7dc7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 0.500525 Sep 07 12:36:21.634897 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 908/1793] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:21 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:21.727579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6390c8ba-15e2-4f71-b1e2-af9412272bb9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc418a17670>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:21.837420 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6390c8ba-15e2-4f71-b1e2-af9412272bb9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.118774 Sep 07 12:36:21.839130 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 886/1794] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:21 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:21.857659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e346f2b0-f987-438e-83f1-c1b4a1d98872 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:21.859501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e346f2b0-f987-438e-83f1-c1b4a1d98872 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:21.875346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e346f2b0-f987-438e-83f1-c1b4a1d98872 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:21.879272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e346f2b0-f987-438e-83f1-c1b4a1d98872 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:21.880946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e346f2b0-f987-438e-83f1-c1b4a1d98872 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:21.888778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e346f2b0-f987-438e-83f1-c1b4a1d98872 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:21.889767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e346f2b0-f987-438e-83f1-c1b4a1d98872 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:21.891214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e346f2b0-f987-438e-83f1-c1b4a1d98872 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:22.335598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e346f2b0-f987-438e-83f1-c1b4a1d98872 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:22.354554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e346f2b0-f987-438e-83f1-c1b4a1d98872 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:22.357276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7267a2f3-0eff-4943-af68-e08ff257f38c tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:22.358620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7267a2f3-0eff-4943-af68-e08ff257f38c tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] [instance: e068f19a-c0b5-4648-be84-71deaa1b580e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:22.361883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e346f2b0-f987-438e-83f1-c1b4a1d98872 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:22.364077 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e346f2b0-f987-438e-83f1-c1b4a1d98872 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1814 microversion: 2.25 time: 0.515017 Sep 07 12:36:22.377540 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 909/1795] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:36:21 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1814 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:36:22.388864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7267a2f3-0eff-4943-af68-e08ff257f38c tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:22.392179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7267a2f3-0eff-4943-af68-e08ff257f38c tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:22.393103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7267a2f3-0eff-4943-af68-e08ff257f38c tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:22.396104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7267a2f3-0eff-4943-af68-e08ff257f38c tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:22.396863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7267a2f3-0eff-4943-af68-e08ff257f38c tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:22.399974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7267a2f3-0eff-4943-af68-e08ff257f38c tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:22.678868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3ea264c7-3910-4916-9fef-b319a1583e33 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:22.680355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3ea264c7-3910-4916-9fef-b319a1583e33 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:22.711079 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ea264c7-3910-4916-9fef-b319a1583e33 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:22.713014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ea264c7-3910-4916-9fef-b319a1583e33 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:22.714667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ea264c7-3910-4916-9fef-b319a1583e33 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:22.719768 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ea264c7-3910-4916-9fef-b319a1583e33 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:22.721316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7267a2f3-0eff-4943-af68-e08ff257f38c tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da21307adfcf48aca8a08c1ef316ff7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99763bdb3740a9af4a779ffc8238ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:22.723344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ea264c7-3910-4916-9fef-b319a1583e33 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:22.728772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ea264c7-3910-4916-9fef-b319a1583e33 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:22.737674 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7267a2f3-0eff-4943-af68-e08ff257f38c tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] 10.222.0.16 "GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e" status: 200 len: 1401 microversion: 2.1 time: 0.384158 Sep 07 12:36:22.739417 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 887/1796] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:22 2022] GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e => generated 1401 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:36:22.862912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0fe73788-bc0f-46a3-a2c8-1526fa9d33b7 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc418a17160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:23.031843 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0fe73788-bc0f-46a3-a2c8-1526fa9d33b7 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.174936 Sep 07 12:36:23.054408 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 888/1797] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:22 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:23.262518 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3ea264c7-3910-4916-9fef-b319a1583e33 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:23.300397 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3ea264c7-3910-4916-9fef-b319a1583e33 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 0.625372 Sep 07 12:36:23.326464 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 910/1798] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:22 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:23.398237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3d1f786b-c1bd-4e4d-8c94-6d5f937a3a96 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:23.399143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3d1f786b-c1bd-4e4d-8c94-6d5f937a3a96 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:23.411552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d1f786b-c1bd-4e4d-8c94-6d5f937a3a96 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:23.428949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d1f786b-c1bd-4e4d-8c94-6d5f937a3a96 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:23.429477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d1f786b-c1bd-4e4d-8c94-6d5f937a3a96 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:23.430306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d1f786b-c1bd-4e4d-8c94-6d5f937a3a96 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:23.430790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d1f786b-c1bd-4e4d-8c94-6d5f937a3a96 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:23.431224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d1f786b-c1bd-4e4d-8c94-6d5f937a3a96 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:23.800037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4edf0815-77ae-475f-a1f2-f110e14c7b76 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:23.810711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4edf0815-77ae-475f-a1f2-f110e14c7b76 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] [instance: e068f19a-c0b5-4648-be84-71deaa1b580e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:23.823301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3d1f786b-c1bd-4e4d-8c94-6d5f937a3a96 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:23.841126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3d1f786b-c1bd-4e4d-8c94-6d5f937a3a96 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:23.843073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3d1f786b-c1bd-4e4d-8c94-6d5f937a3a96 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:23.845941 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3d1f786b-c1bd-4e4d-8c94-6d5f937a3a96 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1814 microversion: 2.25 time: 0.452433 Sep 07 12:36:23.857876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4edf0815-77ae-475f-a1f2-f110e14c7b76 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:23.858891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4edf0815-77ae-475f-a1f2-f110e14c7b76 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:23.862233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4edf0815-77ae-475f-a1f2-f110e14c7b76 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:23.863295 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 889/1799] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:36:23 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1814 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:36:23.865522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4edf0815-77ae-475f-a1f2-f110e14c7b76 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:23.876735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4edf0815-77ae-475f-a1f2-f110e14c7b76 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:23.878786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4edf0815-77ae-475f-a1f2-f110e14c7b76 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:23.981283 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:36:24.057072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-389fce35-4c91-431f-96e3-52785f65ff11 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc418a17af0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:24.165022 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-389fce35-4c91-431f-96e3-52785f65ff11 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.113182 Sep 07 12:36:24.165656 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 890/1800] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:24 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:24.318455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4edf0815-77ae-475f-a1f2-f110e14c7b76 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da21307adfcf48aca8a08c1ef316ff7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99763bdb3740a9af4a779ffc8238ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:24.339258 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4edf0815-77ae-475f-a1f2-f110e14c7b76 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] 10.222.0.16 "GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e" status: 200 len: 1401 microversion: 2.1 time: 0.549468 Sep 07 12:36:24.349148 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 911/1801] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:23 2022] GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e => generated 1401 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:24.363172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-77deb353-ebdf-4a7d-a2c3-73cec8c8fa8c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:24.371923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-77deb353-ebdf-4a7d-a2c3-73cec8c8fa8c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:24.399768 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77deb353-ebdf-4a7d-a2c3-73cec8c8fa8c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:24.405819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77deb353-ebdf-4a7d-a2c3-73cec8c8fa8c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:24.408527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77deb353-ebdf-4a7d-a2c3-73cec8c8fa8c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:24.411352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77deb353-ebdf-4a7d-a2c3-73cec8c8fa8c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:24.412990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77deb353-ebdf-4a7d-a2c3-73cec8c8fa8c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:24.413505 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77deb353-ebdf-4a7d-a2c3-73cec8c8fa8c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:25.003823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a599570b-10aa-407c-a432-c8af359221f2 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:25.018006 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a599570b-10aa-407c-a432-c8af359221f2 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.838756 Sep 07 12:36:25.020184 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 891/1802] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:36:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:25.030098 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-939675ab-bcf1-4736-8611-4a31bca8169e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:25.031163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-939675ab-bcf1-4736-8611-4a31bca8169e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:25.047812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-939675ab-bcf1-4736-8611-4a31bca8169e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:25.049719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-939675ab-bcf1-4736-8611-4a31bca8169e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:25.050877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-939675ab-bcf1-4736-8611-4a31bca8169e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:25.053792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-939675ab-bcf1-4736-8611-4a31bca8169e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:25.056148 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-939675ab-bcf1-4736-8611-4a31bca8169e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:25.057982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-939675ab-bcf1-4736-8611-4a31bca8169e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:25.099803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-77deb353-ebdf-4a7d-a2c3-73cec8c8fa8c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:25.116944 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-77deb353-ebdf-4a7d-a2c3-73cec8c8fa8c tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 0.765386 Sep 07 12:36:25.118401 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 912/1803] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:24 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:25.137232 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e3998a67-4e05-4cbc-a1e8-fc730ea2faa1 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:25.173965 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e3998a67-4e05-4cbc-a1e8-fc730ea2faa1 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.046972 Sep 07 12:36:25.177839 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 913/1804] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Sep 7 12:36:25 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:25.192739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-09c96c72-91a6-4abb-924a-69d74f4e49f5 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41d2efaf0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:25.341499 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-09c96c72-91a6-4abb-924a-69d74f4e49f5 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.162026 Sep 07 12:36:25.342565 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 914/1805] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:25 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:25.348159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a5975b27-f1a4-407d-b906-51a2237566b6 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:25.354269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:36:25.377546 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a5975b27-f1a4-407d-b906-51a2237566b6 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032475 Sep 07 12:36:25.381770 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 915/1806] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:36:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:25.410857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9df922ac-c51b-4176-9e46-cf05c717e41f tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:25.418730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9df922ac-c51b-4176-9e46-cf05c717e41f tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] [instance: e068f19a-c0b5-4648-be84-71deaa1b580e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:25.436636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9df922ac-c51b-4176-9e46-cf05c717e41f tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:25.438841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9df922ac-c51b-4176-9e46-cf05c717e41f tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:25.442893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9df922ac-c51b-4176-9e46-cf05c717e41f tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:25.444027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9df922ac-c51b-4176-9e46-cf05c717e41f tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:25.449457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9df922ac-c51b-4176-9e46-cf05c717e41f tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:25.452463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9df922ac-c51b-4176-9e46-cf05c717e41f tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:25.685608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:36:25.938246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-939675ab-bcf1-4736-8611-4a31bca8169e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:25.955232 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-939675ab-bcf1-4736-8611-4a31bca8169e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:25.969476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-939675ab-bcf1-4736-8611-4a31bca8169e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:25.983571 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-939675ab-bcf1-4736-8611-4a31bca8169e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1814 microversion: 2.25 time: 0.961418 Sep 07 12:36:26.011687 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 892/1807] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:36:25 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1814 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:36:26.021352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c44aaa5-8533-4bc9-b549-0af9a5df9dd4 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:26.052809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9df922ac-c51b-4176-9e46-cf05c717e41f tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da21307adfcf48aca8a08c1ef316ff7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99763bdb3740a9af4a779ffc8238ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:26.069014 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7c44aaa5-8533-4bc9-b549-0af9a5df9dd4 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.054714 Sep 07 12:36:26.069772 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9df922ac-c51b-4176-9e46-cf05c717e41f tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] 10.222.0.16 "GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e" status: 200 len: 1401 microversion: 2.1 time: 0.683440 Sep 07 12:36:26.070695 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 893/1808] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:36:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:26.071820 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 916/1809] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:25 2022] GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e => generated 1401 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:26.094595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-63d86ed8-29b4-4b58-8bd2-f3b87625e696 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:26.152477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-909533f6-4103-4981-84a1-02da26c19a06 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:26.154182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-909533f6-4103-4981-84a1-02da26c19a06 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:26.191488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-909533f6-4103-4981-84a1-02da26c19a06 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:26.192868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-909533f6-4103-4981-84a1-02da26c19a06 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:26.198732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-909533f6-4103-4981-84a1-02da26c19a06 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:26.201118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-909533f6-4103-4981-84a1-02da26c19a06 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:26.202282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-909533f6-4103-4981-84a1-02da26c19a06 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:26.206165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-909533f6-4103-4981-84a1-02da26c19a06 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:26.254959 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-63d86ed8-29b4-4b58-8bd2-f3b87625e696 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.171808 Sep 07 12:36:26.258226 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 917/1810] 10.222.0.16 () {58 vars in 1165 bytes} [Wed Sep 7 12:36:26 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:26.287669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1154690b-1779-4dbe-af1f-608a4226707f tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:26.328550 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1154690b-1779-4dbe-af1f-608a4226707f tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.046367 Sep 07 12:36:26.332290 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 918/1811] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:36:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:26.353632 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=24 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:36:26.360415 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a7050c35-9adb-4f82-a779-862072ebde66 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:26.491072 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a7050c35-9adb-4f82-a779-862072ebde66 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.148448 Sep 07 12:36:26.500026 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 919/1812] 10.222.0.16 () {58 vars in 1169 bytes} [Wed Sep 7 12:36:26 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:26.541265 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-69d72bb9-194b-44f5-96e5-4a612f403c9f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41d195550>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:26.712575 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-69d72bb9-194b-44f5-96e5-4a612f403c9f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.211185 Sep 07 12:36:26.713856 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 920/1813] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:26 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:26.742454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-38dc2e78-23e2-4065-9a2f-0802c10a1868 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:26.822809 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-38dc2e78-23e2-4065-9a2f-0802c10a1868 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.094860 Sep 07 12:36:26.833677 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 921/1814] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Sep 7 12:36:26 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:26.856707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bbce9baa-0d94-4f16-8d3b-daa1dbe51005 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:26.908428 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bbce9baa-0d94-4f16-8d3b-daa1dbe51005 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.062083 Sep 07 12:36:26.909565 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 922/1815] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:36:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:26.945405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cc2d9876-5aa1-4250-b3c0-17db860f2e80 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:27.045831 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cc2d9876-5aa1-4250-b3c0-17db860f2e80 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.112403 Sep 07 12:36:27.074999 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 923/1816] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Sep 7 12:36:26 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:27.080370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5f43b79b-2170-41e6-9c2f-51385a6af8a4 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:27.081006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5f43b79b-2170-41e6-9c2f-51385a6af8a4 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:27.095782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f43b79b-2170-41e6-9c2f-51385a6af8a4 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:27.096285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f43b79b-2170-41e6-9c2f-51385a6af8a4 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:27.096722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f43b79b-2170-41e6-9c2f-51385a6af8a4 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:27.097448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f43b79b-2170-41e6-9c2f-51385a6af8a4 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:27.097948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f43b79b-2170-41e6-9c2f-51385a6af8a4 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:27.098373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f43b79b-2170-41e6-9c2f-51385a6af8a4 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:27.880578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-909533f6-4103-4981-84a1-02da26c19a06 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:27.899605 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-909533f6-4103-4981-84a1-02da26c19a06 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 1.751270 Sep 07 12:36:27.899801 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 894/1817] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:26 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:27.925190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a288ea58-aa4b-4346-8ab8-57b4b1797603 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:27.957374 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a288ea58-aa4b-4346-8ab8-57b4b1797603 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.048584 Sep 07 12:36:27.959468 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 895/1818] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:36:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:27.976936 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6e83b758-6af0-4e5d-8d62-0c41fd8fd456 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:27.977775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6e83b758-6af0-4e5d-8d62-0c41fd8fd456 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] [instance: e068f19a-c0b5-4648-be84-71deaa1b580e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:27.995926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e83b758-6af0-4e5d-8d62-0c41fd8fd456 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:27.999068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e83b758-6af0-4e5d-8d62-0c41fd8fd456 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:28.000312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e83b758-6af0-4e5d-8d62-0c41fd8fd456 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:28.003109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e83b758-6af0-4e5d-8d62-0c41fd8fd456 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:28.004008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e83b758-6af0-4e5d-8d62-0c41fd8fd456 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:28.004581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e83b758-6af0-4e5d-8d62-0c41fd8fd456 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:28.342680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5f43b79b-2170-41e6-9c2f-51385a6af8a4 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:28.366768 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5f43b79b-2170-41e6-9c2f-51385a6af8a4 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:28.372760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5f43b79b-2170-41e6-9c2f-51385a6af8a4 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:28.374673 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5f43b79b-2170-41e6-9c2f-51385a6af8a4 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1814 microversion: 2.25 time: 1.298391 Sep 07 12:36:28.380501 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 924/1819] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:36:27 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1814 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:36:28.400016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b08bd4c0-96ef-49d1-bcbc-e41c4cc893da tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41d252430>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:28.592615 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b08bd4c0-96ef-49d1-bcbc-e41c4cc893da tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.209368 Sep 07 12:36:28.595162 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 925/1820] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:28 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:28.605760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6eeb4147-ffff-42e8-af3e-f31c86d9a15c tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:28.695091 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6eeb4147-ffff-42e8-af3e-f31c86d9a15c tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] 10.222.0.16 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.095679 Sep 07 12:36:28.709539 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 926/1821] 10.222.0.16 () {58 vars in 1144 bytes} [Wed Sep 7 12:36:28 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:28.725870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-18c691ce-0600-4215-a4e4-030e62009d70 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:28.746766 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-18c691ce-0600-4215-a4e4-030e62009d70 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026809 Sep 07 12:36:28.761708 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 927/1822] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:36:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:28.772418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2f59b2a3-eeeb-4f74-a693-ea956517caa5 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:28.829071 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2f59b2a3-eeeb-4f74-a693-ea956517caa5 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] 10.222.0.16 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.064890 Sep 07 12:36:28.834978 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 928/1823] 10.222.0.16 () {58 vars in 1148 bytes} [Wed Sep 7 12:36:28 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:36:28.863251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9ca63446-c17d-43c7-a53e-2a2041dd5d58 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:28.908588 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9ca63446-c17d-43c7-a53e-2a2041dd5d58 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] 10.222.0.16 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.048727 Sep 07 12:36:28.923084 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 929/1824] 10.222.0.16 () {58 vars in 1140 bytes} [Wed Sep 7 12:36:28 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:36:28.936848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-54c8b603-d9a1-4a9b-8f61-960e560aea19 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:28.959518 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-54c8b603-d9a1-4a9b-8f61-960e560aea19 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032522 Sep 07 12:36:28.960167 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 930/1825] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:36:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:36:28.979253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d74f0962-c6ac-45f9-9c69-7da9df67a5a8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:28.979253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d74f0962-c6ac-45f9-9c69-7da9df67a5a8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:29.001363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d74f0962-c6ac-45f9-9c69-7da9df67a5a8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:29.001871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d74f0962-c6ac-45f9-9c69-7da9df67a5a8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:29.002606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d74f0962-c6ac-45f9-9c69-7da9df67a5a8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:29.003948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d74f0962-c6ac-45f9-9c69-7da9df67a5a8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:29.004883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d74f0962-c6ac-45f9-9c69-7da9df67a5a8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:29.018133 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d74f0962-c6ac-45f9-9c69-7da9df67a5a8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:29.649837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=12 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:36:29.848872 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6e83b758-6af0-4e5d-8d62-0c41fd8fd456 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da21307adfcf48aca8a08c1ef316ff7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99763bdb3740a9af4a779ffc8238ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:29.924545 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6e83b758-6af0-4e5d-8d62-0c41fd8fd456 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] 10.222.0.16 "GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e" status: 200 len: 1401 microversion: 2.1 time: 1.955560 Sep 07 12:36:29.925805 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 896/1826] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:27 2022] GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e => generated 1401 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:29.955682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-14d16951-7861-43f1-9688-d359720088a5 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:30.039674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=12 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:36:30.283514 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-14d16951-7861-43f1-9688-d359720088a5 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] 10.222.0.16 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.343981 Sep 07 12:36:30.284901 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 897/1827] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:36:29 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:30.331638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8f9f60cd-b9bc-474c-af72-9518701e5828 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:30.333471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8f9f60cd-b9bc-474c-af72-9518701e5828 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:30.349887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f9f60cd-b9bc-474c-af72-9518701e5828 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:30.351247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f9f60cd-b9bc-474c-af72-9518701e5828 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:30.352372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f9f60cd-b9bc-474c-af72-9518701e5828 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:30.354660 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f9f60cd-b9bc-474c-af72-9518701e5828 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:30.355981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f9f60cd-b9bc-474c-af72-9518701e5828 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:30.356988 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f9f60cd-b9bc-474c-af72-9518701e5828 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:30.447581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:36:30.646985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d74f0962-c6ac-45f9-9c69-7da9df67a5a8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:30.674520 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d74f0962-c6ac-45f9-9c69-7da9df67a5a8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 1.710783 Sep 07 12:36:30.675738 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 931/1828] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:28 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:30.714206 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4beb52a0-f794-455f-9825-5444bf4f8c35 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41d107280>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:30.838212 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4beb52a0-f794-455f-9825-5444bf4f8c35 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.160882 Sep 07 12:36:30.839590 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 932/1829] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:30 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:30.845754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-cd341410-3be7-441a-a6ee-311b2f8bea54 req-72254f63-dcad-4fe5-a2ab-1c6353224ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e068f19a-c0b5-4648-be84-71deaa1b580e", "name": "network-vif-plugged", "status": "completed", "tag": "8f6bb4ac-83bd-4502-ad70-a17a49f4f319"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:36:30.861214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cd341410-3be7-441a-a6ee-311b2f8bea54 req-72254f63-dcad-4fe5-a2ab-1c6353224ec3 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:30.861912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cd341410-3be7-441a-a6ee-311b2f8bea54 req-72254f63-dcad-4fe5-a2ab-1c6353224ec3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:30.862465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cd341410-3be7-441a-a6ee-311b2f8bea54 req-72254f63-dcad-4fe5-a2ab-1c6353224ec3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:30.879976 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-cd341410-3be7-441a-a6ee-311b2f8bea54 req-72254f63-dcad-4fe5-a2ab-1c6353224ec3 service nova] Creating event network-vif-plugged:8f6bb4ac-83bd-4502-ad70-a17a49f4f319 for instance e068f19a-c0b5-4648-be84-71deaa1b580e on n-h1-852087-9 Sep 07 12:36:30.892493 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-cd341410-3be7-441a-a6ee-311b2f8bea54 req-72254f63-dcad-4fe5-a2ab-1c6353224ec3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051341 Sep 07 12:36:30.902231 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 933/1830] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:30.915626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9a50d106-c63c-4e77-8aab-d0cc4dec0f9e tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:30.961547 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9a50d106-c63c-4e77-8aab-d0cc4dec0f9e tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057862 Sep 07 12:36:30.962820 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 934/1831] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:36:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:31.179543 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-77c058df-0dcc-412f-a6df-e9fb61cd5f4d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1355118518", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "fbdf8ec3-7207-4081-80bb-109d3ec18fae"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:36:31.371623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-77c058df-0dcc-412f-a6df-e9fb61cd5f4d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] validate_networks() for [('fbdf8ec3-7207-4081-80bb-109d3ec18fae', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:36:31.498825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8f9f60cd-b9bc-474c-af72-9518701e5828 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:31.547991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8f9f60cd-b9bc-474c-af72-9518701e5828 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:31.557163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8f9f60cd-b9bc-474c-af72-9518701e5828 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:31.560319 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8f9f60cd-b9bc-474c-af72-9518701e5828 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1814 microversion: 2.25 time: 1.260708 Sep 07 12:36:31.566316 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 898/1832] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:36:30 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1814 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:36:31.586651 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-05b34e5d-41eb-4af7-883f-c6e223fddeea tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:31.590785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-05b34e5d-41eb-4af7-883f-c6e223fddeea tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] [instance: e068f19a-c0b5-4648-be84-71deaa1b580e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:31.624865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05b34e5d-41eb-4af7-883f-c6e223fddeea tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:31.627645 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05b34e5d-41eb-4af7-883f-c6e223fddeea tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:31.632413 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05b34e5d-41eb-4af7-883f-c6e223fddeea tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:31.634880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05b34e5d-41eb-4af7-883f-c6e223fddeea tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:31.650018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05b34e5d-41eb-4af7-883f-c6e223fddeea tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:31.657802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05b34e5d-41eb-4af7-883f-c6e223fddeea tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:32.540620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-05b34e5d-41eb-4af7-883f-c6e223fddeea tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da21307adfcf48aca8a08c1ef316ff7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99763bdb3740a9af4a779ffc8238ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:32.562163 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-05b34e5d-41eb-4af7-883f-c6e223fddeea tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] 10.222.0.16 "GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e" status: 200 len: 1401 microversion: 2.1 time: 0.982064 Sep 07 12:36:32.577988 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 899/1833] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:31 2022] GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e => generated 1401 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:32.585185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5e138409-d6bf-4891-8a5c-220e18912ac6 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:32.604660 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5e138409-d6bf-4891-8a5c-220e18912ac6 tempest-FlavorsV2TestJSON-2135854254 tempest-FlavorsV2TestJSON-2135854254-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025379 Sep 07 12:36:32.605270 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 900/1834] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:36:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:32.616505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0c9e9263-c569-47c6-b905-8244aa4fff2d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:32.618110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0c9e9263-c569-47c6-b905-8244aa4fff2d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:32.635053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c9e9263-c569-47c6-b905-8244aa4fff2d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:32.635920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c9e9263-c569-47c6-b905-8244aa4fff2d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:32.636538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c9e9263-c569-47c6-b905-8244aa4fff2d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:32.637541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c9e9263-c569-47c6-b905-8244aa4fff2d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:32.650429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c9e9263-c569-47c6-b905-8244aa4fff2d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:32.651227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c9e9263-c569-47c6-b905-8244aa4fff2d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:33.064550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0c9e9263-c569-47c6-b905-8244aa4fff2d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:33.073416 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0c9e9263-c569-47c6-b905-8244aa4fff2d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 0.466693 Sep 07 12:36:33.085447 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 901/1835] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:32 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:33.091328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cca43088-370a-4c4a-8dbc-ddf5f4edd669 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc418cabaf0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:33.231185 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cca43088-370a-4c4a-8dbc-ddf5f4edd669 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.144386 Sep 07 12:36:33.231798 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 902/1836] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:33 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:33.243273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2ffaf9f9-c5bf-430f-b34f-e239599a7628 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:33.257254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2ffaf9f9-c5bf-430f-b34f-e239599a7628 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:33.306263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ffaf9f9-c5bf-430f-b34f-e239599a7628 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:33.314349 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ffaf9f9-c5bf-430f-b34f-e239599a7628 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:33.321960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ffaf9f9-c5bf-430f-b34f-e239599a7628 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:33.329685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ffaf9f9-c5bf-430f-b34f-e239599a7628 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:33.330922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ffaf9f9-c5bf-430f-b34f-e239599a7628 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:33.331757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ffaf9f9-c5bf-430f-b34f-e239599a7628 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:34.824119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2ffaf9f9-c5bf-430f-b34f-e239599a7628 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:34.883032 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2ffaf9f9-c5bf-430f-b34f-e239599a7628 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:34.897592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2ffaf9f9-c5bf-430f-b34f-e239599a7628 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:34.900563 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2ffaf9f9-c5bf-430f-b34f-e239599a7628 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1814 microversion: 2.25 time: 1.666035 Sep 07 12:36:34.908965 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 903/1837] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:36:33 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1814 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:36:34.930072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d6810fe-c272-4a87-aec2-11ebe38219dd tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:34.936639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1d6810fe-c272-4a87-aec2-11ebe38219dd tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] [instance: e068f19a-c0b5-4648-be84-71deaa1b580e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:34.952246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d6810fe-c272-4a87-aec2-11ebe38219dd tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:34.954240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d6810fe-c272-4a87-aec2-11ebe38219dd tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:34.955359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d6810fe-c272-4a87-aec2-11ebe38219dd tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:34.957327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d6810fe-c272-4a87-aec2-11ebe38219dd tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:34.958487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d6810fe-c272-4a87-aec2-11ebe38219dd tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:34.959689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d6810fe-c272-4a87-aec2-11ebe38219dd tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:34.961846 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-77c058df-0dcc-412f-a6df-e9fb61cd5f4d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:36:34.962750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-77c058df-0dcc-412f-a6df-e9fb61cd5f4d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:36:34.963072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-77c058df-0dcc-412f-a6df-e9fb61cd5f4d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:36:34.963741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-77c058df-0dcc-412f-a6df-e9fb61cd5f4d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:36:34.964268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-77c058df-0dcc-412f-a6df-e9fb61cd5f4d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:36:34.987811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77c058df-0dcc-412f-a6df-e9fb61cd5f4d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:34.989439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77c058df-0dcc-412f-a6df-e9fb61cd5f4d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:34.995748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77c058df-0dcc-412f-a6df-e9fb61cd5f4d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:34.996916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77c058df-0dcc-412f-a6df-e9fb61cd5f4d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:34.999918 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77c058df-0dcc-412f-a6df-e9fb61cd5f4d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:35.001036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77c058df-0dcc-412f-a6df-e9fb61cd5f4d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:35.061967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-77c058df-0dcc-412f-a6df-e9fb61cd5f4d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Getting quotas for project 7e13a7ebce0646f8aea71d49eaa698d1. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:36:35.083894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-77c058df-0dcc-412f-a6df-e9fb61cd5f4d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Getting quotas for user cead0c007d8545b3a32963668fbbe23e and project 7e13a7ebce0646f8aea71d49eaa698d1. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:36:35.138988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-77c058df-0dcc-412f-a6df-e9fb61cd5f4d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:36:35.151003 n-d-852087-9 devstack@n-api.service[122432]: WARNING nova.utils [None req-77c058df-0dcc-412f-a6df-e9fb61cd5f4d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1355118518 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-135511851 Sep 07 12:36:35.154776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-77c058df-0dcc-412f-a6df-e9fb61cd5f4d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:36:35.319468 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-77c058df-0dcc-412f-a6df-e9fb61cd5f4d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.353697 Sep 07 12:36:35.340250 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 935/1838] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:36:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 4376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:36:35.352658 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-74349069-1dea-499d-aa90-05e07218e794 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:35.353802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-74349069-1dea-499d-aa90-05e07218e794 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:35.408833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74349069-1dea-499d-aa90-05e07218e794 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:35.411584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74349069-1dea-499d-aa90-05e07218e794 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:35.417173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74349069-1dea-499d-aa90-05e07218e794 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:35.427265 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74349069-1dea-499d-aa90-05e07218e794 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:35.437867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74349069-1dea-499d-aa90-05e07218e794 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:35.439460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74349069-1dea-499d-aa90-05e07218e794 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:36.681955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1d6810fe-c272-4a87-aec2-11ebe38219dd tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da21307adfcf48aca8a08c1ef316ff7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99763bdb3740a9af4a779ffc8238ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:36.695115 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-74349069-1dea-499d-aa90-05e07218e794 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:36.755349 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1d6810fe-c272-4a87-aec2-11ebe38219dd tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] 10.222.0.16 "GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e" status: 200 len: 1589 microversion: 2.1 time: 1.839041 Sep 07 12:36:36.765319 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 904/1839] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:34 2022] GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e => generated 1589 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:36.769606 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-74349069-1dea-499d-aa90-05e07218e794 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 1.426638 Sep 07 12:36:36.788517 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 936/1840] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:35 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:36.820416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3a08d0a8-8fd6-4cc4-aab0-9e735a509958 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc4189cc790>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:36.843341 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-90c51139-b9df-4e4b-9bd3-36e17d26cd46 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:36.844491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-90c51139-b9df-4e4b-9bd3-36e17d26cd46 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:37.150187 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3a08d0a8-8fd6-4cc4-aab0-9e735a509958 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.373021 Sep 07 12:36:37.150970 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-90c51139-b9df-4e4b-9bd3-36e17d26cd46 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cead0c007d8545b3a32963668fbbe23e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e13a7ebce0646f8aea71d49eaa698d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:37.151815 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 905/1841] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:36 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:37.165029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f97f42eb-40a2-4a0a-881e-41bf260cd2a0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:37.165909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f97f42eb-40a2-4a0a-881e-41bf260cd2a0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:37.184356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f97f42eb-40a2-4a0a-881e-41bf260cd2a0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:37.187369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f97f42eb-40a2-4a0a-881e-41bf260cd2a0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:37.187998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f97f42eb-40a2-4a0a-881e-41bf260cd2a0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:37.188895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f97f42eb-40a2-4a0a-881e-41bf260cd2a0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:37.191634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f97f42eb-40a2-4a0a-881e-41bf260cd2a0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:37.192222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f97f42eb-40a2-4a0a-881e-41bf260cd2a0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:37.257016 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-90c51139-b9df-4e4b-9bd3-36e17d26cd46 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf" status: 200 len: 1232 microversion: 2.1 time: 0.460880 Sep 07 12:36:37.261151 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 937/1842] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:36 2022] GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf => generated 1232 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:37.297589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d411d0a2-32e0-4bbf-af84-f12cde745e68 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:37.302211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d411d0a2-32e0-4bbf-af84-f12cde745e68 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] [instance: e068f19a-c0b5-4648-be84-71deaa1b580e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:37.374543 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d411d0a2-32e0-4bbf-af84-f12cde745e68 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:37.377516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d411d0a2-32e0-4bbf-af84-f12cde745e68 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:37.385785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d411d0a2-32e0-4bbf-af84-f12cde745e68 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:37.390211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d411d0a2-32e0-4bbf-af84-f12cde745e68 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:37.398119 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d411d0a2-32e0-4bbf-af84-f12cde745e68 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:37.401785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d411d0a2-32e0-4bbf-af84-f12cde745e68 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:37.893150 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d411d0a2-32e0-4bbf-af84-f12cde745e68 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] 10.222.0.16 "GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.625798 Sep 07 12:36:37.894243 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 938/1843] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Sep 7 12:36:37 2022] GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e/os-interface => generated 285 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:37.899518 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea008ceb-b09a-42a3-85bd-a9d6a06bde58 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:37.900631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ea008ceb-b09a-42a3-85bd-a9d6a06bde58 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:37.958696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea008ceb-b09a-42a3-85bd-a9d6a06bde58 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:37.968664 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea008ceb-b09a-42a3-85bd-a9d6a06bde58 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:37.975637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea008ceb-b09a-42a3-85bd-a9d6a06bde58 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:37.984134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea008ceb-b09a-42a3-85bd-a9d6a06bde58 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:37.984961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea008ceb-b09a-42a3-85bd-a9d6a06bde58 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:37.986795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea008ceb-b09a-42a3-85bd-a9d6a06bde58 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:39.805524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f97f42eb-40a2-4a0a-881e-41bf260cd2a0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:39.842624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f97f42eb-40a2-4a0a-881e-41bf260cd2a0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:39.853016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f97f42eb-40a2-4a0a-881e-41bf260cd2a0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:39.860536 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f97f42eb-40a2-4a0a-881e-41bf260cd2a0 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1804 microversion: 2.25 time: 2.706968 Sep 07 12:36:39.862005 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 906/1844] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:36:37 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1804 bytes in 2709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:36:39.889556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-178c78ac-95f3-4387-943d-9f2c7e9692b9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc418aaee50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:39.990853 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-178c78ac-95f3-4387-943d-9f2c7e9692b9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.122241 Sep 07 12:36:39.997167 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 907/1845] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:39 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:40.009169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d6b0dd66-b891-4bb1-b7b5-d9fc2194fc05 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:40.010147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d6b0dd66-b891-4bb1-b7b5-d9fc2194fc05 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:40.023190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6b0dd66-b891-4bb1-b7b5-d9fc2194fc05 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:40.024009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6b0dd66-b891-4bb1-b7b5-d9fc2194fc05 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:40.024730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6b0dd66-b891-4bb1-b7b5-d9fc2194fc05 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:40.025766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6b0dd66-b891-4bb1-b7b5-d9fc2194fc05 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:40.031114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6b0dd66-b891-4bb1-b7b5-d9fc2194fc05 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:40.031940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6b0dd66-b891-4bb1-b7b5-d9fc2194fc05 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:40.256910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ea008ceb-b09a-42a3-85bd-a9d6a06bde58 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:40.296123 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ea008ceb-b09a-42a3-85bd-a9d6a06bde58 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 2.400430 Sep 07 12:36:40.307089 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 939/1846] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:37 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 2411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:40.319551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d6b0dd66-b891-4bb1-b7b5-d9fc2194fc05 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cead0c007d8545b3a32963668fbbe23e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e13a7ebce0646f8aea71d49eaa698d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:40.384431 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d6b0dd66-b891-4bb1-b7b5-d9fc2194fc05 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf" status: 200 len: 1284 microversion: 2.1 time: 0.385092 Sep 07 12:36:40.387949 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 908/1847] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:39 2022] GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf => generated 1284 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:40.409221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f173f630-9475-41c2-8deb-939437f25947 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Calling method '.version_select at 0x7fc4189cf4c0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:40.437061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f173f630-9475-41c2-8deb-939437f25947 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:40.440422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f173f630-9475-41c2-8deb-939437f25947 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:40.441659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f173f630-9475-41c2-8deb-939437f25947 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:40.507102 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f173f630-9475-41c2-8deb-939437f25947 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 3449 microversion: 2.25 time: 0.117209 Sep 07 12:36:40.511503 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 909/1848] 10.222.0.16 () {60 vars in 1184 bytes} [Wed Sep 7 12:36:40 2022] GET /compute/v2.1/os-migrations => generated 3449 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:36:40.528995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f51bb179-a3d8-4573-b155-bb6d4a953754 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:40.530192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f51bb179-a3d8-4573-b155-bb6d4a953754 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:40.543701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f51bb179-a3d8-4573-b155-bb6d4a953754 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:40.545776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f51bb179-a3d8-4573-b155-bb6d4a953754 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:40.549182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f51bb179-a3d8-4573-b155-bb6d4a953754 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:40.551452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f51bb179-a3d8-4573-b155-bb6d4a953754 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:40.553840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f51bb179-a3d8-4573-b155-bb6d4a953754 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:40.558476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f51bb179-a3d8-4573-b155-bb6d4a953754 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:40.680021 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2d5d87d8-7973-4898-9843-15e69fa083c6 tempest-ImagesDeleteNegativeTestJSON-1322228996 tempest-ImagesDeleteNegativeTestJSON-1322228996-project] 10.222.0.16 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.371526 Sep 07 12:36:40.681421 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 940/1849] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Sep 7 12:36:40 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 07 12:36:40.698491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad99e16e-bb20-4ed9-82ed-b3c56acc0751 tempest-ImagesDeleteNegativeTestJSON-1322228996 tempest-ImagesDeleteNegativeTestJSON-1322228996-project] Calling method '.version_select at 0x7fc41888e0d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:40.811287 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-ad99e16e-bb20-4ed9-82ed-b3c56acc0751 tempest-ImagesDeleteNegativeTestJSON-1322228996 tempest-ImagesDeleteNegativeTestJSON-1322228996-project] HTTP exception thrown: Image not found. Sep 07 12:36:40.861562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad99e16e-bb20-4ed9-82ed-b3c56acc0751 tempest-ImagesDeleteNegativeTestJSON-1322228996 tempest-ImagesDeleteNegativeTestJSON-1322228996-project] Request method failure captured: Sep 07 12:36:40.861562 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Sep 07 12:36:40.861562 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:36:40.861562 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:36:40.861562 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:36:40.861562 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:36:40.861562 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:36:40.861562 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:36:40.861562 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:36:40.861562 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:36:40.861562 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJBXX4VJgGDZ5scq4Tp-N1sVfUmNYujYl-anq0uU3uD52RTeZc4YTTvQSPRLRqi36B8aOOz37QrNnUAMnJnvixXcsEBSmFfKF9Ot-kE2ZR0RhgCQB7gnA8weQ0dRXGQSQ3_SqOpErnKZ7lvyMNYpBsZ2ulaLPyvs8lg-iAGSgZDamuw Sep 07 12:36:40.861562 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:36:40.861562 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:36:40.861562 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:36:40.861562 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:36:40.861562 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:36:40.861562 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:36:40.861562 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: e5c045c73b904984b5d73e13dab3b3a0 Sep 07 12:36:40.861562 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1322228996 Sep 07 12:36:40.861562 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:36:40.861562 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:36:40.864657 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e5c045c73b904984b5d73e13dab3b3a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e5c045c73b904984b5d73e13dab3b3a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e5c045c73b904984b5d73e13dab3b3a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e5c045c73b904984b5d73e13dab3b3a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:36:40.864657 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1322228996 Sep 07 12:36:40.864657 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: e5c045c73b904984b5d73e13dab3b3a0 Sep 07 12:36:40.864657 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1322228996 Sep 07 12:36:40.864657 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ImagesDeleteNegativeTestJSON-1322228996-project Sep 07 12:36:40.864657 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:36:40.864657 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:36:40.864657 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 75b4db82fe714425b8864023bd210d9c Sep 07 12:36:40.864657 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1322228996-project Sep 07 12:36:40.864657 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:36:40.864657 n-d-852087-9 devstack@n-api.service[122432]: exception: Image not found. Sep 07 12:36:40.864657 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '-1'} Sep 07 12:36:40.864657 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:36:40.864657 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:40.868036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 07 12:36:40.868036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 07 12:36:40.868036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:36:40.868036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:36:40.868036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:36:40.868036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:36:40.868036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 07 12:36:40.868036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 07 12:36:40.868036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 07 12:36:40.868036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 07 12:36:40.868036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:36:40.868036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:36:40.868036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:36:40.868036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:36:40.868036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Sep 07 12:36:40.868036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:40.868036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:40.868036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:40.868036 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:40.871246 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 07 12:36:40.871246 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 07 12:36:40.871246 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 07 12:36:40.871246 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 07 12:36:40.871246 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 07 12:36:40.871246 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 07 12:36:40.871246 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Sep 07 12:36:40.871246 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:40.871246 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:40.871246 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:40.871246 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:40.871246 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:36:40.871246 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:36:40.871246 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:36:40.871246 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:36:40.871246 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:36:40.871246 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:36:40.871246 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:36:40.871246 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:36:40.871246 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 07 12:36:40.877549 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 12:36:40.877549 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 12:36:40.877549 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:40.877549 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:40.877549 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:40.877549 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:40.877549 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:36:40.877549 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:36:40.877549 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:36:40.877549 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:36:40.877549 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 12:36:40.877549 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:40.877549 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad99e16e-bb20-4ed9-82ed-b3c56acc0751 tempest-ImagesDeleteNegativeTestJSON-1322228996 tempest-ImagesDeleteNegativeTestJSON-1322228996-project] Returning 404 to user: Image not found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:36:40.882961 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ad99e16e-bb20-4ed9-82ed-b3c56acc0751 tempest-ImagesDeleteNegativeTestJSON-1322228996 tempest-ImagesDeleteNegativeTestJSON-1322228996-project] 10.222.0.16 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.190932 Sep 07 12:36:40.918501 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 941/1850] 10.222.0.16 () {58 vars in 1134 bytes} [Wed Sep 7 12:36:40 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 07 12:36:40.956643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9cc60386-4d04-4006-8ca6-e26ea71be910 tempest-ImagesDeleteNegativeTestJSON-1322228996 tempest-ImagesDeleteNegativeTestJSON-1322228996-project] Calling method '.version_select at 0x7fc41d109b80>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:41.034324 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-9cc60386-4d04-4006-8ca6-e26ea71be910 tempest-ImagesDeleteNegativeTestJSON-1322228996 tempest-ImagesDeleteNegativeTestJSON-1322228996-project] HTTP exception thrown: Image not found. Sep 07 12:36:41.038851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9cc60386-4d04-4006-8ca6-e26ea71be910 tempest-ImagesDeleteNegativeTestJSON-1322228996 tempest-ImagesDeleteNegativeTestJSON-1322228996-project] Request method failure captured: Sep 07 12:36:41.038851 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/images/6719dbcf-919f-43e8-a8f1-f531006986aj HTTP/1.1 Sep 07 12:36:41.038851 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:36:41.038851 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:36:41.038851 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:36:41.038851 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:36:41.038851 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:36:41.038851 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:36:41.038851 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:36:41.038851 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:36:41.038851 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJBXX4VJgGDZ5scq4Tp-N1sVfUmNYujYl-anq0uU3uD52RTeZc4YTTvQSPRLRqi36B8aOOz37QrNnUAMnJnvixXcsEBSmFfKF9Ot-kE2ZR0RhgCQB7gnA8weQ0dRXGQSQ3_SqOpErnKZ7lvyMNYpBsZ2ulaLPyvs8lg-iAGSgZDamuw Sep 07 12:36:41.038851 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:36:41.038851 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:36:41.038851 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:36:41.038851 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:36:41.038851 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:36:41.038851 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:36:41.038851 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: e5c045c73b904984b5d73e13dab3b3a0 Sep 07 12:36:41.038851 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1322228996 Sep 07 12:36:41.038851 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:36:41.038851 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:36:41.042026 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e5c045c73b904984b5d73e13dab3b3a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e5c045c73b904984b5d73e13dab3b3a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e5c045c73b904984b5d73e13dab3b3a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e5c045c73b904984b5d73e13dab3b3a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:36:41.042026 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1322228996 Sep 07 12:36:41.042026 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: e5c045c73b904984b5d73e13dab3b3a0 Sep 07 12:36:41.042026 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1322228996 Sep 07 12:36:41.042026 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ImagesDeleteNegativeTestJSON-1322228996-project Sep 07 12:36:41.042026 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:36:41.042026 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:36:41.042026 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 75b4db82fe714425b8864023bd210d9c Sep 07 12:36:41.042026 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1322228996-project Sep 07 12:36:41.042026 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:36:41.042026 n-d-852087-9 devstack@n-api.service[122432]: exception: Image not found. Sep 07 12:36:41.042026 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '6719dbcf-919f-43e8-a8f1-f531006986aj'} Sep 07 12:36:41.042026 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:36:41.044020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:41.044020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 07 12:36:41.044020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 07 12:36:41.044020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:36:41.044020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:36:41.044020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:36:41.044020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:36:41.044020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 07 12:36:41.044020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 07 12:36:41.044020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 07 12:36:41.044020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 07 12:36:41.044020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:36:41.044020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:36:41.044020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:36:41.044020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:36:41.044020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6719dbcf-919f-43e8-a8f1-f531006986aj to delete Sep 07 12:36:41.044020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:41.044020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:41.044020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:41.046821 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:41.046821 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 07 12:36:41.046821 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 07 12:36:41.046821 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 07 12:36:41.046821 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 07 12:36:41.046821 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 07 12:36:41.046821 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 07 12:36:41.046821 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6719dbcf-919f-43e8-a8f1-f531006986aj could not be found. Sep 07 12:36:41.046821 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:41.046821 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:41.046821 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:41.046821 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:41.046821 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:36:41.046821 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:36:41.046821 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:36:41.046821 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:36:41.046821 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:36:41.046821 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:36:41.046821 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:36:41.046821 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:36:41.054507 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 07 12:36:41.054507 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 12:36:41.054507 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 12:36:41.054507 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:41.054507 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:41.054507 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:41.054507 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:41.054507 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:36:41.054507 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:36:41.054507 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:36:41.054507 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:36:41.054507 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 12:36:41.054507 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:41.058573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9cc60386-4d04-4006-8ca6-e26ea71be910 tempest-ImagesDeleteNegativeTestJSON-1322228996 tempest-ImagesDeleteNegativeTestJSON-1322228996-project] Returning 404 to user: Image not found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:36:41.059818 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9cc60386-4d04-4006-8ca6-e26ea71be910 tempest-ImagesDeleteNegativeTestJSON-1322228996 tempest-ImagesDeleteNegativeTestJSON-1322228996-project] 10.222.0.16 "DELETE /compute/v2.1/images/6719dbcf-919f-43e8-a8f1-f531006986aj" status: 404 len: 62 microversion: 2.1 time: 0.139335 Sep 07 12:36:41.067522 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 942/1851] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:40 2022] DELETE /compute/v2.1/images/6719dbcf-919f-43e8-a8f1-f531006986aj => generated 62 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:36:41.082135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-873d56c8-56c7-43b9-9a30-571a11bfcc7e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41d2ef0d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:41.200065 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-873d56c8-56c7-43b9-9a30-571a11bfcc7e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.138083 Sep 07 12:36:41.201354 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 943/1852] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:41 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:41.213133 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f93b5cdc-b737-45eb-8b9b-0fd072991a16 tempest-ImagesDeleteNegativeTestJSON-1322228996 tempest-ImagesDeleteNegativeTestJSON-1322228996-project] Calling method '.version_select at 0x7fc41d109550>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:41.258722 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-f93b5cdc-b737-45eb-8b9b-0fd072991a16 tempest-ImagesDeleteNegativeTestJSON-1322228996 tempest-ImagesDeleteNegativeTestJSON-1322228996-project] HTTP exception thrown: Image not found. Sep 07 12:36:41.260824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f93b5cdc-b737-45eb-8b9b-0fd072991a16 tempest-ImagesDeleteNegativeTestJSON-1322228996 tempest-ImagesDeleteNegativeTestJSON-1322228996-project] Request method failure captured: Sep 07 12:36:41.260824 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/images/704e1290-bb13-44f3-bddf-723dbbe6147d1 HTTP/1.1 Sep 07 12:36:41.260824 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:36:41.260824 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:36:41.260824 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:36:41.260824 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:36:41.260824 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:36:41.260824 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:36:41.260824 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:36:41.260824 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:36:41.260824 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJBXX4VJgGDZ5scq4Tp-N1sVfUmNYujYl-anq0uU3uD52RTeZc4YTTvQSPRLRqi36B8aOOz37QrNnUAMnJnvixXcsEBSmFfKF9Ot-kE2ZR0RhgCQB7gnA8weQ0dRXGQSQ3_SqOpErnKZ7lvyMNYpBsZ2ulaLPyvs8lg-iAGSgZDamuw Sep 07 12:36:41.260824 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:36:41.260824 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:36:41.260824 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:36:41.260824 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:36:41.260824 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:36:41.260824 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:36:41.260824 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: e5c045c73b904984b5d73e13dab3b3a0 Sep 07 12:36:41.260824 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1322228996 Sep 07 12:36:41.260824 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:36:41.260824 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:36:41.264244 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e5c045c73b904984b5d73e13dab3b3a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e5c045c73b904984b5d73e13dab3b3a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e5c045c73b904984b5d73e13dab3b3a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e5c045c73b904984b5d73e13dab3b3a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:36:41.264244 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1322228996 Sep 07 12:36:41.264244 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: e5c045c73b904984b5d73e13dab3b3a0 Sep 07 12:36:41.264244 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1322228996 Sep 07 12:36:41.264244 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ImagesDeleteNegativeTestJSON-1322228996-project Sep 07 12:36:41.264244 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:36:41.264244 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:36:41.264244 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 75b4db82fe714425b8864023bd210d9c Sep 07 12:36:41.264244 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1322228996-project Sep 07 12:36:41.264244 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:36:41.264244 n-d-852087-9 devstack@n-api.service[122432]: exception: Image not found. Sep 07 12:36:41.264244 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '704e1290-bb13-44f3-bddf-723dbbe6147d1'} Sep 07 12:36:41.264244 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:36:41.266227 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:41.266227 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 07 12:36:41.266227 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 07 12:36:41.266227 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:36:41.266227 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:36:41.266227 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:36:41.266227 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:36:41.266227 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 07 12:36:41.266227 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 07 12:36:41.266227 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 07 12:36:41.266227 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 07 12:36:41.266227 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:36:41.266227 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:36:41.266227 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:36:41.266227 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:36:41.266227 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 704e1290-bb13-44f3-bddf-723dbbe6147d1 to delete Sep 07 12:36:41.266227 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:41.266227 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:41.266227 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:41.268922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:41.268922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 07 12:36:41.268922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 07 12:36:41.268922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 07 12:36:41.268922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 07 12:36:41.268922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 07 12:36:41.268922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 07 12:36:41.268922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 704e1290-bb13-44f3-bddf-723dbbe6147d1 could not be found. Sep 07 12:36:41.268922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:41.268922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:41.268922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:41.268922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:41.268922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:36:41.268922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:36:41.268922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:36:41.268922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:36:41.268922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:36:41.268922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:36:41.268922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:36:41.268922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:36:41.272968 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 07 12:36:41.272968 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 12:36:41.272968 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 12:36:41.272968 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:41.272968 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:41.272968 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:41.272968 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:41.272968 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:36:41.272968 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:36:41.272968 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:36:41.272968 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:36:41.272968 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 12:36:41.272968 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:41.272968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f93b5cdc-b737-45eb-8b9b-0fd072991a16 tempest-ImagesDeleteNegativeTestJSON-1322228996 tempest-ImagesDeleteNegativeTestJSON-1322228996-project] Returning 404 to user: Image not found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:36:41.272968 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f93b5cdc-b737-45eb-8b9b-0fd072991a16 tempest-ImagesDeleteNegativeTestJSON-1322228996 tempest-ImagesDeleteNegativeTestJSON-1322228996-project] 10.222.0.16 "DELETE /compute/v2.1/images/704e1290-bb13-44f3-bddf-723dbbe6147d1" status: 404 len: 62 microversion: 2.1 time: 0.059050 Sep 07 12:36:41.275665 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 944/1853] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:36:41 2022] DELETE /compute/v2.1/images/704e1290-bb13-44f3-bddf-723dbbe6147d1 => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:36:41.281245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8d002549-cdbc-4974-9bc5-6a3e558ff303 tempest-ImagesDeleteNegativeTestJSON-1322228996 tempest-ImagesDeleteNegativeTestJSON-1322228996-project] Calling method '.version_select at 0x7fc41888e040>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:41.352221 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-8d002549-cdbc-4974-9bc5-6a3e558ff303 tempest-ImagesDeleteNegativeTestJSON-1322228996 tempest-ImagesDeleteNegativeTestJSON-1322228996-project] HTTP exception thrown: Image not found. Sep 07 12:36:41.355320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8d002549-cdbc-4974-9bc5-6a3e558ff303 tempest-ImagesDeleteNegativeTestJSON-1322228996 tempest-ImagesDeleteNegativeTestJSON-1322228996-project] Request method failure captured: Sep 07 12:36:41.355320 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/images/tempest-invalid-2091891555 HTTP/1.1 Sep 07 12:36:41.355320 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:36:41.355320 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:36:41.355320 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:36:41.355320 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:36:41.355320 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:36:41.355320 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:36:41.355320 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:36:41.355320 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:36:41.355320 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJBXX4VJgGDZ5scq4Tp-N1sVfUmNYujYl-anq0uU3uD52RTeZc4YTTvQSPRLRqi36B8aOOz37QrNnUAMnJnvixXcsEBSmFfKF9Ot-kE2ZR0RhgCQB7gnA8weQ0dRXGQSQ3_SqOpErnKZ7lvyMNYpBsZ2ulaLPyvs8lg-iAGSgZDamuw Sep 07 12:36:41.355320 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:36:41.355320 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:36:41.355320 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:36:41.355320 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:36:41.355320 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:36:41.355320 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:36:41.355320 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: e5c045c73b904984b5d73e13dab3b3a0 Sep 07 12:36:41.355320 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1322228996 Sep 07 12:36:41.355320 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:36:41.355320 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:36:41.357036 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e5c045c73b904984b5d73e13dab3b3a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e5c045c73b904984b5d73e13dab3b3a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e5c045c73b904984b5d73e13dab3b3a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e5c045c73b904984b5d73e13dab3b3a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:36:41.357036 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1322228996 Sep 07 12:36:41.357036 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: e5c045c73b904984b5d73e13dab3b3a0 Sep 07 12:36:41.357036 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1322228996 Sep 07 12:36:41.357036 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ImagesDeleteNegativeTestJSON-1322228996-project Sep 07 12:36:41.357036 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:36:41.357036 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:36:41.357036 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 75b4db82fe714425b8864023bd210d9c Sep 07 12:36:41.357036 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1322228996-project Sep 07 12:36:41.357036 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:36:41.357036 n-d-852087-9 devstack@n-api.service[122432]: exception: Image not found. Sep 07 12:36:41.357036 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'tempest-invalid-2091891555'} Sep 07 12:36:41.357036 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:36:41.358188 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:41.358188 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 07 12:36:41.358188 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 07 12:36:41.358188 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:36:41.358188 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:36:41.358188 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:36:41.358188 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:36:41.358188 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 07 12:36:41.358188 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 07 12:36:41.358188 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 07 12:36:41.358188 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 07 12:36:41.358188 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:36:41.358188 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:36:41.358188 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:36:41.358188 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:36:41.358188 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-2091891555 to delete Sep 07 12:36:41.358188 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:41.358188 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:41.358188 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:41.359599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:41.359599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 07 12:36:41.359599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 07 12:36:41.359599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 07 12:36:41.359599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 07 12:36:41.359599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 07 12:36:41.359599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 07 12:36:41.359599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-2091891555 could not be found. Sep 07 12:36:41.359599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:41.359599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:41.359599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:41.359599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:41.359599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:36:41.359599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:36:41.359599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:36:41.359599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:36:41.359599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:36:41.359599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:36:41.359599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:36:41.359599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:36:41.373954 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 07 12:36:41.373954 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 12:36:41.373954 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 12:36:41.373954 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:41.373954 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:41.373954 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:41.373954 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:41.373954 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:36:41.373954 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:36:41.373954 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:36:41.373954 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:36:41.373954 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 12:36:41.373954 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:41.380315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8d002549-cdbc-4974-9bc5-6a3e558ff303 tempest-ImagesDeleteNegativeTestJSON-1322228996 tempest-ImagesDeleteNegativeTestJSON-1322228996-project] Returning 404 to user: Image not found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:36:41.381113 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8d002549-cdbc-4974-9bc5-6a3e558ff303 tempest-ImagesDeleteNegativeTestJSON-1322228996 tempest-ImagesDeleteNegativeTestJSON-1322228996-project] 10.222.0.16 "DELETE /compute/v2.1/images/tempest-invalid-2091891555" status: 404 len: 62 microversion: 2.1 time: 0.100896 Sep 07 12:36:41.382436 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 945/1854] 10.222.0.16 () {58 vars in 1206 bytes} [Wed Sep 7 12:36:41 2022] DELETE /compute/v2.1/images/tempest-invalid-2091891555 => generated 62 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:36:41.395771 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-662c69e8-d9e1-454d-942b-9b02c3401b03 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:41.396978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-662c69e8-d9e1-454d-942b-9b02c3401b03 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:41.405933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-662c69e8-d9e1-454d-942b-9b02c3401b03 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:41.407024 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-662c69e8-d9e1-454d-942b-9b02c3401b03 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:41.407732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-662c69e8-d9e1-454d-942b-9b02c3401b03 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:41.408733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-662c69e8-d9e1-454d-942b-9b02c3401b03 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:41.409596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-662c69e8-d9e1-454d-942b-9b02c3401b03 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:41.410423 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-662c69e8-d9e1-454d-942b-9b02c3401b03 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:42.150133 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-662c69e8-d9e1-454d-942b-9b02c3401b03 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:42.162024 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-662c69e8-d9e1-454d-942b-9b02c3401b03 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 0.770991 Sep 07 12:36:42.173094 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 946/1855] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:41 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:42.185078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-74e18ed5-3c06-4879-8d1f-11c8f32319c8 tempest-ImagesDeleteNegativeTestJSON-1322228996 tempest-ImagesDeleteNegativeTestJSON-1322228996-project] Calling method '.version_select at 0x7fc418863790>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:42.296198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-f51bb179-a3d8-4573-b155-bb6d4a953754 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lazy-loading 'services' on Instance uuid f070fedf-8028-43e3-97f9-8955e81dc84b {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:36:42.303077 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-74e18ed5-3c06-4879-8d1f-11c8f32319c8 tempest-ImagesDeleteNegativeTestJSON-1322228996 tempest-ImagesDeleteNegativeTestJSON-1322228996-project] HTTP exception thrown: Image not found. Sep 07 12:36:42.305308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-74e18ed5-3c06-4879-8d1f-11c8f32319c8 tempest-ImagesDeleteNegativeTestJSON-1322228996 tempest-ImagesDeleteNegativeTestJSON-1322228996-project] Request method failure captured: Sep 07 12:36:42.305308 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/images/887363cb-6d5f-473d-b2cb-c1b212092854 HTTP/1.1 Sep 07 12:36:42.305308 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:36:42.305308 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:36:42.305308 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:36:42.305308 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:36:42.305308 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:36:42.305308 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:36:42.305308 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:36:42.305308 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:36:42.305308 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJBXX4VJgGDZ5scq4Tp-N1sVfUmNYujYl-anq0uU3uD52RTeZc4YTTvQSPRLRqi36B8aOOz37QrNnUAMnJnvixXcsEBSmFfKF9Ot-kE2ZR0RhgCQB7gnA8weQ0dRXGQSQ3_SqOpErnKZ7lvyMNYpBsZ2ulaLPyvs8lg-iAGSgZDamuw Sep 07 12:36:42.305308 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:36:42.305308 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:36:42.305308 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:36:42.305308 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:36:42.305308 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:36:42.305308 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:36:42.305308 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: e5c045c73b904984b5d73e13dab3b3a0 Sep 07 12:36:42.305308 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1322228996 Sep 07 12:36:42.305308 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:36:42.305308 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:36:42.308554 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e5c045c73b904984b5d73e13dab3b3a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e5c045c73b904984b5d73e13dab3b3a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e5c045c73b904984b5d73e13dab3b3a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e5c045c73b904984b5d73e13dab3b3a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:36:42.308554 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1322228996 Sep 07 12:36:42.308554 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: e5c045c73b904984b5d73e13dab3b3a0 Sep 07 12:36:42.308554 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1322228996 Sep 07 12:36:42.308554 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ImagesDeleteNegativeTestJSON-1322228996-project Sep 07 12:36:42.308554 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:36:42.308554 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:36:42.308554 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 75b4db82fe714425b8864023bd210d9c Sep 07 12:36:42.308554 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1322228996-project Sep 07 12:36:42.308554 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:36:42.308554 n-d-852087-9 devstack@n-api.service[122432]: exception: Image not found. Sep 07 12:36:42.308554 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '887363cb-6d5f-473d-b2cb-c1b212092854'} Sep 07 12:36:42.308554 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:36:42.310554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:42.310554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 07 12:36:42.310554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 07 12:36:42.310554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:36:42.310554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:36:42.310554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:36:42.310554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:36:42.310554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 07 12:36:42.310554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 07 12:36:42.310554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 07 12:36:42.310554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 07 12:36:42.310554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:36:42.310554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:36:42.310554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:36:42.310554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:36:42.310554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 887363cb-6d5f-473d-b2cb-c1b212092854 to delete Sep 07 12:36:42.310554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:42.310554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:42.310554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:42.313469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:42.313469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 07 12:36:42.313469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 07 12:36:42.313469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 07 12:36:42.313469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 07 12:36:42.313469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 07 12:36:42.313469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 07 12:36:42.313469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 887363cb-6d5f-473d-b2cb-c1b212092854 could not be found. Sep 07 12:36:42.313469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:42.313469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:42.313469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:42.313469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:42.313469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:36:42.313469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:36:42.313469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:36:42.313469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:36:42.313469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:36:42.313469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:36:42.313469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:36:42.313469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:36:42.317172 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 07 12:36:42.317172 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 12:36:42.317172 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 12:36:42.317172 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:42.317172 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:36:42.317172 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:42.317172 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:36:42.317172 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:36:42.317172 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:36:42.317172 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:36:42.317172 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:36:42.317172 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 12:36:42.317172 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:36:42.317172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-74e18ed5-3c06-4879-8d1f-11c8f32319c8 tempest-ImagesDeleteNegativeTestJSON-1322228996 tempest-ImagesDeleteNegativeTestJSON-1322228996-project] Returning 404 to user: Image not found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:36:42.317172 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-74e18ed5-3c06-4879-8d1f-11c8f32319c8 tempest-ImagesDeleteNegativeTestJSON-1322228996 tempest-ImagesDeleteNegativeTestJSON-1322228996-project] 10.222.0.16 "DELETE /compute/v2.1/images/887363cb-6d5f-473d-b2cb-c1b212092854" status: 404 len: 62 microversion: 2.1 time: 0.135587 Sep 07 12:36:42.324248 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 947/1856] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:42 2022] DELETE /compute/v2.1/images/887363cb-6d5f-473d-b2cb-c1b212092854 => generated 62 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:36:42.324248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-333c9b83-2d59-4b93-a90a-b56388be7f74 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:42.324248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-333c9b83-2d59-4b93-a90a-b56388be7f74 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:42.364299 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f51bb179-a3d8-4573-b155-bb6d4a953754 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 2423 microversion: 2.25 time: 1.839535 Sep 07 12:36:42.366148 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 910/1857] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:36:40 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 2423 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:36:42.382574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c5780495-cbe7-4c6d-99e2-b255f9462fbc tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc418a5e8b0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:42.386830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-333c9b83-2d59-4b93-a90a-b56388be7f74 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:42.393422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-333c9b83-2d59-4b93-a90a-b56388be7f74 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:42.396684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-333c9b83-2d59-4b93-a90a-b56388be7f74 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:42.398127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-333c9b83-2d59-4b93-a90a-b56388be7f74 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:42.401235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-333c9b83-2d59-4b93-a90a-b56388be7f74 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:42.411864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-333c9b83-2d59-4b93-a90a-b56388be7f74 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:42.504635 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c5780495-cbe7-4c6d-99e2-b255f9462fbc tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.137014 Sep 07 12:36:42.505399 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 911/1858] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:42 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:42.520694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-21abaa16-ba5e-44cc-87dc-7a252b0ec0f0 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:42.521729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-21abaa16-ba5e-44cc-87dc-7a252b0ec0f0 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:42.536770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21abaa16-ba5e-44cc-87dc-7a252b0ec0f0 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:42.538198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21abaa16-ba5e-44cc-87dc-7a252b0ec0f0 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:42.541023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21abaa16-ba5e-44cc-87dc-7a252b0ec0f0 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:42.542716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21abaa16-ba5e-44cc-87dc-7a252b0ec0f0 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:42.543269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21abaa16-ba5e-44cc-87dc-7a252b0ec0f0 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:42.545121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21abaa16-ba5e-44cc-87dc-7a252b0ec0f0 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:42.745357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-333c9b83-2d59-4b93-a90a-b56388be7f74 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cead0c007d8545b3a32963668fbbe23e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e13a7ebce0646f8aea71d49eaa698d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:42.780110 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-333c9b83-2d59-4b93-a90a-b56388be7f74 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf" status: 200 len: 1290 microversion: 2.1 time: 0.465148 Sep 07 12:36:42.782318 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 948/1859] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:42 2022] GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf => generated 1290 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:43.218082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-36295f74-6630-4194-a301-fa00257e8b88 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:43.219716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-36295f74-6630-4194-a301-fa00257e8b88 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:43.238410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36295f74-6630-4194-a301-fa00257e8b88 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:43.245150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36295f74-6630-4194-a301-fa00257e8b88 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:43.247653 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36295f74-6630-4194-a301-fa00257e8b88 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:43.250868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36295f74-6630-4194-a301-fa00257e8b88 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:43.257910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36295f74-6630-4194-a301-fa00257e8b88 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:43.261030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36295f74-6630-4194-a301-fa00257e8b88 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:43.346122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-21abaa16-ba5e-44cc-87dc-7a252b0ec0f0 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lazy-loading 'services' on Instance uuid f070fedf-8028-43e3-97f9-8955e81dc84b {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:36:43.430032 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-21abaa16-ba5e-44cc-87dc-7a252b0ec0f0 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 2423 microversion: 2.25 time: 0.899258 Sep 07 12:36:43.432948 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 912/1860] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:36:42 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 2423 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:36:43.454069 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-20238045-86c7-492c-9258-85c713611851 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:43.463030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-20238045-86c7-492c-9258-85c713611851 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] [instance: e068f19a-c0b5-4648-be84-71deaa1b580e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:43.556994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20238045-86c7-492c-9258-85c713611851 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:43.567473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20238045-86c7-492c-9258-85c713611851 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:43.574312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20238045-86c7-492c-9258-85c713611851 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:43.575941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20238045-86c7-492c-9258-85c713611851 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:43.580790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20238045-86c7-492c-9258-85c713611851 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:43.589582 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20238045-86c7-492c-9258-85c713611851 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:45.027025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:36:45.155775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-20238045-86c7-492c-9258-85c713611851 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da21307adfcf48aca8a08c1ef316ff7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99763bdb3740a9af4a779ffc8238ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:45.188453 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-20238045-86c7-492c-9258-85c713611851 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] 10.222.0.16 "GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e" status: 200 len: 1589 microversion: 2.1 time: 1.747773 Sep 07 12:36:45.192275 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 913/1861] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:43 2022] GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e => generated 1589 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:45.210525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-ae07e7f0-5bcb-458b-9e6b-17a0ee185ab3 req-36417344-7e67-4fdd-a021-f72746937746 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e068f19a-c0b5-4648-be84-71deaa1b580e", "tag": "8f6bb4ac-83bd-4502-ad70-a17a49f4f319"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:36:45.253819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ae07e7f0-5bcb-458b-9e6b-17a0ee185ab3 req-36417344-7e67-4fdd-a021-f72746937746 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:45.265415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ae07e7f0-5bcb-458b-9e6b-17a0ee185ab3 req-36417344-7e67-4fdd-a021-f72746937746 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:45.267255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ae07e7f0-5bcb-458b-9e6b-17a0ee185ab3 req-36417344-7e67-4fdd-a021-f72746937746 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:45.281726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-36295f74-6630-4194-a301-fa00257e8b88 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:45.334589 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-36295f74-6630-4194-a301-fa00257e8b88 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 2.112733 Sep 07 12:36:45.336077 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 949/1862] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:43 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 2123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:36:45.336330 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ae07e7f0-5bcb-458b-9e6b-17a0ee185ab3 req-36417344-7e67-4fdd-a021-f72746937746 service nova] Creating event network-changed:8f6bb4ac-83bd-4502-ad70-a17a49f4f319 for instance e068f19a-c0b5-4648-be84-71deaa1b580e on n-h1-852087-9 Sep 07 12:36:45.362884 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-ae07e7f0-5bcb-458b-9e6b-17a0ee185ab3 req-36417344-7e67-4fdd-a021-f72746937746 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160867 Sep 07 12:36:45.364407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e060628-c9f8-40b6-8788-f3c6f2c7c2c3 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc418876310>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:45.370341 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 914/1863] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:45.388361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6dab8a5d-0483-457f-a07e-e36ea527910d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:45.392120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6dab8a5d-0483-457f-a07e-e36ea527910d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:45.409651 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dab8a5d-0483-457f-a07e-e36ea527910d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:45.410998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dab8a5d-0483-457f-a07e-e36ea527910d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:45.413427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dab8a5d-0483-457f-a07e-e36ea527910d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:45.417393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dab8a5d-0483-457f-a07e-e36ea527910d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:45.419500 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dab8a5d-0483-457f-a07e-e36ea527910d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:45.420674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dab8a5d-0483-457f-a07e-e36ea527910d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:45.526430 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2e060628-c9f8-40b6-8788-f3c6f2c7c2c3 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.187408 Sep 07 12:36:45.527951 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 950/1864] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:45 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:45.559948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f1b0f87d-ed36-443b-8a04-870ecd4be340 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:45.561428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f1b0f87d-ed36-443b-8a04-870ecd4be340 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:45.583459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1b0f87d-ed36-443b-8a04-870ecd4be340 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:45.584919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1b0f87d-ed36-443b-8a04-870ecd4be340 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:45.586322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1b0f87d-ed36-443b-8a04-870ecd4be340 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:45.589225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1b0f87d-ed36-443b-8a04-870ecd4be340 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:45.590740 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1b0f87d-ed36-443b-8a04-870ecd4be340 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:45.591875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1b0f87d-ed36-443b-8a04-870ecd4be340 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:45.831446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6dab8a5d-0483-457f-a07e-e36ea527910d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cead0c007d8545b3a32963668fbbe23e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e13a7ebce0646f8aea71d49eaa698d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:45.896259 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6dab8a5d-0483-457f-a07e-e36ea527910d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf" status: 200 len: 1290 microversion: 2.1 time: 0.520829 Sep 07 12:36:45.902964 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 915/1865] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:45 2022] GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf => generated 1290 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:46.020741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-f1b0f87d-ed36-443b-8a04-870ecd4be340 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lazy-loading 'services' on Instance uuid f070fedf-8028-43e3-97f9-8955e81dc84b {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:36:46.297763 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f1b0f87d-ed36-443b-8a04-870ecd4be340 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-volume_attachments/147ce838-e7e7-465e-813a-7cce3b867577" status: 202 len: 0 microversion: 2.25 time: 0.750008 Sep 07 12:36:46.306094 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 951/1866] 10.222.0.16 () {60 vars in 1457 bytes} [Wed Sep 7 12:36:45 2022] DELETE /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-volume_attachments/147ce838-e7e7-465e-813a-7cce3b867577 => generated 0 bytes in 772 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:36:46.318502 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-29ac8976-0b1d-40f5-9cfa-297f5a725480 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:46.332265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-29ac8976-0b1d-40f5-9cfa-297f5a725480 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:46.367784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29ac8976-0b1d-40f5-9cfa-297f5a725480 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:46.373271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29ac8976-0b1d-40f5-9cfa-297f5a725480 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:46.375139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29ac8976-0b1d-40f5-9cfa-297f5a725480 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:46.381918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29ac8976-0b1d-40f5-9cfa-297f5a725480 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:46.385886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29ac8976-0b1d-40f5-9cfa-297f5a725480 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:46.386999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29ac8976-0b1d-40f5-9cfa-297f5a725480 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:46.393973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dbac053e-1bb5-4be3-8202-e23242f9e346 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:46.395514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dbac053e-1bb5-4be3-8202-e23242f9e346 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:46.442485 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbac053e-1bb5-4be3-8202-e23242f9e346 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:46.460428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbac053e-1bb5-4be3-8202-e23242f9e346 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:46.481118 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbac053e-1bb5-4be3-8202-e23242f9e346 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:46.482685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbac053e-1bb5-4be3-8202-e23242f9e346 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:46.483902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbac053e-1bb5-4be3-8202-e23242f9e346 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:46.486315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbac053e-1bb5-4be3-8202-e23242f9e346 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:46.560935 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-29ac8976-0b1d-40f5-9cfa-297f5a725480 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.251104 Sep 07 12:36:46.565722 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 916/1867] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Sep 7 12:36:46 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-volume_attachments => generated 197 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 12:36:46.592087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d63cf20d-8cdf-4eeb-8ecd-b1c997414a11 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc418a00a60>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:46.774616 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d63cf20d-8cdf-4eeb-8ecd-b1c997414a11 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.204052 Sep 07 12:36:46.777552 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 917/1868] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:46 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:46.929688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae036966-7dbf-471c-8d21-0a6dea13b487 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:46.937821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ae036966-7dbf-471c-8d21-0a6dea13b487 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:46.976060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae036966-7dbf-471c-8d21-0a6dea13b487 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:46.986804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae036966-7dbf-471c-8d21-0a6dea13b487 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:46.988055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae036966-7dbf-471c-8d21-0a6dea13b487 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:46.989617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae036966-7dbf-471c-8d21-0a6dea13b487 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:46.998957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae036966-7dbf-471c-8d21-0a6dea13b487 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:47.000291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae036966-7dbf-471c-8d21-0a6dea13b487 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:47.193472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:36:47.349860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ae036966-7dbf-471c-8d21-0a6dea13b487 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cead0c007d8545b3a32963668fbbe23e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e13a7ebce0646f8aea71d49eaa698d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:47.379128 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ae036966-7dbf-471c-8d21-0a6dea13b487 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf" status: 200 len: 1290 microversion: 2.1 time: 0.457741 Sep 07 12:36:47.396075 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 918/1869] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:46 2022] GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf => generated 1290 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:47.563811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dbac053e-1bb5-4be3-8202-e23242f9e346 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:47.582482 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-70178cf8-911e-4205-b6c9-1233351e3905 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:47.586065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-70178cf8-911e-4205-b6c9-1233351e3905 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:47.595328 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dbac053e-1bb5-4be3-8202-e23242f9e346 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 1.214547 Sep 07 12:36:47.610647 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70178cf8-911e-4205-b6c9-1233351e3905 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:47.612034 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 952/1870] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:46 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:47.629322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70178cf8-911e-4205-b6c9-1233351e3905 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:47.629928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70178cf8-911e-4205-b6c9-1233351e3905 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:47.632890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70178cf8-911e-4205-b6c9-1233351e3905 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:47.635071 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70178cf8-911e-4205-b6c9-1233351e3905 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:47.636632 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70178cf8-911e-4205-b6c9-1233351e3905 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:47.765314 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-70178cf8-911e-4205-b6c9-1233351e3905 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.188042 Sep 07 12:36:47.768202 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 919/1871] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Sep 7 12:36:47 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:36:47.810634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-61f7a90a-6554-4650-b530-1e534195258f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41d24c160>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:48.037062 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-61f7a90a-6554-4650-b530-1e534195258f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.236511 Sep 07 12:36:48.059397 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 953/1872] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:47 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:48.408078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-076e4415-4b6f-4cf3-a5b8-e8b59d9cffc7 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:48.409325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-076e4415-4b6f-4cf3-a5b8-e8b59d9cffc7 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:48.444027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-076e4415-4b6f-4cf3-a5b8-e8b59d9cffc7 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:48.444749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-076e4415-4b6f-4cf3-a5b8-e8b59d9cffc7 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:48.445206 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-076e4415-4b6f-4cf3-a5b8-e8b59d9cffc7 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:48.453157 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-076e4415-4b6f-4cf3-a5b8-e8b59d9cffc7 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:48.453710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-076e4415-4b6f-4cf3-a5b8-e8b59d9cffc7 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:48.464687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-076e4415-4b6f-4cf3-a5b8-e8b59d9cffc7 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:48.649211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a8d392a4-f439-4bc8-8c08-fad7f5ac2c56 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:48.650765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a8d392a4-f439-4bc8-8c08-fad7f5ac2c56 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:48.686432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8d392a4-f439-4bc8-8c08-fad7f5ac2c56 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:48.687306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8d392a4-f439-4bc8-8c08-fad7f5ac2c56 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:48.688048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8d392a4-f439-4bc8-8c08-fad7f5ac2c56 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:48.689326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8d392a4-f439-4bc8-8c08-fad7f5ac2c56 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:48.690214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8d392a4-f439-4bc8-8c08-fad7f5ac2c56 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:48.694328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8d392a4-f439-4bc8-8c08-fad7f5ac2c56 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:50.290793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a8d392a4-f439-4bc8-8c08-fad7f5ac2c56 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:50.316437 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a8d392a4-f439-4bc8-8c08-fad7f5ac2c56 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 1.673698 Sep 07 12:36:50.320896 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 954/1873] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:48 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:50.348715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d45e42be-11fe-45f8-8234-6c338bc93fda tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:50.358315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d45e42be-11fe-45f8-8234-6c338bc93fda tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:50.401348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d45e42be-11fe-45f8-8234-6c338bc93fda tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:50.404627 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d45e42be-11fe-45f8-8234-6c338bc93fda tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:50.408797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d45e42be-11fe-45f8-8234-6c338bc93fda tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:50.411456 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d45e42be-11fe-45f8-8234-6c338bc93fda tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:50.419209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d45e42be-11fe-45f8-8234-6c338bc93fda tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:50.422443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d45e42be-11fe-45f8-8234-6c338bc93fda tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:50.528826 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d45e42be-11fe-45f8-8234-6c338bc93fda tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.204560 Sep 07 12:36:50.530308 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 955/1874] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Sep 7 12:36:50 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-volume_attachments => generated 197 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:36:50.544309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-54216bc7-df2f-474f-9989-92aa128e8b05 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc4195464c0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:50.644799 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-54216bc7-df2f-474f-9989-92aa128e8b05 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.112305 Sep 07 12:36:50.645936 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 956/1875] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:50 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:50.708688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-076e4415-4b6f-4cf3-a5b8-e8b59d9cffc7 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cead0c007d8545b3a32963668fbbe23e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e13a7ebce0646f8aea71d49eaa698d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:50.729177 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-076e4415-4b6f-4cf3-a5b8-e8b59d9cffc7 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf" status: 200 len: 1332 microversion: 2.1 time: 2.326164 Sep 07 12:36:50.736851 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 920/1876] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:48 2022] GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf => generated 1332 bytes in 2335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:51.032706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-76d3399b-750f-417c-81b0-daed39e385c1 tempest-ListImagesTestJSON-511274718 tempest-ListImagesTestJSON-511274718-project] Calling method '.version_select at 0x7fc41d2c0a60>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:51.142935 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-76d3399b-750f-417c-81b0-daed39e385c1 tempest-ListImagesTestJSON-511274718 tempest-ListImagesTestJSON-511274718-project] 10.222.0.16 "GET /compute/v2.1/images/a5dd2b4d-ee9d-44eb-b267-89e80edd276f" status: 200 len: 784 microversion: 2.1 time: 0.495551 Sep 07 12:36:51.157023 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 957/1877] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:50 2022] GET /compute/v2.1/images/a5dd2b4d-ee9d-44eb-b267-89e80edd276f => generated 784 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:51.182097 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-31d13045-a40e-47bb-a50d-98ed8d802d3d tempest-ListImagesTestJSON-511274718 tempest-ListImagesTestJSON-511274718-project] Calling method '.version_select at 0x7fc4189cfc10>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:51.353358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-55d58a0f-4a07-4f96-96bb-f2795afb762a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:51.354384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-55d58a0f-4a07-4f96-96bb-f2795afb762a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:51.377353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55d58a0f-4a07-4f96-96bb-f2795afb762a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:51.378217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55d58a0f-4a07-4f96-96bb-f2795afb762a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:51.378836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55d58a0f-4a07-4f96-96bb-f2795afb762a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:51.379850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55d58a0f-4a07-4f96-96bb-f2795afb762a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:51.380508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55d58a0f-4a07-4f96-96bb-f2795afb762a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:51.381113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55d58a0f-4a07-4f96-96bb-f2795afb762a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:51.520406 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-31d13045-a40e-47bb-a50d-98ed8d802d3d tempest-ListImagesTestJSON-511274718 tempest-ListImagesTestJSON-511274718-project] 10.222.0.16 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.348294 Sep 07 12:36:51.532835 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 921/1878] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 12:36:51 2022] GET /compute/v2.1/images => generated 445 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:51.550828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-603375bd-a415-4952-952a-f64977183031 tempest-ListImagesTestJSON-511274718 tempest-ListImagesTestJSON-511274718-project] Calling method '.version_select at 0x7fc4189cf8b0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:51.678578 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-603375bd-a415-4952-952a-f64977183031 tempest-ListImagesTestJSON-511274718 tempest-ListImagesTestJSON-511274718-project] 10.222.0.16 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.139659 Sep 07 12:36:51.693502 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 922/1879] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Sep 7 12:36:51 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:36:51.726315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c55ec3a2-83b2-45ed-b1cd-c802d0f82b3a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:51.754688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c55ec3a2-83b2-45ed-b1cd-c802d0f82b3a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:51.776619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=3,nova_api:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:36:51.782797 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c55ec3a2-83b2-45ed-b1cd-c802d0f82b3a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:51.787879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c55ec3a2-83b2-45ed-b1cd-c802d0f82b3a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:51.789271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c55ec3a2-83b2-45ed-b1cd-c802d0f82b3a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:51.795076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c55ec3a2-83b2-45ed-b1cd-c802d0f82b3a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:51.795869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c55ec3a2-83b2-45ed-b1cd-c802d0f82b3a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:51.796736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c55ec3a2-83b2-45ed-b1cd-c802d0f82b3a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:51.878922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:36:51.938541 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c55ec3a2-83b2-45ed-b1cd-c802d0f82b3a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.243458 Sep 07 12:36:51.945261 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 923/1880] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Sep 7 12:36:51 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-volume_attachments => generated 197 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:36:51.970107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-140641d6-3784-4c15-8b4f-ef2be7a708a1 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41d2cc1f0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:52.040387 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-55d58a0f-4a07-4f96-96bb-f2795afb762a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:52.044647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:36:52.078371 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-140641d6-3784-4c15-8b4f-ef2be7a708a1 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.131485 Sep 07 12:36:52.084221 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 924/1881] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:51 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:52.110939 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7d5a36d6-9b78-45f6-9469-3d23c13a565b tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:52.114245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7d5a36d6-9b78-45f6-9469-3d23c13a565b tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:52.117873 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-55d58a0f-4a07-4f96-96bb-f2795afb762a tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 0.768105 Sep 07 12:36:52.134379 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 958/1882] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:51 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:52.145547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d5a36d6-9b78-45f6-9469-3d23c13a565b tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:52.154832 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d5a36d6-9b78-45f6-9469-3d23c13a565b tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:52.155380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d5a36d6-9b78-45f6-9469-3d23c13a565b tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:52.159081 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d5a36d6-9b78-45f6-9469-3d23c13a565b tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:52.159817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d5a36d6-9b78-45f6-9469-3d23c13a565b tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:52.160045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d5a36d6-9b78-45f6-9469-3d23c13a565b tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:52.388482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-0165318e-e14d-43bc-9a7e-483414ce939e req-b733dc67-a944-4baf-af39-e958987ee05a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4472f1be-6441-4955-b1a0-934980853ccf", "tag": "d2cb7afc-63df-43ee-aefe-22e3a87e7b0d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:36:52.455916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0165318e-e14d-43bc-9a7e-483414ce939e req-b733dc67-a944-4baf-af39-e958987ee05a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:52.463066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0165318e-e14d-43bc-9a7e-483414ce939e req-b733dc67-a944-4baf-af39-e958987ee05a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:52.473122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0165318e-e14d-43bc-9a7e-483414ce939e req-b733dc67-a944-4baf-af39-e958987ee05a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:52.545171 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-0165318e-e14d-43bc-9a7e-483414ce939e req-b733dc67-a944-4baf-af39-e958987ee05a service nova] Creating event network-changed:d2cb7afc-63df-43ee-aefe-22e3a87e7b0d for instance 4472f1be-6441-4955-b1a0-934980853ccf on n-h2-852087-9 Sep 07 12:36:52.583942 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-0165318e-e14d-43bc-9a7e-483414ce939e req-b733dc67-a944-4baf-af39-e958987ee05a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192292 Sep 07 12:36:52.586830 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 959/1883] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:36:52.964832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-31b65781-f31d-488c-a022-0ff9f569d66f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:52.972548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-31b65781-f31d-488c-a022-0ff9f569d66f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:53.008521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31b65781-f31d-488c-a022-0ff9f569d66f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:53.014392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31b65781-f31d-488c-a022-0ff9f569d66f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:53.026459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31b65781-f31d-488c-a022-0ff9f569d66f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:53.029450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31b65781-f31d-488c-a022-0ff9f569d66f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:53.030835 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31b65781-f31d-488c-a022-0ff9f569d66f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:53.032272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31b65781-f31d-488c-a022-0ff9f569d66f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:53.116984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7d5a36d6-9b78-45f6-9469-3d23c13a565b tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cead0c007d8545b3a32963668fbbe23e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e13a7ebce0646f8aea71d49eaa698d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:53.134695 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7d5a36d6-9b78-45f6-9469-3d23c13a565b tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf" status: 200 len: 1332 microversion: 2.1 time: 1.047639 Sep 07 12:36:53.137298 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 925/1884] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:52 2022] GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf => generated 1332 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:53.148479 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7b763b9b-fdec-4211-ba2f-49e3078921a3 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc418a5eee0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:53.211346 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-31b65781-f31d-488c-a022-0ff9f569d66f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.257223 Sep 07 12:36:53.219782 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 960/1885] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Sep 7 12:36:52 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-volume_attachments => generated 197 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:36:53.241453 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-096402fc-be10-4bec-aa79-45dd1aabe769 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:53.243386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-096402fc-be10-4bec-aa79-45dd1aabe769 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:53.272556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-096402fc-be10-4bec-aa79-45dd1aabe769 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:53.294641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-096402fc-be10-4bec-aa79-45dd1aabe769 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:53.296987 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-096402fc-be10-4bec-aa79-45dd1aabe769 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:53.312332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-096402fc-be10-4bec-aa79-45dd1aabe769 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:53.317990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-096402fc-be10-4bec-aa79-45dd1aabe769 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:53.319468 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-096402fc-be10-4bec-aa79-45dd1aabe769 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:53.417825 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7b763b9b-fdec-4211-ba2f-49e3078921a3 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.277772 Sep 07 12:36:53.421228 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 926/1886] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:53 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:54.165191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-096402fc-be10-4bec-aa79-45dd1aabe769 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:54.242420 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-096402fc-be10-4bec-aa79-45dd1aabe769 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 1.016667 Sep 07 12:36:54.246278 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 961/1887] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:53 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:54.272671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0592c67d-8baa-4b38-b8e6-1f4c78a5ab1a tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:54.279205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0592c67d-8baa-4b38-b8e6-1f4c78a5ab1a tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:54.308554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0592c67d-8baa-4b38-b8e6-1f4c78a5ab1a tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:54.319662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0592c67d-8baa-4b38-b8e6-1f4c78a5ab1a tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:54.320984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0592c67d-8baa-4b38-b8e6-1f4c78a5ab1a tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:54.326496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0592c67d-8baa-4b38-b8e6-1f4c78a5ab1a tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:54.330629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0592c67d-8baa-4b38-b8e6-1f4c78a5ab1a tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:54.331907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0592c67d-8baa-4b38-b8e6-1f4c78a5ab1a tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:54.695168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8407d3cd-06f8-44c7-b5e0-9a680c3e7e45 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2035903562", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "e919c9e1-6167-41ae-bc57-c4b7bc4c8d07"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:36:54.818580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-8407d3cd-06f8-44c7-b5e0-9a680c3e7e45 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] validate_networks() for [('e919c9e1-6167-41ae-bc57-c4b7bc4c8d07', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:36:55.051118 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0592c67d-8baa-4b38-b8e6-1f4c78a5ab1a tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cead0c007d8545b3a32963668fbbe23e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e13a7ebce0646f8aea71d49eaa698d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:55.066673 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0592c67d-8baa-4b38-b8e6-1f4c78a5ab1a tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf" status: 200 len: 1332 microversion: 2.1 time: 0.814204 Sep 07 12:36:55.067721 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 962/1888] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:54 2022] GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf => generated 1332 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:55.076912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e3bc39f1-6765-4670-8122-6b6815ae29d6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:55.085926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e3bc39f1-6765-4670-8122-6b6815ae29d6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:55.103641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3bc39f1-6765-4670-8122-6b6815ae29d6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:55.104637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3bc39f1-6765-4670-8122-6b6815ae29d6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:55.105644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3bc39f1-6765-4670-8122-6b6815ae29d6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:55.106644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3bc39f1-6765-4670-8122-6b6815ae29d6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:55.107304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3bc39f1-6765-4670-8122-6b6815ae29d6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:55.107921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3bc39f1-6765-4670-8122-6b6815ae29d6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:55.147524 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e3bc39f1-6765-4670-8122-6b6815ae29d6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.078031 Sep 07 12:36:55.148996 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 963/1889] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Sep 7 12:36:55 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:36:55.154268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bfea9f21-3cd9-435b-91af-ed96f36c6d1f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41941a550>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:55.322953 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bfea9f21-3cd9-435b-91af-ed96f36c6d1f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.172007 Sep 07 12:36:55.347229 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 964/1890] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:55 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:55.370245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7206b6d1-fc08-4011-9dea-3c00cade47c6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:55.377356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7206b6d1-fc08-4011-9dea-3c00cade47c6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:55.417781 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7206b6d1-fc08-4011-9dea-3c00cade47c6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:55.418909 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7206b6d1-fc08-4011-9dea-3c00cade47c6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:55.419932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7206b6d1-fc08-4011-9dea-3c00cade47c6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:55.421404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7206b6d1-fc08-4011-9dea-3c00cade47c6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:55.422297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7206b6d1-fc08-4011-9dea-3c00cade47c6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:55.423075 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7206b6d1-fc08-4011-9dea-3c00cade47c6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:56.473691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7206b6d1-fc08-4011-9dea-3c00cade47c6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:56.529021 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7206b6d1-fc08-4011-9dea-3c00cade47c6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 1.174109 Sep 07 12:36:56.537961 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 965/1891] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:55 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:56.603429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-69b4c5b4-59a9-49be-bc7f-d334e2abeabf tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:56.616220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-69b4c5b4-59a9-49be-bc7f-d334e2abeabf tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:56.624020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:36:56.653292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69b4c5b4-59a9-49be-bc7f-d334e2abeabf tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:56.653906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69b4c5b4-59a9-49be-bc7f-d334e2abeabf tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:56.654400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69b4c5b4-59a9-49be-bc7f-d334e2abeabf tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:56.655213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69b4c5b4-59a9-49be-bc7f-d334e2abeabf tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:56.655703 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69b4c5b4-59a9-49be-bc7f-d334e2abeabf tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:56.656159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69b4c5b4-59a9-49be-bc7f-d334e2abeabf tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:57.296744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8407d3cd-06f8-44c7-b5e0-9a680c3e7e45 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:36:57.298444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8407d3cd-06f8-44c7-b5e0-9a680c3e7e45 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:36:57.299257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8407d3cd-06f8-44c7-b5e0-9a680c3e7e45 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:36:57.299692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8407d3cd-06f8-44c7-b5e0-9a680c3e7e45 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:36:57.300341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8407d3cd-06f8-44c7-b5e0-9a680c3e7e45 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:36:57.339550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8407d3cd-06f8-44c7-b5e0-9a680c3e7e45 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:57.341843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8407d3cd-06f8-44c7-b5e0-9a680c3e7e45 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:57.344531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8407d3cd-06f8-44c7-b5e0-9a680c3e7e45 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:57.350889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8407d3cd-06f8-44c7-b5e0-9a680c3e7e45 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:57.356010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8407d3cd-06f8-44c7-b5e0-9a680c3e7e45 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:57.358121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8407d3cd-06f8-44c7-b5e0-9a680c3e7e45 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:57.433641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-8407d3cd-06f8-44c7-b5e0-9a680c3e7e45 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Getting quotas for project dc00ac02c77f40f5ab6acbe538c9566b. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:36:57.453687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-8407d3cd-06f8-44c7-b5e0-9a680c3e7e45 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Getting quotas for user 41979e405fab49029d8ff5a9903e36ea and project dc00ac02c77f40f5ab6acbe538c9566b. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:36:57.465530 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-69b4c5b4-59a9-49be-bc7f-d334e2abeabf tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cead0c007d8545b3a32963668fbbe23e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e13a7ebce0646f8aea71d49eaa698d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:57.487121 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-69b4c5b4-59a9-49be-bc7f-d334e2abeabf tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf" status: 200 len: 1332 microversion: 2.1 time: 0.946012 Sep 07 12:36:57.491356 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 966/1892] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:56 2022] GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf => generated 1332 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:57.500088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5c843d89-8275-4177-ae8d-77ad5acfaf73 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:57.505165 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5c843d89-8275-4177-ae8d-77ad5acfaf73 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:57.514760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c843d89-8275-4177-ae8d-77ad5acfaf73 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:57.516219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c843d89-8275-4177-ae8d-77ad5acfaf73 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:57.516871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c843d89-8275-4177-ae8d-77ad5acfaf73 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:57.525995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8407d3cd-06f8-44c7-b5e0-9a680c3e7e45 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:36:57.529026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8407d3cd-06f8-44c7-b5e0-9a680c3e7e45 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:36:57.529636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c843d89-8275-4177-ae8d-77ad5acfaf73 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:57.544270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c843d89-8275-4177-ae8d-77ad5acfaf73 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:57.547379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c843d89-8275-4177-ae8d-77ad5acfaf73 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:57.653574 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5c843d89-8275-4177-ae8d-77ad5acfaf73 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.160516 Sep 07 12:36:57.662284 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 967/1893] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Sep 7 12:36:57 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:36:57.674396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a8f212fc-58a5-4a6b-b513-3807f21a1184 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41d226670>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:57.702812 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8407d3cd-06f8-44c7-b5e0-9a680c3e7e45 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.662940 Sep 07 12:36:57.733215 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 927/1894] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:36:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 12:36:57.811899 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a8f212fc-58a5-4a6b-b513-3807f21a1184 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.142874 Sep 07 12:36:57.813909 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 968/1895] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:36:57 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:57.819252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5895dc9f-a267-479f-8d13-ffd457f1dcd0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:57.832911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5895dc9f-a267-479f-8d13-ffd457f1dcd0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:57.847239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5895dc9f-a267-479f-8d13-ffd457f1dcd0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:57.850913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5895dc9f-a267-479f-8d13-ffd457f1dcd0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:57.852843 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5895dc9f-a267-479f-8d13-ffd457f1dcd0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:57.856155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5895dc9f-a267-479f-8d13-ffd457f1dcd0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:57.856902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5895dc9f-a267-479f-8d13-ffd457f1dcd0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:57.859640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5895dc9f-a267-479f-8d13-ffd457f1dcd0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:58.188465 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5d51ce59-aa7e-4ecc-8b53-ff8d19895a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2071815684", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "80d51306-dbb8-4c2e-bca9-60970c39d44b"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:36:58.347408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5895dc9f-a267-479f-8d13-ffd457f1dcd0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:58.362249 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5895dc9f-a267-479f-8d13-ffd457f1dcd0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 0.546899 Sep 07 12:36:58.370120 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 969/1896] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:57 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:58.381995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-5d51ce59-aa7e-4ecc-8b53-ff8d19895a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] validate_networks() for [('80d51306-dbb8-4c2e-bca9-60970c39d44b', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:36:58.429142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-77d3fd12-660d-4772-a7a6-2e4f35e617fe tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:58.435325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-77d3fd12-660d-4772-a7a6-2e4f35e617fe tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:58.785757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-77d3fd12-660d-4772-a7a6-2e4f35e617fe tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41979e405fab49029d8ff5a9903e36ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00ac02c77f40f5ab6acbe538c9566b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:36:58.843545 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-77d3fd12-660d-4772-a7a6-2e4f35e617fe tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa" status: 200 len: 1224 microversion: 2.1 time: 0.469301 Sep 07 12:36:58.844839 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 970/1897] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:58 2022] GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa => generated 1224 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:36:58.879581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ffe8235f-5881-45b4-af1a-7e213e60f9bc tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:36:58.880550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ffe8235f-5881-45b4-af1a-7e213e60f9bc tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:36:58.899849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffe8235f-5881-45b4-af1a-7e213e60f9bc tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:58.901129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffe8235f-5881-45b4-af1a-7e213e60f9bc tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:58.901832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffe8235f-5881-45b4-af1a-7e213e60f9bc tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:36:58.903129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffe8235f-5881-45b4-af1a-7e213e60f9bc tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:36:58.908580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffe8235f-5881-45b4-af1a-7e213e60f9bc tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:36:58.910293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffe8235f-5881-45b4-af1a-7e213e60f9bc tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:00.124079 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ffe8235f-5881-45b4-af1a-7e213e60f9bc tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cead0c007d8545b3a32963668fbbe23e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e13a7ebce0646f8aea71d49eaa698d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:00.156923 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ffe8235f-5881-45b4-af1a-7e213e60f9bc tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf" status: 200 len: 1332 microversion: 2.1 time: 1.306063 Sep 07 12:37:00.158687 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 971/1898] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:36:58 2022] GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf => generated 1332 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:00.180039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-afdd848b-a6e4-4e16-abd5-2f269c2feb30 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:00.194567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-afdd848b-a6e4-4e16-abd5-2f269c2feb30 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:00.231117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afdd848b-a6e4-4e16-abd5-2f269c2feb30 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:00.232715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afdd848b-a6e4-4e16-abd5-2f269c2feb30 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:00.237785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afdd848b-a6e4-4e16-abd5-2f269c2feb30 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:00.240164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afdd848b-a6e4-4e16-abd5-2f269c2feb30 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:00.252151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afdd848b-a6e4-4e16-abd5-2f269c2feb30 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:00.253589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afdd848b-a6e4-4e16-abd5-2f269c2feb30 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:00.398383 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-afdd848b-a6e4-4e16-abd5-2f269c2feb30 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.206264 Sep 07 12:37:00.412454 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 972/1899] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Sep 7 12:37:00 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-volume_attachments => generated 197 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:37:00.446135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ab985ebc-1675-4a19-99f3-ba81aaead009 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41941ad30>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:00.623324 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ab985ebc-1675-4a19-99f3-ba81aaead009 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.208010 Sep 07 12:37:00.627952 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 973/1900] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:37:00 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:00.656761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e700f790-3904-4904-be55-92e4e99df7a0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:00.669228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e700f790-3904-4904-be55-92e4e99df7a0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:00.686821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-5d51ce59-aa7e-4ecc-8b53-ff8d19895a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:37:00.688503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-5d51ce59-aa7e-4ecc-8b53-ff8d19895a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:37:00.689677 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-5d51ce59-aa7e-4ecc-8b53-ff8d19895a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:37:00.691726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-5d51ce59-aa7e-4ecc-8b53-ff8d19895a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:37:00.692874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-5d51ce59-aa7e-4ecc-8b53-ff8d19895a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:37:00.698931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e700f790-3904-4904-be55-92e4e99df7a0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:00.705218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e700f790-3904-4904-be55-92e4e99df7a0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:00.706351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e700f790-3904-4904-be55-92e4e99df7a0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:00.707665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e700f790-3904-4904-be55-92e4e99df7a0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:00.713529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e700f790-3904-4904-be55-92e4e99df7a0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:00.714607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e700f790-3904-4904-be55-92e4e99df7a0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:00.721093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d51ce59-aa7e-4ecc-8b53-ff8d19895a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:00.724120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d51ce59-aa7e-4ecc-8b53-ff8d19895a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:00.726199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d51ce59-aa7e-4ecc-8b53-ff8d19895a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:00.734077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d51ce59-aa7e-4ecc-8b53-ff8d19895a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:00.735772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d51ce59-aa7e-4ecc-8b53-ff8d19895a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:00.736462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d51ce59-aa7e-4ecc-8b53-ff8d19895a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:00.789901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-5d51ce59-aa7e-4ecc-8b53-ff8d19895a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Getting quotas for project ef5b2dd007e944358d72268414868096. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:37:00.806217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-5d51ce59-aa7e-4ecc-8b53-ff8d19895a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Getting quotas for user b920811be01745fc9faea7a9ce213c6e and project ef5b2dd007e944358d72268414868096. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:37:00.867855 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5d51ce59-aa7e-4ecc-8b53-ff8d19895a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:37:00.872286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5d51ce59-aa7e-4ecc-8b53-ff8d19895a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: b05fbd40-21c6-4c6c-9039-887cf2b9e6d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:37:00.992484 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5d51ce59-aa7e-4ecc-8b53-ff8d19895a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.257518 Sep 07 12:37:00.993693 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 928/1901] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:36:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 3260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:37:01.006091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a95a8d3b-4dc7-476d-b39a-a7c82e4abfe1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:01.007149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a95a8d3b-4dc7-476d-b39a-a7c82e4abfe1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:01.017575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a95a8d3b-4dc7-476d-b39a-a7c82e4abfe1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:01.026041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a95a8d3b-4dc7-476d-b39a-a7c82e4abfe1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:01.027507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a95a8d3b-4dc7-476d-b39a-a7c82e4abfe1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:01.028553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a95a8d3b-4dc7-476d-b39a-a7c82e4abfe1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:01.029295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a95a8d3b-4dc7-476d-b39a-a7c82e4abfe1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:01.030031 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a95a8d3b-4dc7-476d-b39a-a7c82e4abfe1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:01.184579 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e700f790-3904-4904-be55-92e4e99df7a0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:01.225342 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e700f790-3904-4904-be55-92e4e99df7a0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 0.595445 Sep 07 12:37:01.233638 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 974/1902] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:00 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:01.248629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fe70569b-1ea0-4080-a4be-465b989b499c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:01.258786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fe70569b-1ea0-4080-a4be-465b989b499c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: b05fbd40-21c6-4c6c-9039-887cf2b9e6d8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:01.365689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a95a8d3b-4dc7-476d-b39a-a7c82e4abfe1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41979e405fab49029d8ff5a9903e36ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00ac02c77f40f5ab6acbe538c9566b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:01.380493 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a95a8d3b-4dc7-476d-b39a-a7c82e4abfe1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa" status: 200 len: 1276 microversion: 2.1 time: 0.385306 Sep 07 12:37:01.390338 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 929/1903] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:00 2022] GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa => generated 1276 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:01.407947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-118bbb91-3369-40b1-9106-77c8e3bd399c tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:01.421706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-118bbb91-3369-40b1-9106-77c8e3bd399c tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:01.437363 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-118bbb91-3369-40b1-9106-77c8e3bd399c tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:01.465409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-118bbb91-3369-40b1-9106-77c8e3bd399c tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:01.467854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-118bbb91-3369-40b1-9106-77c8e3bd399c tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:01.470669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-118bbb91-3369-40b1-9106-77c8e3bd399c tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:01.471226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-118bbb91-3369-40b1-9106-77c8e3bd399c tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:01.471698 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-118bbb91-3369-40b1-9106-77c8e3bd399c tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:01.480042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fe70569b-1ea0-4080-a4be-465b989b499c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:01.489094 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fe70569b-1ea0-4080-a4be-465b989b499c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8" status: 200 len: 1215 microversion: 2.1 time: 0.253682 Sep 07 12:37:01.491859 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 975/1904] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:01 2022] GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 => generated 1215 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:01.499310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f6318bec-5e91-4d67-940f-5d58cca2aba9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:01.515011 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f6318bec-5e91-4d67-940f-5d58cca2aba9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:01.555927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6318bec-5e91-4d67-940f-5d58cca2aba9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:01.558865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6318bec-5e91-4d67-940f-5d58cca2aba9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:01.564206 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6318bec-5e91-4d67-940f-5d58cca2aba9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:01.565626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6318bec-5e91-4d67-940f-5d58cca2aba9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:01.572023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6318bec-5e91-4d67-940f-5d58cca2aba9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:01.574084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6318bec-5e91-4d67-940f-5d58cca2aba9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:01.772306 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f6318bec-5e91-4d67-940f-5d58cca2aba9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.276776 Sep 07 12:37:01.778374 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 976/1905] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Sep 7 12:37:01 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-volume_attachments => generated 197 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:37:01.801794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-83cf3d9e-5db4-4b3e-aca4-15bc27bf5872 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41d24c670>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:02.132147 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-83cf3d9e-5db4-4b3e-aca4-15bc27bf5872 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.349999 Sep 07 12:37:02.149473 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 977/1906] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:37:01 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:02.183791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-118bbb91-3369-40b1-9106-77c8e3bd399c tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cead0c007d8545b3a32963668fbbe23e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e13a7ebce0646f8aea71d49eaa698d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:02.200533 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-118bbb91-3369-40b1-9106-77c8e3bd399c tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf" status: 200 len: 1332 microversion: 2.1 time: 0.808476 Sep 07 12:37:02.206232 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 930/1907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:01 2022] GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf => generated 1332 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:02.262411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-99321ce2-401b-4666-8d29-a69e6b967143 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:02.270552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-99321ce2-401b-4666-8d29-a69e6b967143 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:02.328112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99321ce2-401b-4666-8d29-a69e6b967143 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:02.328800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99321ce2-401b-4666-8d29-a69e6b967143 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:02.329928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99321ce2-401b-4666-8d29-a69e6b967143 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:02.331538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99321ce2-401b-4666-8d29-a69e6b967143 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:02.332521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99321ce2-401b-4666-8d29-a69e6b967143 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:02.333436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99321ce2-401b-4666-8d29-a69e6b967143 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:02.425673 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5b36a470-6f0e-4488-a88c-40ef45f3ad33 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:02.426910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5b36a470-6f0e-4488-a88c-40ef45f3ad33 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:02.439567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b36a470-6f0e-4488-a88c-40ef45f3ad33 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:02.443245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b36a470-6f0e-4488-a88c-40ef45f3ad33 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:02.444142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b36a470-6f0e-4488-a88c-40ef45f3ad33 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:02.453467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b36a470-6f0e-4488-a88c-40ef45f3ad33 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:02.454843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b36a470-6f0e-4488-a88c-40ef45f3ad33 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:02.455649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b36a470-6f0e-4488-a88c-40ef45f3ad33 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:03.054455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5b36a470-6f0e-4488-a88c-40ef45f3ad33 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41979e405fab49029d8ff5a9903e36ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00ac02c77f40f5ab6acbe538c9566b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:03.095192 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5b36a470-6f0e-4488-a88c-40ef45f3ad33 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa" status: 200 len: 1282 microversion: 2.1 time: 0.673460 Sep 07 12:37:03.096260 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 931/1908] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:02 2022] GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa => generated 1282 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:37:03.127783 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1c2326e5-ed87-452b-94b5-8481352cecfa tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:03.128893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1c2326e5-ed87-452b-94b5-8481352cecfa tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: b05fbd40-21c6-4c6c-9039-887cf2b9e6d8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:03.179992 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c2326e5-ed87-452b-94b5-8481352cecfa tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:03.202649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c2326e5-ed87-452b-94b5-8481352cecfa tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:03.207015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c2326e5-ed87-452b-94b5-8481352cecfa tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:03.208856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c2326e5-ed87-452b-94b5-8481352cecfa tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:03.210109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c2326e5-ed87-452b-94b5-8481352cecfa tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:03.211150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c2326e5-ed87-452b-94b5-8481352cecfa tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:03.564474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-99321ce2-401b-4666-8d29-a69e6b967143 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:03.579546 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-99321ce2-401b-4666-8d29-a69e6b967143 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 1.326417 Sep 07 12:37:03.601674 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 978/1909] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:02 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:37:03.627402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1c2326e5-ed87-452b-94b5-8481352cecfa tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:03.634311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-615ada0f-8f37-43d7-b27d-c054b50f49c5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:03.644055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-615ada0f-8f37-43d7-b27d-c054b50f49c5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:03.646283 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1c2326e5-ed87-452b-94b5-8481352cecfa tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8" status: 200 len: 1219 microversion: 2.1 time: 0.540490 Sep 07 12:37:03.654722 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 932/1910] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:03 2022] GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 => generated 1219 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:03.671424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-89e23172-f2b2-4696-b599-4b284f958946 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc418a26d30>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:03.686675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-615ada0f-8f37-43d7-b27d-c054b50f49c5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:03.687919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-615ada0f-8f37-43d7-b27d-c054b50f49c5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:03.708028 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-615ada0f-8f37-43d7-b27d-c054b50f49c5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:03.713310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-615ada0f-8f37-43d7-b27d-c054b50f49c5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:03.713910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-615ada0f-8f37-43d7-b27d-c054b50f49c5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:03.714360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-615ada0f-8f37-43d7-b27d-c054b50f49c5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:03.817110 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-89e23172-f2b2-4696-b599-4b284f958946 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1411 microversion: 2.1 time: 0.156715 Sep 07 12:37:03.818835 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-615ada0f-8f37-43d7-b27d-c054b50f49c5 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.215801 Sep 07 12:37:03.821755 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 933/1911] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:37:03 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1411 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:03.828114 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 979/1912] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Sep 7 12:37:03 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-volume_attachments => generated 197 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:37:03.836167 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-6302944f-b8ff-4f2f-8951-c098dcdf7714 req-6060d3c5-6a9f-46a6-8cd2-fd8381d94b8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4472f1be-6441-4955-b1a0-934980853ccf", "name": "network-vif-plugged", "status": "completed", "tag": "d2cb7afc-63df-43ee-aefe-22e3a87e7b0d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:03.850051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6302944f-b8ff-4f2f-8951-c098dcdf7714 req-6060d3c5-6a9f-46a6-8cd2-fd8381d94b8e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:03.854297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6302944f-b8ff-4f2f-8951-c098dcdf7714 req-6060d3c5-6a9f-46a6-8cd2-fd8381d94b8e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:03.854552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9cbc7a14-9d5b-411e-bf85-1b8f8aa7ee49 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:03.855211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6302944f-b8ff-4f2f-8951-c098dcdf7714 req-6060d3c5-6a9f-46a6-8cd2-fd8381d94b8e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:03.857149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9cbc7a14-9d5b-411e-bf85-1b8f8aa7ee49 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:03.891536 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-6302944f-b8ff-4f2f-8951-c098dcdf7714 req-6060d3c5-6a9f-46a6-8cd2-fd8381d94b8e service nova] Creating event network-vif-plugged:d2cb7afc-63df-43ee-aefe-22e3a87e7b0d for instance 4472f1be-6441-4955-b1a0-934980853ccf on n-h2-852087-9 Sep 07 12:37:03.902463 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-6302944f-b8ff-4f2f-8951-c098dcdf7714 req-6060d3c5-6a9f-46a6-8cd2-fd8381d94b8e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072580 Sep 07 12:37:03.903061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cbc7a14-9d5b-411e-bf85-1b8f8aa7ee49 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:03.903967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cbc7a14-9d5b-411e-bf85-1b8f8aa7ee49 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:03.906906 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 980/1913] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:03.907143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cbc7a14-9d5b-411e-bf85-1b8f8aa7ee49 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:03.912031 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cbc7a14-9d5b-411e-bf85-1b8f8aa7ee49 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:03.916156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cbc7a14-9d5b-411e-bf85-1b8f8aa7ee49 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:03.922796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cbc7a14-9d5b-411e-bf85-1b8f8aa7ee49 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:04.143911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c02f02f1-2cbe-4174-99fd-eba64c39d867 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:04.151463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c02f02f1-2cbe-4174-99fd-eba64c39d867 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:04.196139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c02f02f1-2cbe-4174-99fd-eba64c39d867 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:04.203367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c02f02f1-2cbe-4174-99fd-eba64c39d867 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:04.204738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c02f02f1-2cbe-4174-99fd-eba64c39d867 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:04.206481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c02f02f1-2cbe-4174-99fd-eba64c39d867 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:04.213911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c02f02f1-2cbe-4174-99fd-eba64c39d867 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:04.215314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c02f02f1-2cbe-4174-99fd-eba64c39d867 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:05.027900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c02f02f1-2cbe-4174-99fd-eba64c39d867 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41979e405fab49029d8ff5a9903e36ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00ac02c77f40f5ab6acbe538c9566b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:05.046353 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c02f02f1-2cbe-4174-99fd-eba64c39d867 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa" status: 200 len: 1282 microversion: 2.1 time: 0.920289 Sep 07 12:37:05.047789 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 981/1914] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:04 2022] GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa => generated 1282 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:37:05.053671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-363263f0-4d7e-4e38-98ac-1dbb84a62bad tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:05.060493 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-363263f0-4d7e-4e38-98ac-1dbb84a62bad tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:05.093171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-363263f0-4d7e-4e38-98ac-1dbb84a62bad tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:05.098352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-363263f0-4d7e-4e38-98ac-1dbb84a62bad tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:05.099105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-363263f0-4d7e-4e38-98ac-1dbb84a62bad tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:05.103465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-363263f0-4d7e-4e38-98ac-1dbb84a62bad tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:05.104622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-363263f0-4d7e-4e38-98ac-1dbb84a62bad tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:05.105273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-363263f0-4d7e-4e38-98ac-1dbb84a62bad tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:05.557100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9cbc7a14-9d5b-411e-bf85-1b8f8aa7ee49 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cead0c007d8545b3a32963668fbbe23e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e13a7ebce0646f8aea71d49eaa698d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:05.604950 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9cbc7a14-9d5b-411e-bf85-1b8f8aa7ee49 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf" status: 200 len: 1332 microversion: 2.1 time: 1.764369 Sep 07 12:37:05.606312 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 934/1915] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:03 2022] GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf => generated 1332 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:05.663785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-25d3d6b8-c4ae-4fde-ac9c-7e44bfd64a0b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:05.664754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-25d3d6b8-c4ae-4fde-ac9c-7e44bfd64a0b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: b05fbd40-21c6-4c6c-9039-887cf2b9e6d8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:05.727803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25d3d6b8-c4ae-4fde-ac9c-7e44bfd64a0b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:05.728791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25d3d6b8-c4ae-4fde-ac9c-7e44bfd64a0b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:05.729603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25d3d6b8-c4ae-4fde-ac9c-7e44bfd64a0b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:05.739354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25d3d6b8-c4ae-4fde-ac9c-7e44bfd64a0b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:05.740533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25d3d6b8-c4ae-4fde-ac9c-7e44bfd64a0b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:05.741774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25d3d6b8-c4ae-4fde-ac9c-7e44bfd64a0b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:06.022752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-25d3d6b8-c4ae-4fde-ac9c-7e44bfd64a0b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:06.066618 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-25d3d6b8-c4ae-4fde-ac9c-7e44bfd64a0b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8" status: 200 len: 1285 microversion: 2.1 time: 0.403318 Sep 07 12:37:06.069563 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 935/1916] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:05 2022] GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 => generated 1285 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:06.079150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d768a575-653d-4af4-a141-7bbc306f5d15 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc4189dfca0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:06.188346 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d768a575-653d-4af4-a141-7bbc306f5d15 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1420 microversion: 2.1 time: 0.116009 Sep 07 12:37:06.201842 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 936/1917] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:37:06 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:06.218116 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1dc6406f-ac1b-459b-8575-e7abc4bd62ba tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:06.226932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1dc6406f-ac1b-459b-8575-e7abc4bd62ba tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:06.252954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dc6406f-ac1b-459b-8575-e7abc4bd62ba tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:06.254182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dc6406f-ac1b-459b-8575-e7abc4bd62ba tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:06.257393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dc6406f-ac1b-459b-8575-e7abc4bd62ba tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:06.260453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dc6406f-ac1b-459b-8575-e7abc4bd62ba tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:06.262318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dc6406f-ac1b-459b-8575-e7abc4bd62ba tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:06.262781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dc6406f-ac1b-459b-8575-e7abc4bd62ba tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:06.290645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-363263f0-4d7e-4e38-98ac-1dbb84a62bad tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:06.323494 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:37:06.327075 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1dc6406f-ac1b-459b-8575-e7abc4bd62ba tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.122999 Sep 07 12:37:06.328500 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 937/1918] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Sep 7 12:37:06 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:06.328641 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-363263f0-4d7e-4e38-98ac-1dbb84a62bad tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 1.278306 Sep 07 12:37:06.334661 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b430c310-5b76-4af2-b674-cbbdc6997cdc tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:06.335760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b430c310-5b76-4af2-b674-cbbdc6997cdc tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:06.348654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b430c310-5b76-4af2-b674-cbbdc6997cdc tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:06.350553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b430c310-5b76-4af2-b674-cbbdc6997cdc tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:06.351676 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b430c310-5b76-4af2-b674-cbbdc6997cdc tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:06.352876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b430c310-5b76-4af2-b674-cbbdc6997cdc tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:06.353844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b430c310-5b76-4af2-b674-cbbdc6997cdc tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:06.354879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b430c310-5b76-4af2-b674-cbbdc6997cdc tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:06.363210 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 982/1919] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:05 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:06.419139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-712cdc99-4e1a-40dd-a450-35f184b4583c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc4195ebdc0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:06.640034 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-712cdc99-4e1a-40dd-a450-35f184b4583c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 200 len: 1420 microversion: 2.1 time: 0.264944 Sep 07 12:37:06.650628 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 983/1920] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:37:06 2022] GET /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:06.680668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-337be737-0ff5-47c9-96f6-9d5ee9fde6c4 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:06.682748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-337be737-0ff5-47c9-96f6-9d5ee9fde6c4 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:06.690673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-337be737-0ff5-47c9-96f6-9d5ee9fde6c4 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:06.691494 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-337be737-0ff5-47c9-96f6-9d5ee9fde6c4 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:06.697223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-337be737-0ff5-47c9-96f6-9d5ee9fde6c4 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:06.698593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-337be737-0ff5-47c9-96f6-9d5ee9fde6c4 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:06.699290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-337be737-0ff5-47c9-96f6-9d5ee9fde6c4 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:06.699914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-337be737-0ff5-47c9-96f6-9d5ee9fde6c4 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:07.387998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b430c310-5b76-4af2-b674-cbbdc6997cdc tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41979e405fab49029d8ff5a9903e36ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00ac02c77f40f5ab6acbe538c9566b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:07.431513 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b430c310-5b76-4af2-b674-cbbdc6997cdc tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa" status: 200 len: 1324 microversion: 2.1 time: 1.098608 Sep 07 12:37:07.458306 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 938/1921] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:06 2022] GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa => generated 1324 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:07.464549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fff54d01-c4cb-494d-a827-c0b2d58a0621 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc418a174c0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:08.020487 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-337be737-0ff5-47c9-96f6-9d5ee9fde6c4 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cead0c007d8545b3a32963668fbbe23e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e13a7ebce0646f8aea71d49eaa698d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:08.043016 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-337be737-0ff5-47c9-96f6-9d5ee9fde6c4 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf" status: 200 len: 1332 microversion: 2.1 time: 1.384001 Sep 07 12:37:08.061036 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 984/1922] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:06 2022] GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf => generated 1332 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:08.077733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-815b14d4-361d-4445-84f5-cc5bc9706968 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:08.080412 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-815b14d4-361d-4445-84f5-cc5bc9706968 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: b05fbd40-21c6-4c6c-9039-887cf2b9e6d8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:08.099941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-815b14d4-361d-4445-84f5-cc5bc9706968 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:08.100467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-815b14d4-361d-4445-84f5-cc5bc9706968 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:08.100925 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-815b14d4-361d-4445-84f5-cc5bc9706968 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:08.101718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-815b14d4-361d-4445-84f5-cc5bc9706968 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:08.102404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-815b14d4-361d-4445-84f5-cc5bc9706968 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:08.103024 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-815b14d4-361d-4445-84f5-cc5bc9706968 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:08.380111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-815b14d4-361d-4445-84f5-cc5bc9706968 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:08.390905 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-815b14d4-361d-4445-84f5-cc5bc9706968 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8" status: 200 len: 1273 microversion: 2.1 time: 0.328308 Sep 07 12:37:08.431055 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 985/1923] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:08 2022] GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 => generated 1273 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:08.431055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-335d845b-0352-4970-ba65-c22739e4a9d0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:08.432297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-335d845b-0352-4970-ba65-c22739e4a9d0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:08.482744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-335d845b-0352-4970-ba65-c22739e4a9d0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:08.483137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-335d845b-0352-4970-ba65-c22739e4a9d0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:08.485755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-335d845b-0352-4970-ba65-c22739e4a9d0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:08.488282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-335d845b-0352-4970-ba65-c22739e4a9d0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:08.491474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-335d845b-0352-4970-ba65-c22739e4a9d0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:08.492259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-335d845b-0352-4970-ba65-c22739e4a9d0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:08.751202 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fff54d01-c4cb-494d-a827-c0b2d58a0621 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "DELETE /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 204 len: 0 microversion: 2.1 time: 1.291203 Sep 07 12:37:08.753127 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 939/1924] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:07 2022] DELETE /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 0 bytes in 1294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:37:08.759866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eddbdb25-2279-47a9-93ac-1904dfd5d461 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:08.760738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-eddbdb25-2279-47a9-93ac-1904dfd5d461 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:08.781274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eddbdb25-2279-47a9-93ac-1904dfd5d461 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:08.783159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eddbdb25-2279-47a9-93ac-1904dfd5d461 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:08.788658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eddbdb25-2279-47a9-93ac-1904dfd5d461 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:08.789764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eddbdb25-2279-47a9-93ac-1904dfd5d461 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:08.790434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eddbdb25-2279-47a9-93ac-1904dfd5d461 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:08.791316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eddbdb25-2279-47a9-93ac-1904dfd5d461 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:09.202042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-335d845b-0352-4970-ba65-c22739e4a9d0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:09.216531 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-335d845b-0352-4970-ba65-c22739e4a9d0 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 0.789970 Sep 07 12:37:09.226200 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 986/1925] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:08 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:09.233437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cf2ec2d3-0264-4e07-af93-bee516c1babf tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:09.236864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cf2ec2d3-0264-4e07-af93-bee516c1babf tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:09.250371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf2ec2d3-0264-4e07-af93-bee516c1babf tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:09.254323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf2ec2d3-0264-4e07-af93-bee516c1babf tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:09.255163 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf2ec2d3-0264-4e07-af93-bee516c1babf tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:09.256306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf2ec2d3-0264-4e07-af93-bee516c1babf tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:09.257046 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf2ec2d3-0264-4e07-af93-bee516c1babf tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:09.257752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf2ec2d3-0264-4e07-af93-bee516c1babf tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:09.315162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cf2ec2d3-0264-4e07-af93-bee516c1babf tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:37:09.522552 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cf2ec2d3-0264-4e07-af93-bee516c1babf tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "DELETE /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 204 len: 0 microversion: 2.1 time: 0.294420 Sep 07 12:37:09.523978 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 987/1926] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:37:09 2022] DELETE /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:37:09.530955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d4a4dbbf-9b2b-4a68-bed6-2dd410008a3e tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:09.542755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d4a4dbbf-9b2b-4a68-bed6-2dd410008a3e tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:09.549872 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4a4dbbf-9b2b-4a68-bed6-2dd410008a3e tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:09.550784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4a4dbbf-9b2b-4a68-bed6-2dd410008a3e tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:09.551490 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4a4dbbf-9b2b-4a68-bed6-2dd410008a3e tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:09.552544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4a4dbbf-9b2b-4a68-bed6-2dd410008a3e tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:09.553306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4a4dbbf-9b2b-4a68-bed6-2dd410008a3e tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:09.554022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4a4dbbf-9b2b-4a68-bed6-2dd410008a3e tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:10.175579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-eddbdb25-2279-47a9-93ac-1904dfd5d461 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41979e405fab49029d8ff5a9903e36ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00ac02c77f40f5ab6acbe538c9566b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:10.228855 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eddbdb25-2279-47a9-93ac-1904dfd5d461 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa" status: 200 len: 1324 microversion: 2.1 time: 1.473405 Sep 07 12:37:10.230012 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 940/1927] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:08 2022] GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa => generated 1324 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:10.262967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-11168471-2627-46d1-abcc-bbff31ba59a1 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:10.270250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-11168471-2627-46d1-abcc-bbff31ba59a1 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: b05fbd40-21c6-4c6c-9039-887cf2b9e6d8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:10.307582 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11168471-2627-46d1-abcc-bbff31ba59a1 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:10.322200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11168471-2627-46d1-abcc-bbff31ba59a1 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:10.326993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11168471-2627-46d1-abcc-bbff31ba59a1 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:10.333059 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11168471-2627-46d1-abcc-bbff31ba59a1 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:10.334028 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11168471-2627-46d1-abcc-bbff31ba59a1 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:10.339218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11168471-2627-46d1-abcc-bbff31ba59a1 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:10.678832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d4a4dbbf-9b2b-4a68-bed6-2dd410008a3e tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cead0c007d8545b3a32963668fbbe23e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e13a7ebce0646f8aea71d49eaa698d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:10.690726 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d4a4dbbf-9b2b-4a68-bed6-2dd410008a3e tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf" status: 200 len: 1534 microversion: 2.1 time: 1.164667 Sep 07 12:37:10.701446 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 988/1928] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:09 2022] GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf => generated 1534 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:10.704422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-59f44337-56a2-4ac8-8d48-d3e07200a2aa tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1374228237", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "d72920fd-5bbc-4fad-ab8f-6932e7c7ba21"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:10.764839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:37:10.824282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=12 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:37:10.897836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-59f44337-56a2-4ac8-8d48-d3e07200a2aa tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] validate_networks() for [('d72920fd-5bbc-4fad-ab8f-6932e7c7ba21', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:37:11.162701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-11168471-2627-46d1-abcc-bbff31ba59a1 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:11.172482 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-11168471-2627-46d1-abcc-bbff31ba59a1 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8" status: 200 len: 1315 microversion: 2.1 time: 0.932076 Sep 07 12:37:11.179438 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 941/1929] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:10 2022] GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 => generated 1315 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:11.190321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8fa627fb-7828-4565-beeb-d72c81c6d03c req-8410c4d8-2dae-4a2e-97be-ffca0128687d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03263c2b-a3d1-4f6c-a5c9-ee201f82bb81", "name": "network-vif-unplugged", "status": "completed", "tag": "50a71a57-d6a7-4fc4-884d-37725c6e2f65"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:11.215756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8fa627fb-7828-4565-beeb-d72c81c6d03c req-8410c4d8-2dae-4a2e-97be-ffca0128687d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:11.219912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8fa627fb-7828-4565-beeb-d72c81c6d03c req-8410c4d8-2dae-4a2e-97be-ffca0128687d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:11.220557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8fa627fb-7828-4565-beeb-d72c81c6d03c req-8410c4d8-2dae-4a2e-97be-ffca0128687d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:11.263513 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8fa627fb-7828-4565-beeb-d72c81c6d03c req-8410c4d8-2dae-4a2e-97be-ffca0128687d service nova] Creating event network-vif-unplugged:50a71a57-d6a7-4fc4-884d-37725c6e2f65 for instance 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 on n-h1-852087-9 Sep 07 12:37:11.278068 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8fa627fb-7828-4565-beeb-d72c81c6d03c req-8410c4d8-2dae-4a2e-97be-ffca0128687d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096545 Sep 07 12:37:11.286373 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 942/1930] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:11.304878 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d40aecff-6fb9-4ef1-b3f6-c78e0c7e85fe tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:11.316454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d40aecff-6fb9-4ef1-b3f6-c78e0c7e85fe tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:11.323915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d40aecff-6fb9-4ef1-b3f6-c78e0c7e85fe tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:11.324778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d40aecff-6fb9-4ef1-b3f6-c78e0c7e85fe tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:11.326101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d40aecff-6fb9-4ef1-b3f6-c78e0c7e85fe tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:11.329837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d40aecff-6fb9-4ef1-b3f6-c78e0c7e85fe tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:11.333940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d40aecff-6fb9-4ef1-b3f6-c78e0c7e85fe tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:11.336027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d40aecff-6fb9-4ef1-b3f6-c78e0c7e85fe tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:11.485077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:37:12.201806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d40aecff-6fb9-4ef1-b3f6-c78e0c7e85fe tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:12.216317 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d40aecff-6fb9-4ef1-b3f6-c78e0c7e85fe tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 0.927061 Sep 07 12:37:12.217971 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 943/1931] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:11 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:12.250008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0a2c0690-e8cc-4c3f-b3af-8e37f7fbef54 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Action: 'create', calling method: .version_select at 0x7fc418a00430>, body: {"pool": "5faca153-d2fc-423d-9176-48ca0ab99907"} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:12.532218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-59f44337-56a2-4ac8-8d48-d3e07200a2aa tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:37:12.533048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-59f44337-56a2-4ac8-8d48-d3e07200a2aa tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:37:12.533473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-59f44337-56a2-4ac8-8d48-d3e07200a2aa tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:37:12.534046 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-59f44337-56a2-4ac8-8d48-d3e07200a2aa tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:37:12.534591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-59f44337-56a2-4ac8-8d48-d3e07200a2aa tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:37:12.560432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59f44337-56a2-4ac8-8d48-d3e07200a2aa tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:12.561099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59f44337-56a2-4ac8-8d48-d3e07200a2aa tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:12.561714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59f44337-56a2-4ac8-8d48-d3e07200a2aa tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:12.562644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59f44337-56a2-4ac8-8d48-d3e07200a2aa tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:12.563232 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59f44337-56a2-4ac8-8d48-d3e07200a2aa tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:12.563836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59f44337-56a2-4ac8-8d48-d3e07200a2aa tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:12.595988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-59f44337-56a2-4ac8-8d48-d3e07200a2aa tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Getting quotas for project 081286d7e4664e239ace13466a4a9c50. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:37:12.603030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-59f44337-56a2-4ac8-8d48-d3e07200a2aa tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Getting quotas for user 3d68cf87771f4e9f9caab95adf58b129 and project 081286d7e4664e239ace13466a4a9c50. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:37:12.621650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-59f44337-56a2-4ac8-8d48-d3e07200a2aa tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:37:12.625146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-59f44337-56a2-4ac8-8d48-d3e07200a2aa tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2c8319cb-1eff-4ea4-9b2f-37ac6035c490] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:37:12.699549 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-59f44337-56a2-4ac8-8d48-d3e07200a2aa tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.998553 Sep 07 12:37:12.702661 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 989/1932] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:37:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:37:12.716052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-989a8eeb-88d2-4543-a3fb-5cc084f53fd1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:12.720179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-989a8eeb-88d2-4543-a3fb-5cc084f53fd1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:12.737055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-989a8eeb-88d2-4543-a3fb-5cc084f53fd1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:12.740139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-989a8eeb-88d2-4543-a3fb-5cc084f53fd1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:12.742765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-989a8eeb-88d2-4543-a3fb-5cc084f53fd1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:12.745721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-989a8eeb-88d2-4543-a3fb-5cc084f53fd1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:12.747628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-989a8eeb-88d2-4543-a3fb-5cc084f53fd1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:12.749239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-989a8eeb-88d2-4543-a3fb-5cc084f53fd1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:14.200894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-989a8eeb-88d2-4543-a3fb-5cc084f53fd1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41979e405fab49029d8ff5a9903e36ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00ac02c77f40f5ab6acbe538c9566b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:14.249975 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-989a8eeb-88d2-4543-a3fb-5cc084f53fd1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa" status: 200 len: 1324 microversion: 2.1 time: 1.544387 Sep 07 12:37:14.256334 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 990/1933] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:12 2022] GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa => generated 1324 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:14.299439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c46fc554-edb7-4057-9766-ea272d10b3c7 req-86069c82-ffb1-4a65-ab2e-2462672ad524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8817b2e5-125e-455f-9c44-e0f46786b5fa", "tag": "f2fda9ed-aa0e-41f8-a289-5e6679639d1e"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:14.360735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c46fc554-edb7-4057-9766-ea272d10b3c7 req-86069c82-ffb1-4a65-ab2e-2462672ad524 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:14.364915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c46fc554-edb7-4057-9766-ea272d10b3c7 req-86069c82-ffb1-4a65-ab2e-2462672ad524 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:14.367346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c46fc554-edb7-4057-9766-ea272d10b3c7 req-86069c82-ffb1-4a65-ab2e-2462672ad524 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:14.431818 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c46fc554-edb7-4057-9766-ea272d10b3c7 req-86069c82-ffb1-4a65-ab2e-2462672ad524 service nova] Creating event network-changed:f2fda9ed-aa0e-41f8-a289-5e6679639d1e for instance 8817b2e5-125e-455f-9c44-e0f46786b5fa on n-h1-852087-9 Sep 07 12:37:14.458385 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c46fc554-edb7-4057-9766-ea272d10b3c7 req-86069c82-ffb1-4a65-ab2e-2462672ad524 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191640 Sep 07 12:37:14.461171 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 991/1934] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:14.475113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5654e721-7681-481b-a0ae-98adb03537ba tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:14.481707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5654e721-7681-481b-a0ae-98adb03537ba tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: b05fbd40-21c6-4c6c-9039-887cf2b9e6d8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:14.498128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5654e721-7681-481b-a0ae-98adb03537ba tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:14.503634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5654e721-7681-481b-a0ae-98adb03537ba tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:14.504946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5654e721-7681-481b-a0ae-98adb03537ba tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:14.510681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5654e721-7681-481b-a0ae-98adb03537ba tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:14.511614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5654e721-7681-481b-a0ae-98adb03537ba tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:14.512502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5654e721-7681-481b-a0ae-98adb03537ba tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:15.361660 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5654e721-7681-481b-a0ae-98adb03537ba tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:15.390274 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5654e721-7681-481b-a0ae-98adb03537ba tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8" status: 200 len: 1315 microversion: 2.1 time: 0.925912 Sep 07 12:37:15.391312 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 992/1935] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:14 2022] GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 => generated 1315 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:15.465973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ccbc5d6b-50c9-4129-8390-64dbfcbdeed4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:15.467217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ccbc5d6b-50c9-4129-8390-64dbfcbdeed4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2c8319cb-1eff-4ea4-9b2f-37ac6035c490] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:15.537036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccbc5d6b-50c9-4129-8390-64dbfcbdeed4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:15.551660 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccbc5d6b-50c9-4129-8390-64dbfcbdeed4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:15.552600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccbc5d6b-50c9-4129-8390-64dbfcbdeed4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:15.554518 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccbc5d6b-50c9-4129-8390-64dbfcbdeed4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:15.555358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccbc5d6b-50c9-4129-8390-64dbfcbdeed4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:15.568017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccbc5d6b-50c9-4129-8390-64dbfcbdeed4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:15.883727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ccbc5d6b-50c9-4129-8390-64dbfcbdeed4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:15.899749 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ccbc5d6b-50c9-4129-8390-64dbfcbdeed4 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490" status: 200 len: 1260 microversion: 2.1 time: 0.463015 Sep 07 12:37:15.901000 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 993/1936] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:15 2022] GET /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490 => generated 1260 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:15.908463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-db745ed9-11ba-415a-8e82-9604210b06a1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:15.910049 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-db745ed9-11ba-415a-8e82-9604210b06a1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:15.940323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db745ed9-11ba-415a-8e82-9604210b06a1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:15.942079 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db745ed9-11ba-415a-8e82-9604210b06a1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:15.943096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db745ed9-11ba-415a-8e82-9604210b06a1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:15.944559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db745ed9-11ba-415a-8e82-9604210b06a1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:15.945253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db745ed9-11ba-415a-8e82-9604210b06a1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:15.945946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db745ed9-11ba-415a-8e82-9604210b06a1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:17.134944 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-db745ed9-11ba-415a-8e82-9604210b06a1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:17.147022 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-db745ed9-11ba-415a-8e82-9604210b06a1 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 1.243592 Sep 07 12:37:17.163396 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 994/1937] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:15 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:17.172761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-bf7f8452-efe8-4e66-b8ba-82e58ef67093 req-bb8a3274-21bc-49fc-90c3-c5370073a300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03263c2b-a3d1-4f6c-a5c9-ee201f82bb81", "name": "network-vif-deleted", "tag": "50a71a57-d6a7-4fc4-884d-37725c6e2f65"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:17.184303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-bf7f8452-efe8-4e66-b8ba-82e58ef67093 req-bb8a3274-21bc-49fc-90c3-c5370073a300 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:17.185235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-bf7f8452-efe8-4e66-b8ba-82e58ef67093 req-bb8a3274-21bc-49fc-90c3-c5370073a300 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:17.185954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-bf7f8452-efe8-4e66-b8ba-82e58ef67093 req-bb8a3274-21bc-49fc-90c3-c5370073a300 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:17.239007 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-bf7f8452-efe8-4e66-b8ba-82e58ef67093 req-bb8a3274-21bc-49fc-90c3-c5370073a300 service nova] Creating event network-vif-deleted:50a71a57-d6a7-4fc4-884d-37725c6e2f65 for instance 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 on n-h1-852087-9 Sep 07 12:37:17.265136 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-bf7f8452-efe8-4e66-b8ba-82e58ef67093 req-bb8a3274-21bc-49fc-90c3-c5370073a300 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094187 Sep 07 12:37:17.268346 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 995/1938] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:17.291838 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0dc2af42-dcc0-4448-bf31-ec3d92586e1f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:17.292601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0dc2af42-dcc0-4448-bf31-ec3d92586e1f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:17.328831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dc2af42-dcc0-4448-bf31-ec3d92586e1f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:17.329173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dc2af42-dcc0-4448-bf31-ec3d92586e1f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:17.329825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dc2af42-dcc0-4448-bf31-ec3d92586e1f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:17.331081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dc2af42-dcc0-4448-bf31-ec3d92586e1f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:17.331731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dc2af42-dcc0-4448-bf31-ec3d92586e1f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:17.332330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0dc2af42-dcc0-4448-bf31-ec3d92586e1f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:17.681141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0dc2af42-dcc0-4448-bf31-ec3d92586e1f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41979e405fab49029d8ff5a9903e36ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00ac02c77f40f5ab6acbe538c9566b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:17.695047 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0dc2af42-dcc0-4448-bf31-ec3d92586e1f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa" status: 200 len: 1324 microversion: 2.1 time: 0.418792 Sep 07 12:37:17.698297 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 996/1939] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:17 2022] GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa => generated 1324 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:17.711494 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d0e881fc-f8ca-4d23-81d4-59e1e8323937 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:17.714629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d0e881fc-f8ca-4d23-81d4-59e1e8323937 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: b05fbd40-21c6-4c6c-9039-887cf2b9e6d8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:17.734024 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0e881fc-f8ca-4d23-81d4-59e1e8323937 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:17.735041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0e881fc-f8ca-4d23-81d4-59e1e8323937 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:17.735959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0e881fc-f8ca-4d23-81d4-59e1e8323937 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:17.737858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0e881fc-f8ca-4d23-81d4-59e1e8323937 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:17.741707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0e881fc-f8ca-4d23-81d4-59e1e8323937 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:17.742510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0e881fc-f8ca-4d23-81d4-59e1e8323937 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:18.166592 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0a2c0690-e8cc-4c3f-b3af-8e37f7fbef54 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.944399 Sep 07 12:37:18.176945 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 944/1940] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Sep 7 12:37:12 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:18.197070 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3915d94a-5c87-4d0b-8d6c-b22725d8ff58 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:18.200256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3915d94a-5c87-4d0b-8d6c-b22725d8ff58 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2c8319cb-1eff-4ea4-9b2f-37ac6035c490] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:18.210538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d0e881fc-f8ca-4d23-81d4-59e1e8323937 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:18.222250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3915d94a-5c87-4d0b-8d6c-b22725d8ff58 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:18.223165 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d0e881fc-f8ca-4d23-81d4-59e1e8323937 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8" status: 200 len: 1315 microversion: 2.1 time: 0.521911 Sep 07 12:37:18.224269 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 997/1941] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:17 2022] GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 => generated 1315 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:18.226731 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3915d94a-5c87-4d0b-8d6c-b22725d8ff58 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:18.227686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3915d94a-5c87-4d0b-8d6c-b22725d8ff58 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:18.229387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3915d94a-5c87-4d0b-8d6c-b22725d8ff58 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:18.230308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b91a040b-6d1b-4905-8b27-f46af0605b98 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:18.230870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3915d94a-5c87-4d0b-8d6c-b22725d8ff58 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:18.231052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b91a040b-6d1b-4905-8b27-f46af0605b98 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:18.232222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3915d94a-5c87-4d0b-8d6c-b22725d8ff58 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:18.239761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b91a040b-6d1b-4905-8b27-f46af0605b98 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:18.240776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b91a040b-6d1b-4905-8b27-f46af0605b98 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:18.241404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b91a040b-6d1b-4905-8b27-f46af0605b98 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:18.242424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b91a040b-6d1b-4905-8b27-f46af0605b98 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:18.243423 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b91a040b-6d1b-4905-8b27-f46af0605b98 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:18.244383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b91a040b-6d1b-4905-8b27-f46af0605b98 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:18.519631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3915d94a-5c87-4d0b-8d6c-b22725d8ff58 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:18.538159 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3915d94a-5c87-4d0b-8d6c-b22725d8ff58 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490" status: 200 len: 1266 microversion: 2.1 time: 0.356890 Sep 07 12:37:18.559405 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 945/1942] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:18 2022] GET /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490 => generated 1266 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:18.602383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3071d440-dcdb-46d0-b69b-1e51211f016c tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Action: 'action', calling method: .version_select at 0x7fc41abc8c10>, body: {"addFloatingIp": {"address": "172.25.8.169"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:18.616486 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3071d440-dcdb-46d0-b69b-1e51211f016c tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:18.651297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3071d440-dcdb-46d0-b69b-1e51211f016c tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:18.652175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3071d440-dcdb-46d0-b69b-1e51211f016c tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:18.652975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3071d440-dcdb-46d0-b69b-1e51211f016c tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:18.661740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3071d440-dcdb-46d0-b69b-1e51211f016c tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:18.665609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3071d440-dcdb-46d0-b69b-1e51211f016c tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:18.671899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3071d440-dcdb-46d0-b69b-1e51211f016c tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:18.800457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b91a040b-6d1b-4905-8b27-f46af0605b98 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:18.831543 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b91a040b-6d1b-4905-8b27-f46af0605b98 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 0.605581 Sep 07 12:37:18.851494 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 998/1943] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:18 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:18.881332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a30ec45a-d8e5-4a8a-a6d8-c4a6bfe99088 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:18.886671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a30ec45a-d8e5-4a8a-a6d8-c4a6bfe99088 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:18.905313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a30ec45a-d8e5-4a8a-a6d8-c4a6bfe99088 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:18.910237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a30ec45a-d8e5-4a8a-a6d8-c4a6bfe99088 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:18.911226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a30ec45a-d8e5-4a8a-a6d8-c4a6bfe99088 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:18.912512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a30ec45a-d8e5-4a8a-a6d8-c4a6bfe99088 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:18.913424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a30ec45a-d8e5-4a8a-a6d8-c4a6bfe99088 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:18.922099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a30ec45a-d8e5-4a8a-a6d8-c4a6bfe99088 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:18.954933 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3071d440-dcdb-46d0-b69b-1e51211f016c tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "refresh_cache-4472f1be-6441-4955-b1a0-934980853ccf" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 12:37:18.955248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3071d440-dcdb-46d0-b69b-1e51211f016c tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquired lock "refresh_cache-4472f1be-6441-4955-b1a0-934980853ccf" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 12:37:19.578358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a30ec45a-d8e5-4a8a-a6d8-c4a6bfe99088 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41979e405fab49029d8ff5a9903e36ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00ac02c77f40f5ab6acbe538c9566b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:19.594035 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a30ec45a-d8e5-4a8a-a6d8-c4a6bfe99088 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa" status: 200 len: 1324 microversion: 2.1 time: 0.740481 Sep 07 12:37:19.595587 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 999/1944] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:18 2022] GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa => generated 1324 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:19.600909 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-58f998de-0ae0-47c6-bade-b8f57890b4ee tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:19.601919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-58f998de-0ae0-47c6-bade-b8f57890b4ee tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: b05fbd40-21c6-4c6c-9039-887cf2b9e6d8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:19.610611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58f998de-0ae0-47c6-bade-b8f57890b4ee tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:19.611634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58f998de-0ae0-47c6-bade-b8f57890b4ee tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:19.612407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58f998de-0ae0-47c6-bade-b8f57890b4ee tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:19.619756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58f998de-0ae0-47c6-bade-b8f57890b4ee tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:19.620671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58f998de-0ae0-47c6-bade-b8f57890b4ee tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:19.621530 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58f998de-0ae0-47c6-bade-b8f57890b4ee tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:20.004126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-58f998de-0ae0-47c6-bade-b8f57890b4ee tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:20.006990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:37:20.029821 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-58f998de-0ae0-47c6-bade-b8f57890b4ee tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8" status: 200 len: 1315 microversion: 2.1 time: 0.423904 Sep 07 12:37:20.031790 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1000/1945] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:19 2022] GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:20.056641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-bb445faf-dd33-453c-8f63-b5c386fcbd5c req-8e768563-897b-42b2-81a1-f5e135ad8022 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b05fbd40-21c6-4c6c-9039-887cf2b9e6d8", "tag": "2e2d9ed2-9ac4-4aa8-bea1-c85093084b32"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:20.085716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-bb445faf-dd33-453c-8f63-b5c386fcbd5c req-8e768563-897b-42b2-81a1-f5e135ad8022 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:20.086208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-bb445faf-dd33-453c-8f63-b5c386fcbd5c req-8e768563-897b-42b2-81a1-f5e135ad8022 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:20.086661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-bb445faf-dd33-453c-8f63-b5c386fcbd5c req-8e768563-897b-42b2-81a1-f5e135ad8022 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:20.115153 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-bb445faf-dd33-453c-8f63-b5c386fcbd5c req-8e768563-897b-42b2-81a1-f5e135ad8022 service nova] Creating event network-changed:2e2d9ed2-9ac4-4aa8-bea1-c85093084b32 for instance b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 on n-h2-852087-9 Sep 07 12:37:20.132842 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-bb445faf-dd33-453c-8f63-b5c386fcbd5c req-8e768563-897b-42b2-81a1-f5e135ad8022 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097204 Sep 07 12:37:20.137015 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1001/1946] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:20.154811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b8cf4580-031b-4424-8659-d794dc7f1653 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:20.155578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b8cf4580-031b-4424-8659-d794dc7f1653 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2c8319cb-1eff-4ea4-9b2f-37ac6035c490] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:20.171300 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8cf4580-031b-4424-8659-d794dc7f1653 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:20.171584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8cf4580-031b-4424-8659-d794dc7f1653 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:20.171847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8cf4580-031b-4424-8659-d794dc7f1653 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:20.172586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8cf4580-031b-4424-8659-d794dc7f1653 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:20.173059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8cf4580-031b-4424-8659-d794dc7f1653 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:20.173510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8cf4580-031b-4424-8659-d794dc7f1653 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:20.366448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b8cf4580-031b-4424-8659-d794dc7f1653 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:20.382263 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b8cf4580-031b-4424-8659-d794dc7f1653 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490" status: 200 len: 1266 microversion: 2.1 time: 0.235107 Sep 07 12:37:20.384224 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1002/1947] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:20 2022] GET /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490 => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:20.391258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad62b1e2-f66a-4d12-93d3-450ed615ccb6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:20.394440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ad62b1e2-f66a-4d12-93d3-450ed615ccb6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:20.407205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad62b1e2-f66a-4d12-93d3-450ed615ccb6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:20.408353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad62b1e2-f66a-4d12-93d3-450ed615ccb6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:20.409053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad62b1e2-f66a-4d12-93d3-450ed615ccb6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:20.410572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad62b1e2-f66a-4d12-93d3-450ed615ccb6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:20.411321 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad62b1e2-f66a-4d12-93d3-450ed615ccb6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:20.412059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad62b1e2-f66a-4d12-93d3-450ed615ccb6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:21.648888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ad62b1e2-f66a-4d12-93d3-450ed615ccb6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:21.678495 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ad62b1e2-f66a-4d12-93d3-450ed615ccb6 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 1.291949 Sep 07 12:37:21.681409 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1003/1948] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:20 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:21.707062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e80b9170-216e-4b45-9865-24722809dfa2 req-45376675-3e44-44a8-ae9e-66304bf88394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8817b2e5-125e-455f-9c44-e0f46786b5fa", "name": "network-vif-plugged", "status": "completed", "tag": "f2fda9ed-aa0e-41f8-a289-5e6679639d1e"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:21.745573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e80b9170-216e-4b45-9865-24722809dfa2 req-45376675-3e44-44a8-ae9e-66304bf88394 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:21.747163 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e80b9170-216e-4b45-9865-24722809dfa2 req-45376675-3e44-44a8-ae9e-66304bf88394 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:21.750213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e80b9170-216e-4b45-9865-24722809dfa2 req-45376675-3e44-44a8-ae9e-66304bf88394 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:21.792155 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e80b9170-216e-4b45-9865-24722809dfa2 req-45376675-3e44-44a8-ae9e-66304bf88394 service nova] Creating event network-vif-plugged:f2fda9ed-aa0e-41f8-a289-5e6679639d1e for instance 8817b2e5-125e-455f-9c44-e0f46786b5fa on n-h1-852087-9 Sep 07 12:37:21.813333 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e80b9170-216e-4b45-9865-24722809dfa2 req-45376675-3e44-44a8-ae9e-66304bf88394 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128771 Sep 07 12:37:21.824656 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1004/1949] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:21.838778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d0a58d02-3add-45c3-b44f-262550ba1b85 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:21.840671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d0a58d02-3add-45c3-b44f-262550ba1b85 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:21.862992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0a58d02-3add-45c3-b44f-262550ba1b85 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:21.864342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0a58d02-3add-45c3-b44f-262550ba1b85 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:21.865597 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0a58d02-3add-45c3-b44f-262550ba1b85 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:21.868108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0a58d02-3add-45c3-b44f-262550ba1b85 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:21.869652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0a58d02-3add-45c3-b44f-262550ba1b85 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:21.870668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0a58d02-3add-45c3-b44f-262550ba1b85 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:22.581542 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d0a58d02-3add-45c3-b44f-262550ba1b85 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41979e405fab49029d8ff5a9903e36ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00ac02c77f40f5ab6acbe538c9566b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:22.617446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:37:22.625221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:37:22.639330 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d0a58d02-3add-45c3-b44f-262550ba1b85 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa" status: 200 len: 1324 microversion: 2.1 time: 0.811093 Sep 07 12:37:22.676965 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1005/1950] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:21 2022] GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa => generated 1324 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:22.694725 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-69584a6a-76ad-4039-8e8d-2921008457f7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:22.702071 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-69584a6a-76ad-4039-8e8d-2921008457f7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: b05fbd40-21c6-4c6c-9039-887cf2b9e6d8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:22.721569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69584a6a-76ad-4039-8e8d-2921008457f7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:22.722664 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69584a6a-76ad-4039-8e8d-2921008457f7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:22.723294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69584a6a-76ad-4039-8e8d-2921008457f7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:22.724218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69584a6a-76ad-4039-8e8d-2921008457f7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:22.724860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69584a6a-76ad-4039-8e8d-2921008457f7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:22.726671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69584a6a-76ad-4039-8e8d-2921008457f7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:23.052294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-69584a6a-76ad-4039-8e8d-2921008457f7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:23.062544 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-69584a6a-76ad-4039-8e8d-2921008457f7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8" status: 200 len: 1315 microversion: 2.1 time: 0.375157 Sep 07 12:37:23.063148 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1006/1951] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:22 2022] GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:23.180584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-3071d440-dcdb-46d0-b69b-1e51211f016c tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] Building network info cache for instance {{(pid=122433) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 07 12:37:23.185020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=91 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:37:23.267051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-38c81466-96e3-45a1-887a-ae1ddf20745f tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Action: 'create', calling method: .version_select at 0x7fc419ced790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-592379506", "description": "tempest-description-1960486837"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:24.153076 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-38c81466-96e3-45a1-887a-ae1ddf20745f tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.068564 Sep 07 12:37:24.170281 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1007/1952] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Sep 7 12:37:23 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:24.199538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a54ed508-1038-47c0-a299-10167c6c2e1c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:24.207232 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a54ed508-1038-47c0-a299-10167c6c2e1c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2c8319cb-1eff-4ea4-9b2f-37ac6035c490] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:24.237345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a54ed508-1038-47c0-a299-10167c6c2e1c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:24.244337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a54ed508-1038-47c0-a299-10167c6c2e1c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:24.250864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a54ed508-1038-47c0-a299-10167c6c2e1c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:24.256022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a54ed508-1038-47c0-a299-10167c6c2e1c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:24.257005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a54ed508-1038-47c0-a299-10167c6c2e1c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:24.259310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a54ed508-1038-47c0-a299-10167c6c2e1c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:25.008633 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a54ed508-1038-47c0-a299-10167c6c2e1c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:25.069868 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a54ed508-1038-47c0-a299-10167c6c2e1c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490" status: 200 len: 1308 microversion: 2.1 time: 0.894593 Sep 07 12:37:25.077821 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1008/1953] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:24 2022] GET /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490 => generated 1308 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:25.100473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ceb4d70e-8e66-4117-9697-b4e69b4897ca tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:25.100991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ceb4d70e-8e66-4117-9697-b4e69b4897ca tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:25.127066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:37:25.133108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ceb4d70e-8e66-4117-9697-b4e69b4897ca tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:25.135110 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ceb4d70e-8e66-4117-9697-b4e69b4897ca tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:25.137649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ceb4d70e-8e66-4117-9697-b4e69b4897ca tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:25.139822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ceb4d70e-8e66-4117-9697-b4e69b4897ca tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:25.141284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ceb4d70e-8e66-4117-9697-b4e69b4897ca tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:25.142107 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ceb4d70e-8e66-4117-9697-b4e69b4897ca tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:25.644252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-3071d440-dcdb-46d0-b69b-1e51211f016c tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] Updating instance_info_cache with network_info: [{"id": "d2cb7afc-63df-43ee-aefe-22e3a87e7b0d", "address": "fa:16:3e:fb:be:29", "network": {"id": "fbdf8ec3-7207-4081-80bb-109d3ec18fae", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-49367386-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7e13a7ebce0646f8aea71d49eaa698d1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd2cb7afc-63", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122433) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 07 12:37:25.699312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3071d440-dcdb-46d0-b69b-1e51211f016c tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Releasing lock "refresh_cache-4472f1be-6441-4955-b1a0-934980853ccf" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 12:37:25.703147 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3071d440-dcdb-46d0-b69b-1e51211f016c tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "POST /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf/action" status: 202 len: 0 microversion: 2.1 time: 7.123292 Sep 07 12:37:25.710556 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 946/1954] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:37:18 2022] POST /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf/action => generated 0 bytes in 7135 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 07 12:37:25.741783 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a0085d91-372a-4687-8a44-bf47e9af09a0 req-e5404bb4-0b07-490f-9442-9aa6b7e5d9dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4472f1be-6441-4955-b1a0-934980853ccf", "tag": "d2cb7afc-63df-43ee-aefe-22e3a87e7b0d"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:25.758082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ceb4d70e-8e66-4117-9697-b4e69b4897ca tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:25.798208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:37:25.808654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a0085d91-372a-4687-8a44-bf47e9af09a0 req-e5404bb4-0b07-490f-9442-9aa6b7e5d9dd service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:25.810752 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ceb4d70e-8e66-4117-9697-b4e69b4897ca tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 0.729369 Sep 07 12:37:25.812852 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1009/1955] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:25 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:25.829606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8d095303-c5e8-4bbc-baa8-ebed39ef887a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:25.829907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a0085d91-372a-4687-8a44-bf47e9af09a0 req-e5404bb4-0b07-490f-9442-9aa6b7e5d9dd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:25.833934 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a0085d91-372a-4687-8a44-bf47e9af09a0 req-e5404bb4-0b07-490f-9442-9aa6b7e5d9dd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:25.835989 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8d095303-c5e8-4bbc-baa8-ebed39ef887a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:25.875673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d095303-c5e8-4bbc-baa8-ebed39ef887a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:25.876654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d095303-c5e8-4bbc-baa8-ebed39ef887a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:25.877697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d095303-c5e8-4bbc-baa8-ebed39ef887a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:25.880559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d095303-c5e8-4bbc-baa8-ebed39ef887a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:25.881780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d095303-c5e8-4bbc-baa8-ebed39ef887a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:25.883079 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d095303-c5e8-4bbc-baa8-ebed39ef887a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:25.911880 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a0085d91-372a-4687-8a44-bf47e9af09a0 req-e5404bb4-0b07-490f-9442-9aa6b7e5d9dd service nova] Creating event network-changed:d2cb7afc-63df-43ee-aefe-22e3a87e7b0d for instance 4472f1be-6441-4955-b1a0-934980853ccf on n-h2-852087-9 Sep 07 12:37:25.932002 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a0085d91-372a-4687-8a44-bf47e9af09a0 req-e5404bb4-0b07-490f-9442-9aa6b7e5d9dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217509 Sep 07 12:37:25.934017 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 947/1956] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:25.944821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-934eb6e1-6ff8-4da9-9637-a0a9f8ab44dd req-cfe12e98-ff96-4a46-84a3-9dfd93075335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c8319cb-1eff-4ea4-9b2f-37ac6035c490", "tag": "b221a19c-0a57-40d9-8f2b-5759655c8975"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:25.972054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-934eb6e1-6ff8-4da9-9637-a0a9f8ab44dd req-cfe12e98-ff96-4a46-84a3-9dfd93075335 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:25.973374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-934eb6e1-6ff8-4da9-9637-a0a9f8ab44dd req-cfe12e98-ff96-4a46-84a3-9dfd93075335 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:25.974434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-934eb6e1-6ff8-4da9-9637-a0a9f8ab44dd req-cfe12e98-ff96-4a46-84a3-9dfd93075335 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:26.027039 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-934eb6e1-6ff8-4da9-9637-a0a9f8ab44dd req-cfe12e98-ff96-4a46-84a3-9dfd93075335 service nova] Creating event network-changed:b221a19c-0a57-40d9-8f2b-5759655c8975 for instance 2c8319cb-1eff-4ea4-9b2f-37ac6035c490 on n-h2-852087-9 Sep 07 12:37:26.050980 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-934eb6e1-6ff8-4da9-9637-a0a9f8ab44dd req-cfe12e98-ff96-4a46-84a3-9dfd93075335 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114147 Sep 07 12:37:26.054854 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 948/1957] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:26.079734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b634340c-a187-46c6-aa55-fb189bf4714f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:26.082790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b634340c-a187-46c6-aa55-fb189bf4714f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: b05fbd40-21c6-4c6c-9039-887cf2b9e6d8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:26.108007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b634340c-a187-46c6-aa55-fb189bf4714f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:26.113034 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b634340c-a187-46c6-aa55-fb189bf4714f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:26.115846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b634340c-a187-46c6-aa55-fb189bf4714f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:26.118776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b634340c-a187-46c6-aa55-fb189bf4714f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:26.121354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b634340c-a187-46c6-aa55-fb189bf4714f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:26.124974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b634340c-a187-46c6-aa55-fb189bf4714f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:26.160964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8d095303-c5e8-4bbc-baa8-ebed39ef887a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41979e405fab49029d8ff5a9903e36ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00ac02c77f40f5ab6acbe538c9566b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:26.174042 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8d095303-c5e8-4bbc-baa8-ebed39ef887a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa" status: 200 len: 1518 microversion: 2.1 time: 0.359127 Sep 07 12:37:26.174923 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1010/1958] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:25 2022] GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa => generated 1518 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:26.225109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fcc20444-af89-480c-8729-494b57ddf2f6 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Action: 'create', calling method: .version_select at 0x7fc419636a60>, body: {"security_group_rule": {"parent_group_id": "4bc12727-6247-4cce-bdd5-e7762d5f4525", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:26.703455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b634340c-a187-46c6-aa55-fb189bf4714f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:26.735793 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b634340c-a187-46c6-aa55-fb189bf4714f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8" status: 200 len: 1315 microversion: 2.1 time: 0.676103 Sep 07 12:37:26.754237 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 949/1959] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:26 2022] GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 => generated 1315 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:26.759857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-08177413-628b-48a0-90ad-bf48902f8bbc tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Action: 'create', calling method: .version_select at 0x7fc419523a60>, body: {"pool": "5faca153-d2fc-423d-9176-48ca0ab99907"} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:27.108985 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fcc20444-af89-480c-8729-494b57ddf2f6 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.910109 Sep 07 12:37:27.111207 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1011/1960] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Sep 7 12:37:26 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:27.123251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9e997f5b-c341-4703-96c2-60049fde5b70 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:27.129441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9e997f5b-c341-4703-96c2-60049fde5b70 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2c8319cb-1eff-4ea4-9b2f-37ac6035c490] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:27.203271 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e997f5b-c341-4703-96c2-60049fde5b70 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:27.211619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e997f5b-c341-4703-96c2-60049fde5b70 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:27.215015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e997f5b-c341-4703-96c2-60049fde5b70 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:27.225999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e997f5b-c341-4703-96c2-60049fde5b70 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:27.227099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e997f5b-c341-4703-96c2-60049fde5b70 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:27.228047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e997f5b-c341-4703-96c2-60049fde5b70 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:27.738165 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9e997f5b-c341-4703-96c2-60049fde5b70 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:27.752242 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9e997f5b-c341-4703-96c2-60049fde5b70 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490" status: 200 len: 1308 microversion: 2.1 time: 0.633034 Sep 07 12:37:27.769897 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1012/1961] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:27 2022] GET /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490 => generated 1308 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:27.791297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e07e1f5a-b831-4c8f-b059-8d60f5358fc2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Action: 'create', calling method: .version_select at 0x7fc4195c81f0>, body: {"pool": null} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:29.999354 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-08177413-628b-48a0-90ad-bf48902f8bbc tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.256583 Sep 07 12:37:30.001696 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 950/1962] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Sep 7 12:37:26 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:30.016751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-ebdbef90-f416-4b32-bec6-626956300769 req-ebde1f73-5c54-4914-9fe6-2b27cf9dad07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b05fbd40-21c6-4c6c-9039-887cf2b9e6d8", "name": "network-vif-plugged", "status": "completed", "tag": "2e2d9ed2-9ac4-4aa8-bea1-c85093084b32"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:30.033779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ebdbef90-f416-4b32-bec6-626956300769 req-ebde1f73-5c54-4914-9fe6-2b27cf9dad07 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:30.034968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ebdbef90-f416-4b32-bec6-626956300769 req-ebde1f73-5c54-4914-9fe6-2b27cf9dad07 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:30.036024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ebdbef90-f416-4b32-bec6-626956300769 req-ebde1f73-5c54-4914-9fe6-2b27cf9dad07 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:30.069923 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ebdbef90-f416-4b32-bec6-626956300769 req-ebde1f73-5c54-4914-9fe6-2b27cf9dad07 service nova] Creating event network-vif-plugged:2e2d9ed2-9ac4-4aa8-bea1-c85093084b32 for instance b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 on n-h2-852087-9 Sep 07 12:37:30.082246 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-ebdbef90-f416-4b32-bec6-626956300769 req-ebde1f73-5c54-4914-9fe6-2b27cf9dad07 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077634 Sep 07 12:37:30.084418 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 951/1963] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:30.095670 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8525c974-3eda-455a-b455-f65555929c6b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:30.096967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8525c974-3eda-455a-b455-f65555929c6b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:30.109376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8525c974-3eda-455a-b455-f65555929c6b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:30.110912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8525c974-3eda-455a-b455-f65555929c6b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:30.112068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8525c974-3eda-455a-b455-f65555929c6b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:30.113769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8525c974-3eda-455a-b455-f65555929c6b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:30.114945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8525c974-3eda-455a-b455-f65555929c6b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:30.116036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8525c974-3eda-455a-b455-f65555929c6b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:30.501507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8525c974-3eda-455a-b455-f65555929c6b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:30.517082 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8525c974-3eda-455a-b455-f65555929c6b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 0.429786 Sep 07 12:37:30.518158 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 952/1964] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:30 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:30.528419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c3d8f320-d0ea-437e-b3b7-5fc579ba52f3 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Action: 'create', calling method: .version_select at 0x7fc41d2cc1f0>, body: {"security_group_rule": {"parent_group_id": "4bc12727-6247-4cce-bdd5-e7762d5f4525", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:30.666913 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-c3d8f320-d0ea-437e-b3b7-5fc579ba52f3 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] HTTP exception thrown: This rule already exists in group 4bc12727-6247-4cce-bdd5-e7762d5f4525 Sep 07 12:37:30.684651 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e07e1f5a-b831-4c8f-b059-8d60f5358fc2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.912824 Sep 07 12:37:30.686293 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1013/1965] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Sep 7 12:37:27 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:30.692282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c3d8f320-d0ea-437e-b3b7-5fc579ba52f3 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Request method failure captured: Sep 07 12:37:30.692282 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 07 12:37:30.692282 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:37:30.692282 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:37:30.692282 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:37:30.692282 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 138 Sep 07 12:37:30.692282 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:37:30.692282 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:37:30.692282 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:37:30.692282 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:37:30.692282 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJCAl1SuViaHSWLkzmThpDbvJWx_k0VBILDKcDx3NIgYmrlT6WWF-HkHZ8XOc7WYAeu5xoeaU637SCWJ_DPjQBJKaKOMz000eBLxUimwI255LbZapKKhQXa1VZldUTf2c3rb-PbEyyqOSUYW5-z9IhwuSH7K8c7W1_TQLEn_c7c3WkE Sep 07 12:37:30.692282 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:37:30.692282 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:37:30.692282 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:37:30.692282 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:37:30.692282 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:37:30.692282 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:37:30.692282 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8020b3b90cfa4f84ae9003e6884da03c Sep 07 12:37:30.692282 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1168758300 Sep 07 12:37:30.692282 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:37:30.692282 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:37:30.695957 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:37:30.695957 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1168758300 Sep 07 12:37:30.695957 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8020b3b90cfa4f84ae9003e6884da03c Sep 07 12:37:30.695957 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1168758300 Sep 07 12:37:30.695957 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project Sep 07 12:37:30.695957 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:37:30.695957 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:37:30.695957 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: cbe66dab00d0478d81b5e5e4a45fb0df Sep 07 12:37:30.695957 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project Sep 07 12:37:30.695957 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:37:30.695957 n-d-852087-9 devstack@n-api.service[122433]: {"security_group_rule": {"parent_group_id": "4bc12727-6247-4cce-bdd5-e7762d5f4525", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 07 12:37:30.695957 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:37:30.699162 n-d-852087-9 devstack@n-api.service[122433]: exception: This rule already exists in group 4bc12727-6247-4cce-bdd5-e7762d5f4525 Sep 07 12:37:30.699162 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4bc12727-6247-4cce-bdd5-e7762d5f4525', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 07 12:37:30.699162 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:37:30.699162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:30.699162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Sep 07 12:37:30.699162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Sep 07 12:37:30.699162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Sep 07 12:37:30.699162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 07 12:37:30.699162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 4bc12727-6247-4cce-bdd5-e7762d5f4525 Sep 07 12:37:30.699162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:30.699162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:30.699162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:30.699162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:30.699162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:30.699162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:30.699162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:37:30.699162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:37:30.699162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:37:30.699162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:37:30.699162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:37:30.704006 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:37:30.704006 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Sep 07 12:37:30.704006 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 07 12:37:30.704006 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 4bc12727-6247-4cce-bdd5-e7762d5f4525 Sep 07 12:37:30.704006 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:30.704006 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:30.704006 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:30.704006 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:30.704006 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:30.704006 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:30.704006 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:37:30.704006 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:37:30.704006 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 4bc12727-6247-4cce-bdd5-e7762d5f4525 Sep 07 12:37:30.704006 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:30.704006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c3d8f320-d0ea-437e-b3b7-5fc579ba52f3 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Returning 400 to user: This rule already exists in group 4bc12727-6247-4cce-bdd5-e7762d5f4525 {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:37:30.710130 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c3d8f320-d0ea-437e-b3b7-5fc579ba52f3 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.174158 Sep 07 12:37:30.711069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-478e9b02-5bc7-45f1-a793-29416158f8b9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:30.711069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-478e9b02-5bc7-45f1-a793-29416158f8b9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: b05fbd40-21c6-4c6c-9039-887cf2b9e6d8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:30.711500 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 953/1966] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Sep 7 12:37:30 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:37:30.714919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8285ee4a-3946-48ca-82a2-574558784a6f req-d5216233-891b-4a7d-9dc1-a4f18e6ffe44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48217fe9-fd3c-4c7c-aa31-f7c93c9873ae", "name": "network-vif-unplugged", "status": "completed", "tag": "20b0a985-e074-4d7c-935a-40f22026e773"}, {"name": "network-changed", "server_uuid": "48217fe9-fd3c-4c7c-aa31-f7c93c9873ae", "tag": "20b0a985-e074-4d7c-935a-40f22026e773"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:30.721891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-478e9b02-5bc7-45f1-a793-29416158f8b9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:30.724403 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-478e9b02-5bc7-45f1-a793-29416158f8b9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:30.739410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-478e9b02-5bc7-45f1-a793-29416158f8b9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:30.755020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-478e9b02-5bc7-45f1-a793-29416158f8b9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:30.755508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-478e9b02-5bc7-45f1-a793-29416158f8b9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:30.756043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-478e9b02-5bc7-45f1-a793-29416158f8b9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:30.762200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8285ee4a-3946-48ca-82a2-574558784a6f req-d5216233-891b-4a7d-9dc1-a4f18e6ffe44 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:30.767052 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8285ee4a-3946-48ca-82a2-574558784a6f req-d5216233-891b-4a7d-9dc1-a4f18e6ffe44 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:30.767689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8285ee4a-3946-48ca-82a2-574558784a6f req-d5216233-891b-4a7d-9dc1-a4f18e6ffe44 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:30.793646 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8285ee4a-3946-48ca-82a2-574558784a6f req-d5216233-891b-4a7d-9dc1-a4f18e6ffe44 service nova] Creating event network-vif-unplugged:20b0a985-e074-4d7c-935a-40f22026e773 for instance 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae on n-h2-852087-9 Sep 07 12:37:30.794763 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8285ee4a-3946-48ca-82a2-574558784a6f req-d5216233-891b-4a7d-9dc1-a4f18e6ffe44 service nova] Creating event network-changed:20b0a985-e074-4d7c-935a-40f22026e773 for instance 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae on n-h2-852087-9 Sep 07 12:37:30.803790 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8285ee4a-3946-48ca-82a2-574558784a6f req-d5216233-891b-4a7d-9dc1-a4f18e6ffe44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.102929 Sep 07 12:37:30.805103 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 954/1967] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:30.820094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-62583b2e-64b9-4c0c-ae0e-47523ba0955e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:30.821546 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-62583b2e-64b9-4c0c-ae0e-47523ba0955e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2c8319cb-1eff-4ea4-9b2f-37ac6035c490] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:30.833271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62583b2e-64b9-4c0c-ae0e-47523ba0955e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:30.834197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62583b2e-64b9-4c0c-ae0e-47523ba0955e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:30.834979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62583b2e-64b9-4c0c-ae0e-47523ba0955e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:30.836266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62583b2e-64b9-4c0c-ae0e-47523ba0955e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:30.837070 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62583b2e-64b9-4c0c-ae0e-47523ba0955e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:30.838139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62583b2e-64b9-4c0c-ae0e-47523ba0955e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:31.079006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-478e9b02-5bc7-45f1-a793-29416158f8b9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:31.087168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-62583b2e-64b9-4c0c-ae0e-47523ba0955e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:31.096080 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-478e9b02-5bc7-45f1-a793-29416158f8b9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8" status: 200 len: 1315 microversion: 2.1 time: 0.407771 Sep 07 12:37:31.097186 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1014/1968] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:30 2022] GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:31.106305 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-62583b2e-64b9-4c0c-ae0e-47523ba0955e tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490" status: 200 len: 1308 microversion: 2.1 time: 0.299235 Sep 07 12:37:31.107634 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 955/1969] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:30 2022] GET /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490 => generated 1308 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:31.109228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1b986cdf-2621-4ff1-8acd-ddc9b90fe460 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Action: 'action', calling method: .version_select at 0x7fc41abe4280>, body: {"addFloatingIp": {"address": "172.25.8.172"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:31.114332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1b986cdf-2621-4ff1-8acd-ddc9b90fe460 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:31.117171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0d7e2c06-2a21-461a-910e-b569b12e23ad tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Calling method '.version_select at 0x7fc418bee700>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:31.128283 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b986cdf-2621-4ff1-8acd-ddc9b90fe460 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:31.129695 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b986cdf-2621-4ff1-8acd-ddc9b90fe460 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:31.130899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b986cdf-2621-4ff1-8acd-ddc9b90fe460 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:31.132511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b986cdf-2621-4ff1-8acd-ddc9b90fe460 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:31.133539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b986cdf-2621-4ff1-8acd-ddc9b90fe460 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:31.134455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b986cdf-2621-4ff1-8acd-ddc9b90fe460 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:31.266885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b986cdf-2621-4ff1-8acd-ddc9b90fe460 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "refresh_cache-4472f1be-6441-4955-b1a0-934980853ccf" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 12:37:31.267623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b986cdf-2621-4ff1-8acd-ddc9b90fe460 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquired lock "refresh_cache-4472f1be-6441-4955-b1a0-934980853ccf" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 12:37:31.532905 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0d7e2c06-2a21-461a-910e-b569b12e23ad tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/5bcfe8c5-55c1-4f3a-b095-6bbfd297bb9b" status: 202 len: 0 microversion: 2.1 time: 0.422685 Sep 07 12:37:31.534052 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 956/1970] 10.222.0.16 () {58 vars in 1287 bytes} [Wed Sep 7 12:37:31 2022] DELETE /compute/v2.1/os-security-group-rules/5bcfe8c5-55c1-4f3a-b095-6bbfd297bb9b => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:37:31.545557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0fe09474-1558-4d7d-a8b1-f8321f164fa7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-170430375", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "e919c9e1-6167-41ae-bc57-c4b7bc4c8d07"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:31.635819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-0fe09474-1558-4d7d-a8b1-f8321f164fa7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] validate_networks() for [('e919c9e1-6167-41ae-bc57-c4b7bc4c8d07', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:37:32.272317 n-d-852087-9 devstack@n-api.service[122432]: DEBUG neutronclient.v2_0.client [None req-1b986cdf-2621-4ff1-8acd-ddc9b90fe460 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.8.172 (71283e69-ed00-4e7b-b99e-28589d780ff0) with port d2cb7afc-63df-43ee-aefe-22e3a87e7b0d using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 5faca153-d2fc-423d-9176-48ca0ab99907.", "detail": ""}} {{(pid=122432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 12:37:32.273152 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b986cdf-2621-4ff1-8acd-ddc9b90fe460 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Releasing lock "refresh_cache-4472f1be-6441-4955-b1a0-934980853ccf" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 12:37:32.273833 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-1b986cdf-2621-4ff1-8acd-ddc9b90fe460 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] HTTP exception thrown: Cannot associate floating IP 172.25.8.172 (71283e69-ed00-4e7b-b99e-28589d780ff0) with port d2cb7afc-63df-43ee-aefe-22e3a87e7b0d using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 5faca153-d2fc-423d-9176-48ca0ab99907. Sep 07 12:37:32.273833 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-d5c45a80-ba52-402a-bc52-a5bbd76690e0'] Sep 07 12:37:32.278983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1b986cdf-2621-4ff1-8acd-ddc9b90fe460 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Request method failure captured: Sep 07 12:37:32.278983 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf/action HTTP/1.1 Sep 07 12:37:32.278983 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:37:32.278983 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:37:32.278983 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:37:32.278983 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 46 Sep 07 12:37:32.278983 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:37:32.278983 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:37:32.278983 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:37:32.278983 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:37:32.278983 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJBOaITVB7ZGKtkDqZiwPTsjUOTP5nKpy0IvS8yLaYijhtlrbJk2oN6pF86qnFeVoTCx5JaTlDm1455GaGrhgrbw22YC6YF51VYynBsuSnu7pi6I4GJQ9_WmFroQ-QgP0MwYERtCgeJW7lStTRD8pM93BRg9vrsnGR66XAFSpeqcmXY Sep 07 12:37:32.278983 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:37:32.278983 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:37:32.278983 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:37:32.278983 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:37:32.278983 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:37:32.278983 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:37:32.278983 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 7e13a7ebce0646f8aea71d49eaa698d1 Sep 07 12:37:32.278983 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 Sep 07 12:37:32.278983 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:37:32.278983 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:37:32.280837 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7e13a7ebce0646f8aea71d49eaa698d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7e13a7ebce0646f8aea71d49eaa698d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7e13a7ebce0646f8aea71d49eaa698d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7e13a7ebce0646f8aea71d49eaa698d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:37:32.280837 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 Sep 07 12:37:32.280837 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 7e13a7ebce0646f8aea71d49eaa698d1 Sep 07 12:37:32.280837 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 Sep 07 12:37:32.280837 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project Sep 07 12:37:32.280837 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:37:32.280837 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:37:32.280837 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: cead0c007d8545b3a32963668fbbe23e Sep 07 12:37:32.280837 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project Sep 07 12:37:32.280837 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:37:32.280837 n-d-852087-9 devstack@n-api.service[122432]: {"addFloatingIp": {"address": "172.25.8.172"}} Sep 07 12:37:32.280837 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:37:32.281878 n-d-852087-9 devstack@n-api.service[122432]: exception: Cannot associate floating IP 172.25.8.172 (71283e69-ed00-4e7b-b99e-28589d780ff0) with port d2cb7afc-63df-43ee-aefe-22e3a87e7b0d using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 5faca153-d2fc-423d-9176-48ca0ab99907. Sep 07 12:37:32.281878 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-d5c45a80-ba52-402a-bc52-a5bbd76690e0'] Sep 07 12:37:32.281878 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '4472f1be-6441-4955-b1a0-934980853ccf', 'body': {'addFloatingIp': {'address': '172.25.8.172'}}} Sep 07 12:37:32.281878 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:37:32.281878 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:32.281878 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Sep 07 12:37:32.281878 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Sep 07 12:37:32.281878 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:37:32.281878 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:37:32.281878 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Sep 07 12:37:32.281878 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Sep 07 12:37:32.281878 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:37:32.281878 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:37:32.281878 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Sep 07 12:37:32.281878 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Sep 07 12:37:32.281878 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:37:32.281878 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:37:32.283300 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Sep 07 12:37:32.283300 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Sep 07 12:37:32.283300 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:37:32.283300 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:37:32.283300 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 12:37:32.283300 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 12:37:32.283300 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:37:32.283300 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:37:32.283300 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 12:37:32.283300 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 12:37:32.283300 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:37:32.283300 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:37:32.283300 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 12:37:32.283300 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 12:37:32.283300 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 12:37:32.283300 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 12:37:32.284590 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.8.172 (71283e69-ed00-4e7b-b99e-28589d780ff0) with port d2cb7afc-63df-43ee-aefe-22e3a87e7b0d using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 5faca153-d2fc-423d-9176-48ca0ab99907. Sep 07 12:37:32.284590 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5c45a80-ba52-402a-bc52-a5bbd76690e0'] Sep 07 12:37:32.284590 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:32.284590 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:32.284590 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:32.284590 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:32.284590 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 07 12:37:32.284590 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 07 12:37:32.284590 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 07 12:37:32.284590 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 07 12:37:32.284590 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Sep 07 12:37:32.284590 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Sep 07 12:37:32.284590 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.8.172 (71283e69-ed00-4e7b-b99e-28589d780ff0) with port d2cb7afc-63df-43ee-aefe-22e3a87e7b0d using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 5faca153-d2fc-423d-9176-48ca0ab99907. Sep 07 12:37:32.284590 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5c45a80-ba52-402a-bc52-a5bbd76690e0'] Sep 07 12:37:32.284590 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:32.284590 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:32.285922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:32.285922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:32.285922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:32.285922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:32.285922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:37:32.285922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:37:32.285922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:37:32.285922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:37:32.285922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:37:32.285922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:37:32.285922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:37:32.285922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:37:32.285922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Sep 07 12:37:32.285922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 12:37:32.285922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.8.172 (71283e69-ed00-4e7b-b99e-28589d780ff0) with port d2cb7afc-63df-43ee-aefe-22e3a87e7b0d using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 5faca153-d2fc-423d-9176-48ca0ab99907. Sep 07 12:37:32.285922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5c45a80-ba52-402a-bc52-a5bbd76690e0'] Sep 07 12:37:32.285922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:32.285922 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:32.287461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:32.287461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:32.287461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:32.287461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:32.287461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:37:32.287461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:37:32.287461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.8.172 (71283e69-ed00-4e7b-b99e-28589d780ff0) with port d2cb7afc-63df-43ee-aefe-22e3a87e7b0d using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 5faca153-d2fc-423d-9176-48ca0ab99907. Sep 07 12:37:32.287461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5c45a80-ba52-402a-bc52-a5bbd76690e0'] Sep 07 12:37:32.287461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:32.287461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1b986cdf-2621-4ff1-8acd-ddc9b90fe460 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Returning 400 to user: Cannot associate floating IP 172.25.8.172 (71283e69-ed00-4e7b-b99e-28589d780ff0) with port d2cb7afc-63df-43ee-aefe-22e3a87e7b0d using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 5faca153-d2fc-423d-9176-48ca0ab99907. Sep 07 12:37:32.287461 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-d5c45a80-ba52-402a-bc52-a5bbd76690e0'] {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:37:32.290450 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1b986cdf-2621-4ff1-8acd-ddc9b90fe460 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "POST /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf/action" status: 400 len: 381 microversion: 2.1 time: 1.187238 Sep 07 12:37:32.291769 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1015/1971] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:37:31 2022] POST /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf/action => generated 381 bytes in 1193 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:37:32.307287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2d427c1f-635e-4815-ace2-9b7df4c42e53 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Action: 'create', calling method: .version_select at 0x7fc41978dca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1712743165", "description": "tempest-description-1056979360"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:33.239499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0fe09474-1558-4d7d-a8b1-f8321f164fa7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:37:33.241190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0fe09474-1558-4d7d-a8b1-f8321f164fa7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:37:33.245115 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0fe09474-1558-4d7d-a8b1-f8321f164fa7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:37:33.248400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0fe09474-1558-4d7d-a8b1-f8321f164fa7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:37:33.249389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0fe09474-1558-4d7d-a8b1-f8321f164fa7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:37:33.274920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fe09474-1558-4d7d-a8b1-f8321f164fa7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:33.275768 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2d427c1f-635e-4815-ace2-9b7df4c42e53 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.982334 Sep 07 12:37:33.276364 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1016/1972] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Sep 7 12:37:32 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:33.276996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fe09474-1558-4d7d-a8b1-f8321f164fa7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:33.277856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fe09474-1558-4d7d-a8b1-f8321f164fa7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:33.279552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fe09474-1558-4d7d-a8b1-f8321f164fa7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:33.280447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fe09474-1558-4d7d-a8b1-f8321f164fa7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:33.281093 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a1b35564-4250-4db6-a023-035f4a4fe9b8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:33.281427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fe09474-1558-4d7d-a8b1-f8321f164fa7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:33.282216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a1b35564-4250-4db6-a023-035f4a4fe9b8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:33.296203 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1b35564-4250-4db6-a023-035f4a4fe9b8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:33.299217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1b35564-4250-4db6-a023-035f4a4fe9b8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:33.300635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1b35564-4250-4db6-a023-035f4a4fe9b8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:33.301789 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1b35564-4250-4db6-a023-035f4a4fe9b8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:33.302480 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1b35564-4250-4db6-a023-035f4a4fe9b8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:33.303098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1b35564-4250-4db6-a023-035f4a4fe9b8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:33.316490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-0fe09474-1558-4d7d-a8b1-f8321f164fa7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Getting quotas for project dc00ac02c77f40f5ab6acbe538c9566b. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:37:33.327154 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-0fe09474-1558-4d7d-a8b1-f8321f164fa7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Getting quotas for user 41979e405fab49029d8ff5a9903e36ea and project dc00ac02c77f40f5ab6acbe538c9566b. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:37:33.347744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0fe09474-1558-4d7d-a8b1-f8321f164fa7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:37:33.351361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0fe09474-1558-4d7d-a8b1-f8321f164fa7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 16417424-f738-4fcf-8a54-4941ec487fa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:37:33.429720 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0fe09474-1558-4d7d-a8b1-f8321f164fa7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.893389 Sep 07 12:37:33.437167 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 957/1973] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:37:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:37:33.440219 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-05763116-f296-49fd-815b-0317451f9622 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:33.441370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-05763116-f296-49fd-815b-0317451f9622 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: b05fbd40-21c6-4c6c-9039-887cf2b9e6d8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:33.469336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05763116-f296-49fd-815b-0317451f9622 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:33.470258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05763116-f296-49fd-815b-0317451f9622 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:33.471018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05763116-f296-49fd-815b-0317451f9622 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:33.472261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05763116-f296-49fd-815b-0317451f9622 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:33.473103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05763116-f296-49fd-815b-0317451f9622 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:33.473907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05763116-f296-49fd-815b-0317451f9622 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:33.527833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a1b35564-4250-4db6-a023-035f4a4fe9b8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:33.537158 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a1b35564-4250-4db6-a023-035f4a4fe9b8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 0.259610 Sep 07 12:37:33.553990 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1017/1974] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:33 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:33.563094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e1a099c9-2224-4294-8424-846229de03b8 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:33.564059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e1a099c9-2224-4294-8424-846229de03b8 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2c8319cb-1eff-4ea4-9b2f-37ac6035c490] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:33.571232 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1a099c9-2224-4294-8424-846229de03b8 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:33.572022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1a099c9-2224-4294-8424-846229de03b8 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:33.573972 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1a099c9-2224-4294-8424-846229de03b8 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:33.575138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1a099c9-2224-4294-8424-846229de03b8 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:33.576113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1a099c9-2224-4294-8424-846229de03b8 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:33.576725 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1a099c9-2224-4294-8424-846229de03b8 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:33.859417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-05763116-f296-49fd-815b-0317451f9622 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:33.875666 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-05763116-f296-49fd-815b-0317451f9622 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8" status: 200 len: 1502 microversion: 2.1 time: 0.442388 Sep 07 12:37:33.889566 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 958/1975] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:33 2022] GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 => generated 1502 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:33.889566 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f0c137fd-c8fb-4dc5-a2ab-7ad3ba1d4fe0 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Calling method '.version_select at 0x7fc418935b80>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:34.000406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e1a099c9-2224-4294-8424-846229de03b8 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:34.044264 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e1a099c9-2224-4294-8424-846229de03b8 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490" status: 200 len: 1308 microversion: 2.1 time: 0.475603 Sep 07 12:37:34.047133 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1018/1976] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:33 2022] GET /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490 => generated 1308 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:34.060710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-0321e665-3a13-4859-8826-b1bd49b92bcd req-bcd2223c-b3ae-4911-a50e-b3ac75941c75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c8319cb-1eff-4ea4-9b2f-37ac6035c490", "name": "network-vif-plugged", "status": "completed", "tag": "b221a19c-0a57-40d9-8f2b-5759655c8975"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:34.104037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0321e665-3a13-4859-8826-b1bd49b92bcd req-bcd2223c-b3ae-4911-a50e-b3ac75941c75 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:34.105556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0321e665-3a13-4859-8826-b1bd49b92bcd req-bcd2223c-b3ae-4911-a50e-b3ac75941c75 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:34.106866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0321e665-3a13-4859-8826-b1bd49b92bcd req-bcd2223c-b3ae-4911-a50e-b3ac75941c75 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:34.132401 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-0321e665-3a13-4859-8826-b1bd49b92bcd req-bcd2223c-b3ae-4911-a50e-b3ac75941c75 service nova] Creating event network-vif-plugged:b221a19c-0a57-40d9-8f2b-5759655c8975 for instance 2c8319cb-1eff-4ea4-9b2f-37ac6035c490 on n-h2-852087-9 Sep 07 12:37:34.144106 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-0321e665-3a13-4859-8826-b1bd49b92bcd req-bcd2223c-b3ae-4911-a50e-b3ac75941c75 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094771 Sep 07 12:37:34.148697 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1019/1977] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:34.157044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2bb50987-fede-42b0-ac45-fca3e0523104 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Action: 'create', calling method: .version_select at 0x7fc41971e430>, body: {"security_group_rule": {"parent_group_id": "73d929d4-9de8-4a7c-a812-dafdcf95fba1", "ip_protocol": "tcp", "from_port": 1964666793, "to_port": 22}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:34.389828 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-2bb50987-fede-42b0-ac45-fca3e0523104 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] HTTP exception thrown: Invalid port range 1964666793:22. Former value cannot be greater than the later Sep 07 12:37:34.392216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2bb50987-fede-42b0-ac45-fca3e0523104 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Request method failure captured: Sep 07 12:37:34.392216 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 07 12:37:34.392216 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:37:34.392216 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:37:34.392216 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:37:34.392216 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 146 Sep 07 12:37:34.392216 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:37:34.392216 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:37:34.392216 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:37:34.392216 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:37:34.392216 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJCAl1SuViaHSWLkzmThpDbvJWx_k0VBILDKcDx3NIgYmrlT6WWF-HkHZ8XOc7WYAeu5xoeaU637SCWJ_DPjQBJKaKOMz000eBLxUimwI255LbZapKKhQXa1VZldUTf2c3rb-PbEyyqOSUYW5-z9IhwuSH7K8c7W1_TQLEn_c7c3WkE Sep 07 12:37:34.392216 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:37:34.392216 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:37:34.392216 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:37:34.392216 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:37:34.392216 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:37:34.392216 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:37:34.392216 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8020b3b90cfa4f84ae9003e6884da03c Sep 07 12:37:34.392216 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1168758300 Sep 07 12:37:34.392216 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:37:34.392216 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:37:34.393832 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:37:34.393832 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1168758300 Sep 07 12:37:34.393832 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8020b3b90cfa4f84ae9003e6884da03c Sep 07 12:37:34.393832 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1168758300 Sep 07 12:37:34.393832 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project Sep 07 12:37:34.393832 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:37:34.393832 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:37:34.393832 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: cbe66dab00d0478d81b5e5e4a45fb0df Sep 07 12:37:34.393832 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project Sep 07 12:37:34.393832 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:37:34.393832 n-d-852087-9 devstack@n-api.service[122432]: {"security_group_rule": {"parent_group_id": "73d929d4-9de8-4a7c-a812-dafdcf95fba1", "ip_protocol": "tcp", "from_port": 1964666793, "to_port": 22}} Sep 07 12:37:34.393832 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:37:34.394697 n-d-852087-9 devstack@n-api.service[122432]: exception: Invalid port range 1964666793:22. Former value cannot be greater than the later Sep 07 12:37:34.394697 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'security_group_rule': {'parent_group_id': '73d929d4-9de8-4a7c-a812-dafdcf95fba1', 'ip_protocol': 'tcp', 'from_port': 1964666793, 'to_port': 22}}} Sep 07 12:37:34.394697 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:37:34.394697 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:34.394697 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 07 12:37:34.394697 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 07 12:37:34.394697 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 07 12:37:34.394697 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 07 12:37:34.394697 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 07 12:37:34.394697 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 07 12:37:34.394697 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 07 12:37:34.394697 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 07 12:37:34.394697 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1964666793:22. Former value cannot be greater than the later Sep 07 12:37:34.394697 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:34.394697 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:34.394697 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:34.394697 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:34.394697 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:34.394697 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:34.396270 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:37:34.396270 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:37:34.396270 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:37:34.396270 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:37:34.396270 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:37:34.396270 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:37:34.396270 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 07 12:37:34.396270 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 07 12:37:34.396270 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1964666793:22. Former value cannot be greater than the later Sep 07 12:37:34.396270 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:34.396270 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:34.396270 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:34.396270 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:34.396270 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:34.396270 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:34.396270 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:37:34.396270 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:37:34.396270 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1964666793:22. Former value cannot be greater than the later Sep 07 12:37:34.396270 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:34.397639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2bb50987-fede-42b0-ac45-fca3e0523104 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Returning 400 to user: Invalid port range 1964666793:22. Former value cannot be greater than the later {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:37:34.397639 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2bb50987-fede-42b0-ac45-fca3e0523104 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.242862 Sep 07 12:37:34.397639 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1020/1978] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Sep 7 12:37:34 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 245 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:37:34.409042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f4c98b9a-adef-4cf6-a262-43e8ca01923e tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:34.414217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f4c98b9a-adef-4cf6-a262-43e8ca01923e tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 16417424-f738-4fcf-8a54-4941ec487fa4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:34.545667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f4c98b9a-adef-4cf6-a262-43e8ca01923e tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41979e405fab49029d8ff5a9903e36ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00ac02c77f40f5ab6acbe538c9566b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:34.553566 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f4c98b9a-adef-4cf6-a262-43e8ca01923e tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "GET /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4" status: 200 len: 1223 microversion: 2.1 time: 0.153149 Sep 07 12:37:34.554165 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1021/1979] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:34 2022] GET /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4 => generated 1223 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:34.560663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e38f563-958d-44f2-a687-7dee3a7441a5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:34.563040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6e38f563-958d-44f2-a687-7dee3a7441a5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: b05fbd40-21c6-4c6c-9039-887cf2b9e6d8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:34.579843 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e38f563-958d-44f2-a687-7dee3a7441a5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:34.580457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e38f563-958d-44f2-a687-7dee3a7441a5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:34.581263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e38f563-958d-44f2-a687-7dee3a7441a5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:34.582197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e38f563-958d-44f2-a687-7dee3a7441a5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:34.583256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e38f563-958d-44f2-a687-7dee3a7441a5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:34.583827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e38f563-958d-44f2-a687-7dee3a7441a5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:34.652398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6e38f563-958d-44f2-a687-7dee3a7441a5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: b05fbd40-21c6-4c6c-9039-887cf2b9e6d8] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:37:34.812934 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6e38f563-958d-44f2-a687-7dee3a7441a5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8" status: 204 len: 0 microversion: 2.1 time: 0.256089 Sep 07 12:37:34.814198 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1022/1980] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:37:34 2022] DELETE /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:37:34.821666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-551e378d-07e5-4355-b333-7f0a4dbb1ebe tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Action: 'create', calling method: .version_select at 0x7fc41978d280>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1187292903", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:34.825064 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-551e378d-07e5-4355-b333-7f0a4dbb1ebe tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] HTTP exception thrown: Security group id should be uuid Sep 07 12:37:34.828115 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-551e378d-07e5-4355-b333-7f0a4dbb1ebe tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Request method failure captured: Sep 07 12:37:34.828115 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 07 12:37:34.828115 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:37:34.828115 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:37:34.828115 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:37:34.828115 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 131 Sep 07 12:37:34.828115 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:37:34.828115 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:37:34.828115 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:37:34.828115 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:37:34.828115 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJCAl1SuViaHSWLkzmThpDbvJWx_k0VBILDKcDx3NIgYmrlT6WWF-HkHZ8XOc7WYAeu5xoeaU637SCWJ_DPjQBJKaKOMz000eBLxUimwI255LbZapKKhQXa1VZldUTf2c3rb-PbEyyqOSUYW5-z9IhwuSH7K8c7W1_TQLEn_c7c3WkE Sep 07 12:37:34.828115 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:37:34.828115 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:37:34.828115 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:37:34.828115 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:37:34.828115 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:37:34.828115 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:37:34.828115 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8020b3b90cfa4f84ae9003e6884da03c Sep 07 12:37:34.828115 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1168758300 Sep 07 12:37:34.828115 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:37:34.828115 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:37:34.830916 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:37:34.830916 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1168758300 Sep 07 12:37:34.830916 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8020b3b90cfa4f84ae9003e6884da03c Sep 07 12:37:34.830916 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1168758300 Sep 07 12:37:34.830916 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project Sep 07 12:37:34.830916 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:37:34.830916 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:37:34.830916 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: cbe66dab00d0478d81b5e5e4a45fb0df Sep 07 12:37:34.830916 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project Sep 07 12:37:34.830916 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:37:34.830916 n-d-852087-9 devstack@n-api.service[122432]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1187292903", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 07 12:37:34.830916 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:37:34.830916 n-d-852087-9 devstack@n-api.service[122432]: exception: Security group id should be uuid Sep 07 12:37:34.832533 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1187292903', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 07 12:37:34.832533 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:37:34.832533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:34.832533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Sep 07 12:37:34.832533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Sep 07 12:37:34.832533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Sep 07 12:37:34.832533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 07 12:37:34.832533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Sep 07 12:37:34.832533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:34.832533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:34.832533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:34.832533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:34.832533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:34.832533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:34.832533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:37:34.832533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:37:34.832533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:37:34.832533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:37:34.832533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:37:34.832533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:37:34.836596 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 07 12:37:34.836596 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 07 12:37:34.836596 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Sep 07 12:37:34.836596 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:34.836596 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:34.836596 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:34.836596 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:34.836596 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:34.836596 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:34.836596 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:37:34.836596 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:37:34.836596 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Sep 07 12:37:34.836596 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:34.836596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-551e378d-07e5-4355-b333-7f0a4dbb1ebe tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Returning 400 to user: Security group id should be uuid {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:37:34.836596 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-551e378d-07e5-4355-b333-7f0a4dbb1ebe tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.015100 Sep 07 12:37:34.842215 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1023/1981] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Sep 7 12:37:34 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 07 12:37:34.842215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fa6e5e33-be60-4df0-9dac-e6c8a3e2b9bb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:34.842215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fa6e5e33-be60-4df0-9dac-e6c8a3e2b9bb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:34.852030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa6e5e33-be60-4df0-9dac-e6c8a3e2b9bb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:34.852643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa6e5e33-be60-4df0-9dac-e6c8a3e2b9bb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:34.853333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa6e5e33-be60-4df0-9dac-e6c8a3e2b9bb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:34.854269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa6e5e33-be60-4df0-9dac-e6c8a3e2b9bb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:34.854814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa6e5e33-be60-4df0-9dac-e6c8a3e2b9bb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:34.855427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa6e5e33-be60-4df0-9dac-e6c8a3e2b9bb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:35.233624 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fa6e5e33-be60-4df0-9dac-e6c8a3e2b9bb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:35.243914 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fa6e5e33-be60-4df0-9dac-e6c8a3e2b9bb tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 0.410696 Sep 07 12:37:35.245373 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1024/1982] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:34 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:35.250973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1b0b0728-9d0c-457e-ada0-7612e498ac70 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:35.251722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1b0b0728-9d0c-457e-ada0-7612e498ac70 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: b05fbd40-21c6-4c6c-9039-887cf2b9e6d8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:35.263311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b0b0728-9d0c-457e-ada0-7612e498ac70 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:35.263956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b0b0728-9d0c-457e-ada0-7612e498ac70 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:35.264498 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b0b0728-9d0c-457e-ada0-7612e498ac70 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:35.265684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b0b0728-9d0c-457e-ada0-7612e498ac70 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:35.266248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b0b0728-9d0c-457e-ada0-7612e498ac70 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:35.266741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b0b0728-9d0c-457e-ada0-7612e498ac70 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:35.273978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:37:35.592614 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f0c137fd-c8fb-4dc5-a2ab-7ad3ba1d4fe0 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/71283e69-ed00-4e7b-b99e-28589d780ff0" status: 202 len: 0 microversion: 2.1 time: 1.714644 Sep 07 12:37:35.598000 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 959/1983] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Sep 7 12:37:33 2022] DELETE /compute/v2.1/os-floating-ips/71283e69-ed00-4e7b-b99e-28589d780ff0 => generated 0 bytes in 1721 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:37:35.603594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-307d4dbe-2658-449d-9949-094ac44224cf tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Action: 'create', calling method: .version_select at 0x7fc418935dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1473864792", "description": "tempest-description-504842219"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:35.615666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1b0b0728-9d0c-457e-ada0-7612e498ac70 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:35.627008 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1b0b0728-9d0c-457e-ada0-7612e498ac70 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8" status: 200 len: 1508 microversion: 2.1 time: 0.380291 Sep 07 12:37:35.628483 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1025/1984] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:35 2022] GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 => generated 1508 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:35.635212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-79ac8641-27f5-4e44-8301-a5e7ea1cd057 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:35.636445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-79ac8641-27f5-4e44-8301-a5e7ea1cd057 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2c8319cb-1eff-4ea4-9b2f-37ac6035c490] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:35.644000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79ac8641-27f5-4e44-8301-a5e7ea1cd057 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:35.644914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79ac8641-27f5-4e44-8301-a5e7ea1cd057 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:35.645655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79ac8641-27f5-4e44-8301-a5e7ea1cd057 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:35.646854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79ac8641-27f5-4e44-8301-a5e7ea1cd057 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:35.647781 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79ac8641-27f5-4e44-8301-a5e7ea1cd057 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:35.648452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79ac8641-27f5-4e44-8301-a5e7ea1cd057 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:36.093113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-79ac8641-27f5-4e44-8301-a5e7ea1cd057 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:36.108596 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-307d4dbe-2658-449d-9949-094ac44224cf tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.505908 Sep 07 12:37:36.122676 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 960/1985] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Sep 7 12:37:35 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:36.127919 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-79ac8641-27f5-4e44-8301-a5e7ea1cd057 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490" status: 200 len: 1308 microversion: 2.1 time: 0.494548 Sep 07 12:37:36.138950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-94155064-f051-4861-a32d-ffe881620396 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:36.141337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-94155064-f051-4861-a32d-ffe881620396 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 16417424-f738-4fcf-8a54-4941ec487fa4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:36.146054 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1026/1986] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:35 2022] GET /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490 => generated 1308 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:36.161204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7a2322f6-a818-41aa-aef4-103daaf13883 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Action: 'action', calling method: .version_select at 0x7fc41abe43a0>, body: {"removeFloatingIp": {"address": "172.25.8.169"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:36.166715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94155064-f051-4861-a32d-ffe881620396 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:36.168445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94155064-f051-4861-a32d-ffe881620396 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:36.183461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94155064-f051-4861-a32d-ffe881620396 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:36.189876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94155064-f051-4861-a32d-ffe881620396 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:36.191628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94155064-f051-4861-a32d-ffe881620396 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:36.192608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94155064-f051-4861-a32d-ffe881620396 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:36.324934 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-94155064-f051-4861-a32d-ffe881620396 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41979e405fab49029d8ff5a9903e36ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00ac02c77f40f5ab6acbe538c9566b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:36.349683 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-94155064-f051-4861-a32d-ffe881620396 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "GET /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4" status: 200 len: 1281 microversion: 2.1 time: 0.224363 Sep 07 12:37:36.353912 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 961/1987] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:36 2022] GET /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4 => generated 1281 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:36.364239 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-90fa6153-263c-4398-aee2-caee50ebcf09 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Action: 'create', calling method: .version_select at 0x7fc419523a60>, body: {"security_group_rule": {"parent_group_id": "8e250323-4fca-4b90-969a-619d3724b786", "ip_protocol": "tempest-999-156892720", "from_port": 22, "to_port": 22}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:36.445055 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-90fa6153-263c-4398-aee2-caee50ebcf09 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] HTTP exception thrown: Invalid IP protocol tempest-999-156892720. Sep 07 12:37:36.449246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-90fa6153-263c-4398-aee2-caee50ebcf09 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Request method failure captured: Sep 07 12:37:36.449246 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 07 12:37:36.449246 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:37:36.449246 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:37:36.449246 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:37:36.449246 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 156 Sep 07 12:37:36.449246 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:37:36.449246 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:37:36.449246 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:37:36.449246 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:37:36.449246 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJCAl1SuViaHSWLkzmThpDbvJWx_k0VBILDKcDx3NIgYmrlT6WWF-HkHZ8XOc7WYAeu5xoeaU637SCWJ_DPjQBJKaKOMz000eBLxUimwI255LbZapKKhQXa1VZldUTf2c3rb-PbEyyqOSUYW5-z9IhwuSH7K8c7W1_TQLEn_c7c3WkE Sep 07 12:37:36.449246 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:37:36.449246 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:37:36.449246 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:37:36.449246 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:37:36.449246 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:37:36.449246 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:37:36.449246 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8020b3b90cfa4f84ae9003e6884da03c Sep 07 12:37:36.449246 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1168758300 Sep 07 12:37:36.449246 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:37:36.449246 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:37:36.452869 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:37:36.452869 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1168758300 Sep 07 12:37:36.452869 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8020b3b90cfa4f84ae9003e6884da03c Sep 07 12:37:36.452869 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1168758300 Sep 07 12:37:36.452869 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project Sep 07 12:37:36.452869 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:37:36.452869 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:37:36.452869 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: cbe66dab00d0478d81b5e5e4a45fb0df Sep 07 12:37:36.452869 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project Sep 07 12:37:36.452869 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:37:36.452869 n-d-852087-9 devstack@n-api.service[122433]: {"security_group_rule": {"parent_group_id": "8e250323-4fca-4b90-969a-619d3724b786", "ip_protocol": "tempest-999-156892720", "from_port": 22, "to_port": 22}} Sep 07 12:37:36.452869 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:37:36.455525 n-d-852087-9 devstack@n-api.service[122433]: exception: Invalid IP protocol tempest-999-156892720. Sep 07 12:37:36.455525 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8e250323-4fca-4b90-969a-619d3724b786', 'ip_protocol': 'tempest-999-156892720', 'from_port': 22, 'to_port': 22}}} Sep 07 12:37:36.455525 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:37:36.455525 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:36.455525 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 07 12:37:36.455525 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 07 12:37:36.455525 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 07 12:37:36.455525 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 07 12:37:36.455525 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 07 12:37:36.455525 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 07 12:37:36.455525 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Sep 07 12:37:36.455525 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Sep 07 12:37:36.455525 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-156892720. Sep 07 12:37:36.455525 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:36.455525 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:36.455525 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:36.455525 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:36.455525 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:36.455525 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:36.458534 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:37:36.458534 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:37:36.458534 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:37:36.458534 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:37:36.458534 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:37:36.458534 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:37:36.458534 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 07 12:37:36.458534 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 07 12:37:36.458534 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-156892720. Sep 07 12:37:36.458534 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:36.458534 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:36.458534 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:36.458534 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:36.458534 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:36.458534 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:36.458534 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:37:36.458534 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:37:36.458534 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-156892720. Sep 07 12:37:36.458534 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:36.462924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-90fa6153-263c-4398-aee2-caee50ebcf09 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Returning 400 to user: Invalid IP protocol tempest-999-156892720. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:37:36.462924 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-90fa6153-263c-4398-aee2-caee50ebcf09 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.099971 Sep 07 12:37:36.468457 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 962/1988] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Sep 7 12:37:36 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 07 12:37:36.479419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-599cefe2-4135-4c55-9bcc-3b1b3c9deeb4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:36.480861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-599cefe2-4135-4c55-9bcc-3b1b3c9deeb4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:36.496973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-599cefe2-4135-4c55-9bcc-3b1b3c9deeb4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:36.498232 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-599cefe2-4135-4c55-9bcc-3b1b3c9deeb4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:36.502067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-599cefe2-4135-4c55-9bcc-3b1b3c9deeb4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:36.506138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-599cefe2-4135-4c55-9bcc-3b1b3c9deeb4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:36.507363 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-599cefe2-4135-4c55-9bcc-3b1b3c9deeb4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:36.509294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-599cefe2-4135-4c55-9bcc-3b1b3c9deeb4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:36.575543 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7a2322f6-a818-41aa-aef4-103daaf13883 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:36.593257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a2322f6-a818-41aa-aef4-103daaf13883 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:36.594192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a2322f6-a818-41aa-aef4-103daaf13883 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:36.595107 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a2322f6-a818-41aa-aef4-103daaf13883 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:36.596405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a2322f6-a818-41aa-aef4-103daaf13883 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:36.605570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a2322f6-a818-41aa-aef4-103daaf13883 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:36.606752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a2322f6-a818-41aa-aef4-103daaf13883 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:36.817407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-599cefe2-4135-4c55-9bcc-3b1b3c9deeb4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:36.834634 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-599cefe2-4135-4c55-9bcc-3b1b3c9deeb4 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 0.363921 Sep 07 12:37:36.836999 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 963/1989] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:36 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:36.847880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7471cce5-e61d-4aab-8217-2bb0afa58a87 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Action: 'create', calling method: .version_select at 0x7fc419523dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-438698934", "description": "tempest-description-1083020422"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:37.046753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a2322f6-a818-41aa-aef4-103daaf13883 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "refresh_cache-4472f1be-6441-4955-b1a0-934980853ccf" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 12:37:37.047671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a2322f6-a818-41aa-aef4-103daaf13883 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquired lock "refresh_cache-4472f1be-6441-4955-b1a0-934980853ccf" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 12:37:37.659292 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7471cce5-e61d-4aab-8217-2bb0afa58a87 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.820288 Sep 07 12:37:37.660469 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 964/1990] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Sep 7 12:37:36 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:37.665776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a30064a5-1dba-47ce-b6dc-1d8be6610a0c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:37.667009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a30064a5-1dba-47ce-b6dc-1d8be6610a0c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: b05fbd40-21c6-4c6c-9039-887cf2b9e6d8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:37.707579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a30064a5-1dba-47ce-b6dc-1d8be6610a0c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:37.714356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a30064a5-1dba-47ce-b6dc-1d8be6610a0c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:37.716261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a30064a5-1dba-47ce-b6dc-1d8be6610a0c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:37.721689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a30064a5-1dba-47ce-b6dc-1d8be6610a0c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:37.727401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a30064a5-1dba-47ce-b6dc-1d8be6610a0c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:37.732792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a30064a5-1dba-47ce-b6dc-1d8be6610a0c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:38.167501 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a30064a5-1dba-47ce-b6dc-1d8be6610a0c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:38.179022 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a30064a5-1dba-47ce-b6dc-1d8be6610a0c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8" status: 200 len: 1508 microversion: 2.1 time: 0.517564 Sep 07 12:37:38.179590 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 965/1991] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:37 2022] GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 => generated 1508 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:38.187376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aa06ea7b-178c-4a10-ad70-18d09e44dfe9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:38.188001 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aa06ea7b-178c-4a10-ad70-18d09e44dfe9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2c8319cb-1eff-4ea4-9b2f-37ac6035c490] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:38.200984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa06ea7b-178c-4a10-ad70-18d09e44dfe9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:38.201339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa06ea7b-178c-4a10-ad70-18d09e44dfe9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:38.201760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa06ea7b-178c-4a10-ad70-18d09e44dfe9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:38.202768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa06ea7b-178c-4a10-ad70-18d09e44dfe9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:38.203964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa06ea7b-178c-4a10-ad70-18d09e44dfe9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:38.204187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa06ea7b-178c-4a10-ad70-18d09e44dfe9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:38.499871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aa06ea7b-178c-4a10-ad70-18d09e44dfe9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:38.510473 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aa06ea7b-178c-4a10-ad70-18d09e44dfe9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490" status: 200 len: 1487 microversion: 2.1 time: 0.328973 Sep 07 12:37:38.518171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-7a2322f6-a818-41aa-aef4-103daaf13883 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] Building network info cache for instance {{(pid=122432) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 07 12:37:38.556839 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 966/1992] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:38 2022] GET /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490 => generated 1487 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:38.585046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1ad46e67-d939-4cce-b5d0-f022f4bc9d7f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:38.592587 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1ad46e67-d939-4cce-b5d0-f022f4bc9d7f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 16417424-f738-4fcf-8a54-4941ec487fa4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:38.635654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ad46e67-d939-4cce-b5d0-f022f4bc9d7f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:38.636966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ad46e67-d939-4cce-b5d0-f022f4bc9d7f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:38.643017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ad46e67-d939-4cce-b5d0-f022f4bc9d7f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:38.644425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ad46e67-d939-4cce-b5d0-f022f4bc9d7f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:38.645312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ad46e67-d939-4cce-b5d0-f022f4bc9d7f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:38.656187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ad46e67-d939-4cce-b5d0-f022f4bc9d7f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:40.468391 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1ad46e67-d939-4cce-b5d0-f022f4bc9d7f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41979e405fab49029d8ff5a9903e36ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00ac02c77f40f5ab6acbe538c9566b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:40.485891 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1ad46e67-d939-4cce-b5d0-f022f4bc9d7f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "GET /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4" status: 200 len: 1323 microversion: 2.1 time: 1.923700 Sep 07 12:37:40.494907 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 967/1993] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:38 2022] GET /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4 => generated 1323 bytes in 1937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:40.507586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e2c96f5a-cdb4-42b4-bba0-52ba6be221ff tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Action: 'create', calling method: .version_select at 0x7fc4189fab80>, body: {"security_group_rule": {"parent_group_id": "ac52201a-8b6c-4fe3-9bb5-793ac481ef0b", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:40.888087 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-e2c96f5a-cdb4-42b4-bba0-52ba6be221ff tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Sep 07 12:37:40.905357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e2c96f5a-cdb4-42b4-bba0-52ba6be221ff tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Request method failure captured: Sep 07 12:37:40.905357 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 07 12:37:40.905357 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:37:40.905357 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:37:40.905357 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:37:40.905357 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 138 Sep 07 12:37:40.905357 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:37:40.905357 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:37:40.905357 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:37:40.905357 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:37:40.905357 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJCAl1SuViaHSWLkzmThpDbvJWx_k0VBILDKcDx3NIgYmrlT6WWF-HkHZ8XOc7WYAeu5xoeaU637SCWJ_DPjQBJKaKOMz000eBLxUimwI255LbZapKKhQXa1VZldUTf2c3rb-PbEyyqOSUYW5-z9IhwuSH7K8c7W1_TQLEn_c7c3WkE Sep 07 12:37:40.905357 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:37:40.905357 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:37:40.905357 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:37:40.905357 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:37:40.905357 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:37:40.905357 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:37:40.905357 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8020b3b90cfa4f84ae9003e6884da03c Sep 07 12:37:40.905357 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1168758300 Sep 07 12:37:40.905357 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:37:40.905357 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:37:40.907178 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:37:40.907178 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1168758300 Sep 07 12:37:40.907178 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8020b3b90cfa4f84ae9003e6884da03c Sep 07 12:37:40.907178 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1168758300 Sep 07 12:37:40.907178 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project Sep 07 12:37:40.907178 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:37:40.907178 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:37:40.907178 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: cbe66dab00d0478d81b5e5e4a45fb0df Sep 07 12:37:40.907178 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project Sep 07 12:37:40.907178 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:37:40.907178 n-d-852087-9 devstack@n-api.service[122433]: {"security_group_rule": {"parent_group_id": "ac52201a-8b6c-4fe3-9bb5-793ac481ef0b", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Sep 07 12:37:40.907178 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:37:40.908020 n-d-852087-9 devstack@n-api.service[122433]: exception: Invalid port range 22:21. Former value cannot be greater than the later Sep 07 12:37:40.908020 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ac52201a-8b6c-4fe3-9bb5-793ac481ef0b', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Sep 07 12:37:40.908020 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:37:40.908020 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:40.908020 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 07 12:37:40.908020 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 07 12:37:40.908020 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 07 12:37:40.908020 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 07 12:37:40.908020 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 07 12:37:40.908020 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 07 12:37:40.908020 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 07 12:37:40.908020 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 07 12:37:40.908020 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Sep 07 12:37:40.908020 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:40.908020 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:40.908020 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:40.908020 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:40.908020 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:40.908020 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:40.909648 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:37:40.909648 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:37:40.909648 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:37:40.909648 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:37:40.909648 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:37:40.909648 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:37:40.909648 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 07 12:37:40.909648 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 07 12:37:40.909648 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Sep 07 12:37:40.909648 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:40.909648 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:40.909648 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:40.909648 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:40.909648 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:40.909648 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:40.909648 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:37:40.909648 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:37:40.909648 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Sep 07 12:37:40.909648 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:40.911504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e2c96f5a-cdb4-42b4-bba0-52ba6be221ff tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:37:40.911504 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e2c96f5a-cdb4-42b4-bba0-52ba6be221ff tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.412379 Sep 07 12:37:40.912581 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 968/1994] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Sep 7 12:37:40 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 417 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:37:40.918671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b13f6b8e-5cb0-43b2-a5a6-406a2ef5d3d7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:40.919505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b13f6b8e-5cb0-43b2-a5a6-406a2ef5d3d7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:40.929590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b13f6b8e-5cb0-43b2-a5a6-406a2ef5d3d7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:40.930863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b13f6b8e-5cb0-43b2-a5a6-406a2ef5d3d7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:40.931391 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b13f6b8e-5cb0-43b2-a5a6-406a2ef5d3d7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:40.932686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b13f6b8e-5cb0-43b2-a5a6-406a2ef5d3d7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:40.933256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b13f6b8e-5cb0-43b2-a5a6-406a2ef5d3d7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:40.934825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b13f6b8e-5cb0-43b2-a5a6-406a2ef5d3d7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:41.158869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b13f6b8e-5cb0-43b2-a5a6-406a2ef5d3d7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:41.170806 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b13f6b8e-5cb0-43b2-a5a6-406a2ef5d3d7 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 0.256694 Sep 07 12:37:41.187186 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 969/1995] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:40 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:41.211361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a03add7c-67b2-4b39-ae96-44d2a6504769 req-3f8287ca-dbb2-419c-a389-3fc9535e3640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4472f1be-6441-4955-b1a0-934980853ccf", "tag": "d2cb7afc-63df-43ee-aefe-22e3a87e7b0d"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:41.234530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a03add7c-67b2-4b39-ae96-44d2a6504769 req-3f8287ca-dbb2-419c-a389-3fc9535e3640 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:41.235302 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a03add7c-67b2-4b39-ae96-44d2a6504769 req-3f8287ca-dbb2-419c-a389-3fc9535e3640 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:41.235936 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a03add7c-67b2-4b39-ae96-44d2a6504769 req-3f8287ca-dbb2-419c-a389-3fc9535e3640 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:41.254741 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a03add7c-67b2-4b39-ae96-44d2a6504769 req-3f8287ca-dbb2-419c-a389-3fc9535e3640 service nova] Creating event network-changed:d2cb7afc-63df-43ee-aefe-22e3a87e7b0d for instance 4472f1be-6441-4955-b1a0-934980853ccf on n-h2-852087-9 Sep 07 12:37:41.260715 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a03add7c-67b2-4b39-ae96-44d2a6504769 req-3f8287ca-dbb2-419c-a389-3fc9535e3640 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062885 Sep 07 12:37:41.262036 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 970/1996] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:41.267707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d9b3064-5c51-4c45-b88f-d089c130f650 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:41.269643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1d9b3064-5c51-4c45-b88f-d089c130f650 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2c8319cb-1eff-4ea4-9b2f-37ac6035c490] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:41.280632 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d9b3064-5c51-4c45-b88f-d089c130f650 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:41.281507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d9b3064-5c51-4c45-b88f-d089c130f650 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:41.282129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d9b3064-5c51-4c45-b88f-d089c130f650 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:41.283072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d9b3064-5c51-4c45-b88f-d089c130f650 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:41.283717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d9b3064-5c51-4c45-b88f-d089c130f650 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:41.284316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d9b3064-5c51-4c45-b88f-d089c130f650 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:41.316526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-1d9b3064-5c51-4c45-b88f-d089c130f650 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lazy-loading 'flavor' on Instance uuid 2c8319cb-1eff-4ea4-9b2f-37ac6035c490 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:37:41.383639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-7a2322f6-a818-41aa-aef4-103daaf13883 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] Updating instance_info_cache with network_info: [{"id": "d2cb7afc-63df-43ee-aefe-22e3a87e7b0d", "address": "fa:16:3e:fb:be:29", "network": {"id": "fbdf8ec3-7207-4081-80bb-109d3ec18fae", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-49367386-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7e13a7ebce0646f8aea71d49eaa698d1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd2cb7afc-63", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122432) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 07 12:37:41.406736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a2322f6-a818-41aa-aef4-103daaf13883 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Releasing lock "refresh_cache-4472f1be-6441-4955-b1a0-934980853ccf" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 12:37:41.407921 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7a2322f6-a818-41aa-aef4-103daaf13883 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "POST /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf/action" status: 202 len: 0 microversion: 2.1 time: 5.258915 Sep 07 12:37:41.408743 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1027/1997] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:37:36 2022] POST /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf/action => generated 0 bytes in 5262 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 07 12:37:41.415339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-86f2b245-2ef0-4c9f-a4ff-68d111c1f9c8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:41.416305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-86f2b245-2ef0-4c9f-a4ff-68d111c1f9c8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: b05fbd40-21c6-4c6c-9039-887cf2b9e6d8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:41.427431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86f2b245-2ef0-4c9f-a4ff-68d111c1f9c8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:41.428526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86f2b245-2ef0-4c9f-a4ff-68d111c1f9c8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:41.429370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86f2b245-2ef0-4c9f-a4ff-68d111c1f9c8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:41.430160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86f2b245-2ef0-4c9f-a4ff-68d111c1f9c8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:41.430632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86f2b245-2ef0-4c9f-a4ff-68d111c1f9c8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:41.431061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86f2b245-2ef0-4c9f-a4ff-68d111c1f9c8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:41.448148 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-86f2b245-2ef0-4c9f-a4ff-68d111c1f9c8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] HTTP exception thrown: Instance b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 could not be found. Sep 07 12:37:41.450682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-86f2b245-2ef0-4c9f-a4ff-68d111c1f9c8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Request method failure captured: Sep 07 12:37:41.450682 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 HTTP/1.1 Sep 07 12:37:41.450682 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:37:41.450682 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:37:41.450682 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:37:41.450682 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:37:41.450682 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:37:41.450682 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:37:41.450682 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:37:41.450682 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:37:41.450682 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJBoiaP7MPiSaP6e6aUmMJ8PuR8TxD72E3ycIsoyb5pICiti0ZKBvrRvNoP9EgDHIO9YzOUucG9iu3oQZMsvYh9Gs4g9xjGSFcMGctGxplJk2OO0Aofdu3Ru80K0M86m3EPIBI5c12Fca4rxAASE3osSSig78ynw4pFvNNSiXm2zkBk Sep 07 12:37:41.450682 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:37:41.450682 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:37:41.450682 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:37:41.450682 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:37:41.450682 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:37:41.450682 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:37:41.450682 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:37:41.450682 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:37:41.450682 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:37:41.450682 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:37:41.453093 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef5b2dd007e944358d72268414868096"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef5b2dd007e944358d72268414868096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:37:41.453093 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:37:41.453093 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:37:41.453093 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:37:41.453093 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:37:41.453093 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:37:41.453093 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:37:41.453093 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: b920811be01745fc9faea7a9ce213c6e Sep 07 12:37:41.453093 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:37:41.453093 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:37:41.453093 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 could not be found. Sep 07 12:37:41.453093 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'b05fbd40-21c6-4c6c-9039-887cf2b9e6d8'} Sep 07 12:37:41.454194 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:37:41.454194 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:41.454194 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:37:41.454194 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:37:41.454194 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:37:41.454194 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:37:41.454194 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:37:41.454194 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:37:41.454194 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:37:41.454194 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:37:41.454194 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 could not be found. Sep 07 12:37:41.454194 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:41.454194 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:41.454194 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:41.454194 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:41.454194 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:41.454194 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:41.454194 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:37:41.454194 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:37:41.454194 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:37:41.455883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:37:41.455883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:37:41.455883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:37:41.455883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:37:41.455883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:37:41.455883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:37:41.455883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:37:41.455883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 could not be found. Sep 07 12:37:41.455883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:41.455883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:41.455883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:41.455883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:41.455883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:41.455883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:41.455883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:37:41.455883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:37:41.455883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 could not be found. Sep 07 12:37:41.455883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:41.459305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-86f2b245-2ef0-4c9f-a4ff-68d111c1f9c8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Returning 404 to user: Instance b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:37:41.461374 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-86f2b245-2ef0-4c9f-a4ff-68d111c1f9c8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8" status: 404 len: 111 microversion: 2.1 time: 0.051384 Sep 07 12:37:41.462596 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1028/1998] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:41 2022] GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:37:41.472647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9bd16b39-a2e5-4385-85d6-ad239834704d req-0eb55340-e21c-47af-a7fd-1bee8200554a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b05fbd40-21c6-4c6c-9039-887cf2b9e6d8", "name": "network-vif-deleted", "tag": "2e2d9ed2-9ac4-4aa8-bea1-c85093084b32"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:41.486604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9bd16b39-a2e5-4385-85d6-ad239834704d req-0eb55340-e21c-47af-a7fd-1bee8200554a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:41.487102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9bd16b39-a2e5-4385-85d6-ad239834704d req-0eb55340-e21c-47af-a7fd-1bee8200554a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:41.487554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9bd16b39-a2e5-4385-85d6-ad239834704d req-0eb55340-e21c-47af-a7fd-1bee8200554a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:41.504021 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1d9b3064-5c51-4c45-b88f-d089c130f650 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "POST /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490/action" status: 202 len: 0 microversion: 2.1 time: 0.240171 Sep 07 12:37:41.505918 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 971/1999] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:37:41 2022] POST /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:37:41.516085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-42f1b49f-262d-4756-a224-2d37801c71a1 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Action: 'create', calling method: .version_select at 0x7fc4189fa550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-776314856", "description": "tempest-description-740256948"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:41.520831 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9bd16b39-a2e5-4385-85d6-ad239834704d req-0eb55340-e21c-47af-a7fd-1bee8200554a service nova] Creating event network-vif-deleted:2e2d9ed2-9ac4-4aa8-bea1-c85093084b32 for instance b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 on n-h2-852087-9 Sep 07 12:37:41.534599 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9bd16b39-a2e5-4385-85d6-ad239834704d req-0eb55340-e21c-47af-a7fd-1bee8200554a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069437 Sep 07 12:37:41.535696 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1029/2000] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:41.547550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8f7b7559-b94e-4d15-8af3-e4f7e208cff1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1608413037", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "782fe665-49dc-454e-a75e-cbb471a251fc"}], "block_device_mapping_v2": [{"uuid": "6b722c2d-f72d-4e56-a674-9f7633b60a8b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:41.670971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-8f7b7559-b94e-4d15-8af3-e4f7e208cff1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] validate_networks() for [('782fe665-49dc-454e-a75e-cbb471a251fc', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:37:41.775180 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-42f1b49f-262d-4756-a224-2d37801c71a1 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.267567 Sep 07 12:37:41.775860 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 972/2001] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Sep 7 12:37:41 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:41.781190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5d05790e-f3fa-4d7d-a90a-887fd3604b97 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Calling method '.version_select at 0x7fc4189ccc10>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:42.556474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8f7b7559-b94e-4d15-8af3-e4f7e208cff1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:37:42.557139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8f7b7559-b94e-4d15-8af3-e4f7e208cff1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:37:42.557426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8f7b7559-b94e-4d15-8af3-e4f7e208cff1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:37:42.557862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8f7b7559-b94e-4d15-8af3-e4f7e208cff1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:37:42.558285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8f7b7559-b94e-4d15-8af3-e4f7e208cff1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:37:42.568723 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f7b7559-b94e-4d15-8af3-e4f7e208cff1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:42.569282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f7b7559-b94e-4d15-8af3-e4f7e208cff1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:42.569738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f7b7559-b94e-4d15-8af3-e4f7e208cff1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:42.570532 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f7b7559-b94e-4d15-8af3-e4f7e208cff1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:42.570990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f7b7559-b94e-4d15-8af3-e4f7e208cff1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:42.571446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f7b7559-b94e-4d15-8af3-e4f7e208cff1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:42.592586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-8f7b7559-b94e-4d15-8af3-e4f7e208cff1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Getting quotas for project 6d7695bab2d84b35bf92bd035da71dc3. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:37:42.599945 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-8f7b7559-b94e-4d15-8af3-e4f7e208cff1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Getting quotas for user cf3ae3d912b84a8f906b31874668b740 and project 6d7695bab2d84b35bf92bd035da71dc3. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:37:42.667580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8f7b7559-b94e-4d15-8af3-e4f7e208cff1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:37:42.670070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8f7b7559-b94e-4d15-8af3-e4f7e208cff1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6b722c2d-f72d-4e56-a674-9f7633b60a8b',volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:37:42.824225 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8f7b7559-b94e-4d15-8af3-e4f7e208cff1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.285989 Sep 07 12:37:42.825180 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1030/2002] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Sep 7 12:37:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1288 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 12:37:42.835235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3b023f1a-f300-40a2-9c61-5c064e3c0fd9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:42.836425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3b023f1a-f300-40a2-9c61-5c064e3c0fd9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2c8319cb-1eff-4ea4-9b2f-37ac6035c490] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:42.854819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b023f1a-f300-40a2-9c61-5c064e3c0fd9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:42.855731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b023f1a-f300-40a2-9c61-5c064e3c0fd9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:42.856523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b023f1a-f300-40a2-9c61-5c064e3c0fd9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:42.857837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b023f1a-f300-40a2-9c61-5c064e3c0fd9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:42.858687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b023f1a-f300-40a2-9c61-5c064e3c0fd9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:42.859477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b023f1a-f300-40a2-9c61-5c064e3c0fd9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:42.990640 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5d05790e-f3fa-4d7d-a90a-887fd3604b97 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/d838874c-92a2-4120-9469-519cf5bec57d" status: 202 len: 0 microversion: 2.1 time: 1.213661 Sep 07 12:37:42.996823 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 973/2003] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Sep 7 12:37:41 2022] DELETE /compute/v2.1/os-floating-ips/d838874c-92a2-4120-9469-519cf5bec57d => generated 0 bytes in 1220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:37:43.002180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-08cc1665-1366-474c-9b24-e16888f425cb tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:43.003710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-08cc1665-1366-474c-9b24-e16888f425cb tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 16417424-f738-4fcf-8a54-4941ec487fa4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:43.013520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08cc1665-1366-474c-9b24-e16888f425cb tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:43.013954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08cc1665-1366-474c-9b24-e16888f425cb tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:43.014398 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08cc1665-1366-474c-9b24-e16888f425cb tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:43.015126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08cc1665-1366-474c-9b24-e16888f425cb tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:43.015588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08cc1665-1366-474c-9b24-e16888f425cb tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:43.016026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08cc1665-1366-474c-9b24-e16888f425cb tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:43.158878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3b023f1a-f300-40a2-9c61-5c064e3c0fd9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:43.171946 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3b023f1a-f300-40a2-9c61-5c064e3c0fd9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490" status: 200 len: 1478 microversion: 2.1 time: 0.344737 Sep 07 12:37:43.185609 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1031/2004] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:42 2022] GET /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490 => generated 1478 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:43.195721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7580bf5e-b40d-4bb0-a5fc-aee79a312fbf tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-188363809", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "80d51306-dbb8-4c2e-bca9-60970c39d44b"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:43.289568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-7580bf5e-b40d-4bb0-a5fc-aee79a312fbf tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] validate_networks() for [('80d51306-dbb8-4c2e-bca9-60970c39d44b', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:37:43.298599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:37:43.318272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-08cc1665-1366-474c-9b24-e16888f425cb tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41979e405fab49029d8ff5a9903e36ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00ac02c77f40f5ab6acbe538c9566b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:43.323723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:37:43.334163 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-08cc1665-1366-474c-9b24-e16888f425cb tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "GET /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4" status: 200 len: 1323 microversion: 2.1 time: 0.335845 Sep 07 12:37:43.335362 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 974/2005] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:42 2022] GET /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4 => generated 1323 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:43.342668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6e481214-98d0-4ccc-9d6c-c71bc2912757 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Action: 'create', calling method: .version_select at 0x7fc418af9b80>, body: {"security_group_rule": {"parent_group_id": "00cee21c-a3a4-4ada-9d3b-1745f0e618ad", "ip_protocol": "tcp", "from_port": 22, "to_port": 1684513701}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:43.349151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:37:43.490549 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-6e481214-98d0-4ccc-9d6c-c71bc2912757 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] HTTP exception thrown: Invalid port range 22:1684513701. Valid TCP ports should be between 1-65535 Sep 07 12:37:43.493642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6e481214-98d0-4ccc-9d6c-c71bc2912757 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Request method failure captured: Sep 07 12:37:43.493642 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 07 12:37:43.493642 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:37:43.493642 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:37:43.493642 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:37:43.493642 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 146 Sep 07 12:37:43.493642 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:37:43.493642 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:37:43.493642 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:37:43.493642 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:37:43.493642 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJCAl1SuViaHSWLkzmThpDbvJWx_k0VBILDKcDx3NIgYmrlT6WWF-HkHZ8XOc7WYAeu5xoeaU637SCWJ_DPjQBJKaKOMz000eBLxUimwI255LbZapKKhQXa1VZldUTf2c3rb-PbEyyqOSUYW5-z9IhwuSH7K8c7W1_TQLEn_c7c3WkE Sep 07 12:37:43.493642 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:37:43.493642 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:37:43.493642 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:37:43.493642 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:37:43.493642 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:37:43.493642 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:37:43.493642 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8020b3b90cfa4f84ae9003e6884da03c Sep 07 12:37:43.493642 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1168758300 Sep 07 12:37:43.493642 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:37:43.493642 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:37:43.495555 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:37:43.495555 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1168758300 Sep 07 12:37:43.495555 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8020b3b90cfa4f84ae9003e6884da03c Sep 07 12:37:43.495555 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1168758300 Sep 07 12:37:43.495555 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project Sep 07 12:37:43.495555 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:37:43.495555 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:37:43.495555 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: cbe66dab00d0478d81b5e5e4a45fb0df Sep 07 12:37:43.495555 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project Sep 07 12:37:43.495555 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:37:43.495555 n-d-852087-9 devstack@n-api.service[122433]: {"security_group_rule": {"parent_group_id": "00cee21c-a3a4-4ada-9d3b-1745f0e618ad", "ip_protocol": "tcp", "from_port": 22, "to_port": 1684513701}} Sep 07 12:37:43.495555 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:37:43.496453 n-d-852087-9 devstack@n-api.service[122433]: exception: Invalid port range 22:1684513701. Valid TCP ports should be between 1-65535 Sep 07 12:37:43.496453 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'body': {'security_group_rule': {'parent_group_id': '00cee21c-a3a4-4ada-9d3b-1745f0e618ad', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1684513701}}} Sep 07 12:37:43.496453 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:37:43.496453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:43.496453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 07 12:37:43.496453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 07 12:37:43.496453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 07 12:37:43.496453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 07 12:37:43.496453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 07 12:37:43.496453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 07 12:37:43.496453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Sep 07 12:37:43.496453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 07 12:37:43.496453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1684513701. Valid TCP ports should be between 1-65535 Sep 07 12:37:43.496453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:43.496453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:43.496453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:43.496453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:43.496453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:43.496453 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:43.498541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:37:43.498541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:37:43.498541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:37:43.498541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:37:43.498541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:37:43.498541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:37:43.498541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 07 12:37:43.498541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 07 12:37:43.498541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1684513701. Valid TCP ports should be between 1-65535 Sep 07 12:37:43.498541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:43.498541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:43.498541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:43.498541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:43.498541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:43.498541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:43.498541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:37:43.498541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:37:43.498541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1684513701. Valid TCP ports should be between 1-65535 Sep 07 12:37:43.498541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:43.507083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6e481214-98d0-4ccc-9d6c-c71bc2912757 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Returning 400 to user: Invalid port range 22:1684513701. Valid TCP ports should be between 1-65535 {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:37:43.507083 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6e481214-98d0-4ccc-9d6c-c71bc2912757 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.161100 Sep 07 12:37:43.507083 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 975/2006] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Sep 7 12:37:43 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 164 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:37:43.510360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e2a43a38-39e5-4045-90ba-4938c725b03f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:43.511551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e2a43a38-39e5-4045-90ba-4938c725b03f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:43.523968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2a43a38-39e5-4045-90ba-4938c725b03f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:43.524613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2a43a38-39e5-4045-90ba-4938c725b03f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:43.525395 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2a43a38-39e5-4045-90ba-4938c725b03f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:43.526306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2a43a38-39e5-4045-90ba-4938c725b03f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:43.526910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2a43a38-39e5-4045-90ba-4938c725b03f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:43.528188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2a43a38-39e5-4045-90ba-4938c725b03f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:43.825133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e2a43a38-39e5-4045-90ba-4938c725b03f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:43.836512 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e2a43a38-39e5-4045-90ba-4938c725b03f tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1393 microversion: 2.1 time: 0.334922 Sep 07 12:37:43.837184 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 976/2007] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:43 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1393 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:43.844059 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f60f9b01-9d8a-4638-a814-f0aadeb4a919 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:43.844870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f60f9b01-9d8a-4638-a814-f0aadeb4a919 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:43.856170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f60f9b01-9d8a-4638-a814-f0aadeb4a919 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:43.856875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f60f9b01-9d8a-4638-a814-f0aadeb4a919 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:43.857449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f60f9b01-9d8a-4638-a814-f0aadeb4a919 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:43.858514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f60f9b01-9d8a-4638-a814-f0aadeb4a919 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:43.859531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f60f9b01-9d8a-4638-a814-f0aadeb4a919 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:43.860377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f60f9b01-9d8a-4638-a814-f0aadeb4a919 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:43.995410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f60f9b01-9d8a-4638-a814-f0aadeb4a919 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:44.014487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f60f9b01-9d8a-4638-a814-f0aadeb4a919 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:44.017379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f60f9b01-9d8a-4638-a814-f0aadeb4a919 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:44.019317 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f60f9b01-9d8a-4638-a814-f0aadeb4a919 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1233 microversion: 2.25 time: 0.180565 Sep 07 12:37:44.020310 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 977/2008] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:37:43 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1233 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:37:44.030886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-042950fa-0e50-4c9c-8b9d-471a9e6c179a tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:44.039129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-042950fa-0e50-4c9c-8b9d-471a9e6c179a tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Request method failure captured: Sep 07 12:37:44.039129 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf/action HTTP/1.1 Sep 07 12:37:44.039129 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:37:44.039129 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:37:44.039129 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:37:44.039129 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 34 Sep 07 12:37:44.039129 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:37:44.039129 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:37:44.039129 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:37:44.039129 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:37:44.039129 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJBOaITVB7ZGKtkDqZiwPTsjUOTP5nKpy0IvS8yLaYijhtlrbJk2oN6pF86qnFeVoTCx5JaTlDm1455GaGrhgrbw22YC6YF51VYynBsuSnu7pi6I4GJQ9_WmFroQ-QgP0MwYERtCgeJW7lStTRD8pM93BRg9vrsnGR66XAFSpeqcmXY Sep 07 12:37:44.039129 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:37:44.039129 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:37:44.039129 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:37:44.039129 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:37:44.039129 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:37:44.039129 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:37:44.039129 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 7e13a7ebce0646f8aea71d49eaa698d1 Sep 07 12:37:44.039129 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 Sep 07 12:37:44.039129 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:37:44.039129 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:37:44.042035 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7e13a7ebce0646f8aea71d49eaa698d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7e13a7ebce0646f8aea71d49eaa698d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7e13a7ebce0646f8aea71d49eaa698d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7e13a7ebce0646f8aea71d49eaa698d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:37:44.042035 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 Sep 07 12:37:44.042035 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 7e13a7ebce0646f8aea71d49eaa698d1 Sep 07 12:37:44.042035 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 Sep 07 12:37:44.042035 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project Sep 07 12:37:44.042035 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:37:44.042035 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:37:44.042035 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: cead0c007d8545b3a32963668fbbe23e Sep 07 12:37:44.042035 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project Sep 07 12:37:44.042035 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:37:44.042035 n-d-852087-9 devstack@n-api.service[122433]: {"addFloatingIp": {"address": ""}} Sep 07 12:37:44.042035 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:37:44.042035 n-d-852087-9 devstack@n-api.service[122433]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 07 12:37:44.043769 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '4472f1be-6441-4955-b1a0-934980853ccf', 'body': {'addFloatingIp': {'address': ''}}} Sep 07 12:37:44.043769 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:37:44.043769 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:44.043769 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:37:44.043769 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:37:44.043769 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:37:44.043769 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:37:44.043769 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Sep 07 12:37:44.043769 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:44.043769 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Sep 07 12:37:44.043769 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Sep 07 12:37:44.043769 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:44.043769 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Sep 07 12:37:44.043769 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi '' Sep 07 12:37:44.043769 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:44.043769 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:44.043769 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:44.043769 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:44.043769 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:44.043769 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:44.043769 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:37:44.043769 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:37:44.046907 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:37:44.046907 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:37:44.046907 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:37:44.046907 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:37:44.046907 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:37:44.046907 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:37:44.046907 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:37:44.046907 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:37:44.046907 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:37:44.046907 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:37:44.046907 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 07 12:37:44.046907 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:44.046907 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:44.046907 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:44.046907 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:44.046907 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:44.046907 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:44.046907 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:37:44.046907 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:37:44.049218 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 07 12:37:44.049218 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:44.049218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-042950fa-0e50-4c9c-8b9d-471a9e6c179a tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:37:44.049218 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-042950fa-0e50-4c9c-8b9d-471a9e6c179a tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "POST /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf/action" status: 400 len: 142 microversion: 2.1 time: 0.019859 Sep 07 12:37:44.049218 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 978/2009] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:37:44 2022] POST /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf/action => generated 142 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:37:44.062934 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ba127fc-674f-49ad-9973-b286c7d19055 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-937984501"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:44.067186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3ba127fc-674f-49ad-9973-b286c7d19055 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2c8319cb-1eff-4ea4-9b2f-37ac6035c490] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:44.082403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ba127fc-674f-49ad-9973-b286c7d19055 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:44.083291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ba127fc-674f-49ad-9973-b286c7d19055 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:44.084422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ba127fc-674f-49ad-9973-b286c7d19055 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:44.085937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ba127fc-674f-49ad-9973-b286c7d19055 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:44.086717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ba127fc-674f-49ad-9973-b286c7d19055 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:44.087716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ba127fc-674f-49ad-9973-b286c7d19055 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:44.201441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7580bf5e-b40d-4bb0-a5fc-aee79a312fbf tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:37:44.202826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7580bf5e-b40d-4bb0-a5fc-aee79a312fbf tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:37:44.203705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7580bf5e-b40d-4bb0-a5fc-aee79a312fbf tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:37:44.204634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7580bf5e-b40d-4bb0-a5fc-aee79a312fbf tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:37:44.205350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7580bf5e-b40d-4bb0-a5fc-aee79a312fbf tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:37:44.224577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7580bf5e-b40d-4bb0-a5fc-aee79a312fbf tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:44.225925 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7580bf5e-b40d-4bb0-a5fc-aee79a312fbf tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:44.226257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7580bf5e-b40d-4bb0-a5fc-aee79a312fbf tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:44.228109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7580bf5e-b40d-4bb0-a5fc-aee79a312fbf tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:44.228925 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7580bf5e-b40d-4bb0-a5fc-aee79a312fbf tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:44.230249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7580bf5e-b40d-4bb0-a5fc-aee79a312fbf tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:44.257037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-7580bf5e-b40d-4bb0-a5fc-aee79a312fbf tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Getting quotas for project ef5b2dd007e944358d72268414868096. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:37:44.264703 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-7580bf5e-b40d-4bb0-a5fc-aee79a312fbf tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Getting quotas for user b920811be01745fc9faea7a9ce213c6e and project ef5b2dd007e944358d72268414868096. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:37:44.287968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7580bf5e-b40d-4bb0-a5fc-aee79a312fbf tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:37:44.290325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7580bf5e-b40d-4bb0-a5fc-aee79a312fbf tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 704ec36d-6304-4089-9e70-12b23b3c795e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:37:44.346888 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7580bf5e-b40d-4bb0-a5fc-aee79a312fbf tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.159743 Sep 07 12:37:44.348007 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1032/2010] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:37:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:37:44.354304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2da56c85-f60b-45b5-b62a-faebd5899224 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Action: 'create', calling method: .version_select at 0x7fc4192ba0d0>, body: {"security_group_rule": {"parent_group_id": "3f5733b2-1b25-4c5f-8666-4492bf27b28f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:44.422268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG neutronclient.v2_0.client [None req-2da56c85-f60b-45b5-b62a-faebd5899224 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3f5733b2-1b25-4c5f-8666-4492bf27b28f does not exist", "detail": ""}} {{(pid=122432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 12:37:44.423892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.security_group_api [None req-2da56c85-f60b-45b5-b62a-faebd5899224 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Neutron security group 3f5733b2-1b25-4c5f-8666-4492bf27b28f not found {{(pid=122432) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 12:37:44.424686 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-2da56c85-f60b-45b5-b62a-faebd5899224 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] HTTP exception thrown: Security group 3f5733b2-1b25-4c5f-8666-4492bf27b28f does not exist Sep 07 12:37:44.424686 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-9595a233-7aaf-4af5-b824-509f9c3f4fba'] Sep 07 12:37:44.427586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2da56c85-f60b-45b5-b62a-faebd5899224 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Request method failure captured: Sep 07 12:37:44.427586 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 07 12:37:44.427586 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:37:44.427586 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:37:44.427586 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:37:44.427586 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 138 Sep 07 12:37:44.427586 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:37:44.427586 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:37:44.427586 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:37:44.427586 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:37:44.427586 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJCAl1SuViaHSWLkzmThpDbvJWx_k0VBILDKcDx3NIgYmrlT6WWF-HkHZ8XOc7WYAeu5xoeaU637SCWJ_DPjQBJKaKOMz000eBLxUimwI255LbZapKKhQXa1VZldUTf2c3rb-PbEyyqOSUYW5-z9IhwuSH7K8c7W1_TQLEn_c7c3WkE Sep 07 12:37:44.427586 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:37:44.427586 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:37:44.427586 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:37:44.427586 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:37:44.427586 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:37:44.427586 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:37:44.427586 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8020b3b90cfa4f84ae9003e6884da03c Sep 07 12:37:44.427586 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1168758300 Sep 07 12:37:44.427586 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:37:44.427586 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:37:44.431088 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:37:44.431088 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1168758300 Sep 07 12:37:44.431088 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8020b3b90cfa4f84ae9003e6884da03c Sep 07 12:37:44.431088 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1168758300 Sep 07 12:37:44.431088 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project Sep 07 12:37:44.431088 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:37:44.431088 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:37:44.431088 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: cbe66dab00d0478d81b5e5e4a45fb0df Sep 07 12:37:44.431088 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project Sep 07 12:37:44.431088 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:37:44.431088 n-d-852087-9 devstack@n-api.service[122432]: {"security_group_rule": {"parent_group_id": "3f5733b2-1b25-4c5f-8666-4492bf27b28f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 07 12:37:44.431088 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:37:44.434412 n-d-852087-9 devstack@n-api.service[122432]: exception: Security group 3f5733b2-1b25-4c5f-8666-4492bf27b28f does not exist Sep 07 12:37:44.434412 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-9595a233-7aaf-4af5-b824-509f9c3f4fba'] Sep 07 12:37:44.434412 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3f5733b2-1b25-4c5f-8666-4492bf27b28f', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 07 12:37:44.434412 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:37:44.434412 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:44.434412 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 12:37:44.434412 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 12:37:44.434412 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:37:44.434412 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:37:44.434412 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 12:37:44.434412 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 12:37:44.434412 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:37:44.434412 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:37:44.434412 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 12:37:44.434412 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 12:37:44.434412 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:37:44.434412 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:37:44.434412 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 12:37:44.434412 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 12:37:44.437748 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:37:44.437748 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:37:44.437748 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 12:37:44.437748 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 12:37:44.437748 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:37:44.437748 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:37:44.437748 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 12:37:44.437748 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 12:37:44.437748 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 12:37:44.437748 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 12:37:44.437748 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3f5733b2-1b25-4c5f-8666-4492bf27b28f does not exist Sep 07 12:37:44.437748 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9595a233-7aaf-4af5-b824-509f9c3f4fba'] Sep 07 12:37:44.437748 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:44.437748 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:44.437748 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:44.437748 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:44.437748 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Sep 07 12:37:44.437748 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Sep 07 12:37:44.437748 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 12:37:44.440693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 12:37:44.440693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3f5733b2-1b25-4c5f-8666-4492bf27b28f does not exist Sep 07 12:37:44.440693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9595a233-7aaf-4af5-b824-509f9c3f4fba'] Sep 07 12:37:44.440693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:44.440693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:44.440693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:44.440693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:44.440693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:44.440693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:44.440693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:37:44.440693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:37:44.440693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:37:44.440693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:37:44.440693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:37:44.440693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:37:44.440693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Sep 07 12:37:44.440693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 12:37:44.440693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3f5733b2-1b25-4c5f-8666-4492bf27b28f does not exist Sep 07 12:37:44.440693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9595a233-7aaf-4af5-b824-509f9c3f4fba'] Sep 07 12:37:44.440693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:44.443683 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:44.443683 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:44.443683 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:44.443683 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:44.443683 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:44.443683 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:37:44.443683 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:37:44.443683 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3f5733b2-1b25-4c5f-8666-4492bf27b28f does not exist Sep 07 12:37:44.443683 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9595a233-7aaf-4af5-b824-509f9c3f4fba'] Sep 07 12:37:44.443683 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:44.443683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2da56c85-f60b-45b5-b62a-faebd5899224 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Returning 404 to user: Security group 3f5733b2-1b25-4c5f-8666-4492bf27b28f does not exist Sep 07 12:37:44.443683 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-9595a233-7aaf-4af5-b824-509f9c3f4fba'] {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:37:44.443683 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2da56c85-f60b-45b5-b62a-faebd5899224 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.083380 Sep 07 12:37:44.453680 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1033/2011] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Sep 7 12:37:44 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:37:44.453680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-117e574b-4a98-4663-83cb-729f4c750c8a req-f829b242-1fe1-4274-a7fd-2c6bf2a4f666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16417424-f738-4fcf-8a54-4941ec487fa4", "tag": "e28093e8-45ae-4bd9-a348-a9b5fd640aea"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:44.465944 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-117e574b-4a98-4663-83cb-729f4c750c8a req-f829b242-1fe1-4274-a7fd-2c6bf2a4f666 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:44.466742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-117e574b-4a98-4663-83cb-729f4c750c8a req-f829b242-1fe1-4274-a7fd-2c6bf2a4f666 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:44.467461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-117e574b-4a98-4663-83cb-729f4c750c8a req-f829b242-1fe1-4274-a7fd-2c6bf2a4f666 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:44.486032 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-117e574b-4a98-4663-83cb-729f4c750c8a req-f829b242-1fe1-4274-a7fd-2c6bf2a4f666 service nova] Creating event network-changed:e28093e8-45ae-4bd9-a348-a9b5fd640aea for instance 16417424-f738-4fcf-8a54-4941ec487fa4 on n-h1-852087-9 Sep 07 12:37:44.492855 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-117e574b-4a98-4663-83cb-729f4c750c8a req-f829b242-1fe1-4274-a7fd-2c6bf2a4f666 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056131 Sep 07 12:37:44.493803 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1034/2012] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:44.502990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a3397f44-b20d-4a3d-9717-fb7c157747f6 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:44.506091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a3397f44-b20d-4a3d-9717-fb7c157747f6 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:44.516881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3397f44-b20d-4a3d-9717-fb7c157747f6 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:44.517791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3397f44-b20d-4a3d-9717-fb7c157747f6 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:44.518918 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3397f44-b20d-4a3d-9717-fb7c157747f6 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:44.520025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3397f44-b20d-4a3d-9717-fb7c157747f6 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:44.520850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3397f44-b20d-4a3d-9717-fb7c157747f6 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:44.521551 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3397f44-b20d-4a3d-9717-fb7c157747f6 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:44.557132 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3397f44-b20d-4a3d-9717-fb7c157747f6 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "refresh_cache-4472f1be-6441-4955-b1a0-934980853ccf" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 12:37:44.558023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3397f44-b20d-4a3d-9717-fb7c157747f6 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquired lock "refresh_cache-4472f1be-6441-4955-b1a0-934980853ccf" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 12:37:44.716214 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ba127fc-674f-49ad-9973-b286c7d19055 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "POST /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490/action" status: 202 len: 0 microversion: 2.1 time: 0.662370 Sep 07 12:37:44.725890 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 979/2013] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:37:44 2022] POST /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490/action => generated 0 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 07 12:37:44.726958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3030365e-5137-4132-b5b1-26ce16c29997 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:44.727768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3030365e-5137-4132-b5b1-26ce16c29997 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 704ec36d-6304-4089-9e70-12b23b3c795e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:44.907839 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3397f44-b20d-4a3d-9717-fb7c157747f6 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Releasing lock "refresh_cache-4472f1be-6441-4955-b1a0-934980853ccf" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 12:37:44.908913 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-a3397f44-b20d-4a3d-9717-fb7c157747f6 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] HTTP exception thrown: floating IP not found Sep 07 12:37:44.912133 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a3397f44-b20d-4a3d-9717-fb7c157747f6 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Request method failure captured: Sep 07 12:37:44.912133 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf/action HTTP/1.1 Sep 07 12:37:44.912133 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:37:44.912133 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:37:44.912133 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:37:44.912133 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 41 Sep 07 12:37:44.912133 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:37:44.912133 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:37:44.912133 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:37:44.912133 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:37:44.912133 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJBOaITVB7ZGKtkDqZiwPTsjUOTP5nKpy0IvS8yLaYijhtlrbJk2oN6pF86qnFeVoTCx5JaTlDm1455GaGrhgrbw22YC6YF51VYynBsuSnu7pi6I4GJQ9_WmFroQ-QgP0MwYERtCgeJW7lStTRD8pM93BRg9vrsnGR66XAFSpeqcmXY Sep 07 12:37:44.912133 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:37:44.912133 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:37:44.912133 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:37:44.912133 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:37:44.912133 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:37:44.912133 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:37:44.912133 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 7e13a7ebce0646f8aea71d49eaa698d1 Sep 07 12:37:44.912133 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 Sep 07 12:37:44.912133 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:37:44.912133 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:37:44.913979 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7e13a7ebce0646f8aea71d49eaa698d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7e13a7ebce0646f8aea71d49eaa698d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7e13a7ebce0646f8aea71d49eaa698d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7e13a7ebce0646f8aea71d49eaa698d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:37:44.913979 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 Sep 07 12:37:44.913979 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 7e13a7ebce0646f8aea71d49eaa698d1 Sep 07 12:37:44.913979 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 Sep 07 12:37:44.913979 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project Sep 07 12:37:44.913979 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:37:44.913979 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:37:44.913979 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: cead0c007d8545b3a32963668fbbe23e Sep 07 12:37:44.913979 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project Sep 07 12:37:44.913979 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:37:44.913979 n-d-852087-9 devstack@n-api.service[122432]: {"addFloatingIp": {"address": "0.0.0.0"}} Sep 07 12:37:44.913979 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:37:44.913979 n-d-852087-9 devstack@n-api.service[122432]: exception: floating IP not found Sep 07 12:37:44.915031 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '4472f1be-6441-4955-b1a0-934980853ccf', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Sep 07 12:37:44.915031 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:37:44.915031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:44.915031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 07 12:37:44.915031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 07 12:37:44.915031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 07 12:37:44.915031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 07 12:37:44.915031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Sep 07 12:37:44.915031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Sep 07 12:37:44.915031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 07 12:37:44.915031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 07 12:37:44.915031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 07 12:37:44.915031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:44.915031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:44.915031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:44.915031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:44.915031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:44.915031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:44.915031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:37:44.916480 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:37:44.916480 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:37:44.916480 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:37:44.916480 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:37:44.916480 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:37:44.916480 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:37:44.916480 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:37:44.916480 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Sep 07 12:37:44.916480 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 07 12:37:44.916480 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Sep 07 12:37:44.916480 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:44.916480 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:44.916480 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:44.916480 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:44.916480 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:44.916480 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:44.916480 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:37:44.916480 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:37:44.916480 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Sep 07 12:37:44.916480 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:44.917942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a3397f44-b20d-4a3d-9717-fb7c157747f6 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Returning 404 to user: floating IP not found {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:37:44.917942 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a3397f44-b20d-4a3d-9717-fb7c157747f6 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "POST /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf/action" status: 404 len: 67 microversion: 2.1 time: 0.419341 Sep 07 12:37:44.917942 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1035/2014] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:37:44 2022] POST /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf/action => generated 67 bytes in 421 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:37:44.925017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-493ebb17-6a60-42da-9196-fa482c69701d tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:44.926643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-493ebb17-6a60-42da-9196-fa482c69701d tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 16417424-f738-4fcf-8a54-4941ec487fa4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:44.938217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-493ebb17-6a60-42da-9196-fa482c69701d tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:44.939546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-493ebb17-6a60-42da-9196-fa482c69701d tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:44.940937 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-493ebb17-6a60-42da-9196-fa482c69701d tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:44.942564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-493ebb17-6a60-42da-9196-fa482c69701d tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:44.943474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-493ebb17-6a60-42da-9196-fa482c69701d tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:44.944538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-493ebb17-6a60-42da-9196-fa482c69701d tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:44.952281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3030365e-5137-4132-b5b1-26ce16c29997 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:44.976297 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3030365e-5137-4132-b5b1-26ce16c29997 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e" status: 200 len: 1214 microversion: 2.1 time: 0.255964 Sep 07 12:37:44.978319 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 980/2015] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:44 2022] GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e => generated 1214 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:44.995647 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c37bdb1d-2908-4217-97a5-2a6e690b6746 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Calling method '.version_select at 0x7fc418af9b80>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:45.106655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG neutronclient.v2_0.client [None req-c37bdb1d-2908-4217-97a5-2a6e690b6746 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule ed2d4f5a-bd21-418a-b433-e55a66e987d8 does not exist", "detail": ""}} {{(pid=122433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 12:37:45.107295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.security_group_api [None req-c37bdb1d-2908-4217-97a5-2a6e690b6746 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Neutron security group rule ed2d4f5a-bd21-418a-b433-e55a66e987d8 not found {{(pid=122433) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Sep 07 12:37:45.107840 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-c37bdb1d-2908-4217-97a5-2a6e690b6746 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] HTTP exception thrown: Security group rule ed2d4f5a-bd21-418a-b433-e55a66e987d8 does not exist Sep 07 12:37:45.107840 n-d-852087-9 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-4f7fe4c0-c0cc-4405-badf-45aebb24e425'] Sep 07 12:37:45.110913 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c37bdb1d-2908-4217-97a5-2a6e690b6746 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Request method failure captured: Sep 07 12:37:45.110913 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-security-group-rules/ed2d4f5a-bd21-418a-b433-e55a66e987d8 HTTP/1.1 Sep 07 12:37:45.110913 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:37:45.110913 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:37:45.110913 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:37:45.110913 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:37:45.110913 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:37:45.110913 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:37:45.110913 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:37:45.110913 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:37:45.110913 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJCAl1SuViaHSWLkzmThpDbvJWx_k0VBILDKcDx3NIgYmrlT6WWF-HkHZ8XOc7WYAeu5xoeaU637SCWJ_DPjQBJKaKOMz000eBLxUimwI255LbZapKKhQXa1VZldUTf2c3rb-PbEyyqOSUYW5-z9IhwuSH7K8c7W1_TQLEn_c7c3WkE Sep 07 12:37:45.110913 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:37:45.110913 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:37:45.110913 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:37:45.110913 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:37:45.110913 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:37:45.110913 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:37:45.110913 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8020b3b90cfa4f84ae9003e6884da03c Sep 07 12:37:45.110913 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1168758300 Sep 07 12:37:45.110913 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:37:45.110913 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:37:45.114489 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8020b3b90cfa4f84ae9003e6884da03c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:37:45.114489 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1168758300 Sep 07 12:37:45.114489 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8020b3b90cfa4f84ae9003e6884da03c Sep 07 12:37:45.114489 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1168758300 Sep 07 12:37:45.114489 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project Sep 07 12:37:45.114489 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:37:45.114489 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:37:45.114489 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: cbe66dab00d0478d81b5e5e4a45fb0df Sep 07 12:37:45.114489 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project Sep 07 12:37:45.114489 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:37:45.114489 n-d-852087-9 devstack@n-api.service[122433]: exception: Security group rule ed2d4f5a-bd21-418a-b433-e55a66e987d8 does not exist Sep 07 12:37:45.114489 n-d-852087-9 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-4f7fe4c0-c0cc-4405-badf-45aebb24e425'] Sep 07 12:37:45.116646 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'ed2d4f5a-bd21-418a-b433-e55a66e987d8'} Sep 07 12:37:45.116646 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:37:45.116646 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:45.116646 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Sep 07 12:37:45.116646 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Sep 07 12:37:45.116646 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:37:45.116646 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:37:45.116646 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Sep 07 12:37:45.116646 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Sep 07 12:37:45.116646 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:37:45.116646 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:37:45.116646 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 12:37:45.116646 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 12:37:45.116646 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:37:45.116646 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:37:45.116646 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 12:37:45.116646 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 12:37:45.116646 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:37:45.116646 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:37:45.121831 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 12:37:45.121831 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 12:37:45.121831 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:37:45.121831 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:37:45.121831 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 12:37:45.121831 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 12:37:45.121831 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 12:37:45.121831 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 12:37:45.121831 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule ed2d4f5a-bd21-418a-b433-e55a66e987d8 does not exist Sep 07 12:37:45.121831 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4f7fe4c0-c0cc-4405-badf-45aebb24e425'] Sep 07 12:37:45.121831 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:45.121831 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:45.121831 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:45.121831 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:45.121831 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Sep 07 12:37:45.121831 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Sep 07 12:37:45.121831 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Sep 07 12:37:45.121831 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 12:37:45.124842 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule ed2d4f5a-bd21-418a-b433-e55a66e987d8 does not exist Sep 07 12:37:45.124842 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4f7fe4c0-c0cc-4405-badf-45aebb24e425'] Sep 07 12:37:45.124842 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:45.124842 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:45.124842 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:45.124842 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:45.124842 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:45.124842 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:45.124842 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:37:45.124842 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:37:45.124842 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:37:45.124842 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:37:45.124842 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:37:45.124842 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:37:45.124842 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Sep 07 12:37:45.124842 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 12:37:45.124842 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule ed2d4f5a-bd21-418a-b433-e55a66e987d8 does not exist Sep 07 12:37:45.124842 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4f7fe4c0-c0cc-4405-badf-45aebb24e425'] Sep 07 12:37:45.124842 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:45.124842 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:45.131044 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:45.131044 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:45.131044 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:45.131044 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:45.131044 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:37:45.131044 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:37:45.131044 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule ed2d4f5a-bd21-418a-b433-e55a66e987d8 does not exist Sep 07 12:37:45.131044 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4f7fe4c0-c0cc-4405-badf-45aebb24e425'] Sep 07 12:37:45.131044 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:45.131044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c37bdb1d-2908-4217-97a5-2a6e690b6746 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Returning 404 to user: Security group rule ed2d4f5a-bd21-418a-b433-e55a66e987d8 does not exist Sep 07 12:37:45.131044 n-d-852087-9 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-4f7fe4c0-c0cc-4405-badf-45aebb24e425'] {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:37:45.131044 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c37bdb1d-2908-4217-97a5-2a6e690b6746 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/ed2d4f5a-bd21-418a-b433-e55a66e987d8" status: 404 len: 199 microversion: 2.1 time: 0.130752 Sep 07 12:37:45.132832 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 981/2016] 10.222.0.16 () {58 vars in 1287 bytes} [Wed Sep 7 12:37:44 2022] DELETE /compute/v2.1/os-security-group-rules/ed2d4f5a-bd21-418a-b433-e55a66e987d8 => generated 199 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:37:45.164876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eddb4277-d2fd-49b8-8424-584a1471c9e6 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41d2cc820>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:45.309286 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eddb4277-d2fd-49b8-8424-584a1471c9e6 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c" status: 200 len: 1437 microversion: 2.1 time: 0.193000 Sep 07 12:37:45.312621 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 982/2017] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:37:45 2022] GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c => generated 1437 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:45.327181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ffb90618-6519-4dc7-aef6-5f47dfffbd8d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:45.328537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ffb90618-6519-4dc7-aef6-5f47dfffbd8d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:45.345593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffb90618-6519-4dc7-aef6-5f47dfffbd8d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:45.347930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffb90618-6519-4dc7-aef6-5f47dfffbd8d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:45.349215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffb90618-6519-4dc7-aef6-5f47dfffbd8d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:45.352458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffb90618-6519-4dc7-aef6-5f47dfffbd8d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:45.353654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffb90618-6519-4dc7-aef6-5f47dfffbd8d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:45.355263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffb90618-6519-4dc7-aef6-5f47dfffbd8d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:45.396667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-493ebb17-6a60-42da-9196-fa482c69701d tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41979e405fab49029d8ff5a9903e36ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00ac02c77f40f5ab6acbe538c9566b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:45.413199 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-493ebb17-6a60-42da-9196-fa482c69701d tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "GET /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4" status: 200 len: 1323 microversion: 2.1 time: 0.495532 Sep 07 12:37:45.425795 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1036/2018] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:44 2022] GET /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4 => generated 1323 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:45.440740 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e997f921-d5bf-4bf4-b660-528fda43e5cf tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:45.602456 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-e997f921-d5bf-4bf4-b660-528fda43e5cf tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Sep 07 12:37:45.605612 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e997f921-d5bf-4bf4-b660-528fda43e5cf tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Request method failure captured: Sep 07 12:37:45.605612 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf/action HTTP/1.1 Sep 07 12:37:45.605612 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:37:45.605612 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:37:45.605612 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:37:45.605612 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 44 Sep 07 12:37:45.605612 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:37:45.605612 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:37:45.605612 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:37:45.605612 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:37:45.605612 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJBOaITVB7ZGKtkDqZiwPTsjUOTP5nKpy0IvS8yLaYijhtlrbJk2oN6pF86qnFeVoTCx5JaTlDm1455GaGrhgrbw22YC6YF51VYynBsuSnu7pi6I4GJQ9_WmFroQ-QgP0MwYERtCgeJW7lStTRD8pM93BRg9vrsnGR66XAFSpeqcmXY Sep 07 12:37:45.605612 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:37:45.605612 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:37:45.605612 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:37:45.605612 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:37:45.605612 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:37:45.605612 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:37:45.605612 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 7e13a7ebce0646f8aea71d49eaa698d1 Sep 07 12:37:45.605612 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 Sep 07 12:37:45.605612 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:37:45.605612 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:37:45.607281 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7e13a7ebce0646f8aea71d49eaa698d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7e13a7ebce0646f8aea71d49eaa698d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7e13a7ebce0646f8aea71d49eaa698d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7e13a7ebce0646f8aea71d49eaa698d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:37:45.607281 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 Sep 07 12:37:45.607281 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 7e13a7ebce0646f8aea71d49eaa698d1 Sep 07 12:37:45.607281 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 Sep 07 12:37:45.607281 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project Sep 07 12:37:45.607281 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:37:45.607281 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:37:45.607281 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: cead0c007d8545b3a32963668fbbe23e Sep 07 12:37:45.607281 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project Sep 07 12:37:45.607281 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:37:45.607281 n-d-852087-9 devstack@n-api.service[122432]: {"removeFloatingIp": {"address": "0.0.0.0"}} Sep 07 12:37:45.607281 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:37:45.607281 n-d-852087-9 devstack@n-api.service[122432]: exception: Floating IP not found for address 0.0.0.0. Sep 07 12:37:45.608349 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '4472f1be-6441-4955-b1a0-934980853ccf', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Sep 07 12:37:45.608349 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:37:45.608349 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:45.608349 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Sep 07 12:37:45.608349 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Sep 07 12:37:45.608349 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Sep 07 12:37:45.608349 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Sep 07 12:37:45.608349 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 07 12:37:45.608349 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 07 12:37:45.608349 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 07 12:37:45.608349 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:45.608349 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:45.608349 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:45.608349 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:45.608349 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:45.608349 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:45.608349 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:37:45.608349 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:37:45.608349 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:37:45.609822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:37:45.609822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:37:45.609822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:37:45.609822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:37:45.609822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:37:45.609822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Sep 07 12:37:45.609822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Sep 07 12:37:45.609822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Sep 07 12:37:45.609822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Sep 07 12:37:45.609822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Sep 07 12:37:45.609822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:45.609822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:45.609822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:45.609822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:45.609822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:45.609822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:45.609822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:37:45.609822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:37:45.609822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Sep 07 12:37:45.609822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:37:45.611629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e997f921-d5bf-4bf4-b660-528fda43e5cf tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:37:45.611629 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e997f921-d5bf-4bf4-b660-528fda43e5cf tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "POST /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf/action" status: 404 len: 88 microversion: 2.1 time: 0.178483 Sep 07 12:37:45.617452 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1037/2019] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:37:45 2022] POST /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf/action => generated 88 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:37:45.636639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fc3ea695-b6dd-44f1-89dd-37a502b8acc1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:45.637792 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fc3ea695-b6dd-44f1-89dd-37a502b8acc1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:45.663570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc3ea695-b6dd-44f1-89dd-37a502b8acc1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:45.664624 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc3ea695-b6dd-44f1-89dd-37a502b8acc1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:45.665707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc3ea695-b6dd-44f1-89dd-37a502b8acc1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:45.675911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc3ea695-b6dd-44f1-89dd-37a502b8acc1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:45.677543 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc3ea695-b6dd-44f1-89dd-37a502b8acc1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:45.680022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc3ea695-b6dd-44f1-89dd-37a502b8acc1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:45.928430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fc3ea695-b6dd-44f1-89dd-37a502b8acc1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:45.938658 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fc3ea695-b6dd-44f1-89dd-37a502b8acc1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:45.946498 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fc3ea695-b6dd-44f1-89dd-37a502b8acc1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:45.947842 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fc3ea695-b6dd-44f1-89dd-37a502b8acc1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1251 microversion: 2.25 time: 0.328905 Sep 07 12:37:45.949711 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1038/2020] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:37:45 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1251 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:37:45.961911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5b2cea65-c8ec-4447-8e56-6db19db5af43 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Calling method '.version_select at 0x7fc419c045e0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:46.102668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ffb90618-6519-4dc7-aef6-5f47dfffbd8d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:46.122690 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ffb90618-6519-4dc7-aef6-5f47dfffbd8d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1383 microversion: 2.1 time: 0.807456 Sep 07 12:37:46.139895 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 983/2021] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:45 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1383 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:46.174745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4f3804b5-2139-40a9-a48c-928ee162e17d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:46.176376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4f3804b5-2139-40a9-a48c-928ee162e17d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:46.197448 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f3804b5-2139-40a9-a48c-928ee162e17d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:46.202292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f3804b5-2139-40a9-a48c-928ee162e17d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:46.209262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f3804b5-2139-40a9-a48c-928ee162e17d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:46.211354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f3804b5-2139-40a9-a48c-928ee162e17d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:46.212713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f3804b5-2139-40a9-a48c-928ee162e17d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:46.217631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f3804b5-2139-40a9-a48c-928ee162e17d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:46.346804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4f3804b5-2139-40a9-a48c-928ee162e17d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:37:46.594892 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5b2cea65-c8ec-4447-8e56-6db19db5af43 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/00cee21c-a3a4-4ada-9d3b-1745f0e618ad" status: 202 len: 0 microversion: 2.1 time: 0.643689 Sep 07 12:37:46.601961 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1039/2022] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:37:45 2022] DELETE /compute/v2.1/os-security-groups/00cee21c-a3a4-4ada-9d3b-1745f0e618ad => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:37:46.627789 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c8dd8c2b-dd34-4bde-a6ac-18b934b7e083 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:46.629420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c8dd8c2b-dd34-4bde-a6ac-18b934b7e083 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 704ec36d-6304-4089-9e70-12b23b3c795e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:46.652166 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4f3804b5-2139-40a9-a48c-928ee162e17d tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf" status: 204 len: 0 microversion: 2.1 time: 0.508515 Sep 07 12:37:46.656452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8dd8c2b-dd34-4bde-a6ac-18b934b7e083 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:46.656747 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 984/2023] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:37:46 2022] DELETE /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:37:46.658530 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8dd8c2b-dd34-4bde-a6ac-18b934b7e083 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:46.662026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8dd8c2b-dd34-4bde-a6ac-18b934b7e083 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:46.665001 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8dd8c2b-dd34-4bde-a6ac-18b934b7e083 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:46.667286 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8dd8c2b-dd34-4bde-a6ac-18b934b7e083 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:46.668537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8dd8c2b-dd34-4bde-a6ac-18b934b7e083 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:46.692965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2d11375b-d201-4530-bfec-c8bd1d32207f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Calling method '.version_select at 0x7fc4189ccf70>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:46.713977 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d11375b-d201-4530-bfec-c8bd1d32207f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:46.717777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d11375b-d201-4530-bfec-c8bd1d32207f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:46.719034 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d11375b-d201-4530-bfec-c8bd1d32207f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:46.764000 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2d11375b-d201-4530-bfec-c8bd1d32207f tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2704 microversion: 2.1 time: 0.093568 Sep 07 12:37:46.765214 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 985/2024] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Sep 7 12:37:46 2022] GET /compute/v2.1/os-migrations => generated 2704 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:46.782589 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fd6516d2-cc23-4edd-b494-233934f5aaad tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc418a26af0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:46.913524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c8dd8c2b-dd34-4bde-a6ac-18b934b7e083 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:46.940666 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c8dd8c2b-dd34-4bde-a6ac-18b934b7e083 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e" status: 200 len: 1266 microversion: 2.1 time: 0.335621 Sep 07 12:37:46.943569 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1040/2025] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:46 2022] GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e => generated 1266 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:46.973924 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fd6516d2-cc23-4edd-b494-233934f5aaad tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c" status: 200 len: 1437 microversion: 2.1 time: 0.207366 Sep 07 12:37:46.974524 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 986/2026] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:37:46 2022] GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c => generated 1437 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:46.989799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5df743e3-361b-4724-aef1-2299c4657bf4 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Calling method '.version_select at 0x7fc418a26f70>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:46.990432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-41d29ab0-9232-472b-b208-16cd6556f1a9 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:46.991552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-41d29ab0-9232-472b-b208-16cd6556f1a9 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 16417424-f738-4fcf-8a54-4941ec487fa4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:47.011205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41d29ab0-9232-472b-b208-16cd6556f1a9 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:47.012499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41d29ab0-9232-472b-b208-16cd6556f1a9 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:47.013856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41d29ab0-9232-472b-b208-16cd6556f1a9 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:47.015468 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41d29ab0-9232-472b-b208-16cd6556f1a9 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:47.016560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41d29ab0-9232-472b-b208-16cd6556f1a9 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:47.017666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41d29ab0-9232-472b-b208-16cd6556f1a9 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:47.491887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-41d29ab0-9232-472b-b208-16cd6556f1a9 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41979e405fab49029d8ff5a9903e36ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00ac02c77f40f5ab6acbe538c9566b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:47.502688 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-41d29ab0-9232-472b-b208-16cd6556f1a9 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "GET /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4" status: 200 len: 1323 microversion: 2.1 time: 0.556683 Sep 07 12:37:47.510316 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1041/2027] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:46 2022] GET /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4 => generated 1323 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:47.524128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2c39ce81-77cb-47a1-b989-1e390dd02fa5 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:47.524982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2c39ce81-77cb-47a1-b989-1e390dd02fa5 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:47.536103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c39ce81-77cb-47a1-b989-1e390dd02fa5 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:47.537409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c39ce81-77cb-47a1-b989-1e390dd02fa5 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:47.538227 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c39ce81-77cb-47a1-b989-1e390dd02fa5 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:47.539548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c39ce81-77cb-47a1-b989-1e390dd02fa5 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:47.540461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c39ce81-77cb-47a1-b989-1e390dd02fa5 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:47.542799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c39ce81-77cb-47a1-b989-1e390dd02fa5 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:48.189940 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5df743e3-361b-4724-aef1-2299c4657bf4 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/ac52201a-8b6c-4fe3-9bb5-793ac481ef0b" status: 202 len: 0 microversion: 2.1 time: 1.213883 Sep 07 12:37:48.192162 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 987/2028] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:37:46 2022] DELETE /compute/v2.1/os-security-groups/ac52201a-8b6c-4fe3-9bb5-793ac481ef0b => generated 0 bytes in 1217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:37:48.209463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2c39ce81-77cb-47a1-b989-1e390dd02fa5 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cead0c007d8545b3a32963668fbbe23e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e13a7ebce0646f8aea71d49eaa698d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:48.210324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb95267c-ebdf-49d2-b3f4-f3ce8ad73dbc tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:48.213873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cb95267c-ebdf-49d2-b3f4-f3ce8ad73dbc tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:48.228321 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2c39ce81-77cb-47a1-b989-1e390dd02fa5 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf" status: 200 len: 1540 microversion: 2.1 time: 0.715502 Sep 07 12:37:48.231836 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1042/2029] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:47 2022] GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf => generated 1540 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:48.243022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d824bc9b-11d5-4f0e-8d51-c6fe52c27ba9 req-1c69b749-2405-4091-bd5d-e04670960630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16417424-f738-4fcf-8a54-4941ec487fa4", "name": "network-vif-plugged", "status": "completed", "tag": "e28093e8-45ae-4bd9-a348-a9b5fd640aea"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:48.273541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d824bc9b-11d5-4f0e-8d51-c6fe52c27ba9 req-1c69b749-2405-4091-bd5d-e04670960630 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:48.274618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d824bc9b-11d5-4f0e-8d51-c6fe52c27ba9 req-1c69b749-2405-4091-bd5d-e04670960630 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:48.275494 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d824bc9b-11d5-4f0e-8d51-c6fe52c27ba9 req-1c69b749-2405-4091-bd5d-e04670960630 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:48.278767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb95267c-ebdf-49d2-b3f4-f3ce8ad73dbc tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:48.279516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb95267c-ebdf-49d2-b3f4-f3ce8ad73dbc tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:48.281080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb95267c-ebdf-49d2-b3f4-f3ce8ad73dbc tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:48.281612 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb95267c-ebdf-49d2-b3f4-f3ce8ad73dbc tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:48.282447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb95267c-ebdf-49d2-b3f4-f3ce8ad73dbc tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:48.283258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb95267c-ebdf-49d2-b3f4-f3ce8ad73dbc tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:48.332857 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d824bc9b-11d5-4f0e-8d51-c6fe52c27ba9 req-1c69b749-2405-4091-bd5d-e04670960630 service nova] Creating event network-vif-plugged:e28093e8-45ae-4bd9-a348-a9b5fd640aea for instance 16417424-f738-4fcf-8a54-4941ec487fa4 on n-h1-852087-9 Sep 07 12:37:48.343404 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d824bc9b-11d5-4f0e-8d51-c6fe52c27ba9 req-1c69b749-2405-4091-bd5d-e04670960630 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107579 Sep 07 12:37:48.345156 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1043/2030] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:48.356467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aae76793-b8f5-4969-83df-e839c143bfb2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:48.358660 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aae76793-b8f5-4969-83df-e839c143bfb2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:48.372618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aae76793-b8f5-4969-83df-e839c143bfb2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:48.374267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aae76793-b8f5-4969-83df-e839c143bfb2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:48.375621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aae76793-b8f5-4969-83df-e839c143bfb2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:48.377505 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aae76793-b8f5-4969-83df-e839c143bfb2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:48.378868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aae76793-b8f5-4969-83df-e839c143bfb2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:48.380225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aae76793-b8f5-4969-83df-e839c143bfb2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:48.772821 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cb95267c-ebdf-49d2-b3f4-f3ce8ad73dbc tempest-LiveMigrationTest-27157498 tempest-LiveMigrationTest-27157498-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1534 microversion: 2.1 time: 0.563580 Sep 07 12:37:48.780096 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 988/2031] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:48 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1534 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:48.809251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3f27fa8f-5730-4630-b6e2-92b4950eedb0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:48.812926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3f27fa8f-5730-4630-b6e2-92b4950eedb0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 704ec36d-6304-4089-9e70-12b23b3c795e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:48.846201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f27fa8f-5730-4630-b6e2-92b4950eedb0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:48.847709 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f27fa8f-5730-4630-b6e2-92b4950eedb0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:48.850782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f27fa8f-5730-4630-b6e2-92b4950eedb0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:48.852674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f27fa8f-5730-4630-b6e2-92b4950eedb0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:48.855796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f27fa8f-5730-4630-b6e2-92b4950eedb0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:48.857262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f27fa8f-5730-4630-b6e2-92b4950eedb0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:48.868279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aae76793-b8f5-4969-83df-e839c143bfb2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:48.882235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aae76793-b8f5-4969-83df-e839c143bfb2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:48.885975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aae76793-b8f5-4969-83df-e839c143bfb2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:48.887607 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aae76793-b8f5-4969-83df-e839c143bfb2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1293 microversion: 2.25 time: 0.540087 Sep 07 12:37:48.910826 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1044/2032] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:37:48 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1293 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:37:48.936792 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1a9ccc9f-465a-412f-a593-223392719f43 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc4192baaf0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:49.007999 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1a9ccc9f-465a-412f-a593-223392719f43 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c" status: 200 len: 1437 microversion: 2.1 time: 0.095673 Sep 07 12:37:49.017513 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1045/2033] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:37:48 2022] GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c => generated 1437 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:49.023430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-762967bb-0647-460a-96e1-daccef6528e3 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Calling method '.version_select at 0x7fc4194e4430>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:49.132900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3f27fa8f-5730-4630-b6e2-92b4950eedb0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:49.149474 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3f27fa8f-5730-4630-b6e2-92b4950eedb0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e" status: 200 len: 1272 microversion: 2.1 time: 0.365448 Sep 07 12:37:49.163362 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 989/2034] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:48 2022] GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e => generated 1272 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:49.168292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-668cc3ee-98ce-41df-bbad-9683f5989914 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:49.169147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-668cc3ee-98ce-41df-bbad-9683f5989914 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 16417424-f738-4fcf-8a54-4941ec487fa4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:49.180747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-668cc3ee-98ce-41df-bbad-9683f5989914 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:49.184167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-668cc3ee-98ce-41df-bbad-9683f5989914 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:49.184987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-668cc3ee-98ce-41df-bbad-9683f5989914 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:49.186887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-668cc3ee-98ce-41df-bbad-9683f5989914 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:49.193904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-668cc3ee-98ce-41df-bbad-9683f5989914 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:49.195000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-668cc3ee-98ce-41df-bbad-9683f5989914 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:49.757863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-668cc3ee-98ce-41df-bbad-9683f5989914 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41979e405fab49029d8ff5a9903e36ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00ac02c77f40f5ab6acbe538c9566b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:49.789922 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-668cc3ee-98ce-41df-bbad-9683f5989914 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "GET /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4" status: 200 len: 1323 microversion: 2.1 time: 0.633033 Sep 07 12:37:49.791546 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 990/2035] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:49 2022] GET /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4 => generated 1323 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:49.799204 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-762967bb-0647-460a-96e1-daccef6528e3 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8e250323-4fca-4b90-969a-619d3724b786" status: 202 len: 0 microversion: 2.1 time: 0.778987 Sep 07 12:37:49.801652 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1046/2036] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:37:49 2022] DELETE /compute/v2.1/os-security-groups/8e250323-4fca-4b90-969a-619d3724b786 => generated 0 bytes in 783 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:37:49.826554 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-49bece05-cadd-4070-b10d-0aa28f8fdf9e tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:49.827793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a1bcfdd8-7e55-4d84-a380-d0842d261d15 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:49.828049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-49bece05-cadd-4070-b10d-0aa28f8fdf9e tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:49.832192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a1bcfdd8-7e55-4d84-a380-d0842d261d15 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:49.844527 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49bece05-cadd-4070-b10d-0aa28f8fdf9e tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:49.845841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49bece05-cadd-4070-b10d-0aa28f8fdf9e tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:49.846856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49bece05-cadd-4070-b10d-0aa28f8fdf9e tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:49.848474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49bece05-cadd-4070-b10d-0aa28f8fdf9e tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:49.850101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49bece05-cadd-4070-b10d-0aa28f8fdf9e tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:49.852192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49bece05-cadd-4070-b10d-0aa28f8fdf9e tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:49.866604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1bcfdd8-7e55-4d84-a380-d0842d261d15 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:49.867509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1bcfdd8-7e55-4d84-a380-d0842d261d15 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:49.868314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1bcfdd8-7e55-4d84-a380-d0842d261d15 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:49.869978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1bcfdd8-7e55-4d84-a380-d0842d261d15 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:49.870702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1bcfdd8-7e55-4d84-a380-d0842d261d15 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:49.871424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1bcfdd8-7e55-4d84-a380-d0842d261d15 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:49.979584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a1bcfdd8-7e55-4d84-a380-d0842d261d15 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:37:50.251326 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a1bcfdd8-7e55-4d84-a380-d0842d261d15 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "DELETE /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 204 len: 0 microversion: 2.1 time: 0.447192 Sep 07 12:37:50.252371 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1047/2037] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:37:49 2022] DELETE /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:37:50.271546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd402015-9857-4669-80ea-912fad425727 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Calling method '.version_select at 0x7fc4192ba700>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:50.887677 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-49bece05-cadd-4070-b10d-0aa28f8fdf9e tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cead0c007d8545b3a32963668fbbe23e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e13a7ebce0646f8aea71d49eaa698d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:50.928702 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-49bece05-cadd-4070-b10d-0aa28f8fdf9e tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf" status: 200 len: 1540 microversion: 2.1 time: 1.122432 Sep 07 12:37:50.951558 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 991/2038] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:49 2022] GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf => generated 1540 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:50.988641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4b24fd37-6db1-4244-870f-bb257f233811 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:50.990425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4b24fd37-6db1-4244-870f-bb257f233811 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:51.021241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b24fd37-6db1-4244-870f-bb257f233811 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:51.025577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b24fd37-6db1-4244-870f-bb257f233811 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:51.027537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b24fd37-6db1-4244-870f-bb257f233811 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:51.030082 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b24fd37-6db1-4244-870f-bb257f233811 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:51.031347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b24fd37-6db1-4244-870f-bb257f233811 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:51.032667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b24fd37-6db1-4244-870f-bb257f233811 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:51.668623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4b24fd37-6db1-4244-870f-bb257f233811 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:51.681913 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4b24fd37-6db1-4244-870f-bb257f233811 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:51.683054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4b24fd37-6db1-4244-870f-bb257f233811 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:51.684293 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4b24fd37-6db1-4244-870f-bb257f233811 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1293 microversion: 2.25 time: 0.731344 Sep 07 12:37:51.684886 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 992/2039] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:37:50 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1293 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:37:51.720895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5cd43e02-1174-4b2b-8026-b70c84580594 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc4188478b0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:51.782932 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dd402015-9857-4669-80ea-912fad425727 tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/73d929d4-9de8-4a7c-a812-dafdcf95fba1" status: 202 len: 0 microversion: 2.1 time: 1.528540 Sep 07 12:37:51.783670 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1048/2040] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:37:50 2022] DELETE /compute/v2.1/os-security-groups/73d929d4-9de8-4a7c-a812-dafdcf95fba1 => generated 0 bytes in 1531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:37:51.789180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e46437d1-e60b-46fd-8818-ddc0343fc84e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:51.794818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e46437d1-e60b-46fd-8818-ddc0343fc84e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 704ec36d-6304-4089-9e70-12b23b3c795e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:51.812468 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:37:51.837054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e46437d1-e60b-46fd-8818-ddc0343fc84e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:51.837609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e46437d1-e60b-46fd-8818-ddc0343fc84e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:51.838191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e46437d1-e60b-46fd-8818-ddc0343fc84e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:51.838969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e46437d1-e60b-46fd-8818-ddc0343fc84e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:51.839434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e46437d1-e60b-46fd-8818-ddc0343fc84e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:51.839865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e46437d1-e60b-46fd-8818-ddc0343fc84e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:51.881249 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5cd43e02-1174-4b2b-8026-b70c84580594 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c" status: 200 len: 1437 microversion: 2.1 time: 0.194800 Sep 07 12:37:51.889184 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 993/2041] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:37:51 2022] GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c => generated 1437 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:51.910447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c01d54fd-e7db-4fa5-ac7e-44b41008197b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:51.912559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c01d54fd-e7db-4fa5-ac7e-44b41008197b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:51.940764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c01d54fd-e7db-4fa5-ac7e-44b41008197b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:51.943341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c01d54fd-e7db-4fa5-ac7e-44b41008197b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:51.946573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:37:51.947248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c01d54fd-e7db-4fa5-ac7e-44b41008197b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:51.953849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c01d54fd-e7db-4fa5-ac7e-44b41008197b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:51.956830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c01d54fd-e7db-4fa5-ac7e-44b41008197b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:51.960337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c01d54fd-e7db-4fa5-ac7e-44b41008197b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:52.750613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c01d54fd-e7db-4fa5-ac7e-44b41008197b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:52.762518 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c01d54fd-e7db-4fa5-ac7e-44b41008197b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1389 microversion: 2.1 time: 0.859291 Sep 07 12:37:52.783373 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 994/2042] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:51 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1389 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:52.815476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dea1e20c-1845-4adf-836f-884954a2c4b7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:52.816697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dea1e20c-1845-4adf-836f-884954a2c4b7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 16417424-f738-4fcf-8a54-4941ec487fa4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:52.843787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e46437d1-e60b-46fd-8818-ddc0343fc84e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:52.857990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dea1e20c-1845-4adf-836f-884954a2c4b7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:52.867692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dea1e20c-1845-4adf-836f-884954a2c4b7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:52.871828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dea1e20c-1845-4adf-836f-884954a2c4b7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:52.875555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dea1e20c-1845-4adf-836f-884954a2c4b7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:52.882948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dea1e20c-1845-4adf-836f-884954a2c4b7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:52.886724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dea1e20c-1845-4adf-836f-884954a2c4b7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:52.914482 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e46437d1-e60b-46fd-8818-ddc0343fc84e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e" status: 200 len: 1314 microversion: 2.1 time: 1.128925 Sep 07 12:37:52.916107 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1049/2043] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:51 2022] GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e => generated 1314 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:52.925747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-fc19601d-0340-49c9-8cc2-665f3985366d req-e99214e6-d7ba-4436-871c-6bedf6598c13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c8319cb-1eff-4ea4-9b2f-37ac6035c490", "name": "network-vif-plugged", "status": "completed", "tag": "b221a19c-0a57-40d9-8f2b-5759655c8975"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:52.956894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fc19601d-0340-49c9-8cc2-665f3985366d req-e99214e6-d7ba-4436-871c-6bedf6598c13 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:52.957767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fc19601d-0340-49c9-8cc2-665f3985366d req-e99214e6-d7ba-4436-871c-6bedf6598c13 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:52.959533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fc19601d-0340-49c9-8cc2-665f3985366d req-e99214e6-d7ba-4436-871c-6bedf6598c13 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:53.005473 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-fc19601d-0340-49c9-8cc2-665f3985366d req-e99214e6-d7ba-4436-871c-6bedf6598c13 service nova] Creating event network-vif-plugged:b221a19c-0a57-40d9-8f2b-5759655c8975 for instance 2c8319cb-1eff-4ea4-9b2f-37ac6035c490 on n-h2-852087-9 Sep 07 12:37:53.031213 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-fc19601d-0340-49c9-8cc2-665f3985366d req-e99214e6-d7ba-4436-871c-6bedf6598c13 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109132 Sep 07 12:37:53.033186 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1050/2044] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:53.056709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-401114c8-5e65-4acc-802a-02c7f80cfdbc req-0b3c5675-f07d-4e38-80b5-e626c5f5e951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4472f1be-6441-4955-b1a0-934980853ccf", "name": "network-vif-deleted", "tag": "d2cb7afc-63df-43ee-aefe-22e3a87e7b0d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:53.077909 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-401114c8-5e65-4acc-802a-02c7f80cfdbc req-0b3c5675-f07d-4e38-80b5-e626c5f5e951 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:53.079106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-401114c8-5e65-4acc-802a-02c7f80cfdbc req-0b3c5675-f07d-4e38-80b5-e626c5f5e951 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:53.080349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-401114c8-5e65-4acc-802a-02c7f80cfdbc req-0b3c5675-f07d-4e38-80b5-e626c5f5e951 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:53.109457 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-401114c8-5e65-4acc-802a-02c7f80cfdbc req-0b3c5675-f07d-4e38-80b5-e626c5f5e951 service nova] Creating event network-vif-deleted:d2cb7afc-63df-43ee-aefe-22e3a87e7b0d for instance 4472f1be-6441-4955-b1a0-934980853ccf on n-h2-852087-9 Sep 07 12:37:53.123049 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-401114c8-5e65-4acc-802a-02c7f80cfdbc req-0b3c5675-f07d-4e38-80b5-e626c5f5e951 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085683 Sep 07 12:37:53.125183 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1051/2045] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:53.137066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b7f1ea90-2286-4202-8cc1-31be777bca3e tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] Calling method '.version_select at 0x7fc41971ef70>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:53.523768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dea1e20c-1845-4adf-836f-884954a2c4b7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41979e405fab49029d8ff5a9903e36ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00ac02c77f40f5ab6acbe538c9566b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:53.548596 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dea1e20c-1845-4adf-836f-884954a2c4b7 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "GET /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4" status: 200 len: 1517 microversion: 2.1 time: 0.763749 Sep 07 12:37:53.549210 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 995/2046] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:52 2022] GET /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4 => generated 1517 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:53.561311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-33d15eb3-e9be-42a4-b05d-a2203fa1951b tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:53.573858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-33d15eb3-e9be-42a4-b05d-a2203fa1951b tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] [instance: 4472f1be-6441-4955-b1a0-934980853ccf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:53.598754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33d15eb3-e9be-42a4-b05d-a2203fa1951b tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:53.600966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33d15eb3-e9be-42a4-b05d-a2203fa1951b tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:53.604635 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33d15eb3-e9be-42a4-b05d-a2203fa1951b tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:53.605926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33d15eb3-e9be-42a4-b05d-a2203fa1951b tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:53.606879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33d15eb3-e9be-42a4-b05d-a2203fa1951b tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:53.607570 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33d15eb3-e9be-42a4-b05d-a2203fa1951b tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:53.653018 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-33d15eb3-e9be-42a4-b05d-a2203fa1951b tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] HTTP exception thrown: Instance 4472f1be-6441-4955-b1a0-934980853ccf could not be found. Sep 07 12:37:53.655123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-33d15eb3-e9be-42a4-b05d-a2203fa1951b tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Request method failure captured: Sep 07 12:37:53.655123 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf HTTP/1.1 Sep 07 12:37:53.655123 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:37:53.655123 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:37:53.655123 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:37:53.655123 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:37:53.655123 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:37:53.655123 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:37:53.655123 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:37:53.655123 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:37:53.655123 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJBOaITVB7ZGKtkDqZiwPTsjUOTP5nKpy0IvS8yLaYijhtlrbJk2oN6pF86qnFeVoTCx5JaTlDm1455GaGrhgrbw22YC6YF51VYynBsuSnu7pi6I4GJQ9_WmFroQ-QgP0MwYERtCgeJW7lStTRD8pM93BRg9vrsnGR66XAFSpeqcmXY Sep 07 12:37:53.655123 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:37:53.655123 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:37:53.655123 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:37:53.655123 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:37:53.655123 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:37:53.655123 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:37:53.655123 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 7e13a7ebce0646f8aea71d49eaa698d1 Sep 07 12:37:53.655123 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 Sep 07 12:37:53.655123 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:37:53.655123 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:37:53.657121 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7e13a7ebce0646f8aea71d49eaa698d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7e13a7ebce0646f8aea71d49eaa698d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7e13a7ebce0646f8aea71d49eaa698d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7e13a7ebce0646f8aea71d49eaa698d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:37:53.657121 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 Sep 07 12:37:53.657121 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 7e13a7ebce0646f8aea71d49eaa698d1 Sep 07 12:37:53.657121 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 Sep 07 12:37:53.657121 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project Sep 07 12:37:53.657121 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:37:53.657121 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:37:53.657121 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: cead0c007d8545b3a32963668fbbe23e Sep 07 12:37:53.657121 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project Sep 07 12:37:53.657121 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:37:53.657121 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 4472f1be-6441-4955-b1a0-934980853ccf could not be found. Sep 07 12:37:53.658080 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '4472f1be-6441-4955-b1a0-934980853ccf'} Sep 07 12:37:53.658080 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:37:53.658080 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:53.658080 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:37:53.658080 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:37:53.658080 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:37:53.658080 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:37:53.658080 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:37:53.658080 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:37:53.658080 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:37:53.658080 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:37:53.658080 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4472f1be-6441-4955-b1a0-934980853ccf could not be found. Sep 07 12:37:53.658080 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:53.658080 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:53.658080 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:53.658080 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:53.658080 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:53.658080 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:53.658080 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:37:53.658080 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:37:53.659700 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:37:53.659700 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:37:53.659700 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:37:53.659700 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:37:53.659700 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:37:53.659700 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:37:53.659700 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:37:53.659700 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:37:53.659700 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4472f1be-6441-4955-b1a0-934980853ccf could not be found. Sep 07 12:37:53.659700 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:53.659700 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:37:53.659700 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:53.659700 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:37:53.659700 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:37:53.659700 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:37:53.659700 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:37:53.659700 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:37:53.659700 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4472f1be-6441-4955-b1a0-934980853ccf could not be found. Sep 07 12:37:53.659700 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:37:53.667039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-33d15eb3-e9be-42a4-b05d-a2203fa1951b tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] Returning 404 to user: Instance 4472f1be-6441-4955-b1a0-934980853ccf could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:37:53.669030 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-33d15eb3-e9be-42a4-b05d-a2203fa1951b tempest-FloatingIPsAssociationNegativeTestJSON-1367759011 tempest-FloatingIPsAssociationNegativeTestJSON-1367759011-project] 10.222.0.16 "GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf" status: 404 len: 111 microversion: 2.1 time: 0.117204 Sep 07 12:37:53.670306 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 996/2047] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:53 2022] GET /compute/v2.1/servers/4472f1be-6441-4955-b1a0-934980853ccf => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:37:53.684640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-732b8e13-c806-4919-9aee-d44df584d299 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:53.689969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-732b8e13-c806-4919-9aee-d44df584d299 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:53.712747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-732b8e13-c806-4919-9aee-d44df584d299 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:53.713629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-732b8e13-c806-4919-9aee-d44df584d299 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:53.714270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-732b8e13-c806-4919-9aee-d44df584d299 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:53.715272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-732b8e13-c806-4919-9aee-d44df584d299 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:53.715978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-732b8e13-c806-4919-9aee-d44df584d299 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:53.716585 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-732b8e13-c806-4919-9aee-d44df584d299 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:54.223271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-732b8e13-c806-4919-9aee-d44df584d299 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:54.227047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:37:54.244928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-732b8e13-c806-4919-9aee-d44df584d299 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:54.246020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:37:54.248013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-732b8e13-c806-4919-9aee-d44df584d299 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:54.252982 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-732b8e13-c806-4919-9aee-d44df584d299 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1293 microversion: 2.25 time: 0.576237 Sep 07 12:37:54.254670 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 997/2048] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:37:53 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1293 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:37:54.264760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5031d205-2089-4aa6-ab13-d7563f36a3a0 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc4188474c0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:54.275484 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=14 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:37:54.292376 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b7f1ea90-2286-4202-8cc1-31be777bca3e tempest-SecurityGroupRulesNegativeTestJSON-1168758300 tempest-SecurityGroupRulesNegativeTestJSON-1168758300-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/4bc12727-6247-4cce-bdd5-e7762d5f4525" status: 202 len: 0 microversion: 2.1 time: 1.164867 Sep 07 12:37:54.293305 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1052/2049] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:37:53 2022] DELETE /compute/v2.1/os-security-groups/4bc12727-6247-4cce-bdd5-e7762d5f4525 => generated 0 bytes in 1167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:37:54.299142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e167a79c-7e67-460c-a7d4-ec16a419e186 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.28"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:54.303890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e167a79c-7e67-460c-a7d4-ec16a419e186 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:54.330495 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e167a79c-7e67-460c-a7d4-ec16a419e186 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:54.331313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e167a79c-7e67-460c-a7d4-ec16a419e186 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:54.331950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e167a79c-7e67-460c-a7d4-ec16a419e186 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:54.332862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e167a79c-7e67-460c-a7d4-ec16a419e186 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:54.336555 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e167a79c-7e67-460c-a7d4-ec16a419e186 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:54.337342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e167a79c-7e67-460c-a7d4-ec16a419e186 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:54.365185 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5031d205-2089-4aa6-ab13-d7563f36a3a0 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c" status: 200 len: 1437 microversion: 2.1 time: 0.108351 Sep 07 12:37:54.373247 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 998/2050] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:37:54 2022] GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c => generated 1437 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:54.383305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-505476f6-7694-427f-bb30-1b73cd3b5714 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:54.383952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-505476f6-7694-427f-bb30-1b73cd3b5714 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:54.393945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-505476f6-7694-427f-bb30-1b73cd3b5714 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:54.394453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-505476f6-7694-427f-bb30-1b73cd3b5714 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:54.394896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-505476f6-7694-427f-bb30-1b73cd3b5714 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:54.395620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-505476f6-7694-427f-bb30-1b73cd3b5714 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:54.396085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-505476f6-7694-427f-bb30-1b73cd3b5714 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:54.399872 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-505476f6-7694-427f-bb30-1b73cd3b5714 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:54.414743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e167a79c-7e67-460c-a7d4-ec16a419e186 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "refresh_cache-8817b2e5-125e-455f-9c44-e0f46786b5fa" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 12:37:54.415460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e167a79c-7e67-460c-a7d4-ec16a419e186 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquired lock "refresh_cache-8817b2e5-125e-455f-9c44-e0f46786b5fa" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 12:37:54.659690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-505476f6-7694-427f-bb30-1b73cd3b5714 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:54.686286 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-505476f6-7694-427f-bb30-1b73cd3b5714 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1184 microversion: 2.1 time: 0.312026 Sep 07 12:37:54.687865 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 999/2051] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:54 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1184 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:54.703242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b522d9a7-5054-4ed0-b6fa-3b2a96e1e43a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:54.714512 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b522d9a7-5054-4ed0-b6fa-3b2a96e1e43a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 704ec36d-6304-4089-9e70-12b23b3c795e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:54.731927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b522d9a7-5054-4ed0-b6fa-3b2a96e1e43a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:54.732428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b522d9a7-5054-4ed0-b6fa-3b2a96e1e43a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:54.732875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b522d9a7-5054-4ed0-b6fa-3b2a96e1e43a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:54.733657 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b522d9a7-5054-4ed0-b6fa-3b2a96e1e43a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:54.734143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b522d9a7-5054-4ed0-b6fa-3b2a96e1e43a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:54.734660 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b522d9a7-5054-4ed0-b6fa-3b2a96e1e43a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:54.973120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:37:56.032153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b522d9a7-5054-4ed0-b6fa-3b2a96e1e43a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:56.071383 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b522d9a7-5054-4ed0-b6fa-3b2a96e1e43a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e" status: 200 len: 1314 microversion: 2.1 time: 1.377923 Sep 07 12:37:56.080514 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1000/2052] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:54 2022] GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e => generated 1314 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:56.119460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-cbfff35f-a52e-49bd-a9d1-fdbc92b6bc4a req-bf71c97b-dd6d-4450-8383-e50090f7a038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c2a1933-970b-4c7d-a4b9-25cbc6f34768", "tag": "eef20a26-9e87-43bc-ad0b-150c5fcd678a"}, {"server_uuid": "48217fe9-fd3c-4c7c-aa31-f7c93c9873ae", "name": "network-vif-deleted", "tag": "20b0a985-e074-4d7c-935a-40f22026e773"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:56.188064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:37:56.210379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-cbfff35f-a52e-49bd-a9d1-fdbc92b6bc4a req-bf71c97b-dd6d-4450-8383-e50090f7a038 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:56.222851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-cbfff35f-a52e-49bd-a9d1-fdbc92b6bc4a req-bf71c97b-dd6d-4450-8383-e50090f7a038 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:56.226075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-cbfff35f-a52e-49bd-a9d1-fdbc92b6bc4a req-bf71c97b-dd6d-4450-8383-e50090f7a038 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:56.337430 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-cbfff35f-a52e-49bd-a9d1-fdbc92b6bc4a req-bf71c97b-dd6d-4450-8383-e50090f7a038 service nova] Creating event network-changed:eef20a26-9e87-43bc-ad0b-150c5fcd678a for instance 7c2a1933-970b-4c7d-a4b9-25cbc6f34768 on n-h2-852087-9 Sep 07 12:37:56.338817 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-cbfff35f-a52e-49bd-a9d1-fdbc92b6bc4a req-bf71c97b-dd6d-4450-8383-e50090f7a038 service nova] Creating event network-vif-deleted:20b0a985-e074-4d7c-935a-40f22026e773 for instance 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae on n-h1-852087-9 Sep 07 12:37:56.390419 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-cbfff35f-a52e-49bd-a9d1-fdbc92b6bc4a req-bf71c97b-dd6d-4450-8383-e50090f7a038 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.289262 Sep 07 12:37:56.393368 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1001/2053] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:56.416086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-80728e41-6445-4fbd-8b44-8bb24d273806 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:56.424148 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-80728e41-6445-4fbd-8b44-8bb24d273806 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:56.469077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80728e41-6445-4fbd-8b44-8bb24d273806 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:56.470828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80728e41-6445-4fbd-8b44-8bb24d273806 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:56.472044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80728e41-6445-4fbd-8b44-8bb24d273806 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:56.473717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80728e41-6445-4fbd-8b44-8bb24d273806 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:56.474894 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80728e41-6445-4fbd-8b44-8bb24d273806 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:56.476001 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80728e41-6445-4fbd-8b44-8bb24d273806 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:58.339255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-80728e41-6445-4fbd-8b44-8bb24d273806 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:58.376255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-80728e41-6445-4fbd-8b44-8bb24d273806 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:58.380053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-80728e41-6445-4fbd-8b44-8bb24d273806 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:58.388145 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-80728e41-6445-4fbd-8b44-8bb24d273806 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1281 microversion: 2.25 time: 1.989036 Sep 07 12:37:58.405435 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1002/2054] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:37:56 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1281 bytes in 1998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:37:58.415768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a4ac979c-c8ae-4547-b047-ac30b1a7a642 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41885ee50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:58.571008 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a4ac979c-c8ae-4547-b047-ac30b1a7a642 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c" status: 200 len: 1437 microversion: 2.1 time: 0.176961 Sep 07 12:37:58.582381 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1003/2055] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:37:58 2022] GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c => generated 1437 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:58.591432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-67a32db5-ed2e-4ae3-9d6c-7dc502b386ee req-fcee4674-b0c7-4605-8671-12c72d539104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "704ec36d-6304-4089-9e70-12b23b3c795e", "tag": "ae194be9-b61b-4fb3-8d00-fbe7ae1a96e6"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:37:58.651392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-67a32db5-ed2e-4ae3-9d6c-7dc502b386ee req-fcee4674-b0c7-4605-8671-12c72d539104 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:58.663861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-67a32db5-ed2e-4ae3-9d6c-7dc502b386ee req-fcee4674-b0c7-4605-8671-12c72d539104 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:58.670561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-67a32db5-ed2e-4ae3-9d6c-7dc502b386ee req-fcee4674-b0c7-4605-8671-12c72d539104 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:58.717452 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-67a32db5-ed2e-4ae3-9d6c-7dc502b386ee req-fcee4674-b0c7-4605-8671-12c72d539104 service nova] Creating event network-changed:ae194be9-b61b-4fb3-8d00-fbe7ae1a96e6 for instance 704ec36d-6304-4089-9e70-12b23b3c795e on n-h1-852087-9 Sep 07 12:37:58.741455 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-67a32db5-ed2e-4ae3-9d6c-7dc502b386ee req-fcee4674-b0c7-4605-8671-12c72d539104 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156744 Sep 07 12:37:58.749115 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1004/2056] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:37:58.783843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7b60c51d-fbaa-45db-9752-1cf8822fbdaa tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:58.785646 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7b60c51d-fbaa-45db-9752-1cf8822fbdaa tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:58.813290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b60c51d-fbaa-45db-9752-1cf8822fbdaa tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:58.814189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b60c51d-fbaa-45db-9752-1cf8822fbdaa tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:58.814970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b60c51d-fbaa-45db-9752-1cf8822fbdaa tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:58.819178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b60c51d-fbaa-45db-9752-1cf8822fbdaa tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:58.824398 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b60c51d-fbaa-45db-9752-1cf8822fbdaa tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:58.825643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b60c51d-fbaa-45db-9752-1cf8822fbdaa tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:59.235170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7b60c51d-fbaa-45db-9752-1cf8822fbdaa tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:59.257082 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7b60c51d-fbaa-45db-9752-1cf8822fbdaa tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1184 microversion: 2.1 time: 0.503030 Sep 07 12:37:59.259208 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1005/2057] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:58 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1184 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:59.281813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9be6fd99-bb2f-407a-98e0-a09413d1068b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:59.290094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9be6fd99-bb2f-407a-98e0-a09413d1068b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 704ec36d-6304-4089-9e70-12b23b3c795e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:37:59.313120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9be6fd99-bb2f-407a-98e0-a09413d1068b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:59.314607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9be6fd99-bb2f-407a-98e0-a09413d1068b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:59.315897 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9be6fd99-bb2f-407a-98e0-a09413d1068b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:59.317763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9be6fd99-bb2f-407a-98e0-a09413d1068b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:59.322809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9be6fd99-bb2f-407a-98e0-a09413d1068b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:59.324099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9be6fd99-bb2f-407a-98e0-a09413d1068b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:59.850456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9be6fd99-bb2f-407a-98e0-a09413d1068b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:59.864186 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9be6fd99-bb2f-407a-98e0-a09413d1068b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e" status: 200 len: 1314 microversion: 2.1 time: 0.602942 Sep 07 12:37:59.865202 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1006/2058] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:37:59 2022] GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e => generated 1314 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:37:59.877184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9616238a-3b00-4339-be7f-4f878ed3f9ac tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:37:59.885008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9616238a-3b00-4339-be7f-4f878ed3f9ac tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da21307adfcf48aca8a08c1ef316ff7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99763bdb3740a9af4a779ffc8238ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:37:59.898700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9616238a-3b00-4339-be7f-4f878ed3f9ac tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Searching by: {'deleted': False, 'project_id': 'da99763bdb3740a9af4a779ffc8238ef'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:37:59.906813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9616238a-3b00-4339-be7f-4f878ed3f9ac tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:59.909305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9616238a-3b00-4339-be7f-4f878ed3f9ac tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:59.912326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9616238a-3b00-4339-be7f-4f878ed3f9ac tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:37:59.918775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9616238a-3b00-4339-be7f-4f878ed3f9ac tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:37:59.919292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9616238a-3b00-4339-be7f-4f878ed3f9ac tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:37:59.919961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9616238a-3b00-4339-be7f-4f878ed3f9ac tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:00.159715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-9616238a-3b00-4339-be7f-4f878ed3f9ac tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:38:00.454412 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9616238a-3b00-4339-be7f-4f878ed3f9ac tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.579702 Sep 07 12:38:00.470081 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1007/2059] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Sep 7 12:37:59 2022] GET /compute/v2.1/servers => generated 339 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:38:00.496657 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-18e6be4d-a94f-4693-9726-6c909e9d396f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:00.502616 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-18e6be4d-a94f-4693-9726-6c909e9d396f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:00.520345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18e6be4d-a94f-4693-9726-6c909e9d396f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:00.521575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18e6be4d-a94f-4693-9726-6c909e9d396f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:00.522316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18e6be4d-a94f-4693-9726-6c909e9d396f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:00.523380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18e6be4d-a94f-4693-9726-6c909e9d396f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:00.524267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18e6be4d-a94f-4693-9726-6c909e9d396f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:00.524966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18e6be4d-a94f-4693-9726-6c909e9d396f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:01.522210 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-18e6be4d-a94f-4693-9726-6c909e9d396f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:01.548408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-18e6be4d-a94f-4693-9726-6c909e9d396f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:01.558745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-18e6be4d-a94f-4693-9726-6c909e9d396f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:01.560894 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-18e6be4d-a94f-4693-9726-6c909e9d396f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1281 microversion: 2.25 time: 1.089334 Sep 07 12:38:01.598475 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1008/2060] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:38:00 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1281 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:38:01.627367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-598c951f-7b45-475d-ae7d-be0b4f3a9130 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc4188994c0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:01.776262 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-598c951f-7b45-475d-ae7d-be0b4f3a9130 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c" status: 200 len: 1437 microversion: 2.1 time: 0.175397 Sep 07 12:38:01.778985 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1009/2061] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:38:01 2022] GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c => generated 1437 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:38:01.790642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1bee3509-8a93-4d18-a9a3-b59c8d3c0f74 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:01.793157 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1bee3509-8a93-4d18-a9a3-b59c8d3c0f74 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:01.804935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bee3509-8a93-4d18-a9a3-b59c8d3c0f74 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:01.806208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bee3509-8a93-4d18-a9a3-b59c8d3c0f74 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:01.807279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bee3509-8a93-4d18-a9a3-b59c8d3c0f74 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:01.809648 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bee3509-8a93-4d18-a9a3-b59c8d3c0f74 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:01.811041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bee3509-8a93-4d18-a9a3-b59c8d3c0f74 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:01.812057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bee3509-8a93-4d18-a9a3-b59c8d3c0f74 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:02.178240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1bee3509-8a93-4d18-a9a3-b59c8d3c0f74 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:02.204415 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-e167a79c-7e67-460c-a7d4-ec16a419e186 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] Building network info cache for instance {{(pid=122432) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 07 12:38:02.234220 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1bee3509-8a93-4d18-a9a3-b59c8d3c0f74 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1184 microversion: 2.1 time: 0.452992 Sep 07 12:38:02.271518 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1010/2062] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:38:01 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1184 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:38:02.282098 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-867fffed-3eea-4d9b-a664-9e5f33d3ded4 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:02.293627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-867fffed-3eea-4d9b-a664-9e5f33d3ded4 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da21307adfcf48aca8a08c1ef316ff7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99763bdb3740a9af4a779ffc8238ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:02.295429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-867fffed-3eea-4d9b-a664-9e5f33d3ded4 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Searching by: {'deleted': False, 'project_id': 'da99763bdb3740a9af4a779ffc8238ef'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:38:02.305961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-867fffed-3eea-4d9b-a664-9e5f33d3ded4 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:02.307572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-867fffed-3eea-4d9b-a664-9e5f33d3ded4 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:02.308847 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-867fffed-3eea-4d9b-a664-9e5f33d3ded4 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:02.310870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-867fffed-3eea-4d9b-a664-9e5f33d3ded4 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:02.311926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-867fffed-3eea-4d9b-a664-9e5f33d3ded4 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:02.313112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-867fffed-3eea-4d9b-a664-9e5f33d3ded4 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:02.381441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-867fffed-3eea-4d9b-a664-9e5f33d3ded4 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:38:02.828811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-867fffed-3eea-4d9b-a664-9e5f33d3ded4 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da21307adfcf48aca8a08c1ef316ff7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99763bdb3740a9af4a779ffc8238ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:02.862969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-867fffed-3eea-4d9b-a664-9e5f33d3ded4 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:02.865538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-867fffed-3eea-4d9b-a664-9e5f33d3ded4 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:02.866934 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-867fffed-3eea-4d9b-a664-9e5f33d3ded4 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:03.569920 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-867fffed-3eea-4d9b-a664-9e5f33d3ded4 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 1.296297 Sep 07 12:38:03.570589 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1011/2063] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:38:02 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:38:03.577523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-80ad63ea-8a35-45d4-9553-c96e110944b5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:03.579492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-80ad63ea-8a35-45d4-9553-c96e110944b5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 704ec36d-6304-4089-9e70-12b23b3c795e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:03.612132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80ad63ea-8a35-45d4-9553-c96e110944b5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:03.612615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80ad63ea-8a35-45d4-9553-c96e110944b5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:03.612971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80ad63ea-8a35-45d4-9553-c96e110944b5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:03.613754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80ad63ea-8a35-45d4-9553-c96e110944b5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:03.624321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80ad63ea-8a35-45d4-9553-c96e110944b5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:03.630265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80ad63ea-8a35-45d4-9553-c96e110944b5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:04.310799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=7 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:38:05.462349 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-80ad63ea-8a35-45d4-9553-c96e110944b5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:05.474191 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-80ad63ea-8a35-45d4-9553-c96e110944b5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e" status: 200 len: 1314 microversion: 2.1 time: 1.902202 Sep 07 12:38:05.495737 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1012/2064] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:38:03 2022] GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e => generated 1314 bytes in 1924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:38:05.513536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-88a5f80e-bff5-45d3-8b89-f9e94edb41be req-6e219a02-6955-4f07-af27-d041b3a83b0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8817b2e5-125e-455f-9c44-e0f46786b5fa", "tag": "f2fda9ed-aa0e-41f8-a289-5e6679639d1e"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:38:05.564329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-88a5f80e-bff5-45d3-8b89-f9e94edb41be req-6e219a02-6955-4f07-af27-d041b3a83b0d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:05.565696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-88a5f80e-bff5-45d3-8b89-f9e94edb41be req-6e219a02-6955-4f07-af27-d041b3a83b0d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:05.567701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-88a5f80e-bff5-45d3-8b89-f9e94edb41be req-6e219a02-6955-4f07-af27-d041b3a83b0d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:05.598417 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-88a5f80e-bff5-45d3-8b89-f9e94edb41be req-6e219a02-6955-4f07-af27-d041b3a83b0d service nova] Creating event network-changed:f2fda9ed-aa0e-41f8-a289-5e6679639d1e for instance 8817b2e5-125e-455f-9c44-e0f46786b5fa on n-h1-852087-9 Sep 07 12:38:05.611283 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-88a5f80e-bff5-45d3-8b89-f9e94edb41be req-6e219a02-6955-4f07-af27-d041b3a83b0d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111574 Sep 07 12:38:05.615484 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1013/2065] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:38:05.630753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-317c6b36-3e5e-4017-944a-fcfdfa0e143f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:05.632739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-317c6b36-3e5e-4017-944a-fcfdfa0e143f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:05.652929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-317c6b36-3e5e-4017-944a-fcfdfa0e143f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:05.654120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-317c6b36-3e5e-4017-944a-fcfdfa0e143f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:05.656073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-317c6b36-3e5e-4017-944a-fcfdfa0e143f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:05.660843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-317c6b36-3e5e-4017-944a-fcfdfa0e143f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:05.662173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-317c6b36-3e5e-4017-944a-fcfdfa0e143f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:05.666376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-317c6b36-3e5e-4017-944a-fcfdfa0e143f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:06.215236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-e167a79c-7e67-460c-a7d4-ec16a419e186 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] Updating instance_info_cache with network_info: [{"id": "f2fda9ed-aa0e-41f8-a289-5e6679639d1e", "address": "fa:16:3e:2a:39:9b", "network": {"id": "e919c9e1-6167-41ae-bc57-c4b7bc4c8d07", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-11914908-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dc00ac02c77f40f5ab6acbe538c9566b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf2fda9ed-aa", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122432) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 07 12:38:06.234608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e167a79c-7e67-460c-a7d4-ec16a419e186 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Releasing lock "refresh_cache-8817b2e5-125e-455f-9c44-e0f46786b5fa" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 12:38:06.235923 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e167a79c-7e67-460c-a7d4-ec16a419e186 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "POST /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa/action" status: 202 len: 0 microversion: 2.1 time: 11.941261 Sep 07 12:38:06.237129 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1053/2066] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:37:54 2022] POST /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa/action => generated 0 bytes in 11943 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 07 12:38:06.246881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-53ac514d-f4a2-4462-b1ed-4c0e7d89a01f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc418876dc0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:06.352402 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-53ac514d-f4a2-4462-b1ed-4c0e7d89a01f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c" status: 200 len: 1437 microversion: 2.1 time: 0.111978 Sep 07 12:38:06.353531 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1054/2067] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:38:06 2022] GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c => generated 1437 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:38:06.367369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3a13f57c-120f-449d-a4ab-c8063c509609 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:06.367998 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3a13f57c-120f-449d-a4ab-c8063c509609 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:06.399876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a13f57c-120f-449d-a4ab-c8063c509609 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:06.400447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a13f57c-120f-449d-a4ab-c8063c509609 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:06.400874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a13f57c-120f-449d-a4ab-c8063c509609 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:06.401636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a13f57c-120f-449d-a4ab-c8063c509609 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:06.402454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a13f57c-120f-449d-a4ab-c8063c509609 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:06.405814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a13f57c-120f-449d-a4ab-c8063c509609 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:06.550948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-317c6b36-3e5e-4017-944a-fcfdfa0e143f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:06.566650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-317c6b36-3e5e-4017-944a-fcfdfa0e143f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:06.568359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-317c6b36-3e5e-4017-944a-fcfdfa0e143f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:06.574074 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-317c6b36-3e5e-4017-944a-fcfdfa0e143f tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1281 microversion: 2.25 time: 0.954437 Sep 07 12:38:06.574991 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1014/2068] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:38:05 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1281 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:38:06.586610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-605b238d-8995-46cb-b045-6e0c11efa46e tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:06.590433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3a13f57c-120f-449d-a4ab-c8063c509609 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:06.605536 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-605b238d-8995-46cb-b045-6e0c11efa46e tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026587 Sep 07 12:38:06.606500 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3a13f57c-120f-449d-a4ab-c8063c509609 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 200 len: 1184 microversion: 2.1 time: 0.240099 Sep 07 12:38:06.608196 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1015/2069] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:38:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:38:06.619823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-92b69ae5-612e-478d-8172-f4753914c80e tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.28"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:38:06.623875 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1055/2070] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:38:06 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 1184 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:38:06.630028 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-92b69ae5-612e-478d-8172-f4753914c80e tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 16417424-f738-4fcf-8a54-4941ec487fa4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:06.637026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1eabac79-0a8d-4942-a330-83ea65e894d4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:06.641655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1eabac79-0a8d-4942-a330-83ea65e894d4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 704ec36d-6304-4089-9e70-12b23b3c795e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:06.655949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92b69ae5-612e-478d-8172-f4753914c80e tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:06.656937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92b69ae5-612e-478d-8172-f4753914c80e tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:06.659338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92b69ae5-612e-478d-8172-f4753914c80e tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:06.660522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92b69ae5-612e-478d-8172-f4753914c80e tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:06.660691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92b69ae5-612e-478d-8172-f4753914c80e tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:06.661109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92b69ae5-612e-478d-8172-f4753914c80e tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:06.662895 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eabac79-0a8d-4942-a330-83ea65e894d4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:06.665916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eabac79-0a8d-4942-a330-83ea65e894d4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:06.666646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eabac79-0a8d-4942-a330-83ea65e894d4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:06.668782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eabac79-0a8d-4942-a330-83ea65e894d4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:06.673620 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eabac79-0a8d-4942-a330-83ea65e894d4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:06.674482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eabac79-0a8d-4942-a330-83ea65e894d4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:06.803547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92b69ae5-612e-478d-8172-f4753914c80e tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "refresh_cache-16417424-f738-4fcf-8a54-4941ec487fa4" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 12:38:06.808724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92b69ae5-612e-478d-8172-f4753914c80e tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquired lock "refresh_cache-16417424-f738-4fcf-8a54-4941ec487fa4" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 12:38:08.188773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1eabac79-0a8d-4942-a330-83ea65e894d4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:08.211128 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1eabac79-0a8d-4942-a330-83ea65e894d4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e" status: 200 len: 1314 microversion: 2.1 time: 1.585609 Sep 07 12:38:08.227599 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1056/2071] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:38:06 2022] GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e => generated 1314 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:38:08.254407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e98a1a9-fbbf-4e6c-90f2-ae9b03bf5b5b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:08.255749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2e98a1a9-fbbf-4e6c-90f2-ae9b03bf5b5b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] [instance: e068f19a-c0b5-4648-be84-71deaa1b580e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:08.282095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e98a1a9-fbbf-4e6c-90f2-ae9b03bf5b5b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:08.283771 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e98a1a9-fbbf-4e6c-90f2-ae9b03bf5b5b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:08.284887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e98a1a9-fbbf-4e6c-90f2-ae9b03bf5b5b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:08.286432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e98a1a9-fbbf-4e6c-90f2-ae9b03bf5b5b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:08.287430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e98a1a9-fbbf-4e6c-90f2-ae9b03bf5b5b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:08.288862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e98a1a9-fbbf-4e6c-90f2-ae9b03bf5b5b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:08.371268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2e98a1a9-fbbf-4e6c-90f2-ae9b03bf5b5b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] [instance: e068f19a-c0b5-4648-be84-71deaa1b580e] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:38:08.721596 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2e98a1a9-fbbf-4e6c-90f2-ae9b03bf5b5b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e" status: 204 len: 0 microversion: 2.1 time: 0.478631 Sep 07 12:38:08.733532 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1057/2072] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:38:08 2022] DELETE /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:38:08.747324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ba18d78c-d817-455b-a9bd-0c93791fd9ef tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc4192e5dc0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:08.882022 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ba18d78c-d817-455b-a9bd-0c93791fd9ef tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c" status: 200 len: 1437 microversion: 2.1 time: 0.146211 Sep 07 12:38:08.882645 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1058/2073] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:38:08 2022] GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c => generated 1437 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:38:08.910188 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-03c5cb9d-7135-494b-84a2-c6305e1dec19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:08.910977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-03c5cb9d-7135-494b-84a2-c6305e1dec19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:08.950210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03c5cb9d-7135-494b-84a2-c6305e1dec19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:08.957713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03c5cb9d-7135-494b-84a2-c6305e1dec19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:08.957713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03c5cb9d-7135-494b-84a2-c6305e1dec19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:08.958204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03c5cb9d-7135-494b-84a2-c6305e1dec19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:08.958697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03c5cb9d-7135-494b-84a2-c6305e1dec19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:08.959138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03c5cb9d-7135-494b-84a2-c6305e1dec19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:10.096728 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-03c5cb9d-7135-494b-84a2-c6305e1dec19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:10.119901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-03c5cb9d-7135-494b-84a2-c6305e1dec19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:10.138208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-03c5cb9d-7135-494b-84a2-c6305e1dec19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:10.139794 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-03c5cb9d-7135-494b-84a2-c6305e1dec19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1281 microversion: 2.25 time: 1.256167 Sep 07 12:38:10.143518 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1059/2074] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:38:08 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1281 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:38:10.152208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-38f2e239-2206-413e-b15f-7f7d23772ced tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:10.158591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-38f2e239-2206-413e-b15f-7f7d23772ced tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:10.170745 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38f2e239-2206-413e-b15f-7f7d23772ced tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:10.176817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38f2e239-2206-413e-b15f-7f7d23772ced tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:10.177601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38f2e239-2206-413e-b15f-7f7d23772ced tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:10.181536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38f2e239-2206-413e-b15f-7f7d23772ced tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:10.182367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38f2e239-2206-413e-b15f-7f7d23772ced tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:10.186138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38f2e239-2206-413e-b15f-7f7d23772ced tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:10.229574 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-38f2e239-2206-413e-b15f-7f7d23772ced tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] HTTP exception thrown: Instance 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae could not be found. Sep 07 12:38:10.243809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-38f2e239-2206-413e-b15f-7f7d23772ced tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Request method failure captured: Sep 07 12:38:10.243809 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae HTTP/1.1 Sep 07 12:38:10.243809 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:38:10.243809 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:38:10.243809 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:38:10.243809 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:38:10.243809 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:38:10.243809 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:38:10.243809 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:38:10.243809 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:38:10.243809 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5zwGzwkngoYC-cJ2GbjommfZAenk5Snsx6zvVP-qrJN5QM5lt2HU9sKJdgOR49GCVF27sYloiDGYPH3cZ6h6iUb6YYX6mjjvqEsBfKHFhbmA5MBDDgGhP3f8hmP38AhCjVLT5MNdjVTOul4ymqUAKxYqPGo8PkF5sFmvW_ekZghlk Sep 07 12:38:10.243809 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:38:10.243809 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:38:10.243809 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:38:10.243809 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:38:10.243809 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:38:10.243809 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:38:10.243809 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: b32e8c6ba4e2486aa9769db48d2250d9 Sep 07 12:38:10.243809 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-LiveMigrationTest-546501661 Sep 07 12:38:10.243809 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:38:10.243809 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:38:10.245757 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b32e8c6ba4e2486aa9769db48d2250d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b32e8c6ba4e2486aa9769db48d2250d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b32e8c6ba4e2486aa9769db48d2250d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b32e8c6ba4e2486aa9769db48d2250d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:38:10.245757 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-LiveMigrationTest-546501661 Sep 07 12:38:10.245757 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: b32e8c6ba4e2486aa9769db48d2250d9 Sep 07 12:38:10.245757 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-LiveMigrationTest-546501661 Sep 07 12:38:10.245757 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-LiveMigrationTest-546501661-project Sep 07 12:38:10.245757 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:38:10.245757 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:38:10.245757 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: f009cb4fb12841a0ada96dc8c47cf2bd Sep 07 12:38:10.245757 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-LiveMigrationTest-546501661-project Sep 07 12:38:10.245757 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:38:10.245757 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae could not be found. Sep 07 12:38:10.245757 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '48217fe9-fd3c-4c7c-aa31-f7c93c9873ae'} Sep 07 12:38:10.246866 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:38:10.246866 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:38:10.246866 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:38:10.246866 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:38:10.246866 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:38:10.246866 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:38:10.246866 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:38:10.246866 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:38:10.246866 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:38:10.246866 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:38:10.246866 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae could not be found. Sep 07 12:38:10.246866 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:38:10.246866 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:38:10.246866 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:38:10.246866 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:38:10.246866 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:38:10.246866 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:38:10.246866 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:38:10.246866 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:38:10.246866 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:38:10.248643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:38:10.248643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:38:10.248643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:38:10.248643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:38:10.248643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:38:10.248643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:38:10.248643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:38:10.248643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae could not be found. Sep 07 12:38:10.248643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:38:10.248643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:38:10.248643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:38:10.248643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:38:10.248643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:38:10.248643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:38:10.248643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:38:10.248643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:38:10.248643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae could not be found. Sep 07 12:38:10.248643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:38:10.251278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-38f2e239-2206-413e-b15f-7f7d23772ced tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Returning 404 to user: Instance 48217fe9-fd3c-4c7c-aa31-f7c93c9873ae could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:38:10.255395 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-38f2e239-2206-413e-b15f-7f7d23772ced tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae" status: 404 len: 111 microversion: 2.1 time: 0.110362 Sep 07 12:38:10.256593 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1060/2075] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:38:10 2022] GET /compute/v2.1/servers/48217fe9-fd3c-4c7c-aa31-f7c93c9873ae => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:38:10.267373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-71922a29-7a7f-4638-b97a-99238e8126d8 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:10.270880 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-71922a29-7a7f-4638-b97a-99238e8126d8 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] [instance: e068f19a-c0b5-4648-be84-71deaa1b580e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:10.292275 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71922a29-7a7f-4638-b97a-99238e8126d8 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:10.293175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71922a29-7a7f-4638-b97a-99238e8126d8 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:10.293880 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71922a29-7a7f-4638-b97a-99238e8126d8 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:10.294893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71922a29-7a7f-4638-b97a-99238e8126d8 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:10.295775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71922a29-7a7f-4638-b97a-99238e8126d8 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:10.306574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71922a29-7a7f-4638-b97a-99238e8126d8 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:10.972265 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-71922a29-7a7f-4638-b97a-99238e8126d8 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da21307adfcf48aca8a08c1ef316ff7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99763bdb3740a9af4a779ffc8238ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:11.008637 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-71922a29-7a7f-4638-b97a-99238e8126d8 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] 10.222.0.16 "GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e" status: 200 len: 1714 microversion: 2.1 time: 0.750606 Sep 07 12:38:11.010026 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1061/2076] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:38:10 2022] GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e => generated 1714 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:38:11.019706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-51a0a79c-2af9-4905-aca1-b9be05d88e45 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:11.024326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-51a0a79c-2af9-4905-aca1-b9be05d88e45 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 704ec36d-6304-4089-9e70-12b23b3c795e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:11.049374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51a0a79c-2af9-4905-aca1-b9be05d88e45 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:11.050077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51a0a79c-2af9-4905-aca1-b9be05d88e45 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:11.050662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51a0a79c-2af9-4905-aca1-b9be05d88e45 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:11.051791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51a0a79c-2af9-4905-aca1-b9be05d88e45 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:11.052121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51a0a79c-2af9-4905-aca1-b9be05d88e45 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:11.052666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51a0a79c-2af9-4905-aca1-b9be05d88e45 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:11.729568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-51a0a79c-2af9-4905-aca1-b9be05d88e45 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:11.798334 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-51a0a79c-2af9-4905-aca1-b9be05d88e45 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e" status: 200 len: 1314 microversion: 2.1 time: 0.786017 Sep 07 12:38:11.826024 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1062/2077] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:38:11 2022] GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e => generated 1314 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:38:11.878778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-0697bfc9-4ae0-40ed-adf9-7727ad138f9f req-a7993426-7e27-4cea-afbb-c690002da310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "704ec36d-6304-4089-9e70-12b23b3c795e", "name": "network-vif-plugged", "status": "completed", "tag": "ae194be9-b61b-4fb3-8d00-fbe7ae1a96e6"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:38:11.949133 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0697bfc9-4ae0-40ed-adf9-7727ad138f9f req-a7993426-7e27-4cea-afbb-c690002da310 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:11.950441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0697bfc9-4ae0-40ed-adf9-7727ad138f9f req-a7993426-7e27-4cea-afbb-c690002da310 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:11.951947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0697bfc9-4ae0-40ed-adf9-7727ad138f9f req-a7993426-7e27-4cea-afbb-c690002da310 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:12.012703 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-0697bfc9-4ae0-40ed-adf9-7727ad138f9f req-a7993426-7e27-4cea-afbb-c690002da310 service nova] Creating event network-vif-plugged:ae194be9-b61b-4fb3-8d00-fbe7ae1a96e6 for instance 704ec36d-6304-4089-9e70-12b23b3c795e on n-h1-852087-9 Sep 07 12:38:12.055035 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-0697bfc9-4ae0-40ed-adf9-7727ad138f9f req-a7993426-7e27-4cea-afbb-c690002da310 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225445 Sep 07 12:38:12.063373 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1063/2078] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:38:12.092310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b2e07673-ae2f-4f34-b537-0bbe02995dc8 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc419aad790>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:12.344077 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b2e07673-ae2f-4f34-b537-0bbe02995dc8 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c" status: 200 len: 1437 microversion: 2.1 time: 0.275357 Sep 07 12:38:12.350653 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:38:12.357897 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1064/2079] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:38:12 2022] GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c => generated 1437 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:38:12.377551 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9119ee3d-57ab-4fa8-a9b6-a10bec84dbd1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:12.384677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9119ee3d-57ab-4fa8-a9b6-a10bec84dbd1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:12.425141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9119ee3d-57ab-4fa8-a9b6-a10bec84dbd1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:12.425688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9119ee3d-57ab-4fa8-a9b6-a10bec84dbd1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:12.426142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9119ee3d-57ab-4fa8-a9b6-a10bec84dbd1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:12.430200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9119ee3d-57ab-4fa8-a9b6-a10bec84dbd1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:12.430706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9119ee3d-57ab-4fa8-a9b6-a10bec84dbd1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:12.431157 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9119ee3d-57ab-4fa8-a9b6-a10bec84dbd1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:12.841425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:38:13.806593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9119ee3d-57ab-4fa8-a9b6-a10bec84dbd1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:13.862878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9119ee3d-57ab-4fa8-a9b6-a10bec84dbd1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:13.865538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9119ee3d-57ab-4fa8-a9b6-a10bec84dbd1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:13.868406 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9119ee3d-57ab-4fa8-a9b6-a10bec84dbd1 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1281 microversion: 2.25 time: 1.508969 Sep 07 12:38:13.885988 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1065/2080] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:38:12 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1281 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:38:13.903465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d965e261-98e0-4bbf-b1b6-f89a97da465b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:13.912427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d965e261-98e0-4bbf-b1b6-f89a97da465b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] [instance: e068f19a-c0b5-4648-be84-71deaa1b580e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:13.955651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d965e261-98e0-4bbf-b1b6-f89a97da465b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:13.957111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d965e261-98e0-4bbf-b1b6-f89a97da465b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:13.958425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d965e261-98e0-4bbf-b1b6-f89a97da465b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:13.960029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d965e261-98e0-4bbf-b1b6-f89a97da465b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:13.961123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d965e261-98e0-4bbf-b1b6-f89a97da465b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:13.962154 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d965e261-98e0-4bbf-b1b6-f89a97da465b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:14.318955 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.network.neutron [None req-92b69ae5-612e-478d-8172-f4753914c80e tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 16417424-f738-4fcf-8a54-4941ec487fa4] re-assign floating IP 172.25.8.28 from instance 8817b2e5-125e-455f-9c44-e0f46786b5fa Sep 07 12:38:14.414443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d965e261-98e0-4bbf-b1b6-f89a97da465b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da21307adfcf48aca8a08c1ef316ff7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99763bdb3740a9af4a779ffc8238ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:14.466985 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d965e261-98e0-4bbf-b1b6-f89a97da465b tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] 10.222.0.16 "GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e" status: 200 len: 1714 microversion: 2.1 time: 0.561294 Sep 07 12:38:14.471445 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1066/2081] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:38:13 2022] GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e => generated 1714 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:38:14.496798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8de17833-0b55-4e1a-a757-08aa7296bae4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:14.506670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8de17833-0b55-4e1a-a757-08aa7296bae4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 704ec36d-6304-4089-9e70-12b23b3c795e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:14.528208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8de17833-0b55-4e1a-a757-08aa7296bae4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:14.549671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8de17833-0b55-4e1a-a757-08aa7296bae4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:14.551040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8de17833-0b55-4e1a-a757-08aa7296bae4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:14.552833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8de17833-0b55-4e1a-a757-08aa7296bae4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:14.554250 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8de17833-0b55-4e1a-a757-08aa7296bae4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:14.555499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8de17833-0b55-4e1a-a757-08aa7296bae4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:15.227188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-92b69ae5-612e-478d-8172-f4753914c80e tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] Building network info cache for instance {{(pid=122433) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 07 12:38:16.646970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=29 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:38:16.677331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8de17833-0b55-4e1a-a757-08aa7296bae4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:16.697191 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8de17833-0b55-4e1a-a757-08aa7296bae4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e" status: 200 len: 1314 microversion: 2.1 time: 2.223229 Sep 07 12:38:16.713930 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1067/2082] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:38:14 2022] GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e => generated 1314 bytes in 2241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:38:16.724004 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-de1621d7-a7c8-42d1-b50a-19f35f73d49c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc419335700>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:16.891664 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-de1621d7-a7c8-42d1-b50a-19f35f73d49c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c" status: 200 len: 1437 microversion: 2.1 time: 0.174743 Sep 07 12:38:16.908420 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1068/2083] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:38:16 2022] GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c => generated 1437 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:38:16.949366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d4057f13-8ec5-4809-bd42-1efaeec4d0c3 req-65e7b9da-7fb6-4827-8e75-79b009fe4f85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8817b2e5-125e-455f-9c44-e0f46786b5fa", "tag": "f2fda9ed-aa0e-41f8-a289-5e6679639d1e"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:38:16.990652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d4057f13-8ec5-4809-bd42-1efaeec4d0c3 req-65e7b9da-7fb6-4827-8e75-79b009fe4f85 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:16.997160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d4057f13-8ec5-4809-bd42-1efaeec4d0c3 req-65e7b9da-7fb6-4827-8e75-79b009fe4f85 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:16.998031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d4057f13-8ec5-4809-bd42-1efaeec4d0c3 req-65e7b9da-7fb6-4827-8e75-79b009fe4f85 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:17.032003 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d4057f13-8ec5-4809-bd42-1efaeec4d0c3 req-65e7b9da-7fb6-4827-8e75-79b009fe4f85 service nova] Creating event network-changed:f2fda9ed-aa0e-41f8-a289-5e6679639d1e for instance 8817b2e5-125e-455f-9c44-e0f46786b5fa on n-h1-852087-9 Sep 07 12:38:17.041629 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d4057f13-8ec5-4809-bd42-1efaeec4d0c3 req-65e7b9da-7fb6-4827-8e75-79b009fe4f85 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130791 Sep 07 12:38:17.045970 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1069/2084] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:38:17.056148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-adc23ce9-57d4-4248-942a-dadb00b35ade req-575632b2-2aae-4977-8b13-d39442725754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2a1933-970b-4c7d-a4b9-25cbc6f34768", "name": "network-vif-plugged", "status": "completed", "tag": "eef20a26-9e87-43bc-ad0b-150c5fcd678a"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:38:17.091394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-adc23ce9-57d4-4248-942a-dadb00b35ade req-575632b2-2aae-4977-8b13-d39442725754 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:17.092397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-adc23ce9-57d4-4248-942a-dadb00b35ade req-575632b2-2aae-4977-8b13-d39442725754 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:17.093090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-adc23ce9-57d4-4248-942a-dadb00b35ade req-575632b2-2aae-4977-8b13-d39442725754 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:17.126798 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-adc23ce9-57d4-4248-942a-dadb00b35ade req-575632b2-2aae-4977-8b13-d39442725754 service nova] Creating event network-vif-plugged:eef20a26-9e87-43bc-ad0b-150c5fcd678a for instance 7c2a1933-970b-4c7d-a4b9-25cbc6f34768 on n-h2-852087-9 Sep 07 12:38:17.135279 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-adc23ce9-57d4-4248-942a-dadb00b35ade req-575632b2-2aae-4977-8b13-d39442725754 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087167 Sep 07 12:38:17.137817 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1070/2085] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:38:17.144185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-545aeff9-f8dd-453e-a427-3f19ce0f2182 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:17.145198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-545aeff9-f8dd-453e-a427-3f19ce0f2182 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:17.155313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-545aeff9-f8dd-453e-a427-3f19ce0f2182 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:17.156474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-545aeff9-f8dd-453e-a427-3f19ce0f2182 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:17.157318 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-545aeff9-f8dd-453e-a427-3f19ce0f2182 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:17.158894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-545aeff9-f8dd-453e-a427-3f19ce0f2182 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:17.159771 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-545aeff9-f8dd-453e-a427-3f19ce0f2182 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:17.160489 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-545aeff9-f8dd-453e-a427-3f19ce0f2182 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:19.932279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-545aeff9-f8dd-453e-a427-3f19ce0f2182 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:19.972967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-545aeff9-f8dd-453e-a427-3f19ce0f2182 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:19.983454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-545aeff9-f8dd-453e-a427-3f19ce0f2182 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:19.991355 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-545aeff9-f8dd-453e-a427-3f19ce0f2182 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1281 microversion: 2.25 time: 2.846686 Sep 07 12:38:19.993962 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1071/2086] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:38:17 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1281 bytes in 2855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:38:20.016832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-22e2872b-6649-4f61-831a-7e692e5dd3e4 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:20.018359 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-22e2872b-6649-4f61-831a-7e692e5dd3e4 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] [instance: e068f19a-c0b5-4648-be84-71deaa1b580e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:20.026268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22e2872b-6649-4f61-831a-7e692e5dd3e4 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:20.027193 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22e2872b-6649-4f61-831a-7e692e5dd3e4 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:20.028561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22e2872b-6649-4f61-831a-7e692e5dd3e4 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:20.029898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22e2872b-6649-4f61-831a-7e692e5dd3e4 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:20.030817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22e2872b-6649-4f61-831a-7e692e5dd3e4 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:20.031990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22e2872b-6649-4f61-831a-7e692e5dd3e4 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:20.058647 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-22e2872b-6649-4f61-831a-7e692e5dd3e4 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] HTTP exception thrown: Instance e068f19a-c0b5-4648-be84-71deaa1b580e could not be found. Sep 07 12:38:20.062357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-22e2872b-6649-4f61-831a-7e692e5dd3e4 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Request method failure captured: Sep 07 12:38:20.062357 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e HTTP/1.1 Sep 07 12:38:20.062357 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:38:20.062357 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:38:20.062357 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:38:20.062357 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:38:20.062357 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:38:20.062357 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:38:20.062357 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:38:20.062357 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:38:20.062357 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJApE4-6Loh2lQ6ISeNvudtAOEYeg1nycTzoynU5rctexVQ3GFZDMMqmsmV87_8W_tlY6Sr7JJh6ng6fpJVKO4pQaS2lRhWUr9HwhgJuBjrEitX-ZBqZ2hyubvqYNpLT_SF--W4GB97lPTDchwgk13laLOTl9bfgyDfpksLzZYr7VbI Sep 07 12:38:20.062357 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:38:20.062357 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:38:20.062357 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:38:20.062357 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:38:20.062357 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:38:20.062357 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:38:20.062357 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: da99763bdb3740a9af4a779ffc8238ef Sep 07 12:38:20.062357 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestManualDisk-94119060 Sep 07 12:38:20.062357 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:38:20.062357 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:38:20.064197 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da99763bdb3740a9af4a779ffc8238ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da99763bdb3740a9af4a779ffc8238ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da99763bdb3740a9af4a779ffc8238ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da99763bdb3740a9af4a779ffc8238ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:38:20.064197 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestManualDisk-94119060 Sep 07 12:38:20.064197 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: da99763bdb3740a9af4a779ffc8238ef Sep 07 12:38:20.064197 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestManualDisk-94119060 Sep 07 12:38:20.064197 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersTestManualDisk-94119060-project Sep 07 12:38:20.064197 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:38:20.064197 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:38:20.064197 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: da21307adfcf48aca8a08c1ef316ff7a Sep 07 12:38:20.064197 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestManualDisk-94119060-project Sep 07 12:38:20.064197 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:38:20.064197 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance e068f19a-c0b5-4648-be84-71deaa1b580e could not be found. Sep 07 12:38:20.064197 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'e068f19a-c0b5-4648-be84-71deaa1b580e'} Sep 07 12:38:20.065263 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:38:20.065263 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:38:20.065263 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:38:20.065263 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:38:20.065263 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:38:20.065263 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:38:20.065263 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:38:20.065263 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:38:20.065263 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:38:20.065263 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:38:20.065263 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e068f19a-c0b5-4648-be84-71deaa1b580e could not be found. Sep 07 12:38:20.065263 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:38:20.065263 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:38:20.065263 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:38:20.065263 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:38:20.065263 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:38:20.065263 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:38:20.065263 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:38:20.065263 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:38:20.065263 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:38:20.067708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:38:20.067708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:38:20.067708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:38:20.067708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:38:20.067708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:38:20.067708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:38:20.067708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:38:20.067708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e068f19a-c0b5-4648-be84-71deaa1b580e could not be found. Sep 07 12:38:20.067708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:38:20.067708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:38:20.067708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:38:20.067708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:38:20.067708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:38:20.067708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:38:20.067708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:38:20.067708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:38:20.067708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e068f19a-c0b5-4648-be84-71deaa1b580e could not be found. Sep 07 12:38:20.067708 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:38:20.071050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-22e2872b-6649-4f61-831a-7e692e5dd3e4 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Returning 404 to user: Instance e068f19a-c0b5-4648-be84-71deaa1b580e could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:38:20.072212 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-22e2872b-6649-4f61-831a-7e692e5dd3e4 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] 10.222.0.16 "GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e" status: 404 len: 111 microversion: 2.1 time: 0.076262 Sep 07 12:38:20.073625 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1072/2087] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:38:19 2022] GET /compute/v2.1/servers/e068f19a-c0b5-4648-be84-71deaa1b580e => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:38:20.079785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0cb6c19b-72f8-4f3b-97d8-f0f4bda922c3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:20.080787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0cb6c19b-72f8-4f3b-97d8-f0f4bda922c3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 704ec36d-6304-4089-9e70-12b23b3c795e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:20.088678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cb6c19b-72f8-4f3b-97d8-f0f4bda922c3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:20.089736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cb6c19b-72f8-4f3b-97d8-f0f4bda922c3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:20.090441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cb6c19b-72f8-4f3b-97d8-f0f4bda922c3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:20.091592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cb6c19b-72f8-4f3b-97d8-f0f4bda922c3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:20.092488 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cb6c19b-72f8-4f3b-97d8-f0f4bda922c3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:20.093163 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cb6c19b-72f8-4f3b-97d8-f0f4bda922c3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:20.153134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:38:20.169192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-92b69ae5-612e-478d-8172-f4753914c80e tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] Updating instance_info_cache with network_info: [{"id": "f2fda9ed-aa0e-41f8-a289-5e6679639d1e", "address": "fa:16:3e:2a:39:9b", "network": {"id": "e919c9e1-6167-41ae-bc57-c4b7bc4c8d07", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-11914908-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dc00ac02c77f40f5ab6acbe538c9566b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf2fda9ed-aa", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122433) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 07 12:38:20.220158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-92b69ae5-612e-478d-8172-f4753914c80e tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 16417424-f738-4fcf-8a54-4941ec487fa4] Building network info cache for instance {{(pid=122433) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 07 12:38:21.840258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0cb6c19b-72f8-4f3b-97d8-f0f4bda922c3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:21.888526 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0cb6c19b-72f8-4f3b-97d8-f0f4bda922c3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e" status: 200 len: 1501 microversion: 2.1 time: 1.813009 Sep 07 12:38:21.895937 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1073/2088] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:38:20 2022] GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e => generated 1501 bytes in 1821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:38:21.925269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-81c50b30-e252-4b75-affb-4f39f661ef4d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc4195678b0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:22.076229 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-81c50b30-e252-4b75-affb-4f39f661ef4d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c" status: 200 len: 1437 microversion: 2.1 time: 0.178163 Sep 07 12:38:22.078615 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1074/2089] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:38:21 2022] GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c => generated 1437 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:38:22.088951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-fadd3ec9-159d-4cd7-ba4b-e4ef13fc4dd9 req-1108d763-e98e-4c32-a13e-fe147de3ba1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e068f19a-c0b5-4648-be84-71deaa1b580e", "name": "network-vif-deleted", "tag": "8f6bb4ac-83bd-4502-ad70-a17a49f4f319"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:38:22.117115 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fadd3ec9-159d-4cd7-ba4b-e4ef13fc4dd9 req-1108d763-e98e-4c32-a13e-fe147de3ba1b service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:22.135807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fadd3ec9-159d-4cd7-ba4b-e4ef13fc4dd9 req-1108d763-e98e-4c32-a13e-fe147de3ba1b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:22.140582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fadd3ec9-159d-4cd7-ba4b-e4ef13fc4dd9 req-1108d763-e98e-4c32-a13e-fe147de3ba1b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:22.193857 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-fadd3ec9-159d-4cd7-ba4b-e4ef13fc4dd9 req-1108d763-e98e-4c32-a13e-fe147de3ba1b service nova] Creating event network-vif-deleted:8f6bb4ac-83bd-4502-ad70-a17a49f4f319 for instance e068f19a-c0b5-4648-be84-71deaa1b580e on n-h1-852087-9 Sep 07 12:38:22.216957 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-fadd3ec9-159d-4cd7-ba4b-e4ef13fc4dd9 req-1108d763-e98e-4c32-a13e-fe147de3ba1b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134703 Sep 07 12:38:22.219243 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1075/2090] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:38:22.273445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-eecaf806-9e25-49ba-8cd2-4713bb21aaf9 req-6b566d3d-9190-48ea-a0a1-423d89775a42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16417424-f738-4fcf-8a54-4941ec487fa4", "tag": "e28093e8-45ae-4bd9-a348-a9b5fd640aea"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:38:22.320410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-eecaf806-9e25-49ba-8cd2-4713bb21aaf9 req-6b566d3d-9190-48ea-a0a1-423d89775a42 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:22.320911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-eecaf806-9e25-49ba-8cd2-4713bb21aaf9 req-6b566d3d-9190-48ea-a0a1-423d89775a42 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:22.321357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-eecaf806-9e25-49ba-8cd2-4713bb21aaf9 req-6b566d3d-9190-48ea-a0a1-423d89775a42 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:22.364597 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-eecaf806-9e25-49ba-8cd2-4713bb21aaf9 req-6b566d3d-9190-48ea-a0a1-423d89775a42 service nova] Creating event network-changed:e28093e8-45ae-4bd9-a348-a9b5fd640aea for instance 16417424-f738-4fcf-8a54-4941ec487fa4 on n-h1-852087-9 Sep 07 12:38:22.391366 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-eecaf806-9e25-49ba-8cd2-4713bb21aaf9 req-6b566d3d-9190-48ea-a0a1-423d89775a42 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162823 Sep 07 12:38:22.395074 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1076/2091] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:38:22.430113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0cc9aba2-10a3-428d-a921-5f115b3f9655 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] Calling method '.version_select at 0x7fc419c040d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:22.483850 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0cc9aba2-10a3-428d-a921-5f115b3f9655 tempest-ServersTestManualDisk-94119060 tempest-ServersTestManualDisk-94119060-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-686004982" status: 202 len: 0 microversion: 2.1 time: 0.085124 Sep 07 12:38:22.489430 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1077/2092] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Sep 7 12:38:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-686004982 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:38:22.507517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bd3a0fe1-91ed-4dc1-99ce-7a5f05da05f7 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:22.510755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bd3a0fe1-91ed-4dc1-99ce-7a5f05da05f7 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:22.534175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd3a0fe1-91ed-4dc1-99ce-7a5f05da05f7 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:22.539150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd3a0fe1-91ed-4dc1-99ce-7a5f05da05f7 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:22.539790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd3a0fe1-91ed-4dc1-99ce-7a5f05da05f7 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:22.551551 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd3a0fe1-91ed-4dc1-99ce-7a5f05da05f7 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:22.552428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd3a0fe1-91ed-4dc1-99ce-7a5f05da05f7 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:22.553083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd3a0fe1-91ed-4dc1-99ce-7a5f05da05f7 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:23.465918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-92b69ae5-612e-478d-8172-f4753914c80e tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 16417424-f738-4fcf-8a54-4941ec487fa4] Updating instance_info_cache with network_info: [{"id": "e28093e8-45ae-4bd9-a348-a9b5fd640aea", "address": "fa:16:3e:03:1d:19", "network": {"id": "e919c9e1-6167-41ae-bc57-c4b7bc4c8d07", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-11914908-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dc00ac02c77f40f5ab6acbe538c9566b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape28093e8-45", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122433) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 07 12:38:23.507230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bd3a0fe1-91ed-4dc1-99ce-7a5f05da05f7 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:23.512103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92b69ae5-612e-478d-8172-f4753914c80e tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Releasing lock "refresh_cache-16417424-f738-4fcf-8a54-4941ec487fa4" {{(pid=122433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 12:38:23.519428 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-92b69ae5-612e-478d-8172-f4753914c80e tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "POST /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4/action" status: 202 len: 0 microversion: 2.1 time: 16.907820 Sep 07 12:38:23.523470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bd3a0fe1-91ed-4dc1-99ce-7a5f05da05f7 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:23.527122 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1016/2093] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:38:06 2022] POST /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4/action => generated 0 bytes in 16915 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 07 12:38:23.529596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bd3a0fe1-91ed-4dc1-99ce-7a5f05da05f7 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:23.533955 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bd3a0fe1-91ed-4dc1-99ce-7a5f05da05f7 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1476 microversion: 2.25 time: 1.040543 Sep 07 12:38:23.550221 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1078/2094] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:38:22 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1476 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:38:23.567751 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a87883a2-32a3-496e-94b1-6d618d685e6b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41971eee0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:23.570969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3349fb00-6f37-4ea8-9684-718e517c7754 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:23.572362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3349fb00-6f37-4ea8-9684-718e517c7754 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:23.620152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3349fb00-6f37-4ea8-9684-718e517c7754 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:23.630340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3349fb00-6f37-4ea8-9684-718e517c7754 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:23.631214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3349fb00-6f37-4ea8-9684-718e517c7754 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:23.632436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3349fb00-6f37-4ea8-9684-718e517c7754 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:23.633194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3349fb00-6f37-4ea8-9684-718e517c7754 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:23.657294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3349fb00-6f37-4ea8-9684-718e517c7754 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:23.665142 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a87883a2-32a3-496e-94b1-6d618d685e6b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c" status: 200 len: 1437 microversion: 2.1 time: 0.113341 Sep 07 12:38:23.667622 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1079/2095] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:38:23 2022] GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c => generated 1437 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:38:23.682708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-534d5fae-8c7d-4b88-a753-0182c4a1f20b tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.28"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:38:23.824792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:38:23.861703 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3349fb00-6f37-4ea8-9684-718e517c7754 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:38:24.053733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-534d5fae-8c7d-4b88-a753-0182c4a1f20b tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 16417424-f738-4fcf-8a54-4941ec487fa4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:24.064333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-534d5fae-8c7d-4b88-a753-0182c4a1f20b tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:24.065253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-534d5fae-8c7d-4b88-a753-0182c4a1f20b tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:24.066219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-534d5fae-8c7d-4b88-a753-0182c4a1f20b tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:24.067291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-534d5fae-8c7d-4b88-a753-0182c4a1f20b tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:24.069796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-534d5fae-8c7d-4b88-a753-0182c4a1f20b tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:24.072556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-534d5fae-8c7d-4b88-a753-0182c4a1f20b tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:24.282042 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3349fb00-6f37-4ea8-9684-718e517c7754 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 204 len: 0 microversion: 2.1 time: 0.751791 Sep 07 12:38:24.288490 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1017/2096] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:38:23 2022] DELETE /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:38:24.309787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7e0d6429-bfcc-4f4b-aba7-d4203c730d66 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:24.314857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7e0d6429-bfcc-4f4b-aba7-d4203c730d66 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:24.343390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e0d6429-bfcc-4f4b-aba7-d4203c730d66 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:24.351964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e0d6429-bfcc-4f4b-aba7-d4203c730d66 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:24.353288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e0d6429-bfcc-4f4b-aba7-d4203c730d66 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:24.355844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e0d6429-bfcc-4f4b-aba7-d4203c730d66 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:24.361109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e0d6429-bfcc-4f4b-aba7-d4203c730d66 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:24.362927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e0d6429-bfcc-4f4b-aba7-d4203c730d66 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:24.833063 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-534d5fae-8c7d-4b88-a753-0182c4a1f20b tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] HTTP exception thrown: Floating IP 172.25.8.28 is not associated with instance 8817b2e5-125e-455f-9c44-e0f46786b5fa. Sep 07 12:38:24.835661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-534d5fae-8c7d-4b88-a753-0182c4a1f20b tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Request method failure captured: Sep 07 12:38:24.835661 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa/action HTTP/1.1 Sep 07 12:38:24.835661 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:38:24.835661 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:38:24.835661 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:38:24.835661 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 48 Sep 07 12:38:24.835661 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:38:24.835661 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:38:24.835661 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:38:24.835661 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:38:24.835661 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJBlqcLWGgP5YaSpRRip8sl6ENs86mQ2ZB5Esr_BbiPs2BPnzmI-e2CcMwry9HQsHE_7xTrPaxjrWyCCdxwjB586GVAzp9zrLJ93cY3nFhJZpwBkdDlKcORaqKagI-NfztXwSU5mWdQXi_cefHqVkeBlPPo7irch_gvMM3WMDfixR9Y Sep 07 12:38:24.835661 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:38:24.835661 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:38:24.835661 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:38:24.835661 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:38:24.835661 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:38:24.835661 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:38:24.835661 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: dc00ac02c77f40f5ab6acbe538c9566b Sep 07 12:38:24.835661 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-15279073 Sep 07 12:38:24.835661 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:38:24.835661 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:38:24.837670 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dc00ac02c77f40f5ab6acbe538c9566b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dc00ac02c77f40f5ab6acbe538c9566b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dc00ac02c77f40f5ab6acbe538c9566b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dc00ac02c77f40f5ab6acbe538c9566b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:38:24.837670 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-15279073 Sep 07 12:38:24.837670 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: dc00ac02c77f40f5ab6acbe538c9566b Sep 07 12:38:24.837670 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-15279073 Sep 07 12:38:24.837670 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-FloatingIPsAssociationTestJSON-15279073-project Sep 07 12:38:24.837670 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:38:24.837670 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:38:24.837670 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 41979e405fab49029d8ff5a9903e36ea Sep 07 12:38:24.837670 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-15279073-project Sep 07 12:38:24.837670 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:38:24.837670 n-d-852087-9 devstack@n-api.service[122432]: {"removeFloatingIp": {"address": "172.25.8.28"}} Sep 07 12:38:24.837670 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:38:24.837670 n-d-852087-9 devstack@n-api.service[122432]: exception: Floating IP 172.25.8.28 is not associated with instance 8817b2e5-125e-455f-9c44-e0f46786b5fa. Sep 07 12:38:24.839351 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '8817b2e5-125e-455f-9c44-e0f46786b5fa', 'body': {'removeFloatingIp': {'address': '172.25.8.28'}}} Sep 07 12:38:24.839351 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:38:24.839351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:38:24.839351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:38:24.839351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:38:24.839351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:38:24.839351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:38:24.839351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:38:24.839351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:38:24.839351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:38:24.839351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:38:24.839351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:38:24.839351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:38:24.839351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Sep 07 12:38:24.839351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 12:38:24.839351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.8.28 is not associated with instance 8817b2e5-125e-455f-9c44-e0f46786b5fa. Sep 07 12:38:24.839351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:38:24.839351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:38:24.839351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:38:24.839351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:38:24.841008 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:38:24.841008 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:38:24.841008 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:38:24.841008 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:38:24.841008 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.8.28 is not associated with instance 8817b2e5-125e-455f-9c44-e0f46786b5fa. Sep 07 12:38:24.841008 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:38:24.842504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-534d5fae-8c7d-4b88-a753-0182c4a1f20b tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Returning 409 to user: Floating IP 172.25.8.28 is not associated with instance 8817b2e5-125e-455f-9c44-e0f46786b5fa. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:38:24.843726 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-534d5fae-8c7d-4b88-a753-0182c4a1f20b tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "POST /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa/action" status: 409 len: 145 microversion: 2.1 time: 1.174753 Sep 07 12:38:24.844684 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1080/2097] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:38:23 2022] POST /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa/action => generated 145 bytes in 1176 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:38:24.857940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c4ff8e23-89ad-49e2-a140-7d32565706f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:24.858864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c4ff8e23-89ad-49e2-a140-7d32565706f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:24.904715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4ff8e23-89ad-49e2-a140-7d32565706f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:24.905563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4ff8e23-89ad-49e2-a140-7d32565706f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:24.906271 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4ff8e23-89ad-49e2-a140-7d32565706f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:24.907200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4ff8e23-89ad-49e2-a140-7d32565706f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:24.907839 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4ff8e23-89ad-49e2-a140-7d32565706f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:24.908501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4ff8e23-89ad-49e2-a140-7d32565706f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:25.909944 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c4ff8e23-89ad-49e2-a140-7d32565706f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:25.951031 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c4ff8e23-89ad-49e2-a140-7d32565706f3 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1666 microversion: 2.1 time: 1.096900 Sep 07 12:38:25.957584 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1081/2098] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:38:24 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1666 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:38:26.020074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eae21ec0-7c1c-49b3-ba95-37f3d74a45eb tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc4193360d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:26.182720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-7e0d6429-bfcc-4f4b-aba7-d4203c730d66 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lazy-loading 'services' on Instance uuid 7c2a1933-970b-4c7d-a4b9-25cbc6f34768 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:38:26.232525 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eae21ec0-7c1c-49b3-ba95-37f3d74a45eb tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c" status: 200 len: 1437 microversion: 2.1 time: 0.272993 Sep 07 12:38:26.260404 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1082/2099] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:38:25 2022] GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c => generated 1437 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:38:26.275593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-37f150ef-c482-49aa-a803-8f78c08ac1e2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.28"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:38:26.294968 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7e0d6429-bfcc-4f4b-aba7-d4203c730d66 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1969 microversion: 2.25 time: 2.004447 Sep 07 12:38:26.297371 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1018/2100] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:38:24 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1969 bytes in 2008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:38:26.324566 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f10a4c7d-0621-41b6-81a8-44bcead0915c tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:26.325361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f10a4c7d-0621-41b6-81a8-44bcead0915c tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:26.339621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f10a4c7d-0621-41b6-81a8-44bcead0915c tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:26.340253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f10a4c7d-0621-41b6-81a8-44bcead0915c tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:26.340814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f10a4c7d-0621-41b6-81a8-44bcead0915c tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:26.341694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f10a4c7d-0621-41b6-81a8-44bcead0915c tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:26.344344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f10a4c7d-0621-41b6-81a8-44bcead0915c tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:26.345200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f10a4c7d-0621-41b6-81a8-44bcead0915c tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:27.232184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-37f150ef-c482-49aa-a803-8f78c08ac1e2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 16417424-f738-4fcf-8a54-4941ec487fa4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:27.245189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37f150ef-c482-49aa-a803-8f78c08ac1e2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:27.246088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37f150ef-c482-49aa-a803-8f78c08ac1e2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:27.246780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37f150ef-c482-49aa-a803-8f78c08ac1e2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:27.251293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37f150ef-c482-49aa-a803-8f78c08ac1e2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:27.252939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37f150ef-c482-49aa-a803-8f78c08ac1e2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:27.254850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37f150ef-c482-49aa-a803-8f78c08ac1e2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:27.335414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-f10a4c7d-0621-41b6-81a8-44bcead0915c tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lazy-loading 'services' on Instance uuid 7c2a1933-970b-4c7d-a4b9-25cbc6f34768 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:38:27.377911 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f10a4c7d-0621-41b6-81a8-44bcead0915c tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1969 microversion: 2.25 time: 1.057361 Sep 07 12:38:27.380297 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1019/2101] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:38:26 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1969 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:38:27.387206 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-28aac8e8-58c3-4a4e-8e53-2d41b32f5649 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbc9372a-1d4c-4ceb-b62d-ef7487a594c3"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:38:27.399721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-28aac8e8-58c3-4a4e-8e53-2d41b32f5649 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 704ec36d-6304-4089-9e70-12b23b3c795e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:27.432032 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28aac8e8-58c3-4a4e-8e53-2d41b32f5649 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:27.432760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28aac8e8-58c3-4a4e-8e53-2d41b32f5649 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:27.434006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28aac8e8-58c3-4a4e-8e53-2d41b32f5649 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:27.438250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28aac8e8-58c3-4a4e-8e53-2d41b32f5649 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:27.440037 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28aac8e8-58c3-4a4e-8e53-2d41b32f5649 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:27.440614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28aac8e8-58c3-4a4e-8e53-2d41b32f5649 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:27.972121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37f150ef-c482-49aa-a803-8f78c08ac1e2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "refresh_cache-16417424-f738-4fcf-8a54-4941ec487fa4" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 12:38:27.972509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37f150ef-c482-49aa-a803-8f78c08ac1e2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquired lock "refresh_cache-16417424-f738-4fcf-8a54-4941ec487fa4" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 12:38:28.000974 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-28aac8e8-58c3-4a4e-8e53-2d41b32f5649 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "POST /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.618548 Sep 07 12:38:28.026932 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1020/2102] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Sep 7 12:38:27 2022] POST /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e/os-volume_attachments => generated 194 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:38:28.044613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-062e833c-8914-4a9a-a831-a84d21356398 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:28.047989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-062e833c-8914-4a9a-a831-a84d21356398 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:28.067359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062e833c-8914-4a9a-a831-a84d21356398 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:28.072997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062e833c-8914-4a9a-a831-a84d21356398 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:28.073919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062e833c-8914-4a9a-a831-a84d21356398 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:28.078174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062e833c-8914-4a9a-a831-a84d21356398 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:28.079062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062e833c-8914-4a9a-a831-a84d21356398 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:28.080040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062e833c-8914-4a9a-a831-a84d21356398 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:29.247233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-062e833c-8914-4a9a-a831-a84d21356398 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:29.278718 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-062e833c-8914-4a9a-a831-a84d21356398 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 200 len: 1666 microversion: 2.1 time: 1.249544 Sep 07 12:38:29.279693 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1021/2103] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:38:28 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 1666 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:38:29.305315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-55d9301a-20f5-4201-87e0-7e9a8ffd348f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc418a00dc0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:29.401716 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-55d9301a-20f5-4201-87e0-7e9a8ffd348f tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c" status: 200 len: 1446 microversion: 2.1 time: 0.104174 Sep 07 12:38:29.403558 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1022/2104] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:38:29 2022] GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c => generated 1446 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:38:29.411971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-146510f4-0f26-4544-a170-1bcce2ad5ed4 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:29.419061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-146510f4-0f26-4544-a170-1bcce2ad5ed4 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:29.420211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-146510f4-0f26-4544-a170-1bcce2ad5ed4 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:29.421438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-146510f4-0f26-4544-a170-1bcce2ad5ed4 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:29.423461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-146510f4-0f26-4544-a170-1bcce2ad5ed4 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:29.424591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-146510f4-0f26-4544-a170-1bcce2ad5ed4 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:29.425885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-146510f4-0f26-4544-a170-1bcce2ad5ed4 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:29.483133 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-146510f4-0f26-4544-a170-1bcce2ad5ed4 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.077603 Sep 07 12:38:29.492711 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1023/2105] 10.222.0.16 () {60 vars in 1217 bytes} [Wed Sep 7 12:38:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:38:29.493397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0fc81082-1ba4-468b-954e-9d7bcbb06223 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc4189cfaf0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:29.589902 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0fc81082-1ba4-468b-954e-9d7bcbb06223 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c" status: 200 len: 1446 microversion: 2.1 time: 0.103242 Sep 07 12:38:29.617696 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1024/2106] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:38:29 2022] GET /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c => generated 1446 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:38:29.647924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-627d7dec-af3e-4f34-bb6c-7a6ca60165ca tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852087-9", "block_migration": "auto"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:38:29.667268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-627d7dec-af3e-4f34-bb6c-7a6ca60165ca tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:29.691413 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-627d7dec-af3e-4f34-bb6c-7a6ca60165ca tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:29.693027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-627d7dec-af3e-4f34-bb6c-7a6ca60165ca tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:29.695973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-627d7dec-af3e-4f34-bb6c-7a6ca60165ca tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:29.702119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-627d7dec-af3e-4f34-bb6c-7a6ca60165ca tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:29.708171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-627d7dec-af3e-4f34-bb6c-7a6ca60165ca tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:29.709603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-627d7dec-af3e-4f34-bb6c-7a6ca60165ca tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:29.801427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-627d7dec-af3e-4f34-bb6c-7a6ca60165ca tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lazy-loading 'flavor' on Instance uuid 7c2a1933-970b-4c7d-a4b9-25cbc6f34768 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:38:29.833901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-627d7dec-af3e-4f34-bb6c-7a6ca60165ca tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Going to try to live migrate instance to n-h1-852087-9 {{(pid=122433) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 07 12:38:31.735199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-37f150ef-c482-49aa-a803-8f78c08ac1e2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 16417424-f738-4fcf-8a54-4941ec487fa4] Building network info cache for instance {{(pid=122432) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 07 12:38:34.964343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-37f150ef-c482-49aa-a803-8f78c08ac1e2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 16417424-f738-4fcf-8a54-4941ec487fa4] Updating instance_info_cache with network_info: [{"id": "e28093e8-45ae-4bd9-a348-a9b5fd640aea", "address": "fa:16:3e:03:1d:19", "network": {"id": "e919c9e1-6167-41ae-bc57-c4b7bc4c8d07", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-11914908-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dc00ac02c77f40f5ab6acbe538c9566b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape28093e8-45", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122432) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 07 12:38:34.985430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37f150ef-c482-49aa-a803-8f78c08ac1e2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Releasing lock "refresh_cache-16417424-f738-4fcf-8a54-4941ec487fa4" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 12:38:34.991997 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-37f150ef-c482-49aa-a803-8f78c08ac1e2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "POST /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4/action" status: 202 len: 0 microversion: 2.1 time: 8.721045 Sep 07 12:38:35.009140 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1083/2107] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:38:26 2022] POST /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4/action => generated 0 bytes in 8748 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 07 12:38:35.032125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a59c00a2-4dd1-46e5-b71e-03420dfb3e2d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41971bee0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:35.190316 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-627d7dec-af3e-4f34-bb6c-7a6ca60165ca tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768/action" status: 202 len: 0 microversion: 2.25 time: 5.569741 Sep 07 12:38:35.195201 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1025/2108] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Sep 7 12:38:29 2022] POST /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768/action => generated 0 bytes in 5576 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:38:35.201283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2d9d26ca-63ef-4d7f-bf8c-efaadfaf6858 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:35.202652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2d9d26ca-63ef-4d7f-bf8c-efaadfaf6858 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:35.234485 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d9d26ca-63ef-4d7f-bf8c-efaadfaf6858 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:35.242708 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d9d26ca-63ef-4d7f-bf8c-efaadfaf6858 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:35.244390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d9d26ca-63ef-4d7f-bf8c-efaadfaf6858 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:35.250183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d9d26ca-63ef-4d7f-bf8c-efaadfaf6858 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:35.260804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d9d26ca-63ef-4d7f-bf8c-efaadfaf6858 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:35.264370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d9d26ca-63ef-4d7f-bf8c-efaadfaf6858 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:35.382105 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-2d9d26ca-63ef-4d7f-bf8c-efaadfaf6858 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] HTTP exception thrown: Instance 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 could not be found. Sep 07 12:38:35.407646 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2d9d26ca-63ef-4d7f-bf8c-efaadfaf6858 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Request method failure captured: Sep 07 12:38:35.407646 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 HTTP/1.1 Sep 07 12:38:35.407646 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:38:35.407646 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:38:35.407646 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:38:35.407646 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:38:35.407646 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:38:35.407646 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:38:35.407646 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:38:35.407646 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:38:35.407646 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI5zwGzwkngoYC-cJ2GbjommfZAenk5Snsx6zvVP-qrJN5QM5lt2HU9sKJdgOR49GCVF27sYloiDGYPH3cZ6h6iUb6YYX6mjjvqEsBfKHFhbmA5MBDDgGhP3f8hmP38AhCjVLT5MNdjVTOul4ymqUAKxYqPGo8PkF5sFmvW_ekZghlk Sep 07 12:38:35.407646 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:38:35.407646 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:38:35.407646 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:38:35.407646 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:38:35.407646 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:38:35.407646 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:38:35.407646 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: b32e8c6ba4e2486aa9769db48d2250d9 Sep 07 12:38:35.407646 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-LiveMigrationTest-546501661 Sep 07 12:38:35.407646 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:38:35.407646 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:38:35.410854 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b32e8c6ba4e2486aa9769db48d2250d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b32e8c6ba4e2486aa9769db48d2250d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b32e8c6ba4e2486aa9769db48d2250d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b32e8c6ba4e2486aa9769db48d2250d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:38:35.410854 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-LiveMigrationTest-546501661 Sep 07 12:38:35.410854 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: b32e8c6ba4e2486aa9769db48d2250d9 Sep 07 12:38:35.410854 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-LiveMigrationTest-546501661 Sep 07 12:38:35.410854 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-LiveMigrationTest-546501661-project Sep 07 12:38:35.410854 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:38:35.410854 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:38:35.410854 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: f009cb4fb12841a0ada96dc8c47cf2bd Sep 07 12:38:35.410854 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-LiveMigrationTest-546501661-project Sep 07 12:38:35.410854 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:38:35.410854 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 could not be found. Sep 07 12:38:35.410854 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3'} Sep 07 12:38:35.414748 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:38:35.414748 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:38:35.414748 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:38:35.414748 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:38:35.414748 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:38:35.414748 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:38:35.414748 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:38:35.414748 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:38:35.414748 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:38:35.414748 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:38:35.414748 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 could not be found. Sep 07 12:38:35.414748 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:38:35.414748 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:38:35.414748 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:38:35.414748 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:38:35.414748 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:38:35.414748 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:38:35.414748 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:38:35.414748 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:38:35.414748 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:38:35.419481 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:38:35.419481 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:38:35.419481 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:38:35.419481 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:38:35.419481 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:38:35.419481 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:38:35.419481 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:38:35.419481 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 could not be found. Sep 07 12:38:35.419481 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:38:35.419481 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:38:35.419481 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:38:35.419481 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:38:35.419481 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:38:35.419481 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:38:35.419481 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:38:35.419481 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:38:35.419481 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 could not be found. Sep 07 12:38:35.419481 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:38:35.436784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2d9d26ca-63ef-4d7f-bf8c-efaadfaf6858 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Returning 404 to user: Instance 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:38:35.447017 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2d9d26ca-63ef-4d7f-bf8c-efaadfaf6858 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3" status: 404 len: 111 microversion: 2.1 time: 0.246858 Sep 07 12:38:35.447017 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1026/2109] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:38:35 2022] GET /compute/v2.1/servers/8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 => generated 111 bytes in 248 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:38:35.472563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-9e217685-fa2c-4755-ba35-83d53fc0b96d req-f23b5ddb-d8b5-445e-abd7-4001ed0c79f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3", "name": "network-vif-deleted", "tag": "93de5379-dbd9-4a2c-ae2f-9b0113b9607c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:38:35.506671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9e217685-fa2c-4755-ba35-83d53fc0b96d req-f23b5ddb-d8b5-445e-abd7-4001ed0c79f4 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:35.507604 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9e217685-fa2c-4755-ba35-83d53fc0b96d req-f23b5ddb-d8b5-445e-abd7-4001ed0c79f4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:35.508343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9e217685-fa2c-4755-ba35-83d53fc0b96d req-f23b5ddb-d8b5-445e-abd7-4001ed0c79f4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:35.550546 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-9e217685-fa2c-4755-ba35-83d53fc0b96d req-f23b5ddb-d8b5-445e-abd7-4001ed0c79f4 service nova] Creating event network-vif-deleted:93de5379-dbd9-4a2c-ae2f-9b0113b9607c for instance 8e4a8bcf-4548-4193-b1a6-d2c139c2aaa3 on n-h2-852087-9 Sep 07 12:38:35.597862 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-9e217685-fa2c-4755-ba35-83d53fc0b96d req-f23b5ddb-d8b5-445e-abd7-4001ed0c79f4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151928 Sep 07 12:38:35.602857 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1027/2110] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:38:35.789610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8b19a414-e9e8-45e0-a41a-07339a859ad4 tempest-FloatingIPDetailsTestJSON-1513360368 tempest-FloatingIPDetailsTestJSON-1513360368-project] Action: 'create', calling method: .version_select at 0x7fc418a48f70>, body: {"pool": null} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:38:37.018934 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a59c00a2-4dd1-46e5-b71e-03420dfb3e2d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "DELETE /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c" status: 204 len: 0 microversion: 2.1 time: 2.007641 Sep 07 12:38:37.020419 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1084/2111] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:38:35 2022] DELETE /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c => generated 0 bytes in 2010 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:38:37.031097 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c8c26826-ef0b-4bd8-8497-17152f213c47 req-e42fe65e-7933-48e6-8423-f6d7775261c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16417424-f738-4fcf-8a54-4941ec487fa4", "tag": "e28093e8-45ae-4bd9-a348-a9b5fd640aea"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:38:37.045323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:38:37.059017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c8c26826-ef0b-4bd8-8497-17152f213c47 req-e42fe65e-7933-48e6-8423-f6d7775261c2 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:37.062620 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c8c26826-ef0b-4bd8-8497-17152f213c47 req-e42fe65e-7933-48e6-8423-f6d7775261c2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:37.063435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c8c26826-ef0b-4bd8-8497-17152f213c47 req-e42fe65e-7933-48e6-8423-f6d7775261c2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:37.098432 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c8c26826-ef0b-4bd8-8497-17152f213c47 req-e42fe65e-7933-48e6-8423-f6d7775261c2 service nova] Creating event network-changed:e28093e8-45ae-4bd9-a348-a9b5fd640aea for instance 16417424-f738-4fcf-8a54-4941ec487fa4 on n-h1-852087-9 Sep 07 12:38:37.113346 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c8c26826-ef0b-4bd8-8497-17152f213c47 req-e42fe65e-7933-48e6-8423-f6d7775261c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087446 Sep 07 12:38:37.117257 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1085/2112] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:38:37.132391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3b08a61c-4bbe-4bf6-ac4f-8f89a891f1db req-f8ea4c1d-c52d-4769-9a6e-bf2fef75666b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c8319cb-1eff-4ea4-9b2f-37ac6035c490", "name": "network-vif-unplugged", "status": "completed", "tag": "b221a19c-0a57-40d9-8f2b-5759655c8975"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:38:37.165374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3b08a61c-4bbe-4bf6-ac4f-8f89a891f1db req-f8ea4c1d-c52d-4769-9a6e-bf2fef75666b service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:37.169124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3b08a61c-4bbe-4bf6-ac4f-8f89a891f1db req-f8ea4c1d-c52d-4769-9a6e-bf2fef75666b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:37.173417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3b08a61c-4bbe-4bf6-ac4f-8f89a891f1db req-f8ea4c1d-c52d-4769-9a6e-bf2fef75666b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:37.256886 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3b08a61c-4bbe-4bf6-ac4f-8f89a891f1db req-f8ea4c1d-c52d-4769-9a6e-bf2fef75666b service nova] Creating event network-vif-unplugged:b221a19c-0a57-40d9-8f2b-5759655c8975 for instance 2c8319cb-1eff-4ea4-9b2f-37ac6035c490 on n-h2-852087-9 Sep 07 12:38:37.289153 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3b08a61c-4bbe-4bf6-ac4f-8f89a891f1db req-f8ea4c1d-c52d-4769-9a6e-bf2fef75666b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.169829 Sep 07 12:38:37.303198 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1086/2113] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:38:37.355123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7575d455-c251-438d-9d55-6c5eb9fb4f56 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:37.360080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7575d455-c251-438d-9d55-6c5eb9fb4f56 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 16417424-f738-4fcf-8a54-4941ec487fa4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:37.392790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7575d455-c251-438d-9d55-6c5eb9fb4f56 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:37.394384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7575d455-c251-438d-9d55-6c5eb9fb4f56 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:37.395502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7575d455-c251-438d-9d55-6c5eb9fb4f56 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:37.397226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7575d455-c251-438d-9d55-6c5eb9fb4f56 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:37.398349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7575d455-c251-438d-9d55-6c5eb9fb4f56 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:37.399548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7575d455-c251-438d-9d55-6c5eb9fb4f56 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:37.518645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7575d455-c251-438d-9d55-6c5eb9fb4f56 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 16417424-f738-4fcf-8a54-4941ec487fa4] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:38:37.823221 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7575d455-c251-438d-9d55-6c5eb9fb4f56 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "DELETE /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4" status: 204 len: 0 microversion: 2.1 time: 0.514594 Sep 07 12:38:37.831221 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1087/2114] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:38:37 2022] DELETE /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:38:37.868129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-19c5af57-cb1a-40e8-b2e3-ec729efab7b9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:37.873632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-19c5af57-cb1a-40e8-b2e3-ec729efab7b9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:37.906754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19c5af57-cb1a-40e8-b2e3-ec729efab7b9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:37.907528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19c5af57-cb1a-40e8-b2e3-ec729efab7b9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:37.908205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19c5af57-cb1a-40e8-b2e3-ec729efab7b9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:37.909428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19c5af57-cb1a-40e8-b2e3-ec729efab7b9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:37.924566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19c5af57-cb1a-40e8-b2e3-ec729efab7b9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:37.927947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19c5af57-cb1a-40e8-b2e3-ec729efab7b9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:39.443224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:38:39.672187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-19c5af57-cb1a-40e8-b2e3-ec729efab7b9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:39.721779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-19c5af57-cb1a-40e8-b2e3-ec729efab7b9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:39.734491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-19c5af57-cb1a-40e8-b2e3-ec729efab7b9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:39.736157 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-19c5af57-cb1a-40e8-b2e3-ec729efab7b9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1486 microversion: 2.25 time: 1.903214 Sep 07 12:38:39.772276 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1088/2115] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:38:37 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1486 bytes in 1940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:38:39.777673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1307ef20-7b06-4475-b379-1f07805ecfc5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '.version_select at 0x7fc41971ee50>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:39.828639 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1307ef20-7b06-4475-b379-1f07805ecfc5 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1146664546" status: 202 len: 0 microversion: 2.1 time: 0.055030 Sep 07 12:38:39.832761 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1089/2116] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Sep 7 12:38:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1146664546 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:38:39.838960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-94234d13-62b2-4c72-9681-f6c2e68bc1af tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:39.843939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-94234d13-62b2-4c72-9681-f6c2e68bc1af tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2c8319cb-1eff-4ea4-9b2f-37ac6035c490] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:39.862968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94234d13-62b2-4c72-9681-f6c2e68bc1af tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:39.863888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94234d13-62b2-4c72-9681-f6c2e68bc1af tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:39.864585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94234d13-62b2-4c72-9681-f6c2e68bc1af tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:39.865690 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94234d13-62b2-4c72-9681-f6c2e68bc1af tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:39.866562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94234d13-62b2-4c72-9681-f6c2e68bc1af tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:39.867314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94234d13-62b2-4c72-9681-f6c2e68bc1af tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:39.932586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-94234d13-62b2-4c72-9681-f6c2e68bc1af tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2c8319cb-1eff-4ea4-9b2f-37ac6035c490] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:38:40.213018 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-94234d13-62b2-4c72-9681-f6c2e68bc1af tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490" status: 204 len: 0 microversion: 2.1 time: 0.376842 Sep 07 12:38:40.223634 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1090/2117] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:38:39 2022] DELETE /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:38:40.264078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f8d3e681-a200-46cb-a886-c52e63113aef tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.28"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:38:40.284795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f8d3e681-a200-46cb-a886-c52e63113aef tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:40.333744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8d3e681-a200-46cb-a886-c52e63113aef tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:40.334890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8d3e681-a200-46cb-a886-c52e63113aef tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:40.339271 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8d3e681-a200-46cb-a886-c52e63113aef tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:40.346648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8d3e681-a200-46cb-a886-c52e63113aef tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:40.348708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8d3e681-a200-46cb-a886-c52e63113aef tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:40.354424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8d3e681-a200-46cb-a886-c52e63113aef tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:40.461045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8d3e681-a200-46cb-a886-c52e63113aef tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "refresh_cache-8817b2e5-125e-455f-9c44-e0f46786b5fa" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 12:38:40.461467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8d3e681-a200-46cb-a886-c52e63113aef tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquired lock "refresh_cache-8817b2e5-125e-455f-9c44-e0f46786b5fa" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 12:38:45.411063 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8b19a414-e9e8-45e0-a41a-07339a859ad4 tempest-FloatingIPDetailsTestJSON-1513360368 tempest-FloatingIPDetailsTestJSON-1513360368-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 9.805675 Sep 07 12:38:45.420274 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1028/2118] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Sep 7 12:38:35 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 9808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:38:45.506754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:38:45.550150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:38:45.562090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9371313a-5507-49c2-aef4-99762502aa65 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2069876996", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "d72920fd-5bbc-4fad-ab8f-6932e7c7ba21"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:38:45.760325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-9371313a-5507-49c2-aef4-99762502aa65 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] validate_networks() for [('d72920fd-5bbc-4fad-ab8f-6932e7c7ba21', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:38:47.886543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-9371313a-5507-49c2-aef4-99762502aa65 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:38:47.887608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-9371313a-5507-49c2-aef4-99762502aa65 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:38:47.887608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-9371313a-5507-49c2-aef4-99762502aa65 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:38:47.887968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-9371313a-5507-49c2-aef4-99762502aa65 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:38:47.888396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-9371313a-5507-49c2-aef4-99762502aa65 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:38:47.905905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9371313a-5507-49c2-aef4-99762502aa65 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:47.906412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9371313a-5507-49c2-aef4-99762502aa65 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:47.906863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9371313a-5507-49c2-aef4-99762502aa65 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:47.907644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9371313a-5507-49c2-aef4-99762502aa65 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:47.908122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9371313a-5507-49c2-aef4-99762502aa65 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:47.908736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9371313a-5507-49c2-aef4-99762502aa65 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:47.932250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-9371313a-5507-49c2-aef4-99762502aa65 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Getting quotas for project 081286d7e4664e239ace13466a4a9c50. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:38:47.939687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-9371313a-5507-49c2-aef4-99762502aa65 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Getting quotas for user 3d68cf87771f4e9f9caab95adf58b129 and project 081286d7e4664e239ace13466a4a9c50. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:38:47.957689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9371313a-5507-49c2-aef4-99762502aa65 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:38:47.960398 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9371313a-5507-49c2-aef4-99762502aa65 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 9f506502-b414-408e-b36a-a61e27b58980] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:38:48.030635 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9371313a-5507-49c2-aef4-99762502aa65 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.616800 Sep 07 12:38:48.032203 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1029/2119] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:38:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:38:48.038613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-39f117e5-0c2d-4f3a-939a-df42291d1871 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:48.040163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-39f117e5-0c2d-4f3a-939a-df42291d1871 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:48.047937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39f117e5-0c2d-4f3a-939a-df42291d1871 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:48.048775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39f117e5-0c2d-4f3a-939a-df42291d1871 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:48.049397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39f117e5-0c2d-4f3a-939a-df42291d1871 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:48.050358 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39f117e5-0c2d-4f3a-939a-df42291d1871 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:48.051015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39f117e5-0c2d-4f3a-939a-df42291d1871 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:48.051605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39f117e5-0c2d-4f3a-939a-df42291d1871 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:48.355394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-f8d3e681-a200-46cb-a886-c52e63113aef tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] Building network info cache for instance {{(pid=122432) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 07 12:38:48.434196 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-39f117e5-0c2d-4f3a-939a-df42291d1871 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:48.448811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-39f117e5-0c2d-4f3a-939a-df42291d1871 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:48.459544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-39f117e5-0c2d-4f3a-939a-df42291d1871 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:48.463428 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-39f117e5-0c2d-4f3a-939a-df42291d1871 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1486 microversion: 2.25 time: 0.429663 Sep 07 12:38:48.471746 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1030/2120] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:38:48 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1486 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:38:48.488137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-1811e713-db7f-4c4f-938a-6d9262e14f87 req-41ec9a25-3378-4879-aec3-5627474c6050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16417424-f738-4fcf-8a54-4941ec487fa4", "name": "network-vif-deleted", "tag": "e28093e8-45ae-4bd9-a348-a9b5fd640aea"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:38:48.531858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1811e713-db7f-4c4f-938a-6d9262e14f87 req-41ec9a25-3378-4879-aec3-5627474c6050 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:48.540274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1811e713-db7f-4c4f-938a-6d9262e14f87 req-41ec9a25-3378-4879-aec3-5627474c6050 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:48.540780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1811e713-db7f-4c4f-938a-6d9262e14f87 req-41ec9a25-3378-4879-aec3-5627474c6050 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:48.577399 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-1811e713-db7f-4c4f-938a-6d9262e14f87 req-41ec9a25-3378-4879-aec3-5627474c6050 service nova] Creating event network-vif-deleted:e28093e8-45ae-4bd9-a348-a9b5fd640aea for instance 16417424-f738-4fcf-8a54-4941ec487fa4 on n-h1-852087-9 Sep 07 12:38:48.590418 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-1811e713-db7f-4c4f-938a-6d9262e14f87 req-41ec9a25-3378-4879-aec3-5627474c6050 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114283 Sep 07 12:38:48.591068 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1031/2121] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:38:49.293235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-50b6a13b-f297-4f29-86c9-2998aeadf63b tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Action: 'create', calling method: .version_select at 0x7fc41898bd30>, body: {"keypair": {"name": "tempest-keypair-1277964462", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2ynUkuC7vpJTb79PoBtAR6VZa83yabQ9GrHRN3h+ISKkeSqmGd7BwWDQgCKnIrz3F7B+IcWQ7BBMuEt1xY3h8eZd4VRIp55rO0NwKbxSy5ThiN/l/fLcb82gjAjmcF6Q=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:38:49.338599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-50b6a13b-f297-4f29-86c9-2998aeadf63b tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Getting quotas for project 3d453f24efa048f0a67ab7834d0005c7. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:38:49.354941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-50b6a13b-f297-4f29-86c9-2998aeadf63b tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Getting quotas for user 5d991fa2c5754b14a7a0e638b486f06e and project 3d453f24efa048f0a67ab7834d0005c7. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:38:49.436976 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-50b6a13b-f297-4f29-86c9-2998aeadf63b tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.827659 Sep 07 12:38:49.450241 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1032/2122] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 12:38:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:38:49.486089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-491c7893-695a-469e-a6eb-8b1396b8839f tempest-FloatingIPDetailsTestJSON-1513360368 tempest-FloatingIPDetailsTestJSON-1513360368-project] Action: 'create', calling method: .version_select at 0x7fc418a96f70>, body: {"pool": null} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:38:50.226261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-f8d3e681-a200-46cb-a886-c52e63113aef tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] Updating instance_info_cache with network_info: [{"id": "f2fda9ed-aa0e-41f8-a289-5e6679639d1e", "address": "fa:16:3e:2a:39:9b", "network": {"id": "e919c9e1-6167-41ae-bc57-c4b7bc4c8d07", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-11914908-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dc00ac02c77f40f5ab6acbe538c9566b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf2fda9ed-aa", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122432) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 07 12:38:50.261747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=76,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:38:50.273128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8d3e681-a200-46cb-a886-c52e63113aef tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Releasing lock "refresh_cache-8817b2e5-125e-455f-9c44-e0f46786b5fa" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 12:38:50.278311 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f8d3e681-a200-46cb-a886-c52e63113aef tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "POST /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa/action" status: 202 len: 0 microversion: 2.1 time: 10.052270 Sep 07 12:38:50.281784 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1091/2123] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:38:40 2022] POST /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa/action => generated 0 bytes in 10058 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 07 12:38:50.302170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3c7cca72-2aa0-483b-8a65-ada033e2895a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:50.307908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3c7cca72-2aa0-483b-8a65-ada033e2895a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 704ec36d-6304-4089-9e70-12b23b3c795e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:50.313422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:38:50.325604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c7cca72-2aa0-483b-8a65-ada033e2895a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:50.327586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c7cca72-2aa0-483b-8a65-ada033e2895a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:50.329452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c7cca72-2aa0-483b-8a65-ada033e2895a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:50.331670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c7cca72-2aa0-483b-8a65-ada033e2895a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:50.333047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c7cca72-2aa0-483b-8a65-ada033e2895a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:50.334398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c7cca72-2aa0-483b-8a65-ada033e2895a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:50.448790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3c7cca72-2aa0-483b-8a65-ada033e2895a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 704ec36d-6304-4089-9e70-12b23b3c795e] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:38:50.774322 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3c7cca72-2aa0-483b-8a65-ada033e2895a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "DELETE /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e" status: 204 len: 0 microversion: 2.1 time: 0.487253 Sep 07 12:38:50.777431 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1092/2124] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:38:50 2022] DELETE /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:38:51.422224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bf720010-0ac7-4316-baac-36eb2ed08665 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:51.425136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bf720010-0ac7-4316-baac-36eb2ed08665 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:51.437131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf720010-0ac7-4316-baac-36eb2ed08665 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:51.438286 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf720010-0ac7-4316-baac-36eb2ed08665 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:51.439402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf720010-0ac7-4316-baac-36eb2ed08665 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:51.440474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf720010-0ac7-4316-baac-36eb2ed08665 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:51.441190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf720010-0ac7-4316-baac-36eb2ed08665 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:51.442018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf720010-0ac7-4316-baac-36eb2ed08665 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:51.499480 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bf720010-0ac7-4316-baac-36eb2ed08665 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:38:51.678861 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bf720010-0ac7-4316-baac-36eb2ed08665 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "DELETE /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 204 len: 0 microversion: 2.1 time: 0.899215 Sep 07 12:38:51.683667 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1093/2125] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:38:50 2022] DELETE /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 0 bytes in 905 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:38:51.699821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-57504d9a-dcaa-441b-9eae-a7c241a3b1da tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:51.701259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-57504d9a-dcaa-441b-9eae-a7c241a3b1da tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 9f506502-b414-408e-b36a-a61e27b58980] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:51.714720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57504d9a-dcaa-441b-9eae-a7c241a3b1da tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:51.715720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57504d9a-dcaa-441b-9eae-a7c241a3b1da tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:51.717022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57504d9a-dcaa-441b-9eae-a7c241a3b1da tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:51.718315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57504d9a-dcaa-441b-9eae-a7c241a3b1da tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:51.718981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57504d9a-dcaa-441b-9eae-a7c241a3b1da tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:51.719715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57504d9a-dcaa-441b-9eae-a7c241a3b1da tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:51.868971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-57504d9a-dcaa-441b-9eae-a7c241a3b1da tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:51.879284 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-57504d9a-dcaa-441b-9eae-a7c241a3b1da tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980" status: 200 len: 1260 microversion: 2.1 time: 0.193830 Sep 07 12:38:51.894665 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1094/2126] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:38:51 2022] GET /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980 => generated 1260 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:38:51.901846 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-f47c889a-3bf9-4502-86f7-831a248dba98 req-ea06df3b-1a26-48ad-ab8d-8999bb49c725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8817b2e5-125e-455f-9c44-e0f46786b5fa", "tag": "f2fda9ed-aa0e-41f8-a289-5e6679639d1e"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:38:51.915705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f47c889a-3bf9-4502-86f7-831a248dba98 req-ea06df3b-1a26-48ad-ab8d-8999bb49c725 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:51.916532 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f47c889a-3bf9-4502-86f7-831a248dba98 req-ea06df3b-1a26-48ad-ab8d-8999bb49c725 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:51.917614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f47c889a-3bf9-4502-86f7-831a248dba98 req-ea06df3b-1a26-48ad-ab8d-8999bb49c725 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:51.934184 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-f47c889a-3bf9-4502-86f7-831a248dba98 req-ea06df3b-1a26-48ad-ab8d-8999bb49c725 service nova] Creating event network-changed:f2fda9ed-aa0e-41f8-a289-5e6679639d1e for instance 8817b2e5-125e-455f-9c44-e0f46786b5fa on n-h1-852087-9 Sep 07 12:38:51.944032 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-f47c889a-3bf9-4502-86f7-831a248dba98 req-ea06df3b-1a26-48ad-ab8d-8999bb49c725 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046793 Sep 07 12:38:51.945433 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1095/2127] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:38:51.953404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-66e6f4bc-8bf6-46cf-83e9-ccdb63c03c82 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:51.955566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-66e6f4bc-8bf6-46cf-83e9-ccdb63c03c82 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:51.965272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e6f4bc-8bf6-46cf-83e9-ccdb63c03c82 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:51.966005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e6f4bc-8bf6-46cf-83e9-ccdb63c03c82 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:51.966551 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e6f4bc-8bf6-46cf-83e9-ccdb63c03c82 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:51.967533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e6f4bc-8bf6-46cf-83e9-ccdb63c03c82 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:51.968321 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e6f4bc-8bf6-46cf-83e9-ccdb63c03c82 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:51.968913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e6f4bc-8bf6-46cf-83e9-ccdb63c03c82 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:52.322040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-66e6f4bc-8bf6-46cf-83e9-ccdb63c03c82 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:52.340175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-66e6f4bc-8bf6-46cf-83e9-ccdb63c03c82 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:52.343717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-66e6f4bc-8bf6-46cf-83e9-ccdb63c03c82 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:52.345676 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-66e6f4bc-8bf6-46cf-83e9-ccdb63c03c82 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1486 microversion: 2.25 time: 0.398283 Sep 07 12:38:52.348036 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1096/2128] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:38:51 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1486 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:38:52.399882 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7578ac7c-f4cc-4a47-a1fb-5e46f2849046 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '.version_select at 0x7fc4192ba0d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:52.813319 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7578ac7c-f4cc-4a47-a1fb-5e46f2849046 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/32e6de07-b1df-4c9c-9cfb-e5aaab086dee" status: 200 len: 183 microversion: 2.1 time: 0.452241 Sep 07 12:38:52.828076 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1097/2129] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Sep 7 12:38:52 2022] GET /compute/v2.1/os-floating-ips/32e6de07-b1df-4c9c-9cfb-e5aaab086dee => generated 183 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:38:52.828076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3b571d7e-7317-475e-adda-e0eeff6afe4d req-6bc71e3b-abc5-4976-800c-054e978d4f89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c8319cb-1eff-4ea4-9b2f-37ac6035c490", "name": "network-vif-deleted", "tag": "b221a19c-0a57-40d9-8f2b-5759655c8975"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:38:52.844258 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-491c7893-695a-469e-a6eb-8b1396b8839f tempest-FloatingIPDetailsTestJSON-1513360368 tempest-FloatingIPDetailsTestJSON-1513360368-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 3.400336 Sep 07 12:38:52.845903 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1033/2130] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Sep 7 12:38:49 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 3403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:38:52.862547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f5c5ccf3-fffb-4daa-9c15-49c52ec54f2c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:52.868307 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f5c5ccf3-fffb-4daa-9c15-49c52ec54f2c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 704ec36d-6304-4089-9e70-12b23b3c795e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:52.869462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3b571d7e-7317-475e-adda-e0eeff6afe4d req-6bc71e3b-abc5-4976-800c-054e978d4f89 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:52.874049 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3b571d7e-7317-475e-adda-e0eeff6afe4d req-6bc71e3b-abc5-4976-800c-054e978d4f89 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:52.875016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3b571d7e-7317-475e-adda-e0eeff6afe4d req-6bc71e3b-abc5-4976-800c-054e978d4f89 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:52.896590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5c5ccf3-fffb-4daa-9c15-49c52ec54f2c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:52.898073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5c5ccf3-fffb-4daa-9c15-49c52ec54f2c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:52.898793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5c5ccf3-fffb-4daa-9c15-49c52ec54f2c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:52.899838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5c5ccf3-fffb-4daa-9c15-49c52ec54f2c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:52.900565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5c5ccf3-fffb-4daa-9c15-49c52ec54f2c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:52.901245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5c5ccf3-fffb-4daa-9c15-49c52ec54f2c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:52.911558 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3b571d7e-7317-475e-adda-e0eeff6afe4d req-6bc71e3b-abc5-4976-800c-054e978d4f89 service nova] Creating event network-vif-deleted:b221a19c-0a57-40d9-8f2b-5759655c8975 for instance 2c8319cb-1eff-4ea4-9b2f-37ac6035c490 on n-h2-852087-9 Sep 07 12:38:52.922900 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3b571d7e-7317-475e-adda-e0eeff6afe4d req-6bc71e3b-abc5-4976-800c-054e978d4f89 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106381 Sep 07 12:38:52.924240 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1098/2131] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:38:52.932793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a894a3b4-66b1-437d-8102-b684540d98a8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:38:52.933754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a894a3b4-66b1-437d-8102-b684540d98a8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:52.949293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a894a3b4-66b1-437d-8102-b684540d98a8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:52.950438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a894a3b4-66b1-437d-8102-b684540d98a8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:52.951296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a894a3b4-66b1-437d-8102-b684540d98a8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:52.952900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a894a3b4-66b1-437d-8102-b684540d98a8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:52.953826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a894a3b4-66b1-437d-8102-b684540d98a8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:52.954673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a894a3b4-66b1-437d-8102-b684540d98a8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:53.377065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a894a3b4-66b1-437d-8102-b684540d98a8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:53.380565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f5c5ccf3-fffb-4daa-9c15-49c52ec54f2c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:38:53.402505 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a894a3b4-66b1-437d-8102-b684540d98a8 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 200 len: 1485 microversion: 2.1 time: 0.475003 Sep 07 12:38:53.408484 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f5c5ccf3-fffb-4daa-9c15-49c52ec54f2c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e" status: 200 len: 1553 microversion: 2.1 time: 0.560426 Sep 07 12:38:53.433520 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1099/2132] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:38:52 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 1485 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:38:53.434441 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1034/2133] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:38:52 2022] GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e => generated 1553 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:38:53.449961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f0920e74-feab-40d7-bbf3-c5fce3b79365 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.28"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:38:53.461782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-83e9255a-dcba-40ae-84e8-5063fafd2f91 tempest-FloatingIPDetailsTestJSON-1513360368 tempest-FloatingIPDetailsTestJSON-1513360368-project] Action: 'create', calling method: .version_select at 0x7fc418af9e50>, body: {"pool": null} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:38:54.371951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f0920e74-feab-40d7-bbf3-c5fce3b79365 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:38:54.388098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0920e74-feab-40d7-bbf3-c5fce3b79365 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:54.388939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0920e74-feab-40d7-bbf3-c5fce3b79365 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:54.389703 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0920e74-feab-40d7-bbf3-c5fce3b79365 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:54.391202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0920e74-feab-40d7-bbf3-c5fce3b79365 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:38:54.392020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0920e74-feab-40d7-bbf3-c5fce3b79365 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:38:54.392763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0920e74-feab-40d7-bbf3-c5fce3b79365 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:38:56.849252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0920e74-feab-40d7-bbf3-c5fce3b79365 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "refresh_cache-8817b2e5-125e-455f-9c44-e0f46786b5fa" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 12:38:56.850269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0920e74-feab-40d7-bbf3-c5fce3b79365 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquired lock "refresh_cache-8817b2e5-125e-455f-9c44-e0f46786b5fa" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 12:38:57.923159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:38:59.366148 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=10 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:39:00.049458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-f0920e74-feab-40d7-bbf3-c5fce3b79365 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] Building network info cache for instance {{(pid=122432) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 07 12:39:01.658345 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-83e9255a-dcba-40ae-84e8-5063fafd2f91 tempest-FloatingIPDetailsTestJSON-1513360368 tempest-FloatingIPDetailsTestJSON-1513360368-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.221487 Sep 07 12:39:01.675206 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1035/2134] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Sep 7 12:38:53 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:39:01.687080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-241e8773-4488-46b7-a1eb-dd8e15839532 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:01.688580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-241e8773-4488-46b7-a1eb-dd8e15839532 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 9f506502-b414-408e-b36a-a61e27b58980] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:01.709033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-241e8773-4488-46b7-a1eb-dd8e15839532 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:01.710802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-241e8773-4488-46b7-a1eb-dd8e15839532 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:01.711984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-241e8773-4488-46b7-a1eb-dd8e15839532 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:01.715427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-241e8773-4488-46b7-a1eb-dd8e15839532 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:01.717165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-241e8773-4488-46b7-a1eb-dd8e15839532 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:01.719520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-241e8773-4488-46b7-a1eb-dd8e15839532 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:01.947263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-f0920e74-feab-40d7-bbf3-c5fce3b79365 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] Updating instance_info_cache with network_info: [{"id": "f2fda9ed-aa0e-41f8-a289-5e6679639d1e", "address": "fa:16:3e:2a:39:9b", "network": {"id": "e919c9e1-6167-41ae-bc57-c4b7bc4c8d07", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-11914908-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dc00ac02c77f40f5ab6acbe538c9566b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf2fda9ed-aa", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122432) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 07 12:39:01.987939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0920e74-feab-40d7-bbf3-c5fce3b79365 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Releasing lock "refresh_cache-8817b2e5-125e-455f-9c44-e0f46786b5fa" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 12:39:01.997413 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f0920e74-feab-40d7-bbf3-c5fce3b79365 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "POST /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa/action" status: 202 len: 0 microversion: 2.1 time: 8.571564 Sep 07 12:39:02.004148 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1100/2135] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:38:53 2022] POST /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa/action => generated 0 bytes in 8580 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 07 12:39:02.039931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0e2f4e64-eb95-46cd-942a-f4556f2e3564 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:02.042836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0e2f4e64-eb95-46cd-942a-f4556f2e3564 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:02.088849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e2f4e64-eb95-46cd-942a-f4556f2e3564 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:02.089689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e2f4e64-eb95-46cd-942a-f4556f2e3564 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:02.091825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e2f4e64-eb95-46cd-942a-f4556f2e3564 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:02.095009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e2f4e64-eb95-46cd-942a-f4556f2e3564 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:02.102619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e2f4e64-eb95-46cd-942a-f4556f2e3564 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:02.103963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e2f4e64-eb95-46cd-942a-f4556f2e3564 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:02.305708 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-241e8773-4488-46b7-a1eb-dd8e15839532 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:02.324861 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-241e8773-4488-46b7-a1eb-dd8e15839532 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980" status: 200 len: 1308 microversion: 2.1 time: 0.645658 Sep 07 12:39:02.326351 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1036/2136] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:01 2022] GET /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980 => generated 1308 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:02.337647 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-021c2433-09f0-4485-9ffd-37c2b273f93b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:02.339340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-021c2433-09f0-4485-9ffd-37c2b273f93b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 74efffee-c688-4fe1-88dd-a49eaa3d940e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:02.358231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-021c2433-09f0-4485-9ffd-37c2b273f93b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:02.359081 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-021c2433-09f0-4485-9ffd-37c2b273f93b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:02.359831 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-021c2433-09f0-4485-9ffd-37c2b273f93b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:02.360997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-021c2433-09f0-4485-9ffd-37c2b273f93b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:02.366281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-021c2433-09f0-4485-9ffd-37c2b273f93b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:02.367972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-021c2433-09f0-4485-9ffd-37c2b273f93b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:02.389368 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-021c2433-09f0-4485-9ffd-37c2b273f93b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] HTTP exception thrown: Instance 74efffee-c688-4fe1-88dd-a49eaa3d940e could not be found. Sep 07 12:39:02.391930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-021c2433-09f0-4485-9ffd-37c2b273f93b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Request method failure captured: Sep 07 12:39:02.391930 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e HTTP/1.1 Sep 07 12:39:02.391930 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:39:02.391930 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:39:02.391930 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:39:02.391930 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:39:02.391930 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:39:02.391930 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:39:02.391930 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:39:02.391930 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:39:02.391930 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI5zwGzwkngoYC-cJ2GbjommfZAenk5Snsx6zvVP-qrJN5QM5lt2HU9sKJdgOR49GCVF27sYloiDGYPH3cZ6h6iUb6YYX6mjjvqEsBfKHFhbmA5MBDDgGhP3f8hmP38AhCjVLT5MNdjVTOul4ymqUAKxYqPGo8PkF5sFmvW_ekZghlk Sep 07 12:39:02.391930 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:39:02.391930 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:39:02.391930 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:39:02.391930 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:39:02.391930 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:39:02.391930 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:39:02.391930 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: b32e8c6ba4e2486aa9769db48d2250d9 Sep 07 12:39:02.391930 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-LiveMigrationTest-546501661 Sep 07 12:39:02.391930 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:39:02.391930 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:39:02.393911 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b32e8c6ba4e2486aa9769db48d2250d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b32e8c6ba4e2486aa9769db48d2250d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b32e8c6ba4e2486aa9769db48d2250d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b32e8c6ba4e2486aa9769db48d2250d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:39:02.393911 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-LiveMigrationTest-546501661 Sep 07 12:39:02.393911 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: b32e8c6ba4e2486aa9769db48d2250d9 Sep 07 12:39:02.393911 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-LiveMigrationTest-546501661 Sep 07 12:39:02.393911 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-LiveMigrationTest-546501661-project Sep 07 12:39:02.393911 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:39:02.393911 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:39:02.393911 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: f009cb4fb12841a0ada96dc8c47cf2bd Sep 07 12:39:02.393911 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-LiveMigrationTest-546501661-project Sep 07 12:39:02.393911 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:39:02.393911 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 74efffee-c688-4fe1-88dd-a49eaa3d940e could not be found. Sep 07 12:39:02.393911 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '74efffee-c688-4fe1-88dd-a49eaa3d940e'} Sep 07 12:39:02.394936 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:39:02.394936 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:02.394936 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:39:02.394936 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:39:02.394936 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:39:02.394936 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:39:02.394936 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:39:02.394936 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:39:02.394936 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:39:02.394936 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:39:02.394936 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74efffee-c688-4fe1-88dd-a49eaa3d940e could not be found. Sep 07 12:39:02.394936 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:02.394936 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:02.394936 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:02.394936 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:02.394936 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:02.394936 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:02.394936 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:39:02.394936 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:39:02.394936 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:39:02.397085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:39:02.397085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:39:02.397085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:39:02.397085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:39:02.397085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:39:02.397085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:39:02.397085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:39:02.397085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74efffee-c688-4fe1-88dd-a49eaa3d940e could not be found. Sep 07 12:39:02.397085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:02.397085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:02.397085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:02.397085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:02.397085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:02.397085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:02.397085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:39:02.397085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:39:02.397085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74efffee-c688-4fe1-88dd-a49eaa3d940e could not be found. Sep 07 12:39:02.397085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:02.399927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-021c2433-09f0-4485-9ffd-37c2b273f93b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Returning 404 to user: Instance 74efffee-c688-4fe1-88dd-a49eaa3d940e could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:39:02.401885 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-021c2433-09f0-4485-9ffd-37c2b273f93b tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e" status: 404 len: 111 microversion: 2.1 time: 0.072881 Sep 07 12:39:02.403470 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1037/2137] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:02 2022] GET /compute/v2.1/servers/74efffee-c688-4fe1-88dd-a49eaa3d940e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:39:02.423248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fbdc8053-8456-482f-8961-be1e2a371fea tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:02.424694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fbdc8053-8456-482f-8961-be1e2a371fea tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 704ec36d-6304-4089-9e70-12b23b3c795e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:02.440428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbdc8053-8456-482f-8961-be1e2a371fea tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:02.441574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbdc8053-8456-482f-8961-be1e2a371fea tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:02.443647 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbdc8053-8456-482f-8961-be1e2a371fea tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:02.445263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbdc8053-8456-482f-8961-be1e2a371fea tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:02.447222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbdc8053-8456-482f-8961-be1e2a371fea tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:02.447833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fbdc8053-8456-482f-8961-be1e2a371fea tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:02.623517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0e2f4e64-eb95-46cd-942a-f4556f2e3564 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:02.638803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0e2f4e64-eb95-46cd-942a-f4556f2e3564 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:02.640251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0e2f4e64-eb95-46cd-942a-f4556f2e3564 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:02.641583 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0e2f4e64-eb95-46cd-942a-f4556f2e3564 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1486 microversion: 2.25 time: 0.633154 Sep 07 12:39:02.642925 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1101/2138] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:39:02 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1486 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:39:02.663436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fbdc8053-8456-482f-8961-be1e2a371fea tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:02.680575 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fbdc8053-8456-482f-8961-be1e2a371fea tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e" status: 200 len: 1345 microversion: 2.1 time: 0.274390 Sep 07 12:39:02.682487 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1038/2139] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:02 2022] GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e => generated 1345 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:02.797849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-db114e66-1f6a-4f1d-ac02-efe0db277551 req-def74216-e743-432e-ab48-b5bc2940cbc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74efffee-c688-4fe1-88dd-a49eaa3d940e", "name": "network-vif-deleted", "tag": "53a321bf-b211-4774-a021-98fa126748f1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:39:02.812238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-db114e66-1f6a-4f1d-ac02-efe0db277551 req-def74216-e743-432e-ab48-b5bc2940cbc8 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:02.813167 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-db114e66-1f6a-4f1d-ac02-efe0db277551 req-def74216-e743-432e-ab48-b5bc2940cbc8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:02.813972 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-db114e66-1f6a-4f1d-ac02-efe0db277551 req-def74216-e743-432e-ab48-b5bc2940cbc8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:02.836670 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-db114e66-1f6a-4f1d-ac02-efe0db277551 req-def74216-e743-432e-ab48-b5bc2940cbc8 service nova] Creating event network-vif-deleted:53a321bf-b211-4774-a021-98fa126748f1 for instance 74efffee-c688-4fe1-88dd-a49eaa3d940e on n-h2-852087-9 Sep 07 12:39:02.845242 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-db114e66-1f6a-4f1d-ac02-efe0db277551 req-def74216-e743-432e-ab48-b5bc2940cbc8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200504 Sep 07 12:39:02.846347 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1102/2140] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:39:02.853225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2fd2fea3-62b1-4919-99f9-c9e7d65e2675 tempest-FloatingIPDetailsTestJSON-1513360368 tempest-FloatingIPDetailsTestJSON-1513360368-project] Action: 'create', calling method: .version_select at 0x7fc4199b3dc0>, body: {"pool": null} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:39:02.916605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-4c15d1d5-a022-46b8-9c1a-1c12dda76d64 req-6c6e7153-9dc4-44c0-ac68-9b86c5d503af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2a1933-970b-4c7d-a4b9-25cbc6f34768", "name": "network-vif-unplugged", "status": "completed", "tag": "eef20a26-9e87-43bc-ad0b-150c5fcd678a"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:39:02.978438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4c15d1d5-a022-46b8-9c1a-1c12dda76d64 req-6c6e7153-9dc4-44c0-ac68-9b86c5d503af service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:02.979321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4c15d1d5-a022-46b8-9c1a-1c12dda76d64 req-6c6e7153-9dc4-44c0-ac68-9b86c5d503af service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:02.987062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4c15d1d5-a022-46b8-9c1a-1c12dda76d64 req-6c6e7153-9dc4-44c0-ac68-9b86c5d503af service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:03.041868 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-4c15d1d5-a022-46b8-9c1a-1c12dda76d64 req-6c6e7153-9dc4-44c0-ac68-9b86c5d503af service nova] Creating event network-vif-unplugged:eef20a26-9e87-43bc-ad0b-150c5fcd678a for instance 7c2a1933-970b-4c7d-a4b9-25cbc6f34768 on n-h2-852087-9 Sep 07 12:39:03.058971 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-4c15d1d5-a022-46b8-9c1a-1c12dda76d64 req-6c6e7153-9dc4-44c0-ac68-9b86c5d503af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.374140 Sep 07 12:39:03.071295 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1039/2141] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:39:03.093978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7f01e9f8-98c8-42cb-8044-fd6c15b4ebd1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:03.095481 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7f01e9f8-98c8-42cb-8044-fd6c15b4ebd1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 16417424-f738-4fcf-8a54-4941ec487fa4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:03.120149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f01e9f8-98c8-42cb-8044-fd6c15b4ebd1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:03.121448 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f01e9f8-98c8-42cb-8044-fd6c15b4ebd1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:03.122631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f01e9f8-98c8-42cb-8044-fd6c15b4ebd1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:03.124258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f01e9f8-98c8-42cb-8044-fd6c15b4ebd1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:03.125351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f01e9f8-98c8-42cb-8044-fd6c15b4ebd1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:03.126376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f01e9f8-98c8-42cb-8044-fd6c15b4ebd1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:03.178811 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-7f01e9f8-98c8-42cb-8044-fd6c15b4ebd1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] HTTP exception thrown: Instance 16417424-f738-4fcf-8a54-4941ec487fa4 could not be found. Sep 07 12:39:03.189205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7f01e9f8-98c8-42cb-8044-fd6c15b4ebd1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Request method failure captured: Sep 07 12:39:03.189205 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4 HTTP/1.1 Sep 07 12:39:03.189205 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:39:03.189205 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:39:03.189205 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:39:03.189205 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:39:03.189205 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:39:03.189205 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:39:03.189205 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:39:03.189205 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:39:03.189205 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJBlqcLWGgP5YaSpRRip8sl6ENs86mQ2ZB5Esr_BbiPs2BPnzmI-e2CcMwry9HQsHE_7xTrPaxjrWyCCdxwjB586GVAzp9zrLJ93cY3nFhJZpwBkdDlKcORaqKagI-NfztXwSU5mWdQXi_cefHqVkeBlPPo7irch_gvMM3WMDfixR9Y Sep 07 12:39:03.189205 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:39:03.189205 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:39:03.189205 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:39:03.189205 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:39:03.189205 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:39:03.189205 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:39:03.189205 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: dc00ac02c77f40f5ab6acbe538c9566b Sep 07 12:39:03.189205 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-15279073 Sep 07 12:39:03.189205 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:39:03.189205 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:39:03.192604 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dc00ac02c77f40f5ab6acbe538c9566b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dc00ac02c77f40f5ab6acbe538c9566b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dc00ac02c77f40f5ab6acbe538c9566b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dc00ac02c77f40f5ab6acbe538c9566b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:39:03.192604 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-15279073 Sep 07 12:39:03.192604 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: dc00ac02c77f40f5ab6acbe538c9566b Sep 07 12:39:03.192604 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-15279073 Sep 07 12:39:03.192604 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-FloatingIPsAssociationTestJSON-15279073-project Sep 07 12:39:03.192604 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:39:03.192604 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:39:03.192604 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 41979e405fab49029d8ff5a9903e36ea Sep 07 12:39:03.192604 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-15279073-project Sep 07 12:39:03.192604 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:39:03.192604 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 16417424-f738-4fcf-8a54-4941ec487fa4 could not be found. Sep 07 12:39:03.192604 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '16417424-f738-4fcf-8a54-4941ec487fa4'} Sep 07 12:39:03.195254 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:39:03.195254 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:03.195254 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:39:03.195254 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:39:03.195254 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:39:03.195254 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:39:03.195254 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:39:03.195254 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:39:03.195254 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:39:03.195254 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:39:03.195254 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16417424-f738-4fcf-8a54-4941ec487fa4 could not be found. Sep 07 12:39:03.195254 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:03.195254 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:03.195254 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:03.195254 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:03.195254 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:03.195254 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:03.195254 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:39:03.195254 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:39:03.195254 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:39:03.199701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:39:03.199701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:39:03.199701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:39:03.199701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:39:03.199701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:39:03.199701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:39:03.199701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:39:03.199701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:39:03.199701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:39:03.199701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16417424-f738-4fcf-8a54-4941ec487fa4 could not be found. Sep 07 12:39:03.199701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:03.199701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:03.199701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:03.199701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:03.199701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:03.199701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:03.199701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:39:03.199701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:39:03.199701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16417424-f738-4fcf-8a54-4941ec487fa4 could not be found. Sep 07 12:39:03.199701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:03.208284 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7f01e9f8-98c8-42cb-8044-fd6c15b4ebd1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Returning 404 to user: Instance 16417424-f738-4fcf-8a54-4941ec487fa4 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:39:03.208284 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7f01e9f8-98c8-42cb-8044-fd6c15b4ebd1 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "DELETE /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4" status: 404 len: 111 microversion: 2.1 time: 0.118187 Sep 07 12:39:03.208284 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1040/2142] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:39:03 2022] DELETE /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:39:03.212415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f06e563-9c31-44f0-bfbe-d44b23b3f95d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:03.213160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0f06e563-9c31-44f0-bfbe-d44b23b3f95d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:03.271625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f06e563-9c31-44f0-bfbe-d44b23b3f95d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:03.272535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f06e563-9c31-44f0-bfbe-d44b23b3f95d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:03.273392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f06e563-9c31-44f0-bfbe-d44b23b3f95d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:03.274787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f06e563-9c31-44f0-bfbe-d44b23b3f95d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:03.275690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f06e563-9c31-44f0-bfbe-d44b23b3f95d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:03.276502 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f06e563-9c31-44f0-bfbe-d44b23b3f95d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:03.405209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0f06e563-9c31-44f0-bfbe-d44b23b3f95d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:39:03.626058 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0f06e563-9c31-44f0-bfbe-d44b23b3f95d tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 204 len: 0 microversion: 2.1 time: 0.431067 Sep 07 12:39:03.627335 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1041/2143] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:39:03 2022] DELETE /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:39:03.648659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b1a816e0-31d4-4fc9-a8cd-d1c036155cf2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:03.649968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b1a816e0-31d4-4fc9-a8cd-d1c036155cf2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 16417424-f738-4fcf-8a54-4941ec487fa4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:03.668205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1a816e0-31d4-4fc9-a8cd-d1c036155cf2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:03.673527 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1a816e0-31d4-4fc9-a8cd-d1c036155cf2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:03.674866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1a816e0-31d4-4fc9-a8cd-d1c036155cf2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:03.675981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1a816e0-31d4-4fc9-a8cd-d1c036155cf2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:03.678037 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1a816e0-31d4-4fc9-a8cd-d1c036155cf2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:03.683536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1a816e0-31d4-4fc9-a8cd-d1c036155cf2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:03.725405 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-b1a816e0-31d4-4fc9-a8cd-d1c036155cf2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] HTTP exception thrown: Instance 16417424-f738-4fcf-8a54-4941ec487fa4 could not be found. Sep 07 12:39:03.727972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b1a816e0-31d4-4fc9-a8cd-d1c036155cf2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Request method failure captured: Sep 07 12:39:03.727972 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4 HTTP/1.1 Sep 07 12:39:03.727972 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:39:03.727972 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:39:03.727972 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:39:03.727972 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:39:03.727972 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:39:03.727972 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:39:03.727972 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:39:03.727972 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:39:03.727972 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJBlqcLWGgP5YaSpRRip8sl6ENs86mQ2ZB5Esr_BbiPs2BPnzmI-e2CcMwry9HQsHE_7xTrPaxjrWyCCdxwjB586GVAzp9zrLJ93cY3nFhJZpwBkdDlKcORaqKagI-NfztXwSU5mWdQXi_cefHqVkeBlPPo7irch_gvMM3WMDfixR9Y Sep 07 12:39:03.727972 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:39:03.727972 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:39:03.727972 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:39:03.727972 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:39:03.727972 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:39:03.727972 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:39:03.727972 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: dc00ac02c77f40f5ab6acbe538c9566b Sep 07 12:39:03.727972 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-15279073 Sep 07 12:39:03.727972 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:39:03.727972 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:39:03.729906 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dc00ac02c77f40f5ab6acbe538c9566b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dc00ac02c77f40f5ab6acbe538c9566b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dc00ac02c77f40f5ab6acbe538c9566b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dc00ac02c77f40f5ab6acbe538c9566b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:39:03.729906 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-15279073 Sep 07 12:39:03.729906 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: dc00ac02c77f40f5ab6acbe538c9566b Sep 07 12:39:03.729906 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-15279073 Sep 07 12:39:03.729906 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-FloatingIPsAssociationTestJSON-15279073-project Sep 07 12:39:03.729906 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:39:03.729906 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:39:03.729906 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 41979e405fab49029d8ff5a9903e36ea Sep 07 12:39:03.729906 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-15279073-project Sep 07 12:39:03.729906 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:39:03.729906 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 16417424-f738-4fcf-8a54-4941ec487fa4 could not be found. Sep 07 12:39:03.729906 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '16417424-f738-4fcf-8a54-4941ec487fa4'} Sep 07 12:39:03.730758 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:39:03.730758 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:03.730758 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:39:03.730758 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:39:03.730758 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:39:03.730758 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:39:03.730758 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:39:03.730758 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:39:03.730758 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:39:03.730758 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:39:03.730758 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16417424-f738-4fcf-8a54-4941ec487fa4 could not be found. Sep 07 12:39:03.730758 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:03.730758 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:03.730758 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:03.730758 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:03.730758 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:03.730758 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:03.730758 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:39:03.730758 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:39:03.730758 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:39:03.732124 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:39:03.732124 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:39:03.732124 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:39:03.732124 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:39:03.732124 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:39:03.732124 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:39:03.732124 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:39:03.732124 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16417424-f738-4fcf-8a54-4941ec487fa4 could not be found. Sep 07 12:39:03.732124 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:03.732124 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:03.732124 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:03.732124 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:03.732124 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:03.732124 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:03.732124 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:39:03.732124 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:39:03.732124 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16417424-f738-4fcf-8a54-4941ec487fa4 could not be found. Sep 07 12:39:03.732124 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:03.735246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b1a816e0-31d4-4fc9-a8cd-d1c036155cf2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Returning 404 to user: Instance 16417424-f738-4fcf-8a54-4941ec487fa4 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:39:03.737214 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b1a816e0-31d4-4fc9-a8cd-d1c036155cf2 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "GET /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4" status: 404 len: 111 microversion: 2.1 time: 0.103452 Sep 07 12:39:03.738154 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1042/2144] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:03 2022] GET /compute/v2.1/servers/16417424-f738-4fcf-8a54-4941ec487fa4 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:39:03.743881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-37a6af5b-d7c9-460b-b68f-1f07b4d6fb69 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:03.744681 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-37a6af5b-d7c9-460b-b68f-1f07b4d6fb69 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 9f506502-b414-408e-b36a-a61e27b58980] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:03.756903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37a6af5b-d7c9-460b-b68f-1f07b4d6fb69 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:03.758113 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37a6af5b-d7c9-460b-b68f-1f07b4d6fb69 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:03.759636 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37a6af5b-d7c9-460b-b68f-1f07b4d6fb69 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:03.761449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37a6af5b-d7c9-460b-b68f-1f07b4d6fb69 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:03.762943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37a6af5b-d7c9-460b-b68f-1f07b4d6fb69 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:03.766987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37a6af5b-d7c9-460b-b68f-1f07b4d6fb69 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:04.142112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-37a6af5b-d7c9-460b-b68f-1f07b4d6fb69 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:04.173991 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-37a6af5b-d7c9-460b-b68f-1f07b4d6fb69 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980" status: 200 len: 1308 microversion: 2.1 time: 0.430497 Sep 07 12:39:04.181750 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1043/2145] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:03 2022] GET /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980 => generated 1308 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:04.200978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb19a07a-2f3f-4f3a-8280-e20833045a05 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:04.204489 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cb19a07a-2f3f-4f3a-8280-e20833045a05 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:04.216618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb19a07a-2f3f-4f3a-8280-e20833045a05 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:04.217572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb19a07a-2f3f-4f3a-8280-e20833045a05 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:04.218585 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb19a07a-2f3f-4f3a-8280-e20833045a05 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:04.220073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb19a07a-2f3f-4f3a-8280-e20833045a05 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:04.228152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb19a07a-2f3f-4f3a-8280-e20833045a05 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:04.229930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb19a07a-2f3f-4f3a-8280-e20833045a05 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:04.889529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cb19a07a-2f3f-4f3a-8280-e20833045a05 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009cb4fb12841a0ada96dc8c47cf2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32e8c6ba4e2486aa9769db48d2250d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:04.911830 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cb19a07a-2f3f-4f3a-8280-e20833045a05 tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 200 len: 1501 microversion: 2.1 time: 0.727795 Sep 07 12:39:04.913546 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1044/2146] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:04 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 1501 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:04.922127 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9232d799-b880-45f3-848c-99acb31d7b7a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:04.924196 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9232d799-b880-45f3-848c-99acb31d7b7a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:04.939765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9232d799-b880-45f3-848c-99acb31d7b7a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:04.946342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9232d799-b880-45f3-848c-99acb31d7b7a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:04.949660 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9232d799-b880-45f3-848c-99acb31d7b7a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:04.954073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9232d799-b880-45f3-848c-99acb31d7b7a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:04.957118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9232d799-b880-45f3-848c-99acb31d7b7a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:04.958925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9232d799-b880-45f3-848c-99acb31d7b7a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:05.227671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9232d799-b880-45f3-848c-99acb31d7b7a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:05.262430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9232d799-b880-45f3-848c-99acb31d7b7a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:05.268639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9232d799-b880-45f3-848c-99acb31d7b7a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:05.274448 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9232d799-b880-45f3-848c-99acb31d7b7a tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1486 microversion: 2.25 time: 0.357274 Sep 07 12:39:05.276015 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1045/2147] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:39:04 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1486 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:39:05.287680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-31011ccc-6c39-40f8-94b1-216ee78678a3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:05.288986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-31011ccc-6c39-40f8-94b1-216ee78678a3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 704ec36d-6304-4089-9e70-12b23b3c795e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:05.304076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31011ccc-6c39-40f8-94b1-216ee78678a3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:05.305577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31011ccc-6c39-40f8-94b1-216ee78678a3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:05.308720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31011ccc-6c39-40f8-94b1-216ee78678a3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:05.310560 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31011ccc-6c39-40f8-94b1-216ee78678a3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:05.311856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31011ccc-6c39-40f8-94b1-216ee78678a3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:05.313622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31011ccc-6c39-40f8-94b1-216ee78678a3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:05.481187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31011ccc-6c39-40f8-94b1-216ee78678a3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:05.487219 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31011ccc-6c39-40f8-94b1-216ee78678a3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:05.489149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31011ccc-6c39-40f8-94b1-216ee78678a3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:05.495043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-31011ccc-6c39-40f8-94b1-216ee78678a3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lazy-loading 'fault' on Instance uuid 704ec36d-6304-4089-9e70-12b23b3c795e {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:39:05.709969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-31011ccc-6c39-40f8-94b1-216ee78678a3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:05.772586 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-31011ccc-6c39-40f8-94b1-216ee78678a3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e" status: 200 len: 1350 microversion: 2.1 time: 0.489602 Sep 07 12:39:05.775140 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1046/2148] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:05 2022] GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e => generated 1350 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:05.797273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dbce2ea0-24cc-45f8-b7fb-c26874513485 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '.version_select at 0x7fc418af9940>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:09.885581 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2fd2fea3-62b1-4919-99f9-c9e7d65e2675 tempest-FloatingIPDetailsTestJSON-1513360368 tempest-FloatingIPDetailsTestJSON-1513360368-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.037103 Sep 07 12:39:09.889217 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1103/2149] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Sep 7 12:39:02 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:39:09.903554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d5cd8790-d4c0-4c08-b8d5-888deecbba1b req-670da6f8-0598-4e98-a33e-9b63577eb311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "704ec36d-6304-4089-9e70-12b23b3c795e", "name": "network-vif-deleted", "tag": "ae194be9-b61b-4fb3-8d00-fbe7ae1a96e6"}, {"name": "network-changed", "server_uuid": "9f506502-b414-408e-b36a-a61e27b58980", "tag": "6e1353d6-2e43-4cdf-b8a5-622fd6963e0e"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:39:09.922472 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dbce2ea0-24cc-45f8-b7fb-c26874513485 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/32e6de07-b1df-4c9c-9cfb-e5aaab086dee" status: 202 len: 0 microversion: 2.1 time: 4.144970 Sep 07 12:39:09.923708 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1047/2150] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Sep 7 12:39:05 2022] DELETE /compute/v2.1/os-floating-ips/32e6de07-b1df-4c9c-9cfb-e5aaab086dee => generated 0 bytes in 4148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:39:09.929084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6f55374e-a013-400a-b2a2-76605e7b2c26 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:09.929778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6f55374e-a013-400a-b2a2-76605e7b2c26 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 9f506502-b414-408e-b36a-a61e27b58980] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:09.945392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f55374e-a013-400a-b2a2-76605e7b2c26 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:09.948948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f55374e-a013-400a-b2a2-76605e7b2c26 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:09.949459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f55374e-a013-400a-b2a2-76605e7b2c26 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:09.950287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f55374e-a013-400a-b2a2-76605e7b2c26 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:09.953238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f55374e-a013-400a-b2a2-76605e7b2c26 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:09.953880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f55374e-a013-400a-b2a2-76605e7b2c26 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:09.967787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d5cd8790-d4c0-4c08-b8d5-888deecbba1b req-670da6f8-0598-4e98-a33e-9b63577eb311 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:09.972922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d5cd8790-d4c0-4c08-b8d5-888deecbba1b req-670da6f8-0598-4e98-a33e-9b63577eb311 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:09.975447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d5cd8790-d4c0-4c08-b8d5-888deecbba1b req-670da6f8-0598-4e98-a33e-9b63577eb311 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:10.019361 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d5cd8790-d4c0-4c08-b8d5-888deecbba1b req-670da6f8-0598-4e98-a33e-9b63577eb311 service nova] Creating event network-vif-deleted:ae194be9-b61b-4fb3-8d00-fbe7ae1a96e6 for instance 704ec36d-6304-4089-9e70-12b23b3c795e on n-h1-852087-9 Sep 07 12:39:10.020107 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d5cd8790-d4c0-4c08-b8d5-888deecbba1b req-670da6f8-0598-4e98-a33e-9b63577eb311 service nova] Creating event network-changed:6e1353d6-2e43-4cdf-b8a5-622fd6963e0e for instance 9f506502-b414-408e-b36a-a61e27b58980 on n-h1-852087-9 Sep 07 12:39:10.040013 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d5cd8790-d4c0-4c08-b8d5-888deecbba1b req-670da6f8-0598-4e98-a33e-9b63577eb311 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.148296 Sep 07 12:39:10.040758 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1104/2151] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:39:10.051072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-47de64e1-35ea-44b0-91bc-030be1f7914d req-13a19bf1-69eb-4763-8270-8ede50672409 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8817b2e5-125e-455f-9c44-e0f46786b5fa", "tag": "f2fda9ed-aa0e-41f8-a289-5e6679639d1e"}, {"name": "network-changed", "server_uuid": "7c2a1933-970b-4c7d-a4b9-25cbc6f34768", "tag": "eef20a26-9e87-43bc-ad0b-150c5fcd678a"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:39:10.085882 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-47de64e1-35ea-44b0-91bc-030be1f7914d req-13a19bf1-69eb-4763-8270-8ede50672409 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:10.086851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-47de64e1-35ea-44b0-91bc-030be1f7914d req-13a19bf1-69eb-4763-8270-8ede50672409 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:10.087355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-47de64e1-35ea-44b0-91bc-030be1f7914d req-13a19bf1-69eb-4763-8270-8ede50672409 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:10.135923 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-47de64e1-35ea-44b0-91bc-030be1f7914d req-13a19bf1-69eb-4763-8270-8ede50672409 service nova] Creating event network-changed:f2fda9ed-aa0e-41f8-a289-5e6679639d1e for instance 8817b2e5-125e-455f-9c44-e0f46786b5fa on n-h1-852087-9 Sep 07 12:39:10.136912 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-47de64e1-35ea-44b0-91bc-030be1f7914d req-13a19bf1-69eb-4763-8270-8ede50672409 service nova] Creating event network-changed:eef20a26-9e87-43bc-ad0b-150c5fcd678a for instance 7c2a1933-970b-4c7d-a4b9-25cbc6f34768 on n-h2-852087-9 Sep 07 12:39:10.166826 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-47de64e1-35ea-44b0-91bc-030be1f7914d req-13a19bf1-69eb-4763-8270-8ede50672409 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.123516 Sep 07 12:39:10.167454 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1105/2152] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:39:10.180694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0d9d96f3-6ba1-492a-9cee-167e1b49fafc tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:10.181468 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0d9d96f3-6ba1-492a-9cee-167e1b49fafc tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] [instance: 5516035a-001e-4d31-84cc-84bca52e7b1e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:10.237142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d9d96f3-6ba1-492a-9cee-167e1b49fafc tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:10.238235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d9d96f3-6ba1-492a-9cee-167e1b49fafc tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:10.238696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d9d96f3-6ba1-492a-9cee-167e1b49fafc tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:10.239464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d9d96f3-6ba1-492a-9cee-167e1b49fafc tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:10.239940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d9d96f3-6ba1-492a-9cee-167e1b49fafc tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:10.240382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d9d96f3-6ba1-492a-9cee-167e1b49fafc tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:10.291775 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-0d9d96f3-6ba1-492a-9cee-167e1b49fafc tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] HTTP exception thrown: Instance 5516035a-001e-4d31-84cc-84bca52e7b1e could not be found. Sep 07 12:39:10.298362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0d9d96f3-6ba1-492a-9cee-167e1b49fafc tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Request method failure captured: Sep 07 12:39:10.298362 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e HTTP/1.1 Sep 07 12:39:10.298362 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:39:10.298362 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:39:10.298362 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:39:10.298362 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:39:10.298362 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:39:10.298362 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:39:10.298362 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:39:10.298362 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:39:10.298362 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI5zwGzwkngoYC-cJ2GbjommfZAenk5Snsx6zvVP-qrJN5QM5lt2HU9sKJdgOR49GCVF27sYloiDGYPH3cZ6h6iUb6YYX6mjjvqEsBfKHFhbmA5MBDDgGhP3f8hmP38AhCjVLT5MNdjVTOul4ymqUAKxYqPGo8PkF5sFmvW_ekZghlk Sep 07 12:39:10.298362 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:39:10.298362 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:39:10.298362 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:39:10.298362 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:39:10.298362 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:39:10.298362 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:39:10.298362 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: b32e8c6ba4e2486aa9769db48d2250d9 Sep 07 12:39:10.298362 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-LiveMigrationTest-546501661 Sep 07 12:39:10.298362 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:39:10.298362 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:39:10.300021 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b32e8c6ba4e2486aa9769db48d2250d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b32e8c6ba4e2486aa9769db48d2250d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b32e8c6ba4e2486aa9769db48d2250d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b32e8c6ba4e2486aa9769db48d2250d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:39:10.300021 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-LiveMigrationTest-546501661 Sep 07 12:39:10.300021 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: b32e8c6ba4e2486aa9769db48d2250d9 Sep 07 12:39:10.300021 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-LiveMigrationTest-546501661 Sep 07 12:39:10.300021 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-LiveMigrationTest-546501661-project Sep 07 12:39:10.300021 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:39:10.300021 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:39:10.300021 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: f009cb4fb12841a0ada96dc8c47cf2bd Sep 07 12:39:10.300021 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-LiveMigrationTest-546501661-project Sep 07 12:39:10.300021 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:39:10.300021 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 5516035a-001e-4d31-84cc-84bca52e7b1e could not be found. Sep 07 12:39:10.300021 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '5516035a-001e-4d31-84cc-84bca52e7b1e'} Sep 07 12:39:10.300948 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:39:10.300948 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:10.300948 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:39:10.300948 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:39:10.300948 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:39:10.300948 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:39:10.300948 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:39:10.300948 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:39:10.300948 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:39:10.300948 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:39:10.300948 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5516035a-001e-4d31-84cc-84bca52e7b1e could not be found. Sep 07 12:39:10.300948 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:10.300948 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:10.300948 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:10.300948 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:10.300948 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:10.300948 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:10.300948 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:39:10.300948 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:39:10.300948 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:39:10.302368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:39:10.302368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:39:10.302368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:39:10.302368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:39:10.302368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:39:10.302368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:39:10.302368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:39:10.302368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5516035a-001e-4d31-84cc-84bca52e7b1e could not be found. Sep 07 12:39:10.302368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:10.302368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:10.302368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:10.302368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:10.302368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:10.302368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:10.302368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:39:10.302368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:39:10.302368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5516035a-001e-4d31-84cc-84bca52e7b1e could not be found. Sep 07 12:39:10.302368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:10.321108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0d9d96f3-6ba1-492a-9cee-167e1b49fafc tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] Returning 404 to user: Instance 5516035a-001e-4d31-84cc-84bca52e7b1e could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:39:10.331919 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0d9d96f3-6ba1-492a-9cee-167e1b49fafc tempest-LiveMigrationTest-546501661 tempest-LiveMigrationTest-546501661-project] 10.222.0.16 "GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e" status: 404 len: 111 microversion: 2.1 time: 0.159138 Sep 07 12:39:10.336050 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1106/2153] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:10 2022] GET /compute/v2.1/servers/5516035a-001e-4d31-84cc-84bca52e7b1e => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:39:10.342820 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-59c3f738-19ae-4403-ae1b-4036ae2cbc1c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:10.359669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-59c3f738-19ae-4403-ae1b-4036ae2cbc1c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:10.404668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59c3f738-19ae-4403-ae1b-4036ae2cbc1c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:10.407263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59c3f738-19ae-4403-ae1b-4036ae2cbc1c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:10.409499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59c3f738-19ae-4403-ae1b-4036ae2cbc1c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:10.426844 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59c3f738-19ae-4403-ae1b-4036ae2cbc1c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:10.427942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59c3f738-19ae-4403-ae1b-4036ae2cbc1c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:10.432186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59c3f738-19ae-4403-ae1b-4036ae2cbc1c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:10.449320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6f55374e-a013-400a-b2a2-76605e7b2c26 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:10.500246 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6f55374e-a013-400a-b2a2-76605e7b2c26 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980" status: 200 len: 1308 microversion: 2.1 time: 0.570464 Sep 07 12:39:10.502479 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1048/2154] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:09 2022] GET /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980 => generated 1308 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:10.540328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e7f75d31-7f5a-4bbc-ab0e-4a5ae6fe5576 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:10.547409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e7f75d31-7f5a-4bbc-ab0e-4a5ae6fe5576 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 704ec36d-6304-4089-9e70-12b23b3c795e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:10.560264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7f75d31-7f5a-4bbc-ab0e-4a5ae6fe5576 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:10.564090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7f75d31-7f5a-4bbc-ab0e-4a5ae6fe5576 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:10.564575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7f75d31-7f5a-4bbc-ab0e-4a5ae6fe5576 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:10.565531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7f75d31-7f5a-4bbc-ab0e-4a5ae6fe5576 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:10.565898 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7f75d31-7f5a-4bbc-ab0e-4a5ae6fe5576 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:10.566356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7f75d31-7f5a-4bbc-ab0e-4a5ae6fe5576 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:10.605510 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-e7f75d31-7f5a-4bbc-ab0e-4a5ae6fe5576 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] HTTP exception thrown: Instance 704ec36d-6304-4089-9e70-12b23b3c795e could not be found. Sep 07 12:39:10.607535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e7f75d31-7f5a-4bbc-ab0e-4a5ae6fe5576 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Request method failure captured: Sep 07 12:39:10.607535 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e HTTP/1.1 Sep 07 12:39:10.607535 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:39:10.607535 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:39:10.607535 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:39:10.607535 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:39:10.607535 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:39:10.607535 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:39:10.607535 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:39:10.607535 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:39:10.607535 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJBoiaP7MPiSaP6e6aUmMJ8PuR8TxD72E3ycIsoyb5pICiti0ZKBvrRvNoP9EgDHIO9YzOUucG9iu3oQZMsvYh9Gs4g9xjGSFcMGctGxplJk2OO0Aofdu3Ru80K0M86m3EPIBI5c12Fca4rxAASE3osSSig78ynw4pFvNNSiXm2zkBk Sep 07 12:39:10.607535 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:39:10.607535 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:39:10.607535 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:39:10.607535 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:39:10.607535 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:39:10.607535 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:39:10.607535 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:39:10.607535 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:39:10.607535 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:39:10.607535 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:39:10.609362 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef5b2dd007e944358d72268414868096"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef5b2dd007e944358d72268414868096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:39:10.609362 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:39:10.609362 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:39:10.609362 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:39:10.609362 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:39:10.609362 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:39:10.609362 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:39:10.609362 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: b920811be01745fc9faea7a9ce213c6e Sep 07 12:39:10.609362 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:39:10.609362 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:39:10.609362 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 704ec36d-6304-4089-9e70-12b23b3c795e could not be found. Sep 07 12:39:10.609362 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '704ec36d-6304-4089-9e70-12b23b3c795e'} Sep 07 12:39:10.610268 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:39:10.610268 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:10.610268 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:39:10.610268 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:39:10.610268 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:39:10.610268 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:39:10.610268 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:39:10.610268 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:39:10.610268 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:39:10.610268 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:39:10.610268 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 704ec36d-6304-4089-9e70-12b23b3c795e could not be found. Sep 07 12:39:10.610268 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:10.610268 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:10.610268 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:10.610268 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:10.610268 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:10.610268 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:10.610268 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:39:10.610268 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:39:10.610268 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:39:10.611704 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:39:10.611704 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:39:10.611704 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:39:10.611704 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:39:10.611704 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:39:10.611704 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:39:10.611704 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:39:10.611704 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 704ec36d-6304-4089-9e70-12b23b3c795e could not be found. Sep 07 12:39:10.611704 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:10.611704 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:10.611704 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:10.611704 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:10.611704 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:10.611704 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:10.611704 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:39:10.611704 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:39:10.611704 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 704ec36d-6304-4089-9e70-12b23b3c795e could not be found. Sep 07 12:39:10.611704 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:10.629030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e7f75d31-7f5a-4bbc-ab0e-4a5ae6fe5576 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Returning 404 to user: Instance 704ec36d-6304-4089-9e70-12b23b3c795e could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:39:10.630691 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e7f75d31-7f5a-4bbc-ab0e-4a5ae6fe5576 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e" status: 404 len: 111 microversion: 2.1 time: 0.121315 Sep 07 12:39:10.638561 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1049/2155] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:10 2022] GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:39:10.736711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-9116d8d6-8a06-4e0e-a693-bd48ec612b98 req-2e483e93-757e-42c8-aeb1-ae8ec9519582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f506502-b414-408e-b36a-a61e27b58980", "name": "network-vif-plugged", "status": "completed", "tag": "6e1353d6-2e43-4cdf-b8a5-622fd6963e0e"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:39:10.752386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9116d8d6-8a06-4e0e-a693-bd48ec612b98 req-2e483e93-757e-42c8-aeb1-ae8ec9519582 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:10.757333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9116d8d6-8a06-4e0e-a693-bd48ec612b98 req-2e483e93-757e-42c8-aeb1-ae8ec9519582 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:10.758538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9116d8d6-8a06-4e0e-a693-bd48ec612b98 req-2e483e93-757e-42c8-aeb1-ae8ec9519582 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:10.809226 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-9116d8d6-8a06-4e0e-a693-bd48ec612b98 req-2e483e93-757e-42c8-aeb1-ae8ec9519582 service nova] Creating event network-vif-plugged:6e1353d6-2e43-4cdf-b8a5-622fd6963e0e for instance 9f506502-b414-408e-b36a-a61e27b58980 on n-h1-852087-9 Sep 07 12:39:10.834617 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-9116d8d6-8a06-4e0e-a693-bd48ec612b98 req-2e483e93-757e-42c8-aeb1-ae8ec9519582 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193782 Sep 07 12:39:10.841393 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1050/2156] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:39:10.984452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-614b3579-fee9-45e6-b1d6-082ea8199b75 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1781083361", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "1d677d48-f911-4a36-8bf8-dfa06da98dc6"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:39:11.150059 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-614b3579-fee9-45e6-b1d6-082ea8199b75 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] validate_networks() for [('1d677d48-f911-4a36-8bf8-dfa06da98dc6', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:39:11.249259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-59c3f738-19ae-4403-ae1b-4036ae2cbc1c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:11.306870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-59c3f738-19ae-4403-ae1b-4036ae2cbc1c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:11.321541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-59c3f738-19ae-4403-ae1b-4036ae2cbc1c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:11.327639 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-59c3f738-19ae-4403-ae1b-4036ae2cbc1c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1486 microversion: 2.25 time: 0.988889 Sep 07 12:39:11.330707 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1107/2157] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:39:10 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1486 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:39:11.352762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2cdf6af3-078d-4ac1-a4b4-0095741f72b7 tempest-FloatingIPDetailsTestJSON-1513360368 tempest-FloatingIPDetailsTestJSON-1513360368-project] Calling method '.version_select at 0x7fc4198e6c10>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:12.480797 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2cdf6af3-078d-4ac1-a4b4-0095741f72b7 tempest-FloatingIPDetailsTestJSON-1513360368 tempest-FloatingIPDetailsTestJSON-1513360368-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/18d6b17a-8827-45a5-b04c-2f6478cbcf55" status: 200 len: 141 microversion: 2.1 time: 1.147008 Sep 07 12:39:12.494415 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1108/2158] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Sep 7 12:39:11 2022] GET /compute/v2.1/os-floating-ips/18d6b17a-8827-45a5-b04c-2f6478cbcf55 => generated 141 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:39:12.513030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8cadfa6b-4076-40b8-81f7-d289e65a625f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:12.521104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8cadfa6b-4076-40b8-81f7-d289e65a625f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:12.561386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cadfa6b-4076-40b8-81f7-d289e65a625f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:12.566393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cadfa6b-4076-40b8-81f7-d289e65a625f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:12.572063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cadfa6b-4076-40b8-81f7-d289e65a625f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:12.578556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cadfa6b-4076-40b8-81f7-d289e65a625f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:12.583306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cadfa6b-4076-40b8-81f7-d289e65a625f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:12.589890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cadfa6b-4076-40b8-81f7-d289e65a625f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:12.779828 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8cadfa6b-4076-40b8-81f7-d289e65a625f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:39:12.974642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=5,nova_cell1:RELEASE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:39:13.180625 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8cadfa6b-4076-40b8-81f7-d289e65a625f tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa" status: 204 len: 0 microversion: 2.1 time: 0.683397 Sep 07 12:39:13.182790 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1109/2159] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:39:12 2022] DELETE /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa => generated 0 bytes in 687 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:39:13.191036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5d65e49c-6101-4a10-b3b6-54a618fff2f6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:13.195510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5d65e49c-6101-4a10-b3b6-54a618fff2f6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 704ec36d-6304-4089-9e70-12b23b3c795e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:13.206382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d65e49c-6101-4a10-b3b6-54a618fff2f6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:13.207467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d65e49c-6101-4a10-b3b6-54a618fff2f6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:13.208400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d65e49c-6101-4a10-b3b6-54a618fff2f6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:13.210557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d65e49c-6101-4a10-b3b6-54a618fff2f6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:13.211324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d65e49c-6101-4a10-b3b6-54a618fff2f6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:13.211938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d65e49c-6101-4a10-b3b6-54a618fff2f6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:13.232948 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-5d65e49c-6101-4a10-b3b6-54a618fff2f6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] HTTP exception thrown: Instance 704ec36d-6304-4089-9e70-12b23b3c795e could not be found. Sep 07 12:39:13.242895 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5d65e49c-6101-4a10-b3b6-54a618fff2f6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Request method failure captured: Sep 07 12:39:13.242895 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e/os-volume_attachments HTTP/1.1 Sep 07 12:39:13.242895 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:39:13.242895 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:39:13.242895 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:39:13.242895 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:39:13.242895 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:39:13.242895 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:39:13.242895 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:39:13.242895 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:39:13.242895 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJBoiaP7MPiSaP6e6aUmMJ8PuR8TxD72E3ycIsoyb5pICiti0ZKBvrRvNoP9EgDHIO9YzOUucG9iu3oQZMsvYh9Gs4g9xjGSFcMGctGxplJk2OO0Aofdu3Ru80K0M86m3EPIBI5c12Fca4rxAASE3osSSig78ynw4pFvNNSiXm2zkBk Sep 07 12:39:13.242895 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:39:13.242895 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:39:13.242895 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:39:13.242895 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:39:13.242895 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:39:13.242895 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:39:13.242895 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:39:13.242895 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:39:13.242895 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:39:13.242895 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:39:13.245986 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef5b2dd007e944358d72268414868096"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef5b2dd007e944358d72268414868096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:39:13.245986 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:39:13.245986 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:39:13.245986 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:39:13.245986 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:39:13.245986 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:39:13.245986 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:39:13.245986 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: b920811be01745fc9faea7a9ce213c6e Sep 07 12:39:13.245986 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:39:13.245986 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:39:13.245986 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 704ec36d-6304-4089-9e70-12b23b3c795e could not be found. Sep 07 12:39:13.245986 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'server_id': '704ec36d-6304-4089-9e70-12b23b3c795e'} Sep 07 12:39:13.247571 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:39:13.247571 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:13.247571 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:39:13.247571 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:39:13.247571 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:39:13.247571 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:39:13.247571 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:39:13.247571 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:39:13.247571 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:39:13.247571 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:39:13.247571 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 704ec36d-6304-4089-9e70-12b23b3c795e could not be found. Sep 07 12:39:13.247571 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:13.247571 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:13.247571 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:13.247571 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:13.247571 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:13.247571 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:13.247571 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:39:13.247571 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:39:13.247571 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:39:13.250422 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:39:13.250422 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 12:39:13.250422 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:39:13.250422 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 12:39:13.250422 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:39:13.250422 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 07 12:39:13.250422 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 07 12:39:13.250422 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:39:13.250422 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:39:13.250422 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 704ec36d-6304-4089-9e70-12b23b3c795e could not be found. Sep 07 12:39:13.250422 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:13.250422 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:13.250422 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:13.250422 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:13.250422 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:13.250422 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:13.250422 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:39:13.250422 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:39:13.250422 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 704ec36d-6304-4089-9e70-12b23b3c795e could not be found. Sep 07 12:39:13.250422 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:13.252930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5d65e49c-6101-4a10-b3b6-54a618fff2f6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Returning 404 to user: Instance 704ec36d-6304-4089-9e70-12b23b3c795e could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:39:13.262842 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5d65e49c-6101-4a10-b3b6-54a618fff2f6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.074280 Sep 07 12:39:13.263649 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1110/2160] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:39:13 2022] GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e/os-volume_attachments => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:39:13.272859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ddb38080-082a-4331-babb-c107a78bce28 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:13.273617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ddb38080-082a-4331-babb-c107a78bce28 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 9f506502-b414-408e-b36a-a61e27b58980] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:13.288999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddb38080-082a-4331-babb-c107a78bce28 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:13.289573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddb38080-082a-4331-babb-c107a78bce28 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:13.292671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddb38080-082a-4331-babb-c107a78bce28 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:13.293639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddb38080-082a-4331-babb-c107a78bce28 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:13.294145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddb38080-082a-4331-babb-c107a78bce28 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:13.294596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddb38080-082a-4331-babb-c107a78bce28 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:13.681401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-614b3579-fee9-45e6-b1d6-082ea8199b75 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:39:13.687269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-614b3579-fee9-45e6-b1d6-082ea8199b75 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:39:13.690671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-614b3579-fee9-45e6-b1d6-082ea8199b75 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:39:13.693034 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-614b3579-fee9-45e6-b1d6-082ea8199b75 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:39:13.694484 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-614b3579-fee9-45e6-b1d6-082ea8199b75 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:39:13.699093 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ddb38080-082a-4331-babb-c107a78bce28 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:13.712332 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ddb38080-082a-4331-babb-c107a78bce28 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980" status: 200 len: 1308 microversion: 2.1 time: 0.442628 Sep 07 12:39:13.716149 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1111/2161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:13 2022] GET /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980 => generated 1308 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:13.720977 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-614b3579-fee9-45e6-b1d6-082ea8199b75 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:13.721936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-58862e99-edb6-473c-96a6-da77a3bc43b7 req-c796d6cc-d9de-437c-8594-e69129cae3e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5516035a-001e-4d31-84cc-84bca52e7b1e", "name": "network-vif-deleted", "tag": "f6af2e88-520d-49f5-bc3a-8bccb5d1a54b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:39:13.722802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-614b3579-fee9-45e6-b1d6-082ea8199b75 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:13.724315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-614b3579-fee9-45e6-b1d6-082ea8199b75 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:13.726467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-614b3579-fee9-45e6-b1d6-082ea8199b75 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:13.729289 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-614b3579-fee9-45e6-b1d6-082ea8199b75 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:13.730749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-614b3579-fee9-45e6-b1d6-082ea8199b75 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:13.741677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-58862e99-edb6-473c-96a6-da77a3bc43b7 req-c796d6cc-d9de-437c-8594-e69129cae3e2 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:13.742215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-58862e99-edb6-473c-96a6-da77a3bc43b7 req-c796d6cc-d9de-437c-8594-e69129cae3e2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:13.742665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-58862e99-edb6-473c-96a6-da77a3bc43b7 req-c796d6cc-d9de-437c-8594-e69129cae3e2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:13.763110 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-58862e99-edb6-473c-96a6-da77a3bc43b7 req-c796d6cc-d9de-437c-8594-e69129cae3e2 service nova] Creating event network-vif-deleted:f6af2e88-520d-49f5-bc3a-8bccb5d1a54b for instance 5516035a-001e-4d31-84cc-84bca52e7b1e on n-h2-852087-9 Sep 07 12:39:13.778305 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-58862e99-edb6-473c-96a6-da77a3bc43b7 req-c796d6cc-d9de-437c-8594-e69129cae3e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060734 Sep 07 12:39:13.779361 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1112/2162] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:39:13.790652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0f680617-50b2-47dc-ad5a-e05698f5d7e6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:13.792386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0f680617-50b2-47dc-ad5a-e05698f5d7e6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:13.794060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-614b3579-fee9-45e6-b1d6-082ea8199b75 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Getting quotas for project e28a1b6c8dde4b948d493b369535a301. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:39:13.804183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-614b3579-fee9-45e6-b1d6-082ea8199b75 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Getting quotas for user 3f9b8d4c5d9a4efeb97645f3233b1064 and project e28a1b6c8dde4b948d493b369535a301. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:39:13.823229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f680617-50b2-47dc-ad5a-e05698f5d7e6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:13.823873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f680617-50b2-47dc-ad5a-e05698f5d7e6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:13.824432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f680617-50b2-47dc-ad5a-e05698f5d7e6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:13.825396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f680617-50b2-47dc-ad5a-e05698f5d7e6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:13.826220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-614b3579-fee9-45e6-b1d6-082ea8199b75 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Going to run 3 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:39:13.826421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f680617-50b2-47dc-ad5a-e05698f5d7e6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:13.827040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f680617-50b2-47dc-ad5a-e05698f5d7e6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:13.830138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-614b3579-fee9-45e6-b1d6-082ea8199b75 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: 3156895a-b53e-4926-9425-6feaae2d424d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:39:13.920593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-614b3579-fee9-45e6-b1d6-082ea8199b75 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: d610675f-fc02-46f7-a980-33b6ee582c4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=3156895a-b53e-4926-9425-6feaae2d424d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:39:14.051542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-614b3579-fee9-45e6-b1d6-082ea8199b75 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: 498a719e-d642-4e9c-9951-d6aacb0a16db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=d610675f-fc02-46f7-a980-33b6ee582c4d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:39:14.177844 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0f680617-50b2-47dc-ad5a-e05698f5d7e6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:14.219708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0f680617-50b2-47dc-ad5a-e05698f5d7e6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:14.225604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0f680617-50b2-47dc-ad5a-e05698f5d7e6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:14.229352 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0f680617-50b2-47dc-ad5a-e05698f5d7e6 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1486 microversion: 2.25 time: 0.448351 Sep 07 12:39:14.237860 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1113/2163] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:39:13 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1486 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:39:14.251596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f3e73c3e-a4f9-4b96-aa18-bec9a28ad04d tempest-FloatingIPDetailsTestJSON-1513360368 tempest-FloatingIPDetailsTestJSON-1513360368-project] Calling method '.version_select at 0x7fc419051dc0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:14.333672 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-614b3579-fee9-45e6-b1d6-082ea8199b75 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.488422 Sep 07 12:39:14.335792 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1051/2164] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:39:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:39:14.345974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c50a4b4c-26a2-44a6-ae05-c5d1dc48cb00 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:14.347658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c50a4b4c-26a2-44a6-ae05-c5d1dc48cb00 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:14.362450 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c50a4b4c-26a2-44a6-ae05-c5d1dc48cb00 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:14.363792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c50a4b4c-26a2-44a6-ae05-c5d1dc48cb00 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:14.364981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c50a4b4c-26a2-44a6-ae05-c5d1dc48cb00 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:14.366444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c50a4b4c-26a2-44a6-ae05-c5d1dc48cb00 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:14.367550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c50a4b4c-26a2-44a6-ae05-c5d1dc48cb00 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:14.368707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c50a4b4c-26a2-44a6-ae05-c5d1dc48cb00 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:14.744739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c50a4b4c-26a2-44a6-ae05-c5d1dc48cb00 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41979e405fab49029d8ff5a9903e36ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00ac02c77f40f5ab6acbe538c9566b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:14.755107 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c50a4b4c-26a2-44a6-ae05-c5d1dc48cb00 tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa" status: 200 len: 1524 microversion: 2.1 time: 0.417135 Sep 07 12:39:14.758736 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1052/2165] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:14 2022] GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa => generated 1524 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:14.772288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d905d3bb-53a8-46d4-9449-5cbcee59866e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-373268332", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "80d51306-dbb8-4c2e-bca9-60970c39d44b"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:39:14.949331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-d905d3bb-53a8-46d4-9449-5cbcee59866e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] validate_networks() for [('80d51306-dbb8-4c2e-bca9-60970c39d44b', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:39:17.090590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d905d3bb-53a8-46d4-9449-5cbcee59866e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:39:17.092923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d905d3bb-53a8-46d4-9449-5cbcee59866e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:39:17.094514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d905d3bb-53a8-46d4-9449-5cbcee59866e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:39:17.099103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d905d3bb-53a8-46d4-9449-5cbcee59866e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:39:17.109461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d905d3bb-53a8-46d4-9449-5cbcee59866e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:39:17.120845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=13,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:39:17.193200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d905d3bb-53a8-46d4-9449-5cbcee59866e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:17.194333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d905d3bb-53a8-46d4-9449-5cbcee59866e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:17.197198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d905d3bb-53a8-46d4-9449-5cbcee59866e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:17.202782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d905d3bb-53a8-46d4-9449-5cbcee59866e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:17.208717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d905d3bb-53a8-46d4-9449-5cbcee59866e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:17.211970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d905d3bb-53a8-46d4-9449-5cbcee59866e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:17.254192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:39:17.344565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-d905d3bb-53a8-46d4-9449-5cbcee59866e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Getting quotas for project ef5b2dd007e944358d72268414868096. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:39:17.352422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-d905d3bb-53a8-46d4-9449-5cbcee59866e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Getting quotas for user b920811be01745fc9faea7a9ce213c6e and project ef5b2dd007e944358d72268414868096. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:39:17.398750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d905d3bb-53a8-46d4-9449-5cbcee59866e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:39:17.398750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d905d3bb-53a8-46d4-9449-5cbcee59866e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 657ffafe-1185-4cf0-9f75-e574bc2405e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:39:17.508447 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d905d3bb-53a8-46d4-9449-5cbcee59866e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.740898 Sep 07 12:39:17.517990 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1053/2166] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:39:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:39:17.528240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a768cb28-38ce-4b96-86fa-e4f5a57c4f05 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:17.547550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a768cb28-38ce-4b96-86fa-e4f5a57c4f05 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:17.549952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a768cb28-38ce-4b96-86fa-e4f5a57c4f05 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Searching by: {'deleted': False, 'project_id': 'e28a1b6c8dde4b948d493b369535a301'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:39:17.560142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a768cb28-38ce-4b96-86fa-e4f5a57c4f05 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:17.565409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a768cb28-38ce-4b96-86fa-e4f5a57c4f05 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:17.571096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a768cb28-38ce-4b96-86fa-e4f5a57c4f05 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:17.573461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a768cb28-38ce-4b96-86fa-e4f5a57c4f05 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:17.575179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a768cb28-38ce-4b96-86fa-e4f5a57c4f05 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:17.576836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a768cb28-38ce-4b96-86fa-e4f5a57c4f05 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:17.654273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-a768cb28-38ce-4b96-86fa-e4f5a57c4f05 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:39:17.759691 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a768cb28-38ce-4b96-86fa-e4f5a57c4f05 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.235817 Sep 07 12:39:17.768500 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1054/2167] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Sep 7 12:39:17 2022] GET /compute/v2.1/servers => generated 1018 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:17.785318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-435a619d-37b7-4d7f-8ae1-5b81df288366 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:17.787547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-435a619d-37b7-4d7f-8ae1-5b81df288366 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 9f506502-b414-408e-b36a-a61e27b58980] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:17.803359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-435a619d-37b7-4d7f-8ae1-5b81df288366 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:17.808558 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-435a619d-37b7-4d7f-8ae1-5b81df288366 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:17.811445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-435a619d-37b7-4d7f-8ae1-5b81df288366 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:17.815816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-435a619d-37b7-4d7f-8ae1-5b81df288366 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:17.818381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-435a619d-37b7-4d7f-8ae1-5b81df288366 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:17.820509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-435a619d-37b7-4d7f-8ae1-5b81df288366 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:18.497671 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f3e73c3e-a4f9-4b96-aa18-bec9a28ad04d tempest-FloatingIPDetailsTestJSON-1513360368 tempest-FloatingIPDetailsTestJSON-1513360368-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/18d6b17a-8827-45a5-b04c-2f6478cbcf55" status: 202 len: 0 microversion: 2.1 time: 4.250345 Sep 07 12:39:18.498613 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1114/2168] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Sep 7 12:39:14 2022] DELETE /compute/v2.1/os-floating-ips/18d6b17a-8827-45a5-b04c-2f6478cbcf55 => generated 0 bytes in 4260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:39:18.503549 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f67f2e55-ffd1-4b96-8bcd-ac7dee99be24 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:18.504212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f67f2e55-ffd1-4b96-8bcd-ac7dee99be24 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:18.524368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f67f2e55-ffd1-4b96-8bcd-ac7dee99be24 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:18.525233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f67f2e55-ffd1-4b96-8bcd-ac7dee99be24 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:18.525726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f67f2e55-ffd1-4b96-8bcd-ac7dee99be24 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:18.526594 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f67f2e55-ffd1-4b96-8bcd-ac7dee99be24 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:18.527075 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f67f2e55-ffd1-4b96-8bcd-ac7dee99be24 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:18.527512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f67f2e55-ffd1-4b96-8bcd-ac7dee99be24 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:19.023321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-435a619d-37b7-4d7f-8ae1-5b81df288366 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:19.047348 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-435a619d-37b7-4d7f-8ae1-5b81df288366 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980" status: 200 len: 1488 microversion: 2.1 time: 1.275397 Sep 07 12:39:19.053547 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1055/2169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:17 2022] GET /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980 => generated 1488 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:19.064219 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1f8a5bcb-c0b5-465d-84ec-6cd64e5b5e0a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:19.069866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1f8a5bcb-c0b5-465d-84ec-6cd64e5b5e0a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:19.145390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f8a5bcb-c0b5-465d-84ec-6cd64e5b5e0a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:19.146997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f8a5bcb-c0b5-465d-84ec-6cd64e5b5e0a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:19.153272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f8a5bcb-c0b5-465d-84ec-6cd64e5b5e0a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:19.154108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f8a5bcb-c0b5-465d-84ec-6cd64e5b5e0a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:19.154609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f8a5bcb-c0b5-465d-84ec-6cd64e5b5e0a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:19.155061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f8a5bcb-c0b5-465d-84ec-6cd64e5b5e0a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:19.242130 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f8a5bcb-c0b5-465d-84ec-6cd64e5b5e0a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:19.242914 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f8a5bcb-c0b5-465d-84ec-6cd64e5b5e0a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:19.244061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f8a5bcb-c0b5-465d-84ec-6cd64e5b5e0a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:19.244854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-1f8a5bcb-c0b5-465d-84ec-6cd64e5b5e0a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lazy-loading 'fault' on Instance uuid 8817b2e5-125e-455f-9c44-e0f46786b5fa {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:39:19.254395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f67f2e55-ffd1-4b96-8bcd-ac7dee99be24 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:19.284686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f67f2e55-ffd1-4b96-8bcd-ac7dee99be24 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:19.291116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f67f2e55-ffd1-4b96-8bcd-ac7dee99be24 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:19.301243 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f67f2e55-ffd1-4b96-8bcd-ac7dee99be24 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1486 microversion: 2.25 time: 0.801502 Sep 07 12:39:19.308864 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1115/2170] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:39:18 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1486 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:39:19.315767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-6add03f3-85f1-47a9-ab77-4d9b661c6b1d req-10b658fe-8179-4ab3-a8d1-715b3507ec68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8817b2e5-125e-455f-9c44-e0f46786b5fa", "name": "network-vif-deleted", "tag": "f2fda9ed-aa0e-41f8-a289-5e6679639d1e"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:39:19.331466 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6add03f3-85f1-47a9-ab77-4d9b661c6b1d req-10b658fe-8179-4ab3-a8d1-715b3507ec68 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:19.332957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6add03f3-85f1-47a9-ab77-4d9b661c6b1d req-10b658fe-8179-4ab3-a8d1-715b3507ec68 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:19.333889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6add03f3-85f1-47a9-ab77-4d9b661c6b1d req-10b658fe-8179-4ab3-a8d1-715b3507ec68 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:19.360098 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-6add03f3-85f1-47a9-ab77-4d9b661c6b1d req-10b658fe-8179-4ab3-a8d1-715b3507ec68 service nova] Creating event network-vif-deleted:f2fda9ed-aa0e-41f8-a289-5e6679639d1e for instance 8817b2e5-125e-455f-9c44-e0f46786b5fa on n-h1-852087-9 Sep 07 12:39:19.366534 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-6add03f3-85f1-47a9-ab77-4d9b661c6b1d req-10b658fe-8179-4ab3-a8d1-715b3507ec68 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055880 Sep 07 12:39:19.367601 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1116/2171] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:39:19.375955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2ea3bfc8-c0a2-4ef2-a5ab-03c3303788a0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:19.376976 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2ea3bfc8-c0a2-4ef2-a5ab-03c3303788a0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 657ffafe-1185-4cf0-9f75-e574bc2405e2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:19.410257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1f8a5bcb-c0b5-465d-84ec-6cd64e5b5e0a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41979e405fab49029d8ff5a9903e36ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc00ac02c77f40f5ab6acbe538c9566b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:19.426599 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1f8a5bcb-c0b5-465d-84ec-6cd64e5b5e0a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa" status: 200 len: 1314 microversion: 2.1 time: 0.371536 Sep 07 12:39:19.432756 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1056/2172] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:19 2022] GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:19.448043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8a1b5eb3-cedd-428c-a138-e8936bb68174 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:19.454608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ea3bfc8-c0a2-4ef2-a5ab-03c3303788a0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:19.455692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8a1b5eb3-cedd-428c-a138-e8936bb68174 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: 498a719e-d642-4e9c-9951-d6aacb0a16db] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:19.458276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ea3bfc8-c0a2-4ef2-a5ab-03c3303788a0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:19.458971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ea3bfc8-c0a2-4ef2-a5ab-03c3303788a0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:19.461879 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ea3bfc8-c0a2-4ef2-a5ab-03c3303788a0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:19.464370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ea3bfc8-c0a2-4ef2-a5ab-03c3303788a0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:19.471352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ea3bfc8-c0a2-4ef2-a5ab-03c3303788a0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:19.482979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a1b5eb3-cedd-428c-a138-e8936bb68174 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:19.483766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a1b5eb3-cedd-428c-a138-e8936bb68174 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:19.484425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a1b5eb3-cedd-428c-a138-e8936bb68174 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:19.485203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a1b5eb3-cedd-428c-a138-e8936bb68174 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:19.485729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a1b5eb3-cedd-428c-a138-e8936bb68174 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:19.486337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a1b5eb3-cedd-428c-a138-e8936bb68174 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:19.649275 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8a1b5eb3-cedd-428c-a138-e8936bb68174 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:19.665301 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8a1b5eb3-cedd-428c-a138-e8936bb68174 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db" status: 200 len: 1275 microversion: 2.1 time: 0.231072 Sep 07 12:39:19.668137 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1057/2173] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:19 2022] GET /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db => generated 1275 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:19.699474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4e901e8b-ff4d-48be-9fe0-be6dde747a98 tempest-FloatingIPDetailsTestJSON-1513360368 tempest-FloatingIPDetailsTestJSON-1513360368-project] Calling method '.version_select at 0x7fc4189cfdc0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:19.826328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2ea3bfc8-c0a2-4ef2-a5ab-03c3303788a0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:19.842708 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2ea3bfc8-c0a2-4ef2-a5ab-03c3303788a0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/657ffafe-1185-4cf0-9f75-e574bc2405e2" status: 200 len: 1218 microversion: 2.1 time: 0.473543 Sep 07 12:39:19.846879 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1117/2174] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:19 2022] GET /compute/v2.1/servers/657ffafe-1185-4cf0-9f75-e574bc2405e2 => generated 1218 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:19.854660 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8cc2b431-544f-4350-883e-4a8799a17405 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1667916161"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:39:19.862910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8cc2b431-544f-4350-883e-4a8799a17405 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 9f506502-b414-408e-b36a-a61e27b58980] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:19.884574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc2b431-544f-4350-883e-4a8799a17405 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:19.888436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc2b431-544f-4350-883e-4a8799a17405 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:19.890830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc2b431-544f-4350-883e-4a8799a17405 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:19.892532 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc2b431-544f-4350-883e-4a8799a17405 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:19.895758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc2b431-544f-4350-883e-4a8799a17405 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:19.896963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc2b431-544f-4350-883e-4a8799a17405 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:20.316835 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4e901e8b-ff4d-48be-9fe0-be6dde747a98 tempest-FloatingIPDetailsTestJSON-1513360368 tempest-FloatingIPDetailsTestJSON-1513360368-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.646841 Sep 07 12:39:20.319145 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1058/2175] 10.222.0.16 () {58 vars in 1164 bytes} [Wed Sep 7 12:39:19 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:39:20.347861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cc8ec36a-86c4-492d-9c5e-500588cd5190 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:20.348569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cc8ec36a-86c4-492d-9c5e-500588cd5190 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 657ffafe-1185-4cf0-9f75-e574bc2405e2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:20.403179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc8ec36a-86c4-492d-9c5e-500588cd5190 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:20.411038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc8ec36a-86c4-492d-9c5e-500588cd5190 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:20.414479 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc8ec36a-86c4-492d-9c5e-500588cd5190 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:20.420268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc8ec36a-86c4-492d-9c5e-500588cd5190 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:20.420816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc8ec36a-86c4-492d-9c5e-500588cd5190 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:20.425562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc8ec36a-86c4-492d-9c5e-500588cd5190 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:20.575808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cc8ec36a-86c4-492d-9c5e-500588cd5190 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 657ffafe-1185-4cf0-9f75-e574bc2405e2] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:39:20.656415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc8ec36a-86c4-492d-9c5e-500588cd5190 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:20.664325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc8ec36a-86c4-492d-9c5e-500588cd5190 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:20.668523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc8ec36a-86c4-492d-9c5e-500588cd5190 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:20.702191 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8cc2b431-544f-4350-883e-4a8799a17405 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "POST /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980/action" status: 202 len: 0 microversion: 2.1 time: 0.855953 Sep 07 12:39:20.702191 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1118/2176] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:39:19 2022] POST /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980/action => generated 0 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 07 12:39:20.718358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd10ae03-e46d-4d7b-873b-29de952d3f4b tempest-FloatingIPDetailsTestJSON-1513360368 tempest-FloatingIPDetailsTestJSON-1513360368-project] Calling method '.version_select at 0x7fc4192e5ee0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:20.791869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-cc8ec36a-86c4-492d-9c5e-500588cd5190 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lazy-loading 'flavor' on Instance uuid 657ffafe-1185-4cf0-9f75-e574bc2405e2 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:39:20.865969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-cc8ec36a-86c4-492d-9c5e-500588cd5190 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lazy-loading 'system_metadata' on Instance uuid 657ffafe-1185-4cf0-9f75-e574bc2405e2 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:39:21.155309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-cc8ec36a-86c4-492d-9c5e-500588cd5190 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lazy-loading 'metadata' on Instance uuid 657ffafe-1185-4cf0-9f75-e574bc2405e2 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:39:21.798078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc8ec36a-86c4-492d-9c5e-500588cd5190 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:21.800150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc8ec36a-86c4-492d-9c5e-500588cd5190 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:21.804632 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc8ec36a-86c4-492d-9c5e-500588cd5190 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:22.271816 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cc8ec36a-86c4-492d-9c5e-500588cd5190 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "DELETE /compute/v2.1/servers/657ffafe-1185-4cf0-9f75-e574bc2405e2" status: 204 len: 0 microversion: 2.1 time: 1.949935 Sep 07 12:39:22.275884 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1059/2177] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:39:20 2022] DELETE /compute/v2.1/servers/657ffafe-1185-4cf0-9f75-e574bc2405e2 => generated 0 bytes in 1956 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:39:22.294091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-85ca1782-01f8-4dd5-8da3-807099dd3224 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:22.312337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-85ca1782-01f8-4dd5-8da3-807099dd3224 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:22.324940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85ca1782-01f8-4dd5-8da3-807099dd3224 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:22.325867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85ca1782-01f8-4dd5-8da3-807099dd3224 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:22.326623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85ca1782-01f8-4dd5-8da3-807099dd3224 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:22.328207 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85ca1782-01f8-4dd5-8da3-807099dd3224 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:22.329043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85ca1782-01f8-4dd5-8da3-807099dd3224 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:22.329839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85ca1782-01f8-4dd5-8da3-807099dd3224 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:22.786825 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dd10ae03-e46d-4d7b-873b-29de952d3f4b tempest-FloatingIPDetailsTestJSON-1513360368 tempest-FloatingIPDetailsTestJSON-1513360368-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 396 microversion: 2.1 time: 2.076610 Sep 07 12:39:22.787567 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1119/2178] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Sep 7 12:39:20 2022] GET /compute/v2.1/os-floating-ips => generated 396 bytes in 2085 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:39:22.807406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b37828fe-0f78-452d-bb77-3d559970217a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:22.807651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b37828fe-0f78-452d-bb77-3d559970217a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] [instance: 8817b2e5-125e-455f-9c44-e0f46786b5fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:22.811191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:39:22.824364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b37828fe-0f78-452d-bb77-3d559970217a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:22.824883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b37828fe-0f78-452d-bb77-3d559970217a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:22.825341 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b37828fe-0f78-452d-bb77-3d559970217a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:22.826126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b37828fe-0f78-452d-bb77-3d559970217a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:22.826598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b37828fe-0f78-452d-bb77-3d559970217a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:22.827039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b37828fe-0f78-452d-bb77-3d559970217a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:22.870524 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-b37828fe-0f78-452d-bb77-3d559970217a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] HTTP exception thrown: Instance 8817b2e5-125e-455f-9c44-e0f46786b5fa could not be found. Sep 07 12:39:22.872353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b37828fe-0f78-452d-bb77-3d559970217a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Request method failure captured: Sep 07 12:39:22.872353 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa HTTP/1.1 Sep 07 12:39:22.872353 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:39:22.872353 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:39:22.872353 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:39:22.872353 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:39:22.872353 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:39:22.872353 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:39:22.872353 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:39:22.872353 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:39:22.872353 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJBlqcLWGgP5YaSpRRip8sl6ENs86mQ2ZB5Esr_BbiPs2BPnzmI-e2CcMwry9HQsHE_7xTrPaxjrWyCCdxwjB586GVAzp9zrLJ93cY3nFhJZpwBkdDlKcORaqKagI-NfztXwSU5mWdQXi_cefHqVkeBlPPo7irch_gvMM3WMDfixR9Y Sep 07 12:39:22.872353 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:39:22.872353 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:39:22.872353 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:39:22.872353 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:39:22.872353 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:39:22.872353 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:39:22.872353 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: dc00ac02c77f40f5ab6acbe538c9566b Sep 07 12:39:22.872353 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-15279073 Sep 07 12:39:22.872353 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:39:22.872353 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:39:22.873457 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dc00ac02c77f40f5ab6acbe538c9566b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dc00ac02c77f40f5ab6acbe538c9566b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dc00ac02c77f40f5ab6acbe538c9566b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dc00ac02c77f40f5ab6acbe538c9566b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:39:22.873457 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-15279073 Sep 07 12:39:22.873457 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: dc00ac02c77f40f5ab6acbe538c9566b Sep 07 12:39:22.873457 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-15279073 Sep 07 12:39:22.873457 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-FloatingIPsAssociationTestJSON-15279073-project Sep 07 12:39:22.873457 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:39:22.873457 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:39:22.873457 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 41979e405fab49029d8ff5a9903e36ea Sep 07 12:39:22.873457 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-15279073-project Sep 07 12:39:22.873457 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:39:22.873457 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 8817b2e5-125e-455f-9c44-e0f46786b5fa could not be found. Sep 07 12:39:22.873457 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '8817b2e5-125e-455f-9c44-e0f46786b5fa'} Sep 07 12:39:22.874421 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:39:22.874421 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:22.874421 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:39:22.874421 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:39:22.874421 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:39:22.874421 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:39:22.874421 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:39:22.874421 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:39:22.874421 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:39:22.874421 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:39:22.874421 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8817b2e5-125e-455f-9c44-e0f46786b5fa could not be found. Sep 07 12:39:22.874421 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:22.874421 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:22.874421 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:22.874421 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:22.874421 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:22.874421 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:22.874421 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:39:22.874421 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:39:22.874421 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:39:22.875440 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:39:22.875440 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:39:22.875440 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:39:22.875440 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:39:22.875440 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:39:22.875440 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:39:22.875440 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:39:22.875440 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8817b2e5-125e-455f-9c44-e0f46786b5fa could not be found. Sep 07 12:39:22.875440 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:22.875440 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:22.875440 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:22.875440 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:22.875440 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:22.875440 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:22.875440 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:39:22.875440 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:39:22.875440 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8817b2e5-125e-455f-9c44-e0f46786b5fa could not be found. Sep 07 12:39:22.875440 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:22.876311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b37828fe-0f78-452d-bb77-3d559970217a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] Returning 404 to user: Instance 8817b2e5-125e-455f-9c44-e0f46786b5fa could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:39:22.876311 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b37828fe-0f78-452d-bb77-3d559970217a tempest-FloatingIPsAssociationTestJSON-15279073 tempest-FloatingIPsAssociationTestJSON-15279073-project] 10.222.0.16 "GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa" status: 404 len: 111 microversion: 2.1 time: 0.085327 Sep 07 12:39:22.879831 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1120/2179] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:22 2022] GET /compute/v2.1/servers/8817b2e5-125e-455f-9c44-e0f46786b5fa => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:39:22.906131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7a2d84cd-b8d3-4508-b968-69a437f98795 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:22.906776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7a2d84cd-b8d3-4508-b968-69a437f98795 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: 498a719e-d642-4e9c-9951-d6aacb0a16db] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:22.927979 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a2d84cd-b8d3-4508-b968-69a437f98795 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:22.928484 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a2d84cd-b8d3-4508-b968-69a437f98795 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:22.928936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a2d84cd-b8d3-4508-b968-69a437f98795 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:22.929750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a2d84cd-b8d3-4508-b968-69a437f98795 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:22.930225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a2d84cd-b8d3-4508-b968-69a437f98795 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:22.930686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a2d84cd-b8d3-4508-b968-69a437f98795 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:23.430926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7a2d84cd-b8d3-4508-b968-69a437f98795 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:23.464507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-85ca1782-01f8-4dd5-8da3-807099dd3224 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:23.474330 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7a2d84cd-b8d3-4508-b968-69a437f98795 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db" status: 200 len: 1281 microversion: 2.1 time: 0.592385 Sep 07 12:39:23.475401 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1121/2180] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:22 2022] GET /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db => generated 1281 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:23.479758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-85ca1782-01f8-4dd5-8da3-807099dd3224 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:23.481272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-85ca1782-01f8-4dd5-8da3-807099dd3224 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:23.482567 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-85ca1782-01f8-4dd5-8da3-807099dd3224 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1476 microversion: 2.25 time: 1.204231 Sep 07 12:39:23.493950 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1060/2181] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:39:22 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1476 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:39:23.510051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bbe2ba5f-f023-4017-9bdc-6e869b2626c2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:23.510051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bbe2ba5f-f023-4017-9bdc-6e869b2626c2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 657ffafe-1185-4cf0-9f75-e574bc2405e2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:23.513751 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-34a42655-10ad-4b5e-a716-fdb839d07a57 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc4192fda60>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:23.536027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbe2ba5f-f023-4017-9bdc-6e869b2626c2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:23.536027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbe2ba5f-f023-4017-9bdc-6e869b2626c2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:23.536027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbe2ba5f-f023-4017-9bdc-6e869b2626c2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:23.536509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbe2ba5f-f023-4017-9bdc-6e869b2626c2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:23.536728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbe2ba5f-f023-4017-9bdc-6e869b2626c2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:23.537172 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbe2ba5f-f023-4017-9bdc-6e869b2626c2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:23.639607 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-34a42655-10ad-4b5e-a716-fdb839d07a57 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/357652e0-7aac-465e-8092-8ba8f553ed7c" status: 200 len: 1412 microversion: 2.1 time: 0.162272 Sep 07 12:39:23.640594 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1122/2182] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:39:23 2022] GET /compute/v2.1/images/357652e0-7aac-465e-8092-8ba8f553ed7c => generated 1412 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:23.655595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e56b7c4-2d70-4b6f-bb3c-2a9abea966dd tempest-FloatingIPDetailsTestJSON-1513360368 tempest-FloatingIPDetailsTestJSON-1513360368-project] Calling method '.version_select at 0x7fc419cadb80>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:23.813147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bbe2ba5f-f023-4017-9bdc-6e869b2626c2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:23.833028 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bbe2ba5f-f023-4017-9bdc-6e869b2626c2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/657ffafe-1185-4cf0-9f75-e574bc2405e2" status: 200 len: 1272 microversion: 2.1 time: 0.338506 Sep 07 12:39:23.834942 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1061/2183] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:23 2022] GET /compute/v2.1/servers/657ffafe-1185-4cf0-9f75-e574bc2405e2 => generated 1272 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:23.845745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-38bfe399-969f-475e-86b4-71223abc2834 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Calling method '.version_select at 0x7fc418a260d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:23.856331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38bfe399-969f-475e-86b4-71223abc2834 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:23.857871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38bfe399-969f-475e-86b4-71223abc2834 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:23.859270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38bfe399-969f-475e-86b4-71223abc2834 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:23.886991 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-38bfe399-969f-475e-86b4-71223abc2834 tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1944 microversion: 2.25 time: 0.049709 Sep 07 12:39:23.889212 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1062/2184] 10.222.0.16 () {60 vars in 1184 bytes} [Wed Sep 7 12:39:23 2022] GET /compute/v2.1/os-migrations => generated 1944 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:39:23.908673 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-017b0565-b661-48d1-843f-aa9f0322599b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc418954790>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:23.980810 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-017b0565-b661-48d1-843f-aa9f0322599b tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/357652e0-7aac-465e-8092-8ba8f553ed7c" status: 200 len: 1412 microversion: 2.1 time: 0.089656 Sep 07 12:39:23.982980 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1063/2185] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:39:23 2022] GET /compute/v2.1/images/357652e0-7aac-465e-8092-8ba8f553ed7c => generated 1412 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:23.999072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-04b3688c-d336-4afa-93f1-6a7f1e84ba1d tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:23.999818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-04b3688c-d336-4afa-93f1-6a7f1e84ba1d tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:24.009258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04b3688c-d336-4afa-93f1-6a7f1e84ba1d tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:24.009849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04b3688c-d336-4afa-93f1-6a7f1e84ba1d tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:24.010402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04b3688c-d336-4afa-93f1-6a7f1e84ba1d tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:24.012003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04b3688c-d336-4afa-93f1-6a7f1e84ba1d tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:24.012195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04b3688c-d336-4afa-93f1-6a7f1e84ba1d tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:24.012753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04b3688c-d336-4afa-93f1-6a7f1e84ba1d tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:24.698158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-04b3688c-d336-4afa-93f1-6a7f1e84ba1d tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] Lazy-loading 'services' on Instance uuid 7c2a1933-970b-4c7d-a4b9-25cbc6f34768 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:39:24.725187 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-04b3688c-d336-4afa-93f1-6a7f1e84ba1d tempest-LiveAutoBlockMigrationV225Test-1341887081 tempest-LiveAutoBlockMigrationV225Test-1341887081-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1969 microversion: 2.25 time: 0.729839 Sep 07 12:39:24.726131 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1064/2186] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:39:23 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1969 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:39:24.748947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-03ea219b-c2c9-4f26-817f-c269717f5284 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc418a48310>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:25.052230 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-03ea219b-c2c9-4f26-817f-c269717f5284 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "DELETE /compute/v2.1/images/357652e0-7aac-465e-8092-8ba8f553ed7c" status: 204 len: 0 microversion: 2.1 time: 0.320260 Sep 07 12:39:25.053927 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1065/2187] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:24 2022] DELETE /compute/v2.1/images/357652e0-7aac-465e-8092-8ba8f553ed7c => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:39:25.059562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0c60eb1b-8cb8-4899-9583-d4df976f28fb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:25.060191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0c60eb1b-8cb8-4899-9583-d4df976f28fb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: 498a719e-d642-4e9c-9951-d6aacb0a16db] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:25.074843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c60eb1b-8cb8-4899-9583-d4df976f28fb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:25.076464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c60eb1b-8cb8-4899-9583-d4df976f28fb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:25.078282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c60eb1b-8cb8-4899-9583-d4df976f28fb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:25.080392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c60eb1b-8cb8-4899-9583-d4df976f28fb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:25.081640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c60eb1b-8cb8-4899-9583-d4df976f28fb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:25.082897 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c60eb1b-8cb8-4899-9583-d4df976f28fb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:25.417411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0c60eb1b-8cb8-4899-9583-d4df976f28fb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:25.470069 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0c60eb1b-8cb8-4899-9583-d4df976f28fb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db" status: 200 len: 1281 microversion: 2.1 time: 0.410859 Sep 07 12:39:25.488227 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1066/2188] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:25 2022] GET /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db => generated 1281 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:25.538459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-721782e5-fabd-4503-bfbd-0381c325c528 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:25.541532 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-721782e5-fabd-4503-bfbd-0381c325c528 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:25.583279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-721782e5-fabd-4503-bfbd-0381c325c528 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:25.583581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-721782e5-fabd-4503-bfbd-0381c325c528 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:25.584310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-721782e5-fabd-4503-bfbd-0381c325c528 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:25.592166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-721782e5-fabd-4503-bfbd-0381c325c528 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:25.595613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-721782e5-fabd-4503-bfbd-0381c325c528 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:25.596573 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-721782e5-fabd-4503-bfbd-0381c325c528 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:25.717778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-721782e5-fabd-4503-bfbd-0381c325c528 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:39:25.754955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:39:26.044944 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-721782e5-fabd-4503-bfbd-0381c325c528 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 204 len: 0 microversion: 2.25 time: 0.544971 Sep 07 12:39:26.047742 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1067/2189] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 12:39:25 2022] DELETE /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:39:26.073752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-584733a1-3121-4094-878b-1081001e0ec2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:26.074511 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-584733a1-3121-4094-878b-1081001e0ec2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 657ffafe-1185-4cf0-9f75-e574bc2405e2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:26.095469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-584733a1-3121-4094-878b-1081001e0ec2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:26.099527 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-584733a1-3121-4094-878b-1081001e0ec2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:26.100357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-584733a1-3121-4094-878b-1081001e0ec2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:26.104827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-584733a1-3121-4094-878b-1081001e0ec2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:26.105692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-584733a1-3121-4094-878b-1081001e0ec2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:26.109541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-584733a1-3121-4094-878b-1081001e0ec2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:26.399808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-584733a1-3121-4094-878b-1081001e0ec2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:26.432745 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-584733a1-3121-4094-878b-1081001e0ec2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/657ffafe-1185-4cf0-9f75-e574bc2405e2" status: 200 len: 1216 microversion: 2.1 time: 0.379536 Sep 07 12:39:26.442649 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1068/2190] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:26 2022] GET /compute/v2.1/servers/657ffafe-1185-4cf0-9f75-e574bc2405e2 => generated 1216 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:26.451760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-db73c3a7-7f59-4299-9c17-453c040f8273 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc418a48310>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:26.518919 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-db73c3a7-7f59-4299-9c17-453c040f8273 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] HTTP exception thrown: Image not found. Sep 07 12:39:26.526694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-db73c3a7-7f59-4299-9c17-453c040f8273 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Request method failure captured: Sep 07 12:39:26.526694 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/images/357652e0-7aac-465e-8092-8ba8f553ed7c HTTP/1.1 Sep 07 12:39:26.526694 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:39:26.526694 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:39:26.526694 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:39:26.526694 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:39:26.526694 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:39:26.526694 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:39:26.526694 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:39:26.526694 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:39:26.526694 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI-kQlfcQLorACLQzdYtTfLAYjfzfZ67NLxGmgmKh_xWpac_ei5BT0p7WvRJTQ3OQF_BdKtmk4joe0cgrH1-wFRs4eGPQulhjs6MHBSe19hGr65toe3mL7J9K1C64pnxZIXjdFUI_d7Wy_9-l_t6DtRgirXJxRZFWdrA29tgdfNHFlg Sep 07 12:39:26.526694 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:39:26.526694 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:39:26.526694 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:39:26.526694 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:39:26.526694 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:39:26.526694 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:39:26.526694 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 081286d7e4664e239ace13466a4a9c50 Sep 07 12:39:26.526694 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesTestJSON-627407633 Sep 07 12:39:26.526694 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:39:26.526694 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:39:26.529100 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_081286d7e4664e239ace13466a4a9c50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:39:26.529100 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesTestJSON-627407633 Sep 07 12:39:26.529100 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 081286d7e4664e239ace13466a4a9c50 Sep 07 12:39:26.529100 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesTestJSON-627407633 Sep 07 12:39:26.529100 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ImagesTestJSON-627407633-project Sep 07 12:39:26.529100 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:39:26.529100 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:39:26.529100 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 3d68cf87771f4e9f9caab95adf58b129 Sep 07 12:39:26.529100 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesTestJSON-627407633-project Sep 07 12:39:26.529100 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:39:26.529100 n-d-852087-9 devstack@n-api.service[122433]: exception: Image not found. Sep 07 12:39:26.529100 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '357652e0-7aac-465e-8092-8ba8f553ed7c'} Sep 07 12:39:26.529100 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:39:26.529100 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:26.530695 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 12:39:26.530695 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 12:39:26.530695 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:39:26.530695 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:39:26.530695 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 12:39:26.530695 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 12:39:26.530695 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:39:26.530695 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:39:26.530695 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 12:39:26.530695 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 12:39:26.530695 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 12:39:26.530695 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 12:39:26.530695 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:39:26.530695 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:39:26.530695 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:39:26.530695 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:39:26.530695 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 357652e0-7aac-465e-8092-8ba8f553ed7c Sep 07 12:39:26.530695 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:26.532461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:26.532461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:26.532461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:26.532461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 07 12:39:26.532461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 07 12:39:26.532461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 07 12:39:26.532461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 07 12:39:26.532461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 07 12:39:26.532461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 07 12:39:26.532461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 07 12:39:26.532461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 07 12:39:26.532461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 12:39:26.532461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 12:39:26.532461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:39:26.532461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:39:26.532461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 12:39:26.532461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 12:39:26.532461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:39:26.532461 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:39:26.534281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 12:39:26.534281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 12:39:26.534281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 12:39:26.534281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 12:39:26.534281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:39:26.534281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:39:26.534281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:39:26.534281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:39:26.534281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 357652e0-7aac-465e-8092-8ba8f553ed7c could not be found. Sep 07 12:39:26.534281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:26.534281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:26.534281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:26.534281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:26.534281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:26.534281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:26.534281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:39:26.534281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:39:26.534281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:39:26.534281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:39:26.535884 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:39:26.535884 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:39:26.535884 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 07 12:39:26.535884 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 12:39:26.535884 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 12:39:26.535884 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:26.535884 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:26.535884 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:26.535884 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:26.535884 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:26.535884 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:26.535884 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:39:26.535884 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:39:26.535884 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 12:39:26.535884 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:26.535884 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-db73c3a7-7f59-4299-9c17-453c040f8273 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Returning 404 to user: Image not found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:39:26.535884 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-db73c3a7-7f59-4299-9c17-453c040f8273 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/images/357652e0-7aac-465e-8092-8ba8f553ed7c" status: 404 len: 62 microversion: 2.1 time: 0.084713 Sep 07 12:39:26.537564 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1069/2191] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:39:26 2022] GET /compute/v2.1/images/357652e0-7aac-465e-8092-8ba8f553ed7c => generated 62 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:39:26.541823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fb36ab2c-6071-4c93-abea-8ca740484f17 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:26.542998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fb36ab2c-6071-4c93-abea-8ca740484f17 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:26.559410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb36ab2c-6071-4c93-abea-8ca740484f17 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:26.560410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb36ab2c-6071-4c93-abea-8ca740484f17 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:26.561204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb36ab2c-6071-4c93-abea-8ca740484f17 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:26.562548 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb36ab2c-6071-4c93-abea-8ca740484f17 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:26.563417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb36ab2c-6071-4c93-abea-8ca740484f17 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:26.564162 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb36ab2c-6071-4c93-abea-8ca740484f17 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:27.382912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=12 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:39:27.587292 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6e56b7c4-2d70-4b6f-bb3c-2a9abea966dd tempest-FloatingIPDetailsTestJSON-1513360368 tempest-FloatingIPDetailsTestJSON-1513360368-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/1be94b9a-48a7-420a-bc5e-cfdb12d947b6" status: 202 len: 0 microversion: 2.1 time: 3.945505 Sep 07 12:39:27.593149 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1123/2192] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Sep 7 12:39:23 2022] DELETE /compute/v2.1/os-floating-ips/1be94b9a-48a7-420a-bc5e-cfdb12d947b6 => generated 0 bytes in 3952 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:39:27.597557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fb36ab2c-6071-4c93-abea-8ca740484f17 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:27.600099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:39:27.601318 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0941495d-3b41-40a3-88f6-21b3e9b96854 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:27.603791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0941495d-3b41-40a3-88f6-21b3e9b96854 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: 498a719e-d642-4e9c-9951-d6aacb0a16db] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:27.611344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0941495d-3b41-40a3-88f6-21b3e9b96854 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:27.612173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0941495d-3b41-40a3-88f6-21b3e9b96854 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:27.613088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0941495d-3b41-40a3-88f6-21b3e9b96854 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:27.614061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fb36ab2c-6071-4c93-abea-8ca740484f17 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:27.614779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0941495d-3b41-40a3-88f6-21b3e9b96854 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:27.615420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0941495d-3b41-40a3-88f6-21b3e9b96854 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:27.616008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0941495d-3b41-40a3-88f6-21b3e9b96854 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:27.617667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fb36ab2c-6071-4c93-abea-8ca740484f17 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:27.619014 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fb36ab2c-6071-4c93-abea-8ca740484f17 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1482 microversion: 2.25 time: 1.086622 Sep 07 12:39:27.622666 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1070/2193] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:39:26 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1482 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:39:27.629354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2cfb018b-ca34-4126-bb2c-296f5036cfdc tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:27.630436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2cfb018b-ca34-4126-bb2c-296f5036cfdc tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 9f506502-b414-408e-b36a-a61e27b58980] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:27.638136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cfb018b-ca34-4126-bb2c-296f5036cfdc tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:27.638958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cfb018b-ca34-4126-bb2c-296f5036cfdc tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:27.639555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cfb018b-ca34-4126-bb2c-296f5036cfdc tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:27.640523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cfb018b-ca34-4126-bb2c-296f5036cfdc tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:27.641150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cfb018b-ca34-4126-bb2c-296f5036cfdc tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:27.641764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cfb018b-ca34-4126-bb2c-296f5036cfdc tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:27.766704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0941495d-3b41-40a3-88f6-21b3e9b96854 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:27.789098 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0941495d-3b41-40a3-88f6-21b3e9b96854 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db" status: 200 len: 1281 microversion: 2.1 time: 0.193519 Sep 07 12:39:27.791592 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1124/2194] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:27 2022] GET /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db => generated 1281 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:27.811603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-15bac652-ec09-4d72-9568-3c883ba54ebb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:27.814064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-15bac652-ec09-4d72-9568-3c883ba54ebb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 657ffafe-1185-4cf0-9f75-e574bc2405e2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:27.833304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15bac652-ec09-4d72-9568-3c883ba54ebb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:27.834802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15bac652-ec09-4d72-9568-3c883ba54ebb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:27.836048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15bac652-ec09-4d72-9568-3c883ba54ebb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:27.838299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15bac652-ec09-4d72-9568-3c883ba54ebb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:27.839621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15bac652-ec09-4d72-9568-3c883ba54ebb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:27.840583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15bac652-ec09-4d72-9568-3c883ba54ebb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:28.533368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-15bac652-ec09-4d72-9568-3c883ba54ebb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:28.543480 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-15bac652-ec09-4d72-9568-3c883ba54ebb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/657ffafe-1185-4cf0-9f75-e574bc2405e2" status: 200 len: 1218 microversion: 2.1 time: 0.749586 Sep 07 12:39:28.551569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2cfb018b-ca34-4126-bb2c-296f5036cfdc tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:28.554219 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1125/2195] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:27 2022] GET /compute/v2.1/servers/657ffafe-1185-4cf0-9f75-e574bc2405e2 => generated 1218 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:28.567077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea676829-3502-4f04-ab92-be488206a403 tempest-FloatingIPDetailsTestJSON-1513360368 tempest-FloatingIPDetailsTestJSON-1513360368-project] Calling method '.version_select at 0x7fc4191fc820>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:28.576282 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2cfb018b-ca34-4126-bb2c-296f5036cfdc tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980" status: 200 len: 1506 microversion: 2.1 time: 0.951776 Sep 07 12:39:28.578339 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1071/2196] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:27 2022] GET /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980 => generated 1506 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:28.586757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-bf4ce49b-f0eb-4e87-a273-7c783c446f69 req-4ddb02b2-1ffb-4e3e-9abe-2652cb5e6f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f506502-b414-408e-b36a-a61e27b58980", "name": "network-vif-plugged", "status": "completed", "tag": "6e1353d6-2e43-4cdf-b8a5-622fd6963e0e"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:39:28.615080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bf4ce49b-f0eb-4e87-a273-7c783c446f69 req-4ddb02b2-1ffb-4e3e-9abe-2652cb5e6f17 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:28.620948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bf4ce49b-f0eb-4e87-a273-7c783c446f69 req-4ddb02b2-1ffb-4e3e-9abe-2652cb5e6f17 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:28.622541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bf4ce49b-f0eb-4e87-a273-7c783c446f69 req-4ddb02b2-1ffb-4e3e-9abe-2652cb5e6f17 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:28.647872 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-bf4ce49b-f0eb-4e87-a273-7c783c446f69 req-4ddb02b2-1ffb-4e3e-9abe-2652cb5e6f17 service nova] Creating event network-vif-plugged:6e1353d6-2e43-4cdf-b8a5-622fd6963e0e for instance 9f506502-b414-408e-b36a-a61e27b58980 on n-h1-852087-9 Sep 07 12:39:28.658015 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-bf4ce49b-f0eb-4e87-a273-7c783c446f69 req-4ddb02b2-1ffb-4e3e-9abe-2652cb5e6f17 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077269 Sep 07 12:39:28.660000 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1072/2197] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:39:28.679299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2e4a4264-149b-4b7d-b606-9e592439402c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:28.680704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2e4a4264-149b-4b7d-b606-9e592439402c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:28.694240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e4a4264-149b-4b7d-b606-9e592439402c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:28.695373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e4a4264-149b-4b7d-b606-9e592439402c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:28.696337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e4a4264-149b-4b7d-b606-9e592439402c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:28.697947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e4a4264-149b-4b7d-b606-9e592439402c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:28.698874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e4a4264-149b-4b7d-b606-9e592439402c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:28.699846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e4a4264-149b-4b7d-b606-9e592439402c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:30.101905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2e4a4264-149b-4b7d-b606-9e592439402c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:30.119546 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2e4a4264-149b-4b7d-b606-9e592439402c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:30.127733 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2e4a4264-149b-4b7d-b606-9e592439402c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:30.129154 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2e4a4264-149b-4b7d-b606-9e592439402c tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1482 microversion: 2.25 time: 1.459076 Sep 07 12:39:30.134465 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1073/2198] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:39:28 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1482 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:39:30.142754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f00f1352-959e-4739-9b0c-84473f7af6ff tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:30.147114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f00f1352-959e-4739-9b0c-84473f7af6ff tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: 498a719e-d642-4e9c-9951-d6aacb0a16db] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:30.170701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f00f1352-959e-4739-9b0c-84473f7af6ff tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:30.171368 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f00f1352-959e-4739-9b0c-84473f7af6ff tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:30.172020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f00f1352-959e-4739-9b0c-84473f7af6ff tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:30.172887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f00f1352-959e-4739-9b0c-84473f7af6ff tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:30.173525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f00f1352-959e-4739-9b0c-84473f7af6ff tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:30.174075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f00f1352-959e-4739-9b0c-84473f7af6ff tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:30.512875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f00f1352-959e-4739-9b0c-84473f7af6ff tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:30.545978 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f00f1352-959e-4739-9b0c-84473f7af6ff tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db" status: 200 len: 1281 microversion: 2.1 time: 0.395022 Sep 07 12:39:30.561913 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1074/2199] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:30 2022] GET /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db => generated 1281 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:30.570655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-222b246b-213a-44db-aedf-c23e9b517d75 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:30.572199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-222b246b-213a-44db-aedf-c23e9b517d75 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 657ffafe-1185-4cf0-9f75-e574bc2405e2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:30.644909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-222b246b-213a-44db-aedf-c23e9b517d75 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:30.648138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-222b246b-213a-44db-aedf-c23e9b517d75 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:30.650538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-222b246b-213a-44db-aedf-c23e9b517d75 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:30.654565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-222b246b-213a-44db-aedf-c23e9b517d75 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:30.655223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-222b246b-213a-44db-aedf-c23e9b517d75 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:30.669639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-222b246b-213a-44db-aedf-c23e9b517d75 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:30.711446 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-222b246b-213a-44db-aedf-c23e9b517d75 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] HTTP exception thrown: Instance 657ffafe-1185-4cf0-9f75-e574bc2405e2 could not be found. Sep 07 12:39:30.716026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-222b246b-213a-44db-aedf-c23e9b517d75 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Request method failure captured: Sep 07 12:39:30.716026 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/657ffafe-1185-4cf0-9f75-e574bc2405e2 HTTP/1.1 Sep 07 12:39:30.716026 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:39:30.716026 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:39:30.716026 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:39:30.716026 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:39:30.716026 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:39:30.716026 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:39:30.716026 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:39:30.716026 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:39:30.716026 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJBoiaP7MPiSaP6e6aUmMJ8PuR8TxD72E3ycIsoyb5pICiti0ZKBvrRvNoP9EgDHIO9YzOUucG9iu3oQZMsvYh9Gs4g9xjGSFcMGctGxplJk2OO0Aofdu3Ru80K0M86m3EPIBI5c12Fca4rxAASE3osSSig78ynw4pFvNNSiXm2zkBk Sep 07 12:39:30.716026 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:39:30.716026 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:39:30.716026 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:39:30.716026 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:39:30.716026 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:39:30.716026 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:39:30.716026 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:39:30.716026 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:39:30.716026 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:39:30.716026 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:39:30.718283 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef5b2dd007e944358d72268414868096"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef5b2dd007e944358d72268414868096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:39:30.718283 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:39:30.718283 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:39:30.718283 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:39:30.718283 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:39:30.718283 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:39:30.718283 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:39:30.718283 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: b920811be01745fc9faea7a9ce213c6e Sep 07 12:39:30.718283 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:39:30.718283 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:39:30.718283 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 657ffafe-1185-4cf0-9f75-e574bc2405e2 could not be found. Sep 07 12:39:30.718283 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '657ffafe-1185-4cf0-9f75-e574bc2405e2'} Sep 07 12:39:30.721234 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:39:30.721234 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:30.721234 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:39:30.721234 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:39:30.721234 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:39:30.721234 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:39:30.721234 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:39:30.721234 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:39:30.721234 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:39:30.721234 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:39:30.721234 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 657ffafe-1185-4cf0-9f75-e574bc2405e2 could not be found. Sep 07 12:39:30.721234 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:30.721234 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:30.721234 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:30.721234 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:30.721234 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:30.721234 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:30.721234 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:39:30.721234 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:39:30.721234 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:39:30.723125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:39:30.723125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:39:30.723125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:39:30.723125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:39:30.723125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:39:30.723125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:39:30.723125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:39:30.723125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 657ffafe-1185-4cf0-9f75-e574bc2405e2 could not be found. Sep 07 12:39:30.723125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:30.723125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:30.723125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:30.723125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:30.723125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:30.723125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:30.723125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:39:30.723125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:39:30.723125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 657ffafe-1185-4cf0-9f75-e574bc2405e2 could not be found. Sep 07 12:39:30.723125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:30.724210 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-222b246b-213a-44db-aedf-c23e9b517d75 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Returning 404 to user: Instance 657ffafe-1185-4cf0-9f75-e574bc2405e2 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:39:30.724210 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-222b246b-213a-44db-aedf-c23e9b517d75 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/657ffafe-1185-4cf0-9f75-e574bc2405e2" status: 404 len: 111 microversion: 2.1 time: 0.170540 Sep 07 12:39:30.731226 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1075/2200] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:30 2022] GET /compute/v2.1/servers/657ffafe-1185-4cf0-9f75-e574bc2405e2 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:39:30.743859 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-28d480be-b2cb-4706-aff4-efee1a979af2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:30.744497 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-28d480be-b2cb-4706-aff4-efee1a979af2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 9f506502-b414-408e-b36a-a61e27b58980] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:30.757866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28d480be-b2cb-4706-aff4-efee1a979af2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:30.758379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28d480be-b2cb-4706-aff4-efee1a979af2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:30.758967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28d480be-b2cb-4706-aff4-efee1a979af2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:30.759701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28d480be-b2cb-4706-aff4-efee1a979af2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:30.760162 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28d480be-b2cb-4706-aff4-efee1a979af2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:30.760596 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28d480be-b2cb-4706-aff4-efee1a979af2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:31.905411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-28d480be-b2cb-4706-aff4-efee1a979af2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:31.922286 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-28d480be-b2cb-4706-aff4-efee1a979af2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980" status: 200 len: 1501 microversion: 2.1 time: 1.188109 Sep 07 12:39:31.923001 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1076/2201] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:30 2022] GET /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980 => generated 1501 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:31.931825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-1879d632-51ec-4542-a4a9-b2b5a69d2c54 req-8e7db9d8-0c3e-41eb-a067-80513b1147e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d610675f-fc02-46f7-a980-33b6ee582c4d", "tag": "168d12f5-7490-45c8-98dc-5e5702f57370"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:39:31.982873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1879d632-51ec-4542-a4a9-b2b5a69d2c54 req-8e7db9d8-0c3e-41eb-a067-80513b1147e4 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:31.983379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1879d632-51ec-4542-a4a9-b2b5a69d2c54 req-8e7db9d8-0c3e-41eb-a067-80513b1147e4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:31.983850 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1879d632-51ec-4542-a4a9-b2b5a69d2c54 req-8e7db9d8-0c3e-41eb-a067-80513b1147e4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:32.020828 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-1879d632-51ec-4542-a4a9-b2b5a69d2c54 req-8e7db9d8-0c3e-41eb-a067-80513b1147e4 service nova] Creating event network-changed:168d12f5-7490-45c8-98dc-5e5702f57370 for instance d610675f-fc02-46f7-a980-33b6ee582c4d on n-h2-852087-9 Sep 07 12:39:32.037509 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-1879d632-51ec-4542-a4a9-b2b5a69d2c54 req-8e7db9d8-0c3e-41eb-a067-80513b1147e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107011 Sep 07 12:39:32.040351 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1077/2202] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:39:32.050922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5791863c-660e-4eba-b507-82bf2fbc50c7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-43478367", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "80d51306-dbb8-4c2e-bca9-60970c39d44b"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:39:32.223159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-5791863c-660e-4eba-b507-82bf2fbc50c7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] validate_networks() for [('80d51306-dbb8-4c2e-bca9-60970c39d44b', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:39:34.199431 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ea676829-3502-4f04-ab92-be488206a403 tempest-FloatingIPDetailsTestJSON-1513360368 tempest-FloatingIPDetailsTestJSON-1513360368-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/eea3f839-20c2-44a9-b4aa-2be0e54b5c07" status: 202 len: 0 microversion: 2.1 time: 5.640426 Sep 07 12:39:34.201974 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1126/2203] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Sep 7 12:39:28 2022] DELETE /compute/v2.1/os-floating-ips/eea3f839-20c2-44a9-b4aa-2be0e54b5c07 => generated 0 bytes in 5647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:39:34.229516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-697c9c37-2d4d-4ec6-8e4e-c6438bf69834 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:34.234864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-697c9c37-2d4d-4ec6-8e4e-c6438bf69834 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:34.272746 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-697c9c37-2d4d-4ec6-8e4e-c6438bf69834 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:34.283753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-697c9c37-2d4d-4ec6-8e4e-c6438bf69834 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:34.285223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-697c9c37-2d4d-4ec6-8e4e-c6438bf69834 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:34.286872 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-697c9c37-2d4d-4ec6-8e4e-c6438bf69834 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:34.288098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-697c9c37-2d4d-4ec6-8e4e-c6438bf69834 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:34.289332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-697c9c37-2d4d-4ec6-8e4e-c6438bf69834 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:34.525933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-697c9c37-2d4d-4ec6-8e4e-c6438bf69834 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:34.554904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-5791863c-660e-4eba-b507-82bf2fbc50c7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:39:34.555873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-5791863c-660e-4eba-b507-82bf2fbc50c7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:39:34.556619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-5791863c-660e-4eba-b507-82bf2fbc50c7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:39:34.557248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-5791863c-660e-4eba-b507-82bf2fbc50c7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:39:34.557879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-5791863c-660e-4eba-b507-82bf2fbc50c7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:39:34.572443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-697c9c37-2d4d-4ec6-8e4e-c6438bf69834 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:34.580791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-697c9c37-2d4d-4ec6-8e4e-c6438bf69834 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:34.587429 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-697c9c37-2d4d-4ec6-8e4e-c6438bf69834 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1266 microversion: 2.25 time: 0.381687 Sep 07 12:39:34.590216 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1127/2204] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:39:34 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1266 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:39:34.599091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5791863c-660e-4eba-b507-82bf2fbc50c7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:34.600195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5791863c-660e-4eba-b507-82bf2fbc50c7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:34.602199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5791863c-660e-4eba-b507-82bf2fbc50c7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:34.604473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5791863c-660e-4eba-b507-82bf2fbc50c7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:34.606545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5791863c-660e-4eba-b507-82bf2fbc50c7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:34.608856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0b7bcc0d-27db-4e17-a6af-326121f6531a tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:34.610030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5791863c-660e-4eba-b507-82bf2fbc50c7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:34.611554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0b7bcc0d-27db-4e17-a6af-326121f6531a tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: 498a719e-d642-4e9c-9951-d6aacb0a16db] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:34.632583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b7bcc0d-27db-4e17-a6af-326121f6531a tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:34.635341 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b7bcc0d-27db-4e17-a6af-326121f6531a tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:34.637013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b7bcc0d-27db-4e17-a6af-326121f6531a tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:34.642664 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b7bcc0d-27db-4e17-a6af-326121f6531a tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:34.643609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b7bcc0d-27db-4e17-a6af-326121f6531a tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:34.646963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b7bcc0d-27db-4e17-a6af-326121f6531a tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:34.691053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-5791863c-660e-4eba-b507-82bf2fbc50c7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Getting quotas for project ef5b2dd007e944358d72268414868096. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:39:34.711705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-5791863c-660e-4eba-b507-82bf2fbc50c7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Getting quotas for user b920811be01745fc9faea7a9ce213c6e and project ef5b2dd007e944358d72268414868096. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:39:34.788287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5791863c-660e-4eba-b507-82bf2fbc50c7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:39:34.793095 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5791863c-660e-4eba-b507-82bf2fbc50c7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: e9b81094-ecf8-45b0-b334-e6b2c3b4a058] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:39:34.923483 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5791863c-660e-4eba-b507-82bf2fbc50c7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.879857 Sep 07 12:39:34.925324 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1078/2205] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:39:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:39:34.948732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cbe84767-8efa-490c-adce-96de606f7167 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:34.953015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cbe84767-8efa-490c-adce-96de606f7167 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 9f506502-b414-408e-b36a-a61e27b58980] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:34.973943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbe84767-8efa-490c-adce-96de606f7167 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:34.974764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbe84767-8efa-490c-adce-96de606f7167 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:34.991823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbe84767-8efa-490c-adce-96de606f7167 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:34.992873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbe84767-8efa-490c-adce-96de606f7167 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:34.993818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbe84767-8efa-490c-adce-96de606f7167 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:34.994482 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbe84767-8efa-490c-adce-96de606f7167 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:35.816950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cbe84767-8efa-490c-adce-96de606f7167 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:35.831917 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cbe84767-8efa-490c-adce-96de606f7167 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980" status: 200 len: 1488 microversion: 2.1 time: 0.903083 Sep 07 12:39:35.832999 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1079/2206] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:34 2022] GET /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980 => generated 1488 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:35.842063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-432bc26e-3e7c-4931-aa4e-d41f02b5d666 req-b790f34c-cf9c-496c-a156-68840453d5cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3156895a-b53e-4926-9425-6feaae2d424d", "tag": "78e49300-5bee-474e-a6c8-dda5e06d6553"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:39:35.863587 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-432bc26e-3e7c-4931-aa4e-d41f02b5d666 req-b790f34c-cf9c-496c-a156-68840453d5cf service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:35.864086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-432bc26e-3e7c-4931-aa4e-d41f02b5d666 req-b790f34c-cf9c-496c-a156-68840453d5cf service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:35.864597 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-432bc26e-3e7c-4931-aa4e-d41f02b5d666 req-b790f34c-cf9c-496c-a156-68840453d5cf service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:35.884124 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-432bc26e-3e7c-4931-aa4e-d41f02b5d666 req-b790f34c-cf9c-496c-a156-68840453d5cf service nova] Creating event network-changed:78e49300-5bee-474e-a6c8-dda5e06d6553 for instance 3156895a-b53e-4926-9425-6feaae2d424d on n-h2-852087-9 Sep 07 12:39:35.895730 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-432bc26e-3e7c-4931-aa4e-d41f02b5d666 req-b790f34c-cf9c-496c-a156-68840453d5cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060362 Sep 07 12:39:35.896783 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1080/2207] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:39:35.904910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-869d3495-61bb-4efd-98b3-68f4706d3ffc tempest-FloatingIPDetailsTestJSON-1513360368 tempest-FloatingIPDetailsTestJSON-1513360368-project] Calling method '.version_select at 0x7fc418a96e50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:36.498825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0b7bcc0d-27db-4e17-a6af-326121f6531a tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:36.535244 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0b7bcc0d-27db-4e17-a6af-326121f6531a tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db" status: 200 len: 1323 microversion: 2.1 time: 1.941515 Sep 07 12:39:36.536284 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1128/2208] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:34 2022] GET /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db => generated 1323 bytes in 1944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:36.556623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-0ab0e7b4-8906-4aef-8189-1d8758366cf1 req-bb472151-2bc8-4fab-9533-65c0eceb4572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2a1933-970b-4c7d-a4b9-25cbc6f34768", "name": "network-vif-deleted", "tag": "eef20a26-9e87-43bc-ad0b-150c5fcd678a"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:39:36.595248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0ab0e7b4-8906-4aef-8189-1d8758366cf1 req-bb472151-2bc8-4fab-9533-65c0eceb4572 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:36.596499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0ab0e7b4-8906-4aef-8189-1d8758366cf1 req-bb472151-2bc8-4fab-9533-65c0eceb4572 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:36.598424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0ab0e7b4-8906-4aef-8189-1d8758366cf1 req-bb472151-2bc8-4fab-9533-65c0eceb4572 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:36.638998 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-0ab0e7b4-8906-4aef-8189-1d8758366cf1 req-bb472151-2bc8-4fab-9533-65c0eceb4572 service nova] Creating event network-vif-deleted:eef20a26-9e87-43bc-ad0b-150c5fcd678a for instance 7c2a1933-970b-4c7d-a4b9-25cbc6f34768 on n-h1-852087-9 Sep 07 12:39:36.648978 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-0ab0e7b4-8906-4aef-8189-1d8758366cf1 req-bb472151-2bc8-4fab-9533-65c0eceb4572 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104530 Sep 07 12:39:36.651160 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1129/2209] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:39:36.668054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-176a0166-d544-4a10-8869-82d299fd2b55 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:36.670163 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-176a0166-d544-4a10-8869-82d299fd2b55 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: e9b81094-ecf8-45b0-b334-e6b2c3b4a058] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:36.686444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-176a0166-d544-4a10-8869-82d299fd2b55 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:36.689021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-176a0166-d544-4a10-8869-82d299fd2b55 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:36.690576 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-176a0166-d544-4a10-8869-82d299fd2b55 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:36.691984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-176a0166-d544-4a10-8869-82d299fd2b55 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:36.693018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-176a0166-d544-4a10-8869-82d299fd2b55 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:36.694227 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-176a0166-d544-4a10-8869-82d299fd2b55 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:36.964306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-176a0166-d544-4a10-8869-82d299fd2b55 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:36.977984 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-176a0166-d544-4a10-8869-82d299fd2b55 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058" status: 200 len: 1265 microversion: 2.1 time: 0.322923 Sep 07 12:39:36.978849 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1130/2210] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:36 2022] GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058 => generated 1265 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:37.009773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7d69115a-5c40-4cf1-a2b7-a58314cd96d7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1400645731", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "abfead5a-39da-42e4-8f95-5caa8150f822"}], "security_groups": [{"name": "tempest-securitygroup--30251641"}], "key_name": "tempest-keypair-1277964462", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "64d13c12-9e76-4e8f-8f84-b45d686a04b0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:39:37.437391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-7d69115a-5c40-4cf1-a2b7-a58314cd96d7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] validate_networks() for [('abfead5a-39da-42e4-8f95-5caa8150f822', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:39:40.403055 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-869d3495-61bb-4efd-98b3-68f4706d3ffc tempest-FloatingIPDetailsTestJSON-1513360368 tempest-FloatingIPDetailsTestJSON-1513360368-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/26e05295-52c5-4953-8d07-bce6ad130d36" status: 202 len: 0 microversion: 2.1 time: 4.504051 Sep 07 12:39:40.405039 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1081/2211] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Sep 7 12:39:35 2022] DELETE /compute/v2.1/os-floating-ips/26e05295-52c5-4953-8d07-bce6ad130d36 => generated 0 bytes in 4507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:39:40.410558 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2be217f5-9b4e-4d84-9fcb-902782537521 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:40.411680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2be217f5-9b4e-4d84-9fcb-902782537521 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:40.428421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2be217f5-9b4e-4d84-9fcb-902782537521 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:40.433741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2be217f5-9b4e-4d84-9fcb-902782537521 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:40.434717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2be217f5-9b4e-4d84-9fcb-902782537521 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:40.435977 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2be217f5-9b4e-4d84-9fcb-902782537521 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:40.436724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2be217f5-9b4e-4d84-9fcb-902782537521 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:40.443562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2be217f5-9b4e-4d84-9fcb-902782537521 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:40.744291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2be217f5-9b4e-4d84-9fcb-902782537521 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:40.780062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2be217f5-9b4e-4d84-9fcb-902782537521 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:40.782990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2be217f5-9b4e-4d84-9fcb-902782537521 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:40.785216 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2be217f5-9b4e-4d84-9fcb-902782537521 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 200 len: 1266 microversion: 2.25 time: 0.378486 Sep 07 12:39:40.815580 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1082/2212] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:39:40 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 1266 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:39:40.824130 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c2be40d-e37b-4740-8e05-8811ac741f47 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:40.824957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7c2be40d-e37b-4740-8e05-8811ac741f47 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 9f506502-b414-408e-b36a-a61e27b58980] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:40.852726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c2be40d-e37b-4740-8e05-8811ac741f47 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:40.863792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c2be40d-e37b-4740-8e05-8811ac741f47 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:40.865356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c2be40d-e37b-4740-8e05-8811ac741f47 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:40.867203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c2be40d-e37b-4740-8e05-8811ac741f47 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:40.868575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c2be40d-e37b-4740-8e05-8811ac741f47 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:40.869706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c2be40d-e37b-4740-8e05-8811ac741f47 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:40.961399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7c2be40d-e37b-4740-8e05-8811ac741f47 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 9f506502-b414-408e-b36a-a61e27b58980] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:39:41.163131 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:39:41.190593 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7c2be40d-e37b-4740-8e05-8811ac741f47 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980" status: 204 len: 0 microversion: 2.1 time: 0.371904 Sep 07 12:39:41.192788 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1083/2213] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:39:40 2022] DELETE /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:39:41.215855 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-15ebaa32-6f82-4939-860c-087e3929057f req-5ba1ff25-ed97-43bc-b7c8-aab6d0e67609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f506502-b414-408e-b36a-a61e27b58980", "name": "network-vif-unplugged", "status": "completed", "tag": "6e1353d6-2e43-4cdf-b8a5-622fd6963e0e"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:39:41.242839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-15ebaa32-6f82-4939-860c-087e3929057f req-5ba1ff25-ed97-43bc-b7c8-aab6d0e67609 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:41.245684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-15ebaa32-6f82-4939-860c-087e3929057f req-5ba1ff25-ed97-43bc-b7c8-aab6d0e67609 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:41.248470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-15ebaa32-6f82-4939-860c-087e3929057f req-5ba1ff25-ed97-43bc-b7c8-aab6d0e67609 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:41.280938 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-15ebaa32-6f82-4939-860c-087e3929057f req-5ba1ff25-ed97-43bc-b7c8-aab6d0e67609 service nova] Creating event network-vif-unplugged:6e1353d6-2e43-4cdf-b8a5-622fd6963e0e for instance 9f506502-b414-408e-b36a-a61e27b58980 on n-h1-852087-9 Sep 07 12:39:41.295667 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-15ebaa32-6f82-4939-860c-087e3929057f req-5ba1ff25-ed97-43bc-b7c8-aab6d0e67609 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099759 Sep 07 12:39:41.297575 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1084/2214] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:39:41.311607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-178ba2b0-43c9-4ea9-bfa7-341d33edd122 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:41.312418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-178ba2b0-43c9-4ea9-bfa7-341d33edd122 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: 498a719e-d642-4e9c-9951-d6aacb0a16db] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:41.330451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-178ba2b0-43c9-4ea9-bfa7-341d33edd122 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:41.331211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-178ba2b0-43c9-4ea9-bfa7-341d33edd122 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:41.331883 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-178ba2b0-43c9-4ea9-bfa7-341d33edd122 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:41.340822 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-178ba2b0-43c9-4ea9-bfa7-341d33edd122 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:41.341657 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-178ba2b0-43c9-4ea9-bfa7-341d33edd122 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:41.342280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-178ba2b0-43c9-4ea9-bfa7-341d33edd122 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:41.462660 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-7d69115a-5c40-4cf1-a2b7-a58314cd96d7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Getting quotas for project 3d453f24efa048f0a67ab7834d0005c7. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:39:41.491067 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-7d69115a-5c40-4cf1-a2b7-a58314cd96d7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Getting quotas for user 5d991fa2c5754b14a7a0e638b486f06e and project 3d453f24efa048f0a67ab7834d0005c7. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:39:41.556047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7d69115a-5c40-4cf1-a2b7-a58314cd96d7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:39:41.557103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7d69115a-5c40-4cf1-a2b7-a58314cd96d7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:39:41.564571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7d69115a-5c40-4cf1-a2b7-a58314cd96d7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:39:41.565783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7d69115a-5c40-4cf1-a2b7-a58314cd96d7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:39:41.568528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7d69115a-5c40-4cf1-a2b7-a58314cd96d7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:39:41.607956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d69115a-5c40-4cf1-a2b7-a58314cd96d7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:41.620020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d69115a-5c40-4cf1-a2b7-a58314cd96d7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:41.621189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d69115a-5c40-4cf1-a2b7-a58314cd96d7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:41.622824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d69115a-5c40-4cf1-a2b7-a58314cd96d7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:41.623889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d69115a-5c40-4cf1-a2b7-a58314cd96d7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:41.624848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d69115a-5c40-4cf1-a2b7-a58314cd96d7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:41.742118 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-7d69115a-5c40-4cf1-a2b7-a58314cd96d7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Getting quotas for project 3d453f24efa048f0a67ab7834d0005c7. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:39:41.756628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-7d69115a-5c40-4cf1-a2b7-a58314cd96d7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Getting quotas for user 5d991fa2c5754b14a7a0e638b486f06e and project 3d453f24efa048f0a67ab7834d0005c7. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:39:41.992430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7d69115a-5c40-4cf1-a2b7-a58314cd96d7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:39:42.007765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7d69115a-5c40-4cf1-a2b7-a58314cd96d7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='64d13c12-9e76-4e8f-8f84-b45d686a04b0',volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:39:42.241227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-178ba2b0-43c9-4ea9-bfa7-341d33edd122 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:42.297910 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-178ba2b0-43c9-4ea9-bfa7-341d33edd122 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db" status: 200 len: 1323 microversion: 2.1 time: 0.991105 Sep 07 12:39:42.326560 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1085/2215] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:41 2022] GET /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db => generated 1323 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:42.365161 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f6ad9cf1-b498-4ef3-aa43-9becdc25053f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:42.366469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f6ad9cf1-b498-4ef3-aa43-9becdc25053f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: e9b81094-ecf8-45b0-b334-e6b2c3b4a058] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:42.415583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6ad9cf1-b498-4ef3-aa43-9becdc25053f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:42.416723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6ad9cf1-b498-4ef3-aa43-9becdc25053f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:42.417172 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6ad9cf1-b498-4ef3-aa43-9becdc25053f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:42.420998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6ad9cf1-b498-4ef3-aa43-9becdc25053f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:42.425994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6ad9cf1-b498-4ef3-aa43-9becdc25053f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:42.429403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6ad9cf1-b498-4ef3-aa43-9becdc25053f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:42.545370 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7d69115a-5c40-4cf1-a2b7-a58314cd96d7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 5.545174 Sep 07 12:39:42.550846 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1131/2216] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:39:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 5552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:39:42.570166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-73317cfe-b58c-4a6f-80b8-a9dcbe9709c6 req-4bd372ee-7509-4cf2-9241-3020c49728d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "498a719e-d642-4e9c-9951-d6aacb0a16db", "tag": "cfef85c8-c8aa-483d-b48d-d21143e17765"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:39:42.620728 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-73317cfe-b58c-4a6f-80b8-a9dcbe9709c6 req-4bd372ee-7509-4cf2-9241-3020c49728d4 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:42.621187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-73317cfe-b58c-4a6f-80b8-a9dcbe9709c6 req-4bd372ee-7509-4cf2-9241-3020c49728d4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:42.623596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-73317cfe-b58c-4a6f-80b8-a9dcbe9709c6 req-4bd372ee-7509-4cf2-9241-3020c49728d4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:42.647345 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-73317cfe-b58c-4a6f-80b8-a9dcbe9709c6 req-4bd372ee-7509-4cf2-9241-3020c49728d4 service nova] Creating event network-changed:cfef85c8-c8aa-483d-b48d-d21143e17765 for instance 498a719e-d642-4e9c-9951-d6aacb0a16db on n-h1-852087-9 Sep 07 12:39:42.656595 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-73317cfe-b58c-4a6f-80b8-a9dcbe9709c6 req-4bd372ee-7509-4cf2-9241-3020c49728d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103563 Sep 07 12:39:42.657922 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1132/2217] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:39:42.668243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8ace8b06-c94b-4ef1-908c-c135b97b3f5c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc4192221f0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:42.701317 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-8ace8b06-c94b-4ef1-908c-c135b97b3f5c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] HTTP exception thrown: Image not found. Sep 07 12:39:42.704578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8ace8b06-c94b-4ef1-908c-c135b97b3f5c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Request method failure captured: Sep 07 12:39:42.704578 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/images/357652e0-7aac-465e-8092-8ba8f553ed7c HTTP/1.1 Sep 07 12:39:42.704578 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:39:42.704578 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:39:42.704578 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:39:42.704578 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:39:42.704578 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:39:42.704578 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:39:42.704578 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:39:42.704578 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:39:42.704578 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI-kQlfcQLorACLQzdYtTfLAYjfzfZ67NLxGmgmKh_xWpac_ei5BT0p7WvRJTQ3OQF_BdKtmk4joe0cgrH1-wFRs4eGPQulhjs6MHBSe19hGr65toe3mL7J9K1C64pnxZIXjdFUI_d7Wy_9-l_t6DtRgirXJxRZFWdrA29tgdfNHFlg Sep 07 12:39:42.704578 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:39:42.704578 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:39:42.704578 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:39:42.704578 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:39:42.704578 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:39:42.704578 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:39:42.704578 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 081286d7e4664e239ace13466a4a9c50 Sep 07 12:39:42.704578 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesTestJSON-627407633 Sep 07 12:39:42.704578 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:39:42.704578 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:39:42.706228 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_081286d7e4664e239ace13466a4a9c50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:39:42.706228 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesTestJSON-627407633 Sep 07 12:39:42.706228 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 081286d7e4664e239ace13466a4a9c50 Sep 07 12:39:42.706228 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesTestJSON-627407633 Sep 07 12:39:42.706228 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ImagesTestJSON-627407633-project Sep 07 12:39:42.706228 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:39:42.706228 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:39:42.706228 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 3d68cf87771f4e9f9caab95adf58b129 Sep 07 12:39:42.706228 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesTestJSON-627407633-project Sep 07 12:39:42.706228 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:39:42.706228 n-d-852087-9 devstack@n-api.service[122432]: exception: Image not found. Sep 07 12:39:42.706228 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '357652e0-7aac-465e-8092-8ba8f553ed7c'} Sep 07 12:39:42.706228 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:39:42.706228 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:42.707139 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 07 12:39:42.707139 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 07 12:39:42.707139 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:39:42.707139 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:39:42.707139 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:39:42.707139 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:39:42.707139 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 07 12:39:42.707139 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 07 12:39:42.707139 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 07 12:39:42.707139 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 07 12:39:42.707139 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:39:42.707139 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:39:42.707139 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:39:42.707139 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:39:42.707139 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 357652e0-7aac-465e-8092-8ba8f553ed7c to delete Sep 07 12:39:42.707139 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:42.707139 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:42.707139 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:42.707139 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:42.708377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 07 12:39:42.708377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 07 12:39:42.708377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 07 12:39:42.708377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 07 12:39:42.708377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 07 12:39:42.708377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 07 12:39:42.708377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 357652e0-7aac-465e-8092-8ba8f553ed7c could not be found. Sep 07 12:39:42.708377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:42.708377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:42.708377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:42.708377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:42.708377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:42.708377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:42.708377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:39:42.708377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:39:42.708377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:39:42.708377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:39:42.708377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:39:42.708377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:39:42.708377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 07 12:39:42.709469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 12:39:42.709469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 12:39:42.709469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:42.709469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:42.709469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:42.709469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:42.709469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:42.709469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:42.709469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:39:42.709469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:39:42.709469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 12:39:42.709469 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:42.711288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8ace8b06-c94b-4ef1-908c-c135b97b3f5c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Returning 404 to user: Image not found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:39:42.712527 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8ace8b06-c94b-4ef1-908c-c135b97b3f5c tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "DELETE /compute/v2.1/images/357652e0-7aac-465e-8092-8ba8f553ed7c" status: 404 len: 62 microversion: 2.1 time: 0.053095 Sep 07 12:39:42.713854 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1133/2218] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:42 2022] DELETE /compute/v2.1/images/357652e0-7aac-465e-8092-8ba8f553ed7c => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:39:42.728924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e5c85d7e-7206-40a4-89b8-fb1ad1f6d596 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:42.731753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e5c85d7e-7206-40a4-89b8-fb1ad1f6d596 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 7c2a1933-970b-4c7d-a4b9-25cbc6f34768] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:42.752947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5c85d7e-7206-40a4-89b8-fb1ad1f6d596 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:42.764595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5c85d7e-7206-40a4-89b8-fb1ad1f6d596 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:42.769395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5c85d7e-7206-40a4-89b8-fb1ad1f6d596 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:42.770402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5c85d7e-7206-40a4-89b8-fb1ad1f6d596 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:42.770961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5c85d7e-7206-40a4-89b8-fb1ad1f6d596 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:42.775141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5c85d7e-7206-40a4-89b8-fb1ad1f6d596 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:42.811836 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-e5c85d7e-7206-40a4-89b8-fb1ad1f6d596 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] HTTP exception thrown: Instance 7c2a1933-970b-4c7d-a4b9-25cbc6f34768 could not be found. Sep 07 12:39:42.813996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e5c85d7e-7206-40a4-89b8-fb1ad1f6d596 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Request method failure captured: Sep 07 12:39:42.813996 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 HTTP/1.1 Sep 07 12:39:42.813996 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:39:42.813996 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:39:42.813996 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:39:42.813996 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:39:42.813996 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:39:42.813996 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:39:42.813996 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:39:42.813996 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:39:42.813996 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI766J91sJuT5F2IEQqMchfKaCbSDDF-J9lwzV5FP6Js_H7pktqjB-3Lio5CpiTElE39UZjTqgIShFlx0VbJgNQCgVyAvoaV1-jKOOUTYFV0esgaVjKSWWfHpfNXej83bOupyFtCRU8lUe_AKArpkP0tH23jA8qcBVLgUCSpGDxJw0U Sep 07 12:39:42.813996 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:39:42.813996 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:39:42.813996 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:39:42.813996 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:39:42.813996 n-d-852087-9 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.25 Sep 07 12:39:42.813996 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:39:42.813996 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:39:42.813996 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 6d7695bab2d84b35bf92bd035da71dc3 Sep 07 12:39:42.813996 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2124170019 Sep 07 12:39:42.813996 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:39:42.813996 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:39:42.815565 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d7695bab2d84b35bf92bd035da71dc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d7695bab2d84b35bf92bd035da71dc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d7695bab2d84b35bf92bd035da71dc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d7695bab2d84b35bf92bd035da71dc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:39:42.815565 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2124170019 Sep 07 12:39:42.815565 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 6d7695bab2d84b35bf92bd035da71dc3 Sep 07 12:39:42.815565 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2124170019 Sep 07 12:39:42.815565 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-LiveAutoBlockMigrationV225Test-2124170019-project Sep 07 12:39:42.815565 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:39:42.815565 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:39:42.815565 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: cf3ae3d912b84a8f906b31874668b740 Sep 07 12:39:42.815565 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2124170019-project Sep 07 12:39:42.815565 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:39:42.815565 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 7c2a1933-970b-4c7d-a4b9-25cbc6f34768 could not be found. Sep 07 12:39:42.815565 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '7c2a1933-970b-4c7d-a4b9-25cbc6f34768'} Sep 07 12:39:42.816323 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:39:42.816323 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:42.816323 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:39:42.816323 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:39:42.816323 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:39:42.816323 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:39:42.816323 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:39:42.816323 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:39:42.816323 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:39:42.816323 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:39:42.816323 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c2a1933-970b-4c7d-a4b9-25cbc6f34768 could not be found. Sep 07 12:39:42.816323 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:42.816323 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:42.816323 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:42.816323 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:42.816323 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:42.816323 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:42.816323 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:39:42.816323 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:39:42.816323 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:39:42.817501 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:39:42.817501 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:39:42.817501 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:39:42.817501 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:39:42.817501 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:39:42.817501 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:39:42.817501 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:39:42.817501 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c2a1933-970b-4c7d-a4b9-25cbc6f34768 could not be found. Sep 07 12:39:42.817501 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:42.817501 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:42.817501 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:42.817501 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:42.817501 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:42.817501 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:42.817501 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:39:42.817501 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:39:42.817501 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c2a1933-970b-4c7d-a4b9-25cbc6f34768 could not be found. Sep 07 12:39:42.817501 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:42.820561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e5c85d7e-7206-40a4-89b8-fb1ad1f6d596 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Returning 404 to user: Instance 7c2a1933-970b-4c7d-a4b9-25cbc6f34768 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:39:42.824461 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e5c85d7e-7206-40a4-89b8-fb1ad1f6d596 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768" status: 404 len: 111 microversion: 2.25 time: 0.108952 Sep 07 12:39:42.827008 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1134/2219] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:39:42 2022] GET /compute/v2.1/servers/7c2a1933-970b-4c7d-a4b9-25cbc6f34768 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:39:42.868178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-84db583f-7575-48a8-962b-e3db5bcccb88 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:42.868974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-84db583f-7575-48a8-962b-e3db5bcccb88 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:43.072970 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-84db583f-7575-48a8-962b-e3db5bcccb88 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d991fa2c5754b14a7a0e638b486f06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d453f24efa048f0a67ab7834d0005c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:43.086242 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-84db583f-7575-48a8-962b-e3db5bcccb88 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f" status: 200 len: 1122 microversion: 2.1 time: 0.257452 Sep 07 12:39:43.086968 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1135/2220] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:42 2022] GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f => generated 1122 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:43.114171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-97d9688f-3132-4138-92d6-adf3614caf3a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:43.114960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-97d9688f-3132-4138-92d6-adf3614caf3a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 9f506502-b414-408e-b36a-a61e27b58980] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:43.145896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97d9688f-3132-4138-92d6-adf3614caf3a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:43.146786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97d9688f-3132-4138-92d6-adf3614caf3a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:43.147772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97d9688f-3132-4138-92d6-adf3614caf3a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:43.150803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97d9688f-3132-4138-92d6-adf3614caf3a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:43.151766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97d9688f-3132-4138-92d6-adf3614caf3a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:43.152462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97d9688f-3132-4138-92d6-adf3614caf3a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:43.185067 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:39:43.205813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-97d9688f-3132-4138-92d6-adf3614caf3a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 9f506502-b414-408e-b36a-a61e27b58980] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:39:43.331828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f6ad9cf1-b498-4ef3-aa43-9becdc25053f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:43.347920 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f6ad9cf1-b498-4ef3-aa43-9becdc25053f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058" status: 200 len: 1313 microversion: 2.1 time: 1.019032 Sep 07 12:39:43.351751 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1086/2221] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:42 2022] GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058 => generated 1313 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:43.358907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3d0fb2ae-0f10-4d17-899f-77ef10d880f1 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:43.359067 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.compute.api [None req-97d9688f-3132-4138-92d6-adf3614caf3a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 9f506502-b414-408e-b36a-a61e27b58980] Instance is already in deleting state, ignoring this request Sep 07 12:39:43.360444 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-97d9688f-3132-4138-92d6-adf3614caf3a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980" status: 204 len: 0 microversion: 2.1 time: 0.252973 Sep 07 12:39:43.364089 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1136/2222] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:39:43 2022] DELETE /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:39:43.366701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3d0fb2ae-0f10-4d17-899f-77ef10d880f1 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: 498a719e-d642-4e9c-9951-d6aacb0a16db] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:43.381554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7b837c25-20b4-46bf-975f-cad2f2ce7fd9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:43.384189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7b837c25-20b4-46bf-975f-cad2f2ce7fd9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 9f506502-b414-408e-b36a-a61e27b58980] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:43.395352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d0fb2ae-0f10-4d17-899f-77ef10d880f1 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:43.397353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d0fb2ae-0f10-4d17-899f-77ef10d880f1 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:43.398503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d0fb2ae-0f10-4d17-899f-77ef10d880f1 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:43.410035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d0fb2ae-0f10-4d17-899f-77ef10d880f1 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:43.413987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d0fb2ae-0f10-4d17-899f-77ef10d880f1 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:43.416864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d0fb2ae-0f10-4d17-899f-77ef10d880f1 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:43.433957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b837c25-20b4-46bf-975f-cad2f2ce7fd9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:43.434943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b837c25-20b4-46bf-975f-cad2f2ce7fd9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:43.435705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b837c25-20b4-46bf-975f-cad2f2ce7fd9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:43.436969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b837c25-20b4-46bf-975f-cad2f2ce7fd9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:43.441783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b837c25-20b4-46bf-975f-cad2f2ce7fd9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:43.442816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b837c25-20b4-46bf-975f-cad2f2ce7fd9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:43.453360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:39:44.069839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3d0fb2ae-0f10-4d17-899f-77ef10d880f1 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:44.091979 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3d0fb2ae-0f10-4d17-899f-77ef10d880f1 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db" status: 200 len: 1323 microversion: 2.1 time: 0.738448 Sep 07 12:39:44.099144 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1087/2223] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:43 2022] GET /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db => generated 1323 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:44.140492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-1b09fe82-3a08-46b4-a7d3-dd1cde8959b0 req-e39c4867-e27f-4cb1-a14b-8bffcd8376b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d610675f-fc02-46f7-a980-33b6ee582c4d", "name": "network-vif-plugged", "status": "completed", "tag": "168d12f5-7490-45c8-98dc-5e5702f57370"}, {"server_uuid": "3156895a-b53e-4926-9425-6feaae2d424d", "name": "network-vif-plugged", "status": "completed", "tag": "78e49300-5bee-474e-a6c8-dda5e06d6553"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:39:44.150975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7b837c25-20b4-46bf-975f-cad2f2ce7fd9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:44.165527 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7b837c25-20b4-46bf-975f-cad2f2ce7fd9 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980" status: 200 len: 1494 microversion: 2.1 time: 0.789052 Sep 07 12:39:44.169869 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1137/2224] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:43 2022] GET /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980 => generated 1494 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:44.179140 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cae0d4b3-3600-48ac-9b08-ba0966549760 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:44.186378 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cae0d4b3-3600-48ac-9b08-ba0966549760 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:44.202843 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cae0d4b3-3600-48ac-9b08-ba0966549760 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:44.205272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cae0d4b3-3600-48ac-9b08-ba0966549760 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:44.207731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cae0d4b3-3600-48ac-9b08-ba0966549760 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:44.210471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cae0d4b3-3600-48ac-9b08-ba0966549760 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:44.211230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cae0d4b3-3600-48ac-9b08-ba0966549760 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:44.211984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cae0d4b3-3600-48ac-9b08-ba0966549760 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:44.216211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1b09fe82-3a08-46b4-a7d3-dd1cde8959b0 req-e39c4867-e27f-4cb1-a14b-8bffcd8376b7 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:44.220838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1b09fe82-3a08-46b4-a7d3-dd1cde8959b0 req-e39c4867-e27f-4cb1-a14b-8bffcd8376b7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:44.221926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1b09fe82-3a08-46b4-a7d3-dd1cde8959b0 req-e39c4867-e27f-4cb1-a14b-8bffcd8376b7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:44.278162 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-1b09fe82-3a08-46b4-a7d3-dd1cde8959b0 req-e39c4867-e27f-4cb1-a14b-8bffcd8376b7 service nova] Creating event network-vif-plugged:168d12f5-7490-45c8-98dc-5e5702f57370 for instance d610675f-fc02-46f7-a980-33b6ee582c4d on n-h2-852087-9 Sep 07 12:39:44.279763 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-1b09fe82-3a08-46b4-a7d3-dd1cde8959b0 req-e39c4867-e27f-4cb1-a14b-8bffcd8376b7 service nova] Creating event network-vif-plugged:78e49300-5bee-474e-a6c8-dda5e06d6553 for instance 3156895a-b53e-4926-9425-6feaae2d424d on n-h2-852087-9 Sep 07 12:39:44.311106 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-1b09fe82-3a08-46b4-a7d3-dd1cde8959b0 req-e39c4867-e27f-4cb1-a14b-8bffcd8376b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.195244 Sep 07 12:39:44.311727 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1088/2225] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:39:44.426502 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-59e96109-928d-4e14-b72d-c15cdd2f0983 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:44.432513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-59e96109-928d-4e14-b72d-c15cdd2f0983 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: e9b81094-ecf8-45b0-b334-e6b2c3b4a058] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:44.479733 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59e96109-928d-4e14-b72d-c15cdd2f0983 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:44.480271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59e96109-928d-4e14-b72d-c15cdd2f0983 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:44.480801 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59e96109-928d-4e14-b72d-c15cdd2f0983 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:44.481820 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59e96109-928d-4e14-b72d-c15cdd2f0983 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:44.482330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59e96109-928d-4e14-b72d-c15cdd2f0983 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:44.482780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59e96109-928d-4e14-b72d-c15cdd2f0983 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:44.552103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cae0d4b3-3600-48ac-9b08-ba0966549760 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d991fa2c5754b14a7a0e638b486f06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d453f24efa048f0a67ab7834d0005c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:44.581866 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cae0d4b3-3600-48ac-9b08-ba0966549760 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f" status: 200 len: 1172 microversion: 2.1 time: 0.409976 Sep 07 12:39:44.588260 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1138/2226] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:44 2022] GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f => generated 1172 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:44.645829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:39:44.758662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:39:45.149980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5c31049a-c89f-4561-9acd-d28c2cb50b2e tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:45.155055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5c31049a-c89f-4561-9acd-d28c2cb50b2e tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: 498a719e-d642-4e9c-9951-d6aacb0a16db] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:45.181536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c31049a-c89f-4561-9acd-d28c2cb50b2e tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:45.182083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c31049a-c89f-4561-9acd-d28c2cb50b2e tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:45.182541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c31049a-c89f-4561-9acd-d28c2cb50b2e tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:45.183272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c31049a-c89f-4561-9acd-d28c2cb50b2e tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:45.183908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c31049a-c89f-4561-9acd-d28c2cb50b2e tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:45.184503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c31049a-c89f-4561-9acd-d28c2cb50b2e tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:46.123489 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-59e96109-928d-4e14-b72d-c15cdd2f0983 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:46.156672 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-59e96109-928d-4e14-b72d-c15cdd2f0983 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058" status: 200 len: 1313 microversion: 2.1 time: 1.755957 Sep 07 12:39:46.161077 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1089/2227] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:44 2022] GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058 => generated 1313 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:46.189343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2e961278-2f36-4e17-97cd-c9f331d6ee76 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:46.207754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2e961278-2f36-4e17-97cd-c9f331d6ee76 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 9f506502-b414-408e-b36a-a61e27b58980] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:46.246943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e961278-2f36-4e17-97cd-c9f331d6ee76 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:46.248529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e961278-2f36-4e17-97cd-c9f331d6ee76 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:46.249530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e961278-2f36-4e17-97cd-c9f331d6ee76 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:46.251789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e961278-2f36-4e17-97cd-c9f331d6ee76 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:46.253383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e961278-2f36-4e17-97cd-c9f331d6ee76 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:46.255619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e961278-2f36-4e17-97cd-c9f331d6ee76 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:46.398710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5c31049a-c89f-4561-9acd-d28c2cb50b2e tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:46.420601 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5c31049a-c89f-4561-9acd-d28c2cb50b2e tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db" status: 200 len: 1323 microversion: 2.1 time: 1.282510 Sep 07 12:39:46.421624 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1139/2228] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:45 2022] GET /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db => generated 1323 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:39:46.475934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9f65ebbd-a738-4556-8f54-a7d820fc6d7c tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:46.479050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9f65ebbd-a738-4556-8f54-a7d820fc6d7c tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:46.506050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f65ebbd-a738-4556-8f54-a7d820fc6d7c tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:46.507674 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f65ebbd-a738-4556-8f54-a7d820fc6d7c tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:46.510529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f65ebbd-a738-4556-8f54-a7d820fc6d7c tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:46.512470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f65ebbd-a738-4556-8f54-a7d820fc6d7c tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:46.515129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f65ebbd-a738-4556-8f54-a7d820fc6d7c tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:46.516142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f65ebbd-a738-4556-8f54-a7d820fc6d7c tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:46.849890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9f65ebbd-a738-4556-8f54-a7d820fc6d7c tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d991fa2c5754b14a7a0e638b486f06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d453f24efa048f0a67ab7834d0005c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:46.885174 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9f65ebbd-a738-4556-8f54-a7d820fc6d7c tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f" status: 200 len: 1164 microversion: 2.1 time: 0.425332 Sep 07 12:39:46.886252 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1140/2229] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:46 2022] GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f => generated 1164 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:46.934408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-117d6c5e-0809-4c40-aea4-3bd434bf491c req-760a3281-267c-4183-bab3-4f214bc7c92a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9b81094-ecf8-45b0-b334-e6b2c3b4a058", "tag": "1c4458c2-7f0b-4622-b2d2-fe887eff5433"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:39:46.959324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-117d6c5e-0809-4c40-aea4-3bd434bf491c req-760a3281-267c-4183-bab3-4f214bc7c92a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:46.973840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-117d6c5e-0809-4c40-aea4-3bd434bf491c req-760a3281-267c-4183-bab3-4f214bc7c92a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:46.981854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-117d6c5e-0809-4c40-aea4-3bd434bf491c req-760a3281-267c-4183-bab3-4f214bc7c92a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:47.037204 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-117d6c5e-0809-4c40-aea4-3bd434bf491c req-760a3281-267c-4183-bab3-4f214bc7c92a service nova] Creating event network-changed:1c4458c2-7f0b-4622-b2d2-fe887eff5433 for instance e9b81094-ecf8-45b0-b334-e6b2c3b4a058 on n-h2-852087-9 Sep 07 12:39:47.056273 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-117d6c5e-0809-4c40-aea4-3bd434bf491c req-760a3281-267c-4183-bab3-4f214bc7c92a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163760 Sep 07 12:39:47.059118 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1141/2230] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:39:47.451975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9b300ad2-3c35-454c-8ab2-c59f2fea0066 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-453107289", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:39:47.547043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-9b300ad2-3c35-454c-8ab2-c59f2fea0066 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:39:47.986375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2e961278-2f36-4e17-97cd-c9f331d6ee76 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:48.004082 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2e961278-2f36-4e17-97cd-c9f331d6ee76 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980" status: 200 len: 1494 microversion: 2.1 time: 1.839467 Sep 07 12:39:48.008917 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1090/2231] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:46 2022] GET /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980 => generated 1494 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:48.023401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f2be2703-dfe4-41cf-a920-ea8f71980c8b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:48.024111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f2be2703-dfe4-41cf-a920-ea8f71980c8b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: e9b81094-ecf8-45b0-b334-e6b2c3b4a058] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:48.055037 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2be2703-dfe4-41cf-a920-ea8f71980c8b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:48.056122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2be2703-dfe4-41cf-a920-ea8f71980c8b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:48.059653 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2be2703-dfe4-41cf-a920-ea8f71980c8b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:48.062001 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2be2703-dfe4-41cf-a920-ea8f71980c8b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:48.063469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2be2703-dfe4-41cf-a920-ea8f71980c8b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:48.064142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2be2703-dfe4-41cf-a920-ea8f71980c8b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:49.607792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f2be2703-dfe4-41cf-a920-ea8f71980c8b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:49.630827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9b300ad2-3c35-454c-8ab2-c59f2fea0066 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:39:49.632104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9b300ad2-3c35-454c-8ab2-c59f2fea0066 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:39:49.633208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9b300ad2-3c35-454c-8ab2-c59f2fea0066 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:39:49.635503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9b300ad2-3c35-454c-8ab2-c59f2fea0066 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:39:49.639940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9b300ad2-3c35-454c-8ab2-c59f2fea0066 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:39:49.640747 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f2be2703-dfe4-41cf-a920-ea8f71980c8b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058" status: 200 len: 1313 microversion: 2.1 time: 1.624975 Sep 07 12:39:49.642187 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1091/2232] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:48 2022] GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058 => generated 1313 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:49.675894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b300ad2-3c35-454c-8ab2-c59f2fea0066 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:49.677506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b300ad2-3c35-454c-8ab2-c59f2fea0066 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:49.678878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b300ad2-3c35-454c-8ab2-c59f2fea0066 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:49.682644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b300ad2-3c35-454c-8ab2-c59f2fea0066 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:49.683947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b300ad2-3c35-454c-8ab2-c59f2fea0066 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:49.684976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d54aca0f-d1ea-48ef-97b3-40995df6c59c tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:49.685368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b300ad2-3c35-454c-8ab2-c59f2fea0066 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:49.686815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d54aca0f-d1ea-48ef-97b3-40995df6c59c tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: 498a719e-d642-4e9c-9951-d6aacb0a16db] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:49.709110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d54aca0f-d1ea-48ef-97b3-40995df6c59c tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:49.710075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d54aca0f-d1ea-48ef-97b3-40995df6c59c tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:49.710885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d54aca0f-d1ea-48ef-97b3-40995df6c59c tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:49.715451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d54aca0f-d1ea-48ef-97b3-40995df6c59c tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:49.716385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d54aca0f-d1ea-48ef-97b3-40995df6c59c tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:49.717160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d54aca0f-d1ea-48ef-97b3-40995df6c59c tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:49.752815 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-9b300ad2-3c35-454c-8ab2-c59f2fea0066 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:39:49.804722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-9b300ad2-3c35-454c-8ab2-c59f2fea0066 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for user ed6e5d4d54224bca90954d1ebbd7b7a3 and project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:39:49.881742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9b300ad2-3c35-454c-8ab2-c59f2fea0066 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:39:49.894802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9b300ad2-3c35-454c-8ab2-c59f2fea0066 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:39:50.108466 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9b300ad2-3c35-454c-8ab2-c59f2fea0066 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.042472 Sep 07 12:39:50.137709 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1142/2233] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:39:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:39:50.163940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-05636dc2-a8ed-427c-afb4-6232d936e9d3 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:50.168268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-05636dc2-a8ed-427c-afb4-6232d936e9d3 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:50.186487 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05636dc2-a8ed-427c-afb4-6232d936e9d3 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:50.187954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05636dc2-a8ed-427c-afb4-6232d936e9d3 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:50.189521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05636dc2-a8ed-427c-afb4-6232d936e9d3 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:50.191439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05636dc2-a8ed-427c-afb4-6232d936e9d3 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:50.192567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05636dc2-a8ed-427c-afb4-6232d936e9d3 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:50.193612 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05636dc2-a8ed-427c-afb4-6232d936e9d3 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:51.134123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-05636dc2-a8ed-427c-afb4-6232d936e9d3 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d991fa2c5754b14a7a0e638b486f06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d453f24efa048f0a67ab7834d0005c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:51.185771 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-05636dc2-a8ed-427c-afb4-6232d936e9d3 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f" status: 200 len: 1238 microversion: 2.1 time: 1.039439 Sep 07 12:39:51.187676 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1143/2234] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:50 2022] GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f => generated 1238 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:51.204776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-057dfcf4-c279-4f65-a4c1-6941e92c2e67 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:51.211013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-057dfcf4-c279-4f65-a4c1-6941e92c2e67 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 9f506502-b414-408e-b36a-a61e27b58980] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:51.235475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-057dfcf4-c279-4f65-a4c1-6941e92c2e67 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:51.248688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-057dfcf4-c279-4f65-a4c1-6941e92c2e67 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:51.250184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-057dfcf4-c279-4f65-a4c1-6941e92c2e67 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:51.251710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-057dfcf4-c279-4f65-a4c1-6941e92c2e67 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:51.253770 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-057dfcf4-c279-4f65-a4c1-6941e92c2e67 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:51.257065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-057dfcf4-c279-4f65-a4c1-6941e92c2e67 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:51.427296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-057dfcf4-c279-4f65-a4c1-6941e92c2e67 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:51.428138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-057dfcf4-c279-4f65-a4c1-6941e92c2e67 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:51.438548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-057dfcf4-c279-4f65-a4c1-6941e92c2e67 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:51.440824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-057dfcf4-c279-4f65-a4c1-6941e92c2e67 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lazy-loading 'fault' on Instance uuid 9f506502-b414-408e-b36a-a61e27b58980 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:39:51.672159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d54aca0f-d1ea-48ef-97b3-40995df6c59c tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:51.679029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-057dfcf4-c279-4f65-a4c1-6941e92c2e67 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d68cf87771f4e9f9caab95adf58b129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081286d7e4664e239ace13466a4a9c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:51.693427 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d54aca0f-d1ea-48ef-97b3-40995df6c59c tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db" status: 200 len: 1323 microversion: 2.1 time: 2.037970 Sep 07 12:39:51.699423 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1092/2235] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:49 2022] GET /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db => generated 1323 bytes in 2045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:51.713657 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-057dfcf4-c279-4f65-a4c1-6941e92c2e67 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980" status: 200 len: 1298 microversion: 2.1 time: 0.523831 Sep 07 12:39:51.718903 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1144/2236] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:51 2022] GET /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980 => generated 1298 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:51.732984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de300f9a-7f9a-418f-976f-cc32c041d70f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:51.738064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0e4f8dab-3ffc-4e31-a339-3cbc88f82cfb tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:51.745844 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0e4f8dab-3ffc-4e31-a339-3cbc88f82cfb tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:51.747766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-de300f9a-7f9a-418f-976f-cc32c041d70f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:51.772552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e4f8dab-3ffc-4e31-a339-3cbc88f82cfb tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:51.776686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de300f9a-7f9a-418f-976f-cc32c041d70f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:51.777115 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e4f8dab-3ffc-4e31-a339-3cbc88f82cfb tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:51.777562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de300f9a-7f9a-418f-976f-cc32c041d70f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:51.778634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de300f9a-7f9a-418f-976f-cc32c041d70f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:51.779657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e4f8dab-3ffc-4e31-a339-3cbc88f82cfb tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:51.779955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de300f9a-7f9a-418f-976f-cc32c041d70f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:51.780730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de300f9a-7f9a-418f-976f-cc32c041d70f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:51.781551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de300f9a-7f9a-418f-976f-cc32c041d70f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:51.782479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e4f8dab-3ffc-4e31-a339-3cbc88f82cfb tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:51.787106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e4f8dab-3ffc-4e31-a339-3cbc88f82cfb tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:51.792793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e4f8dab-3ffc-4e31-a339-3cbc88f82cfb tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:51.904195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0e4f8dab-3ffc-4e31-a339-3cbc88f82cfb tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:39:52.099945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-de300f9a-7f9a-418f-976f-cc32c041d70f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:52.105807 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0e4f8dab-3ffc-4e31-a339-3cbc88f82cfb tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 204 len: 0 microversion: 2.25 time: 0.384141 Sep 07 12:39:52.111242 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1145/2237] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 12:39:51 2022] DELETE /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:39:52.120671 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-de300f9a-7f9a-418f-976f-cc32c041d70f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc" status: 200 len: 1220 microversion: 2.1 time: 0.419262 Sep 07 12:39:52.129372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c7bd4d08-c16b-458c-92a4-90ff49a1532c req-2b441227-cbe4-4e3e-8dd4-28665a7b049c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f506502-b414-408e-b36a-a61e27b58980", "name": "network-vif-deleted", "tag": "6e1353d6-2e43-4cdf-b8a5-622fd6963e0e"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:39:52.142040 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1093/2238] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:51 2022] GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc => generated 1220 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:52.151051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c7bd4d08-c16b-458c-92a4-90ff49a1532c req-2b441227-cbe4-4e3e-8dd4-28665a7b049c service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:52.151921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c7bd4d08-c16b-458c-92a4-90ff49a1532c req-2b441227-cbe4-4e3e-8dd4-28665a7b049c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:52.152191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c7bd4d08-c16b-458c-92a4-90ff49a1532c req-2b441227-cbe4-4e3e-8dd4-28665a7b049c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:52.170651 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c7bd4d08-c16b-458c-92a4-90ff49a1532c req-2b441227-cbe4-4e3e-8dd4-28665a7b049c service nova] Creating event network-vif-deleted:6e1353d6-2e43-4cdf-b8a5-622fd6963e0e for instance 9f506502-b414-408e-b36a-a61e27b58980 on n-h1-852087-9 Sep 07 12:39:52.180901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-eb273f9a-b389-4320-b5ac-56b8ebbefcbb req-5a8803bc-1b60-4169-a13a-cf0eb1802d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "498a719e-d642-4e9c-9951-d6aacb0a16db", "name": "network-vif-plugged", "status": "completed", "tag": "cfef85c8-c8aa-483d-b48d-d21143e17765"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:39:52.182025 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c7bd4d08-c16b-458c-92a4-90ff49a1532c req-2b441227-cbe4-4e3e-8dd4-28665a7b049c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069324 Sep 07 12:39:52.184835 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1146/2239] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:39:52.200059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-101d4c4f-8cdd-4085-b388-851fd7e27df9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:52.205765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-101d4c4f-8cdd-4085-b388-851fd7e27df9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: e9b81094-ecf8-45b0-b334-e6b2c3b4a058] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:52.225264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-101d4c4f-8cdd-4085-b388-851fd7e27df9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:52.228398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-101d4c4f-8cdd-4085-b388-851fd7e27df9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:52.230192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-101d4c4f-8cdd-4085-b388-851fd7e27df9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:52.233009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-101d4c4f-8cdd-4085-b388-851fd7e27df9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:52.235249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-101d4c4f-8cdd-4085-b388-851fd7e27df9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:52.238765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-101d4c4f-8cdd-4085-b388-851fd7e27df9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:52.244068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-eb273f9a-b389-4320-b5ac-56b8ebbefcbb req-5a8803bc-1b60-4169-a13a-cf0eb1802d6a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:52.248990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-eb273f9a-b389-4320-b5ac-56b8ebbefcbb req-5a8803bc-1b60-4169-a13a-cf0eb1802d6a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:52.253980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-eb273f9a-b389-4320-b5ac-56b8ebbefcbb req-5a8803bc-1b60-4169-a13a-cf0eb1802d6a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:52.330004 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-eb273f9a-b389-4320-b5ac-56b8ebbefcbb req-5a8803bc-1b60-4169-a13a-cf0eb1802d6a service nova] Creating event network-vif-plugged:cfef85c8-c8aa-483d-b48d-d21143e17765 for instance 498a719e-d642-4e9c-9951-d6aacb0a16db on n-h1-852087-9 Sep 07 12:39:52.353348 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-eb273f9a-b389-4320-b5ac-56b8ebbefcbb req-5a8803bc-1b60-4169-a13a-cf0eb1802d6a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207956 Sep 07 12:39:52.368919 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1094/2240] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:39:52.378894 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a99ff17-49b4-46ff-b471-1facd6cfe3a9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:52.391188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4a99ff17-49b4-46ff-b471-1facd6cfe3a9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:52.434026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a99ff17-49b4-46ff-b471-1facd6cfe3a9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:52.439492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a99ff17-49b4-46ff-b471-1facd6cfe3a9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:52.440414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a99ff17-49b4-46ff-b471-1facd6cfe3a9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:52.444210 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a99ff17-49b4-46ff-b471-1facd6cfe3a9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:52.454201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a99ff17-49b4-46ff-b471-1facd6cfe3a9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:52.455110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a99ff17-49b4-46ff-b471-1facd6cfe3a9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:53.785314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-101d4c4f-8cdd-4085-b388-851fd7e27df9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:53.825345 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-101d4c4f-8cdd-4085-b388-851fd7e27df9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058" status: 200 len: 1313 microversion: 2.1 time: 1.631874 Sep 07 12:39:53.827223 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1147/2241] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:52 2022] GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058 => generated 1313 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:53.853369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-188c0b4a-c3df-4ac7-aa0f-37af023a479f tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:53.856649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-188c0b4a-c3df-4ac7-aa0f-37af023a479f tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:53.878867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:39:53.882396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-188c0b4a-c3df-4ac7-aa0f-37af023a479f tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:53.883017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-188c0b4a-c3df-4ac7-aa0f-37af023a479f tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:53.908429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-188c0b4a-c3df-4ac7-aa0f-37af023a479f tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:53.911224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-188c0b4a-c3df-4ac7-aa0f-37af023a479f tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:53.912263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-188c0b4a-c3df-4ac7-aa0f-37af023a479f tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:53.913144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-188c0b4a-c3df-4ac7-aa0f-37af023a479f tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:53.950966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4a99ff17-49b4-46ff-b471-1facd6cfe3a9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:54.012447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4a99ff17-49b4-46ff-b471-1facd6cfe3a9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:54.024245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4a99ff17-49b4-46ff-b471-1facd6cfe3a9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:54.025470 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4a99ff17-49b4-46ff-b471-1facd6cfe3a9 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1732 microversion: 2.25 time: 1.654517 Sep 07 12:39:54.037752 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1095/2242] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:39:52 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1732 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:39:54.070522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-342835e4-8348-46dd-b5fa-cf81566a8b50 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:54.071492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-342835e4-8348-46dd-b5fa-cf81566a8b50 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: 498a719e-d642-4e9c-9951-d6aacb0a16db] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:54.079293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-342835e4-8348-46dd-b5fa-cf81566a8b50 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:54.080080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-342835e4-8348-46dd-b5fa-cf81566a8b50 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:54.080715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-342835e4-8348-46dd-b5fa-cf81566a8b50 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:54.081686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-342835e4-8348-46dd-b5fa-cf81566a8b50 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:54.082322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-342835e4-8348-46dd-b5fa-cf81566a8b50 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:54.082920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-342835e4-8348-46dd-b5fa-cf81566a8b50 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:54.779007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-342835e4-8348-46dd-b5fa-cf81566a8b50 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:54.829270 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-342835e4-8348-46dd-b5fa-cf81566a8b50 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db" status: 200 len: 1323 microversion: 2.1 time: 0.762444 Sep 07 12:39:54.840028 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1096/2243] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:54 2022] GET /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db => generated 1323 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:54.878700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-188c0b4a-c3df-4ac7-aa0f-37af023a479f tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d991fa2c5754b14a7a0e638b486f06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d453f24efa048f0a67ab7834d0005c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:54.907043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9637c026-c472-4a7b-8f2f-2b884010ad67 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:54.907525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9637c026-c472-4a7b-8f2f-2b884010ad67 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 9f506502-b414-408e-b36a-a61e27b58980] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:54.907665 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-188c0b4a-c3df-4ac7-aa0f-37af023a479f tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f" status: 200 len: 1304 microversion: 2.1 time: 1.075261 Sep 07 12:39:54.908883 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1148/2244] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:53 2022] GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f => generated 1304 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:54.929209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-16b4bda4-354f-4209-9a0b-fb41e15820c1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:54.930490 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-16b4bda4-354f-4209-9a0b-fb41e15820c1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:54.945345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9637c026-c472-4a7b-8f2f-2b884010ad67 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:54.945936 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9637c026-c472-4a7b-8f2f-2b884010ad67 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:54.946418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9637c026-c472-4a7b-8f2f-2b884010ad67 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:54.947152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9637c026-c472-4a7b-8f2f-2b884010ad67 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:54.947612 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9637c026-c472-4a7b-8f2f-2b884010ad67 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:54.948036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9637c026-c472-4a7b-8f2f-2b884010ad67 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:54.955166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16b4bda4-354f-4209-9a0b-fb41e15820c1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:54.955916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16b4bda4-354f-4209-9a0b-fb41e15820c1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:54.956590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16b4bda4-354f-4209-9a0b-fb41e15820c1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:54.957714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16b4bda4-354f-4209-9a0b-fb41e15820c1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:54.958404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16b4bda4-354f-4209-9a0b-fb41e15820c1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:54.959029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16b4bda4-354f-4209-9a0b-fb41e15820c1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:55.005626 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-9637c026-c472-4a7b-8f2f-2b884010ad67 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] HTTP exception thrown: Instance 9f506502-b414-408e-b36a-a61e27b58980 could not be found. Sep 07 12:39:55.011803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9637c026-c472-4a7b-8f2f-2b884010ad67 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Request method failure captured: Sep 07 12:39:55.011803 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980 HTTP/1.1 Sep 07 12:39:55.011803 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:39:55.011803 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:39:55.011803 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:39:55.011803 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:39:55.011803 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:39:55.011803 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:39:55.011803 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:39:55.011803 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:39:55.011803 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI-kQlfcQLorACLQzdYtTfLAYjfzfZ67NLxGmgmKh_xWpac_ei5BT0p7WvRJTQ3OQF_BdKtmk4joe0cgrH1-wFRs4eGPQulhjs6MHBSe19hGr65toe3mL7J9K1C64pnxZIXjdFUI_d7Wy_9-l_t6DtRgirXJxRZFWdrA29tgdfNHFlg Sep 07 12:39:55.011803 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:39:55.011803 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:39:55.011803 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:39:55.011803 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:39:55.011803 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:39:55.011803 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:39:55.011803 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 081286d7e4664e239ace13466a4a9c50 Sep 07 12:39:55.011803 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesTestJSON-627407633 Sep 07 12:39:55.011803 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:39:55.011803 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:39:55.013275 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_081286d7e4664e239ace13466a4a9c50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:39:55.013275 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesTestJSON-627407633 Sep 07 12:39:55.013275 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 081286d7e4664e239ace13466a4a9c50 Sep 07 12:39:55.013275 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesTestJSON-627407633 Sep 07 12:39:55.013275 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ImagesTestJSON-627407633-project Sep 07 12:39:55.013275 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:39:55.013275 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:39:55.013275 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 3d68cf87771f4e9f9caab95adf58b129 Sep 07 12:39:55.013275 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesTestJSON-627407633-project Sep 07 12:39:55.013275 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:39:55.013275 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 9f506502-b414-408e-b36a-a61e27b58980 could not be found. Sep 07 12:39:55.013275 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '9f506502-b414-408e-b36a-a61e27b58980'} Sep 07 12:39:55.014026 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:39:55.014026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:55.014026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:39:55.014026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:39:55.014026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:39:55.014026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:39:55.014026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:39:55.014026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:39:55.014026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:39:55.014026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:39:55.014026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f506502-b414-408e-b36a-a61e27b58980 could not be found. Sep 07 12:39:55.014026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:55.014026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:55.014026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:55.014026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:55.014026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:55.014026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:55.014026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:39:55.014026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:39:55.014026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:39:55.015103 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:39:55.015103 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:39:55.015103 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:39:55.015103 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:39:55.015103 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:39:55.015103 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:39:55.015103 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:39:55.015103 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f506502-b414-408e-b36a-a61e27b58980 could not be found. Sep 07 12:39:55.015103 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:55.015103 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:55.015103 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:55.015103 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:55.015103 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:55.015103 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:55.015103 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:39:55.015103 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:39:55.015103 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f506502-b414-408e-b36a-a61e27b58980 could not be found. Sep 07 12:39:55.015103 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:55.017642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9637c026-c472-4a7b-8f2f-2b884010ad67 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Returning 404 to user: Instance 9f506502-b414-408e-b36a-a61e27b58980 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:39:55.018811 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9637c026-c472-4a7b-8f2f-2b884010ad67 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980" status: 404 len: 111 microversion: 2.1 time: 0.150326 Sep 07 12:39:55.019616 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1097/2245] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:54 2022] GET /compute/v2.1/servers/9f506502-b414-408e-b36a-a61e27b58980 => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:39:55.032743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a07e0ac3-9322-4d08-834c-7d91606bb073 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:55.033755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a07e0ac3-9322-4d08-834c-7d91606bb073 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: e9b81094-ecf8-45b0-b334-e6b2c3b4a058] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:55.040538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a07e0ac3-9322-4d08-834c-7d91606bb073 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:55.041407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a07e0ac3-9322-4d08-834c-7d91606bb073 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:55.042133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a07e0ac3-9322-4d08-834c-7d91606bb073 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:55.043088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a07e0ac3-9322-4d08-834c-7d91606bb073 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:55.043768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a07e0ac3-9322-4d08-834c-7d91606bb073 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:55.044406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a07e0ac3-9322-4d08-834c-7d91606bb073 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:55.186602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-16b4bda4-354f-4209-9a0b-fb41e15820c1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:55.215180 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-16b4bda4-354f-4209-9a0b-fb41e15820c1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc" status: 200 len: 1274 microversion: 2.1 time: 0.304524 Sep 07 12:39:55.218066 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1149/2246] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:54 2022] GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc => generated 1274 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:55.234727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b595341-2c3f-40d4-9c89-f65ba4de93f2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41d107a60>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:55.305063 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-2b595341-2c3f-40d4-9c89-f65ba4de93f2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] HTTP exception thrown: Image not found. Sep 07 12:39:55.307158 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b595341-2c3f-40d4-9c89-f65ba4de93f2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Request method failure captured: Sep 07 12:39:55.307158 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c HTTP/1.1 Sep 07 12:39:55.307158 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:39:55.307158 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:39:55.307158 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:39:55.307158 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:39:55.307158 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:39:55.307158 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:39:55.307158 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:39:55.307158 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:39:55.307158 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI-kQlfcQLorACLQzdYtTfLAYjfzfZ67NLxGmgmKh_xWpac_ei5BT0p7WvRJTQ3OQF_BdKtmk4joe0cgrH1-wFRs4eGPQulhjs6MHBSe19hGr65toe3mL7J9K1C64pnxZIXjdFUI_d7Wy_9-l_t6DtRgirXJxRZFWdrA29tgdfNHFlg Sep 07 12:39:55.307158 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:39:55.307158 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:39:55.307158 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:39:55.307158 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:39:55.307158 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:39:55.307158 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:39:55.307158 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 081286d7e4664e239ace13466a4a9c50 Sep 07 12:39:55.307158 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesTestJSON-627407633 Sep 07 12:39:55.307158 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:39:55.307158 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:39:55.308316 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_081286d7e4664e239ace13466a4a9c50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:39:55.308316 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesTestJSON-627407633 Sep 07 12:39:55.308316 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 081286d7e4664e239ace13466a4a9c50 Sep 07 12:39:55.308316 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesTestJSON-627407633 Sep 07 12:39:55.308316 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ImagesTestJSON-627407633-project Sep 07 12:39:55.308316 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:39:55.308316 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:39:55.308316 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 3d68cf87771f4e9f9caab95adf58b129 Sep 07 12:39:55.308316 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesTestJSON-627407633-project Sep 07 12:39:55.308316 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:39:55.308316 n-d-852087-9 devstack@n-api.service[122432]: exception: Image not found. Sep 07 12:39:55.308316 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '32d7d237-eb37-4603-bdde-54818b345c5c'} Sep 07 12:39:55.308316 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:39:55.308316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:55.309023 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 07 12:39:55.309023 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 07 12:39:55.309023 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:39:55.309023 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:39:55.309023 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:39:55.309023 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:39:55.309023 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 07 12:39:55.309023 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 07 12:39:55.309023 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 07 12:39:55.309023 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 07 12:39:55.309023 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:39:55.309023 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:39:55.309023 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:39:55.309023 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:39:55.309023 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 32d7d237-eb37-4603-bdde-54818b345c5c to delete Sep 07 12:39:55.309023 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:55.309023 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:55.309023 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:55.309023 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:55.310061 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 07 12:39:55.310061 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 07 12:39:55.310061 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 07 12:39:55.310061 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 07 12:39:55.310061 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 07 12:39:55.310061 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 07 12:39:55.310061 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 32d7d237-eb37-4603-bdde-54818b345c5c could not be found. Sep 07 12:39:55.310061 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:55.310061 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:55.310061 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:55.310061 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:55.310061 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:55.310061 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:55.310061 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:39:55.310061 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:39:55.310061 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:39:55.310061 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:39:55.310061 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:39:55.310061 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:39:55.310061 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 07 12:39:55.311137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 12:39:55.311137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 12:39:55.311137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:55.311137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:55.311137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:55.311137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:55.311137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:55.311137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:55.311137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:39:55.311137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:39:55.311137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 12:39:55.311137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:55.314091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b595341-2c3f-40d4-9c89-f65ba4de93f2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Returning 404 to user: Image not found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:39:55.315202 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2b595341-2c3f-40d4-9c89-f65ba4de93f2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "DELETE /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c" status: 404 len: 62 microversion: 2.1 time: 0.094704 Sep 07 12:39:55.315992 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1150/2247] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:55 2022] DELETE /compute/v2.1/images/32d7d237-eb37-4603-bdde-54818b345c5c => generated 62 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:39:55.322317 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-93c496e7-4d64-44c2-828e-d1e7f0d35a4e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:55.323398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-93c496e7-4d64-44c2-828e-d1e7f0d35a4e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:55.345575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93c496e7-4d64-44c2-828e-d1e7f0d35a4e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:55.346393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93c496e7-4d64-44c2-828e-d1e7f0d35a4e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:55.347056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93c496e7-4d64-44c2-828e-d1e7f0d35a4e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:55.348022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93c496e7-4d64-44c2-828e-d1e7f0d35a4e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:55.348700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93c496e7-4d64-44c2-828e-d1e7f0d35a4e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:55.349343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93c496e7-4d64-44c2-828e-d1e7f0d35a4e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:55.650981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a07e0ac3-9322-4d08-834c-7d91606bb073 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:55.709181 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a07e0ac3-9322-4d08-834c-7d91606bb073 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058" status: 200 len: 1313 microversion: 2.1 time: 0.665397 Sep 07 12:39:55.710417 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1098/2248] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:55 2022] GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058 => generated 1313 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:55.736838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-19c3dc46-f131-44b5-9ccf-9cff2e879e04 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:55.737789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-19c3dc46-f131-44b5-9ccf-9cff2e879e04 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2c8319cb-1eff-4ea4-9b2f-37ac6035c490] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:55.779283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19c3dc46-f131-44b5-9ccf-9cff2e879e04 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:55.780412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19c3dc46-f131-44b5-9ccf-9cff2e879e04 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:55.781276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19c3dc46-f131-44b5-9ccf-9cff2e879e04 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:55.782646 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19c3dc46-f131-44b5-9ccf-9cff2e879e04 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:55.783706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19c3dc46-f131-44b5-9ccf-9cff2e879e04 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:55.784592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19c3dc46-f131-44b5-9ccf-9cff2e879e04 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:55.862351 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-19c3dc46-f131-44b5-9ccf-9cff2e879e04 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] HTTP exception thrown: Instance 2c8319cb-1eff-4ea4-9b2f-37ac6035c490 could not be found. Sep 07 12:39:55.866616 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-19c3dc46-f131-44b5-9ccf-9cff2e879e04 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Request method failure captured: Sep 07 12:39:55.866616 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490 HTTP/1.1 Sep 07 12:39:55.866616 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:39:55.866616 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:39:55.866616 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:39:55.866616 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:39:55.866616 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:39:55.866616 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:39:55.866616 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:39:55.866616 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:39:55.866616 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI-kQlfcQLorACLQzdYtTfLAYjfzfZ67NLxGmgmKh_xWpac_ei5BT0p7WvRJTQ3OQF_BdKtmk4joe0cgrH1-wFRs4eGPQulhjs6MHBSe19hGr65toe3mL7J9K1C64pnxZIXjdFUI_d7Wy_9-l_t6DtRgirXJxRZFWdrA29tgdfNHFlg Sep 07 12:39:55.866616 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:39:55.866616 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:39:55.866616 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:39:55.866616 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:39:55.866616 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:39:55.866616 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:39:55.866616 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 081286d7e4664e239ace13466a4a9c50 Sep 07 12:39:55.866616 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesTestJSON-627407633 Sep 07 12:39:55.866616 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:39:55.866616 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:39:55.868110 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_081286d7e4664e239ace13466a4a9c50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:39:55.868110 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesTestJSON-627407633 Sep 07 12:39:55.868110 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 081286d7e4664e239ace13466a4a9c50 Sep 07 12:39:55.868110 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesTestJSON-627407633 Sep 07 12:39:55.868110 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ImagesTestJSON-627407633-project Sep 07 12:39:55.868110 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:39:55.868110 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:39:55.868110 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 3d68cf87771f4e9f9caab95adf58b129 Sep 07 12:39:55.868110 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesTestJSON-627407633-project Sep 07 12:39:55.868110 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:39:55.868110 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 2c8319cb-1eff-4ea4-9b2f-37ac6035c490 could not be found. Sep 07 12:39:55.868110 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '2c8319cb-1eff-4ea4-9b2f-37ac6035c490'} Sep 07 12:39:55.868873 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:39:55.868873 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:55.868873 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:39:55.868873 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:39:55.868873 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:39:55.868873 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:39:55.868873 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:39:55.868873 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:39:55.868873 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:39:55.868873 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:39:55.868873 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c8319cb-1eff-4ea4-9b2f-37ac6035c490 could not be found. Sep 07 12:39:55.868873 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:55.868873 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:55.868873 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:55.868873 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:55.868873 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:55.868873 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:55.868873 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:39:55.868873 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:39:55.868873 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:39:55.870272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:39:55.870272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:39:55.870272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:39:55.870272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:39:55.870272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:39:55.870272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:39:55.870272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:39:55.870272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:39:55.870272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:39:55.870272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c8319cb-1eff-4ea4-9b2f-37ac6035c490 could not be found. Sep 07 12:39:55.870272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:55.870272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:55.870272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:55.870272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:55.870272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:55.870272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:55.870272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:39:55.870272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:39:55.870272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c8319cb-1eff-4ea4-9b2f-37ac6035c490 could not be found. Sep 07 12:39:55.870272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:39:55.871547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-19c3dc46-f131-44b5-9ccf-9cff2e879e04 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Returning 404 to user: Instance 2c8319cb-1eff-4ea4-9b2f-37ac6035c490 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:39:55.872844 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-19c3dc46-f131-44b5-9ccf-9cff2e879e04 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490" status: 404 len: 111 microversion: 2.1 time: 0.152380 Sep 07 12:39:55.921781 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1099/2249] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:39:55 2022] DELETE /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490 => generated 111 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:39:55.942486 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-f7474cb6-8178-4833-8d67-28075c284d41 req-2c5315ba-8f46-4969-ba9d-ced8fea5a2ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9b81094-ecf8-45b0-b334-e6b2c3b4a058", "name": "network-vif-plugged", "status": "completed", "tag": "1c4458c2-7f0b-4622-b2d2-fe887eff5433"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:39:55.995194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f7474cb6-8178-4833-8d67-28075c284d41 req-2c5315ba-8f46-4969-ba9d-ced8fea5a2ff service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:56.000079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f7474cb6-8178-4833-8d67-28075c284d41 req-2c5315ba-8f46-4969-ba9d-ced8fea5a2ff service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:56.007460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f7474cb6-8178-4833-8d67-28075c284d41 req-2c5315ba-8f46-4969-ba9d-ced8fea5a2ff service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:56.077129 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-f7474cb6-8178-4833-8d67-28075c284d41 req-2c5315ba-8f46-4969-ba9d-ced8fea5a2ff service nova] Creating event network-vif-plugged:1c4458c2-7f0b-4622-b2d2-fe887eff5433 for instance e9b81094-ecf8-45b0-b334-e6b2c3b4a058 on n-h2-852087-9 Sep 07 12:39:56.097159 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-f7474cb6-8178-4833-8d67-28075c284d41 req-2c5315ba-8f46-4969-ba9d-ced8fea5a2ff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173035 Sep 07 12:39:56.110708 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1100/2250] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:39:56.141092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8a03f7a1-8809-4f0d-a39c-26461cce97db tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:56.143108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8a03f7a1-8809-4f0d-a39c-26461cce97db tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: 498a719e-d642-4e9c-9951-d6aacb0a16db] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:56.164943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a03f7a1-8809-4f0d-a39c-26461cce97db tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:56.166230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a03f7a1-8809-4f0d-a39c-26461cce97db tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:56.167291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a03f7a1-8809-4f0d-a39c-26461cce97db tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:56.168939 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a03f7a1-8809-4f0d-a39c-26461cce97db tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:56.177336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a03f7a1-8809-4f0d-a39c-26461cce97db tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:56.178635 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a03f7a1-8809-4f0d-a39c-26461cce97db tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:57.282868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-93c496e7-4d64-44c2-828e-d1e7f0d35a4e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:57.305964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-93c496e7-4d64-44c2-828e-d1e7f0d35a4e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:57.330354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-93c496e7-4d64-44c2-828e-d1e7f0d35a4e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:57.333386 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-93c496e7-4d64-44c2-828e-d1e7f0d35a4e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1732 microversion: 2.25 time: 2.015767 Sep 07 12:39:57.335406 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1151/2251] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:39:55 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1732 bytes in 2018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:39:57.351539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2477f636-e025-47b6-97ea-2ceb8e6dbf69 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:57.353285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2477f636-e025-47b6-97ea-2ceb8e6dbf69 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2c8319cb-1eff-4ea4-9b2f-37ac6035c490] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:57.380627 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2477f636-e025-47b6-97ea-2ceb8e6dbf69 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:57.381913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2477f636-e025-47b6-97ea-2ceb8e6dbf69 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:57.390897 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2477f636-e025-47b6-97ea-2ceb8e6dbf69 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:57.392797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2477f636-e025-47b6-97ea-2ceb8e6dbf69 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:57.394036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2477f636-e025-47b6-97ea-2ceb8e6dbf69 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:57.395189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2477f636-e025-47b6-97ea-2ceb8e6dbf69 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:57.442386 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-2477f636-e025-47b6-97ea-2ceb8e6dbf69 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] HTTP exception thrown: Instance 2c8319cb-1eff-4ea4-9b2f-37ac6035c490 could not be found. Sep 07 12:39:57.444625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2477f636-e025-47b6-97ea-2ceb8e6dbf69 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Request method failure captured: Sep 07 12:39:57.444625 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490 HTTP/1.1 Sep 07 12:39:57.444625 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:39:57.444625 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:39:57.444625 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:39:57.444625 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:39:57.444625 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:39:57.444625 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:39:57.444625 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:39:57.444625 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:39:57.444625 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI-kQlfcQLorACLQzdYtTfLAYjfzfZ67NLxGmgmKh_xWpac_ei5BT0p7WvRJTQ3OQF_BdKtmk4joe0cgrH1-wFRs4eGPQulhjs6MHBSe19hGr65toe3mL7J9K1C64pnxZIXjdFUI_d7Wy_9-l_t6DtRgirXJxRZFWdrA29tgdfNHFlg Sep 07 12:39:57.444625 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:39:57.444625 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:39:57.444625 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:39:57.444625 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:39:57.444625 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:39:57.444625 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:39:57.444625 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 081286d7e4664e239ace13466a4a9c50 Sep 07 12:39:57.444625 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesTestJSON-627407633 Sep 07 12:39:57.444625 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:39:57.444625 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:39:57.446801 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_081286d7e4664e239ace13466a4a9c50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:39:57.446801 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesTestJSON-627407633 Sep 07 12:39:57.446801 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 081286d7e4664e239ace13466a4a9c50 Sep 07 12:39:57.446801 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesTestJSON-627407633 Sep 07 12:39:57.446801 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ImagesTestJSON-627407633-project Sep 07 12:39:57.446801 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:39:57.446801 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:39:57.446801 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 3d68cf87771f4e9f9caab95adf58b129 Sep 07 12:39:57.446801 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesTestJSON-627407633-project Sep 07 12:39:57.446801 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:39:57.446801 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 2c8319cb-1eff-4ea4-9b2f-37ac6035c490 could not be found. Sep 07 12:39:57.446801 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '2c8319cb-1eff-4ea4-9b2f-37ac6035c490'} Sep 07 12:39:57.447994 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:39:57.447994 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:57.447994 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:39:57.447994 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:39:57.447994 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:39:57.447994 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:39:57.447994 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:39:57.447994 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:39:57.447994 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:39:57.447994 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:39:57.447994 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c8319cb-1eff-4ea4-9b2f-37ac6035c490 could not be found. Sep 07 12:39:57.447994 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:57.447994 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:57.447994 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:57.447994 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:57.447994 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:57.447994 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:57.447994 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:39:57.447994 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:39:57.447994 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:39:57.449894 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:39:57.449894 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:39:57.449894 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:39:57.449894 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:39:57.449894 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:39:57.449894 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:39:57.449894 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:39:57.449894 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c8319cb-1eff-4ea4-9b2f-37ac6035c490 could not be found. Sep 07 12:39:57.449894 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:57.449894 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:57.449894 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:57.449894 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:57.449894 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:57.449894 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:57.449894 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:39:57.449894 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:39:57.449894 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c8319cb-1eff-4ea4-9b2f-37ac6035c490 could not be found. Sep 07 12:39:57.449894 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:57.458639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2477f636-e025-47b6-97ea-2ceb8e6dbf69 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Returning 404 to user: Instance 2c8319cb-1eff-4ea4-9b2f-37ac6035c490 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:39:57.463637 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2477f636-e025-47b6-97ea-2ceb8e6dbf69 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490" status: 404 len: 111 microversion: 2.1 time: 0.122454 Sep 07 12:39:57.473677 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1152/2252] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:57 2022] GET /compute/v2.1/servers/2c8319cb-1eff-4ea4-9b2f-37ac6035c490 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:39:57.489612 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-05c8fbea-5bc0-48c9-a540-2655f85feb74 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:57.491380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-05c8fbea-5bc0-48c9-a540-2655f85feb74 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:57.503490 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05c8fbea-5bc0-48c9-a540-2655f85feb74 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:57.505213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05c8fbea-5bc0-48c9-a540-2655f85feb74 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:57.506389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05c8fbea-5bc0-48c9-a540-2655f85feb74 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:57.508064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05c8fbea-5bc0-48c9-a540-2655f85feb74 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:57.509350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05c8fbea-5bc0-48c9-a540-2655f85feb74 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:57.510519 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05c8fbea-5bc0-48c9-a540-2655f85feb74 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:57.588626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:39:57.883213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8a03f7a1-8809-4f0d-a39c-26461cce97db tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:57.893143 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8a03f7a1-8809-4f0d-a39c-26461cce97db tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db" status: 200 len: 1515 microversion: 2.1 time: 1.780250 Sep 07 12:39:57.898209 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1101/2253] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:56 2022] GET /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db => generated 1515 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:57.916526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dffb3a8e-1af0-4ecc-940b-66229661b413 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:57.917469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dffb3a8e-1af0-4ecc-940b-66229661b413 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:57.930714 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dffb3a8e-1af0-4ecc-940b-66229661b413 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:57.933993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dffb3a8e-1af0-4ecc-940b-66229661b413 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:57.937524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dffb3a8e-1af0-4ecc-940b-66229661b413 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:57.938675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dffb3a8e-1af0-4ecc-940b-66229661b413 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:57.939510 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dffb3a8e-1af0-4ecc-940b-66229661b413 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:57.941293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dffb3a8e-1af0-4ecc-940b-66229661b413 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:58.062443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dffb3a8e-1af0-4ecc-940b-66229661b413 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:58.075330 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dffb3a8e-1af0-4ecc-940b-66229661b413 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc" status: 200 len: 1274 microversion: 2.1 time: 0.175479 Sep 07 12:39:58.098035 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1102/2254] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:57 2022] GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc => generated 1274 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:58.105022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ecbb041-bba8-4f6f-9a45-b853a63bae09 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:58.109865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3ecbb041-bba8-4f6f-9a45-b853a63bae09 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: e9b81094-ecf8-45b0-b334-e6b2c3b4a058] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:58.126363 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ecbb041-bba8-4f6f-9a45-b853a63bae09 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:58.126877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ecbb041-bba8-4f6f-9a45-b853a63bae09 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:58.127337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ecbb041-bba8-4f6f-9a45-b853a63bae09 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:58.128093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ecbb041-bba8-4f6f-9a45-b853a63bae09 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:58.128574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ecbb041-bba8-4f6f-9a45-b853a63bae09 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:58.129015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ecbb041-bba8-4f6f-9a45-b853a63bae09 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:58.577993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-05c8fbea-5bc0-48c9-a540-2655f85feb74 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d991fa2c5754b14a7a0e638b486f06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d453f24efa048f0a67ab7834d0005c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:58.606480 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-05c8fbea-5bc0-48c9-a540-2655f85feb74 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f" status: 200 len: 1304 microversion: 2.1 time: 1.130646 Sep 07 12:39:58.607016 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1153/2255] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:57 2022] GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f => generated 1304 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:58.636259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f3063a9e-cb42-4ddc-be4b-41c0bcd5d0b2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc4197a7c10>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:58.733845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3ecbb041-bba8-4f6f-9a45-b853a63bae09 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:58.738737 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-f3063a9e-cb42-4ddc-be4b-41c0bcd5d0b2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] HTTP exception thrown: Image not found. Sep 07 12:39:58.740263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f3063a9e-cb42-4ddc-be4b-41c0bcd5d0b2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Request method failure captured: Sep 07 12:39:58.740263 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b HTTP/1.1 Sep 07 12:39:58.740263 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:39:58.740263 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:39:58.740263 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:39:58.740263 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:39:58.740263 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:39:58.740263 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:39:58.740263 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:39:58.740263 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:39:58.740263 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI-kQlfcQLorACLQzdYtTfLAYjfzfZ67NLxGmgmKh_xWpac_ei5BT0p7WvRJTQ3OQF_BdKtmk4joe0cgrH1-wFRs4eGPQulhjs6MHBSe19hGr65toe3mL7J9K1C64pnxZIXjdFUI_d7Wy_9-l_t6DtRgirXJxRZFWdrA29tgdfNHFlg Sep 07 12:39:58.740263 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:39:58.740263 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:39:58.740263 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:39:58.740263 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:39:58.740263 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:39:58.740263 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:39:58.740263 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 081286d7e4664e239ace13466a4a9c50 Sep 07 12:39:58.740263 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesTestJSON-627407633 Sep 07 12:39:58.740263 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:39:58.740263 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:39:58.743350 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_081286d7e4664e239ace13466a4a9c50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:39:58.743350 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesTestJSON-627407633 Sep 07 12:39:58.743350 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 081286d7e4664e239ace13466a4a9c50 Sep 07 12:39:58.743350 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesTestJSON-627407633 Sep 07 12:39:58.743350 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ImagesTestJSON-627407633-project Sep 07 12:39:58.743350 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:39:58.743350 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:39:58.743350 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 3d68cf87771f4e9f9caab95adf58b129 Sep 07 12:39:58.743350 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesTestJSON-627407633-project Sep 07 12:39:58.743350 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:39:58.743350 n-d-852087-9 devstack@n-api.service[122432]: exception: Image not found. Sep 07 12:39:58.743350 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '58af9084-5a9f-4dd8-9e87-5cc39501226b'} Sep 07 12:39:58.743350 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:39:58.743350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:58.752117 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 07 12:39:58.752117 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 07 12:39:58.752117 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:39:58.752117 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:39:58.752117 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:39:58.752117 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:39:58.752117 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 07 12:39:58.752117 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 07 12:39:58.752117 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 07 12:39:58.752117 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 07 12:39:58.752117 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:39:58.752117 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:39:58.752117 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:39:58.752117 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:39:58.752117 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 58af9084-5a9f-4dd8-9e87-5cc39501226b to delete Sep 07 12:39:58.752117 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:58.752117 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:58.752117 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:58.752117 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:58.755545 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 07 12:39:58.755545 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 07 12:39:58.755545 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 07 12:39:58.755545 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 07 12:39:58.755545 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 07 12:39:58.755545 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 07 12:39:58.755545 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 58af9084-5a9f-4dd8-9e87-5cc39501226b could not be found. Sep 07 12:39:58.755545 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:58.755545 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:58.755545 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:58.755545 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:58.755545 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:58.755545 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:58.755545 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:39:58.755545 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:39:58.755545 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:39:58.755545 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:39:58.755545 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:39:58.755545 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:39:58.755545 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 07 12:39:58.761134 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 12:39:58.761134 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 12:39:58.761134 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:58.761134 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:58.761134 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:58.761134 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:58.761134 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:58.761134 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:58.761134 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:39:58.761134 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:39:58.761134 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 12:39:58.761134 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:58.761134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f3063a9e-cb42-4ddc-be4b-41c0bcd5d0b2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Returning 404 to user: Image not found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:39:58.761134 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f3063a9e-cb42-4ddc-be4b-41c0bcd5d0b2 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "DELETE /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b" status: 404 len: 62 microversion: 2.1 time: 0.133386 Sep 07 12:39:58.761134 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1154/2256] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:58 2022] DELETE /compute/v2.1/images/58af9084-5a9f-4dd8-9e87-5cc39501226b => generated 62 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:39:58.764804 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-fa3dbddc-73f1-4201-8d92-9084ddd51e65 req-4296ba4a-1762-491e-bf7c-bceb961b911f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71999ea2-9256-4783-8614-0d28d11aab2f", "tag": "175df065-8068-401b-adb5-2c7be0ceb530"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:39:58.768100 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ecbb041-bba8-4f6f-9a45-b853a63bae09 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058" status: 200 len: 1313 microversion: 2.1 time: 0.665379 Sep 07 12:39:58.768772 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1103/2257] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:58 2022] GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058 => generated 1313 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:39:58.794832 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-250c177b-fb9d-436a-9415-154262d0fd67 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:58.799292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-250c177b-fb9d-436a-9415-154262d0fd67 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: d610675f-fc02-46f7-a980-33b6ee582c4d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:58.806782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fa3dbddc-73f1-4201-8d92-9084ddd51e65 req-4296ba4a-1762-491e-bf7c-bceb961b911f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:58.807283 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fa3dbddc-73f1-4201-8d92-9084ddd51e65 req-4296ba4a-1762-491e-bf7c-bceb961b911f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:58.807732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fa3dbddc-73f1-4201-8d92-9084ddd51e65 req-4296ba4a-1762-491e-bf7c-bceb961b911f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:58.815817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-250c177b-fb9d-436a-9415-154262d0fd67 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:58.818323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-250c177b-fb9d-436a-9415-154262d0fd67 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:58.822145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-250c177b-fb9d-436a-9415-154262d0fd67 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:58.825327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-250c177b-fb9d-436a-9415-154262d0fd67 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:58.829131 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-250c177b-fb9d-436a-9415-154262d0fd67 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:58.830754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-250c177b-fb9d-436a-9415-154262d0fd67 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:58.837947 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-fa3dbddc-73f1-4201-8d92-9084ddd51e65 req-4296ba4a-1762-491e-bf7c-bceb961b911f service nova] Creating event network-changed:175df065-8068-401b-adb5-2c7be0ceb530 for instance 71999ea2-9256-4783-8614-0d28d11aab2f on n-h1-852087-9 Sep 07 12:39:58.851671 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-fa3dbddc-73f1-4201-8d92-9084ddd51e65 req-4296ba4a-1762-491e-bf7c-bceb961b911f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106258 Sep 07 12:39:58.858019 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1155/2258] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:39:58.875230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-445b8074-1a77-477a-9e42-a7aa9104472e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:58.879078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-445b8074-1a77-477a-9e42-a7aa9104472e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:58.899534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-445b8074-1a77-477a-9e42-a7aa9104472e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:58.904938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-445b8074-1a77-477a-9e42-a7aa9104472e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:58.906129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-445b8074-1a77-477a-9e42-a7aa9104472e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:58.907261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-445b8074-1a77-477a-9e42-a7aa9104472e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:58.911039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-445b8074-1a77-477a-9e42-a7aa9104472e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:58.911806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-445b8074-1a77-477a-9e42-a7aa9104472e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:59.012254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-445b8074-1a77-477a-9e42-a7aa9104472e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:59.012785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-445b8074-1a77-477a-9e42-a7aa9104472e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:59.019517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-445b8074-1a77-477a-9e42-a7aa9104472e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:59.020166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-445b8074-1a77-477a-9e42-a7aa9104472e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lazy-loading 'fault' on Instance uuid f070fedf-8028-43e3-97f9-8955e81dc84b {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:39:59.459127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-445b8074-1a77-477a-9e42-a7aa9104472e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:59.479822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-445b8074-1a77-477a-9e42-a7aa9104472e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:59.489174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-445b8074-1a77-477a-9e42-a7aa9104472e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:39:59.499065 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-445b8074-1a77-477a-9e42-a7aa9104472e tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 200 len: 1376 microversion: 2.25 time: 0.634665 Sep 07 12:39:59.499841 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1156/2259] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:39:58 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 1376 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:39:59.511569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c28da066-f7ec-4d04-98b8-c0bd258b97c2 req-f58f7754-a8f9-497a-ac54-091b9ffcb61d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f070fedf-8028-43e3-97f9-8955e81dc84b", "name": "network-vif-deleted", "tag": "236bdb6a-10c1-409a-9ceb-084851be8590"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:39:59.536228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c28da066-f7ec-4d04-98b8-c0bd258b97c2 req-f58f7754-a8f9-497a-ac54-091b9ffcb61d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:59.536724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c28da066-f7ec-4d04-98b8-c0bd258b97c2 req-f58f7754-a8f9-497a-ac54-091b9ffcb61d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:59.541952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c28da066-f7ec-4d04-98b8-c0bd258b97c2 req-f58f7754-a8f9-497a-ac54-091b9ffcb61d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:59.574177 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c28da066-f7ec-4d04-98b8-c0bd258b97c2 req-f58f7754-a8f9-497a-ac54-091b9ffcb61d service nova] Creating event network-vif-deleted:236bdb6a-10c1-409a-9ceb-084851be8590 for instance f070fedf-8028-43e3-97f9-8955e81dc84b on n-h1-852087-9 Sep 07 12:39:59.591357 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c28da066-f7ec-4d04-98b8-c0bd258b97c2 req-f58f7754-a8f9-497a-ac54-091b9ffcb61d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089077 Sep 07 12:39:59.593661 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1157/2260] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:39:59.610975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6cc5ce1b-1cf5-4583-8fc0-0a9118b63462 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:59.615131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6cc5ce1b-1cf5-4583-8fc0-0a9118b63462 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:59.636733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cc5ce1b-1cf5-4583-8fc0-0a9118b63462 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:59.638129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cc5ce1b-1cf5-4583-8fc0-0a9118b63462 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:59.639238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cc5ce1b-1cf5-4583-8fc0-0a9118b63462 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:59.641010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cc5ce1b-1cf5-4583-8fc0-0a9118b63462 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:59.644275 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cc5ce1b-1cf5-4583-8fc0-0a9118b63462 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:59.645830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cc5ce1b-1cf5-4583-8fc0-0a9118b63462 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:59.691020 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-6cc5ce1b-1cf5-4583-8fc0-0a9118b63462 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] HTTP exception thrown: Instance 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 could not be found. Sep 07 12:39:59.697971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6cc5ce1b-1cf5-4583-8fc0-0a9118b63462 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Request method failure captured: Sep 07 12:39:59.697971 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 HTTP/1.1 Sep 07 12:39:59.697971 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:39:59.697971 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:39:59.697971 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:39:59.697971 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:39:59.697971 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:39:59.697971 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:39:59.697971 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:39:59.697971 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:39:59.697971 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI-kQlfcQLorACLQzdYtTfLAYjfzfZ67NLxGmgmKh_xWpac_ei5BT0p7WvRJTQ3OQF_BdKtmk4joe0cgrH1-wFRs4eGPQulhjs6MHBSe19hGr65toe3mL7J9K1C64pnxZIXjdFUI_d7Wy_9-l_t6DtRgirXJxRZFWdrA29tgdfNHFlg Sep 07 12:39:59.697971 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:39:59.697971 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:39:59.697971 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:39:59.697971 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:39:59.697971 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:39:59.697971 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:39:59.697971 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 081286d7e4664e239ace13466a4a9c50 Sep 07 12:39:59.697971 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesTestJSON-627407633 Sep 07 12:39:59.697971 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:39:59.697971 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:39:59.699131 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_081286d7e4664e239ace13466a4a9c50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:39:59.699131 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesTestJSON-627407633 Sep 07 12:39:59.699131 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 081286d7e4664e239ace13466a4a9c50 Sep 07 12:39:59.699131 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesTestJSON-627407633 Sep 07 12:39:59.699131 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ImagesTestJSON-627407633-project Sep 07 12:39:59.699131 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:39:59.699131 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:39:59.699131 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 3d68cf87771f4e9f9caab95adf58b129 Sep 07 12:39:59.699131 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesTestJSON-627407633-project Sep 07 12:39:59.699131 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:39:59.699131 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 could not be found. Sep 07 12:39:59.699131 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '03263c2b-a3d1-4f6c-a5c9-ee201f82bb81'} Sep 07 12:39:59.699969 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:39:59.699969 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:59.699969 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:39:59.699969 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:39:59.699969 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:39:59.699969 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:39:59.699969 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:39:59.699969 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:39:59.699969 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:39:59.699969 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:39:59.699969 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 could not be found. Sep 07 12:39:59.699969 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:59.699969 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:59.699969 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:59.699969 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:59.699969 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:59.699969 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:59.699969 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:39:59.699969 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:39:59.699969 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:39:59.700944 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:39:59.700944 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:39:59.700944 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:39:59.700944 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:39:59.700944 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:39:59.700944 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:39:59.700944 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:39:59.700944 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:39:59.700944 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:39:59.700944 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 could not be found. Sep 07 12:39:59.700944 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:59.700944 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:39:59.700944 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:59.700944 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:39:59.700944 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:39:59.700944 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:39:59.700944 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:39:59.700944 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:39:59.700944 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 could not be found. Sep 07 12:39:59.700944 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:39:59.704793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6cc5ce1b-1cf5-4583-8fc0-0a9118b63462 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Returning 404 to user: Instance 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:39:59.707871 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6cc5ce1b-1cf5-4583-8fc0-0a9118b63462 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "DELETE /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 404 len: 111 microversion: 2.1 time: 0.109950 Sep 07 12:39:59.712286 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1158/2261] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:39:59 2022] DELETE /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:39:59.719103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-15391732-413b-4b67-ac82-60727a37ea2c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:39:59.740825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-15391732-413b-4b67-ac82-60727a37ea2c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:39:59.760901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:39:59.776044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15391732-413b-4b67-ac82-60727a37ea2c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:59.779741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15391732-413b-4b67-ac82-60727a37ea2c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:59.782567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15391732-413b-4b67-ac82-60727a37ea2c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:59.785294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15391732-413b-4b67-ac82-60727a37ea2c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:39:59.793386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15391732-413b-4b67-ac82-60727a37ea2c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:39:59.797913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15391732-413b-4b67-ac82-60727a37ea2c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:39:59.893146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=18 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:40:00.097088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-250c177b-fb9d-436a-9415-154262d0fd67 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:00.143013 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-250c177b-fb9d-436a-9415-154262d0fd67 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers/d610675f-fc02-46f7-a980-33b6ee582c4d" status: 200 len: 1515 microversion: 2.1 time: 1.356840 Sep 07 12:40:00.177629 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1104/2262] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:58 2022] GET /compute/v2.1/servers/d610675f-fc02-46f7-a980-33b6ee582c4d => generated 1515 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:00.198724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5db719d9-16de-442c-ad92-9db59b1472b4 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:00.207046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5db719d9-16de-442c-ad92-9db59b1472b4 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:00.220637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5db719d9-16de-442c-ad92-9db59b1472b4 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:00.221334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5db719d9-16de-442c-ad92-9db59b1472b4 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:00.221902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5db719d9-16de-442c-ad92-9db59b1472b4 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:00.223168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5db719d9-16de-442c-ad92-9db59b1472b4 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:00.223737 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5db719d9-16de-442c-ad92-9db59b1472b4 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:00.224256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5db719d9-16de-442c-ad92-9db59b1472b4 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:00.608306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-15391732-413b-4b67-ac82-60727a37ea2c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:00.618247 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-15391732-413b-4b67-ac82-60727a37ea2c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc" status: 200 len: 1316 microversion: 2.1 time: 0.904332 Sep 07 12:40:00.619756 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1159/2263] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:39:59 2022] GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc => generated 1316 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:00.624954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-27b574df-19b1-4d24-a9a0-5199703e994d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:00.626007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-27b574df-19b1-4d24-a9a0-5199703e994d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:00.661357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27b574df-19b1-4d24-a9a0-5199703e994d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:00.666501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27b574df-19b1-4d24-a9a0-5199703e994d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:00.667493 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27b574df-19b1-4d24-a9a0-5199703e994d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:00.668968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27b574df-19b1-4d24-a9a0-5199703e994d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:00.669462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27b574df-19b1-4d24-a9a0-5199703e994d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:00.670144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27b574df-19b1-4d24-a9a0-5199703e994d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:00.690858 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-27b574df-19b1-4d24-a9a0-5199703e994d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] HTTP exception thrown: Instance 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 could not be found. Sep 07 12:40:00.692825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-27b574df-19b1-4d24-a9a0-5199703e994d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Request method failure captured: Sep 07 12:40:00.692825 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 HTTP/1.1 Sep 07 12:40:00.692825 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:40:00.692825 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:40:00.692825 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:40:00.692825 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:40:00.692825 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:40:00.692825 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:40:00.692825 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:40:00.692825 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:40:00.692825 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI-kQlfcQLorACLQzdYtTfLAYjfzfZ67NLxGmgmKh_xWpac_ei5BT0p7WvRJTQ3OQF_BdKtmk4joe0cgrH1-wFRs4eGPQulhjs6MHBSe19hGr65toe3mL7J9K1C64pnxZIXjdFUI_d7Wy_9-l_t6DtRgirXJxRZFWdrA29tgdfNHFlg Sep 07 12:40:00.692825 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:40:00.692825 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:40:00.692825 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:40:00.692825 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:40:00.692825 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:40:00.692825 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:40:00.692825 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 081286d7e4664e239ace13466a4a9c50 Sep 07 12:40:00.692825 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesTestJSON-627407633 Sep 07 12:40:00.692825 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:40:00.692825 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:40:00.693987 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_081286d7e4664e239ace13466a4a9c50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:40:00.693987 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesTestJSON-627407633 Sep 07 12:40:00.693987 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 081286d7e4664e239ace13466a4a9c50 Sep 07 12:40:00.693987 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesTestJSON-627407633 Sep 07 12:40:00.693987 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ImagesTestJSON-627407633-project Sep 07 12:40:00.693987 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:40:00.693987 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:40:00.693987 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 3d68cf87771f4e9f9caab95adf58b129 Sep 07 12:40:00.693987 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesTestJSON-627407633-project Sep 07 12:40:00.693987 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:40:00.693987 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 could not be found. Sep 07 12:40:00.693987 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '03263c2b-a3d1-4f6c-a5c9-ee201f82bb81'} Sep 07 12:40:00.694578 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:40:00.694578 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:00.694578 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:40:00.694578 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:40:00.694578 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:40:00.694578 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:40:00.694578 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:40:00.694578 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:40:00.694578 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:40:00.694578 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:40:00.694578 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 could not be found. Sep 07 12:40:00.694578 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:00.694578 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:00.694578 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:00.694578 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:00.694578 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:00.694578 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:00.694578 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:40:00.694578 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:40:00.694578 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:40:00.695643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:40:00.695643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:40:00.695643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:40:00.695643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:40:00.695643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:40:00.695643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:40:00.695643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:40:00.695643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 could not be found. Sep 07 12:40:00.695643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:00.695643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:00.695643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:00.695643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:00.695643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:00.695643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:00.695643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:40:00.695643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:40:00.695643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 could not be found. Sep 07 12:40:00.695643 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:00.698863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-27b574df-19b1-4d24-a9a0-5199703e994d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Returning 404 to user: Instance 03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:40:00.700050 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-27b574df-19b1-4d24-a9a0-5199703e994d tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81" status: 404 len: 111 microversion: 2.1 time: 0.078999 Sep 07 12:40:00.701152 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1160/2264] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:00 2022] GET /compute/v2.1/servers/03263c2b-a3d1-4f6c-a5c9-ee201f82bb81 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:40:00.706846 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d5f1a0e-0b56-412d-909e-f0e4d8eaa740 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:00.707785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1d5f1a0e-0b56-412d-909e-f0e4d8eaa740 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: e9b81094-ecf8-45b0-b334-e6b2c3b4a058] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:00.714830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d5f1a0e-0b56-412d-909e-f0e4d8eaa740 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:00.715585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d5f1a0e-0b56-412d-909e-f0e4d8eaa740 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:00.716185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d5f1a0e-0b56-412d-909e-f0e4d8eaa740 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:00.717249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d5f1a0e-0b56-412d-909e-f0e4d8eaa740 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:00.718212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d5f1a0e-0b56-412d-909e-f0e4d8eaa740 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:00.718874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d5f1a0e-0b56-412d-909e-f0e4d8eaa740 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:00.746944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5db719d9-16de-442c-ad92-9db59b1472b4 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d991fa2c5754b14a7a0e638b486f06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d453f24efa048f0a67ab7834d0005c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:00.779933 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5db719d9-16de-442c-ad92-9db59b1472b4 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f" status: 200 len: 1292 microversion: 2.1 time: 0.600093 Sep 07 12:40:00.801952 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1105/2265] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:00 2022] GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f => generated 1292 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:00.818482 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-70aff268-854e-4fd9-bd81-c30c5be53e58 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:00.819553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-70aff268-854e-4fd9-bd81-c30c5be53e58 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: 3156895a-b53e-4926-9425-6feaae2d424d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:00.835863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70aff268-854e-4fd9-bd81-c30c5be53e58 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:00.851904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70aff268-854e-4fd9-bd81-c30c5be53e58 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:00.852675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70aff268-854e-4fd9-bd81-c30c5be53e58 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:00.856551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70aff268-854e-4fd9-bd81-c30c5be53e58 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:00.857447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70aff268-854e-4fd9-bd81-c30c5be53e58 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:00.858097 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70aff268-854e-4fd9-bd81-c30c5be53e58 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:01.064585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1d5f1a0e-0b56-412d-909e-f0e4d8eaa740 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:01.079997 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1d5f1a0e-0b56-412d-909e-f0e4d8eaa740 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058" status: 200 len: 1501 microversion: 2.1 time: 0.377450 Sep 07 12:40:01.085905 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1161/2266] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:00 2022] GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058 => generated 1501 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:01.091133 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0cf3de6e-bfe5-4ac2-bbe5-43e7ef112371 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:01.091768 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0cf3de6e-bfe5-4ac2-bbe5-43e7ef112371 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: f070fedf-8028-43e3-97f9-8955e81dc84b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:01.114688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cf3de6e-bfe5-4ac2-bbe5-43e7ef112371 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:01.115539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cf3de6e-bfe5-4ac2-bbe5-43e7ef112371 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:01.116346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cf3de6e-bfe5-4ac2-bbe5-43e7ef112371 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:01.117602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cf3de6e-bfe5-4ac2-bbe5-43e7ef112371 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:01.118347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cf3de6e-bfe5-4ac2-bbe5-43e7ef112371 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:01.118991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0cf3de6e-bfe5-4ac2-bbe5-43e7ef112371 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:01.138684 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-0cf3de6e-bfe5-4ac2-bbe5-43e7ef112371 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] HTTP exception thrown: Instance f070fedf-8028-43e3-97f9-8955e81dc84b could not be found. Sep 07 12:40:01.141176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0cf3de6e-bfe5-4ac2-bbe5-43e7ef112371 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Request method failure captured: Sep 07 12:40:01.141176 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b HTTP/1.1 Sep 07 12:40:01.141176 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:40:01.141176 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:40:01.141176 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:40:01.141176 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:40:01.141176 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:40:01.141176 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:40:01.141176 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:40:01.141176 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:40:01.141176 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI766J91sJuT5F2IEQqMchfKaCbSDDF-J9lwzV5FP6Js_H7pktqjB-3Lio5CpiTElE39UZjTqgIShFlx0VbJgNQCgVyAvoaV1-jKOOUTYFV0esgaVjKSWWfHpfNXej83bOupyFtCRU8lUe_AKArpkP0tH23jA8qcBVLgUCSpGDxJw0U Sep 07 12:40:01.141176 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:40:01.141176 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:40:01.141176 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:40:01.141176 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:40:01.141176 n-d-852087-9 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.25 Sep 07 12:40:01.141176 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:40:01.141176 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:40:01.141176 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 6d7695bab2d84b35bf92bd035da71dc3 Sep 07 12:40:01.141176 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2124170019 Sep 07 12:40:01.141176 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:40:01.141176 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:40:01.142437 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d7695bab2d84b35bf92bd035da71dc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d7695bab2d84b35bf92bd035da71dc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d7695bab2d84b35bf92bd035da71dc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d7695bab2d84b35bf92bd035da71dc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:40:01.142437 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2124170019 Sep 07 12:40:01.142437 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 6d7695bab2d84b35bf92bd035da71dc3 Sep 07 12:40:01.142437 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2124170019 Sep 07 12:40:01.142437 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-LiveAutoBlockMigrationV225Test-2124170019-project Sep 07 12:40:01.142437 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:40:01.142437 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:40:01.142437 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: cf3ae3d912b84a8f906b31874668b740 Sep 07 12:40:01.142437 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2124170019-project Sep 07 12:40:01.142437 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:40:01.142437 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance f070fedf-8028-43e3-97f9-8955e81dc84b could not be found. Sep 07 12:40:01.142437 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'f070fedf-8028-43e3-97f9-8955e81dc84b'} Sep 07 12:40:01.143048 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:40:01.143048 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:01.143048 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:40:01.143048 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:40:01.143048 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:40:01.143048 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:40:01.143048 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:40:01.143048 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:40:01.143048 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:40:01.143048 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:40:01.143048 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f070fedf-8028-43e3-97f9-8955e81dc84b could not be found. Sep 07 12:40:01.143048 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:01.143048 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:01.143048 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:01.143048 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:01.143048 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:01.143048 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:01.143048 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:40:01.143048 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:40:01.143048 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:40:01.143997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:40:01.143997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:40:01.143997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:40:01.143997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:40:01.143997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:40:01.143997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:40:01.143997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:40:01.143997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f070fedf-8028-43e3-97f9-8955e81dc84b could not be found. Sep 07 12:40:01.143997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:01.143997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:01.143997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:01.143997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:01.143997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:01.143997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:01.143997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:40:01.143997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:40:01.143997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f070fedf-8028-43e3-97f9-8955e81dc84b could not be found. Sep 07 12:40:01.143997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:01.147115 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0cf3de6e-bfe5-4ac2-bbe5-43e7ef112371 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Returning 404 to user: Instance f070fedf-8028-43e3-97f9-8955e81dc84b could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:40:01.149360 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0cf3de6e-bfe5-4ac2-bbe5-43e7ef112371 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b" status: 404 len: 111 microversion: 2.25 time: 0.061222 Sep 07 12:40:01.150643 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1162/2267] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:40:01 2022] GET /compute/v2.1/servers/f070fedf-8028-43e3-97f9-8955e81dc84b => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:40:01.156375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92c04981-4b06-4db4-95f4-7633b876d333 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '.version_select at 0x7fc41969baf0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:01.195597 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-92c04981-4b06-4db4-95f4-7633b876d333 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] HTTP exception thrown: Image not found. Sep 07 12:40:01.198388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92c04981-4b06-4db4-95f4-7633b876d333 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Request method failure captured: Sep 07 12:40:01.198388 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60 HTTP/1.1 Sep 07 12:40:01.198388 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:40:01.198388 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:40:01.198388 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:40:01.198388 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:40:01.198388 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:40:01.198388 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:40:01.198388 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:40:01.198388 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:40:01.198388 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI-kQlfcQLorACLQzdYtTfLAYjfzfZ67NLxGmgmKh_xWpac_ei5BT0p7WvRJTQ3OQF_BdKtmk4joe0cgrH1-wFRs4eGPQulhjs6MHBSe19hGr65toe3mL7J9K1C64pnxZIXjdFUI_d7Wy_9-l_t6DtRgirXJxRZFWdrA29tgdfNHFlg Sep 07 12:40:01.198388 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:40:01.198388 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:40:01.198388 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:40:01.198388 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:40:01.198388 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:40:01.198388 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:40:01.198388 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 081286d7e4664e239ace13466a4a9c50 Sep 07 12:40:01.198388 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesTestJSON-627407633 Sep 07 12:40:01.198388 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:40:01.198388 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:40:01.199574 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_081286d7e4664e239ace13466a4a9c50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:40:01.199574 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesTestJSON-627407633 Sep 07 12:40:01.199574 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 081286d7e4664e239ace13466a4a9c50 Sep 07 12:40:01.199574 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesTestJSON-627407633 Sep 07 12:40:01.199574 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ImagesTestJSON-627407633-project Sep 07 12:40:01.199574 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:40:01.199574 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:40:01.199574 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 3d68cf87771f4e9f9caab95adf58b129 Sep 07 12:40:01.199574 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesTestJSON-627407633-project Sep 07 12:40:01.199574 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:40:01.199574 n-d-852087-9 devstack@n-api.service[122432]: exception: Image not found. Sep 07 12:40:01.199574 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60'} Sep 07 12:40:01.199574 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:40:01.199574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:01.200321 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 07 12:40:01.200321 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 07 12:40:01.200321 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:40:01.200321 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:40:01.200321 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:40:01.200321 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:40:01.200321 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 07 12:40:01.200321 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 07 12:40:01.200321 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 07 12:40:01.200321 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 07 12:40:01.200321 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:40:01.200321 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:40:01.200321 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:40:01.200321 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:40:01.200321 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60 to delete Sep 07 12:40:01.200321 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:01.200321 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:01.200321 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:01.200321 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:01.201286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 07 12:40:01.201286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 07 12:40:01.201286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 07 12:40:01.201286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 07 12:40:01.201286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 07 12:40:01.201286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 07 12:40:01.201286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60 could not be found. Sep 07 12:40:01.201286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:01.201286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:01.201286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:01.201286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:01.201286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:01.201286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:01.201286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:40:01.201286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:40:01.201286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:40:01.201286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:40:01.201286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:40:01.201286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:40:01.201286 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 07 12:40:01.202344 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 12:40:01.202344 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 12:40:01.202344 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:01.202344 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:01.202344 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:01.202344 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:01.202344 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:01.202344 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:01.202344 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:40:01.202344 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:40:01.202344 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 12:40:01.202344 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:01.206550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92c04981-4b06-4db4-95f4-7633b876d333 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Returning 404 to user: Image not found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:40:01.208599 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-92c04981-4b06-4db4-95f4-7633b876d333 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "DELETE /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60" status: 404 len: 62 microversion: 2.1 time: 0.056687 Sep 07 12:40:01.209815 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1163/2268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:01 2022] DELETE /compute/v2.1/images/3b5b9fcf-54e1-4809-9c7b-a3fc9e94df60 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:40:01.216332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-478ba5df-742f-492c-b8f6-aa5b1b39af1c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:01.218219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-478ba5df-742f-492c-b8f6-aa5b1b39af1c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: e9b81094-ecf8-45b0-b334-e6b2c3b4a058] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:01.232814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-478ba5df-742f-492c-b8f6-aa5b1b39af1c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:01.242951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-70aff268-854e-4fd9-bd81-c30c5be53e58 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:01.245910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-478ba5df-742f-492c-b8f6-aa5b1b39af1c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:01.247063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-478ba5df-742f-492c-b8f6-aa5b1b39af1c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:01.250801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-478ba5df-742f-492c-b8f6-aa5b1b39af1c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:01.253973 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-70aff268-854e-4fd9-bd81-c30c5be53e58 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers/3156895a-b53e-4926-9425-6feaae2d424d" status: 200 len: 1516 microversion: 2.1 time: 0.450740 Sep 07 12:40:01.254387 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-478ba5df-742f-492c-b8f6-aa5b1b39af1c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:01.255512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-478ba5df-742f-492c-b8f6-aa5b1b39af1c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:01.255700 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1106/2269] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:00 2022] GET /compute/v2.1/servers/3156895a-b53e-4926-9425-6feaae2d424d => generated 1516 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:01.274120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-150e1f54-627d-446b-9a24-71907265a389 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '.version_select at 0x7fc4192dcaf0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:01.317752 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-150e1f54-627d-446b-9a24-71907265a389 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1984585193" status: 204 len: 0 microversion: 2.25 time: 0.056479 Sep 07 12:40:01.318947 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1107/2270] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Sep 7 12:40:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1984585193 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:40:01.332636 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-18c29c15-1f37-40c7-b8e0-0213af4f895a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:01.333399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-18c29c15-1f37-40c7-b8e0-0213af4f895a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2f6ee92e-b663-4984-9198-d2ca0f8b3892] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:01.350811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18c29c15-1f37-40c7-b8e0-0213af4f895a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:01.351819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18c29c15-1f37-40c7-b8e0-0213af4f895a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:01.352833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18c29c15-1f37-40c7-b8e0-0213af4f895a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:01.354105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18c29c15-1f37-40c7-b8e0-0213af4f895a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:01.354761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18c29c15-1f37-40c7-b8e0-0213af4f895a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:01.355347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18c29c15-1f37-40c7-b8e0-0213af4f895a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:01.388835 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-18c29c15-1f37-40c7-b8e0-0213af4f895a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] HTTP exception thrown: Instance 2f6ee92e-b663-4984-9198-d2ca0f8b3892 could not be found. Sep 07 12:40:01.391087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-18c29c15-1f37-40c7-b8e0-0213af4f895a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Request method failure captured: Sep 07 12:40:01.391087 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892 HTTP/1.1 Sep 07 12:40:01.391087 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:40:01.391087 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:40:01.391087 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:40:01.391087 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:40:01.391087 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:40:01.391087 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:40:01.391087 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:40:01.391087 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:40:01.391087 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI-kQlfcQLorACLQzdYtTfLAYjfzfZ67NLxGmgmKh_xWpac_ei5BT0p7WvRJTQ3OQF_BdKtmk4joe0cgrH1-wFRs4eGPQulhjs6MHBSe19hGr65toe3mL7J9K1C64pnxZIXjdFUI_d7Wy_9-l_t6DtRgirXJxRZFWdrA29tgdfNHFlg Sep 07 12:40:01.391087 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:40:01.391087 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:40:01.391087 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:40:01.391087 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:40:01.391087 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:40:01.391087 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:40:01.391087 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 081286d7e4664e239ace13466a4a9c50 Sep 07 12:40:01.391087 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesTestJSON-627407633 Sep 07 12:40:01.391087 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:40:01.391087 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:40:01.392503 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_081286d7e4664e239ace13466a4a9c50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:40:01.392503 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesTestJSON-627407633 Sep 07 12:40:01.392503 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 081286d7e4664e239ace13466a4a9c50 Sep 07 12:40:01.392503 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesTestJSON-627407633 Sep 07 12:40:01.392503 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ImagesTestJSON-627407633-project Sep 07 12:40:01.392503 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:40:01.392503 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:40:01.392503 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 3d68cf87771f4e9f9caab95adf58b129 Sep 07 12:40:01.392503 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesTestJSON-627407633-project Sep 07 12:40:01.392503 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:40:01.392503 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 2f6ee92e-b663-4984-9198-d2ca0f8b3892 could not be found. Sep 07 12:40:01.392503 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '2f6ee92e-b663-4984-9198-d2ca0f8b3892'} Sep 07 12:40:01.393347 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:40:01.393347 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:01.393347 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:40:01.393347 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:40:01.393347 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:40:01.393347 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:40:01.393347 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:40:01.393347 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:40:01.393347 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:40:01.393347 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:40:01.393347 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f6ee92e-b663-4984-9198-d2ca0f8b3892 could not be found. Sep 07 12:40:01.393347 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:01.393347 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:01.393347 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:01.393347 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:01.393347 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:01.393347 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:01.393347 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:40:01.393347 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:40:01.393347 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:40:01.394607 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:40:01.394607 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:40:01.394607 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:40:01.394607 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:40:01.394607 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:40:01.394607 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:40:01.394607 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:40:01.394607 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:40:01.394607 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:40:01.394607 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f6ee92e-b663-4984-9198-d2ca0f8b3892 could not be found. Sep 07 12:40:01.394607 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:01.394607 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:01.394607 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:01.394607 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:01.394607 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:01.394607 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:01.394607 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:40:01.394607 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:40:01.394607 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f6ee92e-b663-4984-9198-d2ca0f8b3892 could not be found. Sep 07 12:40:01.394607 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:01.396986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-18c29c15-1f37-40c7-b8e0-0213af4f895a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Returning 404 to user: Instance 2f6ee92e-b663-4984-9198-d2ca0f8b3892 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:40:01.398127 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-18c29c15-1f37-40c7-b8e0-0213af4f895a tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892" status: 404 len: 111 microversion: 2.1 time: 0.077847 Sep 07 12:40:01.399426 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1108/2271] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:40:01 2022] DELETE /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:40:01.413796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8364e796-e2d2-4605-b642-015e33b550fd tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:01.417048 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8364e796-e2d2-4605-b642-015e33b550fd tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: 3156895a-b53e-4926-9425-6feaae2d424d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:01.437805 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8364e796-e2d2-4605-b642-015e33b550fd tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:01.438590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8364e796-e2d2-4605-b642-015e33b550fd tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:01.439175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8364e796-e2d2-4605-b642-015e33b550fd tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:01.440053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8364e796-e2d2-4605-b642-015e33b550fd tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:01.440649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8364e796-e2d2-4605-b642-015e33b550fd tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:01.443937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8364e796-e2d2-4605-b642-015e33b550fd tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:01.456807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:40:01.519124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8364e796-e2d2-4605-b642-015e33b550fd tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: 3156895a-b53e-4926-9425-6feaae2d424d] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:40:01.534179 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-478ba5df-742f-492c-b8f6-aa5b1b39af1c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "POST /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058/action" status: 202 len: 0 microversion: 2.1 time: 0.320335 Sep 07 12:40:01.537644 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1164/2272] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:40:01 2022] POST /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:40:01.560439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-49387f69-af4d-4c9d-aa7a-e48f3f64f820 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:01.563158 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-49387f69-af4d-4c9d-aa7a-e48f3f64f820 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] [instance: 2f6ee92e-b663-4984-9198-d2ca0f8b3892] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:01.594728 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49387f69-af4d-4c9d-aa7a-e48f3f64f820 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:01.596505 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49387f69-af4d-4c9d-aa7a-e48f3f64f820 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:01.597918 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49387f69-af4d-4c9d-aa7a-e48f3f64f820 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:01.601616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49387f69-af4d-4c9d-aa7a-e48f3f64f820 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:01.619139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49387f69-af4d-4c9d-aa7a-e48f3f64f820 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:01.621563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49387f69-af4d-4c9d-aa7a-e48f3f64f820 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:01.675646 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-49387f69-af4d-4c9d-aa7a-e48f3f64f820 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] HTTP exception thrown: Instance 2f6ee92e-b663-4984-9198-d2ca0f8b3892 could not be found. Sep 07 12:40:01.704307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-49387f69-af4d-4c9d-aa7a-e48f3f64f820 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Request method failure captured: Sep 07 12:40:01.704307 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892 HTTP/1.1 Sep 07 12:40:01.704307 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:40:01.704307 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:40:01.704307 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:40:01.704307 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:40:01.704307 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:40:01.704307 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:40:01.704307 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:40:01.704307 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:40:01.704307 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI-kQlfcQLorACLQzdYtTfLAYjfzfZ67NLxGmgmKh_xWpac_ei5BT0p7WvRJTQ3OQF_BdKtmk4joe0cgrH1-wFRs4eGPQulhjs6MHBSe19hGr65toe3mL7J9K1C64pnxZIXjdFUI_d7Wy_9-l_t6DtRgirXJxRZFWdrA29tgdfNHFlg Sep 07 12:40:01.704307 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:40:01.704307 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:40:01.704307 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:40:01.704307 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:40:01.704307 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:40:01.704307 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:40:01.704307 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 081286d7e4664e239ace13466a4a9c50 Sep 07 12:40:01.704307 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesTestJSON-627407633 Sep 07 12:40:01.704307 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:40:01.704307 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:40:01.705620 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_081286d7e4664e239ace13466a4a9c50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/081286d7e4664e239ace13466a4a9c50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:40:01.705620 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesTestJSON-627407633 Sep 07 12:40:01.705620 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 081286d7e4664e239ace13466a4a9c50 Sep 07 12:40:01.705620 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesTestJSON-627407633 Sep 07 12:40:01.705620 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ImagesTestJSON-627407633-project Sep 07 12:40:01.705620 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:40:01.705620 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:40:01.705620 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 3d68cf87771f4e9f9caab95adf58b129 Sep 07 12:40:01.705620 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesTestJSON-627407633-project Sep 07 12:40:01.705620 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:40:01.705620 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 2f6ee92e-b663-4984-9198-d2ca0f8b3892 could not be found. Sep 07 12:40:01.705620 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '2f6ee92e-b663-4984-9198-d2ca0f8b3892'} Sep 07 12:40:01.706224 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:40:01.706224 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:01.706224 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:40:01.706224 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:40:01.706224 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:40:01.706224 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:40:01.706224 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:40:01.706224 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:40:01.706224 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:40:01.706224 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:40:01.706224 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f6ee92e-b663-4984-9198-d2ca0f8b3892 could not be found. Sep 07 12:40:01.706224 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:01.706224 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:01.706224 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:01.706224 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:01.706224 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:01.706224 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:01.706224 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:40:01.706224 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:40:01.706224 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:40:01.707237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:40:01.707237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:40:01.707237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:40:01.707237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:40:01.707237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:40:01.707237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:40:01.707237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:40:01.707237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f6ee92e-b663-4984-9198-d2ca0f8b3892 could not be found. Sep 07 12:40:01.707237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:01.707237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:01.707237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:01.707237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:01.707237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:01.707237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:01.707237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:40:01.707237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:40:01.707237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f6ee92e-b663-4984-9198-d2ca0f8b3892 could not be found. Sep 07 12:40:01.707237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:01.712237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-49387f69-af4d-4c9d-aa7a-e48f3f64f820 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] Returning 404 to user: Instance 2f6ee92e-b663-4984-9198-d2ca0f8b3892 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:40:01.713671 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8364e796-e2d2-4605-b642-015e33b550fd tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3156895a-b53e-4926-9425-6feaae2d424d" status: 204 len: 0 microversion: 2.1 time: 0.312580 Sep 07 12:40:01.717712 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1109/2273] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:40:01 2022] DELETE /compute/v2.1/servers/3156895a-b53e-4926-9425-6feaae2d424d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:40:01.720732 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-49387f69-af4d-4c9d-aa7a-e48f3f64f820 tempest-ImagesTestJSON-627407633 tempest-ImagesTestJSON-627407633-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892" status: 404 len: 111 microversion: 2.1 time: 0.180460 Sep 07 12:40:01.722395 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1165/2274] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:01 2022] GET /compute/v2.1/servers/2f6ee92e-b663-4984-9198-d2ca0f8b3892 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:40:01.722669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-68c9a0c0-f2cc-436f-8860-71a20ab17439 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:01.723403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-68c9a0c0-f2cc-436f-8860-71a20ab17439 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: e9b81094-ecf8-45b0-b334-e6b2c3b4a058] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:01.736733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f482f1f9-1a48-41d7-851e-e0ac0c45b4a1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:01.739807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f482f1f9-1a48-41d7-851e-e0ac0c45b4a1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:01.757979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68c9a0c0-f2cc-436f-8860-71a20ab17439 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:01.773610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68c9a0c0-f2cc-436f-8860-71a20ab17439 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:01.775983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68c9a0c0-f2cc-436f-8860-71a20ab17439 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:01.778560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f482f1f9-1a48-41d7-851e-e0ac0c45b4a1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:01.779759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68c9a0c0-f2cc-436f-8860-71a20ab17439 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:01.780622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f482f1f9-1a48-41d7-851e-e0ac0c45b4a1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:01.782626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68c9a0c0-f2cc-436f-8860-71a20ab17439 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:01.783534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f482f1f9-1a48-41d7-851e-e0ac0c45b4a1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:01.784929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68c9a0c0-f2cc-436f-8860-71a20ab17439 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:01.786448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f482f1f9-1a48-41d7-851e-e0ac0c45b4a1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:01.788570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f482f1f9-1a48-41d7-851e-e0ac0c45b4a1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:01.793794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f482f1f9-1a48-41d7-851e-e0ac0c45b4a1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:02.525561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-68c9a0c0-f2cc-436f-8860-71a20ab17439 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:02.551319 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-68c9a0c0-f2cc-436f-8860-71a20ab17439 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058" status: 200 len: 1506 microversion: 2.1 time: 0.835092 Sep 07 12:40:02.552344 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1110/2275] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:01 2022] GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058 => generated 1506 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:02.574136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0da5e239-08ec-439a-9225-c394f91ea887 req-d5cb7e9c-c469-4f59-976a-f08f931e4e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc", "tag": "ae63cbe5-283c-42c7-8611-bf3675d0c6dc"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:02.594361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0da5e239-08ec-439a-9225-c394f91ea887 req-d5cb7e9c-c469-4f59-976a-f08f931e4e1b service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:02.595640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0da5e239-08ec-439a-9225-c394f91ea887 req-d5cb7e9c-c469-4f59-976a-f08f931e4e1b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:02.596638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0da5e239-08ec-439a-9225-c394f91ea887 req-d5cb7e9c-c469-4f59-976a-f08f931e4e1b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:02.627250 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0da5e239-08ec-439a-9225-c394f91ea887 req-d5cb7e9c-c469-4f59-976a-f08f931e4e1b service nova] Creating event network-changed:ae63cbe5-283c-42c7-8611-bf3675d0c6dc for instance b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc on n-h1-852087-9 Sep 07 12:40:02.637268 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0da5e239-08ec-439a-9225-c394f91ea887 req-d5cb7e9c-c469-4f59-976a-f08f931e4e1b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082469 Sep 07 12:40:02.638818 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1111/2276] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:40:02.651696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fcecec00-4f4f-4b79-b013-3e540c4c595f tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:02.653315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fcecec00-4f4f-4b79-b013-3e540c4c595f tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: 3156895a-b53e-4926-9425-6feaae2d424d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:02.665557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcecec00-4f4f-4b79-b013-3e540c4c595f tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:02.666794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcecec00-4f4f-4b79-b013-3e540c4c595f tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:02.667859 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcecec00-4f4f-4b79-b013-3e540c4c595f tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:02.669357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcecec00-4f4f-4b79-b013-3e540c4c595f tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:02.670430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcecec00-4f4f-4b79-b013-3e540c4c595f tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:02.671458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcecec00-4f4f-4b79-b013-3e540c4c595f tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:03.163808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f482f1f9-1a48-41d7-851e-e0ac0c45b4a1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:03.201184 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f482f1f9-1a48-41d7-851e-e0ac0c45b4a1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc" status: 200 len: 1316 microversion: 2.1 time: 1.475330 Sep 07 12:40:03.225670 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1166/2277] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:01 2022] GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc => generated 1316 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:03.242418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d33e6de4-eb73-4c19-897f-273d7bb180c0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:03.243935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d33e6de4-eb73-4c19-897f-273d7bb180c0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:03.254557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d33e6de4-eb73-4c19-897f-273d7bb180c0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:03.255080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d33e6de4-eb73-4c19-897f-273d7bb180c0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:03.256211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d33e6de4-eb73-4c19-897f-273d7bb180c0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:03.257105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d33e6de4-eb73-4c19-897f-273d7bb180c0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:03.257982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d33e6de4-eb73-4c19-897f-273d7bb180c0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:03.258758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d33e6de4-eb73-4c19-897f-273d7bb180c0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:03.478271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fcecec00-4f4f-4b79-b013-3e540c4c595f tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:03.491073 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fcecec00-4f4f-4b79-b013-3e540c4c595f tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers/3156895a-b53e-4926-9425-6feaae2d424d" status: 200 len: 1522 microversion: 2.1 time: 0.849893 Sep 07 12:40:03.492000 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1112/2278] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:02 2022] GET /compute/v2.1/servers/3156895a-b53e-4926-9425-6feaae2d424d => generated 1522 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:03.584230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d2d57ab3-2566-4a94-805f-60b438c67891 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:03.585574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d2d57ab3-2566-4a94-805f-60b438c67891 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: e9b81094-ecf8-45b0-b334-e6b2c3b4a058] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:03.597126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2d57ab3-2566-4a94-805f-60b438c67891 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:03.598849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2d57ab3-2566-4a94-805f-60b438c67891 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:03.600644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2d57ab3-2566-4a94-805f-60b438c67891 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:03.602230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2d57ab3-2566-4a94-805f-60b438c67891 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:03.603319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2d57ab3-2566-4a94-805f-60b438c67891 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:03.604628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2d57ab3-2566-4a94-805f-60b438c67891 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:03.705960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d33e6de4-eb73-4c19-897f-273d7bb180c0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d991fa2c5754b14a7a0e638b486f06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d453f24efa048f0a67ab7834d0005c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:03.716506 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d33e6de4-eb73-4c19-897f-273d7bb180c0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f" status: 200 len: 1292 microversion: 2.1 time: 0.488919 Sep 07 12:40:03.717643 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1167/2279] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:03 2022] GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f => generated 1292 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:03.933316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d2d57ab3-2566-4a94-805f-60b438c67891 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:03.944405 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d2d57ab3-2566-4a94-805f-60b438c67891 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058" status: 200 len: 1486 microversion: 2.1 time: 0.369275 Sep 07 12:40:03.961528 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1113/2280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:03 2022] GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058 => generated 1486 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:03.979851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1bcdf189-a8ef-4c75-93db-9dce14063c29 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:03.980568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1bcdf189-a8ef-4c75-93db-9dce14063c29 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: e9b81094-ecf8-45b0-b334-e6b2c3b4a058] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:03.989196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1bcdf189-a8ef-4c75-93db-9dce14063c29 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:03.989794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1bcdf189-a8ef-4c75-93db-9dce14063c29 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:03.990242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1bcdf189-a8ef-4c75-93db-9dce14063c29 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:03.991050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1bcdf189-a8ef-4c75-93db-9dce14063c29 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:03.991528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1bcdf189-a8ef-4c75-93db-9dce14063c29 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:03.992000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1bcdf189-a8ef-4c75-93db-9dce14063c29 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:04.046560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1bcdf189-a8ef-4c75-93db-9dce14063c29 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: e9b81094-ecf8-45b0-b334-e6b2c3b4a058] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:40:04.253961 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1bcdf189-a8ef-4c75-93db-9dce14063c29 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058" status: 204 len: 0 microversion: 2.1 time: 0.278903 Sep 07 12:40:04.257349 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1168/2281] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:40:03 2022] DELETE /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:40:04.272829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fd35059b-f027-4779-bb44-ab886227f9b3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:04.274774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fd35059b-f027-4779-bb44-ab886227f9b3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:04.281664 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d968da8-0e54-4bb7-afad-e778705c6201 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:04.283650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9d968da8-0e54-4bb7-afad-e778705c6201 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: e9b81094-ecf8-45b0-b334-e6b2c3b4a058] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:04.304373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd35059b-f027-4779-bb44-ab886227f9b3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:04.306607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd35059b-f027-4779-bb44-ab886227f9b3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:04.311095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d968da8-0e54-4bb7-afad-e778705c6201 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:04.312368 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd35059b-f027-4779-bb44-ab886227f9b3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:04.313888 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd35059b-f027-4779-bb44-ab886227f9b3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:04.314896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd35059b-f027-4779-bb44-ab886227f9b3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:04.316301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd35059b-f027-4779-bb44-ab886227f9b3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:04.317575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d968da8-0e54-4bb7-afad-e778705c6201 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:04.323133 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d968da8-0e54-4bb7-afad-e778705c6201 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:04.325210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d968da8-0e54-4bb7-afad-e778705c6201 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:04.327072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d968da8-0e54-4bb7-afad-e778705c6201 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:04.328566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d968da8-0e54-4bb7-afad-e778705c6201 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:05.035813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fd35059b-f027-4779-bb44-ab886227f9b3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:05.037967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9d968da8-0e54-4bb7-afad-e778705c6201 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:05.070029 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9d968da8-0e54-4bb7-afad-e778705c6201 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058" status: 200 len: 1492 microversion: 2.1 time: 0.803208 Sep 07 12:40:05.070919 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1169/2282] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:04 2022] GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058 => generated 1492 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:05.071848 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fd35059b-f027-4779-bb44-ab886227f9b3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc" status: 200 len: 1316 microversion: 2.1 time: 0.815442 Sep 07 12:40:05.091056 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1114/2283] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:04 2022] GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc => generated 1316 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:05.094444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e6b99ae-d846-49ee-9d62-fe23b25f2aab tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:05.095280 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6e6b99ae-d846-49ee-9d62-fe23b25f2aab tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: 3156895a-b53e-4926-9425-6feaae2d424d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:05.098650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0439f914-02d5-4d42-8857-cbebdf546ea2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:05.101174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0439f914-02d5-4d42-8857-cbebdf546ea2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:05.107026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e6b99ae-d846-49ee-9d62-fe23b25f2aab tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:05.108618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e6b99ae-d846-49ee-9d62-fe23b25f2aab tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:05.109089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e6b99ae-d846-49ee-9d62-fe23b25f2aab tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:05.109891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e6b99ae-d846-49ee-9d62-fe23b25f2aab tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:05.111155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e6b99ae-d846-49ee-9d62-fe23b25f2aab tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:05.111155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e6b99ae-d846-49ee-9d62-fe23b25f2aab tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:05.115056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0439f914-02d5-4d42-8857-cbebdf546ea2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:05.115563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0439f914-02d5-4d42-8857-cbebdf546ea2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:05.116000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0439f914-02d5-4d42-8857-cbebdf546ea2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:05.116738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0439f914-02d5-4d42-8857-cbebdf546ea2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:05.120266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0439f914-02d5-4d42-8857-cbebdf546ea2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:05.122727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0439f914-02d5-4d42-8857-cbebdf546ea2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:05.168189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0439f914-02d5-4d42-8857-cbebdf546ea2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:40:05.320478 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0439f914-02d5-4d42-8857-cbebdf546ea2 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "DELETE /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 204 len: 0 microversion: 2.25 time: 0.227710 Sep 07 12:40:05.324315 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1115/2284] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 12:40:05 2022] DELETE /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:40:05.330383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7f807e27-0a06-4fbb-9d0d-f3c1984ea5b0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:05.331307 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7f807e27-0a06-4fbb-9d0d-f3c1984ea5b0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:05.338548 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f807e27-0a06-4fbb-9d0d-f3c1984ea5b0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:05.339063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f807e27-0a06-4fbb-9d0d-f3c1984ea5b0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:05.339663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f807e27-0a06-4fbb-9d0d-f3c1984ea5b0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:05.340295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f807e27-0a06-4fbb-9d0d-f3c1984ea5b0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:05.340946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f807e27-0a06-4fbb-9d0d-f3c1984ea5b0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:05.341528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f807e27-0a06-4fbb-9d0d-f3c1984ea5b0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:05.907221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6e6b99ae-d846-49ee-9d62-fe23b25f2aab tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:05.951936 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6e6b99ae-d846-49ee-9d62-fe23b25f2aab tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers/3156895a-b53e-4926-9425-6feaae2d424d" status: 200 len: 1522 microversion: 2.1 time: 0.879912 Sep 07 12:40:05.953630 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1170/2285] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:05 2022] GET /compute/v2.1/servers/3156895a-b53e-4926-9425-6feaae2d424d => generated 1522 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:05.961261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e3aa5db1-4be5-4259-8bdd-af89e0fffbac tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:05.964305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e3aa5db1-4be5-4259-8bdd-af89e0fffbac tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:05.983720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3aa5db1-4be5-4259-8bdd-af89e0fffbac tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:05.984660 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3aa5db1-4be5-4259-8bdd-af89e0fffbac tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:05.985315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3aa5db1-4be5-4259-8bdd-af89e0fffbac tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:05.986466 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3aa5db1-4be5-4259-8bdd-af89e0fffbac tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:05.987269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3aa5db1-4be5-4259-8bdd-af89e0fffbac tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:05.988005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3aa5db1-4be5-4259-8bdd-af89e0fffbac tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:06.236809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7f807e27-0a06-4fbb-9d0d-f3c1984ea5b0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d991fa2c5754b14a7a0e638b486f06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d453f24efa048f0a67ab7834d0005c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:06.257114 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7f807e27-0a06-4fbb-9d0d-f3c1984ea5b0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f" status: 200 len: 1292 microversion: 2.1 time: 0.932636 Sep 07 12:40:06.261801 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1116/2286] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:05 2022] GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f => generated 1292 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:06.266900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-caa12894-106a-4717-85d7-bf02329bc535 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:06.273510 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-caa12894-106a-4717-85d7-bf02329bc535 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: e9b81094-ecf8-45b0-b334-e6b2c3b4a058] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:06.289572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-caa12894-106a-4717-85d7-bf02329bc535 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:06.290442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-caa12894-106a-4717-85d7-bf02329bc535 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:06.291056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-caa12894-106a-4717-85d7-bf02329bc535 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:06.291974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-caa12894-106a-4717-85d7-bf02329bc535 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:06.301535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-caa12894-106a-4717-85d7-bf02329bc535 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:06.302163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-caa12894-106a-4717-85d7-bf02329bc535 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:06.649146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e3aa5db1-4be5-4259-8bdd-af89e0fffbac tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:06.680446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e3aa5db1-4be5-4259-8bdd-af89e0fffbac tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:06.691089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e3aa5db1-4be5-4259-8bdd-af89e0fffbac tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:06.696891 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e3aa5db1-4be5-4259-8bdd-af89e0fffbac tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1548 microversion: 2.25 time: 0.739660 Sep 07 12:40:06.699918 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1171/2287] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:40:05 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1548 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:40:06.736247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f3e61b17-4eaa-4500-beac-d8e243db7c98 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:06.738024 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f3e61b17-4eaa-4500-beac-d8e243db7c98 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:06.783838 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3e61b17-4eaa-4500-beac-d8e243db7c98 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:06.784390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3e61b17-4eaa-4500-beac-d8e243db7c98 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:06.784845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3e61b17-4eaa-4500-beac-d8e243db7c98 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:06.785637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3e61b17-4eaa-4500-beac-d8e243db7c98 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:06.796716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3e61b17-4eaa-4500-beac-d8e243db7c98 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:06.797418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3e61b17-4eaa-4500-beac-d8e243db7c98 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:07.073808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-caa12894-106a-4717-85d7-bf02329bc535 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:07.100878 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-caa12894-106a-4717-85d7-bf02329bc535 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058" status: 200 len: 1492 microversion: 2.1 time: 0.833713 Sep 07 12:40:07.103113 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1117/2288] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:06 2022] GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058 => generated 1492 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:07.113331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-588bf4fe-dd0c-4067-a2ee-2029878b89bb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:07.114423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-588bf4fe-dd0c-4067-a2ee-2029878b89bb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: 3156895a-b53e-4926-9425-6feaae2d424d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:07.145441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-588bf4fe-dd0c-4067-a2ee-2029878b89bb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:07.146930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-588bf4fe-dd0c-4067-a2ee-2029878b89bb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:07.147697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-588bf4fe-dd0c-4067-a2ee-2029878b89bb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:07.149589 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-588bf4fe-dd0c-4067-a2ee-2029878b89bb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:07.151303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-588bf4fe-dd0c-4067-a2ee-2029878b89bb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:07.152329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-588bf4fe-dd0c-4067-a2ee-2029878b89bb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:07.687197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f3e61b17-4eaa-4500-beac-d8e243db7c98 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:07.700628 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f3e61b17-4eaa-4500-beac-d8e243db7c98 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc" status: 200 len: 1316 microversion: 2.1 time: 0.998689 Sep 07 12:40:07.701773 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1172/2289] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:06 2022] GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc => generated 1316 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:07.710353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cb61d4b7-8c30-4259-b7ab-3778196ce5ed tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:07.714313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cb61d4b7-8c30-4259-b7ab-3778196ce5ed tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:07.734708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb61d4b7-8c30-4259-b7ab-3778196ce5ed tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:07.739823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb61d4b7-8c30-4259-b7ab-3778196ce5ed tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:07.740281 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb61d4b7-8c30-4259-b7ab-3778196ce5ed tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:07.743267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb61d4b7-8c30-4259-b7ab-3778196ce5ed tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:07.744065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb61d4b7-8c30-4259-b7ab-3778196ce5ed tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:07.744656 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb61d4b7-8c30-4259-b7ab-3778196ce5ed tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:07.751216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:40:08.644083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-588bf4fe-dd0c-4067-a2ee-2029878b89bb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:08.655936 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-588bf4fe-dd0c-4067-a2ee-2029878b89bb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers/3156895a-b53e-4926-9425-6feaae2d424d" status: 200 len: 1522 microversion: 2.1 time: 1.550999 Sep 07 12:40:08.656826 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1118/2290] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:07 2022] GET /compute/v2.1/servers/3156895a-b53e-4926-9425-6feaae2d424d => generated 1522 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:08.673610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-b5efa361-74cb-4afb-9cac-0c3c91d13b91 req-6c9b9e02-5e3d-4c07-a255-f4c6a7cb8b80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3156895a-b53e-4926-9425-6feaae2d424d", "name": "network-vif-unplugged", "status": "completed", "tag": "78e49300-5bee-474e-a6c8-dda5e06d6553"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:08.704810 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b5efa361-74cb-4afb-9cac-0c3c91d13b91 req-6c9b9e02-5e3d-4c07-a255-f4c6a7cb8b80 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:08.705836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b5efa361-74cb-4afb-9cac-0c3c91d13b91 req-6c9b9e02-5e3d-4c07-a255-f4c6a7cb8b80 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:08.706475 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b5efa361-74cb-4afb-9cac-0c3c91d13b91 req-6c9b9e02-5e3d-4c07-a255-f4c6a7cb8b80 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:08.725340 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-b5efa361-74cb-4afb-9cac-0c3c91d13b91 req-6c9b9e02-5e3d-4c07-a255-f4c6a7cb8b80 service nova] Creating event network-vif-unplugged:78e49300-5bee-474e-a6c8-dda5e06d6553 for instance 3156895a-b53e-4926-9425-6feaae2d424d on n-h2-852087-9 Sep 07 12:40:08.732928 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-b5efa361-74cb-4afb-9cac-0c3c91d13b91 req-6c9b9e02-5e3d-4c07-a255-f4c6a7cb8b80 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073480 Sep 07 12:40:08.734056 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1119/2291] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:40:08.741504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fe736d69-ab7e-4c35-a105-3ae922c92c18 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:08.750359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fe736d69-ab7e-4c35-a105-3ae922c92c18 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:08.780290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe736d69-ab7e-4c35-a105-3ae922c92c18 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:08.781047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe736d69-ab7e-4c35-a105-3ae922c92c18 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:08.781845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe736d69-ab7e-4c35-a105-3ae922c92c18 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:08.787622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe736d69-ab7e-4c35-a105-3ae922c92c18 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:08.788330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe736d69-ab7e-4c35-a105-3ae922c92c18 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:08.788914 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe736d69-ab7e-4c35-a105-3ae922c92c18 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:09.332035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cb61d4b7-8c30-4259-b7ab-3778196ce5ed tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d991fa2c5754b14a7a0e638b486f06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d453f24efa048f0a67ab7834d0005c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:09.415194 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cb61d4b7-8c30-4259-b7ab-3778196ce5ed tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f" status: 200 len: 1292 microversion: 2.1 time: 1.711430 Sep 07 12:40:09.446561 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1173/2292] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:07 2022] GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f => generated 1292 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:09.475029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f5ebd472-7d65-4456-892e-e9fc7749d8e6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:09.475803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f5ebd472-7d65-4456-892e-e9fc7749d8e6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: e9b81094-ecf8-45b0-b334-e6b2c3b4a058] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:09.496105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5ebd472-7d65-4456-892e-e9fc7749d8e6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:09.502063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5ebd472-7d65-4456-892e-e9fc7749d8e6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:09.502884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5ebd472-7d65-4456-892e-e9fc7749d8e6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:09.503884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5ebd472-7d65-4456-892e-e9fc7749d8e6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:09.504535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5ebd472-7d65-4456-892e-e9fc7749d8e6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:09.505392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5ebd472-7d65-4456-892e-e9fc7749d8e6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:10.680283 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f5ebd472-7d65-4456-892e-e9fc7749d8e6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:10.706356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fe736d69-ab7e-4c35-a105-3ae922c92c18 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:10.707072 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f5ebd472-7d65-4456-892e-e9fc7749d8e6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058" status: 200 len: 1492 microversion: 2.1 time: 1.241201 Sep 07 12:40:10.728584 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1174/2293] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:09 2022] GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058 => generated 1492 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:10.732415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fe736d69-ab7e-4c35-a105-3ae922c92c18 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:10.735098 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fe736d69-ab7e-4c35-a105-3ae922c92c18 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:10.736544 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fe736d69-ab7e-4c35-a105-3ae922c92c18 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 200 len: 1548 microversion: 2.25 time: 2.001129 Sep 07 12:40:10.742789 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1120/2294] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:40:08 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 1548 bytes in 2008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:40:10.754016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6094d576-fba6-4d12-99ea-d82bf17e2bcb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:10.754992 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6094d576-fba6-4d12-99ea-d82bf17e2bcb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: 3156895a-b53e-4926-9425-6feaae2d424d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:10.767859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4393f239-5318-4ce8-b907-17afbb4b61a6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:10.768615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4393f239-5318-4ce8-b907-17afbb4b61a6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:10.772722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6094d576-fba6-4d12-99ea-d82bf17e2bcb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:10.773636 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6094d576-fba6-4d12-99ea-d82bf17e2bcb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:10.774372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6094d576-fba6-4d12-99ea-d82bf17e2bcb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:10.778225 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6094d576-fba6-4d12-99ea-d82bf17e2bcb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:10.779428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6094d576-fba6-4d12-99ea-d82bf17e2bcb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:10.780329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6094d576-fba6-4d12-99ea-d82bf17e2bcb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:10.790616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4393f239-5318-4ce8-b907-17afbb4b61a6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:10.791785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4393f239-5318-4ce8-b907-17afbb4b61a6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:10.792302 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4393f239-5318-4ce8-b907-17afbb4b61a6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:10.794050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4393f239-5318-4ce8-b907-17afbb4b61a6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:10.796797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4393f239-5318-4ce8-b907-17afbb4b61a6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:10.797402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4393f239-5318-4ce8-b907-17afbb4b61a6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:10.912018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6094d576-fba6-4d12-99ea-d82bf17e2bcb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:10.912834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6094d576-fba6-4d12-99ea-d82bf17e2bcb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:10.913866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6094d576-fba6-4d12-99ea-d82bf17e2bcb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:10.914695 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-6094d576-fba6-4d12-99ea-d82bf17e2bcb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lazy-loading 'fault' on Instance uuid 3156895a-b53e-4926-9425-6feaae2d424d {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:40:11.229813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6094d576-fba6-4d12-99ea-d82bf17e2bcb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:11.244019 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6094d576-fba6-4d12-99ea-d82bf17e2bcb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers/3156895a-b53e-4926-9425-6feaae2d424d" status: 200 len: 1313 microversion: 2.1 time: 0.498678 Sep 07 12:40:11.244979 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1121/2295] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:10 2022] GET /compute/v2.1/servers/3156895a-b53e-4926-9425-6feaae2d424d => generated 1313 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:11.251962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-290d67ba-2efb-4727-9601-4adadcd3592f req-54237502-7562-44d4-ab8d-3105bbb69823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3156895a-b53e-4926-9425-6feaae2d424d", "name": "network-vif-deleted", "tag": "78e49300-5bee-474e-a6c8-dda5e06d6553"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:11.267072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-290d67ba-2efb-4727-9601-4adadcd3592f req-54237502-7562-44d4-ab8d-3105bbb69823 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:11.267848 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-290d67ba-2efb-4727-9601-4adadcd3592f req-54237502-7562-44d4-ab8d-3105bbb69823 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:11.268598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-290d67ba-2efb-4727-9601-4adadcd3592f req-54237502-7562-44d4-ab8d-3105bbb69823 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:11.308561 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-290d67ba-2efb-4727-9601-4adadcd3592f req-54237502-7562-44d4-ab8d-3105bbb69823 service nova] Creating event network-vif-deleted:78e49300-5bee-474e-a6c8-dda5e06d6553 for instance 3156895a-b53e-4926-9425-6feaae2d424d on n-h2-852087-9 Sep 07 12:40:11.328704 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-290d67ba-2efb-4727-9601-4adadcd3592f req-54237502-7562-44d4-ab8d-3105bbb69823 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069035 Sep 07 12:40:11.330219 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1122/2296] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:40:11.358071 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-239574b2-f9bd-4aeb-995f-2c8f085237af tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:11.364123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-239574b2-f9bd-4aeb-995f-2c8f085237af tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:11.382035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:40:11.385271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-239574b2-f9bd-4aeb-995f-2c8f085237af tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:11.385975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-239574b2-f9bd-4aeb-995f-2c8f085237af tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:11.386571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-239574b2-f9bd-4aeb-995f-2c8f085237af tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:11.387458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-239574b2-f9bd-4aeb-995f-2c8f085237af tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:11.389057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-239574b2-f9bd-4aeb-995f-2c8f085237af tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:11.390582 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-239574b2-f9bd-4aeb-995f-2c8f085237af tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:12.374823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4393f239-5318-4ce8-b907-17afbb4b61a6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:12.406516 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4393f239-5318-4ce8-b907-17afbb4b61a6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc" status: 200 len: 1316 microversion: 2.1 time: 1.673611 Sep 07 12:40:12.413396 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1175/2297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:10 2022] GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc => generated 1316 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:12.434879 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0528bbd3-0198-462d-acdb-ba94c0451e4d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:12.438811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0528bbd3-0198-462d-acdb-ba94c0451e4d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: e9b81094-ecf8-45b0-b334-e6b2c3b4a058] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:12.462166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0528bbd3-0198-462d-acdb-ba94c0451e4d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:12.463520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0528bbd3-0198-462d-acdb-ba94c0451e4d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:12.464968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0528bbd3-0198-462d-acdb-ba94c0451e4d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:12.486785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0528bbd3-0198-462d-acdb-ba94c0451e4d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:12.490610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0528bbd3-0198-462d-acdb-ba94c0451e4d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:12.492459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0528bbd3-0198-462d-acdb-ba94c0451e4d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:13.191241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-239574b2-f9bd-4aeb-995f-2c8f085237af tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d991fa2c5754b14a7a0e638b486f06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d453f24efa048f0a67ab7834d0005c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:13.196842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0528bbd3-0198-462d-acdb-ba94c0451e4d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:13.212562 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0528bbd3-0198-462d-acdb-ba94c0451e4d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058" status: 200 len: 1450 microversion: 2.1 time: 0.797191 Sep 07 12:40:13.233523 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1176/2298] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:12 2022] GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058 => generated 1450 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:13.233523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f0e7de74-91f5-4075-b532-d7d649163586 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:13.233523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f0e7de74-91f5-4075-b532-d7d649163586 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: 81fe7509-9012-4fcc-9f06-26693494f535] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:13.233523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0e7de74-91f5-4075-b532-d7d649163586 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:13.234120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0e7de74-91f5-4075-b532-d7d649163586 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:13.234120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0e7de74-91f5-4075-b532-d7d649163586 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:13.234120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0e7de74-91f5-4075-b532-d7d649163586 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:13.234120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0e7de74-91f5-4075-b532-d7d649163586 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:13.234637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0e7de74-91f5-4075-b532-d7d649163586 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:13.237953 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-239574b2-f9bd-4aeb-995f-2c8f085237af tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f" status: 200 len: 1292 microversion: 2.1 time: 1.881421 Sep 07 12:40:13.240682 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1123/2299] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:11 2022] GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f => generated 1292 bytes in 1910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:13.265233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d0e3b635-0a95-4e9d-9836-57eb6f1a99b1 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:13.271017 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-f0e7de74-91f5-4075-b532-d7d649163586 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] HTTP exception thrown: Instance 81fe7509-9012-4fcc-9f06-26693494f535 could not be found. Sep 07 12:40:13.272938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f0e7de74-91f5-4075-b532-d7d649163586 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Request method failure captured: Sep 07 12:40:13.272938 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 HTTP/1.1 Sep 07 12:40:13.272938 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:40:13.272938 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:40:13.272938 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:40:13.272938 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:40:13.272938 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:40:13.272938 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:40:13.272938 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:40:13.272938 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:40:13.272938 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGI766J91sJuT5F2IEQqMchfKaCbSDDF-J9lwzV5FP6Js_H7pktqjB-3Lio5CpiTElE39UZjTqgIShFlx0VbJgNQCgVyAvoaV1-jKOOUTYFV0esgaVjKSWWfHpfNXej83bOupyFtCRU8lUe_AKArpkP0tH23jA8qcBVLgUCSpGDxJw0U Sep 07 12:40:13.272938 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:40:13.272938 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:40:13.272938 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:40:13.272938 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:40:13.272938 n-d-852087-9 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.25 Sep 07 12:40:13.272938 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:40:13.272938 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:40:13.272938 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 6d7695bab2d84b35bf92bd035da71dc3 Sep 07 12:40:13.272938 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2124170019 Sep 07 12:40:13.272938 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:40:13.272938 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:40:13.274538 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d7695bab2d84b35bf92bd035da71dc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d7695bab2d84b35bf92bd035da71dc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d7695bab2d84b35bf92bd035da71dc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d7695bab2d84b35bf92bd035da71dc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:40:13.274538 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2124170019 Sep 07 12:40:13.274538 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 6d7695bab2d84b35bf92bd035da71dc3 Sep 07 12:40:13.274538 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2124170019 Sep 07 12:40:13.274538 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-LiveAutoBlockMigrationV225Test-2124170019-project Sep 07 12:40:13.274538 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:40:13.274538 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:40:13.274538 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: cf3ae3d912b84a8f906b31874668b740 Sep 07 12:40:13.274538 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2124170019-project Sep 07 12:40:13.274538 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:40:13.274538 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 81fe7509-9012-4fcc-9f06-26693494f535 could not be found. Sep 07 12:40:13.274538 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '81fe7509-9012-4fcc-9f06-26693494f535'} Sep 07 12:40:13.275137 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:40:13.275137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:13.275137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:40:13.275137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:40:13.275137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:40:13.275137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:40:13.275137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:40:13.275137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:40:13.275137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:40:13.275137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:40:13.275137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81fe7509-9012-4fcc-9f06-26693494f535 could not be found. Sep 07 12:40:13.275137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:13.275137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:13.275137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:13.275137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:13.275137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:13.275137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:13.275137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:40:13.275137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:40:13.275137 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:40:13.277693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:40:13.277693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:40:13.277693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:40:13.277693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:40:13.277693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:40:13.277693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:40:13.277693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:40:13.277693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81fe7509-9012-4fcc-9f06-26693494f535 could not be found. Sep 07 12:40:13.277693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:13.277693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:13.277693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:13.277693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:13.277693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:13.277693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:13.277693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:40:13.277693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:40:13.277693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81fe7509-9012-4fcc-9f06-26693494f535 could not be found. Sep 07 12:40:13.277693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:13.279706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f0e7de74-91f5-4075-b532-d7d649163586 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Returning 404 to user: Instance 81fe7509-9012-4fcc-9f06-26693494f535 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:40:13.279706 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f0e7de74-91f5-4075-b532-d7d649163586 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535" status: 404 len: 111 microversion: 2.25 time: 0.060115 Sep 07 12:40:13.283068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d0e3b635-0a95-4e9d-9836-57eb6f1a99b1 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: 3156895a-b53e-4926-9425-6feaae2d424d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:13.283579 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1177/2300] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:40:13 2022] GET /compute/v2.1/servers/81fe7509-9012-4fcc-9f06-26693494f535 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:40:13.288738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-92447008-c9ba-441d-98a6-4a9ccc456eea req-8e86fdc9-55c7-41fb-b18b-abb44ea6725a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9b81094-ecf8-45b0-b334-e6b2c3b4a058", "name": "network-vif-deleted", "tag": "1c4458c2-7f0b-4622-b2d2-fe887eff5433"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:13.298030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0e3b635-0a95-4e9d-9836-57eb6f1a99b1 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:13.299076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0e3b635-0a95-4e9d-9836-57eb6f1a99b1 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:13.302526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0e3b635-0a95-4e9d-9836-57eb6f1a99b1 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:13.304557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0e3b635-0a95-4e9d-9836-57eb6f1a99b1 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:13.307093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0e3b635-0a95-4e9d-9836-57eb6f1a99b1 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:13.309578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0e3b635-0a95-4e9d-9836-57eb6f1a99b1 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:13.323216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:40:13.323455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-92447008-c9ba-441d-98a6-4a9ccc456eea req-8e86fdc9-55c7-41fb-b18b-abb44ea6725a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:13.328820 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-92447008-c9ba-441d-98a6-4a9ccc456eea req-8e86fdc9-55c7-41fb-b18b-abb44ea6725a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:13.329888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-92447008-c9ba-441d-98a6-4a9ccc456eea req-8e86fdc9-55c7-41fb-b18b-abb44ea6725a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:13.339770 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-d0e3b635-0a95-4e9d-9836-57eb6f1a99b1 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] HTTP exception thrown: Instance 3156895a-b53e-4926-9425-6feaae2d424d could not be found. Sep 07 12:40:13.342162 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d0e3b635-0a95-4e9d-9836-57eb6f1a99b1 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Request method failure captured: Sep 07 12:40:13.342162 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/3156895a-b53e-4926-9425-6feaae2d424d HTTP/1.1 Sep 07 12:40:13.342162 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:40:13.342162 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:40:13.342162 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:40:13.342162 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:40:13.342162 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:40:13.342162 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:40:13.342162 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:40:13.342162 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:40:13.342162 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJDsBdDBuK6-U-oa3EgLwJ0cInn42LooYDDK2xuzMieAmtDdHVgCQSCGUg7Mms36Dytx6iFOmjDeDJYTcyb97tpVFzJ2wUaPiQNOZa3rYItTJozEFSKJVy72U0F8Z9IglffmC_MrHLrEV6jHa3Ae7EJd2NyfR5n6uH1QOj7TevCy0ho Sep 07 12:40:13.342162 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:40:13.342162 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:40:13.342162 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:40:13.342162 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:40:13.342162 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:40:13.342162 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:40:13.342162 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: e28a1b6c8dde4b948d493b369535a301 Sep 07 12:40:13.342162 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ListServersNegativeTestJSON-1212395273 Sep 07 12:40:13.342162 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:40:13.342162 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:40:13.343634 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:40:13.343634 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ListServersNegativeTestJSON-1212395273 Sep 07 12:40:13.343634 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: e28a1b6c8dde4b948d493b369535a301 Sep 07 12:40:13.343634 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1212395273 Sep 07 12:40:13.343634 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ListServersNegativeTestJSON-1212395273-project Sep 07 12:40:13.343634 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:40:13.343634 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:40:13.343634 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 3f9b8d4c5d9a4efeb97645f3233b1064 Sep 07 12:40:13.343634 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ListServersNegativeTestJSON-1212395273-project Sep 07 12:40:13.343634 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:40:13.343634 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 3156895a-b53e-4926-9425-6feaae2d424d could not be found. Sep 07 12:40:13.343634 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '3156895a-b53e-4926-9425-6feaae2d424d'} Sep 07 12:40:13.344371 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:40:13.344371 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:13.344371 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:40:13.344371 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:40:13.344371 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:40:13.344371 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:40:13.344371 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:40:13.344371 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:40:13.344371 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:40:13.344371 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:40:13.344371 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3156895a-b53e-4926-9425-6feaae2d424d could not be found. Sep 07 12:40:13.344371 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:13.344371 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:13.344371 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:13.344371 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:13.344371 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:13.344371 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:13.344371 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:40:13.344371 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:40:13.344371 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:40:13.345536 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:40:13.345536 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:40:13.345536 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:40:13.345536 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:40:13.345536 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:40:13.345536 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:40:13.345536 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:40:13.345536 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3156895a-b53e-4926-9425-6feaae2d424d could not be found. Sep 07 12:40:13.345536 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:13.345536 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:13.345536 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:13.345536 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:13.345536 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:13.345536 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:13.345536 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:40:13.345536 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:40:13.345536 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3156895a-b53e-4926-9425-6feaae2d424d could not be found. Sep 07 12:40:13.345536 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:13.348445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d0e3b635-0a95-4e9d-9836-57eb6f1a99b1 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Returning 404 to user: Instance 3156895a-b53e-4926-9425-6feaae2d424d could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:40:13.350700 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d0e3b635-0a95-4e9d-9836-57eb6f1a99b1 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers/3156895a-b53e-4926-9425-6feaae2d424d" status: 404 len: 111 microversion: 2.1 time: 0.095434 Sep 07 12:40:13.351639 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1124/2301] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:13 2022] GET /compute/v2.1/servers/3156895a-b53e-4926-9425-6feaae2d424d => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:40:13.372826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ae4dc07-12bc-4a12-8b89-36170c2953be tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:13.380956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3ae4dc07-12bc-4a12-8b89-36170c2953be tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:13.390231 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-92447008-c9ba-441d-98a6-4a9ccc456eea req-8e86fdc9-55c7-41fb-b18b-abb44ea6725a service nova] Creating event network-vif-deleted:1c4458c2-7f0b-4622-b2d2-fe887eff5433 for instance e9b81094-ecf8-45b0-b334-e6b2c3b4a058 on n-h2-852087-9 Sep 07 12:40:13.393135 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ae4dc07-12bc-4a12-8b89-36170c2953be tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:13.394024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ae4dc07-12bc-4a12-8b89-36170c2953be tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:13.394731 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ae4dc07-12bc-4a12-8b89-36170c2953be tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:13.395727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ae4dc07-12bc-4a12-8b89-36170c2953be tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:13.396428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ae4dc07-12bc-4a12-8b89-36170c2953be tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:13.397089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ae4dc07-12bc-4a12-8b89-36170c2953be tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:13.407126 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-92447008-c9ba-441d-98a6-4a9ccc456eea req-8e86fdc9-55c7-41fb-b18b-abb44ea6725a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121751 Sep 07 12:40:13.409368 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1178/2302] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:40:13.428863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-67263801-0328-4f3c-8032-754c06297f7f tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:13.454355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-67263801-0328-4f3c-8032-754c06297f7f tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:13.455878 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3ae4dc07-12bc-4a12-8b89-36170c2953be tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:40:13.456255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-67263801-0328-4f3c-8032-754c06297f7f tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'e28a1b6c8dde4b948d493b369535a301'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:40:13.471118 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67263801-0328-4f3c-8032-754c06297f7f tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:13.471934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67263801-0328-4f3c-8032-754c06297f7f tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:13.472691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67263801-0328-4f3c-8032-754c06297f7f tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:13.474003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67263801-0328-4f3c-8032-754c06297f7f tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:13.479834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67263801-0328-4f3c-8032-754c06297f7f tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:13.483829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67263801-0328-4f3c-8032-754c06297f7f tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:13.729294 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ae4dc07-12bc-4a12-8b89-36170c2953be tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 204 len: 0 microversion: 2.25 time: 0.373646 Sep 07 12:40:13.732018 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1125/2303] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 12:40:13 2022] DELETE /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:40:13.749398 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-67263801-0328-4f3c-8032-754c06297f7f tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.337570 Sep 07 12:40:13.753871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-7785df59-3042-4445-af71-187bf04d6e1e req-a00274ac-983b-4e29-bdfc-c3434e025825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81fe7509-9012-4fcc-9f06-26693494f535", "name": "network-vif-deleted", "tag": "e45111b2-8436-42bb-872d-704690a433d6"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:13.755092 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1179/2304] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Sep 7 12:40:13 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:40:13.763260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-33094c97-2f02-4bac-a1ec-1d2ebc46fa01 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:13.764592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-33094c97-2f02-4bac-a1ec-1d2ebc46fa01 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:13.799804 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33094c97-2f02-4bac-a1ec-1d2ebc46fa01 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:13.802466 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33094c97-2f02-4bac-a1ec-1d2ebc46fa01 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:13.805850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33094c97-2f02-4bac-a1ec-1d2ebc46fa01 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:13.810095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33094c97-2f02-4bac-a1ec-1d2ebc46fa01 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:13.816416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33094c97-2f02-4bac-a1ec-1d2ebc46fa01 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:13.817386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33094c97-2f02-4bac-a1ec-1d2ebc46fa01 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:13.817621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7785df59-3042-4445-af71-187bf04d6e1e req-a00274ac-983b-4e29-bdfc-c3434e025825 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:13.818114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7785df59-3042-4445-af71-187bf04d6e1e req-a00274ac-983b-4e29-bdfc-c3434e025825 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:13.827223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7785df59-3042-4445-af71-187bf04d6e1e req-a00274ac-983b-4e29-bdfc-c3434e025825 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:13.890931 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-7785df59-3042-4445-af71-187bf04d6e1e req-a00274ac-983b-4e29-bdfc-c3434e025825 service nova] Creating event network-vif-deleted:e45111b2-8436-42bb-872d-704690a433d6 for instance 81fe7509-9012-4fcc-9f06-26693494f535 on n-h2-852087-9 Sep 07 12:40:13.930510 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-7785df59-3042-4445-af71-187bf04d6e1e req-a00274ac-983b-4e29-bdfc-c3434e025825 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186595 Sep 07 12:40:13.933571 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1126/2305] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:40:13.970074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-173752e4-4f92-41dd-a6f6-5ed82438c7ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:13.977372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-173752e4-4f92-41dd-a6f6-5ed82438c7ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:14.021459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-173752e4-4f92-41dd-a6f6-5ed82438c7ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:14.022429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-173752e4-4f92-41dd-a6f6-5ed82438c7ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:14.023295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-173752e4-4f92-41dd-a6f6-5ed82438c7ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:14.024920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-173752e4-4f92-41dd-a6f6-5ed82438c7ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:14.043141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-173752e4-4f92-41dd-a6f6-5ed82438c7ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:14.044109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-173752e4-4f92-41dd-a6f6-5ed82438c7ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:14.783006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-33094c97-2f02-4bac-a1ec-1d2ebc46fa01 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:14.801978 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-33094c97-2f02-4bac-a1ec-1d2ebc46fa01 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc" status: 200 len: 1316 microversion: 2.1 time: 1.045578 Sep 07 12:40:14.805551 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1180/2306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:13 2022] GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc => generated 1316 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:14.817512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3d5fec5f-af1f-4411-b32f-4d6c8ca9a68f tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:14.828773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3d5fec5f-af1f-4411-b32f-4d6c8ca9a68f tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Request method failure captured: Sep 07 12:40:14.828773 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Sep 07 12:40:14.828773 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:40:14.828773 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:40:14.828773 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:40:14.828773 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:40:14.828773 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:40:14.828773 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:40:14.828773 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:40:14.828773 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:40:14.828773 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJDsBdDBuK6-U-oa3EgLwJ0cInn42LooYDDK2xuzMieAmtDdHVgCQSCGUg7Mms36Dytx6iFOmjDeDJYTcyb97tpVFzJ2wUaPiQNOZa3rYItTJozEFSKJVy72U0F8Z9IglffmC_MrHLrEV6jHa3Ae7EJd2NyfR5n6uH1QOj7TevCy0ho Sep 07 12:40:14.828773 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:40:14.828773 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:40:14.828773 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:40:14.828773 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:40:14.828773 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:40:14.828773 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:40:14.828773 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: e28a1b6c8dde4b948d493b369535a301 Sep 07 12:40:14.828773 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ListServersNegativeTestJSON-1212395273 Sep 07 12:40:14.828773 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:40:14.828773 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:40:14.830063 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:40:14.830063 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ListServersNegativeTestJSON-1212395273 Sep 07 12:40:14.830063 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: e28a1b6c8dde4b948d493b369535a301 Sep 07 12:40:14.830063 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1212395273 Sep 07 12:40:14.830063 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ListServersNegativeTestJSON-1212395273-project Sep 07 12:40:14.830063 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:40:14.830063 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:40:14.830063 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 3f9b8d4c5d9a4efeb97645f3233b1064 Sep 07 12:40:14.830063 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ListServersNegativeTestJSON-1212395273-project Sep 07 12:40:14.830063 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:40:14.830063 n-d-852087-9 devstack@n-api.service[122432]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 07 12:40:14.830063 n-d-852087-9 devstack@n-api.service[122432]: action_args: {} Sep 07 12:40:14.830693 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:40:14.830693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:14.830693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:40:14.830693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:40:14.830693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:40:14.830693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:40:14.830693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Sep 07 12:40:14.830693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:14.830693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Sep 07 12:40:14.830693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Sep 07 12:40:14.830693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:14.830693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 07 12:40:14.830693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi '2011/01/01' Sep 07 12:40:14.830693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:14.830693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:14.830693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:14.830693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:14.830693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:14.830693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:14.830693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:40:14.830693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:40:14.830693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:40:14.830693 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:40:14.831945 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 12:40:14.831945 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:40:14.831945 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 12:40:14.831945 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:40:14.831945 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 12:40:14.831945 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:40:14.831945 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 07 12:40:14.831945 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 07 12:40:14.831945 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 07 12:40:14.831945 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:40:14.831945 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:40:14.831945 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:40:14.831945 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:40:14.831945 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 07 12:40:14.831945 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:14.831945 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:14.831945 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:14.831945 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:14.831945 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:14.831945 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:14.832942 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:40:14.832942 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:40:14.832942 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 07 12:40:14.832942 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:14.835027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3d5fec5f-af1f-4411-b32f-4d6c8ca9a68f tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:40:14.839983 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3d5fec5f-af1f-4411-b32f-4d6c8ca9a68f tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.030186 Sep 07 12:40:14.845076 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1181/2307] 10.222.0.16 () {58 vars in 1182 bytes} [Wed Sep 7 12:40:14 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:40:14.955254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-173752e4-4f92-41dd-a6f6-5ed82438c7ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:14.971929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-173752e4-4f92-41dd-a6f6-5ed82438c7ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:14.978402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-173752e4-4f92-41dd-a6f6-5ed82438c7ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:14.982356 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-173752e4-4f92-41dd-a6f6-5ed82438c7ec tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1562 microversion: 2.25 time: 1.039139 Sep 07 12:40:14.985272 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1127/2308] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:40:13 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1562 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:40:14.995746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f4ee0796-7ee0-4041-a7af-cdafb7dcfb57 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:14.999869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f4ee0796-7ee0-4041-a7af-cdafb7dcfb57 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: e9b81094-ecf8-45b0-b334-e6b2c3b4a058] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:15.016631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4ee0796-7ee0-4041-a7af-cdafb7dcfb57 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:15.018165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4ee0796-7ee0-4041-a7af-cdafb7dcfb57 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:15.020709 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4ee0796-7ee0-4041-a7af-cdafb7dcfb57 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:15.021677 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4ee0796-7ee0-4041-a7af-cdafb7dcfb57 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:15.023901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4ee0796-7ee0-4041-a7af-cdafb7dcfb57 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:15.024520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4ee0796-7ee0-4041-a7af-cdafb7dcfb57 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:15.089742 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-f4ee0796-7ee0-4041-a7af-cdafb7dcfb57 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] HTTP exception thrown: Instance e9b81094-ecf8-45b0-b334-e6b2c3b4a058 could not be found. Sep 07 12:40:15.105423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f4ee0796-7ee0-4041-a7af-cdafb7dcfb57 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Request method failure captured: Sep 07 12:40:15.105423 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058 HTTP/1.1 Sep 07 12:40:15.105423 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:40:15.105423 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:40:15.105423 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:40:15.105423 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:40:15.105423 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:40:15.105423 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:40:15.105423 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:40:15.105423 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:40:15.105423 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJBoiaP7MPiSaP6e6aUmMJ8PuR8TxD72E3ycIsoyb5pICiti0ZKBvrRvNoP9EgDHIO9YzOUucG9iu3oQZMsvYh9Gs4g9xjGSFcMGctGxplJk2OO0Aofdu3Ru80K0M86m3EPIBI5c12Fca4rxAASE3osSSig78ynw4pFvNNSiXm2zkBk Sep 07 12:40:15.105423 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:40:15.105423 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:40:15.105423 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:40:15.105423 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:40:15.105423 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:40:15.105423 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:40:15.105423 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:40:15.105423 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:40:15.105423 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:40:15.105423 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:40:15.108413 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef5b2dd007e944358d72268414868096"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef5b2dd007e944358d72268414868096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:40:15.108413 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:40:15.108413 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:40:15.108413 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:40:15.108413 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:40:15.108413 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:40:15.108413 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:40:15.108413 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: b920811be01745fc9faea7a9ce213c6e Sep 07 12:40:15.108413 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:40:15.108413 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:40:15.108413 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance e9b81094-ecf8-45b0-b334-e6b2c3b4a058 could not be found. Sep 07 12:40:15.108413 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'e9b81094-ecf8-45b0-b334-e6b2c3b4a058'} Sep 07 12:40:15.110278 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:40:15.110278 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:15.110278 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:40:15.110278 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:40:15.110278 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:40:15.110278 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:40:15.110278 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:40:15.110278 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:40:15.110278 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:40:15.110278 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:40:15.110278 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9b81094-ecf8-45b0-b334-e6b2c3b4a058 could not be found. Sep 07 12:40:15.110278 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:15.110278 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:15.110278 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:15.110278 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:15.110278 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:15.110278 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:15.110278 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:40:15.110278 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:40:15.110278 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:40:15.111543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:40:15.111543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:40:15.111543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:40:15.111543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:40:15.111543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:40:15.111543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:40:15.111543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:40:15.111543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9b81094-ecf8-45b0-b334-e6b2c3b4a058 could not be found. Sep 07 12:40:15.111543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:15.111543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:15.111543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:15.111543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:15.111543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:15.111543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:15.111543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:40:15.111543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:40:15.111543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9b81094-ecf8-45b0-b334-e6b2c3b4a058 could not be found. Sep 07 12:40:15.111543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:15.114013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f4ee0796-7ee0-4041-a7af-cdafb7dcfb57 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Returning 404 to user: Instance e9b81094-ecf8-45b0-b334-e6b2c3b4a058 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:40:15.116653 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f4ee0796-7ee0-4041-a7af-cdafb7dcfb57 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058" status: 404 len: 111 microversion: 2.1 time: 0.128424 Sep 07 12:40:15.129808 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1128/2309] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:14 2022] GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:40:15.139665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c7ec8b20-1165-4f4f-ba59-a1cb398dfbd3 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:15.142471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c7ec8b20-1165-4f4f-ba59-a1cb398dfbd3 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:15.180991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7ec8b20-1165-4f4f-ba59-a1cb398dfbd3 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:15.181555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7ec8b20-1165-4f4f-ba59-a1cb398dfbd3 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:15.182014 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7ec8b20-1165-4f4f-ba59-a1cb398dfbd3 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:15.193119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7ec8b20-1165-4f4f-ba59-a1cb398dfbd3 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:15.200080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7ec8b20-1165-4f4f-ba59-a1cb398dfbd3 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:15.201935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7ec8b20-1165-4f4f-ba59-a1cb398dfbd3 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:15.338478 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b5cdf3eb-01f7-491b-9e59-24459f3539a4 tempest-FloatingIPsNegativeTestJSON-1452227678 tempest-FloatingIPsNegativeTestJSON-1452227678-project] Calling method '.version_select at 0x7fc41d252d30>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:15.781283 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b5cdf3eb-01f7-491b-9e59-24459f3539a4 tempest-FloatingIPsNegativeTestJSON-1452227678 tempest-FloatingIPsNegativeTestJSON-1452227678-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.933990 Sep 07 12:40:15.782501 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1182/2310] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Sep 7 12:40:14 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:40:15.795225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3d9e9a1d-688e-49c8-824b-aa2b34e8c3b4 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:15.823533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3d9e9a1d-688e-49c8-824b-aa2b34e8c3b4 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:15.831362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3d9e9a1d-688e-49c8-824b-aa2b34e8c3b4 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Searching by: {'deleted': False, 'project_id': 'e28a1b6c8dde4b948d493b369535a301'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:40:15.865664 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d9e9a1d-688e-49c8-824b-aa2b34e8c3b4 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:15.867172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d9e9a1d-688e-49c8-824b-aa2b34e8c3b4 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:15.868568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d9e9a1d-688e-49c8-824b-aa2b34e8c3b4 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:15.870440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d9e9a1d-688e-49c8-824b-aa2b34e8c3b4 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:15.878069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d9e9a1d-688e-49c8-824b-aa2b34e8c3b4 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:15.879419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d9e9a1d-688e-49c8-824b-aa2b34e8c3b4 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:16.237396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c7ec8b20-1165-4f4f-ba59-a1cb398dfbd3 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d991fa2c5754b14a7a0e638b486f06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d453f24efa048f0a67ab7834d0005c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:16.254024 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c7ec8b20-1165-4f4f-ba59-a1cb398dfbd3 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f" status: 200 len: 1292 microversion: 2.1 time: 1.122509 Sep 07 12:40:16.276438 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1129/2311] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:15 2022] GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f => generated 1292 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:16.282655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-74f6d339-656b-4285-b484-5cd8fc4f903a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1944373127", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "80d51306-dbb8-4c2e-bca9-60970c39d44b"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:16.296332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-3d9e9a1d-688e-49c8-824b-aa2b34e8c3b4 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:40:16.423669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-74f6d339-656b-4285-b484-5cd8fc4f903a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] validate_networks() for [('80d51306-dbb8-4c2e-bca9-60970c39d44b', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:40:16.581653 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3d9e9a1d-688e-49c8-824b-aa2b34e8c3b4 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.792517 Sep 07 12:40:16.602537 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1183/2312] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Sep 7 12:40:15 2022] GET /compute/v2.1/servers => generated 683 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:40:16.615531 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-359a9531-7e1f-407a-b021-29bb8db557e9 tempest-FloatingIPsNegativeTestJSON-1452227678 tempest-FloatingIPsNegativeTestJSON-1452227678-project] Action: 'create', calling method: .version_select at 0x7fc419546040>, body: {"pool": "non_exist_pool"} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:17.194773 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-359a9531-7e1f-407a-b021-29bb8db557e9 tempest-FloatingIPsNegativeTestJSON-1452227678 tempest-FloatingIPsNegativeTestJSON-1452227678-project] HTTP exception thrown: Floating IP pool not found. Sep 07 12:40:17.197792 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-359a9531-7e1f-407a-b021-29bb8db557e9 tempest-FloatingIPsNegativeTestJSON-1452227678 tempest-FloatingIPsNegativeTestJSON-1452227678-project] Request method failure captured: Sep 07 12:40:17.197792 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Sep 07 12:40:17.197792 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:40:17.197792 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:40:17.197792 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:40:17.197792 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 26 Sep 07 12:40:17.197792 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:40:17.197792 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:40:17.197792 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:40:17.197792 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:40:17.197792 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJEt1H8wjuDgPB_Cd0R_pgtnAA9gzsCQ_1OHPd6e-46D9N24o2oirr6hvv4VB9UtRX1uXKqdUA8EFFgJ8diWMmBtw0VSKudR8qN5x9Xa_woN0BNLfGXKxE8bZQv9IUGBfa8ivKs5kDf4qv7IcMMsq4JHh_eKqPFSllHHmuBmvoY_lq8 Sep 07 12:40:17.197792 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:40:17.197792 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:40:17.197792 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:40:17.197792 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:40:17.197792 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:40:17.197792 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:40:17.197792 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 4ace362c8f6f4b46a3627b246b969e5a Sep 07 12:40:17.197792 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1452227678 Sep 07 12:40:17.197792 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:40:17.197792 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:40:17.200347 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4ace362c8f6f4b46a3627b246b969e5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4ace362c8f6f4b46a3627b246b969e5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4ace362c8f6f4b46a3627b246b969e5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4ace362c8f6f4b46a3627b246b969e5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:40:17.200347 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1452227678 Sep 07 12:40:17.200347 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 4ace362c8f6f4b46a3627b246b969e5a Sep 07 12:40:17.200347 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1452227678 Sep 07 12:40:17.200347 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-FloatingIPsNegativeTestJSON-1452227678-project Sep 07 12:40:17.200347 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:40:17.200347 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:40:17.200347 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: c84ad6869d6a46ce808af5c522061a88 Sep 07 12:40:17.200347 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1452227678-project Sep 07 12:40:17.200347 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:40:17.200347 n-d-852087-9 devstack@n-api.service[122432]: {"pool": "non_exist_pool"} Sep 07 12:40:17.200347 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:40:17.200347 n-d-852087-9 devstack@n-api.service[122432]: exception: Floating IP pool not found. Sep 07 12:40:17.200347 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'pool': 'non_exist_pool'}} Sep 07 12:40:17.200347 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:40:17.202109 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:17.202109 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Sep 07 12:40:17.202109 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Sep 07 12:40:17.202109 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Sep 07 12:40:17.202109 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Sep 07 12:40:17.202109 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Sep 07 12:40:17.202109 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Sep 07 12:40:17.202109 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Sep 07 12:40:17.202109 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:17.202109 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:17.202109 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:17.202109 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:17.202109 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:17.202109 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:17.202109 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:40:17.202109 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:40:17.202109 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:40:17.202109 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:40:17.202109 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:40:17.202109 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:40:17.204492 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Sep 07 12:40:17.204492 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:40:17.204492 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Sep 07 12:40:17.204492 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:17.204492 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:17.204492 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:17.204492 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:17.204492 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:17.204492 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:17.204492 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:40:17.204492 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:40:17.204492 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Sep 07 12:40:17.204492 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:17.204492 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-359a9531-7e1f-407a-b021-29bb8db557e9 tempest-FloatingIPsNegativeTestJSON-1452227678 tempest-FloatingIPsNegativeTestJSON-1452227678-project] Returning 404 to user: Floating IP pool not found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:40:17.204492 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-359a9531-7e1f-407a-b021-29bb8db557e9 tempest-FloatingIPsNegativeTestJSON-1452227678 tempest-FloatingIPsNegativeTestJSON-1452227678-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.595685 Sep 07 12:40:17.208006 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1184/2313] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Sep 7 12:40:16 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 598 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:40:17.226738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4c2c0d45-b182-4e1b-b705-5141052f94a1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:17.227837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4c2c0d45-b182-4e1b-b705-5141052f94a1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:17.244796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c2c0d45-b182-4e1b-b705-5141052f94a1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:17.246179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c2c0d45-b182-4e1b-b705-5141052f94a1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:17.247843 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c2c0d45-b182-4e1b-b705-5141052f94a1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:17.249771 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c2c0d45-b182-4e1b-b705-5141052f94a1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:17.250614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c2c0d45-b182-4e1b-b705-5141052f94a1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:17.251655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c2c0d45-b182-4e1b-b705-5141052f94a1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:17.790973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4c2c0d45-b182-4e1b-b705-5141052f94a1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:17.809837 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4c2c0d45-b182-4e1b-b705-5141052f94a1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc" status: 200 len: 1316 microversion: 2.1 time: 0.602476 Sep 07 12:40:17.822435 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1185/2314] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:17 2022] GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc => generated 1316 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:17.841913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0960c90b-6786-40d7-8f31-6d929279ed19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:17.843025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0960c90b-6786-40d7-8f31-6d929279ed19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:17.854382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0960c90b-6786-40d7-8f31-6d929279ed19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:17.862439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0960c90b-6786-40d7-8f31-6d929279ed19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:17.863244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0960c90b-6786-40d7-8f31-6d929279ed19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:17.864220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0960c90b-6786-40d7-8f31-6d929279ed19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:17.864935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0960c90b-6786-40d7-8f31-6d929279ed19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:17.865693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0960c90b-6786-40d7-8f31-6d929279ed19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:18.112243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0960c90b-6786-40d7-8f31-6d929279ed19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:18.132505 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0960c90b-6786-40d7-8f31-6d929279ed19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:18.134717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0960c90b-6786-40d7-8f31-6d929279ed19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3ae3d912b84a8f906b31874668b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7695bab2d84b35bf92bd035da71dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:18.136370 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0960c90b-6786-40d7-8f31-6d929279ed19 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 200 len: 1346 microversion: 2.25 time: 0.312784 Sep 07 12:40:18.137125 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1186/2315] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:40:17 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 1346 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:40:18.142312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e0181074-ef02-46be-baca-b91ce30a4d85 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:18.162589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e0181074-ef02-46be-baca-b91ce30a4d85 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:18.163504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.compute.servers [None req-e0181074-ef02-46be-baca-b91ce30a4d85 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Removing options 'limit' from query {{(pid=122432) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 07 12:40:18.169703 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e0181074-ef02-46be-baca-b91ce30a4d85 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Searching by: {'deleted': False, 'project_id': 'e28a1b6c8dde4b948d493b369535a301'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:40:18.181773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0181074-ef02-46be-baca-b91ce30a4d85 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:18.182857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0181074-ef02-46be-baca-b91ce30a4d85 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:18.183545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0181074-ef02-46be-baca-b91ce30a4d85 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:18.184783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0181074-ef02-46be-baca-b91ce30a4d85 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:18.185841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0181074-ef02-46be-baca-b91ce30a4d85 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:18.187766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0181074-ef02-46be-baca-b91ce30a4d85 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:18.240234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-e0181074-ef02-46be-baca-b91ce30a4d85 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:40:18.295785 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e0181074-ef02-46be-baca-b91ce30a4d85 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.157267 Sep 07 12:40:18.301000 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1187/2316] 10.222.0.16 () {58 vars in 1144 bytes} [Wed Sep 7 12:40:18 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:40:18.336455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-ac97824a-9578-4d34-806b-8a74ae68b54b req-dcf168c4-4429-4016-904a-795c8546f50b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc", "name": "network-vif-plugged", "status": "completed", "tag": "ae63cbe5-283c-42c7-8611-bf3675d0c6dc"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:18.384641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ac97824a-9578-4d34-806b-8a74ae68b54b req-dcf168c4-4429-4016-904a-795c8546f50b service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:18.386165 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ac97824a-9578-4d34-806b-8a74ae68b54b req-dcf168c4-4429-4016-904a-795c8546f50b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:18.388116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ac97824a-9578-4d34-806b-8a74ae68b54b req-dcf168c4-4429-4016-904a-795c8546f50b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:18.416831 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-ac97824a-9578-4d34-806b-8a74ae68b54b req-dcf168c4-4429-4016-904a-795c8546f50b service nova] Creating event network-vif-plugged:ae63cbe5-283c-42c7-8611-bf3675d0c6dc for instance b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc on n-h1-852087-9 Sep 07 12:40:18.432399 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-ac97824a-9578-4d34-806b-8a74ae68b54b req-dcf168c4-4429-4016-904a-795c8546f50b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128286 Sep 07 12:40:18.442007 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1188/2317] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:40:18.556082 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-74f6d339-656b-4285-b484-5cd8fc4f903a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:40:18.556824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-74f6d339-656b-4285-b484-5cd8fc4f903a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:40:18.557738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-74f6d339-656b-4285-b484-5cd8fc4f903a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:40:18.558625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-74f6d339-656b-4285-b484-5cd8fc4f903a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:40:18.560315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-74f6d339-656b-4285-b484-5cd8fc4f903a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:40:18.586879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74f6d339-656b-4285-b484-5cd8fc4f903a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:18.588178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74f6d339-656b-4285-b484-5cd8fc4f903a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:18.589259 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74f6d339-656b-4285-b484-5cd8fc4f903a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:18.591496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74f6d339-656b-4285-b484-5cd8fc4f903a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:18.592778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74f6d339-656b-4285-b484-5cd8fc4f903a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:18.593795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74f6d339-656b-4285-b484-5cd8fc4f903a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:18.640407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-74f6d339-656b-4285-b484-5cd8fc4f903a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Getting quotas for project ef5b2dd007e944358d72268414868096. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:40:18.657678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-74f6d339-656b-4285-b484-5cd8fc4f903a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Getting quotas for user b920811be01745fc9faea7a9ce213c6e and project ef5b2dd007e944358d72268414868096. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:40:18.730958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-74f6d339-656b-4285-b484-5cd8fc4f903a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:40:18.760662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-74f6d339-656b-4285-b484-5cd8fc4f903a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:40:19.004067 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-74f6d339-656b-4285-b484-5cd8fc4f903a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.725431 Sep 07 12:40:19.013196 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1130/2318] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:40:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:40:19.040433 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-485d16df-ee5f-4b7e-91f9-abbd331fc89e tempest-FloatingIPsNegativeTestJSON-1452227678 tempest-FloatingIPsNegativeTestJSON-1452227678-project] Calling method '.version_select at 0x7fc4192dc280>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:19.046953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2a854206-aeb2-41b5-92b4-ad3dd4ee927e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1994114935", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "0ac8c6ba-1ff3-44c9-a6a3-f9ca8013e51a"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:19.171059 n-d-852087-9 devstack@n-api.service[122433]: DEBUG neutronclient.v2_0.client [None req-485d16df-ee5f-4b7e-91f9-abbd331fc89e tempest-FloatingIPsNegativeTestJSON-1452227678 tempest-FloatingIPsNegativeTestJSON-1452227678-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 1ae10453-370f-4bac-8747-fd5c73672624 could not be found", "detail": ""}} {{(pid=122433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 12:40:19.174034 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-485d16df-ee5f-4b7e-91f9-abbd331fc89e tempest-FloatingIPsNegativeTestJSON-1452227678 tempest-FloatingIPsNegativeTestJSON-1452227678-project] HTTP exception thrown: Floating IP not found for ID 1ae10453-370f-4bac-8747-fd5c73672624 Sep 07 12:40:19.181377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-485d16df-ee5f-4b7e-91f9-abbd331fc89e tempest-FloatingIPsNegativeTestJSON-1452227678 tempest-FloatingIPsNegativeTestJSON-1452227678-project] Request method failure captured: Sep 07 12:40:19.181377 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-floating-ips/1ae10453-370f-4bac-8747-fd5c73672624 HTTP/1.1 Sep 07 12:40:19.181377 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:40:19.181377 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:40:19.181377 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:40:19.181377 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:40:19.181377 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:40:19.181377 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:40:19.181377 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:40:19.181377 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:40:19.181377 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJEt1H8wjuDgPB_Cd0R_pgtnAA9gzsCQ_1OHPd6e-46D9N24o2oirr6hvv4VB9UtRX1uXKqdUA8EFFgJ8diWMmBtw0VSKudR8qN5x9Xa_woN0BNLfGXKxE8bZQv9IUGBfa8ivKs5kDf4qv7IcMMsq4JHh_eKqPFSllHHmuBmvoY_lq8 Sep 07 12:40:19.181377 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:40:19.181377 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:40:19.181377 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:40:19.181377 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:40:19.181377 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:40:19.181377 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:40:19.181377 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 4ace362c8f6f4b46a3627b246b969e5a Sep 07 12:40:19.181377 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1452227678 Sep 07 12:40:19.181377 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:40:19.181377 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:40:19.184307 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4ace362c8f6f4b46a3627b246b969e5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4ace362c8f6f4b46a3627b246b969e5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4ace362c8f6f4b46a3627b246b969e5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4ace362c8f6f4b46a3627b246b969e5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:40:19.184307 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1452227678 Sep 07 12:40:19.184307 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 4ace362c8f6f4b46a3627b246b969e5a Sep 07 12:40:19.184307 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1452227678 Sep 07 12:40:19.184307 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-FloatingIPsNegativeTestJSON-1452227678-project Sep 07 12:40:19.184307 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:40:19.184307 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:40:19.184307 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: c84ad6869d6a46ce808af5c522061a88 Sep 07 12:40:19.184307 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1452227678-project Sep 07 12:40:19.184307 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:40:19.184307 n-d-852087-9 devstack@n-api.service[122433]: exception: Floating IP not found for ID 1ae10453-370f-4bac-8747-fd5c73672624 Sep 07 12:40:19.184307 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '1ae10453-370f-4bac-8747-fd5c73672624'} Sep 07 12:40:19.184307 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:40:19.189069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:19.189069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 07 12:40:19.189069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 07 12:40:19.189069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:40:19.189069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:40:19.189069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 07 12:40:19.189069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 07 12:40:19.189069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:40:19.189069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:40:19.189069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 12:40:19.189069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 12:40:19.189069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:40:19.189069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:40:19.189069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 12:40:19.189069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 12:40:19.189069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:40:19.189069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:40:19.189069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 12:40:19.189069 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 12:40:19.191731 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:40:19.191731 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:40:19.191731 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 12:40:19.191731 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 12:40:19.191731 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 12:40:19.191731 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 12:40:19.191731 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 1ae10453-370f-4bac-8747-fd5c73672624 could not be found Sep 07 12:40:19.191731 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88eb8f24-0ec5-48dc-b013-b1f6c9a3f8fe'] Sep 07 12:40:19.191731 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:19.191731 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:19.191731 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:19.191731 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:19.191731 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 07 12:40:19.191731 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 07 12:40:19.191731 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 07 12:40:19.191731 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 07 12:40:19.191731 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 1ae10453-370f-4bac-8747-fd5c73672624. Sep 07 12:40:19.191731 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:19.191731 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:19.191731 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:19.195705 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:19.195705 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:19.195705 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:19.195705 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:40:19.195705 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:40:19.195705 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:40:19.195705 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:40:19.195705 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:40:19.195705 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:40:19.195705 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 07 12:40:19.195705 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 07 12:40:19.195705 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 1ae10453-370f-4bac-8747-fd5c73672624 Sep 07 12:40:19.195705 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:19.195705 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:19.195705 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:19.195705 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:19.195705 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:19.195705 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:19.195705 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:40:19.195705 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:40:19.200489 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 1ae10453-370f-4bac-8747-fd5c73672624 Sep 07 12:40:19.200489 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:19.200489 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-485d16df-ee5f-4b7e-91f9-abbd331fc89e tempest-FloatingIPsNegativeTestJSON-1452227678 tempest-FloatingIPsNegativeTestJSON-1452227678-project] Returning 404 to user: Floating IP not found for ID 1ae10453-370f-4bac-8747-fd5c73672624 {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:40:19.200489 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-485d16df-ee5f-4b7e-91f9-abbd331fc89e tempest-FloatingIPsNegativeTestJSON-1452227678 tempest-FloatingIPsNegativeTestJSON-1452227678-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/1ae10453-370f-4bac-8747-fd5c73672624" status: 404 len: 111 microversion: 2.1 time: 0.174898 Sep 07 12:40:19.200489 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1131/2319] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Sep 7 12:40:19 2022] DELETE /compute/v2.1/os-floating-ips/1ae10453-370f-4bac-8747-fd5c73672624 => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:40:19.227226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d07aabd7-eeb9-48ba-877c-4ef8d33f39e2 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:19.228114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d07aabd7-eeb9-48ba-877c-4ef8d33f39e2 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:19.267624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d07aabd7-eeb9-48ba-877c-4ef8d33f39e2 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:19.270247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d07aabd7-eeb9-48ba-877c-4ef8d33f39e2 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:19.271908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d07aabd7-eeb9-48ba-877c-4ef8d33f39e2 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:19.274642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d07aabd7-eeb9-48ba-877c-4ef8d33f39e2 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:19.276690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d07aabd7-eeb9-48ba-877c-4ef8d33f39e2 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:19.277211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d07aabd7-eeb9-48ba-877c-4ef8d33f39e2 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:19.365968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-2a854206-aeb2-41b5-92b4-ad3dd4ee927e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] validate_networks() for [('0ac8c6ba-1ff3-44c9-a6a3-f9ca8013e51a', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:40:20.666382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d07aabd7-eeb9-48ba-877c-4ef8d33f39e2 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d991fa2c5754b14a7a0e638b486f06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d453f24efa048f0a67ab7834d0005c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:20.722705 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d07aabd7-eeb9-48ba-877c-4ef8d33f39e2 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f" status: 200 len: 1292 microversion: 2.1 time: 1.521945 Sep 07 12:40:20.723313 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1132/2320] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:19 2022] GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f => generated 1292 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:20.743550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-be510e99-f695-45b7-a263-f8c1dc201ac1 req-3df1f8ff-5c5f-4e9e-a19a-9f9d61cac841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a72bc8e2-53a9-4c43-83b1-c86bfef2e918", "name": "network-vif-deleted", "tag": "840128a7-29eb-4c42-8c9d-e4c58a31e527"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:20.786511 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-be510e99-f695-45b7-a263-f8c1dc201ac1 req-3df1f8ff-5c5f-4e9e-a19a-9f9d61cac841 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:20.786948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-be510e99-f695-45b7-a263-f8c1dc201ac1 req-3df1f8ff-5c5f-4e9e-a19a-9f9d61cac841 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:20.793865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-be510e99-f695-45b7-a263-f8c1dc201ac1 req-3df1f8ff-5c5f-4e9e-a19a-9f9d61cac841 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:20.838694 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-be510e99-f695-45b7-a263-f8c1dc201ac1 req-3df1f8ff-5c5f-4e9e-a19a-9f9d61cac841 service nova] Creating event network-vif-deleted:840128a7-29eb-4c42-8c9d-e4c58a31e527 for instance a72bc8e2-53a9-4c43-83b1-c86bfef2e918 on n-h2-852087-9 Sep 07 12:40:20.846472 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-be510e99-f695-45b7-a263-f8c1dc201ac1 req-3df1f8ff-5c5f-4e9e-a19a-9f9d61cac841 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115409 Sep 07 12:40:20.852329 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1133/2321] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:40:20.870320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2d162dcd-cd51-4025-9fbd-3c8405c11530 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:20.877550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2d162dcd-cd51-4025-9fbd-3c8405c11530 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Request method failure captured: Sep 07 12:40:20.877550 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Sep 07 12:40:20.877550 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:40:20.877550 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:40:20.877550 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:40:20.877550 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:40:20.877550 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:40:20.877550 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:40:20.877550 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:40:20.877550 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:40:20.877550 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJDsBdDBuK6-U-oa3EgLwJ0cInn42LooYDDK2xuzMieAmtDdHVgCQSCGUg7Mms36Dytx6iFOmjDeDJYTcyb97tpVFzJ2wUaPiQNOZa3rYItTJozEFSKJVy72U0F8Z9IglffmC_MrHLrEV6jHa3Ae7EJd2NyfR5n6uH1QOj7TevCy0ho Sep 07 12:40:20.877550 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:40:20.877550 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:40:20.877550 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:40:20.877550 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:40:20.877550 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:40:20.877550 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:40:20.877550 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: e28a1b6c8dde4b948d493b369535a301 Sep 07 12:40:20.877550 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ListServersNegativeTestJSON-1212395273 Sep 07 12:40:20.877550 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:40:20.877550 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:40:20.878784 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:40:20.878784 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ListServersNegativeTestJSON-1212395273 Sep 07 12:40:20.878784 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: e28a1b6c8dde4b948d493b369535a301 Sep 07 12:40:20.878784 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1212395273 Sep 07 12:40:20.878784 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ListServersNegativeTestJSON-1212395273-project Sep 07 12:40:20.878784 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:40:20.878784 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:40:20.878784 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 3f9b8d4c5d9a4efeb97645f3233b1064 Sep 07 12:40:20.878784 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ListServersNegativeTestJSON-1212395273-project Sep 07 12:40:20.878784 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:40:20.878784 n-d-852087-9 devstack@n-api.service[122433]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 07 12:40:20.878784 n-d-852087-9 devstack@n-api.service[122433]: action_args: {} Sep 07 12:40:20.879577 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:40:20.879577 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:20.879577 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:40:20.879577 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:40:20.879577 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:40:20.879577 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:40:20.879577 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Sep 07 12:40:20.879577 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:20.879577 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 07 12:40:20.879577 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 07 12:40:20.879577 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 07 12:40:20.879577 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 07 12:40:20.879577 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 07 12:40:20.879577 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:20.879577 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 07 12:40:20.879577 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi '-1' Sep 07 12:40:20.879577 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:20.879577 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:20.879577 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:20.879577 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:20.879577 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:20.879577 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:20.879577 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:40:20.879577 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:40:20.880779 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:40:20.880779 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:40:20.880779 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 12:40:20.880779 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:40:20.880779 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 12:40:20.880779 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:40:20.880779 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 12:40:20.880779 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:40:20.880779 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 07 12:40:20.880779 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 07 12:40:20.880779 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 07 12:40:20.880779 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:40:20.880779 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:40:20.880779 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:40:20.880779 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:40:20.880779 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 07 12:40:20.880779 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:20.880779 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:20.880779 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:20.880779 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:20.881811 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:20.881811 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:20.881811 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:40:20.881811 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:40:20.881811 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 07 12:40:20.881811 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:20.883141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2d162dcd-cd51-4025-9fbd-3c8405c11530 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:40:20.892805 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2d162dcd-cd51-4025-9fbd-3c8405c11530 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.038898 Sep 07 12:40:20.903038 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1134/2322] 10.222.0.16 () {58 vars in 1142 bytes} [Wed Sep 7 12:40:20 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:40:20.909459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-696ce80e-3611-4eee-b779-d79893ecdbc1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:20.910249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-696ce80e-3611-4eee-b779-d79893ecdbc1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:20.931146 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-696ce80e-3611-4eee-b779-d79893ecdbc1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:20.931950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-696ce80e-3611-4eee-b779-d79893ecdbc1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:20.932447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-696ce80e-3611-4eee-b779-d79893ecdbc1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:20.933189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-696ce80e-3611-4eee-b779-d79893ecdbc1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:20.933789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-696ce80e-3611-4eee-b779-d79893ecdbc1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:20.934301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-696ce80e-3611-4eee-b779-d79893ecdbc1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:21.421516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-696ce80e-3611-4eee-b779-d79893ecdbc1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:21.438387 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-696ce80e-3611-4eee-b779-d79893ecdbc1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc" status: 200 len: 1466 microversion: 2.1 time: 0.543060 Sep 07 12:40:21.438989 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1135/2323] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:20 2022] GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc => generated 1466 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:21.448751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f11d12ea-3bf0-4d49-8c44-3b65fe655dd3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:21.449397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f11d12ea-3bf0-4d49-8c44-3b65fe655dd3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:21.477505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f11d12ea-3bf0-4d49-8c44-3b65fe655dd3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:21.480800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f11d12ea-3bf0-4d49-8c44-3b65fe655dd3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:21.484111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f11d12ea-3bf0-4d49-8c44-3b65fe655dd3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:21.485257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f11d12ea-3bf0-4d49-8c44-3b65fe655dd3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:21.485550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f11d12ea-3bf0-4d49-8c44-3b65fe655dd3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:21.485964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f11d12ea-3bf0-4d49-8c44-3b65fe655dd3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:21.541878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2a854206-aeb2-41b5-92b4-ad3dd4ee927e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:40:21.542667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2a854206-aeb2-41b5-92b4-ad3dd4ee927e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:40:21.543098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2a854206-aeb2-41b5-92b4-ad3dd4ee927e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:40:21.543824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2a854206-aeb2-41b5-92b4-ad3dd4ee927e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:40:21.544818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2a854206-aeb2-41b5-92b4-ad3dd4ee927e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:40:21.609925 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a854206-aeb2-41b5-92b4-ad3dd4ee927e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:21.611034 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a854206-aeb2-41b5-92b4-ad3dd4ee927e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:21.611778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a854206-aeb2-41b5-92b4-ad3dd4ee927e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:21.616034 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a854206-aeb2-41b5-92b4-ad3dd4ee927e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:21.616919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a854206-aeb2-41b5-92b4-ad3dd4ee927e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:21.618000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a854206-aeb2-41b5-92b4-ad3dd4ee927e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:21.711409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f11d12ea-3bf0-4d49-8c44-3b65fe655dd3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:21.720268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-2a854206-aeb2-41b5-92b4-ad3dd4ee927e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Getting quotas for project f1a9377ba32c4732912a4fcd0a6daa08. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:40:21.725835 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f11d12ea-3bf0-4d49-8c44-3b65fe655dd3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1267 microversion: 2.1 time: 0.285705 Sep 07 12:40:21.727588 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1136/2324] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:21 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1267 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:21.735353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-65ce6deb-5d74-41e4-a574-ff1eff382b08 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:21.736433 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-65ce6deb-5d74-41e4-a574-ff1eff382b08 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] [instance: a72bc8e2-53a9-4c43-83b1-c86bfef2e918] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:21.744661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-2a854206-aeb2-41b5-92b4-ad3dd4ee927e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Getting quotas for user 017965094f7d482686f7617e0835b7fc and project f1a9377ba32c4732912a4fcd0a6daa08. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:40:21.753289 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65ce6deb-5d74-41e4-a574-ff1eff382b08 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:21.754141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65ce6deb-5d74-41e4-a574-ff1eff382b08 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:21.754750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65ce6deb-5d74-41e4-a574-ff1eff382b08 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:21.756455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65ce6deb-5d74-41e4-a574-ff1eff382b08 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:21.757375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65ce6deb-5d74-41e4-a574-ff1eff382b08 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:21.758341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65ce6deb-5d74-41e4-a574-ff1eff382b08 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:21.784937 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-65ce6deb-5d74-41e4-a574-ff1eff382b08 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] HTTP exception thrown: Instance a72bc8e2-53a9-4c43-83b1-c86bfef2e918 could not be found. Sep 07 12:40:21.787605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-65ce6deb-5d74-41e4-a574-ff1eff382b08 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Request method failure captured: Sep 07 12:40:21.787605 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 HTTP/1.1 Sep 07 12:40:21.787605 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:40:21.787605 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:40:21.787605 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:40:21.787605 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:40:21.787605 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:40:21.787605 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:40:21.787605 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:40:21.787605 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:40:21.787605 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGI766J91sJuT5F2IEQqMchfKaCbSDDF-J9lwzV5FP6Js_H7pktqjB-3Lio5CpiTElE39UZjTqgIShFlx0VbJgNQCgVyAvoaV1-jKOOUTYFV0esgaVjKSWWfHpfNXej83bOupyFtCRU8lUe_AKArpkP0tH23jA8qcBVLgUCSpGDxJw0U Sep 07 12:40:21.787605 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:40:21.787605 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:40:21.787605 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:40:21.787605 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:40:21.787605 n-d-852087-9 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.25 Sep 07 12:40:21.787605 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:40:21.787605 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:40:21.787605 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 6d7695bab2d84b35bf92bd035da71dc3 Sep 07 12:40:21.787605 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2124170019 Sep 07 12:40:21.787605 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:40:21.787605 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:40:21.788839 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d7695bab2d84b35bf92bd035da71dc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d7695bab2d84b35bf92bd035da71dc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d7695bab2d84b35bf92bd035da71dc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d7695bab2d84b35bf92bd035da71dc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:40:21.788839 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2124170019 Sep 07 12:40:21.788839 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 6d7695bab2d84b35bf92bd035da71dc3 Sep 07 12:40:21.788839 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2124170019 Sep 07 12:40:21.788839 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-LiveAutoBlockMigrationV225Test-2124170019-project Sep 07 12:40:21.788839 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:40:21.788839 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:40:21.788839 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: cf3ae3d912b84a8f906b31874668b740 Sep 07 12:40:21.788839 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2124170019-project Sep 07 12:40:21.788839 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:40:21.788839 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance a72bc8e2-53a9-4c43-83b1-c86bfef2e918 could not be found. Sep 07 12:40:21.788839 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'a72bc8e2-53a9-4c43-83b1-c86bfef2e918'} Sep 07 12:40:21.789541 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:40:21.789541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:21.789541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:40:21.789541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:40:21.789541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:40:21.789541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:40:21.789541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:40:21.789541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:40:21.789541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:40:21.789541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:40:21.789541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a72bc8e2-53a9-4c43-83b1-c86bfef2e918 could not be found. Sep 07 12:40:21.789541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:21.789541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:21.789541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:21.789541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:21.789541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:21.789541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:21.789541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:40:21.789541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:40:21.789541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:40:21.791292 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:40:21.791292 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:40:21.791292 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:40:21.791292 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:40:21.791292 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:40:21.791292 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:40:21.791292 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:40:21.791292 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a72bc8e2-53a9-4c43-83b1-c86bfef2e918 could not be found. Sep 07 12:40:21.791292 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:21.791292 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:21.791292 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:21.791292 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:21.791292 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:21.791292 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:21.791292 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:40:21.791292 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:40:21.791292 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a72bc8e2-53a9-4c43-83b1-c86bfef2e918 could not be found. Sep 07 12:40:21.791292 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:21.792624 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2a854206-aeb2-41b5-92b4-ad3dd4ee927e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:40:21.794118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-65ce6deb-5d74-41e4-a574-ff1eff382b08 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] Returning 404 to user: Instance a72bc8e2-53a9-4c43-83b1-c86bfef2e918 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:40:21.796013 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-65ce6deb-5d74-41e4-a574-ff1eff382b08 tempest-LiveAutoBlockMigrationV225Test-2124170019 tempest-LiveAutoBlockMigrationV225Test-2124170019-project] 10.222.0.16 "GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918" status: 404 len: 111 microversion: 2.25 time: 0.066422 Sep 07 12:40:21.797857 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1137/2325] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:40:21 2022] GET /compute/v2.1/servers/a72bc8e2-53a9-4c43-83b1-c86bfef2e918 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:40:21.799601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2a854206-aeb2-41b5-92b4-ad3dd4ee927e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] [instance: b713d625-5bb0-4562-916a-b9060c88a6d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:40:21.838564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a043fb61-be4a-4b01-bde6-7ea40c1bb26a req-facd1f4e-971c-412f-a07f-8f6d78e0461f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71999ea2-9256-4783-8614-0d28d11aab2f", "name": "network-vif-plugged", "status": "completed", "tag": "175df065-8068-401b-adb5-2c7be0ceb530"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:21.871431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a043fb61-be4a-4b01-bde6-7ea40c1bb26a req-facd1f4e-971c-412f-a07f-8f6d78e0461f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:21.872332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a043fb61-be4a-4b01-bde6-7ea40c1bb26a req-facd1f4e-971c-412f-a07f-8f6d78e0461f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:21.873107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a043fb61-be4a-4b01-bde6-7ea40c1bb26a req-facd1f4e-971c-412f-a07f-8f6d78e0461f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:21.927469 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a043fb61-be4a-4b01-bde6-7ea40c1bb26a req-facd1f4e-971c-412f-a07f-8f6d78e0461f service nova] Creating event network-vif-plugged:175df065-8068-401b-adb5-2c7be0ceb530 for instance 71999ea2-9256-4783-8614-0d28d11aab2f on n-h1-852087-9 Sep 07 12:40:21.929229 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2a854206-aeb2-41b5-92b4-ad3dd4ee927e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.481395 Sep 07 12:40:21.933765 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1189/2326] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:40:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:40:21.946344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1720e121-f1c0-4cf1-bfe2-bcb364df957c tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:21.947891 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a043fb61-be4a-4b01-bde6-7ea40c1bb26a req-facd1f4e-971c-412f-a07f-8f6d78e0461f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146834 Sep 07 12:40:21.948697 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1138/2327] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:40:21.955833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1720e121-f1c0-4cf1-bfe2-bcb364df957c tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Request method failure captured: Sep 07 12:40:21.955833 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Sep 07 12:40:21.955833 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:40:21.955833 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:40:21.955833 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:40:21.955833 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:40:21.955833 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:40:21.955833 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:40:21.955833 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:40:21.955833 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:40:21.955833 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJDsBdDBuK6-U-oa3EgLwJ0cInn42LooYDDK2xuzMieAmtDdHVgCQSCGUg7Mms36Dytx6iFOmjDeDJYTcyb97tpVFzJ2wUaPiQNOZa3rYItTJozEFSKJVy72U0F8Z9IglffmC_MrHLrEV6jHa3Ae7EJd2NyfR5n6uH1QOj7TevCy0ho Sep 07 12:40:21.955833 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:40:21.955833 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:40:21.955833 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:40:21.955833 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:40:21.955833 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:40:21.955833 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:40:21.955833 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: e28a1b6c8dde4b948d493b369535a301 Sep 07 12:40:21.955833 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ListServersNegativeTestJSON-1212395273 Sep 07 12:40:21.955833 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:40:21.955833 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:40:21.958233 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:40:21.958233 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ListServersNegativeTestJSON-1212395273 Sep 07 12:40:21.958233 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: e28a1b6c8dde4b948d493b369535a301 Sep 07 12:40:21.958233 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1212395273 Sep 07 12:40:21.958233 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ListServersNegativeTestJSON-1212395273-project Sep 07 12:40:21.958233 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:40:21.958233 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:40:21.958233 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 3f9b8d4c5d9a4efeb97645f3233b1064 Sep 07 12:40:21.958233 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ListServersNegativeTestJSON-1212395273-project Sep 07 12:40:21.958233 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:40:21.958233 n-d-852087-9 devstack@n-api.service[122432]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 07 12:40:21.958233 n-d-852087-9 devstack@n-api.service[122432]: action_args: {} Sep 07 12:40:21.959997 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:40:21.959997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:21.959997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:40:21.959997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:40:21.959997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:40:21.959997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:40:21.959997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Sep 07 12:40:21.959997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:21.959997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 07 12:40:21.959997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 07 12:40:21.959997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 07 12:40:21.959997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 07 12:40:21.959997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 07 12:40:21.959997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:21.959997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 07 12:40:21.959997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'testing' Sep 07 12:40:21.959997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:21.959997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:21.959997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:21.959997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:21.959997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:21.959997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:21.959997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:40:21.959997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:40:21.962555 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:40:21.962555 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:40:21.962555 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 12:40:21.962555 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:40:21.962555 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 12:40:21.962555 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:40:21.962555 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 12:40:21.962555 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:40:21.962555 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 07 12:40:21.962555 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 07 12:40:21.962555 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 07 12:40:21.962555 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:40:21.962555 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:40:21.962555 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:40:21.962555 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:40:21.962555 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 07 12:40:21.962555 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:21.962555 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:21.962555 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:21.962555 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:21.979824 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:21.979824 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:21.979824 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:40:21.979824 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:40:21.979824 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 07 12:40:21.979824 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:21.979824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1720e121-f1c0-4cf1-bfe2-bcb364df957c tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:40:21.979824 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1720e121-f1c0-4cf1-bfe2-bcb364df957c tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.027887 Sep 07 12:40:21.979824 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1190/2328] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Sep 7 12:40:21 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:40:21.982121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c34334e7-103b-48dc-a5cb-5f1a0eaa81b0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:21.982853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c34334e7-103b-48dc-a5cb-5f1a0eaa81b0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:22.016478 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c34334e7-103b-48dc-a5cb-5f1a0eaa81b0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:22.016959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c34334e7-103b-48dc-a5cb-5f1a0eaa81b0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:22.017764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c34334e7-103b-48dc-a5cb-5f1a0eaa81b0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:22.022362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c34334e7-103b-48dc-a5cb-5f1a0eaa81b0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:22.023443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c34334e7-103b-48dc-a5cb-5f1a0eaa81b0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:22.024294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c34334e7-103b-48dc-a5cb-5f1a0eaa81b0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:22.533193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-88e5c7bf-ae0c-49f6-9734-4f67f226e71a tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:22.535473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-88e5c7bf-ae0c-49f6-9734-4f67f226e71a tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] [instance: b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:22.549303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88e5c7bf-ae0c-49f6-9734-4f67f226e71a tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:22.550616 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88e5c7bf-ae0c-49f6-9734-4f67f226e71a tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:22.551428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88e5c7bf-ae0c-49f6-9734-4f67f226e71a tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:22.552730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88e5c7bf-ae0c-49f6-9734-4f67f226e71a tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:22.553675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88e5c7bf-ae0c-49f6-9734-4f67f226e71a tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:22.554743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88e5c7bf-ae0c-49f6-9734-4f67f226e71a tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:23.068425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c34334e7-103b-48dc-a5cb-5f1a0eaa81b0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d991fa2c5754b14a7a0e638b486f06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d453f24efa048f0a67ab7834d0005c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:23.094783 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c34334e7-103b-48dc-a5cb-5f1a0eaa81b0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f" status: 200 len: 1292 microversion: 2.1 time: 1.128047 Sep 07 12:40:23.097589 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1191/2329] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:21 2022] GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f => generated 1292 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:23.270308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e27959ae-ca3e-412b-9478-2fb58e1c8330 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1179256144", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:23.456763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-e27959ae-ca3e-412b-9478-2fb58e1c8330 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:40:24.182920 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-88e5c7bf-ae0c-49f6-9734-4f67f226e71a tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc" status: 200 len: 1617 microversion: 2.1 time: 2.228681 Sep 07 12:40:24.186031 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1139/2330] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:21 2022] GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc => generated 1617 bytes in 2237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:24.202396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fb37385c-d933-4d3f-aa69-72a63b7f771e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:24.206337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fb37385c-d933-4d3f-aa69-72a63b7f771e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] [instance: b713d625-5bb0-4562-916a-b9060c88a6d1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:24.214759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb37385c-d933-4d3f-aa69-72a63b7f771e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:24.221828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb37385c-d933-4d3f-aa69-72a63b7f771e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:24.225689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb37385c-d933-4d3f-aa69-72a63b7f771e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:24.228794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb37385c-d933-4d3f-aa69-72a63b7f771e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:24.231188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb37385c-d933-4d3f-aa69-72a63b7f771e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:24.233202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb37385c-d933-4d3f-aa69-72a63b7f771e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:24.423924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fb37385c-d933-4d3f-aa69-72a63b7f771e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017965094f7d482686f7617e0835b7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a9377ba32c4732912a4fcd0a6daa08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:24.435253 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fb37385c-d933-4d3f-aa69-72a63b7f771e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] 10.222.0.16 "GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1" status: 200 len: 1268 microversion: 2.1 time: 0.246794 Sep 07 12:40:24.439694 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1140/2331] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:24 2022] GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1 => generated 1268 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:24.459214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-43861610-6926-4b36-b329-db2bbc3ebda8 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:24.471419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-43861610-6926-4b36-b329-db2bbc3ebda8 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:24.472505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-43861610-6926-4b36-b329-db2bbc3ebda8 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'e28a1b6c8dde4b948d493b369535a301'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:40:24.489542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.compute.servers [None req-43861610-6926-4b36-b329-db2bbc3ebda8 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Flavor 'non_existing_flavor' could not be found {{(pid=122433) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Sep 07 12:40:24.490980 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-43861610-6926-4b36-b329-db2bbc3ebda8 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.043567 Sep 07 12:40:24.492136 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1141/2332] 10.222.0.16 () {58 vars in 1178 bytes} [Wed Sep 7 12:40:24 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:40:24.498126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a457173a-5876-4853-9ffa-b51ac2c34155 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:24.512179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a457173a-5876-4853-9ffa-b51ac2c34155 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:24.532430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a457173a-5876-4853-9ffa-b51ac2c34155 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:24.538109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a457173a-5876-4853-9ffa-b51ac2c34155 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:24.539234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a457173a-5876-4853-9ffa-b51ac2c34155 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:24.540169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a457173a-5876-4853-9ffa-b51ac2c34155 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:24.546183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a457173a-5876-4853-9ffa-b51ac2c34155 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:24.546753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a457173a-5876-4853-9ffa-b51ac2c34155 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:24.659525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e27959ae-ca3e-412b-9478-2fb58e1c8330 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:40:24.660615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e27959ae-ca3e-412b-9478-2fb58e1c8330 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:40:24.661266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e27959ae-ca3e-412b-9478-2fb58e1c8330 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:40:24.661908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e27959ae-ca3e-412b-9478-2fb58e1c8330 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:40:24.662488 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e27959ae-ca3e-412b-9478-2fb58e1c8330 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:40:24.669258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:40:24.708180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e27959ae-ca3e-412b-9478-2fb58e1c8330 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:24.708707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e27959ae-ca3e-412b-9478-2fb58e1c8330 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:24.709151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e27959ae-ca3e-412b-9478-2fb58e1c8330 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:24.709958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e27959ae-ca3e-412b-9478-2fb58e1c8330 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:24.710428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e27959ae-ca3e-412b-9478-2fb58e1c8330 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:24.710856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e27959ae-ca3e-412b-9478-2fb58e1c8330 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:24.776235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a457173a-5876-4853-9ffa-b51ac2c34155 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:24.777464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-e27959ae-ca3e-412b-9478-2fb58e1c8330 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Getting quotas for project d9b06047717c4a5ca47ebc72587256fb. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:40:24.784865 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a457173a-5876-4853-9ffa-b51ac2c34155 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1273 microversion: 2.1 time: 0.290575 Sep 07 12:40:24.785464 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1142/2333] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:24 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1273 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:24.794570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-e27959ae-ca3e-412b-9478-2fb58e1c8330 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Getting quotas for user 6f493fa6856847b4ae7cc8eb997a14c7 and project d9b06047717c4a5ca47ebc72587256fb. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:40:24.805871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1dd420f5-701f-48fc-a2a6-e4dec1ee650d tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:24.806764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1dd420f5-701f-48fc-a2a6-e4dec1ee650d tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:24.824136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dd420f5-701f-48fc-a2a6-e4dec1ee650d tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:24.825972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dd420f5-701f-48fc-a2a6-e4dec1ee650d tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:24.829023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dd420f5-701f-48fc-a2a6-e4dec1ee650d tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:24.830051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dd420f5-701f-48fc-a2a6-e4dec1ee650d tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:24.830681 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dd420f5-701f-48fc-a2a6-e4dec1ee650d tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:24.832821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1dd420f5-701f-48fc-a2a6-e4dec1ee650d tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:24.844027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e27959ae-ca3e-412b-9478-2fb58e1c8330 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:40:24.856097 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e27959ae-ca3e-412b-9478-2fb58e1c8330 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:40:24.949929 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e27959ae-ca3e-412b-9478-2fb58e1c8330 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.832939 Sep 07 12:40:24.959172 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1192/2334] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:40:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:40:24.965715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5c4c1446-749c-4b96-a289-a77927eb5c67 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Action: 'create', calling method: .version_select at 0x7fc41d1f10d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-2094874072", "policies": ["affinity"]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:25.046689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-5c4c1446-749c-4b96-a289-a77927eb5c67 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'server_groups'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:40:25.067637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-5c4c1446-749c-4b96-a289-a77927eb5c67 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for user ed6e5d4d54224bca90954d1ebbd7b7a3 and project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'server_groups'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:40:25.262310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-5c4c1446-749c-4b96-a289-a77927eb5c67 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'server_groups'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:40:25.279175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-5c4c1446-749c-4b96-a289-a77927eb5c67 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for user ed6e5d4d54224bca90954d1ebbd7b7a3 and project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'server_groups'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:40:25.346657 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5c4c1446-749c-4b96-a289-a77927eb5c67 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.385773 Sep 07 12:40:25.347861 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1193/2335] 10.222.0.16 () {60 vars in 1174 bytes} [Wed Sep 7 12:40:24 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:40:25.363146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0fc11103-bb5f-455f-badd-b41b6b689ac0 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:25.368814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0fc11103-bb5f-455f-badd-b41b6b689ac0 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:25.369830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0fc11103-bb5f-455f-badd-b41b6b689ac0 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'e28a1b6c8dde4b948d493b369535a301'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:40:25.379589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fc11103-bb5f-455f-badd-b41b6b689ac0 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:25.381962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fc11103-bb5f-455f-badd-b41b6b689ac0 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:25.382557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fc11103-bb5f-455f-badd-b41b6b689ac0 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:25.383681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fc11103-bb5f-455f-badd-b41b6b689ac0 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:25.384279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fc11103-bb5f-455f-badd-b41b6b689ac0 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:25.387181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fc11103-bb5f-455f-badd-b41b6b689ac0 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:25.567934 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0fc11103-bb5f-455f-badd-b41b6b689ac0 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.218353 Sep 07 12:40:25.576026 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1194/2336] 10.222.0.16 () {58 vars in 1174 bytes} [Wed Sep 7 12:40:25 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:40:25.582400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3048ad7b-fe1b-4923-9713-845d8e3e5f05 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:25.587778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3048ad7b-fe1b-4923-9713-845d8e3e5f05 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:25.775941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3048ad7b-fe1b-4923-9713-845d8e3e5f05 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f493fa6856847b4ae7cc8eb997a14c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b06047717c4a5ca47ebc72587256fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:25.789818 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3048ad7b-fe1b-4923-9713-845d8e3e5f05 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce" status: 200 len: 1217 microversion: 2.1 time: 0.211953 Sep 07 12:40:25.795894 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1195/2337] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:25 2022] GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce => generated 1217 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:25.814349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b880599a-1352-4ece-9ffa-7d3793038732 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:25.815575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b880599a-1352-4ece-9ffa-7d3793038732 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] [instance: b713d625-5bb0-4562-916a-b9060c88a6d1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:25.832254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b880599a-1352-4ece-9ffa-7d3793038732 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:25.836221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b880599a-1352-4ece-9ffa-7d3793038732 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:25.836969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b880599a-1352-4ece-9ffa-7d3793038732 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:25.837991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b880599a-1352-4ece-9ffa-7d3793038732 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:25.840171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b880599a-1352-4ece-9ffa-7d3793038732 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:25.840906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b880599a-1352-4ece-9ffa-7d3793038732 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:25.911796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1dd420f5-701f-48fc-a2a6-e4dec1ee650d tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d991fa2c5754b14a7a0e638b486f06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d453f24efa048f0a67ab7834d0005c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:25.927650 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1dd420f5-701f-48fc-a2a6-e4dec1ee650d tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f" status: 200 len: 1292 microversion: 2.1 time: 1.133991 Sep 07 12:40:25.928182 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1143/2338] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:24 2022] GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f => generated 1292 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:25.961164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1104927471", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "0a940909-7557-42a1-b854-5549ca49a0b6"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:26.070206 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:40:26.187272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b880599a-1352-4ece-9ffa-7d3793038732 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017965094f7d482686f7617e0835b7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a9377ba32c4732912a4fcd0a6daa08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:26.202581 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b880599a-1352-4ece-9ffa-7d3793038732 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] 10.222.0.16 "GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1" status: 200 len: 1274 microversion: 2.1 time: 0.405049 Sep 07 12:40:26.203885 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1196/2339] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:25 2022] GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1 => generated 1274 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:26.208733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-64cbc449-1696-49a7-9d10-fe55e8b5a427 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:26.222934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-64cbc449-1696-49a7-9d10-fe55e8b5a427 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:26.226149 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-64cbc449-1696-49a7-9d10-fe55e8b5a427 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'e28a1b6c8dde4b948d493b369535a301'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:40:26.241953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64cbc449-1696-49a7-9d10-fe55e8b5a427 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:26.246737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64cbc449-1696-49a7-9d10-fe55e8b5a427 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:26.247389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64cbc449-1696-49a7-9d10-fe55e8b5a427 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:26.248560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64cbc449-1696-49a7-9d10-fe55e8b5a427 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:26.252963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64cbc449-1696-49a7-9d10-fe55e8b5a427 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:26.253744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64cbc449-1696-49a7-9d10-fe55e8b5a427 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:26.485305 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-64cbc449-1696-49a7-9d10-fe55e8b5a427 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.280031 Sep 07 12:40:26.488379 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1197/2340] 10.222.0.16 () {58 vars in 1184 bytes} [Wed Sep 7 12:40:26 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:40:26.499610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5693e7e1-12cd-4fa7-b789-36b6651025fa tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:26.501626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5693e7e1-12cd-4fa7-b789-36b6651025fa tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:26.514730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5693e7e1-12cd-4fa7-b789-36b6651025fa tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:26.515759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5693e7e1-12cd-4fa7-b789-36b6651025fa tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:26.516596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5693e7e1-12cd-4fa7-b789-36b6651025fa tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:26.518784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5693e7e1-12cd-4fa7-b789-36b6651025fa tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:26.519701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5693e7e1-12cd-4fa7-b789-36b6651025fa tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:26.520469 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5693e7e1-12cd-4fa7-b789-36b6651025fa tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:26.705103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:40:26.705876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:40:26.706536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:40:26.707098 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:40:26.707668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:40:26.772724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:26.772950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:26.773696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:26.774676 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:26.775328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:26.775982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:26.819495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:40:26.842941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for user ed6e5d4d54224bca90954d1ebbd7b7a3 and project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:40:26.884804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Going to run 2 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:40:26.888059 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 65f0a19b-4d7c-4874-accf-9f62a5b48847] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:40:26.985871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122433) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 07 12:40:27.056271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:40:27.110938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for user ed6e5d4d54224bca90954d1ebbd7b7a3 and project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:40:27.275951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:40:27.288285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for user ed6e5d4d54224bca90954d1ebbd7b7a3 and project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:40:27.325963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:40:27.339093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: aa6c3482-9f8e-41a7-8bec-32d428a3ce52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=65f0a19b-4d7c-4874-accf-9f62a5b48847,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:40:27.485591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5693e7e1-12cd-4fa7-b789-36b6651025fa tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:27.498528 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5693e7e1-12cd-4fa7-b789-36b6651025fa tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1315 microversion: 2.1 time: 1.006975 Sep 07 12:40:27.500172 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1198/2341] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:26 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1315 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:27.513723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:40:27.524840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-47fbaa97-a8ca-42d5-aeff-b7cbca967e3d tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:27.527976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for user ed6e5d4d54224bca90954d1ebbd7b7a3 and project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:40:27.546983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-47fbaa97-a8ca-42d5-aeff-b7cbca967e3d tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:27.547383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-47fbaa97-a8ca-42d5-aeff-b7cbca967e3d tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Searching by: {'deleted': False, 'project_id': 'e28a1b6c8dde4b948d493b369535a301'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:40:27.607482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47fbaa97-a8ca-42d5-aeff-b7cbca967e3d tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:27.612722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47fbaa97-a8ca-42d5-aeff-b7cbca967e3d tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:27.613228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47fbaa97-a8ca-42d5-aeff-b7cbca967e3d tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:27.614099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47fbaa97-a8ca-42d5-aeff-b7cbca967e3d tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:27.614575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47fbaa97-a8ca-42d5-aeff-b7cbca967e3d tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:27.615293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47fbaa97-a8ca-42d5-aeff-b7cbca967e3d tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:27.664248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:40:27.689187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for user ed6e5d4d54224bca90954d1ebbd7b7a3 and project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:40:27.738043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-47fbaa97-a8ca-42d5-aeff-b7cbca967e3d tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:40:27.808428 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-72611d0a-c812-40a5-bc1c-e05d88bd8abe tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.868469 Sep 07 12:40:27.813624 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1144/2342] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:40:25 2022] POST /compute/v2.1/servers => generated 32 bytes in 1875 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 07 12:40:27.827045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0a3e1f73-e9a6-4188-96d6-39901de74eb4 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:27.828516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0a3e1f73-e9a6-4188-96d6-39901de74eb4 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:27.837201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-47fbaa97-a8ca-42d5-aeff-b7cbca967e3d tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:27.845915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a3e1f73-e9a6-4188-96d6-39901de74eb4 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:27.848044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a3e1f73-e9a6-4188-96d6-39901de74eb4 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:27.851750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a3e1f73-e9a6-4188-96d6-39901de74eb4 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:27.854005 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a3e1f73-e9a6-4188-96d6-39901de74eb4 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:27.856816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a3e1f73-e9a6-4188-96d6-39901de74eb4 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:27.857678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a3e1f73-e9a6-4188-96d6-39901de74eb4 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:27.862178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47fbaa97-a8ca-42d5-aeff-b7cbca967e3d tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:27.863149 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47fbaa97-a8ca-42d5-aeff-b7cbca967e3d tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:27.864743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47fbaa97-a8ca-42d5-aeff-b7cbca967e3d tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:27.871151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:40:28.157907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0a3e1f73-e9a6-4188-96d6-39901de74eb4 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f493fa6856847b4ae7cc8eb997a14c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b06047717c4a5ca47ebc72587256fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:28.175217 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0a3e1f73-e9a6-4188-96d6-39901de74eb4 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce" status: 200 len: 1269 microversion: 2.1 time: 0.359830 Sep 07 12:40:28.176815 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1145/2343] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:27 2022] GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce => generated 1269 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:28.188863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cc1cc440-c04a-4acc-9ff2-08842251d58a tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:28.190615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cc1cc440-c04a-4acc-9ff2-08842251d58a tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:28.213902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc1cc440-c04a-4acc-9ff2-08842251d58a tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:28.214840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc1cc440-c04a-4acc-9ff2-08842251d58a tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:28.215511 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc1cc440-c04a-4acc-9ff2-08842251d58a tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:28.216484 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc1cc440-c04a-4acc-9ff2-08842251d58a tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:28.217594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc1cc440-c04a-4acc-9ff2-08842251d58a tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:28.218296 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc1cc440-c04a-4acc-9ff2-08842251d58a tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:29.256843 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-47fbaa97-a8ca-42d5-aeff-b7cbca967e3d tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 1.746481 Sep 07 12:40:29.257768 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1199/2344] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:40:27 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:29.263266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9687c367-7daa-4918-9ee9-0730221c1740 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:29.263892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9687c367-7daa-4918-9ee9-0730221c1740 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] [instance: b713d625-5bb0-4562-916a-b9060c88a6d1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:29.309451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9687c367-7daa-4918-9ee9-0730221c1740 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:29.310154 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9687c367-7daa-4918-9ee9-0730221c1740 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:29.310677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9687c367-7daa-4918-9ee9-0730221c1740 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:29.311884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9687c367-7daa-4918-9ee9-0730221c1740 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:29.312428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9687c367-7daa-4918-9ee9-0730221c1740 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:29.312974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9687c367-7daa-4918-9ee9-0730221c1740 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:29.888087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cc1cc440-c04a-4acc-9ff2-08842251d58a tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d991fa2c5754b14a7a0e638b486f06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d453f24efa048f0a67ab7834d0005c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:29.917159 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cc1cc440-c04a-4acc-9ff2-08842251d58a tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f" status: 200 len: 1482 microversion: 2.1 time: 1.735278 Sep 07 12:40:29.934591 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1146/2345] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:28 2022] GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f => generated 1482 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:29.970167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d5c6d033-6bc7-4906-b497-ad231098ca72 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:29.983686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d5c6d033-6bc7-4906-b497-ad231098ca72 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:29.990261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d5c6d033-6bc7-4906-b497-ad231098ca72 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Searching by: {'deleted': False, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:40:30.012389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5c6d033-6bc7-4906-b497-ad231098ca72 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:30.013748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5c6d033-6bc7-4906-b497-ad231098ca72 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:30.014761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5c6d033-6bc7-4906-b497-ad231098ca72 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:30.016879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5c6d033-6bc7-4906-b497-ad231098ca72 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:30.018238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5c6d033-6bc7-4906-b497-ad231098ca72 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:30.019238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5c6d033-6bc7-4906-b497-ad231098ca72 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:30.090832 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-d5c6d033-6bc7-4906-b497-ad231098ca72 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:40:30.133192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:40:30.163091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9687c367-7daa-4918-9ee9-0730221c1740 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017965094f7d482686f7617e0835b7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a9377ba32c4732912a4fcd0a6daa08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:30.186349 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9687c367-7daa-4918-9ee9-0730221c1740 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] 10.222.0.16 "GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1" status: 200 len: 1316 microversion: 2.1 time: 0.927020 Sep 07 12:40:30.195145 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d5c6d033-6bc7-4906-b497-ad231098ca72 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.255505 Sep 07 12:40:30.198126 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1200/2346] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:29 2022] GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1 => generated 1316 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:30.199856 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1147/2347] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Sep 7 12:40:29 2022] GET /compute/v2.1/servers => generated 1003 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:30.208629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-493c8e6f-01ae-4537-b1fa-dacfb99f53f3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:30.214453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d55b59d3-73c7-4cfb-a016-2846001c7c6d tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:30.215541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-493c8e6f-01ae-4537-b1fa-dacfb99f53f3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:30.218359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d55b59d3-73c7-4cfb-a016-2846001c7c6d tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:30.236460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-493c8e6f-01ae-4537-b1fa-dacfb99f53f3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:30.237296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-493c8e6f-01ae-4537-b1fa-dacfb99f53f3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:30.239987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d55b59d3-73c7-4cfb-a016-2846001c7c6d tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:30.246123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-493c8e6f-01ae-4537-b1fa-dacfb99f53f3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:30.246404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d55b59d3-73c7-4cfb-a016-2846001c7c6d tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:30.246706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d55b59d3-73c7-4cfb-a016-2846001c7c6d tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:30.247932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d55b59d3-73c7-4cfb-a016-2846001c7c6d tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:30.249716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d55b59d3-73c7-4cfb-a016-2846001c7c6d tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:30.251659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d55b59d3-73c7-4cfb-a016-2846001c7c6d tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:30.253251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-493c8e6f-01ae-4537-b1fa-dacfb99f53f3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:30.255263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-493c8e6f-01ae-4537-b1fa-dacfb99f53f3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:30.256830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-493c8e6f-01ae-4537-b1fa-dacfb99f53f3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:30.558177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d55b59d3-73c7-4cfb-a016-2846001c7c6d tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f493fa6856847b4ae7cc8eb997a14c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b06047717c4a5ca47ebc72587256fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:30.578840 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d55b59d3-73c7-4cfb-a016-2846001c7c6d tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce" status: 200 len: 1275 microversion: 2.1 time: 0.376484 Sep 07 12:40:30.579944 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1148/2348] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:30 2022] GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce => generated 1275 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:30.610652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6071971e-da57-4091-ad45-4f822707fccb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:30.630672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6071971e-da57-4091-ad45-4f822707fccb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:30.632886 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6071971e-da57-4091-ad45-4f822707fccb tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.040808 Sep 07 12:40:30.634410 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1149/2349] 10.222.0.16 () {58 vars in 1178 bytes} [Wed Sep 7 12:40:30 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:40:30.654968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-05d1105c-4dfe-4d38-9e17-3ca37a4b92e4 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:30.656528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-05d1105c-4dfe-4d38-9e17-3ca37a4b92e4 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:30.675493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05d1105c-4dfe-4d38-9e17-3ca37a4b92e4 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:30.676886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05d1105c-4dfe-4d38-9e17-3ca37a4b92e4 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:30.678409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05d1105c-4dfe-4d38-9e17-3ca37a4b92e4 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:30.701522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05d1105c-4dfe-4d38-9e17-3ca37a4b92e4 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:30.702580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05d1105c-4dfe-4d38-9e17-3ca37a4b92e4 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:30.703700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05d1105c-4dfe-4d38-9e17-3ca37a4b92e4 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:30.919769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-493c8e6f-01ae-4537-b1fa-dacfb99f53f3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:30.930965 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-493c8e6f-01ae-4537-b1fa-dacfb99f53f3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1315 microversion: 2.1 time: 0.730733 Sep 07 12:40:30.932115 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1201/2350] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:30 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1315 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:30.937544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-47661527-4872-4f64-9fdd-15611a378a41 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:30.938373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-47661527-4872-4f64-9fdd-15611a378a41 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: aa6c3482-9f8e-41a7-8bec-32d428a3ce52] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:30.965366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47661527-4872-4f64-9fdd-15611a378a41 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:30.966223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47661527-4872-4f64-9fdd-15611a378a41 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:30.966666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47661527-4872-4f64-9fdd-15611a378a41 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:30.967325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47661527-4872-4f64-9fdd-15611a378a41 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:30.968123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47661527-4872-4f64-9fdd-15611a378a41 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:30.968762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47661527-4872-4f64-9fdd-15611a378a41 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:30.970156 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-05d1105c-4dfe-4d38-9e17-3ca37a4b92e4 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.333701 Sep 07 12:40:30.971005 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1150/2351] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Sep 7 12:40:30 2022] GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f/os-interface => generated 284 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:40:30.976248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-d65c5124-dd91-4762-81a8-0406cda2c9df req-df4aec70-315b-43d4-b375-b8a0f996fa79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b713d625-5bb0-4562-916a-b9060c88a6d1", "tag": "d7d0e6f6-b543-4403-813b-81db4758be6b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:31.004961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d65c5124-dd91-4762-81a8-0406cda2c9df req-df4aec70-315b-43d4-b375-b8a0f996fa79 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:31.007294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d65c5124-dd91-4762-81a8-0406cda2c9df req-df4aec70-315b-43d4-b375-b8a0f996fa79 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:31.008858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d65c5124-dd91-4762-81a8-0406cda2c9df req-df4aec70-315b-43d4-b375-b8a0f996fa79 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:31.065801 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-d65c5124-dd91-4762-81a8-0406cda2c9df req-df4aec70-315b-43d4-b375-b8a0f996fa79 service nova] Creating event network-changed:d7d0e6f6-b543-4403-813b-81db4758be6b for instance b713d625-5bb0-4562-916a-b9060c88a6d1 on n-h2-852087-9 Sep 07 12:40:31.075779 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-d65c5124-dd91-4762-81a8-0406cda2c9df req-df4aec70-315b-43d4-b375-b8a0f996fa79 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102815 Sep 07 12:40:31.077747 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1151/2352] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:40:31.092503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-38d95cac-c79d-4f5e-9d93-59eaa019cba6 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:31.104629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-38d95cac-c79d-4f5e-9d93-59eaa019cba6 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:31.106375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-38d95cac-c79d-4f5e-9d93-59eaa019cba6 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Searching by: {'deleted': False, 'project_id': 'e28a1b6c8dde4b948d493b369535a301'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:40:31.118441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38d95cac-c79d-4f5e-9d93-59eaa019cba6 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:31.122946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38d95cac-c79d-4f5e-9d93-59eaa019cba6 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:31.124381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38d95cac-c79d-4f5e-9d93-59eaa019cba6 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:31.131614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38d95cac-c79d-4f5e-9d93-59eaa019cba6 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:31.133195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38d95cac-c79d-4f5e-9d93-59eaa019cba6 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:31.134290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38d95cac-c79d-4f5e-9d93-59eaa019cba6 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:31.202768 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-47661527-4872-4f64-9fdd-15611a378a41 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:31.223073 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-47661527-4872-4f64-9fdd-15611a378a41 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52" status: 200 len: 1215 microversion: 2.1 time: 0.287010 Sep 07 12:40:31.237524 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1202/2353] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:30 2022] GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52 => generated 1215 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:31.237741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-38d95cac-c79d-4f5e-9d93-59eaa019cba6 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:40:31.237841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df05a260-1375-4ad6-b24b-3bbdf9bc6bc1 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:31.237841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-df05a260-1375-4ad6-b24b-3bbdf9bc6bc1 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] [instance: b713d625-5bb0-4562-916a-b9060c88a6d1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:31.250937 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df05a260-1375-4ad6-b24b-3bbdf9bc6bc1 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:31.251593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df05a260-1375-4ad6-b24b-3bbdf9bc6bc1 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:31.252111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df05a260-1375-4ad6-b24b-3bbdf9bc6bc1 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:31.253012 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df05a260-1375-4ad6-b24b-3bbdf9bc6bc1 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:31.254702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df05a260-1375-4ad6-b24b-3bbdf9bc6bc1 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:31.254702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df05a260-1375-4ad6-b24b-3bbdf9bc6bc1 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:31.331495 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-38d95cac-c79d-4f5e-9d93-59eaa019cba6 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.240949 Sep 07 12:40:31.333584 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1152/2354] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Sep 7 12:40:31 2022] GET /compute/v2.1/servers => generated 683 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:40:31.357784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-02b05913-2a8f-4251-bb95-c578b7f9f332 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:31.359815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-02b05913-2a8f-4251-bb95-c578b7f9f332 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: 3156895a-b53e-4926-9425-6feaae2d424d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:31.383540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02b05913-2a8f-4251-bb95-c578b7f9f332 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:31.391052 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02b05913-2a8f-4251-bb95-c578b7f9f332 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:31.393868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02b05913-2a8f-4251-bb95-c578b7f9f332 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:31.401146 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02b05913-2a8f-4251-bb95-c578b7f9f332 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:31.402012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02b05913-2a8f-4251-bb95-c578b7f9f332 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:31.402751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02b05913-2a8f-4251-bb95-c578b7f9f332 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:31.437769 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-02b05913-2a8f-4251-bb95-c578b7f9f332 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] HTTP exception thrown: Instance 3156895a-b53e-4926-9425-6feaae2d424d could not be found. Sep 07 12:40:31.442551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-02b05913-2a8f-4251-bb95-c578b7f9f332 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Request method failure captured: Sep 07 12:40:31.442551 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/3156895a-b53e-4926-9425-6feaae2d424d HTTP/1.1 Sep 07 12:40:31.442551 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:40:31.442551 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:40:31.442551 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:40:31.442551 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:40:31.442551 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:40:31.442551 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:40:31.442551 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:40:31.442551 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:40:31.442551 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJDsBdDBuK6-U-oa3EgLwJ0cInn42LooYDDK2xuzMieAmtDdHVgCQSCGUg7Mms36Dytx6iFOmjDeDJYTcyb97tpVFzJ2wUaPiQNOZa3rYItTJozEFSKJVy72U0F8Z9IglffmC_MrHLrEV6jHa3Ae7EJd2NyfR5n6uH1QOj7TevCy0ho Sep 07 12:40:31.442551 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:40:31.442551 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:40:31.442551 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:40:31.442551 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:40:31.442551 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:40:31.442551 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:40:31.442551 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: e28a1b6c8dde4b948d493b369535a301 Sep 07 12:40:31.442551 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ListServersNegativeTestJSON-1212395273 Sep 07 12:40:31.442551 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:40:31.442551 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:40:31.443888 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:40:31.443888 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ListServersNegativeTestJSON-1212395273 Sep 07 12:40:31.443888 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: e28a1b6c8dde4b948d493b369535a301 Sep 07 12:40:31.443888 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1212395273 Sep 07 12:40:31.443888 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ListServersNegativeTestJSON-1212395273-project Sep 07 12:40:31.443888 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:40:31.443888 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:40:31.443888 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 3f9b8d4c5d9a4efeb97645f3233b1064 Sep 07 12:40:31.443888 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ListServersNegativeTestJSON-1212395273-project Sep 07 12:40:31.443888 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:40:31.443888 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 3156895a-b53e-4926-9425-6feaae2d424d could not be found. Sep 07 12:40:31.443888 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '3156895a-b53e-4926-9425-6feaae2d424d'} Sep 07 12:40:31.444598 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:40:31.444598 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:31.444598 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:40:31.444598 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:40:31.444598 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:40:31.444598 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:40:31.444598 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:40:31.444598 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:40:31.444598 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:40:31.444598 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:40:31.444598 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3156895a-b53e-4926-9425-6feaae2d424d could not be found. Sep 07 12:40:31.444598 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:31.444598 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:31.444598 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:31.444598 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:31.444598 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:31.444598 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:31.444598 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:40:31.444598 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:40:31.444598 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:40:31.445793 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:40:31.445793 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:40:31.445793 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:40:31.445793 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:40:31.445793 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:40:31.445793 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:40:31.445793 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:40:31.445793 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:40:31.445793 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:40:31.445793 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3156895a-b53e-4926-9425-6feaae2d424d could not be found. Sep 07 12:40:31.445793 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:31.445793 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:31.445793 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:31.445793 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:31.445793 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:31.445793 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:31.445793 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:40:31.445793 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:40:31.445793 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3156895a-b53e-4926-9425-6feaae2d424d could not be found. Sep 07 12:40:31.445793 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:31.446922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-02b05913-2a8f-4251-bb95-c578b7f9f332 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Returning 404 to user: Instance 3156895a-b53e-4926-9425-6feaae2d424d could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:40:31.446922 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-02b05913-2a8f-4251-bb95-c578b7f9f332 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3156895a-b53e-4926-9425-6feaae2d424d" status: 404 len: 111 microversion: 2.1 time: 0.102576 Sep 07 12:40:31.447781 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1153/2355] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:40:31 2022] DELETE /compute/v2.1/servers/3156895a-b53e-4926-9425-6feaae2d424d => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:40:31.457523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d8d89b70-489c-4954-beda-97c0b54c09c7 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:31.458045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d8d89b70-489c-4954-beda-97c0b54c09c7 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: d610675f-fc02-46f7-a980-33b6ee582c4d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:31.473665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8d89b70-489c-4954-beda-97c0b54c09c7 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:31.474166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8d89b70-489c-4954-beda-97c0b54c09c7 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:31.474606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8d89b70-489c-4954-beda-97c0b54c09c7 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:31.475338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8d89b70-489c-4954-beda-97c0b54c09c7 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:31.475795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8d89b70-489c-4954-beda-97c0b54c09c7 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:31.476222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8d89b70-489c-4954-beda-97c0b54c09c7 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:31.538654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d8d89b70-489c-4954-beda-97c0b54c09c7 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: d610675f-fc02-46f7-a980-33b6ee582c4d] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:40:31.724858 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d8d89b70-489c-4954-beda-97c0b54c09c7 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d610675f-fc02-46f7-a980-33b6ee582c4d" status: 204 len: 0 microversion: 2.1 time: 0.272597 Sep 07 12:40:31.731898 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1154/2356] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:40:31 2022] DELETE /compute/v2.1/servers/d610675f-fc02-46f7-a980-33b6ee582c4d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:40:31.766964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-abee7d5b-7b60-4c79-ae51-8a44365c04a4 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:31.768864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-abee7d5b-7b60-4c79-ae51-8a44365c04a4 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:31.787608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abee7d5b-7b60-4c79-ae51-8a44365c04a4 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:31.791223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abee7d5b-7b60-4c79-ae51-8a44365c04a4 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:31.793552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abee7d5b-7b60-4c79-ae51-8a44365c04a4 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:31.796050 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abee7d5b-7b60-4c79-ae51-8a44365c04a4 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:31.796885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abee7d5b-7b60-4c79-ae51-8a44365c04a4 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:31.797271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abee7d5b-7b60-4c79-ae51-8a44365c04a4 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:32.062379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-abee7d5b-7b60-4c79-ae51-8a44365c04a4 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f493fa6856847b4ae7cc8eb997a14c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b06047717c4a5ca47ebc72587256fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:32.073836 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-abee7d5b-7b60-4c79-ae51-8a44365c04a4 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce" status: 200 len: 1275 microversion: 2.1 time: 0.338413 Sep 07 12:40:32.077722 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1155/2357] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:31 2022] GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce => generated 1275 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:32.087068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dac04d0d-604b-426c-8563-5631cf9df707 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:32.087521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dac04d0d-604b-426c-8563-5631cf9df707 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: 498a719e-d642-4e9c-9951-d6aacb0a16db] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:32.096178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dac04d0d-604b-426c-8563-5631cf9df707 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:32.096692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dac04d0d-604b-426c-8563-5631cf9df707 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:32.097362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dac04d0d-604b-426c-8563-5631cf9df707 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:32.098193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dac04d0d-604b-426c-8563-5631cf9df707 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:32.098691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dac04d0d-604b-426c-8563-5631cf9df707 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:32.099409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dac04d0d-604b-426c-8563-5631cf9df707 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:32.109773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-df05a260-1375-4ad6-b24b-3bbdf9bc6bc1 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017965094f7d482686f7617e0835b7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a9377ba32c4732912a4fcd0a6daa08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:32.124850 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-df05a260-1375-4ad6-b24b-3bbdf9bc6bc1 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] 10.222.0.16 "GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1" status: 200 len: 1316 microversion: 2.1 time: 0.899178 Sep 07 12:40:32.126942 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1203/2358] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:31 2022] GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1 => generated 1316 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:32.158901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d18646e-8458-4c88-83e9-63eb90cb735b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:32.160430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9d18646e-8458-4c88-83e9-63eb90cb735b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:32.173960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d18646e-8458-4c88-83e9-63eb90cb735b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:32.175932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dac04d0d-604b-426c-8563-5631cf9df707 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: 498a719e-d642-4e9c-9951-d6aacb0a16db] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:40:32.177108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d18646e-8458-4c88-83e9-63eb90cb735b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:32.177604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d18646e-8458-4c88-83e9-63eb90cb735b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:32.178359 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d18646e-8458-4c88-83e9-63eb90cb735b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:32.178826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d18646e-8458-4c88-83e9-63eb90cb735b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:32.179254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d18646e-8458-4c88-83e9-63eb90cb735b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:32.343456 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dac04d0d-604b-426c-8563-5631cf9df707 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "DELETE /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db" status: 204 len: 0 microversion: 2.1 time: 0.261700 Sep 07 12:40:32.344845 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1156/2359] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:40:32 2022] DELETE /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:40:32.355499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-92937781-94df-4211-a82a-463dfbcecbc9 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:32.356916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-92937781-94df-4211-a82a-463dfbcecbc9 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: aa6c3482-9f8e-41a7-8bec-32d428a3ce52] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:32.371430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92937781-94df-4211-a82a-463dfbcecbc9 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:32.372315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92937781-94df-4211-a82a-463dfbcecbc9 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:32.374378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92937781-94df-4211-a82a-463dfbcecbc9 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:32.375779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92937781-94df-4211-a82a-463dfbcecbc9 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:32.376630 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92937781-94df-4211-a82a-463dfbcecbc9 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:32.377373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92937781-94df-4211-a82a-463dfbcecbc9 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:32.838478 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-92937781-94df-4211-a82a-463dfbcecbc9 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:32.856124 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-92937781-94df-4211-a82a-463dfbcecbc9 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52" status: 200 len: 1271 microversion: 2.1 time: 0.509323 Sep 07 12:40:32.872198 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1157/2360] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:32 2022] GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52 => generated 1271 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:32.889471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a01c8e0-dd9b-44f2-88c9-d83dfa0e139c tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:32.897027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7a01c8e0-dd9b-44f2-88c9-d83dfa0e139c tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: 3156895a-b53e-4926-9425-6feaae2d424d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:32.905882 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a01c8e0-dd9b-44f2-88c9-d83dfa0e139c tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:32.907146 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a01c8e0-dd9b-44f2-88c9-d83dfa0e139c tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:32.907945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a01c8e0-dd9b-44f2-88c9-d83dfa0e139c tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:32.910066 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a01c8e0-dd9b-44f2-88c9-d83dfa0e139c tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:32.911118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a01c8e0-dd9b-44f2-88c9-d83dfa0e139c tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:32.913837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a01c8e0-dd9b-44f2-88c9-d83dfa0e139c tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:32.953322 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-7a01c8e0-dd9b-44f2-88c9-d83dfa0e139c tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] HTTP exception thrown: Instance 3156895a-b53e-4926-9425-6feaae2d424d could not be found. Sep 07 12:40:32.958318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a01c8e0-dd9b-44f2-88c9-d83dfa0e139c tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Request method failure captured: Sep 07 12:40:32.958318 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/3156895a-b53e-4926-9425-6feaae2d424d HTTP/1.1 Sep 07 12:40:32.958318 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:40:32.958318 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:40:32.958318 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:40:32.958318 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:40:32.958318 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:40:32.958318 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:40:32.958318 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:40:32.958318 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:40:32.958318 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJDsBdDBuK6-U-oa3EgLwJ0cInn42LooYDDK2xuzMieAmtDdHVgCQSCGUg7Mms36Dytx6iFOmjDeDJYTcyb97tpVFzJ2wUaPiQNOZa3rYItTJozEFSKJVy72U0F8Z9IglffmC_MrHLrEV6jHa3Ae7EJd2NyfR5n6uH1QOj7TevCy0ho Sep 07 12:40:32.958318 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:40:32.958318 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:40:32.958318 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:40:32.958318 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:40:32.958318 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:40:32.958318 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:40:32.958318 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: e28a1b6c8dde4b948d493b369535a301 Sep 07 12:40:32.958318 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ListServersNegativeTestJSON-1212395273 Sep 07 12:40:32.958318 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:40:32.958318 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:40:32.961277 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:40:32.961277 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ListServersNegativeTestJSON-1212395273 Sep 07 12:40:32.961277 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: e28a1b6c8dde4b948d493b369535a301 Sep 07 12:40:32.961277 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1212395273 Sep 07 12:40:32.961277 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ListServersNegativeTestJSON-1212395273-project Sep 07 12:40:32.961277 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:40:32.961277 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:40:32.961277 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 3f9b8d4c5d9a4efeb97645f3233b1064 Sep 07 12:40:32.961277 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ListServersNegativeTestJSON-1212395273-project Sep 07 12:40:32.961277 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:40:32.961277 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 3156895a-b53e-4926-9425-6feaae2d424d could not be found. Sep 07 12:40:32.961277 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '3156895a-b53e-4926-9425-6feaae2d424d'} Sep 07 12:40:32.962992 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:40:32.962992 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:32.962992 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:40:32.962992 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:40:32.962992 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:40:32.962992 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:40:32.962992 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:40:32.962992 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:40:32.962992 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:40:32.962992 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:40:32.962992 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3156895a-b53e-4926-9425-6feaae2d424d could not be found. Sep 07 12:40:32.962992 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:32.962992 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:32.962992 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:32.962992 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:32.962992 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:32.962992 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:32.962992 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:40:32.962992 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:40:32.962992 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:40:32.965162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:40:32.965162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:40:32.965162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:40:32.965162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:40:32.965162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:40:32.965162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:40:32.965162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:40:32.965162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3156895a-b53e-4926-9425-6feaae2d424d could not be found. Sep 07 12:40:32.965162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:32.965162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:32.965162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:32.965162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:32.965162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:32.965162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:32.965162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:40:32.965162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:40:32.965162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3156895a-b53e-4926-9425-6feaae2d424d could not be found. Sep 07 12:40:32.965162 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:32.967961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a01c8e0-dd9b-44f2-88c9-d83dfa0e139c tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Returning 404 to user: Instance 3156895a-b53e-4926-9425-6feaae2d424d could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:40:32.970855 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7a01c8e0-dd9b-44f2-88c9-d83dfa0e139c tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers/3156895a-b53e-4926-9425-6feaae2d424d" status: 404 len: 111 microversion: 2.1 time: 0.108326 Sep 07 12:40:32.970855 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1158/2361] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:32 2022] GET /compute/v2.1/servers/3156895a-b53e-4926-9425-6feaae2d424d => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:40:32.984454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-1d8ee552-9eec-4dc4-998b-9b2d1206f737 req-3008f688-7513-4e9a-8dd3-16f116735eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b8d74fd-0b94-465e-a644-a44170def51c", "tag": "798531a0-1079-41ca-b03b-2f727c036b56"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:32.999543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1d8ee552-9eec-4dc4-998b-9b2d1206f737 req-3008f688-7513-4e9a-8dd3-16f116735eb4 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:33.000204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1d8ee552-9eec-4dc4-998b-9b2d1206f737 req-3008f688-7513-4e9a-8dd3-16f116735eb4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:33.000755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1d8ee552-9eec-4dc4-998b-9b2d1206f737 req-3008f688-7513-4e9a-8dd3-16f116735eb4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:33.023020 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-1d8ee552-9eec-4dc4-998b-9b2d1206f737 req-3008f688-7513-4e9a-8dd3-16f116735eb4 service nova] Creating event network-changed:798531a0-1079-41ca-b03b-2f727c036b56 for instance 9b8d74fd-0b94-465e-a644-a44170def51c on n-h2-852087-9 Sep 07 12:40:33.032259 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-1d8ee552-9eec-4dc4-998b-9b2d1206f737 req-3008f688-7513-4e9a-8dd3-16f116735eb4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058111 Sep 07 12:40:33.033563 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1159/2362] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:40:33.043559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2181d9e2-1c7e-4478-a694-e1c2fac1844a tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:33.044811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2181d9e2-1c7e-4478-a694-e1c2fac1844a tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: d610675f-fc02-46f7-a980-33b6ee582c4d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:33.054505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2181d9e2-1c7e-4478-a694-e1c2fac1844a tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:33.055646 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2181d9e2-1c7e-4478-a694-e1c2fac1844a tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:33.056476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2181d9e2-1c7e-4478-a694-e1c2fac1844a tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:33.058574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2181d9e2-1c7e-4478-a694-e1c2fac1844a tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:33.059251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2181d9e2-1c7e-4478-a694-e1c2fac1844a tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:33.059873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2181d9e2-1c7e-4478-a694-e1c2fac1844a tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:33.074279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9d18646e-8458-4c88-83e9-63eb90cb735b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:33.124001 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9d18646e-8458-4c88-83e9-63eb90cb735b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1315 microversion: 2.1 time: 0.994103 Sep 07 12:40:33.126367 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1204/2363] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:32 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1315 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:33.149013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cfe99ea0-2fce-4caf-b5bb-4286d5cfa834 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:33.150068 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cfe99ea0-2fce-4caf-b5bb-4286d5cfa834 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:33.196324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cfe99ea0-2fce-4caf-b5bb-4286d5cfa834 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:33.197192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cfe99ea0-2fce-4caf-b5bb-4286d5cfa834 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:33.198015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cfe99ea0-2fce-4caf-b5bb-4286d5cfa834 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:33.199499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cfe99ea0-2fce-4caf-b5bb-4286d5cfa834 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:33.200323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cfe99ea0-2fce-4caf-b5bb-4286d5cfa834 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:33.201004 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cfe99ea0-2fce-4caf-b5bb-4286d5cfa834 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:33.426008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cfe99ea0-2fce-4caf-b5bb-4286d5cfa834 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f493fa6856847b4ae7cc8eb997a14c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b06047717c4a5ca47ebc72587256fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:33.450230 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cfe99ea0-2fce-4caf-b5bb-4286d5cfa834 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce" status: 200 len: 1275 microversion: 2.1 time: 0.318757 Sep 07 12:40:33.453581 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1205/2364] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:33 2022] GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce => generated 1275 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:33.499070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-95791cec-9263-4045-b180-341c1d1807b7 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:33.500597 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-95791cec-9263-4045-b180-341c1d1807b7 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] [instance: b713d625-5bb0-4562-916a-b9060c88a6d1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:33.528187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95791cec-9263-4045-b180-341c1d1807b7 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:33.531758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95791cec-9263-4045-b180-341c1d1807b7 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:33.534607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95791cec-9263-4045-b180-341c1d1807b7 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:33.536651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95791cec-9263-4045-b180-341c1d1807b7 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:33.537719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95791cec-9263-4045-b180-341c1d1807b7 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:33.540081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95791cec-9263-4045-b180-341c1d1807b7 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:33.952516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2181d9e2-1c7e-4478-a694-e1c2fac1844a tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:33.966215 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2181d9e2-1c7e-4478-a694-e1c2fac1844a tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers/d610675f-fc02-46f7-a980-33b6ee582c4d" status: 200 len: 1521 microversion: 2.1 time: 0.930926 Sep 07 12:40:33.987300 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1160/2365] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:33 2022] GET /compute/v2.1/servers/d610675f-fc02-46f7-a980-33b6ee582c4d => generated 1521 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:34.000040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a718c071-c3f9-48a9-bb12-d4ef42c41b75 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:34.001617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a718c071-c3f9-48a9-bb12-d4ef42c41b75 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:34.016187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a718c071-c3f9-48a9-bb12-d4ef42c41b75 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:34.021342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a718c071-c3f9-48a9-bb12-d4ef42c41b75 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:34.022601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a718c071-c3f9-48a9-bb12-d4ef42c41b75 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:34.023614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a718c071-c3f9-48a9-bb12-d4ef42c41b75 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:34.025981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a718c071-c3f9-48a9-bb12-d4ef42c41b75 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:34.026831 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a718c071-c3f9-48a9-bb12-d4ef42c41b75 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:35.573265 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-95791cec-9263-4045-b180-341c1d1807b7 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017965094f7d482686f7617e0835b7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a9377ba32c4732912a4fcd0a6daa08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:35.589006 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-95791cec-9263-4045-b180-341c1d1807b7 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] 10.222.0.16 "GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1" status: 200 len: 1316 microversion: 2.1 time: 2.116004 Sep 07 12:40:35.591786 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1206/2366] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:33 2022] GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1 => generated 1316 bytes in 2137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:35.598164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c5188ef3-5375-436a-8441-b64f61bbba63 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:35.599024 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c5188ef3-5375-436a-8441-b64f61bbba63 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: aa6c3482-9f8e-41a7-8bec-32d428a3ce52] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:35.606239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5188ef3-5375-436a-8441-b64f61bbba63 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:35.607002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5188ef3-5375-436a-8441-b64f61bbba63 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:35.607810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5188ef3-5375-436a-8441-b64f61bbba63 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:35.608866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5188ef3-5375-436a-8441-b64f61bbba63 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:35.609548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5188ef3-5375-436a-8441-b64f61bbba63 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:35.610136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5188ef3-5375-436a-8441-b64f61bbba63 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:35.824286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a718c071-c3f9-48a9-bb12-d4ef42c41b75 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d991fa2c5754b14a7a0e638b486f06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d453f24efa048f0a67ab7834d0005c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:35.842308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c5188ef3-5375-436a-8441-b64f61bbba63 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:35.844505 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a718c071-c3f9-48a9-bb12-d4ef42c41b75 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f" status: 200 len: 1482 microversion: 2.1 time: 1.853792 Sep 07 12:40:35.846993 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1161/2367] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:33 2022] GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f => generated 1482 bytes in 1859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:35.867443 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c5188ef3-5375-436a-8441-b64f61bbba63 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52" status: 200 len: 1277 microversion: 2.1 time: 0.273779 Sep 07 12:40:35.869146 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1207/2368] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:35 2022] GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52 => generated 1277 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:35.908037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bc2c924d-7bf9-4cbe-9148-09863e685447 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:35.910716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bc2c924d-7bf9-4cbe-9148-09863e685447 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:35.916978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-321dcab2-cd27-449e-ac2b-00cb2cf7322d req-5a1bd324-fd21-4162-9694-7b4c1d7b46b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71999ea2-9256-4783-8614-0d28d11aab2f", "tag": "175df065-8068-401b-adb5-2c7be0ceb530"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:35.979175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc2c924d-7bf9-4cbe-9148-09863e685447 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:35.980749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc2c924d-7bf9-4cbe-9148-09863e685447 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:35.981981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc2c924d-7bf9-4cbe-9148-09863e685447 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:35.986629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc2c924d-7bf9-4cbe-9148-09863e685447 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:35.988291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-321dcab2-cd27-449e-ac2b-00cb2cf7322d req-5a1bd324-fd21-4162-9694-7b4c1d7b46b7 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:35.989088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc2c924d-7bf9-4cbe-9148-09863e685447 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:35.990356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc2c924d-7bf9-4cbe-9148-09863e685447 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:35.990847 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-321dcab2-cd27-449e-ac2b-00cb2cf7322d req-5a1bd324-fd21-4162-9694-7b4c1d7b46b7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:35.992009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-321dcab2-cd27-449e-ac2b-00cb2cf7322d req-5a1bd324-fd21-4162-9694-7b4c1d7b46b7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:36.049466 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-321dcab2-cd27-449e-ac2b-00cb2cf7322d req-5a1bd324-fd21-4162-9694-7b4c1d7b46b7 service nova] Creating event network-changed:175df065-8068-401b-adb5-2c7be0ceb530 for instance 71999ea2-9256-4783-8614-0d28d11aab2f on n-h1-852087-9 Sep 07 12:40:36.078884 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-321dcab2-cd27-449e-ac2b-00cb2cf7322d req-5a1bd324-fd21-4162-9694-7b4c1d7b46b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.223638 Sep 07 12:40:36.083207 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1162/2369] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:40:36.113515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb0c3510-7f31-49f4-b397-1fb2e9fda601 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:36.116533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cb0c3510-7f31-49f4-b397-1fb2e9fda601 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:36.133598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb0c3510-7f31-49f4-b397-1fb2e9fda601 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:36.134940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb0c3510-7f31-49f4-b397-1fb2e9fda601 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:36.136208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb0c3510-7f31-49f4-b397-1fb2e9fda601 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:36.137947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb0c3510-7f31-49f4-b397-1fb2e9fda601 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:36.139051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb0c3510-7f31-49f4-b397-1fb2e9fda601 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:36.140183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb0c3510-7f31-49f4-b397-1fb2e9fda601 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:37.643702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=16 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:40:37.671044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bc2c924d-7bf9-4cbe-9148-09863e685447 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:37.686761 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bc2c924d-7bf9-4cbe-9148-09863e685447 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1315 microversion: 2.1 time: 1.812165 Sep 07 12:40:37.690766 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1208/2370] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:35 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1315 bytes in 1820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:37.707933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-305eae9a-34ef-42d1-b4bb-f15271dc1efd tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:37.710593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-305eae9a-34ef-42d1-b4bb-f15271dc1efd tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: d610675f-fc02-46f7-a980-33b6ee582c4d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:37.720032 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=28 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:40:37.727224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-305eae9a-34ef-42d1-b4bb-f15271dc1efd tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:37.731947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-305eae9a-34ef-42d1-b4bb-f15271dc1efd tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:37.735623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-305eae9a-34ef-42d1-b4bb-f15271dc1efd tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:37.736600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-305eae9a-34ef-42d1-b4bb-f15271dc1efd tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:37.737251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-305eae9a-34ef-42d1-b4bb-f15271dc1efd tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:37.739471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-305eae9a-34ef-42d1-b4bb-f15271dc1efd tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:37.833338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=24 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:40:38.416437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cb0c3510-7f31-49f4-b397-1fb2e9fda601 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f493fa6856847b4ae7cc8eb997a14c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b06047717c4a5ca47ebc72587256fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:38.460541 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cb0c3510-7f31-49f4-b397-1fb2e9fda601 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce" status: 200 len: 1317 microversion: 2.1 time: 2.371997 Sep 07 12:40:38.462372 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1163/2371] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:36 2022] GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce => generated 1317 bytes in 2378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:38.481915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-252a2d6d-6dcf-4d2e-bbeb-967668f87f72 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:38.483737 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-252a2d6d-6dcf-4d2e-bbeb-967668f87f72 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] [instance: b713d625-5bb0-4562-916a-b9060c88a6d1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:38.506164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-252a2d6d-6dcf-4d2e-bbeb-967668f87f72 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:38.509732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-252a2d6d-6dcf-4d2e-bbeb-967668f87f72 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:38.515462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-252a2d6d-6dcf-4d2e-bbeb-967668f87f72 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:38.522951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-252a2d6d-6dcf-4d2e-bbeb-967668f87f72 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:38.526447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-252a2d6d-6dcf-4d2e-bbeb-967668f87f72 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:38.527881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-252a2d6d-6dcf-4d2e-bbeb-967668f87f72 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:39.236749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-305eae9a-34ef-42d1-b4bb-f15271dc1efd tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:39.272017 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-305eae9a-34ef-42d1-b4bb-f15271dc1efd tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers/d610675f-fc02-46f7-a980-33b6ee582c4d" status: 200 len: 1521 microversion: 2.1 time: 1.579248 Sep 07 12:40:39.292459 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1209/2372] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:37 2022] GET /compute/v2.1/servers/d610675f-fc02-46f7-a980-33b6ee582c4d => generated 1521 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:39.302736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-47c8d40c-6d44-4a15-bc5a-16253239e3e0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:39.304985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-47c8d40c-6d44-4a15-bc5a-16253239e3e0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: aa6c3482-9f8e-41a7-8bec-32d428a3ce52] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:39.318330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47c8d40c-6d44-4a15-bc5a-16253239e3e0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:39.321607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47c8d40c-6d44-4a15-bc5a-16253239e3e0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:39.322334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47c8d40c-6d44-4a15-bc5a-16253239e3e0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:39.323396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47c8d40c-6d44-4a15-bc5a-16253239e3e0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:39.324209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47c8d40c-6d44-4a15-bc5a-16253239e3e0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:39.324828 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47c8d40c-6d44-4a15-bc5a-16253239e3e0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:39.607416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-252a2d6d-6dcf-4d2e-bbeb-967668f87f72 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017965094f7d482686f7617e0835b7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a9377ba32c4732912a4fcd0a6daa08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:39.615367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:40:39.625176 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-252a2d6d-6dcf-4d2e-bbeb-967668f87f72 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] 10.222.0.16 "GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1" status: 200 len: 1316 microversion: 2.1 time: 1.160516 Sep 07 12:40:39.626481 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1164/2373] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:38 2022] GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1 => generated 1316 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:39.638611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-47c8d40c-6d44-4a15-bc5a-16253239e3e0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:39.641105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-9181feba-9ffa-4e55-8dd1-401db8c5d9a6 req-e2e3c4fc-2d4f-4799-a35e-f987fc2002c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "498a719e-d642-4e9c-9951-d6aacb0a16db", "name": "network-vif-deleted", "tag": "cfef85c8-c8aa-483d-b48d-d21143e17765"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:39.662488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9181feba-9ffa-4e55-8dd1-401db8c5d9a6 req-e2e3c4fc-2d4f-4799-a35e-f987fc2002c0 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:39.668288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9181feba-9ffa-4e55-8dd1-401db8c5d9a6 req-e2e3c4fc-2d4f-4799-a35e-f987fc2002c0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:39.669033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9181feba-9ffa-4e55-8dd1-401db8c5d9a6 req-e2e3c4fc-2d4f-4799-a35e-f987fc2002c0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:39.688287 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-47c8d40c-6d44-4a15-bc5a-16253239e3e0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52" status: 200 len: 1277 microversion: 2.1 time: 0.398260 Sep 07 12:40:39.702891 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-9181feba-9ffa-4e55-8dd1-401db8c5d9a6 req-e2e3c4fc-2d4f-4799-a35e-f987fc2002c0 service nova] Creating event network-vif-deleted:cfef85c8-c8aa-483d-b48d-d21143e17765 for instance 498a719e-d642-4e9c-9951-d6aacb0a16db on n-h1-852087-9 Sep 07 12:40:39.708687 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1210/2374] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:39 2022] GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52 => generated 1277 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:39.711344 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-9181feba-9ffa-4e55-8dd1-401db8c5d9a6 req-e2e3c4fc-2d4f-4799-a35e-f987fc2002c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083117 Sep 07 12:40:39.712207 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1165/2375] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:40:39.715278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-00d70bab-e93f-4af7-8aec-c1ec9da78f22 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:39.716198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-00d70bab-e93f-4af7-8aec-c1ec9da78f22 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:39.718456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ea0f59c-6ee5-4d90-89b0-14f569ddf974 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:39.719181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4ea0f59c-6ee5-4d90-89b0-14f569ddf974 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:39.726942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00d70bab-e93f-4af7-8aec-c1ec9da78f22 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:39.727711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00d70bab-e93f-4af7-8aec-c1ec9da78f22 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:39.728344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00d70bab-e93f-4af7-8aec-c1ec9da78f22 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:39.729290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00d70bab-e93f-4af7-8aec-c1ec9da78f22 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:39.729968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00d70bab-e93f-4af7-8aec-c1ec9da78f22 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:39.730571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00d70bab-e93f-4af7-8aec-c1ec9da78f22 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:39.752135 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ea0f59c-6ee5-4d90-89b0-14f569ddf974 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:39.753000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ea0f59c-6ee5-4d90-89b0-14f569ddf974 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:39.753821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ea0f59c-6ee5-4d90-89b0-14f569ddf974 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:39.754900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ea0f59c-6ee5-4d90-89b0-14f569ddf974 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:39.755649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ea0f59c-6ee5-4d90-89b0-14f569ddf974 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:39.756348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ea0f59c-6ee5-4d90-89b0-14f569ddf974 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:40.713724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4ea0f59c-6ee5-4d90-89b0-14f569ddf974 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f493fa6856847b4ae7cc8eb997a14c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b06047717c4a5ca47ebc72587256fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:40.723031 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ea0f59c-6ee5-4d90-89b0-14f569ddf974 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce" status: 200 len: 1317 microversion: 2.1 time: 1.009298 Sep 07 12:40:40.741982 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1166/2376] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:39 2022] GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce => generated 1317 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:40.749015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-4d035980-fd28-4cae-8457-6eafd241b987 req-0286ce5d-ae43-4d00-820f-7d01ff0c3f6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d610675f-fc02-46f7-a980-33b6ee582c4d", "name": "network-vif-deleted", "tag": "168d12f5-7490-45c8-98dc-5e5702f57370"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:40.768056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4d035980-fd28-4cae-8457-6eafd241b987 req-0286ce5d-ae43-4d00-820f-7d01ff0c3f6d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:40.774544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4d035980-fd28-4cae-8457-6eafd241b987 req-0286ce5d-ae43-4d00-820f-7d01ff0c3f6d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:40.775044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4d035980-fd28-4cae-8457-6eafd241b987 req-0286ce5d-ae43-4d00-820f-7d01ff0c3f6d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:40.799992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-00d70bab-e93f-4af7-8aec-c1ec9da78f22 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:40.810967 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-00d70bab-e93f-4af7-8aec-c1ec9da78f22 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1315 microversion: 2.1 time: 1.100942 Sep 07 12:40:40.820655 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1211/2377] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:39 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1315 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:40.824323 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-4d035980-fd28-4cae-8457-6eafd241b987 req-0286ce5d-ae43-4d00-820f-7d01ff0c3f6d service nova] Creating event network-vif-deleted:168d12f5-7490-45c8-98dc-5e5702f57370 for instance d610675f-fc02-46f7-a980-33b6ee582c4d on n-h2-852087-9 Sep 07 12:40:40.831924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c4585294-cc5e-485d-a448-019844a2f4e7 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:40.832547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c4585294-cc5e-485d-a448-019844a2f4e7 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: d610675f-fc02-46f7-a980-33b6ee582c4d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:40.846181 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-4d035980-fd28-4cae-8457-6eafd241b987 req-0286ce5d-ae43-4d00-820f-7d01ff0c3f6d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102476 Sep 07 12:40:40.847137 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1167/2378] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:40:40.863700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4585294-cc5e-485d-a448-019844a2f4e7 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:40.864243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4585294-cc5e-485d-a448-019844a2f4e7 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:40.864681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4585294-cc5e-485d-a448-019844a2f4e7 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:40.865420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4585294-cc5e-485d-a448-019844a2f4e7 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:40.865926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4585294-cc5e-485d-a448-019844a2f4e7 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:40.866353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4585294-cc5e-485d-a448-019844a2f4e7 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:40.872787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5a0990cf-7d19-41b6-84d6-771105cbc4d8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:40.873561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5a0990cf-7d19-41b6-84d6-771105cbc4d8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] [instance: b713d625-5bb0-4562-916a-b9060c88a6d1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:40.895639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a0990cf-7d19-41b6-84d6-771105cbc4d8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:40.902237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a0990cf-7d19-41b6-84d6-771105cbc4d8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:40.903102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a0990cf-7d19-41b6-84d6-771105cbc4d8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:40.904056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a0990cf-7d19-41b6-84d6-771105cbc4d8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:40.904679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a0990cf-7d19-41b6-84d6-771105cbc4d8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:40.906228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a0990cf-7d19-41b6-84d6-771105cbc4d8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:40.975845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4585294-cc5e-485d-a448-019844a2f4e7 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:40.976287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4585294-cc5e-485d-a448-019844a2f4e7 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:40.976900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4585294-cc5e-485d-a448-019844a2f4e7 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:40.981347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-c4585294-cc5e-485d-a448-019844a2f4e7 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lazy-loading 'fault' on Instance uuid d610675f-fc02-46f7-a980-33b6ee582c4d {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:40:41.146013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:40:41.649966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c4585294-cc5e-485d-a448-019844a2f4e7 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9b8d4c5d9a4efeb97645f3233b1064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e28a1b6c8dde4b948d493b369535a301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:41.666479 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c4585294-cc5e-485d-a448-019844a2f4e7 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers/d610675f-fc02-46f7-a980-33b6ee582c4d" status: 200 len: 1313 microversion: 2.1 time: 0.844674 Sep 07 12:40:41.667387 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1212/2379] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:40 2022] GET /compute/v2.1/servers/d610675f-fc02-46f7-a980-33b6ee582c4d => generated 1313 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:41.672673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32a22bff-44ae-4119-b4ad-cba443515b1e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:41.681989 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-32a22bff-44ae-4119-b4ad-cba443515b1e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: aa6c3482-9f8e-41a7-8bec-32d428a3ce52] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:41.693053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32a22bff-44ae-4119-b4ad-cba443515b1e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:41.696256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32a22bff-44ae-4119-b4ad-cba443515b1e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:41.697050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32a22bff-44ae-4119-b4ad-cba443515b1e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:41.700241 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32a22bff-44ae-4119-b4ad-cba443515b1e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:41.701001 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32a22bff-44ae-4119-b4ad-cba443515b1e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:41.703823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32a22bff-44ae-4119-b4ad-cba443515b1e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:41.949654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-32a22bff-44ae-4119-b4ad-cba443515b1e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:41.964382 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-32a22bff-44ae-4119-b4ad-cba443515b1e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52" status: 200 len: 1277 microversion: 2.1 time: 0.295648 Sep 07 12:40:41.968936 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1213/2380] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:41 2022] GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52 => generated 1277 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:41.980730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-55c4a708-2cba-4aeb-8099-b93dfabe976a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:41.985619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-55c4a708-2cba-4aeb-8099-b93dfabe976a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:42.002691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55c4a708-2cba-4aeb-8099-b93dfabe976a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:42.008236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55c4a708-2cba-4aeb-8099-b93dfabe976a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:42.011085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55c4a708-2cba-4aeb-8099-b93dfabe976a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:42.011949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55c4a708-2cba-4aeb-8099-b93dfabe976a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:42.013175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55c4a708-2cba-4aeb-8099-b93dfabe976a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:42.013805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55c4a708-2cba-4aeb-8099-b93dfabe976a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:42.114352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5a0990cf-7d19-41b6-84d6-771105cbc4d8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017965094f7d482686f7617e0835b7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a9377ba32c4732912a4fcd0a6daa08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:42.137250 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5a0990cf-7d19-41b6-84d6-771105cbc4d8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] 10.222.0.16 "GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1" status: 200 len: 1316 microversion: 2.1 time: 1.288821 Sep 07 12:40:42.138147 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1168/2381] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:40 2022] GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1 => generated 1316 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:42.143768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8a3c7709-9b86-41ce-beb3-cd25e12dc4fe req-bda65631-17e4-45cb-b6ea-4dec812b9dee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65f0a19b-4d7c-4874-accf-9f62a5b48847", "tag": "033af800-eb84-4289-a20f-9c09295fd2fd"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:42.155436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8a3c7709-9b86-41ce-beb3-cd25e12dc4fe req-bda65631-17e4-45cb-b6ea-4dec812b9dee service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:42.156228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8a3c7709-9b86-41ce-beb3-cd25e12dc4fe req-bda65631-17e4-45cb-b6ea-4dec812b9dee service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:42.156816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8a3c7709-9b86-41ce-beb3-cd25e12dc4fe req-bda65631-17e4-45cb-b6ea-4dec812b9dee service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:42.170549 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8a3c7709-9b86-41ce-beb3-cd25e12dc4fe req-bda65631-17e4-45cb-b6ea-4dec812b9dee service nova] Creating event network-changed:033af800-eb84-4289-a20f-9c09295fd2fd for instance 65f0a19b-4d7c-4874-accf-9f62a5b48847 on n-h2-852087-9 Sep 07 12:40:42.176287 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8a3c7709-9b86-41ce-beb3-cd25e12dc4fe req-bda65631-17e4-45cb-b6ea-4dec812b9dee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036045 Sep 07 12:40:42.177173 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1169/2382] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:40:42.184625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-847c965f-732b-428f-bb6c-9824ccf5673e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:42.185684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-847c965f-732b-428f-bb6c-9824ccf5673e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:42.194628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-847c965f-732b-428f-bb6c-9824ccf5673e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:42.195802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-847c965f-732b-428f-bb6c-9824ccf5673e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:42.196413 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-847c965f-732b-428f-bb6c-9824ccf5673e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:42.199017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-847c965f-732b-428f-bb6c-9824ccf5673e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:42.199705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-847c965f-732b-428f-bb6c-9824ccf5673e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:42.200300 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-847c965f-732b-428f-bb6c-9824ccf5673e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:42.445274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-55c4a708-2cba-4aeb-8099-b93dfabe976a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f493fa6856847b4ae7cc8eb997a14c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b06047717c4a5ca47ebc72587256fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:42.475176 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-55c4a708-2cba-4aeb-8099-b93dfabe976a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce" status: 200 len: 1317 microversion: 2.1 time: 0.492177 Sep 07 12:40:42.489533 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1214/2383] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:41 2022] GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce => generated 1317 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:42.489533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-dabe7c6c-e5ad-498a-9705-f4efc5ad6908 req-64e25cf1-8561-4a12-9e84-03e5e2e3b394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b713d625-5bb0-4562-916a-b9060c88a6d1", "name": "network-vif-plugged", "status": "completed", "tag": "d7d0e6f6-b543-4403-813b-81db4758be6b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:42.503730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dabe7c6c-e5ad-498a-9705-f4efc5ad6908 req-64e25cf1-8561-4a12-9e84-03e5e2e3b394 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:42.503730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dabe7c6c-e5ad-498a-9705-f4efc5ad6908 req-64e25cf1-8561-4a12-9e84-03e5e2e3b394 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:42.503730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dabe7c6c-e5ad-498a-9705-f4efc5ad6908 req-64e25cf1-8561-4a12-9e84-03e5e2e3b394 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:42.545391 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-dabe7c6c-e5ad-498a-9705-f4efc5ad6908 req-64e25cf1-8561-4a12-9e84-03e5e2e3b394 service nova] Creating event network-vif-plugged:d7d0e6f6-b543-4403-813b-81db4758be6b for instance b713d625-5bb0-4562-916a-b9060c88a6d1 on n-h2-852087-9 Sep 07 12:40:42.559259 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-dabe7c6c-e5ad-498a-9705-f4efc5ad6908 req-64e25cf1-8561-4a12-9e84-03e5e2e3b394 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081426 Sep 07 12:40:42.561242 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1215/2384] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:40:42.705665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e15f491b-4d80-4df3-99a8-fdf372b5d3c0 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:42.708655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e15f491b-4d80-4df3-99a8-fdf372b5d3c0 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: d610675f-fc02-46f7-a980-33b6ee582c4d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:42.731548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e15f491b-4d80-4df3-99a8-fdf372b5d3c0 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:42.739366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e15f491b-4d80-4df3-99a8-fdf372b5d3c0 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:42.749057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e15f491b-4d80-4df3-99a8-fdf372b5d3c0 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:42.750001 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e15f491b-4d80-4df3-99a8-fdf372b5d3c0 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:42.750583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e15f491b-4d80-4df3-99a8-fdf372b5d3c0 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:42.751105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e15f491b-4d80-4df3-99a8-fdf372b5d3c0 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:42.754157 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-847c965f-732b-428f-bb6c-9824ccf5673e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:42.776843 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-847c965f-732b-428f-bb6c-9824ccf5673e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1315 microversion: 2.1 time: 0.598027 Sep 07 12:40:42.790153 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1170/2385] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:42 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1315 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:42.831023 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-e15f491b-4d80-4df3-99a8-fdf372b5d3c0 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] HTTP exception thrown: Instance d610675f-fc02-46f7-a980-33b6ee582c4d could not be found. Sep 07 12:40:42.833400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e15f491b-4d80-4df3-99a8-fdf372b5d3c0 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Request method failure captured: Sep 07 12:40:42.833400 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/d610675f-fc02-46f7-a980-33b6ee582c4d HTTP/1.1 Sep 07 12:40:42.833400 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:40:42.833400 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:40:42.833400 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:40:42.833400 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:40:42.833400 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:40:42.833400 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:40:42.833400 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:40:42.833400 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:40:42.833400 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJDsBdDBuK6-U-oa3EgLwJ0cInn42LooYDDK2xuzMieAmtDdHVgCQSCGUg7Mms36Dytx6iFOmjDeDJYTcyb97tpVFzJ2wUaPiQNOZa3rYItTJozEFSKJVy72U0F8Z9IglffmC_MrHLrEV6jHa3Ae7EJd2NyfR5n6uH1QOj7TevCy0ho Sep 07 12:40:42.833400 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:40:42.833400 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:40:42.833400 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:40:42.833400 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:40:42.833400 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:40:42.833400 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:40:42.833400 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: e28a1b6c8dde4b948d493b369535a301 Sep 07 12:40:42.833400 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ListServersNegativeTestJSON-1212395273 Sep 07 12:40:42.833400 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:40:42.833400 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:40:42.834875 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:40:42.834875 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ListServersNegativeTestJSON-1212395273 Sep 07 12:40:42.834875 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: e28a1b6c8dde4b948d493b369535a301 Sep 07 12:40:42.834875 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1212395273 Sep 07 12:40:42.834875 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ListServersNegativeTestJSON-1212395273-project Sep 07 12:40:42.834875 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:40:42.834875 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:40:42.834875 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 3f9b8d4c5d9a4efeb97645f3233b1064 Sep 07 12:40:42.834875 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ListServersNegativeTestJSON-1212395273-project Sep 07 12:40:42.834875 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:40:42.834875 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance d610675f-fc02-46f7-a980-33b6ee582c4d could not be found. Sep 07 12:40:42.834875 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'd610675f-fc02-46f7-a980-33b6ee582c4d'} Sep 07 12:40:42.836031 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:40:42.836031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:42.836031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:40:42.836031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:40:42.836031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:40:42.836031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:40:42.836031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:40:42.836031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:40:42.836031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:40:42.836031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:40:42.836031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d610675f-fc02-46f7-a980-33b6ee582c4d could not be found. Sep 07 12:40:42.836031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:42.836031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:42.836031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:42.836031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:42.836031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:42.836031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:42.836031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:40:42.836031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:40:42.836031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:40:42.838604 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:40:42.838604 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:40:42.838604 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:40:42.838604 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:40:42.838604 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:40:42.838604 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:40:42.838604 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:40:42.838604 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d610675f-fc02-46f7-a980-33b6ee582c4d could not be found. Sep 07 12:40:42.838604 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:42.838604 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:42.838604 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:42.838604 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:42.838604 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:42.838604 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:42.838604 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:40:42.838604 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:40:42.838604 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d610675f-fc02-46f7-a980-33b6ee582c4d could not be found. Sep 07 12:40:42.838604 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:42.841094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e15f491b-4d80-4df3-99a8-fdf372b5d3c0 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Returning 404 to user: Instance d610675f-fc02-46f7-a980-33b6ee582c4d could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:40:42.841094 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e15f491b-4d80-4df3-99a8-fdf372b5d3c0 tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers/d610675f-fc02-46f7-a980-33b6ee582c4d" status: 404 len: 111 microversion: 2.1 time: 0.147465 Sep 07 12:40:42.841735 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1216/2386] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:42 2022] GET /compute/v2.1/servers/d610675f-fc02-46f7-a980-33b6ee582c4d => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:40:42.852342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c8c7ebac-7936-45cf-be3b-1e3b1a1d08dc tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:42.852978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c8c7ebac-7936-45cf-be3b-1e3b1a1d08dc tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] [instance: 498a719e-d642-4e9c-9951-d6aacb0a16db] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:42.870580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8c7ebac-7936-45cf-be3b-1e3b1a1d08dc tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:42.871090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8c7ebac-7936-45cf-be3b-1e3b1a1d08dc tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:42.871540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8c7ebac-7936-45cf-be3b-1e3b1a1d08dc tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:42.872302 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8c7ebac-7936-45cf-be3b-1e3b1a1d08dc tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:42.872779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8c7ebac-7936-45cf-be3b-1e3b1a1d08dc tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:42.873437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8c7ebac-7936-45cf-be3b-1e3b1a1d08dc tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:42.932459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-28659798-49ee-474c-a04f-3876c723796b req-6db7a938-026b-44a7-87f5-83a61c5839d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "886a386f-a0cc-4d90-96ac-4e418ed43bce", "tag": "a0ca592a-191a-4417-974a-0fdc230ebb1c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:42.937143 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-c8c7ebac-7936-45cf-be3b-1e3b1a1d08dc tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] HTTP exception thrown: Instance 498a719e-d642-4e9c-9951-d6aacb0a16db could not be found. Sep 07 12:40:42.938862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c8c7ebac-7936-45cf-be3b-1e3b1a1d08dc tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Request method failure captured: Sep 07 12:40:42.938862 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db HTTP/1.1 Sep 07 12:40:42.938862 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:40:42.938862 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:40:42.938862 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:40:42.938862 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:40:42.938862 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:40:42.938862 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:40:42.938862 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:40:42.938862 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:40:42.938862 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJDsBdDBuK6-U-oa3EgLwJ0cInn42LooYDDK2xuzMieAmtDdHVgCQSCGUg7Mms36Dytx6iFOmjDeDJYTcyb97tpVFzJ2wUaPiQNOZa3rYItTJozEFSKJVy72U0F8Z9IglffmC_MrHLrEV6jHa3Ae7EJd2NyfR5n6uH1QOj7TevCy0ho Sep 07 12:40:42.938862 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:40:42.938862 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:40:42.938862 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:40:42.938862 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:40:42.938862 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:40:42.938862 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:40:42.938862 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: e28a1b6c8dde4b948d493b369535a301 Sep 07 12:40:42.938862 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ListServersNegativeTestJSON-1212395273 Sep 07 12:40:42.938862 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:40:42.938862 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:40:42.940025 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e28a1b6c8dde4b948d493b369535a301"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:40:42.940025 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ListServersNegativeTestJSON-1212395273 Sep 07 12:40:42.940025 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: e28a1b6c8dde4b948d493b369535a301 Sep 07 12:40:42.940025 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1212395273 Sep 07 12:40:42.940025 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ListServersNegativeTestJSON-1212395273-project Sep 07 12:40:42.940025 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:40:42.940025 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:40:42.940025 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 3f9b8d4c5d9a4efeb97645f3233b1064 Sep 07 12:40:42.940025 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ListServersNegativeTestJSON-1212395273-project Sep 07 12:40:42.940025 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:40:42.940025 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 498a719e-d642-4e9c-9951-d6aacb0a16db could not be found. Sep 07 12:40:42.940025 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '498a719e-d642-4e9c-9951-d6aacb0a16db'} Sep 07 12:40:42.940672 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:40:42.940672 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:42.940672 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:40:42.940672 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:40:42.940672 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:40:42.940672 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:40:42.940672 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:40:42.940672 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:40:42.940672 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:40:42.940672 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:40:42.940672 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 498a719e-d642-4e9c-9951-d6aacb0a16db could not be found. Sep 07 12:40:42.940672 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:42.940672 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:42.940672 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:42.940672 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:42.940672 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:42.940672 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:42.940672 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:40:42.940672 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:40:42.940672 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:40:42.941735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:40:42.941735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:40:42.941735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:40:42.941735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:40:42.941735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:40:42.941735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:40:42.941735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:40:42.941735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 498a719e-d642-4e9c-9951-d6aacb0a16db could not be found. Sep 07 12:40:42.941735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:42.941735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:42.941735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:42.941735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:42.941735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:42.941735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:42.941735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:40:42.941735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:40:42.941735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 498a719e-d642-4e9c-9951-d6aacb0a16db could not be found. Sep 07 12:40:42.941735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:42.943833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c8c7ebac-7936-45cf-be3b-1e3b1a1d08dc tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] Returning 404 to user: Instance 498a719e-d642-4e9c-9951-d6aacb0a16db could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:40:42.944735 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c8c7ebac-7936-45cf-be3b-1e3b1a1d08dc tempest-ListServersNegativeTestJSON-1212395273 tempest-ListServersNegativeTestJSON-1212395273-project] 10.222.0.16 "GET /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db" status: 404 len: 111 microversion: 2.1 time: 0.098045 Sep 07 12:40:42.945420 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1171/2387] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:42 2022] GET /compute/v2.1/servers/498a719e-d642-4e9c-9951-d6aacb0a16db => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:40:42.950980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-28659798-49ee-474c-a04f-3876c723796b req-6db7a938-026b-44a7-87f5-83a61c5839d8 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:42.953409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-28659798-49ee-474c-a04f-3876c723796b req-6db7a938-026b-44a7-87f5-83a61c5839d8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:42.954046 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-28659798-49ee-474c-a04f-3876c723796b req-6db7a938-026b-44a7-87f5-83a61c5839d8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:42.992976 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-28659798-49ee-474c-a04f-3876c723796b req-6db7a938-026b-44a7-87f5-83a61c5839d8 service nova] Creating event network-changed:a0ca592a-191a-4417-974a-0fdc230ebb1c for instance 886a386f-a0cc-4d90-96ac-4e418ed43bce on n-h1-852087-9 Sep 07 12:40:42.999717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-79555309-b0ab-4ace-be3c-f0c3ad3a8df6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:43.000382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-79555309-b0ab-4ace-be3c-f0c3ad3a8df6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: aa6c3482-9f8e-41a7-8bec-32d428a3ce52] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:43.005949 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-28659798-49ee-474c-a04f-3876c723796b req-6db7a938-026b-44a7-87f5-83a61c5839d8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079399 Sep 07 12:40:43.009821 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1217/2388] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:40:43.016051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79555309-b0ab-4ace-be3c-f0c3ad3a8df6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:43.018121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79555309-b0ab-4ace-be3c-f0c3ad3a8df6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:43.024904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79555309-b0ab-4ace-be3c-f0c3ad3a8df6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:43.025771 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79555309-b0ab-4ace-be3c-f0c3ad3a8df6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:43.026255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79555309-b0ab-4ace-be3c-f0c3ad3a8df6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:43.026694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79555309-b0ab-4ace-be3c-f0c3ad3a8df6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:43.166368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-64e49102-06ec-478d-8b8a-a93ee2c78b1e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:43.167428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-64e49102-06ec-478d-8b8a-a93ee2c78b1e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] [instance: b713d625-5bb0-4562-916a-b9060c88a6d1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:43.179014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64e49102-06ec-478d-8b8a-a93ee2c78b1e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:43.179823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64e49102-06ec-478d-8b8a-a93ee2c78b1e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:43.180422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64e49102-06ec-478d-8b8a-a93ee2c78b1e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:43.181331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64e49102-06ec-478d-8b8a-a93ee2c78b1e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:43.181979 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64e49102-06ec-478d-8b8a-a93ee2c78b1e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:43.182688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64e49102-06ec-478d-8b8a-a93ee2c78b1e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:43.188104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:40:44.151313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-79555309-b0ab-4ace-be3c-f0c3ad3a8df6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:44.183573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-64e49102-06ec-478d-8b8a-a93ee2c78b1e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017965094f7d482686f7617e0835b7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a9377ba32c4732912a4fcd0a6daa08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:44.237041 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-79555309-b0ab-4ace-be3c-f0c3ad3a8df6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52" status: 200 len: 1319 microversion: 2.1 time: 1.241738 Sep 07 12:40:44.240348 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-64e49102-06ec-478d-8b8a-a93ee2c78b1e tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] 10.222.0.16 "GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1" status: 200 len: 1316 microversion: 2.1 time: 1.079158 Sep 07 12:40:44.262725 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1172/2389] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:42 2022] GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52 => generated 1319 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:40:44.273837 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1218/2390] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:43 2022] GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1 => generated 1316 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:40:44.302434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b58b9945-556a-4b96-b489-3f5f7d89fed1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:44.303444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ae5d4258-32fd-482f-9db3-e435db309bd3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:44.307278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b58b9945-556a-4b96-b489-3f5f7d89fed1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:44.309547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ae5d4258-32fd-482f-9db3-e435db309bd3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:44.339184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae5d4258-32fd-482f-9db3-e435db309bd3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:44.341747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b58b9945-556a-4b96-b489-3f5f7d89fed1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:44.342971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b58b9945-556a-4b96-b489-3f5f7d89fed1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:44.344263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae5d4258-32fd-482f-9db3-e435db309bd3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:44.345427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b58b9945-556a-4b96-b489-3f5f7d89fed1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:44.346576 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae5d4258-32fd-482f-9db3-e435db309bd3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:44.348428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b58b9945-556a-4b96-b489-3f5f7d89fed1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:44.348634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae5d4258-32fd-482f-9db3-e435db309bd3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:44.349452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae5d4258-32fd-482f-9db3-e435db309bd3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:44.350470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b58b9945-556a-4b96-b489-3f5f7d89fed1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:44.351630 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae5d4258-32fd-482f-9db3-e435db309bd3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:44.351802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b58b9945-556a-4b96-b489-3f5f7d89fed1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:45.470124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ae5d4258-32fd-482f-9db3-e435db309bd3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:45.498046 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ae5d4258-32fd-482f-9db3-e435db309bd3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1315 microversion: 2.1 time: 1.221339 Sep 07 12:40:45.544789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b58b9945-556a-4b96-b489-3f5f7d89fed1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f493fa6856847b4ae7cc8eb997a14c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b06047717c4a5ca47ebc72587256fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:45.555034 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b58b9945-556a-4b96-b489-3f5f7d89fed1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce" status: 200 len: 1317 microversion: 2.1 time: 1.290145 Sep 07 12:40:45.555526 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1219/2391] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:44 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1315 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:45.566743 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1173/2392] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:44 2022] GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce => generated 1317 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:45.568748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1cb8c1f3-e94a-4de7-bc71-a2fad66a0435 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:45.570470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1cb8c1f3-e94a-4de7-bc71-a2fad66a0435 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: aa6c3482-9f8e-41a7-8bec-32d428a3ce52] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:45.572143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c063d1d8-7749-4c48-bc60-ee8adc6cdeb1 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:45.572769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c063d1d8-7749-4c48-bc60-ee8adc6cdeb1 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] [instance: b713d625-5bb0-4562-916a-b9060c88a6d1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:45.583049 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:40:45.589224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cb8c1f3-e94a-4de7-bc71-a2fad66a0435 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:45.590910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cb8c1f3-e94a-4de7-bc71-a2fad66a0435 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:45.592085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cb8c1f3-e94a-4de7-bc71-a2fad66a0435 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:45.592274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c063d1d8-7749-4c48-bc60-ee8adc6cdeb1 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:45.592746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c063d1d8-7749-4c48-bc60-ee8adc6cdeb1 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:45.593195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c063d1d8-7749-4c48-bc60-ee8adc6cdeb1 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:45.593952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c063d1d8-7749-4c48-bc60-ee8adc6cdeb1 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:45.594427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c063d1d8-7749-4c48-bc60-ee8adc6cdeb1 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:45.594840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c063d1d8-7749-4c48-bc60-ee8adc6cdeb1 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:45.595128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cb8c1f3-e94a-4de7-bc71-a2fad66a0435 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:45.596219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cb8c1f3-e94a-4de7-bc71-a2fad66a0435 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:45.597206 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cb8c1f3-e94a-4de7-bc71-a2fad66a0435 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:46.492012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c063d1d8-7749-4c48-bc60-ee8adc6cdeb1 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017965094f7d482686f7617e0835b7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a9377ba32c4732912a4fcd0a6daa08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:46.507055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1cb8c1f3-e94a-4de7-bc71-a2fad66a0435 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:46.513660 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c063d1d8-7749-4c48-bc60-ee8adc6cdeb1 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] 10.222.0.16 "GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1" status: 200 len: 1316 microversion: 2.1 time: 0.945410 Sep 07 12:40:46.517305 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1174/2393] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:45 2022] GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1 => generated 1316 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:46.543458 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1cb8c1f3-e94a-4de7-bc71-a2fad66a0435 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52" status: 200 len: 1319 microversion: 2.1 time: 0.984197 Sep 07 12:40:46.544767 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1220/2394] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:45 2022] GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52 => generated 1319 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:46.574343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-faa8fb3f-d770-4a45-b705-1b6f0139a56e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:46.578838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-faa8fb3f-d770-4a45-b705-1b6f0139a56e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:46.606139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:40:46.610265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-faa8fb3f-d770-4a45-b705-1b6f0139a56e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:46.610931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-faa8fb3f-d770-4a45-b705-1b6f0139a56e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:46.611382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-faa8fb3f-d770-4a45-b705-1b6f0139a56e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:46.612145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-faa8fb3f-d770-4a45-b705-1b6f0139a56e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:46.614451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-faa8fb3f-d770-4a45-b705-1b6f0139a56e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:46.614451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-faa8fb3f-d770-4a45-b705-1b6f0139a56e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:46.634103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5423fcc1-ca49-4ff8-8a49-ea2bdffde0d9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:46.635967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5423fcc1-ca49-4ff8-8a49-ea2bdffde0d9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:46.660391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5423fcc1-ca49-4ff8-8a49-ea2bdffde0d9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:46.662706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5423fcc1-ca49-4ff8-8a49-ea2bdffde0d9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:46.664553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5423fcc1-ca49-4ff8-8a49-ea2bdffde0d9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:46.665815 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5423fcc1-ca49-4ff8-8a49-ea2bdffde0d9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:46.666780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5423fcc1-ca49-4ff8-8a49-ea2bdffde0d9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:46.667755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5423fcc1-ca49-4ff8-8a49-ea2bdffde0d9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:47.540125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5423fcc1-ca49-4ff8-8a49-ea2bdffde0d9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f493fa6856847b4ae7cc8eb997a14c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b06047717c4a5ca47ebc72587256fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:47.548941 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5423fcc1-ca49-4ff8-8a49-ea2bdffde0d9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce" status: 200 len: 1317 microversion: 2.1 time: 0.932510 Sep 07 12:40:47.557337 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1221/2395] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:46 2022] GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce => generated 1317 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:47.571854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f180e608-32a3-4dfb-945f-e24d8a1499c8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:47.574616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f180e608-32a3-4dfb-945f-e24d8a1499c8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] [instance: b713d625-5bb0-4562-916a-b9060c88a6d1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:47.581061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-faa8fb3f-d770-4a45-b705-1b6f0139a56e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:47.590162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f180e608-32a3-4dfb-945f-e24d8a1499c8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:47.590787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f180e608-32a3-4dfb-945f-e24d8a1499c8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:47.591365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f180e608-32a3-4dfb-945f-e24d8a1499c8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:47.593343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f180e608-32a3-4dfb-945f-e24d8a1499c8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:47.594844 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f180e608-32a3-4dfb-945f-e24d8a1499c8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:47.596107 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f180e608-32a3-4dfb-945f-e24d8a1499c8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:47.606218 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-faa8fb3f-d770-4a45-b705-1b6f0139a56e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1315 microversion: 2.1 time: 1.046915 Sep 07 12:40:47.607238 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1175/2396] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:46 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1315 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:47.629295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1b2816a8-0466-456d-92b6-d71041ce6e70 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:47.629295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1b2816a8-0466-456d-92b6-d71041ce6e70 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: aa6c3482-9f8e-41a7-8bec-32d428a3ce52] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:47.650621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b2816a8-0466-456d-92b6-d71041ce6e70 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:47.651418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b2816a8-0466-456d-92b6-d71041ce6e70 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:47.652202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b2816a8-0466-456d-92b6-d71041ce6e70 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:47.653459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b2816a8-0466-456d-92b6-d71041ce6e70 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:47.654300 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b2816a8-0466-456d-92b6-d71041ce6e70 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:47.660471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b2816a8-0466-456d-92b6-d71041ce6e70 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:49.089697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1b2816a8-0466-456d-92b6-d71041ce6e70 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:49.102432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f180e608-32a3-4dfb-945f-e24d8a1499c8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017965094f7d482686f7617e0835b7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a9377ba32c4732912a4fcd0a6daa08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:49.108204 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1b2816a8-0466-456d-92b6-d71041ce6e70 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52" status: 200 len: 1319 microversion: 2.1 time: 1.489081 Sep 07 12:40:49.109642 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1176/2397] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:47 2022] GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52 => generated 1319 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:49.120528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-b0b87045-66a6-48a9-8ae6-4a54f21bd60c req-756dd65c-8737-4e66-a929-75bb93fe7a6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8d74fd-0b94-465e-a644-a44170def51c", "name": "network-vif-plugged", "status": "completed", "tag": "798531a0-1079-41ca-b03b-2f727c036b56"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:49.151249 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f180e608-32a3-4dfb-945f-e24d8a1499c8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] 10.222.0.16 "GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1" status: 200 len: 1503 microversion: 2.1 time: 1.590976 Sep 07 12:40:49.153111 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1222/2398] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:47 2022] GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1 => generated 1503 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:49.155211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b0b87045-66a6-48a9-8ae6-4a54f21bd60c req-756dd65c-8737-4e66-a929-75bb93fe7a6c service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:49.156097 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b0b87045-66a6-48a9-8ae6-4a54f21bd60c req-756dd65c-8737-4e66-a929-75bb93fe7a6c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:49.156881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b0b87045-66a6-48a9-8ae6-4a54f21bd60c req-756dd65c-8737-4e66-a929-75bb93fe7a6c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:49.175085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-08dc7a9b-78d0-4da6-a635-49455726a851 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:49.179762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-08dc7a9b-78d0-4da6-a635-49455726a851 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:49.198452 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-b0b87045-66a6-48a9-8ae6-4a54f21bd60c req-756dd65c-8737-4e66-a929-75bb93fe7a6c service nova] Creating event network-vif-plugged:798531a0-1079-41ca-b03b-2f727c036b56 for instance 9b8d74fd-0b94-465e-a644-a44170def51c on n-h2-852087-9 Sep 07 12:40:49.199124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08dc7a9b-78d0-4da6-a635-49455726a851 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:49.199920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08dc7a9b-78d0-4da6-a635-49455726a851 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:49.200626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08dc7a9b-78d0-4da6-a635-49455726a851 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:49.201863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08dc7a9b-78d0-4da6-a635-49455726a851 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:49.203736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08dc7a9b-78d0-4da6-a635-49455726a851 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:49.207916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08dc7a9b-78d0-4da6-a635-49455726a851 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:49.216882 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-b0b87045-66a6-48a9-8ae6-4a54f21bd60c req-756dd65c-8737-4e66-a929-75bb93fe7a6c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102074 Sep 07 12:40:49.220539 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1177/2399] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:40:49.249187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-581f9e4a-83ef-4918-9232-04c02aadaa28 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:49.251819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-581f9e4a-83ef-4918-9232-04c02aadaa28 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:49.265244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-581f9e4a-83ef-4918-9232-04c02aadaa28 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:49.266615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-581f9e4a-83ef-4918-9232-04c02aadaa28 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:49.267636 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-581f9e4a-83ef-4918-9232-04c02aadaa28 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:49.269337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-581f9e4a-83ef-4918-9232-04c02aadaa28 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:49.270557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-581f9e4a-83ef-4918-9232-04c02aadaa28 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:49.271595 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-581f9e4a-83ef-4918-9232-04c02aadaa28 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:51.161067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-581f9e4a-83ef-4918-9232-04c02aadaa28 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:51.187243 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-581f9e4a-83ef-4918-9232-04c02aadaa28 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1315 microversion: 2.1 time: 1.962939 Sep 07 12:40:51.204562 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1178/2400] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:49 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1315 bytes in 1983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:51.220614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-394cf02c-e928-4f80-9aee-5a238cb58cc4 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:51.222256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-394cf02c-e928-4f80-9aee-5a238cb58cc4 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] [instance: b713d625-5bb0-4562-916a-b9060c88a6d1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:51.237892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-08dc7a9b-78d0-4da6-a635-49455726a851 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f493fa6856847b4ae7cc8eb997a14c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b06047717c4a5ca47ebc72587256fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:51.242428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-394cf02c-e928-4f80-9aee-5a238cb58cc4 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:51.248888 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-08dc7a9b-78d0-4da6-a635-49455726a851 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce" status: 200 len: 1317 microversion: 2.1 time: 2.093745 Sep 07 12:40:51.251940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-394cf02c-e928-4f80-9aee-5a238cb58cc4 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:51.254502 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1223/2401] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:49 2022] GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce => generated 1317 bytes in 2099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:51.255170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-394cf02c-e928-4f80-9aee-5a238cb58cc4 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:51.256629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-394cf02c-e928-4f80-9aee-5a238cb58cc4 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:51.260595 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-394cf02c-e928-4f80-9aee-5a238cb58cc4 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:51.261347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-394cf02c-e928-4f80-9aee-5a238cb58cc4 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:51.262429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-977531b7-5973-4315-96ba-483d4a455fe5 req-249e46b7-c6ec-4423-8a84-a7055dfb999c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa6c3482-9f8e-41a7-8bec-32d428a3ce52", "tag": "5d83a858-3dea-4c83-8d38-a1fe466b187d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:51.283148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-977531b7-5973-4315-96ba-483d4a455fe5 req-249e46b7-c6ec-4423-8a84-a7055dfb999c service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:51.283939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-977531b7-5973-4315-96ba-483d4a455fe5 req-249e46b7-c6ec-4423-8a84-a7055dfb999c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:51.284703 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-977531b7-5973-4315-96ba-483d4a455fe5 req-249e46b7-c6ec-4423-8a84-a7055dfb999c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:51.305179 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-977531b7-5973-4315-96ba-483d4a455fe5 req-249e46b7-c6ec-4423-8a84-a7055dfb999c service nova] Creating event network-changed:5d83a858-3dea-4c83-8d38-a1fe466b187d for instance aa6c3482-9f8e-41a7-8bec-32d428a3ce52 on n-h2-852087-9 Sep 07 12:40:51.315047 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-977531b7-5973-4315-96ba-483d4a455fe5 req-249e46b7-c6ec-4423-8a84-a7055dfb999c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058083 Sep 07 12:40:51.316612 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1224/2402] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:40:51.324566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-43909be7-48f6-4424-be7a-0072600b4280 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:51.325906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-43909be7-48f6-4424-be7a-0072600b4280 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: aa6c3482-9f8e-41a7-8bec-32d428a3ce52] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:51.335281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-394cf02c-e928-4f80-9aee-5a238cb58cc4 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] [instance: b713d625-5bb0-4562-916a-b9060c88a6d1] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:40:51.336282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43909be7-48f6-4424-be7a-0072600b4280 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:51.336977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43909be7-48f6-4424-be7a-0072600b4280 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:51.337738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43909be7-48f6-4424-be7a-0072600b4280 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:51.338814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43909be7-48f6-4424-be7a-0072600b4280 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:51.339460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43909be7-48f6-4424-be7a-0072600b4280 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:51.340055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43909be7-48f6-4424-be7a-0072600b4280 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:51.502324 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-394cf02c-e928-4f80-9aee-5a238cb58cc4 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1" status: 204 len: 0 microversion: 2.1 time: 0.295315 Sep 07 12:40:51.507584 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1179/2403] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:40:51 2022] DELETE /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:40:51.516326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-58c43a6e-3941-42ad-bb8d-f1106d65e8cd req-65adb5ae-006d-45e1-a1f7-1313753b803b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65f0a19b-4d7c-4874-accf-9f62a5b48847", "name": "network-vif-plugged", "status": "completed", "tag": "033af800-eb84-4289-a20f-9c09295fd2fd"}, {"server_uuid": "886a386f-a0cc-4d90-96ac-4e418ed43bce", "name": "network-vif-plugged", "status": "completed", "tag": "a0ca592a-191a-4417-974a-0fdc230ebb1c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:51.534232 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-58c43a6e-3941-42ad-bb8d-f1106d65e8cd req-65adb5ae-006d-45e1-a1f7-1313753b803b service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:51.536586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-58c43a6e-3941-42ad-bb8d-f1106d65e8cd req-65adb5ae-006d-45e1-a1f7-1313753b803b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:51.537617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-58c43a6e-3941-42ad-bb8d-f1106d65e8cd req-65adb5ae-006d-45e1-a1f7-1313753b803b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:51.579400 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-58c43a6e-3941-42ad-bb8d-f1106d65e8cd req-65adb5ae-006d-45e1-a1f7-1313753b803b service nova] Creating event network-vif-plugged:033af800-eb84-4289-a20f-9c09295fd2fd for instance 65f0a19b-4d7c-4874-accf-9f62a5b48847 on n-h2-852087-9 Sep 07 12:40:51.581272 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-58c43a6e-3941-42ad-bb8d-f1106d65e8cd req-65adb5ae-006d-45e1-a1f7-1313753b803b service nova] Creating event network-vif-plugged:a0ca592a-191a-4417-974a-0fdc230ebb1c for instance 886a386f-a0cc-4d90-96ac-4e418ed43bce on n-h1-852087-9 Sep 07 12:40:51.591987 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-58c43a6e-3941-42ad-bb8d-f1106d65e8cd req-65adb5ae-006d-45e1-a1f7-1313753b803b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.085345 Sep 07 12:40:51.593321 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1180/2404] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:40:51.604037 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d8beca16-aae1-4a5f-8f23-996ade9d278a tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:51.605319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d8beca16-aae1-4a5f-8f23-996ade9d278a tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] [instance: b713d625-5bb0-4562-916a-b9060c88a6d1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:51.629469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8beca16-aae1-4a5f-8f23-996ade9d278a tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:51.632599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8beca16-aae1-4a5f-8f23-996ade9d278a tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:51.633338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8beca16-aae1-4a5f-8f23-996ade9d278a tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:51.634582 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8beca16-aae1-4a5f-8f23-996ade9d278a tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:51.635342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8beca16-aae1-4a5f-8f23-996ade9d278a tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:51.635997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8beca16-aae1-4a5f-8f23-996ade9d278a tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:52.057506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-43909be7-48f6-4424-be7a-0072600b4280 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:52.084141 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-43909be7-48f6-4424-be7a-0072600b4280 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52" status: 200 len: 1319 microversion: 2.1 time: 0.765974 Sep 07 12:40:52.100552 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1225/2405] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:51 2022] GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52 => generated 1319 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:52.221266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d8beca16-aae1-4a5f-8f23-996ade9d278a tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017965094f7d482686f7617e0835b7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a9377ba32c4732912a4fcd0a6daa08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:52.238205 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d8beca16-aae1-4a5f-8f23-996ade9d278a tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] 10.222.0.16 "GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1" status: 200 len: 1509 microversion: 2.1 time: 0.642714 Sep 07 12:40:52.240250 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1181/2406] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:51 2022] GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1 => generated 1509 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:52.251467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-57daeb9e-1010-4315-a7e7-ef8ccd76f0ca tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:52.252826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-57daeb9e-1010-4315-a7e7-ef8ccd76f0ca tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:52.264677 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57daeb9e-1010-4315-a7e7-ef8ccd76f0ca tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:52.265523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57daeb9e-1010-4315-a7e7-ef8ccd76f0ca tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:52.266258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57daeb9e-1010-4315-a7e7-ef8ccd76f0ca tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:52.267936 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57daeb9e-1010-4315-a7e7-ef8ccd76f0ca tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:52.268746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57daeb9e-1010-4315-a7e7-ef8ccd76f0ca tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:52.269509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57daeb9e-1010-4315-a7e7-ef8ccd76f0ca tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:52.472455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7b2a00f2-8888-46ac-ae9a-f84711f8dbf5 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Action: 'update', calling method: .version_select at 0x7fc419cadf70>, body: {"quota_set": {"ram": "5120"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:52.623240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-57daeb9e-1010-4315-a7e7-ef8ccd76f0ca tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:52.643040 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-57daeb9e-1010-4315-a7e7-ef8ccd76f0ca tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1315 microversion: 2.1 time: 0.400799 Sep 07 12:40:52.645562 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1182/2407] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:52 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:52.650138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1489f292-4270-4cd0-a818-95a8067073f1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:52.651572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1489f292-4270-4cd0-a818-95a8067073f1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:52.663560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b2a00f2-8888-46ac-ae9a-f84711f8dbf5 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:52.664651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b2a00f2-8888-46ac-ae9a-f84711f8dbf5 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:52.665560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b2a00f2-8888-46ac-ae9a-f84711f8dbf5 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:52.667113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b2a00f2-8888-46ac-ae9a-f84711f8dbf5 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:52.668013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b2a00f2-8888-46ac-ae9a-f84711f8dbf5 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:52.669282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b2a00f2-8888-46ac-ae9a-f84711f8dbf5 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:52.672436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1489f292-4270-4cd0-a818-95a8067073f1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:52.696463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1489f292-4270-4cd0-a818-95a8067073f1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:52.701780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1489f292-4270-4cd0-a818-95a8067073f1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:52.703503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1489f292-4270-4cd0-a818-95a8067073f1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:52.704329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1489f292-4270-4cd0-a818-95a8067073f1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:52.705019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1489f292-4270-4cd0-a818-95a8067073f1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:52.845828 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7b2a00f2-8888-46ac-ae9a-f84711f8dbf5 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/17177ff8c59449a0ab52f49af8711245" status: 200 len: 148 microversion: 2.57 time: 0.743279 Sep 07 12:40:52.859739 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1226/2408] 10.222.0.16 () {62 vars in 1303 bytes} [Wed Sep 7 12:40:52 2022] PUT /compute/v2.1/os-quota-sets/17177ff8c59449a0ab52f49af8711245 => generated 148 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:40:52.873843 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3dc87324-7ae8-4828-93e6-6ceef0b148e8 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Calling method '.version_select at 0x7fc418804ca0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:53.012961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1489f292-4270-4cd0-a818-95a8067073f1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f493fa6856847b4ae7cc8eb997a14c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b06047717c4a5ca47ebc72587256fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:53.017056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:40:53.022979 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1489f292-4270-4cd0-a818-95a8067073f1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce" status: 200 len: 1317 microversion: 2.1 time: 0.377566 Sep 07 12:40:53.031251 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1183/2409] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:52 2022] GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce => generated 1317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:53.034543 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dc87324-7ae8-4828-93e6-6ceef0b148e8 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:53.035749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dc87324-7ae8-4828-93e6-6ceef0b148e8 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:53.036374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dc87324-7ae8-4828-93e6-6ceef0b148e8 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:53.037351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dc87324-7ae8-4828-93e6-6ceef0b148e8 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:53.038246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dc87324-7ae8-4828-93e6-6ceef0b148e8 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:53.039311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3dc87324-7ae8-4828-93e6-6ceef0b148e8 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:53.105233 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3dc87324-7ae8-4828-93e6-6ceef0b148e8 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/17177ff8c59449a0ab52f49af8711245/detail" status: 200 len: 463 microversion: 2.57 time: 0.233529 Sep 07 12:40:53.129436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3905037e-6e9d-4490-8908-7de412df2777 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:53.130118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3905037e-6e9d-4490-8908-7de412df2777 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: aa6c3482-9f8e-41a7-8bec-32d428a3ce52] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:53.136605 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1227/2410] 10.222.0.16 () {60 vars in 1304 bytes} [Wed Sep 7 12:40:52 2022] GET /compute/v2.1/os-quota-sets/17177ff8c59449a0ab52f49af8711245/detail => generated 463 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:40:53.156746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3905037e-6e9d-4490-8908-7de412df2777 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:53.158310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3905037e-6e9d-4490-8908-7de412df2777 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:53.159695 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3905037e-6e9d-4490-8908-7de412df2777 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:53.161958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3905037e-6e9d-4490-8908-7de412df2777 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:53.163360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3905037e-6e9d-4490-8908-7de412df2777 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:53.165743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3905037e-6e9d-4490-8908-7de412df2777 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:53.274986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4a718318-0cb9-41d5-9306-bb8a5a344872 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:53.281726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4a718318-0cb9-41d5-9306-bb8a5a344872 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] [instance: b713d625-5bb0-4562-916a-b9060c88a6d1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:53.313688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a718318-0cb9-41d5-9306-bb8a5a344872 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:53.314616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a718318-0cb9-41d5-9306-bb8a5a344872 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:53.315677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a718318-0cb9-41d5-9306-bb8a5a344872 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:53.317066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a718318-0cb9-41d5-9306-bb8a5a344872 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:53.318196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a718318-0cb9-41d5-9306-bb8a5a344872 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:53.319150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a718318-0cb9-41d5-9306-bb8a5a344872 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:53.491195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3905037e-6e9d-4490-8908-7de412df2777 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:53.504861 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3905037e-6e9d-4490-8908-7de412df2777 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52" status: 200 len: 1319 microversion: 2.1 time: 0.380738 Sep 07 12:40:53.505773 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1184/2411] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:53 2022] GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52 => generated 1319 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:40:53.599320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eab5299a-53aa-45c6-853b-a62ddfb8f291 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Action: 'update', calling method: .version_select at 0x7fc418c67790>, body: {"quota_set": {"ram": "2048"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:53.697309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4a718318-0cb9-41d5-9306-bb8a5a344872 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017965094f7d482686f7617e0835b7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a9377ba32c4732912a4fcd0a6daa08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:53.707977 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4a718318-0cb9-41d5-9306-bb8a5a344872 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] 10.222.0.16 "GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1" status: 200 len: 1509 microversion: 2.1 time: 0.441912 Sep 07 12:40:53.712319 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1228/2412] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:53 2022] GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1 => generated 1509 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:53.728671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b57669da-452c-4fb2-a6f0-80647ab4ff22 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:53.729330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b57669da-452c-4fb2-a6f0-80647ab4ff22 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:53.734694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eab5299a-53aa-45c6-853b-a62ddfb8f291 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:53.735271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eab5299a-53aa-45c6-853b-a62ddfb8f291 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:53.735727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eab5299a-53aa-45c6-853b-a62ddfb8f291 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:53.736533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eab5299a-53aa-45c6-853b-a62ddfb8f291 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:53.737007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eab5299a-53aa-45c6-853b-a62ddfb8f291 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:53.737435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eab5299a-53aa-45c6-853b-a62ddfb8f291 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:53.747914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b57669da-452c-4fb2-a6f0-80647ab4ff22 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:53.748422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b57669da-452c-4fb2-a6f0-80647ab4ff22 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:53.748872 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b57669da-452c-4fb2-a6f0-80647ab4ff22 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:53.749648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b57669da-452c-4fb2-a6f0-80647ab4ff22 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:53.750173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b57669da-452c-4fb2-a6f0-80647ab4ff22 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:53.750689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b57669da-452c-4fb2-a6f0-80647ab4ff22 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:53.854889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eab5299a-53aa-45c6-853b-a62ddfb8f291 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:53.858629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eab5299a-53aa-45c6-853b-a62ddfb8f291 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:53.861895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eab5299a-53aa-45c6-853b-a62ddfb8f291 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:53.865902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eab5299a-53aa-45c6-853b-a62ddfb8f291 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:53.867606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eab5299a-53aa-45c6-853b-a62ddfb8f291 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:53.870611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eab5299a-53aa-45c6-853b-a62ddfb8f291 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:54.093529 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eab5299a-53aa-45c6-853b-a62ddfb8f291 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/17177ff8c59449a0ab52f49af8711245?user_id=c7999b10881842f2a14b59f954b4393f" status: 200 len: 148 microversion: 2.57 time: 0.497758 Sep 07 12:40:54.101068 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1185/2413] 10.222.0.16 () {62 vars in 1384 bytes} [Wed Sep 7 12:40:53 2022] PUT /compute/v2.1/os-quota-sets/17177ff8c59449a0ab52f49af8711245?user_id=c7999b10881842f2a14b59f954b4393f => generated 148 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:40:54.160088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e19161a7-ee5c-492b-847f-5f3cbb5b84b9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:54.161694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e19161a7-ee5c-492b-847f-5f3cbb5b84b9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:54.178467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e19161a7-ee5c-492b-847f-5f3cbb5b84b9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:54.179955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e19161a7-ee5c-492b-847f-5f3cbb5b84b9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:54.180815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e19161a7-ee5c-492b-847f-5f3cbb5b84b9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:54.181893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e19161a7-ee5c-492b-847f-5f3cbb5b84b9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:54.182756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e19161a7-ee5c-492b-847f-5f3cbb5b84b9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:54.183404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e19161a7-ee5c-492b-847f-5f3cbb5b84b9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:54.827337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b57669da-452c-4fb2-a6f0-80647ab4ff22 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:54.845672 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b57669da-452c-4fb2-a6f0-80647ab4ff22 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1502 microversion: 2.1 time: 1.132495 Sep 07 12:40:54.846754 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1229/2414] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:53 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1502 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:54.872068 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ffc07de6-196a-4808-a96d-0d73ed540e89 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] Calling method '.version_select at 0x7fc418804700>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:55.019492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e19161a7-ee5c-492b-847f-5f3cbb5b84b9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f493fa6856847b4ae7cc8eb997a14c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b06047717c4a5ca47ebc72587256fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:55.029719 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e19161a7-ee5c-492b-847f-5f3cbb5b84b9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce" status: 200 len: 1317 microversion: 2.1 time: 0.926728 Sep 07 12:40:55.031698 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1186/2415] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:54 2022] GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce => generated 1317 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:55.038244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-662902e0-9807-4d48-940d-8345badd0cd0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:55.039399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-662902e0-9807-4d48-940d-8345badd0cd0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: aa6c3482-9f8e-41a7-8bec-32d428a3ce52] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:55.047554 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-662902e0-9807-4d48-940d-8345badd0cd0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:55.048947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-662902e0-9807-4d48-940d-8345badd0cd0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:55.049917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-662902e0-9807-4d48-940d-8345badd0cd0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:55.051203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-662902e0-9807-4d48-940d-8345badd0cd0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:55.052697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-662902e0-9807-4d48-940d-8345badd0cd0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:55.053564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-662902e0-9807-4d48-940d-8345badd0cd0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:55.116897 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ffc07de6-196a-4808-a96d-0d73ed540e89 tempest-QuotasAdminTestV257-921822801 tempest-QuotasAdminTestV257-921822801-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/17177ff8c59449a0ab52f49af8711245?user_id=c7999b10881842f2a14b59f954b4393f" status: 200 len: 190 microversion: 2.57 time: 0.249874 Sep 07 12:40:55.121842 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1230/2416] 10.222.0.16 () {60 vars in 1364 bytes} [Wed Sep 7 12:40:54 2022] GET /compute/v2.1/os-quota-sets/17177ff8c59449a0ab52f49af8711245?user_id=c7999b10881842f2a14b59f954b4393f => generated 190 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:40:55.136178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a4513549-fd4f-47f0-8b2e-fb0384713817 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:55.137171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a4513549-fd4f-47f0-8b2e-fb0384713817 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] [instance: b713d625-5bb0-4562-916a-b9060c88a6d1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:55.163619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4513549-fd4f-47f0-8b2e-fb0384713817 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:55.164193 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4513549-fd4f-47f0-8b2e-fb0384713817 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:55.166427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4513549-fd4f-47f0-8b2e-fb0384713817 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:55.169112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4513549-fd4f-47f0-8b2e-fb0384713817 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:55.170042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4513549-fd4f-47f0-8b2e-fb0384713817 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:55.170673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4513549-fd4f-47f0-8b2e-fb0384713817 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:55.719552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-662902e0-9807-4d48-940d-8345badd0cd0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:55.739592 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-662902e0-9807-4d48-940d-8345badd0cd0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52" status: 200 len: 1319 microversion: 2.1 time: 0.705777 Sep 07 12:40:55.762547 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1187/2417] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:55 2022] GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52 => generated 1319 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:55.770093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-74e65f01-c0cb-4584-a045-afd88ffe91c0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:55.770639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-74e65f01-c0cb-4584-a045-afd88ffe91c0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:55.782520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74e65f01-c0cb-4584-a045-afd88ffe91c0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:55.783326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74e65f01-c0cb-4584-a045-afd88ffe91c0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:55.783963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74e65f01-c0cb-4584-a045-afd88ffe91c0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:55.785207 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74e65f01-c0cb-4584-a045-afd88ffe91c0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:55.785916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74e65f01-c0cb-4584-a045-afd88ffe91c0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:55.786648 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74e65f01-c0cb-4584-a045-afd88ffe91c0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:55.829203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-74e65f01-c0cb-4584-a045-afd88ffe91c0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lazy-loading 'flavor' on Instance uuid 9b8d74fd-0b94-465e-a644-a44170def51c {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:40:55.842649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a4513549-fd4f-47f0-8b2e-fb0384713817 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017965094f7d482686f7617e0835b7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a9377ba32c4732912a4fcd0a6daa08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:55.870147 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a4513549-fd4f-47f0-8b2e-fb0384713817 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] 10.222.0.16 "GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1" status: 200 len: 1509 microversion: 2.1 time: 0.746215 Sep 07 12:40:55.904861 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1231/2418] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:55 2022] GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1 => generated 1509 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:56.267808 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-74e65f01-c0cb-4584-a045-afd88ffe91c0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "POST /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c/action" status: 202 len: 0 microversion: 2.1 time: 0.499101 Sep 07 12:40:56.271087 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1188/2419] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:40:55 2022] POST /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:40:56.293726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7daeced4-c5ec-4384-946f-5abd9427cc80 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:56.299896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7daeced4-c5ec-4384-946f-5abd9427cc80 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:56.355331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7daeced4-c5ec-4384-946f-5abd9427cc80 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:56.357720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7daeced4-c5ec-4384-946f-5abd9427cc80 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:56.360178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7daeced4-c5ec-4384-946f-5abd9427cc80 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:56.368313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7daeced4-c5ec-4384-946f-5abd9427cc80 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:56.369955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7daeced4-c5ec-4384-946f-5abd9427cc80 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:56.371068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7daeced4-c5ec-4384-946f-5abd9427cc80 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:56.379334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d914cc21-822c-4c0d-9c4f-766f1a1c6a07 tempest-FloatingIPDetailsNegativeTestJSON-1703365911 tempest-FloatingIPDetailsNegativeTestJSON-1703365911-project] Calling method '.version_select at 0x7fc41d1f1160>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:56.522810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG neutronclient.v2_0.client [None req-d914cc21-822c-4c0d-9c4f-766f1a1c6a07 tempest-FloatingIPDetailsNegativeTestJSON-1703365911 tempest-FloatingIPDetailsNegativeTestJSON-1703365911-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a2cda968-3c66-4fe2-86e5-0e7dadc23d20 could not be found", "detail": ""}} {{(pid=122432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 12:40:56.525986 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-d914cc21-822c-4c0d-9c4f-766f1a1c6a07 tempest-FloatingIPDetailsNegativeTestJSON-1703365911 tempest-FloatingIPDetailsNegativeTestJSON-1703365911-project] HTTP exception thrown: Floating IP not found for ID a2cda968-3c66-4fe2-86e5-0e7dadc23d20 Sep 07 12:40:56.531875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d914cc21-822c-4c0d-9c4f-766f1a1c6a07 tempest-FloatingIPDetailsNegativeTestJSON-1703365911 tempest-FloatingIPDetailsNegativeTestJSON-1703365911-project] Request method failure captured: Sep 07 12:40:56.531875 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-floating-ips/a2cda968-3c66-4fe2-86e5-0e7dadc23d20 HTTP/1.1 Sep 07 12:40:56.531875 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:40:56.531875 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:40:56.531875 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:40:56.531875 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:40:56.531875 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:40:56.531875 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:40:56.531875 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:40:56.531875 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:40:56.531875 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJFXJh9aaOo-4x3THvBk_o47o_FqB5tCcy7rtHcWWkbEPuMBSwTK3nVh_nPtecgsFHVrMOh2R0lPzowyDlcDREEsbYw83cgT8mEvg70SpuXPlTVpovXL_y3TsaoydGEGRCTwqTJvV-nbjzFY81vFt1o0_CZCbrkpQL7ObWLZ1TQOmWI Sep 07 12:40:56.531875 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:40:56.531875 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:40:56.531875 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:40:56.531875 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:40:56.531875 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:40:56.531875 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:40:56.531875 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 23c82c9746b54889920c6b39cda7fd82 Sep 07 12:40:56.531875 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1703365911 Sep 07 12:40:56.531875 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:40:56.531875 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:40:56.535520 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/23c82c9746b54889920c6b39cda7fd82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_23c82c9746b54889920c6b39cda7fd82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/23c82c9746b54889920c6b39cda7fd82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/23c82c9746b54889920c6b39cda7fd82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:40:56.535520 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1703365911 Sep 07 12:40:56.535520 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 23c82c9746b54889920c6b39cda7fd82 Sep 07 12:40:56.535520 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1703365911 Sep 07 12:40:56.535520 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1703365911-project Sep 07 12:40:56.535520 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:40:56.535520 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:40:56.535520 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 933b063913fb4fc5bb17cb1f8946fb25 Sep 07 12:40:56.535520 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1703365911-project Sep 07 12:40:56.535520 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:40:56.535520 n-d-852087-9 devstack@n-api.service[122432]: exception: Floating IP not found for ID a2cda968-3c66-4fe2-86e5-0e7dadc23d20 Sep 07 12:40:56.535520 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'a2cda968-3c66-4fe2-86e5-0e7dadc23d20'} Sep 07 12:40:56.537261 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:40:56.537261 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:56.537261 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 07 12:40:56.537261 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 07 12:40:56.537261 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:40:56.537261 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:40:56.537261 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 07 12:40:56.537261 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 07 12:40:56.537261 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:40:56.537261 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:40:56.537261 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 12:40:56.537261 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 12:40:56.537261 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:40:56.537261 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:40:56.537261 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 12:40:56.537261 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 12:40:56.537261 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:40:56.537261 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:40:56.537261 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 12:40:56.539563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 12:40:56.539563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:40:56.539563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:40:56.539563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 12:40:56.539563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 12:40:56.539563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 12:40:56.539563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 12:40:56.539563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a2cda968-3c66-4fe2-86e5-0e7dadc23d20 could not be found Sep 07 12:40:56.539563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-89e6b894-0f61-44c2-a9f9-787a86c19335'] Sep 07 12:40:56.539563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:56.539563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:56.539563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:56.539563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:56.539563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 07 12:40:56.539563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 07 12:40:56.539563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 07 12:40:56.539563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 07 12:40:56.539563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a2cda968-3c66-4fe2-86e5-0e7dadc23d20. Sep 07 12:40:56.539563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:56.542886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:56.542886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:56.542886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:56.542886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:56.542886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:56.542886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:40:56.542886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:40:56.542886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:40:56.542886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:40:56.542886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:40:56.542886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:40:56.542886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 07 12:40:56.542886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 07 12:40:56.542886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a2cda968-3c66-4fe2-86e5-0e7dadc23d20 Sep 07 12:40:56.542886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:56.542886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:56.542886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:56.542886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:56.542886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:56.542886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:56.542886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:40:56.555429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:40:56.555429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a2cda968-3c66-4fe2-86e5-0e7dadc23d20 Sep 07 12:40:56.555429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:40:56.567731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d914cc21-822c-4c0d-9c4f-766f1a1c6a07 tempest-FloatingIPDetailsNegativeTestJSON-1703365911 tempest-FloatingIPDetailsNegativeTestJSON-1703365911-project] Returning 404 to user: Floating IP not found for ID a2cda968-3c66-4fe2-86e5-0e7dadc23d20 {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:40:56.570020 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d914cc21-822c-4c0d-9c4f-766f1a1c6a07 tempest-FloatingIPDetailsNegativeTestJSON-1703365911 tempest-FloatingIPDetailsNegativeTestJSON-1703365911-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/a2cda968-3c66-4fe2-86e5-0e7dadc23d20" status: 404 len: 111 microversion: 2.1 time: 0.661813 Sep 07 12:40:56.574893 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1232/2420] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Sep 7 12:40:55 2022] GET /compute/v2.1/os-floating-ips/a2cda968-3c66-4fe2-86e5-0e7dadc23d20 => generated 111 bytes in 669 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:40:56.607767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3ec763d0-3f9c-4a99-8876-a13812d75221 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:56.611383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3ec763d0-3f9c-4a99-8876-a13812d75221 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:56.664445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ec763d0-3f9c-4a99-8876-a13812d75221 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:56.670060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ec763d0-3f9c-4a99-8876-a13812d75221 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:56.671965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ec763d0-3f9c-4a99-8876-a13812d75221 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:56.674805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ec763d0-3f9c-4a99-8876-a13812d75221 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:56.675970 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ec763d0-3f9c-4a99-8876-a13812d75221 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:56.676946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ec763d0-3f9c-4a99-8876-a13812d75221 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:56.947284 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7daeced4-c5ec-4384-946f-5abd9427cc80 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f493fa6856847b4ae7cc8eb997a14c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b06047717c4a5ca47ebc72587256fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:56.990871 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7daeced4-c5ec-4384-946f-5abd9427cc80 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce" status: 200 len: 1466 microversion: 2.1 time: 0.714628 Sep 07 12:40:56.991571 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1189/2421] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:56 2022] GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce => generated 1466 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:57.021080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-ddabdf30-8f39-46d6-97c6-8645ba61a151 req-7464a380-b3b8-466d-a1c9-5674e4f1887a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b713d625-5bb0-4562-916a-b9060c88a6d1", "name": "network-vif-deleted", "tag": "d7d0e6f6-b543-4403-813b-81db4758be6b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:57.052346 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ddabdf30-8f39-46d6-97c6-8645ba61a151 req-7464a380-b3b8-466d-a1c9-5674e4f1887a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:57.052861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ddabdf30-8f39-46d6-97c6-8645ba61a151 req-7464a380-b3b8-466d-a1c9-5674e4f1887a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:57.053317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ddabdf30-8f39-46d6-97c6-8645ba61a151 req-7464a380-b3b8-466d-a1c9-5674e4f1887a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:57.087454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3ec763d0-3f9c-4a99-8876-a13812d75221 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:57.110235 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3ec763d0-3f9c-4a99-8876-a13812d75221 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1508 microversion: 2.1 time: 0.526700 Sep 07 12:40:57.112370 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ddabdf30-8f39-46d6-97c6-8645ba61a151 req-7464a380-b3b8-466d-a1c9-5674e4f1887a service nova] Creating event network-vif-deleted:d7d0e6f6-b543-4403-813b-81db4758be6b for instance b713d625-5bb0-4562-916a-b9060c88a6d1 on n-h2-852087-9 Sep 07 12:40:57.122318 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1233/2422] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:56 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1508 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:57.134858 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-ddabdf30-8f39-46d6-97c6-8645ba61a151 req-7464a380-b3b8-466d-a1c9-5674e4f1887a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137754 Sep 07 12:40:57.135344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea9dabb8-b2db-4c2a-8c7e-01f3526fb2ba tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:57.137062 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1190/2423] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:40:57.137709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ea9dabb8-b2db-4c2a-8c7e-01f3526fb2ba tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: aa6c3482-9f8e-41a7-8bec-32d428a3ce52] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:57.155742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2114745c-e333-4fc2-9df8-196cc18b4cf4 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:57.158950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea9dabb8-b2db-4c2a-8c7e-01f3526fb2ba tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:57.159313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea9dabb8-b2db-4c2a-8c7e-01f3526fb2ba tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:57.159834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2114745c-e333-4fc2-9df8-196cc18b4cf4 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] [instance: b713d625-5bb0-4562-916a-b9060c88a6d1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:57.164625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea9dabb8-b2db-4c2a-8c7e-01f3526fb2ba tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:57.165780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea9dabb8-b2db-4c2a-8c7e-01f3526fb2ba tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:57.172121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea9dabb8-b2db-4c2a-8c7e-01f3526fb2ba tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:57.174216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea9dabb8-b2db-4c2a-8c7e-01f3526fb2ba tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:57.182813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2114745c-e333-4fc2-9df8-196cc18b4cf4 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:57.183353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2114745c-e333-4fc2-9df8-196cc18b4cf4 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:57.183817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2114745c-e333-4fc2-9df8-196cc18b4cf4 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:57.184628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2114745c-e333-4fc2-9df8-196cc18b4cf4 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:57.185117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2114745c-e333-4fc2-9df8-196cc18b4cf4 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:57.185613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2114745c-e333-4fc2-9df8-196cc18b4cf4 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:57.374136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2114745c-e333-4fc2-9df8-196cc18b4cf4 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017965094f7d482686f7617e0835b7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a9377ba32c4732912a4fcd0a6daa08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:57.420985 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2114745c-e333-4fc2-9df8-196cc18b4cf4 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] 10.222.0.16 "GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1" status: 200 len: 1467 microversion: 2.1 time: 0.281442 Sep 07 12:40:57.422020 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1191/2424] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:57 2022] GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1 => generated 1467 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:57.427677 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-89e9e20b-b068-4ed8-825a-e40153b5ddce tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-99459105", "metadata": {"image_type": "test"}}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:57.437232 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-89e9e20b-b068-4ed8-825a-e40153b5ddce tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:57.448608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89e9e20b-b068-4ed8-825a-e40153b5ddce tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:57.452096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89e9e20b-b068-4ed8-825a-e40153b5ddce tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:57.454288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89e9e20b-b068-4ed8-825a-e40153b5ddce tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:57.455443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89e9e20b-b068-4ed8-825a-e40153b5ddce tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:57.458536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89e9e20b-b068-4ed8-825a-e40153b5ddce tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:57.459346 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89e9e20b-b068-4ed8-825a-e40153b5ddce tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:57.567101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-89e9e20b-b068-4ed8-825a-e40153b5ddce tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Getting quotas for project d9b06047717c4a5ca47ebc72587256fb. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:40:57.587676 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-89e9e20b-b068-4ed8-825a-e40153b5ddce tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Getting quotas for user 6f493fa6856847b4ae7cc8eb997a14c7 and project d9b06047717c4a5ca47ebc72587256fb. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:40:57.627152 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ea9dabb8-b2db-4c2a-8c7e-01f3526fb2ba tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:57.643750 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ea9dabb8-b2db-4c2a-8c7e-01f3526fb2ba tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52" status: 200 len: 1319 microversion: 2.1 time: 0.522438 Sep 07 12:40:57.645098 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1234/2425] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:57 2022] GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52 => generated 1319 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:58.142617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5c5b46ca-c070-49de-aa07-28ee3fee293f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:58.146079 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5c5b46ca-c070-49de-aa07-28ee3fee293f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:58.171174 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-89e9e20b-b068-4ed8-825a-e40153b5ddce tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "POST /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce/action" status: 202 len: 0 microversion: 2.1 time: 0.745209 Sep 07 12:40:58.176867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c5b46ca-c070-49de-aa07-28ee3fee293f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:58.178063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c5b46ca-c070-49de-aa07-28ee3fee293f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:58.178735 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1192/2426] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:40:57 2022] POST /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce/action => generated 0 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 07 12:40:58.179308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c5b46ca-c070-49de-aa07-28ee3fee293f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:58.180578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c5b46ca-c070-49de-aa07-28ee3fee293f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:58.182447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c5b46ca-c070-49de-aa07-28ee3fee293f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:58.183372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c5b46ca-c070-49de-aa07-28ee3fee293f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:58.202327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a83500eb-7059-4e4c-8652-15f607fcf578 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc418c09e50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:58.339582 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a83500eb-7059-4e4c-8652-15f607fcf578 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf" status: 200 len: 1422 microversion: 2.1 time: 0.153017 Sep 07 12:40:58.342062 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1193/2427] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:40:58 2022] GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf => generated 1422 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:40:58.447257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1645a0b0-011b-48df-a125-1bb99757fa2f tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:58.448641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1645a0b0-011b-48df-a125-1bb99757fa2f tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] [instance: b713d625-5bb0-4562-916a-b9060c88a6d1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:58.470698 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1645a0b0-011b-48df-a125-1bb99757fa2f tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:58.471494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1645a0b0-011b-48df-a125-1bb99757fa2f tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:58.472280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1645a0b0-011b-48df-a125-1bb99757fa2f tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:58.481151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1645a0b0-011b-48df-a125-1bb99757fa2f tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:58.481827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1645a0b0-011b-48df-a125-1bb99757fa2f tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:58.482292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1645a0b0-011b-48df-a125-1bb99757fa2f tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:58.571889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1645a0b0-011b-48df-a125-1bb99757fa2f tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:58.572528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1645a0b0-011b-48df-a125-1bb99757fa2f tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:58.574140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1645a0b0-011b-48df-a125-1bb99757fa2f tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:58.575083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-1645a0b0-011b-48df-a125-1bb99757fa2f tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lazy-loading 'fault' on Instance uuid b713d625-5bb0-4562-916a-b9060c88a6d1 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:40:58.737121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1645a0b0-011b-48df-a125-1bb99757fa2f tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017965094f7d482686f7617e0835b7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a9377ba32c4732912a4fcd0a6daa08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:58.771200 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1645a0b0-011b-48df-a125-1bb99757fa2f tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] 10.222.0.16 "GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1" status: 200 len: 1306 microversion: 2.1 time: 0.330672 Sep 07 12:40:58.783206 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1194/2428] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:58 2022] GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1 => generated 1306 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:40:58.826152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-28c648b6-826a-4e70-af98-166c5b19dab6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:58.827222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-28c648b6-826a-4e70-af98-166c5b19dab6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: aa6c3482-9f8e-41a7-8bec-32d428a3ce52] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:58.846910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28c648b6-826a-4e70-af98-166c5b19dab6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:58.850597 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28c648b6-826a-4e70-af98-166c5b19dab6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:58.852501 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28c648b6-826a-4e70-af98-166c5b19dab6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:58.855056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28c648b6-826a-4e70-af98-166c5b19dab6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:58.856413 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28c648b6-826a-4e70-af98-166c5b19dab6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:58.857208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28c648b6-826a-4e70-af98-166c5b19dab6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:58.895907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5c5b46ca-c070-49de-aa07-28ee3fee293f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:58.924036 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5c5b46ca-c070-49de-aa07-28ee3fee293f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1508 microversion: 2.1 time: 0.778355 Sep 07 12:40:58.928325 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1235/2429] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:58 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1508 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:40:59.290717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-28c648b6-826a-4e70-af98-166c5b19dab6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:40:59.310530 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-28c648b6-826a-4e70-af98-166c5b19dab6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52" status: 200 len: 1319 microversion: 2.1 time: 0.506864 Sep 07 12:40:59.311361 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1195/2430] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:58 2022] GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52 => generated 1319 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:59.362025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-13f2f305-828a-43b4-adba-cd60e16de31c tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc41d1f1160>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:59.446471 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-13f2f305-828a-43b4-adba-cd60e16de31c tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf" status: 200 len: 1422 microversion: 2.1 time: 0.091250 Sep 07 12:40:59.448361 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1236/2431] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:40:59 2022] GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf => generated 1422 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:40:59.829701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ce32ce38-eb32-4669-b181-52cedd5138d9 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:59.830485 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ce32ce38-eb32-4669-b181-52cedd5138d9 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] [instance: b713d625-5bb0-4562-916a-b9060c88a6d1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:59.844031 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce32ce38-eb32-4669-b181-52cedd5138d9 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:59.847853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce32ce38-eb32-4669-b181-52cedd5138d9 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:59.848689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce32ce38-eb32-4669-b181-52cedd5138d9 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:59.849946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce32ce38-eb32-4669-b181-52cedd5138d9 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:40:59.852306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce32ce38-eb32-4669-b181-52cedd5138d9 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:40:59.855603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce32ce38-eb32-4669-b181-52cedd5138d9 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:40:59.908290 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-ce32ce38-eb32-4669-b181-52cedd5138d9 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] HTTP exception thrown: Instance b713d625-5bb0-4562-916a-b9060c88a6d1 could not be found. Sep 07 12:40:59.913328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ce32ce38-eb32-4669-b181-52cedd5138d9 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Request method failure captured: Sep 07 12:40:59.913328 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1 HTTP/1.1 Sep 07 12:40:59.913328 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:40:59.913328 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:40:59.913328 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:40:59.913328 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:40:59.913328 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:40:59.913328 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:40:59.913328 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:40:59.913328 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:40:59.913328 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJEwi8IAHkDx_jlgPPGJl5zav7UR_229b3K8Py7ApcDVmQlOOGgkJQwUgzQ_N9NEAbmIqIPTel05zYwlBu6ho_rBQFYa2TL5_BSm_C1Kdkf7v5pcN0crk8d7rYsfFPGdjWE1Lnw3nv7H0h2ITDviXDLbCRCuIhGXgl87q1_hWPhXkdk Sep 07 12:40:59.913328 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:40:59.913328 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:40:59.913328 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:40:59.913328 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:40:59.913328 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:40:59.913328 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:40:59.913328 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: f1a9377ba32c4732912a4fcd0a6daa08 Sep 07 12:40:59.913328 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesNegativeTestJSON-1649918667 Sep 07 12:40:59.913328 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:40:59.913328 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:40:59.914756 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:40:59.914756 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesNegativeTestJSON-1649918667 Sep 07 12:40:59.914756 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: f1a9377ba32c4732912a4fcd0a6daa08 Sep 07 12:40:59.914756 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1649918667 Sep 07 12:40:59.914756 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ImagesNegativeTestJSON-1649918667-project Sep 07 12:40:59.914756 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:40:59.914756 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:40:59.914756 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 017965094f7d482686f7617e0835b7fc Sep 07 12:40:59.914756 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesNegativeTestJSON-1649918667-project Sep 07 12:40:59.914756 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:40:59.914756 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance b713d625-5bb0-4562-916a-b9060c88a6d1 could not be found. Sep 07 12:40:59.914756 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'b713d625-5bb0-4562-916a-b9060c88a6d1'} Sep 07 12:40:59.915628 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:40:59.915628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:59.915628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:40:59.915628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:40:59.915628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:40:59.915628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:40:59.915628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:40:59.915628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:40:59.915628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:40:59.915628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:40:59.915628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b713d625-5bb0-4562-916a-b9060c88a6d1 could not be found. Sep 07 12:40:59.915628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:59.915628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:59.915628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:59.915628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:59.915628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:59.915628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:59.915628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:40:59.915628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:40:59.915628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:40:59.917603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:40:59.917603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:40:59.917603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:40:59.917603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:40:59.917603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:40:59.917603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:40:59.917603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:40:59.917603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b713d625-5bb0-4562-916a-b9060c88a6d1 could not be found. Sep 07 12:40:59.917603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:59.917603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:40:59.917603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:59.917603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:40:59.917603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:40:59.917603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:40:59.917603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:40:59.917603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:40:59.917603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b713d625-5bb0-4562-916a-b9060c88a6d1 could not be found. Sep 07 12:40:59.917603 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:40:59.920823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ce32ce38-eb32-4669-b181-52cedd5138d9 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Returning 404 to user: Instance b713d625-5bb0-4562-916a-b9060c88a6d1 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:40:59.922043 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ce32ce38-eb32-4669-b181-52cedd5138d9 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] 10.222.0.16 "GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1" status: 404 len: 111 microversion: 2.1 time: 0.097858 Sep 07 12:40:59.923342 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1196/2432] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:59 2022] GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:40:59.937986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f0698e46-2c79-48a8-aea3-880e0e974e31 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1618881672", "metadata": {"image_type": "test"}}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:40:59.962380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f0698e46-2c79-48a8-aea3-880e0e974e31 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] [instance: b713d625-5bb0-4562-916a-b9060c88a6d1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:40:59.969184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3e71ce97-a018-429b-9121-d518f2847b0b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:40:59.986731 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3e71ce97-a018-429b-9121-d518f2847b0b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:00.018619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e71ce97-a018-429b-9121-d518f2847b0b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:00.022289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0698e46-2c79-48a8-aea3-880e0e974e31 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:00.022770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e71ce97-a018-429b-9121-d518f2847b0b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:00.023799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e71ce97-a018-429b-9121-d518f2847b0b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:00.028931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0698e46-2c79-48a8-aea3-880e0e974e31 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:00.030021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0698e46-2c79-48a8-aea3-880e0e974e31 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:00.031275 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e71ce97-a018-429b-9121-d518f2847b0b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:00.032615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e71ce97-a018-429b-9121-d518f2847b0b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:00.033466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e71ce97-a018-429b-9121-d518f2847b0b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:00.034427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0698e46-2c79-48a8-aea3-880e0e974e31 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:00.038012 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0698e46-2c79-48a8-aea3-880e0e974e31 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:00.038912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0698e46-2c79-48a8-aea3-880e0e974e31 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:00.100482 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-f0698e46-2c79-48a8-aea3-880e0e974e31 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] HTTP exception thrown: Instance b713d625-5bb0-4562-916a-b9060c88a6d1 could not be found. Sep 07 12:41:00.105768 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f0698e46-2c79-48a8-aea3-880e0e974e31 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Request method failure captured: Sep 07 12:41:00.105768 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1/action HTTP/1.1 Sep 07 12:41:00.105768 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:41:00.105768 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:41:00.105768 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:41:00.105768 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 112 Sep 07 12:41:00.105768 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:41:00.105768 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:41:00.105768 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:41:00.105768 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:41:00.105768 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJEwi8IAHkDx_jlgPPGJl5zav7UR_229b3K8Py7ApcDVmQlOOGgkJQwUgzQ_N9NEAbmIqIPTel05zYwlBu6ho_rBQFYa2TL5_BSm_C1Kdkf7v5pcN0crk8d7rYsfFPGdjWE1Lnw3nv7H0h2ITDviXDLbCRCuIhGXgl87q1_hWPhXkdk Sep 07 12:41:00.105768 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:41:00.105768 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:41:00.105768 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:41:00.105768 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:41:00.105768 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:41:00.105768 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:41:00.105768 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: f1a9377ba32c4732912a4fcd0a6daa08 Sep 07 12:41:00.105768 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesNegativeTestJSON-1649918667 Sep 07 12:41:00.105768 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:41:00.105768 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:41:00.108617 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:41:00.108617 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesNegativeTestJSON-1649918667 Sep 07 12:41:00.108617 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: f1a9377ba32c4732912a4fcd0a6daa08 Sep 07 12:41:00.108617 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1649918667 Sep 07 12:41:00.108617 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ImagesNegativeTestJSON-1649918667-project Sep 07 12:41:00.108617 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:41:00.108617 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:41:00.108617 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 017965094f7d482686f7617e0835b7fc Sep 07 12:41:00.108617 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesNegativeTestJSON-1649918667-project Sep 07 12:41:00.108617 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:41:00.108617 n-d-852087-9 devstack@n-api.service[122432]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1618881672", "metadata": {"image_type": "test"}}} Sep 07 12:41:00.108617 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:41:00.111267 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance b713d625-5bb0-4562-916a-b9060c88a6d1 could not be found. Sep 07 12:41:00.111267 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'b713d625-5bb0-4562-916a-b9060c88a6d1', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1618881672', 'metadata': {'image_type': 'test'}}}} Sep 07 12:41:00.111267 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:41:00.111267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:00.111267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:41:00.111267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:41:00.111267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:41:00.111267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:41:00.111267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:41:00.111267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:41:00.111267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:41:00.111267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:41:00.111267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b713d625-5bb0-4562-916a-b9060c88a6d1 could not be found. Sep 07 12:41:00.111267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.111267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:41:00.111267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.111267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:00.111267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:41:00.111267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:41:00.113807 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:41:00.113807 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:41:00.113807 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:41:00.113807 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:41:00.113807 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:41:00.113807 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:41:00.113807 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:41:00.113807 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:41:00.113807 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 07 12:41:00.113807 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 07 12:41:00.113807 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:41:00.113807 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:41:00.113807 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:41:00.113807 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:41:00.113807 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b713d625-5bb0-4562-916a-b9060c88a6d1 could not be found. Sep 07 12:41:00.113807 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.113807 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:41:00.113807 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.113807 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:00.113807 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:41:00.119751 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:41:00.119751 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:41:00.119751 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:41:00.119751 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b713d625-5bb0-4562-916a-b9060c88a6d1 could not be found. Sep 07 12:41:00.119751 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.126202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f0698e46-2c79-48a8-aea3-880e0e974e31 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Returning 404 to user: Instance b713d625-5bb0-4562-916a-b9060c88a6d1 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:41:00.129559 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f0698e46-2c79-48a8-aea3-880e0e974e31 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] 10.222.0.16 "POST /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1/action" status: 404 len: 111 microversion: 2.1 time: 0.199328 Sep 07 12:41:00.146675 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1237/2433] 10.222.0.16 () {60 vars in 1279 bytes} [Wed Sep 7 12:40:59 2022] POST /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1/action => generated 111 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:41:00.165220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d26eb0c-b6da-45c1-b0d7-34af02dce360 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1214345178", "metadata": {"image_type": "test"}}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:00.173055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9d26eb0c-b6da-45c1-b0d7-34af02dce360 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Failed to fetch instance by id tempest-invalid-1015666323 {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 07 12:41:00.174082 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-9d26eb0c-b6da-45c1-b0d7-34af02dce360 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] HTTP exception thrown: Instance tempest-invalid-1015666323 could not be found. Sep 07 12:41:00.180170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d26eb0c-b6da-45c1-b0d7-34af02dce360 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Request method failure captured: Sep 07 12:41:00.180170 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/tempest-invalid-1015666323/action HTTP/1.1 Sep 07 12:41:00.180170 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:41:00.180170 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:41:00.180170 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:41:00.180170 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 112 Sep 07 12:41:00.180170 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:41:00.180170 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:41:00.180170 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:41:00.180170 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:41:00.180170 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJEwi8IAHkDx_jlgPPGJl5zav7UR_229b3K8Py7ApcDVmQlOOGgkJQwUgzQ_N9NEAbmIqIPTel05zYwlBu6ho_rBQFYa2TL5_BSm_C1Kdkf7v5pcN0crk8d7rYsfFPGdjWE1Lnw3nv7H0h2ITDviXDLbCRCuIhGXgl87q1_hWPhXkdk Sep 07 12:41:00.180170 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:41:00.180170 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:41:00.180170 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:41:00.180170 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:41:00.180170 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:41:00.180170 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:41:00.180170 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: f1a9377ba32c4732912a4fcd0a6daa08 Sep 07 12:41:00.180170 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesNegativeTestJSON-1649918667 Sep 07 12:41:00.180170 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:41:00.180170 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:41:00.183035 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:41:00.183035 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesNegativeTestJSON-1649918667 Sep 07 12:41:00.183035 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: f1a9377ba32c4732912a4fcd0a6daa08 Sep 07 12:41:00.183035 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1649918667 Sep 07 12:41:00.183035 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ImagesNegativeTestJSON-1649918667-project Sep 07 12:41:00.183035 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:41:00.183035 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:41:00.183035 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 017965094f7d482686f7617e0835b7fc Sep 07 12:41:00.183035 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesNegativeTestJSON-1649918667-project Sep 07 12:41:00.183035 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:41:00.183035 n-d-852087-9 devstack@n-api.service[122432]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1214345178", "metadata": {"image_type": "test"}}} Sep 07 12:41:00.183035 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:41:00.185522 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance tempest-invalid-1015666323 could not be found. Sep 07 12:41:00.185522 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'tempest-invalid-1015666323', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1214345178', 'metadata': {'image_type': 'test'}}}} Sep 07 12:41:00.185522 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:41:00.185522 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:00.185522 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:41:00.185522 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:41:00.185522 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 07 12:41:00.185522 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 07 12:41:00.185522 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1015666323 could not be found. Sep 07 12:41:00.185522 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.185522 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:41:00.185522 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.185522 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:00.185522 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:41:00.185522 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:41:00.185522 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:41:00.185522 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:41:00.185522 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:41:00.185522 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:41:00.185522 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:41:00.188045 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:41:00.188045 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:41:00.188045 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:41:00.188045 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 07 12:41:00.188045 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 07 12:41:00.188045 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:41:00.188045 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:41:00.188045 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:41:00.188045 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:41:00.188045 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1015666323 could not be found. Sep 07 12:41:00.188045 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.188045 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:41:00.188045 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.188045 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:00.188045 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:41:00.188045 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:41:00.188045 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:41:00.188045 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:41:00.188045 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1015666323 could not be found. Sep 07 12:41:00.188045 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.194093 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d26eb0c-b6da-45c1-b0d7-34af02dce360 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Returning 404 to user: Instance tempest-invalid-1015666323 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:41:00.195903 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9d26eb0c-b6da-45c1-b0d7-34af02dce360 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] 10.222.0.16 "POST /compute/v2.1/servers/tempest-invalid-1015666323/action" status: 404 len: 101 microversion: 2.1 time: 0.047203 Sep 07 12:41:00.202341 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1238/2434] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Sep 7 12:41:00 2022] POST /compute/v2.1/servers/tempest-invalid-1015666323/action => generated 101 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:41:00.226701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-634ab05d-2402-41ed-90f5-ef604f109a7a tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-933408509"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:00.240491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-634ab05d-2402-41ed-90f5-ef604f109a7a tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 07 12:41:00.243630 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-634ab05d-2402-41ed-90f5-ef604f109a7a tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 07 12:41:00.255336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-634ab05d-2402-41ed-90f5-ef604f109a7a tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Request method failure captured: Sep 07 12:41:00.255336 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 07 12:41:00.255336 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:41:00.255336 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:41:00.255336 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:41:00.255336 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 56 Sep 07 12:41:00.255336 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:41:00.255336 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:41:00.255336 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:41:00.255336 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:41:00.255336 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJEwi8IAHkDx_jlgPPGJl5zav7UR_229b3K8Py7ApcDVmQlOOGgkJQwUgzQ_N9NEAbmIqIPTel05zYwlBu6ho_rBQFYa2TL5_BSm_C1Kdkf7v5pcN0crk8d7rYsfFPGdjWE1Lnw3nv7H0h2ITDviXDLbCRCuIhGXgl87q1_hWPhXkdk Sep 07 12:41:00.255336 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:41:00.255336 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:41:00.255336 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:41:00.255336 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:41:00.255336 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:41:00.255336 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:41:00.255336 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: f1a9377ba32c4732912a4fcd0a6daa08 Sep 07 12:41:00.255336 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesNegativeTestJSON-1649918667 Sep 07 12:41:00.255336 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:41:00.255336 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:41:00.258250 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:41:00.258250 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesNegativeTestJSON-1649918667 Sep 07 12:41:00.258250 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: f1a9377ba32c4732912a4fcd0a6daa08 Sep 07 12:41:00.258250 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1649918667 Sep 07 12:41:00.258250 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ImagesNegativeTestJSON-1649918667-project Sep 07 12:41:00.258250 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:41:00.258250 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:41:00.258250 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 017965094f7d482686f7617e0835b7fc Sep 07 12:41:00.258250 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesNegativeTestJSON-1649918667-project Sep 07 12:41:00.258250 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:41:00.258250 n-d-852087-9 devstack@n-api.service[122432]: {"createImage": {"name": "tempest-test-snap-933408509"}} Sep 07 12:41:00.258250 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:41:00.258250 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 07 12:41:00.261809 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-933408509'}}} Sep 07 12:41:00.261809 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:41:00.261809 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:00.261809 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:41:00.261809 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:41:00.261809 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 07 12:41:00.261809 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 07 12:41:00.261809 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 07 12:41:00.261809 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.261809 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:41:00.261809 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.261809 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:00.261809 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:41:00.261809 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:41:00.261809 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:41:00.261809 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:41:00.261809 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:41:00.261809 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:41:00.261809 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:41:00.261809 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:41:00.265015 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:41:00.265015 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:41:00.265015 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 07 12:41:00.265015 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 07 12:41:00.265015 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:41:00.265015 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:41:00.265015 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:41:00.265015 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:41:00.265015 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 07 12:41:00.265015 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.265015 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:41:00.265015 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.265015 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:00.265015 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:41:00.265015 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:41:00.265015 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:41:00.265015 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:41:00.265015 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 07 12:41:00.265015 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.271611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-634ab05d-2402-41ed-90f5-ef604f109a7a tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:41:00.276151 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-634ab05d-2402-41ed-90f5-ef604f109a7a tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] 10.222.0.16 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.063651 Sep 07 12:41:00.278258 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1239/2435] 10.222.0.16 () {60 vars in 1275 bytes} [Wed Sep 7 12:41:00 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:41:00.305053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8a023f3b-cdf6-4700-8bdb-2582e11052e5 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1646649576"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:00.311085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8a023f3b-cdf6-4700-8bdb-2582e11052e5 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 07 12:41:00.326355 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-8a023f3b-cdf6-4700-8bdb-2582e11052e5 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 07 12:41:00.335062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8a023f3b-cdf6-4700-8bdb-2582e11052e5 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Request method failure captured: Sep 07 12:41:00.335062 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 07 12:41:00.335062 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:41:00.335062 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:41:00.335062 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:41:00.335062 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 57 Sep 07 12:41:00.335062 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:41:00.335062 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:41:00.335062 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:41:00.335062 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:41:00.335062 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJEwi8IAHkDx_jlgPPGJl5zav7UR_229b3K8Py7ApcDVmQlOOGgkJQwUgzQ_N9NEAbmIqIPTel05zYwlBu6ho_rBQFYa2TL5_BSm_C1Kdkf7v5pcN0crk8d7rYsfFPGdjWE1Lnw3nv7H0h2ITDviXDLbCRCuIhGXgl87q1_hWPhXkdk Sep 07 12:41:00.335062 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:41:00.335062 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:41:00.335062 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:41:00.335062 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:41:00.335062 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:41:00.335062 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:41:00.335062 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: f1a9377ba32c4732912a4fcd0a6daa08 Sep 07 12:41:00.335062 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesNegativeTestJSON-1649918667 Sep 07 12:41:00.335062 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:41:00.335062 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:41:00.338836 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:41:00.338836 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesNegativeTestJSON-1649918667 Sep 07 12:41:00.338836 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: f1a9377ba32c4732912a4fcd0a6daa08 Sep 07 12:41:00.338836 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1649918667 Sep 07 12:41:00.338836 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ImagesNegativeTestJSON-1649918667-project Sep 07 12:41:00.338836 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:41:00.338836 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:41:00.338836 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 017965094f7d482686f7617e0835b7fc Sep 07 12:41:00.338836 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesNegativeTestJSON-1649918667-project Sep 07 12:41:00.338836 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:41:00.338836 n-d-852087-9 devstack@n-api.service[122432]: {"createImage": {"name": "tempest-test-snap-1646649576"}} Sep 07 12:41:00.338836 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:41:00.338836 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 07 12:41:00.340170 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1646649576'}}} Sep 07 12:41:00.340170 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:41:00.340170 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:00.340170 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:41:00.340170 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:41:00.340170 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 07 12:41:00.340170 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 07 12:41:00.340170 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 07 12:41:00.340170 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.340170 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:41:00.340170 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.340170 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:00.340170 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:41:00.340170 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:41:00.340170 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:41:00.340170 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:41:00.340170 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:41:00.340170 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:41:00.340170 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:41:00.340170 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:41:00.342229 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:41:00.342229 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:41:00.342229 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 07 12:41:00.342229 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 07 12:41:00.342229 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:41:00.342229 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:41:00.342229 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:41:00.342229 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:41:00.342229 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 07 12:41:00.342229 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.342229 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:41:00.342229 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.342229 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:00.342229 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:41:00.342229 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:41:00.342229 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:41:00.342229 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:41:00.342229 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 07 12:41:00.342229 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.349994 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8a023f3b-cdf6-4700-8bdb-2582e11052e5 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:41:00.357057 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8a023f3b-cdf6-4700-8bdb-2582e11052e5 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] 10.222.0.16 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.065719 Sep 07 12:41:00.360742 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1240/2436] 10.222.0.16 () {60 vars in 1281 bytes} [Wed Sep 7 12:41:00 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:41:00.387223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9bf9d2ee-dfe8-41e7-a4c5-17f07bf6ceaf tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:00.394128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9bf9d2ee-dfe8-41e7-a4c5-17f07bf6ceaf tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: aa6c3482-9f8e-41a7-8bec-32d428a3ce52] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:00.426692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9bf9d2ee-dfe8-41e7-a4c5-17f07bf6ceaf tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:00.428106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9bf9d2ee-dfe8-41e7-a4c5-17f07bf6ceaf tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:00.429399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9bf9d2ee-dfe8-41e7-a4c5-17f07bf6ceaf tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:00.433566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9bf9d2ee-dfe8-41e7-a4c5-17f07bf6ceaf tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:00.436228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9bf9d2ee-dfe8-41e7-a4c5-17f07bf6ceaf tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:00.437651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9bf9d2ee-dfe8-41e7-a4c5-17f07bf6ceaf tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:00.438523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3e71ce97-a018-429b-9121-d518f2847b0b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:00.451561 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3e71ce97-a018-429b-9121-d518f2847b0b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1508 microversion: 2.1 time: 0.499441 Sep 07 12:41:00.472748 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1197/2437] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:40:59 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1508 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:00.485748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0b6c368c-b7b1-4f30-91c0-62724a07f6a8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:00.486588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0b6c368c-b7b1-4f30-91c0-62724a07f6a8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] [instance: b713d625-5bb0-4562-916a-b9060c88a6d1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:00.493960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b6c368c-b7b1-4f30-91c0-62724a07f6a8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:00.500175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b6c368c-b7b1-4f30-91c0-62724a07f6a8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:00.500926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b6c368c-b7b1-4f30-91c0-62724a07f6a8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:00.502025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b6c368c-b7b1-4f30-91c0-62724a07f6a8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:00.502727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b6c368c-b7b1-4f30-91c0-62724a07f6a8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:00.503405 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b6c368c-b7b1-4f30-91c0-62724a07f6a8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:00.545772 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-0b6c368c-b7b1-4f30-91c0-62724a07f6a8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] HTTP exception thrown: Instance b713d625-5bb0-4562-916a-b9060c88a6d1 could not be found. Sep 07 12:41:00.547600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0b6c368c-b7b1-4f30-91c0-62724a07f6a8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Request method failure captured: Sep 07 12:41:00.547600 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1 HTTP/1.1 Sep 07 12:41:00.547600 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:41:00.547600 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:41:00.547600 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:41:00.547600 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:41:00.547600 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:41:00.547600 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:41:00.547600 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:41:00.547600 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:41:00.547600 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJEwi8IAHkDx_jlgPPGJl5zav7UR_229b3K8Py7ApcDVmQlOOGgkJQwUgzQ_N9NEAbmIqIPTel05zYwlBu6ho_rBQFYa2TL5_BSm_C1Kdkf7v5pcN0crk8d7rYsfFPGdjWE1Lnw3nv7H0h2ITDviXDLbCRCuIhGXgl87q1_hWPhXkdk Sep 07 12:41:00.547600 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:41:00.547600 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:41:00.547600 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:41:00.547600 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:41:00.547600 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:41:00.547600 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:41:00.547600 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: f1a9377ba32c4732912a4fcd0a6daa08 Sep 07 12:41:00.547600 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesNegativeTestJSON-1649918667 Sep 07 12:41:00.547600 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:41:00.547600 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:41:00.550197 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:41:00.550197 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesNegativeTestJSON-1649918667 Sep 07 12:41:00.550197 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: f1a9377ba32c4732912a4fcd0a6daa08 Sep 07 12:41:00.550197 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1649918667 Sep 07 12:41:00.550197 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ImagesNegativeTestJSON-1649918667-project Sep 07 12:41:00.550197 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:41:00.550197 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:41:00.550197 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 017965094f7d482686f7617e0835b7fc Sep 07 12:41:00.550197 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesNegativeTestJSON-1649918667-project Sep 07 12:41:00.550197 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:41:00.550197 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance b713d625-5bb0-4562-916a-b9060c88a6d1 could not be found. Sep 07 12:41:00.550197 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'b713d625-5bb0-4562-916a-b9060c88a6d1'} Sep 07 12:41:00.551464 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:41:00.551464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:00.551464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:41:00.551464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:41:00.551464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:41:00.551464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:41:00.551464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:41:00.551464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:41:00.551464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:41:00.551464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:41:00.551464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b713d625-5bb0-4562-916a-b9060c88a6d1 could not be found. Sep 07 12:41:00.551464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.551464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:41:00.551464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.551464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:00.551464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:41:00.551464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:41:00.551464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:41:00.551464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:41:00.551464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:41:00.553920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:41:00.553920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:41:00.553920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:41:00.553920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:41:00.553920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:41:00.553920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:41:00.553920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:41:00.553920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:41:00.553920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:41:00.553920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b713d625-5bb0-4562-916a-b9060c88a6d1 could not be found. Sep 07 12:41:00.553920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.553920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:41:00.553920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.553920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:00.553920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:41:00.553920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:41:00.553920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:41:00.553920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:41:00.553920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b713d625-5bb0-4562-916a-b9060c88a6d1 could not be found. Sep 07 12:41:00.553920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.558367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0b6c368c-b7b1-4f30-91c0-62724a07f6a8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Returning 404 to user: Instance b713d625-5bb0-4562-916a-b9060c88a6d1 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:41:00.558367 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0b6c368c-b7b1-4f30-91c0-62724a07f6a8 tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1" status: 404 len: 111 microversion: 2.1 time: 0.075372 Sep 07 12:41:00.558367 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1198/2438] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:41:00 2022] DELETE /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:41:00.567695 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c2d84f6b-4cbe-4400-91e8-cb83fbba09d0 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc418d43670>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:00.636912 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c2d84f6b-4cbe-4400-91e8-cb83fbba09d0 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf" status: 200 len: 1422 microversion: 2.1 time: 0.085905 Sep 07 12:41:00.641316 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1199/2439] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:41:00 2022] GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf => generated 1422 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:00.663234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-af951b75-b87c-4cfe-a587-f46d50f3f3da tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:00.664455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-af951b75-b87c-4cfe-a587-f46d50f3f3da tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] [instance: b713d625-5bb0-4562-916a-b9060c88a6d1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:00.682164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af951b75-b87c-4cfe-a587-f46d50f3f3da tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:00.686330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af951b75-b87c-4cfe-a587-f46d50f3f3da tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:00.688768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af951b75-b87c-4cfe-a587-f46d50f3f3da tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:00.689939 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af951b75-b87c-4cfe-a587-f46d50f3f3da tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:00.694421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af951b75-b87c-4cfe-a587-f46d50f3f3da tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:00.695426 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af951b75-b87c-4cfe-a587-f46d50f3f3da tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:00.729435 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-af951b75-b87c-4cfe-a587-f46d50f3f3da tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] HTTP exception thrown: Instance b713d625-5bb0-4562-916a-b9060c88a6d1 could not be found. Sep 07 12:41:00.738674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-af951b75-b87c-4cfe-a587-f46d50f3f3da tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Request method failure captured: Sep 07 12:41:00.738674 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1 HTTP/1.1 Sep 07 12:41:00.738674 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:41:00.738674 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:41:00.738674 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:41:00.738674 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:41:00.738674 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:41:00.738674 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:41:00.738674 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:41:00.738674 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:41:00.738674 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJEwi8IAHkDx_jlgPPGJl5zav7UR_229b3K8Py7ApcDVmQlOOGgkJQwUgzQ_N9NEAbmIqIPTel05zYwlBu6ho_rBQFYa2TL5_BSm_C1Kdkf7v5pcN0crk8d7rYsfFPGdjWE1Lnw3nv7H0h2ITDviXDLbCRCuIhGXgl87q1_hWPhXkdk Sep 07 12:41:00.738674 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:41:00.738674 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:41:00.738674 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:41:00.738674 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:41:00.738674 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:41:00.738674 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:41:00.738674 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: f1a9377ba32c4732912a4fcd0a6daa08 Sep 07 12:41:00.738674 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesNegativeTestJSON-1649918667 Sep 07 12:41:00.738674 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:41:00.738674 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:41:00.739937 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f1a9377ba32c4732912a4fcd0a6daa08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:41:00.739937 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesNegativeTestJSON-1649918667 Sep 07 12:41:00.739937 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: f1a9377ba32c4732912a4fcd0a6daa08 Sep 07 12:41:00.739937 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1649918667 Sep 07 12:41:00.739937 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ImagesNegativeTestJSON-1649918667-project Sep 07 12:41:00.739937 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:41:00.739937 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:41:00.739937 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 017965094f7d482686f7617e0835b7fc Sep 07 12:41:00.739937 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesNegativeTestJSON-1649918667-project Sep 07 12:41:00.739937 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:41:00.739937 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance b713d625-5bb0-4562-916a-b9060c88a6d1 could not be found. Sep 07 12:41:00.739937 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'b713d625-5bb0-4562-916a-b9060c88a6d1'} Sep 07 12:41:00.740574 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:41:00.740574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:00.740574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:41:00.740574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:41:00.740574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:41:00.740574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:41:00.740574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:41:00.740574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:41:00.740574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:41:00.740574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:41:00.740574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b713d625-5bb0-4562-916a-b9060c88a6d1 could not be found. Sep 07 12:41:00.740574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.740574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:41:00.740574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.740574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:00.740574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:41:00.740574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:41:00.740574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:41:00.740574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:41:00.740574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:41:00.742250 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:41:00.742250 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:41:00.742250 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:41:00.742250 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:41:00.742250 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:41:00.742250 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:41:00.742250 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:41:00.742250 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b713d625-5bb0-4562-916a-b9060c88a6d1 could not be found. Sep 07 12:41:00.742250 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.742250 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:41:00.742250 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.742250 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:00.742250 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:41:00.742250 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:41:00.742250 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:41:00.742250 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:41:00.742250 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b713d625-5bb0-4562-916a-b9060c88a6d1 could not be found. Sep 07 12:41:00.742250 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:41:00.744974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-af951b75-b87c-4cfe-a587-f46d50f3f3da tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] Returning 404 to user: Instance b713d625-5bb0-4562-916a-b9060c88a6d1 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:41:00.747467 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-af951b75-b87c-4cfe-a587-f46d50f3f3da tempest-ImagesNegativeTestJSON-1649918667 tempest-ImagesNegativeTestJSON-1649918667-project] 10.222.0.16 "GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1" status: 404 len: 111 microversion: 2.1 time: 0.104560 Sep 07 12:41:00.752576 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1200/2440] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:00 2022] GET /compute/v2.1/servers/b713d625-5bb0-4562-916a-b9060c88a6d1 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:41:00.966247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9bf9d2ee-dfe8-41e7-a4c5-17f07bf6ceaf tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:00.985915 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9bf9d2ee-dfe8-41e7-a4c5-17f07bf6ceaf tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52" status: 200 len: 1319 microversion: 2.1 time: 0.622806 Sep 07 12:41:00.991137 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1241/2441] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:00 2022] GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52 => generated 1319 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:01.493083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5fcaae38-5499-49fb-81b0-333e8860e33f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:01.501097 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5fcaae38-5499-49fb-81b0-333e8860e33f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:01.517816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fcaae38-5499-49fb-81b0-333e8860e33f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:01.519549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fcaae38-5499-49fb-81b0-333e8860e33f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:01.522235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fcaae38-5499-49fb-81b0-333e8860e33f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:01.524273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fcaae38-5499-49fb-81b0-333e8860e33f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:01.529857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fcaae38-5499-49fb-81b0-333e8860e33f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:01.531223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fcaae38-5499-49fb-81b0-333e8860e33f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:01.546302 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:41:01.665854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-57380abc-9856-478a-abb0-678dc61f4c47 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc41854e040>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:01.811487 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-57380abc-9856-478a-abb0-678dc61f4c47 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf" status: 200 len: 1422 microversion: 2.1 time: 0.142778 Sep 07 12:41:01.826008 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1242/2442] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:41:01 2022] GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf => generated 1422 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:02.020263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-50241170-067f-498f-a1ac-c51b2e77a45a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:02.021398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-50241170-067f-498f-a1ac-c51b2e77a45a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: aa6c3482-9f8e-41a7-8bec-32d428a3ce52] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:02.069400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50241170-067f-498f-a1ac-c51b2e77a45a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:02.071146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50241170-067f-498f-a1ac-c51b2e77a45a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:02.076377 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50241170-067f-498f-a1ac-c51b2e77a45a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:02.079814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50241170-067f-498f-a1ac-c51b2e77a45a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:02.081907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50241170-067f-498f-a1ac-c51b2e77a45a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:02.096060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50241170-067f-498f-a1ac-c51b2e77a45a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:02.378214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5fcaae38-5499-49fb-81b0-333e8860e33f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:02.394739 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5fcaae38-5499-49fb-81b0-333e8860e33f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1508 microversion: 2.1 time: 0.915754 Sep 07 12:41:02.398038 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1201/2443] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:01 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1508 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:02.678521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-50241170-067f-498f-a1ac-c51b2e77a45a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:02.695096 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-50241170-067f-498f-a1ac-c51b2e77a45a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52" status: 200 len: 1319 microversion: 2.1 time: 0.676722 Sep 07 12:41:02.697458 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1243/2444] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:02 2022] GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52 => generated 1319 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:02.840019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2dbce982-6a77-496d-bdda-452643bf6c95 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc41d1b40d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:02.957815 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2dbce982-6a77-496d-bdda-452643bf6c95 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf" status: 200 len: 1422 microversion: 2.1 time: 0.119307 Sep 07 12:41:02.966714 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1202/2445] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:41:02 2022] GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf => generated 1422 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:03.442849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a0ebb2bc-0c1b-4ec7-b8c6-0969fa196814 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:03.443492 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a0ebb2bc-0c1b-4ec7-b8c6-0969fa196814 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:03.445990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:41:03.462332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0ebb2bc-0c1b-4ec7-b8c6-0969fa196814 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:03.463171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0ebb2bc-0c1b-4ec7-b8c6-0969fa196814 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:03.463984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0ebb2bc-0c1b-4ec7-b8c6-0969fa196814 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:03.464917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0ebb2bc-0c1b-4ec7-b8c6-0969fa196814 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:03.465391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0ebb2bc-0c1b-4ec7-b8c6-0969fa196814 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:03.465869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0ebb2bc-0c1b-4ec7-b8c6-0969fa196814 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:03.563371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:41:03.734184 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9e7b7997-2e46-4604-aef8-c20b5ec55dc5 tempest-TenantUsagesNegativeTestJSON-183759776 tempest-TenantUsagesNegativeTestJSON-183759776-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-06T12%3A41%3A03.548638&end=2022-09-08T12%3A41%3A03.548638" status: 404 len: 112 microversion: - time: 0.181338 Sep 07 12:41:03.742160 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1203/2446] 10.222.0.16 () {58 vars in 1316 bytes} [Wed Sep 7 12:41:03 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-06T12%3A41%3A03.548638&end=2022-09-08T12%3A41%3A03.548638 => generated 112 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 07 12:41:03.750389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e7561e36-d5c0-467a-99e8-6b04d82edfa6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:03.753114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e7561e36-d5c0-467a-99e8-6b04d82edfa6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: aa6c3482-9f8e-41a7-8bec-32d428a3ce52] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:03.761241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7561e36-d5c0-467a-99e8-6b04d82edfa6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:03.761982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7561e36-d5c0-467a-99e8-6b04d82edfa6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:03.763118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7561e36-d5c0-467a-99e8-6b04d82edfa6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:03.764274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7561e36-d5c0-467a-99e8-6b04d82edfa6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:03.765008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7561e36-d5c0-467a-99e8-6b04d82edfa6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:03.765672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7561e36-d5c0-467a-99e8-6b04d82edfa6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:03.924403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=5 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:41:04.073018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=12 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:41:04.303536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a0ebb2bc-0c1b-4ec7-b8c6-0969fa196814 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:04.318284 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a0ebb2bc-0c1b-4ec7-b8c6-0969fa196814 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1508 microversion: 2.1 time: 0.881320 Sep 07 12:41:04.320215 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1244/2447] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:03 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1508 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:04.326096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-786f7301-3495-4d23-b072-f9dbb79ac600 tempest-TenantUsagesNegativeTestJSON-183759776 tempest-TenantUsagesNegativeTestJSON-183759776-project-admin] Calling method '.version_select at 0x7fc419222430>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:04.332417 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-786f7301-3495-4d23-b072-f9dbb79ac600 tempest-TenantUsagesNegativeTestJSON-183759776 tempest-TenantUsagesNegativeTestJSON-183759776-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Sep 07 12:41:04.340856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-786f7301-3495-4d23-b072-f9dbb79ac600 tempest-TenantUsagesNegativeTestJSON-183759776 tempest-TenantUsagesNegativeTestJSON-183759776-project-admin] Request method failure captured: Sep 07 12:41:04.340856 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-simple-tenant-usage/eb453619f4fa446893a13c1803c5f0b8?start=2022-09-08T12%3A41%3A03.548638&end=2022-09-06T12%3A41%3A03.548638 HTTP/1.1 Sep 07 12:41:04.340856 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:41:04.340856 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:41:04.340856 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:41:04.340856 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:41:04.340856 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:41:04.340856 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:41:04.340856 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:41:04.340856 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:41:04.340856 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJFfPki2FRTG3UQFEUzyKTW-AGkuNr3AygZsuIjZxlOwuiQvetgpVBdWOw08zInedEjxm5tiSCSm6-UIbUpvS5CBxa9Kg08TS_tt_3gn7z2iBS5gAbvOJ2RVMJS0cbJpa0yTfu5FupedrOlYoaaTWwsUiSLcBpWQmmD3tb0wF2r2Fao Sep 07 12:41:04.340856 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:41:04.340856 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:41:04.340856 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:41:04.340856 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:41:04.340856 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:41:04.340856 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:41:04.340856 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 46715ad864e84ef9be287e699388747f Sep 07 12:41:04.340856 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-183759776 Sep 07 12:41:04.340856 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member,admin Sep 07 12:41:04.340856 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member,admin Sep 07 12:41:04.342667 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46715ad864e84ef9be287e699388747f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_46715ad864e84ef9be287e699388747f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/46715ad864e84ef9be287e699388747f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46715ad864e84ef9be287e699388747f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:41:04.342667 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-183759776 Sep 07 12:41:04.342667 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 46715ad864e84ef9be287e699388747f Sep 07 12:41:04.342667 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-183759776 Sep 07 12:41:04.342667 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TenantUsagesNegativeTestJSON-183759776-project-admin Sep 07 12:41:04.342667 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:41:04.342667 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:41:04.342667 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: ccfe6bbd052d4acfbb39972580509ced Sep 07 12:41:04.342667 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-183759776-project-admin Sep 07 12:41:04.342667 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:41:04.342667 n-d-852087-9 devstack@n-api.service[122432]: exception: Invalid start time. The start time cannot occur after the end time. Sep 07 12:41:04.342667 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'eb453619f4fa446893a13c1803c5f0b8'} Sep 07 12:41:04.343550 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:41:04.343550 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:04.343550 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:41:04.343550 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:41:04.343550 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:41:04.343550 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:41:04.343550 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:41:04.343550 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:41:04.343550 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 12:41:04.343550 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:41:04.343550 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:41:04.343550 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:41:04.343550 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Sep 07 12:41:04.343550 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 07 12:41:04.343550 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Sep 07 12:41:04.343550 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Sep 07 12:41:04.343550 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Sep 07 12:41:04.343550 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 07 12:41:04.343550 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Sep 07 12:41:04.345215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:04.345215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:41:04.345215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:04.345215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:04.345215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:41:04.345215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:41:04.345215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:41:04.345215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:41:04.345215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Sep 07 12:41:04.345215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:04.348223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-786f7301-3495-4d23-b072-f9dbb79ac600 tempest-TenantUsagesNegativeTestJSON-183759776 tempest-TenantUsagesNegativeTestJSON-183759776-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:41:04.349339 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-786f7301-3495-4d23-b072-f9dbb79ac600 tempest-TenantUsagesNegativeTestJSON-183759776 tempest-TenantUsagesNegativeTestJSON-183759776-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/eb453619f4fa446893a13c1803c5f0b8?start=2022-09-08T12%3A41%3A03.548638&end=2022-09-06T12%3A41%3A03.548638" status: 400 len: 111 microversion: 2.1 time: 0.027660 Sep 07 12:41:04.350406 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1245/2448] 10.222.0.16 () {58 vars in 1412 bytes} [Wed Sep 7 12:41:04 2022] GET /compute/v2.1/os-simple-tenant-usage/eb453619f4fa446893a13c1803c5f0b8?start=2022-09-08T12%3A41%3A03.548638&end=2022-09-06T12%3A41%3A03.548638 => generated 111 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:41:04.364990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9f8d2ea2-c64a-42b4-a035-65d5df856814 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc4185583a0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:04.371984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e7561e36-d5c0-467a-99e8-6b04d82edfa6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:04.390043 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e7561e36-d5c0-467a-99e8-6b04d82edfa6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52" status: 200 len: 1319 microversion: 2.1 time: 0.645574 Sep 07 12:41:04.391700 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1204/2449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:03 2022] GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52 => generated 1319 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:04.465732 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9f8d2ea2-c64a-42b4-a035-65d5df856814 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf" status: 200 len: 1422 microversion: 2.1 time: 0.107832 Sep 07 12:41:04.468713 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1246/2450] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:41:04 2022] GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf => generated 1422 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:04.496780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-5f27307b-ecaa-45c5-8919-2b4f2065f79e req-f5de59b0-32e3-4b7a-8879-10d34135ebf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa6c3482-9f8e-41a7-8bec-32d428a3ce52", "name": "network-vif-plugged", "status": "completed", "tag": "5d83a858-3dea-4c83-8d38-a1fe466b187d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:04.521348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5f27307b-ecaa-45c5-8919-2b4f2065f79e req-f5de59b0-32e3-4b7a-8879-10d34135ebf8 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:04.535516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5f27307b-ecaa-45c5-8919-2b4f2065f79e req-f5de59b0-32e3-4b7a-8879-10d34135ebf8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:04.536744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5f27307b-ecaa-45c5-8919-2b4f2065f79e req-f5de59b0-32e3-4b7a-8879-10d34135ebf8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:04.566768 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-5f27307b-ecaa-45c5-8919-2b4f2065f79e req-f5de59b0-32e3-4b7a-8879-10d34135ebf8 service nova] Creating event network-vif-plugged:5d83a858-3dea-4c83-8d38-a1fe466b187d for instance aa6c3482-9f8e-41a7-8bec-32d428a3ce52 on n-h2-852087-9 Sep 07 12:41:04.583092 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-5f27307b-ecaa-45c5-8919-2b4f2065f79e req-f5de59b0-32e3-4b7a-8879-10d34135ebf8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094792 Sep 07 12:41:04.586735 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1247/2451] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:41:04.647652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7f1b114c-4bdc-445a-aadc-13840e35ac96 tempest-TenantUsagesNegativeTestJSON-795184130 tempest-TenantUsagesNegativeTestJSON-795184130-project] Calling method '.version_select at 0x7fc41d22d3a0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:04.653581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7f1b114c-4bdc-445a-aadc-13840e35ac96 tempest-TenantUsagesNegativeTestJSON-795184130 tempest-TenantUsagesNegativeTestJSON-795184130-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '1c8a9138310d444db49b7c74a16e5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb453619f4fa446893a13c1803c5f0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:04.656108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7f1b114c-4bdc-445a-aadc-13840e35ac96 tempest-TenantUsagesNegativeTestJSON-795184130 tempest-TenantUsagesNegativeTestJSON-795184130-project] Request method failure captured: Sep 07 12:41:04.656108 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-06T12%3A41%3A03.548638&end=2022-09-08T12%3A41%3A03.548638&detailed=1 HTTP/1.1 Sep 07 12:41:04.656108 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:41:04.656108 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:41:04.656108 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:41:04.656108 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:41:04.656108 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:41:04.656108 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:41:04.656108 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:41:04.656108 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:41:04.656108 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJFd630M-jC_-enqPqKqD57VUDJKMjgROWbS8gHAhOhpdElxpPuuHnvYjM8HkZ6U7pzWoQHDmNIxaglmvVV_Sd4CD84-PJ1Ckq42lxFbDZJlUiJ_zHVY22jl4OP2-JJFsKvFSuBDUvHbDd1dUhT39USofFb_dqfoKjSanLNV7vPjmW4 Sep 07 12:41:04.656108 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:41:04.656108 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:41:04.656108 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:41:04.656108 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:41:04.656108 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:41:04.656108 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:41:04.656108 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: eb453619f4fa446893a13c1803c5f0b8 Sep 07 12:41:04.656108 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-795184130 Sep 07 12:41:04.656108 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:41:04.656108 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:41:04.658102 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eb453619f4fa446893a13c1803c5f0b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eb453619f4fa446893a13c1803c5f0b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eb453619f4fa446893a13c1803c5f0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eb453619f4fa446893a13c1803c5f0b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:41:04.658102 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-795184130 Sep 07 12:41:04.658102 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: eb453619f4fa446893a13c1803c5f0b8 Sep 07 12:41:04.658102 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-795184130 Sep 07 12:41:04.658102 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TenantUsagesNegativeTestJSON-795184130-project Sep 07 12:41:04.658102 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:41:04.658102 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:41:04.658102 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 1c8a9138310d444db49b7c74a16e5211 Sep 07 12:41:04.658102 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-795184130-project Sep 07 12:41:04.658102 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:41:04.658102 n-d-852087-9 devstack@n-api.service[122433]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 07 12:41:04.658102 n-d-852087-9 devstack@n-api.service[122433]: action_args: {} Sep 07 12:41:04.658102 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:41:04.658892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:04.658892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:41:04.658892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:41:04.658892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:41:04.658892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:41:04.658892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:41:04.658892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:41:04.658892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 12:41:04.658892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:41:04.658892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:41:04.658892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:41:04.658892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Sep 07 12:41:04.658892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 07 12:41:04.658892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Sep 07 12:41:04.658892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Sep 07 12:41:04.658892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 07 12:41:04.658892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 07 12:41:04.658892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 07 12:41:04.658892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 07 12:41:04.660841 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:41:04.660841 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:41:04.660841 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:41:04.660841 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:41:04.660841 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 07 12:41:04.660841 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 07 12:41:04.660841 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 07 12:41:04.660841 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 07 12:41:04.660841 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 07 12:41:04.660841 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 07 12:41:04.660841 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 07 12:41:04.660841 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:41:04.660841 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:41:04.660841 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:41:04.660841 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:04.660841 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:41:04.660841 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:41:04.660841 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 07 12:41:04.660841 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 07 12:41:04.662035 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 07 12:41:04.662035 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:41:04.662035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7f1b114c-4bdc-445a-aadc-13840e35ac96 tempest-TenantUsagesNegativeTestJSON-795184130 tempest-TenantUsagesNegativeTestJSON-795184130-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:41:04.662035 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7f1b114c-4bdc-445a-aadc-13840e35ac96 tempest-TenantUsagesNegativeTestJSON-795184130 tempest-TenantUsagesNegativeTestJSON-795184130-project] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-06T12%3A41%3A03.548638&end=2022-09-08T12%3A41%3A03.548638&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.264456 Sep 07 12:41:04.662035 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1205/2452] 10.222.0.16 () {58 vars in 1335 bytes} [Wed Sep 7 12:41:04 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-06T12%3A41%3A03.548638&end=2022-09-08T12%3A41%3A03.548638&detailed=1 => generated 123 bytes in 266 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:41:05.348947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f7609ff0-201f-4f3f-aa5d-a254de50647b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:05.350722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f7609ff0-201f-4f3f-aa5d-a254de50647b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:05.361836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=14 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:41:05.403501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f7609ff0-201f-4f3f-aa5d-a254de50647b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:05.409640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f7609ff0-201f-4f3f-aa5d-a254de50647b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:05.409640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f7609ff0-201f-4f3f-aa5d-a254de50647b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:05.411885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f7609ff0-201f-4f3f-aa5d-a254de50647b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:05.412795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f7609ff0-201f-4f3f-aa5d-a254de50647b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:05.413461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f7609ff0-201f-4f3f-aa5d-a254de50647b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:05.442071 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-417931c5-1bc8-4cd5-8c5a-768a8871b930 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:05.442864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-417931c5-1bc8-4cd5-8c5a-768a8871b930 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: aa6c3482-9f8e-41a7-8bec-32d428a3ce52] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:05.459564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-417931c5-1bc8-4cd5-8c5a-768a8871b930 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:05.460099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-417931c5-1bc8-4cd5-8c5a-768a8871b930 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:05.460724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-417931c5-1bc8-4cd5-8c5a-768a8871b930 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:05.461632 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-417931c5-1bc8-4cd5-8c5a-768a8871b930 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:05.462126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-417931c5-1bc8-4cd5-8c5a-768a8871b930 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:05.462570 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-417931c5-1bc8-4cd5-8c5a-768a8871b930 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:06.546202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-417931c5-1bc8-4cd5-8c5a-768a8871b930 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:06.564493 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-417931c5-1bc8-4cd5-8c5a-768a8871b930 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52" status: 200 len: 1319 microversion: 2.1 time: 1.127427 Sep 07 12:41:06.566042 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1206/2453] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:05 2022] GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52 => generated 1319 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:41:06.571242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e8eecb1d-1e1f-4c9a-a81b-305627811146 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc41d265670>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:06.624105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f7609ff0-201f-4f3f-aa5d-a254de50647b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:06.653524 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f7609ff0-201f-4f3f-aa5d-a254de50647b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1508 microversion: 2.1 time: 1.311927 Sep 07 12:41:06.657542 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1248/2454] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:05 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1508 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:06.693060 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e8eecb1d-1e1f-4c9a-a81b-305627811146 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf" status: 200 len: 1422 microversion: 2.1 time: 0.125569 Sep 07 12:41:06.694070 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1207/2455] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:41:06 2022] GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf => generated 1422 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:07.247711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-200ca758-15f6-47b9-b0a6-634c390782d0 req-c41bdc7f-7234-4564-93fb-bc477562cf6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "886a386f-a0cc-4d90-96ac-4e418ed43bce", "name": "network-vif-plugged", "status": "completed", "tag": "a0ca592a-191a-4417-974a-0fdc230ebb1c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:07.271282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-200ca758-15f6-47b9-b0a6-634c390782d0 req-c41bdc7f-7234-4564-93fb-bc477562cf6d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:07.271832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-200ca758-15f6-47b9-b0a6-634c390782d0 req-c41bdc7f-7234-4564-93fb-bc477562cf6d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:07.272280 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-200ca758-15f6-47b9-b0a6-634c390782d0 req-c41bdc7f-7234-4564-93fb-bc477562cf6d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:07.311658 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-200ca758-15f6-47b9-b0a6-634c390782d0 req-c41bdc7f-7234-4564-93fb-bc477562cf6d service nova] Creating event network-vif-plugged:a0ca592a-191a-4417-974a-0fdc230ebb1c for instance 886a386f-a0cc-4d90-96ac-4e418ed43bce on n-h1-852087-9 Sep 07 12:41:07.325860 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-200ca758-15f6-47b9-b0a6-634c390782d0 req-c41bdc7f-7234-4564-93fb-bc477562cf6d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081990 Sep 07 12:41:07.326748 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1249/2456] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:41:07.615518 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7b6f9ef0-9d23-41f3-bd25-ad394588c598 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:07.616998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7b6f9ef0-9d23-41f3-bd25-ad394588c598 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: aa6c3482-9f8e-41a7-8bec-32d428a3ce52] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:07.634637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b6f9ef0-9d23-41f3-bd25-ad394588c598 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:07.635637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b6f9ef0-9d23-41f3-bd25-ad394588c598 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:07.636265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b6f9ef0-9d23-41f3-bd25-ad394588c598 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:07.637217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b6f9ef0-9d23-41f3-bd25-ad394588c598 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:07.637917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b6f9ef0-9d23-41f3-bd25-ad394588c598 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:07.638517 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b6f9ef0-9d23-41f3-bd25-ad394588c598 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:07.697511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f5fe78ce-7472-4659-94ec-abeda8108f02 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:07.698370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f5fe78ce-7472-4659-94ec-abeda8108f02 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:07.717274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5fe78ce-7472-4659-94ec-abeda8108f02 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:07.717812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5fe78ce-7472-4659-94ec-abeda8108f02 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:07.718262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5fe78ce-7472-4659-94ec-abeda8108f02 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:07.718985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5fe78ce-7472-4659-94ec-abeda8108f02 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:07.719453 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5fe78ce-7472-4659-94ec-abeda8108f02 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:07.729124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5fe78ce-7472-4659-94ec-abeda8108f02 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:08.479793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7b6f9ef0-9d23-41f3-bd25-ad394588c598 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:08.495343 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7b6f9ef0-9d23-41f3-bd25-ad394588c598 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52" status: 200 len: 1469 microversion: 2.1 time: 0.884354 Sep 07 12:41:08.510432 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1208/2457] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:07 2022] GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52 => generated 1469 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:41:08.525329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-be007eb9-b024-4544-8603-11d481e0cbc4 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc41d265670>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:08.589589 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-be007eb9-b024-4544-8603-11d481e0cbc4 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf" status: 200 len: 1422 microversion: 2.1 time: 0.077637 Sep 07 12:41:08.590631 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1209/2458] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:41:08 2022] GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf => generated 1422 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:08.602945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a1636de0-9c89-4835-ad9b-077b68dca49b tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:08.610252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a1636de0-9c89-4835-ad9b-077b68dca49b tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 65f0a19b-4d7c-4874-accf-9f62a5b48847] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:08.627084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1636de0-9c89-4835-ad9b-077b68dca49b tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:08.628524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1636de0-9c89-4835-ad9b-077b68dca49b tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:08.629265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1636de0-9c89-4835-ad9b-077b68dca49b tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:08.630359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1636de0-9c89-4835-ad9b-077b68dca49b tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:08.631114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1636de0-9c89-4835-ad9b-077b68dca49b tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:08.631810 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1636de0-9c89-4835-ad9b-077b68dca49b tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:09.334409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f5fe78ce-7472-4659-94ec-abeda8108f02 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:09.347706 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f5fe78ce-7472-4659-94ec-abeda8108f02 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1508 microversion: 2.1 time: 1.657788 Sep 07 12:41:09.353207 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1250/2459] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:07 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1508 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:09.611572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1f1d34d4-0a3b-4422-bd3f-d17102d20ad1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc4185aaca0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:09.854953 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1f1d34d4-0a3b-4422-bd3f-d17102d20ad1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf" status: 200 len: 1422 microversion: 2.1 time: 0.250890 Sep 07 12:41:09.861040 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1251/2460] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:41:09 2022] GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf => generated 1422 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:10.194828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a1636de0-9c89-4835-ad9b-077b68dca49b tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:10.216204 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a1636de0-9c89-4835-ad9b-077b68dca49b tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/65f0a19b-4d7c-4874-accf-9f62a5b48847" status: 200 len: 1468 microversion: 2.1 time: 1.623234 Sep 07 12:41:10.240737 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1210/2461] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:08 2022] GET /compute/v2.1/servers/65f0a19b-4d7c-4874-accf-9f62a5b48847 => generated 1468 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:10.255605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-938a6c3d-d7fc-445b-b6bd-f9714bf1c2bc tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:10.282137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-938a6c3d-d7fc-445b-b6bd-f9714bf1c2bc tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:10.286898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-938a6c3d-d7fc-445b-b6bd-f9714bf1c2bc tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Searching by: {'reservation_id': 'r-1scum8b3', 'deleted': False, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:41:10.319168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-938a6c3d-d7fc-445b-b6bd-f9714bf1c2bc tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:10.322977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-938a6c3d-d7fc-445b-b6bd-f9714bf1c2bc tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:10.324101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-938a6c3d-d7fc-445b-b6bd-f9714bf1c2bc tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:10.333920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-938a6c3d-d7fc-445b-b6bd-f9714bf1c2bc tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:10.335172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-938a6c3d-d7fc-445b-b6bd-f9714bf1c2bc tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:10.337091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-938a6c3d-d7fc-445b-b6bd-f9714bf1c2bc tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:10.398139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b2cbd298-5f37-46ee-bd96-12dfb96bf5ba tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:10.402582 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b2cbd298-5f37-46ee-bd96-12dfb96bf5ba tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:10.417977 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2cbd298-5f37-46ee-bd96-12dfb96bf5ba tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:10.418494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2cbd298-5f37-46ee-bd96-12dfb96bf5ba tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:10.418955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2cbd298-5f37-46ee-bd96-12dfb96bf5ba tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:10.419705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2cbd298-5f37-46ee-bd96-12dfb96bf5ba tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:10.420177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2cbd298-5f37-46ee-bd96-12dfb96bf5ba tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:10.420617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2cbd298-5f37-46ee-bd96-12dfb96bf5ba tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:10.549037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-938a6c3d-d7fc-445b-b6bd-f9714bf1c2bc tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:41:10.903861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-938a6c3d-d7fc-445b-b6bd-f9714bf1c2bc tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:10.972300 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-938a6c3d-d7fc-445b-b6bd-f9714bf1c2bc tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:10.973793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-938a6c3d-d7fc-445b-b6bd-f9714bf1c2bc tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:10.974912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-938a6c3d-d7fc-445b-b6bd-f9714bf1c2bc tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:11.701073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b2cbd298-5f37-46ee-bd96-12dfb96bf5ba tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:11.744169 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b2cbd298-5f37-46ee-bd96-12dfb96bf5ba tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1508 microversion: 2.1 time: 1.363081 Sep 07 12:41:11.750230 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1211/2462] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:10 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1508 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:11.769328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f20e7773-a7ae-4a4e-9060-71b2f0c1a7f5 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc4189bbaf0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:11.939139 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f20e7773-a7ae-4a4e-9060-71b2f0c1a7f5 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf" status: 200 len: 1422 microversion: 2.1 time: 0.184339 Sep 07 12:41:11.944026 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1212/2463] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:41:11 2022] GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf => generated 1422 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:11.946782 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-938a6c3d-d7fc-445b-b6bd-f9714bf1c2bc tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?reservation_id=r-1scum8b3" status: 200 len: 2930 microversion: 2.1 time: 1.703049 Sep 07 12:41:11.949409 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1252/2464] 10.222.0.16 () {58 vars in 1197 bytes} [Wed Sep 7 12:41:10 2022] GET /compute/v2.1/servers/detail?reservation_id=r-1scum8b3 => generated 2930 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:12.022498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-39bab70c-f93d-4da7-a8dc-7499ae0a7602 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:12.106361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:41:12.119930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.compute.server_groups [None req-39bab70c-f93d-4da7-a8dc-7499ae0a7602 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Querying cell 9e0290a2-728a-49bc-bfb2-19275e06ed31(cell1) for 2 instances {{(pid=122433) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 07 12:41:12.124499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39bab70c-f93d-4da7-a8dc-7499ae0a7602 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:12.126973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39bab70c-f93d-4da7-a8dc-7499ae0a7602 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:12.130010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39bab70c-f93d-4da7-a8dc-7499ae0a7602 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:12.339342 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-39bab70c-f93d-4da7-a8dc-7499ae0a7602 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/0a940909-7557-42a1-b854-5549ca49a0b6" status: 200 len: 266 microversion: 2.1 time: 0.327360 Sep 07 12:41:12.341839 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1213/2465] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Sep 7 12:41:12 2022] GET /compute/v2.1/os-server-groups/0a940909-7557-42a1-b854-5549ca49a0b6 => generated 266 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:41:12.354933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ac746501-5a79-4b82-9a51-96cbb31c30ba tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:12.355756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ac746501-5a79-4b82-9a51-96cbb31c30ba tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] [instance: aa6c3482-9f8e-41a7-8bec-32d428a3ce52] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:12.373605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac746501-5a79-4b82-9a51-96cbb31c30ba tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:12.378847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac746501-5a79-4b82-9a51-96cbb31c30ba tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:12.379644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac746501-5a79-4b82-9a51-96cbb31c30ba tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:12.380564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac746501-5a79-4b82-9a51-96cbb31c30ba tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:12.386804 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac746501-5a79-4b82-9a51-96cbb31c30ba tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:12.394709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac746501-5a79-4b82-9a51-96cbb31c30ba tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:12.802711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-25603daf-37d3-4bb0-89da-398de02ea28a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:12.805311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-25603daf-37d3-4bb0-89da-398de02ea28a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:12.842802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25603daf-37d3-4bb0-89da-398de02ea28a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:12.847555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25603daf-37d3-4bb0-89da-398de02ea28a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:12.854105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25603daf-37d3-4bb0-89da-398de02ea28a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:12.857449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25603daf-37d3-4bb0-89da-398de02ea28a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:12.867318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25603daf-37d3-4bb0-89da-398de02ea28a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:12.871767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25603daf-37d3-4bb0-89da-398de02ea28a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:13.083717 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ac746501-5a79-4b82-9a51-96cbb31c30ba tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52" status: 200 len: 1620 microversion: 2.1 time: 0.732982 Sep 07 12:41:13.085024 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1253/2466] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:12 2022] GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52 => generated 1620 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:13.154557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0febde5a-232e-4feb-bab2-5d18ce89fc63 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc41d2f30d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:13.348616 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0febde5a-232e-4feb-bab2-5d18ce89fc63 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf" status: 200 len: 1422 microversion: 2.1 time: 0.230902 Sep 07 12:41:13.349233 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1254/2467] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:41:13 2022] GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf => generated 1422 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:13.366317 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d055cd49-6c15-4b8e-854e-1196bdf48896 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:13.367014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d055cd49-6c15-4b8e-854e-1196bdf48896 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] [instance: 65f0a19b-4d7c-4874-accf-9f62a5b48847] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:13.430966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d055cd49-6c15-4b8e-854e-1196bdf48896 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:13.433422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d055cd49-6c15-4b8e-854e-1196bdf48896 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:13.436138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d055cd49-6c15-4b8e-854e-1196bdf48896 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:13.443504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d055cd49-6c15-4b8e-854e-1196bdf48896 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:13.444652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d055cd49-6c15-4b8e-854e-1196bdf48896 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:13.445412 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d055cd49-6c15-4b8e-854e-1196bdf48896 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:13.540827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-25603daf-37d3-4bb0-89da-398de02ea28a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:13.577319 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-25603daf-37d3-4bb0-89da-398de02ea28a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1508 microversion: 2.1 time: 0.782837 Sep 07 12:41:13.599661 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1214/2468] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:12 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1508 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:14.233049 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d055cd49-6c15-4b8e-854e-1196bdf48896 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/65f0a19b-4d7c-4874-accf-9f62a5b48847" status: 200 len: 1619 microversion: 2.1 time: 0.869202 Sep 07 12:41:14.233940 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1255/2469] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:13 2022] GET /compute/v2.1/servers/65f0a19b-4d7c-4874-accf-9f62a5b48847 => generated 1619 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:14.276805 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a9566ab6-e6f5-4a37-b994-8ee16875b4b1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Action: 'create', calling method: .version_select at 0x7fc41d16c430>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1100707857", "policies": ["anti-affinity"]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:14.365409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-23c5bc10-fad8-4a49-8860-7e2a728be424 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc41d2c08b0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:14.438504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-a9566ab6-e6f5-4a37-b994-8ee16875b4b1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:41:14.466182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-a9566ab6-e6f5-4a37-b994-8ee16875b4b1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for user ed6e5d4d54224bca90954d1ebbd7b7a3 and project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:41:14.510383 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-23c5bc10-fad8-4a49-8860-7e2a728be424 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf" status: 200 len: 1422 microversion: 2.1 time: 0.149641 Sep 07 12:41:14.517806 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1256/2470] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:41:14 2022] GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf => generated 1422 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:14.624793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-987bbeba-a315-413a-81c2-7f86e1c90b34 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:14.625453 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-987bbeba-a315-413a-81c2-7f86e1c90b34 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:14.647246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-987bbeba-a315-413a-81c2-7f86e1c90b34 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:14.647828 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-987bbeba-a315-413a-81c2-7f86e1c90b34 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:14.655096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-987bbeba-a315-413a-81c2-7f86e1c90b34 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:14.655956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-987bbeba-a315-413a-81c2-7f86e1c90b34 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:14.658200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-987bbeba-a315-413a-81c2-7f86e1c90b34 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:14.658717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-987bbeba-a315-413a-81c2-7f86e1c90b34 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:14.780285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-a9566ab6-e6f5-4a37-b994-8ee16875b4b1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:41:14.824697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-a9566ab6-e6f5-4a37-b994-8ee16875b4b1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for user ed6e5d4d54224bca90954d1ebbd7b7a3 and project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:41:14.981156 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a9566ab6-e6f5-4a37-b994-8ee16875b4b1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.720336 Sep 07 12:41:14.990443 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1215/2471] 10.222.0.16 () {60 vars in 1174 bytes} [Wed Sep 7 12:41:14 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:41:15.460172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-987bbeba-a315-413a-81c2-7f86e1c90b34 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:15.472876 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-987bbeba-a315-413a-81c2-7f86e1c90b34 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1508 microversion: 2.1 time: 0.853073 Sep 07 12:41:15.527065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-94fb69b8-fe77-4015-ad98-7e6ef8a39567 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc41d16c5e0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:15.535970 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1257/2472] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:14 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1508 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:15.690490 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-962666147", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "d99b666a-2966-46d5-95c8-fbd940b4df0d"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:15.736720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:41:18.816030 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-94fb69b8-fe77-4015-ad98-7e6ef8a39567 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf" status: 200 len: 1422 microversion: 2.1 time: 3.286323 Sep 07 12:41:18.819036 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1216/2473] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:41:15 2022] GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf => generated 1422 bytes in 3297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:41:18.839334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:41:18.841603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d1723719-6850-4d76-aad0-526ce21cc60d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:18.847955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d1723719-6850-4d76-aad0-526ce21cc60d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:18.860550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1723719-6850-4d76-aad0-526ce21cc60d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:18.862078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1723719-6850-4d76-aad0-526ce21cc60d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:18.874498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1723719-6850-4d76-aad0-526ce21cc60d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:18.883100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1723719-6850-4d76-aad0-526ce21cc60d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:18.887780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1723719-6850-4d76-aad0-526ce21cc60d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:18.889212 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1723719-6850-4d76-aad0-526ce21cc60d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:19.600940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d1723719-6850-4d76-aad0-526ce21cc60d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:19.643314 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d1723719-6850-4d76-aad0-526ce21cc60d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1508 microversion: 2.1 time: 0.821040 Sep 07 12:41:19.645933 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1217/2474] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:18 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1508 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:19.661107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-80f21a7e-cea6-48ed-bfbf-6a02387729ea tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Calling method '.version_select at 0x7fc4192d5310>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:19.800050 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-80f21a7e-cea6-48ed-bfbf-6a02387729ea tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] 10.222.0.16 "GET /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a" status: 200 len: 636 microversion: 2.1 time: 0.152713 Sep 07 12:41:19.800638 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1218/2475] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:41:19 2022] GET /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a => generated 636 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:41:19.838322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1bcd2a6a-7b23-48f8-aebf-a83d11149c9b tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Action: 'update_all', calling method: .version_select at 0x7fc41d16cca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:20.030048 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-1bcd2a6a-7b23-48f8-aebf-a83d11149c9b tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Getting quotas for project f3795ca9f10f4043b3c4b006bd87cac2. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:41:20.045343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-1bcd2a6a-7b23-48f8-aebf-a83d11149c9b tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Getting quotas for user e23223b336d4435f868016d39a5a638a and project f3795ca9f10f4043b3c4b006bd87cac2. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:41:20.065308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:41:20.066065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:41:20.066254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:41:20.066633 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:41:20.067059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:41:20.227373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:20.234802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:20.245969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:20.247921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:20.251913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:20.253150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:20.323934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:41:20.339332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for user ed6e5d4d54224bca90954d1ebbd7b7a3 and project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:41:20.376263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Going to run 2 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:41:20.384523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 8d248e06-d37c-4895-85a8-e8c5e412aedb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:41:20.489553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122432) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 07 12:41:20.586969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'server_group_members'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:41:20.615333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for user ed6e5d4d54224bca90954d1ebbd7b7a3 and project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'server_group_members'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:41:20.819642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'server_group_members'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:41:20.864677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for user ed6e5d4d54224bca90954d1ebbd7b7a3 and project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'server_group_members'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:41:20.932374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 6762b361-a49e-467e-ba9b-cebfb35d9a58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=8d248e06-d37c-4895-85a8-e8c5e412aedb,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:41:20.933060 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1bcd2a6a-7b23-48f8-aebf-a83d11149c9b tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] 10.222.0.16 "PUT /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata" status: 200 len: 61 microversion: 2.1 time: 1.104079 Sep 07 12:41:20.939050 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1219/2476] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 12:41:19 2022] PUT /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata => generated 61 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 12:41:20.947217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bd3de062-125a-4dec-b3f1-c564a643d42f tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc4185591f0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:21.057992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'server_group_members'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:41:21.070340 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bd3de062-125a-4dec-b3f1-c564a643d42f tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf" status: 200 len: 1422 microversion: 2.1 time: 0.134722 Sep 07 12:41:21.079111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for user ed6e5d4d54224bca90954d1ebbd7b7a3 and project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'server_group_members'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:41:21.079692 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1220/2477] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:41:20 2022] GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf => generated 1422 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:21.083946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-157ddf6f-f8c9-4706-bb9d-2b87e71e54bc tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:21.113955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-157ddf6f-f8c9-4706-bb9d-2b87e71e54bc tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5d991fa2c5754b14a7a0e638b486f06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d453f24efa048f0a67ab7834d0005c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:21.118756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-157ddf6f-f8c9-4706-bb9d-2b87e71e54bc tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Searching by: {'deleted': False, 'project_id': '3d453f24efa048f0a67ab7834d0005c7'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:41:21.153421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-157ddf6f-f8c9-4706-bb9d-2b87e71e54bc tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:21.156823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-157ddf6f-f8c9-4706-bb9d-2b87e71e54bc tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:21.160035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-157ddf6f-f8c9-4706-bb9d-2b87e71e54bc tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:21.165811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-157ddf6f-f8c9-4706-bb9d-2b87e71e54bc tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:21.169474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-157ddf6f-f8c9-4706-bb9d-2b87e71e54bc tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:21.170767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-157ddf6f-f8c9-4706-bb9d-2b87e71e54bc tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:21.219366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'server_group_members'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:41:21.251013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for user ed6e5d4d54224bca90954d1ebbd7b7a3 and project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'server_group_members'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:41:21.269714 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-157ddf6f-f8c9-4706-bb9d-2b87e71e54bc tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:41:21.357715 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-157ddf6f-f8c9-4706-bb9d-2b87e71e54bc tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.281125 Sep 07 12:41:21.358322 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1221/2478] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Sep 7 12:41:21 2022] GET /compute/v2.1/servers => generated 344 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:41:21.379602 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e08c923c-b393-4c2b-8359-16f12515cc4f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:21.380257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e08c923c-b393-4c2b-8359-16f12515cc4f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:21.396254 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8c0ffb27-5d5f-4c38-91af-d892e801795e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 5.715821 Sep 07 12:41:21.402940 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1258/2479] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:41:15 2022] POST /compute/v2.1/servers => generated 32 bytes in 5723 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 07 12:41:21.417846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e08c923c-b393-4c2b-8359-16f12515cc4f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:21.418352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e08c923c-b393-4c2b-8359-16f12515cc4f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:21.426077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e08c923c-b393-4c2b-8359-16f12515cc4f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:21.426837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e08c923c-b393-4c2b-8359-16f12515cc4f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:21.427337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e08c923c-b393-4c2b-8359-16f12515cc4f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:21.427780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e08c923c-b393-4c2b-8359-16f12515cc4f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:21.907214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6340fd3f-83ef-46ba-be1c-333678be4c19 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1303629738", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "f9f6b6a8-43a1-473b-b2ee-d0a73b68079f"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:22.106644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-6340fd3f-83ef-46ba-be1c-333678be4c19 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] validate_networks() for [('f9f6b6a8-43a1-473b-b2ee-d0a73b68079f', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:41:22.338336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e08c923c-b393-4c2b-8359-16f12515cc4f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:22.348755 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e08c923c-b393-4c2b-8359-16f12515cc4f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1508 microversion: 2.1 time: 0.973630 Sep 07 12:41:22.366262 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1222/2480] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:21 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1508 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:22.375455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c999c73d-31e2-4e11-a93a-c40232ce472e tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Calling method '.version_select at 0x7fc4188e1c10>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:22.888597 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c999c73d-31e2-4e11-a93a-c40232ce472e tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] 10.222.0.16 "DELETE /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.520919 Sep 07 12:41:22.893324 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1223/2481] 10.222.0.16 () {58 vars in 1296 bytes} [Wed Sep 7 12:41:22 2022] DELETE /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata/os_version => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:41:22.901216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-207e12ac-4513-4fec-b28a-13badb1b885b tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:22.918772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-207e12ac-4513-4fec-b28a-13badb1b885b tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5d991fa2c5754b14a7a0e638b486f06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d453f24efa048f0a67ab7834d0005c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:22.933868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-207e12ac-4513-4fec-b28a-13badb1b885b tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Searching by: {'deleted': False, 'project_id': '3d453f24efa048f0a67ab7834d0005c7'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:41:22.947700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-207e12ac-4513-4fec-b28a-13badb1b885b tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:22.954112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-207e12ac-4513-4fec-b28a-13badb1b885b tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:22.955445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-207e12ac-4513-4fec-b28a-13badb1b885b tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:22.964440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-207e12ac-4513-4fec-b28a-13badb1b885b tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:22.965572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-207e12ac-4513-4fec-b28a-13badb1b885b tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:22.966550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-207e12ac-4513-4fec-b28a-13badb1b885b tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:23.046632 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-207e12ac-4513-4fec-b28a-13badb1b885b tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:41:23.146516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-207e12ac-4513-4fec-b28a-13badb1b885b tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d991fa2c5754b14a7a0e638b486f06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d453f24efa048f0a67ab7834d0005c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:23.182175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-207e12ac-4513-4fec-b28a-13badb1b885b tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:23.185742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-207e12ac-4513-4fec-b28a-13badb1b885b tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:23.189200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-207e12ac-4513-4fec-b28a-13badb1b885b tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:24.265817 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-207e12ac-4513-4fec-b28a-13badb1b885b tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 1.374347 Sep 07 12:41:24.267201 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1224/2482] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:41:22 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:24.272630 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6ca6f281-4ff5-4f36-8439-b8c9dec7a5c3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:24.284882 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6ca6f281-4ff5-4f36-8439-b8c9dec7a5c3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:24.289726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6ca6f281-4ff5-4f36-8439-b8c9dec7a5c3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Searching by: {'deleted': False, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:41:24.322177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ca6f281-4ff5-4f36-8439-b8c9dec7a5c3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:24.323740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ca6f281-4ff5-4f36-8439-b8c9dec7a5c3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:24.325146 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ca6f281-4ff5-4f36-8439-b8c9dec7a5c3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:24.328819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ca6f281-4ff5-4f36-8439-b8c9dec7a5c3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:24.330928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ca6f281-4ff5-4f36-8439-b8c9dec7a5c3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:24.332114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ca6f281-4ff5-4f36-8439-b8c9dec7a5c3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:24.434747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-6ca6f281-4ff5-4f36-8439-b8c9dec7a5c3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:41:24.597901 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6ca6f281-4ff5-4f36-8439-b8c9dec7a5c3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.322659 Sep 07 12:41:24.599946 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1225/2483] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Sep 7 12:41:24 2022] GET /compute/v2.1/servers => generated 1663 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:24.626922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8d8ca151-981c-419c-b20e-2604b1876ae8 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc418d54550>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:24.851645 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8d8ca151-981c-419c-b20e-2604b1876ae8 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf" status: 200 len: 1422 microversion: 2.1 time: 0.249345 Sep 07 12:41:24.852666 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1226/2484] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:41:24 2022] GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf => generated 1422 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:24.933139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eaefc55f-70b8-47c9-9ca9-f2a848fa361c tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Calling method '.version_select at 0x7fc41d1cee50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:25.069612 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eaefc55f-70b8-47c9-9ca9-f2a848fa361c tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] 10.222.0.16 "GET /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata" status: 200 len: 37 microversion: 2.1 time: 0.206211 Sep 07 12:41:25.070980 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1227/2485] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Sep 7 12:41:24 2022] GET /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata => generated 37 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:41:25.088418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-756b2d5d-9f67-4986-8327-3819051b2ab4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:25.095057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-756b2d5d-9f67-4986-8327-3819051b2ab4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:25.142472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-756b2d5d-9f67-4986-8327-3819051b2ab4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:25.148983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-756b2d5d-9f67-4986-8327-3819051b2ab4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:25.153236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-756b2d5d-9f67-4986-8327-3819051b2ab4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:25.154687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-756b2d5d-9f67-4986-8327-3819051b2ab4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:25.155512 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-756b2d5d-9f67-4986-8327-3819051b2ab4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:25.156312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-756b2d5d-9f67-4986-8327-3819051b2ab4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:25.301316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-6340fd3f-83ef-46ba-be1c-333678be4c19 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:41:25.302045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-6340fd3f-83ef-46ba-be1c-333678be4c19 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:41:25.302976 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-6340fd3f-83ef-46ba-be1c-333678be4c19 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:41:25.303623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-6340fd3f-83ef-46ba-be1c-333678be4c19 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:41:25.304692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-6340fd3f-83ef-46ba-be1c-333678be4c19 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:41:25.336905 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6340fd3f-83ef-46ba-be1c-333678be4c19 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:25.341807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6340fd3f-83ef-46ba-be1c-333678be4c19 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:25.342760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6340fd3f-83ef-46ba-be1c-333678be4c19 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:25.347748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6340fd3f-83ef-46ba-be1c-333678be4c19 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:25.351850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6340fd3f-83ef-46ba-be1c-333678be4c19 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:25.356265 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6340fd3f-83ef-46ba-be1c-333678be4c19 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:25.467205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-6340fd3f-83ef-46ba-be1c-333678be4c19 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Getting quotas for project 3479aa98e81346039d54eec7a7fb2304. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:41:25.495165 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-6340fd3f-83ef-46ba-be1c-333678be4c19 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Getting quotas for user 1f6382498aed492590e3fb1896f692f7 and project 3479aa98e81346039d54eec7a7fb2304. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:41:25.532089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-756b2d5d-9f67-4986-8327-3819051b2ab4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:25.571681 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-756b2d5d-9f67-4986-8327-3819051b2ab4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1508 microversion: 2.1 time: 0.481290 Sep 07 12:41:25.572765 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1228/2486] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:25 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1508 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:25.581794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6340fd3f-83ef-46ba-be1c-333678be4c19 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Going to run 2 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:41:25.589172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6340fd3f-83ef-46ba-be1c-333678be4c19 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: abbf48d7-8190-4dde-8fb6-95d83eccf1b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:41:25.616213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-714ec159-848d-4ab7-861f-acc3b6fe3016 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:25.648199 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-714ec159-848d-4ab7-861f-acc3b6fe3016 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.064197 Sep 07 12:41:25.651530 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1229/2487] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:41:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:41:25.673603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0edb3666-47e0-4229-9244-c3cc0ffc2d1a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:25.680604 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0edb3666-47e0-4229-9244-c3cc0ffc2d1a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 6762b361-a49e-467e-ba9b-cebfb35d9a58] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:25.715577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0edb3666-47e0-4229-9244-c3cc0ffc2d1a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:25.716086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0edb3666-47e0-4229-9244-c3cc0ffc2d1a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:25.726364 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0edb3666-47e0-4229-9244-c3cc0ffc2d1a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:25.727509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0edb3666-47e0-4229-9244-c3cc0ffc2d1a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:25.728202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0edb3666-47e0-4229-9244-c3cc0ffc2d1a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:25.728816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0edb3666-47e0-4229-9244-c3cc0ffc2d1a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:25.728993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6340fd3f-83ef-46ba-be1c-333678be4c19 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 2360d1da-9d70-4484-be65-d3cc510b9071] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=abbf48d7-8190-4dde-8fb6-95d83eccf1b3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:41:25.915499 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6340fd3f-83ef-46ba-be1c-333678be4c19 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.504089 Sep 07 12:41:25.919790 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1259/2488] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:41:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 4516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:41:25.932949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e4cb33eb-40b6-4d1e-be51-208251cec9ac tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Action: 'update_all', calling method: .version_select at 0x7fc41855e430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:25.960399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0edb3666-47e0-4229-9244-c3cc0ffc2d1a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:25.978499 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0edb3666-47e0-4229-9244-c3cc0ffc2d1a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/6762b361-a49e-467e-ba9b-cebfb35d9a58" status: 200 len: 1276 microversion: 2.1 time: 0.321629 Sep 07 12:41:25.991869 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1230/2489] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:25 2022] GET /compute/v2.1/servers/6762b361-a49e-467e-ba9b-cebfb35d9a58 => generated 1276 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:26.036285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cdda79b6-fb2d-45ee-9041-c308448c0c34 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc41d22d3a0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:26.263436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-e4cb33eb-40b6-4d1e-be51-208251cec9ac tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Getting quotas for project f3795ca9f10f4043b3c4b006bd87cac2. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:41:26.280875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-e4cb33eb-40b6-4d1e-be51-208251cec9ac tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Getting quotas for user e23223b336d4435f868016d39a5a638a and project f3795ca9f10f4043b3c4b006bd87cac2. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:41:26.283086 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cdda79b6-fb2d-45ee-9041-c308448c0c34 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf" status: 200 len: 1422 microversion: 2.1 time: 0.287076 Sep 07 12:41:26.287373 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1231/2490] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:41:25 2022] GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf => generated 1422 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:26.311622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-886ace83-05b0-4988-8042-ad7032212810 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:26.339495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-886ace83-05b0-4988-8042-ad7032212810 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:26.345233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-886ace83-05b0-4988-8042-ad7032212810 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Searching by: {'deleted': False, 'project_id': '3479aa98e81346039d54eec7a7fb2304'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:41:26.536289 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-886ace83-05b0-4988-8042-ad7032212810 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:26.545144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-886ace83-05b0-4988-8042-ad7032212810 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:26.549260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-886ace83-05b0-4988-8042-ad7032212810 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:26.558246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-886ace83-05b0-4988-8042-ad7032212810 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:26.559228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-886ace83-05b0-4988-8042-ad7032212810 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:26.560028 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-886ace83-05b0-4988-8042-ad7032212810 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:26.771069 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-886ace83-05b0-4988-8042-ad7032212810 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.479401 Sep 07 12:41:26.805477 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1232/2491] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Sep 7 12:41:26 2022] GET /compute/v2.1/servers => generated 677 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:41:26.819183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fc586ba0-7c8e-4e0a-a936-2c1b36e6679a tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:26.820477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fc586ba0-7c8e-4e0a-a936-2c1b36e6679a tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:26.841013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc586ba0-7c8e-4e0a-a936-2c1b36e6679a tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:26.841959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc586ba0-7c8e-4e0a-a936-2c1b36e6679a tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:26.842643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc586ba0-7c8e-4e0a-a936-2c1b36e6679a tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:26.843799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc586ba0-7c8e-4e0a-a936-2c1b36e6679a tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:26.844537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc586ba0-7c8e-4e0a-a936-2c1b36e6679a tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:26.850419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc586ba0-7c8e-4e0a-a936-2c1b36e6679a tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:26.888229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:41:26.903724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fc586ba0-7c8e-4e0a-a936-2c1b36e6679a tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:41:27.162096 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fc586ba0-7c8e-4e0a-a936-2c1b36e6679a tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "DELETE /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f" status: 204 len: 0 microversion: 2.1 time: 0.353958 Sep 07 12:41:27.168424 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1233/2492] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:41:26 2022] DELETE /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:41:27.197222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bcfe4e06-cf0a-4ff3-977f-3ab8ffe867fd tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:27.198305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bcfe4e06-cf0a-4ff3-977f-3ab8ffe867fd tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:27.225555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcfe4e06-cf0a-4ff3-977f-3ab8ffe867fd tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:27.225555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcfe4e06-cf0a-4ff3-977f-3ab8ffe867fd tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:27.225555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcfe4e06-cf0a-4ff3-977f-3ab8ffe867fd tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:27.225555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcfe4e06-cf0a-4ff3-977f-3ab8ffe867fd tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:27.226571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcfe4e06-cf0a-4ff3-977f-3ab8ffe867fd tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:27.226571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcfe4e06-cf0a-4ff3-977f-3ab8ffe867fd tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:27.277829 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e4cb33eb-40b6-4d1e-be51-208251cec9ac tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] 10.222.0.16 "PUT /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata" status: 200 len: 61 microversion: 2.1 time: 1.353310 Sep 07 12:41:27.281407 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1260/2493] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 12:41:25 2022] PUT /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata => generated 61 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:41:27.294236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-55be7591-b626-4dc1-bac1-96c9a301ae2c tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:27.301127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-55be7591-b626-4dc1-bac1-96c9a301ae2c tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 2360d1da-9d70-4484-be65-d3cc510b9071] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:27.306279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=14 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:41:27.721133 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-55be7591-b626-4dc1-bac1-96c9a301ae2c tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:27.773043 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-55be7591-b626-4dc1-bac1-96c9a301ae2c tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071" status: 200 len: 1220 microversion: 2.1 time: 0.488528 Sep 07 12:41:27.774387 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1261/2494] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:27 2022] GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071 => generated 1220 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:27.813264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32d943ce-b688-435b-ae60-e5a5a81350ba tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:27.814285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-32d943ce-b688-435b-ae60-e5a5a81350ba tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 6762b361-a49e-467e-ba9b-cebfb35d9a58] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:27.844856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d943ce-b688-435b-ae60-e5a5a81350ba tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:27.858217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bcfe4e06-cf0a-4ff3-977f-3ab8ffe867fd tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:27.868022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d943ce-b688-435b-ae60-e5a5a81350ba tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:27.877535 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bcfe4e06-cf0a-4ff3-977f-3ab8ffe867fd tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1508 microversion: 2.1 time: 0.706012 Sep 07 12:41:27.889956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d943ce-b688-435b-ae60-e5a5a81350ba tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:27.890381 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1234/2495] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:27 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1508 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:27.890865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d943ce-b688-435b-ae60-e5a5a81350ba tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:27.891364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d943ce-b688-435b-ae60-e5a5a81350ba tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:27.900078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32d943ce-b688-435b-ae60-e5a5a81350ba tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:27.906290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ad32c045-39e9-40e6-bda9-d2861a159486 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:27.910607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ad32c045-39e9-40e6-bda9-d2861a159486 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:27.928299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad32c045-39e9-40e6-bda9-d2861a159486 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:27.938680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad32c045-39e9-40e6-bda9-d2861a159486 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:27.939530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad32c045-39e9-40e6-bda9-d2861a159486 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:27.940615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad32c045-39e9-40e6-bda9-d2861a159486 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:27.943646 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad32c045-39e9-40e6-bda9-d2861a159486 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:27.945173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad32c045-39e9-40e6-bda9-d2861a159486 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:28.224110 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-32d943ce-b688-435b-ae60-e5a5a81350ba tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:28.240184 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-32d943ce-b688-435b-ae60-e5a5a81350ba tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/6762b361-a49e-467e-ba9b-cebfb35d9a58" status: 200 len: 1276 microversion: 2.1 time: 0.451577 Sep 07 12:41:28.243665 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1262/2496] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:27 2022] GET /compute/v2.1/servers/6762b361-a49e-467e-ba9b-cebfb35d9a58 => generated 1276 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:28.261854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1c5c8ed1-1932-4743-824c-0f333f479d81 tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Calling method '.version_select at 0x7fc41854ec10>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:28.551283 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1c5c8ed1-1932-4743-824c-0f333f479d81 tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] 10.222.0.16 "GET /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.305634 Sep 07 12:41:28.553205 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1263/2497] 10.222.0.16 () {58 vars in 1290 bytes} [Wed Sep 7 12:41:28 2022] GET /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata/os_distro => generated 33 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:41:28.562203 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-79c7fcae-ca41-44a3-a2ae-7726ce4c1303 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc419601160>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:28.643562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ad32c045-39e9-40e6-bda9-d2861a159486 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d991fa2c5754b14a7a0e638b486f06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d453f24efa048f0a67ab7834d0005c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:28.662000 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ad32c045-39e9-40e6-bda9-d2861a159486 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f" status: 200 len: 1607 microversion: 2.1 time: 0.765550 Sep 07 12:41:28.663108 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1235/2498] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:27 2022] GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f => generated 1607 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:28.673062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5b5fe6aa-24aa-41ab-a33b-643b82e816fb tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Action: 'update_all', calling method: .version_select at 0x7fc41d16c8b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:28.823426 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-79c7fcae-ca41-44a3-a2ae-7726ce4c1303 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf" status: 200 len: 1422 microversion: 2.1 time: 0.267561 Sep 07 12:41:28.825600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-5b5fe6aa-24aa-41ab-a33b-643b82e816fb tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Getting quotas for project f3795ca9f10f4043b3c4b006bd87cac2. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:41:28.831910 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1264/2499] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:41:28 2022] GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf => generated 1422 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:28.841088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-906c91ea-f875-4566-8e00-7a244a97b750 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:28.842022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-906c91ea-f875-4566-8e00-7a244a97b750 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 2360d1da-9d70-4484-be65-d3cc510b9071] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:28.855414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-906c91ea-f875-4566-8e00-7a244a97b750 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:28.857206 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-906c91ea-f875-4566-8e00-7a244a97b750 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:28.857982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-906c91ea-f875-4566-8e00-7a244a97b750 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:28.860553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-906c91ea-f875-4566-8e00-7a244a97b750 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:28.860768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-5b5fe6aa-24aa-41ab-a33b-643b82e816fb tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Getting quotas for user e23223b336d4435f868016d39a5a638a and project f3795ca9f10f4043b3c4b006bd87cac2. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:41:28.863337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-906c91ea-f875-4566-8e00-7a244a97b750 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:28.876113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-906c91ea-f875-4566-8e00-7a244a97b750 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:29.190201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-906c91ea-f875-4566-8e00-7a244a97b750 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:29.235423 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-906c91ea-f875-4566-8e00-7a244a97b750 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071" status: 200 len: 1224 microversion: 2.1 time: 0.400230 Sep 07 12:41:29.249611 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1265/2500] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:28 2022] GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071 => generated 1224 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:29.292058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-507bd132-b1eb-491c-83a6-d99541e7e71b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:29.292846 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-507bd132-b1eb-491c-83a6-d99541e7e71b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:29.313942 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5b5fe6aa-24aa-41ab-a33b-643b82e816fb tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] 10.222.0.16 "PUT /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.649215 Sep 07 12:41:29.314963 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1236/2501] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 12:41:28 2022] PUT /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata => generated 61 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:41:29.321663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3aa1460a-aff8-455c-9d7f-310d41baac95 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:29.327679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3aa1460a-aff8-455c-9d7f-310d41baac95 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 6762b361-a49e-467e-ba9b-cebfb35d9a58] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:29.341438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3aa1460a-aff8-455c-9d7f-310d41baac95 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:29.343167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3aa1460a-aff8-455c-9d7f-310d41baac95 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:29.345449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-507bd132-b1eb-491c-83a6-d99541e7e71b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:29.346205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-507bd132-b1eb-491c-83a6-d99541e7e71b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:29.346932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-507bd132-b1eb-491c-83a6-d99541e7e71b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:29.347834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3aa1460a-aff8-455c-9d7f-310d41baac95 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:29.350145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3aa1460a-aff8-455c-9d7f-310d41baac95 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:29.353405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-507bd132-b1eb-491c-83a6-d99541e7e71b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:29.354943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-507bd132-b1eb-491c-83a6-d99541e7e71b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:29.355833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3aa1460a-aff8-455c-9d7f-310d41baac95 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:29.358687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-507bd132-b1eb-491c-83a6-d99541e7e71b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:29.361602 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3aa1460a-aff8-455c-9d7f-310d41baac95 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:30.010631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3aa1460a-aff8-455c-9d7f-310d41baac95 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:30.021566 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3aa1460a-aff8-455c-9d7f-310d41baac95 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/6762b361-a49e-467e-ba9b-cebfb35d9a58" status: 200 len: 1318 microversion: 2.1 time: 0.705224 Sep 07 12:41:30.027441 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1237/2502] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:29 2022] GET /compute/v2.1/servers/6762b361-a49e-467e-ba9b-cebfb35d9a58 => generated 1318 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:30.038105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d0cd10d1-5480-461c-9c31-fdbdc1e7a4e7 tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Calling method '.version_select at 0x7fc41d1904c0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:30.129952 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d0cd10d1-5480-461c-9c31-fdbdc1e7a4e7 tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] 10.222.0.16 "GET /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.101064 Sep 07 12:41:30.130818 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1238/2503] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Sep 7 12:41:30 2022] GET /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata => generated 61 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:41:30.136022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-39801834-49f9-49a8-bced-b126c295775c tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:30.139314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-39801834-49f9-49a8-bced-b126c295775c tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:30.171433 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39801834-49f9-49a8-bced-b126c295775c tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:30.172257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39801834-49f9-49a8-bced-b126c295775c tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:30.172867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39801834-49f9-49a8-bced-b126c295775c tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:30.173795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39801834-49f9-49a8-bced-b126c295775c tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:30.174410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39801834-49f9-49a8-bced-b126c295775c tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:30.174993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39801834-49f9-49a8-bced-b126c295775c tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:30.248369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-507bd132-b1eb-491c-83a6-d99541e7e71b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:30.284758 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-507bd132-b1eb-491c-83a6-d99541e7e71b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1529 microversion: 2.1 time: 1.036554 Sep 07 12:41:30.286769 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1266/2504] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:29 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1529 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:30.307172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6746de59-e60e-4fd2-bc4a-c862a46dbc6b tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc419487c10>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:30.493562 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6746de59-e60e-4fd2-bc4a-c862a46dbc6b tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf" status: 200 len: 1422 microversion: 2.1 time: 0.193551 Sep 07 12:41:30.498810 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1267/2505] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:41:30 2022] GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf => generated 1422 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:30.521383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-23aeebe6-d4c0-4aa0-a0d1-3e5bb0588ae1 tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Action: 'update_all', calling method: .version_select at 0x7fc41848e670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:30.700240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-23aeebe6-d4c0-4aa0-a0d1-3e5bb0588ae1 tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Getting quotas for project f3795ca9f10f4043b3c4b006bd87cac2. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:41:30.713327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-23aeebe6-d4c0-4aa0-a0d1-3e5bb0588ae1 tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Getting quotas for user e23223b336d4435f868016d39a5a638a and project f3795ca9f10f4043b3c4b006bd87cac2. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:41:30.961050 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-39801834-49f9-49a8-bced-b126c295775c tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d991fa2c5754b14a7a0e638b486f06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d453f24efa048f0a67ab7834d0005c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:30.970700 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-39801834-49f9-49a8-bced-b126c295775c tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f" status: 200 len: 1607 microversion: 2.1 time: 0.838647 Sep 07 12:41:30.982829 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1239/2506] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:30 2022] GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f => generated 1607 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:30.988416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c53c4269-a475-4915-ad4c-7c9c9ddb3180 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:30.993160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c53c4269-a475-4915-ad4c-7c9c9ddb3180 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 2360d1da-9d70-4484-be65-d3cc510b9071] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:31.017370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c53c4269-a475-4915-ad4c-7c9c9ddb3180 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:31.021909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c53c4269-a475-4915-ad4c-7c9c9ddb3180 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:31.022980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c53c4269-a475-4915-ad4c-7c9c9ddb3180 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:31.024411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c53c4269-a475-4915-ad4c-7c9c9ddb3180 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:31.029534 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c53c4269-a475-4915-ad4c-7c9c9ddb3180 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:31.037012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c53c4269-a475-4915-ad4c-7c9c9ddb3180 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:31.142030 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-23aeebe6-d4c0-4aa0-a0d1-3e5bb0588ae1 tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] 10.222.0.16 "PUT /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.634001 Sep 07 12:41:31.143054 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1268/2507] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 12:41:30 2022] PUT /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata => generated 61 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:41:31.149696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fea198b5-da22-45d0-8d2a-5e85323e029c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:31.151038 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fea198b5-da22-45d0-8d2a-5e85323e029c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 6762b361-a49e-467e-ba9b-cebfb35d9a58] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:31.159891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fea198b5-da22-45d0-8d2a-5e85323e029c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:31.160400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fea198b5-da22-45d0-8d2a-5e85323e029c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:31.160856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fea198b5-da22-45d0-8d2a-5e85323e029c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:31.174255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fea198b5-da22-45d0-8d2a-5e85323e029c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:31.174255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fea198b5-da22-45d0-8d2a-5e85323e029c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:31.174255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fea198b5-da22-45d0-8d2a-5e85323e029c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:31.279510 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c53c4269-a475-4915-ad4c-7c9c9ddb3180 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:31.295231 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c53c4269-a475-4915-ad4c-7c9c9ddb3180 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071" status: 200 len: 1278 microversion: 2.1 time: 0.310958 Sep 07 12:41:31.295968 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1240/2508] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:30 2022] GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071 => generated 1278 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:31.318044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e962cab6-31cc-4920-a176-b2bdbd935fdc tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Action: 'update_all', calling method: .version_select at 0x7fc4188e19d0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:31.497664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e962cab6-31cc-4920-a176-b2bdbd935fdc tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Getting quotas for project f3795ca9f10f4043b3c4b006bd87cac2. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:41:31.512307 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e962cab6-31cc-4920-a176-b2bdbd935fdc tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Getting quotas for user e23223b336d4435f868016d39a5a638a and project f3795ca9f10f4043b3c4b006bd87cac2. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:41:32.391392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fea198b5-da22-45d0-8d2a-5e85323e029c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:32.405476 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fea198b5-da22-45d0-8d2a-5e85323e029c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/6762b361-a49e-467e-ba9b-cebfb35d9a58" status: 200 len: 1318 microversion: 2.1 time: 1.261053 Sep 07 12:41:32.425533 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1269/2509] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:31 2022] GET /compute/v2.1/servers/6762b361-a49e-467e-ba9b-cebfb35d9a58 => generated 1318 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:32.425533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9b77d3f4-d067-40e6-b5da-4201412a30a2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:32.425533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9b77d3f4-d067-40e6-b5da-4201412a30a2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:32.451893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b77d3f4-d067-40e6-b5da-4201412a30a2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:32.456166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b77d3f4-d067-40e6-b5da-4201412a30a2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:32.457935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b77d3f4-d067-40e6-b5da-4201412a30a2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:32.459605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b77d3f4-d067-40e6-b5da-4201412a30a2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:32.467246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b77d3f4-d067-40e6-b5da-4201412a30a2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:32.467887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b77d3f4-d067-40e6-b5da-4201412a30a2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:32.925223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9b77d3f4-d067-40e6-b5da-4201412a30a2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:32.935469 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9b77d3f4-d067-40e6-b5da-4201412a30a2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1524 microversion: 2.1 time: 0.517275 Sep 07 12:41:32.940131 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1270/2510] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:32 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1524 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:32.956631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5b59f9c9-3b41-405e-b784-1f63af054fc8 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc41848eee0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:35.379955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:41:36.611410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:41:40.733059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=40 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:41:41.284200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:41:41.486116 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e962cab6-31cc-4920-a176-b2bdbd935fdc tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] 10.222.0.16 "PUT /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata" status: 200 len: 64 microversion: 2.1 time: 10.179030 Sep 07 12:41:41.487362 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1241/2511] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 12:41:31 2022] PUT /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata => generated 64 bytes in 10191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:41:41.494309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-45a9786c-6a0d-419b-b242-b92875b79ff0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:41.494972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-45a9786c-6a0d-419b-b242-b92875b79ff0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:41.528929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45a9786c-6a0d-419b-b242-b92875b79ff0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:41.529447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45a9786c-6a0d-419b-b242-b92875b79ff0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:41.529926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45a9786c-6a0d-419b-b242-b92875b79ff0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:41.530664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45a9786c-6a0d-419b-b242-b92875b79ff0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:41.531130 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45a9786c-6a0d-419b-b242-b92875b79ff0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:41.531888 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45a9786c-6a0d-419b-b242-b92875b79ff0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:41.532492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=22 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:41:41.594450 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5b59f9c9-3b41-405e-b784-1f63af054fc8 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf" status: 200 len: 1431 microversion: 2.1 time: 8.648017 Sep 07 12:41:41.599028 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1271/2512] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:41:32 2022] GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf => generated 1431 bytes in 8654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:41.616376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3c400382-f93a-420c-924d-77e289e90dc1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:41.619605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3c400382-f93a-420c-924d-77e289e90dc1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 2360d1da-9d70-4484-be65-d3cc510b9071] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:41.632757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c400382-f93a-420c-924d-77e289e90dc1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:41.635958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c400382-f93a-420c-924d-77e289e90dc1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:41.637283 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c400382-f93a-420c-924d-77e289e90dc1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:41.638989 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c400382-f93a-420c-924d-77e289e90dc1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:41.640112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c400382-f93a-420c-924d-77e289e90dc1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:41.641144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c400382-f93a-420c-924d-77e289e90dc1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:41.650364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=82 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:41:41.733192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-45a9786c-6a0d-419b-b242-b92875b79ff0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d991fa2c5754b14a7a0e638b486f06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d453f24efa048f0a67ab7834d0005c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:41.746816 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-45a9786c-6a0d-419b-b242-b92875b79ff0 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f" status: 200 len: 1253 microversion: 2.1 time: 0.258234 Sep 07 12:41:41.747437 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1242/2513] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:41 2022] GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f => generated 1253 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:41.752646 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-56aee2f2-0431-4812-aa15-1d659dfa2e46 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:41.766085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-56aee2f2-0431-4812-aa15-1d659dfa2e46 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 6762b361-a49e-467e-ba9b-cebfb35d9a58] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:41.778281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56aee2f2-0431-4812-aa15-1d659dfa2e46 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:41.779053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56aee2f2-0431-4812-aa15-1d659dfa2e46 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:41.779657 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56aee2f2-0431-4812-aa15-1d659dfa2e46 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:41.780582 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56aee2f2-0431-4812-aa15-1d659dfa2e46 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:41.785560 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56aee2f2-0431-4812-aa15-1d659dfa2e46 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:41.786353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56aee2f2-0431-4812-aa15-1d659dfa2e46 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:41.812017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3c400382-f93a-420c-924d-77e289e90dc1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:41.831145 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3c400382-f93a-420c-924d-77e289e90dc1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071" status: 200 len: 1278 microversion: 2.1 time: 0.230165 Sep 07 12:41:41.833317 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1272/2514] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:41 2022] GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071 => generated 1278 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:41.846904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0801b4b6-6c1a-4fa7-844d-285b54b9db34 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:41.848647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0801b4b6-6c1a-4fa7-844d-285b54b9db34 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:41.858023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0801b4b6-6c1a-4fa7-844d-285b54b9db34 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:41.858793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0801b4b6-6c1a-4fa7-844d-285b54b9db34 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:41.859590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0801b4b6-6c1a-4fa7-844d-285b54b9db34 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:41.860579 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0801b4b6-6c1a-4fa7-844d-285b54b9db34 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:41.861387 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0801b4b6-6c1a-4fa7-844d-285b54b9db34 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:41.862031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0801b4b6-6c1a-4fa7-844d-285b54b9db34 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:42.224191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-56aee2f2-0431-4812-aa15-1d659dfa2e46 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:42.237840 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-56aee2f2-0431-4812-aa15-1d659dfa2e46 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/6762b361-a49e-467e-ba9b-cebfb35d9a58" status: 200 len: 1318 microversion: 2.1 time: 0.486979 Sep 07 12:41:42.239101 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1243/2515] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:41 2022] GET /compute/v2.1/servers/6762b361-a49e-467e-ba9b-cebfb35d9a58 => generated 1318 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:42.252911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-53ed3d8a-77c4-4cb0-af2f-e0589ec10206 req-b520cf95-7e7d-4468-8d0d-7b844cd82dab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abbf48d7-8190-4dde-8fb6-95d83eccf1b3", "tag": "262fba0b-3e24-4471-8a3a-2854f1151108"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:42.291228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-53ed3d8a-77c4-4cb0-af2f-e0589ec10206 req-b520cf95-7e7d-4468-8d0d-7b844cd82dab service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:42.291909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-53ed3d8a-77c4-4cb0-af2f-e0589ec10206 req-b520cf95-7e7d-4468-8d0d-7b844cd82dab service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:42.292144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-53ed3d8a-77c4-4cb0-af2f-e0589ec10206 req-b520cf95-7e7d-4468-8d0d-7b844cd82dab service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:42.308122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0801b4b6-6c1a-4fa7-844d-285b54b9db34 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:42.316853 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0801b4b6-6c1a-4fa7-844d-285b54b9db34 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1524 microversion: 2.1 time: 0.481267 Sep 07 12:41:42.339235 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1273/2516] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:41 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1524 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:42.341095 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-53ed3d8a-77c4-4cb0-af2f-e0589ec10206 req-b520cf95-7e7d-4468-8d0d-7b844cd82dab service nova] Creating event network-changed:262fba0b-3e24-4471-8a3a-2854f1151108 for instance abbf48d7-8190-4dde-8fb6-95d83eccf1b3 on n-h2-852087-9 Sep 07 12:41:42.358104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b2405da2-3838-46ba-b487-2c4f8776e993 req-627ff2c4-9160-4e96-b26b-f9fc87fe3031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71999ea2-9256-4783-8614-0d28d11aab2f", "name": "network-vif-deleted", "tag": "175df065-8068-401b-adb5-2c7be0ceb530"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:42.359457 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-53ed3d8a-77c4-4cb0-af2f-e0589ec10206 req-b520cf95-7e7d-4468-8d0d-7b844cd82dab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118753 Sep 07 12:41:42.360447 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1244/2517] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:41:42.380013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-63f18426-c891-49ff-9930-c958132fdb62 req-c22e348f-8d38-4fc9-88cf-13ef09a07a7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8d74fd-0b94-465e-a644-a44170def51c", "name": "network-vif-plugged", "status": "completed", "tag": "798531a0-1079-41ca-b03b-2f727c036b56"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:42.405963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b2405da2-3838-46ba-b487-2c4f8776e993 req-627ff2c4-9160-4e96-b26b-f9fc87fe3031 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:42.406894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b2405da2-3838-46ba-b487-2c4f8776e993 req-627ff2c4-9160-4e96-b26b-f9fc87fe3031 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:42.407824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b2405da2-3838-46ba-b487-2c4f8776e993 req-627ff2c4-9160-4e96-b26b-f9fc87fe3031 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:42.416373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-63f18426-c891-49ff-9930-c958132fdb62 req-c22e348f-8d38-4fc9-88cf-13ef09a07a7a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:42.416933 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-63f18426-c891-49ff-9930-c958132fdb62 req-c22e348f-8d38-4fc9-88cf-13ef09a07a7a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:42.417419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-63f18426-c891-49ff-9930-c958132fdb62 req-c22e348f-8d38-4fc9-88cf-13ef09a07a7a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:42.447877 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-63f18426-c891-49ff-9930-c958132fdb62 req-c22e348f-8d38-4fc9-88cf-13ef09a07a7a service nova] Creating event network-vif-plugged:798531a0-1079-41ca-b03b-2f727c036b56 for instance 9b8d74fd-0b94-465e-a644-a44170def51c on n-h2-852087-9 Sep 07 12:41:42.465626 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b2405da2-3838-46ba-b487-2c4f8776e993 req-627ff2c4-9160-4e96-b26b-f9fc87fe3031 service nova] Creating event network-vif-deleted:175df065-8068-401b-adb5-2c7be0ceb530 for instance 71999ea2-9256-4783-8614-0d28d11aab2f on n-h1-852087-9 Sep 07 12:41:42.470116 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-63f18426-c891-49ff-9930-c958132fdb62 req-c22e348f-8d38-4fc9-88cf-13ef09a07a7a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107350 Sep 07 12:41:42.471058 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1245/2518] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:41:42.479415 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b2405da2-3838-46ba-b487-2c4f8776e993 req-627ff2c4-9160-4e96-b26b-f9fc87fe3031 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138755 Sep 07 12:41:42.486468 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1274/2519] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:41:42.492830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-65ae7de5-760a-4c0d-be7f-9b949a3112b4 tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Calling method '.version_select at 0x7fc418beed30>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:42.500777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-38624b08-a1cc-4b1a-82ab-092d9a23f022 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc41d2f3c10>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:42.630138 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-38624b08-a1cc-4b1a-82ab-092d9a23f022 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf" status: 200 len: 1431 microversion: 2.1 time: 0.142214 Sep 07 12:41:42.632096 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1275/2520] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:41:42 2022] GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf => generated 1431 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:42.645509 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-65ae7de5-760a-4c0d-be7f-9b949a3112b4 tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] 10.222.0.16 "GET /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata" status: 200 len: 64 microversion: 2.1 time: 0.173117 Sep 07 12:41:42.646127 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1246/2521] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Sep 7 12:41:42 2022] GET /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata => generated 64 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:41:42.651581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bc90bba1-70b9-4708-bac6-aad6e0741a2b tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:42.651915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bc90bba1-70b9-4708-bac6-aad6e0741a2b tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:42.657474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-70a832d2-79f3-465f-91d4-c85804660d1c tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Action: 'update_all', calling method: .version_select at 0x7fc41d190940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:42.671059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc90bba1-70b9-4708-bac6-aad6e0741a2b tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:42.671579 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc90bba1-70b9-4708-bac6-aad6e0741a2b tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:42.672027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc90bba1-70b9-4708-bac6-aad6e0741a2b tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:42.672781 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc90bba1-70b9-4708-bac6-aad6e0741a2b tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:42.673253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc90bba1-70b9-4708-bac6-aad6e0741a2b tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:42.679295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc90bba1-70b9-4708-bac6-aad6e0741a2b tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:42.735321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:41:42.754270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-70a832d2-79f3-465f-91d4-c85804660d1c tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Getting quotas for project f3795ca9f10f4043b3c4b006bd87cac2. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:41:42.770257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-70a832d2-79f3-465f-91d4-c85804660d1c tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Getting quotas for user e23223b336d4435f868016d39a5a638a and project f3795ca9f10f4043b3c4b006bd87cac2. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:41:43.660654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bc90bba1-70b9-4708-bac6-aad6e0741a2b tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f493fa6856847b4ae7cc8eb997a14c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b06047717c4a5ca47ebc72587256fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:43.675199 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bc90bba1-70b9-4708-bac6-aad6e0741a2b tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce" status: 200 len: 1479 microversion: 2.1 time: 1.032474 Sep 07 12:41:43.688402 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1276/2522] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:42 2022] GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce => generated 1479 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:41:43.702649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-daf16001-53d2-452f-b45b-a92313c51305 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:43.704692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-daf16001-53d2-452f-b45b-a92313c51305 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:43.738603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-daf16001-53d2-452f-b45b-a92313c51305 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:43.740120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-daf16001-53d2-452f-b45b-a92313c51305 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:43.744499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-daf16001-53d2-452f-b45b-a92313c51305 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:43.745749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-daf16001-53d2-452f-b45b-a92313c51305 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:43.748351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-daf16001-53d2-452f-b45b-a92313c51305 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:43.751465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-daf16001-53d2-452f-b45b-a92313c51305 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:43.767942 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-70a832d2-79f3-465f-91d4-c85804660d1c tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] 10.222.0.16 "PUT /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata" status: 200 len: 61 microversion: 2.1 time: 1.114358 Sep 07 12:41:43.769644 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1247/2523] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 12:41:42 2022] PUT /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata => generated 61 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:41:43.794902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-609383e6-4329-4413-9e5b-79a748ae1be4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:43.799303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-609383e6-4329-4413-9e5b-79a748ae1be4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 2360d1da-9d70-4484-be65-d3cc510b9071] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:43.830985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-609383e6-4329-4413-9e5b-79a748ae1be4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:43.831851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-609383e6-4329-4413-9e5b-79a748ae1be4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:43.832525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-609383e6-4329-4413-9e5b-79a748ae1be4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:43.833767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-609383e6-4329-4413-9e5b-79a748ae1be4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:43.834418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-609383e6-4329-4413-9e5b-79a748ae1be4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:43.835236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-609383e6-4329-4413-9e5b-79a748ae1be4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:44.232745 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-daf16001-53d2-452f-b45b-a92313c51305 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d991fa2c5754b14a7a0e638b486f06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d453f24efa048f0a67ab7834d0005c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:44.249237 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-daf16001-53d2-452f-b45b-a92313c51305 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f" status: 200 len: 1253 microversion: 2.1 time: 0.559336 Sep 07 12:41:44.253864 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1277/2524] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:43 2022] GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f => generated 1253 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:44.262752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32855d04-ba6c-446c-8d5e-7dfe3084aa11 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:44.266227 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-32855d04-ba6c-446c-8d5e-7dfe3084aa11 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 6762b361-a49e-467e-ba9b-cebfb35d9a58] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:44.281941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32855d04-ba6c-446c-8d5e-7dfe3084aa11 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:44.284700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32855d04-ba6c-446c-8d5e-7dfe3084aa11 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:44.285783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32855d04-ba6c-446c-8d5e-7dfe3084aa11 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:44.286935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32855d04-ba6c-446c-8d5e-7dfe3084aa11 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:44.295078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32855d04-ba6c-446c-8d5e-7dfe3084aa11 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:44.296737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32855d04-ba6c-446c-8d5e-7dfe3084aa11 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:44.308285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-609383e6-4329-4413-9e5b-79a748ae1be4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:44.322331 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-609383e6-4329-4413-9e5b-79a748ae1be4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071" status: 200 len: 1320 microversion: 2.1 time: 0.550372 Sep 07 12:41:44.323559 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1248/2525] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:43 2022] GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071 => generated 1320 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:44.331219 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d7ef4e0f-e687-444f-97bd-127c04980134 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:44.332096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d7ef4e0f-e687-444f-97bd-127c04980134 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:44.340108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7ef4e0f-e687-444f-97bd-127c04980134 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:44.341085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7ef4e0f-e687-444f-97bd-127c04980134 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:44.342140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7ef4e0f-e687-444f-97bd-127c04980134 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:44.343294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7ef4e0f-e687-444f-97bd-127c04980134 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:44.344110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7ef4e0f-e687-444f-97bd-127c04980134 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:44.345910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7ef4e0f-e687-444f-97bd-127c04980134 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:44.963889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-32855d04-ba6c-446c-8d5e-7dfe3084aa11 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:44.976795 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-32855d04-ba6c-446c-8d5e-7dfe3084aa11 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/6762b361-a49e-467e-ba9b-cebfb35d9a58" status: 200 len: 1318 microversion: 2.1 time: 0.720903 Sep 07 12:41:44.981861 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1278/2526] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:44 2022] GET /compute/v2.1/servers/6762b361-a49e-467e-ba9b-cebfb35d9a58 => generated 1318 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:44.995265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d7ef4e0f-e687-444f-97bd-127c04980134 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:45.006368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5738bbeb-95c7-4913-a8a9-fc8bda64d8cf tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Action: 'update', calling method: .version_select at 0x7fc4188f3430>, body: {"meta": {"os_version": "alt"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:45.011994 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d7ef4e0f-e687-444f-97bd-127c04980134 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1524 microversion: 2.1 time: 0.687070 Sep 07 12:41:45.039601 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1249/2527] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:44 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1524 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:45.062265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-355d98a8-932b-4bf9-9a55-88ba12d36be4 req-c603e3d9-8978-4ea8-b0ae-557d0e089222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6762b361-a49e-467e-ba9b-cebfb35d9a58", "tag": "5662afc1-dcd4-46fd-a437-6fc43e3c2295"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:45.116000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-355d98a8-932b-4bf9-9a55-88ba12d36be4 req-c603e3d9-8978-4ea8-b0ae-557d0e089222 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:45.116685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-355d98a8-932b-4bf9-9a55-88ba12d36be4 req-c603e3d9-8978-4ea8-b0ae-557d0e089222 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:45.117234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-355d98a8-932b-4bf9-9a55-88ba12d36be4 req-c603e3d9-8978-4ea8-b0ae-557d0e089222 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:45.147501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-5738bbeb-95c7-4913-a8a9-fc8bda64d8cf tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Getting quotas for project f3795ca9f10f4043b3c4b006bd87cac2. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:41:45.164451 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-355d98a8-932b-4bf9-9a55-88ba12d36be4 req-c603e3d9-8978-4ea8-b0ae-557d0e089222 service nova] Creating event network-changed:5662afc1-dcd4-46fd-a437-6fc43e3c2295 for instance 6762b361-a49e-467e-ba9b-cebfb35d9a58 on n-h1-852087-9 Sep 07 12:41:45.164707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-5738bbeb-95c7-4913-a8a9-fc8bda64d8cf tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Getting quotas for user e23223b336d4435f868016d39a5a638a and project f3795ca9f10f4043b3c4b006bd87cac2. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:41:45.183339 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-355d98a8-932b-4bf9-9a55-88ba12d36be4 req-c603e3d9-8978-4ea8-b0ae-557d0e089222 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142124 Sep 07 12:41:45.184488 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1250/2528] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:41:45.190317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b071c59d-3a49-4ece-a1c3-80718a2aa0b7 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:45.204812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b071c59d-3a49-4ece-a1c3-80718a2aa0b7 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:45.239986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b071c59d-3a49-4ece-a1c3-80718a2aa0b7 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:45.250233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b071c59d-3a49-4ece-a1c3-80718a2aa0b7 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:45.252244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b071c59d-3a49-4ece-a1c3-80718a2aa0b7 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:45.253155 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b071c59d-3a49-4ece-a1c3-80718a2aa0b7 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:45.256834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b071c59d-3a49-4ece-a1c3-80718a2aa0b7 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:45.257720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b071c59d-3a49-4ece-a1c3-80718a2aa0b7 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:45.976492 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5738bbeb-95c7-4913-a8a9-fc8bda64d8cf tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] 10.222.0.16 "PUT /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.992800 Sep 07 12:41:45.977471 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1279/2529] 10.222.0.16 () {60 vars in 1313 bytes} [Wed Sep 7 12:41:44 2022] PUT /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata/os_version => generated 31 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:41:45.983822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-623a3e91-f293-4834-a03a-f0dbc7a494fb req-f5b9e6fd-5b9f-4d51-9547-4d5dfd195d29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "886a386f-a0cc-4d90-96ac-4e418ed43bce", "name": "network-vif-unplugged", "status": "completed", "tag": "a0ca592a-191a-4417-974a-0fdc230ebb1c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:46.048485 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-623a3e91-f293-4834-a03a-f0dbc7a494fb req-f5b9e6fd-5b9f-4d51-9547-4d5dfd195d29 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:46.049003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-623a3e91-f293-4834-a03a-f0dbc7a494fb req-f5b9e6fd-5b9f-4d51-9547-4d5dfd195d29 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:46.049451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-623a3e91-f293-4834-a03a-f0dbc7a494fb req-f5b9e6fd-5b9f-4d51-9547-4d5dfd195d29 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:46.099140 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-623a3e91-f293-4834-a03a-f0dbc7a494fb req-f5b9e6fd-5b9f-4d51-9547-4d5dfd195d29 service nova] Creating event network-vif-unplugged:a0ca592a-191a-4417-974a-0fdc230ebb1c for instance 886a386f-a0cc-4d90-96ac-4e418ed43bce on n-h1-852087-9 Sep 07 12:41:46.125425 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-623a3e91-f293-4834-a03a-f0dbc7a494fb req-f5b9e6fd-5b9f-4d51-9547-4d5dfd195d29 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.146533 Sep 07 12:41:46.126097 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1280/2530] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:41:46.153149 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c55b7656-30d4-4f6e-9242-4cf1bf608be7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:46.154908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c55b7656-30d4-4f6e-9242-4cf1bf608be7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:46.181382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c55b7656-30d4-4f6e-9242-4cf1bf608be7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:46.181976 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c55b7656-30d4-4f6e-9242-4cf1bf608be7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:46.191020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c55b7656-30d4-4f6e-9242-4cf1bf608be7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:46.192000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c55b7656-30d4-4f6e-9242-4cf1bf608be7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:46.194491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c55b7656-30d4-4f6e-9242-4cf1bf608be7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:46.195045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c55b7656-30d4-4f6e-9242-4cf1bf608be7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:46.281647 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b071c59d-3a49-4ece-a1c3-80718a2aa0b7 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f493fa6856847b4ae7cc8eb997a14c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b06047717c4a5ca47ebc72587256fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:46.293422 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b071c59d-3a49-4ece-a1c3-80718a2aa0b7 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce" status: 200 len: 1466 microversion: 2.1 time: 1.107392 Sep 07 12:41:46.296106 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1251/2531] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:45 2022] GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce => generated 1466 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:46.302799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b4b20efb-a6f6-426c-b5e7-f7e8b1386a85 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:46.310780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b4b20efb-a6f6-426c-b5e7-f7e8b1386a85 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 2360d1da-9d70-4484-be65-d3cc510b9071] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:46.323631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4b20efb-a6f6-426c-b5e7-f7e8b1386a85 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:46.326894 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4b20efb-a6f6-426c-b5e7-f7e8b1386a85 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:46.327660 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4b20efb-a6f6-426c-b5e7-f7e8b1386a85 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:46.328986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4b20efb-a6f6-426c-b5e7-f7e8b1386a85 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:46.331379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4b20efb-a6f6-426c-b5e7-f7e8b1386a85 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:46.337019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4b20efb-a6f6-426c-b5e7-f7e8b1386a85 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:46.680298 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c55b7656-30d4-4f6e-9242-4cf1bf608be7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d991fa2c5754b14a7a0e638b486f06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d453f24efa048f0a67ab7834d0005c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:46.698400 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c55b7656-30d4-4f6e-9242-4cf1bf608be7 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f" status: 200 len: 1253 microversion: 2.1 time: 0.563543 Sep 07 12:41:46.701269 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1281/2532] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:46 2022] GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f => generated 1253 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:46.724348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-6a9d22d6-e86e-4da2-98b7-71d2f65e062c req-aed00d16-3bb6-48dd-805b-0853d03465e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d248e06-d37c-4895-85a8-e8c5e412aedb", "tag": "9ed5605a-00bc-4fa2-920f-050b6706d609"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:46.783901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6a9d22d6-e86e-4da2-98b7-71d2f65e062c req-aed00d16-3bb6-48dd-805b-0853d03465e0 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:46.784764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6a9d22d6-e86e-4da2-98b7-71d2f65e062c req-aed00d16-3bb6-48dd-805b-0853d03465e0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:46.785397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6a9d22d6-e86e-4da2-98b7-71d2f65e062c req-aed00d16-3bb6-48dd-805b-0853d03465e0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:46.828747 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-6a9d22d6-e86e-4da2-98b7-71d2f65e062c req-aed00d16-3bb6-48dd-805b-0853d03465e0 service nova] Creating event network-changed:9ed5605a-00bc-4fa2-920f-050b6706d609 for instance 8d248e06-d37c-4895-85a8-e8c5e412aedb on n-h2-852087-9 Sep 07 12:41:46.844678 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-6a9d22d6-e86e-4da2-98b7-71d2f65e062c req-aed00d16-3bb6-48dd-805b-0853d03465e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137124 Sep 07 12:41:46.848580 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1282/2533] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:41:46.866766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4891cd6f-ae40-42ae-abbb-2d357e3c54ca tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Calling method '.version_select at 0x7fc41855e820>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:46.968587 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4891cd6f-ae40-42ae-abbb-2d357e3c54ca tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] 10.222.0.16 "GET /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata" status: 200 len: 58 microversion: 2.1 time: 0.118033 Sep 07 12:41:46.969185 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1283/2534] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Sep 7 12:41:46 2022] GET /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata => generated 58 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:41:46.979962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-accf30f7-aedb-42fc-85f3-a40920240408 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:46.982279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-accf30f7-aedb-42fc-85f3-a40920240408 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 6762b361-a49e-467e-ba9b-cebfb35d9a58] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:47.005523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-accf30f7-aedb-42fc-85f3-a40920240408 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:47.007211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-accf30f7-aedb-42fc-85f3-a40920240408 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:47.008985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-accf30f7-aedb-42fc-85f3-a40920240408 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:47.011716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-accf30f7-aedb-42fc-85f3-a40920240408 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:47.012737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-accf30f7-aedb-42fc-85f3-a40920240408 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:47.015323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-accf30f7-aedb-42fc-85f3-a40920240408 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:47.399867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b4b20efb-a6f6-426c-b5e7-f7e8b1386a85 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:47.437553 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b4b20efb-a6f6-426c-b5e7-f7e8b1386a85 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071" status: 200 len: 1320 microversion: 2.1 time: 1.139525 Sep 07 12:41:47.454481 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1252/2535] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:46 2022] GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071 => generated 1320 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:47.465146 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de66a332-9641-4732-b420-a0ea54e8f464 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:47.488682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-de66a332-9641-4732-b420-a0ea54e8f464 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:47.505396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de66a332-9641-4732-b420-a0ea54e8f464 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:47.513370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de66a332-9641-4732-b420-a0ea54e8f464 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:47.516606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de66a332-9641-4732-b420-a0ea54e8f464 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:47.517749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de66a332-9641-4732-b420-a0ea54e8f464 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:47.518535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de66a332-9641-4732-b420-a0ea54e8f464 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:47.519091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de66a332-9641-4732-b420-a0ea54e8f464 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:47.813352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-accf30f7-aedb-42fc-85f3-a40920240408 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:47.825994 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-accf30f7-aedb-42fc-85f3-a40920240408 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/6762b361-a49e-467e-ba9b-cebfb35d9a58" status: 200 len: 1318 microversion: 2.1 time: 0.852371 Sep 07 12:41:47.829685 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1284/2536] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:46 2022] GET /compute/v2.1/servers/6762b361-a49e-467e-ba9b-cebfb35d9a58 => generated 1318 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:47.844049 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ba3462d3-beef-44fb-abaf-039f321a6042 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc41854ef70>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:47.957797 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ba3462d3-beef-44fb-abaf-039f321a6042 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/a5dd2b4d-ee9d-44eb-b267-89e80edd276f" status: 200 len: 784 microversion: 2.1 time: 0.124768 Sep 07 12:41:47.958930 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1285/2537] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:41:47 2022] GET /compute/v2.1/images/a5dd2b4d-ee9d-44eb-b267-89e80edd276f => generated 784 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:41:47.973882 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-021fcca6-0a9c-4276-8aa3-f4e735ace158 tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Action: 'update_all', calling method: .version_select at 0x7fc419487040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:48.062293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-de66a332-9641-4732-b420-a0ea54e8f464 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:48.075051 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-de66a332-9641-4732-b420-a0ea54e8f464 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1524 microversion: 2.1 time: 0.617284 Sep 07 12:41:48.079015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-021fcca6-0a9c-4276-8aa3-f4e735ace158 tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Getting quotas for project f3795ca9f10f4043b3c4b006bd87cac2. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:41:48.094748 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1253/2538] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:47 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1524 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:48.102559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0425b06b-7c6a-41c5-819d-1e096e6c4db2 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:48.107995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0425b06b-7c6a-41c5-819d-1e096e6c4db2 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:48.112398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-021fcca6-0a9c-4276-8aa3-f4e735ace158 tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Getting quotas for user e23223b336d4435f868016d39a5a638a and project f3795ca9f10f4043b3c4b006bd87cac2. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:41:48.130309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0425b06b-7c6a-41c5-819d-1e096e6c4db2 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:48.131204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0425b06b-7c6a-41c5-819d-1e096e6c4db2 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:48.131962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0425b06b-7c6a-41c5-819d-1e096e6c4db2 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:48.136777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0425b06b-7c6a-41c5-819d-1e096e6c4db2 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:48.137810 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0425b06b-7c6a-41c5-819d-1e096e6c4db2 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:48.139186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0425b06b-7c6a-41c5-819d-1e096e6c4db2 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:48.251790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0425b06b-7c6a-41c5-819d-1e096e6c4db2 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d991fa2c5754b14a7a0e638b486f06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d453f24efa048f0a67ab7834d0005c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:48.261290 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0425b06b-7c6a-41c5-819d-1e096e6c4db2 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f" status: 200 len: 1253 microversion: 2.1 time: 0.164914 Sep 07 12:41:48.263260 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1254/2539] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:48 2022] GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f => generated 1253 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:48.270257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-db27301f-92ae-4042-a43d-1ec5be2d90e6 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:48.279745 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-db27301f-92ae-4042-a43d-1ec5be2d90e6 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014832 Sep 07 12:41:48.280686 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1255/2540] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:41:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:41:48.286929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-46f2d80f-d021-471f-a22b-36c7ed949697 req-78c58d0d-1c0a-4e17-a343-fe83a101d9da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abbf48d7-8190-4dde-8fb6-95d83eccf1b3", "name": "network-vif-plugged", "status": "completed", "tag": "262fba0b-3e24-4471-8a3a-2854f1151108"}, {"server_uuid": "6762b361-a49e-467e-ba9b-cebfb35d9a58", "name": "network-vif-plugged", "status": "completed", "tag": "5662afc1-dcd4-46fd-a437-6fc43e3c2295"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:48.361380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-46f2d80f-d021-471f-a22b-36c7ed949697 req-78c58d0d-1c0a-4e17-a343-fe83a101d9da service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:48.361675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-46f2d80f-d021-471f-a22b-36c7ed949697 req-78c58d0d-1c0a-4e17-a343-fe83a101d9da service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:48.362517 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-46f2d80f-d021-471f-a22b-36c7ed949697 req-78c58d0d-1c0a-4e17-a343-fe83a101d9da service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:48.415606 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-46f2d80f-d021-471f-a22b-36c7ed949697 req-78c58d0d-1c0a-4e17-a343-fe83a101d9da service nova] Creating event network-vif-plugged:262fba0b-3e24-4471-8a3a-2854f1151108 for instance abbf48d7-8190-4dde-8fb6-95d83eccf1b3 on n-h2-852087-9 Sep 07 12:41:48.420377 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-46f2d80f-d021-471f-a22b-36c7ed949697 req-78c58d0d-1c0a-4e17-a343-fe83a101d9da service nova] Creating event network-vif-plugged:5662afc1-dcd4-46fd-a437-6fc43e3c2295 for instance 6762b361-a49e-467e-ba9b-cebfb35d9a58 on n-h1-852087-9 Sep 07 12:41:48.459982 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-46f2d80f-d021-471f-a22b-36c7ed949697 req-78c58d0d-1c0a-4e17-a343-fe83a101d9da service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.173176 Sep 07 12:41:48.464310 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1256/2541] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:41:48.493165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-230d6d9f-76a4-47c3-bc97-72b538efcfee tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc41850b700>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:50.378770 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-230d6d9f-76a4-47c3-bc97-72b538efcfee tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "DELETE /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf" status: 204 len: 0 microversion: 2.1 time: 1.904818 Sep 07 12:41:50.380718 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1257/2542] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:48 2022] DELETE /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf => generated 0 bytes in 1914 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:41:50.387633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a9efdd18-292a-4ea0-aafe-8335324e678a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:50.390300 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a9efdd18-292a-4ea0-aafe-8335324e678a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 2360d1da-9d70-4484-be65-d3cc510b9071] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:50.402984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9efdd18-292a-4ea0-aafe-8335324e678a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:50.403934 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9efdd18-292a-4ea0-aafe-8335324e678a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:50.406182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9efdd18-292a-4ea0-aafe-8335324e678a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:50.421640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9efdd18-292a-4ea0-aafe-8335324e678a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:50.422543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9efdd18-292a-4ea0-aafe-8335324e678a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:50.423215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9efdd18-292a-4ea0-aafe-8335324e678a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:50.450344 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-021fcca6-0a9c-4276-8aa3-f4e735ace158 tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] 10.222.0.16 "PUT /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata" status: 200 len: 61 microversion: 2.1 time: 2.489818 Sep 07 12:41:50.452028 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1286/2543] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 12:41:47 2022] PUT /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata => generated 61 bytes in 2492 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:41:50.458052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-849bfc4b-faa8-4571-88e7-9bcaaf93b83f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:50.462002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-849bfc4b-faa8-4571-88e7-9bcaaf93b83f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 6762b361-a49e-467e-ba9b-cebfb35d9a58] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:50.497401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-849bfc4b-faa8-4571-88e7-9bcaaf93b83f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:50.498813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-849bfc4b-faa8-4571-88e7-9bcaaf93b83f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:50.500852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-849bfc4b-faa8-4571-88e7-9bcaaf93b83f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:50.508761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-849bfc4b-faa8-4571-88e7-9bcaaf93b83f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:50.509686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-849bfc4b-faa8-4571-88e7-9bcaaf93b83f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:50.511749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-849bfc4b-faa8-4571-88e7-9bcaaf93b83f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:50.930787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a9efdd18-292a-4ea0-aafe-8335324e678a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:50.952401 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a9efdd18-292a-4ea0-aafe-8335324e678a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071" status: 200 len: 1320 microversion: 2.1 time: 0.569967 Sep 07 12:41:50.953660 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1258/2544] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:50 2022] GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071 => generated 1320 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:51.001370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d104eeca-a9a2-4ed5-9286-530b50b76963 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:51.004555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d104eeca-a9a2-4ed5-9286-530b50b76963 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:51.057454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d104eeca-a9a2-4ed5-9286-530b50b76963 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:51.059978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d104eeca-a9a2-4ed5-9286-530b50b76963 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:51.064324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d104eeca-a9a2-4ed5-9286-530b50b76963 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:51.107217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d104eeca-a9a2-4ed5-9286-530b50b76963 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:51.115765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d104eeca-a9a2-4ed5-9286-530b50b76963 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.041s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:51.119007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d104eeca-a9a2-4ed5-9286-530b50b76963 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:51.133245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-849bfc4b-faa8-4571-88e7-9bcaaf93b83f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:51.145220 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-849bfc4b-faa8-4571-88e7-9bcaaf93b83f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/6762b361-a49e-467e-ba9b-cebfb35d9a58" status: 200 len: 1318 microversion: 2.1 time: 0.691672 Sep 07 12:41:51.145831 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1287/2545] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:50 2022] GET /compute/v2.1/servers/6762b361-a49e-467e-ba9b-cebfb35d9a58 => generated 1318 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:51.158394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e215cd8c-9d5c-4aa3-8cd4-eb8d9e13aef5 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:51.159292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e215cd8c-9d5c-4aa3-8cd4-eb8d9e13aef5 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:51.197432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e215cd8c-9d5c-4aa3-8cd4-eb8d9e13aef5 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:51.208062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e215cd8c-9d5c-4aa3-8cd4-eb8d9e13aef5 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:51.210222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e215cd8c-9d5c-4aa3-8cd4-eb8d9e13aef5 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:51.211238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e215cd8c-9d5c-4aa3-8cd4-eb8d9e13aef5 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:51.211723 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e215cd8c-9d5c-4aa3-8cd4-eb8d9e13aef5 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:51.212202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e215cd8c-9d5c-4aa3-8cd4-eb8d9e13aef5 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:51.513209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e215cd8c-9d5c-4aa3-8cd4-eb8d9e13aef5 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d991fa2c5754b14a7a0e638b486f06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d453f24efa048f0a67ab7834d0005c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:51.540748 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e215cd8c-9d5c-4aa3-8cd4-eb8d9e13aef5 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f" status: 200 len: 1253 microversion: 2.1 time: 0.386189 Sep 07 12:41:51.543900 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1288/2546] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:51 2022] GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f => generated 1253 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:51.572955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-23ce74e1-7640-4374-b6d6-c52d7998a55e req-37255f60-60bc-418c-859e-095c1325ede7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2360d1da-9d70-4484-be65-d3cc510b9071", "tag": "4aa46be9-0029-4660-9d0d-2f5b8ec0dbe6"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:51.605827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-23ce74e1-7640-4374-b6d6-c52d7998a55e req-37255f60-60bc-418c-859e-095c1325ede7 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:51.606333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-23ce74e1-7640-4374-b6d6-c52d7998a55e req-37255f60-60bc-418c-859e-095c1325ede7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:51.606779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-23ce74e1-7640-4374-b6d6-c52d7998a55e req-37255f60-60bc-418c-859e-095c1325ede7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:51.656044 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-23ce74e1-7640-4374-b6d6-c52d7998a55e req-37255f60-60bc-418c-859e-095c1325ede7 service nova] Creating event network-changed:4aa46be9-0029-4660-9d0d-2f5b8ec0dbe6 for instance 2360d1da-9d70-4484-be65-d3cc510b9071 on n-h1-852087-9 Sep 07 12:41:51.668254 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-23ce74e1-7640-4374-b6d6-c52d7998a55e req-37255f60-60bc-418c-859e-095c1325ede7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119791 Sep 07 12:41:51.669818 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1289/2547] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:41:51.673584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d104eeca-a9a2-4ed5-9286-530b50b76963 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:51.683984 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d104eeca-a9a2-4ed5-9286-530b50b76963 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1524 microversion: 2.1 time: 0.720885 Sep 07 12:41:51.692168 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1259/2548] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:50 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1524 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:51.694356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-88376874-ec91-4420-aeb7-09b13b146803 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc418410430>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:51.710895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7d8f4bc9-d041-4194-89d7-3f939fe332fa tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Action: 'create', calling method: .version_select at 0x7fc418c7adc0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:51.779087 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-88376874-ec91-4420-aeb7-09b13b146803 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] HTTP exception thrown: Image not found. Sep 07 12:41:51.781696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-88376874-ec91-4420-aeb7-09b13b146803 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Request method failure captured: Sep 07 12:41:51.781696 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf HTTP/1.1 Sep 07 12:41:51.781696 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:41:51.781696 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:41:51.781696 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:41:51.781696 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:41:51.781696 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:41:51.781696 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:41:51.781696 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:41:51.781696 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:41:51.781696 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJE1WjdtxxnraKMR3DarlN0QR-dibe-LhRzQb-ar-VHuiZ3i14nzPMAcroPGLDquTHY5bLsfAj8iU4LLW2vu5cFfUC4nEdYNbBmeuO7XMgGDD_pM2xwkKA_Rh7q7iryubrPCsQHv6bgbo-DjODTRXaYkSAeb7o1Un3DcfsLeVMe4XG8 Sep 07 12:41:51.781696 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:41:51.781696 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:41:51.781696 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:41:51.781696 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:41:51.781696 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:41:51.781696 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:41:51.781696 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: d9b06047717c4a5ca47ebc72587256fb Sep 07 12:41:51.781696 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesOneServerTestJSON-2023066662 Sep 07 12:41:51.781696 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:41:51.781696 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:41:51.782954 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9b06047717c4a5ca47ebc72587256fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d9b06047717c4a5ca47ebc72587256fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d9b06047717c4a5ca47ebc72587256fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9b06047717c4a5ca47ebc72587256fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:41:51.782954 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesOneServerTestJSON-2023066662 Sep 07 12:41:51.782954 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: d9b06047717c4a5ca47ebc72587256fb Sep 07 12:41:51.782954 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2023066662 Sep 07 12:41:51.782954 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ImagesOneServerTestJSON-2023066662-project Sep 07 12:41:51.782954 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:41:51.782954 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:41:51.782954 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6f493fa6856847b4ae7cc8eb997a14c7 Sep 07 12:41:51.782954 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesOneServerTestJSON-2023066662-project Sep 07 12:41:51.782954 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:41:51.782954 n-d-852087-9 devstack@n-api.service[122432]: exception: Image not found. Sep 07 12:41:51.782954 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'a0c2e836-950b-4524-8408-c375bd0b9baf'} Sep 07 12:41:51.782954 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:41:51.783763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:51.783763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 12:41:51.783763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 12:41:51.783763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:41:51.783763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:41:51.783763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 12:41:51.783763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 12:41:51.783763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:41:51.783763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:41:51.783763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 12:41:51.783763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 12:41:51.783763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 12:41:51.783763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 12:41:51.783763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:41:51.783763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:41:51.783763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:41:51.783763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:41:51.783763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a0c2e836-950b-4524-8408-c375bd0b9baf Sep 07 12:41:51.785884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:51.785884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:41:51.785884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:51.785884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:51.785884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 07 12:41:51.785884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 07 12:41:51.785884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 07 12:41:51.785884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 07 12:41:51.785884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 07 12:41:51.785884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 07 12:41:51.785884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 07 12:41:51.785884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 07 12:41:51.785884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 12:41:51.785884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 12:41:51.785884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:41:51.785884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:41:51.785884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 12:41:51.785884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 12:41:51.785884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:41:51.785884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:41:51.788980 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 12:41:51.788980 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 12:41:51.788980 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 12:41:51.788980 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 12:41:51.788980 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:41:51.788980 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:41:51.788980 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:41:51.788980 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:41:51.788980 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a0c2e836-950b-4524-8408-c375bd0b9baf could not be found. Sep 07 12:41:51.788980 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:51.788980 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:41:51.788980 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:51.788980 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:51.788980 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:41:51.788980 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:41:51.788980 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:41:51.788980 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:41:51.788980 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:41:51.788980 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:41:51.791687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:41:51.791687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:41:51.791687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 07 12:41:51.791687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 12:41:51.791687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 12:41:51.791687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:51.791687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:41:51.791687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:51.791687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:51.791687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:41:51.791687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:41:51.791687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:41:51.791687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:41:51.791687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 12:41:51.791687 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:41:51.791687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-88376874-ec91-4420-aeb7-09b13b146803 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Returning 404 to user: Image not found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:41:51.791687 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-88376874-ec91-4420-aeb7-09b13b146803 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf" status: 404 len: 62 microversion: 2.1 time: 0.107416 Sep 07 12:41:51.795472 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1290/2549] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:41:51 2022] GET /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf => generated 62 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:41:51.809185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6fd37a76-6447-4f14-829d-04bfb2385d83 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1386699793"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:51.811934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6fd37a76-6447-4f14-829d-04bfb2385d83 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:51.830042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6fd37a76-6447-4f14-829d-04bfb2385d83 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:51.830564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6fd37a76-6447-4f14-829d-04bfb2385d83 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:51.831017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6fd37a76-6447-4f14-829d-04bfb2385d83 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:51.831782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6fd37a76-6447-4f14-829d-04bfb2385d83 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:51.832251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6fd37a76-6447-4f14-829d-04bfb2385d83 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:51.832686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6fd37a76-6447-4f14-829d-04bfb2385d83 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:51.968839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-7d8f4bc9-d041-4194-89d7-3f939fe332fa tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Getting quotas for project f3795ca9f10f4043b3c4b006bd87cac2. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:41:52.009828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-7d8f4bc9-d041-4194-89d7-3f939fe332fa tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Getting quotas for user e23223b336d4435f868016d39a5a638a and project f3795ca9f10f4043b3c4b006bd87cac2. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:41:52.861105 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6fd37a76-6447-4f14-829d-04bfb2385d83 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "POST /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce/action" status: 202 len: 0 microversion: 2.1 time: 1.044410 Sep 07 12:41:52.863274 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1291/2550] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:41:51 2022] POST /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce/action => generated 0 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 07 12:41:52.898969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bad0e56c-71e0-477d-b321-8af7cb57ac48 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:52.901761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bad0e56c-71e0-477d-b321-8af7cb57ac48 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 2360d1da-9d70-4484-be65-d3cc510b9071] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:52.936759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bad0e56c-71e0-477d-b321-8af7cb57ac48 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:52.937863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bad0e56c-71e0-477d-b321-8af7cb57ac48 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:52.941399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bad0e56c-71e0-477d-b321-8af7cb57ac48 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:52.943122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bad0e56c-71e0-477d-b321-8af7cb57ac48 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:52.946120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bad0e56c-71e0-477d-b321-8af7cb57ac48 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:52.952743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bad0e56c-71e0-477d-b321-8af7cb57ac48 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:53.494044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bad0e56c-71e0-477d-b321-8af7cb57ac48 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:53.514547 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bad0e56c-71e0-477d-b321-8af7cb57ac48 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071" status: 200 len: 1320 microversion: 2.1 time: 0.631756 Sep 07 12:41:53.517191 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1292/2551] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:52 2022] GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071 => generated 1320 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:53.528769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5cf16353-e76a-4a11-a6d4-2e1bb9b585d5 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:53.530565 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5cf16353-e76a-4a11-a6d4-2e1bb9b585d5 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 6762b361-a49e-467e-ba9b-cebfb35d9a58] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:53.545752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cf16353-e76a-4a11-a6d4-2e1bb9b585d5 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:53.547426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cf16353-e76a-4a11-a6d4-2e1bb9b585d5 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:53.548808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cf16353-e76a-4a11-a6d4-2e1bb9b585d5 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:53.551147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cf16353-e76a-4a11-a6d4-2e1bb9b585d5 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:53.552428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cf16353-e76a-4a11-a6d4-2e1bb9b585d5 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:53.555541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cf16353-e76a-4a11-a6d4-2e1bb9b585d5 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:53.568435 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7d8f4bc9-d041-4194-89d7-3f939fe332fa tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] 10.222.0.16 "POST /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata" status: 200 len: 85 microversion: 2.1 time: 1.875003 Sep 07 12:41:53.571871 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1260/2552] 10.222.0.16 () {60 vars in 1281 bytes} [Wed Sep 7 12:41:51 2022] POST /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata => generated 85 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:41:53.578818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4157e1db-6d9a-4d9f-81ef-450ffedf85b8 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:53.582184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4157e1db-6d9a-4d9f-81ef-450ffedf85b8 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] [instance: 71999ea2-9256-4783-8614-0d28d11aab2f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:53.597774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4157e1db-6d9a-4d9f-81ef-450ffedf85b8 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:53.601776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4157e1db-6d9a-4d9f-81ef-450ffedf85b8 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:53.602624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4157e1db-6d9a-4d9f-81ef-450ffedf85b8 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:53.603778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4157e1db-6d9a-4d9f-81ef-450ffedf85b8 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:53.606901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4157e1db-6d9a-4d9f-81ef-450ffedf85b8 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:53.607691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4157e1db-6d9a-4d9f-81ef-450ffedf85b8 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:53.645112 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-4157e1db-6d9a-4d9f-81ef-450ffedf85b8 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] HTTP exception thrown: Instance 71999ea2-9256-4783-8614-0d28d11aab2f could not be found. Sep 07 12:41:53.652807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4157e1db-6d9a-4d9f-81ef-450ffedf85b8 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Request method failure captured: Sep 07 12:41:53.652807 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f HTTP/1.1 Sep 07 12:41:53.652807 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:41:53.652807 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:41:53.652807 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:41:53.652807 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:41:53.652807 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:41:53.652807 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:41:53.652807 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:41:53.652807 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:41:53.652807 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJDTKPKPK_MxIUTdLgwdyHsYYGuJvO_-a4GHOrFG4MbwEKElmnYrY-GJ77Jwm6KWdWDhsTKJcIUo_vMHo-HtCR6uKEiBJciaIETpkK7lZk_6mC3hIVcOf2pBrakXy-j3Hen0yQ1Z1o1m1xfaUIx0dTwuWNqBDyQ9OMa1FZL3jVr0os4 Sep 07 12:41:53.652807 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:41:53.652807 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:41:53.652807 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:41:53.652807 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:41:53.652807 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:41:53.652807 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:41:53.652807 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 3d453f24efa048f0a67ab7834d0005c7 Sep 07 12:41:53.652807 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestBootFromVolume-740425709 Sep 07 12:41:53.652807 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:41:53.652807 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:41:53.654254 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d453f24efa048f0a67ab7834d0005c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3d453f24efa048f0a67ab7834d0005c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3d453f24efa048f0a67ab7834d0005c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d453f24efa048f0a67ab7834d0005c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:41:53.654254 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestBootFromVolume-740425709 Sep 07 12:41:53.654254 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 3d453f24efa048f0a67ab7834d0005c7 Sep 07 12:41:53.654254 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestBootFromVolume-740425709 Sep 07 12:41:53.654254 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersTestBootFromVolume-740425709-project Sep 07 12:41:53.654254 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:41:53.654254 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:41:53.654254 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5d991fa2c5754b14a7a0e638b486f06e Sep 07 12:41:53.654254 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestBootFromVolume-740425709-project Sep 07 12:41:53.654254 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:41:53.654254 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 71999ea2-9256-4783-8614-0d28d11aab2f could not be found. Sep 07 12:41:53.654254 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '71999ea2-9256-4783-8614-0d28d11aab2f'} Sep 07 12:41:53.654928 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:41:53.654928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:53.654928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:41:53.654928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:41:53.654928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:41:53.654928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:41:53.654928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:41:53.654928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:41:53.654928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:41:53.654928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:41:53.654928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71999ea2-9256-4783-8614-0d28d11aab2f could not be found. Sep 07 12:41:53.654928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:41:53.654928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:41:53.654928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:41:53.654928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:53.654928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:41:53.654928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:41:53.654928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:41:53.654928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:41:53.654928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:41:53.656011 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:41:53.656011 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:41:53.656011 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:41:53.656011 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:41:53.656011 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:41:53.656011 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:41:53.656011 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:41:53.656011 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71999ea2-9256-4783-8614-0d28d11aab2f could not be found. Sep 07 12:41:53.656011 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:41:53.656011 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:41:53.656011 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:41:53.656011 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:41:53.656011 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:41:53.656011 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:41:53.656011 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:41:53.656011 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:41:53.656011 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71999ea2-9256-4783-8614-0d28d11aab2f could not be found. Sep 07 12:41:53.656011 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:41:53.664070 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4157e1db-6d9a-4d9f-81ef-450ffedf85b8 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Returning 404 to user: Instance 71999ea2-9256-4783-8614-0d28d11aab2f could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:41:53.665746 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4157e1db-6d9a-4d9f-81ef-450ffedf85b8 tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f" status: 404 len: 111 microversion: 2.1 time: 0.092337 Sep 07 12:41:53.669616 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1261/2553] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:53 2022] GET /compute/v2.1/servers/71999ea2-9256-4783-8614-0d28d11aab2f => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:41:53.678126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f72b7929-4f64-4f51-bfb5-c665b9942148 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:53.679424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f72b7929-4f64-4f51-bfb5-c665b9942148 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:53.692302 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f72b7929-4f64-4f51-bfb5-c665b9942148 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:53.697832 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f72b7929-4f64-4f51-bfb5-c665b9942148 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:53.700913 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f72b7929-4f64-4f51-bfb5-c665b9942148 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:53.705920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f72b7929-4f64-4f51-bfb5-c665b9942148 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:53.710194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f72b7929-4f64-4f51-bfb5-c665b9942148 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:53.715274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f72b7929-4f64-4f51-bfb5-c665b9942148 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:53.920623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5cf16353-e76a-4a11-a6d4-2e1bb9b585d5 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:53.952339 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5cf16353-e76a-4a11-a6d4-2e1bb9b585d5 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/6762b361-a49e-467e-ba9b-cebfb35d9a58" status: 200 len: 1467 microversion: 2.1 time: 0.432818 Sep 07 12:41:53.955625 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1293/2554] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:53 2022] GET /compute/v2.1/servers/6762b361-a49e-467e-ba9b-cebfb35d9a58 => generated 1467 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:53.975865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-188f6967-2a21-4799-92de-ffae9075b715 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc41845a1f0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:54.134940 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-188f6967-2a21-4799-92de-ffae9075b715 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4" status: 200 len: 1429 microversion: 2.1 time: 0.175665 Sep 07 12:41:54.135908 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1294/2555] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:41:53 2022] GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4 => generated 1429 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:54.294365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f72b7929-4f64-4f51-bfb5-c665b9942148 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:54.321871 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f72b7929-4f64-4f51-bfb5-c665b9942148 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1524 microversion: 2.1 time: 0.647254 Sep 07 12:41:54.323469 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-393fbaba-0809-4890-b5f7-d26a49164dff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1272385720", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "053fbc67-334b-4d09-89d9-46503fbb7c8b"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:54.324948 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1262/2556] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:53 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1524 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:54.347710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5c6c52f8-33cc-48c3-a36d-9f299c6f4940 tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] Calling method '.version_select at 0x7fc418552f70>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:54.551482 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5c6c52f8-33cc-48c3-a36d-9f299c6f4940 tempest-ImagesMetadataTestJSON-20994272 tempest-ImagesMetadataTestJSON-20994272-project] 10.222.0.16 "GET /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata" status: 200 len: 85 microversion: 2.1 time: 0.220843 Sep 07 12:41:54.552711 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1263/2557] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Sep 7 12:41:54 2022] GET /compute/v2.1/images/d34c2772-74c3-4c68-acf2-cdb7331e054a/metadata => generated 85 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:41:54.577248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-502a71c8-6cbc-4e25-9042-bcced1aa674e tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] Calling method '.version_select at 0x7fc4188e1670>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:54.611684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-393fbaba-0809-4890-b5f7-d26a49164dff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] validate_networks() for [('053fbc67-334b-4d09-89d9-46503fbb7c8b', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:41:54.692486 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-502a71c8-6cbc-4e25-9042-bcced1aa674e tempest-ServersTestBootFromVolume-740425709 tempest-ServersTestBootFromVolume-740425709-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1277964462" status: 202 len: 0 microversion: 2.1 time: 0.128810 Sep 07 12:41:54.698935 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1264/2558] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Sep 7 12:41:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1277964462 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:41:54.737463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d5b58bd4-47e1-4e02-a9eb-1e79a86df776 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:54.739132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d5b58bd4-47e1-4e02-a9eb-1e79a86df776 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 8d248e06-d37c-4895-85a8-e8c5e412aedb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:54.782582 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5b58bd4-47e1-4e02-a9eb-1e79a86df776 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:54.785414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5b58bd4-47e1-4e02-a9eb-1e79a86df776 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:54.786638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5b58bd4-47e1-4e02-a9eb-1e79a86df776 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:54.789289 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5b58bd4-47e1-4e02-a9eb-1e79a86df776 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:54.796208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5b58bd4-47e1-4e02-a9eb-1e79a86df776 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:54.797455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5b58bd4-47e1-4e02-a9eb-1e79a86df776 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:55.809541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d5b58bd4-47e1-4e02-a9eb-1e79a86df776 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:55.827649 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d5b58bd4-47e1-4e02-a9eb-1e79a86df776 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/8d248e06-d37c-4895-85a8-e8c5e412aedb" status: 200 len: 1318 microversion: 2.1 time: 1.120311 Sep 07 12:41:55.828624 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1265/2559] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:54 2022] GET /compute/v2.1/servers/8d248e06-d37c-4895-85a8-e8c5e412aedb => generated 1318 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:55.883659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6a96e832-2b19-421b-a486-d87a36df3bae tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:55.885365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6a96e832-2b19-421b-a486-d87a36df3bae tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 2360d1da-9d70-4484-be65-d3cc510b9071] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:55.909785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a96e832-2b19-421b-a486-d87a36df3bae tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:55.915676 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a96e832-2b19-421b-a486-d87a36df3bae tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:55.919440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a96e832-2b19-421b-a486-d87a36df3bae tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:55.924697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a96e832-2b19-421b-a486-d87a36df3bae tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:55.932055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a96e832-2b19-421b-a486-d87a36df3bae tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:55.936006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a96e832-2b19-421b-a486-d87a36df3bae tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:57.111367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6a96e832-2b19-421b-a486-d87a36df3bae tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:57.148016 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6a96e832-2b19-421b-a486-d87a36df3bae tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071" status: 200 len: 1320 microversion: 2.1 time: 1.300771 Sep 07 12:41:57.156227 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1266/2560] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:55 2022] GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071 => generated 1320 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:57.168318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4aa6a040-296b-4c43-ad59-5b163d71c854 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc418552280>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:57.287292 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4aa6a040-296b-4c43-ad59-5b163d71c854 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4" status: 200 len: 1429 microversion: 2.1 time: 0.127643 Sep 07 12:41:57.292593 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1267/2561] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:41:57 2022] GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4 => generated 1429 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:57.323709 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b366d314-97f0-4109-a2a1-04171b2352ea tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:57.327765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b366d314-97f0-4109-a2a1-04171b2352ea tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:57.381317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b366d314-97f0-4109-a2a1-04171b2352ea tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:57.384085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b366d314-97f0-4109-a2a1-04171b2352ea tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:57.386404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b366d314-97f0-4109-a2a1-04171b2352ea tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:57.387658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b366d314-97f0-4109-a2a1-04171b2352ea tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:57.390094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b366d314-97f0-4109-a2a1-04171b2352ea tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:57.391808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b366d314-97f0-4109-a2a1-04171b2352ea tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:58.067344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-393fbaba-0809-4890-b5f7-d26a49164dff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:41:58.068182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-393fbaba-0809-4890-b5f7-d26a49164dff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:41:58.069261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-393fbaba-0809-4890-b5f7-d26a49164dff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:41:58.070590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-393fbaba-0809-4890-b5f7-d26a49164dff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:41:58.070752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-393fbaba-0809-4890-b5f7-d26a49164dff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:41:58.101378 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=72 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:41:58.156128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-393fbaba-0809-4890-b5f7-d26a49164dff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:58.156932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-393fbaba-0809-4890-b5f7-d26a49164dff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:58.157709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-393fbaba-0809-4890-b5f7-d26a49164dff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:58.158991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-393fbaba-0809-4890-b5f7-d26a49164dff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:58.159807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-393fbaba-0809-4890-b5f7-d26a49164dff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:58.160521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-393fbaba-0809-4890-b5f7-d26a49164dff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:58.345303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-393fbaba-0809-4890-b5f7-d26a49164dff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Getting quotas for project feb4e290866f4f54b2b99733b56cb7bd. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:41:58.385292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-393fbaba-0809-4890-b5f7-d26a49164dff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Getting quotas for user ac0d1c1e891c470c99e7c968b908a054 and project feb4e290866f4f54b2b99733b56cb7bd. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:41:58.505380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-393fbaba-0809-4890-b5f7-d26a49164dff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:41:58.534640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-393fbaba-0809-4890-b5f7-d26a49164dff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:41:58.810903 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-393fbaba-0809-4890-b5f7-d26a49164dff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.662226 Sep 07 12:41:58.825881 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1295/2562] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:41:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 4678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:41:58.841686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-23ae8c20-4585-44d0-86b6-cf00061b83d8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:41:58.842649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-23ae8c20-4585-44d0-86b6-cf00061b83d8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 8d248e06-d37c-4895-85a8-e8c5e412aedb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:41:58.855021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23ae8c20-4585-44d0-86b6-cf00061b83d8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:58.855923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23ae8c20-4585-44d0-86b6-cf00061b83d8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:58.856551 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23ae8c20-4585-44d0-86b6-cf00061b83d8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:58.857523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23ae8c20-4585-44d0-86b6-cf00061b83d8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:58.858183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23ae8c20-4585-44d0-86b6-cf00061b83d8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:41:58.862538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-23ae8c20-4585-44d0-86b6-cf00061b83d8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:41:59.910571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b366d314-97f0-4109-a2a1-04171b2352ea tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:59.922903 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b366d314-97f0-4109-a2a1-04171b2352ea tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1524 microversion: 2.1 time: 2.627270 Sep 07 12:41:59.923989 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1268/2563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:57 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1524 bytes in 2631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:41:59.935301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-ef0621c4-f169-4daa-b979-680f66661464 req-b24dff11-f5fd-49e6-b19b-de42f437b963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d248e06-d37c-4895-85a8-e8c5e412aedb", "name": "network-vif-plugged", "status": "completed", "tag": "9ed5605a-00bc-4fa2-920f-050b6706d609"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:41:59.981840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-23ae8c20-4585-44d0-86b6-cf00061b83d8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:41:59.994475 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ef0621c4-f169-4daa-b979-680f66661464 req-b24dff11-f5fd-49e6-b19b-de42f437b963 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:41:59.995746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ef0621c4-f169-4daa-b979-680f66661464 req-b24dff11-f5fd-49e6-b19b-de42f437b963 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:00.001198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ef0621c4-f169-4daa-b979-680f66661464 req-b24dff11-f5fd-49e6-b19b-de42f437b963 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:00.022621 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-23ae8c20-4585-44d0-86b6-cf00061b83d8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/8d248e06-d37c-4895-85a8-e8c5e412aedb" status: 200 len: 1318 microversion: 2.1 time: 1.193074 Sep 07 12:42:00.031312 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1296/2564] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:41:58 2022] GET /compute/v2.1/servers/8d248e06-d37c-4895-85a8-e8c5e412aedb => generated 1318 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:00.055070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ceba0f0e-a266-4c7d-9207-543e36908841 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:00.059465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ceba0f0e-a266-4c7d-9207-543e36908841 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 2360d1da-9d70-4484-be65-d3cc510b9071] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:00.108943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ceba0f0e-a266-4c7d-9207-543e36908841 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:00.109864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ceba0f0e-a266-4c7d-9207-543e36908841 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:00.115279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ceba0f0e-a266-4c7d-9207-543e36908841 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:00.116706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ceba0f0e-a266-4c7d-9207-543e36908841 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:00.119991 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ef0621c4-f169-4daa-b979-680f66661464 req-b24dff11-f5fd-49e6-b19b-de42f437b963 service nova] Creating event network-vif-plugged:9ed5605a-00bc-4fa2-920f-050b6706d609 for instance 8d248e06-d37c-4895-85a8-e8c5e412aedb on n-h2-852087-9 Sep 07 12:42:00.123971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ceba0f0e-a266-4c7d-9207-543e36908841 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:00.131139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ceba0f0e-a266-4c7d-9207-543e36908841 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:00.144766 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-ef0621c4-f169-4daa-b979-680f66661464 req-b24dff11-f5fd-49e6-b19b-de42f437b963 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217034 Sep 07 12:42:00.145897 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1269/2565] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:00.163023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-39a4e931-9025-4500-9140-7fd0fedd9cf9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc4185173a0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:00.401316 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-39a4e931-9025-4500-9140-7fd0fedd9cf9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4" status: 200 len: 1429 microversion: 2.1 time: 0.245606 Sep 07 12:42:00.421963 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1270/2566] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:42:00 2022] GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4 => generated 1429 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:00.451377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c5989758-80b4-479b-b284-59afdea3310f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:00.452700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c5989758-80b4-479b-b284-59afdea3310f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:00.510020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5989758-80b4-479b-b284-59afdea3310f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:00.514816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5989758-80b4-479b-b284-59afdea3310f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:00.515627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5989758-80b4-479b-b284-59afdea3310f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:00.533409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5989758-80b4-479b-b284-59afdea3310f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:00.534437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5989758-80b4-479b-b284-59afdea3310f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:00.535469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5989758-80b4-479b-b284-59afdea3310f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:00.584394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ceba0f0e-a266-4c7d-9207-543e36908841 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:00.588747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:42:00.636713 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ceba0f0e-a266-4c7d-9207-543e36908841 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071" status: 200 len: 1320 microversion: 2.1 time: 0.602874 Sep 07 12:42:00.654244 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1297/2567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:00 2022] GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071 => generated 1320 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:00.697912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:42:00.864267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c5989758-80b4-479b-b284-59afdea3310f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:00.894783 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c5989758-80b4-479b-b284-59afdea3310f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1229 microversion: 2.1 time: 0.469557 Sep 07 12:42:00.928090 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1271/2568] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:00 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1229 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:00.975279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-512fc3a1-4bf2-4c54-8cde-4f1d9414849b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:00.976777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-512fc3a1-4bf2-4c54-8cde-4f1d9414849b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:01.008643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-512fc3a1-4bf2-4c54-8cde-4f1d9414849b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:01.012045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-512fc3a1-4bf2-4c54-8cde-4f1d9414849b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:01.014549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-512fc3a1-4bf2-4c54-8cde-4f1d9414849b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:01.019452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-512fc3a1-4bf2-4c54-8cde-4f1d9414849b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:01.020545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-512fc3a1-4bf2-4c54-8cde-4f1d9414849b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:01.026738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-512fc3a1-4bf2-4c54-8cde-4f1d9414849b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:01.706655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-512fc3a1-4bf2-4c54-8cde-4f1d9414849b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:01.744703 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-512fc3a1-4bf2-4c54-8cde-4f1d9414849b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1524 microversion: 2.1 time: 0.776885 Sep 07 12:42:01.767020 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1272/2569] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:00 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1524 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:42:01.777766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9684e9f1-6427-4279-a41b-5edb03e89ca0 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Action: 'create', calling method: .version_select at 0x7fc41848e670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-801126885", "description": "tempest-description-470059961"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:01.786578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4cad53f4-a69b-4d44-ae6c-4e98028e0454 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:01.793267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4cad53f4-a69b-4d44-ae6c-4e98028e0454 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 8d248e06-d37c-4895-85a8-e8c5e412aedb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:01.832682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cad53f4-a69b-4d44-ae6c-4e98028e0454 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:01.833628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cad53f4-a69b-4d44-ae6c-4e98028e0454 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:01.847315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cad53f4-a69b-4d44-ae6c-4e98028e0454 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:01.850878 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cad53f4-a69b-4d44-ae6c-4e98028e0454 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:01.851921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cad53f4-a69b-4d44-ae6c-4e98028e0454 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:01.852718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cad53f4-a69b-4d44-ae6c-4e98028e0454 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:02.060355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:42:02.690688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4cad53f4-a69b-4d44-ae6c-4e98028e0454 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:02.729029 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4cad53f4-a69b-4d44-ae6c-4e98028e0454 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/8d248e06-d37c-4895-85a8-e8c5e412aedb" status: 200 len: 1318 microversion: 2.1 time: 0.954635 Sep 07 12:42:02.730597 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1273/2570] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:01 2022] GET /compute/v2.1/servers/8d248e06-d37c-4895-85a8-e8c5e412aedb => generated 1318 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:02.783105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f4af88e6-3bbc-4172-8c1f-77b7e3b30eea tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc41874e8b0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:02.922079 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9684e9f1-6427-4279-a41b-5edb03e89ca0 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 2.265193 Sep 07 12:42:02.938084 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1298/2571] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Sep 7 12:42:00 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 2283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:02.947370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e98bcc53-a1cf-4137-b0c4-b67bc0a98d09 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:02.948532 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e98bcc53-a1cf-4137-b0c4-b67bc0a98d09 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 2360d1da-9d70-4484-be65-d3cc510b9071] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:03.023574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e98bcc53-a1cf-4137-b0c4-b67bc0a98d09 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:03.035098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e98bcc53-a1cf-4137-b0c4-b67bc0a98d09 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:03.037902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e98bcc53-a1cf-4137-b0c4-b67bc0a98d09 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:03.052483 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e98bcc53-a1cf-4137-b0c4-b67bc0a98d09 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:03.053902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e98bcc53-a1cf-4137-b0c4-b67bc0a98d09 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:03.054938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e98bcc53-a1cf-4137-b0c4-b67bc0a98d09 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:03.061952 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f4af88e6-3bbc-4172-8c1f-77b7e3b30eea tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4" status: 200 len: 1429 microversion: 2.1 time: 0.299122 Sep 07 12:42:03.066211 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1274/2572] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:42:02 2022] GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4 => generated 1429 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:03.090425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c90a3193-e33b-4cf7-a6a6-0ede7b305482 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:03.094954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c90a3193-e33b-4cf7-a6a6-0ede7b305482 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:03.136570 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c90a3193-e33b-4cf7-a6a6-0ede7b305482 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:03.137529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c90a3193-e33b-4cf7-a6a6-0ede7b305482 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:03.138330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c90a3193-e33b-4cf7-a6a6-0ede7b305482 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:03.139669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c90a3193-e33b-4cf7-a6a6-0ede7b305482 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:03.163267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c90a3193-e33b-4cf7-a6a6-0ede7b305482 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:03.174227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c90a3193-e33b-4cf7-a6a6-0ede7b305482 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:03.629557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c90a3193-e33b-4cf7-a6a6-0ede7b305482 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:03.653693 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c90a3193-e33b-4cf7-a6a6-0ede7b305482 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1283 microversion: 2.1 time: 0.584333 Sep 07 12:42:03.655686 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1275/2573] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:03 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1283 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:04.118769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9c9e86bd-00af-49e6-bfa2-588d0a7fc817 tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] Calling method '.version_select at 0x7fc4188ca670>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:04.163943 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-9c9e86bd-00af-49e6-bfa2-588d0a7fc817 tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] HTTP exception thrown: Image not found. Sep 07 12:42:04.173373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9c9e86bd-00af-49e6-bfa2-588d0a7fc817 tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] Request method failure captured: Sep 07 12:42:04.173373 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/images/482be4f1-92bd-4544-a4ad-035bec65545c/metadata/os_distro HTTP/1.1 Sep 07 12:42:04.173373 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:42:04.173373 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:42:04.173373 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:42:04.173373 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:42:04.173373 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:42:04.173373 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:42:04.173373 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:42:04.173373 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:42:04.173373 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJGajVBNVp3tJHLikQqVvtwF94NAnUdk2KsJ1ehVdIMD7-mr4Gq6gNkts1BkVqgVlDM1omZ-zS_KNOmLD3CwkAHOHbd5FtYvl6ZTGDN27TeEroeVYRIMJgxRIQLCXo00PAK_5Y8Zesn6FrUsRLHL9FlY3uYH6EDqns1ymag127Up-XU Sep 07 12:42:04.173373 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:42:04.173373 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:42:04.173373 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:42:04.173373 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:42:04.173373 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:42:04.173373 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:42:04.173373 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 23ab27472b224f609fb1da2cb67d9e69 Sep 07 12:42:04.173373 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1102613464 Sep 07 12:42:04.173373 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:42:04.173373 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:42:04.176589 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/23ab27472b224f609fb1da2cb67d9e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_23ab27472b224f609fb1da2cb67d9e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/23ab27472b224f609fb1da2cb67d9e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/23ab27472b224f609fb1da2cb67d9e69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:42:04.176589 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1102613464 Sep 07 12:42:04.176589 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 23ab27472b224f609fb1da2cb67d9e69 Sep 07 12:42:04.176589 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1102613464 Sep 07 12:42:04.176589 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ImagesMetadataNegativeTestJSON-1102613464-project Sep 07 12:42:04.176589 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:42:04.176589 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:42:04.176589 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 7cebfca97074466bb2a176d6ec93f31e Sep 07 12:42:04.176589 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1102613464-project Sep 07 12:42:04.176589 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:42:04.176589 n-d-852087-9 devstack@n-api.service[122433]: exception: Image not found. Sep 07 12:42:04.176589 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'image_id': '482be4f1-92bd-4544-a4ad-035bec65545c', 'id': 'os_distro'} Sep 07 12:42:04.176589 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:42:04.178382 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:04.178382 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 12:42:04.178382 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 12:42:04.178382 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:42:04.178382 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:42:04.178382 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 12:42:04.178382 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 12:42:04.178382 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:42:04.178382 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:42:04.178382 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 12:42:04.178382 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 12:42:04.178382 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 12:42:04.178382 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 12:42:04.178382 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:42:04.178382 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:42:04.178382 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:42:04.178382 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:42:04.178382 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 482be4f1-92bd-4544-a4ad-035bec65545c Sep 07 12:42:04.180974 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:04.180974 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:04.180974 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:04.180974 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:04.180974 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 07 12:42:04.180974 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 07 12:42:04.180974 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 07 12:42:04.180974 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 07 12:42:04.180974 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 07 12:42:04.180974 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 07 12:42:04.180974 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 07 12:42:04.180974 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 07 12:42:04.180974 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 12:42:04.180974 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 12:42:04.180974 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:42:04.180974 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:42:04.180974 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 12:42:04.180974 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 12:42:04.180974 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:42:04.180974 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:42:04.183482 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 12:42:04.183482 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 12:42:04.183482 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 12:42:04.183482 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 12:42:04.183482 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:42:04.183482 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:42:04.183482 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:42:04.183482 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:42:04.183482 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 482be4f1-92bd-4544-a4ad-035bec65545c could not be found. Sep 07 12:42:04.183482 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:04.183482 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:04.183482 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:04.183482 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:04.183482 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:42:04.183482 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:42:04.183482 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:42:04.183482 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:42:04.183482 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:42:04.183482 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:42:04.188754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:42:04.188754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:42:04.188754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Sep 07 12:42:04.188754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 07 12:42:04.188754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 07 12:42:04.188754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 12:42:04.188754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 12:42:04.188754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:04.188754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:04.188754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:04.188754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:04.188754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:42:04.188754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:42:04.188754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:42:04.188754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:42:04.188754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 12:42:04.188754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:04.188754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9c9e86bd-00af-49e6-bfa2-588d0a7fc817 tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] Returning 404 to user: Image not found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:42:04.193517 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9c9e86bd-00af-49e6-bfa2-588d0a7fc817 tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] 10.222.0.16 "DELETE /compute/v2.1/images/482be4f1-92bd-4544-a4ad-035bec65545c/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.535640 Sep 07 12:42:04.197761 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1276/2574] 10.222.0.16 () {58 vars in 1293 bytes} [Wed Sep 7 12:42:03 2022] DELETE /compute/v2.1/images/482be4f1-92bd-4544-a4ad-035bec65545c/metadata/os_distro => generated 62 bytes in 541 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:42:04.220599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8e696ef2-b958-4c62-b066-7d5d85f8a87f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:04.225251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8e696ef2-b958-4c62-b066-7d5d85f8a87f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:04.250864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e696ef2-b958-4c62-b066-7d5d85f8a87f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:04.262785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e696ef2-b958-4c62-b066-7d5d85f8a87f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:04.263980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e696ef2-b958-4c62-b066-7d5d85f8a87f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:04.266253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e696ef2-b958-4c62-b066-7d5d85f8a87f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:04.268141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e696ef2-b958-4c62-b066-7d5d85f8a87f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:04.270249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e696ef2-b958-4c62-b066-7d5d85f8a87f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:04.812893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e98bcc53-a1cf-4137-b0c4-b67bc0a98d09 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:04.826433 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e98bcc53-a1cf-4137-b0c4-b67bc0a98d09 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071" status: 200 len: 1320 microversion: 2.1 time: 1.886724 Sep 07 12:42:04.827601 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1299/2575] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:02 2022] GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071 => generated 1320 bytes in 1889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:04.844907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eeffe492-72e0-4a48-9be3-079c57d0239e tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Action: 'create', calling method: .version_select at 0x7fc41846e040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1241458478", "description": "tempest-description-835488362"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:04.942394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8e696ef2-b958-4c62-b066-7d5d85f8a87f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:04.950567 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8e696ef2-b958-4c62-b066-7d5d85f8a87f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1524 microversion: 2.1 time: 0.746729 Sep 07 12:42:04.951367 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1277/2576] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:04 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1524 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:05.001897 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-94be0d5b-57f3-48ed-97cc-752701b2b059 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:05.004097 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-94be0d5b-57f3-48ed-97cc-752701b2b059 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 8d248e06-d37c-4895-85a8-e8c5e412aedb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:05.022573 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94be0d5b-57f3-48ed-97cc-752701b2b059 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:05.023693 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94be0d5b-57f3-48ed-97cc-752701b2b059 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:05.025569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94be0d5b-57f3-48ed-97cc-752701b2b059 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:05.027930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94be0d5b-57f3-48ed-97cc-752701b2b059 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:05.029793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94be0d5b-57f3-48ed-97cc-752701b2b059 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:05.030823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94be0d5b-57f3-48ed-97cc-752701b2b059 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:05.319634 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eeffe492-72e0-4a48-9be3-079c57d0239e tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.490325 Sep 07 12:42:05.329961 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1300/2577] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Sep 7 12:42:04 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:05.330390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-94be0d5b-57f3-48ed-97cc-752701b2b059 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:05.330987 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c0b5b6b1-eede-40f0-bbd7-90ba012ce010 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc41855e700>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:05.391142 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-94be0d5b-57f3-48ed-97cc-752701b2b059 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/8d248e06-d37c-4895-85a8-e8c5e412aedb" status: 200 len: 1468 microversion: 2.1 time: 0.400001 Sep 07 12:42:05.396449 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1278/2578] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:04 2022] GET /compute/v2.1/servers/8d248e06-d37c-4895-85a8-e8c5e412aedb => generated 1468 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:05.429563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd079ad1-c3e6-4f77-9c19-63694ac59236 tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] Calling method '.version_select at 0x7fc418517b80>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:05.466647 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c0b5b6b1-eede-40f0-bbd7-90ba012ce010 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4" status: 200 len: 1429 microversion: 2.1 time: 0.143338 Sep 07 12:42:05.467608 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1301/2579] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:42:05 2022] GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4 => generated 1429 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:05.478597 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7126f002-c54e-4d66-91a6-027760208296 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:05.487811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7126f002-c54e-4d66-91a6-027760208296 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:05.493203 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-dd079ad1-c3e6-4f77-9c19-63694ac59236 tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] HTTP exception thrown: Image not found. Sep 07 12:42:05.495445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd079ad1-c3e6-4f77-9c19-63694ac59236 tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] Request method failure captured: Sep 07 12:42:05.495445 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/images/7a8c1b91-f661-4fa1-9986-b770ee49679c/metadata/os_version HTTP/1.1 Sep 07 12:42:05.495445 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:42:05.495445 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:42:05.495445 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:42:05.495445 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:42:05.495445 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:42:05.495445 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:42:05.495445 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:42:05.495445 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:42:05.495445 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJGajVBNVp3tJHLikQqVvtwF94NAnUdk2KsJ1ehVdIMD7-mr4Gq6gNkts1BkVqgVlDM1omZ-zS_KNOmLD3CwkAHOHbd5FtYvl6ZTGDN27TeEroeVYRIMJgxRIQLCXo00PAK_5Y8Zesn6FrUsRLHL9FlY3uYH6EDqns1ymag127Up-XU Sep 07 12:42:05.495445 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:42:05.495445 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:42:05.495445 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:42:05.495445 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:42:05.495445 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:42:05.495445 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:42:05.495445 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 23ab27472b224f609fb1da2cb67d9e69 Sep 07 12:42:05.495445 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1102613464 Sep 07 12:42:05.495445 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:42:05.495445 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:42:05.496764 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/23ab27472b224f609fb1da2cb67d9e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_23ab27472b224f609fb1da2cb67d9e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/23ab27472b224f609fb1da2cb67d9e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/23ab27472b224f609fb1da2cb67d9e69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:42:05.496764 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1102613464 Sep 07 12:42:05.496764 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 23ab27472b224f609fb1da2cb67d9e69 Sep 07 12:42:05.496764 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1102613464 Sep 07 12:42:05.496764 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ImagesMetadataNegativeTestJSON-1102613464-project Sep 07 12:42:05.496764 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:42:05.496764 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:42:05.496764 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 7cebfca97074466bb2a176d6ec93f31e Sep 07 12:42:05.496764 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1102613464-project Sep 07 12:42:05.496764 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:42:05.496764 n-d-852087-9 devstack@n-api.service[122433]: exception: Image not found. Sep 07 12:42:05.496764 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'image_id': '7a8c1b91-f661-4fa1-9986-b770ee49679c', 'id': 'os_version'} Sep 07 12:42:05.496764 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:42:05.497506 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:05.497506 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 12:42:05.497506 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 12:42:05.497506 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:42:05.497506 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:42:05.497506 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 12:42:05.497506 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 12:42:05.497506 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:42:05.497506 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:42:05.497506 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 12:42:05.497506 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 12:42:05.497506 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 12:42:05.497506 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 12:42:05.497506 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:42:05.497506 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:42:05.497506 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:42:05.497506 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:42:05.497506 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7a8c1b91-f661-4fa1-9986-b770ee49679c Sep 07 12:42:05.498466 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:05.498466 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:05.498466 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:05.498466 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:05.498466 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 07 12:42:05.498466 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 07 12:42:05.498466 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 07 12:42:05.498466 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 07 12:42:05.498466 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 07 12:42:05.498466 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 07 12:42:05.498466 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 07 12:42:05.498466 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 07 12:42:05.498466 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 12:42:05.498466 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 12:42:05.498466 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:42:05.498466 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:42:05.498466 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 12:42:05.498466 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 12:42:05.498466 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:42:05.498466 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:42:05.499514 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 12:42:05.499514 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 12:42:05.499514 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 12:42:05.499514 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 12:42:05.499514 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:42:05.499514 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:42:05.499514 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:42:05.499514 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:42:05.499514 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7a8c1b91-f661-4fa1-9986-b770ee49679c could not be found. Sep 07 12:42:05.499514 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:05.499514 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:05.499514 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:05.499514 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:05.499514 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:42:05.499514 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:42:05.499514 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:42:05.499514 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:42:05.499514 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:42:05.499514 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:42:05.500493 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:42:05.500493 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:42:05.500493 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Sep 07 12:42:05.500493 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 07 12:42:05.500493 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 07 12:42:05.500493 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 12:42:05.500493 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 12:42:05.500493 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:05.500493 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:05.500493 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:05.500493 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:05.500493 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:42:05.500493 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:42:05.500493 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:42:05.500493 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:42:05.500493 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 12:42:05.500493 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:05.500493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd079ad1-c3e6-4f77-9c19-63694ac59236 tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] Returning 404 to user: Image not found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:42:05.501427 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dd079ad1-c3e6-4f77-9c19-63694ac59236 tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] 10.222.0.16 "GET /compute/v2.1/images/7a8c1b91-f661-4fa1-9986-b770ee49679c/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.095813 Sep 07 12:42:05.504312 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1279/2580] 10.222.0.16 () {58 vars in 1293 bytes} [Wed Sep 7 12:42:05 2022] GET /compute/v2.1/images/7a8c1b91-f661-4fa1-9986-b770ee49679c/metadata/os_version => generated 62 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:42:05.518580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7126f002-c54e-4d66-91a6-027760208296 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:05.520718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8fb66537-f2a9-4455-a8c7-a60897010ff8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:05.523619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7126f002-c54e-4d66-91a6-027760208296 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:05.524241 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7126f002-c54e-4d66-91a6-027760208296 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:05.527499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7126f002-c54e-4d66-91a6-027760208296 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:05.532052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7126f002-c54e-4d66-91a6-027760208296 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:05.540303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7126f002-c54e-4d66-91a6-027760208296 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:05.557228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8fb66537-f2a9-4455-a8c7-a60897010ff8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:05.565438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8fb66537-f2a9-4455-a8c7-a60897010ff8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Searching by: {'reservation_id': 'r-klvh8n1y', 'deleted': False, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:42:05.589318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fb66537-f2a9-4455-a8c7-a60897010ff8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:05.594473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fb66537-f2a9-4455-a8c7-a60897010ff8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:05.597563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fb66537-f2a9-4455-a8c7-a60897010ff8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:05.600677 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fb66537-f2a9-4455-a8c7-a60897010ff8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:05.602982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fb66537-f2a9-4455-a8c7-a60897010ff8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:05.611046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fb66537-f2a9-4455-a8c7-a60897010ff8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:05.945509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-8fb66537-f2a9-4455-a8c7-a60897010ff8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:42:06.181472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8fb66537-f2a9-4455-a8c7-a60897010ff8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:06.198813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fb66537-f2a9-4455-a8c7-a60897010ff8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:06.199436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fb66537-f2a9-4455-a8c7-a60897010ff8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:06.199992 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fb66537-f2a9-4455-a8c7-a60897010ff8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:06.423434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7126f002-c54e-4d66-91a6-027760208296 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:06.435846 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7126f002-c54e-4d66-91a6-027760208296 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1325 microversion: 2.1 time: 0.963624 Sep 07 12:42:06.440062 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1302/2581] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:05 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1325 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:06.447978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-53a60750-7b7e-41a1-be5b-2920a55cc51d tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] Calling method '.version_select at 0x7fc41854ed30>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:06.494647 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-53a60750-7b7e-41a1-be5b-2920a55cc51d tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] HTTP exception thrown: Image not found. Sep 07 12:42:06.498290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-53a60750-7b7e-41a1-be5b-2920a55cc51d tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] Request method failure captured: Sep 07 12:42:06.498290 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/images/13a32e4f-77c6-4bc1-bbb2-2b602e1d0974/metadata HTTP/1.1 Sep 07 12:42:06.498290 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:42:06.498290 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:42:06.498290 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:42:06.498290 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:42:06.498290 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:42:06.498290 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:42:06.498290 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:42:06.498290 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:42:06.498290 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJGajVBNVp3tJHLikQqVvtwF94NAnUdk2KsJ1ehVdIMD7-mr4Gq6gNkts1BkVqgVlDM1omZ-zS_KNOmLD3CwkAHOHbd5FtYvl6ZTGDN27TeEroeVYRIMJgxRIQLCXo00PAK_5Y8Zesn6FrUsRLHL9FlY3uYH6EDqns1ymag127Up-XU Sep 07 12:42:06.498290 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:42:06.498290 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:42:06.498290 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:42:06.498290 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:42:06.498290 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:42:06.498290 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:42:06.498290 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 23ab27472b224f609fb1da2cb67d9e69 Sep 07 12:42:06.498290 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1102613464 Sep 07 12:42:06.498290 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:42:06.498290 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:42:06.499853 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/23ab27472b224f609fb1da2cb67d9e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_23ab27472b224f609fb1da2cb67d9e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/23ab27472b224f609fb1da2cb67d9e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/23ab27472b224f609fb1da2cb67d9e69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:42:06.499853 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1102613464 Sep 07 12:42:06.499853 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 23ab27472b224f609fb1da2cb67d9e69 Sep 07 12:42:06.499853 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1102613464 Sep 07 12:42:06.499853 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ImagesMetadataNegativeTestJSON-1102613464-project Sep 07 12:42:06.499853 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:42:06.499853 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:42:06.499853 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 7cebfca97074466bb2a176d6ec93f31e Sep 07 12:42:06.499853 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1102613464-project Sep 07 12:42:06.499853 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:42:06.499853 n-d-852087-9 devstack@n-api.service[122432]: exception: Image not found. Sep 07 12:42:06.499853 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'image_id': '13a32e4f-77c6-4bc1-bbb2-2b602e1d0974'} Sep 07 12:42:06.499853 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:42:06.500852 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:06.500852 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 12:42:06.500852 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 12:42:06.500852 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:42:06.500852 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:42:06.500852 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 12:42:06.500852 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 12:42:06.500852 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:42:06.500852 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:42:06.500852 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 12:42:06.500852 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 12:42:06.500852 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 12:42:06.500852 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 12:42:06.500852 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:42:06.500852 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:42:06.500852 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:42:06.500852 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:42:06.500852 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 13a32e4f-77c6-4bc1-bbb2-2b602e1d0974 Sep 07 12:42:06.502098 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:06.502098 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:06.502098 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:06.502098 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:06.502098 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 07 12:42:06.502098 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 07 12:42:06.502098 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 07 12:42:06.502098 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 07 12:42:06.502098 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 07 12:42:06.502098 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 07 12:42:06.502098 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 07 12:42:06.502098 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 07 12:42:06.502098 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 12:42:06.502098 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 12:42:06.502098 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:42:06.502098 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:42:06.502098 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 12:42:06.502098 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 12:42:06.502098 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:42:06.502098 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:42:06.503377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 12:42:06.503377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 12:42:06.503377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 12:42:06.503377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 12:42:06.503377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:42:06.503377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:42:06.503377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:42:06.503377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:42:06.503377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 13a32e4f-77c6-4bc1-bbb2-2b602e1d0974 could not be found. Sep 07 12:42:06.503377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:06.503377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:06.503377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:06.503377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:06.503377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:42:06.503377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:42:06.503377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:42:06.503377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:42:06.503377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:42:06.503377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:42:06.505554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:42:06.505554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:42:06.505554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Sep 07 12:42:06.505554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 07 12:42:06.505554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 07 12:42:06.505554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 12:42:06.505554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 12:42:06.505554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:06.505554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:06.505554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:06.505554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:06.505554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:42:06.505554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:42:06.505554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:42:06.505554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:42:06.505554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 12:42:06.505554 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:06.508512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-53a60750-7b7e-41a1-be5b-2920a55cc51d tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] Returning 404 to user: Image not found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:42:06.509678 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-53a60750-7b7e-41a1-be5b-2920a55cc51d tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] 10.222.0.16 "GET /compute/v2.1/images/13a32e4f-77c6-4bc1-bbb2-2b602e1d0974/metadata" status: 404 len: 62 microversion: 2.1 time: 0.068284 Sep 07 12:42:06.526671 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1303/2582] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Sep 7 12:42:06 2022] GET /compute/v2.1/images/13a32e4f-77c6-4bc1-bbb2-2b602e1d0974/metadata => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:42:06.544893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-924d304f-464a-434e-a0e6-da8bf9f4f34c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1057769735", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "cb511943-70f2-41d3-b932-6332864944b8"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:06.666412 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-924d304f-464a-434e-a0e6-da8bf9f4f34c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] validate_networks() for [('cb511943-70f2-41d3-b932-6332864944b8', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:42:06.732640 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8fb66537-f2a9-4455-a8c7-a60897010ff8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?reservation_id=r-klvh8n1y" status: 200 len: 2928 microversion: 2.1 time: 1.225855 Sep 07 12:42:06.754087 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1280/2583] 10.222.0.16 () {58 vars in 1197 bytes} [Wed Sep 7 12:42:05 2022] GET /compute/v2.1/servers/detail?reservation_id=r-klvh8n1y => generated 2928 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:06.779806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b6925887-ac38-40f5-bc52-81622b2e301c tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:06.785340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b6925887-ac38-40f5-bc52-81622b2e301c tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 2360d1da-9d70-4484-be65-d3cc510b9071] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:06.801791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6925887-ac38-40f5-bc52-81622b2e301c tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:06.802837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6925887-ac38-40f5-bc52-81622b2e301c tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:06.804162 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6925887-ac38-40f5-bc52-81622b2e301c tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:06.805466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6925887-ac38-40f5-bc52-81622b2e301c tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:06.806470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6925887-ac38-40f5-bc52-81622b2e301c tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:06.807255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6925887-ac38-40f5-bc52-81622b2e301c tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:07.673464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b6925887-ac38-40f5-bc52-81622b2e301c tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:07.702483 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b6925887-ac38-40f5-bc52-81622b2e301c tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071" status: 200 len: 1320 microversion: 2.1 time: 0.946284 Sep 07 12:42:07.706307 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1281/2584] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:06 2022] GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071 => generated 1320 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:07.726513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c42081d-c187-4625-b1f9-cff7e5c79242 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:07.730944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2c42081d-c187-4625-b1f9-cff7e5c79242 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:07.761059 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c42081d-c187-4625-b1f9-cff7e5c79242 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:07.764241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c42081d-c187-4625-b1f9-cff7e5c79242 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:07.765453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c42081d-c187-4625-b1f9-cff7e5c79242 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:07.775274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c42081d-c187-4625-b1f9-cff7e5c79242 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:07.776588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c42081d-c187-4625-b1f9-cff7e5c79242 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:07.777614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c42081d-c187-4625-b1f9-cff7e5c79242 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:08.271885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:42:08.444899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=14 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:42:08.531802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-924d304f-464a-434e-a0e6-da8bf9f4f34c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:42:08.533786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-924d304f-464a-434e-a0e6-da8bf9f4f34c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:42:08.535411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-924d304f-464a-434e-a0e6-da8bf9f4f34c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:42:08.536664 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-924d304f-464a-434e-a0e6-da8bf9f4f34c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:42:08.542094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-924d304f-464a-434e-a0e6-da8bf9f4f34c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:42:08.597283 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-924d304f-464a-434e-a0e6-da8bf9f4f34c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:08.601795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-924d304f-464a-434e-a0e6-da8bf9f4f34c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:08.604964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2c42081d-c187-4625-b1f9-cff7e5c79242 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:08.605664 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-924d304f-464a-434e-a0e6-da8bf9f4f34c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:08.610253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-924d304f-464a-434e-a0e6-da8bf9f4f34c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:08.614077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-924d304f-464a-434e-a0e6-da8bf9f4f34c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:08.621446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-924d304f-464a-434e-a0e6-da8bf9f4f34c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:08.623837 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2c42081d-c187-4625-b1f9-cff7e5c79242 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1506 microversion: 2.1 time: 0.913576 Sep 07 12:42:08.627431 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1282/2585] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:07 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1506 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:08.635898 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2411d212-7dbb-4d9e-9a62-658a6636d3a9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc41857e820>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:08.678827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-924d304f-464a-434e-a0e6-da8bf9f4f34c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Getting quotas for project 6d6d8398313f4738bd1d9b6cd1ea93a7. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:42:08.695063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-924d304f-464a-434e-a0e6-da8bf9f4f34c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Getting quotas for user 6c7fac0664f044168f52e7c1a982c48e and project 6d6d8398313f4738bd1d9b6cd1ea93a7. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:42:08.736471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-924d304f-464a-434e-a0e6-da8bf9f4f34c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:42:08.745956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-924d304f-464a-434e-a0e6-da8bf9f4f34c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:42:08.748932 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2411d212-7dbb-4d9e-9a62-658a6636d3a9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4" status: 200 len: 1429 microversion: 2.1 time: 0.119883 Sep 07 12:42:08.773688 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1283/2586] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:42:08 2022] GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4 => generated 1429 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:08.798989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5dfa9534-25c2-45a4-9dec-0ac5372a0254 tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] Action: 'update_all', calling method: .version_select at 0x7fc41850bd30>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:08.872405 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-924d304f-464a-434e-a0e6-da8bf9f4f34c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.340845 Sep 07 12:42:08.884155 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1304/2587] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:42:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:42:08.890408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c1418b7d-ae63-4ebd-8b06-35b1aeaa927a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:08.940054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.compute.server_groups [None req-c1418b7d-ae63-4ebd-8b06-35b1aeaa927a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Querying cell 9e0290a2-728a-49bc-bfb2-19275e06ed31(cell1) for 2 instances {{(pid=122432) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 07 12:42:08.944361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1418b7d-ae63-4ebd-8b06-35b1aeaa927a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:08.945133 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1418b7d-ae63-4ebd-8b06-35b1aeaa927a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:08.946643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1418b7d-ae63-4ebd-8b06-35b1aeaa927a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:08.952088 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-5dfa9534-25c2-45a4-9dec-0ac5372a0254 tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] HTTP exception thrown: Image not found. Sep 07 12:42:08.960351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5dfa9534-25c2-45a4-9dec-0ac5372a0254 tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] Request method failure captured: Sep 07 12:42:08.960351 n-d-852087-9 devstack@n-api.service[122433]: request: PUT /compute/v2.1/images/4f95e4a3-4088-4858-b4c4-4f619491ca14/metadata HTTP/1.1 Sep 07 12:42:08.960351 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:42:08.960351 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:42:08.960351 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:42:08.960351 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 57 Sep 07 12:42:08.960351 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:42:08.960351 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:42:08.960351 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:42:08.960351 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:42:08.960351 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJGajVBNVp3tJHLikQqVvtwF94NAnUdk2KsJ1ehVdIMD7-mr4Gq6gNkts1BkVqgVlDM1omZ-zS_KNOmLD3CwkAHOHbd5FtYvl6ZTGDN27TeEroeVYRIMJgxRIQLCXo00PAK_5Y8Zesn6FrUsRLHL9FlY3uYH6EDqns1ymag127Up-XU Sep 07 12:42:08.960351 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:42:08.960351 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:42:08.960351 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:42:08.960351 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:42:08.960351 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:42:08.960351 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:42:08.960351 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 23ab27472b224f609fb1da2cb67d9e69 Sep 07 12:42:08.960351 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1102613464 Sep 07 12:42:08.960351 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:42:08.960351 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:42:08.962948 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/23ab27472b224f609fb1da2cb67d9e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_23ab27472b224f609fb1da2cb67d9e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/23ab27472b224f609fb1da2cb67d9e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/23ab27472b224f609fb1da2cb67d9e69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:42:08.962948 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1102613464 Sep 07 12:42:08.962948 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 23ab27472b224f609fb1da2cb67d9e69 Sep 07 12:42:08.962948 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1102613464 Sep 07 12:42:08.962948 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ImagesMetadataNegativeTestJSON-1102613464-project Sep 07 12:42:08.962948 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:42:08.962948 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:42:08.962948 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 7cebfca97074466bb2a176d6ec93f31e Sep 07 12:42:08.962948 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1102613464-project Sep 07 12:42:08.962948 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:42:08.962948 n-d-852087-9 devstack@n-api.service[122433]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 07 12:42:08.962948 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:42:08.962948 n-d-852087-9 devstack@n-api.service[122433]: exception: Image not found. Sep 07 12:42:08.964737 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'image_id': '4f95e4a3-4088-4858-b4c4-4f619491ca14', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 07 12:42:08.964737 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:42:08.964737 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:08.964737 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 12:42:08.964737 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 12:42:08.964737 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:42:08.964737 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:42:08.964737 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 12:42:08.964737 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 12:42:08.964737 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:42:08.964737 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:42:08.964737 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 12:42:08.964737 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 12:42:08.964737 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 12:42:08.964737 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 12:42:08.964737 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:42:08.964737 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:42:08.964737 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:42:08.966881 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:42:08.966881 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4f95e4a3-4088-4858-b4c4-4f619491ca14 Sep 07 12:42:08.966881 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:08.966881 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:08.966881 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:08.966881 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:08.966881 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 07 12:42:08.966881 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 07 12:42:08.966881 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 07 12:42:08.966881 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 07 12:42:08.966881 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 07 12:42:08.966881 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 07 12:42:08.966881 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 07 12:42:08.966881 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 07 12:42:08.966881 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 12:42:08.966881 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 12:42:08.966881 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:42:08.966881 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:42:08.966881 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 12:42:08.966881 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 12:42:08.970192 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:42:08.970192 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:42:08.970192 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 12:42:08.970192 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 12:42:08.970192 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 12:42:08.970192 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 12:42:08.970192 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:42:08.970192 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:42:08.970192 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:42:08.970192 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:42:08.970192 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4f95e4a3-4088-4858-b4c4-4f619491ca14 could not be found. Sep 07 12:42:08.970192 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:08.970192 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:08.970192 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:08.970192 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:08.970192 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:42:08.970192 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:42:08.970192 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:42:08.970192 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:42:08.976333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:42:08.976333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:42:08.976333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:42:08.976333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:42:08.976333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:42:08.976333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:42:08.976333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Sep 07 12:42:08.976333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 07 12:42:08.976333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 07 12:42:08.976333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 12:42:08.976333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 12:42:08.976333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:08.976333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:08.976333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:08.976333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:08.976333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:42:08.976333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:42:08.976333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:42:08.976333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:42:08.976333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 12:42:08.976333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:08.979115 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5dfa9534-25c2-45a4-9dec-0ac5372a0254 tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] Returning 404 to user: Image not found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:42:08.979115 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5dfa9534-25c2-45a4-9dec-0ac5372a0254 tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] 10.222.0.16 "PUT /compute/v2.1/images/4f95e4a3-4088-4858-b4c4-4f619491ca14/metadata" status: 404 len: 62 microversion: 2.1 time: 0.196268 Sep 07 12:42:08.989198 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1284/2588] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 12:42:08 2022] PUT /compute/v2.1/images/4f95e4a3-4088-4858-b4c4-4f619491ca14/metadata => generated 62 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:42:09.026773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c3847434-61b1-4867-9ece-820dd862a0bf tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:09.027995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c3847434-61b1-4867-9ece-820dd862a0bf tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:09.045036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3847434-61b1-4867-9ece-820dd862a0bf tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:09.048201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3847434-61b1-4867-9ece-820dd862a0bf tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:09.049727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3847434-61b1-4867-9ece-820dd862a0bf tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:09.050132 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c1418b7d-ae63-4ebd-8b06-35b1aeaa927a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/d99b666a-2966-46d5-95c8-fbd940b4df0d" status: 200 len: 271 microversion: 2.1 time: 0.170099 Sep 07 12:42:09.051163 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1305/2589] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Sep 7 12:42:08 2022] GET /compute/v2.1/os-server-groups/d99b666a-2966-46d5-95c8-fbd940b4df0d => generated 271 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:09.054799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3847434-61b1-4867-9ece-820dd862a0bf tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:09.056114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3847434-61b1-4867-9ece-820dd862a0bf tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:09.059690 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e8f998d3-6bc5-4162-ab08-de8c6fdd661b req-d8acffdf-56a2-434d-9048-24f123c1c6f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2360d1da-9d70-4484-be65-d3cc510b9071", "name": "network-vif-plugged", "status": "completed", "tag": "4aa46be9-0029-4660-9d0d-2f5b8ec0dbe6"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:09.075408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3847434-61b1-4867-9ece-820dd862a0bf tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:09.107693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e8f998d3-6bc5-4162-ab08-de8c6fdd661b req-d8acffdf-56a2-434d-9048-24f123c1c6f8 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:09.122837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e8f998d3-6bc5-4162-ab08-de8c6fdd661b req-d8acffdf-56a2-434d-9048-24f123c1c6f8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:09.128011 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e8f998d3-6bc5-4162-ab08-de8c6fdd661b req-d8acffdf-56a2-434d-9048-24f123c1c6f8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:09.225865 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e8f998d3-6bc5-4162-ab08-de8c6fdd661b req-d8acffdf-56a2-434d-9048-24f123c1c6f8 service nova] Creating event network-vif-plugged:4aa46be9-0029-4660-9d0d-2f5b8ec0dbe6 for instance 2360d1da-9d70-4484-be65-d3cc510b9071 on n-h1-852087-9 Sep 07 12:42:09.245866 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e8f998d3-6bc5-4162-ab08-de8c6fdd661b req-d8acffdf-56a2-434d-9048-24f123c1c6f8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192129 Sep 07 12:42:09.262171 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1306/2590] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:09.281181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c0437658-49bc-430f-b0c6-7a17abb6b343 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:09.300828 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c0437658-49bc-430f-b0c6-7a17abb6b343 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 2360d1da-9d70-4484-be65-d3cc510b9071] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:09.344313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0437658-49bc-430f-b0c6-7a17abb6b343 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:09.347646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0437658-49bc-430f-b0c6-7a17abb6b343 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:09.349000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0437658-49bc-430f-b0c6-7a17abb6b343 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:09.358114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0437658-49bc-430f-b0c6-7a17abb6b343 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:09.359117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0437658-49bc-430f-b0c6-7a17abb6b343 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:09.360412 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0437658-49bc-430f-b0c6-7a17abb6b343 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:09.946303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c3847434-61b1-4867-9ece-820dd862a0bf tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:09.967727 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c3847434-61b1-4867-9ece-820dd862a0bf tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1325 microversion: 2.1 time: 0.976050 Sep 07 12:42:09.969670 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1285/2591] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:08 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1325 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:09.976509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4fadf414-82d9-4740-b1f2-ac4314e8db4d tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:09.977637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4fadf414-82d9-4740-b1f2-ac4314e8db4d tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:10.003276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c0437658-49bc-430f-b0c6-7a17abb6b343 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:10.019150 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c0437658-49bc-430f-b0c6-7a17abb6b343 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071" status: 200 len: 1320 microversion: 2.1 time: 0.750137 Sep 07 12:42:10.029802 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1307/2592] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:09 2022] GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071 => generated 1320 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:10.043741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dfa03484-16fc-4632-9eca-16b92af1f5e3 tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] Action: 'update', calling method: .version_select at 0x7fc41846ef70>, body: {"meta": {"os_distro": "alt"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:10.081010 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-dfa03484-16fc-4632-9eca-16b92af1f5e3 tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] HTTP exception thrown: Image not found. Sep 07 12:42:10.083754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dfa03484-16fc-4632-9eca-16b92af1f5e3 tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] Request method failure captured: Sep 07 12:42:10.083754 n-d-852087-9 devstack@n-api.service[122432]: request: PUT /compute/v2.1/images/9f69404f-0b39-4b9b-866e-a721f4eb69ba/metadata/os_distro HTTP/1.1 Sep 07 12:42:10.083754 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:42:10.083754 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:42:10.083754 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:42:10.083754 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 30 Sep 07 12:42:10.083754 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:42:10.083754 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:42:10.083754 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:42:10.083754 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:42:10.083754 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJGajVBNVp3tJHLikQqVvtwF94NAnUdk2KsJ1ehVdIMD7-mr4Gq6gNkts1BkVqgVlDM1omZ-zS_KNOmLD3CwkAHOHbd5FtYvl6ZTGDN27TeEroeVYRIMJgxRIQLCXo00PAK_5Y8Zesn6FrUsRLHL9FlY3uYH6EDqns1ymag127Up-XU Sep 07 12:42:10.083754 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:42:10.083754 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:42:10.083754 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:42:10.083754 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:42:10.083754 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:42:10.083754 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:42:10.083754 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 23ab27472b224f609fb1da2cb67d9e69 Sep 07 12:42:10.083754 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1102613464 Sep 07 12:42:10.083754 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:42:10.083754 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:42:10.086253 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/23ab27472b224f609fb1da2cb67d9e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_23ab27472b224f609fb1da2cb67d9e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/23ab27472b224f609fb1da2cb67d9e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/23ab27472b224f609fb1da2cb67d9e69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:42:10.086253 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1102613464 Sep 07 12:42:10.086253 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 23ab27472b224f609fb1da2cb67d9e69 Sep 07 12:42:10.086253 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1102613464 Sep 07 12:42:10.086253 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ImagesMetadataNegativeTestJSON-1102613464-project Sep 07 12:42:10.086253 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:42:10.086253 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:42:10.086253 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 7cebfca97074466bb2a176d6ec93f31e Sep 07 12:42:10.086253 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1102613464-project Sep 07 12:42:10.086253 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:42:10.086253 n-d-852087-9 devstack@n-api.service[122432]: {"meta": {"os_distro": "alt"}} Sep 07 12:42:10.086253 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:42:10.086253 n-d-852087-9 devstack@n-api.service[122432]: exception: Image not found. Sep 07 12:42:10.086253 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'image_id': '9f69404f-0b39-4b9b-866e-a721f4eb69ba', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Sep 07 12:42:10.087725 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:42:10.087725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:10.087725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 12:42:10.087725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 12:42:10.087725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:42:10.087725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:42:10.087725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 12:42:10.087725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 12:42:10.087725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:42:10.087725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:42:10.087725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 12:42:10.087725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 12:42:10.087725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 12:42:10.087725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 12:42:10.087725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:42:10.087725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:42:10.087725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:42:10.087725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:42:10.090585 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9f69404f-0b39-4b9b-866e-a721f4eb69ba Sep 07 12:42:10.090585 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:10.090585 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:10.090585 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:10.090585 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:10.090585 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 07 12:42:10.090585 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 07 12:42:10.090585 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 07 12:42:10.090585 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 07 12:42:10.090585 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 07 12:42:10.090585 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 07 12:42:10.090585 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 07 12:42:10.090585 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 07 12:42:10.090585 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 12:42:10.090585 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 12:42:10.090585 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:42:10.090585 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:42:10.090585 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 12:42:10.090585 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 12:42:10.093269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:42:10.093269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:42:10.093269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 12:42:10.093269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 12:42:10.093269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 12:42:10.093269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 12:42:10.093269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:42:10.093269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:42:10.093269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:42:10.093269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:42:10.093269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9f69404f-0b39-4b9b-866e-a721f4eb69ba could not be found. Sep 07 12:42:10.093269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:10.093269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:10.093269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:10.093269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:10.093269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:42:10.093269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:42:10.093269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:42:10.093269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:42:10.097791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:42:10.097791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:42:10.097791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:42:10.097791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:42:10.097791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:42:10.097791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:42:10.097791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Sep 07 12:42:10.097791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 07 12:42:10.097791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 07 12:42:10.097791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 12:42:10.097791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 12:42:10.097791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:10.097791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:10.097791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:10.097791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:10.097791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:42:10.097791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:42:10.097791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:42:10.097791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:42:10.097791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 12:42:10.097791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:10.100821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dfa03484-16fc-4632-9eca-16b92af1f5e3 tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] Returning 404 to user: Image not found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:42:10.100821 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dfa03484-16fc-4632-9eca-16b92af1f5e3 tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] 10.222.0.16 "PUT /compute/v2.1/images/9f69404f-0b39-4b9b-866e-a721f4eb69ba/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.066242 Sep 07 12:42:10.103828 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1308/2593] 10.222.0.16 () {60 vars in 1310 bytes} [Wed Sep 7 12:42:10 2022] PUT /compute/v2.1/images/9f69404f-0b39-4b9b-866e-a721f4eb69ba/metadata/os_distro => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:42:10.128985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f0857e59-26ca-4ec1-820b-37a34f1a69db tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:10.129445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f0857e59-26ca-4ec1-820b-37a34f1a69db tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] [instance: 6762b361-a49e-467e-ba9b-cebfb35d9a58] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:10.151803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0857e59-26ca-4ec1-820b-37a34f1a69db tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:10.156382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0857e59-26ca-4ec1-820b-37a34f1a69db tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:10.157168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0857e59-26ca-4ec1-820b-37a34f1a69db tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:10.160511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0857e59-26ca-4ec1-820b-37a34f1a69db tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:10.163016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0857e59-26ca-4ec1-820b-37a34f1a69db tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:10.165304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0857e59-26ca-4ec1-820b-37a34f1a69db tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:10.227532 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4fadf414-82d9-4740-b1f2-ac4314e8db4d tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:10.247924 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4fadf414-82d9-4740-b1f2-ac4314e8db4d tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45" status: 200 len: 1216 microversion: 2.1 time: 0.273056 Sep 07 12:42:10.249203 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1286/2594] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:09 2022] GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 => generated 1216 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:10.269175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-7911b1b9-3a97-4f4b-812d-a0171e325678 req-cbe6cdc9-797c-4a9b-b6db-d3c66794c374 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "663da890-aea0-44c3-842f-71ee8abfaac8", "tag": "91a161ca-8197-4775-8162-05a0be29c897"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:10.297928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7911b1b9-3a97-4f4b-812d-a0171e325678 req-cbe6cdc9-797c-4a9b-b6db-d3c66794c374 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:10.298423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7911b1b9-3a97-4f4b-812d-a0171e325678 req-cbe6cdc9-797c-4a9b-b6db-d3c66794c374 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:10.298868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7911b1b9-3a97-4f4b-812d-a0171e325678 req-cbe6cdc9-797c-4a9b-b6db-d3c66794c374 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:10.338738 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-7911b1b9-3a97-4f4b-812d-a0171e325678 req-cbe6cdc9-797c-4a9b-b6db-d3c66794c374 service nova] Creating event network-changed:91a161ca-8197-4775-8162-05a0be29c897 for instance 663da890-aea0-44c3-842f-71ee8abfaac8 on n-h1-852087-9 Sep 07 12:42:10.358494 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-7911b1b9-3a97-4f4b-812d-a0171e325678 req-cbe6cdc9-797c-4a9b-b6db-d3c66794c374 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105931 Sep 07 12:42:10.364548 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1287/2595] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:10.385162 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b7dc923c-1f8d-4d81-8385-cbd29861decc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:10.385929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b7dc923c-1f8d-4d81-8385-cbd29861decc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:10.424095 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7dc923c-1f8d-4d81-8385-cbd29861decc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:10.424721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7dc923c-1f8d-4d81-8385-cbd29861decc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:10.430641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7dc923c-1f8d-4d81-8385-cbd29861decc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:10.435679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7dc923c-1f8d-4d81-8385-cbd29861decc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:10.438243 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7dc923c-1f8d-4d81-8385-cbd29861decc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:10.438805 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7dc923c-1f8d-4d81-8385-cbd29861decc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:10.779274 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f0857e59-26ca-4ec1-820b-37a34f1a69db tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/6762b361-a49e-467e-ba9b-cebfb35d9a58" status: 200 len: 1618 microversion: 2.1 time: 0.671853 Sep 07 12:42:10.786235 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1309/2596] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:10 2022] GET /compute/v2.1/servers/6762b361-a49e-467e-ba9b-cebfb35d9a58 => generated 1618 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:10.791574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b7dc923c-1f8d-4d81-8385-cbd29861decc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:10.797654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-06cec2af-cd7f-41ef-8144-837ac2bf1d99 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc4184100d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:10.821543 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b7dc923c-1f8d-4d81-8385-cbd29861decc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1506 microversion: 2.1 time: 0.453785 Sep 07 12:42:10.834536 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1288/2597] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:10 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1506 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:10.869680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae18f6eb-8a9e-4a5e-a8a4-632aa3279f13 tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] Action: 'create', calling method: .version_select at 0x7fc41850b1f0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:10.906340 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-06cec2af-cd7f-41ef-8144-837ac2bf1d99 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4" status: 200 len: 1429 microversion: 2.1 time: 0.117687 Sep 07 12:42:10.914561 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1310/2598] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:42:10 2022] GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4 => generated 1429 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:10.920575 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-ae18f6eb-8a9e-4a5e-a8a4-632aa3279f13 tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] HTTP exception thrown: Image not found. Sep 07 12:42:10.922938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-33fff816-98e9-4c20-b78d-cf7c09af10b2 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:10.923205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae18f6eb-8a9e-4a5e-a8a4-632aa3279f13 tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] Request method failure captured: Sep 07 12:42:10.923205 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/images/f50e7df5-9e56-47c0-a60c-7c3346b699dd/metadata HTTP/1.1 Sep 07 12:42:10.923205 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:42:10.923205 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:42:10.923205 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:42:10.923205 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 57 Sep 07 12:42:10.923205 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:42:10.923205 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:42:10.923205 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:42:10.923205 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:42:10.923205 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJGajVBNVp3tJHLikQqVvtwF94NAnUdk2KsJ1ehVdIMD7-mr4Gq6gNkts1BkVqgVlDM1omZ-zS_KNOmLD3CwkAHOHbd5FtYvl6ZTGDN27TeEroeVYRIMJgxRIQLCXo00PAK_5Y8Zesn6FrUsRLHL9FlY3uYH6EDqns1ymag127Up-XU Sep 07 12:42:10.923205 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:42:10.923205 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:42:10.923205 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:42:10.923205 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:42:10.923205 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:42:10.923205 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:42:10.923205 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 23ab27472b224f609fb1da2cb67d9e69 Sep 07 12:42:10.923205 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1102613464 Sep 07 12:42:10.923205 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:42:10.923205 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:42:10.925645 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/23ab27472b224f609fb1da2cb67d9e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_23ab27472b224f609fb1da2cb67d9e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/23ab27472b224f609fb1da2cb67d9e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/23ab27472b224f609fb1da2cb67d9e69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:42:10.925645 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1102613464 Sep 07 12:42:10.925645 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 23ab27472b224f609fb1da2cb67d9e69 Sep 07 12:42:10.925645 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1102613464 Sep 07 12:42:10.925645 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ImagesMetadataNegativeTestJSON-1102613464-project Sep 07 12:42:10.925645 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:42:10.925645 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:42:10.925645 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 7cebfca97074466bb2a176d6ec93f31e Sep 07 12:42:10.925645 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1102613464-project Sep 07 12:42:10.925645 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:42:10.925645 n-d-852087-9 devstack@n-api.service[122433]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 07 12:42:10.925645 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:42:10.925645 n-d-852087-9 devstack@n-api.service[122433]: exception: Image not found. Sep 07 12:42:10.925645 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'image_id': 'f50e7df5-9e56-47c0-a60c-7c3346b699dd', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 07 12:42:10.927133 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:42:10.927133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:10.927133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 12:42:10.927133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 12:42:10.927133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:42:10.927133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:42:10.927133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 12:42:10.927133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 12:42:10.927133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:42:10.927133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:42:10.927133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 12:42:10.927133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 12:42:10.927133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 12:42:10.927133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 12:42:10.927133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:42:10.927133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:42:10.927133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:42:10.927133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:42:10.929210 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f50e7df5-9e56-47c0-a60c-7c3346b699dd Sep 07 12:42:10.929210 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:10.929210 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:10.929210 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:10.929210 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:10.929210 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 07 12:42:10.929210 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 07 12:42:10.929210 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 07 12:42:10.929210 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 07 12:42:10.929210 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 07 12:42:10.929210 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 07 12:42:10.929210 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 07 12:42:10.929210 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 07 12:42:10.929210 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 12:42:10.929210 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 12:42:10.929210 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:42:10.929210 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:42:10.929210 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 12:42:10.929210 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 12:42:10.931483 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:42:10.931483 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:42:10.931483 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 12:42:10.931483 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 12:42:10.931483 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 12:42:10.931483 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 12:42:10.931483 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:42:10.931483 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:42:10.931483 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:42:10.931483 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:42:10.931483 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f50e7df5-9e56-47c0-a60c-7c3346b699dd could not be found. Sep 07 12:42:10.931483 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:10.931483 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:10.931483 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:10.931483 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:10.931483 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:42:10.931483 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:42:10.931483 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:42:10.931483 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:42:10.933640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:42:10.933640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:42:10.933640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:42:10.933640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:42:10.933640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:42:10.933640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:42:10.933640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Sep 07 12:42:10.933640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 07 12:42:10.933640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 07 12:42:10.933640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 12:42:10.933640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 12:42:10.933640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:10.933640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:10.933640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:10.933640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:10.933640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:42:10.933640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:42:10.933640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:42:10.933640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:42:10.933640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 12:42:10.933640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:10.936408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae18f6eb-8a9e-4a5e-a8a4-632aa3279f13 tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] Returning 404 to user: Image not found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:42:10.942185 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ae18f6eb-8a9e-4a5e-a8a4-632aa3279f13 tempest-ImagesMetadataNegativeTestJSON-1102613464 tempest-ImagesMetadataNegativeTestJSON-1102613464-project] 10.222.0.16 "POST /compute/v2.1/images/f50e7df5-9e56-47c0-a60c-7c3346b699dd/metadata" status: 404 len: 62 microversion: 2.1 time: 0.093402 Sep 07 12:42:10.942843 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1289/2599] 10.222.0.16 () {60 vars in 1281 bytes} [Wed Sep 7 12:42:10 2022] POST /compute/v2.1/images/f50e7df5-9e56-47c0-a60c-7c3346b699dd/metadata => generated 62 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:42:10.943856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-33fff816-98e9-4c20-b78d-cf7c09af10b2 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] [instance: 8d248e06-d37c-4895-85a8-e8c5e412aedb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:10.993710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-12361d67-f409-4d2d-ba17-9ee892ea948a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:10.995245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-12361d67-f409-4d2d-ba17-9ee892ea948a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:11.008791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33fff816-98e9-4c20-b78d-cf7c09af10b2 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:11.009705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33fff816-98e9-4c20-b78d-cf7c09af10b2 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:11.012991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33fff816-98e9-4c20-b78d-cf7c09af10b2 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:11.013553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12361d67-f409-4d2d-ba17-9ee892ea948a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:11.014037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33fff816-98e9-4c20-b78d-cf7c09af10b2 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:11.016819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12361d67-f409-4d2d-ba17-9ee892ea948a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:11.017781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12361d67-f409-4d2d-ba17-9ee892ea948a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:11.020400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12361d67-f409-4d2d-ba17-9ee892ea948a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:11.021024 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33fff816-98e9-4c20-b78d-cf7c09af10b2 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:11.021234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12361d67-f409-4d2d-ba17-9ee892ea948a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:11.022047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33fff816-98e9-4c20-b78d-cf7c09af10b2 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:11.022688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12361d67-f409-4d2d-ba17-9ee892ea948a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:12.195863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-12361d67-f409-4d2d-ba17-9ee892ea948a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:12.228439 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-12361d67-f409-4d2d-ba17-9ee892ea948a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1325 microversion: 2.1 time: 1.238431 Sep 07 12:42:12.230388 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1290/2600] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:10 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1325 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:42:12.240483 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-183c929e-2e6f-4e65-8ef6-a2a501168c26 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:12.242203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-183c929e-2e6f-4e65-8ef6-a2a501168c26 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 2360d1da-9d70-4484-be65-d3cc510b9071] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:12.257375 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-33fff816-98e9-4c20-b78d-cf7c09af10b2 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8d248e06-d37c-4895-85a8-e8c5e412aedb" status: 200 len: 1619 microversion: 2.1 time: 1.339745 Sep 07 12:42:12.258420 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-183c929e-2e6f-4e65-8ef6-a2a501168c26 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:12.259640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-183c929e-2e6f-4e65-8ef6-a2a501168c26 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:12.260689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-183c929e-2e6f-4e65-8ef6-a2a501168c26 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:12.262382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-183c929e-2e6f-4e65-8ef6-a2a501168c26 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:12.273607 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1311/2601] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:10 2022] GET /compute/v2.1/servers/8d248e06-d37c-4895-85a8-e8c5e412aedb => generated 1619 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:12.276662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-183c929e-2e6f-4e65-8ef6-a2a501168c26 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:12.286926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-183c929e-2e6f-4e65-8ef6-a2a501168c26 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:12.320696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-55e85667-b148-4b54-a6fd-a63d9291e1f2 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:12.325460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-55e85667-b148-4b54-a6fd-a63d9291e1f2 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:12.358488 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55e85667-b148-4b54-a6fd-a63d9291e1f2 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:12.364125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55e85667-b148-4b54-a6fd-a63d9291e1f2 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:12.365388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55e85667-b148-4b54-a6fd-a63d9291e1f2 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:12.368657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55e85667-b148-4b54-a6fd-a63d9291e1f2 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:12.372447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55e85667-b148-4b54-a6fd-a63d9291e1f2 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:12.374957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55e85667-b148-4b54-a6fd-a63d9291e1f2 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:13.144180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-55e85667-b148-4b54-a6fd-a63d9291e1f2 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:13.206776 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-55e85667-b148-4b54-a6fd-a63d9291e1f2 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45" status: 200 len: 1212 microversion: 2.1 time: 0.937862 Sep 07 12:42:13.207629 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1312/2602] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:12 2022] GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 => generated 1212 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:13.240205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-5857ec8b-42c9-42d9-acdc-a884b48e9a98 req-b85d8b34-961b-454a-8304-1525e904a505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "886a386f-a0cc-4d90-96ac-4e418ed43bce", "name": "network-vif-plugged", "status": "completed", "tag": "a0ca592a-191a-4417-974a-0fdc230ebb1c"}, {"server_uuid": "9b8d74fd-0b94-465e-a644-a44170def51c", "name": "network-vif-unplugged", "status": "completed", "tag": "798531a0-1079-41ca-b03b-2f727c036b56"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:13.262559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5857ec8b-42c9-42d9-acdc-a884b48e9a98 req-b85d8b34-961b-454a-8304-1525e904a505 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:13.263550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5857ec8b-42c9-42d9-acdc-a884b48e9a98 req-b85d8b34-961b-454a-8304-1525e904a505 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:13.263861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5857ec8b-42c9-42d9-acdc-a884b48e9a98 req-b85d8b34-961b-454a-8304-1525e904a505 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:13.298023 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-5857ec8b-42c9-42d9-acdc-a884b48e9a98 req-b85d8b34-961b-454a-8304-1525e904a505 service nova] Creating event network-vif-plugged:a0ca592a-191a-4417-974a-0fdc230ebb1c for instance 886a386f-a0cc-4d90-96ac-4e418ed43bce on n-h1-852087-9 Sep 07 12:42:13.301195 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-5857ec8b-42c9-42d9-acdc-a884b48e9a98 req-b85d8b34-961b-454a-8304-1525e904a505 service nova] Creating event network-vif-unplugged:798531a0-1079-41ca-b03b-2f727c036b56 for instance 9b8d74fd-0b94-465e-a644-a44170def51c on n-h2-852087-9 Sep 07 12:42:13.331759 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-5857ec8b-42c9-42d9-acdc-a884b48e9a98 req-b85d8b34-961b-454a-8304-1525e904a505 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.106840 Sep 07 12:42:13.342578 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1313/2603] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:13.349504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f492b73f-e46b-4f55-8f30-ddef32b4532b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:13.354219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f492b73f-e46b-4f55-8f30-ddef32b4532b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:13.370275 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f492b73f-e46b-4f55-8f30-ddef32b4532b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:13.370664 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f492b73f-e46b-4f55-8f30-ddef32b4532b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:13.372551 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f492b73f-e46b-4f55-8f30-ddef32b4532b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:13.372551 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f492b73f-e46b-4f55-8f30-ddef32b4532b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:13.372551 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f492b73f-e46b-4f55-8f30-ddef32b4532b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:13.374034 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f492b73f-e46b-4f55-8f30-ddef32b4532b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:13.752495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-183c929e-2e6f-4e65-8ef6-a2a501168c26 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:13.795430 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-183c929e-2e6f-4e65-8ef6-a2a501168c26 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071" status: 200 len: 1508 microversion: 2.1 time: 1.558649 Sep 07 12:42:13.799238 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1291/2604] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:12 2022] GET /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071 => generated 1508 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:13.825213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-960c9429-663d-422b-a538-7160c774ae07 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc4192a4c10>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:13.954260 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-960c9429-663d-422b-a538-7160c774ae07 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4" status: 200 len: 1429 microversion: 2.1 time: 0.148815 Sep 07 12:42:13.954260 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1292/2605] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:42:13 2022] GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4 => generated 1429 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:13.970350 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c64a46b-d759-4b07-803a-e73daaa9e058 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1390414306", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:14.005713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:42:14.047696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f492b73f-e46b-4f55-8f30-ddef32b4532b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:14.058440 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f492b73f-e46b-4f55-8f30-ddef32b4532b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 200 len: 1509 microversion: 2.1 time: 0.713687 Sep 07 12:42:14.059437 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1314/2606] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:13 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 1509 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:14.080317 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e7c0a54c-f711-4dca-8060-fb766a659726 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:14.081218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e7c0a54c-f711-4dca-8060-fb766a659726 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:14.099553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7c0a54c-f711-4dca-8060-fb766a659726 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:14.100572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7c0a54c-f711-4dca-8060-fb766a659726 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:14.102024 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7c0a54c-f711-4dca-8060-fb766a659726 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:14.103486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7c0a54c-f711-4dca-8060-fb766a659726 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:14.104153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7c0a54c-f711-4dca-8060-fb766a659726 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:14.106326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7c0a54c-f711-4dca-8060-fb766a659726 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:14.122249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-2c64a46b-d759-4b07-803a-e73daaa9e058 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:42:15.217645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e7c0a54c-f711-4dca-8060-fb766a659726 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:15.231829 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e7c0a54c-f711-4dca-8060-fb766a659726 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1325 microversion: 2.1 time: 1.171069 Sep 07 12:42:15.249201 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1315/2607] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:14 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1325 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:15.260004 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6d731034-4382-4688-a649-2c7ef3a0a6b4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:15.261068 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6d731034-4382-4688-a649-2c7ef3a0a6b4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: abbf48d7-8190-4dde-8fb6-95d83eccf1b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:15.267635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d731034-4382-4688-a649-2c7ef3a0a6b4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:15.268391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d731034-4382-4688-a649-2c7ef3a0a6b4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:15.269068 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d731034-4382-4688-a649-2c7ef3a0a6b4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:15.270050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d731034-4382-4688-a649-2c7ef3a0a6b4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:15.270678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d731034-4382-4688-a649-2c7ef3a0a6b4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:15.271259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d731034-4382-4688-a649-2c7ef3a0a6b4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:15.371977 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-2c64a46b-d759-4b07-803a-e73daaa9e058 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:42:15.373242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-2c64a46b-d759-4b07-803a-e73daaa9e058 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:42:15.374097 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-2c64a46b-d759-4b07-803a-e73daaa9e058 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:42:15.374663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-2c64a46b-d759-4b07-803a-e73daaa9e058 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:42:15.375452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-2c64a46b-d759-4b07-803a-e73daaa9e058 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:42:15.396310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c64a46b-d759-4b07-803a-e73daaa9e058 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:15.396856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c64a46b-d759-4b07-803a-e73daaa9e058 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:15.397514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c64a46b-d759-4b07-803a-e73daaa9e058 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:15.398506 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c64a46b-d759-4b07-803a-e73daaa9e058 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:15.399159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c64a46b-d759-4b07-803a-e73daaa9e058 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:15.399766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c64a46b-d759-4b07-803a-e73daaa9e058 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:15.428896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-2c64a46b-d759-4b07-803a-e73daaa9e058 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:42:15.440361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-2c64a46b-d759-4b07-803a-e73daaa9e058 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for user ed6e5d4d54224bca90954d1ebbd7b7a3 and project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:42:15.488990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2c64a46b-d759-4b07-803a-e73daaa9e058 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:42:15.492273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2c64a46b-d759-4b07-803a-e73daaa9e058 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:42:15.652694 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2c64a46b-d759-4b07-803a-e73daaa9e058 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.692135 Sep 07 12:42:15.670011 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1293/2608] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:42:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:42:15.681418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5692f32d-759f-4267-bb93-95b53de920d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:15.683086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5692f32d-759f-4267-bb93-95b53de920d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:15.711808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5692f32d-759f-4267-bb93-95b53de920d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:15.717876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5692f32d-759f-4267-bb93-95b53de920d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:15.733785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5692f32d-759f-4267-bb93-95b53de920d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:15.739412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5692f32d-759f-4267-bb93-95b53de920d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:15.743554 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5692f32d-759f-4267-bb93-95b53de920d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:15.745103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5692f32d-759f-4267-bb93-95b53de920d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:15.900406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5692f32d-759f-4267-bb93-95b53de920d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:42:15.936201 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.compute.api [None req-5692f32d-759f-4267-bb93-95b53de920d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Working on deleting snapshot 651c5d42-5e83-4255-8759-f52dab9cf1e7 from shelved instance... Sep 07 12:42:17.109762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6d731034-4382-4688-a649-2c7ef3a0a6b4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:17.180833 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6d731034-4382-4688-a649-2c7ef3a0a6b4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/abbf48d7-8190-4dde-8fb6-95d83eccf1b3" status: 200 len: 1508 microversion: 2.1 time: 1.925903 Sep 07 12:42:17.193152 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1316/2609] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:15 2022] GET /compute/v2.1/servers/abbf48d7-8190-4dde-8fb6-95d83eccf1b3 => generated 1508 bytes in 1943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:17.234053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1b25d802-584c-4dc3-8396-6369469227c9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:17.239115 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1b25d802-584c-4dc3-8396-6369469227c9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:17.251495 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b25d802-584c-4dc3-8396-6369469227c9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:17.252654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b25d802-584c-4dc3-8396-6369469227c9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:17.253921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b25d802-584c-4dc3-8396-6369469227c9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:17.255503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b25d802-584c-4dc3-8396-6369469227c9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:17.256872 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b25d802-584c-4dc3-8396-6369469227c9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:17.258168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b25d802-584c-4dc3-8396-6369469227c9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:17.470652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1b25d802-584c-4dc3-8396-6369469227c9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:17.484393 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1b25d802-584c-4dc3-8396-6369469227c9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45" status: 200 len: 1274 microversion: 2.1 time: 0.289145 Sep 07 12:42:17.485743 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1317/2610] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:17 2022] GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 => generated 1274 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:17.491552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-90aedf79-fb4e-4900-9356-c6971e77f8bd tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc41848ec10>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:18.654047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:42:18.724026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:42:19.206943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5692f32d-759f-4267-bb93-95b53de920d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Doing local delete in cell 9e0290a2-728a-49bc-bfb2-19275e06ed31(cell1) {{(pid=122433) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 07 12:42:19.207777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5692f32d-759f-4267-bb93-95b53de920d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:19.213956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5692f32d-759f-4267-bb93-95b53de920d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:19.214431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5692f32d-759f-4267-bb93-95b53de920d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:19.216040 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.compute.api [None req-5692f32d-759f-4267-bb93-95b53de920d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 07 12:42:19.227833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-5692f32d-759f-4267-bb93-95b53de920d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] deallocate_for_instance() {{(pid=122433) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 07 12:42:19.280260 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-90aedf79-fb4e-4900-9356-c6971e77f8bd tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4" status: 200 len: 1429 microversion: 2.1 time: 1.792672 Sep 07 12:42:19.287146 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1318/2611] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:42:17 2022] GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4 => generated 1429 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:19.304588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-51cb0cb4-20de-4685-aec8-385a79f1e49e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:19.326156 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-51cb0cb4-20de-4685-aec8-385a79f1e49e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:19.370090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51cb0cb4-20de-4685-aec8-385a79f1e49e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:19.375229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51cb0cb4-20de-4685-aec8-385a79f1e49e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:19.377056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51cb0cb4-20de-4685-aec8-385a79f1e49e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:19.387903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51cb0cb4-20de-4685-aec8-385a79f1e49e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:19.387903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51cb0cb4-20de-4685-aec8-385a79f1e49e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:19.389285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51cb0cb4-20de-4685-aec8-385a79f1e49e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:20.008620 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-51cb0cb4-20de-4685-aec8-385a79f1e49e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:20.040360 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-51cb0cb4-20de-4685-aec8-385a79f1e49e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca" status: 200 len: 1269 microversion: 2.1 time: 0.750155 Sep 07 12:42:20.042675 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1319/2612] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:19 2022] GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca => generated 1269 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:20.062147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-05976e42-6c97-4341-b130-0a1242fcad75 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:20.066108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-05976e42-6c97-4341-b130-0a1242fcad75 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:20.084138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05976e42-6c97-4341-b130-0a1242fcad75 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:20.087008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05976e42-6c97-4341-b130-0a1242fcad75 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:20.088786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05976e42-6c97-4341-b130-0a1242fcad75 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:20.091690 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05976e42-6c97-4341-b130-0a1242fcad75 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:20.093771 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05976e42-6c97-4341-b130-0a1242fcad75 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:20.099825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05976e42-6c97-4341-b130-0a1242fcad75 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:21.130243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-05976e42-6c97-4341-b130-0a1242fcad75 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:21.144399 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-05976e42-6c97-4341-b130-0a1242fcad75 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1325 microversion: 2.1 time: 1.098866 Sep 07 12:42:21.160136 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1320/2613] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:20 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1325 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:21.170915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-47127947-24d6-4d98-a58a-a02e7a69af00 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:21.171713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-47127947-24d6-4d98-a58a-a02e7a69af00 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: abbf48d7-8190-4dde-8fb6-95d83eccf1b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:21.180346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47127947-24d6-4d98-a58a-a02e7a69af00 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:21.181170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47127947-24d6-4d98-a58a-a02e7a69af00 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:21.181823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47127947-24d6-4d98-a58a-a02e7a69af00 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:21.182729 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47127947-24d6-4d98-a58a-a02e7a69af00 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:21.183360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47127947-24d6-4d98-a58a-a02e7a69af00 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:21.183953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47127947-24d6-4d98-a58a-a02e7a69af00 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:21.235030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-47127947-24d6-4d98-a58a-a02e7a69af00 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: abbf48d7-8190-4dde-8fb6-95d83eccf1b3] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:42:21.516841 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-47127947-24d6-4d98-a58a-a02e7a69af00 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "DELETE /compute/v2.1/servers/abbf48d7-8190-4dde-8fb6-95d83eccf1b3" status: 204 len: 0 microversion: 2.1 time: 0.354504 Sep 07 12:42:21.523661 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1321/2614] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:42:21 2022] DELETE /compute/v2.1/servers/abbf48d7-8190-4dde-8fb6-95d83eccf1b3 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:42:21.545784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8a225f97-d3b7-462b-b44a-0d0640e06397 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:21.559203 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8a225f97-d3b7-462b-b44a-0d0640e06397 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:21.574328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a225f97-d3b7-462b-b44a-0d0640e06397 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:21.577287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a225f97-d3b7-462b-b44a-0d0640e06397 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:21.579491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a225f97-d3b7-462b-b44a-0d0640e06397 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:21.583185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a225f97-d3b7-462b-b44a-0d0640e06397 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:21.589043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a225f97-d3b7-462b-b44a-0d0640e06397 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:21.590571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a225f97-d3b7-462b-b44a-0d0640e06397 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:21.597881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-5692f32d-759f-4267-bb93-95b53de920d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Updating instance_info_cache with network_info: [] {{(pid=122433) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 07 12:42:21.631442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:SAVEPOINT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:42:21.644450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:42:22.004997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8a225f97-d3b7-462b-b44a-0d0640e06397 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:22.019932 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8a225f97-d3b7-462b-b44a-0d0640e06397 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45" status: 200 len: 1316 microversion: 2.1 time: 0.492351 Sep 07 12:42:22.020609 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1322/2615] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:21 2022] GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 => generated 1316 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:22.027102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9daff2fb-6907-4013-b0d0-aba08e1c1dc4 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc41d1de160>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:22.135884 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9daff2fb-6907-4013-b0d0-aba08e1c1dc4 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4" status: 200 len: 1429 microversion: 2.1 time: 0.113802 Sep 07 12:42:22.137322 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1323/2616] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:42:22 2022] GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4 => generated 1429 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:22.151105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e144cc1c-5cce-4114-81d7-ee4739c46617 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:22.156108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e144cc1c-5cce-4114-81d7-ee4739c46617 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:22.177987 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e144cc1c-5cce-4114-81d7-ee4739c46617 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:22.179082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e144cc1c-5cce-4114-81d7-ee4739c46617 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:22.179725 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e144cc1c-5cce-4114-81d7-ee4739c46617 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:22.183163 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e144cc1c-5cce-4114-81d7-ee4739c46617 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:22.187496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e144cc1c-5cce-4114-81d7-ee4739c46617 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:22.191787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e144cc1c-5cce-4114-81d7-ee4739c46617 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:22.420383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e144cc1c-5cce-4114-81d7-ee4739c46617 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:22.447203 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e144cc1c-5cce-4114-81d7-ee4739c46617 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca" status: 200 len: 1275 microversion: 2.1 time: 0.306153 Sep 07 12:42:22.465692 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1324/2617] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:22 2022] GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca => generated 1275 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:22.481035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e74fea88-335f-45cc-ba7a-8a5842d7053a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:22.484623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e74fea88-335f-45cc-ba7a-8a5842d7053a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 2360d1da-9d70-4484-be65-d3cc510b9071] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:22.507215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e74fea88-335f-45cc-ba7a-8a5842d7053a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:22.508022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e74fea88-335f-45cc-ba7a-8a5842d7053a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:22.508985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e74fea88-335f-45cc-ba7a-8a5842d7053a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:22.517267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e74fea88-335f-45cc-ba7a-8a5842d7053a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:22.518437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e74fea88-335f-45cc-ba7a-8a5842d7053a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:22.519524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e74fea88-335f-45cc-ba7a-8a5842d7053a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:22.560813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e74fea88-335f-45cc-ba7a-8a5842d7053a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 2360d1da-9d70-4484-be65-d3cc510b9071] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:42:22.575740 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5692f32d-759f-4267-bb93-95b53de920d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 204 len: 0 microversion: 2.1 time: 6.903269 Sep 07 12:42:22.576354 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1294/2618] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:42:15 2022] DELETE /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 0 bytes in 6906 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:42:22.585856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-33edbd18-4d57-4ece-9e84-d1c0fcdc5ef2 req-b7483547-3d6e-4daf-91d8-cd14cc1d0730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8d74fd-0b94-465e-a644-a44170def51c", "name": "network-vif-deleted", "tag": "798531a0-1079-41ca-b03b-2f727c036b56"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:22.612976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-33edbd18-4d57-4ece-9e84-d1c0fcdc5ef2 req-b7483547-3d6e-4daf-91d8-cd14cc1d0730 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:22.614306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-33edbd18-4d57-4ece-9e84-d1c0fcdc5ef2 req-b7483547-3d6e-4daf-91d8-cd14cc1d0730 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:22.622507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-33edbd18-4d57-4ece-9e84-d1c0fcdc5ef2 req-b7483547-3d6e-4daf-91d8-cd14cc1d0730 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:22.648656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.compute.server_external_events [req-33edbd18-4d57-4ece-9e84-d1c0fcdc5ef2 req-b7483547-3d6e-4daf-91d8-cd14cc1d0730 service nova] Unable to find a host for instance 9b8d74fd-0b94-465e-a644-a44170def51c. Dropping event network-vif-deleted {{(pid=122433) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 07 12:42:22.656607 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-33edbd18-4d57-4ece-9e84-d1c0fcdc5ef2 req-b7483547-3d6e-4daf-91d8-cd14cc1d0730 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.078791 Sep 07 12:42:22.666711 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1295/2619] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 89 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 07 12:42:22.671781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb14bfe7-0222-42cf-b476-7cdb58896d41 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:22.672418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cb14bfe7-0222-42cf-b476-7cdb58896d41 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:22.690018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb14bfe7-0222-42cf-b476-7cdb58896d41 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:22.690550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb14bfe7-0222-42cf-b476-7cdb58896d41 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:22.690998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb14bfe7-0222-42cf-b476-7cdb58896d41 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:22.691751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb14bfe7-0222-42cf-b476-7cdb58896d41 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:22.705439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb14bfe7-0222-42cf-b476-7cdb58896d41 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:22.707658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb14bfe7-0222-42cf-b476-7cdb58896d41 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:22.810687 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e74fea88-335f-45cc-ba7a-8a5842d7053a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071" status: 204 len: 0 microversion: 2.1 time: 0.340670 Sep 07 12:42:22.812663 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1325/2620] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:42:22 2022] DELETE /compute/v2.1/servers/2360d1da-9d70-4484-be65-d3cc510b9071 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:42:22.824586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-68dfcada-7ba0-4fbb-812a-96017ae1122b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:22.825620 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-68dfcada-7ba0-4fbb-812a-96017ae1122b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:22.839981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68dfcada-7ba0-4fbb-812a-96017ae1122b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:22.840749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68dfcada-7ba0-4fbb-812a-96017ae1122b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:22.841378 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68dfcada-7ba0-4fbb-812a-96017ae1122b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:22.847045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68dfcada-7ba0-4fbb-812a-96017ae1122b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:22.848773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68dfcada-7ba0-4fbb-812a-96017ae1122b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:22.849813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68dfcada-7ba0-4fbb-812a-96017ae1122b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:22.890854 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-68dfcada-7ba0-4fbb-812a-96017ae1122b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] HTTP exception thrown: Instance 9b8d74fd-0b94-465e-a644-a44170def51c could not be found. Sep 07 12:42:22.892947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-68dfcada-7ba0-4fbb-812a-96017ae1122b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Request method failure captured: Sep 07 12:42:22.892947 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c HTTP/1.1 Sep 07 12:42:22.892947 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:42:22.892947 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:42:22.892947 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:42:22.892947 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:42:22.892947 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:42:22.892947 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:42:22.892947 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:42:22.892947 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:42:22.892947 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJBoiaP7MPiSaP6e6aUmMJ8PuR8TxD72E3ycIsoyb5pICiti0ZKBvrRvNoP9EgDHIO9YzOUucG9iu3oQZMsvYh9Gs4g9xjGSFcMGctGxplJk2OO0Aofdu3Ru80K0M86m3EPIBI5c12Fca4rxAASE3osSSig78ynw4pFvNNSiXm2zkBk Sep 07 12:42:22.892947 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:42:22.892947 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:42:22.892947 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:42:22.892947 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:42:22.892947 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:42:22.892947 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:42:22.892947 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:42:22.892947 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:42:22.892947 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:42:22.892947 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:42:22.894430 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef5b2dd007e944358d72268414868096"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef5b2dd007e944358d72268414868096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:42:22.894430 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:42:22.894430 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:42:22.894430 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:42:22.894430 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:42:22.894430 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:42:22.894430 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:42:22.894430 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: b920811be01745fc9faea7a9ce213c6e Sep 07 12:42:22.894430 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:42:22.894430 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:42:22.894430 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 9b8d74fd-0b94-465e-a644-a44170def51c could not be found. Sep 07 12:42:22.894430 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '9b8d74fd-0b94-465e-a644-a44170def51c'} Sep 07 12:42:22.895251 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:42:22.895251 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:22.895251 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:42:22.895251 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:42:22.895251 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:42:22.895251 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:42:22.895251 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:42:22.895251 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:42:22.895251 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:42:22.895251 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:42:22.895251 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b8d74fd-0b94-465e-a644-a44170def51c could not be found. Sep 07 12:42:22.895251 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:22.895251 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:22.895251 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:22.895251 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:22.895251 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:42:22.895251 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:42:22.895251 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:42:22.895251 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:42:22.895251 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:42:22.896513 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:42:22.896513 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:42:22.896513 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:42:22.896513 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:42:22.896513 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:42:22.896513 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:42:22.896513 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:42:22.896513 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b8d74fd-0b94-465e-a644-a44170def51c could not be found. Sep 07 12:42:22.896513 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:22.896513 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:22.896513 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:22.896513 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:22.896513 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:42:22.896513 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:42:22.896513 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:42:22.896513 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:42:22.896513 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b8d74fd-0b94-465e-a644-a44170def51c could not be found. Sep 07 12:42:22.896513 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:22.898662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-68dfcada-7ba0-4fbb-812a-96017ae1122b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Returning 404 to user: Instance 9b8d74fd-0b94-465e-a644-a44170def51c could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:42:22.903051 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-68dfcada-7ba0-4fbb-812a-96017ae1122b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 404 len: 111 microversion: 2.1 time: 0.088633 Sep 07 12:42:22.904336 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1326/2621] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:22 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:42:23.045712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c67dc908-7b6f-476f-b3ec-c65dfe8a9fb9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:23.046382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c67dc908-7b6f-476f-b3ec-c65dfe8a9fb9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:23.054402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c67dc908-7b6f-476f-b3ec-c65dfe8a9fb9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:23.054911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c67dc908-7b6f-476f-b3ec-c65dfe8a9fb9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:23.055365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c67dc908-7b6f-476f-b3ec-c65dfe8a9fb9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:23.056110 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c67dc908-7b6f-476f-b3ec-c65dfe8a9fb9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:23.072377 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c67dc908-7b6f-476f-b3ec-c65dfe8a9fb9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:23.072920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c67dc908-7b6f-476f-b3ec-c65dfe8a9fb9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:23.609593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cb14bfe7-0222-42cf-b476-7cdb58896d41 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:23.632000 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cb14bfe7-0222-42cf-b476-7cdb58896d41 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1325 microversion: 2.1 time: 0.955622 Sep 07 12:42:23.632740 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1296/2622] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:22 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1325 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:23.638525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-10482708-2a2b-406a-be01-7831a3cca97b tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc41874e8b0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:23.681411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c67dc908-7b6f-476f-b3ec-c65dfe8a9fb9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:23.692192 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c67dc908-7b6f-476f-b3ec-c65dfe8a9fb9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45" status: 200 len: 1316 microversion: 2.1 time: 0.651755 Sep 07 12:42:23.710197 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1327/2623] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:23 2022] GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 => generated 1316 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:42:23.726269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c11cc359-923b-418f-9013-9f7004da5e32 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-501406366", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "f9f6b6a8-43a1-473b-b2ee-d0a73b68079f"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:23.780343 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-10482708-2a2b-406a-be01-7831a3cca97b tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4" status: 200 len: 1429 microversion: 2.1 time: 0.146466 Sep 07 12:42:23.781165 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1297/2624] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:42:23 2022] GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4 => generated 1429 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:23.786230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3fb978a1-777f-4542-a285-d912551900bc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-857186229", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "80d51306-dbb8-4c2e-bca9-60970c39d44b"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:23.907247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-c11cc359-923b-418f-9013-9f7004da5e32 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] validate_networks() for [('f9f6b6a8-43a1-473b-b2ee-d0a73b68079f', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:42:23.926286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-3fb978a1-777f-4542-a285-d912551900bc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] validate_networks() for [('80d51306-dbb8-4c2e-bca9-60970c39d44b', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:42:25.412754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:42:25.467850 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=10 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:42:28.694579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-3fb978a1-777f-4542-a285-d912551900bc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:42:28.695658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-3fb978a1-777f-4542-a285-d912551900bc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:42:28.696311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-3fb978a1-777f-4542-a285-d912551900bc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:42:28.696905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-3fb978a1-777f-4542-a285-d912551900bc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:42:28.697664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-3fb978a1-777f-4542-a285-d912551900bc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:42:28.721293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fb978a1-777f-4542-a285-d912551900bc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:28.723042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fb978a1-777f-4542-a285-d912551900bc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:28.724889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fb978a1-777f-4542-a285-d912551900bc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:28.729757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fb978a1-777f-4542-a285-d912551900bc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:28.730367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fb978a1-777f-4542-a285-d912551900bc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:28.730818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fb978a1-777f-4542-a285-d912551900bc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:28.787927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-3fb978a1-777f-4542-a285-d912551900bc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Getting quotas for project ef5b2dd007e944358d72268414868096. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:42:28.802110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-3fb978a1-777f-4542-a285-d912551900bc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Getting quotas for user b920811be01745fc9faea7a9ce213c6e and project ef5b2dd007e944358d72268414868096. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:42:28.830581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3fb978a1-777f-4542-a285-d912551900bc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:42:28.833729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3fb978a1-777f-4542-a285-d912551900bc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:42:28.932483 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3fb978a1-777f-4542-a285-d912551900bc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.149992 Sep 07 12:42:28.937018 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1298/2625] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:42:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 5155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:42:28.970163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ab8139b-c2d8-43fe-8758-b1f9494757bd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:28.971299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4ab8139b-c2d8-43fe-8758-b1f9494757bd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:29.015604 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ab8139b-c2d8-43fe-8758-b1f9494757bd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:29.019868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ab8139b-c2d8-43fe-8758-b1f9494757bd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:29.020593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ab8139b-c2d8-43fe-8758-b1f9494757bd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:29.022916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ab8139b-c2d8-43fe-8758-b1f9494757bd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:29.024190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ab8139b-c2d8-43fe-8758-b1f9494757bd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:29.027892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ab8139b-c2d8-43fe-8758-b1f9494757bd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:29.625314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c11cc359-923b-418f-9013-9f7004da5e32 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:42:29.626221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c11cc359-923b-418f-9013-9f7004da5e32 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:42:29.626389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c11cc359-923b-418f-9013-9f7004da5e32 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:42:29.626676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c11cc359-923b-418f-9013-9f7004da5e32 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:42:29.627576 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c11cc359-923b-418f-9013-9f7004da5e32 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:42:29.630800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:42:29.673651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c11cc359-923b-418f-9013-9f7004da5e32 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:29.677979 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c11cc359-923b-418f-9013-9f7004da5e32 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:29.678903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c11cc359-923b-418f-9013-9f7004da5e32 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:29.679948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c11cc359-923b-418f-9013-9f7004da5e32 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:29.680800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c11cc359-923b-418f-9013-9f7004da5e32 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:29.682906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c11cc359-923b-418f-9013-9f7004da5e32 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:29.750868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-c11cc359-923b-418f-9013-9f7004da5e32 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Getting quotas for project 3479aa98e81346039d54eec7a7fb2304. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:42:29.779537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-c11cc359-923b-418f-9013-9f7004da5e32 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Getting quotas for user 1f6382498aed492590e3fb1896f692f7 and project 3479aa98e81346039d54eec7a7fb2304. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:42:29.831536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c11cc359-923b-418f-9013-9f7004da5e32 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Going to run 2 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:42:29.839086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c11cc359-923b-418f-9013-9f7004da5e32 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: b847cba9-b245-4b45-b0bd-897d59ba9a67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:42:29.902245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c11cc359-923b-418f-9013-9f7004da5e32 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 4bb43114-1042-49c5-b60c-2474dae9f021] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=b847cba9-b245-4b45-b0bd-897d59ba9a67,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:42:29.976864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4ab8139b-c2d8-43fe-8758-b1f9494757bd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:29.993758 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ab8139b-c2d8-43fe-8758-b1f9494757bd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca" status: 200 len: 1317 microversion: 2.1 time: 1.051179 Sep 07 12:42:29.996718 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1299/2626] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:28 2022] GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca => generated 1317 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:30.010988 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-87e6b71d-1619-4d0a-9aec-cd842bc7403f req-df643ec0-9710-4cf4-8652-94c0ae1be06a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "663da890-aea0-44c3-842f-71ee8abfaac8", "name": "network-vif-plugged", "status": "completed", "tag": "91a161ca-8197-4775-8162-05a0be29c897"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:30.049152 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c11cc359-923b-418f-9013-9f7004da5e32 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 6.335484 Sep 07 12:42:30.053436 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1328/2627] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:42:23 2022] POST /compute/v2.1/servers => generated 32 bytes in 6343 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 07 12:42:30.063468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-87e6b71d-1619-4d0a-9aec-cd842bc7403f req-df643ec0-9710-4cf4-8652-94c0ae1be06a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:30.064521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-87e6b71d-1619-4d0a-9aec-cd842bc7403f req-df643ec0-9710-4cf4-8652-94c0ae1be06a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:30.065200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-87e6b71d-1619-4d0a-9aec-cd842bc7403f req-df643ec0-9710-4cf4-8652-94c0ae1be06a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:30.078144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-379da888-aeaa-4e3b-a7fb-db25a7ad4d4c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:30.080139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-379da888-aeaa-4e3b-a7fb-db25a7ad4d4c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:30.101817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-379da888-aeaa-4e3b-a7fb-db25a7ad4d4c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:30.102605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-379da888-aeaa-4e3b-a7fb-db25a7ad4d4c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:30.103070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-379da888-aeaa-4e3b-a7fb-db25a7ad4d4c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:30.105072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-379da888-aeaa-4e3b-a7fb-db25a7ad4d4c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:30.105989 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-379da888-aeaa-4e3b-a7fb-db25a7ad4d4c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:30.108657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-379da888-aeaa-4e3b-a7fb-db25a7ad4d4c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:30.119692 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-87e6b71d-1619-4d0a-9aec-cd842bc7403f req-df643ec0-9710-4cf4-8652-94c0ae1be06a service nova] Creating event network-vif-plugged:91a161ca-8197-4775-8162-05a0be29c897 for instance 663da890-aea0-44c3-842f-71ee8abfaac8 on n-h1-852087-9 Sep 07 12:42:30.168184 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-87e6b71d-1619-4d0a-9aec-cd842bc7403f req-df643ec0-9710-4cf4-8652-94c0ae1be06a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161481 Sep 07 12:42:30.179474 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1300/2628] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:30.223304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a82dba3e-effe-4246-b546-7252c6449d07 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:30.229402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a82dba3e-effe-4246-b546-7252c6449d07 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:30.278063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a82dba3e-effe-4246-b546-7252c6449d07 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:30.278922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a82dba3e-effe-4246-b546-7252c6449d07 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:30.279959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a82dba3e-effe-4246-b546-7252c6449d07 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:30.281410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a82dba3e-effe-4246-b546-7252c6449d07 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:30.282503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a82dba3e-effe-4246-b546-7252c6449d07 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:30.286118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a82dba3e-effe-4246-b546-7252c6449d07 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:30.750701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a82dba3e-effe-4246-b546-7252c6449d07 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:30.764296 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a82dba3e-effe-4246-b546-7252c6449d07 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45" status: 200 len: 1316 microversion: 2.1 time: 0.582592 Sep 07 12:42:30.769249 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1301/2629] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:30 2022] GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 => generated 1316 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:30.781397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ef25bb5f-222b-4cdb-9d46-68e1236d599f tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc41851c5e0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:30.848717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-379da888-aeaa-4e3b-a7fb-db25a7ad4d4c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:30.867885 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-379da888-aeaa-4e3b-a7fb-db25a7ad4d4c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1325 microversion: 2.1 time: 0.810603 Sep 07 12:42:30.872054 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1329/2630] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:30 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1325 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:30.887235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-1ae81cef-ae94-4377-8a7a-effdd15143e7 req-96ccc8a9-f506-407b-b9ec-6675662e5165 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45", "tag": "18cbdf2f-3657-4ad8-b999-fd91c1f28c75"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:30.936108 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ef25bb5f-222b-4cdb-9d46-68e1236d599f tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4" status: 200 len: 1429 microversion: 2.1 time: 0.165236 Sep 07 12:42:30.937440 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1302/2631] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:42:30 2022] GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4 => generated 1429 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:30.946812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8b53666f-bb91-4099-81e8-735ff734966a req-51ba3287-9351-40cf-b55d-dd1ae490f3ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca", "tag": "1a21d3dc-ddf4-4a1a-97b1-157da447d776"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:30.954693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1ae81cef-ae94-4377-8a7a-effdd15143e7 req-96ccc8a9-f506-407b-b9ec-6675662e5165 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:30.962142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1ae81cef-ae94-4377-8a7a-effdd15143e7 req-96ccc8a9-f506-407b-b9ec-6675662e5165 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:30.964111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1ae81cef-ae94-4377-8a7a-effdd15143e7 req-96ccc8a9-f506-407b-b9ec-6675662e5165 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:30.992599 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-1ae81cef-ae94-4377-8a7a-effdd15143e7 req-96ccc8a9-f506-407b-b9ec-6675662e5165 service nova] Creating event network-changed:18cbdf2f-3657-4ad8-b999-fd91c1f28c75 for instance bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 on n-h2-852087-9 Sep 07 12:42:30.995589 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8b53666f-bb91-4099-81e8-735ff734966a req-51ba3287-9351-40cf-b55d-dd1ae490f3ab service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:30.996892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8b53666f-bb91-4099-81e8-735ff734966a req-51ba3287-9351-40cf-b55d-dd1ae490f3ab service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:30.997617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8b53666f-bb91-4099-81e8-735ff734966a req-51ba3287-9351-40cf-b55d-dd1ae490f3ab service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:31.023192 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-1ae81cef-ae94-4377-8a7a-effdd15143e7 req-96ccc8a9-f506-407b-b9ec-6675662e5165 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146385 Sep 07 12:42:31.025180 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8b53666f-bb91-4099-81e8-735ff734966a req-51ba3287-9351-40cf-b55d-dd1ae490f3ab service nova] Creating event network-changed:1a21d3dc-ddf4-4a1a-97b1-157da447d776 for instance 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca on n-h2-852087-9 Sep 07 12:42:31.026568 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1330/2632] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:31.039204 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8b53666f-bb91-4099-81e8-735ff734966a req-51ba3287-9351-40cf-b55d-dd1ae490f3ab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096826 Sep 07 12:42:31.040630 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1303/2633] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:31.045100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-738ed6f6-326f-4043-a835-225347cd7441 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:31.047054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-738ed6f6-326f-4043-a835-225347cd7441 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:31.059103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cc20fa06-a19c-4cfc-86b5-c0bc9c146444 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:31.065034 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cc20fa06-a19c-4cfc-86b5-c0bc9c146444 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:31.072458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cc20fa06-a19c-4cfc-86b5-c0bc9c146444 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Searching by: {'deleted': False, 'project_id': '3479aa98e81346039d54eec7a7fb2304'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:42:31.072684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-738ed6f6-326f-4043-a835-225347cd7441 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:31.073541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-738ed6f6-326f-4043-a835-225347cd7441 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:31.074438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-738ed6f6-326f-4043-a835-225347cd7441 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:31.075894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-738ed6f6-326f-4043-a835-225347cd7441 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:31.076971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-738ed6f6-326f-4043-a835-225347cd7441 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:31.078232 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-738ed6f6-326f-4043-a835-225347cd7441 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:31.110977 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc20fa06-a19c-4cfc-86b5-c0bc9c146444 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:31.115007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc20fa06-a19c-4cfc-86b5-c0bc9c146444 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:31.118075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc20fa06-a19c-4cfc-86b5-c0bc9c146444 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:31.137124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc20fa06-a19c-4cfc-86b5-c0bc9c146444 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:31.139634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc20fa06-a19c-4cfc-86b5-c0bc9c146444 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:31.144800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc20fa06-a19c-4cfc-86b5-c0bc9c146444 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:31.222716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-cc20fa06-a19c-4cfc-86b5-c0bc9c146444 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:42:31.361508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-738ed6f6-326f-4043-a835-225347cd7441 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:31.379210 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-738ed6f6-326f-4043-a835-225347cd7441 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1218 microversion: 2.1 time: 0.348909 Sep 07 12:42:31.380137 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1331/2634] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:31 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1218 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:31.385418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-07a80c9e-c8d1-4269-8d29-07f21d311519 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:31.386055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-07a80c9e-c8d1-4269-8d29-07f21d311519 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:31.396250 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cc20fa06-a19c-4cfc-86b5-c0bc9c146444 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.353938 Sep 07 12:42:31.400419 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1304/2635] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Sep 7 12:42:31 2022] GET /compute/v2.1/servers => generated 1003 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:31.412460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07a80c9e-c8d1-4269-8d29-07f21d311519 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:31.413255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07a80c9e-c8d1-4269-8d29-07f21d311519 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:31.414149 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07a80c9e-c8d1-4269-8d29-07f21d311519 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:31.415105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07a80c9e-c8d1-4269-8d29-07f21d311519 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:31.415740 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07a80c9e-c8d1-4269-8d29-07f21d311519 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:31.416336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07a80c9e-c8d1-4269-8d29-07f21d311519 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:31.422159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2b770859-6807-4b3c-a25e-18ead8de14b4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:31.425439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2b770859-6807-4b3c-a25e-18ead8de14b4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 4bb43114-1042-49c5-b60c-2474dae9f021] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:31.782915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2b770859-6807-4b3c-a25e-18ead8de14b4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:31.800047 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2b770859-6807-4b3c-a25e-18ead8de14b4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021" status: 200 len: 1217 microversion: 2.1 time: 0.390115 Sep 07 12:42:31.802338 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1305/2636] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:31 2022] GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021 => generated 1217 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:42:31.814276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b3fcbbec-9f9f-4a4d-8920-9d7886dbe7af tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:31.822407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b3fcbbec-9f9f-4a4d-8920-9d7886dbe7af tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:31.840542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3fcbbec-9f9f-4a4d-8920-9d7886dbe7af tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:31.841059 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3fcbbec-9f9f-4a4d-8920-9d7886dbe7af tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:31.841525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3fcbbec-9f9f-4a4d-8920-9d7886dbe7af tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:31.842289 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3fcbbec-9f9f-4a4d-8920-9d7886dbe7af tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:31.842760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3fcbbec-9f9f-4a4d-8920-9d7886dbe7af tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:31.843196 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3fcbbec-9f9f-4a4d-8920-9d7886dbe7af tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:32.123689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-07a80c9e-c8d1-4269-8d29-07f21d311519 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:32.135250 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-07a80c9e-c8d1-4269-8d29-07f21d311519 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca" status: 200 len: 1317 microversion: 2.1 time: 0.753896 Sep 07 12:42:32.145256 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1332/2637] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:31 2022] GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca => generated 1317 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:32.157522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bf0952da-3835-4a48-86f1-08ac40d76c1f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:32.157522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bf0952da-3835-4a48-86f1-08ac40d76c1f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:32.185105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf0952da-3835-4a48-86f1-08ac40d76c1f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:32.185640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf0952da-3835-4a48-86f1-08ac40d76c1f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:32.186083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf0952da-3835-4a48-86f1-08ac40d76c1f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:32.186809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf0952da-3835-4a48-86f1-08ac40d76c1f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:32.187284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf0952da-3835-4a48-86f1-08ac40d76c1f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:32.187824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf0952da-3835-4a48-86f1-08ac40d76c1f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:32.910220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bf0952da-3835-4a48-86f1-08ac40d76c1f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:32.922235 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bf0952da-3835-4a48-86f1-08ac40d76c1f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1325 microversion: 2.1 time: 0.770584 Sep 07 12:42:32.928795 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1333/2638] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:32 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1325 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:32.936840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4c3063d4-2879-4501-93bc-8ca69bd656b3 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc418558430>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:32.984833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b3fcbbec-9f9f-4a4d-8920-9d7886dbe7af tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:32.997372 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b3fcbbec-9f9f-4a4d-8920-9d7886dbe7af tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45" status: 200 len: 1316 microversion: 2.1 time: 1.193800 Sep 07 12:42:32.998318 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1306/2639] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:31 2022] GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 => generated 1316 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:33.012100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-91b8fecf-717c-4a2b-ad80-48ab6587d666 req-02e2a6ee-ac21-4232-a827-c8e6947a2702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abbf48d7-8190-4dde-8fb6-95d83eccf1b3", "name": "network-vif-unplugged", "status": "completed", "tag": "262fba0b-3e24-4471-8a3a-2854f1151108"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:33.032776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-91b8fecf-717c-4a2b-ad80-48ab6587d666 req-02e2a6ee-ac21-4232-a827-c8e6947a2702 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:33.034991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-91b8fecf-717c-4a2b-ad80-48ab6587d666 req-02e2a6ee-ac21-4232-a827-c8e6947a2702 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:33.046337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-91b8fecf-717c-4a2b-ad80-48ab6587d666 req-02e2a6ee-ac21-4232-a827-c8e6947a2702 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:33.059214 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-91b8fecf-717c-4a2b-ad80-48ab6587d666 req-02e2a6ee-ac21-4232-a827-c8e6947a2702 service nova] Creating event network-vif-unplugged:262fba0b-3e24-4471-8a3a-2854f1151108 for instance abbf48d7-8190-4dde-8fb6-95d83eccf1b3 on n-h2-852087-9 Sep 07 12:42:33.081031 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-91b8fecf-717c-4a2b-ad80-48ab6587d666 req-02e2a6ee-ac21-4232-a827-c8e6947a2702 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078271 Sep 07 12:42:33.082256 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1307/2640] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:33.111891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-61d4fb58-ca5f-4ab8-9f3e-165b568e931c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:33.113074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-61d4fb58-ca5f-4ab8-9f3e-165b568e931c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:33.142874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61d4fb58-ca5f-4ab8-9f3e-165b568e931c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:33.143393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61d4fb58-ca5f-4ab8-9f3e-165b568e931c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:33.143845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61d4fb58-ca5f-4ab8-9f3e-165b568e931c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:33.144582 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61d4fb58-ca5f-4ab8-9f3e-165b568e931c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:33.154605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61d4fb58-ca5f-4ab8-9f3e-165b568e931c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:33.158249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61d4fb58-ca5f-4ab8-9f3e-165b568e931c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:33.196489 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4c3063d4-2879-4501-93bc-8ca69bd656b3 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4" status: 200 len: 1429 microversion: 2.1 time: 0.266140 Sep 07 12:42:33.202769 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1334/2641] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:42:32 2022] GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4 => generated 1429 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:33.208308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-46c6e0a4-0a00-42b7-b300-f22fb1f85b5a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:33.221672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-46c6e0a4-0a00-42b7-b300-f22fb1f85b5a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 4bb43114-1042-49c5-b60c-2474dae9f021] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:33.238088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46c6e0a4-0a00-42b7-b300-f22fb1f85b5a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:33.246546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46c6e0a4-0a00-42b7-b300-f22fb1f85b5a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:33.247183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46c6e0a4-0a00-42b7-b300-f22fb1f85b5a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:33.248289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46c6e0a4-0a00-42b7-b300-f22fb1f85b5a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:33.249073 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46c6e0a4-0a00-42b7-b300-f22fb1f85b5a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:33.253649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46c6e0a4-0a00-42b7-b300-f22fb1f85b5a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:34.089241 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-46c6e0a4-0a00-42b7-b300-f22fb1f85b5a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:34.138046 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-46c6e0a4-0a00-42b7-b300-f22fb1f85b5a tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021" status: 200 len: 1213 microversion: 2.1 time: 0.930666 Sep 07 12:42:34.145251 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1335/2642] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:33 2022] GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021 => generated 1213 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:34.166982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d2bb5307-f748-4e5a-aacd-ae7da0e22ea1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:34.168847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d2bb5307-f748-4e5a-aacd-ae7da0e22ea1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:34.202451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2bb5307-f748-4e5a-aacd-ae7da0e22ea1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:34.204624 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2bb5307-f748-4e5a-aacd-ae7da0e22ea1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:34.206702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2bb5307-f748-4e5a-aacd-ae7da0e22ea1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:34.211602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2bb5307-f748-4e5a-aacd-ae7da0e22ea1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:34.215771 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2bb5307-f748-4e5a-aacd-ae7da0e22ea1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:34.217270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2bb5307-f748-4e5a-aacd-ae7da0e22ea1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:34.565365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-61d4fb58-ca5f-4ab8-9f3e-165b568e931c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:34.598417 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-61d4fb58-ca5f-4ab8-9f3e-165b568e931c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1266 microversion: 2.1 time: 1.505585 Sep 07 12:42:34.599329 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1308/2643] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:33 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1266 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:34.608413 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7977d266-f688-4c0d-9419-c74faba68215 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:34.617629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7977d266-f688-4c0d-9419-c74faba68215 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:34.639600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7977d266-f688-4c0d-9419-c74faba68215 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:34.642604 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7977d266-f688-4c0d-9419-c74faba68215 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:34.645976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7977d266-f688-4c0d-9419-c74faba68215 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:34.650927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7977d266-f688-4c0d-9419-c74faba68215 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:34.653814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7977d266-f688-4c0d-9419-c74faba68215 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:34.656169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7977d266-f688-4c0d-9419-c74faba68215 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:35.652149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7977d266-f688-4c0d-9419-c74faba68215 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:35.671163 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7977d266-f688-4c0d-9419-c74faba68215 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1523 microversion: 2.1 time: 1.068517 Sep 07 12:42:35.674677 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1309/2644] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:34 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1523 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:35.714880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bee2e569-a99f-4e88-b1b3-70729007d287 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:35.719480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bee2e569-a99f-4e88-b1b3-70729007d287 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:35.747702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bee2e569-a99f-4e88-b1b3-70729007d287 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:35.752710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bee2e569-a99f-4e88-b1b3-70729007d287 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:35.754286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bee2e569-a99f-4e88-b1b3-70729007d287 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:35.758100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bee2e569-a99f-4e88-b1b3-70729007d287 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:35.766639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bee2e569-a99f-4e88-b1b3-70729007d287 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:35.768214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bee2e569-a99f-4e88-b1b3-70729007d287 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:35.949952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d2bb5307-f748-4e5a-aacd-ae7da0e22ea1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:35.996035 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d2bb5307-f748-4e5a-aacd-ae7da0e22ea1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca" status: 200 len: 1317 microversion: 2.1 time: 1.833776 Sep 07 12:42:36.004183 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1336/2645] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:34 2022] GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca => generated 1317 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:36.018059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-678412c8-019b-46d8-a8f0-377c569b2b16 req-3e452b95-b764-4837-b619-a77513fe6825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2360d1da-9d70-4484-be65-d3cc510b9071", "name": "network-vif-deleted", "tag": "4aa46be9-0029-4660-9d0d-2f5b8ec0dbe6"}, {"server_uuid": "abbf48d7-8190-4dde-8fb6-95d83eccf1b3", "name": "network-vif-deleted", "tag": "262fba0b-3e24-4471-8a3a-2854f1151108"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:36.072960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-678412c8-019b-46d8-a8f0-377c569b2b16 req-3e452b95-b764-4837-b619-a77513fe6825 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:36.073834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-678412c8-019b-46d8-a8f0-377c569b2b16 req-3e452b95-b764-4837-b619-a77513fe6825 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:36.074817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-678412c8-019b-46d8-a8f0-377c569b2b16 req-3e452b95-b764-4837-b619-a77513fe6825 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:36.139610 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-678412c8-019b-46d8-a8f0-377c569b2b16 req-3e452b95-b764-4837-b619-a77513fe6825 service nova] Creating event network-vif-deleted:4aa46be9-0029-4660-9d0d-2f5b8ec0dbe6 for instance 2360d1da-9d70-4484-be65-d3cc510b9071 on n-h1-852087-9 Sep 07 12:42:36.148346 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-678412c8-019b-46d8-a8f0-377c569b2b16 req-3e452b95-b764-4837-b619-a77513fe6825 service nova] Creating event network-vif-deleted:262fba0b-3e24-4471-8a3a-2854f1151108 for instance abbf48d7-8190-4dde-8fb6-95d83eccf1b3 on n-h2-852087-9 Sep 07 12:42:36.195906 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-678412c8-019b-46d8-a8f0-377c569b2b16 req-3e452b95-b764-4837-b619-a77513fe6825 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.189101 Sep 07 12:42:36.208883 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1337/2646] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:36.227074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-51c24810-ff3a-489a-9507-2a30d3f235d4 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc4184058b0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:36.412718 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-51c24810-ff3a-489a-9507-2a30d3f235d4 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4" status: 200 len: 1429 microversion: 2.1 time: 0.198778 Sep 07 12:42:36.417233 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1338/2647] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:42:36 2022] GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4 => generated 1429 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:36.444584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-86a4555d-9cb8-4c95-9807-1b755dc0dde3 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:36.445779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-86a4555d-9cb8-4c95-9807-1b755dc0dde3 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 4bb43114-1042-49c5-b60c-2474dae9f021] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:36.467220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86a4555d-9cb8-4c95-9807-1b755dc0dde3 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:36.468393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86a4555d-9cb8-4c95-9807-1b755dc0dde3 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:36.469334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86a4555d-9cb8-4c95-9807-1b755dc0dde3 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:36.471338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86a4555d-9cb8-4c95-9807-1b755dc0dde3 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:36.475129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86a4555d-9cb8-4c95-9807-1b755dc0dde3 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:36.481508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86a4555d-9cb8-4c95-9807-1b755dc0dde3 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:36.799984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-86a4555d-9cb8-4c95-9807-1b755dc0dde3 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:36.816177 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-86a4555d-9cb8-4c95-9807-1b755dc0dde3 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021" status: 200 len: 1269 microversion: 2.1 time: 0.392365 Sep 07 12:42:36.820567 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1339/2648] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:36 2022] GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021 => generated 1269 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:36.842700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5da7b914-a2e1-4fe3-be99-c6bdcc0ed114 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:36.843738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5da7b914-a2e1-4fe3-be99-c6bdcc0ed114 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:36.871522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5da7b914-a2e1-4fe3-be99-c6bdcc0ed114 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:36.878717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5da7b914-a2e1-4fe3-be99-c6bdcc0ed114 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:36.880874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5da7b914-a2e1-4fe3-be99-c6bdcc0ed114 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:36.883613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5da7b914-a2e1-4fe3-be99-c6bdcc0ed114 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:36.889940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5da7b914-a2e1-4fe3-be99-c6bdcc0ed114 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:36.890721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5da7b914-a2e1-4fe3-be99-c6bdcc0ed114 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:37.155534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5da7b914-a2e1-4fe3-be99-c6bdcc0ed114 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:37.170363 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5da7b914-a2e1-4fe3-be99-c6bdcc0ed114 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1272 microversion: 2.1 time: 0.339469 Sep 07 12:42:37.189433 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1340/2649] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:36 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1272 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:37.208929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-38a67fa2-232f-497f-926f-97bc14413851 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:37.211538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-38a67fa2-232f-497f-926f-97bc14413851 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:37.229836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bee2e569-a99f-4e88-b1b3-70729007d287 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:37.242029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38a67fa2-232f-497f-926f-97bc14413851 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:37.244907 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bee2e569-a99f-4e88-b1b3-70729007d287 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45" status: 200 len: 1316 microversion: 2.1 time: 1.552924 Sep 07 12:42:37.245825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38a67fa2-232f-497f-926f-97bc14413851 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:37.246480 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38a67fa2-232f-497f-926f-97bc14413851 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:37.261942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38a67fa2-232f-497f-926f-97bc14413851 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:37.261942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38a67fa2-232f-497f-926f-97bc14413851 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:37.261942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38a67fa2-232f-497f-926f-97bc14413851 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:37.262424 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1310/2650] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:35 2022] GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 => generated 1316 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:37.277718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b92ef452-fd8f-4074-a934-3993994286e3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:37.277718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b92ef452-fd8f-4074-a934-3993994286e3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:37.306591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b92ef452-fd8f-4074-a934-3993994286e3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:37.312795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b92ef452-fd8f-4074-a934-3993994286e3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:37.316010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b92ef452-fd8f-4074-a934-3993994286e3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:37.325635 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b92ef452-fd8f-4074-a934-3993994286e3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:37.326971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b92ef452-fd8f-4074-a934-3993994286e3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:37.330575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b92ef452-fd8f-4074-a934-3993994286e3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:38.023258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-38a67fa2-232f-497f-926f-97bc14413851 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:38.083920 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-38a67fa2-232f-497f-926f-97bc14413851 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1523 microversion: 2.1 time: 0.887991 Sep 07 12:42:38.091650 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1341/2651] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:37 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1523 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:38.099947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b92ef452-fd8f-4074-a934-3993994286e3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:38.125018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-78ea794b-1c0c-4007-b87d-d5b474f43fdd tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc41d1de8b0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:38.143341 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b92ef452-fd8f-4074-a934-3993994286e3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca" status: 200 len: 1317 microversion: 2.1 time: 0.888992 Sep 07 12:42:38.146953 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1311/2652] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:37 2022] GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca => generated 1317 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:38.174390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8514340d-a5be-42d3-8cd4-93e5684b6ada tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:38.175467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8514340d-a5be-42d3-8cd4-93e5684b6ada tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 4bb43114-1042-49c5-b60c-2474dae9f021] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:38.192545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8514340d-a5be-42d3-8cd4-93e5684b6ada tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:38.193035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8514340d-a5be-42d3-8cd4-93e5684b6ada tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:38.193651 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8514340d-a5be-42d3-8cd4-93e5684b6ada tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:38.195012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8514340d-a5be-42d3-8cd4-93e5684b6ada tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:38.195967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8514340d-a5be-42d3-8cd4-93e5684b6ada tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:38.196696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8514340d-a5be-42d3-8cd4-93e5684b6ada tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:38.310063 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-78ea794b-1c0c-4007-b87d-d5b474f43fdd tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4" status: 200 len: 1429 microversion: 2.1 time: 0.212891 Sep 07 12:42:38.334953 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1342/2653] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:42:38 2022] GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4 => generated 1429 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:38.386168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-78a76ba2-0c05-4ab8-90f1-b4cddef1f53a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-265318200", "metadata": {"": ""}}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:38.402538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-78a76ba2-0c05-4ab8-90f1-b4cddef1f53a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Request method failure captured: Sep 07 12:42:38.402538 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8/action HTTP/1.1 Sep 07 12:42:38.402538 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:42:38.402538 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:42:38.402538 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:42:38.402538 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 106 Sep 07 12:42:38.402538 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:42:38.402538 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:42:38.402538 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:42:38.402538 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:42:38.402538 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJGQYbyJLIsXxXjgkDYN7LwAZ3FIxjt-YGkXt1Xo1a1MUwTVDulf3qar21KhPKqmmgY5XowXVa7QiIPma2KSUUJYmnQLgFXdiW6Ghu6fpYXXYUWnHmYT3Op2c2gidR2lsMRLQPmqnvHgSb4f0Vzgm_QdSzSUbn3j0rcW4vT7twxuCxo Sep 07 12:42:38.402538 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:42:38.402538 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:42:38.402538 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:42:38.402538 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:42:38.402538 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:42:38.402538 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:42:38.402538 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:42:38.402538 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:42:38.402538 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:42:38.402538 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:42:38.404144 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:42:38.404144 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:42:38.404144 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:42:38.404144 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:42:38.404144 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:42:38.404144 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:42:38.404144 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:42:38.404144 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: ac0d1c1e891c470c99e7c968b908a054 Sep 07 12:42:38.404144 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:42:38.404144 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:42:38.404144 n-d-852087-9 devstack@n-api.service[122432]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-265318200", "metadata": {"": ""}}} Sep 07 12:42:38.404144 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:42:38.405046 n-d-852087-9 devstack@n-api.service[122432]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:42:38.405046 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '663da890-aea0-44c3-842f-71ee8abfaac8', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-265318200', 'metadata': {'': ''}}}} Sep 07 12:42:38.405046 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:42:38.405046 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:38.405046 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:42:38.405046 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:42:38.405046 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:42:38.405046 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:42:38.405046 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:42:38.405046 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:38.405046 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 07 12:42:38.405046 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 07 12:42:38.405046 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 07 12:42:38.405046 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 07 12:42:38.405046 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 07 12:42:38.405046 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:38.405046 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 07 12:42:38.405046 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'': ''} Sep 07 12:42:38.405046 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:38.405046 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:38.405046 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:38.406484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:38.406484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:42:38.406484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:42:38.406484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:42:38.406484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:42:38.406484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:42:38.406484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:42:38.406484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:42:38.406484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:42:38.406484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:42:38.406484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:42:38.406484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:42:38.406484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:42:38.406484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:42:38.406484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:42:38.406484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:42:38.406484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:38.406484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:38.406484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:38.406484 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:38.407814 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:42:38.407814 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:42:38.407814 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:42:38.407814 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:42:38.407814 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:42:38.407814 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:38.407814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-78a76ba2-0c05-4ab8-90f1-b4cddef1f53a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:42:38.407814 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-78a76ba2-0c05-4ab8-90f1-b4cddef1f53a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "POST /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8/action" status: 400 len: 170 microversion: 2.1 time: 0.069479 Sep 07 12:42:38.409450 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1343/2654] 10.222.0.16 () {60 vars in 1279 bytes} [Wed Sep 7 12:42:38 2022] POST /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8/action => generated 170 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:42:38.419714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5af7712e-95ae-4794-9496-7c559a8a9579 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:38.426073 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5af7712e-95ae-4794-9496-7c559a8a9579 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:38.438876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8514340d-a5be-42d3-8cd4-93e5684b6ada tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:38.455795 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8514340d-a5be-42d3-8cd4-93e5684b6ada tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021" status: 200 len: 1275 microversion: 2.1 time: 0.290313 Sep 07 12:42:38.458238 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1312/2655] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:38 2022] GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021 => generated 1275 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:38.460456 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5af7712e-95ae-4794-9496-7c559a8a9579 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:38.461558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5af7712e-95ae-4794-9496-7c559a8a9579 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:38.462356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5af7712e-95ae-4794-9496-7c559a8a9579 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:38.463682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5af7712e-95ae-4794-9496-7c559a8a9579 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:38.471120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5af7712e-95ae-4794-9496-7c559a8a9579 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:38.472112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5af7712e-95ae-4794-9496-7c559a8a9579 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:38.473798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ff28dd1-c347-452c-8c89-41bc20b830cc tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:38.475264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4ff28dd1-c347-452c-8c89-41bc20b830cc tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:38.492978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ff28dd1-c347-452c-8c89-41bc20b830cc tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:38.494196 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ff28dd1-c347-452c-8c89-41bc20b830cc tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:38.496883 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ff28dd1-c347-452c-8c89-41bc20b830cc tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:38.499029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ff28dd1-c347-452c-8c89-41bc20b830cc tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:38.509270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ff28dd1-c347-452c-8c89-41bc20b830cc tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:38.510120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ff28dd1-c347-452c-8c89-41bc20b830cc tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:38.515626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:RELEASE=1,nova_cell1:SELECT=84,nova_cell1:UPDATE=13,nova_cell1:DELETE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:42:38.727830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5af7712e-95ae-4794-9496-7c559a8a9579 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:38.731176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:42:38.746630 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5af7712e-95ae-4794-9496-7c559a8a9579 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1272 microversion: 2.1 time: 0.335342 Sep 07 12:42:38.751430 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1344/2656] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:38 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1272 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:38.789963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d35e1658-a1c6-42e3-9d83-f5ee0b82c0da tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:38.790788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d35e1658-a1c6-42e3-9d83-f5ee0b82c0da tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:38.811944 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d35e1658-a1c6-42e3-9d83-f5ee0b82c0da tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:38.813028 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d35e1658-a1c6-42e3-9d83-f5ee0b82c0da tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:38.813522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d35e1658-a1c6-42e3-9d83-f5ee0b82c0da tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:38.814306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d35e1658-a1c6-42e3-9d83-f5ee0b82c0da tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:38.814779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d35e1658-a1c6-42e3-9d83-f5ee0b82c0da tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:38.815471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d35e1658-a1c6-42e3-9d83-f5ee0b82c0da tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:39.720661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:42:39.805185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:42:40.102625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4ff28dd1-c347-452c-8c89-41bc20b830cc tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:40.124657 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ff28dd1-c347-452c-8c89-41bc20b830cc tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45" status: 200 len: 1316 microversion: 2.1 time: 1.660891 Sep 07 12:42:40.126154 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1313/2657] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:38 2022] GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 => generated 1316 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:40.138444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5d2669a4-e8c1-44aa-a52d-7a3229986352 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:40.140849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5d2669a4-e8c1-44aa-a52d-7a3229986352 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:40.158491 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d2669a4-e8c1-44aa-a52d-7a3229986352 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:40.160880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d2669a4-e8c1-44aa-a52d-7a3229986352 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:40.163934 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d2669a4-e8c1-44aa-a52d-7a3229986352 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:40.167430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d2669a4-e8c1-44aa-a52d-7a3229986352 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:40.169918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d2669a4-e8c1-44aa-a52d-7a3229986352 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:40.174731 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d2669a4-e8c1-44aa-a52d-7a3229986352 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:40.374875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d35e1658-a1c6-42e3-9d83-f5ee0b82c0da tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:40.426827 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d35e1658-a1c6-42e3-9d83-f5ee0b82c0da tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1523 microversion: 2.1 time: 1.671997 Sep 07 12:42:40.431585 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1345/2658] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:38 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1523 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:40.484977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5e93fb06-beaa-425f-b69c-90e7d44127cf tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc41845ad30>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:40.717728 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5e93fb06-beaa-425f-b69c-90e7d44127cf tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4" status: 200 len: 1438 microversion: 2.1 time: 0.281213 Sep 07 12:42:40.719091 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1346/2659] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:42:40 2022] GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4 => generated 1438 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:40.749397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-770ad6fd-31d1-4a8c-93d9-a60218884280 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:40.750468 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-770ad6fd-31d1-4a8c-93d9-a60218884280 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 4bb43114-1042-49c5-b60c-2474dae9f021] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:40.769134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-770ad6fd-31d1-4a8c-93d9-a60218884280 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:40.769690 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-770ad6fd-31d1-4a8c-93d9-a60218884280 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:40.770156 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-770ad6fd-31d1-4a8c-93d9-a60218884280 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:40.770905 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-770ad6fd-31d1-4a8c-93d9-a60218884280 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:40.771416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-770ad6fd-31d1-4a8c-93d9-a60218884280 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:40.771858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-770ad6fd-31d1-4a8c-93d9-a60218884280 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:40.946910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-770ad6fd-31d1-4a8c-93d9-a60218884280 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:40.981130 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-770ad6fd-31d1-4a8c-93d9-a60218884280 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021" status: 200 len: 1275 microversion: 2.1 time: 0.251238 Sep 07 12:42:40.984471 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1347/2660] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:40 2022] GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021 => generated 1275 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:41.029441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e54e0198-9085-4bbe-9544-7bc1bfaaa06c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:41.030667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e54e0198-9085-4bbe-9544-7bc1bfaaa06c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:41.038775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e54e0198-9085-4bbe-9544-7bc1bfaaa06c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:41.039075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5d2669a4-e8c1-44aa-a52d-7a3229986352 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:41.039794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e54e0198-9085-4bbe-9544-7bc1bfaaa06c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:41.040486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e54e0198-9085-4bbe-9544-7bc1bfaaa06c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:41.042074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e54e0198-9085-4bbe-9544-7bc1bfaaa06c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:41.042074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e54e0198-9085-4bbe-9544-7bc1bfaaa06c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:41.048526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e54e0198-9085-4bbe-9544-7bc1bfaaa06c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:41.083848 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5d2669a4-e8c1-44aa-a52d-7a3229986352 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca" status: 200 len: 1317 microversion: 2.1 time: 0.955621 Sep 07 12:42:41.090970 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1314/2661] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:40 2022] GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca => generated 1317 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:41.126332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e482a7a9-4c57-47af-b38c-b5325d604334 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:41.129121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e482a7a9-4c57-47af-b38c-b5325d604334 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:41.164058 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:42:41.169607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e482a7a9-4c57-47af-b38c-b5325d604334 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:41.174164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e482a7a9-4c57-47af-b38c-b5325d604334 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:41.175501 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e482a7a9-4c57-47af-b38c-b5325d604334 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:41.178369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e482a7a9-4c57-47af-b38c-b5325d604334 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:41.181777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e482a7a9-4c57-47af-b38c-b5325d604334 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:41.185171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e482a7a9-4c57-47af-b38c-b5325d604334 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:41.788117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:42:42.679019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e482a7a9-4c57-47af-b38c-b5325d604334 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:42.721077 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e482a7a9-4c57-47af-b38c-b5325d604334 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1523 microversion: 2.1 time: 1.625308 Sep 07 12:42:42.751785 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1315/2662] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:41 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1523 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:42.772891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e54e0198-9085-4bbe-9544-7bc1bfaaa06c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:42.777376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-dab5c255-11e9-4a36-8867-5027861e6e3a req-600e3e1f-6683-406e-851f-d13d38234435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45", "name": "network-vif-plugged", "status": "completed", "tag": "18cbdf2f-3657-4ad8-b999-fd91c1f28c75"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:42.796798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-dab5c255-11e9-4a36-8867-5027861e6e3a req-600e3e1f-6683-406e-851f-d13d38234435 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:42.797679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-dab5c255-11e9-4a36-8867-5027861e6e3a req-600e3e1f-6683-406e-851f-d13d38234435 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:42.799422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-dab5c255-11e9-4a36-8867-5027861e6e3a req-600e3e1f-6683-406e-851f-d13d38234435 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:42.803087 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e54e0198-9085-4bbe-9544-7bc1bfaaa06c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1314 microversion: 2.1 time: 1.816126 Sep 07 12:42:42.823293 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1348/2663] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:40 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1314 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:42.830765 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-dab5c255-11e9-4a36-8867-5027861e6e3a req-600e3e1f-6683-406e-851f-d13d38234435 service nova] Creating event network-vif-plugged:18cbdf2f-3657-4ad8-b999-fd91c1f28c75 for instance bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 on n-h2-852087-9 Sep 07 12:42:42.847618 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-dab5c255-11e9-4a36-8867-5027861e6e3a req-600e3e1f-6683-406e-851f-d13d38234435 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093098 Sep 07 12:42:42.852211 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1316/2664] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:42.881661 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-21f8737a-9e07-4f34-8a25-84e45d1467c7 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc418470040>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:43.045344 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-21f8737a-9e07-4f34-8a25-84e45d1467c7 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4" status: 200 len: 1438 microversion: 2.1 time: 0.190745 Sep 07 12:42:43.070074 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1317/2665] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:42:42 2022] GET /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4 => generated 1438 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:43.085702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d097b943-63cc-4e1b-92e4-1c06a20d1a0a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:43.094209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d097b943-63cc-4e1b-92e4-1c06a20d1a0a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:43.118241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d097b943-63cc-4e1b-92e4-1c06a20d1a0a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:43.119104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d097b943-63cc-4e1b-92e4-1c06a20d1a0a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:43.119938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d097b943-63cc-4e1b-92e4-1c06a20d1a0a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:43.122242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d097b943-63cc-4e1b-92e4-1c06a20d1a0a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:43.123340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d097b943-63cc-4e1b-92e4-1c06a20d1a0a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:43.124514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d097b943-63cc-4e1b-92e4-1c06a20d1a0a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:43.332325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e00d9718-5c4e-4cac-a93e-706dddae8522 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Action: 'create', calling method: .version_select at 0x7fc41d1f10d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2055228310", "description": "tempest-description-364264420"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:43.761321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d097b943-63cc-4e1b-92e4-1c06a20d1a0a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:43.778830 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d097b943-63cc-4e1b-92e4-1c06a20d1a0a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45" status: 200 len: 1316 microversion: 2.1 time: 0.706423 Sep 07 12:42:43.816046 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1318/2666] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:43 2022] GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 => generated 1316 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:43.825058 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-696f0cb5-6a32-4b66-bb3b-2622b7691dba tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:43.830904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-696f0cb5-6a32-4b66-bb3b-2622b7691dba tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 4bb43114-1042-49c5-b60c-2474dae9f021] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:43.859177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-696f0cb5-6a32-4b66-bb3b-2622b7691dba tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:43.860338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-696f0cb5-6a32-4b66-bb3b-2622b7691dba tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:43.863766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-696f0cb5-6a32-4b66-bb3b-2622b7691dba tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:43.869965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-696f0cb5-6a32-4b66-bb3b-2622b7691dba tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:43.879049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-696f0cb5-6a32-4b66-bb3b-2622b7691dba tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:43.880012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-696f0cb5-6a32-4b66-bb3b-2622b7691dba tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:44.671651 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-696f0cb5-6a32-4b66-bb3b-2622b7691dba tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:44.684723 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-696f0cb5-6a32-4b66-bb3b-2622b7691dba tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021" status: 200 len: 1317 microversion: 2.1 time: 0.866758 Sep 07 12:42:44.701812 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1319/2667] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:43 2022] GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021 => generated 1317 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:44.702555 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e00d9718-5c4e-4cac-a93e-706dddae8522 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.876953 Sep 07 12:42:44.703287 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1349/2668] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Sep 7 12:42:42 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:44.716935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7bc323ee-8023-4134-9b75-afdfd90c3d22 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:44.718220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7bc323ee-8023-4134-9b75-afdfd90c3d22 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:44.720504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-913173f9-f346-4820-b5ba-9e88d48b82c9 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2012371767", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:44.727225 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:42:44.728009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-913173f9-f346-4820-b5ba-9e88d48b82c9 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Request method failure captured: Sep 07 12:42:44.728009 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8/action HTTP/1.1 Sep 07 12:42:44.728009 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:42:44.728009 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:42:44.728009 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:42:44.728009 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 619 Sep 07 12:42:44.728009 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:42:44.728009 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:42:44.728009 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:42:44.728009 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:42:44.728009 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJGQYbyJLIsXxXjgkDYN7LwAZ3FIxjt-YGkXt1Xo1a1MUwTVDulf3qar21KhPKqmmgY5XowXVa7QiIPma2KSUUJYmnQLgFXdiW6Ghu6fpYXXYUWnHmYT3Op2c2gidR2lsMRLQPmqnvHgSb4f0Vzgm_QdSzSUbn3j0rcW4vT7twxuCxo Sep 07 12:42:44.728009 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:42:44.728009 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:42:44.728009 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:42:44.728009 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:42:44.728009 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:42:44.728009 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:42:44.728009 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:42:44.728009 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:42:44.728009 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:42:44.728009 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:42:44.729546 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:42:44.729546 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:42:44.729546 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:42:44.729546 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:42:44.729546 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:42:44.729546 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:42:44.729546 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:42:44.729546 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: ac0d1c1e891c470c99e7c968b908a054 Sep 07 12:42:44.729546 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:42:44.729546 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:42:44.730679 n-d-852087-9 devstack@n-api.service[122432]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2012371767", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Sep 07 12:42:44.730679 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:42:44.730679 n-d-852087-9 devstack@n-api.service[122432]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:42:44.730915 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '663da890-aea0-44c3-842f-71ee8abfaac8', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2012371767', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Sep 07 12:42:44.730915 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:42:44.730915 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:44.730915 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:42:44.730915 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:42:44.730915 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:42:44.730915 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:42:44.730915 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:42:44.730915 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:44.730915 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 07 12:42:44.730915 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 07 12:42:44.731722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 07 12:42:44.731722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 07 12:42:44.731722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 07 12:42:44.731722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:44.731722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 07 12:42:44.731722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Sep 07 12:42:44.731722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:44.731722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:44.731722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:44.731722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:44.731722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:42:44.731722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:42:44.731722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:42:44.731722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:42:44.731722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:42:44.731722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:42:44.731722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:42:44.732893 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:42:44.732893 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:42:44.732893 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:42:44.732893 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:42:44.732893 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:42:44.732893 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:42:44.732893 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:42:44.732893 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:42:44.732893 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:44.732893 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:44.732893 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:44.732893 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:44.733723 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:42:44.733723 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:42:44.733723 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:42:44.733723 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:42:44.733723 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:42:44.733723 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:44.734165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bc323ee-8023-4134-9b75-afdfd90c3d22 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:44.734165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bc323ee-8023-4134-9b75-afdfd90c3d22 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:44.734165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bc323ee-8023-4134-9b75-afdfd90c3d22 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:44.734165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bc323ee-8023-4134-9b75-afdfd90c3d22 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:44.734523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bc323ee-8023-4134-9b75-afdfd90c3d22 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:44.734523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7bc323ee-8023-4134-9b75-afdfd90c3d22 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:44.736564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-913173f9-f346-4820-b5ba-9e88d48b82c9 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:42:44.738683 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-913173f9-f346-4820-b5ba-9e88d48b82c9 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "POST /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8/action" status: 400 len: 938 microversion: 2.1 time: 0.025407 Sep 07 12:42:44.740028 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1350/2669] 10.222.0.16 () {60 vars in 1279 bytes} [Wed Sep 7 12:42:44 2022] POST /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8/action => generated 938 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:42:44.745870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d7e6968-a149-4cc7-8f38-cd1abcef7b5c tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:44.746994 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1d7e6968-a149-4cc7-8f38-cd1abcef7b5c tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:44.758609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d7e6968-a149-4cc7-8f38-cd1abcef7b5c tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:44.759378 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d7e6968-a149-4cc7-8f38-cd1abcef7b5c tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:44.760023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d7e6968-a149-4cc7-8f38-cd1abcef7b5c tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:44.762224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d7e6968-a149-4cc7-8f38-cd1abcef7b5c tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:44.762953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d7e6968-a149-4cc7-8f38-cd1abcef7b5c tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:44.763537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d7e6968-a149-4cc7-8f38-cd1abcef7b5c tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:45.224893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7bc323ee-8023-4134-9b75-afdfd90c3d22 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:45.233531 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7bc323ee-8023-4134-9b75-afdfd90c3d22 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca" status: 200 len: 1317 microversion: 2.1 time: 0.527799 Sep 07 12:42:45.234947 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1320/2670] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:44 2022] GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca => generated 1317 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:45.240729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0fb0ff94-d45c-4cdc-b903-5e9bffede870 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:45.241668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0fb0ff94-d45c-4cdc-b903-5e9bffede870 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:45.250192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fb0ff94-d45c-4cdc-b903-5e9bffede870 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:45.250970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fb0ff94-d45c-4cdc-b903-5e9bffede870 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:45.251421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fb0ff94-d45c-4cdc-b903-5e9bffede870 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:45.252166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fb0ff94-d45c-4cdc-b903-5e9bffede870 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:45.252633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fb0ff94-d45c-4cdc-b903-5e9bffede870 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:45.253135 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fb0ff94-d45c-4cdc-b903-5e9bffede870 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:45.490982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1d7e6968-a149-4cc7-8f38-cd1abcef7b5c tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f493fa6856847b4ae7cc8eb997a14c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b06047717c4a5ca47ebc72587256fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:45.507473 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1d7e6968-a149-4cc7-8f38-cd1abcef7b5c tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce" status: 200 len: 1466 microversion: 2.1 time: 0.765622 Sep 07 12:42:45.508937 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1351/2671] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:44 2022] GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce => generated 1466 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:45.518374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-aa8d4cfd-4a1b-49b1-9f1a-828f2f232dc8 req-2d38e7c7-d05c-4225-838f-dc44e299ca6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0850dcd6-d5e3-4cea-bcdf-0105880bbc08", "tag": "0245a691-5a7a-4312-af03-6815cec9da19"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:45.543622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-aa8d4cfd-4a1b-49b1-9f1a-828f2f232dc8 req-2d38e7c7-d05c-4225-838f-dc44e299ca6a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:45.545080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-aa8d4cfd-4a1b-49b1-9f1a-828f2f232dc8 req-2d38e7c7-d05c-4225-838f-dc44e299ca6a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:45.546676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-aa8d4cfd-4a1b-49b1-9f1a-828f2f232dc8 req-2d38e7c7-d05c-4225-838f-dc44e299ca6a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:45.575711 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-aa8d4cfd-4a1b-49b1-9f1a-828f2f232dc8 req-2d38e7c7-d05c-4225-838f-dc44e299ca6a service nova] Creating event network-changed:0245a691-5a7a-4312-af03-6815cec9da19 for instance 0850dcd6-d5e3-4cea-bcdf-0105880bbc08 on n-h1-852087-9 Sep 07 12:42:45.586937 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-aa8d4cfd-4a1b-49b1-9f1a-828f2f232dc8 req-2d38e7c7-d05c-4225-838f-dc44e299ca6a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075232 Sep 07 12:42:45.589251 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1352/2672] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:45.633668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a63bc33a-a4f0-4598-9154-de11ea09ff4b tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Action: 'create', calling method: .version_select at 0x7fc4196019d0>, body: {"security_group_rule": {"parent_group_id": "ff6e09b6-7080-4404-ae65-428b4e46c21e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:46.007768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0fb0ff94-d45c-4cdc-b903-5e9bffede870 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:46.034680 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0fb0ff94-d45c-4cdc-b903-5e9bffede870 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1314 microversion: 2.1 time: 0.797755 Sep 07 12:42:46.046960 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1321/2673] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:45 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1314 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:46.056239 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-515db475-f95b-422b-9570-795f892e431e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:46.064331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-515db475-f95b-422b-9570-795f892e431e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:46.089059 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-515db475-f95b-422b-9570-795f892e431e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:46.090328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-515db475-f95b-422b-9570-795f892e431e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:46.090932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-515db475-f95b-422b-9570-795f892e431e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:46.091972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-515db475-f95b-422b-9570-795f892e431e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:46.092672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-515db475-f95b-422b-9570-795f892e431e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:46.093286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-515db475-f95b-422b-9570-795f892e431e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:46.263000 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a63bc33a-a4f0-4598-9154-de11ea09ff4b tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.669586 Sep 07 12:42:46.264754 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1353/2674] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Sep 7 12:42:45 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:46.314564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-931da4c7-3636-4b26-ac4a-72b815bc0f97 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:46.316647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-931da4c7-3636-4b26-ac4a-72b815bc0f97 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:46.333953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-931da4c7-3636-4b26-ac4a-72b815bc0f97 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:46.335634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-931da4c7-3636-4b26-ac4a-72b815bc0f97 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:46.336574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-931da4c7-3636-4b26-ac4a-72b815bc0f97 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:46.338444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-931da4c7-3636-4b26-ac4a-72b815bc0f97 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:46.339691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-931da4c7-3636-4b26-ac4a-72b815bc0f97 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:46.341094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-931da4c7-3636-4b26-ac4a-72b815bc0f97 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:46.433261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-515db475-f95b-422b-9570-795f892e431e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:46.464365 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-515db475-f95b-422b-9570-795f892e431e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1523 microversion: 2.1 time: 0.415014 Sep 07 12:42:46.482087 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1322/2675] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:46 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1523 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:46.512742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-5b7a0144-f148-462c-9392-d056d72dd038 req-bb6a69c6-4bb5-4f72-9c46-fbd8e4dd5b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca", "name": "network-vif-plugged", "status": "completed", "tag": "1a21d3dc-ddf4-4a1a-97b1-157da447d776"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:46.532762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5b7a0144-f148-462c-9392-d056d72dd038 req-bb6a69c6-4bb5-4f72-9c46-fbd8e4dd5b79 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:46.534224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5b7a0144-f148-462c-9392-d056d72dd038 req-bb6a69c6-4bb5-4f72-9c46-fbd8e4dd5b79 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:46.535381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5b7a0144-f148-462c-9392-d056d72dd038 req-bb6a69c6-4bb5-4f72-9c46-fbd8e4dd5b79 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:46.551523 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-5b7a0144-f148-462c-9392-d056d72dd038 req-bb6a69c6-4bb5-4f72-9c46-fbd8e4dd5b79 service nova] Creating event network-vif-plugged:1a21d3dc-ddf4-4a1a-97b1-157da447d776 for instance 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca on n-h2-852087-9 Sep 07 12:42:46.562034 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-5b7a0144-f148-462c-9392-d056d72dd038 req-bb6a69c6-4bb5-4f72-9c46-fbd8e4dd5b79 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077354 Sep 07 12:42:46.566681 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1323/2676] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:46.586551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c804702-547c-4bfd-b568-814c90a0e9d2 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc4183e7a60>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:46.691654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-931da4c7-3636-4b26-ac4a-72b815bc0f97 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:46.712252 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-931da4c7-3636-4b26-ac4a-72b815bc0f97 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45" status: 200 len: 1503 microversion: 2.1 time: 0.431643 Sep 07 12:42:46.719366 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1354/2677] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:46 2022] GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 => generated 1503 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:46.724413 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fa8767eb-fcd9-4511-a7a5-0bb6b7c9f251 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:46.725048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fa8767eb-fcd9-4511-a7a5-0bb6b7c9f251 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 4bb43114-1042-49c5-b60c-2474dae9f021] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:46.732682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa8767eb-fcd9-4511-a7a5-0bb6b7c9f251 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:46.733184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa8767eb-fcd9-4511-a7a5-0bb6b7c9f251 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:46.733712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa8767eb-fcd9-4511-a7a5-0bb6b7c9f251 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:46.734444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa8767eb-fcd9-4511-a7a5-0bb6b7c9f251 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:46.734909 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa8767eb-fcd9-4511-a7a5-0bb6b7c9f251 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:46.735340 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa8767eb-fcd9-4511-a7a5-0bb6b7c9f251 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:46.984223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fa8767eb-fcd9-4511-a7a5-0bb6b7c9f251 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:46.994371 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fa8767eb-fcd9-4511-a7a5-0bb6b7c9f251 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021" status: 200 len: 1317 microversion: 2.1 time: 0.273834 Sep 07 12:42:46.999216 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1355/2678] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:46 2022] GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021 => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:47.095363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-93d5858d-ffaf-436f-b67c-1f47616bb54e tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Action: 'create', calling method: .version_select at 0x7fc4192e5dc0>, body: {"keypair": {"name": "tempest-keypair-888921737", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMsrJiuw8rMYuAmxeugmf1pTgQydBdnI0fHKAcY95DZcLiVmOOiBaeyOdVIdfbQpYEGkYpWzDdMqA2Cdihpy1yMUwrGFLelSz/Mibdan3UmsQWbDpK1heDux9xBWCDILQ=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:47.120002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-93d5858d-ffaf-436f-b67c-1f47616bb54e tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Getting quotas for project e12bd04061ca4c3795958b51739bbbdd. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:42:47.129097 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-93d5858d-ffaf-436f-b67c-1f47616bb54e tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Getting quotas for user 51065729f69f4bfb8ab48d2c70d0ed55 and project e12bd04061ca4c3795958b51739bbbdd. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:42:47.182106 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-93d5858d-ffaf-436f-b67c-1f47616bb54e tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.180178 Sep 07 12:42:47.184132 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1356/2679] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 12:42:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:47.195219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-82518bec-fcee-4c8c-aa21-c227f8b7414a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:47.197030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-82518bec-fcee-4c8c-aa21-c227f8b7414a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:47.212054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82518bec-fcee-4c8c-aa21-c227f8b7414a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:47.213451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82518bec-fcee-4c8c-aa21-c227f8b7414a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:47.214573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82518bec-fcee-4c8c-aa21-c227f8b7414a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:47.216147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82518bec-fcee-4c8c-aa21-c227f8b7414a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:47.217460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82518bec-fcee-4c8c-aa21-c227f8b7414a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:47.218992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82518bec-fcee-4c8c-aa21-c227f8b7414a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:47.497507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-82518bec-fcee-4c8c-aa21-c227f8b7414a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:47.506491 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-82518bec-fcee-4c8c-aa21-c227f8b7414a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca" status: 200 len: 1317 microversion: 2.1 time: 0.320314 Sep 07 12:42:47.507092 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1357/2680] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:47 2022] GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:47.512394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-840cf23f-d87f-4f23-a393-9da1b7ab1de2 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Action: 'create', calling method: .version_select at 0x7fc4184260d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1595794637", "description": "tempest-description-419029178"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:47.762789 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2c804702-547c-4bfd-b568-814c90a0e9d2 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "DELETE /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4" status: 204 len: 0 microversion: 2.1 time: 1.194344 Sep 07 12:42:47.766967 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1324/2681] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:46 2022] DELETE /compute/v2.1/images/677ab386-53c3-4098-b539-708adaf323e4 => generated 0 bytes in 1196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:42:47.772288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-e33b84c2-1621-4ab9-b9af-21267f753a3e req-b17ee0b2-1af4-404d-8030-8b353069014b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b847cba9-b245-4b45-b0bd-897d59ba9a67", "tag": "21e4d80d-0a18-4cd6-898c-dfdd13455bca"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:47.785709 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e33b84c2-1621-4ab9-b9af-21267f753a3e req-b17ee0b2-1af4-404d-8030-8b353069014b service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:47.786357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e33b84c2-1621-4ab9-b9af-21267f753a3e req-b17ee0b2-1af4-404d-8030-8b353069014b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:47.786729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e33b84c2-1621-4ab9-b9af-21267f753a3e req-b17ee0b2-1af4-404d-8030-8b353069014b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:47.800868 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-e33b84c2-1621-4ab9-b9af-21267f753a3e req-b17ee0b2-1af4-404d-8030-8b353069014b service nova] Creating event network-changed:21e4d80d-0a18-4cd6-898c-dfdd13455bca for instance b847cba9-b245-4b45-b0bd-897d59ba9a67 on n-h1-852087-9 Sep 07 12:42:47.808477 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-e33b84c2-1621-4ab9-b9af-21267f753a3e req-b17ee0b2-1af4-404d-8030-8b353069014b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039341 Sep 07 12:42:47.809828 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1325/2682] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:47.820431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4e830833-bc91-4cf5-878a-28b3ac84491c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:47.822297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4e830833-bc91-4cf5-878a-28b3ac84491c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:47.839366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e830833-bc91-4cf5-878a-28b3ac84491c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:47.841614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e830833-bc91-4cf5-878a-28b3ac84491c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:47.843278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e830833-bc91-4cf5-878a-28b3ac84491c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:47.843517 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-840cf23f-d87f-4f23-a393-9da1b7ab1de2 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.334727 Sep 07 12:42:47.846139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e830833-bc91-4cf5-878a-28b3ac84491c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:47.846705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e830833-bc91-4cf5-878a-28b3ac84491c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:47.847476 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1358/2683] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Sep 7 12:42:47 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:47.848734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e830833-bc91-4cf5-878a-28b3ac84491c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:47.859605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5b720d4d-f8da-4a6a-99ad-cc0b1aaea48e tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-801126885"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:47.860651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5b720d4d-f8da-4a6a-99ad-cc0b1aaea48e tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:47.871415 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b720d4d-f8da-4a6a-99ad-cc0b1aaea48e tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:47.872279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b720d4d-f8da-4a6a-99ad-cc0b1aaea48e tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:47.873017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b720d4d-f8da-4a6a-99ad-cc0b1aaea48e tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:47.874747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b720d4d-f8da-4a6a-99ad-cc0b1aaea48e tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:47.876308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b720d4d-f8da-4a6a-99ad-cc0b1aaea48e tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:47.877654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b720d4d-f8da-4a6a-99ad-cc0b1aaea48e tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:48.234314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4e830833-bc91-4cf5-878a-28b3ac84491c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:48.250871 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4e830833-bc91-4cf5-878a-28b3ac84491c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1523 microversion: 2.1 time: 0.437076 Sep 07 12:42:48.251533 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1326/2684] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:47 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1523 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:48.263923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d92a5a35-7c44-48b9-90f8-9992e9fa31d8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:48.267507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d92a5a35-7c44-48b9-90f8-9992e9fa31d8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:48.277155 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.network.security_group_api [None req-5b720d4d-f8da-4a6a-99ad-cc0b1aaea48e tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Adding security group 50f70075-b246-49aa-b148-935adca32a43 to port 18cbdf2f-3657-4ad8-b999-fd91c1f28c75 Sep 07 12:42:48.290274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d92a5a35-7c44-48b9-90f8-9992e9fa31d8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:48.291044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d92a5a35-7c44-48b9-90f8-9992e9fa31d8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:48.292291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d92a5a35-7c44-48b9-90f8-9992e9fa31d8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:48.298238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d92a5a35-7c44-48b9-90f8-9992e9fa31d8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:48.298969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d92a5a35-7c44-48b9-90f8-9992e9fa31d8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:48.299617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d92a5a35-7c44-48b9-90f8-9992e9fa31d8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:49.456691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d92a5a35-7c44-48b9-90f8-9992e9fa31d8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:49.467393 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d92a5a35-7c44-48b9-90f8-9992e9fa31d8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1314 microversion: 2.1 time: 1.211944 Sep 07 12:42:49.483126 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1327/2685] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:48 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1314 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:49.492593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de376f24-ecaf-44bd-8141-dac70e3ce465 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '.version_select at 0x7fc41842b940>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:49.519654 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-de376f24-ecaf-44bd-8141-dac70e3ce465 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] HTTP exception thrown: Image not found. Sep 07 12:42:49.522055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de376f24-ecaf-44bd-8141-dac70e3ce465 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Request method failure captured: Sep 07 12:42:49.522055 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf HTTP/1.1 Sep 07 12:42:49.522055 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:42:49.522055 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:42:49.522055 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:42:49.522055 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:42:49.522055 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:42:49.522055 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:42:49.522055 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:42:49.522055 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:42:49.522055 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJE1WjdtxxnraKMR3DarlN0QR-dibe-LhRzQb-ar-VHuiZ3i14nzPMAcroPGLDquTHY5bLsfAj8iU4LLW2vu5cFfUC4nEdYNbBmeuO7XMgGDD_pM2xwkKA_Rh7q7iryubrPCsQHv6bgbo-DjODTRXaYkSAeb7o1Un3DcfsLeVMe4XG8 Sep 07 12:42:49.522055 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:42:49.522055 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:42:49.522055 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:42:49.522055 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:42:49.522055 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:42:49.522055 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:42:49.522055 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: d9b06047717c4a5ca47ebc72587256fb Sep 07 12:42:49.522055 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesOneServerTestJSON-2023066662 Sep 07 12:42:49.522055 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:42:49.522055 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:42:49.523353 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9b06047717c4a5ca47ebc72587256fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d9b06047717c4a5ca47ebc72587256fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d9b06047717c4a5ca47ebc72587256fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9b06047717c4a5ca47ebc72587256fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:42:49.523353 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesOneServerTestJSON-2023066662 Sep 07 12:42:49.523353 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: d9b06047717c4a5ca47ebc72587256fb Sep 07 12:42:49.523353 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2023066662 Sep 07 12:42:49.523353 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ImagesOneServerTestJSON-2023066662-project Sep 07 12:42:49.523353 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:42:49.523353 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:42:49.523353 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6f493fa6856847b4ae7cc8eb997a14c7 Sep 07 12:42:49.523353 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesOneServerTestJSON-2023066662-project Sep 07 12:42:49.523353 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:42:49.523353 n-d-852087-9 devstack@n-api.service[122433]: exception: Image not found. Sep 07 12:42:49.523353 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'a0c2e836-950b-4524-8408-c375bd0b9baf'} Sep 07 12:42:49.523353 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:42:49.524116 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:49.524116 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 07 12:42:49.524116 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 07 12:42:49.524116 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:42:49.524116 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:42:49.524116 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:42:49.524116 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:42:49.524116 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 07 12:42:49.524116 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 07 12:42:49.524116 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 07 12:42:49.524116 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 07 12:42:49.524116 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:42:49.524116 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:42:49.524116 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:42:49.524116 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:42:49.524116 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a0c2e836-950b-4524-8408-c375bd0b9baf to delete Sep 07 12:42:49.524116 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:49.524116 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:49.524116 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:49.525331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:49.525331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 07 12:42:49.525331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 07 12:42:49.525331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 07 12:42:49.525331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 07 12:42:49.525331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 07 12:42:49.525331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 07 12:42:49.525331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a0c2e836-950b-4524-8408-c375bd0b9baf could not be found. Sep 07 12:42:49.525331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:49.525331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:49.525331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:49.525331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:49.525331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:42:49.525331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:42:49.525331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:42:49.525331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:42:49.525331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:42:49.525331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:42:49.525331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:42:49.525331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:42:49.526861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 07 12:42:49.526861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 12:42:49.526861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 12:42:49.526861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:49.526861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:49.526861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:49.526861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:49.526861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:42:49.526861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:42:49.526861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:42:49.526861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:42:49.526861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 12:42:49.526861 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:49.530769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de376f24-ecaf-44bd-8141-dac70e3ce465 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Returning 404 to user: Image not found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:42:49.532677 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-de376f24-ecaf-44bd-8141-dac70e3ce465 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "DELETE /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf" status: 404 len: 62 microversion: 2.1 time: 0.048042 Sep 07 12:42:49.537765 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1328/2686] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:49 2022] DELETE /compute/v2.1/images/a0c2e836-950b-4524-8408-c375bd0b9baf => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:42:49.548629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ffff5b5e-71f6-467e-b04d-cbafe20c57a4 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Action: 'create', calling method: .version_select at 0x7fc41d2d6e50>, body: {"security_group_rule": {"parent_group_id": "6b489915-0f9b-4f1d-a285-a5a0f812790c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:50.102987 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5b720d4d-f8da-4a6a-99ad-cc0b1aaea48e tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "POST /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45/action" status: 202 len: 0 microversion: 2.1 time: 2.252799 Sep 07 12:42:50.105204 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1359/2687] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:42:47 2022] POST /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45/action => generated 0 bytes in 2257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:42:50.116780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-77220e5b-bfea-4993-b48c-13bffe8af184 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:50.119276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-77220e5b-bfea-4993-b48c-13bffe8af184 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 4bb43114-1042-49c5-b60c-2474dae9f021] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:50.137060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77220e5b-bfea-4993-b48c-13bffe8af184 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:50.139717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77220e5b-bfea-4993-b48c-13bffe8af184 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:50.142233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77220e5b-bfea-4993-b48c-13bffe8af184 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:50.143420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77220e5b-bfea-4993-b48c-13bffe8af184 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:50.146311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77220e5b-bfea-4993-b48c-13bffe8af184 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:50.149414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77220e5b-bfea-4993-b48c-13bffe8af184 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:50.569782 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ffff5b5e-71f6-467e-b04d-cbafe20c57a4 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.030039 Sep 07 12:42:50.570549 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1329/2688] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Sep 7 12:42:49 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:50.575813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9f8f0a3f-0a5e-4907-a2fb-e6f964f7db96 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:50.580251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9f8f0a3f-0a5e-4907-a2fb-e6f964f7db96 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Request method failure captured: Sep 07 12:42:50.580251 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8/action HTTP/1.1 Sep 07 12:42:50.580251 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:42:50.580251 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:42:50.580251 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:42:50.580251 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 285 Sep 07 12:42:50.580251 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:42:50.580251 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:42:50.580251 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:42:50.580251 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:42:50.580251 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJGQYbyJLIsXxXjgkDYN7LwAZ3FIxjt-YGkXt1Xo1a1MUwTVDulf3qar21KhPKqmmgY5XowXVa7QiIPma2KSUUJYmnQLgFXdiW6Ghu6fpYXXYUWnHmYT3Op2c2gidR2lsMRLQPmqnvHgSb4f0Vzgm_QdSzSUbn3j0rcW4vT7twxuCxo Sep 07 12:42:50.580251 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:42:50.580251 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:42:50.580251 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:42:50.580251 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:42:50.580251 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:42:50.580251 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:42:50.580251 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:42:50.580251 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:42:50.580251 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:42:50.580251 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:42:50.583396 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:42:50.583396 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:42:50.583396 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:42:50.583396 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:42:50.583396 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:42:50.583396 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:42:50.583396 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:42:50.583396 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: ac0d1c1e891c470c99e7c968b908a054 Sep 07 12:42:50.583396 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:42:50.583396 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:42:50.583396 n-d-852087-9 devstack@n-api.service[122433]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 07 12:42:50.585704 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:42:50.585704 n-d-852087-9 devstack@n-api.service[122433]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 12:42:50.585704 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '663da890-aea0-44c3-842f-71ee8abfaac8', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 07 12:42:50.585704 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:42:50.585704 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:50.585704 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:42:50.585704 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:42:50.585704 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:42:50.585704 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:42:50.585704 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 12:42:50.588986 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:50.588986 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Sep 07 12:42:50.588986 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 07 12:42:50.588986 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:50.588986 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 07 12:42:50.588986 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 07 12:42:50.588986 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:50.588986 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:50.588986 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:50.588986 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:50.588986 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:42:50.588986 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:42:50.588986 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:42:50.588986 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:42:50.588986 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:42:50.588986 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:42:50.588986 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:42:50.588986 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:42:50.588986 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:42:50.588986 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:42:50.591649 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:42:50.591649 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:42:50.591649 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:42:50.591649 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:42:50.591649 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 12:42:50.591649 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:50.591649 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:50.591649 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:50.591649 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:50.591649 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:42:50.591649 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:42:50.591649 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:42:50.591649 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:42:50.594990 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 12:42:50.594990 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:42:50.594990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9f8f0a3f-0a5e-4907-a2fb-e6f964f7db96 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:42:50.594990 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9f8f0a3f-0a5e-4907-a2fb-e6f964f7db96 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "POST /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8/action" status: 400 len: 619 microversion: 2.1 time: 0.010376 Sep 07 12:42:50.595576 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1330/2689] 10.222.0.16 () {60 vars in 1279 bytes} [Wed Sep 7 12:42:50 2022] POST /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8/action => generated 619 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:42:50.595576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dea1a243-78c5-4e48-adab-b0a4d74675b4 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:50.595576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dea1a243-78c5-4e48-adab-b0a4d74675b4 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:50.598465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-77220e5b-bfea-4993-b48c-13bffe8af184 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:50.615085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dea1a243-78c5-4e48-adab-b0a4d74675b4 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:50.615407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dea1a243-78c5-4e48-adab-b0a4d74675b4 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:50.615603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dea1a243-78c5-4e48-adab-b0a4d74675b4 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:50.616408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dea1a243-78c5-4e48-adab-b0a4d74675b4 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:50.616868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dea1a243-78c5-4e48-adab-b0a4d74675b4 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:50.617314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dea1a243-78c5-4e48-adab-b0a4d74675b4 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:50.628193 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-77220e5b-bfea-4993-b48c-13bffe8af184 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021" status: 200 len: 1317 microversion: 2.1 time: 0.520750 Sep 07 12:42:50.630393 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1360/2690] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:50 2022] GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021 => generated 1317 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:50.642482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-ad361965-7e1b-4720-8c23-149ef777168c req-7a51de01-87ba-4a8f-99cd-07f5c85f3181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "886a386f-a0cc-4d90-96ac-4e418ed43bce", "name": "network-vif-unplugged", "status": "completed", "tag": "a0ca592a-191a-4417-974a-0fdc230ebb1c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:50.668185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ad361965-7e1b-4720-8c23-149ef777168c req-7a51de01-87ba-4a8f-99cd-07f5c85f3181 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:50.671166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ad361965-7e1b-4720-8c23-149ef777168c req-7a51de01-87ba-4a8f-99cd-07f5c85f3181 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:50.672360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ad361965-7e1b-4720-8c23-149ef777168c req-7a51de01-87ba-4a8f-99cd-07f5c85f3181 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:50.701946 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-ad361965-7e1b-4720-8c23-149ef777168c req-7a51de01-87ba-4a8f-99cd-07f5c85f3181 service nova] Creating event network-vif-unplugged:a0ca592a-191a-4417-974a-0fdc230ebb1c for instance 886a386f-a0cc-4d90-96ac-4e418ed43bce on n-h1-852087-9 Sep 07 12:42:50.710184 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-ad361965-7e1b-4720-8c23-149ef777168c req-7a51de01-87ba-4a8f-99cd-07f5c85f3181 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076430 Sep 07 12:42:50.711140 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1361/2691] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:50.717936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ec20ece-13c9-4920-a070-f695b6ac2c8a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:50.718884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5ec20ece-13c9-4920-a070-f695b6ac2c8a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:50.726527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ec20ece-13c9-4920-a070-f695b6ac2c8a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:50.727424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ec20ece-13c9-4920-a070-f695b6ac2c8a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:50.728088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ec20ece-13c9-4920-a070-f695b6ac2c8a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:50.729237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ec20ece-13c9-4920-a070-f695b6ac2c8a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:50.729992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ec20ece-13c9-4920-a070-f695b6ac2c8a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:50.730646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ec20ece-13c9-4920-a070-f695b6ac2c8a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:50.762859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5ec20ece-13c9-4920-a070-f695b6ac2c8a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:42:50.878946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dea1a243-78c5-4e48-adab-b0a4d74675b4 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:50.895758 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5ec20ece-13c9-4920-a070-f695b6ac2c8a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "DELETE /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce" status: 204 len: 0 microversion: 2.1 time: 0.182838 Sep 07 12:42:50.896710 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1362/2692] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:42:50 2022] DELETE /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:42:50.906517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-a1ceabdf-022e-43a9-b5c2-f95c5d5d69ff req-662c9878-bc73-4c40-9e15-32317424f7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bb43114-1042-49c5-b60c-2474dae9f021", "tag": "14322b51-ee31-4407-9e34-e85d7d459730"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:50.918171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a1ceabdf-022e-43a9-b5c2-f95c5d5d69ff req-662c9878-bc73-4c40-9e15-32317424f7e2 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:50.918895 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a1ceabdf-022e-43a9-b5c2-f95c5d5d69ff req-662c9878-bc73-4c40-9e15-32317424f7e2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:50.920001 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a1ceabdf-022e-43a9-b5c2-f95c5d5d69ff req-662c9878-bc73-4c40-9e15-32317424f7e2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:50.923708 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dea1a243-78c5-4e48-adab-b0a4d74675b4 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca" status: 200 len: 1466 microversion: 2.1 time: 0.335963 Sep 07 12:42:50.925135 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1331/2693] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:50 2022] GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca => generated 1466 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:50.931991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e5345121-be7d-4b97-b284-55d1e09fc0c4 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1241458478"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:50.932633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e5345121-be7d-4b97-b284-55d1e09fc0c4 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:50.939613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5345121-be7d-4b97-b284-55d1e09fc0c4 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:50.940227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5345121-be7d-4b97-b284-55d1e09fc0c4 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:50.940757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5345121-be7d-4b97-b284-55d1e09fc0c4 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:50.941794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5345121-be7d-4b97-b284-55d1e09fc0c4 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:50.942566 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5345121-be7d-4b97-b284-55d1e09fc0c4 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:50.943211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5345121-be7d-4b97-b284-55d1e09fc0c4 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:50.967517 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-a1ceabdf-022e-43a9-b5c2-f95c5d5d69ff req-662c9878-bc73-4c40-9e15-32317424f7e2 service nova] Creating event network-changed:14322b51-ee31-4407-9e34-e85d7d459730 for instance 4bb43114-1042-49c5-b60c-2474dae9f021 on n-h1-852087-9 Sep 07 12:42:50.973312 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-a1ceabdf-022e-43a9-b5c2-f95c5d5d69ff req-662c9878-bc73-4c40-9e15-32317424f7e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074049 Sep 07 12:42:50.974599 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1363/2694] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:50.982488 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-534a9e1a-6d44-4510-b195-ac0c6a8f072c req-b24f6ca4-4c34-49d1-a5b7-af054abea8fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45", "tag": "18cbdf2f-3657-4ad8-b999-fd91c1f28c75"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:50.994020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-534a9e1a-6d44-4510-b195-ac0c6a8f072c req-b24f6ca4-4c34-49d1-a5b7-af054abea8fa service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:50.994736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-534a9e1a-6d44-4510-b195-ac0c6a8f072c req-b24f6ca4-4c34-49d1-a5b7-af054abea8fa service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:50.995179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-534a9e1a-6d44-4510-b195-ac0c6a8f072c req-b24f6ca4-4c34-49d1-a5b7-af054abea8fa service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:51.008378 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-534a9e1a-6d44-4510-b195-ac0c6a8f072c req-b24f6ca4-4c34-49d1-a5b7-af054abea8fa service nova] Creating event network-changed:18cbdf2f-3657-4ad8-b999-fd91c1f28c75 for instance bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 on n-h2-852087-9 Sep 07 12:42:51.014197 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-534a9e1a-6d44-4510-b195-ac0c6a8f072c req-b24f6ca4-4c34-49d1-a5b7-af054abea8fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037608 Sep 07 12:42:51.014928 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1364/2695] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:51.021539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-421d5bf5-a93f-461f-aaf2-5d084a929a0f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "bf2691f7-1135-41d7-b628-72332a6e44a8"}], "security_groups": [{"name": "tempest-securitygroup--296217467"}], "key_name": "tempest-keypair-888921737", "user_data": "}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:51.186234 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.network.security_group_api [None req-e5345121-be7d-4b97-b284-55d1e09fc0c4 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Adding security group 9466dab1-056f-4f12-88eb-8c53f033654a to port 18cbdf2f-3657-4ad8-b999-fd91c1f28c75 Sep 07 12:42:51.313548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-421d5bf5-a93f-461f-aaf2-5d084a929a0f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] validate_networks() for [('bf2691f7-1135-41d7-b628-72332a6e44a8', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:42:52.365203 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-421d5bf5-a93f-461f-aaf2-5d084a929a0f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:42:52.367781 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-421d5bf5-a93f-461f-aaf2-5d084a929a0f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:42:52.370358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-421d5bf5-a93f-461f-aaf2-5d084a929a0f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:42:52.371515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-421d5bf5-a93f-461f-aaf2-5d084a929a0f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:42:52.372915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-421d5bf5-a93f-461f-aaf2-5d084a929a0f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:42:52.382638 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e5345121-be7d-4b97-b284-55d1e09fc0c4 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "POST /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45/action" status: 202 len: 0 microversion: 2.1 time: 1.455307 Sep 07 12:42:52.385771 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1332/2696] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:42:50 2022] POST /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45/action => generated 0 bytes in 1460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:42:52.395185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fcbab027-5803-4f85-8d4d-b98ba8384cfe tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:52.396906 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fcbab027-5803-4f85-8d4d-b98ba8384cfe tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:52.402266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-421d5bf5-a93f-461f-aaf2-5d084a929a0f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:52.402773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-421d5bf5-a93f-461f-aaf2-5d084a929a0f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:52.403223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-421d5bf5-a93f-461f-aaf2-5d084a929a0f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:52.403987 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-421d5bf5-a93f-461f-aaf2-5d084a929a0f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:52.404614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-421d5bf5-a93f-461f-aaf2-5d084a929a0f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:52.405066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-421d5bf5-a93f-461f-aaf2-5d084a929a0f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:52.413331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcbab027-5803-4f85-8d4d-b98ba8384cfe tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:52.414811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcbab027-5803-4f85-8d4d-b98ba8384cfe tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:52.415942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcbab027-5803-4f85-8d4d-b98ba8384cfe tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:52.417632 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcbab027-5803-4f85-8d4d-b98ba8384cfe tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:52.418824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcbab027-5803-4f85-8d4d-b98ba8384cfe tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:52.419937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcbab027-5803-4f85-8d4d-b98ba8384cfe tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:52.432812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-421d5bf5-a93f-461f-aaf2-5d084a929a0f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Getting quotas for project e12bd04061ca4c3795958b51739bbbdd. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:42:52.450206 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-421d5bf5-a93f-461f-aaf2-5d084a929a0f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Getting quotas for user 51065729f69f4bfb8ab48d2c70d0ed55 and project e12bd04061ca4c3795958b51739bbbdd. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:42:52.474198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:42:52.493584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-421d5bf5-a93f-461f-aaf2-5d084a929a0f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:42:52.496910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-421d5bf5-a93f-461f-aaf2-5d084a929a0f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] [instance: b017ea78-874a-4e91-933a-716e254275a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:42:52.572535 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-421d5bf5-a93f-461f-aaf2-5d084a929a0f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.556115 Sep 07 12:42:52.573708 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1365/2697] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:42:51 2022] POST /compute/v2.1/servers => generated 408 bytes in 1558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:42:52.580238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a6ca7746-9ee6-44fb-ae90-f2268b67dc0b tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:52.581883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a6ca7746-9ee6-44fb-ae90-f2268b67dc0b tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:52.591147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6ca7746-9ee6-44fb-ae90-f2268b67dc0b tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:52.592037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6ca7746-9ee6-44fb-ae90-f2268b67dc0b tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:52.592717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6ca7746-9ee6-44fb-ae90-f2268b67dc0b tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:52.594027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6ca7746-9ee6-44fb-ae90-f2268b67dc0b tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:52.594784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6ca7746-9ee6-44fb-ae90-f2268b67dc0b tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:52.595663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6ca7746-9ee6-44fb-ae90-f2268b67dc0b tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:52.779671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fcbab027-5803-4f85-8d4d-b98ba8384cfe tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:52.788860 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fcbab027-5803-4f85-8d4d-b98ba8384cfe tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1314 microversion: 2.1 time: 0.400896 Sep 07 12:42:52.789918 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1333/2698] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:52 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:52.795139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-df9eb04d-27f9-45ad-b699-ab3131e92481 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Action: 'create', calling method: .version_select at 0x7fc41850b3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1748820869", "description": "tempest-description-450544211"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:52.878957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a6ca7746-9ee6-44fb-ae90-f2268b67dc0b tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:52.904041 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a6ca7746-9ee6-44fb-ae90-f2268b67dc0b tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1523 microversion: 2.1 time: 0.318985 Sep 07 12:42:52.904868 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1366/2699] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:52 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1523 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:52.930772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-05125d4c-cbd3-4006-b764-5e59638ead0a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:52.931481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-05125d4c-cbd3-4006-b764-5e59638ead0a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:52.939888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05125d4c-cbd3-4006-b764-5e59638ead0a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:52.941847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05125d4c-cbd3-4006-b764-5e59638ead0a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:52.942426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05125d4c-cbd3-4006-b764-5e59638ead0a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:52.943388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05125d4c-cbd3-4006-b764-5e59638ead0a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:52.944125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05125d4c-cbd3-4006-b764-5e59638ead0a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:52.944722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05125d4c-cbd3-4006-b764-5e59638ead0a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:53.256252 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-df9eb04d-27f9-45ad-b699-ab3131e92481 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.464990 Sep 07 12:42:53.267197 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1334/2700] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Sep 7 12:42:52 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:53.273959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e2f6c44d-135c-4b25-a34f-09c0d44635da tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:53.274887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e2f6c44d-135c-4b25-a34f-09c0d44635da tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] [instance: 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:53.290832 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2f6c44d-135c-4b25-a34f-09c0d44635da tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:53.291344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2f6c44d-135c-4b25-a34f-09c0d44635da tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:53.291939 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2f6c44d-135c-4b25-a34f-09c0d44635da tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:53.292627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2f6c44d-135c-4b25-a34f-09c0d44635da tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:53.293110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2f6c44d-135c-4b25-a34f-09c0d44635da tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:53.293568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2f6c44d-135c-4b25-a34f-09c0d44635da tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:53.333167 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-05125d4c-cbd3-4006-b764-5e59638ead0a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f493fa6856847b4ae7cc8eb997a14c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b06047717c4a5ca47ebc72587256fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:53.343380 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-05125d4c-cbd3-4006-b764-5e59638ead0a tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce" status: 200 len: 1472 microversion: 2.1 time: 0.424134 Sep 07 12:42:53.344058 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1367/2701] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:52 2022] GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce => generated 1472 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:53.365276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5f8b49f5-be18-48aa-8a0c-bab86f9339f2 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:53.366868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5f8b49f5-be18-48aa-8a0c-bab86f9339f2 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 4bb43114-1042-49c5-b60c-2474dae9f021] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:53.380888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f8b49f5-be18-48aa-8a0c-bab86f9339f2 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:53.381819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f8b49f5-be18-48aa-8a0c-bab86f9339f2 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:53.382468 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f8b49f5-be18-48aa-8a0c-bab86f9339f2 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:53.383653 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f8b49f5-be18-48aa-8a0c-bab86f9339f2 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:53.384371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f8b49f5-be18-48aa-8a0c-bab86f9339f2 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:53.384990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f8b49f5-be18-48aa-8a0c-bab86f9339f2 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:53.625355 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e2f6c44d-135c-4b25-a34f-09c0d44635da tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca" status: 200 len: 1617 microversion: 2.1 time: 0.356596 Sep 07 12:42:53.627080 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1335/2702] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:53 2022] GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca => generated 1617 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:53.633987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a68f7d38-a108-494c-ae19-011c3d13ae9f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:53.633987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a68f7d38-a108-494c-ae19-011c3d13ae9f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:53.640930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a68f7d38-a108-494c-ae19-011c3d13ae9f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:53.641514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a68f7d38-a108-494c-ae19-011c3d13ae9f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:53.641962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a68f7d38-a108-494c-ae19-011c3d13ae9f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:53.642678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a68f7d38-a108-494c-ae19-011c3d13ae9f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:53.643141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a68f7d38-a108-494c-ae19-011c3d13ae9f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:53.643758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a68f7d38-a108-494c-ae19-011c3d13ae9f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:53.669894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5f8b49f5-be18-48aa-8a0c-bab86f9339f2 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:53.684150 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5f8b49f5-be18-48aa-8a0c-bab86f9339f2 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021" status: 200 len: 1317 microversion: 2.1 time: 0.328593 Sep 07 12:42:53.685388 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1368/2703] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:53 2022] GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021 => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:53.691680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-caa11e92-e613-45b2-90d1-c541eac3cffe tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:53.693020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-caa11e92-e613-45b2-90d1-c541eac3cffe tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] [instance: b017ea78-874a-4e91-933a-716e254275a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:53.701369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-caa11e92-e613-45b2-90d1-c541eac3cffe tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:53.702234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-caa11e92-e613-45b2-90d1-c541eac3cffe tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:53.703099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-caa11e92-e613-45b2-90d1-c541eac3cffe tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:53.704399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-caa11e92-e613-45b2-90d1-c541eac3cffe tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:53.705124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-caa11e92-e613-45b2-90d1-c541eac3cffe tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:53.705796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-caa11e92-e613-45b2-90d1-c541eac3cffe tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:53.727489 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:42:53.843863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-caa11e92-e613-45b2-90d1-c541eac3cffe tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51065729f69f4bfb8ab48d2c70d0ed55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12bd04061ca4c3795958b51739bbbdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:53.854044 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-caa11e92-e613-45b2-90d1-c541eac3cffe tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] 10.222.0.16 "GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6" status: 200 len: 1221 microversion: 2.1 time: 0.166618 Sep 07 12:42:53.870646 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1369/2704] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:53 2022] GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6 => generated 1221 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:53.876347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b4fe0903-0ec0-47da-97af-2ada39510f24 req-d8ac8ac8-6a34-49db-bf79-a424be464e17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0850dcd6-d5e3-4cea-bcdf-0105880bbc08", "name": "network-vif-plugged", "status": "completed", "tag": "0245a691-5a7a-4312-af03-6815cec9da19"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:53.891986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b4fe0903-0ec0-47da-97af-2ada39510f24 req-d8ac8ac8-6a34-49db-bf79-a424be464e17 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:53.893350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b4fe0903-0ec0-47da-97af-2ada39510f24 req-d8ac8ac8-6a34-49db-bf79-a424be464e17 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:53.894061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b4fe0903-0ec0-47da-97af-2ada39510f24 req-d8ac8ac8-6a34-49db-bf79-a424be464e17 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:53.922115 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b4fe0903-0ec0-47da-97af-2ada39510f24 req-d8ac8ac8-6a34-49db-bf79-a424be464e17 service nova] Creating event network-vif-plugged:0245a691-5a7a-4312-af03-6815cec9da19 for instance 0850dcd6-d5e3-4cea-bcdf-0105880bbc08 on n-h1-852087-9 Sep 07 12:42:53.943896 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b4fe0903-0ec0-47da-97af-2ada39510f24 req-d8ac8ac8-6a34-49db-bf79-a424be464e17 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071215 Sep 07 12:42:53.947621 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1370/2705] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:53.956474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f145ad1d-bde3-4aeb-9712-2f6777d9e5a0 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:53.957793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f145ad1d-bde3-4aeb-9712-2f6777d9e5a0 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:53.967093 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f145ad1d-bde3-4aeb-9712-2f6777d9e5a0 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:53.967997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f145ad1d-bde3-4aeb-9712-2f6777d9e5a0 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:53.968707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f145ad1d-bde3-4aeb-9712-2f6777d9e5a0 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:53.969981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f145ad1d-bde3-4aeb-9712-2f6777d9e5a0 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:53.971629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f145ad1d-bde3-4aeb-9712-2f6777d9e5a0 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:53.972562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f145ad1d-bde3-4aeb-9712-2f6777d9e5a0 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:54.064062 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a68f7d38-a108-494c-ae19-011c3d13ae9f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.436346 Sep 07 12:42:54.066310 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1336/2706] 10.222.0.16 () {58 vars in 1293 bytes} [Wed Sep 7 12:42:53 2022] GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45/os-security-groups => generated 1156 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:54.082008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-fc8ee859-9835-437b-8324-c97d3d5a762e req-cb3fe162-42fb-4db6-acc2-a4118462436d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45", "tag": "18cbdf2f-3657-4ad8-b999-fd91c1f28c75"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:54.105369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fc8ee859-9835-437b-8324-c97d3d5a762e req-cb3fe162-42fb-4db6-acc2-a4118462436d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:54.106580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fc8ee859-9835-437b-8324-c97d3d5a762e req-cb3fe162-42fb-4db6-acc2-a4118462436d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:54.107534 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fc8ee859-9835-437b-8324-c97d3d5a762e req-cb3fe162-42fb-4db6-acc2-a4118462436d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:54.131109 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-fc8ee859-9835-437b-8324-c97d3d5a762e req-cb3fe162-42fb-4db6-acc2-a4118462436d service nova] Creating event network-changed:18cbdf2f-3657-4ad8-b999-fd91c1f28c75 for instance bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 on n-h2-852087-9 Sep 07 12:42:54.142965 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-fc8ee859-9835-437b-8324-c97d3d5a762e req-cb3fe162-42fb-4db6-acc2-a4118462436d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073876 Sep 07 12:42:54.144562 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1337/2707] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:54.154722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-000a028a-afb7-47b3-a571-58dab038df1e tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Action: 'create', calling method: .version_select at 0x7fc4183f68b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1724728004", "description": "tempest-description-134767314"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:54.283919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f145ad1d-bde3-4aeb-9712-2f6777d9e5a0 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:54.295330 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f145ad1d-bde3-4aeb-9712-2f6777d9e5a0 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1523 microversion: 2.1 time: 0.345608 Sep 07 12:42:54.296234 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1371/2708] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:53 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1523 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:54.300978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1a29f2d0-0564-4fe0-a4d1-cb0794b8f8a3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:54.301622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1a29f2d0-0564-4fe0-a4d1-cb0794b8f8a3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:54.309769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a29f2d0-0564-4fe0-a4d1-cb0794b8f8a3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:54.310344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a29f2d0-0564-4fe0-a4d1-cb0794b8f8a3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:54.310810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a29f2d0-0564-4fe0-a4d1-cb0794b8f8a3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:54.311554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a29f2d0-0564-4fe0-a4d1-cb0794b8f8a3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:54.312015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a29f2d0-0564-4fe0-a4d1-cb0794b8f8a3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:54.312555 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a29f2d0-0564-4fe0-a4d1-cb0794b8f8a3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:54.553143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1a29f2d0-0564-4fe0-a4d1-cb0794b8f8a3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:54.558644 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-000a028a-afb7-47b3-a571-58dab038df1e tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.411817 Sep 07 12:42:54.559675 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1338/2709] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Sep 7 12:42:54 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:54.567298 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1a29f2d0-0564-4fe0-a4d1-cb0794b8f8a3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1314 microversion: 2.1 time: 0.269642 Sep 07 12:42:54.569194 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1372/2710] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:54 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:54.575643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-16c594ff-7fa6-4f0d-b00c-136215463011 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1496551325", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc"]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:54.577595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-de7e528b-3bf2-46b0-9efd-1025037e8fb0 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Action: 'create', calling method: .version_select at 0x7fc41d1f7dc0>, body: {"security_group": {"name": " tempest-securitygroup -2015578905 ", "description": "tempest-description-166073852"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:54.690573 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-16c594ff-7fa6-4f0d-b00c-136215463011 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:42:55.049207 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-de7e528b-3bf2-46b0-9efd-1025037e8fb0 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.477758 Sep 07 12:42:55.051700 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1373/2711] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Sep 7 12:42:54 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:55.068156 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-910e6fb0-b57f-417d-aaab-d1b81040e645 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-294202257"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:55.077928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-910e6fb0-b57f-417d-aaab-d1b81040e645 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:55.093817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910e6fb0-b57f-417d-aaab-d1b81040e645 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:55.094314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910e6fb0-b57f-417d-aaab-d1b81040e645 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:55.094753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910e6fb0-b57f-417d-aaab-d1b81040e645 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:55.095548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910e6fb0-b57f-417d-aaab-d1b81040e645 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:55.096006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910e6fb0-b57f-417d-aaab-d1b81040e645 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:55.096431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910e6fb0-b57f-417d-aaab-d1b81040e645 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:55.263468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-16c594ff-7fa6-4f0d-b00c-136215463011 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:42:55.264325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-16c594ff-7fa6-4f0d-b00c-136215463011 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:42:55.265102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-16c594ff-7fa6-4f0d-b00c-136215463011 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:42:55.265820 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-16c594ff-7fa6-4f0d-b00c-136215463011 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:42:55.266519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-16c594ff-7fa6-4f0d-b00c-136215463011 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:42:55.282264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16c594ff-7fa6-4f0d-b00c-136215463011 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:55.283325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16c594ff-7fa6-4f0d-b00c-136215463011 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:55.283964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16c594ff-7fa6-4f0d-b00c-136215463011 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:55.287936 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16c594ff-7fa6-4f0d-b00c-136215463011 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:55.288727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16c594ff-7fa6-4f0d-b00c-136215463011 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:55.289331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16c594ff-7fa6-4f0d-b00c-136215463011 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:55.358937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-16c594ff-7fa6-4f0d-b00c-136215463011 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:42:55.375150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-16c594ff-7fa6-4f0d-b00c-136215463011 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for user ed6e5d4d54224bca90954d1ebbd7b7a3 and project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:42:55.403455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-16c594ff-7fa6-4f0d-b00c-136215463011 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:42:55.409314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-16c594ff-7fa6-4f0d-b00c-136215463011 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 825ead8a-aa8c-4402-80f7-749edc7d21c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:42:55.487763 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-910e6fb0-b57f-417d-aaab-d1b81040e645 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "POST /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8/action" status: 202 len: 0 microversion: 2.1 time: 0.433209 Sep 07 12:42:55.489859 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1374/2712] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:42:55 2022] POST /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8/action => generated 0 bytes in 437 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 07 12:42:55.514962 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-16c594ff-7fa6-4f0d-b00c-136215463011 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.953138 Sep 07 12:42:55.525568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8a87b35e-56a5-45e9-b3a6-e0b2480b0a58 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:55.525568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8a87b35e-56a5-45e9-b3a6-e0b2480b0a58 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:55.527052 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1339/2713] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:42:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:42:55.536117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7b16d939-dbc4-47f2-982f-a1f5085b2d8d tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Action: 'create', calling method: .version_select at 0x7fc418d549d0>, body: {"security_group_rule": {"parent_group_id": "645df850-1485-449e-ad52-72ffb48c457e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "96f22e24-13b4-4444-bf8b-aa23cd185599"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:55.563429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a87b35e-56a5-45e9-b3a6-e0b2480b0a58 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:55.568657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a87b35e-56a5-45e9-b3a6-e0b2480b0a58 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:55.572757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a87b35e-56a5-45e9-b3a6-e0b2480b0a58 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:55.574059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a87b35e-56a5-45e9-b3a6-e0b2480b0a58 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:55.574912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a87b35e-56a5-45e9-b3a6-e0b2480b0a58 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:55.576159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a87b35e-56a5-45e9-b3a6-e0b2480b0a58 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:56.460402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8a87b35e-56a5-45e9-b3a6-e0b2480b0a58 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f493fa6856847b4ae7cc8eb997a14c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b06047717c4a5ca47ebc72587256fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:56.473608 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8a87b35e-56a5-45e9-b3a6-e0b2480b0a58 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce" status: 200 len: 1472 microversion: 2.1 time: 0.981623 Sep 07 12:42:56.493534 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1375/2714] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:55 2022] GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce => generated 1472 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:56.504328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7c7dcfb3-7e57-4131-afbe-f0492bb58115 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:56.505072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7c7dcfb3-7e57-4131-afbe-f0492bb58115 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 4bb43114-1042-49c5-b60c-2474dae9f021] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:56.523081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c7dcfb3-7e57-4131-afbe-f0492bb58115 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:56.524450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c7dcfb3-7e57-4131-afbe-f0492bb58115 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:56.525587 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c7dcfb3-7e57-4131-afbe-f0492bb58115 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:56.527524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c7dcfb3-7e57-4131-afbe-f0492bb58115 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:56.528670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c7dcfb3-7e57-4131-afbe-f0492bb58115 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:56.529958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c7dcfb3-7e57-4131-afbe-f0492bb58115 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:56.876998 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7c7dcfb3-7e57-4131-afbe-f0492bb58115 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:56.880868 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7b16d939-dbc4-47f2-982f-a1f5085b2d8d tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.352298 Sep 07 12:42:56.890235 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1340/2715] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Sep 7 12:42:55 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:56.894572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bd2baecd-1703-445d-8e18-26806889d4f5 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:56.895353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bd2baecd-1703-445d-8e18-26806889d4f5 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] [instance: b017ea78-874a-4e91-933a-716e254275a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:56.904191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd2baecd-1703-445d-8e18-26806889d4f5 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:56.904818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd2baecd-1703-445d-8e18-26806889d4f5 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:56.905586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd2baecd-1703-445d-8e18-26806889d4f5 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:56.906429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd2baecd-1703-445d-8e18-26806889d4f5 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:56.907006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd2baecd-1703-445d-8e18-26806889d4f5 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:56.907544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd2baecd-1703-445d-8e18-26806889d4f5 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:56.925778 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7c7dcfb3-7e57-4131-afbe-f0492bb58115 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021" status: 200 len: 1317 microversion: 2.1 time: 0.429947 Sep 07 12:42:56.928029 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1376/2716] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:56 2022] GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021 => generated 1317 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:56.937216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5f6d37d1-c36a-41ed-8213-44b3f40399a9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '.version_select at 0x7fc41d2f3d30>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:57.138305 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5f6d37d1-c36a-41ed-8213-44b3f40399a9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/a77d5d10-8cd3-4ec1-9443-087ec81ebdb9" status: 200 len: 223 microversion: 2.1 time: 0.207731 Sep 07 12:42:57.139526 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1377/2717] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Sep 7 12:42:56 2022] GET /compute/v2.1/os-security-groups/a77d5d10-8cd3-4ec1-9443-087ec81ebdb9 => generated 223 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:57.150663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fc5803a4-c0b3-4f08-8298-27f81f968a6b tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1625782695"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:57.156154 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fc5803a4-c0b3-4f08-8298-27f81f968a6b tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:57.168342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc5803a4-c0b3-4f08-8298-27f81f968a6b tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:57.169602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc5803a4-c0b3-4f08-8298-27f81f968a6b tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:57.170787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc5803a4-c0b3-4f08-8298-27f81f968a6b tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:57.172471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc5803a4-c0b3-4f08-8298-27f81f968a6b tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:57.173614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc5803a4-c0b3-4f08-8298-27f81f968a6b tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:57.174892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc5803a4-c0b3-4f08-8298-27f81f968a6b tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:57.210602 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bd2baecd-1703-445d-8e18-26806889d4f5 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51065729f69f4bfb8ab48d2c70d0ed55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12bd04061ca4c3795958b51739bbbdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:57.215749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:42:57.223026 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bd2baecd-1703-445d-8e18-26806889d4f5 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] 10.222.0.16 "GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6" status: 200 len: 1350 microversion: 2.1 time: 0.339866 Sep 07 12:42:57.224546 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1341/2718] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:56 2022] GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6 => generated 1350 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:57.230137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-009c6a72-f6fa-4057-b873-3d38395812d8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:57.231125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-009c6a72-f6fa-4057-b873-3d38395812d8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 825ead8a-aa8c-4402-80f7-749edc7d21c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:57.238304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-009c6a72-f6fa-4057-b873-3d38395812d8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:57.239213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-009c6a72-f6fa-4057-b873-3d38395812d8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:57.239922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-009c6a72-f6fa-4057-b873-3d38395812d8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:57.240866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-009c6a72-f6fa-4057-b873-3d38395812d8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:57.241616 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-009c6a72-f6fa-4057-b873-3d38395812d8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:57.242263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-009c6a72-f6fa-4057-b873-3d38395812d8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:57.251057 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-fc5803a4-c0b3-4f08-8298-27f81f968a6b tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] HTTP exception thrown: Cannot 'createImage' instance 663da890-aea0-44c3-842f-71ee8abfaac8 while it is in task_state image_snapshot Sep 07 12:42:57.254225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fc5803a4-c0b3-4f08-8298-27f81f968a6b tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Request method failure captured: Sep 07 12:42:57.254225 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8/action HTTP/1.1 Sep 07 12:42:57.254225 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:42:57.254225 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:42:57.254225 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:42:57.254225 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 85 Sep 07 12:42:57.254225 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:42:57.254225 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:42:57.254225 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:42:57.254225 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:42:57.254225 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJGQYbyJLIsXxXjgkDYN7LwAZ3FIxjt-YGkXt1Xo1a1MUwTVDulf3qar21KhPKqmmgY5XowXVa7QiIPma2KSUUJYmnQLgFXdiW6Ghu6fpYXXYUWnHmYT3Op2c2gidR2lsMRLQPmqnvHgSb4f0Vzgm_QdSzSUbn3j0rcW4vT7twxuCxo Sep 07 12:42:57.254225 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:42:57.254225 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:42:57.254225 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:42:57.254225 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:42:57.254225 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:42:57.254225 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:42:57.254225 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:42:57.254225 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:42:57.254225 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:42:57.254225 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:42:57.256032 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:42:57.256032 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:42:57.256032 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:42:57.256032 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:42:57.256032 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:42:57.256032 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:42:57.256032 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:42:57.256032 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: ac0d1c1e891c470c99e7c968b908a054 Sep 07 12:42:57.256032 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:42:57.256032 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:42:57.256032 n-d-852087-9 devstack@n-api.service[122432]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1625782695"}} Sep 07 12:42:57.256032 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:42:57.257112 n-d-852087-9 devstack@n-api.service[122432]: exception: Cannot 'createImage' instance 663da890-aea0-44c3-842f-71ee8abfaac8 while it is in task_state image_snapshot Sep 07 12:42:57.257112 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '663da890-aea0-44c3-842f-71ee8abfaac8', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1625782695'}}} Sep 07 12:42:57.257112 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:42:57.257112 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:57.257112 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Sep 07 12:42:57.257112 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Sep 07 12:42:57.257112 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Sep 07 12:42:57.257112 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 12:42:57.257112 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 663da890-aea0-44c3-842f-71ee8abfaac8 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Sep 07 12:42:57.257112 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:57.257112 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:57.257112 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:57.257112 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:57.257112 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:42:57.257112 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:42:57.257112 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:42:57.257112 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:42:57.257112 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:42:57.257112 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:42:57.258211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:42:57.258211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:42:57.258211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:42:57.258211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:42:57.258211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Sep 07 12:42:57.258211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 12:42:57.258211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 12:42:57.258211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 12:42:57.258211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 663da890-aea0-44c3-842f-71ee8abfaac8 while it is in task_state image_snapshot Sep 07 12:42:57.258211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:57.258211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:57.258211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:57.258211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:57.258211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:42:57.258211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:42:57.258211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:42:57.258211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:42:57.258211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 663da890-aea0-44c3-842f-71ee8abfaac8 while it is in task_state image_snapshot Sep 07 12:42:57.258211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:57.259287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fc5803a4-c0b3-4f08-8298-27f81f968a6b tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Returning 409 to user: Cannot 'createImage' instance 663da890-aea0-44c3-842f-71ee8abfaac8 while it is in task_state image_snapshot {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:42:57.259287 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fc5803a4-c0b3-4f08-8298-27f81f968a6b tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "POST /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8/action" status: 409 len: 159 microversion: 2.1 time: 0.115539 Sep 07 12:42:57.259287 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1378/2719] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:42:57 2022] POST /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8/action => generated 159 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:42:57.267952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d47bd942-ed8d-4aa7-909b-4ebcb12ab88d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:57.269108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d47bd942-ed8d-4aa7-909b-4ebcb12ab88d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:57.280239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d47bd942-ed8d-4aa7-909b-4ebcb12ab88d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:57.281144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d47bd942-ed8d-4aa7-909b-4ebcb12ab88d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:57.281987 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d47bd942-ed8d-4aa7-909b-4ebcb12ab88d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:57.283666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d47bd942-ed8d-4aa7-909b-4ebcb12ab88d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:57.284537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d47bd942-ed8d-4aa7-909b-4ebcb12ab88d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:57.285316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d47bd942-ed8d-4aa7-909b-4ebcb12ab88d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:57.346671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-009c6a72-f6fa-4057-b873-3d38395812d8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:57.357293 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-009c6a72-f6fa-4057-b873-3d38395812d8 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5" status: 200 len: 1269 microversion: 2.1 time: 0.131350 Sep 07 12:42:57.358293 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1342/2720] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:57 2022] GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5 => generated 1269 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:57.365352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-201b8bfa-aec2-4ca5-b60c-83e4e03166b5 req-a3a028fa-e48b-4dfb-841c-e5c39ab8fe83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb43114-1042-49c5-b60c-2474dae9f021", "name": "network-vif-plugged", "status": "completed", "tag": "14322b51-ee31-4407-9e34-e85d7d459730"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:57.375626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-201b8bfa-aec2-4ca5-b60c-83e4e03166b5 req-a3a028fa-e48b-4dfb-841c-e5c39ab8fe83 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:57.376124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-201b8bfa-aec2-4ca5-b60c-83e4e03166b5 req-a3a028fa-e48b-4dfb-841c-e5c39ab8fe83 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:57.376558 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-201b8bfa-aec2-4ca5-b60c-83e4e03166b5 req-a3a028fa-e48b-4dfb-841c-e5c39ab8fe83 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:57.390249 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-201b8bfa-aec2-4ca5-b60c-83e4e03166b5 req-a3a028fa-e48b-4dfb-841c-e5c39ab8fe83 service nova] Creating event network-vif-plugged:14322b51-ee31-4407-9e34-e85d7d459730 for instance 4bb43114-1042-49c5-b60c-2474dae9f021 on n-h1-852087-9 Sep 07 12:42:57.396157 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-201b8bfa-aec2-4ca5-b60c-83e4e03166b5 req-a3a028fa-e48b-4dfb-841c-e5c39ab8fe83 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036528 Sep 07 12:42:57.396937 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1343/2721] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:57.404087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-90a7cef3-711f-42fb-bdec-2433cfcc9a26 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Action: 'create', calling method: .version_select at 0x7fc418470c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-946057544", "description": "tempest-description-2028340726"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:57.629404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d47bd942-ed8d-4aa7-909b-4ebcb12ab88d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:57.649366 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d47bd942-ed8d-4aa7-909b-4ebcb12ab88d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1314 microversion: 2.1 time: 0.388780 Sep 07 12:42:57.665701 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1379/2722] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:57 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:57.692368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-728d784e-eec5-405d-bf33-56b999d68210 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '.version_select at 0x7fc419212670>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:57.814617 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-90a7cef3-711f-42fb-bdec-2433cfcc9a26 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.415840 Sep 07 12:42:57.816824 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1344/2723] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Sep 7 12:42:57 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:57.832672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bbffc134-d18f-40e3-b18b-65ea87c73d45 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '.version_select at 0x7fc41842bc10>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:58.130235 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bbffc134-d18f-40e3-b18b-65ea87c73d45 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "DELETE /compute/v2.1/images/fcf90254-35f2-4cc1-a799-e09abcf848c3" status: 204 len: 0 microversion: 2.1 time: 0.311221 Sep 07 12:42:58.135214 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1345/2724] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:57 2022] DELETE /compute/v2.1/images/fcf90254-35f2-4cc1-a799-e09abcf848c3 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:42:58.143753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-90247291-262a-46f2-96cd-c3b23e8edbf6 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:58.145105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-90247291-262a-46f2-96cd-c3b23e8edbf6 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:58.159757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90247291-262a-46f2-96cd-c3b23e8edbf6 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:58.163051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90247291-262a-46f2-96cd-c3b23e8edbf6 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:58.163749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90247291-262a-46f2-96cd-c3b23e8edbf6 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:58.166282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90247291-262a-46f2-96cd-c3b23e8edbf6 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:58.166729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90247291-262a-46f2-96cd-c3b23e8edbf6 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:58.167772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90247291-262a-46f2-96cd-c3b23e8edbf6 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:58.302318 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-728d784e-eec5-405d-bf33-56b999d68210 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/a77d5d10-8cd3-4ec1-9443-087ec81ebdb9" status: 202 len: 0 microversion: 2.1 time: 0.634018 Sep 07 12:42:58.304153 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1380/2725] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:42:57 2022] DELETE /compute/v2.1/os-security-groups/a77d5d10-8cd3-4ec1-9443-087ec81ebdb9 => generated 0 bytes in 637 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:42:58.313271 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-33d830aa-2003-4c01-9fcd-0c050ce8dc94 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Action: 'create', calling method: .version_select at 0x7fc41d1070d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1639174514", "description": "tempest-description-635384884"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:58.534366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-90247291-262a-46f2-96cd-c3b23e8edbf6 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f493fa6856847b4ae7cc8eb997a14c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b06047717c4a5ca47ebc72587256fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:58.552703 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-90247291-262a-46f2-96cd-c3b23e8edbf6 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce" status: 200 len: 1472 microversion: 2.1 time: 0.415303 Sep 07 12:42:58.554500 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1346/2726] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:58 2022] GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce => generated 1472 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:58.574074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fe72f816-71f7-40b0-9e0e-4f3cc5f1c0df tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:58.575002 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fe72f816-71f7-40b0-9e0e-4f3cc5f1c0df tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 4bb43114-1042-49c5-b60c-2474dae9f021] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:58.581939 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe72f816-71f7-40b0-9e0e-4f3cc5f1c0df tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:58.582735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe72f816-71f7-40b0-9e0e-4f3cc5f1c0df tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:58.583414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe72f816-71f7-40b0-9e0e-4f3cc5f1c0df tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:58.584504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe72f816-71f7-40b0-9e0e-4f3cc5f1c0df tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:58.585145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe72f816-71f7-40b0-9e0e-4f3cc5f1c0df tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:58.585757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe72f816-71f7-40b0-9e0e-4f3cc5f1c0df tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:58.955335 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-33d830aa-2003-4c01-9fcd-0c050ce8dc94 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.649459 Sep 07 12:42:58.956356 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1381/2727] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Sep 7 12:42:58 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:58.966490 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df747998-eeb8-41b3-a905-b2a02f2ba2ff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:58.967770 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-df747998-eeb8-41b3-a905-b2a02f2ba2ff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:58.976685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df747998-eeb8-41b3-a905-b2a02f2ba2ff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:58.977528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df747998-eeb8-41b3-a905-b2a02f2ba2ff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:58.978178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df747998-eeb8-41b3-a905-b2a02f2ba2ff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:58.979096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df747998-eeb8-41b3-a905-b2a02f2ba2ff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:58.980304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df747998-eeb8-41b3-a905-b2a02f2ba2ff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:58.981177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df747998-eeb8-41b3-a905-b2a02f2ba2ff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:59.044575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fe72f816-71f7-40b0-9e0e-4f3cc5f1c0df tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:59.056444 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fe72f816-71f7-40b0-9e0e-4f3cc5f1c0df tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021" status: 200 len: 1317 microversion: 2.1 time: 0.488490 Sep 07 12:42:59.057421 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1347/2728] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:58 2022] GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021 => generated 1317 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:59.071118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-1ecaaccf-2c17-4c93-90e0-c6dd8bdf1b84 req-fd347f1c-a6ad-4453-a144-1d6e14653e4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b017ea78-874a-4e91-933a-716e254275a6", "tag": "914cfc7f-b102-4403-ba5d-484c546bac81"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:59.091030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1ecaaccf-2c17-4c93-90e0-c6dd8bdf1b84 req-fd347f1c-a6ad-4453-a144-1d6e14653e4f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:59.091878 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1ecaaccf-2c17-4c93-90e0-c6dd8bdf1b84 req-fd347f1c-a6ad-4453-a144-1d6e14653e4f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:59.092715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1ecaaccf-2c17-4c93-90e0-c6dd8bdf1b84 req-fd347f1c-a6ad-4453-a144-1d6e14653e4f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:59.107043 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-1ecaaccf-2c17-4c93-90e0-c6dd8bdf1b84 req-fd347f1c-a6ad-4453-a144-1d6e14653e4f service nova] Creating event network-changed:914cfc7f-b102-4403-ba5d-484c546bac81 for instance b017ea78-874a-4e91-933a-716e254275a6 on n-h2-852087-9 Sep 07 12:42:59.113133 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-1ecaaccf-2c17-4c93-90e0-c6dd8bdf1b84 req-fd347f1c-a6ad-4453-a144-1d6e14653e4f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053768 Sep 07 12:42:59.114300 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1348/2729] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:42:59.124293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-02b53952-d6ab-4ace-994e-d82766526a42 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:59.125318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-02b53952-d6ab-4ace-994e-d82766526a42 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] [instance: b017ea78-874a-4e91-933a-716e254275a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:59.133326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02b53952-d6ab-4ace-994e-d82766526a42 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:59.134540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02b53952-d6ab-4ace-994e-d82766526a42 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:59.134910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02b53952-d6ab-4ace-994e-d82766526a42 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:59.136087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02b53952-d6ab-4ace-994e-d82766526a42 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:59.136825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02b53952-d6ab-4ace-994e-d82766526a42 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:59.137516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02b53952-d6ab-4ace-994e-d82766526a42 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:59.338327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-df747998-eeb8-41b3-a905-b2a02f2ba2ff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:59.348612 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-df747998-eeb8-41b3-a905-b2a02f2ba2ff tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1535 microversion: 2.1 time: 0.389726 Sep 07 12:42:59.349584 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1382/2730] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:58 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1535 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:59.368544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6d23d56f-8edc-4259-bc4b-cdd71121395f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '.version_select at 0x7fc4191e2e50>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:59.490997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG neutronclient.v2_0.client [None req-6d23d56f-8edc-4259-bc4b-cdd71121395f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a77d5d10-8cd3-4ec1-9443-087ec81ebdb9 does not exist", "detail": ""}} {{(pid=122432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 12:42:59.491723 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.security_group_api [None req-6d23d56f-8edc-4259-bc4b-cdd71121395f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Neutron security group a77d5d10-8cd3-4ec1-9443-087ec81ebdb9 not found {{(pid=122432) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 12:42:59.492272 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-6d23d56f-8edc-4259-bc4b-cdd71121395f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] HTTP exception thrown: Security group a77d5d10-8cd3-4ec1-9443-087ec81ebdb9 does not exist Sep 07 12:42:59.492272 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-6560926e-6fe0-4e94-ba71-a5baaf0c5c3c'] Sep 07 12:42:59.494514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6d23d56f-8edc-4259-bc4b-cdd71121395f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Request method failure captured: Sep 07 12:42:59.494514 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-security-groups/a77d5d10-8cd3-4ec1-9443-087ec81ebdb9 HTTP/1.1 Sep 07 12:42:59.494514 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:42:59.494514 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:42:59.494514 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:42:59.494514 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:42:59.494514 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:42:59.494514 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:42:59.494514 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:42:59.494514 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:42:59.494514 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJGWMXgN7OdrmO70X8q48ZD-kObLPYOd01ANus8JY-PK7OjbvYCQ097-aKOdLEd3zX6imftUV9BBkR8dj8xCIWAm9yYmlnMVOTu04sxm_YJiyi8RzROPFAn0FZkGq3OAzdh-65OtDl9f1F4UEDEA_AaJuKK-hToemYtm-2HEdw2FTvo Sep 07 12:42:59.494514 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:42:59.494514 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:42:59.494514 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:42:59.494514 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:42:59.494514 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:42:59.494514 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:42:59.494514 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:42:59.494514 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:42:59.494514 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:42:59.494514 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:42:59.497374 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:42:59.497374 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:42:59.497374 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:42:59.497374 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:42:59.497374 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:42:59.497374 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:42:59.497374 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:42:59.497374 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6c7fac0664f044168f52e7c1a982c48e Sep 07 12:42:59.497374 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:42:59.497374 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:42:59.497374 n-d-852087-9 devstack@n-api.service[122432]: exception: Security group a77d5d10-8cd3-4ec1-9443-087ec81ebdb9 does not exist Sep 07 12:42:59.497374 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-6560926e-6fe0-4e94-ba71-a5baaf0c5c3c'] Sep 07 12:42:59.497374 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'a77d5d10-8cd3-4ec1-9443-087ec81ebdb9'} Sep 07 12:42:59.499272 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:42:59.499272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:59.499272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 12:42:59.499272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 12:42:59.499272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:42:59.499272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:42:59.499272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 12:42:59.499272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 12:42:59.499272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:42:59.499272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:42:59.499272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 12:42:59.499272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 12:42:59.499272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:42:59.499272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:42:59.499272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 12:42:59.499272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 12:42:59.499272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:42:59.499272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:42:59.499272 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 12:42:59.501788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 12:42:59.501788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:42:59.501788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:42:59.501788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 12:42:59.501788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 12:42:59.501788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 12:42:59.501788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 12:42:59.501788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a77d5d10-8cd3-4ec1-9443-087ec81ebdb9 does not exist Sep 07 12:42:59.501788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6560926e-6fe0-4e94-ba71-a5baaf0c5c3c'] Sep 07 12:42:59.501788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:59.501788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:59.501788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:59.501788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:59.501788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 07 12:42:59.501788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 12:42:59.501788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 12:42:59.501788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 12:42:59.501788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a77d5d10-8cd3-4ec1-9443-087ec81ebdb9 does not exist Sep 07 12:42:59.504151 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6560926e-6fe0-4e94-ba71-a5baaf0c5c3c'] Sep 07 12:42:59.504151 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:59.504151 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:59.504151 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:59.504151 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:59.504151 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:42:59.504151 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:42:59.504151 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:42:59.504151 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:42:59.504151 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:42:59.504151 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:42:59.504151 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:42:59.504151 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:42:59.504151 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 07 12:42:59.504151 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 12:42:59.504151 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a77d5d10-8cd3-4ec1-9443-087ec81ebdb9 does not exist Sep 07 12:42:59.504151 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6560926e-6fe0-4e94-ba71-a5baaf0c5c3c'] Sep 07 12:42:59.504151 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:59.504151 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:42:59.504151 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:59.504151 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:42:59.506885 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:42:59.506885 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:42:59.506885 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:42:59.506885 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:42:59.506885 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a77d5d10-8cd3-4ec1-9443-087ec81ebdb9 does not exist Sep 07 12:42:59.506885 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6560926e-6fe0-4e94-ba71-a5baaf0c5c3c'] Sep 07 12:42:59.506885 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:42:59.507718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-02b53952-d6ab-4ace-994e-d82766526a42 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51065729f69f4bfb8ab48d2c70d0ed55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12bd04061ca4c3795958b51739bbbdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:59.507890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6d23d56f-8edc-4259-bc4b-cdd71121395f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Returning 404 to user: Security group a77d5d10-8cd3-4ec1-9443-087ec81ebdb9 does not exist Sep 07 12:42:59.507890 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-6560926e-6fe0-4e94-ba71-a5baaf0c5c3c'] {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:42:59.510153 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6d23d56f-8edc-4259-bc4b-cdd71121395f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/a77d5d10-8cd3-4ec1-9443-087ec81ebdb9" status: 404 len: 194 microversion: 2.1 time: 0.146901 Sep 07 12:42:59.510839 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1383/2731] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Sep 7 12:42:59 2022] GET /compute/v2.1/os-security-groups/a77d5d10-8cd3-4ec1-9443-087ec81ebdb9 => generated 194 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:42:59.513254 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-02b53952-d6ab-4ace-994e-d82766526a42 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] 10.222.0.16 "GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6" status: 200 len: 1350 microversion: 2.1 time: 0.396556 Sep 07 12:42:59.515060 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1349/2732] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:59 2022] GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6 => generated 1350 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:59.517680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-82d6c9b9-e728-490a-b475-0c1a88081755 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:59.518555 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-82d6c9b9-e728-490a-b475-0c1a88081755 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 825ead8a-aa8c-4402-80f7-749edc7d21c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:59.525185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7804e337-5090-45e5-8b3f-9366e9062073 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:42:59.526757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7804e337-5090-45e5-8b3f-9366e9062073 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:42:59.529813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82d6c9b9-e728-490a-b475-0c1a88081755 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:59.530506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82d6c9b9-e728-490a-b475-0c1a88081755 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:59.530974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82d6c9b9-e728-490a-b475-0c1a88081755 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:59.531711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82d6c9b9-e728-490a-b475-0c1a88081755 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:59.532187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82d6c9b9-e728-490a-b475-0c1a88081755 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:59.532620 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82d6c9b9-e728-490a-b475-0c1a88081755 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:59.540336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7804e337-5090-45e5-8b3f-9366e9062073 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:59.540336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7804e337-5090-45e5-8b3f-9366e9062073 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:59.540336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7804e337-5090-45e5-8b3f-9366e9062073 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:59.541131 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7804e337-5090-45e5-8b3f-9366e9062073 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:42:59.541642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7804e337-5090-45e5-8b3f-9366e9062073 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:42:59.542233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7804e337-5090-45e5-8b3f-9366e9062073 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:42:59.632674 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-82d6c9b9-e728-490a-b475-0c1a88081755 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:59.642062 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-82d6c9b9-e728-490a-b475-0c1a88081755 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5" status: 200 len: 1275 microversion: 2.1 time: 0.129810 Sep 07 12:42:59.642777 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1384/2733] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:59 2022] GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5 => generated 1275 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:59.647862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f8510fc9-8689-475c-b634-34de2fe251b1 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Action: 'create', calling method: .version_select at 0x7fc4190b33a0>, body: {"security_group_rule": {"parent_group_id": "c18f693e-20f8-4a74-8c98-93feef6a7c71", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "e56c8b9c-218e-417d-924a-8caf8fe8637d"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:42:59.878671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7804e337-5090-45e5-8b3f-9366e9062073 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:42:59.888118 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7804e337-5090-45e5-8b3f-9366e9062073 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1314 microversion: 2.1 time: 0.370995 Sep 07 12:42:59.892876 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1350/2734] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:42:59 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:42:59.898372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d96f4d51-b173-48f7-9e53-adf75b1cad50 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Action: 'create', calling method: .version_select at 0x7fc4183f65e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-847484129", "description": "tempest-description-1523633841"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:00.245254 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d96f4d51-b173-48f7-9e53-adf75b1cad50 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.350911 Sep 07 12:43:00.257555 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1351/2735] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Sep 7 12:42:59 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:00.257555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5fd439e1-14b7-422b-9f42-1e52bd29d36c tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:00.257555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5fd439e1-14b7-422b-9f42-1e52bd29d36c tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:00.279716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fd439e1-14b7-422b-9f42-1e52bd29d36c tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:00.280824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fd439e1-14b7-422b-9f42-1e52bd29d36c tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:00.281854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fd439e1-14b7-422b-9f42-1e52bd29d36c tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:00.285345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fd439e1-14b7-422b-9f42-1e52bd29d36c tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:00.286657 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fd439e1-14b7-422b-9f42-1e52bd29d36c tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:00.288082 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fd439e1-14b7-422b-9f42-1e52bd29d36c tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:00.293811 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f8510fc9-8689-475c-b634-34de2fe251b1 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.648855 Sep 07 12:43:00.295196 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1385/2736] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Sep 7 12:42:59 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:00.311325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e6cd642d-1822-451e-9c90-5b6451876be1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:00.312187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e6cd642d-1822-451e-9c90-5b6451876be1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 4bb43114-1042-49c5-b60c-2474dae9f021] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:00.323183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6cd642d-1822-451e-9c90-5b6451876be1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:00.324406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6cd642d-1822-451e-9c90-5b6451876be1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:00.325443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6cd642d-1822-451e-9c90-5b6451876be1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:00.326922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6cd642d-1822-451e-9c90-5b6451876be1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:00.327903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6cd642d-1822-451e-9c90-5b6451876be1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:00.329062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6cd642d-1822-451e-9c90-5b6451876be1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:00.559067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5fd439e1-14b7-422b-9f42-1e52bd29d36c tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f493fa6856847b4ae7cc8eb997a14c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b06047717c4a5ca47ebc72587256fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:00.588490 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5fd439e1-14b7-422b-9f42-1e52bd29d36c tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce" status: 200 len: 1472 microversion: 2.1 time: 0.340946 Sep 07 12:43:00.594132 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1352/2737] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:00 2022] GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce => generated 1472 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:00.612971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e6cd642d-1822-451e-9c90-5b6451876be1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:00.613687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-44bfbb6f-94be-4ac4-aae0-4089bf3ef08a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Action: 'create', calling method: .version_select at 0x7fc4183f65e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1169252483", "description": "tempest-description-704081703"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:00.624527 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e6cd642d-1822-451e-9c90-5b6451876be1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021" status: 200 len: 1317 microversion: 2.1 time: 0.327717 Sep 07 12:43:00.625452 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1386/2738] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:00 2022] GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021 => generated 1317 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:00.630834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d04844be-ec24-4ee6-893c-90a5fb0d6a5f tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Calling method '.version_select at 0x7fc419487550>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:01.200775 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-44bfbb6f-94be-4ac4-aae0-4089bf3ef08a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.604158 Sep 07 12:43:01.202082 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1353/2739] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Sep 7 12:43:00 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:01.209025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ca1b186c-aaab-4b99-824f-3fe1104e9f59 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:01.209857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ca1b186c-aaab-4b99-824f-3fe1104e9f59 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:01.217692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca1b186c-aaab-4b99-824f-3fe1104e9f59 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:01.218366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca1b186c-aaab-4b99-824f-3fe1104e9f59 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:01.219004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca1b186c-aaab-4b99-824f-3fe1104e9f59 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:01.219830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca1b186c-aaab-4b99-824f-3fe1104e9f59 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:01.220392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca1b186c-aaab-4b99-824f-3fe1104e9f59 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:01.221109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca1b186c-aaab-4b99-824f-3fe1104e9f59 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:01.424871 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d04844be-ec24-4ee6-893c-90a5fb0d6a5f tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/e56c8b9c-218e-417d-924a-8caf8fe8637d" status: 202 len: 0 microversion: 2.1 time: 0.797852 Sep 07 12:43:01.425629 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1387/2740] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:43:00 2022] DELETE /compute/v2.1/os-security-groups/e56c8b9c-218e-417d-924a-8caf8fe8637d => generated 0 bytes in 799 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:43:01.433799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-496ef997-bbc2-4643-a1ec-486b1ac55f4a tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:01.434698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-496ef997-bbc2-4643-a1ec-486b1ac55f4a tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] [instance: b017ea78-874a-4e91-933a-716e254275a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:01.443541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-496ef997-bbc2-4643-a1ec-486b1ac55f4a tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:01.444246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-496ef997-bbc2-4643-a1ec-486b1ac55f4a tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:01.444946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-496ef997-bbc2-4643-a1ec-486b1ac55f4a tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:01.445987 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-496ef997-bbc2-4643-a1ec-486b1ac55f4a tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:01.446541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-496ef997-bbc2-4643-a1ec-486b1ac55f4a tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:01.447105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-496ef997-bbc2-4643-a1ec-486b1ac55f4a tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:01.698419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ca1b186c-aaab-4b99-824f-3fe1104e9f59 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:01.710279 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ca1b186c-aaab-4b99-824f-3fe1104e9f59 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1535 microversion: 2.1 time: 0.505573 Sep 07 12:43:01.711298 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1354/2741] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:01 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1535 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:01.716756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c971a804-1183-4842-883e-3ade0dd72cb5 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:01.717386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c971a804-1183-4842-883e-3ade0dd72cb5 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 825ead8a-aa8c-4402-80f7-749edc7d21c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:01.726641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c971a804-1183-4842-883e-3ade0dd72cb5 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:01.727518 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c971a804-1183-4842-883e-3ade0dd72cb5 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:01.728453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c971a804-1183-4842-883e-3ade0dd72cb5 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:01.729614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c971a804-1183-4842-883e-3ade0dd72cb5 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:01.730348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c971a804-1183-4842-883e-3ade0dd72cb5 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:01.730790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c971a804-1183-4842-883e-3ade0dd72cb5 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:01.900154 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-496ef997-bbc2-4643-a1ec-486b1ac55f4a tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51065729f69f4bfb8ab48d2c70d0ed55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12bd04061ca4c3795958b51739bbbdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:01.912627 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-496ef997-bbc2-4643-a1ec-486b1ac55f4a tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] 10.222.0.16 "GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6" status: 200 len: 1350 microversion: 2.1 time: 0.484259 Sep 07 12:43:01.912938 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1388/2742] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:01 2022] GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6 => generated 1350 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:01.919634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3b9ef102-e326-4ff5-bd29-abfb4e8316c5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:01.920467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3b9ef102-e326-4ff5-bd29-abfb4e8316c5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:01.930920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b9ef102-e326-4ff5-bd29-abfb4e8316c5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:01.931702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b9ef102-e326-4ff5-bd29-abfb4e8316c5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:01.932868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b9ef102-e326-4ff5-bd29-abfb4e8316c5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:01.934409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b9ef102-e326-4ff5-bd29-abfb4e8316c5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:01.935238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b9ef102-e326-4ff5-bd29-abfb4e8316c5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:01.935807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b9ef102-e326-4ff5-bd29-abfb4e8316c5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:02.014457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c971a804-1183-4842-883e-3ade0dd72cb5 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:02.029741 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c971a804-1183-4842-883e-3ade0dd72cb5 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5" status: 200 len: 1317 microversion: 2.1 time: 0.316749 Sep 07 12:43:02.030856 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1355/2743] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:01 2022] GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5 => generated 1317 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:02.043069 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0e2434ba-a996-4de7-9d45-a5814719407c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Action: 'create', calling method: .version_select at 0x7fc41851cd30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1997135522", "description": "tempest-description-1786867752"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:02.219742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3b9ef102-e326-4ff5-bd29-abfb4e8316c5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:02.229949 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3b9ef102-e326-4ff5-bd29-abfb4e8316c5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1314 microversion: 2.1 time: 0.315632 Sep 07 12:43:02.230557 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1389/2744] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:01 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:02.235894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9cf7f4cd-6dda-40a7-9289-1f4dd5b3d4e1 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Calling method '.version_select at 0x7fc418fb81f0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:02.416224 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9cf7f4cd-6dda-40a7-9289-1f4dd5b3d4e1 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/c18f693e-20f8-4a74-8c98-93feef6a7c71" status: 200 len: 247 microversion: 2.1 time: 0.184194 Sep 07 12:43:02.416967 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1390/2745] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Sep 7 12:43:02 2022] GET /compute/v2.1/os-security-groups/c18f693e-20f8-4a74-8c98-93feef6a7c71 => generated 247 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:02.424100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:43:02.435527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0d767347-2b04-4ad7-ae20-cb9f83510da9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:02.436046 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0d767347-2b04-4ad7-ae20-cb9f83510da9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:02.448405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d767347-2b04-4ad7-ae20-cb9f83510da9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:02.450472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d767347-2b04-4ad7-ae20-cb9f83510da9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:02.450472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d767347-2b04-4ad7-ae20-cb9f83510da9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:02.450822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d767347-2b04-4ad7-ae20-cb9f83510da9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:02.451586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d767347-2b04-4ad7-ae20-cb9f83510da9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:02.454217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d767347-2b04-4ad7-ae20-cb9f83510da9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:02.485985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=10 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:43:02.506319 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0e2434ba-a996-4de7-9d45-a5814719407c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.471576 Sep 07 12:43:02.509233 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1356/2746] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Sep 7 12:43:02 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:02.527021 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f05f40a-8b61-48ed-85f4-f1466ebecb36 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:02.527556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0f05f40a-8b61-48ed-85f4-f1466ebecb36 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 4bb43114-1042-49c5-b60c-2474dae9f021] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:02.543740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f05f40a-8b61-48ed-85f4-f1466ebecb36 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:02.544247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f05f40a-8b61-48ed-85f4-f1466ebecb36 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:02.544694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f05f40a-8b61-48ed-85f4-f1466ebecb36 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:02.545413 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f05f40a-8b61-48ed-85f4-f1466ebecb36 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:02.545916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f05f40a-8b61-48ed-85f4-f1466ebecb36 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:02.546346 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f05f40a-8b61-48ed-85f4-f1466ebecb36 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:02.796057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0d767347-2b04-4ad7-ae20-cb9f83510da9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f493fa6856847b4ae7cc8eb997a14c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b06047717c4a5ca47ebc72587256fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:02.818131 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0d767347-2b04-4ad7-ae20-cb9f83510da9 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce" status: 200 len: 1472 microversion: 2.1 time: 0.395210 Sep 07 12:43:02.820534 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1391/2747] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:02 2022] GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce => generated 1472 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:02.827524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-15a71d0c-40ed-4122-a911-82d3c7049b83 req-3ad1bf97-91cf-47b4-b4e8-7b5675db079b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "825ead8a-aa8c-4402-80f7-749edc7d21c5", "tag": "97742b1d-4f2e-4907-8288-3d2750b5f23d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:02.832789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0f05f40a-8b61-48ed-85f4-f1466ebecb36 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:02.842187 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0f05f40a-8b61-48ed-85f4-f1466ebecb36 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021" status: 200 len: 1317 microversion: 2.1 time: 0.330863 Sep 07 12:43:02.842790 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1357/2748] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:02 2022] GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021 => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:02.853962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-15a71d0c-40ed-4122-a911-82d3c7049b83 req-3ad1bf97-91cf-47b4-b4e8-7b5675db079b service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:02.857896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-420e2a62-fdbf-4b8d-9e25-2bd8eb0da7cf tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Action: 'create', calling method: .version_select at 0x7fc41851c4c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1924870218", "description": "tempest-description-1727572388"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:02.878216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-15a71d0c-40ed-4122-a911-82d3c7049b83 req-3ad1bf97-91cf-47b4-b4e8-7b5675db079b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:02.878705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-15a71d0c-40ed-4122-a911-82d3c7049b83 req-3ad1bf97-91cf-47b4-b4e8-7b5675db079b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:02.905715 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-15a71d0c-40ed-4122-a911-82d3c7049b83 req-3ad1bf97-91cf-47b4-b4e8-7b5675db079b service nova] Creating event network-changed:97742b1d-4f2e-4907-8288-3d2750b5f23d for instance 825ead8a-aa8c-4402-80f7-749edc7d21c5 on n-h2-852087-9 Sep 07 12:43:02.912408 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-15a71d0c-40ed-4122-a911-82d3c7049b83 req-3ad1bf97-91cf-47b4-b4e8-7b5675db079b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089915 Sep 07 12:43:02.913551 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1392/2749] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:02.919881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4de111f4-5366-4c27-acaf-9b6b167c4511 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '.version_select at 0x7fc4185aa160>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:03.870279 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-420e2a62-fdbf-4b8d-9e25-2bd8eb0da7cf tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.016550 Sep 07 12:43:03.871855 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1358/2750] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Sep 7 12:43:02 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:03.877613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-361b8d94-31b8-4c6c-9383-8e3c58d451df tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:03.878501 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-361b8d94-31b8-4c6c-9383-8e3c58d451df tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:03.894603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361b8d94-31b8-4c6c-9383-8e3c58d451df tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:03.902084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361b8d94-31b8-4c6c-9383-8e3c58d451df tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:03.902855 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361b8d94-31b8-4c6c-9383-8e3c58d451df tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:03.903958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361b8d94-31b8-4c6c-9383-8e3c58d451df tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:03.905836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361b8d94-31b8-4c6c-9383-8e3c58d451df tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:03.906288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361b8d94-31b8-4c6c-9383-8e3c58d451df tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:03.962718 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4de111f4-5366-4c27-acaf-9b6b167c4511 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 1.047299 Sep 07 12:43:03.963935 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1393/2751] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Sep 7 12:43:02 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:03.973850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ae3279a6-e2d5-410d-9241-3b87d97857a4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:03.975218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ae3279a6-e2d5-410d-9241-3b87d97857a4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] [instance: b017ea78-874a-4e91-933a-716e254275a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:03.987933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae3279a6-e2d5-410d-9241-3b87d97857a4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:03.988877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae3279a6-e2d5-410d-9241-3b87d97857a4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:03.989803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae3279a6-e2d5-410d-9241-3b87d97857a4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:03.991113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae3279a6-e2d5-410d-9241-3b87d97857a4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:03.991969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae3279a6-e2d5-410d-9241-3b87d97857a4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:03.992761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae3279a6-e2d5-410d-9241-3b87d97857a4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:04.167808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-361b8d94-31b8-4c6c-9383-8e3c58d451df tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:04.181372 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-361b8d94-31b8-4c6c-9383-8e3c58d451df tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1541 microversion: 2.1 time: 0.307538 Sep 07 12:43:04.183240 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1359/2752] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:03 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1541 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:04.192812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3180e82a-5d50-4718-b4ea-1b0a6d8d1616 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:04.194965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3180e82a-5d50-4718-b4ea-1b0a6d8d1616 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 825ead8a-aa8c-4402-80f7-749edc7d21c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:04.205471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3180e82a-5d50-4718-b4ea-1b0a6d8d1616 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:04.206125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3180e82a-5d50-4718-b4ea-1b0a6d8d1616 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:04.206665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3180e82a-5d50-4718-b4ea-1b0a6d8d1616 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:04.207450 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3180e82a-5d50-4718-b4ea-1b0a6d8d1616 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:04.208188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3180e82a-5d50-4718-b4ea-1b0a6d8d1616 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:04.208617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3180e82a-5d50-4718-b4ea-1b0a6d8d1616 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:04.210023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ae3279a6-e2d5-410d-9241-3b87d97857a4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51065729f69f4bfb8ab48d2c70d0ed55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12bd04061ca4c3795958b51739bbbdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:04.223942 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ae3279a6-e2d5-410d-9241-3b87d97857a4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] 10.222.0.16 "GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6" status: 200 len: 1350 microversion: 2.1 time: 0.257881 Sep 07 12:43:04.225243 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1394/2753] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:03 2022] GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6 => generated 1350 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:04.235342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0f8f41ce-3faf-4063-92f6-9e823044aa79 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:04.236945 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0f8f41ce-3faf-4063-92f6-9e823044aa79 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:04.248237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f8f41ce-3faf-4063-92f6-9e823044aa79 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:04.249697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f8f41ce-3faf-4063-92f6-9e823044aa79 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:04.250602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f8f41ce-3faf-4063-92f6-9e823044aa79 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:04.252015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f8f41ce-3faf-4063-92f6-9e823044aa79 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:04.252890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f8f41ce-3faf-4063-92f6-9e823044aa79 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:04.253626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f8f41ce-3faf-4063-92f6-9e823044aa79 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:04.261360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:43:04.452721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3180e82a-5d50-4718-b4ea-1b0a6d8d1616 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:04.474543 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3180e82a-5d50-4718-b4ea-1b0a6d8d1616 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5" status: 200 len: 1317 microversion: 2.1 time: 0.289000 Sep 07 12:43:04.475878 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1360/2754] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:04 2022] GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5 => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:04.476952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0f8f41ce-3faf-4063-92f6-9e823044aa79 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:04.484965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-4ad058c8-fa6e-4b66-bfeb-593963e24de7 req-8643b9b2-9343-454f-b225-94268379851a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "886a386f-a0cc-4d90-96ac-4e418ed43bce", "name": "network-vif-deleted", "tag": "a0ca592a-191a-4417-974a-0fdc230ebb1c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:04.488875 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0f8f41ce-3faf-4063-92f6-9e823044aa79 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1501 microversion: 2.1 time: 0.261801 Sep 07 12:43:04.490214 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1395/2755] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:04 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1501 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:04.495306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-754d859d-a5b4-419f-b4c7-8fb7c8c41ad1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:04.495916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-754d859d-a5b4-419f-b4c7-8fb7c8c41ad1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:04.502596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-754d859d-a5b4-419f-b4c7-8fb7c8c41ad1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:04.503417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-754d859d-a5b4-419f-b4c7-8fb7c8c41ad1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:04.504184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-754d859d-a5b4-419f-b4c7-8fb7c8c41ad1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:04.505739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-754d859d-a5b4-419f-b4c7-8fb7c8c41ad1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:04.506393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-754d859d-a5b4-419f-b4c7-8fb7c8c41ad1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:04.506974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-754d859d-a5b4-419f-b4c7-8fb7c8c41ad1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:04.510521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4ad058c8-fa6e-4b66-bfeb-593963e24de7 req-8643b9b2-9343-454f-b225-94268379851a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:04.511157 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4ad058c8-fa6e-4b66-bfeb-593963e24de7 req-8643b9b2-9343-454f-b225-94268379851a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:04.511719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4ad058c8-fa6e-4b66-bfeb-593963e24de7 req-8643b9b2-9343-454f-b225-94268379851a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:04.525293 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-4ad058c8-fa6e-4b66-bfeb-593963e24de7 req-8643b9b2-9343-454f-b225-94268379851a service nova] Creating event network-vif-deleted:a0ca592a-191a-4417-974a-0fdc230ebb1c for instance 886a386f-a0cc-4d90-96ac-4e418ed43bce on n-h1-852087-9 Sep 07 12:43:04.531595 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-4ad058c8-fa6e-4b66-bfeb-593963e24de7 req-8643b9b2-9343-454f-b225-94268379851a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053475 Sep 07 12:43:04.532593 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1361/2756] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:04.539577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a274fd60-e6b3-4558-9285-66f284f33ffd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:04.540456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a274fd60-e6b3-4558-9285-66f284f33ffd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 4bb43114-1042-49c5-b60c-2474dae9f021] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:04.552213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a274fd60-e6b3-4558-9285-66f284f33ffd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:04.553110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a274fd60-e6b3-4558-9285-66f284f33ffd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:04.553922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a274fd60-e6b3-4558-9285-66f284f33ffd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:04.555311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a274fd60-e6b3-4558-9285-66f284f33ffd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:04.556466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a274fd60-e6b3-4558-9285-66f284f33ffd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:04.557266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a274fd60-e6b3-4558-9285-66f284f33ffd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:04.625990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-754d859d-a5b4-419f-b4c7-8fb7c8c41ad1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f493fa6856847b4ae7cc8eb997a14c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b06047717c4a5ca47ebc72587256fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:04.647330 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-754d859d-a5b4-419f-b4c7-8fb7c8c41ad1 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce" status: 200 len: 1302 microversion: 2.1 time: 0.155356 Sep 07 12:43:04.654146 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1396/2757] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:04 2022] GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce => generated 1302 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:04.662645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e0d0d6e-3947-438f-8301-4cff274e9022 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Action: 'create', calling method: .version_select at 0x7fc41d2528b0>, body: {"security_group_rule": {"parent_group_id": "fa3778c8-46cf-438d-8a01-baf0c675c36f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:04.909324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a274fd60-e6b3-4558-9285-66f284f33ffd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:04.921651 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a274fd60-e6b3-4558-9285-66f284f33ffd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021" status: 200 len: 1317 microversion: 2.1 time: 0.387082 Sep 07 12:43:04.923785 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1362/2758] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:04 2022] GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021 => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:04.929949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-80114e89-b252-4bae-9672-769b880de08d tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '.version_select at 0x7fc4183d2160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:05.147639 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2e0d0d6e-3947-438f-8301-4cff274e9022 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.495078 Sep 07 12:43:05.159463 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1397/2759] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Sep 7 12:43:04 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:05.168052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eb8736d2-dd80-4f9c-bcfe-f176ce1650d1 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:05.185089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb8736d2-dd80-4f9c-bcfe-f176ce1650d1 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:05.186455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb8736d2-dd80-4f9c-bcfe-f176ce1650d1 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:05.187537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb8736d2-dd80-4f9c-bcfe-f176ce1650d1 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:05.293639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eb8736d2-dd80-4f9c-bcfe-f176ce1650d1 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Going to try to stop instance {{(pid=122432) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 12:43:05.318895 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-80114e89-b252-4bae-9672-769b880de08d tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/229ed710-e4a3-42c6-8d9d-0e5c9398a133" status: 202 len: 0 microversion: 2.1 time: 0.392670 Sep 07 12:43:05.321430 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1363/2760] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:43:04 2022] DELETE /compute/v2.1/os-security-groups/229ed710-e4a3-42c6-8d9d-0e5c9398a133 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:43:05.326619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:43:05.336121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-5ec5aa8d-016f-4b81-b06a-c74811eeb63c req-2ef26206-4062-44ea-8f29-b5061ca1b2a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "663da890-aea0-44c3-842f-71ee8abfaac8", "name": "network-vif-plugged", "status": "completed", "tag": "91a161ca-8197-4775-8162-05a0be29c897"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:05.366377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5ec5aa8d-016f-4b81-b06a-c74811eeb63c req-2ef26206-4062-44ea-8f29-b5061ca1b2a0 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:05.367740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5ec5aa8d-016f-4b81-b06a-c74811eeb63c req-2ef26206-4062-44ea-8f29-b5061ca1b2a0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:05.368848 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5ec5aa8d-016f-4b81-b06a-c74811eeb63c req-2ef26206-4062-44ea-8f29-b5061ca1b2a0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:05.374388 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eb8736d2-dd80-4f9c-bcfe-f176ce1650d1 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "POST /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08/action" status: 202 len: 0 microversion: 2.1 time: 0.209022 Sep 07 12:43:05.375170 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1398/2761] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:43:05 2022] POST /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:43:05.381301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ddadb359-ca43-4c7d-86d0-313149416ce7 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Action: 'create', calling method: .version_select at 0x7fc418405e50>, body: {"security_group_rule": {"parent_group_id": "fa3778c8-46cf-438d-8a01-baf0c675c36f", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:05.393161 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:43:05.398709 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-5ec5aa8d-016f-4b81-b06a-c74811eeb63c req-2ef26206-4062-44ea-8f29-b5061ca1b2a0 service nova] Creating event network-vif-plugged:91a161ca-8197-4775-8162-05a0be29c897 for instance 663da890-aea0-44c3-842f-71ee8abfaac8 on n-h1-852087-9 Sep 07 12:43:05.410508 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-5ec5aa8d-016f-4b81-b06a-c74811eeb63c req-2ef26206-4062-44ea-8f29-b5061ca1b2a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084977 Sep 07 12:43:05.412901 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1364/2762] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:05.423295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e5c5f569-4276-4645-aa72-5e67fce6947e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:05.424798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e5c5f569-4276-4645-aa72-5e67fce6947e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:05.437230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5c5f569-4276-4645-aa72-5e67fce6947e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:05.438119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5c5f569-4276-4645-aa72-5e67fce6947e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:05.438852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5c5f569-4276-4645-aa72-5e67fce6947e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:05.439672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5c5f569-4276-4645-aa72-5e67fce6947e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:05.440288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5c5f569-4276-4645-aa72-5e67fce6947e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:05.441049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5c5f569-4276-4645-aa72-5e67fce6947e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:05.727226 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ddadb359-ca43-4c7d-86d0-313149416ce7 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.350636 Sep 07 12:43:05.728385 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1399/2763] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Sep 7 12:43:05 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:05.735832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2a382004-d1f1-49a1-a8ab-3450b6844c91 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:05.736923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2a382004-d1f1-49a1-a8ab-3450b6844c91 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] [instance: b017ea78-874a-4e91-933a-716e254275a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:05.752340 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a382004-d1f1-49a1-a8ab-3450b6844c91 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:05.753798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a382004-d1f1-49a1-a8ab-3450b6844c91 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:05.754563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a382004-d1f1-49a1-a8ab-3450b6844c91 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:05.756202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a382004-d1f1-49a1-a8ab-3450b6844c91 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:05.757342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a382004-d1f1-49a1-a8ab-3450b6844c91 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:05.758629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a382004-d1f1-49a1-a8ab-3450b6844c91 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:05.766977 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e5c5f569-4276-4645-aa72-5e67fce6947e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:05.805387 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e5c5f569-4276-4645-aa72-5e67fce6947e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1541 microversion: 2.1 time: 0.389974 Sep 07 12:43:05.806604 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1365/2764] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:05 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1541 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:05.813966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a57f5e29-13a8-45b7-bedf-e2984213d22b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '.version_select at 0x7fc41840d4c0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:05.952988 n-d-852087-9 devstack@n-api.service[122433]: DEBUG neutronclient.v2_0.client [None req-a57f5e29-13a8-45b7-bedf-e2984213d22b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 229ed710-e4a3-42c6-8d9d-0e5c9398a133 does not exist", "detail": ""}} {{(pid=122433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 12:43:05.954133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.security_group_api [None req-a57f5e29-13a8-45b7-bedf-e2984213d22b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Neutron security group 229ed710-e4a3-42c6-8d9d-0e5c9398a133 not found {{(pid=122433) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 12:43:05.954479 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-a57f5e29-13a8-45b7-bedf-e2984213d22b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] HTTP exception thrown: Security group 229ed710-e4a3-42c6-8d9d-0e5c9398a133 does not exist Sep 07 12:43:05.954479 n-d-852087-9 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-09a3d43d-687d-44d8-acb5-485b579e273f'] Sep 07 12:43:05.958304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a57f5e29-13a8-45b7-bedf-e2984213d22b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Request method failure captured: Sep 07 12:43:05.958304 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-security-groups/229ed710-e4a3-42c6-8d9d-0e5c9398a133 HTTP/1.1 Sep 07 12:43:05.958304 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:43:05.958304 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:43:05.958304 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:43:05.958304 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:43:05.958304 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:43:05.958304 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:43:05.958304 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:43:05.958304 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:43:05.958304 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJGWMXgN7OdrmO70X8q48ZD-kObLPYOd01ANus8JY-PK7OjbvYCQ097-aKOdLEd3zX6imftUV9BBkR8dj8xCIWAm9yYmlnMVOTu04sxm_YJiyi8RzROPFAn0FZkGq3OAzdh-65OtDl9f1F4UEDEA_AaJuKK-hToemYtm-2HEdw2FTvo Sep 07 12:43:05.958304 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:43:05.958304 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:43:05.958304 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:43:05.958304 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:43:05.958304 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:43:05.958304 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:43:05.958304 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:43:05.958304 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:43:05.958304 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:43:05.958304 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:43:05.959908 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:43:05.959908 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:43:05.959908 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:43:05.959908 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:43:05.959908 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:43:05.959908 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:43:05.959908 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:43:05.959908 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6c7fac0664f044168f52e7c1a982c48e Sep 07 12:43:05.959908 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:43:05.959908 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:43:05.959908 n-d-852087-9 devstack@n-api.service[122433]: exception: Security group 229ed710-e4a3-42c6-8d9d-0e5c9398a133 does not exist Sep 07 12:43:05.959908 n-d-852087-9 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-09a3d43d-687d-44d8-acb5-485b579e273f'] Sep 07 12:43:05.959908 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '229ed710-e4a3-42c6-8d9d-0e5c9398a133'} Sep 07 12:43:05.960824 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:43:05.960824 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:05.960824 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 12:43:05.960824 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 12:43:05.960824 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:43:05.960824 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:43:05.960824 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 12:43:05.960824 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 12:43:05.960824 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:43:05.960824 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:43:05.960824 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 12:43:05.960824 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 12:43:05.960824 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:43:05.960824 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:43:05.960824 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 12:43:05.960824 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 12:43:05.960824 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:43:05.960824 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:43:05.960824 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 12:43:05.962048 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 12:43:05.962048 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:43:05.962048 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:43:05.962048 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 12:43:05.962048 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 12:43:05.962048 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 12:43:05.962048 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 12:43:05.962048 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 229ed710-e4a3-42c6-8d9d-0e5c9398a133 does not exist Sep 07 12:43:05.962048 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09a3d43d-687d-44d8-acb5-485b579e273f'] Sep 07 12:43:05.962048 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:05.962048 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:05.962048 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:05.962048 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:05.962048 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 07 12:43:05.962048 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 12:43:05.962048 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 12:43:05.962048 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 12:43:05.962048 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 229ed710-e4a3-42c6-8d9d-0e5c9398a133 does not exist Sep 07 12:43:05.963314 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09a3d43d-687d-44d8-acb5-485b579e273f'] Sep 07 12:43:05.963314 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:05.963314 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:05.963314 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:05.963314 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:05.963314 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:05.963314 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:05.963314 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:43:05.963314 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:43:05.963314 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:43:05.963314 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:43:05.963314 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:43:05.963314 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:43:05.963314 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 07 12:43:05.963314 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 12:43:05.963314 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 229ed710-e4a3-42c6-8d9d-0e5c9398a133 does not exist Sep 07 12:43:05.963314 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09a3d43d-687d-44d8-acb5-485b579e273f'] Sep 07 12:43:05.963314 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:05.963314 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:05.963314 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:05.963314 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:05.965781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:05.965781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:05.965781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:43:05.965781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:43:05.965781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 229ed710-e4a3-42c6-8d9d-0e5c9398a133 does not exist Sep 07 12:43:05.965781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09a3d43d-687d-44d8-acb5-485b579e273f'] Sep 07 12:43:05.965781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:05.967960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a57f5e29-13a8-45b7-bedf-e2984213d22b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Returning 404 to user: Security group 229ed710-e4a3-42c6-8d9d-0e5c9398a133 does not exist Sep 07 12:43:05.967960 n-d-852087-9 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-09a3d43d-687d-44d8-acb5-485b579e273f'] {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:43:05.969166 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a57f5e29-13a8-45b7-bedf-e2984213d22b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/229ed710-e4a3-42c6-8d9d-0e5c9398a133" status: 404 len: 194 microversion: 2.1 time: 0.160206 Sep 07 12:43:05.973561 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1366/2765] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Sep 7 12:43:05 2022] GET /compute/v2.1/os-security-groups/229ed710-e4a3-42c6-8d9d-0e5c9398a133 => generated 194 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:43:05.979558 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-82c2d76f-62dd-4bff-bb3c-25c19c6fec78 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:05.980451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-82c2d76f-62dd-4bff-bb3c-25c19c6fec78 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:05.988557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82c2d76f-62dd-4bff-bb3c-25c19c6fec78 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:05.989615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82c2d76f-62dd-4bff-bb3c-25c19c6fec78 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:05.990238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82c2d76f-62dd-4bff-bb3c-25c19c6fec78 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:05.991142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82c2d76f-62dd-4bff-bb3c-25c19c6fec78 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:05.991792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82c2d76f-62dd-4bff-bb3c-25c19c6fec78 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:05.992234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82c2d76f-62dd-4bff-bb3c-25c19c6fec78 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:06.191109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2a382004-d1f1-49a1-a8ab-3450b6844c91 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51065729f69f4bfb8ab48d2c70d0ed55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12bd04061ca4c3795958b51739bbbdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:06.210946 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2a382004-d1f1-49a1-a8ab-3450b6844c91 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] 10.222.0.16 "GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6" status: 200 len: 1350 microversion: 2.1 time: 0.480900 Sep 07 12:43:06.211667 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1400/2766] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:05 2022] GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6 => generated 1350 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:06.217282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-19bec7bf-0c00-4838-86b9-065c78fe5389 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:06.218141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-19bec7bf-0c00-4838-86b9-065c78fe5389 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 825ead8a-aa8c-4402-80f7-749edc7d21c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:06.226708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19bec7bf-0c00-4838-86b9-065c78fe5389 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:06.227604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19bec7bf-0c00-4838-86b9-065c78fe5389 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:06.228191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19bec7bf-0c00-4838-86b9-065c78fe5389 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:06.229355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19bec7bf-0c00-4838-86b9-065c78fe5389 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:06.230053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19bec7bf-0c00-4838-86b9-065c78fe5389 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:06.230617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19bec7bf-0c00-4838-86b9-065c78fe5389 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:06.348204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-82c2d76f-62dd-4bff-bb3c-25c19c6fec78 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:06.356770 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-82c2d76f-62dd-4bff-bb3c-25c19c6fec78 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1511 microversion: 2.1 time: 0.381627 Sep 07 12:43:06.357368 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1367/2767] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:05 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1511 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:06.362140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-70325d83-ffa9-4015-b7f7-553dab991793 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:06.363028 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-70325d83-ffa9-4015-b7f7-553dab991793 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:06.370306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70325d83-ffa9-4015-b7f7-553dab991793 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:06.370944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70325d83-ffa9-4015-b7f7-553dab991793 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:06.371623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70325d83-ffa9-4015-b7f7-553dab991793 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:06.373261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70325d83-ffa9-4015-b7f7-553dab991793 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:06.373261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70325d83-ffa9-4015-b7f7-553dab991793 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:06.373609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70325d83-ffa9-4015-b7f7-553dab991793 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:06.411966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70325d83-ffa9-4015-b7f7-553dab991793 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:06.413048 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70325d83-ffa9-4015-b7f7-553dab991793 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:06.413048 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70325d83-ffa9-4015-b7f7-553dab991793 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:06.413462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-70325d83-ffa9-4015-b7f7-553dab991793 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lazy-loading 'fault' on Instance uuid 886a386f-a0cc-4d90-96ac-4e418ed43bce {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:43:06.575515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-70325d83-ffa9-4015-b7f7-553dab991793 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f493fa6856847b4ae7cc8eb997a14c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b06047717c4a5ca47ebc72587256fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:06.580253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:43:06.586418 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-70325d83-ffa9-4015-b7f7-553dab991793 tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce" status: 200 len: 1307 microversion: 2.1 time: 0.227846 Sep 07 12:43:06.587010 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1368/2768] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:06 2022] GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce => generated 1307 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:06.602809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-959413b4-0e0c-41fb-9d01-484f2ccf10e2 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Calling method '.version_select at 0x7fc4183f6a60>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:06.674276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-19bec7bf-0c00-4838-86b9-065c78fe5389 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:06.685365 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-19bec7bf-0c00-4838-86b9-065c78fe5389 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5" status: 200 len: 1317 microversion: 2.1 time: 0.472328 Sep 07 12:43:06.696403 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1401/2769] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:06 2022] GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5 => generated 1317 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:06.696403 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2689117e-ba36-400f-9b2b-0fd638bca7d1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:06.696403 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2689117e-ba36-400f-9b2b-0fd638bca7d1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 4bb43114-1042-49c5-b60c-2474dae9f021] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:06.700737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2689117e-ba36-400f-9b2b-0fd638bca7d1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:06.701247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2689117e-ba36-400f-9b2b-0fd638bca7d1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:06.701718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2689117e-ba36-400f-9b2b-0fd638bca7d1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:06.702650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2689117e-ba36-400f-9b2b-0fd638bca7d1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:06.703312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2689117e-ba36-400f-9b2b-0fd638bca7d1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:06.704075 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2689117e-ba36-400f-9b2b-0fd638bca7d1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:06.731665 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-959413b4-0e0c-41fb-9d01-484f2ccf10e2 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/fa3778c8-46cf-438d-8a01-baf0c675c36f" status: 200 len: 665 microversion: 2.1 time: 0.143547 Sep 07 12:43:06.741970 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1369/2770] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Sep 7 12:43:06 2022] GET /compute/v2.1/os-security-groups/fa3778c8-46cf-438d-8a01-baf0c675c36f => generated 665 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:06.747405 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-897aedcd-0068-4fb2-b0e4-f4e892cc8e16 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '.version_select at 0x7fc41851cdc0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:07.012021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2689117e-ba36-400f-9b2b-0fd638bca7d1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:07.023173 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2689117e-ba36-400f-9b2b-0fd638bca7d1 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021" status: 200 len: 1506 microversion: 2.1 time: 0.335771 Sep 07 12:43:07.024270 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1402/2771] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:06 2022] GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021 => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:07.030591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-50611524-295b-44ea-812d-2d6eabb6bf34 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Calling method '.version_select at 0x7fc419230af0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:07.181316 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-897aedcd-0068-4fb2-b0e4-f4e892cc8e16 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/af3c8754-5f67-41d0-b2a4-4c14d5e4972c" status: 202 len: 0 microversion: 2.1 time: 0.437789 Sep 07 12:43:07.187653 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1370/2772] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:43:06 2022] DELETE /compute/v2.1/os-security-groups/af3c8754-5f67-41d0-b2a4-4c14d5e4972c => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:43:07.190307 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d0357237-f782-45e3-b21d-8618c524a180 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:07.191236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d0357237-f782-45e3-b21d-8618c524a180 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:07.200879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0357237-f782-45e3-b21d-8618c524a180 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:07.201789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0357237-f782-45e3-b21d-8618c524a180 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:07.202549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0357237-f782-45e3-b21d-8618c524a180 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:07.204520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0357237-f782-45e3-b21d-8618c524a180 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:07.205380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0357237-f782-45e3-b21d-8618c524a180 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:07.206198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0357237-f782-45e3-b21d-8618c524a180 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:07.306837 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-50611524-295b-44ea-812d-2d6eabb6bf34 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/35103183-68b7-4ecd-8c82-c0db24a7d6da" status: 202 len: 0 microversion: 2.1 time: 0.280165 Sep 07 12:43:07.318169 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1403/2773] 10.222.0.16 () {58 vars in 1287 bytes} [Wed Sep 7 12:43:07 2022] DELETE /compute/v2.1/os-security-group-rules/35103183-68b7-4ecd-8c82-c0db24a7d6da => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:43:07.324635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8bcc7ec8-1726-4fb7-a270-19ee249baf35 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:07.325975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8bcc7ec8-1726-4fb7-a270-19ee249baf35 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: b847cba9-b245-4b45-b0bd-897d59ba9a67] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:07.343206 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bcc7ec8-1726-4fb7-a270-19ee249baf35 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:07.344248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bcc7ec8-1726-4fb7-a270-19ee249baf35 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:07.345377 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bcc7ec8-1726-4fb7-a270-19ee249baf35 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:07.347264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bcc7ec8-1726-4fb7-a270-19ee249baf35 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:07.348397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bcc7ec8-1726-4fb7-a270-19ee249baf35 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:07.349730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bcc7ec8-1726-4fb7-a270-19ee249baf35 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:07.576808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d0357237-f782-45e3-b21d-8618c524a180 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:07.593776 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d0357237-f782-45e3-b21d-8618c524a180 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1541 microversion: 2.1 time: 0.409430 Sep 07 12:43:07.606485 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1371/2774] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:07 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1541 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:07.623332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c52fd746-6c56-4ba8-9e2e-1639574264e7 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '.version_select at 0x7fc41840d9d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:07.647531 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8bcc7ec8-1726-4fb7-a270-19ee249baf35 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:07.655171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG neutronclient.v2_0.client [None req-c52fd746-6c56-4ba8-9e2e-1639574264e7 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group af3c8754-5f67-41d0-b2a4-4c14d5e4972c does not exist", "detail": ""}} {{(pid=122433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 12:43:07.656687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.security_group_api [None req-c52fd746-6c56-4ba8-9e2e-1639574264e7 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Neutron security group af3c8754-5f67-41d0-b2a4-4c14d5e4972c not found {{(pid=122433) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 12:43:07.657830 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-c52fd746-6c56-4ba8-9e2e-1639574264e7 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] HTTP exception thrown: Security group af3c8754-5f67-41d0-b2a4-4c14d5e4972c does not exist Sep 07 12:43:07.657830 n-d-852087-9 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-8616a622-2cdb-472c-a5bc-2d1bf679c39f'] Sep 07 12:43:07.661742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c52fd746-6c56-4ba8-9e2e-1639574264e7 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Request method failure captured: Sep 07 12:43:07.661742 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-security-groups/af3c8754-5f67-41d0-b2a4-4c14d5e4972c HTTP/1.1 Sep 07 12:43:07.661742 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:43:07.661742 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:43:07.661742 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:43:07.661742 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:43:07.661742 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:43:07.661742 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:43:07.661742 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:43:07.661742 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:43:07.661742 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJGWMXgN7OdrmO70X8q48ZD-kObLPYOd01ANus8JY-PK7OjbvYCQ097-aKOdLEd3zX6imftUV9BBkR8dj8xCIWAm9yYmlnMVOTu04sxm_YJiyi8RzROPFAn0FZkGq3OAzdh-65OtDl9f1F4UEDEA_AaJuKK-hToemYtm-2HEdw2FTvo Sep 07 12:43:07.661742 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:43:07.661742 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:43:07.661742 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:43:07.661742 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:43:07.661742 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:43:07.661742 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:43:07.661742 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:43:07.661742 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:43:07.661742 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:43:07.661742 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:43:07.663138 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:43:07.663138 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:43:07.663138 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:43:07.663138 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:43:07.663138 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:43:07.663138 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:43:07.663138 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:43:07.663138 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6c7fac0664f044168f52e7c1a982c48e Sep 07 12:43:07.663138 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:43:07.663138 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:43:07.663138 n-d-852087-9 devstack@n-api.service[122433]: exception: Security group af3c8754-5f67-41d0-b2a4-4c14d5e4972c does not exist Sep 07 12:43:07.663138 n-d-852087-9 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-8616a622-2cdb-472c-a5bc-2d1bf679c39f'] Sep 07 12:43:07.663138 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'af3c8754-5f67-41d0-b2a4-4c14d5e4972c'} Sep 07 12:43:07.664133 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:43:07.664133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:07.664133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 12:43:07.664133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 12:43:07.664133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:43:07.664133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:43:07.664133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 12:43:07.664133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 12:43:07.664133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:43:07.664133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:43:07.664133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 12:43:07.664133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 12:43:07.664133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:43:07.664133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:43:07.664133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 12:43:07.664133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 12:43:07.664133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:43:07.664133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:43:07.664133 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 12:43:07.665605 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 12:43:07.665605 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:43:07.665605 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:43:07.665605 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 12:43:07.665605 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 12:43:07.665605 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 12:43:07.665605 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 12:43:07.665605 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group af3c8754-5f67-41d0-b2a4-4c14d5e4972c does not exist Sep 07 12:43:07.665605 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8616a622-2cdb-472c-a5bc-2d1bf679c39f'] Sep 07 12:43:07.665605 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:07.665605 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:07.665605 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:07.665605 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:07.665605 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 07 12:43:07.665605 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 12:43:07.665605 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 12:43:07.665605 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 12:43:07.665605 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group af3c8754-5f67-41d0-b2a4-4c14d5e4972c does not exist Sep 07 12:43:07.670897 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8616a622-2cdb-472c-a5bc-2d1bf679c39f'] Sep 07 12:43:07.670897 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:07.670897 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:07.670897 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:07.670897 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:07.670897 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:07.670897 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:07.670897 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:43:07.670897 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:43:07.670897 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:43:07.670897 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:43:07.670897 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:43:07.670897 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:43:07.670897 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 07 12:43:07.670897 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 12:43:07.670897 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group af3c8754-5f67-41d0-b2a4-4c14d5e4972c does not exist Sep 07 12:43:07.670897 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8616a622-2cdb-472c-a5bc-2d1bf679c39f'] Sep 07 12:43:07.670897 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:07.670897 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:07.670897 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:07.670897 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:07.672488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:07.672488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:07.672488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:43:07.672488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:43:07.672488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group af3c8754-5f67-41d0-b2a4-4c14d5e4972c does not exist Sep 07 12:43:07.672488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8616a622-2cdb-472c-a5bc-2d1bf679c39f'] Sep 07 12:43:07.672488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:07.673004 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8bcc7ec8-1726-4fb7-a270-19ee249baf35 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/b847cba9-b245-4b45-b0bd-897d59ba9a67" status: 200 len: 1317 microversion: 2.1 time: 0.349191 Sep 07 12:43:07.673107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c52fd746-6c56-4ba8-9e2e-1639574264e7 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Returning 404 to user: Security group af3c8754-5f67-41d0-b2a4-4c14d5e4972c does not exist Sep 07 12:43:07.673107 n-d-852087-9 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-8616a622-2cdb-472c-a5bc-2d1bf679c39f'] {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:43:07.673278 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1404/2775] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:07 2022] GET /compute/v2.1/servers/b847cba9-b245-4b45-b0bd-897d59ba9a67 => generated 1317 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:07.673374 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c52fd746-6c56-4ba8-9e2e-1639574264e7 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/af3c8754-5f67-41d0-b2a4-4c14d5e4972c" status: 404 len: 194 microversion: 2.1 time: 0.056850 Sep 07 12:43:07.673374 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1372/2776] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Sep 7 12:43:07 2022] GET /compute/v2.1/os-security-groups/af3c8754-5f67-41d0-b2a4-4c14d5e4972c => generated 194 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:43:07.676152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-353fe94c-ec0d-41f2-98b2-cbe49d6587c6 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Calling method '.version_select at 0x7fc4183f6310>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:07.679126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-73f26a79-d396-4a4d-aa19-8481e6a9aa4c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:07.680710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-73f26a79-d396-4a4d-aa19-8481e6a9aa4c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] [instance: b017ea78-874a-4e91-933a-716e254275a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:07.693758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73f26a79-d396-4a4d-aa19-8481e6a9aa4c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:07.694832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73f26a79-d396-4a4d-aa19-8481e6a9aa4c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:07.695673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73f26a79-d396-4a4d-aa19-8481e6a9aa4c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:07.696786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73f26a79-d396-4a4d-aa19-8481e6a9aa4c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:07.697543 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73f26a79-d396-4a4d-aa19-8481e6a9aa4c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:07.698224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73f26a79-d396-4a4d-aa19-8481e6a9aa4c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:08.039059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-73f26a79-d396-4a4d-aa19-8481e6a9aa4c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51065729f69f4bfb8ab48d2c70d0ed55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12bd04061ca4c3795958b51739bbbdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:08.049418 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-73f26a79-d396-4a4d-aa19-8481e6a9aa4c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] 10.222.0.16 "GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6" status: 200 len: 1350 microversion: 2.1 time: 0.382205 Sep 07 12:43:08.050229 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1405/2777] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:07 2022] GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6 => generated 1350 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:08.055881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-86f69ef5-12f3-49b8-804c-ded2b9fa341b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:08.056643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-86f69ef5-12f3-49b8-804c-ded2b9fa341b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:08.063343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86f69ef5-12f3-49b8-804c-ded2b9fa341b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:08.064379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86f69ef5-12f3-49b8-804c-ded2b9fa341b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:08.065051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86f69ef5-12f3-49b8-804c-ded2b9fa341b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:08.066067 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86f69ef5-12f3-49b8-804c-ded2b9fa341b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:08.066601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86f69ef5-12f3-49b8-804c-ded2b9fa341b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:08.067096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86f69ef5-12f3-49b8-804c-ded2b9fa341b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:08.173955 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-353fe94c-ec0d-41f2-98b2-cbe49d6587c6 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/fa3778c8-46cf-438d-8a01-baf0c675c36f" status: 202 len: 0 microversion: 2.1 time: 0.506320 Sep 07 12:43:08.178040 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1373/2778] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:43:07 2022] DELETE /compute/v2.1/os-security-groups/fa3778c8-46cf-438d-8a01-baf0c675c36f => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:43:08.184662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e0b7d686-548c-4a76-9970-6f1a99b5839e tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:08.186288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e0b7d686-548c-4a76-9970-6f1a99b5839e tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] [instance: 886a386f-a0cc-4d90-96ac-4e418ed43bce] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:08.194424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0b7d686-548c-4a76-9970-6f1a99b5839e tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:08.195463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0b7d686-548c-4a76-9970-6f1a99b5839e tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:08.196070 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0b7d686-548c-4a76-9970-6f1a99b5839e tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:08.197073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0b7d686-548c-4a76-9970-6f1a99b5839e tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:08.197816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0b7d686-548c-4a76-9970-6f1a99b5839e tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:08.198431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0b7d686-548c-4a76-9970-6f1a99b5839e tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:08.225185 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-e0b7d686-548c-4a76-9970-6f1a99b5839e tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] HTTP exception thrown: Instance 886a386f-a0cc-4d90-96ac-4e418ed43bce could not be found. Sep 07 12:43:08.227509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e0b7d686-548c-4a76-9970-6f1a99b5839e tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Request method failure captured: Sep 07 12:43:08.227509 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce HTTP/1.1 Sep 07 12:43:08.227509 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:43:08.227509 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:43:08.227509 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:43:08.227509 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:43:08.227509 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:43:08.227509 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:43:08.227509 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:43:08.227509 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:43:08.227509 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJE1WjdtxxnraKMR3DarlN0QR-dibe-LhRzQb-ar-VHuiZ3i14nzPMAcroPGLDquTHY5bLsfAj8iU4LLW2vu5cFfUC4nEdYNbBmeuO7XMgGDD_pM2xwkKA_Rh7q7iryubrPCsQHv6bgbo-DjODTRXaYkSAeb7o1Un3DcfsLeVMe4XG8 Sep 07 12:43:08.227509 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:43:08.227509 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:43:08.227509 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:43:08.227509 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:43:08.227509 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:43:08.227509 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:43:08.227509 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: d9b06047717c4a5ca47ebc72587256fb Sep 07 12:43:08.227509 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesOneServerTestJSON-2023066662 Sep 07 12:43:08.227509 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:43:08.227509 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:43:08.229099 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9b06047717c4a5ca47ebc72587256fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d9b06047717c4a5ca47ebc72587256fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d9b06047717c4a5ca47ebc72587256fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9b06047717c4a5ca47ebc72587256fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:43:08.229099 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesOneServerTestJSON-2023066662 Sep 07 12:43:08.229099 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: d9b06047717c4a5ca47ebc72587256fb Sep 07 12:43:08.229099 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2023066662 Sep 07 12:43:08.229099 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ImagesOneServerTestJSON-2023066662-project Sep 07 12:43:08.229099 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:43:08.229099 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:43:08.229099 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6f493fa6856847b4ae7cc8eb997a14c7 Sep 07 12:43:08.229099 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesOneServerTestJSON-2023066662-project Sep 07 12:43:08.229099 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:43:08.229099 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 886a386f-a0cc-4d90-96ac-4e418ed43bce could not be found. Sep 07 12:43:08.229099 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '886a386f-a0cc-4d90-96ac-4e418ed43bce'} Sep 07 12:43:08.230056 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:43:08.230056 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:08.230056 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:43:08.230056 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:43:08.230056 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:43:08.230056 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:43:08.230056 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:43:08.230056 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:43:08.230056 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:43:08.230056 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:43:08.230056 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 886a386f-a0cc-4d90-96ac-4e418ed43bce could not be found. Sep 07 12:43:08.230056 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:08.230056 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:08.230056 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:08.230056 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:08.230056 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:08.230056 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:08.230056 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:43:08.230056 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:43:08.230056 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:43:08.231821 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:43:08.231821 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:43:08.231821 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:43:08.231821 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:43:08.231821 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:43:08.231821 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:43:08.231821 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:43:08.231821 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 886a386f-a0cc-4d90-96ac-4e418ed43bce could not be found. Sep 07 12:43:08.231821 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:08.231821 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:08.231821 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:08.231821 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:08.231821 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:08.231821 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:08.231821 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:43:08.231821 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:43:08.231821 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 886a386f-a0cc-4d90-96ac-4e418ed43bce could not be found. Sep 07 12:43:08.231821 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:08.233470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e0b7d686-548c-4a76-9970-6f1a99b5839e tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] Returning 404 to user: Instance 886a386f-a0cc-4d90-96ac-4e418ed43bce could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:43:08.234337 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e0b7d686-548c-4a76-9970-6f1a99b5839e tempest-ImagesOneServerTestJSON-2023066662 tempest-ImagesOneServerTestJSON-2023066662-project] 10.222.0.16 "GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce" status: 404 len: 111 microversion: 2.1 time: 0.052748 Sep 07 12:43:08.234693 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1374/2779] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:08 2022] GET /compute/v2.1/servers/886a386f-a0cc-4d90-96ac-4e418ed43bce => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:43:08.240211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-642df23a-5851-4d47-a8d6-265479098439 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '.version_select at 0x7fc41851cdc0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:08.268329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-86f69ef5-12f3-49b8-804c-ded2b9fa341b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:08.280576 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-86f69ef5-12f3-49b8-804c-ded2b9fa341b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1511 microversion: 2.1 time: 0.228997 Sep 07 12:43:08.281509 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1406/2780] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:08 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1511 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:08.286628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eb1fe8cd-e17d-4365-a8de-a4e157b86c14 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:08.287532 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eb1fe8cd-e17d-4365-a8de-a4e157b86c14 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 825ead8a-aa8c-4402-80f7-749edc7d21c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:08.294312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb1fe8cd-e17d-4365-a8de-a4e157b86c14 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:08.295221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb1fe8cd-e17d-4365-a8de-a4e157b86c14 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:08.295832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb1fe8cd-e17d-4365-a8de-a4e157b86c14 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:08.296740 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb1fe8cd-e17d-4365-a8de-a4e157b86c14 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:08.297428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb1fe8cd-e17d-4365-a8de-a4e157b86c14 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:08.298070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb1fe8cd-e17d-4365-a8de-a4e157b86c14 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:08.559943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eb1fe8cd-e17d-4365-a8de-a4e157b86c14 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:08.578326 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-642df23a-5851-4d47-a8d6-265479098439 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/a7c841db-a50b-4faa-a62b-543819247640" status: 202 len: 0 microversion: 2.1 time: 0.341758 Sep 07 12:43:08.581342 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1375/2781] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:43:08 2022] DELETE /compute/v2.1/os-security-groups/a7c841db-a50b-4faa-a62b-543819247640 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:43:08.594954 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eb1fe8cd-e17d-4365-a8de-a4e157b86c14 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5" status: 200 len: 1317 microversion: 2.1 time: 0.311547 Sep 07 12:43:08.596689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0b69bebd-fead-42b9-93ef-2fb4faf28eca req-747ba08b-563d-4fb5-bd15-627d95086c67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b017ea78-874a-4e91-933a-716e254275a6", "name": "network-vif-plugged", "status": "completed", "tag": "914cfc7f-b102-4403-ba5d-484c546bac81"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:08.604425 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1407/2782] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:08 2022] GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5 => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:08.613759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fb8b2f67-e7bd-41ab-bd88-7c17002e7d64 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Calling method '.version_select at 0x7fc41931a820>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:08.635856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0b69bebd-fead-42b9-93ef-2fb4faf28eca req-747ba08b-563d-4fb5-bd15-627d95086c67 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:08.636366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0b69bebd-fead-42b9-93ef-2fb4faf28eca req-747ba08b-563d-4fb5-bd15-627d95086c67 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:08.636856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0b69bebd-fead-42b9-93ef-2fb4faf28eca req-747ba08b-563d-4fb5-bd15-627d95086c67 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:08.652499 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0b69bebd-fead-42b9-93ef-2fb4faf28eca req-747ba08b-563d-4fb5-bd15-627d95086c67 service nova] Creating event network-vif-plugged:914cfc7f-b102-4403-ba5d-484c546bac81 for instance b017ea78-874a-4e91-933a-716e254275a6 on n-h2-852087-9 Sep 07 12:43:08.658697 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0b69bebd-fead-42b9-93ef-2fb4faf28eca req-747ba08b-563d-4fb5-bd15-627d95086c67 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075270 Sep 07 12:43:08.659379 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1376/2783] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:08.660734 n-d-852087-9 devstack@n-api.service[122432]: DEBUG neutronclient.v2_0.client [None req-fb8b2f67-e7bd-41ab-bd88-7c17002e7d64 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e56c8b9c-218e-417d-924a-8caf8fe8637d does not exist", "detail": ""}} {{(pid=122432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 12:43:08.662245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.security_group_api [None req-fb8b2f67-e7bd-41ab-bd88-7c17002e7d64 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Neutron security group e56c8b9c-218e-417d-924a-8caf8fe8637d not found {{(pid=122432) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 12:43:08.663333 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-fb8b2f67-e7bd-41ab-bd88-7c17002e7d64 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] HTTP exception thrown: Security group e56c8b9c-218e-417d-924a-8caf8fe8637d does not exist Sep 07 12:43:08.663333 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-533de288-6500-4d58-abe8-6a74ff843073'] Sep 07 12:43:08.665341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-86fbd176-2ae5-4cde-ba5b-432aea913a3b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '.version_select at 0x7fc4183e7a60>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:08.667383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fb8b2f67-e7bd-41ab-bd88-7c17002e7d64 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Request method failure captured: Sep 07 12:43:08.667383 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/os-security-groups/e56c8b9c-218e-417d-924a-8caf8fe8637d HTTP/1.1 Sep 07 12:43:08.667383 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:43:08.667383 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:43:08.667383 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:43:08.667383 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:43:08.667383 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:43:08.667383 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:43:08.667383 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:43:08.667383 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:43:08.667383 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJHA3JkTv1_WGAIPt--7jcaDlz3Y9TMC1FlhMMb4e_kJrjbi8DRr4EM1l3whkA-eiuN-aNgBJNcvOwe7UGB-PSD5aqgwYgBS-mHy8eKF8O9fW8-fBh3WwaWUyTe5f6FFQrwZo2SuD4sP3iHQTvWR-M42sFuAQSHMbUNo_J9XM3bv_ys Sep 07 12:43:08.667383 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:43:08.667383 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:43:08.667383 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:43:08.667383 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:43:08.667383 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:43:08.667383 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:43:08.667383 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: ca74c97ba0a8469488ca342e7dad88b3 Sep 07 12:43:08.667383 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1996574825 Sep 07 12:43:08.667383 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:43:08.667383 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:43:08.668819 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca74c97ba0a8469488ca342e7dad88b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ca74c97ba0a8469488ca342e7dad88b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ca74c97ba0a8469488ca342e7dad88b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca74c97ba0a8469488ca342e7dad88b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:43:08.668819 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1996574825 Sep 07 12:43:08.668819 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: ca74c97ba0a8469488ca342e7dad88b3 Sep 07 12:43:08.668819 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1996574825 Sep 07 12:43:08.668819 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-SecurityGroupRulesTestJSON-1996574825-project Sep 07 12:43:08.668819 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:43:08.668819 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:43:08.668819 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: a72c053633884118a592c877ad5a1a86 Sep 07 12:43:08.668819 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1996574825-project Sep 07 12:43:08.668819 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:43:08.668819 n-d-852087-9 devstack@n-api.service[122432]: exception: Security group e56c8b9c-218e-417d-924a-8caf8fe8637d does not exist Sep 07 12:43:08.668819 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-533de288-6500-4d58-abe8-6a74ff843073'] Sep 07 12:43:08.668819 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'e56c8b9c-218e-417d-924a-8caf8fe8637d'} Sep 07 12:43:08.669780 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:43:08.669780 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:08.669780 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 12:43:08.669780 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 12:43:08.669780 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:43:08.669780 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:43:08.669780 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 12:43:08.669780 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 12:43:08.669780 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:43:08.669780 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:43:08.669780 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 12:43:08.669780 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 12:43:08.669780 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:43:08.669780 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:43:08.669780 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 12:43:08.669780 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 12:43:08.669780 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:43:08.669780 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:43:08.669780 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 12:43:08.671050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 12:43:08.671050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:43:08.671050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:43:08.671050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 12:43:08.671050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 12:43:08.671050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 12:43:08.671050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 12:43:08.671050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e56c8b9c-218e-417d-924a-8caf8fe8637d does not exist Sep 07 12:43:08.671050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-533de288-6500-4d58-abe8-6a74ff843073'] Sep 07 12:43:08.671050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:08.671050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:08.671050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:08.671050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:08.671050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 07 12:43:08.671050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 12:43:08.671050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 12:43:08.671050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 12:43:08.671050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e56c8b9c-218e-417d-924a-8caf8fe8637d does not exist Sep 07 12:43:08.672266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-533de288-6500-4d58-abe8-6a74ff843073'] Sep 07 12:43:08.672266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:08.672266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:08.672266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:08.672266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:08.672266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:08.672266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:08.672266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:43:08.672266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:43:08.672266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:43:08.672266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:43:08.672266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:43:08.672266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:43:08.672266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 07 12:43:08.672266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 12:43:08.672266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e56c8b9c-218e-417d-924a-8caf8fe8637d does not exist Sep 07 12:43:08.672266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-533de288-6500-4d58-abe8-6a74ff843073'] Sep 07 12:43:08.672266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:08.672266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:08.672266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:08.672266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:08.673652 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:08.673652 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:08.673652 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:43:08.673652 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:43:08.673652 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e56c8b9c-218e-417d-924a-8caf8fe8637d does not exist Sep 07 12:43:08.673652 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-533de288-6500-4d58-abe8-6a74ff843073'] Sep 07 12:43:08.673652 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:08.673652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fb8b2f67-e7bd-41ab-bd88-7c17002e7d64 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Returning 404 to user: Security group e56c8b9c-218e-417d-924a-8caf8fe8637d does not exist Sep 07 12:43:08.673652 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-533de288-6500-4d58-abe8-6a74ff843073'] {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:43:08.673652 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fb8b2f67-e7bd-41ab-bd88-7c17002e7d64 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/e56c8b9c-218e-417d-924a-8caf8fe8637d" status: 404 len: 194 microversion: 2.1 time: 0.063394 Sep 07 12:43:08.676135 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1408/2784] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:43:08 2022] DELETE /compute/v2.1/os-security-groups/e56c8b9c-218e-417d-924a-8caf8fe8637d => generated 194 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:43:08.685903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9449c9c8-2a94-43bb-aa6a-02dbdd915775 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:08.687121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9449c9c8-2a94-43bb-aa6a-02dbdd915775 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:08.697096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG neutronclient.v2_0.client [None req-86fbd176-2ae5-4cde-ba5b-432aea913a3b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a7c841db-a50b-4faa-a62b-543819247640 does not exist", "detail": ""}} {{(pid=122433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 12:43:08.697942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.security_group_api [None req-86fbd176-2ae5-4cde-ba5b-432aea913a3b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Neutron security group a7c841db-a50b-4faa-a62b-543819247640 not found {{(pid=122433) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 12:43:08.698571 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-86fbd176-2ae5-4cde-ba5b-432aea913a3b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] HTTP exception thrown: Security group a7c841db-a50b-4faa-a62b-543819247640 does not exist Sep 07 12:43:08.698571 n-d-852087-9 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-fecdaef8-a106-4dbd-bc24-29fcb408c21a'] Sep 07 12:43:08.700128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9449c9c8-2a94-43bb-aa6a-02dbdd915775 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:08.700572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-86fbd176-2ae5-4cde-ba5b-432aea913a3b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Request method failure captured: Sep 07 12:43:08.700572 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-security-groups/a7c841db-a50b-4faa-a62b-543819247640 HTTP/1.1 Sep 07 12:43:08.700572 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:43:08.700572 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:43:08.700572 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:43:08.700572 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:43:08.700572 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:43:08.700572 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:43:08.700572 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:43:08.700572 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:43:08.700572 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJGWMXgN7OdrmO70X8q48ZD-kObLPYOd01ANus8JY-PK7OjbvYCQ097-aKOdLEd3zX6imftUV9BBkR8dj8xCIWAm9yYmlnMVOTu04sxm_YJiyi8RzROPFAn0FZkGq3OAzdh-65OtDl9f1F4UEDEA_AaJuKK-hToemYtm-2HEdw2FTvo Sep 07 12:43:08.700572 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:43:08.700572 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:43:08.700572 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:43:08.700572 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:43:08.700572 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:43:08.700572 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:43:08.700572 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:43:08.700572 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:43:08.700572 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:43:08.700572 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:43:08.702044 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:43:08.702044 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:43:08.702044 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:43:08.702044 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:43:08.702044 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:43:08.702044 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:43:08.702044 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:43:08.702044 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6c7fac0664f044168f52e7c1a982c48e Sep 07 12:43:08.702044 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:43:08.702044 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:43:08.702044 n-d-852087-9 devstack@n-api.service[122433]: exception: Security group a7c841db-a50b-4faa-a62b-543819247640 does not exist Sep 07 12:43:08.702044 n-d-852087-9 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-fecdaef8-a106-4dbd-bc24-29fcb408c21a'] Sep 07 12:43:08.702044 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'a7c841db-a50b-4faa-a62b-543819247640'} Sep 07 12:43:08.702888 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:43:08.702888 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:08.702888 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 12:43:08.702888 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 12:43:08.702888 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:43:08.702888 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:43:08.702888 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 12:43:08.702888 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 12:43:08.702888 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:43:08.702888 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:43:08.702888 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 12:43:08.702888 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 12:43:08.702888 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:43:08.702888 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:43:08.702888 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 12:43:08.702888 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 12:43:08.702888 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:43:08.702888 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:43:08.702888 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 12:43:08.705372 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 12:43:08.705372 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:43:08.705372 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:43:08.705372 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 12:43:08.705372 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 12:43:08.705372 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 12:43:08.705372 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 12:43:08.705372 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a7c841db-a50b-4faa-a62b-543819247640 does not exist Sep 07 12:43:08.705372 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fecdaef8-a106-4dbd-bc24-29fcb408c21a'] Sep 07 12:43:08.705372 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:08.705372 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:08.705372 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:08.705372 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:08.705372 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 07 12:43:08.705372 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 12:43:08.705372 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 12:43:08.705372 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 12:43:08.705372 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a7c841db-a50b-4faa-a62b-543819247640 does not exist Sep 07 12:43:08.707140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fecdaef8-a106-4dbd-bc24-29fcb408c21a'] Sep 07 12:43:08.707140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:08.707140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:08.707140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:08.707140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:08.707140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:08.707140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:08.707140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:43:08.707140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:43:08.707140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:43:08.707140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:43:08.707140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:43:08.707140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:43:08.707140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 07 12:43:08.707140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 12:43:08.707140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a7c841db-a50b-4faa-a62b-543819247640 does not exist Sep 07 12:43:08.707140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fecdaef8-a106-4dbd-bc24-29fcb408c21a'] Sep 07 12:43:08.707140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:08.707140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:08.707140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:08.707140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:08.710107 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:08.710107 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:08.710107 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:43:08.710107 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:43:08.710107 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a7c841db-a50b-4faa-a62b-543819247640 does not exist Sep 07 12:43:08.710107 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fecdaef8-a106-4dbd-bc24-29fcb408c21a'] Sep 07 12:43:08.710107 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:08.711387 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9449c9c8-2a94-43bb-aa6a-02dbdd915775 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:08.711569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-86fbd176-2ae5-4cde-ba5b-432aea913a3b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Returning 404 to user: Security group a7c841db-a50b-4faa-a62b-543819247640 does not exist Sep 07 12:43:08.711569 n-d-852087-9 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-fecdaef8-a106-4dbd-bc24-29fcb408c21a'] {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:43:08.711857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9449c9c8-2a94-43bb-aa6a-02dbdd915775 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:08.712005 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-86fbd176-2ae5-4cde-ba5b-432aea913a3b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/a7c841db-a50b-4faa-a62b-543819247640" status: 404 len: 194 microversion: 2.1 time: 0.041341 Sep 07 12:43:08.712143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9449c9c8-2a94-43bb-aa6a-02dbdd915775 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:08.712283 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1377/2785] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Sep 7 12:43:08 2022] GET /compute/v2.1/os-security-groups/a7c841db-a50b-4faa-a62b-543819247640 => generated 194 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:43:08.712419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9449c9c8-2a94-43bb-aa6a-02dbdd915775 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:08.712419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9449c9c8-2a94-43bb-aa6a-02dbdd915775 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:08.712720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1a95a620-5fd4-4757-8a59-dbee7a047803 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Calling method '.version_select at 0x7fc41850b550>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:09.096845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9449c9c8-2a94-43bb-aa6a-02dbdd915775 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:09.113110 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9449c9c8-2a94-43bb-aa6a-02dbdd915775 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1541 microversion: 2.1 time: 0.434961 Sep 07 12:43:09.114640 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1409/2786] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:08 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1541 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:09.125620 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ddff32c9-2dd1-48d8-9eed-81db53e367f2 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:09.127195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ddff32c9-2dd1-48d8-9eed-81db53e367f2 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: b847cba9-b245-4b45-b0bd-897d59ba9a67] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:09.136220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddff32c9-2dd1-48d8-9eed-81db53e367f2 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:09.136729 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddff32c9-2dd1-48d8-9eed-81db53e367f2 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:09.137181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddff32c9-2dd1-48d8-9eed-81db53e367f2 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:09.138780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddff32c9-2dd1-48d8-9eed-81db53e367f2 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:09.139258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddff32c9-2dd1-48d8-9eed-81db53e367f2 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:09.139692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddff32c9-2dd1-48d8-9eed-81db53e367f2 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:09.263881 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1a95a620-5fd4-4757-8a59-dbee7a047803 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/c18f693e-20f8-4a74-8c98-93feef6a7c71" status: 202 len: 0 microversion: 2.1 time: 0.558927 Sep 07 12:43:09.267255 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1378/2787] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:43:08 2022] DELETE /compute/v2.1/os-security-groups/c18f693e-20f8-4a74-8c98-93feef6a7c71 => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:43:09.274338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-02852c69-7439-46ad-a1e6-82aab4829dc9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '.version_select at 0x7fc418470280>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:09.408613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ddff32c9-2dd1-48d8-9eed-81db53e367f2 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:09.418610 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ddff32c9-2dd1-48d8-9eed-81db53e367f2 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/b847cba9-b245-4b45-b0bd-897d59ba9a67" status: 200 len: 1317 microversion: 2.1 time: 0.302141 Sep 07 12:43:09.419476 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1410/2788] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:09 2022] GET /compute/v2.1/servers/b847cba9-b245-4b45-b0bd-897d59ba9a67 => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:09.424740 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5e0d4743-a6d4-424e-9cab-ce9f7d702cb4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:09.425734 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5e0d4743-a6d4-424e-9cab-ce9f7d702cb4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] [instance: b017ea78-874a-4e91-933a-716e254275a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:09.433245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e0d4743-a6d4-424e-9cab-ce9f7d702cb4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:09.434013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e0d4743-a6d4-424e-9cab-ce9f7d702cb4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:09.434649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e0d4743-a6d4-424e-9cab-ce9f7d702cb4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:09.435609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e0d4743-a6d4-424e-9cab-ce9f7d702cb4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:09.436074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e0d4743-a6d4-424e-9cab-ce9f7d702cb4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:09.436694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e0d4743-a6d4-424e-9cab-ce9f7d702cb4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:09.584886 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-02852c69-7439-46ad-a1e6-82aab4829dc9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.316180 Sep 07 12:43:09.586234 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1379/2789] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Sep 7 12:43:09 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:09.592735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9496e721-efa2-4660-9a13-754c14443fcb tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Calling method '.version_select at 0x7fc4183fb430>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:09.653687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5e0d4743-a6d4-424e-9cab-ce9f7d702cb4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51065729f69f4bfb8ab48d2c70d0ed55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12bd04061ca4c3795958b51739bbbdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:09.662294 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5e0d4743-a6d4-424e-9cab-ce9f7d702cb4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] 10.222.0.16 "GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6" status: 200 len: 1350 microversion: 2.1 time: 0.241684 Sep 07 12:43:09.663485 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1411/2790] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:09 2022] GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6 => generated 1350 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:09.672357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5beb9a18-4b02-4ea0-90be-096021dee590 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:09.672996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5beb9a18-4b02-4ea0-90be-096021dee590 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:09.680548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5beb9a18-4b02-4ea0-90be-096021dee590 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:09.681558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5beb9a18-4b02-4ea0-90be-096021dee590 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:09.682971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5beb9a18-4b02-4ea0-90be-096021dee590 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:09.683873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5beb9a18-4b02-4ea0-90be-096021dee590 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:09.684350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5beb9a18-4b02-4ea0-90be-096021dee590 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:09.684787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5beb9a18-4b02-4ea0-90be-096021dee590 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:09.895102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5beb9a18-4b02-4ea0-90be-096021dee590 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:09.905233 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5beb9a18-4b02-4ea0-90be-096021dee590 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1511 microversion: 2.1 time: 0.240829 Sep 07 12:43:09.917757 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1412/2791] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:09 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1511 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:09.924670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ffc67017-99a8-4f3c-ae9b-d41e05df253a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Action: 'create', calling method: .version_select at 0x7fc41922f040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2119382530", "description": "tempest-description-700733058"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:09.952018 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9496e721-efa2-4660-9a13-754c14443fcb tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/96f22e24-13b4-4444-bf8b-aa23cd185599" status: 202 len: 0 microversion: 2.1 time: 0.364475 Sep 07 12:43:09.952841 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1380/2792] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:43:09 2022] DELETE /compute/v2.1/os-security-groups/96f22e24-13b4-4444-bf8b-aa23cd185599 => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:43:09.959276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e022ec4c-a4b0-4a17-b7fc-929cfac84313 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:09.959979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e022ec4c-a4b0-4a17-b7fc-929cfac84313 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 825ead8a-aa8c-4402-80f7-749edc7d21c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:09.968492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e022ec4c-a4b0-4a17-b7fc-929cfac84313 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:09.969354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e022ec4c-a4b0-4a17-b7fc-929cfac84313 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:09.970351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e022ec4c-a4b0-4a17-b7fc-929cfac84313 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:09.971089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e022ec4c-a4b0-4a17-b7fc-929cfac84313 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:09.971562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e022ec4c-a4b0-4a17-b7fc-929cfac84313 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:09.971993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e022ec4c-a4b0-4a17-b7fc-929cfac84313 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:10.212103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e022ec4c-a4b0-4a17-b7fc-929cfac84313 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:10.228113 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e022ec4c-a4b0-4a17-b7fc-929cfac84313 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5" status: 200 len: 1317 microversion: 2.1 time: 0.272681 Sep 07 12:43:10.230217 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1381/2793] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:09 2022] GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5 => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:10.237132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5a701de5-208a-4c1b-a4dc-7e9479c8fb79 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Calling method '.version_select at 0x7fc4183fbca0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:10.241223 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ffc67017-99a8-4f3c-ae9b-d41e05df253a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.321385 Sep 07 12:43:10.250484 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1413/2794] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Sep 7 12:43:09 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:10.255864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-60eee449-059c-4b72-bc4f-60a381341ce9 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:10.256517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-60eee449-059c-4b72-bc4f-60a381341ce9 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:10.275334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60eee449-059c-4b72-bc4f-60a381341ce9 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:10.275880 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60eee449-059c-4b72-bc4f-60a381341ce9 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:10.276340 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60eee449-059c-4b72-bc4f-60a381341ce9 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:10.277120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60eee449-059c-4b72-bc4f-60a381341ce9 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:10.277658 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60eee449-059c-4b72-bc4f-60a381341ce9 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:10.278095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60eee449-059c-4b72-bc4f-60a381341ce9 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:10.522736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-60eee449-059c-4b72-bc4f-60a381341ce9 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:10.533041 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-60eee449-059c-4b72-bc4f-60a381341ce9 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1541 microversion: 2.1 time: 0.281176 Sep 07 12:43:10.533790 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1414/2795] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:10 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1541 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:10.539682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-25ffd05b-1430-49de-906c-728f3e0c5bfd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Action: 'create', calling method: .version_select at 0x7fc4192f09d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-793911215", "description": "tempest-description-1517185763"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:10.688974 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5a701de5-208a-4c1b-a4dc-7e9479c8fb79 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/645df850-1485-449e-ad52-72ffb48c457e" status: 202 len: 0 microversion: 2.1 time: 0.456903 Sep 07 12:43:10.690089 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1382/2796] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:43:10 2022] DELETE /compute/v2.1/os-security-groups/645df850-1485-449e-ad52-72ffb48c457e => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:43:10.924160 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-25ffd05b-1430-49de-906c-728f3e0c5bfd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.388279 Sep 07 12:43:10.933707 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1415/2797] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Sep 7 12:43:10 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:10.947288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-79ad90db-cef0-4fb8-9342-d9eeddd01385 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:10.948066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-79ad90db-cef0-4fb8-9342-d9eeddd01385 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: b847cba9-b245-4b45-b0bd-897d59ba9a67] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:10.961941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79ad90db-cef0-4fb8-9342-d9eeddd01385 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:10.963690 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79ad90db-cef0-4fb8-9342-d9eeddd01385 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:10.965161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79ad90db-cef0-4fb8-9342-d9eeddd01385 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:10.966680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79ad90db-cef0-4fb8-9342-d9eeddd01385 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:10.967943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79ad90db-cef0-4fb8-9342-d9eeddd01385 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:10.968870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79ad90db-cef0-4fb8-9342-d9eeddd01385 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:11.013696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bb2393cd-a872-4644-83e8-3a73e76bac4b tempest-ListImageFiltersNegativeTestJSON-1460671240 tempest-ListImageFiltersNegativeTestJSON-1460671240-project] Calling method '.version_select at 0x7fc4183f65e0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:11.077139 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-bb2393cd-a872-4644-83e8-3a73e76bac4b tempest-ListImageFiltersNegativeTestJSON-1460671240 tempest-ListImageFiltersNegativeTestJSON-1460671240-project] HTTP exception thrown: Image not found. Sep 07 12:43:11.079706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bb2393cd-a872-4644-83e8-3a73e76bac4b tempest-ListImageFiltersNegativeTestJSON-1460671240 tempest-ListImageFiltersNegativeTestJSON-1460671240-project] Request method failure captured: Sep 07 12:43:11.079706 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/images/67caa56b-116a-461c-b188-5124164199cc HTTP/1.1 Sep 07 12:43:11.079706 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:43:11.079706 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:43:11.079706 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:43:11.079706 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:43:11.079706 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:43:11.079706 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:43:11.079706 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:43:11.079706 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:43:11.079706 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJHeoero8ATXC6Fco48lcfIpwhfSo_hI_Os33aE7J-jZ4f3HVhpHOPqnP0IRwyRL-co54IvHVGA0AdwPGCMUYmr9EO57CUv8R-GVmWquBYRNnOyWLYxrbUKWi7oWjFtAsTVZ6EVzW-ENq-_JW5xBqlCbPKHNVYeDZuw-cxni5dlFjgI Sep 07 12:43:11.079706 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:43:11.079706 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:43:11.079706 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:43:11.079706 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:43:11.079706 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:43:11.079706 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:43:11.079706 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: df4d4e930cc340648802d66519734b51 Sep 07 12:43:11.079706 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1460671240 Sep 07 12:43:11.079706 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:43:11.079706 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:43:11.081113 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/df4d4e930cc340648802d66519734b51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_df4d4e930cc340648802d66519734b51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/df4d4e930cc340648802d66519734b51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/df4d4e930cc340648802d66519734b51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:43:11.081113 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1460671240 Sep 07 12:43:11.081113 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: df4d4e930cc340648802d66519734b51 Sep 07 12:43:11.081113 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1460671240 Sep 07 12:43:11.081113 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ListImageFiltersNegativeTestJSON-1460671240-project Sep 07 12:43:11.081113 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:43:11.081113 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:43:11.081113 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 233b13d9f29144459c5d14ea83e16afa Sep 07 12:43:11.081113 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1460671240-project Sep 07 12:43:11.081113 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:43:11.081113 n-d-852087-9 devstack@n-api.service[122433]: exception: Image not found. Sep 07 12:43:11.081113 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '67caa56b-116a-461c-b188-5124164199cc'} Sep 07 12:43:11.081113 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:43:11.082026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:11.082026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 12:43:11.082026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 12:43:11.082026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:43:11.082026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:43:11.082026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 12:43:11.082026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 12:43:11.082026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:43:11.082026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:43:11.082026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 12:43:11.082026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 12:43:11.082026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 12:43:11.082026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 12:43:11.082026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:43:11.082026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:43:11.082026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:43:11.082026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:43:11.082026 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 67caa56b-116a-461c-b188-5124164199cc Sep 07 12:43:11.083567 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:11.083567 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:11.083567 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:11.083567 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:11.083567 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 07 12:43:11.083567 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 07 12:43:11.083567 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 07 12:43:11.083567 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 07 12:43:11.083567 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 07 12:43:11.083567 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 07 12:43:11.083567 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 07 12:43:11.083567 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 07 12:43:11.083567 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 12:43:11.083567 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 12:43:11.083567 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:43:11.083567 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:43:11.083567 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 12:43:11.083567 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 12:43:11.083567 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:43:11.083567 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:43:11.085621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 12:43:11.085621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 12:43:11.085621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 12:43:11.085621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 12:43:11.085621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:43:11.085621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:43:11.085621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:43:11.085621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:43:11.085621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 67caa56b-116a-461c-b188-5124164199cc could not be found. Sep 07 12:43:11.085621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:11.085621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:11.085621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:11.085621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:11.085621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:11.085621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:11.085621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:43:11.085621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:43:11.085621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:43:11.085621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:43:11.087142 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:43:11.087142 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:43:11.087142 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 07 12:43:11.087142 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 12:43:11.087142 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 12:43:11.087142 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:11.087142 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:11.087142 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:11.087142 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:11.087142 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:11.087142 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:11.087142 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:43:11.087142 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:43:11.087142 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 12:43:11.087142 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:11.087142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bb2393cd-a872-4644-83e8-3a73e76bac4b tempest-ListImageFiltersNegativeTestJSON-1460671240 tempest-ListImageFiltersNegativeTestJSON-1460671240-project] Returning 404 to user: Image not found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:43:11.088610 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bb2393cd-a872-4644-83e8-3a73e76bac4b tempest-ListImageFiltersNegativeTestJSON-1460671240 tempest-ListImageFiltersNegativeTestJSON-1460671240-project] 10.222.0.16 "GET /compute/v2.1/images/67caa56b-116a-461c-b188-5124164199cc" status: 404 len: 62 microversion: 2.1 time: 0.389590 Sep 07 12:43:11.088610 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1383/2798] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:43:10 2022] GET /compute/v2.1/images/67caa56b-116a-461c-b188-5124164199cc => generated 62 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:43:11.097256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-db558c85-8f5a-400e-b3cd-75058b80afaf req-3777cc2d-5e02-4e55-834b-1df09471c065 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b847cba9-b245-4b45-b0bd-897d59ba9a67", "name": "network-vif-plugged", "status": "completed", "tag": "21e4d80d-0a18-4cd6-898c-dfdd13455bca"}, {"server_uuid": "825ead8a-aa8c-4402-80f7-749edc7d21c5", "name": "network-vif-plugged", "status": "completed", "tag": "97742b1d-4f2e-4907-8288-3d2750b5f23d"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:11.121382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-db558c85-8f5a-400e-b3cd-75058b80afaf req-3777cc2d-5e02-4e55-834b-1df09471c065 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:11.121937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-db558c85-8f5a-400e-b3cd-75058b80afaf req-3777cc2d-5e02-4e55-834b-1df09471c065 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:11.122382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-db558c85-8f5a-400e-b3cd-75058b80afaf req-3777cc2d-5e02-4e55-834b-1df09471c065 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:11.151851 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-db558c85-8f5a-400e-b3cd-75058b80afaf req-3777cc2d-5e02-4e55-834b-1df09471c065 service nova] Creating event network-vif-plugged:21e4d80d-0a18-4cd6-898c-dfdd13455bca for instance b847cba9-b245-4b45-b0bd-897d59ba9a67 on n-h1-852087-9 Sep 07 12:43:11.152407 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-db558c85-8f5a-400e-b3cd-75058b80afaf req-3777cc2d-5e02-4e55-834b-1df09471c065 service nova] Creating event network-vif-plugged:97742b1d-4f2e-4907-8288-3d2750b5f23d for instance 825ead8a-aa8c-4402-80f7-749edc7d21c5 on n-h2-852087-9 Sep 07 12:43:11.168313 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-db558c85-8f5a-400e-b3cd-75058b80afaf req-3777cc2d-5e02-4e55-834b-1df09471c065 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.079388 Sep 07 12:43:11.170993 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1384/2799] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:11.178983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a7f7296a-eb51-42e5-b963-3526027a8f6c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:11.180613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a7f7296a-eb51-42e5-b963-3526027a8f6c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] [instance: b017ea78-874a-4e91-933a-716e254275a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:11.190119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7f7296a-eb51-42e5-b963-3526027a8f6c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:11.190876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7f7296a-eb51-42e5-b963-3526027a8f6c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:11.192033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7f7296a-eb51-42e5-b963-3526027a8f6c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:11.192957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7f7296a-eb51-42e5-b963-3526027a8f6c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:11.193621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7f7296a-eb51-42e5-b963-3526027a8f6c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:11.194373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7f7296a-eb51-42e5-b963-3526027a8f6c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:11.244483 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-79ad90db-cef0-4fb8-9342-d9eeddd01385 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:11.247796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:43:11.265411 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-79ad90db-cef0-4fb8-9342-d9eeddd01385 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/b847cba9-b245-4b45-b0bd-897d59ba9a67" status: 200 len: 1317 microversion: 2.1 time: 0.329932 Sep 07 12:43:11.283060 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1416/2800] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:10 2022] GET /compute/v2.1/servers/b847cba9-b245-4b45-b0bd-897d59ba9a67 => generated 1317 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:11.291401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0f4c4be0-752c-4411-b63d-eaca20585583 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Calling method '.version_select at 0x7fc418542310>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:11.533914 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a7f7296a-eb51-42e5-b963-3526027a8f6c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51065729f69f4bfb8ab48d2c70d0ed55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12bd04061ca4c3795958b51739bbbdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:11.546058 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a7f7296a-eb51-42e5-b963-3526027a8f6c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] 10.222.0.16 "GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6" status: 200 len: 1539 microversion: 2.1 time: 0.372295 Sep 07 12:43:11.558784 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1385/2801] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:11 2022] GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6 => generated 1539 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:11.589077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8013ca07-5311-4ce1-aa98-83aecd35242c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:11.590073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8013ca07-5311-4ce1-aa98-83aecd35242c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:11.602608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8013ca07-5311-4ce1-aa98-83aecd35242c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:11.603410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8013ca07-5311-4ce1-aa98-83aecd35242c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:11.604138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8013ca07-5311-4ce1-aa98-83aecd35242c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:11.605188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8013ca07-5311-4ce1-aa98-83aecd35242c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:11.605953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8013ca07-5311-4ce1-aa98-83aecd35242c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:11.606574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8013ca07-5311-4ce1-aa98-83aecd35242c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:11.873951 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0f4c4be0-752c-4411-b63d-eaca20585583 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/6b489915-0f9b-4f1d-a285-a5a0f812790c" status: 202 len: 0 microversion: 2.1 time: 0.588910 Sep 07 12:43:11.874800 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1417/2802] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:43:11 2022] DELETE /compute/v2.1/os-security-groups/6b489915-0f9b-4f1d-a285-a5a0f812790c => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:43:11.883313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-20754ec6-e2d7-4bed-95b0-8ce85a540aee tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-259826645", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "cb511943-70f2-41d3-b932-6332864944b8"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:11.890644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8013ca07-5311-4ce1-aa98-83aecd35242c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:11.912848 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8013ca07-5311-4ce1-aa98-83aecd35242c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1511 microversion: 2.1 time: 0.350534 Sep 07 12:43:11.917438 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1386/2803] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:11 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1511 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:11.937429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-145dbd5b-ae06-4e8d-b9ce-882f4e12810d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:11.939364 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-145dbd5b-ae06-4e8d-b9ce-882f4e12810d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 825ead8a-aa8c-4402-80f7-749edc7d21c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:11.955168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-145dbd5b-ae06-4e8d-b9ce-882f4e12810d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:11.956054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-145dbd5b-ae06-4e8d-b9ce-882f4e12810d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:11.956627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-145dbd5b-ae06-4e8d-b9ce-882f4e12810d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:11.958256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-145dbd5b-ae06-4e8d-b9ce-882f4e12810d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:11.959319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-145dbd5b-ae06-4e8d-b9ce-882f4e12810d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:11.960084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-145dbd5b-ae06-4e8d-b9ce-882f4e12810d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:12.012297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-20754ec6-e2d7-4bed-95b0-8ce85a540aee tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] validate_networks() for [('cb511943-70f2-41d3-b932-6332864944b8', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:43:12.227338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-145dbd5b-ae06-4e8d-b9ce-882f4e12810d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:12.237424 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-145dbd5b-ae06-4e8d-b9ce-882f4e12810d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5" status: 200 len: 1317 microversion: 2.1 time: 0.316954 Sep 07 12:43:12.238121 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1387/2804] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:11 2022] GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5 => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:12.244160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1f21da20-4887-4579-8be7-f686efddb379 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:12.245086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1f21da20-4887-4579-8be7-f686efddb379 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:12.251526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:43:12.253999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f21da20-4887-4579-8be7-f686efddb379 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:12.258262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f21da20-4887-4579-8be7-f686efddb379 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:12.258858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f21da20-4887-4579-8be7-f686efddb379 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:12.259959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f21da20-4887-4579-8be7-f686efddb379 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:12.260381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f21da20-4887-4579-8be7-f686efddb379 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:12.260842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f21da20-4887-4579-8be7-f686efddb379 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:12.590949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1f21da20-4887-4579-8be7-f686efddb379 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:12.605096 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1f21da20-4887-4579-8be7-f686efddb379 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1536 microversion: 2.1 time: 0.365562 Sep 07 12:43:12.606136 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1388/2805] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:12 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1536 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:12.613663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dbcf77ef-2bf0-423f-b738-b8e2257f076c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:12.615113 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dbcf77ef-2bf0-423f-b738-b8e2257f076c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] [instance: b017ea78-874a-4e91-933a-716e254275a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:12.627493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dbcf77ef-2bf0-423f-b738-b8e2257f076c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:12.628959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dbcf77ef-2bf0-423f-b738-b8e2257f076c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:12.630007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dbcf77ef-2bf0-423f-b738-b8e2257f076c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:12.631387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dbcf77ef-2bf0-423f-b738-b8e2257f076c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:12.632639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dbcf77ef-2bf0-423f-b738-b8e2257f076c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:12.633804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dbcf77ef-2bf0-423f-b738-b8e2257f076c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:12.779467 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dbcf77ef-2bf0-423f-b738-b8e2257f076c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] 10.222.0.16 "GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.171462 Sep 07 12:43:12.781426 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1389/2806] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Sep 7 12:43:12 2022] GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6/os-interface => generated 284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:12.792485 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-686801df-5884-42d5-9f95-1f5b08ee4a15 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] Calling method '.version_select at 0x7fc4183e7820>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:12.800792 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-20754ec6-e2d7-4bed-95b0-8ce85a540aee tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:43:12.801407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-20754ec6-e2d7-4bed-95b0-8ce85a540aee tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:43:12.802145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-20754ec6-e2d7-4bed-95b0-8ce85a540aee tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:43:12.802997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-20754ec6-e2d7-4bed-95b0-8ce85a540aee tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:43:12.803526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-20754ec6-e2d7-4bed-95b0-8ce85a540aee tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:43:12.815780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20754ec6-e2d7-4bed-95b0-8ce85a540aee tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:12.816697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20754ec6-e2d7-4bed-95b0-8ce85a540aee tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:12.817614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20754ec6-e2d7-4bed-95b0-8ce85a540aee tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:12.818984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20754ec6-e2d7-4bed-95b0-8ce85a540aee tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:12.819729 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20754ec6-e2d7-4bed-95b0-8ce85a540aee tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:12.820390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20754ec6-e2d7-4bed-95b0-8ce85a540aee tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:12.852223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-20754ec6-e2d7-4bed-95b0-8ce85a540aee tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Getting quotas for project 6d6d8398313f4738bd1d9b6cd1ea93a7. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:43:12.860916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-20754ec6-e2d7-4bed-95b0-8ce85a540aee tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Getting quotas for user 6c7fac0664f044168f52e7c1a982c48e and project 6d6d8398313f4738bd1d9b6cd1ea93a7. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:43:12.893523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-20754ec6-e2d7-4bed-95b0-8ce85a540aee tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:43:12.900011 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-20754ec6-e2d7-4bed-95b0-8ce85a540aee tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:43:13.035563 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-20754ec6-e2d7-4bed-95b0-8ce85a540aee tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.158108 Sep 07 12:43:13.036961 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1418/2807] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:43:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:43:13.050283 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-686f63da-326e-4227-bcac-7aec8e92a8c0 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:13.053305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-686f63da-326e-4227-bcac-7aec8e92a8c0 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: b847cba9-b245-4b45-b0bd-897d59ba9a67] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:13.068919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-686f63da-326e-4227-bcac-7aec8e92a8c0 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:13.076100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-686f63da-326e-4227-bcac-7aec8e92a8c0 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:13.082146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-686f63da-326e-4227-bcac-7aec8e92a8c0 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:13.083538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-686f63da-326e-4227-bcac-7aec8e92a8c0 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:13.086951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-686f63da-326e-4227-bcac-7aec8e92a8c0 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:13.088247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-686f63da-326e-4227-bcac-7aec8e92a8c0 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:13.507616 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-686801df-5884-42d5-9f95-1f5b08ee4a15 tempest-SecurityGroupRulesTestJSON-1996574825 tempest-SecurityGroupRulesTestJSON-1996574825-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/ff6e09b6-7080-4404-ae65-428b4e46c21e" status: 202 len: 0 microversion: 2.1 time: 0.723523 Sep 07 12:43:13.509351 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1390/2808] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:43:12 2022] DELETE /compute/v2.1/os-security-groups/ff6e09b6-7080-4404-ae65-428b4e46c21e => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:43:13.517113 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a70c76d8-31a2-44d6-9755-7867e65830d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:13.518392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a70c76d8-31a2-44d6-9755-7867e65830d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:13.535949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a70c76d8-31a2-44d6-9755-7867e65830d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:13.536545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a70c76d8-31a2-44d6-9755-7867e65830d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:13.537049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a70c76d8-31a2-44d6-9755-7867e65830d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:13.537961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a70c76d8-31a2-44d6-9755-7867e65830d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:13.538456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a70c76d8-31a2-44d6-9755-7867e65830d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:13.540703 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-686f63da-326e-4227-bcac-7aec8e92a8c0 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:13.545288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a70c76d8-31a2-44d6-9755-7867e65830d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:13.594879 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-686f63da-326e-4227-bcac-7aec8e92a8c0 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/b847cba9-b245-4b45-b0bd-897d59ba9a67" status: 200 len: 1317 microversion: 2.1 time: 0.555373 Sep 07 12:43:13.600529 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1419/2809] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:13 2022] GET /compute/v2.1/servers/b847cba9-b245-4b45-b0bd-897d59ba9a67 => generated 1317 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:13.644991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6019ccbc-b6e0-41da-876e-0112ff857935 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:13.646421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6019ccbc-b6e0-41da-876e-0112ff857935 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:13.846043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6019ccbc-b6e0-41da-876e-0112ff857935 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:13.865646 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6019ccbc-b6e0-41da-876e-0112ff857935 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7" status: 200 len: 1215 microversion: 2.1 time: 0.249316 Sep 07 12:43:13.867432 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1420/2810] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:13 2022] GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 => generated 1215 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:13.881618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-250c611b-bb2b-441b-b13e-2baca409e688 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:13.886386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-250c611b-bb2b-441b-b13e-2baca409e688 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 825ead8a-aa8c-4402-80f7-749edc7d21c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:13.898502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:43:13.905709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-250c611b-bb2b-441b-b13e-2baca409e688 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:13.906249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-250c611b-bb2b-441b-b13e-2baca409e688 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:13.906704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-250c611b-bb2b-441b-b13e-2baca409e688 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:13.907448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-250c611b-bb2b-441b-b13e-2baca409e688 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:13.907932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-250c611b-bb2b-441b-b13e-2baca409e688 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:13.908382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-250c611b-bb2b-441b-b13e-2baca409e688 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:14.579656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a70c76d8-31a2-44d6-9755-7867e65830d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:14.592142 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a70c76d8-31a2-44d6-9755-7867e65830d5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1511 microversion: 2.1 time: 1.081311 Sep 07 12:43:14.602499 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1391/2811] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:13 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1511 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:14.704504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-250c611b-bb2b-441b-b13e-2baca409e688 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:14.723661 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-250c611b-bb2b-441b-b13e-2baca409e688 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5" status: 200 len: 1466 microversion: 2.1 time: 0.854775 Sep 07 12:43:14.725028 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1421/2812] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:13 2022] GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5 => generated 1466 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:14.734047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-455beb7c-c4c8-43d4-af33-4840946356fe tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:14.735044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-455beb7c-c4c8-43d4-af33-4840946356fe tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:14.755302 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-455beb7c-c4c8-43d4-af33-4840946356fe tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:14.755753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-455beb7c-c4c8-43d4-af33-4840946356fe tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:14.756221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-455beb7c-c4c8-43d4-af33-4840946356fe tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:14.756989 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-455beb7c-c4c8-43d4-af33-4840946356fe tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:14.757737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-455beb7c-c4c8-43d4-af33-4840946356fe tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:14.758364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-455beb7c-c4c8-43d4-af33-4840946356fe tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:15.053981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1ea76932-736c-44e1-a155-a3347c30e0a6 tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Action: 'create', calling method: .version_select at 0x7fc4183b18b0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK71vQ0+PuCYOB24rx3wFugQJUTI2yc3LXWWEMOHyYilMYTuwqY0LtQFaTcOQFSH/mdJVDCxupVIvyCRJleih/s4Vz/lyFG0Z5SyRgybXZYTrZSTnE9zP2RbHQh4uEwgaA=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:15.064392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1ea76932-736c-44e1-a155-a3347c30e0a6 tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Request method failure captured: Sep 07 12:43:15.064392 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 07 12:43:15.064392 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:43:15.064392 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:43:15.064392 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:43:15.064392 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 257 Sep 07 12:43:15.064392 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:43:15.064392 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:43:15.064392 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:43:15.064392 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:43:15.064392 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJHhpcI8Hw0ecGUk3ibFf3aergi14XgIs5jEI0_Jl2-z1jrmWlvgg7Fp0ZumErU-Pe_w2f3HR_iZwU9I2zIWFybPfkrMGd36u21nFii9l6Z6nR0acm9SI-JeVxzowdPa0b-2cnYTC1v9ckSZC9__qxCkgFOF2WNhaR3kU2kG8aELp7I Sep 07 12:43:15.064392 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:43:15.064392 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:43:15.064392 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:43:15.064392 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:43:15.064392 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:43:15.064392 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:43:15.064392 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 622fb561e7e64f19ab6fcb6d408b2dba Sep 07 12:43:15.064392 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1661084025 Sep 07 12:43:15.064392 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:43:15.064392 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:43:15.067150 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:43:15.067150 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1661084025 Sep 07 12:43:15.067150 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 622fb561e7e64f19ab6fcb6d408b2dba Sep 07 12:43:15.067150 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1661084025 Sep 07 12:43:15.067150 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-KeyPairsNegativeTestJSON-1661084025-project Sep 07 12:43:15.067150 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:43:15.067150 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:43:15.067150 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: b64ca954fe8e4b57ace328e2c97a548c Sep 07 12:43:15.067150 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1661084025-project Sep 07 12:43:15.067150 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:43:15.067150 n-d-852087-9 devstack@n-api.service[122433]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK71vQ0+PuCYOB24rx3wFugQJUTI2yc3LXWWEMOHyYilMYTuwqY0LtQFaTcOQFSH/mdJVDCxupVIvyCRJleih/s4Vz/lyFG0Z5SyRgybXZYTrZSTnE9zP2RbHQh4uEwgaA=="}} Sep 07 12:43:15.068505 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:43:15.068505 n-d-852087-9 devstack@n-api.service[122433]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 07 12:43:15.068505 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK71vQ0+PuCYOB24rx3wFugQJUTI2yc3LXWWEMOHyYilMYTuwqY0LtQFaTcOQFSH/mdJVDCxupVIvyCRJleih/s4Vz/lyFG0Z5SyRgybXZYTrZSTnE9zP2RbHQh4uEwgaA=='}}} Sep 07 12:43:15.068505 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:43:15.068505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:15.068505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 07 12:43:15.068505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 07 12:43:15.068505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Sep 07 12:43:15.068505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Sep 07 12:43:15.068505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Sep 07 12:43:15.068505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Sep 07 12:43:15.068505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 07 12:43:15.068505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:15.068505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 07 12:43:15.068505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:15.068505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:15.068505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:43:15.070408 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:43:15.070408 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:43:15.070408 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:43:15.070408 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Sep 07 12:43:15.070408 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:15.070408 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Sep 07 12:43:15.070408 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Sep 07 12:43:15.070408 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Sep 07 12:43:15.070408 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'minLength': 1, Sep 07 12:43:15.070408 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 07 12:43:15.070408 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:15.070408 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Sep 07 12:43:15.070408 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Sep 07 12:43:15.070408 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:15.070408 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:15.070408 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:15.070408 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:15.070408 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:15.070408 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:15.070408 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:43:15.070408 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:43:15.070408 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:43:15.070408 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:43:15.077452 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:43:15.077452 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:43:15.077452 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:43:15.077452 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:43:15.077452 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:43:15.077452 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:43:15.077452 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:43:15.077452 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:43:15.077452 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:43:15.077452 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:43:15.077452 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 07 12:43:15.077452 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:15.077452 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:15.077452 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:15.077452 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:15.077452 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:15.077452 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:15.077452 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:43:15.077452 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:43:15.082596 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 07 12:43:15.082596 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:15.082596 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1ea76932-736c-44e1-a155-a3347c30e0a6 tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:43:15.087539 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1ea76932-736c-44e1-a155-a3347c30e0a6 tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.473585 Sep 07 12:43:15.089446 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1392/2813] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 12:43:14 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 486 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:43:15.101875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ab4ac64-c066-4326-834c-c1ccfa445078 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:15.104416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8ab4ac64-c066-4326-834c-c1ccfa445078 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: b847cba9-b245-4b45-b0bd-897d59ba9a67] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:15.119175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ab4ac64-c066-4326-834c-c1ccfa445078 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:15.120607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ab4ac64-c066-4326-834c-c1ccfa445078 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:15.122053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ab4ac64-c066-4326-834c-c1ccfa445078 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:15.123891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ab4ac64-c066-4326-834c-c1ccfa445078 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:15.125134 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ab4ac64-c066-4326-834c-c1ccfa445078 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:15.126971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ab4ac64-c066-4326-834c-c1ccfa445078 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:15.559667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-455beb7c-c4c8-43d4-af33-4840946356fe tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:15.576064 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-455beb7c-c4c8-43d4-af33-4840946356fe tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1523 microversion: 2.1 time: 0.848979 Sep 07 12:43:15.577823 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1422/2814] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:14 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1523 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:15.589092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6903c28a-b7c7-46a8-8a62-e2fd07055479 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:15.590819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6903c28a-b7c7-46a8-8a62-e2fd07055479 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] [instance: 825ead8a-aa8c-4402-80f7-749edc7d21c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:15.603368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6903c28a-b7c7-46a8-8a62-e2fd07055479 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:15.604749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6903c28a-b7c7-46a8-8a62-e2fd07055479 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:15.605857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6903c28a-b7c7-46a8-8a62-e2fd07055479 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:15.607562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6903c28a-b7c7-46a8-8a62-e2fd07055479 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:15.608840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6903c28a-b7c7-46a8-8a62-e2fd07055479 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:15.609978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6903c28a-b7c7-46a8-8a62-e2fd07055479 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:15.707919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8ab4ac64-c066-4326-834c-c1ccfa445078 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:15.729023 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8ab4ac64-c066-4326-834c-c1ccfa445078 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/b847cba9-b245-4b45-b0bd-897d59ba9a67" status: 200 len: 1505 microversion: 2.1 time: 0.637208 Sep 07 12:43:15.732593 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1393/2815] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:15 2022] GET /compute/v2.1/servers/b847cba9-b245-4b45-b0bd-897d59ba9a67 => generated 1505 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:15.744779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9b438300-2472-45ec-9e47-6a9f9de250fd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:15.746565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9b438300-2472-45ec-9e47-6a9f9de250fd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:15.761118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b438300-2472-45ec-9e47-6a9f9de250fd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:15.762777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b438300-2472-45ec-9e47-6a9f9de250fd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:15.764557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b438300-2472-45ec-9e47-6a9f9de250fd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:15.769662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b438300-2472-45ec-9e47-6a9f9de250fd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:15.771381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b438300-2472-45ec-9e47-6a9f9de250fd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:15.772792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b438300-2472-45ec-9e47-6a9f9de250fd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:16.034117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9b438300-2472-45ec-9e47-6a9f9de250fd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:16.049168 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9b438300-2472-45ec-9e47-6a9f9de250fd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7" status: 200 len: 1275 microversion: 2.1 time: 0.313908 Sep 07 12:43:16.053347 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1394/2816] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:15 2022] GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 => generated 1275 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:16.065723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5d160354-5ad7-41c1-b69c-14ffe0e5e75b tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Action: 'create', calling method: .version_select at 0x7fc418867e50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-172280235", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:16.105598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-5d160354-5ad7-41c1-b69c-14ffe0e5e75b tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Getting quotas for project 622fb561e7e64f19ab6fcb6d408b2dba. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:43:16.128063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-5d160354-5ad7-41c1-b69c-14ffe0e5e75b tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Getting quotas for user b64ca954fe8e4b57ace328e2c97a548c and project 622fb561e7e64f19ab6fcb6d408b2dba. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:43:16.168100 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-5d160354-5ad7-41c1-b69c-14ffe0e5e75b tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5d160354-5ad7-41c1-b69c-14ffe0e5e75b tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Request method failure captured: Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 2166 Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJHhpcI8Hw0ecGUk3ibFf3aergi14XgIs5jEI0_Jl2-z1jrmWlvgg7Fp0ZumErU-Pe_w2f3HR_iZwU9I2zIWFybPfkrMGd36u21nFii9l6Z6nR0acm9SI-JeVxzowdPa0b-2cnYTC1v9ckSZC9__qxCkgFOF2WNhaR3kU2kG8aELp7I Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 622fb561e7e64f19ab6fcb6d408b2dba Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1661084025 Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1661084025 Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 622fb561e7e64f19ab6fcb6d408b2dba Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1661084025 Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-KeyPairsNegativeTestJSON-1661084025-project Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: b64ca954fe8e4b57ace328e2c97a548c Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1661084025-project Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-172280235", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:43:16.186101 n-d-852087-9 devstack@n-api.service[122433]: exception: Keypair data is invalid: failed to generate fingerprint Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-172280235', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:43:16.188631 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:43:16.191387 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:43:16.191387 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:43:16.191387 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:43:16.191387 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:43:16.191387 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 07 12:43:16.191387 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 07 12:43:16.191387 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 07 12:43:16.191387 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 07 12:43:16.191387 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 07 12:43:16.191387 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:16.191387 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:16.191387 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:16.191387 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:16.191387 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:16.191387 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:16.191387 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:43:16.191387 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:43:16.191387 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 07 12:43:16.191387 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:16.194654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5d160354-5ad7-41c1-b69c-14ffe0e5e75b tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:43:16.196089 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5d160354-5ad7-41c1-b69c-14ffe0e5e75b tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.141318 Sep 07 12:43:16.204407 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1395/2817] 10.222.0.16 () {60 vars in 1160 bytes} [Wed Sep 7 12:43:16 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 07 12:43:16.212994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-b8d731c9-6369-45d8-a885-2b9e56a7408b req-39b1165d-a19a-4671-8814-fccea034ccdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b017ea78-874a-4e91-933a-716e254275a6", "tag": "914cfc7f-b102-4403-ba5d-484c546bac81"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:16.232912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b8d731c9-6369-45d8-a885-2b9e56a7408b req-39b1165d-a19a-4671-8814-fccea034ccdd service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:16.233836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b8d731c9-6369-45d8-a885-2b9e56a7408b req-39b1165d-a19a-4671-8814-fccea034ccdd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:16.234619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b8d731c9-6369-45d8-a885-2b9e56a7408b req-39b1165d-a19a-4671-8814-fccea034ccdd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:16.258434 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-b8d731c9-6369-45d8-a885-2b9e56a7408b req-39b1165d-a19a-4671-8814-fccea034ccdd service nova] Creating event network-changed:914cfc7f-b102-4403-ba5d-484c546bac81 for instance b017ea78-874a-4e91-933a-716e254275a6 on n-h2-852087-9 Sep 07 12:43:16.268818 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-b8d731c9-6369-45d8-a885-2b9e56a7408b req-39b1165d-a19a-4671-8814-fccea034ccdd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062447 Sep 07 12:43:16.270804 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1396/2818] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:16.281210 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6903c28a-b7c7-46a8-8a62-e2fd07055479 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5" status: 200 len: 1617 microversion: 2.1 time: 0.701212 Sep 07 12:43:16.282075 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1423/2819] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:15 2022] GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5 => generated 1617 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:16.296814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c7bdffe2-53eb-4abc-8d4a-964e8587dfd9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:16.299393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c7bdffe2-53eb-4abc-8d4a-964e8587dfd9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:16.303035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7e648418-0efd-4dd2-84b1-2f04636cf5a7 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:16.306627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7e648418-0efd-4dd2-84b1-2f04636cf5a7 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:16.318521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7bdffe2-53eb-4abc-8d4a-964e8587dfd9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:16.319570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7bdffe2-53eb-4abc-8d4a-964e8587dfd9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:16.321116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7bdffe2-53eb-4abc-8d4a-964e8587dfd9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:16.322579 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7bdffe2-53eb-4abc-8d4a-964e8587dfd9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:16.323706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7bdffe2-53eb-4abc-8d4a-964e8587dfd9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:16.324856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7bdffe2-53eb-4abc-8d4a-964e8587dfd9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:16.365387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e648418-0efd-4dd2-84b1-2f04636cf5a7 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:16.373084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e648418-0efd-4dd2-84b1-2f04636cf5a7 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:16.382588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e648418-0efd-4dd2-84b1-2f04636cf5a7 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:16.383891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e648418-0efd-4dd2-84b1-2f04636cf5a7 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:16.394338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e648418-0efd-4dd2-84b1-2f04636cf5a7 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:16.395672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e648418-0efd-4dd2-84b1-2f04636cf5a7 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:16.524682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7e648418-0efd-4dd2-84b1-2f04636cf5a7 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:43:16.753935 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7e648418-0efd-4dd2-84b1-2f04636cf5a7 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "DELETE /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 204 len: 0 microversion: 2.1 time: 0.480639 Sep 07 12:43:16.755850 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1397/2820] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:43:16 2022] DELETE /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:43:16.768537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-63599765-6a95-481f-8e2d-690ebbff3107 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:16.770644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-63599765-6a95-481f-8e2d-690ebbff3107 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: b847cba9-b245-4b45-b0bd-897d59ba9a67] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:16.791249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63599765-6a95-481f-8e2d-690ebbff3107 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:16.792521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63599765-6a95-481f-8e2d-690ebbff3107 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:16.793997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63599765-6a95-481f-8e2d-690ebbff3107 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:16.795952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63599765-6a95-481f-8e2d-690ebbff3107 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:16.797181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63599765-6a95-481f-8e2d-690ebbff3107 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:16.798257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63599765-6a95-481f-8e2d-690ebbff3107 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:16.836147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-63599765-6a95-481f-8e2d-690ebbff3107 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: b847cba9-b245-4b45-b0bd-897d59ba9a67] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:43:16.964623 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-63599765-6a95-481f-8e2d-690ebbff3107 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b847cba9-b245-4b45-b0bd-897d59ba9a67" status: 204 len: 0 microversion: 2.1 time: 0.206907 Sep 07 12:43:16.966080 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1398/2821] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:43:16 2022] DELETE /compute/v2.1/servers/b847cba9-b245-4b45-b0bd-897d59ba9a67 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:43:16.982002 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ea59683c-c4ff-41d5-917c-ee8ddaceeb19 tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Action: 'create', calling method: .version_select at 0x7fc4183d2af0>, body: {"keypair": {"name": "tempest-keypair-737726915", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJck99oEOz5Gy2QW1lIfIEoyvIhScVjpREwpSj22oLAg7zp3wYXNHL5sR+nMEcQRoNs9u5unWM/i+oRwS2gwFUbwGkuS04Y7/mInmDFDAa9xsesC/yGKi0bCIxY/YSOAhg=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:16.990850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c7bdffe2-53eb-4abc-8d4a-964e8587dfd9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:17.003353 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c7bdffe2-53eb-4abc-8d4a-964e8587dfd9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1511 microversion: 2.1 time: 0.717928 Sep 07 12:43:17.006942 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1424/2822] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:16 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1511 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:17.012422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-885fe452-2219-417b-817d-a1be0469c2e3 req-4e84bbe0-7f10-44f2-8d1d-502707fd8936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "663da890-aea0-44c3-842f-71ee8abfaac8", "name": "network-vif-unplugged", "status": "completed", "tag": "91a161ca-8197-4775-8162-05a0be29c897"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:17.016627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-ea59683c-c4ff-41d5-917c-ee8ddaceeb19 tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Getting quotas for project 622fb561e7e64f19ab6fcb6d408b2dba. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:43:17.036583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-ea59683c-c4ff-41d5-917c-ee8ddaceeb19 tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Getting quotas for user b64ca954fe8e4b57ace328e2c97a548c and project 622fb561e7e64f19ab6fcb6d408b2dba. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:43:17.045600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-885fe452-2219-417b-817d-a1be0469c2e3 req-4e84bbe0-7f10-44f2-8d1d-502707fd8936 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:17.046371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-885fe452-2219-417b-817d-a1be0469c2e3 req-4e84bbe0-7f10-44f2-8d1d-502707fd8936 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:17.054506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-885fe452-2219-417b-817d-a1be0469c2e3 req-4e84bbe0-7f10-44f2-8d1d-502707fd8936 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:17.075606 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-885fe452-2219-417b-817d-a1be0469c2e3 req-4e84bbe0-7f10-44f2-8d1d-502707fd8936 service nova] Creating event network-vif-unplugged:91a161ca-8197-4775-8162-05a0be29c897 for instance 663da890-aea0-44c3-842f-71ee8abfaac8 on n-h1-852087-9 Sep 07 12:43:17.084848 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-885fe452-2219-417b-817d-a1be0469c2e3 req-4e84bbe0-7f10-44f2-8d1d-502707fd8936 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075696 Sep 07 12:43:17.086327 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1425/2823] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:17.103451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-955ad11e-b483-4fa4-b603-3438374e4281 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1327916870", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:17.111902 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ea59683c-c4ff-41d5-917c-ee8ddaceeb19 tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.142016 Sep 07 12:43:17.112674 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1399/2824] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 12:43:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:17.134229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b4b323fa-ea7e-4b08-9995-e40ff56ebe85 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:17.134923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b4b323fa-ea7e-4b08-9995-e40ff56ebe85 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:17.153306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4b323fa-ea7e-4b08-9995-e40ff56ebe85 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:17.153441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4b323fa-ea7e-4b08-9995-e40ff56ebe85 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:17.153811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4b323fa-ea7e-4b08-9995-e40ff56ebe85 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:17.154560 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4b323fa-ea7e-4b08-9995-e40ff56ebe85 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:17.155155 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4b323fa-ea7e-4b08-9995-e40ff56ebe85 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:17.155429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4b323fa-ea7e-4b08-9995-e40ff56ebe85 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:17.167428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:43:17.263896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-955ad11e-b483-4fa4-b603-3438374e4281 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:43:18.070747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b4b323fa-ea7e-4b08-9995-e40ff56ebe85 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:18.086621 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b4b323fa-ea7e-4b08-9995-e40ff56ebe85 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1529 microversion: 2.1 time: 0.962577 Sep 07 12:43:18.088915 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1400/2825] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:17 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1529 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:18.102434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-241afa9a-9947-4434-bf46-a1732bf472bf tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:18.104601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-241afa9a-9947-4434-bf46-a1732bf472bf tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 4bb43114-1042-49c5-b60c-2474dae9f021] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:18.119133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-241afa9a-9947-4434-bf46-a1732bf472bf tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:18.120320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-241afa9a-9947-4434-bf46-a1732bf472bf tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:18.123700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-241afa9a-9947-4434-bf46-a1732bf472bf tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:18.124878 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-241afa9a-9947-4434-bf46-a1732bf472bf tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:18.125788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-241afa9a-9947-4434-bf46-a1732bf472bf tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:18.126494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-241afa9a-9947-4434-bf46-a1732bf472bf tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:18.182954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-241afa9a-9947-4434-bf46-a1732bf472bf tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 4bb43114-1042-49c5-b60c-2474dae9f021] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:43:18.281923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-955ad11e-b483-4fa4-b603-3438374e4281 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:43:18.281923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-955ad11e-b483-4fa4-b603-3438374e4281 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:43:18.281923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-955ad11e-b483-4fa4-b603-3438374e4281 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:43:18.281923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-955ad11e-b483-4fa4-b603-3438374e4281 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:43:18.283102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-955ad11e-b483-4fa4-b603-3438374e4281 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:43:18.297376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-955ad11e-b483-4fa4-b603-3438374e4281 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:18.298040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-955ad11e-b483-4fa4-b603-3438374e4281 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:18.298773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-955ad11e-b483-4fa4-b603-3438374e4281 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:18.299640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-955ad11e-b483-4fa4-b603-3438374e4281 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:18.300171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-955ad11e-b483-4fa4-b603-3438374e4281 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:18.300853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-955ad11e-b483-4fa4-b603-3438374e4281 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:18.325146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-955ad11e-b483-4fa4-b603-3438374e4281 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:43:18.331953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-955ad11e-b483-4fa4-b603-3438374e4281 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Getting quotas for user ed6e5d4d54224bca90954d1ebbd7b7a3 and project e15fa55f4d4f4b4db6dbb26c0f07c3c4. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:43:18.348317 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-955ad11e-b483-4fa4-b603-3438374e4281 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:43:18.351562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-955ad11e-b483-4fa4-b603-3438374e4281 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: e419158f-482c-4386-814d-4df837dec1ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:43:18.354456 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-241afa9a-9947-4434-bf46-a1732bf472bf tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021" status: 204 len: 0 microversion: 2.1 time: 0.263321 Sep 07 12:43:18.359942 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1401/2826] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:43:18 2022] DELETE /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:43:18.367648 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4c70b406-3e36-4274-9e98-e9d53d841de3 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:18.369108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4c70b406-3e36-4274-9e98-e9d53d841de3 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:18.381182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c70b406-3e36-4274-9e98-e9d53d841de3 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:18.382191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c70b406-3e36-4274-9e98-e9d53d841de3 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:18.383063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c70b406-3e36-4274-9e98-e9d53d841de3 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:18.384509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c70b406-3e36-4274-9e98-e9d53d841de3 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:18.386179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c70b406-3e36-4274-9e98-e9d53d841de3 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:18.387296 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c70b406-3e36-4274-9e98-e9d53d841de3 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:18.435729 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-955ad11e-b483-4fa4-b603-3438374e4281 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.347387 Sep 07 12:43:18.448258 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1426/2827] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:43:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:43:18.458325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5bbfd7db-5dd2-4c5b-8136-979debddc05c tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Action: 'create', calling method: .version_select at 0x7fc419cad9d0>, body: {"keypair": {"name": "tempest-keypair-737726915", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdQjzq3DaUNTCdBRQWVlYLr8ASoQjFbFd1By8Ifm4sPebEEZc4mjQOhSsUpzQkAQBvJZLBZUgYLl7ZO1aAgKaqXMAIqfeMOgHPiuPHOTKyenGJ0lXjcsf5/MUtn4f69uw=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:18.479902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-5bbfd7db-5dd2-4c5b-8136-979debddc05c tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Getting quotas for project 622fb561e7e64f19ab6fcb6d408b2dba. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:43:18.488222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-5bbfd7db-5dd2-4c5b-8136-979debddc05c tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Getting quotas for user b64ca954fe8e4b57ace328e2c97a548c and project 622fb561e7e64f19ab6fcb6d408b2dba. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:43:18.520918 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-5bbfd7db-5dd2-4c5b-8136-979debddc05c tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] HTTP exception thrown: Key pair 'tempest-keypair-737726915' already exists. Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5bbfd7db-5dd2-4c5b-8136-979debddc05c tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Request method failure captured: Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 272 Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJHhpcI8Hw0ecGUk3ibFf3aergi14XgIs5jEI0_Jl2-z1jrmWlvgg7Fp0ZumErU-Pe_w2f3HR_iZwU9I2zIWFybPfkrMGd36u21nFii9l6Z6nR0acm9SI-JeVxzowdPa0b-2cnYTC1v9ckSZC9__qxCkgFOF2WNhaR3kU2kG8aELp7I Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 622fb561e7e64f19ab6fcb6d408b2dba Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1661084025 Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1661084025 Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 622fb561e7e64f19ab6fcb6d408b2dba Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1661084025 Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-KeyPairsNegativeTestJSON-1661084025-project Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: b64ca954fe8e4b57ace328e2c97a548c Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1661084025-project Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: {"keypair": {"name": "tempest-keypair-737726915", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdQjzq3DaUNTCdBRQWVlYLr8ASoQjFbFd1By8Ifm4sPebEEZc4mjQOhSsUpzQkAQBvJZLBZUgYLl7ZO1aAgKaqXMAIqfeMOgHPiuPHOTKyenGJ0lXjcsf5/MUtn4f69uw=="}} Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: exception: Key pair 'tempest-keypair-737726915' already exists. Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-737726915', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdQjzq3DaUNTCdBRQWVlYLr8ASoQjFbFd1By8Ifm4sPebEEZc4mjQOhSsUpzQkAQBvJZLBZUgYLl7ZO1aAgKaqXMAIqfeMOgHPiuPHOTKyenGJ0lXjcsf5/MUtn4f69uw=='}}} Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result.read() Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'b64ca954fe8e4b57ace328e2c97a548c-tempest-keypair-737726915' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 07 12:43:18.544616 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi kp.save(context.session) Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi session.flush() Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result.read() Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 07 12:43:18.549461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'b64ca954fe8e4b57ace328e2c97a548c-tempest-keypair-737726915' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 7, 12, 43, 18, 509461), 'updated_at': None, 'name': 'tempest-keypair-737726915', 'user_id': 'b64ca954fe8e4b57ace328e2c97a548c', 'fingerprint': '56:3a:9b:1b:fe:9d:52:f5:b8:31:99:e2:12:35:87:da', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdQjzq3DaUNTCdBRQWVlYLr8ASoQjFbFd1By8Ifm4sPebEEZc4mjQOhSsUpzQkAQBvJZLBZUgYLl7ZO1aAgKaqXMAIqfeMOgHPiuPHOTKyenGJ0lXjcsf5/MUtn4f69uw==', 'type': 'ssh'}] Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi keypair.create() Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._create() Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-737726915' already exists. Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Sep 07 12:43:18.554267 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-737726915' already exists. Sep 07 12:43:18.567380 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:18.567380 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:18.567380 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:18.567380 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:18.567380 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:18.567380 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:18.567380 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:43:18.567380 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:43:18.567380 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-737726915' already exists. Sep 07 12:43:18.567380 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:18.567380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5bbfd7db-5dd2-4c5b-8136-979debddc05c tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Returning 409 to user: Key pair 'tempest-keypair-737726915' already exists. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:43:18.567380 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5bbfd7db-5dd2-4c5b-8136-979debddc05c tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.102400 Sep 07 12:43:18.567380 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1427/2828] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 12:43:18 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:43:18.572907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-971d232e-9779-4f97-9280-4eff9c07ff19 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:18.574275 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-971d232e-9779-4f97-9280-4eff9c07ff19 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:18.592693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-971d232e-9779-4f97-9280-4eff9c07ff19 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:18.593905 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-971d232e-9779-4f97-9280-4eff9c07ff19 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:18.594645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-971d232e-9779-4f97-9280-4eff9c07ff19 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:18.596043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-971d232e-9779-4f97-9280-4eff9c07ff19 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:18.596993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-971d232e-9779-4f97-9280-4eff9c07ff19 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:18.598004 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-971d232e-9779-4f97-9280-4eff9c07ff19 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:18.701311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4c70b406-3e36-4274-9e98-e9d53d841de3 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:18.727140 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4c70b406-3e36-4274-9e98-e9d53d841de3 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7" status: 200 len: 1315 microversion: 2.1 time: 0.369458 Sep 07 12:43:18.727974 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1402/2829] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:18 2022] GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:18.741166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a7b153ff-9edd-4835-96b4-5029b3acc6cd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:18.742080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a7b153ff-9edd-4835-96b4-5029b3acc6cd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: b847cba9-b245-4b45-b0bd-897d59ba9a67] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:18.749917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7b153ff-9edd-4835-96b4-5029b3acc6cd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:18.750677 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7b153ff-9edd-4835-96b4-5029b3acc6cd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:18.751255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7b153ff-9edd-4835-96b4-5029b3acc6cd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:18.752936 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7b153ff-9edd-4835-96b4-5029b3acc6cd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:18.753660 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7b153ff-9edd-4835-96b4-5029b3acc6cd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:18.754237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7b153ff-9edd-4835-96b4-5029b3acc6cd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:18.950736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-971d232e-9779-4f97-9280-4eff9c07ff19 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:18.998181 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-971d232e-9779-4f97-9280-4eff9c07ff19 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1511 microversion: 2.1 time: 0.437205 Sep 07 12:43:19.000947 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1428/2830] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:18 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1511 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:19.012251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-58782e15-3b6d-41a6-9d24-4c11a5ff0a77 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:19.013242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-58782e15-3b6d-41a6-9d24-4c11a5ff0a77 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: e419158f-482c-4386-814d-4df837dec1ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:19.257478 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-58782e15-3b6d-41a6-9d24-4c11a5ff0a77 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:19.258920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a7b153ff-9edd-4835-96b4-5029b3acc6cd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:19.268910 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-58782e15-3b6d-41a6-9d24-4c11a5ff0a77 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff" status: 200 len: 1217 microversion: 2.1 time: 0.265833 Sep 07 12:43:19.271425 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1429/2831] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:19 2022] GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff => generated 1217 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:19.277139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-33f40b10-f8ed-4d7b-9bac-9996ad8474d5 tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Calling method '.version_select at 0x7fc41848edc0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:19.283398 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a7b153ff-9edd-4835-96b4-5029b3acc6cd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/b847cba9-b245-4b45-b0bd-897d59ba9a67" status: 200 len: 1511 microversion: 2.1 time: 0.547410 Sep 07 12:43:19.285617 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1403/2832] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:18 2022] GET /compute/v2.1/servers/b847cba9-b245-4b45-b0bd-897d59ba9a67 => generated 1511 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:19.304615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-48eb7cc6-0814-48a2-8fb6-a8ffb3149c1d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:19.305946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-48eb7cc6-0814-48a2-8fb6-a8ffb3149c1d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:19.319818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48eb7cc6-0814-48a2-8fb6-a8ffb3149c1d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:19.320657 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48eb7cc6-0814-48a2-8fb6-a8ffb3149c1d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:19.321451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48eb7cc6-0814-48a2-8fb6-a8ffb3149c1d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:19.322547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48eb7cc6-0814-48a2-8fb6-a8ffb3149c1d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:19.323348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48eb7cc6-0814-48a2-8fb6-a8ffb3149c1d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:19.323958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48eb7cc6-0814-48a2-8fb6-a8ffb3149c1d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:19.353511 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-33f40b10-f8ed-4d7b-9bac-9996ad8474d5 tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-737726915" status: 202 len: 0 microversion: 2.1 time: 0.076099 Sep 07 12:43:19.354750 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1430/2833] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Sep 7 12:43:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-737726915 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:43:19.378916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-15fd638f-a378-4df4-a730-62801a7341d3 tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Action: 'create', calling method: .version_select at 0x7fc419cad940>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCaXO5m+z0a0axDYd8Z/eftep1VN7g7iMoNycHvUSRIhbcZqXSop3QHLtWOiNB1uzlmpFe1OhViFL/yLq1NRJGndpgFqaI13yAb2R4HlqqaRJSS633/0qiZYYMaZkDqzQ=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-15fd638f-a378-4df4-a730-62801a7341d3 tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Request method failure captured: Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 247 Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJHhpcI8Hw0ecGUk3ibFf3aergi14XgIs5jEI0_Jl2-z1jrmWlvgg7Fp0ZumErU-Pe_w2f3HR_iZwU9I2zIWFybPfkrMGd36u21nFii9l6Z6nR0acm9SI-JeVxzowdPa0b-2cnYTC1v9ckSZC9__qxCkgFOF2WNhaR3kU2kG8aELp7I Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 622fb561e7e64f19ab6fcb6d408b2dba Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1661084025 Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1661084025 Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 622fb561e7e64f19ab6fcb6d408b2dba Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1661084025 Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-KeyPairsNegativeTestJSON-1661084025-project Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: b64ca954fe8e4b57ace328e2c97a548c Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1661084025-project Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCaXO5m+z0a0axDYd8Z/eftep1VN7g7iMoNycHvUSRIhbcZqXSop3QHLtWOiNB1uzlmpFe1OhViFL/yLq1NRJGndpgFqaI13yAb2R4HlqqaRJSS633/0qiZYYMaZkDqzQ=="}} Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCaXO5m+z0a0axDYd8Z/eftep1VN7g7iMoNycHvUSRIhbcZqXSop3QHLtWOiNB1uzlmpFe1OhViFL/yLq1NRJGndpgFqaI13yAb2R4HlqqaRJSS633/0qiZYYMaZkDqzQ=='}}} Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi '' Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:43:19.383467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:43:19.388353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:43:19.388353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:43:19.388353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:43:19.388353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:43:19.388353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 07 12:43:19.388353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.388353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:19.388353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.388353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:19.388353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:19.388353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:19.388353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:43:19.388353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:43:19.388353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 07 12:43:19.388353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.391658 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-15fd638f-a378-4df4-a730-62801a7341d3 tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:43:19.392831 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-15fd638f-a378-4df4-a730-62801a7341d3 tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.018048 Sep 07 12:43:19.394057 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1431/2834] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 12:43:19 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:43:19.404099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eea693cc-70e7-4f47-b451-31a5ba1dffcc tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Action: 'create', calling method: .version_select at 0x7fc41971e8b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1561991221", "public_key": " "}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:19.439816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-eea693cc-70e7-4f47-b451-31a5ba1dffcc tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Getting quotas for project 622fb561e7e64f19ab6fcb6d408b2dba. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:43:19.449968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-eea693cc-70e7-4f47-b451-31a5ba1dffcc tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Getting quotas for user b64ca954fe8e4b57ace328e2c97a548c and project 622fb561e7e64f19ab6fcb6d408b2dba. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:43:19.491457 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-eea693cc-70e7-4f47-b451-31a5ba1dffcc tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eea693cc-70e7-4f47-b451-31a5ba1dffcc tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Request method failure captured: Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 95 Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJHhpcI8Hw0ecGUk3ibFf3aergi14XgIs5jEI0_Jl2-z1jrmWlvgg7Fp0ZumErU-Pe_w2f3HR_iZwU9I2zIWFybPfkrMGd36u21nFii9l6Z6nR0acm9SI-JeVxzowdPa0b-2cnYTC1v9ckSZC9__qxCkgFOF2WNhaR3kU2kG8aELp7I Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 622fb561e7e64f19ab6fcb6d408b2dba Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1661084025 Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1661084025 Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 622fb561e7e64f19ab6fcb6d408b2dba Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1661084025 Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-KeyPairsNegativeTestJSON-1661084025-project Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: b64ca954fe8e4b57ace328e2c97a548c Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1661084025-project Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1561991221", "public_key": " "}} Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: exception: Keypair data is invalid: failed to generate fingerprint Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1561991221', 'public_key': ' '}}} Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:19.498515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 07 12:43:19.507311 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.510800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eea693cc-70e7-4f47-b451-31a5ba1dffcc tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:43:19.510800 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eea693cc-70e7-4f47-b451-31a5ba1dffcc tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.109688 Sep 07 12:43:19.516836 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1432/2835] 10.222.0.16 () {60 vars in 1158 bytes} [Wed Sep 7 12:43:19 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 07 12:43:19.532733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea8a5a4e-7c31-4936-8f58-fb9d5a94125f tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Action: 'create', calling method: .version_select at 0x7fc41d107ee0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4Wj1XZYTyCnOjSW9dONeU3r5iqwNHLgzvvI2Lxe69NFOUPtoL1GwGwZVx1SwO8Qnr/wQRzvlrjfd/6FSKrb2fM+admXONfpTaYEk/4XcVBCFjSfV+TBVgQlAd9shRFyw=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea8a5a4e-7c31-4936-8f58-fb9d5a94125f tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Request method failure captured: Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 507 Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJHhpcI8Hw0ecGUk3ibFf3aergi14XgIs5jEI0_Jl2-z1jrmWlvgg7Fp0ZumErU-Pe_w2f3HR_iZwU9I2zIWFybPfkrMGd36u21nFii9l6Z6nR0acm9SI-JeVxzowdPa0b-2cnYTC1v9ckSZC9__qxCkgFOF2WNhaR3kU2kG8aELp7I Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 622fb561e7e64f19ab6fcb6d408b2dba Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1661084025 Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1661084025 Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 622fb561e7e64f19ab6fcb6d408b2dba Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1661084025 Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-KeyPairsNegativeTestJSON-1661084025-project Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: b64ca954fe8e4b57ace328e2c97a548c Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1661084025-project Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4Wj1XZYTyCnOjSW9dONeU3r5iqwNHLgzvvI2Lxe69NFOUPtoL1GwGwZVx1SwO8Qnr/wQRzvlrjfd/6FSKrb2fM+admXONfpTaYEk/4XcVBCFjSfV+TBVgQlAd9shRFyw=="}} Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4Wj1XZYTyCnOjSW9dONeU3r5iqwNHLgzvvI2Lxe69NFOUPtoL1GwGwZVx1SwO8Qnr/wQRzvlrjfd/6FSKrb2fM+admXONfpTaYEk/4XcVBCFjSfV+TBVgQlAd9shRFyw=='}}} Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 07 12:43:19.540383 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.546996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea8a5a4e-7c31-4936-8f58-fb9d5a94125f tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:43:19.554484 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ea8a5a4e-7c31-4936-8f58-fb9d5a94125f tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.023553 Sep 07 12:43:19.557198 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1433/2836] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 12:43:19 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:43:19.565065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-48eb7cc6-0814-48a2-8fb6-a8ffb3149c1d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:19.567310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ac17172e-039c-49d3-822c-10ff60da337b tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Action: 'create', calling method: .version_select at 0x7fc4192bbd30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1195782159", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:19.574880 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-48eb7cc6-0814-48a2-8fb6-a8ffb3149c1d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1529 microversion: 2.1 time: 0.287732 Sep 07 12:43:19.590425 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1404/2837] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:19 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1529 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:19.599409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-ac17172e-039c-49d3-822c-10ff60da337b tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Getting quotas for project 622fb561e7e64f19ab6fcb6d408b2dba. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:43:19.605721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-ac17172e-039c-49d3-822c-10ff60da337b tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Getting quotas for user b64ca954fe8e4b57ace328e2c97a548c and project 622fb561e7e64f19ab6fcb6d408b2dba. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:43:19.627681 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-ac17172e-039c-49d3-822c-10ff60da337b tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ac17172e-039c-49d3-822c-10ff60da337b tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Request method failure captured: Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 118 Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJHhpcI8Hw0ecGUk3ibFf3aergi14XgIs5jEI0_Jl2-z1jrmWlvgg7Fp0ZumErU-Pe_w2f3HR_iZwU9I2zIWFybPfkrMGd36u21nFii9l6Z6nR0acm9SI-JeVxzowdPa0b-2cnYTC1v9ckSZC9__qxCkgFOF2WNhaR3kU2kG8aELp7I Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 622fb561e7e64f19ab6fcb6d408b2dba Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1661084025 Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1661084025 Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 622fb561e7e64f19ab6fcb6d408b2dba Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1661084025 Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-KeyPairsNegativeTestJSON-1661084025-project Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: b64ca954fe8e4b57ace328e2c97a548c Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1661084025-project Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1195782159", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: exception: Keypair data is invalid: failed to generate fingerprint Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1195782159', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 07 12:43:19.630242 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ac17172e-039c-49d3-822c-10ff60da337b tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ac17172e-039c-49d3-822c-10ff60da337b tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.076962 Sep 07 12:43:19.641695 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1434/2838] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 12:43:19 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 83 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 07 12:43:19.647893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-75a03e2e-0773-41eb-b013-48825ee3b47b tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Calling method '.version_select at 0x7fc4183b1f70>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:19.665601 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-75a03e2e-0773-41eb-b013-48825ee3b47b tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1826888973 not found for user b64ca954fe8e4b57ace328e2c97a548c Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-75a03e2e-0773-41eb-b013-48825ee3b47b tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Request method failure captured: Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1826888973 HTTP/1.1 Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJHhpcI8Hw0ecGUk3ibFf3aergi14XgIs5jEI0_Jl2-z1jrmWlvgg7Fp0ZumErU-Pe_w2f3HR_iZwU9I2zIWFybPfkrMGd36u21nFii9l6Z6nR0acm9SI-JeVxzowdPa0b-2cnYTC1v9ckSZC9__qxCkgFOF2WNhaR3kU2kG8aELp7I Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 622fb561e7e64f19ab6fcb6d408b2dba Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1661084025 Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/622fb561e7e64f19ab6fcb6d408b2dba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1661084025 Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 622fb561e7e64f19ab6fcb6d408b2dba Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1661084025 Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-KeyPairsNegativeTestJSON-1661084025-project Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: b64ca954fe8e4b57ace328e2c97a548c Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1661084025-project Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: exception: Keypair tempest-keypair-non-existent-1826888973 not found for user b64ca954fe8e4b57ace328e2c97a548c Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'tempest-keypair-non-existent-1826888973'} Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise self.value Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1826888973 not found for user b64ca954fe8e4b57ace328e2c97a548c Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.668333 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1826888973 not found for user b64ca954fe8e4b57ace328e2c97a548c Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1826888973 not found for user b64ca954fe8e4b57ace328e2c97a548c Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-75a03e2e-0773-41eb-b013-48825ee3b47b tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1826888973 not found for user b64ca954fe8e4b57ace328e2c97a548c {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-75a03e2e-0773-41eb-b013-48825ee3b47b tempest-KeyPairsNegativeTestJSON-1661084025 tempest-KeyPairsNegativeTestJSON-1661084025-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1826888973" status: 404 len: 145 microversion: 2.1 time: 0.027256 Sep 07 12:43:19.680184 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1405/2839] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Sep 7 12:43:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1826888973 => generated 145 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:43:19.774202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f6b377a1-9726-42b7-bc09-4d8b9fd6437c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:19.774830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f6b377a1-9726-42b7-bc09-4d8b9fd6437c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:19.782731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6b377a1-9726-42b7-bc09-4d8b9fd6437c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:19.783426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6b377a1-9726-42b7-bc09-4d8b9fd6437c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:19.783923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6b377a1-9726-42b7-bc09-4d8b9fd6437c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:19.784575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6b377a1-9726-42b7-bc09-4d8b9fd6437c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:19.785020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6b377a1-9726-42b7-bc09-4d8b9fd6437c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:19.785674 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6b377a1-9726-42b7-bc09-4d8b9fd6437c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:20.026246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9cb8faa3-ff90-4eb4-8f52-803c6077cbcc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:20.027127 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9cb8faa3-ff90-4eb4-8f52-803c6077cbcc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:20.031034 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f6b377a1-9726-42b7-bc09-4d8b9fd6437c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:20.038830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cb8faa3-ff90-4eb4-8f52-803c6077cbcc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:20.042077 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f6b377a1-9726-42b7-bc09-4d8b9fd6437c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7" status: 200 len: 1315 microversion: 2.1 time: 0.272498 Sep 07 12:43:20.042295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cb8faa3-ff90-4eb4-8f52-803c6077cbcc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:20.042758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cb8faa3-ff90-4eb4-8f52-803c6077cbcc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:20.043643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cb8faa3-ff90-4eb4-8f52-803c6077cbcc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:20.043963 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1435/2840] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:19 2022] GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:20.044085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cb8faa3-ff90-4eb4-8f52-803c6077cbcc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:20.046818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cb8faa3-ff90-4eb4-8f52-803c6077cbcc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:20.259777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9cb8faa3-ff90-4eb4-8f52-803c6077cbcc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:20.276830 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9cb8faa3-ff90-4eb4-8f52-803c6077cbcc tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1511 microversion: 2.1 time: 0.254687 Sep 07 12:43:20.279532 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1406/2841] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:20 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1511 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:43:20.321120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-89251a53-daae-498e-8e80-c9750213e07d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:20.321800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-89251a53-daae-498e-8e80-c9750213e07d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: e419158f-482c-4386-814d-4df837dec1ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:20.325996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bde6fa56-91c2-45ae-a50a-b82a6562a441 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:20.327165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bde6fa56-91c2-45ae-a50a-b82a6562a441 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: b847cba9-b245-4b45-b0bd-897d59ba9a67] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:20.341780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bde6fa56-91c2-45ae-a50a-b82a6562a441 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:20.342558 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bde6fa56-91c2-45ae-a50a-b82a6562a441 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:20.343068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bde6fa56-91c2-45ae-a50a-b82a6562a441 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:20.344483 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bde6fa56-91c2-45ae-a50a-b82a6562a441 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:20.345030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bde6fa56-91c2-45ae-a50a-b82a6562a441 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:20.345790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bde6fa56-91c2-45ae-a50a-b82a6562a441 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:20.345966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89251a53-daae-498e-8e80-c9750213e07d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:20.348847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89251a53-daae-498e-8e80-c9750213e07d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:20.349346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89251a53-daae-498e-8e80-c9750213e07d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:20.350266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89251a53-daae-498e-8e80-c9750213e07d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:20.353047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89251a53-daae-498e-8e80-c9750213e07d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:20.353593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89251a53-daae-498e-8e80-c9750213e07d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:20.488837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-89251a53-daae-498e-8e80-c9750213e07d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:20.506718 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-89251a53-daae-498e-8e80-c9750213e07d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff" status: 200 len: 1221 microversion: 2.1 time: 0.190540 Sep 07 12:43:20.508040 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1436/2842] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:20 2022] GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff => generated 1221 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:20.601772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a3e07df6-6433-4c41-9e0b-f25dcbcd881c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:20.602426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a3e07df6-6433-4c41-9e0b-f25dcbcd881c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:20.612053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3e07df6-6433-4c41-9e0b-f25dcbcd881c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:20.612767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3e07df6-6433-4c41-9e0b-f25dcbcd881c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:20.613565 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3e07df6-6433-4c41-9e0b-f25dcbcd881c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:20.615111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3e07df6-6433-4c41-9e0b-f25dcbcd881c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:20.616053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3e07df6-6433-4c41-9e0b-f25dcbcd881c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:20.616599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3e07df6-6433-4c41-9e0b-f25dcbcd881c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:20.772574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bde6fa56-91c2-45ae-a50a-b82a6562a441 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:20.793547 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bde6fa56-91c2-45ae-a50a-b82a6562a441 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/b847cba9-b245-4b45-b0bd-897d59ba9a67" status: 200 len: 1511 microversion: 2.1 time: 0.474720 Sep 07 12:43:20.794770 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1407/2843] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:20 2022] GET /compute/v2.1/servers/b847cba9-b245-4b45-b0bd-897d59ba9a67 => generated 1511 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:20.944753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a3e07df6-6433-4c41-9e0b-f25dcbcd881c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:20.963524 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a3e07df6-6433-4c41-9e0b-f25dcbcd881c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1529 microversion: 2.1 time: 0.366267 Sep 07 12:43:20.964854 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1437/2844] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:20 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1529 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:21.088656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-28b7b979-ff4b-4294-8a44-dd5be3b56ff7 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:21.090503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-28b7b979-ff4b-4294-8a44-dd5be3b56ff7 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:21.111311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28b7b979-ff4b-4294-8a44-dd5be3b56ff7 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:21.112626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28b7b979-ff4b-4294-8a44-dd5be3b56ff7 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:21.114217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28b7b979-ff4b-4294-8a44-dd5be3b56ff7 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:21.117031 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28b7b979-ff4b-4294-8a44-dd5be3b56ff7 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:21.118203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28b7b979-ff4b-4294-8a44-dd5be3b56ff7 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:21.119421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28b7b979-ff4b-4294-8a44-dd5be3b56ff7 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:21.262085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-7b35ea46-a460-400e-9880-b185a01c16b0 req-ed31c3ea-2b2a-4600-9591-983ea548dbd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "209a7f47-3606-42a4-8360-4fa356ad74e7", "tag": "5e6b718d-88c1-405f-8b5d-2849933dfc7d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:21.282411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7b35ea46-a460-400e-9880-b185a01c16b0 req-ed31c3ea-2b2a-4600-9591-983ea548dbd1 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:21.286539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7b35ea46-a460-400e-9880-b185a01c16b0 req-ed31c3ea-2b2a-4600-9591-983ea548dbd1 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:21.288632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7b35ea46-a460-400e-9880-b185a01c16b0 req-ed31c3ea-2b2a-4600-9591-983ea548dbd1 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:21.314546 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7b35ea46-a460-400e-9880-b185a01c16b0 req-ed31c3ea-2b2a-4600-9591-983ea548dbd1 service nova] Creating event network-changed:5e6b718d-88c1-405f-8b5d-2849933dfc7d for instance 209a7f47-3606-42a4-8360-4fa356ad74e7 on n-h1-852087-9 Sep 07 12:43:21.321652 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-7b35ea46-a460-400e-9880-b185a01c16b0 req-ed31c3ea-2b2a-4600-9591-983ea548dbd1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064231 Sep 07 12:43:21.323194 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1438/2845] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:21.330262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2fda0f7a-4d0d-489b-be51-1acbf46bf080 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:21.331731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2fda0f7a-4d0d-489b-be51-1acbf46bf080 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:21.344884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fda0f7a-4d0d-489b-be51-1acbf46bf080 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:21.348372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fda0f7a-4d0d-489b-be51-1acbf46bf080 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:21.350263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fda0f7a-4d0d-489b-be51-1acbf46bf080 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:21.352272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fda0f7a-4d0d-489b-be51-1acbf46bf080 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:21.353260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fda0f7a-4d0d-489b-be51-1acbf46bf080 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:21.354205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fda0f7a-4d0d-489b-be51-1acbf46bf080 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:21.407516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-28b7b979-ff4b-4294-8a44-dd5be3b56ff7 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:21.428276 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-28b7b979-ff4b-4294-8a44-dd5be3b56ff7 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7" status: 200 len: 1315 microversion: 2.1 time: 0.347343 Sep 07 12:43:21.429269 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1408/2846] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:21 2022] GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:43:21.539715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-872e8a63-f908-4b26-8bb7-03ea1bd238bd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:21.540954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-872e8a63-f908-4b26-8bb7-03ea1bd238bd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: e419158f-482c-4386-814d-4df837dec1ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:21.548315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-872e8a63-f908-4b26-8bb7-03ea1bd238bd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:21.549185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-872e8a63-f908-4b26-8bb7-03ea1bd238bd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:21.549967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-872e8a63-f908-4b26-8bb7-03ea1bd238bd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:21.551098 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-872e8a63-f908-4b26-8bb7-03ea1bd238bd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:21.551853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-872e8a63-f908-4b26-8bb7-03ea1bd238bd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:21.552441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-872e8a63-f908-4b26-8bb7-03ea1bd238bd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:21.654146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2fda0f7a-4d0d-489b-be51-1acbf46bf080 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:21.655120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-872e8a63-f908-4b26-8bb7-03ea1bd238bd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:21.663538 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-872e8a63-f908-4b26-8bb7-03ea1bd238bd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff" status: 200 len: 1221 microversion: 2.1 time: 0.127878 Sep 07 12:43:21.665152 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2fda0f7a-4d0d-489b-be51-1acbf46bf080 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1511 microversion: 2.1 time: 0.340325 Sep 07 12:43:21.667088 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1439/2847] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:21 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1511 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:21.673701 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1409/2848] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:21 2022] GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff => generated 1221 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:43:21.842677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-39d4fc39-bc2b-4c14-a852-7d9ce272354f tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:21.843626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-39d4fc39-bc2b-4c14-a852-7d9ce272354f tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: b847cba9-b245-4b45-b0bd-897d59ba9a67] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:21.890390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39d4fc39-bc2b-4c14-a852-7d9ce272354f tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:21.905960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39d4fc39-bc2b-4c14-a852-7d9ce272354f tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:21.905960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39d4fc39-bc2b-4c14-a852-7d9ce272354f tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:21.905960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39d4fc39-bc2b-4c14-a852-7d9ce272354f tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:21.905960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39d4fc39-bc2b-4c14-a852-7d9ce272354f tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:21.905960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39d4fc39-bc2b-4c14-a852-7d9ce272354f tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:22.009378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-485e3aff-90a8-45d2-9aeb-755e506f166c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:22.011281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-485e3aff-90a8-45d2-9aeb-755e506f166c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:22.025306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-485e3aff-90a8-45d2-9aeb-755e506f166c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:22.026670 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-485e3aff-90a8-45d2-9aeb-755e506f166c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:22.027735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-485e3aff-90a8-45d2-9aeb-755e506f166c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:22.029726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-485e3aff-90a8-45d2-9aeb-755e506f166c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:22.031285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-485e3aff-90a8-45d2-9aeb-755e506f166c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:22.033081 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-485e3aff-90a8-45d2-9aeb-755e506f166c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:22.411894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-39d4fc39-bc2b-4c14-a852-7d9ce272354f tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:22.417504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-485e3aff-90a8-45d2-9aeb-755e506f166c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:22.429767 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-485e3aff-90a8-45d2-9aeb-755e506f166c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1529 microversion: 2.1 time: 0.427969 Sep 07 12:43:22.431030 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1410/2849] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:21 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1529 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:22.472660 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-39d4fc39-bc2b-4c14-a852-7d9ce272354f tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/b847cba9-b245-4b45-b0bd-897d59ba9a67" status: 200 len: 1511 microversion: 2.1 time: 0.643628 Sep 07 12:43:22.475161 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-95bfb2cc-0765-4044-b3f7-68e0f0ce15f1 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:22.476023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-95bfb2cc-0765-4044-b3f7-68e0f0ce15f1 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:22.477214 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1440/2850] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:21 2022] GET /compute/v2.1/servers/b847cba9-b245-4b45-b0bd-897d59ba9a67 => generated 1511 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:22.502205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95bfb2cc-0765-4044-b3f7-68e0f0ce15f1 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:22.503318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95bfb2cc-0765-4044-b3f7-68e0f0ce15f1 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:22.504480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95bfb2cc-0765-4044-b3f7-68e0f0ce15f1 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:22.506763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95bfb2cc-0765-4044-b3f7-68e0f0ce15f1 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:22.507767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95bfb2cc-0765-4044-b3f7-68e0f0ce15f1 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:22.508924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95bfb2cc-0765-4044-b3f7-68e0f0ce15f1 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:22.710157 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ce2d251-675f-44da-a20b-4ef48801480a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:22.711561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5ce2d251-675f-44da-a20b-4ef48801480a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:22.724389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ce2d251-675f-44da-a20b-4ef48801480a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:22.726473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ce2d251-675f-44da-a20b-4ef48801480a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:22.726473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ce2d251-675f-44da-a20b-4ef48801480a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:22.727261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ce2d251-675f-44da-a20b-4ef48801480a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:22.728045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ce2d251-675f-44da-a20b-4ef48801480a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:22.728754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ce2d251-675f-44da-a20b-4ef48801480a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:23.228387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-95bfb2cc-0765-4044-b3f7-68e0f0ce15f1 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:23.248018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5ce2d251-675f-44da-a20b-4ef48801480a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:23.274142 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-95bfb2cc-0765-4044-b3f7-68e0f0ce15f1 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7" status: 200 len: 1315 microversion: 2.1 time: 0.802473 Sep 07 12:43:23.279474 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1411/2851] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:22 2022] GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 => generated 1315 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:43:23.281748 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5ce2d251-675f-44da-a20b-4ef48801480a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1511 microversion: 2.1 time: 0.573525 Sep 07 12:43:23.289601 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1441/2852] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:22 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1511 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:23.308167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d76e8f9c-5db0-4664-ac57-b6288872f274 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:23.308875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d76e8f9c-5db0-4664-ac57-b6288872f274 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: e419158f-482c-4386-814d-4df837dec1ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:23.324887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d76e8f9c-5db0-4664-ac57-b6288872f274 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:23.326352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d76e8f9c-5db0-4664-ac57-b6288872f274 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:23.329262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d76e8f9c-5db0-4664-ac57-b6288872f274 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:23.343250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d76e8f9c-5db0-4664-ac57-b6288872f274 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:23.345369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d76e8f9c-5db0-4664-ac57-b6288872f274 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:23.346515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d76e8f9c-5db0-4664-ac57-b6288872f274 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:23.457039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e55c8c7b-e629-49c9-9447-c39f130b42d6 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:23.457762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e55c8c7b-e629-49c9-9447-c39f130b42d6 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:23.486593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e55c8c7b-e629-49c9-9447-c39f130b42d6 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:23.487606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e55c8c7b-e629-49c9-9447-c39f130b42d6 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:23.492153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e55c8c7b-e629-49c9-9447-c39f130b42d6 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:23.493372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e55c8c7b-e629-49c9-9447-c39f130b42d6 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:23.495516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e55c8c7b-e629-49c9-9447-c39f130b42d6 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:23.496380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e55c8c7b-e629-49c9-9447-c39f130b42d6 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:23.572653 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d76e8f9c-5db0-4664-ac57-b6288872f274 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:23.583782 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d76e8f9c-5db0-4664-ac57-b6288872f274 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff" status: 200 len: 1213 microversion: 2.1 time: 0.302671 Sep 07 12:43:23.590700 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1412/2853] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:23 2022] GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff => generated 1213 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:23.596153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6a255bda-baec-4fbb-b577-c0d79fc41003 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:23.597091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6a255bda-baec-4fbb-b577-c0d79fc41003 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: b847cba9-b245-4b45-b0bd-897d59ba9a67] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:23.613686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a255bda-baec-4fbb-b577-c0d79fc41003 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:23.615243 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a255bda-baec-4fbb-b577-c0d79fc41003 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:23.616367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a255bda-baec-4fbb-b577-c0d79fc41003 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:23.617572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a255bda-baec-4fbb-b577-c0d79fc41003 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:23.618260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a255bda-baec-4fbb-b577-c0d79fc41003 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:23.618899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a255bda-baec-4fbb-b577-c0d79fc41003 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:24.221793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e55c8c7b-e629-49c9-9447-c39f130b42d6 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:24.233721 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e55c8c7b-e629-49c9-9447-c39f130b42d6 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1529 microversion: 2.1 time: 0.781793 Sep 07 12:43:24.253616 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1442/2854] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:23 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1529 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:43:24.305962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d498e5c-c306-4fa2-8637-1e58681f6bfd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:24.306661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1d498e5c-c306-4fa2-8637-1e58681f6bfd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:24.333564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d498e5c-c306-4fa2-8637-1e58681f6bfd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:24.342669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d498e5c-c306-4fa2-8637-1e58681f6bfd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:24.347224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d498e5c-c306-4fa2-8637-1e58681f6bfd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:24.350904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d498e5c-c306-4fa2-8637-1e58681f6bfd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:24.354501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d498e5c-c306-4fa2-8637-1e58681f6bfd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:24.357803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d498e5c-c306-4fa2-8637-1e58681f6bfd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:25.220041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6a255bda-baec-4fbb-b577-c0d79fc41003 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:25.252495 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6a255bda-baec-4fbb-b577-c0d79fc41003 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/b847cba9-b245-4b45-b0bd-897d59ba9a67" status: 200 len: 1511 microversion: 2.1 time: 1.660230 Sep 07 12:43:25.253371 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1413/2855] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:23 2022] GET /compute/v2.1/servers/b847cba9-b245-4b45-b0bd-897d59ba9a67 => generated 1511 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:25.271958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1d498e5c-c306-4fa2-8637-1e58681f6bfd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:25.281278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-db88b253-36db-474f-b9d2-7b3b979e8c5a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:25.286565 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1d498e5c-c306-4fa2-8637-1e58681f6bfd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7" status: 200 len: 1315 microversion: 2.1 time: 0.988555 Sep 07 12:43:25.289412 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1443/2856] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:24 2022] GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 => generated 1315 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:25.298447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-db88b253-36db-474f-b9d2-7b3b979e8c5a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:25.301583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f6a546c8-045c-420b-b0d4-fe17463d8c67 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:25.302826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f6a546c8-045c-420b-b0d4-fe17463d8c67 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: e419158f-482c-4386-814d-4df837dec1ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:25.322879 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6a546c8-045c-420b-b0d4-fe17463d8c67 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:25.323844 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6a546c8-045c-420b-b0d4-fe17463d8c67 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:25.324694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6a546c8-045c-420b-b0d4-fe17463d8c67 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:25.325953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6a546c8-045c-420b-b0d4-fe17463d8c67 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:25.326830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6a546c8-045c-420b-b0d4-fe17463d8c67 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:25.327508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6a546c8-045c-420b-b0d4-fe17463d8c67 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:25.327773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db88b253-36db-474f-b9d2-7b3b979e8c5a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:25.328305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db88b253-36db-474f-b9d2-7b3b979e8c5a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:25.329100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db88b253-36db-474f-b9d2-7b3b979e8c5a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:25.330972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db88b253-36db-474f-b9d2-7b3b979e8c5a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:25.331462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db88b253-36db-474f-b9d2-7b3b979e8c5a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:25.331903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db88b253-36db-474f-b9d2-7b3b979e8c5a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:25.592594 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f6a546c8-045c-420b-b0d4-fe17463d8c67 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:25.607391 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f6a546c8-045c-420b-b0d4-fe17463d8c67 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff" status: 200 len: 1275 microversion: 2.1 time: 0.316228 Sep 07 12:43:25.609610 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1444/2857] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:25 2022] GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff => generated 1275 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:25.616933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-2282e76c-1cc8-43e4-9c74-5a07ae9c561a req-b2d71deb-5e52-47b9-a374-f15108762224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "663da890-aea0-44c3-842f-71ee8abfaac8", "name": "network-vif-deleted", "tag": "91a161ca-8197-4775-8162-05a0be29c897"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:25.645207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2282e76c-1cc8-43e4-9c74-5a07ae9c561a req-b2d71deb-5e52-47b9-a374-f15108762224 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:25.648955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2282e76c-1cc8-43e4-9c74-5a07ae9c561a req-b2d71deb-5e52-47b9-a374-f15108762224 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:25.650789 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2282e76c-1cc8-43e4-9c74-5a07ae9c561a req-b2d71deb-5e52-47b9-a374-f15108762224 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:25.679226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:43:25.699931 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-2282e76c-1cc8-43e4-9c74-5a07ae9c561a req-b2d71deb-5e52-47b9-a374-f15108762224 service nova] Creating event network-vif-deleted:91a161ca-8197-4775-8162-05a0be29c897 for instance 663da890-aea0-44c3-842f-71ee8abfaac8 on n-h1-852087-9 Sep 07 12:43:25.716948 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-2282e76c-1cc8-43e4-9c74-5a07ae9c561a req-b2d71deb-5e52-47b9-a374-f15108762224 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105005 Sep 07 12:43:25.721895 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1445/2858] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:25.730224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c55a6fb0-37b2-4265-b5f1-06f81f45be88 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:25.735007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c55a6fb0-37b2-4265-b5f1-06f81f45be88 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:25.748857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c55a6fb0-37b2-4265-b5f1-06f81f45be88 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:25.750721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c55a6fb0-37b2-4265-b5f1-06f81f45be88 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:25.765769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c55a6fb0-37b2-4265-b5f1-06f81f45be88 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:25.767475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c55a6fb0-37b2-4265-b5f1-06f81f45be88 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:25.772004 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c55a6fb0-37b2-4265-b5f1-06f81f45be88 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:25.772949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c55a6fb0-37b2-4265-b5f1-06f81f45be88 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:25.870425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c55a6fb0-37b2-4265-b5f1-06f81f45be88 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:25.871386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c55a6fb0-37b2-4265-b5f1-06f81f45be88 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:25.872211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c55a6fb0-37b2-4265-b5f1-06f81f45be88 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:25.874223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-c55a6fb0-37b2-4265-b5f1-06f81f45be88 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lazy-loading 'fault' on Instance uuid 663da890-aea0-44c3-842f-71ee8abfaac8 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:43:25.928173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-db88b253-36db-474f-b9d2-7b3b979e8c5a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:25.946822 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-db88b253-36db-474f-b9d2-7b3b979e8c5a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1511 microversion: 2.1 time: 0.673926 Sep 07 12:43:25.947511 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1414/2859] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:25 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1511 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:26.071924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c55a6fb0-37b2-4265-b5f1-06f81f45be88 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:26.103505 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c55a6fb0-37b2-4265-b5f1-06f81f45be88 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 200 len: 1315 microversion: 2.1 time: 0.379149 Sep 07 12:43:26.104614 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1446/2860] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:25 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:26.109025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0f49ad17-fa4a-4108-90c4-5e344786c3d4 req-21ce9d38-e373-4ab8-9e99-a4b00cfda742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b847cba9-b245-4b45-b0bd-897d59ba9a67", "name": "network-vif-deleted", "tag": "21e4d80d-0a18-4cd6-898c-dfdd13455bca"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:26.156264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0f49ad17-fa4a-4108-90c4-5e344786c3d4 req-21ce9d38-e373-4ab8-9e99-a4b00cfda742 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:26.157119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0f49ad17-fa4a-4108-90c4-5e344786c3d4 req-21ce9d38-e373-4ab8-9e99-a4b00cfda742 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:26.157818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0f49ad17-fa4a-4108-90c4-5e344786c3d4 req-21ce9d38-e373-4ab8-9e99-a4b00cfda742 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:26.196701 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0f49ad17-fa4a-4108-90c4-5e344786c3d4 req-21ce9d38-e373-4ab8-9e99-a4b00cfda742 service nova] Creating event network-vif-deleted:21e4d80d-0a18-4cd6-898c-dfdd13455bca for instance b847cba9-b245-4b45-b0bd-897d59ba9a67 on n-h1-852087-9 Sep 07 12:43:26.221114 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0f49ad17-fa4a-4108-90c4-5e344786c3d4 req-21ce9d38-e373-4ab8-9e99-a4b00cfda742 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120625 Sep 07 12:43:26.227964 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1415/2861] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:26.287367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f1ef8d9f-7a2c-45af-a97e-9d17be36c082 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:26.288185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f1ef8d9f-7a2c-45af-a97e-9d17be36c082 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: b847cba9-b245-4b45-b0bd-897d59ba9a67] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:26.306264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1ef8d9f-7a2c-45af-a97e-9d17be36c082 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:26.307580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1ef8d9f-7a2c-45af-a97e-9d17be36c082 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:26.310497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1ef8d9f-7a2c-45af-a97e-9d17be36c082 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:26.311613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1ef8d9f-7a2c-45af-a97e-9d17be36c082 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:26.319373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7082fb8f-d78b-4c08-9297-2eb094259e58 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:26.320918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7082fb8f-d78b-4c08-9297-2eb094259e58 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:26.331416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1ef8d9f-7a2c-45af-a97e-9d17be36c082 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:26.333736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1ef8d9f-7a2c-45af-a97e-9d17be36c082 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:26.347463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7082fb8f-d78b-4c08-9297-2eb094259e58 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:26.353948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7082fb8f-d78b-4c08-9297-2eb094259e58 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:26.357477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7082fb8f-d78b-4c08-9297-2eb094259e58 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:26.362157 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7082fb8f-d78b-4c08-9297-2eb094259e58 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:26.366672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7082fb8f-d78b-4c08-9297-2eb094259e58 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:26.369744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7082fb8f-d78b-4c08-9297-2eb094259e58 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:26.679596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f1ef8d9f-7a2c-45af-a97e-9d17be36c082 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:26.718557 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f1ef8d9f-7a2c-45af-a97e-9d17be36c082 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/b847cba9-b245-4b45-b0bd-897d59ba9a67" status: 200 len: 1302 microversion: 2.1 time: 0.432455 Sep 07 12:43:26.721975 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1447/2862] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:26 2022] GET /compute/v2.1/servers/b847cba9-b245-4b45-b0bd-897d59ba9a67 => generated 1302 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:26.738316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5365abe8-7335-4a87-8be9-c9ce10ee4562 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:26.739711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5365abe8-7335-4a87-8be9-c9ce10ee4562 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: e419158f-482c-4386-814d-4df837dec1ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:26.762441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5365abe8-7335-4a87-8be9-c9ce10ee4562 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:26.763525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5365abe8-7335-4a87-8be9-c9ce10ee4562 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:26.764179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5365abe8-7335-4a87-8be9-c9ce10ee4562 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:26.766054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5365abe8-7335-4a87-8be9-c9ce10ee4562 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:26.783486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5365abe8-7335-4a87-8be9-c9ce10ee4562 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:26.786162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5365abe8-7335-4a87-8be9-c9ce10ee4562 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:26.938274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7082fb8f-d78b-4c08-9297-2eb094259e58 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:26.958163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:43:26.972416 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7082fb8f-d78b-4c08-9297-2eb094259e58 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7" status: 200 len: 1315 microversion: 2.1 time: 0.658670 Sep 07 12:43:26.986162 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1416/2863] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:26 2022] GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 => generated 1315 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:26.997975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-48ebfe61-ca96-4d0f-9ba8-447552491ef0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:26.998975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-48ebfe61-ca96-4d0f-9ba8-447552491ef0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:27.009304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48ebfe61-ca96-4d0f-9ba8-447552491ef0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:27.010213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48ebfe61-ca96-4d0f-9ba8-447552491ef0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:27.010700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48ebfe61-ca96-4d0f-9ba8-447552491ef0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:27.011444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48ebfe61-ca96-4d0f-9ba8-447552491ef0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:27.011905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48ebfe61-ca96-4d0f-9ba8-447552491ef0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:27.012524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48ebfe61-ca96-4d0f-9ba8-447552491ef0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:27.038492 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5365abe8-7335-4a87-8be9-c9ce10ee4562 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:27.047377 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5365abe8-7335-4a87-8be9-c9ce10ee4562 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff" status: 200 len: 1275 microversion: 2.1 time: 0.323938 Sep 07 12:43:27.048305 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1448/2864] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:26 2022] GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff => generated 1275 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:27.055109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:43:27.136675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd5ef248-f046-49c9-9e00-27664722daca tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:27.138061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dd5ef248-f046-49c9-9e00-27664722daca tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:27.147577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd5ef248-f046-49c9-9e00-27664722daca tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:27.148529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd5ef248-f046-49c9-9e00-27664722daca tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:27.149569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd5ef248-f046-49c9-9e00-27664722daca tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:27.150597 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd5ef248-f046-49c9-9e00-27664722daca tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:27.151533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd5ef248-f046-49c9-9e00-27664722daca tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:27.152283 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd5ef248-f046-49c9-9e00-27664722daca tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:27.170219 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-dd5ef248-f046-49c9-9e00-27664722daca tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] HTTP exception thrown: Instance 663da890-aea0-44c3-842f-71ee8abfaac8 could not be found. Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd5ef248-f046-49c9-9e00-27664722daca tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Request method failure captured: Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 HTTP/1.1 Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJGQYbyJLIsXxXjgkDYN7LwAZ3FIxjt-YGkXt1Xo1a1MUwTVDulf3qar21KhPKqmmgY5XowXVa7QiIPma2KSUUJYmnQLgFXdiW6Ghu6fpYXXYUWnHmYT3Op2c2gidR2lsMRLQPmqnvHgSb4f0Vzgm_QdSzSUbn3j0rcW4vT7twxuCxo Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: ac0d1c1e891c470c99e7c968b908a054 Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 663da890-aea0-44c3-842f-71ee8abfaac8 could not be found. Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '663da890-aea0-44c3-842f-71ee8abfaac8'} Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 663da890-aea0-44c3-842f-71ee8abfaac8 could not be found. Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 663da890-aea0-44c3-842f-71ee8abfaac8 could not be found. Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:27.172574 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:27.176478 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:27.176478 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:27.176478 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:27.176478 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:27.176478 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:43:27.176478 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:43:27.176478 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 663da890-aea0-44c3-842f-71ee8abfaac8 could not be found. Sep 07 12:43:27.176478 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:27.176478 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd5ef248-f046-49c9-9e00-27664722daca tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Returning 404 to user: Instance 663da890-aea0-44c3-842f-71ee8abfaac8 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:43:27.176478 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dd5ef248-f046-49c9-9e00-27664722daca tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 404 len: 111 microversion: 2.1 time: 0.044495 Sep 07 12:43:27.176478 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1449/2865] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:27 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:43:27.187711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fbc2fe32-b789-4011-809b-1e130b608ebd tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Action: 'create', calling method: .version_select at 0x7fc41982f550>, body: {"keypair": {"name": "tempest-keypair-314828128", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhXLSPHV3JigqNrcCTIbMN5h+0T8dazOya7LCEtHB+dhPbN4uij6Ow4LOqBq8Sgzo2i8lgQM3od2d6KYWYqRAXNHWTbdciBCxXqrpkm8jHoYl1D9ylY/sOaQsSYtX7xkA=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:27.193785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:43:27.213239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-fbc2fe32-b789-4011-809b-1e130b608ebd tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Getting quotas for project feb4e290866f4f54b2b99733b56cb7bd. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:43:27.221733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-fbc2fe32-b789-4011-809b-1e130b608ebd tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Getting quotas for user ac0d1c1e891c470c99e7c968b908a054 and project feb4e290866f4f54b2b99733b56cb7bd. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:43:27.261532 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fbc2fe32-b789-4011-809b-1e130b608ebd tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.077719 Sep 07 12:43:27.263543 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1450/2866] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 12:43:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:43:27.317918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-48ebfe61-ca96-4d0f-9ba8-447552491ef0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:27.336582 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-48ebfe61-ca96-4d0f-9ba8-447552491ef0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1511 microversion: 2.1 time: 0.347641 Sep 07 12:43:27.338217 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1417/2867] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:26 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1511 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:27.778289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-260f2828-464c-4014-bb56-930081422165 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:27.824350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-260f2828-464c-4014-bb56-930081422165 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: b847cba9-b245-4b45-b0bd-897d59ba9a67] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:27.912560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-260f2828-464c-4014-bb56-930081422165 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:27.916610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-260f2828-464c-4014-bb56-930081422165 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:27.919344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-260f2828-464c-4014-bb56-930081422165 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:27.924122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-260f2828-464c-4014-bb56-930081422165 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:27.924814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-260f2828-464c-4014-bb56-930081422165 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:27.925463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-260f2828-464c-4014-bb56-930081422165 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:28.012185 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-260f2828-464c-4014-bb56-930081422165 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] HTTP exception thrown: Instance b847cba9-b245-4b45-b0bd-897d59ba9a67 could not be found. Sep 07 12:43:28.015841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-61ee6aad-72af-4ad7-a405-bd41f6b1c439 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:28.016742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-61ee6aad-72af-4ad7-a405-bd41f6b1c439 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-260f2828-464c-4014-bb56-930081422165 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Request method failure captured: Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/b847cba9-b245-4b45-b0bd-897d59ba9a67 HTTP/1.1 Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJFw8nGnkNdVmjwWxUKvUm60dLLXYvM5e0lz-7j0tendMYGEgrA1S6tzjUHGBy-aFtnNuZrDqh97-H1Dm3U_Q5J-FmyKnT4BXSQmmaHxNbrLLRf90BrSi0xSklVzJk2KfjRYDwx7tye7d-1bSOMQGeXkgGIl3vPMbLNmSuPgp-GhHvk Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 3479aa98e81346039d54eec7a7fb2304 Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-MultipleCreateTestJSON-1172789111 Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3479aa98e81346039d54eec7a7fb2304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3479aa98e81346039d54eec7a7fb2304"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3479aa98e81346039d54eec7a7fb2304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3479aa98e81346039d54eec7a7fb2304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-MultipleCreateTestJSON-1172789111 Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 3479aa98e81346039d54eec7a7fb2304 Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1172789111 Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-MultipleCreateTestJSON-1172789111-project Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 1f6382498aed492590e3fb1896f692f7 Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-MultipleCreateTestJSON-1172789111-project Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance b847cba9-b245-4b45-b0bd-897d59ba9a67 could not be found. Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'b847cba9-b245-4b45-b0bd-897d59ba9a67'} Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b847cba9-b245-4b45-b0bd-897d59ba9a67 could not be found. Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b847cba9-b245-4b45-b0bd-897d59ba9a67 could not be found. Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:28.018056 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:28.021993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:28.021993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:28.021993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:28.021993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:43:28.021993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:43:28.021993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b847cba9-b245-4b45-b0bd-897d59ba9a67 could not be found. Sep 07 12:43:28.021993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:43:28.030763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61ee6aad-72af-4ad7-a405-bd41f6b1c439 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:28.031005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-260f2828-464c-4014-bb56-930081422165 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Returning 404 to user: Instance b847cba9-b245-4b45-b0bd-897d59ba9a67 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:43:28.033062 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-260f2828-464c-4014-bb56-930081422165 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/b847cba9-b245-4b45-b0bd-897d59ba9a67" status: 404 len: 111 microversion: 2.1 time: 0.290527 Sep 07 12:43:28.033806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61ee6aad-72af-4ad7-a405-bd41f6b1c439 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:28.035187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61ee6aad-72af-4ad7-a405-bd41f6b1c439 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:28.039913 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1451/2868] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:27 2022] GET /compute/v2.1/servers/b847cba9-b245-4b45-b0bd-897d59ba9a67 => generated 111 bytes in 299 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:43:28.040886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61ee6aad-72af-4ad7-a405-bd41f6b1c439 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:28.041558 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61ee6aad-72af-4ad7-a405-bd41f6b1c439 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:28.048556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61ee6aad-72af-4ad7-a405-bd41f6b1c439 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:28.057966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-68266f6e-5eae-4ef9-becf-67dfd3228a43 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:28.063148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-68266f6e-5eae-4ef9-becf-67dfd3228a43 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 4bb43114-1042-49c5-b60c-2474dae9f021] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:28.074967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68266f6e-5eae-4ef9-becf-67dfd3228a43 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:28.076946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68266f6e-5eae-4ef9-becf-67dfd3228a43 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:28.077698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68266f6e-5eae-4ef9-becf-67dfd3228a43 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:28.078951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68266f6e-5eae-4ef9-becf-67dfd3228a43 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:28.079618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68266f6e-5eae-4ef9-becf-67dfd3228a43 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:28.080260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68266f6e-5eae-4ef9-becf-67dfd3228a43 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:28.144602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68266f6e-5eae-4ef9-becf-67dfd3228a43 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:28.146288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68266f6e-5eae-4ef9-becf-67dfd3228a43 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:28.147862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68266f6e-5eae-4ef9-becf-67dfd3228a43 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:28.149868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-68266f6e-5eae-4ef9-becf-67dfd3228a43 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lazy-loading 'fault' on Instance uuid 4bb43114-1042-49c5-b60c-2474dae9f021 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:43:28.308846 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:43:28.483178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-68266f6e-5eae-4ef9-becf-67dfd3228a43 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:28.530143 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-68266f6e-5eae-4ef9-becf-67dfd3228a43 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021" status: 200 len: 1307 microversion: 2.1 time: 0.485901 Sep 07 12:43:28.533106 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1452/2869] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:28 2022] GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021 => generated 1307 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:28.546914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ae73ca2-c3ea-4832-a885-de0b48e7c9cb tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:28.546914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6ae73ca2-c3ea-4832-a885-de0b48e7c9cb tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: e419158f-482c-4386-814d-4df837dec1ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:28.564298 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ae73ca2-c3ea-4832-a885-de0b48e7c9cb tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:28.565202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ae73ca2-c3ea-4832-a885-de0b48e7c9cb tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:28.565945 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ae73ca2-c3ea-4832-a885-de0b48e7c9cb tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:28.567245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ae73ca2-c3ea-4832-a885-de0b48e7c9cb tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:28.568693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ae73ca2-c3ea-4832-a885-de0b48e7c9cb tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:28.571013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ae73ca2-c3ea-4832-a885-de0b48e7c9cb tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:28.614589 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-61ee6aad-72af-4ad7-a405-bd41f6b1c439 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:28.632371 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-61ee6aad-72af-4ad7-a405-bd41f6b1c439 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7" status: 200 len: 1315 microversion: 2.1 time: 0.620144 Sep 07 12:43:28.652932 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1418/2870] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:28 2022] GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 => generated 1315 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:43:28.693322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-d93a13b4-9ea8-4f81-9312-4c03f90075fb req-67e0c57d-28fb-467d-8dc8-80669cbdf181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb43114-1042-49c5-b60c-2474dae9f021", "name": "network-vif-deleted", "tag": "14322b51-ee31-4407-9e34-e85d7d459730"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:28.709973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6ae73ca2-c3ea-4832-a885-de0b48e7c9cb tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:28.713285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d93a13b4-9ea8-4f81-9312-4c03f90075fb req-67e0c57d-28fb-467d-8dc8-80669cbdf181 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:28.714484 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d93a13b4-9ea8-4f81-9312-4c03f90075fb req-67e0c57d-28fb-467d-8dc8-80669cbdf181 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:28.716453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d93a13b4-9ea8-4f81-9312-4c03f90075fb req-67e0c57d-28fb-467d-8dc8-80669cbdf181 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:28.718953 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6ae73ca2-c3ea-4832-a885-de0b48e7c9cb tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff" status: 200 len: 1275 microversion: 2.1 time: 0.185867 Sep 07 12:43:28.719554 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1453/2871] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:28 2022] GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff => generated 1275 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:28.733920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8182a855-4eb0-4450-a4f2-ad0de55eba00 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:28.742589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8182a855-4eb0-4450-a4f2-ad0de55eba00 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:28.752087 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-d93a13b4-9ea8-4f81-9312-4c03f90075fb req-67e0c57d-28fb-467d-8dc8-80669cbdf181 service nova] Creating event network-vif-deleted:14322b51-ee31-4407-9e34-e85d7d459730 for instance 4bb43114-1042-49c5-b60c-2474dae9f021 on n-h1-852087-9 Sep 07 12:43:28.753953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8182a855-4eb0-4450-a4f2-ad0de55eba00 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:28.755227 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8182a855-4eb0-4450-a4f2-ad0de55eba00 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:28.756682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8182a855-4eb0-4450-a4f2-ad0de55eba00 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:28.757934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8182a855-4eb0-4450-a4f2-ad0de55eba00 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:28.761287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8182a855-4eb0-4450-a4f2-ad0de55eba00 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:28.765904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8182a855-4eb0-4450-a4f2-ad0de55eba00 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:28.776049 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-d93a13b4-9ea8-4f81-9312-4c03f90075fb req-67e0c57d-28fb-467d-8dc8-80669cbdf181 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120626 Sep 07 12:43:28.777908 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1419/2872] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:29.397227 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8182a855-4eb0-4450-a4f2-ad0de55eba00 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:29.428007 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8182a855-4eb0-4450-a4f2-ad0de55eba00 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1511 microversion: 2.1 time: 0.706879 Sep 07 12:43:29.432233 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1454/2873] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:28 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1511 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:29.563285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-365927e8-f533-4382-a59e-8839deebfbd7 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:29.564329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-365927e8-f533-4382-a59e-8839deebfbd7 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 4bb43114-1042-49c5-b60c-2474dae9f021] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:29.574727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-365927e8-f533-4382-a59e-8839deebfbd7 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:29.575614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-365927e8-f533-4382-a59e-8839deebfbd7 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:29.576331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-365927e8-f533-4382-a59e-8839deebfbd7 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:29.577298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-365927e8-f533-4382-a59e-8839deebfbd7 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:29.578005 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-365927e8-f533-4382-a59e-8839deebfbd7 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:29.579129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-365927e8-f533-4382-a59e-8839deebfbd7 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:29.616299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-365927e8-f533-4382-a59e-8839deebfbd7 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:29.617689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-365927e8-f533-4382-a59e-8839deebfbd7 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:29.618414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-365927e8-f533-4382-a59e-8839deebfbd7 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:29.619389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-365927e8-f533-4382-a59e-8839deebfbd7 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lazy-loading 'fault' on Instance uuid 4bb43114-1042-49c5-b60c-2474dae9f021 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:43:29.679380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6cc7ed80-04af-4784-b628-66dda87b55e9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:29.682423 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6cc7ed80-04af-4784-b628-66dda87b55e9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:29.704799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cc7ed80-04af-4784-b628-66dda87b55e9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:29.706287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cc7ed80-04af-4784-b628-66dda87b55e9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:29.707457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cc7ed80-04af-4784-b628-66dda87b55e9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:29.709148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cc7ed80-04af-4784-b628-66dda87b55e9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:29.710347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cc7ed80-04af-4784-b628-66dda87b55e9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:29.711460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cc7ed80-04af-4784-b628-66dda87b55e9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:29.743875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-365927e8-f533-4382-a59e-8839deebfbd7 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:29.784595 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-365927e8-f533-4382-a59e-8839deebfbd7 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021" status: 200 len: 1307 microversion: 2.1 time: 0.226835 Sep 07 12:43:29.790341 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1420/2874] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:29 2022] GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021 => generated 1307 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:29.797791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e0840a0c-0f8e-4647-aa82-170a6e99325f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:29.798763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e0840a0c-0f8e-4647-aa82-170a6e99325f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: e419158f-482c-4386-814d-4df837dec1ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:29.812158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:43:29.828132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0840a0c-0f8e-4647-aa82-170a6e99325f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:29.829081 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0840a0c-0f8e-4647-aa82-170a6e99325f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:29.829470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0840a0c-0f8e-4647-aa82-170a6e99325f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:29.830230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0840a0c-0f8e-4647-aa82-170a6e99325f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:29.834900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0840a0c-0f8e-4647-aa82-170a6e99325f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:29.835758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0840a0c-0f8e-4647-aa82-170a6e99325f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:30.176526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6cc7ed80-04af-4784-b628-66dda87b55e9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:30.237732 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6cc7ed80-04af-4784-b628-66dda87b55e9 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7" status: 200 len: 1315 microversion: 2.1 time: 0.566181 Sep 07 12:43:30.245632 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1455/2875] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:29 2022] GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 => generated 1315 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:30.282791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e0840a0c-0f8e-4647-aa82-170a6e99325f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:30.312974 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e0840a0c-0f8e-4647-aa82-170a6e99325f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff" status: 200 len: 1317 microversion: 2.1 time: 0.518606 Sep 07 12:43:30.324450 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1421/2876] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:29 2022] GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff => generated 1317 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:30.471424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-25312a0c-0ca2-4dcf-a429-611e639b36cd tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:30.473380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-25312a0c-0ca2-4dcf-a429-611e639b36cd tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:30.485453 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25312a0c-0ca2-4dcf-a429-611e639b36cd tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:30.487123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25312a0c-0ca2-4dcf-a429-611e639b36cd tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:30.488400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25312a0c-0ca2-4dcf-a429-611e639b36cd tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:30.491009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25312a0c-0ca2-4dcf-a429-611e639b36cd tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:30.492307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25312a0c-0ca2-4dcf-a429-611e639b36cd tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:30.493474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25312a0c-0ca2-4dcf-a429-611e639b36cd tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:30.835942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2f822a60-af44-42f5-becb-ff24e8666ffd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:30.838057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2f822a60-af44-42f5-becb-ff24e8666ffd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 4bb43114-1042-49c5-b60c-2474dae9f021] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:30.864272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f822a60-af44-42f5-becb-ff24e8666ffd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:30.865693 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f822a60-af44-42f5-becb-ff24e8666ffd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:30.866327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f822a60-af44-42f5-becb-ff24e8666ffd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:30.868362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f822a60-af44-42f5-becb-ff24e8666ffd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:30.870107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f822a60-af44-42f5-becb-ff24e8666ffd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:30.871154 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f822a60-af44-42f5-becb-ff24e8666ffd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:30.970220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f822a60-af44-42f5-becb-ff24e8666ffd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:30.975655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f822a60-af44-42f5-becb-ff24e8666ffd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:30.976711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f822a60-af44-42f5-becb-ff24e8666ffd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:30.982337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-2f822a60-af44-42f5-becb-ff24e8666ffd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lazy-loading 'fault' on Instance uuid 4bb43114-1042-49c5-b60c-2474dae9f021 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:43:31.432963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2f822a60-af44-42f5-becb-ff24e8666ffd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6382498aed492590e3fb1896f692f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3479aa98e81346039d54eec7a7fb2304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:31.442480 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2f822a60-af44-42f5-becb-ff24e8666ffd tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021" status: 200 len: 1307 microversion: 2.1 time: 0.612043 Sep 07 12:43:31.442480 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1422/2877] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:30 2022] GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021 => generated 1307 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:31.447461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d024653a-8a81-4645-abc9-0a5dbdbebb83 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:31.448112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d024653a-8a81-4645-abc9-0a5dbdbebb83 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:31.455199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d024653a-8a81-4645-abc9-0a5dbdbebb83 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:31.455568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d024653a-8a81-4645-abc9-0a5dbdbebb83 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:31.456016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d024653a-8a81-4645-abc9-0a5dbdbebb83 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:31.456739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d024653a-8a81-4645-abc9-0a5dbdbebb83 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:31.457199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d024653a-8a81-4645-abc9-0a5dbdbebb83 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:31.457843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d024653a-8a81-4645-abc9-0a5dbdbebb83 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:31.468855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-25312a0c-0ca2-4dcf-a429-611e639b36cd tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:31.481603 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-25312a0c-0ca2-4dcf-a429-611e639b36cd tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1511 microversion: 2.1 time: 1.023582 Sep 07 12:43:31.498053 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1456/2878] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:30 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1511 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:31.526974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-24dcdc57-d50e-428c-a7cf-1facfedc0b4c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:31.529169 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-24dcdc57-d50e-428c-a7cf-1facfedc0b4c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: e419158f-482c-4386-814d-4df837dec1ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:31.541917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24dcdc57-d50e-428c-a7cf-1facfedc0b4c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:31.543373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24dcdc57-d50e-428c-a7cf-1facfedc0b4c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:31.544678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24dcdc57-d50e-428c-a7cf-1facfedc0b4c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:31.546331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24dcdc57-d50e-428c-a7cf-1facfedc0b4c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:31.547426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24dcdc57-d50e-428c-a7cf-1facfedc0b4c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:31.548455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24dcdc57-d50e-428c-a7cf-1facfedc0b4c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:32.050224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-24dcdc57-d50e-428c-a7cf-1facfedc0b4c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:32.069349 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-24dcdc57-d50e-428c-a7cf-1facfedc0b4c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff" status: 200 len: 1317 microversion: 2.1 time: 0.567604 Sep 07 12:43:32.083420 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1457/2879] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:31 2022] GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff => generated 1317 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:32.085470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d024653a-8a81-4645-abc9-0a5dbdbebb83 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:32.114054 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d024653a-8a81-4645-abc9-0a5dbdbebb83 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7" status: 200 len: 1315 microversion: 2.1 time: 0.669906 Sep 07 12:43:32.116530 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1423/2880] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:31 2022] GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 => generated 1315 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:32.403383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-71b587e2-e307-4c3c-b7ef-481fdb1bb372 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1260377984", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:32.491057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f00ef605-81d7-4a4f-8292-9a68263055b4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:32.495708 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f00ef605-81d7-4a4f-8292-9a68263055b4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] [instance: 4bb43114-1042-49c5-b60c-2474dae9f021] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:32.505577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-71b587e2-e307-4c3c-b7ef-481fdb1bb372 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] validate_networks() for [('053fbc67-334b-4d09-89d9-46503fbb7c8b', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:43:32.511875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f00ef605-81d7-4a4f-8292-9a68263055b4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:32.512970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f00ef605-81d7-4a4f-8292-9a68263055b4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:32.515249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f00ef605-81d7-4a4f-8292-9a68263055b4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:32.516594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f00ef605-81d7-4a4f-8292-9a68263055b4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:32.518174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f00ef605-81d7-4a4f-8292-9a68263055b4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:32.518957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f00ef605-81d7-4a4f-8292-9a68263055b4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:32.547575 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-f00ef605-81d7-4a4f-8292-9a68263055b4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] HTTP exception thrown: Instance 4bb43114-1042-49c5-b60c-2474dae9f021 could not be found. Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f00ef605-81d7-4a4f-8292-9a68263055b4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Request method failure captured: Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021 HTTP/1.1 Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJFw8nGnkNdVmjwWxUKvUm60dLLXYvM5e0lz-7j0tendMYGEgrA1S6tzjUHGBy-aFtnNuZrDqh97-H1Dm3U_Q5J-FmyKnT4BXSQmmaHxNbrLLRf90BrSi0xSklVzJk2KfjRYDwx7tye7d-1bSOMQGeXkgGIl3vPMbLNmSuPgp-GhHvk Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 3479aa98e81346039d54eec7a7fb2304 Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-MultipleCreateTestJSON-1172789111 Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3479aa98e81346039d54eec7a7fb2304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3479aa98e81346039d54eec7a7fb2304"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3479aa98e81346039d54eec7a7fb2304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3479aa98e81346039d54eec7a7fb2304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-MultipleCreateTestJSON-1172789111 Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 3479aa98e81346039d54eec7a7fb2304 Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1172789111 Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-MultipleCreateTestJSON-1172789111-project Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 1f6382498aed492590e3fb1896f692f7 Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-MultipleCreateTestJSON-1172789111-project Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 4bb43114-1042-49c5-b60c-2474dae9f021 could not be found. Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '4bb43114-1042-49c5-b60c-2474dae9f021'} Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bb43114-1042-49c5-b60c-2474dae9f021 could not be found. Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bb43114-1042-49c5-b60c-2474dae9f021 could not be found. Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:32.550184 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:32.559032 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:32.559032 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:32.559032 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:32.559032 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:43:32.559032 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:43:32.559032 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bb43114-1042-49c5-b60c-2474dae9f021 could not be found. Sep 07 12:43:32.559032 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:32.563168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f00ef605-81d7-4a4f-8292-9a68263055b4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] Returning 404 to user: Instance 4bb43114-1042-49c5-b60c-2474dae9f021 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:43:32.565565 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f00ef605-81d7-4a4f-8292-9a68263055b4 tempest-MultipleCreateTestJSON-1172789111 tempest-MultipleCreateTestJSON-1172789111-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021" status: 404 len: 111 microversion: 2.1 time: 0.079675 Sep 07 12:43:32.572795 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1424/2881] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:32 2022] GET /compute/v2.1/servers/4bb43114-1042-49c5-b60c-2474dae9f021 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:43:32.583052 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f5d56dba-1e3a-434f-9ab8-1d2fc0cdbf7d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:32.584577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f5d56dba-1e3a-434f-9ab8-1d2fc0cdbf7d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:32.599335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5d56dba-1e3a-434f-9ab8-1d2fc0cdbf7d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:32.600754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5d56dba-1e3a-434f-9ab8-1d2fc0cdbf7d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:32.601861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5d56dba-1e3a-434f-9ab8-1d2fc0cdbf7d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:32.603839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5d56dba-1e3a-434f-9ab8-1d2fc0cdbf7d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:32.605066 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5d56dba-1e3a-434f-9ab8-1d2fc0cdbf7d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:32.606263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5d56dba-1e3a-434f-9ab8-1d2fc0cdbf7d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:33.387012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f5d56dba-1e3a-434f-9ab8-1d2fc0cdbf7d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:33.398128 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f5d56dba-1e3a-434f-9ab8-1d2fc0cdbf7d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1511 microversion: 2.1 time: 0.823261 Sep 07 12:43:33.399233 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1425/2882] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:32 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1511 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:33.404707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-871d8351-c740-4e92-b1b3-0d3832965d5d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:33.405562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-871d8351-c740-4e92-b1b3-0d3832965d5d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: e419158f-482c-4386-814d-4df837dec1ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:33.412512 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-871d8351-c740-4e92-b1b3-0d3832965d5d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:33.413306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-871d8351-c740-4e92-b1b3-0d3832965d5d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:33.413948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-871d8351-c740-4e92-b1b3-0d3832965d5d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:33.416364 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-871d8351-c740-4e92-b1b3-0d3832965d5d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:33.417082 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-871d8351-c740-4e92-b1b3-0d3832965d5d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:33.417974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-871d8351-c740-4e92-b1b3-0d3832965d5d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:34.061944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-871d8351-c740-4e92-b1b3-0d3832965d5d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:34.077443 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-871d8351-c740-4e92-b1b3-0d3832965d5d tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff" status: 200 len: 1317 microversion: 2.1 time: 0.674646 Sep 07 12:43:34.078177 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1426/2883] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:33 2022] GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff => generated 1317 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:34.106314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-92bd32c9-1b35-4965-ae47-922aab053934 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:34.107784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-92bd32c9-1b35-4965-ae47-922aab053934 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:34.122046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92bd32c9-1b35-4965-ae47-922aab053934 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:34.123051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92bd32c9-1b35-4965-ae47-922aab053934 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:34.123829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92bd32c9-1b35-4965-ae47-922aab053934 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:34.125618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92bd32c9-1b35-4965-ae47-922aab053934 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:34.126114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92bd32c9-1b35-4965-ae47-922aab053934 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:34.127640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92bd32c9-1b35-4965-ae47-922aab053934 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:35.312775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-92bd32c9-1b35-4965-ae47-922aab053934 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:35.326481 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-92bd32c9-1b35-4965-ae47-922aab053934 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7" status: 200 len: 1315 microversion: 2.1 time: 1.234120 Sep 07 12:43:35.327155 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1427/2884] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:34 2022] GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 => generated 1315 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:35.339425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-d337cf27-3f83-4010-8d33-4663623935c7 req-c36f129e-b584-4ba4-8a80-0f8740fe5926 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e419158f-482c-4386-814d-4df837dec1ff", "tag": "e70800bc-cd41-4110-9353-c80d5bc259aa"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:35.359990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d337cf27-3f83-4010-8d33-4663623935c7 req-c36f129e-b584-4ba4-8a80-0f8740fe5926 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:35.360476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d337cf27-3f83-4010-8d33-4663623935c7 req-c36f129e-b584-4ba4-8a80-0f8740fe5926 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:35.360937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d337cf27-3f83-4010-8d33-4663623935c7 req-c36f129e-b584-4ba4-8a80-0f8740fe5926 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:35.373106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-71b587e2-e307-4c3c-b7ef-481fdb1bb372 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:43:35.374874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-71b587e2-e307-4c3c-b7ef-481fdb1bb372 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:43:35.377429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-71b587e2-e307-4c3c-b7ef-481fdb1bb372 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:43:35.378676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-71b587e2-e307-4c3c-b7ef-481fdb1bb372 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:43:35.380764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-71b587e2-e307-4c3c-b7ef-481fdb1bb372 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:43:35.385215 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-d337cf27-3f83-4010-8d33-4663623935c7 req-c36f129e-b584-4ba4-8a80-0f8740fe5926 service nova] Creating event network-changed:e70800bc-cd41-4110-9353-c80d5bc259aa for instance e419158f-482c-4386-814d-4df837dec1ff on n-h1-852087-9 Sep 07 12:43:35.394008 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-d337cf27-3f83-4010-8d33-4663623935c7 req-c36f129e-b584-4ba4-8a80-0f8740fe5926 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064745 Sep 07 12:43:35.402688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71b587e2-e307-4c3c-b7ef-481fdb1bb372 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:35.403188 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71b587e2-e307-4c3c-b7ef-481fdb1bb372 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:35.404251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71b587e2-e307-4c3c-b7ef-481fdb1bb372 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:35.405082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71b587e2-e307-4c3c-b7ef-481fdb1bb372 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:35.405601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71b587e2-e307-4c3c-b7ef-481fdb1bb372 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:35.406032 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71b587e2-e307-4c3c-b7ef-481fdb1bb372 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:35.406478 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1428/2885] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:35.417280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6da93d9a-bd5d-4e27-972c-c7d3daaba05f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:35.421762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6da93d9a-bd5d-4e27-972c-c7d3daaba05f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:35.438783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-71b587e2-e307-4c3c-b7ef-481fdb1bb372 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Getting quotas for project feb4e290866f4f54b2b99733b56cb7bd. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:43:35.446813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6da93d9a-bd5d-4e27-972c-c7d3daaba05f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:35.448788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6da93d9a-bd5d-4e27-972c-c7d3daaba05f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:35.451492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6da93d9a-bd5d-4e27-972c-c7d3daaba05f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:35.453709 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6da93d9a-bd5d-4e27-972c-c7d3daaba05f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:35.453964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-71b587e2-e307-4c3c-b7ef-481fdb1bb372 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Getting quotas for user ac0d1c1e891c470c99e7c968b908a054 and project feb4e290866f4f54b2b99733b56cb7bd. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:43:35.455076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6da93d9a-bd5d-4e27-972c-c7d3daaba05f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:35.456397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6da93d9a-bd5d-4e27-972c-c7d3daaba05f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:35.482550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-71b587e2-e307-4c3c-b7ef-481fdb1bb372 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:43:35.486194 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-71b587e2-e307-4c3c-b7ef-481fdb1bb372 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:43:35.575857 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-71b587e2-e307-4c3c-b7ef-481fdb1bb372 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.180404 Sep 07 12:43:35.578048 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1458/2886] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:43:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 3185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:43:35.591729 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-87872cdf-aec6-407e-a7e1-a7a6e4671a01 req-450ecb59-ed91-4289-8660-94a980e13835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "209a7f47-3606-42a4-8360-4fa356ad74e7", "name": "network-vif-plugged", "status": "completed", "tag": "5e6b718d-88c1-405f-8b5d-2849933dfc7d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:35.609274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-87872cdf-aec6-407e-a7e1-a7a6e4671a01 req-450ecb59-ed91-4289-8660-94a980e13835 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:35.610223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-87872cdf-aec6-407e-a7e1-a7a6e4671a01 req-450ecb59-ed91-4289-8660-94a980e13835 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:35.610878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-87872cdf-aec6-407e-a7e1-a7a6e4671a01 req-450ecb59-ed91-4289-8660-94a980e13835 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:35.624750 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-87872cdf-aec6-407e-a7e1-a7a6e4671a01 req-450ecb59-ed91-4289-8660-94a980e13835 service nova] Creating event network-vif-plugged:5e6b718d-88c1-405f-8b5d-2849933dfc7d for instance 209a7f47-3606-42a4-8360-4fa356ad74e7 on n-h1-852087-9 Sep 07 12:43:35.635227 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-87872cdf-aec6-407e-a7e1-a7a6e4671a01 req-450ecb59-ed91-4289-8660-94a980e13835 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052252 Sep 07 12:43:35.636724 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1459/2887] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:35.651772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d22beefb-d79b-464f-a7b1-83197da8f483 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:35.654495 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d22beefb-d79b-464f-a7b1-83197da8f483 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: e419158f-482c-4386-814d-4df837dec1ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:35.669621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d22beefb-d79b-464f-a7b1-83197da8f483 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:35.670586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d22beefb-d79b-464f-a7b1-83197da8f483 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:35.671367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d22beefb-d79b-464f-a7b1-83197da8f483 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:35.672664 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d22beefb-d79b-464f-a7b1-83197da8f483 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:35.673580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d22beefb-d79b-464f-a7b1-83197da8f483 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:35.674363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d22beefb-d79b-464f-a7b1-83197da8f483 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:35.915009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6da93d9a-bd5d-4e27-972c-c7d3daaba05f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:35.961703 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6da93d9a-bd5d-4e27-972c-c7d3daaba05f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1511 microversion: 2.1 time: 0.551749 Sep 07 12:43:35.966165 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1429/2888] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:35 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1511 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:35.987976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-59b63721-0085-4b15-af9c-48ba23da1412 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:35.991183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-59b63721-0085-4b15-af9c-48ba23da1412 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:36.171859 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-59b63721-0085-4b15-af9c-48ba23da1412 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:36.188931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d22beefb-d79b-464f-a7b1-83197da8f483 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:36.217809 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-59b63721-0085-4b15-af9c-48ba23da1412 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 200 len: 1225 microversion: 2.1 time: 0.248252 Sep 07 12:43:36.219679 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1430/2889] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:35 2022] GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 1225 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:36.228206 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d22beefb-d79b-464f-a7b1-83197da8f483 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff" status: 200 len: 1317 microversion: 2.1 time: 0.588062 Sep 07 12:43:36.229305 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1460/2890] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:35 2022] GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff => generated 1317 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:36.371618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a9ccb456-889d-493a-bdbb-fdf6d69e7623 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:36.377958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a9ccb456-889d-493a-bdbb-fdf6d69e7623 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:36.419597 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9ccb456-889d-493a-bdbb-fdf6d69e7623 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:36.426366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9ccb456-889d-493a-bdbb-fdf6d69e7623 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:36.427985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9ccb456-889d-493a-bdbb-fdf6d69e7623 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:36.433735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9ccb456-889d-493a-bdbb-fdf6d69e7623 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:36.434817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9ccb456-889d-493a-bdbb-fdf6d69e7623 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:36.435615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9ccb456-889d-493a-bdbb-fdf6d69e7623 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:36.582497 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6b28116f-6874-4473-b520-f47515f298f0 tempest-ServerGroup264TestJSON-2144917153 tempest-ServerGroup264TestJSON-2144917153-project] Action: 'create', calling method: .version_select at 0x7fc41830ed30>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:36.639868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-6b28116f-6874-4473-b520-f47515f298f0 tempest-ServerGroup264TestJSON-2144917153 tempest-ServerGroup264TestJSON-2144917153-project] Getting quotas for project 3bd95895c74e480d908430233510a1cb. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:43:36.647472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-6b28116f-6874-4473-b520-f47515f298f0 tempest-ServerGroup264TestJSON-2144917153 tempest-ServerGroup264TestJSON-2144917153-project] Getting quotas for user f5b2743919bf47e9856f3d9ba873ec1c and project 3bd95895c74e480d908430233510a1cb. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:43:36.740879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-6b28116f-6874-4473-b520-f47515f298f0 tempest-ServerGroup264TestJSON-2144917153 tempest-ServerGroup264TestJSON-2144917153-project] Getting quotas for project 3bd95895c74e480d908430233510a1cb. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:43:36.749017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-6b28116f-6874-4473-b520-f47515f298f0 tempest-ServerGroup264TestJSON-2144917153 tempest-ServerGroup264TestJSON-2144917153-project] Getting quotas for user f5b2743919bf47e9856f3d9ba873ec1c and project 3bd95895c74e480d908430233510a1cb. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:43:36.771136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a9ccb456-889d-493a-bdbb-fdf6d69e7623 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:36.777397 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6b28116f-6874-4473-b520-f47515f298f0 tempest-ServerGroup264TestJSON-2144917153 tempest-ServerGroup264TestJSON-2144917153-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.556033 Sep 07 12:43:36.778454 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1431/2891] 10.222.0.16 () {62 vars in 1214 bytes} [Wed Sep 7 12:43:36 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:43:36.788178 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a9ccb456-889d-493a-bdbb-fdf6d69e7623 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7" status: 200 len: 1315 microversion: 2.1 time: 0.425356 Sep 07 12:43:36.788822 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1461/2892] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:36 2022] GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:36.791736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-20aafc31-b293-4d81-bccc-2370aa455124 tempest-ServerGroup264TestJSON-2144917153 tempest-ServerGroup264TestJSON-2144917153-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:36.812892 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-20aafc31-b293-4d81-bccc-2370aa455124 tempest-ServerGroup264TestJSON-2144917153 tempest-ServerGroup264TestJSON-2144917153-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.026003 Sep 07 12:43:36.821032 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1432/2893] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Sep 7 12:43:36 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:43:36.829080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bc3cf945-f6b0-4bdd-beda-4915d400769c tempest-ServerGroup264TestJSON-2144917153 tempest-ServerGroup264TestJSON-2144917153-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:36.845325 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bc3cf945-f6b0-4bdd-beda-4915d400769c tempest-ServerGroup264TestJSON-2144917153 tempest-ServerGroup264TestJSON-2144917153-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/92a9a0d9-13ab-493d-90b4-df98564fbb52" status: 200 len: 235 microversion: 2.64 time: 0.023288 Sep 07 12:43:36.849225 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1462/2894] 10.222.0.16 () {60 vars in 1304 bytes} [Wed Sep 7 12:43:36 2022] GET /compute/v2.1/os-server-groups/92a9a0d9-13ab-493d-90b4-df98564fbb52 => generated 235 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 12:43:36.865022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bc8663be-fbe0-4fb1-9070-50ffac3719fa tempest-ServerGroup264TestJSON-2144917153 tempest-ServerGroup264TestJSON-2144917153-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:36.991036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-10b70f98-80fe-4e14-b4f3-fac66a08c24d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:36.992176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-10b70f98-80fe-4e14-b4f3-fac66a08c24d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:37.010594 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10b70f98-80fe-4e14-b4f3-fac66a08c24d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:37.015812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10b70f98-80fe-4e14-b4f3-fac66a08c24d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:37.017893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10b70f98-80fe-4e14-b4f3-fac66a08c24d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:37.020135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10b70f98-80fe-4e14-b4f3-fac66a08c24d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:37.025760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10b70f98-80fe-4e14-b4f3-fac66a08c24d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:37.026702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10b70f98-80fe-4e14-b4f3-fac66a08c24d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:37.253916 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bc8663be-fbe0-4fb1-9070-50ffac3719fa tempest-ServerGroup264TestJSON-2144917153 tempest-ServerGroup264TestJSON-2144917153-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/92a9a0d9-13ab-493d-90b4-df98564fbb52" status: 204 len: 0 microversion: 2.64 time: 0.395439 Sep 07 12:43:37.255001 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1433/2895] 10.222.0.16 () {60 vars in 1307 bytes} [Wed Sep 7 12:43:36 2022] DELETE /compute/v2.1/os-server-groups/92a9a0d9-13ab-493d-90b4-df98564fbb52 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:43:37.262840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0a2639b4-b7d8-4de3-9c42-4e4930aeef04 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:37.263503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0a2639b4-b7d8-4de3-9c42-4e4930aeef04 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:37.270895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a2639b4-b7d8-4de3-9c42-4e4930aeef04 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:37.271399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a2639b4-b7d8-4de3-9c42-4e4930aeef04 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:37.271966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a2639b4-b7d8-4de3-9c42-4e4930aeef04 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:37.272715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a2639b4-b7d8-4de3-9c42-4e4930aeef04 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:37.273330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a2639b4-b7d8-4de3-9c42-4e4930aeef04 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:37.273737 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a2639b4-b7d8-4de3-9c42-4e4930aeef04 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:37.566011 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0a2639b4-b7d8-4de3-9c42-4e4930aeef04 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:37.583013 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0a2639b4-b7d8-4de3-9c42-4e4930aeef04 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 200 len: 1277 microversion: 2.1 time: 0.320847 Sep 07 12:43:37.584491 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1434/2896] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:37 2022] GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 1277 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:37.595302 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5f255027-f2e9-4310-9c1e-c9b3f8deaeee tempest-ServerGroup264TestJSON-2144917153 tempest-ServerGroup264TestJSON-2144917153-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:37.614237 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-5f255027-f2e9-4310-9c1e-c9b3f8deaeee tempest-ServerGroup264TestJSON-2144917153 tempest-ServerGroup264TestJSON-2144917153-project] HTTP exception thrown: Instance group 92a9a0d9-13ab-493d-90b4-df98564fbb52 could not be found. Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5f255027-f2e9-4310-9c1e-c9b3f8deaeee tempest-ServerGroup264TestJSON-2144917153 tempest-ServerGroup264TestJSON-2144917153-project] Request method failure captured: Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-server-groups/92a9a0d9-13ab-493d-90b4-df98564fbb52 HTTP/1.1 Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJH32FT3TiA6HoSMly3ySG9h0P-6_tuIJl20D4-nskELuhYAK6mrB-7nEHJt8WsPxsoubN3IXoDvxk_YYZZkLoxCbQUfz9g2oyjVaugQllzQjHv1vi1hAWLc9HcGFvJHLNtxk-bg_G9eBYJCyU6B78mZ2eaMXVzXj5yJ-IhRS_WUdz4 Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.64 Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 3bd95895c74e480d908430233510a1cb Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerGroup264TestJSON-2144917153 Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3bd95895c74e480d908430233510a1cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3bd95895c74e480d908430233510a1cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3bd95895c74e480d908430233510a1cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3bd95895c74e480d908430233510a1cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerGroup264TestJSON-2144917153 Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 3bd95895c74e480d908430233510a1cb Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerGroup264TestJSON-2144917153 Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerGroup264TestJSON-2144917153-project Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: f5b2743919bf47e9856f3d9ba873ec1c Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerGroup264TestJSON-2144917153-project Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance group 92a9a0d9-13ab-493d-90b4-df98564fbb52 could not be found. Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '92a9a0d9-13ab-493d-90b4-df98564fbb52'} Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 92a9a0d9-13ab-493d-90b4-df98564fbb52 could not be found. Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 92a9a0d9-13ab-493d-90b4-df98564fbb52 could not be found. Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:37.622801 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:37.626797 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:37.626797 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:37.626797 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:43:37.626797 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:43:37.626797 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 92a9a0d9-13ab-493d-90b4-df98564fbb52 could not be found. Sep 07 12:43:37.626797 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:37.628632 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5f255027-f2e9-4310-9c1e-c9b3f8deaeee tempest-ServerGroup264TestJSON-2144917153 tempest-ServerGroup264TestJSON-2144917153-project] Returning 404 to user: Instance group 92a9a0d9-13ab-493d-90b4-df98564fbb52 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:43:37.629413 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5f255027-f2e9-4310-9c1e-c9b3f8deaeee tempest-ServerGroup264TestJSON-2144917153 tempest-ServerGroup264TestJSON-2144917153-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/92a9a0d9-13ab-493d-90b4-df98564fbb52" status: 404 len: 117 microversion: 2.64 time: 0.043640 Sep 07 12:43:37.640014 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1435/2897] 10.222.0.16 () {60 vars in 1307 bytes} [Wed Sep 7 12:43:37 2022] DELETE /compute/v2.1/os-server-groups/92a9a0d9-13ab-493d-90b4-df98564fbb52 => generated 117 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:43:37.645762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e544b105-4b02-4b1c-8917-179839ee2b9c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:37.646058 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e544b105-4b02-4b1c-8917-179839ee2b9c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: e419158f-482c-4386-814d-4df837dec1ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:37.664178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e544b105-4b02-4b1c-8917-179839ee2b9c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:37.664448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-10b70f98-80fe-4e14-b4f3-fac66a08c24d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:37.664919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e544b105-4b02-4b1c-8917-179839ee2b9c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:37.665122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e544b105-4b02-4b1c-8917-179839ee2b9c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:37.668484 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e544b105-4b02-4b1c-8917-179839ee2b9c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:37.669005 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e544b105-4b02-4b1c-8917-179839ee2b9c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:37.669464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e544b105-4b02-4b1c-8917-179839ee2b9c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:37.693398 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-10b70f98-80fe-4e14-b4f3-fac66a08c24d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1511 microversion: 2.1 time: 0.706594 Sep 07 12:43:37.701952 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1463/2898] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:36 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1511 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:37.842327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c5b5b84c-cfb7-430e-b14b-df6b34fa58e4 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:37.843897 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c5b5b84c-cfb7-430e-b14b-df6b34fa58e4 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:37.876058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5b5b84c-cfb7-430e-b14b-df6b34fa58e4 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:37.877880 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5b5b84c-cfb7-430e-b14b-df6b34fa58e4 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:37.879122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5b5b84c-cfb7-430e-b14b-df6b34fa58e4 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:37.893033 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5b5b84c-cfb7-430e-b14b-df6b34fa58e4 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:37.897703 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5b5b84c-cfb7-430e-b14b-df6b34fa58e4 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:37.899136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5b5b84c-cfb7-430e-b14b-df6b34fa58e4 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:37.997922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e544b105-4b02-4b1c-8917-179839ee2b9c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:38.013806 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e544b105-4b02-4b1c-8917-179839ee2b9c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff" status: 200 len: 1317 microversion: 2.1 time: 0.375534 Sep 07 12:43:38.014539 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1436/2899] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:37 2022] GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:38.624005 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d4c0ca7a-77b3-4b1b-bbfe-d910b95c2edb tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:38.624708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c5b5b84c-cfb7-430e-b14b-df6b34fa58e4 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:38.636306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d4c0ca7a-77b3-4b1b-bbfe-d910b95c2edb tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:38.647065 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c5b5b84c-cfb7-430e-b14b-df6b34fa58e4 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7" status: 200 len: 1315 microversion: 2.1 time: 0.815303 Sep 07 12:43:38.667684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4c0ca7a-77b3-4b1b-bbfe-d910b95c2edb tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:38.670860 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1464/2900] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:37 2022] GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 => generated 1315 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:38.671422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4c0ca7a-77b3-4b1b-bbfe-d910b95c2edb tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:38.685595 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4c0ca7a-77b3-4b1b-bbfe-d910b95c2edb tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:38.686922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4c0ca7a-77b3-4b1b-bbfe-d910b95c2edb tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:38.698374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4c0ca7a-77b3-4b1b-bbfe-d910b95c2edb tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:38.699161 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4c0ca7a-77b3-4b1b-bbfe-d910b95c2edb tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:38.737831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8e693211-97b0-4e8a-9767-9c6fa30d4e38 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:38.739585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8e693211-97b0-4e8a-9767-9c6fa30d4e38 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:38.751535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e693211-97b0-4e8a-9767-9c6fa30d4e38 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:38.752780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e693211-97b0-4e8a-9767-9c6fa30d4e38 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:38.753514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e693211-97b0-4e8a-9767-9c6fa30d4e38 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:38.754838 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e693211-97b0-4e8a-9767-9c6fa30d4e38 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:38.759675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e693211-97b0-4e8a-9767-9c6fa30d4e38 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:38.760927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e693211-97b0-4e8a-9767-9c6fa30d4e38 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:38.883856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d4c0ca7a-77b3-4b1b-bbfe-d910b95c2edb tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:38.918019 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d4c0ca7a-77b3-4b1b-bbfe-d910b95c2edb tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 200 len: 1295 microversion: 2.1 time: 0.309206 Sep 07 12:43:38.918624 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1437/2901] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:38 2022] GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 1295 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:39.062399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3eabcec1-0d40-485f-b592-15a5c13558ce tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:39.062399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3eabcec1-0d40-485f-b592-15a5c13558ce tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: e419158f-482c-4386-814d-4df837dec1ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:39.077286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3eabcec1-0d40-485f-b592-15a5c13558ce tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:39.078100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3eabcec1-0d40-485f-b592-15a5c13558ce tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:39.079093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3eabcec1-0d40-485f-b592-15a5c13558ce tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:39.080016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3eabcec1-0d40-485f-b592-15a5c13558ce tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:39.080645 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3eabcec1-0d40-485f-b592-15a5c13558ce tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:39.081241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3eabcec1-0d40-485f-b592-15a5c13558ce tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:39.241106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8e693211-97b0-4e8a-9767-9c6fa30d4e38 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:39.278560 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8e693211-97b0-4e8a-9767-9c6fa30d4e38 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1488 microversion: 2.1 time: 0.552829 Sep 07 12:43:39.286544 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1465/2902] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:38 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1488 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:39.341601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f49cc688-5c4b-4cdd-87d0-22fb344e879f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:39.342476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f49cc688-5c4b-4cdd-87d0-22fb344e879f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:39.363600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f49cc688-5c4b-4cdd-87d0-22fb344e879f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:39.364592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f49cc688-5c4b-4cdd-87d0-22fb344e879f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:39.365349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f49cc688-5c4b-4cdd-87d0-22fb344e879f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:39.366817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f49cc688-5c4b-4cdd-87d0-22fb344e879f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:39.368245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f49cc688-5c4b-4cdd-87d0-22fb344e879f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:39.369144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f49cc688-5c4b-4cdd-87d0-22fb344e879f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:39.431244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:43:39.498462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f49cc688-5c4b-4cdd-87d0-22fb344e879f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:43:40.060791 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f49cc688-5c4b-4cdd-87d0-22fb344e879f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 204 len: 0 microversion: 2.1 time: 0.732155 Sep 07 12:43:40.062625 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1466/2903] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:43:39 2022] DELETE /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:43:40.070560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-688d9865-5762-4421-bade-d4c2bad4b8fd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:40.087075 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-688d9865-5762-4421-bade-d4c2bad4b8fd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:40.113437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3eabcec1-0d40-485f-b592-15a5c13558ce tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:40.115806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-688d9865-5762-4421-bade-d4c2bad4b8fd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:40.116528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-688d9865-5762-4421-bade-d4c2bad4b8fd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:40.117911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-688d9865-5762-4421-bade-d4c2bad4b8fd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:40.122577 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3eabcec1-0d40-485f-b592-15a5c13558ce tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff" status: 200 len: 1317 microversion: 2.1 time: 1.065019 Sep 07 12:43:40.126421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-688d9865-5762-4421-bade-d4c2bad4b8fd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:40.127863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-688d9865-5762-4421-bade-d4c2bad4b8fd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:40.128476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-688d9865-5762-4421-bade-d4c2bad4b8fd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:40.129307 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1438/2904] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:39 2022] GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff => generated 1317 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:43:40.149904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e7b8ed92-e460-4bec-93b3-5f7d80d744ee tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:40.151095 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e7b8ed92-e460-4bec-93b3-5f7d80d744ee tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:40.160648 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7b8ed92-e460-4bec-93b3-5f7d80d744ee tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:40.161685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7b8ed92-e460-4bec-93b3-5f7d80d744ee tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:40.163064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7b8ed92-e460-4bec-93b3-5f7d80d744ee tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:40.164531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7b8ed92-e460-4bec-93b3-5f7d80d744ee tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:40.165427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7b8ed92-e460-4bec-93b3-5f7d80d744ee tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:40.170055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e7b8ed92-e460-4bec-93b3-5f7d80d744ee tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:40.710901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e7b8ed92-e460-4bec-93b3-5f7d80d744ee tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:40.716235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:43:40.724311 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e7b8ed92-e460-4bec-93b3-5f7d80d744ee tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 200 len: 1283 microversion: 2.1 time: 0.593717 Sep 07 12:43:40.734237 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1439/2905] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:40 2022] GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 1283 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:40.769555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8663a5e2-e697-4dec-b7d1-770b1398a16f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:40.770543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8663a5e2-e697-4dec-b7d1-770b1398a16f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:40.791040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8663a5e2-e697-4dec-b7d1-770b1398a16f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:40.794030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8663a5e2-e697-4dec-b7d1-770b1398a16f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:40.798306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8663a5e2-e697-4dec-b7d1-770b1398a16f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:40.799563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8663a5e2-e697-4dec-b7d1-770b1398a16f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:40.800313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8663a5e2-e697-4dec-b7d1-770b1398a16f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:40.801209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8663a5e2-e697-4dec-b7d1-770b1398a16f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:40.960647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-688d9865-5762-4421-bade-d4c2bad4b8fd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:40.986745 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-688d9865-5762-4421-bade-d4c2bad4b8fd tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7" status: 200 len: 1315 microversion: 2.1 time: 0.922060 Sep 07 12:43:41.005364 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1467/2906] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:40 2022] GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 => generated 1315 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:41.213537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e02c5dba-3e58-4edb-a851-2d170d69ea63 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:41.220322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e02c5dba-3e58-4edb-a851-2d170d69ea63 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: e419158f-482c-4386-814d-4df837dec1ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:41.259524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e02c5dba-3e58-4edb-a851-2d170d69ea63 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:41.263621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e02c5dba-3e58-4edb-a851-2d170d69ea63 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:41.266956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e02c5dba-3e58-4edb-a851-2d170d69ea63 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:41.274646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e02c5dba-3e58-4edb-a851-2d170d69ea63 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:41.278792 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e02c5dba-3e58-4edb-a851-2d170d69ea63 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:41.280716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e02c5dba-3e58-4edb-a851-2d170d69ea63 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:41.789522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8663a5e2-e697-4dec-b7d1-770b1398a16f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:41.810024 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8663a5e2-e697-4dec-b7d1-770b1398a16f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1494 microversion: 2.1 time: 1.074143 Sep 07 12:43:41.811034 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1440/2907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:40 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1494 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:41.837990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3c57e523-1438-4750-9458-92179fe4b956 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:41.846359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3c57e523-1438-4750-9458-92179fe4b956 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:41.864076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c57e523-1438-4750-9458-92179fe4b956 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:41.864937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c57e523-1438-4750-9458-92179fe4b956 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:41.865749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c57e523-1438-4750-9458-92179fe4b956 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:41.867081 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c57e523-1438-4750-9458-92179fe4b956 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:41.878432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c57e523-1438-4750-9458-92179fe4b956 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:41.879630 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3c57e523-1438-4750-9458-92179fe4b956 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:41.997539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e02c5dba-3e58-4edb-a851-2d170d69ea63 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:42.023805 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e02c5dba-3e58-4edb-a851-2d170d69ea63 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff" status: 200 len: 1317 microversion: 2.1 time: 0.850933 Sep 07 12:43:42.024975 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1468/2908] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:41 2022] GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff => generated 1317 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:43:42.046213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c7d692bc-7bd0-483e-b43a-acccf294d70f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:42.046988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c7d692bc-7bd0-483e-b43a-acccf294d70f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:42.074996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7d692bc-7bd0-483e-b43a-acccf294d70f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:42.075515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7d692bc-7bd0-483e-b43a-acccf294d70f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:42.075965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7d692bc-7bd0-483e-b43a-acccf294d70f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:42.076821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7d692bc-7bd0-483e-b43a-acccf294d70f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:42.077294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7d692bc-7bd0-483e-b43a-acccf294d70f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:42.077761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7d692bc-7bd0-483e-b43a-acccf294d70f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:42.292567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3c57e523-1438-4750-9458-92179fe4b956 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:42.317517 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3c57e523-1438-4750-9458-92179fe4b956 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 200 len: 1283 microversion: 2.1 time: 0.500581 Sep 07 12:43:42.383333 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1441/2909] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:41 2022] GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 1283 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:42.866470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f9fb22c9-0af2-4a26-9b77-6c85430f6652 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:42.871114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f9fb22c9-0af2-4a26-9b77-6c85430f6652 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:42.910507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9fb22c9-0af2-4a26-9b77-6c85430f6652 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:42.911529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9fb22c9-0af2-4a26-9b77-6c85430f6652 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:42.912786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9fb22c9-0af2-4a26-9b77-6c85430f6652 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:42.914340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9fb22c9-0af2-4a26-9b77-6c85430f6652 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:42.915623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9fb22c9-0af2-4a26-9b77-6c85430f6652 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:42.916732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9fb22c9-0af2-4a26-9b77-6c85430f6652 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:43.179403 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c7d692bc-7bd0-483e-b43a-acccf294d70f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:43.194146 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c7d692bc-7bd0-483e-b43a-acccf294d70f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7" status: 200 len: 1315 microversion: 2.1 time: 1.167999 Sep 07 12:43:43.206765 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1469/2910] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:42 2022] GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 => generated 1315 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:43.218553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c0d400b4-a611-465d-b4b5-8c982cb2f500 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:43.219388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c0d400b4-a611-465d-b4b5-8c982cb2f500 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: e419158f-482c-4386-814d-4df837dec1ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:43.227172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0d400b4-a611-465d-b4b5-8c982cb2f500 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:43.227947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0d400b4-a611-465d-b4b5-8c982cb2f500 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:43.228689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0d400b4-a611-465d-b4b5-8c982cb2f500 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:43.229701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0d400b4-a611-465d-b4b5-8c982cb2f500 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:43.230334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0d400b4-a611-465d-b4b5-8c982cb2f500 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:43.230939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0d400b4-a611-465d-b4b5-8c982cb2f500 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:43.477606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f9fb22c9-0af2-4a26-9b77-6c85430f6652 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:43.490221 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f9fb22c9-0af2-4a26-9b77-6c85430f6652 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1494 microversion: 2.1 time: 0.630965 Sep 07 12:43:43.491215 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1442/2911] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:42 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1494 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:43.496407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb541fb9-c71c-4f43-a83b-71e30aa032ab tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:43.497308 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cb541fb9-c71c-4f43-a83b-71e30aa032ab tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:43.506213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb541fb9-c71c-4f43-a83b-71e30aa032ab tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:43.507071 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb541fb9-c71c-4f43-a83b-71e30aa032ab tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:43.507719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb541fb9-c71c-4f43-a83b-71e30aa032ab tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:43.508655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb541fb9-c71c-4f43-a83b-71e30aa032ab tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:43.509339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb541fb9-c71c-4f43-a83b-71e30aa032ab tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:43.510248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb541fb9-c71c-4f43-a83b-71e30aa032ab tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:43.643838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cb541fb9-c71c-4f43-a83b-71e30aa032ab tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:43.648147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c0d400b4-a611-465d-b4b5-8c982cb2f500 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:43.656995 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c0d400b4-a611-465d-b4b5-8c982cb2f500 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff" status: 200 len: 1317 microversion: 2.1 time: 0.448747 Sep 07 12:43:43.677105 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1470/2912] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:43 2022] GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff => generated 1317 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:43.695165 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cb541fb9-c71c-4f43-a83b-71e30aa032ab tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 200 len: 1283 microversion: 2.1 time: 0.201869 Sep 07 12:43:43.697254 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1443/2913] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:43 2022] GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 1283 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:44.220629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-59e736a8-72f8-4223-bd2f-c83065af4fab tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:44.221222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-59e736a8-72f8-4223-bd2f-c83065af4fab tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:44.238683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59e736a8-72f8-4223-bd2f-c83065af4fab tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:44.241343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59e736a8-72f8-4223-bd2f-c83065af4fab tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:44.243329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59e736a8-72f8-4223-bd2f-c83065af4fab tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:44.247260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59e736a8-72f8-4223-bd2f-c83065af4fab tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:44.252126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59e736a8-72f8-4223-bd2f-c83065af4fab tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:44.254344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59e736a8-72f8-4223-bd2f-c83065af4fab tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:44.521121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a79409b8-4ca9-499c-9129-175a16cda9d2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:44.523780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a79409b8-4ca9-499c-9129-175a16cda9d2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:44.556863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a79409b8-4ca9-499c-9129-175a16cda9d2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:44.557694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a79409b8-4ca9-499c-9129-175a16cda9d2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:44.558784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a79409b8-4ca9-499c-9129-175a16cda9d2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:44.560111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a79409b8-4ca9-499c-9129-175a16cda9d2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:44.561526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a79409b8-4ca9-499c-9129-175a16cda9d2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:44.562686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a79409b8-4ca9-499c-9129-175a16cda9d2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:44.856276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-59e736a8-72f8-4223-bd2f-c83065af4fab tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:44.875106 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-59e736a8-72f8-4223-bd2f-c83065af4fab tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7" status: 200 len: 1503 microversion: 2.1 time: 0.658534 Sep 07 12:43:44.876157 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1471/2914] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:44 2022] GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 => generated 1503 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:44.882321 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-a2bf9fd2-f57b-4ed1-960b-899cf629414f req-b4464fbe-327f-4d1d-babe-e7ce45c8d6ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e419158f-482c-4386-814d-4df837dec1ff", "name": "network-vif-plugged", "status": "completed", "tag": "e70800bc-cd41-4110-9353-c80d5bc259aa"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:44.914206 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a2bf9fd2-f57b-4ed1-960b-899cf629414f req-b4464fbe-327f-4d1d-babe-e7ce45c8d6ea service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:44.915070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a2bf9fd2-f57b-4ed1-960b-899cf629414f req-b4464fbe-327f-4d1d-babe-e7ce45c8d6ea service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:44.916053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a2bf9fd2-f57b-4ed1-960b-899cf629414f req-b4464fbe-327f-4d1d-babe-e7ce45c8d6ea service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:44.945374 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-a2bf9fd2-f57b-4ed1-960b-899cf629414f req-b4464fbe-327f-4d1d-babe-e7ce45c8d6ea service nova] Creating event network-vif-plugged:e70800bc-cd41-4110-9353-c80d5bc259aa for instance e419158f-482c-4386-814d-4df837dec1ff on n-h1-852087-9 Sep 07 12:43:44.955414 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-a2bf9fd2-f57b-4ed1-960b-899cf629414f req-b4464fbe-327f-4d1d-babe-e7ce45c8d6ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077080 Sep 07 12:43:44.957339 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1472/2915] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:44.969419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-88dc7fba-ead0-4981-9c86-c38b84bc10fd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:44.970196 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a79409b8-4ca9-499c-9129-175a16cda9d2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:44.971284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-88dc7fba-ead0-4981-9c86-c38b84bc10fd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: e419158f-482c-4386-814d-4df837dec1ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:44.980332 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a79409b8-4ca9-499c-9129-175a16cda9d2 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1494 microversion: 2.1 time: 0.466477 Sep 07 12:43:44.983225 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1444/2916] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:44 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1494 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:43:44.989100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-32deb295-f7fc-43f0-b69c-678a2b627e69 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:44.990053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-32deb295-f7fc-43f0-b69c-678a2b627e69 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:44.999823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32deb295-f7fc-43f0-b69c-678a2b627e69 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:45.000595 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32deb295-f7fc-43f0-b69c-678a2b627e69 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:45.001928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32deb295-f7fc-43f0-b69c-678a2b627e69 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:45.002921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32deb295-f7fc-43f0-b69c-678a2b627e69 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:45.003565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32deb295-f7fc-43f0-b69c-678a2b627e69 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:45.004331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32deb295-f7fc-43f0-b69c-678a2b627e69 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:45.018091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88dc7fba-ead0-4981-9c86-c38b84bc10fd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:45.022481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88dc7fba-ead0-4981-9c86-c38b84bc10fd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:45.023798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88dc7fba-ead0-4981-9c86-c38b84bc10fd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:45.027335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88dc7fba-ead0-4981-9c86-c38b84bc10fd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:45.028890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88dc7fba-ead0-4981-9c86-c38b84bc10fd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:45.029962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88dc7fba-ead0-4981-9c86-c38b84bc10fd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:45.413584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-32deb295-f7fc-43f0-b69c-678a2b627e69 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:45.418549 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:43:45.434131 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-32deb295-f7fc-43f0-b69c-678a2b627e69 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 200 len: 1325 microversion: 2.1 time: 0.448621 Sep 07 12:43:45.461677 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1445/2917] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:44 2022] GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 1325 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:45.476957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=38 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:43:45.477252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fad6fb48-44ad-47a6-9502-1d56ee859d0b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2119382530"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:45.477793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fad6fb48-44ad-47a6-9502-1d56ee859d0b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:45.493955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad6fb48-44ad-47a6-9502-1d56ee859d0b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:45.497037 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad6fb48-44ad-47a6-9502-1d56ee859d0b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:45.500818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad6fb48-44ad-47a6-9502-1d56ee859d0b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:45.501652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad6fb48-44ad-47a6-9502-1d56ee859d0b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:45.502313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad6fb48-44ad-47a6-9502-1d56ee859d0b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:45.502766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fad6fb48-44ad-47a6-9502-1d56ee859d0b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:45.523508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-88dc7fba-ead0-4981-9c86-c38b84bc10fd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:45.548049 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-88dc7fba-ead0-4981-9c86-c38b84bc10fd tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff" status: 200 len: 1317 microversion: 2.1 time: 0.582377 Sep 07 12:43:45.574453 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1473/2918] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:44 2022] GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff => generated 1317 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:45.858999 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.network.security_group_api [None req-fad6fb48-44ad-47a6-9502-1d56ee859d0b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Adding security group 078addc5-f778-4355-95e0-80c0ea60a5c0 to port 5e6b718d-88c1-405f-8b5d-2849933dfc7d Sep 07 12:43:46.026639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92913447-c13a-4215-8b12-f03fad7cc770 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:46.027509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-92913447-c13a-4215-8b12-f03fad7cc770 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:46.039919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92913447-c13a-4215-8b12-f03fad7cc770 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:46.044545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92913447-c13a-4215-8b12-f03fad7cc770 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:46.045290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92913447-c13a-4215-8b12-f03fad7cc770 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:46.048727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92913447-c13a-4215-8b12-f03fad7cc770 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:46.051054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92913447-c13a-4215-8b12-f03fad7cc770 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:46.051717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92913447-c13a-4215-8b12-f03fad7cc770 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:46.766152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=10 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:43:46.820114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-92913447-c13a-4215-8b12-f03fad7cc770 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:46.838566 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-92913447-c13a-4215-8b12-f03fad7cc770 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 200 len: 1452 microversion: 2.1 time: 0.816224 Sep 07 12:43:46.849531 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1474/2919] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:46 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 1452 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:43:46.863526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-4fb58f9a-7185-4a1d-8971-0222b95c8be4 req-c9a6ab43-da29-417b-befe-e40cd6845f07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0850dcd6-d5e3-4cea-bcdf-0105880bbc08", "name": "network-vif-deleted", "tag": "0245a691-5a7a-4312-af03-6815cec9da19"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:46.899851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4fb58f9a-7185-4a1d-8971-0222b95c8be4 req-c9a6ab43-da29-417b-befe-e40cd6845f07 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:46.907019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4fb58f9a-7185-4a1d-8971-0222b95c8be4 req-c9a6ab43-da29-417b-befe-e40cd6845f07 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:46.911663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4fb58f9a-7185-4a1d-8971-0222b95c8be4 req-c9a6ab43-da29-417b-befe-e40cd6845f07 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:46.965019 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-4fb58f9a-7185-4a1d-8971-0222b95c8be4 req-c9a6ab43-da29-417b-befe-e40cd6845f07 service nova] Creating event network-vif-deleted:0245a691-5a7a-4312-af03-6815cec9da19 for instance 0850dcd6-d5e3-4cea-bcdf-0105880bbc08 on n-h1-852087-9 Sep 07 12:43:46.992794 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-4fb58f9a-7185-4a1d-8971-0222b95c8be4 req-c9a6ab43-da29-417b-befe-e40cd6845f07 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147360 Sep 07 12:43:46.997523 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1475/2920] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:47.004784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2ede30da-e46f-4dc2-8fe9-aa658c3f1a6a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:47.005549 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2ede30da-e46f-4dc2-8fe9-aa658c3f1a6a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:47.039821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ede30da-e46f-4dc2-8fe9-aa658c3f1a6a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:47.041651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ede30da-e46f-4dc2-8fe9-aa658c3f1a6a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:47.042930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ede30da-e46f-4dc2-8fe9-aa658c3f1a6a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:47.044817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ede30da-e46f-4dc2-8fe9-aa658c3f1a6a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:47.046293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ede30da-e46f-4dc2-8fe9-aa658c3f1a6a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:47.047992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ede30da-e46f-4dc2-8fe9-aa658c3f1a6a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:47.083252 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fad6fb48-44ad-47a6-9502-1d56ee859d0b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "POST /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7/action" status: 202 len: 0 microversion: 2.1 time: 1.620563 Sep 07 12:43:47.089149 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1446/2921] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:43:45 2022] POST /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7/action => generated 0 bytes in 1622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:43:47.089464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec04fa2f-7aa3-4927-ba37-8ca41118772a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:47.104605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ec04fa2f-7aa3-4927-ba37-8ca41118772a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: e419158f-482c-4386-814d-4df837dec1ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:47.133561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec04fa2f-7aa3-4927-ba37-8ca41118772a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:47.139922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec04fa2f-7aa3-4927-ba37-8ca41118772a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:47.141012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec04fa2f-7aa3-4927-ba37-8ca41118772a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:47.148022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec04fa2f-7aa3-4927-ba37-8ca41118772a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:47.152656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec04fa2f-7aa3-4927-ba37-8ca41118772a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:47.154381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec04fa2f-7aa3-4927-ba37-8ca41118772a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:47.542684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2ede30da-e46f-4dc2-8fe9-aa658c3f1a6a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:47.571699 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2ede30da-e46f-4dc2-8fe9-aa658c3f1a6a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 200 len: 1325 microversion: 2.1 time: 0.567901 Sep 07 12:43:47.573962 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1476/2922] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:46 2022] GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 1325 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:47.744416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ec04fa2f-7aa3-4927-ba37-8ca41118772a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:47.757941 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ec04fa2f-7aa3-4927-ba37-8ca41118772a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff" status: 200 len: 1317 microversion: 2.1 time: 0.672381 Sep 07 12:43:47.759178 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1447/2923] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:47 2022] GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff => generated 1317 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:47.768016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b8297e4d-cb9d-46e4-9482-c7320b0cc88d tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '.version_select at 0x7fc4183c5ca0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:48.171337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG neutronclient.v2_0.client [None req-b8297e4d-cb9d-46e4-9482-c7320b0cc88d tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 078addc5-f778-4355-95e0-80c0ea60a5c0 in use.", "detail": ""}} {{(pid=122433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 12:43:48.175383 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-b8297e4d-cb9d-46e4-9482-c7320b0cc88d tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] HTTP exception thrown: Security Group 078addc5-f778-4355-95e0-80c0ea60a5c0 in use. Sep 07 12:43:48.175383 n-d-852087-9 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-70f1b844-4ac0-4708-a618-1598f0965b41'] Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b8297e4d-cb9d-46e4-9482-c7320b0cc88d tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Request method failure captured: Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-security-groups/078addc5-f778-4355-95e0-80c0ea60a5c0 HTTP/1.1 Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJGWMXgN7OdrmO70X8q48ZD-kObLPYOd01ANus8JY-PK7OjbvYCQ097-aKOdLEd3zX6imftUV9BBkR8dj8xCIWAm9yYmlnMVOTu04sxm_YJiyi8RzROPFAn0FZkGq3OAzdh-65OtDl9f1F4UEDEA_AaJuKK-hToemYtm-2HEdw2FTvo Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6c7fac0664f044168f52e7c1a982c48e Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: exception: Security Group 078addc5-f778-4355-95e0-80c0ea60a5c0 in use. Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-70f1b844-4ac0-4708-a618-1598f0965b41'] Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '078addc5-f778-4355-95e0-80c0ea60a5c0'} Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 12:43:48.180532 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 078addc5-f778-4355-95e0-80c0ea60a5c0 in use. Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70f1b844-4ac0-4708-a618-1598f0965b41'] Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 078addc5-f778-4355-95e0-80c0ea60a5c0 in use. Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70f1b844-4ac0-4708-a618-1598f0965b41'] Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 078addc5-f778-4355-95e0-80c0ea60a5c0 in use. Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70f1b844-4ac0-4708-a618-1598f0965b41'] Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 078addc5-f778-4355-95e0-80c0ea60a5c0 in use. Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70f1b844-4ac0-4708-a618-1598f0965b41'] Sep 07 12:43:48.187538 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:48.192111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b8297e4d-cb9d-46e4-9482-c7320b0cc88d tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Returning 400 to user: Security Group 078addc5-f778-4355-95e0-80c0ea60a5c0 in use. Sep 07 12:43:48.192111 n-d-852087-9 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-70f1b844-4ac0-4708-a618-1598f0965b41'] {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:43:48.197382 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b8297e4d-cb9d-46e4-9482-c7320b0cc88d tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/078addc5-f778-4355-95e0-80c0ea60a5c0" status: 400 len: 185 microversion: 2.1 time: 0.436209 Sep 07 12:43:48.204481 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1448/2924] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:43:47 2022] DELETE /compute/v2.1/os-security-groups/078addc5-f778-4355-95e0-80c0ea60a5c0 => generated 185 bytes in 445 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:43:48.233089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-f36e95bc-4e54-4494-b5d4-738b6caec1be req-44c6099b-2e60-4b5a-9f30-59b56632b113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "209a7f47-3606-42a4-8360-4fa356ad74e7", "tag": "5e6b718d-88c1-405f-8b5d-2849933dfc7d"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:48.290915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f36e95bc-4e54-4494-b5d4-738b6caec1be req-44c6099b-2e60-4b5a-9f30-59b56632b113 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:48.291953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f36e95bc-4e54-4494-b5d4-738b6caec1be req-44c6099b-2e60-4b5a-9f30-59b56632b113 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:48.292940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f36e95bc-4e54-4494-b5d4-738b6caec1be req-44c6099b-2e60-4b5a-9f30-59b56632b113 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:48.337120 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-f36e95bc-4e54-4494-b5d4-738b6caec1be req-44c6099b-2e60-4b5a-9f30-59b56632b113 service nova] Creating event network-changed:5e6b718d-88c1-405f-8b5d-2849933dfc7d for instance 209a7f47-3606-42a4-8360-4fa356ad74e7 on n-h1-852087-9 Sep 07 12:43:48.352626 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-f36e95bc-4e54-4494-b5d4-738b6caec1be req-44c6099b-2e60-4b5a-9f30-59b56632b113 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143170 Sep 07 12:43:48.357088 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1449/2925] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:48.371002 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-06dbf96c-cb30-4c25-ab76-e9001cdfec08 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:48.376056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-06dbf96c-cb30-4c25-ab76-e9001cdfec08 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:48.407887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06dbf96c-cb30-4c25-ab76-e9001cdfec08 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:48.412152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06dbf96c-cb30-4c25-ab76-e9001cdfec08 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:48.412655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06dbf96c-cb30-4c25-ab76-e9001cdfec08 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:48.419139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06dbf96c-cb30-4c25-ab76-e9001cdfec08 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:48.419739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06dbf96c-cb30-4c25-ab76-e9001cdfec08 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:48.420198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06dbf96c-cb30-4c25-ab76-e9001cdfec08 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:48.469145 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-06dbf96c-cb30-4c25-ab76-e9001cdfec08 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] HTTP exception thrown: Instance 0850dcd6-d5e3-4cea-bcdf-0105880bbc08 could not be found. Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-06dbf96c-cb30-4c25-ab76-e9001cdfec08 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Request method failure captured: Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 HTTP/1.1 Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJBoiaP7MPiSaP6e6aUmMJ8PuR8TxD72E3ycIsoyb5pICiti0ZKBvrRvNoP9EgDHIO9YzOUucG9iu3oQZMsvYh9Gs4g9xjGSFcMGctGxplJk2OO0Aofdu3Ru80K0M86m3EPIBI5c12Fca4rxAASE3osSSig78ynw4pFvNNSiXm2zkBk Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef5b2dd007e944358d72268414868096"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef5b2dd007e944358d72268414868096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: b920811be01745fc9faea7a9ce213c6e Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 0850dcd6-d5e3-4cea-bcdf-0105880bbc08 could not be found. Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '0850dcd6-d5e3-4cea-bcdf-0105880bbc08'} Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0850dcd6-d5e3-4cea-bcdf-0105880bbc08 could not be found. Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0850dcd6-d5e3-4cea-bcdf-0105880bbc08 could not be found. Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:43:48.471486 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:48.479258 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:43:48.479258 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:43:48.479258 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:43:48.479258 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:43:48.479258 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:43:48.479258 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0850dcd6-d5e3-4cea-bcdf-0105880bbc08 could not be found. Sep 07 12:43:48.479258 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:43:48.479258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-06dbf96c-cb30-4c25-ab76-e9001cdfec08 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Returning 404 to user: Instance 0850dcd6-d5e3-4cea-bcdf-0105880bbc08 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:43:48.479258 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-06dbf96c-cb30-4c25-ab76-e9001cdfec08 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 404 len: 111 microversion: 2.1 time: 0.113166 Sep 07 12:43:48.479258 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1450/2926] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:48 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:43:48.480576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-51a9a77b-4eea-4b6a-b7b1-505f6e281f68 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:48.485533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-51a9a77b-4eea-4b6a-b7b1-505f6e281f68 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:48.488307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3bc67dd2-c2ab-48ac-9177-bc0245aef25b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1471084871", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:48.491104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51a9a77b-4eea-4b6a-b7b1-505f6e281f68 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:48.491623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51a9a77b-4eea-4b6a-b7b1-505f6e281f68 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:48.492074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51a9a77b-4eea-4b6a-b7b1-505f6e281f68 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:48.492830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51a9a77b-4eea-4b6a-b7b1-505f6e281f68 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:48.493304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51a9a77b-4eea-4b6a-b7b1-505f6e281f68 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:48.493792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51a9a77b-4eea-4b6a-b7b1-505f6e281f68 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:48.615937 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-51a9a77b-4eea-4b6a-b7b1-505f6e281f68 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "POST /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7/action" status: 202 len: 0 microversion: 2.1 time: 0.135031 Sep 07 12:43:48.634535 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1451/2927] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:43:48 2022] POST /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:43:48.650084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c6adaeea-5796-4d18-8c83-500d1dbd60d6 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:48.652017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c6adaeea-5796-4d18-8c83-500d1dbd60d6 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:48.662621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6adaeea-5796-4d18-8c83-500d1dbd60d6 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:48.663428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6adaeea-5796-4d18-8c83-500d1dbd60d6 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:48.664043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6adaeea-5796-4d18-8c83-500d1dbd60d6 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:48.665477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6adaeea-5796-4d18-8c83-500d1dbd60d6 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:48.678719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6adaeea-5796-4d18-8c83-500d1dbd60d6 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:48.682449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6adaeea-5796-4d18-8c83-500d1dbd60d6 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:48.715900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-3bc67dd2-c2ab-48ac-9177-bc0245aef25b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] validate_networks() for [('1850ed1e-2cdb-4fcf-aa55-0e1010b69611', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:43:49.287880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c6adaeea-5796-4d18-8c83-500d1dbd60d6 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:49.316040 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c6adaeea-5796-4d18-8c83-500d1dbd60d6 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 200 len: 1325 microversion: 2.1 time: 0.677242 Sep 07 12:43:49.317333 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1452/2928] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:48 2022] GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 1325 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:49.358760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-af2a6fc7-081b-463d-b18a-5896bcfa9324 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:49.361920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-af2a6fc7-081b-463d-b18a-5896bcfa9324 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:49.387964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af2a6fc7-081b-463d-b18a-5896bcfa9324 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:49.390994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af2a6fc7-081b-463d-b18a-5896bcfa9324 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:49.391976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af2a6fc7-081b-463d-b18a-5896bcfa9324 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:49.397661 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af2a6fc7-081b-463d-b18a-5896bcfa9324 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:49.399074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af2a6fc7-081b-463d-b18a-5896bcfa9324 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:49.402072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af2a6fc7-081b-463d-b18a-5896bcfa9324 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:50.358157 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-af2a6fc7-081b-463d-b18a-5896bcfa9324 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:50.370299 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-af2a6fc7-081b-463d-b18a-5896bcfa9324 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7" status: 200 len: 1574 microversion: 2.1 time: 1.028658 Sep 07 12:43:50.370829 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1453/2929] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:49 2022] GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 => generated 1574 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:50.381924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2daf8580-de14-4c68-9b13-e61d785e4ee1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:50.382892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2daf8580-de14-4c68-9b13-e61d785e4ee1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: e419158f-482c-4386-814d-4df837dec1ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:50.392553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:43:50.400254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2daf8580-de14-4c68-9b13-e61d785e4ee1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:50.401204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2daf8580-de14-4c68-9b13-e61d785e4ee1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:50.402068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2daf8580-de14-4c68-9b13-e61d785e4ee1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:50.405594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2daf8580-de14-4c68-9b13-e61d785e4ee1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:50.406653 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2daf8580-de14-4c68-9b13-e61d785e4ee1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:50.407279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2daf8580-de14-4c68-9b13-e61d785e4ee1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:50.968606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3bc67dd2-c2ab-48ac-9177-bc0245aef25b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:43:50.970506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3bc67dd2-c2ab-48ac-9177-bc0245aef25b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:43:50.971869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3bc67dd2-c2ab-48ac-9177-bc0245aef25b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:43:50.973746 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3bc67dd2-c2ab-48ac-9177-bc0245aef25b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:43:50.976053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3bc67dd2-c2ab-48ac-9177-bc0245aef25b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:43:51.022738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3bc67dd2-c2ab-48ac-9177-bc0245aef25b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:51.023659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3bc67dd2-c2ab-48ac-9177-bc0245aef25b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:51.024050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3bc67dd2-c2ab-48ac-9177-bc0245aef25b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:51.024784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3bc67dd2-c2ab-48ac-9177-bc0245aef25b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:51.025434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3bc67dd2-c2ab-48ac-9177-bc0245aef25b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:51.026679 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3bc67dd2-c2ab-48ac-9177-bc0245aef25b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:51.057802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-3bc67dd2-c2ab-48ac-9177-bc0245aef25b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Getting quotas for project ccf5b780ca404c21a5d68f150cedbd7a. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:43:51.066087 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-3bc67dd2-c2ab-48ac-9177-bc0245aef25b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Getting quotas for user 99c75734232a40d4958acb5980b7bc0c and project ccf5b780ca404c21a5d68f150cedbd7a. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:43:51.085741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3bc67dd2-c2ab-48ac-9177-bc0245aef25b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:43:51.089772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3bc67dd2-c2ab-48ac-9177-bc0245aef25b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:43:51.133736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:43:51.163058 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3bc67dd2-c2ab-48ac-9177-bc0245aef25b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.575386 Sep 07 12:43:51.164583 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1477/2930] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:43:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 3578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:43:51.171126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b359eda6-d18d-4878-8d3b-5a6ae0a04da7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1135258244", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "80d51306-dbb8-4c2e-bca9-60970c39d44b"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:51.266896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2daf8580-de14-4c68-9b13-e61d785e4ee1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:51.281203 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-b359eda6-d18d-4878-8d3b-5a6ae0a04da7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] validate_networks() for [('80d51306-dbb8-4c2e-bca9-60970c39d44b', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:43:51.290526 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2daf8580-de14-4c68-9b13-e61d785e4ee1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff" status: 200 len: 1467 microversion: 2.1 time: 0.917891 Sep 07 12:43:51.301085 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1454/2931] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:50 2022] GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff => generated 1467 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:51.317251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-9c140cee-4deb-4e47-8d15-de17ac1897e5 req-a37591f5-ee61-4925-8747-4931624707c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "023e989d-cb87-4aea-a0c8-7123ad57c4f2", "tag": "9e2c8268-a833-4fcd-9631-f8c82408ea70"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:51.359565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9c140cee-4deb-4e47-8d15-de17ac1897e5 req-a37591f5-ee61-4925-8747-4931624707c0 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:51.361536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9c140cee-4deb-4e47-8d15-de17ac1897e5 req-a37591f5-ee61-4925-8747-4931624707c0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:51.362517 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9c140cee-4deb-4e47-8d15-de17ac1897e5 req-a37591f5-ee61-4925-8747-4931624707c0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:51.408594 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-9c140cee-4deb-4e47-8d15-de17ac1897e5 req-a37591f5-ee61-4925-8747-4931624707c0 service nova] Creating event network-changed:9e2c8268-a833-4fcd-9631-f8c82408ea70 for instance 023e989d-cb87-4aea-a0c8-7123ad57c4f2 on n-h2-852087-9 Sep 07 12:43:51.432605 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-9c140cee-4deb-4e47-8d15-de17ac1897e5 req-a37591f5-ee61-4925-8747-4931624707c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128989 Sep 07 12:43:51.433771 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1455/2932] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:51.457373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9903a3c0-7436-4dc2-8904-23ebf9a591f4 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:51.458671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9903a3c0-7436-4dc2-8904-23ebf9a591f4 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:51.479039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9903a3c0-7436-4dc2-8904-23ebf9a591f4 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:51.479983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9903a3c0-7436-4dc2-8904-23ebf9a591f4 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:51.480796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9903a3c0-7436-4dc2-8904-23ebf9a591f4 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:51.482307 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9903a3c0-7436-4dc2-8904-23ebf9a591f4 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:51.483200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9903a3c0-7436-4dc2-8904-23ebf9a591f4 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:51.483999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9903a3c0-7436-4dc2-8904-23ebf9a591f4 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:52.613681 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9903a3c0-7436-4dc2-8904-23ebf9a591f4 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:52.635836 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9903a3c0-7436-4dc2-8904-23ebf9a591f4 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 200 len: 1325 microversion: 2.1 time: 1.199745 Sep 07 12:43:52.636778 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1456/2933] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:51 2022] GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 1325 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:52.648667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-302d5621-4b78-4d83-80cc-c8f05f06e975 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:52.650439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-302d5621-4b78-4d83-80cc-c8f05f06e975 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:52.662745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-302d5621-4b78-4d83-80cc-c8f05f06e975 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:52.663368 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-302d5621-4b78-4d83-80cc-c8f05f06e975 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:52.664174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-302d5621-4b78-4d83-80cc-c8f05f06e975 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:52.665613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-302d5621-4b78-4d83-80cc-c8f05f06e975 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:52.666478 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-302d5621-4b78-4d83-80cc-c8f05f06e975 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:52.667284 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-302d5621-4b78-4d83-80cc-c8f05f06e975 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:52.858456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-302d5621-4b78-4d83-80cc-c8f05f06e975 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:52.877435 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-302d5621-4b78-4d83-80cc-c8f05f06e975 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1227 microversion: 2.1 time: 0.238200 Sep 07 12:43:52.879884 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1457/2934] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:52 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1227 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:52.907275 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ec20a77-c083-4624-ba8c-bcad8b083be8 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:52.908619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0ec20a77-c083-4624-ba8c-bcad8b083be8 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] [instance: e419158f-482c-4386-814d-4df837dec1ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:52.927282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ec20a77-c083-4624-ba8c-bcad8b083be8 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:52.928724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ec20a77-c083-4624-ba8c-bcad8b083be8 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:52.929686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ec20a77-c083-4624-ba8c-bcad8b083be8 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:52.930672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ec20a77-c083-4624-ba8c-bcad8b083be8 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:52.931767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ec20a77-c083-4624-ba8c-bcad8b083be8 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:52.932419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ec20a77-c083-4624-ba8c-bcad8b083be8 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:53.824104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:43:53.840692 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ec20a77-c083-4624-ba8c-bcad8b083be8 tempest-ServersOnMultiNodesTest-1629320611 tempest-ServersOnMultiNodesTest-1629320611-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff" status: 200 len: 1618 microversion: 2.1 time: 0.958208 Sep 07 12:43:53.841317 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1458/2935] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:52 2022] GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff => generated 1618 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:53.850783 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d97e18cc-0fef-48d9-8321-ac1f531f7b6c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:53.854496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d97e18cc-0fef-48d9-8321-ac1f531f7b6c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:53.870748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d97e18cc-0fef-48d9-8321-ac1f531f7b6c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:53.871492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d97e18cc-0fef-48d9-8321-ac1f531f7b6c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:53.874810 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d97e18cc-0fef-48d9-8321-ac1f531f7b6c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:53.875808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d97e18cc-0fef-48d9-8321-ac1f531f7b6c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:53.876474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d97e18cc-0fef-48d9-8321-ac1f531f7b6c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:53.878223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d97e18cc-0fef-48d9-8321-ac1f531f7b6c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:54.269709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b359eda6-d18d-4878-8d3b-5a6ae0a04da7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:43:54.272198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b359eda6-d18d-4878-8d3b-5a6ae0a04da7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:43:54.273091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b359eda6-d18d-4878-8d3b-5a6ae0a04da7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:43:54.274205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b359eda6-d18d-4878-8d3b-5a6ae0a04da7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:43:54.275391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b359eda6-d18d-4878-8d3b-5a6ae0a04da7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:43:54.295866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b359eda6-d18d-4878-8d3b-5a6ae0a04da7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:54.296864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b359eda6-d18d-4878-8d3b-5a6ae0a04da7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:54.297871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b359eda6-d18d-4878-8d3b-5a6ae0a04da7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:54.299364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b359eda6-d18d-4878-8d3b-5a6ae0a04da7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:54.300384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b359eda6-d18d-4878-8d3b-5a6ae0a04da7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:54.301428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b359eda6-d18d-4878-8d3b-5a6ae0a04da7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:54.341702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-b359eda6-d18d-4878-8d3b-5a6ae0a04da7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Getting quotas for project ef5b2dd007e944358d72268414868096. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:43:54.354083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-b359eda6-d18d-4878-8d3b-5a6ae0a04da7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Getting quotas for user b920811be01745fc9faea7a9ce213c6e and project ef5b2dd007e944358d72268414868096. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:43:54.380965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b359eda6-d18d-4878-8d3b-5a6ae0a04da7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:43:54.385560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b359eda6-d18d-4878-8d3b-5a6ae0a04da7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:43:54.518853 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b359eda6-d18d-4878-8d3b-5a6ae0a04da7 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.352460 Sep 07 12:43:54.524521 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1478/2936] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:43:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:43:54.535746 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-57d9919d-c433-4c93-b9a4-87571413381d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:54.535746 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-57d9919d-c433-4c93-b9a4-87571413381d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:54.541093 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57d9919d-c433-4c93-b9a4-87571413381d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:54.541748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57d9919d-c433-4c93-b9a4-87571413381d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:54.542311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57d9919d-c433-4c93-b9a4-87571413381d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:54.543137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57d9919d-c433-4c93-b9a4-87571413381d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:54.543593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57d9919d-c433-4c93-b9a4-87571413381d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:54.544558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57d9919d-c433-4c93-b9a4-87571413381d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:54.597686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d97e18cc-0fef-48d9-8321-ac1f531f7b6c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:54.623271 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d97e18cc-0fef-48d9-8321-ac1f531f7b6c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7" status: 200 len: 1572 microversion: 2.1 time: 0.777880 Sep 07 12:43:54.623992 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1459/2937] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:53 2022] GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 => generated 1572 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:54.632847 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9759a87d-099b-4d69-a664-8c234fb512bd tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:54.633857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9759a87d-099b-4d69-a664-8c234fb512bd tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:54.642568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9759a87d-099b-4d69-a664-8c234fb512bd tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:54.667592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9759a87d-099b-4d69-a664-8c234fb512bd tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:54.668081 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9759a87d-099b-4d69-a664-8c234fb512bd tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:54.670842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9759a87d-099b-4d69-a664-8c234fb512bd tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:54.671483 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9759a87d-099b-4d69-a664-8c234fb512bd tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:54.671990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9759a87d-099b-4d69-a664-8c234fb512bd tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:54.884046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9759a87d-099b-4d69-a664-8c234fb512bd tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:54.921536 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9759a87d-099b-4d69-a664-8c234fb512bd tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1275 microversion: 2.1 time: 0.293499 Sep 07 12:43:54.925364 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1460/2938] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:54 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1275 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:54.937683 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b62c7490-a2d6-4cf1-bf2e-c2085b2f05ab tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:54.948714 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b62c7490-a2d6-4cf1-bf2e-c2085b2f05ab tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: e419158f-482c-4386-814d-4df837dec1ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:54.993407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b62c7490-a2d6-4cf1-bf2e-c2085b2f05ab tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:55.006531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b62c7490-a2d6-4cf1-bf2e-c2085b2f05ab tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:55.007344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b62c7490-a2d6-4cf1-bf2e-c2085b2f05ab tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:55.015005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-57d9919d-c433-4c93-b9a4-87571413381d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:55.015208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b62c7490-a2d6-4cf1-bf2e-c2085b2f05ab tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:55.015953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b62c7490-a2d6-4cf1-bf2e-c2085b2f05ab tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:55.019201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b62c7490-a2d6-4cf1-bf2e-c2085b2f05ab tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:55.025242 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-57d9919d-c433-4c93-b9a4-87571413381d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 200 len: 1325 microversion: 2.1 time: 0.499171 Sep 07 12:43:55.034010 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1479/2939] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:54 2022] GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 1325 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:55.051590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0af8f0f6-eb9d-4bfa-8460-ada7812aaadf tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:55.052288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0af8f0f6-eb9d-4bfa-8460-ada7812aaadf tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:55.230843 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0af8f0f6-eb9d-4bfa-8460-ada7812aaadf tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:55.244983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b62c7490-a2d6-4cf1-bf2e-c2085b2f05ab tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: e419158f-482c-4386-814d-4df837dec1ff] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:43:55.246176 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0af8f0f6-eb9d-4bfa-8460-ada7812aaadf tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe" status: 200 len: 1215 microversion: 2.1 time: 0.210929 Sep 07 12:43:55.270413 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1480/2940] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:55 2022] GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe => generated 1215 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:55.277885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a3bf5f53-66f3-4cf8-807d-d5d513cf52c5 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-793911215"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:55.278320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a3bf5f53-66f3-4cf8-807d-d5d513cf52c5 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:55.292700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3bf5f53-66f3-4cf8-807d-d5d513cf52c5 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:55.294546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3bf5f53-66f3-4cf8-807d-d5d513cf52c5 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:55.296486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3bf5f53-66f3-4cf8-807d-d5d513cf52c5 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:55.298366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3bf5f53-66f3-4cf8-807d-d5d513cf52c5 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:55.301192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3bf5f53-66f3-4cf8-807d-d5d513cf52c5 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:55.302718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3bf5f53-66f3-4cf8-807d-d5d513cf52c5 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:55.559276 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b62c7490-a2d6-4cf1-bf2e-c2085b2f05ab tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff" status: 204 len: 0 microversion: 2.1 time: 0.624820 Sep 07 12:43:55.579779 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1461/2941] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:43:54 2022] DELETE /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff => generated 0 bytes in 653 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:43:55.609098 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f49f77eb-927e-44b1-885e-9c87f951f072 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:55.614728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f49f77eb-927e-44b1-885e-9c87f951f072 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: e419158f-482c-4386-814d-4df837dec1ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:55.647415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f49f77eb-927e-44b1-885e-9c87f951f072 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:55.652800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f49f77eb-927e-44b1-885e-9c87f951f072 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:55.653753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f49f77eb-927e-44b1-885e-9c87f951f072 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:55.668239 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f49f77eb-927e-44b1-885e-9c87f951f072 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:55.669187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f49f77eb-927e-44b1-885e-9c87f951f072 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:55.678264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f49f77eb-927e-44b1-885e-9c87f951f072 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:56.141377 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.network.security_group_api [None req-a3bf5f53-66f3-4cf8-807d-d5d513cf52c5 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Adding security group 81a7640e-608b-40ab-afa7-a72eac5ab4ed to port 5e6b718d-88c1-405f-8b5d-2849933dfc7d Sep 07 12:43:56.293111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f49f77eb-927e-44b1-885e-9c87f951f072 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:56.312555 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f49f77eb-927e-44b1-885e-9c87f951f072 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff" status: 200 len: 1473 microversion: 2.1 time: 0.726868 Sep 07 12:43:56.327727 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1462/2942] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:55 2022] GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff => generated 1473 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:56.359795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9ce38e45-3d5b-4cb7-9ecc-a29f94305d0b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:56.360980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9ce38e45-3d5b-4cb7-9ecc-a29f94305d0b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:56.423773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ce38e45-3d5b-4cb7-9ecc-a29f94305d0b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:56.424655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ce38e45-3d5b-4cb7-9ecc-a29f94305d0b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:56.430117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ce38e45-3d5b-4cb7-9ecc-a29f94305d0b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:56.435963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ce38e45-3d5b-4cb7-9ecc-a29f94305d0b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:56.437362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ce38e45-3d5b-4cb7-9ecc-a29f94305d0b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:56.440024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ce38e45-3d5b-4cb7-9ecc-a29f94305d0b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:57.659458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9ce38e45-3d5b-4cb7-9ecc-a29f94305d0b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:57.693906 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9ce38e45-3d5b-4cb7-9ecc-a29f94305d0b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1323 microversion: 2.1 time: 1.347032 Sep 07 12:43:57.709648 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1463/2943] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:56 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1323 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:57.722359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c721c273-cd22-47aa-932b-01429089934a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:57.725970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c721c273-cd22-47aa-932b-01429089934a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:57.747079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c721c273-cd22-47aa-932b-01429089934a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:57.747946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c721c273-cd22-47aa-932b-01429089934a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:57.749672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c721c273-cd22-47aa-932b-01429089934a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:57.751373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c721c273-cd22-47aa-932b-01429089934a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:57.752169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c721c273-cd22-47aa-932b-01429089934a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:57.753376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c721c273-cd22-47aa-932b-01429089934a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:58.387523 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a3bf5f53-66f3-4cf8-807d-d5d513cf52c5 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "POST /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7/action" status: 202 len: 0 microversion: 2.1 time: 3.115443 Sep 07 12:43:58.392123 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1481/2944] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:43:55 2022] POST /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7/action => generated 0 bytes in 3118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:43:58.415453 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bdc97c30-1f8e-4f5c-a49e-1239721b83a8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:58.419841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bdc97c30-1f8e-4f5c-a49e-1239721b83a8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:58.479814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdc97c30-1f8e-4f5c-a49e-1239721b83a8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:58.485819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdc97c30-1f8e-4f5c-a49e-1239721b83a8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:58.493873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdc97c30-1f8e-4f5c-a49e-1239721b83a8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:58.501518 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdc97c30-1f8e-4f5c-a49e-1239721b83a8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:58.506721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdc97c30-1f8e-4f5c-a49e-1239721b83a8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:58.510723 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdc97c30-1f8e-4f5c-a49e-1239721b83a8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:59.004523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bdc97c30-1f8e-4f5c-a49e-1239721b83a8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:59.031823 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bdc97c30-1f8e-4f5c-a49e-1239721b83a8 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe" status: 200 len: 1275 microversion: 2.1 time: 0.638946 Sep 07 12:43:59.035807 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1482/2945] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:58 2022] GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe => generated 1275 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:59.076870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d4bd86a0-2452-44ff-b6fa-debf843f808f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:59.077881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d4bd86a0-2452-44ff-b6fa-debf843f808f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: e419158f-482c-4386-814d-4df837dec1ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:59.084696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c721c273-cd22-47aa-932b-01429089934a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:59.114368 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c721c273-cd22-47aa-932b-01429089934a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 200 len: 1325 microversion: 2.1 time: 1.399746 Sep 07 12:43:59.115893 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1464/2946] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:57 2022] GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 1325 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:59.133084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4bd86a0-2452-44ff-b6fa-debf843f808f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:59.134076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4bd86a0-2452-44ff-b6fa-debf843f808f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:59.135087 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4bd86a0-2452-44ff-b6fa-debf843f808f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:59.137156 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4bd86a0-2452-44ff-b6fa-debf843f808f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:59.139305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4bd86a0-2452-44ff-b6fa-debf843f808f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:59.140079 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4bd86a0-2452-44ff-b6fa-debf843f808f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:59.144682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-ab31659d-2778-4b98-af4e-5f239fa50b81 req-7345e667-2254-4e04-8abc-38eb8f229dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "023e989d-cb87-4aea-a0c8-7123ad57c4f2", "name": "network-vif-plugged", "status": "completed", "tag": "9e2c8268-a833-4fcd-9631-f8c82408ea70"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:59.169264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ab31659d-2778-4b98-af4e-5f239fa50b81 req-7345e667-2254-4e04-8abc-38eb8f229dc0 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:59.170707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ab31659d-2778-4b98-af4e-5f239fa50b81 req-7345e667-2254-4e04-8abc-38eb8f229dc0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:59.171898 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ab31659d-2778-4b98-af4e-5f239fa50b81 req-7345e667-2254-4e04-8abc-38eb8f229dc0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:59.208701 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ab31659d-2778-4b98-af4e-5f239fa50b81 req-7345e667-2254-4e04-8abc-38eb8f229dc0 service nova] Creating event network-vif-plugged:9e2c8268-a833-4fcd-9631-f8c82408ea70 for instance 023e989d-cb87-4aea-a0c8-7123ad57c4f2 on n-h2-852087-9 Sep 07 12:43:59.224641 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-ab31659d-2778-4b98-af4e-5f239fa50b81 req-7345e667-2254-4e04-8abc-38eb8f229dc0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092761 Sep 07 12:43:59.226442 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1465/2947] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:59.245316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ab730db-0ffd-4ae1-b52b-ffcaeab82410 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '.version_select at 0x7fc4183c51f0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:59.618342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d4bd86a0-2452-44ff-b6fa-debf843f808f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:43:59.641835 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d4bd86a0-2452-44ff-b6fa-debf843f808f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff" status: 200 len: 1431 microversion: 2.1 time: 0.603386 Sep 07 12:43:59.644529 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1483/2948] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:59 2022] GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff => generated 1431 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:43:59.667177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-6d6755bc-d6f2-421c-ae2b-034efdaea0d3 req-11f8a8b2-a67a-4b19-88d8-225f5d42b3c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "209a7f47-3606-42a4-8360-4fa356ad74e7", "tag": "5e6b718d-88c1-405f-8b5d-2849933dfc7d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:59.698107 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6d6755bc-d6f2-421c-ae2b-034efdaea0d3 req-11f8a8b2-a67a-4b19-88d8-225f5d42b3c0 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:59.698850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6d6755bc-d6f2-421c-ae2b-034efdaea0d3 req-11f8a8b2-a67a-4b19-88d8-225f5d42b3c0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:59.701236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6d6755bc-d6f2-421c-ae2b-034efdaea0d3 req-11f8a8b2-a67a-4b19-88d8-225f5d42b3c0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:59.725262 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-6d6755bc-d6f2-421c-ae2b-034efdaea0d3 req-11f8a8b2-a67a-4b19-88d8-225f5d42b3c0 service nova] Creating event network-changed:5e6b718d-88c1-405f-8b5d-2849933dfc7d for instance 209a7f47-3606-42a4-8360-4fa356ad74e7 on n-h1-852087-9 Sep 07 12:43:59.734613 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-6d6755bc-d6f2-421c-ae2b-034efdaea0d3 req-11f8a8b2-a67a-4b19-88d8-225f5d42b3c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087181 Sep 07 12:43:59.736026 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1484/2949] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:59.742604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d03148be-4b29-4df6-acf2-2559c1274cf2 req-1fa650fe-93d6-41c0-a11d-22d2edf349e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca300ad8-1300-4adf-940f-8cc52f13d8dc", "tag": "6b1ac69f-da45-464f-94bf-5e56a21ce00a"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:43:59.758046 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d03148be-4b29-4df6-acf2-2559c1274cf2 req-1fa650fe-93d6-41c0-a11d-22d2edf349e6 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:59.758534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d03148be-4b29-4df6-acf2-2559c1274cf2 req-1fa650fe-93d6-41c0-a11d-22d2edf349e6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:59.759235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d03148be-4b29-4df6-acf2-2559c1274cf2 req-1fa650fe-93d6-41c0-a11d-22d2edf349e6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:59.776015 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d03148be-4b29-4df6-acf2-2559c1274cf2 req-1fa650fe-93d6-41c0-a11d-22d2edf349e6 service nova] Creating event network-changed:6b1ac69f-da45-464f-94bf-5e56a21ce00a for instance ca300ad8-1300-4adf-940f-8cc52f13d8dc on n-h2-852087-9 Sep 07 12:43:59.783301 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d03148be-4b29-4df6-acf2-2559c1274cf2 req-1fa650fe-93d6-41c0-a11d-22d2edf349e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045499 Sep 07 12:43:59.784220 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1485/2950] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:43:59.796301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-870876ba-94af-4d09-a365-12827f0f5958 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:43:59.797398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-870876ba-94af-4d09-a365-12827f0f5958 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:43:59.807334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-870876ba-94af-4d09-a365-12827f0f5958 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:59.808147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-870876ba-94af-4d09-a365-12827f0f5958 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:59.808773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-870876ba-94af-4d09-a365-12827f0f5958 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:43:59.809977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-870876ba-94af-4d09-a365-12827f0f5958 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:43:59.811663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-870876ba-94af-4d09-a365-12827f0f5958 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:43:59.812391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-870876ba-94af-4d09-a365-12827f0f5958 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:00.181446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG neutronclient.v2_0.client [None req-0ab730db-0ffd-4ae1-b52b-ffcaeab82410 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 81a7640e-608b-40ab-afa7-a72eac5ab4ed in use.", "detail": ""}} {{(pid=122433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 12:44:00.187313 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-0ab730db-0ffd-4ae1-b52b-ffcaeab82410 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] HTTP exception thrown: Security Group 81a7640e-608b-40ab-afa7-a72eac5ab4ed in use. Sep 07 12:44:00.187313 n-d-852087-9 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-8093f947-48d8-4436-bc6f-8df7ce5d8e6f'] Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ab730db-0ffd-4ae1-b52b-ffcaeab82410 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Request method failure captured: Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-security-groups/81a7640e-608b-40ab-afa7-a72eac5ab4ed HTTP/1.1 Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJGWMXgN7OdrmO70X8q48ZD-kObLPYOd01ANus8JY-PK7OjbvYCQ097-aKOdLEd3zX6imftUV9BBkR8dj8xCIWAm9yYmlnMVOTu04sxm_YJiyi8RzROPFAn0FZkGq3OAzdh-65OtDl9f1F4UEDEA_AaJuKK-hToemYtm-2HEdw2FTvo Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6c7fac0664f044168f52e7c1a982c48e Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: exception: Security Group 81a7640e-608b-40ab-afa7-a72eac5ab4ed in use. Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-8093f947-48d8-4436-bc6f-8df7ce5d8e6f'] Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '81a7640e-608b-40ab-afa7-a72eac5ab4ed'} Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 12:44:00.195171 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 81a7640e-608b-40ab-afa7-a72eac5ab4ed in use. Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8093f947-48d8-4436-bc6f-8df7ce5d8e6f'] Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 81a7640e-608b-40ab-afa7-a72eac5ab4ed in use. Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8093f947-48d8-4436-bc6f-8df7ce5d8e6f'] Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 81a7640e-608b-40ab-afa7-a72eac5ab4ed in use. Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8093f947-48d8-4436-bc6f-8df7ce5d8e6f'] Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 81a7640e-608b-40ab-afa7-a72eac5ab4ed in use. Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8093f947-48d8-4436-bc6f-8df7ce5d8e6f'] Sep 07 12:44:00.204644 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:00.218692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ab730db-0ffd-4ae1-b52b-ffcaeab82410 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Returning 400 to user: Security Group 81a7640e-608b-40ab-afa7-a72eac5ab4ed in use. Sep 07 12:44:00.218692 n-d-852087-9 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-8093f947-48d8-4436-bc6f-8df7ce5d8e6f'] {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:00.221030 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ab730db-0ffd-4ae1-b52b-ffcaeab82410 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/81a7640e-608b-40ab-afa7-a72eac5ab4ed" status: 400 len: 185 microversion: 2.1 time: 0.991593 Sep 07 12:44:00.222894 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1466/2951] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:43:59 2022] DELETE /compute/v2.1/os-security-groups/81a7640e-608b-40ab-afa7-a72eac5ab4ed => generated 185 bytes in 995 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:44:00.236292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-169d9298-b8aa-4185-95ff-25f97031bc72 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:00.237361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-169d9298-b8aa-4185-95ff-25f97031bc72 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:00.248051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-169d9298-b8aa-4185-95ff-25f97031bc72 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:00.249047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-169d9298-b8aa-4185-95ff-25f97031bc72 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:00.250372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-169d9298-b8aa-4185-95ff-25f97031bc72 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:00.253740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-169d9298-b8aa-4185-95ff-25f97031bc72 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:00.255384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-169d9298-b8aa-4185-95ff-25f97031bc72 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:00.256268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-169d9298-b8aa-4185-95ff-25f97031bc72 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:00.346136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-870876ba-94af-4d09-a365-12827f0f5958 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:00.348810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:44:00.362394 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-870876ba-94af-4d09-a365-12827f0f5958 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1323 microversion: 2.1 time: 0.572324 Sep 07 12:44:00.374148 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1486/2952] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:43:59 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1323 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:00.380079 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d1d9f2ce-aa8f-4246-9c45-87f8f218a714 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:00.381045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d1d9f2ce-aa8f-4246-9c45-87f8f218a714 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:00.400040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1d9f2ce-aa8f-4246-9c45-87f8f218a714 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:00.400776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1d9f2ce-aa8f-4246-9c45-87f8f218a714 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:00.401443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1d9f2ce-aa8f-4246-9c45-87f8f218a714 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:00.402434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1d9f2ce-aa8f-4246-9c45-87f8f218a714 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:00.403103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1d9f2ce-aa8f-4246-9c45-87f8f218a714 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:00.403704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1d9f2ce-aa8f-4246-9c45-87f8f218a714 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:00.460982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-169d9298-b8aa-4185-95ff-25f97031bc72 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:00.474460 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-169d9298-b8aa-4185-95ff-25f97031bc72 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe" status: 200 len: 1273 microversion: 2.1 time: 0.249632 Sep 07 12:44:00.475751 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1467/2953] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:00 2022] GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe => generated 1273 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:00.484085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb113de6-db04-438f-bccb-94dc215a8780 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:00.486212 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cb113de6-db04-438f-bccb-94dc215a8780 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:00.507271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb113de6-db04-438f-bccb-94dc215a8780 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:00.508093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb113de6-db04-438f-bccb-94dc215a8780 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:00.508721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb113de6-db04-438f-bccb-94dc215a8780 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:00.509784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb113de6-db04-438f-bccb-94dc215a8780 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:00.510537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb113de6-db04-438f-bccb-94dc215a8780 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:00.511333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb113de6-db04-438f-bccb-94dc215a8780 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:00.576130 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cb113de6-db04-438f-bccb-94dc215a8780 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:44:00.748053 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cb113de6-db04-438f-bccb-94dc215a8780 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "DELETE /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7" status: 204 len: 0 microversion: 2.1 time: 0.270457 Sep 07 12:44:00.749800 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1468/2954] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:44:00 2022] DELETE /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:44:00.758986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-779810f0-d133-43f5-9bb2-8b2828d98ba2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:00.761188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-779810f0-d133-43f5-9bb2-8b2828d98ba2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: e419158f-482c-4386-814d-4df837dec1ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:00.779378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-779810f0-d133-43f5-9bb2-8b2828d98ba2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:00.780714 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-779810f0-d133-43f5-9bb2-8b2828d98ba2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:00.782065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-779810f0-d133-43f5-9bb2-8b2828d98ba2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:00.784523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-779810f0-d133-43f5-9bb2-8b2828d98ba2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:00.786434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-779810f0-d133-43f5-9bb2-8b2828d98ba2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:00.788583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-779810f0-d133-43f5-9bb2-8b2828d98ba2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:00.851675 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-779810f0-d133-43f5-9bb2-8b2828d98ba2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] HTTP exception thrown: Instance e419158f-482c-4386-814d-4df837dec1ff could not be found. Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-779810f0-d133-43f5-9bb2-8b2828d98ba2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Request method failure captured: Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff HTTP/1.1 Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJEP0irHIBLN8hFWvgLoOKa85E_5AoxCeRoHxKkTt9HdaFmlIYGchkE6q65oBFLP3DgAcUWlzLQgHRTeUGfdJav2RIkb2FS4kv4XxxXu-KkXROe-iYh2upLJXJIuF28hkxxUYg0rmbMG5d0HtmW6B3uJIdcPQo2gv8Pl4EjF30y2Jzg Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: e15fa55f4d4f4b4db6dbb26c0f07c3c4 Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersOnMultiNodesTest-1611524513 Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersOnMultiNodesTest-1611524513 Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: e15fa55f4d4f4b4db6dbb26c0f07c3c4 Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1611524513 Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersOnMultiNodesTest-1611524513-project Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: ed6e5d4d54224bca90954d1ebbd7b7a3 Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersOnMultiNodesTest-1611524513-project Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance e419158f-482c-4386-814d-4df837dec1ff could not be found. Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'e419158f-482c-4386-814d-4df837dec1ff'} Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e419158f-482c-4386-814d-4df837dec1ff could not be found. Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e419158f-482c-4386-814d-4df837dec1ff could not be found. Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:00.859014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:00.864099 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:00.864099 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:00.864099 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:00.864099 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:00.864099 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:00.864099 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e419158f-482c-4386-814d-4df837dec1ff could not be found. Sep 07 12:44:00.864099 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:00.864099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-779810f0-d133-43f5-9bb2-8b2828d98ba2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Returning 404 to user: Instance e419158f-482c-4386-814d-4df837dec1ff could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:00.864099 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-779810f0-d133-43f5-9bb2-8b2828d98ba2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff" status: 404 len: 111 microversion: 2.1 time: 0.110302 Sep 07 12:44:00.864099 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1469/2955] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:00 2022] GET /compute/v2.1/servers/e419158f-482c-4386-814d-4df837dec1ff => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:00.872304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-00e40f97-6efd-4584-bc87-2113686123d6 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:00.873357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-00e40f97-6efd-4584-bc87-2113686123d6 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:00.884570 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00e40f97-6efd-4584-bc87-2113686123d6 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:00.885907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00e40f97-6efd-4584-bc87-2113686123d6 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:00.886946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00e40f97-6efd-4584-bc87-2113686123d6 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:00.888921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00e40f97-6efd-4584-bc87-2113686123d6 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:00.890435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00e40f97-6efd-4584-bc87-2113686123d6 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:00.891490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00e40f97-6efd-4584-bc87-2113686123d6 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:01.324233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d1d9f2ce-aa8f-4246-9c45-87f8f218a714 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:01.336611 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d1d9f2ce-aa8f-4246-9c45-87f8f218a714 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 200 len: 1325 microversion: 2.1 time: 0.960483 Sep 07 12:44:01.338557 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1487/2956] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:00 2022] GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 1325 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:01.352342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aa7b7ba6-44aa-4b41-a4d6-8ab9e56824db tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:01.353692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aa7b7ba6-44aa-4b41-a4d6-8ab9e56824db tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 825ead8a-aa8c-4402-80f7-749edc7d21c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:01.374417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa7b7ba6-44aa-4b41-a4d6-8ab9e56824db tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:01.375159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa7b7ba6-44aa-4b41-a4d6-8ab9e56824db tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:01.375714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa7b7ba6-44aa-4b41-a4d6-8ab9e56824db tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:01.376618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa7b7ba6-44aa-4b41-a4d6-8ab9e56824db tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:01.377330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa7b7ba6-44aa-4b41-a4d6-8ab9e56824db tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:01.378472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa7b7ba6-44aa-4b41-a4d6-8ab9e56824db tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:01.444327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aa7b7ba6-44aa-4b41-a4d6-8ab9e56824db tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 825ead8a-aa8c-4402-80f7-749edc7d21c5] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:44:01.643133 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aa7b7ba6-44aa-4b41-a4d6-8ab9e56824db tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "DELETE /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5" status: 204 len: 0 microversion: 2.1 time: 0.300088 Sep 07 12:44:01.649137 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1488/2957] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:44:01 2022] DELETE /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:44:01.656910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9427c9b7-92f2-44c6-85f2-2d07644d2029 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:01.658375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9427c9b7-92f2-44c6-85f2-2d07644d2029 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:01.671903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9427c9b7-92f2-44c6-85f2-2d07644d2029 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:01.672802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9427c9b7-92f2-44c6-85f2-2d07644d2029 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:01.673632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9427c9b7-92f2-44c6-85f2-2d07644d2029 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:01.676068 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9427c9b7-92f2-44c6-85f2-2d07644d2029 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:01.676917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9427c9b7-92f2-44c6-85f2-2d07644d2029 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:01.677756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9427c9b7-92f2-44c6-85f2-2d07644d2029 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:01.678669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-00e40f97-6efd-4584-bc87-2113686123d6 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:01.728699 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-00e40f97-6efd-4584-bc87-2113686123d6 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7" status: 200 len: 1646 microversion: 2.1 time: 0.861841 Sep 07 12:44:01.731191 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1470/2958] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:00 2022] GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 => generated 1646 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:01.761430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bed527c8-a016-41f1-a087-a26d6fcf3bd4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:01.769333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bed527c8-a016-41f1-a087-a26d6fcf3bd4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:01.799793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bed527c8-a016-41f1-a087-a26d6fcf3bd4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:01.800751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bed527c8-a016-41f1-a087-a26d6fcf3bd4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:01.801529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bed527c8-a016-41f1-a087-a26d6fcf3bd4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:01.810384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bed527c8-a016-41f1-a087-a26d6fcf3bd4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:01.813322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bed527c8-a016-41f1-a087-a26d6fcf3bd4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:01.817269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bed527c8-a016-41f1-a087-a26d6fcf3bd4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:02.668031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9427c9b7-92f2-44c6-85f2-2d07644d2029 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:02.671611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bed527c8-a016-41f1-a087-a26d6fcf3bd4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:02.683630 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bed527c8-a016-41f1-a087-a26d6fcf3bd4 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe" status: 200 len: 1315 microversion: 2.1 time: 0.948570 Sep 07 12:44:02.685914 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1471/2959] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:01 2022] GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe => generated 1315 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:02.714101 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9427c9b7-92f2-44c6-85f2-2d07644d2029 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1323 microversion: 2.1 time: 1.066453 Sep 07 12:44:02.720444 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1489/2960] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:01 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1323 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:02.726092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8bca7264-9b0d-489b-bbb7-8102e25941c4 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:02.728458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8bca7264-9b0d-489b-bbb7-8102e25941c4 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 825ead8a-aa8c-4402-80f7-749edc7d21c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:02.749233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bca7264-9b0d-489b-bbb7-8102e25941c4 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:02.750085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bca7264-9b0d-489b-bbb7-8102e25941c4 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:02.751231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bca7264-9b0d-489b-bbb7-8102e25941c4 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:02.752480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bca7264-9b0d-489b-bbb7-8102e25941c4 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:02.753226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bca7264-9b0d-489b-bbb7-8102e25941c4 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:02.754120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bca7264-9b0d-489b-bbb7-8102e25941c4 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:02.934700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-0bc82018-0558-4723-a5fe-b981ebbcc4e0 req-d5cb29ac-1531-4e72-811f-42dbff73f638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e419158f-482c-4386-814d-4df837dec1ff", "name": "network-vif-deleted", "tag": "e70800bc-cd41-4110-9353-c80d5bc259aa"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:02.946459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0bc82018-0558-4723-a5fe-b981ebbcc4e0 req-d5cb29ac-1531-4e72-811f-42dbff73f638 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:02.947427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0bc82018-0558-4723-a5fe-b981ebbcc4e0 req-d5cb29ac-1531-4e72-811f-42dbff73f638 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:02.948052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0bc82018-0558-4723-a5fe-b981ebbcc4e0 req-d5cb29ac-1531-4e72-811f-42dbff73f638 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:02.961659 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-0bc82018-0558-4723-a5fe-b981ebbcc4e0 req-d5cb29ac-1531-4e72-811f-42dbff73f638 service nova] Creating event network-vif-deleted:e70800bc-cd41-4110-9353-c80d5bc259aa for instance e419158f-482c-4386-814d-4df837dec1ff on n-h1-852087-9 Sep 07 12:44:02.976379 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-0bc82018-0558-4723-a5fe-b981ebbcc4e0 req-d5cb29ac-1531-4e72-811f-42dbff73f638 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.254126 Sep 07 12:44:02.977841 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1490/2961] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:02.986139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f93075fe-ac57-4806-b4ce-319c4b43fc94 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:02.987421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f93075fe-ac57-4806-b4ce-319c4b43fc94 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:02.997470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f93075fe-ac57-4806-b4ce-319c4b43fc94 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:02.998349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f93075fe-ac57-4806-b4ce-319c4b43fc94 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:02.998962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f93075fe-ac57-4806-b4ce-319c4b43fc94 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:03.001043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f93075fe-ac57-4806-b4ce-319c4b43fc94 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:03.001824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f93075fe-ac57-4806-b4ce-319c4b43fc94 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:03.002435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f93075fe-ac57-4806-b4ce-319c4b43fc94 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:03.236591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8bca7264-9b0d-489b-bbb7-8102e25941c4 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:03.268808 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8bca7264-9b0d-489b-bbb7-8102e25941c4 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5" status: 200 len: 1472 microversion: 2.1 time: 0.580403 Sep 07 12:44:03.286287 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1472/2962] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:02 2022] GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5 => generated 1472 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:03.315996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2e835a03-22f9-448e-963d-0b045078324e tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:03.317204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2e835a03-22f9-448e-963d-0b045078324e tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:03.335971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e835a03-22f9-448e-963d-0b045078324e tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:03.337417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e835a03-22f9-448e-963d-0b045078324e tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:03.344356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e835a03-22f9-448e-963d-0b045078324e tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:03.345982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e835a03-22f9-448e-963d-0b045078324e tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:03.349425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e835a03-22f9-448e-963d-0b045078324e tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:03.351226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e835a03-22f9-448e-963d-0b045078324e tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:03.758830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f93075fe-ac57-4806-b4ce-319c4b43fc94 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:03.791976 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f93075fe-ac57-4806-b4ce-319c4b43fc94 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 200 len: 1325 microversion: 2.1 time: 0.812143 Sep 07 12:44:03.796697 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1491/2963] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:02 2022] GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 1325 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:03.817754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ec39749b-cbc7-4ce9-8855-d85ace36aca5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:03.821277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ec39749b-cbc7-4ce9-8855-d85ace36aca5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:03.837313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec39749b-cbc7-4ce9-8855-d85ace36aca5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:03.840627 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec39749b-cbc7-4ce9-8855-d85ace36aca5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:03.842058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec39749b-cbc7-4ce9-8855-d85ace36aca5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:03.845027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec39749b-cbc7-4ce9-8855-d85ace36aca5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:03.846606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec39749b-cbc7-4ce9-8855-d85ace36aca5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:03.848404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec39749b-cbc7-4ce9-8855-d85ace36aca5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:03.917009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2e835a03-22f9-448e-963d-0b045078324e tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:03.952835 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2e835a03-22f9-448e-963d-0b045078324e tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7" status: 200 len: 1646 microversion: 2.1 time: 0.663519 Sep 07 12:44:03.956461 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1473/2964] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:03 2022] GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 => generated 1646 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:03.968375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f3f29d4d-f150-4bdf-8a0b-00ca1bb69877 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:03.971243 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f3f29d4d-f150-4bdf-8a0b-00ca1bb69877 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:04.013575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3f29d4d-f150-4bdf-8a0b-00ca1bb69877 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:04.019376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3f29d4d-f150-4bdf-8a0b-00ca1bb69877 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:04.019376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3f29d4d-f150-4bdf-8a0b-00ca1bb69877 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:04.026372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3f29d4d-f150-4bdf-8a0b-00ca1bb69877 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:04.027870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3f29d4d-f150-4bdf-8a0b-00ca1bb69877 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:04.028684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3f29d4d-f150-4bdf-8a0b-00ca1bb69877 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:04.134427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:44:04.225171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ec39749b-cbc7-4ce9-8855-d85ace36aca5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:04.239153 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ec39749b-cbc7-4ce9-8855-d85ace36aca5 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe" status: 200 len: 1315 microversion: 2.1 time: 0.438909 Sep 07 12:44:04.242127 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1492/2965] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:03 2022] GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:04.333825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f5f50b6a-8196-44e9-a302-632915fef534 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:04.335238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f5f50b6a-8196-44e9-a302-632915fef534 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 825ead8a-aa8c-4402-80f7-749edc7d21c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:04.339864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:44:04.350411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5f50b6a-8196-44e9-a302-632915fef534 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:04.351286 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5f50b6a-8196-44e9-a302-632915fef534 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:04.360230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5f50b6a-8196-44e9-a302-632915fef534 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:04.368128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5f50b6a-8196-44e9-a302-632915fef534 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:04.370445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5f50b6a-8196-44e9-a302-632915fef534 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:04.371539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5f50b6a-8196-44e9-a302-632915fef534 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:04.702459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f3f29d4d-f150-4bdf-8a0b-00ca1bb69877 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:04.745021 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f3f29d4d-f150-4bdf-8a0b-00ca1bb69877 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1323 microversion: 2.1 time: 0.784678 Sep 07 12:44:04.801951 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1474/2966] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:03 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1323 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:04.862957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-895333d1-5e67-40b2-aa63-6a0309e3b249 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:04.864185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-895333d1-5e67-40b2-aa63-6a0309e3b249 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:04.898073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-895333d1-5e67-40b2-aa63-6a0309e3b249 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:04.901382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-895333d1-5e67-40b2-aa63-6a0309e3b249 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:04.902185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-895333d1-5e67-40b2-aa63-6a0309e3b249 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:04.905593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-895333d1-5e67-40b2-aa63-6a0309e3b249 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:04.906335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-895333d1-5e67-40b2-aa63-6a0309e3b249 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:04.906986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-895333d1-5e67-40b2-aa63-6a0309e3b249 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:04.977530 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f5f50b6a-8196-44e9-a302-632915fef534 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:05.022782 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f5f50b6a-8196-44e9-a302-632915fef534 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5" status: 200 len: 1472 microversion: 2.1 time: 0.706943 Sep 07 12:44:05.026433 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1493/2967] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:04 2022] GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5 => generated 1472 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:44:05.040594 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2ec9857b-dab7-446f-8d77-2159a5c6907f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:05.048691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2ec9857b-dab7-446f-8d77-2159a5c6907f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:05.063795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ec9857b-dab7-446f-8d77-2159a5c6907f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:05.066799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ec9857b-dab7-446f-8d77-2159a5c6907f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:05.068551 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ec9857b-dab7-446f-8d77-2159a5c6907f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:05.070780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ec9857b-dab7-446f-8d77-2159a5c6907f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:05.072206 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ec9857b-dab7-446f-8d77-2159a5c6907f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:05.074428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ec9857b-dab7-446f-8d77-2159a5c6907f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:05.183087 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ec9857b-dab7-446f-8d77-2159a5c6907f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:05.184315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ec9857b-dab7-446f-8d77-2159a5c6907f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:05.185865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ec9857b-dab7-446f-8d77-2159a5c6907f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:05.187308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-2ec9857b-dab7-446f-8d77-2159a5c6907f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lazy-loading 'fault' on Instance uuid 209a7f47-3606-42a4-8360-4fa356ad74e7 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:44:05.236620 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=14 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:44:05.379317 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2ec9857b-dab7-446f-8d77-2159a5c6907f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:05.393301 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2ec9857b-dab7-446f-8d77-2159a5c6907f tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7" status: 200 len: 1305 microversion: 2.1 time: 0.364880 Sep 07 12:44:05.394294 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1494/2968] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:05 2022] GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 => generated 1305 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:05.418421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e59c7efa-aad7-4db2-a6dd-56fe9f7457b7 req-7e8825a6-6f2e-467d-9d5a-32d5910a0e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "209a7f47-3606-42a4-8360-4fa356ad74e7", "name": "network-vif-deleted", "tag": "5e6b718d-88c1-405f-8b5d-2849933dfc7d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:05.447885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e59c7efa-aad7-4db2-a6dd-56fe9f7457b7 req-7e8825a6-6f2e-467d-9d5a-32d5910a0e42 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:05.452479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e59c7efa-aad7-4db2-a6dd-56fe9f7457b7 req-7e8825a6-6f2e-467d-9d5a-32d5910a0e42 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:05.453194 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e59c7efa-aad7-4db2-a6dd-56fe9f7457b7 req-7e8825a6-6f2e-467d-9d5a-32d5910a0e42 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:05.494747 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e59c7efa-aad7-4db2-a6dd-56fe9f7457b7 req-7e8825a6-6f2e-467d-9d5a-32d5910a0e42 service nova] Creating event network-vif-deleted:5e6b718d-88c1-405f-8b5d-2849933dfc7d for instance 209a7f47-3606-42a4-8360-4fa356ad74e7 on n-h1-852087-9 Sep 07 12:44:05.507141 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e59c7efa-aad7-4db2-a6dd-56fe9f7457b7 req-7e8825a6-6f2e-467d-9d5a-32d5910a0e42 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111345 Sep 07 12:44:05.508616 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1495/2969] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:05.516597 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ef3a0aeb-60ab-479c-b467-cb2c063894b0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:05.517350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ef3a0aeb-60ab-479c-b467-cb2c063894b0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:05.536342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef3a0aeb-60ab-479c-b467-cb2c063894b0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:05.537357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef3a0aeb-60ab-479c-b467-cb2c063894b0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:05.538020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef3a0aeb-60ab-479c-b467-cb2c063894b0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:05.539286 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef3a0aeb-60ab-479c-b467-cb2c063894b0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:05.540462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef3a0aeb-60ab-479c-b467-cb2c063894b0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:05.541254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef3a0aeb-60ab-479c-b467-cb2c063894b0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:05.646460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-895333d1-5e67-40b2-aa63-6a0309e3b249 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:05.687963 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-895333d1-5e67-40b2-aa63-6a0309e3b249 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 200 len: 1325 microversion: 2.1 time: 0.869578 Sep 07 12:44:05.698137 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1475/2970] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:04 2022] GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 1325 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:05.815033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5f7f8405-3922-42f1-8a12-01067017a2df tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:05.816895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5f7f8405-3922-42f1-8a12-01067017a2df tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:05.855207 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f7f8405-3922-42f1-8a12-01067017a2df tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:05.855986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f7f8405-3922-42f1-8a12-01067017a2df tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:05.859480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f7f8405-3922-42f1-8a12-01067017a2df tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:05.866759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f7f8405-3922-42f1-8a12-01067017a2df tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:05.868251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f7f8405-3922-42f1-8a12-01067017a2df tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:05.869337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f7f8405-3922-42f1-8a12-01067017a2df tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:06.563898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ef3a0aeb-60ab-479c-b467-cb2c063894b0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:06.573108 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ef3a0aeb-60ab-479c-b467-cb2c063894b0 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe" status: 200 len: 1315 microversion: 2.1 time: 1.063286 Sep 07 12:44:06.592820 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1496/2971] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:05 2022] GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe => generated 1315 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:06.692668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-fb762a66-5aab-4b6e-b63c-d7dd3cd0e95f req-ab034922-e5ac-4adb-b34a-4ddc53ecef5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe", "tag": "36bd5563-22e8-432a-ab67-ee7f2814dd6d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:06.706134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fb762a66-5aab-4b6e-b63c-d7dd3cd0e95f req-ab034922-e5ac-4adb-b34a-4ddc53ecef5e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:06.706953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fb762a66-5aab-4b6e-b63c-d7dd3cd0e95f req-ab034922-e5ac-4adb-b34a-4ddc53ecef5e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:06.707586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fb762a66-5aab-4b6e-b63c-d7dd3cd0e95f req-ab034922-e5ac-4adb-b34a-4ddc53ecef5e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:06.720036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5f7f8405-3922-42f1-8a12-01067017a2df tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:06.722468 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-fb762a66-5aab-4b6e-b63c-d7dd3cd0e95f req-ab034922-e5ac-4adb-b34a-4ddc53ecef5e service nova] Creating event network-changed:36bd5563-22e8-432a-ab67-ee7f2814dd6d for instance 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe on n-h1-852087-9 Sep 07 12:44:06.729541 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5f7f8405-3922-42f1-8a12-01067017a2df tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1323 microversion: 2.1 time: 0.931689 Sep 07 12:44:06.731961 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-fb762a66-5aab-4b6e-b63c-d7dd3cd0e95f req-ab034922-e5ac-4adb-b34a-4ddc53ecef5e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137060 Sep 07 12:44:06.733193 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1497/2972] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:06.733895 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1476/2973] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:05 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1323 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:06.741215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ead860af-6daa-4400-89a5-9665cfc797e2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:06.743100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ead860af-6daa-4400-89a5-9665cfc797e2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 825ead8a-aa8c-4402-80f7-749edc7d21c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:06.745239 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-31dadd3b-e24d-45a2-8821-2f2f3f297266 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:06.748621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-31dadd3b-e24d-45a2-8821-2f2f3f297266 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:06.752980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ead860af-6daa-4400-89a5-9665cfc797e2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:06.754179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ead860af-6daa-4400-89a5-9665cfc797e2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:06.754929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ead860af-6daa-4400-89a5-9665cfc797e2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:06.756855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ead860af-6daa-4400-89a5-9665cfc797e2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:06.758277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ead860af-6daa-4400-89a5-9665cfc797e2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:06.758917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ead860af-6daa-4400-89a5-9665cfc797e2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:06.764686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31dadd3b-e24d-45a2-8821-2f2f3f297266 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:06.765567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31dadd3b-e24d-45a2-8821-2f2f3f297266 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:06.770172 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31dadd3b-e24d-45a2-8821-2f2f3f297266 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:06.772535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31dadd3b-e24d-45a2-8821-2f2f3f297266 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:06.775351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31dadd3b-e24d-45a2-8821-2f2f3f297266 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:06.776134 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31dadd3b-e24d-45a2-8821-2f2f3f297266 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:06.820206 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-31dadd3b-e24d-45a2-8821-2f2f3f297266 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] HTTP exception thrown: Instance 209a7f47-3606-42a4-8360-4fa356ad74e7 could not be found. Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-31dadd3b-e24d-45a2-8821-2f2f3f297266 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Request method failure captured: Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 HTTP/1.1 Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJGWMXgN7OdrmO70X8q48ZD-kObLPYOd01ANus8JY-PK7OjbvYCQ097-aKOdLEd3zX6imftUV9BBkR8dj8xCIWAm9yYmlnMVOTu04sxm_YJiyi8RzROPFAn0FZkGq3OAzdh-65OtDl9f1F4UEDEA_AaJuKK-hToemYtm-2HEdw2FTvo Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6c7fac0664f044168f52e7c1a982c48e Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 209a7f47-3606-42a4-8360-4fa356ad74e7 could not be found. Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '209a7f47-3606-42a4-8360-4fa356ad74e7'} Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 209a7f47-3606-42a4-8360-4fa356ad74e7 could not be found. Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 209a7f47-3606-42a4-8360-4fa356ad74e7 could not be found. Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:06.823456 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:06.829458 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:06.829458 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:06.829458 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:06.829458 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:06.829458 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:06.829458 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 209a7f47-3606-42a4-8360-4fa356ad74e7 could not be found. Sep 07 12:44:06.829458 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:06.829458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-31dadd3b-e24d-45a2-8821-2f2f3f297266 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Returning 404 to user: Instance 209a7f47-3606-42a4-8360-4fa356ad74e7 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:06.829458 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-31dadd3b-e24d-45a2-8821-2f2f3f297266 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7" status: 404 len: 111 microversion: 2.1 time: 0.090944 Sep 07 12:44:06.829458 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1477/2974] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:06 2022] GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:06.837851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-439f79ab-cd35-4f17-a0f2-0f1823d53f0f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:06.839074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-439f79ab-cd35-4f17-a0f2-0f1823d53f0f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:06.850728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-439f79ab-cd35-4f17-a0f2-0f1823d53f0f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:06.851638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-439f79ab-cd35-4f17-a0f2-0f1823d53f0f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:06.852439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-439f79ab-cd35-4f17-a0f2-0f1823d53f0f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:06.853822 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-439f79ab-cd35-4f17-a0f2-0f1823d53f0f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:06.854774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-439f79ab-cd35-4f17-a0f2-0f1823d53f0f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:06.855811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-439f79ab-cd35-4f17-a0f2-0f1823d53f0f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:07.157984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ead860af-6daa-4400-89a5-9665cfc797e2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:07.176227 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ead860af-6daa-4400-89a5-9665cfc797e2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5" status: 200 len: 1472 microversion: 2.1 time: 0.441008 Sep 07 12:44:07.179532 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1498/2975] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:06 2022] GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5 => generated 1472 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:07.193340 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9e4df711-8d32-46e6-95f8-908c923a7fed tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '.version_select at 0x7fc41848edc0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:07.351377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-439f79ab-cd35-4f17-a0f2-0f1823d53f0f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:07.363352 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-439f79ab-cd35-4f17-a0f2-0f1823d53f0f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 200 len: 1522 microversion: 2.1 time: 0.531554 Sep 07 12:44:07.364005 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1478/2976] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:06 2022] GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 1522 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:07.405129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-61f79979-ea68-4752-85f3-2b989e602f66 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:07.406157 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-61f79979-ea68-4752-85f3-2b989e602f66 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:07.425905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61f79979-ea68-4752-85f3-2b989e602f66 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:07.428453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61f79979-ea68-4752-85f3-2b989e602f66 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:07.429653 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61f79979-ea68-4752-85f3-2b989e602f66 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:07.431928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61f79979-ea68-4752-85f3-2b989e602f66 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:07.432775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61f79979-ea68-4752-85f3-2b989e602f66 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:07.433459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61f79979-ea68-4752-85f3-2b989e602f66 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:07.841073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-61f79979-ea68-4752-85f3-2b989e602f66 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:07.855902 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-61f79979-ea68-4752-85f3-2b989e602f66 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 200 len: 1522 microversion: 2.1 time: 0.457668 Sep 07 12:44:07.857036 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1479/2977] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:07 2022] GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 1522 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:07.881468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-797896aa-6610-4e73-92d0-c58bed358364 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:07.884190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-797896aa-6610-4e73-92d0-c58bed358364 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:07.898527 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-797896aa-6610-4e73-92d0-c58bed358364 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:07.899046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-797896aa-6610-4e73-92d0-c58bed358364 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:07.899497 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-797896aa-6610-4e73-92d0-c58bed358364 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:07.900257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-797896aa-6610-4e73-92d0-c58bed358364 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:07.900735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-797896aa-6610-4e73-92d0-c58bed358364 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:07.901176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-797896aa-6610-4e73-92d0-c58bed358364 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:07.921078 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9e4df711-8d32-46e6-95f8-908c923a7fed tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/078addc5-f778-4355-95e0-80c0ea60a5c0" status: 202 len: 0 microversion: 2.1 time: 0.739877 Sep 07 12:44:07.926076 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1499/2978] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:44:07 2022] DELETE /compute/v2.1/os-security-groups/078addc5-f778-4355-95e0-80c0ea60a5c0 => generated 0 bytes in 745 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:44:07.932223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4639be19-dca7-4b07-8acd-ded947ce3e1c tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:07.932881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4639be19-dca7-4b07-8acd-ded947ce3e1c tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:07.942664 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4639be19-dca7-4b07-8acd-ded947ce3e1c tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:07.943197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4639be19-dca7-4b07-8acd-ded947ce3e1c tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:07.943659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4639be19-dca7-4b07-8acd-ded947ce3e1c tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:07.944428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4639be19-dca7-4b07-8acd-ded947ce3e1c tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:07.944903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4639be19-dca7-4b07-8acd-ded947ce3e1c tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:07.945325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4639be19-dca7-4b07-8acd-ded947ce3e1c tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:08.194790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-797896aa-6610-4e73-92d0-c58bed358364 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:08.239311 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-797896aa-6610-4e73-92d0-c58bed358364 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe" status: 200 len: 1315 microversion: 2.1 time: 0.365420 Sep 07 12:44:08.240289 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1480/2979] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:07 2022] GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:08.247952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8c31adff-df00-4ab7-848a-79f6abb3a530 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-663080238"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:08.250817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8c31adff-df00-4ab7-848a-79f6abb3a530 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:08.268656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c31adff-df00-4ab7-848a-79f6abb3a530 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:08.269306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c31adff-df00-4ab7-848a-79f6abb3a530 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:08.269816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c31adff-df00-4ab7-848a-79f6abb3a530 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:08.270594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c31adff-df00-4ab7-848a-79f6abb3a530 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:08.277114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c31adff-df00-4ab7-848a-79f6abb3a530 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:08.277964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c31adff-df00-4ab7-848a-79f6abb3a530 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:08.328169 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4639be19-dca7-4b07-8acd-ded947ce3e1c tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:08.341918 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4639be19-dca7-4b07-8acd-ded947ce3e1c tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1323 microversion: 2.1 time: 0.414349 Sep 07 12:44:08.343095 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1500/2980] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:07 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1323 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:08.353999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6f12b1ff-58fa-49f5-92b4-2a07dd2fbec5 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '.version_select at 0x7fc419546310>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:08.722655 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6f12b1ff-58fa-49f5-92b4-2a07dd2fbec5 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/81a7640e-608b-40ab-afa7-a72eac5ab4ed" status: 202 len: 0 microversion: 2.1 time: 0.372995 Sep 07 12:44:08.723755 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1501/2981] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:44:08 2022] DELETE /compute/v2.1/os-security-groups/81a7640e-608b-40ab-afa7-a72eac5ab4ed => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:44:08.732218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fe452dd0-5ceb-43d7-afe7-e7c60e148e32 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:08.732960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fe452dd0-5ceb-43d7-afe7-e7c60e148e32 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 825ead8a-aa8c-4402-80f7-749edc7d21c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:08.748858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe452dd0-5ceb-43d7-afe7-e7c60e148e32 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:08.750953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe452dd0-5ceb-43d7-afe7-e7c60e148e32 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:08.751559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe452dd0-5ceb-43d7-afe7-e7c60e148e32 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:08.753612 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe452dd0-5ceb-43d7-afe7-e7c60e148e32 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:08.755424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe452dd0-5ceb-43d7-afe7-e7c60e148e32 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:08.756368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe452dd0-5ceb-43d7-afe7-e7c60e148e32 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:08.831206 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8c31adff-df00-4ab7-848a-79f6abb3a530 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "POST /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2/action" status: 202 len: 0 microversion: 2.1 time: 0.589559 Sep 07 12:44:08.831951 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1481/2982] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:44:08 2022] POST /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2/action => generated 0 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 07 12:44:08.842681 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7e5a5d5f-a088-4b8a-920c-6fbe43e78f50 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Action: 'create', calling method: .version_select at 0x7fc4189bbb80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-115781725", "description": "tempest-description-348409888"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:08.850483 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe452dd0-5ceb-43d7-afe7-e7c60e148e32 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:08.851267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe452dd0-5ceb-43d7-afe7-e7c60e148e32 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:08.852036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fe452dd0-5ceb-43d7-afe7-e7c60e148e32 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:08.852672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-fe452dd0-5ceb-43d7-afe7-e7c60e148e32 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lazy-loading 'fault' on Instance uuid 825ead8a-aa8c-4402-80f7-749edc7d21c5 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:44:08.980415 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fe452dd0-5ceb-43d7-afe7-e7c60e148e32 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:08.998630 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fe452dd0-5ceb-43d7-afe7-e7c60e148e32 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5" status: 200 len: 1307 microversion: 2.1 time: 0.273198 Sep 07 12:44:08.999239 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1502/2983] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:08 2022] GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5 => generated 1307 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:09.005475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d6b970f6-e1ab-4d0f-a701-64557b668f7f req-d0e061ba-5dd3-4f35-9a33-0fc2cf4f878f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825ead8a-aa8c-4402-80f7-749edc7d21c5", "name": "network-vif-deleted", "tag": "97742b1d-4f2e-4907-8288-3d2750b5f23d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:09.036459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d6b970f6-e1ab-4d0f-a701-64557b668f7f req-d0e061ba-5dd3-4f35-9a33-0fc2cf4f878f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:09.038928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d6b970f6-e1ab-4d0f-a701-64557b668f7f req-d0e061ba-5dd3-4f35-9a33-0fc2cf4f878f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:09.039890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d6b970f6-e1ab-4d0f-a701-64557b668f7f req-d0e061ba-5dd3-4f35-9a33-0fc2cf4f878f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:09.068892 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d6b970f6-e1ab-4d0f-a701-64557b668f7f req-d0e061ba-5dd3-4f35-9a33-0fc2cf4f878f service nova] Creating event network-vif-deleted:97742b1d-4f2e-4907-8288-3d2750b5f23d for instance 825ead8a-aa8c-4402-80f7-749edc7d21c5 on n-h2-852087-9 Sep 07 12:44:09.082153 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d6b970f6-e1ab-4d0f-a701-64557b668f7f req-d0e061ba-5dd3-4f35-9a33-0fc2cf4f878f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080530 Sep 07 12:44:09.083200 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1503/2984] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:09.090898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea0e2f0f-6b76-481e-a12d-255a9cef5d4a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '.version_select at 0x7fc4194daca0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:09.230909 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7e5a5d5f-a088-4b8a-920c-6fbe43e78f50 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.396894 Sep 07 12:44:09.232597 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1482/2985] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Sep 7 12:44:08 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:09.292668 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ea0e2f0f-6b76-481e-a12d-255a9cef5d4a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "DELETE /compute/v2.1/images/c8fb60a0-5b20-4982-9520-fe7723de97a3" status: 204 len: 0 microversion: 2.1 time: 0.207762 Sep 07 12:44:09.293286 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1504/2986] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:09 2022] DELETE /compute/v2.1/images/c8fb60a0-5b20-4982-9520-fe7723de97a3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:44:09.303631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cb40e6d9-bd81-41a5-bbc4-3e94ab9a858c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Action: 'update', calling method: .version_select at 0x7fc4195e2670>, body: {"security_group": {"name": "tempest-sg-hth-1462094650", "description": "tempest-description-hth-651910259"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:09.388642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f0828d98-cca3-49a0-a952-e64a4042daea tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'create', calling method: .version_select at 0x7fc4184085e0>, body: {"keypair": {"name": "tempest-keypair-1673796667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkdPdV+Hj5D2Ioh2YUBFaZX+txg/46CxQf20r4cCpVMH1fUubfhQPUqpdGZeZfWHiH79JQqpvRXv6hBG4p9v5JuhCW/8+mumprdGNCXra8/g6ysZEzWvuqkbobBDD365A=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:09.430579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f0828d98-cca3-49a0-a952-e64a4042daea tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Getting quotas for project af1de494abea4aa7841c00fb199e8aec. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:44:09.446474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f0828d98-cca3-49a0-a952-e64a4042daea tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Getting quotas for user 22ec4509710f446d843f6882120c5d6e and project af1de494abea4aa7841c00fb199e8aec. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:44:09.518249 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f0828d98-cca3-49a0-a952-e64a4042daea tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.282779 Sep 07 12:44:09.522432 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1483/2987] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 12:44:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:09.537994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-28fd2e63-e2bd-4524-96d1-0217154e8713 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:09.541537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-28fd2e63-e2bd-4524-96d1-0217154e8713 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:09.563218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28fd2e63-e2bd-4524-96d1-0217154e8713 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:09.564634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28fd2e63-e2bd-4524-96d1-0217154e8713 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:09.566365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28fd2e63-e2bd-4524-96d1-0217154e8713 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:09.568529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28fd2e63-e2bd-4524-96d1-0217154e8713 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:09.570496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28fd2e63-e2bd-4524-96d1-0217154e8713 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:09.571841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28fd2e63-e2bd-4524-96d1-0217154e8713 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:09.595131 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cb40e6d9-bd81-41a5-bbc4-3e94ab9a858c tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "PUT /compute/v2.1/os-security-groups/9f6cbd0a-6c8c-47d6-96bf-e5d7bf8c2773" status: 200 len: 217 microversion: 2.1 time: 0.299780 Sep 07 12:44:09.598279 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1505/2988] 10.222.0.16 () {60 vars in 1290 bytes} [Wed Sep 7 12:44:09 2022] PUT /compute/v2.1/os-security-groups/9f6cbd0a-6c8c-47d6-96bf-e5d7bf8c2773 => generated 217 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:09.605570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fad8050d-4fb7-4aaa-b8d4-532602bd23eb tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '.version_select at 0x7fc41d24c940>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:09.664720 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-fad8050d-4fb7-4aaa-b8d4-532602bd23eb tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] HTTP exception thrown: Image not found. Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fad8050d-4fb7-4aaa-b8d4-532602bd23eb tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Request method failure captured: Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/images/c8fb60a0-5b20-4982-9520-fe7723de97a3 HTTP/1.1 Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJGQYbyJLIsXxXjgkDYN7LwAZ3FIxjt-YGkXt1Xo1a1MUwTVDulf3qar21KhPKqmmgY5XowXVa7QiIPma2KSUUJYmnQLgFXdiW6Ghu6fpYXXYUWnHmYT3Op2c2gidR2lsMRLQPmqnvHgSb4f0Vzgm_QdSzSUbn3j0rcW4vT7twxuCxo Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: ac0d1c1e891c470c99e7c968b908a054 Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: exception: Image not found. Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'c8fb60a0-5b20-4982-9520-fe7723de97a3'} Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c8fb60a0-5b20-4982-9520-fe7723de97a3 Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 07 12:44:09.669340 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c8fb60a0-5b20-4982-9520-fe7723de97a3 could not be found. Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 12:44:09.677266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:09.685528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fad8050d-4fb7-4aaa-b8d4-532602bd23eb tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Returning 404 to user: Image not found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:09.687290 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fad8050d-4fb7-4aaa-b8d4-532602bd23eb tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/images/c8fb60a0-5b20-4982-9520-fe7723de97a3" status: 404 len: 62 microversion: 2.1 time: 0.086333 Sep 07 12:44:09.694289 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1506/2989] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:44:09 2022] GET /compute/v2.1/images/c8fb60a0-5b20-4982-9520-fe7723de97a3 => generated 62 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:44:09.706339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-06740be0-85d0-4ec4-9d30-6e1754344bbb tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:09.709457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-06740be0-85d0-4ec4-9d30-6e1754344bbb tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:09.721793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06740be0-85d0-4ec4-9d30-6e1754344bbb tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:09.723279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06740be0-85d0-4ec4-9d30-6e1754344bbb tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:09.724149 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06740be0-85d0-4ec4-9d30-6e1754344bbb tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:09.725865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06740be0-85d0-4ec4-9d30-6e1754344bbb tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:09.727177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06740be0-85d0-4ec4-9d30-6e1754344bbb tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:09.728886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06740be0-85d0-4ec4-9d30-6e1754344bbb tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:09.937841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-28fd2e63-e2bd-4524-96d1-0217154e8713 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:09.952760 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-28fd2e63-e2bd-4524-96d1-0217154e8713 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe" status: 200 len: 1315 microversion: 2.1 time: 0.428094 Sep 07 12:44:09.953944 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1484/2990] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:09 2022] GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:09.964269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-77c20d7f-7b63-4d32-ac1e-27c4f423a63a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '.version_select at 0x7fc41857e280>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:10.161264 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-77c20d7f-7b63-4d32-ac1e-27c4f423a63a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/9f6cbd0a-6c8c-47d6-96bf-e5d7bf8c2773" status: 200 len: 217 microversion: 2.1 time: 0.205872 Sep 07 12:44:10.170881 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1485/2991] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Sep 7 12:44:09 2022] GET /compute/v2.1/os-security-groups/9f6cbd0a-6c8c-47d6-96bf-e5d7bf8c2773 => generated 217 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:10.176327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd2abf8c-d5c1-494b-a6c0-a27ae0310028 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:10.177258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dd2abf8c-d5c1-494b-a6c0-a27ae0310028 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:10.194028 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd2abf8c-d5c1-494b-a6c0-a27ae0310028 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:10.194943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd2abf8c-d5c1-494b-a6c0-a27ae0310028 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:10.195566 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd2abf8c-d5c1-494b-a6c0-a27ae0310028 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:10.196528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd2abf8c-d5c1-494b-a6c0-a27ae0310028 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:10.197624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd2abf8c-d5c1-494b-a6c0-a27ae0310028 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:10.199375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd2abf8c-d5c1-494b-a6c0-a27ae0310028 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:10.239982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-06740be0-85d0-4ec4-9d30-6e1754344bbb tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:10.250249 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-06740be0-85d0-4ec4-9d30-6e1754344bbb tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1323 microversion: 2.1 time: 0.552675 Sep 07 12:44:10.251124 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1507/2992] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:09 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1323 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:10.256983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9a5790ff-717d-4318-95a7-03d675c28e09 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:10.264732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9a5790ff-717d-4318-95a7-03d675c28e09 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 825ead8a-aa8c-4402-80f7-749edc7d21c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:10.277512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a5790ff-717d-4318-95a7-03d675c28e09 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:10.278295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a5790ff-717d-4318-95a7-03d675c28e09 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:10.278935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a5790ff-717d-4318-95a7-03d675c28e09 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:10.279839 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a5790ff-717d-4318-95a7-03d675c28e09 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:10.280473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a5790ff-717d-4318-95a7-03d675c28e09 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:10.281069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a5790ff-717d-4318-95a7-03d675c28e09 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:10.314103 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-9a5790ff-717d-4318-95a7-03d675c28e09 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] HTTP exception thrown: Instance 825ead8a-aa8c-4402-80f7-749edc7d21c5 could not be found. Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9a5790ff-717d-4318-95a7-03d675c28e09 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Request method failure captured: Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5 HTTP/1.1 Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJEP0irHIBLN8hFWvgLoOKa85E_5AoxCeRoHxKkTt9HdaFmlIYGchkE6q65oBFLP3DgAcUWlzLQgHRTeUGfdJav2RIkb2FS4kv4XxxXu-KkXROe-iYh2upLJXJIuF28hkxxUYg0rmbMG5d0HtmW6B3uJIdcPQo2gv8Pl4EjF30y2Jzg Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: e15fa55f4d4f4b4db6dbb26c0f07c3c4 Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersOnMultiNodesTest-1611524513 Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersOnMultiNodesTest-1611524513 Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: e15fa55f4d4f4b4db6dbb26c0f07c3c4 Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1611524513 Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersOnMultiNodesTest-1611524513-project Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: ed6e5d4d54224bca90954d1ebbd7b7a3 Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersOnMultiNodesTest-1611524513-project Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 825ead8a-aa8c-4402-80f7-749edc7d21c5 could not be found. Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '825ead8a-aa8c-4402-80f7-749edc7d21c5'} Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 825ead8a-aa8c-4402-80f7-749edc7d21c5 could not be found. Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 825ead8a-aa8c-4402-80f7-749edc7d21c5 could not be found. Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:10.317540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:10.321923 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:10.321923 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:10.321923 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:10.321923 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:10.321923 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:10.321923 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 825ead8a-aa8c-4402-80f7-749edc7d21c5 could not be found. Sep 07 12:44:10.321923 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:10.321923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9a5790ff-717d-4318-95a7-03d675c28e09 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Returning 404 to user: Instance 825ead8a-aa8c-4402-80f7-749edc7d21c5 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:10.325029 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9a5790ff-717d-4318-95a7-03d675c28e09 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5" status: 404 len: 111 microversion: 2.1 time: 0.071180 Sep 07 12:44:10.332539 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1508/2993] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:10 2022] GET /compute/v2.1/servers/825ead8a-aa8c-4402-80f7-749edc7d21c5 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:10.355077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9885f4d0-2ca5-48bc-a63d-ecbc1ac5d080 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '.version_select at 0x7fc4196623a0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:10.657530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dd2abf8c-d5c1-494b-a6c0-a27ae0310028 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:10.668921 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dd2abf8c-d5c1-494b-a6c0-a27ae0310028 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 200 len: 1534 microversion: 2.1 time: 0.496523 Sep 07 12:44:10.672427 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1486/2994] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:10 2022] GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 1534 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:10.687890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e38575b2-fc00-4b4d-856c-96da016bf2bb tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:10.688683 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e38575b2-fc00-4b4d-856c-96da016bf2bb tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:10.700168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e38575b2-fc00-4b4d-856c-96da016bf2bb tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:10.701073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e38575b2-fc00-4b4d-856c-96da016bf2bb tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:10.706663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e38575b2-fc00-4b4d-856c-96da016bf2bb tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:10.707739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e38575b2-fc00-4b4d-856c-96da016bf2bb tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:10.708392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e38575b2-fc00-4b4d-856c-96da016bf2bb tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:10.709005 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e38575b2-fc00-4b4d-856c-96da016bf2bb tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:10.774492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e38575b2-fc00-4b4d-856c-96da016bf2bb tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:44:10.904741 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e38575b2-fc00-4b4d-856c-96da016bf2bb tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca" status: 204 len: 0 microversion: 2.1 time: 0.219735 Sep 07 12:44:10.905419 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1487/2995] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:44:10 2022] DELETE /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:44:10.917842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-df8cfad1-20ee-49b6-a40d-e1238c4f550e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:10.919526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-df8cfad1-20ee-49b6-a40d-e1238c4f550e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:10.927201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df8cfad1-20ee-49b6-a40d-e1238c4f550e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:10.928067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df8cfad1-20ee-49b6-a40d-e1238c4f550e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:10.928729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df8cfad1-20ee-49b6-a40d-e1238c4f550e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:10.929886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df8cfad1-20ee-49b6-a40d-e1238c4f550e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:10.930533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df8cfad1-20ee-49b6-a40d-e1238c4f550e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:10.931287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df8cfad1-20ee-49b6-a40d-e1238c4f550e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:11.639649 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9885f4d0-2ca5-48bc-a63d-ecbc1ac5d080 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/9f6cbd0a-6c8c-47d6-96bf-e5d7bf8c2773" status: 202 len: 0 microversion: 2.1 time: 1.306330 Sep 07 12:44:11.642084 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1509/2996] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:44:10 2022] DELETE /compute/v2.1/os-security-groups/9f6cbd0a-6c8c-47d6-96bf-e5d7bf8c2773 => generated 0 bytes in 1311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:44:11.660562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cd1f1f36-7012-4f27-8b76-a055cd9840be tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:11.665233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cd1f1f36-7012-4f27-8b76-a055cd9840be tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:11.690225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd1f1f36-7012-4f27-8b76-a055cd9840be tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:11.691273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd1f1f36-7012-4f27-8b76-a055cd9840be tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:11.694608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd1f1f36-7012-4f27-8b76-a055cd9840be tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:11.700391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd1f1f36-7012-4f27-8b76-a055cd9840be tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:11.704741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd1f1f36-7012-4f27-8b76-a055cd9840be tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:11.706135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd1f1f36-7012-4f27-8b76-a055cd9840be tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:11.779003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:44:11.937425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-df8cfad1-20ee-49b6-a40d-e1238c4f550e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:11.956892 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-df8cfad1-20ee-49b6-a40d-e1238c4f550e tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca" status: 200 len: 1472 microversion: 2.1 time: 1.043234 Sep 07 12:44:11.975770 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1488/2997] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:10 2022] GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca => generated 1472 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:11.988726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0fb97066-2399-4aa3-b683-8f89838804e1 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:11.992799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0fb97066-2399-4aa3-b683-8f89838804e1 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:12.012071 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fb97066-2399-4aa3-b683-8f89838804e1 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:12.016109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fb97066-2399-4aa3-b683-8f89838804e1 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:12.017062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fb97066-2399-4aa3-b683-8f89838804e1 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:12.018842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fb97066-2399-4aa3-b683-8f89838804e1 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:12.022990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fb97066-2399-4aa3-b683-8f89838804e1 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:12.023751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fb97066-2399-4aa3-b683-8f89838804e1 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:12.382855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cd1f1f36-7012-4f27-8b76-a055cd9840be tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:12.392807 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cd1f1f36-7012-4f27-8b76-a055cd9840be tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe" status: 200 len: 1315 microversion: 2.1 time: 0.748135 Sep 07 12:44:12.400605 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1510/2998] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:11 2022] GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe => generated 1315 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:12.409789 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-93e8a7e4-4eae-4d6c-b568-7583999e6f1b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:12.415430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-93e8a7e4-4eae-4d6c-b568-7583999e6f1b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:12.437161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93e8a7e4-4eae-4d6c-b568-7583999e6f1b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:12.438507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93e8a7e4-4eae-4d6c-b568-7583999e6f1b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:12.439501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93e8a7e4-4eae-4d6c-b568-7583999e6f1b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:12.440622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93e8a7e4-4eae-4d6c-b568-7583999e6f1b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:12.441378 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93e8a7e4-4eae-4d6c-b568-7583999e6f1b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:12.442101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93e8a7e4-4eae-4d6c-b568-7583999e6f1b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:12.476254 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-93e8a7e4-4eae-4d6c-b568-7583999e6f1b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] HTTP exception thrown: Instance 209a7f47-3606-42a4-8360-4fa356ad74e7 could not be found. Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-93e8a7e4-4eae-4d6c-b568-7583999e6f1b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Request method failure captured: Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 HTTP/1.1 Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJGWMXgN7OdrmO70X8q48ZD-kObLPYOd01ANus8JY-PK7OjbvYCQ097-aKOdLEd3zX6imftUV9BBkR8dj8xCIWAm9yYmlnMVOTu04sxm_YJiyi8RzROPFAn0FZkGq3OAzdh-65OtDl9f1F4UEDEA_AaJuKK-hToemYtm-2HEdw2FTvo Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6c7fac0664f044168f52e7c1a982c48e Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 209a7f47-3606-42a4-8360-4fa356ad74e7 could not be found. Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '209a7f47-3606-42a4-8360-4fa356ad74e7'} Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 209a7f47-3606-42a4-8360-4fa356ad74e7 could not be found. Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:12.479776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:12.484647 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 209a7f47-3606-42a4-8360-4fa356ad74e7 could not be found. Sep 07 12:44:12.484647 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:12.484647 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:12.484647 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:12.484647 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:12.484647 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:12.484647 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:12.484647 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:12.484647 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:12.484647 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 209a7f47-3606-42a4-8360-4fa356ad74e7 could not be found. Sep 07 12:44:12.484647 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:12.488709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-93e8a7e4-4eae-4d6c-b568-7583999e6f1b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Returning 404 to user: Instance 209a7f47-3606-42a4-8360-4fa356ad74e7 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:12.490368 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-93e8a7e4-4eae-4d6c-b568-7583999e6f1b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "DELETE /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7" status: 404 len: 111 microversion: 2.1 time: 0.088174 Sep 07 12:44:12.491782 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1511/2999] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:44:12 2022] DELETE /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:12.498330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c05e568f-1c3b-4006-9a90-f31004a24e0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:12.500126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c05e568f-1c3b-4006-9a90-f31004a24e0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:12.508355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c05e568f-1c3b-4006-9a90-f31004a24e0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:12.509252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c05e568f-1c3b-4006-9a90-f31004a24e0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:12.510183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c05e568f-1c3b-4006-9a90-f31004a24e0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:12.511450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c05e568f-1c3b-4006-9a90-f31004a24e0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:12.512241 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c05e568f-1c3b-4006-9a90-f31004a24e0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:12.512900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c05e568f-1c3b-4006-9a90-f31004a24e0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:12.705764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0fb97066-2399-4aa3-b683-8f89838804e1 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:12.719403 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0fb97066-2399-4aa3-b683-8f89838804e1 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1323 microversion: 2.1 time: 0.737676 Sep 07 12:44:12.722229 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1489/3000] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:11 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1323 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:12.875345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-3b9003a6-5219-4915-8e82-c79888858296 req-f3b3df57-daee-4df9-b151-5f12fea42d1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca300ad8-1300-4adf-940f-8cc52f13d8dc", "name": "network-vif-plugged", "status": "completed", "tag": "6b1ac69f-da45-464f-94bf-5e56a21ce00a"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:12.901753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3b9003a6-5219-4915-8e82-c79888858296 req-f3b3df57-daee-4df9-b151-5f12fea42d1d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:12.903416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3b9003a6-5219-4915-8e82-c79888858296 req-f3b3df57-daee-4df9-b151-5f12fea42d1d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:12.907238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3b9003a6-5219-4915-8e82-c79888858296 req-f3b3df57-daee-4df9-b151-5f12fea42d1d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:12.946054 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-3b9003a6-5219-4915-8e82-c79888858296 req-f3b3df57-daee-4df9-b151-5f12fea42d1d service nova] Creating event network-vif-plugged:6b1ac69f-da45-464f-94bf-5e56a21ce00a for instance ca300ad8-1300-4adf-940f-8cc52f13d8dc on n-h2-852087-9 Sep 07 12:44:12.962140 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-3b9003a6-5219-4915-8e82-c79888858296 req-f3b3df57-daee-4df9-b151-5f12fea42d1d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235934 Sep 07 12:44:12.968565 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1490/3001] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:12.996831 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-997da107-a64a-40c6-a219-5b698c7a2b77 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:12.998291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-997da107-a64a-40c6-a219-5b698c7a2b77 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: 209a7f47-3606-42a4-8360-4fa356ad74e7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:13.049784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-997da107-a64a-40c6-a219-5b698c7a2b77 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:13.050792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-997da107-a64a-40c6-a219-5b698c7a2b77 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:13.056114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-997da107-a64a-40c6-a219-5b698c7a2b77 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:13.057585 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-997da107-a64a-40c6-a219-5b698c7a2b77 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:13.065319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-997da107-a64a-40c6-a219-5b698c7a2b77 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:13.074753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-997da107-a64a-40c6-a219-5b698c7a2b77 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:13.153316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c05e568f-1c3b-4006-9a90-f31004a24e0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:13.157206 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-997da107-a64a-40c6-a219-5b698c7a2b77 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] HTTP exception thrown: Instance 209a7f47-3606-42a4-8360-4fa356ad74e7 could not be found. Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-997da107-a64a-40c6-a219-5b698c7a2b77 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Request method failure captured: Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 HTTP/1.1 Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJGWMXgN7OdrmO70X8q48ZD-kObLPYOd01ANus8JY-PK7OjbvYCQ097-aKOdLEd3zX6imftUV9BBkR8dj8xCIWAm9yYmlnMVOTu04sxm_YJiyi8RzROPFAn0FZkGq3OAzdh-65OtDl9f1F4UEDEA_AaJuKK-hToemYtm-2HEdw2FTvo Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6c7fac0664f044168f52e7c1a982c48e Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 209a7f47-3606-42a4-8360-4fa356ad74e7 could not be found. Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '209a7f47-3606-42a4-8360-4fa356ad74e7'} Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 209a7f47-3606-42a4-8360-4fa356ad74e7 could not be found. Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 209a7f47-3606-42a4-8360-4fa356ad74e7 could not be found. Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:13.161595 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:13.170206 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:13.170206 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:13.170206 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:13.170206 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:13.170206 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:13.170206 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 209a7f47-3606-42a4-8360-4fa356ad74e7 could not be found. Sep 07 12:44:13.170206 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:13.179802 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c05e568f-1c3b-4006-9a90-f31004a24e0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 200 len: 1540 microversion: 2.1 time: 0.670371 Sep 07 12:44:13.181864 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1512/3002] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:12 2022] GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 1540 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:13.183234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-997da107-a64a-40c6-a219-5b698c7a2b77 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Returning 404 to user: Instance 209a7f47-3606-42a4-8360-4fa356ad74e7 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:13.185042 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-997da107-a64a-40c6-a219-5b698c7a2b77 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7" status: 404 len: 111 microversion: 2.1 time: 0.211791 Sep 07 12:44:13.188322 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1491/3003] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:12 2022] GET /compute/v2.1/servers/209a7f47-3606-42a4-8360-4fa356ad74e7 => generated 111 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:13.195667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9de7162b-738c-4c44-9360-4836032cf0d6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:13.202246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9de7162b-738c-4c44-9360-4836032cf0d6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:13.209376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8a1629f6-3775-46ad-bd80-d781c9e100e0 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '.version_select at 0x7fc418552c10>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:13.215800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9de7162b-738c-4c44-9360-4836032cf0d6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:13.216853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9de7162b-738c-4c44-9360-4836032cf0d6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:13.218592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9de7162b-738c-4c44-9360-4836032cf0d6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:13.222618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9de7162b-738c-4c44-9360-4836032cf0d6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:13.223599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9de7162b-738c-4c44-9360-4836032cf0d6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:13.224219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9de7162b-738c-4c44-9360-4836032cf0d6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:13.367213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG neutronclient.v2_0.client [None req-8a1629f6-3775-46ad-bd80-d781c9e100e0 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 81a7640e-608b-40ab-afa7-a72eac5ab4ed does not exist", "detail": ""}} {{(pid=122433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 12:44:13.368536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.security_group_api [None req-8a1629f6-3775-46ad-bd80-d781c9e100e0 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Neutron security group 81a7640e-608b-40ab-afa7-a72eac5ab4ed not found {{(pid=122433) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 12:44:13.369455 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-8a1629f6-3775-46ad-bd80-d781c9e100e0 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] HTTP exception thrown: Security group 81a7640e-608b-40ab-afa7-a72eac5ab4ed does not exist Sep 07 12:44:13.369455 n-d-852087-9 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-5d16b848-be23-46d7-b113-8ef8b90a26c8'] Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8a1629f6-3775-46ad-bd80-d781c9e100e0 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Request method failure captured: Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-security-groups/81a7640e-608b-40ab-afa7-a72eac5ab4ed HTTP/1.1 Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJGWMXgN7OdrmO70X8q48ZD-kObLPYOd01ANus8JY-PK7OjbvYCQ097-aKOdLEd3zX6imftUV9BBkR8dj8xCIWAm9yYmlnMVOTu04sxm_YJiyi8RzROPFAn0FZkGq3OAzdh-65OtDl9f1F4UEDEA_AaJuKK-hToemYtm-2HEdw2FTvo Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6c7fac0664f044168f52e7c1a982c48e Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: exception: Security group 81a7640e-608b-40ab-afa7-a72eac5ab4ed does not exist Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-5d16b848-be23-46d7-b113-8ef8b90a26c8'] Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '81a7640e-608b-40ab-afa7-a72eac5ab4ed'} Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 12:44:13.375789 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 81a7640e-608b-40ab-afa7-a72eac5ab4ed does not exist Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d16b848-be23-46d7-b113-8ef8b90a26c8'] Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 81a7640e-608b-40ab-afa7-a72eac5ab4ed does not exist Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d16b848-be23-46d7-b113-8ef8b90a26c8'] Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 81a7640e-608b-40ab-afa7-a72eac5ab4ed does not exist Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d16b848-be23-46d7-b113-8ef8b90a26c8'] Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 81a7640e-608b-40ab-afa7-a72eac5ab4ed does not exist Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d16b848-be23-46d7-b113-8ef8b90a26c8'] Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8a1629f6-3775-46ad-bd80-d781c9e100e0 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Returning 404 to user: Security group 81a7640e-608b-40ab-afa7-a72eac5ab4ed does not exist Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-5d16b848-be23-46d7-b113-8ef8b90a26c8'] {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:13.384710 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8a1629f6-3775-46ad-bd80-d781c9e100e0 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/81a7640e-608b-40ab-afa7-a72eac5ab4ed" status: 404 len: 194 microversion: 2.1 time: 0.188888 Sep 07 12:44:13.395614 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1492/3004] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:44:13 2022] DELETE /compute/v2.1/os-security-groups/81a7640e-608b-40ab-afa7-a72eac5ab4ed => generated 194 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:13.418526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6805f75b-a067-4740-94be-71e991b3cf63 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:13.418889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6805f75b-a067-4740-94be-71e991b3cf63 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] [instance: b017ea78-874a-4e91-933a-716e254275a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:13.438158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6805f75b-a067-4740-94be-71e991b3cf63 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:13.441740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6805f75b-a067-4740-94be-71e991b3cf63 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:13.441740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6805f75b-a067-4740-94be-71e991b3cf63 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:13.441740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6805f75b-a067-4740-94be-71e991b3cf63 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:13.442533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6805f75b-a067-4740-94be-71e991b3cf63 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:13.445455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6805f75b-a067-4740-94be-71e991b3cf63 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:13.561733 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6805f75b-a067-4740-94be-71e991b3cf63 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] [instance: b017ea78-874a-4e91-933a-716e254275a6] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:44:13.642736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:44:13.699392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:44:13.726903 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6805f75b-a067-4740-94be-71e991b3cf63 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6" status: 204 len: 0 microversion: 2.1 time: 0.334103 Sep 07 12:44:13.736627 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1493/3005] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:44:13 2022] DELETE /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:44:13.754754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1e2ce5c3-9af3-406a-962c-5e10434cc5e5 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '.version_select at 0x7fc418867430>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:14.037045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG neutronclient.v2_0.client [None req-1e2ce5c3-9af3-406a-962c-5e10434cc5e5 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 078addc5-f778-4355-95e0-80c0ea60a5c0 does not exist", "detail": ""}} {{(pid=122433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 12:44:14.038756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.security_group_api [None req-1e2ce5c3-9af3-406a-962c-5e10434cc5e5 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Neutron security group 078addc5-f778-4355-95e0-80c0ea60a5c0 not found {{(pid=122433) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 12:44:14.039508 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-1e2ce5c3-9af3-406a-962c-5e10434cc5e5 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] HTTP exception thrown: Security group 078addc5-f778-4355-95e0-80c0ea60a5c0 does not exist Sep 07 12:44:14.039508 n-d-852087-9 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-576cb314-32cf-484f-8d3d-c4ed5fd12ff7'] Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1e2ce5c3-9af3-406a-962c-5e10434cc5e5 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Request method failure captured: Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-security-groups/078addc5-f778-4355-95e0-80c0ea60a5c0 HTTP/1.1 Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJGWMXgN7OdrmO70X8q48ZD-kObLPYOd01ANus8JY-PK7OjbvYCQ097-aKOdLEd3zX6imftUV9BBkR8dj8xCIWAm9yYmlnMVOTu04sxm_YJiyi8RzROPFAn0FZkGq3OAzdh-65OtDl9f1F4UEDEA_AaJuKK-hToemYtm-2HEdw2FTvo Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6c7fac0664f044168f52e7c1a982c48e Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: exception: Security group 078addc5-f778-4355-95e0-80c0ea60a5c0 does not exist Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-576cb314-32cf-484f-8d3d-c4ed5fd12ff7'] Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '078addc5-f778-4355-95e0-80c0ea60a5c0'} Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 12:44:14.042583 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 078addc5-f778-4355-95e0-80c0ea60a5c0 does not exist Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-576cb314-32cf-484f-8d3d-c4ed5fd12ff7'] Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 078addc5-f778-4355-95e0-80c0ea60a5c0 does not exist Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-576cb314-32cf-484f-8d3d-c4ed5fd12ff7'] Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 078addc5-f778-4355-95e0-80c0ea60a5c0 does not exist Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-576cb314-32cf-484f-8d3d-c4ed5fd12ff7'] Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 078addc5-f778-4355-95e0-80c0ea60a5c0 does not exist Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-576cb314-32cf-484f-8d3d-c4ed5fd12ff7'] Sep 07 12:44:14.046354 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:14.050032 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1e2ce5c3-9af3-406a-962c-5e10434cc5e5 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Returning 404 to user: Security group 078addc5-f778-4355-95e0-80c0ea60a5c0 does not exist Sep 07 12:44:14.050032 n-d-852087-9 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-576cb314-32cf-484f-8d3d-c4ed5fd12ff7'] {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:14.051252 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1e2ce5c3-9af3-406a-962c-5e10434cc5e5 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/078addc5-f778-4355-95e0-80c0ea60a5c0" status: 404 len: 194 microversion: 2.1 time: 0.312032 Sep 07 12:44:14.052048 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1494/3006] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:44:13 2022] DELETE /compute/v2.1/os-security-groups/078addc5-f778-4355-95e0-80c0ea60a5c0 => generated 194 bytes in 315 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:14.072825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fc1db2ef-4924-4c5f-bbde-7992cbaa0e0e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:14.079854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fc1db2ef-4924-4c5f-bbde-7992cbaa0e0e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:14.109133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc1db2ef-4924-4c5f-bbde-7992cbaa0e0e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:14.112306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc1db2ef-4924-4c5f-bbde-7992cbaa0e0e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:14.113469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc1db2ef-4924-4c5f-bbde-7992cbaa0e0e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:14.118247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc1db2ef-4924-4c5f-bbde-7992cbaa0e0e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:14.119040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc1db2ef-4924-4c5f-bbde-7992cbaa0e0e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:14.121047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc1db2ef-4924-4c5f-bbde-7992cbaa0e0e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:14.365538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9de7162b-738c-4c44-9360-4836032cf0d6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:14.404846 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9de7162b-738c-4c44-9360-4836032cf0d6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca" status: 200 len: 1472 microversion: 2.1 time: 1.217913 Sep 07 12:44:14.408207 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1513/3007] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:13 2022] GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca => generated 1472 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:14.425772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c20cf496-e048-482c-b926-7840e327f8f2 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:14.436791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c20cf496-e048-482c-b926-7840e327f8f2 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] [instance: b017ea78-874a-4e91-933a-716e254275a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:14.456296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c20cf496-e048-482c-b926-7840e327f8f2 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:14.457601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c20cf496-e048-482c-b926-7840e327f8f2 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:14.458747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c20cf496-e048-482c-b926-7840e327f8f2 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:14.461684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c20cf496-e048-482c-b926-7840e327f8f2 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:14.463554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c20cf496-e048-482c-b926-7840e327f8f2 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:14.464644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c20cf496-e048-482c-b926-7840e327f8f2 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:14.585244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fc1db2ef-4924-4c5f-bbde-7992cbaa0e0e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:14.597584 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fc1db2ef-4924-4c5f-bbde-7992cbaa0e0e tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe" status: 200 len: 1315 microversion: 2.1 time: 0.540930 Sep 07 12:44:14.609850 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1495/3008] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:14 2022] GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:14.609850 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7d844c64-dcb3-482a-839a-dec5a4488537 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:14.610439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7d844c64-dcb3-482a-839a-dec5a4488537 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:14.630640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d844c64-dcb3-482a-839a-dec5a4488537 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:14.633599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d844c64-dcb3-482a-839a-dec5a4488537 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:14.636843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d844c64-dcb3-482a-839a-dec5a4488537 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:14.640214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d844c64-dcb3-482a-839a-dec5a4488537 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:14.641130 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d844c64-dcb3-482a-839a-dec5a4488537 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:14.642164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d844c64-dcb3-482a-839a-dec5a4488537 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:15.087862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c20cf496-e048-482c-b926-7840e327f8f2 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51065729f69f4bfb8ab48d2c70d0ed55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12bd04061ca4c3795958b51739bbbdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:15.129779 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c20cf496-e048-482c-b926-7840e327f8f2 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] 10.222.0.16 "GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6" status: 200 len: 1664 microversion: 2.1 time: 0.714378 Sep 07 12:44:15.130851 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1514/3009] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:14 2022] GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6 => generated 1664 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:15.151674 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-78eb1cb9-a105-4293-b6b3-c14c49e06e7b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '.version_select at 0x7fc41d28e0d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:15.192713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG neutronclient.v2_0.client [None req-78eb1cb9-a105-4293-b6b3-c14c49e06e7b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a7c841db-a50b-4faa-a62b-543819247640 does not exist", "detail": ""}} {{(pid=122432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 12:44:15.193710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.security_group_api [None req-78eb1cb9-a105-4293-b6b3-c14c49e06e7b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Neutron security group a7c841db-a50b-4faa-a62b-543819247640 not found {{(pid=122432) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 12:44:15.194431 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-78eb1cb9-a105-4293-b6b3-c14c49e06e7b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] HTTP exception thrown: Security group a7c841db-a50b-4faa-a62b-543819247640 does not exist Sep 07 12:44:15.194431 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-620df310-2f89-4dc2-9a98-0ab0dd703978'] Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-78eb1cb9-a105-4293-b6b3-c14c49e06e7b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Request method failure captured: Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/os-security-groups/a7c841db-a50b-4faa-a62b-543819247640 HTTP/1.1 Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJGWMXgN7OdrmO70X8q48ZD-kObLPYOd01ANus8JY-PK7OjbvYCQ097-aKOdLEd3zX6imftUV9BBkR8dj8xCIWAm9yYmlnMVOTu04sxm_YJiyi8RzROPFAn0FZkGq3OAzdh-65OtDl9f1F4UEDEA_AaJuKK-hToemYtm-2HEdw2FTvo Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6c7fac0664f044168f52e7c1a982c48e Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: exception: Security group a7c841db-a50b-4faa-a62b-543819247640 does not exist Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-620df310-2f89-4dc2-9a98-0ab0dd703978'] Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'a7c841db-a50b-4faa-a62b-543819247640'} Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 12:44:15.197313 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a7c841db-a50b-4faa-a62b-543819247640 does not exist Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-620df310-2f89-4dc2-9a98-0ab0dd703978'] Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a7c841db-a50b-4faa-a62b-543819247640 does not exist Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-620df310-2f89-4dc2-9a98-0ab0dd703978'] Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a7c841db-a50b-4faa-a62b-543819247640 does not exist Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-620df310-2f89-4dc2-9a98-0ab0dd703978'] Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a7c841db-a50b-4faa-a62b-543819247640 does not exist Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-620df310-2f89-4dc2-9a98-0ab0dd703978'] Sep 07 12:44:15.201776 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:15.205822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-78eb1cb9-a105-4293-b6b3-c14c49e06e7b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Returning 404 to user: Security group a7c841db-a50b-4faa-a62b-543819247640 does not exist Sep 07 12:44:15.205822 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-620df310-2f89-4dc2-9a98-0ab0dd703978'] {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:15.207625 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-78eb1cb9-a105-4293-b6b3-c14c49e06e7b tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/a7c841db-a50b-4faa-a62b-543819247640" status: 404 len: 194 microversion: 2.1 time: 0.075339 Sep 07 12:44:15.208782 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1515/3010] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:44:15 2022] DELETE /compute/v2.1/os-security-groups/a7c841db-a50b-4faa-a62b-543819247640 => generated 194 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:15.230713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-376fc0e3-da9f-43fb-9d30-233fac7aa90d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:15.235763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-376fc0e3-da9f-43fb-9d30-233fac7aa90d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:15.257835 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-376fc0e3-da9f-43fb-9d30-233fac7aa90d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:15.260962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-376fc0e3-da9f-43fb-9d30-233fac7aa90d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:15.262625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-376fc0e3-da9f-43fb-9d30-233fac7aa90d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:15.266771 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-376fc0e3-da9f-43fb-9d30-233fac7aa90d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:15.267518 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-376fc0e3-da9f-43fb-9d30-233fac7aa90d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:15.269439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-376fc0e3-da9f-43fb-9d30-233fac7aa90d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:15.274178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7d844c64-dcb3-482a-839a-dec5a4488537 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:15.301954 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7d844c64-dcb3-482a-839a-dec5a4488537 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1323 microversion: 2.1 time: 0.698651 Sep 07 12:44:15.309287 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1496/3011] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:14 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1323 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:15.329361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c891c660-526b-45cc-a812-6447bb371aa1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-686952309", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49960e13-4e80-4757-a207-47071e716cc5"}], "security_groups": [{"name": "tempest-securitygroup--1118209278"}], "key_name": "tempest-keypair-1673796667", "user_data": "}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:15.655558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-376fc0e3-da9f-43fb-9d30-233fac7aa90d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:15.681464 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-376fc0e3-da9f-43fb-9d30-233fac7aa90d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 200 len: 1540 microversion: 2.1 time: 0.468494 Sep 07 12:44:15.684250 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1516/3012] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:15 2022] GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 1540 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:15.694750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8b3ee674-ac07-4358-9764-bd74989f4e56 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '.version_select at 0x7fc4192228b0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:15.696241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-c891c660-526b-45cc-a812-6447bb371aa1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] validate_networks() for [('49960e13-4e80-4757-a207-47071e716cc5', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:44:15.837383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG neutronclient.v2_0.client [None req-8b3ee674-ac07-4358-9764-bd74989f4e56 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group af3c8754-5f67-41d0-b2a4-4c14d5e4972c does not exist", "detail": ""}} {{(pid=122432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 12:44:15.838841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.security_group_api [None req-8b3ee674-ac07-4358-9764-bd74989f4e56 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Neutron security group af3c8754-5f67-41d0-b2a4-4c14d5e4972c not found {{(pid=122432) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 12:44:15.840068 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-8b3ee674-ac07-4358-9764-bd74989f4e56 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] HTTP exception thrown: Security group af3c8754-5f67-41d0-b2a4-4c14d5e4972c does not exist Sep 07 12:44:15.840068 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-8b868956-b9f2-42f3-b047-264da918ef6e'] Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8b3ee674-ac07-4358-9764-bd74989f4e56 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Request method failure captured: Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/os-security-groups/af3c8754-5f67-41d0-b2a4-4c14d5e4972c HTTP/1.1 Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJGWMXgN7OdrmO70X8q48ZD-kObLPYOd01ANus8JY-PK7OjbvYCQ097-aKOdLEd3zX6imftUV9BBkR8dj8xCIWAm9yYmlnMVOTu04sxm_YJiyi8RzROPFAn0FZkGq3OAzdh-65OtDl9f1F4UEDEA_AaJuKK-hToemYtm-2HEdw2FTvo Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6c7fac0664f044168f52e7c1a982c48e Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: exception: Security group af3c8754-5f67-41d0-b2a4-4c14d5e4972c does not exist Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-8b868956-b9f2-42f3-b047-264da918ef6e'] Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'af3c8754-5f67-41d0-b2a4-4c14d5e4972c'} Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 12:44:15.849076 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group af3c8754-5f67-41d0-b2a4-4c14d5e4972c does not exist Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8b868956-b9f2-42f3-b047-264da918ef6e'] Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group af3c8754-5f67-41d0-b2a4-4c14d5e4972c does not exist Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8b868956-b9f2-42f3-b047-264da918ef6e'] Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group af3c8754-5f67-41d0-b2a4-4c14d5e4972c does not exist Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8b868956-b9f2-42f3-b047-264da918ef6e'] Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group af3c8754-5f67-41d0-b2a4-4c14d5e4972c does not exist Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8b868956-b9f2-42f3-b047-264da918ef6e'] Sep 07 12:44:15.857905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:15.870105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8b3ee674-ac07-4358-9764-bd74989f4e56 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Returning 404 to user: Security group af3c8754-5f67-41d0-b2a4-4c14d5e4972c does not exist Sep 07 12:44:15.870105 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-8b868956-b9f2-42f3-b047-264da918ef6e'] {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:15.873306 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8b3ee674-ac07-4358-9764-bd74989f4e56 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/af3c8754-5f67-41d0-b2a4-4c14d5e4972c" status: 404 len: 194 microversion: 2.1 time: 0.185463 Sep 07 12:44:15.875118 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1517/3013] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:44:15 2022] DELETE /compute/v2.1/os-security-groups/af3c8754-5f67-41d0-b2a4-4c14d5e4972c => generated 194 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:15.885041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8d9ffa11-f84d-40f0-ba24-54a5bf07d0a3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:15.886541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8d9ffa11-f84d-40f0-ba24-54a5bf07d0a3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:15.929514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d9ffa11-f84d-40f0-ba24-54a5bf07d0a3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:15.930930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d9ffa11-f84d-40f0-ba24-54a5bf07d0a3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:15.932730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d9ffa11-f84d-40f0-ba24-54a5bf07d0a3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:15.935312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d9ffa11-f84d-40f0-ba24-54a5bf07d0a3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:15.936668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d9ffa11-f84d-40f0-ba24-54a5bf07d0a3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:15.937833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d9ffa11-f84d-40f0-ba24-54a5bf07d0a3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:16.397161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8d9ffa11-f84d-40f0-ba24-54a5bf07d0a3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:16.425636 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8d9ffa11-f84d-40f0-ba24-54a5bf07d0a3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca" status: 200 len: 1472 microversion: 2.1 time: 0.548242 Sep 07 12:44:16.428784 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1518/3014] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:15 2022] GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca => generated 1472 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:16.445206 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0b9d9bb5-c428-49d1-acb6-72010a54213d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:16.446876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0b9d9bb5-c428-49d1-acb6-72010a54213d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:16.468620 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b9d9bb5-c428-49d1-acb6-72010a54213d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:16.470127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b9d9bb5-c428-49d1-acb6-72010a54213d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:16.471169 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b9d9bb5-c428-49d1-acb6-72010a54213d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:16.472906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b9d9bb5-c428-49d1-acb6-72010a54213d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:16.474087 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b9d9bb5-c428-49d1-acb6-72010a54213d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:16.475128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b9d9bb5-c428-49d1-acb6-72010a54213d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:16.831981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c891c660-526b-45cc-a812-6447bb371aa1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:44:16.833715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c891c660-526b-45cc-a812-6447bb371aa1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:44:16.835080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c891c660-526b-45cc-a812-6447bb371aa1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:44:16.836096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c891c660-526b-45cc-a812-6447bb371aa1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:44:16.837083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c891c660-526b-45cc-a812-6447bb371aa1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:44:16.865335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c891c660-526b-45cc-a812-6447bb371aa1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:16.868691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c891c660-526b-45cc-a812-6447bb371aa1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:16.872148 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c891c660-526b-45cc-a812-6447bb371aa1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:16.876956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c891c660-526b-45cc-a812-6447bb371aa1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:16.879114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c891c660-526b-45cc-a812-6447bb371aa1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:16.882856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c891c660-526b-45cc-a812-6447bb371aa1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:16.954576 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0b9d9bb5-c428-49d1-acb6-72010a54213d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:16.964194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-c891c660-526b-45cc-a812-6447bb371aa1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Getting quotas for project af1de494abea4aa7841c00fb199e8aec. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:44:16.984183 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0b9d9bb5-c428-49d1-acb6-72010a54213d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe" status: 200 len: 1315 microversion: 2.1 time: 0.550096 Sep 07 12:44:16.985226 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1519/3015] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:16 2022] GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe => generated 1315 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:16.996055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-c891c660-526b-45cc-a812-6447bb371aa1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Getting quotas for user 22ec4509710f446d843f6882120c5d6e and project af1de494abea4aa7841c00fb199e8aec. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:44:17.016084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-6be03c6f-92c5-40b9-830c-5e8d0071856e req-9535d873-362f-497b-afca-e571d2a920e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe", "name": "network-vif-plugged", "status": "completed", "tag": "36bd5563-22e8-432a-ab67-ee7f2814dd6d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:17.039127 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c891c660-526b-45cc-a812-6447bb371aa1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:44:17.045100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c891c660-526b-45cc-a812-6447bb371aa1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:44:17.050479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6be03c6f-92c5-40b9-830c-5e8d0071856e req-9535d873-362f-497b-afca-e571d2a920e1 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:17.051525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6be03c6f-92c5-40b9-830c-5e8d0071856e req-9535d873-362f-497b-afca-e571d2a920e1 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:17.052163 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6be03c6f-92c5-40b9-830c-5e8d0071856e req-9535d873-362f-497b-afca-e571d2a920e1 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:17.109145 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-6be03c6f-92c5-40b9-830c-5e8d0071856e req-9535d873-362f-497b-afca-e571d2a920e1 service nova] Creating event network-vif-plugged:36bd5563-22e8-432a-ab67-ee7f2814dd6d for instance 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe on n-h1-852087-9 Sep 07 12:44:17.120524 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-6be03c6f-92c5-40b9-830c-5e8d0071856e req-9535d873-362f-497b-afca-e571d2a920e1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115771 Sep 07 12:44:17.121993 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1520/3016] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:17.135046 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-312ab8f4-6830-4505-9de5-3824e7bac2a5 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '.version_select at 0x7fc41978d310>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:17.157921 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c891c660-526b-45cc-a812-6447bb371aa1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.845420 Sep 07 12:44:17.159570 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1497/3017] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:44:15 2022] POST /compute/v2.1/servers => generated 409 bytes in 1848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:44:17.176988 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ea04751c-f336-4d6b-b6c1-8c9c0585392c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:17.178038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ea04751c-f336-4d6b-b6c1-8c9c0585392c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] [instance: b017ea78-874a-4e91-933a-716e254275a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:17.190122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea04751c-f336-4d6b-b6c1-8c9c0585392c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:17.192053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea04751c-f336-4d6b-b6c1-8c9c0585392c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:17.193004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea04751c-f336-4d6b-b6c1-8c9c0585392c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:17.195885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea04751c-f336-4d6b-b6c1-8c9c0585392c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:17.200415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea04751c-f336-4d6b-b6c1-8c9c0585392c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:17.201151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea04751c-f336-4d6b-b6c1-8c9c0585392c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:17.233727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG neutronclient.v2_0.client [None req-312ab8f4-6830-4505-9de5-3824e7bac2a5 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 229ed710-e4a3-42c6-8d9d-0e5c9398a133 does not exist", "detail": ""}} {{(pid=122432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 12:44:17.234791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.security_group_api [None req-312ab8f4-6830-4505-9de5-3824e7bac2a5 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Neutron security group 229ed710-e4a3-42c6-8d9d-0e5c9398a133 not found {{(pid=122432) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 12:44:17.235745 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-312ab8f4-6830-4505-9de5-3824e7bac2a5 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] HTTP exception thrown: Security group 229ed710-e4a3-42c6-8d9d-0e5c9398a133 does not exist Sep 07 12:44:17.235745 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-68df606a-22e4-4627-96f6-f62e522f5400'] Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-312ab8f4-6830-4505-9de5-3824e7bac2a5 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Request method failure captured: Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/os-security-groups/229ed710-e4a3-42c6-8d9d-0e5c9398a133 HTTP/1.1 Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJGWMXgN7OdrmO70X8q48ZD-kObLPYOd01ANus8JY-PK7OjbvYCQ097-aKOdLEd3zX6imftUV9BBkR8dj8xCIWAm9yYmlnMVOTu04sxm_YJiyi8RzROPFAn0FZkGq3OAzdh-65OtDl9f1F4UEDEA_AaJuKK-hToemYtm-2HEdw2FTvo Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6c7fac0664f044168f52e7c1a982c48e Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: exception: Security group 229ed710-e4a3-42c6-8d9d-0e5c9398a133 does not exist Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-68df606a-22e4-4627-96f6-f62e522f5400'] Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '229ed710-e4a3-42c6-8d9d-0e5c9398a133'} Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 12:44:17.239822 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 229ed710-e4a3-42c6-8d9d-0e5c9398a133 does not exist Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68df606a-22e4-4627-96f6-f62e522f5400'] Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 229ed710-e4a3-42c6-8d9d-0e5c9398a133 does not exist Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68df606a-22e4-4627-96f6-f62e522f5400'] Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 229ed710-e4a3-42c6-8d9d-0e5c9398a133 does not exist Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68df606a-22e4-4627-96f6-f62e522f5400'] Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 229ed710-e4a3-42c6-8d9d-0e5c9398a133 does not exist Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68df606a-22e4-4627-96f6-f62e522f5400'] Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-312ab8f4-6830-4505-9de5-3824e7bac2a5 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Returning 404 to user: Security group 229ed710-e4a3-42c6-8d9d-0e5c9398a133 does not exist Sep 07 12:44:17.245389 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-68df606a-22e4-4627-96f6-f62e522f5400'] {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:17.258934 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-312ab8f4-6830-4505-9de5-3824e7bac2a5 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/229ed710-e4a3-42c6-8d9d-0e5c9398a133" status: 404 len: 194 microversion: 2.1 time: 0.130690 Sep 07 12:44:17.264511 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1521/3018] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:44:17 2022] DELETE /compute/v2.1/os-security-groups/229ed710-e4a3-42c6-8d9d-0e5c9398a133 => generated 194 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:17.283747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-39fc1712-7465-4d05-b45f-b62d806028c7 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:17.298323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-39fc1712-7465-4d05-b45f-b62d806028c7 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:17.330480 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39fc1712-7465-4d05-b45f-b62d806028c7 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:17.331385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39fc1712-7465-4d05-b45f-b62d806028c7 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:17.331847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39fc1712-7465-4d05-b45f-b62d806028c7 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:17.332685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39fc1712-7465-4d05-b45f-b62d806028c7 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:17.333158 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39fc1712-7465-4d05-b45f-b62d806028c7 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:17.333634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39fc1712-7465-4d05-b45f-b62d806028c7 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:18.207239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-39fc1712-7465-4d05-b45f-b62d806028c7 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:18.219573 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ea04751c-f336-4d6b-b6c1-8c9c0585392c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51065729f69f4bfb8ab48d2c70d0ed55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12bd04061ca4c3795958b51739bbbdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:18.229673 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ea04751c-f336-4d6b-b6c1-8c9c0585392c tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] 10.222.0.16 "GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6" status: 200 len: 1664 microversion: 2.1 time: 1.067855 Sep 07 12:44:18.242393 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1498/3019] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:17 2022] GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6 => generated 1664 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:18.245932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d651396b-183b-463c-aab3-73a24f44f747 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:18.247408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d651396b-183b-463c-aab3-73a24f44f747 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:18.261727 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-39fc1712-7465-4d05-b45f-b62d806028c7 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1323 microversion: 2.1 time: 0.984103 Sep 07 12:44:18.278183 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1522/3020] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:17 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1323 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:18.279175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d651396b-183b-463c-aab3-73a24f44f747 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:18.279175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d651396b-183b-463c-aab3-73a24f44f747 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:18.279175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d651396b-183b-463c-aab3-73a24f44f747 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:18.279175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d651396b-183b-463c-aab3-73a24f44f747 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:18.279175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d651396b-183b-463c-aab3-73a24f44f747 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:18.279175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d651396b-183b-463c-aab3-73a24f44f747 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:18.283115 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-37aeade9-9b7d-4b7d-9024-be7ad4c6dabc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:18.283978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-37aeade9-9b7d-4b7d-9024-be7ad4c6dabc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:18.286684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:44:18.581863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37aeade9-9b7d-4b7d-9024-be7ad4c6dabc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:18.595509 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-37aeade9-9b7d-4b7d-9024-be7ad4c6dabc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1238 microversion: 2.1 time: 0.330167 Sep 07 12:44:18.596166 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1523/3021] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:18 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1238 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:18.621072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3afc36b9-c8b4-4b45-9ca0-ecb1cb473def tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '.version_select at 0x7fc419662820>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:18.743644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG neutronclient.v2_0.client [None req-3afc36b9-c8b4-4b45-9ca0-ecb1cb473def tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a77d5d10-8cd3-4ec1-9443-087ec81ebdb9 does not exist", "detail": ""}} {{(pid=122432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 12:44:18.744575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.security_group_api [None req-3afc36b9-c8b4-4b45-9ca0-ecb1cb473def tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Neutron security group a77d5d10-8cd3-4ec1-9443-087ec81ebdb9 not found {{(pid=122432) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 12:44:18.745714 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-3afc36b9-c8b4-4b45-9ca0-ecb1cb473def tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] HTTP exception thrown: Security group a77d5d10-8cd3-4ec1-9443-087ec81ebdb9 does not exist Sep 07 12:44:18.745714 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-4fd62d86-0e8d-4a83-bbac-1fa61d52eca7'] Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3afc36b9-c8b4-4b45-9ca0-ecb1cb473def tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Request method failure captured: Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/os-security-groups/a77d5d10-8cd3-4ec1-9443-087ec81ebdb9 HTTP/1.1 Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJGWMXgN7OdrmO70X8q48ZD-kObLPYOd01ANus8JY-PK7OjbvYCQ097-aKOdLEd3zX6imftUV9BBkR8dj8xCIWAm9yYmlnMVOTu04sxm_YJiyi8RzROPFAn0FZkGq3OAzdh-65OtDl9f1F4UEDEA_AaJuKK-hToemYtm-2HEdw2FTvo Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6c7fac0664f044168f52e7c1a982c48e Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: exception: Security group a77d5d10-8cd3-4ec1-9443-087ec81ebdb9 does not exist Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-4fd62d86-0e8d-4a83-bbac-1fa61d52eca7'] Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'a77d5d10-8cd3-4ec1-9443-087ec81ebdb9'} Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 12:44:18.750273 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a77d5d10-8cd3-4ec1-9443-087ec81ebdb9 does not exist Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4fd62d86-0e8d-4a83-bbac-1fa61d52eca7'] Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a77d5d10-8cd3-4ec1-9443-087ec81ebdb9 does not exist Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4fd62d86-0e8d-4a83-bbac-1fa61d52eca7'] Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a77d5d10-8cd3-4ec1-9443-087ec81ebdb9 does not exist Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4fd62d86-0e8d-4a83-bbac-1fa61d52eca7'] Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a77d5d10-8cd3-4ec1-9443-087ec81ebdb9 does not exist Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4fd62d86-0e8d-4a83-bbac-1fa61d52eca7'] Sep 07 12:44:18.759020 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:18.769286 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3afc36b9-c8b4-4b45-9ca0-ecb1cb473def tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Returning 404 to user: Security group a77d5d10-8cd3-4ec1-9443-087ec81ebdb9 does not exist Sep 07 12:44:18.769286 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-4fd62d86-0e8d-4a83-bbac-1fa61d52eca7'] {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:18.769286 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3afc36b9-c8b4-4b45-9ca0-ecb1cb473def tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/a77d5d10-8cd3-4ec1-9443-087ec81ebdb9" status: 404 len: 194 microversion: 2.1 time: 0.152861 Sep 07 12:44:18.769286 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1524/3022] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:44:18 2022] DELETE /compute/v2.1/os-security-groups/a77d5d10-8cd3-4ec1-9443-087ec81ebdb9 => generated 194 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:18.782406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bbff7600-6faf-4f81-a519-aae1483a849c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:18.784094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bbff7600-6faf-4f81-a519-aae1483a849c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:18.796098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbff7600-6faf-4f81-a519-aae1483a849c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:18.797765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbff7600-6faf-4f81-a519-aae1483a849c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:18.798548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbff7600-6faf-4f81-a519-aae1483a849c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:18.799927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbff7600-6faf-4f81-a519-aae1483a849c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:18.800876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbff7600-6faf-4f81-a519-aae1483a849c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:18.802384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbff7600-6faf-4f81-a519-aae1483a849c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:18.841350 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d651396b-183b-463c-aab3-73a24f44f747 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:18.850942 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d651396b-183b-463c-aab3-73a24f44f747 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 200 len: 1522 microversion: 2.1 time: 0.614668 Sep 07 12:44:18.861594 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1499/3023] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:18 2022] GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 1522 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:18.867617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-f8b3bd49-e96b-4e27-8657-0c9277a37541 req-000d27cd-6579-4d52-ae23-b03313b4c504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca", "name": "network-vif-deleted", "tag": "1a21d3dc-ddf4-4a1a-97b1-157da447d776"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:18.870993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbff7600-6faf-4f81-a519-aae1483a849c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:18.872039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbff7600-6faf-4f81-a519-aae1483a849c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:18.872630 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbff7600-6faf-4f81-a519-aae1483a849c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:18.873251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-bbff7600-6faf-4f81-a519-aae1483a849c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lazy-loading 'fault' on Instance uuid 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:44:18.893271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f8b3bd49-e96b-4e27-8657-0c9277a37541 req-000d27cd-6579-4d52-ae23-b03313b4c504 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:18.894256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f8b3bd49-e96b-4e27-8657-0c9277a37541 req-000d27cd-6579-4d52-ae23-b03313b4c504 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:18.895160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f8b3bd49-e96b-4e27-8657-0c9277a37541 req-000d27cd-6579-4d52-ae23-b03313b4c504 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:18.921883 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-f8b3bd49-e96b-4e27-8657-0c9277a37541 req-000d27cd-6579-4d52-ae23-b03313b4c504 service nova] Creating event network-vif-deleted:1a21d3dc-ddf4-4a1a-97b1-157da447d776 for instance 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca on n-h2-852087-9 Sep 07 12:44:18.928808 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-f8b3bd49-e96b-4e27-8657-0c9277a37541 req-000d27cd-6579-4d52-ae23-b03313b4c504 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065016 Sep 07 12:44:18.929864 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1500/3024] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:18.935932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1b17c01d-4adb-43a6-9e05-de0e19ad363a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:18.936772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1b17c01d-4adb-43a6-9e05-de0e19ad363a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:18.943925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b17c01d-4adb-43a6-9e05-de0e19ad363a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:18.944389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b17c01d-4adb-43a6-9e05-de0e19ad363a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:18.945057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b17c01d-4adb-43a6-9e05-de0e19ad363a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:18.946043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b17c01d-4adb-43a6-9e05-de0e19ad363a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:18.946618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b17c01d-4adb-43a6-9e05-de0e19ad363a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:18.947131 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b17c01d-4adb-43a6-9e05-de0e19ad363a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:19.020724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bbff7600-6faf-4f81-a519-aae1483a849c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:19.047966 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bbff7600-6faf-4f81-a519-aae1483a849c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca" status: 200 len: 1307 microversion: 2.1 time: 0.272390 Sep 07 12:44:19.048888 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1525/3025] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:18 2022] GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca => generated 1307 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:19.193046 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fc10b4bb-7744-44bd-8ec8-089e304cd743 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1800657637", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:19.308067 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-fc10b4bb-7744-44bd-8ec8-089e304cd743 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] validate_networks() for [('601ef32c-950a-4c7a-8340-8d5aac86e6c9', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:44:19.545173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1b17c01d-4adb-43a6-9e05-de0e19ad363a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:19.556730 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1b17c01d-4adb-43a6-9e05-de0e19ad363a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe" status: 200 len: 1315 microversion: 2.1 time: 0.625255 Sep 07 12:44:19.558150 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1501/3026] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:18 2022] GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe => generated 1315 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:19.563791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5345fb6f-e6bb-47a6-83bd-112ee6869919 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:19.564819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5345fb6f-e6bb-47a6-83bd-112ee6869919 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:19.573373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5345fb6f-e6bb-47a6-83bd-112ee6869919 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:19.574235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5345fb6f-e6bb-47a6-83bd-112ee6869919 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:19.575038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5345fb6f-e6bb-47a6-83bd-112ee6869919 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:19.577536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5345fb6f-e6bb-47a6-83bd-112ee6869919 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:19.578602 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5345fb6f-e6bb-47a6-83bd-112ee6869919 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:19.579273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5345fb6f-e6bb-47a6-83bd-112ee6869919 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:19.631399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5345fb6f-e6bb-47a6-83bd-112ee6869919 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:44:19.928382 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5345fb6f-e6bb-47a6-83bd-112ee6869919 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45" status: 204 len: 0 microversion: 2.1 time: 0.368038 Sep 07 12:44:19.929636 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1502/3027] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:44:19 2022] DELETE /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:44:19.944988 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-da40b0bf-4691-479d-a3e0-4b38f446cd44 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:19.946042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-da40b0bf-4691-479d-a3e0-4b38f446cd44 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:19.957333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da40b0bf-4691-479d-a3e0-4b38f446cd44 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:19.959209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da40b0bf-4691-479d-a3e0-4b38f446cd44 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:19.960034 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da40b0bf-4691-479d-a3e0-4b38f446cd44 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:19.961714 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da40b0bf-4691-479d-a3e0-4b38f446cd44 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:19.962234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da40b0bf-4691-479d-a3e0-4b38f446cd44 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:19.962827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da40b0bf-4691-479d-a3e0-4b38f446cd44 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:20.001185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-da40b0bf-4691-479d-a3e0-4b38f446cd44 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:44:20.125620 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-da40b0bf-4691-479d-a3e0-4b38f446cd44 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "DELETE /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 204 len: 0 microversion: 2.1 time: 0.187306 Sep 07 12:44:20.126989 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1503/3028] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:44:19 2022] DELETE /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:44:20.134848 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6bf31256-9060-4871-a333-0a1b2e9fd58f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:20.135976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6bf31256-9060-4871-a333-0a1b2e9fd58f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] [instance: b017ea78-874a-4e91-933a-716e254275a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:20.144871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bf31256-9060-4871-a333-0a1b2e9fd58f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:20.145864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bf31256-9060-4871-a333-0a1b2e9fd58f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:20.146739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bf31256-9060-4871-a333-0a1b2e9fd58f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:20.147618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bf31256-9060-4871-a333-0a1b2e9fd58f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:20.148197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bf31256-9060-4871-a333-0a1b2e9fd58f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:20.148711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bf31256-9060-4871-a333-0a1b2e9fd58f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:20.342829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6bf31256-9060-4871-a333-0a1b2e9fd58f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51065729f69f4bfb8ab48d2c70d0ed55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12bd04061ca4c3795958b51739bbbdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:20.357051 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6bf31256-9060-4871-a333-0a1b2e9fd58f tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] 10.222.0.16 "GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6" status: 200 len: 1597 microversion: 2.1 time: 0.227915 Sep 07 12:44:20.381633 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1504/3029] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:20 2022] GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6 => generated 1597 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:20.393021 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c89125a1-ea3e-4581-8862-1467c21f5234 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:20.393735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c89125a1-ea3e-4581-8862-1467c21f5234 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:20.408103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c89125a1-ea3e-4581-8862-1467c21f5234 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:20.409950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c89125a1-ea3e-4581-8862-1467c21f5234 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:20.411111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c89125a1-ea3e-4581-8862-1467c21f5234 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:20.412651 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c89125a1-ea3e-4581-8862-1467c21f5234 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:20.414010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c89125a1-ea3e-4581-8862-1467c21f5234 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:20.415100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c89125a1-ea3e-4581-8862-1467c21f5234 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:21.098074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fc10b4bb-7744-44bd-8ec8-089e304cd743 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:44:21.098964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fc10b4bb-7744-44bd-8ec8-089e304cd743 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:44:21.101003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fc10b4bb-7744-44bd-8ec8-089e304cd743 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:44:21.101603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fc10b4bb-7744-44bd-8ec8-089e304cd743 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:44:21.102139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fc10b4bb-7744-44bd-8ec8-089e304cd743 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:44:21.118211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc10b4bb-7744-44bd-8ec8-089e304cd743 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:21.119039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc10b4bb-7744-44bd-8ec8-089e304cd743 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:21.119627 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc10b4bb-7744-44bd-8ec8-089e304cd743 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:21.121154 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc10b4bb-7744-44bd-8ec8-089e304cd743 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:21.121900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc10b4bb-7744-44bd-8ec8-089e304cd743 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:21.122570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc10b4bb-7744-44bd-8ec8-089e304cd743 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:21.132733 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c89125a1-ea3e-4581-8862-1467c21f5234 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:21.155072 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c89125a1-ea3e-4581-8862-1467c21f5234 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1517 microversion: 2.1 time: 0.770594 Sep 07 12:44:21.169782 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1505/3030] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:20 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1517 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:21.180859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-fc10b4bb-7744-44bd-8ec8-089e304cd743 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Getting quotas for project bc8452d8eab643549a30030eda3f40ba. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:44:21.192812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-fc10b4bb-7744-44bd-8ec8-089e304cd743 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Getting quotas for user 1824fe66513042c98d1157166f227bc7 and project bc8452d8eab643549a30030eda3f40ba. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:44:21.193685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0ef0d83d-87e8-423a-9fce-db1992122cee req-c03d7cce-cc79-4c4d-8330-414c44f111ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "023e989d-cb87-4aea-a0c8-7123ad57c4f2", "name": "network-vif-plugged", "status": "completed", "tag": "9e2c8268-a833-4fcd-9631-f8c82408ea70"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:21.212135 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0ef0d83d-87e8-423a-9fce-db1992122cee req-c03d7cce-cc79-4c4d-8330-414c44f111ee service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:21.213195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0ef0d83d-87e8-423a-9fce-db1992122cee req-c03d7cce-cc79-4c4d-8330-414c44f111ee service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:21.214491 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0ef0d83d-87e8-423a-9fce-db1992122cee req-c03d7cce-cc79-4c4d-8330-414c44f111ee service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:21.249174 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0ef0d83d-87e8-423a-9fce-db1992122cee req-c03d7cce-cc79-4c4d-8330-414c44f111ee service nova] Creating event network-vif-plugged:9e2c8268-a833-4fcd-9631-f8c82408ea70 for instance 023e989d-cb87-4aea-a0c8-7123ad57c4f2 on n-h2-852087-9 Sep 07 12:44:21.255645 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0ef0d83d-87e8-423a-9fce-db1992122cee req-c03d7cce-cc79-4c4d-8330-414c44f111ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088279 Sep 07 12:44:21.256936 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1506/3031] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:21.259999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fc10b4bb-7744-44bd-8ec8-089e304cd743 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:44:21.265763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fc10b4bb-7744-44bd-8ec8-089e304cd743 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:44:21.267915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-87d1806c-e95e-46bf-a072-cc81910f446f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:21.268838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-87d1806c-e95e-46bf-a072-cc81910f446f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:21.278428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87d1806c-e95e-46bf-a072-cc81910f446f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:21.279127 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87d1806c-e95e-46bf-a072-cc81910f446f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:21.279782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87d1806c-e95e-46bf-a072-cc81910f446f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:21.280686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87d1806c-e95e-46bf-a072-cc81910f446f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:21.281272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87d1806c-e95e-46bf-a072-cc81910f446f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:21.281852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87d1806c-e95e-46bf-a072-cc81910f446f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:21.498893 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fc10b4bb-7744-44bd-8ec8-089e304cd743 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.447434 Sep 07 12:44:21.499769 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1526/3032] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:44:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 2450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:44:21.505117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9089becc-36bf-41f5-b6ee-d83e6f4c4909 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:21.509614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9089becc-36bf-41f5-b6ee-d83e6f4c4909 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:21.526257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9089becc-36bf-41f5-b6ee-d83e6f4c4909 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:21.529912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9089becc-36bf-41f5-b6ee-d83e6f4c4909 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:21.532147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9089becc-36bf-41f5-b6ee-d83e6f4c4909 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:21.542655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9089becc-36bf-41f5-b6ee-d83e6f4c4909 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:21.543295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9089becc-36bf-41f5-b6ee-d83e6f4c4909 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:21.543567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9089becc-36bf-41f5-b6ee-d83e6f4c4909 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:21.600382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-87d1806c-e95e-46bf-a072-cc81910f446f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:21.663391 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-87d1806c-e95e-46bf-a072-cc81910f446f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1296 microversion: 2.1 time: 0.387346 Sep 07 12:44:21.664591 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1507/3033] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:21 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1296 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:21.698455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7add0599-2ad1-4ec9-b360-1367af952792 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:21.701995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7add0599-2ad1-4ec9-b360-1367af952792 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:21.719149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7add0599-2ad1-4ec9-b360-1367af952792 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:21.720070 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7add0599-2ad1-4ec9-b360-1367af952792 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:21.720897 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7add0599-2ad1-4ec9-b360-1367af952792 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:21.722658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7add0599-2ad1-4ec9-b360-1367af952792 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:21.736321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7add0599-2ad1-4ec9-b360-1367af952792 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:21.737292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7add0599-2ad1-4ec9-b360-1367af952792 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:21.783927 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-7add0599-2ad1-4ec9-b360-1367af952792 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] HTTP exception thrown: Instance 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca could not be found. Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7add0599-2ad1-4ec9-b360-1367af952792 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Request method failure captured: Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca HTTP/1.1 Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJEP0irHIBLN8hFWvgLoOKa85E_5AoxCeRoHxKkTt9HdaFmlIYGchkE6q65oBFLP3DgAcUWlzLQgHRTeUGfdJav2RIkb2FS4kv4XxxXu-KkXROe-iYh2upLJXJIuF28hkxxUYg0rmbMG5d0HtmW6B3uJIdcPQo2gv8Pl4EjF30y2Jzg Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: e15fa55f4d4f4b4db6dbb26c0f07c3c4 Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersOnMultiNodesTest-1611524513 Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersOnMultiNodesTest-1611524513 Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: e15fa55f4d4f4b4db6dbb26c0f07c3c4 Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1611524513 Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersOnMultiNodesTest-1611524513-project Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: ed6e5d4d54224bca90954d1ebbd7b7a3 Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersOnMultiNodesTest-1611524513-project Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca could not be found. Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca'} Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca could not be found. Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca could not be found. Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:21.786802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:21.791385 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:21.791385 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:21.791385 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:21.791385 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:21.791385 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:21.791385 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca could not be found. Sep 07 12:44:21.791385 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:21.793356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7add0599-2ad1-4ec9-b360-1367af952792 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Returning 404 to user: Instance 3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:21.794741 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7add0599-2ad1-4ec9-b360-1367af952792 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca" status: 404 len: 111 microversion: 2.1 time: 0.125722 Sep 07 12:44:21.799580 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1508/3034] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:21 2022] GET /compute/v2.1/servers/3eeb4dce-da0c-4cf5-9bc7-d1c8073b49ca => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:21.809024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3b7f3666-998a-4cc0-aa79-c9df4b3621d1 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:21.815353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3b7f3666-998a-4cc0-aa79-c9df4b3621d1 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:21.824618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b7f3666-998a-4cc0-aa79-c9df4b3621d1 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:21.825128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b7f3666-998a-4cc0-aa79-c9df4b3621d1 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:21.825624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b7f3666-998a-4cc0-aa79-c9df4b3621d1 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:21.826335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b7f3666-998a-4cc0-aa79-c9df4b3621d1 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:21.827078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b7f3666-998a-4cc0-aa79-c9df4b3621d1 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:21.827301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b7f3666-998a-4cc0-aa79-c9df4b3621d1 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:21.922384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:44:22.615798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3b7f3666-998a-4cc0-aa79-c9df4b3621d1 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:22.628533 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3b7f3666-998a-4cc0-aa79-c9df4b3621d1 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 200 len: 1528 microversion: 2.1 time: 0.826922 Sep 07 12:44:22.646747 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1509/3035] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:21 2022] GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 1528 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:22.665474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9089becc-36bf-41f5-b6ee-d83e6f4c4909 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:22.667038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-60afbe03-bb2c-4549-bd7a-19e050103efe tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:22.668137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-60afbe03-bb2c-4549-bd7a-19e050103efe tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:22.678906 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60afbe03-bb2c-4549-bd7a-19e050103efe tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:22.680174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60afbe03-bb2c-4549-bd7a-19e050103efe tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:22.680923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60afbe03-bb2c-4549-bd7a-19e050103efe tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:22.682435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60afbe03-bb2c-4549-bd7a-19e050103efe tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:22.683467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60afbe03-bb2c-4549-bd7a-19e050103efe tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:22.684431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60afbe03-bb2c-4549-bd7a-19e050103efe tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:22.723091 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9089becc-36bf-41f5-b6ee-d83e6f4c4909 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45" status: 200 len: 1646 microversion: 2.1 time: 1.221563 Sep 07 12:44:22.734513 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1527/3036] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:21 2022] GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 => generated 1646 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:22.748963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-98653407-ca2b-4afe-9310-a1064da453c0 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:22.753356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-98653407-ca2b-4afe-9310-a1064da453c0 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:22.769989 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98653407-ca2b-4afe-9310-a1064da453c0 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:22.773669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98653407-ca2b-4afe-9310-a1064da453c0 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:22.774741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98653407-ca2b-4afe-9310-a1064da453c0 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:22.776290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98653407-ca2b-4afe-9310-a1064da453c0 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:22.777363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98653407-ca2b-4afe-9310-a1064da453c0 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:22.778451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98653407-ca2b-4afe-9310-a1064da453c0 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:22.864442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-98653407-ca2b-4afe-9310-a1064da453c0 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lazy-loading 'flavor' on Instance uuid ca300ad8-1300-4adf-940f-8cc52f13d8dc {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:44:22.961470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-60afbe03-bb2c-4549-bd7a-19e050103efe tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:22.990446 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-98653407-ca2b-4afe-9310-a1064da453c0 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "POST /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc/action" status: 200 len: 32 microversion: 2.1 time: 0.254426 Sep 07 12:44:22.991068 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1528/3037] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:44:22 2022] POST /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc/action => generated 32 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:44:22.994242 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-60afbe03-bb2c-4549-bd7a-19e050103efe tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe" status: 200 len: 1502 microversion: 2.1 time: 0.345540 Sep 07 12:44:22.996887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-27a817a6-faae-4b35-b645-5138d1f69576 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:22.997655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-27a817a6-faae-4b35-b645-5138d1f69576 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] [instance: b017ea78-874a-4e91-933a-716e254275a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:23.011854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27a817a6-faae-4b35-b645-5138d1f69576 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:23.012994 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27a817a6-faae-4b35-b645-5138d1f69576 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:23.013456 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27a817a6-faae-4b35-b645-5138d1f69576 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:23.013886 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1510/3038] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:22 2022] GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe => generated 1502 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:23.014308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27a817a6-faae-4b35-b645-5138d1f69576 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:23.014782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27a817a6-faae-4b35-b645-5138d1f69576 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:23.015398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27a817a6-faae-4b35-b645-5138d1f69576 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:23.034494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-20983bdb-5b57-49c6-8cd7-776ecba10ffa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:23.044527 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-20983bdb-5b57-49c6-8cd7-776ecba10ffa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:23.067046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20983bdb-5b57-49c6-8cd7-776ecba10ffa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:23.067791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20983bdb-5b57-49c6-8cd7-776ecba10ffa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:23.068598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20983bdb-5b57-49c6-8cd7-776ecba10ffa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:23.069872 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20983bdb-5b57-49c6-8cd7-776ecba10ffa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:23.073854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20983bdb-5b57-49c6-8cd7-776ecba10ffa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:23.075002 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20983bdb-5b57-49c6-8cd7-776ecba10ffa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:23.257328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-27a817a6-faae-4b35-b645-5138d1f69576 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51065729f69f4bfb8ab48d2c70d0ed55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12bd04061ca4c3795958b51739bbbdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:23.260345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-20983bdb-5b57-49c6-8cd7-776ecba10ffa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:23.273599 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-27a817a6-faae-4b35-b645-5138d1f69576 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] 10.222.0.16 "GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6" status: 200 len: 1310 microversion: 2.1 time: 0.280604 Sep 07 12:44:23.284797 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-20983bdb-5b57-49c6-8cd7-776ecba10ffa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1210 microversion: 2.1 time: 0.255429 Sep 07 12:44:23.287137 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1511/3039] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:23 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1210 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:23.292200 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1529/3040] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:22 2022] GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6 => generated 1310 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:23.307844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4b3a71b8-d706-42ac-bea5-379fbf64b022 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:23.311906 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4b3a71b8-d706-42ac-bea5-379fbf64b022 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 8d248e06-d37c-4895-85a8-e8c5e412aedb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:23.329033 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-66df768b-fe83-49f1-8ddc-f4c538a1e5cb req-811ae9f5-d41d-4ddc-8ffd-41a573271836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b017ea78-874a-4e91-933a-716e254275a6", "name": "network-vif-deleted", "tag": "914cfc7f-b102-4403-ba5d-484c546bac81"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:23.329940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b3a71b8-d706-42ac-bea5-379fbf64b022 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:23.330680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b3a71b8-d706-42ac-bea5-379fbf64b022 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:23.331432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b3a71b8-d706-42ac-bea5-379fbf64b022 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:23.332948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b3a71b8-d706-42ac-bea5-379fbf64b022 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:23.333697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b3a71b8-d706-42ac-bea5-379fbf64b022 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:23.334522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b3a71b8-d706-42ac-bea5-379fbf64b022 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:23.348572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-66df768b-fe83-49f1-8ddc-f4c538a1e5cb req-811ae9f5-d41d-4ddc-8ffd-41a573271836 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:23.349236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-66df768b-fe83-49f1-8ddc-f4c538a1e5cb req-811ae9f5-d41d-4ddc-8ffd-41a573271836 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:23.349688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-66df768b-fe83-49f1-8ddc-f4c538a1e5cb req-811ae9f5-d41d-4ddc-8ffd-41a573271836 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:23.363130 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-66df768b-fe83-49f1-8ddc-f4c538a1e5cb req-811ae9f5-d41d-4ddc-8ffd-41a573271836 service nova] Creating event network-vif-deleted:914cfc7f-b102-4403-ba5d-484c546bac81 for instance b017ea78-874a-4e91-933a-716e254275a6 on n-h2-852087-9 Sep 07 12:44:23.370548 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-66df768b-fe83-49f1-8ddc-f4c538a1e5cb req-811ae9f5-d41d-4ddc-8ffd-41a573271836 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059414 Sep 07 12:44:23.371901 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1530/3041] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:23.396492 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b0a4f5ee-8248-41f4-adf4-5af6c1afb339 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:23.400088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b0a4f5ee-8248-41f4-adf4-5af6c1afb339 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:23.427267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0a4f5ee-8248-41f4-adf4-5af6c1afb339 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:23.432514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0a4f5ee-8248-41f4-adf4-5af6c1afb339 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:23.434415 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0a4f5ee-8248-41f4-adf4-5af6c1afb339 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:23.437410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0a4f5ee-8248-41f4-adf4-5af6c1afb339 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:23.438419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0a4f5ee-8248-41f4-adf4-5af6c1afb339 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:23.441155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0a4f5ee-8248-41f4-adf4-5af6c1afb339 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:23.451855 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4b3a71b8-d706-42ac-bea5-379fbf64b022 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 8d248e06-d37c-4895-85a8-e8c5e412aedb] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:44:23.706302 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4b3a71b8-d706-42ac-bea5-379fbf64b022 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8d248e06-d37c-4895-85a8-e8c5e412aedb" status: 204 len: 0 microversion: 2.1 time: 0.414377 Sep 07 12:44:23.721665 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1512/3042] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:44:23 2022] DELETE /compute/v2.1/servers/8d248e06-d37c-4895-85a8-e8c5e412aedb => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:44:23.729331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ddd993d2-3301-417e-a011-079245a7f4f8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:23.730578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ddd993d2-3301-417e-a011-079245a7f4f8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:23.738824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddd993d2-3301-417e-a011-079245a7f4f8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:23.739630 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddd993d2-3301-417e-a011-079245a7f4f8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:23.740264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddd993d2-3301-417e-a011-079245a7f4f8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:23.741008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddd993d2-3301-417e-a011-079245a7f4f8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:23.741532 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddd993d2-3301-417e-a011-079245a7f4f8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:23.742271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ddd993d2-3301-417e-a011-079245a7f4f8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:23.804398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b0a4f5ee-8248-41f4-adf4-5af6c1afb339 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:23.821170 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b0a4f5ee-8248-41f4-adf4-5af6c1afb339 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1364 microversion: 2.1 time: 0.435138 Sep 07 12:44:23.822308 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1531/3043] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:23 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1364 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:23.834642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dfc70f3c-7194-4e44-b3e5-0c6db4f17e65 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:23.836711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dfc70f3c-7194-4e44-b3e5-0c6db4f17e65 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:23.863564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfc70f3c-7194-4e44-b3e5-0c6db4f17e65 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:23.864974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfc70f3c-7194-4e44-b3e5-0c6db4f17e65 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:23.866147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfc70f3c-7194-4e44-b3e5-0c6db4f17e65 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:23.868411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfc70f3c-7194-4e44-b3e5-0c6db4f17e65 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:23.869904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfc70f3c-7194-4e44-b3e5-0c6db4f17e65 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:23.870912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfc70f3c-7194-4e44-b3e5-0c6db4f17e65 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:23.918088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:44:23.932034 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-dfc70f3c-7194-4e44-b3e5-0c6db4f17e65 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lazy-loading 'flavor' on Instance uuid 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:44:24.101712 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dfc70f3c-7194-4e44-b3e5-0c6db4f17e65 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "POST /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe/action" status: 202 len: 0 microversion: 2.1 time: 0.277388 Sep 07 12:44:24.109599 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1532/3044] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:44:23 2022] POST /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:44:24.112622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ddd993d2-3301-417e-a011-079245a7f4f8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:24.125709 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ddd993d2-3301-417e-a011-079245a7f4f8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1523 microversion: 2.1 time: 0.402278 Sep 07 12:44:24.126328 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1513/3045] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:23 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1523 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:24.135911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e21a377f-fedc-4c49-a777-76166c7500a7 req-30c92c69-cc54-40d3-bca3-1fd68dca9c0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "023e989d-cb87-4aea-a0c8-7123ad57c4f2", "name": "network-vif-unplugged", "status": "completed", "tag": "9e2c8268-a833-4fcd-9631-f8c82408ea70"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:24.156077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d20d2171-6204-491c-98a2-3cba7ddb80c5 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:24.156765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d20d2171-6204-491c-98a2-3cba7ddb80c5 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:24.177857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d20d2171-6204-491c-98a2-3cba7ddb80c5 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:24.178386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d20d2171-6204-491c-98a2-3cba7ddb80c5 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:24.178841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d20d2171-6204-491c-98a2-3cba7ddb80c5 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:24.179574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d20d2171-6204-491c-98a2-3cba7ddb80c5 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:24.180044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d20d2171-6204-491c-98a2-3cba7ddb80c5 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:24.180483 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d20d2171-6204-491c-98a2-3cba7ddb80c5 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:24.181424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e21a377f-fedc-4c49-a777-76166c7500a7 req-30c92c69-cc54-40d3-bca3-1fd68dca9c0d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:24.185800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e21a377f-fedc-4c49-a777-76166c7500a7 req-30c92c69-cc54-40d3-bca3-1fd68dca9c0d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:24.186887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e21a377f-fedc-4c49-a777-76166c7500a7 req-30c92c69-cc54-40d3-bca3-1fd68dca9c0d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:24.236243 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e21a377f-fedc-4c49-a777-76166c7500a7 req-30c92c69-cc54-40d3-bca3-1fd68dca9c0d service nova] Creating event network-vif-unplugged:9e2c8268-a833-4fcd-9631-f8c82408ea70 for instance 023e989d-cb87-4aea-a0c8-7123ad57c4f2 on n-h2-852087-9 Sep 07 12:44:24.246415 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e21a377f-fedc-4c49-a777-76166c7500a7 req-30c92c69-cc54-40d3-bca3-1fd68dca9c0d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.133468 Sep 07 12:44:24.249995 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1533/3046] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:24.263088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3ad7aeac-9b4a-4234-8949-4ad9806aeee2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:24.264554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3ad7aeac-9b4a-4234-8949-4ad9806aeee2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 6762b361-a49e-467e-ba9b-cebfb35d9a58] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:24.278438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ad7aeac-9b4a-4234-8949-4ad9806aeee2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:24.279749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ad7aeac-9b4a-4234-8949-4ad9806aeee2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:24.280837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ad7aeac-9b4a-4234-8949-4ad9806aeee2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:24.283686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ad7aeac-9b4a-4234-8949-4ad9806aeee2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:24.285046 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ad7aeac-9b4a-4234-8949-4ad9806aeee2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:24.294551 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ad7aeac-9b4a-4234-8949-4ad9806aeee2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:24.396752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3ad7aeac-9b4a-4234-8949-4ad9806aeee2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 6762b361-a49e-467e-ba9b-cebfb35d9a58] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:44:24.528427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d20d2171-6204-491c-98a2-3cba7ddb80c5 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:24.538680 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d20d2171-6204-491c-98a2-3cba7ddb80c5 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 200 len: 1528 microversion: 2.1 time: 0.395921 Sep 07 12:44:24.542510 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1514/3047] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:24 2022] GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 1528 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:24.547968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9585447c-4b43-48c5-8a35-17da775de2f7 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:24.549132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9585447c-4b43-48c5-8a35-17da775de2f7 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:24.559720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9585447c-4b43-48c5-8a35-17da775de2f7 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:24.560432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9585447c-4b43-48c5-8a35-17da775de2f7 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:24.561244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9585447c-4b43-48c5-8a35-17da775de2f7 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:24.562235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9585447c-4b43-48c5-8a35-17da775de2f7 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:24.562942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9585447c-4b43-48c5-8a35-17da775de2f7 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:24.563756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9585447c-4b43-48c5-8a35-17da775de2f7 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:24.664961 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3ad7aeac-9b4a-4234-8949-4ad9806aeee2 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6762b361-a49e-467e-ba9b-cebfb35d9a58" status: 204 len: 0 microversion: 2.1 time: 0.411838 Sep 07 12:44:24.666896 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1534/3048] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:44:24 2022] DELETE /compute/v2.1/servers/6762b361-a49e-467e-ba9b-cebfb35d9a58 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:44:24.677438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-da023e2a-b7e1-48ba-aad7-ddc8418fd584 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:24.679337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-da023e2a-b7e1-48ba-aad7-ddc8418fd584 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:24.691003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da023e2a-b7e1-48ba-aad7-ddc8418fd584 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:24.692361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da023e2a-b7e1-48ba-aad7-ddc8418fd584 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:24.695741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da023e2a-b7e1-48ba-aad7-ddc8418fd584 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:24.698094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da023e2a-b7e1-48ba-aad7-ddc8418fd584 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:24.699629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da023e2a-b7e1-48ba-aad7-ddc8418fd584 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:24.700942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da023e2a-b7e1-48ba-aad7-ddc8418fd584 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:25.021156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9585447c-4b43-48c5-8a35-17da775de2f7 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:25.033676 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9585447c-4b43-48c5-8a35-17da775de2f7 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45" status: 200 len: 1646 microversion: 2.1 time: 0.489324 Sep 07 12:44:25.035760 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1515/3049] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:24 2022] GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 => generated 1646 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:25.045804 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-da023e2a-b7e1-48ba-aad7-ddc8418fd584 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:25.061545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bf8129b9-07b7-42f5-b2d1-551eadceb717 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:25.063206 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bf8129b9-07b7-42f5-b2d1-551eadceb717 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:25.070167 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-da023e2a-b7e1-48ba-aad7-ddc8418fd584 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe" status: 200 len: 1510 microversion: 2.1 time: 0.400877 Sep 07 12:44:25.071087 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1535/3050] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:24 2022] GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe => generated 1510 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:25.076698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4b30a79a-23fc-41a3-924d-047bae64127e tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:25.077647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4b30a79a-23fc-41a3-924d-047bae64127e tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] [instance: b017ea78-874a-4e91-933a-716e254275a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:25.094642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf8129b9-07b7-42f5-b2d1-551eadceb717 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:25.095592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf8129b9-07b7-42f5-b2d1-551eadceb717 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:25.095788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b30a79a-23fc-41a3-924d-047bae64127e tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:25.096350 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf8129b9-07b7-42f5-b2d1-551eadceb717 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:25.097096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b30a79a-23fc-41a3-924d-047bae64127e tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:25.097687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf8129b9-07b7-42f5-b2d1-551eadceb717 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:25.097850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b30a79a-23fc-41a3-924d-047bae64127e tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:25.098476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf8129b9-07b7-42f5-b2d1-551eadceb717 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:25.099211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf8129b9-07b7-42f5-b2d1-551eadceb717 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:25.100056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b30a79a-23fc-41a3-924d-047bae64127e tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:25.101767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b30a79a-23fc-41a3-924d-047bae64127e tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:25.102799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b30a79a-23fc-41a3-924d-047bae64127e tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:25.173064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b30a79a-23fc-41a3-924d-047bae64127e tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:25.173759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b30a79a-23fc-41a3-924d-047bae64127e tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:25.174335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b30a79a-23fc-41a3-924d-047bae64127e tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:25.175084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-4b30a79a-23fc-41a3-924d-047bae64127e tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lazy-loading 'fault' on Instance uuid b017ea78-874a-4e91-933a-716e254275a6 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:44:25.258072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4b30a79a-23fc-41a3-924d-047bae64127e tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51065729f69f4bfb8ab48d2c70d0ed55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12bd04061ca4c3795958b51739bbbdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:25.276257 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4b30a79a-23fc-41a3-924d-047bae64127e tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] 10.222.0.16 "GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6" status: 200 len: 1315 microversion: 2.1 time: 0.203817 Sep 07 12:44:25.276870 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1536/3051] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:25 2022] GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:25.294410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-255b380c-99af-43cb-84a2-3da58d0c7252 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:25.295051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-255b380c-99af-43cb-84a2-3da58d0c7252 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 8d248e06-d37c-4895-85a8-e8c5e412aedb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:25.302168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-255b380c-99af-43cb-84a2-3da58d0c7252 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:25.302942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-255b380c-99af-43cb-84a2-3da58d0c7252 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:25.303577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-255b380c-99af-43cb-84a2-3da58d0c7252 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:25.304903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-255b380c-99af-43cb-84a2-3da58d0c7252 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:25.305600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-255b380c-99af-43cb-84a2-3da58d0c7252 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:25.306354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-255b380c-99af-43cb-84a2-3da58d0c7252 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:25.452319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bf8129b9-07b7-42f5-b2d1-551eadceb717 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:25.468893 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bf8129b9-07b7-42f5-b2d1-551eadceb717 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1314 microversion: 2.1 time: 0.430245 Sep 07 12:44:25.478429 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1516/3052] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:25 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:25.484302 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6bbf13ef-2942-4388-af9f-22f3a97929ed tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:25.485261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6bbf13ef-2942-4388-af9f-22f3a97929ed tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:25.493629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bbf13ef-2942-4388-af9f-22f3a97929ed tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:25.494317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bbf13ef-2942-4388-af9f-22f3a97929ed tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:25.494953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bbf13ef-2942-4388-af9f-22f3a97929ed tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:25.496168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bbf13ef-2942-4388-af9f-22f3a97929ed tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:25.496823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bbf13ef-2942-4388-af9f-22f3a97929ed tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:25.497385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bbf13ef-2942-4388-af9f-22f3a97929ed tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:25.647355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-255b380c-99af-43cb-84a2-3da58d0c7252 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:25.658644 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-255b380c-99af-43cb-84a2-3da58d0c7252 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/8d248e06-d37c-4895-85a8-e8c5e412aedb" status: 200 len: 1474 microversion: 2.1 time: 0.380177 Sep 07 12:44:25.659541 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1537/3053] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:25 2022] GET /compute/v2.1/servers/8d248e06-d37c-4895-85a8-e8c5e412aedb => generated 1474 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:25.666855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-91513ff1-3d8f-4b12-8975-8b79fe44e51c tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:25.668230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-91513ff1-3d8f-4b12-8975-8b79fe44e51c tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:25.678786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91513ff1-3d8f-4b12-8975-8b79fe44e51c tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:25.680296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91513ff1-3d8f-4b12-8975-8b79fe44e51c tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:25.681248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91513ff1-3d8f-4b12-8975-8b79fe44e51c tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:25.683149 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91513ff1-3d8f-4b12-8975-8b79fe44e51c tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:25.684287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91513ff1-3d8f-4b12-8975-8b79fe44e51c tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:25.686069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91513ff1-3d8f-4b12-8975-8b79fe44e51c tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:25.855651 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6bbf13ef-2942-4388-af9f-22f3a97929ed tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:25.866129 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6bbf13ef-2942-4388-af9f-22f3a97929ed tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1364 microversion: 2.1 time: 0.386010 Sep 07 12:44:25.866748 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1517/3054] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:25 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1364 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:25.871966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1e6be9b8-0dc3-48b9-ba5f-2520eb1f6c34 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:25.872593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1e6be9b8-0dc3-48b9-ba5f-2520eb1f6c34 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:25.880419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e6be9b8-0dc3-48b9-ba5f-2520eb1f6c34 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:25.880936 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e6be9b8-0dc3-48b9-ba5f-2520eb1f6c34 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:25.881389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e6be9b8-0dc3-48b9-ba5f-2520eb1f6c34 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:25.882248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e6be9b8-0dc3-48b9-ba5f-2520eb1f6c34 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:25.882725 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e6be9b8-0dc3-48b9-ba5f-2520eb1f6c34 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:25.883169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e6be9b8-0dc3-48b9-ba5f-2520eb1f6c34 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:25.954454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-91513ff1-3d8f-4b12-8975-8b79fe44e51c tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:25.963648 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-91513ff1-3d8f-4b12-8975-8b79fe44e51c tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1523 microversion: 2.1 time: 0.302560 Sep 07 12:44:25.964243 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1538/3055] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:25 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1523 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:25.969530 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-751ec22a-f1e3-4888-b626-a42c33c10e65 req-2d48df40-8707-44b9-a958-8642a4f9c966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edf38c92-ffc2-492b-8642-88ca59537acd", "tag": "23b18fbd-594f-42e0-a655-6b5f01607b28"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:25.980682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-751ec22a-f1e3-4888-b626-a42c33c10e65 req-2d48df40-8707-44b9-a958-8642a4f9c966 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:25.981207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-751ec22a-f1e3-4888-b626-a42c33c10e65 req-2d48df40-8707-44b9-a958-8642a4f9c966 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:25.981693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-751ec22a-f1e3-4888-b626-a42c33c10e65 req-2d48df40-8707-44b9-a958-8642a4f9c966 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:25.995562 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-751ec22a-f1e3-4888-b626-a42c33c10e65 req-2d48df40-8707-44b9-a958-8642a4f9c966 service nova] Creating event network-changed:23b18fbd-594f-42e0-a655-6b5f01607b28 for instance edf38c92-ffc2-492b-8642-88ca59537acd on n-h1-852087-9 Sep 07 12:44:26.002702 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-751ec22a-f1e3-4888-b626-a42c33c10e65 req-2d48df40-8707-44b9-a958-8642a4f9c966 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037065 Sep 07 12:44:26.003720 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1539/3056] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:26.079479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-28180eab-3b60-4c8d-8bcd-b5b81881d892 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:26.080742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-28180eab-3b60-4c8d-8bcd-b5b81881d892 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:26.083062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1e6be9b8-0dc3-48b9-ba5f-2520eb1f6c34 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:26.087474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28180eab-3b60-4c8d-8bcd-b5b81881d892 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:26.088102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28180eab-3b60-4c8d-8bcd-b5b81881d892 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:26.088611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28180eab-3b60-4c8d-8bcd-b5b81881d892 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:26.089416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28180eab-3b60-4c8d-8bcd-b5b81881d892 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:26.089980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28180eab-3b60-4c8d-8bcd-b5b81881d892 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:26.090479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28180eab-3b60-4c8d-8bcd-b5b81881d892 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:26.096880 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1e6be9b8-0dc3-48b9-ba5f-2520eb1f6c34 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 200 len: 1528 microversion: 2.1 time: 0.228700 Sep 07 12:44:26.097971 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1518/3057] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:25 2022] GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 1528 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:26.106740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-88e83949-aa38-41be-8ad8-2fcfa19abf48 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:26.107865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-88e83949-aa38-41be-8ad8-2fcfa19abf48 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:26.119941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88e83949-aa38-41be-8ad8-2fcfa19abf48 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:26.120773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88e83949-aa38-41be-8ad8-2fcfa19abf48 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:26.121539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88e83949-aa38-41be-8ad8-2fcfa19abf48 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:26.123126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88e83949-aa38-41be-8ad8-2fcfa19abf48 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:26.124372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88e83949-aa38-41be-8ad8-2fcfa19abf48 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:26.125575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88e83949-aa38-41be-8ad8-2fcfa19abf48 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:26.570806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-88e83949-aa38-41be-8ad8-2fcfa19abf48 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:26.584477 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-88e83949-aa38-41be-8ad8-2fcfa19abf48 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe" status: 200 len: 1510 microversion: 2.1 time: 0.484975 Sep 07 12:44:26.585714 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1519/3058] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:26 2022] GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe => generated 1510 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:26.591182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-16589267-7a11-4286-a949-080cb5cb74a4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:26.591987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-16589267-7a11-4286-a949-080cb5cb74a4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] [instance: b017ea78-874a-4e91-933a-716e254275a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:26.592141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-28180eab-3b60-4c8d-8bcd-b5b81881d892 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:26.600887 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-28180eab-3b60-4c8d-8bcd-b5b81881d892 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45" status: 200 len: 1646 microversion: 2.1 time: 0.526638 Sep 07 12:44:26.601513 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1540/3059] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:26 2022] GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 => generated 1646 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:26.606803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-16c16ba0-0f62-4bf0-8bef-6558d2216a41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:26.607679 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-16c16ba0-0f62-4bf0-8bef-6558d2216a41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:26.614978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16c16ba0-0f62-4bf0-8bef-6558d2216a41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:26.615767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16c16ba0-0f62-4bf0-8bef-6558d2216a41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:26.616504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16c16ba0-0f62-4bf0-8bef-6558d2216a41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:26.617411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16c16ba0-0f62-4bf0-8bef-6558d2216a41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:26.618142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16c16ba0-0f62-4bf0-8bef-6558d2216a41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:26.618572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16c16ba0-0f62-4bf0-8bef-6558d2216a41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:26.624503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16589267-7a11-4286-a949-080cb5cb74a4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:26.625389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16589267-7a11-4286-a949-080cb5cb74a4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:26.625972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16589267-7a11-4286-a949-080cb5cb74a4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:26.626762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16589267-7a11-4286-a949-080cb5cb74a4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:26.627238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16589267-7a11-4286-a949-080cb5cb74a4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:26.627693 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16589267-7a11-4286-a949-080cb5cb74a4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:26.681276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16589267-7a11-4286-a949-080cb5cb74a4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:26.682214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16589267-7a11-4286-a949-080cb5cb74a4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:26.683017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16589267-7a11-4286-a949-080cb5cb74a4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:26.683849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-16589267-7a11-4286-a949-080cb5cb74a4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lazy-loading 'fault' on Instance uuid b017ea78-874a-4e91-933a-716e254275a6 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:44:26.941182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:44:27.022769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=10 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:44:27.399933 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-16589267-7a11-4286-a949-080cb5cb74a4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51065729f69f4bfb8ab48d2c70d0ed55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12bd04061ca4c3795958b51739bbbdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:27.411561 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-16589267-7a11-4286-a949-080cb5cb74a4 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] 10.222.0.16 "GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6" status: 200 len: 1315 microversion: 2.1 time: 0.824234 Sep 07 12:44:27.435591 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1520/3060] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:26 2022] GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6 => generated 1315 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:27.452540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1f8aee06-3094-4e1d-b214-12a95df79dc7 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:27.454503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1f8aee06-3094-4e1d-b214-12a95df79dc7 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 8d248e06-d37c-4895-85a8-e8c5e412aedb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:27.463085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f8aee06-3094-4e1d-b214-12a95df79dc7 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:27.463600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f8aee06-3094-4e1d-b214-12a95df79dc7 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:27.464191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f8aee06-3094-4e1d-b214-12a95df79dc7 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:27.465223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f8aee06-3094-4e1d-b214-12a95df79dc7 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:27.466108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f8aee06-3094-4e1d-b214-12a95df79dc7 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:27.466938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f8aee06-3094-4e1d-b214-12a95df79dc7 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:27.718800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-16c16ba0-0f62-4bf0-8bef-6558d2216a41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:27.734620 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-16c16ba0-0f62-4bf0-8bef-6558d2216a41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1314 microversion: 2.1 time: 1.131264 Sep 07 12:44:27.735648 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1541/3061] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:26 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1314 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:27.742260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fbdcd4ad-8e49-417f-b0af-2f6f729d98c7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:27.743158 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fbdcd4ad-8e49-417f-b0af-2f6f729d98c7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:27.758650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbdcd4ad-8e49-417f-b0af-2f6f729d98c7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:27.761584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbdcd4ad-8e49-417f-b0af-2f6f729d98c7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:27.762715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbdcd4ad-8e49-417f-b0af-2f6f729d98c7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:27.764132 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbdcd4ad-8e49-417f-b0af-2f6f729d98c7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:27.765092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbdcd4ad-8e49-417f-b0af-2f6f729d98c7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:27.766000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbdcd4ad-8e49-417f-b0af-2f6f729d98c7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:28.826548 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1f8aee06-3094-4e1d-b214-12a95df79dc7 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:28.842843 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1f8aee06-3094-4e1d-b214-12a95df79dc7 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/8d248e06-d37c-4895-85a8-e8c5e412aedb" status: 200 len: 1474 microversion: 2.1 time: 1.401809 Sep 07 12:44:28.862619 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1521/3062] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:27 2022] GET /compute/v2.1/servers/8d248e06-d37c-4895-85a8-e8c5e412aedb => generated 1474 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:28.897515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b9ddfff4-085d-47f3-9c57-5caea30f6f79 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:28.898559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b9ddfff4-085d-47f3-9c57-5caea30f6f79 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:28.932389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9ddfff4-085d-47f3-9c57-5caea30f6f79 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:28.937767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9ddfff4-085d-47f3-9c57-5caea30f6f79 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:28.938699 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9ddfff4-085d-47f3-9c57-5caea30f6f79 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:28.939750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9ddfff4-085d-47f3-9c57-5caea30f6f79 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:28.940541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9ddfff4-085d-47f3-9c57-5caea30f6f79 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:28.946008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9ddfff4-085d-47f3-9c57-5caea30f6f79 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:29.053295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fbdcd4ad-8e49-417f-b0af-2f6f729d98c7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:29.069541 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fbdcd4ad-8e49-417f-b0af-2f6f729d98c7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1364 microversion: 2.1 time: 1.332013 Sep 07 12:44:29.084091 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1542/3063] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:27 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1364 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:29.089274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ddbd05e6-edc9-4770-bc4d-cfa39fa1c252 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:29.090198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ddbd05e6-edc9-4770-bc4d-cfa39fa1c252 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:29.097056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddbd05e6-edc9-4770-bc4d-cfa39fa1c252 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:29.097590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddbd05e6-edc9-4770-bc4d-cfa39fa1c252 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:29.098038 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddbd05e6-edc9-4770-bc4d-cfa39fa1c252 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:29.098754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddbd05e6-edc9-4770-bc4d-cfa39fa1c252 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:29.099202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddbd05e6-edc9-4770-bc4d-cfa39fa1c252 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:29.099625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddbd05e6-edc9-4770-bc4d-cfa39fa1c252 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:29.136343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddbd05e6-edc9-4770-bc4d-cfa39fa1c252 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:29.137134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddbd05e6-edc9-4770-bc4d-cfa39fa1c252 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:29.137794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddbd05e6-edc9-4770-bc4d-cfa39fa1c252 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:29.138256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-ddbd05e6-edc9-4770-bc4d-cfa39fa1c252 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lazy-loading 'fault' on Instance uuid 023e989d-cb87-4aea-a0c8-7123ad57c4f2 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:44:29.272894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ddbd05e6-edc9-4770-bc4d-cfa39fa1c252 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:29.290675 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ddbd05e6-edc9-4770-bc4d-cfa39fa1c252 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 200 len: 1315 microversion: 2.1 time: 0.204914 Sep 07 12:44:29.292657 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1543/3064] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:29 2022] GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:29.302705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e4adbf80-831b-45c5-b06c-a94b595221b4 req-018cd13e-9bb5-4104-acf4-f764ee166645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45", "name": "network-vif-unplugged", "status": "completed", "tag": "18cbdf2f-3657-4ad8-b999-fd91c1f28c75"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:29.322878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e4adbf80-831b-45c5-b06c-a94b595221b4 req-018cd13e-9bb5-4104-acf4-f764ee166645 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:29.324191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e4adbf80-831b-45c5-b06c-a94b595221b4 req-018cd13e-9bb5-4104-acf4-f764ee166645 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:29.325279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e4adbf80-831b-45c5-b06c-a94b595221b4 req-018cd13e-9bb5-4104-acf4-f764ee166645 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:29.351966 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e4adbf80-831b-45c5-b06c-a94b595221b4 req-018cd13e-9bb5-4104-acf4-f764ee166645 service nova] Creating event network-vif-unplugged:18cbdf2f-3657-4ad8-b999-fd91c1f28c75 for instance bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 on n-h2-852087-9 Sep 07 12:44:29.361618 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e4adbf80-831b-45c5-b06c-a94b595221b4 req-018cd13e-9bb5-4104-acf4-f764ee166645 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065986 Sep 07 12:44:29.367832 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1544/3065] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:29.375176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e2d6092e-5e98-4c08-9c60-861ffe99e2d1 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:29.376189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e2d6092e-5e98-4c08-9c60-861ffe99e2d1 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:29.384903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2d6092e-5e98-4c08-9c60-861ffe99e2d1 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:29.385748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2d6092e-5e98-4c08-9c60-861ffe99e2d1 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:29.386202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2d6092e-5e98-4c08-9c60-861ffe99e2d1 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:29.386941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2d6092e-5e98-4c08-9c60-861ffe99e2d1 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:29.387410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2d6092e-5e98-4c08-9c60-861ffe99e2d1 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:29.387845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2d6092e-5e98-4c08-9c60-861ffe99e2d1 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:29.716370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b9ddfff4-085d-47f3-9c57-5caea30f6f79 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:29.724838 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b9ddfff4-085d-47f3-9c57-5caea30f6f79 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1523 microversion: 2.1 time: 0.861814 Sep 07 12:44:29.725473 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1522/3066] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:28 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1523 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:29.730996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1467c643-aea7-43e2-89ff-f2dd9c24a4ed tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:29.731511 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1467c643-aea7-43e2-89ff-f2dd9c24a4ed tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:29.739074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1467c643-aea7-43e2-89ff-f2dd9c24a4ed tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:29.739581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1467c643-aea7-43e2-89ff-f2dd9c24a4ed tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:29.740024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1467c643-aea7-43e2-89ff-f2dd9c24a4ed tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:29.740751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1467c643-aea7-43e2-89ff-f2dd9c24a4ed tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:29.741214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1467c643-aea7-43e2-89ff-f2dd9c24a4ed tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:29.741679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1467c643-aea7-43e2-89ff-f2dd9c24a4ed tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:30.201513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e2d6092e-5e98-4c08-9c60-861ffe99e2d1 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:30.223441 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e2d6092e-5e98-4c08-9c60-861ffe99e2d1 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45" status: 200 len: 1646 microversion: 2.1 time: 0.853288 Sep 07 12:44:30.224493 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1545/3067] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:29 2022] GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 => generated 1646 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:30.234130 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b5a46342-0caf-47e8-a533-0ba29ffc929f req-ec3614dc-66d1-483b-a0bb-9f145aaa7b71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4510b67f-d3c1-4341-a4aa-deda75761799", "tag": "29290a05-6053-4199-a000-3cc6b7487504"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:30.254622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b5a46342-0caf-47e8-a533-0ba29ffc929f req-ec3614dc-66d1-483b-a0bb-9f145aaa7b71 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:30.256234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b5a46342-0caf-47e8-a533-0ba29ffc929f req-ec3614dc-66d1-483b-a0bb-9f145aaa7b71 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:30.257342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b5a46342-0caf-47e8-a533-0ba29ffc929f req-ec3614dc-66d1-483b-a0bb-9f145aaa7b71 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:30.289799 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b5a46342-0caf-47e8-a533-0ba29ffc929f req-ec3614dc-66d1-483b-a0bb-9f145aaa7b71 service nova] Creating event network-changed:29290a05-6053-4199-a000-3cc6b7487504 for instance 4510b67f-d3c1-4341-a4aa-deda75761799 on n-h1-852087-9 Sep 07 12:44:30.299266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1467c643-aea7-43e2-89ff-f2dd9c24a4ed tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:30.307240 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b5a46342-0caf-47e8-a533-0ba29ffc929f req-ec3614dc-66d1-483b-a0bb-9f145aaa7b71 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071409 Sep 07 12:44:30.316033 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1546/3068] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:30.323577 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1467c643-aea7-43e2-89ff-f2dd9c24a4ed tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe" status: 200 len: 1493 microversion: 2.1 time: 0.596396 Sep 07 12:44:30.335856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-31782544-8e91-47ba-ae51-86a3ae4b7fbf tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:30.339299 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1523/3069] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:29 2022] GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe => generated 1493 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:30.353433 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1aa05d46-4854-4602-a4ae-28b54c936124 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:30.358358 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1aa05d46-4854-4602-a4ae-28b54c936124 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:30.364264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-31782544-8e91-47ba-ae51-86a3ae4b7fbf tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] [instance: b017ea78-874a-4e91-933a-716e254275a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:30.380159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:44:30.385392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aa05d46-4854-4602-a4ae-28b54c936124 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:30.386880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aa05d46-4854-4602-a4ae-28b54c936124 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:30.388045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aa05d46-4854-4602-a4ae-28b54c936124 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:30.389552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aa05d46-4854-4602-a4ae-28b54c936124 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:30.390738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aa05d46-4854-4602-a4ae-28b54c936124 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:30.391117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31782544-8e91-47ba-ae51-86a3ae4b7fbf tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:30.391769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31782544-8e91-47ba-ae51-86a3ae4b7fbf tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:30.392232 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31782544-8e91-47ba-ae51-86a3ae4b7fbf tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:30.393051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31782544-8e91-47ba-ae51-86a3ae4b7fbf tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:30.393619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31782544-8e91-47ba-ae51-86a3ae4b7fbf tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:30.399461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aa05d46-4854-4602-a4ae-28b54c936124 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:30.400805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31782544-8e91-47ba-ae51-86a3ae4b7fbf tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:30.442637 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-31782544-8e91-47ba-ae51-86a3ae4b7fbf tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] HTTP exception thrown: Instance b017ea78-874a-4e91-933a-716e254275a6 could not be found. Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-31782544-8e91-47ba-ae51-86a3ae4b7fbf tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Request method failure captured: Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6 HTTP/1.1 Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJHFDj7IhB8soLa3rC0BdeQVikduIDSVXj-3o71RZYmj_aw01byVsYZAhlfXW0cpkUV4wu4gzvceGDx7Hdiino0SsyGNeW0tGBt6aZi5xqAZvv0GgXW8TH0MZ3oAyxA12Fg0CywPrW2aeMSDrpsvypADGDuNoUH-19HGZSur5Xp18PM Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: e12bd04061ca4c3795958b51739bbbdd Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestFqdnHostnames-1488833353 Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e12bd04061ca4c3795958b51739bbbdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e12bd04061ca4c3795958b51739bbbdd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e12bd04061ca4c3795958b51739bbbdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e12bd04061ca4c3795958b51739bbbdd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestFqdnHostnames-1488833353 Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: e12bd04061ca4c3795958b51739bbbdd Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1488833353 Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersTestFqdnHostnames-1488833353-project Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 51065729f69f4bfb8ab48d2c70d0ed55 Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestFqdnHostnames-1488833353-project Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance b017ea78-874a-4e91-933a-716e254275a6 could not be found. Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'b017ea78-874a-4e91-933a-716e254275a6'} Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b017ea78-874a-4e91-933a-716e254275a6 could not be found. Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b017ea78-874a-4e91-933a-716e254275a6 could not be found. Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:30.447201 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:30.464090 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:30.464090 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:30.464090 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:30.464090 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:30.464090 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:30.464090 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b017ea78-874a-4e91-933a-716e254275a6 could not be found. Sep 07 12:44:30.464090 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:30.466946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:44:30.467851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-31782544-8e91-47ba-ae51-86a3ae4b7fbf tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Returning 404 to user: Instance b017ea78-874a-4e91-933a-716e254275a6 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:30.473947 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-31782544-8e91-47ba-ae51-86a3ae4b7fbf tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] 10.222.0.16 "GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6" status: 404 len: 111 microversion: 2.1 time: 0.152189 Sep 07 12:44:30.475966 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1547/3070] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:30 2022] GET /compute/v2.1/servers/b017ea78-874a-4e91-933a-716e254275a6 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:30.490213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bd0a1806-1c8e-40b0-ab3f-d35e84747de1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:30.491517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bd0a1806-1c8e-40b0-ab3f-d35e84747de1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 8d248e06-d37c-4895-85a8-e8c5e412aedb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:30.518079 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd0a1806-1c8e-40b0-ab3f-d35e84747de1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:30.519270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd0a1806-1c8e-40b0-ab3f-d35e84747de1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:30.520431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd0a1806-1c8e-40b0-ab3f-d35e84747de1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:30.521917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd0a1806-1c8e-40b0-ab3f-d35e84747de1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:30.523079 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd0a1806-1c8e-40b0-ab3f-d35e84747de1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:30.524779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd0a1806-1c8e-40b0-ab3f-d35e84747de1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:30.610156 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:44:30.751830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bd0a1806-1c8e-40b0-ab3f-d35e84747de1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:30.770024 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bd0a1806-1c8e-40b0-ab3f-d35e84747de1 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/8d248e06-d37c-4895-85a8-e8c5e412aedb" status: 200 len: 1303 microversion: 2.1 time: 0.289956 Sep 07 12:44:30.776844 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1548/3071] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:30 2022] GET /compute/v2.1/servers/8d248e06-d37c-4895-85a8-e8c5e412aedb => generated 1303 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:30.797669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0ddb25ab-51ed-402f-9576-97ca9e706ac0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:30.800182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0ddb25ab-51ed-402f-9576-97ca9e706ac0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:30.821986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ddb25ab-51ed-402f-9576-97ca9e706ac0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:30.823316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ddb25ab-51ed-402f-9576-97ca9e706ac0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:30.826895 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ddb25ab-51ed-402f-9576-97ca9e706ac0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:30.827512 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1aa05d46-4854-4602-a4ae-28b54c936124 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:30.830118 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ddb25ab-51ed-402f-9576-97ca9e706ac0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:30.832975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ddb25ab-51ed-402f-9576-97ca9e706ac0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:30.834284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ddb25ab-51ed-402f-9576-97ca9e706ac0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:30.848822 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1aa05d46-4854-4602-a4ae-28b54c936124 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1314 microversion: 2.1 time: 0.505316 Sep 07 12:44:30.850296 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1524/3072] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:30 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:30.881022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8a2131b5-3872-42dd-895b-c8aa9dd98d4d req-86693299-8671-4a20-9bae-da345bc5db93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45", "name": "network-vif-deleted", "tag": "18cbdf2f-3657-4ad8-b999-fd91c1f28c75"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:30.909460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8a2131b5-3872-42dd-895b-c8aa9dd98d4d req-86693299-8671-4a20-9bae-da345bc5db93 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:30.909987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8a2131b5-3872-42dd-895b-c8aa9dd98d4d req-86693299-8671-4a20-9bae-da345bc5db93 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:30.910429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8a2131b5-3872-42dd-895b-c8aa9dd98d4d req-86693299-8671-4a20-9bae-da345bc5db93 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:30.927957 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8a2131b5-3872-42dd-895b-c8aa9dd98d4d req-86693299-8671-4a20-9bae-da345bc5db93 service nova] Creating event network-vif-deleted:18cbdf2f-3657-4ad8-b999-fd91c1f28c75 for instance bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 on n-h2-852087-9 Sep 07 12:44:30.934484 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8a2131b5-3872-42dd-895b-c8aa9dd98d4d req-86693299-8671-4a20-9bae-da345bc5db93 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082381 Sep 07 12:44:30.935885 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1525/3073] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:30.942746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6953dc7f-0ced-4195-b62e-4a731e93870c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:30.944246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6953dc7f-0ced-4195-b62e-4a731e93870c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:30.953716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6953dc7f-0ced-4195-b62e-4a731e93870c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:30.954896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6953dc7f-0ced-4195-b62e-4a731e93870c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:30.956009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6953dc7f-0ced-4195-b62e-4a731e93870c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:30.957715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6953dc7f-0ced-4195-b62e-4a731e93870c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:30.967600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6953dc7f-0ced-4195-b62e-4a731e93870c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:30.970362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6953dc7f-0ced-4195-b62e-4a731e93870c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:31.007110 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-6953dc7f-0ced-4195-b62e-4a731e93870c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] HTTP exception thrown: Instance 023e989d-cb87-4aea-a0c8-7123ad57c4f2 could not be found. Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6953dc7f-0ced-4195-b62e-4a731e93870c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Request method failure captured: Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 HTTP/1.1 Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJGQYbyJLIsXxXjgkDYN7LwAZ3FIxjt-YGkXt1Xo1a1MUwTVDulf3qar21KhPKqmmgY5XowXVa7QiIPma2KSUUJYmnQLgFXdiW6Ghu6fpYXXYUWnHmYT3Op2c2gidR2lsMRLQPmqnvHgSb4f0Vzgm_QdSzSUbn3j0rcW4vT7twxuCxo Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: ac0d1c1e891c470c99e7c968b908a054 Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 023e989d-cb87-4aea-a0c8-7123ad57c4f2 could not be found. Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '023e989d-cb87-4aea-a0c8-7123ad57c4f2'} Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 023e989d-cb87-4aea-a0c8-7123ad57c4f2 could not be found. Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 023e989d-cb87-4aea-a0c8-7123ad57c4f2 could not be found. Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:31.010105 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:31.019237 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:31.019237 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:31.019237 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:31.019237 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:31.019237 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:31.019237 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:31.019237 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 023e989d-cb87-4aea-a0c8-7123ad57c4f2 could not be found. Sep 07 12:44:31.019237 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:31.019237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6953dc7f-0ced-4195-b62e-4a731e93870c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Returning 404 to user: Instance 023e989d-cb87-4aea-a0c8-7123ad57c4f2 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:31.019237 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6953dc7f-0ced-4195-b62e-4a731e93870c tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 404 len: 111 microversion: 2.1 time: 0.073951 Sep 07 12:44:31.019237 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1526/3074] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:30 2022] GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:31.023910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-545fe797-0fac-4b98-aa8a-f0e492ec021c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:31.024768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-545fe797-0fac-4b98-aa8a-f0e492ec021c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:31.054982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-545fe797-0fac-4b98-aa8a-f0e492ec021c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:31.055667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-545fe797-0fac-4b98-aa8a-f0e492ec021c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:31.057269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-545fe797-0fac-4b98-aa8a-f0e492ec021c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:31.058398 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-545fe797-0fac-4b98-aa8a-f0e492ec021c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:31.063196 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-545fe797-0fac-4b98-aa8a-f0e492ec021c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:31.063931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-545fe797-0fac-4b98-aa8a-f0e492ec021c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:31.100513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0ddb25ab-51ed-402f-9576-97ca9e706ac0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:31.115520 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0ddb25ab-51ed-402f-9576-97ca9e706ac0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1364 microversion: 2.1 time: 0.335984 Sep 07 12:44:31.117956 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1549/3075] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:30 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1364 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:31.119006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-545fe797-0fac-4b98-aa8a-f0e492ec021c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:44:31.129888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-096e1975-c8bc-4919-ba76-8d81d27ff293 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] Calling method '.version_select at 0x7fc41d28e040>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:31.141195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:44:31.177801 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-096e1975-c8bc-4919-ba76-8d81d27ff293 tempest-ServersTestFqdnHostnames-1488833353 tempest-ServersTestFqdnHostnames-1488833353-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-888921737" status: 202 len: 0 microversion: 2.1 time: 0.056191 Sep 07 12:44:31.181652 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1550/3076] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Sep 7 12:44:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-888921737 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:44:31.187566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-77a52aad-f7df-4af7-87fb-065ea757842b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:31.188329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-77a52aad-f7df-4af7-87fb-065ea757842b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:31.197449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77a52aad-f7df-4af7-87fb-065ea757842b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:31.198536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77a52aad-f7df-4af7-87fb-065ea757842b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:31.199042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77a52aad-f7df-4af7-87fb-065ea757842b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:31.199809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77a52aad-f7df-4af7-87fb-065ea757842b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:31.200270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77a52aad-f7df-4af7-87fb-065ea757842b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:31.200721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77a52aad-f7df-4af7-87fb-065ea757842b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:31.231057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:44:31.307123 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-545fe797-0fac-4b98-aa8a-f0e492ec021c tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "DELETE /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe" status: 204 len: 0 microversion: 2.1 time: 0.288713 Sep 07 12:44:31.308554 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1527/3077] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:44:31 2022] DELETE /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:44:31.319785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ea657b14-14fc-4a6b-ab59-58ddd4b5ee0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-641742912", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:31.409252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-ea657b14-14fc-4a6b-ab59-58ddd4b5ee0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] validate_networks() for [('053fbc67-334b-4d09-89d9-46503fbb7c8b', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:44:31.727262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-77a52aad-f7df-4af7-87fb-065ea757842b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:31.739392 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-77a52aad-f7df-4af7-87fb-065ea757842b tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1523 microversion: 2.1 time: 0.556279 Sep 07 12:44:31.744542 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1551/3078] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:31 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1523 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:31.765182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-471d7f0f-d0f4-4cc0-a26b-333c00d4217a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:31.765994 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-471d7f0f-d0f4-4cc0-a26b-333c00d4217a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:31.779611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-471d7f0f-d0f4-4cc0-a26b-333c00d4217a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:31.780607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-471d7f0f-d0f4-4cc0-a26b-333c00d4217a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:31.782132 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-471d7f0f-d0f4-4cc0-a26b-333c00d4217a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:31.783173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-471d7f0f-d0f4-4cc0-a26b-333c00d4217a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:31.784237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-471d7f0f-d0f4-4cc0-a26b-333c00d4217a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:31.785123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-471d7f0f-d0f4-4cc0-a26b-333c00d4217a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:31.874728 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-471d7f0f-d0f4-4cc0-a26b-333c00d4217a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:31.875447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-471d7f0f-d0f4-4cc0-a26b-333c00d4217a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:31.876378 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-471d7f0f-d0f4-4cc0-a26b-333c00d4217a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:31.879373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-471d7f0f-d0f4-4cc0-a26b-333c00d4217a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lazy-loading 'fault' on Instance uuid bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:44:32.037901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-471d7f0f-d0f4-4cc0-a26b-333c00d4217a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7fac0664f044168f52e7c1a982c48e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d8398313f4738bd1d9b6cd1ea93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:32.060063 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-471d7f0f-d0f4-4cc0-a26b-333c00d4217a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45" status: 200 len: 1306 microversion: 2.1 time: 0.313752 Sep 07 12:44:32.073716 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1552/3079] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:31 2022] GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 => generated 1306 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:32.083320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-55f137b3-ccf4-4ce1-9b10-6652b305c669 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:32.084241 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-55f137b3-ccf4-4ce1-9b10-6652b305c669 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:32.095219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55f137b3-ccf4-4ce1-9b10-6652b305c669 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:32.095727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55f137b3-ccf4-4ce1-9b10-6652b305c669 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:32.096191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55f137b3-ccf4-4ce1-9b10-6652b305c669 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:32.099506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55f137b3-ccf4-4ce1-9b10-6652b305c669 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:32.100013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55f137b3-ccf4-4ce1-9b10-6652b305c669 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:32.100467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55f137b3-ccf4-4ce1-9b10-6652b305c669 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:32.425754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-55f137b3-ccf4-4ce1-9b10-6652b305c669 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:32.435760 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-55f137b3-ccf4-4ce1-9b10-6652b305c669 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe" status: 200 len: 1499 microversion: 2.1 time: 0.373178 Sep 07 12:44:32.436798 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1553/3080] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:32 2022] GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe => generated 1499 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:32.441519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ea657b14-14fc-4a6b-ab59-58ddd4b5ee0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:44:32.442078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ea657b14-14fc-4a6b-ab59-58ddd4b5ee0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:44:32.442417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ea657b14-14fc-4a6b-ab59-58ddd4b5ee0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:44:32.443200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ea657b14-14fc-4a6b-ab59-58ddd4b5ee0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:44:32.443620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ea657b14-14fc-4a6b-ab59-58ddd4b5ee0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:44:32.444460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d7493993-386b-4a37-a9ba-466a2656222e req-2f43dc35-d1e3-4926-a9a9-3b942a81600d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d248e06-d37c-4895-85a8-e8c5e412aedb", "name": "network-vif-unplugged", "status": "completed", "tag": "9ed5605a-00bc-4fa2-920f-050b6706d609"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:32.464249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d7493993-386b-4a37-a9ba-466a2656222e req-2f43dc35-d1e3-4926-a9a9-3b942a81600d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:32.465138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d7493993-386b-4a37-a9ba-466a2656222e req-2f43dc35-d1e3-4926-a9a9-3b942a81600d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:32.465862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d7493993-386b-4a37-a9ba-466a2656222e req-2f43dc35-d1e3-4926-a9a9-3b942a81600d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:32.482490 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d7493993-386b-4a37-a9ba-466a2656222e req-2f43dc35-d1e3-4926-a9a9-3b942a81600d service nova] Creating event network-vif-unplugged:9ed5605a-00bc-4fa2-920f-050b6706d609 for instance 8d248e06-d37c-4895-85a8-e8c5e412aedb on n-h2-852087-9 Sep 07 12:44:32.482816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea657b14-14fc-4a6b-ab59-58ddd4b5ee0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:32.484274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea657b14-14fc-4a6b-ab59-58ddd4b5ee0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:32.487744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea657b14-14fc-4a6b-ab59-58ddd4b5ee0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:32.489791 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d7493993-386b-4a37-a9ba-466a2656222e req-2f43dc35-d1e3-4926-a9a9-3b942a81600d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051134 Sep 07 12:44:32.491435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea657b14-14fc-4a6b-ab59-58ddd4b5ee0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:32.492081 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1554/3081] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:32.493967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea657b14-14fc-4a6b-ab59-58ddd4b5ee0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:32.494443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea657b14-14fc-4a6b-ab59-58ddd4b5ee0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:32.500508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fa5bb905-40ef-47f4-bcbb-420c5bb71793 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:32.501434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fa5bb905-40ef-47f4-bcbb-420c5bb71793 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 8d248e06-d37c-4895-85a8-e8c5e412aedb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:32.510844 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa5bb905-40ef-47f4-bcbb-420c5bb71793 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:32.511490 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa5bb905-40ef-47f4-bcbb-420c5bb71793 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:32.512775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa5bb905-40ef-47f4-bcbb-420c5bb71793 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:32.513956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa5bb905-40ef-47f4-bcbb-420c5bb71793 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:32.514663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa5bb905-40ef-47f4-bcbb-420c5bb71793 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:32.515323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa5bb905-40ef-47f4-bcbb-420c5bb71793 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:32.527210 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-ea657b14-14fc-4a6b-ab59-58ddd4b5ee0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Getting quotas for project feb4e290866f4f54b2b99733b56cb7bd. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:44:32.534671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-ea657b14-14fc-4a6b-ab59-58ddd4b5ee0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Getting quotas for user ac0d1c1e891c470c99e7c968b908a054 and project feb4e290866f4f54b2b99733b56cb7bd. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:44:32.551214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ea657b14-14fc-4a6b-ab59-58ddd4b5ee0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:44:32.553988 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ea657b14-14fc-4a6b-ab59-58ddd4b5ee0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: f7a91425-0aae-40bb-b720-071ac9ec52f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:44:32.569396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa5bb905-40ef-47f4-bcbb-420c5bb71793 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:32.570111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa5bb905-40ef-47f4-bcbb-420c5bb71793 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:32.575890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa5bb905-40ef-47f4-bcbb-420c5bb71793 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:32.578529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-fa5bb905-40ef-47f4-bcbb-420c5bb71793 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lazy-loading 'fault' on Instance uuid 8d248e06-d37c-4895-85a8-e8c5e412aedb {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:44:32.626636 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ea657b14-14fc-4a6b-ab59-58ddd4b5ee0e tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.316184 Sep 07 12:44:32.627955 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1528/3082] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:44:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 1319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:44:32.633026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5f5f8aad-ef8b-499a-9e46-3eaa38eb2d8e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:32.633677 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5f5f8aad-ef8b-499a-9e46-3eaa38eb2d8e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:32.647502 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f5f8aad-ef8b-499a-9e46-3eaa38eb2d8e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:32.648024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f5f8aad-ef8b-499a-9e46-3eaa38eb2d8e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:32.648464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f5f8aad-ef8b-499a-9e46-3eaa38eb2d8e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:32.649201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f5f8aad-ef8b-499a-9e46-3eaa38eb2d8e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:32.649711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f5f8aad-ef8b-499a-9e46-3eaa38eb2d8e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:32.650122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f5f8aad-ef8b-499a-9e46-3eaa38eb2d8e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:32.661180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fa5bb905-40ef-47f4-bcbb-420c5bb71793 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:32.671361 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fa5bb905-40ef-47f4-bcbb-420c5bb71793 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/8d248e06-d37c-4895-85a8-e8c5e412aedb" status: 200 len: 1308 microversion: 2.1 time: 0.177513 Sep 07 12:44:32.682243 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1555/3083] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:32 2022] GET /compute/v2.1/servers/8d248e06-d37c-4895-85a8-e8c5e412aedb => generated 1308 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:32.708627 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e4eda477-ea1a-413a-9ad6-1f384bce55fb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:32.709411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e4eda477-ea1a-413a-9ad6-1f384bce55fb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:32.716512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4eda477-ea1a-413a-9ad6-1f384bce55fb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:32.717112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4eda477-ea1a-413a-9ad6-1f384bce55fb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:32.717651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4eda477-ea1a-413a-9ad6-1f384bce55fb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:32.718435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4eda477-ea1a-413a-9ad6-1f384bce55fb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:32.718967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4eda477-ea1a-413a-9ad6-1f384bce55fb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:32.719486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4eda477-ea1a-413a-9ad6-1f384bce55fb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:33.089038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5f5f8aad-ef8b-499a-9e46-3eaa38eb2d8e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:33.112808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e4eda477-ea1a-413a-9ad6-1f384bce55fb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:33.117220 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5f5f8aad-ef8b-499a-9e46-3eaa38eb2d8e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1314 microversion: 2.1 time: 0.486221 Sep 07 12:44:33.120063 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1529/3084] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:32 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:33.122486 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e4eda477-ea1a-413a-9ad6-1f384bce55fb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1364 microversion: 2.1 time: 0.438936 Sep 07 12:44:33.127632 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-ed031e13-fd4f-494d-b2b1-6b045dfffdb7 req-54b97f17-b42f-4468-bda4-993f4ac1cdab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6762b361-a49e-467e-ba9b-cebfb35d9a58", "name": "network-vif-deleted", "tag": "5662afc1-dcd4-46fd-a437-6fc43e3c2295"}, {"server_uuid": "023e989d-cb87-4aea-a0c8-7123ad57c4f2", "name": "network-vif-deleted", "tag": "9e2c8268-a833-4fcd-9631-f8c82408ea70"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:33.128499 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1556/3085] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:32 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1364 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:33.141449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fdb077ac-605a-4c9a-8c5e-01b802ea5677 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:33.142477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fdb077ac-605a-4c9a-8c5e-01b802ea5677 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: f7a91425-0aae-40bb-b720-071ac9ec52f2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:33.148535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:44:33.182178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ed031e13-fd4f-494d-b2b1-6b045dfffdb7 req-54b97f17-b42f-4468-bda4-993f4ac1cdab service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:33.183092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ed031e13-fd4f-494d-b2b1-6b045dfffdb7 req-54b97f17-b42f-4468-bda4-993f4ac1cdab service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:33.184088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ed031e13-fd4f-494d-b2b1-6b045dfffdb7 req-54b97f17-b42f-4468-bda4-993f4ac1cdab service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:33.214681 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ed031e13-fd4f-494d-b2b1-6b045dfffdb7 req-54b97f17-b42f-4468-bda4-993f4ac1cdab service nova] Creating event network-vif-deleted:5662afc1-dcd4-46fd-a437-6fc43e3c2295 for instance 6762b361-a49e-467e-ba9b-cebfb35d9a58 on n-h1-852087-9 Sep 07 12:44:33.215992 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ed031e13-fd4f-494d-b2b1-6b045dfffdb7 req-54b97f17-b42f-4468-bda4-993f4ac1cdab service nova] Creating event network-vif-deleted:9e2c8268-a833-4fcd-9631-f8c82408ea70 for instance 023e989d-cb87-4aea-a0c8-7123ad57c4f2 on n-h2-852087-9 Sep 07 12:44:33.240036 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-ed031e13-fd4f-494d-b2b1-6b045dfffdb7 req-54b97f17-b42f-4468-bda4-993f4ac1cdab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.116625 Sep 07 12:44:33.241551 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1530/3086] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:33.260430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-76e680c4-0f68-4499-92a5-3a00b59d94b7 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:33.262637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-76e680c4-0f68-4499-92a5-3a00b59d94b7 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:33.278396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fdb077ac-605a-4c9a-8c5e-01b802ea5677 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:33.280319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76e680c4-0f68-4499-92a5-3a00b59d94b7 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:33.282500 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76e680c4-0f68-4499-92a5-3a00b59d94b7 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:33.284038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76e680c4-0f68-4499-92a5-3a00b59d94b7 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:33.286119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76e680c4-0f68-4499-92a5-3a00b59d94b7 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:33.287211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76e680c4-0f68-4499-92a5-3a00b59d94b7 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:33.289989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76e680c4-0f68-4499-92a5-3a00b59d94b7 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:33.307811 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fdb077ac-605a-4c9a-8c5e-01b802ea5677 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2" status: 200 len: 1224 microversion: 2.1 time: 0.177732 Sep 07 12:44:33.308578 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1557/3087] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:33 2022] GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2 => generated 1224 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:33.313520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-2e652e5e-e921-4714-864b-2a950c33618a req-2e01940f-e1d8-4368-bbf2-410a0fec8c4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d248e06-d37c-4895-85a8-e8c5e412aedb", "name": "network-vif-deleted", "tag": "9ed5605a-00bc-4fa2-920f-050b6706d609"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:33.338786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2e652e5e-e921-4714-864b-2a950c33618a req-2e01940f-e1d8-4368-bbf2-410a0fec8c4c service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:33.345580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2e652e5e-e921-4714-864b-2a950c33618a req-2e01940f-e1d8-4368-bbf2-410a0fec8c4c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:33.346298 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2e652e5e-e921-4714-864b-2a950c33618a req-2e01940f-e1d8-4368-bbf2-410a0fec8c4c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:33.364231 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-2e652e5e-e921-4714-864b-2a950c33618a req-2e01940f-e1d8-4368-bbf2-410a0fec8c4c service nova] Creating event network-vif-deleted:9ed5605a-00bc-4fa2-920f-050b6706d609 for instance 8d248e06-d37c-4895-85a8-e8c5e412aedb on n-h2-852087-9 Sep 07 12:44:33.379392 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-2e652e5e-e921-4714-864b-2a950c33618a req-2e01940f-e1d8-4368-bbf2-410a0fec8c4c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069417 Sep 07 12:44:33.380017 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1558/3088] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:33.392754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e05c292d-5419-449d-965b-1c77576de417 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:33.394523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e05c292d-5419-449d-965b-1c77576de417 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] [instance: bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:33.420724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e05c292d-5419-449d-965b-1c77576de417 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:33.421928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e05c292d-5419-449d-965b-1c77576de417 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:33.422835 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e05c292d-5419-449d-965b-1c77576de417 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:33.424214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e05c292d-5419-449d-965b-1c77576de417 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:33.425304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e05c292d-5419-449d-965b-1c77576de417 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:33.426413 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e05c292d-5419-449d-965b-1c77576de417 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:33.484614 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-e05c292d-5419-449d-965b-1c77576de417 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] HTTP exception thrown: Instance bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 could not be found. Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e05c292d-5419-449d-965b-1c77576de417 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Request method failure captured: Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 HTTP/1.1 Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJGWMXgN7OdrmO70X8q48ZD-kObLPYOd01ANus8JY-PK7OjbvYCQ097-aKOdLEd3zX6imftUV9BBkR8dj8xCIWAm9yYmlnMVOTu04sxm_YJiyi8RzROPFAn0FZkGq3OAzdh-65OtDl9f1F4UEDEA_AaJuKK-hToemYtm-2HEdw2FTvo Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d6d8398313f4738bd1d9b6cd1ea93a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 6d6d8398313f4738bd1d9b6cd1ea93a7 Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2082440812 Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6c7fac0664f044168f52e7c1a982c48e Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-SecurityGroupsTestJSON-2082440812-project Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 could not be found. Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45'} Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 could not be found. Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 could not be found. Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:33.489119 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:33.498432 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:33.498432 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:33.498432 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:33.498432 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:33.498432 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:33.498432 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 could not be found. Sep 07 12:44:33.498432 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:33.498432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e05c292d-5419-449d-965b-1c77576de417 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Returning 404 to user: Instance bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:33.500584 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e05c292d-5419-449d-965b-1c77576de417 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45" status: 404 len: 111 microversion: 2.1 time: 0.117310 Sep 07 12:44:33.518799 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1559/3089] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:33 2022] GET /compute/v2.1/servers/bbc1a3a8-18c8-4fa3-8e64-ab29ac952e45 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:33.524360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9c94a2e5-f996-420f-b6a8-fe422b65f6eb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:33.525431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9c94a2e5-f996-420f-b6a8-fe422b65f6eb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:33.532757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c94a2e5-f996-420f-b6a8-fe422b65f6eb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:33.533430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c94a2e5-f996-420f-b6a8-fe422b65f6eb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:33.534065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c94a2e5-f996-420f-b6a8-fe422b65f6eb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:33.534891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c94a2e5-f996-420f-b6a8-fe422b65f6eb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:33.535459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c94a2e5-f996-420f-b6a8-fe422b65f6eb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:33.535987 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c94a2e5-f996-420f-b6a8-fe422b65f6eb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:34.199964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-76e680c4-0f68-4499-92a5-3a00b59d94b7 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:34.220071 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-76e680c4-0f68-4499-92a5-3a00b59d94b7 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1523 microversion: 2.1 time: 0.975612 Sep 07 12:44:34.242532 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1531/3090] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:33 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1523 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:34.251695 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9a9b8499-e09a-48ef-acc2-de6261f31860 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '.version_select at 0x7fc41d190dc0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:34.320010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9c94a2e5-f996-420f-b6a8-fe422b65f6eb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:34.331911 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9c94a2e5-f996-420f-b6a8-fe422b65f6eb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe" status: 200 len: 1499 microversion: 2.1 time: 0.811421 Sep 07 12:44:34.333315 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1560/3091] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:33 2022] GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe => generated 1499 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:34.340887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b4e0ae25-dc0b-4f19-bb1e-1c0599ae7a2f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:34.346248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b4e0ae25-dc0b-4f19-bb1e-1c0599ae7a2f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 8d248e06-d37c-4895-85a8-e8c5e412aedb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:34.359236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4e0ae25-dc0b-4f19-bb1e-1c0599ae7a2f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:34.360315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4e0ae25-dc0b-4f19-bb1e-1c0599ae7a2f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:34.360788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4e0ae25-dc0b-4f19-bb1e-1c0599ae7a2f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:34.362622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4e0ae25-dc0b-4f19-bb1e-1c0599ae7a2f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:34.363115 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4e0ae25-dc0b-4f19-bb1e-1c0599ae7a2f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:34.363546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4e0ae25-dc0b-4f19-bb1e-1c0599ae7a2f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:34.382794 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-b4e0ae25-dc0b-4f19-bb1e-1c0599ae7a2f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] HTTP exception thrown: Instance 8d248e06-d37c-4895-85a8-e8c5e412aedb could not be found. Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b4e0ae25-dc0b-4f19-bb1e-1c0599ae7a2f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Request method failure captured: Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/8d248e06-d37c-4895-85a8-e8c5e412aedb HTTP/1.1 Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJEP0irHIBLN8hFWvgLoOKa85E_5AoxCeRoHxKkTt9HdaFmlIYGchkE6q65oBFLP3DgAcUWlzLQgHRTeUGfdJav2RIkb2FS4kv4XxxXu-KkXROe-iYh2upLJXJIuF28hkxxUYg0rmbMG5d0HtmW6B3uJIdcPQo2gv8Pl4EjF30y2Jzg Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: e15fa55f4d4f4b4db6dbb26c0f07c3c4 Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersOnMultiNodesTest-1611524513 Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersOnMultiNodesTest-1611524513 Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: e15fa55f4d4f4b4db6dbb26c0f07c3c4 Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1611524513 Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersOnMultiNodesTest-1611524513-project Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: ed6e5d4d54224bca90954d1ebbd7b7a3 Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersOnMultiNodesTest-1611524513-project Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 8d248e06-d37c-4895-85a8-e8c5e412aedb could not be found. Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '8d248e06-d37c-4895-85a8-e8c5e412aedb'} Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d248e06-d37c-4895-85a8-e8c5e412aedb could not be found. Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d248e06-d37c-4895-85a8-e8c5e412aedb could not be found. Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:34.385051 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:34.389178 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:34.389178 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:34.389178 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:34.389178 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:34.389178 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:34.389178 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d248e06-d37c-4895-85a8-e8c5e412aedb could not be found. Sep 07 12:44:34.389178 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:34.391954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b4e0ae25-dc0b-4f19-bb1e-1c0599ae7a2f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Returning 404 to user: Instance 8d248e06-d37c-4895-85a8-e8c5e412aedb could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:34.393771 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b4e0ae25-dc0b-4f19-bb1e-1c0599ae7a2f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/8d248e06-d37c-4895-85a8-e8c5e412aedb" status: 404 len: 111 microversion: 2.1 time: 0.057897 Sep 07 12:44:34.394385 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1561/3092] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:34 2022] GET /compute/v2.1/servers/8d248e06-d37c-4895-85a8-e8c5e412aedb => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:34.400735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b20bdadb-3e8d-4c39-a7aa-15b5b7afecbc tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:34.401772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b20bdadb-3e8d-4c39-a7aa-15b5b7afecbc tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:34.408557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b20bdadb-3e8d-4c39-a7aa-15b5b7afecbc tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:34.409097 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b20bdadb-3e8d-4c39-a7aa-15b5b7afecbc tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:34.409571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b20bdadb-3e8d-4c39-a7aa-15b5b7afecbc tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:34.410295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b20bdadb-3e8d-4c39-a7aa-15b5b7afecbc tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:34.410939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b20bdadb-3e8d-4c39-a7aa-15b5b7afecbc tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:34.411559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b20bdadb-3e8d-4c39-a7aa-15b5b7afecbc tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:34.593040 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9a9b8499-e09a-48ef-acc2-de6261f31860 tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/9466dab1-056f-4f12-88eb-8c53f033654a" status: 202 len: 0 microversion: 2.1 time: 0.349004 Sep 07 12:44:34.597773 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1532/3093] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:44:34 2022] DELETE /compute/v2.1/os-security-groups/9466dab1-056f-4f12-88eb-8c53f033654a => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:44:34.604205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-14ff97d0-65af-41cb-8e1d-bbf50a956023 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:34.605177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-14ff97d0-65af-41cb-8e1d-bbf50a956023 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:34.612141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ff97d0-65af-41cb-8e1d-bbf50a956023 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:34.612949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ff97d0-65af-41cb-8e1d-bbf50a956023 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:34.613577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ff97d0-65af-41cb-8e1d-bbf50a956023 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:34.614579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ff97d0-65af-41cb-8e1d-bbf50a956023 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:34.615274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ff97d0-65af-41cb-8e1d-bbf50a956023 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:34.615950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ff97d0-65af-41cb-8e1d-bbf50a956023 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:34.736759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b20bdadb-3e8d-4c39-a7aa-15b5b7afecbc tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:34.765292 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b20bdadb-3e8d-4c39-a7aa-15b5b7afecbc tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1314 microversion: 2.1 time: 0.369586 Sep 07 12:44:34.767215 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1562/3094] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:34 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:34.772602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c28e82da-cd02-4bc0-8a97-41ca29f8def3 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:34.773527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c28e82da-cd02-4bc0-8a97-41ca29f8def3 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: f7a91425-0aae-40bb-b720-071ac9ec52f2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:34.786174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c28e82da-cd02-4bc0-8a97-41ca29f8def3 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:34.786986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c28e82da-cd02-4bc0-8a97-41ca29f8def3 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:34.787644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c28e82da-cd02-4bc0-8a97-41ca29f8def3 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:34.788541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c28e82da-cd02-4bc0-8a97-41ca29f8def3 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:34.789331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c28e82da-cd02-4bc0-8a97-41ca29f8def3 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:34.789969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c28e82da-cd02-4bc0-8a97-41ca29f8def3 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:34.915549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-14ff97d0-65af-41cb-8e1d-bbf50a956023 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:34.919739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c28e82da-cd02-4bc0-8a97-41ca29f8def3 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:34.928227 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c28e82da-cd02-4bc0-8a97-41ca29f8def3 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2" status: 200 len: 1284 microversion: 2.1 time: 0.159412 Sep 07 12:44:34.930467 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1563/3095] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:34 2022] GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2 => generated 1284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:34.932068 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-14ff97d0-65af-41cb-8e1d-bbf50a956023 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1364 microversion: 2.1 time: 0.332866 Sep 07 12:44:34.934706 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1533/3096] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:34 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1364 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:34.937509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-724d3c31-3881-41ca-96a5-f54c9e8a3ed9 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:34.943350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-724d3c31-3881-41ca-96a5-f54c9e8a3ed9 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 6762b361-a49e-467e-ba9b-cebfb35d9a58] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:34.958325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-fc4e7fb8-2974-4228-9529-8fdb46210443 req-8d078468-4c0b-4230-ae68-e6f34578a65f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4510b67f-d3c1-4341-a4aa-deda75761799", "name": "network-vif-plugged", "status": "completed", "tag": "29290a05-6053-4199-a000-3cc6b7487504"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:34.964622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-724d3c31-3881-41ca-96a5-f54c9e8a3ed9 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:34.965413 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-724d3c31-3881-41ca-96a5-f54c9e8a3ed9 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:34.966065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-724d3c31-3881-41ca-96a5-f54c9e8a3ed9 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:34.966958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-724d3c31-3881-41ca-96a5-f54c9e8a3ed9 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:34.967586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-724d3c31-3881-41ca-96a5-f54c9e8a3ed9 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:34.968181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-724d3c31-3881-41ca-96a5-f54c9e8a3ed9 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:34.981248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fc4e7fb8-2974-4228-9529-8fdb46210443 req-8d078468-4c0b-4230-ae68-e6f34578a65f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:34.988817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fc4e7fb8-2974-4228-9529-8fdb46210443 req-8d078468-4c0b-4230-ae68-e6f34578a65f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:34.989477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fc4e7fb8-2974-4228-9529-8fdb46210443 req-8d078468-4c0b-4230-ae68-e6f34578a65f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:34.991693 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-724d3c31-3881-41ca-96a5-f54c9e8a3ed9 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] HTTP exception thrown: Instance 6762b361-a49e-467e-ba9b-cebfb35d9a58 could not be found. Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-724d3c31-3881-41ca-96a5-f54c9e8a3ed9 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Request method failure captured: Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/6762b361-a49e-467e-ba9b-cebfb35d9a58 HTTP/1.1 Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJEP0irHIBLN8hFWvgLoOKa85E_5AoxCeRoHxKkTt9HdaFmlIYGchkE6q65oBFLP3DgAcUWlzLQgHRTeUGfdJav2RIkb2FS4kv4XxxXu-KkXROe-iYh2upLJXJIuF28hkxxUYg0rmbMG5d0HtmW6B3uJIdcPQo2gv8Pl4EjF30y2Jzg Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: e15fa55f4d4f4b4db6dbb26c0f07c3c4 Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersOnMultiNodesTest-1611524513 Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersOnMultiNodesTest-1611524513 Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: e15fa55f4d4f4b4db6dbb26c0f07c3c4 Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1611524513 Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersOnMultiNodesTest-1611524513-project Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: ed6e5d4d54224bca90954d1ebbd7b7a3 Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersOnMultiNodesTest-1611524513-project Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 6762b361-a49e-467e-ba9b-cebfb35d9a58 could not be found. Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '6762b361-a49e-467e-ba9b-cebfb35d9a58'} Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6762b361-a49e-467e-ba9b-cebfb35d9a58 could not be found. Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6762b361-a49e-467e-ba9b-cebfb35d9a58 could not be found. Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:34.993515 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:34.998071 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:34.998071 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:34.998071 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:34.998071 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:34.998071 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:34.998071 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6762b361-a49e-467e-ba9b-cebfb35d9a58 could not be found. Sep 07 12:44:34.998071 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:34.999428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-724d3c31-3881-41ca-96a5-f54c9e8a3ed9 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Returning 404 to user: Instance 6762b361-a49e-467e-ba9b-cebfb35d9a58 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:35.000674 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-724d3c31-3881-41ca-96a5-f54c9e8a3ed9 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/6762b361-a49e-467e-ba9b-cebfb35d9a58" status: 404 len: 111 microversion: 2.1 time: 0.069004 Sep 07 12:44:35.001270 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1564/3097] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:34 2022] GET /compute/v2.1/servers/6762b361-a49e-467e-ba9b-cebfb35d9a58 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:35.006119 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-39a4c64f-0e84-462c-9b77-7b67bcedae0a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] Calling method '.version_select at 0x7fc41d20f9d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:35.010734 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-fc4e7fb8-2974-4228-9529-8fdb46210443 req-8d078468-4c0b-4230-ae68-e6f34578a65f service nova] Creating event network-vif-plugged:29290a05-6053-4199-a000-3cc6b7487504 for instance 4510b67f-d3c1-4341-a4aa-deda75761799 on n-h1-852087-9 Sep 07 12:44:35.021687 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-fc4e7fb8-2974-4228-9529-8fdb46210443 req-8d078468-4c0b-4230-ae68-e6f34578a65f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068423 Sep 07 12:44:35.022934 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1534/3098] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:35.029975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c2959ce8-b4c7-427d-917c-f258f15ea6ec tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:35.066608 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c2959ce8-b4c7-427d-917c-f258f15ea6ec tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/d99b666a-2966-46d5-95c8-fbd940b4df0d" status: 204 len: 0 microversion: 2.1 time: 0.037486 Sep 07 12:44:35.067674 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1535/3099] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Sep 7 12:44:35 2022] DELETE /compute/v2.1/os-server-groups/d99b666a-2966-46d5-95c8-fbd940b4df0d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:44:35.077678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a55cade5-d58e-42f4-b58c-88763c4607d3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:35.078632 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a55cade5-d58e-42f4-b58c-88763c4607d3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 65f0a19b-4d7c-4874-accf-9f62a5b48847] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:35.086247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a55cade5-d58e-42f4-b58c-88763c4607d3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:35.086750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a55cade5-d58e-42f4-b58c-88763c4607d3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:35.087368 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a55cade5-d58e-42f4-b58c-88763c4607d3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:35.088330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a55cade5-d58e-42f4-b58c-88763c4607d3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:35.088959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a55cade5-d58e-42f4-b58c-88763c4607d3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:35.089382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a55cade5-d58e-42f4-b58c-88763c4607d3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:35.119702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a55cade5-d58e-42f4-b58c-88763c4607d3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 65f0a19b-4d7c-4874-accf-9f62a5b48847] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:44:35.219189 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a55cade5-d58e-42f4-b58c-88763c4607d3 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "DELETE /compute/v2.1/servers/65f0a19b-4d7c-4874-accf-9f62a5b48847" status: 204 len: 0 microversion: 2.1 time: 0.146288 Sep 07 12:44:35.228402 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1536/3100] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:44:35 2022] DELETE /compute/v2.1/servers/65f0a19b-4d7c-4874-accf-9f62a5b48847 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:44:35.235487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1e1818de-76a6-4d19-929d-a4d897da87ee tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:35.236694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1e1818de-76a6-4d19-929d-a4d897da87ee tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: aa6c3482-9f8e-41a7-8bec-32d428a3ce52] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:35.248293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e1818de-76a6-4d19-929d-a4d897da87ee tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:35.249144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e1818de-76a6-4d19-929d-a4d897da87ee tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:35.249730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e1818de-76a6-4d19-929d-a4d897da87ee tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:35.251630 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e1818de-76a6-4d19-929d-a4d897da87ee tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:35.252256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e1818de-76a6-4d19-929d-a4d897da87ee tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:35.253970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e1818de-76a6-4d19-929d-a4d897da87ee tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:35.288974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1e1818de-76a6-4d19-929d-a4d897da87ee tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: aa6c3482-9f8e-41a7-8bec-32d428a3ce52] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:44:35.352129 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-39a4c64f-0e84-462c-9b77-7b67bcedae0a tempest-SecurityGroupsTestJSON-2082440812 tempest-SecurityGroupsTestJSON-2082440812-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/50f70075-b246-49aa-b148-935adca32a43" status: 202 len: 0 microversion: 2.1 time: 0.349627 Sep 07 12:44:35.356702 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1565/3101] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:44:35 2022] DELETE /compute/v2.1/os-security-groups/50f70075-b246-49aa-b148-935adca32a43 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:44:35.360504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-774dbb24-7e8c-4bec-8727-f8060de5fb7d tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:35.361145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-774dbb24-7e8c-4bec-8727-f8060de5fb7d tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:35.372570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-774dbb24-7e8c-4bec-8727-f8060de5fb7d tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:35.373432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-774dbb24-7e8c-4bec-8727-f8060de5fb7d tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:35.374126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-774dbb24-7e8c-4bec-8727-f8060de5fb7d tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:35.375296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-774dbb24-7e8c-4bec-8727-f8060de5fb7d tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:35.375964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-774dbb24-7e8c-4bec-8727-f8060de5fb7d tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:35.376604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-774dbb24-7e8c-4bec-8727-f8060de5fb7d tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:35.408410 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1e1818de-76a6-4d19-929d-a4d897da87ee tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52" status: 204 len: 0 microversion: 2.1 time: 0.177425 Sep 07 12:44:35.409723 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1537/3102] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:44:35 2022] DELETE /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:44:35.425280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-6828d84d-a1dc-48a1-af6c-fe3a1b35f49a req-7249fdd5-0e07-4da0-9db5-22e7132618b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe", "name": "network-vif-deleted", "tag": "36bd5563-22e8-432a-ab67-ee7f2814dd6d"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:35.445378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6828d84d-a1dc-48a1-af6c-fe3a1b35f49a req-7249fdd5-0e07-4da0-9db5-22e7132618b9 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:35.446385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6828d84d-a1dc-48a1-af6c-fe3a1b35f49a req-7249fdd5-0e07-4da0-9db5-22e7132618b9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:35.446834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6828d84d-a1dc-48a1-af6c-fe3a1b35f49a req-7249fdd5-0e07-4da0-9db5-22e7132618b9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:35.465924 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-6828d84d-a1dc-48a1-af6c-fe3a1b35f49a req-7249fdd5-0e07-4da0-9db5-22e7132618b9 service nova] Creating event network-vif-deleted:36bd5563-22e8-432a-ab67-ee7f2814dd6d for instance 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe on n-h1-852087-9 Sep 07 12:44:35.471081 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-6828d84d-a1dc-48a1-af6c-fe3a1b35f49a req-7249fdd5-0e07-4da0-9db5-22e7132618b9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059507 Sep 07 12:44:35.472343 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1538/3103] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:35.478007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a69fa8cf-c968-491e-a063-9ec6d1e2630b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:35.478731 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a69fa8cf-c968-491e-a063-9ec6d1e2630b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:35.486182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a69fa8cf-c968-491e-a063-9ec6d1e2630b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:35.487029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a69fa8cf-c968-491e-a063-9ec6d1e2630b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:35.487760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a69fa8cf-c968-491e-a063-9ec6d1e2630b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:35.488744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a69fa8cf-c968-491e-a063-9ec6d1e2630b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:35.489462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a69fa8cf-c968-491e-a063-9ec6d1e2630b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:35.490141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a69fa8cf-c968-491e-a063-9ec6d1e2630b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:35.653704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a69fa8cf-c968-491e-a063-9ec6d1e2630b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:35.665107 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a69fa8cf-c968-491e-a063-9ec6d1e2630b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe" status: 200 len: 1457 microversion: 2.1 time: 0.191343 Sep 07 12:44:35.672725 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1539/3104] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:35 2022] GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe => generated 1457 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:35.679962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9a1e8735-1bb1-4c53-8860-8bd085de8f3a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:35.681383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9a1e8735-1bb1-4c53-8860-8bd085de8f3a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 65f0a19b-4d7c-4874-accf-9f62a5b48847] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:35.690053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a1e8735-1bb1-4c53-8860-8bd085de8f3a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:35.690782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a1e8735-1bb1-4c53-8860-8bd085de8f3a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:35.691338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a1e8735-1bb1-4c53-8860-8bd085de8f3a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:35.692147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a1e8735-1bb1-4c53-8860-8bd085de8f3a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:35.692816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a1e8735-1bb1-4c53-8860-8bd085de8f3a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:35.693521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a1e8735-1bb1-4c53-8860-8bd085de8f3a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:35.966074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-774dbb24-7e8c-4bec-8727-f8060de5fb7d tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:35.981170 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-774dbb24-7e8c-4bec-8727-f8060de5fb7d tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1523 microversion: 2.1 time: 0.627038 Sep 07 12:44:36.019227 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1566/3105] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:35 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1523 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:36.047463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2d045c29-3810-432e-a9a5-f8854c3adefe tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:36.048656 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2d045c29-3810-432e-a9a5-f8854c3adefe tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:36.063801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d045c29-3810-432e-a9a5-f8854c3adefe tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:36.064867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d045c29-3810-432e-a9a5-f8854c3adefe tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:36.065743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d045c29-3810-432e-a9a5-f8854c3adefe tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:36.067385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d045c29-3810-432e-a9a5-f8854c3adefe tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:36.068351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d045c29-3810-432e-a9a5-f8854c3adefe tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:36.069037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d045c29-3810-432e-a9a5-f8854c3adefe tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:36.287871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9a1e8735-1bb1-4c53-8860-8bd085de8f3a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:36.298485 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9a1e8735-1bb1-4c53-8860-8bd085de8f3a tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/65f0a19b-4d7c-4874-accf-9f62a5b48847" status: 200 len: 1474 microversion: 2.1 time: 0.624038 Sep 07 12:44:36.303084 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1540/3106] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:35 2022] GET /compute/v2.1/servers/65f0a19b-4d7c-4874-accf-9f62a5b48847 => generated 1474 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:36.314782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0b52b3a7-92e4-480f-9816-e5ed238092c2 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:36.340335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0b52b3a7-92e4-480f-9816-e5ed238092c2 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: f7a91425-0aae-40bb-b720-071ac9ec52f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:36.384918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b52b3a7-92e4-480f-9816-e5ed238092c2 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:36.389808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b52b3a7-92e4-480f-9816-e5ed238092c2 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:36.390730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b52b3a7-92e4-480f-9816-e5ed238092c2 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:36.391936 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b52b3a7-92e4-480f-9816-e5ed238092c2 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:36.392765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b52b3a7-92e4-480f-9816-e5ed238092c2 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:36.398835 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b52b3a7-92e4-480f-9816-e5ed238092c2 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:36.710547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2d045c29-3810-432e-a9a5-f8854c3adefe tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:36.732362 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2d045c29-3810-432e-a9a5-f8854c3adefe tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1314 microversion: 2.1 time: 0.710943 Sep 07 12:44:36.734375 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1567/3107] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:36 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1314 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:36.763582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1faeab8e-5bf4-4c0e-80da-7de59fb82275 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:36.766493 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1faeab8e-5bf4-4c0e-80da-7de59fb82275 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:36.788372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1faeab8e-5bf4-4c0e-80da-7de59fb82275 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:36.790200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1faeab8e-5bf4-4c0e-80da-7de59fb82275 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:36.791344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1faeab8e-5bf4-4c0e-80da-7de59fb82275 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:36.793199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1faeab8e-5bf4-4c0e-80da-7de59fb82275 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:36.795279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1faeab8e-5bf4-4c0e-80da-7de59fb82275 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:36.796473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1faeab8e-5bf4-4c0e-80da-7de59fb82275 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:37.125564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0b52b3a7-92e4-480f-9816-e5ed238092c2 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:37.131237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:44:37.151180 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0b52b3a7-92e4-480f-9816-e5ed238092c2 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2" status: 200 len: 1324 microversion: 2.1 time: 0.834681 Sep 07 12:44:37.164380 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1541/3108] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:36 2022] GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2 => generated 1324 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:37.176721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-362b8e7a-6c53-4161-8516-fb71d4b1267f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:37.177582 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-362b8e7a-6c53-4161-8516-fb71d4b1267f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:37.194255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-362b8e7a-6c53-4161-8516-fb71d4b1267f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:37.194939 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-362b8e7a-6c53-4161-8516-fb71d4b1267f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:37.196293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-362b8e7a-6c53-4161-8516-fb71d4b1267f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:37.197075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-362b8e7a-6c53-4161-8516-fb71d4b1267f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:37.197587 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-362b8e7a-6c53-4161-8516-fb71d4b1267f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:37.198041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-362b8e7a-6c53-4161-8516-fb71d4b1267f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:37.260183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1faeab8e-5bf4-4c0e-80da-7de59fb82275 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:37.285958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-362b8e7a-6c53-4161-8516-fb71d4b1267f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:37.286467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-362b8e7a-6c53-4161-8516-fb71d4b1267f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:37.286922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-362b8e7a-6c53-4161-8516-fb71d4b1267f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:37.287389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-362b8e7a-6c53-4161-8516-fb71d4b1267f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lazy-loading 'fault' on Instance uuid 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:44:37.291916 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1faeab8e-5bf4-4c0e-80da-7de59fb82275 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1364 microversion: 2.1 time: 0.536077 Sep 07 12:44:37.297809 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1568/3109] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:36 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1364 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:37.312745 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-257f26fd-69e6-4373-a11a-e4b6f6ab2ba8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:37.313568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-257f26fd-69e6-4373-a11a-e4b6f6ab2ba8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:37.356091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-257f26fd-69e6-4373-a11a-e4b6f6ab2ba8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:37.356993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-257f26fd-69e6-4373-a11a-e4b6f6ab2ba8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:37.357902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-257f26fd-69e6-4373-a11a-e4b6f6ab2ba8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:37.359544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-257f26fd-69e6-4373-a11a-e4b6f6ab2ba8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:37.360678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-257f26fd-69e6-4373-a11a-e4b6f6ab2ba8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:37.362037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-257f26fd-69e6-4373-a11a-e4b6f6ab2ba8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:37.395133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-362b8e7a-6c53-4161-8516-fb71d4b1267f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b920811be01745fc9faea7a9ce213c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5b2dd007e944358d72268414868096', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:37.408553 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-362b8e7a-6c53-4161-8516-fb71d4b1267f tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe" status: 200 len: 1305 microversion: 2.1 time: 0.242575 Sep 07 12:44:37.410972 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1542/3110] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:37 2022] GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe => generated 1305 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:37.419762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1aeaaa1d-f5b8-4b51-b4ee-e12881619fde tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:37.421344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1aeaaa1d-f5b8-4b51-b4ee-e12881619fde tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 65f0a19b-4d7c-4874-accf-9f62a5b48847] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:37.434575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aeaaa1d-f5b8-4b51-b4ee-e12881619fde tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:37.435543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aeaaa1d-f5b8-4b51-b4ee-e12881619fde tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:37.436367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aeaaa1d-f5b8-4b51-b4ee-e12881619fde tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:37.437730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aeaaa1d-f5b8-4b51-b4ee-e12881619fde tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:37.438703 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aeaaa1d-f5b8-4b51-b4ee-e12881619fde tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:37.439403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1aeaaa1d-f5b8-4b51-b4ee-e12881619fde tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:37.686986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-257f26fd-69e6-4373-a11a-e4b6f6ab2ba8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:37.710967 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-257f26fd-69e6-4373-a11a-e4b6f6ab2ba8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1523 microversion: 2.1 time: 0.408812 Sep 07 12:44:37.719497 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1aeaaa1d-f5b8-4b51-b4ee-e12881619fde tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:37.732574 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1aeaaa1d-f5b8-4b51-b4ee-e12881619fde tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/65f0a19b-4d7c-4874-accf-9f62a5b48847" status: 200 len: 1474 microversion: 2.1 time: 0.319829 Sep 07 12:44:37.733379 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1543/3112] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:37 2022] GET /compute/v2.1/servers/65f0a19b-4d7c-4874-accf-9f62a5b48847 => generated 1474 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:37.736405 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1569/3112] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:37 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1523 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:37.762748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6efcef71-94cf-43c5-aa19-a44f3aedc4b1 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:37.763889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6efcef71-94cf-43c5-aa19-a44f3aedc4b1 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:37.774982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6efcef71-94cf-43c5-aa19-a44f3aedc4b1 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:37.775545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6efcef71-94cf-43c5-aa19-a44f3aedc4b1 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:37.776135 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6efcef71-94cf-43c5-aa19-a44f3aedc4b1 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:37.776961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6efcef71-94cf-43c5-aa19-a44f3aedc4b1 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:37.777543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6efcef71-94cf-43c5-aa19-a44f3aedc4b1 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:37.778064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6efcef71-94cf-43c5-aa19-a44f3aedc4b1 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:38.012247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6efcef71-94cf-43c5-aa19-a44f3aedc4b1 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:38.024028 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6efcef71-94cf-43c5-aa19-a44f3aedc4b1 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1314 microversion: 2.1 time: 0.269164 Sep 07 12:44:38.025746 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1544/3113] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:37 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:44:38.188064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-af3cd8e7-081e-4d8b-a8ad-2c6527c6da75 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:38.189128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-af3cd8e7-081e-4d8b-a8ad-2c6527c6da75 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: f7a91425-0aae-40bb-b720-071ac9ec52f2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:38.200967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af3cd8e7-081e-4d8b-a8ad-2c6527c6da75 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:38.202213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af3cd8e7-081e-4d8b-a8ad-2c6527c6da75 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:38.203014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af3cd8e7-081e-4d8b-a8ad-2c6527c6da75 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:38.204740 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af3cd8e7-081e-4d8b-a8ad-2c6527c6da75 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:38.206019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af3cd8e7-081e-4d8b-a8ad-2c6527c6da75 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:38.207077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af3cd8e7-081e-4d8b-a8ad-2c6527c6da75 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:38.316118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-6edef3b7-0922-4cb5-b0a7-556db26fac58 req-51cddbba-7c89-4af3-bcea-4d44f9737bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edf38c92-ffc2-492b-8642-88ca59537acd", "name": "network-vif-plugged", "status": "completed", "tag": "23b18fbd-594f-42e0-a655-6b5f01607b28"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:38.333977 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6edef3b7-0922-4cb5-b0a7-556db26fac58 req-51cddbba-7c89-4af3-bcea-4d44f9737bb4 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:38.335377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6edef3b7-0922-4cb5-b0a7-556db26fac58 req-51cddbba-7c89-4af3-bcea-4d44f9737bb4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:38.336051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6edef3b7-0922-4cb5-b0a7-556db26fac58 req-51cddbba-7c89-4af3-bcea-4d44f9737bb4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:38.355968 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-6edef3b7-0922-4cb5-b0a7-556db26fac58 req-51cddbba-7c89-4af3-bcea-4d44f9737bb4 service nova] Creating event network-vif-plugged:23b18fbd-594f-42e0-a655-6b5f01607b28 for instance edf38c92-ffc2-492b-8642-88ca59537acd on n-h1-852087-9 Sep 07 12:44:38.377618 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-6edef3b7-0922-4cb5-b0a7-556db26fac58 req-51cddbba-7c89-4af3-bcea-4d44f9737bb4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065794 Sep 07 12:44:38.379166 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1545/3114] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:44:38.396515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c6122760-d126-4bf6-9bc4-4c70d5b1f6bc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:38.397752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c6122760-d126-4bf6-9bc4-4c70d5b1f6bc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:38.417285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6122760-d126-4bf6-9bc4-4c70d5b1f6bc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:38.417979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6122760-d126-4bf6-9bc4-4c70d5b1f6bc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:38.418441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6122760-d126-4bf6-9bc4-4c70d5b1f6bc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:38.419224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6122760-d126-4bf6-9bc4-4c70d5b1f6bc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:38.419844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6122760-d126-4bf6-9bc4-4c70d5b1f6bc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:38.422705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6122760-d126-4bf6-9bc4-4c70d5b1f6bc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:38.657618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-af3cd8e7-081e-4d8b-a8ad-2c6527c6da75 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:38.661545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:44:38.673201 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-af3cd8e7-081e-4d8b-a8ad-2c6527c6da75 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2" status: 200 len: 1324 microversion: 2.1 time: 0.491375 Sep 07 12:44:38.674250 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1570/3115] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:38 2022] GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2 => generated 1324 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:44:38.680815 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1393313d-4306-4ebe-8a17-fc5cab961bdb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:38.681804 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1393313d-4306-4ebe-8a17-fc5cab961bdb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:38.688772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1393313d-4306-4ebe-8a17-fc5cab961bdb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:38.690135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1393313d-4306-4ebe-8a17-fc5cab961bdb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:38.690905 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1393313d-4306-4ebe-8a17-fc5cab961bdb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:38.691914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1393313d-4306-4ebe-8a17-fc5cab961bdb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:38.692569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1393313d-4306-4ebe-8a17-fc5cab961bdb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:38.693172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1393313d-4306-4ebe-8a17-fc5cab961bdb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:38.719211 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-1393313d-4306-4ebe-8a17-fc5cab961bdb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] HTTP exception thrown: Instance 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe could not be found. Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1393313d-4306-4ebe-8a17-fc5cab961bdb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Request method failure captured: Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe HTTP/1.1 Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJBoiaP7MPiSaP6e6aUmMJ8PuR8TxD72E3ycIsoyb5pICiti0ZKBvrRvNoP9EgDHIO9YzOUucG9iu3oQZMsvYh9Gs4g9xjGSFcMGctGxplJk2OO0Aofdu3Ru80K0M86m3EPIBI5c12Fca4rxAASE3osSSig78ynw4pFvNNSiXm2zkBk Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef5b2dd007e944358d72268414868096"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef5b2dd007e944358d72268414868096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: b920811be01745fc9faea7a9ce213c6e Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe could not be found. Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe'} Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe could not be found. Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe could not be found. Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:38.721164 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:38.725869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:38.725869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:38.725869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:38.725869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:38.725869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:38.725869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe could not be found. Sep 07 12:44:38.725869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:38.727295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1393313d-4306-4ebe-8a17-fc5cab961bdb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Returning 404 to user: Instance 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:38.728509 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1393313d-4306-4ebe-8a17-fc5cab961bdb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe" status: 404 len: 111 microversion: 2.1 time: 0.052963 Sep 07 12:44:38.729621 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1571/3116] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:38 2022] GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:38.747400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cd1844ba-04c7-47e2-b45f-5900ca293346 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:38.748292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cd1844ba-04c7-47e2-b45f-5900ca293346 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:38.757062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd1844ba-04c7-47e2-b45f-5900ca293346 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:38.757936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd1844ba-04c7-47e2-b45f-5900ca293346 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:38.758475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd1844ba-04c7-47e2-b45f-5900ca293346 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:38.759312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd1844ba-04c7-47e2-b45f-5900ca293346 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:38.759876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd1844ba-04c7-47e2-b45f-5900ca293346 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:38.760399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd1844ba-04c7-47e2-b45f-5900ca293346 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:38.784812 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-cd1844ba-04c7-47e2-b45f-5900ca293346 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] HTTP exception thrown: Instance 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe could not be found. Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cd1844ba-04c7-47e2-b45f-5900ca293346 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Request method failure captured: Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe HTTP/1.1 Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJBoiaP7MPiSaP6e6aUmMJ8PuR8TxD72E3ycIsoyb5pICiti0ZKBvrRvNoP9EgDHIO9YzOUucG9iu3oQZMsvYh9Gs4g9xjGSFcMGctGxplJk2OO0Aofdu3Ru80K0M86m3EPIBI5c12Fca4rxAASE3osSSig78ynw4pFvNNSiXm2zkBk Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef5b2dd007e944358d72268414868096"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef5b2dd007e944358d72268414868096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: b920811be01745fc9faea7a9ce213c6e Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe could not be found. Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe'} Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe could not be found. Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:38.788486 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:38.797254 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe could not be found. Sep 07 12:44:38.797254 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:38.797254 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:38.797254 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:38.797254 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:38.797254 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:38.797254 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:38.797254 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:38.797254 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:38.797254 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe could not be found. Sep 07 12:44:38.797254 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:38.797254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cd1844ba-04c7-47e2-b45f-5900ca293346 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Returning 404 to user: Instance 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:38.797254 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cd1844ba-04c7-47e2-b45f-5900ca293346 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "DELETE /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe" status: 404 len: 111 microversion: 2.1 time: 0.054412 Sep 07 12:44:38.804048 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1572/3117] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:44:38 2022] DELETE /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:44:38.808375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6355f6df-ccfe-47c7-a9c4-e3ac13ed5061 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:38.810146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6355f6df-ccfe-47c7-a9c4-e3ac13ed5061 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:38.820611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6355f6df-ccfe-47c7-a9c4-e3ac13ed5061 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:38.821448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6355f6df-ccfe-47c7-a9c4-e3ac13ed5061 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:38.822555 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6355f6df-ccfe-47c7-a9c4-e3ac13ed5061 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:38.823990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6355f6df-ccfe-47c7-a9c4-e3ac13ed5061 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:38.824814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6355f6df-ccfe-47c7-a9c4-e3ac13ed5061 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:38.825637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6355f6df-ccfe-47c7-a9c4-e3ac13ed5061 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:38.828668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c6122760-d126-4bf6-9bc4-4c70d5b1f6bc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:38.840663 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c6122760-d126-4bf6-9bc4-4c70d5b1f6bc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1364 microversion: 2.1 time: 0.459258 Sep 07 12:44:38.855105 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1546/3118] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:38 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1364 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:38.869031 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-abb31b1e-7aa1-413b-9c71-52e8af155e56 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:38.870396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-abb31b1e-7aa1-413b-9c71-52e8af155e56 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 65f0a19b-4d7c-4874-accf-9f62a5b48847] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:38.884402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abb31b1e-7aa1-413b-9c71-52e8af155e56 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:38.885116 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abb31b1e-7aa1-413b-9c71-52e8af155e56 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:38.885857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abb31b1e-7aa1-413b-9c71-52e8af155e56 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:38.887856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abb31b1e-7aa1-413b-9c71-52e8af155e56 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:38.888635 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abb31b1e-7aa1-413b-9c71-52e8af155e56 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:38.889324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abb31b1e-7aa1-413b-9c71-52e8af155e56 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:39.563268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6355f6df-ccfe-47c7-a9c4-e3ac13ed5061 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:39.580042 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6355f6df-ccfe-47c7-a9c4-e3ac13ed5061 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1523 microversion: 2.1 time: 0.773813 Sep 07 12:44:39.581395 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1573/3119] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:38 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1523 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:39.586451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f383c051-532b-4986-99e2-e4740b045a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:39.590409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f383c051-532b-4986-99e2-e4740b045a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:39.604108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f383c051-532b-4986-99e2-e4740b045a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:39.610371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f383c051-532b-4986-99e2-e4740b045a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:39.611091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f383c051-532b-4986-99e2-e4740b045a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:39.612229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f383c051-532b-4986-99e2-e4740b045a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:39.612861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f383c051-532b-4986-99e2-e4740b045a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:39.613506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f383c051-532b-4986-99e2-e4740b045a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:39.642000 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-f383c051-532b-4986-99e2-e4740b045a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] HTTP exception thrown: Instance 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe could not be found. Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f383c051-532b-4986-99e2-e4740b045a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Request method failure captured: Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe HTTP/1.1 Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJBoiaP7MPiSaP6e6aUmMJ8PuR8TxD72E3ycIsoyb5pICiti0ZKBvrRvNoP9EgDHIO9YzOUucG9iu3oQZMsvYh9Gs4g9xjGSFcMGctGxplJk2OO0Aofdu3Ru80K0M86m3EPIBI5c12Fca4rxAASE3osSSig78ynw4pFvNNSiXm2zkBk Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef5b2dd007e944358d72268414868096"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef5b2dd007e944358d72268414868096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: b920811be01745fc9faea7a9ce213c6e Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe could not be found. Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe'} Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe could not be found. Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe could not be found. Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:39.655527 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:39.660042 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:39.660042 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:39.660042 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:39.660042 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:39.660042 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:39.660042 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe could not be found. Sep 07 12:44:39.660042 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:39.661957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f383c051-532b-4986-99e2-e4740b045a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Returning 404 to user: Instance 351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:39.663089 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f383c051-532b-4986-99e2-e4740b045a4a tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe" status: 404 len: 111 microversion: 2.1 time: 0.080526 Sep 07 12:44:39.664184 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1574/3120] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:39 2022] GET /compute/v2.1/servers/351c1bdf-305d-4eeb-9a70-0d8a2c9a90fe => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:39.669379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a1f5bd0c-c40d-4071-b995-65be6bd33caa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:39.670474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a1f5bd0c-c40d-4071-b995-65be6bd33caa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:39.688792 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1f5bd0c-c40d-4071-b995-65be6bd33caa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:39.689295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1f5bd0c-c40d-4071-b995-65be6bd33caa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:39.689776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1f5bd0c-c40d-4071-b995-65be6bd33caa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:39.690598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1f5bd0c-c40d-4071-b995-65be6bd33caa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:39.691078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1f5bd0c-c40d-4071-b995-65be6bd33caa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:39.691518 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1f5bd0c-c40d-4071-b995-65be6bd33caa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:39.698800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-abb31b1e-7aa1-413b-9c71-52e8af155e56 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:39.708472 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-abb31b1e-7aa1-413b-9c71-52e8af155e56 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/65f0a19b-4d7c-4874-accf-9f62a5b48847" status: 200 len: 1474 microversion: 2.1 time: 0.849589 Sep 07 12:44:39.719306 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1547/3121] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:38 2022] GET /compute/v2.1/servers/65f0a19b-4d7c-4874-accf-9f62a5b48847 => generated 1474 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:39.724839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ace547f-3e76-49aa-9b78-5f4ce7c435a9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:39.725722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8ace547f-3e76-49aa-9b78-5f4ce7c435a9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:39.741089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ace547f-3e76-49aa-9b78-5f4ce7c435a9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:39.742018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ace547f-3e76-49aa-9b78-5f4ce7c435a9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:39.742677 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ace547f-3e76-49aa-9b78-5f4ce7c435a9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:39.754578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ace547f-3e76-49aa-9b78-5f4ce7c435a9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:39.755436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ace547f-3e76-49aa-9b78-5f4ce7c435a9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:39.756088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ace547f-3e76-49aa-9b78-5f4ce7c435a9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:39.774008 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-8ace547f-3e76-49aa-9b78-5f4ce7c435a9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] HTTP exception thrown: Instance 0850dcd6-d5e3-4cea-bcdf-0105880bbc08 could not be found. Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ace547f-3e76-49aa-9b78-5f4ce7c435a9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Request method failure captured: Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 HTTP/1.1 Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJBoiaP7MPiSaP6e6aUmMJ8PuR8TxD72E3ycIsoyb5pICiti0ZKBvrRvNoP9EgDHIO9YzOUucG9iu3oQZMsvYh9Gs4g9xjGSFcMGctGxplJk2OO0Aofdu3Ru80K0M86m3EPIBI5c12Fca4rxAASE3osSSig78ynw4pFvNNSiXm2zkBk Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef5b2dd007e944358d72268414868096"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef5b2dd007e944358d72268414868096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: b920811be01745fc9faea7a9ce213c6e Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 0850dcd6-d5e3-4cea-bcdf-0105880bbc08 could not be found. Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '0850dcd6-d5e3-4cea-bcdf-0105880bbc08'} Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0850dcd6-d5e3-4cea-bcdf-0105880bbc08 could not be found. Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:39.776188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:39.780284 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0850dcd6-d5e3-4cea-bcdf-0105880bbc08 could not be found. Sep 07 12:44:39.780284 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:39.780284 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:39.780284 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:39.780284 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:39.780284 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:39.780284 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:39.780284 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:39.780284 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:39.780284 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0850dcd6-d5e3-4cea-bcdf-0105880bbc08 could not be found. Sep 07 12:44:39.780284 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:39.782451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ace547f-3e76-49aa-9b78-5f4ce7c435a9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Returning 404 to user: Instance 0850dcd6-d5e3-4cea-bcdf-0105880bbc08 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:39.783748 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8ace547f-3e76-49aa-9b78-5f4ce7c435a9 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 404 len: 111 microversion: 2.1 time: 0.062945 Sep 07 12:44:39.788106 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1548/3122] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:44:39 2022] DELETE /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:39.793688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2edcfc66-854e-41d6-a71a-d9432a4708dd tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:39.794739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2edcfc66-854e-41d6-a71a-d9432a4708dd tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: f7a91425-0aae-40bb-b720-071ac9ec52f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:39.802386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2edcfc66-854e-41d6-a71a-d9432a4708dd tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:39.803300 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2edcfc66-854e-41d6-a71a-d9432a4708dd tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:39.803965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2edcfc66-854e-41d6-a71a-d9432a4708dd tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:39.804930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2edcfc66-854e-41d6-a71a-d9432a4708dd tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:39.805692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2edcfc66-854e-41d6-a71a-d9432a4708dd tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:39.806364 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2edcfc66-854e-41d6-a71a-d9432a4708dd tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:40.898604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a1f5bd0c-c40d-4071-b995-65be6bd33caa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:40.936574 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a1f5bd0c-c40d-4071-b995-65be6bd33caa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1500 microversion: 2.1 time: 1.270546 Sep 07 12:44:40.938003 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1575/3123] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:39 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1500 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:40.962794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b4db6fe-50ff-4882-a49f-01ec8472567d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:40.966720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2b4db6fe-50ff-4882-a49f-01ec8472567d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 0850dcd6-d5e3-4cea-bcdf-0105880bbc08] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:40.994885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b4db6fe-50ff-4882-a49f-01ec8472567d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:40.995557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b4db6fe-50ff-4882-a49f-01ec8472567d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:41.000749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b4db6fe-50ff-4882-a49f-01ec8472567d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:41.001833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b4db6fe-50ff-4882-a49f-01ec8472567d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:41.004606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b4db6fe-50ff-4882-a49f-01ec8472567d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:41.005397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b4db6fe-50ff-4882-a49f-01ec8472567d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:41.039701 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-2b4db6fe-50ff-4882-a49f-01ec8472567d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] HTTP exception thrown: Instance 0850dcd6-d5e3-4cea-bcdf-0105880bbc08 could not be found. Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b4db6fe-50ff-4882-a49f-01ec8472567d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Request method failure captured: Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 HTTP/1.1 Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJBoiaP7MPiSaP6e6aUmMJ8PuR8TxD72E3ycIsoyb5pICiti0ZKBvrRvNoP9EgDHIO9YzOUucG9iu3oQZMsvYh9Gs4g9xjGSFcMGctGxplJk2OO0Aofdu3Ru80K0M86m3EPIBI5c12Fca4rxAASE3osSSig78ynw4pFvNNSiXm2zkBk Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef5b2dd007e944358d72268414868096"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef5b2dd007e944358d72268414868096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: b920811be01745fc9faea7a9ce213c6e Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 0850dcd6-d5e3-4cea-bcdf-0105880bbc08 could not be found. Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '0850dcd6-d5e3-4cea-bcdf-0105880bbc08'} Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0850dcd6-d5e3-4cea-bcdf-0105880bbc08 could not be found. Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0850dcd6-d5e3-4cea-bcdf-0105880bbc08 could not be found. Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:41.043297 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:41.051633 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:41.051633 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:41.051633 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:41.051633 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:41.051633 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:41.051633 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0850dcd6-d5e3-4cea-bcdf-0105880bbc08 could not be found. Sep 07 12:44:41.051633 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:41.054295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b4db6fe-50ff-4882-a49f-01ec8472567d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Returning 404 to user: Instance 0850dcd6-d5e3-4cea-bcdf-0105880bbc08 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:41.057968 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2b4db6fe-50ff-4882-a49f-01ec8472567d tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08" status: 404 len: 111 microversion: 2.1 time: 0.116656 Sep 07 12:44:41.064461 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1576/3124] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:40 2022] GET /compute/v2.1/servers/0850dcd6-d5e3-4cea-bcdf-0105880bbc08 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:41.074635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8c059fd7-a789-4ecc-9ef0-fda8808d8ff7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:41.076692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8c059fd7-a789-4ecc-9ef0-fda8808d8ff7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:41.088587 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c059fd7-a789-4ecc-9ef0-fda8808d8ff7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:41.090021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c059fd7-a789-4ecc-9ef0-fda8808d8ff7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:41.091065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c059fd7-a789-4ecc-9ef0-fda8808d8ff7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:41.092598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c059fd7-a789-4ecc-9ef0-fda8808d8ff7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:41.093698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c059fd7-a789-4ecc-9ef0-fda8808d8ff7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:41.094779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c059fd7-a789-4ecc-9ef0-fda8808d8ff7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:41.861571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2edcfc66-854e-41d6-a71a-d9432a4708dd tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:41.923279 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2edcfc66-854e-41d6-a71a-d9432a4708dd tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2" status: 200 len: 1324 microversion: 2.1 time: 2.133541 Sep 07 12:44:41.930997 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1549/3125] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:39 2022] GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2 => generated 1324 bytes in 2142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:41.938208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-186006e9-010b-451f-ae20-45a5c6dc83d1 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:41.940290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-186006e9-010b-451f-ae20-45a5c6dc83d1 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:41.961550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-186006e9-010b-451f-ae20-45a5c6dc83d1 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:41.962836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-186006e9-010b-451f-ae20-45a5c6dc83d1 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:41.964027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-186006e9-010b-451f-ae20-45a5c6dc83d1 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:41.965901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-186006e9-010b-451f-ae20-45a5c6dc83d1 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:41.966480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-186006e9-010b-451f-ae20-45a5c6dc83d1 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:41.966931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-186006e9-010b-451f-ae20-45a5c6dc83d1 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:42.088683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8c059fd7-a789-4ecc-9ef0-fda8808d8ff7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:42.110120 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8c059fd7-a789-4ecc-9ef0-fda8808d8ff7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1550 microversion: 2.1 time: 1.043222 Sep 07 12:44:42.112126 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1577/3126] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:41 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1550 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:42.135107 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b1d656d6-0a6d-4a4e-b5ad-ce8a6004f15b tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:42.136200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b1d656d6-0a6d-4a4e-b5ad-ce8a6004f15b tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 65f0a19b-4d7c-4874-accf-9f62a5b48847] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:42.160087 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1d656d6-0a6d-4a4e-b5ad-ce8a6004f15b tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:42.161026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1d656d6-0a6d-4a4e-b5ad-ce8a6004f15b tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:42.161635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1d656d6-0a6d-4a4e-b5ad-ce8a6004f15b tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:42.162775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1d656d6-0a6d-4a4e-b5ad-ce8a6004f15b tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:42.163362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1d656d6-0a6d-4a4e-b5ad-ce8a6004f15b tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:42.164051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1d656d6-0a6d-4a4e-b5ad-ce8a6004f15b tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:42.472090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b1d656d6-0a6d-4a4e-b5ad-ce8a6004f15b tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:42.486564 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b1d656d6-0a6d-4a4e-b5ad-ce8a6004f15b tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/65f0a19b-4d7c-4874-accf-9f62a5b48847" status: 200 len: 1304 microversion: 2.1 time: 0.366489 Sep 07 12:44:42.489089 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1578/3127] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:42 2022] GET /compute/v2.1/servers/65f0a19b-4d7c-4874-accf-9f62a5b48847 => generated 1304 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:42.515876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:44:42.524438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3e0f0ccd-794e-42b1-96a1-3cff5aeb6b19 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:42.539544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3e0f0ccd-794e-42b1-96a1-3cff5aeb6b19 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:42.543303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:44:42.577129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e0f0ccd-794e-42b1-96a1-3cff5aeb6b19 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:42.579907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e0f0ccd-794e-42b1-96a1-3cff5aeb6b19 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:42.580830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e0f0ccd-794e-42b1-96a1-3cff5aeb6b19 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:42.589395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e0f0ccd-794e-42b1-96a1-3cff5aeb6b19 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:42.594264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e0f0ccd-794e-42b1-96a1-3cff5aeb6b19 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:42.595025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e0f0ccd-794e-42b1-96a1-3cff5aeb6b19 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:42.646441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-3e0f0ccd-794e-42b1-96a1-3cff5aeb6b19 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lazy-loading 'flavor' on Instance uuid 4510b67f-d3c1-4341-a4aa-deda75761799 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:44:42.811110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-186006e9-010b-451f-ae20-45a5c6dc83d1 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:42.847176 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-186006e9-010b-451f-ae20-45a5c6dc83d1 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1523 microversion: 2.1 time: 0.912096 Sep 07 12:44:42.852117 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1550/3128] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:41 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1523 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:42.873166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8a062072-8637-4427-845b-2ee21e35eebb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:42.874945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8a062072-8637-4427-845b-2ee21e35eebb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:42.914543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a062072-8637-4427-845b-2ee21e35eebb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:42.915419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a062072-8637-4427-845b-2ee21e35eebb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:42.919344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a062072-8637-4427-845b-2ee21e35eebb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:42.921391 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a062072-8637-4427-845b-2ee21e35eebb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:42.923067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a062072-8637-4427-845b-2ee21e35eebb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:42.924443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a062072-8637-4427-845b-2ee21e35eebb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:42.936102 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3e0f0ccd-794e-42b1-96a1-3cff5aeb6b19 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "POST /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799/action" status: 200 len: 32 microversion: 2.1 time: 0.434137 Sep 07 12:44:42.941928 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1579/3129] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:44:42 2022] POST /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799/action => generated 32 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:44:42.956224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-7ec0f54c-c548-499e-96b1-b6a94eeb128f req-bc0846a4-42f8-487d-9b8b-f49548bd2d2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65f0a19b-4d7c-4874-accf-9f62a5b48847", "name": "network-vif-deleted", "tag": "033af800-eb84-4289-a20f-9c09295fd2fd"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:42.972922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7ec0f54c-c548-499e-96b1-b6a94eeb128f req-bc0846a4-42f8-487d-9b8b-f49548bd2d2e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:42.973638 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7ec0f54c-c548-499e-96b1-b6a94eeb128f req-bc0846a4-42f8-487d-9b8b-f49548bd2d2e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:42.974223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7ec0f54c-c548-499e-96b1-b6a94eeb128f req-bc0846a4-42f8-487d-9b8b-f49548bd2d2e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:42.980863 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-8a062072-8637-4427-845b-2ee21e35eebb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] HTTP exception thrown: Instance 9b8d74fd-0b94-465e-a644-a44170def51c could not be found. Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8a062072-8637-4427-845b-2ee21e35eebb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Request method failure captured: Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c HTTP/1.1 Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJBoiaP7MPiSaP6e6aUmMJ8PuR8TxD72E3ycIsoyb5pICiti0ZKBvrRvNoP9EgDHIO9YzOUucG9iu3oQZMsvYh9Gs4g9xjGSFcMGctGxplJk2OO0Aofdu3Ru80K0M86m3EPIBI5c12Fca4rxAASE3osSSig78ynw4pFvNNSiXm2zkBk Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef5b2dd007e944358d72268414868096"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef5b2dd007e944358d72268414868096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: b920811be01745fc9faea7a9ce213c6e Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 9b8d74fd-0b94-465e-a644-a44170def51c could not be found. Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '9b8d74fd-0b94-465e-a644-a44170def51c'} Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b8d74fd-0b94-465e-a644-a44170def51c could not be found. Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:42.985315 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:42.990449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b8d74fd-0b94-465e-a644-a44170def51c could not be found. Sep 07 12:44:42.990449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:42.990449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:42.990449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:42.990449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:42.990449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:42.990449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:42.990449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:42.990449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:42.990449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b8d74fd-0b94-465e-a644-a44170def51c could not be found. Sep 07 12:44:42.990449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:42.992068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8a062072-8637-4427-845b-2ee21e35eebb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Returning 404 to user: Instance 9b8d74fd-0b94-465e-a644-a44170def51c could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:42.995909 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8a062072-8637-4427-845b-2ee21e35eebb tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 404 len: 111 microversion: 2.1 time: 0.140316 Sep 07 12:44:42.997987 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7ec0f54c-c548-499e-96b1-b6a94eeb128f req-bc0846a4-42f8-487d-9b8b-f49548bd2d2e service nova] Creating event network-vif-deleted:033af800-eb84-4289-a20f-9c09295fd2fd for instance 65f0a19b-4d7c-4874-accf-9f62a5b48847 on n-h2-852087-9 Sep 07 12:44:43.003282 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1551/3130] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:44:42 2022] DELETE /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:43.009889 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-7ec0f54c-c548-499e-96b1-b6a94eeb128f req-bc0846a4-42f8-487d-9b8b-f49548bd2d2e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065350 Sep 07 12:44:43.010852 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1580/3131] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:43.018073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eccaabb2-2b60-47a5-bc69-efaf8098ad3b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:43.018965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-eccaabb2-2b60-47a5-bc69-efaf8098ad3b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:43.023412 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c8d5d4ab-8334-4d4a-b08a-49f9971cf2ad tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:43.026857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c8d5d4ab-8334-4d4a-b08a-49f9971cf2ad tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:43.036086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eccaabb2-2b60-47a5-bc69-efaf8098ad3b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:43.039798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eccaabb2-2b60-47a5-bc69-efaf8098ad3b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:43.040614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eccaabb2-2b60-47a5-bc69-efaf8098ad3b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:43.043708 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eccaabb2-2b60-47a5-bc69-efaf8098ad3b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:43.047041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eccaabb2-2b60-47a5-bc69-efaf8098ad3b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:43.048029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eccaabb2-2b60-47a5-bc69-efaf8098ad3b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:43.048289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8d5d4ab-8334-4d4a-b08a-49f9971cf2ad tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:43.051786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8d5d4ab-8334-4d4a-b08a-49f9971cf2ad tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:43.052712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8d5d4ab-8334-4d4a-b08a-49f9971cf2ad tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:43.054052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8d5d4ab-8334-4d4a-b08a-49f9971cf2ad tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:43.054793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8d5d4ab-8334-4d4a-b08a-49f9971cf2ad tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:43.057913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8d5d4ab-8334-4d4a-b08a-49f9971cf2ad tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:43.303564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:44:43.614777 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eccaabb2-2b60-47a5-bc69-efaf8098ad3b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.608280 Sep 07 12:44:43.615411 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1552/3132] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Sep 7 12:44:43 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/os-interface => generated 284 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:43.622588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3a4f5f97-37f5-49cd-9b99-37c18427080f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:43.623236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3a4f5f97-37f5-49cd-9b99-37c18427080f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: f7a91425-0aae-40bb-b720-071ac9ec52f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:43.639493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a4f5f97-37f5-49cd-9b99-37c18427080f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:43.640018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a4f5f97-37f5-49cd-9b99-37c18427080f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:43.640690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a4f5f97-37f5-49cd-9b99-37c18427080f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:43.642381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a4f5f97-37f5-49cd-9b99-37c18427080f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:43.643245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a4f5f97-37f5-49cd-9b99-37c18427080f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:43.643986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a4f5f97-37f5-49cd-9b99-37c18427080f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:43.937382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c8d5d4ab-8334-4d4a-b08a-49f9971cf2ad tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:43.951636 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c8d5d4ab-8334-4d4a-b08a-49f9971cf2ad tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1506 microversion: 2.1 time: 0.939402 Sep 07 12:44:43.954456 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1581/3133] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:43 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1506 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:43.974239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-db426119-b034-4e8e-ba2c-4a01570dc183 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:43.975226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-db426119-b034-4e8e-ba2c-4a01570dc183 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 9b8d74fd-0b94-465e-a644-a44170def51c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:43.989848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db426119-b034-4e8e-ba2c-4a01570dc183 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:43.990356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db426119-b034-4e8e-ba2c-4a01570dc183 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:43.990873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db426119-b034-4e8e-ba2c-4a01570dc183 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:43.991511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db426119-b034-4e8e-ba2c-4a01570dc183 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:43.996117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db426119-b034-4e8e-ba2c-4a01570dc183 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:43.996596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-db426119-b034-4e8e-ba2c-4a01570dc183 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:44.034653 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-db426119-b034-4e8e-ba2c-4a01570dc183 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] HTTP exception thrown: Instance 9b8d74fd-0b94-465e-a644-a44170def51c could not be found. Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-db426119-b034-4e8e-ba2c-4a01570dc183 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Request method failure captured: Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c HTTP/1.1 Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJBoiaP7MPiSaP6e6aUmMJ8PuR8TxD72E3ycIsoyb5pICiti0ZKBvrRvNoP9EgDHIO9YzOUucG9iu3oQZMsvYh9Gs4g9xjGSFcMGctGxplJk2OO0Aofdu3Ru80K0M86m3EPIBI5c12Fca4rxAASE3osSSig78ynw4pFvNNSiXm2zkBk Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef5b2dd007e944358d72268414868096"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef5b2dd007e944358d72268414868096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: b920811be01745fc9faea7a9ce213c6e Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 9b8d74fd-0b94-465e-a644-a44170def51c could not be found. Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '9b8d74fd-0b94-465e-a644-a44170def51c'} Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b8d74fd-0b94-465e-a644-a44170def51c could not be found. Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b8d74fd-0b94-465e-a644-a44170def51c could not be found. Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:44.040568 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.045635 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:44.045635 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:44.045635 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:44.045635 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:44.045635 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:44.045635 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b8d74fd-0b94-465e-a644-a44170def51c could not be found. Sep 07 12:44:44.045635 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.045635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-db426119-b034-4e8e-ba2c-4a01570dc183 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Returning 404 to user: Instance 9b8d74fd-0b94-465e-a644-a44170def51c could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:44.045635 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-db426119-b034-4e8e-ba2c-4a01570dc183 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c" status: 404 len: 111 microversion: 2.1 time: 0.086756 Sep 07 12:44:44.045635 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1582/3134] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:43 2022] GET /compute/v2.1/servers/9b8d74fd-0b94-465e-a644-a44170def51c => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:44.063020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-24376b88-ad46-4d19-a1cb-21a300f43799 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:44.064063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-24376b88-ad46-4d19-a1cb-21a300f43799 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: 65f0a19b-4d7c-4874-accf-9f62a5b48847] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:44.090980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24376b88-ad46-4d19-a1cb-21a300f43799 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:44.093793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24376b88-ad46-4d19-a1cb-21a300f43799 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:44.094329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24376b88-ad46-4d19-a1cb-21a300f43799 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:44.095080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24376b88-ad46-4d19-a1cb-21a300f43799 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:44.095928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24376b88-ad46-4d19-a1cb-21a300f43799 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:44.099842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24376b88-ad46-4d19-a1cb-21a300f43799 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:44.135407 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-24376b88-ad46-4d19-a1cb-21a300f43799 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] HTTP exception thrown: Instance 65f0a19b-4d7c-4874-accf-9f62a5b48847 could not be found. Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-24376b88-ad46-4d19-a1cb-21a300f43799 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Request method failure captured: Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/65f0a19b-4d7c-4874-accf-9f62a5b48847 HTTP/1.1 Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJEP0irHIBLN8hFWvgLoOKa85E_5AoxCeRoHxKkTt9HdaFmlIYGchkE6q65oBFLP3DgAcUWlzLQgHRTeUGfdJav2RIkb2FS4kv4XxxXu-KkXROe-iYh2upLJXJIuF28hkxxUYg0rmbMG5d0HtmW6B3uJIdcPQo2gv8Pl4EjF30y2Jzg Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: e15fa55f4d4f4b4db6dbb26c0f07c3c4 Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersOnMultiNodesTest-1611524513 Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersOnMultiNodesTest-1611524513 Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: e15fa55f4d4f4b4db6dbb26c0f07c3c4 Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1611524513 Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersOnMultiNodesTest-1611524513-project Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: ed6e5d4d54224bca90954d1ebbd7b7a3 Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersOnMultiNodesTest-1611524513-project Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 65f0a19b-4d7c-4874-accf-9f62a5b48847 could not be found. Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '65f0a19b-4d7c-4874-accf-9f62a5b48847'} Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65f0a19b-4d7c-4874-accf-9f62a5b48847 could not be found. Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65f0a19b-4d7c-4874-accf-9f62a5b48847 could not be found. Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:44.137030 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.141898 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:44.141898 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:44.141898 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:44.141898 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:44.141898 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:44.141898 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65f0a19b-4d7c-4874-accf-9f62a5b48847 could not be found. Sep 07 12:44:44.141898 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.141898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-24376b88-ad46-4d19-a1cb-21a300f43799 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Returning 404 to user: Instance 65f0a19b-4d7c-4874-accf-9f62a5b48847 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:44.141898 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-24376b88-ad46-4d19-a1cb-21a300f43799 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/65f0a19b-4d7c-4874-accf-9f62a5b48847" status: 404 len: 111 microversion: 2.1 time: 0.086722 Sep 07 12:44:44.149902 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1583/3135] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:44 2022] GET /compute/v2.1/servers/65f0a19b-4d7c-4874-accf-9f62a5b48847 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:44.165781 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2ffa8c25-1953-4d3f-85ff-2aa37cbcf3f5 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:44.166406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2ffa8c25-1953-4d3f-85ff-2aa37cbcf3f5 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:44.173278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ffa8c25-1953-4d3f-85ff-2aa37cbcf3f5 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:44.173801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ffa8c25-1953-4d3f-85ff-2aa37cbcf3f5 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:44.174325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ffa8c25-1953-4d3f-85ff-2aa37cbcf3f5 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:44.175048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ffa8c25-1953-4d3f-85ff-2aa37cbcf3f5 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:44.175510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ffa8c25-1953-4d3f-85ff-2aa37cbcf3f5 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:44.175935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ffa8c25-1953-4d3f-85ff-2aa37cbcf3f5 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:44.365993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3a4f5f97-37f5-49cd-9b99-37c18427080f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:44.381436 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3a4f5f97-37f5-49cd-9b99-37c18427080f tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2" status: 200 len: 1324 microversion: 2.1 time: 0.764570 Sep 07 12:44:44.383267 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1553/3136] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:43 2022] GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2 => generated 1324 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:44.398020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-caf09af2-f26a-4bc2-be83-fb65b05556f3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:44.398330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-caf09af2-f26a-4bc2-be83-fb65b05556f3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: e9b81094-ecf8-45b0-b334-e6b2c3b4a058] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:44.414946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-caf09af2-f26a-4bc2-be83-fb65b05556f3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:44.417886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-caf09af2-f26a-4bc2-be83-fb65b05556f3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:44.418344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-caf09af2-f26a-4bc2-be83-fb65b05556f3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:44.419125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-caf09af2-f26a-4bc2-be83-fb65b05556f3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:44.423973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-caf09af2-f26a-4bc2-be83-fb65b05556f3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:44.424591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-caf09af2-f26a-4bc2-be83-fb65b05556f3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:44.445242 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-caf09af2-f26a-4bc2-be83-fb65b05556f3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] HTTP exception thrown: Instance e9b81094-ecf8-45b0-b334-e6b2c3b4a058 could not be found. Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-caf09af2-f26a-4bc2-be83-fb65b05556f3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Request method failure captured: Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058 HTTP/1.1 Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJBoiaP7MPiSaP6e6aUmMJ8PuR8TxD72E3ycIsoyb5pICiti0ZKBvrRvNoP9EgDHIO9YzOUucG9iu3oQZMsvYh9Gs4g9xjGSFcMGctGxplJk2OO0Aofdu3Ru80K0M86m3EPIBI5c12Fca4rxAASE3osSSig78ynw4pFvNNSiXm2zkBk Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef5b2dd007e944358d72268414868096"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef5b2dd007e944358d72268414868096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: b920811be01745fc9faea7a9ce213c6e Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance e9b81094-ecf8-45b0-b334-e6b2c3b4a058 could not be found. Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'e9b81094-ecf8-45b0-b334-e6b2c3b4a058'} Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9b81094-ecf8-45b0-b334-e6b2c3b4a058 could not be found. Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:44.446973 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:44.456136 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9b81094-ecf8-45b0-b334-e6b2c3b4a058 could not be found. Sep 07 12:44:44.456136 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.456136 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:44.456136 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.456136 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:44.456136 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:44.456136 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:44.456136 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:44.456136 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:44.456136 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9b81094-ecf8-45b0-b334-e6b2c3b4a058 could not be found. Sep 07 12:44:44.456136 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.456136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-caf09af2-f26a-4bc2-be83-fb65b05556f3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Returning 404 to user: Instance e9b81094-ecf8-45b0-b334-e6b2c3b4a058 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:44.456136 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-caf09af2-f26a-4bc2-be83-fb65b05556f3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058" status: 404 len: 111 microversion: 2.1 time: 0.064361 Sep 07 12:44:44.456136 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1554/3137] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:44:44 2022] DELETE /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:44.459199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf8427ce-77aa-4508-8f46-2ff062755626 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:44.459199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cf8427ce-77aa-4508-8f46-2ff062755626 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: aa6c3482-9f8e-41a7-8bec-32d428a3ce52] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:44.462415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:44:44.468106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf8427ce-77aa-4508-8f46-2ff062755626 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:44.468359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf8427ce-77aa-4508-8f46-2ff062755626 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:44.468682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf8427ce-77aa-4508-8f46-2ff062755626 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:44.469435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf8427ce-77aa-4508-8f46-2ff062755626 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:44.469948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf8427ce-77aa-4508-8f46-2ff062755626 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:44.470581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf8427ce-77aa-4508-8f46-2ff062755626 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:44.498992 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-cf8427ce-77aa-4508-8f46-2ff062755626 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] HTTP exception thrown: Instance aa6c3482-9f8e-41a7-8bec-32d428a3ce52 could not be found. Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf8427ce-77aa-4508-8f46-2ff062755626 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Request method failure captured: Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52 HTTP/1.1 Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJEP0irHIBLN8hFWvgLoOKa85E_5AoxCeRoHxKkTt9HdaFmlIYGchkE6q65oBFLP3DgAcUWlzLQgHRTeUGfdJav2RIkb2FS4kv4XxxXu-KkXROe-iYh2upLJXJIuF28hkxxUYg0rmbMG5d0HtmW6B3uJIdcPQo2gv8Pl4EjF30y2Jzg Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: e15fa55f4d4f4b4db6dbb26c0f07c3c4 Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersOnMultiNodesTest-1611524513 Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersOnMultiNodesTest-1611524513 Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: e15fa55f4d4f4b4db6dbb26c0f07c3c4 Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1611524513 Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersOnMultiNodesTest-1611524513-project Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: ed6e5d4d54224bca90954d1ebbd7b7a3 Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersOnMultiNodesTest-1611524513-project Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance aa6c3482-9f8e-41a7-8bec-32d428a3ce52 could not be found. Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'aa6c3482-9f8e-41a7-8bec-32d428a3ce52'} Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa6c3482-9f8e-41a7-8bec-32d428a3ce52 could not be found. Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa6c3482-9f8e-41a7-8bec-32d428a3ce52 could not be found. Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:44.501665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.505787 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:44.505787 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:44.505787 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:44.505787 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:44.505787 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:44.505787 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa6c3482-9f8e-41a7-8bec-32d428a3ce52 could not be found. Sep 07 12:44:44.505787 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.507325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf8427ce-77aa-4508-8f46-2ff062755626 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Returning 404 to user: Instance aa6c3482-9f8e-41a7-8bec-32d428a3ce52 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:44.508457 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cf8427ce-77aa-4508-8f46-2ff062755626 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52" status: 404 len: 111 microversion: 2.1 time: 0.055049 Sep 07 12:44:44.509844 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1555/3138] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:44 2022] GET /compute/v2.1/servers/aa6c3482-9f8e-41a7-8bec-32d428a3ce52 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:44.516252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e28d0ac2-bcf3-47b5-b1f9-d683e0e8b676 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:44.517221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e28d0ac2-bcf3-47b5-b1f9-d683e0e8b676 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: e9b81094-ecf8-45b0-b334-e6b2c3b4a058] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:44.525968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e28d0ac2-bcf3-47b5-b1f9-d683e0e8b676 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:44.526785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e28d0ac2-bcf3-47b5-b1f9-d683e0e8b676 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:44.527460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e28d0ac2-bcf3-47b5-b1f9-d683e0e8b676 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:44.528423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e28d0ac2-bcf3-47b5-b1f9-d683e0e8b676 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:44.529229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e28d0ac2-bcf3-47b5-b1f9-d683e0e8b676 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:44.529919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e28d0ac2-bcf3-47b5-b1f9-d683e0e8b676 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:44.552200 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-e28d0ac2-bcf3-47b5-b1f9-d683e0e8b676 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] HTTP exception thrown: Instance e9b81094-ecf8-45b0-b334-e6b2c3b4a058 could not be found. Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e28d0ac2-bcf3-47b5-b1f9-d683e0e8b676 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Request method failure captured: Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058 HTTP/1.1 Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJBoiaP7MPiSaP6e6aUmMJ8PuR8TxD72E3ycIsoyb5pICiti0ZKBvrRvNoP9EgDHIO9YzOUucG9iu3oQZMsvYh9Gs4g9xjGSFcMGctGxplJk2OO0Aofdu3Ru80K0M86m3EPIBI5c12Fca4rxAASE3osSSig78ynw4pFvNNSiXm2zkBk Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef5b2dd007e944358d72268414868096"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef5b2dd007e944358d72268414868096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: b920811be01745fc9faea7a9ce213c6e Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance e9b81094-ecf8-45b0-b334-e6b2c3b4a058 could not be found. Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'e9b81094-ecf8-45b0-b334-e6b2c3b4a058'} Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9b81094-ecf8-45b0-b334-e6b2c3b4a058 could not be found. Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9b81094-ecf8-45b0-b334-e6b2c3b4a058 could not be found. Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:44.555410 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.560093 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:44.560093 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:44.560093 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:44.560093 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:44.560093 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:44.560093 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9b81094-ecf8-45b0-b334-e6b2c3b4a058 could not be found. Sep 07 12:44:44.560093 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.561327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e28d0ac2-bcf3-47b5-b1f9-d683e0e8b676 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Returning 404 to user: Instance e9b81094-ecf8-45b0-b334-e6b2c3b4a058 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:44.569025 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e28d0ac2-bcf3-47b5-b1f9-d683e0e8b676 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058" status: 404 len: 111 microversion: 2.1 time: 0.053007 Sep 07 12:44:44.569025 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1556/3139] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:44 2022] GET /compute/v2.1/servers/e9b81094-ecf8-45b0-b334-e6b2c3b4a058 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:44.587875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fdafbf74-20e4-476f-9f8c-a5fce7d99a5c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:44.613716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2ffa8c25-1953-4d3f-85ff-2aa37cbcf3f5 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:44.630047 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2ffa8c25-1953-4d3f-85ff-2aa37cbcf3f5 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1523 microversion: 2.1 time: 0.478825 Sep 07 12:44:44.630682 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1584/3140] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:44 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1523 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:44.636938 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fdafbf74-20e4-476f-9f8c-a5fce7d99a5c tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/0a940909-7557-42a1-b854-5549ca49a0b6" status: 204 len: 0 microversion: 2.1 time: 0.067777 Sep 07 12:44:44.639228 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1557/3141] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Sep 7 12:44:44 2022] DELETE /compute/v2.1/os-server-groups/0a940909-7557-42a1-b854-5549ca49a0b6 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:44:44.646911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-12a3543e-0886-4dfd-ae6c-30fb8b199cb0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:44.647147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ca0d0457-3206-42a2-9c15-fc39a1326f25 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:44.647407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-12a3543e-0886-4dfd-ae6c-30fb8b199cb0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:44.647553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ca0d0457-3206-42a2-9c15-fc39a1326f25 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 657ffafe-1185-4cf0-9f75-e574bc2405e2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:44.655552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca0d0457-3206-42a2-9c15-fc39a1326f25 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:44.656067 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca0d0457-3206-42a2-9c15-fc39a1326f25 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:44.656516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca0d0457-3206-42a2-9c15-fc39a1326f25 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:44.657898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca0d0457-3206-42a2-9c15-fc39a1326f25 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:44.658416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca0d0457-3206-42a2-9c15-fc39a1326f25 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:44.658877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca0d0457-3206-42a2-9c15-fc39a1326f25 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:44.659925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12a3543e-0886-4dfd-ae6c-30fb8b199cb0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:44.661436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12a3543e-0886-4dfd-ae6c-30fb8b199cb0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:44.662422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12a3543e-0886-4dfd-ae6c-30fb8b199cb0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:44.663712 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12a3543e-0886-4dfd-ae6c-30fb8b199cb0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:44.664806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12a3543e-0886-4dfd-ae6c-30fb8b199cb0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:44.665659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12a3543e-0886-4dfd-ae6c-30fb8b199cb0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:44.677470 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-ca0d0457-3206-42a2-9c15-fc39a1326f25 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] HTTP exception thrown: Instance 657ffafe-1185-4cf0-9f75-e574bc2405e2 could not be found. Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ca0d0457-3206-42a2-9c15-fc39a1326f25 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Request method failure captured: Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/657ffafe-1185-4cf0-9f75-e574bc2405e2 HTTP/1.1 Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJBoiaP7MPiSaP6e6aUmMJ8PuR8TxD72E3ycIsoyb5pICiti0ZKBvrRvNoP9EgDHIO9YzOUucG9iu3oQZMsvYh9Gs4g9xjGSFcMGctGxplJk2OO0Aofdu3Ru80K0M86m3EPIBI5c12Fca4rxAASE3osSSig78ynw4pFvNNSiXm2zkBk Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef5b2dd007e944358d72268414868096"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef5b2dd007e944358d72268414868096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: b920811be01745fc9faea7a9ce213c6e Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 657ffafe-1185-4cf0-9f75-e574bc2405e2 could not be found. Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '657ffafe-1185-4cf0-9f75-e574bc2405e2'} Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 657ffafe-1185-4cf0-9f75-e574bc2405e2 could not be found. Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:44.679140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:44.683951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 657ffafe-1185-4cf0-9f75-e574bc2405e2 could not be found. Sep 07 12:44:44.683951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.683951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:44.683951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.683951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:44.683951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:44.683951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:44.683951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:44.683951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:44.683951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 657ffafe-1185-4cf0-9f75-e574bc2405e2 could not be found. Sep 07 12:44:44.683951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.683951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ca0d0457-3206-42a2-9c15-fc39a1326f25 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Returning 404 to user: Instance 657ffafe-1185-4cf0-9f75-e574bc2405e2 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:44.683951 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ca0d0457-3206-42a2-9c15-fc39a1326f25 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "DELETE /compute/v2.1/servers/657ffafe-1185-4cf0-9f75-e574bc2405e2" status: 404 len: 111 microversion: 2.1 time: 0.039699 Sep 07 12:44:44.683951 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1585/3142] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:44:44 2022] DELETE /compute/v2.1/servers/657ffafe-1185-4cf0-9f75-e574bc2405e2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:44.699889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3c728472-59c6-46dc-9046-bc18ce611531 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:44.700509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3c728472-59c6-46dc-9046-bc18ce611531 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 657ffafe-1185-4cf0-9f75-e574bc2405e2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:44.716119 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c728472-59c6-46dc-9046-bc18ce611531 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:44.717019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c728472-59c6-46dc-9046-bc18ce611531 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:44.723881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-12a3543e-0886-4dfd-ae6c-30fb8b199cb0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:44:44.725723 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c728472-59c6-46dc-9046-bc18ce611531 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:44.733050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c728472-59c6-46dc-9046-bc18ce611531 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:44.735108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c728472-59c6-46dc-9046-bc18ce611531 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:44.735945 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c728472-59c6-46dc-9046-bc18ce611531 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:44.760000 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-3c728472-59c6-46dc-9046-bc18ce611531 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] HTTP exception thrown: Instance 657ffafe-1185-4cf0-9f75-e574bc2405e2 could not be found. Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3c728472-59c6-46dc-9046-bc18ce611531 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Request method failure captured: Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/657ffafe-1185-4cf0-9f75-e574bc2405e2 HTTP/1.1 Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJBoiaP7MPiSaP6e6aUmMJ8PuR8TxD72E3ycIsoyb5pICiti0ZKBvrRvNoP9EgDHIO9YzOUucG9iu3oQZMsvYh9Gs4g9xjGSFcMGctGxplJk2OO0Aofdu3Ru80K0M86m3EPIBI5c12Fca4rxAASE3osSSig78ynw4pFvNNSiXm2zkBk Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef5b2dd007e944358d72268414868096"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef5b2dd007e944358d72268414868096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: b920811be01745fc9faea7a9ce213c6e Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 657ffafe-1185-4cf0-9f75-e574bc2405e2 could not be found. Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '657ffafe-1185-4cf0-9f75-e574bc2405e2'} Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 657ffafe-1185-4cf0-9f75-e574bc2405e2 could not be found. Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 657ffafe-1185-4cf0-9f75-e574bc2405e2 could not be found. Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:44.769467 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.777935 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:44.777935 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:44.777935 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:44.777935 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:44.777935 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:44.777935 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 657ffafe-1185-4cf0-9f75-e574bc2405e2 could not be found. Sep 07 12:44:44.777935 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:44.777935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3c728472-59c6-46dc-9046-bc18ce611531 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Returning 404 to user: Instance 657ffafe-1185-4cf0-9f75-e574bc2405e2 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:44.777935 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3c728472-59c6-46dc-9046-bc18ce611531 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/657ffafe-1185-4cf0-9f75-e574bc2405e2" status: 404 len: 111 microversion: 2.1 time: 0.082100 Sep 07 12:44:44.786140 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1586/3143] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:44 2022] GET /compute/v2.1/servers/657ffafe-1185-4cf0-9f75-e574bc2405e2 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:44.951201 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-12a3543e-0886-4dfd-ae6c-30fb8b199cb0 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc" status: 204 len: 0 microversion: 2.1 time: 0.307638 Sep 07 12:44:44.953061 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1558/3144] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:44:44 2022] DELETE /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:44:44.964775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-603da547-f113-41dc-bef7-8466ed2862b6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:44.966528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-603da547-f113-41dc-bef7-8466ed2862b6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:44.981278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-943f7bc4-01a3-4337-a3ff-91952aff6268 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:44.991074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-603da547-f113-41dc-bef7-8466ed2862b6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:44.992018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-603da547-f113-41dc-bef7-8466ed2862b6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:44.992796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-603da547-f113-41dc-bef7-8466ed2862b6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:44.995571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-943f7bc4-01a3-4337-a3ff-91952aff6268 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:45.002353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-603da547-f113-41dc-bef7-8466ed2862b6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:45.003216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-603da547-f113-41dc-bef7-8466ed2862b6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:45.004007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-603da547-f113-41dc-bef7-8466ed2862b6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:45.013874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-943f7bc4-01a3-4337-a3ff-91952aff6268 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:45.014745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-943f7bc4-01a3-4337-a3ff-91952aff6268 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:45.015531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-943f7bc4-01a3-4337-a3ff-91952aff6268 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:45.016818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-943f7bc4-01a3-4337-a3ff-91952aff6268 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:45.022641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-943f7bc4-01a3-4337-a3ff-91952aff6268 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:45.026356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-943f7bc4-01a3-4337-a3ff-91952aff6268 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:45.388718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-603da547-f113-41dc-bef7-8466ed2862b6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:45.393844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-943f7bc4-01a3-4337-a3ff-91952aff6268 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:45.407676 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-603da547-f113-41dc-bef7-8466ed2862b6 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc" status: 200 len: 1472 microversion: 2.1 time: 0.447345 Sep 07 12:44:45.407956 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-943f7bc4-01a3-4337-a3ff-91952aff6268 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1506 microversion: 2.1 time: 0.434707 Sep 07 12:44:45.410248 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1587/3145] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:44 2022] GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc => generated 1472 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:45.421643 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1559/3146] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:44 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:45.440888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-05ac9ad9-fbbb-4b86-81ab-a1a607bdee97 req-a1aa92c6-43b7-4a2c-b534-bdbb0e64fd70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7a91425-0aae-40bb-b720-071ac9ec52f2", "tag": "6c0bc09c-cf07-4fe9-b562-595f55280547"}, {"server_uuid": "aa6c3482-9f8e-41a7-8bec-32d428a3ce52", "name": "network-vif-deleted", "tag": "5d83a858-3dea-4c83-8d38-a1fe466b187d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:45.447293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4198d126-5657-444d-b04f-2f3d7df3a0d9 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:45.447557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4198d126-5657-444d-b04f-2f3d7df3a0d9 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: f7a91425-0aae-40bb-b720-071ac9ec52f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:45.462149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4198d126-5657-444d-b04f-2f3d7df3a0d9 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:45.463175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4198d126-5657-444d-b04f-2f3d7df3a0d9 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:45.464054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4198d126-5657-444d-b04f-2f3d7df3a0d9 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:45.465894 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4198d126-5657-444d-b04f-2f3d7df3a0d9 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:45.466932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4198d126-5657-444d-b04f-2f3d7df3a0d9 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:45.467770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4198d126-5657-444d-b04f-2f3d7df3a0d9 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:45.477080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-05ac9ad9-fbbb-4b86-81ab-a1a607bdee97 req-a1aa92c6-43b7-4a2c-b534-bdbb0e64fd70 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:45.479701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-05ac9ad9-fbbb-4b86-81ab-a1a607bdee97 req-a1aa92c6-43b7-4a2c-b534-bdbb0e64fd70 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:45.480787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-05ac9ad9-fbbb-4b86-81ab-a1a607bdee97 req-a1aa92c6-43b7-4a2c-b534-bdbb0e64fd70 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:45.514097 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-05ac9ad9-fbbb-4b86-81ab-a1a607bdee97 req-a1aa92c6-43b7-4a2c-b534-bdbb0e64fd70 service nova] Creating event network-changed:6c0bc09c-cf07-4fe9-b562-595f55280547 for instance f7a91425-0aae-40bb-b720-071ac9ec52f2 on n-h2-852087-9 Sep 07 12:44:45.515431 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-05ac9ad9-fbbb-4b86-81ab-a1a607bdee97 req-a1aa92c6-43b7-4a2c-b534-bdbb0e64fd70 service nova] Creating event network-vif-deleted:5d83a858-3dea-4c83-8d38-a1fe466b187d for instance aa6c3482-9f8e-41a7-8bec-32d428a3ce52 on n-h2-852087-9 Sep 07 12:44:45.529820 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-05ac9ad9-fbbb-4b86-81ab-a1a607bdee97 req-a1aa92c6-43b7-4a2c-b534-bdbb0e64fd70 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.116976 Sep 07 12:44:45.536571 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1588/3147] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:45.676404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1f1d8afd-7b5e-49fa-a6c8-6add6f6e6f60 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:45.678776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1f1d8afd-7b5e-49fa-a6c8-6add6f6e6f60 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:45.697367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f1d8afd-7b5e-49fa-a6c8-6add6f6e6f60 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:45.698334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f1d8afd-7b5e-49fa-a6c8-6add6f6e6f60 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:45.699082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f1d8afd-7b5e-49fa-a6c8-6add6f6e6f60 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:45.700819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f1d8afd-7b5e-49fa-a6c8-6add6f6e6f60 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:45.702120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f1d8afd-7b5e-49fa-a6c8-6add6f6e6f60 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:45.703533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f1d8afd-7b5e-49fa-a6c8-6add6f6e6f60 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:45.829648 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4198d126-5657-444d-b04f-2f3d7df3a0d9 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:45.853805 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4198d126-5657-444d-b04f-2f3d7df3a0d9 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2" status: 200 len: 1324 microversion: 2.1 time: 0.426952 Sep 07 12:44:45.870829 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1560/3148] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:45 2022] GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2 => generated 1324 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:46.280215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1f1d8afd-7b5e-49fa-a6c8-6add6f6e6f60 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:46.294813 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1f1d8afd-7b5e-49fa-a6c8-6add6f6e6f60 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1523 microversion: 2.1 time: 0.640704 Sep 07 12:44:46.300616 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1589/3149] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:45 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1523 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:46.460182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c25fd6d9-bda4-492e-a053-725bcef34c29 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:46.464207 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6ca598c6-f968-4631-9db1-e4900e6cfa2a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:46.466016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c25fd6d9-bda4-492e-a053-725bcef34c29 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:46.470220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6ca598c6-f968-4631-9db1-e4900e6cfa2a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:46.500008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c25fd6d9-bda4-492e-a053-725bcef34c29 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:46.502152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ca598c6-f968-4631-9db1-e4900e6cfa2a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:46.503942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ca598c6-f968-4631-9db1-e4900e6cfa2a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:46.505095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c25fd6d9-bda4-492e-a053-725bcef34c29 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:46.506213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c25fd6d9-bda4-492e-a053-725bcef34c29 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:46.507455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ca598c6-f968-4631-9db1-e4900e6cfa2a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:46.510100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ca598c6-f968-4631-9db1-e4900e6cfa2a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:46.518144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c25fd6d9-bda4-492e-a053-725bcef34c29 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:46.526301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c25fd6d9-bda4-492e-a053-725bcef34c29 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:46.526742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ca598c6-f968-4631-9db1-e4900e6cfa2a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:46.531454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c25fd6d9-bda4-492e-a053-725bcef34c29 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:46.534186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ca598c6-f968-4631-9db1-e4900e6cfa2a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:47.541703 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6ca598c6-f968-4631-9db1-e4900e6cfa2a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:47.548445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:44:47.588364 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6ca598c6-f968-4631-9db1-e4900e6cfa2a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1506 microversion: 2.1 time: 1.156892 Sep 07 12:44:47.603136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c25fd6d9-bda4-492e-a053-725bcef34c29 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6e5d4d54224bca90954d1ebbd7b7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e15fa55f4d4f4b4db6dbb26c0f07c3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:47.622997 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1561/3150] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:46 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1506 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:47.648168 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c25fd6d9-bda4-492e-a053-725bcef34c29 tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc" status: 200 len: 1472 microversion: 2.1 time: 1.199720 Sep 07 12:44:47.650241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-40a99443-8e0f-4a37-b602-c0df6603f327 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:47.653508 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-40a99443-8e0f-4a37-b602-c0df6603f327 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: f7a91425-0aae-40bb-b720-071ac9ec52f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:47.654870 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1590/3151] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:46 2022] GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc => generated 1472 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:47.686035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40a99443-8e0f-4a37-b602-c0df6603f327 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:47.687388 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40a99443-8e0f-4a37-b602-c0df6603f327 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:47.692244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-13e3dfcb-dce9-4a87-90f0-2f876b1ee380 req-06dd2575-c95f-4517-8250-be627d3c0d2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edf38c92-ffc2-492b-8642-88ca59537acd", "tag": "23b18fbd-594f-42e0-a655-6b5f01607b28"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:47.695157 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40a99443-8e0f-4a37-b602-c0df6603f327 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:47.698702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40a99443-8e0f-4a37-b602-c0df6603f327 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:47.702211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40a99443-8e0f-4a37-b602-c0df6603f327 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:47.703771 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40a99443-8e0f-4a37-b602-c0df6603f327 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:47.721257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-13e3dfcb-dce9-4a87-90f0-2f876b1ee380 req-06dd2575-c95f-4517-8250-be627d3c0d2f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:47.722135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-13e3dfcb-dce9-4a87-90f0-2f876b1ee380 req-06dd2575-c95f-4517-8250-be627d3c0d2f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:47.722868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-13e3dfcb-dce9-4a87-90f0-2f876b1ee380 req-06dd2575-c95f-4517-8250-be627d3c0d2f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:47.746569 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-13e3dfcb-dce9-4a87-90f0-2f876b1ee380 req-06dd2575-c95f-4517-8250-be627d3c0d2f service nova] Creating event network-changed:23b18fbd-594f-42e0-a655-6b5f01607b28 for instance edf38c92-ffc2-492b-8642-88ca59537acd on n-h1-852087-9 Sep 07 12:44:47.756141 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-13e3dfcb-dce9-4a87-90f0-2f876b1ee380 req-06dd2575-c95f-4517-8250-be627d3c0d2f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095859 Sep 07 12:44:47.758274 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1591/3152] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:47.769549 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0304894f-119e-453f-93d2-aa07740c12e8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:47.772339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0304894f-119e-453f-93d2-aa07740c12e8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:47.783943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0304894f-119e-453f-93d2-aa07740c12e8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:47.785151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0304894f-119e-453f-93d2-aa07740c12e8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:47.786143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0304894f-119e-453f-93d2-aa07740c12e8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:47.787641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0304894f-119e-453f-93d2-aa07740c12e8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:47.788812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0304894f-119e-453f-93d2-aa07740c12e8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:47.789825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0304894f-119e-453f-93d2-aa07740c12e8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:49.106582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0304894f-119e-453f-93d2-aa07740c12e8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:49.128916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-40a99443-8e0f-4a37-b602-c0df6603f327 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:49.143278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:44:49.149301 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0304894f-119e-453f-93d2-aa07740c12e8 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1523 microversion: 2.1 time: 1.388461 Sep 07 12:44:49.151651 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1592/3153] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:47 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1523 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:49.156170 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-40a99443-8e0f-4a37-b602-c0df6603f327 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2" status: 200 len: 1324 microversion: 2.1 time: 1.531421 Sep 07 12:44:49.158882 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1562/3154] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:47 2022] GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2 => generated 1324 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:49.179988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c56343cb-990d-4bc5-8804-81ce757db0a6 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:49.189829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c56343cb-990d-4bc5-8804-81ce757db0a6 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:49.207904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c56343cb-990d-4bc5-8804-81ce757db0a6 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:49.209414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c56343cb-990d-4bc5-8804-81ce757db0a6 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:49.210603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c56343cb-990d-4bc5-8804-81ce757db0a6 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:49.213225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c56343cb-990d-4bc5-8804-81ce757db0a6 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:49.214269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c56343cb-990d-4bc5-8804-81ce757db0a6 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:49.215957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c56343cb-990d-4bc5-8804-81ce757db0a6 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:49.960722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a075c00-83ca-4c49-ac6c-783bf3a8f78f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:49.961729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4a075c00-83ca-4c49-ac6c-783bf3a8f78f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] [instance: b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:49.975743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a075c00-83ca-4c49-ac6c-783bf3a8f78f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:49.981204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a075c00-83ca-4c49-ac6c-783bf3a8f78f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:49.982044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a075c00-83ca-4c49-ac6c-783bf3a8f78f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:49.983691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a075c00-83ca-4c49-ac6c-783bf3a8f78f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:49.984445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a075c00-83ca-4c49-ac6c-783bf3a8f78f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:49.987229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a075c00-83ca-4c49-ac6c-783bf3a8f78f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:50.029942 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-4a075c00-83ca-4c49-ac6c-783bf3a8f78f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] HTTP exception thrown: Instance b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc could not be found. Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a075c00-83ca-4c49-ac6c-783bf3a8f78f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Request method failure captured: Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc HTTP/1.1 Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJEP0irHIBLN8hFWvgLoOKa85E_5AoxCeRoHxKkTt9HdaFmlIYGchkE6q65oBFLP3DgAcUWlzLQgHRTeUGfdJav2RIkb2FS4kv4XxxXu-KkXROe-iYh2upLJXJIuF28hkxxUYg0rmbMG5d0HtmW6B3uJIdcPQo2gv8Pl4EjF30y2Jzg Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: e15fa55f4d4f4b4db6dbb26c0f07c3c4 Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersOnMultiNodesTest-1611524513 Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e15fa55f4d4f4b4db6dbb26c0f07c3c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersOnMultiNodesTest-1611524513 Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: e15fa55f4d4f4b4db6dbb26c0f07c3c4 Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1611524513 Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersOnMultiNodesTest-1611524513-project Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: ed6e5d4d54224bca90954d1ebbd7b7a3 Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersOnMultiNodesTest-1611524513-project Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc could not be found. Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc'} Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc could not be found. Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc could not be found. Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:50.034777 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:50.039692 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:50.039692 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:50.039692 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:50.039692 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:50.039692 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:50.039692 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc could not be found. Sep 07 12:44:50.039692 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:50.044311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a075c00-83ca-4c49-ac6c-783bf3a8f78f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] Returning 404 to user: Instance b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:50.045555 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4a075c00-83ca-4c49-ac6c-783bf3a8f78f tempest-ServersOnMultiNodesTest-1611524513 tempest-ServersOnMultiNodesTest-1611524513-project] 10.222.0.16 "GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc" status: 404 len: 111 microversion: 2.1 time: 0.885424 Sep 07 12:44:50.049911 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1563/3155] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:49 2022] GET /compute/v2.1/servers/b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc => generated 111 bytes in 890 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:50.068319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bc15be31-333a-40cc-b8d8-751d07116df3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:50.080661 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bc15be31-333a-40cc-b8d8-751d07116df3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 704ec36d-6304-4089-9e70-12b23b3c795e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:50.115561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc15be31-333a-40cc-b8d8-751d07116df3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:50.116418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc15be31-333a-40cc-b8d8-751d07116df3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:50.118492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc15be31-333a-40cc-b8d8-751d07116df3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:50.119792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc15be31-333a-40cc-b8d8-751d07116df3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:50.122414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc15be31-333a-40cc-b8d8-751d07116df3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:50.122974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc15be31-333a-40cc-b8d8-751d07116df3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:50.161359 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-bc15be31-333a-40cc-b8d8-751d07116df3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] HTTP exception thrown: Instance 704ec36d-6304-4089-9e70-12b23b3c795e could not be found. Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bc15be31-333a-40cc-b8d8-751d07116df3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Request method failure captured: Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e HTTP/1.1 Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJBoiaP7MPiSaP6e6aUmMJ8PuR8TxD72E3ycIsoyb5pICiti0ZKBvrRvNoP9EgDHIO9YzOUucG9iu3oQZMsvYh9Gs4g9xjGSFcMGctGxplJk2OO0Aofdu3Ru80K0M86m3EPIBI5c12Fca4rxAASE3osSSig78ynw4pFvNNSiXm2zkBk Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef5b2dd007e944358d72268414868096"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef5b2dd007e944358d72268414868096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: b920811be01745fc9faea7a9ce213c6e Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 704ec36d-6304-4089-9e70-12b23b3c795e could not be found. Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '704ec36d-6304-4089-9e70-12b23b3c795e'} Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 704ec36d-6304-4089-9e70-12b23b3c795e could not be found. Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:50.166477 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:50.170471 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 704ec36d-6304-4089-9e70-12b23b3c795e could not be found. Sep 07 12:44:50.170471 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:50.170471 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:50.170471 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:50.170471 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:50.170471 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:50.170471 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:50.170471 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:50.170471 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:50.170471 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 704ec36d-6304-4089-9e70-12b23b3c795e could not be found. Sep 07 12:44:50.170471 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:50.170471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bc15be31-333a-40cc-b8d8-751d07116df3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Returning 404 to user: Instance 704ec36d-6304-4089-9e70-12b23b3c795e could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:50.170471 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bc15be31-333a-40cc-b8d8-751d07116df3 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "DELETE /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e" status: 404 len: 111 microversion: 2.1 time: 0.116512 Sep 07 12:44:50.173465 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1564/3156] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:44:50 2022] DELETE /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:50.187881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-639a3f10-6912-4ae5-a95f-fef025909c6e req-b7e2a9fe-c4cb-4f80-b8da-45fa524c3d9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc", "name": "network-vif-deleted", "tag": "ae63cbe5-283c-42c7-8611-bf3675d0c6dc"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:50.230483 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-639a3f10-6912-4ae5-a95f-fef025909c6e req-b7e2a9fe-c4cb-4f80-b8da-45fa524c3d9b service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:50.231688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-639a3f10-6912-4ae5-a95f-fef025909c6e req-b7e2a9fe-c4cb-4f80-b8da-45fa524c3d9b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:50.232891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-639a3f10-6912-4ae5-a95f-fef025909c6e req-b7e2a9fe-c4cb-4f80-b8da-45fa524c3d9b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:50.265950 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-639a3f10-6912-4ae5-a95f-fef025909c6e req-b7e2a9fe-c4cb-4f80-b8da-45fa524c3d9b service nova] Creating event network-vif-deleted:ae63cbe5-283c-42c7-8611-bf3675d0c6dc for instance b56e9ee5-b7c9-4ec1-b45e-0fe26634e4bc on n-h1-852087-9 Sep 07 12:44:50.278947 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-639a3f10-6912-4ae5-a95f-fef025909c6e req-b7e2a9fe-c4cb-4f80-b8da-45fa524c3d9b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101856 Sep 07 12:44:50.281354 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1565/3157] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:50.296169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-108d35ad-0f55-4b82-a30c-0f021e6f3a72 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:50.299530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-108d35ad-0f55-4b82-a30c-0f021e6f3a72 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:50.320047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-108d35ad-0f55-4b82-a30c-0f021e6f3a72 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:50.322339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-108d35ad-0f55-4b82-a30c-0f021e6f3a72 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:50.323595 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-108d35ad-0f55-4b82-a30c-0f021e6f3a72 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:50.324983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-108d35ad-0f55-4b82-a30c-0f021e6f3a72 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:50.330504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c56343cb-990d-4bc5-8804-81ce757db0a6 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:50.332530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-108d35ad-0f55-4b82-a30c-0f021e6f3a72 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:50.334638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-108d35ad-0f55-4b82-a30c-0f021e6f3a72 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:50.359246 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c56343cb-990d-4bc5-8804-81ce757db0a6 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1506 microversion: 2.1 time: 1.205320 Sep 07 12:44:50.366155 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1593/3158] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:49 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1506 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:50.395939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-59d306f1-1351-4564-bfac-c63bcaede4f6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:50.397652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-59d306f1-1351-4564-bfac-c63bcaede4f6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: 704ec36d-6304-4089-9e70-12b23b3c795e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:50.411042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59d306f1-1351-4564-bfac-c63bcaede4f6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:50.411926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59d306f1-1351-4564-bfac-c63bcaede4f6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:50.412722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59d306f1-1351-4564-bfac-c63bcaede4f6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:50.414546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59d306f1-1351-4564-bfac-c63bcaede4f6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:50.415686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59d306f1-1351-4564-bfac-c63bcaede4f6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:50.417060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59d306f1-1351-4564-bfac-c63bcaede4f6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:50.458572 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-59d306f1-1351-4564-bfac-c63bcaede4f6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] HTTP exception thrown: Instance 704ec36d-6304-4089-9e70-12b23b3c795e could not be found. Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-59d306f1-1351-4564-bfac-c63bcaede4f6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Request method failure captured: Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e HTTP/1.1 Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJBoiaP7MPiSaP6e6aUmMJ8PuR8TxD72E3ycIsoyb5pICiti0ZKBvrRvNoP9EgDHIO9YzOUucG9iu3oQZMsvYh9Gs4g9xjGSFcMGctGxplJk2OO0Aofdu3Ru80K0M86m3EPIBI5c12Fca4rxAASE3osSSig78ynw4pFvNNSiXm2zkBk Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef5b2dd007e944358d72268414868096"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef5b2dd007e944358d72268414868096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: b920811be01745fc9faea7a9ce213c6e Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 704ec36d-6304-4089-9e70-12b23b3c795e could not be found. Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '704ec36d-6304-4089-9e70-12b23b3c795e'} Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 704ec36d-6304-4089-9e70-12b23b3c795e could not be found. Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 704ec36d-6304-4089-9e70-12b23b3c795e could not be found. Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:50.464302 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:50.473067 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:50.473067 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:50.473067 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:50.473067 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:50.473067 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:50.473067 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 704ec36d-6304-4089-9e70-12b23b3c795e could not be found. Sep 07 12:44:50.473067 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:50.477554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-59d306f1-1351-4564-bfac-c63bcaede4f6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Returning 404 to user: Instance 704ec36d-6304-4089-9e70-12b23b3c795e could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:50.500251 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-59d306f1-1351-4564-bfac-c63bcaede4f6 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e" status: 404 len: 111 microversion: 2.1 time: 0.111151 Sep 07 12:44:50.503444 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1594/3159] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:50 2022] GET /compute/v2.1/servers/704ec36d-6304-4089-9e70-12b23b3c795e => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:50.522235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c25b1507-782d-4c7c-b8fd-7186bff872a1 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:50.524243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c25b1507-782d-4c7c-b8fd-7186bff872a1 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: f7a91425-0aae-40bb-b720-071ac9ec52f2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:50.545149 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c25b1507-782d-4c7c-b8fd-7186bff872a1 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:50.547569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c25b1507-782d-4c7c-b8fd-7186bff872a1 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:50.551124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c25b1507-782d-4c7c-b8fd-7186bff872a1 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:50.565229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c25b1507-782d-4c7c-b8fd-7186bff872a1 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:50.566634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c25b1507-782d-4c7c-b8fd-7186bff872a1 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:50.567692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c25b1507-782d-4c7c-b8fd-7186bff872a1 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:50.637053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-108d35ad-0f55-4b82-a30c-0f021e6f3a72 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:50.667549 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-108d35ad-0f55-4b82-a30c-0f021e6f3a72 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1503 microversion: 2.1 time: 0.383624 Sep 07 12:44:50.688058 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1566/3160] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:50 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1503 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:50.706580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f3125856-7a73-484e-92d2-079c852a3a5b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:50.708145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f3125856-7a73-484e-92d2-079c852a3a5b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: b05fbd40-21c6-4c6c-9039-887cf2b9e6d8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:50.725900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3125856-7a73-484e-92d2-079c852a3a5b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:50.726422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3125856-7a73-484e-92d2-079c852a3a5b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:50.728426 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3125856-7a73-484e-92d2-079c852a3a5b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:50.730289 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3125856-7a73-484e-92d2-079c852a3a5b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:50.731520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3125856-7a73-484e-92d2-079c852a3a5b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:50.737581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3125856-7a73-484e-92d2-079c852a3a5b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:50.771450 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-f3125856-7a73-484e-92d2-079c852a3a5b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] HTTP exception thrown: Instance b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 could not be found. Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f3125856-7a73-484e-92d2-079c852a3a5b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Request method failure captured: Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 HTTP/1.1 Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJBoiaP7MPiSaP6e6aUmMJ8PuR8TxD72E3ycIsoyb5pICiti0ZKBvrRvNoP9EgDHIO9YzOUucG9iu3oQZMsvYh9Gs4g9xjGSFcMGctGxplJk2OO0Aofdu3Ru80K0M86m3EPIBI5c12Fca4rxAASE3osSSig78ynw4pFvNNSiXm2zkBk Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef5b2dd007e944358d72268414868096"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef5b2dd007e944358d72268414868096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: b920811be01745fc9faea7a9ce213c6e Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 could not be found. Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'b05fbd40-21c6-4c6c-9039-887cf2b9e6d8'} Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 could not be found. Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:50.776886 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:50.784517 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 could not be found. Sep 07 12:44:50.784517 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:50.784517 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:50.784517 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:50.784517 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:50.784517 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:50.784517 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:50.784517 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:50.784517 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:50.784517 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 could not be found. Sep 07 12:44:50.784517 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:44:50.784517 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f3125856-7a73-484e-92d2-079c852a3a5b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Returning 404 to user: Instance b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:50.784517 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f3125856-7a73-484e-92d2-079c852a3a5b tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8" status: 404 len: 111 microversion: 2.1 time: 0.087815 Sep 07 12:44:50.784517 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1567/3161] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:44:50 2022] DELETE /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:50.797238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9ef17843-ad0f-4cdd-b9a6-f5a135b1c33c tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Action: 'create', calling method: .version_select at 0x7fc41d2655e0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-996576480", "description": "tempest-description-1499547660"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:51.177442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c25b1507-782d-4c7c-b8fd-7186bff872a1 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:51.211250 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c25b1507-782d-4c7c-b8fd-7186bff872a1 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2" status: 200 len: 1324 microversion: 2.1 time: 0.703818 Sep 07 12:44:51.212253 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1595/3162] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:50 2022] GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2 => generated 1324 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:51.239258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9b79823b-745f-486e-98a2-bae8475db141 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:51.240564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9b79823b-745f-486e-98a2-bae8475db141 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] [instance: b05fbd40-21c6-4c6c-9039-887cf2b9e6d8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:51.264924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b79823b-745f-486e-98a2-bae8475db141 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:51.266050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b79823b-745f-486e-98a2-bae8475db141 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:51.266775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b79823b-745f-486e-98a2-bae8475db141 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:51.268223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b79823b-745f-486e-98a2-bae8475db141 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:51.278509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b79823b-745f-486e-98a2-bae8475db141 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:51.279433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b79823b-745f-486e-98a2-bae8475db141 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:51.339711 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-9b79823b-745f-486e-98a2-bae8475db141 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] HTTP exception thrown: Instance b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 could not be found. Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9b79823b-745f-486e-98a2-bae8475db141 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Request method failure captured: Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 HTTP/1.1 Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJBoiaP7MPiSaP6e6aUmMJ8PuR8TxD72E3ycIsoyb5pICiti0ZKBvrRvNoP9EgDHIO9YzOUucG9iu3oQZMsvYh9Gs4g9xjGSFcMGctGxplJk2OO0Aofdu3Ru80K0M86m3EPIBI5c12Fca4rxAASE3osSSig78ynw4pFvNNSiXm2zkBk Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef5b2dd007e944358d72268414868096"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef5b2dd007e944358d72268414868096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef5b2dd007e944358d72268414868096"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: ef5b2dd007e944358d72268414868096 Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1071368198 Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: b920811be01745fc9faea7a9ce213c6e Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1071368198-project Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 could not be found. Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'b05fbd40-21c6-4c6c-9039-887cf2b9e6d8'} Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 could not be found. Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 could not be found. Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:44:51.343722 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:51.348947 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:44:51.348947 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:44:51.348947 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:44:51.348947 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:44:51.348947 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:44:51.348947 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 could not be found. Sep 07 12:44:51.348947 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:44:51.354001 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9b79823b-745f-486e-98a2-bae8475db141 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] Returning 404 to user: Instance b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:44:51.355323 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9b79823b-745f-486e-98a2-bae8475db141 tempest-DeleteServersTestJSON-1071368198 tempest-DeleteServersTestJSON-1071368198-project] 10.222.0.16 "GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8" status: 404 len: 111 microversion: 2.1 time: 0.129405 Sep 07 12:44:51.357793 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1596/3163] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:51 2022] GET /compute/v2.1/servers/b05fbd40-21c6-4c6c-9039-887cf2b9e6d8 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:44:51.397374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3a7b21c6-3c46-448a-a9d9-3c1fee0f21ab tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:51.403962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3a7b21c6-3c46-448a-a9d9-3c1fee0f21ab tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:51.452795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a7b21c6-3c46-448a-a9d9-3c1fee0f21ab tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:51.454601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a7b21c6-3c46-448a-a9d9-3c1fee0f21ab tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:51.455386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a7b21c6-3c46-448a-a9d9-3c1fee0f21ab tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:51.459240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a7b21c6-3c46-448a-a9d9-3c1fee0f21ab tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:51.462573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a7b21c6-3c46-448a-a9d9-3c1fee0f21ab tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:51.464268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a7b21c6-3c46-448a-a9d9-3c1fee0f21ab tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:52.616468 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9ef17843-ad0f-4cdd-b9a6-f5a135b1c33c tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 1.823487 Sep 07 12:44:52.636257 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1568/3164] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Sep 7 12:44:50 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:52.662336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8df438d0-9351-4ad9-bb55-71fcf0f8aed8 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:52.669651 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8df438d0-9351-4ad9-bb55-71fcf0f8aed8 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: f7a91425-0aae-40bb-b720-071ac9ec52f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:52.710594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8df438d0-9351-4ad9-bb55-71fcf0f8aed8 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:52.711707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8df438d0-9351-4ad9-bb55-71fcf0f8aed8 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:52.712668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8df438d0-9351-4ad9-bb55-71fcf0f8aed8 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:52.714192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8df438d0-9351-4ad9-bb55-71fcf0f8aed8 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:52.716872 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8df438d0-9351-4ad9-bb55-71fcf0f8aed8 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:52.717879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8df438d0-9351-4ad9-bb55-71fcf0f8aed8 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:53.061300 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3a7b21c6-3c46-448a-a9d9-3c1fee0f21ab tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:53.102179 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3a7b21c6-3c46-448a-a9d9-3c1fee0f21ab tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1506 microversion: 2.1 time: 1.713562 Sep 07 12:44:53.106032 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1597/3165] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:51 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1506 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:53.117749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-83b385a4-b842-4998-b47b-acd12a164fc2 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-996576480"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:53.119259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-83b385a4-b842-4998-b47b-acd12a164fc2 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:53.155317 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83b385a4-b842-4998-b47b-acd12a164fc2 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:53.156393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83b385a4-b842-4998-b47b-acd12a164fc2 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:53.157243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83b385a4-b842-4998-b47b-acd12a164fc2 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:53.158712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83b385a4-b842-4998-b47b-acd12a164fc2 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:53.168690 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83b385a4-b842-4998-b47b-acd12a164fc2 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:53.169733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83b385a4-b842-4998-b47b-acd12a164fc2 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:53.530225 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8df438d0-9351-4ad9-bb55-71fcf0f8aed8 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:53.569203 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8df438d0-9351-4ad9-bb55-71fcf0f8aed8 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2" status: 200 len: 1324 microversion: 2.1 time: 0.927544 Sep 07 12:44:53.578062 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1569/3166] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:52 2022] GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2 => generated 1324 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:53.735330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-bf1929c0-04bf-40fa-96e6-796bc9a1bcab req-144b277c-e5da-4a4a-8da0-6ef6bc1e86dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a91425-0aae-40bb-b720-071ac9ec52f2", "name": "network-vif-plugged", "status": "completed", "tag": "6c0bc09c-cf07-4fe9-b562-595f55280547"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:53.780356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bf1929c0-04bf-40fa-96e6-796bc9a1bcab req-144b277c-e5da-4a4a-8da0-6ef6bc1e86dd service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:53.780656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bf1929c0-04bf-40fa-96e6-796bc9a1bcab req-144b277c-e5da-4a4a-8da0-6ef6bc1e86dd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:53.781060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bf1929c0-04bf-40fa-96e6-796bc9a1bcab req-144b277c-e5da-4a4a-8da0-6ef6bc1e86dd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:53.818468 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-bf1929c0-04bf-40fa-96e6-796bc9a1bcab req-144b277c-e5da-4a4a-8da0-6ef6bc1e86dd service nova] Creating event network-vif-plugged:6c0bc09c-cf07-4fe9-b562-595f55280547 for instance f7a91425-0aae-40bb-b720-071ac9ec52f2 on n-h2-852087-9 Sep 07 12:44:53.834286 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-bf1929c0-04bf-40fa-96e6-796bc9a1bcab req-144b277c-e5da-4a4a-8da0-6ef6bc1e86dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108099 Sep 07 12:44:53.834956 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1570/3167] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:53.924156 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.network.security_group_api [None req-83b385a4-b842-4998-b47b-acd12a164fc2 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Adding security group e484593e-9ab0-4467-838c-6e95391ad820 to port 6b1ac69f-da45-464f-94bf-5e56a21ce00a Sep 07 12:44:54.135333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-99fa788c-faba-4dca-8b1f-f0c2f1e5e8d8 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:54.137082 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-99fa788c-faba-4dca-8b1f-f0c2f1e5e8d8 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:54.156780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99fa788c-faba-4dca-8b1f-f0c2f1e5e8d8 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:54.159515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99fa788c-faba-4dca-8b1f-f0c2f1e5e8d8 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:54.162337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99fa788c-faba-4dca-8b1f-f0c2f1e5e8d8 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:54.165229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99fa788c-faba-4dca-8b1f-f0c2f1e5e8d8 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:54.169826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99fa788c-faba-4dca-8b1f-f0c2f1e5e8d8 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:54.170654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99fa788c-faba-4dca-8b1f-f0c2f1e5e8d8 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:54.831994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-99fa788c-faba-4dca-8b1f-f0c2f1e5e8d8 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:54.841001 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-99fa788c-faba-4dca-8b1f-f0c2f1e5e8d8 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1506 microversion: 2.1 time: 0.712286 Sep 07 12:44:54.841678 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1571/3168] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:54 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1506 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:44:54.861419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ca903594-be34-4958-99bb-773974c8f953 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:54.868888 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ca903594-be34-4958-99bb-773974c8f953 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: f7a91425-0aae-40bb-b720-071ac9ec52f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:54.899777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca903594-be34-4958-99bb-773974c8f953 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:54.900615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca903594-be34-4958-99bb-773974c8f953 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:54.901257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca903594-be34-4958-99bb-773974c8f953 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:54.902320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca903594-be34-4958-99bb-773974c8f953 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:54.902965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca903594-be34-4958-99bb-773974c8f953 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:54.906278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca903594-be34-4958-99bb-773974c8f953 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:55.832964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ca903594-be34-4958-99bb-773974c8f953 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:55.855556 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ca903594-be34-4958-99bb-773974c8f953 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2" status: 200 len: 1324 microversion: 2.1 time: 0.999211 Sep 07 12:44:55.857980 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1572/3169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:54 2022] GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2 => generated 1324 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:55.897201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-879cbb0b-dc0e-4a07-aeea-6688d00b7ae4 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:55.897201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-879cbb0b-dc0e-4a07-aeea-6688d00b7ae4 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:55.918366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-879cbb0b-dc0e-4a07-aeea-6688d00b7ae4 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:55.920415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-879cbb0b-dc0e-4a07-aeea-6688d00b7ae4 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:55.922246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-879cbb0b-dc0e-4a07-aeea-6688d00b7ae4 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:55.926257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-879cbb0b-dc0e-4a07-aeea-6688d00b7ae4 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:55.927168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-879cbb0b-dc0e-4a07-aeea-6688d00b7ae4 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:55.928049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-879cbb0b-dc0e-4a07-aeea-6688d00b7ae4 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:56.944747 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-83b385a4-b842-4998-b47b-acd12a164fc2 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "POST /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc/action" status: 202 len: 0 microversion: 2.1 time: 3.836317 Sep 07 12:44:56.949965 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1598/3170] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:44:53 2022] POST /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc/action => generated 0 bytes in 3840 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:44:56.972145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-879cbb0b-dc0e-4a07-aeea-6688d00b7ae4 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:57.003847 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-879cbb0b-dc0e-4a07-aeea-6688d00b7ae4 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1506 microversion: 2.1 time: 1.112658 Sep 07 12:44:57.004934 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1573/3171] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:55 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1506 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:44:57.030377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f472ada6-0abc-42a9-b921-a7e833e0de8d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:57.031466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f472ada6-0abc-42a9-b921-a7e833e0de8d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: f7a91425-0aae-40bb-b720-071ac9ec52f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:57.067226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f472ada6-0abc-42a9-b921-a7e833e0de8d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:57.070834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f472ada6-0abc-42a9-b921-a7e833e0de8d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:57.078989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f472ada6-0abc-42a9-b921-a7e833e0de8d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:57.080414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f472ada6-0abc-42a9-b921-a7e833e0de8d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:57.086992 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f472ada6-0abc-42a9-b921-a7e833e0de8d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:57.088000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f472ada6-0abc-42a9-b921-a7e833e0de8d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:57.305208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7d87bf35-c37a-445b-a77b-2c59a50736ce tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Action: 'create', calling method: .version_select at 0x7fc4181e7e50>, body: {"keypair": {"name": "tempest-keypair-829215161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJI/DQpqAnWPsJbJaC0rortlREy3DvhuuFoIlbfu8tqbuI8yFMPcJhP9xuD+rogl59QPpsx7otZtuSePCBclnPhFgjfLu7CuorIgIvatuPBkHm1cHrG5CJL9HiwmiOrUw=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:57.367882 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-7d87bf35-c37a-445b-a77b-2c59a50736ce tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Getting quotas for project edd12d086d6b4a1a85b6b491aa3c3fd9. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:44:57.390598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-7d87bf35-c37a-445b-a77b-2c59a50736ce tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Getting quotas for user 4d2c5f9ea748432aaa877fb6dcde4462 and project edd12d086d6b4a1a85b6b491aa3c3fd9. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:44:57.459605 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7d87bf35-c37a-445b-a77b-2c59a50736ce tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.510370 Sep 07 12:44:57.461548 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1599/3172] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Sep 7 12:44:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 514 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 07 12:44:57.473290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-78914031-8f70-4e8b-97ac-c1c436fad035 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-996576480"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:57.475083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-78914031-8f70-4e8b-97ac-c1c436fad035 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:57.489409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78914031-8f70-4e8b-97ac-c1c436fad035 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:57.491993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78914031-8f70-4e8b-97ac-c1c436fad035 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:57.495239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78914031-8f70-4e8b-97ac-c1c436fad035 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:57.497072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78914031-8f70-4e8b-97ac-c1c436fad035 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:57.498373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78914031-8f70-4e8b-97ac-c1c436fad035 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:57.499502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78914031-8f70-4e8b-97ac-c1c436fad035 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:57.778900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f472ada6-0abc-42a9-b921-a7e833e0de8d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:57.809941 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f472ada6-0abc-42a9-b921-a7e833e0de8d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2" status: 200 len: 1522 microversion: 2.1 time: 0.800770 Sep 07 12:44:57.813956 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1574/3173] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:57 2022] GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2 => generated 1522 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:57.822057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-d06b2265-a50f-4b9b-9122-94bf1377377d req-e93831bd-6cbb-429f-998c-f67738e77103 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca300ad8-1300-4adf-940f-8cc52f13d8dc", "tag": "6b1ac69f-da45-464f-94bf-5e56a21ce00a"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:57.848625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d06b2265-a50f-4b9b-9122-94bf1377377d req-e93831bd-6cbb-429f-998c-f67738e77103 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:57.849563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d06b2265-a50f-4b9b-9122-94bf1377377d req-e93831bd-6cbb-429f-998c-f67738e77103 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:57.852922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d06b2265-a50f-4b9b-9122-94bf1377377d req-e93831bd-6cbb-429f-998c-f67738e77103 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:57.874116 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-d06b2265-a50f-4b9b-9122-94bf1377377d req-e93831bd-6cbb-429f-998c-f67738e77103 service nova] Creating event network-changed:6b1ac69f-da45-464f-94bf-5e56a21ce00a for instance ca300ad8-1300-4adf-940f-8cc52f13d8dc on n-h2-852087-9 Sep 07 12:44:57.880673 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-d06b2265-a50f-4b9b-9122-94bf1377377d req-e93831bd-6cbb-429f-998c-f67738e77103 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064865 Sep 07 12:44:57.881385 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1575/3174] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:57.903444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-14c15161-2338-400d-8917-ca04fcf5e97b tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Calling method '.version_select at 0x7fc418c67940>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:57.914303 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-14c15161-2338-400d-8917-ca04fcf5e97b tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-829215161" status: 200 len: 512 microversion: 2.2 time: 0.021615 Sep 07 12:44:57.915257 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1576/3175] 10.222.0.16 () {60 vars in 1255 bytes} [Wed Sep 7 12:44:57 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-829215161 => generated 512 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:57.920471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-03cb8bf3-0e87-434a-9175-6c4b958816f0 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:57.921541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-03cb8bf3-0e87-434a-9175-6c4b958816f0 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: f7a91425-0aae-40bb-b720-071ac9ec52f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:57.928892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03cb8bf3-0e87-434a-9175-6c4b958816f0 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:57.929644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03cb8bf3-0e87-434a-9175-6c4b958816f0 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:57.930186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03cb8bf3-0e87-434a-9175-6c4b958816f0 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:57.931030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03cb8bf3-0e87-434a-9175-6c4b958816f0 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:57.931571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03cb8bf3-0e87-434a-9175-6c4b958816f0 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:57.932101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03cb8bf3-0e87-434a-9175-6c4b958816f0 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:58.008239 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-03cb8bf3-0e87-434a-9175-6c4b958816f0 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: f7a91425-0aae-40bb-b720-071ac9ec52f2] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:44:58.192614 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-03cb8bf3-0e87-434a-9175-6c4b958816f0 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2" status: 204 len: 0 microversion: 2.1 time: 0.275539 Sep 07 12:44:58.193642 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1577/3176] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:44:57 2022] DELETE /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:44:58.306064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-26d2d897-adf0-42a4-b9b8-1924c094f88c tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Action: 'create', calling method: .version_select at 0x7fc4196ce5e0>, body: {"keypair": {"name": "tempest-keypair-1054873302", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTLhbyXXPv2Ej7cvqTTYJSh7QwWqwefUOvN4ha16i4zG3si0M8l9EtO2LJ7ZVZ4PoWm9yGYAUjbMC1tej3wwmJWCBULT2kQS/++wg93zCl+NLXTR1oGS7L3Yphna9YAtQ=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:58.334949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-26d2d897-adf0-42a4-b9b8-1924c094f88c tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Getting quotas for project 8d5a02ff920d478983e39d3c1bd62b97. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:44:58.342132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-26d2d897-adf0-42a4-b9b8-1924c094f88c tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Getting quotas for user 62581f838674471fadf9609a3135d4b2 and project 8d5a02ff920d478983e39d3c1bd62b97. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:44:58.378252 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-26d2d897-adf0-42a4-b9b8-1924c094f88c tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.175377 Sep 07 12:44:58.379493 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1578/3177] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 12:44:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:44:58.400416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-51ab6223-1370-4b76-ad8a-4795591346a9 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Calling method '.version_select at 0x7fc41d1908b0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:58.437994 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-51ab6223-1370-4b76-ad8a-4795591346a9 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-829215161" status: 204 len: 0 microversion: 2.2 time: 0.047045 Sep 07 12:44:58.439426 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1579/3178] 10.222.0.16 () {60 vars in 1258 bytes} [Wed Sep 7 12:44:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-829215161 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:44:58.449398 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-24c62558-ab18-4af8-b0bc-99e06f1f997e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:58.450929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-24c62558-ab18-4af8-b0bc-99e06f1f997e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:58.461998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24c62558-ab18-4af8-b0bc-99e06f1f997e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:58.462854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24c62558-ab18-4af8-b0bc-99e06f1f997e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:58.463568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24c62558-ab18-4af8-b0bc-99e06f1f997e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:58.464529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24c62558-ab18-4af8-b0bc-99e06f1f997e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:58.465631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24c62558-ab18-4af8-b0bc-99e06f1f997e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:58.466437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24c62558-ab18-4af8-b0bc-99e06f1f997e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:58.644439 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.network.security_group_api [None req-78914031-8f70-4e8b-97ac-c1c436fad035 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Removing security group e484593e-9ab0-4467-838c-6e95391ad820 from port 6b1ac69f-da45-464f-94bf-5e56a21ce00a Sep 07 12:44:58.906706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-24c62558-ab18-4af8-b0bc-99e06f1f997e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:58.922602 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-24c62558-ab18-4af8-b0bc-99e06f1f997e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1506 microversion: 2.1 time: 0.481044 Sep 07 12:44:58.923390 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1580/3179] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:58 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1506 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:58.928779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-03705d5e-e67b-4fb7-af2f-5075c80f27a3 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:58.933146 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-03705d5e-e67b-4fb7-af2f-5075c80f27a3 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: f7a91425-0aae-40bb-b720-071ac9ec52f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:58.949397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03705d5e-e67b-4fb7-af2f-5075c80f27a3 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:58.949946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03705d5e-e67b-4fb7-af2f-5075c80f27a3 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:58.950399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03705d5e-e67b-4fb7-af2f-5075c80f27a3 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:58.951673 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03705d5e-e67b-4fb7-af2f-5075c80f27a3 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:58.952299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03705d5e-e67b-4fb7-af2f-5075c80f27a3 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:58.953037 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03705d5e-e67b-4fb7-af2f-5075c80f27a3 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:59.638742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-03705d5e-e67b-4fb7-af2f-5075c80f27a3 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:44:59.650821 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-03705d5e-e67b-4fb7-af2f-5075c80f27a3 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2" status: 200 len: 1528 microversion: 2.1 time: 0.726077 Sep 07 12:44:59.651498 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1581/3180] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:58 2022] GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2 => generated 1528 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:44:59.676278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ebde9e0-8680-42ed-b8cd-97e59a77f30b tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Action: 'create', calling method: .version_select at 0x7fc41d1ceaf0>, body: {"keypair": {"name": "tempest-keypair-2117070194", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLILQ3hbByiDfIAvVXOPvdUqTyvFWO7aoAfhvBFzu3bLr3jqq7e4hBIkNnzk5+MNVxxA2melpR4gUaP3g9O9GvBQ80Qv86UKgLbKDKOwB+o2Idg+C5B9qy1f4bAuNW/jkA=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:59.711880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-3ebde9e0-8680-42ed-b8cd-97e59a77f30b tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Getting quotas for project edd12d086d6b4a1a85b6b491aa3c3fd9. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:44:59.719215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-3ebde9e0-8680-42ed-b8cd-97e59a77f30b tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Getting quotas for user 4d2c5f9ea748432aaa877fb6dcde4462 and project edd12d086d6b4a1a85b6b491aa3c3fd9. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:44:59.751901 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ebde9e0-8680-42ed-b8cd-97e59a77f30b tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.095556 Sep 07 12:44:59.753542 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1582/3181] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Sep 7 12:44:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 98 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 07 12:44:59.772444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f6eb52f1-abe5-437c-a5eb-c2aa7236862d tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Calling method '.version_select at 0x7fc4192be040>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:59.829027 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f6eb52f1-abe5-437c-a5eb-c2aa7236862d tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2117070194" status: 204 len: 0 microversion: 2.2 time: 0.065577 Sep 07 12:44:59.836393 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1583/3182] 10.222.0.16 () {60 vars in 1261 bytes} [Wed Sep 7 12:44:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2117070194 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:44:59.847736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c7a0908-8db5-46b7-8353-a9ac529ceb35 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Action: 'create', calling method: .version_select at 0x7fc418a263a0>, body: {"keypair": {"name": "tempest-keypair-1149651710", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:44:59.861600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=5,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:44:59.867802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-7c7a0908-8db5-46b7-8353-a9ac529ceb35 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Getting quotas for project edd12d086d6b4a1a85b6b491aa3c3fd9. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:44:59.875854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-7c7a0908-8db5-46b7-8353-a9ac529ceb35 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Getting quotas for user 4d2c5f9ea748432aaa877fb6dcde4462 and project edd12d086d6b4a1a85b6b491aa3c3fd9. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:44:59.909632 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7c7a0908-8db5-46b7-8353-a9ac529ceb35 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.066039 Sep 07 12:44:59.911448 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1584/3183] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Sep 7 12:44:59 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 68 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 07 12:44:59.922349 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5619a786-ebfa-44f2-bd32-29519744602b tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Calling method '.version_select at 0x7fc419552310>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:59.957231 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5619a786-ebfa-44f2-bd32-29519744602b tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1149651710" status: 204 len: 0 microversion: 2.2 time: 0.037988 Sep 07 12:44:59.958785 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1585/3184] 10.222.0.16 () {60 vars in 1261 bytes} [Wed Sep 7 12:44:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1149651710 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:44:59.966273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e456e4b7-237a-436f-b005-dcc43d7984a7 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:44:59.967493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e456e4b7-237a-436f-b005-dcc43d7984a7 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:44:59.979467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e456e4b7-237a-436f-b005-dcc43d7984a7 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:59.985863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e456e4b7-237a-436f-b005-dcc43d7984a7 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:59.986757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e456e4b7-237a-436f-b005-dcc43d7984a7 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:44:59.987882 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e456e4b7-237a-436f-b005-dcc43d7984a7 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:44:59.988441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e456e4b7-237a-436f-b005-dcc43d7984a7 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:44:59.989938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e456e4b7-237a-436f-b005-dcc43d7984a7 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:00.226279 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-78914031-8f70-4e8b-97ac-c1c436fad035 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "POST /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc/action" status: 202 len: 0 microversion: 2.1 time: 2.762186 Sep 07 12:45:00.231519 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1600/3185] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:44:57 2022] POST /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc/action => generated 0 bytes in 2765 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:45:00.252447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c95c3543-bff7-4319-9ae8-93be4169d3b2 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Action: 'create', calling method: .version_select at 0x7fc418fd49d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1520599271", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTUATFnhgaGPf0A2mJp0VXGYgUHB/oOipFiEkas9UR+hVPlEeNUJdoRfIBUUhL074/gGqquXLCGdhBHy0dY9eyN5aMcDXlKGk6CNn/WBrdVTnKhEkmW+fzqVNRKR77BUQ=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:00.284165 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:45:00.305517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-c95c3543-bff7-4319-9ae8-93be4169d3b2 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Getting quotas for project edd12d086d6b4a1a85b6b491aa3c3fd9. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:45:00.319899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-c95c3543-bff7-4319-9ae8-93be4169d3b2 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Getting quotas for user 4d2c5f9ea748432aaa877fb6dcde4462 and project edd12d086d6b4a1a85b6b491aa3c3fd9. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:45:00.392923 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c95c3543-bff7-4319-9ae8-93be4169d3b2 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.160344 Sep 07 12:45:00.407279 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1601/3186] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Sep 7 12:45:00 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 179 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 07 12:45:00.420524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-941ad5c5-b4d6-4180-98bc-85a9271b4893 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Action: 'create', calling method: .version_select at 0x7fc4181e3280>, body: {"pool": null} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:01.035556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e456e4b7-237a-436f-b005-dcc43d7984a7 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:01.053349 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e456e4b7-237a-436f-b005-dcc43d7984a7 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1506 microversion: 2.1 time: 1.091983 Sep 07 12:45:01.054467 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1586/3187] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:44:59 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1506 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:01.065836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d65065d0-9069-4a31-aa69-a8db2f6248f6 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Action: 'create', calling method: .version_select at 0x7fc4183d21f0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1221981429", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUhJhvY2Y7fPnO5Qp9uVDqZvr3aDyXEbSczyL3l+fSYPkN+Bbh3IwScsNhu+WnB6o7f7oK/jNWhEfPUS02YrmvEyHFJVK0HkYsLcjtSS4zna1oOMMl04KP93rZU1vr+CQ=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:01.094233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-d65065d0-9069-4a31-aa69-a8db2f6248f6 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Getting quotas for project edd12d086d6b4a1a85b6b491aa3c3fd9. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:45:01.111428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-d65065d0-9069-4a31-aa69-a8db2f6248f6 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Getting quotas for user 4d2c5f9ea748432aaa877fb6dcde4462 and project edd12d086d6b4a1a85b6b491aa3c3fd9. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:45:01.149386 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d65065d0-9069-4a31-aa69-a8db2f6248f6 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.091254 Sep 07 12:45:01.150727 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1587/3188] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Sep 7 12:45:01 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 95 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 07 12:45:01.157640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-87e78415-d63e-4bb6-81da-2202b3921fc0 req-c4988936-0e08-4370-8402-75186a6a990a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca300ad8-1300-4adf-940f-8cc52f13d8dc", "tag": "6b1ac69f-da45-464f-94bf-5e56a21ce00a"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:01.171239 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-87e78415-d63e-4bb6-81da-2202b3921fc0 req-c4988936-0e08-4370-8402-75186a6a990a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:01.171750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-87e78415-d63e-4bb6-81da-2202b3921fc0 req-c4988936-0e08-4370-8402-75186a6a990a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:01.172196 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-87e78415-d63e-4bb6-81da-2202b3921fc0 req-c4988936-0e08-4370-8402-75186a6a990a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:01.185128 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-87e78415-d63e-4bb6-81da-2202b3921fc0 req-c4988936-0e08-4370-8402-75186a6a990a service nova] Creating event network-changed:6b1ac69f-da45-464f-94bf-5e56a21ce00a for instance ca300ad8-1300-4adf-940f-8cc52f13d8dc on n-h2-852087-9 Sep 07 12:45:01.191331 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-87e78415-d63e-4bb6-81da-2202b3921fc0 req-c4988936-0e08-4370-8402-75186a6a990a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038168 Sep 07 12:45:01.192657 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1588/3189] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:45:01.199305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-efef5fdb-f2d6-49c9-8204-7a65d46591b1 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1242598007", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e5c38840-0845-4ebc-a7c5-dbf102469c78"}], "security_groups": [{"name": "tempest-securitygroup--1084555778"}], "key_name": "tempest-keypair-1054873302", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:02.250317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-efef5fdb-f2d6-49c9-8204-7a65d46591b1 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] validate_networks() for [('e5c38840-0845-4ebc-a7c5-dbf102469c78', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:45:04.818923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-efef5fdb-f2d6-49c9-8204-7a65d46591b1 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Getting quotas for project 8d5a02ff920d478983e39d3c1bd62b97. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:45:04.831999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-efef5fdb-f2d6-49c9-8204-7a65d46591b1 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Getting quotas for user 62581f838674471fadf9609a3135d4b2 and project 8d5a02ff920d478983e39d3c1bd62b97. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:45:04.863148 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-efef5fdb-f2d6-49c9-8204-7a65d46591b1 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:45:04.864437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-efef5fdb-f2d6-49c9-8204-7a65d46591b1 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:45:04.865581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-efef5fdb-f2d6-49c9-8204-7a65d46591b1 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:45:04.866577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-efef5fdb-f2d6-49c9-8204-7a65d46591b1 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:45:04.867615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-efef5fdb-f2d6-49c9-8204-7a65d46591b1 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:45:04.897834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efef5fdb-f2d6-49c9-8204-7a65d46591b1 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:04.899013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efef5fdb-f2d6-49c9-8204-7a65d46591b1 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:04.900064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efef5fdb-f2d6-49c9-8204-7a65d46591b1 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:04.901742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efef5fdb-f2d6-49c9-8204-7a65d46591b1 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:04.903107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efef5fdb-f2d6-49c9-8204-7a65d46591b1 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:04.904354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efef5fdb-f2d6-49c9-8204-7a65d46591b1 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:04.945526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-efef5fdb-f2d6-49c9-8204-7a65d46591b1 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Getting quotas for project 8d5a02ff920d478983e39d3c1bd62b97. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:45:04.958160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-efef5fdb-f2d6-49c9-8204-7a65d46591b1 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Getting quotas for user 62581f838674471fadf9609a3135d4b2 and project 8d5a02ff920d478983e39d3c1bd62b97. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:45:04.994188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-efef5fdb-f2d6-49c9-8204-7a65d46591b1 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:45:05.000178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-efef5fdb-f2d6-49c9-8204-7a65d46591b1 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] [instance: 87931dc7-3c20-4661-8653-972aacfec19e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:45:05.141311 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-efef5fdb-f2d6-49c9-8204-7a65d46591b1 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.946696 Sep 07 12:45:05.143344 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1589/3190] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:45:01 2022] POST /compute/v2.1/servers => generated 407 bytes in 3950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:45:05.153088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d04dbd1e-ba86-4524-8ae7-6129b5aec171 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:05.154952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d04dbd1e-ba86-4524-8ae7-6129b5aec171 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: f7a91425-0aae-40bb-b720-071ac9ec52f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:05.172069 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d04dbd1e-ba86-4524-8ae7-6129b5aec171 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:05.173796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d04dbd1e-ba86-4524-8ae7-6129b5aec171 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:05.175521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d04dbd1e-ba86-4524-8ae7-6129b5aec171 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:05.178241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d04dbd1e-ba86-4524-8ae7-6129b5aec171 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:05.181801 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d04dbd1e-ba86-4524-8ae7-6129b5aec171 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:05.184048 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d04dbd1e-ba86-4524-8ae7-6129b5aec171 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:05.251399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d04dbd1e-ba86-4524-8ae7-6129b5aec171 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:05.252283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d04dbd1e-ba86-4524-8ae7-6129b5aec171 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:05.252938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d04dbd1e-ba86-4524-8ae7-6129b5aec171 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:05.253712 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-d04dbd1e-ba86-4524-8ae7-6129b5aec171 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lazy-loading 'fault' on Instance uuid f7a91425-0aae-40bb-b720-071ac9ec52f2 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:45:05.772776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d04dbd1e-ba86-4524-8ae7-6129b5aec171 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d1c1e891c470c99e7c968b908a054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feb4e290866f4f54b2b99733b56cb7bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:05.786944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:45:05.815976 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d04dbd1e-ba86-4524-8ae7-6129b5aec171 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2" status: 200 len: 1314 microversion: 2.1 time: 0.670278 Sep 07 12:45:05.878376 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1590/3191] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:05 2022] GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2 => generated 1314 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:05.892090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0e1c4f3b-b1ed-4e9e-a37e-185ff983236d tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Action: 'create', calling method: .version_select at 0x7fc418d54c10>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-925646975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArdv55bgT+Poau3wzZSqea+d3CNOhu61FdXbxsvfmOteYJfqgcFV9X15sh+zpHx/MVvmRRiGtZS6iKKHguXYu6i8ImdX8asGFxP00MJZrrNHrvJgd+ohvsFlFgjdZZ1aw=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:05.976678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-0e1c4f3b-b1ed-4e9e-a37e-185ff983236d tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Getting quotas for project edd12d086d6b4a1a85b6b491aa3c3fd9. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:45:05.996901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-0e1c4f3b-b1ed-4e9e-a37e-185ff983236d tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Getting quotas for user 4d2c5f9ea748432aaa877fb6dcde4462 and project edd12d086d6b4a1a85b6b491aa3c3fd9. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:45:06.045273 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0e1c4f3b-b1ed-4e9e-a37e-185ff983236d tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.162650 Sep 07 12:45:06.047837 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1591/3192] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Sep 7 12:45:05 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 169 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 07 12:45:06.062341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7e80bbd9-aef9-45cf-b3a8-4a506f95496d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:06.064061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7e80bbd9-aef9-45cf-b3a8-4a506f95496d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:06.072375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e80bbd9-aef9-45cf-b3a8-4a506f95496d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:06.073283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e80bbd9-aef9-45cf-b3a8-4a506f95496d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:06.074153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e80bbd9-aef9-45cf-b3a8-4a506f95496d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:06.075197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e80bbd9-aef9-45cf-b3a8-4a506f95496d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:06.076042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e80bbd9-aef9-45cf-b3a8-4a506f95496d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:06.076907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7e80bbd9-aef9-45cf-b3a8-4a506f95496d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:06.903027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7e80bbd9-aef9-45cf-b3a8-4a506f95496d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:06.911755 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7e80bbd9-aef9-45cf-b3a8-4a506f95496d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1506 microversion: 2.1 time: 0.862307 Sep 07 12:45:06.913057 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1592/3193] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:06 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1506 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:06.918214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-b5982efb-9916-4d98-be3c-4fb3f1a33315 req-5c3e9e6e-19c7-411d-818f-40d5d7b6d820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a91425-0aae-40bb-b720-071ac9ec52f2", "name": "network-vif-deleted", "tag": "6c0bc09c-cf07-4fe9-b562-595f55280547"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:06.935359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b5982efb-9916-4d98-be3c-4fb3f1a33315 req-5c3e9e6e-19c7-411d-818f-40d5d7b6d820 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:06.935877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b5982efb-9916-4d98-be3c-4fb3f1a33315 req-5c3e9e6e-19c7-411d-818f-40d5d7b6d820 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:06.938861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b5982efb-9916-4d98-be3c-4fb3f1a33315 req-5c3e9e6e-19c7-411d-818f-40d5d7b6d820 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:06.956051 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-b5982efb-9916-4d98-be3c-4fb3f1a33315 req-5c3e9e6e-19c7-411d-818f-40d5d7b6d820 service nova] Creating event network-vif-deleted:6c0bc09c-cf07-4fe9-b562-595f55280547 for instance f7a91425-0aae-40bb-b720-071ac9ec52f2 on n-h2-852087-9 Sep 07 12:45:06.964063 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-b5982efb-9916-4d98-be3c-4fb3f1a33315 req-5c3e9e6e-19c7-411d-818f-40d5d7b6d820 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049067 Sep 07 12:45:06.966052 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1593/3194] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:45:06.974195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-95acf938-a373-4030-a474-164d755cfe02 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:06.975529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-95acf938-a373-4030-a474-164d755cfe02 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] [instance: 87931dc7-3c20-4661-8653-972aacfec19e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:06.984023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95acf938-a373-4030-a474-164d755cfe02 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:06.984922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95acf938-a373-4030-a474-164d755cfe02 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:06.985831 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95acf938-a373-4030-a474-164d755cfe02 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:06.987389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95acf938-a373-4030-a474-164d755cfe02 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:06.988076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95acf938-a373-4030-a474-164d755cfe02 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:06.988707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95acf938-a373-4030-a474-164d755cfe02 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:07.161746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-95acf938-a373-4030-a474-164d755cfe02 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62581f838674471fadf9609a3135d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a02ff920d478983e39d3c1bd62b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:07.188893 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-95acf938-a373-4030-a474-164d755cfe02 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] 10.222.0.16 "GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e" status: 200 len: 1322 microversion: 2.1 time: 0.219828 Sep 07 12:45:07.190842 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1594/3195] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:06 2022] GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:07.208228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2b71d412-3173-4ae9-9ee7-94298dbc192a tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Calling method '.version_select at 0x7fc4192dc310>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:07.218772 n-d-852087-9 devstack@n-api.service[122433]: WARNING oslo_db.sqlalchemy.utils [None req-2b71d412-3173-4ae9-9ee7-94298dbc192a tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 07 12:45:07.245511 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2b71d412-3173-4ae9-9ee7-94298dbc192a tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.051009 Sep 07 12:45:07.246308 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1595/3196] 10.222.0.16 () {60 vars in 1177 bytes} [Wed Sep 7 12:45:07 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:07.257811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-69f4d973-bf5e-4971-9898-f5cb25cf681a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:07.258439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-69f4d973-bf5e-4971-9898-f5cb25cf681a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: f7a91425-0aae-40bb-b720-071ac9ec52f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:07.267421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69f4d973-bf5e-4971-9898-f5cb25cf681a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:07.268274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69f4d973-bf5e-4971-9898-f5cb25cf681a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:07.268941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69f4d973-bf5e-4971-9898-f5cb25cf681a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:07.270032 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69f4d973-bf5e-4971-9898-f5cb25cf681a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:07.270694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69f4d973-bf5e-4971-9898-f5cb25cf681a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:07.271290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69f4d973-bf5e-4971-9898-f5cb25cf681a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:07.291265 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-69f4d973-bf5e-4971-9898-f5cb25cf681a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] HTTP exception thrown: Instance f7a91425-0aae-40bb-b720-071ac9ec52f2 could not be found. Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-69f4d973-bf5e-4971-9898-f5cb25cf681a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Request method failure captured: Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2 HTTP/1.1 Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJGQYbyJLIsXxXjgkDYN7LwAZ3FIxjt-YGkXt1Xo1a1MUwTVDulf3qar21KhPKqmmgY5XowXVa7QiIPma2KSUUJYmnQLgFXdiW6Ghu6fpYXXYUWnHmYT3Op2c2gidR2lsMRLQPmqnvHgSb4f0Vzgm_QdSzSUbn3j0rcW4vT7twxuCxo Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: ac0d1c1e891c470c99e7c968b908a054 Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance f7a91425-0aae-40bb-b720-071ac9ec52f2 could not be found. Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'f7a91425-0aae-40bb-b720-071ac9ec52f2'} Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7a91425-0aae-40bb-b720-071ac9ec52f2 could not be found. Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7a91425-0aae-40bb-b720-071ac9ec52f2 could not be found. Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:07.293024 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:07.298507 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:07.298507 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:07.298507 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:45:07.298507 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:45:07.298507 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:45:07.298507 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:45:07.298507 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7a91425-0aae-40bb-b720-071ac9ec52f2 could not be found. Sep 07 12:45:07.298507 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:07.298507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-69f4d973-bf5e-4971-9898-f5cb25cf681a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Returning 404 to user: Instance f7a91425-0aae-40bb-b720-071ac9ec52f2 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:45:07.298507 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-69f4d973-bf5e-4971-9898-f5cb25cf681a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2" status: 404 len: 111 microversion: 2.1 time: 0.040841 Sep 07 12:45:07.298507 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1596/3197] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:07 2022] GET /compute/v2.1/servers/f7a91425-0aae-40bb-b720-071ac9ec52f2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:45:07.301283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ae077b7-9da0-48bd-a3b9-af93602f2a43 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Calling method '.version_select at 0x7fc418508280>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:07.333070 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ae077b7-9da0-48bd-a3b9-af93602f2a43 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-925646975" status: 204 len: 0 microversion: 2.2 time: 0.036282 Sep 07 12:45:07.338410 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1597/3198] 10.222.0.16 () {60 vars in 1318 bytes} [Wed Sep 7 12:45:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-925646975 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:45:07.345542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e8632913-d961-4b03-97a2-0b75792664ad tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '.version_select at 0x7fc4192ac8b0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:07.387693 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-e8632913-d961-4b03-97a2-0b75792664ad tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] HTTP exception thrown: Image not found. Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e8632913-d961-4b03-97a2-0b75792664ad tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Request method failure captured: Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/images/c8fb60a0-5b20-4982-9520-fe7723de97a3 HTTP/1.1 Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJGQYbyJLIsXxXjgkDYN7LwAZ3FIxjt-YGkXt1Xo1a1MUwTVDulf3qar21KhPKqmmgY5XowXVa7QiIPma2KSUUJYmnQLgFXdiW6Ghu6fpYXXYUWnHmYT3Op2c2gidR2lsMRLQPmqnvHgSb4f0Vzgm_QdSzSUbn3j0rcW4vT7twxuCxo Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: ac0d1c1e891c470c99e7c968b908a054 Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: exception: Image not found. Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'c8fb60a0-5b20-4982-9520-fe7723de97a3'} Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c8fb60a0-5b20-4982-9520-fe7723de97a3 to delete Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c8fb60a0-5b20-4982-9520-fe7723de97a3 could not be found. Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:07.390428 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:07.399067 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:07.399067 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:45:07.399067 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:45:07.399067 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:45:07.399067 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:45:07.399067 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:45:07.399067 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:45:07.399067 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:45:07.399067 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:45:07.399067 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 07 12:45:07.399067 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 12:45:07.399067 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 12:45:07.399067 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:07.399067 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:07.399067 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:07.399067 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:07.399067 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:45:07.399067 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:45:07.399067 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:45:07.399067 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:45:07.399067 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 12:45:07.399067 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:07.399067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e8632913-d961-4b03-97a2-0b75792664ad tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Returning 404 to user: Image not found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:45:07.399067 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e8632913-d961-4b03-97a2-0b75792664ad tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "DELETE /compute/v2.1/images/c8fb60a0-5b20-4982-9520-fe7723de97a3" status: 404 len: 62 microversion: 2.1 time: 0.052541 Sep 07 12:45:07.399067 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1598/3199] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:07 2022] DELETE /compute/v2.1/images/c8fb60a0-5b20-4982-9520-fe7723de97a3 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:45:07.407066 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1ce358db-b8a2-4c8a-91a8-116e35f090ea tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Calling method '.version_select at 0x7fc4192acc10>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:07.437239 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1ce358db-b8a2-4c8a-91a8-116e35f090ea tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1221981429" status: 204 len: 0 microversion: 2.2 time: 0.042519 Sep 07 12:45:07.442906 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1599/3200] 10.222.0.16 () {60 vars in 1321 bytes} [Wed Sep 7 12:45:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1221981429 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:45:07.457401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-842a7a1c-07a6-4bcb-859b-e2566a4f2b74 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:07.458050 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-842a7a1c-07a6-4bcb-859b-e2566a4f2b74 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:07.470099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-842a7a1c-07a6-4bcb-859b-e2566a4f2b74 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:07.471771 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-842a7a1c-07a6-4bcb-859b-e2566a4f2b74 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:07.473385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-842a7a1c-07a6-4bcb-859b-e2566a4f2b74 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:07.474476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-842a7a1c-07a6-4bcb-859b-e2566a4f2b74 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:07.475236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-842a7a1c-07a6-4bcb-859b-e2566a4f2b74 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:07.475891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-842a7a1c-07a6-4bcb-859b-e2566a4f2b74 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:07.508383 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-842a7a1c-07a6-4bcb-859b-e2566a4f2b74 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] HTTP exception thrown: Instance 023e989d-cb87-4aea-a0c8-7123ad57c4f2 could not be found. Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-842a7a1c-07a6-4bcb-859b-e2566a4f2b74 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Request method failure captured: Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 HTTP/1.1 Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJGQYbyJLIsXxXjgkDYN7LwAZ3FIxjt-YGkXt1Xo1a1MUwTVDulf3qar21KhPKqmmgY5XowXVa7QiIPma2KSUUJYmnQLgFXdiW6Ghu6fpYXXYUWnHmYT3Op2c2gidR2lsMRLQPmqnvHgSb4f0Vzgm_QdSzSUbn3j0rcW4vT7twxuCxo Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: ac0d1c1e891c470c99e7c968b908a054 Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 023e989d-cb87-4aea-a0c8-7123ad57c4f2 could not be found. Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '023e989d-cb87-4aea-a0c8-7123ad57c4f2'} Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 023e989d-cb87-4aea-a0c8-7123ad57c4f2 could not be found. Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:45:07.510840 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:45:07.516902 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 023e989d-cb87-4aea-a0c8-7123ad57c4f2 could not be found. Sep 07 12:45:07.516902 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:07.516902 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:07.516902 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:07.516902 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:07.516902 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:45:07.516902 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:45:07.516902 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:45:07.516902 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:45:07.516902 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 023e989d-cb87-4aea-a0c8-7123ad57c4f2 could not be found. Sep 07 12:45:07.516902 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:07.516902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-842a7a1c-07a6-4bcb-859b-e2566a4f2b74 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Returning 404 to user: Instance 023e989d-cb87-4aea-a0c8-7123ad57c4f2 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:45:07.519703 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-842a7a1c-07a6-4bcb-859b-e2566a4f2b74 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "DELETE /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 404 len: 111 microversion: 2.1 time: 0.074159 Sep 07 12:45:07.524389 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1600/3201] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:45:07 2022] DELETE /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:45:07.530130 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a63a2313-1492-4a27-b5dd-e247dffe222b tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Calling method '.version_select at 0x7fc41d1909d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:07.564743 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a63a2313-1492-4a27-b5dd-e247dffe222b tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1520599271" status: 204 len: 0 microversion: 2.2 time: 0.037032 Sep 07 12:45:07.567413 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1601/3202] 10.222.0.16 () {60 vars in 1321 bytes} [Wed Sep 7 12:45:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1520599271 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:45:07.588637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f14ea37b-e2dc-4ab6-88be-bbf5ac3e5a58 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:07.590669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f14ea37b-e2dc-4ab6-88be-bbf5ac3e5a58 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 023e989d-cb87-4aea-a0c8-7123ad57c4f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:07.599279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=31 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:45:07.608451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f14ea37b-e2dc-4ab6-88be-bbf5ac3e5a58 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:07.616671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f14ea37b-e2dc-4ab6-88be-bbf5ac3e5a58 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:07.617215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f14ea37b-e2dc-4ab6-88be-bbf5ac3e5a58 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:07.618186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f14ea37b-e2dc-4ab6-88be-bbf5ac3e5a58 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:07.618683 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f14ea37b-e2dc-4ab6-88be-bbf5ac3e5a58 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:07.619316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f14ea37b-e2dc-4ab6-88be-bbf5ac3e5a58 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:07.641416 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-f14ea37b-e2dc-4ab6-88be-bbf5ac3e5a58 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] HTTP exception thrown: Instance 023e989d-cb87-4aea-a0c8-7123ad57c4f2 could not be found. Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f14ea37b-e2dc-4ab6-88be-bbf5ac3e5a58 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Request method failure captured: Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 HTTP/1.1 Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJGQYbyJLIsXxXjgkDYN7LwAZ3FIxjt-YGkXt1Xo1a1MUwTVDulf3qar21KhPKqmmgY5XowXVa7QiIPma2KSUUJYmnQLgFXdiW6Ghu6fpYXXYUWnHmYT3Op2c2gidR2lsMRLQPmqnvHgSb4f0Vzgm_QdSzSUbn3j0rcW4vT7twxuCxo Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: ac0d1c1e891c470c99e7c968b908a054 Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 023e989d-cb87-4aea-a0c8-7123ad57c4f2 could not be found. Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '023e989d-cb87-4aea-a0c8-7123ad57c4f2'} Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 023e989d-cb87-4aea-a0c8-7123ad57c4f2 could not be found. Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 023e989d-cb87-4aea-a0c8-7123ad57c4f2 could not be found. Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:07.642908 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:07.650254 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:07.650254 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:07.650254 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:45:07.650254 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:45:07.650254 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:45:07.650254 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:45:07.650254 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 023e989d-cb87-4aea-a0c8-7123ad57c4f2 could not be found. Sep 07 12:45:07.650254 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:07.650254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f14ea37b-e2dc-4ab6-88be-bbf5ac3e5a58 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Returning 404 to user: Instance 023e989d-cb87-4aea-a0c8-7123ad57c4f2 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:45:07.650254 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f14ea37b-e2dc-4ab6-88be-bbf5ac3e5a58 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2" status: 404 len: 111 microversion: 2.1 time: 0.075244 Sep 07 12:45:07.650254 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1602/3203] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:07 2022] GET /compute/v2.1/servers/023e989d-cb87-4aea-a0c8-7123ad57c4f2 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:45:07.654102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1038d7dc-fb26-4358-8b7f-fcec3f0a2bbb tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Action: 'create', calling method: .version_select at 0x7fc4192b4ca0>, body: {"keypair": {"name": "tempest-keypair-36208301", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhIDMfKvvXcvJUnqC/hrqQa+0In1K3l5WbAHMUadQ/UohVVJ63srQwASx/GSdFJ3+rmWaIY/LHJg9FARk5V7TxlnPFxUU37w9Vh/SSbejIYADKUQBAnvsVCWtEG7BtqiQ=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:07.666092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:DELETE=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:45:07.676931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-1038d7dc-fb26-4358-8b7f-fcec3f0a2bbb tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Getting quotas for project edd12d086d6b4a1a85b6b491aa3c3fd9. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:45:07.678932 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-941ad5c5-b4d6-4180-98bc-85a9271b4893 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.267225 Sep 07 12:45:07.680234 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1602/3204] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Sep 7 12:45:00 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:45:07.693978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9fe300fb-30ce-4549-9b31-45f073d56832 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '.version_select at 0x7fc4181ec700>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:07.694196 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-1038d7dc-fb26-4358-8b7f-fcec3f0a2bbb tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Getting quotas for user 4d2c5f9ea748432aaa877fb6dcde4462 and project edd12d086d6b4a1a85b6b491aa3c3fd9. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:45:07.752165 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9fe300fb-30ce-4549-9b31-45f073d56832 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-314828128" status: 202 len: 0 microversion: 2.1 time: 0.069359 Sep 07 12:45:07.752427 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1038d7dc-fb26-4358-8b7f-fcec3f0a2bbb tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.2 time: 0.102483 Sep 07 12:45:07.753305 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1603/3205] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Sep 7 12:45:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-314828128 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:45:07.764620 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1603/3206] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Sep 7 12:45:07 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 115 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 07 12:45:07.765639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9718d372-9b7b-4145-99e8-1e5d0ae5587a tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.102"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:07.778151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9718d372-9b7b-4145-99e8-1e5d0ae5587a tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:07.803053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4795e06f-f875-4aae-8da8-f28aa4de0d95 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Calling method '.version_select at 0x7fc41d16cdc0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:07.828973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9718d372-9b7b-4145-99e8-1e5d0ae5587a tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:07.832100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9718d372-9b7b-4145-99e8-1e5d0ae5587a tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:07.833460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9718d372-9b7b-4145-99e8-1e5d0ae5587a tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:07.835141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9718d372-9b7b-4145-99e8-1e5d0ae5587a tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:07.836503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9718d372-9b7b-4145-99e8-1e5d0ae5587a tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:07.837763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9718d372-9b7b-4145-99e8-1e5d0ae5587a tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:07.839829 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4795e06f-f875-4aae-8da8-f28aa4de0d95 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-36208301" status: 200 len: 511 microversion: 2.2 time: 0.065951 Sep 07 12:45:07.849424 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1604/3207] 10.222.0.16 () {60 vars in 1252 bytes} [Wed Sep 7 12:45:07 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-36208301 => generated 511 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:45:07.874497 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-68c96a88-e94e-498d-9629-d13b8a82273c tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Calling method '.version_select at 0x7fc4192dca60>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:07.881628 n-d-852087-9 devstack@n-api.service[122433]: WARNING oslo_db.sqlalchemy.utils [None req-68c96a88-e94e-498d-9629-d13b8a82273c tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 07 12:45:07.892063 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-68c96a88-e94e-498d-9629-d13b8a82273c tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 368 microversion: 2.2 time: 0.022278 Sep 07 12:45:07.900181 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1605/3208] 10.222.0.16 () {60 vars in 1177 bytes} [Wed Sep 7 12:45:07 2022] GET /compute/v2.1/os-keypairs => generated 368 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:45:07.907969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f42dd4b-1dfb-4786-91a0-9d3272ed9afd tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Calling method '.version_select at 0x7fc4192acdc0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:07.944458 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0f42dd4b-1dfb-4786-91a0-9d3272ed9afd tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-36208301" status: 204 len: 0 microversion: 2.2 time: 0.042796 Sep 07 12:45:07.944752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9718d372-9b7b-4145-99e8-1e5d0ae5587a tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "refresh_cache-ca300ad8-1300-4adf-940f-8cc52f13d8dc" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 12:45:07.945239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9718d372-9b7b-4145-99e8-1e5d0ae5587a tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquired lock "refresh_cache-ca300ad8-1300-4adf-940f-8cc52f13d8dc" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 12:45:07.947717 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1606/3209] 10.222.0.16 () {60 vars in 1255 bytes} [Wed Sep 7 12:45:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-36208301 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:45:07.955912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bf1de077-4128-48f1-888b-93caf0742b5b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:07.956576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bf1de077-4128-48f1-888b-93caf0742b5b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:07.993920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf1de077-4128-48f1-888b-93caf0742b5b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:07.994493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf1de077-4128-48f1-888b-93caf0742b5b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:07.994943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf1de077-4128-48f1-888b-93caf0742b5b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:07.999541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf1de077-4128-48f1-888b-93caf0742b5b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:08.002904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf1de077-4128-48f1-888b-93caf0742b5b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:08.004469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf1de077-4128-48f1-888b-93caf0742b5b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:08.665690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bf1de077-4128-48f1-888b-93caf0742b5b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:08.684558 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bf1de077-4128-48f1-888b-93caf0742b5b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1506 microversion: 2.1 time: 0.734788 Sep 07 12:45:08.688846 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1607/3210] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:07 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1506 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:08.699494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5b9d9b85-a73d-4937-b469-f4d59daf7e00 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Action: 'create', calling method: .version_select at 0x7fc419d04280>, body: {"keypair": {"name": "tempest-keypair-427825918", "type": "x509"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:08.745799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-5b9d9b85-a73d-4937-b469-f4d59daf7e00 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Getting quotas for project edd12d086d6b4a1a85b6b491aa3c3fd9. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:45:08.758677 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-5b9d9b85-a73d-4937-b469-f4d59daf7e00 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Getting quotas for user 4d2c5f9ea748432aaa877fb6dcde4462 and project edd12d086d6b4a1a85b6b491aa3c3fd9. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:45:08.794034 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.processutils [None req-5b9d9b85-a73d-4937-b469-f4d59daf7e00 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpxrp6ysz6/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpxrp6ysz6/temp.key -subj /CN=4d2c5f9ea748432aaa877fb6dcde4462 -extensions v3_req_client {{(pid=122433) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 07 12:45:09.096888 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.processutils [None req-5b9d9b85-a73d-4937-b469-f4d59daf7e00 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpxrp6ysz6/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpxrp6ysz6/temp.key -subj /CN=4d2c5f9ea748432aaa877fb6dcde4462 -extensions v3_req_client" returned: 0 in 0.302s {{(pid=122433) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 07 12:45:09.099477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.processutils [None req-5b9d9b85-a73d-4937-b469-f4d59daf7e00 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpxrp6ysz6/temp.key -password pass: {{(pid=122433) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 07 12:45:09.188035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.processutils [None req-5b9d9b85-a73d-4937-b469-f4d59daf7e00 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpxrp6ysz6/temp.key -password pass:" returned: 0 in 0.088s {{(pid=122433) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 07 12:45:09.323826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-5b9d9b85-a73d-4937-b469-f4d59daf7e00 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Getting quotas for project edd12d086d6b4a1a85b6b491aa3c3fd9. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:45:09.353006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-5b9d9b85-a73d-4937-b469-f4d59daf7e00 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Getting quotas for user 4d2c5f9ea748432aaa877fb6dcde4462 and project edd12d086d6b4a1a85b6b491aa3c3fd9. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:45:09.415944 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5b9d9b85-a73d-4937-b469-f4d59daf7e00 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.724644 Sep 07 12:45:09.418133 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1608/3211] 10.222.0.16 () {62 vars in 1198 bytes} [Wed Sep 7 12:45:08 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 728 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:45:09.429802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-40c9d918-2fea-49f4-bab2-b2d37e209f07 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:09.431233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-40c9d918-2fea-49f4-bab2-b2d37e209f07 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] [instance: 87931dc7-3c20-4661-8653-972aacfec19e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:09.443434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40c9d918-2fea-49f4-bab2-b2d37e209f07 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:09.444839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40c9d918-2fea-49f4-bab2-b2d37e209f07 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:09.445434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40c9d918-2fea-49f4-bab2-b2d37e209f07 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:09.446875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40c9d918-2fea-49f4-bab2-b2d37e209f07 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:09.447726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40c9d918-2fea-49f4-bab2-b2d37e209f07 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:09.448503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40c9d918-2fea-49f4-bab2-b2d37e209f07 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:09.760531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-40c9d918-2fea-49f4-bab2-b2d37e209f07 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62581f838674471fadf9609a3135d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a02ff920d478983e39d3c1bd62b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:09.777412 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-40c9d918-2fea-49f4-bab2-b2d37e209f07 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] 10.222.0.16 "GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e" status: 200 len: 1328 microversion: 2.1 time: 0.356856 Sep 07 12:45:09.779212 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1609/3212] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:09 2022] GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e => generated 1328 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:09.802513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ee5cd35-920c-4370-9b70-da8137f9b3a0 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Calling method '.version_select at 0x7fc41d3284c0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:09.823680 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8ee5cd35-920c-4370-9b70-da8137f9b3a0 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-427825918" status: 200 len: 1533 microversion: 2.2 time: 0.041854 Sep 07 12:45:09.836717 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1610/3213] 10.222.0.16 () {60 vars in 1255 bytes} [Wed Sep 7 12:45:09 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-427825918 => generated 1533 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:09.847021 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b0e867b9-7f97-427f-952f-dcb15b69940d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '.version_select at 0x7fc41d190160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:09.892660 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-b0e867b9-7f97-427f-952f-dcb15b69940d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] HTTP exception thrown: Image not found. Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b0e867b9-7f97-427f-952f-dcb15b69940d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Request method failure captured: Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/images/fcf90254-35f2-4cc1-a799-e09abcf848c3 HTTP/1.1 Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJGQYbyJLIsXxXjgkDYN7LwAZ3FIxjt-YGkXt1Xo1a1MUwTVDulf3qar21KhPKqmmgY5XowXVa7QiIPma2KSUUJYmnQLgFXdiW6Ghu6fpYXXYUWnHmYT3Op2c2gidR2lsMRLQPmqnvHgSb4f0Vzgm_QdSzSUbn3j0rcW4vT7twxuCxo Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: ac0d1c1e891c470c99e7c968b908a054 Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: exception: Image not found. Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'fcf90254-35f2-4cc1-a799-e09abcf848c3'} Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fcf90254-35f2-4cc1-a799-e09abcf848c3 to delete Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fcf90254-35f2-4cc1-a799-e09abcf848c3 could not be found. Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:09.894910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:09.905780 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:09.905780 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:45:09.905780 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:45:09.905780 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:45:09.905780 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:45:09.905780 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:45:09.905780 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:45:09.905780 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:45:09.905780 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:45:09.905780 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 07 12:45:09.905780 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 07 12:45:09.905780 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 07 12:45:09.905780 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:09.905780 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:09.905780 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:09.905780 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:09.905780 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:45:09.905780 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:45:09.905780 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:45:09.905780 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:45:09.905780 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 07 12:45:09.905780 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:09.905780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b0e867b9-7f97-427f-952f-dcb15b69940d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Returning 404 to user: Image not found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:45:09.905780 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b0e867b9-7f97-427f-952f-dcb15b69940d tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "DELETE /compute/v2.1/images/fcf90254-35f2-4cc1-a799-e09abcf848c3" status: 404 len: 62 microversion: 2.1 time: 0.057856 Sep 07 12:45:09.905780 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1611/3214] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:09 2022] DELETE /compute/v2.1/images/fcf90254-35f2-4cc1-a799-e09abcf848c3 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:45:09.915643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6f46b107-45b8-4191-9456-3da90b2e84ed tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:09.915643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6f46b107-45b8-4191-9456-3da90b2e84ed tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:09.921213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f46b107-45b8-4191-9456-3da90b2e84ed tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:09.925453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f46b107-45b8-4191-9456-3da90b2e84ed tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:09.926163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f46b107-45b8-4191-9456-3da90b2e84ed tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:09.927004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f46b107-45b8-4191-9456-3da90b2e84ed tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:09.927654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f46b107-45b8-4191-9456-3da90b2e84ed tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:09.928100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f46b107-45b8-4191-9456-3da90b2e84ed tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:10.337391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:45:10.766336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6f46b107-45b8-4191-9456-3da90b2e84ed tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:10.775474 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6f46b107-45b8-4191-9456-3da90b2e84ed tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1506 microversion: 2.1 time: 0.871356 Sep 07 12:45:10.776424 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1612/3215] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:09 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1506 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:10.798304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f734dc11-f689-43bb-a7cf-e103cc2e4f2b tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Calling method '.version_select at 0x7fc41d1901f0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:10.803848 n-d-852087-9 devstack@n-api.service[122433]: WARNING oslo_db.sqlalchemy.utils [None req-f734dc11-f689-43bb-a7cf-e103cc2e4f2b tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 07 12:45:10.812417 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f734dc11-f689-43bb-a7cf-e103cc2e4f2b tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.024723 Sep 07 12:45:10.813280 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1613/3216] 10.222.0.16 () {60 vars in 1177 bytes} [Wed Sep 7 12:45:10 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:10.827147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-34cd9458-666c-4a35-8386-cd09c1cb967a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:10.828393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-34cd9458-666c-4a35-8386-cd09c1cb967a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:10.835962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34cd9458-666c-4a35-8386-cd09c1cb967a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:10.837215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34cd9458-666c-4a35-8386-cd09c1cb967a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:10.838016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34cd9458-666c-4a35-8386-cd09c1cb967a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:10.839046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34cd9458-666c-4a35-8386-cd09c1cb967a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:10.839707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34cd9458-666c-4a35-8386-cd09c1cb967a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:10.840326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34cd9458-666c-4a35-8386-cd09c1cb967a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:10.858760 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-34cd9458-666c-4a35-8386-cd09c1cb967a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] HTTP exception thrown: Instance 663da890-aea0-44c3-842f-71ee8abfaac8 could not be found. Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-34cd9458-666c-4a35-8386-cd09c1cb967a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Request method failure captured: Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 HTTP/1.1 Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJGQYbyJLIsXxXjgkDYN7LwAZ3FIxjt-YGkXt1Xo1a1MUwTVDulf3qar21KhPKqmmgY5XowXVa7QiIPma2KSUUJYmnQLgFXdiW6Ghu6fpYXXYUWnHmYT3Op2c2gidR2lsMRLQPmqnvHgSb4f0Vzgm_QdSzSUbn3j0rcW4vT7twxuCxo Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: ac0d1c1e891c470c99e7c968b908a054 Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 663da890-aea0-44c3-842f-71ee8abfaac8 could not be found. Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '663da890-aea0-44c3-842f-71ee8abfaac8'} Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 663da890-aea0-44c3-842f-71ee8abfaac8 could not be found. Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:45:10.861889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:45:10.865783 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 663da890-aea0-44c3-842f-71ee8abfaac8 could not be found. Sep 07 12:45:10.865783 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:10.865783 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:10.865783 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:10.865783 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:10.865783 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:45:10.865783 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:45:10.865783 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:45:10.865783 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:45:10.865783 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 663da890-aea0-44c3-842f-71ee8abfaac8 could not be found. Sep 07 12:45:10.865783 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:10.868965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-34cd9458-666c-4a35-8386-cd09c1cb967a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Returning 404 to user: Instance 663da890-aea0-44c3-842f-71ee8abfaac8 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:45:10.871496 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-34cd9458-666c-4a35-8386-cd09c1cb967a tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "DELETE /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 404 len: 111 microversion: 2.1 time: 0.056224 Sep 07 12:45:10.874563 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1614/3217] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:45:10 2022] DELETE /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:45:10.888109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e1f35efc-ae16-4315-b1fa-2da77753ecac tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:10.889803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e1f35efc-ae16-4315-b1fa-2da77753ecac tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] [instance: 87931dc7-3c20-4661-8653-972aacfec19e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:10.917864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1f35efc-ae16-4315-b1fa-2da77753ecac tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:10.919068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1f35efc-ae16-4315-b1fa-2da77753ecac tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:10.919925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1f35efc-ae16-4315-b1fa-2da77753ecac tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:10.922247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1f35efc-ae16-4315-b1fa-2da77753ecac tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:10.925505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1f35efc-ae16-4315-b1fa-2da77753ecac tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:10.926773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1f35efc-ae16-4315-b1fa-2da77753ecac tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:11.646494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e1f35efc-ae16-4315-b1fa-2da77753ecac tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62581f838674471fadf9609a3135d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a02ff920d478983e39d3c1bd62b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:11.659861 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e1f35efc-ae16-4315-b1fa-2da77753ecac tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] 10.222.0.16 "GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e" status: 200 len: 1396 microversion: 2.1 time: 0.781075 Sep 07 12:45:11.665176 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1615/3218] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:10 2022] GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e => generated 1396 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:11.670742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eeacb05e-6762-49a3-ad29-64a0510565d4 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] Calling method '.version_select at 0x7fc418c7a940>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:11.720540 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eeacb05e-6762-49a3-ad29-64a0510565d4 tempest-KeyPairsV22TestJSON-1061854835 tempest-KeyPairsV22TestJSON-1061854835-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-427825918" status: 204 len: 0 microversion: 2.2 time: 0.053756 Sep 07 12:45:11.724013 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1616/3219] 10.222.0.16 () {60 vars in 1258 bytes} [Wed Sep 7 12:45:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-427825918 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:45:11.746343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2bb510c1-19c6-4915-960c-d8fde610a346 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:11.747058 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2bb510c1-19c6-4915-960c-d8fde610a346 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] [instance: 663da890-aea0-44c3-842f-71ee8abfaac8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:11.770061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bb510c1-19c6-4915-960c-d8fde610a346 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:11.771116 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bb510c1-19c6-4915-960c-d8fde610a346 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:11.771116 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bb510c1-19c6-4915-960c-d8fde610a346 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:11.771765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bb510c1-19c6-4915-960c-d8fde610a346 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:11.776530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bb510c1-19c6-4915-960c-d8fde610a346 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:11.777968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bb510c1-19c6-4915-960c-d8fde610a346 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:11.816710 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-2bb510c1-19c6-4915-960c-d8fde610a346 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] HTTP exception thrown: Instance 663da890-aea0-44c3-842f-71ee8abfaac8 could not be found. Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2bb510c1-19c6-4915-960c-d8fde610a346 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Request method failure captured: Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 HTTP/1.1 Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJGQYbyJLIsXxXjgkDYN7LwAZ3FIxjt-YGkXt1Xo1a1MUwTVDulf3qar21KhPKqmmgY5XowXVa7QiIPma2KSUUJYmnQLgFXdiW6Ghu6fpYXXYUWnHmYT3Op2c2gidR2lsMRLQPmqnvHgSb4f0Vzgm_QdSzSUbn3j0rcW4vT7twxuCxo Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feb4e290866f4f54b2b99733b56cb7bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: feb4e290866f4f54b2b99733b56cb7bd Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558 Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: ac0d1c1e891c470c99e7c968b908a054 Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1099208558-project Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 663da890-aea0-44c3-842f-71ee8abfaac8 could not be found. Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '663da890-aea0-44c3-842f-71ee8abfaac8'} Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 663da890-aea0-44c3-842f-71ee8abfaac8 could not be found. Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 663da890-aea0-44c3-842f-71ee8abfaac8 could not be found. Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:11.820283 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:11.829522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:11.829522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:11.829522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:45:11.829522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:45:11.829522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:45:11.829522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:45:11.829522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 663da890-aea0-44c3-842f-71ee8abfaac8 could not be found. Sep 07 12:45:11.829522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:11.829522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2bb510c1-19c6-4915-960c-d8fde610a346 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] Returning 404 to user: Instance 663da890-aea0-44c3-842f-71ee8abfaac8 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:45:11.829522 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2bb510c1-19c6-4915-960c-d8fde610a346 tempest-ImagesOneServerNegativeTestJSON-1099208558 tempest-ImagesOneServerNegativeTestJSON-1099208558-project] 10.222.0.16 "GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8" status: 404 len: 111 microversion: 2.1 time: 0.101506 Sep 07 12:45:11.836684 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1617/3220] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:11 2022] GET /compute/v2.1/servers/663da890-aea0-44c3-842f-71ee8abfaac8 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:45:11.843064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c7a342f-55c5-4c4f-8ea9-bc570cddad41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:11.844039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2c7a342f-55c5-4c4f-8ea9-bc570cddad41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:11.851707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c7a342f-55c5-4c4f-8ea9-bc570cddad41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:11.852592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c7a342f-55c5-4c4f-8ea9-bc570cddad41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:11.853246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c7a342f-55c5-4c4f-8ea9-bc570cddad41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:11.854260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c7a342f-55c5-4c4f-8ea9-bc570cddad41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:11.854981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c7a342f-55c5-4c4f-8ea9-bc570cddad41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:11.855628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c7a342f-55c5-4c4f-8ea9-bc570cddad41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:13.370304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2c7a342f-55c5-4c4f-8ea9-bc570cddad41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:13.385358 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2c7a342f-55c5-4c4f-8ea9-bc570cddad41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1506 microversion: 2.1 time: 1.546017 Sep 07 12:45:13.388274 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1618/3221] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:11 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1506 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:13.398446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-02bfb3b9-4bc7-4fe2-a2a8-69540ae9249e tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:13.400362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-02bfb3b9-4bc7-4fe2-a2a8-69540ae9249e tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] [instance: 87931dc7-3c20-4661-8653-972aacfec19e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:13.417477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02bfb3b9-4bc7-4fe2-a2a8-69540ae9249e tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:13.418241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02bfb3b9-4bc7-4fe2-a2a8-69540ae9249e tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:13.418815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02bfb3b9-4bc7-4fe2-a2a8-69540ae9249e tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:13.419962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02bfb3b9-4bc7-4fe2-a2a8-69540ae9249e tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:13.420874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02bfb3b9-4bc7-4fe2-a2a8-69540ae9249e tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:13.421593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02bfb3b9-4bc7-4fe2-a2a8-69540ae9249e tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:14.927562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:45:15.478558 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-02bfb3b9-4bc7-4fe2-a2a8-69540ae9249e tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62581f838674471fadf9609a3135d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a02ff920d478983e39d3c1bd62b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:15.544266 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-02bfb3b9-4bc7-4fe2-a2a8-69540ae9249e tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] 10.222.0.16 "GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e" status: 200 len: 1396 microversion: 2.1 time: 2.153394 Sep 07 12:45:15.548699 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1619/3222] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:13 2022] GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e => generated 1396 bytes in 2159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:15.591434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-380b8a8b-5fc4-4517-a2b0-175c11c5154d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:15.594740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-380b8a8b-5fc4-4517-a2b0-175c11c5154d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:15.601581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-9718d372-9b7b-4145-99e8-1e5d0ae5587a tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Building network info cache for instance {{(pid=122432) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 07 12:45:15.651706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-380b8a8b-5fc4-4517-a2b0-175c11c5154d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:15.656664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-380b8a8b-5fc4-4517-a2b0-175c11c5154d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:15.657884 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-380b8a8b-5fc4-4517-a2b0-175c11c5154d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:15.673236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-380b8a8b-5fc4-4517-a2b0-175c11c5154d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:15.674420 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-380b8a8b-5fc4-4517-a2b0-175c11c5154d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:15.675262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-380b8a8b-5fc4-4517-a2b0-175c11c5154d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:17.091444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-380b8a8b-5fc4-4517-a2b0-175c11c5154d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:17.103768 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-380b8a8b-5fc4-4517-a2b0-175c11c5154d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1506 microversion: 2.1 time: 1.549232 Sep 07 12:45:17.104954 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1620/3223] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:15 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1506 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:17.326803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-036df85b-5018-4eca-9cf3-9fe14dfe6640 tempest-AbsoluteLimitsNegativeTestJSON-134342285 tempest-AbsoluteLimitsNegativeTestJSON-134342285-project] Calling method '.version_select at 0x7fc4192cc430>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:17.350355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-036df85b-5018-4eca-9cf3-9fe14dfe6640 tempest-AbsoluteLimitsNegativeTestJSON-134342285 tempest-AbsoluteLimitsNegativeTestJSON-134342285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:17.350355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-036df85b-5018-4eca-9cf3-9fe14dfe6640 tempest-AbsoluteLimitsNegativeTestJSON-134342285 tempest-AbsoluteLimitsNegativeTestJSON-134342285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:17.350355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-036df85b-5018-4eca-9cf3-9fe14dfe6640 tempest-AbsoluteLimitsNegativeTestJSON-134342285 tempest-AbsoluteLimitsNegativeTestJSON-134342285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:17.350355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-036df85b-5018-4eca-9cf3-9fe14dfe6640 tempest-AbsoluteLimitsNegativeTestJSON-134342285 tempest-AbsoluteLimitsNegativeTestJSON-134342285-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:17.350355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-036df85b-5018-4eca-9cf3-9fe14dfe6640 tempest-AbsoluteLimitsNegativeTestJSON-134342285 tempest-AbsoluteLimitsNegativeTestJSON-134342285-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:17.351462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-036df85b-5018-4eca-9cf3-9fe14dfe6640 tempest-AbsoluteLimitsNegativeTestJSON-134342285 tempest-AbsoluteLimitsNegativeTestJSON-134342285-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:17.411208 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-036df85b-5018-4eca-9cf3-9fe14dfe6640 tempest-AbsoluteLimitsNegativeTestJSON-134342285 tempest-AbsoluteLimitsNegativeTestJSON-134342285-project] 10.222.0.16 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.304483 Sep 07 12:45:17.412462 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1621/3224] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 12:45:17 2022] GET /compute/v2.1/limits => generated 511 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:45:17.419394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-78d256c2-c40c-4a53-9d2c-e661fd404137 req-7b05f9a9-21f3-4c43-9939-32d310015f77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca300ad8-1300-4adf-940f-8cc52f13d8dc", "tag": "6b1ac69f-da45-464f-94bf-5e56a21ce00a"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:17.465586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-78d256c2-c40c-4a53-9d2c-e661fd404137 req-7b05f9a9-21f3-4c43-9939-32d310015f77 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:17.466473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-78d256c2-c40c-4a53-9d2c-e661fd404137 req-7b05f9a9-21f3-4c43-9939-32d310015f77 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:17.467276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-78d256c2-c40c-4a53-9d2c-e661fd404137 req-7b05f9a9-21f3-4c43-9939-32d310015f77 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:17.525817 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-78d256c2-c40c-4a53-9d2c-e661fd404137 req-7b05f9a9-21f3-4c43-9939-32d310015f77 service nova] Creating event network-changed:6b1ac69f-da45-464f-94bf-5e56a21ce00a for instance ca300ad8-1300-4adf-940f-8cc52f13d8dc on n-h2-852087-9 Sep 07 12:45:17.536970 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-78d256c2-c40c-4a53-9d2c-e661fd404137 req-7b05f9a9-21f3-4c43-9939-32d310015f77 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122285 Sep 07 12:45:17.538111 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1622/3225] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:45:17.550004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ad5bd6f-ce66-4bc2-9774-f17126cdedb6 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:17.551641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3ad5bd6f-ce66-4bc2-9774-f17126cdedb6 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] [instance: 87931dc7-3c20-4661-8653-972aacfec19e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:17.570210 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ad5bd6f-ce66-4bc2-9774-f17126cdedb6 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:17.571470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ad5bd6f-ce66-4bc2-9774-f17126cdedb6 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:17.572492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ad5bd6f-ce66-4bc2-9774-f17126cdedb6 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:17.575136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ad5bd6f-ce66-4bc2-9774-f17126cdedb6 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:17.576308 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ad5bd6f-ce66-4bc2-9774-f17126cdedb6 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:17.577278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ad5bd6f-ce66-4bc2-9774-f17126cdedb6 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:17.824837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:45:18.832981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3ad5bd6f-ce66-4bc2-9774-f17126cdedb6 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62581f838674471fadf9609a3135d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a02ff920d478983e39d3c1bd62b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:18.871060 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ad5bd6f-ce66-4bc2-9774-f17126cdedb6 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] 10.222.0.16 "GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e" status: 200 len: 1396 microversion: 2.1 time: 1.320579 Sep 07 12:45:18.872146 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1623/3226] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:17 2022] GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e => generated 1396 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:18.882137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-addbfe20-fca3-47cd-9cbd-471278ab9a35 tempest-AbsoluteLimitsNegativeTestJSON-134342285 tempest-AbsoluteLimitsNegativeTestJSON-134342285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1700187365", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:19.074321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-addbfe20-fca3-47cd-9cbd-471278ab9a35 tempest-AbsoluteLimitsNegativeTestJSON-134342285 tempest-AbsoluteLimitsNegativeTestJSON-134342285-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:45:20.427297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-9718d372-9b7b-4145-99e8-1e5d0ae5587a tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Updating instance_info_cache with network_info: [{"id": "6b1ac69f-da45-464f-94bf-5e56a21ce00a", "address": "fa:16:3e:40:17:41", "network": {"id": "1850ed1e-2cdb-4fcf-aa55-0e1010b69611", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-251029267-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ccf5b780ca404c21a5d68f150cedbd7a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6b1ac69f-da", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122432) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 07 12:45:20.449219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9718d372-9b7b-4145-99e8-1e5d0ae5587a tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Releasing lock "refresh_cache-ca300ad8-1300-4adf-940f-8cc52f13d8dc" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 12:45:20.450785 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9718d372-9b7b-4145-99e8-1e5d0ae5587a tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "POST /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc/action" status: 202 len: 0 microversion: 2.1 time: 12.694904 Sep 07 12:45:20.454315 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1604/3227] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:45:07 2022] POST /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc/action => generated 0 bytes in 12700 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 07 12:45:20.479847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-16d9608f-81bd-4793-b5fc-a811d975d495 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:20.482582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-16d9608f-81bd-4793-b5fc-a811d975d495 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:20.497550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16d9608f-81bd-4793-b5fc-a811d975d495 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:20.498522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16d9608f-81bd-4793-b5fc-a811d975d495 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:20.499157 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16d9608f-81bd-4793-b5fc-a811d975d495 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:20.500320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16d9608f-81bd-4793-b5fc-a811d975d495 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:20.502333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16d9608f-81bd-4793-b5fc-a811d975d495 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:20.514355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16d9608f-81bd-4793-b5fc-a811d975d495 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:21.454738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-addbfe20-fca3-47cd-9cbd-471278ab9a35 tempest-AbsoluteLimitsNegativeTestJSON-134342285 tempest-AbsoluteLimitsNegativeTestJSON-134342285-project] Getting quotas for project f6a0b88539ff4f3983ef179c31f50c7e. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:45:21.482480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-addbfe20-fca3-47cd-9cbd-471278ab9a35 tempest-AbsoluteLimitsNegativeTestJSON-134342285 tempest-AbsoluteLimitsNegativeTestJSON-134342285-project] Getting quotas for user 40ae38c9beea4fc3b5a7fb07b0edf3ad and project f6a0b88539ff4f3983ef179c31f50c7e. Resources: dict_keys(['metadata_items']) {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:45:21.521760 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-addbfe20-fca3-47cd-9cbd-471278ab9a35 tempest-AbsoluteLimitsNegativeTestJSON-134342285 tempest-AbsoluteLimitsNegativeTestJSON-134342285-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-addbfe20-fca3-47cd-9cbd-471278ab9a35 tempest-AbsoluteLimitsNegativeTestJSON-134342285 tempest-AbsoluteLimitsNegativeTestJSON-134342285-project] Request method failure captured: Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 1752 Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJJbebkRIecXo41p-Dv3cNZhkdUdKGBqVS8TOVAjcOtPSKDqmFamJDBktSaJzYbTBqtjIWKWN1Em250wTJV2qwRe-ZgkROtniT1MnZWX2uFDu4Tf3ywvdedYpK27ifd-QU2OcjhTATL_3V54h7OB-OvKC1tmCSDu5F4vz6pz76-iiek Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: f6a0b88539ff4f3983ef179c31f50c7e Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-134342285 Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f6a0b88539ff4f3983ef179c31f50c7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f6a0b88539ff4f3983ef179c31f50c7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f6a0b88539ff4f3983ef179c31f50c7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f6a0b88539ff4f3983ef179c31f50c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-134342285 Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: f6a0b88539ff4f3983ef179c31f50c7e Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-134342285 Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-134342285-project Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 40ae38c9beea4fc3b5a7fb07b0edf3ad Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-134342285-project Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1700187365", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:45:21.524526 n-d-852087-9 devstack@n-api.service[122433]: exception: Maximum number of metadata items exceeds 128 Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1700187365', 'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:45:21.526853 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:45:21.529556 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:45:21.529556 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 07 12:45:21.529556 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 07 12:45:21.529556 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 07 12:45:21.529556 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Sep 07 12:45:21.529556 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:21.529556 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:21.529556 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:21.529556 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:21.529556 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:45:21.529556 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:45:21.529556 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:45:21.529556 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:45:21.529556 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Sep 07 12:45:21.529556 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:21.533187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-addbfe20-fca3-47cd-9cbd-471278ab9a35 tempest-AbsoluteLimitsNegativeTestJSON-134342285 tempest-AbsoluteLimitsNegativeTestJSON-134342285-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:45:21.534450 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-addbfe20-fca3-47cd-9cbd-471278ab9a35 tempest-AbsoluteLimitsNegativeTestJSON-134342285 tempest-AbsoluteLimitsNegativeTestJSON-134342285-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 2.660701 Sep 07 12:45:21.535299 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1624/3228] 10.222.0.16 () {60 vars in 1148 bytes} [Wed Sep 7 12:45:18 2022] POST /compute/v2.1/servers => generated 87 bytes in 2662 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:45:21.619074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-16d9608f-81bd-4793-b5fc-a811d975d495 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:21.644698 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-16d9608f-81bd-4793-b5fc-a811d975d495 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1486 microversion: 2.1 time: 1.185375 Sep 07 12:45:21.647804 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1605/3229] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:20 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1486 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:21.675849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-08003712-0ddb-410c-811d-a31972c073b9 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:21.679103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-08003712-0ddb-410c-811d-a31972c073b9 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] [instance: 87931dc7-3c20-4661-8653-972aacfec19e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:21.712685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08003712-0ddb-410c-811d-a31972c073b9 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:21.714366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08003712-0ddb-410c-811d-a31972c073b9 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:21.716927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08003712-0ddb-410c-811d-a31972c073b9 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:21.717890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08003712-0ddb-410c-811d-a31972c073b9 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:21.718655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08003712-0ddb-410c-811d-a31972c073b9 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:21.720653 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08003712-0ddb-410c-811d-a31972c073b9 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:22.048778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-87b034e8-40dd-478b-a31f-bedd5aaa2d66 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2093297925", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "b09d014c-3443-48ed-84da-449ea818c81d"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:22.204427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-87b034e8-40dd-478b-a31f-bedd5aaa2d66 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] validate_networks() for [('b09d014c-3443-48ed-84da-449ea818c81d', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:45:23.258430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-08003712-0ddb-410c-811d-a31972c073b9 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62581f838674471fadf9609a3135d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a02ff920d478983e39d3c1bd62b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:23.267414 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-08003712-0ddb-410c-811d-a31972c073b9 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] 10.222.0.16 "GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e" status: 200 len: 1396 microversion: 2.1 time: 1.617043 Sep 07 12:45:23.278878 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1606/3230] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:21 2022] GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e => generated 1396 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:23.287729 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-98cdbca6-7420-497f-a2de-d02a05348df8 req-f97e8839-2275-4dcd-ae55-e21a5cf364f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87931dc7-3c20-4661-8653-972aacfec19e", "tag": "0aff791e-d1d3-4633-893c-be6e34af3651"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:23.335034 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-98cdbca6-7420-497f-a2de-d02a05348df8 req-f97e8839-2275-4dcd-ae55-e21a5cf364f3 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:23.342198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-98cdbca6-7420-497f-a2de-d02a05348df8 req-f97e8839-2275-4dcd-ae55-e21a5cf364f3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:23.343790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-98cdbca6-7420-497f-a2de-d02a05348df8 req-f97e8839-2275-4dcd-ae55-e21a5cf364f3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:23.413303 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-98cdbca6-7420-497f-a2de-d02a05348df8 req-f97e8839-2275-4dcd-ae55-e21a5cf364f3 service nova] Creating event network-changed:0aff791e-d1d3-4633-893c-be6e34af3651 for instance 87931dc7-3c20-4661-8653-972aacfec19e on n-h2-852087-9 Sep 07 12:45:23.423905 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-98cdbca6-7420-497f-a2de-d02a05348df8 req-f97e8839-2275-4dcd-ae55-e21a5cf364f3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142973 Sep 07 12:45:23.425637 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1607/3231] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:45:23.436709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-00746b48-60d2-41da-acba-4fcc10afc45e tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.102"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:24.689190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-00746b48-60d2-41da-acba-4fcc10afc45e tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:24.714608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00746b48-60d2-41da-acba-4fcc10afc45e tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:24.715626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00746b48-60d2-41da-acba-4fcc10afc45e tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:24.721544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00746b48-60d2-41da-acba-4fcc10afc45e tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:24.723569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00746b48-60d2-41da-acba-4fcc10afc45e tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:24.727103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00746b48-60d2-41da-acba-4fcc10afc45e tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:24.728541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00746b48-60d2-41da-acba-4fcc10afc45e tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:25.005533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-87b034e8-40dd-478b-a31f-bedd5aaa2d66 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:45:25.006145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-87b034e8-40dd-478b-a31f-bedd5aaa2d66 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:45:25.006776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-87b034e8-40dd-478b-a31f-bedd5aaa2d66 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:45:25.007336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-87b034e8-40dd-478b-a31f-bedd5aaa2d66 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:45:25.007831 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-87b034e8-40dd-478b-a31f-bedd5aaa2d66 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:45:25.034016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=49 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:45:25.039667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87b034e8-40dd-478b-a31f-bedd5aaa2d66 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:25.041583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87b034e8-40dd-478b-a31f-bedd5aaa2d66 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:25.043208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87b034e8-40dd-478b-a31f-bedd5aaa2d66 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:25.044397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87b034e8-40dd-478b-a31f-bedd5aaa2d66 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:25.046316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87b034e8-40dd-478b-a31f-bedd5aaa2d66 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:25.048227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87b034e8-40dd-478b-a31f-bedd5aaa2d66 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:25.110878 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-87b034e8-40dd-478b-a31f-bedd5aaa2d66 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Getting quotas for project f535596776604720870c42b1a788cb3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:45:25.130313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-87b034e8-40dd-478b-a31f-bedd5aaa2d66 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Getting quotas for user f76fe928bf384b88b8a3ba5e4b9c6232 and project f535596776604720870c42b1a788cb3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:45:25.167865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-87b034e8-40dd-478b-a31f-bedd5aaa2d66 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:45:25.175952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-87b034e8-40dd-478b-a31f-bedd5aaa2d66 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:45:25.266450 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:45:25.309046 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-87b034e8-40dd-478b-a31f-bedd5aaa2d66 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.772279 Sep 07 12:45:25.313173 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1625/3232] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:45:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:45:25.333085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-46119376-3504-4439-940f-f75282240b60 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1220798413", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:25.410091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-46119376-3504-4439-940f-f75282240b60 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] validate_networks() for [('601ef32c-950a-4c7a-8340-8d5aac86e6c9', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:45:26.694160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00746b48-60d2-41da-acba-4fcc10afc45e tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "refresh_cache-ca300ad8-1300-4adf-940f-8cc52f13d8dc" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 12:45:26.694969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00746b48-60d2-41da-acba-4fcc10afc45e tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquired lock "refresh_cache-ca300ad8-1300-4adf-940f-8cc52f13d8dc" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 12:45:28.783912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-46119376-3504-4439-940f-f75282240b60 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:45:28.784892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-46119376-3504-4439-940f-f75282240b60 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:45:28.784892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-46119376-3504-4439-940f-f75282240b60 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:45:28.785308 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-46119376-3504-4439-940f-f75282240b60 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:45:28.785606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-46119376-3504-4439-940f-f75282240b60 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:45:28.806530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46119376-3504-4439-940f-f75282240b60 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:28.807189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46119376-3504-4439-940f-f75282240b60 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:28.807838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46119376-3504-4439-940f-f75282240b60 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:28.808848 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46119376-3504-4439-940f-f75282240b60 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:28.809525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46119376-3504-4439-940f-f75282240b60 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:28.810150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46119376-3504-4439-940f-f75282240b60 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:28.871627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-46119376-3504-4439-940f-f75282240b60 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Getting quotas for project bc8452d8eab643549a30030eda3f40ba. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:45:28.887318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-46119376-3504-4439-940f-f75282240b60 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Getting quotas for user 1824fe66513042c98d1157166f227bc7 and project bc8452d8eab643549a30030eda3f40ba. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:45:28.917269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-46119376-3504-4439-940f-f75282240b60 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:45:28.919631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-46119376-3504-4439-940f-f75282240b60 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:45:29.082319 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-46119376-3504-4439-940f-f75282240b60 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.758895 Sep 07 12:45:29.084069 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1626/3233] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:45:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 3763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:45:29.099345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-46e2290a-341d-488d-8d21-43020b9fb298 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:29.101423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-46e2290a-341d-488d-8d21-43020b9fb298 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] [instance: 87931dc7-3c20-4661-8653-972aacfec19e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:29.170880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46e2290a-341d-488d-8d21-43020b9fb298 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:29.171824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46e2290a-341d-488d-8d21-43020b9fb298 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:29.173701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46e2290a-341d-488d-8d21-43020b9fb298 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:29.179763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46e2290a-341d-488d-8d21-43020b9fb298 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:29.181453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46e2290a-341d-488d-8d21-43020b9fb298 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:29.182828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46e2290a-341d-488d-8d21-43020b9fb298 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:29.995722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-46e2290a-341d-488d-8d21-43020b9fb298 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62581f838674471fadf9609a3135d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a02ff920d478983e39d3c1bd62b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:30.031590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-00746b48-60d2-41da-acba-4fcc10afc45e tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Building network info cache for instance {{(pid=122432) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 07 12:45:30.054062 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-46e2290a-341d-488d-8d21-43020b9fb298 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] 10.222.0.16 "GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e" status: 200 len: 1396 microversion: 2.1 time: 0.949064 Sep 07 12:45:30.056269 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1627/3234] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:29 2022] GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e => generated 1396 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:30.068613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0d089471-2564-440c-b223-45d42847a556 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:30.071910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0d089471-2564-440c-b223-45d42847a556 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:30.114285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d089471-2564-440c-b223-45d42847a556 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:30.115568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d089471-2564-440c-b223-45d42847a556 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:30.116442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d089471-2564-440c-b223-45d42847a556 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:30.129676 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d089471-2564-440c-b223-45d42847a556 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:30.131113 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d089471-2564-440c-b223-45d42847a556 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:30.131959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d089471-2564-440c-b223-45d42847a556 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:30.331749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0d089471-2564-440c-b223-45d42847a556 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:30.361831 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0d089471-2564-440c-b223-45d42847a556 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1276 microversion: 2.1 time: 0.303325 Sep 07 12:45:30.362939 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1628/3235] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:30 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1276 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:30.373834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fe466bb8-8e05-4164-9dc4-e431908bfff5 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:30.384093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fe466bb8-8e05-4164-9dc4-e431908bfff5 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:30.420327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe466bb8-8e05-4164-9dc4-e431908bfff5 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:30.440266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe466bb8-8e05-4164-9dc4-e431908bfff5 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:30.443019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe466bb8-8e05-4164-9dc4-e431908bfff5 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:30.447155 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe466bb8-8e05-4164-9dc4-e431908bfff5 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:30.447749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe466bb8-8e05-4164-9dc4-e431908bfff5 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:30.448218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe466bb8-8e05-4164-9dc4-e431908bfff5 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:30.745702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fe466bb8-8e05-4164-9dc4-e431908bfff5 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:30.772599 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fe466bb8-8e05-4164-9dc4-e431908bfff5 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1210 microversion: 2.1 time: 0.402449 Sep 07 12:45:30.790758 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1629/3236] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:30 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1210 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:30.799930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-21620a30-7fbd-438a-b708-bdb7bebfc35a req-ba783717-312e-4f69-962f-5504a46a6300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca300ad8-1300-4adf-940f-8cc52f13d8dc", "tag": "6b1ac69f-da45-464f-94bf-5e56a21ce00a"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:30.844575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-21620a30-7fbd-438a-b708-bdb7bebfc35a req-ba783717-312e-4f69-962f-5504a46a6300 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:30.845692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-21620a30-7fbd-438a-b708-bdb7bebfc35a req-ba783717-312e-4f69-962f-5504a46a6300 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:30.846532 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-21620a30-7fbd-438a-b708-bdb7bebfc35a req-ba783717-312e-4f69-962f-5504a46a6300 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:30.874440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:45:30.929219 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-21620a30-7fbd-438a-b708-bdb7bebfc35a req-ba783717-312e-4f69-962f-5504a46a6300 service nova] Creating event network-changed:6b1ac69f-da45-464f-94bf-5e56a21ce00a for instance ca300ad8-1300-4adf-940f-8cc52f13d8dc on n-h2-852087-9 Sep 07 12:45:30.960006 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-21620a30-7fbd-438a-b708-bdb7bebfc35a req-ba783717-312e-4f69-962f-5504a46a6300 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167416 Sep 07 12:45:30.965645 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1630/3237] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:45:31.086226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-35d556c5-ce28-4c53-9843-0feb216e3f5b tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:31.087576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-35d556c5-ce28-4c53-9843-0feb216e3f5b tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] [instance: 87931dc7-3c20-4661-8653-972aacfec19e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:31.108375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35d556c5-ce28-4c53-9843-0feb216e3f5b tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:31.109622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35d556c5-ce28-4c53-9843-0feb216e3f5b tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:31.113803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35d556c5-ce28-4c53-9843-0feb216e3f5b tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:31.116857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35d556c5-ce28-4c53-9843-0feb216e3f5b tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:31.116857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35d556c5-ce28-4c53-9843-0feb216e3f5b tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:31.116857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35d556c5-ce28-4c53-9843-0feb216e3f5b tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:32.398678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-35d556c5-ce28-4c53-9843-0feb216e3f5b tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62581f838674471fadf9609a3135d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a02ff920d478983e39d3c1bd62b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:32.410745 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-35d556c5-ce28-4c53-9843-0feb216e3f5b tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] 10.222.0.16 "GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e" status: 200 len: 1396 microversion: 2.1 time: 1.333853 Sep 07 12:45:32.412256 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1631/3238] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:31 2022] GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e => generated 1396 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:45:32.419287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-77fbcc59-e276-45b2-9ef7-1fd2b1c75d7d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:32.420181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-77fbcc59-e276-45b2-9ef7-1fd2b1c75d7d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:32.427873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77fbcc59-e276-45b2-9ef7-1fd2b1c75d7d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:32.428693 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77fbcc59-e276-45b2-9ef7-1fd2b1c75d7d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:32.429324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77fbcc59-e276-45b2-9ef7-1fd2b1c75d7d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:32.430293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77fbcc59-e276-45b2-9ef7-1fd2b1c75d7d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:32.430948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77fbcc59-e276-45b2-9ef7-1fd2b1c75d7d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:32.431561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77fbcc59-e276-45b2-9ef7-1fd2b1c75d7d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:32.763704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-00746b48-60d2-41da-acba-4fcc10afc45e tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Updating instance_info_cache with network_info: [{"id": "6b1ac69f-da45-464f-94bf-5e56a21ce00a", "address": "fa:16:3e:40:17:41", "network": {"id": "1850ed1e-2cdb-4fcf-aa55-0e1010b69611", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-251029267-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ccf5b780ca404c21a5d68f150cedbd7a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6b1ac69f-da", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122432) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 07 12:45:32.786501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00746b48-60d2-41da-acba-4fcc10afc45e tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Releasing lock "refresh_cache-ca300ad8-1300-4adf-940f-8cc52f13d8dc" {{(pid=122432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 12:45:32.788087 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-00746b48-60d2-41da-acba-4fcc10afc45e tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "POST /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc/action" status: 202 len: 0 microversion: 2.1 time: 9.359301 Sep 07 12:45:32.788087 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1608/3239] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:45:23 2022] POST /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc/action => generated 0 bytes in 9361 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 07 12:45:32.793796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c3ebda0f-f240-413f-a904-af146d92b26b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:32.794455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c3ebda0f-f240-413f-a904-af146d92b26b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:32.802703 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3ebda0f-f240-413f-a904-af146d92b26b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:32.803268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3ebda0f-f240-413f-a904-af146d92b26b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:32.803783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3ebda0f-f240-413f-a904-af146d92b26b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:32.804588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3ebda0f-f240-413f-a904-af146d92b26b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:32.805069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3ebda0f-f240-413f-a904-af146d92b26b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:32.805582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3ebda0f-f240-413f-a904-af146d92b26b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:33.153767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c3ebda0f-f240-413f-a904-af146d92b26b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:33.168954 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c3ebda0f-f240-413f-a904-af146d92b26b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1272 microversion: 2.1 time: 0.376447 Sep 07 12:45:33.170361 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1609/3240] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:32 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1272 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:33.200462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b4a3a0ed-c367-49c6-b2a2-adaaddcd40f7 req-c0ff1774-16f9-4f2f-a57d-05b3238089b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87931dc7-3c20-4661-8653-972aacfec19e", "name": "network-vif-plugged", "status": "completed", "tag": "0aff791e-d1d3-4633-893c-be6e34af3651"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:33.234002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b4a3a0ed-c367-49c6-b2a2-adaaddcd40f7 req-c0ff1774-16f9-4f2f-a57d-05b3238089b6 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:33.235063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b4a3a0ed-c367-49c6-b2a2-adaaddcd40f7 req-c0ff1774-16f9-4f2f-a57d-05b3238089b6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:33.237302 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b4a3a0ed-c367-49c6-b2a2-adaaddcd40f7 req-c0ff1774-16f9-4f2f-a57d-05b3238089b6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:33.269014 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b4a3a0ed-c367-49c6-b2a2-adaaddcd40f7 req-c0ff1774-16f9-4f2f-a57d-05b3238089b6 service nova] Creating event network-vif-plugged:0aff791e-d1d3-4633-893c-be6e34af3651 for instance 87931dc7-3c20-4661-8653-972aacfec19e on n-h2-852087-9 Sep 07 12:45:33.276908 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b4a3a0ed-c367-49c6-b2a2-adaaddcd40f7 req-c0ff1774-16f9-4f2f-a57d-05b3238089b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105016 Sep 07 12:45:33.278226 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1610/3241] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:45:33.292954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0c93c209-871e-428e-8c53-f19aaa626bef tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '.version_select at 0x7fc41d28e0d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:33.327315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-77fbcc59-e276-45b2-9ef7-1fd2b1c75d7d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:33.338742 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-77fbcc59-e276-45b2-9ef7-1fd2b1c75d7d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1318 microversion: 2.1 time: 0.924894 Sep 07 12:45:33.339382 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1632/3242] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:32 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1318 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:33.437831 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dfa634c9-fb96-41e1-83a4-2bdd5407d2d0 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:33.439387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dfa634c9-fb96-41e1-83a4-2bdd5407d2d0 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] [instance: 87931dc7-3c20-4661-8653-972aacfec19e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:33.446300 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfa634c9-fb96-41e1-83a4-2bdd5407d2d0 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:33.447120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfa634c9-fb96-41e1-83a4-2bdd5407d2d0 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:33.447885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfa634c9-fb96-41e1-83a4-2bdd5407d2d0 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:33.449015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfa634c9-fb96-41e1-83a4-2bdd5407d2d0 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:33.449726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfa634c9-fb96-41e1-83a4-2bdd5407d2d0 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:33.450316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfa634c9-fb96-41e1-83a4-2bdd5407d2d0 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:34.413755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dfa634c9-fb96-41e1-83a4-2bdd5407d2d0 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62581f838674471fadf9609a3135d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a02ff920d478983e39d3c1bd62b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:34.459439 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dfa634c9-fb96-41e1-83a4-2bdd5407d2d0 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] 10.222.0.16 "GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e" status: 200 len: 1396 microversion: 2.1 time: 1.020408 Sep 07 12:45:34.463005 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1633/3243] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:33 2022] GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e => generated 1396 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:34.499240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-61c73d97-65c5-4835-b77b-f5246c699244 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:34.507085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-61c73d97-65c5-4835-b77b-f5246c699244 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:34.566818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61c73d97-65c5-4835-b77b-f5246c699244 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:34.571175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61c73d97-65c5-4835-b77b-f5246c699244 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:34.572344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61c73d97-65c5-4835-b77b-f5246c699244 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:34.573931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61c73d97-65c5-4835-b77b-f5246c699244 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:34.574950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61c73d97-65c5-4835-b77b-f5246c699244 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:34.576232 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61c73d97-65c5-4835-b77b-f5246c699244 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:35.147041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-61c73d97-65c5-4835-b77b-f5246c699244 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:35.177177 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-61c73d97-65c5-4835-b77b-f5246c699244 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1272 microversion: 2.1 time: 0.712419 Sep 07 12:45:35.180279 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1634/3244] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:34 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1272 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:35.188151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5e030387-a600-4bfb-9242-eb1f21c8cadd tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:35.189367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5e030387-a600-4bfb-9242-eb1f21c8cadd tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:35.207251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e030387-a600-4bfb-9242-eb1f21c8cadd tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:35.209099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e030387-a600-4bfb-9242-eb1f21c8cadd tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:35.210507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e030387-a600-4bfb-9242-eb1f21c8cadd tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:35.212410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e030387-a600-4bfb-9242-eb1f21c8cadd tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:35.214648 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e030387-a600-4bfb-9242-eb1f21c8cadd tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:35.215629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e030387-a600-4bfb-9242-eb1f21c8cadd tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:36.157291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5e030387-a600-4bfb-9242-eb1f21c8cadd tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:36.172834 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5e030387-a600-4bfb-9242-eb1f21c8cadd tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1318 microversion: 2.1 time: 0.987495 Sep 07 12:45:36.178756 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1635/3245] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:35 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1318 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:36.197407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-167e7e14-2bbc-4140-bd2c-796d7ed0a811 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:36.199974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-167e7e14-2bbc-4140-bd2c-796d7ed0a811 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] [instance: 87931dc7-3c20-4661-8653-972aacfec19e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:36.222885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-167e7e14-2bbc-4140-bd2c-796d7ed0a811 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:36.226305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-167e7e14-2bbc-4140-bd2c-796d7ed0a811 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:36.227869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-167e7e14-2bbc-4140-bd2c-796d7ed0a811 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:36.230260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-167e7e14-2bbc-4140-bd2c-796d7ed0a811 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:36.232795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-167e7e14-2bbc-4140-bd2c-796d7ed0a811 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:36.236923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-167e7e14-2bbc-4140-bd2c-796d7ed0a811 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:37.767259 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-167e7e14-2bbc-4140-bd2c-796d7ed0a811 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62581f838674471fadf9609a3135d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a02ff920d478983e39d3c1bd62b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:37.790393 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-167e7e14-2bbc-4140-bd2c-796d7ed0a811 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] 10.222.0.16 "GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e" status: 200 len: 1577 microversion: 2.1 time: 1.607865 Sep 07 12:45:37.792572 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1636/3246] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:36 2022] GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e => generated 1577 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:37.828502 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-751e4be7-205b-4abb-b6d3-a716d68e68df tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:37.836227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-751e4be7-205b-4abb-b6d3-a716d68e68df tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:37.878209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-751e4be7-205b-4abb-b6d3-a716d68e68df tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:37.879699 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-751e4be7-205b-4abb-b6d3-a716d68e68df tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:37.880928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-751e4be7-205b-4abb-b6d3-a716d68e68df tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:37.882412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-751e4be7-205b-4abb-b6d3-a716d68e68df tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:37.887251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-751e4be7-205b-4abb-b6d3-a716d68e68df tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:37.888266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-751e4be7-205b-4abb-b6d3-a716d68e68df tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:38.200255 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0c93c209-871e-428e-8c53-f19aaa626bef tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/9899b656-6576-43ea-ac4f-f36346ee1ce0" status: 202 len: 0 microversion: 2.1 time: 4.917114 Sep 07 12:45:38.200940 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1611/3247] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Sep 7 12:45:33 2022] DELETE /compute/v2.1/os-floating-ips/9899b656-6576-43ea-ac4f-f36346ee1ce0 => generated 0 bytes in 4922 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:45:38.209226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9916eab4-9da9-4a86-9cc6-f86d36ec8320 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:38.210289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9916eab4-9da9-4a86-9cc6-f86d36ec8320 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:38.259486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9916eab4-9da9-4a86-9cc6-f86d36ec8320 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:38.260186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9916eab4-9da9-4a86-9cc6-f86d36ec8320 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:38.263797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9916eab4-9da9-4a86-9cc6-f86d36ec8320 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:38.264591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9916eab4-9da9-4a86-9cc6-f86d36ec8320 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:38.270597 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9916eab4-9da9-4a86-9cc6-f86d36ec8320 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:38.271191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9916eab4-9da9-4a86-9cc6-f86d36ec8320 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:38.353675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=39,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:45:38.836955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:45:38.899268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=11 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:45:39.103994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-751e4be7-205b-4abb-b6d3-a716d68e68df tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:39.119499 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-751e4be7-205b-4abb-b6d3-a716d68e68df tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1314 microversion: 2.1 time: 1.305897 Sep 07 12:45:39.123341 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1637/3248] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:37 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1314 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:39.133023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-995e3b15-054b-4544-aba0-d716287bb400 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:39.133586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-995e3b15-054b-4544-aba0-d716287bb400 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] [instance: 87931dc7-3c20-4661-8653-972aacfec19e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:39.165985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-995e3b15-054b-4544-aba0-d716287bb400 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:39.171871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-995e3b15-054b-4544-aba0-d716287bb400 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:39.172343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-995e3b15-054b-4544-aba0-d716287bb400 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:39.173202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-995e3b15-054b-4544-aba0-d716287bb400 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:39.175740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-995e3b15-054b-4544-aba0-d716287bb400 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:39.176299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-995e3b15-054b-4544-aba0-d716287bb400 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:39.367941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9916eab4-9da9-4a86-9cc6-f86d36ec8320 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:39.430252 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9916eab4-9da9-4a86-9cc6-f86d36ec8320 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1318 microversion: 2.1 time: 1.222822 Sep 07 12:45:39.438872 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1612/3249] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:38 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1318 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:39.469133 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1850a498-b425-4c71-84af-8f9647383434 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '.version_select at 0x7fc4181e9280>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:39.924212 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-995e3b15-054b-4544-aba0-d716287bb400 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] 10.222.0.16 "GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.799310 Sep 07 12:45:39.925172 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1638/3250] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Sep 7 12:45:39 2022] GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e/os-interface => generated 284 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:45:39.936176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-260df69c-31c1-42b2-9cdf-f6293b5cbde4 req-5e074549-8849-4262-928a-1eaad03ebbbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc8c812d-29e5-4153-a609-74814c3e7c86", "tag": "793646ba-5b13-4cdc-afbf-a554b83f8b18"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:39.986804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-260df69c-31c1-42b2-9cdf-f6293b5cbde4 req-5e074549-8849-4262-928a-1eaad03ebbbd service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:40.013506 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-260df69c-31c1-42b2-9cdf-f6293b5cbde4 req-5e074549-8849-4262-928a-1eaad03ebbbd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:40.022363 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-260df69c-31c1-42b2-9cdf-f6293b5cbde4 req-5e074549-8849-4262-928a-1eaad03ebbbd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:40.067968 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-260df69c-31c1-42b2-9cdf-f6293b5cbde4 req-5e074549-8849-4262-928a-1eaad03ebbbd service nova] Creating event network-changed:793646ba-5b13-4cdc-afbf-a554b83f8b18 for instance dc8c812d-29e5-4153-a609-74814c3e7c86 on n-h2-852087-9 Sep 07 12:45:40.099466 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-260df69c-31c1-42b2-9cdf-f6293b5cbde4 req-5e074549-8849-4262-928a-1eaad03ebbbd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166919 Sep 07 12:45:40.107874 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1639/3251] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:45:40.168644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-57431656-e1d2-4601-ad10-4545b8be8436 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:40.169869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-57431656-e1d2-4601-ad10-4545b8be8436 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:40.206008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57431656-e1d2-4601-ad10-4545b8be8436 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:40.206679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57431656-e1d2-4601-ad10-4545b8be8436 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:40.221115 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57431656-e1d2-4601-ad10-4545b8be8436 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:40.225182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57431656-e1d2-4601-ad10-4545b8be8436 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:40.228688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57431656-e1d2-4601-ad10-4545b8be8436 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:40.231461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57431656-e1d2-4601-ad10-4545b8be8436 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:41.025110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-57431656-e1d2-4601-ad10-4545b8be8436 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:41.055465 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-57431656-e1d2-4601-ad10-4545b8be8436 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1314 microversion: 2.1 time: 0.889546 Sep 07 12:45:41.067920 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1640/3252] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:40 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1314 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:45:41.101646 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6a7bc6dd-52be-46bf-bacd-3423db9e427f tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:41.105642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6a7bc6dd-52be-46bf-bacd-3423db9e427f tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:41.148934 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a7bc6dd-52be-46bf-bacd-3423db9e427f tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:41.164280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a7bc6dd-52be-46bf-bacd-3423db9e427f tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:41.184601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a7bc6dd-52be-46bf-bacd-3423db9e427f tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:41.187599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a7bc6dd-52be-46bf-bacd-3423db9e427f tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:41.188608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a7bc6dd-52be-46bf-bacd-3423db9e427f tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:41.198854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a7bc6dd-52be-46bf-bacd-3423db9e427f tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:42.212446 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1850a498-b425-4c71-84af-8f9647383434 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/e484593e-9ab0-4467-838c-6e95391ad820" status: 202 len: 0 microversion: 2.1 time: 2.769782 Sep 07 12:45:42.217900 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1613/3253] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:45:39 2022] DELETE /compute/v2.1/os-security-groups/e484593e-9ab0-4467-838c-6e95391ad820 => generated 0 bytes in 2778 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:45:42.238952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-219ce7fb-4bfe-43c7-82ae-3c9fbcf4db5a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:42.239577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-219ce7fb-4bfe-43c7-82ae-3c9fbcf4db5a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:42.260826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-219ce7fb-4bfe-43c7-82ae-3c9fbcf4db5a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:42.261163 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-219ce7fb-4bfe-43c7-82ae-3c9fbcf4db5a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:42.267497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-219ce7fb-4bfe-43c7-82ae-3c9fbcf4db5a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:42.268303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-219ce7fb-4bfe-43c7-82ae-3c9fbcf4db5a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:42.268799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-219ce7fb-4bfe-43c7-82ae-3c9fbcf4db5a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:42.269247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-219ce7fb-4bfe-43c7-82ae-3c9fbcf4db5a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:42.437221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6a7bc6dd-52be-46bf-bacd-3423db9e427f tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:42.473622 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6a7bc6dd-52be-46bf-bacd-3423db9e427f tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1318 microversion: 2.1 time: 1.401043 Sep 07 12:45:42.475148 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1641/3254] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:41 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1318 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:42.503126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e11cc4ff-7d03-46a9-9c74-2895e363da90 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:42.506444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e11cc4ff-7d03-46a9-9c74-2895e363da90 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:42.531179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e11cc4ff-7d03-46a9-9c74-2895e363da90 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:42.537375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e11cc4ff-7d03-46a9-9c74-2895e363da90 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:42.539015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e11cc4ff-7d03-46a9-9c74-2895e363da90 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:42.540635 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e11cc4ff-7d03-46a9-9c74-2895e363da90 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:42.545045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e11cc4ff-7d03-46a9-9c74-2895e363da90 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:42.546186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e11cc4ff-7d03-46a9-9c74-2895e363da90 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:42.687018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e11cc4ff-7d03-46a9-9c74-2895e363da90 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:45:43.100036 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e11cc4ff-7d03-46a9-9c74-2895e363da90 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 204 len: 0 microversion: 2.1 time: 0.619774 Sep 07 12:45:43.100765 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1642/3255] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:45:42 2022] DELETE /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 0 bytes in 624 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:45:43.233734 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-219ce7fb-4bfe-43c7-82ae-3c9fbcf4db5a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:43.255100 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-219ce7fb-4bfe-43c7-82ae-3c9fbcf4db5a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1314 microversion: 2.1 time: 1.033743 Sep 07 12:45:43.256303 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1614/3256] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:42 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1314 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:43.269856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-a37b6694-3a06-48bc-aa12-90570550a6e2 req-eb604cdf-122b-4754-a0c6-271157758592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cf493cf-e2dc-4589-a81e-8eac7bbded71", "tag": "31bf026a-f253-4d7f-a890-203d22ba6fdd"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:43.289528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a37b6694-3a06-48bc-aa12-90570550a6e2 req-eb604cdf-122b-4754-a0c6-271157758592 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:43.290370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a37b6694-3a06-48bc-aa12-90570550a6e2 req-eb604cdf-122b-4754-a0c6-271157758592 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:43.291096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a37b6694-3a06-48bc-aa12-90570550a6e2 req-eb604cdf-122b-4754-a0c6-271157758592 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:43.317577 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-a37b6694-3a06-48bc-aa12-90570550a6e2 req-eb604cdf-122b-4754-a0c6-271157758592 service nova] Creating event network-changed:31bf026a-f253-4d7f-a890-203d22ba6fdd for instance 6cf493cf-e2dc-4589-a81e-8eac7bbded71 on n-h1-852087-9 Sep 07 12:45:43.325842 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-a37b6694-3a06-48bc-aa12-90570550a6e2 req-eb604cdf-122b-4754-a0c6-271157758592 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065638 Sep 07 12:45:43.329124 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1615/3257] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:45:43.338414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-89a20c94-0801-4511-8227-f255a42021b9 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:43.339419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-89a20c94-0801-4511-8227-f255a42021b9 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:43.351649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89a20c94-0801-4511-8227-f255a42021b9 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:43.352362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89a20c94-0801-4511-8227-f255a42021b9 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:43.352904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89a20c94-0801-4511-8227-f255a42021b9 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:43.355237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89a20c94-0801-4511-8227-f255a42021b9 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:43.356331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89a20c94-0801-4511-8227-f255a42021b9 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:43.357098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89a20c94-0801-4511-8227-f255a42021b9 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:43.489714 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-baff5f06-a5e6-4026-93e8-bcb630135982 tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] Calling method '.version_select at 0x7fc418d541f0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:43.627045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG neutronclient.v2_0.client [None req-baff5f06-a5e6-4026-93e8-bcb630135982 tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 600105a7-c48c-49d1-834c-31b421f11f6b does not exist", "detail": ""}} {{(pid=122433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 12:45:43.627802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.security_group_api [None req-baff5f06-a5e6-4026-93e8-bcb630135982 tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] Neutron security group 600105a7-c48c-49d1-834c-31b421f11f6b not found {{(pid=122433) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 12:45:43.628424 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-baff5f06-a5e6-4026-93e8-bcb630135982 tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] HTTP exception thrown: Security group 600105a7-c48c-49d1-834c-31b421f11f6b does not exist Sep 07 12:45:43.628424 n-d-852087-9 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-b3d96877-8201-4bc8-a775-eefe5dd8f8c5'] Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-baff5f06-a5e6-4026-93e8-bcb630135982 tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] Request method failure captured: Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-security-groups/600105a7-c48c-49d1-834c-31b421f11f6b HTTP/1.1 Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJJ2MTihyYcjInY0qpEzyJBuTPUA-_gKI26QkQzcTSvdYPyOVtmErrnEMtZuD_-3rj4tlcplyzKsoA94Jxet6aCjzXWe16OnlvsAsN4KmQMQWEpUhAI6r1bJ5lt5Mxm-__rPxvWBGh2q3ErKF6xNGGF-AcrW1N8M3yXdFoodQ-ey8Lk Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: cea301a05d974c498a2ee62b013c6967 Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2043556858 Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cea301a05d974c498a2ee62b013c6967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cea301a05d974c498a2ee62b013c6967"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cea301a05d974c498a2ee62b013c6967"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cea301a05d974c498a2ee62b013c6967"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2043556858 Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: cea301a05d974c498a2ee62b013c6967 Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2043556858 Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-SecurityGroupsNegativeTestJSON-2043556858-project Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: a3d56dad2385444b80c96a68cd0c1f95 Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2043556858-project Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: exception: Security group 600105a7-c48c-49d1-834c-31b421f11f6b does not exist Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-b3d96877-8201-4bc8-a775-eefe5dd8f8c5'] Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '600105a7-c48c-49d1-834c-31b421f11f6b'} Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 12:45:43.630965 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 600105a7-c48c-49d1-834c-31b421f11f6b does not exist Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3d96877-8201-4bc8-a775-eefe5dd8f8c5'] Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 600105a7-c48c-49d1-834c-31b421f11f6b does not exist Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3d96877-8201-4bc8-a775-eefe5dd8f8c5'] Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 600105a7-c48c-49d1-834c-31b421f11f6b does not exist Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3d96877-8201-4bc8-a775-eefe5dd8f8c5'] Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 600105a7-c48c-49d1-834c-31b421f11f6b does not exist Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3d96877-8201-4bc8-a775-eefe5dd8f8c5'] Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-baff5f06-a5e6-4026-93e8-bcb630135982 tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] Returning 404 to user: Security group 600105a7-c48c-49d1-834c-31b421f11f6b does not exist Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: Neutron server returns request_ids: ['req-b3d96877-8201-4bc8-a775-eefe5dd8f8c5'] {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-baff5f06-a5e6-4026-93e8-bcb630135982 tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/600105a7-c48c-49d1-834c-31b421f11f6b" status: 404 len: 194 microversion: 2.1 time: 0.531657 Sep 07 12:45:43.635788 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1643/3258] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:45:43 2022] DELETE /compute/v2.1/os-security-groups/600105a7-c48c-49d1-834c-31b421f11f6b => generated 194 bytes in 534 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:45:43.661248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b878252e-5327-468f-b067-0fa3733f677e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:43.663093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b878252e-5327-468f-b067-0fa3733f677e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:43.691963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b878252e-5327-468f-b067-0fa3733f677e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:43.697864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b878252e-5327-468f-b067-0fa3733f677e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:43.698418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b878252e-5327-468f-b067-0fa3733f677e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:43.699672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b878252e-5327-468f-b067-0fa3733f677e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:43.701183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b878252e-5327-468f-b067-0fa3733f677e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:43.710068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b878252e-5327-468f-b067-0fa3733f677e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:44.075238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-89a20c94-0801-4511-8227-f255a42021b9 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:44.086439 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-89a20c94-0801-4511-8227-f255a42021b9 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1509 microversion: 2.1 time: 0.753844 Sep 07 12:45:44.087798 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1616/3259] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:43 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1509 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:44.093160 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-850933ad-f535-4e15-8d4b-02d47080449a tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.003999 Sep 07 12:45:44.094859 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1617/3260] 10.222.0.16 () {58 vars in 1164 bytes} [Wed Sep 7 12:45:44 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 07 12:45:44.104193 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d794d4ab-0192-4284-9b5f-47d97fc0f32d tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:44.105195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d794d4ab-0192-4284-9b5f-47d97fc0f32d tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] [instance: 87931dc7-3c20-4661-8653-972aacfec19e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:44.114968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d794d4ab-0192-4284-9b5f-47d97fc0f32d tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:44.115955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d794d4ab-0192-4284-9b5f-47d97fc0f32d tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:44.116765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d794d4ab-0192-4284-9b5f-47d97fc0f32d tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:44.117925 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d794d4ab-0192-4284-9b5f-47d97fc0f32d tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:44.118634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d794d4ab-0192-4284-9b5f-47d97fc0f32d tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:44.119272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d794d4ab-0192-4284-9b5f-47d97fc0f32d tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:44.295318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b878252e-5327-468f-b067-0fa3733f677e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:44.306208 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b878252e-5327-468f-b067-0fa3733f677e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1318 microversion: 2.1 time: 0.668513 Sep 07 12:45:44.307156 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1644/3261] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:43 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1318 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:44.327303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-d7ec8cd8-5450-41c0-b1ee-1ae36c392d85 req-a00f98c1-51e7-425b-96ab-321e7b3c1de7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87931dc7-3c20-4661-8653-972aacfec19e", "tag": "0aff791e-d1d3-4633-893c-be6e34af3651"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:44.343063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d7ec8cd8-5450-41c0-b1ee-1ae36c392d85 req-a00f98c1-51e7-425b-96ab-321e7b3c1de7 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:44.343925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d7ec8cd8-5450-41c0-b1ee-1ae36c392d85 req-a00f98c1-51e7-425b-96ab-321e7b3c1de7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:44.344756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d7ec8cd8-5450-41c0-b1ee-1ae36c392d85 req-a00f98c1-51e7-425b-96ab-321e7b3c1de7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:44.359536 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-d7ec8cd8-5450-41c0-b1ee-1ae36c392d85 req-a00f98c1-51e7-425b-96ab-321e7b3c1de7 service nova] Creating event network-changed:0aff791e-d1d3-4633-893c-be6e34af3651 for instance 87931dc7-3c20-4661-8653-972aacfec19e on n-h2-852087-9 Sep 07 12:45:44.368367 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-d7ec8cd8-5450-41c0-b1ee-1ae36c392d85 req-a00f98c1-51e7-425b-96ab-321e7b3c1de7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044617 Sep 07 12:45:44.374437 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1645/3262] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:45:44.381911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-309557d8-ac13-4383-950c-b156a5314486 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc41928e670>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:44.455861 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-309557d8-ac13-4383-950c-b156a5314486 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/de8f8ae8-8f4d-4c1f-84af-ca4ddbd27865" status: 200 len: 662 microversion: 2.1 time: 0.079613 Sep 07 12:45:44.466682 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1646/3263] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:45:44 2022] GET /compute/v2.1/images/de8f8ae8-8f4d-4c1f-84af-ca4ddbd27865 => generated 662 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:45:44.478313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2485afd2-66dd-4cc8-8004-be8865a1629c tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] Calling method '.version_select at 0x7fc418c7a940>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:44.478601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d794d4ab-0192-4284-9b5f-47d97fc0f32d tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62581f838674471fadf9609a3135d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a02ff920d478983e39d3c1bd62b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:44.493302 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d794d4ab-0192-4284-9b5f-47d97fc0f32d tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] 10.222.0.16 "GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e" status: 200 len: 1577 microversion: 2.1 time: 0.396785 Sep 07 12:45:44.495910 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1618/3264] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:44 2022] GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e => generated 1577 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:44.507260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3629aa21-10b6-4fe2-97b3-84c71d3bc6ca tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:44.508479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3629aa21-10b6-4fe2-97b3-84c71d3bc6ca tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:44.527134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3629aa21-10b6-4fe2-97b3-84c71d3bc6ca tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:44.527608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3629aa21-10b6-4fe2-97b3-84c71d3bc6ca tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:44.531152 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3629aa21-10b6-4fe2-97b3-84c71d3bc6ca tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:44.534600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3629aa21-10b6-4fe2-97b3-84c71d3bc6ca tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:44.537183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3629aa21-10b6-4fe2-97b3-84c71d3bc6ca tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:44.537714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3629aa21-10b6-4fe2-97b3-84c71d3bc6ca tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:44.809440 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2485afd2-66dd-4cc8-8004-be8865a1629c tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.340429 Sep 07 12:45:44.810416 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1647/3265] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Sep 7 12:45:44 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:45:44.825008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-77515b9d-4f07-49ca-8df7-c6d4cd5fb32d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc41d29a0d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:44.852481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3629aa21-10b6-4fe2-97b3-84c71d3bc6ca tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:44.862523 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3629aa21-10b6-4fe2-97b3-84c71d3bc6ca tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1314 microversion: 2.1 time: 0.365143 Sep 07 12:45:44.867786 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1619/3266] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:44 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:44.879243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-29234939-1ad9-49e8-9f01-2350645385fa tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] Calling method '.version_select at 0x7fc418403ee0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:44.942815 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-77515b9d-4f07-49ca-8df7-c6d4cd5fb32d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/de8f8ae8-8f4d-4c1f-84af-ca4ddbd27865" status: 200 len: 662 microversion: 2.1 time: 0.122232 Sep 07 12:45:44.944074 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1648/3267] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:45:44 2022] GET /compute/v2.1/images/de8f8ae8-8f4d-4c1f-84af-ca4ddbd27865 => generated 662 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:45:45.114658 n-d-852087-9 devstack@n-api.service[122432]: DEBUG neutronclient.v2_0.client [None req-29234939-1ad9-49e8-9f01-2350645385fa tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 12:45:45.115378 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-29234939-1ad9-49e8-9f01-2350645385fa tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] HTTP exception thrown: Insufficient rights for removing default security group. Sep 07 12:45:45.115378 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-a27f0ef2-d085-4471-9502-6e93f95dba3b'] Sep 07 12:45:45.116155 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0d7d1ea1-3c53-40be-a95c-0017f7583ac4 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:45.116914 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0d7d1ea1-3c53-40be-a95c-0017f7583ac4 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-29234939-1ad9-49e8-9f01-2350645385fa tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] Request method failure captured: Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/os-security-groups/8afc9f3e-680e-42a2-97ff-f125b8616a11 HTTP/1.1 Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJJ2MTihyYcjInY0qpEzyJBuTPUA-_gKI26QkQzcTSvdYPyOVtmErrnEMtZuD_-3rj4tlcplyzKsoA94Jxet6aCjzXWe16OnlvsAsN4KmQMQWEpUhAI6r1bJ5lt5Mxm-__rPxvWBGh2q3ErKF6xNGGF-AcrW1N8M3yXdFoodQ-ey8Lk Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: cea301a05d974c498a2ee62b013c6967 Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2043556858 Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cea301a05d974c498a2ee62b013c6967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cea301a05d974c498a2ee62b013c6967"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cea301a05d974c498a2ee62b013c6967"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cea301a05d974c498a2ee62b013c6967"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2043556858 Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: cea301a05d974c498a2ee62b013c6967 Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2043556858 Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-SecurityGroupsNegativeTestJSON-2043556858-project Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: a3d56dad2385444b80c96a68cd0c1f95 Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2043556858-project Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: exception: Insufficient rights for removing default security group. Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-a27f0ef2-d085-4471-9502-6e93f95dba3b'] Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '8afc9f3e-680e-42a2-97ff-f125b8616a11'} Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 12:45:45.117611 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a27f0ef2-d085-4471-9502-6e93f95dba3b'] Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a27f0ef2-d085-4471-9502-6e93f95dba3b'] Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a27f0ef2-d085-4471-9502-6e93f95dba3b'] Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a27f0ef2-d085-4471-9502-6e93f95dba3b'] Sep 07 12:45:45.122135 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:45:45.126513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-29234939-1ad9-49e8-9f01-2350645385fa tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] Returning 400 to user: Insufficient rights for removing default security group. Sep 07 12:45:45.126513 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-a27f0ef2-d085-4471-9502-6e93f95dba3b'] {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:45:45.127470 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-29234939-1ad9-49e8-9f01-2350645385fa tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8afc9f3e-680e-42a2-97ff-f125b8616a11" status: 400 len: 182 microversion: 2.1 time: 0.258334 Sep 07 12:45:45.127966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d7d1ea1-3c53-40be-a95c-0017f7583ac4 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:45.128893 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1620/3268] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:45:44 2022] DELETE /compute/v2.1/os-security-groups/8afc9f3e-680e-42a2-97ff-f125b8616a11 => generated 182 bytes in 260 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:45:45.138034 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d7d1ea1-3c53-40be-a95c-0017f7583ac4 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:45.138626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d7d1ea1-3c53-40be-a95c-0017f7583ac4 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:45.141022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d7d1ea1-3c53-40be-a95c-0017f7583ac4 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:45.141022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d7d1ea1-3c53-40be-a95c-0017f7583ac4 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:45.141022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d7d1ea1-3c53-40be-a95c-0017f7583ac4 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:45.143977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7685ec0c-984d-4a74-812f-91df15b3ff07 tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] Calling method '.version_select at 0x7fc4181f4dc0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:45.180003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG neutronclient.v2_0.client [None req-7685ec0c-984d-4a74-812f-91df15b3ff07 tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2e764048-a48b-4459-8770-1ed0cec7099a does not exist", "detail": ""}} {{(pid=122432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 12:45:45.180614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.security_group_api [None req-7685ec0c-984d-4a74-812f-91df15b3ff07 tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] Neutron security group 2e764048-a48b-4459-8770-1ed0cec7099a not found {{(pid=122432) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 12:45:45.181139 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-7685ec0c-984d-4a74-812f-91df15b3ff07 tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] HTTP exception thrown: Security group 2e764048-a48b-4459-8770-1ed0cec7099a does not exist Sep 07 12:45:45.181139 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-9c0baa42-5ec8-4330-8a8f-32c00a0c00fc'] Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7685ec0c-984d-4a74-812f-91df15b3ff07 tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] Request method failure captured: Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-security-groups/2e764048-a48b-4459-8770-1ed0cec7099a HTTP/1.1 Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJJ2MTihyYcjInY0qpEzyJBuTPUA-_gKI26QkQzcTSvdYPyOVtmErrnEMtZuD_-3rj4tlcplyzKsoA94Jxet6aCjzXWe16OnlvsAsN4KmQMQWEpUhAI6r1bJ5lt5Mxm-__rPxvWBGh2q3ErKF6xNGGF-AcrW1N8M3yXdFoodQ-ey8Lk Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: cea301a05d974c498a2ee62b013c6967 Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2043556858 Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cea301a05d974c498a2ee62b013c6967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cea301a05d974c498a2ee62b013c6967"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cea301a05d974c498a2ee62b013c6967"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cea301a05d974c498a2ee62b013c6967"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2043556858 Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: cea301a05d974c498a2ee62b013c6967 Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2043556858 Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-SecurityGroupsNegativeTestJSON-2043556858-project Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: a3d56dad2385444b80c96a68cd0c1f95 Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2043556858-project Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: exception: Security group 2e764048-a48b-4459-8770-1ed0cec7099a does not exist Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-9c0baa42-5ec8-4330-8a8f-32c00a0c00fc'] Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '2e764048-a48b-4459-8770-1ed0cec7099a'} Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 12:45:45.184704 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2e764048-a48b-4459-8770-1ed0cec7099a does not exist Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c0baa42-5ec8-4330-8a8f-32c00a0c00fc'] Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2e764048-a48b-4459-8770-1ed0cec7099a does not exist Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c0baa42-5ec8-4330-8a8f-32c00a0c00fc'] Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2e764048-a48b-4459-8770-1ed0cec7099a does not exist Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c0baa42-5ec8-4330-8a8f-32c00a0c00fc'] Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2e764048-a48b-4459-8770-1ed0cec7099a does not exist Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c0baa42-5ec8-4330-8a8f-32c00a0c00fc'] Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7685ec0c-984d-4a74-812f-91df15b3ff07 tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] Returning 404 to user: Security group 2e764048-a48b-4459-8770-1ed0cec7099a does not exist Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-9c0baa42-5ec8-4330-8a8f-32c00a0c00fc'] {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7685ec0c-984d-4a74-812f-91df15b3ff07 tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/2e764048-a48b-4459-8770-1ed0cec7099a" status: 404 len: 194 microversion: 2.1 time: 0.046315 Sep 07 12:45:45.188758 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1621/3269] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Sep 7 12:45:45 2022] GET /compute/v2.1/os-security-groups/2e764048-a48b-4459-8770-1ed0cec7099a => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:45:45.198688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-845e886f-9695-482d-8361-ed1d3f0048d5 tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] Action: 'update', calling method: .version_select at 0x7fc418403d30>, body: {"security_group": {"name": "tempest-sg-1169050899", "description": "tempest-description-1033398965"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:45.227164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG neutronclient.v2_0.client [None req-845e886f-9695-482d-8361-ed1d3f0048d5 tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 34c0aada-1fa2-4597-b34d-b55e94dd32f0 does not exist", "detail": ""}} {{(pid=122432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 07 12:45:45.227767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.security_group_api [None req-845e886f-9695-482d-8361-ed1d3f0048d5 tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] Neutron security group 34c0aada-1fa2-4597-b34d-b55e94dd32f0 not found {{(pid=122432) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 07 12:45:45.228289 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-845e886f-9695-482d-8361-ed1d3f0048d5 tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] HTTP exception thrown: Security group 34c0aada-1fa2-4597-b34d-b55e94dd32f0 does not exist Sep 07 12:45:45.228289 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-eea4ccbd-e063-46c5-bfd3-eb2a982ff529'] Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-845e886f-9695-482d-8361-ed1d3f0048d5 tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] Request method failure captured: Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: request: PUT /compute/v2.1/os-security-groups/34c0aada-1fa2-4597-b34d-b55e94dd32f0 HTTP/1.1 Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 102 Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJJ2MTihyYcjInY0qpEzyJBuTPUA-_gKI26QkQzcTSvdYPyOVtmErrnEMtZuD_-3rj4tlcplyzKsoA94Jxet6aCjzXWe16OnlvsAsN4KmQMQWEpUhAI6r1bJ5lt5Mxm-__rPxvWBGh2q3ErKF6xNGGF-AcrW1N8M3yXdFoodQ-ey8Lk Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: cea301a05d974c498a2ee62b013c6967 Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2043556858 Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cea301a05d974c498a2ee62b013c6967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cea301a05d974c498a2ee62b013c6967"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cea301a05d974c498a2ee62b013c6967"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cea301a05d974c498a2ee62b013c6967"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2043556858 Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: cea301a05d974c498a2ee62b013c6967 Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2043556858 Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-SecurityGroupsNegativeTestJSON-2043556858-project Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: a3d56dad2385444b80c96a68cd0c1f95 Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2043556858-project Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: {"security_group": {"name": "tempest-sg-1169050899", "description": "tempest-description-1033398965"}} Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: exception: Security group 34c0aada-1fa2-4597-b34d-b55e94dd32f0 does not exist Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-eea4ccbd-e063-46c5-bfd3-eb2a982ff529'] Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '34c0aada-1fa2-4597-b34d-b55e94dd32f0', 'body': {'security_group': {'name': 'tempest-sg-1169050899', 'description': 'tempest-description-1033398965'}}} Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 07 12:45:45.230544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 34c0aada-1fa2-4597-b34d-b55e94dd32f0 does not exist Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eea4ccbd-e063-46c5-bfd3-eb2a982ff529'] Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 34c0aada-1fa2-4597-b34d-b55e94dd32f0 does not exist Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eea4ccbd-e063-46c5-bfd3-eb2a982ff529'] Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 34c0aada-1fa2-4597-b34d-b55e94dd32f0 does not exist Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eea4ccbd-e063-46c5-bfd3-eb2a982ff529'] Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 34c0aada-1fa2-4597-b34d-b55e94dd32f0 does not exist Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eea4ccbd-e063-46c5-bfd3-eb2a982ff529'] Sep 07 12:45:45.235424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:45:45.245183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-845e886f-9695-482d-8361-ed1d3f0048d5 tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] Returning 404 to user: Security group 34c0aada-1fa2-4597-b34d-b55e94dd32f0 does not exist Sep 07 12:45:45.245183 n-d-852087-9 devstack@n-api.service[122432]: Neutron server returns request_ids: ['req-eea4ccbd-e063-46c5-bfd3-eb2a982ff529'] {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:45:45.246684 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-845e886f-9695-482d-8361-ed1d3f0048d5 tempest-SecurityGroupsNegativeTestJSON-2043556858 tempest-SecurityGroupsNegativeTestJSON-2043556858-project] 10.222.0.16 "PUT /compute/v2.1/os-security-groups/34c0aada-1fa2-4597-b34d-b55e94dd32f0" status: 404 len: 194 microversion: 2.1 time: 0.053452 Sep 07 12:45:45.247855 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1622/3270] 10.222.0.16 () {60 vars in 1290 bytes} [Wed Sep 7 12:45:45 2022] PUT /compute/v2.1/os-security-groups/34c0aada-1fa2-4597-b34d-b55e94dd32f0 => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:45:45.332186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4014b495-3dd4-4df1-b038-d0bbf7946209 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:45.333023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4014b495-3dd4-4df1-b038-d0bbf7946209 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:45.350036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4014b495-3dd4-4df1-b038-d0bbf7946209 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:45.351206 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4014b495-3dd4-4df1-b038-d0bbf7946209 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:45.353733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4014b495-3dd4-4df1-b038-d0bbf7946209 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:45.357603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4014b495-3dd4-4df1-b038-d0bbf7946209 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:45.359138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4014b495-3dd4-4df1-b038-d0bbf7946209 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:45.361944 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4014b495-3dd4-4df1-b038-d0bbf7946209 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:45.477061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0d7d1ea1-3c53-40be-a95c-0017f7583ac4 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:45.491965 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0d7d1ea1-3c53-40be-a95c-0017f7583ac4 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1509 microversion: 2.1 time: 0.379543 Sep 07 12:45:45.501702 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1649/3271] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:45 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1509 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:45.765104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4014b495-3dd4-4df1-b038-d0bbf7946209 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:45.777715 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4014b495-3dd4-4df1-b038-d0bbf7946209 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1318 microversion: 2.1 time: 0.451447 Sep 07 12:45:45.779203 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1623/3272] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:45 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1318 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:45.892243 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bd9b15d9-d50c-412f-9b6d-573d1637e57e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:45.898133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bd9b15d9-d50c-412f-9b6d-573d1637e57e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:45.923471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd9b15d9-d50c-412f-9b6d-573d1637e57e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:45.924769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd9b15d9-d50c-412f-9b6d-573d1637e57e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:45.925435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd9b15d9-d50c-412f-9b6d-573d1637e57e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:45.926423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd9b15d9-d50c-412f-9b6d-573d1637e57e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:45.927101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd9b15d9-d50c-412f-9b6d-573d1637e57e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:45.927544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd9b15d9-d50c-412f-9b6d-573d1637e57e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:46.227690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bd9b15d9-d50c-412f-9b6d-573d1637e57e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:46.238403 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bd9b15d9-d50c-412f-9b6d-573d1637e57e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1314 microversion: 2.1 time: 0.351960 Sep 07 12:45:46.243086 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1650/3273] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:45 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:46.515390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-04162f51-1e23-4e72-91b9-f8f5cbad8586 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:46.515390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-04162f51-1e23-4e72-91b9-f8f5cbad8586 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:46.535774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04162f51-1e23-4e72-91b9-f8f5cbad8586 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:46.536942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04162f51-1e23-4e72-91b9-f8f5cbad8586 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:46.537720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04162f51-1e23-4e72-91b9-f8f5cbad8586 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:46.539009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04162f51-1e23-4e72-91b9-f8f5cbad8586 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:46.539698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04162f51-1e23-4e72-91b9-f8f5cbad8586 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:46.540239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04162f51-1e23-4e72-91b9-f8f5cbad8586 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:46.800790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f59c3664-9e56-46a8-b08f-329e4b2849e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:46.801477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f59c3664-9e56-46a8-b08f-329e4b2849e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:46.814862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f59c3664-9e56-46a8-b08f-329e4b2849e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:46.818836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f59c3664-9e56-46a8-b08f-329e4b2849e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:46.819472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f59c3664-9e56-46a8-b08f-329e4b2849e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:46.820410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f59c3664-9e56-46a8-b08f-329e4b2849e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:46.820893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f59c3664-9e56-46a8-b08f-329e4b2849e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:46.821332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f59c3664-9e56-46a8-b08f-329e4b2849e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:46.882095 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:45:47.986470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-04162f51-1e23-4e72-91b9-f8f5cbad8586 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:48.008238 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-04162f51-1e23-4e72-91b9-f8f5cbad8586 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1509 microversion: 2.1 time: 1.497122 Sep 07 12:45:48.023154 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1624/3274] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:46 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1509 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:48.047053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d0095104-8a64-441d-88ef-ac69d9e31d39 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4188760d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:48.210150 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d0095104-8a64-441d-88ef-ac69d9e31d39 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/7e891158-bba0-4ba2-9f8e-068767d33973" status: 200 len: 661 microversion: 2.1 time: 0.181576 Sep 07 12:45:48.213397 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1625/3275] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:45:48 2022] GET /compute/v2.1/images/7e891158-bba0-4ba2-9f8e-068767d33973 => generated 661 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:45:48.234831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3e6eb276-a585-471c-afc1-701f7eaaa00a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:48.243012 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3e6eb276-a585-471c-afc1-701f7eaaa00a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:48.264984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=29 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:45:48.274127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e6eb276-a585-471c-afc1-701f7eaaa00a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:48.279204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e6eb276-a585-471c-afc1-701f7eaaa00a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:48.279562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f59c3664-9e56-46a8-b08f-329e4b2849e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:48.281712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e6eb276-a585-471c-afc1-701f7eaaa00a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:48.283699 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e6eb276-a585-471c-afc1-701f7eaaa00a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:48.287602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e6eb276-a585-471c-afc1-701f7eaaa00a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:48.288827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e6eb276-a585-471c-afc1-701f7eaaa00a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:48.321924 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f59c3664-9e56-46a8-b08f-329e4b2849e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1318 microversion: 2.1 time: 1.524928 Sep 07 12:45:48.327232 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1651/3276] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:46 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1318 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:48.368195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6c868fa1-2184-4f47-8452-38c9bcddb6f1 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc419ca6160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:48.535310 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6c868fa1-2184-4f47-8452-38c9bcddb6f1 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/7e891158-bba0-4ba2-9f8e-068767d33973" status: 200 len: 661 microversion: 2.1 time: 0.198904 Sep 07 12:45:48.540679 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1652/3277] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:45:48 2022] GET /compute/v2.1/images/7e891158-bba0-4ba2-9f8e-068767d33973 => generated 661 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:45:49.051981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e1f7d644-de70-4b42-8681-75100529690f tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:49.052977 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e1f7d644-de70-4b42-8681-75100529690f tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:49.084763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1f7d644-de70-4b42-8681-75100529690f tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:49.086149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1f7d644-de70-4b42-8681-75100529690f tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:49.088411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1f7d644-de70-4b42-8681-75100529690f tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:49.092487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1f7d644-de70-4b42-8681-75100529690f tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:49.094852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1f7d644-de70-4b42-8681-75100529690f tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:49.099230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1f7d644-de70-4b42-8681-75100529690f tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:50.165791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3e6eb276-a585-471c-afc1-701f7eaaa00a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:50.194137 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3e6eb276-a585-471c-afc1-701f7eaaa00a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1314 microversion: 2.1 time: 1.978324 Sep 07 12:45:50.205564 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1626/3278] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:48 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1314 bytes in 1983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:50.212133 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d534cfdb-9ff5-4ed5-af02-5ef25207e3d9 req-8ad5f9d5-1c6a-4925-bbe8-0d9e9685d18e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc8c812d-29e5-4153-a609-74814c3e7c86", "name": "network-vif-plugged", "status": "completed", "tag": "793646ba-5b13-4cdc-afbf-a554b83f8b18"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:50.235949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d534cfdb-9ff5-4ed5-af02-5ef25207e3d9 req-8ad5f9d5-1c6a-4925-bbe8-0d9e9685d18e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:50.240025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d534cfdb-9ff5-4ed5-af02-5ef25207e3d9 req-8ad5f9d5-1c6a-4925-bbe8-0d9e9685d18e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:50.240648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d534cfdb-9ff5-4ed5-af02-5ef25207e3d9 req-8ad5f9d5-1c6a-4925-bbe8-0d9e9685d18e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:50.272619 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d534cfdb-9ff5-4ed5-af02-5ef25207e3d9 req-8ad5f9d5-1c6a-4925-bbe8-0d9e9685d18e service nova] Creating event network-vif-plugged:793646ba-5b13-4cdc-afbf-a554b83f8b18 for instance dc8c812d-29e5-4153-a609-74814c3e7c86 on n-h2-852087-9 Sep 07 12:45:50.286135 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d534cfdb-9ff5-4ed5-af02-5ef25207e3d9 req-8ad5f9d5-1c6a-4925-bbe8-0d9e9685d18e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085734 Sep 07 12:45:50.287004 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1627/3279] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:45:50.295631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d5ddeda3-cd1d-4e02-8686-4ba35d5fbac4 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:50.296756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d5ddeda3-cd1d-4e02-8686-4ba35d5fbac4 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:50.306619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5ddeda3-cd1d-4e02-8686-4ba35d5fbac4 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:50.307610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5ddeda3-cd1d-4e02-8686-4ba35d5fbac4 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:50.308610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5ddeda3-cd1d-4e02-8686-4ba35d5fbac4 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:50.309766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5ddeda3-cd1d-4e02-8686-4ba35d5fbac4 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:50.310655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5ddeda3-cd1d-4e02-8686-4ba35d5fbac4 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:50.311382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5ddeda3-cd1d-4e02-8686-4ba35d5fbac4 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:50.944449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e1f7d644-de70-4b42-8681-75100529690f tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:50.976208 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e1f7d644-de70-4b42-8681-75100529690f tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1509 microversion: 2.1 time: 1.914545 Sep 07 12:45:50.976208 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1653/3280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:49 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1509 bytes in 1921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:45:50.977388 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1e27e951-e979-4e0f-b7e5-0d07ebeab089 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc41d2d3310>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:51.151231 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1e27e951-e979-4e0f-b7e5-0d07ebeab089 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/cac5e828-3cc2-4f9a-a61c-c55044456554" status: 200 len: 662 microversion: 2.1 time: 0.183200 Sep 07 12:45:51.169684 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1654/3281] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:45:50 2022] GET /compute/v2.1/images/cac5e828-3cc2-4f9a-a61c-c55044456554 => generated 662 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:45:51.205899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-27fc18ef-28db-4ba2-98eb-2491f7a9b2f0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc419ca6160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:51.221666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d5ddeda3-cd1d-4e02-8686-4ba35d5fbac4 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:51.248985 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d5ddeda3-cd1d-4e02-8686-4ba35d5fbac4 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1318 microversion: 2.1 time: 0.959762 Sep 07 12:45:51.254370 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1628/3282] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:50 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1318 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:51.278015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7435f3f5-0c0a-4c21-8c5a-d8bed5530fec tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:51.279798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7435f3f5-0c0a-4c21-8c5a-d8bed5530fec tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:51.301728 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7435f3f5-0c0a-4c21-8c5a-d8bed5530fec tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:51.310798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7435f3f5-0c0a-4c21-8c5a-d8bed5530fec tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:51.312070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7435f3f5-0c0a-4c21-8c5a-d8bed5530fec tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:51.313893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7435f3f5-0c0a-4c21-8c5a-d8bed5530fec tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:51.315083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7435f3f5-0c0a-4c21-8c5a-d8bed5530fec tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:51.316190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7435f3f5-0c0a-4c21-8c5a-d8bed5530fec tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:51.341924 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-27fc18ef-28db-4ba2-98eb-2491f7a9b2f0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/cac5e828-3cc2-4f9a-a61c-c55044456554" status: 200 len: 662 microversion: 2.1 time: 0.165025 Sep 07 12:45:51.343232 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1655/3283] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:45:51 2022] GET /compute/v2.1/images/cac5e828-3cc2-4f9a-a61c-c55044456554 => generated 662 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:45:51.676085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c44a88f7-d3f9-43cb-a918-5c14b75545a0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1197727644", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:51.852448 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-c44a88f7-d3f9-43cb-a918-5c14b75545a0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:45:52.198147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7435f3f5-0c0a-4c21-8c5a-d8bed5530fec tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:52.214468 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7435f3f5-0c0a-4c21-8c5a-d8bed5530fec tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1314 microversion: 2.1 time: 0.958019 Sep 07 12:45:52.216052 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1629/3284] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:51 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1314 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:52.238006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e80bea90-cf6e-48b3-a590-2b8886999e1a tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:52.239409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e80bea90-cf6e-48b3-a590-2b8886999e1a tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:52.252185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e80bea90-cf6e-48b3-a590-2b8886999e1a tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:52.252788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e80bea90-cf6e-48b3-a590-2b8886999e1a tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:52.253557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e80bea90-cf6e-48b3-a590-2b8886999e1a tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:52.254467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e80bea90-cf6e-48b3-a590-2b8886999e1a tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:52.255159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e80bea90-cf6e-48b3-a590-2b8886999e1a tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:52.256472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e80bea90-cf6e-48b3-a590-2b8886999e1a tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:52.524048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e80bea90-cf6e-48b3-a590-2b8886999e1a tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:52.540280 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e80bea90-cf6e-48b3-a590-2b8886999e1a tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1467 microversion: 2.1 time: 0.321736 Sep 07 12:45:52.572959 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1630/3285] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:52 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1467 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:52.583347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-06f343b8-5e2d-4e2b-ba7f-053520d5d8e6 req-b9b9ce7c-f234-4a33-b6ab-cd1c9e0b561d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca300ad8-1300-4adf-940f-8cc52f13d8dc", "name": "network-vif-deleted", "tag": "6b1ac69f-da45-464f-94bf-5e56a21ce00a"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:52.607757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c44a88f7-d3f9-43cb-a918-5c14b75545a0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:45:52.608513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c44a88f7-d3f9-43cb-a918-5c14b75545a0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:45:52.610002 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c44a88f7-d3f9-43cb-a918-5c14b75545a0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:45:52.611514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c44a88f7-d3f9-43cb-a918-5c14b75545a0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:45:52.612851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-06f343b8-5e2d-4e2b-ba7f-053520d5d8e6 req-b9b9ce7c-f234-4a33-b6ab-cd1c9e0b561d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:52.614406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c44a88f7-d3f9-43cb-a918-5c14b75545a0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:45:52.614665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-06f343b8-5e2d-4e2b-ba7f-053520d5d8e6 req-b9b9ce7c-f234-4a33-b6ab-cd1c9e0b561d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:52.616546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-06f343b8-5e2d-4e2b-ba7f-053520d5d8e6 req-b9b9ce7c-f234-4a33-b6ab-cd1c9e0b561d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:52.648602 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-06f343b8-5e2d-4e2b-ba7f-053520d5d8e6 req-b9b9ce7c-f234-4a33-b6ab-cd1c9e0b561d service nova] Creating event network-vif-deleted:6b1ac69f-da45-464f-94bf-5e56a21ce00a for instance ca300ad8-1300-4adf-940f-8cc52f13d8dc on n-h2-852087-9 Sep 07 12:45:52.648972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c44a88f7-d3f9-43cb-a918-5c14b75545a0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:52.649973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c44a88f7-d3f9-43cb-a918-5c14b75545a0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:52.650768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c44a88f7-d3f9-43cb-a918-5c14b75545a0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:52.652439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c44a88f7-d3f9-43cb-a918-5c14b75545a0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:52.653381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c44a88f7-d3f9-43cb-a918-5c14b75545a0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:52.654269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c44a88f7-d3f9-43cb-a918-5c14b75545a0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:52.679954 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-06f343b8-5e2d-4e2b-ba7f-053520d5d8e6 req-b9b9ce7c-f234-4a33-b6ab-cd1c9e0b561d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096825 Sep 07 12:45:52.681465 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1631/3286] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:45:52.713672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-c44a88f7-d3f9-43cb-a918-5c14b75545a0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Getting quotas for project 48a87170da674037af70fac57a366c7f. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:45:52.720077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b06d3fc0-c898-4d93-9b93-6d86d82c6d78 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:52.721375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b06d3fc0-c898-4d93-9b93-6d86d82c6d78 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:52.732649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-c44a88f7-d3f9-43cb-a918-5c14b75545a0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Getting quotas for user 796a821c4f184a6aac2859bb943f9bc6 and project 48a87170da674037af70fac57a366c7f. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:45:52.739619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b06d3fc0-c898-4d93-9b93-6d86d82c6d78 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:52.740479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b06d3fc0-c898-4d93-9b93-6d86d82c6d78 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:52.741307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b06d3fc0-c898-4d93-9b93-6d86d82c6d78 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:52.742469 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b06d3fc0-c898-4d93-9b93-6d86d82c6d78 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:52.743290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b06d3fc0-c898-4d93-9b93-6d86d82c6d78 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:52.744053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b06d3fc0-c898-4d93-9b93-6d86d82c6d78 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:52.815095 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c44a88f7-d3f9-43cb-a918-5c14b75545a0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:45:52.823458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c44a88f7-d3f9-43cb-a918-5c14b75545a0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 676e42b4-4985-43cc-892b-176e13b341df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:45:53.095429 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c44a88f7-d3f9-43cb-a918-5c14b75545a0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.423743 Sep 07 12:45:53.101397 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1656/3287] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:45:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1431 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 12:45:53.117752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b06d3fc0-c898-4d93-9b93-6d86d82c6d78 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:53.121953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a93adf27-53da-44e6-9617-3bd88012a053 req-0859d27c-395e-4c74-aee6-b3ff45df389e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cf493cf-e2dc-4589-a81e-8eac7bbded71", "name": "network-vif-plugged", "status": "completed", "tag": "31bf026a-f253-4d7f-a890-203d22ba6fdd"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:53.146289 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a93adf27-53da-44e6-9617-3bd88012a053 req-0859d27c-395e-4c74-aee6-b3ff45df389e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:53.147581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a93adf27-53da-44e6-9617-3bd88012a053 req-0859d27c-395e-4c74-aee6-b3ff45df389e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:53.148558 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b06d3fc0-c898-4d93-9b93-6d86d82c6d78 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1318 microversion: 2.1 time: 0.463242 Sep 07 12:45:53.148843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a93adf27-53da-44e6-9617-3bd88012a053 req-0859d27c-395e-4c74-aee6-b3ff45df389e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:53.152001 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1632/3288] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:52 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1318 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:53.174182 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a93adf27-53da-44e6-9617-3bd88012a053 req-0859d27c-395e-4c74-aee6-b3ff45df389e service nova] Creating event network-vif-plugged:31bf026a-f253-4d7f-a890-203d22ba6fdd for instance 6cf493cf-e2dc-4589-a81e-8eac7bbded71 on n-h1-852087-9 Sep 07 12:45:53.188733 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a93adf27-53da-44e6-9617-3bd88012a053 req-0859d27c-395e-4c74-aee6-b3ff45df389e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077489 Sep 07 12:45:53.194366 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1657/3289] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:45:53.262377 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cc7184eb-cfa2-4c80-aae4-0a9b450d5e90 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:53.272605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cc7184eb-cfa2-4c80-aae4-0a9b450d5e90 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:53.291064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-db357cee-8307-410b-a0d4-beb1ca3ef7ed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-340949420", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:53.326364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc7184eb-cfa2-4c80-aae4-0a9b450d5e90 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:53.326873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc7184eb-cfa2-4c80-aae4-0a9b450d5e90 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:53.329844 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc7184eb-cfa2-4c80-aae4-0a9b450d5e90 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:53.330670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc7184eb-cfa2-4c80-aae4-0a9b450d5e90 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:53.331139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc7184eb-cfa2-4c80-aae4-0a9b450d5e90 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:53.331582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc7184eb-cfa2-4c80-aae4-0a9b450d5e90 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:53.456680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-db357cee-8307-410b-a0d4-beb1ca3ef7ed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:45:54.171814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cc7184eb-cfa2-4c80-aae4-0a9b450d5e90 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:54.194306 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cc7184eb-cfa2-4c80-aae4-0a9b450d5e90 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1314 microversion: 2.1 time: 0.943635 Sep 07 12:45:54.196337 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1633/3290] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:53 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1314 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:54.206950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3ed8361a-6393-4485-80db-bc094ea23184 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:54.209136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3ed8361a-6393-4485-80db-bc094ea23184 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:54.230561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ed8361a-6393-4485-80db-bc094ea23184 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:54.231767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ed8361a-6393-4485-80db-bc094ea23184 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:54.232960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ed8361a-6393-4485-80db-bc094ea23184 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:54.234657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ed8361a-6393-4485-80db-bc094ea23184 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:54.236102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ed8361a-6393-4485-80db-bc094ea23184 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:54.237086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ed8361a-6393-4485-80db-bc094ea23184 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:54.299510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ed8361a-6393-4485-80db-bc094ea23184 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:54.302474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ed8361a-6393-4485-80db-bc094ea23184 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:54.303662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ed8361a-6393-4485-80db-bc094ea23184 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:54.306678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-3ed8361a-6393-4485-80db-bc094ea23184 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lazy-loading 'fault' on Instance uuid ca300ad8-1300-4adf-940f-8cc52f13d8dc {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:45:54.322089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-db357cee-8307-410b-a0d4-beb1ca3ef7ed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:45:54.323018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-db357cee-8307-410b-a0d4-beb1ca3ef7ed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:45:54.323018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-db357cee-8307-410b-a0d4-beb1ca3ef7ed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:45:54.323658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-db357cee-8307-410b-a0d4-beb1ca3ef7ed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:45:54.324099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-db357cee-8307-410b-a0d4-beb1ca3ef7ed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:45:54.344468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db357cee-8307-410b-a0d4-beb1ca3ef7ed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:54.344970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db357cee-8307-410b-a0d4-beb1ca3ef7ed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:54.345415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db357cee-8307-410b-a0d4-beb1ca3ef7ed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:54.347666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db357cee-8307-410b-a0d4-beb1ca3ef7ed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:54.350678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db357cee-8307-410b-a0d4-beb1ca3ef7ed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:54.352850 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db357cee-8307-410b-a0d4-beb1ca3ef7ed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:54.398362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-db357cee-8307-410b-a0d4-beb1ca3ef7ed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Getting quotas for project 48a87170da674037af70fac57a366c7f. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:45:54.411178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-db357cee-8307-410b-a0d4-beb1ca3ef7ed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Getting quotas for user 796a821c4f184a6aac2859bb943f9bc6 and project 48a87170da674037af70fac57a366c7f. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:45:54.434546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3ed8361a-6393-4485-80db-bc094ea23184 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c75734232a40d4958acb5980b7bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf5b780ca404c21a5d68f150cedbd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:54.456409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-db357cee-8307-410b-a0d4-beb1ca3ef7ed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:45:54.459675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-db357cee-8307-410b-a0d4-beb1ca3ef7ed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 91762428-7354-4926-b463-edc357e1e7cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:45:54.464189 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3ed8361a-6393-4485-80db-bc094ea23184 tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 200 len: 1313 microversion: 2.1 time: 0.264434 Sep 07 12:45:54.465285 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1634/3291] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:54 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:54.514842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:45:54.541814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-19b91ddf-c0a5-4f2f-b7ff-e7154e7aa394 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:54.544318 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-19b91ddf-c0a5-4f2f-b7ff-e7154e7aa394 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:54.557176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19b91ddf-c0a5-4f2f-b7ff-e7154e7aa394 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:54.558498 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19b91ddf-c0a5-4f2f-b7ff-e7154e7aa394 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:54.559537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19b91ddf-c0a5-4f2f-b7ff-e7154e7aa394 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:54.561312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19b91ddf-c0a5-4f2f-b7ff-e7154e7aa394 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:54.562366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19b91ddf-c0a5-4f2f-b7ff-e7154e7aa394 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:54.563416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19b91ddf-c0a5-4f2f-b7ff-e7154e7aa394 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:54.569094 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-db357cee-8307-410b-a0d4-beb1ca3ef7ed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.284464 Sep 07 12:45:54.581873 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1658/3292] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:45:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1299 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:45:54.615447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2d64155a-f8cc-4576-b242-47d11b0df63d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:54.629047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2d64155a-f8cc-4576-b242-47d11b0df63d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 91762428-7354-4926-b463-edc357e1e7cf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:54.924653 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2d64155a-f8cc-4576-b242-47d11b0df63d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796a821c4f184a6aac2859bb943f9bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a87170da674037af70fac57a366c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:54.951918 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2d64155a-f8cc-4576-b242-47d11b0df63d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf" status: 200 len: 1217 microversion: 2.1 time: 0.355104 Sep 07 12:45:54.954449 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1659/3293] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:54 2022] GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf => generated 1217 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:55.119101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-19b91ddf-c0a5-4f2f-b7ff-e7154e7aa394 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:55.134410 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-19b91ddf-c0a5-4f2f-b7ff-e7154e7aa394 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1508 microversion: 2.1 time: 0.620831 Sep 07 12:45:55.136470 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1635/3294] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:54 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1508 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:55.195751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b18e40be-2e68-41d1-963f-1fa55c763be6 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:55.198515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b18e40be-2e68-41d1-963f-1fa55c763be6 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:55.231326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a14dbd69-9cf8-440c-877a-82c226bf5910 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:55.232231 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a14dbd69-9cf8-440c-877a-82c226bf5910 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:55.240882 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b18e40be-2e68-41d1-963f-1fa55c763be6 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:55.244297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b18e40be-2e68-41d1-963f-1fa55c763be6 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:55.245656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b18e40be-2e68-41d1-963f-1fa55c763be6 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:55.246621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a14dbd69-9cf8-440c-877a-82c226bf5910 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:55.247917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a14dbd69-9cf8-440c-877a-82c226bf5910 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:55.248839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b18e40be-2e68-41d1-963f-1fa55c763be6 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:55.249204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a14dbd69-9cf8-440c-877a-82c226bf5910 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:55.250003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b18e40be-2e68-41d1-963f-1fa55c763be6 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:55.251948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b18e40be-2e68-41d1-963f-1fa55c763be6 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:55.252314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a14dbd69-9cf8-440c-877a-82c226bf5910 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:55.253405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a14dbd69-9cf8-440c-877a-82c226bf5910 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:55.254419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a14dbd69-9cf8-440c-877a-82c226bf5910 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:55.307742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:45:55.882620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b18e40be-2e68-41d1-963f-1fa55c763be6 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:55.917393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a14dbd69-9cf8-440c-877a-82c226bf5910 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:55.939074 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b18e40be-2e68-41d1-963f-1fa55c763be6 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1508 microversion: 2.1 time: 0.758857 Sep 07 12:45:55.941112 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a14dbd69-9cf8-440c-877a-82c226bf5910 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1314 microversion: 2.1 time: 0.717893 Sep 07 12:45:55.942763 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1660/3295] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:55 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1508 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:55.951849 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1636/3296] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:55 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1314 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:45:55.968345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-27bf7111-bbe2-4894-9a9d-bedbc2ef73bd tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:55.970516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-27bf7111-bbe2-4894-9a9d-bedbc2ef73bd tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] [instance: ca300ad8-1300-4adf-940f-8cc52f13d8dc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:55.987646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-85fa7e0d-2c79-4417-aca1-95b30f366b18 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:55.995042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-85fa7e0d-2c79-4417-aca1-95b30f366b18 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 91762428-7354-4926-b463-edc357e1e7cf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:56.013962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27bf7111-bbe2-4894-9a9d-bedbc2ef73bd tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:56.022337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27bf7111-bbe2-4894-9a9d-bedbc2ef73bd tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:56.024939 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27bf7111-bbe2-4894-9a9d-bedbc2ef73bd tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:56.037320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27bf7111-bbe2-4894-9a9d-bedbc2ef73bd tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:56.038340 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85fa7e0d-2c79-4417-aca1-95b30f366b18 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:56.038535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27bf7111-bbe2-4894-9a9d-bedbc2ef73bd tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:56.038710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85fa7e0d-2c79-4417-aca1-95b30f366b18 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:56.038710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85fa7e0d-2c79-4417-aca1-95b30f366b18 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:56.039445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85fa7e0d-2c79-4417-aca1-95b30f366b18 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:56.041104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27bf7111-bbe2-4894-9a9d-bedbc2ef73bd tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:56.054614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85fa7e0d-2c79-4417-aca1-95b30f366b18 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:56.055378 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85fa7e0d-2c79-4417-aca1-95b30f366b18 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:56.112202 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-27bf7111-bbe2-4894-9a9d-bedbc2ef73bd tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] HTTP exception thrown: Instance ca300ad8-1300-4adf-940f-8cc52f13d8dc could not be found. Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-27bf7111-bbe2-4894-9a9d-bedbc2ef73bd tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Request method failure captured: Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc HTTP/1.1 Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJICI3Fl5rA9-lyICLKJII3NQjSWRUHKKtcBf2jmh5QItt_ZkOSEPGcpS5Yh414CBFiX_DDA30S0XmWExt6wjmQKWUlgwaX-23MeuAqCNeyEVEOd5aYuMJOdApXli3miv0lRQM3oWMivL-kLLX8QiQ5kCCyohYGVby9LpokksDO2U3M Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: ccf5b780ca404c21a5d68f150cedbd7a Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1963119748 Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ccf5b780ca404c21a5d68f150cedbd7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ccf5b780ca404c21a5d68f150cedbd7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ccf5b780ca404c21a5d68f150cedbd7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ccf5b780ca404c21a5d68f150cedbd7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1963119748 Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: ccf5b780ca404c21a5d68f150cedbd7a Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1963119748 Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerRescueTestJSONUnderV235-1963119748-project Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 99c75734232a40d4958acb5980b7bc0c Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1963119748-project Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance ca300ad8-1300-4adf-940f-8cc52f13d8dc could not be found. Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'ca300ad8-1300-4adf-940f-8cc52f13d8dc'} Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca300ad8-1300-4adf-940f-8cc52f13d8dc could not be found. Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca300ad8-1300-4adf-940f-8cc52f13d8dc could not be found. Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:56.119686 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:45:56.132405 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:56.132405 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:45:56.132405 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:45:56.132405 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:45:56.132405 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:45:56.132405 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:45:56.132405 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca300ad8-1300-4adf-940f-8cc52f13d8dc could not be found. Sep 07 12:45:56.132405 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:45:56.137756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-27bf7111-bbe2-4894-9a9d-bedbc2ef73bd tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] Returning 404 to user: Instance ca300ad8-1300-4adf-940f-8cc52f13d8dc could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:45:56.151975 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-27bf7111-bbe2-4894-9a9d-bedbc2ef73bd tempest-ServerRescueTestJSONUnderV235-1963119748 tempest-ServerRescueTestJSONUnderV235-1963119748-project] 10.222.0.16 "GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc" status: 404 len: 111 microversion: 2.1 time: 0.191488 Sep 07 12:45:56.159854 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1661/3297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:55 2022] GET /compute/v2.1/servers/ca300ad8-1300-4adf-940f-8cc52f13d8dc => generated 111 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:45:56.183088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-489d0fa6-152a-4032-9d93-3d924acb8e31 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:56.190526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-489d0fa6-152a-4032-9d93-3d924acb8e31 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:56.208316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-489d0fa6-152a-4032-9d93-3d924acb8e31 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:56.210580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-489d0fa6-152a-4032-9d93-3d924acb8e31 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:56.211560 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-489d0fa6-152a-4032-9d93-3d924acb8e31 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:56.213798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-489d0fa6-152a-4032-9d93-3d924acb8e31 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:56.214865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-489d0fa6-152a-4032-9d93-3d924acb8e31 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:56.215705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-489d0fa6-152a-4032-9d93-3d924acb8e31 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:56.394965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-489d0fa6-152a-4032-9d93-3d924acb8e31 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:45:56.395400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-489d0fa6-152a-4032-9d93-3d924acb8e31 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:45:56.395887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-489d0fa6-152a-4032-9d93-3d924acb8e31 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:45:56.396299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-489d0fa6-152a-4032-9d93-3d924acb8e31 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:45:56.396717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-489d0fa6-152a-4032-9d93-3d924acb8e31 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:45:56.484217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-85fa7e0d-2c79-4417-aca1-95b30f366b18 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796a821c4f184a6aac2859bb943f9bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a87170da674037af70fac57a366c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:56.508497 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-85fa7e0d-2c79-4417-aca1-95b30f366b18 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf" status: 200 len: 1213 microversion: 2.1 time: 0.527403 Sep 07 12:45:56.521377 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1637/3298] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:55 2022] GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf => generated 1213 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:56.611093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-489d0fa6-152a-4032-9d93-3d924acb8e31 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:56.633070 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-489d0fa6-152a-4032-9d93-3d924acb8e31 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:56.635860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-489d0fa6-152a-4032-9d93-3d924acb8e31 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:56.636427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-489d0fa6-152a-4032-9d93-3d924acb8e31 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:56.640290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-489d0fa6-152a-4032-9d93-3d924acb8e31 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:56.641709 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-489d0fa6-152a-4032-9d93-3d924acb8e31 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:56.642214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-489d0fa6-152a-4032-9d93-3d924acb8e31 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:56.753283 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-489d0fa6-152a-4032-9d93-3d924acb8e31 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "POST /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86/action" status: 202 len: 1110 microversion: 2.1 time: 0.591546 Sep 07 12:45:56.770571 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1662/3299] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:45:56 2022] POST /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86/action => generated 1110 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 07 12:45:56.788134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9e494aa7-df99-4ac7-b0fb-89f749d294d3 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:56.788929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9e494aa7-df99-4ac7-b0fb-89f749d294d3 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:56.804236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e494aa7-df99-4ac7-b0fb-89f749d294d3 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:56.806332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e494aa7-df99-4ac7-b0fb-89f749d294d3 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:56.809042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e494aa7-df99-4ac7-b0fb-89f749d294d3 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:56.811235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e494aa7-df99-4ac7-b0fb-89f749d294d3 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:56.814877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e494aa7-df99-4ac7-b0fb-89f749d294d3 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:56.817700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9e494aa7-df99-4ac7-b0fb-89f749d294d3 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:56.996843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6e4a8247-a6d4-4a6b-a509-8c1fa637fe11 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:56.997819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6e4a8247-a6d4-4a6b-a509-8c1fa637fe11 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:57.017600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e4a8247-a6d4-4a6b-a509-8c1fa637fe11 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:57.018460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e4a8247-a6d4-4a6b-a509-8c1fa637fe11 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:57.019235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e4a8247-a6d4-4a6b-a509-8c1fa637fe11 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:57.020218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e4a8247-a6d4-4a6b-a509-8c1fa637fe11 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:57.021006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e4a8247-a6d4-4a6b-a509-8c1fa637fe11 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:57.021721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e4a8247-a6d4-4a6b-a509-8c1fa637fe11 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:57.486907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9e494aa7-df99-4ac7-b0fb-89f749d294d3 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:57.509609 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9e494aa7-df99-4ac7-b0fb-89f749d294d3 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1515 microversion: 2.1 time: 0.723648 Sep 07 12:45:57.520174 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1638/3300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:56 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1515 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:57.601684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6e4a8247-a6d4-4a6b-a509-8c1fa637fe11 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:57.618695 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6e4a8247-a6d4-4a6b-a509-8c1fa637fe11 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1501 microversion: 2.1 time: 0.627919 Sep 07 12:45:57.619322 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1663/3301] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:56 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1501 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:45:57.624230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-91046799-f8fe-4f0d-9099-f98f364b82a1 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:57.624870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-91046799-f8fe-4f0d-9099-f98f364b82a1 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 91762428-7354-4926-b463-edc357e1e7cf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:57.642560 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91046799-f8fe-4f0d-9099-f98f364b82a1 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:57.643078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91046799-f8fe-4f0d-9099-f98f364b82a1 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:57.643539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91046799-f8fe-4f0d-9099-f98f364b82a1 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:57.644272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91046799-f8fe-4f0d-9099-f98f364b82a1 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:57.644747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91046799-f8fe-4f0d-9099-f98f364b82a1 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:57.645202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91046799-f8fe-4f0d-9099-f98f364b82a1 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:57.821574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-91046799-f8fe-4f0d-9099-f98f364b82a1 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796a821c4f184a6aac2859bb943f9bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a87170da674037af70fac57a366c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:57.844633 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-91046799-f8fe-4f0d-9099-f98f364b82a1 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf" status: 200 len: 1275 microversion: 2.1 time: 0.223788 Sep 07 12:45:57.848783 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1664/3302] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:57 2022] GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf => generated 1275 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:57.851175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-79caf571-4739-4903-bfca-64986d3297f9 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1735154698", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": "none"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:57.858287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1fd7d7bb-b0ab-40f4-be1d-8856f9df68dd tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:45:57.862910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1fd7d7bb-b0ab-40f4-be1d-8856f9df68dd tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:57.884115 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fd7d7bb-b0ab-40f4-be1d-8856f9df68dd tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:57.887078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fd7d7bb-b0ab-40f4-be1d-8856f9df68dd tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:57.888610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fd7d7bb-b0ab-40f4-be1d-8856f9df68dd tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:57.890107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fd7d7bb-b0ab-40f4-be1d-8856f9df68dd tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:57.891450 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fd7d7bb-b0ab-40f4-be1d-8856f9df68dd tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:57.893151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fd7d7bb-b0ab-40f4-be1d-8856f9df68dd tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:57.928096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-1fd7d7bb-b0ab-40f4-be1d-8856f9df68dd tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lazy-loading 'flavor' on Instance uuid 6cf493cf-e2dc-4589-a81e-8eac7bbded71 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:45:57.972876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-79caf571-4739-4903-bfca-64986d3297f9 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:45:57.974651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-79caf571-4739-4903-bfca-64986d3297f9 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:45:57.980783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-79caf571-4739-4903-bfca-64986d3297f9 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:45:57.982031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-79caf571-4739-4903-bfca-64986d3297f9 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:45:57.983042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-79caf571-4739-4903-bfca-64986d3297f9 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:45:58.003702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79caf571-4739-4903-bfca-64986d3297f9 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:58.005344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79caf571-4739-4903-bfca-64986d3297f9 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:58.006491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79caf571-4739-4903-bfca-64986d3297f9 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:58.008037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79caf571-4739-4903-bfca-64986d3297f9 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:58.009439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79caf571-4739-4903-bfca-64986d3297f9 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:58.011117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79caf571-4739-4903-bfca-64986d3297f9 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:58.025456 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1fd7d7bb-b0ab-40f4-be1d-8856f9df68dd tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "POST /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71/action" status: 200 len: 32 microversion: 2.1 time: 0.174835 Sep 07 12:45:58.032857 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1665/3303] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:45:57 2022] POST /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71/action => generated 32 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:45:58.038823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-97165552-ee96-44f0-92d9-69d89a5f09e0 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:58.039553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-97165552-ee96-44f0-92d9-69d89a5f09e0 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:58.057834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97165552-ee96-44f0-92d9-69d89a5f09e0 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:58.062531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97165552-ee96-44f0-92d9-69d89a5f09e0 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:58.063374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-79caf571-4739-4903-bfca-64986d3297f9 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Getting quotas for project bf2e2ee3fd574ca69c57a7a356066547. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:45:58.065213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97165552-ee96-44f0-92d9-69d89a5f09e0 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:58.066387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97165552-ee96-44f0-92d9-69d89a5f09e0 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:58.069374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97165552-ee96-44f0-92d9-69d89a5f09e0 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:58.070012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97165552-ee96-44f0-92d9-69d89a5f09e0 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:58.076658 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-79caf571-4739-4903-bfca-64986d3297f9 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Getting quotas for user ba617e93f5e740ba8970f7323871ee06 and project bf2e2ee3fd574ca69c57a7a356066547. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:45:58.098320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-79caf571-4739-4903-bfca-64986d3297f9 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:45:58.101643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-79caf571-4739-4903-bfca-64986d3297f9 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] [instance: b9ad03f9-bc18-46f7-a042-e24dba76410e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:45:58.164770 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-79caf571-4739-4903-bfca-64986d3297f9 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.640074 Sep 07 12:45:58.166227 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1639/3304] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Sep 7 12:45:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 12:45:58.193370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8fddb405-0830-482a-a608-1276c656f4d9 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:58.194684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8fddb405-0830-482a-a608-1276c656f4d9 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] [instance: b9ad03f9-bc18-46f7-a042-e24dba76410e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:58.490797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8fddb405-0830-482a-a608-1276c656f4d9 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:58.517197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8fddb405-0830-482a-a608-1276c656f4d9 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:58.529830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8fddb405-0830-482a-a608-1276c656f4d9 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:58.532355 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8fddb405-0830-482a-a608-1276c656f4d9 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] 10.222.0.16 "GET /compute/v2.1/servers/b9ad03f9-bc18-46f7-a042-e24dba76410e" status: 200 len: 1281 microversion: 2.47 time: 0.350462 Sep 07 12:45:58.533532 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1640/3305] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:45:58 2022] GET /compute/v2.1/servers/b9ad03f9-bc18-46f7-a042-e24dba76410e => generated 1281 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:45:58.559735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-333ad706-d895-4762-b748-b6a83e75f3df tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:58.567144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-333ad706-d895-4762-b748-b6a83e75f3df tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:58.588815 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-333ad706-d895-4762-b748-b6a83e75f3df tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:58.589795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-333ad706-d895-4762-b748-b6a83e75f3df tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:58.590503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-333ad706-d895-4762-b748-b6a83e75f3df tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:58.591744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-333ad706-d895-4762-b748-b6a83e75f3df tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:58.593062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-333ad706-d895-4762-b748-b6a83e75f3df tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:58.594363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-333ad706-d895-4762-b748-b6a83e75f3df tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:59.196720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-97165552-ee96-44f0-92d9-69d89a5f09e0 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:59.214898 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-97165552-ee96-44f0-92d9-69d89a5f09e0 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1507 microversion: 2.1 time: 1.179587 Sep 07 12:45:59.218340 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1666/3306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:58 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1507 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:45:59.234259 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-27ef7872-2314-475e-b5c4-da103f75fbc8 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:59.237360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-27ef7872-2314-475e-b5c4-da103f75fbc8 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 91762428-7354-4926-b463-edc357e1e7cf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:59.255546 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27ef7872-2314-475e-b5c4-da103f75fbc8 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:59.258728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27ef7872-2314-475e-b5c4-da103f75fbc8 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:59.262365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27ef7872-2314-475e-b5c4-da103f75fbc8 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:59.266121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27ef7872-2314-475e-b5c4-da103f75fbc8 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:59.267146 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27ef7872-2314-475e-b5c4-da103f75fbc8 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:59.269415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27ef7872-2314-475e-b5c4-da103f75fbc8 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:59.446927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-27ef7872-2314-475e-b5c4-da103f75fbc8 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796a821c4f184a6aac2859bb943f9bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a87170da674037af70fac57a366c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:59.450090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-333ad706-d895-4762-b748-b6a83e75f3df tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:59.462869 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-27ef7872-2314-475e-b5c4-da103f75fbc8 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf" status: 200 len: 1275 microversion: 2.1 time: 0.242412 Sep 07 12:45:59.464242 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1667/3307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:59 2022] GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf => generated 1275 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:59.485283 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-333ad706-d895-4762-b748-b6a83e75f3df tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1515 microversion: 2.1 time: 0.930529 Sep 07 12:45:59.486434 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1641/3308] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:45:58 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1515 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:45:59.588382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-97b81d76-397f-4a91-9c6b-b0ed6f5e5a7a tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:45:59.589738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-97b81d76-397f-4a91-9c6b-b0ed6f5e5a7a tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] [instance: b9ad03f9-bc18-46f7-a042-e24dba76410e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:45:59.608530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97b81d76-397f-4a91-9c6b-b0ed6f5e5a7a tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:59.609822 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97b81d76-397f-4a91-9c6b-b0ed6f5e5a7a tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:59.614786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97b81d76-397f-4a91-9c6b-b0ed6f5e5a7a tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:59.616309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97b81d76-397f-4a91-9c6b-b0ed6f5e5a7a tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:45:59.616934 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97b81d76-397f-4a91-9c6b-b0ed6f5e5a7a tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:45:59.617440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97b81d76-397f-4a91-9c6b-b0ed6f5e5a7a tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:45:59.779390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-97b81d76-397f-4a91-9c6b-b0ed6f5e5a7a tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:59.796400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-97b81d76-397f-4a91-9c6b-b0ed6f5e5a7a tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:59.799643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-97b81d76-397f-4a91-9c6b-b0ed6f5e5a7a tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:45:59.801952 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-97b81d76-397f-4a91-9c6b-b0ed6f5e5a7a tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] 10.222.0.16 "GET /compute/v2.1/servers/b9ad03f9-bc18-46f7-a042-e24dba76410e" status: 200 len: 1333 microversion: 2.47 time: 0.226327 Sep 07 12:45:59.803190 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1668/3309] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:45:59 2022] GET /compute/v2.1/servers/b9ad03f9-bc18-46f7-a042-e24dba76410e => generated 1333 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:46:00.265421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5b710bfc-05fb-4b13-ad41-d13d8c7b2c0c tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:00.268338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5b710bfc-05fb-4b13-ad41-d13d8c7b2c0c tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:00.285053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b710bfc-05fb-4b13-ad41-d13d8c7b2c0c tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:00.285991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b710bfc-05fb-4b13-ad41-d13d8c7b2c0c tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:00.286456 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b710bfc-05fb-4b13-ad41-d13d8c7b2c0c tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:00.287290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b710bfc-05fb-4b13-ad41-d13d8c7b2c0c tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:00.287801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b710bfc-05fb-4b13-ad41-d13d8c7b2c0c tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:00.288270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b710bfc-05fb-4b13-ad41-d13d8c7b2c0c tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:00.493639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b06cae4f-bad5-4740-b87a-c154180828a3 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:00.494950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b06cae4f-bad5-4740-b87a-c154180828a3 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 91762428-7354-4926-b463-edc357e1e7cf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:00.507403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b06cae4f-bad5-4740-b87a-c154180828a3 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:00.510170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b06cae4f-bad5-4740-b87a-c154180828a3 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:00.510170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b06cae4f-bad5-4740-b87a-c154180828a3 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:00.511482 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b06cae4f-bad5-4740-b87a-c154180828a3 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:00.512246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b06cae4f-bad5-4740-b87a-c154180828a3 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:00.512852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b06cae4f-bad5-4740-b87a-c154180828a3 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:00.752830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b06cae4f-bad5-4740-b87a-c154180828a3 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796a821c4f184a6aac2859bb943f9bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a87170da674037af70fac57a366c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:00.768027 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b06cae4f-bad5-4740-b87a-c154180828a3 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf" status: 200 len: 1275 microversion: 2.1 time: 0.281467 Sep 07 12:46:00.768538 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1669/3310] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:00 2022] GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf => generated 1275 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:00.775570 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ef52332-8483-4788-b7e7-f11b558674f5 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:00.776459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4ef52332-8483-4788-b7e7-f11b558674f5 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:00.788223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ef52332-8483-4788-b7e7-f11b558674f5 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:00.789099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ef52332-8483-4788-b7e7-f11b558674f5 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:00.790340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ef52332-8483-4788-b7e7-f11b558674f5 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:00.791979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ef52332-8483-4788-b7e7-f11b558674f5 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:00.792738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ef52332-8483-4788-b7e7-f11b558674f5 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:00.793993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ef52332-8483-4788-b7e7-f11b558674f5 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:00.880337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5b710bfc-05fb-4b13-ad41-d13d8c7b2c0c tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:00.891133 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5b710bfc-05fb-4b13-ad41-d13d8c7b2c0c tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1507 microversion: 2.1 time: 0.637752 Sep 07 12:46:00.891969 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1642/3311] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:00 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1507 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:00.911203 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-696a4cf9-df18-4d0e-9f8f-53e1c36b966c tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:00.911203 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-696a4cf9-df18-4d0e-9f8f-53e1c36b966c tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] [instance: b9ad03f9-bc18-46f7-a042-e24dba76410e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:00.911203 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-696a4cf9-df18-4d0e-9f8f-53e1c36b966c tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:00.911203 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-696a4cf9-df18-4d0e-9f8f-53e1c36b966c tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:00.911203 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-696a4cf9-df18-4d0e-9f8f-53e1c36b966c tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:00.916966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-696a4cf9-df18-4d0e-9f8f-53e1c36b966c tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:00.917119 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-696a4cf9-df18-4d0e-9f8f-53e1c36b966c tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:00.917738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-696a4cf9-df18-4d0e-9f8f-53e1c36b966c tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:01.514801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-696a4cf9-df18-4d0e-9f8f-53e1c36b966c tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:01.529273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-696a4cf9-df18-4d0e-9f8f-53e1c36b966c tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:01.531815 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-696a4cf9-df18-4d0e-9f8f-53e1c36b966c tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:01.533717 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-696a4cf9-df18-4d0e-9f8f-53e1c36b966c tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] 10.222.0.16 "GET /compute/v2.1/servers/b9ad03f9-bc18-46f7-a042-e24dba76410e" status: 200 len: 1339 microversion: 2.47 time: 0.640642 Sep 07 12:46:01.534452 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1643/3312] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:46:00 2022] GET /compute/v2.1/servers/b9ad03f9-bc18-46f7-a042-e24dba76410e => generated 1339 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:46:01.540701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9b8c00f3-d4f6-4a5d-838b-6ebd991773d3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:01.541422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9b8c00f3-d4f6-4a5d-838b-6ebd991773d3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:01.552274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b8c00f3-d4f6-4a5d-838b-6ebd991773d3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:01.553924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b8c00f3-d4f6-4a5d-838b-6ebd991773d3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:01.554774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b8c00f3-d4f6-4a5d-838b-6ebd991773d3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:01.555932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b8c00f3-d4f6-4a5d-838b-6ebd991773d3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:01.556795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b8c00f3-d4f6-4a5d-838b-6ebd991773d3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:01.557560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b8c00f3-d4f6-4a5d-838b-6ebd991773d3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:01.774477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4ef52332-8483-4788-b7e7-f11b558674f5 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:01.812639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:46:01.829505 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ef52332-8483-4788-b7e7-f11b558674f5 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1515 microversion: 2.1 time: 1.059011 Sep 07 12:46:01.830515 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1670/3313] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:00 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1515 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:01.839790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-157878e9-de11-42d5-ac2c-086603959010 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:01.840947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-157878e9-de11-42d5-ac2c-086603959010 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 91762428-7354-4926-b463-edc357e1e7cf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:01.857170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-157878e9-de11-42d5-ac2c-086603959010 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:01.858484 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-157878e9-de11-42d5-ac2c-086603959010 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:01.859587 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-157878e9-de11-42d5-ac2c-086603959010 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:01.864383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-157878e9-de11-42d5-ac2c-086603959010 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:01.865708 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-157878e9-de11-42d5-ac2c-086603959010 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:01.866758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-157878e9-de11-42d5-ac2c-086603959010 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:02.248990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9b8c00f3-d4f6-4a5d-838b-6ebd991773d3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:02.261870 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9b8c00f3-d4f6-4a5d-838b-6ebd991773d3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.725348 Sep 07 12:46:02.274067 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1644/3314] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:01 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:02.303304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c847a80c-fc5f-4c29-91e0-8f941489a76f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:02.305090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c847a80c-fc5f-4c29-91e0-8f941489a76f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:02.316160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c847a80c-fc5f-4c29-91e0-8f941489a76f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:02.316896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c847a80c-fc5f-4c29-91e0-8f941489a76f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:02.317954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c847a80c-fc5f-4c29-91e0-8f941489a76f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:02.319229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c847a80c-fc5f-4c29-91e0-8f941489a76f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:02.320021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c847a80c-fc5f-4c29-91e0-8f941489a76f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:02.320791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c847a80c-fc5f-4c29-91e0-8f941489a76f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:02.730174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-157878e9-de11-42d5-ac2c-086603959010 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796a821c4f184a6aac2859bb943f9bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a87170da674037af70fac57a366c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:02.747868 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-157878e9-de11-42d5-ac2c-086603959010 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf" status: 200 len: 1317 microversion: 2.1 time: 0.915085 Sep 07 12:46:02.748681 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1671/3315] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:01 2022] GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf => generated 1317 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:02.760154 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ebd12fbe-1d37-4874-b9b6-245be99e56f3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:02.762351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ebd12fbe-1d37-4874-b9b6-245be99e56f3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:02.775727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebd12fbe-1d37-4874-b9b6-245be99e56f3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:02.778011 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebd12fbe-1d37-4874-b9b6-245be99e56f3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:02.778641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebd12fbe-1d37-4874-b9b6-245be99e56f3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:02.779552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebd12fbe-1d37-4874-b9b6-245be99e56f3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:02.780183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebd12fbe-1d37-4874-b9b6-245be99e56f3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:02.780966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebd12fbe-1d37-4874-b9b6-245be99e56f3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:02.955576 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c847a80c-fc5f-4c29-91e0-8f941489a76f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:02.965558 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c847a80c-fc5f-4c29-91e0-8f941489a76f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1507 microversion: 2.1 time: 0.690011 Sep 07 12:46:02.966315 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1645/3316] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:02 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1507 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:02.982022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5141f3c1-90ab-4e1e-a2a8-ddd415e01094 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:02.983552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5141f3c1-90ab-4e1e-a2a8-ddd415e01094 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] [instance: b9ad03f9-bc18-46f7-a042-e24dba76410e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:02.996335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5141f3c1-90ab-4e1e-a2a8-ddd415e01094 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:02.998224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5141f3c1-90ab-4e1e-a2a8-ddd415e01094 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:02.999303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5141f3c1-90ab-4e1e-a2a8-ddd415e01094 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:03.000517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5141f3c1-90ab-4e1e-a2a8-ddd415e01094 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:03.003515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5141f3c1-90ab-4e1e-a2a8-ddd415e01094 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:03.004579 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5141f3c1-90ab-4e1e-a2a8-ddd415e01094 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:03.197238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5141f3c1-90ab-4e1e-a2a8-ddd415e01094 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:03.221237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5141f3c1-90ab-4e1e-a2a8-ddd415e01094 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:03.225954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5141f3c1-90ab-4e1e-a2a8-ddd415e01094 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:03.228190 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5141f3c1-90ab-4e1e-a2a8-ddd415e01094 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] 10.222.0.16 "GET /compute/v2.1/servers/b9ad03f9-bc18-46f7-a042-e24dba76410e" status: 200 len: 1339 microversion: 2.47 time: 0.260183 Sep 07 12:46:03.243128 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1646/3317] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:46:02 2022] GET /compute/v2.1/servers/b9ad03f9-bc18-46f7-a042-e24dba76410e => generated 1339 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:46:03.266101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cd3404ea-bd9c-4435-b81a-7f74405a0215 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:03.266580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cd3404ea-bd9c-4435-b81a-7f74405a0215 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:03.274110 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd3404ea-bd9c-4435-b81a-7f74405a0215 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:03.274613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd3404ea-bd9c-4435-b81a-7f74405a0215 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:03.275056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd3404ea-bd9c-4435-b81a-7f74405a0215 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:03.275974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd3404ea-bd9c-4435-b81a-7f74405a0215 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:03.276444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd3404ea-bd9c-4435-b81a-7f74405a0215 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:03.276912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd3404ea-bd9c-4435-b81a-7f74405a0215 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:03.397536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ebd12fbe-1d37-4874-b9b6-245be99e56f3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:03.409306 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ebd12fbe-1d37-4874-b9b6-245be99e56f3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.658778 Sep 07 12:46:03.410716 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1672/3318] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:02 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:03.436040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-33f026e2-d6be-416d-b839-159f22d07510 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:03.437285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-33f026e2-d6be-416d-b839-159f22d07510 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:03.451224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33f026e2-d6be-416d-b839-159f22d07510 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:03.452084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33f026e2-d6be-416d-b839-159f22d07510 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:03.453684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33f026e2-d6be-416d-b839-159f22d07510 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:03.457336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33f026e2-d6be-416d-b839-159f22d07510 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:03.458151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33f026e2-d6be-416d-b839-159f22d07510 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:03.459285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33f026e2-d6be-416d-b839-159f22d07510 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:03.921245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-33f026e2-d6be-416d-b839-159f22d07510 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:03.934365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cd3404ea-bd9c-4435-b81a-7f74405a0215 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:03.950898 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cd3404ea-bd9c-4435-b81a-7f74405a0215 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1515 microversion: 2.1 time: 0.689399 Sep 07 12:46:03.965515 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1647/3319] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:03 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1515 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:03.966448 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-33f026e2-d6be-416d-b839-159f22d07510 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.522711 Sep 07 12:46:03.966448 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1673/3320] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:03 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:46:03.966635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-754e5e25-eeac-4484-984c-12fd3fd56921 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:03.966635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-754e5e25-eeac-4484-984c-12fd3fd56921 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 91762428-7354-4926-b463-edc357e1e7cf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:03.977850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-754e5e25-eeac-4484-984c-12fd3fd56921 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:03.977850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-754e5e25-eeac-4484-984c-12fd3fd56921 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:03.977850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-754e5e25-eeac-4484-984c-12fd3fd56921 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:03.977850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-754e5e25-eeac-4484-984c-12fd3fd56921 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:03.977850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-754e5e25-eeac-4484-984c-12fd3fd56921 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:03.977850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-754e5e25-eeac-4484-984c-12fd3fd56921 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:04.010624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c8379208-c015-49ce-b18e-1852c6b3ca95 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:04.020253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c8379208-c015-49ce-b18e-1852c6b3ca95 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:04.045058 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8379208-c015-49ce-b18e-1852c6b3ca95 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:04.057352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8379208-c015-49ce-b18e-1852c6b3ca95 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:04.058891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8379208-c015-49ce-b18e-1852c6b3ca95 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:04.061717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8379208-c015-49ce-b18e-1852c6b3ca95 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:04.066845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8379208-c015-49ce-b18e-1852c6b3ca95 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:04.068117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8379208-c015-49ce-b18e-1852c6b3ca95 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:04.370650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:46:04.710290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-754e5e25-eeac-4484-984c-12fd3fd56921 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796a821c4f184a6aac2859bb943f9bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a87170da674037af70fac57a366c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:04.722489 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-754e5e25-eeac-4484-984c-12fd3fd56921 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf" status: 200 len: 1317 microversion: 2.1 time: 0.768091 Sep 07 12:46:04.728001 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1648/3321] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:03 2022] GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf => generated 1317 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:04.738145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-913261fe-8e28-49e6-9332-6cfddcbff8c5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1754890948"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:46:04.741626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-913261fe-8e28-49e6-9332-6cfddcbff8c5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:04.761881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-913261fe-8e28-49e6-9332-6cfddcbff8c5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:04.762895 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-913261fe-8e28-49e6-9332-6cfddcbff8c5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:04.763446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-913261fe-8e28-49e6-9332-6cfddcbff8c5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:04.764413 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-913261fe-8e28-49e6-9332-6cfddcbff8c5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:04.765081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-913261fe-8e28-49e6-9332-6cfddcbff8c5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:04.766424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-913261fe-8e28-49e6-9332-6cfddcbff8c5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:04.946061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=14 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:46:05.151695 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-913261fe-8e28-49e6-9332-6cfddcbff8c5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action" status: 202 len: 0 microversion: 2.1 time: 0.417802 Sep 07 12:46:05.155734 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1649/3322] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:46:04 2022] POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 07 12:46:05.196755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-29d46821-451a-4d5e-bda1-53951788ec3c tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:05.206632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-29d46821-451a-4d5e-bda1-53951788ec3c tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] [instance: b9ad03f9-bc18-46f7-a042-e24dba76410e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:05.221198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29d46821-451a-4d5e-bda1-53951788ec3c tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:05.223224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29d46821-451a-4d5e-bda1-53951788ec3c tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:05.223767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29d46821-451a-4d5e-bda1-53951788ec3c tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:05.226760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29d46821-451a-4d5e-bda1-53951788ec3c tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:05.232202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29d46821-451a-4d5e-bda1-53951788ec3c tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:05.233034 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29d46821-451a-4d5e-bda1-53951788ec3c tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:05.302757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c8379208-c015-49ce-b18e-1852c6b3ca95 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:05.318814 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c8379208-c015-49ce-b18e-1852c6b3ca95 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1507 microversion: 2.1 time: 1.315562 Sep 07 12:46:05.320637 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1674/3323] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:04 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1507 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:05.340057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-cfe2ca32-3374-4fb8-abd5-d5bd4c0dcc9e req-2d44f28f-08ac-4111-b970-4e6730eddb55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "676e42b4-4985-43cc-892b-176e13b341df", "tag": "8973b130-dd43-4a93-b14e-3d7f5131cd14"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:46:05.372174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-cfe2ca32-3374-4fb8-abd5-d5bd4c0dcc9e req-2d44f28f-08ac-4111-b970-4e6730eddb55 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:05.373062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-cfe2ca32-3374-4fb8-abd5-d5bd4c0dcc9e req-2d44f28f-08ac-4111-b970-4e6730eddb55 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:05.373911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-cfe2ca32-3374-4fb8-abd5-d5bd4c0dcc9e req-2d44f28f-08ac-4111-b970-4e6730eddb55 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:05.402505 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-cfe2ca32-3374-4fb8-abd5-d5bd4c0dcc9e req-2d44f28f-08ac-4111-b970-4e6730eddb55 service nova] Creating event network-changed:8973b130-dd43-4a93-b14e-3d7f5131cd14 for instance 676e42b4-4985-43cc-892b-176e13b341df on n-h2-852087-9 Sep 07 12:46:05.408119 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-cfe2ca32-3374-4fb8-abd5-d5bd4c0dcc9e req-2d44f28f-08ac-4111-b970-4e6730eddb55 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086061 Sep 07 12:46:05.410339 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1675/3324] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:46:05.416201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4f3159f7-2cdb-4350-be4f-903848c054c9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:05.417344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4f3159f7-2cdb-4350-be4f-903848c054c9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:05.424449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f3159f7-2cdb-4350-be4f-903848c054c9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:05.425272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f3159f7-2cdb-4350-be4f-903848c054c9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:05.425933 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f3159f7-2cdb-4350-be4f-903848c054c9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:05.427976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f3159f7-2cdb-4350-be4f-903848c054c9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:05.428639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f3159f7-2cdb-4350-be4f-903848c054c9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:05.429412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f3159f7-2cdb-4350-be4f-903848c054c9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:05.498045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-29d46821-451a-4d5e-bda1-53951788ec3c tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:05.527470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-29d46821-451a-4d5e-bda1-53951788ec3c tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:05.530728 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-29d46821-451a-4d5e-bda1-53951788ec3c tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:05.538210 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-29d46821-451a-4d5e-bda1-53951788ec3c tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] 10.222.0.16 "GET /compute/v2.1/servers/b9ad03f9-bc18-46f7-a042-e24dba76410e" status: 200 len: 1360 microversion: 2.47 time: 0.375713 Sep 07 12:46:05.539410 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1650/3325] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:46:05 2022] GET /compute/v2.1/servers/b9ad03f9-bc18-46f7-a042-e24dba76410e => generated 1360 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:46:05.592139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e09f57f-4670-44f0-a3a5-eafbdb0f8561 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2037509431"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:46:05.596492 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6e09f57f-4670-44f0-a3a5-eafbdb0f8561 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] [instance: b9ad03f9-bc18-46f7-a042-e24dba76410e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:05.612277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e09f57f-4670-44f0-a3a5-eafbdb0f8561 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:05.622450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e09f57f-4670-44f0-a3a5-eafbdb0f8561 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:05.623074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e09f57f-4670-44f0-a3a5-eafbdb0f8561 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:05.623956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e09f57f-4670-44f0-a3a5-eafbdb0f8561 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:05.626420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e09f57f-4670-44f0-a3a5-eafbdb0f8561 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:05.627054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e09f57f-4670-44f0-a3a5-eafbdb0f8561 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:06.003133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4f3159f7-2cdb-4350-be4f-903848c054c9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:06.043281 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4f3159f7-2cdb-4350-be4f-903848c054c9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1515 microversion: 2.1 time: 0.630962 Sep 07 12:46:06.046642 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6e09f57f-4670-44f0-a3a5-eafbdb0f8561 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] 10.222.0.16 "POST /compute/v2.1/servers/b9ad03f9-bc18-46f7-a042-e24dba76410e/action" status: 202 len: 52 microversion: 2.47 time: 0.457345 Sep 07 12:46:06.047932 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1651/3326] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Sep 7 12:46:05 2022] POST /compute/v2.1/servers/b9ad03f9-bc18-46f7-a042-e24dba76410e/action => generated 52 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Sep 07 12:46:06.057296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7082c598-9fbc-47bb-94d6-ee16c47f9c00 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:06.058242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7082c598-9fbc-47bb-94d6-ee16c47f9c00 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 91762428-7354-4926-b463-edc357e1e7cf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:06.058374 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1676/3327] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:05 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1515 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:06.082698 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3640d4e3-2fac-4dd2-920f-a0c1269efb2b tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:06.087937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3640d4e3-2fac-4dd2-920f-a0c1269efb2b tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] [instance: b9ad03f9-bc18-46f7-a042-e24dba76410e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:06.097594 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7082c598-9fbc-47bb-94d6-ee16c47f9c00 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:06.098112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7082c598-9fbc-47bb-94d6-ee16c47f9c00 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:06.098706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7082c598-9fbc-47bb-94d6-ee16c47f9c00 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:06.099837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7082c598-9fbc-47bb-94d6-ee16c47f9c00 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:06.100447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7082c598-9fbc-47bb-94d6-ee16c47f9c00 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:06.100940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7082c598-9fbc-47bb-94d6-ee16c47f9c00 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:06.105298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3640d4e3-2fac-4dd2-920f-a0c1269efb2b tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:06.113838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3640d4e3-2fac-4dd2-920f-a0c1269efb2b tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:06.117594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3640d4e3-2fac-4dd2-920f-a0c1269efb2b tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:06.119128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3640d4e3-2fac-4dd2-920f-a0c1269efb2b tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:06.120001 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3640d4e3-2fac-4dd2-920f-a0c1269efb2b tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:06.120779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3640d4e3-2fac-4dd2-920f-a0c1269efb2b tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:06.121161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:46:06.196156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3640d4e3-2fac-4dd2-920f-a0c1269efb2b tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] [instance: b9ad03f9-bc18-46f7-a042-e24dba76410e] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:46:06.411967 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3640d4e3-2fac-4dd2-920f-a0c1269efb2b tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b9ad03f9-bc18-46f7-a042-e24dba76410e" status: 204 len: 0 microversion: 2.47 time: 0.348277 Sep 07 12:46:06.417238 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1677/3328] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 12:46:06 2022] DELETE /compute/v2.1/servers/b9ad03f9-bc18-46f7-a042-e24dba76410e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:46:06.424272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-acafae37-44cf-4ff3-ad1d-c1370baa5f80 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:06.425437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-acafae37-44cf-4ff3-ad1d-c1370baa5f80 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:06.436448 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-acafae37-44cf-4ff3-ad1d-c1370baa5f80 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:06.437410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-acafae37-44cf-4ff3-ad1d-c1370baa5f80 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:06.438443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-acafae37-44cf-4ff3-ad1d-c1370baa5f80 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:06.439449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-acafae37-44cf-4ff3-ad1d-c1370baa5f80 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:06.441074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-acafae37-44cf-4ff3-ad1d-c1370baa5f80 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:06.441989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-acafae37-44cf-4ff3-ad1d-c1370baa5f80 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:06.711858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7082c598-9fbc-47bb-94d6-ee16c47f9c00 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796a821c4f184a6aac2859bb943f9bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a87170da674037af70fac57a366c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:06.761590 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7082c598-9fbc-47bb-94d6-ee16c47f9c00 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf" status: 200 len: 1317 microversion: 2.1 time: 0.711923 Sep 07 12:46:06.767456 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1652/3329] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:06 2022] GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf => generated 1317 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:06.805872 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f93c0fa5-e909-48f7-8f21-519e984617aa tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:06.807203 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f93c0fa5-e909-48f7-8f21-519e984617aa tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] [instance: b9ad03f9-bc18-46f7-a042-e24dba76410e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:06.828501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f93c0fa5-e909-48f7-8f21-519e984617aa tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:06.831775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f93c0fa5-e909-48f7-8f21-519e984617aa tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:06.833145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f93c0fa5-e909-48f7-8f21-519e984617aa tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:06.834917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f93c0fa5-e909-48f7-8f21-519e984617aa tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:06.836372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f93c0fa5-e909-48f7-8f21-519e984617aa tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:06.839255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f93c0fa5-e909-48f7-8f21-519e984617aa tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:06.915557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-acafae37-44cf-4ff3-ad1d-c1370baa5f80 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:06.931055 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-acafae37-44cf-4ff3-ad1d-c1370baa5f80 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1507 microversion: 2.1 time: 0.511750 Sep 07 12:46:06.960373 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1678/3330] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:06 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1507 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:07.018256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f93c0fa5-e909-48f7-8f21-519e984617aa tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:07.037974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f93c0fa5-e909-48f7-8f21-519e984617aa tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:07.042130 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f93c0fa5-e909-48f7-8f21-519e984617aa tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:07.046607 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f93c0fa5-e909-48f7-8f21-519e984617aa tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] 10.222.0.16 "GET /compute/v2.1/servers/b9ad03f9-bc18-46f7-a042-e24dba76410e" status: 200 len: 1366 microversion: 2.47 time: 0.259969 Sep 07 12:46:07.059400 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1653/3331] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:46:06 2022] GET /compute/v2.1/servers/b9ad03f9-bc18-46f7-a042-e24dba76410e => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:46:07.104469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-96f1b394-55c3-464b-9f04-e0e7cee3b5fc tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:07.105893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-96f1b394-55c3-464b-9f04-e0e7cee3b5fc tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:07.122150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96f1b394-55c3-464b-9f04-e0e7cee3b5fc tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:07.124011 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96f1b394-55c3-464b-9f04-e0e7cee3b5fc tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:07.124675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96f1b394-55c3-464b-9f04-e0e7cee3b5fc tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:07.129939 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96f1b394-55c3-464b-9f04-e0e7cee3b5fc tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:07.132045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96f1b394-55c3-464b-9f04-e0e7cee3b5fc tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:07.133331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96f1b394-55c3-464b-9f04-e0e7cee3b5fc tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:07.483453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-96f1b394-55c3-464b-9f04-e0e7cee3b5fc tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:07.493910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-07eb436a-5005-4c40-ba2d-b5e33dbd4097 req-cda1395a-2782-4b34-b64b-b310b3d9a050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91762428-7354-4926-b463-edc357e1e7cf", "tag": "8dbc8ca0-72c8-4de0-87af-ac6f1b8ece18"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:46:07.499015 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-96f1b394-55c3-464b-9f04-e0e7cee3b5fc tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1515 microversion: 2.1 time: 0.400131 Sep 07 12:46:07.501537 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1679/3332] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:07 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1515 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:07.518521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-07eb436a-5005-4c40-ba2d-b5e33dbd4097 req-cda1395a-2782-4b34-b64b-b310b3d9a050 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:07.519416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-07eb436a-5005-4c40-ba2d-b5e33dbd4097 req-cda1395a-2782-4b34-b64b-b310b3d9a050 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:07.520183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-07eb436a-5005-4c40-ba2d-b5e33dbd4097 req-cda1395a-2782-4b34-b64b-b310b3d9a050 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:07.545689 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-07eb436a-5005-4c40-ba2d-b5e33dbd4097 req-cda1395a-2782-4b34-b64b-b310b3d9a050 service nova] Creating event network-changed:8dbc8ca0-72c8-4de0-87af-ac6f1b8ece18 for instance 91762428-7354-4926-b463-edc357e1e7cf on n-h1-852087-9 Sep 07 12:46:07.552068 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-07eb436a-5005-4c40-ba2d-b5e33dbd4097 req-cda1395a-2782-4b34-b64b-b310b3d9a050 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062027 Sep 07 12:46:07.553304 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1654/3333] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:46:07.788836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-789a51c8-a28f-4ab5-8883-e6f5a88bde20 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:07.789473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-789a51c8-a28f-4ab5-8883-e6f5a88bde20 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 91762428-7354-4926-b463-edc357e1e7cf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:07.797830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-789a51c8-a28f-4ab5-8883-e6f5a88bde20 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:07.798998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-789a51c8-a28f-4ab5-8883-e6f5a88bde20 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:07.800007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-789a51c8-a28f-4ab5-8883-e6f5a88bde20 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:07.801058 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-789a51c8-a28f-4ab5-8883-e6f5a88bde20 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:07.801759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-789a51c8-a28f-4ab5-8883-e6f5a88bde20 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:07.802359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-789a51c8-a28f-4ab5-8883-e6f5a88bde20 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:07.962385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ad2e7a5-a8d6-41ac-88e9-c584a2ec171e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:07.964698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6ad2e7a5-a8d6-41ac-88e9-c584a2ec171e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:07.973143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ad2e7a5-a8d6-41ac-88e9-c584a2ec171e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:07.974087 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ad2e7a5-a8d6-41ac-88e9-c584a2ec171e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:07.974815 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ad2e7a5-a8d6-41ac-88e9-c584a2ec171e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:07.975757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ad2e7a5-a8d6-41ac-88e9-c584a2ec171e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:07.976425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ad2e7a5-a8d6-41ac-88e9-c584a2ec171e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:07.977133 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ad2e7a5-a8d6-41ac-88e9-c584a2ec171e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:07.985926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-789a51c8-a28f-4ab5-8883-e6f5a88bde20 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796a821c4f184a6aac2859bb943f9bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a87170da674037af70fac57a366c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:07.998013 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-789a51c8-a28f-4ab5-8883-e6f5a88bde20 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf" status: 200 len: 1317 microversion: 2.1 time: 0.213103 Sep 07 12:46:08.009729 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1680/3334] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:07 2022] GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:08.030306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:46:08.076172 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8b96caed-5352-4689-b38c-05b457f89ca7 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:08.077527 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8b96caed-5352-4689-b38c-05b457f89ca7 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] [instance: b9ad03f9-bc18-46f7-a042-e24dba76410e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:08.097336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b96caed-5352-4689-b38c-05b457f89ca7 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:08.097877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b96caed-5352-4689-b38c-05b457f89ca7 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:08.098830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b96caed-5352-4689-b38c-05b457f89ca7 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:08.101074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b96caed-5352-4689-b38c-05b457f89ca7 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:08.103654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b96caed-5352-4689-b38c-05b457f89ca7 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:08.104948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b96caed-5352-4689-b38c-05b457f89ca7 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:08.147631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6ad2e7a5-a8d6-41ac-88e9-c584a2ec171e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:08.156479 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6ad2e7a5-a8d6-41ac-88e9-c584a2ec171e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1507 microversion: 2.1 time: 0.198529 Sep 07 12:46:08.157703 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1655/3335] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:07 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1507 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:08.214180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8b96caed-5352-4689-b38c-05b457f89ca7 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:08.230347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8b96caed-5352-4689-b38c-05b457f89ca7 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:08.234843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8b96caed-5352-4689-b38c-05b457f89ca7 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:08.237064 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8b96caed-5352-4689-b38c-05b457f89ca7 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] 10.222.0.16 "GET /compute/v2.1/servers/b9ad03f9-bc18-46f7-a042-e24dba76410e" status: 200 len: 1366 microversion: 2.47 time: 0.165011 Sep 07 12:46:08.239041 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1681/3336] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:46:08 2022] GET /compute/v2.1/servers/b9ad03f9-bc18-46f7-a042-e24dba76410e => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:46:08.527115 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-10f55fc7-cd14-4632-965f-63b38fbd883b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:08.527933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-10f55fc7-cd14-4632-965f-63b38fbd883b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:08.531807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:46:08.539319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10f55fc7-cd14-4632-965f-63b38fbd883b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:08.540048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10f55fc7-cd14-4632-965f-63b38fbd883b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:08.540605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10f55fc7-cd14-4632-965f-63b38fbd883b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:08.541567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10f55fc7-cd14-4632-965f-63b38fbd883b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:08.542229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10f55fc7-cd14-4632-965f-63b38fbd883b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:08.542859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10f55fc7-cd14-4632-965f-63b38fbd883b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:09.028809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8dd1295a-b692-4565-a269-7f2de2aedb99 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:09.040357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8dd1295a-b692-4565-a269-7f2de2aedb99 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 91762428-7354-4926-b463-edc357e1e7cf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:09.059349 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8dd1295a-b692-4565-a269-7f2de2aedb99 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:09.060628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8dd1295a-b692-4565-a269-7f2de2aedb99 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:09.061703 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8dd1295a-b692-4565-a269-7f2de2aedb99 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:09.063338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8dd1295a-b692-4565-a269-7f2de2aedb99 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:09.071952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8dd1295a-b692-4565-a269-7f2de2aedb99 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:09.073211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8dd1295a-b692-4565-a269-7f2de2aedb99 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:09.109185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-10f55fc7-cd14-4632-965f-63b38fbd883b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:09.160944 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-10f55fc7-cd14-4632-965f-63b38fbd883b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1515 microversion: 2.1 time: 0.635518 Sep 07 12:46:09.163267 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1656/3337] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:08 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1515 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:09.183549 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5c5a46fd-0f67-45b2-88f2-223f7edc1a41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:09.184443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5c5a46fd-0f67-45b2-88f2-223f7edc1a41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:09.193885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c5a46fd-0f67-45b2-88f2-223f7edc1a41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:09.194793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c5a46fd-0f67-45b2-88f2-223f7edc1a41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:09.195395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c5a46fd-0f67-45b2-88f2-223f7edc1a41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:09.196725 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c5a46fd-0f67-45b2-88f2-223f7edc1a41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:09.197714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c5a46fd-0f67-45b2-88f2-223f7edc1a41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:09.198953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c5a46fd-0f67-45b2-88f2-223f7edc1a41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:09.388138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8dd1295a-b692-4565-a269-7f2de2aedb99 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796a821c4f184a6aac2859bb943f9bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a87170da674037af70fac57a366c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:09.398786 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8dd1295a-b692-4565-a269-7f2de2aedb99 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf" status: 200 len: 1317 microversion: 2.1 time: 0.377956 Sep 07 12:46:09.404358 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1682/3338] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:09 2022] GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf => generated 1317 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:09.416473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b922be59-15c1-4121-8c4a-0051ecf270b5 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:09.417671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b922be59-15c1-4121-8c4a-0051ecf270b5 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] [instance: b9ad03f9-bc18-46f7-a042-e24dba76410e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:09.452571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b922be59-15c1-4121-8c4a-0051ecf270b5 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:09.454227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b922be59-15c1-4121-8c4a-0051ecf270b5 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:09.455215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b922be59-15c1-4121-8c4a-0051ecf270b5 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:09.456687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b922be59-15c1-4121-8c4a-0051ecf270b5 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:09.457954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b922be59-15c1-4121-8c4a-0051ecf270b5 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:09.459077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b922be59-15c1-4121-8c4a-0051ecf270b5 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:09.529204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5c5a46fd-0f67-45b2-88f2-223f7edc1a41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:09.541651 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5c5a46fd-0f67-45b2-88f2-223f7edc1a41 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1507 microversion: 2.1 time: 0.364058 Sep 07 12:46:09.543399 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1657/3339] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:09 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1507 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:09.594762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b922be59-15c1-4121-8c4a-0051ecf270b5 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:09.610163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b922be59-15c1-4121-8c4a-0051ecf270b5 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:09.611743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b922be59-15c1-4121-8c4a-0051ecf270b5 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:09.613027 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b922be59-15c1-4121-8c4a-0051ecf270b5 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] 10.222.0.16 "GET /compute/v2.1/servers/b9ad03f9-bc18-46f7-a042-e24dba76410e" status: 200 len: 1366 microversion: 2.47 time: 0.207479 Sep 07 12:46:09.613996 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1683/3340] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:46:09 2022] GET /compute/v2.1/servers/b9ad03f9-bc18-46f7-a042-e24dba76410e => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:46:10.203981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7a48da14-5197-4143-9fe2-aa44f844fb80 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:10.205581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7a48da14-5197-4143-9fe2-aa44f844fb80 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:10.212503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a48da14-5197-4143-9fe2-aa44f844fb80 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:10.213419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a48da14-5197-4143-9fe2-aa44f844fb80 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:10.214115 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a48da14-5197-4143-9fe2-aa44f844fb80 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:10.215091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a48da14-5197-4143-9fe2-aa44f844fb80 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:10.215806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a48da14-5197-4143-9fe2-aa44f844fb80 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:10.216529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a48da14-5197-4143-9fe2-aa44f844fb80 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:10.445234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9f5f8493-f3ba-4761-b538-86e1a93b3aed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:10.445979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9f5f8493-f3ba-4761-b538-86e1a93b3aed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 91762428-7354-4926-b463-edc357e1e7cf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:10.462313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f5f8493-f3ba-4761-b538-86e1a93b3aed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:10.462812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f5f8493-f3ba-4761-b538-86e1a93b3aed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:10.464784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f5f8493-f3ba-4761-b538-86e1a93b3aed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:10.478960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f5f8493-f3ba-4761-b538-86e1a93b3aed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:10.479662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f5f8493-f3ba-4761-b538-86e1a93b3aed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:10.480137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f5f8493-f3ba-4761-b538-86e1a93b3aed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:10.506850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7a48da14-5197-4143-9fe2-aa44f844fb80 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:10.515971 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7a48da14-5197-4143-9fe2-aa44f844fb80 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1515 microversion: 2.1 time: 0.316964 Sep 07 12:46:10.525610 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1658/3341] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:10 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1515 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:10.569595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b49fa953-6bd3-482a-b9fd-092a185e4b1e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:10.570708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b49fa953-6bd3-482a-b9fd-092a185e4b1e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:10.587340 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b49fa953-6bd3-482a-b9fd-092a185e4b1e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:10.588322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b49fa953-6bd3-482a-b9fd-092a185e4b1e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:10.588783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b49fa953-6bd3-482a-b9fd-092a185e4b1e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:10.592337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b49fa953-6bd3-482a-b9fd-092a185e4b1e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:10.593343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b49fa953-6bd3-482a-b9fd-092a185e4b1e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:10.594289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b49fa953-6bd3-482a-b9fd-092a185e4b1e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:11.415295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b49fa953-6bd3-482a-b9fd-092a185e4b1e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:11.427742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9f5f8493-f3ba-4761-b538-86e1a93b3aed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796a821c4f184a6aac2859bb943f9bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a87170da674037af70fac57a366c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:11.444208 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9f5f8493-f3ba-4761-b538-86e1a93b3aed tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf" status: 200 len: 1317 microversion: 2.1 time: 1.005361 Sep 07 12:46:11.444901 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1684/3342] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:10 2022] GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf => generated 1317 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:11.458258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-65091717-7954-4285-9044-357b846fd037 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:11.462415 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b49fa953-6bd3-482a-b9fd-092a185e4b1e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1507 microversion: 2.1 time: 0.895494 Sep 07 12:46:11.463875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-65091717-7954-4285-9044-357b846fd037 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] [instance: b9ad03f9-bc18-46f7-a042-e24dba76410e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:11.479610 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1659/3343] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:10 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1507 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:11.479924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65091717-7954-4285-9044-357b846fd037 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:11.485556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65091717-7954-4285-9044-357b846fd037 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:11.485556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65091717-7954-4285-9044-357b846fd037 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:11.486631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65091717-7954-4285-9044-357b846fd037 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:11.487271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65091717-7954-4285-9044-357b846fd037 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:11.487772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65091717-7954-4285-9044-357b846fd037 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:11.567291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-705ab503-a75c-4e03-83bc-29959700869a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:11.572983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-705ab503-a75c-4e03-83bc-29959700869a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:11.638954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-705ab503-a75c-4e03-83bc-29959700869a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:11.641641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-705ab503-a75c-4e03-83bc-29959700869a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:11.644200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-705ab503-a75c-4e03-83bc-29959700869a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:11.647631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-705ab503-a75c-4e03-83bc-29959700869a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:11.649333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-705ab503-a75c-4e03-83bc-29959700869a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:11.651012 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-705ab503-a75c-4e03-83bc-29959700869a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:12.082386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-65091717-7954-4285-9044-357b846fd037 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:12.126570 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-65091717-7954-4285-9044-357b846fd037 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:12.130067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-65091717-7954-4285-9044-357b846fd037 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:12.132881 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-65091717-7954-4285-9044-357b846fd037 tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] 10.222.0.16 "GET /compute/v2.1/servers/b9ad03f9-bc18-46f7-a042-e24dba76410e" status: 200 len: 1366 microversion: 2.47 time: 0.685450 Sep 07 12:46:12.134184 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1685/3344] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:46:11 2022] GET /compute/v2.1/servers/b9ad03f9-bc18-46f7-a042-e24dba76410e => generated 1366 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:46:12.495479 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f6b24844-62b5-440e-9de0-2f9ba898a90d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:12.498379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f6b24844-62b5-440e-9de0-2f9ba898a90d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 91762428-7354-4926-b463-edc357e1e7cf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:12.537523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6b24844-62b5-440e-9de0-2f9ba898a90d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:12.539295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6b24844-62b5-440e-9de0-2f9ba898a90d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:12.541653 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6b24844-62b5-440e-9de0-2f9ba898a90d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:12.545658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6b24844-62b5-440e-9de0-2f9ba898a90d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:12.548732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-705ab503-a75c-4e03-83bc-29959700869a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:12.550196 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6b24844-62b5-440e-9de0-2f9ba898a90d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:12.551581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6b24844-62b5-440e-9de0-2f9ba898a90d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:12.563105 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-705ab503-a75c-4e03-83bc-29959700869a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1515 microversion: 2.1 time: 1.023970 Sep 07 12:46:12.578470 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1660/3345] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:11 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1515 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:12.619759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4f05c839-7657-4a71-8287-92e55c18fe7e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:12.625054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4f05c839-7657-4a71-8287-92e55c18fe7e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:12.654157 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f05c839-7657-4a71-8287-92e55c18fe7e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:12.665870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f05c839-7657-4a71-8287-92e55c18fe7e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:12.673768 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f05c839-7657-4a71-8287-92e55c18fe7e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:12.675017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f05c839-7657-4a71-8287-92e55c18fe7e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:12.677831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f05c839-7657-4a71-8287-92e55c18fe7e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:12.678428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f05c839-7657-4a71-8287-92e55c18fe7e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:12.708109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:46:13.137581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4f05c839-7657-4a71-8287-92e55c18fe7e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:13.153967 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4f05c839-7657-4a71-8287-92e55c18fe7e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1507 microversion: 2.1 time: 0.573991 Sep 07 12:46:13.154882 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1661/3346] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:12 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1507 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:13.165292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-075a1503-260d-4248-9be1-398a1d63c29b tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:13.171650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-075a1503-260d-4248-9be1-398a1d63c29b tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] [instance: b9ad03f9-bc18-46f7-a042-e24dba76410e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:13.180678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-075a1503-260d-4248-9be1-398a1d63c29b tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:13.181527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-075a1503-260d-4248-9be1-398a1d63c29b tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:13.182140 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-075a1503-260d-4248-9be1-398a1d63c29b tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:13.183074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-075a1503-260d-4248-9be1-398a1d63c29b tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:13.183711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-075a1503-260d-4248-9be1-398a1d63c29b tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:13.184306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-075a1503-260d-4248-9be1-398a1d63c29b tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:13.259551 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-075a1503-260d-4248-9be1-398a1d63c29b tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:13.260908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-075a1503-260d-4248-9be1-398a1d63c29b tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:13.261552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-075a1503-260d-4248-9be1-398a1d63c29b tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:13.262219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-075a1503-260d-4248-9be1-398a1d63c29b tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lazy-loading 'fault' on Instance uuid b9ad03f9-bc18-46f7-a042-e24dba76410e {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:46:13.403484 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-075a1503-260d-4248-9be1-398a1d63c29b tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:13.413401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-075a1503-260d-4248-9be1-398a1d63c29b tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:13.433776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-075a1503-260d-4248-9be1-398a1d63c29b tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba617e93f5e740ba8970f7323871ee06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2e2ee3fd574ca69c57a7a356066547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:13.441663 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-075a1503-260d-4248-9be1-398a1d63c29b tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] 10.222.0.16 "GET /compute/v2.1/servers/b9ad03f9-bc18-46f7-a042-e24dba76410e" status: 200 len: 1371 microversion: 2.47 time: 0.283574 Sep 07 12:46:13.443411 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1662/3347] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:46:13 2022] GET /compute/v2.1/servers/b9ad03f9-bc18-46f7-a042-e24dba76410e => generated 1371 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:46:13.594902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2ab57a5a-9b73-4a2e-bb47-704528b5443e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:13.599095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2ab57a5a-9b73-4a2e-bb47-704528b5443e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:13.629210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ab57a5a-9b73-4a2e-bb47-704528b5443e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:13.653037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ab57a5a-9b73-4a2e-bb47-704528b5443e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:13.654483 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ab57a5a-9b73-4a2e-bb47-704528b5443e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:13.656651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ab57a5a-9b73-4a2e-bb47-704528b5443e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:13.657558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ab57a5a-9b73-4a2e-bb47-704528b5443e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:13.666191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ab57a5a-9b73-4a2e-bb47-704528b5443e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:13.688078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f6b24844-62b5-440e-9de0-2f9ba898a90d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796a821c4f184a6aac2859bb943f9bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a87170da674037af70fac57a366c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:13.702508 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f6b24844-62b5-440e-9de0-2f9ba898a90d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf" status: 200 len: 1317 microversion: 2.1 time: 1.215682 Sep 07 12:46:13.704097 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1686/3348] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:12 2022] GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf => generated 1317 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:46:13.985733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2ab57a5a-9b73-4a2e-bb47-704528b5443e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:14.001228 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2ab57a5a-9b73-4a2e-bb47-704528b5443e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1515 microversion: 2.1 time: 0.413147 Sep 07 12:46:14.002246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-4842668e-0d23-4998-b9c7-5e9ce75818a1 req-eb6b056c-5688-4460-841a-a4b1e9be5c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "676e42b4-4985-43cc-892b-176e13b341df", "name": "network-vif-plugged", "status": "completed", "tag": "8973b130-dd43-4a93-b14e-3d7f5131cd14"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:46:14.003039 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1663/3349] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:13 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1515 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:14.039264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4842668e-0d23-4998-b9c7-5e9ce75818a1 req-eb6b056c-5688-4460-841a-a4b1e9be5c86 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:14.040271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4842668e-0d23-4998-b9c7-5e9ce75818a1 req-eb6b056c-5688-4460-841a-a4b1e9be5c86 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:14.041468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4842668e-0d23-4998-b9c7-5e9ce75818a1 req-eb6b056c-5688-4460-841a-a4b1e9be5c86 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:14.089315 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-4842668e-0d23-4998-b9c7-5e9ce75818a1 req-eb6b056c-5688-4460-841a-a4b1e9be5c86 service nova] Creating event network-vif-plugged:8973b130-dd43-4a93-b14e-3d7f5131cd14 for instance 676e42b4-4985-43cc-892b-176e13b341df on n-h2-852087-9 Sep 07 12:46:14.110144 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-4842668e-0d23-4998-b9c7-5e9ce75818a1 req-eb6b056c-5688-4460-841a-a4b1e9be5c86 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115241 Sep 07 12:46:14.116851 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1687/3350] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:46:14.179783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-77ca240a-3966-4d3c-8554-abc88d577835 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:14.180420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-77ca240a-3966-4d3c-8554-abc88d577835 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:14.194122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77ca240a-3966-4d3c-8554-abc88d577835 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:14.197754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77ca240a-3966-4d3c-8554-abc88d577835 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:14.198369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77ca240a-3966-4d3c-8554-abc88d577835 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:14.199156 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77ca240a-3966-4d3c-8554-abc88d577835 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:14.199650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77ca240a-3966-4d3c-8554-abc88d577835 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:14.200082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77ca240a-3966-4d3c-8554-abc88d577835 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:14.474220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b8f19228-8dde-4999-97e0-a23e84f582fc tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:14.475287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b8f19228-8dde-4999-97e0-a23e84f582fc tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] [instance: b9ad03f9-bc18-46f7-a042-e24dba76410e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:14.491770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8f19228-8dde-4999-97e0-a23e84f582fc tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:14.493891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8f19228-8dde-4999-97e0-a23e84f582fc tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:14.495490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8f19228-8dde-4999-97e0-a23e84f582fc tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:14.496737 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8f19228-8dde-4999-97e0-a23e84f582fc tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:14.502314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8f19228-8dde-4999-97e0-a23e84f582fc tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:14.503910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8f19228-8dde-4999-97e0-a23e84f582fc tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:14.546319 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-b8f19228-8dde-4999-97e0-a23e84f582fc tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] HTTP exception thrown: Instance b9ad03f9-bc18-46f7-a042-e24dba76410e could not be found. Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b8f19228-8dde-4999-97e0-a23e84f582fc tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Request method failure captured: Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/b9ad03f9-bc18-46f7-a042-e24dba76410e HTTP/1.1 Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJKEfQRKtoQGGCE2TV62lqCjL-kYfcVXtFjDacy7yyXrTB8fTjjijERrJNhTKsHBjflBsezRKWsjv237LJUUldcjBPMHgECQGzbFkclIR85NBnETsMBViGH2ru-RIODgoLs_R4yFLgcbv3iAmsYe8NTpHVPnC_6xmnbO5TXDz3lb4u0 Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.47 Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: bf2e2ee3fd574ca69c57a7a356066547 Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersAaction247Test-615005061 Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bf2e2ee3fd574ca69c57a7a356066547"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bf2e2ee3fd574ca69c57a7a356066547"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bf2e2ee3fd574ca69c57a7a356066547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bf2e2ee3fd574ca69c57a7a356066547"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersAaction247Test-615005061 Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: bf2e2ee3fd574ca69c57a7a356066547 Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersAaction247Test-615005061 Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersAaction247Test-615005061-project Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: ba617e93f5e740ba8970f7323871ee06 Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersAaction247Test-615005061-project Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance b9ad03f9-bc18-46f7-a042-e24dba76410e could not be found. Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'b9ad03f9-bc18-46f7-a042-e24dba76410e'} Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9ad03f9-bc18-46f7-a042-e24dba76410e could not be found. Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9ad03f9-bc18-46f7-a042-e24dba76410e could not be found. Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:46:14.556138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:46:14.564879 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:46:14.564879 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:46:14.564879 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:46:14.564879 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:46:14.564879 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:46:14.564879 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9ad03f9-bc18-46f7-a042-e24dba76410e could not be found. Sep 07 12:46:14.564879 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:46:14.564879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b8f19228-8dde-4999-97e0-a23e84f582fc tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] Returning 404 to user: Instance b9ad03f9-bc18-46f7-a042-e24dba76410e could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:46:14.567510 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b8f19228-8dde-4999-97e0-a23e84f582fc tempest-ServersAaction247Test-615005061 tempest-ServersAaction247Test-615005061-project] 10.222.0.16 "GET /compute/v2.1/servers/b9ad03f9-bc18-46f7-a042-e24dba76410e" status: 404 len: 111 microversion: 2.47 time: 0.096534 Sep 07 12:46:14.567510 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1688/3351] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:46:14 2022] GET /compute/v2.1/servers/b9ad03f9-bc18-46f7-a042-e24dba76410e => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 07 12:46:14.625966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-77ca240a-3966-4d3c-8554-abc88d577835 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:14.643791 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-77ca240a-3966-4d3c-8554-abc88d577835 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1507 microversion: 2.1 time: 0.469045 Sep 07 12:46:14.647919 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1664/3352] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:14 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1507 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:46:14.753072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3e722567-040f-48e5-8c36-b9fa2b23abbd tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:14.753882 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3e722567-040f-48e5-8c36-b9fa2b23abbd tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 91762428-7354-4926-b463-edc357e1e7cf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:14.781962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e722567-040f-48e5-8c36-b9fa2b23abbd tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:14.784979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e722567-040f-48e5-8c36-b9fa2b23abbd tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:14.789643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e722567-040f-48e5-8c36-b9fa2b23abbd tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:14.794133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e722567-040f-48e5-8c36-b9fa2b23abbd tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:14.799545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e722567-040f-48e5-8c36-b9fa2b23abbd tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:14.800704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e722567-040f-48e5-8c36-b9fa2b23abbd tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:15.032545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b27072bb-cde0-42ea-8eff-d01243f67d98 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:15.042246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b27072bb-cde0-42ea-8eff-d01243f67d98 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:15.103505 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b27072bb-cde0-42ea-8eff-d01243f67d98 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:15.106778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b27072bb-cde0-42ea-8eff-d01243f67d98 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:15.107895 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b27072bb-cde0-42ea-8eff-d01243f67d98 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:15.112002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b27072bb-cde0-42ea-8eff-d01243f67d98 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:15.115619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b27072bb-cde0-42ea-8eff-d01243f67d98 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:15.120606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b27072bb-cde0-42ea-8eff-d01243f67d98 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:15.467993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3e722567-040f-48e5-8c36-b9fa2b23abbd tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796a821c4f184a6aac2859bb943f9bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a87170da674037af70fac57a366c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:15.480779 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3e722567-040f-48e5-8c36-b9fa2b23abbd tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf" status: 200 len: 1317 microversion: 2.1 time: 0.733851 Sep 07 12:46:15.481381 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1689/3353] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:14 2022] GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf => generated 1317 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:15.630545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b27072bb-cde0-42ea-8eff-d01243f67d98 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:15.643983 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b27072bb-cde0-42ea-8eff-d01243f67d98 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1515 microversion: 2.1 time: 0.620619 Sep 07 12:46:15.645344 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1665/3354] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:15 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1515 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:15.690445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a35fed2-adf5-463f-b0fd-29b236eb0213 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:15.691190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4a35fed2-adf5-463f-b0fd-29b236eb0213 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:15.711862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a35fed2-adf5-463f-b0fd-29b236eb0213 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:15.713573 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a35fed2-adf5-463f-b0fd-29b236eb0213 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:15.714401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a35fed2-adf5-463f-b0fd-29b236eb0213 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:15.715089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a35fed2-adf5-463f-b0fd-29b236eb0213 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:15.715575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a35fed2-adf5-463f-b0fd-29b236eb0213 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:15.716020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a35fed2-adf5-463f-b0fd-29b236eb0213 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:16.510981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bc83354f-55d6-4fa6-a960-a21a302e737b tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:16.512208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bc83354f-55d6-4fa6-a960-a21a302e737b tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 91762428-7354-4926-b463-edc357e1e7cf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:16.523082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:46:16.526052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc83354f-55d6-4fa6-a960-a21a302e737b tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:16.527215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc83354f-55d6-4fa6-a960-a21a302e737b tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:16.529067 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc83354f-55d6-4fa6-a960-a21a302e737b tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:16.531007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc83354f-55d6-4fa6-a960-a21a302e737b tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:16.533075 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc83354f-55d6-4fa6-a960-a21a302e737b tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:16.534565 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc83354f-55d6-4fa6-a960-a21a302e737b tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:16.561238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4a35fed2-adf5-463f-b0fd-29b236eb0213 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:16.585142 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4a35fed2-adf5-463f-b0fd-29b236eb0213 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1507 microversion: 2.1 time: 0.907708 Sep 07 12:46:16.597722 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1690/3355] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:15 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1507 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:16.671081 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8c81a18d-f35d-4883-a650-676602895483 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:16.671765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8c81a18d-f35d-4883-a650-676602895483 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:16.683689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c81a18d-f35d-4883-a650-676602895483 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:16.684196 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c81a18d-f35d-4883-a650-676602895483 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:16.684791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c81a18d-f35d-4883-a650-676602895483 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:16.685562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c81a18d-f35d-4883-a650-676602895483 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:16.686265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c81a18d-f35d-4883-a650-676602895483 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:16.686866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c81a18d-f35d-4883-a650-676602895483 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:17.365726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bc83354f-55d6-4fa6-a960-a21a302e737b tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796a821c4f184a6aac2859bb943f9bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a87170da674037af70fac57a366c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:17.387749 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bc83354f-55d6-4fa6-a960-a21a302e737b tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf" status: 200 len: 1317 microversion: 2.1 time: 0.882338 Sep 07 12:46:17.388876 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1666/3356] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:16 2022] GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf => generated 1317 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:17.414100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-32a4a610-8b60-49ea-9c5f-de14cecff93a req-30620351-fd73-4815-85b5-4ea1cf590139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91762428-7354-4926-b463-edc357e1e7cf", "name": "network-vif-plugged", "status": "completed", "tag": "8dbc8ca0-72c8-4de0-87af-ac6f1b8ece18"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:46:17.425809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-32a4a610-8b60-49ea-9c5f-de14cecff93a req-30620351-fd73-4815-85b5-4ea1cf590139 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:17.426773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-32a4a610-8b60-49ea-9c5f-de14cecff93a req-30620351-fd73-4815-85b5-4ea1cf590139 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:17.427411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-32a4a610-8b60-49ea-9c5f-de14cecff93a req-30620351-fd73-4815-85b5-4ea1cf590139 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:17.461179 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-32a4a610-8b60-49ea-9c5f-de14cecff93a req-30620351-fd73-4815-85b5-4ea1cf590139 service nova] Creating event network-vif-plugged:8dbc8ca0-72c8-4de0-87af-ac6f1b8ece18 for instance 91762428-7354-4926-b463-edc357e1e7cf on n-h1-852087-9 Sep 07 12:46:17.473205 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-32a4a610-8b60-49ea-9c5f-de14cecff93a req-30620351-fd73-4815-85b5-4ea1cf590139 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067991 Sep 07 12:46:17.476657 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1667/3357] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:46:17.565554 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8c81a18d-f35d-4883-a650-676602895483 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:17.590312 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8c81a18d-f35d-4883-a650-676602895483 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1515 microversion: 2.1 time: 0.923883 Sep 07 12:46:17.592474 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1691/3358] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:16 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1515 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:17.617136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d5ec89ee-e6bb-4186-b37c-04c9f9a2289a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:17.619574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d5ec89ee-e6bb-4186-b37c-04c9f9a2289a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:17.653453 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5ec89ee-e6bb-4186-b37c-04c9f9a2289a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:17.660714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5ec89ee-e6bb-4186-b37c-04c9f9a2289a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:17.661428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5ec89ee-e6bb-4186-b37c-04c9f9a2289a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:17.662453 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5ec89ee-e6bb-4186-b37c-04c9f9a2289a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:17.662870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5ec89ee-e6bb-4186-b37c-04c9f9a2289a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:17.663303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5ec89ee-e6bb-4186-b37c-04c9f9a2289a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:18.272923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec633ce9-d765-4e76-b81b-216135aea805 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-844719534", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:46:18.387153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d5ec89ee-e6bb-4186-b37c-04c9f9a2289a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:18.397580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-ec633ce9-d765-4e76-b81b-216135aea805 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] validate_networks() for [('f31895c7-5684-4c76-b257-83071f0edbbd', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:46:18.402513 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d5ec89ee-e6bb-4186-b37c-04c9f9a2289a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1507 microversion: 2.1 time: 0.797453 Sep 07 12:46:18.403589 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1668/3359] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:17 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1507 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:18.443832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-402a99ad-53f1-4040-b17d-2129e841cda7 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:18.445285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-402a99ad-53f1-4040-b17d-2129e841cda7 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 91762428-7354-4926-b463-edc357e1e7cf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:18.472308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-402a99ad-53f1-4040-b17d-2129e841cda7 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:18.475659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-402a99ad-53f1-4040-b17d-2129e841cda7 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:18.476548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-402a99ad-53f1-4040-b17d-2129e841cda7 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:18.479939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-402a99ad-53f1-4040-b17d-2129e841cda7 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:18.482248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-402a99ad-53f1-4040-b17d-2129e841cda7 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:18.485535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-402a99ad-53f1-4040-b17d-2129e841cda7 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:19.076023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-402a99ad-53f1-4040-b17d-2129e841cda7 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796a821c4f184a6aac2859bb943f9bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a87170da674037af70fac57a366c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:19.137946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:46:19.166874 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-402a99ad-53f1-4040-b17d-2129e841cda7 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf" status: 200 len: 1317 microversion: 2.1 time: 0.745278 Sep 07 12:46:19.190805 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1669/3360] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:18 2022] GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf => generated 1317 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:19.230526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5e209356-69f4-44f7-a257-398de9f89979 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:19.231413 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5e209356-69f4-44f7-a257-398de9f89979 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:19.253861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e209356-69f4-44f7-a257-398de9f89979 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:19.254746 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e209356-69f4-44f7-a257-398de9f89979 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:19.257311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e209356-69f4-44f7-a257-398de9f89979 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:19.260159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e209356-69f4-44f7-a257-398de9f89979 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:19.262653 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e209356-69f4-44f7-a257-398de9f89979 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:19.263141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e209356-69f4-44f7-a257-398de9f89979 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:19.872965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5e209356-69f4-44f7-a257-398de9f89979 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:19.908878 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5e209356-69f4-44f7-a257-398de9f89979 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1515 microversion: 2.1 time: 0.705847 Sep 07 12:46:19.922255 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1670/3361] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:19 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1515 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:19.941762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-362d4707-d3a7-4ada-9e08-32eb84dc0c3b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:19.942942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-362d4707-d3a7-4ada-9e08-32eb84dc0c3b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:19.967810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-362d4707-d3a7-4ada-9e08-32eb84dc0c3b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:19.980191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-362d4707-d3a7-4ada-9e08-32eb84dc0c3b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:19.981345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-362d4707-d3a7-4ada-9e08-32eb84dc0c3b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:19.984258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-362d4707-d3a7-4ada-9e08-32eb84dc0c3b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:19.985345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-362d4707-d3a7-4ada-9e08-32eb84dc0c3b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:19.987194 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-362d4707-d3a7-4ada-9e08-32eb84dc0c3b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:20.390036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ec633ce9-d765-4e76-b81b-216135aea805 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:46:20.391891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ec633ce9-d765-4e76-b81b-216135aea805 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:46:20.393919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ec633ce9-d765-4e76-b81b-216135aea805 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:46:20.395254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ec633ce9-d765-4e76-b81b-216135aea805 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:46:20.438041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ec633ce9-d765-4e76-b81b-216135aea805 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:46:20.451750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec633ce9-d765-4e76-b81b-216135aea805 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:20.457563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec633ce9-d765-4e76-b81b-216135aea805 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:20.458339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec633ce9-d765-4e76-b81b-216135aea805 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:20.459345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec633ce9-d765-4e76-b81b-216135aea805 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:20.459984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec633ce9-d765-4e76-b81b-216135aea805 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:20.460597 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec633ce9-d765-4e76-b81b-216135aea805 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:20.520058 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-ec633ce9-d765-4e76-b81b-216135aea805 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Getting quotas for project 256a95a81360419dbaf33382dd369262. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:46:20.543567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-ec633ce9-d765-4e76-b81b-216135aea805 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Getting quotas for user a6d92e694e984ad8b126b94ed8effb3f and project 256a95a81360419dbaf33382dd369262. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:46:20.606277 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ec633ce9-d765-4e76-b81b-216135aea805 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:46:20.610314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ec633ce9-d765-4e76-b81b-216135aea805 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:46:20.719769 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ec633ce9-d765-4e76-b81b-216135aea805 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.743024 Sep 07 12:46:20.721349 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1692/3362] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:46:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 2746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 12:46:20.738450 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a997a531-00ee-4799-aa79-6bc600525076 req-94c3d88b-0dd0-46c1-ba6b-36f5121e938a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edf38c92-ffc2-492b-8642-88ca59537acd", "name": "network-vif-plugged", "status": "completed", "tag": "23b18fbd-594f-42e0-a655-6b5f01607b28"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:46:20.764824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a997a531-00ee-4799-aa79-6bc600525076 req-94c3d88b-0dd0-46c1-ba6b-36f5121e938a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:20.768513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a997a531-00ee-4799-aa79-6bc600525076 req-94c3d88b-0dd0-46c1-ba6b-36f5121e938a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:20.771849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a997a531-00ee-4799-aa79-6bc600525076 req-94c3d88b-0dd0-46c1-ba6b-36f5121e938a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:20.805779 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a997a531-00ee-4799-aa79-6bc600525076 req-94c3d88b-0dd0-46c1-ba6b-36f5121e938a service nova] Creating event network-vif-plugged:23b18fbd-594f-42e0-a655-6b5f01607b28 for instance edf38c92-ffc2-492b-8642-88ca59537acd on n-h1-852087-9 Sep 07 12:46:20.812457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-362d4707-d3a7-4ada-9e08-32eb84dc0c3b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:20.820295 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a997a531-00ee-4799-aa79-6bc600525076 req-94c3d88b-0dd0-46c1-ba6b-36f5121e938a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094620 Sep 07 12:46:20.821134 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1693/3363] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:46:20.834294 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-362d4707-d3a7-4ada-9e08-32eb84dc0c3b tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1507 microversion: 2.1 time: 0.916311 Sep 07 12:46:20.837339 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1671/3364] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:19 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1507 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:20.846714 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-658e5716-3600-4e3c-a7d4-4e81b4a81bb0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:20.849889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-57da9435-a517-4234-80a4-3dfe625105a7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:20.852765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-57da9435-a517-4234-80a4-3dfe625105a7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:20.854626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-658e5716-3600-4e3c-a7d4-4e81b4a81bb0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 91762428-7354-4926-b463-edc357e1e7cf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:20.863910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-658e5716-3600-4e3c-a7d4-4e81b4a81bb0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:20.877893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-658e5716-3600-4e3c-a7d4-4e81b4a81bb0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:20.878671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-658e5716-3600-4e3c-a7d4-4e81b4a81bb0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:20.879717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-658e5716-3600-4e3c-a7d4-4e81b4a81bb0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:20.891713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-658e5716-3600-4e3c-a7d4-4e81b4a81bb0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:20.905418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-658e5716-3600-4e3c-a7d4-4e81b4a81bb0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:21.034388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-57da9435-a517-4234-80a4-3dfe625105a7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:21.088468 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-57da9435-a517-4234-80a4-3dfe625105a7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2" status: 200 len: 1221 microversion: 2.1 time: 0.248021 Sep 07 12:46:21.098052 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1672/3365] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:20 2022] GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2 => generated 1221 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:21.122062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-798358ec-b67f-486a-bef0-3afe7e0675f0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:21.123428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-798358ec-b67f-486a-bef0-3afe7e0675f0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:21.164562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-798358ec-b67f-486a-bef0-3afe7e0675f0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:21.165452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-798358ec-b67f-486a-bef0-3afe7e0675f0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:21.176149 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-798358ec-b67f-486a-bef0-3afe7e0675f0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:21.177245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-798358ec-b67f-486a-bef0-3afe7e0675f0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:21.177677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-798358ec-b67f-486a-bef0-3afe7e0675f0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:21.178141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-798358ec-b67f-486a-bef0-3afe7e0675f0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:21.299023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-658e5716-3600-4e3c-a7d4-4e81b4a81bb0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796a821c4f184a6aac2859bb943f9bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a87170da674037af70fac57a366c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:21.310290 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-658e5716-3600-4e3c-a7d4-4e81b4a81bb0 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf" status: 200 len: 1467 microversion: 2.1 time: 0.486450 Sep 07 12:46:21.328634 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1694/3366] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:20 2022] GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf => generated 1467 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:21.360318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ccffc83-13a9-49f5-a1cc-b3969a2169c2 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:21.362334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0ccffc83-13a9-49f5-a1cc-b3969a2169c2 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 676e42b4-4985-43cc-892b-176e13b341df] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:21.366486 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:46:21.380081 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ccffc83-13a9-49f5-a1cc-b3969a2169c2 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:21.390152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ccffc83-13a9-49f5-a1cc-b3969a2169c2 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:21.393269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ccffc83-13a9-49f5-a1cc-b3969a2169c2 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:21.394476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ccffc83-13a9-49f5-a1cc-b3969a2169c2 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:21.397034 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ccffc83-13a9-49f5-a1cc-b3969a2169c2 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:21.403944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ccffc83-13a9-49f5-a1cc-b3969a2169c2 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:21.794069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-798358ec-b67f-486a-bef0-3afe7e0675f0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:21.812724 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-798358ec-b67f-486a-bef0-3afe7e0675f0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1515 microversion: 2.1 time: 0.712921 Sep 07 12:46:21.814327 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1673/3367] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:21 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1515 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:21.831452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-552a4242-0537-4fc9-a7cc-88e9f88d2018 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1010954822", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:46:22.017183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0ccffc83-13a9-49f5-a1cc-b3969a2169c2 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796a821c4f184a6aac2859bb943f9bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a87170da674037af70fac57a366c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:22.053805 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ccffc83-13a9-49f5-a1cc-b3969a2169c2 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/676e42b4-4985-43cc-892b-176e13b341df" status: 200 len: 1467 microversion: 2.1 time: 0.701489 Sep 07 12:46:22.057329 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1695/3368] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:21 2022] GET /compute/v2.1/servers/676e42b4-4985-43cc-892b-176e13b341df => generated 1467 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:46:22.067749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e4cba575-d5ee-411b-88fe-044346f5af7e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:22.068761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e4cba575-d5ee-411b-88fe-044346f5af7e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:22.078773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4cba575-d5ee-411b-88fe-044346f5af7e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:22.079710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4cba575-d5ee-411b-88fe-044346f5af7e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:22.080883 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4cba575-d5ee-411b-88fe-044346f5af7e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:22.082265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4cba575-d5ee-411b-88fe-044346f5af7e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:22.083054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4cba575-d5ee-411b-88fe-044346f5af7e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:22.085358 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4cba575-d5ee-411b-88fe-044346f5af7e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:22.101244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-552a4242-0537-4fc9-a7cc-88e9f88d2018 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] validate_networks() for [('f31895c7-5684-4c76-b257-83071f0edbbd', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:46:22.848664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e4cba575-d5ee-411b-88fe-044346f5af7e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:22.886513 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e4cba575-d5ee-411b-88fe-044346f5af7e tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1507 microversion: 2.1 time: 0.822703 Sep 07 12:46:22.897271 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1696/3369] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:22 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1507 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:22.943184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a5e5a813-5d65-4dee-9b7d-b727a3828ed1 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1320309460"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:46:22.972143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a5e5a813-5d65-4dee-9b7d-b727a3828ed1 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 676e42b4-4985-43cc-892b-176e13b341df] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:22.998025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5e5a813-5d65-4dee-9b7d-b727a3828ed1 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:23.003939 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5e5a813-5d65-4dee-9b7d-b727a3828ed1 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:23.005238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5e5a813-5d65-4dee-9b7d-b727a3828ed1 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:23.006735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5e5a813-5d65-4dee-9b7d-b727a3828ed1 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:23.010788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5e5a813-5d65-4dee-9b7d-b727a3828ed1 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:23.011960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5e5a813-5d65-4dee-9b7d-b727a3828ed1 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:23.798585 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a5e5a813-5d65-4dee-9b7d-b727a3828ed1 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "POST /compute/v2.1/servers/676e42b4-4985-43cc-892b-176e13b341df/action" status: 202 len: 0 microversion: 2.1 time: 0.897912 Sep 07 12:46:23.805216 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1697/3370] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:46:22 2022] POST /compute/v2.1/servers/676e42b4-4985-43cc-892b-176e13b341df/action => generated 0 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 07 12:46:23.821842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0a83f416-68e0-4b17-a0f4-f619f5af7d5c tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:23.843769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0a83f416-68e0-4b17-a0f4-f619f5af7d5c tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62581f838674471fadf9609a3135d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a02ff920d478983e39d3c1bd62b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:23.855850 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0a83f416-68e0-4b17-a0f4-f619f5af7d5c tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Searching by: {'deleted': False, 'project_id': '8d5a02ff920d478983e39d3c1bd62b97'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:46:23.865163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a83f416-68e0-4b17-a0f4-f619f5af7d5c tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:23.866040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a83f416-68e0-4b17-a0f4-f619f5af7d5c tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:23.866692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a83f416-68e0-4b17-a0f4-f619f5af7d5c tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:23.867662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a83f416-68e0-4b17-a0f4-f619f5af7d5c tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:23.870483 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a83f416-68e0-4b17-a0f4-f619f5af7d5c tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:23.871307 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a83f416-68e0-4b17-a0f4-f619f5af7d5c tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:23.937403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-0a83f416-68e0-4b17-a0f4-f619f5af7d5c tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:46:24.046372 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0a83f416-68e0-4b17-a0f4-f619f5af7d5c tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.238737 Sep 07 12:46:24.055323 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1698/3371] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Sep 7 12:46:23 2022] GET /compute/v2.1/servers => generated 334 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:46:24.069343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6f158870-b834-4cb7-95c7-22b8d7ff51b5 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:24.070508 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6f158870-b834-4cb7-95c7-22b8d7ff51b5 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:24.082078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f158870-b834-4cb7-95c7-22b8d7ff51b5 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:24.083179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f158870-b834-4cb7-95c7-22b8d7ff51b5 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:24.084125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f158870-b834-4cb7-95c7-22b8d7ff51b5 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:24.085565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f158870-b834-4cb7-95c7-22b8d7ff51b5 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:24.087578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f158870-b834-4cb7-95c7-22b8d7ff51b5 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:24.088402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f158870-b834-4cb7-95c7-22b8d7ff51b5 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:24.216965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-552a4242-0537-4fc9-a7cc-88e9f88d2018 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:46:24.217524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-552a4242-0537-4fc9-a7cc-88e9f88d2018 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:46:24.217999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-552a4242-0537-4fc9-a7cc-88e9f88d2018 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:46:24.218459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-552a4242-0537-4fc9-a7cc-88e9f88d2018 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:46:24.218884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-552a4242-0537-4fc9-a7cc-88e9f88d2018 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:46:24.262471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-552a4242-0537-4fc9-a7cc-88e9f88d2018 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:24.268022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-552a4242-0537-4fc9-a7cc-88e9f88d2018 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:24.270159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-552a4242-0537-4fc9-a7cc-88e9f88d2018 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:24.278693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-552a4242-0537-4fc9-a7cc-88e9f88d2018 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:24.280430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-552a4242-0537-4fc9-a7cc-88e9f88d2018 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:24.281044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-552a4242-0537-4fc9-a7cc-88e9f88d2018 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:24.365724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-552a4242-0537-4fc9-a7cc-88e9f88d2018 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Getting quotas for project 256a95a81360419dbaf33382dd369262. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:46:24.390757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-552a4242-0537-4fc9-a7cc-88e9f88d2018 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Getting quotas for user a6d92e694e984ad8b126b94ed8effb3f and project 256a95a81360419dbaf33382dd369262. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:46:24.452174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-552a4242-0537-4fc9-a7cc-88e9f88d2018 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:46:24.456445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-552a4242-0537-4fc9-a7cc-88e9f88d2018 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:46:24.530595 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-552a4242-0537-4fc9-a7cc-88e9f88d2018 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.712468 Sep 07 12:46:24.532127 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1674/3372] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:46:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 2715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:46:24.546300 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-042156de-faab-49fc-b785-31eaf46c4810 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4181f4670>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:24.746181 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-042156de-faab-49fc-b785-31eaf46c4810 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/958ebe61-1ee8-4b9d-81e2-ea97e10768ff" status: 200 len: 1455 microversion: 2.1 time: 0.212292 Sep 07 12:46:24.748860 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1675/3373] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:46:24 2022] GET /compute/v2.1/images/958ebe61-1ee8-4b9d-81e2-ea97e10768ff => generated 1455 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:24.772207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-37dd5728-6fa5-492d-9e9a-2407fcc3f035 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:24.773817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-37dd5728-6fa5-492d-9e9a-2407fcc3f035 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:24.794951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37dd5728-6fa5-492d-9e9a-2407fcc3f035 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:24.796698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37dd5728-6fa5-492d-9e9a-2407fcc3f035 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:24.797996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37dd5728-6fa5-492d-9e9a-2407fcc3f035 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:24.801461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37dd5728-6fa5-492d-9e9a-2407fcc3f035 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:24.803564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37dd5728-6fa5-492d-9e9a-2407fcc3f035 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:24.805275 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37dd5728-6fa5-492d-9e9a-2407fcc3f035 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:24.855035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6f158870-b834-4cb7-95c7-22b8d7ff51b5 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:24.897158 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6f158870-b834-4cb7-95c7-22b8d7ff51b5 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1515 microversion: 2.1 time: 0.839930 Sep 07 12:46:24.912111 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1699/3374] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:24 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1515 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:24.969848 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1ef0bf32-6a89-4640-9473-00fd335bba25 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:25.003163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1ef0bf32-6a89-4640-9473-00fd335bba25 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62581f838674471fadf9609a3135d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a02ff920d478983e39d3c1bd62b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:25.004446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1ef0bf32-6a89-4640-9473-00fd335bba25 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Searching by: {'deleted': False, 'project_id': '8d5a02ff920d478983e39d3c1bd62b97'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:46:25.022795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ef0bf32-6a89-4640-9473-00fd335bba25 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:25.023650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ef0bf32-6a89-4640-9473-00fd335bba25 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:25.040490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ef0bf32-6a89-4640-9473-00fd335bba25 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:25.041853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ef0bf32-6a89-4640-9473-00fd335bba25 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:25.042724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ef0bf32-6a89-4640-9473-00fd335bba25 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:25.043519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ef0bf32-6a89-4640-9473-00fd335bba25 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:25.145819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-1ef0bf32-6a89-4640-9473-00fd335bba25 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:46:25.366537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1ef0bf32-6a89-4640-9473-00fd335bba25 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62581f838674471fadf9609a3135d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a02ff920d478983e39d3c1bd62b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:25.414580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ef0bf32-6a89-4640-9473-00fd335bba25 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:25.415471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ef0bf32-6a89-4640-9473-00fd335bba25 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:25.417807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ef0bf32-6a89-4640-9473-00fd335bba25 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:25.927189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37dd5728-6fa5-492d-9e9a-2407fcc3f035 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:25.954917 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-37dd5728-6fa5-492d-9e9a-2407fcc3f035 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1507 microversion: 2.1 time: 1.203681 Sep 07 12:46:25.957432 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1676/3375] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:24 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1507 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:25.969598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a50f74ec-7312-4a10-925e-e32c05ec2e0e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:25.970637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a50f74ec-7312-4a10-925e-e32c05ec2e0e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:26.179436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a50f74ec-7312-4a10-925e-e32c05ec2e0e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:26.183795 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1ef0bf32-6a89-4640-9473-00fd335bba25 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 1.268807 Sep 07 12:46:26.185195 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1700/3376] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:46:24 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:26.209629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-171e8e0d-d22d-44f8-b51e-e6e6541c36e5 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc418bee820>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:26.241694 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a50f74ec-7312-4a10-925e-e32c05ec2e0e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e" status: 200 len: 1222 microversion: 2.1 time: 0.279067 Sep 07 12:46:26.258296 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1677/3377] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:25 2022] GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e => generated 1222 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:26.282592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6d7e3510-c9bb-428e-b373-3a7ad92f3215 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:26.283924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6d7e3510-c9bb-428e-b373-3a7ad92f3215 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:26.315357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d7e3510-c9bb-428e-b373-3a7ad92f3215 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:26.316182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d7e3510-c9bb-428e-b373-3a7ad92f3215 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:26.316948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d7e3510-c9bb-428e-b373-3a7ad92f3215 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:26.323716 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-171e8e0d-d22d-44f8-b51e-e6e6541c36e5 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/958ebe61-1ee8-4b9d-81e2-ea97e10768ff" status: 200 len: 1455 microversion: 2.1 time: 0.136904 Sep 07 12:46:26.326991 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1701/3378] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:46:26 2022] GET /compute/v2.1/images/958ebe61-1ee8-4b9d-81e2-ea97e10768ff => generated 1455 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:26.330824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d7e3510-c9bb-428e-b373-3a7ad92f3215 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:26.331845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d7e3510-c9bb-428e-b373-3a7ad92f3215 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:26.332581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d7e3510-c9bb-428e-b373-3a7ad92f3215 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:26.346659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6e0a7958-915d-4ea8-b850-b052c9296418 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:26.376201 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6e0a7958-915d-4ea8-b850-b052c9296418 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.046371 Sep 07 12:46:26.379807 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1702/3379] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:46:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:46:26.984627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9cc7a195-9ebf-4bb7-bab1-6e5612dcc49f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:26.985715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9cc7a195-9ebf-4bb7-bab1-6e5612dcc49f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:27.003240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cc7a195-9ebf-4bb7-bab1-6e5612dcc49f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:27.019928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cc7a195-9ebf-4bb7-bab1-6e5612dcc49f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:27.032020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cc7a195-9ebf-4bb7-bab1-6e5612dcc49f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:27.033305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cc7a195-9ebf-4bb7-bab1-6e5612dcc49f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:27.035413 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cc7a195-9ebf-4bb7-bab1-6e5612dcc49f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:27.036191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cc7a195-9ebf-4bb7-bab1-6e5612dcc49f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:28.467611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9cc7a195-9ebf-4bb7-bab1-6e5612dcc49f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:28.507802 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9cc7a195-9ebf-4bb7-bab1-6e5612dcc49f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1507 microversion: 2.1 time: 1.527007 Sep 07 12:46:28.508851 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1703/3380] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:26 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1507 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:28.559797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6d7e3510-c9bb-428e-b373-3a7ad92f3215 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:28.592198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7628f4d2-e9fc-46c9-94dd-12c233a5efc8 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:28.593153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7628f4d2-e9fc-46c9-94dd-12c233a5efc8 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] [instance: 87931dc7-3c20-4661-8653-972aacfec19e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:28.597315 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6d7e3510-c9bb-428e-b373-3a7ad92f3215 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1515 microversion: 2.1 time: 2.336924 Sep 07 12:46:28.602398 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1678/3381] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:26 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1515 bytes in 2344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:28.641371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d3ad09bc-d0c8-42fd-b3fb-53281aba2531 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:28.648034 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7628f4d2-e9fc-46c9-94dd-12c233a5efc8 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:28.648948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7628f4d2-e9fc-46c9-94dd-12c233a5efc8 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:28.649779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7628f4d2-e9fc-46c9-94dd-12c233a5efc8 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:28.651117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7628f4d2-e9fc-46c9-94dd-12c233a5efc8 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:28.651962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7628f4d2-e9fc-46c9-94dd-12c233a5efc8 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:28.652872 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7628f4d2-e9fc-46c9-94dd-12c233a5efc8 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:28.662134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d3ad09bc-d0c8-42fd-b3fb-53281aba2531 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:28.703277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3ad09bc-d0c8-42fd-b3fb-53281aba2531 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:28.704126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3ad09bc-d0c8-42fd-b3fb-53281aba2531 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:28.704913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3ad09bc-d0c8-42fd-b3fb-53281aba2531 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:28.706261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3ad09bc-d0c8-42fd-b3fb-53281aba2531 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:28.726328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3ad09bc-d0c8-42fd-b3fb-53281aba2531 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:28.727277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3ad09bc-d0c8-42fd-b3fb-53281aba2531 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:28.918884 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7628f4d2-e9fc-46c9-94dd-12c233a5efc8 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] [instance: 87931dc7-3c20-4661-8653-972aacfec19e] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:46:29.107643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:46:29.394356 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7628f4d2-e9fc-46c9-94dd-12c233a5efc8 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] 10.222.0.16 "DELETE /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e" status: 204 len: 0 microversion: 2.1 time: 0.830432 Sep 07 12:46:29.395604 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1704/3382] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:46:28 2022] DELETE /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e => generated 0 bytes in 886 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:46:29.406711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bcd18fe3-a2d5-4880-9129-7af7f7599930 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc418a17a60>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:29.510769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d3ad09bc-d0c8-42fd-b3fb-53281aba2531 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:29.556581 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d3ad09bc-d0c8-42fd-b3fb-53281aba2531 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e" status: 200 len: 1292 microversion: 2.1 time: 0.952166 Sep 07 12:46:29.560075 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1679/3383] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:28 2022] GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e => generated 1292 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:29.614936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-016247c7-ee3a-4195-bcd0-c6726280e485 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Action: 'create', calling method: .version_select at 0x7fc4181f41f0>, body: {"keypair": {"name": "tempest-keypair-617594435", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsf5cdWBRf8ixmhJYQInwQSnhORixoRw3LlPF7Xcy80wl8QyeHzzI96HMmhbgIzezRh8JJl18jd5DBijfaIXGypZ6p54+t3INHl7CXPHx6W0vo9iXf0zj9eawWWa9YcfA=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:46:29.666654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-016247c7-ee3a-4195-bcd0-c6726280e485 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Getting quotas for project 9a0713651a514386bcf37ee6cc3d8e2f. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:46:29.689236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-016247c7-ee3a-4195-bcd0-c6726280e485 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Getting quotas for user 3ca81088a7ce4c3fafc90d36c07711ff and project 9a0713651a514386bcf37ee6cc3d8e2f. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:46:29.764108 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-016247c7-ee3a-4195-bcd0-c6726280e485 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.164615 Sep 07 12:46:29.765634 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1680/3384] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Sep 7 12:46:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 168 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 12:46:29.792569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3f9a31f4-c0a4-4c88-9ba2-e2dadec1fbd5 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:29.796967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3f9a31f4-c0a4-4c88-9ba2-e2dadec1fbd5 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] [instance: 87931dc7-3c20-4661-8653-972aacfec19e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:29.830718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f9a31f4-c0a4-4c88-9ba2-e2dadec1fbd5 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:29.831784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f9a31f4-c0a4-4c88-9ba2-e2dadec1fbd5 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:29.832802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f9a31f4-c0a4-4c88-9ba2-e2dadec1fbd5 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:29.842223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f9a31f4-c0a4-4c88-9ba2-e2dadec1fbd5 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:29.843464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f9a31f4-c0a4-4c88-9ba2-e2dadec1fbd5 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:29.844421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f9a31f4-c0a4-4c88-9ba2-e2dadec1fbd5 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:30.058042 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bcd18fe3-a2d5-4880-9129-7af7f7599930 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/958ebe61-1ee8-4b9d-81e2-ea97e10768ff" status: 200 len: 1455 microversion: 2.1 time: 0.658898 Sep 07 12:46:30.058818 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1705/3385] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:46:29 2022] GET /compute/v2.1/images/958ebe61-1ee8-4b9d-81e2-ea97e10768ff => generated 1455 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:30.108366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aae6454c-e37e-4629-b074-941fc46fae2a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:30.110123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aae6454c-e37e-4629-b074-941fc46fae2a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:30.123302 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aae6454c-e37e-4629-b074-941fc46fae2a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:30.127371 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aae6454c-e37e-4629-b074-941fc46fae2a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:30.128798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aae6454c-e37e-4629-b074-941fc46fae2a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:30.129826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aae6454c-e37e-4629-b074-941fc46fae2a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:30.138203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aae6454c-e37e-4629-b074-941fc46fae2a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:30.138980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aae6454c-e37e-4629-b074-941fc46fae2a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:31.107779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3f9a31f4-c0a4-4c88-9ba2-e2dadec1fbd5 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62581f838674471fadf9609a3135d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a02ff920d478983e39d3c1bd62b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:31.123809 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3f9a31f4-c0a4-4c88-9ba2-e2dadec1fbd5 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] 10.222.0.16 "GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e" status: 200 len: 1701 microversion: 2.1 time: 1.356425 Sep 07 12:46:31.138296 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1681/3386] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:29 2022] GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e => generated 1701 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:31.150383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cce63bbe-57d8-4e0d-b1cb-0db1f3ed4b09 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:31.151016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cce63bbe-57d8-4e0d-b1cb-0db1f3ed4b09 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:31.174458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cce63bbe-57d8-4e0d-b1cb-0db1f3ed4b09 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:31.175880 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cce63bbe-57d8-4e0d-b1cb-0db1f3ed4b09 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:31.176992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cce63bbe-57d8-4e0d-b1cb-0db1f3ed4b09 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:31.178713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cce63bbe-57d8-4e0d-b1cb-0db1f3ed4b09 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:31.181227 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cce63bbe-57d8-4e0d-b1cb-0db1f3ed4b09 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:31.182743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cce63bbe-57d8-4e0d-b1cb-0db1f3ed4b09 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:31.858608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aae6454c-e37e-4629-b074-941fc46fae2a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:31.873975 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aae6454c-e37e-4629-b074-941fc46fae2a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1507 microversion: 2.1 time: 1.799474 Sep 07 12:46:31.877312 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1706/3387] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:30 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1507 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:31.896648 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e2b39977-c6a4-4172-a138-15ab3aa67d4c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:31.897451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e2b39977-c6a4-4172-a138-15ab3aa67d4c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:31.935640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2b39977-c6a4-4172-a138-15ab3aa67d4c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:31.936354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2b39977-c6a4-4172-a138-15ab3aa67d4c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:31.938891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2b39977-c6a4-4172-a138-15ab3aa67d4c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:31.944334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2b39977-c6a4-4172-a138-15ab3aa67d4c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:31.944853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2b39977-c6a4-4172-a138-15ab3aa67d4c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:31.945315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2b39977-c6a4-4172-a138-15ab3aa67d4c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:34.310103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:46:34.331154 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cce63bbe-57d8-4e0d-b1cb-0db1f3ed4b09 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:34.357841 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cce63bbe-57d8-4e0d-b1cb-0db1f3ed4b09 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1515 microversion: 2.1 time: 3.218196 Sep 07 12:46:34.379321 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1682/3388] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:31 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1515 bytes in 3240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:34.382777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e2b39977-c6a4-4172-a138-15ab3aa67d4c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:34.397025 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e2b39977-c6a4-4172-a138-15ab3aa67d4c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e" status: 200 len: 1322 microversion: 2.1 time: 2.517783 Sep 07 12:46:34.401966 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1707/3389] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:31 2022] GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e => generated 1322 bytes in 2524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:34.414482 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-61072661-0653-4817-8433-d51dbd594228 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:34.415516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-61072661-0653-4817-8433-d51dbd594228 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] [instance: 87931dc7-3c20-4661-8653-972aacfec19e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:34.418688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-80adeb9b-1076-46d0-98d7-97e0cc6a257a tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc418128700>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:34.440728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61072661-0653-4817-8433-d51dbd594228 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:34.443824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61072661-0653-4817-8433-d51dbd594228 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:34.444552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61072661-0653-4817-8433-d51dbd594228 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:34.445894 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61072661-0653-4817-8433-d51dbd594228 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:34.446728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61072661-0653-4817-8433-d51dbd594228 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:34.447392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61072661-0653-4817-8433-d51dbd594228 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:35.091759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:46:35.332255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:46:36.679455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-61072661-0653-4817-8433-d51dbd594228 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62581f838674471fadf9609a3135d4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a02ff920d478983e39d3c1bd62b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:36.709085 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-61072661-0653-4817-8433-d51dbd594228 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] 10.222.0.16 "GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e" status: 200 len: 1701 microversion: 2.1 time: 2.304418 Sep 07 12:46:36.710130 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1708/3390] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:34 2022] GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e => generated 1701 bytes in 2307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:36.729778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e5fb1f32-c764-4f0e-ae29-5acdd1100b3d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:36.731830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e5fb1f32-c764-4f0e-ae29-5acdd1100b3d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:36.750316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5fb1f32-c764-4f0e-ae29-5acdd1100b3d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:36.752125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5fb1f32-c764-4f0e-ae29-5acdd1100b3d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:36.757439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5fb1f32-c764-4f0e-ae29-5acdd1100b3d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:36.759438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5fb1f32-c764-4f0e-ae29-5acdd1100b3d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:36.760181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5fb1f32-c764-4f0e-ae29-5acdd1100b3d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:36.760742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5fb1f32-c764-4f0e-ae29-5acdd1100b3d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:38.042993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e5fb1f32-c764-4f0e-ae29-5acdd1100b3d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:38.102750 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e5fb1f32-c764-4f0e-ae29-5acdd1100b3d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1487 microversion: 2.1 time: 1.390576 Sep 07 12:46:38.151043 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1709/3391] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:36 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1487 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:38.198698 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-01d2f96f-2a51-4309-9548-1c6dffd55015 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:38.202198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-01d2f96f-2a51-4309-9548-1c6dffd55015 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:38.267013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01d2f96f-2a51-4309-9548-1c6dffd55015 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:38.277816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01d2f96f-2a51-4309-9548-1c6dffd55015 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:38.279432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01d2f96f-2a51-4309-9548-1c6dffd55015 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:38.283152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01d2f96f-2a51-4309-9548-1c6dffd55015 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:38.285322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01d2f96f-2a51-4309-9548-1c6dffd55015 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:38.290648 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01d2f96f-2a51-4309-9548-1c6dffd55015 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:39.707944 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=14 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:46:40.087914 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-01d2f96f-2a51-4309-9548-1c6dffd55015 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:40.099948 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-01d2f96f-2a51-4309-9548-1c6dffd55015 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1521 microversion: 2.1 time: 1.946771 Sep 07 12:46:40.115235 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1710/3392] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:38 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1521 bytes in 1951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:40.115235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8454addf-d588-44a4-9431-5c2f8f3d2d9f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:40.115235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8454addf-d588-44a4-9431-5c2f8f3d2d9f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:40.132741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8454addf-d588-44a4-9431-5c2f8f3d2d9f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:40.136438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8454addf-d588-44a4-9431-5c2f8f3d2d9f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:40.136874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8454addf-d588-44a4-9431-5c2f8f3d2d9f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:40.137796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8454addf-d588-44a4-9431-5c2f8f3d2d9f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:40.140478 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8454addf-d588-44a4-9431-5c2f8f3d2d9f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:40.142108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8454addf-d588-44a4-9431-5c2f8f3d2d9f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:41.167542 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:46:41.503805 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8454addf-d588-44a4-9431-5c2f8f3d2d9f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:41.543395 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8454addf-d588-44a4-9431-5c2f8f3d2d9f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e" status: 200 len: 1322 microversion: 2.1 time: 1.421270 Sep 07 12:46:41.560605 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1711/3393] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:40 2022] GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e => generated 1322 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:41.616039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-56236593-b0ee-4c2a-a422-527f89fd2dbd tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1911234503", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "703490ac-af73-4666-b0b1-235c0744d5d7"}, {"port": "d4ebc424-f0c8-485e-a625-d0d51830190e", "tag": "port-1"}, {"port": "ff4033b6-7d47-4ed1-9c26-6cc0e709c6e8", "tag": "port-2"}, {"uuid": "a843d80b-3841-48c1-9a28-d8cab40dc91e", "tag": "net-1"}, {"uuid": "a843d80b-3841-48c1-9a28-d8cab40dc91e"}, {"uuid": "f1afa6b4-f3ff-4bd6-9363-016280dbdc17", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "f1afa6b4-f3ff-4bd6-9363-016280dbdc17", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "3656e6ad-d5cf-43d0-ac24-770406a0fe87", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "e6c65479-6976-499b-94fa-c05087e18c56", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "593494a7-6b35-496c-a60d-6de39f1a9bea", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1090099101"}], "key_name": "tempest-keypair-617594435", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:46:44.370159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=51 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:46:50.314816 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-80adeb9b-1076-46d0-98d7-97e0cc6a257a tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/958ebe61-1ee8-4b9d-81e2-ea97e10768ff" status: 200 len: 1455 microversion: 2.1 time: 15.933795 Sep 07 12:46:50.318952 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1683/3394] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:46:34 2022] GET /compute/v2.1/images/958ebe61-1ee8-4b9d-81e2-ea97e10768ff => generated 1455 bytes in 15939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:50.329613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-8f580635-1f0d-493c-83d3-eca9859d8131 req-c10b4fd5-0eb3-4429-a0f9-e88999e01bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "676e42b4-4985-43cc-892b-176e13b341df", "name": "network-vif-plugged", "status": "completed", "tag": "8973b130-dd43-4a93-b14e-3d7f5131cd14"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:46:50.352974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8f580635-1f0d-493c-83d3-eca9859d8131 req-c10b4fd5-0eb3-4429-a0f9-e88999e01bd8 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:50.354486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8f580635-1f0d-493c-83d3-eca9859d8131 req-c10b4fd5-0eb3-4429-a0f9-e88999e01bd8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:50.355885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8f580635-1f0d-493c-83d3-eca9859d8131 req-c10b4fd5-0eb3-4429-a0f9-e88999e01bd8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:50.389128 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-8f580635-1f0d-493c-83d3-eca9859d8131 req-c10b4fd5-0eb3-4429-a0f9-e88999e01bd8 service nova] Creating event network-vif-plugged:8973b130-dd43-4a93-b14e-3d7f5131cd14 for instance 676e42b4-4985-43cc-892b-176e13b341df on n-h2-852087-9 Sep 07 12:46:50.403619 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-8f580635-1f0d-493c-83d3-eca9859d8131 req-c10b4fd5-0eb3-4429-a0f9-e88999e01bd8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081755 Sep 07 12:46:50.405196 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1684/3395] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:46:50.408670 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-56236593-b0ee-4c2a-a422-527f89fd2dbd tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] validate_networks() for [('703490ac-af73-4666-b0b1-235c0744d5d7', None, None, None, None, None), (None, None, 'd4ebc424-f0c8-485e-a625-d0d51830190e', None, None, None), (None, None, 'ff4033b6-7d47-4ed1-9c26-6cc0e709c6e8', None, None, None), ('a843d80b-3841-48c1-9a28-d8cab40dc91e', None, None, None, None, None), ('a843d80b-3841-48c1-9a28-d8cab40dc91e', None, None, None, None, None), ('f1afa6b4-f3ff-4bd6-9363-016280dbdc17', '10.2.2.100', None, None, None, None), ('f1afa6b4-f3ff-4bd6-9363-016280dbdc17', '10.2.2.200', None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:46:50.416363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-910bd7c9-dc27-479b-aa94-3663ac579ae0 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:50.418664 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-910bd7c9-dc27-479b-aa94-3663ac579ae0 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] [instance: 87931dc7-3c20-4661-8653-972aacfec19e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:50.432047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910bd7c9-dc27-479b-aa94-3663ac579ae0 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:50.433624 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910bd7c9-dc27-479b-aa94-3663ac579ae0 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:50.437153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910bd7c9-dc27-479b-aa94-3663ac579ae0 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:50.439003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910bd7c9-dc27-479b-aa94-3663ac579ae0 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:50.440158 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910bd7c9-dc27-479b-aa94-3663ac579ae0 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:50.441097 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910bd7c9-dc27-479b-aa94-3663ac579ae0 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:50.472597 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-910bd7c9-dc27-479b-aa94-3663ac579ae0 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] HTTP exception thrown: Instance 87931dc7-3c20-4661-8653-972aacfec19e could not be found. Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-910bd7c9-dc27-479b-aa94-3663ac579ae0 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Request method failure captured: Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e HTTP/1.1 Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJJJQ5w-hhtXQQZvjZ3Rceovg4QenU-fqHOP1TkRo4sFZJRjNdkC4zcqit6dsIs25GVyYJey16mg60I8wz_mL2r9jgH1b2H9Cy4ZyDG4LqWnu7H7_5YZghXhZjwDbXTCcNqA4rzcHqJ0-FGQBAB1XTEOyod4B6B1viu6XFgqNz1WHg8 Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8d5a02ff920d478983e39d3c1bd62b97 Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestJSON-717218240 Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8d5a02ff920d478983e39d3c1bd62b97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8d5a02ff920d478983e39d3c1bd62b97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8d5a02ff920d478983e39d3c1bd62b97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8d5a02ff920d478983e39d3c1bd62b97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestJSON-717218240 Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8d5a02ff920d478983e39d3c1bd62b97 Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestJSON-717218240 Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersTestJSON-717218240-project Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 62581f838674471fadf9609a3135d4b2 Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestJSON-717218240-project Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 87931dc7-3c20-4661-8653-972aacfec19e could not be found. Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '87931dc7-3c20-4661-8653-972aacfec19e'} Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87931dc7-3c20-4661-8653-972aacfec19e could not be found. Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87931dc7-3c20-4661-8653-972aacfec19e could not be found. Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:46:50.476351 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:46:50.488867 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:46:50.488867 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:46:50.488867 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:46:50.488867 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:46:50.488867 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87931dc7-3c20-4661-8653-972aacfec19e could not be found. Sep 07 12:46:50.488867 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:46:50.488867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-910bd7c9-dc27-479b-aa94-3663ac579ae0 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Returning 404 to user: Instance 87931dc7-3c20-4661-8653-972aacfec19e could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:46:50.488867 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-910bd7c9-dc27-479b-aa94-3663ac579ae0 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] 10.222.0.16 "GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e" status: 404 len: 111 microversion: 2.1 time: 0.072554 Sep 07 12:46:50.488867 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1685/3396] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:50 2022] GET /compute/v2.1/servers/87931dc7-3c20-4661-8653-972aacfec19e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:46:50.491913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dfc3c0aa-ab0a-46c1-8f7d-0a2c8fe002ac tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:46:50.491913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dfc3c0aa-ab0a-46c1-8f7d-0a2c8fe002ac tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:50.501293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfc3c0aa-ab0a-46c1-8f7d-0a2c8fe002ac tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:50.502272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfc3c0aa-ab0a-46c1-8f7d-0a2c8fe002ac tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:50.502737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfc3c0aa-ab0a-46c1-8f7d-0a2c8fe002ac tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:50.504205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfc3c0aa-ab0a-46c1-8f7d-0a2c8fe002ac tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:50.504741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfc3c0aa-ab0a-46c1-8f7d-0a2c8fe002ac tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:50.505331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dfc3c0aa-ab0a-46c1-8f7d-0a2c8fe002ac tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:50.605844 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dfc3c0aa-ab0a-46c1-8f7d-0a2c8fe002ac tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "POST /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71/action" status: 202 len: 0 microversion: 2.1 time: 0.124222 Sep 07 12:46:50.607318 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1686/3397] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:46:50 2022] POST /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:46:50.613996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c0154496-3df2-4eab-a56e-d5eb6c8c95bf req-1ce3a60a-c33a-4def-a258-2ac534c11641 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2c8a9c1-51cc-4b6c-9b68-6ec76021310e", "tag": "6472e7b8-dd8f-4bc2-98be-2d89ad9c1aa6"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:46:50.632673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c0154496-3df2-4eab-a56e-d5eb6c8c95bf req-1ce3a60a-c33a-4def-a258-2ac534c11641 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:50.633194 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c0154496-3df2-4eab-a56e-d5eb6c8c95bf req-1ce3a60a-c33a-4def-a258-2ac534c11641 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:50.633683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c0154496-3df2-4eab-a56e-d5eb6c8c95bf req-1ce3a60a-c33a-4def-a258-2ac534c11641 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:50.655490 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c0154496-3df2-4eab-a56e-d5eb6c8c95bf req-1ce3a60a-c33a-4def-a258-2ac534c11641 service nova] Creating event network-changed:6472e7b8-dd8f-4bc2-98be-2d89ad9c1aa6 for instance f2c8a9c1-51cc-4b6c-9b68-6ec76021310e on n-h2-852087-9 Sep 07 12:46:50.668251 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c0154496-3df2-4eab-a56e-d5eb6c8c95bf req-1ce3a60a-c33a-4def-a258-2ac534c11641 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058788 Sep 07 12:46:50.669218 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1687/3398] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:46:50.914905 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-04f9cfea-e142-40c3-918f-c908cd5d3903 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1636693500", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "17b2eb87-adef-4c9e-9384-06a7a60703da"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:46:51.094514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-04f9cfea-e142-40c3-918f-c908cd5d3903 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] validate_networks() for [('17b2eb87-adef-4c9e-9384-06a7a60703da', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:46:51.517204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=40,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:46:51.764521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:46:53.002665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-04f9cfea-e142-40c3-918f-c908cd5d3903 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:46:53.005850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-04f9cfea-e142-40c3-918f-c908cd5d3903 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:46:53.007018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-04f9cfea-e142-40c3-918f-c908cd5d3903 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:46:53.008097 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-04f9cfea-e142-40c3-918f-c908cd5d3903 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:46:53.008952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-04f9cfea-e142-40c3-918f-c908cd5d3903 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:46:53.026850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04f9cfea-e142-40c3-918f-c908cd5d3903 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:53.028169 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04f9cfea-e142-40c3-918f-c908cd5d3903 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:53.029224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04f9cfea-e142-40c3-918f-c908cd5d3903 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:53.031155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04f9cfea-e142-40c3-918f-c908cd5d3903 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:53.032146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04f9cfea-e142-40c3-918f-c908cd5d3903 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:53.033086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04f9cfea-e142-40c3-918f-c908cd5d3903 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:53.070136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-04f9cfea-e142-40c3-918f-c908cd5d3903 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Getting quotas for project 6b3ae4d905a7493289a242cc9ce5a051. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:46:53.084956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-04f9cfea-e142-40c3-918f-c908cd5d3903 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Getting quotas for user 6902480075db4d7bb4be2306197cfbc0 and project 6b3ae4d905a7493289a242cc9ce5a051. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:46:53.111670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-04f9cfea-e142-40c3-918f-c908cd5d3903 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:46:53.115319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-04f9cfea-e142-40c3-918f-c908cd5d3903 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] [instance: d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:46:53.182094 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-04f9cfea-e142-40c3-918f-c908cd5d3903 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.511076 Sep 07 12:46:53.183638 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1688/3399] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:46:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:46:53.193136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1491b924-9910-48c9-a2a7-dad770935796 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:53.194268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1491b924-9910-48c9-a2a7-dad770935796 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:53.210136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1491b924-9910-48c9-a2a7-dad770935796 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:53.211067 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1491b924-9910-48c9-a2a7-dad770935796 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:53.211858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1491b924-9910-48c9-a2a7-dad770935796 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:53.213378 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1491b924-9910-48c9-a2a7-dad770935796 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:53.214245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1491b924-9910-48c9-a2a7-dad770935796 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:53.215964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1491b924-9910-48c9-a2a7-dad770935796 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:53.563727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1491b924-9910-48c9-a2a7-dad770935796 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:53.580385 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1491b924-9910-48c9-a2a7-dad770935796 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1521 microversion: 2.1 time: 0.394820 Sep 07 12:46:53.581875 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1689/3400] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:53 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:53.591764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6860fef0-5af1-4354-bcd2-62b7feefc8b8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:53.593435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6860fef0-5af1-4354-bcd2-62b7feefc8b8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:53.605266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6860fef0-5af1-4354-bcd2-62b7feefc8b8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:53.606251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6860fef0-5af1-4354-bcd2-62b7feefc8b8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:53.606981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6860fef0-5af1-4354-bcd2-62b7feefc8b8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:53.608956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6860fef0-5af1-4354-bcd2-62b7feefc8b8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:53.609864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6860fef0-5af1-4354-bcd2-62b7feefc8b8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:53.610999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6860fef0-5af1-4354-bcd2-62b7feefc8b8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:53.939210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6860fef0-5af1-4354-bcd2-62b7feefc8b8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:53.948787 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6860fef0-5af1-4354-bcd2-62b7feefc8b8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e" status: 200 len: 1322 microversion: 2.1 time: 0.364734 Sep 07 12:46:53.950093 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1690/3401] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:53 2022] GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e => generated 1322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:53.955735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b076d4c8-3d96-4a77-8d83-d938665abede tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:53.956363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b076d4c8-3d96-4a77-8d83-d938665abede tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:53.974555 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b076d4c8-3d96-4a77-8d83-d938665abede tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:53.976120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b076d4c8-3d96-4a77-8d83-d938665abede tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:53.977320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b076d4c8-3d96-4a77-8d83-d938665abede tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:53.978863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b076d4c8-3d96-4a77-8d83-d938665abede tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:53.979996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b076d4c8-3d96-4a77-8d83-d938665abede tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:53.980776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b076d4c8-3d96-4a77-8d83-d938665abede tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:54.296230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b076d4c8-3d96-4a77-8d83-d938665abede tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:54.309277 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b076d4c8-3d96-4a77-8d83-d938665abede tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.357661 Sep 07 12:46:54.310229 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1691/3402] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:53 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:54.318740 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-831bd1d0-5dd3-4ee0-b701-a9ec2418e2c4 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] Calling method '.version_select at 0x7fc4180f7e50>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:54.346052 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-831bd1d0-5dd3-4ee0-b701-a9ec2418e2c4 tempest-ServersTestJSON-717218240 tempest-ServersTestJSON-717218240-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1054873302" status: 202 len: 0 microversion: 2.1 time: 0.033915 Sep 07 12:46:54.352345 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1692/3403] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Sep 7 12:46:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1054873302 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:46:54.364190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d97d85cd-da2a-40ff-9e13-07bf412bda86 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:54.366105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d97d85cd-da2a-40ff-9e13-07bf412bda86 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:54.380117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d97d85cd-da2a-40ff-9e13-07bf412bda86 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:54.380963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d97d85cd-da2a-40ff-9e13-07bf412bda86 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:54.381719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d97d85cd-da2a-40ff-9e13-07bf412bda86 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:54.383364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d97d85cd-da2a-40ff-9e13-07bf412bda86 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:54.384225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d97d85cd-da2a-40ff-9e13-07bf412bda86 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:54.385221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d97d85cd-da2a-40ff-9e13-07bf412bda86 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:54.695072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d97d85cd-da2a-40ff-9e13-07bf412bda86 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:54.712881 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d97d85cd-da2a-40ff-9e13-07bf412bda86 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1495 microversion: 2.1 time: 0.356916 Sep 07 12:46:54.714830 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1693/3404] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:54 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1495 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:54.726840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-28cd4a54-6817-4da3-adb1-2189cc9f4935 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4181e30d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:54.839863 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-28cd4a54-6817-4da3-adb1-2189cc9f4935 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/958ebe61-1ee8-4b9d-81e2-ea97e10768ff" status: 200 len: 1464 microversion: 2.1 time: 0.122330 Sep 07 12:46:54.870593 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1694/3405] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:46:54 2022] GET /compute/v2.1/images/958ebe61-1ee8-4b9d-81e2-ea97e10768ff => generated 1464 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:54.882615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-95bc00a1-2e0f-4b5e-b7c4-0ce6b508baaf req-e9fe3ef0-5c10-4e0e-a2d3-804017372004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc8c812d-29e5-4153-a609-74814c3e7c86", "name": "network-vif-plugged", "status": "completed", "tag": "793646ba-5b13-4cdc-afbf-a554b83f8b18"}, {"server_uuid": "f2c8a9c1-51cc-4b6c-9b68-6ec76021310e", "name": "network-vif-plugged", "status": "completed", "tag": "6472e7b8-dd8f-4bc2-98be-2d89ad9c1aa6"}, {"server_uuid": "8425f313-f6b3-462f-92d7-8803be5ff8f2", "name": "network-vif-plugged", "status": "completed", "tag": "b1e3f8b5-9eca-480a-8b03-6f52f4a3fc53"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:46:54.906763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-95bc00a1-2e0f-4b5e-b7c4-0ce6b508baaf req-e9fe3ef0-5c10-4e0e-a2d3-804017372004 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:54.908136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-95bc00a1-2e0f-4b5e-b7c4-0ce6b508baaf req-e9fe3ef0-5c10-4e0e-a2d3-804017372004 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:54.909312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-95bc00a1-2e0f-4b5e-b7c4-0ce6b508baaf req-e9fe3ef0-5c10-4e0e-a2d3-804017372004 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:54.942832 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-95bc00a1-2e0f-4b5e-b7c4-0ce6b508baaf req-e9fe3ef0-5c10-4e0e-a2d3-804017372004 service nova] Creating event network-vif-plugged:793646ba-5b13-4cdc-afbf-a554b83f8b18 for instance dc8c812d-29e5-4153-a609-74814c3e7c86 on n-h2-852087-9 Sep 07 12:46:54.943706 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-95bc00a1-2e0f-4b5e-b7c4-0ce6b508baaf req-e9fe3ef0-5c10-4e0e-a2d3-804017372004 service nova] Creating event network-vif-plugged:6472e7b8-dd8f-4bc2-98be-2d89ad9c1aa6 for instance f2c8a9c1-51cc-4b6c-9b68-6ec76021310e on n-h2-852087-9 Sep 07 12:46:54.944960 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-95bc00a1-2e0f-4b5e-b7c4-0ce6b508baaf req-e9fe3ef0-5c10-4e0e-a2d3-804017372004 service nova] Creating event network-vif-plugged:b1e3f8b5-9eca-480a-8b03-6f52f4a3fc53 for instance 8425f313-f6b3-462f-92d7-8803be5ff8f2 on n-h1-852087-9 Sep 07 12:46:54.966462 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-95bc00a1-2e0f-4b5e-b7c4-0ce6b508baaf req-e9fe3ef0-5c10-4e0e-a2d3-804017372004 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.093399 Sep 07 12:46:54.968111 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1695/3406] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:46:54.982097 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-854cc2a8-f1c5-47b2-92cf-5d20badf3671 req-e4c1dba2-8a8d-4ef8-888e-44dc51deff03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87931dc7-3c20-4661-8653-972aacfec19e", "name": "network-vif-deleted", "tag": "0aff791e-d1d3-4633-893c-be6e34af3651"}, {"name": "network-changed", "server_uuid": "8425f313-f6b3-462f-92d7-8803be5ff8f2", "tag": "b1e3f8b5-9eca-480a-8b03-6f52f4a3fc53"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:46:55.007081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-854cc2a8-f1c5-47b2-92cf-5d20badf3671 req-e4c1dba2-8a8d-4ef8-888e-44dc51deff03 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:55.007962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-854cc2a8-f1c5-47b2-92cf-5d20badf3671 req-e4c1dba2-8a8d-4ef8-888e-44dc51deff03 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:55.008769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-854cc2a8-f1c5-47b2-92cf-5d20badf3671 req-e4c1dba2-8a8d-4ef8-888e-44dc51deff03 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:55.032058 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-854cc2a8-f1c5-47b2-92cf-5d20badf3671 req-e4c1dba2-8a8d-4ef8-888e-44dc51deff03 service nova] Creating event network-vif-deleted:0aff791e-d1d3-4633-893c-be6e34af3651 for instance 87931dc7-3c20-4661-8653-972aacfec19e on n-h2-852087-9 Sep 07 12:46:55.032954 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-854cc2a8-f1c5-47b2-92cf-5d20badf3671 req-e4c1dba2-8a8d-4ef8-888e-44dc51deff03 service nova] Creating event network-changed:b1e3f8b5-9eca-480a-8b03-6f52f4a3fc53 for instance 8425f313-f6b3-462f-92d7-8803be5ff8f2 on n-h1-852087-9 Sep 07 12:46:55.048625 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-854cc2a8-f1c5-47b2-92cf-5d20badf3671 req-e4c1dba2-8a8d-4ef8-888e-44dc51deff03 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.077586 Sep 07 12:46:55.050275 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1696/3407] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:46:55.060088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a3fc8e7f-0edb-4b61-88e9-cb3da5213063 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:55.061527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a3fc8e7f-0edb-4b61-88e9-cb3da5213063 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] [instance: d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:55.073329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3fc8e7f-0edb-4b61-88e9-cb3da5213063 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:55.074276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3fc8e7f-0edb-4b61-88e9-cb3da5213063 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:55.075064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3fc8e7f-0edb-4b61-88e9-cb3da5213063 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:55.076359 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3fc8e7f-0edb-4b61-88e9-cb3da5213063 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:55.077890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3fc8e7f-0edb-4b61-88e9-cb3da5213063 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:55.078691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3fc8e7f-0edb-4b61-88e9-cb3da5213063 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:55.377183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a3fc8e7f-0edb-4b61-88e9-cb3da5213063 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6902480075db4d7bb4be2306197cfbc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3ae4d905a7493289a242cc9ce5a051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:55.387363 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a3fc8e7f-0edb-4b61-88e9-cb3da5213063 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] 10.222.0.16 "GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1" status: 200 len: 1285 microversion: 2.1 time: 0.335063 Sep 07 12:46:55.398671 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1697/3408] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:55 2022] GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1 => generated 1285 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:55.422263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b013c39a-0087-4ab0-9957-86d994854b54 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1160953241"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:46:55.441467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b013c39a-0087-4ab0-9957-86d994854b54 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:55.464180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b013c39a-0087-4ab0-9957-86d994854b54 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:55.464895 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b013c39a-0087-4ab0-9957-86d994854b54 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:55.465587 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b013c39a-0087-4ab0-9957-86d994854b54 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:55.466984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b013c39a-0087-4ab0-9957-86d994854b54 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:55.467972 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b013c39a-0087-4ab0-9957-86d994854b54 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:55.468922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b013c39a-0087-4ab0-9957-86d994854b54 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:56.140392 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b013c39a-0087-4ab0-9957-86d994854b54 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action" status: 202 len: 0 microversion: 2.1 time: 0.744163 Sep 07 12:46:56.146926 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1698/3409] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:46:55 2022] POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action => generated 0 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 07 12:46:56.159244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2649d315-4877-4e47-b080-381b33aceb59 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:56.160448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2649d315-4877-4e47-b080-381b33aceb59 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:56.175098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2649d315-4877-4e47-b080-381b33aceb59 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:56.176136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2649d315-4877-4e47-b080-381b33aceb59 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:56.177368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2649d315-4877-4e47-b080-381b33aceb59 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:56.178796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2649d315-4877-4e47-b080-381b33aceb59 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:56.179689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2649d315-4877-4e47-b080-381b33aceb59 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:56.180550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2649d315-4877-4e47-b080-381b33aceb59 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:56.368204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-56236593-b0ee-4c2a-a422-527f89fd2dbd tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:46:56.369031 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-56236593-b0ee-4c2a-a422-527f89fd2dbd tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:46:56.369868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-56236593-b0ee-4c2a-a422-527f89fd2dbd tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:46:56.370932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-56236593-b0ee-4c2a-a422-527f89fd2dbd tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:46:56.374102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-56236593-b0ee-4c2a-a422-527f89fd2dbd tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:46:56.399645 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56236593-b0ee-4c2a-a422-527f89fd2dbd tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:56.400475 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56236593-b0ee-4c2a-a422-527f89fd2dbd tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:56.401282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56236593-b0ee-4c2a-a422-527f89fd2dbd tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:56.402776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56236593-b0ee-4c2a-a422-527f89fd2dbd tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:56.404004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56236593-b0ee-4c2a-a422-527f89fd2dbd tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:56.404806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56236593-b0ee-4c2a-a422-527f89fd2dbd tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:56.484440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-56236593-b0ee-4c2a-a422-527f89fd2dbd tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Getting quotas for project 9a0713651a514386bcf37ee6cc3d8e2f. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:46:56.495608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-56236593-b0ee-4c2a-a422-527f89fd2dbd tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Getting quotas for user 3ca81088a7ce4c3fafc90d36c07711ff and project 9a0713651a514386bcf37ee6cc3d8e2f. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:46:56.616565 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2649d315-4877-4e47-b080-381b33aceb59 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:56.628380 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2649d315-4877-4e47-b080-381b33aceb59 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1521 microversion: 2.1 time: 0.482206 Sep 07 12:46:56.629907 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1699/3410] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:56 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1521 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:56.638287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7e3de428-e725-40c6-96e7-8888a20a5b0c tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4181f1dc0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:56.721585 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7e3de428-e725-40c6-96e7-8888a20a5b0c tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/958ebe61-1ee8-4b9d-81e2-ea97e10768ff" status: 200 len: 1464 microversion: 2.1 time: 0.090232 Sep 07 12:46:56.727568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-56236593-b0ee-4c2a-a422-527f89fd2dbd tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:46:56.731234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-56236593-b0ee-4c2a-a422-527f89fd2dbd tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='3656e6ad-d5cf-43d0-ac24-770406a0fe87',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='e6c65479-6976-499b-94fa-c05087e18c56',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='593494a7-6b35-496c-a60d-6de39f1a9bea',volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:46:56.736774 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1700/3411] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:46:56 2022] GET /compute/v2.1/images/958ebe61-1ee8-4b9d-81e2-ea97e10768ff => generated 1464 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:56.742348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6cf205bd-684a-4491-ab55-edf21c136481 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:56.742944 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6cf205bd-684a-4491-ab55-edf21c136481 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:56.757158 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cf205bd-684a-4491-ab55-edf21c136481 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:56.758016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cf205bd-684a-4491-ab55-edf21c136481 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:56.758784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cf205bd-684a-4491-ab55-edf21c136481 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:56.759758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cf205bd-684a-4491-ab55-edf21c136481 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:56.760271 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cf205bd-684a-4491-ab55-edf21c136481 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:56.760702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cf205bd-684a-4491-ab55-edf21c136481 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:57.046819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6cf205bd-684a-4491-ab55-edf21c136481 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:57.055445 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6cf205bd-684a-4491-ab55-edf21c136481 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e" status: 200 len: 1322 microversion: 2.1 time: 0.316932 Sep 07 12:46:57.072655 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1701/3412] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:56 2022] GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:57.079017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8b44ffda-7683-406d-a41a-c13c8bd21ec3 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:57.079833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8b44ffda-7683-406d-a41a-c13c8bd21ec3 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:57.107800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b44ffda-7683-406d-a41a-c13c8bd21ec3 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:57.108620 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b44ffda-7683-406d-a41a-c13c8bd21ec3 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:57.109070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b44ffda-7683-406d-a41a-c13c8bd21ec3 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:57.110272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b44ffda-7683-406d-a41a-c13c8bd21ec3 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:57.110972 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b44ffda-7683-406d-a41a-c13c8bd21ec3 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:57.111897 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b44ffda-7683-406d-a41a-c13c8bd21ec3 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:57.290641 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-56236593-b0ee-4c2a-a422-527f89fd2dbd tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 15.728162 Sep 07 12:46:57.291797 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1712/3413] 10.222.0.16 () {62 vars in 1189 bytes} [Wed Sep 7 12:46:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 15731 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 12:46:57.297661 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1086e627-6c13-44a4-a9db-275702ddf32f tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:57.298754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1086e627-6c13-44a4-a9db-275702ddf32f tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] [instance: d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:57.306231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1086e627-6c13-44a4-a9db-275702ddf32f tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:57.306789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1086e627-6c13-44a4-a9db-275702ddf32f tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:57.307442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1086e627-6c13-44a4-a9db-275702ddf32f tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:57.308600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1086e627-6c13-44a4-a9db-275702ddf32f tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:57.309300 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1086e627-6c13-44a4-a9db-275702ddf32f tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:57.309956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1086e627-6c13-44a4-a9db-275702ddf32f tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:58.311733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8b44ffda-7683-406d-a41a-c13c8bd21ec3 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:58.340882 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8b44ffda-7683-406d-a41a-c13c8bd21ec3 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1501 microversion: 2.1 time: 1.261696 Sep 07 12:46:58.344904 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1702/3414] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:57 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1501 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:58.371229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-452bf0f5-3a67-4f08-8c17-2c7de85be370 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:58.372355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-452bf0f5-3a67-4f08-8c17-2c7de85be370 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 676e42b4-4985-43cc-892b-176e13b341df] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:58.389696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-452bf0f5-3a67-4f08-8c17-2c7de85be370 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:58.398180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-452bf0f5-3a67-4f08-8c17-2c7de85be370 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:58.405529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-452bf0f5-3a67-4f08-8c17-2c7de85be370 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:58.424525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-452bf0f5-3a67-4f08-8c17-2c7de85be370 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:58.426799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-452bf0f5-3a67-4f08-8c17-2c7de85be370 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:58.428022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-452bf0f5-3a67-4f08-8c17-2c7de85be370 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:58.520897 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1086e627-6c13-44a4-a9db-275702ddf32f tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6902480075db4d7bb4be2306197cfbc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3ae4d905a7493289a242cc9ce5a051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:58.552441 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1086e627-6c13-44a4-a9db-275702ddf32f tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] 10.222.0.16 "GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1" status: 200 len: 1325 microversion: 2.1 time: 1.258399 Sep 07 12:46:58.556738 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1713/3415] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:57 2022] GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1 => generated 1325 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:58.586777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8a518108-6186-45cb-9b06-9441aa1cba96 req-f38ceda2-7c69-4a5b-9810-af8bd81a1571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edf38c92-ffc2-492b-8642-88ca59537acd", "name": "network-vif-unplugged", "status": "completed", "tag": "23b18fbd-594f-42e0-a655-6b5f01607b28"}, {"server_uuid": "676e42b4-4985-43cc-892b-176e13b341df", "name": "network-vif-unplugged", "status": "completed", "tag": "8973b130-dd43-4a93-b14e-3d7f5131cd14"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:46:58.637186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8a518108-6186-45cb-9b06-9441aa1cba96 req-f38ceda2-7c69-4a5b-9810-af8bd81a1571 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:58.638624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8a518108-6186-45cb-9b06-9441aa1cba96 req-f38ceda2-7c69-4a5b-9810-af8bd81a1571 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:58.642679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8a518108-6186-45cb-9b06-9441aa1cba96 req-f38ceda2-7c69-4a5b-9810-af8bd81a1571 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:58.700498 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8a518108-6186-45cb-9b06-9441aa1cba96 req-f38ceda2-7c69-4a5b-9810-af8bd81a1571 service nova] Creating event network-vif-unplugged:23b18fbd-594f-42e0-a655-6b5f01607b28 for instance edf38c92-ffc2-492b-8642-88ca59537acd on n-h1-852087-9 Sep 07 12:46:58.706145 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8a518108-6186-45cb-9b06-9441aa1cba96 req-f38ceda2-7c69-4a5b-9810-af8bd81a1571 service nova] Creating event network-vif-unplugged:8973b130-dd43-4a93-b14e-3d7f5131cd14 for instance 676e42b4-4985-43cc-892b-176e13b341df on n-h2-852087-9 Sep 07 12:46:58.743300 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8a518108-6186-45cb-9b06-9441aa1cba96 req-f38ceda2-7c69-4a5b-9810-af8bd81a1571 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.182550 Sep 07 12:46:58.745433 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1714/3416] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:46:58.764904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-98e633c3-87f3-4243-b81d-a3c531da5f16 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:58.777810 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-98e633c3-87f3-4243-b81d-a3c531da5f16 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:59.025020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-98e633c3-87f3-4243-b81d-a3c531da5f16 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:59.034744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-452bf0f5-3a67-4f08-8c17-2c7de85be370 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796a821c4f184a6aac2859bb943f9bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a87170da674037af70fac57a366c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:59.039897 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-98e633c3-87f3-4243-b81d-a3c531da5f16 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:59.049147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-98e633c3-87f3-4243-b81d-a3c531da5f16 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:59.052409 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-98e633c3-87f3-4243-b81d-a3c531da5f16 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1285 microversion: 2.42 time: 0.300128 Sep 07 12:46:59.055847 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1715/3417] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:46:58 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1285 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:46:59.065611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a95dbb51-3905-4456-8477-42951aa5b2e9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:59.065886 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-452bf0f5-3a67-4f08-8c17-2c7de85be370 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/676e42b4-4985-43cc-892b-176e13b341df" status: 200 len: 1467 microversion: 2.1 time: 0.716668 Sep 07 12:46:59.074789 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1703/3418] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:58 2022] GET /compute/v2.1/servers/676e42b4-4985-43cc-892b-176e13b341df => generated 1467 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:59.084451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a95dbb51-3905-4456-8477-42951aa5b2e9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:59.100164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-93ed85a9-bf38-40e9-9967-05ca9121a52b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:59.101865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-93ed85a9-bf38-40e9-9967-05ca9121a52b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:59.116735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a95dbb51-3905-4456-8477-42951aa5b2e9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:59.118402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a95dbb51-3905-4456-8477-42951aa5b2e9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:59.119749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a95dbb51-3905-4456-8477-42951aa5b2e9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:59.121525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a95dbb51-3905-4456-8477-42951aa5b2e9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:59.122730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a95dbb51-3905-4456-8477-42951aa5b2e9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:59.123847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93ed85a9-bf38-40e9-9967-05ca9121a52b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:59.124424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a95dbb51-3905-4456-8477-42951aa5b2e9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:59.124692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93ed85a9-bf38-40e9-9967-05ca9121a52b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:59.125460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93ed85a9-bf38-40e9-9967-05ca9121a52b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:59.136869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93ed85a9-bf38-40e9-9967-05ca9121a52b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:59.137817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93ed85a9-bf38-40e9-9967-05ca9121a52b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:59.138701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93ed85a9-bf38-40e9-9967-05ca9121a52b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:59.661686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a95dbb51-3905-4456-8477-42951aa5b2e9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:59.697220 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a95dbb51-3905-4456-8477-42951aa5b2e9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1506 microversion: 2.1 time: 0.639252 Sep 07 12:46:59.699255 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1716/3419] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:59 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1506 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:59.710012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-39a11f86-21c5-4ab1-944a-d45d105ce4d2 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:46:59.711575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-39a11f86-21c5-4ab1-944a-d45d105ce4d2 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:59.724717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39a11f86-21c5-4ab1-944a-d45d105ce4d2 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:59.726458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39a11f86-21c5-4ab1-944a-d45d105ce4d2 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:59.728667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39a11f86-21c5-4ab1-944a-d45d105ce4d2 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:59.730558 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39a11f86-21c5-4ab1-944a-d45d105ce4d2 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:59.732032 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39a11f86-21c5-4ab1-944a-d45d105ce4d2 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:59.733845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39a11f86-21c5-4ab1-944a-d45d105ce4d2 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:59.753268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-93ed85a9-bf38-40e9-9967-05ca9121a52b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:46:59.774404 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-93ed85a9-bf38-40e9-9967-05ca9121a52b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e" status: 200 len: 1516 microversion: 2.1 time: 0.696271 Sep 07 12:46:59.791471 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1704/3420] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:46:59 2022] GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e => generated 1516 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:46:59.820687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1eb705cb-987a-4ff0-b1c8-bc8579e5d461 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-142036514"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:46:59.829180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1eb705cb-987a-4ff0-b1c8-bc8579e5d461 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 91762428-7354-4926-b463-edc357e1e7cf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:46:59.829769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-39a11f86-21c5-4ab1-944a-d45d105ce4d2 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:46:59.842857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eb705cb-987a-4ff0-b1c8-bc8579e5d461 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:59.844140 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eb705cb-987a-4ff0-b1c8-bc8579e5d461 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:59.845205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eb705cb-987a-4ff0-b1c8-bc8579e5d461 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:59.847040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eb705cb-987a-4ff0-b1c8-bc8579e5d461 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:46:59.848435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eb705cb-987a-4ff0-b1c8-bc8579e5d461 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:46:59.849514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eb705cb-987a-4ff0-b1c8-bc8579e5d461 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:46:59.861592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:47:00.044655 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-39a11f86-21c5-4ab1-944a-d45d105ce4d2 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 204 len: 0 microversion: 2.1 time: 0.342430 Sep 07 12:47:00.050239 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1717/3421] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:46:59 2022] DELETE /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:47:00.064888 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9073c7df-f3c5-430b-8d79-34e039454ceb tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:00.066710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9073c7df-f3c5-430b-8d79-34e039454ceb tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] [instance: d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:00.089667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9073c7df-f3c5-430b-8d79-34e039454ceb tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:00.090826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9073c7df-f3c5-430b-8d79-34e039454ceb tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:00.091638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9073c7df-f3c5-430b-8d79-34e039454ceb tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:00.093125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9073c7df-f3c5-430b-8d79-34e039454ceb tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:00.093788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9073c7df-f3c5-430b-8d79-34e039454ceb tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:00.094634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9073c7df-f3c5-430b-8d79-34e039454ceb tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:00.367435 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1eb705cb-987a-4ff0-b1c8-bc8579e5d461 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "POST /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf/action" status: 202 len: 0 microversion: 2.1 time: 0.572923 Sep 07 12:47:00.369193 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1705/3422] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:46:59 2022] POST /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 07 12:47:00.389739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1e209de7-5828-463b-9166-15c77a04c46d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:00.391977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1e209de7-5828-463b-9166-15c77a04c46d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:00.412369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e209de7-5828-463b-9166-15c77a04c46d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:00.413550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e209de7-5828-463b-9166-15c77a04c46d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:00.420877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e209de7-5828-463b-9166-15c77a04c46d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:00.422668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e209de7-5828-463b-9166-15c77a04c46d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:00.423912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e209de7-5828-463b-9166-15c77a04c46d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:00.424567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e209de7-5828-463b-9166-15c77a04c46d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:00.589342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9073c7df-f3c5-430b-8d79-34e039454ceb tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6902480075db4d7bb4be2306197cfbc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3ae4d905a7493289a242cc9ce5a051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:00.614115 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9073c7df-f3c5-430b-8d79-34e039454ceb tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] 10.222.0.16 "GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1" status: 200 len: 1325 microversion: 2.1 time: 0.561505 Sep 07 12:47:00.615244 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1718/3423] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:00 2022] GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1 => generated 1325 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:00.625837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2e1e71bb-05a3-4688-85f9-26061e96429e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:47:00.638346 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2e1e71bb-05a3-4688-85f9-26061e96429e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:00.650597 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e1e71bb-05a3-4688-85f9-26061e96429e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:00.651875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e1e71bb-05a3-4688-85f9-26061e96429e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:00.652746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e1e71bb-05a3-4688-85f9-26061e96429e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:00.654330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e1e71bb-05a3-4688-85f9-26061e96429e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:00.655645 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e1e71bb-05a3-4688-85f9-26061e96429e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:00.656805 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e1e71bb-05a3-4688-85f9-26061e96429e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:00.708570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1e209de7-5828-463b-9166-15c77a04c46d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:00.722415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-2e1e71bb-05a3-4688-85f9-26061e96429e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lazy-loading 'flavor' on Instance uuid f2c8a9c1-51cc-4b6c-9b68-6ec76021310e {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:47:00.734089 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1e209de7-5828-463b-9166-15c77a04c46d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 200 len: 1506 microversion: 2.1 time: 0.357464 Sep 07 12:47:00.735464 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1706/3424] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:00 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:00.794929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-61a258e3-08bc-45a6-aada-3c69625ad42d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:00.797248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-61a258e3-08bc-45a6-aada-3c69625ad42d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:00.806124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61a258e3-08bc-45a6-aada-3c69625ad42d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:00.806845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61a258e3-08bc-45a6-aada-3c69625ad42d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:00.807415 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61a258e3-08bc-45a6-aada-3c69625ad42d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:00.808304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61a258e3-08bc-45a6-aada-3c69625ad42d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:00.809571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61a258e3-08bc-45a6-aada-3c69625ad42d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:00.810159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61a258e3-08bc-45a6-aada-3c69625ad42d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:00.884134 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2e1e71bb-05a3-4688-85f9-26061e96429e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "POST /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e/action" status: 200 len: 32 microversion: 2.1 time: 0.266550 Sep 07 12:47:00.885534 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1719/3425] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:47:00 2022] POST /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e/action => generated 32 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:47:00.892607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0266f354-d521-48bd-a618-efa1819642b5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:00.893625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0266f354-d521-48bd-a618-efa1819642b5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:00.902504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0266f354-d521-48bd-a618-efa1819642b5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:00.903510 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0266f354-d521-48bd-a618-efa1819642b5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:00.904309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0266f354-d521-48bd-a618-efa1819642b5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:00.905863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0266f354-d521-48bd-a618-efa1819642b5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:00.907890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0266f354-d521-48bd-a618-efa1819642b5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:00.908567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0266f354-d521-48bd-a618-efa1819642b5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:01.071977 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0266f354-d521-48bd-a618-efa1819642b5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:01.123586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0266f354-d521-48bd-a618-efa1819642b5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:01.127601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0266f354-d521-48bd-a618-efa1819642b5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:01.130459 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0266f354-d521-48bd-a618-efa1819642b5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1575 microversion: 2.42 time: 0.242801 Sep 07 12:47:01.141594 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1720/3426] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:47:00 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1575 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:47:01.141594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-545354f6-3b80-4bb1-8a5b-373bc12d69c5 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc41872a040>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:01.272399 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-545354f6-3b80-4bb1-8a5b-373bc12d69c5 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81" status: 200 len: 1454 microversion: 2.1 time: 0.138963 Sep 07 12:47:01.275496 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1721/3427] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:47:01 2022] GET /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81 => generated 1454 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:01.285163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-28c82534-c155-45c4-a665-4b303e477f01 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:01.286498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-28c82534-c155-45c4-a665-4b303e477f01 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:01.314524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28c82534-c155-45c4-a665-4b303e477f01 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:01.315723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28c82534-c155-45c4-a665-4b303e477f01 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:01.316629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28c82534-c155-45c4-a665-4b303e477f01 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:01.318118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28c82534-c155-45c4-a665-4b303e477f01 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:01.319099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28c82534-c155-45c4-a665-4b303e477f01 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:01.320437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28c82534-c155-45c4-a665-4b303e477f01 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:01.376569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-28c82534-c155-45c4-a665-4b303e477f01 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:47:01.531785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-61a258e3-08bc-45a6-aada-3c69625ad42d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:01.560468 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-61a258e3-08bc-45a6-aada-3c69625ad42d tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1507 microversion: 2.1 time: 0.790792 Sep 07 12:47:01.564734 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1707/3428] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:00 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1507 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:01.583212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-284353d8-0e1e-4cf6-ab1e-c2a3761536e3 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:01.587753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-284353d8-0e1e-4cf6-ab1e-c2a3761536e3 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:01.588382 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-28c82534-c155-45c4-a665-4b303e477f01 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 204 len: 0 microversion: 2.1 time: 0.310646 Sep 07 12:47:01.589404 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1722/3429] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:47:01 2022] DELETE /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:47:01.616884 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-118085d8-3a26-4704-b5ef-7288ae6f60a7 req-2b40cee4-4ac5-4e36-a3af-38fa56704b7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1", "tag": "9ead8f12-20d6-4b8b-97f1-2379de7610c7"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:47:01.619295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-284353d8-0e1e-4cf6-ab1e-c2a3761536e3 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:01.620310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-284353d8-0e1e-4cf6-ab1e-c2a3761536e3 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:01.621087 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-284353d8-0e1e-4cf6-ab1e-c2a3761536e3 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:01.626317 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-284353d8-0e1e-4cf6-ab1e-c2a3761536e3 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:01.627073 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-284353d8-0e1e-4cf6-ab1e-c2a3761536e3 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:01.627740 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-284353d8-0e1e-4cf6-ab1e-c2a3761536e3 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:01.648192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-118085d8-3a26-4704-b5ef-7288ae6f60a7 req-2b40cee4-4ac5-4e36-a3af-38fa56704b7d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:01.648838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-118085d8-3a26-4704-b5ef-7288ae6f60a7 req-2b40cee4-4ac5-4e36-a3af-38fa56704b7d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:01.649290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-118085d8-3a26-4704-b5ef-7288ae6f60a7 req-2b40cee4-4ac5-4e36-a3af-38fa56704b7d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:01.667842 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-118085d8-3a26-4704-b5ef-7288ae6f60a7 req-2b40cee4-4ac5-4e36-a3af-38fa56704b7d service nova] Creating event network-changed:9ead8f12-20d6-4b8b-97f1-2379de7610c7 for instance d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1 on n-h2-852087-9 Sep 07 12:47:01.683250 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-118085d8-3a26-4704-b5ef-7288ae6f60a7 req-2b40cee4-4ac5-4e36-a3af-38fa56704b7d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078132 Sep 07 12:47:01.684194 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1723/3430] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:47:01.690261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5b29e512-1dba-4ba1-bd43-716d05d4dd11 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:01.691194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5b29e512-1dba-4ba1-bd43-716d05d4dd11 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] [instance: d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:01.700061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b29e512-1dba-4ba1-bd43-716d05d4dd11 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:01.701112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b29e512-1dba-4ba1-bd43-716d05d4dd11 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:01.701969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b29e512-1dba-4ba1-bd43-716d05d4dd11 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:01.703231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b29e512-1dba-4ba1-bd43-716d05d4dd11 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:01.703884 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b29e512-1dba-4ba1-bd43-716d05d4dd11 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:01.704476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b29e512-1dba-4ba1-bd43-716d05d4dd11 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:02.240598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5b29e512-1dba-4ba1-bd43-716d05d4dd11 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6902480075db4d7bb4be2306197cfbc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3ae4d905a7493289a242cc9ce5a051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:02.246499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-284353d8-0e1e-4cf6-ab1e-c2a3761536e3 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:02.260667 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5b29e512-1dba-4ba1-bd43-716d05d4dd11 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] 10.222.0.16 "GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1" status: 200 len: 1325 microversion: 2.1 time: 0.574489 Sep 07 12:47:02.261303 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1724/3431] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:01 2022] GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1 => generated 1325 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:02.263505 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-284353d8-0e1e-4cf6-ab1e-c2a3761536e3 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e" status: 200 len: 1522 microversion: 2.1 time: 0.694414 Sep 07 12:47:02.264475 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1708/3432] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:01 2022] GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e => generated 1522 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:02.269718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-375c6886-336f-480f-b87b-2c0734c2515d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-191794939", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "b09d014c-3443-48ed-84da-449ea818c81d"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:47:02.281991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4728ec9f-c457-4478-838c-af0f290b4a5d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:02.288972 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4728ec9f-c457-4478-838c-af0f290b4a5d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:02.308439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4728ec9f-c457-4478-838c-af0f290b4a5d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:02.309618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4728ec9f-c457-4478-838c-af0f290b4a5d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:02.310716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4728ec9f-c457-4478-838c-af0f290b4a5d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:02.312751 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4728ec9f-c457-4478-838c-af0f290b4a5d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:02.314193 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4728ec9f-c457-4478-838c-af0f290b4a5d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:02.315390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4728ec9f-c457-4478-838c-af0f290b4a5d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:02.348152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-375c6886-336f-480f-b87b-2c0734c2515d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] validate_networks() for [('b09d014c-3443-48ed-84da-449ea818c81d', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:47:02.476366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4728ec9f-c457-4478-838c-af0f290b4a5d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:02.507497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4728ec9f-c457-4478-838c-af0f290b4a5d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:02.510460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4728ec9f-c457-4478-838c-af0f290b4a5d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:02.514119 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4728ec9f-c457-4478-838c-af0f290b4a5d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1593 microversion: 2.42 time: 0.240663 Sep 07 12:47:02.533543 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1709/3433] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:47:02 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1593 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:47:02.533543 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4c08b8b5-1716-4ed3-bb2f-91fe6c4e8abd tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4180ee1f0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:02.597828 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4c08b8b5-1716-4ed3-bb2f-91fe6c4e8abd tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81" status: 200 len: 1454 microversion: 2.1 time: 0.077076 Sep 07 12:47:02.598772 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1710/3434] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:47:02 2022] GET /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81 => generated 1454 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:02.615767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cd2030dc-faa6-4ac0-ae1a-4f51ceea6409 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:02.616867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cd2030dc-faa6-4ac0-ae1a-4f51ceea6409 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:02.633623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd2030dc-faa6-4ac0-ae1a-4f51ceea6409 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:02.635414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd2030dc-faa6-4ac0-ae1a-4f51ceea6409 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:02.636847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd2030dc-faa6-4ac0-ae1a-4f51ceea6409 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:02.638228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd2030dc-faa6-4ac0-ae1a-4f51ceea6409 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:02.639402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd2030dc-faa6-4ac0-ae1a-4f51ceea6409 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:02.639959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd2030dc-faa6-4ac0-ae1a-4f51ceea6409 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:02.922629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cd2030dc-faa6-4ac0-ae1a-4f51ceea6409 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:02.936611 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cd2030dc-faa6-4ac0-ae1a-4f51ceea6409 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1507 microversion: 2.1 time: 0.335815 Sep 07 12:47:02.940341 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1711/3435] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:02 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1507 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:03.057658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-375c6886-336f-480f-b87b-2c0734c2515d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:47:03.058421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-375c6886-336f-480f-b87b-2c0734c2515d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:47:03.059312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-375c6886-336f-480f-b87b-2c0734c2515d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:47:03.059930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-375c6886-336f-480f-b87b-2c0734c2515d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:47:03.060582 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-375c6886-336f-480f-b87b-2c0734c2515d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:47:03.079272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-375c6886-336f-480f-b87b-2c0734c2515d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:03.080396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-375c6886-336f-480f-b87b-2c0734c2515d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:03.081144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-375c6886-336f-480f-b87b-2c0734c2515d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:03.082450 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-375c6886-336f-480f-b87b-2c0734c2515d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:03.083207 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-375c6886-336f-480f-b87b-2c0734c2515d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:03.083906 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-375c6886-336f-480f-b87b-2c0734c2515d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:03.118102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-375c6886-336f-480f-b87b-2c0734c2515d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Getting quotas for project f535596776604720870c42b1a788cb3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:47:03.128212 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-375c6886-336f-480f-b87b-2c0734c2515d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Getting quotas for user f76fe928bf384b88b8a3ba5e4b9c6232 and project f535596776604720870c42b1a788cb3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:47:03.152078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-375c6886-336f-480f-b87b-2c0734c2515d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:47:03.156595 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-375c6886-336f-480f-b87b-2c0734c2515d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:47:03.255183 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-375c6886-336f-480f-b87b-2c0734c2515d tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.992208 Sep 07 12:47:03.256687 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1725/3436] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:47:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:47:03.271235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-469ac114-e091-45fa-aece-f3257f911ee1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:03.273425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-469ac114-e091-45fa-aece-f3257f911ee1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:03.278066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:47:03.280571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:47:03.305932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ced1fdc-db66-4174-b138-0212e7132c52 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:03.306896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4ced1fdc-db66-4174-b138-0212e7132c52 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] [instance: d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:03.317796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ced1fdc-db66-4174-b138-0212e7132c52 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:03.318303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ced1fdc-db66-4174-b138-0212e7132c52 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:03.319252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ced1fdc-db66-4174-b138-0212e7132c52 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:03.320416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ced1fdc-db66-4174-b138-0212e7132c52 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:03.321088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ced1fdc-db66-4174-b138-0212e7132c52 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:03.321728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ced1fdc-db66-4174-b138-0212e7132c52 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:03.412335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-469ac114-e091-45fa-aece-f3257f911ee1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:03.428158 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-469ac114-e091-45fa-aece-f3257f911ee1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 200 len: 1217 microversion: 2.1 time: 0.163534 Sep 07 12:47:03.429409 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1712/3437] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:03 2022] GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 1217 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:03.447633 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-72a26bbe-030c-4634-9be9-4d572c1b4c57 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:03.448268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-72a26bbe-030c-4634-9be9-4d572c1b4c57 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:03.455857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72a26bbe-030c-4634-9be9-4d572c1b4c57 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:03.456380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72a26bbe-030c-4634-9be9-4d572c1b4c57 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:03.456966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72a26bbe-030c-4634-9be9-4d572c1b4c57 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:03.457632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72a26bbe-030c-4634-9be9-4d572c1b4c57 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:03.458104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72a26bbe-030c-4634-9be9-4d572c1b4c57 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:03.458536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72a26bbe-030c-4634-9be9-4d572c1b4c57 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:04.015118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4ced1fdc-db66-4174-b138-0212e7132c52 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6902480075db4d7bb4be2306197cfbc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3ae4d905a7493289a242cc9ce5a051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:04.042303 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ced1fdc-db66-4174-b138-0212e7132c52 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] 10.222.0.16 "GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1" status: 200 len: 1325 microversion: 2.1 time: 0.740956 Sep 07 12:47:04.054561 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1726/3438] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:03 2022] GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1 => generated 1325 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:04.095215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-57fa8a8b-4b23-4428-9d75-2a526c87db7a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:04.107856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-57fa8a8b-4b23-4428-9d75-2a526c87db7a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:04.137009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57fa8a8b-4b23-4428-9d75-2a526c87db7a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:04.139471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57fa8a8b-4b23-4428-9d75-2a526c87db7a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:04.140894 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57fa8a8b-4b23-4428-9d75-2a526c87db7a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:04.142589 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57fa8a8b-4b23-4428-9d75-2a526c87db7a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:04.155278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57fa8a8b-4b23-4428-9d75-2a526c87db7a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:04.163465 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57fa8a8b-4b23-4428-9d75-2a526c87db7a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:04.517184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-72a26bbe-030c-4634-9be9-4d572c1b4c57 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:04.532586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-57fa8a8b-4b23-4428-9d75-2a526c87db7a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:04.540539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:47:04.561688 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-72a26bbe-030c-4634-9be9-4d572c1b4c57 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e" status: 200 len: 1522 microversion: 2.1 time: 1.129220 Sep 07 12:47:04.564194 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1713/3439] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:03 2022] GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e => generated 1522 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:04.580777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cd3b928e-5f50-42a1-bf7c-b96e01c4249a tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4181f1820>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:04.581204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-57fa8a8b-4b23-4428-9d75-2a526c87db7a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:04.585464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-57fa8a8b-4b23-4428-9d75-2a526c87db7a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:04.588111 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-57fa8a8b-4b23-4428-9d75-2a526c87db7a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1593 microversion: 2.42 time: 0.531323 Sep 07 12:47:04.593299 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1727/3440] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:47:04 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1593 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:47:04.607060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-396b126e-6466-455f-a668-0abb66d07ee1 req-bd49cc62-b2a7-4e41-b6cc-7f16b835b84d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edf38c92-ffc2-492b-8642-88ca59537acd", "name": "network-vif-plugged", "status": "completed", "tag": "23b18fbd-594f-42e0-a655-6b5f01607b28"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:47:04.677306 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cd3b928e-5f50-42a1-bf7c-b96e01c4249a tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81" status: 200 len: 1454 microversion: 2.1 time: 0.108884 Sep 07 12:47:04.679266 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1714/3441] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:47:04 2022] GET /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81 => generated 1454 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:04.686020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ab35d994-bad8-4f4b-b584-29abd9e176af tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:04.687073 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ab35d994-bad8-4f4b-b584-29abd9e176af tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:04.695266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab35d994-bad8-4f4b-b584-29abd9e176af tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:04.696188 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab35d994-bad8-4f4b-b584-29abd9e176af tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:04.696791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-396b126e-6466-455f-a668-0abb66d07ee1 req-bd49cc62-b2a7-4e41-b6cc-7f16b835b84d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:04.697395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab35d994-bad8-4f4b-b584-29abd9e176af tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:04.697712 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-396b126e-6466-455f-a668-0abb66d07ee1 req-bd49cc62-b2a7-4e41-b6cc-7f16b835b84d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:04.698488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-396b126e-6466-455f-a668-0abb66d07ee1 req-bd49cc62-b2a7-4e41-b6cc-7f16b835b84d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:04.699682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab35d994-bad8-4f4b-b584-29abd9e176af tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:04.700393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab35d994-bad8-4f4b-b584-29abd9e176af tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:04.701089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab35d994-bad8-4f4b-b584-29abd9e176af tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:04.755726 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-396b126e-6466-455f-a668-0abb66d07ee1 req-bd49cc62-b2a7-4e41-b6cc-7f16b835b84d service nova] Creating event network-vif-plugged:23b18fbd-594f-42e0-a655-6b5f01607b28 for instance edf38c92-ffc2-492b-8642-88ca59537acd on n-h1-852087-9 Sep 07 12:47:04.775408 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-396b126e-6466-455f-a668-0abb66d07ee1 req-bd49cc62-b2a7-4e41-b6cc-7f16b835b84d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179920 Sep 07 12:47:04.776364 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1728/3442] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:47:04.790892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ca93f0e1-a6ca-4377-9059-6cd150f413a7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:04.791962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ca93f0e1-a6ca-4377-9059-6cd150f413a7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:04.807345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca93f0e1-a6ca-4377-9059-6cd150f413a7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:04.808167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca93f0e1-a6ca-4377-9059-6cd150f413a7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:04.808789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca93f0e1-a6ca-4377-9059-6cd150f413a7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:04.809762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca93f0e1-a6ca-4377-9059-6cd150f413a7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:04.810409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca93f0e1-a6ca-4377-9059-6cd150f413a7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:04.811050 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca93f0e1-a6ca-4377-9059-6cd150f413a7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:05.358601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ca93f0e1-a6ca-4377-9059-6cd150f413a7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:05.374960 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ca93f0e1-a6ca-4377-9059-6cd150f413a7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 200 len: 1221 microversion: 2.1 time: 0.596903 Sep 07 12:47:05.391121 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1729/3443] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:04 2022] GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 1221 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:05.433031 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-f3e36f33-b38e-4f56-bd10-a3d0b3deac1e req-012a32c5-667e-48dd-8a2c-0ad7b445b969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc8c812d-29e5-4153-a609-74814c3e7c86", "name": "network-vif-deleted", "tag": "793646ba-5b13-4cdc-afbf-a554b83f8b18"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:47:05.462634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f3e36f33-b38e-4f56-bd10-a3d0b3deac1e req-012a32c5-667e-48dd-8a2c-0ad7b445b969 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:05.463128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f3e36f33-b38e-4f56-bd10-a3d0b3deac1e req-012a32c5-667e-48dd-8a2c-0ad7b445b969 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:05.467520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f3e36f33-b38e-4f56-bd10-a3d0b3deac1e req-012a32c5-667e-48dd-8a2c-0ad7b445b969 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:05.501261 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-f3e36f33-b38e-4f56-bd10-a3d0b3deac1e req-012a32c5-667e-48dd-8a2c-0ad7b445b969 service nova] Creating event network-vif-deleted:793646ba-5b13-4cdc-afbf-a554b83f8b18 for instance dc8c812d-29e5-4153-a609-74814c3e7c86 on n-h2-852087-9 Sep 07 12:47:05.516200 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-f3e36f33-b38e-4f56-bd10-a3d0b3deac1e req-012a32c5-667e-48dd-8a2c-0ad7b445b969 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122703 Sep 07 12:47:05.517024 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1730/3444] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:47:05.523834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1ebf5d4a-8821-4e7a-9922-0c288882596d tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:05.525649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1ebf5d4a-8821-4e7a-9922-0c288882596d tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] [instance: d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:05.532826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ebf5d4a-8821-4e7a-9922-0c288882596d tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:05.534130 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ebf5d4a-8821-4e7a-9922-0c288882596d tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:05.535068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ebf5d4a-8821-4e7a-9922-0c288882596d tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:05.536009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ebf5d4a-8821-4e7a-9922-0c288882596d tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:05.536673 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ebf5d4a-8821-4e7a-9922-0c288882596d tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:05.537396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ebf5d4a-8821-4e7a-9922-0c288882596d tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:06.616482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ab35d994-bad8-4f4b-b584-29abd9e176af tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:06.661686 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ab35d994-bad8-4f4b-b584-29abd9e176af tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1507 microversion: 2.1 time: 1.975228 Sep 07 12:47:06.662572 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1715/3445] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:04 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1507 bytes in 1982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:06.678369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bdb3a744-6bfb-44ca-a2b9-aa9ee1e259b4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:06.680346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bdb3a744-6bfb-44ca-a2b9-aa9ee1e259b4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:06.707284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdb3a744-6bfb-44ca-a2b9-aa9ee1e259b4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:06.708273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdb3a744-6bfb-44ca-a2b9-aa9ee1e259b4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:06.710768 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdb3a744-6bfb-44ca-a2b9-aa9ee1e259b4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:06.714836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdb3a744-6bfb-44ca-a2b9-aa9ee1e259b4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:06.715497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdb3a744-6bfb-44ca-a2b9-aa9ee1e259b4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:06.715979 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdb3a744-6bfb-44ca-a2b9-aa9ee1e259b4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:07.246366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1ebf5d4a-8821-4e7a-9922-0c288882596d tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6902480075db4d7bb4be2306197cfbc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3ae4d905a7493289a242cc9ce5a051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:07.271308 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1ebf5d4a-8821-4e7a-9922-0c288882596d tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] 10.222.0.16 "GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1" status: 200 len: 1325 microversion: 2.1 time: 1.751610 Sep 07 12:47:07.275804 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1731/3446] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:05 2022] GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1 => generated 1325 bytes in 1758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:07.287280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-40a2163c-d8d9-4caf-8ef4-cfa78720fa5b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:07.288994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-40a2163c-d8d9-4caf-8ef4-cfa78720fa5b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:07.328293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40a2163c-d8d9-4caf-8ef4-cfa78720fa5b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:07.330779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40a2163c-d8d9-4caf-8ef4-cfa78720fa5b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:07.335796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40a2163c-d8d9-4caf-8ef4-cfa78720fa5b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:07.337608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40a2163c-d8d9-4caf-8ef4-cfa78720fa5b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:07.341415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40a2163c-d8d9-4caf-8ef4-cfa78720fa5b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:07.342814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40a2163c-d8d9-4caf-8ef4-cfa78720fa5b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:07.347092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bdb3a744-6bfb-44ca-a2b9-aa9ee1e259b4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:07.363283 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bdb3a744-6bfb-44ca-a2b9-aa9ee1e259b4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e" status: 200 len: 1522 microversion: 2.1 time: 0.697391 Sep 07 12:47:07.363776 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1716/3447] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:06 2022] GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e => generated 1522 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:07.381106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-930d7d97-9271-4af5-bfb9-f34f7c1e9261 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc41809cca0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:07.536441 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-930d7d97-9271-4af5-bfb9-f34f7c1e9261 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81" status: 200 len: 1454 microversion: 2.1 time: 0.171505 Sep 07 12:47:07.537054 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1717/3448] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:47:07 2022] GET /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81 => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:07.552762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ae275323-4464-44b5-ba89-3537bae16e35 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:07.554175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ae275323-4464-44b5-ba89-3537bae16e35 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:07.567005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae275323-4464-44b5-ba89-3537bae16e35 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:07.567509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae275323-4464-44b5-ba89-3537bae16e35 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:07.567958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae275323-4464-44b5-ba89-3537bae16e35 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:07.568706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae275323-4464-44b5-ba89-3537bae16e35 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:07.569177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae275323-4464-44b5-ba89-3537bae16e35 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:07.569663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae275323-4464-44b5-ba89-3537bae16e35 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:07.608868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-40a2163c-d8d9-4caf-8ef4-cfa78720fa5b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:07.654102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-40a2163c-d8d9-4caf-8ef4-cfa78720fa5b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:07.665376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-40a2163c-d8d9-4caf-8ef4-cfa78720fa5b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:07.668753 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-40a2163c-d8d9-4caf-8ef4-cfa78720fa5b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1593 microversion: 2.42 time: 0.390543 Sep 07 12:47:07.670481 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1732/3449] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:47:07 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1593 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:47:07.729422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-62d2b429-9d3c-4bc2-9607-c37dc5f6a71c tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:07.731053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-62d2b429-9d3c-4bc2-9607-c37dc5f6a71c tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:07.752501 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62d2b429-9d3c-4bc2-9607-c37dc5f6a71c tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:07.760387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62d2b429-9d3c-4bc2-9607-c37dc5f6a71c tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:07.761697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62d2b429-9d3c-4bc2-9607-c37dc5f6a71c tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:07.767691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62d2b429-9d3c-4bc2-9607-c37dc5f6a71c tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:07.768979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62d2b429-9d3c-4bc2-9607-c37dc5f6a71c tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:07.770250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62d2b429-9d3c-4bc2-9607-c37dc5f6a71c tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:07.946315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ae275323-4464-44b5-ba89-3537bae16e35 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:07.961894 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ae275323-4464-44b5-ba89-3537bae16e35 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 200 len: 1275 microversion: 2.1 time: 0.423464 Sep 07 12:47:07.963978 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1718/3450] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:07 2022] GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 1275 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:08.058486 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-62d2b429-9d3c-4bc2-9607-c37dc5f6a71c tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:08.073115 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-62d2b429-9d3c-4bc2-9607-c37dc5f6a71c tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 200 len: 1465 microversion: 2.1 time: 0.368004 Sep 07 12:47:08.085534 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1733/3451] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:07 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 1465 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:08.323057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c8e85b54-1c08-493b-a6df-ca4c7dce9d73 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:08.325129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c8e85b54-1c08-493b-a6df-ca4c7dce9d73 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] [instance: d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:08.361145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-5b46f561-6f18-4cd4-94d1-1f960615d29d req-f1a040eb-ed78-4b73-a756-ba6486ee1d68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cf493cf-e2dc-4589-a81e-8eac7bbded71", "name": "network-vif-deleted", "tag": "31bf026a-f253-4d7f-a890-203d22ba6fdd"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:47:08.433456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5b46f561-6f18-4cd4-94d1-1f960615d29d req-f1a040eb-ed78-4b73-a756-ba6486ee1d68 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:08.434762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5b46f561-6f18-4cd4-94d1-1f960615d29d req-f1a040eb-ed78-4b73-a756-ba6486ee1d68 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:08.435879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5b46f561-6f18-4cd4-94d1-1f960615d29d req-f1a040eb-ed78-4b73-a756-ba6486ee1d68 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:08.453613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8e85b54-1c08-493b-a6df-ca4c7dce9d73 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:08.484767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8e85b54-1c08-493b-a6df-ca4c7dce9d73 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:08.489108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8e85b54-1c08-493b-a6df-ca4c7dce9d73 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:08.493611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8e85b54-1c08-493b-a6df-ca4c7dce9d73 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:08.508505 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8e85b54-1c08-493b-a6df-ca4c7dce9d73 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:08.509989 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8e85b54-1c08-493b-a6df-ca4c7dce9d73 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:08.570093 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-5b46f561-6f18-4cd4-94d1-1f960615d29d req-f1a040eb-ed78-4b73-a756-ba6486ee1d68 service nova] Creating event network-vif-deleted:31bf026a-f253-4d7f-a890-203d22ba6fdd for instance 6cf493cf-e2dc-4589-a81e-8eac7bbded71 on n-h1-852087-9 Sep 07 12:47:08.611947 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-5b46f561-6f18-4cd4-94d1-1f960615d29d req-f1a040eb-ed78-4b73-a756-ba6486ee1d68 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.255328 Sep 07 12:47:08.627595 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1734/3452] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:47:08.664290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ca879ae-744f-46e4-83e5-f886d54bfb24 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:08.665963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3ca879ae-744f-46e4-83e5-f886d54bfb24 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:08.706436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ca879ae-744f-46e4-83e5-f886d54bfb24 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:08.709601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ca879ae-744f-46e4-83e5-f886d54bfb24 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:08.710779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ca879ae-744f-46e4-83e5-f886d54bfb24 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:08.719728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ca879ae-744f-46e4-83e5-f886d54bfb24 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:08.720970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ca879ae-744f-46e4-83e5-f886d54bfb24 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:08.722252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ca879ae-744f-46e4-83e5-f886d54bfb24 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:09.687578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3ca879ae-744f-46e4-83e5-f886d54bfb24 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:09.723110 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ca879ae-744f-46e4-83e5-f886d54bfb24 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e" status: 200 len: 1522 microversion: 2.1 time: 1.093219 Sep 07 12:47:09.724088 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1735/3453] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:08 2022] GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e => generated 1522 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:09.738092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e1436ee2-28af-443e-b600-07649da4faf1 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc41982aca0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:09.868529 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e1436ee2-28af-443e-b600-07649da4faf1 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81" status: 200 len: 1454 microversion: 2.1 time: 0.139703 Sep 07 12:47:09.877628 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1736/3454] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:47:09 2022] GET /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81 => generated 1454 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:09.886862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-421fe56b-8028-4813-b5c1-72bbb928e0da tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:09.887881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-421fe56b-8028-4813-b5c1-72bbb928e0da tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:09.898454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-421fe56b-8028-4813-b5c1-72bbb928e0da tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:09.899595 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-421fe56b-8028-4813-b5c1-72bbb928e0da tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:09.900646 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-421fe56b-8028-4813-b5c1-72bbb928e0da tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:09.902112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-421fe56b-8028-4813-b5c1-72bbb928e0da tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:09.903082 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-421fe56b-8028-4813-b5c1-72bbb928e0da tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:09.903986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-421fe56b-8028-4813-b5c1-72bbb928e0da tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:09.939223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c8e85b54-1c08-493b-a6df-ca4c7dce9d73 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6902480075db4d7bb4be2306197cfbc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3ae4d905a7493289a242cc9ce5a051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:09.976489 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c8e85b54-1c08-493b-a6df-ca4c7dce9d73 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] 10.222.0.16 "GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1" status: 200 len: 1325 microversion: 2.1 time: 1.662861 Sep 07 12:47:09.987003 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1719/3455] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:08 2022] GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1 => generated 1325 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:10.004735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1b77e184-e253-419a-91b2-3a861b780003 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:10.011191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1b77e184-e253-419a-91b2-3a861b780003 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:10.031861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b77e184-e253-419a-91b2-3a861b780003 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:10.041821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b77e184-e253-419a-91b2-3a861b780003 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:10.042552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b77e184-e253-419a-91b2-3a861b780003 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:10.043499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b77e184-e253-419a-91b2-3a861b780003 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:10.044920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b77e184-e253-419a-91b2-3a861b780003 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:10.047399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b77e184-e253-419a-91b2-3a861b780003 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:10.484908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1b77e184-e253-419a-91b2-3a861b780003 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:10.501028 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1b77e184-e253-419a-91b2-3a861b780003 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 200 len: 1275 microversion: 2.1 time: 0.511703 Sep 07 12:47:10.505790 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1720/3456] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:09 2022] GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 1275 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:10.521058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0fd4cbb9-7ec9-47bb-9a6a-aaba30e021aa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:10.527408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0fd4cbb9-7ec9-47bb-9a6a-aaba30e021aa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 6cf493cf-e2dc-4589-a81e-8eac7bbded71] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:10.571388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fd4cbb9-7ec9-47bb-9a6a-aaba30e021aa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:10.572366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fd4cbb9-7ec9-47bb-9a6a-aaba30e021aa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:10.572999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fd4cbb9-7ec9-47bb-9a6a-aaba30e021aa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:10.573987 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fd4cbb9-7ec9-47bb-9a6a-aaba30e021aa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:10.577873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fd4cbb9-7ec9-47bb-9a6a-aaba30e021aa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:10.579519 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fd4cbb9-7ec9-47bb-9a6a-aaba30e021aa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:10.635725 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-0fd4cbb9-7ec9-47bb-9a6a-aaba30e021aa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] HTTP exception thrown: Instance 6cf493cf-e2dc-4589-a81e-8eac7bbded71 could not be found. Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0fd4cbb9-7ec9-47bb-9a6a-aaba30e021aa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Request method failure captured: Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 HTTP/1.1 Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJIhxP31yvacjUfYAigOJyu0QLh1yvKwW4JWZ7EvdqFgFhQGBFX8Y4hRvcGkvQKlZ6n51X42OjWVv8w4WkESigwMWd2weuiz2qyy_D1ZS6RAa5f7lE2uWK5W0Q3qynyfmhSvOqIpd0l4mxIhos9nnlr7svOQSy7D5Uxk7bAR62kurpc Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: bc8452d8eab643549a30030eda3f40ba Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerRescueTestJSON-222200472 Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bc8452d8eab643549a30030eda3f40ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bc8452d8eab643549a30030eda3f40ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bc8452d8eab643549a30030eda3f40ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bc8452d8eab643549a30030eda3f40ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerRescueTestJSON-222200472 Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: bc8452d8eab643549a30030eda3f40ba Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerRescueTestJSON-222200472 Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerRescueTestJSON-222200472-project Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 1824fe66513042c98d1157166f227bc7 Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerRescueTestJSON-222200472-project Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 6cf493cf-e2dc-4589-a81e-8eac7bbded71 could not be found. Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '6cf493cf-e2dc-4589-a81e-8eac7bbded71'} Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cf493cf-e2dc-4589-a81e-8eac7bbded71 could not be found. Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cf493cf-e2dc-4589-a81e-8eac7bbded71 could not be found. Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:47:10.637884 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:47:10.643026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:47:10.643026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:47:10.643026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:47:10.643026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:47:10.643026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:47:10.643026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cf493cf-e2dc-4589-a81e-8eac7bbded71 could not be found. Sep 07 12:47:10.643026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:47:10.655059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0fd4cbb9-7ec9-47bb-9a6a-aaba30e021aa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Returning 404 to user: Instance 6cf493cf-e2dc-4589-a81e-8eac7bbded71 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:47:10.655984 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0fd4cbb9-7ec9-47bb-9a6a-aaba30e021aa tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71" status: 404 len: 111 microversion: 2.1 time: 0.147340 Sep 07 12:47:10.672229 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1721/3457] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:10 2022] GET /compute/v2.1/servers/6cf493cf-e2dc-4589-a81e-8eac7bbded71 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:47:10.684275 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-421fe56b-8028-4813-b5c1-72bbb928e0da tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:10.695753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-384cdbee-997c-4679-bb0d-b17dbd4faec1 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:10.696301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-384cdbee-997c-4679-bb0d-b17dbd4faec1 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:10.717103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-384cdbee-997c-4679-bb0d-b17dbd4faec1 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:10.730380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-421fe56b-8028-4813-b5c1-72bbb928e0da tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:10.731118 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-384cdbee-997c-4679-bb0d-b17dbd4faec1 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:10.733564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-384cdbee-997c-4679-bb0d-b17dbd4faec1 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:10.734874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-384cdbee-997c-4679-bb0d-b17dbd4faec1 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:10.736382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-384cdbee-997c-4679-bb0d-b17dbd4faec1 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:10.738685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-384cdbee-997c-4679-bb0d-b17dbd4faec1 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:10.739493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-421fe56b-8028-4813-b5c1-72bbb928e0da tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:10.749466 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-421fe56b-8028-4813-b5c1-72bbb928e0da tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1661 microversion: 2.42 time: 0.866762 Sep 07 12:47:10.752969 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1737/3458] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:47:09 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1661 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:47:10.764885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-337e3b5e-a163-4b52-b5e1-1563a8ec3663 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:10.765916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-337e3b5e-a163-4b52-b5e1-1563a8ec3663 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:10.792405 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-337e3b5e-a163-4b52-b5e1-1563a8ec3663 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:10.793195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-337e3b5e-a163-4b52-b5e1-1563a8ec3663 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:10.793956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-337e3b5e-a163-4b52-b5e1-1563a8ec3663 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:10.795892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-337e3b5e-a163-4b52-b5e1-1563a8ec3663 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:10.796631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-337e3b5e-a163-4b52-b5e1-1563a8ec3663 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:10.797562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-337e3b5e-a163-4b52-b5e1-1563a8ec3663 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:10.878747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-384cdbee-997c-4679-bb0d-b17dbd4faec1 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:47:11.143184 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-384cdbee-997c-4679-bb0d-b17dbd4faec1 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 204 len: 0 microversion: 2.1 time: 0.469176 Sep 07 12:47:11.144322 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1722/3459] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:47:10 2022] DELETE /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:47:11.164610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-39d500f7-6862-4098-b849-d5a3436dddc6 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc41d105b80>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:11.325778 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-39d500f7-6862-4098-b849-d5a3436dddc6 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81" status: 200 len: 1454 microversion: 2.1 time: 0.175856 Sep 07 12:47:11.326581 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1723/3460] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:47:11 2022] GET /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81 => generated 1454 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:11.345382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-958a873a-1bf1-4b01-be94-d1cc7cdb5205 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:11.350712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-958a873a-1bf1-4b01-be94-d1cc7cdb5205 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] [instance: d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:11.373393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:47:11.374977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-958a873a-1bf1-4b01-be94-d1cc7cdb5205 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:11.375585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-958a873a-1bf1-4b01-be94-d1cc7cdb5205 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:11.381666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-958a873a-1bf1-4b01-be94-d1cc7cdb5205 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:11.382756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-958a873a-1bf1-4b01-be94-d1cc7cdb5205 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:11.383265 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-958a873a-1bf1-4b01-be94-d1cc7cdb5205 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:11.383822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-958a873a-1bf1-4b01-be94-d1cc7cdb5205 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:11.439319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:47:11.696523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-337e3b5e-a163-4b52-b5e1-1563a8ec3663 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:11.717238 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-337e3b5e-a163-4b52-b5e1-1563a8ec3663 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e" status: 200 len: 1522 microversion: 2.1 time: 0.955237 Sep 07 12:47:11.718414 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1738/3461] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:10 2022] GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e => generated 1522 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:11.733006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aad2b7d0-07ae-46de-a23f-89e7936f5b6f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:11.736301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aad2b7d0-07ae-46de-a23f-89e7936f5b6f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:11.758341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aad2b7d0-07ae-46de-a23f-89e7936f5b6f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:11.759361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aad2b7d0-07ae-46de-a23f-89e7936f5b6f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:11.760115 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aad2b7d0-07ae-46de-a23f-89e7936f5b6f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:11.761123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aad2b7d0-07ae-46de-a23f-89e7936f5b6f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:11.761880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aad2b7d0-07ae-46de-a23f-89e7936f5b6f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:11.763224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aad2b7d0-07ae-46de-a23f-89e7936f5b6f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:11.779509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-958a873a-1bf1-4b01-be94-d1cc7cdb5205 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6902480075db4d7bb4be2306197cfbc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3ae4d905a7493289a242cc9ce5a051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:11.796984 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-958a873a-1bf1-4b01-be94-d1cc7cdb5205 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] 10.222.0.16 "GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1" status: 200 len: 1325 microversion: 2.1 time: 0.457670 Sep 07 12:47:11.798231 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1724/3462] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:11 2022] GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1 => generated 1325 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:11.803906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-33a68076-5886-4cc8-90ce-ec52a1a9b2af tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:11.808229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-33a68076-5886-4cc8-90ce-ec52a1a9b2af tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:11.821622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33a68076-5886-4cc8-90ce-ec52a1a9b2af tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:11.830300 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33a68076-5886-4cc8-90ce-ec52a1a9b2af tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:11.831036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33a68076-5886-4cc8-90ce-ec52a1a9b2af tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:11.832094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33a68076-5886-4cc8-90ce-ec52a1a9b2af tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:11.833623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33a68076-5886-4cc8-90ce-ec52a1a9b2af tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:11.834276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33a68076-5886-4cc8-90ce-ec52a1a9b2af tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:12.262121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-33a68076-5886-4cc8-90ce-ec52a1a9b2af tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:12.278639 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-33a68076-5886-4cc8-90ce-ec52a1a9b2af tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 200 len: 1317 microversion: 2.1 time: 0.479101 Sep 07 12:47:12.279924 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1725/3463] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:11 2022] GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 1317 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:12.292675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-edd97ae0-b19d-4278-9d25-6d2030ad75c1 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:12.293536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-edd97ae0-b19d-4278-9d25-6d2030ad75c1 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:12.311855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edd97ae0-b19d-4278-9d25-6d2030ad75c1 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:12.312660 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edd97ae0-b19d-4278-9d25-6d2030ad75c1 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:12.313274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edd97ae0-b19d-4278-9d25-6d2030ad75c1 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:12.314250 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edd97ae0-b19d-4278-9d25-6d2030ad75c1 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:12.314890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edd97ae0-b19d-4278-9d25-6d2030ad75c1 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:12.315478 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edd97ae0-b19d-4278-9d25-6d2030ad75c1 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:12.320036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aad2b7d0-07ae-46de-a23f-89e7936f5b6f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:12.341298 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aad2b7d0-07ae-46de-a23f-89e7936f5b6f tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1492 microversion: 2.1 time: 0.621349 Sep 07 12:47:12.342508 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1739/3464] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:11 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1492 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:12.352527 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-41b5f768-0b15-47fd-b108-804998666e09 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc41872a040>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:12.448839 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-41b5f768-0b15-47fd-b108-804998666e09 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81" status: 200 len: 1454 microversion: 2.1 time: 0.096813 Sep 07 12:47:12.451154 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1740/3465] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:47:12 2022] GET /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81 => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:12.748266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-36cbb36e-48de-482b-b2e3-fc9657db71e3 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:12.749971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-36cbb36e-48de-482b-b2e3-fc9657db71e3 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:12.761747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36cbb36e-48de-482b-b2e3-fc9657db71e3 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:12.762704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36cbb36e-48de-482b-b2e3-fc9657db71e3 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:12.763874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36cbb36e-48de-482b-b2e3-fc9657db71e3 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:12.764920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36cbb36e-48de-482b-b2e3-fc9657db71e3 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:12.765685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36cbb36e-48de-482b-b2e3-fc9657db71e3 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:12.766375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36cbb36e-48de-482b-b2e3-fc9657db71e3 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:13.026687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-edd97ae0-b19d-4278-9d25-6d2030ad75c1 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:13.047482 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-36cbb36e-48de-482b-b2e3-fc9657db71e3 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:13.057309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-edd97ae0-b19d-4278-9d25-6d2030ad75c1 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:13.062244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-edd97ae0-b19d-4278-9d25-6d2030ad75c1 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:13.065628 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-36cbb36e-48de-482b-b2e3-fc9657db71e3 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e" status: 200 len: 1522 microversion: 2.1 time: 0.323496 Sep 07 12:47:13.066596 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-edd97ae0-b19d-4278-9d25-6d2030ad75c1 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1708 microversion: 2.42 time: 0.784339 Sep 07 12:47:13.067902 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1726/3466] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:47:12 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1708 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:47:13.070007 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1741/3467] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:12 2022] GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:47:13.079367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d6da9679-b96c-41fc-877f-2b97ce3e2d00 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:13.080938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d6da9679-b96c-41fc-877f-2b97ce3e2d00 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] [instance: d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:13.094184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6da9679-b96c-41fc-877f-2b97ce3e2d00 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:13.095510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6da9679-b96c-41fc-877f-2b97ce3e2d00 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:13.096590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6da9679-b96c-41fc-877f-2b97ce3e2d00 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:13.098147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6da9679-b96c-41fc-877f-2b97ce3e2d00 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:13.099270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6da9679-b96c-41fc-877f-2b97ce3e2d00 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:13.100317 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6da9679-b96c-41fc-877f-2b97ce3e2d00 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:13.234054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-38e0df4f-6c9c-4a4e-96bd-a82efe21b6df req-a6bc462f-4e04-45c8-b101-06e91818496b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5203be99-6bdd-42c2-955d-90ce3a228ed3", "tag": "7d26615d-741b-4cfa-a0ce-5b16555ea640"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:47:13.254940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:47:13.261008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=14 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:47:13.274589 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-38e0df4f-6c9c-4a4e-96bd-a82efe21b6df req-a6bc462f-4e04-45c8-b101-06e91818496b service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:13.277841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-38e0df4f-6c9c-4a4e-96bd-a82efe21b6df req-a6bc462f-4e04-45c8-b101-06e91818496b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:13.279163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-38e0df4f-6c9c-4a4e-96bd-a82efe21b6df req-a6bc462f-4e04-45c8-b101-06e91818496b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:13.313428 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-38e0df4f-6c9c-4a4e-96bd-a82efe21b6df req-a6bc462f-4e04-45c8-b101-06e91818496b service nova] Creating event network-changed:7d26615d-741b-4cfa-a0ce-5b16555ea640 for instance 5203be99-6bdd-42c2-955d-90ce3a228ed3 on n-h1-852087-9 Sep 07 12:47:13.324905 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-38e0df4f-6c9c-4a4e-96bd-a82efe21b6df req-a6bc462f-4e04-45c8-b101-06e91818496b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095001 Sep 07 12:47:13.326245 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1742/3468] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:47:13.332246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-820c5752-9d9e-4c67-847d-2e8b15b0666b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:13.340992 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-820c5752-9d9e-4c67-847d-2e8b15b0666b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:13.356603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-820c5752-9d9e-4c67-847d-2e8b15b0666b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:13.357504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-820c5752-9d9e-4c67-847d-2e8b15b0666b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:13.358121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-820c5752-9d9e-4c67-847d-2e8b15b0666b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:13.363578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-820c5752-9d9e-4c67-847d-2e8b15b0666b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:13.364362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-820c5752-9d9e-4c67-847d-2e8b15b0666b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:13.368060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-820c5752-9d9e-4c67-847d-2e8b15b0666b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:13.427563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:47:13.667584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d6da9679-b96c-41fc-877f-2b97ce3e2d00 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6902480075db4d7bb4be2306197cfbc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3ae4d905a7493289a242cc9ce5a051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:13.679834 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d6da9679-b96c-41fc-877f-2b97ce3e2d00 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] 10.222.0.16 "GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1" status: 200 len: 1325 microversion: 2.1 time: 0.609440 Sep 07 12:47:13.698871 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1727/3469] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:13 2022] GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1 => generated 1325 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:13.704862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f53f555e-c7cb-4e54-a9f3-4349a6f8a522 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:13.705373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f53f555e-c7cb-4e54-a9f3-4349a6f8a522 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:13.738898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f53f555e-c7cb-4e54-a9f3-4349a6f8a522 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:13.739339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f53f555e-c7cb-4e54-a9f3-4349a6f8a522 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:13.739947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f53f555e-c7cb-4e54-a9f3-4349a6f8a522 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:13.740708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f53f555e-c7cb-4e54-a9f3-4349a6f8a522 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:13.741183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f53f555e-c7cb-4e54-a9f3-4349a6f8a522 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:13.741652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f53f555e-c7cb-4e54-a9f3-4349a6f8a522 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:14.206512 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-820c5752-9d9e-4c67-847d-2e8b15b0666b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:14.242267 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-820c5752-9d9e-4c67-847d-2e8b15b0666b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 200 len: 1317 microversion: 2.1 time: 0.914515 Sep 07 12:47:14.244550 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1743/3470] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:13 2022] GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 1317 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:14.257180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fb200d2b-6baf-427b-aad8-90c4da07fa87 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4192cc160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:14.350587 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fb200d2b-6baf-427b-aad8-90c4da07fa87 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81" status: 200 len: 1454 microversion: 2.1 time: 0.102312 Sep 07 12:47:14.350934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f53f555e-c7cb-4e54-a9f3-4349a6f8a522 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:14.356650 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1744/3471] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:47:14 2022] GET /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81 => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:14.367213 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f53f555e-c7cb-4e54-a9f3-4349a6f8a522 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1492 microversion: 2.1 time: 0.671468 Sep 07 12:47:14.368487 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1728/3472] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:13 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1492 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:14.375265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ba688c8-d5dc-495c-a4b9-7d81a0f7afe1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:14.376277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b2674092-45cf-47b1-b0f7-4e7374b7a6d0 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:14.377171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b2674092-45cf-47b1-b0f7-4e7374b7a6d0 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:14.380441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0ba688c8-d5dc-495c-a4b9-7d81a0f7afe1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:14.395383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2674092-45cf-47b1-b0f7-4e7374b7a6d0 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:14.397701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2674092-45cf-47b1-b0f7-4e7374b7a6d0 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:14.398045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:47:14.399721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2674092-45cf-47b1-b0f7-4e7374b7a6d0 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:14.403361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2674092-45cf-47b1-b0f7-4e7374b7a6d0 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:14.403572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ba688c8-d5dc-495c-a4b9-7d81a0f7afe1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:14.404813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ba688c8-d5dc-495c-a4b9-7d81a0f7afe1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:14.406186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ba688c8-d5dc-495c-a4b9-7d81a0f7afe1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:14.407876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2674092-45cf-47b1-b0f7-4e7374b7a6d0 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:14.408313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ba688c8-d5dc-495c-a4b9-7d81a0f7afe1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:14.408489 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2674092-45cf-47b1-b0f7-4e7374b7a6d0 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:14.409845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ba688c8-d5dc-495c-a4b9-7d81a0f7afe1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:14.411025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ba688c8-d5dc-495c-a4b9-7d81a0f7afe1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:14.882650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b2674092-45cf-47b1-b0f7-4e7374b7a6d0 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:14.916709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b2674092-45cf-47b1-b0f7-4e7374b7a6d0 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:14.920290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b2674092-45cf-47b1-b0f7-4e7374b7a6d0 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:14.928928 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b2674092-45cf-47b1-b0f7-4e7374b7a6d0 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1708 microversion: 2.42 time: 0.558553 Sep 07 12:47:14.949533 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1729/3473] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:47:14 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1708 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:47:14.983904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e7257dc5-7314-44a8-800e-2c0f6c1e2193 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:14.985695 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e7257dc5-7314-44a8-800e-2c0f6c1e2193 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] [instance: d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:15.001868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0ba688c8-d5dc-495c-a4b9-7d81a0f7afe1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:15.016018 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ba688c8-d5dc-495c-a4b9-7d81a0f7afe1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e" status: 200 len: 1522 microversion: 2.1 time: 0.657226 Sep 07 12:47:15.016771 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1745/3474] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:14 2022] GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e => generated 1522 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:15.029838 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7257dc5-7314-44a8-800e-2c0f6c1e2193 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:15.029838 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7257dc5-7314-44a8-800e-2c0f6c1e2193 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:15.029838 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7257dc5-7314-44a8-800e-2c0f6c1e2193 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:15.029838 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7257dc5-7314-44a8-800e-2c0f6c1e2193 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:15.029838 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7257dc5-7314-44a8-800e-2c0f6c1e2193 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:15.029838 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7257dc5-7314-44a8-800e-2c0f6c1e2193 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:15.193354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a4194d6d-d932-4a9a-afe4-f28dc3fbb980 req-54e07d09-5734-4e5f-80bd-528506e8f5de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1", "name": "network-vif-plugged", "status": "completed", "tag": "9ead8f12-20d6-4b8b-97f1-2379de7610c7"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:47:15.209222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a4194d6d-d932-4a9a-afe4-f28dc3fbb980 req-54e07d09-5734-4e5f-80bd-528506e8f5de service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:15.210812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a4194d6d-d932-4a9a-afe4-f28dc3fbb980 req-54e07d09-5734-4e5f-80bd-528506e8f5de service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:15.211505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a4194d6d-d932-4a9a-afe4-f28dc3fbb980 req-54e07d09-5734-4e5f-80bd-528506e8f5de service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:15.232125 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a4194d6d-d932-4a9a-afe4-f28dc3fbb980 req-54e07d09-5734-4e5f-80bd-528506e8f5de service nova] Creating event network-vif-plugged:9ead8f12-20d6-4b8b-97f1-2379de7610c7 for instance d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1 on n-h2-852087-9 Sep 07 12:47:15.259985 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a4194d6d-d932-4a9a-afe4-f28dc3fbb980 req-54e07d09-5734-4e5f-80bd-528506e8f5de service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062914 Sep 07 12:47:15.268088 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1746/3475] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:47:15.274437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9e4e8537-3292-4f14-a862-684882eb6333 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:15.279849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9e4e8537-3292-4f14-a862-684882eb6333 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:15.300761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e4e8537-3292-4f14-a862-684882eb6333 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:15.300761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e4e8537-3292-4f14-a862-684882eb6333 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:15.301584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e4e8537-3292-4f14-a862-684882eb6333 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:15.305464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e4e8537-3292-4f14-a862-684882eb6333 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:15.308297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e4e8537-3292-4f14-a862-684882eb6333 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:15.308921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e4e8537-3292-4f14-a862-684882eb6333 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:16.383751 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e7257dc5-7314-44a8-800e-2c0f6c1e2193 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6902480075db4d7bb4be2306197cfbc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3ae4d905a7493289a242cc9ce5a051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:16.394118 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e7257dc5-7314-44a8-800e-2c0f6c1e2193 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] 10.222.0.16 "GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1" status: 200 len: 1325 microversion: 2.1 time: 1.441933 Sep 07 12:47:16.401399 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1730/3476] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:14 2022] GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1 => generated 1325 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:16.407483 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2add2906-9ef6-4ebf-a9ec-a3184f9b57ac tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4180f9c10>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:16.586699 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2add2906-9ef6-4ebf-a9ec-a3184f9b57ac tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81" status: 200 len: 1454 microversion: 2.1 time: 0.183175 Sep 07 12:47:16.587316 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1731/3477] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:47:16 2022] GET /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81 => generated 1454 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:16.599502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32f5bdc6-97c8-4450-ae4a-b316134e308a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:16.600145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-32f5bdc6-97c8-4450-ae4a-b316134e308a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:16.621331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32f5bdc6-97c8-4450-ae4a-b316134e308a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:16.621863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32f5bdc6-97c8-4450-ae4a-b316134e308a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:16.628017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32f5bdc6-97c8-4450-ae4a-b316134e308a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:16.629167 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32f5bdc6-97c8-4450-ae4a-b316134e308a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:16.638418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32f5bdc6-97c8-4450-ae4a-b316134e308a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:16.639164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32f5bdc6-97c8-4450-ae4a-b316134e308a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:17.027963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9e4e8537-3292-4f14-a862-684882eb6333 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:17.042897 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9e4e8537-3292-4f14-a862-684882eb6333 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 200 len: 1317 microversion: 2.1 time: 1.773444 Sep 07 12:47:17.043927 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1747/3478] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:15 2022] GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 1317 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:17.054741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2248ed5c-b637-4592-8bd8-b21ca1722eb6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:17.055371 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2248ed5c-b637-4592-8bd8-b21ca1722eb6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:17.093210 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2248ed5c-b637-4592-8bd8-b21ca1722eb6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:17.093755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2248ed5c-b637-4592-8bd8-b21ca1722eb6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:17.094272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2248ed5c-b637-4592-8bd8-b21ca1722eb6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:17.095016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2248ed5c-b637-4592-8bd8-b21ca1722eb6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:17.095485 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2248ed5c-b637-4592-8bd8-b21ca1722eb6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:17.095923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2248ed5c-b637-4592-8bd8-b21ca1722eb6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:18.463803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-32f5bdc6-97c8-4450-ae4a-b316134e308a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:18.483228 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-32f5bdc6-97c8-4450-ae4a-b316134e308a tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1492 microversion: 2.1 time: 1.894700 Sep 07 12:47:18.489037 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1732/3479] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:16 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1492 bytes in 1901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:18.511730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-93168d20-c273-4d98-ad36-8d97933af4ad tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:18.533362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-93168d20-c273-4d98-ad36-8d97933af4ad tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:18.586677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93168d20-c273-4d98-ad36-8d97933af4ad tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:18.594339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93168d20-c273-4d98-ad36-8d97933af4ad tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:18.598969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93168d20-c273-4d98-ad36-8d97933af4ad tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:18.602092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93168d20-c273-4d98-ad36-8d97933af4ad tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:18.607726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93168d20-c273-4d98-ad36-8d97933af4ad tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:18.609878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93168d20-c273-4d98-ad36-8d97933af4ad tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:18.799053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2248ed5c-b637-4592-8bd8-b21ca1722eb6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:18.817094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2248ed5c-b637-4592-8bd8-b21ca1722eb6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:18.827085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2248ed5c-b637-4592-8bd8-b21ca1722eb6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:18.841169 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2248ed5c-b637-4592-8bd8-b21ca1722eb6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1755 microversion: 2.42 time: 1.794029 Sep 07 12:47:18.844007 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1748/3480] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:47:17 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1755 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:47:18.878863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-96313f96-874c-4a92-ad09-6fe76c8d183a tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:18.880319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-96313f96-874c-4a92-ad09-6fe76c8d183a tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] [instance: d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:18.930558 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96313f96-874c-4a92-ad09-6fe76c8d183a tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:18.933308 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96313f96-874c-4a92-ad09-6fe76c8d183a tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:18.936201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96313f96-874c-4a92-ad09-6fe76c8d183a tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:18.937133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96313f96-874c-4a92-ad09-6fe76c8d183a tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:18.939958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96313f96-874c-4a92-ad09-6fe76c8d183a tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:18.940414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96313f96-874c-4a92-ad09-6fe76c8d183a tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:20.172193 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-93168d20-c273-4d98-ad36-8d97933af4ad tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:20.196778 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-93168d20-c273-4d98-ad36-8d97933af4ad tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e" status: 200 len: 1522 microversion: 2.1 time: 1.706230 Sep 07 12:47:20.198736 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1733/3481] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:18 2022] GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e => generated 1522 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:20.205236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-96f729af-ebcc-4013-aac8-c3630ac35b09 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4181e7ee0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:20.274510 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-96313f96-874c-4a92-ad09-6fe76c8d183a tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6902480075db4d7bb4be2306197cfbc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3ae4d905a7493289a242cc9ce5a051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:20.303681 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-96313f96-874c-4a92-ad09-6fe76c8d183a tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] 10.222.0.16 "GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1" status: 200 len: 1522 microversion: 2.1 time: 1.453985 Sep 07 12:47:20.335630 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-96f729af-ebcc-4013-aac8-c3630ac35b09 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81" status: 200 len: 1454 microversion: 2.1 time: 0.133394 Sep 07 12:47:20.340244 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1734/3482] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:47:20 2022] GET /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81 => generated 1454 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:20.341117 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1749/3483] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:18 2022] GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1 => generated 1522 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:20.350510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4597f1fd-f9ff-46ea-9160-20d5ee45957a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:20.352517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4597f1fd-f9ff-46ea-9160-20d5ee45957a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:20.356329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-44f62429-0c6a-4347-9fc3-34c5d5ca9335 req-b2e4903a-db48-43fc-8ef8-f671fa634a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91762428-7354-4926-b463-edc357e1e7cf", "name": "network-vif-plugged", "status": "completed", "tag": "8dbc8ca0-72c8-4de0-87af-ac6f1b8ece18"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:47:20.367578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4597f1fd-f9ff-46ea-9160-20d5ee45957a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:20.368094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4597f1fd-f9ff-46ea-9160-20d5ee45957a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:20.368610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4597f1fd-f9ff-46ea-9160-20d5ee45957a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:20.369345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4597f1fd-f9ff-46ea-9160-20d5ee45957a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:20.375431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4597f1fd-f9ff-46ea-9160-20d5ee45957a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:20.376251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4597f1fd-f9ff-46ea-9160-20d5ee45957a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:20.377017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-44f62429-0c6a-4347-9fc3-34c5d5ca9335 req-b2e4903a-db48-43fc-8ef8-f671fa634a3c service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:20.377954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-44f62429-0c6a-4347-9fc3-34c5d5ca9335 req-b2e4903a-db48-43fc-8ef8-f671fa634a3c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:20.378691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-44f62429-0c6a-4347-9fc3-34c5d5ca9335 req-b2e4903a-db48-43fc-8ef8-f671fa634a3c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:20.399357 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-44f62429-0c6a-4347-9fc3-34c5d5ca9335 req-b2e4903a-db48-43fc-8ef8-f671fa634a3c service nova] Creating event network-vif-plugged:8dbc8ca0-72c8-4de0-87af-ac6f1b8ece18 for instance 91762428-7354-4926-b463-edc357e1e7cf on n-h1-852087-9 Sep 07 12:47:20.425982 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-44f62429-0c6a-4347-9fc3-34c5d5ca9335 req-b2e4903a-db48-43fc-8ef8-f671fa634a3c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082264 Sep 07 12:47:20.427403 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1750/3484] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:47:20.452993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-fb0572aa-a67e-4d16-a6ff-b33a3feb5b04 req-4abfa2dc-35ed-4de3-a61a-484dba49db7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4510b67f-d3c1-4341-a4aa-deda75761799", "name": "network-vif-deleted", "tag": "29290a05-6053-4199-a000-3cc6b7487504"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:47:20.478461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fb0572aa-a67e-4d16-a6ff-b33a3feb5b04 req-4abfa2dc-35ed-4de3-a61a-484dba49db7e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:20.481758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fb0572aa-a67e-4d16-a6ff-b33a3feb5b04 req-4abfa2dc-35ed-4de3-a61a-484dba49db7e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:20.485709 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fb0572aa-a67e-4d16-a6ff-b33a3feb5b04 req-4abfa2dc-35ed-4de3-a61a-484dba49db7e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:20.540219 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-fb0572aa-a67e-4d16-a6ff-b33a3feb5b04 req-4abfa2dc-35ed-4de3-a61a-484dba49db7e service nova] Creating event network-vif-deleted:29290a05-6053-4199-a000-3cc6b7487504 for instance 4510b67f-d3c1-4341-a4aa-deda75761799 on n-h1-852087-9 Sep 07 12:47:20.573023 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-fb0572aa-a67e-4d16-a6ff-b33a3feb5b04 req-4abfa2dc-35ed-4de3-a61a-484dba49db7e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138823 Sep 07 12:47:20.574587 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1751/3485] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:47:20.586945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d1d0ae92-58e0-4396-a547-cedd9a23c2b7 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:20.589085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d1d0ae92-58e0-4396-a547-cedd9a23c2b7 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:20.603860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1d0ae92-58e0-4396-a547-cedd9a23c2b7 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:20.605325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1d0ae92-58e0-4396-a547-cedd9a23c2b7 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:20.609694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1d0ae92-58e0-4396-a547-cedd9a23c2b7 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:20.611530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1d0ae92-58e0-4396-a547-cedd9a23c2b7 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:20.612785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1d0ae92-58e0-4396-a547-cedd9a23c2b7 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:20.613735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1d0ae92-58e0-4396-a547-cedd9a23c2b7 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:20.695396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:47:20.741529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1d0ae92-58e0-4396-a547-cedd9a23c2b7 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:20.745384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1d0ae92-58e0-4396-a547-cedd9a23c2b7 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:20.750533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1d0ae92-58e0-4396-a547-cedd9a23c2b7 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:20.751664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-d1d0ae92-58e0-4396-a547-cedd9a23c2b7 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lazy-loading 'fault' on Instance uuid 4510b67f-d3c1-4341-a4aa-deda75761799 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:47:21.477070 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d1d0ae92-58e0-4396-a547-cedd9a23c2b7 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1824fe66513042c98d1157166f227bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8452d8eab643549a30030eda3f40ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:21.507799 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d1d0ae92-58e0-4396-a547-cedd9a23c2b7 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 200 len: 1304 microversion: 2.1 time: 0.930449 Sep 07 12:47:21.541159 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1752/3486] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:20 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 1304 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:21.560155 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dec92c18-04d4-420b-90b1-47a74c5b71d1 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:21.567765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dec92c18-04d4-420b-90b1-47a74c5b71d1 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:21.585171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dec92c18-04d4-420b-90b1-47a74c5b71d1 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:21.586722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dec92c18-04d4-420b-90b1-47a74c5b71d1 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:21.588089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dec92c18-04d4-420b-90b1-47a74c5b71d1 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:21.589776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dec92c18-04d4-420b-90b1-47a74c5b71d1 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:21.594070 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dec92c18-04d4-420b-90b1-47a74c5b71d1 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:21.595377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dec92c18-04d4-420b-90b1-47a74c5b71d1 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:22.650525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4597f1fd-f9ff-46ea-9160-20d5ee45957a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:22.667744 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4597f1fd-f9ff-46ea-9160-20d5ee45957a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 200 len: 1317 microversion: 2.1 time: 2.322674 Sep 07 12:47:22.671747 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1735/3487] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:20 2022] GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 1317 bytes in 2330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:22.716452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-76fed364-40c1-4742-9945-71d06cb2f818 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:22.720328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-76fed364-40c1-4742-9945-71d06cb2f818 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] [instance: d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:22.747516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76fed364-40c1-4742-9945-71d06cb2f818 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:22.757535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76fed364-40c1-4742-9945-71d06cb2f818 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:22.758833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76fed364-40c1-4742-9945-71d06cb2f818 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:22.760534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76fed364-40c1-4742-9945-71d06cb2f818 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:22.761800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76fed364-40c1-4742-9945-71d06cb2f818 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:22.762890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76fed364-40c1-4742-9945-71d06cb2f818 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:22.922715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dec92c18-04d4-420b-90b1-47a74c5b71d1 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:22.939638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dec92c18-04d4-420b-90b1-47a74c5b71d1 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:22.942935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dec92c18-04d4-420b-90b1-47a74c5b71d1 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:22.946265 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-76fed364-40c1-4742-9945-71d06cb2f818 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] HTTP exception thrown: Instance is not a member of specified network Sep 07 12:47:22.946611 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dec92c18-04d4-420b-90b1-47a74c5b71d1 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1802 microversion: 2.42 time: 1.402421 Sep 07 12:47:22.948862 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1753/3488] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:47:21 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1802 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:47:22.962707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b7539649-0cb2-4a62-92f0-cb5e72fa90f4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:22.964469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b7539649-0cb2-4a62-92f0-cb5e72fa90f4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:23.035552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7539649-0cb2-4a62-92f0-cb5e72fa90f4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-76fed364-40c1-4742-9945-71d06cb2f818 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Request method failure captured: Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1/ips/invalid HTTP/1.1 Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJKvQFH-aDf6SC29kXAco1k5U9jQcSAbwZ6H2CdFNL8LAuWxYza5cRCzWaXpEq20lF4AiTDhnllFREFspM2xp7uUOLmwTNRe9BB8XnvyG4OigM3WzNOXcA6ev9j6pyUbdxDF6DbJN7X_jWy0KUj13xkoYOGNJd5R_wkLYqut0CUKN6Y Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 6b3ae4d905a7493289a242cc9ce5a051 Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1651183701 Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b3ae4d905a7493289a242cc9ce5a051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6b3ae4d905a7493289a242cc9ce5a051"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6b3ae4d905a7493289a242cc9ce5a051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b3ae4d905a7493289a242cc9ce5a051"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1651183701 Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 6b3ae4d905a7493289a242cc9ce5a051 Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1651183701 Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerAddressesNegativeTestJSON-1651183701-project Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6902480075db4d7bb4be2306197cfbc0 Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1651183701-project Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance is not a member of specified network Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'server_id': 'd49e3a99-5b6e-4c8c-989f-b689d2d7f3f1', 'id': 'invalid'} Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Sep 07 12:47:23.035823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:47:23.041667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7539649-0cb2-4a62-92f0-cb5e72fa90f4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:23.042568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-76fed364-40c1-4742-9945-71d06cb2f818 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:47:23.043283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7539649-0cb2-4a62-92f0-cb5e72fa90f4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:23.046782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7539649-0cb2-4a62-92f0-cb5e72fa90f4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:23.047599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7539649-0cb2-4a62-92f0-cb5e72fa90f4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:23.048277 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7539649-0cb2-4a62-92f0-cb5e72fa90f4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:23.054792 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-76fed364-40c1-4742-9945-71d06cb2f818 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] 10.222.0.16 "GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.372361 Sep 07 12:47:23.064233 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1736/3489] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 12:47:22 2022] GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1/ips/invalid => generated 91 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:47:23.083321 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-76f24e50-2203-40e6-94eb-7664c93ca85d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4180cf040>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:23.907242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b7539649-0cb2-4a62-92f0-cb5e72fa90f4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:23.938160 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b7539649-0cb2-4a62-92f0-cb5e72fa90f4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e" status: 200 len: 1522 microversion: 2.1 time: 0.986554 Sep 07 12:47:23.964758 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1754/3490] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:22 2022] GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e => generated 1522 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:23.976908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aa6082ef-9e6f-45ee-99b7-4a7c0ac6c3e6 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:23.986504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aa6082ef-9e6f-45ee-99b7-4a7c0ac6c3e6 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] [instance: 4510b67f-d3c1-4341-a4aa-deda75761799] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:24.007208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa6082ef-9e6f-45ee-99b7-4a7c0ac6c3e6 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:24.008846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa6082ef-9e6f-45ee-99b7-4a7c0ac6c3e6 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:24.013707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa6082ef-9e6f-45ee-99b7-4a7c0ac6c3e6 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:24.015199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa6082ef-9e6f-45ee-99b7-4a7c0ac6c3e6 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:24.021971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa6082ef-9e6f-45ee-99b7-4a7c0ac6c3e6 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:24.022773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa6082ef-9e6f-45ee-99b7-4a7c0ac6c3e6 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:24.149079 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-aa6082ef-9e6f-45ee-99b7-4a7c0ac6c3e6 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] HTTP exception thrown: Instance 4510b67f-d3c1-4341-a4aa-deda75761799 could not be found. Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aa6082ef-9e6f-45ee-99b7-4a7c0ac6c3e6 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Request method failure captured: Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 HTTP/1.1 Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJIhxP31yvacjUfYAigOJyu0QLh1yvKwW4JWZ7EvdqFgFhQGBFX8Y4hRvcGkvQKlZ6n51X42OjWVv8w4WkESigwMWd2weuiz2qyy_D1ZS6RAa5f7lE2uWK5W0Q3qynyfmhSvOqIpd0l4mxIhos9nnlr7svOQSy7D5Uxk7bAR62kurpc Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: bc8452d8eab643549a30030eda3f40ba Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerRescueTestJSON-222200472 Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bc8452d8eab643549a30030eda3f40ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bc8452d8eab643549a30030eda3f40ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bc8452d8eab643549a30030eda3f40ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bc8452d8eab643549a30030eda3f40ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerRescueTestJSON-222200472 Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: bc8452d8eab643549a30030eda3f40ba Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerRescueTestJSON-222200472 Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerRescueTestJSON-222200472-project Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 1824fe66513042c98d1157166f227bc7 Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerRescueTestJSON-222200472-project Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 4510b67f-d3c1-4341-a4aa-deda75761799 could not be found. Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '4510b67f-d3c1-4341-a4aa-deda75761799'} Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4510b67f-d3c1-4341-a4aa-deda75761799 could not be found. Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4510b67f-d3c1-4341-a4aa-deda75761799 could not be found. Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:47:24.154892 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:47:24.164874 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:47:24.164874 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:47:24.164874 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:47:24.164874 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:47:24.164874 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:47:24.164874 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4510b67f-d3c1-4341-a4aa-deda75761799 could not be found. Sep 07 12:47:24.164874 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:47:24.172055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aa6082ef-9e6f-45ee-99b7-4a7c0ac6c3e6 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] Returning 404 to user: Instance 4510b67f-d3c1-4341-a4aa-deda75761799 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:47:24.175970 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aa6082ef-9e6f-45ee-99b7-4a7c0ac6c3e6 tempest-ServerRescueTestJSON-222200472 tempest-ServerRescueTestJSON-222200472-project] 10.222.0.16 "GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799" status: 404 len: 111 microversion: 2.1 time: 0.209542 Sep 07 12:47:24.179573 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1755/3491] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:23 2022] GET /compute/v2.1/servers/4510b67f-d3c1-4341-a4aa-deda75761799 => generated 111 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:47:24.201649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b08c5699-f1b2-431c-a348-9de2012228dc tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:24.204584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b08c5699-f1b2-431c-a348-9de2012228dc tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Failed to fetch instance by id 999 {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 07 12:47:24.206015 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-b08c5699-f1b2-431c-a348-9de2012228dc tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] HTTP exception thrown: Instance 999 could not be found. Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b08c5699-f1b2-431c-a348-9de2012228dc tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Request method failure captured: Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJKvQFH-aDf6SC29kXAco1k5U9jQcSAbwZ6H2CdFNL8LAuWxYza5cRCzWaXpEq20lF4AiTDhnllFREFspM2xp7uUOLmwTNRe9BB8XnvyG4OigM3WzNOXcA6ev9j6pyUbdxDF6DbJN7X_jWy0KUj13xkoYOGNJd5R_wkLYqut0CUKN6Y Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 6b3ae4d905a7493289a242cc9ce5a051 Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1651183701 Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b3ae4d905a7493289a242cc9ce5a051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6b3ae4d905a7493289a242cc9ce5a051"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6b3ae4d905a7493289a242cc9ce5a051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b3ae4d905a7493289a242cc9ce5a051"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1651183701 Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 6b3ae4d905a7493289a242cc9ce5a051 Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1651183701 Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerAddressesNegativeTestJSON-1651183701-project Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6902480075db4d7bb4be2306197cfbc0 Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1651183701-project Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 999 could not be found. Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'server_id': '999'} Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 07 12:47:24.211688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:47:24.221811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b08c5699-f1b2-431c-a348-9de2012228dc tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:47:24.223765 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b08c5699-f1b2-431c-a348-9de2012228dc tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] 10.222.0.16 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.042067 Sep 07 12:47:24.225116 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1756/3492] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Sep 7 12:47:24 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:47:24.250614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-713759f6-9ea7-4f5f-87c4-2b21843a0b9c tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:24.252311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-713759f6-9ea7-4f5f-87c4-2b21843a0b9c tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:24.267517 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-713759f6-9ea7-4f5f-87c4-2b21843a0b9c tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:24.268835 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-713759f6-9ea7-4f5f-87c4-2b21843a0b9c tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:24.269977 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-713759f6-9ea7-4f5f-87c4-2b21843a0b9c tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:24.271563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-713759f6-9ea7-4f5f-87c4-2b21843a0b9c tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:24.272647 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-713759f6-9ea7-4f5f-87c4-2b21843a0b9c tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:24.273798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-713759f6-9ea7-4f5f-87c4-2b21843a0b9c tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:26.945111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-713759f6-9ea7-4f5f-87c4-2b21843a0b9c tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:27.005865 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-713759f6-9ea7-4f5f-87c4-2b21843a0b9c tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 200 len: 1317 microversion: 2.1 time: 2.768421 Sep 07 12:47:27.011799 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1757/3493] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:24 2022] GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 1317 bytes in 2785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:27.038370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-91f2202e-20fd-4641-a4a9-3adeb49abd1c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:27.039465 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-91f2202e-20fd-4641-a4a9-3adeb49abd1c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:27.129263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91f2202e-20fd-4641-a4a9-3adeb49abd1c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:27.137446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91f2202e-20fd-4641-a4a9-3adeb49abd1c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:27.146562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91f2202e-20fd-4641-a4a9-3adeb49abd1c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:27.149894 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91f2202e-20fd-4641-a4a9-3adeb49abd1c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:27.158620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91f2202e-20fd-4641-a4a9-3adeb49abd1c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:27.167083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91f2202e-20fd-4641-a4a9-3adeb49abd1c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:29.613782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-91f2202e-20fd-4641-a4a9-3adeb49abd1c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:29.630085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-91f2202e-20fd-4641-a4a9-3adeb49abd1c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:29.669520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-91f2202e-20fd-4641-a4a9-3adeb49abd1c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:29.669520 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-91f2202e-20fd-4641-a4a9-3adeb49abd1c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1849 microversion: 2.42 time: 2.650680 Sep 07 12:47:29.672771 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1758/3494] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:47:27 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1849 bytes in 2660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:47:29.723951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c7a9e885-32e4-4300-9036-c87fc661e879 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:29.741007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c7a9e885-32e4-4300-9036-c87fc661e879 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] [instance: d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:29.819607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7a9e885-32e4-4300-9036-c87fc661e879 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:29.820234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7a9e885-32e4-4300-9036-c87fc661e879 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:29.820619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7a9e885-32e4-4300-9036-c87fc661e879 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:29.821371 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7a9e885-32e4-4300-9036-c87fc661e879 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:29.846234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7a9e885-32e4-4300-9036-c87fc661e879 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:29.846727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7a9e885-32e4-4300-9036-c87fc661e879 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:30.067931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c7a9e885-32e4-4300-9036-c87fc661e879 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] [instance: d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:47:30.597249 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c7a9e885-32e4-4300-9036-c87fc661e879 tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1" status: 204 len: 0 microversion: 2.1 time: 0.918889 Sep 07 12:47:30.598295 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1759/3495] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:47:29 2022] DELETE /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1 => generated 0 bytes in 925 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:47:30.629830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6a07abb8-1216-41f9-9f86-9aa9eb120089 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:30.642809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6a07abb8-1216-41f9-9f86-9aa9eb120089 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:30.683386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a07abb8-1216-41f9-9f86-9aa9eb120089 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:30.683915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a07abb8-1216-41f9-9f86-9aa9eb120089 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:30.689729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a07abb8-1216-41f9-9f86-9aa9eb120089 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:30.699460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a07abb8-1216-41f9-9f86-9aa9eb120089 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:30.700402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a07abb8-1216-41f9-9f86-9aa9eb120089 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:30.704645 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a07abb8-1216-41f9-9f86-9aa9eb120089 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:32.736304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=21 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:47:32.856615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=60 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:47:32.899940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6a07abb8-1216-41f9-9f86-9aa9eb120089 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:32.957123 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6a07abb8-1216-41f9-9f86-9aa9eb120089 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e" status: 200 len: 1522 microversion: 2.1 time: 2.357655 Sep 07 12:47:32.964716 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1760/3496] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:30 2022] GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e => generated 1522 bytes in 2366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:32.987941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4561a057-b5a7-40f4-ab12-2976291a67db tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:32.994922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4561a057-b5a7-40f4-ab12-2976291a67db tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:33.021794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4561a057-b5a7-40f4-ab12-2976291a67db tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:33.022593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4561a057-b5a7-40f4-ab12-2976291a67db tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:33.023180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4561a057-b5a7-40f4-ab12-2976291a67db tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:33.030421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4561a057-b5a7-40f4-ab12-2976291a67db tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:33.031079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4561a057-b5a7-40f4-ab12-2976291a67db tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:33.031645 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4561a057-b5a7-40f4-ab12-2976291a67db tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:34.199826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4561a057-b5a7-40f4-ab12-2976291a67db tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:34.214863 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4561a057-b5a7-40f4-ab12-2976291a67db tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 200 len: 1317 microversion: 2.1 time: 1.245696 Sep 07 12:47:34.220137 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1761/3497] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:32 2022] GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 1317 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:34.227005 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-89073267-3627-4f4c-b17e-80e5a3d6debc tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:34.233776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-89073267-3627-4f4c-b17e-80e5a3d6debc tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] [instance: d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:34.261602 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89073267-3627-4f4c-b17e-80e5a3d6debc tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:34.265548 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89073267-3627-4f4c-b17e-80e5a3d6debc tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:34.266997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89073267-3627-4f4c-b17e-80e5a3d6debc tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:34.268035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89073267-3627-4f4c-b17e-80e5a3d6debc tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:34.268720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89073267-3627-4f4c-b17e-80e5a3d6debc tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:34.269370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89073267-3627-4f4c-b17e-80e5a3d6debc tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:35.021050 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-89073267-3627-4f4c-b17e-80e5a3d6debc tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6902480075db4d7bb4be2306197cfbc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3ae4d905a7493289a242cc9ce5a051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:35.046826 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-89073267-3627-4f4c-b17e-80e5a3d6debc tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] 10.222.0.16 "GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1" status: 200 len: 1528 microversion: 2.1 time: 0.824026 Sep 07 12:47:35.048575 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1762/3498] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:34 2022] GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1 => generated 1528 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:35.067601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c66cfbfb-724f-499b-a262-56b872ce1f1f tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:35.082383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c66cfbfb-724f-499b-a262-56b872ce1f1f tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:35.110710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c66cfbfb-724f-499b-a262-56b872ce1f1f tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:35.112108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c66cfbfb-724f-499b-a262-56b872ce1f1f tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:35.115852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c66cfbfb-724f-499b-a262-56b872ce1f1f tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:35.121868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c66cfbfb-724f-499b-a262-56b872ce1f1f tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:35.127620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c66cfbfb-724f-499b-a262-56b872ce1f1f tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:35.133383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c66cfbfb-724f-499b-a262-56b872ce1f1f tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:36.089628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c66cfbfb-724f-499b-a262-56b872ce1f1f tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:36.104080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c66cfbfb-724f-499b-a262-56b872ce1f1f tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:36.107955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c66cfbfb-724f-499b-a262-56b872ce1f1f tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:36.111583 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c66cfbfb-724f-499b-a262-56b872ce1f1f tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1849 microversion: 2.42 time: 1.057441 Sep 07 12:47:36.113738 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1763/3499] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:47:35 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1849 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:47:36.141006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-f618e6b4-b3f0-44d0-b38e-91fd9f2d598f req-52b9573c-5f53-4b5c-9c9b-a1a4fd163864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5203be99-6bdd-42c2-955d-90ce3a228ed3", "name": "network-vif-plugged", "status": "completed", "tag": "7d26615d-741b-4cfa-a0ce-5b16555ea640"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:47:36.206839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f618e6b4-b3f0-44d0-b38e-91fd9f2d598f req-52b9573c-5f53-4b5c-9c9b-a1a4fd163864 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:36.207419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f618e6b4-b3f0-44d0-b38e-91fd9f2d598f req-52b9573c-5f53-4b5c-9c9b-a1a4fd163864 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:36.242777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f618e6b4-b3f0-44d0-b38e-91fd9f2d598f req-52b9573c-5f53-4b5c-9c9b-a1a4fd163864 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:36.242777 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-f618e6b4-b3f0-44d0-b38e-91fd9f2d598f req-52b9573c-5f53-4b5c-9c9b-a1a4fd163864 service nova] Creating event network-vif-plugged:7d26615d-741b-4cfa-a0ce-5b16555ea640 for instance 5203be99-6bdd-42c2-955d-90ce3a228ed3 on n-h1-852087-9 Sep 07 12:47:36.269904 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-f618e6b4-b3f0-44d0-b38e-91fd9f2d598f req-52b9573c-5f53-4b5c-9c9b-a1a4fd163864 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153320 Sep 07 12:47:36.272105 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1764/3500] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:47:36.289534 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-af7cfde9-e4a4-41bf-be5f-d2a33de1c2d9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:36.290357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-af7cfde9-e4a4-41bf-be5f-d2a33de1c2d9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:36.310292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af7cfde9-e4a4-41bf-be5f-d2a33de1c2d9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:36.311241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af7cfde9-e4a4-41bf-be5f-d2a33de1c2d9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:36.326475 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af7cfde9-e4a4-41bf-be5f-d2a33de1c2d9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:36.328160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af7cfde9-e4a4-41bf-be5f-d2a33de1c2d9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:36.332418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af7cfde9-e4a4-41bf-be5f-d2a33de1c2d9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:36.333239 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af7cfde9-e4a4-41bf-be5f-d2a33de1c2d9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:38.246999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-af7cfde9-e4a4-41bf-be5f-d2a33de1c2d9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:38.264544 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-af7cfde9-e4a4-41bf-be5f-d2a33de1c2d9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e" status: 200 len: 1502 microversion: 2.1 time: 1.990362 Sep 07 12:47:38.282646 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1765/3501] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:36 2022] GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e => generated 1502 bytes in 2010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:38.293412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ee57913-b665-47a2-811b-a86152f0c41e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:38.303417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4ee57913-b665-47a2-811b-a86152f0c41e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:38.314083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ee57913-b665-47a2-811b-a86152f0c41e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:38.315042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ee57913-b665-47a2-811b-a86152f0c41e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:38.316195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ee57913-b665-47a2-811b-a86152f0c41e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:38.330441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ee57913-b665-47a2-811b-a86152f0c41e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:38.333168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ee57913-b665-47a2-811b-a86152f0c41e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:38.337646 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ee57913-b665-47a2-811b-a86152f0c41e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:39.220982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4ee57913-b665-47a2-811b-a86152f0c41e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:39.237616 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ee57913-b665-47a2-811b-a86152f0c41e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 200 len: 1317 microversion: 2.1 time: 0.953305 Sep 07 12:47:39.248449 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1766/3502] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:38 2022] GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 1317 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:39.253867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-2fa40c63-05f2-4fd3-a9c7-66064941833b req-fdfe998b-b6f9-4da9-8507-2698160da273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1", "name": "network-vif-deleted", "tag": "9ead8f12-20d6-4b8b-97f1-2379de7610c7"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:47:39.273372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2fa40c63-05f2-4fd3-a9c7-66064941833b req-fdfe998b-b6f9-4da9-8507-2698160da273 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:39.278503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2fa40c63-05f2-4fd3-a9c7-66064941833b req-fdfe998b-b6f9-4da9-8507-2698160da273 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:39.279369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2fa40c63-05f2-4fd3-a9c7-66064941833b req-fdfe998b-b6f9-4da9-8507-2698160da273 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:39.307436 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-2fa40c63-05f2-4fd3-a9c7-66064941833b req-fdfe998b-b6f9-4da9-8507-2698160da273 service nova] Creating event network-vif-deleted:9ead8f12-20d6-4b8b-97f1-2379de7610c7 for instance d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1 on n-h2-852087-9 Sep 07 12:47:39.319244 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-2fa40c63-05f2-4fd3-a9c7-66064941833b req-fdfe998b-b6f9-4da9-8507-2698160da273 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069284 Sep 07 12:47:39.326664 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1767/3503] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:47:39.334225 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-35538a82-52d5-43bb-b86f-c27db833804f tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:39.344197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-35538a82-52d5-43bb-b86f-c27db833804f tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] [instance: d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:39.354543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35538a82-52d5-43bb-b86f-c27db833804f tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:39.356071 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35538a82-52d5-43bb-b86f-c27db833804f tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:39.357247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35538a82-52d5-43bb-b86f-c27db833804f tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:39.358299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35538a82-52d5-43bb-b86f-c27db833804f tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:39.359151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35538a82-52d5-43bb-b86f-c27db833804f tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:39.359821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35538a82-52d5-43bb-b86f-c27db833804f tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:39.411839 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-35538a82-52d5-43bb-b86f-c27db833804f tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] HTTP exception thrown: Instance d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1 could not be found. Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-35538a82-52d5-43bb-b86f-c27db833804f tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Request method failure captured: Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1 HTTP/1.1 Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJKvQFH-aDf6SC29kXAco1k5U9jQcSAbwZ6H2CdFNL8LAuWxYza5cRCzWaXpEq20lF4AiTDhnllFREFspM2xp7uUOLmwTNRe9BB8XnvyG4OigM3WzNOXcA6ev9j6pyUbdxDF6DbJN7X_jWy0KUj13xkoYOGNJd5R_wkLYqut0CUKN6Y Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 6b3ae4d905a7493289a242cc9ce5a051 Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1651183701 Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b3ae4d905a7493289a242cc9ce5a051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6b3ae4d905a7493289a242cc9ce5a051"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6b3ae4d905a7493289a242cc9ce5a051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b3ae4d905a7493289a242cc9ce5a051"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1651183701 Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 6b3ae4d905a7493289a242cc9ce5a051 Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1651183701 Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerAddressesNegativeTestJSON-1651183701-project Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6902480075db4d7bb4be2306197cfbc0 Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1651183701-project Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1 could not be found. Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'd49e3a99-5b6e-4c8c-989f-b689d2d7f3f1'} Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1 could not be found. Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1 could not be found. Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:47:39.428775 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:47:39.432880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:47:39.432880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:47:39.432880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:47:39.432880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:47:39.432880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:47:39.432880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:47:39.432880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1 could not be found. Sep 07 12:47:39.432880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:47:39.436958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-35538a82-52d5-43bb-b86f-c27db833804f tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] Returning 404 to user: Instance d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:47:39.438504 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-35538a82-52d5-43bb-b86f-c27db833804f tempest-ServerAddressesNegativeTestJSON-1651183701 tempest-ServerAddressesNegativeTestJSON-1651183701-project] 10.222.0.16 "GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1" status: 404 len: 111 microversion: 2.1 time: 0.109754 Sep 07 12:47:39.439368 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1768/3504] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:39 2022] GET /compute/v2.1/servers/d49e3a99-5b6e-4c8c-989f-b689d2d7f3f1 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:47:39.444989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-924fa9d2-9005-4759-81d2-303f29200a08 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:39.448050 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-924fa9d2-9005-4759-81d2-303f29200a08 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:39.457063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-924fa9d2-9005-4759-81d2-303f29200a08 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:39.458043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-924fa9d2-9005-4759-81d2-303f29200a08 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:39.458752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-924fa9d2-9005-4759-81d2-303f29200a08 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:39.459782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-924fa9d2-9005-4759-81d2-303f29200a08 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:39.460657 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-924fa9d2-9005-4759-81d2-303f29200a08 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:39.461354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-924fa9d2-9005-4759-81d2-303f29200a08 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:41.804605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-924fa9d2-9005-4759-81d2-303f29200a08 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:41.875765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-924fa9d2-9005-4759-81d2-303f29200a08 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:41.900202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-924fa9d2-9005-4759-81d2-303f29200a08 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:41.922539 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-924fa9d2-9005-4759-81d2-303f29200a08 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1870 microversion: 2.42 time: 2.471902 Sep 07 12:47:41.928967 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1769/3505] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:47:39 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1870 bytes in 2488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:47:41.975889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-91c7d5a9-1c3c-4fcb-a715-c4ed2b551913 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:41.977255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-91c7d5a9-1c3c-4fcb-a715-c4ed2b551913 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:42.036218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91c7d5a9-1c3c-4fcb-a715-c4ed2b551913 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:42.037320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91c7d5a9-1c3c-4fcb-a715-c4ed2b551913 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:42.038166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91c7d5a9-1c3c-4fcb-a715-c4ed2b551913 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:42.039552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91c7d5a9-1c3c-4fcb-a715-c4ed2b551913 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:42.040471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91c7d5a9-1c3c-4fcb-a715-c4ed2b551913 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:42.056749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-91c7d5a9-1c3c-4fcb-a715-c4ed2b551913 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:42.245769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:47:43.402301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-91c7d5a9-1c3c-4fcb-a715-c4ed2b551913 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:43.416808 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-91c7d5a9-1c3c-4fcb-a715-c4ed2b551913 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2" status: 200 len: 1514 microversion: 2.1 time: 1.486229 Sep 07 12:47:43.449728 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1770/3506] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:41 2022] GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2 => generated 1514 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:43.471097 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1b812305-e2bb-47a9-bd24-d5a8bc8eca03 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:43.476904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1b812305-e2bb-47a9-bd24-d5a8bc8eca03 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:43.495309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b812305-e2bb-47a9-bd24-d5a8bc8eca03 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:43.499029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b812305-e2bb-47a9-bd24-d5a8bc8eca03 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:43.503166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b812305-e2bb-47a9-bd24-d5a8bc8eca03 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:43.504319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b812305-e2bb-47a9-bd24-d5a8bc8eca03 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:43.510721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b812305-e2bb-47a9-bd24-d5a8bc8eca03 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:43.511615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b812305-e2bb-47a9-bd24-d5a8bc8eca03 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:44.179760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1b812305-e2bb-47a9-bd24-d5a8bc8eca03 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:44.205203 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1b812305-e2bb-47a9-bd24-d5a8bc8eca03 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 200 len: 1506 microversion: 2.1 time: 0.749902 Sep 07 12:47:44.228657 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1771/3507] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:43 2022] GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 1506 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:44.236508 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-bd7bd2a4-06aa-47d2-8420-ce5304bfe9db req-c5ad3fc2-0f0c-4721-8068-e6c9c8a72b5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f90d70b2-052c-4840-8008-9d9b2b08772a", "tag": "c36949c2-d7d4-432d-beb4-1b6f8be02a34"}, {"name": "network-changed", "server_uuid": "f90d70b2-052c-4840-8008-9d9b2b08772a", "tag": "d4ebc424-f0c8-485e-a625-d0d51830190e"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:47:44.299960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bd7bd2a4-06aa-47d2-8420-ce5304bfe9db req-c5ad3fc2-0f0c-4721-8068-e6c9c8a72b5d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:44.300685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bd7bd2a4-06aa-47d2-8420-ce5304bfe9db req-c5ad3fc2-0f0c-4721-8068-e6c9c8a72b5d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:44.304079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bd7bd2a4-06aa-47d2-8420-ce5304bfe9db req-c5ad3fc2-0f0c-4721-8068-e6c9c8a72b5d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:44.350147 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-bd7bd2a4-06aa-47d2-8420-ce5304bfe9db req-c5ad3fc2-0f0c-4721-8068-e6c9c8a72b5d service nova] Creating event network-changed:c36949c2-d7d4-432d-beb4-1b6f8be02a34 for instance f90d70b2-052c-4840-8008-9d9b2b08772a on n-h2-852087-9 Sep 07 12:47:44.360492 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-bd7bd2a4-06aa-47d2-8420-ce5304bfe9db req-c5ad3fc2-0f0c-4721-8068-e6c9c8a72b5d service nova] Creating event network-changed:d4ebc424-f0c8-485e-a625-d0d51830190e for instance f90d70b2-052c-4840-8008-9d9b2b08772a on n-h2-852087-9 Sep 07 12:47:44.378884 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-bd7bd2a4-06aa-47d2-8420-ce5304bfe9db req-c5ad3fc2-0f0c-4721-8068-e6c9c8a72b5d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.148212 Sep 07 12:47:44.387528 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1772/3508] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:47:44.404505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8dab9dc8-cf7d-4971-9d3c-ee98d6f2ff92 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:44.405610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8dab9dc8-cf7d-4971-9d3c-ee98d6f2ff92 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:44.428909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8dab9dc8-cf7d-4971-9d3c-ee98d6f2ff92 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:44.433617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8dab9dc8-cf7d-4971-9d3c-ee98d6f2ff92 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:44.435639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8dab9dc8-cf7d-4971-9d3c-ee98d6f2ff92 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:44.442464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8dab9dc8-cf7d-4971-9d3c-ee98d6f2ff92 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:44.443554 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8dab9dc8-cf7d-4971-9d3c-ee98d6f2ff92 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:44.446519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8dab9dc8-cf7d-4971-9d3c-ee98d6f2ff92 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:45.912040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8dab9dc8-cf7d-4971-9d3c-ee98d6f2ff92 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:45.926776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8dab9dc8-cf7d-4971-9d3c-ee98d6f2ff92 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:45.931453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8dab9dc8-cf7d-4971-9d3c-ee98d6f2ff92 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:45.934604 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8dab9dc8-cf7d-4971-9d3c-ee98d6f2ff92 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1870 microversion: 2.42 time: 1.544119 Sep 07 12:47:45.937344 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1773/3509] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:47:44 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1870 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:47:45.946890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-23386493-b1fe-4002-8097-fcbeb924771e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:47:45.963629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-23386493-b1fe-4002-8097-fcbeb924771e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 273464cb-3141-4b83-9825-99b5e8ad21e0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:45.992737 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:47:46.008161 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-23386493-b1fe-4002-8097-fcbeb924771e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] HTTP exception thrown: Instance 273464cb-3141-4b83-9825-99b5e8ad21e0 could not be found. Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-23386493-b1fe-4002-8097-fcbeb924771e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Request method failure captured: Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/273464cb-3141-4b83-9825-99b5e8ad21e0/action HTTP/1.1 Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 14 Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJKZVQHWlJ74Dx2W8ZEdML0xF-2AOg7c1kyx3sCL0Z6KLQM5ezA45HggvILiFiNDg07ylWr0Vwzz5BQco3_h-9AY0fLV1Rv4K5sggvhMC6zI5NaP-U7NrDZHMoSQThjt2D27IAAoa8B5_g5vq1oNty_s1bxD15UYFAJm0Q--CvZRoS0 Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 256a95a81360419dbaf33382dd369262 Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1632514538 Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/256a95a81360419dbaf33382dd369262"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_256a95a81360419dbaf33382dd369262"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/256a95a81360419dbaf33382dd369262"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/256a95a81360419dbaf33382dd369262"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1632514538 Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 256a95a81360419dbaf33382dd369262 Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1632514538 Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerRescueNegativeTestJSON-1632514538-project Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: a6d92e694e984ad8b126b94ed8effb3f Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1632514538-project Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: {"rescue": {}} Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 273464cb-3141-4b83-9825-99b5e8ad21e0 could not be found. Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '273464cb-3141-4b83-9825-99b5e8ad21e0', 'body': {'rescue': {}}} Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 273464cb-3141-4b83-9825-99b5e8ad21e0 could not be found. Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 273464cb-3141-4b83-9825-99b5e8ad21e0 could not be found. Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:47:46.022487 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:47:46.038053 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:47:46.038053 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:47:46.038053 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:47:46.038053 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:47:46.038053 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 273464cb-3141-4b83-9825-99b5e8ad21e0 could not be found. Sep 07 12:47:46.038053 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:47:46.038053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-23386493-b1fe-4002-8097-fcbeb924771e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Returning 404 to user: Instance 273464cb-3141-4b83-9825-99b5e8ad21e0 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:47:46.042400 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-23386493-b1fe-4002-8097-fcbeb924771e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "POST /compute/v2.1/servers/273464cb-3141-4b83-9825-99b5e8ad21e0/action" status: 404 len: 111 microversion: 2.1 time: 0.103161 Sep 07 12:47:46.044927 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1774/3510] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:47:45 2022] POST /compute/v2.1/servers/273464cb-3141-4b83-9825-99b5e8ad21e0/action => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:47:46.055447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c8e8b7a4-208d-4f1e-b020-3155f12c05d1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:46.057217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c8e8b7a4-208d-4f1e-b020-3155f12c05d1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:46.074362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8e8b7a4-208d-4f1e-b020-3155f12c05d1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:46.080642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8e8b7a4-208d-4f1e-b020-3155f12c05d1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:46.082304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8e8b7a4-208d-4f1e-b020-3155f12c05d1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:46.084023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8e8b7a4-208d-4f1e-b020-3155f12c05d1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:46.085812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8e8b7a4-208d-4f1e-b020-3155f12c05d1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:46.087090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8e8b7a4-208d-4f1e-b020-3155f12c05d1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:46.826401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c8e8b7a4-208d-4f1e-b020-3155f12c05d1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:46.842279 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c8e8b7a4-208d-4f1e-b020-3155f12c05d1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 200 len: 1506 microversion: 2.1 time: 0.795304 Sep 07 12:47:46.855621 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1775/3511] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:46 2022] GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 1506 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:46.872446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-82add0cb-cc98-4c64-9142-e8ce322a7a03 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:47:46.873296 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-82add0cb-cc98-4c64-9142-e8ce322a7a03 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:46.903476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82add0cb-cc98-4c64-9142-e8ce322a7a03 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:46.904262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82add0cb-cc98-4c64-9142-e8ce322a7a03 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:46.904908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82add0cb-cc98-4c64-9142-e8ce322a7a03 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:46.905925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82add0cb-cc98-4c64-9142-e8ce322a7a03 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:46.906591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82add0cb-cc98-4c64-9142-e8ce322a7a03 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:46.907197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82add0cb-cc98-4c64-9142-e8ce322a7a03 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:47.112038 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-82add0cb-cc98-4c64-9142-e8ce322a7a03 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "POST /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2/action" status: 202 len: 0 microversion: 2.1 time: 0.251825 Sep 07 12:47:47.125955 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1776/3512] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:47:46 2022] POST /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:47:47.131719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b05cbed0-ee48-47b9-ad1a-d858cb5696ec tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:47:47.144999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b05cbed0-ee48-47b9-ad1a-d858cb5696ec tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:47.163569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b05cbed0-ee48-47b9-ad1a-d858cb5696ec tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:47.163969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b05cbed0-ee48-47b9-ad1a-d858cb5696ec tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:47.164422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b05cbed0-ee48-47b9-ad1a-d858cb5696ec tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:47.165181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b05cbed0-ee48-47b9-ad1a-d858cb5696ec tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:47.165699 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b05cbed0-ee48-47b9-ad1a-d858cb5696ec tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:47.166125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b05cbed0-ee48-47b9-ad1a-d858cb5696ec tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:47.368259 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b05cbed0-ee48-47b9-ad1a-d858cb5696ec tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "PUT /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 200 len: 1078 microversion: 2.1 time: 0.240791 Sep 07 12:47:47.368921 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1777/3513] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Sep 7 12:47:47 2022] PUT /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 1078 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:47.393679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-74e1654e-0fd8-463f-9138-fefa1281533a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:47.394320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-74e1654e-0fd8-463f-9138-fefa1281533a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:47.424443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74e1654e-0fd8-463f-9138-fefa1281533a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:47.425255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74e1654e-0fd8-463f-9138-fefa1281533a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:47.425950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74e1654e-0fd8-463f-9138-fefa1281533a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:47.427585 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74e1654e-0fd8-463f-9138-fefa1281533a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:47.428285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74e1654e-0fd8-463f-9138-fefa1281533a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:47.432317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74e1654e-0fd8-463f-9138-fefa1281533a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:48.351989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-74e1654e-0fd8-463f-9138-fefa1281533a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:48.372208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-74e1654e-0fd8-463f-9138-fefa1281533a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:48.383539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-74e1654e-0fd8-463f-9138-fefa1281533a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:48.385441 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-74e1654e-0fd8-463f-9138-fefa1281533a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1891 microversion: 2.42 time: 1.002817 Sep 07 12:47:48.400305 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1778/3514] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:47:47 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1891 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:47:48.418366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b03c9a27-9739-410f-9f30-7e1f68676536 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:48.421512 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b03c9a27-9739-410f-9f30-7e1f68676536 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:48.462240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b03c9a27-9739-410f-9f30-7e1f68676536 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:48.463205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b03c9a27-9739-410f-9f30-7e1f68676536 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:48.465957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b03c9a27-9739-410f-9f30-7e1f68676536 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:48.467574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b03c9a27-9739-410f-9f30-7e1f68676536 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:48.471080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b03c9a27-9739-410f-9f30-7e1f68676536 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:48.476282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b03c9a27-9739-410f-9f30-7e1f68676536 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:49.795700 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-76f24e50-2203-40e6-94eb-7664c93ca85d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81" status: 200 len: 1454 microversion: 2.1 time: 26.729259 Sep 07 12:47:49.802834 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1737/3515] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:47:23 2022] GET /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81 => generated 1454 bytes in 26738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:49.842375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-72dc35c8-3da6-4b78-ba15-2948d60d1ed9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:49.851854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-72dc35c8-3da6-4b78-ba15-2948d60d1ed9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:49.929847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72dc35c8-3da6-4b78-ba15-2948d60d1ed9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:49.932516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72dc35c8-3da6-4b78-ba15-2948d60d1ed9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:49.938621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72dc35c8-3da6-4b78-ba15-2948d60d1ed9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:49.948697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72dc35c8-3da6-4b78-ba15-2948d60d1ed9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:49.952489 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72dc35c8-3da6-4b78-ba15-2948d60d1ed9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:49.969176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72dc35c8-3da6-4b78-ba15-2948d60d1ed9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:50.319560 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b03c9a27-9739-410f-9f30-7e1f68676536 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:50.331594 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b03c9a27-9739-410f-9f30-7e1f68676536 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2" status: 200 len: 1499 microversion: 2.1 time: 1.929677 Sep 07 12:47:50.344356 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1779/3516] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:48 2022] GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2 => generated 1499 bytes in 1943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:50.349979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-ca20e831-3a5f-4aaa-b72a-095d3176cb38 req-1ac50b68-2c91-4023-9291-e44acda0baee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f90d70b2-052c-4840-8008-9d9b2b08772a", "tag": "ff4033b6-7d47-4ed1-9c26-6cc0e709c6e8"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:47:50.395322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ca20e831-3a5f-4aaa-b72a-095d3176cb38 req-1ac50b68-2c91-4023-9291-e44acda0baee service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:50.404533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ca20e831-3a5f-4aaa-b72a-095d3176cb38 req-1ac50b68-2c91-4023-9291-e44acda0baee service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:50.405441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ca20e831-3a5f-4aaa-b72a-095d3176cb38 req-1ac50b68-2c91-4023-9291-e44acda0baee service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:50.447352 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ca20e831-3a5f-4aaa-b72a-095d3176cb38 req-1ac50b68-2c91-4023-9291-e44acda0baee service nova] Creating event network-changed:ff4033b6-7d47-4ed1-9c26-6cc0e709c6e8 for instance f90d70b2-052c-4840-8008-9d9b2b08772a on n-h2-852087-9 Sep 07 12:47:50.463726 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-ca20e831-3a5f-4aaa-b72a-095d3176cb38 req-1ac50b68-2c91-4023-9291-e44acda0baee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117694 Sep 07 12:47:50.472374 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1780/3517] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:47:50.491312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-17174ae3-46a2-4e9c-9332-3407ba62f3a5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:50.496041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-17174ae3-46a2-4e9c-9332-3407ba62f3a5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:50.545044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17174ae3-46a2-4e9c-9332-3407ba62f3a5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:50.548906 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17174ae3-46a2-4e9c-9332-3407ba62f3a5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:50.550082 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17174ae3-46a2-4e9c-9332-3407ba62f3a5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:50.551100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17174ae3-46a2-4e9c-9332-3407ba62f3a5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:50.553305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17174ae3-46a2-4e9c-9332-3407ba62f3a5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:50.554053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17174ae3-46a2-4e9c-9332-3407ba62f3a5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:50.726920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-72dc35c8-3da6-4b78-ba15-2948d60d1ed9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:50.745409 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-72dc35c8-3da6-4b78-ba15-2948d60d1ed9 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 200 len: 1504 microversion: 2.1 time: 0.936864 Sep 07 12:47:50.746805 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1738/3518] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:49 2022] GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 1504 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:50.764047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-62c9af6c-0ad9-4255-a5f7-bc625e2cfa0e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:50.766353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-62c9af6c-0ad9-4255-a5f7-bc625e2cfa0e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:50.783153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62c9af6c-0ad9-4255-a5f7-bc625e2cfa0e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:50.786406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62c9af6c-0ad9-4255-a5f7-bc625e2cfa0e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:50.787934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62c9af6c-0ad9-4255-a5f7-bc625e2cfa0e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:50.790519 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62c9af6c-0ad9-4255-a5f7-bc625e2cfa0e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:50.792358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62c9af6c-0ad9-4255-a5f7-bc625e2cfa0e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:50.794684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62c9af6c-0ad9-4255-a5f7-bc625e2cfa0e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:51.821304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-17174ae3-46a2-4e9c-9332-3407ba62f3a5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:51.845518 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-17174ae3-46a2-4e9c-9332-3407ba62f3a5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:51.855544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-17174ae3-46a2-4e9c-9332-3407ba62f3a5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:51.857103 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-17174ae3-46a2-4e9c-9332-3407ba62f3a5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1891 microversion: 2.42 time: 1.383158 Sep 07 12:47:51.859131 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1781/3519] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:47:50 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1891 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:47:51.868586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6fe413cb-0c94-4fdb-9151-3acc54141282 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:47:51.877014 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6fe413cb-0c94-4fdb-9151-3acc54141282 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:51.930875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fe413cb-0c94-4fdb-9151-3acc54141282 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:51.931810 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fe413cb-0c94-4fdb-9151-3acc54141282 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:51.932626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fe413cb-0c94-4fdb-9151-3acc54141282 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:51.934042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fe413cb-0c94-4fdb-9151-3acc54141282 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:51.946047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fe413cb-0c94-4fdb-9151-3acc54141282 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:51.950419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fe413cb-0c94-4fdb-9151-3acc54141282 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:52.038285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-62c9af6c-0ad9-4255-a5f7-bc625e2cfa0e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:52.049888 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-62c9af6c-0ad9-4255-a5f7-bc625e2cfa0e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 1.298594 Sep 07 12:47:52.059185 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1739/3520] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:50 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:52.067921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9427e5f5-38df-4079-97d0-2451ecfc0a72 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:52.078808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9427e5f5-38df-4079-97d0-2451ecfc0a72 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:52.098420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9427e5f5-38df-4079-97d0-2451ecfc0a72 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:52.102676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9427e5f5-38df-4079-97d0-2451ecfc0a72 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:52.107280 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9427e5f5-38df-4079-97d0-2451ecfc0a72 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:52.108377 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9427e5f5-38df-4079-97d0-2451ecfc0a72 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:52.112900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9427e5f5-38df-4079-97d0-2451ecfc0a72 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:52.113758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9427e5f5-38df-4079-97d0-2451ecfc0a72 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:52.150478 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-6fe413cb-0c94-4fdb-9151-3acc54141282 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lazy-loading 'flavor' on Instance uuid 8425f313-f6b3-462f-92d7-8803be5ff8f2 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:47:52.184342 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-6fe413cb-0c94-4fdb-9151-3acc54141282 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] HTTP exception thrown: Cannot 'rescue' instance 8425f313-f6b3-462f-92d7-8803be5ff8f2 while it is in vm_state paused Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6fe413cb-0c94-4fdb-9151-3acc54141282 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Request method failure captured: Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2/action HTTP/1.1 Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 14 Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJKZVQHWlJ74Dx2W8ZEdML0xF-2AOg7c1kyx3sCL0Z6KLQM5ezA45HggvILiFiNDg07ylWr0Vwzz5BQco3_h-9AY0fLV1Rv4K5sggvhMC6zI5NaP-U7NrDZHMoSQThjt2D27IAAoa8B5_g5vq1oNty_s1bxD15UYFAJm0Q--CvZRoS0 Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 256a95a81360419dbaf33382dd369262 Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1632514538 Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/256a95a81360419dbaf33382dd369262"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_256a95a81360419dbaf33382dd369262"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/256a95a81360419dbaf33382dd369262"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/256a95a81360419dbaf33382dd369262"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1632514538 Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 256a95a81360419dbaf33382dd369262 Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1632514538 Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerRescueNegativeTestJSON-1632514538-project Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: a6d92e694e984ad8b126b94ed8effb3f Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1632514538-project Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: {"rescue": {}} Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: exception: Cannot 'rescue' instance 8425f313-f6b3-462f-92d7-8803be5ff8f2 while it is in vm_state paused Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '8425f313-f6b3-462f-92d7-8803be5ff8f2', 'body': {'rescue': {}}} Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8425f313-f6b3-462f-92d7-8803be5ff8f2 in vm_state paused. Cannot rescue while the instance is in this state. Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 8425f313-f6b3-462f-92d7-8803be5ff8f2 while it is in vm_state paused Sep 07 12:47:52.188702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:47:52.197688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:47:52.197688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:47:52.197688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:47:52.197688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:47:52.197688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:47:52.197688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:47:52.197688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:47:52.197688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 8425f313-f6b3-462f-92d7-8803be5ff8f2 while it is in vm_state paused Sep 07 12:47:52.197688 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:47:52.203069 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6fe413cb-0c94-4fdb-9151-3acc54141282 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Returning 409 to user: Cannot 'rescue' instance 8425f313-f6b3-462f-92d7-8803be5ff8f2 while it is in vm_state paused {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:47:52.208126 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6fe413cb-0c94-4fdb-9151-3acc54141282 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "POST /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2/action" status: 409 len: 144 microversion: 2.1 time: 0.347321 Sep 07 12:47:52.212844 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1782/3521] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:47:51 2022] POST /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2/action => generated 144 bytes in 353 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:47:52.225547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f51a13ea-72b8-4825-827e-7c6e7b0bde92 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4182ac700>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:52.839196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9427e5f5-38df-4079-97d0-2451ecfc0a72 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:52.868327 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9427e5f5-38df-4079-97d0-2451ecfc0a72 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 200 len: 1504 microversion: 2.1 time: 0.807873 Sep 07 12:47:52.876035 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1740/3522] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:52 2022] GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 1504 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:52.881623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d2382dbf-0e43-4734-99c6-ea8a09555926 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-2100712005"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:47:52.888407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d2382dbf-0e43-4734-99c6-ea8a09555926 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:52.907070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2382dbf-0e43-4734-99c6-ea8a09555926 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:52.907609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2382dbf-0e43-4734-99c6-ea8a09555926 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:52.908376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2382dbf-0e43-4734-99c6-ea8a09555926 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:52.909298 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2382dbf-0e43-4734-99c6-ea8a09555926 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:52.909964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2382dbf-0e43-4734-99c6-ea8a09555926 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:52.910852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2382dbf-0e43-4734-99c6-ea8a09555926 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:56.799833 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f51a13ea-72b8-4825-827e-7c6e7b0bde92 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81" status: 200 len: 1463 microversion: 2.1 time: 4.581341 Sep 07 12:47:56.804039 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1783/3523] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:47:52 2022] GET /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81 => generated 1463 bytes in 4590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:56.821599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ba94f12-b89d-42a6-a5b1-1a042acccd84 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:47:56.822495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0ba94f12-b89d-42a6-a5b1-1a042acccd84 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:56.854367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ba94f12-b89d-42a6-a5b1-1a042acccd84 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:56.856993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ba94f12-b89d-42a6-a5b1-1a042acccd84 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:56.859656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ba94f12-b89d-42a6-a5b1-1a042acccd84 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:56.862823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ba94f12-b89d-42a6-a5b1-1a042acccd84 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:56.864622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ba94f12-b89d-42a6-a5b1-1a042acccd84 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:56.865978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ba94f12-b89d-42a6-a5b1-1a042acccd84 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:57.108544 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ba94f12-b89d-42a6-a5b1-1a042acccd84 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "POST /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2/action" status: 202 len: 0 microversion: 2.1 time: 0.298376 Sep 07 12:47:57.113345 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1784/3524] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:47:56 2022] POST /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:47:57.141692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8309beed-7c3a-48f4-a399-80ba7a82ea74 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:57.146746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8309beed-7c3a-48f4-a399-80ba7a82ea74 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:57.204898 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8309beed-7c3a-48f4-a399-80ba7a82ea74 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:57.206738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8309beed-7c3a-48f4-a399-80ba7a82ea74 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:57.221466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8309beed-7c3a-48f4-a399-80ba7a82ea74 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:57.226947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8309beed-7c3a-48f4-a399-80ba7a82ea74 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:57.228271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8309beed-7c3a-48f4-a399-80ba7a82ea74 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:57.229986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8309beed-7c3a-48f4-a399-80ba7a82ea74 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:57.305260 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d2382dbf-0e43-4734-99c6-ea8a09555926 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action" status: 202 len: 0 microversion: 2.1 time: 4.425402 Sep 07 12:47:57.331583 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1741/3525] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:47:52 2022] POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action => generated 0 bytes in 4448 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 07 12:47:57.357690 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32f84976-84f0-4822-a2c0-193b0fc3b2e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:47:57.369140 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-32f84976-84f0-4822-a2c0-193b0fc3b2e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:57.385764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32f84976-84f0-4822-a2c0-193b0fc3b2e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:57.387422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32f84976-84f0-4822-a2c0-193b0fc3b2e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:57.393236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32f84976-84f0-4822-a2c0-193b0fc3b2e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:57.394982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32f84976-84f0-4822-a2c0-193b0fc3b2e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:57.396016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32f84976-84f0-4822-a2c0-193b0fc3b2e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:57.397429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32f84976-84f0-4822-a2c0-193b0fc3b2e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:57.671126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-32f84976-84f0-4822-a2c0-193b0fc3b2e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:47:57.672163 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-32f84976-84f0-4822-a2c0-193b0fc3b2e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:47:57.673778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-32f84976-84f0-4822-a2c0-193b0fc3b2e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:47:57.674900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-32f84976-84f0-4822-a2c0-193b0fc3b2e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:47:57.676224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-32f84976-84f0-4822-a2c0-193b0fc3b2e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:47:57.883878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-32f84976-84f0-4822-a2c0-193b0fc3b2e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:57.903613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32f84976-84f0-4822-a2c0-193b0fc3b2e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:57.906339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32f84976-84f0-4822-a2c0-193b0fc3b2e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:57.909269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32f84976-84f0-4822-a2c0-193b0fc3b2e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:57.913361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32f84976-84f0-4822-a2c0-193b0fc3b2e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:57.914164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32f84976-84f0-4822-a2c0-193b0fc3b2e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:57.915398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32f84976-84f0-4822-a2c0-193b0fc3b2e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:58.005993 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-32f84976-84f0-4822-a2c0-193b0fc3b2e0 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "POST /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3/action" status: 202 len: 1110 microversion: 2.1 time: 0.670436 Sep 07 12:47:58.024098 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1742/3526] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:47:57 2022] POST /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3/action => generated 1110 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 07 12:47:58.042150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-2ec83f6a-f7c7-4e04-81db-bf37abe045e5 req-31ad46d1-1395-436c-a8bb-d29dab31d44d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f90d70b2-052c-4840-8008-9d9b2b08772a", "tag": "32b44f36-cd89-4a45-8da9-812f25573ca9"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:47:58.072671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2ec83f6a-f7c7-4e04-81db-bf37abe045e5 req-31ad46d1-1395-436c-a8bb-d29dab31d44d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:58.075192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2ec83f6a-f7c7-4e04-81db-bf37abe045e5 req-31ad46d1-1395-436c-a8bb-d29dab31d44d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:58.076007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2ec83f6a-f7c7-4e04-81db-bf37abe045e5 req-31ad46d1-1395-436c-a8bb-d29dab31d44d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:58.096835 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-2ec83f6a-f7c7-4e04-81db-bf37abe045e5 req-31ad46d1-1395-436c-a8bb-d29dab31d44d service nova] Creating event network-changed:32b44f36-cd89-4a45-8da9-812f25573ca9 for instance f90d70b2-052c-4840-8008-9d9b2b08772a on n-h2-852087-9 Sep 07 12:47:58.105338 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-2ec83f6a-f7c7-4e04-81db-bf37abe045e5 req-31ad46d1-1395-436c-a8bb-d29dab31d44d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077355 Sep 07 12:47:58.107037 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1743/3527] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:47:58.113908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-65c48119-d513-4199-8524-de39c2e04c25 req-a7665071-620f-40db-bc98-2fba865fea44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edf38c92-ffc2-492b-8642-88ca59537acd", "name": "network-vif-unplugged", "status": "completed", "tag": "23b18fbd-594f-42e0-a655-6b5f01607b28"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:47:58.130762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-65c48119-d513-4199-8524-de39c2e04c25 req-a7665071-620f-40db-bc98-2fba865fea44 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:58.131901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-65c48119-d513-4199-8524-de39c2e04c25 req-a7665071-620f-40db-bc98-2fba865fea44 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:58.132517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-65c48119-d513-4199-8524-de39c2e04c25 req-a7665071-620f-40db-bc98-2fba865fea44 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:58.171806 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-65c48119-d513-4199-8524-de39c2e04c25 req-a7665071-620f-40db-bc98-2fba865fea44 service nova] Creating event network-vif-unplugged:23b18fbd-594f-42e0-a655-6b5f01607b28 for instance edf38c92-ffc2-492b-8642-88ca59537acd on n-h1-852087-9 Sep 07 12:47:58.185877 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-65c48119-d513-4199-8524-de39c2e04c25 req-a7665071-620f-40db-bc98-2fba865fea44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074981 Sep 07 12:47:58.198930 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1744/3528] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:47:58.215336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c51c4ab0-2599-4ece-9cf4-a204fe2fa0da tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4180bed30>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:58.382665 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c51c4ab0-2599-4ece-9cf4-a204fe2fa0da tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81" status: 200 len: 1463 microversion: 2.1 time: 0.180888 Sep 07 12:47:58.384718 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1745/3529] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:47:58 2022] GET /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81 => generated 1463 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:58.412616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8e75e710-fb57-462e-a349-9a891b552b9f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:58.414211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8e75e710-fb57-462e-a349-9a891b552b9f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:58.429627 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e75e710-fb57-462e-a349-9a891b552b9f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:58.430137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e75e710-fb57-462e-a349-9a891b552b9f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:58.431060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e75e710-fb57-462e-a349-9a891b552b9f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:58.435223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e75e710-fb57-462e-a349-9a891b552b9f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:58.436648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e75e710-fb57-462e-a349-9a891b552b9f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:58.437291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e75e710-fb57-462e-a349-9a891b552b9f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:58.536091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8309beed-7c3a-48f4-a399-80ba7a82ea74 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:58.571985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8309beed-7c3a-48f4-a399-80ba7a82ea74 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:58.588652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8309beed-7c3a-48f4-a399-80ba7a82ea74 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:58.593877 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8309beed-7c3a-48f4-a399-80ba7a82ea74 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1891 microversion: 2.42 time: 1.476556 Sep 07 12:47:58.599042 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1785/3530] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:47:57 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1891 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:47:58.624267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-18a80f68-37f8-471b-b5b4-cea0738c4b55 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:58.624267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-18a80f68-37f8-471b-b5b4-cea0738c4b55 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:58.655010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18a80f68-37f8-471b-b5b4-cea0738c4b55 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:58.655561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18a80f68-37f8-471b-b5b4-cea0738c4b55 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:58.657698 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18a80f68-37f8-471b-b5b4-cea0738c4b55 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:58.660607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18a80f68-37f8-471b-b5b4-cea0738c4b55 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:58.662603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18a80f68-37f8-471b-b5b4-cea0738c4b55 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:58.663945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18a80f68-37f8-471b-b5b4-cea0738c4b55 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:59.379810 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-18a80f68-37f8-471b-b5b4-cea0738c4b55 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:59.384617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8e75e710-fb57-462e-a349-9a891b552b9f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:47:59.398331 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8e75e710-fb57-462e-a349-9a891b552b9f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2" status: 200 len: 1514 microversion: 2.1 time: 1.011302 Sep 07 12:47:59.398941 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1746/3531] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:58 2022] GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2 => generated 1514 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:59.400453 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-18a80f68-37f8-471b-b5b4-cea0738c4b55 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1679 microversion: 2.1 time: 0.798587 Sep 07 12:47:59.417917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0a4793a9-5aab-4daf-9c7c-04e7e2b753f3 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:59.417917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0a4793a9-5aab-4daf-9c7c-04e7e2b753f3 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:59.419815 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1786/3532] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:58 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1679 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:47:59.448656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5092c226-bc4d-4abd-a08d-8583fdb68ffa tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:47:59.450279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5092c226-bc4d-4abd-a08d-8583fdb68ffa tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 91762428-7354-4926-b463-edc357e1e7cf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:47:59.463498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5092c226-bc4d-4abd-a08d-8583fdb68ffa tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:59.464809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a4793a9-5aab-4daf-9c7c-04e7e2b753f3 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:59.466545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5092c226-bc4d-4abd-a08d-8583fdb68ffa tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:59.467856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5092c226-bc4d-4abd-a08d-8583fdb68ffa tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:59.469684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5092c226-bc4d-4abd-a08d-8583fdb68ffa tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:59.470323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a4793a9-5aab-4daf-9c7c-04e7e2b753f3 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:59.471005 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5092c226-bc4d-4abd-a08d-8583fdb68ffa tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:59.472035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5092c226-bc4d-4abd-a08d-8583fdb68ffa tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:59.472878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a4793a9-5aab-4daf-9c7c-04e7e2b753f3 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:47:59.478191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a4793a9-5aab-4daf-9c7c-04e7e2b753f3 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:47:59.489561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a4793a9-5aab-4daf-9c7c-04e7e2b753f3 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:47:59.491437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a4793a9-5aab-4daf-9c7c-04e7e2b753f3 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:00.500429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0a4793a9-5aab-4daf-9c7c-04e7e2b753f3 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:00.539542 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0a4793a9-5aab-4daf-9c7c-04e7e2b753f3 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 200 len: 1515 microversion: 2.1 time: 1.127161 Sep 07 12:48:00.543555 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1747/3533] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:59 2022] GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 1515 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:00.625979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5092c226-bc4d-4abd-a08d-8583fdb68ffa tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796a821c4f184a6aac2859bb943f9bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a87170da674037af70fac57a366c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:00.650084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:48:00.655166 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5092c226-bc4d-4abd-a08d-8583fdb68ffa tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf" status: 200 len: 1467 microversion: 2.1 time: 1.233120 Sep 07 12:48:00.662045 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1787/3534] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:47:59 2022] GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf => generated 1467 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:00.677142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dc38701f-80f4-443a-99b3-b578f02da622 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:00.680123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dc38701f-80f4-443a-99b3-b578f02da622 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:00.712941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc38701f-80f4-443a-99b3-b578f02da622 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:00.721239 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc38701f-80f4-443a-99b3-b578f02da622 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:00.722431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc38701f-80f4-443a-99b3-b578f02da622 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:00.723994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc38701f-80f4-443a-99b3-b578f02da622 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:00.725054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc38701f-80f4-443a-99b3-b578f02da622 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:00.726124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc38701f-80f4-443a-99b3-b578f02da622 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:01.238294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-88c60b37-6552-48fc-bd6f-6754a01e242e tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-875421015", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": "none"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:48:01.547454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-88c60b37-6552-48fc-bd6f-6754a01e242e tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:48:01.548574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-88c60b37-6552-48fc-bd6f-6754a01e242e tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:48:01.551349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-88c60b37-6552-48fc-bd6f-6754a01e242e tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:48:01.555448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-88c60b37-6552-48fc-bd6f-6754a01e242e tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:48:01.556210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-88c60b37-6552-48fc-bd6f-6754a01e242e tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:48:01.612813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88c60b37-6552-48fc-bd6f-6754a01e242e tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:01.615468 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88c60b37-6552-48fc-bd6f-6754a01e242e tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:01.620238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88c60b37-6552-48fc-bd6f-6754a01e242e tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:01.623550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88c60b37-6552-48fc-bd6f-6754a01e242e tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:01.629450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88c60b37-6552-48fc-bd6f-6754a01e242e tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:01.633098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88c60b37-6552-48fc-bd6f-6754a01e242e tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:01.715327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-88c60b37-6552-48fc-bd6f-6754a01e242e tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Getting quotas for project 313385f79a2148599af2c15696fad11e. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:48:01.731160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dc38701f-80f4-443a-99b3-b578f02da622 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:01.755678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-88c60b37-6552-48fc-bd6f-6754a01e242e tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Getting quotas for user 2cd92a5e717d4c94b046c0a632bd3ae3 and project 313385f79a2148599af2c15696fad11e. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:48:01.772960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dc38701f-80f4-443a-99b3-b578f02da622 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:01.780762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dc38701f-80f4-443a-99b3-b578f02da622 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:01.787216 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dc38701f-80f4-443a-99b3-b578f02da622 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1879 microversion: 2.42 time: 1.120272 Sep 07 12:48:01.806628 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1788/3535] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:00 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1879 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:01.838849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-e05e46db-2d5d-4332-ab38-16b2bbfe037f req-c3c52f19-9ca5-4537-9672-6bd7e9ca57d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f90d70b2-052c-4840-8008-9d9b2b08772a", "tag": "4884ea30-6481-4544-a1c7-5f3beab54e8d"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:48:01.862377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e05e46db-2d5d-4332-ab38-16b2bbfe037f req-c3c52f19-9ca5-4537-9672-6bd7e9ca57d4 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:01.863587 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e05e46db-2d5d-4332-ab38-16b2bbfe037f req-c3c52f19-9ca5-4537-9672-6bd7e9ca57d4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:01.869430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e05e46db-2d5d-4332-ab38-16b2bbfe037f req-c3c52f19-9ca5-4537-9672-6bd7e9ca57d4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:01.880897 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-88c60b37-6552-48fc-bd6f-6754a01e242e tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:48:01.893653 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-e05e46db-2d5d-4332-ab38-16b2bbfe037f req-c3c52f19-9ca5-4537-9672-6bd7e9ca57d4 service nova] Creating event network-changed:4884ea30-6481-4544-a1c7-5f3beab54e8d for instance f90d70b2-052c-4840-8008-9d9b2b08772a on n-h2-852087-9 Sep 07 12:48:01.903791 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-e05e46db-2d5d-4332-ab38-16b2bbfe037f req-c3c52f19-9ca5-4537-9672-6bd7e9ca57d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094555 Sep 07 12:48:01.905950 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1789/3536] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:48:01.919606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8a31e8ad-237d-4335-8f37-4c4b02074da6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:01.921940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8a31e8ad-237d-4335-8f37-4c4b02074da6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:01.924648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-88c60b37-6552-48fc-bd6f-6754a01e242e tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] [instance: d4363e90-4eb0-487a-a798-7a6d0a613e12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:48:01.934797 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a31e8ad-237d-4335-8f37-4c4b02074da6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:01.936108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a31e8ad-237d-4335-8f37-4c4b02074da6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:01.937164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a31e8ad-237d-4335-8f37-4c4b02074da6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:01.939865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a31e8ad-237d-4335-8f37-4c4b02074da6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:01.940840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a31e8ad-237d-4335-8f37-4c4b02074da6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:01.941699 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a31e8ad-237d-4335-8f37-4c4b02074da6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:02.100001 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-88c60b37-6552-48fc-bd6f-6754a01e242e tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.553165 Sep 07 12:48:02.105036 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1748/3537] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Sep 7 12:48:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1560 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 12:48:02.130123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-55cf3a3c-3d9f-449c-9ff3-fcbead20947f tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1473533796"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:48:02.136035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-55cf3a3c-3d9f-449c-9ff3-fcbead20947f tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 676e42b4-4985-43cc-892b-176e13b341df] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:02.220704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55cf3a3c-3d9f-449c-9ff3-fcbead20947f tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:02.226606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55cf3a3c-3d9f-449c-9ff3-fcbead20947f tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:02.227619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55cf3a3c-3d9f-449c-9ff3-fcbead20947f tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:02.229291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55cf3a3c-3d9f-449c-9ff3-fcbead20947f tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:02.230138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55cf3a3c-3d9f-449c-9ff3-fcbead20947f tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:02.231585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-55cf3a3c-3d9f-449c-9ff3-fcbead20947f tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:03.109772 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-55cf3a3c-3d9f-449c-9ff3-fcbead20947f tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "POST /compute/v2.1/servers/676e42b4-4985-43cc-892b-176e13b341df/action" status: 202 len: 0 microversion: 2.1 time: 1.001424 Sep 07 12:48:03.144356 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1749/3538] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:48:02 2022] POST /compute/v2.1/servers/676e42b4-4985-43cc-892b-176e13b341df/action => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 07 12:48:03.171794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e9e4b30b-bf75-4788-9987-8591a08bc66e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:03.175256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e9e4b30b-bf75-4788-9987-8591a08bc66e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:03.187743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8a31e8ad-237d-4335-8f37-4c4b02074da6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:03.205103 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8a31e8ad-237d-4335-8f37-4c4b02074da6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1687 microversion: 2.1 time: 1.297045 Sep 07 12:48:03.205738 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1790/3539] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:01 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1687 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:03.214125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9e4b30b-bf75-4788-9987-8591a08bc66e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:03.221808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9e4b30b-bf75-4788-9987-8591a08bc66e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:03.222670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9e4b30b-bf75-4788-9987-8591a08bc66e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:03.225435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-5dffba43-cb58-4a8a-9d88-758bd043b55a req-7fcad8c1-037d-46b1-bf0c-c7c2d7fd57e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91762428-7354-4926-b463-edc357e1e7cf", "name": "network-vif-unplugged", "status": "completed", "tag": "8dbc8ca0-72c8-4de0-87af-ac6f1b8ece18"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:48:03.226487 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9e4b30b-bf75-4788-9987-8591a08bc66e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:03.229470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9e4b30b-bf75-4788-9987-8591a08bc66e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:03.238167 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9e4b30b-bf75-4788-9987-8591a08bc66e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:03.258575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5dffba43-cb58-4a8a-9d88-758bd043b55a req-7fcad8c1-037d-46b1-bf0c-c7c2d7fd57e0 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:03.259062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5dffba43-cb58-4a8a-9d88-758bd043b55a req-7fcad8c1-037d-46b1-bf0c-c7c2d7fd57e0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:03.259555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5dffba43-cb58-4a8a-9d88-758bd043b55a req-7fcad8c1-037d-46b1-bf0c-c7c2d7fd57e0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:03.285158 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-5dffba43-cb58-4a8a-9d88-758bd043b55a req-7fcad8c1-037d-46b1-bf0c-c7c2d7fd57e0 service nova] Creating event network-vif-unplugged:8dbc8ca0-72c8-4de0-87af-ac6f1b8ece18 for instance 91762428-7354-4926-b463-edc357e1e7cf on n-h1-852087-9 Sep 07 12:48:03.296632 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-5dffba43-cb58-4a8a-9d88-758bd043b55a req-7fcad8c1-037d-46b1-bf0c-c7c2d7fd57e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089376 Sep 07 12:48:03.300208 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1791/3540] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:48:03.312723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cbad0f99-9667-42be-a259-a9aaa4a0c4e0 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:03.317716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cbad0f99-9667-42be-a259-a9aaa4a0c4e0 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] [instance: d4363e90-4eb0-487a-a798-7a6d0a613e12] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:03.507945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cbad0f99-9667-42be-a259-a9aaa4a0c4e0 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:03.528738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cbad0f99-9667-42be-a259-a9aaa4a0c4e0 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:03.539790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cbad0f99-9667-42be-a259-a9aaa4a0c4e0 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:03.552313 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cbad0f99-9667-42be-a259-a9aaa4a0c4e0 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] 10.222.0.16 "GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12" status: 200 len: 1277 microversion: 2.57 time: 0.248943 Sep 07 12:48:03.562233 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1792/3541] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:03 2022] GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12 => generated 1277 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:03.585923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fe868254-e365-4c81-b61f-8734afdd057c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:03.587767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fe868254-e365-4c81-b61f-8734afdd057c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:03.616959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe868254-e365-4c81-b61f-8734afdd057c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:03.622535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe868254-e365-4c81-b61f-8734afdd057c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:03.624136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe868254-e365-4c81-b61f-8734afdd057c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:03.634942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe868254-e365-4c81-b61f-8734afdd057c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:03.636780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe868254-e365-4c81-b61f-8734afdd057c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:03.638320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe868254-e365-4c81-b61f-8734afdd057c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:04.324052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e9e4b30b-bf75-4788-9987-8591a08bc66e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:04.355749 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e9e4b30b-bf75-4788-9987-8591a08bc66e tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 200 len: 1515 microversion: 2.1 time: 1.205370 Sep 07 12:48:04.364548 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1750/3542] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:03 2022] GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 1515 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:04.405696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0363a18f-01a1-4fd1-b4c9-0b089cfb2aa8 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4180f9c10>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:04.548351 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0363a18f-01a1-4fd1-b4c9-0b089cfb2aa8 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/0212f9d4-0f64-48eb-bcfc-be06de84afdc" status: 200 len: 1455 microversion: 2.1 time: 0.181296 Sep 07 12:48:04.553636 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1751/3543] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:48:04 2022] GET /compute/v2.1/images/0212f9d4-0f64-48eb-bcfc-be06de84afdc => generated 1455 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:04.571123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b39156ae-6d95-4091-a1b0-ab44db9634c4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:48:04.573752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b39156ae-6d95-4091-a1b0-ab44db9634c4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:04.584565 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b39156ae-6d95-4091-a1b0-ab44db9634c4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:04.585471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b39156ae-6d95-4091-a1b0-ab44db9634c4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:04.586178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b39156ae-6d95-4091-a1b0-ab44db9634c4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:04.587153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b39156ae-6d95-4091-a1b0-ab44db9634c4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:04.587810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b39156ae-6d95-4091-a1b0-ab44db9634c4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:04.588637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b39156ae-6d95-4091-a1b0-ab44db9634c4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:04.623199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-b39156ae-6d95-4091-a1b0-ab44db9634c4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lazy-loading 'flavor' on Instance uuid 8425f313-f6b3-462f-92d7-8803be5ff8f2 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:48:04.696377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fe868254-e365-4c81-b61f-8734afdd057c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:04.718382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:48:04.734481 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fe868254-e365-4c81-b61f-8734afdd057c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:04.739144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fe868254-e365-4c81-b61f-8734afdd057c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:04.741141 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fe868254-e365-4c81-b61f-8734afdd057c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1879 microversion: 2.42 time: 1.176790 Sep 07 12:48:04.754410 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1793/3544] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:03 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1879 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:04.770492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-baceef0d-eed2-4428-a2df-6ed1cfdea4cd req-c210dbba-9848-4b73-8607-adccdd6fa414 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f90d70b2-052c-4840-8008-9d9b2b08772a", "tag": "3b263aff-c35a-41f4-8ce7-a3994b2d62ea"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:48:04.784814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-baceef0d-eed2-4428-a2df-6ed1cfdea4cd req-c210dbba-9848-4b73-8607-adccdd6fa414 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:04.785610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-baceef0d-eed2-4428-a2df-6ed1cfdea4cd req-c210dbba-9848-4b73-8607-adccdd6fa414 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:04.786318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-baceef0d-eed2-4428-a2df-6ed1cfdea4cd req-c210dbba-9848-4b73-8607-adccdd6fa414 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:04.801445 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b39156ae-6d95-4091-a1b0-ab44db9634c4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "POST /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2/action" status: 200 len: 32 microversion: 2.1 time: 0.245079 Sep 07 12:48:04.807124 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-baceef0d-eed2-4428-a2df-6ed1cfdea4cd req-c210dbba-9848-4b73-8607-adccdd6fa414 service nova] Creating event network-changed:3b263aff-c35a-41f4-8ce7-a3994b2d62ea for instance f90d70b2-052c-4840-8008-9d9b2b08772a on n-h2-852087-9 Sep 07 12:48:04.811208 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1752/3545] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:48:04 2022] POST /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2/action => generated 32 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:48:04.822796 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-baceef0d-eed2-4428-a2df-6ed1cfdea4cd req-c210dbba-9848-4b73-8607-adccdd6fa414 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066147 Sep 07 12:48:04.824459 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1794/3546] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:48:04.827633 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2afe77ce-2a1f-4914-aa34-fd20dbc77423 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:04.830262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2afe77ce-2a1f-4914-aa34-fd20dbc77423 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:04.844489 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8b21599c-f301-4ee9-bd8d-ee517599130f tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:04.846794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8b21599c-f301-4ee9-bd8d-ee517599130f tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] [instance: d4363e90-4eb0-487a-a798-7a6d0a613e12] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:04.848543 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2afe77ce-2a1f-4914-aa34-fd20dbc77423 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:04.850014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2afe77ce-2a1f-4914-aa34-fd20dbc77423 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:04.851783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2afe77ce-2a1f-4914-aa34-fd20dbc77423 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:04.857887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2afe77ce-2a1f-4914-aa34-fd20dbc77423 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:04.859719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2afe77ce-2a1f-4914-aa34-fd20dbc77423 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:04.862058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2afe77ce-2a1f-4914-aa34-fd20dbc77423 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:04.878569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b21599c-f301-4ee9-bd8d-ee517599130f tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:04.880106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b21599c-f301-4ee9-bd8d-ee517599130f tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:04.881209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b21599c-f301-4ee9-bd8d-ee517599130f tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:04.886900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b21599c-f301-4ee9-bd8d-ee517599130f tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:04.888762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b21599c-f301-4ee9-bd8d-ee517599130f tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:04.890129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b21599c-f301-4ee9-bd8d-ee517599130f tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:05.324876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8b21599c-f301-4ee9-bd8d-ee517599130f tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:05.345734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8b21599c-f301-4ee9-bd8d-ee517599130f tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:05.350101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8b21599c-f301-4ee9-bd8d-ee517599130f tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:05.353413 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8b21599c-f301-4ee9-bd8d-ee517599130f tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] 10.222.0.16 "GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12" status: 200 len: 1329 microversion: 2.57 time: 0.526305 Sep 07 12:48:05.360251 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1795/3547] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:04 2022] GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12 => generated 1329 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:05.376747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ff56c6a1-5cec-42e6-96f9-38c5a2eaece6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:05.378344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ff56c6a1-5cec-42e6-96f9-38c5a2eaece6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:05.399514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff56c6a1-5cec-42e6-96f9-38c5a2eaece6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:05.401716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff56c6a1-5cec-42e6-96f9-38c5a2eaece6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:05.402576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff56c6a1-5cec-42e6-96f9-38c5a2eaece6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:05.408294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff56c6a1-5cec-42e6-96f9-38c5a2eaece6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:05.409381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff56c6a1-5cec-42e6-96f9-38c5a2eaece6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:05.410236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff56c6a1-5cec-42e6-96f9-38c5a2eaece6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:05.848285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2afe77ce-2a1f-4914-aa34-fd20dbc77423 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:05.951347 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2afe77ce-2a1f-4914-aa34-fd20dbc77423 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1687 microversion: 2.1 time: 1.136793 Sep 07 12:48:05.952812 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1753/3548] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:04 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1687 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:05.977119 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-311ff3e5-abdb-4c95-971a-abe15896af30 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:05.979200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-311ff3e5-abdb-4c95-971a-abe15896af30 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:06.003351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-311ff3e5-abdb-4c95-971a-abe15896af30 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:06.007801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-311ff3e5-abdb-4c95-971a-abe15896af30 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:06.010864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-311ff3e5-abdb-4c95-971a-abe15896af30 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:06.013287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-311ff3e5-abdb-4c95-971a-abe15896af30 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:06.021399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-311ff3e5-abdb-4c95-971a-abe15896af30 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:06.022427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-311ff3e5-abdb-4c95-971a-abe15896af30 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:06.610110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ff56c6a1-5cec-42e6-96f9-38c5a2eaece6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:06.628951 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ff56c6a1-5cec-42e6-96f9-38c5a2eaece6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2" status: 200 len: 1520 microversion: 2.1 time: 1.264823 Sep 07 12:48:06.629586 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1796/3549] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:05 2022] GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2 => generated 1520 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:06.651441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-10d4948e-80af-401f-9582-ae1504418a70 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc41873a700>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:06.742639 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-10d4948e-80af-401f-9582-ae1504418a70 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/0212f9d4-0f64-48eb-bcfc-be06de84afdc" status: 200 len: 1455 microversion: 2.1 time: 0.107040 Sep 07 12:48:06.743345 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1797/3550] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:48:06 2022] GET /compute/v2.1/images/0212f9d4-0f64-48eb-bcfc-be06de84afdc => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:06.754859 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c88ef2b2-2e43-471c-955b-763c87fc2f45 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:06.760891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c88ef2b2-2e43-471c-955b-763c87fc2f45 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:06.768895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c88ef2b2-2e43-471c-955b-763c87fc2f45 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:06.769400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c88ef2b2-2e43-471c-955b-763c87fc2f45 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:06.769880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c88ef2b2-2e43-471c-955b-763c87fc2f45 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:06.770618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c88ef2b2-2e43-471c-955b-763c87fc2f45 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:06.771074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c88ef2b2-2e43-471c-955b-763c87fc2f45 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:06.771502 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c88ef2b2-2e43-471c-955b-763c87fc2f45 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:06.991807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-311ff3e5-abdb-4c95-971a-abe15896af30 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:07.020523 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-311ff3e5-abdb-4c95-971a-abe15896af30 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 200 len: 1515 microversion: 2.1 time: 1.062590 Sep 07 12:48:07.035870 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1754/3551] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:05 2022] GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 1515 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:07.063200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-421e60e8-dc70-4762-b992-134a74b473b3 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:07.063989 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-421e60e8-dc70-4762-b992-134a74b473b3 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] [instance: d4363e90-4eb0-487a-a798-7a6d0a613e12] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:07.080509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-421e60e8-dc70-4762-b992-134a74b473b3 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:07.086513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-421e60e8-dc70-4762-b992-134a74b473b3 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:07.087204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-421e60e8-dc70-4762-b992-134a74b473b3 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:07.087991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-421e60e8-dc70-4762-b992-134a74b473b3 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:07.088477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-421e60e8-dc70-4762-b992-134a74b473b3 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:07.088922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-421e60e8-dc70-4762-b992-134a74b473b3 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:07.265296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-421e60e8-dc70-4762-b992-134a74b473b3 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:07.287760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-421e60e8-dc70-4762-b992-134a74b473b3 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:07.289430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-421e60e8-dc70-4762-b992-134a74b473b3 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:07.290721 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-421e60e8-dc70-4762-b992-134a74b473b3 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] 10.222.0.16 "GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12" status: 200 len: 1329 microversion: 2.57 time: 0.253693 Sep 07 12:48:07.291308 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1755/3552] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:07 2022] GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12 => generated 1329 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:07.305154 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-07949e19-6d86-47d0-bf09-0067d50148d0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:07.311312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-07949e19-6d86-47d0-bf09-0067d50148d0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:07.329352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07949e19-6d86-47d0-bf09-0067d50148d0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:07.330319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07949e19-6d86-47d0-bf09-0067d50148d0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:07.331280 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07949e19-6d86-47d0-bf09-0067d50148d0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:07.332221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07949e19-6d86-47d0-bf09-0067d50148d0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:07.332859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07949e19-6d86-47d0-bf09-0067d50148d0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:07.335284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07949e19-6d86-47d0-bf09-0067d50148d0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:08.258720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c88ef2b2-2e43-471c-955b-763c87fc2f45 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:08.272091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c88ef2b2-2e43-471c-955b-763c87fc2f45 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:08.273815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c88ef2b2-2e43-471c-955b-763c87fc2f45 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:08.275575 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c88ef2b2-2e43-471c-955b-763c87fc2f45 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1879 microversion: 2.42 time: 1.530983 Sep 07 12:48:08.276352 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1798/3553] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:06 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1879 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:08.287652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-07949e19-6d86-47d0-bf09-0067d50148d0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:08.306676 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-45b5722c-4b1e-4853-8093-7889008730bc req-5a36139d-30d9-4ad6-b3e7-c810792b60e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f90d70b2-052c-4840-8008-9d9b2b08772a", "tag": "bb3dbd1e-6aad-4076-9d60-f092ced32e09"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:48:08.312450 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-07949e19-6d86-47d0-bf09-0067d50148d0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1687 microversion: 2.1 time: 1.013538 Sep 07 12:48:08.313961 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1756/3554] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:07 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1687 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:08.328002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7b8d59e0-dee4-4f9d-a586-6ddcdff748bd tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:08.338970 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7b8d59e0-dee4-4f9d-a586-6ddcdff748bd tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:08.342991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-45b5722c-4b1e-4853-8093-7889008730bc req-5a36139d-30d9-4ad6-b3e7-c810792b60e6 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:08.343734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-45b5722c-4b1e-4853-8093-7889008730bc req-5a36139d-30d9-4ad6-b3e7-c810792b60e6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:08.344470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-45b5722c-4b1e-4853-8093-7889008730bc req-5a36139d-30d9-4ad6-b3e7-c810792b60e6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:08.368578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b8d59e0-dee4-4f9d-a586-6ddcdff748bd tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:08.370155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b8d59e0-dee4-4f9d-a586-6ddcdff748bd tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:08.371289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b8d59e0-dee4-4f9d-a586-6ddcdff748bd tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:08.373259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b8d59e0-dee4-4f9d-a586-6ddcdff748bd tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:08.374480 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b8d59e0-dee4-4f9d-a586-6ddcdff748bd tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:08.375579 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b8d59e0-dee4-4f9d-a586-6ddcdff748bd tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:08.405868 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-45b5722c-4b1e-4853-8093-7889008730bc req-5a36139d-30d9-4ad6-b3e7-c810792b60e6 service nova] Creating event network-changed:bb3dbd1e-6aad-4076-9d60-f092ced32e09 for instance f90d70b2-052c-4840-8008-9d9b2b08772a on n-h2-852087-9 Sep 07 12:48:08.415519 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-45b5722c-4b1e-4853-8093-7889008730bc req-5a36139d-30d9-4ad6-b3e7-c810792b60e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115636 Sep 07 12:48:08.419898 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1799/3555] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:48:08.432438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5422a653-36af-4114-a4af-5964fb529d84 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc41826daf0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:08.621169 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5422a653-36af-4114-a4af-5964fb529d84 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/0212f9d4-0f64-48eb-bcfc-be06de84afdc" status: 200 len: 1455 microversion: 2.1 time: 0.198106 Sep 07 12:48:08.659069 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1800/3556] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:48:08 2022] GET /compute/v2.1/images/0212f9d4-0f64-48eb-bcfc-be06de84afdc => generated 1455 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:08.671060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ba0f9228-dedd-4bad-82c1-1cf67c938944 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:08.673169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ba0f9228-dedd-4bad-82c1-1cf67c938944 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:08.707966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba0f9228-dedd-4bad-82c1-1cf67c938944 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:08.710332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba0f9228-dedd-4bad-82c1-1cf67c938944 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:08.717569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba0f9228-dedd-4bad-82c1-1cf67c938944 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:08.719497 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba0f9228-dedd-4bad-82c1-1cf67c938944 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:08.720703 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba0f9228-dedd-4bad-82c1-1cf67c938944 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:08.721829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba0f9228-dedd-4bad-82c1-1cf67c938944 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:08.985619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7b8d59e0-dee4-4f9d-a586-6ddcdff748bd tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:09.027402 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7b8d59e0-dee4-4f9d-a586-6ddcdff748bd tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2" status: 200 len: 1520 microversion: 2.1 time: 0.706727 Sep 07 12:48:09.039760 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1757/3557] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:08 2022] GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2 => generated 1520 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:09.060288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7a8687fe-a2d2-4145-811e-f88f6174a618 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:09.062465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7a8687fe-a2d2-4145-811e-f88f6174a618 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] [instance: d4363e90-4eb0-487a-a798-7a6d0a613e12] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:09.082233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a8687fe-a2d2-4145-811e-f88f6174a618 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:09.088005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a8687fe-a2d2-4145-811e-f88f6174a618 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:09.090015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a8687fe-a2d2-4145-811e-f88f6174a618 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:09.096294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a8687fe-a2d2-4145-811e-f88f6174a618 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:09.097714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a8687fe-a2d2-4145-811e-f88f6174a618 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:09.098825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a8687fe-a2d2-4145-811e-f88f6174a618 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:09.123360 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 12:48:09.124093 n-d-852087-9 devstack@n-api.service[122433]: Wed Sep 7 12:48:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 (ip 10.222.0.16) !!! Sep 07 12:48:09.237575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ba0f9228-dedd-4bad-82c1-1cf67c938944 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:09.263504 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ba0f9228-dedd-4bad-82c1-1cf67c938944 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 200 len: 1521 microversion: 2.1 time: 0.601964 Sep 07 12:48:09.277543 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1801/3558] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:08 2022] GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 1521 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:09.292197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a7440cbe-bafb-4c11-8c41-3a9a9b234f29 req-26586e69-4abe-4f18-bc30-13a1b00d39a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edf38c92-ffc2-492b-8642-88ca59537acd", "name": "network-vif-plugged", "status": "completed", "tag": "23b18fbd-594f-42e0-a655-6b5f01607b28"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:48:09.316812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a7440cbe-bafb-4c11-8c41-3a9a9b234f29 req-26586e69-4abe-4f18-bc30-13a1b00d39a4 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:09.320251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a7440cbe-bafb-4c11-8c41-3a9a9b234f29 req-26586e69-4abe-4f18-bc30-13a1b00d39a4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:09.321022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a7440cbe-bafb-4c11-8c41-3a9a9b234f29 req-26586e69-4abe-4f18-bc30-13a1b00d39a4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:09.356096 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a7440cbe-bafb-4c11-8c41-3a9a9b234f29 req-26586e69-4abe-4f18-bc30-13a1b00d39a4 service nova] Creating event network-vif-plugged:23b18fbd-594f-42e0-a655-6b5f01607b28 for instance edf38c92-ffc2-492b-8642-88ca59537acd on n-h1-852087-9 Sep 07 12:48:09.363006 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a7440cbe-bafb-4c11-8c41-3a9a9b234f29 req-26586e69-4abe-4f18-bc30-13a1b00d39a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074802 Sep 07 12:48:09.364043 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1802/3559] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:48:09.382502 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-17d6c88d-feaa-4e38-bf3e-f236ea29b313 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:09.383712 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-17d6c88d-feaa-4e38-bf3e-f236ea29b313 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:09.396835 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17d6c88d-feaa-4e38-bf3e-f236ea29b313 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:09.397592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17d6c88d-feaa-4e38-bf3e-f236ea29b313 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:09.402425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17d6c88d-feaa-4e38-bf3e-f236ea29b313 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:09.403561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17d6c88d-feaa-4e38-bf3e-f236ea29b313 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:09.404811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17d6c88d-feaa-4e38-bf3e-f236ea29b313 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:09.405969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17d6c88d-feaa-4e38-bf3e-f236ea29b313 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:09.778102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7a8687fe-a2d2-4145-811e-f88f6174a618 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:09.816179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7a8687fe-a2d2-4145-811e-f88f6174a618 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:09.824994 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7a8687fe-a2d2-4145-811e-f88f6174a618 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:09.833772 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7a8687fe-a2d2-4145-811e-f88f6174a618 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] 10.222.0.16 "GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12" status: 200 len: 1335 microversion: 2.57 time: 0.791512 Sep 07 12:48:09.843263 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1758/3560] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:09 2022] GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12 => generated 1335 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:09.858676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0aefd8fc-6fe5-401f-aed8-6f2070959d24 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:09.862968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0aefd8fc-6fe5-401f-aed8-6f2070959d24 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:09.914663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0aefd8fc-6fe5-401f-aed8-6f2070959d24 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:09.916750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0aefd8fc-6fe5-401f-aed8-6f2070959d24 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:09.918336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0aefd8fc-6fe5-401f-aed8-6f2070959d24 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:09.921415 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0aefd8fc-6fe5-401f-aed8-6f2070959d24 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:09.923092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0aefd8fc-6fe5-401f-aed8-6f2070959d24 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:09.924436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0aefd8fc-6fe5-401f-aed8-6f2070959d24 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:10.284206 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-17d6c88d-feaa-4e38-bf3e-f236ea29b313 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:10.321525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-17d6c88d-feaa-4e38-bf3e-f236ea29b313 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:10.335124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-17d6c88d-feaa-4e38-bf3e-f236ea29b313 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:10.339971 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-17d6c88d-feaa-4e38-bf3e-f236ea29b313 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1879 microversion: 2.42 time: 0.971311 Sep 07 12:48:10.343468 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1803/3561] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:09 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1879 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:10.361162 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3810fb77-3d52-47dd-8011-5fd2742cbe23 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc418260e50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:10.817608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0aefd8fc-6fe5-401f-aed8-6f2070959d24 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:10.842222 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0aefd8fc-6fe5-401f-aed8-6f2070959d24 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1687 microversion: 2.1 time: 0.992082 Sep 07 12:48:10.847158 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1759/3562] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:09 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1687 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:10.856874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-72391d94-685a-4010-b5b8-bc410fc0ec58 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:10.858341 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-72391d94-685a-4010-b5b8-bc410fc0ec58 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:10.885616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72391d94-685a-4010-b5b8-bc410fc0ec58 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:10.886703 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72391d94-685a-4010-b5b8-bc410fc0ec58 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:10.887631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72391d94-685a-4010-b5b8-bc410fc0ec58 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:10.888811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72391d94-685a-4010-b5b8-bc410fc0ec58 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:10.906002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72391d94-685a-4010-b5b8-bc410fc0ec58 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:10.907400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72391d94-685a-4010-b5b8-bc410fc0ec58 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:11.393918 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-72391d94-685a-4010-b5b8-bc410fc0ec58 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:11.408765 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-72391d94-685a-4010-b5b8-bc410fc0ec58 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2" status: 200 len: 1520 microversion: 2.1 time: 0.559575 Sep 07 12:48:11.411115 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1760/3563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:10 2022] GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2 => generated 1520 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:11.421070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-42095f1e-0b20-4c30-81ba-4d074cca71f8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:11.423049 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-42095f1e-0b20-4c30-81ba-4d074cca71f8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:11.440498 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42095f1e-0b20-4c30-81ba-4d074cca71f8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:11.442816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42095f1e-0b20-4c30-81ba-4d074cca71f8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:11.444402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42095f1e-0b20-4c30-81ba-4d074cca71f8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:11.446499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42095f1e-0b20-4c30-81ba-4d074cca71f8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:11.448128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42095f1e-0b20-4c30-81ba-4d074cca71f8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:11.449431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42095f1e-0b20-4c30-81ba-4d074cca71f8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:11.687883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:48:11.788311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:48:13.125388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-42095f1e-0b20-4c30-81ba-4d074cca71f8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:13.168861 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-42095f1e-0b20-4c30-81ba-4d074cca71f8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 200 len: 1521 microversion: 2.1 time: 1.755331 Sep 07 12:48:13.170068 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1761/3564] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:11 2022] GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 1521 bytes in 1758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:13.197616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e407d96e-129b-405c-9698-cfc6312e7d35 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:13.214307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e407d96e-129b-405c-9698-cfc6312e7d35 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] [instance: d4363e90-4eb0-487a-a798-7a6d0a613e12] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:13.249866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:48:13.253899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e407d96e-129b-405c-9698-cfc6312e7d35 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:13.255261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e407d96e-129b-405c-9698-cfc6312e7d35 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:13.256378 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e407d96e-129b-405c-9698-cfc6312e7d35 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:13.258008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e407d96e-129b-405c-9698-cfc6312e7d35 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:13.258764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e407d96e-129b-405c-9698-cfc6312e7d35 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:13.259480 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e407d96e-129b-405c-9698-cfc6312e7d35 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:13.516030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:48:13.567607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e407d96e-129b-405c-9698-cfc6312e7d35 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:13.594124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e407d96e-129b-405c-9698-cfc6312e7d35 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:13.606258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e407d96e-129b-405c-9698-cfc6312e7d35 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:13.622478 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e407d96e-129b-405c-9698-cfc6312e7d35 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] 10.222.0.16 "GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12" status: 200 len: 1335 microversion: 2.57 time: 0.445940 Sep 07 12:48:13.643358 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1762/3565] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:13 2022] GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12 => generated 1335 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:13.653893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-58d52f47-1f27-4d0f-86f4-6cca5a6dc97d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:13.653893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-58d52f47-1f27-4d0f-86f4-6cca5a6dc97d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:13.692930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58d52f47-1f27-4d0f-86f4-6cca5a6dc97d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:13.694969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58d52f47-1f27-4d0f-86f4-6cca5a6dc97d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:13.697267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58d52f47-1f27-4d0f-86f4-6cca5a6dc97d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:13.699293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58d52f47-1f27-4d0f-86f4-6cca5a6dc97d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:13.702901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58d52f47-1f27-4d0f-86f4-6cca5a6dc97d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:13.706052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58d52f47-1f27-4d0f-86f4-6cca5a6dc97d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:14.835949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-58d52f47-1f27-4d0f-86f4-6cca5a6dc97d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:14.859718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-58d52f47-1f27-4d0f-86f4-6cca5a6dc97d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:14.866421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-58d52f47-1f27-4d0f-86f4-6cca5a6dc97d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:14.868181 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-58d52f47-1f27-4d0f-86f4-6cca5a6dc97d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1879 microversion: 2.42 time: 1.233194 Sep 07 12:48:14.887421 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1763/3566] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:13 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1879 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:14.905173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d5309aa2-9bdb-488d-b7c7-c6771ce08a46 req-a7c27954-fbb3-41fa-b99d-e40104aeb25c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5203be99-6bdd-42c2-955d-90ce3a228ed3", "name": "network-vif-unplugged", "status": "completed", "tag": "7d26615d-741b-4cfa-a0ce-5b16555ea640"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:48:14.928873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d5309aa2-9bdb-488d-b7c7-c6771ce08a46 req-a7c27954-fbb3-41fa-b99d-e40104aeb25c service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:14.930216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d5309aa2-9bdb-488d-b7c7-c6771ce08a46 req-a7c27954-fbb3-41fa-b99d-e40104aeb25c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:14.932268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d5309aa2-9bdb-488d-b7c7-c6771ce08a46 req-a7c27954-fbb3-41fa-b99d-e40104aeb25c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:14.990559 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d5309aa2-9bdb-488d-b7c7-c6771ce08a46 req-a7c27954-fbb3-41fa-b99d-e40104aeb25c service nova] Creating event network-vif-unplugged:7d26615d-741b-4cfa-a0ce-5b16555ea640 for instance 5203be99-6bdd-42c2-955d-90ce3a228ed3 on n-h1-852087-9 Sep 07 12:48:15.004828 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d5309aa2-9bdb-488d-b7c7-c6771ce08a46 req-a7c27954-fbb3-41fa-b99d-e40104aeb25c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124710 Sep 07 12:48:15.013534 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1764/3567] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:48:15.036449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-57f17c5e-ff34-45a2-bc27-2898f9e66f64 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:15.037909 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-57f17c5e-ff34-45a2-bc27-2898f9e66f64 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:15.056869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57f17c5e-ff34-45a2-bc27-2898f9e66f64 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:15.058157 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57f17c5e-ff34-45a2-bc27-2898f9e66f64 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:15.059282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57f17c5e-ff34-45a2-bc27-2898f9e66f64 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:15.060845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57f17c5e-ff34-45a2-bc27-2898f9e66f64 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:15.062941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57f17c5e-ff34-45a2-bc27-2898f9e66f64 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:15.065374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57f17c5e-ff34-45a2-bc27-2898f9e66f64 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:15.744767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-57f17c5e-ff34-45a2-bc27-2898f9e66f64 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:15.758033 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-57f17c5e-ff34-45a2-bc27-2898f9e66f64 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1682 microversion: 2.1 time: 0.742182 Sep 07 12:48:15.786069 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1765/3568] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:15 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1682 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:15.791454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7c3a8c71-6dfc-4da6-87dc-ea258e065bcd tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:15.792061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7c3a8c71-6dfc-4da6-87dc-ea258e065bcd tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:15.813460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c3a8c71-6dfc-4da6-87dc-ea258e065bcd tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:15.814479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c3a8c71-6dfc-4da6-87dc-ea258e065bcd tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:15.815151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c3a8c71-6dfc-4da6-87dc-ea258e065bcd tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:15.816142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c3a8c71-6dfc-4da6-87dc-ea258e065bcd tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:15.830098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c3a8c71-6dfc-4da6-87dc-ea258e065bcd tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:15.831123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c3a8c71-6dfc-4da6-87dc-ea258e065bcd tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:16.180299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7c3a8c71-6dfc-4da6-87dc-ea258e065bcd tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:16.189212 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7c3a8c71-6dfc-4da6-87dc-ea258e065bcd tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2" status: 200 len: 1520 microversion: 2.1 time: 0.401739 Sep 07 12:48:16.196978 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1766/3569] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:15 2022] GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2 => generated 1520 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:16.316815 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e09eecec-4e55-4d79-8adb-c8bd96b90fa7 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1583621720", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "5482d43e-2908-421f-b8da-a795b1d6a3b3"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:48:19.396481 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=55 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:48:20.296668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=58 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:48:21.155246 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3810fb77-3d52-47dd-8011-5fd2742cbe23 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/0212f9d4-0f64-48eb-bcfc-be06de84afdc" status: 200 len: 1455 microversion: 2.1 time: 10.807049 Sep 07 12:48:21.161247 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1804/3570] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:48:10 2022] GET /compute/v2.1/images/0212f9d4-0f64-48eb-bcfc-be06de84afdc => generated 1455 bytes in 10814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:21.177440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6358ca1b-4b41-462a-abc6-822ae140dbf1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:21.190101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6358ca1b-4b41-462a-abc6-822ae140dbf1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:21.195727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-e09eecec-4e55-4d79-8adb-c8bd96b90fa7 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] validate_networks() for [('5482d43e-2908-421f-b8da-a795b1d6a3b3', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:48:21.209616 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6358ca1b-4b41-462a-abc6-822ae140dbf1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:21.210144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6358ca1b-4b41-462a-abc6-822ae140dbf1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:21.210619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6358ca1b-4b41-462a-abc6-822ae140dbf1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:21.211414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6358ca1b-4b41-462a-abc6-822ae140dbf1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:21.211890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6358ca1b-4b41-462a-abc6-822ae140dbf1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:21.212381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6358ca1b-4b41-462a-abc6-822ae140dbf1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:21.741786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6358ca1b-4b41-462a-abc6-822ae140dbf1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:21.756528 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6358ca1b-4b41-462a-abc6-822ae140dbf1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 200 len: 1521 microversion: 2.1 time: 0.588365 Sep 07 12:48:21.770241 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1805/3571] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:21 2022] GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 1521 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:21.815244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-23e32c86-2461-4fb5-a34f-2dc0a8012348 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:21.815950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-23e32c86-2461-4fb5-a34f-2dc0a8012348 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] [instance: d4363e90-4eb0-487a-a798-7a6d0a613e12] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:21.847540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23e32c86-2461-4fb5-a34f-2dc0a8012348 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:21.848142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23e32c86-2461-4fb5-a34f-2dc0a8012348 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:21.853817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23e32c86-2461-4fb5-a34f-2dc0a8012348 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:21.855786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23e32c86-2461-4fb5-a34f-2dc0a8012348 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:21.856334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23e32c86-2461-4fb5-a34f-2dc0a8012348 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:21.856796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23e32c86-2461-4fb5-a34f-2dc0a8012348 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:21.990399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-23e32c86-2461-4fb5-a34f-2dc0a8012348 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:21.999706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-23e32c86-2461-4fb5-a34f-2dc0a8012348 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:22.001253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-23e32c86-2461-4fb5-a34f-2dc0a8012348 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:22.009525 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-23e32c86-2461-4fb5-a34f-2dc0a8012348 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] 10.222.0.16 "GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12" status: 200 len: 1356 microversion: 2.57 time: 0.232988 Sep 07 12:48:22.014733 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1806/3572] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:21 2022] GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12 => generated 1356 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:22.020045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-58931837-21bf-4639-8ebb-160dbcb3f387 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:22.021984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-58931837-21bf-4639-8ebb-160dbcb3f387 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:22.041199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58931837-21bf-4639-8ebb-160dbcb3f387 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:22.042055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58931837-21bf-4639-8ebb-160dbcb3f387 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:22.042910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58931837-21bf-4639-8ebb-160dbcb3f387 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:22.043845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58931837-21bf-4639-8ebb-160dbcb3f387 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:22.044629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58931837-21bf-4639-8ebb-160dbcb3f387 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:22.045226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58931837-21bf-4639-8ebb-160dbcb3f387 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:22.789281 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e09eecec-4e55-4d79-8adb-c8bd96b90fa7 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:48:22.790546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e09eecec-4e55-4d79-8adb-c8bd96b90fa7 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:48:22.791244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e09eecec-4e55-4d79-8adb-c8bd96b90fa7 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:48:22.792837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e09eecec-4e55-4d79-8adb-c8bd96b90fa7 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:48:22.793507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e09eecec-4e55-4d79-8adb-c8bd96b90fa7 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:48:22.823759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e09eecec-4e55-4d79-8adb-c8bd96b90fa7 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:22.824560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e09eecec-4e55-4d79-8adb-c8bd96b90fa7 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:22.825204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e09eecec-4e55-4d79-8adb-c8bd96b90fa7 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:22.826240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e09eecec-4e55-4d79-8adb-c8bd96b90fa7 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:22.827240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e09eecec-4e55-4d79-8adb-c8bd96b90fa7 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:22.827862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e09eecec-4e55-4d79-8adb-c8bd96b90fa7 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:22.880123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-e09eecec-4e55-4d79-8adb-c8bd96b90fa7 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Getting quotas for project d8029a72c23341e9977b259a56b94bd2. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:48:22.897251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-e09eecec-4e55-4d79-8adb-c8bd96b90fa7 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Getting quotas for user 0d8d3e8ed9a14ea6b593d0e199996ab3 and project d8029a72c23341e9977b259a56b94bd2. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:48:22.923585 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-58931837-21bf-4639-8ebb-160dbcb3f387 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:22.942428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-58931837-21bf-4639-8ebb-160dbcb3f387 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:22.943958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-58931837-21bf-4639-8ebb-160dbcb3f387 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:22.945245 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-58931837-21bf-4639-8ebb-160dbcb3f387 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1879 microversion: 2.42 time: 0.929102 Sep 07 12:48:22.960661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e09eecec-4e55-4d79-8adb-c8bd96b90fa7 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:48:22.968091 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1807/3573] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:22 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1879 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:23.004647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e09eecec-4e55-4d79-8adb-c8bd96b90fa7 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] [instance: bf13a2d3-c288-435f-a0ae-b47b19839312] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:48:23.012385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e0aa9352-bbf9-4407-9560-4b03d74e04d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:23.022271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e0aa9352-bbf9-4407-9560-4b03d74e04d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:23.062324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0aa9352-bbf9-4407-9560-4b03d74e04d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:23.063608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0aa9352-bbf9-4407-9560-4b03d74e04d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:23.069529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0aa9352-bbf9-4407-9560-4b03d74e04d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:23.087378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0aa9352-bbf9-4407-9560-4b03d74e04d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:23.095469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0aa9352-bbf9-4407-9560-4b03d74e04d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:23.098525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0aa9352-bbf9-4407-9560-4b03d74e04d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:23.311727 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e09eecec-4e55-4d79-8adb-c8bd96b90fa7 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 7.111879 Sep 07 12:48:23.322449 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1767/3574] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Sep 7 12:48:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 7114 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 12:48:23.363304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8e1faff9-d640-419a-ac86-78de4036b25d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:23.366191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8e1faff9-d640-419a-ac86-78de4036b25d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:23.425124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e1faff9-d640-419a-ac86-78de4036b25d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:23.452183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e1faff9-d640-419a-ac86-78de4036b25d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:23.458606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e1faff9-d640-419a-ac86-78de4036b25d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:23.460471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e1faff9-d640-419a-ac86-78de4036b25d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:23.469178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e1faff9-d640-419a-ac86-78de4036b25d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:23.470156 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e1faff9-d640-419a-ac86-78de4036b25d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:23.835095 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e0aa9352-bbf9-4407-9560-4b03d74e04d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:23.875173 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e0aa9352-bbf9-4407-9560-4b03d74e04d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1682 microversion: 2.1 time: 0.876480 Sep 07 12:48:23.909538 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1808/3575] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:22 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1682 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:23.909538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8cc40830-cc99-467a-87fa-87d75778829a req-70809264-4aff-449c-b045-647dbb12de0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "676e42b4-4985-43cc-892b-176e13b341df", "name": "network-vif-plugged", "status": "completed", "tag": "8973b130-dd43-4a93-b14e-3d7f5131cd14"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:48:23.960420 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8cc40830-cc99-467a-87fa-87d75778829a req-70809264-4aff-449c-b045-647dbb12de0c service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:23.960969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8cc40830-cc99-467a-87fa-87d75778829a req-70809264-4aff-449c-b045-647dbb12de0c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:23.961370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8cc40830-cc99-467a-87fa-87d75778829a req-70809264-4aff-449c-b045-647dbb12de0c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:23.997980 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8cc40830-cc99-467a-87fa-87d75778829a req-70809264-4aff-449c-b045-647dbb12de0c service nova] Creating event network-vif-plugged:8973b130-dd43-4a93-b14e-3d7f5131cd14 for instance 676e42b4-4985-43cc-892b-176e13b341df on n-h2-852087-9 Sep 07 12:48:24.015954 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8cc40830-cc99-467a-87fa-87d75778829a req-70809264-4aff-449c-b045-647dbb12de0c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119848 Sep 07 12:48:24.016833 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1809/3576] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:48:24.030782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a5020a02-3348-42ed-a997-b02967a51b07 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:48:24.037294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a5020a02-3348-42ed-a997-b02967a51b07 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] [instance: d4363e90-4eb0-487a-a798-7a6d0a613e12] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:24.059897 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5020a02-3348-42ed-a997-b02967a51b07 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:24.060455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5020a02-3348-42ed-a997-b02967a51b07 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:24.062786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5020a02-3348-42ed-a997-b02967a51b07 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:24.064540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5020a02-3348-42ed-a997-b02967a51b07 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:24.068566 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5020a02-3348-42ed-a997-b02967a51b07 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:24.070833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5020a02-3348-42ed-a997-b02967a51b07 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:24.136625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8e1faff9-d640-419a-ac86-78de4036b25d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:24.165572 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8e1faff9-d640-419a-ac86-78de4036b25d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2" status: 200 len: 1520 microversion: 2.1 time: 0.835034 Sep 07 12:48:24.169090 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1768/3577] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:23 2022] GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2 => generated 1520 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:24.189715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2940cfe8-9d4e-4ce9-822d-75f6e4aee6b1 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4180425e0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:32.639182 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2940cfe8-9d4e-4ce9-822d-75f6e4aee6b1 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/0212f9d4-0f64-48eb-bcfc-be06de84afdc" status: 200 len: 1464 microversion: 2.1 time: 8.468283 Sep 07 12:48:32.654064 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1769/3578] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:48:24 2022] GET /compute/v2.1/images/0212f9d4-0f64-48eb-bcfc-be06de84afdc => generated 1464 bytes in 8484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:32.667288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a5020a02-3348-42ed-a997-b02967a51b07 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:48:32.667288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a5020a02-3348-42ed-a997-b02967a51b07 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:48:32.667288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a5020a02-3348-42ed-a997-b02967a51b07 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:48:32.667288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a5020a02-3348-42ed-a997-b02967a51b07 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:48:32.667288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a5020a02-3348-42ed-a997-b02967a51b07 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:48:32.675838 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2ed2ba4d-1d25-41c2-9dad-f343f4d33b88 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:32.677143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2ed2ba4d-1d25-41c2-9dad-f343f4d33b88 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:32.688902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ed2ba4d-1d25-41c2-9dad-f343f4d33b88 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:32.690197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ed2ba4d-1d25-41c2-9dad-f343f4d33b88 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:32.691233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ed2ba4d-1d25-41c2-9dad-f343f4d33b88 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:32.692863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ed2ba4d-1d25-41c2-9dad-f343f4d33b88 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:32.694155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ed2ba4d-1d25-41c2-9dad-f343f4d33b88 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:32.695152 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ed2ba4d-1d25-41c2-9dad-f343f4d33b88 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:32.792025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a5020a02-3348-42ed-a997-b02967a51b07 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] [instance: d4363e90-4eb0-487a-a798-7a6d0a613e12] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:32.822121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5020a02-3348-42ed-a997-b02967a51b07 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:32.825952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5020a02-3348-42ed-a997-b02967a51b07 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:32.827317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5020a02-3348-42ed-a997-b02967a51b07 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:32.830614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5020a02-3348-42ed-a997-b02967a51b07 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:32.831425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5020a02-3348-42ed-a997-b02967a51b07 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:32.834189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5020a02-3348-42ed-a997-b02967a51b07 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:32.861128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:48:32.923530 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a5020a02-3348-42ed-a997-b02967a51b07 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] 10.222.0.16 "POST /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12/action" status: 202 len: 1137 microversion: 2.57 time: 8.903608 Sep 07 12:48:32.925050 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1810/3579] 10.222.0.16 () {62 vars in 1320 bytes} [Wed Sep 7 12:48:24 2022] POST /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12/action => generated 1137 bytes in 8907 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 07 12:48:32.938982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bc0f349b-8f54-4919-a75d-c7c0bc7ebe6d tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:32.939681 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bc0f349b-8f54-4919-a75d-c7c0bc7ebe6d tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] [instance: bf13a2d3-c288-435f-a0ae-b47b19839312] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:32.950864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:48:32.964069 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc0f349b-8f54-4919-a75d-c7c0bc7ebe6d tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:32.964577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc0f349b-8f54-4919-a75d-c7c0bc7ebe6d tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:32.965035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc0f349b-8f54-4919-a75d-c7c0bc7ebe6d tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:32.965799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc0f349b-8f54-4919-a75d-c7c0bc7ebe6d tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:32.966269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc0f349b-8f54-4919-a75d-c7c0bc7ebe6d tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:32.966825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc0f349b-8f54-4919-a75d-c7c0bc7ebe6d tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:32.990324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2ed2ba4d-1d25-41c2-9dad-f343f4d33b88 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:33.002346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:48:33.006816 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2ed2ba4d-1d25-41c2-9dad-f343f4d33b88 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 200 len: 1521 microversion: 2.1 time: 0.350501 Sep 07 12:48:33.030826 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1770/3580] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:32 2022] GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:33.060727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8ec9e148-d9fd-4d2b-83b0-c0770eaa6b1a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:33.062548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8ec9e148-d9fd-4d2b-83b0-c0770eaa6b1a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:33.082069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ec9e148-d9fd-4d2b-83b0-c0770eaa6b1a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:33.083649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ec9e148-d9fd-4d2b-83b0-c0770eaa6b1a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:33.084835 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ec9e148-d9fd-4d2b-83b0-c0770eaa6b1a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:33.086582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ec9e148-d9fd-4d2b-83b0-c0770eaa6b1a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:33.087837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ec9e148-d9fd-4d2b-83b0-c0770eaa6b1a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:33.089026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ec9e148-d9fd-4d2b-83b0-c0770eaa6b1a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:33.246214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bc0f349b-8f54-4919-a75d-c7c0bc7ebe6d tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:33.282101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bc0f349b-8f54-4919-a75d-c7c0bc7ebe6d tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:33.286893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bc0f349b-8f54-4919-a75d-c7c0bc7ebe6d tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:33.290060 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bc0f349b-8f54-4919-a75d-c7c0bc7ebe6d tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312" status: 200 len: 1362 microversion: 2.26 time: 0.363392 Sep 07 12:48:33.291820 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1811/3581] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:32 2022] GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312 => generated 1362 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:33.302768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b9bf8135-e8a3-4852-a3c2-2fb040d7f949 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:33.304644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b9bf8135-e8a3-4852-a3c2-2fb040d7f949 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:33.320491 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9bf8135-e8a3-4852-a3c2-2fb040d7f949 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:33.327693 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9bf8135-e8a3-4852-a3c2-2fb040d7f949 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:33.327693 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9bf8135-e8a3-4852-a3c2-2fb040d7f949 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:33.327693 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9bf8135-e8a3-4852-a3c2-2fb040d7f949 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:33.327693 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9bf8135-e8a3-4852-a3c2-2fb040d7f949 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:33.327693 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9bf8135-e8a3-4852-a3c2-2fb040d7f949 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:33.670745 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8ec9e148-d9fd-4d2b-83b0-c0770eaa6b1a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:33.696266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8ec9e148-d9fd-4d2b-83b0-c0770eaa6b1a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:33.699491 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b9bf8135-e8a3-4852-a3c2-2fb040d7f949 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:33.701346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8ec9e148-d9fd-4d2b-83b0-c0770eaa6b1a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:33.704821 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8ec9e148-d9fd-4d2b-83b0-c0770eaa6b1a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1879 microversion: 2.42 time: 0.671710 Sep 07 12:48:33.706209 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1771/3582] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:33 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1879 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:33.709255 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b9bf8135-e8a3-4852-a3c2-2fb040d7f949 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1682 microversion: 2.1 time: 0.415695 Sep 07 12:48:33.710574 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1812/3583] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:33 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1682 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:33.715990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a10e3029-0e59-4690-9556-861aa1ce9cda req-b96815e6-b062-4b1d-a5c9-4f08fc3521cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5203be99-6bdd-42c2-955d-90ce3a228ed3", "name": "network-vif-plugged", "status": "completed", "tag": "7d26615d-741b-4cfa-a0ce-5b16555ea640"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:48:33.717316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6acda851-ff23-4859-b7a8-8c236b7e9e3f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:33.718651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6acda851-ff23-4859-b7a8-8c236b7e9e3f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:33.727597 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a10e3029-0e59-4690-9556-861aa1ce9cda req-b96815e6-b062-4b1d-a5c9-4f08fc3521cb service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:33.728351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a10e3029-0e59-4690-9556-861aa1ce9cda req-b96815e6-b062-4b1d-a5c9-4f08fc3521cb service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:33.728966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a10e3029-0e59-4690-9556-861aa1ce9cda req-b96815e6-b062-4b1d-a5c9-4f08fc3521cb service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:33.745379 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a10e3029-0e59-4690-9556-861aa1ce9cda req-b96815e6-b062-4b1d-a5c9-4f08fc3521cb service nova] Creating event network-vif-plugged:7d26615d-741b-4cfa-a0ce-5b16555ea640 for instance 5203be99-6bdd-42c2-955d-90ce3a228ed3 on n-h1-852087-9 Sep 07 12:48:33.752407 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a10e3029-0e59-4690-9556-861aa1ce9cda req-b96815e6-b062-4b1d-a5c9-4f08fc3521cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040249 Sep 07 12:48:33.753025 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1813/3584] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:48:33.758997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-aeb0853d-d09c-404a-a735-7356a0c91bfe req-06567c99-3619-42b4-b55b-85f6b58f0bdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf13a2d3-c288-435f-a0ae-b47b19839312", "tag": "ac0d74d3-f3f5-4d6a-a3da-030e64c6e998"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:48:33.765727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6acda851-ff23-4859-b7a8-8c236b7e9e3f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:33.766688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6acda851-ff23-4859-b7a8-8c236b7e9e3f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:33.767592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6acda851-ff23-4859-b7a8-8c236b7e9e3f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:33.769370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6acda851-ff23-4859-b7a8-8c236b7e9e3f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:33.770848 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-aeb0853d-d09c-404a-a735-7356a0c91bfe req-06567c99-3619-42b4-b55b-85f6b58f0bdd service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:33.771330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-aeb0853d-d09c-404a-a735-7356a0c91bfe req-06567c99-3619-42b4-b55b-85f6b58f0bdd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:33.771538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6acda851-ff23-4859-b7a8-8c236b7e9e3f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:33.771748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-aeb0853d-d09c-404a-a735-7356a0c91bfe req-06567c99-3619-42b4-b55b-85f6b58f0bdd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:33.772460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6acda851-ff23-4859-b7a8-8c236b7e9e3f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:33.785837 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-aeb0853d-d09c-404a-a735-7356a0c91bfe req-06567c99-3619-42b4-b55b-85f6b58f0bdd service nova] Creating event network-changed:ac0d74d3-f3f5-4d6a-a3da-030e64c6e998 for instance bf13a2d3-c288-435f-a0ae-b47b19839312 on n-h1-852087-9 Sep 07 12:48:33.792234 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-aeb0853d-d09c-404a-a735-7356a0c91bfe req-06567c99-3619-42b4-b55b-85f6b58f0bdd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037413 Sep 07 12:48:33.793184 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1814/3585] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:48:33.800910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4c06afeb-153d-426e-a4cd-5f3d0fea29db tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4183fbaf0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:33.876402 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4c06afeb-153d-426e-a4cd-5f3d0fea29db tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/0212f9d4-0f64-48eb-bcfc-be06de84afdc" status: 200 len: 1464 microversion: 2.1 time: 0.081167 Sep 07 12:48:33.885929 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1815/3586] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:48:33 2022] GET /compute/v2.1/images/0212f9d4-0f64-48eb-bcfc-be06de84afdc => generated 1464 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:33.885929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae44bc69-9f62-46ff-8e9b-f9474c1df8d1 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:33.885929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ae44bc69-9f62-46ff-8e9b-f9474c1df8d1 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] [instance: d4363e90-4eb0-487a-a798-7a6d0a613e12] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:33.893247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae44bc69-9f62-46ff-8e9b-f9474c1df8d1 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:33.894281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae44bc69-9f62-46ff-8e9b-f9474c1df8d1 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:33.894963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae44bc69-9f62-46ff-8e9b-f9474c1df8d1 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:33.896084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae44bc69-9f62-46ff-8e9b-f9474c1df8d1 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:33.897125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae44bc69-9f62-46ff-8e9b-f9474c1df8d1 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:33.897841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae44bc69-9f62-46ff-8e9b-f9474c1df8d1 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:34.116003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ae44bc69-9f62-46ff-8e9b-f9474c1df8d1 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:34.143047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ae44bc69-9f62-46ff-8e9b-f9474c1df8d1 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:34.150768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ae44bc69-9f62-46ff-8e9b-f9474c1df8d1 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:34.152877 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ae44bc69-9f62-46ff-8e9b-f9474c1df8d1 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] 10.222.0.16 "GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12" status: 200 len: 1365 microversion: 2.57 time: 0.273660 Sep 07 12:48:34.154192 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1816/3587] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:33 2022] GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12 => generated 1365 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:34.201322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c0dadefa-8590-4c08-b0ba-4cbdab5e791d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:34.202765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c0dadefa-8590-4c08-b0ba-4cbdab5e791d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 676e42b4-4985-43cc-892b-176e13b341df] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:34.217265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0dadefa-8590-4c08-b0ba-4cbdab5e791d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:34.219182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0dadefa-8590-4c08-b0ba-4cbdab5e791d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:34.219975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0dadefa-8590-4c08-b0ba-4cbdab5e791d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:34.221262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0dadefa-8590-4c08-b0ba-4cbdab5e791d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:34.222108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0dadefa-8590-4c08-b0ba-4cbdab5e791d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:34.222835 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0dadefa-8590-4c08-b0ba-4cbdab5e791d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:34.252337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6acda851-ff23-4859-b7a8-8c236b7e9e3f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:34.268372 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6acda851-ff23-4859-b7a8-8c236b7e9e3f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2" status: 200 len: 1520 microversion: 2.1 time: 0.559981 Sep 07 12:48:34.280122 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1772/3588] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:33 2022] GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2 => generated 1520 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:34.312618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c486ad6d-fb38-4000-8f6e-211f5004d5ce tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:34.313903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c486ad6d-fb38-4000-8f6e-211f5004d5ce tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:34.334662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c486ad6d-fb38-4000-8f6e-211f5004d5ce tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:34.335550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c486ad6d-fb38-4000-8f6e-211f5004d5ce tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:34.336354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c486ad6d-fb38-4000-8f6e-211f5004d5ce tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:34.337706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c486ad6d-fb38-4000-8f6e-211f5004d5ce tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:34.339127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c486ad6d-fb38-4000-8f6e-211f5004d5ce tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:34.340289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c486ad6d-fb38-4000-8f6e-211f5004d5ce tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:34.595176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c0dadefa-8590-4c08-b0ba-4cbdab5e791d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796a821c4f184a6aac2859bb943f9bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a87170da674037af70fac57a366c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:34.609733 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c0dadefa-8590-4c08-b0ba-4cbdab5e791d tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/676e42b4-4985-43cc-892b-176e13b341df" status: 200 len: 1467 microversion: 2.1 time: 0.421298 Sep 07 12:48:34.626414 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1817/3589] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:34 2022] GET /compute/v2.1/servers/676e42b4-4985-43cc-892b-176e13b341df => generated 1467 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:34.656254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6e720f7b-cf57-46d4-9c1a-8607c3fdb1aa tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:34.657644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6e720f7b-cf57-46d4-9c1a-8607c3fdb1aa tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] [instance: bf13a2d3-c288-435f-a0ae-b47b19839312] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:34.659152 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c486ad6d-fb38-4000-8f6e-211f5004d5ce tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:34.679375 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c486ad6d-fb38-4000-8f6e-211f5004d5ce tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 200 len: 1521 microversion: 2.1 time: 0.397152 Sep 07 12:48:34.680315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e720f7b-cf57-46d4-9c1a-8607c3fdb1aa tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:34.683542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e720f7b-cf57-46d4-9c1a-8607c3fdb1aa tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:34.684713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e720f7b-cf57-46d4-9c1a-8607c3fdb1aa tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:34.684928 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1773/3590] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:34 2022] GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:34.693406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e720f7b-cf57-46d4-9c1a-8607c3fdb1aa tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:34.694860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e720f7b-cf57-46d4-9c1a-8607c3fdb1aa tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:34.695805 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e720f7b-cf57-46d4-9c1a-8607c3fdb1aa tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:34.719940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-82a030c7-f2e4-4fa3-b0d6-c5cc3f4d4cf7 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4181f10d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:34.964731 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-82a030c7-f2e4-4fa3-b0d6-c5cc3f4d4cf7 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images?changes-since=2022-09-07T12%3A45%3A49Z" status: 200 len: 1903 microversion: 2.1 time: 0.277833 Sep 07 12:48:34.977520 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1774/3591] 10.222.0.16 () {58 vars in 1199 bytes} [Wed Sep 7 12:48:34 2022] GET /compute/v2.1/images?changes-since=2022-09-07T12%3A45%3A49Z => generated 1903 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:34.983748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-778f9111-2d8e-4eb4-876f-b7aa5311e01c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:34.984767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-778f9111-2d8e-4eb4-876f-b7aa5311e01c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:34.994269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-778f9111-2d8e-4eb4-876f-b7aa5311e01c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:34.995394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-778f9111-2d8e-4eb4-876f-b7aa5311e01c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:34.996318 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-778f9111-2d8e-4eb4-876f-b7aa5311e01c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:34.998053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-778f9111-2d8e-4eb4-876f-b7aa5311e01c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:34.998980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-778f9111-2d8e-4eb4-876f-b7aa5311e01c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:34.999678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-778f9111-2d8e-4eb4-876f-b7aa5311e01c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:35.116386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6e720f7b-cf57-46d4-9c1a-8607c3fdb1aa tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:35.134305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6e720f7b-cf57-46d4-9c1a-8607c3fdb1aa tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:35.138233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6e720f7b-cf57-46d4-9c1a-8607c3fdb1aa tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:35.140413 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6e720f7b-cf57-46d4-9c1a-8607c3fdb1aa tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312" status: 200 len: 1362 microversion: 2.26 time: 0.512264 Sep 07 12:48:35.153534 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1818/3592] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:34 2022] GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312 => generated 1362 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:35.153534 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8d0c9379-088a-4af2-8f6e-783aa4b0cdf3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:35.153534 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8d0c9379-088a-4af2-8f6e-783aa4b0cdf3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:35.173855 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d0c9379-088a-4af2-8f6e-783aa4b0cdf3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:35.174839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d0c9379-088a-4af2-8f6e-783aa4b0cdf3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:35.175672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d0c9379-088a-4af2-8f6e-783aa4b0cdf3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:35.186639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d0c9379-088a-4af2-8f6e-783aa4b0cdf3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:35.188027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d0c9379-088a-4af2-8f6e-783aa4b0cdf3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:35.188865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d0c9379-088a-4af2-8f6e-783aa4b0cdf3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:35.482840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-778f9111-2d8e-4eb4-876f-b7aa5311e01c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:35.507820 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-778f9111-2d8e-4eb4-876f-b7aa5311e01c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:35.511660 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-778f9111-2d8e-4eb4-876f-b7aa5311e01c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:35.514052 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-778f9111-2d8e-4eb4-876f-b7aa5311e01c tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1879 microversion: 2.42 time: 0.534658 Sep 07 12:48:35.516076 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1775/3593] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:34 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1879 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:35.525009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-67a2b8ef-903d-4ccf-9d2b-b69f461b6d68 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4180adaf0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:35.655595 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8d0c9379-088a-4af2-8f6e-783aa4b0cdf3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:35.671592 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-67a2b8ef-903d-4ccf-9d2b-b69f461b6d68 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1181557789" status: 200 len: 485 microversion: 2.1 time: 0.153502 Sep 07 12:48:35.673615 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1776/3594] 10.222.0.16 () {58 vars in 1231 bytes} [Wed Sep 7 12:48:35 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1181557789 => generated 485 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:48:35.684451 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8d0c9379-088a-4af2-8f6e-783aa4b0cdf3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1682 microversion: 2.1 time: 0.537407 Sep 07 12:48:35.685543 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1819/3595] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:35 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1682 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:35.690590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de081f06-4386-49e7-9def-9e096851d73a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:35.691691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-de081f06-4386-49e7-9def-9e096851d73a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:35.699520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de081f06-4386-49e7-9def-9e096851d73a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:35.700319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de081f06-4386-49e7-9def-9e096851d73a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:35.700896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de081f06-4386-49e7-9def-9e096851d73a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:35.702147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de081f06-4386-49e7-9def-9e096851d73a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:35.702864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de081f06-4386-49e7-9def-9e096851d73a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:35.703490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de081f06-4386-49e7-9def-9e096851d73a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:35.709539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e864a65a-5ac1-428b-b7fd-03df39164c21 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:35.709539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e864a65a-5ac1-428b-b7fd-03df39164c21 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] [instance: d4363e90-4eb0-487a-a798-7a6d0a613e12] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:35.724092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e864a65a-5ac1-428b-b7fd-03df39164c21 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:35.725953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e864a65a-5ac1-428b-b7fd-03df39164c21 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:35.726742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e864a65a-5ac1-428b-b7fd-03df39164c21 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:35.729842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e864a65a-5ac1-428b-b7fd-03df39164c21 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:35.731078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e864a65a-5ac1-428b-b7fd-03df39164c21 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:35.732133 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e864a65a-5ac1-428b-b7fd-03df39164c21 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:35.910074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e864a65a-5ac1-428b-b7fd-03df39164c21 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:35.932065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e864a65a-5ac1-428b-b7fd-03df39164c21 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:35.934408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e864a65a-5ac1-428b-b7fd-03df39164c21 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:35.936247 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e864a65a-5ac1-428b-b7fd-03df39164c21 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] 10.222.0.16 "GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12" status: 200 len: 1365 microversion: 2.57 time: 0.261060 Sep 07 12:48:35.937862 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1777/3596] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:35 2022] GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12 => generated 1365 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:35.943511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5b64095a-3bed-429e-a9db-1ff7b1bec86c tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4180ad670>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:36.072346 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-de081f06-4386-49e7-9def-9e096851d73a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:36.084904 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-de081f06-4386-49e7-9def-9e096851d73a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2" status: 200 len: 1520 microversion: 2.1 time: 0.398132 Sep 07 12:48:36.086164 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1820/3597] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:35 2022] GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2 => generated 1520 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:36.092779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-75fb21e9-7e12-4cc0-ac46-436eb21261f2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:36.094836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-75fb21e9-7e12-4cc0-ac46-436eb21261f2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:36.126003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75fb21e9-7e12-4cc0-ac46-436eb21261f2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:36.129303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75fb21e9-7e12-4cc0-ac46-436eb21261f2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:36.130182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75fb21e9-7e12-4cc0-ac46-436eb21261f2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:36.131407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75fb21e9-7e12-4cc0-ac46-436eb21261f2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:36.132355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75fb21e9-7e12-4cc0-ac46-436eb21261f2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:36.149115 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-75fb21e9-7e12-4cc0-ac46-436eb21261f2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:36.388551 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5b64095a-3bed-429e-a9db-1ff7b1bec86c tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images?server=676e42b4-4985-43cc-892b-176e13b341df" status: 200 len: 958 microversion: 2.1 time: 0.449272 Sep 07 12:48:36.389174 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1778/3598] 10.222.0.16 () {58 vars in 1209 bytes} [Wed Sep 7 12:48:35 2022] GET /compute/v2.1/images?server=676e42b4-4985-43cc-892b-176e13b341df => generated 958 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:48:36.421934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c4ed969e-a7d5-4312-b762-eeaf9a49f18a tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:36.422891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c4ed969e-a7d5-4312-b762-eeaf9a49f18a tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] [instance: bf13a2d3-c288-435f-a0ae-b47b19839312] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:36.452216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4ed969e-a7d5-4312-b762-eeaf9a49f18a tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:36.461444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4ed969e-a7d5-4312-b762-eeaf9a49f18a tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:36.462139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4ed969e-a7d5-4312-b762-eeaf9a49f18a tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:36.462943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4ed969e-a7d5-4312-b762-eeaf9a49f18a tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:36.463438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4ed969e-a7d5-4312-b762-eeaf9a49f18a tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:36.463925 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4ed969e-a7d5-4312-b762-eeaf9a49f18a tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:37.053604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c4ed969e-a7d5-4312-b762-eeaf9a49f18a tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:37.120851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c4ed969e-a7d5-4312-b762-eeaf9a49f18a tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:37.124839 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c4ed969e-a7d5-4312-b762-eeaf9a49f18a tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:37.131431 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c4ed969e-a7d5-4312-b762-eeaf9a49f18a tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312" status: 200 len: 1362 microversion: 2.26 time: 0.719269 Sep 07 12:48:37.155477 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1779/3599] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:36 2022] GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312 => generated 1362 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:37.169197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-77fb6801-f3e8-4ec1-959a-7052781e2b18 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc413fccb80>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:37.231113 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-75fb21e9-7e12-4cc0-ac46-436eb21261f2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:37.257687 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-75fb21e9-7e12-4cc0-ac46-436eb21261f2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 200 len: 1521 microversion: 2.1 time: 1.169101 Sep 07 12:48:37.260449 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1821/3600] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:36 2022] GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 1521 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:37.279412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-10157873-5ba1-401c-bf2b-c9fe605dc363 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:37.281617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-10157873-5ba1-401c-bf2b-c9fe605dc363 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:37.296252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10157873-5ba1-401c-bf2b-c9fe605dc363 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:37.297450 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10157873-5ba1-401c-bf2b-c9fe605dc363 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:37.299139 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-77fb6801-f3e8-4ec1-959a-7052781e2b18 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F91762428-7354-4926-b463-edc357e1e7cf" status: 200 len: 484 microversion: 2.1 time: 0.141991 Sep 07 12:48:37.299374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10157873-5ba1-401c-bf2b-c9fe605dc363 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:37.310403 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1780/3601] 10.222.0.16 () {58 vars in 1317 bytes} [Wed Sep 7 12:48:37 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F91762428-7354-4926-b463-edc357e1e7cf => generated 484 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:48:37.310403 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3abc66db-0f3b-4f41-a8f6-790428ac6764 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:37.310403 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3abc66db-0f3b-4f41-a8f6-790428ac6764 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:37.313812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10157873-5ba1-401c-bf2b-c9fe605dc363 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:37.318467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3abc66db-0f3b-4f41-a8f6-790428ac6764 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:37.318794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3abc66db-0f3b-4f41-a8f6-790428ac6764 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:37.319348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3abc66db-0f3b-4f41-a8f6-790428ac6764 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:37.320171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3abc66db-0f3b-4f41-a8f6-790428ac6764 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:37.320547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10157873-5ba1-401c-bf2b-c9fe605dc363 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:37.320850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3abc66db-0f3b-4f41-a8f6-790428ac6764 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:37.321384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3abc66db-0f3b-4f41-a8f6-790428ac6764 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:37.322321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10157873-5ba1-401c-bf2b-c9fe605dc363 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:37.381402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:48:37.950711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3abc66db-0f3b-4f41-a8f6-790428ac6764 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:37.980188 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3abc66db-0f3b-4f41-a8f6-790428ac6764 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1682 microversion: 2.1 time: 0.678270 Sep 07 12:48:37.980455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-10157873-5ba1-401c-bf2b-c9fe605dc363 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:37.982960 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1781/3602] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:37 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1682 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:38.004670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e7475bca-89d9-4fda-8b0a-eaa58e921305 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:38.011304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-10157873-5ba1-401c-bf2b-c9fe605dc363 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:38.015237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-10157873-5ba1-401c-bf2b-c9fe605dc363 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:38.021343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e7475bca-89d9-4fda-8b0a-eaa58e921305 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] [instance: d4363e90-4eb0-487a-a798-7a6d0a613e12] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:38.025780 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-10157873-5ba1-401c-bf2b-c9fe605dc363 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1879 microversion: 2.42 time: 0.760487 Sep 07 12:48:38.027404 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1822/3603] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:37 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1879 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:38.035535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7475bca-89d9-4fda-8b0a-eaa58e921305 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:38.036718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7475bca-89d9-4fda-8b0a-eaa58e921305 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:38.037684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7475bca-89d9-4fda-8b0a-eaa58e921305 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:38.039056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7475bca-89d9-4fda-8b0a-eaa58e921305 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:38.039981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-3114b2ab-6120-4f7a-b780-3617a52bba89 req-7c321ccc-a552-4642-857d-2e307eaa7a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "676e42b4-4985-43cc-892b-176e13b341df", "name": "network-vif-unplugged", "status": "completed", "tag": "8973b130-dd43-4a93-b14e-3d7f5131cd14"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:48:38.040444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7475bca-89d9-4fda-8b0a-eaa58e921305 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:38.041420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7475bca-89d9-4fda-8b0a-eaa58e921305 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:38.084194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3114b2ab-6120-4f7a-b780-3617a52bba89 req-7c321ccc-a552-4642-857d-2e307eaa7a2b service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:38.094635 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3114b2ab-6120-4f7a-b780-3617a52bba89 req-7c321ccc-a552-4642-857d-2e307eaa7a2b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:38.095376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3114b2ab-6120-4f7a-b780-3617a52bba89 req-7c321ccc-a552-4642-857d-2e307eaa7a2b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:38.172906 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-3114b2ab-6120-4f7a-b780-3617a52bba89 req-7c321ccc-a552-4642-857d-2e307eaa7a2b service nova] Creating event network-vif-unplugged:8973b130-dd43-4a93-b14e-3d7f5131cd14 for instance 676e42b4-4985-43cc-892b-176e13b341df on n-h2-852087-9 Sep 07 12:48:38.200076 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-3114b2ab-6120-4f7a-b780-3617a52bba89 req-7c321ccc-a552-4642-857d-2e307eaa7a2b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.171102 Sep 07 12:48:38.201275 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1823/3604] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:48:38.218857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e7475bca-89d9-4fda-8b0a-eaa58e921305 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:38.239838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b6caac49-97c8-4631-9a4c-18d7353246c7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:38.255391 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b6caac49-97c8-4631-9a4c-18d7353246c7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:38.259849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e7475bca-89d9-4fda-8b0a-eaa58e921305 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:38.269151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e7475bca-89d9-4fda-8b0a-eaa58e921305 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:38.276729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6caac49-97c8-4631-9a4c-18d7353246c7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:38.281949 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e7475bca-89d9-4fda-8b0a-eaa58e921305 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] 10.222.0.16 "GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12" status: 200 len: 1365 microversion: 2.57 time: 0.296520 Sep 07 12:48:38.283695 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1782/3605] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:37 2022] GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12 => generated 1365 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:38.288280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6caac49-97c8-4631-9a4c-18d7353246c7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:38.304553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6caac49-97c8-4631-9a4c-18d7353246c7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:38.306446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6caac49-97c8-4631-9a4c-18d7353246c7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:38.309897 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-80edc069-3448-41e2-a757-6b43a5254eef tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4180bef70>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:38.310555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6caac49-97c8-4631-9a4c-18d7353246c7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:38.311984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6caac49-97c8-4631-9a4c-18d7353246c7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:38.410640 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-80edc069-3448-41e2-a757-6b43a5254eef tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F91762428-7354-4926-b463-edc357e1e7cf" status: 200 len: 484 microversion: 2.1 time: 0.123852 Sep 07 12:48:38.412516 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1783/3606] 10.222.0.16 () {58 vars in 1303 bytes} [Wed Sep 7 12:48:38 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F91762428-7354-4926-b463-edc357e1e7cf => generated 484 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:48:38.435343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-086160f5-c9aa-47cc-a8f5-74408d469dd1 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:38.436528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-086160f5-c9aa-47cc-a8f5-74408d469dd1 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] [instance: bf13a2d3-c288-435f-a0ae-b47b19839312] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:38.463624 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-086160f5-c9aa-47cc-a8f5-74408d469dd1 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:38.464570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-086160f5-c9aa-47cc-a8f5-74408d469dd1 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:38.465444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-086160f5-c9aa-47cc-a8f5-74408d469dd1 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:38.467000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-086160f5-c9aa-47cc-a8f5-74408d469dd1 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:38.468016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-086160f5-c9aa-47cc-a8f5-74408d469dd1 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:38.469158 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-086160f5-c9aa-47cc-a8f5-74408d469dd1 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:39.720686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b6caac49-97c8-4631-9a4c-18d7353246c7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:39.781385 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b6caac49-97c8-4631-9a4c-18d7353246c7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2" status: 200 len: 1520 microversion: 2.1 time: 1.567486 Sep 07 12:48:39.782637 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1824/3607] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:38 2022] GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2 => generated 1520 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:39.808082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-086160f5-c9aa-47cc-a8f5-74408d469dd1 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:39.820152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ba9864f0-af8c-4288-9625-9a77f807a729 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:39.840206 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ba9864f0-af8c-4288-9625-9a77f807a729 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:39.864659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-086160f5-c9aa-47cc-a8f5-74408d469dd1 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:39.879552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-086160f5-c9aa-47cc-a8f5-74408d469dd1 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:39.880704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba9864f0-af8c-4288-9625-9a77f807a729 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:39.887248 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-086160f5-c9aa-47cc-a8f5-74408d469dd1 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312" status: 200 len: 1362 microversion: 2.26 time: 1.460439 Sep 07 12:48:39.890735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba9864f0-af8c-4288-9625-9a77f807a729 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:39.894769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba9864f0-af8c-4288-9625-9a77f807a729 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:39.900863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba9864f0-af8c-4288-9625-9a77f807a729 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:39.902282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba9864f0-af8c-4288-9625-9a77f807a729 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:39.904609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba9864f0-af8c-4288-9625-9a77f807a729 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:39.909143 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1784/3608] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:38 2022] GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312 => generated 1362 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:39.920556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2d6ce5eb-0f85-4bae-a65c-2bd587b2d461 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4180a7040>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:40.351864 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2d6ce5eb-0f85-4bae-a65c-2bd587b2d461 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.436701 Sep 07 12:48:40.353974 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1785/3609] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Sep 7 12:48:39 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:40.378190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c634c277-127b-45e0-a5f3-613a5db20dff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:40.381509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c634c277-127b-45e0-a5f3-613a5db20dff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:40.408577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c634c277-127b-45e0-a5f3-613a5db20dff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:40.411482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c634c277-127b-45e0-a5f3-613a5db20dff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:40.412673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c634c277-127b-45e0-a5f3-613a5db20dff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:40.420257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ba9864f0-af8c-4288-9625-9a77f807a729 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:40.428045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c634c277-127b-45e0-a5f3-613a5db20dff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:40.431567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c634c277-127b-45e0-a5f3-613a5db20dff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:40.435971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c634c277-127b-45e0-a5f3-613a5db20dff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:40.452474 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ba9864f0-af8c-4288-9625-9a77f807a729 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 200 len: 1506 microversion: 2.1 time: 0.667583 Sep 07 12:48:40.461565 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1825/3610] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:39 2022] GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 1506 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:40.475771 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-28927992-77e7-4381-9eb7-d200f8cdfb51 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:40.483008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-28927992-77e7-4381-9eb7-d200f8cdfb51 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:40.504283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28927992-77e7-4381-9eb7-d200f8cdfb51 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:40.508774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28927992-77e7-4381-9eb7-d200f8cdfb51 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:40.509702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28927992-77e7-4381-9eb7-d200f8cdfb51 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:40.514304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28927992-77e7-4381-9eb7-d200f8cdfb51 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:40.515798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28927992-77e7-4381-9eb7-d200f8cdfb51 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:40.519276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28927992-77e7-4381-9eb7-d200f8cdfb51 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:41.447864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c634c277-127b-45e0-a5f3-613a5db20dff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:41.497476 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c634c277-127b-45e0-a5f3-613a5db20dff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1682 microversion: 2.1 time: 1.134277 Sep 07 12:48:41.527084 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1786/3611] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:40 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1682 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:41.555404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-28927992-77e7-4381-9eb7-d200f8cdfb51 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:41.572247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7be4b29a-0eb2-4f2a-954c-f149cd52795b tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:41.573800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7be4b29a-0eb2-4f2a-954c-f149cd52795b tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] [instance: d4363e90-4eb0-487a-a798-7a6d0a613e12] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:41.602011 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-28927992-77e7-4381-9eb7-d200f8cdfb51 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:41.610184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7be4b29a-0eb2-4f2a-954c-f149cd52795b tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:41.611533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7be4b29a-0eb2-4f2a-954c-f149cd52795b tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:41.615523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7be4b29a-0eb2-4f2a-954c-f149cd52795b tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:41.616746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-28927992-77e7-4381-9eb7-d200f8cdfb51 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:41.621408 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-28927992-77e7-4381-9eb7-d200f8cdfb51 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1879 microversion: 2.42 time: 1.157239 Sep 07 12:48:41.623530 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7be4b29a-0eb2-4f2a-954c-f149cd52795b tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:41.624764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7be4b29a-0eb2-4f2a-954c-f149cd52795b tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:41.629363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7be4b29a-0eb2-4f2a-954c-f149cd52795b tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:41.630810 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1826/3612] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:40 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1879 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:41.661965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-175cb38b-704c-4277-a133-982dfacb8921 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4181c50d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:41.755318 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7be4b29a-0eb2-4f2a-954c-f149cd52795b tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:41.765769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7be4b29a-0eb2-4f2a-954c-f149cd52795b tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:41.767582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7be4b29a-0eb2-4f2a-954c-f149cd52795b tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:41.769079 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7be4b29a-0eb2-4f2a-954c-f149cd52795b tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] 10.222.0.16 "GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12" status: 200 len: 1365 microversion: 2.57 time: 0.235868 Sep 07 12:48:41.769808 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1787/3613] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:41 2022] GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12 => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:41.775115 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32879879-8ab5-4b5b-884d-dd0d9a5f3b88 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:41.783174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-32879879-8ab5-4b5b-884d-dd0d9a5f3b88 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:41.798624 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32879879-8ab5-4b5b-884d-dd0d9a5f3b88 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:41.799449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32879879-8ab5-4b5b-884d-dd0d9a5f3b88 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:41.800104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32879879-8ab5-4b5b-884d-dd0d9a5f3b88 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:41.801047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32879879-8ab5-4b5b-884d-dd0d9a5f3b88 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:41.801765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32879879-8ab5-4b5b-884d-dd0d9a5f3b88 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:41.802416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32879879-8ab5-4b5b-884d-dd0d9a5f3b88 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:41.919643 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-175cb38b-704c-4277-a133-982dfacb8921 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.283868 Sep 07 12:48:41.923911 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1827/3614] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Sep 7 12:48:41 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:41.943237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a1ab95c3-706c-45e2-8d06-317bd6e0be3b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:41.943882 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a1ab95c3-706c-45e2-8d06-317bd6e0be3b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:41.980803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1ab95c3-706c-45e2-8d06-317bd6e0be3b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:41.981472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1ab95c3-706c-45e2-8d06-317bd6e0be3b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:41.981991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1ab95c3-706c-45e2-8d06-317bd6e0be3b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:41.982802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1ab95c3-706c-45e2-8d06-317bd6e0be3b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:41.983336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1ab95c3-706c-45e2-8d06-317bd6e0be3b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:41.993682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1ab95c3-706c-45e2-8d06-317bd6e0be3b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:42.347625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-32879879-8ab5-4b5b-884d-dd0d9a5f3b88 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:42.392407 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-32879879-8ab5-4b5b-884d-dd0d9a5f3b88 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 200 len: 1506 microversion: 2.1 time: 0.620908 Sep 07 12:48:42.397989 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1788/3615] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:41 2022] GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 1506 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:42.415727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8580aaa2-acae-4efa-a0d9-12f71ce95bdb tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:42.427006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8580aaa2-acae-4efa-a0d9-12f71ce95bdb tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] [instance: bf13a2d3-c288-435f-a0ae-b47b19839312] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:42.446538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8580aaa2-acae-4efa-a0d9-12f71ce95bdb tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:42.450199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8580aaa2-acae-4efa-a0d9-12f71ce95bdb tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:42.452496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8580aaa2-acae-4efa-a0d9-12f71ce95bdb tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:42.454077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8580aaa2-acae-4efa-a0d9-12f71ce95bdb tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:42.455153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8580aaa2-acae-4efa-a0d9-12f71ce95bdb tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:42.456185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8580aaa2-acae-4efa-a0d9-12f71ce95bdb tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:42.703221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a1ab95c3-706c-45e2-8d06-317bd6e0be3b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:42.752943 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a1ab95c3-706c-45e2-8d06-317bd6e0be3b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2" status: 200 len: 1500 microversion: 2.1 time: 0.820093 Sep 07 12:48:42.772432 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1828/3616] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:41 2022] GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2 => generated 1500 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:42.816144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1125eba7-038d-408f-b7b2-fd88af5a7be2 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4181d0160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:42.937518 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8580aaa2-acae-4efa-a0d9-12f71ce95bdb tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:43.034934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8580aaa2-acae-4efa-a0d9-12f71ce95bdb tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:43.055497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8580aaa2-acae-4efa-a0d9-12f71ce95bdb tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:43.071411 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8580aaa2-acae-4efa-a0d9-12f71ce95bdb tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312" status: 200 len: 1362 microversion: 2.26 time: 0.667438 Sep 07 12:48:43.081082 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1789/3617] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:42 2022] GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312 => generated 1362 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:43.104558 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1125eba7-038d-408f-b7b2-fd88af5a7be2 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.313446 Sep 07 12:48:43.108719 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1829/3618] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:48:42 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:48:43.120464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-41ecd7bc-0db7-4960-9906-3203aaa2ebbe tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:43.121374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-41ecd7bc-0db7-4960-9906-3203aaa2ebbe tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:43.146789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7baa2038-4974-4458-ae54-6701517fe36b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:43.146789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7baa2038-4974-4458-ae54-6701517fe36b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:43.162003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41ecd7bc-0db7-4960-9906-3203aaa2ebbe tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:43.162338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7baa2038-4974-4458-ae54-6701517fe36b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:43.162557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41ecd7bc-0db7-4960-9906-3203aaa2ebbe tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:43.162746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7baa2038-4974-4458-ae54-6701517fe36b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:43.163440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41ecd7bc-0db7-4960-9906-3203aaa2ebbe tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:43.166475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41ecd7bc-0db7-4960-9906-3203aaa2ebbe tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:43.169660 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7baa2038-4974-4458-ae54-6701517fe36b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:43.170785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7baa2038-4974-4458-ae54-6701517fe36b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:43.171554 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7baa2038-4974-4458-ae54-6701517fe36b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:43.172090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7baa2038-4974-4458-ae54-6701517fe36b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:43.173199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41ecd7bc-0db7-4960-9906-3203aaa2ebbe tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:43.182679 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41ecd7bc-0db7-4960-9906-3203aaa2ebbe tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:43.581599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7baa2038-4974-4458-ae54-6701517fe36b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:43.611315 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7baa2038-4974-4458-ae54-6701517fe36b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1682 microversion: 2.1 time: 0.494236 Sep 07 12:48:43.613220 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1830/3619] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:43 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1682 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:43.634544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c091ce92-6005-4082-a097-d4101b7c247d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:43.644076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c091ce92-6005-4082-a097-d4101b7c247d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:43.663676 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c091ce92-6005-4082-a097-d4101b7c247d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:43.673507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c091ce92-6005-4082-a097-d4101b7c247d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:43.674148 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c091ce92-6005-4082-a097-d4101b7c247d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:43.675018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c091ce92-6005-4082-a097-d4101b7c247d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:43.675559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c091ce92-6005-4082-a097-d4101b7c247d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:43.676095 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c091ce92-6005-4082-a097-d4101b7c247d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:43.845330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-41ecd7bc-0db7-4960-9906-3203aaa2ebbe tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:48:43.998125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:48:44.046719 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-41ecd7bc-0db7-4960-9906-3203aaa2ebbe tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 204 len: 0 microversion: 2.1 time: 0.962985 Sep 07 12:48:44.056297 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1790/3620] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:48:43 2022] DELETE /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 0 bytes in 975 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:48:44.062305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b513d418-aa7f-43f5-b39b-68eff72c5c3b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d120e67a-0e99-4adc-bba1-975568718ef8"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:48:44.074343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b513d418-aa7f-43f5-b39b-68eff72c5c3b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:44.142316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b513d418-aa7f-43f5-b39b-68eff72c5c3b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:44.159322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b513d418-aa7f-43f5-b39b-68eff72c5c3b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:44.160567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b513d418-aa7f-43f5-b39b-68eff72c5c3b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:44.161554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b513d418-aa7f-43f5-b39b-68eff72c5c3b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:44.161852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b513d418-aa7f-43f5-b39b-68eff72c5c3b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:44.172848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b513d418-aa7f-43f5-b39b-68eff72c5c3b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:44.297747 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-b513d418-aa7f-43f5-b39b-68eff72c5c3b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] HTTP exception thrown: Cannot 'attach_volume' instance 8425f313-f6b3-462f-92d7-8803be5ff8f2 while it is in vm_state rescued Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b513d418-aa7f-43f5-b39b-68eff72c5c3b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Request method failure captured: Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2/os-volume_attachments HTTP/1.1 Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 74 Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJKZVQHWlJ74Dx2W8ZEdML0xF-2AOg7c1kyx3sCL0Z6KLQM5ezA45HggvILiFiNDg07ylWr0Vwzz5BQco3_h-9AY0fLV1Rv4K5sggvhMC6zI5NaP-U7NrDZHMoSQThjt2D27IAAoa8B5_g5vq1oNty_s1bxD15UYFAJm0Q--CvZRoS0 Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 256a95a81360419dbaf33382dd369262 Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1632514538 Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/256a95a81360419dbaf33382dd369262"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_256a95a81360419dbaf33382dd369262"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/256a95a81360419dbaf33382dd369262"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/256a95a81360419dbaf33382dd369262"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1632514538 Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 256a95a81360419dbaf33382dd369262 Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1632514538 Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerRescueNegativeTestJSON-1632514538-project Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: a6d92e694e984ad8b126b94ed8effb3f Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1632514538-project Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: {"volumeAttachment": {"volumeId": "d120e67a-0e99-4adc-bba1-975568718ef8"}} Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: exception: Cannot 'attach_volume' instance 8425f313-f6b3-462f-92d7-8803be5ff8f2 while it is in vm_state rescued Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'server_id': '8425f313-f6b3-462f-92d7-8803be5ff8f2', 'body': {'volumeAttachment': {'volumeId': 'd120e67a-0e99-4adc-bba1-975568718ef8'}}} Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8425f313-f6b3-462f-92d7-8803be5ff8f2 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 07 12:48:44.309943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 12:48:44.319304 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 12:48:44.319304 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 12:48:44.319304 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8425f313-f6b3-462f-92d7-8803be5ff8f2 while it is in vm_state rescued Sep 07 12:48:44.319304 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:48:44.319304 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:48:44.319304 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:48:44.319304 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:48:44.319304 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:48:44.319304 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:48:44.319304 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:48:44.319304 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:48:44.319304 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8425f313-f6b3-462f-92d7-8803be5ff8f2 while it is in vm_state rescued Sep 07 12:48:44.319304 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:48:44.321610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c091ce92-6005-4082-a097-d4101b7c247d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:44.324092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b513d418-aa7f-43f5-b39b-68eff72c5c3b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Returning 409 to user: Cannot 'attach_volume' instance 8425f313-f6b3-462f-92d7-8803be5ff8f2 while it is in vm_state rescued {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:48:44.325981 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b513d418-aa7f-43f5-b39b-68eff72c5c3b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "POST /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.267933 Sep 07 12:48:44.328249 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1791/3621] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Sep 7 12:48:44 2022] POST /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2/os-volume_attachments => generated 152 bytes in 271 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:48:44.338179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df4fb22b-6894-448c-b890-d7381cf94d34 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:44.339619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-df4fb22b-6894-448c-b890-d7381cf94d34 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] [instance: d4363e90-4eb0-487a-a798-7a6d0a613e12] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:44.365899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df4fb22b-6894-448c-b890-d7381cf94d34 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:44.367059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df4fb22b-6894-448c-b890-d7381cf94d34 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:44.367991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df4fb22b-6894-448c-b890-d7381cf94d34 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:44.369779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df4fb22b-6894-448c-b890-d7381cf94d34 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:44.370690 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df4fb22b-6894-448c-b890-d7381cf94d34 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:44.371517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df4fb22b-6894-448c-b890-d7381cf94d34 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:44.373301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c091ce92-6005-4082-a097-d4101b7c247d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:44.379722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c091ce92-6005-4082-a097-d4101b7c247d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:44.382908 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c091ce92-6005-4082-a097-d4101b7c247d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1879 microversion: 2.42 time: 0.767771 Sep 07 12:48:44.393141 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1831/3622] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:43 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1879 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:44.393473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6b79aa69-f692-490b-8e9a-8b5c2cb01893 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc418260f70>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:44.416802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:48:44.571232 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6b79aa69-f692-490b-8e9a-8b5c2cb01893 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/detail?changes-since=2022-09-07T12%3A45%3A42Z" status: 200 len: 6334 microversion: 2.1 time: 0.184690 Sep 07 12:48:44.585628 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1832/3623] 10.222.0.16 () {58 vars in 1220 bytes} [Wed Sep 7 12:48:44 2022] GET /compute/v2.1/images/detail?changes-since=2022-09-07T12%3A45%3A42Z => generated 6334 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:44.585628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-61ed8ec8-6092-4a69-b018-57a08a94c4a2 req-23273438-bc1e-4fec-a9e3-d03b7c314451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf13a2d3-c288-435f-a0ae-b47b19839312", "name": "network-vif-plugged", "status": "completed", "tag": "ac0d74d3-f3f5-4d6a-a3da-030e64c6e998"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:48:44.604551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-61ed8ec8-6092-4a69-b018-57a08a94c4a2 req-23273438-bc1e-4fec-a9e3-d03b7c314451 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:44.605541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-61ed8ec8-6092-4a69-b018-57a08a94c4a2 req-23273438-bc1e-4fec-a9e3-d03b7c314451 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:44.606384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-61ed8ec8-6092-4a69-b018-57a08a94c4a2 req-23273438-bc1e-4fec-a9e3-d03b7c314451 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:44.609425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-df4fb22b-6894-448c-b890-d7381cf94d34 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:44.629986 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-61ed8ec8-6092-4a69-b018-57a08a94c4a2 req-23273438-bc1e-4fec-a9e3-d03b7c314451 service nova] Creating event network-vif-plugged:ac0d74d3-f3f5-4d6a-a3da-030e64c6e998 for instance bf13a2d3-c288-435f-a0ae-b47b19839312 on n-h1-852087-9 Sep 07 12:48:44.634842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-df4fb22b-6894-448c-b890-d7381cf94d34 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:44.640139 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-61ed8ec8-6092-4a69-b018-57a08a94c4a2 req-23273438-bc1e-4fec-a9e3-d03b7c314451 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065197 Sep 07 12:48:44.643849 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1833/3624] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:48:44.646593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-df4fb22b-6894-448c-b890-d7381cf94d34 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:44.655279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3658db58-02f4-4445-91e8-3a7183f526f9 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:44.656849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3658db58-02f4-4445-91e8-3a7183f526f9 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] [instance: bf13a2d3-c288-435f-a0ae-b47b19839312] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:44.663887 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-df4fb22b-6894-448c-b890-d7381cf94d34 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] 10.222.0.16 "GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12" status: 200 len: 1365 microversion: 2.57 time: 0.333743 Sep 07 12:48:44.664606 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1792/3625] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:44 2022] GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12 => generated 1365 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:44.670404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3658db58-02f4-4445-91e8-3a7183f526f9 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:44.671388 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3658db58-02f4-4445-91e8-3a7183f526f9 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:44.672534 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3658db58-02f4-4445-91e8-3a7183f526f9 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:44.673949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3658db58-02f4-4445-91e8-3a7183f526f9 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:44.675006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3658db58-02f4-4445-91e8-3a7183f526f9 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:44.675894 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3658db58-02f4-4445-91e8-3a7183f526f9 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:44.679264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cab95daf-ac56-4ba2-87bb-827ec02132a9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:48:44.680697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cab95daf-ac56-4ba2-87bb-827ec02132a9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:44.701950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cab95daf-ac56-4ba2-87bb-827ec02132a9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:44.701950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cab95daf-ac56-4ba2-87bb-827ec02132a9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:44.701950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cab95daf-ac56-4ba2-87bb-827ec02132a9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:44.710544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cab95daf-ac56-4ba2-87bb-827ec02132a9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:44.711285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cab95daf-ac56-4ba2-87bb-827ec02132a9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:44.712037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cab95daf-ac56-4ba2-87bb-827ec02132a9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:44.863421 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cab95daf-ac56-4ba2-87bb-827ec02132a9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "POST /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2/action" status: 202 len: 0 microversion: 2.1 time: 0.192882 Sep 07 12:48:44.868685 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1793/3626] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:48:44 2022] POST /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:48:44.879897 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-589dfc9c-43c7-4c0d-8bb4-a5452265243a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-659994378", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "b09d014c-3443-48ed-84da-449ea818c81d"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:48:44.974827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-589dfc9c-43c7-4c0d-8bb4-a5452265243a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] validate_networks() for [('b09d014c-3443-48ed-84da-449ea818c81d', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:48:45.023763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3658db58-02f4-4445-91e8-3a7183f526f9 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:45.034599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3658db58-02f4-4445-91e8-3a7183f526f9 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:45.037452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3658db58-02f4-4445-91e8-3a7183f526f9 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:45.039153 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3658db58-02f4-4445-91e8-3a7183f526f9 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312" status: 200 len: 1362 microversion: 2.26 time: 0.393188 Sep 07 12:48:45.040803 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1834/3627] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:44 2022] GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312 => generated 1362 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:45.048636 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f77ae8c6-d113-40bb-9b94-c5806bd6b6bb tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc418260700>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:45.127680 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f77ae8c6-d113-40bb-9b94-c5806bd6b6bb tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1181557789" status: 200 len: 665 microversion: 2.1 time: 0.084940 Sep 07 12:48:45.129339 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1835/3628] 10.222.0.16 () {58 vars in 1252 bytes} [Wed Sep 7 12:48:45 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1181557789 => generated 665 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:48:45.139075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-78c99151-693b-48e9-9d47-26a957c522d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:45.140901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-78c99151-693b-48e9-9d47-26a957c522d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:45.153075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78c99151-693b-48e9-9d47-26a957c522d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:45.154493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78c99151-693b-48e9-9d47-26a957c522d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:45.155777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78c99151-693b-48e9-9d47-26a957c522d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:45.157295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78c99151-693b-48e9-9d47-26a957c522d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:45.158583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78c99151-693b-48e9-9d47-26a957c522d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:45.159378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78c99151-693b-48e9-9d47-26a957c522d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:45.493709 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-78c99151-693b-48e9-9d47-26a957c522d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:45.510208 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-78c99151-693b-48e9-9d47-26a957c522d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1682 microversion: 2.1 time: 0.377751 Sep 07 12:48:45.512139 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1836/3629] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:45 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1682 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:45.521235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b0d473f3-c00c-44ef-b520-065b286db430 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:45.522602 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b0d473f3-c00c-44ef-b520-065b286db430 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:45.538221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0d473f3-c00c-44ef-b520-065b286db430 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:45.539184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0d473f3-c00c-44ef-b520-065b286db430 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:45.540036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0d473f3-c00c-44ef-b520-065b286db430 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:45.541738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0d473f3-c00c-44ef-b520-065b286db430 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:45.543862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0d473f3-c00c-44ef-b520-065b286db430 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:45.546091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0d473f3-c00c-44ef-b520-065b286db430 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:45.691045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-589dfc9c-43c7-4c0d-8bb4-a5452265243a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:48:45.691789 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-589dfc9c-43c7-4c0d-8bb4-a5452265243a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:48:45.692642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-589dfc9c-43c7-4c0d-8bb4-a5452265243a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:48:45.693434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-589dfc9c-43c7-4c0d-8bb4-a5452265243a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:48:45.694221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-589dfc9c-43c7-4c0d-8bb4-a5452265243a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:48:45.713668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-589dfc9c-43c7-4c0d-8bb4-a5452265243a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:45.714179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-589dfc9c-43c7-4c0d-8bb4-a5452265243a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:45.714657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-589dfc9c-43c7-4c0d-8bb4-a5452265243a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:45.715666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-589dfc9c-43c7-4c0d-8bb4-a5452265243a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:45.716142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-589dfc9c-43c7-4c0d-8bb4-a5452265243a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:45.716576 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-589dfc9c-43c7-4c0d-8bb4-a5452265243a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:45.737030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-589dfc9c-43c7-4c0d-8bb4-a5452265243a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Getting quotas for project f535596776604720870c42b1a788cb3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:48:45.743991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-589dfc9c-43c7-4c0d-8bb4-a5452265243a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Getting quotas for user f76fe928bf384b88b8a3ba5e4b9c6232 and project f535596776604720870c42b1a788cb3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:48:45.758704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-589dfc9c-43c7-4c0d-8bb4-a5452265243a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:48:45.761323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-589dfc9c-43c7-4c0d-8bb4-a5452265243a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:48:45.792651 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b0d473f3-c00c-44ef-b520-065b286db430 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:45.804340 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b0d473f3-c00c-44ef-b520-065b286db430 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2" status: 200 len: 1508 microversion: 2.1 time: 0.290002 Sep 07 12:48:45.805123 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1837/3630] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:45 2022] GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2 => generated 1508 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:45.822008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6b80b87e-3957-4ee2-b8f9-059585b7add2 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc41821b940>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:45.831192 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-589dfc9c-43c7-4c0d-8bb4-a5452265243a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.959044 Sep 07 12:48:45.835657 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1794/3631] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:48:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:48:45.847145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f4b30800-b7dc-4299-b565-9d416ce72f05 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:45.848737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f4b30800-b7dc-4299-b565-9d416ce72f05 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:45.860164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4b30800-b7dc-4299-b565-9d416ce72f05 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:45.864021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4b30800-b7dc-4299-b565-9d416ce72f05 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:45.864021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4b30800-b7dc-4299-b565-9d416ce72f05 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:45.865355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4b30800-b7dc-4299-b565-9d416ce72f05 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:45.866518 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4b30800-b7dc-4299-b565-9d416ce72f05 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:45.867243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4b30800-b7dc-4299-b565-9d416ce72f05 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:45.944354 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6b80b87e-3957-4ee2-b8f9-059585b7add2 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F91762428-7354-4926-b463-edc357e1e7cf" status: 200 len: 1466 microversion: 2.1 time: 0.137511 Sep 07 12:48:45.946379 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1838/3632] 10.222.0.16 () {58 vars in 1338 bytes} [Wed Sep 7 12:48:45 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F91762428-7354-4926-b463-edc357e1e7cf => generated 1466 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:45.956968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aa8ae08f-2f70-4638-8784-01fb1f05e750 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:45.959667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aa8ae08f-2f70-4638-8784-01fb1f05e750 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] [instance: d4363e90-4eb0-487a-a798-7a6d0a613e12] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:45.974286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa8ae08f-2f70-4638-8784-01fb1f05e750 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:45.974822 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa8ae08f-2f70-4638-8784-01fb1f05e750 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:45.975270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa8ae08f-2f70-4638-8784-01fb1f05e750 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:45.976084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa8ae08f-2f70-4638-8784-01fb1f05e750 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:45.976560 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa8ae08f-2f70-4638-8784-01fb1f05e750 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:45.976997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa8ae08f-2f70-4638-8784-01fb1f05e750 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:46.131571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aa8ae08f-2f70-4638-8784-01fb1f05e750 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:46.143946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aa8ae08f-2f70-4638-8784-01fb1f05e750 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:46.146036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aa8ae08f-2f70-4638-8784-01fb1f05e750 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:46.147677 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aa8ae08f-2f70-4638-8784-01fb1f05e750 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] 10.222.0.16 "GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12" status: 200 len: 1365 microversion: 2.57 time: 0.199251 Sep 07 12:48:46.148670 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1839/3633] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:45 2022] GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12 => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:46.170321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a6311316-d71e-4b2c-be1f-df8e30dec32b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:46.170944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a6311316-d71e-4b2c-be1f-df8e30dec32b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:46.262912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a6311316-d71e-4b2c-be1f-df8e30dec32b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:46.271843 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a6311316-d71e-4b2c-be1f-df8e30dec32b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02" status: 200 len: 1217 microversion: 2.1 time: 0.112535 Sep 07 12:48:46.273367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f4b30800-b7dc-4299-b565-9d416ce72f05 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:46.289692 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1840/3634] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:46 2022] GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02 => generated 1217 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:46.294209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f4b30800-b7dc-4299-b565-9d416ce72f05 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:46.295365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-19bafe1f-626f-4f70-847e-7b17e16700f5 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4182040d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:46.297936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f4b30800-b7dc-4299-b565-9d416ce72f05 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:46.300618 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f4b30800-b7dc-4299-b565-9d416ce72f05 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1879 microversion: 2.42 time: 0.462434 Sep 07 12:48:46.302397 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1795/3635] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:45 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1879 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:46.311622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a8ca1ac3-69da-46ed-a43c-9329428be7d6 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:46.314142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a8ca1ac3-69da-46ed-a43c-9329428be7d6 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] [instance: bf13a2d3-c288-435f-a0ae-b47b19839312] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:46.332000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8ca1ac3-69da-46ed-a43c-9329428be7d6 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:46.333754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8ca1ac3-69da-46ed-a43c-9329428be7d6 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:46.335473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8ca1ac3-69da-46ed-a43c-9329428be7d6 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:46.337703 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8ca1ac3-69da-46ed-a43c-9329428be7d6 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:46.339926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8ca1ac3-69da-46ed-a43c-9329428be7d6 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:46.340972 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a8ca1ac3-69da-46ed-a43c-9329428be7d6 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:46.434070 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-19bafe1f-626f-4f70-847e-7b17e16700f5 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F91762428-7354-4926-b463-edc357e1e7cf" status: 200 len: 1466 microversion: 2.1 time: 0.142282 Sep 07 12:48:46.435964 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1841/3636] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Sep 7 12:48:46 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F91762428-7354-4926-b463-edc357e1e7cf => generated 1466 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:46.466917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f1f8e03f-8194-49d1-9afd-4c99290f5939 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4182694c0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:46.807354 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f1f8e03f-8194-49d1-9afd-4c99290f5939 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7109 microversion: 2.1 time: 0.353348 Sep 07 12:48:46.810075 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1842/3637] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Sep 7 12:48:46 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7109 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:46.847977 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-38c2e7c8-997f-4ce8-a3a0-b8e9f97d89b7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:46.848671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-38c2e7c8-997f-4ce8-a3a0-b8e9f97d89b7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:46.866126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38c2e7c8-997f-4ce8-a3a0-b8e9f97d89b7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:46.866668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38c2e7c8-997f-4ce8-a3a0-b8e9f97d89b7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:46.867082 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38c2e7c8-997f-4ce8-a3a0-b8e9f97d89b7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:46.867846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38c2e7c8-997f-4ce8-a3a0-b8e9f97d89b7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:46.868298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38c2e7c8-997f-4ce8-a3a0-b8e9f97d89b7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:46.868731 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38c2e7c8-997f-4ce8-a3a0-b8e9f97d89b7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:47.308161 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-38c2e7c8-997f-4ce8-a3a0-b8e9f97d89b7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:47.336555 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a8ca1ac3-69da-46ed-a43c-9329428be7d6 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:47.350465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a8ca1ac3-69da-46ed-a43c-9329428be7d6 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:47.353015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a8ca1ac3-69da-46ed-a43c-9329428be7d6 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:47.354533 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a8ca1ac3-69da-46ed-a43c-9329428be7d6 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312" status: 200 len: 1362 microversion: 2.26 time: 1.050474 Sep 07 12:48:47.355755 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1796/3638] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:46 2022] GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312 => generated 1362 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:47.356975 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-38c2e7c8-997f-4ce8-a3a0-b8e9f97d89b7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.522609 Sep 07 12:48:47.363791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-37467ec1-6431-41f8-9f49-9ea52726cd78 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4181d7e50>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:47.365041 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1843/3639] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:46 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:47.391312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ed075b18-57db-48c2-ba85-6b061a6ebbeb tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:47.405248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ed075b18-57db-48c2-ba85-6b061a6ebbeb tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:47.442064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed075b18-57db-48c2-ba85-6b061a6ebbeb tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:47.443080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed075b18-57db-48c2-ba85-6b061a6ebbeb tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:47.443876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed075b18-57db-48c2-ba85-6b061a6ebbeb tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:47.477980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed075b18-57db-48c2-ba85-6b061a6ebbeb tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:47.485433 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed075b18-57db-48c2-ba85-6b061a6ebbeb tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:47.489465 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed075b18-57db-48c2-ba85-6b061a6ebbeb tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:47.780350 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-37467ec1-6431-41f8-9f49-9ea52726cd78 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.417470 Sep 07 12:48:47.794080 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1797/3640] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Sep 7 12:48:47 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:47.812158 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b2eb8eb9-b204-4044-a208-2353424f5072 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:47.814171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b2eb8eb9-b204-4044-a208-2353424f5072 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] [instance: d4363e90-4eb0-487a-a798-7a6d0a613e12] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:47.838385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2eb8eb9-b204-4044-a208-2353424f5072 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:47.840870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2eb8eb9-b204-4044-a208-2353424f5072 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:47.841808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2eb8eb9-b204-4044-a208-2353424f5072 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:47.843853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2eb8eb9-b204-4044-a208-2353424f5072 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:47.845135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2eb8eb9-b204-4044-a208-2353424f5072 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:47.846329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2eb8eb9-b204-4044-a208-2353424f5072 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:48.008247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ed075b18-57db-48c2-ba85-6b061a6ebbeb tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:48.075583 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ed075b18-57db-48c2-ba85-6b061a6ebbeb tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2" status: 200 len: 1508 microversion: 2.1 time: 0.708535 Sep 07 12:48:48.088917 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1844/3641] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:47 2022] GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2 => generated 1508 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:48.113283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b1c803c6-b008-434f-8e5c-a15c89b28fbd tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:48.115007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b1c803c6-b008-434f-8e5c-a15c89b28fbd tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:48.137368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b2eb8eb9-b204-4044-a208-2353424f5072 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:48.144396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1c803c6-b008-434f-8e5c-a15c89b28fbd tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:48.147801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b2eb8eb9-b204-4044-a208-2353424f5072 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:48.148778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1c803c6-b008-434f-8e5c-a15c89b28fbd tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:48.149431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1c803c6-b008-434f-8e5c-a15c89b28fbd tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:48.150420 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1c803c6-b008-434f-8e5c-a15c89b28fbd tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:48.152481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b2eb8eb9-b204-4044-a208-2353424f5072 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:48.153316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1c803c6-b008-434f-8e5c-a15c89b28fbd tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:48.154072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1c803c6-b008-434f-8e5c-a15c89b28fbd tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:48.165201 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b2eb8eb9-b204-4044-a208-2353424f5072 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] 10.222.0.16 "GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12" status: 200 len: 1365 microversion: 2.57 time: 0.372651 Sep 07 12:48:48.166497 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1798/3642] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:47 2022] GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12 => generated 1365 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:48.182182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c77d7e06-3aeb-4168-9d4f-7bf6f9b1422f tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:48.182524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c77d7e06-3aeb-4168-9d4f-7bf6f9b1422f tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:48.200814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c77d7e06-3aeb-4168-9d4f-7bf6f9b1422f tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:48.201605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c77d7e06-3aeb-4168-9d4f-7bf6f9b1422f tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:48.202075 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c77d7e06-3aeb-4168-9d4f-7bf6f9b1422f tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:48.202812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c77d7e06-3aeb-4168-9d4f-7bf6f9b1422f tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:48.203534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c77d7e06-3aeb-4168-9d4f-7bf6f9b1422f tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:48.219422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c77d7e06-3aeb-4168-9d4f-7bf6f9b1422f tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:48.384814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b1c803c6-b008-434f-8e5c-a15c89b28fbd tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:48.402631 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b1c803c6-b008-434f-8e5c-a15c89b28fbd tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02" status: 200 len: 1269 microversion: 2.1 time: 0.311621 Sep 07 12:48:48.440117 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1845/3643] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:48 2022] GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02 => generated 1269 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:48.462379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d2211f25-e0b9-41df-8e52-927127e478d4 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4181d0160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:48.596289 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d2211f25-e0b9-41df-8e52-927127e478d4 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/a5dd2b4d-ee9d-44eb-b267-89e80edd276f" status: 200 len: 784 microversion: 2.1 time: 0.153708 Sep 07 12:48:48.597619 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1846/3644] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 12:48:48 2022] GET /compute/v2.1/images/a5dd2b4d-ee9d-44eb-b267-89e80edd276f => generated 784 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:48:48.607664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-48e32ac2-ea03-4366-ae7f-725dde48caed req-1da6a15d-9010-42bb-ba02-30e2ce8ac851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5203be99-6bdd-42c2-955d-90ce3a228ed3", "name": "network-vif-deleted", "tag": "7d26615d-741b-4cfa-a0ce-5b16555ea640"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:48:48.648311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-48e32ac2-ea03-4366-ae7f-725dde48caed req-1da6a15d-9010-42bb-ba02-30e2ce8ac851 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:48.654512 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-48e32ac2-ea03-4366-ae7f-725dde48caed req-1da6a15d-9010-42bb-ba02-30e2ce8ac851 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:48.655620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-48e32ac2-ea03-4366-ae7f-725dde48caed req-1da6a15d-9010-42bb-ba02-30e2ce8ac851 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:48.680458 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-48e32ac2-ea03-4366-ae7f-725dde48caed req-1da6a15d-9010-42bb-ba02-30e2ce8ac851 service nova] Creating event network-vif-deleted:7d26615d-741b-4cfa-a0ce-5b16555ea640 for instance 5203be99-6bdd-42c2-955d-90ce3a228ed3 on n-h1-852087-9 Sep 07 12:48:48.694203 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-48e32ac2-ea03-4366-ae7f-725dde48caed req-1da6a15d-9010-42bb-ba02-30e2ce8ac851 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094818 Sep 07 12:48:48.696351 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1847/3645] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:48:48.713258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-070cca3c-642d-4eb2-a167-4baa7d74140d tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:48.714468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-070cca3c-642d-4eb2-a167-4baa7d74140d tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] [instance: bf13a2d3-c288-435f-a0ae-b47b19839312] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:48.732538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-070cca3c-642d-4eb2-a167-4baa7d74140d tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:48.733344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-070cca3c-642d-4eb2-a167-4baa7d74140d tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:48.734053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-070cca3c-642d-4eb2-a167-4baa7d74140d tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:48.735030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-070cca3c-642d-4eb2-a167-4baa7d74140d tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:48.735762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-070cca3c-642d-4eb2-a167-4baa7d74140d tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:48.736415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-070cca3c-642d-4eb2-a167-4baa7d74140d tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:49.257790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c77d7e06-3aeb-4168-9d4f-7bf6f9b1422f tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:49.279666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c77d7e06-3aeb-4168-9d4f-7bf6f9b1422f tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:49.292553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c77d7e06-3aeb-4168-9d4f-7bf6f9b1422f tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:49.294597 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c77d7e06-3aeb-4168-9d4f-7bf6f9b1422f tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1879 microversion: 2.42 time: 1.126812 Sep 07 12:48:49.295615 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1799/3646] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:48 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1879 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:49.302642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b882b1e0-6b2e-4a90-8b16-2db17b0bc0ee tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4181d7d30>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:49.372068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-070cca3c-642d-4eb2-a167-4baa7d74140d tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:49.396518 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-070cca3c-642d-4eb2-a167-4baa7d74140d tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:49.401289 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-070cca3c-642d-4eb2-a167-4baa7d74140d tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:49.407995 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-070cca3c-642d-4eb2-a167-4baa7d74140d tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312" status: 200 len: 1362 microversion: 2.26 time: 0.704890 Sep 07 12:48:49.409066 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1848/3647] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:48 2022] GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312 => generated 1362 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:49.425279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c1e91eda-16b7-45c8-8010-ed95cd6aa09a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:49.429143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c1e91eda-16b7-45c8-8010-ed95cd6aa09a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:49.438796 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b882b1e0-6b2e-4a90-8b16-2db17b0bc0ee tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.139470 Sep 07 12:48:49.442160 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1800/3648] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Sep 7 12:48:49 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:49.460845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fc67ec20-85ca-4598-8309-e4c5e4ed8af7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:49.462109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fc67ec20-85ca-4598-8309-e4c5e4ed8af7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:49.470282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=77 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:48:49.477376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1e91eda-16b7-45c8-8010-ed95cd6aa09a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:49.478927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1e91eda-16b7-45c8-8010-ed95cd6aa09a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:49.480074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1e91eda-16b7-45c8-8010-ed95cd6aa09a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:49.481666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1e91eda-16b7-45c8-8010-ed95cd6aa09a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:49.482826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1e91eda-16b7-45c8-8010-ed95cd6aa09a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:49.483909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1e91eda-16b7-45c8-8010-ed95cd6aa09a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:49.492030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc67ec20-85ca-4598-8309-e4c5e4ed8af7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:49.493428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc67ec20-85ca-4598-8309-e4c5e4ed8af7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:49.495381 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc67ec20-85ca-4598-8309-e4c5e4ed8af7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:49.502758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc67ec20-85ca-4598-8309-e4c5e4ed8af7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:49.503796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc67ec20-85ca-4598-8309-e4c5e4ed8af7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:49.504813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc67ec20-85ca-4598-8309-e4c5e4ed8af7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:50.075133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c1e91eda-16b7-45c8-8010-ed95cd6aa09a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:50.119418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fc67ec20-85ca-4598-8309-e4c5e4ed8af7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:50.121324 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c1e91eda-16b7-45c8-8010-ed95cd6aa09a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.710104 Sep 07 12:48:50.142733 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fc67ec20-85ca-4598-8309-e4c5e4ed8af7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2" status: 200 len: 1508 microversion: 2.1 time: 0.698332 Sep 07 12:48:50.144482 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1801/3649] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:49 2022] GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2 => generated 1508 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:50.152741 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1849/3650] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:49 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:50.176163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d02ac14f-752b-43f1-9275-d3ae6d1055aa tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4181c5820>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:50.197337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-60ee6b36-6fe9-4b5b-8a6d-c4703bac59a2 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:50.201085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-60ee6b36-6fe9-4b5b-8a6d-c4703bac59a2 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] [instance: d4363e90-4eb0-487a-a798-7a6d0a613e12] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:50.252447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60ee6b36-6fe9-4b5b-8a6d-c4703bac59a2 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:50.257069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60ee6b36-6fe9-4b5b-8a6d-c4703bac59a2 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:50.259656 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60ee6b36-6fe9-4b5b-8a6d-c4703bac59a2 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:50.264372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60ee6b36-6fe9-4b5b-8a6d-c4703bac59a2 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:50.269207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60ee6b36-6fe9-4b5b-8a6d-c4703bac59a2 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:50.278106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60ee6b36-6fe9-4b5b-8a6d-c4703bac59a2 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:50.503456 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-60ee6b36-6fe9-4b5b-8a6d-c4703bac59a2 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:50.560431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-60ee6b36-6fe9-4b5b-8a6d-c4703bac59a2 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:50.576524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-60ee6b36-6fe9-4b5b-8a6d-c4703bac59a2 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:50.579214 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-60ee6b36-6fe9-4b5b-8a6d-c4703bac59a2 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] 10.222.0.16 "GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12" status: 200 len: 1371 microversion: 2.57 time: 0.432447 Sep 07 12:48:50.580274 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1802/3651] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:50 2022] GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12 => generated 1371 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:50.617177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f2004215-a7c0-483d-9741-550aa8558399 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:50.618381 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f2004215-a7c0-483d-9741-550aa8558399 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:50.647131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2004215-a7c0-483d-9741-550aa8558399 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:50.648199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2004215-a7c0-483d-9741-550aa8558399 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:50.649089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2004215-a7c0-483d-9741-550aa8558399 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:50.650573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2004215-a7c0-483d-9741-550aa8558399 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:50.651350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2004215-a7c0-483d-9741-550aa8558399 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:50.652119 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2004215-a7c0-483d-9741-550aa8558399 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:51.127376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f2004215-a7c0-483d-9741-550aa8558399 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:51.137077 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f2004215-a7c0-483d-9741-550aa8558399 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02" status: 200 len: 1317 microversion: 2.1 time: 0.555268 Sep 07 12:48:51.143587 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1803/3652] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:50 2022] GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02 => generated 1317 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:51.150661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-900e335a-e86b-403b-b328-0e6907215158 req-f5ff8ee6-02dd-4145-b993-492b905e4279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edf38c92-ffc2-492b-8642-88ca59537acd", "name": "network-vif-unplugged", "status": "completed", "tag": "23b18fbd-594f-42e0-a655-6b5f01607b28"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:48:51.179142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-900e335a-e86b-403b-b328-0e6907215158 req-f5ff8ee6-02dd-4145-b993-492b905e4279 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:51.182480 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-900e335a-e86b-403b-b328-0e6907215158 req-f5ff8ee6-02dd-4145-b993-492b905e4279 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:51.183233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-900e335a-e86b-403b-b328-0e6907215158 req-f5ff8ee6-02dd-4145-b993-492b905e4279 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:51.214584 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-900e335a-e86b-403b-b328-0e6907215158 req-f5ff8ee6-02dd-4145-b993-492b905e4279 service nova] Creating event network-vif-unplugged:23b18fbd-594f-42e0-a655-6b5f01607b28 for instance edf38c92-ffc2-492b-8642-88ca59537acd on n-h1-852087-9 Sep 07 12:48:51.231159 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-900e335a-e86b-403b-b328-0e6907215158 req-f5ff8ee6-02dd-4145-b993-492b905e4279 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079823 Sep 07 12:48:51.233418 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1804/3653] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:48:51.247674 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7b858a41-a21e-49dd-bb92-a9342ab24559 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:51.248560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7b858a41-a21e-49dd-bb92-a9342ab24559 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:51.263056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b858a41-a21e-49dd-bb92-a9342ab24559 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:51.268621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b858a41-a21e-49dd-bb92-a9342ab24559 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:51.269266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b858a41-a21e-49dd-bb92-a9342ab24559 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:51.270081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b858a41-a21e-49dd-bb92-a9342ab24559 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:51.270567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b858a41-a21e-49dd-bb92-a9342ab24559 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:51.271006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b858a41-a21e-49dd-bb92-a9342ab24559 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:51.352024 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d02ac14f-752b-43f1-9275-d3ae6d1055aa tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "DELETE /compute/v2.1/images/0212f9d4-0f64-48eb-bcfc-be06de84afdc" status: 204 len: 0 microversion: 2.1 time: 1.197283 Sep 07 12:48:51.353519 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1850/3654] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:50 2022] DELETE /compute/v2.1/images/0212f9d4-0f64-48eb-bcfc-be06de84afdc => generated 0 bytes in 1200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:48:51.363570 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c21dbfe-2ba8-4b47-ad53-a1f3a1bf0d31 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:51.368828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7c21dbfe-2ba8-4b47-ad53-a1f3a1bf0d31 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] [instance: bf13a2d3-c288-435f-a0ae-b47b19839312] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:51.416674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c21dbfe-2ba8-4b47-ad53-a1f3a1bf0d31 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:51.422086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c21dbfe-2ba8-4b47-ad53-a1f3a1bf0d31 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:51.423362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c21dbfe-2ba8-4b47-ad53-a1f3a1bf0d31 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:51.429403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c21dbfe-2ba8-4b47-ad53-a1f3a1bf0d31 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:51.430862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c21dbfe-2ba8-4b47-ad53-a1f3a1bf0d31 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:51.435490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c21dbfe-2ba8-4b47-ad53-a1f3a1bf0d31 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:51.515269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:48:51.930679 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7b858a41-a21e-49dd-bb92-a9342ab24559 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:51.983829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7b858a41-a21e-49dd-bb92-a9342ab24559 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:51.995992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7b858a41-a21e-49dd-bb92-a9342ab24559 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:52.003345 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7b858a41-a21e-49dd-bb92-a9342ab24559 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1879 microversion: 2.42 time: 0.767789 Sep 07 12:48:52.004756 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1805/3655] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:51 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1879 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:52.014698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d60c3508-eccb-4cd1-a4a9-0d777915136e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:52.016436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d60c3508-eccb-4cd1-a4a9-0d777915136e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:52.029405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d60c3508-eccb-4cd1-a4a9-0d777915136e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:52.030925 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d60c3508-eccb-4cd1-a4a9-0d777915136e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:52.032130 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d60c3508-eccb-4cd1-a4a9-0d777915136e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:52.033975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d60c3508-eccb-4cd1-a4a9-0d777915136e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:52.035242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d60c3508-eccb-4cd1-a4a9-0d777915136e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:52.036249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d60c3508-eccb-4cd1-a4a9-0d777915136e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:52.168998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7c21dbfe-2ba8-4b47-ad53-a1f3a1bf0d31 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:52.187118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7c21dbfe-2ba8-4b47-ad53-a1f3a1bf0d31 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:52.189139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7c21dbfe-2ba8-4b47-ad53-a1f3a1bf0d31 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:52.190858 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7c21dbfe-2ba8-4b47-ad53-a1f3a1bf0d31 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312" status: 200 len: 1547 microversion: 2.26 time: 0.834582 Sep 07 12:48:52.191553 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1851/3656] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:51 2022] GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312 => generated 1547 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:52.196923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fad28430-9844-49a0-9f19-1cd7b04bb1cc tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc418223040>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:52.429807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d60c3508-eccb-4cd1-a4a9-0d777915136e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:52.446053 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d60c3508-eccb-4cd1-a4a9-0d777915136e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2" status: 200 len: 1508 microversion: 2.1 time: 0.438985 Sep 07 12:48:52.447263 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1806/3657] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:52 2022] GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2 => generated 1508 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:52.458224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f33698d7-84b5-4c43-bb5d-603d4cfb37e0 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:52.459984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f33698d7-84b5-4c43-bb5d-603d4cfb37e0 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] [instance: d4363e90-4eb0-487a-a798-7a6d0a613e12] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:52.472857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f33698d7-84b5-4c43-bb5d-603d4cfb37e0 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:52.472857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f33698d7-84b5-4c43-bb5d-603d4cfb37e0 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:52.473628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f33698d7-84b5-4c43-bb5d-603d4cfb37e0 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:52.475171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f33698d7-84b5-4c43-bb5d-603d4cfb37e0 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:52.475941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f33698d7-84b5-4c43-bb5d-603d4cfb37e0 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:52.476805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f33698d7-84b5-4c43-bb5d-603d4cfb37e0 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:52.601313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f33698d7-84b5-4c43-bb5d-603d4cfb37e0 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:52.611903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f33698d7-84b5-4c43-bb5d-603d4cfb37e0 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:52.613440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f33698d7-84b5-4c43-bb5d-603d4cfb37e0 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:52.615285 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f33698d7-84b5-4c43-bb5d-603d4cfb37e0 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] 10.222.0.16 "GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12" status: 200 len: 1371 microversion: 2.57 time: 0.166193 Sep 07 12:48:52.616183 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1807/3658] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:52 2022] GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:52.630377 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-576003b9-94e4-44f9-a173-0fb9386d46ea tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:52.631584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-576003b9-94e4-44f9-a173-0fb9386d46ea tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:52.643735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-576003b9-94e4-44f9-a173-0fb9386d46ea tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:52.646713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-576003b9-94e4-44f9-a173-0fb9386d46ea tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:52.647418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-576003b9-94e4-44f9-a173-0fb9386d46ea tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:52.649083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-576003b9-94e4-44f9-a173-0fb9386d46ea tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:52.650262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-576003b9-94e4-44f9-a173-0fb9386d46ea tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:52.650834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-576003b9-94e4-44f9-a173-0fb9386d46ea tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:52.831503 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fad28430-9844-49a0-9f19-1cd7b04bb1cc tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "DELETE /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81" status: 204 len: 0 microversion: 2.1 time: 0.638388 Sep 07 12:48:52.833089 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1852/3659] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:52 2022] DELETE /compute/v2.1/images/cd8ba560-f079-4d36-adf4-203d7fd06d81 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:48:52.842627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a1a99ed7-1437-4dc5-9efa-e38dc9e26b04 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:52.843549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a1a99ed7-1437-4dc5-9efa-e38dc9e26b04 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:52.852164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1a99ed7-1437-4dc5-9efa-e38dc9e26b04 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:52.853129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1a99ed7-1437-4dc5-9efa-e38dc9e26b04 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:52.853742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1a99ed7-1437-4dc5-9efa-e38dc9e26b04 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:52.854937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1a99ed7-1437-4dc5-9efa-e38dc9e26b04 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:52.855521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1a99ed7-1437-4dc5-9efa-e38dc9e26b04 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:52.856392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1a99ed7-1437-4dc5-9efa-e38dc9e26b04 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:53.042206 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-576003b9-94e4-44f9-a173-0fb9386d46ea tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:53.055919 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-576003b9-94e4-44f9-a173-0fb9386d46ea tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02" status: 200 len: 1317 microversion: 2.1 time: 0.438166 Sep 07 12:48:53.057171 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1808/3660] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:52 2022] GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02 => generated 1317 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:53.067648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bc6a4ca0-5283-464e-bc09-134709aff997 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '.version_select at 0x7fc4181e7550>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:53.088592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc6a4ca0-5283-464e-bc09-134709aff997 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:53.089353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc6a4ca0-5283-464e-bc09-134709aff997 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:53.090044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc6a4ca0-5283-464e-bc09-134709aff997 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:53.090864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bc6a4ca0-5283-464e-bc09-134709aff997 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] [instance: bf13a2d3-c288-435f-a0ae-b47b19839312] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:53.100147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc6a4ca0-5283-464e-bc09-134709aff997 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:53.100916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc6a4ca0-5283-464e-bc09-134709aff997 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:53.101585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc6a4ca0-5283-464e-bc09-134709aff997 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:53.102538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc6a4ca0-5283-464e-bc09-134709aff997 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:53.103327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc6a4ca0-5283-464e-bc09-134709aff997 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:53.104129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc6a4ca0-5283-464e-bc09-134709aff997 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:53.139329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc6a4ca0-5283-464e-bc09-134709aff997 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:53.139978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc6a4ca0-5283-464e-bc09-134709aff997 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:53.140428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc6a4ca0-5283-464e-bc09-134709aff997 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:53.157447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc6a4ca0-5283-464e-bc09-134709aff997 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:53.158388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc6a4ca0-5283-464e-bc09-134709aff997 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:53.158833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc6a4ca0-5283-464e-bc09-134709aff997 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:53.180475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:48:53.193344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-bc6a4ca0-5283-464e-bc09-134709aff997 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lazy-loading 'flavor' on Instance uuid bf13a2d3-c288-435f-a0ae-b47b19839312 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:48:53.216102 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bc6a4ca0-5283-464e-bc09-134709aff997 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "PUT /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags/tempest-tag-1080212857" status: 201 len: 0 microversion: 2.26 time: 0.156752 Sep 07 12:48:53.217106 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1809/3661] 10.222.0.16 () {62 vars in 1380 bytes} [Wed Sep 7 12:48:53 2022] PUT /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags/tempest-tag-1080212857 => generated 0 bytes in 159 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 07 12:48:53.222348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-17637f33-5a7c-4bd5-a704-d687e9578463 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4181e70d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:53.277875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a1a99ed7-1437-4dc5-9efa-e38dc9e26b04 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:53.287941 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a1a99ed7-1437-4dc5-9efa-e38dc9e26b04 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.451641 Sep 07 12:48:53.290191 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1853/3662] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:52 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:53.317117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-2457fc8f-5604-417b-bb85-81f9516f9f34 req-9ccf295e-aeca-487c-8446-5a003885d0dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6ce007e-728c-4f62-858f-0da8782e1c02", "tag": "3128b5c0-fe38-43f4-9ae9-be319b69137f"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:48:53.333186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2457fc8f-5604-417b-bb85-81f9516f9f34 req-9ccf295e-aeca-487c-8446-5a003885d0dd service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:53.334629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2457fc8f-5604-417b-bb85-81f9516f9f34 req-9ccf295e-aeca-487c-8446-5a003885d0dd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:53.335077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2457fc8f-5604-417b-bb85-81f9516f9f34 req-9ccf295e-aeca-487c-8446-5a003885d0dd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:53.357219 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-2457fc8f-5604-417b-bb85-81f9516f9f34 req-9ccf295e-aeca-487c-8446-5a003885d0dd service nova] Creating event network-changed:3128b5c0-fe38-43f4-9ae9-be319b69137f for instance a6ce007e-728c-4f62-858f-0da8782e1c02 on n-h2-852087-9 Sep 07 12:48:53.365099 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-2457fc8f-5604-417b-bb85-81f9516f9f34 req-9ccf295e-aeca-487c-8446-5a003885d0dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053280 Sep 07 12:48:53.366636 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1854/3663] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:48:53.373812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-80e172e0-69ce-410f-a769-0d7fc642c3e2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:53.376455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-80e172e0-69ce-410f-a769-0d7fc642c3e2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:53.384787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80e172e0-69ce-410f-a769-0d7fc642c3e2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:53.387563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80e172e0-69ce-410f-a769-0d7fc642c3e2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:53.388378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80e172e0-69ce-410f-a769-0d7fc642c3e2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:53.389790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80e172e0-69ce-410f-a769-0d7fc642c3e2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:53.390843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80e172e0-69ce-410f-a769-0d7fc642c3e2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:53.392057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80e172e0-69ce-410f-a769-0d7fc642c3e2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:53.831436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-80e172e0-69ce-410f-a769-0d7fc642c3e2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:53.858190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-80e172e0-69ce-410f-a769-0d7fc642c3e2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:53.860496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-80e172e0-69ce-410f-a769-0d7fc642c3e2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:53.862534 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-80e172e0-69ce-410f-a769-0d7fc642c3e2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1879 microversion: 2.42 time: 0.494343 Sep 07 12:48:53.863563 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1855/3664] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:53 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1879 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:53.868900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-02d590cc-9c83-495e-b928-e8dd53e3954c tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '.version_select at 0x7fc4181c5550>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:53.877812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02d590cc-9c83-495e-b928-e8dd53e3954c tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:53.878649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02d590cc-9c83-495e-b928-e8dd53e3954c tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:53.879902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02d590cc-9c83-495e-b928-e8dd53e3954c tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:53.919747 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-02d590cc-9c83-495e-b928-e8dd53e3954c tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags/tempest-tag-1080212857" status: 204 len: 0 microversion: 2.26 time: 0.055037 Sep 07 12:48:53.924983 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1856/3665] 10.222.0.16 () {60 vars in 1361 bytes} [Wed Sep 7 12:48:53 2022] GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags/tempest-tag-1080212857 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:48:53.936894 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fc3237ae-7f78-4f39-95ea-5be900810370 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:53.937752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fc3237ae-7f78-4f39-95ea-5be900810370 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:53.944983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc3237ae-7f78-4f39-95ea-5be900810370 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:53.945514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc3237ae-7f78-4f39-95ea-5be900810370 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:53.945965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc3237ae-7f78-4f39-95ea-5be900810370 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:53.946699 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc3237ae-7f78-4f39-95ea-5be900810370 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:53.947169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc3237ae-7f78-4f39-95ea-5be900810370 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:53.947904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc3237ae-7f78-4f39-95ea-5be900810370 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:54.131705 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-17637f33-5a7c-4bd5-a704-d687e9578463 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "DELETE /compute/v2.1/images/958ebe61-1ee8-4b9d-81e2-ea97e10768ff" status: 204 len: 0 microversion: 2.1 time: 0.913217 Sep 07 12:48:54.132538 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1810/3666] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:53 2022] DELETE /compute/v2.1/images/958ebe61-1ee8-4b9d-81e2-ea97e10768ff => generated 0 bytes in 915 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:48:54.141735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7438842c-54a6-4fb7-8cc4-41e65a456a00 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:54.142783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7438842c-54a6-4fb7-8cc4-41e65a456a00 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:54.150009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7438842c-54a6-4fb7-8cc4-41e65a456a00 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:54.150993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7438842c-54a6-4fb7-8cc4-41e65a456a00 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:54.151678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7438842c-54a6-4fb7-8cc4-41e65a456a00 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:54.152673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7438842c-54a6-4fb7-8cc4-41e65a456a00 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:54.153372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7438842c-54a6-4fb7-8cc4-41e65a456a00 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:54.154099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7438842c-54a6-4fb7-8cc4-41e65a456a00 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:54.408201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fc3237ae-7f78-4f39-95ea-5be900810370 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:54.417681 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fc3237ae-7f78-4f39-95ea-5be900810370 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.490900 Sep 07 12:48:54.418280 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1857/3667] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:53 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:54.424096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-467e28bc-6280-40e0-abb4-f47dcfecf373 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:54.425001 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-467e28bc-6280-40e0-abb4-f47dcfecf373 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] [instance: d4363e90-4eb0-487a-a798-7a6d0a613e12] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:54.432627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-467e28bc-6280-40e0-abb4-f47dcfecf373 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:54.433409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-467e28bc-6280-40e0-abb4-f47dcfecf373 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:54.434179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-467e28bc-6280-40e0-abb4-f47dcfecf373 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:54.435296 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-467e28bc-6280-40e0-abb4-f47dcfecf373 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:54.435746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-467e28bc-6280-40e0-abb4-f47dcfecf373 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:54.436518 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-467e28bc-6280-40e0-abb4-f47dcfecf373 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:54.592442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-467e28bc-6280-40e0-abb4-f47dcfecf373 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:54.593347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7438842c-54a6-4fb7-8cc4-41e65a456a00 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:54.602569 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7438842c-54a6-4fb7-8cc4-41e65a456a00 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2" status: 200 len: 1514 microversion: 2.1 time: 0.468222 Sep 07 12:48:54.607903 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1811/3668] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:54 2022] GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2 => generated 1514 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:54.613525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-097c3444-e712-4541-a0be-361548c7f573 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '.version_select at 0x7fc41854ee50>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:54.623618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-467e28bc-6280-40e0-abb4-f47dcfecf373 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:54.626317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-467e28bc-6280-40e0-abb4-f47dcfecf373 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:54.628370 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-467e28bc-6280-40e0-abb4-f47dcfecf373 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] 10.222.0.16 "GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12" status: 200 len: 1371 microversion: 2.57 time: 0.208587 Sep 07 12:48:54.630044 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1858/3669] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:54 2022] GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12 => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:54.636533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b3257b40-1da3-4fa6-b7d9-2a0f66db1c0b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:54.637504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b3257b40-1da3-4fa6-b7d9-2a0f66db1c0b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:54.644568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-097c3444-e712-4541-a0be-361548c7f573 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:54.650809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3257b40-1da3-4fa6-b7d9-2a0f66db1c0b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:54.651643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3257b40-1da3-4fa6-b7d9-2a0f66db1c0b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:54.652289 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3257b40-1da3-4fa6-b7d9-2a0f66db1c0b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:54.653210 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3257b40-1da3-4fa6-b7d9-2a0f66db1c0b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:54.654929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3257b40-1da3-4fa6-b7d9-2a0f66db1c0b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:54.655553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3257b40-1da3-4fa6-b7d9-2a0f66db1c0b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:54.656582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-097c3444-e712-4541-a0be-361548c7f573 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:54.657178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-097c3444-e712-4541-a0be-361548c7f573 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:54.657813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-097c3444-e712-4541-a0be-361548c7f573 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] [instance: bf13a2d3-c288-435f-a0ae-b47b19839312] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:54.671117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-097c3444-e712-4541-a0be-361548c7f573 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:54.677043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-097c3444-e712-4541-a0be-361548c7f573 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:54.677758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-097c3444-e712-4541-a0be-361548c7f573 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:54.678600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-097c3444-e712-4541-a0be-361548c7f573 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:54.679151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-097c3444-e712-4541-a0be-361548c7f573 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:54.679656 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-097c3444-e712-4541-a0be-361548c7f573 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:54.731830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-097c3444-e712-4541-a0be-361548c7f573 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:54.733632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-097c3444-e712-4541-a0be-361548c7f573 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:54.734126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-097c3444-e712-4541-a0be-361548c7f573 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:54.756329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-097c3444-e712-4541-a0be-361548c7f573 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lazy-loading 'flavor' on Instance uuid bf13a2d3-c288-435f-a0ae-b47b19839312 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:48:54.785144 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-097c3444-e712-4541-a0be-361548c7f573 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags" status: 204 len: 0 microversion: 2.26 time: 0.175808 Sep 07 12:48:54.785838 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1812/3670] 10.222.0.16 () {60 vars in 1295 bytes} [Wed Sep 7 12:48:54 2022] DELETE /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:48:54.797257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b257dfbd-2105-4e5b-8ccb-b8c33591fe51 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:54.797829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b257dfbd-2105-4e5b-8ccb-b8c33591fe51 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 91762428-7354-4926-b463-edc357e1e7cf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:54.812435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b257dfbd-2105-4e5b-8ccb-b8c33591fe51 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:54.813019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b257dfbd-2105-4e5b-8ccb-b8c33591fe51 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:54.813468 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b257dfbd-2105-4e5b-8ccb-b8c33591fe51 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:54.814238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b257dfbd-2105-4e5b-8ccb-b8c33591fe51 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:54.814707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b257dfbd-2105-4e5b-8ccb-b8c33591fe51 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:54.815139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b257dfbd-2105-4e5b-8ccb-b8c33591fe51 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:54.857790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b257dfbd-2105-4e5b-8ccb-b8c33591fe51 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 91762428-7354-4926-b463-edc357e1e7cf] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:48:54.965076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b3257b40-1da3-4fa6-b7d9-2a0f66db1c0b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:55.001789 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b3257b40-1da3-4fa6-b7d9-2a0f66db1c0b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02" status: 200 len: 1317 microversion: 2.1 time: 0.368395 Sep 07 12:48:55.007597 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1859/3671] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:54 2022] GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02 => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:55.032714 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8aecdd7e-266e-4c99-8193-c0a78e75ac14 req-f9141b28-091e-41da-a62c-c1cf9304c9ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f90d70b2-052c-4840-8008-9d9b2b08772a", "name": "network-vif-plugged", "status": "completed", "tag": "3b263aff-c35a-41f4-8ce7-a3994b2d62ea"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:48:55.040967 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b257dfbd-2105-4e5b-8ccb-b8c33591fe51 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "DELETE /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf" status: 204 len: 0 microversion: 2.1 time: 0.247488 Sep 07 12:48:55.042334 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1813/3672] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:48:54 2022] DELETE /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:48:55.050229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8cbb6141-4e05-4d3b-85b0-5703d817f6df tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:55.051172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8cbb6141-4e05-4d3b-85b0-5703d817f6df tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:55.058519 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cbb6141-4e05-4d3b-85b0-5703d817f6df tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:55.059916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cbb6141-4e05-4d3b-85b0-5703d817f6df tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:55.060647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cbb6141-4e05-4d3b-85b0-5703d817f6df tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:55.061655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cbb6141-4e05-4d3b-85b0-5703d817f6df tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:55.062453 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cbb6141-4e05-4d3b-85b0-5703d817f6df tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:55.063096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cbb6141-4e05-4d3b-85b0-5703d817f6df tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:55.078879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8aecdd7e-266e-4c99-8193-c0a78e75ac14 req-f9141b28-091e-41da-a62c-c1cf9304c9ac service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:55.084089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8aecdd7e-266e-4c99-8193-c0a78e75ac14 req-f9141b28-091e-41da-a62c-c1cf9304c9ac service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:55.087624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8aecdd7e-266e-4c99-8193-c0a78e75ac14 req-f9141b28-091e-41da-a62c-c1cf9304c9ac service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:55.143431 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8aecdd7e-266e-4c99-8193-c0a78e75ac14 req-f9141b28-091e-41da-a62c-c1cf9304c9ac service nova] Creating event network-vif-plugged:3b263aff-c35a-41f4-8ce7-a3994b2d62ea for instance f90d70b2-052c-4840-8008-9d9b2b08772a on n-h2-852087-9 Sep 07 12:48:55.170250 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8aecdd7e-266e-4c99-8193-c0a78e75ac14 req-f9141b28-091e-41da-a62c-c1cf9304c9ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154004 Sep 07 12:48:55.176658 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1860/3673] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:48:55.194834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5edf24f2-8672-4b16-9d13-2a68c007ead3 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '.version_select at 0x7fc4182609d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:55.233428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5edf24f2-8672-4b16-9d13-2a68c007ead3 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:55.234772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5edf24f2-8672-4b16-9d13-2a68c007ead3 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:55.235823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5edf24f2-8672-4b16-9d13-2a68c007ead3 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:55.286431 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5edf24f2-8672-4b16-9d13-2a68c007ead3 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags" status: 200 len: 12 microversion: 2.26 time: 0.106832 Sep 07 12:48:55.288400 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1861/3674] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Sep 7 12:48:55 2022] GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags => generated 12 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:55.297727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-04af26a4-5497-45bf-ae2e-16c46d21cf51 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:55.300005 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-04af26a4-5497-45bf-ae2e-16c46d21cf51 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:55.322565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04af26a4-5497-45bf-ae2e-16c46d21cf51 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:55.324057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04af26a4-5497-45bf-ae2e-16c46d21cf51 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:55.325204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04af26a4-5497-45bf-ae2e-16c46d21cf51 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:55.327852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04af26a4-5497-45bf-ae2e-16c46d21cf51 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:55.329140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04af26a4-5497-45bf-ae2e-16c46d21cf51 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:55.330339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04af26a4-5497-45bf-ae2e-16c46d21cf51 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:55.724722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:48:55.753777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:48:56.148614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8cbb6141-4e05-4d3b-85b0-5703d817f6df tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:56.158396 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8cbb6141-4e05-4d3b-85b0-5703d817f6df tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 1.114460 Sep 07 12:48:56.162588 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1814/3675] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:55 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:56.189178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bc4a367d-7f2e-4151-ae22-dc880b55e0da tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:56.193393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bc4a367d-7f2e-4151-ae22-dc880b55e0da tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 91762428-7354-4926-b463-edc357e1e7cf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:56.221867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc4a367d-7f2e-4151-ae22-dc880b55e0da tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:56.222706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc4a367d-7f2e-4151-ae22-dc880b55e0da tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:56.223335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc4a367d-7f2e-4151-ae22-dc880b55e0da tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:56.224318 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc4a367d-7f2e-4151-ae22-dc880b55e0da tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:56.225127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc4a367d-7f2e-4151-ae22-dc880b55e0da tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:56.227405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc4a367d-7f2e-4151-ae22-dc880b55e0da tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:56.271562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:48:56.725452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-04af26a4-5497-45bf-ae2e-16c46d21cf51 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:56.757797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bc4a367d-7f2e-4151-ae22-dc880b55e0da tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796a821c4f184a6aac2859bb943f9bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a87170da674037af70fac57a366c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:56.766780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-04af26a4-5497-45bf-ae2e-16c46d21cf51 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:56.772678 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bc4a367d-7f2e-4151-ae22-dc880b55e0da tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf" status: 200 len: 1473 microversion: 2.1 time: 0.605283 Sep 07 12:48:56.773185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-04af26a4-5497-45bf-ae2e-16c46d21cf51 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:56.773966 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1815/3676] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:56 2022] GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf => generated 1473 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:56.775676 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-04af26a4-5497-45bf-ae2e-16c46d21cf51 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1879 microversion: 2.42 time: 1.486254 Sep 07 12:48:56.786113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-292dbf1d-cba7-4896-8ef1-94253b35e278 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '.version_select at 0x7fc41d195af0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:56.789678 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1862/3677] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:55 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1879 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:56.801255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4c96e2ac-d377-473c-a1c1-b038d6cbff88 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:56.807206 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4c96e2ac-d377-473c-a1c1-b038d6cbff88 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] [instance: d4363e90-4eb0-487a-a798-7a6d0a613e12] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:56.808775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-292dbf1d-cba7-4896-8ef1-94253b35e278 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:56.809587 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-292dbf1d-cba7-4896-8ef1-94253b35e278 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:56.810268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-292dbf1d-cba7-4896-8ef1-94253b35e278 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:56.811924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-292dbf1d-cba7-4896-8ef1-94253b35e278 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] [instance: bf13a2d3-c288-435f-a0ae-b47b19839312] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:56.818938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-292dbf1d-cba7-4896-8ef1-94253b35e278 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:56.819889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-292dbf1d-cba7-4896-8ef1-94253b35e278 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:56.820614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-292dbf1d-cba7-4896-8ef1-94253b35e278 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:56.822851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-292dbf1d-cba7-4896-8ef1-94253b35e278 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:56.823643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-292dbf1d-cba7-4896-8ef1-94253b35e278 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:56.824277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-292dbf1d-cba7-4896-8ef1-94253b35e278 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:56.829290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c96e2ac-d377-473c-a1c1-b038d6cbff88 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:56.830736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c96e2ac-d377-473c-a1c1-b038d6cbff88 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:56.833538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c96e2ac-d377-473c-a1c1-b038d6cbff88 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:56.836898 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c96e2ac-d377-473c-a1c1-b038d6cbff88 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:56.841402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c96e2ac-d377-473c-a1c1-b038d6cbff88 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:56.845294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c96e2ac-d377-473c-a1c1-b038d6cbff88 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:56.886402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-292dbf1d-cba7-4896-8ef1-94253b35e278 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:56.887682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-292dbf1d-cba7-4896-8ef1-94253b35e278 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:56.888719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-292dbf1d-cba7-4896-8ef1-94253b35e278 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:56.912970 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-292dbf1d-cba7-4896-8ef1-94253b35e278 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:56.914001 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-292dbf1d-cba7-4896-8ef1-94253b35e278 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:56.914937 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-292dbf1d-cba7-4896-8ef1-94253b35e278 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:57.009558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-292dbf1d-cba7-4896-8ef1-94253b35e278 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lazy-loading 'flavor' on Instance uuid bf13a2d3-c288-435f-a0ae-b47b19839312 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:48:57.086300 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-292dbf1d-cba7-4896-8ef1-94253b35e278 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "PUT /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags/tempest-tag-1205932612" status: 201 len: 0 microversion: 2.26 time: 0.299574 Sep 07 12:48:57.089626 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1816/3678] 10.222.0.16 () {62 vars in 1380 bytes} [Wed Sep 7 12:48:56 2022] PUT /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags/tempest-tag-1205932612 => generated 0 bytes in 315 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 07 12:48:57.120739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ce64ca7c-5e2a-4563-9d39-1a0ad76e2abf tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:57.124420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ce64ca7c-5e2a-4563-9d39-1a0ad76e2abf tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:57.142782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4c96e2ac-d377-473c-a1c1-b038d6cbff88 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:57.155599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce64ca7c-5e2a-4563-9d39-1a0ad76e2abf tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:57.158467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce64ca7c-5e2a-4563-9d39-1a0ad76e2abf tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:57.162096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce64ca7c-5e2a-4563-9d39-1a0ad76e2abf tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:57.166874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4c96e2ac-d377-473c-a1c1-b038d6cbff88 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:57.167647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce64ca7c-5e2a-4563-9d39-1a0ad76e2abf tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:57.168623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce64ca7c-5e2a-4563-9d39-1a0ad76e2abf tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:57.169433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce64ca7c-5e2a-4563-9d39-1a0ad76e2abf tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:57.182125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4c96e2ac-d377-473c-a1c1-b038d6cbff88 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:57.184940 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4c96e2ac-d377-473c-a1c1-b038d6cbff88 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] 10.222.0.16 "GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12" status: 200 len: 1371 microversion: 2.57 time: 0.393071 Sep 07 12:48:57.191106 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1863/3679] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:56 2022] GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12 => generated 1371 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:57.213940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-df8f6329-308e-4bd4-ac37-13f426ed60f1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:48:57.217633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-df8f6329-308e-4bd4-ac37-13f426ed60f1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:57.236441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df8f6329-308e-4bd4-ac37-13f426ed60f1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:57.237232 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df8f6329-308e-4bd4-ac37-13f426ed60f1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:57.237896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df8f6329-308e-4bd4-ac37-13f426ed60f1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:57.238809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df8f6329-308e-4bd4-ac37-13f426ed60f1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:57.239746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df8f6329-308e-4bd4-ac37-13f426ed60f1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:57.240578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df8f6329-308e-4bd4-ac37-13f426ed60f1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:57.408701 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-df8f6329-308e-4bd4-ac37-13f426ed60f1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action" status: 202 len: 0 microversion: 2.1 time: 0.213813 Sep 07 12:48:57.410135 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1864/3680] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:48:57 2022] POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:48:57.447939 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f3c2bc73-b636-4b48-9aec-93579c67ceda tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '.version_select at 0x7fc4181fc670>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:57.473170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3c2bc73-b636-4b48-9aec-93579c67ceda tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:57.474205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3c2bc73-b636-4b48-9aec-93579c67ceda tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:57.474902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3c2bc73-b636-4b48-9aec-93579c67ceda tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:57.491095 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f3c2bc73-b636-4b48-9aec-93579c67ceda tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags" status: 200 len: 36 microversion: 2.26 time: 0.074644 Sep 07 12:48:57.492359 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1865/3681] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Sep 7 12:48:57 2022] GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags => generated 36 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:57.498159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-12c648b1-fda8-4a0d-8da2-21b6c40ddecd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:57.499388 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-12c648b1-fda8-4a0d-8da2-21b6c40ddecd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:57.507336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12c648b1-fda8-4a0d-8da2-21b6c40ddecd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:57.508298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12c648b1-fda8-4a0d-8da2-21b6c40ddecd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:57.508976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12c648b1-fda8-4a0d-8da2-21b6c40ddecd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:57.510349 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12c648b1-fda8-4a0d-8da2-21b6c40ddecd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:57.511083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12c648b1-fda8-4a0d-8da2-21b6c40ddecd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:57.511899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12c648b1-fda8-4a0d-8da2-21b6c40ddecd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:57.950904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ce64ca7c-5e2a-4563-9d39-1a0ad76e2abf tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:57.985787 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ce64ca7c-5e2a-4563-9d39-1a0ad76e2abf tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02" status: 200 len: 1317 microversion: 2.1 time: 0.893082 Sep 07 12:48:57.986602 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1817/3682] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:57 2022] GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02 => generated 1317 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:58.010042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ec703b62-aee9-472a-8a71-40ea394cd7ec tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '.version_select at 0x7fc41d195790>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:58.026498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-12c648b1-fda8-4a0d-8da2-21b6c40ddecd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:58.031684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec703b62-aee9-472a-8a71-40ea394cd7ec tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:58.035078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec703b62-aee9-472a-8a71-40ea394cd7ec tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:58.035870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec703b62-aee9-472a-8a71-40ea394cd7ec tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:58.043060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ec703b62-aee9-472a-8a71-40ea394cd7ec tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] [instance: bf13a2d3-c288-435f-a0ae-b47b19839312] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:58.051375 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-12c648b1-fda8-4a0d-8da2-21b6c40ddecd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1671 microversion: 2.1 time: 0.557283 Sep 07 12:48:58.052431 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1866/3683] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:57 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1671 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:58.060004 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec703b62-aee9-472a-8a71-40ea394cd7ec tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:58.062493 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec703b62-aee9-472a-8a71-40ea394cd7ec tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:58.063138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec703b62-aee9-472a-8a71-40ea394cd7ec tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:58.068680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec703b62-aee9-472a-8a71-40ea394cd7ec tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:58.069706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec703b62-aee9-472a-8a71-40ea394cd7ec tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:58.070538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec703b62-aee9-472a-8a71-40ea394cd7ec tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:58.106043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-69de450b-a2bc-44d0-a51c-1f684433d92e req-04501737-e191-4fae-b4ca-2cd051edf361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f90d70b2-052c-4840-8008-9d9b2b08772a", "name": "network-vif-plugged", "status": "completed", "tag": "4884ea30-6481-4544-a1c7-5f3beab54e8d"}, {"server_uuid": "f90d70b2-052c-4840-8008-9d9b2b08772a", "name": "network-vif-plugged", "status": "completed", "tag": "d4ebc424-f0c8-485e-a625-d0d51830190e"}, {"server_uuid": "f90d70b2-052c-4840-8008-9d9b2b08772a", "name": "network-vif-plugged", "status": "completed", "tag": "ff4033b6-7d47-4ed1-9c26-6cc0e709c6e8"}, {"server_uuid": "f90d70b2-052c-4840-8008-9d9b2b08772a", "name": "network-vif-plugged", "status": "completed", "tag": "c36949c2-d7d4-432d-beb4-1b6f8be02a34"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:48:58.129128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-69de450b-a2bc-44d0-a51c-1f684433d92e req-04501737-e191-4fae-b4ca-2cd051edf361 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:58.130019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-69de450b-a2bc-44d0-a51c-1f684433d92e req-04501737-e191-4fae-b4ca-2cd051edf361 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:58.130819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-69de450b-a2bc-44d0-a51c-1f684433d92e req-04501737-e191-4fae-b4ca-2cd051edf361 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:58.132871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec703b62-aee9-472a-8a71-40ea394cd7ec tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:58.133983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec703b62-aee9-472a-8a71-40ea394cd7ec tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:58.134501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec703b62-aee9-472a-8a71-40ea394cd7ec tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:58.163109 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-69de450b-a2bc-44d0-a51c-1f684433d92e req-04501737-e191-4fae-b4ca-2cd051edf361 service nova] Creating event network-vif-plugged:4884ea30-6481-4544-a1c7-5f3beab54e8d for instance f90d70b2-052c-4840-8008-9d9b2b08772a on n-h2-852087-9 Sep 07 12:48:58.164375 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-69de450b-a2bc-44d0-a51c-1f684433d92e req-04501737-e191-4fae-b4ca-2cd051edf361 service nova] Creating event network-vif-plugged:d4ebc424-f0c8-485e-a625-d0d51830190e for instance f90d70b2-052c-4840-8008-9d9b2b08772a on n-h2-852087-9 Sep 07 12:48:58.165770 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-69de450b-a2bc-44d0-a51c-1f684433d92e req-04501737-e191-4fae-b4ca-2cd051edf361 service nova] Creating event network-vif-plugged:ff4033b6-7d47-4ed1-9c26-6cc0e709c6e8 for instance f90d70b2-052c-4840-8008-9d9b2b08772a on n-h2-852087-9 Sep 07 12:48:58.166035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-ec703b62-aee9-472a-8a71-40ea394cd7ec tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lazy-loading 'flavor' on Instance uuid bf13a2d3-c288-435f-a0ae-b47b19839312 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:48:58.167272 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-69de450b-a2bc-44d0-a51c-1f684433d92e req-04501737-e191-4fae-b4ca-2cd051edf361 service nova] Creating event network-vif-plugged:c36949c2-d7d4-432d-beb4-1b6f8be02a34 for instance f90d70b2-052c-4840-8008-9d9b2b08772a on n-h2-852087-9 Sep 07 12:48:58.178814 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-69de450b-a2bc-44d0-a51c-1f684433d92e req-04501737-e191-4fae-b4ca-2cd051edf361 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.110289 Sep 07 12:48:58.180750 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1867/3684] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:48:58.186452 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ec703b62-aee9-472a-8a71-40ea394cd7ec tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags/tempest-tag-1205932612" status: 204 len: 0 microversion: 2.26 time: 0.190665 Sep 07 12:48:58.192034 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1818/3685] 10.222.0.16 () {60 vars in 1364 bytes} [Wed Sep 7 12:48:57 2022] DELETE /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags/tempest-tag-1205932612 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:48:58.196701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9c3d1595-bb7f-4b22-bb10-130332c15bad tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:58.197601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6d5dc4a0-d75b-49c4-965b-688f81bf9738 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:58.198705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6d5dc4a0-d75b-49c4-965b-688f81bf9738 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:58.199162 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9c3d1595-bb7f-4b22-bb10-130332c15bad tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 91762428-7354-4926-b463-edc357e1e7cf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:58.211394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d5dc4a0-d75b-49c4-965b-688f81bf9738 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:58.211954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c3d1595-bb7f-4b22-bb10-130332c15bad tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:58.212246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d5dc4a0-d75b-49c4-965b-688f81bf9738 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:58.213445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c3d1595-bb7f-4b22-bb10-130332c15bad tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:58.213751 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d5dc4a0-d75b-49c4-965b-688f81bf9738 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:58.214791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c3d1595-bb7f-4b22-bb10-130332c15bad tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:58.215316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d5dc4a0-d75b-49c4-965b-688f81bf9738 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:58.216215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d5dc4a0-d75b-49c4-965b-688f81bf9738 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:58.216892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c3d1595-bb7f-4b22-bb10-130332c15bad tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:58.217093 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d5dc4a0-d75b-49c4-965b-688f81bf9738 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:58.218253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c3d1595-bb7f-4b22-bb10-130332c15bad tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:58.219295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c3d1595-bb7f-4b22-bb10-130332c15bad tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:58.755689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9c3d1595-bb7f-4b22-bb10-130332c15bad tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796a821c4f184a6aac2859bb943f9bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a87170da674037af70fac57a366c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:58.769695 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6d5dc4a0-d75b-49c4-965b-688f81bf9738 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:58.774799 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9c3d1595-bb7f-4b22-bb10-130332c15bad tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf" status: 200 len: 1473 microversion: 2.1 time: 0.590952 Sep 07 12:48:58.777006 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1868/3686] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:58 2022] GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf => generated 1473 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:58.786436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4b96e34f-f777-4fd3-a06b-2fb968a5df12 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Action: 'create', calling method: .version_select at 0x7fc4181fcdc0>, body: {"keypair": {"name": "tempest-keypair-883330946", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRhSLLJ+idc3ajGW62I5HWGvWxepub42e/QPqaBuav+ckvgkUm/qCvLF8WhE4smKXV/wn/41QwvIHkZ/Fpd0B9Wwp6mJzS6uTzDDoSs0YlsxmUkUNKy51fnRvK9Lt2QGw=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:48:58.796573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6d5dc4a0-d75b-49c4-965b-688f81bf9738 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:58.802323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6d5dc4a0-d75b-49c4-965b-688f81bf9738 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:58.805075 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6d5dc4a0-d75b-49c4-965b-688f81bf9738 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1879 microversion: 2.42 time: 0.615087 Sep 07 12:48:58.821532 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1819/3687] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:58 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1879 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:58.821532 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-76588f42-15ea-4378-b7d3-9960e8591a45 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '.version_select at 0x7fc4188045e0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:58.822752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76588f42-15ea-4378-b7d3-9960e8591a45 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:58.822752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76588f42-15ea-4378-b7d3-9960e8591a45 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:58.822752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76588f42-15ea-4378-b7d3-9960e8591a45 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:58.834330 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-76588f42-15ea-4378-b7d3-9960e8591a45 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags" status: 200 len: 12 microversion: 2.26 time: 0.025295 Sep 07 12:48:58.834330 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1820/3688] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Sep 7 12:48:58 2022] GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags => generated 12 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:58.849273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a2ec83e9-aeee-4c91-9581-6ccb856338c8 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:58.849273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a2ec83e9-aeee-4c91-9581-6ccb856338c8 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] [instance: d4363e90-4eb0-487a-a798-7a6d0a613e12] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:58.851687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2ec83e9-aeee-4c91-9581-6ccb856338c8 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:58.852199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2ec83e9-aeee-4c91-9581-6ccb856338c8 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:58.852645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2ec83e9-aeee-4c91-9581-6ccb856338c8 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:58.853374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2ec83e9-aeee-4c91-9581-6ccb856338c8 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:58.853950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2ec83e9-aeee-4c91-9581-6ccb856338c8 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:58.854386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2ec83e9-aeee-4c91-9581-6ccb856338c8 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:58.882416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-4b96e34f-f777-4fd3-a06b-2fb968a5df12 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Getting quotas for project 256a95a81360419dbaf33382dd369262. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:48:58.892348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-4b96e34f-f777-4fd3-a06b-2fb968a5df12 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Getting quotas for user a6d92e694e984ad8b126b94ed8effb3f and project 256a95a81360419dbaf33382dd369262. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:48:58.954262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a2ec83e9-aeee-4c91-9581-6ccb856338c8 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:58.967029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a2ec83e9-aeee-4c91-9581-6ccb856338c8 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:58.970984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a2ec83e9-aeee-4c91-9581-6ccb856338c8 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:58.973444 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a2ec83e9-aeee-4c91-9581-6ccb856338c8 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] 10.222.0.16 "GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12" status: 200 len: 1356 microversion: 2.57 time: 0.132367 Sep 07 12:48:58.974964 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1821/3689] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:48:58 2022] GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12 => generated 1356 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:48:58.982598 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4b96e34f-f777-4fd3-a06b-2fb968a5df12 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.202999 Sep 07 12:48:59.002022 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1869/3690] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 12:48:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:48:59.040328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fd2a305f-d14e-4e49-8e2b-350198dd40f2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '.version_select at 0x7fc41854ee50>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:59.063748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-637bb624-d5c2-41ed-80de-531adbf16cc2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:59.070082 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-637bb624-d5c2-41ed-80de-531adbf16cc2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:59.110739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd2a305f-d14e-4e49-8e2b-350198dd40f2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:59.114504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd2a305f-d14e-4e49-8e2b-350198dd40f2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:59.115428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd2a305f-d14e-4e49-8e2b-350198dd40f2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:59.116378 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fd2a305f-d14e-4e49-8e2b-350198dd40f2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] [instance: bf13a2d3-c288-435f-a0ae-b47b19839312] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:59.151343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd2a305f-d14e-4e49-8e2b-350198dd40f2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:59.153323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd2a305f-d14e-4e49-8e2b-350198dd40f2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:59.155980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd2a305f-d14e-4e49-8e2b-350198dd40f2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:59.161288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd2a305f-d14e-4e49-8e2b-350198dd40f2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:59.162288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd2a305f-d14e-4e49-8e2b-350198dd40f2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:59.163188 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd2a305f-d14e-4e49-8e2b-350198dd40f2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:59.175945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-637bb624-d5c2-41ed-80de-531adbf16cc2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:59.177916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-637bb624-d5c2-41ed-80de-531adbf16cc2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:59.181649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-637bb624-d5c2-41ed-80de-531adbf16cc2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:59.183593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-637bb624-d5c2-41ed-80de-531adbf16cc2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:59.187205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-637bb624-d5c2-41ed-80de-531adbf16cc2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:59.191864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-637bb624-d5c2-41ed-80de-531adbf16cc2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:59.257636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=93,nova_cell1:DELETE=2,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:48:59.280604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd2a305f-d14e-4e49-8e2b-350198dd40f2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:59.282111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd2a305f-d14e-4e49-8e2b-350198dd40f2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:59.283446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd2a305f-d14e-4e49-8e2b-350198dd40f2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:59.318418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-fd2a305f-d14e-4e49-8e2b-350198dd40f2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lazy-loading 'flavor' on Instance uuid bf13a2d3-c288-435f-a0ae-b47b19839312 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:48:59.372389 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fd2a305f-d14e-4e49-8e2b-350198dd40f2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags" status: 204 len: 0 microversion: 2.26 time: 0.384233 Sep 07 12:48:59.386230 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1822/3691] 10.222.0.16 () {60 vars in 1295 bytes} [Wed Sep 7 12:48:58 2022] DELETE /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:48:59.413877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3f4243e8-3acf-48f3-9721-0b4dcc0db0b7 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:59.415253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3f4243e8-3acf-48f3-9721-0b4dcc0db0b7 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] [instance: d4363e90-4eb0-487a-a798-7a6d0a613e12] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:59.457057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f4243e8-3acf-48f3-9721-0b4dcc0db0b7 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:59.462114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f4243e8-3acf-48f3-9721-0b4dcc0db0b7 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:59.463225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f4243e8-3acf-48f3-9721-0b4dcc0db0b7 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:59.469095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f4243e8-3acf-48f3-9721-0b4dcc0db0b7 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:59.470529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f4243e8-3acf-48f3-9721-0b4dcc0db0b7 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:59.471609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f4243e8-3acf-48f3-9721-0b4dcc0db0b7 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:59.533731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3f4243e8-3acf-48f3-9721-0b4dcc0db0b7 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] [instance: d4363e90-4eb0-487a-a798-7a6d0a613e12] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:48:59.677689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-637bb624-d5c2-41ed-80de-531adbf16cc2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:48:59.693644 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-637bb624-d5c2-41ed-80de-531adbf16cc2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02" status: 200 len: 1317 microversion: 2.1 time: 0.676137 Sep 07 12:48:59.694252 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1870/3692] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:59 2022] GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02 => generated 1317 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:48:59.701562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:48:59.711383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e032abb2-82fe-40c8-abab-1589ac0a8f10 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:59.718631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e032abb2-82fe-40c8-abab-1589ac0a8f10 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:59.725549 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3f4243e8-3acf-48f3-9721-0b4dcc0db0b7 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12" status: 204 len: 0 microversion: 2.57 time: 0.337619 Sep 07 12:48:59.726181 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1823/3693] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 12:48:59 2022] DELETE /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:48:59.731814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1e564416-c00c-458a-bdf8-b7e9cde0938f tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '.version_select at 0x7fc41854e040>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:48:59.744394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e032abb2-82fe-40c8-abab-1589ac0a8f10 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:59.745355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e032abb2-82fe-40c8-abab-1589ac0a8f10 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:59.746020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e032abb2-82fe-40c8-abab-1589ac0a8f10 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:59.747019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e032abb2-82fe-40c8-abab-1589ac0a8f10 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:59.747704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e032abb2-82fe-40c8-abab-1589ac0a8f10 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:59.748568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e032abb2-82fe-40c8-abab-1589ac0a8f10 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:59.765972 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e564416-c00c-458a-bdf8-b7e9cde0938f tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:59.766465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e564416-c00c-458a-bdf8-b7e9cde0938f tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:59.766907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e564416-c00c-458a-bdf8-b7e9cde0938f tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:59.767534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1e564416-c00c-458a-bdf8-b7e9cde0938f tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] [instance: bf13a2d3-c288-435f-a0ae-b47b19839312] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:48:59.794811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e564416-c00c-458a-bdf8-b7e9cde0938f tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:59.795322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e564416-c00c-458a-bdf8-b7e9cde0938f tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:59.795788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e564416-c00c-458a-bdf8-b7e9cde0938f tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:59.796535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e564416-c00c-458a-bdf8-b7e9cde0938f tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:59.797073 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e564416-c00c-458a-bdf8-b7e9cde0938f tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:59.800651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e564416-c00c-458a-bdf8-b7e9cde0938f tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:59.872578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e564416-c00c-458a-bdf8-b7e9cde0938f tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:59.873083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e564416-c00c-458a-bdf8-b7e9cde0938f tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:59.873559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e564416-c00c-458a-bdf8-b7e9cde0938f tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:48:59.906915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e564416-c00c-458a-bdf8-b7e9cde0938f tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:48:59.907423 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e564416-c00c-458a-bdf8-b7e9cde0938f tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:48:59.908029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e564416-c00c-458a-bdf8-b7e9cde0938f tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:00.020480 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-1e564416-c00c-458a-bdf8-b7e9cde0938f tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lazy-loading 'flavor' on Instance uuid bf13a2d3-c288-435f-a0ae-b47b19839312 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:49:00.075708 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1e564416-c00c-458a-bdf8-b7e9cde0938f tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "PUT /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags/tempest-tag-1977535937" status: 201 len: 0 microversion: 2.26 time: 0.348002 Sep 07 12:49:00.082336 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1824/3694] 10.222.0.16 () {62 vars in 1380 bytes} [Wed Sep 7 12:48:59 2022] PUT /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags/tempest-tag-1977535937 => generated 0 bytes in 351 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 07 12:49:00.089693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2fae34b5-7c7e-467b-a1e2-d9d0a7b4c7b4 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:00.090929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2fae34b5-7c7e-467b-a1e2-d9d0a7b4c7b4 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] [instance: d4363e90-4eb0-487a-a798-7a6d0a613e12] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:00.112979 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fae34b5-7c7e-467b-a1e2-d9d0a7b4c7b4 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:00.113930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fae34b5-7c7e-467b-a1e2-d9d0a7b4c7b4 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:00.114747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fae34b5-7c7e-467b-a1e2-d9d0a7b4c7b4 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:00.116042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fae34b5-7c7e-467b-a1e2-d9d0a7b4c7b4 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:00.116955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fae34b5-7c7e-467b-a1e2-d9d0a7b4c7b4 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:00.117636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fae34b5-7c7e-467b-a1e2-d9d0a7b4c7b4 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:00.459761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e032abb2-82fe-40c8-abab-1589ac0a8f10 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:00.466683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2fae34b5-7c7e-467b-a1e2-d9d0a7b4c7b4 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:00.472441 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e032abb2-82fe-40c8-abab-1589ac0a8f10 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1671 microversion: 2.1 time: 0.776280 Sep 07 12:49:00.476143 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1871/3695] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:48:59 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1671 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:00.487974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-056676bd-07dd-4727-a6aa-1594f632dd71 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:00.498482 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-056676bd-07dd-4727-a6aa-1594f632dd71 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 91762428-7354-4926-b463-edc357e1e7cf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:00.500388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2fae34b5-7c7e-467b-a1e2-d9d0a7b4c7b4 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:00.503007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2fae34b5-7c7e-467b-a1e2-d9d0a7b4c7b4 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:00.504926 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2fae34b5-7c7e-467b-a1e2-d9d0a7b4c7b4 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] 10.222.0.16 "GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12" status: 200 len: 1362 microversion: 2.57 time: 0.425842 Sep 07 12:49:00.505505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-056676bd-07dd-4727-a6aa-1594f632dd71 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:00.506072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-056676bd-07dd-4727-a6aa-1594f632dd71 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:00.506585 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-056676bd-07dd-4727-a6aa-1594f632dd71 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:00.507383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-056676bd-07dd-4727-a6aa-1594f632dd71 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:00.509625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-056676bd-07dd-4727-a6aa-1594f632dd71 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:00.510409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-056676bd-07dd-4727-a6aa-1594f632dd71 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:00.521541 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1825/3696] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:00 2022] GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12 => generated 1362 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:49:00.529223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0eccf4b2-c24f-4282-8477-180182cced25 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:00.532111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0eccf4b2-c24f-4282-8477-180182cced25 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:00.547387 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0eccf4b2-c24f-4282-8477-180182cced25 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:00.547894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0eccf4b2-c24f-4282-8477-180182cced25 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:00.548340 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0eccf4b2-c24f-4282-8477-180182cced25 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:00.551373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0eccf4b2-c24f-4282-8477-180182cced25 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:00.551895 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0eccf4b2-c24f-4282-8477-180182cced25 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:00.552341 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0eccf4b2-c24f-4282-8477-180182cced25 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:00.560575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:49:00.689983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-056676bd-07dd-4727-a6aa-1594f632dd71 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796a821c4f184a6aac2859bb943f9bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a87170da674037af70fac57a366c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:00.721618 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-056676bd-07dd-4727-a6aa-1594f632dd71 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf" status: 200 len: 1431 microversion: 2.1 time: 0.229674 Sep 07 12:49:00.722284 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1872/3697] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:00 2022] GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf => generated 1431 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:00.751287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-15452e59-35b3-435d-9aa2-50a9de7d3082 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '.version_select at 0x7fc41819d3a0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:00.773912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15452e59-35b3-435d-9aa2-50a9de7d3082 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:00.775029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15452e59-35b3-435d-9aa2-50a9de7d3082 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:00.775756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15452e59-35b3-435d-9aa2-50a9de7d3082 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:00.776470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-15452e59-35b3-435d-9aa2-50a9de7d3082 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] [instance: bf13a2d3-c288-435f-a0ae-b47b19839312] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:00.785705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15452e59-35b3-435d-9aa2-50a9de7d3082 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:00.786451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15452e59-35b3-435d-9aa2-50a9de7d3082 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:00.790229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15452e59-35b3-435d-9aa2-50a9de7d3082 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:00.799931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15452e59-35b3-435d-9aa2-50a9de7d3082 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:00.800484 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15452e59-35b3-435d-9aa2-50a9de7d3082 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:00.801058 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15452e59-35b3-435d-9aa2-50a9de7d3082 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:00.878297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15452e59-35b3-435d-9aa2-50a9de7d3082 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:00.879179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15452e59-35b3-435d-9aa2-50a9de7d3082 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:00.879880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15452e59-35b3-435d-9aa2-50a9de7d3082 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:00.908695 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15452e59-35b3-435d-9aa2-50a9de7d3082 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:00.909573 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15452e59-35b3-435d-9aa2-50a9de7d3082 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:00.910477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15452e59-35b3-435d-9aa2-50a9de7d3082 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:00.913570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0eccf4b2-c24f-4282-8477-180182cced25 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:00.930396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0eccf4b2-c24f-4282-8477-180182cced25 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:00.936958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0eccf4b2-c24f-4282-8477-180182cced25 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:00.938737 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0eccf4b2-c24f-4282-8477-180182cced25 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1879 microversion: 2.42 time: 0.417083 Sep 07 12:49:00.957042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-15452e59-35b3-435d-9aa2-50a9de7d3082 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lazy-loading 'flavor' on Instance uuid bf13a2d3-c288-435f-a0ae-b47b19839312 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:49:00.963231 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1826/3698] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:00 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1879 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:49:00.976064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-2d260a1b-e181-42f4-85e4-6aadaba9f925 req-1d6fc2cb-33fb-460f-a0a3-0553a16deb80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f90d70b2-052c-4840-8008-9d9b2b08772a", "name": "network-vif-plugged", "status": "completed", "tag": "32b44f36-cd89-4a45-8da9-812f25573ca9"}, {"server_uuid": "f90d70b2-052c-4840-8008-9d9b2b08772a", "name": "network-vif-plugged", "status": "completed", "tag": "bb3dbd1e-6aad-4076-9d60-f092ced32e09"}, {"server_uuid": "a6ce007e-728c-4f62-858f-0da8782e1c02", "name": "network-vif-plugged", "status": "completed", "tag": "3128b5c0-fe38-43f4-9ae9-be319b69137f"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:49:00.982826 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-15452e59-35b3-435d-9aa2-50a9de7d3082 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "PUT /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags/tempest-tag-1498036493" status: 201 len: 0 microversion: 2.26 time: 0.239655 Sep 07 12:49:00.989250 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1873/3699] 10.222.0.16 () {62 vars in 1380 bytes} [Wed Sep 7 12:49:00 2022] PUT /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags/tempest-tag-1498036493 => generated 0 bytes in 266 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 07 12:49:00.994863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-594ff245-bf54-4b6e-a9e4-402771385a1b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:00.995540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-594ff245-bf54-4b6e-a9e4-402771385a1b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:01.003295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2d260a1b-e181-42f4-85e4-6aadaba9f925 req-1d6fc2cb-33fb-460f-a0a3-0553a16deb80 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:01.004388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2d260a1b-e181-42f4-85e4-6aadaba9f925 req-1d6fc2cb-33fb-460f-a0a3-0553a16deb80 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:01.005424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2d260a1b-e181-42f4-85e4-6aadaba9f925 req-1d6fc2cb-33fb-460f-a0a3-0553a16deb80 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:01.020301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-594ff245-bf54-4b6e-a9e4-402771385a1b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:01.022641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-594ff245-bf54-4b6e-a9e4-402771385a1b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:01.024473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-594ff245-bf54-4b6e-a9e4-402771385a1b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:01.025760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-594ff245-bf54-4b6e-a9e4-402771385a1b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:01.028332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-594ff245-bf54-4b6e-a9e4-402771385a1b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:01.030281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-594ff245-bf54-4b6e-a9e4-402771385a1b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:01.054378 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-2d260a1b-e181-42f4-85e4-6aadaba9f925 req-1d6fc2cb-33fb-460f-a0a3-0553a16deb80 service nova] Creating event network-vif-plugged:32b44f36-cd89-4a45-8da9-812f25573ca9 for instance f90d70b2-052c-4840-8008-9d9b2b08772a on n-h2-852087-9 Sep 07 12:49:01.057029 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-2d260a1b-e181-42f4-85e4-6aadaba9f925 req-1d6fc2cb-33fb-460f-a0a3-0553a16deb80 service nova] Creating event network-vif-plugged:bb3dbd1e-6aad-4076-9d60-f092ced32e09 for instance f90d70b2-052c-4840-8008-9d9b2b08772a on n-h2-852087-9 Sep 07 12:49:01.062936 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-2d260a1b-e181-42f4-85e4-6aadaba9f925 req-1d6fc2cb-33fb-460f-a0a3-0553a16deb80 service nova] Creating event network-vif-plugged:3128b5c0-fe38-43f4-9ae9-be319b69137f for instance a6ce007e-728c-4f62-858f-0da8782e1c02 on n-h2-852087-9 Sep 07 12:49:01.084870 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-2d260a1b-e181-42f4-85e4-6aadaba9f925 req-1d6fc2cb-33fb-460f-a0a3-0553a16deb80 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.119456 Sep 07 12:49:01.086519 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1827/3700] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:49:01.099874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-7ba25f26-2d7f-4aa8-bb56-e3c38df9c7cd req-c098443d-d5db-490e-a26b-091312f7c4f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91762428-7354-4926-b463-edc357e1e7cf", "name": "network-vif-deleted", "tag": "8dbc8ca0-72c8-4de0-87af-ac6f1b8ece18"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:49:01.136394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7ba25f26-2d7f-4aa8-bb56-e3c38df9c7cd req-c098443d-d5db-490e-a26b-091312f7c4f2 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:01.138124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7ba25f26-2d7f-4aa8-bb56-e3c38df9c7cd req-c098443d-d5db-490e-a26b-091312f7c4f2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:01.139073 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7ba25f26-2d7f-4aa8-bb56-e3c38df9c7cd req-c098443d-d5db-490e-a26b-091312f7c4f2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:01.154257 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7ba25f26-2d7f-4aa8-bb56-e3c38df9c7cd req-c098443d-d5db-490e-a26b-091312f7c4f2 service nova] Creating event network-vif-deleted:8dbc8ca0-72c8-4de0-87af-ac6f1b8ece18 for instance 91762428-7354-4926-b463-edc357e1e7cf on n-h1-852087-9 Sep 07 12:49:01.180353 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-7ba25f26-2d7f-4aa8-bb56-e3c38df9c7cd req-c098443d-d5db-490e-a26b-091312f7c4f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086581 Sep 07 12:49:01.185434 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1828/3701] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:49:01.199706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3f984374-ecf1-4498-83d7-b46f05375686 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '.version_select at 0x7fc41d1093a0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:01.246045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f984374-ecf1-4498-83d7-b46f05375686 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:01.250370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f984374-ecf1-4498-83d7-b46f05375686 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:01.253352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f984374-ecf1-4498-83d7-b46f05375686 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:01.256257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3f984374-ecf1-4498-83d7-b46f05375686 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] [instance: bf13a2d3-c288-435f-a0ae-b47b19839312] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:01.293924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f984374-ecf1-4498-83d7-b46f05375686 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:01.312963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f984374-ecf1-4498-83d7-b46f05375686 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:01.318435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f984374-ecf1-4498-83d7-b46f05375686 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:01.322848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f984374-ecf1-4498-83d7-b46f05375686 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:01.328406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f984374-ecf1-4498-83d7-b46f05375686 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:01.330777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f984374-ecf1-4498-83d7-b46f05375686 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:01.427145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f984374-ecf1-4498-83d7-b46f05375686 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:01.428309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f984374-ecf1-4498-83d7-b46f05375686 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:01.429545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f984374-ecf1-4498-83d7-b46f05375686 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:01.466117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-3f984374-ecf1-4498-83d7-b46f05375686 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lazy-loading 'flavor' on Instance uuid bf13a2d3-c288-435f-a0ae-b47b19839312 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:49:01.505559 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3f984374-ecf1-4498-83d7-b46f05375686 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags" status: 204 len: 0 microversion: 2.26 time: 0.316099 Sep 07 12:49:01.507088 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1829/3702] 10.222.0.16 () {60 vars in 1295 bytes} [Wed Sep 7 12:49:01 2022] DELETE /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:49:01.533064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c89a6f63-635b-4034-a173-6223ca0c5c4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Action: 'create', calling method: .version_select at 0x7fc41d188790>, body: {"keypair": {"name": "tempest-keypair-1546266145", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMv1/hMo63JvU8LnnRwh0gxTK0mXyRWBe49Gw84WVWzPqKxYyVsfN/lZp+GdOC24vEn/F2VZ0hXj7eZmLvn0B4WoeKFiGlcq9YtPmu68H5dWhw1Co0JwCwHs9OhMnr92HA=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:49:01.560370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-c89a6f63-635b-4034-a173-6223ca0c5c4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Getting quotas for project 17c0c643a1704bc2be7aaedfd11802e8. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:49:01.581915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-c89a6f63-635b-4034-a173-6223ca0c5c4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Getting quotas for user 9b0cc4dd3ef645b18341a7273cb0522c and project 17c0c643a1704bc2be7aaedfd11802e8. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:49:01.645910 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c89a6f63-635b-4034-a173-6223ca0c5c4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.135712 Sep 07 12:49:01.648642 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1830/3703] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Sep 7 12:49:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 140 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 12:49:01.660613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-72a193b8-e690-44db-b576-ff9515620815 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:01.661237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-72a193b8-e690-44db-b576-ff9515620815 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:01.670967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72a193b8-e690-44db-b576-ff9515620815 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:01.672956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72a193b8-e690-44db-b576-ff9515620815 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:01.674128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72a193b8-e690-44db-b576-ff9515620815 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:01.675267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72a193b8-e690-44db-b576-ff9515620815 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:01.675985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72a193b8-e690-44db-b576-ff9515620815 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:01.676693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72a193b8-e690-44db-b576-ff9515620815 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:01.797807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-594ff245-bf54-4b6e-a9e4-402771385a1b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:01.823693 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-594ff245-bf54-4b6e-a9e4-402771385a1b tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02" status: 200 len: 1317 microversion: 2.1 time: 0.832506 Sep 07 12:49:01.824988 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1874/3704] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:00 2022] GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02 => generated 1317 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:01.831062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-010b267a-0f69-4423-94f1-f55660874a68 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '.version_select at 0x7fc4182690d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:01.841344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-010b267a-0f69-4423-94f1-f55660874a68 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:01.842205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-010b267a-0f69-4423-94f1-f55660874a68 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:01.842820 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-010b267a-0f69-4423-94f1-f55660874a68 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:01.855710 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-010b267a-0f69-4423-94f1-f55660874a68 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags" status: 200 len: 12 microversion: 2.26 time: 0.029217 Sep 07 12:49:01.871307 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1875/3705] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Sep 7 12:49:01 2022] GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags => generated 12 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:01.877597 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-906e19c2-55b0-4a75-a3d4-5df8b524f957 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:01.878208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-906e19c2-55b0-4a75-a3d4-5df8b524f957 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] [instance: d4363e90-4eb0-487a-a798-7a6d0a613e12] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:01.885306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-906e19c2-55b0-4a75-a3d4-5df8b524f957 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:01.886229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-906e19c2-55b0-4a75-a3d4-5df8b524f957 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:01.886959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-906e19c2-55b0-4a75-a3d4-5df8b524f957 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:01.888420 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-906e19c2-55b0-4a75-a3d4-5df8b524f957 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:01.888913 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-906e19c2-55b0-4a75-a3d4-5df8b524f957 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:01.889355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-906e19c2-55b0-4a75-a3d4-5df8b524f957 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:02.099969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-906e19c2-55b0-4a75-a3d4-5df8b524f957 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:02.120217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-906e19c2-55b0-4a75-a3d4-5df8b524f957 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:02.124549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-906e19c2-55b0-4a75-a3d4-5df8b524f957 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:02.127300 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-906e19c2-55b0-4a75-a3d4-5df8b524f957 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] 10.222.0.16 "GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12" status: 200 len: 1362 microversion: 2.57 time: 0.254165 Sep 07 12:49:02.129469 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1876/3706] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:01 2022] GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12 => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:49:02.139754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ea9a74b7-ab86-4497-bc94-79c87efdd69f tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:02.141819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ea9a74b7-ab86-4497-bc94-79c87efdd69f tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 91762428-7354-4926-b463-edc357e1e7cf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:02.154375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea9a74b7-ab86-4497-bc94-79c87efdd69f tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:02.155861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea9a74b7-ab86-4497-bc94-79c87efdd69f tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:02.157191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea9a74b7-ab86-4497-bc94-79c87efdd69f tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:02.158995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea9a74b7-ab86-4497-bc94-79c87efdd69f tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:02.160632 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea9a74b7-ab86-4497-bc94-79c87efdd69f tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:02.162007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea9a74b7-ab86-4497-bc94-79c87efdd69f tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:02.239752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea9a74b7-ab86-4497-bc94-79c87efdd69f tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:02.241264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea9a74b7-ab86-4497-bc94-79c87efdd69f tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:02.242867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea9a74b7-ab86-4497-bc94-79c87efdd69f tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:02.244590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-ea9a74b7-ab86-4497-bc94-79c87efdd69f tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lazy-loading 'fault' on Instance uuid 91762428-7354-4926-b463-edc357e1e7cf {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:49:02.251978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-72a193b8-e690-44db-b576-ff9515620815 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:02.274367 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-72a193b8-e690-44db-b576-ff9515620815 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1676 microversion: 2.1 time: 0.624483 Sep 07 12:49:02.278384 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1831/3707] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:01 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1676 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:02.298196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f2ba94c2-f8cc-420e-83ca-5f3130a44b49 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '.version_select at 0x7fc41d1050d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:02.319062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2ba94c2-f8cc-420e-83ca-5f3130a44b49 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:02.319855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2ba94c2-f8cc-420e-83ca-5f3130a44b49 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:02.320588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2ba94c2-f8cc-420e-83ca-5f3130a44b49 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:02.321307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f2ba94c2-f8cc-420e-83ca-5f3130a44b49 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] [instance: bf13a2d3-c288-435f-a0ae-b47b19839312] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:02.341904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2ba94c2-f8cc-420e-83ca-5f3130a44b49 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:02.342512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2ba94c2-f8cc-420e-83ca-5f3130a44b49 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:02.342996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2ba94c2-f8cc-420e-83ca-5f3130a44b49 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:02.343860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2ba94c2-f8cc-420e-83ca-5f3130a44b49 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:02.344300 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2ba94c2-f8cc-420e-83ca-5f3130a44b49 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:02.344741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2ba94c2-f8cc-420e-83ca-5f3130a44b49 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:02.375498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ea9a74b7-ab86-4497-bc94-79c87efdd69f tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796a821c4f184a6aac2859bb943f9bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a87170da674037af70fac57a366c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:02.429417 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ea9a74b7-ab86-4497-bc94-79c87efdd69f tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf" status: 200 len: 1307 microversion: 2.1 time: 0.297387 Sep 07 12:49:02.431607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2ba94c2-f8cc-420e-83ca-5f3130a44b49 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:02.432157 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2ba94c2-f8cc-420e-83ca-5f3130a44b49 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:02.432611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2ba94c2-f8cc-420e-83ca-5f3130a44b49 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:02.437200 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1877/3708] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:02 2022] GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf => generated 1307 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:02.470210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-f2ba94c2-f8cc-420e-83ca-5f3130a44b49 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lazy-loading 'flavor' on Instance uuid bf13a2d3-c288-435f-a0ae-b47b19839312 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:49:02.481393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-41b25ff8-647a-47c3-9d91-ea89652082c6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:02.488197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-41b25ff8-647a-47c3-9d91-ea89652082c6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:02.512055 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f2ba94c2-f8cc-420e-83ca-5f3130a44b49 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags" status: 204 len: 0 microversion: 2.26 time: 0.229503 Sep 07 12:49:02.520063 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1832/3709] 10.222.0.16 () {60 vars in 1295 bytes} [Wed Sep 7 12:49:02 2022] DELETE /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:49:02.527516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41b25ff8-647a-47c3-9d91-ea89652082c6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:02.532017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-edf83612-ab53-4cf4-8901-bdfe878f9be0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '.version_select at 0x7fc41d20f8b0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:02.532965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41b25ff8-647a-47c3-9d91-ea89652082c6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:02.536840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41b25ff8-647a-47c3-9d91-ea89652082c6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:02.543460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41b25ff8-647a-47c3-9d91-ea89652082c6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:02.545100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edf83612-ab53-4cf4-8901-bdfe878f9be0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:02.545699 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edf83612-ab53-4cf4-8901-bdfe878f9be0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:02.546910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41b25ff8-647a-47c3-9d91-ea89652082c6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:02.547348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edf83612-ab53-4cf4-8901-bdfe878f9be0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:02.548659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-edf83612-ab53-4cf4-8901-bdfe878f9be0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] [instance: bf13a2d3-c288-435f-a0ae-b47b19839312] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:02.549476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41b25ff8-647a-47c3-9d91-ea89652082c6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:02.559049 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edf83612-ab53-4cf4-8901-bdfe878f9be0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:02.560095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edf83612-ab53-4cf4-8901-bdfe878f9be0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:02.560761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edf83612-ab53-4cf4-8901-bdfe878f9be0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:02.562187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edf83612-ab53-4cf4-8901-bdfe878f9be0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:02.563215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edf83612-ab53-4cf4-8901-bdfe878f9be0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:02.563910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edf83612-ab53-4cf4-8901-bdfe878f9be0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:02.623404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edf83612-ab53-4cf4-8901-bdfe878f9be0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:02.624721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edf83612-ab53-4cf4-8901-bdfe878f9be0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:02.626217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edf83612-ab53-4cf4-8901-bdfe878f9be0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:02.664474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edf83612-ab53-4cf4-8901-bdfe878f9be0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:02.666711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edf83612-ab53-4cf4-8901-bdfe878f9be0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:02.667113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-edf83612-ab53-4cf4-8901-bdfe878f9be0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:02.714473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-edf83612-ab53-4cf4-8901-bdfe878f9be0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lazy-loading 'flavor' on Instance uuid bf13a2d3-c288-435f-a0ae-b47b19839312 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:49:02.745844 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-edf83612-ab53-4cf4-8901-bdfe878f9be0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "PUT /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags/tempest-tag-113236769" status: 201 len: 0 microversion: 2.26 time: 0.222091 Sep 07 12:49:02.751676 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1833/3710] 10.222.0.16 () {62 vars in 1377 bytes} [Wed Sep 7 12:49:02 2022] PUT /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags/tempest-tag-113236769 => generated 0 bytes in 226 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 07 12:49:02.787598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8d532896-b9ed-470a-92d8-49c7a4569d3c tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '.version_select at 0x7fc4181f4af0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:02.846008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d532896-b9ed-470a-92d8-49c7a4569d3c tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:02.847117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d532896-b9ed-470a-92d8-49c7a4569d3c tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:02.849991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d532896-b9ed-470a-92d8-49c7a4569d3c tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:02.850935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8d532896-b9ed-470a-92d8-49c7a4569d3c tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] [instance: bf13a2d3-c288-435f-a0ae-b47b19839312] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:02.879949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d532896-b9ed-470a-92d8-49c7a4569d3c tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:02.880782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d532896-b9ed-470a-92d8-49c7a4569d3c tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:02.881460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d532896-b9ed-470a-92d8-49c7a4569d3c tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:02.885747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d532896-b9ed-470a-92d8-49c7a4569d3c tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:02.890103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d532896-b9ed-470a-92d8-49c7a4569d3c tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:02.890937 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d532896-b9ed-470a-92d8-49c7a4569d3c tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:03.007132 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d532896-b9ed-470a-92d8-49c7a4569d3c tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:03.010740 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d532896-b9ed-470a-92d8-49c7a4569d3c tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:03.011709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d532896-b9ed-470a-92d8-49c7a4569d3c tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:03.068502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=89,nova_cell1:DELETE=3,nova_cell1:UPDATE=1,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:49:03.073156 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d532896-b9ed-470a-92d8-49c7a4569d3c tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:03.074328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d532896-b9ed-470a-92d8-49c7a4569d3c tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:03.088792 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d532896-b9ed-470a-92d8-49c7a4569d3c tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:03.167713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-8d532896-b9ed-470a-92d8-49c7a4569d3c tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lazy-loading 'flavor' on Instance uuid bf13a2d3-c288-435f-a0ae-b47b19839312 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:49:03.221349 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8d532896-b9ed-470a-92d8-49c7a4569d3c tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "PUT /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags/tempest-tag-1579512330" status: 201 len: 0 microversion: 2.26 time: 0.455250 Sep 07 12:49:03.227551 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1834/3711] 10.222.0.16 () {62 vars in 1380 bytes} [Wed Sep 7 12:49:02 2022] PUT /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags/tempest-tag-1579512330 => generated 0 bytes in 470 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 07 12:49:03.239252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c399ce22-34d8-472a-8f00-b0e584ce7db1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:03.241531 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c399ce22-34d8-472a-8f00-b0e584ce7db1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:03.259721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c399ce22-34d8-472a-8f00-b0e584ce7db1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:03.260720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c399ce22-34d8-472a-8f00-b0e584ce7db1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:03.261058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c399ce22-34d8-472a-8f00-b0e584ce7db1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:03.261917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c399ce22-34d8-472a-8f00-b0e584ce7db1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:03.262634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c399ce22-34d8-472a-8f00-b0e584ce7db1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:03.263080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c399ce22-34d8-472a-8f00-b0e584ce7db1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:03.699503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-41b25ff8-647a-47c3-9d91-ea89652082c6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:03.747077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-41b25ff8-647a-47c3-9d91-ea89652082c6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:03.751324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-41b25ff8-647a-47c3-9d91-ea89652082c6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:03.754172 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-41b25ff8-647a-47c3-9d91-ea89652082c6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1879 microversion: 2.42 time: 1.314423 Sep 07 12:49:03.756045 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1878/3712] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:02 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1879 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:49:03.766410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-77333e67-6633-4b8b-83fd-c2b08d563980 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:03.768087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-77333e67-6633-4b8b-83fd-c2b08d563980 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] [instance: d4363e90-4eb0-487a-a798-7a6d0a613e12] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:03.782583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77333e67-6633-4b8b-83fd-c2b08d563980 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:03.783792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77333e67-6633-4b8b-83fd-c2b08d563980 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:03.785196 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77333e67-6633-4b8b-83fd-c2b08d563980 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:03.786634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77333e67-6633-4b8b-83fd-c2b08d563980 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:03.787800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77333e67-6633-4b8b-83fd-c2b08d563980 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:03.789463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77333e67-6633-4b8b-83fd-c2b08d563980 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:03.817380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c399ce22-34d8-472a-8f00-b0e584ce7db1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:03.833956 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c399ce22-34d8-472a-8f00-b0e584ce7db1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02" status: 200 len: 1317 microversion: 2.1 time: 0.608301 Sep 07 12:49:03.836452 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1835/3713] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:03 2022] GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02 => generated 1317 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:03.846083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cb80e087-c1ab-41ce-bbc9-867146f9c731 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Action: 'update_all', calling method: .version_select at 0x7fc418403ca0>, body: {"tags": ["tempest-tag-1353449470", "tempest-tag-2100173407"]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:49:03.864410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb80e087-c1ab-41ce-bbc9-867146f9c731 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:03.865591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb80e087-c1ab-41ce-bbc9-867146f9c731 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:03.866710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb80e087-c1ab-41ce-bbc9-867146f9c731 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:03.867770 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cb80e087-c1ab-41ce-bbc9-867146f9c731 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] [instance: bf13a2d3-c288-435f-a0ae-b47b19839312] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:03.879955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb80e087-c1ab-41ce-bbc9-867146f9c731 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:03.880168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77333e67-6633-4b8b-83fd-c2b08d563980 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:03.880998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77333e67-6633-4b8b-83fd-c2b08d563980 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:03.882096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb80e087-c1ab-41ce-bbc9-867146f9c731 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:03.882824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77333e67-6633-4b8b-83fd-c2b08d563980 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:03.883830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-77333e67-6633-4b8b-83fd-c2b08d563980 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lazy-loading 'fault' on Instance uuid d4363e90-4eb0-487a-a798-7a6d0a613e12 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:49:03.900781 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb80e087-c1ab-41ce-bbc9-867146f9c731 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:03.902897 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb80e087-c1ab-41ce-bbc9-867146f9c731 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:03.903759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb80e087-c1ab-41ce-bbc9-867146f9c731 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:03.904474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb80e087-c1ab-41ce-bbc9-867146f9c731 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:03.969838 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb80e087-c1ab-41ce-bbc9-867146f9c731 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:03.972882 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb80e087-c1ab-41ce-bbc9-867146f9c731 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:03.975165 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb80e087-c1ab-41ce-bbc9-867146f9c731 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:04.002470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-77333e67-6633-4b8b-83fd-c2b08d563980 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:04.014949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-77333e67-6633-4b8b-83fd-c2b08d563980 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:04.016735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-77333e67-6633-4b8b-83fd-c2b08d563980 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd92a5e717d4c94b046c0a632bd3ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313385f79a2148599af2c15696fad11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:04.018103 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-77333e67-6633-4b8b-83fd-c2b08d563980 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] 10.222.0.16 "GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12" status: 200 len: 1367 microversion: 2.57 time: 0.259893 Sep 07 12:49:04.033541 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1879/3714] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:03 2022] GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12 => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:49:04.033541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2d9dde16-ac33-4abe-b9a7-c105a64935f3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:04.033541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2d9dde16-ac33-4abe-b9a7-c105a64935f3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:04.034193 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-cb80e087-c1ab-41ce-bbc9-867146f9c731 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lazy-loading 'flavor' on Instance uuid bf13a2d3-c288-435f-a0ae-b47b19839312 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:49:04.044004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d9dde16-ac33-4abe-b9a7-c105a64935f3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:04.044817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d9dde16-ac33-4abe-b9a7-c105a64935f3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:04.045657 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d9dde16-ac33-4abe-b9a7-c105a64935f3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:04.047496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d9dde16-ac33-4abe-b9a7-c105a64935f3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:04.048228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d9dde16-ac33-4abe-b9a7-c105a64935f3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:04.049375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d9dde16-ac33-4abe-b9a7-c105a64935f3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:04.073651 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cb80e087-c1ab-41ce-bbc9-867146f9c731 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "PUT /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags" status: 200 len: 62 microversion: 2.26 time: 0.235167 Sep 07 12:49:04.074943 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1836/3715] 10.222.0.16 () {62 vars in 1312 bytes} [Wed Sep 7 12:49:03 2022] PUT /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags => generated 62 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:04.113096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a2e6b8fd-06fc-4d79-b4f6-9d85d1dee565 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:04.122528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a2e6b8fd-06fc-4d79-b4f6-9d85d1dee565 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 91762428-7354-4926-b463-edc357e1e7cf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:04.134141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2e6b8fd-06fc-4d79-b4f6-9d85d1dee565 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:04.135596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2e6b8fd-06fc-4d79-b4f6-9d85d1dee565 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:04.137021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2e6b8fd-06fc-4d79-b4f6-9d85d1dee565 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:04.138633 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2e6b8fd-06fc-4d79-b4f6-9d85d1dee565 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:04.139825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2e6b8fd-06fc-4d79-b4f6-9d85d1dee565 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:04.140830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2e6b8fd-06fc-4d79-b4f6-9d85d1dee565 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:04.195554 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-a2e6b8fd-06fc-4d79-b4f6-9d85d1dee565 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] HTTP exception thrown: Instance 91762428-7354-4926-b463-edc357e1e7cf could not be found. Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a2e6b8fd-06fc-4d79-b4f6-9d85d1dee565 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Request method failure captured: Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf HTTP/1.1 Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJJ0F_5ywwEnCZY49KfhwBIy4v_eT2SxOOlhWV1gSKlaL09mnj5YwjmoZ5Ch3zufIICoF9Ekw95NY51MidFkHeRH8dHxNAiuQ7ydTVXYlkBNjtE2CSSTGrC7xLCvaYcP64V19ju4dyCdOaQmmdUJe5wkm_a93K9B7sJTSzR6v5RwRsE Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 48a87170da674037af70fac57a366c7f Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ListImageFiltersTestJSON-1778327409 Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/48a87170da674037af70fac57a366c7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_48a87170da674037af70fac57a366c7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/48a87170da674037af70fac57a366c7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/48a87170da674037af70fac57a366c7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ListImageFiltersTestJSON-1778327409 Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 48a87170da674037af70fac57a366c7f Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1778327409 Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ListImageFiltersTestJSON-1778327409-project Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 796a821c4f184a6aac2859bb943f9bc6 Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ListImageFiltersTestJSON-1778327409-project Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 91762428-7354-4926-b463-edc357e1e7cf could not be found. Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '91762428-7354-4926-b463-edc357e1e7cf'} Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91762428-7354-4926-b463-edc357e1e7cf could not be found. Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91762428-7354-4926-b463-edc357e1e7cf could not be found. Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:49:04.199069 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:04.205883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:49:04.205883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:49:04.205883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:49:04.205883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:49:04.205883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:49:04.205883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91762428-7354-4926-b463-edc357e1e7cf could not be found. Sep 07 12:49:04.205883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:04.205883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a2e6b8fd-06fc-4d79-b4f6-9d85d1dee565 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Returning 404 to user: Instance 91762428-7354-4926-b463-edc357e1e7cf could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:49:04.205883 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a2e6b8fd-06fc-4d79-b4f6-9d85d1dee565 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf" status: 404 len: 111 microversion: 2.1 time: 0.125522 Sep 07 12:49:04.205883 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1837/3716] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:04 2022] GET /compute/v2.1/servers/91762428-7354-4926-b463-edc357e1e7cf => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:49:04.214370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bc421f5b-b1ba-4ef1-a6e2-6de7e5189c86 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-737920644", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f31895c7-5684-4c76-b257-83071f0edbbd"}], "security_groups": [{"name": "tempest-securitygroup--1572897782"}], "key_name": "tempest-keypair-883330946", "user_data": "}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:49:04.697452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2d9dde16-ac33-4abe-b9a7-c105a64935f3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:04.704683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-bc421f5b-b1ba-4ef1-a6e2-6de7e5189c86 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] validate_networks() for [('f31895c7-5684-4c76-b257-83071f0edbbd', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:49:04.720187 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2d9dde16-ac33-4abe-b9a7-c105a64935f3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.698728 Sep 07 12:49:04.742893 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1880/3717] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:04 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:04.768588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8f6dd0ce-b349-4b53-a80a-754f7e786ebb tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '.version_select at 0x7fc418260820>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:04.784173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f6dd0ce-b349-4b53-a80a-754f7e786ebb tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:04.785543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f6dd0ce-b349-4b53-a80a-754f7e786ebb tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:04.786903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f6dd0ce-b349-4b53-a80a-754f7e786ebb tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:04.808983 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8f6dd0ce-b349-4b53-a80a-754f7e786ebb tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags" status: 200 len: 62 microversion: 2.26 time: 0.062902 Sep 07 12:49:04.810734 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1881/3718] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Sep 7 12:49:04 2022] GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags => generated 62 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:04.820201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0de1a646-8ef0-408f-ae39-7177cd3785ad tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:04.821219 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0de1a646-8ef0-408f-ae39-7177cd3785ad tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 676e42b4-4985-43cc-892b-176e13b341df] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:04.830317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0de1a646-8ef0-408f-ae39-7177cd3785ad tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:04.831026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0de1a646-8ef0-408f-ae39-7177cd3785ad tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:04.831606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0de1a646-8ef0-408f-ae39-7177cd3785ad tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:04.832591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0de1a646-8ef0-408f-ae39-7177cd3785ad tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:04.833200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0de1a646-8ef0-408f-ae39-7177cd3785ad tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:04.833858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0de1a646-8ef0-408f-ae39-7177cd3785ad tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:04.864644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0de1a646-8ef0-408f-ae39-7177cd3785ad tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 676e42b4-4985-43cc-892b-176e13b341df] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:49:04.986350 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0de1a646-8ef0-408f-ae39-7177cd3785ad tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "DELETE /compute/v2.1/servers/676e42b4-4985-43cc-892b-176e13b341df" status: 204 len: 0 microversion: 2.1 time: 0.173010 Sep 07 12:49:04.987733 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1882/3719] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:49:04 2022] DELETE /compute/v2.1/servers/676e42b4-4985-43cc-892b-176e13b341df => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:49:04.995823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bd1a6ffe-6e53-449b-8bbc-1f7f7c6c5612 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:49:04.998864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bd1a6ffe-6e53-449b-8bbc-1f7f7c6c5612 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:05.007567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd1a6ffe-6e53-449b-8bbc-1f7f7c6c5612 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:05.008398 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd1a6ffe-6e53-449b-8bbc-1f7f7c6c5612 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:05.008955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd1a6ffe-6e53-449b-8bbc-1f7f7c6c5612 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:05.009925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd1a6ffe-6e53-449b-8bbc-1f7f7c6c5612 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:05.010609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd1a6ffe-6e53-449b-8bbc-1f7f7c6c5612 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:05.011431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd1a6ffe-6e53-449b-8bbc-1f7f7c6c5612 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:05.091925 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bd1a6ffe-6e53-449b-8bbc-1f7f7c6c5612 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action" status: 200 len: 324 microversion: 2.1 time: 0.100979 Sep 07 12:49:05.093104 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1883/3720] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:49:04 2022] POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action => generated 324 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:49:05.107058 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ce7b48c1-d77c-4db2-bf8a-0b6306b5d8b5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:05.107058 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ce7b48c1-d77c-4db2-bf8a-0b6306b5d8b5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:05.121077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce7b48c1-d77c-4db2-bf8a-0b6306b5d8b5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:05.122027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce7b48c1-d77c-4db2-bf8a-0b6306b5d8b5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:05.122869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce7b48c1-d77c-4db2-bf8a-0b6306b5d8b5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:05.124168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce7b48c1-d77c-4db2-bf8a-0b6306b5d8b5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:05.125018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce7b48c1-d77c-4db2-bf8a-0b6306b5d8b5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:05.125844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce7b48c1-d77c-4db2-bf8a-0b6306b5d8b5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:05.612136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ce7b48c1-d77c-4db2-bf8a-0b6306b5d8b5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:05.623819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ce7b48c1-d77c-4db2-bf8a-0b6306b5d8b5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:05.626023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ce7b48c1-d77c-4db2-bf8a-0b6306b5d8b5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:05.632810 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ce7b48c1-d77c-4db2-bf8a-0b6306b5d8b5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 2835 microversion: 2.42 time: 0.536934 Sep 07 12:49:05.634040 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1884/3721] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:05 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 2835 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:49:05.644393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-60698413-a3a8-4003-b717-2c58ba820268 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '.version_select at 0x7fc41819de50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:05.662346 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60698413-a3a8-4003-b717-2c58ba820268 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:05.663478 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60698413-a3a8-4003-b717-2c58ba820268 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:05.664359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60698413-a3a8-4003-b717-2c58ba820268 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:05.665254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-60698413-a3a8-4003-b717-2c58ba820268 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] [instance: bf13a2d3-c288-435f-a0ae-b47b19839312] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:05.679009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60698413-a3a8-4003-b717-2c58ba820268 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:05.679956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60698413-a3a8-4003-b717-2c58ba820268 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:05.680753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60698413-a3a8-4003-b717-2c58ba820268 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:05.682173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60698413-a3a8-4003-b717-2c58ba820268 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:05.683039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60698413-a3a8-4003-b717-2c58ba820268 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:05.683898 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60698413-a3a8-4003-b717-2c58ba820268 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:05.719153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bc421f5b-b1ba-4ef1-a6e2-6de7e5189c86 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:49:05.721085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bc421f5b-b1ba-4ef1-a6e2-6de7e5189c86 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:49:05.722367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bc421f5b-b1ba-4ef1-a6e2-6de7e5189c86 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:49:05.723915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bc421f5b-b1ba-4ef1-a6e2-6de7e5189c86 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:49:05.724540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bc421f5b-b1ba-4ef1-a6e2-6de7e5189c86 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:49:05.733444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60698413-a3a8-4003-b717-2c58ba820268 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:05.734603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60698413-a3a8-4003-b717-2c58ba820268 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:05.735430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60698413-a3a8-4003-b717-2c58ba820268 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:05.740076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc421f5b-b1ba-4ef1-a6e2-6de7e5189c86 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:05.741579 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc421f5b-b1ba-4ef1-a6e2-6de7e5189c86 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:05.742195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc421f5b-b1ba-4ef1-a6e2-6de7e5189c86 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:05.743671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc421f5b-b1ba-4ef1-a6e2-6de7e5189c86 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:05.744829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc421f5b-b1ba-4ef1-a6e2-6de7e5189c86 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:05.745570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc421f5b-b1ba-4ef1-a6e2-6de7e5189c86 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:05.769724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-bc421f5b-b1ba-4ef1-a6e2-6de7e5189c86 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Getting quotas for project 256a95a81360419dbaf33382dd369262. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:49:05.771057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-60698413-a3a8-4003-b717-2c58ba820268 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lazy-loading 'flavor' on Instance uuid bf13a2d3-c288-435f-a0ae-b47b19839312 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:49:05.777366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-bc421f5b-b1ba-4ef1-a6e2-6de7e5189c86 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Getting quotas for user a6d92e694e984ad8b126b94ed8effb3f and project 256a95a81360419dbaf33382dd369262. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:49:05.779589 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1,nova_cell1:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:49:05.793229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bc421f5b-b1ba-4ef1-a6e2-6de7e5189c86 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:49:05.796558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bc421f5b-b1ba-4ef1-a6e2-6de7e5189c86 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:49:05.806000 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-60698413-a3a8-4003-b717-2c58ba820268 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags" status: 204 len: 0 microversion: 2.26 time: 0.169638 Sep 07 12:49:05.807209 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1885/3722] 10.222.0.16 () {60 vars in 1295 bytes} [Wed Sep 7 12:49:05 2022] DELETE /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312/tags => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:49:05.816652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a243febd-de40-43b8-ae9b-b9f5031db484 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:05.817936 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a243febd-de40-43b8-ae9b-b9f5031db484 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:05.831401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a243febd-de40-43b8-ae9b-b9f5031db484 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:05.832513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a243febd-de40-43b8-ae9b-b9f5031db484 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:05.833443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a243febd-de40-43b8-ae9b-b9f5031db484 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:05.834930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a243febd-de40-43b8-ae9b-b9f5031db484 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:05.835990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a243febd-de40-43b8-ae9b-b9f5031db484 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:05.836971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a243febd-de40-43b8-ae9b-b9f5031db484 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:05.859870 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bc421f5b-b1ba-4ef1-a6e2-6de7e5189c86 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.654179 Sep 07 12:49:05.865738 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1838/3723] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:49:04 2022] POST /compute/v2.1/servers => generated 409 bytes in 1661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:49:05.881940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f2aa5ff1-bafe-4424-9ef1-bdc3c291f9c9 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:05.885246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f2aa5ff1-bafe-4424-9ef1-bdc3c291f9c9 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 676e42b4-4985-43cc-892b-176e13b341df] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:05.913677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2aa5ff1-bafe-4424-9ef1-bdc3c291f9c9 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:05.914956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2aa5ff1-bafe-4424-9ef1-bdc3c291f9c9 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:05.919789 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2aa5ff1-bafe-4424-9ef1-bdc3c291f9c9 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:05.922324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2aa5ff1-bafe-4424-9ef1-bdc3c291f9c9 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:05.923918 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2aa5ff1-bafe-4424-9ef1-bdc3c291f9c9 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:05.925294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f2aa5ff1-bafe-4424-9ef1-bdc3c291f9c9 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:06.310887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a243febd-de40-43b8-ae9b-b9f5031db484 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:06.323077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f2aa5ff1-bafe-4424-9ef1-bdc3c291f9c9 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796a821c4f184a6aac2859bb943f9bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a87170da674037af70fac57a366c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:06.329647 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a243febd-de40-43b8-ae9b-b9f5031db484 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02" status: 200 len: 1507 microversion: 2.1 time: 0.520100 Sep 07 12:49:06.332131 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1886/3724] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:05 2022] GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02 => generated 1507 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:06.334650 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f2aa5ff1-bafe-4424-9ef1-bdc3c291f9c9 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/676e42b4-4985-43cc-892b-176e13b341df" status: 200 len: 1473 microversion: 2.1 time: 0.463229 Sep 07 12:49:06.342725 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-446fc882-3b6f-4734-a751-148502dbf970 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:06.344320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-446fc882-3b6f-4734-a751-148502dbf970 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] [instance: d4363e90-4eb0-487a-a798-7a6d0a613e12] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:06.345919 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1839/3725] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:05 2022] GET /compute/v2.1/servers/676e42b4-4985-43cc-892b-176e13b341df => generated 1473 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:06.357423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-446fc882-3b6f-4734-a751-148502dbf970 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:06.358972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-446fc882-3b6f-4734-a751-148502dbf970 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:06.360094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-446fc882-3b6f-4734-a751-148502dbf970 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:06.362495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-446fc882-3b6f-4734-a751-148502dbf970 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:06.364427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-647e53ad-af12-4232-9b23-3c017cc8e882 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:06.364991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-446fc882-3b6f-4734-a751-148502dbf970 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:06.365252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-647e53ad-af12-4232-9b23-3c017cc8e882 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:06.366325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-446fc882-3b6f-4734-a751-148502dbf970 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:06.394228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-647e53ad-af12-4232-9b23-3c017cc8e882 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:06.394777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-647e53ad-af12-4232-9b23-3c017cc8e882 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:06.395225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-647e53ad-af12-4232-9b23-3c017cc8e882 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:06.396229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-647e53ad-af12-4232-9b23-3c017cc8e882 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:06.396724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-647e53ad-af12-4232-9b23-3c017cc8e882 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:06.397264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-647e53ad-af12-4232-9b23-3c017cc8e882 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:06.414865 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-446fc882-3b6f-4734-a751-148502dbf970 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] HTTP exception thrown: Instance d4363e90-4eb0-487a-a798-7a6d0a613e12 could not be found. Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-446fc882-3b6f-4734-a751-148502dbf970 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Request method failure captured: Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12 HTTP/1.1 Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJL-enRjau5kR7nkRXOXw7yKrk65aFZpEE9m6EMfpB5iUtH7rBaquMwJqGAOIWlMAR-px4w1apd3oSCEQoFMNuPQ6hTIO5xRM0kSemHINZG2yPoX2z5ydMUehr31hntc5DvWt0hSeJiHA68Tmnovh8r0Q_Mtf2pr3eLQeJK1RgnS38o Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.57 Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 313385f79a2148599af2c15696fad11e Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerShowV257Test-1764834529 Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/313385f79a2148599af2c15696fad11e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_313385f79a2148599af2c15696fad11e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/313385f79a2148599af2c15696fad11e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/313385f79a2148599af2c15696fad11e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerShowV257Test-1764834529 Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 313385f79a2148599af2c15696fad11e Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerShowV257Test-1764834529 Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerShowV257Test-1764834529-project Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 2cd92a5e717d4c94b046c0a632bd3ae3 Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerShowV257Test-1764834529-project Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance d4363e90-4eb0-487a-a798-7a6d0a613e12 could not be found. Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'd4363e90-4eb0-487a-a798-7a6d0a613e12'} Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4363e90-4eb0-487a-a798-7a6d0a613e12 could not be found. Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4363e90-4eb0-487a-a798-7a6d0a613e12 could not be found. Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:49:06.417138 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:49:06.433640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:49:06.433640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:49:06.433640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:49:06.433640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:49:06.433640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:49:06.433640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4363e90-4eb0-487a-a798-7a6d0a613e12 could not be found. Sep 07 12:49:06.433640 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:49:06.433640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-446fc882-3b6f-4734-a751-148502dbf970 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] Returning 404 to user: Instance d4363e90-4eb0-487a-a798-7a6d0a613e12 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:49:06.433640 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-446fc882-3b6f-4734-a751-148502dbf970 tempest-ServerShowV257Test-1764834529 tempest-ServerShowV257Test-1764834529-project] 10.222.0.16 "GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12" status: 404 len: 111 microversion: 2.57 time: 0.085052 Sep 07 12:49:06.433640 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1887/3726] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:06 2022] GET /compute/v2.1/servers/d4363e90-4eb0-487a-a798-7a6d0a613e12 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:49:06.438515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4e0bfc64-968b-40b3-a269-aa490873138b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:06.440189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4e0bfc64-968b-40b3-a269-aa490873138b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:06.452136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e0bfc64-968b-40b3-a269-aa490873138b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:06.457194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e0bfc64-968b-40b3-a269-aa490873138b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:06.459979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e0bfc64-968b-40b3-a269-aa490873138b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:06.463014 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e0bfc64-968b-40b3-a269-aa490873138b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:06.463617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e0bfc64-968b-40b3-a269-aa490873138b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:06.466269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e0bfc64-968b-40b3-a269-aa490873138b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:06.784087 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4e0bfc64-968b-40b3-a269-aa490873138b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.363169 Sep 07 12:49:06.799087 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1888/3727] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Sep 7 12:49:06 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a/os-interface => generated 1831 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:49:06.819253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-78f253e9-3a53-43e1-b630-d8f04196e934 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:06.820386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-78f253e9-3a53-43e1-b630-d8f04196e934 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] [instance: bf13a2d3-c288-435f-a0ae-b47b19839312] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:06.845513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:49:06.851585 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78f253e9-3a53-43e1-b630-d8f04196e934 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:06.852666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78f253e9-3a53-43e1-b630-d8f04196e934 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:06.853721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78f253e9-3a53-43e1-b630-d8f04196e934 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:06.855427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78f253e9-3a53-43e1-b630-d8f04196e934 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:06.857584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78f253e9-3a53-43e1-b630-d8f04196e934 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:06.858382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-647e53ad-af12-4232-9b23-3c017cc8e882 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:06.860873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78f253e9-3a53-43e1-b630-d8f04196e934 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:06.874439 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-647e53ad-af12-4232-9b23-3c017cc8e882 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.526726 Sep 07 12:49:06.885923 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1840/3728] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:06 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:06.885923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0d48fd01-cf03-4de6-b474-24ab3d305c43 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:06.885923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0d48fd01-cf03-4de6-b474-24ab3d305c43 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:06.907743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d48fd01-cf03-4de6-b474-24ab3d305c43 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:06.908439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d48fd01-cf03-4de6-b474-24ab3d305c43 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:06.912403 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d48fd01-cf03-4de6-b474-24ab3d305c43 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:06.912727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d48fd01-cf03-4de6-b474-24ab3d305c43 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:06.913443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d48fd01-cf03-4de6-b474-24ab3d305c43 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:06.913974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0d48fd01-cf03-4de6-b474-24ab3d305c43 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:06.958674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-78f253e9-3a53-43e1-b630-d8f04196e934 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] [instance: bf13a2d3-c288-435f-a0ae-b47b19839312] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:49:07.042829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0d48fd01-cf03-4de6-b474-24ab3d305c43 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:07.062654 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0d48fd01-cf03-4de6-b474-24ab3d305c43 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1248 microversion: 2.1 time: 0.183274 Sep 07 12:49:07.064506 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1841/3729] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:06 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1248 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:07.075213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fa9a0647-4561-4a7d-b7ca-ab01fce6d2c8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:07.077104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fa9a0647-4561-4a7d-b7ca-ab01fce6d2c8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:07.093126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa9a0647-4561-4a7d-b7ca-ab01fce6d2c8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:07.094849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa9a0647-4561-4a7d-b7ca-ab01fce6d2c8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:07.096215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa9a0647-4561-4a7d-b7ca-ab01fce6d2c8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:07.098002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa9a0647-4561-4a7d-b7ca-ab01fce6d2c8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:07.099805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa9a0647-4561-4a7d-b7ca-ab01fce6d2c8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:07.100977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa9a0647-4561-4a7d-b7ca-ab01fce6d2c8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:07.158831 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-78f253e9-3a53-43e1-b630-d8f04196e934 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312" status: 204 len: 0 microversion: 2.26 time: 0.357116 Sep 07 12:49:07.163188 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1889/3730] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 12:49:06 2022] DELETE /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:49:07.174979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e8d3657a-a711-4e4b-9c6c-11618c3f1960 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1384144282", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ec69cf0d-62d0-4d8e-b15a-13645e6a9f48"}, {"port": "52acc413-bd10-4aa6-9f53-f86a0cad3f9b", "tag": "port-1"}, {"port": "ac84729b-c148-47a6-8ee7-4895a2aef8ac", "tag": "port-2"}, {"uuid": "8abeec9d-7db7-4209-b9e5-a6ca616b1c21", "tag": "net-1"}, {"uuid": "8abeec9d-7db7-4209-b9e5-a6ca616b1c21"}, {"uuid": "d3ed8851-f358-4f5b-b997-5fb9e43f8df1", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "d3ed8851-f358-4f5b-b997-5fb9e43f8df1", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "2f2caec4-5ae8-415f-a6fd-6e0601e9e161", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "34130f44-9fa1-4367-8fc2-76f4c2ab5e1d", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "609d882a-f1bf-409d-aa2d-f366e6cbe096", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1828685699"}], "key_name": "tempest-keypair-1546266145", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:49:07.524943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-e8d3657a-a711-4e4b-9c6c-11618c3f1960 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] validate_networks() for [('ec69cf0d-62d0-4d8e-b15a-13645e6a9f48', None, None, None, None, None), (None, None, '52acc413-bd10-4aa6-9f53-f86a0cad3f9b', None, None, None), (None, None, 'ac84729b-c148-47a6-8ee7-4895a2aef8ac', None, None, None), ('8abeec9d-7db7-4209-b9e5-a6ca616b1c21', None, None, None, None, None), ('8abeec9d-7db7-4209-b9e5-a6ca616b1c21', None, None, None, None, None), ('d3ed8851-f358-4f5b-b997-5fb9e43f8df1', '10.2.2.100', None, None, None, None), ('d3ed8851-f358-4f5b-b997-5fb9e43f8df1', '10.2.2.200', None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:49:07.652513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fa9a0647-4561-4a7d-b7ca-ab01fce6d2c8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:07.669025 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fa9a0647-4561-4a7d-b7ca-ab01fce6d2c8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02" status: 200 len: 1507 microversion: 2.1 time: 0.602265 Sep 07 12:49:07.682114 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1842/3731] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:07 2022] GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02 => generated 1507 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:07.697738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1eb88a5f-c744-4d8e-baa8-77084a970844 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:07.698549 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1eb88a5f-c744-4d8e-baa8-77084a970844 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:07.707102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eb88a5f-c744-4d8e-baa8-77084a970844 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:07.707934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eb88a5f-c744-4d8e-baa8-77084a970844 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:07.708552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eb88a5f-c744-4d8e-baa8-77084a970844 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:07.709513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eb88a5f-c744-4d8e-baa8-77084a970844 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:07.710163 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eb88a5f-c744-4d8e-baa8-77084a970844 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:07.711200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eb88a5f-c744-4d8e-baa8-77084a970844 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:08.195508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1eb88a5f-c744-4d8e-baa8-77084a970844 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:08.221396 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1eb88a5f-c744-4d8e-baa8-77084a970844 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.538236 Sep 07 12:49:08.222265 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1843/3732] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:07 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:08.231075 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-27b66213-5968-4bee-bf43-877f68c089b0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:08.232709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-27b66213-5968-4bee-bf43-877f68c089b0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] [instance: bf13a2d3-c288-435f-a0ae-b47b19839312] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:08.244095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27b66213-5968-4bee-bf43-877f68c089b0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:08.245006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27b66213-5968-4bee-bf43-877f68c089b0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:08.245738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27b66213-5968-4bee-bf43-877f68c089b0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:08.247093 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27b66213-5968-4bee-bf43-877f68c089b0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:08.247969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27b66213-5968-4bee-bf43-877f68c089b0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:08.249141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27b66213-5968-4bee-bf43-877f68c089b0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:08.910747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:49:09.093950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-27b66213-5968-4bee-bf43-877f68c089b0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:09.118244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-27b66213-5968-4bee-bf43-877f68c089b0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:09.125626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-27b66213-5968-4bee-bf43-877f68c089b0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d8d3e8ed9a14ea6b593d0e199996ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8029a72c23341e9977b259a56b94bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:09.129808 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-27b66213-5968-4bee-bf43-877f68c089b0 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312" status: 200 len: 1553 microversion: 2.26 time: 0.905481 Sep 07 12:49:09.131177 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1844/3733] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:08 2022] GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312 => generated 1553 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:49:09.137987 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7c4190f0-4a84-462e-b2c8-7d265a837435 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:09.139907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7c4190f0-4a84-462e-b2c8-7d265a837435 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 676e42b4-4985-43cc-892b-176e13b341df] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:09.156501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c4190f0-4a84-462e-b2c8-7d265a837435 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:09.157748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c4190f0-4a84-462e-b2c8-7d265a837435 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:09.158466 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c4190f0-4a84-462e-b2c8-7d265a837435 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:09.159724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c4190f0-4a84-462e-b2c8-7d265a837435 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:09.160608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c4190f0-4a84-462e-b2c8-7d265a837435 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:09.161439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c4190f0-4a84-462e-b2c8-7d265a837435 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:09.528854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7c4190f0-4a84-462e-b2c8-7d265a837435 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796a821c4f184a6aac2859bb943f9bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a87170da674037af70fac57a366c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:09.548434 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7c4190f0-4a84-462e-b2c8-7d265a837435 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/676e42b4-4985-43cc-892b-176e13b341df" status: 200 len: 1473 microversion: 2.1 time: 0.415800 Sep 07 12:49:09.549666 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1845/3734] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:09 2022] GET /compute/v2.1/servers/676e42b4-4985-43cc-892b-176e13b341df => generated 1473 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:09.555331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-70c70b32-9a07-4086-b68d-1d943ba3f9a6 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:49:09.558384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-70c70b32-9a07-4086-b68d-1d943ba3f9a6 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:09.570058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70c70b32-9a07-4086-b68d-1d943ba3f9a6 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:09.570762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70c70b32-9a07-4086-b68d-1d943ba3f9a6 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:09.571355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70c70b32-9a07-4086-b68d-1d943ba3f9a6 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:09.572536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70c70b32-9a07-4086-b68d-1d943ba3f9a6 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:09.573189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70c70b32-9a07-4086-b68d-1d943ba3f9a6 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:09.573663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70c70b32-9a07-4086-b68d-1d943ba3f9a6 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:09.708646 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-70c70b32-9a07-4086-b68d-1d943ba3f9a6 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "PUT /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02" status: 200 len: 1079 microversion: 2.1 time: 0.157443 Sep 07 12:49:09.709270 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1846/3735] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Sep 7 12:49:09 2022] PUT /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02 => generated 1079 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:09.716299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-995f2061-e07a-4cff-9d01-73a7c018bfec tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:09.717455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-995f2061-e07a-4cff-9d01-73a7c018bfec tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:09.747662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-995f2061-e07a-4cff-9d01-73a7c018bfec tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:09.749028 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-995f2061-e07a-4cff-9d01-73a7c018bfec tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:09.750012 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-995f2061-e07a-4cff-9d01-73a7c018bfec tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:09.751372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-995f2061-e07a-4cff-9d01-73a7c018bfec tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:09.763352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-995f2061-e07a-4cff-9d01-73a7c018bfec tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:09.763352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-995f2061-e07a-4cff-9d01-73a7c018bfec tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:09.895872 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-995f2061-e07a-4cff-9d01-73a7c018bfec tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:09.907362 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-995f2061-e07a-4cff-9d01-73a7c018bfec tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1296 microversion: 2.1 time: 0.196898 Sep 07 12:49:09.909267 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1847/3736] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:09 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1296 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:10.355445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b04f50f1-41ed-4f0d-8bd6-01856e251281 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:10.356005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b04f50f1-41ed-4f0d-8bd6-01856e251281 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:10.373621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b04f50f1-41ed-4f0d-8bd6-01856e251281 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:10.374203 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b04f50f1-41ed-4f0d-8bd6-01856e251281 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:10.374848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b04f50f1-41ed-4f0d-8bd6-01856e251281 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:10.377566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b04f50f1-41ed-4f0d-8bd6-01856e251281 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:10.378044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b04f50f1-41ed-4f0d-8bd6-01856e251281 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:10.380694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b04f50f1-41ed-4f0d-8bd6-01856e251281 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:11.096296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b04f50f1-41ed-4f0d-8bd6-01856e251281 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:11.113581 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b04f50f1-41ed-4f0d-8bd6-01856e251281 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 1.202139 Sep 07 12:49:11.128072 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1848/3737] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:09 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:11.425106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-caabad61-90a4-4d42-a5eb-798c95e5cb4a req-ef1985a2-bd53-419f-a4d9-8199ce39877d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f90d70b2-052c-4840-8008-9d9b2b08772a", "tag": "c36949c2-d7d4-432d-beb4-1b6f8be02a34"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:49:11.437571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-caabad61-90a4-4d42-a5eb-798c95e5cb4a req-ef1985a2-bd53-419f-a4d9-8199ce39877d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:11.438431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-caabad61-90a4-4d42-a5eb-798c95e5cb4a req-ef1985a2-bd53-419f-a4d9-8199ce39877d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:11.438965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-caabad61-90a4-4d42-a5eb-798c95e5cb4a req-ef1985a2-bd53-419f-a4d9-8199ce39877d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:11.444146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:DELETE=1,nova_cell1:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:49:11.456019 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-caabad61-90a4-4d42-a5eb-798c95e5cb4a req-ef1985a2-bd53-419f-a4d9-8199ce39877d service nova] Creating event network-changed:c36949c2-d7d4-432d-beb4-1b6f8be02a34 for instance f90d70b2-052c-4840-8008-9d9b2b08772a on n-h2-852087-9 Sep 07 12:49:11.463120 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-caabad61-90a4-4d42-a5eb-798c95e5cb4a req-ef1985a2-bd53-419f-a4d9-8199ce39877d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.319807 Sep 07 12:49:11.464504 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1849/3738] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:49:11.474549 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad5a5e8d-fc43-40a0-bd7b-ffe4e5ee3ca8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:11.476672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ad5a5e8d-fc43-40a0-bd7b-ffe4e5ee3ca8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:11.486774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad5a5e8d-fc43-40a0-bd7b-ffe4e5ee3ca8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:11.487572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad5a5e8d-fc43-40a0-bd7b-ffe4e5ee3ca8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:11.488327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad5a5e8d-fc43-40a0-bd7b-ffe4e5ee3ca8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:11.489546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad5a5e8d-fc43-40a0-bd7b-ffe4e5ee3ca8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:11.490215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad5a5e8d-fc43-40a0-bd7b-ffe4e5ee3ca8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:11.490991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad5a5e8d-fc43-40a0-bd7b-ffe4e5ee3ca8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:12.042190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ad5a5e8d-fc43-40a0-bd7b-ffe4e5ee3ca8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:12.063832 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ad5a5e8d-fc43-40a0-bd7b-ffe4e5ee3ca8 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02" status: 200 len: 1505 microversion: 2.1 time: 0.596745 Sep 07 12:49:12.078245 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1850/3739] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:11 2022] GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02 => generated 1505 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:12.083941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e13ed07-162b-428b-8ee9-d294148e36a2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:12.086366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6e13ed07-162b-428b-8ee9-d294148e36a2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] [instance: bf13a2d3-c288-435f-a0ae-b47b19839312] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:12.104991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e13ed07-162b-428b-8ee9-d294148e36a2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:12.108066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e13ed07-162b-428b-8ee9-d294148e36a2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:12.109146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e13ed07-162b-428b-8ee9-d294148e36a2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:12.111764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e13ed07-162b-428b-8ee9-d294148e36a2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:12.113777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e13ed07-162b-428b-8ee9-d294148e36a2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:12.115875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e13ed07-162b-428b-8ee9-d294148e36a2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:12.147193 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-6e13ed07-162b-428b-8ee9-d294148e36a2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] HTTP exception thrown: Instance bf13a2d3-c288-435f-a0ae-b47b19839312 could not be found. Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e13ed07-162b-428b-8ee9-d294148e36a2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Request method failure captured: Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312 HTTP/1.1 Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJMNeoDhRE6BwftUBqXF3PzuQe7y1Zh-vVB7MXKp-1Fr2yZpqSiM7cpYwL0i3ZxeTn_TfMgG81rZip5o5ot2i46pOVgcrWU4qbn5sJNrhbxCmMdrqSHb3YrBudm-ARTwwiSNZ1-Noy0eMQ0HuJxhFPnIPRuPzpxo_jKpeKOOzvhP2G4 Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.26 Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: d8029a72c23341e9977b259a56b94bd2 Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerTagsTestJSON-2109268797 Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d8029a72c23341e9977b259a56b94bd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d8029a72c23341e9977b259a56b94bd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d8029a72c23341e9977b259a56b94bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d8029a72c23341e9977b259a56b94bd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerTagsTestJSON-2109268797 Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: d8029a72c23341e9977b259a56b94bd2 Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerTagsTestJSON-2109268797 Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerTagsTestJSON-2109268797-project Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 0d8d3e8ed9a14ea6b593d0e199996ab3 Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerTagsTestJSON-2109268797-project Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance bf13a2d3-c288-435f-a0ae-b47b19839312 could not be found. Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'bf13a2d3-c288-435f-a0ae-b47b19839312'} Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf13a2d3-c288-435f-a0ae-b47b19839312 could not be found. Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf13a2d3-c288-435f-a0ae-b47b19839312 could not be found. Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:49:12.150926 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:12.159812 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:49:12.159812 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:49:12.159812 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:49:12.159812 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:49:12.159812 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:49:12.159812 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf13a2d3-c288-435f-a0ae-b47b19839312 could not be found. Sep 07 12:49:12.159812 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:12.163256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e13ed07-162b-428b-8ee9-d294148e36a2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] Returning 404 to user: Instance bf13a2d3-c288-435f-a0ae-b47b19839312 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:49:12.164864 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6e13ed07-162b-428b-8ee9-d294148e36a2 tempest-ServerTagsTestJSON-2109268797 tempest-ServerTagsTestJSON-2109268797-project] 10.222.0.16 "GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312" status: 404 len: 111 microversion: 2.26 time: 0.093532 Sep 07 12:49:12.166911 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1851/3740] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:12 2022] GET /compute/v2.1/servers/bf13a2d3-c288-435f-a0ae-b47b19839312 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:49:12.278151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-6967f75d-35e4-468b-8e2f-e21525638617 req-ffc353b6-3539-4fb4-8682-fe5518e8b831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "676e42b4-4985-43cc-892b-176e13b341df", "name": "network-vif-deleted", "tag": "8973b130-dd43-4a93-b14e-3d7f5131cd14"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:49:12.299186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6967f75d-35e4-468b-8e2f-e21525638617 req-ffc353b6-3539-4fb4-8682-fe5518e8b831 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:12.300210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6967f75d-35e4-468b-8e2f-e21525638617 req-ffc353b6-3539-4fb4-8682-fe5518e8b831 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:12.300981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6967f75d-35e4-468b-8e2f-e21525638617 req-ffc353b6-3539-4fb4-8682-fe5518e8b831 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:12.325705 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-6967f75d-35e4-468b-8e2f-e21525638617 req-ffc353b6-3539-4fb4-8682-fe5518e8b831 service nova] Creating event network-vif-deleted:8973b130-dd43-4a93-b14e-3d7f5131cd14 for instance 676e42b4-4985-43cc-892b-176e13b341df on n-h2-852087-9 Sep 07 12:49:12.335442 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-6967f75d-35e4-468b-8e2f-e21525638617 req-ffc353b6-3539-4fb4-8682-fe5518e8b831 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166304 Sep 07 12:49:12.336507 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1852/3741] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:49:12.344810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-afda38ee-adfc-473e-ab4a-c8833d1728ff tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:12.345580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-afda38ee-adfc-473e-ab4a-c8833d1728ff tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] [instance: 676e42b4-4985-43cc-892b-176e13b341df] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:12.354438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afda38ee-adfc-473e-ab4a-c8833d1728ff tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:12.355244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afda38ee-adfc-473e-ab4a-c8833d1728ff tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:12.355710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afda38ee-adfc-473e-ab4a-c8833d1728ff tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:12.356433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afda38ee-adfc-473e-ab4a-c8833d1728ff tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:12.356896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afda38ee-adfc-473e-ab4a-c8833d1728ff tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:12.357330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afda38ee-adfc-473e-ab4a-c8833d1728ff tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:12.378552 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-afda38ee-adfc-473e-ab4a-c8833d1728ff tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] HTTP exception thrown: Instance 676e42b4-4985-43cc-892b-176e13b341df could not be found. Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-afda38ee-adfc-473e-ab4a-c8833d1728ff tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Request method failure captured: Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/676e42b4-4985-43cc-892b-176e13b341df HTTP/1.1 Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJJ0F_5ywwEnCZY49KfhwBIy4v_eT2SxOOlhWV1gSKlaL09mnj5YwjmoZ5Ch3zufIICoF9Ekw95NY51MidFkHeRH8dHxNAiuQ7ydTVXYlkBNjtE2CSSTGrC7xLCvaYcP64V19ju4dyCdOaQmmdUJe5wkm_a93K9B7sJTSzR6v5RwRsE Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 48a87170da674037af70fac57a366c7f Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ListImageFiltersTestJSON-1778327409 Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/48a87170da674037af70fac57a366c7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_48a87170da674037af70fac57a366c7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/48a87170da674037af70fac57a366c7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/48a87170da674037af70fac57a366c7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ListImageFiltersTestJSON-1778327409 Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 48a87170da674037af70fac57a366c7f Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1778327409 Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ListImageFiltersTestJSON-1778327409-project Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 796a821c4f184a6aac2859bb943f9bc6 Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ListImageFiltersTestJSON-1778327409-project Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 676e42b4-4985-43cc-892b-176e13b341df could not be found. Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '676e42b4-4985-43cc-892b-176e13b341df'} Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 676e42b4-4985-43cc-892b-176e13b341df could not be found. Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 676e42b4-4985-43cc-892b-176e13b341df could not be found. Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:49:12.380730 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:12.404186 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:49:12.404186 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:49:12.404186 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:49:12.404186 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:49:12.404186 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:49:12.404186 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 676e42b4-4985-43cc-892b-176e13b341df could not be found. Sep 07 12:49:12.404186 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:12.404186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-afda38ee-adfc-473e-ab4a-c8833d1728ff tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Returning 404 to user: Instance 676e42b4-4985-43cc-892b-176e13b341df could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:49:12.404186 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-afda38ee-adfc-473e-ab4a-c8833d1728ff tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "GET /compute/v2.1/servers/676e42b4-4985-43cc-892b-176e13b341df" status: 404 len: 111 microversion: 2.1 time: 0.044434 Sep 07 12:49:12.404186 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1853/3742] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:12 2022] GET /compute/v2.1/servers/676e42b4-4985-43cc-892b-176e13b341df => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:49:12.404186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8cb0fb41-fbe2-42f5-a5ee-1e2ec45d7c6d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:12.404186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8cb0fb41-fbe2-42f5-a5ee-1e2ec45d7c6d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:12.404186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:49:12.414367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cb0fb41-fbe2-42f5-a5ee-1e2ec45d7c6d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:12.414367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cb0fb41-fbe2-42f5-a5ee-1e2ec45d7c6d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:12.416387 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cb0fb41-fbe2-42f5-a5ee-1e2ec45d7c6d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:12.417121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cb0fb41-fbe2-42f5-a5ee-1e2ec45d7c6d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:12.418165 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cb0fb41-fbe2-42f5-a5ee-1e2ec45d7c6d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:12.418834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cb0fb41-fbe2-42f5-a5ee-1e2ec45d7c6d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:12.582332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8cb0fb41-fbe2-42f5-a5ee-1e2ec45d7c6d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:12.601468 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8cb0fb41-fbe2-42f5-a5ee-1e2ec45d7c6d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1302 microversion: 2.1 time: 0.214148 Sep 07 12:49:12.602336 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1854/3743] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:12 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1302 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:12.614077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-897c7d2a-378b-4925-9743-7a2d408dda06 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:12.615484 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-897c7d2a-378b-4925-9743-7a2d408dda06 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:12.635582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-897c7d2a-378b-4925-9743-7a2d408dda06 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:12.636608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-897c7d2a-378b-4925-9743-7a2d408dda06 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:12.637375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-897c7d2a-378b-4925-9743-7a2d408dda06 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:12.638519 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-897c7d2a-378b-4925-9743-7a2d408dda06 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:12.639621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-897c7d2a-378b-4925-9743-7a2d408dda06 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:12.640346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-897c7d2a-378b-4925-9743-7a2d408dda06 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:13.666583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-897c7d2a-378b-4925-9743-7a2d408dda06 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:13.675128 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-897c7d2a-378b-4925-9743-7a2d408dda06 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 1.071253 Sep 07 12:49:13.690044 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1855/3744] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:12 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:13.704731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f7bee37f-c6b2-4946-833a-3461f7250228 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:13.706632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f7bee37f-c6b2-4946-833a-3461f7250228 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:13.713457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f7bee37f-c6b2-4946-833a-3461f7250228 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:13.714291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f7bee37f-c6b2-4946-833a-3461f7250228 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:13.714933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f7bee37f-c6b2-4946-833a-3461f7250228 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:13.716266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f7bee37f-c6b2-4946-833a-3461f7250228 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:13.717596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f7bee37f-c6b2-4946-833a-3461f7250228 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:13.718504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f7bee37f-c6b2-4946-833a-3461f7250228 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:14.208276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f7bee37f-c6b2-4946-833a-3461f7250228 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:14.218499 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f7bee37f-c6b2-4946-833a-3461f7250228 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02" status: 200 len: 1505 microversion: 2.1 time: 0.526901 Sep 07 12:49:14.223851 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1856/3745] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:13 2022] GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02 => generated 1505 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:14.235110 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-54d66ae5-87bd-4b9e-9c10-b67ae5cfe8c7 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc418863700>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:14.864491 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-54d66ae5-87bd-4b9e-9c10-b67ae5cfe8c7 tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "DELETE /compute/v2.1/images/cac5e828-3cc2-4f9a-a61c-c55044456554" status: 204 len: 0 microversion: 2.1 time: 0.638728 Sep 07 12:49:14.865236 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1857/3746] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:14 2022] DELETE /compute/v2.1/images/cac5e828-3cc2-4f9a-a61c-c55044456554 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:49:14.871528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-939095d8-f0d6-4142-9ba3-d78fbc6125dc req-8076c3f0-cf73-4a4a-b314-f904cbfd07e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf13a2d3-c288-435f-a0ae-b47b19839312", "name": "network-vif-deleted", "tag": "ac0d74d3-f3f5-4d6a-a3da-030e64c6e998"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:49:14.884675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-939095d8-f0d6-4142-9ba3-d78fbc6125dc req-8076c3f0-cf73-4a4a-b314-f904cbfd07e0 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:14.891692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-939095d8-f0d6-4142-9ba3-d78fbc6125dc req-8076c3f0-cf73-4a4a-b314-f904cbfd07e0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:14.893856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-939095d8-f0d6-4142-9ba3-d78fbc6125dc req-8076c3f0-cf73-4a4a-b314-f904cbfd07e0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:14.931966 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-939095d8-f0d6-4142-9ba3-d78fbc6125dc req-8076c3f0-cf73-4a4a-b314-f904cbfd07e0 service nova] Creating event network-vif-deleted:ac0d74d3-f3f5-4d6a-a3da-030e64c6e998 for instance bf13a2d3-c288-435f-a0ae-b47b19839312 on n-h1-852087-9 Sep 07 12:49:14.951481 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-939095d8-f0d6-4142-9ba3-d78fbc6125dc req-8076c3f0-cf73-4a4a-b314-f904cbfd07e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083217 Sep 07 12:49:14.958571 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1858/3747] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:49:14.981657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-37283d6f-9a70-42be-bb3b-cd0739631542 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:14.988503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-37283d6f-9a70-42be-bb3b-cd0739631542 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:15.008519 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37283d6f-9a70-42be-bb3b-cd0739631542 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:15.009952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37283d6f-9a70-42be-bb3b-cd0739631542 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:15.012262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37283d6f-9a70-42be-bb3b-cd0739631542 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:15.014112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37283d6f-9a70-42be-bb3b-cd0739631542 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:15.015256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37283d6f-9a70-42be-bb3b-cd0739631542 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:15.016233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37283d6f-9a70-42be-bb3b-cd0739631542 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:15.684690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e8d3657a-a711-4e4b-9c6c-11618c3f1960 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:49:15.686756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e8d3657a-a711-4e4b-9c6c-11618c3f1960 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:49:15.688229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e8d3657a-a711-4e4b-9c6c-11618c3f1960 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:49:15.689247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e8d3657a-a711-4e4b-9c6c-11618c3f1960 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:49:15.690314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e8d3657a-a711-4e4b-9c6c-11618c3f1960 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:49:15.709715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8d3657a-a711-4e4b-9c6c-11618c3f1960 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:15.711070 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8d3657a-a711-4e4b-9c6c-11618c3f1960 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:15.712527 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8d3657a-a711-4e4b-9c6c-11618c3f1960 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:15.714054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8d3657a-a711-4e4b-9c6c-11618c3f1960 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:15.714902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8d3657a-a711-4e4b-9c6c-11618c3f1960 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:15.715963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8d3657a-a711-4e4b-9c6c-11618c3f1960 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:15.757421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:49:15.762805 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e8d3657a-a711-4e4b-9c6c-11618c3f1960 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Getting quotas for project 17c0c643a1704bc2be7aaedfd11802e8. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:49:15.774949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e8d3657a-a711-4e4b-9c6c-11618c3f1960 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Getting quotas for user 9b0cc4dd3ef645b18341a7273cb0522c and project 17c0c643a1704bc2be7aaedfd11802e8. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:49:15.786322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=10 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:49:15.860533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37283d6f-9a70-42be-bb3b-cd0739631542 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:15.875687 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-37283d6f-9a70-42be-bb3b-cd0739631542 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1370 microversion: 2.1 time: 0.912892 Sep 07 12:49:15.877219 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1859/3748] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:14 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1370 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:15.884858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f0537940-a088-4715-ad1b-16ae2b25324e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1202515795", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "49960e13-4e80-4757-a207-47071e716cc5"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:49:16.010928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-f0537940-a088-4715-ad1b-16ae2b25324e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] validate_networks() for [('49960e13-4e80-4757-a207-47071e716cc5', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:49:16.140811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e8d3657a-a711-4e4b-9c6c-11618c3f1960 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:49:16.150484 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e8d3657a-a711-4e4b-9c6c-11618c3f1960 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='2f2caec4-5ae8-415f-a6fd-6e0601e9e161',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='34130f44-9fa1-4367-8fc2-76f4c2ab5e1d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='609d882a-f1bf-409d-aa2d-f366e6cbe096',volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:49:16.838131 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e8d3657a-a711-4e4b-9c6c-11618c3f1960 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 9.672311 Sep 07 12:49:16.840439 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1890/3749] 10.222.0.16 () {62 vars in 1189 bytes} [Wed Sep 7 12:49:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 9676 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 12:49:16.849187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-788207df-42b2-4360-ac0d-2a0e077cf693 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:49:16.852638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-788207df-42b2-4360-ac0d-2a0e077cf693 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:16.867150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-788207df-42b2-4360-ac0d-2a0e077cf693 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:16.867681 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-788207df-42b2-4360-ac0d-2a0e077cf693 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:16.874214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-788207df-42b2-4360-ac0d-2a0e077cf693 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:16.875261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-788207df-42b2-4360-ac0d-2a0e077cf693 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:16.877106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-788207df-42b2-4360-ac0d-2a0e077cf693 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:16.879865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-788207df-42b2-4360-ac0d-2a0e077cf693 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:17.031904 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-788207df-42b2-4360-ac0d-2a0e077cf693 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "PUT /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02" status: 200 len: 1081 microversion: 2.1 time: 0.189003 Sep 07 12:49:17.033564 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1891/3750] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Sep 7 12:49:16 2022] PUT /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02 => generated 1081 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:17.046351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e3585c32-b516-48ae-819d-4e5dd502ff0c tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc4182aa3a0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:17.138667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f0537940-a088-4715-ad1b-16ae2b25324e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:49:17.142841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f0537940-a088-4715-ad1b-16ae2b25324e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:49:17.145171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f0537940-a088-4715-ad1b-16ae2b25324e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:49:17.147643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f0537940-a088-4715-ad1b-16ae2b25324e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:49:17.151055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f0537940-a088-4715-ad1b-16ae2b25324e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:49:17.190366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0537940-a088-4715-ad1b-16ae2b25324e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:17.191883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0537940-a088-4715-ad1b-16ae2b25324e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:17.193065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0537940-a088-4715-ad1b-16ae2b25324e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:17.195514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0537940-a088-4715-ad1b-16ae2b25324e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:17.197358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0537940-a088-4715-ad1b-16ae2b25324e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:17.198703 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0537940-a088-4715-ad1b-16ae2b25324e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:17.243422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-f0537940-a088-4715-ad1b-16ae2b25324e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Getting quotas for project af1de494abea4aa7841c00fb199e8aec. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:49:17.267428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-f0537940-a088-4715-ad1b-16ae2b25324e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Getting quotas for user 22ec4509710f446d843f6882120c5d6e and project af1de494abea4aa7841c00fb199e8aec. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:49:17.296405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f0537940-a088-4715-ad1b-16ae2b25324e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:49:17.302392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f0537940-a088-4715-ad1b-16ae2b25324e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:49:17.453274 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f0537940-a088-4715-ad1b-16ae2b25324e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.574077 Sep 07 12:49:17.466377 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1860/3751] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:49:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:49:17.496507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-740062e5-1519-4b07-8baa-26b0c0e18ac7 req-e1d20548-07a7-43ee-8dc8-90d6803809db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b52328c-937b-46cf-abdf-8629194fc25c", "tag": "3adf0f69-1af4-4072-9454-5e1b89d8b2f7"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:49:17.534563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-740062e5-1519-4b07-8baa-26b0c0e18ac7 req-e1d20548-07a7-43ee-8dc8-90d6803809db service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:17.537568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-740062e5-1519-4b07-8baa-26b0c0e18ac7 req-e1d20548-07a7-43ee-8dc8-90d6803809db service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:17.543201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-740062e5-1519-4b07-8baa-26b0c0e18ac7 req-e1d20548-07a7-43ee-8dc8-90d6803809db service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:17.577786 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-740062e5-1519-4b07-8baa-26b0c0e18ac7 req-e1d20548-07a7-43ee-8dc8-90d6803809db service nova] Creating event network-changed:3adf0f69-1af4-4072-9454-5e1b89d8b2f7 for instance 4b52328c-937b-46cf-abdf-8629194fc25c on n-h1-852087-9 Sep 07 12:49:17.598245 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-740062e5-1519-4b07-8baa-26b0c0e18ac7 req-e1d20548-07a7-43ee-8dc8-90d6803809db service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127607 Sep 07 12:49:17.604392 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1861/3752] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:49:17.612863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c529fb71-a1f4-4b11-be31-02ed0cc4d130 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:17.613618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c529fb71-a1f4-4b11-be31-02ed0cc4d130 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:17.629587 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e3585c32-b516-48ae-819d-4e5dd502ff0c tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "DELETE /compute/v2.1/images/7e891158-bba0-4ba2-9f8e-068767d33973" status: 204 len: 0 microversion: 2.1 time: 0.594122 Sep 07 12:49:17.633667 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1892/3753] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:17 2022] DELETE /compute/v2.1/images/7e891158-bba0-4ba2-9f8e-068767d33973 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:49:17.640179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0210e4e7-03fe-4b30-816c-1b659bd0444a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:17.641880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0210e4e7-03fe-4b30-816c-1b659bd0444a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:17.652060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0210e4e7-03fe-4b30-816c-1b659bd0444a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:17.652729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0210e4e7-03fe-4b30-816c-1b659bd0444a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:17.653611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0210e4e7-03fe-4b30-816c-1b659bd0444a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:17.654419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0210e4e7-03fe-4b30-816c-1b659bd0444a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:17.654991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0210e4e7-03fe-4b30-816c-1b659bd0444a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:17.655955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0210e4e7-03fe-4b30-816c-1b659bd0444a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:17.859127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c529fb71-a1f4-4b11-be31-02ed0cc4d130 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:17.872099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c529fb71-a1f4-4b11-be31-02ed0cc4d130 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:17.878349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c529fb71-a1f4-4b11-be31-02ed0cc4d130 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:17.889128 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c529fb71-a1f4-4b11-be31-02ed0cc4d130 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1286 microversion: 2.32 time: 0.283421 Sep 07 12:49:17.902722 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1862/3754] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:17 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1286 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:49:17.921513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9aabca54-c763-42ca-8daf-66054fedc5e2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:17.922789 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9aabca54-c763-42ca-8daf-66054fedc5e2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:17.931826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9aabca54-c763-42ca-8daf-66054fedc5e2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:17.932762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9aabca54-c763-42ca-8daf-66054fedc5e2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:17.933376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9aabca54-c763-42ca-8daf-66054fedc5e2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:17.934377 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9aabca54-c763-42ca-8daf-66054fedc5e2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:17.935032 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9aabca54-c763-42ca-8daf-66054fedc5e2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:17.935703 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9aabca54-c763-42ca-8daf-66054fedc5e2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:18.209871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0210e4e7-03fe-4b30-816c-1b659bd0444a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:18.221090 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0210e4e7-03fe-4b30-816c-1b659bd0444a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1370 microversion: 2.1 time: 0.585294 Sep 07 12:49:18.229154 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1893/3755] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:17 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1370 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:18.246992 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ee7e19f3-d659-47bb-b857-df994513c673 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:18.247649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ee7e19f3-d659-47bb-b857-df994513c673 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:18.463004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ee7e19f3-d659-47bb-b857-df994513c673 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:18.490311 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ee7e19f3-d659-47bb-b857-df994513c673 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1215 microversion: 2.1 time: 0.259361 Sep 07 12:49:18.495410 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1894/3756] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:18 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1215 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:18.517370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d3db486-6eba-43d2-bf8e-fbc2327771fa tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] Calling method '.version_select at 0x7fc418155af0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:18.557806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9aabca54-c763-42ca-8daf-66054fedc5e2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:18.572388 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9aabca54-c763-42ca-8daf-66054fedc5e2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02" status: 200 len: 1507 microversion: 2.1 time: 0.656062 Sep 07 12:49:18.577282 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1863/3757] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:17 2022] GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02 => generated 1507 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:18.630640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9fc6cebd-1c90-4c02-92a0-c0c304b02f9a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:18.636199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9fc6cebd-1c90-4c02-92a0-c0c304b02f9a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:18.654766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fc6cebd-1c90-4c02-92a0-c0c304b02f9a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:18.655566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fc6cebd-1c90-4c02-92a0-c0c304b02f9a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:18.656497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fc6cebd-1c90-4c02-92a0-c0c304b02f9a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:18.657851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fc6cebd-1c90-4c02-92a0-c0c304b02f9a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:18.671863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fc6cebd-1c90-4c02-92a0-c0c304b02f9a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:18.673029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fc6cebd-1c90-4c02-92a0-c0c304b02f9a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:19.074363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9fc6cebd-1c90-4c02-92a0-c0c304b02f9a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:19.086089 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9fc6cebd-1c90-4c02-92a0-c0c304b02f9a tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02" status: 200 len: 1507 microversion: 2.1 time: 0.464086 Sep 07 12:49:19.087507 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1864/3758] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:18 2022] GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02 => generated 1507 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:19.092928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c3ccdd20-0343-421e-896e-9adb2008994d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:19.094142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c3ccdd20-0343-421e-896e-9adb2008994d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:19.101331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3ccdd20-0343-421e-896e-9adb2008994d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:19.102359 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3ccdd20-0343-421e-896e-9adb2008994d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:19.103089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3ccdd20-0343-421e-896e-9adb2008994d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:19.104117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3ccdd20-0343-421e-896e-9adb2008994d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:19.104940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3ccdd20-0343-421e-896e-9adb2008994d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:19.105686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3ccdd20-0343-421e-896e-9adb2008994d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:19.207466 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1d3db486-6eba-43d2-bf8e-fbc2327771fa tempest-ListImageFiltersTestJSON-1778327409 tempest-ListImageFiltersTestJSON-1778327409-project] 10.222.0.16 "DELETE /compute/v2.1/images/de8f8ae8-8f4d-4c1f-84af-ca4ddbd27865" status: 204 len: 0 microversion: 2.1 time: 0.709598 Sep 07 12:49:19.208517 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1895/3759] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:18 2022] DELETE /compute/v2.1/images/de8f8ae8-8f4d-4c1f-84af-ca4ddbd27865 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:49:19.237894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c3ccdd20-0343-421e-896e-9adb2008994d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:19.241663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a39e92b3-421e-40de-a25b-2db19c177b54 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:19.242580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a39e92b3-421e-40de-a25b-2db19c177b54 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:19.265784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c3ccdd20-0343-421e-896e-9adb2008994d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:19.270315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c3ccdd20-0343-421e-896e-9adb2008994d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:19.273818 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c3ccdd20-0343-421e-896e-9adb2008994d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1528 microversion: 2.32 time: 0.184496 Sep 07 12:49:19.294904 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1865/3760] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:19 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1528 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:49:19.297962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a39e92b3-421e-40de-a25b-2db19c177b54 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:19.300442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a39e92b3-421e-40de-a25b-2db19c177b54 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:19.302480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a39e92b3-421e-40de-a25b-2db19c177b54 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:19.305398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0abdb35e-a53b-49d8-b77f-27e2d812e5df tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:19.305781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a39e92b3-421e-40de-a25b-2db19c177b54 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:19.306234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0abdb35e-a53b-49d8-b77f-27e2d812e5df tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:19.308551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a39e92b3-421e-40de-a25b-2db19c177b54 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:19.313637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a39e92b3-421e-40de-a25b-2db19c177b54 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:19.319472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0abdb35e-a53b-49d8-b77f-27e2d812e5df tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:19.321178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0abdb35e-a53b-49d8-b77f-27e2d812e5df tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:19.321849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0abdb35e-a53b-49d8-b77f-27e2d812e5df tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:19.327846 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0abdb35e-a53b-49d8-b77f-27e2d812e5df tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:19.328233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0abdb35e-a53b-49d8-b77f-27e2d812e5df tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:19.328935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0abdb35e-a53b-49d8-b77f-27e2d812e5df tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:19.620732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0abdb35e-a53b-49d8-b77f-27e2d812e5df tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:19.641476 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0abdb35e-a53b-49d8-b77f-27e2d812e5df tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1370 microversion: 2.1 time: 0.347405 Sep 07 12:49:19.662811 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1866/3761] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:19 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1370 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:19.686736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b6195177-569e-4fba-9470-bf8010ebd4c6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:19.688547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b6195177-569e-4fba-9470-bf8010ebd4c6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:19.701759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6195177-569e-4fba-9470-bf8010ebd4c6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:19.703037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6195177-569e-4fba-9470-bf8010ebd4c6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:19.704150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6195177-569e-4fba-9470-bf8010ebd4c6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:19.705782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6195177-569e-4fba-9470-bf8010ebd4c6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:19.706915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6195177-569e-4fba-9470-bf8010ebd4c6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:19.708223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6195177-569e-4fba-9470-bf8010ebd4c6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:19.989742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b6195177-569e-4fba-9470-bf8010ebd4c6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:20.012458 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b6195177-569e-4fba-9470-bf8010ebd4c6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1267 microversion: 2.1 time: 0.344696 Sep 07 12:49:20.026692 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1867/3762] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:19 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1267 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:20.101762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a39e92b3-421e-40de-a25b-2db19c177b54 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:49:20.282604 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a39e92b3-421e-40de-a25b-2db19c177b54 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02" status: 204 len: 0 microversion: 2.1 time: 1.071734 Sep 07 12:49:20.284977 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1896/3763] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:49:19 2022] DELETE /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02 => generated 0 bytes in 1076 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:49:20.308548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8810f3dd-f4ec-4f6d-bb7f-6ff09a4033d2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:20.309916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8810f3dd-f4ec-4f6d-bb7f-6ff09a4033d2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:20.327906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8810f3dd-f4ec-4f6d-bb7f-6ff09a4033d2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:20.329532 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8810f3dd-f4ec-4f6d-bb7f-6ff09a4033d2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:20.330499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8810f3dd-f4ec-4f6d-bb7f-6ff09a4033d2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:20.333394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f743ea92-59fb-4452-a948-f73599edf606 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:20.334891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f743ea92-59fb-4452-a948-f73599edf606 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:20.335217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8810f3dd-f4ec-4f6d-bb7f-6ff09a4033d2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:20.336405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8810f3dd-f4ec-4f6d-bb7f-6ff09a4033d2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:20.339506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8810f3dd-f4ec-4f6d-bb7f-6ff09a4033d2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:20.370107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f743ea92-59fb-4452-a948-f73599edf606 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:20.371579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f743ea92-59fb-4452-a948-f73599edf606 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:20.372553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f743ea92-59fb-4452-a948-f73599edf606 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:20.376438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f743ea92-59fb-4452-a948-f73599edf606 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:20.377377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f743ea92-59fb-4452-a948-f73599edf606 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:20.381821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f743ea92-59fb-4452-a948-f73599edf606 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:20.439493 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8810f3dd-f4ec-4f6d-bb7f-6ff09a4033d2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:49:20.585151 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.compute.api [None req-8810f3dd-f4ec-4f6d-bb7f-6ff09a4033d2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] Instance is already in deleting state, ignoring this request Sep 07 12:49:20.586076 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8810f3dd-f4ec-4f6d-bb7f-6ff09a4033d2 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02" status: 204 len: 0 microversion: 2.1 time: 0.293833 Sep 07 12:49:20.590900 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1868/3764] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:49:20 2022] DELETE /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 12:49:20.596740 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-60769361-1c35-4a2b-b1bc-fccc8ab57e02 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:20.597519 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-60769361-1c35-4a2b-b1bc-fccc8ab57e02 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:20.598227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f743ea92-59fb-4452-a948-f73599edf606 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:20.605230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60769361-1c35-4a2b-b1bc-fccc8ab57e02 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:20.605831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60769361-1c35-4a2b-b1bc-fccc8ab57e02 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:20.606286 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60769361-1c35-4a2b-b1bc-fccc8ab57e02 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:20.607192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60769361-1c35-4a2b-b1bc-fccc8ab57e02 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:20.607668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60769361-1c35-4a2b-b1bc-fccc8ab57e02 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:20.608109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60769361-1c35-4a2b-b1bc-fccc8ab57e02 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:20.633354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f743ea92-59fb-4452-a948-f73599edf606 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:20.635145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f743ea92-59fb-4452-a948-f73599edf606 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:20.636436 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f743ea92-59fb-4452-a948-f73599edf606 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1576 microversion: 2.32 time: 0.324572 Sep 07 12:49:20.642580 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1897/3765] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:20 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1576 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:49:20.694870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-045c351f-ab22-4c82-80b1-593a30c82a8c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:20.695543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-045c351f-ab22-4c82-80b1-593a30c82a8c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:20.709963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-045c351f-ab22-4c82-80b1-593a30c82a8c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:20.712755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-045c351f-ab22-4c82-80b1-593a30c82a8c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:20.714372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-045c351f-ab22-4c82-80b1-593a30c82a8c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:20.718492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-045c351f-ab22-4c82-80b1-593a30c82a8c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:20.719473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-045c351f-ab22-4c82-80b1-593a30c82a8c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:20.724240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-045c351f-ab22-4c82-80b1-593a30c82a8c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:21.079155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-60769361-1c35-4a2b-b1bc-fccc8ab57e02 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:21.101313 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-60769361-1c35-4a2b-b1bc-fccc8ab57e02 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02" status: 200 len: 1513 microversion: 2.1 time: 0.508808 Sep 07 12:49:21.115823 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1869/3766] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:20 2022] GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02 => generated 1513 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:21.124929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9348d878-5981-48e1-9bae-f1614f630cfd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:21.124929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9348d878-5981-48e1-9bae-f1614f630cfd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:21.136032 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9348d878-5981-48e1-9bae-f1614f630cfd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:21.139004 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9348d878-5981-48e1-9bae-f1614f630cfd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:21.139794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9348d878-5981-48e1-9bae-f1614f630cfd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:21.141157 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9348d878-5981-48e1-9bae-f1614f630cfd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:21.141374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9348d878-5981-48e1-9bae-f1614f630cfd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:21.141808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9348d878-5981-48e1-9bae-f1614f630cfd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:21.414400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9348d878-5981-48e1-9bae-f1614f630cfd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:21.423299 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9348d878-5981-48e1-9bae-f1614f630cfd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1275 microversion: 2.1 time: 0.319516 Sep 07 12:49:21.428901 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1870/3767] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:21 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1275 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:21.488637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-045c351f-ab22-4c82-80b1-593a30c82a8c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:21.510042 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-045c351f-ab22-4c82-80b1-593a30c82a8c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1370 microversion: 2.1 time: 0.821402 Sep 07 12:49:21.512289 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1898/3768] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:20 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1370 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:49:21.689567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4be2558b-1d3d-4fa3-bd01-a2c0c78db3b4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:21.690097 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4be2558b-1d3d-4fa3-bd01-a2c0c78db3b4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:21.703020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4be2558b-1d3d-4fa3-bd01-a2c0c78db3b4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:21.703536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4be2558b-1d3d-4fa3-bd01-a2c0c78db3b4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:21.703990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4be2558b-1d3d-4fa3-bd01-a2c0c78db3b4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:21.704706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4be2558b-1d3d-4fa3-bd01-a2c0c78db3b4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:21.705287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4be2558b-1d3d-4fa3-bd01-a2c0c78db3b4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:21.705683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4be2558b-1d3d-4fa3-bd01-a2c0c78db3b4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:21.719694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:49:22.020540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4be2558b-1d3d-4fa3-bd01-a2c0c78db3b4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:22.040702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4be2558b-1d3d-4fa3-bd01-a2c0c78db3b4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:22.042439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4be2558b-1d3d-4fa3-bd01-a2c0c78db3b4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:22.069869 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4be2558b-1d3d-4fa3-bd01-a2c0c78db3b4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1576 microversion: 2.32 time: 0.378703 Sep 07 12:49:22.114788 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1871/3769] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:21 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1576 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:49:22.133268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a7d5fb98-8af1-4d83-8595-a27f253cafd7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:22.134082 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a7d5fb98-8af1-4d83-8595-a27f253cafd7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:22.147597 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7d5fb98-8af1-4d83-8595-a27f253cafd7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:22.148139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7d5fb98-8af1-4d83-8595-a27f253cafd7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:22.148603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7d5fb98-8af1-4d83-8595-a27f253cafd7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:22.170153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7d5fb98-8af1-4d83-8595-a27f253cafd7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:22.172533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7d5fb98-8af1-4d83-8595-a27f253cafd7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:22.173350 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7d5fb98-8af1-4d83-8595-a27f253cafd7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:22.468599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-97bab56e-033a-4516-ad11-f1e6ad80c491 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:22.469338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-97bab56e-033a-4516-ad11-f1e6ad80c491 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:22.490567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97bab56e-033a-4516-ad11-f1e6ad80c491 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:22.490851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97bab56e-033a-4516-ad11-f1e6ad80c491 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:22.503819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97bab56e-033a-4516-ad11-f1e6ad80c491 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:22.509453 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97bab56e-033a-4516-ad11-f1e6ad80c491 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:22.511011 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97bab56e-033a-4516-ad11-f1e6ad80c491 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:22.513806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97bab56e-033a-4516-ad11-f1e6ad80c491 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:22.530807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a7d5fb98-8af1-4d83-8595-a27f253cafd7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:22.539336 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a7d5fb98-8af1-4d83-8595-a27f253cafd7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02" status: 200 len: 1513 microversion: 2.1 time: 0.410415 Sep 07 12:49:22.539930 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1899/3770] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:22 2022] GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02 => generated 1513 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:49:22.556196 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c4d1c31f-3117-47a3-9842-9b000c3acf76 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:22.556841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c4d1c31f-3117-47a3-9842-9b000c3acf76 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:22.578890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4d1c31f-3117-47a3-9842-9b000c3acf76 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:22.579489 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4d1c31f-3117-47a3-9842-9b000c3acf76 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:22.579959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4d1c31f-3117-47a3-9842-9b000c3acf76 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:22.580780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4d1c31f-3117-47a3-9842-9b000c3acf76 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:22.581276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4d1c31f-3117-47a3-9842-9b000c3acf76 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:22.602483 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4d1c31f-3117-47a3-9842-9b000c3acf76 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:22.657740 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-97bab56e-033a-4516-ad11-f1e6ad80c491 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:22.670032 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-97bab56e-033a-4516-ad11-f1e6ad80c491 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1275 microversion: 2.1 time: 0.205756 Sep 07 12:49:22.670654 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1872/3771] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:22 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1275 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:49:23.164257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-42034159-b307-49cb-a076-f550371ca397 tempest-AbsoluteLimitsTestJSON-581111787 tempest-AbsoluteLimitsTestJSON-581111787-project] Calling method '.version_select at 0x7fc418863d30>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:23.186028 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42034159-b307-49cb-a076-f550371ca397 tempest-AbsoluteLimitsTestJSON-581111787 tempest-AbsoluteLimitsTestJSON-581111787-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:23.187091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42034159-b307-49cb-a076-f550371ca397 tempest-AbsoluteLimitsTestJSON-581111787 tempest-AbsoluteLimitsTestJSON-581111787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:23.188961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42034159-b307-49cb-a076-f550371ca397 tempest-AbsoluteLimitsTestJSON-581111787 tempest-AbsoluteLimitsTestJSON-581111787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:23.190648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42034159-b307-49cb-a076-f550371ca397 tempest-AbsoluteLimitsTestJSON-581111787 tempest-AbsoluteLimitsTestJSON-581111787-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:23.191846 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42034159-b307-49cb-a076-f550371ca397 tempest-AbsoluteLimitsTestJSON-581111787 tempest-AbsoluteLimitsTestJSON-581111787-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:23.192636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42034159-b307-49cb-a076-f550371ca397 tempest-AbsoluteLimitsTestJSON-581111787 tempest-AbsoluteLimitsTestJSON-581111787-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:23.260123 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-42034159-b307-49cb-a076-f550371ca397 tempest-AbsoluteLimitsTestJSON-581111787 tempest-AbsoluteLimitsTestJSON-581111787-project] 10.222.0.16 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.410761 Sep 07 12:49:23.261906 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1873/3772] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 12:49:22 2022] GET /compute/v2.1/limits => generated 511 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:49:23.271228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b2297894-2ea7-45ba-b2b1-2723f413e6c4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:23.272577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b2297894-2ea7-45ba-b2b1-2723f413e6c4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:23.295040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2297894-2ea7-45ba-b2b1-2723f413e6c4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:23.297292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2297894-2ea7-45ba-b2b1-2723f413e6c4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:23.301608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2297894-2ea7-45ba-b2b1-2723f413e6c4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:23.305296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2297894-2ea7-45ba-b2b1-2723f413e6c4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:23.305766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2297894-2ea7-45ba-b2b1-2723f413e6c4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:23.307815 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2297894-2ea7-45ba-b2b1-2723f413e6c4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:24.327959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b2297894-2ea7-45ba-b2b1-2723f413e6c4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:24.349841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b2297894-2ea7-45ba-b2b1-2723f413e6c4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:24.371319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b2297894-2ea7-45ba-b2b1-2723f413e6c4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:24.382739 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b2297894-2ea7-45ba-b2b1-2723f413e6c4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1576 microversion: 2.32 time: 1.119157 Sep 07 12:49:24.383351 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1874/3773] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:23 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1576 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:49:24.421273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ec982c3f-ad21-475b-99ab-ba1f8b0e64c1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:24.431816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ec982c3f-ad21-475b-99ab-ba1f8b0e64c1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:24.463883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec982c3f-ad21-475b-99ab-ba1f8b0e64c1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:24.470967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec982c3f-ad21-475b-99ab-ba1f8b0e64c1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:24.475922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec982c3f-ad21-475b-99ab-ba1f8b0e64c1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:24.481022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec982c3f-ad21-475b-99ab-ba1f8b0e64c1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:24.482545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec982c3f-ad21-475b-99ab-ba1f8b0e64c1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:24.488434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec982c3f-ad21-475b-99ab-ba1f8b0e64c1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:24.928160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c4d1c31f-3117-47a3-9842-9b000c3acf76 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:24.939627 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c4d1c31f-3117-47a3-9842-9b000c3acf76 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1370 microversion: 2.1 time: 2.387792 Sep 07 12:49:24.950052 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1900/3774] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:22 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1370 bytes in 2399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:49:24.956190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6610e6b3-b2e1-48eb-9d2b-6b8c14eda946 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:24.959610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6610e6b3-b2e1-48eb-9d2b-6b8c14eda946 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:24.975270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6610e6b3-b2e1-48eb-9d2b-6b8c14eda946 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:24.981057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6610e6b3-b2e1-48eb-9d2b-6b8c14eda946 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:24.981904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6610e6b3-b2e1-48eb-9d2b-6b8c14eda946 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:24.983206 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6610e6b3-b2e1-48eb-9d2b-6b8c14eda946 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:24.984105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6610e6b3-b2e1-48eb-9d2b-6b8c14eda946 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:24.984751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6610e6b3-b2e1-48eb-9d2b-6b8c14eda946 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:25.233013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6610e6b3-b2e1-48eb-9d2b-6b8c14eda946 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:25.246470 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6610e6b3-b2e1-48eb-9d2b-6b8c14eda946 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1273 microversion: 2.1 time: 0.294696 Sep 07 12:49:25.257372 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1901/3775] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:24 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1273 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:25.368337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ec982c3f-ad21-475b-99ab-ba1f8b0e64c1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:25.400315 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ec982c3f-ad21-475b-99ab-ba1f8b0e64c1 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02" status: 200 len: 1513 microversion: 2.1 time: 1.012472 Sep 07 12:49:25.429591 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1875/3776] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:24 2022] GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02 => generated 1513 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:25.443841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-283d31cd-2f23-4796-8739-d38a25a5c5d4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:25.445523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-283d31cd-2f23-4796-8739-d38a25a5c5d4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:25.475330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-283d31cd-2f23-4796-8739-d38a25a5c5d4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:25.475849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-283d31cd-2f23-4796-8739-d38a25a5c5d4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:25.477636 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-283d31cd-2f23-4796-8739-d38a25a5c5d4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:25.478809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-283d31cd-2f23-4796-8739-d38a25a5c5d4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:25.479515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-283d31cd-2f23-4796-8739-d38a25a5c5d4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:25.479960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-283d31cd-2f23-4796-8739-d38a25a5c5d4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:25.655337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-283d31cd-2f23-4796-8739-d38a25a5c5d4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:25.667209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-283d31cd-2f23-4796-8739-d38a25a5c5d4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:25.669789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-283d31cd-2f23-4796-8739-d38a25a5c5d4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:25.672593 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-283d31cd-2f23-4796-8739-d38a25a5c5d4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1594 microversion: 2.32 time: 0.239580 Sep 07 12:49:25.692767 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1902/3777] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:25 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1594 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:49:25.967995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-07f8a72b-8b1c-4318-bb2f-7719d6f6d21f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:25.968968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-07f8a72b-8b1c-4318-bb2f-7719d6f6d21f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:25.977574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07f8a72b-8b1c-4318-bb2f-7719d6f6d21f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:25.978521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07f8a72b-8b1c-4318-bb2f-7719d6f6d21f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:25.979146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07f8a72b-8b1c-4318-bb2f-7719d6f6d21f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:25.980206 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07f8a72b-8b1c-4318-bb2f-7719d6f6d21f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:25.980856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07f8a72b-8b1c-4318-bb2f-7719d6f6d21f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:25.981458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07f8a72b-8b1c-4318-bb2f-7719d6f6d21f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:26.282995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4b645a14-431f-4c1e-ac5b-74dd44b260fb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:26.283656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4b645a14-431f-4c1e-ac5b-74dd44b260fb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:26.297411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:49:26.299167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b645a14-431f-4c1e-ac5b-74dd44b260fb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:26.299903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b645a14-431f-4c1e-ac5b-74dd44b260fb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:26.300359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b645a14-431f-4c1e-ac5b-74dd44b260fb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:26.301205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b645a14-431f-4c1e-ac5b-74dd44b260fb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:26.301716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b645a14-431f-4c1e-ac5b-74dd44b260fb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:26.302333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b645a14-431f-4c1e-ac5b-74dd44b260fb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:26.309466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:49:26.612961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4b645a14-431f-4c1e-ac5b-74dd44b260fb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:26.627934 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4b645a14-431f-4c1e-ac5b-74dd44b260fb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1273 microversion: 2.1 time: 0.348883 Sep 07 12:49:26.629229 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1903/3778] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:26 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1273 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:49:26.652454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d7e22f90-bd2a-4002-9808-a25a8e0dffdf tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:26.653984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d7e22f90-bd2a-4002-9808-a25a8e0dffdf tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:26.666362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7e22f90-bd2a-4002-9808-a25a8e0dffdf tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:26.667367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7e22f90-bd2a-4002-9808-a25a8e0dffdf tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:26.669058 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7e22f90-bd2a-4002-9808-a25a8e0dffdf tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:26.670393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7e22f90-bd2a-4002-9808-a25a8e0dffdf tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:26.673794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7e22f90-bd2a-4002-9808-a25a8e0dffdf tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:26.675129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7e22f90-bd2a-4002-9808-a25a8e0dffdf tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:26.871888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-07f8a72b-8b1c-4318-bb2f-7719d6f6d21f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:26.909469 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-07f8a72b-8b1c-4318-bb2f-7719d6f6d21f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1370 microversion: 2.1 time: 0.942981 Sep 07 12:49:26.975334 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1876/3779] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:25 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1370 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:27.008285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e25b72b1-6522-4670-8f7c-2e791023625f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:27.019629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e25b72b1-6522-4670-8f7c-2e791023625f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:27.049440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e25b72b1-6522-4670-8f7c-2e791023625f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:27.050296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e25b72b1-6522-4670-8f7c-2e791023625f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:27.050758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e25b72b1-6522-4670-8f7c-2e791023625f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:27.051536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e25b72b1-6522-4670-8f7c-2e791023625f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:27.052010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e25b72b1-6522-4670-8f7c-2e791023625f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:27.052443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e25b72b1-6522-4670-8f7c-2e791023625f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:27.251911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d7e22f90-bd2a-4002-9808-a25a8e0dffdf tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76fe928bf384b88b8a3ba5e4b9c6232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535596776604720870c42b1a788cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:27.278560 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d7e22f90-bd2a-4002-9808-a25a8e0dffdf tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02" status: 200 len: 1471 microversion: 2.1 time: 0.646784 Sep 07 12:49:27.285968 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1904/3780] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:26 2022] GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02 => generated 1471 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:27.348750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e25b72b1-6522-4670-8f7c-2e791023625f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:27.394890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e25b72b1-6522-4670-8f7c-2e791023625f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:27.403587 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e25b72b1-6522-4670-8f7c-2e791023625f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:27.406898 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e25b72b1-6522-4670-8f7c-2e791023625f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1594 microversion: 2.32 time: 0.429165 Sep 07 12:49:27.411797 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1877/3781] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:26 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1594 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:49:27.438347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-df78da75-a073-4d19-90b1-7174a1cdc99a req-113dae39-afef-4b38-a459-8f740eacd904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6ce007e-728c-4f62-858f-0da8782e1c02", "name": "network-vif-deleted", "tag": "3128b5c0-fe38-43f4-9ae9-be319b69137f"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:49:27.484931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-df78da75-a073-4d19-90b1-7174a1cdc99a req-113dae39-afef-4b38-a459-8f740eacd904 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:27.488790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-df78da75-a073-4d19-90b1-7174a1cdc99a req-113dae39-afef-4b38-a459-8f740eacd904 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:27.489355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-df78da75-a073-4d19-90b1-7174a1cdc99a req-113dae39-afef-4b38-a459-8f740eacd904 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:27.528832 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-df78da75-a073-4d19-90b1-7174a1cdc99a req-113dae39-afef-4b38-a459-8f740eacd904 service nova] Creating event network-vif-deleted:3128b5c0-fe38-43f4-9ae9-be319b69137f for instance a6ce007e-728c-4f62-858f-0da8782e1c02 on n-h2-852087-9 Sep 07 12:49:27.545200 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-df78da75-a073-4d19-90b1-7174a1cdc99a req-113dae39-afef-4b38-a459-8f740eacd904 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129346 Sep 07 12:49:27.549843 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1878/3782] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:49:27.658041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2bae6be9-e91b-41d1-adfa-fff964130fba tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:27.659635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2bae6be9-e91b-41d1-adfa-fff964130fba tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:27.669254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bae6be9-e91b-41d1-adfa-fff964130fba tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:27.670314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bae6be9-e91b-41d1-adfa-fff964130fba tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:27.671244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bae6be9-e91b-41d1-adfa-fff964130fba tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:27.673161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bae6be9-e91b-41d1-adfa-fff964130fba tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:27.674649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bae6be9-e91b-41d1-adfa-fff964130fba tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:27.675330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bae6be9-e91b-41d1-adfa-fff964130fba tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:27.907372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-24930231-234e-46b0-b9b7-cd5f2789d14f req-de4e8ee0-1ee4-4766-ac76-d2030734d226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b52328c-937b-46cf-abdf-8629194fc25c", "name": "network-vif-plugged", "status": "completed", "tag": "3adf0f69-1af4-4072-9454-5e1b89d8b2f7"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:49:27.923836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-24930231-234e-46b0-b9b7-cd5f2789d14f req-de4e8ee0-1ee4-4766-ac76-d2030734d226 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:27.924750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-24930231-234e-46b0-b9b7-cd5f2789d14f req-de4e8ee0-1ee4-4766-ac76-d2030734d226 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:27.925505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-24930231-234e-46b0-b9b7-cd5f2789d14f req-de4e8ee0-1ee4-4766-ac76-d2030734d226 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:27.952884 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-24930231-234e-46b0-b9b7-cd5f2789d14f req-de4e8ee0-1ee4-4766-ac76-d2030734d226 service nova] Creating event network-vif-plugged:3adf0f69-1af4-4072-9454-5e1b89d8b2f7 for instance 4b52328c-937b-46cf-abdf-8629194fc25c on n-h1-852087-9 Sep 07 12:49:27.963984 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-24930231-234e-46b0-b9b7-cd5f2789d14f req-de4e8ee0-1ee4-4766-ac76-d2030734d226 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.676731 Sep 07 12:49:27.968517 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1905/3783] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:49:28.064631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-30029e9c-85d7-4558-825d-c5ea4454d048 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:28.096983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-30029e9c-85d7-4558-825d-c5ea4454d048 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:28.175498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30029e9c-85d7-4558-825d-c5ea4454d048 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:28.178117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30029e9c-85d7-4558-825d-c5ea4454d048 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:28.182244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30029e9c-85d7-4558-825d-c5ea4454d048 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:28.185273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30029e9c-85d7-4558-825d-c5ea4454d048 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:28.191763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30029e9c-85d7-4558-825d-c5ea4454d048 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:28.192826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30029e9c-85d7-4558-825d-c5ea4454d048 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:28.471209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:49:29.248042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2bae6be9-e91b-41d1-adfa-fff964130fba tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:29.303371 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2bae6be9-e91b-41d1-adfa-fff964130fba tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1315 microversion: 2.1 time: 1.652589 Sep 07 12:49:29.305579 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1879/3784] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:27 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1315 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:29.316864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-30029e9c-85d7-4558-825d-c5ea4454d048 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:29.352074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8208313c-9598-47a1-993e-22fa75766960 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:29.366502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8208313c-9598-47a1-993e-22fa75766960 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: a6ce007e-728c-4f62-858f-0da8782e1c02] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:29.413004 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-30029e9c-85d7-4558-825d-c5ea4454d048 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1370 microversion: 2.1 time: 1.359694 Sep 07 12:49:29.421623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8208313c-9598-47a1-993e-22fa75766960 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:29.429602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8208313c-9598-47a1-993e-22fa75766960 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:29.438673 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1906/3785] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:28 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1370 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:29.448371 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b3f4fdfb-45cc-44dc-91b0-f847e7048d04 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:29.449298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b3f4fdfb-45cc-44dc-91b0-f847e7048d04 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:29.454795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8208313c-9598-47a1-993e-22fa75766960 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:29.456400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8208313c-9598-47a1-993e-22fa75766960 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:29.459669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3f4fdfb-45cc-44dc-91b0-f847e7048d04 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:29.460510 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3f4fdfb-45cc-44dc-91b0-f847e7048d04 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:29.461147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3f4fdfb-45cc-44dc-91b0-f847e7048d04 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:29.462439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3f4fdfb-45cc-44dc-91b0-f847e7048d04 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:29.463746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3f4fdfb-45cc-44dc-91b0-f847e7048d04 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:29.464473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b3f4fdfb-45cc-44dc-91b0-f847e7048d04 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:29.464988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8208313c-9598-47a1-993e-22fa75766960 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:29.473385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8208313c-9598-47a1-993e-22fa75766960 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:29.545802 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-8208313c-9598-47a1-993e-22fa75766960 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] HTTP exception thrown: Instance a6ce007e-728c-4f62-858f-0da8782e1c02 could not be found. Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8208313c-9598-47a1-993e-22fa75766960 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Request method failure captured: Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02 HTTP/1.1 Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJJepBULgZtpyXL5AohhsnMxFghDMYGmdNvK1HRg77IMSLrb4KNvRl-DfGsahgtGwALfMW9UanSrsImnyFvj6nfsUgP4kkT4FXBc8Xurj0aSsrREZJ0k5QuoAIFVs6i_m85V8yo4YvoZFDaKU-D9qFYk4FrKRELjq3e99AapP8_sEsg Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: f535596776604720870c42b1a788cb3c Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1773028133 Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f535596776604720870c42b1a788cb3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f535596776604720870c42b1a788cb3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f535596776604720870c42b1a788cb3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f535596776604720870c42b1a788cb3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerDiskConfigTestJSON-1773028133 Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: f535596776604720870c42b1a788cb3c Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1773028133 Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerDiskConfigTestJSON-1773028133-project Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: f76fe928bf384b88b8a3ba5e4b9c6232 Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerDiskConfigTestJSON-1773028133-project Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance a6ce007e-728c-4f62-858f-0da8782e1c02 could not be found. Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'a6ce007e-728c-4f62-858f-0da8782e1c02'} Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6ce007e-728c-4f62-858f-0da8782e1c02 could not be found. Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6ce007e-728c-4f62-858f-0da8782e1c02 could not be found. Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:49:29.547619 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:29.553101 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:49:29.553101 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:49:29.553101 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:49:29.553101 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:49:29.553101 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:49:29.553101 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6ce007e-728c-4f62-858f-0da8782e1c02 could not be found. Sep 07 12:49:29.553101 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:29.554620 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8208313c-9598-47a1-993e-22fa75766960 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Returning 404 to user: Instance a6ce007e-728c-4f62-858f-0da8782e1c02 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:49:29.555787 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8208313c-9598-47a1-993e-22fa75766960 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02" status: 404 len: 111 microversion: 2.1 time: 0.247915 Sep 07 12:49:29.556899 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1880/3786] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:29 2022] GET /compute/v2.1/servers/a6ce007e-728c-4f62-858f-0da8782e1c02 => generated 111 bytes in 250 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:49:29.810368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-36a0e3fe-9b60-4416-b7af-b3952519e89d tempest-AZV2TestJSON-886955114 tempest-AZV2TestJSON-886955114-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:29.812055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36a0e3fe-9b60-4416-b7af-b3952519e89d tempest-AZV2TestJSON-886955114 tempest-AZV2TestJSON-886955114-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:29.813092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36a0e3fe-9b60-4416-b7af-b3952519e89d tempest-AZV2TestJSON-886955114 tempest-AZV2TestJSON-886955114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:29.813814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36a0e3fe-9b60-4416-b7af-b3952519e89d tempest-AZV2TestJSON-886955114 tempest-AZV2TestJSON-886955114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:29.814848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36a0e3fe-9b60-4416-b7af-b3952519e89d tempest-AZV2TestJSON-886955114 tempest-AZV2TestJSON-886955114-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:29.815524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36a0e3fe-9b60-4416-b7af-b3952519e89d tempest-AZV2TestJSON-886955114 tempest-AZV2TestJSON-886955114-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:29.816153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36a0e3fe-9b60-4416-b7af-b3952519e89d tempest-AZV2TestJSON-886955114 tempest-AZV2TestJSON-886955114-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:29.847503 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-36a0e3fe-9b60-4416-b7af-b3952519e89d tempest-AZV2TestJSON-886955114 tempest-AZV2TestJSON-886955114-project] 10.222.0.16 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.289136 Sep 07 12:49:29.848799 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1881/3787] 10.222.0.16 () {58 vars in 1164 bytes} [Wed Sep 7 12:49:29 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:49:29.868608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f5ef9897-c17d-4863-84bf-34e776bc7458 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:29.869454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f5ef9897-c17d-4863-84bf-34e776bc7458 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:29.888618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5ef9897-c17d-4863-84bf-34e776bc7458 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:29.893415 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5ef9897-c17d-4863-84bf-34e776bc7458 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:29.894424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5ef9897-c17d-4863-84bf-34e776bc7458 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:29.895606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5ef9897-c17d-4863-84bf-34e776bc7458 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:29.898871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5ef9897-c17d-4863-84bf-34e776bc7458 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:29.899861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5ef9897-c17d-4863-84bf-34e776bc7458 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:29.942761 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-f5ef9897-c17d-4863-84bf-34e776bc7458 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] HTTP exception thrown: Instance 5203be99-6bdd-42c2-955d-90ce3a228ed3 could not be found. Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f5ef9897-c17d-4863-84bf-34e776bc7458 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Request method failure captured: Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 HTTP/1.1 Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJJepBULgZtpyXL5AohhsnMxFghDMYGmdNvK1HRg77IMSLrb4KNvRl-DfGsahgtGwALfMW9UanSrsImnyFvj6nfsUgP4kkT4FXBc8Xurj0aSsrREZJ0k5QuoAIFVs6i_m85V8yo4YvoZFDaKU-D9qFYk4FrKRELjq3e99AapP8_sEsg Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: f535596776604720870c42b1a788cb3c Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1773028133 Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f535596776604720870c42b1a788cb3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f535596776604720870c42b1a788cb3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f535596776604720870c42b1a788cb3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f535596776604720870c42b1a788cb3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerDiskConfigTestJSON-1773028133 Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: f535596776604720870c42b1a788cb3c Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1773028133 Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerDiskConfigTestJSON-1773028133-project Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: f76fe928bf384b88b8a3ba5e4b9c6232 Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerDiskConfigTestJSON-1773028133-project Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 5203be99-6bdd-42c2-955d-90ce3a228ed3 could not be found. Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '5203be99-6bdd-42c2-955d-90ce3a228ed3'} Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5203be99-6bdd-42c2-955d-90ce3a228ed3 could not be found. Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:49:29.944419 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:49:29.957359 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5203be99-6bdd-42c2-955d-90ce3a228ed3 could not be found. Sep 07 12:49:29.957359 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:29.957359 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:49:29.957359 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:29.957359 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:49:29.957359 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:49:29.957359 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:49:29.957359 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:49:29.957359 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:49:29.957359 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5203be99-6bdd-42c2-955d-90ce3a228ed3 could not be found. Sep 07 12:49:29.957359 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:29.957359 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f5ef9897-c17d-4863-84bf-34e776bc7458 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Returning 404 to user: Instance 5203be99-6bdd-42c2-955d-90ce3a228ed3 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:49:29.957359 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f5ef9897-c17d-4863-84bf-34e776bc7458 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 404 len: 111 microversion: 2.1 time: 0.095489 Sep 07 12:49:29.957359 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1882/3788] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:49:29 2022] DELETE /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:49:30.049566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8803eeed-de16-468f-bc9b-f5e96994811b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-642770557", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "b810bb5d-8084-47d5-9b9e-6ea4661cdf5f"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:49:30.204235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b3f4fdfb-45cc-44dc-91b0-f847e7048d04 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:30.225067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b3f4fdfb-45cc-44dc-91b0-f847e7048d04 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:30.226871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b3f4fdfb-45cc-44dc-91b0-f847e7048d04 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:30.228260 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b3f4fdfb-45cc-44dc-91b0-f847e7048d04 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1662 microversion: 2.32 time: 0.787365 Sep 07 12:49:30.228859 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1907/3789] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:29 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1662 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:49:30.255464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cba56808-31b4-42ad-925c-631453be6da7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:30.258891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cba56808-31b4-42ad-925c-631453be6da7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: 5203be99-6bdd-42c2-955d-90ce3a228ed3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:30.285550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cba56808-31b4-42ad-925c-631453be6da7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:30.286493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cba56808-31b4-42ad-925c-631453be6da7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:30.286968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cba56808-31b4-42ad-925c-631453be6da7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:30.287746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cba56808-31b4-42ad-925c-631453be6da7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:30.288233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cba56808-31b4-42ad-925c-631453be6da7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:30.288676 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cba56808-31b4-42ad-925c-631453be6da7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:30.299359 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-8803eeed-de16-468f-bc9b-f5e96994811b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] validate_networks() for [('b810bb5d-8084-47d5-9b9e-6ea4661cdf5f', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:49:30.331555 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-cba56808-31b4-42ad-925c-631453be6da7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] HTTP exception thrown: Instance 5203be99-6bdd-42c2-955d-90ce3a228ed3 could not be found. Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cba56808-31b4-42ad-925c-631453be6da7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Request method failure captured: Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 HTTP/1.1 Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJJepBULgZtpyXL5AohhsnMxFghDMYGmdNvK1HRg77IMSLrb4KNvRl-DfGsahgtGwALfMW9UanSrsImnyFvj6nfsUgP4kkT4FXBc8Xurj0aSsrREZJ0k5QuoAIFVs6i_m85V8yo4YvoZFDaKU-D9qFYk4FrKRELjq3e99AapP8_sEsg Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: f535596776604720870c42b1a788cb3c Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1773028133 Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f535596776604720870c42b1a788cb3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f535596776604720870c42b1a788cb3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f535596776604720870c42b1a788cb3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f535596776604720870c42b1a788cb3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerDiskConfigTestJSON-1773028133 Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: f535596776604720870c42b1a788cb3c Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1773028133 Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerDiskConfigTestJSON-1773028133-project Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: f76fe928bf384b88b8a3ba5e4b9c6232 Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerDiskConfigTestJSON-1773028133-project Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 5203be99-6bdd-42c2-955d-90ce3a228ed3 could not be found. Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '5203be99-6bdd-42c2-955d-90ce3a228ed3'} Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5203be99-6bdd-42c2-955d-90ce3a228ed3 could not be found. Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5203be99-6bdd-42c2-955d-90ce3a228ed3 could not be found. Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:49:30.343553 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:49:30.365041 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:49:30.365041 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:49:30.365041 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:49:30.365041 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:49:30.365041 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:49:30.365041 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5203be99-6bdd-42c2-955d-90ce3a228ed3 could not be found. Sep 07 12:49:30.365041 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:49:30.365041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cba56808-31b4-42ad-925c-631453be6da7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Returning 404 to user: Instance 5203be99-6bdd-42c2-955d-90ce3a228ed3 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:49:30.365041 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cba56808-31b4-42ad-925c-631453be6da7 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3" status: 404 len: 111 microversion: 2.1 time: 0.098313 Sep 07 12:49:30.365041 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1908/3790] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:30 2022] GET /compute/v2.1/servers/5203be99-6bdd-42c2-955d-90ce3a228ed3 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:49:30.365041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7421bd66-9eb4-4dce-bae4-e03de28ff076 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:30.365041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7421bd66-9eb4-4dce-bae4-e03de28ff076 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:30.372377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7421bd66-9eb4-4dce-bae4-e03de28ff076 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:30.372377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7421bd66-9eb4-4dce-bae4-e03de28ff076 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:30.372377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7421bd66-9eb4-4dce-bae4-e03de28ff076 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:30.373221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7421bd66-9eb4-4dce-bae4-e03de28ff076 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:30.373729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7421bd66-9eb4-4dce-bae4-e03de28ff076 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:30.374752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7421bd66-9eb4-4dce-bae4-e03de28ff076 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:32.286459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8803eeed-de16-468f-bc9b-f5e96994811b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:49:32.288010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8803eeed-de16-468f-bc9b-f5e96994811b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:49:32.288837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8803eeed-de16-468f-bc9b-f5e96994811b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:49:32.289458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8803eeed-de16-468f-bc9b-f5e96994811b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:49:32.290166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8803eeed-de16-468f-bc9b-f5e96994811b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:49:32.311223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8803eeed-de16-468f-bc9b-f5e96994811b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:32.312239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8803eeed-de16-468f-bc9b-f5e96994811b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:32.312886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8803eeed-de16-468f-bc9b-f5e96994811b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:32.318975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8803eeed-de16-468f-bc9b-f5e96994811b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:32.320565 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8803eeed-de16-468f-bc9b-f5e96994811b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:32.321254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8803eeed-de16-468f-bc9b-f5e96994811b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:32.378957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-8803eeed-de16-468f-bc9b-f5e96994811b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Getting quotas for project 8e605280bfcc43c6862a1181dabb3d2f. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:49:32.427076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-8803eeed-de16-468f-bc9b-f5e96994811b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Getting quotas for user 5da37082c7e74cc3be74ce6104983f03 and project 8e605280bfcc43c6862a1181dabb3d2f. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:49:32.484281 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8803eeed-de16-468f-bc9b-f5e96994811b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:49:32.500701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8803eeed-de16-468f-bc9b-f5e96994811b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:49:32.614284 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7421bd66-9eb4-4dce-bae4-e03de28ff076 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:32.625471 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7421bd66-9eb4-4dce-bae4-e03de28ff076 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1315 microversion: 2.1 time: 2.278628 Sep 07 12:49:32.626872 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1909/3791] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:30 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1315 bytes in 2280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:32.648104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c29cf86a-1547-492a-8de7-8a9f89845828 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:32.649181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c29cf86a-1547-492a-8de7-8a9f89845828 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:32.670568 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8803eeed-de16-468f-bc9b-f5e96994811b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.718366 Sep 07 12:49:32.671255 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1883/3792] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:49:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:49:32.683324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c29cf86a-1547-492a-8de7-8a9f89845828 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:32.687722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c29cf86a-1547-492a-8de7-8a9f89845828 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:32.691127 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c29cf86a-1547-492a-8de7-8a9f89845828 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:32.693533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c29cf86a-1547-492a-8de7-8a9f89845828 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:32.694689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c29cf86a-1547-492a-8de7-8a9f89845828 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:32.695433 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c29cf86a-1547-492a-8de7-8a9f89845828 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:32.728247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-75e7942e-9d22-4a42-adcd-aec058f5ffaf tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:32.731145 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-c29cf86a-1547-492a-8de7-8a9f89845828 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] HTTP exception thrown: Instance dc8c812d-29e5-4153-a609-74814c3e7c86 could not be found. Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c29cf86a-1547-492a-8de7-8a9f89845828 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Request method failure captured: Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 HTTP/1.1 Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJJepBULgZtpyXL5AohhsnMxFghDMYGmdNvK1HRg77IMSLrb4KNvRl-DfGsahgtGwALfMW9UanSrsImnyFvj6nfsUgP4kkT4FXBc8Xurj0aSsrREZJ0k5QuoAIFVs6i_m85V8yo4YvoZFDaKU-D9qFYk4FrKRELjq3e99AapP8_sEsg Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: f535596776604720870c42b1a788cb3c Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1773028133 Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f535596776604720870c42b1a788cb3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f535596776604720870c42b1a788cb3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f535596776604720870c42b1a788cb3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f535596776604720870c42b1a788cb3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerDiskConfigTestJSON-1773028133 Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: f535596776604720870c42b1a788cb3c Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1773028133 Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerDiskConfigTestJSON-1773028133-project Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: f76fe928bf384b88b8a3ba5e4b9c6232 Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerDiskConfigTestJSON-1773028133-project Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance dc8c812d-29e5-4153-a609-74814c3e7c86 could not be found. Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'dc8c812d-29e5-4153-a609-74814c3e7c86'} Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc8c812d-29e5-4153-a609-74814c3e7c86 could not be found. Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:49:32.733540 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:49:32.738837 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc8c812d-29e5-4153-a609-74814c3e7c86 could not be found. Sep 07 12:49:32.738837 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:49:32.738837 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:49:32.738837 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:49:32.738837 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:49:32.738837 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:49:32.738837 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:49:32.738837 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:49:32.738837 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:49:32.738837 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc8c812d-29e5-4153-a609-74814c3e7c86 could not be found. Sep 07 12:49:32.738837 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:49:32.742233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-75e7942e-9d22-4a42-adcd-aec058f5ffaf tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:32.749078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c29cf86a-1547-492a-8de7-8a9f89845828 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Returning 404 to user: Instance dc8c812d-29e5-4153-a609-74814c3e7c86 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:49:32.751280 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c29cf86a-1547-492a-8de7-8a9f89845828 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 404 len: 111 microversion: 2.1 time: 0.122768 Sep 07 12:49:32.752719 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1910/3793] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:49:32 2022] DELETE /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:49:32.769203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-22175498-0096-4893-9e17-e1b8a46e6821 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:32.770935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-22175498-0096-4893-9e17-e1b8a46e6821 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:32.775015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75e7942e-9d22-4a42-adcd-aec058f5ffaf tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:32.776824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75e7942e-9d22-4a42-adcd-aec058f5ffaf tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:32.779100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75e7942e-9d22-4a42-adcd-aec058f5ffaf tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:32.783052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75e7942e-9d22-4a42-adcd-aec058f5ffaf tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:32.784731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75e7942e-9d22-4a42-adcd-aec058f5ffaf tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:32.786471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75e7942e-9d22-4a42-adcd-aec058f5ffaf tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:32.795770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22175498-0096-4893-9e17-e1b8a46e6821 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:32.796860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22175498-0096-4893-9e17-e1b8a46e6821 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:32.799506 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22175498-0096-4893-9e17-e1b8a46e6821 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:32.802171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22175498-0096-4893-9e17-e1b8a46e6821 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:32.803109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22175498-0096-4893-9e17-e1b8a46e6821 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:32.809100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22175498-0096-4893-9e17-e1b8a46e6821 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:33.765421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-22175498-0096-4893-9e17-e1b8a46e6821 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:33.779430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-22175498-0096-4893-9e17-e1b8a46e6821 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:33.786877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-22175498-0096-4893-9e17-e1b8a46e6821 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:33.790481 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-22175498-0096-4893-9e17-e1b8a46e6821 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1662 microversion: 2.32 time: 1.035409 Sep 07 12:49:33.815509 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1911/3794] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:32 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1662 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:49:33.828151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3bda255c-9cfd-41a7-a8d0-56053460b2ae tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:33.832086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3bda255c-9cfd-41a7-a8d0-56053460b2ae tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:34.028806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-75e7942e-9d22-4a42-adcd-aec058f5ffaf tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:34.089985 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-75e7942e-9d22-4a42-adcd-aec058f5ffaf tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1563 microversion: 2.1 time: 1.397495 Sep 07 12:49:34.093977 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1884/3795] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:32 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1563 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:34.120827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d51b3d7-614f-4ab2-844a-9d76bedbeb45 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:34.125155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1d51b3d7-614f-4ab2-844a-9d76bedbeb45 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] [instance: dc8c812d-29e5-4153-a609-74814c3e7c86] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:34.160243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d51b3d7-614f-4ab2-844a-9d76bedbeb45 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:34.163092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d51b3d7-614f-4ab2-844a-9d76bedbeb45 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:34.163590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d51b3d7-614f-4ab2-844a-9d76bedbeb45 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:34.169315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d51b3d7-614f-4ab2-844a-9d76bedbeb45 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:34.172183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d51b3d7-614f-4ab2-844a-9d76bedbeb45 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:34.173814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d51b3d7-614f-4ab2-844a-9d76bedbeb45 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:34.238751 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-1d51b3d7-614f-4ab2-844a-9d76bedbeb45 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] HTTP exception thrown: Instance dc8c812d-29e5-4153-a609-74814c3e7c86 could not be found. Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d51b3d7-614f-4ab2-844a-9d76bedbeb45 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Request method failure captured: Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 HTTP/1.1 Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJJepBULgZtpyXL5AohhsnMxFghDMYGmdNvK1HRg77IMSLrb4KNvRl-DfGsahgtGwALfMW9UanSrsImnyFvj6nfsUgP4kkT4FXBc8Xurj0aSsrREZJ0k5QuoAIFVs6i_m85V8yo4YvoZFDaKU-D9qFYk4FrKRELjq3e99AapP8_sEsg Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: f535596776604720870c42b1a788cb3c Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1773028133 Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f535596776604720870c42b1a788cb3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f535596776604720870c42b1a788cb3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f535596776604720870c42b1a788cb3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f535596776604720870c42b1a788cb3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerDiskConfigTestJSON-1773028133 Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: f535596776604720870c42b1a788cb3c Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1773028133 Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerDiskConfigTestJSON-1773028133-project Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: f76fe928bf384b88b8a3ba5e4b9c6232 Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerDiskConfigTestJSON-1773028133-project Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance dc8c812d-29e5-4153-a609-74814c3e7c86 could not be found. Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'dc8c812d-29e5-4153-a609-74814c3e7c86'} Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc8c812d-29e5-4153-a609-74814c3e7c86 could not be found. Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc8c812d-29e5-4153-a609-74814c3e7c86 could not be found. Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:49:34.247461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:34.254250 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:49:34.254250 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:49:34.254250 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:49:34.254250 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:49:34.254250 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:49:34.254250 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc8c812d-29e5-4153-a609-74814c3e7c86 could not be found. Sep 07 12:49:34.254250 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:49:34.266079 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d51b3d7-614f-4ab2-844a-9d76bedbeb45 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] Returning 404 to user: Instance dc8c812d-29e5-4153-a609-74814c3e7c86 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:49:34.275230 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1d51b3d7-614f-4ab2-844a-9d76bedbeb45 tempest-ServerDiskConfigTestJSON-1773028133 tempest-ServerDiskConfigTestJSON-1773028133-project] 10.222.0.16 "GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86" status: 404 len: 111 microversion: 2.1 time: 0.178154 Sep 07 12:49:34.288004 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1885/3796] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:34 2022] GET /compute/v2.1/servers/dc8c812d-29e5-4153-a609-74814c3e7c86 => generated 111 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:49:34.309418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ab5e0bcc-cf56-4bfa-819f-6552fb401327 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:34.310953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ab5e0bcc-cf56-4bfa-819f-6552fb401327 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:34.328795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab5e0bcc-cf56-4bfa-819f-6552fb401327 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:34.329266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab5e0bcc-cf56-4bfa-819f-6552fb401327 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:34.329748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab5e0bcc-cf56-4bfa-819f-6552fb401327 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:34.330505 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab5e0bcc-cf56-4bfa-819f-6552fb401327 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:34.330974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab5e0bcc-cf56-4bfa-819f-6552fb401327 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:34.331405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab5e0bcc-cf56-4bfa-819f-6552fb401327 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:34.390229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3bda255c-9cfd-41a7-a8d0-56053460b2ae tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:34.406709 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3bda255c-9cfd-41a7-a8d0-56053460b2ae tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1216 microversion: 2.1 time: 0.588977 Sep 07 12:49:34.407071 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1912/3797] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:33 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1216 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:34.412770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c6d4b428-bef9-424e-999c-d3299ffc9f1c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:34.425167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c6d4b428-bef9-424e-999c-d3299ffc9f1c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:34.445084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6d4b428-bef9-424e-999c-d3299ffc9f1c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:34.445743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6d4b428-bef9-424e-999c-d3299ffc9f1c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:34.446394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6d4b428-bef9-424e-999c-d3299ffc9f1c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:34.447379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6d4b428-bef9-424e-999c-d3299ffc9f1c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:34.449238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6d4b428-bef9-424e-999c-d3299ffc9f1c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:34.450225 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6d4b428-bef9-424e-999c-d3299ffc9f1c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:34.823421 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c6d4b428-bef9-424e-999c-d3299ffc9f1c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.414839 Sep 07 12:49:34.825248 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1913/3798] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Sep 7 12:49:34 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-interface => generated 284 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:49:34.831433 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-975e5e5b-e928-4dd3-adc1-55fb5ff47a59 req-b132a431-333d-4577-810d-315344aef4dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0983070f-5877-49b6-8e6b-0a2a2471517d", "tag": "a097e437-e2eb-467f-9143-e1c6b1a563aa"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:49:34.861983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-975e5e5b-e928-4dd3-adc1-55fb5ff47a59 req-b132a431-333d-4577-810d-315344aef4dc service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:34.865426 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-975e5e5b-e928-4dd3-adc1-55fb5ff47a59 req-b132a431-333d-4577-810d-315344aef4dc service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:34.869586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-975e5e5b-e928-4dd3-adc1-55fb5ff47a59 req-b132a431-333d-4577-810d-315344aef4dc service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:34.897329 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-975e5e5b-e928-4dd3-adc1-55fb5ff47a59 req-b132a431-333d-4577-810d-315344aef4dc service nova] Creating event network-changed:a097e437-e2eb-467f-9143-e1c6b1a563aa for instance 0983070f-5877-49b6-8e6b-0a2a2471517d on n-h2-852087-9 Sep 07 12:49:34.915929 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-975e5e5b-e928-4dd3-adc1-55fb5ff47a59 req-b132a431-333d-4577-810d-315344aef4dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088803 Sep 07 12:49:34.920431 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1914/3799] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:49:34.947333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d9438ad3-45b6-4e29-a658-a2af42b2a2a1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:34.959309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d9438ad3-45b6-4e29-a658-a2af42b2a2a1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:34.986790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9438ad3-45b6-4e29-a658-a2af42b2a2a1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:34.989599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9438ad3-45b6-4e29-a658-a2af42b2a2a1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:34.991111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9438ad3-45b6-4e29-a658-a2af42b2a2a1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:34.992849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9438ad3-45b6-4e29-a658-a2af42b2a2a1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:34.994760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9438ad3-45b6-4e29-a658-a2af42b2a2a1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:34.995954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9438ad3-45b6-4e29-a658-a2af42b2a2a1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:35.379867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ab5e0bcc-cf56-4bfa-819f-6552fb401327 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:35.392786 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ab5e0bcc-cf56-4bfa-819f-6552fb401327 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1315 microversion: 2.1 time: 1.103183 Sep 07 12:49:35.413080 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1886/3800] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:34 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1315 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:35.438938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3fb46415-bd5e-4267-a7bf-c6a69d59881f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:35.439534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3fb46415-bd5e-4267-a7bf-c6a69d59881f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:35.449309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:49:35.451349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fb46415-bd5e-4267-a7bf-c6a69d59881f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:35.452035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fb46415-bd5e-4267-a7bf-c6a69d59881f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:35.452497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fb46415-bd5e-4267-a7bf-c6a69d59881f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:35.453286 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fb46415-bd5e-4267-a7bf-c6a69d59881f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:35.453800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fb46415-bd5e-4267-a7bf-c6a69d59881f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:35.454229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fb46415-bd5e-4267-a7bf-c6a69d59881f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:35.698567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3fb46415-bd5e-4267-a7bf-c6a69d59881f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:35.714004 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3fb46415-bd5e-4267-a7bf-c6a69d59881f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1286 microversion: 2.1 time: 0.282055 Sep 07 12:49:35.716125 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1887/3801] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:35 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1286 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:35.933717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d9438ad3-45b6-4e29-a658-a2af42b2a2a1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:35.952962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d9438ad3-45b6-4e29-a658-a2af42b2a2a1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:35.955488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d9438ad3-45b6-4e29-a658-a2af42b2a2a1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:35.958968 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d9438ad3-45b6-4e29-a658-a2af42b2a2a1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1709 microversion: 2.32 time: 1.032816 Sep 07 12:49:35.960017 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1915/3802] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:34 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1709 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:49:36.432971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8e031494-d175-49d5-9d62-2cca6138979b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:36.436894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8e031494-d175-49d5-9d62-2cca6138979b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:36.456306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e031494-d175-49d5-9d62-2cca6138979b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:36.457136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e031494-d175-49d5-9d62-2cca6138979b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:36.458536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e031494-d175-49d5-9d62-2cca6138979b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:36.460174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e031494-d175-49d5-9d62-2cca6138979b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:36.461243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e031494-d175-49d5-9d62-2cca6138979b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:36.462175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e031494-d175-49d5-9d62-2cca6138979b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:36.743458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b9ef5543-73a3-42b0-989a-6bdbbbd57924 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:36.744399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b9ef5543-73a3-42b0-989a-6bdbbbd57924 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:36.755348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9ef5543-73a3-42b0-989a-6bdbbbd57924 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:36.756452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9ef5543-73a3-42b0-989a-6bdbbbd57924 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:36.757106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9ef5543-73a3-42b0-989a-6bdbbbd57924 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:36.758608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9ef5543-73a3-42b0-989a-6bdbbbd57924 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:36.759961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9ef5543-73a3-42b0-989a-6bdbbbd57924 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:36.760536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9ef5543-73a3-42b0-989a-6bdbbbd57924 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:36.928819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b9ef5543-73a3-42b0-989a-6bdbbbd57924 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:36.951570 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b9ef5543-73a3-42b0-989a-6bdbbbd57924 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1274 microversion: 2.1 time: 0.211922 Sep 07 12:49:36.953314 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1916/3803] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:36 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1274 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:36.993174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ac75e13d-519d-4e41-8e01-1a2857f879f0 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:36.995185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ac75e13d-519d-4e41-8e01-1a2857f879f0 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:37.000240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:49:37.020735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac75e13d-519d-4e41-8e01-1a2857f879f0 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:37.022977 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac75e13d-519d-4e41-8e01-1a2857f879f0 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:37.024352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac75e13d-519d-4e41-8e01-1a2857f879f0 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:37.026913 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac75e13d-519d-4e41-8e01-1a2857f879f0 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:37.028799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac75e13d-519d-4e41-8e01-1a2857f879f0 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:37.031446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac75e13d-519d-4e41-8e01-1a2857f879f0 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:37.071955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8e031494-d175-49d5-9d62-2cca6138979b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:37.086829 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8e031494-d175-49d5-9d62-2cca6138979b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1315 microversion: 2.1 time: 0.666296 Sep 07 12:49:37.087977 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1888/3804] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:36 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1315 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:37.573255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ac75e13d-519d-4e41-8e01-1a2857f879f0 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:37.608086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ac75e13d-519d-4e41-8e01-1a2857f879f0 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:37.617310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ac75e13d-519d-4e41-8e01-1a2857f879f0 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:37.626634 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ac75e13d-519d-4e41-8e01-1a2857f879f0 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1709 microversion: 2.32 time: 0.635645 Sep 07 12:49:37.629804 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1917/3805] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:36 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1709 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:49:38.001102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3d4f11f5-688b-4db3-bef2-ee28cc21c9d9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:38.006443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3d4f11f5-688b-4db3-bef2-ee28cc21c9d9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:38.047587 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d4f11f5-688b-4db3-bef2-ee28cc21c9d9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:38.052186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d4f11f5-688b-4db3-bef2-ee28cc21c9d9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:38.053278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d4f11f5-688b-4db3-bef2-ee28cc21c9d9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:38.061889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d4f11f5-688b-4db3-bef2-ee28cc21c9d9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:38.063054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d4f11f5-688b-4db3-bef2-ee28cc21c9d9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:38.063884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d4f11f5-688b-4db3-bef2-ee28cc21c9d9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:38.125927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-24cafc02-097d-4fb9-b882-4eca76d0dcff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:38.132294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-24cafc02-097d-4fb9-b882-4eca76d0dcff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:38.186392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24cafc02-097d-4fb9-b882-4eca76d0dcff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:38.195562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24cafc02-097d-4fb9-b882-4eca76d0dcff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:38.201088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24cafc02-097d-4fb9-b882-4eca76d0dcff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:38.209180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24cafc02-097d-4fb9-b882-4eca76d0dcff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:38.215502 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24cafc02-097d-4fb9-b882-4eca76d0dcff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:38.226951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24cafc02-097d-4fb9-b882-4eca76d0dcff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:38.601735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3d4f11f5-688b-4db3-bef2-ee28cc21c9d9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:38.620088 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3d4f11f5-688b-4db3-bef2-ee28cc21c9d9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1274 microversion: 2.1 time: 0.646352 Sep 07 12:49:38.620707 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1889/3806] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:37 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1274 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:38.679975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-382840e0-355b-4d4e-9449-6af64149b18a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:38.684114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-382840e0-355b-4d4e-9449-6af64149b18a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:38.692483 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-382840e0-355b-4d4e-9449-6af64149b18a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:38.693370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-382840e0-355b-4d4e-9449-6af64149b18a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:38.694132 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-382840e0-355b-4d4e-9449-6af64149b18a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:38.695184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-382840e0-355b-4d4e-9449-6af64149b18a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:38.695995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-382840e0-355b-4d4e-9449-6af64149b18a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:38.696642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-382840e0-355b-4d4e-9449-6af64149b18a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:40.731650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-382840e0-355b-4d4e-9449-6af64149b18a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:40.785896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-382840e0-355b-4d4e-9449-6af64149b18a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:40.790252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-382840e0-355b-4d4e-9449-6af64149b18a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:40.797550 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-382840e0-355b-4d4e-9449-6af64149b18a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1756 microversion: 2.32 time: 2.121608 Sep 07 12:49:40.801821 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1890/3807] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:38 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1756 bytes in 2127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:49:40.815827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-24cafc02-097d-4fb9-b882-4eca76d0dcff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:40.829638 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df61598c-6c98-4189-a150-187fe95e2537 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:40.831072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-df61598c-6c98-4189-a150-187fe95e2537 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:40.833415 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-24cafc02-097d-4fb9-b882-4eca76d0dcff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1315 microversion: 2.1 time: 2.723609 Sep 07 12:49:40.839233 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1918/3808] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:38 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1315 bytes in 2732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:40.887672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df61598c-6c98-4189-a150-187fe95e2537 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:40.888677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df61598c-6c98-4189-a150-187fe95e2537 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:40.889651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df61598c-6c98-4189-a150-187fe95e2537 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:40.890967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df61598c-6c98-4189-a150-187fe95e2537 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:40.896457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df61598c-6c98-4189-a150-187fe95e2537 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:40.897812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df61598c-6c98-4189-a150-187fe95e2537 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:41.365253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-df61598c-6c98-4189-a150-187fe95e2537 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:41.407171 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-df61598c-6c98-4189-a150-187fe95e2537 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1316 microversion: 2.1 time: 0.595795 Sep 07 12:49:41.410529 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1891/3809] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:40 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1316 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:41.863730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9d747462-a754-4604-86f2-ee646eaed0cf tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:41.864734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9d747462-a754-4604-86f2-ee646eaed0cf tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:41.886892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8efa0ae0-50e1-462e-aab5-20d69cdd7072 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:41.892354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8efa0ae0-50e1-462e-aab5-20d69cdd7072 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:41.923996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d747462-a754-4604-86f2-ee646eaed0cf tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:41.945562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d747462-a754-4604-86f2-ee646eaed0cf tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:41.946986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d747462-a754-4604-86f2-ee646eaed0cf tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:41.951676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8efa0ae0-50e1-462e-aab5-20d69cdd7072 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:41.951972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d747462-a754-4604-86f2-ee646eaed0cf tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:41.952671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8efa0ae0-50e1-462e-aab5-20d69cdd7072 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:41.952840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d747462-a754-4604-86f2-ee646eaed0cf tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:41.953562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d747462-a754-4604-86f2-ee646eaed0cf tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:41.954263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8efa0ae0-50e1-462e-aab5-20d69cdd7072 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:41.956245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8efa0ae0-50e1-462e-aab5-20d69cdd7072 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:41.962584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8efa0ae0-50e1-462e-aab5-20d69cdd7072 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:41.963429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8efa0ae0-50e1-462e-aab5-20d69cdd7072 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:42.041918 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:49:42.346688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:49:42.448420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=16 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:49:42.816930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9d747462-a754-4604-86f2-ee646eaed0cf tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:42.906381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9d747462-a754-4604-86f2-ee646eaed0cf tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:42.919080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9d747462-a754-4604-86f2-ee646eaed0cf tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:42.921288 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9d747462-a754-4604-86f2-ee646eaed0cf tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1756 microversion: 2.32 time: 1.071142 Sep 07 12:49:42.933857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8efa0ae0-50e1-462e-aab5-20d69cdd7072 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:42.945642 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1919/3810] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:41 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1756 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:49:42.952579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8ab3c503-6948-46e2-880b-8a93cbde966e req-75ec7f58-1dab-4919-99ff-775bed313d3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b52328c-937b-46cf-abdf-8629194fc25c", "tag": "3adf0f69-1af4-4072-9454-5e1b89d8b2f7"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:49:42.969366 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8efa0ae0-50e1-462e-aab5-20d69cdd7072 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1315 microversion: 2.1 time: 1.089972 Sep 07 12:49:42.975954 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1892/3811] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:41 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1315 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:49:42.981909 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cd5ff855-928d-40ae-9683-b8e53afbf3b4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:42.995784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cd5ff855-928d-40ae-9683-b8e53afbf3b4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:43.015915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8ab3c503-6948-46e2-880b-8a93cbde966e req-75ec7f58-1dab-4919-99ff-775bed313d3f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:43.016950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8ab3c503-6948-46e2-880b-8a93cbde966e req-75ec7f58-1dab-4919-99ff-775bed313d3f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:43.018959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8ab3c503-6948-46e2-880b-8a93cbde966e req-75ec7f58-1dab-4919-99ff-775bed313d3f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:43.021113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd5ff855-928d-40ae-9683-b8e53afbf3b4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:43.025912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd5ff855-928d-40ae-9683-b8e53afbf3b4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:43.033010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd5ff855-928d-40ae-9683-b8e53afbf3b4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:43.040679 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd5ff855-928d-40ae-9683-b8e53afbf3b4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:43.044184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd5ff855-928d-40ae-9683-b8e53afbf3b4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:43.050283 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd5ff855-928d-40ae-9683-b8e53afbf3b4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:43.081858 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8ab3c503-6948-46e2-880b-8a93cbde966e req-75ec7f58-1dab-4919-99ff-775bed313d3f service nova] Creating event network-changed:3adf0f69-1af4-4072-9454-5e1b89d8b2f7 for instance 4b52328c-937b-46cf-abdf-8629194fc25c on n-h1-852087-9 Sep 07 12:49:43.099462 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8ab3c503-6948-46e2-880b-8a93cbde966e req-75ec7f58-1dab-4919-99ff-775bed313d3f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150753 Sep 07 12:49:43.101598 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1920/3812] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:49:44.006786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f42ccf83-f3e8-4e74-b041-a263962ab753 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:44.007872 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f42ccf83-f3e8-4e74-b041-a263962ab753 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:44.027780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f42ccf83-f3e8-4e74-b041-a263962ab753 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:44.028173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f42ccf83-f3e8-4e74-b041-a263962ab753 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:44.039872 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f42ccf83-f3e8-4e74-b041-a263962ab753 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:44.041975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f42ccf83-f3e8-4e74-b041-a263962ab753 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:44.050374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f42ccf83-f3e8-4e74-b041-a263962ab753 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:44.051135 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f42ccf83-f3e8-4e74-b041-a263962ab753 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:44.395760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:49:44.851554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cd5ff855-928d-40ae-9683-b8e53afbf3b4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:44.868928 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cd5ff855-928d-40ae-9683-b8e53afbf3b4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1316 microversion: 2.1 time: 1.890893 Sep 07 12:49:44.869818 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1893/3813] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:42 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1316 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:44.894602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0120a71f-c208-4d7b-ac32-0aad1229c332 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:44.907619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0120a71f-c208-4d7b-ac32-0aad1229c332 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:44.923320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0120a71f-c208-4d7b-ac32-0aad1229c332 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:44.923857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0120a71f-c208-4d7b-ac32-0aad1229c332 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:44.924330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0120a71f-c208-4d7b-ac32-0aad1229c332 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:44.925076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0120a71f-c208-4d7b-ac32-0aad1229c332 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:44.925591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0120a71f-c208-4d7b-ac32-0aad1229c332 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:44.926762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0120a71f-c208-4d7b-ac32-0aad1229c332 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:45.149173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f42ccf83-f3e8-4e74-b041-a263962ab753 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:45.165109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f42ccf83-f3e8-4e74-b041-a263962ab753 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:45.166749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f42ccf83-f3e8-4e74-b041-a263962ab753 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:45.170184 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f42ccf83-f3e8-4e74-b041-a263962ab753 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1756 microversion: 2.32 time: 1.169011 Sep 07 12:49:45.177865 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1921/3814] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:43 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1756 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:49:45.183126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-eed4c5c7-56d2-4b3c-b2fe-18af8e2e00e2 req-1b3c80c7-d039-49af-8982-e0ee8cb7549f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0983070f-5877-49b6-8e6b-0a2a2471517d", "name": "network-vif-plugged", "status": "completed", "tag": "a097e437-e2eb-467f-9143-e1c6b1a563aa"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:49:45.207073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-eed4c5c7-56d2-4b3c-b2fe-18af8e2e00e2 req-1b3c80c7-d039-49af-8982-e0ee8cb7549f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:45.207565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-eed4c5c7-56d2-4b3c-b2fe-18af8e2e00e2 req-1b3c80c7-d039-49af-8982-e0ee8cb7549f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:45.208004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-eed4c5c7-56d2-4b3c-b2fe-18af8e2e00e2 req-1b3c80c7-d039-49af-8982-e0ee8cb7549f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:45.237541 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-eed4c5c7-56d2-4b3c-b2fe-18af8e2e00e2 req-1b3c80c7-d039-49af-8982-e0ee8cb7549f service nova] Creating event network-vif-plugged:a097e437-e2eb-467f-9143-e1c6b1a563aa for instance 0983070f-5877-49b6-8e6b-0a2a2471517d on n-h2-852087-9 Sep 07 12:49:45.251748 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-eed4c5c7-56d2-4b3c-b2fe-18af8e2e00e2 req-1b3c80c7-d039-49af-8982-e0ee8cb7549f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072217 Sep 07 12:49:45.252388 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1922/3815] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:49:45.342262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-fb8dc5f3-5c71-4c9f-9183-562b28a75afa req-070693c4-c388-4c80-9202-bafc684ad354 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860", "tag": "01afecc6-db9f-4ad9-84b4-c7038640dcd0"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:49:45.372674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fb8dc5f3-5c71-4c9f-9183-562b28a75afa req-070693c4-c388-4c80-9202-bafc684ad354 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:45.379786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fb8dc5f3-5c71-4c9f-9183-562b28a75afa req-070693c4-c388-4c80-9202-bafc684ad354 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:45.380708 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fb8dc5f3-5c71-4c9f-9183-562b28a75afa req-070693c4-c388-4c80-9202-bafc684ad354 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:45.447196 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-fb8dc5f3-5c71-4c9f-9183-562b28a75afa req-070693c4-c388-4c80-9202-bafc684ad354 service nova] Creating event network-changed:01afecc6-db9f-4ad9-84b4-c7038640dcd0 for instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 on n-h1-852087-9 Sep 07 12:49:45.468827 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-fb8dc5f3-5c71-4c9f-9183-562b28a75afa req-070693c4-c388-4c80-9202-bafc684ad354 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130457 Sep 07 12:49:45.475357 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1923/3816] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:49:45.762522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0120a71f-c208-4d7b-ac32-0aad1229c332 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:45.775127 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0120a71f-c208-4d7b-ac32-0aad1229c332 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1315 microversion: 2.1 time: 0.903807 Sep 07 12:49:45.776288 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1894/3817] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:44 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1315 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:45.928712 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3df537bb-1c58-4815-bc36-64d0b27ff7c9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:45.950973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3df537bb-1c58-4815-bc36-64d0b27ff7c9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:45.982392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3df537bb-1c58-4815-bc36-64d0b27ff7c9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:45.983554 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3df537bb-1c58-4815-bc36-64d0b27ff7c9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:45.984531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3df537bb-1c58-4815-bc36-64d0b27ff7c9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:45.990568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3df537bb-1c58-4815-bc36-64d0b27ff7c9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:45.992290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3df537bb-1c58-4815-bc36-64d0b27ff7c9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:45.995887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3df537bb-1c58-4815-bc36-64d0b27ff7c9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:46.231034 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-68a1db1e-57d6-4638-af90-ab4ab5dd8a32 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:46.231890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-68a1db1e-57d6-4638-af90-ab4ab5dd8a32 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:46.243412 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68a1db1e-57d6-4638-af90-ab4ab5dd8a32 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:46.250196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68a1db1e-57d6-4638-af90-ab4ab5dd8a32 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:46.250991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68a1db1e-57d6-4638-af90-ab4ab5dd8a32 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:46.251984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68a1db1e-57d6-4638-af90-ab4ab5dd8a32 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:46.252668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68a1db1e-57d6-4638-af90-ab4ab5dd8a32 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:46.253310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68a1db1e-57d6-4638-af90-ab4ab5dd8a32 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:48.136512 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3df537bb-1c58-4815-bc36-64d0b27ff7c9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:48.141224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-68a1db1e-57d6-4638-af90-ab4ab5dd8a32 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:48.167185 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3df537bb-1c58-4815-bc36-64d0b27ff7c9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1316 microversion: 2.1 time: 2.250343 Sep 07 12:49:48.170651 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1924/3818] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:45 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1316 bytes in 2257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:48.196381 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-68a1db1e-57d6-4638-af90-ab4ab5dd8a32 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:48.212211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-68a1db1e-57d6-4638-af90-ab4ab5dd8a32 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:48.219786 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-68a1db1e-57d6-4638-af90-ab4ab5dd8a32 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1803 microversion: 2.32 time: 1.988429 Sep 07 12:49:48.223242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ede1139e-b08b-4ce2-82ea-db7d19bd9ad0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:48.231658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ede1139e-b08b-4ce2-82ea-db7d19bd9ad0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:48.233680 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1895/3819] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:46 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1803 bytes in 2008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:49:48.250524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ede1139e-b08b-4ce2-82ea-db7d19bd9ad0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:48.251857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ede1139e-b08b-4ce2-82ea-db7d19bd9ad0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:48.252956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ede1139e-b08b-4ce2-82ea-db7d19bd9ad0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:48.254883 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ede1139e-b08b-4ce2-82ea-db7d19bd9ad0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:48.256083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ede1139e-b08b-4ce2-82ea-db7d19bd9ad0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:48.257397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ede1139e-b08b-4ce2-82ea-db7d19bd9ad0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:49.144327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ede1139e-b08b-4ce2-82ea-db7d19bd9ad0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:49.152056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:49:49.162182 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ede1139e-b08b-4ce2-82ea-db7d19bd9ad0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1501 microversion: 2.1 time: 0.945504 Sep 07 12:49:49.162922 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1925/3820] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:48 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1501 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:49.212025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e7a0a0bb-9b2c-48d6-a11c-88c27b9bd518 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:49:49.215624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a1497d56-d430-4d7b-9dd9-9ba4a3f5da75 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:49.216538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a1497d56-d430-4d7b-9dd9-9ba4a3f5da75 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:49.233752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1497d56-d430-4d7b-9dd9-9ba4a3f5da75 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:49.245018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1497d56-d430-4d7b-9dd9-9ba4a3f5da75 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:49.245830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1497d56-d430-4d7b-9dd9-9ba4a3f5da75 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:49.246912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1497d56-d430-4d7b-9dd9-9ba4a3f5da75 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:49.247627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1497d56-d430-4d7b-9dd9-9ba4a3f5da75 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:49.248405 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1497d56-d430-4d7b-9dd9-9ba4a3f5da75 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:49.271311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7a0a0bb-9b2c-48d6-a11c-88c27b9bd518 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:49.272295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7a0a0bb-9b2c-48d6-a11c-88c27b9bd518 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:49.273041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7a0a0bb-9b2c-48d6-a11c-88c27b9bd518 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:49.445389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e7a0a0bb-9b2c-48d6-a11c-88c27b9bd518 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Going to try to stop instance {{(pid=122432) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 12:49:49.607335 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e7a0a0bb-9b2c-48d6-a11c-88c27b9bd518 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d/action" status: 202 len: 0 microversion: 2.1 time: 0.401215 Sep 07 12:49:49.609925 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1896/3821] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:49:49 2022] POST /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:49:49.620926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c97fadc4-caa7-47b2-b1cb-4c4f9172e16c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:49.623760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c97fadc4-caa7-47b2-b1cb-4c4f9172e16c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:49.636085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c97fadc4-caa7-47b2-b1cb-4c4f9172e16c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:49.637024 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c97fadc4-caa7-47b2-b1cb-4c4f9172e16c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:49.637929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c97fadc4-caa7-47b2-b1cb-4c4f9172e16c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:49.639050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c97fadc4-caa7-47b2-b1cb-4c4f9172e16c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:49.639911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c97fadc4-caa7-47b2-b1cb-4c4f9172e16c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:49.640893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c97fadc4-caa7-47b2-b1cb-4c4f9172e16c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:50.490920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a1497d56-d430-4d7b-9dd9-9ba4a3f5da75 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:50.537064 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a1497d56-d430-4d7b-9dd9-9ba4a3f5da75 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1316 microversion: 2.1 time: 1.308467 Sep 07 12:49:50.578823 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1926/3822] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:49 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1316 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:49:50.607079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-277f2a79-277a-45b3-8379-aec6ee4c78ec tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:50.611762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-277f2a79-277a-45b3-8379-aec6ee4c78ec tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:50.647608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-277f2a79-277a-45b3-8379-aec6ee4c78ec tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:50.648799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-277f2a79-277a-45b3-8379-aec6ee4c78ec tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:50.651562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-277f2a79-277a-45b3-8379-aec6ee4c78ec tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:50.662103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-277f2a79-277a-45b3-8379-aec6ee4c78ec tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:50.665347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-277f2a79-277a-45b3-8379-aec6ee4c78ec tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:50.666526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-277f2a79-277a-45b3-8379-aec6ee4c78ec tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:50.887499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c97fadc4-caa7-47b2-b1cb-4c4f9172e16c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:50.931494 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c97fadc4-caa7-47b2-b1cb-4c4f9172e16c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:50.939151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c97fadc4-caa7-47b2-b1cb-4c4f9172e16c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:50.941059 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c97fadc4-caa7-47b2-b1cb-4c4f9172e16c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1803 microversion: 2.32 time: 1.327820 Sep 07 12:49:50.948969 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1897/3823] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:49 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1803 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:49:51.397298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-277f2a79-277a-45b3-8379-aec6ee4c78ec tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:51.442036 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-277f2a79-277a-45b3-8379-aec6ee4c78ec tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1511 microversion: 2.1 time: 0.860603 Sep 07 12:49:51.454049 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1927/3824] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:50 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1511 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:51.592598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-53f21a6f-e379-4fda-99aa-039fb4af46a9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:51.595089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-53f21a6f-e379-4fda-99aa-039fb4af46a9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:51.631980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53f21a6f-e379-4fda-99aa-039fb4af46a9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:51.637075 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53f21a6f-e379-4fda-99aa-039fb4af46a9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:51.640776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53f21a6f-e379-4fda-99aa-039fb4af46a9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:51.643915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53f21a6f-e379-4fda-99aa-039fb4af46a9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:51.651097 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53f21a6f-e379-4fda-99aa-039fb4af46a9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:51.652577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53f21a6f-e379-4fda-99aa-039fb4af46a9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:52.013131 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8abff51a-41cb-4ed5-b864-d7dc1a8f9ec4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:52.017039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8abff51a-41cb-4ed5-b864-d7dc1a8f9ec4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:52.046166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8abff51a-41cb-4ed5-b864-d7dc1a8f9ec4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:52.047586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8abff51a-41cb-4ed5-b864-d7dc1a8f9ec4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:52.048747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8abff51a-41cb-4ed5-b864-d7dc1a8f9ec4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:52.055395 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8abff51a-41cb-4ed5-b864-d7dc1a8f9ec4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:52.056510 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8abff51a-41cb-4ed5-b864-d7dc1a8f9ec4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:52.057376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8abff51a-41cb-4ed5-b864-d7dc1a8f9ec4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:53.027987 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-53f21a6f-e379-4fda-99aa-039fb4af46a9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:53.082617 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-53f21a6f-e379-4fda-99aa-039fb4af46a9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1316 microversion: 2.1 time: 1.492314 Sep 07 12:49:53.087095 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1898/3825] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:51 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1316 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:53.121138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5f6751c0-cf44-443b-b639-20296d27a8de tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:53.122287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5f6751c0-cf44-443b-b639-20296d27a8de tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:53.154584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f6751c0-cf44-443b-b639-20296d27a8de tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:53.156879 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f6751c0-cf44-443b-b639-20296d27a8de tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:53.157702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f6751c0-cf44-443b-b639-20296d27a8de tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:53.159031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f6751c0-cf44-443b-b639-20296d27a8de tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:53.159864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f6751c0-cf44-443b-b639-20296d27a8de tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:53.160629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f6751c0-cf44-443b-b639-20296d27a8de tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:53.267754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8abff51a-41cb-4ed5-b864-d7dc1a8f9ec4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:53.367792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8abff51a-41cb-4ed5-b864-d7dc1a8f9ec4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:53.376748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8abff51a-41cb-4ed5-b864-d7dc1a8f9ec4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:53.385107 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8abff51a-41cb-4ed5-b864-d7dc1a8f9ec4 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1850 microversion: 2.32 time: 1.379661 Sep 07 12:49:53.390563 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1928/3826] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:51 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1850 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:49:53.795023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3dfa5f38-0977-4e81-91f8-8b330137b487 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Action: 'create', calling method: .version_select at 0x7fc4182ad5e0>, body: {"keypair": {"name": "tempest-keypair-357939483", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGimlDP0jkSYPc+W3P8yrcMvh3kXnZLQWi35SDggJDU6OqVomWD3wtIk+Z/Vaz74smAjID1jM8afd5MatWJ7M71NOjeUbxFsDMPe9QDFAuPmx1hSjwWaKvGh3C6/BQqCEw=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:49:53.846397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-3dfa5f38-0977-4e81-91f8-8b330137b487 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Getting quotas for project fdbe65a861ac4b9ea7e5c2bbd4d955b3. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:49:53.875181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-3dfa5f38-0977-4e81-91f8-8b330137b487 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Getting quotas for user 9e1c3623bbda4cbdbf6b5d2dedb48f74 and project fdbe65a861ac4b9ea7e5c2bbd4d955b3. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:49:53.969820 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3dfa5f38-0977-4e81-91f8-8b330137b487 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.576263 Sep 07 12:49:53.972238 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1929/3827] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Sep 7 12:49:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 581 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 12:49:54.127170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4480e30d-bfff-4943-8392-de47a6f11588 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:54.128373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4480e30d-bfff-4943-8392-de47a6f11588 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:54.145555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4480e30d-bfff-4943-8392-de47a6f11588 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:54.149298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4480e30d-bfff-4943-8392-de47a6f11588 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:54.152359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4480e30d-bfff-4943-8392-de47a6f11588 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:54.155048 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4480e30d-bfff-4943-8392-de47a6f11588 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:54.159093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4480e30d-bfff-4943-8392-de47a6f11588 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:54.166399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4480e30d-bfff-4943-8392-de47a6f11588 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:55.518472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5f6751c0-cf44-443b-b639-20296d27a8de tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:55.533586 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5f6751c0-cf44-443b-b639-20296d27a8de tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1511 microversion: 2.1 time: 2.444392 Sep 07 12:49:55.540969 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1899/3828] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:53 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1511 bytes in 2453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:55.553039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b0263a09-fead-45f2-ac18-4953750b944e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:55.553693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b0263a09-fead-45f2-ac18-4953750b944e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:55.569852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0263a09-fead-45f2-ac18-4953750b944e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:55.581688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0263a09-fead-45f2-ac18-4953750b944e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:55.582264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0263a09-fead-45f2-ac18-4953750b944e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:55.583262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0263a09-fead-45f2-ac18-4953750b944e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:55.584122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0263a09-fead-45f2-ac18-4953750b944e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:55.584735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0263a09-fead-45f2-ac18-4953750b944e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:55.874007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4480e30d-bfff-4943-8392-de47a6f11588 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:55.903045 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4480e30d-bfff-4943-8392-de47a6f11588 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1316 microversion: 2.1 time: 1.779581 Sep 07 12:49:55.905598 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1930/3829] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:54 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1316 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:49:56.230402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b0263a09-fead-45f2-ac18-4953750b944e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:56.247897 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b0263a09-fead-45f2-ac18-4953750b944e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:56.253829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b0263a09-fead-45f2-ac18-4953750b944e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:56.255500 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b0263a09-fead-45f2-ac18-4953750b944e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1850 microversion: 2.32 time: 0.713015 Sep 07 12:49:56.278417 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1900/3830] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:55 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1850 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:49:56.573932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-21dce769-eb04-4db1-830f-3f5e6bae54ef tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:56.575380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-21dce769-eb04-4db1-830f-3f5e6bae54ef tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:56.587106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21dce769-eb04-4db1-830f-3f5e6bae54ef tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:56.588108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21dce769-eb04-4db1-830f-3f5e6bae54ef tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:56.588874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21dce769-eb04-4db1-830f-3f5e6bae54ef tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:56.590002 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21dce769-eb04-4db1-830f-3f5e6bae54ef tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:56.591572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21dce769-eb04-4db1-830f-3f5e6bae54ef tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:56.592390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21dce769-eb04-4db1-830f-3f5e6bae54ef tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:56.930375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6953da9f-55ba-43f9-90b9-bc9427d0845e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:56.931010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6953da9f-55ba-43f9-90b9-bc9427d0845e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:56.963071 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6953da9f-55ba-43f9-90b9-bc9427d0845e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:56.963766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6953da9f-55ba-43f9-90b9-bc9427d0845e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:56.964409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6953da9f-55ba-43f9-90b9-bc9427d0845e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:56.965410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6953da9f-55ba-43f9-90b9-bc9427d0845e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:56.966105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6953da9f-55ba-43f9-90b9-bc9427d0845e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:56.966744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6953da9f-55ba-43f9-90b9-bc9427d0845e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:57.404829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-21dce769-eb04-4db1-830f-3f5e6bae54ef tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:57.418763 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-21dce769-eb04-4db1-830f-3f5e6bae54ef tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1511 microversion: 2.1 time: 0.851493 Sep 07 12:49:57.426900 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1931/3831] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:56 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1511 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:49:57.440118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e38879b7-51a3-49e3-a280-4519d2442eb1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:57.445666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e38879b7-51a3-49e3-a280-4519d2442eb1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:57.463838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e38879b7-51a3-49e3-a280-4519d2442eb1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:57.468114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e38879b7-51a3-49e3-a280-4519d2442eb1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:57.469164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e38879b7-51a3-49e3-a280-4519d2442eb1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:57.471200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e38879b7-51a3-49e3-a280-4519d2442eb1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:57.472617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e38879b7-51a3-49e3-a280-4519d2442eb1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:57.481183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e38879b7-51a3-49e3-a280-4519d2442eb1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:57.587090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6953da9f-55ba-43f9-90b9-bc9427d0845e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:57.596885 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6953da9f-55ba-43f9-90b9-bc9427d0845e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1316 microversion: 2.1 time: 0.670494 Sep 07 12:49:57.598850 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1901/3832] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:56 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1316 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:49:58.456311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-528fe2d9-b920-48f7-b582-cfacdf44ea0b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:58.462801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-528fe2d9-b920-48f7-b582-cfacdf44ea0b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:58.483967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-528fe2d9-b920-48f7-b582-cfacdf44ea0b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:58.485135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-528fe2d9-b920-48f7-b582-cfacdf44ea0b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:58.486661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-528fe2d9-b920-48f7-b582-cfacdf44ea0b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:58.489047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-528fe2d9-b920-48f7-b582-cfacdf44ea0b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:58.490773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-528fe2d9-b920-48f7-b582-cfacdf44ea0b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:58.491815 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-528fe2d9-b920-48f7-b582-cfacdf44ea0b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:58.629241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e38879b7-51a3-49e3-a280-4519d2442eb1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:58.691094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e38879b7-51a3-49e3-a280-4519d2442eb1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:58.696939 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e38879b7-51a3-49e3-a280-4519d2442eb1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:58.699990 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e38879b7-51a3-49e3-a280-4519d2442eb1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1850 microversion: 2.32 time: 1.271467 Sep 07 12:49:58.701695 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1932/3833] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:49:57 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1850 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:49:58.711393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b037b4da-f416-4120-a0ff-b592ac633e5a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:49:58.713774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b037b4da-f416-4120-a0ff-b592ac633e5a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:49:58.739361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b037b4da-f416-4120-a0ff-b592ac633e5a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:58.746121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b037b4da-f416-4120-a0ff-b592ac633e5a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:58.748323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b037b4da-f416-4120-a0ff-b592ac633e5a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:58.755470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b037b4da-f416-4120-a0ff-b592ac633e5a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:58.756206 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b037b4da-f416-4120-a0ff-b592ac633e5a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:58.756816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b037b4da-f416-4120-a0ff-b592ac633e5a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:59.867120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-528fe2d9-b920-48f7-b582-cfacdf44ea0b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:49:59.885612 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-528fe2d9-b920-48f7-b582-cfacdf44ea0b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1511 microversion: 2.1 time: 1.437753 Sep 07 12:49:59.893680 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1902/3834] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:58 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1511 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:49:59.914645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-6efc19fe-32a9-4037-8e20-aa7d9d9dbb54 req-b5c6d17c-f207-4f74-af8a-34ef16528598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860", "name": "network-vif-plugged", "status": "completed", "tag": "01afecc6-db9f-4ad9-84b4-c7038640dcd0"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:49:59.940683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6efc19fe-32a9-4037-8e20-aa7d9d9dbb54 req-b5c6d17c-f207-4f74-af8a-34ef16528598 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:49:59.941912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6efc19fe-32a9-4037-8e20-aa7d9d9dbb54 req-b5c6d17c-f207-4f74-af8a-34ef16528598 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:49:59.942755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6efc19fe-32a9-4037-8e20-aa7d9d9dbb54 req-b5c6d17c-f207-4f74-af8a-34ef16528598 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:49:59.964521 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-6efc19fe-32a9-4037-8e20-aa7d9d9dbb54 req-b5c6d17c-f207-4f74-af8a-34ef16528598 service nova] Creating event network-vif-plugged:01afecc6-db9f-4ad9-84b4-c7038640dcd0 for instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 on n-h1-852087-9 Sep 07 12:49:59.975098 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-6efc19fe-32a9-4037-8e20-aa7d9d9dbb54 req-b5c6d17c-f207-4f74-af8a-34ef16528598 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075151 Sep 07 12:49:59.976510 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1903/3835] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:49:59.984277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5f3a76c5-e301-4e12-94ea-a18d52cfba53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1418524743", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cbe13b8b-97d8-4e5e-bde8-fa59eb5ebba9"}], "security_groups": [{"name": "tempest-securitygroup--1705838289"}], "key_name": "tempest-keypair-357939483", "user_data": "}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:00.091108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b037b4da-f416-4120-a0ff-b592ac633e5a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:00.108306 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b037b4da-f416-4120-a0ff-b592ac633e5a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1316 microversion: 2.1 time: 1.404374 Sep 07 12:50:00.113918 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1933/3836] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:49:58 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1316 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:00.129558 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d06b3a5a-1208-4965-854b-14da9070e746 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:00.130494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d06b3a5a-1208-4965-854b-14da9070e746 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:00.145546 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d06b3a5a-1208-4965-854b-14da9070e746 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:00.147087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d06b3a5a-1208-4965-854b-14da9070e746 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:00.147556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d06b3a5a-1208-4965-854b-14da9070e746 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:00.148347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d06b3a5a-1208-4965-854b-14da9070e746 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:00.148829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d06b3a5a-1208-4965-854b-14da9070e746 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:00.149274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d06b3a5a-1208-4965-854b-14da9070e746 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:00.386638 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-5f3a76c5-e301-4e12-94ea-a18d52cfba53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] validate_networks() for [('cbe13b8b-97d8-4e5e-bde8-fa59eb5ebba9', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:50:01.529775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d06b3a5a-1208-4965-854b-14da9070e746 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:01.563664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d06b3a5a-1208-4965-854b-14da9070e746 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:01.568146 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d06b3a5a-1208-4965-854b-14da9070e746 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:01.571450 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d06b3a5a-1208-4965-854b-14da9070e746 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1850 microversion: 2.32 time: 1.455353 Sep 07 12:50:01.573573 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1934/3837] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:00 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1850 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:01.584024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-799e2daa-3d70-4fa1-af89-3d3dab5da121 req-932c19e7-2385-4478-a84d-5ee43a250186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9352ac2-475e-4c77-aa85-5ecd566563b2", "tag": "3a4e33c1-9c34-429f-8cce-622597db4c32"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:01.608444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-799e2daa-3d70-4fa1-af89-3d3dab5da121 req-932c19e7-2385-4478-a84d-5ee43a250186 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:01.609839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-799e2daa-3d70-4fa1-af89-3d3dab5da121 req-932c19e7-2385-4478-a84d-5ee43a250186 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:01.610297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-799e2daa-3d70-4fa1-af89-3d3dab5da121 req-932c19e7-2385-4478-a84d-5ee43a250186 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:01.630119 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-799e2daa-3d70-4fa1-af89-3d3dab5da121 req-932c19e7-2385-4478-a84d-5ee43a250186 service nova] Creating event network-changed:3a4e33c1-9c34-429f-8cce-622597db4c32 for instance e9352ac2-475e-4c77-aa85-5ecd566563b2 on n-h2-852087-9 Sep 07 12:50:01.649220 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-799e2daa-3d70-4fa1-af89-3d3dab5da121 req-932c19e7-2385-4478-a84d-5ee43a250186 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072158 Sep 07 12:50:01.653943 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1935/3838] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:50:01.673222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2dde9299-ba1b-4d88-bb68-72d57fc6f8cf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:01.675510 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2dde9299-ba1b-4d88-bb68-72d57fc6f8cf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:01.688407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dde9299-ba1b-4d88-bb68-72d57fc6f8cf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:01.689080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dde9299-ba1b-4d88-bb68-72d57fc6f8cf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:01.690003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dde9299-ba1b-4d88-bb68-72d57fc6f8cf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:01.691187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dde9299-ba1b-4d88-bb68-72d57fc6f8cf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:01.692111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dde9299-ba1b-4d88-bb68-72d57fc6f8cf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:01.693419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dde9299-ba1b-4d88-bb68-72d57fc6f8cf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:02.582609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2dde9299-ba1b-4d88-bb68-72d57fc6f8cf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:02.594427 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2dde9299-ba1b-4d88-bb68-72d57fc6f8cf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1511 microversion: 2.1 time: 0.937330 Sep 07 12:50:02.610628 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1936/3839] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:01 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1511 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:02.617838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f31dbf03-6baf-4f94-9a3d-277daa972bcb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:02.618593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f31dbf03-6baf-4f94-9a3d-277daa972bcb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:02.629858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f31dbf03-6baf-4f94-9a3d-277daa972bcb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:02.630765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f31dbf03-6baf-4f94-9a3d-277daa972bcb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:02.631441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f31dbf03-6baf-4f94-9a3d-277daa972bcb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:02.632610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f31dbf03-6baf-4f94-9a3d-277daa972bcb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:02.633390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f31dbf03-6baf-4f94-9a3d-277daa972bcb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:02.634064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f31dbf03-6baf-4f94-9a3d-277daa972bcb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:03.293053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-5f3a76c5-e301-4e12-94ea-a18d52cfba53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:50:03.298150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-5f3a76c5-e301-4e12-94ea-a18d52cfba53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:50:03.300826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-5f3a76c5-e301-4e12-94ea-a18d52cfba53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:50:03.306404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-5f3a76c5-e301-4e12-94ea-a18d52cfba53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:50:03.307293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-5f3a76c5-e301-4e12-94ea-a18d52cfba53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:50:03.345365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f3a76c5-e301-4e12-94ea-a18d52cfba53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:03.346481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f3a76c5-e301-4e12-94ea-a18d52cfba53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:03.347337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f3a76c5-e301-4e12-94ea-a18d52cfba53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:03.348277 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f31dbf03-6baf-4f94-9a3d-277daa972bcb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:03.348799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f3a76c5-e301-4e12-94ea-a18d52cfba53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:03.349839 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f3a76c5-e301-4e12-94ea-a18d52cfba53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:03.350464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f3a76c5-e301-4e12-94ea-a18d52cfba53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:03.363342 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f31dbf03-6baf-4f94-9a3d-277daa972bcb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1316 microversion: 2.1 time: 0.745203 Sep 07 12:50:03.364361 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1937/3840] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:02 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1316 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:03.382552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3cc8072a-7e37-4fd8-8a7f-a6483f9c3843 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:03.383476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3cc8072a-7e37-4fd8-8a7f-a6483f9c3843 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:03.397242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cc8072a-7e37-4fd8-8a7f-a6483f9c3843 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:03.398246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cc8072a-7e37-4fd8-8a7f-a6483f9c3843 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:03.399061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cc8072a-7e37-4fd8-8a7f-a6483f9c3843 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:03.400041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cc8072a-7e37-4fd8-8a7f-a6483f9c3843 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:03.400747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cc8072a-7e37-4fd8-8a7f-a6483f9c3843 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:03.401442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cc8072a-7e37-4fd8-8a7f-a6483f9c3843 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:03.406429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-5f3a76c5-e301-4e12-94ea-a18d52cfba53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Getting quotas for project fdbe65a861ac4b9ea7e5c2bbd4d955b3. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:50:03.417034 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-5f3a76c5-e301-4e12-94ea-a18d52cfba53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Getting quotas for user 9e1c3623bbda4cbdbf6b5d2dedb48f74 and project fdbe65a861ac4b9ea7e5c2bbd4d955b3. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:50:03.467856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5f3a76c5-e301-4e12-94ea-a18d52cfba53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:50:03.474439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5f3a76c5-e301-4e12-94ea-a18d52cfba53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:50:03.651482 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5f3a76c5-e301-4e12-94ea-a18d52cfba53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.672658 Sep 07 12:50:03.654936 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1904/3841] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Sep 7 12:49:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 3677 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 12:50:03.667530 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-24f1c22f-bfe9-475d-b449-37be916ef4af tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:03.669449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-24f1c22f-bfe9-475d-b449-37be916ef4af tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:03.690011 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24f1c22f-bfe9-475d-b449-37be916ef4af tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:03.695308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24f1c22f-bfe9-475d-b449-37be916ef4af tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:03.698532 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24f1c22f-bfe9-475d-b449-37be916ef4af tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:03.703623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24f1c22f-bfe9-475d-b449-37be916ef4af tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:03.706603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24f1c22f-bfe9-475d-b449-37be916ef4af tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:03.710130 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24f1c22f-bfe9-475d-b449-37be916ef4af tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:03.939065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:04.119338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3cc8072a-7e37-4fd8-8a7f-a6483f9c3843 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:04.132940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3cc8072a-7e37-4fd8-8a7f-a6483f9c3843 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:04.135500 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3cc8072a-7e37-4fd8-8a7f-a6483f9c3843 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:04.137317 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3cc8072a-7e37-4fd8-8a7f-a6483f9c3843 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1859 microversion: 2.32 time: 0.771639 Sep 07 12:50:04.154632 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1938/3842] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:03 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1859 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:04.250766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-24f1c22f-bfe9-475d-b449-37be916ef4af tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:04.267222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-24f1c22f-bfe9-475d-b449-37be916ef4af tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:04.271934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-24f1c22f-bfe9-475d-b449-37be916ef4af tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:04.275818 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-24f1c22f-bfe9-475d-b449-37be916ef4af tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 2953 microversion: 2.42 time: 0.618744 Sep 07 12:50:04.281613 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1905/3843] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:03 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 2953 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:04.288374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d55d279d-0f73-4b23-892e-684f941c99a6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:04.289547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d55d279d-0f73-4b23-892e-684f941c99a6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:04.302982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d55d279d-0f73-4b23-892e-684f941c99a6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:04.304543 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d55d279d-0f73-4b23-892e-684f941c99a6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:04.305238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d55d279d-0f73-4b23-892e-684f941c99a6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:04.306217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d55d279d-0f73-4b23-892e-684f941c99a6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:04.307383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d55d279d-0f73-4b23-892e-684f941c99a6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:04.308053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d55d279d-0f73-4b23-892e-684f941c99a6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:04.414660 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-89eeae5d-6f90-48f3-b02b-24588973361d tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2028358869", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "c374f8e6-3b32-4ce6-8a44-64bb5ff02ec6"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:04.513534 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-89eeae5d-6f90-48f3-b02b-24588973361d tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] validate_networks() for [('c374f8e6-3b32-4ce6-8a44-64bb5ff02ec6', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:50:04.859819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d55d279d-0f73-4b23-892e-684f941c99a6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:04.876188 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d55d279d-0f73-4b23-892e-684f941c99a6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1511 microversion: 2.1 time: 0.591599 Sep 07 12:50:04.878891 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1906/3844] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:04 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1511 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:04.899257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d8ab200e-f957-4eca-b9dd-69c29423b51b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:04.902334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d8ab200e-f957-4eca-b9dd-69c29423b51b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:04.912328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8ab200e-f957-4eca-b9dd-69c29423b51b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:04.913229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8ab200e-f957-4eca-b9dd-69c29423b51b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:04.914042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8ab200e-f957-4eca-b9dd-69c29423b51b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:04.915084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8ab200e-f957-4eca-b9dd-69c29423b51b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:04.915805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8ab200e-f957-4eca-b9dd-69c29423b51b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:04.919827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8ab200e-f957-4eca-b9dd-69c29423b51b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:05.779572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d8ab200e-f957-4eca-b9dd-69c29423b51b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:05.795125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d8ab200e-f957-4eca-b9dd-69c29423b51b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:05.796640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d8ab200e-f957-4eca-b9dd-69c29423b51b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:05.803752 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d8ab200e-f957-4eca-b9dd-69c29423b51b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1277 microversion: 2.20 time: 0.922063 Sep 07 12:50:05.809198 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1907/3845] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:04 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1277 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:05.829240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bfc7ca2a-de0e-45fd-939f-17ec79dd080d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:05.830255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bfc7ca2a-de0e-45fd-939f-17ec79dd080d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:05.834401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:05.857756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfc7ca2a-de0e-45fd-939f-17ec79dd080d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:05.858870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfc7ca2a-de0e-45fd-939f-17ec79dd080d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:05.859551 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfc7ca2a-de0e-45fd-939f-17ec79dd080d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:05.860606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfc7ca2a-de0e-45fd-939f-17ec79dd080d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:05.864551 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfc7ca2a-de0e-45fd-939f-17ec79dd080d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:05.865600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfc7ca2a-de0e-45fd-939f-17ec79dd080d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:07.183175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-89eeae5d-6f90-48f3-b02b-24588973361d tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:50:07.185238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-89eeae5d-6f90-48f3-b02b-24588973361d tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:50:07.186474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-89eeae5d-6f90-48f3-b02b-24588973361d tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:50:07.187496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-89eeae5d-6f90-48f3-b02b-24588973361d tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:50:07.188615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-89eeae5d-6f90-48f3-b02b-24588973361d tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:50:07.197574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:07.242929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89eeae5d-6f90-48f3-b02b-24588973361d tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:07.254871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89eeae5d-6f90-48f3-b02b-24588973361d tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:07.256110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89eeae5d-6f90-48f3-b02b-24588973361d tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:07.260153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89eeae5d-6f90-48f3-b02b-24588973361d tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:07.261055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89eeae5d-6f90-48f3-b02b-24588973361d tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:07.268624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89eeae5d-6f90-48f3-b02b-24588973361d tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:07.331703 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-89eeae5d-6f90-48f3-b02b-24588973361d tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Getting quotas for project ab7bfa5688d5406da8f755efff3cf54e. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:50:07.344938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-89eeae5d-6f90-48f3-b02b-24588973361d tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Getting quotas for user 30c27a3ca32e4f4d976d1351372b0fb1 and project ab7bfa5688d5406da8f755efff3cf54e. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:50:07.364222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-89eeae5d-6f90-48f3-b02b-24588973361d tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:50:07.367461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-89eeae5d-6f90-48f3-b02b-24588973361d tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:50:07.433532 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-89eeae5d-6f90-48f3-b02b-24588973361d tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.277355 Sep 07 12:50:07.434530 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1939/3846] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:50:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:50:07.440578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fe62c0e4-343b-4a97-9798-a461caf5c7f4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:07.441827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fe62c0e4-343b-4a97-9798-a461caf5c7f4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:07.450958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe62c0e4-343b-4a97-9798-a461caf5c7f4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:07.451908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe62c0e4-343b-4a97-9798-a461caf5c7f4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:07.452537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe62c0e4-343b-4a97-9798-a461caf5c7f4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:07.453453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe62c0e4-343b-4a97-9798-a461caf5c7f4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:07.456385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe62c0e4-343b-4a97-9798-a461caf5c7f4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:07.457025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fe62c0e4-343b-4a97-9798-a461caf5c7f4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:07.487981 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bfc7ca2a-de0e-45fd-939f-17ec79dd080d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a/os-interface" status: 200 len: 1831 microversion: 2.42 time: 1.677081 Sep 07 12:50:07.489675 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1908/3847] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Sep 7 12:50:05 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a/os-interface => generated 1831 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:07.505065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-fd76c49a-f205-4e86-b9cd-05ef8aaab4cf req-006d5557-81a9-44b5-8209-5e1e762e925e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9352ac2-475e-4c77-aa85-5ecd566563b2", "tag": "52acc413-bd10-4aa6-9f53-f86a0cad3f9b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:07.536444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fd76c49a-f205-4e86-b9cd-05ef8aaab4cf req-006d5557-81a9-44b5-8209-5e1e762e925e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:07.538418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fd76c49a-f205-4e86-b9cd-05ef8aaab4cf req-006d5557-81a9-44b5-8209-5e1e762e925e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:07.539177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fd76c49a-f205-4e86-b9cd-05ef8aaab4cf req-006d5557-81a9-44b5-8209-5e1e762e925e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:07.607846 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-fd76c49a-f205-4e86-b9cd-05ef8aaab4cf req-006d5557-81a9-44b5-8209-5e1e762e925e service nova] Creating event network-changed:52acc413-bd10-4aa6-9f53-f86a0cad3f9b for instance e9352ac2-475e-4c77-aa85-5ecd566563b2 on n-h2-852087-9 Sep 07 12:50:07.635987 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-fd76c49a-f205-4e86-b9cd-05ef8aaab4cf req-006d5557-81a9-44b5-8209-5e1e762e925e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144038 Sep 07 12:50:07.637873 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1909/3848] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:50:07.663131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-95b52260-2230-43b2-9361-a70952a5d28f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:07.664909 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-95b52260-2230-43b2-9361-a70952a5d28f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:07.685843 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95b52260-2230-43b2-9361-a70952a5d28f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:07.686688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95b52260-2230-43b2-9361-a70952a5d28f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:07.689611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95b52260-2230-43b2-9361-a70952a5d28f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:07.691782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95b52260-2230-43b2-9361-a70952a5d28f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:07.694300 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95b52260-2230-43b2-9361-a70952a5d28f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:07.695908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95b52260-2230-43b2-9361-a70952a5d28f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:07.772275 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:08.586210 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fe62c0e4-343b-4a97-9798-a461caf5c7f4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:08.605186 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fe62c0e4-343b-4a97-9798-a461caf5c7f4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 1.168674 Sep 07 12:50:08.606785 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1940/3849] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:07 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:08.614813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fff138c1-021d-447a-859d-5d1529043168 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:08.616037 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fff138c1-021d-447a-859d-5d1529043168 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:08.626466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fff138c1-021d-447a-859d-5d1529043168 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:08.627790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fff138c1-021d-447a-859d-5d1529043168 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:08.628523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fff138c1-021d-447a-859d-5d1529043168 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:08.629625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fff138c1-021d-447a-859d-5d1529043168 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:08.630393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fff138c1-021d-447a-859d-5d1529043168 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:08.631343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fff138c1-021d-447a-859d-5d1529043168 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:08.896299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-95b52260-2230-43b2-9361-a70952a5d28f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:08.937665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-95b52260-2230-43b2-9361-a70952a5d28f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:08.946811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-95b52260-2230-43b2-9361-a70952a5d28f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:08.953132 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-95b52260-2230-43b2-9361-a70952a5d28f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 1.311535 Sep 07 12:50:08.955573 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1910/3850] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:07 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:08.974440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-44d2bd61-59ef-491e-a089-3c7bbb8af4ed tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:08.975506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-44d2bd61-59ef-491e-a089-3c7bbb8af4ed tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:08.991392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44d2bd61-59ef-491e-a089-3c7bbb8af4ed tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:08.992172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44d2bd61-59ef-491e-a089-3c7bbb8af4ed tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:08.993063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44d2bd61-59ef-491e-a089-3c7bbb8af4ed tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:08.994327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44d2bd61-59ef-491e-a089-3c7bbb8af4ed tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:08.995114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44d2bd61-59ef-491e-a089-3c7bbb8af4ed tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:08.995948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44d2bd61-59ef-491e-a089-3c7bbb8af4ed tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:09.190821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fff138c1-021d-447a-859d-5d1529043168 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:09.204759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-44d2bd61-59ef-491e-a089-3c7bbb8af4ed tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:09.211794 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fff138c1-021d-447a-859d-5d1529043168 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1511 microversion: 2.1 time: 0.603449 Sep 07 12:50:09.212413 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1941/3851] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:08 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1511 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:09.217967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-35502294-a10a-4fdc-926e-d6001bd44e3f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-640057678", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "c374f8e6-3b32-4ce6-8a44-64bb5ff02ec6"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:09.218974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-44d2bd61-59ef-491e-a089-3c7bbb8af4ed tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:09.222128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-44d2bd61-59ef-491e-a089-3c7bbb8af4ed tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:09.233920 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-44d2bd61-59ef-491e-a089-3c7bbb8af4ed tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1339 microversion: 2.20 time: 0.271294 Sep 07 12:50:09.259453 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1911/3852] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:08 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1339 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:09.289254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3cf7d13b-3963-4e88-b706-96e45eb88f2d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-263622697", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "2279e516-151d-4440-a79a-0f9a195eadec"}, {"uuid": "d4495bb1-e16b-4dca-8f92-bb427dd9930c"}, {"uuid": "2279e516-151d-4440-a79a-0f9a195eadec"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:09.361236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-3cf7d13b-3963-4e88-b706-96e45eb88f2d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] validate_networks() for [('2279e516-151d-4440-a79a-0f9a195eadec', None, None, None, None, None), ('d4495bb1-e16b-4dca-8f92-bb427dd9930c', None, None, None, None, None), ('2279e516-151d-4440-a79a-0f9a195eadec', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:50:09.382448 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-35502294-a10a-4fdc-926e-d6001bd44e3f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] validate_networks() for [('c374f8e6-3b32-4ce6-8a44-64bb5ff02ec6', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:50:11.968290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-35502294-a10a-4fdc-926e-d6001bd44e3f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:50:11.969231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-35502294-a10a-4fdc-926e-d6001bd44e3f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:50:11.969886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-35502294-a10a-4fdc-926e-d6001bd44e3f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:50:11.970932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-35502294-a10a-4fdc-926e-d6001bd44e3f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:50:11.971962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-35502294-a10a-4fdc-926e-d6001bd44e3f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:50:12.033291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35502294-a10a-4fdc-926e-d6001bd44e3f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:12.034688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35502294-a10a-4fdc-926e-d6001bd44e3f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:12.035725 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35502294-a10a-4fdc-926e-d6001bd44e3f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:12.037077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35502294-a10a-4fdc-926e-d6001bd44e3f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:12.038225 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35502294-a10a-4fdc-926e-d6001bd44e3f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:12.039472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35502294-a10a-4fdc-926e-d6001bd44e3f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:12.080948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-35502294-a10a-4fdc-926e-d6001bd44e3f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Getting quotas for project ab7bfa5688d5406da8f755efff3cf54e. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:50:12.091640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-35502294-a10a-4fdc-926e-d6001bd44e3f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Getting quotas for user 30c27a3ca32e4f4d976d1351372b0fb1 and project ab7bfa5688d5406da8f755efff3cf54e. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:50:12.118229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-35502294-a10a-4fdc-926e-d6001bd44e3f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:50:12.124323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-35502294-a10a-4fdc-926e-d6001bd44e3f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 290d9a42-9d80-495f-8e45-879687fea820] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:50:12.226914 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-35502294-a10a-4fdc-926e-d6001bd44e3f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.013195 Sep 07 12:50:12.228342 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1942/3853] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:50:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:50:12.259329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e229af96-ff9f-4922-968a-6091a4386a81 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1401033605", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "b810bb5d-8084-47d5-9b9e-6ea4661cdf5f"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:12.384705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-e229af96-ff9f-4922-968a-6091a4386a81 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] validate_networks() for [('b810bb5d-8084-47d5-9b9e-6ea4661cdf5f', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:50:13.366130 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:13.449477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:14.925450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3cf7d13b-3963-4e88-b706-96e45eb88f2d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:50:14.929978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3cf7d13b-3963-4e88-b706-96e45eb88f2d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:50:14.930975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3cf7d13b-3963-4e88-b706-96e45eb88f2d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:50:14.937960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3cf7d13b-3963-4e88-b706-96e45eb88f2d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:50:14.940762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-3cf7d13b-3963-4e88-b706-96e45eb88f2d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:50:14.968780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cf7d13b-3963-4e88-b706-96e45eb88f2d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:14.969850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cf7d13b-3963-4e88-b706-96e45eb88f2d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:14.971013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cf7d13b-3963-4e88-b706-96e45eb88f2d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:14.973383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cf7d13b-3963-4e88-b706-96e45eb88f2d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:14.974465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cf7d13b-3963-4e88-b706-96e45eb88f2d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:14.976122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cf7d13b-3963-4e88-b706-96e45eb88f2d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:14.982688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e229af96-ff9f-4922-968a-6091a4386a81 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:50:14.983550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e229af96-ff9f-4922-968a-6091a4386a81 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:50:14.983775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e229af96-ff9f-4922-968a-6091a4386a81 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:50:14.983995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e229af96-ff9f-4922-968a-6091a4386a81 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:50:14.984412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e229af96-ff9f-4922-968a-6091a4386a81 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:50:15.006513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e229af96-ff9f-4922-968a-6091a4386a81 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:15.007494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e229af96-ff9f-4922-968a-6091a4386a81 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:15.008171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e229af96-ff9f-4922-968a-6091a4386a81 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:15.009223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e229af96-ff9f-4922-968a-6091a4386a81 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:15.009949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e229af96-ff9f-4922-968a-6091a4386a81 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:15.010643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e229af96-ff9f-4922-968a-6091a4386a81 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:15.028281 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-3cf7d13b-3963-4e88-b706-96e45eb88f2d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Getting quotas for project 55ea9c8446d545d1ae1bd49f67d6008b. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:50:15.047723 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-3cf7d13b-3963-4e88-b706-96e45eb88f2d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Getting quotas for user 73853219b29241269ce4bb94155b204e and project 55ea9c8446d545d1ae1bd49f67d6008b. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:50:15.062170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e229af96-ff9f-4922-968a-6091a4386a81 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Getting quotas for project 8e605280bfcc43c6862a1181dabb3d2f. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:50:15.077815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-e229af96-ff9f-4922-968a-6091a4386a81 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Getting quotas for user 5da37082c7e74cc3be74ce6104983f03 and project 8e605280bfcc43c6862a1181dabb3d2f. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:50:15.084609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3cf7d13b-3963-4e88-b706-96e45eb88f2d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:50:15.089796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3cf7d13b-3963-4e88-b706-96e45eb88f2d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:50:15.102401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e229af96-ff9f-4922-968a-6091a4386a81 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:50:15.104657 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e229af96-ff9f-4922-968a-6091a4386a81 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 0f92440f-8b32-4731-8383-d9e57e575ae7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:50:15.208282 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e229af96-ff9f-4922-968a-6091a4386a81 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.978438 Sep 07 12:50:15.215769 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1943/3854] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:50:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:50:15.221161 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-90ab9f20-ca84-4721-8537-192af051085c req-f4822331-09cc-4bd3-8a1d-64e4f9b184a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9352ac2-475e-4c77-aa85-5ecd566563b2", "tag": "ac84729b-c148-47a6-8ee7-4895a2aef8ac"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:15.238191 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3cf7d13b-3963-4e88-b706-96e45eb88f2d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.974679 Sep 07 12:50:15.240596 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1912/3855] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:50:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 5980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:50:15.253422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-90ab9f20-ca84-4721-8537-192af051085c req-f4822331-09cc-4bd3-8a1d-64e4f9b184a8 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:15.254568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5698095e-689d-4f35-842c-5ae809ee5382 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:15.255429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5698095e-689d-4f35-842c-5ae809ee5382 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:15.258901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-90ab9f20-ca84-4721-8537-192af051085c req-f4822331-09cc-4bd3-8a1d-64e4f9b184a8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:15.261750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-90ab9f20-ca84-4721-8537-192af051085c req-f4822331-09cc-4bd3-8a1d-64e4f9b184a8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:15.280346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5698095e-689d-4f35-842c-5ae809ee5382 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:15.280802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5698095e-689d-4f35-842c-5ae809ee5382 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:15.281315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5698095e-689d-4f35-842c-5ae809ee5382 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:15.283114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5698095e-689d-4f35-842c-5ae809ee5382 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:15.288862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5698095e-689d-4f35-842c-5ae809ee5382 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:15.295318 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5698095e-689d-4f35-842c-5ae809ee5382 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:15.379953 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-90ab9f20-ca84-4721-8537-192af051085c req-f4822331-09cc-4bd3-8a1d-64e4f9b184a8 service nova] Creating event network-changed:ac84729b-c148-47a6-8ee7-4895a2aef8ac for instance e9352ac2-475e-4c77-aa85-5ecd566563b2 on n-h2-852087-9 Sep 07 12:50:15.400299 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-90ab9f20-ca84-4721-8537-192af051085c req-f4822331-09cc-4bd3-8a1d-64e4f9b184a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179164 Sep 07 12:50:15.402619 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1944/3856] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:50:15.415796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c2fa2f85-693f-49c7-9282-5f761df437d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:15.420844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c2fa2f85-693f-49c7-9282-5f761df437d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:15.448610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2fa2f85-693f-49c7-9282-5f761df437d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:15.449452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2fa2f85-693f-49c7-9282-5f761df437d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:15.450922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2fa2f85-693f-49c7-9282-5f761df437d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:15.452473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2fa2f85-693f-49c7-9282-5f761df437d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:15.453163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2fa2f85-693f-49c7-9282-5f761df437d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:15.453818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2fa2f85-693f-49c7-9282-5f761df437d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:17.535311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c2fa2f85-693f-49c7-9282-5f761df437d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:17.551298 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c2fa2f85-693f-49c7-9282-5f761df437d9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1511 microversion: 2.1 time: 2.146178 Sep 07 12:50:17.552365 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1945/3857] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:15 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1511 bytes in 2149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:17.563091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-03938224-af6e-47b5-98b1-c3c028cf98b2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:17.564961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-03938224-af6e-47b5-98b1-c3c028cf98b2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:17.576291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03938224-af6e-47b5-98b1-c3c028cf98b2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:17.577244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03938224-af6e-47b5-98b1-c3c028cf98b2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:17.578451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03938224-af6e-47b5-98b1-c3c028cf98b2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:17.579705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03938224-af6e-47b5-98b1-c3c028cf98b2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:17.580423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03938224-af6e-47b5-98b1-c3c028cf98b2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:17.581977 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03938224-af6e-47b5-98b1-c3c028cf98b2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:17.608265 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5698095e-689d-4f35-842c-5ae809ee5382 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:17.624684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5698095e-689d-4f35-842c-5ae809ee5382 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:17.639907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5698095e-689d-4f35-842c-5ae809ee5382 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:17.656353 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5698095e-689d-4f35-842c-5ae809ee5382 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 2.413890 Sep 07 12:50:17.657452 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1913/3858] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:15 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 2416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:17.672583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea01efaf-1d74-4b4d-82fd-6e827c73f2ac tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1615027821", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "451", "networks": [{"uuid": "c374f8e6-3b32-4ce6-8a44-64bb5ff02ec6"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:17.826282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-ea01efaf-1d74-4b4d-82fd-6e827c73f2ac tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] validate_networks() for [('c374f8e6-3b32-4ce6-8a44-64bb5ff02ec6', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:50:18.538070 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-03938224-af6e-47b5-98b1-c3c028cf98b2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:18.544515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:18.556494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-03938224-af6e-47b5-98b1-c3c028cf98b2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:18.558419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-03938224-af6e-47b5-98b1-c3c028cf98b2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:18.560502 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-03938224-af6e-47b5-98b1-c3c028cf98b2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1407 microversion: 2.20 time: 1.005579 Sep 07 12:50:18.561721 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1946/3859] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:17 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1407 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:18.571412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-339da4bb-b266-45df-84d5-d2a37a5250cb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:18.573177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-339da4bb-b266-45df-84d5-d2a37a5250cb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 0f92440f-8b32-4731-8383-d9e57e575ae7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:18.605550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-339da4bb-b266-45df-84d5-d2a37a5250cb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:18.607582 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-339da4bb-b266-45df-84d5-d2a37a5250cb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:18.608530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-339da4bb-b266-45df-84d5-d2a37a5250cb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:18.609973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-339da4bb-b266-45df-84d5-d2a37a5250cb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:18.610854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-339da4bb-b266-45df-84d5-d2a37a5250cb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:18.611655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-339da4bb-b266-45df-84d5-d2a37a5250cb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:18.825749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-339da4bb-b266-45df-84d5-d2a37a5250cb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:18.856909 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-339da4bb-b266-45df-84d5-d2a37a5250cb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7" status: 200 len: 1275 microversion: 2.1 time: 0.290254 Sep 07 12:50:18.861238 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1947/3860] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:18 2022] GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7 => generated 1275 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:18.904954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8020aa0d-c644-4283-a608-f4470db32919 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:18.906796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8020aa0d-c644-4283-a608-f4470db32919 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:18.931496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8020aa0d-c644-4283-a608-f4470db32919 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:18.932997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8020aa0d-c644-4283-a608-f4470db32919 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:18.934064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8020aa0d-c644-4283-a608-f4470db32919 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:18.935591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8020aa0d-c644-4283-a608-f4470db32919 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:18.936549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8020aa0d-c644-4283-a608-f4470db32919 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:18.937884 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8020aa0d-c644-4283-a608-f4470db32919 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:19.207202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8020aa0d-c644-4283-a608-f4470db32919 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:19.227145 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8020aa0d-c644-4283-a608-f4470db32919 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1272 microversion: 2.1 time: 0.360612 Sep 07 12:50:19.228204 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1948/3861] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:18 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1272 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:19.249473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-dce82f0e-f900-4f53-92c9-c47c667938e7 req-81a33bca-a1c6-481f-891a-5b8d0fb40b9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "290d9a42-9d80-495f-8e45-879687fea820", "tag": "732db7ed-1d4a-40a0-984a-7df4b79e7f0d"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:19.261250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-dce82f0e-f900-4f53-92c9-c47c667938e7 req-81a33bca-a1c6-481f-891a-5b8d0fb40b9e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:19.262133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-dce82f0e-f900-4f53-92c9-c47c667938e7 req-81a33bca-a1c6-481f-891a-5b8d0fb40b9e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:19.263000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-dce82f0e-f900-4f53-92c9-c47c667938e7 req-81a33bca-a1c6-481f-891a-5b8d0fb40b9e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:19.315396 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-dce82f0e-f900-4f53-92c9-c47c667938e7 req-81a33bca-a1c6-481f-891a-5b8d0fb40b9e service nova] Creating event network-changed:732db7ed-1d4a-40a0-984a-7df4b79e7f0d for instance 290d9a42-9d80-495f-8e45-879687fea820 on n-h2-852087-9 Sep 07 12:50:19.321268 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-dce82f0e-f900-4f53-92c9-c47c667938e7 req-81a33bca-a1c6-481f-891a-5b8d0fb40b9e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076019 Sep 07 12:50:19.322671 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1949/3862] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:50:19.330292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bb2a52d2-b37e-4026-bbe3-d75f4fd76e06 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:19.332415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bb2a52d2-b37e-4026-bbe3-d75f4fd76e06 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:19.340334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb2a52d2-b37e-4026-bbe3-d75f4fd76e06 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:19.341423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb2a52d2-b37e-4026-bbe3-d75f4fd76e06 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:19.342191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb2a52d2-b37e-4026-bbe3-d75f4fd76e06 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:19.343225 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb2a52d2-b37e-4026-bbe3-d75f4fd76e06 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:19.343965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb2a52d2-b37e-4026-bbe3-d75f4fd76e06 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:19.344718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb2a52d2-b37e-4026-bbe3-d75f4fd76e06 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:20.507094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bb2a52d2-b37e-4026-bbe3-d75f4fd76e06 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:20.526252 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bb2a52d2-b37e-4026-bbe3-d75f4fd76e06 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1511 microversion: 2.1 time: 1.201613 Sep 07 12:50:20.528053 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1950/3863] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:19 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1511 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:20.539937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-731bc775-e45f-4d30-aa35-905397752487 req-ffe9e115-387f-4c3e-8b5d-e42133ca5133 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9352ac2-475e-4c77-aa85-5ecd566563b2", "tag": "763b76c0-527c-4cf7-87d0-1d9905756999"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:20.564377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-731bc775-e45f-4d30-aa35-905397752487 req-ffe9e115-387f-4c3e-8b5d-e42133ca5133 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:20.565928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-731bc775-e45f-4d30-aa35-905397752487 req-ffe9e115-387f-4c3e-8b5d-e42133ca5133 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:20.567004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-731bc775-e45f-4d30-aa35-905397752487 req-ffe9e115-387f-4c3e-8b5d-e42133ca5133 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:20.609992 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-731bc775-e45f-4d30-aa35-905397752487 req-ffe9e115-387f-4c3e-8b5d-e42133ca5133 service nova] Creating event network-changed:763b76c0-527c-4cf7-87d0-1d9905756999 for instance e9352ac2-475e-4c77-aa85-5ecd566563b2 on n-h2-852087-9 Sep 07 12:50:20.627942 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-731bc775-e45f-4d30-aa35-905397752487 req-ffe9e115-387f-4c3e-8b5d-e42133ca5133 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096857 Sep 07 12:50:20.630065 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1951/3864] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:50:20.649398 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5e62d5b6-3f4b-4ccd-94f4-010c4cad704e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:20.652444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5e62d5b6-3f4b-4ccd-94f4-010c4cad704e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:20.691229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e62d5b6-3f4b-4ccd-94f4-010c4cad704e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:20.691731 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e62d5b6-3f4b-4ccd-94f4-010c4cad704e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:20.692170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e62d5b6-3f4b-4ccd-94f4-010c4cad704e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:20.692896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e62d5b6-3f4b-4ccd-94f4-010c4cad704e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:20.702504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e62d5b6-3f4b-4ccd-94f4-010c4cad704e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:20.703689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e62d5b6-3f4b-4ccd-94f4-010c4cad704e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:20.744022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-ea01efaf-1d74-4b4d-82fd-6e827c73f2ac tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:50:20.745375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-ea01efaf-1d74-4b4d-82fd-6e827c73f2ac tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:50:20.746020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-ea01efaf-1d74-4b4d-82fd-6e827c73f2ac tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:50:20.747480 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-ea01efaf-1d74-4b4d-82fd-6e827c73f2ac tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:50:20.748420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-ea01efaf-1d74-4b4d-82fd-6e827c73f2ac tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:50:20.793817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea01efaf-1d74-4b4d-82fd-6e827c73f2ac tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:20.797099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea01efaf-1d74-4b4d-82fd-6e827c73f2ac tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:20.799576 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea01efaf-1d74-4b4d-82fd-6e827c73f2ac tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:20.801517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea01efaf-1d74-4b4d-82fd-6e827c73f2ac tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:20.806150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea01efaf-1d74-4b4d-82fd-6e827c73f2ac tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:20.809444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea01efaf-1d74-4b4d-82fd-6e827c73f2ac tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:20.870914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-ea01efaf-1d74-4b4d-82fd-6e827c73f2ac tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Getting quotas for project ab7bfa5688d5406da8f755efff3cf54e. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:50:20.887449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-ea01efaf-1d74-4b4d-82fd-6e827c73f2ac tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Getting quotas for user 30c27a3ca32e4f4d976d1351372b0fb1 and project ab7bfa5688d5406da8f755efff3cf54e. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:50:20.918363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ea01efaf-1d74-4b4d-82fd-6e827c73f2ac tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:50:20.930553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ea01efaf-1d74-4b4d-82fd-6e827c73f2ac tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 99bf1197-df2d-4baa-adbe-dc0032977a9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:50:21.132950 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ea01efaf-1d74-4b4d-82fd-6e827c73f2ac tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.473920 Sep 07 12:50:21.145188 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1914/3865] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:50:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 3487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:50:21.152592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5bd71e6b-ed79-42e2-934b-63565e4d20b0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:21.155290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5bd71e6b-ed79-42e2-934b-63565e4d20b0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:21.175539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bd71e6b-ed79-42e2-934b-63565e4d20b0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:21.176465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bd71e6b-ed79-42e2-934b-63565e4d20b0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:21.177890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bd71e6b-ed79-42e2-934b-63565e4d20b0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:21.179059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bd71e6b-ed79-42e2-934b-63565e4d20b0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:21.194311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bd71e6b-ed79-42e2-934b-63565e4d20b0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:21.195578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bd71e6b-ed79-42e2-934b-63565e4d20b0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:21.595875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5e62d5b6-3f4b-4ccd-94f4-010c4cad704e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:21.613251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5e62d5b6-3f4b-4ccd-94f4-010c4cad704e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:21.617866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5e62d5b6-3f4b-4ccd-94f4-010c4cad704e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:21.620262 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5e62d5b6-3f4b-4ccd-94f4-010c4cad704e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.986148 Sep 07 12:50:21.622791 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1952/3866] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:20 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:21.632307 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ba59922c-9bd8-4879-908d-8c09f7f80681 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:21.633099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ba59922c-9bd8-4879-908d-8c09f7f80681 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 0f92440f-8b32-4731-8383-d9e57e575ae7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:21.655178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba59922c-9bd8-4879-908d-8c09f7f80681 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:21.656052 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba59922c-9bd8-4879-908d-8c09f7f80681 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:21.656868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba59922c-9bd8-4879-908d-8c09f7f80681 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:21.657671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba59922c-9bd8-4879-908d-8c09f7f80681 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:21.658459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba59922c-9bd8-4879-908d-8c09f7f80681 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:21.659143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba59922c-9bd8-4879-908d-8c09f7f80681 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:22.005434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5bd71e6b-ed79-42e2-934b-63565e4d20b0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:22.028631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5bd71e6b-ed79-42e2-934b-63565e4d20b0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:22.035084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5bd71e6b-ed79-42e2-934b-63565e4d20b0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:22.037173 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5bd71e6b-ed79-42e2-934b-63565e4d20b0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1407 microversion: 2.20 time: 0.890249 Sep 07 12:50:22.051735 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1915/3867] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:21 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1407 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:22.064772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-16331a21-e7a7-4f01-ae5d-bf4f7297fb69 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:22.065764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-16331a21-e7a7-4f01-ae5d-bf4f7297fb69 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:22.078074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16331a21-e7a7-4f01-ae5d-bf4f7297fb69 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:22.082354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16331a21-e7a7-4f01-ae5d-bf4f7297fb69 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:22.083899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16331a21-e7a7-4f01-ae5d-bf4f7297fb69 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:22.087243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16331a21-e7a7-4f01-ae5d-bf4f7297fb69 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:22.096595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16331a21-e7a7-4f01-ae5d-bf4f7297fb69 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:22.097975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16331a21-e7a7-4f01-ae5d-bf4f7297fb69 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:22.583100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ba59922c-9bd8-4879-908d-8c09f7f80681 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:22.594122 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ba59922c-9bd8-4879-908d-8c09f7f80681 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7" status: 200 len: 1317 microversion: 2.1 time: 0.969815 Sep 07 12:50:22.595413 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1953/3868] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:21 2022] GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7 => generated 1317 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:22.601575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fcb1ff0b-a880-4fe0-8413-8380bfafbc63 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:22.603771 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fcb1ff0b-a880-4fe0-8413-8380bfafbc63 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 99bf1197-df2d-4baa-adbe-dc0032977a9c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:22.611920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcb1ff0b-a880-4fe0-8413-8380bfafbc63 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:22.612766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcb1ff0b-a880-4fe0-8413-8380bfafbc63 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:22.613584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcb1ff0b-a880-4fe0-8413-8380bfafbc63 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:22.614669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcb1ff0b-a880-4fe0-8413-8380bfafbc63 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:22.615373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcb1ff0b-a880-4fe0-8413-8380bfafbc63 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:22.616045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcb1ff0b-a880-4fe0-8413-8380bfafbc63 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:22.806972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fcb1ff0b-a880-4fe0-8413-8380bfafbc63 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:22.825872 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fcb1ff0b-a880-4fe0-8413-8380bfafbc63 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c" status: 200 len: 1273 microversion: 2.1 time: 0.228232 Sep 07 12:50:22.827605 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1954/3869] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:22 2022] GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c => generated 1273 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:22.838610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-010a6d9b-5cbb-4817-a2c8-1c52425899d4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:22.840330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-010a6d9b-5cbb-4817-a2c8-1c52425899d4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:22.853943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-010a6d9b-5cbb-4817-a2c8-1c52425899d4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:22.855179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-010a6d9b-5cbb-4817-a2c8-1c52425899d4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:22.855939 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-010a6d9b-5cbb-4817-a2c8-1c52425899d4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:22.856879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-010a6d9b-5cbb-4817-a2c8-1c52425899d4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:22.857666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-010a6d9b-5cbb-4817-a2c8-1c52425899d4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:22.858349 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-010a6d9b-5cbb-4817-a2c8-1c52425899d4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:22.955922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-16331a21-e7a7-4f01-ae5d-bf4f7297fb69 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:22.971720 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-16331a21-e7a7-4f01-ae5d-bf4f7297fb69 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1312 microversion: 2.1 time: 0.918051 Sep 07 12:50:22.973629 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1916/3870] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:22 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1312 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:22.982422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-dc00bb9e-3d7c-4dc7-ac89-1a1625a3d1dc req-b68d83f6-e173-4c55-a839-a781f8843fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f92440f-8b32-4731-8383-d9e57e575ae7", "tag": "27516518-fb56-48fd-82b9-87d4f320e9c5"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:23.002737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dc00bb9e-3d7c-4dc7-ac89-1a1625a3d1dc req-b68d83f6-e173-4c55-a839-a781f8843fa5 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:23.003603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dc00bb9e-3d7c-4dc7-ac89-1a1625a3d1dc req-b68d83f6-e173-4c55-a839-a781f8843fa5 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:23.004705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dc00bb9e-3d7c-4dc7-ac89-1a1625a3d1dc req-b68d83f6-e173-4c55-a839-a781f8843fa5 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:23.027291 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-dc00bb9e-3d7c-4dc7-ac89-1a1625a3d1dc req-b68d83f6-e173-4c55-a839-a781f8843fa5 service nova] Creating event network-changed:27516518-fb56-48fd-82b9-87d4f320e9c5 for instance 0f92440f-8b32-4731-8383-d9e57e575ae7 on n-h1-852087-9 Sep 07 12:50:23.036530 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-dc00bb9e-3d7c-4dc7-ac89-1a1625a3d1dc req-b68d83f6-e173-4c55-a839-a781f8843fa5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060684 Sep 07 12:50:23.037631 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1917/3871] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:50:23.047645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0f0ea7a3-ef15-4b3f-9c2c-08fdd3940410 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:23.048652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0f0ea7a3-ef15-4b3f-9c2c-08fdd3940410 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:23.060324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f0ea7a3-ef15-4b3f-9c2c-08fdd3940410 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:23.064251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f0ea7a3-ef15-4b3f-9c2c-08fdd3940410 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:23.065756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f0ea7a3-ef15-4b3f-9c2c-08fdd3940410 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:23.069203 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f0ea7a3-ef15-4b3f-9c2c-08fdd3940410 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:23.070822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f0ea7a3-ef15-4b3f-9c2c-08fdd3940410 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:23.072181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f0ea7a3-ef15-4b3f-9c2c-08fdd3940410 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:23.309384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-010a6d9b-5cbb-4817-a2c8-1c52425899d4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:23.326541 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-010a6d9b-5cbb-4817-a2c8-1c52425899d4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1488 microversion: 2.1 time: 0.496351 Sep 07 12:50:23.331228 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1955/3872] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:22 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1488 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:23.362751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-6fb4b1db-65a2-4914-b80a-767619a4090f req-13f60068-c02b-49a7-9dd7-363cec330d07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe6581c-7070-48c5-a16d-fa30b22567d4", "tag": "57759270-a8de-4adc-a2ba-ccbb3e371878"}, {"name": "network-changed", "server_uuid": "e9352ac2-475e-4c77-aa85-5ecd566563b2", "tag": "6dd24b36-3c01-41dd-97ac-f83db2b44791"}, {"name": "network-changed", "server_uuid": "6aaad486-bd76-4c89-af5b-3443b3d53da0", "tag": "907dde1f-7429-4a22-9b69-83154943daee"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:23.393662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6fb4b1db-65a2-4914-b80a-767619a4090f req-13f60068-c02b-49a7-9dd7-363cec330d07 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:23.394515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6fb4b1db-65a2-4914-b80a-767619a4090f req-13f60068-c02b-49a7-9dd7-363cec330d07 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:23.395267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6fb4b1db-65a2-4914-b80a-767619a4090f req-13f60068-c02b-49a7-9dd7-363cec330d07 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:23.432566 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-6fb4b1db-65a2-4914-b80a-767619a4090f req-13f60068-c02b-49a7-9dd7-363cec330d07 service nova] Creating event network-changed:57759270-a8de-4adc-a2ba-ccbb3e371878 for instance ffe6581c-7070-48c5-a16d-fa30b22567d4 on n-h2-852087-9 Sep 07 12:50:23.433267 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-6fb4b1db-65a2-4914-b80a-767619a4090f req-13f60068-c02b-49a7-9dd7-363cec330d07 service nova] Creating event network-changed:6dd24b36-3c01-41dd-97ac-f83db2b44791 for instance e9352ac2-475e-4c77-aa85-5ecd566563b2 on n-h2-852087-9 Sep 07 12:50:23.433956 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-6fb4b1db-65a2-4914-b80a-767619a4090f req-13f60068-c02b-49a7-9dd7-363cec330d07 service nova] Creating event network-changed:907dde1f-7429-4a22-9b69-83154943daee for instance 6aaad486-bd76-4c89-af5b-3443b3d53da0 on n-h1-852087-9 Sep 07 12:50:23.464327 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-6fb4b1db-65a2-4914-b80a-767619a4090f req-13f60068-c02b-49a7-9dd7-363cec330d07 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.114292 Sep 07 12:50:23.483075 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1956/3873] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:50:23.507662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4aca98fe-3880-4d8b-88e9-2a21185e59f4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:23.510199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4aca98fe-3880-4d8b-88e9-2a21185e59f4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:23.536700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4aca98fe-3880-4d8b-88e9-2a21185e59f4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:23.537888 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4aca98fe-3880-4d8b-88e9-2a21185e59f4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:23.540160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4aca98fe-3880-4d8b-88e9-2a21185e59f4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:23.541765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4aca98fe-3880-4d8b-88e9-2a21185e59f4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:23.542723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4aca98fe-3880-4d8b-88e9-2a21185e59f4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:23.543500 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4aca98fe-3880-4d8b-88e9-2a21185e59f4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:23.920001 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0f0ea7a3-ef15-4b3f-9c2c-08fdd3940410 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:23.938487 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0f0ea7a3-ef15-4b3f-9c2c-08fdd3940410 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:23.941664 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0f0ea7a3-ef15-4b3f-9c2c-08fdd3940410 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:23.944029 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0f0ea7a3-ef15-4b3f-9c2c-08fdd3940410 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.903827 Sep 07 12:50:23.949101 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1918/3874] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:23 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:23.955758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-60a21cf2-759d-4061-9e2f-9285585699ec tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:23.960673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-60a21cf2-759d-4061-9e2f-9285585699ec tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:23.972457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60a21cf2-759d-4061-9e2f-9285585699ec tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:23.974120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60a21cf2-759d-4061-9e2f-9285585699ec tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:23.975172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60a21cf2-759d-4061-9e2f-9285585699ec tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:23.976699 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60a21cf2-759d-4061-9e2f-9285585699ec tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:23.977848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60a21cf2-759d-4061-9e2f-9285585699ec tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:23.978982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60a21cf2-759d-4061-9e2f-9285585699ec tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:24.015264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4aca98fe-3880-4d8b-88e9-2a21185e59f4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:24.036274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4aca98fe-3880-4d8b-88e9-2a21185e59f4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:24.040498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4aca98fe-3880-4d8b-88e9-2a21185e59f4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:24.042805 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4aca98fe-3880-4d8b-88e9-2a21185e59f4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1407 microversion: 2.20 time: 0.555062 Sep 07 12:50:24.043920 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1957/3875] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:23 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1407 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:24.056980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-2a98c7e2-8d8b-431d-9bb9-14ea136ff8e7 req-934853ce-8e43-4d22-b194-f131dfadb1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "290d9a42-9d80-495f-8e45-879687fea820", "name": "network-vif-plugged", "status": "completed", "tag": "732db7ed-1d4a-40a0-984a-7df4b79e7f0d"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:24.079616 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2a98c7e2-8d8b-431d-9bb9-14ea136ff8e7 req-934853ce-8e43-4d22-b194-f131dfadb1f7 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:24.080600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2a98c7e2-8d8b-431d-9bb9-14ea136ff8e7 req-934853ce-8e43-4d22-b194-f131dfadb1f7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:24.081424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2a98c7e2-8d8b-431d-9bb9-14ea136ff8e7 req-934853ce-8e43-4d22-b194-f131dfadb1f7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:24.098555 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-2a98c7e2-8d8b-431d-9bb9-14ea136ff8e7 req-934853ce-8e43-4d22-b194-f131dfadb1f7 service nova] Creating event network-vif-plugged:732db7ed-1d4a-40a0-984a-7df4b79e7f0d for instance 290d9a42-9d80-495f-8e45-879687fea820 on n-h2-852087-9 Sep 07 12:50:24.107646 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-2a98c7e2-8d8b-431d-9bb9-14ea136ff8e7 req-934853ce-8e43-4d22-b194-f131dfadb1f7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061438 Sep 07 12:50:24.109712 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1958/3876] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:50:24.135174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1997c894-eedb-4958-888c-a61fad23077a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:24.137044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1997c894-eedb-4958-888c-a61fad23077a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 0f92440f-8b32-4731-8383-d9e57e575ae7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:24.155462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1997c894-eedb-4958-888c-a61fad23077a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:24.156162 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1997c894-eedb-4958-888c-a61fad23077a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:24.156694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1997c894-eedb-4958-888c-a61fad23077a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:24.158303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1997c894-eedb-4958-888c-a61fad23077a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:24.158989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1997c894-eedb-4958-888c-a61fad23077a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:24.159522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1997c894-eedb-4958-888c-a61fad23077a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:24.911174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1997c894-eedb-4958-888c-a61fad23077a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:24.919866 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1997c894-eedb-4958-888c-a61fad23077a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7" status: 200 len: 1317 microversion: 2.1 time: 0.805932 Sep 07 12:50:24.929878 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1959/3877] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:24 2022] GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7 => generated 1317 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:24.937961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-db5f3625-a87d-4202-8e70-a90117da6fb8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:24.938597 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-db5f3625-a87d-4202-8e70-a90117da6fb8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 99bf1197-df2d-4baa-adbe-dc0032977a9c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:24.945438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db5f3625-a87d-4202-8e70-a90117da6fb8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:24.946003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db5f3625-a87d-4202-8e70-a90117da6fb8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:24.946454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db5f3625-a87d-4202-8e70-a90117da6fb8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:24.947201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db5f3625-a87d-4202-8e70-a90117da6fb8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:24.947698 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db5f3625-a87d-4202-8e70-a90117da6fb8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:24.948136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db5f3625-a87d-4202-8e70-a90117da6fb8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:25.022280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:25.037275 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-db5f3625-a87d-4202-8e70-a90117da6fb8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:25.050285 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-db5f3625-a87d-4202-8e70-a90117da6fb8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c" status: 200 len: 1279 microversion: 2.1 time: 0.117605 Sep 07 12:50:25.051418 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1960/3878] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:24 2022] GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c => generated 1279 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:25.058971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c3efdbc8-a877-40b3-ae0a-8289c456690d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:25.059791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c3efdbc8-a877-40b3-ae0a-8289c456690d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:25.068942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3efdbc8-a877-40b3-ae0a-8289c456690d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:25.070384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3efdbc8-a877-40b3-ae0a-8289c456690d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:25.071194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3efdbc8-a877-40b3-ae0a-8289c456690d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:25.072497 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3efdbc8-a877-40b3-ae0a-8289c456690d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:25.073307 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3efdbc8-a877-40b3-ae0a-8289c456690d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:25.074260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3efdbc8-a877-40b3-ae0a-8289c456690d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:25.104249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=18 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:25.294730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c3efdbc8-a877-40b3-ae0a-8289c456690d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:25.303822 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c3efdbc8-a877-40b3-ae0a-8289c456690d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1333 microversion: 2.1 time: 0.250500 Sep 07 12:50:25.304443 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1961/3879] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:25 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1333 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:25.309568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7f3b61a4-0ad2-4756-a4f2-cc6192d5b824 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:25.310272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7f3b61a4-0ad2-4756-a4f2-cc6192d5b824 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:25.317759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f3b61a4-0ad2-4756-a4f2-cc6192d5b824 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:25.318271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f3b61a4-0ad2-4756-a4f2-cc6192d5b824 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:25.318951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f3b61a4-0ad2-4756-a4f2-cc6192d5b824 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:25.319994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f3b61a4-0ad2-4756-a4f2-cc6192d5b824 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:25.320424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f3b61a4-0ad2-4756-a4f2-cc6192d5b824 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:25.320883 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7f3b61a4-0ad2-4756-a4f2-cc6192d5b824 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:25.787172 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7f3b61a4-0ad2-4756-a4f2-cc6192d5b824 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:25.801130 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7f3b61a4-0ad2-4756-a4f2-cc6192d5b824 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:25.802697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7f3b61a4-0ad2-4756-a4f2-cc6192d5b824 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:25.804028 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7f3b61a4-0ad2-4756-a4f2-cc6192d5b824 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.498531 Sep 07 12:50:25.804640 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1962/3880] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:25 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:25.827736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-354b2b63-52e8-4458-9a9b-0a627f93a604 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:25.830007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-354b2b63-52e8-4458-9a9b-0a627f93a604 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:25.839584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-354b2b63-52e8-4458-9a9b-0a627f93a604 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:25.840081 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-354b2b63-52e8-4458-9a9b-0a627f93a604 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:25.840755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-354b2b63-52e8-4458-9a9b-0a627f93a604 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:25.841705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-354b2b63-52e8-4458-9a9b-0a627f93a604 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:25.842453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-354b2b63-52e8-4458-9a9b-0a627f93a604 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:25.842895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-354b2b63-52e8-4458-9a9b-0a627f93a604 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:26.450451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-354b2b63-52e8-4458-9a9b-0a627f93a604 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:26.466935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-354b2b63-52e8-4458-9a9b-0a627f93a604 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:26.471835 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-60a21cf2-759d-4061-9e2f-9285585699ec tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action" status: 200 len: 154 microversion: 2.1 time: 2.524093 Sep 07 12:50:26.485749 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1919/3881] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:50:23 2022] POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action => generated 154 bytes in 2527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:50:26.486852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-354b2b63-52e8-4458-9a9b-0a627f93a604 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:26.494892 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-354b2b63-52e8-4458-9a9b-0a627f93a604 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1407 microversion: 2.20 time: 0.674102 Sep 07 12:50:26.500229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-fa30c74d-ecc5-4531-8e6c-802ec4f7f56a req-3fc63df5-c8a0-42e9-a77c-16e4af5d92b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9352ac2-475e-4c77-aa85-5ecd566563b2", "tag": "2d928931-3783-4efe-a479-33f49c27cfb9"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:26.504838 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1963/3882] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:25 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1407 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:26.520599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b2178de9-778d-49e0-9301-3d3bc90fa0b7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:26.525532 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b2178de9-778d-49e0-9301-3d3bc90fa0b7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 0f92440f-8b32-4731-8383-d9e57e575ae7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:26.542731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fa30c74d-ecc5-4531-8e6c-802ec4f7f56a req-3fc63df5-c8a0-42e9-a77c-16e4af5d92b5 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:26.544053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fa30c74d-ecc5-4531-8e6c-802ec4f7f56a req-3fc63df5-c8a0-42e9-a77c-16e4af5d92b5 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:26.545106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fa30c74d-ecc5-4531-8e6c-802ec4f7f56a req-3fc63df5-c8a0-42e9-a77c-16e4af5d92b5 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:26.552675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2178de9-778d-49e0-9301-3d3bc90fa0b7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:26.553646 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2178de9-778d-49e0-9301-3d3bc90fa0b7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:26.554816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2178de9-778d-49e0-9301-3d3bc90fa0b7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:26.556209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2178de9-778d-49e0-9301-3d3bc90fa0b7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:26.557048 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2178de9-778d-49e0-9301-3d3bc90fa0b7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:26.558434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2178de9-778d-49e0-9301-3d3bc90fa0b7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:26.591921 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-fa30c74d-ecc5-4531-8e6c-802ec4f7f56a req-3fc63df5-c8a0-42e9-a77c-16e4af5d92b5 service nova] Creating event network-changed:2d928931-3783-4efe-a479-33f49c27cfb9 for instance e9352ac2-475e-4c77-aa85-5ecd566563b2 on n-h2-852087-9 Sep 07 12:50:26.601623 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-fa30c74d-ecc5-4531-8e6c-802ec4f7f56a req-3fc63df5-c8a0-42e9-a77c-16e4af5d92b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122707 Sep 07 12:50:26.603168 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1920/3883] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:50:26.613410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cd59ab8e-ae1a-4a8c-83df-8453ce063394 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:26.615337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cd59ab8e-ae1a-4a8c-83df-8453ce063394 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 99bf1197-df2d-4baa-adbe-dc0032977a9c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:26.628369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd59ab8e-ae1a-4a8c-83df-8453ce063394 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:26.633086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd59ab8e-ae1a-4a8c-83df-8453ce063394 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:26.633086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd59ab8e-ae1a-4a8c-83df-8453ce063394 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:26.633785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd59ab8e-ae1a-4a8c-83df-8453ce063394 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:26.634149 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd59ab8e-ae1a-4a8c-83df-8453ce063394 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:26.634882 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd59ab8e-ae1a-4a8c-83df-8453ce063394 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:26.976022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cd59ab8e-ae1a-4a8c-83df-8453ce063394 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:26.990117 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cd59ab8e-ae1a-4a8c-83df-8453ce063394 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c" status: 200 len: 1279 microversion: 2.1 time: 0.383970 Sep 07 12:50:27.007555 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1921/3884] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:26 2022] GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c => generated 1279 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:27.022555 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5a3d26d4-07a7-4d34-b9fa-635defee2e5b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:27.023492 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5a3d26d4-07a7-4d34-b9fa-635defee2e5b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:27.032433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a3d26d4-07a7-4d34-b9fa-635defee2e5b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:27.033148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a3d26d4-07a7-4d34-b9fa-635defee2e5b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:27.033906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a3d26d4-07a7-4d34-b9fa-635defee2e5b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:27.035032 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a3d26d4-07a7-4d34-b9fa-635defee2e5b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:27.035766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a3d26d4-07a7-4d34-b9fa-635defee2e5b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:27.036332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a3d26d4-07a7-4d34-b9fa-635defee2e5b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:27.605453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b2178de9-778d-49e0-9301-3d3bc90fa0b7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:27.641644 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b2178de9-778d-49e0-9301-3d3bc90fa0b7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7" status: 200 len: 1317 microversion: 2.1 time: 1.133201 Sep 07 12:50:27.650598 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1964/3885] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:26 2022] GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7 => generated 1317 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:27.665637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1435efaf-f987-4a83-8459-f39af789ad88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:27.673167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1435efaf-f987-4a83-8459-f39af789ad88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:27.739922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1435efaf-f987-4a83-8459-f39af789ad88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:27.751320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1435efaf-f987-4a83-8459-f39af789ad88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:27.752437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1435efaf-f987-4a83-8459-f39af789ad88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:27.754657 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1435efaf-f987-4a83-8459-f39af789ad88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:27.756937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1435efaf-f987-4a83-8459-f39af789ad88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:27.758145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1435efaf-f987-4a83-8459-f39af789ad88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:28.070449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5a3d26d4-07a7-4d34-b9fa-635defee2e5b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:28.094301 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5a3d26d4-07a7-4d34-b9fa-635defee2e5b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1333 microversion: 2.1 time: 1.085477 Sep 07 12:50:28.105993 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1922/3886] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:27 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1333 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:28.115587 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9239af4f-1d50-48e1-b2df-9c1a72602707 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:28.127177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9239af4f-1d50-48e1-b2df-9c1a72602707 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:28.140149 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9239af4f-1d50-48e1-b2df-9c1a72602707 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:28.141439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9239af4f-1d50-48e1-b2df-9c1a72602707 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:28.142582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9239af4f-1d50-48e1-b2df-9c1a72602707 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:28.144166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9239af4f-1d50-48e1-b2df-9c1a72602707 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:28.145662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9239af4f-1d50-48e1-b2df-9c1a72602707 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:28.146727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9239af4f-1d50-48e1-b2df-9c1a72602707 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:29.044638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1435efaf-f987-4a83-8459-f39af789ad88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:29.100401 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1435efaf-f987-4a83-8459-f39af789ad88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 1.447192 Sep 07 12:50:29.102230 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1965/3887] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:27 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:29.111934 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2e0fa1e1-9fd8-49e5-81e4-8341a2fe54d8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:29.115197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2e0fa1e1-9fd8-49e5-81e4-8341a2fe54d8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:29.123835 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e0fa1e1-9fd8-49e5-81e4-8341a2fe54d8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:29.125031 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e0fa1e1-9fd8-49e5-81e4-8341a2fe54d8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:29.125583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e0fa1e1-9fd8-49e5-81e4-8341a2fe54d8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:29.126427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e0fa1e1-9fd8-49e5-81e4-8341a2fe54d8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:29.126968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e0fa1e1-9fd8-49e5-81e4-8341a2fe54d8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:29.127479 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e0fa1e1-9fd8-49e5-81e4-8341a2fe54d8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:29.133821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:29.204913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9239af4f-1d50-48e1-b2df-9c1a72602707 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:29.224793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9239af4f-1d50-48e1-b2df-9c1a72602707 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:29.229196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9239af4f-1d50-48e1-b2df-9c1a72602707 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:29.231482 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9239af4f-1d50-48e1-b2df-9c1a72602707 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 1.123300 Sep 07 12:50:29.232494 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1923/3888] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:28 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:29.242706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-81bdb24b-83c6-4796-9bbb-9ce0e6acaba7 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:29.246169 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-81bdb24b-83c6-4796-9bbb-9ce0e6acaba7 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 99bf1197-df2d-4baa-adbe-dc0032977a9c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:29.260749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81bdb24b-83c6-4796-9bbb-9ce0e6acaba7 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:29.262099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81bdb24b-83c6-4796-9bbb-9ce0e6acaba7 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:29.262684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81bdb24b-83c6-4796-9bbb-9ce0e6acaba7 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:29.263625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81bdb24b-83c6-4796-9bbb-9ce0e6acaba7 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:29.264213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81bdb24b-83c6-4796-9bbb-9ce0e6acaba7 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:29.264754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81bdb24b-83c6-4796-9bbb-9ce0e6acaba7 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:29.473833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-81bdb24b-83c6-4796-9bbb-9ce0e6acaba7 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:29.495138 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-81bdb24b-83c6-4796-9bbb-9ce0e6acaba7 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c" status: 200 len: 1279 microversion: 2.1 time: 0.260656 Sep 07 12:50:29.498553 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1924/3889] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:29 2022] GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c => generated 1279 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:29.507812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-8f198293-9747-406e-ac9f-c97e76976d08 req-bf9855ad-8dd4-45bd-a60a-800e87d050a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe6581c-7070-48c5-a16d-fa30b22567d4", "name": "network-vif-plugged", "status": "completed", "tag": "57759270-a8de-4adc-a2ba-ccbb3e371878"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:29.521751 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8f198293-9747-406e-ac9f-c97e76976d08 req-bf9855ad-8dd4-45bd-a60a-800e87d050a3 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:29.522661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8f198293-9747-406e-ac9f-c97e76976d08 req-bf9855ad-8dd4-45bd-a60a-800e87d050a3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:29.523322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8f198293-9747-406e-ac9f-c97e76976d08 req-bf9855ad-8dd4-45bd-a60a-800e87d050a3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:29.543641 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-8f198293-9747-406e-ac9f-c97e76976d08 req-bf9855ad-8dd4-45bd-a60a-800e87d050a3 service nova] Creating event network-vif-plugged:57759270-a8de-4adc-a2ba-ccbb3e371878 for instance ffe6581c-7070-48c5-a16d-fa30b22567d4 on n-h2-852087-9 Sep 07 12:50:29.549431 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-8f198293-9747-406e-ac9f-c97e76976d08 req-bf9855ad-8dd4-45bd-a60a-800e87d050a3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049118 Sep 07 12:50:29.550114 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1925/3890] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:50:29.555951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-09c2b065-a314-458d-bdd6-9625d8746841 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:29.556836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-09c2b065-a314-458d-bdd6-9625d8746841 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 0f92440f-8b32-4731-8383-d9e57e575ae7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:29.563880 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09c2b065-a314-458d-bdd6-9625d8746841 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:29.564382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09c2b065-a314-458d-bdd6-9625d8746841 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:29.565116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09c2b065-a314-458d-bdd6-9625d8746841 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:29.566290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09c2b065-a314-458d-bdd6-9625d8746841 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:29.566820 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09c2b065-a314-458d-bdd6-9625d8746841 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:29.567316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09c2b065-a314-458d-bdd6-9625d8746841 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:29.740092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2e0fa1e1-9fd8-49e5-81e4-8341a2fe54d8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:29.762847 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2e0fa1e1-9fd8-49e5-81e4-8341a2fe54d8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:29.766250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2e0fa1e1-9fd8-49e5-81e4-8341a2fe54d8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:29.769161 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2e0fa1e1-9fd8-49e5-81e4-8341a2fe54d8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1407 microversion: 2.20 time: 0.664313 Sep 07 12:50:29.773838 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1966/3891] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:29 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1407 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:29.784828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c2da826e-480a-4297-bf3b-8004d9c28ac8 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:29.786351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c2da826e-480a-4297-bf3b-8004d9c28ac8 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:29.797435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2da826e-480a-4297-bf3b-8004d9c28ac8 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:29.798411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2da826e-480a-4297-bf3b-8004d9c28ac8 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:29.799218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2da826e-480a-4297-bf3b-8004d9c28ac8 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:29.800510 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2da826e-480a-4297-bf3b-8004d9c28ac8 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:29.802039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2da826e-480a-4297-bf3b-8004d9c28ac8 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:29.802841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2da826e-480a-4297-bf3b-8004d9c28ac8 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:30.037990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-09c2b065-a314-458d-bdd6-9625d8746841 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:30.048150 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-09c2b065-a314-458d-bdd6-9625d8746841 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7" status: 200 len: 1317 microversion: 2.1 time: 0.496449 Sep 07 12:50:30.049013 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1926/3892] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:29 2022] GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7 => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:30.054016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df95058d-03b9-44b0-a4cd-bcc199c0795d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:30.055506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-df95058d-03b9-44b0-a4cd-bcc199c0795d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:30.062089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df95058d-03b9-44b0-a4cd-bcc199c0795d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:30.062089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df95058d-03b9-44b0-a4cd-bcc199c0795d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:30.062606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df95058d-03b9-44b0-a4cd-bcc199c0795d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:30.063244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df95058d-03b9-44b0-a4cd-bcc199c0795d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:30.063728 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df95058d-03b9-44b0-a4cd-bcc199c0795d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:30.064165 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df95058d-03b9-44b0-a4cd-bcc199c0795d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:30.288220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c2da826e-480a-4297-bf3b-8004d9c28ac8 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:30.299986 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c2da826e-480a-4297-bf3b-8004d9c28ac8 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1354 microversion: 2.1 time: 0.523355 Sep 07 12:50:30.301283 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1967/3893] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:29 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1354 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:30.306963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c2affc9e-0617-42fc-820a-a6165ed721be req-eeb7bb08-1e56-4128-8cc2-016b04480e1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9352ac2-475e-4c77-aa85-5ecd566563b2", "tag": "acffd0c4-1273-4d97-8465-26984f8e6d9d"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:30.320512 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c2affc9e-0617-42fc-820a-a6165ed721be req-eeb7bb08-1e56-4128-8cc2-016b04480e1a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:30.321359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c2affc9e-0617-42fc-820a-a6165ed721be req-eeb7bb08-1e56-4128-8cc2-016b04480e1a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:30.322059 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c2affc9e-0617-42fc-820a-a6165ed721be req-eeb7bb08-1e56-4128-8cc2-016b04480e1a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:30.352519 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c2affc9e-0617-42fc-820a-a6165ed721be req-eeb7bb08-1e56-4128-8cc2-016b04480e1a service nova] Creating event network-changed:acffd0c4-1273-4d97-8465-26984f8e6d9d for instance e9352ac2-475e-4c77-aa85-5ecd566563b2 on n-h2-852087-9 Sep 07 12:50:30.360861 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c2affc9e-0617-42fc-820a-a6165ed721be req-eeb7bb08-1e56-4128-8cc2-016b04480e1a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058028 Sep 07 12:50:30.362642 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1968/3894] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:50:30.371182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-93549425-f9ee-479d-8cec-8bff3825cf78 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:30.372545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-93549425-f9ee-479d-8cec-8bff3825cf78 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:30.375367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:30.383589 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93549425-f9ee-479d-8cec-8bff3825cf78 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:30.384600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93549425-f9ee-479d-8cec-8bff3825cf78 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:30.384900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93549425-f9ee-479d-8cec-8bff3825cf78 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:30.385798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93549425-f9ee-479d-8cec-8bff3825cf78 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:30.386569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93549425-f9ee-479d-8cec-8bff3825cf78 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:30.387191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93549425-f9ee-479d-8cec-8bff3825cf78 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:30.393415 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-df95058d-03b9-44b0-a4cd-bcc199c0795d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:30.408746 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-df95058d-03b9-44b0-a4cd-bcc199c0795d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.358375 Sep 07 12:50:30.409763 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1927/3895] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:30 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:30.456714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7527ed8a-ffc0-4cb7-a491-d121834ceab4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:30.457677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7527ed8a-ffc0-4cb7-a491-d121834ceab4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:30.467868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7527ed8a-ffc0-4cb7-a491-d121834ceab4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:30.468528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7527ed8a-ffc0-4cb7-a491-d121834ceab4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:30.469309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7527ed8a-ffc0-4cb7-a491-d121834ceab4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:30.470832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7527ed8a-ffc0-4cb7-a491-d121834ceab4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:30.471798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7527ed8a-ffc0-4cb7-a491-d121834ceab4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:30.472438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7527ed8a-ffc0-4cb7-a491-d121834ceab4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:30.717188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-93549425-f9ee-479d-8cec-8bff3825cf78 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:30.734730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7527ed8a-ffc0-4cb7-a491-d121834ceab4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:30.735710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-93549425-f9ee-479d-8cec-8bff3825cf78 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:30.738672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-93549425-f9ee-479d-8cec-8bff3825cf78 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:30.740844 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-93549425-f9ee-479d-8cec-8bff3825cf78 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.376097 Sep 07 12:50:30.742590 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1969/3896] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:30 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:30.752805 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7527ed8a-ffc0-4cb7-a491-d121834ceab4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.308463 Sep 07 12:50:30.754865 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1928/3897] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:30 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:50:30.756543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8d22adc0-c584-4506-9dae-1423a608b095 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:30.757781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8d22adc0-c584-4506-9dae-1423a608b095 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 99bf1197-df2d-4baa-adbe-dc0032977a9c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:30.766314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d22adc0-c584-4506-9dae-1423a608b095 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:30.766815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d22adc0-c584-4506-9dae-1423a608b095 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:30.767258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d22adc0-c584-4506-9dae-1423a608b095 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:30.767983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d22adc0-c584-4506-9dae-1423a608b095 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:30.768474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d22adc0-c584-4506-9dae-1423a608b095 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:30.768870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d22adc0-c584-4506-9dae-1423a608b095 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:30.779222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d35e53b-6892-4a2a-9fce-2ff4bf383ae3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:30.780608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9d35e53b-6892-4a2a-9fce-2ff4bf383ae3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:30.788336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d35e53b-6892-4a2a-9fce-2ff4bf383ae3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:30.789297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d35e53b-6892-4a2a-9fce-2ff4bf383ae3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:30.790268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d35e53b-6892-4a2a-9fce-2ff4bf383ae3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:30.791956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d35e53b-6892-4a2a-9fce-2ff4bf383ae3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:30.792722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d35e53b-6892-4a2a-9fce-2ff4bf383ae3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:30.793406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d35e53b-6892-4a2a-9fce-2ff4bf383ae3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:30.835793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:30.907422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=12 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:31.131194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8d22adc0-c584-4506-9dae-1423a608b095 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:31.140456 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8d22adc0-c584-4506-9dae-1423a608b095 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c" status: 200 len: 1321 microversion: 2.1 time: 0.396058 Sep 07 12:50:31.141061 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1970/3898] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:30 2022] GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c => generated 1321 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:31.147198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9d35e53b-6892-4a2a-9fce-2ff4bf383ae3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:31.149982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4260f9f6-a41e-440a-8629-e927f5235883 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:31.150807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4260f9f6-a41e-440a-8629-e927f5235883 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:31.160154 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9d35e53b-6892-4a2a-9fce-2ff4bf383ae3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.384929 Sep 07 12:50:31.161128 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1929/3899] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:30 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:31.166136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-34dcaf32-102f-478d-af21-bce4bd5d3021 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:31.166751 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-34dcaf32-102f-478d-af21-bce4bd5d3021 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 0f92440f-8b32-4731-8383-d9e57e575ae7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:31.166901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4260f9f6-a41e-440a-8629-e927f5235883 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:31.167913 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4260f9f6-a41e-440a-8629-e927f5235883 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:31.169303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4260f9f6-a41e-440a-8629-e927f5235883 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:31.171253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4260f9f6-a41e-440a-8629-e927f5235883 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:31.172105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4260f9f6-a41e-440a-8629-e927f5235883 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:31.173022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4260f9f6-a41e-440a-8629-e927f5235883 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:31.174854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34dcaf32-102f-478d-af21-bce4bd5d3021 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:31.175360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34dcaf32-102f-478d-af21-bce4bd5d3021 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:31.175811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34dcaf32-102f-478d-af21-bce4bd5d3021 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:31.176598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34dcaf32-102f-478d-af21-bce4bd5d3021 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:31.177090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34dcaf32-102f-478d-af21-bce4bd5d3021 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:31.177685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34dcaf32-102f-478d-af21-bce4bd5d3021 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:31.530381 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-34dcaf32-102f-478d-af21-bce4bd5d3021 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:31.536077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:31.543480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4260f9f6-a41e-440a-8629-e927f5235883 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:31.545303 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-34dcaf32-102f-478d-af21-bce4bd5d3021 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7" status: 200 len: 1317 microversion: 2.1 time: 0.383019 Sep 07 12:50:31.546440 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1930/3900] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:31 2022] GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7 => generated 1317 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:31.552542 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-75d541c3-4c1b-43aa-8a03-e52de0d02a5f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1042158831", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "49960e13-4e80-4757-a207-47071e716cc5"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:31.569111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4260f9f6-a41e-440a-8629-e927f5235883 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:31.570665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4260f9f6-a41e-440a-8629-e927f5235883 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:31.571892 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4260f9f6-a41e-440a-8629-e927f5235883 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1407 microversion: 2.20 time: 0.429364 Sep 07 12:50:31.572497 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1971/3901] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:31 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1407 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:31.585737 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7ea49da3-c98f-429a-99e3-9ff8b70cbdea tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:31.587253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7ea49da3-c98f-429a-99e3-9ff8b70cbdea tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:31.598552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ea49da3-c98f-429a-99e3-9ff8b70cbdea tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:31.599437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ea49da3-c98f-429a-99e3-9ff8b70cbdea tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:31.600365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ea49da3-c98f-429a-99e3-9ff8b70cbdea tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:31.602108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ea49da3-c98f-429a-99e3-9ff8b70cbdea tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:31.602933 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ea49da3-c98f-429a-99e3-9ff8b70cbdea tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:31.603708 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ea49da3-c98f-429a-99e3-9ff8b70cbdea tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:31.616686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-75d541c3-4c1b-43aa-8a03-e52de0d02a5f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] validate_networks() for [('49960e13-4e80-4757-a207-47071e716cc5', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:50:31.893254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7ea49da3-c98f-429a-99e3-9ff8b70cbdea tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:31.926148 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7ea49da3-c98f-429a-99e3-9ff8b70cbdea tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1354 microversion: 2.1 time: 0.349790 Sep 07 12:50:31.927012 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1972/3902] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:31 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1354 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:31.941861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-fa8d519c-d6be-4079-b941-9de8b062e7d7 req-311bcf04-3b51-4f10-ba3f-9934d9ca8e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f92440f-8b32-4731-8383-d9e57e575ae7", "name": "network-vif-plugged", "status": "completed", "tag": "27516518-fb56-48fd-82b9-87d4f320e9c5"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:31.966628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fa8d519c-d6be-4079-b941-9de8b062e7d7 req-311bcf04-3b51-4f10-ba3f-9934d9ca8e6a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:31.967435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fa8d519c-d6be-4079-b941-9de8b062e7d7 req-311bcf04-3b51-4f10-ba3f-9934d9ca8e6a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:31.968179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fa8d519c-d6be-4079-b941-9de8b062e7d7 req-311bcf04-3b51-4f10-ba3f-9934d9ca8e6a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:32.002775 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-fa8d519c-d6be-4079-b941-9de8b062e7d7 req-311bcf04-3b51-4f10-ba3f-9934d9ca8e6a service nova] Creating event network-vif-plugged:27516518-fb56-48fd-82b9-87d4f320e9c5 for instance 0f92440f-8b32-4731-8383-d9e57e575ae7 on n-h1-852087-9 Sep 07 12:50:32.012410 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-fa8d519c-d6be-4079-b941-9de8b062e7d7 req-311bcf04-3b51-4f10-ba3f-9934d9ca8e6a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080992 Sep 07 12:50:32.013545 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1973/3903] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:50:32.023890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-53e6cbef-64fe-4786-b4b3-a8ab014f0bf1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:32.024858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-53e6cbef-64fe-4786-b4b3-a8ab014f0bf1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:32.039763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53e6cbef-64fe-4786-b4b3-a8ab014f0bf1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:32.040852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53e6cbef-64fe-4786-b4b3-a8ab014f0bf1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:32.041446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53e6cbef-64fe-4786-b4b3-a8ab014f0bf1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:32.042563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53e6cbef-64fe-4786-b4b3-a8ab014f0bf1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:32.043194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53e6cbef-64fe-4786-b4b3-a8ab014f0bf1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:32.043789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53e6cbef-64fe-4786-b4b3-a8ab014f0bf1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:32.780163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-53e6cbef-64fe-4786-b4b3-a8ab014f0bf1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:32.818723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-53e6cbef-64fe-4786-b4b3-a8ab014f0bf1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:32.822576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-53e6cbef-64fe-4786-b4b3-a8ab014f0bf1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:32.826809 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-53e6cbef-64fe-4786-b4b3-a8ab014f0bf1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.811320 Sep 07 12:50:32.828571 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1974/3904] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:32 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:32.852287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-43d3c7f6-4384-4e04-994e-bf901fa47334 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:32.854022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-43d3c7f6-4384-4e04-994e-bf901fa47334 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 99bf1197-df2d-4baa-adbe-dc0032977a9c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:32.884016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43d3c7f6-4384-4e04-994e-bf901fa47334 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:32.887988 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43d3c7f6-4384-4e04-994e-bf901fa47334 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:32.888618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-75d541c3-4c1b-43aa-8a03-e52de0d02a5f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:50:32.889306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43d3c7f6-4384-4e04-994e-bf901fa47334 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:32.889714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-75d541c3-4c1b-43aa-8a03-e52de0d02a5f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:50:32.889714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-75d541c3-4c1b-43aa-8a03-e52de0d02a5f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:50:32.890135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-75d541c3-4c1b-43aa-8a03-e52de0d02a5f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:50:32.890337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43d3c7f6-4384-4e04-994e-bf901fa47334 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:32.890938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43d3c7f6-4384-4e04-994e-bf901fa47334 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:32.891173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-75d541c3-4c1b-43aa-8a03-e52de0d02a5f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:50:32.892154 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43d3c7f6-4384-4e04-994e-bf901fa47334 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:32.906833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75d541c3-4c1b-43aa-8a03-e52de0d02a5f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:32.908483 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75d541c3-4c1b-43aa-8a03-e52de0d02a5f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:32.909142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75d541c3-4c1b-43aa-8a03-e52de0d02a5f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:32.910261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75d541c3-4c1b-43aa-8a03-e52de0d02a5f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:32.910955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75d541c3-4c1b-43aa-8a03-e52de0d02a5f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:32.911575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75d541c3-4c1b-43aa-8a03-e52de0d02a5f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:32.933715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-75d541c3-4c1b-43aa-8a03-e52de0d02a5f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Getting quotas for project af1de494abea4aa7841c00fb199e8aec. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:50:32.944110 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-75d541c3-4c1b-43aa-8a03-e52de0d02a5f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Getting quotas for user 22ec4509710f446d843f6882120c5d6e and project af1de494abea4aa7841c00fb199e8aec. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:50:32.960578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-75d541c3-4c1b-43aa-8a03-e52de0d02a5f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:50:32.963070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-75d541c3-4c1b-43aa-8a03-e52de0d02a5f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:50:33.032422 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-75d541c3-4c1b-43aa-8a03-e52de0d02a5f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.484326 Sep 07 12:50:33.033159 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1931/3905] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:50:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:50:33.046086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-53a23144-1e06-4578-b1b8-3d5b72da73bf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:33.056032 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-53a23144-1e06-4578-b1b8-3d5b72da73bf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 0f92440f-8b32-4731-8383-d9e57e575ae7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:33.066859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53a23144-1e06-4578-b1b8-3d5b72da73bf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:33.067798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53a23144-1e06-4578-b1b8-3d5b72da73bf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:33.068491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53a23144-1e06-4578-b1b8-3d5b72da73bf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:33.069822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53a23144-1e06-4578-b1b8-3d5b72da73bf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:33.070563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53a23144-1e06-4578-b1b8-3d5b72da73bf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:33.073204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53a23144-1e06-4578-b1b8-3d5b72da73bf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:33.597153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-53a23144-1e06-4578-b1b8-3d5b72da73bf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:33.610455 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-53a23144-1e06-4578-b1b8-3d5b72da73bf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7" status: 200 len: 1317 microversion: 2.1 time: 0.569422 Sep 07 12:50:33.612123 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1932/3906] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:33 2022] GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7 => generated 1317 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:33.618150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-88869536-fce3-4a76-89a2-3774c4ebfb53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:33.619735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-88869536-fce3-4a76-89a2-3774c4ebfb53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:33.627707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88869536-fce3-4a76-89a2-3774c4ebfb53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:33.628514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88869536-fce3-4a76-89a2-3774c4ebfb53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:33.628842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-43d3c7f6-4384-4e04-994e-bf901fa47334 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:33.629312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88869536-fce3-4a76-89a2-3774c4ebfb53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:33.630375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88869536-fce3-4a76-89a2-3774c4ebfb53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:33.631024 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88869536-fce3-4a76-89a2-3774c4ebfb53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:33.631848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-88869536-fce3-4a76-89a2-3774c4ebfb53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:33.651078 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-43d3c7f6-4384-4e04-994e-bf901fa47334 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c" status: 200 len: 1321 microversion: 2.1 time: 0.818964 Sep 07 12:50:33.659916 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1975/3907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:32 2022] GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c => generated 1321 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:33.668623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7900f355-2205-4b9d-a672-b0db32135a6b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:33.671173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7900f355-2205-4b9d-a672-b0db32135a6b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:33.695875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7900f355-2205-4b9d-a672-b0db32135a6b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:33.696778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7900f355-2205-4b9d-a672-b0db32135a6b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:33.697980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7900f355-2205-4b9d-a672-b0db32135a6b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:33.699398 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7900f355-2205-4b9d-a672-b0db32135a6b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:33.700562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7900f355-2205-4b9d-a672-b0db32135a6b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:33.701337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7900f355-2205-4b9d-a672-b0db32135a6b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:34.055202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-88869536-fce3-4a76-89a2-3774c4ebfb53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:34.085145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-88869536-fce3-4a76-89a2-3774c4ebfb53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:34.088338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-88869536-fce3-4a76-89a2-3774c4ebfb53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:34.090193 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-88869536-fce3-4a76-89a2-3774c4ebfb53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1599 microversion: 2.20 time: 0.476759 Sep 07 12:50:34.091843 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1933/3908] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:33 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1599 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:34.098053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7900f355-2205-4b9d-a672-b0db32135a6b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:34.103781 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-766c5438-9b82-46cc-9775-90c30198a673 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:34.105911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-766c5438-9b82-46cc-9775-90c30198a673 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:34.119209 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7900f355-2205-4b9d-a672-b0db32135a6b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1354 microversion: 2.1 time: 0.457179 Sep 07 12:50:34.120300 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-766c5438-9b82-46cc-9775-90c30198a673 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:34.121748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-766c5438-9b82-46cc-9775-90c30198a673 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:34.122467 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1976/3909] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:33 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1354 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:34.123059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-766c5438-9b82-46cc-9775-90c30198a673 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:34.124592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-766c5438-9b82-46cc-9775-90c30198a673 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:34.125803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-766c5438-9b82-46cc-9775-90c30198a673 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:34.126792 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-766c5438-9b82-46cc-9775-90c30198a673 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:34.134447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-14775e4d-c815-48fe-b837-faf8b045949d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:34.135312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-14775e4d-c815-48fe-b837-faf8b045949d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:34.197582 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14775e4d-c815-48fe-b837-faf8b045949d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:34.198419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14775e4d-c815-48fe-b837-faf8b045949d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:34.201753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14775e4d-c815-48fe-b837-faf8b045949d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:34.204588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14775e4d-c815-48fe-b837-faf8b045949d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:34.205814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14775e4d-c815-48fe-b837-faf8b045949d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:34.218581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14775e4d-c815-48fe-b837-faf8b045949d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:34.272105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-766c5438-9b82-46cc-9775-90c30198a673 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:34.288027 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-766c5438-9b82-46cc-9775-90c30198a673 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef" status: 200 len: 1267 microversion: 2.1 time: 0.193584 Sep 07 12:50:34.289952 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1934/3910] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:34 2022] GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef => generated 1267 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:34.325425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-a95603d5-aa58-4197-9a49-b8ac662749e6 req-d42122d9-d45e-430e-9413-8a55f8c7bb9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a05521d0-a89d-418b-93c8-8bb32e9877b3", "tag": "d5abea6b-5954-4b65-9ef5-34170d7a794f"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:34.344857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a95603d5-aa58-4197-9a49-b8ac662749e6 req-d42122d9-d45e-430e-9413-8a55f8c7bb9b service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:34.346139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a95603d5-aa58-4197-9a49-b8ac662749e6 req-d42122d9-d45e-430e-9413-8a55f8c7bb9b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:34.347212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a95603d5-aa58-4197-9a49-b8ac662749e6 req-d42122d9-d45e-430e-9413-8a55f8c7bb9b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:34.368397 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-a95603d5-aa58-4197-9a49-b8ac662749e6 req-d42122d9-d45e-430e-9413-8a55f8c7bb9b service nova] Creating event network-changed:d5abea6b-5954-4b65-9ef5-34170d7a794f for instance a05521d0-a89d-418b-93c8-8bb32e9877b3 on n-h1-852087-9 Sep 07 12:50:34.379687 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-a95603d5-aa58-4197-9a49-b8ac662749e6 req-d42122d9-d45e-430e-9413-8a55f8c7bb9b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087501 Sep 07 12:50:34.381682 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1935/3911] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:50:34.388306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9a4c6eae-ef4c-4b19-a35a-24993432caf4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:34.388987 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9a4c6eae-ef4c-4b19-a35a-24993432caf4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:34.397605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a4c6eae-ef4c-4b19-a35a-24993432caf4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:34.398267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a4c6eae-ef4c-4b19-a35a-24993432caf4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:34.398839 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a4c6eae-ef4c-4b19-a35a-24993432caf4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:34.399690 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a4c6eae-ef4c-4b19-a35a-24993432caf4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:34.400264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a4c6eae-ef4c-4b19-a35a-24993432caf4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:34.400940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a4c6eae-ef4c-4b19-a35a-24993432caf4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:34.536797 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9a4c6eae-ef4c-4b19-a35a-24993432caf4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.152102 Sep 07 12:50:34.537952 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1936/3912] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Sep 7 12:50:34 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4/os-interface => generated 284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:50:34.542508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-71081fc2-ec3b-434e-adc9-f393401e7a07 req-87f958f0-1f32-4e15-948c-38aef4771d60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99bf1197-df2d-4baa-adbe-dc0032977a9c", "tag": "7282a636-5215-4e21-8a64-6beb646297a1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:34.551971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:34.554408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-71081fc2-ec3b-434e-adc9-f393401e7a07 req-87f958f0-1f32-4e15-948c-38aef4771d60 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:34.555252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-71081fc2-ec3b-434e-adc9-f393401e7a07 req-87f958f0-1f32-4e15-948c-38aef4771d60 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:34.555861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-71081fc2-ec3b-434e-adc9-f393401e7a07 req-87f958f0-1f32-4e15-948c-38aef4771d60 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:34.578536 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-71081fc2-ec3b-434e-adc9-f393401e7a07 req-87f958f0-1f32-4e15-948c-38aef4771d60 service nova] Creating event network-changed:7282a636-5215-4e21-8a64-6beb646297a1 for instance 99bf1197-df2d-4baa-adbe-dc0032977a9c on n-h1-852087-9 Sep 07 12:50:34.608865 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-71081fc2-ec3b-434e-adc9-f393401e7a07 req-87f958f0-1f32-4e15-948c-38aef4771d60 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069978 Sep 07 12:50:34.616705 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1937/3913] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:50:34.656974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8407b699-f2f6-4cfc-8dc1-00dade774fd6 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:34.658090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8407b699-f2f6-4cfc-8dc1-00dade774fd6 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 0f92440f-8b32-4731-8383-d9e57e575ae7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:34.677360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8407b699-f2f6-4cfc-8dc1-00dade774fd6 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:34.677901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8407b699-f2f6-4cfc-8dc1-00dade774fd6 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:34.678389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8407b699-f2f6-4cfc-8dc1-00dade774fd6 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:34.679107 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8407b699-f2f6-4cfc-8dc1-00dade774fd6 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:34.695234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8407b699-f2f6-4cfc-8dc1-00dade774fd6 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:34.698248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8407b699-f2f6-4cfc-8dc1-00dade774fd6 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:34.958147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-14775e4d-c815-48fe-b837-faf8b045949d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:34.983072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-14775e4d-c815-48fe-b837-faf8b045949d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:34.985705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-14775e4d-c815-48fe-b837-faf8b045949d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:34.987096 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-14775e4d-c815-48fe-b837-faf8b045949d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.863191 Sep 07 12:50:34.987691 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1977/3914] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:34 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:34.995004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ac907e8c-0373-462b-aa46-fd84249867ba tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:34.995965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ac907e8c-0373-462b-aa46-fd84249867ba tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 99bf1197-df2d-4baa-adbe-dc0032977a9c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:35.003471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac907e8c-0373-462b-aa46-fd84249867ba tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:35.004247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac907e8c-0373-462b-aa46-fd84249867ba tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:35.004910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac907e8c-0373-462b-aa46-fd84249867ba tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:35.005883 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac907e8c-0373-462b-aa46-fd84249867ba tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:35.006599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac907e8c-0373-462b-aa46-fd84249867ba tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:35.007216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac907e8c-0373-462b-aa46-fd84249867ba tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:36.076608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8407b699-f2f6-4cfc-8dc1-00dade774fd6 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:36.101715 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8407b699-f2f6-4cfc-8dc1-00dade774fd6 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7" status: 200 len: 1506 microversion: 2.1 time: 1.449401 Sep 07 12:50:36.103336 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1938/3915] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:34 2022] GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7 => generated 1506 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:50:36.113117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c0ea388a-8b16-48a0-90ff-70aeb931f8e4 req-ac153d79-ab58-487a-bc90-cdb4a878d78d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aaad486-bd76-4c89-af5b-3443b3d53da0", "name": "network-vif-plugged", "status": "completed", "tag": "907dde1f-7429-4a22-9b69-83154943daee"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:36.117548 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ac907e8c-0373-462b-aa46-fd84249867ba tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:36.135385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c0ea388a-8b16-48a0-90ff-70aeb931f8e4 req-ac153d79-ab58-487a-bc90-cdb4a878d78d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:36.136790 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ac907e8c-0373-462b-aa46-fd84249867ba tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c" status: 200 len: 1321 microversion: 2.1 time: 1.147251 Sep 07 12:50:36.137467 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1978/3916] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:34 2022] GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c => generated 1321 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:36.138180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c0ea388a-8b16-48a0-90ff-70aeb931f8e4 req-ac153d79-ab58-487a-bc90-cdb4a878d78d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:36.139602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c0ea388a-8b16-48a0-90ff-70aeb931f8e4 req-ac153d79-ab58-487a-bc90-cdb4a878d78d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:36.143055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6ee53226-452c-4bbc-a0ad-d8328a84f9a8 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:36.143745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6ee53226-452c-4bbc-a0ad-d8328a84f9a8 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:36.160071 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ee53226-452c-4bbc-a0ad-d8328a84f9a8 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:36.167052 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ee53226-452c-4bbc-a0ad-d8328a84f9a8 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:36.168554 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ee53226-452c-4bbc-a0ad-d8328a84f9a8 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:36.171415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ee53226-452c-4bbc-a0ad-d8328a84f9a8 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:36.175201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ee53226-452c-4bbc-a0ad-d8328a84f9a8 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:36.175667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ee53226-452c-4bbc-a0ad-d8328a84f9a8 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:36.183772 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c0ea388a-8b16-48a0-90ff-70aeb931f8e4 req-ac153d79-ab58-487a-bc90-cdb4a878d78d service nova] Creating event network-vif-plugged:907dde1f-7429-4a22-9b69-83154943daee for instance 6aaad486-bd76-4c89-af5b-3443b3d53da0 on n-h1-852087-9 Sep 07 12:50:36.193952 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c0ea388a-8b16-48a0-90ff-70aeb931f8e4 req-ac153d79-ab58-487a-bc90-cdb4a878d78d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087859 Sep 07 12:50:36.195532 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1939/3917] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:50:36.208512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-910435b9-dcc6-4cc2-a10d-bb824188dab6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:36.210516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-910435b9-dcc6-4cc2-a10d-bb824188dab6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:36.224399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910435b9-dcc6-4cc2-a10d-bb824188dab6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:36.226242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910435b9-dcc6-4cc2-a10d-bb824188dab6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:36.227450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910435b9-dcc6-4cc2-a10d-bb824188dab6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:36.229526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910435b9-dcc6-4cc2-a10d-bb824188dab6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:36.230660 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910435b9-dcc6-4cc2-a10d-bb824188dab6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:36.231472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-910435b9-dcc6-4cc2-a10d-bb824188dab6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:36.434226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-910435b9-dcc6-4cc2-a10d-bb824188dab6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:36.447329 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-910435b9-dcc6-4cc2-a10d-bb824188dab6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef" status: 200 len: 1273 microversion: 2.1 time: 0.249048 Sep 07 12:50:36.452857 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1940/3918] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:36 2022] GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef => generated 1273 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:36.458192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b0b2b5dc-6acf-4bf6-9431-674ab85212f5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:36.458847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b0b2b5dc-6acf-4bf6-9431-674ab85212f5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:36.486620 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0b2b5dc-6acf-4bf6-9431-674ab85212f5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:36.487513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0b2b5dc-6acf-4bf6-9431-674ab85212f5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:36.488334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0b2b5dc-6acf-4bf6-9431-674ab85212f5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:36.489305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0b2b5dc-6acf-4bf6-9431-674ab85212f5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:36.490370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0b2b5dc-6acf-4bf6-9431-674ab85212f5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:36.491413 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0b2b5dc-6acf-4bf6-9431-674ab85212f5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:36.739796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6ee53226-452c-4bbc-a0ad-d8328a84f9a8 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:36.749122 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6ee53226-452c-4bbc-a0ad-d8328a84f9a8 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1354 microversion: 2.1 time: 0.610159 Sep 07 12:50:36.749884 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1979/3919] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:36 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1354 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:36.770902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ec4bc19-abd6-411b-ae43-5dd38b11321a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:36.771597 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0ec4bc19-abd6-411b-ae43-5dd38b11321a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 0f92440f-8b32-4731-8383-d9e57e575ae7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:36.780051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ec4bc19-abd6-411b-ae43-5dd38b11321a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:36.780986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ec4bc19-abd6-411b-ae43-5dd38b11321a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:36.781446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ec4bc19-abd6-411b-ae43-5dd38b11321a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:36.782417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ec4bc19-abd6-411b-ae43-5dd38b11321a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:36.782899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ec4bc19-abd6-411b-ae43-5dd38b11321a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:36.783342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ec4bc19-abd6-411b-ae43-5dd38b11321a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:36.815154 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0ec4bc19-abd6-411b-ae43-5dd38b11321a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 0f92440f-8b32-4731-8383-d9e57e575ae7] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:50:36.915864 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ec4bc19-abd6-411b-ae43-5dd38b11321a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7" status: 204 len: 0 microversion: 2.1 time: 0.149204 Sep 07 12:50:36.917369 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1980/3920] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:50:36 2022] DELETE /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:50:36.924970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-cda76be6-4b08-4647-8d32-e11194823f5b req-765153a2-3c0a-4410-9872-9379cb520959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a05521d0-a89d-418b-93c8-8bb32e9877b3", "tag": "5138e43b-3b31-4d09-8d71-ac4cda0957ae"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:36.937286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-cda76be6-4b08-4647-8d32-e11194823f5b req-765153a2-3c0a-4410-9872-9379cb520959 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:36.938331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-cda76be6-4b08-4647-8d32-e11194823f5b req-765153a2-3c0a-4410-9872-9379cb520959 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:36.939291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-cda76be6-4b08-4647-8d32-e11194823f5b req-765153a2-3c0a-4410-9872-9379cb520959 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:36.954162 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-cda76be6-4b08-4647-8d32-e11194823f5b req-765153a2-3c0a-4410-9872-9379cb520959 service nova] Creating event network-changed:5138e43b-3b31-4d09-8d71-ac4cda0957ae for instance a05521d0-a89d-418b-93c8-8bb32e9877b3 on n-h1-852087-9 Sep 07 12:50:36.960143 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-cda76be6-4b08-4647-8d32-e11194823f5b req-765153a2-3c0a-4410-9872-9379cb520959 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040722 Sep 07 12:50:36.961208 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1981/3921] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:50:36.968402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d2f2eb9f-f98c-41ba-8f6e-26f3e987952d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:36.969378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d2f2eb9f-f98c-41ba-8f6e-26f3e987952d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 0f92440f-8b32-4731-8383-d9e57e575ae7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:36.976481 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2f2eb9f-f98c-41ba-8f6e-26f3e987952d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:36.977408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2f2eb9f-f98c-41ba-8f6e-26f3e987952d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:36.978054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2f2eb9f-f98c-41ba-8f6e-26f3e987952d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:36.978983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2f2eb9f-f98c-41ba-8f6e-26f3e987952d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:36.979648 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2f2eb9f-f98c-41ba-8f6e-26f3e987952d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:36.980402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2f2eb9f-f98c-41ba-8f6e-26f3e987952d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:37.001256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b0b2b5dc-6acf-4bf6-9431-674ab85212f5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:37.018307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b0b2b5dc-6acf-4bf6-9431-674ab85212f5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:37.021767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b0b2b5dc-6acf-4bf6-9431-674ab85212f5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:37.024185 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b0b2b5dc-6acf-4bf6-9431-674ab85212f5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.570040 Sep 07 12:50:37.024937 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1941/3922] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:36 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:37.196519 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-38f56143-35c3-42dc-8d7c-36f760611266 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:37.197814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-38f56143-35c3-42dc-8d7c-36f760611266 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 99bf1197-df2d-4baa-adbe-dc0032977a9c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:37.210157 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38f56143-35c3-42dc-8d7c-36f760611266 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:37.211270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38f56143-35c3-42dc-8d7c-36f760611266 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:37.212370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38f56143-35c3-42dc-8d7c-36f760611266 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:37.213811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38f56143-35c3-42dc-8d7c-36f760611266 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:37.215292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38f56143-35c3-42dc-8d7c-36f760611266 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:37.216331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38f56143-35c3-42dc-8d7c-36f760611266 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:37.385627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d2f2eb9f-f98c-41ba-8f6e-26f3e987952d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:37.397275 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d2f2eb9f-f98c-41ba-8f6e-26f3e987952d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7" status: 200 len: 1512 microversion: 2.1 time: 0.434491 Sep 07 12:50:37.398278 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1982/3923] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:36 2022] GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7 => generated 1512 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:37.491143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2f79d3f0-656a-4e96-b950-8774fad82fa7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:37.492903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2f79d3f0-656a-4e96-b950-8774fad82fa7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:37.504737 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f79d3f0-656a-4e96-b950-8774fad82fa7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:37.505770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f79d3f0-656a-4e96-b950-8774fad82fa7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:37.506678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f79d3f0-656a-4e96-b950-8774fad82fa7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:37.508093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f79d3f0-656a-4e96-b950-8774fad82fa7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:37.509056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f79d3f0-656a-4e96-b950-8774fad82fa7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:37.509976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f79d3f0-656a-4e96-b950-8774fad82fa7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:37.518739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:37.704294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2f79d3f0-656a-4e96-b950-8774fad82fa7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:37.714159 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2f79d3f0-656a-4e96-b950-8774fad82fa7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef" status: 200 len: 1273 microversion: 2.1 time: 0.233090 Sep 07 12:50:37.714891 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1983/3924] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:37 2022] GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef => generated 1273 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:37.719905 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-38f56143-35c3-42dc-8d7c-36f760611266 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:37.729238 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-38f56143-35c3-42dc-8d7c-36f760611266 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c" status: 200 len: 1321 microversion: 2.1 time: 0.540450 Sep 07 12:50:37.730265 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1942/3925] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:37 2022] GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c => generated 1321 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:37.774926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b0a88c03-7cef-4ae6-8802-c86dba11184b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:37.775560 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b0a88c03-7cef-4ae6-8802-c86dba11184b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:37.782837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0a88c03-7cef-4ae6-8802-c86dba11184b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:37.783351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0a88c03-7cef-4ae6-8802-c86dba11184b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:37.783804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0a88c03-7cef-4ae6-8802-c86dba11184b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:37.784695 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0a88c03-7cef-4ae6-8802-c86dba11184b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:37.785036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0a88c03-7cef-4ae6-8802-c86dba11184b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:37.785462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0a88c03-7cef-4ae6-8802-c86dba11184b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:38.054868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e705a00-1bb3-4317-994b-2908e72bcf4f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:38.057047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6e705a00-1bb3-4317-994b-2908e72bcf4f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:38.065333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e705a00-1bb3-4317-994b-2908e72bcf4f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:38.065866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e705a00-1bb3-4317-994b-2908e72bcf4f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:38.066369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e705a00-1bb3-4317-994b-2908e72bcf4f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:38.067257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e705a00-1bb3-4317-994b-2908e72bcf4f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:38.067779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e705a00-1bb3-4317-994b-2908e72bcf4f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:38.068276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e705a00-1bb3-4317-994b-2908e72bcf4f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:38.438295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b0a88c03-7cef-4ae6-8802-c86dba11184b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:38.467437 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b0a88c03-7cef-4ae6-8802-c86dba11184b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1354 microversion: 2.1 time: 0.696318 Sep 07 12:50:38.476343 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1984/3926] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:37 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1354 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:38.479041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fb4f53e8-62f8-499b-b541-ddcd6d9b72de tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:38.480360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fb4f53e8-62f8-499b-b541-ddcd6d9b72de tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 0f92440f-8b32-4731-8383-d9e57e575ae7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:38.493461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb4f53e8-62f8-499b-b541-ddcd6d9b72de tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:38.494592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb4f53e8-62f8-499b-b541-ddcd6d9b72de tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:38.495575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb4f53e8-62f8-499b-b541-ddcd6d9b72de tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:38.497476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb4f53e8-62f8-499b-b541-ddcd6d9b72de tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:38.498502 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb4f53e8-62f8-499b-b541-ddcd6d9b72de tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:38.499357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb4f53e8-62f8-499b-b541-ddcd6d9b72de tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:38.508996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6e705a00-1bb3-4317-994b-2908e72bcf4f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:38.529407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6e705a00-1bb3-4317-994b-2908e72bcf4f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:38.532846 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6e705a00-1bb3-4317-994b-2908e72bcf4f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:38.535339 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6e705a00-1bb3-4317-994b-2908e72bcf4f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.487477 Sep 07 12:50:38.536549 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1943/3927] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:38 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:50:38.548234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-1450b901-2ac9-4efd-9f09-f216066f5e34 req-97c289a2-8f88-4764-b1ee-062ad3d53a8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe6581c-7070-48c5-a16d-fa30b22567d4", "tag": "57759270-a8de-4adc-a2ba-ccbb3e371878"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:38.563249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1450b901-2ac9-4efd-9f09-f216066f5e34 req-97c289a2-8f88-4764-b1ee-062ad3d53a8c service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:38.564610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1450b901-2ac9-4efd-9f09-f216066f5e34 req-97c289a2-8f88-4764-b1ee-062ad3d53a8c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:38.565316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1450b901-2ac9-4efd-9f09-f216066f5e34 req-97c289a2-8f88-4764-b1ee-062ad3d53a8c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:38.590607 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-1450b901-2ac9-4efd-9f09-f216066f5e34 req-97c289a2-8f88-4764-b1ee-062ad3d53a8c service nova] Creating event network-changed:57759270-a8de-4adc-a2ba-ccbb3e371878 for instance ffe6581c-7070-48c5-a16d-fa30b22567d4 on n-h2-852087-9 Sep 07 12:50:38.602084 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-1450b901-2ac9-4efd-9f09-f216066f5e34 req-97c289a2-8f88-4764-b1ee-062ad3d53a8c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058303 Sep 07 12:50:38.603749 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1944/3928] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:50:38.747368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-21b4d27d-200c-420d-9036-8e97913d3a81 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:38.748096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-21b4d27d-200c-420d-9036-8e97913d3a81 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:38.776450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21b4d27d-200c-420d-9036-8e97913d3a81 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:38.777319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21b4d27d-200c-420d-9036-8e97913d3a81 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:38.778253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21b4d27d-200c-420d-9036-8e97913d3a81 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:38.779920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21b4d27d-200c-420d-9036-8e97913d3a81 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:38.780497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21b4d27d-200c-420d-9036-8e97913d3a81 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:38.781024 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21b4d27d-200c-420d-9036-8e97913d3a81 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:39.618927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fb4f53e8-62f8-499b-b541-ddcd6d9b72de tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:39.635302 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fb4f53e8-62f8-499b-b541-ddcd6d9b72de tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7" status: 200 len: 1512 microversion: 2.1 time: 1.163744 Sep 07 12:50:39.640114 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1985/3929] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:38 2022] GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7 => generated 1512 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:39.651786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-13994115-59e8-4d65-8913-a812ef733c5b tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:39.653519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-13994115-59e8-4d65-8913-a812ef733c5b tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 99bf1197-df2d-4baa-adbe-dc0032977a9c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:39.672932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13994115-59e8-4d65-8913-a812ef733c5b tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:39.674919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13994115-59e8-4d65-8913-a812ef733c5b tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:39.676482 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13994115-59e8-4d65-8913-a812ef733c5b tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:39.679958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13994115-59e8-4d65-8913-a812ef733c5b tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:39.681337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13994115-59e8-4d65-8913-a812ef733c5b tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:39.682586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13994115-59e8-4d65-8913-a812ef733c5b tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:40.562780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-21b4d27d-200c-420d-9036-8e97913d3a81 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:40.578530 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-21b4d27d-200c-420d-9036-8e97913d3a81 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef" status: 200 len: 1315 microversion: 2.1 time: 1.835815 Sep 07 12:50:40.579745 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1945/3930] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:38 2022] GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef => generated 1315 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:40.587825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1eec7611-e353-4143-ac1d-92d2db86110b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:40.589250 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1eec7611-e353-4143-ac1d-92d2db86110b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:40.616386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eec7611-e353-4143-ac1d-92d2db86110b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:40.617586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eec7611-e353-4143-ac1d-92d2db86110b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:40.618302 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eec7611-e353-4143-ac1d-92d2db86110b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:40.619338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eec7611-e353-4143-ac1d-92d2db86110b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:40.621577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eec7611-e353-4143-ac1d-92d2db86110b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:40.622470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eec7611-e353-4143-ac1d-92d2db86110b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:40.839933 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-13994115-59e8-4d65-8913-a812ef733c5b tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:40.873141 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-13994115-59e8-4d65-8913-a812ef733c5b tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c" status: 200 len: 1321 microversion: 2.1 time: 1.229820 Sep 07 12:50:40.875209 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1986/3931] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:39 2022] GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c => generated 1321 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:40.894780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-26d3d1bd-0c8c-4f20-ad77-26235b121903 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:40.904733 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-26d3d1bd-0c8c-4f20-ad77-26235b121903 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:40.935404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26d3d1bd-0c8c-4f20-ad77-26235b121903 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:40.936192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26d3d1bd-0c8c-4f20-ad77-26235b121903 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:40.936778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26d3d1bd-0c8c-4f20-ad77-26235b121903 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:40.937632 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26d3d1bd-0c8c-4f20-ad77-26235b121903 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:40.938123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26d3d1bd-0c8c-4f20-ad77-26235b121903 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:40.938567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26d3d1bd-0c8c-4f20-ad77-26235b121903 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:41.603082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1eec7611-e353-4143-ac1d-92d2db86110b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:41.638806 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1eec7611-e353-4143-ac1d-92d2db86110b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1354 microversion: 2.1 time: 1.057386 Sep 07 12:50:41.656487 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1946/3932] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:40 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1354 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:41.689230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-81073a91-bc85-41e9-8e7f-d7758247190a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:41.694883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-81073a91-bc85-41e9-8e7f-d7758247190a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 0f92440f-8b32-4731-8383-d9e57e575ae7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:41.716554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81073a91-bc85-41e9-8e7f-d7758247190a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:41.720336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81073a91-bc85-41e9-8e7f-d7758247190a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:41.721659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81073a91-bc85-41e9-8e7f-d7758247190a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:41.723384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81073a91-bc85-41e9-8e7f-d7758247190a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:41.724882 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81073a91-bc85-41e9-8e7f-d7758247190a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:41.726113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81073a91-bc85-41e9-8e7f-d7758247190a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:41.808033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-26d3d1bd-0c8c-4f20-ad77-26235b121903 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:41.845896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-26d3d1bd-0c8c-4f20-ad77-26235b121903 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:41.852018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-26d3d1bd-0c8c-4f20-ad77-26235b121903 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:41.854005 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-26d3d1bd-0c8c-4f20-ad77-26235b121903 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.977305 Sep 07 12:50:41.858707 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1987/3933] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:40 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:41.874111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eb3945be-52b5-4ac9-b38c-a59bf38b0ce8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:41.881958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-eb3945be-52b5-4ac9-b38c-a59bf38b0ce8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:41.908200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb3945be-52b5-4ac9-b38c-a59bf38b0ce8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:41.908900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb3945be-52b5-4ac9-b38c-a59bf38b0ce8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:41.909877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb3945be-52b5-4ac9-b38c-a59bf38b0ce8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:41.911276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb3945be-52b5-4ac9-b38c-a59bf38b0ce8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:41.912328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb3945be-52b5-4ac9-b38c-a59bf38b0ce8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:41.913207 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb3945be-52b5-4ac9-b38c-a59bf38b0ce8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:42.232444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-81073a91-bc85-41e9-8e7f-d7758247190a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:42.251392 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-81073a91-bc85-41e9-8e7f-d7758247190a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7" status: 200 len: 1512 microversion: 2.1 time: 0.592363 Sep 07 12:50:42.254280 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1947/3934] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:41 2022] GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7 => generated 1512 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:42.263704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-834d807b-198a-4b6a-a589-23e728ce33ef tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:42.265344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-834d807b-198a-4b6a-a589-23e728ce33ef tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 99bf1197-df2d-4baa-adbe-dc0032977a9c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:42.277558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-834d807b-198a-4b6a-a589-23e728ce33ef tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:42.278461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-834d807b-198a-4b6a-a589-23e728ce33ef tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:42.279611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-834d807b-198a-4b6a-a589-23e728ce33ef tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:42.280870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-834d807b-198a-4b6a-a589-23e728ce33ef tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:42.281775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-834d807b-198a-4b6a-a589-23e728ce33ef tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:42.282563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-834d807b-198a-4b6a-a589-23e728ce33ef tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:42.368827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-eb3945be-52b5-4ac9-b38c-a59bf38b0ce8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:42.394122 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eb3945be-52b5-4ac9-b38c-a59bf38b0ce8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef" status: 200 len: 1315 microversion: 2.1 time: 0.533209 Sep 07 12:50:42.395732 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1988/3935] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:41 2022] GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:42.557795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-4a16a0f5-4422-4109-a479-b4593093a576 req-de418bcb-fad2-4979-9345-ec668e2ab9fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a05521d0-a89d-418b-93c8-8bb32e9877b3", "tag": "bedbadf5-eb44-437a-a98d-a5c59f97639c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:42.591014 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4a16a0f5-4422-4109-a479-b4593093a576 req-de418bcb-fad2-4979-9345-ec668e2ab9fa service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:42.592575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4a16a0f5-4422-4109-a479-b4593093a576 req-de418bcb-fad2-4979-9345-ec668e2ab9fa service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:42.593648 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4a16a0f5-4422-4109-a479-b4593093a576 req-de418bcb-fad2-4979-9345-ec668e2ab9fa service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:42.617611 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-4a16a0f5-4422-4109-a479-b4593093a576 req-de418bcb-fad2-4979-9345-ec668e2ab9fa service nova] Creating event network-changed:bedbadf5-eb44-437a-a98d-a5c59f97639c for instance a05521d0-a89d-418b-93c8-8bb32e9877b3 on n-h1-852087-9 Sep 07 12:50:42.625760 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-4a16a0f5-4422-4109-a479-b4593093a576 req-de418bcb-fad2-4979-9345-ec668e2ab9fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077274 Sep 07 12:50:42.627267 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1989/3936] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:50:42.637736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-e498a9bf-8366-4fcc-83ec-7f86ca9368eb req-db403274-08d9-4723-b288-4dde08e9e92e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaef0385-5f99-4b42-97b2-5c412f4007ef", "tag": "5f3b27e0-c172-4e5b-a0d2-e417964e9c1b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:42.660093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e498a9bf-8366-4fcc-83ec-7f86ca9368eb req-db403274-08d9-4723-b288-4dde08e9e92e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:42.661280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e498a9bf-8366-4fcc-83ec-7f86ca9368eb req-db403274-08d9-4723-b288-4dde08e9e92e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:42.662443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e498a9bf-8366-4fcc-83ec-7f86ca9368eb req-db403274-08d9-4723-b288-4dde08e9e92e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:42.683011 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-e498a9bf-8366-4fcc-83ec-7f86ca9368eb req-db403274-08d9-4723-b288-4dde08e9e92e service nova] Creating event network-changed:5f3b27e0-c172-4e5b-a0d2-e417964e9c1b for instance aaef0385-5f99-4b42-97b2-5c412f4007ef on n-h2-852087-9 Sep 07 12:50:42.697725 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-e498a9bf-8366-4fcc-83ec-7f86ca9368eb req-db403274-08d9-4723-b288-4dde08e9e92e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061165 Sep 07 12:50:42.698886 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1990/3937] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:50:42.705130 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8390286c-9126-4471-9203-6e811f2be888 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:42.706045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8390286c-9126-4471-9203-6e811f2be888 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:42.714136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8390286c-9126-4471-9203-6e811f2be888 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:42.714790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8390286c-9126-4471-9203-6e811f2be888 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:42.715353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8390286c-9126-4471-9203-6e811f2be888 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:42.716227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8390286c-9126-4471-9203-6e811f2be888 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:42.716818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8390286c-9126-4471-9203-6e811f2be888 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:42.717416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8390286c-9126-4471-9203-6e811f2be888 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:42.737445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-834d807b-198a-4b6a-a589-23e728ce33ef tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:42.769454 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-834d807b-198a-4b6a-a589-23e728ce33ef tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c" status: 200 len: 1321 microversion: 2.1 time: 0.512682 Sep 07 12:50:42.770901 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1948/3938] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:42 2022] GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c => generated 1321 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:42.914950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-100e2783-a1fe-43a9-9677-d883219043c5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:42.916026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-100e2783-a1fe-43a9-9677-d883219043c5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:42.925822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:42.950887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-100e2783-a1fe-43a9-9677-d883219043c5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:42.951704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-100e2783-a1fe-43a9-9677-d883219043c5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:42.952410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-100e2783-a1fe-43a9-9677-d883219043c5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:42.953757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-100e2783-a1fe-43a9-9677-d883219043c5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:42.954568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-100e2783-a1fe-43a9-9677-d883219043c5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:42.955299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-100e2783-a1fe-43a9-9677-d883219043c5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:42.956644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:43.160868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8390286c-9126-4471-9203-6e811f2be888 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:43.177040 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8390286c-9126-4471-9203-6e811f2be888 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1354 microversion: 2.1 time: 0.476720 Sep 07 12:50:43.185995 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1991/3939] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:42 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1354 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:43.284383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-13470445-44fc-476c-af8f-adb32507d94e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:43.285996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-13470445-44fc-476c-af8f-adb32507d94e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 0f92440f-8b32-4731-8383-d9e57e575ae7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:43.302885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13470445-44fc-476c-af8f-adb32507d94e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:43.305159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13470445-44fc-476c-af8f-adb32507d94e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:43.306559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13470445-44fc-476c-af8f-adb32507d94e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:43.308341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13470445-44fc-476c-af8f-adb32507d94e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:43.310164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13470445-44fc-476c-af8f-adb32507d94e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:43.311284 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13470445-44fc-476c-af8f-adb32507d94e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:43.506951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-13470445-44fc-476c-af8f-adb32507d94e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:43.522505 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-13470445-44fc-476c-af8f-adb32507d94e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7" status: 200 len: 1470 microversion: 2.1 time: 0.249436 Sep 07 12:50:43.553512 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1992/3940] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:43 2022] GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7 => generated 1470 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:43.553851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-100e2783-a1fe-43a9-9677-d883219043c5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:43.560379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2eb0754e-1164-40f7-8eb4-028bc097d24e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:43.564021 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2eb0754e-1164-40f7-8eb4-028bc097d24e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:43.565859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-100e2783-a1fe-43a9-9677-d883219043c5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:43.574484 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-100e2783-a1fe-43a9-9677-d883219043c5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:43.575177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2eb0754e-1164-40f7-8eb4-028bc097d24e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:43.575817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2eb0754e-1164-40f7-8eb4-028bc097d24e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:43.576151 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-100e2783-a1fe-43a9-9677-d883219043c5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.668352 Sep 07 12:50:43.576452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2eb0754e-1164-40f7-8eb4-028bc097d24e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:43.580355 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1949/3941] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:42 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:50:43.588118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2eb0754e-1164-40f7-8eb4-028bc097d24e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:43.591122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2eb0754e-1164-40f7-8eb4-028bc097d24e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:43.594342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c2ef7bda-9cad-49dc-8968-0e4741739f54 req-ff1c7ead-c903-437d-9154-7c8b9fba4437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99bf1197-df2d-4baa-adbe-dc0032977a9c", "name": "network-vif-plugged", "status": "completed", "tag": "7282a636-5215-4e21-8a64-6beb646297a1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:43.596017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2eb0754e-1164-40f7-8eb4-028bc097d24e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:43.628422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c2ef7bda-9cad-49dc-8968-0e4741739f54 req-ff1c7ead-c903-437d-9154-7c8b9fba4437 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:43.629092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c2ef7bda-9cad-49dc-8968-0e4741739f54 req-ff1c7ead-c903-437d-9154-7c8b9fba4437 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:43.629575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c2ef7bda-9cad-49dc-8968-0e4741739f54 req-ff1c7ead-c903-437d-9154-7c8b9fba4437 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:43.669569 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c2ef7bda-9cad-49dc-8968-0e4741739f54 req-ff1c7ead-c903-437d-9154-7c8b9fba4437 service nova] Creating event network-vif-plugged:7282a636-5215-4e21-8a64-6beb646297a1 for instance 99bf1197-df2d-4baa-adbe-dc0032977a9c on n-h1-852087-9 Sep 07 12:50:43.693049 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c2ef7bda-9cad-49dc-8968-0e4741739f54 req-ff1c7ead-c903-437d-9154-7c8b9fba4437 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109066 Sep 07 12:50:43.696268 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1950/3942] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:50:43.808117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dbe26d31-3ef6-4a75-b4c3-da70fb0502a1 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:43.809182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dbe26d31-3ef6-4a75-b4c3-da70fb0502a1 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 99bf1197-df2d-4baa-adbe-dc0032977a9c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:43.817219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbe26d31-3ef6-4a75-b4c3-da70fb0502a1 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:43.818436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbe26d31-3ef6-4a75-b4c3-da70fb0502a1 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:43.819123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbe26d31-3ef6-4a75-b4c3-da70fb0502a1 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:43.820417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbe26d31-3ef6-4a75-b4c3-da70fb0502a1 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:43.821457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbe26d31-3ef6-4a75-b4c3-da70fb0502a1 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:43.822306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbe26d31-3ef6-4a75-b4c3-da70fb0502a1 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:43.971345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2eb0754e-1164-40f7-8eb4-028bc097d24e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:43.980109 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2eb0754e-1164-40f7-8eb4-028bc097d24e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef" status: 200 len: 1315 microversion: 2.1 time: 0.439393 Sep 07 12:50:43.993878 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1993/3943] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:43 2022] GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:44.065291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dbe26d31-3ef6-4a75-b4c3-da70fb0502a1 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:44.072625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:44.083478 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dbe26d31-3ef6-4a75-b4c3-da70fb0502a1 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c" status: 200 len: 1321 microversion: 2.1 time: 0.279396 Sep 07 12:50:44.084586 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1951/3944] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:43 2022] GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:44.211438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3e02299-1210-474b-8070-75d976b874ed tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:44.212170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d3e02299-1210-474b-8070-75d976b874ed tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:44.219808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3e02299-1210-474b-8070-75d976b874ed tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:44.220320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3e02299-1210-474b-8070-75d976b874ed tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:44.220956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3e02299-1210-474b-8070-75d976b874ed tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:44.221761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3e02299-1210-474b-8070-75d976b874ed tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:44.222242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3e02299-1210-474b-8070-75d976b874ed tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:44.222686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3e02299-1210-474b-8070-75d976b874ed tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:44.436465 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d3e02299-1210-474b-8070-75d976b874ed tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:44.445905 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d3e02299-1210-474b-8070-75d976b874ed tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1354 microversion: 2.1 time: 0.238754 Sep 07 12:50:44.446662 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1994/3945] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:44 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1354 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:44.566054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c4b57037-19c5-449b-8959-17666a01c4b3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:44.567025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c4b57037-19c5-449b-8959-17666a01c4b3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 0f92440f-8b32-4731-8383-d9e57e575ae7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:44.579260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4b57037-19c5-449b-8959-17666a01c4b3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:44.580190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4b57037-19c5-449b-8959-17666a01c4b3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:44.581006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4b57037-19c5-449b-8959-17666a01c4b3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:44.582373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4b57037-19c5-449b-8959-17666a01c4b3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:44.583249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4b57037-19c5-449b-8959-17666a01c4b3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:44.584140 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4b57037-19c5-449b-8959-17666a01c4b3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:44.605662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-10279e71-cd42-4eaf-a9a3-1923099c2688 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:44.606401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-10279e71-cd42-4eaf-a9a3-1923099c2688 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:44.613217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10279e71-cd42-4eaf-a9a3-1923099c2688 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:44.613850 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10279e71-cd42-4eaf-a9a3-1923099c2688 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:44.614407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10279e71-cd42-4eaf-a9a3-1923099c2688 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:44.615270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10279e71-cd42-4eaf-a9a3-1923099c2688 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:44.615878 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10279e71-cd42-4eaf-a9a3-1923099c2688 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:44.616384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10279e71-cd42-4eaf-a9a3-1923099c2688 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:44.643738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4b57037-19c5-449b-8959-17666a01c4b3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:44.644686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4b57037-19c5-449b-8959-17666a01c4b3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:44.647040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4b57037-19c5-449b-8959-17666a01c4b3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:44.647040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-c4b57037-19c5-449b-8959-17666a01c4b3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lazy-loading 'fault' on Instance uuid 0f92440f-8b32-4731-8383-d9e57e575ae7 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:50:44.749000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c4b57037-19c5-449b-8959-17666a01c4b3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:44.762867 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c4b57037-19c5-449b-8959-17666a01c4b3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7" status: 200 len: 1307 microversion: 2.1 time: 0.204805 Sep 07 12:50:44.763678 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1952/3946] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:44 2022] GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7 => generated 1307 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:44.770494 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-461988ba-3de7-4353-8f3b-ca0820d61ae9 req-ae84b9c4-6e65-47a0-90c3-deb0884532f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f92440f-8b32-4731-8383-d9e57e575ae7", "name": "network-vif-deleted", "tag": "27516518-fb56-48fd-82b9-87d4f320e9c5"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:44.784578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-461988ba-3de7-4353-8f3b-ca0820d61ae9 req-ae84b9c4-6e65-47a0-90c3-deb0884532f7 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:44.785265 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-461988ba-3de7-4353-8f3b-ca0820d61ae9 req-ae84b9c4-6e65-47a0-90c3-deb0884532f7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:44.786052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-461988ba-3de7-4353-8f3b-ca0820d61ae9 req-ae84b9c4-6e65-47a0-90c3-deb0884532f7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:44.806671 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-461988ba-3de7-4353-8f3b-ca0820d61ae9 req-ae84b9c4-6e65-47a0-90c3-deb0884532f7 service nova] Creating event network-vif-deleted:27516518-fb56-48fd-82b9-87d4f320e9c5 for instance 0f92440f-8b32-4731-8383-d9e57e575ae7 on n-h1-852087-9 Sep 07 12:50:44.816196 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-461988ba-3de7-4353-8f3b-ca0820d61ae9 req-ae84b9c4-6e65-47a0-90c3-deb0884532f7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050414 Sep 07 12:50:44.817190 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1953/3947] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:50:44.944554 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-10279e71-cd42-4eaf-a9a3-1923099c2688 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:44.956384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-10279e71-cd42-4eaf-a9a3-1923099c2688 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:44.958168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-10279e71-cd42-4eaf-a9a3-1923099c2688 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:44.959578 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-10279e71-cd42-4eaf-a9a3-1923099c2688 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.358572 Sep 07 12:50:44.960149 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1995/3948] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:44 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:50:45.005947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6f3ab4e3-a416-45d0-8380-01fc62c37446 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:45.006947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6f3ab4e3-a416-45d0-8380-01fc62c37446 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:45.014277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f3ab4e3-a416-45d0-8380-01fc62c37446 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:45.014758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f3ab4e3-a416-45d0-8380-01fc62c37446 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:45.015229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f3ab4e3-a416-45d0-8380-01fc62c37446 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:45.015945 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f3ab4e3-a416-45d0-8380-01fc62c37446 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:45.016406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f3ab4e3-a416-45d0-8380-01fc62c37446 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:45.016830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f3ab4e3-a416-45d0-8380-01fc62c37446 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:45.125881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d527df6b-0870-4215-9665-da32b3c64eeb tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:45.127006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d527df6b-0870-4215-9665-da32b3c64eeb tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 99bf1197-df2d-4baa-adbe-dc0032977a9c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:45.135345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d527df6b-0870-4215-9665-da32b3c64eeb tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:45.136623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d527df6b-0870-4215-9665-da32b3c64eeb tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:45.136842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d527df6b-0870-4215-9665-da32b3c64eeb tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:45.138044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d527df6b-0870-4215-9665-da32b3c64eeb tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:45.138951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d527df6b-0870-4215-9665-da32b3c64eeb tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:45.139282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d527df6b-0870-4215-9665-da32b3c64eeb tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:45.214481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6f3ab4e3-a416-45d0-8380-01fc62c37446 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:45.223321 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6f3ab4e3-a416-45d0-8380-01fc62c37446 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef" status: 200 len: 1315 microversion: 2.1 time: 0.222636 Sep 07 12:50:45.223924 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1954/3949] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:44 2022] GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:45.327791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d527df6b-0870-4215-9665-da32b3c64eeb tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:45.336443 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d527df6b-0870-4215-9665-da32b3c64eeb tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c" status: 200 len: 1321 microversion: 2.1 time: 0.218324 Sep 07 12:50:45.337143 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1996/3950] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:45 2022] GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:45.471545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-65ed7294-0a5b-451e-a599-8b08c7b5b374 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:45.472390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-65ed7294-0a5b-451e-a599-8b08c7b5b374 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:45.485575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65ed7294-0a5b-451e-a599-8b08c7b5b374 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:45.487211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65ed7294-0a5b-451e-a599-8b08c7b5b374 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:45.488818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65ed7294-0a5b-451e-a599-8b08c7b5b374 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:45.489783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65ed7294-0a5b-451e-a599-8b08c7b5b374 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:45.490821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65ed7294-0a5b-451e-a599-8b08c7b5b374 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:45.491630 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-65ed7294-0a5b-451e-a599-8b08c7b5b374 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:45.683610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-65ed7294-0a5b-451e-a599-8b08c7b5b374 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:45.699123 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-65ed7294-0a5b-451e-a599-8b08c7b5b374 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1354 microversion: 2.1 time: 0.231433 Sep 07 12:50:45.700391 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1955/3951] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:45 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1354 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:50:45.800171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-79ad5243-34e8-4961-a084-d20d484b76e3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:45.800794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-79ad5243-34e8-4961-a084-d20d484b76e3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 0f92440f-8b32-4731-8383-d9e57e575ae7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:45.808521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79ad5243-34e8-4961-a084-d20d484b76e3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:45.809036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79ad5243-34e8-4961-a084-d20d484b76e3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:45.809544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79ad5243-34e8-4961-a084-d20d484b76e3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:45.810762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79ad5243-34e8-4961-a084-d20d484b76e3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:45.811248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79ad5243-34e8-4961-a084-d20d484b76e3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:45.811868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79ad5243-34e8-4961-a084-d20d484b76e3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:45.830949 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-79ad5243-34e8-4961-a084-d20d484b76e3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-79ad5243-34e8-4961-a084-d20d484b76e3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7 HTTP/1.1 Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '0f92440f-8b32-4731-8383-d9e57e575ae7'} Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:50:45.833342 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:45.843546 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:45.843546 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:50:45.843546 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:50:45.843546 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:50:45.843546 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:50:45.843546 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. Sep 07 12:50:45.843546 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:45.843546 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-79ad5243-34e8-4961-a084-d20d484b76e3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 404 to user: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:50:45.843546 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-79ad5243-34e8-4961-a084-d20d484b76e3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7" status: 404 len: 111 microversion: 2.1 time: 0.039265 Sep 07 12:50:45.843546 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1997/3952] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:45 2022] GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:50:45.849107 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-254baf53-579d-49c1-b6ce-db0a05829a8b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:45.850150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-254baf53-579d-49c1-b6ce-db0a05829a8b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:45.859491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-254baf53-579d-49c1-b6ce-db0a05829a8b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:45.860245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-254baf53-579d-49c1-b6ce-db0a05829a8b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:45.860879 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-254baf53-579d-49c1-b6ce-db0a05829a8b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:45.862148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-254baf53-579d-49c1-b6ce-db0a05829a8b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:45.862720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-254baf53-579d-49c1-b6ce-db0a05829a8b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:45.863446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-254baf53-579d-49c1-b6ce-db0a05829a8b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:45.998572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-103756f4-d386-443d-89d5-50f034271ddc tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:45.999961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-103756f4-d386-443d-89d5-50f034271ddc tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:46.011635 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-103756f4-d386-443d-89d5-50f034271ddc tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:46.013027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-103756f4-d386-443d-89d5-50f034271ddc tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:46.013874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-103756f4-d386-443d-89d5-50f034271ddc tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:46.015473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-103756f4-d386-443d-89d5-50f034271ddc tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:46.016297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-103756f4-d386-443d-89d5-50f034271ddc tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:46.016928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-103756f4-d386-443d-89d5-50f034271ddc tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:46.118254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-254baf53-579d-49c1-b6ce-db0a05829a8b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:46.132526 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-254baf53-579d-49c1-b6ce-db0a05829a8b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.288248 Sep 07 12:50:46.142478 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1956/3953] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:45 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:46.231464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b474304-c20c-491f-afac-59cc57803247 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "b810bb5d-8084-47d5-9b9e-6ea4661cdf5f"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b474304-c20c-491f-afac-59cc57803247 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 163 Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: {"server": {"name": 12345, "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "b810bb5d-8084-47d5-9b9e-6ea4661cdf5f"}]}} Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f', 'flavorRef': '452', 'networks': [{'uuid': 'b810bb5d-8084-47d5-9b9e-6ea4661cdf5f'}]}}} Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 12345 Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:50:46.237278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:50:46.248280 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:50:46.248280 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 07 12:50:46.248280 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:46.248280 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:50:46.248280 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:46.248280 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:46.248280 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:50:46.248280 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:50:46.248280 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:50:46.248280 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:50:46.248280 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 07 12:50:46.248280 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:46.248280 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b474304-c20c-491f-afac-59cc57803247 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:50:46.248280 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2b474304-c20c-491f-afac-59cc57803247 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.014922 Sep 07 12:50:46.248280 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1957/3954] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:50:46 2022] POST /compute/v2.1/servers => generated 127 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:50:46.251636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2fa82609-5357-4c58-80a6-5cf4f2dc5c36 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:46.252306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2fa82609-5357-4c58-80a6-5cf4f2dc5c36 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:46.260693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fa82609-5357-4c58-80a6-5cf4f2dc5c36 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:46.261306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fa82609-5357-4c58-80a6-5cf4f2dc5c36 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:46.261946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fa82609-5357-4c58-80a6-5cf4f2dc5c36 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:46.262741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fa82609-5357-4c58-80a6-5cf4f2dc5c36 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:46.263223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fa82609-5357-4c58-80a6-5cf4f2dc5c36 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:46.263658 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fa82609-5357-4c58-80a6-5cf4f2dc5c36 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:46.278936 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-103756f4-d386-443d-89d5-50f034271ddc tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:46.296035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-103756f4-d386-443d-89d5-50f034271ddc tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:46.299634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-103756f4-d386-443d-89d5-50f034271ddc tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:46.301811 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-103756f4-d386-443d-89d5-50f034271ddc tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.313889 Sep 07 12:50:46.302779 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1998/3955] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:45 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:46.310932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-03f0543b-99b0-4b9b-8a81-5fee89b8f638 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:46.312351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-03f0543b-99b0-4b9b-8a81-5fee89b8f638 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:46.324638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03f0543b-99b0-4b9b-8a81-5fee89b8f638 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:46.326258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03f0543b-99b0-4b9b-8a81-5fee89b8f638 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:46.326994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03f0543b-99b0-4b9b-8a81-5fee89b8f638 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:46.329140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03f0543b-99b0-4b9b-8a81-5fee89b8f638 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:46.329980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03f0543b-99b0-4b9b-8a81-5fee89b8f638 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:46.330948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03f0543b-99b0-4b9b-8a81-5fee89b8f638 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:46.629933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2fa82609-5357-4c58-80a6-5cf4f2dc5c36 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:46.639952 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2fa82609-5357-4c58-80a6-5cf4f2dc5c36 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef" status: 200 len: 1315 microversion: 2.1 time: 0.396154 Sep 07 12:50:46.640552 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1958/3956] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:46 2022] GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:46.645841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-70b42d3c-1a03-4321-90ea-870e0a6eead0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:46.646628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-70b42d3c-1a03-4321-90ea-870e0a6eead0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 99bf1197-df2d-4baa-adbe-dc0032977a9c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:46.654373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70b42d3c-1a03-4321-90ea-870e0a6eead0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:46.654977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70b42d3c-1a03-4321-90ea-870e0a6eead0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:46.655303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70b42d3c-1a03-4321-90ea-870e0a6eead0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:46.656033 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70b42d3c-1a03-4321-90ea-870e0a6eead0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:46.656545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70b42d3c-1a03-4321-90ea-870e0a6eead0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:46.656966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70b42d3c-1a03-4321-90ea-870e0a6eead0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:46.749724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-03f0543b-99b0-4b9b-8a81-5fee89b8f638 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:46.760682 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-03f0543b-99b0-4b9b-8a81-5fee89b8f638 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.456185 Sep 07 12:50:46.761569 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 1999/3957] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:46 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:46.778069 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-878d2b68-fa41-4048-a354-440b57aa4800 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:46.778069 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-878d2b68-fa41-4048-a354-440b57aa4800 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:46.778069 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-878d2b68-fa41-4048-a354-440b57aa4800 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:46.778069 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-878d2b68-fa41-4048-a354-440b57aa4800 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:46.778827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-878d2b68-fa41-4048-a354-440b57aa4800 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:46.779094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-878d2b68-fa41-4048-a354-440b57aa4800 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:46.779774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-878d2b68-fa41-4048-a354-440b57aa4800 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:46.780204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-878d2b68-fa41-4048-a354-440b57aa4800 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:47.020570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-70b42d3c-1a03-4321-90ea-870e0a6eead0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:47.031528 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-70b42d3c-1a03-4321-90ea-870e0a6eead0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c" status: 200 len: 1511 microversion: 2.1 time: 0.389505 Sep 07 12:50:47.032648 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1959/3958] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:46 2022] GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c => generated 1511 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:47.038525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32ca8903-3d5b-4734-bcfd-e63a2a88d23d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:47.039435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-32ca8903-3d5b-4734-bcfd-e63a2a88d23d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:47.047966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32ca8903-3d5b-4734-bcfd-e63a2a88d23d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:47.048808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32ca8903-3d5b-4734-bcfd-e63a2a88d23d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:47.049242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32ca8903-3d5b-4734-bcfd-e63a2a88d23d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:47.050205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32ca8903-3d5b-4734-bcfd-e63a2a88d23d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:47.050851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32ca8903-3d5b-4734-bcfd-e63a2a88d23d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:47.051462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32ca8903-3d5b-4734-bcfd-e63a2a88d23d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:47.091516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-878d2b68-fa41-4048-a354-440b57aa4800 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:47.099982 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-878d2b68-fa41-4048-a354-440b57aa4800 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1354 microversion: 2.1 time: 0.337204 Sep 07 12:50:47.100710 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2000/3959] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:46 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1354 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:47.106382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-90f90f2a-c416-43a8-a1ef-c1aa6302cda3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:47.106711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-90f90f2a-c416-43a8-a1ef-c1aa6302cda3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:47.113544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90f90f2a-c416-43a8-a1ef-c1aa6302cda3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:47.114437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90f90f2a-c416-43a8-a1ef-c1aa6302cda3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:47.114883 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90f90f2a-c416-43a8-a1ef-c1aa6302cda3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:47.115703 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90f90f2a-c416-43a8-a1ef-c1aa6302cda3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:47.116171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90f90f2a-c416-43a8-a1ef-c1aa6302cda3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:47.116603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90f90f2a-c416-43a8-a1ef-c1aa6302cda3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:47.750176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-32ca8903-3d5b-4734-bcfd-e63a2a88d23d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:47.764661 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-32ca8903-3d5b-4734-bcfd-e63a2a88d23d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.730352 Sep 07 12:50:47.777899 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1960/3960] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:47 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:47.777899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-20b81cd6-fb69-45f7-b119-6cd33702f3fa tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:47.777899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-20b81cd6-fb69-45f7-b119-6cd33702f3fa tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:47.790524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20b81cd6-fb69-45f7-b119-6cd33702f3fa tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:47.791979 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20b81cd6-fb69-45f7-b119-6cd33702f3fa tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:47.792992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20b81cd6-fb69-45f7-b119-6cd33702f3fa tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:47.794489 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20b81cd6-fb69-45f7-b119-6cd33702f3fa tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:47.795496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20b81cd6-fb69-45f7-b119-6cd33702f3fa tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:47.796424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20b81cd6-fb69-45f7-b119-6cd33702f3fa tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:47.796625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-90f90f2a-c416-43a8-a1ef-c1aa6302cda3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:47.818285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:47.821322 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-90f90f2a-c416-43a8-a1ef-c1aa6302cda3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0" status: 200 len: 1511 microversion: 2.1 time: 0.719525 Sep 07 12:50:47.822561 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2001/3961] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:47 2022] GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0 => generated 1511 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:47.828580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-af060d77-28f2-4ff0-a1f2-67b686a41051 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:47.829399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-af060d77-28f2-4ff0-a1f2-67b686a41051 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:47.837805 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af060d77-28f2-4ff0-a1f2-67b686a41051 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:47.838306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af060d77-28f2-4ff0-a1f2-67b686a41051 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:47.838823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af060d77-28f2-4ff0-a1f2-67b686a41051 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:47.839629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af060d77-28f2-4ff0-a1f2-67b686a41051 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:47.840165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af060d77-28f2-4ff0-a1f2-67b686a41051 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:47.840668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af060d77-28f2-4ff0-a1f2-67b686a41051 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:48.237344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-af060d77-28f2-4ff0-a1f2-67b686a41051 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:48.245234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-20b81cd6-fb69-45f7-b119-6cd33702f3fa tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:48.251742 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-af060d77-28f2-4ff0-a1f2-67b686a41051 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef" status: 200 len: 1315 microversion: 2.1 time: 0.427666 Sep 07 12:50:48.253816 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2002/3962] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:47 2022] GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:48.263138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-96925f5a-a087-43a5-8014-ec0ea51d3277 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:48.264943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-96925f5a-a087-43a5-8014-ec0ea51d3277 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 290d9a42-9d80-495f-8e45-879687fea820] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:48.279688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96925f5a-a087-43a5-8014-ec0ea51d3277 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:48.281108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96925f5a-a087-43a5-8014-ec0ea51d3277 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:48.282028 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96925f5a-a087-43a5-8014-ec0ea51d3277 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:48.283366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96925f5a-a087-43a5-8014-ec0ea51d3277 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:48.284241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96925f5a-a087-43a5-8014-ec0ea51d3277 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:48.285253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96925f5a-a087-43a5-8014-ec0ea51d3277 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:48.286662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-20b81cd6-fb69-45f7-b119-6cd33702f3fa tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:48.289613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-20b81cd6-fb69-45f7-b119-6cd33702f3fa tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:48.294608 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-20b81cd6-fb69-45f7-b119-6cd33702f3fa tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.526594 Sep 07 12:50:48.295622 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1961/3963] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:47 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:48.313821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a87e246d-21d2-481e-9716-797e39885fdb tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:48.315971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a87e246d-21d2-481e-9716-797e39885fdb tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:48.332293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a87e246d-21d2-481e-9716-797e39885fdb tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:48.334597 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a87e246d-21d2-481e-9716-797e39885fdb tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:48.336077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a87e246d-21d2-481e-9716-797e39885fdb tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:48.337780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a87e246d-21d2-481e-9716-797e39885fdb tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:48.339113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a87e246d-21d2-481e-9716-797e39885fdb tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:48.339906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a87e246d-21d2-481e-9716-797e39885fdb tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:48.606579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-96925f5a-a087-43a5-8014-ec0ea51d3277 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:48.619969 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-96925f5a-a087-43a5-8014-ec0ea51d3277 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/290d9a42-9d80-495f-8e45-879687fea820" status: 200 len: 1510 microversion: 2.1 time: 0.364002 Sep 07 12:50:48.627096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a87e246d-21d2-481e-9716-797e39885fdb tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:48.641931 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2003/3964] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:48 2022] GET /compute/v2.1/servers/290d9a42-9d80-495f-8e45-879687fea820 => generated 1510 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:48.643871 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a87e246d-21d2-481e-9716-797e39885fdb tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1354 microversion: 2.1 time: 0.346396 Sep 07 12:50:48.645427 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1962/3965] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:48 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1354 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:48.647859 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-99279cc2-a6c9-4e51-9317-5b2b3a24a324 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:48.655348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-99279cc2-a6c9-4e51-9317-5b2b3a24a324 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:48.656674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-99279cc2-a6c9-4e51-9317-5b2b3a24a324 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:50:48.675716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99279cc2-a6c9-4e51-9317-5b2b3a24a324 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:48.676301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99279cc2-a6c9-4e51-9317-5b2b3a24a324 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:48.676756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99279cc2-a6c9-4e51-9317-5b2b3a24a324 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:48.678276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99279cc2-a6c9-4e51-9317-5b2b3a24a324 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:48.678276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99279cc2-a6c9-4e51-9317-5b2b3a24a324 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:48.678717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99279cc2-a6c9-4e51-9317-5b2b3a24a324 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:48.814998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-99279cc2-a6c9-4e51-9317-5b2b3a24a324 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:50:48.895552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-99279cc2-a6c9-4e51-9317-5b2b3a24a324 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:48.903232 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99279cc2-a6c9-4e51-9317-5b2b3a24a324 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:48.903729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99279cc2-a6c9-4e51-9317-5b2b3a24a324 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:48.908634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99279cc2-a6c9-4e51-9317-5b2b3a24a324 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:49.048230 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-99279cc2-a6c9-4e51-9317-5b2b3a24a324 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.404775 Sep 07 12:50:49.049081 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2004/3966] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Sep 7 12:50:48 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:49.088948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-14d78a61-ef3f-468f-9b15-f409207208f0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:49.095603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-14d78a61-ef3f-468f-9b15-f409207208f0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:49.097322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-14d78a61-ef3f-468f-9b15-f409207208f0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2028358869', 'deleted': False, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:50:49.104643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14d78a61-ef3f-468f-9b15-f409207208f0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:49.105141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14d78a61-ef3f-468f-9b15-f409207208f0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:49.105636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14d78a61-ef3f-468f-9b15-f409207208f0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:49.106420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14d78a61-ef3f-468f-9b15-f409207208f0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:49.106914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14d78a61-ef3f-468f-9b15-f409207208f0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:49.107343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14d78a61-ef3f-468f-9b15-f409207208f0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:49.208948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-14d78a61-ef3f-468f-9b15-f409207208f0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:50:49.287063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-056e63c2-291f-4208-a718-cb703782c22c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:49.288053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-056e63c2-291f-4208-a718-cb703782c22c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:49.289567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-14d78a61-ef3f-468f-9b15-f409207208f0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:49.295959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-056e63c2-291f-4208-a718-cb703782c22c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:49.296620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-056e63c2-291f-4208-a718-cb703782c22c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:49.297072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14d78a61-ef3f-468f-9b15-f409207208f0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:49.297347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-056e63c2-291f-4208-a718-cb703782c22c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:49.297575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14d78a61-ef3f-468f-9b15-f409207208f0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:49.298036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14d78a61-ef3f-468f-9b15-f409207208f0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:49.298305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-056e63c2-291f-4208-a718-cb703782c22c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:49.298782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-056e63c2-291f-4208-a718-cb703782c22c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:49.299233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-056e63c2-291f-4208-a718-cb703782c22c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:49.523091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-056e63c2-291f-4208-a718-cb703782c22c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:49.536273 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-056e63c2-291f-4208-a718-cb703782c22c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef" status: 200 len: 1315 microversion: 2.1 time: 0.254211 Sep 07 12:50:49.537565 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2005/3967] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:49 2022] GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:50:49.544050 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-88076b43-680d-40a4-8e5d-fb5e0c50ee4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:49.544995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-88076b43-680d-40a4-8e5d-fb5e0c50ee4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:49.562982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88076b43-680d-40a4-8e5d-fb5e0c50ee4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:49.565724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88076b43-680d-40a4-8e5d-fb5e0c50ee4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:49.566931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88076b43-680d-40a4-8e5d-fb5e0c50ee4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:49.568627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88076b43-680d-40a4-8e5d-fb5e0c50ee4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:49.569848 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88076b43-680d-40a4-8e5d-fb5e0c50ee4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:49.572008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88076b43-680d-40a4-8e5d-fb5e0c50ee4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:49.596575 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-14d78a61-ef3f-468f-9b15-f409207208f0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2028358869" status: 200 len: 1514 microversion: 2.1 time: 0.511287 Sep 07 12:50:49.597626 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1963/3968] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Sep 7 12:50:49 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2028358869 => generated 1514 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:49.606475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d82c7c19-590c-4b6a-b8b6-6920fdc0f15e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1677528983", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "f82c1e14-548c-4cd2-989b-7cc9c4c1d238", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "b810bb5d-8084-47d5-9b9e-6ea4661cdf5f"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:49.715912 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-d82c7c19-590c-4b6a-b8b6-6920fdc0f15e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Block Device f82c1e14-548c-4cd2-989b-7cc9c4c1d238 is not bootable. Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d82c7c19-590c-4b6a-b8b6-6920fdc0f15e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 358 Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1677528983", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "f82c1e14-548c-4cd2-989b-7cc9c4c1d238", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "b810bb5d-8084-47d5-9b9e-6ea4661cdf5f"}]}} Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: exception: Block Device f82c1e14-548c-4cd2-989b-7cc9c4c1d238 is not bootable. Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1677528983', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'f82c1e14-548c-4cd2-989b-7cc9c4c1d238'}], 'networks': [{'uuid': 'b810bb5d-8084-47d5-9b9e-6ea4661cdf5f'}]}}} Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device f82c1e14-548c-4cd2-989b-7cc9c4c1d238 is not bootable. Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:50:49.726363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:50:49.735438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:50:49.735438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:50:49.735438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:50:49.735438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 07 12:50:49.735438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 07 12:50:49.735438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 07 12:50:49.735438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device f82c1e14-548c-4cd2-989b-7cc9c4c1d238 is not bootable. Sep 07 12:50:49.735438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:49.735438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:50:49.735438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:49.735438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:49.735438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:50:49.735438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:50:49.735438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:50:49.735438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:50:49.735438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device f82c1e14-548c-4cd2-989b-7cc9c4c1d238 is not bootable. Sep 07 12:50:49.735438 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:49.735438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d82c7c19-590c-4b6a-b8b6-6920fdc0f15e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 400 to user: Block Device f82c1e14-548c-4cd2-989b-7cc9c4c1d238 is not bootable. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:50:49.735438 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d82c7c19-590c-4b6a-b8b6-6920fdc0f15e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.129987 Sep 07 12:50:49.735438 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1964/3969] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:50:49 2022] POST /compute/v2.1/servers => generated 110 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:50:49.742356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-64c9d118-a17d-440c-989b-5d51cfddbc32 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:49.748656 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-64c9d118-a17d-440c-989b-5d51cfddbc32 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:49.749810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-64c9d118-a17d-440c-989b-5d51cfddbc32 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:50:49.755993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64c9d118-a17d-440c-989b-5d51cfddbc32 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:49.756771 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64c9d118-a17d-440c-989b-5d51cfddbc32 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:49.757339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64c9d118-a17d-440c-989b-5d51cfddbc32 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:49.758633 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64c9d118-a17d-440c-989b-5d51cfddbc32 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:49.759169 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64c9d118-a17d-440c-989b-5d51cfddbc32 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:49.759689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64c9d118-a17d-440c-989b-5d51cfddbc32 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:49.840697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-88076b43-680d-40a4-8e5d-fb5e0c50ee4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:49.851771 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-88076b43-680d-40a4-8e5d-fb5e0c50ee4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:49.853681 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-88076b43-680d-40a4-8e5d-fb5e0c50ee4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:49.854927 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-88076b43-680d-40a4-8e5d-fb5e0c50ee4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.315383 Sep 07 12:50:49.855527 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2006/3970] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:49 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:49.860724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-94aade80-145e-4f60-90a4-68a0e06d248a tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:49.861870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-94aade80-145e-4f60-90a4-68a0e06d248a tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:49.869047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94aade80-145e-4f60-90a4-68a0e06d248a tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:49.870009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94aade80-145e-4f60-90a4-68a0e06d248a tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:49.870643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94aade80-145e-4f60-90a4-68a0e06d248a tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:49.871722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94aade80-145e-4f60-90a4-68a0e06d248a tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:49.872374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94aade80-145e-4f60-90a4-68a0e06d248a tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:49.872974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94aade80-145e-4f60-90a4-68a0e06d248a tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:49.875063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-64c9d118-a17d-440c-989b-5d51cfddbc32 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:50:49.975233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-64c9d118-a17d-440c-989b-5d51cfddbc32 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:49.986560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64c9d118-a17d-440c-989b-5d51cfddbc32 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:49.986991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64c9d118-a17d-440c-989b-5d51cfddbc32 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:49.987504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64c9d118-a17d-440c-989b-5d51cfddbc32 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:50.114955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-94aade80-145e-4f60-90a4-68a0e06d248a tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:50.124478 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-94aade80-145e-4f60-90a4-68a0e06d248a tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1354 microversion: 2.1 time: 0.267467 Sep 07 12:50:50.125161 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2007/3971] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:49 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1354 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:50.130301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ab276dd9-9a7c-443d-86fe-ee9bff79e023 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:50.131229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ab276dd9-9a7c-443d-86fe-ee9bff79e023 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:50.138336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab276dd9-9a7c-443d-86fe-ee9bff79e023 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:50.139266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab276dd9-9a7c-443d-86fe-ee9bff79e023 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:50.139797 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab276dd9-9a7c-443d-86fe-ee9bff79e023 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:50.141469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab276dd9-9a7c-443d-86fe-ee9bff79e023 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:50.142709 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab276dd9-9a7c-443d-86fe-ee9bff79e023 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:50.143249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab276dd9-9a7c-443d-86fe-ee9bff79e023 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:50.173016 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-64c9d118-a17d-440c-989b-5d51cfddbc32 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4515 microversion: 2.1 time: 0.436221 Sep 07 12:50:50.173780 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1965/3972] 10.222.0.16 () {58 vars in 1173 bytes} [Wed Sep 7 12:50:49 2022] GET /compute/v2.1/servers/detail?status=active => generated 4515 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:50.203568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-34183e10-fb31-40e6-970f-65f86cc7b8a3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:50.209641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-34183e10-fb31-40e6-970f-65f86cc7b8a3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:50.210207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.compute.servers [None req-34183e10-fb31-40e6-970f-65f86cc7b8a3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Removing options 'limit' from query {{(pid=122432) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 07 12:50:50.211165 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-34183e10-fb31-40e6-970f-65f86cc7b8a3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Searching by: {'deleted': False, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:50:50.221827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34183e10-fb31-40e6-970f-65f86cc7b8a3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:50.222315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34183e10-fb31-40e6-970f-65f86cc7b8a3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:50.222750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34183e10-fb31-40e6-970f-65f86cc7b8a3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:50.223478 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34183e10-fb31-40e6-970f-65f86cc7b8a3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:50.223941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34183e10-fb31-40e6-970f-65f86cc7b8a3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:50.224369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34183e10-fb31-40e6-970f-65f86cc7b8a3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:50.272722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-34183e10-fb31-40e6-970f-65f86cc7b8a3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:50.281455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34183e10-fb31-40e6-970f-65f86cc7b8a3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:50.282117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34183e10-fb31-40e6-970f-65f86cc7b8a3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:50.282696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34183e10-fb31-40e6-970f-65f86cc7b8a3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:50.319874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ab276dd9-9a7c-443d-86fe-ee9bff79e023 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:50.329127 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ab276dd9-9a7c-443d-86fe-ee9bff79e023 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.202744 Sep 07 12:50:50.329779 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2008/3973] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:50 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:50.352980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-55debfbf-8715-4f40-9d5a-6cacfbaa9d28 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:50.353642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-55debfbf-8715-4f40-9d5a-6cacfbaa9d28 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:50.361587 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55debfbf-8715-4f40-9d5a-6cacfbaa9d28 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:50.362330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55debfbf-8715-4f40-9d5a-6cacfbaa9d28 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:50.362970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55debfbf-8715-4f40-9d5a-6cacfbaa9d28 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:50.363697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55debfbf-8715-4f40-9d5a-6cacfbaa9d28 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:50.364153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55debfbf-8715-4f40-9d5a-6cacfbaa9d28 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:50.364580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55debfbf-8715-4f40-9d5a-6cacfbaa9d28 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:50.460997 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-34183e10-fb31-40e6-970f-65f86cc7b8a3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.262525 Sep 07 12:50:50.462677 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1966/3974] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Sep 7 12:50:50 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:50:50.500587 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-34fd6e05-d0cc-4e0f-8880-48b98d745b04 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:50.506433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-34fd6e05-d0cc-4e0f-8880-48b98d745b04 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:50.507638 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-34fd6e05-d0cc-4e0f-8880-48b98d745b04 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:50:50.514950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34fd6e05-d0cc-4e0f-8880-48b98d745b04 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:50.515775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34fd6e05-d0cc-4e0f-8880-48b98d745b04 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:50.516427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34fd6e05-d0cc-4e0f-8880-48b98d745b04 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:50.517689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34fd6e05-d0cc-4e0f-8880-48b98d745b04 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:50.518410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34fd6e05-d0cc-4e0f-8880-48b98d745b04 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:50.519019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34fd6e05-d0cc-4e0f-8880-48b98d745b04 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:50.552255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-34fd6e05-d0cc-4e0f-8880-48b98d745b04 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:50:50.557609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-55debfbf-8715-4f40-9d5a-6cacfbaa9d28 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:50.568673 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-55debfbf-8715-4f40-9d5a-6cacfbaa9d28 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.219850 Sep 07 12:50:50.584559 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2009/3975] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:50 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:50.594691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-69d9d27f-4be6-4225-a76e-f3d58fb23e28 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:50.595644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-69d9d27f-4be6-4225-a76e-f3d58fb23e28 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:50.597350 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-34fd6e05-d0cc-4e0f-8880-48b98d745b04 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.102396 Sep 07 12:50:50.601682 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1967/3976] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Sep 7 12:50:50 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:50:50.611761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b6e5e7a1-f0cf-4a01-a4ff-caad3cd2f6f6 req-11b8a382-7ce5-4d47-87ed-7b2aaf1fef4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaef0385-5f99-4b42-97b2-5c412f4007ef", "name": "network-vif-plugged", "status": "completed", "tag": "5f3b27e0-c172-4e5b-a0d2-e417964e9c1b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:50.617827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69d9d27f-4be6-4225-a76e-f3d58fb23e28 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:50.619401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69d9d27f-4be6-4225-a76e-f3d58fb23e28 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:50.620449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69d9d27f-4be6-4225-a76e-f3d58fb23e28 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:50.621699 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69d9d27f-4be6-4225-a76e-f3d58fb23e28 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:50.622498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69d9d27f-4be6-4225-a76e-f3d58fb23e28 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:50.622944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69d9d27f-4be6-4225-a76e-f3d58fb23e28 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:50.631732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b6e5e7a1-f0cf-4a01-a4ff-caad3cd2f6f6 req-11b8a382-7ce5-4d47-87ed-7b2aaf1fef4e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:50.632960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b6e5e7a1-f0cf-4a01-a4ff-caad3cd2f6f6 req-11b8a382-7ce5-4d47-87ed-7b2aaf1fef4e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:50.633883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b6e5e7a1-f0cf-4a01-a4ff-caad3cd2f6f6 req-11b8a382-7ce5-4d47-87ed-7b2aaf1fef4e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:50.650515 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b6e5e7a1-f0cf-4a01-a4ff-caad3cd2f6f6 req-11b8a382-7ce5-4d47-87ed-7b2aaf1fef4e service nova] Creating event network-vif-plugged:5f3b27e0-c172-4e5b-a0d2-e417964e9c1b for instance aaef0385-5f99-4b42-97b2-5c412f4007ef on n-h2-852087-9 Sep 07 12:50:50.657175 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b6e5e7a1-f0cf-4a01-a4ff-caad3cd2f6f6 req-11b8a382-7ce5-4d47-87ed-7b2aaf1fef4e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053990 Sep 07 12:50:50.658166 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1968/3977] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:50:50.664446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b1ca6d6a-eddb-41f6-8949-877f48b9381a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:50.671160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b1ca6d6a-eddb-41f6-8949-877f48b9381a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:50.671503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.compute.servers [None req-b1ca6d6a-eddb-41f6-8949-877f48b9381a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Removing options 'limit' from query {{(pid=122432) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 07 12:50:50.672762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b1ca6d6a-eddb-41f6-8949-877f48b9381a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Searching by: {'deleted': False, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:50:50.680131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1ca6d6a-eddb-41f6-8949-877f48b9381a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:50.680761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1ca6d6a-eddb-41f6-8949-877f48b9381a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:50.681208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1ca6d6a-eddb-41f6-8949-877f48b9381a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:50.682448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1ca6d6a-eddb-41f6-8949-877f48b9381a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:50.683219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1ca6d6a-eddb-41f6-8949-877f48b9381a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:50.683796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1ca6d6a-eddb-41f6-8949-877f48b9381a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:50.729257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-b1ca6d6a-eddb-41f6-8949-877f48b9381a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:50:50.756904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:50.782632 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b1ca6d6a-eddb-41f6-8949-877f48b9381a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.122674 Sep 07 12:50:50.783926 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1969/3978] 10.222.0.16 () {58 vars in 1150 bytes} [Wed Sep 7 12:50:50 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:50.805386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9dc119ba-1eb0-4105-be77-945e40209604 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:50.814939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9dc119ba-1eb0-4105-be77-945e40209604 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:50.816594 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9dc119ba-1eb0-4105-be77-945e40209604 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Searching by: {'deleted': False, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:50:50.835298 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9dc119ba-1eb0-4105-be77-945e40209604 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:50.836193 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9dc119ba-1eb0-4105-be77-945e40209604 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:50.838119 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9dc119ba-1eb0-4105-be77-945e40209604 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:50.839345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9dc119ba-1eb0-4105-be77-945e40209604 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:50.846601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9dc119ba-1eb0-4105-be77-945e40209604 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:50.848176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9dc119ba-1eb0-4105-be77-945e40209604 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:50.888770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-69d9d27f-4be6-4225-a76e-f3d58fb23e28 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:50.904063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-9dc119ba-1eb0-4105-be77-945e40209604 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:50:50.908848 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-69d9d27f-4be6-4225-a76e-f3d58fb23e28 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef" status: 200 len: 1315 microversion: 2.1 time: 0.322386 Sep 07 12:50:50.915478 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2010/3979] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:50 2022] GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:50.933666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b50ecec0-34a5-4781-944c-1d5fa437fde9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:50.935463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b50ecec0-34a5-4781-944c-1d5fa437fde9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:50.954642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b50ecec0-34a5-4781-944c-1d5fa437fde9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:50.955539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b50ecec0-34a5-4781-944c-1d5fa437fde9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:50.962017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b50ecec0-34a5-4781-944c-1d5fa437fde9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:50.966061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b50ecec0-34a5-4781-944c-1d5fa437fde9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:50.967237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b50ecec0-34a5-4781-944c-1d5fa437fde9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:50.968155 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b50ecec0-34a5-4781-944c-1d5fa437fde9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:50.974049 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9dc119ba-1eb0-4105-be77-945e40209604 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.176350 Sep 07 12:50:50.976847 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1970/3980] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Sep 7 12:50:50 2022] GET /compute/v2.1/servers => generated 1011 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:51.003810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b289cc35-5d7e-4a34-854e-6dbf0689daf9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:51.017117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b289cc35-5d7e-4a34-854e-6dbf0689daf9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:51.017766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b289cc35-5d7e-4a34-854e-6dbf0689daf9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:50:51.060214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b289cc35-5d7e-4a34-854e-6dbf0689daf9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:51.060214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b289cc35-5d7e-4a34-854e-6dbf0689daf9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:51.060214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b289cc35-5d7e-4a34-854e-6dbf0689daf9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:51.063428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b289cc35-5d7e-4a34-854e-6dbf0689daf9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:51.068706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b289cc35-5d7e-4a34-854e-6dbf0689daf9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:51.069898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b289cc35-5d7e-4a34-854e-6dbf0689daf9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:51.305155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-b289cc35-5d7e-4a34-854e-6dbf0689daf9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:50:51.385051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b50ecec0-34a5-4781-944c-1d5fa437fde9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:51.396287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b50ecec0-34a5-4781-944c-1d5fa437fde9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:51.398858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b50ecec0-34a5-4781-944c-1d5fa437fde9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:51.400883 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b50ecec0-34a5-4781-944c-1d5fa437fde9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.479480 Sep 07 12:50:51.416656 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2011/3981] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:50 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:51.436030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d8746438-c505-43ac-a538-befda11c82bd tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:51.437128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d8746438-c505-43ac-a538-befda11c82bd tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:51.437621 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b289cc35-5d7e-4a34-854e-6dbf0689daf9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.442883 Sep 07 12:50:51.438613 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1971/3982] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:50:50 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:50:51.470024 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f5fbac53-7c54-4881-a2a8-999837c730a8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:51.471085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8746438-c505-43ac-a538-befda11c82bd tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:51.471290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8746438-c505-43ac-a538-befda11c82bd tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:51.471748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8746438-c505-43ac-a538-befda11c82bd tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:51.472622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8746438-c505-43ac-a538-befda11c82bd tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:51.473741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8746438-c505-43ac-a538-befda11c82bd tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:51.474582 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8746438-c505-43ac-a538-befda11c82bd tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:51.479623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f5fbac53-7c54-4881-a2a8-999837c730a8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:51.481081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.compute.servers [None req-f5fbac53-7c54-4881-a2a8-999837c730a8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Removing options 'limit' from query {{(pid=122432) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 07 12:50:51.482386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f5fbac53-7c54-4881-a2a8-999837c730a8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Searching by: {'deleted': False, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:50:51.494022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5fbac53-7c54-4881-a2a8-999837c730a8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:51.495034 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5fbac53-7c54-4881-a2a8-999837c730a8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:51.495866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5fbac53-7c54-4881-a2a8-999837c730a8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:51.497404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5fbac53-7c54-4881-a2a8-999837c730a8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:51.498253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5fbac53-7c54-4881-a2a8-999837c730a8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:51.498996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5fbac53-7c54-4881-a2a8-999837c730a8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:51.545979 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f5fbac53-7c54-4881-a2a8-999837c730a8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.082901 Sep 07 12:50:51.561253 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1972/3983] 10.222.0.16 () {58 vars in 1140 bytes} [Wed Sep 7 12:50:51 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:50:51.570646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6d720c7e-7b6e-417f-a3d4-4651f32a02e8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:51.581256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6d720c7e-7b6e-417f-a3d4-4651f32a02e8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:51.583013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6d720c7e-7b6e-417f-a3d4-4651f32a02e8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2028358869', 'deleted': False, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:50:51.594739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d720c7e-7b6e-417f-a3d4-4651f32a02e8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:51.595922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d720c7e-7b6e-417f-a3d4-4651f32a02e8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:51.597347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d720c7e-7b6e-417f-a3d4-4651f32a02e8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:51.599196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d720c7e-7b6e-417f-a3d4-4651f32a02e8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:51.602871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d720c7e-7b6e-417f-a3d4-4651f32a02e8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:51.604082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d720c7e-7b6e-417f-a3d4-4651f32a02e8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:51.701287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d8746438-c505-43ac-a538-befda11c82bd tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:51.714152 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d8746438-c505-43ac-a538-befda11c82bd tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1354 microversion: 2.1 time: 0.296450 Sep 07 12:50:51.715393 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2012/3984] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:51 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1354 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:51.782764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-6d720c7e-7b6e-417f-a3d4-4651f32a02e8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:50:51.911269 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6d720c7e-7b6e-417f-a3d4-4651f32a02e8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2028358869" status: 200 len: 346 microversion: 2.1 time: 0.348238 Sep 07 12:50:51.912396 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1973/3985] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Sep 7 12:50:51 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2028358869 => generated 346 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:50:51.931463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4995bc01-bfdb-432e-92e6-820c2f8fcf05 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:51.943720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4995bc01-bfdb-432e-92e6-820c2f8fcf05 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:51.944762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4995bc01-bfdb-432e-92e6-820c2f8fcf05 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:51.945924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4995bc01-bfdb-432e-92e6-820c2f8fcf05 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:51.951657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b8ecd05b-984b-4096-9496-e2223313a228 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:51.952425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b8ecd05b-984b-4096-9496-e2223313a228 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:51.970679 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8ecd05b-984b-4096-9496-e2223313a228 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:51.971175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8ecd05b-984b-4096-9496-e2223313a228 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:51.971600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8ecd05b-984b-4096-9496-e2223313a228 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:51.972325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8ecd05b-984b-4096-9496-e2223313a228 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:51.972929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8ecd05b-984b-4096-9496-e2223313a228 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:51.973365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8ecd05b-984b-4096-9496-e2223313a228 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:51.997735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4995bc01-bfdb-432e-92e6-820c2f8fcf05 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] Going to try to stop instance {{(pid=122433) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 12:50:52.079974 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4995bc01-bfdb-432e-92e6-820c2f8fcf05 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "POST /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0/action" status: 202 len: 0 microversion: 2.1 time: 0.155454 Sep 07 12:50:52.101242 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2013/3986] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:50:51 2022] POST /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:50:52.118384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f0b2afc0-77f2-417e-9549-eab65806d22f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:52.120246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f0b2afc0-77f2-417e-9549-eab65806d22f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:52.124472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:52.140958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0b2afc0-77f2-417e-9549-eab65806d22f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:52.142112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0b2afc0-77f2-417e-9549-eab65806d22f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:52.143153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0b2afc0-77f2-417e-9549-eab65806d22f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:52.144447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0b2afc0-77f2-417e-9549-eab65806d22f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:52.145243 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0b2afc0-77f2-417e-9549-eab65806d22f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:52.146187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0b2afc0-77f2-417e-9549-eab65806d22f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:52.255242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b8ecd05b-984b-4096-9496-e2223313a228 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:52.270625 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b8ecd05b-984b-4096-9496-e2223313a228 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef" status: 200 len: 1315 microversion: 2.1 time: 0.323711 Sep 07 12:50:52.271828 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1974/3987] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:51 2022] GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:52.434235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f0b2afc0-77f2-417e-9549-eab65806d22f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:52.435322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bd5ee5a6-86b8-477c-afee-13255e8d7a58 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:52.436356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bd5ee5a6-86b8-477c-afee-13255e8d7a58 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:52.447717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd5ee5a6-86b8-477c-afee-13255e8d7a58 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:52.448947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd5ee5a6-86b8-477c-afee-13255e8d7a58 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:52.450383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd5ee5a6-86b8-477c-afee-13255e8d7a58 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:52.451916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd5ee5a6-86b8-477c-afee-13255e8d7a58 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:52.453202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd5ee5a6-86b8-477c-afee-13255e8d7a58 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:52.454563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd5ee5a6-86b8-477c-afee-13255e8d7a58 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:52.456811 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f0b2afc0-77f2-417e-9549-eab65806d22f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0" status: 200 len: 1521 microversion: 2.1 time: 0.352687 Sep 07 12:50:52.458022 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2014/3988] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:52 2022] GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0 => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:52.734539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bd5ee5a6-86b8-477c-afee-13255e8d7a58 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:52.749130 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bd5ee5a6-86b8-477c-afee-13255e8d7a58 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:52.752017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bd5ee5a6-86b8-477c-afee-13255e8d7a58 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:52.754157 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bd5ee5a6-86b8-477c-afee-13255e8d7a58 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.325022 Sep 07 12:50:52.755118 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1975/3989] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:52 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:50:52.756806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5f931f01-be86-4263-80ba-502b9a80e84c tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:52.758679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5f931f01-be86-4263-80ba-502b9a80e84c tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:52.770104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f931f01-be86-4263-80ba-502b9a80e84c tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:52.770718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f931f01-be86-4263-80ba-502b9a80e84c tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:52.771226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f931f01-be86-4263-80ba-502b9a80e84c tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:52.772153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f931f01-be86-4263-80ba-502b9a80e84c tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:52.772679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f931f01-be86-4263-80ba-502b9a80e84c tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:52.773273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f931f01-be86-4263-80ba-502b9a80e84c tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:52.966039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5f931f01-be86-4263-80ba-502b9a80e84c tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:52.976675 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5f931f01-be86-4263-80ba-502b9a80e84c tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1354 microversion: 2.1 time: 0.227146 Sep 07 12:50:52.977437 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2015/3990] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:52 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1354 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:53.309287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f8a10d7f-a352-4c27-b9f4-e948805f3eed tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:53.310094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f8a10d7f-a352-4c27-b9f4-e948805f3eed tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:53.317724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8a10d7f-a352-4c27-b9f4-e948805f3eed tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:53.318479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8a10d7f-a352-4c27-b9f4-e948805f3eed tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:53.318964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8a10d7f-a352-4c27-b9f4-e948805f3eed tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:53.319756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8a10d7f-a352-4c27-b9f4-e948805f3eed tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:53.320254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8a10d7f-a352-4c27-b9f4-e948805f3eed tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:53.320808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8a10d7f-a352-4c27-b9f4-e948805f3eed tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:53.480277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f8a10d7f-a352-4c27-b9f4-e948805f3eed tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:53.485521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a344a179-dac1-4927-b644-2c80d8fc10e4 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:53.486642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a344a179-dac1-4927-b644-2c80d8fc10e4 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:53.493036 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f8a10d7f-a352-4c27-b9f4-e948805f3eed tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef" status: 200 len: 1501 microversion: 2.1 time: 0.187974 Sep 07 12:50:53.494262 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1976/3991] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:53 2022] GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef => generated 1501 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:53.494990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a344a179-dac1-4927-b644-2c80d8fc10e4 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:53.495339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a344a179-dac1-4927-b644-2c80d8fc10e4 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:53.495917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a344a179-dac1-4927-b644-2c80d8fc10e4 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:53.497139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a344a179-dac1-4927-b644-2c80d8fc10e4 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:53.497385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a344a179-dac1-4927-b644-2c80d8fc10e4 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:53.497784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a344a179-dac1-4927-b644-2c80d8fc10e4 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:53.536706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9118eeba-711f-4f14-a194-b6792a5aaa65 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:53.543251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9118eeba-711f-4f14-a194-b6792a5aaa65 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:53.557649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9118eeba-711f-4f14-a194-b6792a5aaa65 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:53.558533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9118eeba-711f-4f14-a194-b6792a5aaa65 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:53.559401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9118eeba-711f-4f14-a194-b6792a5aaa65 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:53.560794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9118eeba-711f-4f14-a194-b6792a5aaa65 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:53.561558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9118eeba-711f-4f14-a194-b6792a5aaa65 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:53.562310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9118eeba-711f-4f14-a194-b6792a5aaa65 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:53.676764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a344a179-dac1-4927-b644-2c80d8fc10e4 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:53.681549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:53.704199 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a344a179-dac1-4927-b644-2c80d8fc10e4 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0" status: 200 len: 1521 microversion: 2.1 time: 0.217287 Sep 07 12:50:53.705820 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2016/3992] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:53 2022] GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:50:53.712750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bd6721b5-be62-49df-a9f7-f162ea0bb724 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-612180950", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "destination_type": "local"}, {"source_type": "volume", "uuid": "7c2c805d-2599-4cd9-b054-989007c2971c", "destination_type": "invalid"}], "networks": [{"uuid": "b810bb5d-8084-47d5-9b9e-6ea4661cdf5f"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:53.720204 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9118eeba-711f-4f14-a194-b6792a5aaa65 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action" status: 200 len: 14 microversion: 2.1 time: 0.190906 Sep 07 12:50:53.726598 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1977/3993] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:50:53 2022] POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action => generated 14 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bd6721b5-be62-49df-a9f7-f162ea0bb724 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 494 Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-612180950", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "destination_type": "local"}, {"source_type": "volume", "uuid": "7c2c805d-2599-4cd9-b054-989007c2971c", "destination_type": "invalid"}], "networks": [{"uuid": "b810bb5d-8084-47d5-9b9e-6ea4661cdf5f"}]}} Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-612180950', 'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '7c2c805d-2599-4cd9-b054-989007c2971c', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'b810bb5d-8084-47d5-9b9e-6ea4661cdf5f'}]}}} Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'invalid' Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:50:53.727804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:50:53.736000 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:50:53.736000 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:50:53.736000 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:50:53.736000 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:50:53.736000 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:50:53.736000 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:50:53.736000 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:50:53.736000 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:50:53.736000 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 07 12:50:53.736000 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:53.736000 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:50:53.736000 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:53.736000 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:53.736000 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:50:53.736000 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:50:53.736000 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:50:53.736000 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:50:53.736000 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 07 12:50:53.736000 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:53.736000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bd6721b5-be62-49df-a9f7-f162ea0bb724 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:50:53.736000 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bd6721b5-be62-49df-a9f7-f162ea0bb724 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.022959 Sep 07 12:50:53.736000 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2017/3994] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:50:53 2022] POST /compute/v2.1/servers => generated 155 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:50:53.745241 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b89b8a9f-e113-4d1c-9a86-f5647db275c0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:53.746427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b89b8a9f-e113-4d1c-9a86-f5647db275c0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:53.756556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b89b8a9f-e113-4d1c-9a86-f5647db275c0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:53.757435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b89b8a9f-e113-4d1c-9a86-f5647db275c0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:53.758432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b89b8a9f-e113-4d1c-9a86-f5647db275c0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:53.759985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b89b8a9f-e113-4d1c-9a86-f5647db275c0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:53.761054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b89b8a9f-e113-4d1c-9a86-f5647db275c0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:53.761982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b89b8a9f-e113-4d1c-9a86-f5647db275c0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:53.789294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fa743bc9-5e82-4211-8a08-ed1e0cb23b0d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:53.792048 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fa743bc9-5e82-4211-8a08-ed1e0cb23b0d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:53.810047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa743bc9-5e82-4211-8a08-ed1e0cb23b0d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:53.811525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa743bc9-5e82-4211-8a08-ed1e0cb23b0d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:53.812310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa743bc9-5e82-4211-8a08-ed1e0cb23b0d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:53.814003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa743bc9-5e82-4211-8a08-ed1e0cb23b0d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:53.814877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa743bc9-5e82-4211-8a08-ed1e0cb23b0d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:53.815717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa743bc9-5e82-4211-8a08-ed1e0cb23b0d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:54.182585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b89b8a9f-e113-4d1c-9a86-f5647db275c0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:54.194704 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b89b8a9f-e113-4d1c-9a86-f5647db275c0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.453569 Sep 07 12:50:54.202478 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1978/3995] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:53 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:54.206221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2375eff2-26e2-462e-80d2-54937390de65 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:54.207588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2375eff2-26e2-462e-80d2-54937390de65 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:54.221392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2375eff2-26e2-462e-80d2-54937390de65 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:54.222522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2375eff2-26e2-462e-80d2-54937390de65 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:54.223295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2375eff2-26e2-462e-80d2-54937390de65 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:54.224916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2375eff2-26e2-462e-80d2-54937390de65 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:54.225853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2375eff2-26e2-462e-80d2-54937390de65 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:54.226635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2375eff2-26e2-462e-80d2-54937390de65 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:54.239868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fa743bc9-5e82-4211-8a08-ed1e0cb23b0d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:54.252460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fa743bc9-5e82-4211-8a08-ed1e0cb23b0d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:54.255003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fa743bc9-5e82-4211-8a08-ed1e0cb23b0d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:54.257091 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fa743bc9-5e82-4211-8a08-ed1e0cb23b0d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.475529 Sep 07 12:50:54.257896 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2018/3996] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:53 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:50:54.267201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-044c2f5f-b289-48cf-a752-1ac1f71d0432 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:54.268840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-044c2f5f-b289-48cf-a752-1ac1f71d0432 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:54.281943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-044c2f5f-b289-48cf-a752-1ac1f71d0432 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:54.282888 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-044c2f5f-b289-48cf-a752-1ac1f71d0432 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:54.283625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-044c2f5f-b289-48cf-a752-1ac1f71d0432 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:54.284584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-044c2f5f-b289-48cf-a752-1ac1f71d0432 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:54.285225 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-044c2f5f-b289-48cf-a752-1ac1f71d0432 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:54.285938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-044c2f5f-b289-48cf-a752-1ac1f71d0432 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:54.512921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2375eff2-26e2-462e-80d2-54937390de65 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:54.522743 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2375eff2-26e2-462e-80d2-54937390de65 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1354 microversion: 2.1 time: 0.325161 Sep 07 12:50:54.523531 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1979/3997] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:54 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1354 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:54.549343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-044c2f5f-b289-48cf-a752-1ac1f71d0432 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:54.558161 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-044c2f5f-b289-48cf-a752-1ac1f71d0432 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.298537 Sep 07 12:50:54.558842 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2019/3998] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:54 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:54.626680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-27187193-3187-4a25-b209-7d066c401560 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2107381331", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "b810bb5d-8084-47d5-9b9e-6ea4661cdf5f"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-27187193-3187-4a25-b209-7d066c401560 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 492 Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2107381331", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "b810bb5d-8084-47d5-9b9e-6ea4661cdf5f"}]}} Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2107381331', 'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'b810bb5d-8084-47d5-9b9e-6ea4661cdf5f'}]}}} Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:54.631383 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-27187193-3187-4a25-b209-7d066c401560 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-27187193-3187-4a25-b209-7d066c401560 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.011334 Sep 07 12:50:54.638243 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1980/3999] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:50:54 2022] POST /compute/v2.1/servers => generated 624 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:50:54.645694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aae80620-15ba-4293-8fe8-a94707cb23ba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:54.646429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aae80620-15ba-4293-8fe8-a94707cb23ba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:54.653537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aae80620-15ba-4293-8fe8-a94707cb23ba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:54.654217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aae80620-15ba-4293-8fe8-a94707cb23ba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:54.654767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aae80620-15ba-4293-8fe8-a94707cb23ba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:54.655663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aae80620-15ba-4293-8fe8-a94707cb23ba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:54.656237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aae80620-15ba-4293-8fe8-a94707cb23ba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:54.656764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aae80620-15ba-4293-8fe8-a94707cb23ba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:54.742575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d1007b1-88a2-4ace-b1c6-b98b0fd09071 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:54.745700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9d1007b1-88a2-4ace-b1c6-b98b0fd09071 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:54.758508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d1007b1-88a2-4ace-b1c6-b98b0fd09071 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:54.759551 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d1007b1-88a2-4ace-b1c6-b98b0fd09071 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:54.760557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d1007b1-88a2-4ace-b1c6-b98b0fd09071 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:54.762197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d1007b1-88a2-4ace-b1c6-b98b0fd09071 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:54.763137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d1007b1-88a2-4ace-b1c6-b98b0fd09071 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:54.763946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d1007b1-88a2-4ace-b1c6-b98b0fd09071 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:54.848851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aae80620-15ba-4293-8fe8-a94707cb23ba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:54.857897 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aae80620-15ba-4293-8fe8-a94707cb23ba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.216858 Sep 07 12:50:54.858503 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2020/4000] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:54 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:54.863828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fedf5d94-fb98-48ae-9239-67c7dad9bf20 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:54.864515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fedf5d94-fb98-48ae-9239-67c7dad9bf20 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:54.872972 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9d1007b1-88a2-4ace-b1c6-b98b0fd09071 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action" status: 200 len: 14 microversion: 2.1 time: 0.140749 Sep 07 12:50:54.873884 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1981/4001] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:50:54 2022] POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:50:54.874097 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fedf5d94-fb98-48ae-9239-67c7dad9bf20 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:54.874969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fedf5d94-fb98-48ae-9239-67c7dad9bf20 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:54.875832 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fedf5d94-fb98-48ae-9239-67c7dad9bf20 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:54.877186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fedf5d94-fb98-48ae-9239-67c7dad9bf20 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:54.878073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fedf5d94-fb98-48ae-9239-67c7dad9bf20 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:54.878862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fedf5d94-fb98-48ae-9239-67c7dad9bf20 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:54.891423 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dc2acd5c-1baf-4da6-9e30-a1ba9b18b611 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:54.892642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dc2acd5c-1baf-4da6-9e30-a1ba9b18b611 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:54.901349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc2acd5c-1baf-4da6-9e30-a1ba9b18b611 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:54.901752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc2acd5c-1baf-4da6-9e30-a1ba9b18b611 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:54.903126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc2acd5c-1baf-4da6-9e30-a1ba9b18b611 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:54.903126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc2acd5c-1baf-4da6-9e30-a1ba9b18b611 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:54.903556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc2acd5c-1baf-4da6-9e30-a1ba9b18b611 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:54.903990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc2acd5c-1baf-4da6-9e30-a1ba9b18b611 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:55.152204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fedf5d94-fb98-48ae-9239-67c7dad9bf20 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:55.156296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dc2acd5c-1baf-4da6-9e30-a1ba9b18b611 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:55.162106 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fedf5d94-fb98-48ae-9239-67c7dad9bf20 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0" status: 200 len: 1521 microversion: 2.1 time: 0.302142 Sep 07 12:50:55.162871 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2021/4002] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:54 2022] GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:55.168191 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dc2acd5c-1baf-4da6-9e30-a1ba9b18b611 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.281245 Sep 07 12:50:55.169288 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1982/4003] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:54 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:50:55.262998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f0b1a79c-3eac-4744-b98d-ed2152d385da tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "b810bb5d-8084-47d5-9b9e-6ea4661cdf5f"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f0b1a79c-3eac-4744-b98d-ed2152d385da tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 416 Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "b810bb5d-8084-47d5-9b9e-6ea4661cdf5f"}]}} Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f', 'flavorRef': '452', 'networks': [{'uuid': 'b810bb5d-8084-47d5-9b9e-6ea4661cdf5f'}]}}} Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:55.267822 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f0b1a79c-3eac-4744-b98d-ed2152d385da tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f0b1a79c-3eac-4744-b98d-ed2152d385da tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.011077 Sep 07 12:50:55.273294 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2022/4004] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:50:55 2022] POST /compute/v2.1/servers => generated 619 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:50:55.281062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1aa954c6-d5fd-422d-8f7f-d00680c7c01b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:55.281835 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1aa954c6-d5fd-422d-8f7f-d00680c7c01b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:55.289831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1aa954c6-d5fd-422d-8f7f-d00680c7c01b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:55.290562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1aa954c6-d5fd-422d-8f7f-d00680c7c01b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:55.291106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1aa954c6-d5fd-422d-8f7f-d00680c7c01b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:55.291977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1aa954c6-d5fd-422d-8f7f-d00680c7c01b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:55.292617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1aa954c6-d5fd-422d-8f7f-d00680c7c01b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:55.293145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1aa954c6-d5fd-422d-8f7f-d00680c7c01b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:55.301253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a7db10b5-d8c4-4056-9fa2-2eff0869b745 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:55.302113 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a7db10b5-d8c4-4056-9fa2-2eff0869b745 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:55.311498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7db10b5-d8c4-4056-9fa2-2eff0869b745 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:55.312158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7db10b5-d8c4-4056-9fa2-2eff0869b745 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:55.312807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7db10b5-d8c4-4056-9fa2-2eff0869b745 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:55.313828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7db10b5-d8c4-4056-9fa2-2eff0869b745 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:55.314402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7db10b5-d8c4-4056-9fa2-2eff0869b745 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:55.314931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7db10b5-d8c4-4056-9fa2-2eff0869b745 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:55.559554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1aa954c6-d5fd-422d-8f7f-d00680c7c01b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:55.570408 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1aa954c6-d5fd-422d-8f7f-d00680c7c01b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.293330 Sep 07 12:50:55.571165 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1983/4005] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:55 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:55.580249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4f1a5f61-1f30-46ee-bb31-917d67a936be tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:55.581427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4f1a5f61-1f30-46ee-bb31-917d67a936be tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:55.592015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:55.595973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f1a5f61-1f30-46ee-bb31-917d67a936be tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:55.596890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f1a5f61-1f30-46ee-bb31-917d67a936be tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:55.597405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f1a5f61-1f30-46ee-bb31-917d67a936be tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:55.598470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f1a5f61-1f30-46ee-bb31-917d67a936be tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:55.599178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f1a5f61-1f30-46ee-bb31-917d67a936be tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:55.600836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4f1a5f61-1f30-46ee-bb31-917d67a936be tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:55.620046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a7db10b5-d8c4-4056-9fa2-2eff0869b745 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:55.639352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a7db10b5-d8c4-4056-9fa2-2eff0869b745 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:55.642245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a7db10b5-d8c4-4056-9fa2-2eff0869b745 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:55.644337 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a7db10b5-d8c4-4056-9fa2-2eff0869b745 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.347350 Sep 07 12:50:55.645622 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2023/4006] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:55 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:55.653982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-124f28c2-38fa-4158-b989-e565cc9c94c2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:55.655349 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-124f28c2-38fa-4158-b989-e565cc9c94c2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:55.666221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-124f28c2-38fa-4158-b989-e565cc9c94c2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:55.667068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-124f28c2-38fa-4158-b989-e565cc9c94c2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:55.667853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-124f28c2-38fa-4158-b989-e565cc9c94c2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:55.669140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-124f28c2-38fa-4158-b989-e565cc9c94c2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:55.670322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-124f28c2-38fa-4158-b989-e565cc9c94c2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:55.671348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-124f28c2-38fa-4158-b989-e565cc9c94c2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:55.866214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4f1a5f61-1f30-46ee-bb31-917d67a936be tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:55.880543 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4f1a5f61-1f30-46ee-bb31-917d67a936be tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1354 microversion: 2.1 time: 0.304382 Sep 07 12:50:55.880543 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1984/4007] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:55 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1354 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:55.891437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4c6c0130-7b77-43c5-92f3-0ced148df65a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:55.896310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4c6c0130-7b77-43c5-92f3-0ced148df65a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:55.906675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-124f28c2-38fa-4158-b989-e565cc9c94c2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:55.912960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c6c0130-7b77-43c5-92f3-0ced148df65a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:55.912960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c6c0130-7b77-43c5-92f3-0ced148df65a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:55.913374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c6c0130-7b77-43c5-92f3-0ced148df65a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:55.914089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c6c0130-7b77-43c5-92f3-0ced148df65a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:55.914627 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c6c0130-7b77-43c5-92f3-0ced148df65a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:55.915127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c6c0130-7b77-43c5-92f3-0ced148df65a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:55.925012 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-124f28c2-38fa-4158-b989-e565cc9c94c2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.277215 Sep 07 12:50:55.926130 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2024/4008] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:55 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:56.015599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6acddcef-1bfa-4cb7-9492-3d729a30ceb4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1266496268", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": -1, "networks": [{"uuid": "b810bb5d-8084-47d5-9b9e-6ea4661cdf5f"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:56.029462 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-6acddcef-1bfa-4cb7-9492-3d729a30ceb4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Flavor -1 could not be found. Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6acddcef-1bfa-4cb7-9492-3d729a30ceb4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 206 Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1266496268", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": -1, "networks": [{"uuid": "b810bb5d-8084-47d5-9b9e-6ea4661cdf5f"}]}} Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: exception: Flavor -1 could not be found. Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1266496268', 'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f', 'flavorRef': -1, 'networks': [{'uuid': 'b810bb5d-8084-47d5-9b9e-6ea4661cdf5f'}]}}} Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:50:56.031338 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:50:56.037803 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:50:56.037803 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:50:56.037803 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:50:56.037803 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:50:56.037803 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 07 12:50:56.037803 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 07 12:50:56.037803 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 07 12:50:56.037803 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Sep 07 12:50:56.037803 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:56.037803 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:50:56.037803 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:56.037803 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:56.037803 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:50:56.037803 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:50:56.037803 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:50:56.037803 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:50:56.037803 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Sep 07 12:50:56.037803 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:56.037803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6acddcef-1bfa-4cb7-9492-3d729a30ceb4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:50:56.037803 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6acddcef-1bfa-4cb7-9492-3d729a30ceb4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.021890 Sep 07 12:50:56.037803 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2025/4009] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:50:56 2022] POST /compute/v2.1/servers => generated 73 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 07 12:50:56.046132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e6a85629-8f7c-4ed0-a850-a7beba4ce812 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:56.047267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e6a85629-8f7c-4ed0-a850-a7beba4ce812 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:56.056855 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6a85629-8f7c-4ed0-a850-a7beba4ce812 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:56.057411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6a85629-8f7c-4ed0-a850-a7beba4ce812 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:56.057974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6a85629-8f7c-4ed0-a850-a7beba4ce812 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:56.059106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6a85629-8f7c-4ed0-a850-a7beba4ce812 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:56.059683 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6a85629-8f7c-4ed0-a850-a7beba4ce812 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:56.060229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6a85629-8f7c-4ed0-a850-a7beba4ce812 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:56.248503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e6a85629-8f7c-4ed0-a850-a7beba4ce812 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:56.257644 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e6a85629-8f7c-4ed0-a850-a7beba4ce812 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.218090 Sep 07 12:50:56.258240 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2026/4010] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:56 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:56.263208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-41891fa2-64fc-4575-9073-e34bff70cb0c tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:56.264184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-41891fa2-64fc-4575-9073-e34bff70cb0c tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:56.270847 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41891fa2-64fc-4575-9073-e34bff70cb0c tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:56.271346 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41891fa2-64fc-4575-9073-e34bff70cb0c tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:56.271787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41891fa2-64fc-4575-9073-e34bff70cb0c tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:56.272503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41891fa2-64fc-4575-9073-e34bff70cb0c tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:56.272991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41891fa2-64fc-4575-9073-e34bff70cb0c tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:56.273424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41891fa2-64fc-4575-9073-e34bff70cb0c tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:56.427693 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-41891fa2-64fc-4575-9073-e34bff70cb0c tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:56.436785 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-41891fa2-64fc-4575-9073-e34bff70cb0c tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0" status: 200 len: 1521 microversion: 2.1 time: 0.177428 Sep 07 12:50:56.437379 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2027/4011] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:56 2022] GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:56.442650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3254191d-85eb-4375-ae22-d636529d43da tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:56.443368 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3254191d-85eb-4375-ae22-d636529d43da tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:56.450707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3254191d-85eb-4375-ae22-d636529d43da tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:56.451217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3254191d-85eb-4375-ae22-d636529d43da tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:56.451657 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3254191d-85eb-4375-ae22-d636529d43da tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:56.452386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3254191d-85eb-4375-ae22-d636529d43da tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:56.452850 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3254191d-85eb-4375-ae22-d636529d43da tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:56.453277 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3254191d-85eb-4375-ae22-d636529d43da tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:56.627648 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3254191d-85eb-4375-ae22-d636529d43da tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:56.636530 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3254191d-85eb-4375-ae22-d636529d43da tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.197949 Sep 07 12:50:56.637151 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2028/4012] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:56 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:56.672367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d92cc611-ecc4-4daa-919a-05fc7a1ead5e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:56.672999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d92cc611-ecc4-4daa-919a-05fc7a1ead5e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:56.681467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d92cc611-ecc4-4daa-919a-05fc7a1ead5e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:56.682316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d92cc611-ecc4-4daa-919a-05fc7a1ead5e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:56.683033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d92cc611-ecc4-4daa-919a-05fc7a1ead5e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:56.684202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d92cc611-ecc4-4daa-919a-05fc7a1ead5e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:56.684940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d92cc611-ecc4-4daa-919a-05fc7a1ead5e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:56.685718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d92cc611-ecc4-4daa-919a-05fc7a1ead5e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:56.933000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d92cc611-ecc4-4daa-919a-05fc7a1ead5e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:56.944392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d92cc611-ecc4-4daa-919a-05fc7a1ead5e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:56.946198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d92cc611-ecc4-4daa-919a-05fc7a1ead5e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:56.947489 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d92cc611-ecc4-4daa-919a-05fc7a1ead5e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.279843 Sep 07 12:50:56.948137 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2029/4013] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:56 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:50:56.957675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-91a91580-2b8f-431a-89b6-535dc6c07dfa tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2113663833", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "b810bb5d-8084-47d5-9b9e-6ea4661cdf5f"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-91a91580-2b8f-431a-89b6-535dc6c07dfa tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 173 Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2113663833", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "b810bb5d-8084-47d5-9b9e-6ea4661cdf5f"}]}} Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2113663833', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'b810bb5d-8084-47d5-9b9e-6ea4661cdf5f'}]}}} Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi -1 Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:50:56.966222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:50:56.974834 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:50:56.974834 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:50:56.974834 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 07 12:50:56.974834 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:56.974834 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:50:56.974834 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:56.974834 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:56.974834 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:50:56.974834 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:50:56.974834 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:50:56.974834 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:50:56.974834 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 07 12:50:56.974834 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:56.974834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-91a91580-2b8f-431a-89b6-535dc6c07dfa tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:50:56.974834 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-91a91580-2b8f-431a-89b6-535dc6c07dfa tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.019372 Sep 07 12:50:56.974834 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2030/4014] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:50:56 2022] POST /compute/v2.1/servers => generated 145 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:50:56.979713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8fc92830-f0bd-4b14-8a1a-89cdcab7fbe5 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:56.980899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8fc92830-f0bd-4b14-8a1a-89cdcab7fbe5 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:56.992655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fc92830-f0bd-4b14-8a1a-89cdcab7fbe5 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:56.993234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fc92830-f0bd-4b14-8a1a-89cdcab7fbe5 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:56.993761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fc92830-f0bd-4b14-8a1a-89cdcab7fbe5 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:56.994564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fc92830-f0bd-4b14-8a1a-89cdcab7fbe5 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:56.995075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fc92830-f0bd-4b14-8a1a-89cdcab7fbe5 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:56.995550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fc92830-f0bd-4b14-8a1a-89cdcab7fbe5 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:57.162174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8fc92830-f0bd-4b14-8a1a-89cdcab7fbe5 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:57.170893 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8fc92830-f0bd-4b14-8a1a-89cdcab7fbe5 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1354 microversion: 2.1 time: 0.199140 Sep 07 12:50:57.171480 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2031/4015] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:56 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1354 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:57.176468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6ced69b0-e57d-4ef8-9fea-78be7e38f5e2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:57.177171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6ced69b0-e57d-4ef8-9fea-78be7e38f5e2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:57.183747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ced69b0-e57d-4ef8-9fea-78be7e38f5e2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:57.184248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ced69b0-e57d-4ef8-9fea-78be7e38f5e2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:57.184693 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ced69b0-e57d-4ef8-9fea-78be7e38f5e2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:57.185413 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ced69b0-e57d-4ef8-9fea-78be7e38f5e2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:57.185905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ced69b0-e57d-4ef8-9fea-78be7e38f5e2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:57.186334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ced69b0-e57d-4ef8-9fea-78be7e38f5e2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:57.334235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6ced69b0-e57d-4ef8-9fea-78be7e38f5e2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:57.343980 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6ced69b0-e57d-4ef8-9fea-78be7e38f5e2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.171310 Sep 07 12:50:57.344506 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2032/4016] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:57 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:57.384748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9633cd12-cb3d-40dd-80ea-41869905cd6a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:57.385373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9633cd12-cb3d-40dd-80ea-41869905cd6a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:57.392010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9633cd12-cb3d-40dd-80ea-41869905cd6a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:57.392507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9633cd12-cb3d-40dd-80ea-41869905cd6a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:57.392950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9633cd12-cb3d-40dd-80ea-41869905cd6a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:57.393718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9633cd12-cb3d-40dd-80ea-41869905cd6a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:57.394197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9633cd12-cb3d-40dd-80ea-41869905cd6a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:57.394607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9633cd12-cb3d-40dd-80ea-41869905cd6a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:57.543976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9633cd12-cb3d-40dd-80ea-41869905cd6a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:57.552492 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9633cd12-cb3d-40dd-80ea-41869905cd6a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.171691 Sep 07 12:50:57.553100 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2033/4017] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:57 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:50:57.558242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cfff6cf4-2814-4167-a539-3c51379c4bad tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:57.558862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cfff6cf4-2814-4167-a539-3c51379c4bad tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:57.565533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cfff6cf4-2814-4167-a539-3c51379c4bad tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:57.566041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cfff6cf4-2814-4167-a539-3c51379c4bad tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:57.566480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cfff6cf4-2814-4167-a539-3c51379c4bad tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:57.567185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cfff6cf4-2814-4167-a539-3c51379c4bad tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:57.567643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cfff6cf4-2814-4167-a539-3c51379c4bad tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:57.568073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cfff6cf4-2814-4167-a539-3c51379c4bad tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:57.668874 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4c6c0130-7b77-43c5-92f3-0ced148df65a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action" status: 200 len: 14 microversion: 2.1 time: 1.785670 Sep 07 12:50:57.670117 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1985/4018] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:50:55 2022] POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action => generated 14 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:50:57.680088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f9bd2b77-e4d4-449a-a1bd-2a57e69002ce tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1724056490", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:57.690665 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-f9bd2b77-e4d4-449a-a1bd-2a57e69002ce tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f9bd2b77-e4d4-449a-a1bd-2a57e69002ce tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 216 Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1724056490", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1724056490', 'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._validate_network_id( Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:50:57.693855 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:57.700638 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:57.700638 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:50:57.700638 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:50:57.700638 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:50:57.700638 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:50:57.700638 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 07 12:50:57.700638 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:57.700638 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f9bd2b77-e4d4-449a-a1bd-2a57e69002ce tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:50:57.700638 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f9bd2b77-e4d4-449a-a1bd-2a57e69002ce tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.023842 Sep 07 12:50:57.700638 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1986/4019] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:50:57 2022] POST /compute/v2.1/servers => generated 123 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:50:57.712369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-90209a8d-2ad7-4f82-a20a-7189be97081d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:57.719392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-90209a8d-2ad7-4f82-a20a-7189be97081d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:57.732363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90209a8d-2ad7-4f82-a20a-7189be97081d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:57.733191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90209a8d-2ad7-4f82-a20a-7189be97081d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:57.733981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90209a8d-2ad7-4f82-a20a-7189be97081d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:57.735222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90209a8d-2ad7-4f82-a20a-7189be97081d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:57.735355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cfff6cf4-2814-4167-a539-3c51379c4bad tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:57.736057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90209a8d-2ad7-4f82-a20a-7189be97081d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:57.736831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90209a8d-2ad7-4f82-a20a-7189be97081d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:57.744297 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cfff6cf4-2814-4167-a539-3c51379c4bad tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0" status: 200 len: 1521 microversion: 2.1 time: 0.189950 Sep 07 12:50:57.744902 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2034/4020] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:57 2022] GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:57.946874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-90209a8d-2ad7-4f82-a20a-7189be97081d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:57.957188 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-90209a8d-2ad7-4f82-a20a-7189be97081d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.252766 Sep 07 12:50:57.957884 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1987/4021] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:57 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:57.980994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-aabfc45f-a77a-49c0-8920-3384f3cb93c1 req-de222153-b113-487c-9a20-419b47f113f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a05521d0-a89d-418b-93c8-8bb32e9877b3", "name": "network-vif-plugged", "status": "completed", "tag": "bedbadf5-eb44-437a-a98d-a5c59f97639c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:57.992230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6cab8f2b-0811-4848-965b-a23ffa4e62d7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:57.992230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6cab8f2b-0811-4848-965b-a23ffa4e62d7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:58.001871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cab8f2b-0811-4848-965b-a23ffa4e62d7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:58.002358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cab8f2b-0811-4848-965b-a23ffa4e62d7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:58.003091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cab8f2b-0811-4848-965b-a23ffa4e62d7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:58.003923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cab8f2b-0811-4848-965b-a23ffa4e62d7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:58.004429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-aabfc45f-a77a-49c0-8920-3384f3cb93c1 req-de222153-b113-487c-9a20-419b47f113f4 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:58.004860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cab8f2b-0811-4848-965b-a23ffa4e62d7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:58.005329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cab8f2b-0811-4848-965b-a23ffa4e62d7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:58.005682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-aabfc45f-a77a-49c0-8920-3384f3cb93c1 req-de222153-b113-487c-9a20-419b47f113f4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:58.006675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-aabfc45f-a77a-49c0-8920-3384f3cb93c1 req-de222153-b113-487c-9a20-419b47f113f4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:58.034095 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-aabfc45f-a77a-49c0-8920-3384f3cb93c1 req-de222153-b113-487c-9a20-419b47f113f4 service nova] Creating event network-vif-plugged:bedbadf5-eb44-437a-a98d-a5c59f97639c for instance a05521d0-a89d-418b-93c8-8bb32e9877b3 on n-h1-852087-9 Sep 07 12:50:58.044760 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-aabfc45f-a77a-49c0-8920-3384f3cb93c1 req-de222153-b113-487c-9a20-419b47f113f4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066978 Sep 07 12:50:58.047852 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2035/4022] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:50:58.057986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6449254c-4170-47f9-bdaf-6b334ec18222 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:58.059319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6449254c-4170-47f9-bdaf-6b334ec18222 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:58.073437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6449254c-4170-47f9-bdaf-6b334ec18222 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:58.074447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6449254c-4170-47f9-bdaf-6b334ec18222 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:58.075345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6449254c-4170-47f9-bdaf-6b334ec18222 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:58.076376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6449254c-4170-47f9-bdaf-6b334ec18222 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:58.077003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6449254c-4170-47f9-bdaf-6b334ec18222 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:58.077685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6449254c-4170-47f9-bdaf-6b334ec18222 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:58.281271 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6cab8f2b-0811-4848-965b-a23ffa4e62d7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:58.289062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:58.300509 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6cab8f2b-0811-4848-965b-a23ffa4e62d7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.313380 Sep 07 12:50:58.301964 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1988/4023] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:57 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:58.314017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b4df4ecc-a190-4aba-8847-f1ffdefc18c1 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:58.316094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b4df4ecc-a190-4aba-8847-f1ffdefc18c1 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:58.330411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4df4ecc-a190-4aba-8847-f1ffdefc18c1 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:58.332811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4df4ecc-a190-4aba-8847-f1ffdefc18c1 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:58.334010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4df4ecc-a190-4aba-8847-f1ffdefc18c1 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:58.335872 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4df4ecc-a190-4aba-8847-f1ffdefc18c1 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:58.337336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4df4ecc-a190-4aba-8847-f1ffdefc18c1 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:58.338510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4df4ecc-a190-4aba-8847-f1ffdefc18c1 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:58.408635 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6449254c-4170-47f9-bdaf-6b334ec18222 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:58.419605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6449254c-4170-47f9-bdaf-6b334ec18222 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:58.421278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6449254c-4170-47f9-bdaf-6b334ec18222 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:58.422733 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6449254c-4170-47f9-bdaf-6b334ec18222 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.373171 Sep 07 12:50:58.423268 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2036/4024] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:58 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:58.444444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-66b84dc8-bcb5-4a52-8971-91e2e1e59578 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1867556230", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "key_name": "tempest-key-1429631576", "networks": [{"uuid": "b810bb5d-8084-47d5-9b9e-6ea4661cdf5f"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:58.508209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-66b84dc8-bcb5-4a52-8971-91e2e1e59578 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] validate_networks() for [('b810bb5d-8084-47d5-9b9e-6ea4661cdf5f', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:50:58.725652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:58.764062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b4df4ecc-a190-4aba-8847-f1ffdefc18c1 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:58.774343 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b4df4ecc-a190-4aba-8847-f1ffdefc18c1 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1354 microversion: 2.1 time: 0.469368 Sep 07 12:50:58.785877 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1989/4025] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:58 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1354 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:58.785877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-acf98227-78a7-46aa-8593-5389922408b8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:58.785877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-acf98227-78a7-46aa-8593-5389922408b8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:58.796569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acf98227-78a7-46aa-8593-5389922408b8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:58.796569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acf98227-78a7-46aa-8593-5389922408b8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:58.796569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acf98227-78a7-46aa-8593-5389922408b8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:58.796569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acf98227-78a7-46aa-8593-5389922408b8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:58.796569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acf98227-78a7-46aa-8593-5389922408b8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:58.796569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acf98227-78a7-46aa-8593-5389922408b8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:58.893215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:58.910544 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-acf98227-78a7-46aa-8593-5389922408b8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action" status: 200 len: 14 microversion: 2.1 time: 0.133559 Sep 07 12:50:58.916444 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1990/4026] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:50:58 2022] POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:50:58.923187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-83d7aa67-7f18-4682-9491-75fe21f4066e tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:58.924708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-83d7aa67-7f18-4682-9491-75fe21f4066e tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:58.938634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83d7aa67-7f18-4682-9491-75fe21f4066e tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:58.939520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83d7aa67-7f18-4682-9491-75fe21f4066e tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:58.940311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83d7aa67-7f18-4682-9491-75fe21f4066e tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:58.941616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83d7aa67-7f18-4682-9491-75fe21f4066e tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:58.942743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83d7aa67-7f18-4682-9491-75fe21f4066e tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:58.943970 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83d7aa67-7f18-4682-9491-75fe21f4066e tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:58.956111 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-66b84dc8-bcb5-4a52-8971-91e2e1e59578 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Invalid key_name provided. Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-66b84dc8-bcb5-4a52-8971-91e2e1e59578 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 247 Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1867556230", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "key_name": "tempest-key-1429631576", "networks": [{"uuid": "b810bb5d-8084-47d5-9b9e-6ea4661cdf5f"}]}} Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: exception: Invalid key_name provided. Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1867556230', 'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f', 'flavorRef': '452', 'key_name': 'tempest-key-1429631576', 'networks': [{'uuid': 'b810bb5d-8084-47d5-9b9e-6ea4661cdf5f'}]}}} Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1429631576 not found for user 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:58.959269 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-66b84dc8-bcb5-4a52-8971-91e2e1e59578 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 400 to user: Invalid key_name provided. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-66b84dc8-bcb5-4a52-8971-91e2e1e59578 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.528777 Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2037/4027] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:50:58 2022] POST /compute/v2.1/servers => generated 70 bytes in 541 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ff91443-2aff-4521-8bc7-c5ee44f6149a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:58.973996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4ff91443-2aff-4521-8bc7-c5ee44f6149a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:58.982079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ff91443-2aff-4521-8bc7-c5ee44f6149a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:58.982079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ff91443-2aff-4521-8bc7-c5ee44f6149a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:58.982079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ff91443-2aff-4521-8bc7-c5ee44f6149a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:58.983967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ff91443-2aff-4521-8bc7-c5ee44f6149a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:58.985349 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ff91443-2aff-4521-8bc7-c5ee44f6149a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:58.986623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ff91443-2aff-4521-8bc7-c5ee44f6149a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:59.176098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-83d7aa67-7f18-4682-9491-75fe21f4066e tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:59.194502 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-83d7aa67-7f18-4682-9491-75fe21f4066e tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0" status: 200 len: 1521 microversion: 2.1 time: 0.278933 Sep 07 12:50:59.197119 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1991/4028] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:58 2022] GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:59.223734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4ff91443-2aff-4521-8bc7-c5ee44f6149a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:59.234174 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ff91443-2aff-4521-8bc7-c5ee44f6149a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.267552 Sep 07 12:50:59.235113 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2038/4029] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:58 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:50:59.258841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ac093fd-d2a4-4fcd-a08e-d4477fa3ca64 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:59.259477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6ac093fd-d2a4-4fcd-a08e-d4477fa3ca64 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:59.267687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ac093fd-d2a4-4fcd-a08e-d4477fa3ca64 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:59.268188 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ac093fd-d2a4-4fcd-a08e-d4477fa3ca64 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:59.268631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ac093fd-d2a4-4fcd-a08e-d4477fa3ca64 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:59.269363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ac093fd-d2a4-4fcd-a08e-d4477fa3ca64 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:59.269887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ac093fd-d2a4-4fcd-a08e-d4477fa3ca64 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:59.270323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ac093fd-d2a4-4fcd-a08e-d4477fa3ca64 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:59.447650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6ac093fd-d2a4-4fcd-a08e-d4477fa3ca64 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:59.455454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-50c88666-bccd-48c7-8614-e8931a65ab72 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:59.456937 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6ac093fd-d2a4-4fcd-a08e-d4477fa3ca64 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.202183 Sep 07 12:50:59.458214 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1992/4030] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:59 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:50:59.469918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-50c88666-bccd-48c7-8614-e8931a65ab72 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:59.487850 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50c88666-bccd-48c7-8614-e8931a65ab72 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:59.488638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50c88666-bccd-48c7-8614-e8931a65ab72 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:59.489474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50c88666-bccd-48c7-8614-e8931a65ab72 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:59.490691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50c88666-bccd-48c7-8614-e8931a65ab72 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:59.491495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50c88666-bccd-48c7-8614-e8931a65ab72 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:59.492128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50c88666-bccd-48c7-8614-e8931a65ab72 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:59.499790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:50:59.580940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8dac6206-3881-402d-9c11-910f337c30b9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-26074463", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "b810bb5d-8084-47d5-9b9e-6ea4661cdf5f"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:50:59.800320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.security_group_api [None req-8dac6206-3881-402d-9c11-910f337c30b9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Neutron security group does_not_exist not found {{(pid=122432) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Sep 07 12:50:59.802504 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-8dac6206-3881-402d-9c11-910f337c30b9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8dac6206-3881-402d-9c11-910f337c30b9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 256 Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-26074463", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "b810bb5d-8084-47d5-9b9e-6ea4661cdf5f"}]}} Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: exception: Unable to find security_group with name or id 'does_not_exist' Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-26074463', 'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'b810bb5d-8084-47d5-9b9e-6ea4661cdf5f'}]}}} Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Sep 07 12:50:59.813215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:50:59.824536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8dac6206-3881-402d-9c11-910f337c30b9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:50:59.845743 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8dac6206-3881-402d-9c11-910f337c30b9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.242526 Sep 07 12:50:59.845743 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1993/4031] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:50:59 2022] POST /compute/v2.1/servers => generated 106 bytes in 251 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:50:59.845743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bb6eacde-c840-41f4-a1b9-0475e12d674e tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:59.845743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bb6eacde-c840-41f4-a1b9-0475e12d674e tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:59.855891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb6eacde-c840-41f4-a1b9-0475e12d674e tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:59.857022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb6eacde-c840-41f4-a1b9-0475e12d674e tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:59.857560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb6eacde-c840-41f4-a1b9-0475e12d674e tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:59.858077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-50c88666-bccd-48c7-8614-e8931a65ab72 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:59.860021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb6eacde-c840-41f4-a1b9-0475e12d674e tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:59.864182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb6eacde-c840-41f4-a1b9-0475e12d674e tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:59.864949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb6eacde-c840-41f4-a1b9-0475e12d674e tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:59.877885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-50c88666-bccd-48c7-8614-e8931a65ab72 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:59.881134 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-50c88666-bccd-48c7-8614-e8931a65ab72 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:50:59.883501 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-50c88666-bccd-48c7-8614-e8931a65ab72 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.436109 Sep 07 12:50:59.884697 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2039/4032] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:50:59 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:50:59.894051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-270a70d6-ff89-4d57-a589-598207d71d4d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:50:59.896440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-270a70d6-ff89-4d57-a589-598207d71d4d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:50:59.912665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-270a70d6-ff89-4d57-a589-598207d71d4d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:59.914031 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-270a70d6-ff89-4d57-a589-598207d71d4d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:59.915312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-270a70d6-ff89-4d57-a589-598207d71d4d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:50:59.917136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-270a70d6-ff89-4d57-a589-598207d71d4d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:50:59.918413 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-270a70d6-ff89-4d57-a589-598207d71d4d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:50:59.919614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-270a70d6-ff89-4d57-a589-598207d71d4d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:00.147958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bb6eacde-c840-41f4-a1b9-0475e12d674e tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:00.159509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-270a70d6-ff89-4d57-a589-598207d71d4d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:00.163448 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bb6eacde-c840-41f4-a1b9-0475e12d674e tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1354 microversion: 2.1 time: 0.335677 Sep 07 12:51:00.164546 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1994/4033] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:59 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1354 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:00.169075 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-270a70d6-ff89-4d57-a589-598207d71d4d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.282439 Sep 07 12:51:00.169934 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2040/4034] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:50:59 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:00.173243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a80cb904-6e49-4a27-8cb7-ce38297070a6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:00.175790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a80cb904-6e49-4a27-8cb7-ce38297070a6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:00.179948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-beabc4bb-d5ee-4a51-9fa1-e19021b5b596 req-fb7a7e3c-2311-4e42-b49f-b33557f20431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a05521d0-a89d-418b-93c8-8bb32e9877b3", "name": "network-vif-plugged", "status": "completed", "tag": "5138e43b-3b31-4d09-8d71-ac4cda0957ae"}, {"server_uuid": "a05521d0-a89d-418b-93c8-8bb32e9877b3", "name": "network-vif-plugged", "status": "completed", "tag": "d5abea6b-5954-4b65-9ef5-34170d7a794f"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:00.182559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a80cb904-6e49-4a27-8cb7-ce38297070a6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:00.183301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a80cb904-6e49-4a27-8cb7-ce38297070a6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:00.183750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a80cb904-6e49-4a27-8cb7-ce38297070a6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:00.184468 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a80cb904-6e49-4a27-8cb7-ce38297070a6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:00.184926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a80cb904-6e49-4a27-8cb7-ce38297070a6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:00.185356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a80cb904-6e49-4a27-8cb7-ce38297070a6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:00.199364 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-beabc4bb-d5ee-4a51-9fa1-e19021b5b596 req-fb7a7e3c-2311-4e42-b49f-b33557f20431 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:00.203876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-beabc4bb-d5ee-4a51-9fa1-e19021b5b596 req-fb7a7e3c-2311-4e42-b49f-b33557f20431 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:00.204679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-beabc4bb-d5ee-4a51-9fa1-e19021b5b596 req-fb7a7e3c-2311-4e42-b49f-b33557f20431 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:00.218651 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-beabc4bb-d5ee-4a51-9fa1-e19021b5b596 req-fb7a7e3c-2311-4e42-b49f-b33557f20431 service nova] Creating event network-vif-plugged:5138e43b-3b31-4d09-8d71-ac4cda0957ae for instance a05521d0-a89d-418b-93c8-8bb32e9877b3 on n-h1-852087-9 Sep 07 12:51:00.219483 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-beabc4bb-d5ee-4a51-9fa1-e19021b5b596 req-fb7a7e3c-2311-4e42-b49f-b33557f20431 service nova] Creating event network-vif-plugged:d5abea6b-5954-4b65-9ef5-34170d7a794f for instance a05521d0-a89d-418b-93c8-8bb32e9877b3 on n-h1-852087-9 Sep 07 12:51:00.225688 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-beabc4bb-d5ee-4a51-9fa1-e19021b5b596 req-fb7a7e3c-2311-4e42-b49f-b33557f20431 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053370 Sep 07 12:51:00.226441 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2041/4035] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:51:00.232592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2712ddff-296f-4ec5-89db-13e66a5faef0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:00.233511 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2712ddff-296f-4ec5-89db-13e66a5faef0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:00.240299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2712ddff-296f-4ec5-89db-13e66a5faef0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:00.240806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2712ddff-296f-4ec5-89db-13e66a5faef0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:00.241244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2712ddff-296f-4ec5-89db-13e66a5faef0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:00.241993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2712ddff-296f-4ec5-89db-13e66a5faef0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:00.242456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2712ddff-296f-4ec5-89db-13e66a5faef0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:00.242887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2712ddff-296f-4ec5-89db-13e66a5faef0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:00.266699 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:00.274092 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a80cb904-6e49-4a27-8cb7-ce38297070a6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action" status: 200 len: 14 microversion: 2.1 time: 0.107576 Sep 07 12:51:00.275257 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1995/4036] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:00 2022] POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:51:00.284996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-833089d0-e07b-4689-81e1-8710ffe24afc tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:00.286191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-833089d0-e07b-4689-81e1-8710ffe24afc tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:00.298685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-833089d0-e07b-4689-81e1-8710ffe24afc tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:00.299414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-833089d0-e07b-4689-81e1-8710ffe24afc tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:00.300170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-833089d0-e07b-4689-81e1-8710ffe24afc tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:00.301472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-833089d0-e07b-4689-81e1-8710ffe24afc tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:00.302354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-833089d0-e07b-4689-81e1-8710ffe24afc tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:00.303198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-833089d0-e07b-4689-81e1-8710ffe24afc tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:00.485304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2712ddff-296f-4ec5-89db-13e66a5faef0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:00.501057 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2712ddff-296f-4ec5-89db-13e66a5faef0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.272411 Sep 07 12:51:00.507578 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2042/4037] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:00 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:00.520956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-833089d0-e07b-4689-81e1-8710ffe24afc tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:00.525831 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-75c92f11-3e4a-48b5-b0b2-1c18276eb1db tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:00.526822 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-75c92f11-3e4a-48b5-b0b2-1c18276eb1db tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: b4b8c48c-fdc9-450b-9a4a-73061feb2a4d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:00.530762 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-833089d0-e07b-4689-81e1-8710ffe24afc tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0" status: 200 len: 1521 microversion: 2.1 time: 0.254023 Sep 07 12:51:00.531884 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1996/4038] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:00 2022] GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:00.537000 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-75c92f11-3e4a-48b5-b0b2-1c18276eb1db tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Instance b4b8c48c-fdc9-450b-9a4a-73061feb2a4d could not be found. Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-75c92f11-3e4a-48b5-b0b2-1c18276eb1db tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/b4b8c48c-fdc9-450b-9a4a-73061feb2a4d HTTP/1.1 Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance b4b8c48c-fdc9-450b-9a4a-73061feb2a4d could not be found. Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'b4b8c48c-fdc9-450b-9a4a-73061feb2a4d'} Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4b8c48c-fdc9-450b-9a4a-73061feb2a4d could not be found. Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4b8c48c-fdc9-450b-9a4a-73061feb2a4d could not be found. Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:00.540698 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:00.546670 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:00.546670 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:00.546670 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:00.546670 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:00.546670 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:51:00.546670 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:51:00.546670 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4b8c48c-fdc9-450b-9a4a-73061feb2a4d could not be found. Sep 07 12:51:00.546670 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:00.546670 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-75c92f11-3e4a-48b5-b0b2-1c18276eb1db tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 404 to user: Instance b4b8c48c-fdc9-450b-9a4a-73061feb2a4d could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:51:00.546670 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-75c92f11-3e4a-48b5-b0b2-1c18276eb1db tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b4b8c48c-fdc9-450b-9a4a-73061feb2a4d" status: 404 len: 111 microversion: 2.1 time: 0.021918 Sep 07 12:51:00.546670 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2043/4039] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:51:00 2022] DELETE /compute/v2.1/servers/b4b8c48c-fdc9-450b-9a4a-73061feb2a4d => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:51:00.554503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-331466d1-d9d3-4093-ac9f-f2f428d4a42c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:00.555155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-331466d1-d9d3-4093-ac9f-f2f428d4a42c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:00.562354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-331466d1-d9d3-4093-ac9f-f2f428d4a42c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:00.562882 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-331466d1-d9d3-4093-ac9f-f2f428d4a42c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:00.563374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-331466d1-d9d3-4093-ac9f-f2f428d4a42c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:00.564067 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-331466d1-d9d3-4093-ac9f-f2f428d4a42c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:00.564516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-331466d1-d9d3-4093-ac9f-f2f428d4a42c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:00.564933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-331466d1-d9d3-4093-ac9f-f2f428d4a42c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:00.711583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-331466d1-d9d3-4093-ac9f-f2f428d4a42c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:00.720274 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-331466d1-d9d3-4093-ac9f-f2f428d4a42c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.169758 Sep 07 12:51:00.720872 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1997/4040] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:00 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:00.744127 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eac20b8c-2c68-4c09-abfe-1067bddec5ed tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:00.744743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-eac20b8c-2c68-4c09-abfe-1067bddec5ed tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:00.752080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eac20b8c-2c68-4c09-abfe-1067bddec5ed tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:00.752584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eac20b8c-2c68-4c09-abfe-1067bddec5ed tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:00.753024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eac20b8c-2c68-4c09-abfe-1067bddec5ed tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:00.753767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eac20b8c-2c68-4c09-abfe-1067bddec5ed tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:00.754228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eac20b8c-2c68-4c09-abfe-1067bddec5ed tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:00.754656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eac20b8c-2c68-4c09-abfe-1067bddec5ed tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:00.904471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-eac20b8c-2c68-4c09-abfe-1067bddec5ed tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:00.913597 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eac20b8c-2c68-4c09-abfe-1067bddec5ed tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.173368 Sep 07 12:51:00.914214 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2044/4041] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:00 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:00.929668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c1fb79aa-a697-4ab1-a250-4f6343476ac8 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:00.930497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c1fb79aa-a697-4ab1-a250-4f6343476ac8 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:00.939571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8775907f-1304-41a4-bb0a-d41942e43c4d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:00.940075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8775907f-1304-41a4-bb0a-d41942e43c4d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 07 12:51:00.940583 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-8775907f-1304-41a4-bb0a-d41942e43c4d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8775907f-1304-41a4-bb0a-d41942e43c4d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 9223372036854775808 could not be found. Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '9223372036854775808'} Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:00.942400 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:00.947294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:00.947294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:51:00.947294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:51:00.947294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Sep 07 12:51:00.947294 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:00.947294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8775907f-1304-41a4-bb0a-d41942e43c4d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:51:00.947294 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8775907f-1304-41a4-bb0a-d41942e43c4d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.009290 Sep 07 12:51:00.947997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1fb79aa-a697-4ab1-a250-4f6343476ac8 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:00.947997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1fb79aa-a697-4ab1-a250-4f6343476ac8 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:00.947997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1fb79aa-a697-4ab1-a250-4f6343476ac8 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:00.947997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1fb79aa-a697-4ab1-a250-4f6343476ac8 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:00.948379 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2045/4042] 10.222.0.16 () {58 vars in 1188 bytes} [Wed Sep 7 12:51:00 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 07 12:51:00.948482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1fb79aa-a697-4ab1-a250-4f6343476ac8 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:00.949009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1fb79aa-a697-4ab1-a250-4f6343476ac8 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:00.953535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-079f1082-f9be-4b41-939f-44f2427ff591 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:00.954154 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-079f1082-f9be-4b41-939f-44f2427ff591 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:00.962691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-079f1082-f9be-4b41-939f-44f2427ff591 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:00.963234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-079f1082-f9be-4b41-939f-44f2427ff591 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:00.963671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-079f1082-f9be-4b41-939f-44f2427ff591 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:00.964414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-079f1082-f9be-4b41-939f-44f2427ff591 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:00.964922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-079f1082-f9be-4b41-939f-44f2427ff591 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:00.965444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-079f1082-f9be-4b41-939f-44f2427ff591 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:01.224369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-079f1082-f9be-4b41-939f-44f2427ff591 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:01.230587 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c1fb79aa-a697-4ab1-a250-4f6343476ac8 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:01.233532 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-079f1082-f9be-4b41-939f-44f2427ff591 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.284224 Sep 07 12:51:01.234116 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2046/4043] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:00 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:01.239016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9f43a1ef-1426-4a5a-8fcc-b99719051936 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:01.240024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9f43a1ef-1426-4a5a-8fcc-b99719051936 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:01.246047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c1fb79aa-a697-4ab1-a250-4f6343476ac8 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:01.246756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f43a1ef-1426-4a5a-8fcc-b99719051936 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:01.247250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f43a1ef-1426-4a5a-8fcc-b99719051936 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:01.247739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c1fb79aa-a697-4ab1-a250-4f6343476ac8 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:01.247955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f43a1ef-1426-4a5a-8fcc-b99719051936 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:01.248657 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f43a1ef-1426-4a5a-8fcc-b99719051936 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:01.249119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f43a1ef-1426-4a5a-8fcc-b99719051936 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:01.249385 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c1fb79aa-a697-4ab1-a250-4f6343476ac8 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.324104 Sep 07 12:51:01.249786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f43a1ef-1426-4a5a-8fcc-b99719051936 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:01.258176 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1998/4044] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:00 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:51:01.266201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-70811080-727c-4f14-b143-71f1c17a424c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:01.267269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-70811080-727c-4f14-b143-71f1c17a424c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:01.283001 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70811080-727c-4f14-b143-71f1c17a424c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:01.283504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70811080-727c-4f14-b143-71f1c17a424c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:01.284032 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70811080-727c-4f14-b143-71f1c17a424c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:01.284783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70811080-727c-4f14-b143-71f1c17a424c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:01.285315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70811080-727c-4f14-b143-71f1c17a424c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:01.285862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70811080-727c-4f14-b143-71f1c17a424c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:01.612756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9f43a1ef-1426-4a5a-8fcc-b99719051936 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:01.628864 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9f43a1ef-1426-4a5a-8fcc-b99719051936 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1354 microversion: 2.1 time: 0.393242 Sep 07 12:51:01.630291 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2047/4045] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:01 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1354 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:01.635983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-70811080-727c-4f14-b143-71f1c17a424c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:01.648352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aab17bf3-437d-4c65-a683-9510f0a9c055 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:01.657024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aab17bf3-437d-4c65-a683-9510f0a9c055 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:01.658021 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-70811080-727c-4f14-b143-71f1c17a424c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.396231 Sep 07 12:51:01.659374 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 1999/4046] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:01 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:01.662792 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=18 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:01.666291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aab17bf3-437d-4c65-a683-9510f0a9c055 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:01.666803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aab17bf3-437d-4c65-a683-9510f0a9c055 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:01.667252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aab17bf3-437d-4c65-a683-9510f0a9c055 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:01.667973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aab17bf3-437d-4c65-a683-9510f0a9c055 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:01.668434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aab17bf3-437d-4c65-a683-9510f0a9c055 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:01.669246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aab17bf3-437d-4c65-a683-9510f0a9c055 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:01.673370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92150f60-2e44-4e79-a636-5e50d1adc867 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:01.674217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-92150f60-2e44-4e79-a636-5e50d1adc867 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:01.686583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92150f60-2e44-4e79-a636-5e50d1adc867 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:01.687645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92150f60-2e44-4e79-a636-5e50d1adc867 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:01.688621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92150f60-2e44-4e79-a636-5e50d1adc867 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:01.690099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92150f60-2e44-4e79-a636-5e50d1adc867 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:01.691099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92150f60-2e44-4e79-a636-5e50d1adc867 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:01.691992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92150f60-2e44-4e79-a636-5e50d1adc867 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:01.767516 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aab17bf3-437d-4c65-a683-9510f0a9c055 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action" status: 200 len: 14 microversion: 2.1 time: 0.134570 Sep 07 12:51:01.768929 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2048/4047] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:01 2022] POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:51:01.776349 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-683c63b8-b34d-430c-92b3-6c86ca469ad2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:01.777171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-683c63b8-b34d-430c-92b3-6c86ca469ad2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Failed to fetch instance by id -1 {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 07 12:51:01.778136 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-683c63b8-b34d-430c-92b3-6c86ca469ad2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Instance -1 could not be found. Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-683c63b8-b34d-430c-92b3-6c86ca469ad2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance -1 could not be found. Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '-1'} Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:01.780537 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:01.789377 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:51:01.789377 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:51:01.789377 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Sep 07 12:51:01.789377 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:01.794144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-683c63b8-b34d-430c-92b3-6c86ca469ad2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:51:01.794144 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-683c63b8-b34d-430c-92b3-6c86ca469ad2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.021865 Sep 07 12:51:01.795393 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2049/4048] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:51:01 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:51:01.806330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-838a1677-a642-41a8-a2f9-265612d494e9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:01.807896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-838a1677-a642-41a8-a2f9-265612d494e9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:01.819307 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-838a1677-a642-41a8-a2f9-265612d494e9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:01.820081 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-838a1677-a642-41a8-a2f9-265612d494e9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:01.820769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-838a1677-a642-41a8-a2f9-265612d494e9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:01.821787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-838a1677-a642-41a8-a2f9-265612d494e9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:01.822702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-838a1677-a642-41a8-a2f9-265612d494e9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:01.823825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-838a1677-a642-41a8-a2f9-265612d494e9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:01.952221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-92150f60-2e44-4e79-a636-5e50d1adc867 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:01.970065 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-92150f60-2e44-4e79-a636-5e50d1adc867 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0" status: 200 len: 1521 microversion: 2.1 time: 0.308701 Sep 07 12:51:01.971611 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2000/4049] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:01 2022] GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0 => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:02.021793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-838a1677-a642-41a8-a2f9-265612d494e9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:02.031502 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-838a1677-a642-41a8-a2f9-265612d494e9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.231495 Sep 07 12:51:02.032180 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2050/4050] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:01 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:02.056529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-03277a35-0abc-4ab0-ac0e-d448ad776b24 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:02.057465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-03277a35-0abc-4ab0-ac0e-d448ad776b24 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:02.064063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03277a35-0abc-4ab0-ac0e-d448ad776b24 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:02.064751 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03277a35-0abc-4ab0-ac0e-d448ad776b24 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:02.065411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03277a35-0abc-4ab0-ac0e-d448ad776b24 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:02.066240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03277a35-0abc-4ab0-ac0e-d448ad776b24 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:02.067140 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03277a35-0abc-4ab0-ac0e-d448ad776b24 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:02.067536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03277a35-0abc-4ab0-ac0e-d448ad776b24 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:02.235811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-03277a35-0abc-4ab0-ac0e-d448ad776b24 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:02.250590 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-03277a35-0abc-4ab0-ac0e-d448ad776b24 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.197614 Sep 07 12:51:02.251652 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2001/4051] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:02 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:02.280144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8f1ff32e-4e65-4623-88cc-2402a612c712 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:02.281568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8f1ff32e-4e65-4623-88cc-2402a612c712 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 76152ccd-39e4-4e91-99cc-97a5486bffda] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:02.285112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2067bee6-a960-4dad-b9d0-e32747474f1f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:02.286353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2067bee6-a960-4dad-b9d0-e32747474f1f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:02.294115 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-8f1ff32e-4e65-4623-88cc-2402a612c712 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Instance 76152ccd-39e4-4e91-99cc-97a5486bffda could not be found. Sep 07 12:51:02.298592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2067bee6-a960-4dad-b9d0-e32747474f1f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:02.298592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2067bee6-a960-4dad-b9d0-e32747474f1f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:02.300087 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2067bee6-a960-4dad-b9d0-e32747474f1f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:02.301362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2067bee6-a960-4dad-b9d0-e32747474f1f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:02.303376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2067bee6-a960-4dad-b9d0-e32747474f1f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:02.303376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2067bee6-a960-4dad-b9d0-e32747474f1f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8f1ff32e-4e65-4623-88cc-2402a612c712 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/76152ccd-39e4-4e91-99cc-97a5486bffda/action HTTP/1.1 Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 19 Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: {"forceDelete": {}} Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 76152ccd-39e4-4e91-99cc-97a5486bffda could not be found. Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '76152ccd-39e4-4e91-99cc-97a5486bffda', 'body': {'forceDelete': {}}} Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76152ccd-39e4-4e91-99cc-97a5486bffda could not be found. Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76152ccd-39e4-4e91-99cc-97a5486bffda could not be found. Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:02.320036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:02.331747 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:51:02.331747 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:51:02.331747 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76152ccd-39e4-4e91-99cc-97a5486bffda could not be found. Sep 07 12:51:02.331747 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:02.331747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8f1ff32e-4e65-4623-88cc-2402a612c712 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 404 to user: Instance 76152ccd-39e4-4e91-99cc-97a5486bffda could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:51:02.331747 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8f1ff32e-4e65-4623-88cc-2402a612c712 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers/76152ccd-39e4-4e91-99cc-97a5486bffda/action" status: 404 len: 111 microversion: 2.1 time: 0.055373 Sep 07 12:51:02.334227 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2051/4052] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:02 2022] POST /compute/v2.1/servers/76152ccd-39e4-4e91-99cc-97a5486bffda/action => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:51:02.347005 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ca5c3d2-256b-4980-8ced-7cb8864162d3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:02.347636 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8ca5c3d2-256b-4980-8ced-7cb8864162d3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:02.356177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ca5c3d2-256b-4980-8ced-7cb8864162d3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:02.356720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ca5c3d2-256b-4980-8ced-7cb8864162d3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:02.357140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ca5c3d2-256b-4980-8ced-7cb8864162d3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:02.358308 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ca5c3d2-256b-4980-8ced-7cb8864162d3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:02.361711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ca5c3d2-256b-4980-8ced-7cb8864162d3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:02.362403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ca5c3d2-256b-4980-8ced-7cb8864162d3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:02.622552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2067bee6-a960-4dad-b9d0-e32747474f1f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:02.634444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2067bee6-a960-4dad-b9d0-e32747474f1f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:02.636045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2067bee6-a960-4dad-b9d0-e32747474f1f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:02.637986 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2067bee6-a960-4dad-b9d0-e32747474f1f tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.362007 Sep 07 12:51:02.639111 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2002/4053] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:02 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:51:02.656259 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8ca5c3d2-256b-4980-8ced-7cb8864162d3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:02.676374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a0a4f225-c479-45eb-aea0-6f4af0e26577 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:02.677307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a0a4f225-c479-45eb-aea0-6f4af0e26577 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:02.685437 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8ca5c3d2-256b-4980-8ced-7cb8864162d3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.345815 Sep 07 12:51:02.686834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0a4f225-c479-45eb-aea0-6f4af0e26577 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:02.688047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0a4f225-c479-45eb-aea0-6f4af0e26577 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:02.689093 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0a4f225-c479-45eb-aea0-6f4af0e26577 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:02.690010 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2052/4054] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:02 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:02.691041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0a4f225-c479-45eb-aea0-6f4af0e26577 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:02.691921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0a4f225-c479-45eb-aea0-6f4af0e26577 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:02.692703 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0a4f225-c479-45eb-aea0-6f4af0e26577 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:02.732923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5fdea1d6-5108-4843-81f4-d7bd1fa19354 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:02.733806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5fdea1d6-5108-4843-81f4-d7bd1fa19354 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:02.748633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fdea1d6-5108-4843-81f4-d7bd1fa19354 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:02.749553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fdea1d6-5108-4843-81f4-d7bd1fa19354 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:02.750267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fdea1d6-5108-4843-81f4-d7bd1fa19354 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:02.751917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fdea1d6-5108-4843-81f4-d7bd1fa19354 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:02.752639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fdea1d6-5108-4843-81f4-d7bd1fa19354 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:02.753260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fdea1d6-5108-4843-81f4-d7bd1fa19354 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:03.024304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a0a4f225-c479-45eb-aea0-6f4af0e26577 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:03.030584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5fdea1d6-5108-4843-81f4-d7bd1fa19354 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:03.038689 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a0a4f225-c479-45eb-aea0-6f4af0e26577 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1354 microversion: 2.1 time: 0.374840 Sep 07 12:51:03.039563 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2003/4055] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:02 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1354 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:03.045965 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5fdea1d6-5108-4843-81f4-d7bd1fa19354 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.323422 Sep 07 12:51:03.047565 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2053/4056] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:02 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:03.057213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-48926c62-c7b8-422d-ad92-252f401a8ef9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:03.059062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-48926c62-c7b8-422d-ad92-252f401a8ef9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:03.067240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e8a59051-0760-43de-814d-6caab0572f34 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:03.071369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e8a59051-0760-43de-814d-6caab0572f34 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:03.072834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48926c62-c7b8-422d-ad92-252f401a8ef9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:03.074260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48926c62-c7b8-422d-ad92-252f401a8ef9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:03.076503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48926c62-c7b8-422d-ad92-252f401a8ef9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:03.078117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48926c62-c7b8-422d-ad92-252f401a8ef9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:03.079268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48926c62-c7b8-422d-ad92-252f401a8ef9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:03.081022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-48926c62-c7b8-422d-ad92-252f401a8ef9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:03.083629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8a59051-0760-43de-814d-6caab0572f34 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:03.084477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8a59051-0760-43de-814d-6caab0572f34 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:03.085213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8a59051-0760-43de-814d-6caab0572f34 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:03.086426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8a59051-0760-43de-814d-6caab0572f34 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:03.087714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8a59051-0760-43de-814d-6caab0572f34 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:03.088686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8a59051-0760-43de-814d-6caab0572f34 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:03.191154 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e8a59051-0760-43de-814d-6caab0572f34 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action" status: 200 len: 14 microversion: 2.1 time: 0.149287 Sep 07 12:51:03.192329 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2004/4057] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:03 2022] POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:51:03.203996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-356993f5-650a-4396-ada7-31da3cd5d7b3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:03.209578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-356993f5-650a-4396-ada7-31da3cd5d7b3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: f76b7952-0145-4bce-a0b4-56aee8d0e194] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:03.239175 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-356993f5-650a-4396-ada7-31da3cd5d7b3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Instance f76b7952-0145-4bce-a0b4-56aee8d0e194 could not be found. Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-356993f5-650a-4396-ada7-31da3cd5d7b3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/f76b7952-0145-4bce-a0b4-56aee8d0e194/action HTTP/1.1 Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 39 Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: {"os-getConsoleOutput": {"length": 10}} Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance f76b7952-0145-4bce-a0b4-56aee8d0e194 could not be found. Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'f76b7952-0145-4bce-a0b4-56aee8d0e194', 'body': {'os-getConsoleOutput': {'length': 10}}} Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f76b7952-0145-4bce-a0b4-56aee8d0e194 could not be found. Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f76b7952-0145-4bce-a0b4-56aee8d0e194 could not be found. Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:03.247301 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:03.255147 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:03.255147 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:03.255147 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:51:03.255147 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:51:03.255147 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f76b7952-0145-4bce-a0b4-56aee8d0e194 could not be found. Sep 07 12:51:03.255147 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:03.255147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-356993f5-650a-4396-ada7-31da3cd5d7b3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 404 to user: Instance f76b7952-0145-4bce-a0b4-56aee8d0e194 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:51:03.256366 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-356993f5-650a-4396-ada7-31da3cd5d7b3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers/f76b7952-0145-4bce-a0b4-56aee8d0e194/action" status: 404 len: 111 microversion: 2.1 time: 0.061165 Sep 07 12:51:03.257155 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2005/4058] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:03 2022] POST /compute/v2.1/servers/f76b7952-0145-4bce-a0b4-56aee8d0e194/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:51:03.268848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3f783664-0ca5-4e9d-825e-ab70eac54a14 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:03.269750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3f783664-0ca5-4e9d-825e-ab70eac54a14 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:03.275468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-48926c62-c7b8-422d-ad92-252f401a8ef9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:03.282586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f783664-0ca5-4e9d-825e-ab70eac54a14 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:03.283444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f783664-0ca5-4e9d-825e-ab70eac54a14 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:03.284267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f783664-0ca5-4e9d-825e-ab70eac54a14 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:03.285053 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-48926c62-c7b8-422d-ad92-252f401a8ef9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0" status: 200 len: 1521 microversion: 2.1 time: 0.235560 Sep 07 12:51:03.285384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f783664-0ca5-4e9d-825e-ab70eac54a14 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:03.287477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f783664-0ca5-4e9d-825e-ab70eac54a14 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:03.288525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f783664-0ca5-4e9d-825e-ab70eac54a14 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:03.300740 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2054/4059] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:03 2022] GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:03.479651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3f783664-0ca5-4e9d-825e-ab70eac54a14 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:03.490206 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3f783664-0ca5-4e9d-825e-ab70eac54a14 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.227033 Sep 07 12:51:03.491063 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2006/4060] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:03 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:03.516374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a01cc8a8-2167-43f0-89ce-cd072ce3c610 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:03.517045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a01cc8a8-2167-43f0-89ce-cd072ce3c610 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:03.523797 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a01cc8a8-2167-43f0-89ce-cd072ce3c610 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:03.524302 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a01cc8a8-2167-43f0-89ce-cd072ce3c610 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:03.524745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a01cc8a8-2167-43f0-89ce-cd072ce3c610 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:03.525468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a01cc8a8-2167-43f0-89ce-cd072ce3c610 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:03.525960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a01cc8a8-2167-43f0-89ce-cd072ce3c610 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:03.526391 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a01cc8a8-2167-43f0-89ce-cd072ce3c610 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:03.689676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b3bcaf24-fbc8-416f-bf16-3e2c172e8bd2 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:03.691030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b3bcaf24-fbc8-416f-bf16-3e2c172e8bd2 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:03.703514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3bcaf24-fbc8-416f-bf16-3e2c172e8bd2 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:03.704492 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3bcaf24-fbc8-416f-bf16-3e2c172e8bd2 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:03.705381 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3bcaf24-fbc8-416f-bf16-3e2c172e8bd2 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:03.706845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3bcaf24-fbc8-416f-bf16-3e2c172e8bd2 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:03.707754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3bcaf24-fbc8-416f-bf16-3e2c172e8bd2 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:03.708311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3bcaf24-fbc8-416f-bf16-3e2c172e8bd2 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:03.724551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a01cc8a8-2167-43f0-89ce-cd072ce3c610 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:03.737967 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a01cc8a8-2167-43f0-89ce-cd072ce3c610 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.225366 Sep 07 12:51:03.738484 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2055/4061] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:03 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:03.765148 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e0439574-19f5-41b9-a8fc-ffbe967168c5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:03.765808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e0439574-19f5-41b9-a8fc-ffbe967168c5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: fbe5740f-ee2e-4dc0-8100-bdf37ce5f834] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:03.772345 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-e0439574-19f5-41b9-a8fc-ffbe967168c5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Instance fbe5740f-ee2e-4dc0-8100-bdf37ce5f834 could not be found. Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e0439574-19f5-41b9-a8fc-ffbe967168c5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/fbe5740f-ee2e-4dc0-8100-bdf37ce5f834 HTTP/1.1 Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance fbe5740f-ee2e-4dc0-8100-bdf37ce5f834 could not be found. Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'fbe5740f-ee2e-4dc0-8100-bdf37ce5f834'} Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbe5740f-ee2e-4dc0-8100-bdf37ce5f834 could not be found. Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbe5740f-ee2e-4dc0-8100-bdf37ce5f834 could not be found. Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:03.774013 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:03.782891 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:03.782891 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:51:03.782891 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:51:03.782891 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbe5740f-ee2e-4dc0-8100-bdf37ce5f834 could not be found. Sep 07 12:51:03.782891 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:03.782891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e0439574-19f5-41b9-a8fc-ffbe967168c5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 404 to user: Instance fbe5740f-ee2e-4dc0-8100-bdf37ce5f834 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:51:03.785609 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e0439574-19f5-41b9-a8fc-ffbe967168c5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/fbe5740f-ee2e-4dc0-8100-bdf37ce5f834" status: 404 len: 111 microversion: 2.1 time: 0.018686 Sep 07 12:51:03.786267 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2056/4062] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:03 2022] GET /compute/v2.1/servers/fbe5740f-ee2e-4dc0-8100-bdf37ce5f834 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:51:03.795424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b788a65d-dd72-4463-a51d-513f258229bf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:03.796057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b788a65d-dd72-4463-a51d-513f258229bf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:03.803800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b788a65d-dd72-4463-a51d-513f258229bf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:03.804270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b788a65d-dd72-4463-a51d-513f258229bf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:03.804725 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b788a65d-dd72-4463-a51d-513f258229bf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:03.805476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b788a65d-dd72-4463-a51d-513f258229bf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:03.805991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b788a65d-dd72-4463-a51d-513f258229bf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:03.806430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b788a65d-dd72-4463-a51d-513f258229bf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:04.012174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b3bcaf24-fbc8-416f-bf16-3e2c172e8bd2 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:04.023686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b3bcaf24-fbc8-416f-bf16-3e2c172e8bd2 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:04.025166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b3bcaf24-fbc8-416f-bf16-3e2c172e8bd2 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:04.026428 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b3bcaf24-fbc8-416f-bf16-3e2c172e8bd2 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.344595 Sep 07 12:51:04.027013 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2007/4063] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:03 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:51:04.040106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b788a65d-dd72-4463-a51d-513f258229bf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:04.049644 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b788a65d-dd72-4463-a51d-513f258229bf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.258242 Sep 07 12:51:04.050248 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2057/4064] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:03 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:04.065877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-785bf571-2e04-4846-bbdf-72126082d121 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:04.066910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-785bf571-2e04-4846-bbdf-72126082d121 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:04.078453 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-785bf571-2e04-4846-bbdf-72126082d121 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:04.079087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-64d5449f-5558-48be-8d4e-833ba3e29a52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:04.079501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-785bf571-2e04-4846-bbdf-72126082d121 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:04.080213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-64d5449f-5558-48be-8d4e-833ba3e29a52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:04.080410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-785bf571-2e04-4846-bbdf-72126082d121 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:04.081373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-785bf571-2e04-4846-bbdf-72126082d121 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:04.082191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-785bf571-2e04-4846-bbdf-72126082d121 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:04.082970 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-785bf571-2e04-4846-bbdf-72126082d121 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:04.091162 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64d5449f-5558-48be-8d4e-833ba3e29a52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:04.091842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64d5449f-5558-48be-8d4e-833ba3e29a52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:04.092605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64d5449f-5558-48be-8d4e-833ba3e29a52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:04.093869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64d5449f-5558-48be-8d4e-833ba3e29a52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:04.094542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64d5449f-5558-48be-8d4e-833ba3e29a52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:04.095046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64d5449f-5558-48be-8d4e-833ba3e29a52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:04.111471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:04.341441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-785bf571-2e04-4846-bbdf-72126082d121 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:04.346746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-64d5449f-5558-48be-8d4e-833ba3e29a52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:04.358206 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-785bf571-2e04-4846-bbdf-72126082d121 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1804 microversion: 2.1 time: 0.296252 Sep 07 12:51:04.360504 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2008/4065] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:04 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1804 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:04.361454 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-64d5449f-5558-48be-8d4e-833ba3e29a52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.289806 Sep 07 12:51:04.377060 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2058/4066] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:04 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:04.377060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-92740e52-9749-455a-a3d0-b81c6de7c1fa tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:04.377060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-92740e52-9749-455a-a3d0-b81c6de7c1fa tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:04.384134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-82951799-d204-4714-ac5c-262277778727 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:04.386036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92740e52-9749-455a-a3d0-b81c6de7c1fa tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:04.386941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92740e52-9749-455a-a3d0-b81c6de7c1fa tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:04.387707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-82951799-d204-4714-ac5c-262277778727 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:04.387897 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92740e52-9749-455a-a3d0-b81c6de7c1fa tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:04.389095 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92740e52-9749-455a-a3d0-b81c6de7c1fa tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:04.390142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92740e52-9749-455a-a3d0-b81c6de7c1fa tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:04.391553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92740e52-9749-455a-a3d0-b81c6de7c1fa tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:04.397360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82951799-d204-4714-ac5c-262277778727 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:04.398097 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82951799-d204-4714-ac5c-262277778727 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:04.400246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82951799-d204-4714-ac5c-262277778727 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:04.400246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82951799-d204-4714-ac5c-262277778727 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:04.400246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82951799-d204-4714-ac5c-262277778727 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:04.400877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82951799-d204-4714-ac5c-262277778727 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:04.512376 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-82951799-d204-4714-ac5c-262277778727 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action" status: 200 len: 14 microversion: 2.1 time: 0.148319 Sep 07 12:51:04.513816 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2009/4067] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:04 2022] POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:51:04.523943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-70e9e513-81bb-4afa-9e51-439be7ce526d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:04.525088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-70e9e513-81bb-4afa-9e51-439be7ce526d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:04.538668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70e9e513-81bb-4afa-9e51-439be7ce526d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:04.539630 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70e9e513-81bb-4afa-9e51-439be7ce526d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:04.540385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70e9e513-81bb-4afa-9e51-439be7ce526d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:04.541667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70e9e513-81bb-4afa-9e51-439be7ce526d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:04.542780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70e9e513-81bb-4afa-9e51-439be7ce526d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:04.543581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70e9e513-81bb-4afa-9e51-439be7ce526d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:04.578103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-92740e52-9749-455a-a3d0-b81c6de7c1fa tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:04.580832 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-70e9e513-81bb-4afa-9e51-439be7ce526d tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3/ips" status: 200 len: 218 microversion: 2.1 time: 0.064910 Sep 07 12:51:04.581843 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2010/4068] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Sep 7 12:51:04 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3/ips => generated 218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:51:04.588979 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-601bb479-07d9-4ec3-bb64-165c8e95d3ff tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1123922892", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "b810bb5d-8084-47d5-9b9e-6ea4661cdf5f"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:04.593877 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-92740e52-9749-455a-a3d0-b81c6de7c1fa tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0" status: 200 len: 1521 microversion: 2.1 time: 0.228958 Sep 07 12:51:04.594704 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2059/4069] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:04 2022] GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:04.600720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6aa17abe-f7b6-48b4-829e-69773e96e4af tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:04.601461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6aa17abe-f7b6-48b4-829e-69773e96e4af tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:04.609276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa17abe-f7b6-48b4-829e-69773e96e4af tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:04.610023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa17abe-f7b6-48b4-829e-69773e96e4af tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:04.610595 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa17abe-f7b6-48b4-829e-69773e96e4af tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:04.611606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa17abe-f7b6-48b4-829e-69773e96e4af tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:04.612171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa17abe-f7b6-48b4-829e-69773e96e4af tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:04.612684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa17abe-f7b6-48b4-829e-69773e96e4af tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-601bb479-07d9-4ec3-bb64-165c8e95d3ff tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 238 Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1123922892", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "b810bb5d-8084-47d5-9b9e-6ea4661cdf5f"}]}} Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1123922892', 'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'b810bb5d-8084-47d5-9b9e-6ea4661cdf5f'}]}}} Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:04.616720 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-601bb479-07d9-4ec3-bb64-165c8e95d3ff tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-601bb479-07d9-4ec3-bb64-165c8e95d3ff tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.035474 Sep 07 12:51:04.624191 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2011/4070] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:51:04 2022] POST /compute/v2.1/servers => generated 139 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:51:04.632777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8485c152-c6ab-4a9a-9562-395d9a53ac97 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:04.633781 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8485c152-c6ab-4a9a-9562-395d9a53ac97 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:04.645360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8485c152-c6ab-4a9a-9562-395d9a53ac97 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:04.646177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8485c152-c6ab-4a9a-9562-395d9a53ac97 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:04.646730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8485c152-c6ab-4a9a-9562-395d9a53ac97 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:04.647609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8485c152-c6ab-4a9a-9562-395d9a53ac97 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:04.648270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8485c152-c6ab-4a9a-9562-395d9a53ac97 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:04.648814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8485c152-c6ab-4a9a-9562-395d9a53ac97 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:04.649777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6aa17abe-f7b6-48b4-829e-69773e96e4af tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:51:04.702543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:04.769941 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6aa17abe-f7b6-48b4-829e-69773e96e4af tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 204 len: 0 microversion: 2.1 time: 0.173151 Sep 07 12:51:04.771350 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2060/4071] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:51:04 2022] DELETE /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:51:04.785749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3074bcb7-5eff-4d5f-a334-fc66c9efa9fb tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:04.787264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3074bcb7-5eff-4d5f-a334-fc66c9efa9fb tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:04.798988 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3074bcb7-5eff-4d5f-a334-fc66c9efa9fb tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:04.799898 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3074bcb7-5eff-4d5f-a334-fc66c9efa9fb tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:04.800728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3074bcb7-5eff-4d5f-a334-fc66c9efa9fb tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:04.802046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3074bcb7-5eff-4d5f-a334-fc66c9efa9fb tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:04.803012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3074bcb7-5eff-4d5f-a334-fc66c9efa9fb tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:04.803814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3074bcb7-5eff-4d5f-a334-fc66c9efa9fb tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:04.836737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8485c152-c6ab-4a9a-9562-395d9a53ac97 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:04.846298 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8485c152-c6ab-4a9a-9562-395d9a53ac97 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.218613 Sep 07 12:51:04.846898 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2012/4072] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:04 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:04.872574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-be32d25e-0aee-4add-aa6e-7b90f06320b5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:04.874548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-be32d25e-0aee-4add-aa6e-7b90f06320b5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:04.888871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be32d25e-0aee-4add-aa6e-7b90f06320b5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:04.888871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be32d25e-0aee-4add-aa6e-7b90f06320b5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:04.888871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be32d25e-0aee-4add-aa6e-7b90f06320b5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:04.889613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be32d25e-0aee-4add-aa6e-7b90f06320b5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:04.890017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be32d25e-0aee-4add-aa6e-7b90f06320b5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:04.890767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be32d25e-0aee-4add-aa6e-7b90f06320b5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:05.076025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3074bcb7-5eff-4d5f-a334-fc66c9efa9fb tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:05.091943 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3074bcb7-5eff-4d5f-a334-fc66c9efa9fb tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1810 microversion: 2.1 time: 0.312722 Sep 07 12:51:05.093030 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2061/4073] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:04 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1810 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:05.102486 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ca56809d-bc57-4cf6-9597-32ffceabe469 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:05.103570 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ca56809d-bc57-4cf6-9597-32ffceabe469 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:05.112183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca56809d-bc57-4cf6-9597-32ffceabe469 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:05.112874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca56809d-bc57-4cf6-9597-32ffceabe469 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:05.113571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca56809d-bc57-4cf6-9597-32ffceabe469 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:05.114625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca56809d-bc57-4cf6-9597-32ffceabe469 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:05.115406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca56809d-bc57-4cf6-9597-32ffceabe469 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:05.116027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca56809d-bc57-4cf6-9597-32ffceabe469 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:05.131415 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-be32d25e-0aee-4add-aa6e-7b90f06320b5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:05.141435 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-be32d25e-0aee-4add-aa6e-7b90f06320b5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.274259 Sep 07 12:51:05.142623 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2013/4074] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:04 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:05.289317 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd1df9a8-0616-4946-a147-22aa7cde3f0c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1523928781", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "b810bb5d-8084-47d5-9b9e-6ea4661cdf5f"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd1df9a8-0616-4946-a147-22aa7cde3f0c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 235 Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1523928781", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "b810bb5d-8084-47d5-9b9e-6ea4661cdf5f"}]}} Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1523928781', 'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'b810bb5d-8084-47d5-9b9e-6ea4661cdf5f'}]}}} Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'notvalid' Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:05.294289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd1df9a8-0616-4946-a147-22aa7cde3f0c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dd1df9a8-0616-4946-a147-22aa7cde3f0c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.012452 Sep 07 12:51:05.305289 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2014/4075] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:51:05 2022] POST /compute/v2.1/servers => generated 133 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 07 12:51:05.310089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d372deb9-19ee-47a2-bccf-6462ee3e71f0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:05.311064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d372deb9-19ee-47a2-bccf-6462ee3e71f0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:05.320098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d372deb9-19ee-47a2-bccf-6462ee3e71f0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:05.320889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d372deb9-19ee-47a2-bccf-6462ee3e71f0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:05.321667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d372deb9-19ee-47a2-bccf-6462ee3e71f0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:05.322611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d372deb9-19ee-47a2-bccf-6462ee3e71f0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:05.323229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d372deb9-19ee-47a2-bccf-6462ee3e71f0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:05.323791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d372deb9-19ee-47a2-bccf-6462ee3e71f0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:05.371619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ca56809d-bc57-4cf6-9597-32ffceabe469 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:05.383928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ca56809d-bc57-4cf6-9597-32ffceabe469 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:05.388121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ca56809d-bc57-4cf6-9597-32ffceabe469 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:05.389853 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ca56809d-bc57-4cf6-9597-32ffceabe469 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.295082 Sep 07 12:51:05.391254 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2062/4076] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:05 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:51:05.507216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d372deb9-19ee-47a2-bccf-6462ee3e71f0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:05.517173 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d372deb9-19ee-47a2-bccf-6462ee3e71f0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.213227 Sep 07 12:51:05.517848 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2015/4077] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:05 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:05.530678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-90abafda-07fc-48ba-8063-fd35a154e7cd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:05.535321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-90abafda-07fc-48ba-8063-fd35a154e7cd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:05.548592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90abafda-07fc-48ba-8063-fd35a154e7cd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:05.549341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90abafda-07fc-48ba-8063-fd35a154e7cd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:05.550182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90abafda-07fc-48ba-8063-fd35a154e7cd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:05.551406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90abafda-07fc-48ba-8063-fd35a154e7cd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:05.552006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90abafda-07fc-48ba-8063-fd35a154e7cd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:05.552835 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90abafda-07fc-48ba-8063-fd35a154e7cd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:05.560125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c624fa62-3040-468b-ad2b-392303accc1b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:05.560871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c624fa62-3040-468b-ad2b-392303accc1b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:05.571403 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c624fa62-3040-468b-ad2b-392303accc1b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:05.572223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c624fa62-3040-468b-ad2b-392303accc1b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:05.572974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c624fa62-3040-468b-ad2b-392303accc1b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:05.574213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c624fa62-3040-468b-ad2b-392303accc1b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:05.575282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c624fa62-3040-468b-ad2b-392303accc1b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:05.575997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c624fa62-3040-468b-ad2b-392303accc1b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:05.702627 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-90abafda-07fc-48ba-8063-fd35a154e7cd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action" status: 200 len: 14 microversion: 2.1 time: 0.180220 Sep 07 12:51:05.703839 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2063/4078] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:05 2022] POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action => generated 14 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:51:05.712226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ec43166-0852-4f11-a6f4-0d8cbb50f075 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:05.713121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4ec43166-0852-4f11-a6f4-0d8cbb50f075 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:05.722908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ec43166-0852-4f11-a6f4-0d8cbb50f075 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:05.723997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ec43166-0852-4f11-a6f4-0d8cbb50f075 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:05.724625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ec43166-0852-4f11-a6f4-0d8cbb50f075 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:05.725801 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ec43166-0852-4f11-a6f4-0d8cbb50f075 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:05.726334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ec43166-0852-4f11-a6f4-0d8cbb50f075 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:05.726868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ec43166-0852-4f11-a6f4-0d8cbb50f075 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:05.739893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c624fa62-3040-468b-ad2b-392303accc1b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:05.749045 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c624fa62-3040-468b-ad2b-392303accc1b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.195622 Sep 07 12:51:05.749722 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2016/4079] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:05 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:05.791369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f2690faf-653f-4de5-bef6-8e11c798aaa3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:05.792390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f2690faf-653f-4de5-bef6-8e11c798aaa3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 8125066f-f27d-4d9e-a92e-88aa3c215e19] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:05.802486 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-f2690faf-653f-4de5-bef6-8e11c798aaa3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Instance 8125066f-f27d-4d9e-a92e-88aa3c215e19 could not be found. Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f2690faf-653f-4de5-bef6-8e11c798aaa3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/8125066f-f27d-4d9e-a92e-88aa3c215e19/action HTTP/1.1 Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 13 Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: {"pause": {}} Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 8125066f-f27d-4d9e-a92e-88aa3c215e19 could not be found. Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '8125066f-f27d-4d9e-a92e-88aa3c215e19', 'body': {'pause': {}}} Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8125066f-f27d-4d9e-a92e-88aa3c215e19 could not be found. Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8125066f-f27d-4d9e-a92e-88aa3c215e19 could not be found. Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:05.812497 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:05.822171 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:51:05.822171 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:51:05.822171 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8125066f-f27d-4d9e-a92e-88aa3c215e19 could not be found. Sep 07 12:51:05.822171 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:05.822171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f2690faf-653f-4de5-bef6-8e11c798aaa3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 404 to user: Instance 8125066f-f27d-4d9e-a92e-88aa3c215e19 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:51:05.822171 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f2690faf-653f-4de5-bef6-8e11c798aaa3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers/8125066f-f27d-4d9e-a92e-88aa3c215e19/action" status: 404 len: 111 microversion: 2.1 time: 0.031194 Sep 07 12:51:05.822171 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2017/4080] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:05 2022] POST /compute/v2.1/servers/8125066f-f27d-4d9e-a92e-88aa3c215e19/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:51:05.831668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-54362e47-9e02-47e6-a0fb-14bc941bee72 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:05.832789 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-54362e47-9e02-47e6-a0fb-14bc941bee72 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:05.842774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54362e47-9e02-47e6-a0fb-14bc941bee72 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:05.842774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54362e47-9e02-47e6-a0fb-14bc941bee72 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:05.843261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54362e47-9e02-47e6-a0fb-14bc941bee72 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:05.844327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54362e47-9e02-47e6-a0fb-14bc941bee72 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:05.844739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54362e47-9e02-47e6-a0fb-14bc941bee72 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:05.845238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54362e47-9e02-47e6-a0fb-14bc941bee72 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:06.039150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4ec43166-0852-4f11-a6f4-0d8cbb50f075 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:06.051122 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ec43166-0852-4f11-a6f4-0d8cbb50f075 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0" status: 200 len: 1521 microversion: 2.1 time: 0.345028 Sep 07 12:51:06.051707 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2064/4081] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:05 2022] GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0 => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:06.096960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-54362e47-9e02-47e6-a0fb-14bc941bee72 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:06.106022 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-54362e47-9e02-47e6-a0fb-14bc941bee72 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.282266 Sep 07 12:51:06.106627 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2018/4082] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:05 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:06.123456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9b663ab3-b98f-46b6-807a-611f5b2d0505 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:06.124730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9b663ab3-b98f-46b6-807a-611f5b2d0505 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:06.128468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:06.136510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d2dbb219-8463-4606-a93f-a6ac69f8fce3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:06.137170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d2dbb219-8463-4606-a93f-a6ac69f8fce3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:06.140432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b663ab3-b98f-46b6-807a-611f5b2d0505 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:06.141318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b663ab3-b98f-46b6-807a-611f5b2d0505 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:06.142160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b663ab3-b98f-46b6-807a-611f5b2d0505 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:06.143412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b663ab3-b98f-46b6-807a-611f5b2d0505 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:06.144141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2dbb219-8463-4606-a93f-a6ac69f8fce3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:06.144278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b663ab3-b98f-46b6-807a-611f5b2d0505 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:06.144654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2dbb219-8463-4606-a93f-a6ac69f8fce3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:06.145009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b663ab3-b98f-46b6-807a-611f5b2d0505 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:06.145122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2dbb219-8463-4606-a93f-a6ac69f8fce3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:06.145834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2dbb219-8463-4606-a93f-a6ac69f8fce3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:06.146390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2dbb219-8463-4606-a93f-a6ac69f8fce3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:06.146827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2dbb219-8463-4606-a93f-a6ac69f8fce3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:06.745174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d2dbb219-8463-4606-a93f-a6ac69f8fce3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:06.751355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9b663ab3-b98f-46b6-807a-611f5b2d0505 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:06.760554 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d2dbb219-8463-4606-a93f-a6ac69f8fce3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.629390 Sep 07 12:51:06.763973 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9b663ab3-b98f-46b6-807a-611f5b2d0505 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1810 microversion: 2.1 time: 0.647726 Sep 07 12:51:06.765180 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2065/4083] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:06 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1810 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:06.774168 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2019/4084] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:06 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:06.774774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3cbbbe38-7a35-49dc-864e-44187f3ff7d1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:06.776321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3cbbbe38-7a35-49dc-864e-44187f3ff7d1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:06.791396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-70fe1971-d465-433f-9525-c53e9cb76e80 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:06.792872 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cbbbe38-7a35-49dc-864e-44187f3ff7d1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:06.793384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cbbbe38-7a35-49dc-864e-44187f3ff7d1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:06.794291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cbbbe38-7a35-49dc-864e-44187f3ff7d1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:06.794738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-70fe1971-d465-433f-9525-c53e9cb76e80 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:06.795065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cbbbe38-7a35-49dc-864e-44187f3ff7d1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:06.795786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cbbbe38-7a35-49dc-864e-44187f3ff7d1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:06.796423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cbbbe38-7a35-49dc-864e-44187f3ff7d1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:06.806384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70fe1971-d465-433f-9525-c53e9cb76e80 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:06.807220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70fe1971-d465-433f-9525-c53e9cb76e80 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:06.807986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70fe1971-d465-433f-9525-c53e9cb76e80 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:06.809269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70fe1971-d465-433f-9525-c53e9cb76e80 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:06.810115 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70fe1971-d465-433f-9525-c53e9cb76e80 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:06.810819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70fe1971-d465-433f-9525-c53e9cb76e80 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:06.927848 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-70fe1971-d465-433f-9525-c53e9cb76e80 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action" status: 200 len: 14 microversion: 2.1 time: 0.142817 Sep 07 12:51:06.934140 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2020/4085] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:06 2022] POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:51:06.940031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-89246af8-c8fb-4439-bf51-079194370bcf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:06.940676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-89246af8-c8fb-4439-bf51-079194370bcf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:06.949265 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89246af8-c8fb-4439-bf51-079194370bcf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:06.950399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89246af8-c8fb-4439-bf51-079194370bcf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:06.950963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89246af8-c8fb-4439-bf51-079194370bcf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:06.952016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89246af8-c8fb-4439-bf51-079194370bcf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:06.952650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89246af8-c8fb-4439-bf51-079194370bcf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:06.953205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89246af8-c8fb-4439-bf51-079194370bcf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:07.037317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3cbbbe38-7a35-49dc-864e-44187f3ff7d1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:07.050343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3cbbbe38-7a35-49dc-864e-44187f3ff7d1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:07.052323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3cbbbe38-7a35-49dc-864e-44187f3ff7d1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:07.053833 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3cbbbe38-7a35-49dc-864e-44187f3ff7d1 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.286620 Sep 07 12:51:07.054560 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2066/4086] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:06 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:51:07.075162 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-89246af8-c8fb-4439-bf51-079194370bcf tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action" status: 202 len: 0 microversion: 2.1 time: 0.138262 Sep 07 12:51:07.081554 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2021/4087] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:06 2022] POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:51:07.081939 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-02d99dbb-3a56-45d3-aa5d-2da4c425977f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:07.081939 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-02d99dbb-3a56-45d3-aa5d-2da4c425977f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:07.086596 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02d99dbb-3a56-45d3-aa5d-2da4c425977f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:07.087114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02d99dbb-3a56-45d3-aa5d-2da4c425977f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:07.087567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02d99dbb-3a56-45d3-aa5d-2da4c425977f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:07.088300 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02d99dbb-3a56-45d3-aa5d-2da4c425977f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:07.088775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02d99dbb-3a56-45d3-aa5d-2da4c425977f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:07.089214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02d99dbb-3a56-45d3-aa5d-2da4c425977f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:07.096174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-10346960-c108-4353-a1df-a635a4aca92d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:07.096174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-10346960-c108-4353-a1df-a635a4aca92d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:07.111736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10346960-c108-4353-a1df-a635a4aca92d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:07.111736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10346960-c108-4353-a1df-a635a4aca92d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:07.111736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10346960-c108-4353-a1df-a635a4aca92d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:07.113108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10346960-c108-4353-a1df-a635a4aca92d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:07.113980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10346960-c108-4353-a1df-a635a4aca92d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:07.114891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10346960-c108-4353-a1df-a635a4aca92d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:07.410543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-02d99dbb-3a56-45d3-aa5d-2da4c425977f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:07.422425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-10346960-c108-4353-a1df-a635a4aca92d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:07.432936 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-02d99dbb-3a56-45d3-aa5d-2da4c425977f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0" status: 200 len: 1521 microversion: 2.1 time: 0.360825 Sep 07 12:51:07.434239 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2067/4088] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:07 2022] GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0 => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:07.445460 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-10346960-c108-4353-a1df-a635a4aca92d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1510 microversion: 2.1 time: 0.361194 Sep 07 12:51:07.447540 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2022/4089] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:07 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1510 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:07.790387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9c2212a1-97cc-4e4a-81ca-cce6c7ddb025 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:07.791143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9c2212a1-97cc-4e4a-81ca-cce6c7ddb025 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:07.798704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c2212a1-97cc-4e4a-81ca-cce6c7ddb025 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:07.799225 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c2212a1-97cc-4e4a-81ca-cce6c7ddb025 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:07.799674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c2212a1-97cc-4e4a-81ca-cce6c7ddb025 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:07.800422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c2212a1-97cc-4e4a-81ca-cce6c7ddb025 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:07.800921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c2212a1-97cc-4e4a-81ca-cce6c7ddb025 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:07.801364 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c2212a1-97cc-4e4a-81ca-cce6c7ddb025 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:07.942426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-5660be76-0977-43b9-ad84-21b819b59ded req-f56e5c37-d169-4efb-98a5-57088c13c4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a05521d0-a89d-418b-93c8-8bb32e9877b3", "name": "network-vif-deleted", "tag": "5138e43b-3b31-4d09-8d71-ac4cda0957ae"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:07.968167 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5660be76-0977-43b9-ad84-21b819b59ded req-f56e5c37-d169-4efb-98a5-57088c13c4d5 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:07.969055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5660be76-0977-43b9-ad84-21b819b59ded req-f56e5c37-d169-4efb-98a5-57088c13c4d5 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:07.969983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5660be76-0977-43b9-ad84-21b819b59ded req-f56e5c37-d169-4efb-98a5-57088c13c4d5 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:07.996727 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-5660be76-0977-43b9-ad84-21b819b59ded req-f56e5c37-d169-4efb-98a5-57088c13c4d5 service nova] Creating event network-vif-deleted:5138e43b-3b31-4d09-8d71-ac4cda0957ae for instance a05521d0-a89d-418b-93c8-8bb32e9877b3 on n-h1-852087-9 Sep 07 12:51:08.013837 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-5660be76-0977-43b9-ad84-21b819b59ded req-f56e5c37-d169-4efb-98a5-57088c13c4d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076797 Sep 07 12:51:08.015351 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2023/4090] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:51:08.022320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9ea87dc2-22d8-4a44-ae06-45f06fd8893f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:08.025669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9ea87dc2-22d8-4a44-ae06-45f06fd8893f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:08.049361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ea87dc2-22d8-4a44-ae06-45f06fd8893f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:08.050412 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ea87dc2-22d8-4a44-ae06-45f06fd8893f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:08.051194 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ea87dc2-22d8-4a44-ae06-45f06fd8893f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:08.052244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ea87dc2-22d8-4a44-ae06-45f06fd8893f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:08.052946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ea87dc2-22d8-4a44-ae06-45f06fd8893f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:08.054564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ea87dc2-22d8-4a44-ae06-45f06fd8893f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:08.202996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9c2212a1-97cc-4e4a-81ca-cce6c7ddb025 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:08.219996 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9ea87dc2-22d8-4a44-ae06-45f06fd8893f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action" status: 200 len: 14 microversion: 2.1 time: 0.201771 Sep 07 12:51:08.224649 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2024/4091] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:08 2022] POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action => generated 14 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:51:08.236670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9587a23c-6455-44a8-b5de-20866238b91d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:08.238626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9587a23c-6455-44a8-b5de-20866238b91d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:08.250682 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9c2212a1-97cc-4e4a-81ca-cce6c7ddb025 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1789 microversion: 2.1 time: 0.464239 Sep 07 12:51:08.256623 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2068/4092] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:07 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1789 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:08.258340 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9587a23c-6455-44a8-b5de-20866238b91d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:08.259459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9587a23c-6455-44a8-b5de-20866238b91d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:08.260926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9587a23c-6455-44a8-b5de-20866238b91d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:08.262443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9587a23c-6455-44a8-b5de-20866238b91d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:08.263648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9587a23c-6455-44a8-b5de-20866238b91d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:08.264451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9587a23c-6455-44a8-b5de-20866238b91d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:08.362481 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-18545135-c8cc-4141-b7f1-88b31e961c2f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0796098-a0c7-4c63-abf5-469004cdf31a"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:08.368641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-18545135-c8cc-4141-b7f1-88b31e961c2f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:08.384129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18545135-c8cc-4141-b7f1-88b31e961c2f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:08.385434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18545135-c8cc-4141-b7f1-88b31e961c2f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:08.386311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18545135-c8cc-4141-b7f1-88b31e961c2f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:08.387622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18545135-c8cc-4141-b7f1-88b31e961c2f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:08.388874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18545135-c8cc-4141-b7f1-88b31e961c2f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:08.390034 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18545135-c8cc-4141-b7f1-88b31e961c2f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:08.585592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9587a23c-6455-44a8-b5de-20866238b91d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:08.599961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9587a23c-6455-44a8-b5de-20866238b91d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:08.601996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9587a23c-6455-44a8-b5de-20866238b91d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:08.604420 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9587a23c-6455-44a8-b5de-20866238b91d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.380309 Sep 07 12:51:08.605410 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2025/4093] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:08 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:51:08.611466 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8fc4e103-afb9-4e8e-b55c-5b68350896f3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:08.612225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8fc4e103-afb9-4e8e-b55c-5b68350896f3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:08.622481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fc4e103-afb9-4e8e-b55c-5b68350896f3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:08.626059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fc4e103-afb9-4e8e-b55c-5b68350896f3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:08.627850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fc4e103-afb9-4e8e-b55c-5b68350896f3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:08.629871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fc4e103-afb9-4e8e-b55c-5b68350896f3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:08.630770 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fc4e103-afb9-4e8e-b55c-5b68350896f3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:08.633079 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fc4e103-afb9-4e8e-b55c-5b68350896f3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:08.879246 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-18545135-c8cc-4141-b7f1-88b31e961c2f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "POST /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.525190 Sep 07 12:51:08.881138 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2069/4094] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Sep 7 12:51:08 2022] POST /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments => generated 194 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:51:08.904814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5c2cfbd6-1294-4ca0-a85d-6b856d183204 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:08.912408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5c2cfbd6-1294-4ca0-a85d-6b856d183204 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:08.941025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c2cfbd6-1294-4ca0-a85d-6b856d183204 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:08.943293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c2cfbd6-1294-4ca0-a85d-6b856d183204 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:08.945843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c2cfbd6-1294-4ca0-a85d-6b856d183204 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:08.949009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c2cfbd6-1294-4ca0-a85d-6b856d183204 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:08.950866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c2cfbd6-1294-4ca0-a85d-6b856d183204 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:08.952854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c2cfbd6-1294-4ca0-a85d-6b856d183204 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:08.966291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8fc4e103-afb9-4e8e-b55c-5b68350896f3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:08.986551 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8fc4e103-afb9-4e8e-b55c-5b68350896f3 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0" status: 200 len: 1498 microversion: 2.1 time: 0.379340 Sep 07 12:51:08.989234 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2026/4095] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:08 2022] GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0 => generated 1498 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:09.036106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a7b597dc-0946-4296-b6ef-d3b737530a2f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:09.061322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a7b597dc-0946-4296-b6ef-d3b737530a2f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:09.062797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a7b597dc-0946-4296-b6ef-d3b737530a2f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:51:09.077681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7b597dc-0946-4296-b6ef-d3b737530a2f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:09.078548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7b597dc-0946-4296-b6ef-d3b737530a2f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:09.090776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7b597dc-0946-4296-b6ef-d3b737530a2f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:09.092129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7b597dc-0946-4296-b6ef-d3b737530a2f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:09.092990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7b597dc-0946-4296-b6ef-d3b737530a2f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:09.105881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7b597dc-0946-4296-b6ef-d3b737530a2f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:09.195583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-a7b597dc-0946-4296-b6ef-d3b737530a2f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:51:09.284971 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a7b597dc-0946-4296-b6ef-d3b737530a2f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.256974 Sep 07 12:51:09.292773 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2027/4096] 10.222.0.16 () {58 vars in 1154 bytes} [Wed Sep 7 12:51:09 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:51:09.305211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3fe490a7-c3b4-45a8-8bf4-0efc14594f62 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:09.309330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3fe490a7-c3b4-45a8-8bf4-0efc14594f62 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:09.324891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fe490a7-c3b4-45a8-8bf4-0efc14594f62 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:09.325821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fe490a7-c3b4-45a8-8bf4-0efc14594f62 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:09.327064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fe490a7-c3b4-45a8-8bf4-0efc14594f62 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:09.327858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fe490a7-c3b4-45a8-8bf4-0efc14594f62 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:09.328697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fe490a7-c3b4-45a8-8bf4-0efc14594f62 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:09.329683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3fe490a7-c3b4-45a8-8bf4-0efc14594f62 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:09.409858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5c2cfbd6-1294-4ca0-a85d-6b856d183204 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:09.420078 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5c2cfbd6-1294-4ca0-a85d-6b856d183204 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1490 microversion: 2.1 time: 0.536398 Sep 07 12:51:09.420688 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2070/4097] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:08 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1490 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:09.434089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7d9df7ee-98c1-4c6a-8bf8-0f586257a991 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:09.435527 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7d9df7ee-98c1-4c6a-8bf8-0f586257a991 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:09.447496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d9df7ee-98c1-4c6a-8bf8-0f586257a991 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:09.448802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d9df7ee-98c1-4c6a-8bf8-0f586257a991 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:09.450226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d9df7ee-98c1-4c6a-8bf8-0f586257a991 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:09.451725 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d9df7ee-98c1-4c6a-8bf8-0f586257a991 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:09.452703 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d9df7ee-98c1-4c6a-8bf8-0f586257a991 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:09.453734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d9df7ee-98c1-4c6a-8bf8-0f586257a991 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:09.486960 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3fe490a7-c3b4-45a8-8bf4-0efc14594f62 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action" status: 200 len: 14 microversion: 2.1 time: 0.197924 Sep 07 12:51:09.493045 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2028/4098] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:09 2022] POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action => generated 14 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:51:09.499666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-96ff784d-a251-4d03-88bc-dce23a8732e0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:09.517387 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96ff784d-a251-4d03-88bc-dce23a8732e0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:09.518384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96ff784d-a251-4d03-88bc-dce23a8732e0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:09.519578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96ff784d-a251-4d03-88bc-dce23a8732e0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:09.530474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:09.582584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-96ff784d-a251-4d03-88bc-dce23a8732e0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] Going to try to start instance {{(pid=122432) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 12:51:09.653153 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-96ff784d-a251-4d03-88bc-dce23a8732e0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "POST /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0/action" status: 202 len: 0 microversion: 2.1 time: 0.158065 Sep 07 12:51:09.658204 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2029/4099] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:09 2022] POST /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:51:09.679456 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d36e0014-c2a6-43ae-a499-88c0104b6b11 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:09.680518 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d36e0014-c2a6-43ae-a499-88c0104b6b11 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:09.691521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d36e0014-c2a6-43ae-a499-88c0104b6b11 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:09.692028 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d36e0014-c2a6-43ae-a499-88c0104b6b11 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:09.692680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d36e0014-c2a6-43ae-a499-88c0104b6b11 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:09.693249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d36e0014-c2a6-43ae-a499-88c0104b6b11 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:09.693800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d36e0014-c2a6-43ae-a499-88c0104b6b11 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:09.694428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d36e0014-c2a6-43ae-a499-88c0104b6b11 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:09.723686 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-d36e0014-c2a6-43ae-a499-88c0104b6b11 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Cannot 'pause' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state paused Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d36e0014-c2a6-43ae-a499-88c0104b6b11 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action HTTP/1.1 Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 13 Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: {"pause": {}} Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: exception: Cannot 'pause' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state paused Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860', 'body': {'pause': {}}} Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 in vm_state paused. Cannot pause while the instance is in this state. Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state paused Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:09.725656 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:09.742246 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:09.742246 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:51:09.742246 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:51:09.742246 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state paused Sep 07 12:51:09.742246 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:09.742246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d36e0014-c2a6-43ae-a499-88c0104b6b11 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 409 to user: Cannot 'pause' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state paused {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:51:09.742246 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d36e0014-c2a6-43ae-a499-88c0104b6b11 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action" status: 409 len: 143 microversion: 2.1 time: 0.059632 Sep 07 12:51:09.742246 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2030/4100] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:09 2022] POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action => generated 143 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:51:09.742246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3b3a3a92-9c33-48a6-b05a-0752f79946a5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:09.742246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3b3a3a92-9c33-48a6-b05a-0752f79946a5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:09.750101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b3a3a92-9c33-48a6-b05a-0752f79946a5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:09.751455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b3a3a92-9c33-48a6-b05a-0752f79946a5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:09.752324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b3a3a92-9c33-48a6-b05a-0752f79946a5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:09.754966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b3a3a92-9c33-48a6-b05a-0752f79946a5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:09.755888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b3a3a92-9c33-48a6-b05a-0752f79946a5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:09.756625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3b3a3a92-9c33-48a6-b05a-0752f79946a5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:09.819178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7d9df7ee-98c1-4c6a-8bf8-0f586257a991 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:09.859238 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7d9df7ee-98c1-4c6a-8bf8-0f586257a991 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1610 microversion: 2.1 time: 0.435939 Sep 07 12:51:09.878159 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2071/4101] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:09 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1610 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:09.889413 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-30fdb6ce-a2ee-4570-a9cb-eb5ec00bec59 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:09.891216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-30fdb6ce-a2ee-4570-a9cb-eb5ec00bec59 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:09.907528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30fdb6ce-a2ee-4570-a9cb-eb5ec00bec59 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:09.908843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30fdb6ce-a2ee-4570-a9cb-eb5ec00bec59 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:09.910314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30fdb6ce-a2ee-4570-a9cb-eb5ec00bec59 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:09.912115 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30fdb6ce-a2ee-4570-a9cb-eb5ec00bec59 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:09.913798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30fdb6ce-a2ee-4570-a9cb-eb5ec00bec59 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:09.915072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30fdb6ce-a2ee-4570-a9cb-eb5ec00bec59 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:10.503654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-30fdb6ce-a2ee-4570-a9cb-eb5ec00bec59 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:10.533299 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-30fdb6ce-a2ee-4570-a9cb-eb5ec00bec59 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0" status: 200 len: 1507 microversion: 2.1 time: 0.652400 Sep 07 12:51:10.545579 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2072/4102] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:09 2022] GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0 => generated 1507 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:10.549941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3b3a3a92-9c33-48a6-b05a-0752f79946a5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:10.556826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c762280-930d-4387-977d-298cdd19db45 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:10.558494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2c762280-930d-4387-977d-298cdd19db45 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:10.574294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c762280-930d-4387-977d-298cdd19db45 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:10.575281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c762280-930d-4387-977d-298cdd19db45 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:10.575842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c762280-930d-4387-977d-298cdd19db45 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:10.576728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c762280-930d-4387-977d-298cdd19db45 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:10.578899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c762280-930d-4387-977d-298cdd19db45 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:10.582514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c762280-930d-4387-977d-298cdd19db45 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:10.593387 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3b3a3a92-9c33-48a6-b05a-0752f79946a5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:10.600949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3b3a3a92-9c33-48a6-b05a-0752f79946a5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:10.607990 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3b3a3a92-9c33-48a6-b05a-0752f79946a5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.871408 Sep 07 12:51:10.612608 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2031/4103] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:09 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:51:10.638169 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d70e787f-e8b1-45cd-b4f5-e5023b333a22 req-8f439316-97f2-4b18-ba02-86f21cd92627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a05521d0-a89d-418b-93c8-8bb32e9877b3", "name": "network-vif-deleted", "tag": "bedbadf5-eb44-437a-a98d-a5c59f97639c"}, {"server_uuid": "a05521d0-a89d-418b-93c8-8bb32e9877b3", "name": "network-vif-deleted", "tag": "d5abea6b-5954-4b65-9ef5-34170d7a794f"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:10.673066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d70e787f-e8b1-45cd-b4f5-e5023b333a22 req-8f439316-97f2-4b18-ba02-86f21cd92627 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:10.674121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d70e787f-e8b1-45cd-b4f5-e5023b333a22 req-8f439316-97f2-4b18-ba02-86f21cd92627 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:10.674712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d70e787f-e8b1-45cd-b4f5-e5023b333a22 req-8f439316-97f2-4b18-ba02-86f21cd92627 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:10.701906 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d70e787f-e8b1-45cd-b4f5-e5023b333a22 req-8f439316-97f2-4b18-ba02-86f21cd92627 service nova] Creating event network-vif-deleted:bedbadf5-eb44-437a-a98d-a5c59f97639c for instance a05521d0-a89d-418b-93c8-8bb32e9877b3 on n-h1-852087-9 Sep 07 12:51:10.703527 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d70e787f-e8b1-45cd-b4f5-e5023b333a22 req-8f439316-97f2-4b18-ba02-86f21cd92627 service nova] Creating event network-vif-deleted:d5abea6b-5954-4b65-9ef5-34170d7a794f for instance a05521d0-a89d-418b-93c8-8bb32e9877b3 on n-h1-852087-9 Sep 07 12:51:10.723548 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d70e787f-e8b1-45cd-b4f5-e5023b333a22 req-8f439316-97f2-4b18-ba02-86f21cd92627 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.106023 Sep 07 12:51:10.728977 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2032/4104] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:51:10.756958 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2c762280-930d-4387-977d-298cdd19db45 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action" status: 202 len: 0 microversion: 2.1 time: 0.208170 Sep 07 12:51:10.758193 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2073/4105] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:10 2022] POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:51:10.765935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-de823f6b-cb11-4276-aa7d-67fa2085bdd2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:10.776084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-de823f6b-cb11-4276-aa7d-67fa2085bdd2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:10.781786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-f8ce63a6-c07b-4ae5-891a-517a0950d34f req-98d4da04-f317-4a21-8c89-2800ec1a3542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9352ac2-475e-4c77-aa85-5ecd566563b2", "name": "network-vif-plugged", "status": "completed", "tag": "ac84729b-c148-47a6-8ee7-4895a2aef8ac"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:10.801989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f8ce63a6-c07b-4ae5-891a-517a0950d34f req-98d4da04-f317-4a21-8c89-2800ec1a3542 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:10.802979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f8ce63a6-c07b-4ae5-891a-517a0950d34f req-98d4da04-f317-4a21-8c89-2800ec1a3542 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:10.804541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f8ce63a6-c07b-4ae5-891a-517a0950d34f req-98d4da04-f317-4a21-8c89-2800ec1a3542 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:10.812632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de823f6b-cb11-4276-aa7d-67fa2085bdd2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:10.815703 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de823f6b-cb11-4276-aa7d-67fa2085bdd2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:10.817075 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de823f6b-cb11-4276-aa7d-67fa2085bdd2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:10.820454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de823f6b-cb11-4276-aa7d-67fa2085bdd2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:10.821269 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-f8ce63a6-c07b-4ae5-891a-517a0950d34f req-98d4da04-f317-4a21-8c89-2800ec1a3542 service nova] Creating event network-vif-plugged:ac84729b-c148-47a6-8ee7-4895a2aef8ac for instance e9352ac2-475e-4c77-aa85-5ecd566563b2 on n-h2-852087-9 Sep 07 12:51:10.824064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de823f6b-cb11-4276-aa7d-67fa2085bdd2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:10.825370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de823f6b-cb11-4276-aa7d-67fa2085bdd2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:10.829878 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-f8ce63a6-c07b-4ae5-891a-517a0950d34f req-98d4da04-f317-4a21-8c89-2800ec1a3542 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069537 Sep 07 12:51:10.831225 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2074/4106] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:51:10.839506 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c043485-02ad-4091-b84a-6bb39d4fb8ce tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:10.840634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7c043485-02ad-4091-b84a-6bb39d4fb8ce tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:10.851328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c043485-02ad-4091-b84a-6bb39d4fb8ce tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:10.852270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c043485-02ad-4091-b84a-6bb39d4fb8ce tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:10.852902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c043485-02ad-4091-b84a-6bb39d4fb8ce tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:10.853917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c043485-02ad-4091-b84a-6bb39d4fb8ce tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:10.854971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c043485-02ad-4091-b84a-6bb39d4fb8ce tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:10.855896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c043485-02ad-4091-b84a-6bb39d4fb8ce tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:10.908749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:10.983400 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-de823f6b-cb11-4276-aa7d-67fa2085bdd2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action" status: 200 len: 14 microversion: 2.1 time: 0.248439 Sep 07 12:51:10.987605 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2033/4107] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:10 2022] POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action => generated 14 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:51:11.006416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f8a46319-63bb-4de1-925b-b739c4c1ccf5 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:11.007147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f8a46319-63bb-4de1-925b-b739c4c1ccf5 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:11.021647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8a46319-63bb-4de1-925b-b739c4c1ccf5 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:11.022156 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8a46319-63bb-4de1-925b-b739c4c1ccf5 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:11.022799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8a46319-63bb-4de1-925b-b739c4c1ccf5 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:11.023747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8a46319-63bb-4de1-925b-b739c4c1ccf5 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:11.024739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8a46319-63bb-4de1-925b-b739c4c1ccf5 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:11.026334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8a46319-63bb-4de1-925b-b739c4c1ccf5 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:11.120672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8a46319-63bb-4de1-925b-b739c4c1ccf5 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:11.124463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8a46319-63bb-4de1-925b-b739c4c1ccf5 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:11.125215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8a46319-63bb-4de1-925b-b739c4c1ccf5 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:11.127277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-f8a46319-63bb-4de1-925b-b739c4c1ccf5 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lazy-loading 'fault' on Instance uuid a05521d0-a89d-418b-93c8-8bb32e9877b3 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:51:11.182326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7c043485-02ad-4091-b84a-6bb39d4fb8ce tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:11.195895 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7c043485-02ad-4091-b84a-6bb39d4fb8ce tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1497 microversion: 2.1 time: 0.362970 Sep 07 12:51:11.197115 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2075/4108] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:10 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1497 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:11.238003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f8a46319-63bb-4de1-925b-b739c4c1ccf5 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:11.249540 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f8a46319-63bb-4de1-925b-b739c4c1ccf5 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 200 len: 1302 microversion: 2.1 time: 0.253738 Sep 07 12:51:11.249540 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2034/4109] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:10 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 1302 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:11.583365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d395a195-403c-4574-a78e-d9f4ed7179eb tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:11.585538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d395a195-403c-4574-a78e-d9f4ed7179eb tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:11.598457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d395a195-403c-4574-a78e-d9f4ed7179eb tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:11.599905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d395a195-403c-4574-a78e-d9f4ed7179eb tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:11.600712 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d395a195-403c-4574-a78e-d9f4ed7179eb tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:11.602514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d395a195-403c-4574-a78e-d9f4ed7179eb tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:11.603403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d395a195-403c-4574-a78e-d9f4ed7179eb tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:11.604167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d395a195-403c-4574-a78e-d9f4ed7179eb tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:11.644514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-89a07209-9eb4-4358-b19b-4bf273f7b264 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:11.646141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-89a07209-9eb4-4358-b19b-4bf273f7b264 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:11.660523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89a07209-9eb4-4358-b19b-4bf273f7b264 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:11.662006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89a07209-9eb4-4358-b19b-4bf273f7b264 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:11.663075 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89a07209-9eb4-4358-b19b-4bf273f7b264 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:11.664841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89a07209-9eb4-4358-b19b-4bf273f7b264 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:11.666036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89a07209-9eb4-4358-b19b-4bf273f7b264 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:11.667306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89a07209-9eb4-4358-b19b-4bf273f7b264 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:12.159418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d395a195-403c-4574-a78e-d9f4ed7179eb tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:12.204555 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d395a195-403c-4574-a78e-d9f4ed7179eb tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0" status: 200 len: 1507 microversion: 2.1 time: 0.625333 Sep 07 12:51:12.217744 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2076/4110] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:11 2022] GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0 => generated 1507 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:12.221038 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-89a07209-9eb4-4358-b19b-4bf273f7b264 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:12.230300 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b807bf73-7341-414f-9a83-166dade2bd3d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:12.237537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b807bf73-7341-414f-9a83-166dade2bd3d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:12.247786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-89a07209-9eb4-4358-b19b-4bf273f7b264 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:12.253291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-89a07209-9eb4-4358-b19b-4bf273f7b264 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:12.253936 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b807bf73-7341-414f-9a83-166dade2bd3d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:12.255466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b807bf73-7341-414f-9a83-166dade2bd3d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:12.257122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b807bf73-7341-414f-9a83-166dade2bd3d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:12.258533 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-89a07209-9eb4-4358-b19b-4bf273f7b264 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.621050 Sep 07 12:51:12.259663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b807bf73-7341-414f-9a83-166dade2bd3d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:12.260263 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2035/4111] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:11 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:51:12.261185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b807bf73-7341-414f-9a83-166dade2bd3d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:12.262496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b807bf73-7341-414f-9a83-166dade2bd3d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:12.275098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d03a0f60-2987-4f7f-8a78-786aa1a943cc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:12.276784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d03a0f60-2987-4f7f-8a78-786aa1a943cc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:12.284656 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:12.295092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d03a0f60-2987-4f7f-8a78-786aa1a943cc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:12.296292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d03a0f60-2987-4f7f-8a78-786aa1a943cc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:12.297380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d03a0f60-2987-4f7f-8a78-786aa1a943cc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:12.299108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d03a0f60-2987-4f7f-8a78-786aa1a943cc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:12.300252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d03a0f60-2987-4f7f-8a78-786aa1a943cc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:12.301304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d03a0f60-2987-4f7f-8a78-786aa1a943cc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:12.392980 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b807bf73-7341-414f-9a83-166dade2bd3d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action" status: 200 len: 14 microversion: 2.1 time: 0.173614 Sep 07 12:51:12.394532 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2077/4112] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:12 2022] POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action => generated 14 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:51:12.401416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-67f012dd-213c-4198-b5df-6e7b7eb36a65 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:12.402528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-67f012dd-213c-4198-b5df-6e7b7eb36a65 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:12.411766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67f012dd-213c-4198-b5df-6e7b7eb36a65 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:12.412670 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67f012dd-213c-4198-b5df-6e7b7eb36a65 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:12.413286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67f012dd-213c-4198-b5df-6e7b7eb36a65 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:12.414285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67f012dd-213c-4198-b5df-6e7b7eb36a65 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:12.414989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67f012dd-213c-4198-b5df-6e7b7eb36a65 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:12.415606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67f012dd-213c-4198-b5df-6e7b7eb36a65 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:12.459868 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-67f012dd-213c-4198-b5df-6e7b7eb36a65 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] HTTP exception thrown: Instance a05521d0-a89d-418b-93c8-8bb32e9877b3 could not be found. Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-67f012dd-213c-4198-b5df-6e7b7eb36a65 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Request method failure captured: Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 HTTP/1.1 Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJN8NqKxBwConiCWO9bIXJk7c-FVKnSUYjAvdT7C5Od3Elyr9LGtszVr5mluLtiRpomLOBsLJLzY7W19SIqLmM-OZ_Lh5-sXVLTNU7jLpVnaQDZH2__l9Mw78gUnVvJbtz6Lr6bt6XcnIB4QpY7Mwb79DiXYgGdQrs0zAO51eh0Aozo Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 55ea9c8446d545d1ae1bd49f67d6008b Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestMultiNic-151275201 Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/55ea9c8446d545d1ae1bd49f67d6008b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_55ea9c8446d545d1ae1bd49f67d6008b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/55ea9c8446d545d1ae1bd49f67d6008b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/55ea9c8446d545d1ae1bd49f67d6008b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestMultiNic-151275201 Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 55ea9c8446d545d1ae1bd49f67d6008b Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestMultiNic-151275201 Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersTestMultiNic-151275201-project Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 73853219b29241269ce4bb94155b204e Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestMultiNic-151275201-project Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance a05521d0-a89d-418b-93c8-8bb32e9877b3 could not be found. Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'a05521d0-a89d-418b-93c8-8bb32e9877b3'} Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a05521d0-a89d-418b-93c8-8bb32e9877b3 could not be found. Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a05521d0-a89d-418b-93c8-8bb32e9877b3 could not be found. Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:12.464826 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:12.471475 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:12.471475 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:12.471475 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:12.471475 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:51:12.471475 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:51:12.471475 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a05521d0-a89d-418b-93c8-8bb32e9877b3 could not be found. Sep 07 12:51:12.471475 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:12.471475 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-67f012dd-213c-4198-b5df-6e7b7eb36a65 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Returning 404 to user: Instance a05521d0-a89d-418b-93c8-8bb32e9877b3 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:51:12.471475 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-67f012dd-213c-4198-b5df-6e7b7eb36a65 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 404 len: 111 microversion: 2.1 time: 0.071010 Sep 07 12:51:12.471475 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2078/4113] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:12 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:51:12.514064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d03a0f60-2987-4f7f-8a78-786aa1a943cc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:12.523183 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d03a0f60-2987-4f7f-8a78-786aa1a943cc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.261013 Sep 07 12:51:12.524220 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2036/4114] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:12 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:12.555480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-01f08911-cef0-4b60-8b38-0f338e52eb65 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:12.556908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-01f08911-cef0-4b60-8b38-0f338e52eb65 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:12.564598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01f08911-cef0-4b60-8b38-0f338e52eb65 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:12.565421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01f08911-cef0-4b60-8b38-0f338e52eb65 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:12.565932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01f08911-cef0-4b60-8b38-0f338e52eb65 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:12.566666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01f08911-cef0-4b60-8b38-0f338e52eb65 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:12.567119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01f08911-cef0-4b60-8b38-0f338e52eb65 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:12.567584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01f08911-cef0-4b60-8b38-0f338e52eb65 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:12.781096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-01f08911-cef0-4b60-8b38-0f338e52eb65 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:12.790624 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-01f08911-cef0-4b60-8b38-0f338e52eb65 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.240077 Sep 07 12:51:12.804937 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2079/4115] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:12 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:12.814879 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d787597-031d-4544-9f33-0d27c5a5c315 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:12.818023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9d787597-031d-4544-9f33-0d27c5a5c315 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 0f92440f-8b32-4731-8383-d9e57e575ae7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:12.828517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d787597-031d-4544-9f33-0d27c5a5c315 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:12.829672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d787597-031d-4544-9f33-0d27c5a5c315 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:12.831339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d787597-031d-4544-9f33-0d27c5a5c315 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:12.832909 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d787597-031d-4544-9f33-0d27c5a5c315 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:12.834595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d787597-031d-4544-9f33-0d27c5a5c315 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:12.835760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d787597-031d-4544-9f33-0d27c5a5c315 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:12.867941 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-9d787597-031d-4544-9f33-0d27c5a5c315 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d787597-031d-4544-9f33-0d27c5a5c315 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7/action HTTP/1.1 Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 28 Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: {"reboot": {"type": "SOFT"}} Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '0f92440f-8b32-4731-8383-d9e57e575ae7', 'body': {'reboot': {'type': 'SOFT'}}} Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:51:12.871975 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:51:12.877203 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. Sep 07 12:51:12.877203 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:12.877203 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:12.877203 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:12.877203 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:12.877203 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:12.877203 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:12.877203 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:51:12.877203 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:51:12.877203 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. Sep 07 12:51:12.877203 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:12.879279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d787597-031d-4544-9f33-0d27c5a5c315 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 404 to user: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:51:12.881102 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9d787597-031d-4544-9f33-0d27c5a5c315 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7/action" status: 404 len: 111 microversion: 2.1 time: 0.070141 Sep 07 12:51:12.882372 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2037/4116] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:12 2022] POST /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7/action => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:51:12.897968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5406f129-6fcf-4d79-9c15-8a536fc7f79f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:12.899502 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5406f129-6fcf-4d79-9c15-8a536fc7f79f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:12.918863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5406f129-6fcf-4d79-9c15-8a536fc7f79f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:12.920459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5406f129-6fcf-4d79-9c15-8a536fc7f79f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:12.921814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5406f129-6fcf-4d79-9c15-8a536fc7f79f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:12.924081 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5406f129-6fcf-4d79-9c15-8a536fc7f79f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:12.925395 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5406f129-6fcf-4d79-9c15-8a536fc7f79f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:12.926625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5406f129-6fcf-4d79-9c15-8a536fc7f79f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:13.113416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9eb88225-cc42-4f19-86bf-19ad0b68b681 req-a58bd251-cbb6-4341-b7ca-5855d7886312 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9352ac2-475e-4c77-aa85-5ecd566563b2", "name": "network-vif-plugged", "status": "completed", "tag": "52acc413-bd10-4aa6-9f53-f86a0cad3f9b"}, {"server_uuid": "e9352ac2-475e-4c77-aa85-5ecd566563b2", "name": "network-vif-plugged", "status": "completed", "tag": "3a4e33c1-9c34-429f-8cce-622597db4c32"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:13.159967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9eb88225-cc42-4f19-86bf-19ad0b68b681 req-a58bd251-cbb6-4341-b7ca-5855d7886312 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:13.160808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9eb88225-cc42-4f19-86bf-19ad0b68b681 req-a58bd251-cbb6-4341-b7ca-5855d7886312 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:13.161780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9eb88225-cc42-4f19-86bf-19ad0b68b681 req-a58bd251-cbb6-4341-b7ca-5855d7886312 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:13.207787 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9eb88225-cc42-4f19-86bf-19ad0b68b681 req-a58bd251-cbb6-4341-b7ca-5855d7886312 service nova] Creating event network-vif-plugged:52acc413-bd10-4aa6-9f53-f86a0cad3f9b for instance e9352ac2-475e-4c77-aa85-5ecd566563b2 on n-h2-852087-9 Sep 07 12:51:13.208555 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9eb88225-cc42-4f19-86bf-19ad0b68b681 req-a58bd251-cbb6-4341-b7ca-5855d7886312 service nova] Creating event network-vif-plugged:3a4e33c1-9c34-429f-8cce-622597db4c32 for instance e9352ac2-475e-4c77-aa85-5ecd566563b2 on n-h2-852087-9 Sep 07 12:51:13.248539 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9eb88225-cc42-4f19-86bf-19ad0b68b681 req-a58bd251-cbb6-4341-b7ca-5855d7886312 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.142715 Sep 07 12:51:13.255678 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2038/4117] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:51:13.268909 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ecb8184-2576-4e3f-95ab-873d7ca78c79 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:13.274752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5ecb8184-2576-4e3f-95ab-873d7ca78c79 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:13.293599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5406f129-6fcf-4d79-9c15-8a536fc7f79f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:13.296765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ecb8184-2576-4e3f-95ab-873d7ca78c79 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:13.297429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ecb8184-2576-4e3f-95ab-873d7ca78c79 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:13.297917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ecb8184-2576-4e3f-95ab-873d7ca78c79 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:13.298648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ecb8184-2576-4e3f-95ab-873d7ca78c79 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:13.299120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ecb8184-2576-4e3f-95ab-873d7ca78c79 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:13.299560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ecb8184-2576-4e3f-95ab-873d7ca78c79 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:13.312302 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5406f129-6fcf-4d79-9c15-8a536fc7f79f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.423506 Sep 07 12:51:13.314800 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2080/4118] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:12 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:13.344288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fc425c28-f94b-4085-af7e-24ca04045155 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:13.345247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fc425c28-f94b-4085-af7e-24ca04045155 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:13.353923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc425c28-f94b-4085-af7e-24ca04045155 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:13.354937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc425c28-f94b-4085-af7e-24ca04045155 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:13.355590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc425c28-f94b-4085-af7e-24ca04045155 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:13.356711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc425c28-f94b-4085-af7e-24ca04045155 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:13.357401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc425c28-f94b-4085-af7e-24ca04045155 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:13.358047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc425c28-f94b-4085-af7e-24ca04045155 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:14.003884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5ecb8184-2576-4e3f-95ab-873d7ca78c79 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:14.019462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fc425c28-f94b-4085-af7e-24ca04045155 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:14.045125 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5ecb8184-2576-4e3f-95ab-873d7ca78c79 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0" status: 200 len: 1511 microversion: 2.1 time: 0.781107 Sep 07 12:51:14.054772 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2039/4119] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:13 2022] GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0 => generated 1511 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:14.065008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c8e0deef-7675-4ed8-8010-b8c8b9b389c0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:14.066107 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c8e0deef-7675-4ed8-8010-b8c8b9b389c0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:14.073902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fc425c28-f94b-4085-af7e-24ca04045155 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:14.077138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fc425c28-f94b-4085-af7e-24ca04045155 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:14.082215 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fc425c28-f94b-4085-af7e-24ca04045155 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.764296 Sep 07 12:51:14.083430 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2081/4120] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:13 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:51:14.111576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e95527a9-9377-42c1-9202-3500e69188ba tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:14.113102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8e0deef-7675-4ed8-8010-b8c8b9b389c0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:14.114100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8e0deef-7675-4ed8-8010-b8c8b9b389c0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:14.114970 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8e0deef-7675-4ed8-8010-b8c8b9b389c0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:14.116328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8e0deef-7675-4ed8-8010-b8c8b9b389c0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:14.117213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8e0deef-7675-4ed8-8010-b8c8b9b389c0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:14.118297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8e0deef-7675-4ed8-8010-b8c8b9b389c0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:14.118717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e95527a9-9377-42c1-9202-3500e69188ba tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:14.132509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e95527a9-9377-42c1-9202-3500e69188ba tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:14.133987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e95527a9-9377-42c1-9202-3500e69188ba tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:14.135596 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e95527a9-9377-42c1-9202-3500e69188ba tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:14.137668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e95527a9-9377-42c1-9202-3500e69188ba tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:14.139046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e95527a9-9377-42c1-9202-3500e69188ba tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:14.140318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e95527a9-9377-42c1-9202-3500e69188ba tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:14.261307 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e95527a9-9377-42c1-9202-3500e69188ba tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action" status: 200 len: 14 microversion: 2.1 time: 0.164010 Sep 07 12:51:14.263522 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2082/4121] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:14 2022] POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:51:14.277997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-da1b4e31-ee59-47c7-a3e4-b269aef5217a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:14.284319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da1b4e31-ee59-47c7-a3e4-b269aef5217a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:14.285456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.compute.servers [None req-da1b4e31-ee59-47c7-a3e4-b269aef5217a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Removing options 'limit' from query {{(pid=122433) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 07 12:51:14.287311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-da1b4e31-ee59-47c7-a3e4-b269aef5217a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Searching by: {'deleted': False, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:51:14.289221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da1b4e31-ee59-47c7-a3e4-b269aef5217a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:14.290029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da1b4e31-ee59-47c7-a3e4-b269aef5217a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:14.290893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da1b4e31-ee59-47c7-a3e4-b269aef5217a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:14.292184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da1b4e31-ee59-47c7-a3e4-b269aef5217a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:14.293051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da1b4e31-ee59-47c7-a3e4-b269aef5217a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:14.294281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da1b4e31-ee59-47c7-a3e4-b269aef5217a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:14.298370 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-da1b4e31-ee59-47c7-a3e4-b269aef5217a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.032511 Sep 07 12:51:14.299531 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2083/4122] 10.222.0.16 () {58 vars in 1140 bytes} [Wed Sep 7 12:51:14 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:51:14.321400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-65c43c9f-f327-4488-b99c-bf59f73318a1 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:14.324115 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-65c43c9f-f327-4488-b99c-bf59f73318a1 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:14.341759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65c43c9f-f327-4488-b99c-bf59f73318a1 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:14.344489 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65c43c9f-f327-4488-b99c-bf59f73318a1 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:14.346322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65c43c9f-f327-4488-b99c-bf59f73318a1 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:14.348106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65c43c9f-f327-4488-b99c-bf59f73318a1 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:14.349448 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65c43c9f-f327-4488-b99c-bf59f73318a1 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:14.356319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65c43c9f-f327-4488-b99c-bf59f73318a1 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:14.416195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c8e0deef-7675-4ed8-8010-b8c8b9b389c0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:14.438261 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c8e0deef-7675-4ed8-8010-b8c8b9b389c0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.379998 Sep 07 12:51:14.447286 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2040/4123] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:14 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:14.483405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-04f34ff2-62b7-49c0-8baa-4a31eb8a1a3c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:14.492001 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-04f34ff2-62b7-49c0-8baa-4a31eb8a1a3c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 0d9852ef-ef6c-475d-b18b-a5b03710d38d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:14.504298 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-04f34ff2-62b7-49c0-8baa-4a31eb8a1a3c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Instance 0d9852ef-ef6c-475d-b18b-a5b03710d38d could not be found. Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-04f34ff2-62b7-49c0-8baa-4a31eb8a1a3c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/0d9852ef-ef6c-475d-b18b-a5b03710d38d/action HTTP/1.1 Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 28 Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: {"reboot": {"type": "SOFT"}} Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 0d9852ef-ef6c-475d-b18b-a5b03710d38d could not be found. Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '0d9852ef-ef6c-475d-b18b-a5b03710d38d', 'body': {'reboot': {'type': 'SOFT'}}} Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d9852ef-ef6c-475d-b18b-a5b03710d38d could not be found. Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d9852ef-ef6c-475d-b18b-a5b03710d38d could not be found. Sep 07 12:51:14.508567 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:14.519363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:14.519363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:14.519363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:14.519363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:14.519363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:14.519363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:51:14.519363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:51:14.519363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d9852ef-ef6c-475d-b18b-a5b03710d38d could not be found. Sep 07 12:51:14.519363 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:14.537303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-04f34ff2-62b7-49c0-8baa-4a31eb8a1a3c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 404 to user: Instance 0d9852ef-ef6c-475d-b18b-a5b03710d38d could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:51:14.545668 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-04f34ff2-62b7-49c0-8baa-4a31eb8a1a3c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers/0d9852ef-ef6c-475d-b18b-a5b03710d38d/action" status: 404 len: 111 microversion: 2.1 time: 0.072937 Sep 07 12:51:14.547544 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2041/4124] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:14 2022] POST /compute/v2.1/servers/0d9852ef-ef6c-475d-b18b-a5b03710d38d/action => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:51:14.569046 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a50dadf9-2b18-41ad-8109-511f8725287e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:14.572257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a50dadf9-2b18-41ad-8109-511f8725287e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:14.594853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a50dadf9-2b18-41ad-8109-511f8725287e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:14.595306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a50dadf9-2b18-41ad-8109-511f8725287e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:14.595768 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a50dadf9-2b18-41ad-8109-511f8725287e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:14.596526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a50dadf9-2b18-41ad-8109-511f8725287e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:14.597005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a50dadf9-2b18-41ad-8109-511f8725287e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:14.597711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a50dadf9-2b18-41ad-8109-511f8725287e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:14.890667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-65c43c9f-f327-4488-b99c-bf59f73318a1 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:14.909627 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-65c43c9f-f327-4488-b99c-bf59f73318a1 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0" status: 200 len: 1511 microversion: 2.1 time: 0.595852 Sep 07 12:51:14.929754 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2084/4125] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:14 2022] GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0 => generated 1511 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:14.961258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-175924ff-cb07-4079-88ec-441ed81811da tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:14.973245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-175924ff-cb07-4079-88ec-441ed81811da tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 290d9a42-9d80-495f-8e45-879687fea820] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:14.988058 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-175924ff-cb07-4079-88ec-441ed81811da tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:14.988900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-175924ff-cb07-4079-88ec-441ed81811da tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:14.989669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-175924ff-cb07-4079-88ec-441ed81811da tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:14.990678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-175924ff-cb07-4079-88ec-441ed81811da tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:14.991336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-175924ff-cb07-4079-88ec-441ed81811da tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:14.992204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-175924ff-cb07-4079-88ec-441ed81811da tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:15.027277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a50dadf9-2b18-41ad-8109-511f8725287e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:15.061626 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a50dadf9-2b18-41ad-8109-511f8725287e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.504857 Sep 07 12:51:15.062812 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2042/4126] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:14 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:15.116780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a71603db-fe6a-4f23-832e-736a53d87b36 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:15.119300 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a71603db-fe6a-4f23-832e-736a53d87b36 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:15.132308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a71603db-fe6a-4f23-832e-736a53d87b36 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:15.133197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a71603db-fe6a-4f23-832e-736a53d87b36 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:15.134091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a71603db-fe6a-4f23-832e-736a53d87b36 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:15.135441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a71603db-fe6a-4f23-832e-736a53d87b36 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:15.136343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a71603db-fe6a-4f23-832e-736a53d87b36 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:15.137276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a71603db-fe6a-4f23-832e-736a53d87b36 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:15.477127 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-175924ff-cb07-4079-88ec-441ed81811da tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:15.509782 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-175924ff-cb07-4079-88ec-441ed81811da tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/290d9a42-9d80-495f-8e45-879687fea820" status: 200 len: 1510 microversion: 2.1 time: 0.558871 Sep 07 12:51:15.516520 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2085/4127] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:14 2022] GET /compute/v2.1/servers/290d9a42-9d80-495f-8e45-879687fea820 => generated 1510 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:15.522305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1885aa84-a02e-4ed0-9841-36c7ed8ba1ab tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:15.525895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1885aa84-a02e-4ed0-9841-36c7ed8ba1ab tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:15.544913 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1885aa84-a02e-4ed0-9841-36c7ed8ba1ab tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:15.545907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1885aa84-a02e-4ed0-9841-36c7ed8ba1ab tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:15.546997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1885aa84-a02e-4ed0-9841-36c7ed8ba1ab tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:15.548107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1885aa84-a02e-4ed0-9841-36c7ed8ba1ab tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:15.549723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1885aa84-a02e-4ed0-9841-36c7ed8ba1ab tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:15.550412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1885aa84-a02e-4ed0-9841-36c7ed8ba1ab tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:15.580029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a71603db-fe6a-4f23-832e-736a53d87b36 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:15.601939 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a71603db-fe6a-4f23-832e-736a53d87b36 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.491221 Sep 07 12:51:15.603886 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2043/4128] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:15 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:15.610493 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c12d3ec4-cff5-49f2-9b68-96a9a7b80345 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:15.613602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c12d3ec4-cff5-49f2-9b68-96a9a7b80345 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:15.620963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c12d3ec4-cff5-49f2-9b68-96a9a7b80345 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:15.621829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c12d3ec4-cff5-49f2-9b68-96a9a7b80345 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:15.622505 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c12d3ec4-cff5-49f2-9b68-96a9a7b80345 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:15.623419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c12d3ec4-cff5-49f2-9b68-96a9a7b80345 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:15.623881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c12d3ec4-cff5-49f2-9b68-96a9a7b80345 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:15.624307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c12d3ec4-cff5-49f2-9b68-96a9a7b80345 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:15.762688 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c12d3ec4-cff5-49f2-9b68-96a9a7b80345 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action" status: 200 len: 8208 microversion: 2.1 time: 0.155265 Sep 07 12:51:15.764117 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2044/4129] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:15 2022] POST /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef/action => generated 8208 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:15.776157 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f5da706e-7d14-490f-9aa5-c1ed63fbbe2b tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:15.777346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f5da706e-7d14-490f-9aa5-c1ed63fbbe2b tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 99bf1197-df2d-4baa-adbe-dc0032977a9c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:15.788594 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5da706e-7d14-490f-9aa5-c1ed63fbbe2b tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:15.789454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5da706e-7d14-490f-9aa5-c1ed63fbbe2b tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:15.790194 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5da706e-7d14-490f-9aa5-c1ed63fbbe2b tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:15.791503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5da706e-7d14-490f-9aa5-c1ed63fbbe2b tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:15.792314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5da706e-7d14-490f-9aa5-c1ed63fbbe2b tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:15.793252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5da706e-7d14-490f-9aa5-c1ed63fbbe2b tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:16.127445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1885aa84-a02e-4ed0-9841-36c7ed8ba1ab tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:16.154029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1885aa84-a02e-4ed0-9841-36c7ed8ba1ab tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:16.162571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1885aa84-a02e-4ed0-9841-36c7ed8ba1ab tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:16.167345 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1885aa84-a02e-4ed0-9841-36c7ed8ba1ab tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.647250 Sep 07 12:51:16.185943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f5da706e-7d14-490f-9aa5-c1ed63fbbe2b tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:16.187050 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2086/4130] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:15 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:51:16.206493 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f5da706e-7d14-490f-9aa5-c1ed63fbbe2b tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c" status: 200 len: 1511 microversion: 2.1 time: 0.439487 Sep 07 12:51:16.208114 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2045/4131] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:15 2022] GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c => generated 1511 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:16.218495 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e90e8a74-c3e0-4cfa-bd5f-6069b0d974bd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:16.220691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e90e8a74-c3e0-4cfa-bd5f-6069b0d974bd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:16.230326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-18226d45-d903-48d0-86cc-aac6242cf1ea tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:16.239862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-18226d45-d903-48d0-86cc-aac6242cf1ea tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 0f92440f-8b32-4731-8383-d9e57e575ae7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:16.259374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e90e8a74-c3e0-4cfa-bd5f-6069b0d974bd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:16.261242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e90e8a74-c3e0-4cfa-bd5f-6069b0d974bd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:16.261629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18226d45-d903-48d0-86cc-aac6242cf1ea tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:16.262832 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18226d45-d903-48d0-86cc-aac6242cf1ea tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:16.264467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e90e8a74-c3e0-4cfa-bd5f-6069b0d974bd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:16.265009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18226d45-d903-48d0-86cc-aac6242cf1ea tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:16.266027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18226d45-d903-48d0-86cc-aac6242cf1ea tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:16.269048 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18226d45-d903-48d0-86cc-aac6242cf1ea tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:16.269513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e90e8a74-c3e0-4cfa-bd5f-6069b0d974bd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:16.271020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18226d45-d903-48d0-86cc-aac6242cf1ea tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:16.272207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e90e8a74-c3e0-4cfa-bd5f-6069b0d974bd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:16.273995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e90e8a74-c3e0-4cfa-bd5f-6069b0d974bd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:16.301028 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-18226d45-d903-48d0-86cc-aac6242cf1ea tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-18226d45-d903-48d0-86cc-aac6242cf1ea tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7/action HTTP/1.1 Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 65 Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: {"rebuild": {"imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f"}} Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '0f92440f-8b32-4731-8383-d9e57e575ae7', 'body': {'rebuild': {'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f'}}} Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 07 12:51:16.304129 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 07 12:51:16.309422 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 07 12:51:16.309422 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:51:16.309422 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:51:16.309422 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:51:16.309422 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:51:16.309422 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. Sep 07 12:51:16.309422 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:16.309422 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:16.309422 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:16.309422 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:16.309422 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:16.309422 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:16.309422 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:51:16.309422 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:51:16.309422 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. Sep 07 12:51:16.309422 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:16.312973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-18226d45-d903-48d0-86cc-aac6242cf1ea tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 404 to user: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:51:16.314199 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-18226d45-d903-48d0-86cc-aac6242cf1ea tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7/action" status: 404 len: 111 microversion: 2.1 time: 0.098254 Sep 07 12:51:16.314977 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2087/4132] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:16 2022] POST /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7/action => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:51:16.321222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8202a77a-f4cf-42f1-978d-c91243a925a0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:16.327981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8202a77a-f4cf-42f1-978d-c91243a925a0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:16.329265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8202a77a-f4cf-42f1-978d-c91243a925a0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Searching by: {'ip': '172.20.0.9', 'deleted': False, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:51:16.765642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8202a77a-f4cf-42f1-978d-c91243a925a0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:16.766722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8202a77a-f4cf-42f1-978d-c91243a925a0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:16.766962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8202a77a-f4cf-42f1-978d-c91243a925a0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:16.768574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8202a77a-f4cf-42f1-978d-c91243a925a0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:16.771634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8202a77a-f4cf-42f1-978d-c91243a925a0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:16.772569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8202a77a-f4cf-42f1-978d-c91243a925a0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:16.873350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e90e8a74-c3e0-4cfa-bd5f-6069b0d974bd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:16.903297 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e90e8a74-c3e0-4cfa-bd5f-6069b0d974bd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.688173 Sep 07 12:51:16.904512 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2046/4133] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:16 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:16.916054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8551dae4-1ce1-477a-bc9d-b5adf3501725 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:16.931841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8551dae4-1ce1-477a-bc9d-b5adf3501725 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:16.947696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8551dae4-1ce1-477a-bc9d-b5adf3501725 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:16.951388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8551dae4-1ce1-477a-bc9d-b5adf3501725 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:16.951865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8551dae4-1ce1-477a-bc9d-b5adf3501725 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:16.952844 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8551dae4-1ce1-477a-bc9d-b5adf3501725 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:16.953332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8551dae4-1ce1-477a-bc9d-b5adf3501725 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:16.953927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8551dae4-1ce1-477a-bc9d-b5adf3501725 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:17.037417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-8202a77a-f4cf-42f1-978d-c91243a925a0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:51:17.186584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8551dae4-1ce1-477a-bc9d-b5adf3501725 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:17.197068 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8202a77a-f4cf-42f1-978d-c91243a925a0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers?ip=172.20.0.9" status: 200 len: 346 microversion: 2.1 time: 0.880098 Sep 07 12:51:17.198680 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2088/4134] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Sep 7 12:51:16 2022] GET /compute/v2.1/servers?ip=172.20.0.9 => generated 346 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:51:17.200131 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8551dae4-1ce1-477a-bc9d-b5adf3501725 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.290764 Sep 07 12:51:17.213864 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2047/4135] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:16 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:17.218091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8a2fd44b-406a-47d1-8dc9-1fedcf2e522b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:17.219430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8a2fd44b-406a-47d1-8dc9-1fedcf2e522b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:17.229018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6498178c-c815-4622-b7ab-9e0a83dfefb5 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:17.229707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6498178c-c815-4622-b7ab-9e0a83dfefb5 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:17.235877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a2fd44b-406a-47d1-8dc9-1fedcf2e522b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:17.238138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a2fd44b-406a-47d1-8dc9-1fedcf2e522b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:17.238138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a2fd44b-406a-47d1-8dc9-1fedcf2e522b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:17.238852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6498178c-c815-4622-b7ab-9e0a83dfefb5 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:17.239695 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6498178c-c815-4622-b7ab-9e0a83dfefb5 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:17.240456 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6498178c-c815-4622-b7ab-9e0a83dfefb5 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:17.242161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6498178c-c815-4622-b7ab-9e0a83dfefb5 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:17.242804 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6498178c-c815-4622-b7ab-9e0a83dfefb5 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:17.243256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a2fd44b-406a-47d1-8dc9-1fedcf2e522b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:17.243488 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6498178c-c815-4622-b7ab-9e0a83dfefb5 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:17.245187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a2fd44b-406a-47d1-8dc9-1fedcf2e522b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:17.246918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a2fd44b-406a-47d1-8dc9-1fedcf2e522b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:17.275879 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:17.711290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8a2fd44b-406a-47d1-8dc9-1fedcf2e522b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:17.733260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6498178c-c815-4622-b7ab-9e0a83dfefb5 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:17.746468 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8a2fd44b-406a-47d1-8dc9-1fedcf2e522b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.545664 Sep 07 12:51:17.747133 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2089/4136] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:17 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:17.751047 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6498178c-c815-4622-b7ab-9e0a83dfefb5 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0" status: 200 len: 1511 microversion: 2.1 time: 0.534461 Sep 07 12:51:17.752033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-13120dbc-9cd7-48c2-b9e9-4d9871f2bcad tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:17.752920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-13120dbc-9cd7-48c2-b9e9-4d9871f2bcad tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:17.753621 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2048/4137] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:17 2022] GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0 => generated 1511 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:17.763218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7c5bf39b-db38-45a9-9c9d-8b9aefcda53d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:17.764911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7c5bf39b-db38-45a9-9c9d-8b9aefcda53d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:17.777065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c5bf39b-db38-45a9-9c9d-8b9aefcda53d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:17.778394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c5bf39b-db38-45a9-9c9d-8b9aefcda53d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:17.779187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13120dbc-9cd7-48c2-b9e9-4d9871f2bcad tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:17.779989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13120dbc-9cd7-48c2-b9e9-4d9871f2bcad tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:17.780181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13120dbc-9cd7-48c2-b9e9-4d9871f2bcad tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:17.780721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c5bf39b-db38-45a9-9c9d-8b9aefcda53d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:17.780941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13120dbc-9cd7-48c2-b9e9-4d9871f2bcad tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:17.781375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13120dbc-9cd7-48c2-b9e9-4d9871f2bcad tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:17.781845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13120dbc-9cd7-48c2-b9e9-4d9871f2bcad tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:17.783128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c5bf39b-db38-45a9-9c9d-8b9aefcda53d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:17.784258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c5bf39b-db38-45a9-9c9d-8b9aefcda53d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:17.785270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c5bf39b-db38-45a9-9c9d-8b9aefcda53d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:18.209085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7c5bf39b-db38-45a9-9c9d-8b9aefcda53d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:18.221615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-13120dbc-9cd7-48c2-b9e9-4d9871f2bcad tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:18.247530 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7c5bf39b-db38-45a9-9c9d-8b9aefcda53d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.491706 Sep 07 12:51:18.259849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-13120dbc-9cd7-48c2-b9e9-4d9871f2bcad tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:18.263310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-13120dbc-9cd7-48c2-b9e9-4d9871f2bcad tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:18.266054 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-13120dbc-9cd7-48c2-b9e9-4d9871f2bcad tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.517353 Sep 07 12:51:18.267357 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2090/4138] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:17 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:51:18.287561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8b254d07-4c0a-4b32-abbb-5ace936f4f4f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:18.287561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8b254d07-4c0a-4b32-abbb-5ace936f4f4f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 290d9a42-9d80-495f-8e45-879687fea820] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:18.290091 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2049/4139] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:17 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:18.296852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b254d07-4c0a-4b32-abbb-5ace936f4f4f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:18.297926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b254d07-4c0a-4b32-abbb-5ace936f4f4f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:18.299163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b254d07-4c0a-4b32-abbb-5ace936f4f4f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:18.301026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-86b8d85b-687d-470e-9a20-687ee8af20ac tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:18.302178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b254d07-4c0a-4b32-abbb-5ace936f4f4f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:18.303499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b254d07-4c0a-4b32-abbb-5ace936f4f4f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:18.303741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-86b8d85b-687d-470e-9a20-687ee8af20ac tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:18.304731 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b254d07-4c0a-4b32-abbb-5ace936f4f4f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:18.317593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86b8d85b-687d-470e-9a20-687ee8af20ac tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:18.318424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86b8d85b-687d-470e-9a20-687ee8af20ac tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:18.319673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86b8d85b-687d-470e-9a20-687ee8af20ac tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:18.321071 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86b8d85b-687d-470e-9a20-687ee8af20ac tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:18.321633 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86b8d85b-687d-470e-9a20-687ee8af20ac tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:18.322098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86b8d85b-687d-470e-9a20-687ee8af20ac tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:18.762712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-86b8d85b-687d-470e-9a20-687ee8af20ac tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:18.793310 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-86b8d85b-687d-470e-9a20-687ee8af20ac tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.499665 Sep 07 12:51:18.796866 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2050/4140] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:18 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:18.809521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bd1d0ac5-2823-4e58-b56e-44e8f1a108d8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:18.816863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bd1d0ac5-2823-4e58-b56e-44e8f1a108d8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 2fb88186-a32d-44c2-a20d-2693e1d5bbeb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:18.835490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8b254d07-4c0a-4b32-abbb-5ace936f4f4f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:18.842849 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-bd1d0ac5-2823-4e58-b56e-44e8f1a108d8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Instance 2fb88186-a32d-44c2-a20d-2693e1d5bbeb could not be found. Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bd1d0ac5-2823-4e58-b56e-44e8f1a108d8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/2fb88186-a32d-44c2-a20d-2693e1d5bbeb/action HTTP/1.1 Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 65 Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: {"rebuild": {"imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f"}} Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 2fb88186-a32d-44c2-a20d-2693e1d5bbeb could not be found. Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '2fb88186-a32d-44c2-a20d-2693e1d5bbeb', 'body': {'rebuild': {'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f'}}} Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fb88186-a32d-44c2-a20d-2693e1d5bbeb could not be found. Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 07 12:51:18.845851 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:51:18.853995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:51:18.853995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:51:18.853995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:51:18.853995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fb88186-a32d-44c2-a20d-2693e1d5bbeb could not be found. Sep 07 12:51:18.853995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:18.853995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:18.853995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:18.853995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:18.853995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:18.853995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:18.853995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:51:18.853995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:51:18.853995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fb88186-a32d-44c2-a20d-2693e1d5bbeb could not be found. Sep 07 12:51:18.853995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:18.856798 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8b254d07-4c0a-4b32-abbb-5ace936f4f4f tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/290d9a42-9d80-495f-8e45-879687fea820" status: 200 len: 1510 microversion: 2.1 time: 0.578001 Sep 07 12:51:18.858480 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bd1d0ac5-2823-4e58-b56e-44e8f1a108d8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 404 to user: Instance 2fb88186-a32d-44c2-a20d-2693e1d5bbeb could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:51:18.859701 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bd1d0ac5-2823-4e58-b56e-44e8f1a108d8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers/2fb88186-a32d-44c2-a20d-2693e1d5bbeb/action" status: 404 len: 111 microversion: 2.1 time: 0.061385 Sep 07 12:51:18.860555 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2051/4141] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:18 2022] POST /compute/v2.1/servers/2fb88186-a32d-44c2-a20d-2693e1d5bbeb/action => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:51:18.867063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8fecd421-f425-478d-86fb-330e46f73d54 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:18.868401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8fecd421-f425-478d-86fb-330e46f73d54 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:18.877172 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2091/4142] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:18 2022] GET /compute/v2.1/servers/290d9a42-9d80-495f-8e45-879687fea820 => generated 1510 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:18.889133 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fecd421-f425-478d-86fb-330e46f73d54 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:18.895881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f3dd8202-94a0-4064-ac1b-0e259478d12f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:18.897967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f3dd8202-94a0-4064-ac1b-0e259478d12f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:18.898289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fecd421-f425-478d-86fb-330e46f73d54 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:18.898524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fecd421-f425-478d-86fb-330e46f73d54 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:18.899293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fecd421-f425-478d-86fb-330e46f73d54 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:18.899776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fecd421-f425-478d-86fb-330e46f73d54 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:18.900202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8fecd421-f425-478d-86fb-330e46f73d54 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:18.958082 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3dd8202-94a0-4064-ac1b-0e259478d12f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:18.965866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3dd8202-94a0-4064-ac1b-0e259478d12f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:18.980071 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3dd8202-94a0-4064-ac1b-0e259478d12f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:18.981538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3dd8202-94a0-4064-ac1b-0e259478d12f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:18.987442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3dd8202-94a0-4064-ac1b-0e259478d12f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:18.988347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3dd8202-94a0-4064-ac1b-0e259478d12f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:19.147449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:19.424320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8fecd421-f425-478d-86fb-330e46f73d54 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:19.435313 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8fecd421-f425-478d-86fb-330e46f73d54 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.573162 Sep 07 12:51:19.445671 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2052/4143] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:18 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:19.445671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4886c455-f33f-4544-be8a-2b9881a6e0ba tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:19.445671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4886c455-f33f-4544-be8a-2b9881a6e0ba tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 99bf1197-df2d-4baa-adbe-dc0032977a9c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:19.462623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4886c455-f33f-4544-be8a-2b9881a6e0ba tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:19.463109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4886c455-f33f-4544-be8a-2b9881a6e0ba tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:19.463545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4886c455-f33f-4544-be8a-2b9881a6e0ba tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:19.464786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4886c455-f33f-4544-be8a-2b9881a6e0ba tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:19.465575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4886c455-f33f-4544-be8a-2b9881a6e0ba tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:19.466020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4886c455-f33f-4544-be8a-2b9881a6e0ba tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:19.524601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f3dd8202-94a0-4064-ac1b-0e259478d12f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:19.535475 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f3dd8202-94a0-4064-ac1b-0e259478d12f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.656787 Sep 07 12:51:19.536238 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2092/4144] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:18 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:19.542463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-368aa33c-0cf2-4ae2-b646-f425e294739d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:19.543470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-368aa33c-0cf2-4ae2-b646-f425e294739d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:19.551551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-368aa33c-0cf2-4ae2-b646-f425e294739d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:19.552426 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-368aa33c-0cf2-4ae2-b646-f425e294739d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:19.553081 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-368aa33c-0cf2-4ae2-b646-f425e294739d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:19.554406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-368aa33c-0cf2-4ae2-b646-f425e294739d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:19.555094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-368aa33c-0cf2-4ae2-b646-f425e294739d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:19.555759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-368aa33c-0cf2-4ae2-b646-f425e294739d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:20.166854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4886c455-f33f-4544-be8a-2b9881a6e0ba tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:20.177326 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4886c455-f33f-4544-be8a-2b9881a6e0ba tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c" status: 200 len: 1511 microversion: 2.1 time: 0.739002 Sep 07 12:51:20.178266 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2053/4145] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:19 2022] GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c => generated 1511 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:20.205698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-452e0308-e384-4380-a0f1-bd19f9429aa0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:20.209984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-452e0308-e384-4380-a0f1-bd19f9429aa0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:20.218782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-452e0308-e384-4380-a0f1-bd19f9429aa0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:20.219483 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-452e0308-e384-4380-a0f1-bd19f9429aa0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:20.220090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-452e0308-e384-4380-a0f1-bd19f9429aa0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:20.220995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-452e0308-e384-4380-a0f1-bd19f9429aa0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:20.221653 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-452e0308-e384-4380-a0f1-bd19f9429aa0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:20.222284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-452e0308-e384-4380-a0f1-bd19f9429aa0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:20.269632 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-368aa33c-0cf2-4ae2-b646-f425e294739d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:20.293202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-368aa33c-0cf2-4ae2-b646-f425e294739d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:20.304018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-368aa33c-0cf2-4ae2-b646-f425e294739d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:20.314601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-452e0308-e384-4380-a0f1-bd19f9429aa0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Locking {{(pid=122432) lock /opt/stack/nova/nova/compute/api.py:4845}} Sep 07 12:51:20.315948 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-368aa33c-0cf2-4ae2-b646-f425e294739d tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.778028 Sep 07 12:51:20.316845 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2093/4146] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:19 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:51:20.333209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9570bacd-b18b-4217-94ab-047d4d4b5cac tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:20.342299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9570bacd-b18b-4217-94ab-047d4d4b5cac tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:20.374117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9570bacd-b18b-4217-94ab-047d4d4b5cac tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:20.374993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9570bacd-b18b-4217-94ab-047d4d4b5cac tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:20.375819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9570bacd-b18b-4217-94ab-047d4d4b5cac tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:20.377143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9570bacd-b18b-4217-94ab-047d4d4b5cac tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:20.378079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9570bacd-b18b-4217-94ab-047d4d4b5cac tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:20.388864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9570bacd-b18b-4217-94ab-047d4d4b5cac tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:20.399023 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-452e0308-e384-4380-a0f1-bd19f9429aa0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action" status: 202 len: 0 microversion: 2.1 time: 0.199160 Sep 07 12:51:20.409217 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2054/4147] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:20 2022] POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:51:20.416088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-60fc1862-59e4-4a28-a170-6281e6b6b17a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:20.422733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-60fc1862-59e4-4a28-a170-6281e6b6b17a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:20.423611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-60fc1862-59e4-4a28-a170-6281e6b6b17a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Searching by: {'deleted': False, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:51:20.436554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60fc1862-59e4-4a28-a170-6281e6b6b17a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:20.438464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60fc1862-59e4-4a28-a170-6281e6b6b17a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:20.439539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60fc1862-59e4-4a28-a170-6281e6b6b17a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:20.442643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60fc1862-59e4-4a28-a170-6281e6b6b17a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:20.444368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60fc1862-59e4-4a28-a170-6281e6b6b17a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:20.446067 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60fc1862-59e4-4a28-a170-6281e6b6b17a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:20.500186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-60fc1862-59e4-4a28-a170-6281e6b6b17a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:51:20.580887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-60fc1862-59e4-4a28-a170-6281e6b6b17a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:20.591266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60fc1862-59e4-4a28-a170-6281e6b6b17a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:20.591765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60fc1862-59e4-4a28-a170-6281e6b6b17a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:20.592211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60fc1862-59e4-4a28-a170-6281e6b6b17a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:20.664636 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9570bacd-b18b-4217-94ab-047d4d4b5cac tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:20.667415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:20.675946 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9570bacd-b18b-4217-94ab-047d4d4b5cac tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.356847 Sep 07 12:51:20.676557 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2094/4148] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:20 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:20.682430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c11912bf-4b62-4273-9aea-1dae9f35df88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:20.683172 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c11912bf-4b62-4273-9aea-1dae9f35df88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:20.690935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c11912bf-4b62-4273-9aea-1dae9f35df88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:20.691656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c11912bf-4b62-4273-9aea-1dae9f35df88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:20.692816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c11912bf-4b62-4273-9aea-1dae9f35df88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:20.693953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c11912bf-4b62-4273-9aea-1dae9f35df88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:20.694575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c11912bf-4b62-4273-9aea-1dae9f35df88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:20.695143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c11912bf-4b62-4273-9aea-1dae9f35df88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:20.884498 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-60fc1862-59e4-4a28-a170-6281e6b6b17a tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 4515 microversion: 2.1 time: 0.473327 Sep 07 12:51:20.886459 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2055/4149] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:51:20 2022] GET /compute/v2.1/servers/detail => generated 4515 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:20.905297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e2c29980-4d64-4c88-935e-bb958d6e4ed4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-449136968", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "78ae4944-f2f0-4f8e-9307-6de47bdb71d5"}, {"uuid": "74f6f91b-bde8-4d03-a73d-236e18d902ed"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:21.079927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-e2c29980-4d64-4c88-935e-bb958d6e4ed4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] validate_networks() for [('78ae4944-f2f0-4f8e-9307-6de47bdb71d5', None, None, None, None, None), ('74f6f91b-bde8-4d03-a73d-236e18d902ed', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:51:21.115983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c11912bf-4b62-4273-9aea-1dae9f35df88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:21.158626 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c11912bf-4b62-4273-9aea-1dae9f35df88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.480573 Sep 07 12:51:21.170636 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2095/4150] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:20 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:21.184282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a3e9be20-f244-4fd3-8686-c1d5edf3a25f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:21.184832 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a3e9be20-f244-4fd3-8686-c1d5edf3a25f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 8255ad4d-01f2-43df-af7c-a90ac6e0fcd9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:21.202799 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-a3e9be20-f244-4fd3-8686-c1d5edf3a25f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Instance 8255ad4d-01f2-43df-af7c-a90ac6e0fcd9 could not be found. Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a3e9be20-f244-4fd3-8686-c1d5edf3a25f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/8255ad4d-01f2-43df-af7c-a90ac6e0fcd9/action HTTP/1.1 Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 15 Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: {"restore": {}} Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 8255ad4d-01f2-43df-af7c-a90ac6e0fcd9 could not be found. Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '8255ad4d-01f2-43df-af7c-a90ac6e0fcd9', 'body': {'restore': {}}} Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8255ad4d-01f2-43df-af7c-a90ac6e0fcd9 could not be found. Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8255ad4d-01f2-43df-af7c-a90ac6e0fcd9 could not be found. Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:21.204449 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:21.207412 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:51:21.207412 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:51:21.207412 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8255ad4d-01f2-43df-af7c-a90ac6e0fcd9 could not be found. Sep 07 12:51:21.207412 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:21.207412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a3e9be20-f244-4fd3-8686-c1d5edf3a25f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 404 to user: Instance 8255ad4d-01f2-43df-af7c-a90ac6e0fcd9 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:51:21.207412 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a3e9be20-f244-4fd3-8686-c1d5edf3a25f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers/8255ad4d-01f2-43df-af7c-a90ac6e0fcd9/action" status: 404 len: 111 microversion: 2.1 time: 0.028360 Sep 07 12:51:21.207412 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2096/4151] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:21 2022] POST /compute/v2.1/servers/8255ad4d-01f2-43df-af7c-a90ac6e0fcd9/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:51:21.213915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-57da1236-11e7-4274-babb-141ba385f563 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:21.222441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-57da1236-11e7-4274-babb-141ba385f563 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:21.223023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-57da1236-11e7-4274-babb-141ba385f563 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:51:21.565271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57da1236-11e7-4274-babb-141ba385f563 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:21.566205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57da1236-11e7-4274-babb-141ba385f563 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:21.567049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57da1236-11e7-4274-babb-141ba385f563 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:21.568838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57da1236-11e7-4274-babb-141ba385f563 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:21.570493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57da1236-11e7-4274-babb-141ba385f563 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:21.571451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-57da1236-11e7-4274-babb-141ba385f563 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:21.643182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-57da1236-11e7-4274-babb-141ba385f563 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:51:21.725907 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-57da1236-11e7-4274-babb-141ba385f563 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.517224 Sep 07 12:51:21.727088 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2097/4152] 10.222.0.16 () {58 vars in 1150 bytes} [Wed Sep 7 12:51:21 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:21.741632 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4255ffee-a519-4fb2-9e1a-9a272342314a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:21.756419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4255ffee-a519-4fb2-9e1a-9a272342314a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:21.757579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4255ffee-a519-4fb2-9e1a-9a272342314a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:21.759010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4255ffee-a519-4fb2-9e1a-9a272342314a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:21.818621 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-4255ffee-a519-4fb2-9e1a-9a272342314a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] HTTP exception thrown: Instance edf38c92-ffc2-492b-8642-88ca59537acd is locked Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4255ffee-a519-4fb2-9e1a-9a272342314a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Request method failure captured: Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action HTTP/1.1 Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 15 Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJIYLgiUrD1FdG9a7jmdNUMsZflZ3IWVyV8jqJSyV7T-w7h1XqCWsHPlozQTxQ2SU2jPLptx_fK_PvA-9nGk2l4mDj334XTiP3wjCP9pCC7M8WLyWD7z_wyZ-hqyLowt8RL_r5UCBhe13xhmSDGs-ilkA2aO2hODHauJwGHwZVM1f9E Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: af1de494abea4aa7841c00fb199e8aec Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerActionsTestJSON-835038512 Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/af1de494abea4aa7841c00fb199e8aec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_af1de494abea4aa7841c00fb199e8aec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/af1de494abea4aa7841c00fb199e8aec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/af1de494abea4aa7841c00fb199e8aec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerActionsTestJSON-835038512 Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: af1de494abea4aa7841c00fb199e8aec Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerActionsTestJSON-835038512 Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerActionsTestJSON-835038512-project Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 22ec4509710f446d843f6882120c5d6e Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerActionsTestJSON-835038512-project Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: {"os-stop": {}} Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance edf38c92-ffc2-492b-8642-88ca59537acd is locked Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'edf38c92-ffc2-492b-8642-88ca59537acd', 'body': {'os-stop': {}}} Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance edf38c92-ffc2-492b-8642-88ca59537acd is locked Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance edf38c92-ffc2-492b-8642-88ca59537acd is locked Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edf38c92-ffc2-492b-8642-88ca59537acd is locked Sep 07 12:51:21.821809 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:21.833453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4255ffee-a519-4fb2-9e1a-9a272342314a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Returning 409 to user: Instance edf38c92-ffc2-492b-8642-88ca59537acd is locked {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:51:21.833911 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4255ffee-a519-4fb2-9e1a-9a272342314a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action" status: 409 len: 107 microversion: 2.1 time: 0.103772 Sep 07 12:51:21.835636 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2098/4153] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:21 2022] POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action => generated 107 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:51:21.848242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-53325de5-1c61-47f4-aef8-30871c2946fb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:21.850638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-53325de5-1c61-47f4-aef8-30871c2946fb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:21.865428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53325de5-1c61-47f4-aef8-30871c2946fb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:21.866829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53325de5-1c61-47f4-aef8-30871c2946fb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:21.867909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53325de5-1c61-47f4-aef8-30871c2946fb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:21.869753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53325de5-1c61-47f4-aef8-30871c2946fb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:21.870928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53325de5-1c61-47f4-aef8-30871c2946fb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:21.872013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53325de5-1c61-47f4-aef8-30871c2946fb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:22.203427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-53325de5-1c61-47f4-aef8-30871c2946fb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:22.216454 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-53325de5-1c61-47f4-aef8-30871c2946fb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.377587 Sep 07 12:51:22.219338 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2099/4154] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:21 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:22.231019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b66c38a9-9978-4537-b671-8d558fa944c7 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:22.232737 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b66c38a9-9978-4537-b671-8d558fa944c7 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:22.245337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b66c38a9-9978-4537-b671-8d558fa944c7 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:22.246998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b66c38a9-9978-4537-b671-8d558fa944c7 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:22.248210 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b66c38a9-9978-4537-b671-8d558fa944c7 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:22.250013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b66c38a9-9978-4537-b671-8d558fa944c7 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:22.251204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b66c38a9-9978-4537-b671-8d558fa944c7 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:22.252564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b66c38a9-9978-4537-b671-8d558fa944c7 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:23.241683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e2c29980-4d64-4c88-935e-bb958d6e4ed4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:51:23.243318 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e2c29980-4d64-4c88-935e-bb958d6e4ed4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:51:23.244727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e2c29980-4d64-4c88-935e-bb958d6e4ed4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:51:23.245473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e2c29980-4d64-4c88-935e-bb958d6e4ed4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:51:23.246312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e2c29980-4d64-4c88-935e-bb958d6e4ed4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:51:23.259916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b66c38a9-9978-4537-b671-8d558fa944c7 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:23.273259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2c29980-4d64-4c88-935e-bb958d6e4ed4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:23.274180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2c29980-4d64-4c88-935e-bb958d6e4ed4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:23.275122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2c29980-4d64-4c88-935e-bb958d6e4ed4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:23.276452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2c29980-4d64-4c88-935e-bb958d6e4ed4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:23.277294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2c29980-4d64-4c88-935e-bb958d6e4ed4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:23.278123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2c29980-4d64-4c88-935e-bb958d6e4ed4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:23.289702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b66c38a9-9978-4537-b671-8d558fa944c7 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:23.293749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b66c38a9-9978-4537-b671-8d558fa944c7 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:23.296824 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b66c38a9-9978-4537-b671-8d558fa944c7 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 1.075140 Sep 07 12:51:23.311391 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2100/4155] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:22 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:51:23.311391 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-267d1a02-885d-47cc-a20a-26c9dbbd51e4 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:23.319325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-e2c29980-4d64-4c88-935e-bb958d6e4ed4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Getting quotas for project 55ea9c8446d545d1ae1bd49f67d6008b. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:51:23.323743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-267d1a02-885d-47cc-a20a-26c9dbbd51e4 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:23.325782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-267d1a02-885d-47cc-a20a-26c9dbbd51e4 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:51:23.327044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-e2c29980-4d64-4c88-935e-bb958d6e4ed4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Getting quotas for user 73853219b29241269ce4bb94155b204e and project 55ea9c8446d545d1ae1bd49f67d6008b. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:51:23.343607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e2c29980-4d64-4c88-935e-bb958d6e4ed4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:51:23.346347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e2c29980-4d64-4c88-935e-bb958d6e4ed4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:51:23.350516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-267d1a02-885d-47cc-a20a-26c9dbbd51e4 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:23.354243 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-267d1a02-885d-47cc-a20a-26c9dbbd51e4 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:23.355100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-267d1a02-885d-47cc-a20a-26c9dbbd51e4 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:23.358999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-267d1a02-885d-47cc-a20a-26c9dbbd51e4 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:23.360148 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-267d1a02-885d-47cc-a20a-26c9dbbd51e4 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:23.361869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-267d1a02-885d-47cc-a20a-26c9dbbd51e4 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:23.400690 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e2c29980-4d64-4c88-935e-bb958d6e4ed4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.512213 Sep 07 12:51:23.401362 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2056/4156] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:51:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:51:23.424958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-66489006-71c8-47ec-8fa0-060686cfbfc3 req-36bec2fc-5f85-45ec-8a5d-0e3d49e9ab8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9352ac2-475e-4c77-aa85-5ecd566563b2", "name": "network-vif-plugged", "status": "completed", "tag": "2d928931-3783-4efe-a479-33f49c27cfb9"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:23.448794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-66489006-71c8-47ec-8fa0-060686cfbfc3 req-36bec2fc-5f85-45ec-8a5d-0e3d49e9ab8f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:23.449979 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-66489006-71c8-47ec-8fa0-060686cfbfc3 req-36bec2fc-5f85-45ec-8a5d-0e3d49e9ab8f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:23.451260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-66489006-71c8-47ec-8fa0-060686cfbfc3 req-36bec2fc-5f85-45ec-8a5d-0e3d49e9ab8f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:23.487699 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-66489006-71c8-47ec-8fa0-060686cfbfc3 req-36bec2fc-5f85-45ec-8a5d-0e3d49e9ab8f service nova] Creating event network-vif-plugged:2d928931-3783-4efe-a479-33f49c27cfb9 for instance e9352ac2-475e-4c77-aa85-5ecd566563b2 on n-h2-852087-9 Sep 07 12:51:23.499290 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-66489006-71c8-47ec-8fa0-060686cfbfc3 req-36bec2fc-5f85-45ec-8a5d-0e3d49e9ab8f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095541 Sep 07 12:51:23.500794 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2057/4157] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:51:23.511813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3af69c5d-39da-45dc-a8a8-8882173ee825 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:23.514183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3af69c5d-39da-45dc-a8a8-8882173ee825 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:23.522265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-267d1a02-885d-47cc-a20a-26c9dbbd51e4 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:51:23.528159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3af69c5d-39da-45dc-a8a8-8882173ee825 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:23.529043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3af69c5d-39da-45dc-a8a8-8882173ee825 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:23.529988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3af69c5d-39da-45dc-a8a8-8882173ee825 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:23.531109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3af69c5d-39da-45dc-a8a8-8882173ee825 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:23.531928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3af69c5d-39da-45dc-a8a8-8882173ee825 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:23.533046 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3af69c5d-39da-45dc-a8a8-8882173ee825 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:23.651868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3af69c5d-39da-45dc-a8a8-8882173ee825 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Unlocking {{(pid=122432) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 07 12:51:23.715911 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-267d1a02-885d-47cc-a20a-26c9dbbd51e4 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.414508 Sep 07 12:51:23.716941 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2101/4158] 10.222.0.16 () {58 vars in 1212 bytes} [Wed Sep 7 12:51:23 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:23.726966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-60bc318a-4b93-495e-8d8d-0dac554e20ee tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:23.727407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-60bc318a-4b93-495e-8d8d-0dac554e20ee tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:23.748920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60bc318a-4b93-495e-8d8d-0dac554e20ee tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:23.749541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60bc318a-4b93-495e-8d8d-0dac554e20ee tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:23.750396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60bc318a-4b93-495e-8d8d-0dac554e20ee tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:23.752407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60bc318a-4b93-495e-8d8d-0dac554e20ee tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:23.753959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60bc318a-4b93-495e-8d8d-0dac554e20ee tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:23.756328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60bc318a-4b93-495e-8d8d-0dac554e20ee tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:23.774159 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3af69c5d-39da-45dc-a8a8-8882173ee825 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action" status: 202 len: 0 microversion: 2.1 time: 0.271490 Sep 07 12:51:23.778913 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2058/4159] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:23 2022] POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:51:23.789263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b9f77171-d12b-481c-80fe-780df624c337 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:23.790051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b9f77171-d12b-481c-80fe-780df624c337 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:23.870795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b9f77171-d12b-481c-80fe-780df624c337 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:23.903072 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b9f77171-d12b-481c-80fe-780df624c337 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472" status: 200 len: 1212 microversion: 2.1 time: 0.126016 Sep 07 12:51:23.903694 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2059/4160] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:23 2022] GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 => generated 1212 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:23.914265 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-97cb6181-7068-42df-8eb0-16ac19de6233 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:23.942647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-97cb6181-7068-42df-8eb0-16ac19de6233 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:23.943479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-97cb6181-7068-42df-8eb0-16ac19de6233 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:51:23.970143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97cb6181-7068-42df-8eb0-16ac19de6233 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:23.977016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97cb6181-7068-42df-8eb0-16ac19de6233 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:23.977882 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97cb6181-7068-42df-8eb0-16ac19de6233 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:23.980517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97cb6181-7068-42df-8eb0-16ac19de6233 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:23.983364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97cb6181-7068-42df-8eb0-16ac19de6233 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:23.984127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97cb6181-7068-42df-8eb0-16ac19de6233 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:24.163434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-60bc318a-4b93-495e-8d8d-0dac554e20ee tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:24.177894 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-60bc318a-4b93-495e-8d8d-0dac554e20ee tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.459625 Sep 07 12:51:24.194573 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2102/4161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:23 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:24.200857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e6fb23d1-8a72-4d19-bb5c-d2b59ab44ac4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:24.208112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6fb23d1-8a72-4d19-bb5c-d2b59ab44ac4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:24.208943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6fb23d1-8a72-4d19-bb5c-d2b59ab44ac4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:24.209612 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6fb23d1-8a72-4d19-bb5c-d2b59ab44ac4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:24.241314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e6fb23d1-8a72-4d19-bb5c-d2b59ab44ac4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Going to try to stop instance {{(pid=122433) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 12:51:24.263561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-97cb6181-7068-42df-8eb0-16ac19de6233 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:51:24.307899 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e6fb23d1-8a72-4d19-bb5c-d2b59ab44ac4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action" status: 202 len: 0 microversion: 2.1 time: 0.111296 Sep 07 12:51:24.309828 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2103/4162] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:24 2022] POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:51:24.317132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4193bfba-2117-4669-8d34-05ae8a6a3bf6 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:24.321242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4193bfba-2117-4669-8d34-05ae8a6a3bf6 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:24.334362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4193bfba-2117-4669-8d34-05ae8a6a3bf6 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:24.335245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4193bfba-2117-4669-8d34-05ae8a6a3bf6 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:24.335966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4193bfba-2117-4669-8d34-05ae8a6a3bf6 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:24.336749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4193bfba-2117-4669-8d34-05ae8a6a3bf6 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:24.337256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4193bfba-2117-4669-8d34-05ae8a6a3bf6 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:24.337744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4193bfba-2117-4669-8d34-05ae8a6a3bf6 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:24.370163 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-4193bfba-2117-4669-8d34-05ae8a6a3bf6 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Cannot 'restore' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state active Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4193bfba-2117-4669-8d34-05ae8a6a3bf6 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action HTTP/1.1 Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 15 Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: {"restore": {}} Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: exception: Cannot 'restore' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state active Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860', 'body': {'restore': {}}} Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 in vm_state active. Cannot restore while the instance is in this state. Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state active Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:24.371948 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:24.377587 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:24.377587 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:51:24.377587 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:51:24.377587 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state active Sep 07 12:51:24.377587 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:24.377587 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4193bfba-2117-4669-8d34-05ae8a6a3bf6 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 409 to user: Cannot 'restore' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state active {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:51:24.377587 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4193bfba-2117-4669-8d34-05ae8a6a3bf6 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action" status: 409 len: 145 microversion: 2.1 time: 0.062016 Sep 07 12:51:24.378217 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2104/4163] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:24 2022] POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action => generated 145 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:51:24.383124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6c5d3b91-e446-431c-9685-89a9ddfeabae tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:24.383864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6c5d3b91-e446-431c-9685-89a9ddfeabae tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:24.390744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c5d3b91-e446-431c-9685-89a9ddfeabae tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:24.392063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c5d3b91-e446-431c-9685-89a9ddfeabae tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:24.392063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c5d3b91-e446-431c-9685-89a9ddfeabae tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:24.392468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c5d3b91-e446-431c-9685-89a9ddfeabae tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:24.392940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c5d3b91-e446-431c-9685-89a9ddfeabae tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:24.393372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c5d3b91-e446-431c-9685-89a9ddfeabae tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:24.431768 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-97cb6181-7068-42df-8eb0-16ac19de6233 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.525417 Sep 07 12:51:24.435191 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2060/4164] 10.222.0.16 () {58 vars in 1196 bytes} [Wed Sep 7 12:51:23 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:24.450741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d9863a1b-72bb-497e-8c02-3413f3109e7b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:24.451416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d9863a1b-72bb-497e-8c02-3413f3109e7b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:24.487072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9863a1b-72bb-497e-8c02-3413f3109e7b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:24.489841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9863a1b-72bb-497e-8c02-3413f3109e7b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:24.493748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9863a1b-72bb-497e-8c02-3413f3109e7b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:24.497609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9863a1b-72bb-497e-8c02-3413f3109e7b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:24.499125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9863a1b-72bb-497e-8c02-3413f3109e7b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:24.500142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9863a1b-72bb-497e-8c02-3413f3109e7b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:24.588375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6c5d3b91-e446-431c-9685-89a9ddfeabae tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:24.599251 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6c5d3b91-e446-431c-9685-89a9ddfeabae tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1679 microversion: 2.1 time: 0.219710 Sep 07 12:51:24.599860 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2105/4165] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:24 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1679 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:24.605038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d90da215-8e23-4d5c-aab7-c53aa61cc4b9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:24.607815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d90da215-8e23-4d5c-aab7-c53aa61cc4b9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:24.617104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d90da215-8e23-4d5c-aab7-c53aa61cc4b9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:24.617431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d90da215-8e23-4d5c-aab7-c53aa61cc4b9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:24.618021 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d90da215-8e23-4d5c-aab7-c53aa61cc4b9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:24.618774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d90da215-8e23-4d5c-aab7-c53aa61cc4b9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:24.619304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d90da215-8e23-4d5c-aab7-c53aa61cc4b9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:24.619751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d90da215-8e23-4d5c-aab7-c53aa61cc4b9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:24.913386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d9863a1b-72bb-497e-8c02-3413f3109e7b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:24.927296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d9863a1b-72bb-497e-8c02-3413f3109e7b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:24.929071 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d9863a1b-72bb-497e-8c02-3413f3109e7b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:24.930416 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d9863a1b-72bb-497e-8c02-3413f3109e7b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.493400 Sep 07 12:51:24.931033 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2061/4166] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:24 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:51:24.951892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9c8f573c-c2ea-423b-be6b-1c8438fd55de tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:24.973059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9c8f573c-c2ea-423b-be6b-1c8438fd55de tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:24.978407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9c8f573c-c2ea-423b-be6b-1c8438fd55de tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Searching by: {'name': '2028358869', 'deleted': False, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:51:24.993454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d90da215-8e23-4d5c-aab7-c53aa61cc4b9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:25.000822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c8f573c-c2ea-423b-be6b-1c8438fd55de tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:25.001676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c8f573c-c2ea-423b-be6b-1c8438fd55de tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:25.002412 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c8f573c-c2ea-423b-be6b-1c8438fd55de tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:25.007833 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d90da215-8e23-4d5c-aab7-c53aa61cc4b9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.406755 Sep 07 12:51:25.010137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c8f573c-c2ea-423b-be6b-1c8438fd55de tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:25.011736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c8f573c-c2ea-423b-be6b-1c8438fd55de tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:25.014973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c8f573c-c2ea-423b-be6b-1c8438fd55de tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:25.024764 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2106/4167] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:24 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:25.035561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5f487bd5-8168-4079-83dc-68b32a7d2045 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:25.036728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5f487bd5-8168-4079-83dc-68b32a7d2045 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:25.044850 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f487bd5-8168-4079-83dc-68b32a7d2045 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:25.045827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f487bd5-8168-4079-83dc-68b32a7d2045 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:25.046619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f487bd5-8168-4079-83dc-68b32a7d2045 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:25.047752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f487bd5-8168-4079-83dc-68b32a7d2045 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:25.048805 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f487bd5-8168-4079-83dc-68b32a7d2045 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:25.049813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f487bd5-8168-4079-83dc-68b32a7d2045 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:25.164194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5f487bd5-8168-4079-83dc-68b32a7d2045 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:25.175900 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5f487bd5-8168-4079-83dc-68b32a7d2045 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472" status: 200 len: 1216 microversion: 2.1 time: 0.149770 Sep 07 12:51:25.176791 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2107/4168] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:25 2022] GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 => generated 1216 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:25.183009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-80d90a86-2799-4aff-858d-a8342bff8579 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:25.184865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-80d90a86-2799-4aff-858d-a8342bff8579 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:25.192711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80d90a86-2799-4aff-858d-a8342bff8579 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:25.193525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80d90a86-2799-4aff-858d-a8342bff8579 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:25.194156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80d90a86-2799-4aff-858d-a8342bff8579 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:25.195268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80d90a86-2799-4aff-858d-a8342bff8579 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:25.195927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80d90a86-2799-4aff-858d-a8342bff8579 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:25.197320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80d90a86-2799-4aff-858d-a8342bff8579 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:25.247196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-9c8f573c-c2ea-423b-be6b-1c8438fd55de tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:51:25.255510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:25.377772 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9c8f573c-c2ea-423b-be6b-1c8438fd55de tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers?name=2028358869" status: 200 len: 346 microversion: 2.1 time: 0.433842 Sep 07 12:51:25.390189 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2062/4169] 10.222.0.16 () {58 vars in 1156 bytes} [Wed Sep 7 12:51:24 2022] GET /compute/v2.1/servers?name=2028358869 => generated 346 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:51:25.409055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-12bd7fe6-66ed-4790-81ee-4f0248e075bd tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:25.425800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-12bd7fe6-66ed-4790-81ee-4f0248e075bd tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:25.426059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-12bd7fe6-66ed-4790-81ee-4f0248e075bd tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:51:25.440030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12bd7fe6-66ed-4790-81ee-4f0248e075bd tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:25.440727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12bd7fe6-66ed-4790-81ee-4f0248e075bd tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:25.442024 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12bd7fe6-66ed-4790-81ee-4f0248e075bd tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:25.443051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12bd7fe6-66ed-4790-81ee-4f0248e075bd tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:25.444563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12bd7fe6-66ed-4790-81ee-4f0248e075bd tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:25.444888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12bd7fe6-66ed-4790-81ee-4f0248e075bd tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:25.593108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-80d90a86-2799-4aff-858d-a8342bff8579 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:25.618112 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-80d90a86-2799-4aff-858d-a8342bff8579 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.439897 Sep 07 12:51:25.618714 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2108/4170] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:25 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:25.633601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-9d8aae4f-4c7b-4393-aabb-e05ebbb02ca2 req-bbb956da-641f-4c68-b153-e7832661e427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9352ac2-475e-4c77-aa85-5ecd566563b2", "name": "network-vif-plugged", "status": "completed", "tag": "763b76c0-527c-4cf7-87d0-1d9905756999"}, {"server_uuid": "e9352ac2-475e-4c77-aa85-5ecd566563b2", "name": "network-vif-plugged", "status": "completed", "tag": "6dd24b36-3c01-41dd-97ac-f83db2b44791"}, {"server_uuid": "e9352ac2-475e-4c77-aa85-5ecd566563b2", "name": "network-vif-plugged", "status": "completed", "tag": "acffd0c4-1273-4d97-8465-26984f8e6d9d"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:25.633805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-12bd7fe6-66ed-4790-81ee-4f0248e075bd tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:51:25.652168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9d8aae4f-4c7b-4393-aabb-e05ebbb02ca2 req-bbb956da-641f-4c68-b153-e7832661e427 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:25.653088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9d8aae4f-4c7b-4393-aabb-e05ebbb02ca2 req-bbb956da-641f-4c68-b153-e7832661e427 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:25.653867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9d8aae4f-4c7b-4393-aabb-e05ebbb02ca2 req-bbb956da-641f-4c68-b153-e7832661e427 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:25.694969 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-9d8aae4f-4c7b-4393-aabb-e05ebbb02ca2 req-bbb956da-641f-4c68-b153-e7832661e427 service nova] Creating event network-vif-plugged:763b76c0-527c-4cf7-87d0-1d9905756999 for instance e9352ac2-475e-4c77-aa85-5ecd566563b2 on n-h2-852087-9 Sep 07 12:51:25.695723 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-9d8aae4f-4c7b-4393-aabb-e05ebbb02ca2 req-bbb956da-641f-4c68-b153-e7832661e427 service nova] Creating event network-vif-plugged:6dd24b36-3c01-41dd-97ac-f83db2b44791 for instance e9352ac2-475e-4c77-aa85-5ecd566563b2 on n-h2-852087-9 Sep 07 12:51:25.697032 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-9d8aae4f-4c7b-4393-aabb-e05ebbb02ca2 req-bbb956da-641f-4c68-b153-e7832661e427 service nova] Creating event network-vif-plugged:acffd0c4-1273-4d97-8465-26984f8e6d9d for instance e9352ac2-475e-4c77-aa85-5ecd566563b2 on n-h2-852087-9 Sep 07 12:51:25.709114 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-9d8aae4f-4c7b-4393-aabb-e05ebbb02ca2 req-bbb956da-641f-4c68-b153-e7832661e427 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.088310 Sep 07 12:51:25.710705 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2109/4171] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:51:25.720727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-04fd7d17-af4f-4b62-a457-59f673e87e18 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:25.722003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-04fd7d17-af4f-4b62-a457-59f673e87e18 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:25.735293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04fd7d17-af4f-4b62-a457-59f673e87e18 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:25.736076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04fd7d17-af4f-4b62-a457-59f673e87e18 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:25.737291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04fd7d17-af4f-4b62-a457-59f673e87e18 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:25.738991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04fd7d17-af4f-4b62-a457-59f673e87e18 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:25.740223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04fd7d17-af4f-4b62-a457-59f673e87e18 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:25.741190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04fd7d17-af4f-4b62-a457-59f673e87e18 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:25.838442 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-12bd7fe6-66ed-4790-81ee-4f0248e075bd tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.435010 Sep 07 12:51:25.839545 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2063/4172] 10.222.0.16 () {58 vars in 1154 bytes} [Wed Sep 7 12:51:25 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:25.845447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4651900b-eb61-43a9-a5ff-18ee0fc6f60a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:25.860785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4651900b-eb61-43a9-a5ff-18ee0fc6f60a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 02d0db20-d18c-432d-a02d-297329d598b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:25.879997 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-4651900b-eb61-43a9-a5ff-18ee0fc6f60a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Instance 02d0db20-d18c-432d-a02d-297329d598b2 could not be found. Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4651900b-eb61-43a9-a5ff-18ee0fc6f60a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/02d0db20-d18c-432d-a02d-297329d598b2/action HTTP/1.1 Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 14 Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: {"resume": {}} Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 02d0db20-d18c-432d-a02d-297329d598b2 could not be found. Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '02d0db20-d18c-432d-a02d-297329d598b2', 'body': {'resume': {}}} Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02d0db20-d18c-432d-a02d-297329d598b2 could not be found. Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02d0db20-d18c-432d-a02d-297329d598b2 could not be found. Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:25.900180 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:25.909802 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:51:25.909802 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:51:25.909802 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02d0db20-d18c-432d-a02d-297329d598b2 could not be found. Sep 07 12:51:25.909802 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:25.909802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4651900b-eb61-43a9-a5ff-18ee0fc6f60a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 404 to user: Instance 02d0db20-d18c-432d-a02d-297329d598b2 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:51:25.909802 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4651900b-eb61-43a9-a5ff-18ee0fc6f60a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers/02d0db20-d18c-432d-a02d-297329d598b2/action" status: 404 len: 111 microversion: 2.1 time: 0.061635 Sep 07 12:51:25.909802 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2064/4173] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:25 2022] POST /compute/v2.1/servers/02d0db20-d18c-432d-a02d-297329d598b2/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:51:25.922659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ae474fe5-da08-4780-b059-168de2c5c6f0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:25.934714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ae474fe5-da08-4780-b059-168de2c5c6f0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:25.936268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ae474fe5-da08-4780-b059-168de2c5c6f0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-202835886', 'deleted': False, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:51:25.953614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae474fe5-da08-4780-b059-168de2c5c6f0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:25.954484 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae474fe5-da08-4780-b059-168de2c5c6f0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:25.955165 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae474fe5-da08-4780-b059-168de2c5c6f0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:25.956479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae474fe5-da08-4780-b059-168de2c5c6f0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:25.957261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae474fe5-da08-4780-b059-168de2c5c6f0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:25.958076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae474fe5-da08-4780-b059-168de2c5c6f0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:26.252564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-ae474fe5-da08-4780-b059-168de2c5c6f0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:51:26.374587 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ae474fe5-da08-4780-b059-168de2c5c6f0 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-202835886" status: 200 len: 346 microversion: 2.1 time: 0.459020 Sep 07 12:51:26.376102 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2065/4174] 10.222.0.16 () {58 vars in 1228 bytes} [Wed Sep 7 12:51:25 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-202835886 => generated 346 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:51:26.386799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a351259d-3e94-4525-92ab-6dbf37b0d1fb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:26.389374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a351259d-3e94-4525-92ab-6dbf37b0d1fb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:26.400405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a351259d-3e94-4525-92ab-6dbf37b0d1fb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:26.402050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a351259d-3e94-4525-92ab-6dbf37b0d1fb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:26.405888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a351259d-3e94-4525-92ab-6dbf37b0d1fb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:26.413336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a351259d-3e94-4525-92ab-6dbf37b0d1fb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:26.414339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a351259d-3e94-4525-92ab-6dbf37b0d1fb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:26.415330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a351259d-3e94-4525-92ab-6dbf37b0d1fb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:26.493644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-04fd7d17-af4f-4b62-a457-59f673e87e18 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:26.514488 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-04fd7d17-af4f-4b62-a457-59f673e87e18 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1679 microversion: 2.1 time: 0.801608 Sep 07 12:51:26.516102 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2110/4175] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:25 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1679 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:26.523661 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0d90ef8f-0895-4b09-abef-8a376cdb5a2e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:26.524424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0d90ef8f-0895-4b09-abef-8a376cdb5a2e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:26.537787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d90ef8f-0895-4b09-abef-8a376cdb5a2e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:26.550250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d90ef8f-0895-4b09-abef-8a376cdb5a2e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:26.550905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d90ef8f-0895-4b09-abef-8a376cdb5a2e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:26.552230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d90ef8f-0895-4b09-abef-8a376cdb5a2e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:26.552490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d90ef8f-0895-4b09-abef-8a376cdb5a2e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:26.553269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d90ef8f-0895-4b09-abef-8a376cdb5a2e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:27.014110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0d90ef8f-0895-4b09-abef-8a376cdb5a2e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:27.028921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0d90ef8f-0895-4b09-abef-8a376cdb5a2e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:27.031422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0d90ef8f-0895-4b09-abef-8a376cdb5a2e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:27.033528 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0d90ef8f-0895-4b09-abef-8a376cdb5a2e tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.515826 Sep 07 12:51:27.048607 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2111/4176] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:26 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:51:27.053245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a9f7c317-3061-48db-be47-5c03b5de761b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:27.054513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a9f7c317-3061-48db-be47-5c03b5de761b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:27.061623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a351259d-3e94-4525-92ab-6dbf37b0d1fb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:27.065779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9f7c317-3061-48db-be47-5c03b5de761b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:27.066701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9f7c317-3061-48db-be47-5c03b5de761b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:27.067371 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9f7c317-3061-48db-be47-5c03b5de761b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:27.068895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9f7c317-3061-48db-be47-5c03b5de761b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:27.070292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9f7c317-3061-48db-be47-5c03b5de761b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:27.070996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9f7c317-3061-48db-be47-5c03b5de761b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:27.077268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:27.085629 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a351259d-3e94-4525-92ab-6dbf37b0d1fb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.707609 Sep 07 12:51:27.087026 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2066/4177] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:26 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:27.097014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-61bcf576-8f1b-4fff-9a8e-6b1093c7910c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:27.101339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-61bcf576-8f1b-4fff-9a8e-6b1093c7910c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:27.110560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61bcf576-8f1b-4fff-9a8e-6b1093c7910c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:27.111162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61bcf576-8f1b-4fff-9a8e-6b1093c7910c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:27.111671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61bcf576-8f1b-4fff-9a8e-6b1093c7910c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:27.112458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61bcf576-8f1b-4fff-9a8e-6b1093c7910c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:27.113300 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61bcf576-8f1b-4fff-9a8e-6b1093c7910c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:27.114056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61bcf576-8f1b-4fff-9a8e-6b1093c7910c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:27.147506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-61bcf576-8f1b-4fff-9a8e-6b1093c7910c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lazy-loading 'flavor' on Instance uuid 4b52328c-937b-46cf-abdf-8629194fc25c {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:51:27.163354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a9f7c317-3061-48db-be47-5c03b5de761b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:27.173024 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a9f7c317-3061-48db-be47-5c03b5de761b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472" status: 200 len: 1270 microversion: 2.1 time: 0.131588 Sep 07 12:51:27.186083 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2112/4178] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:27 2022] GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 => generated 1270 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:27.198684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fb47da0e-7a43-4d8d-9005-a0557adb2081 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:27.200285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fb47da0e-7a43-4d8d-9005-a0557adb2081 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 99bf1197-df2d-4baa-adbe-dc0032977a9c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:27.218159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb47da0e-7a43-4d8d-9005-a0557adb2081 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:27.219102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb47da0e-7a43-4d8d-9005-a0557adb2081 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:27.219976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb47da0e-7a43-4d8d-9005-a0557adb2081 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:27.221843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb47da0e-7a43-4d8d-9005-a0557adb2081 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:27.222779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb47da0e-7a43-4d8d-9005-a0557adb2081 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:27.223471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fb47da0e-7a43-4d8d-9005-a0557adb2081 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:27.265185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fb47da0e-7a43-4d8d-9005-a0557adb2081 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 99bf1197-df2d-4baa-adbe-dc0032977a9c] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:51:27.360618 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-61bcf576-8f1b-4fff-9a8e-6b1093c7910c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "POST /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/action" status: 200 len: 32 microversion: 2.1 time: 0.271805 Sep 07 12:51:27.362412 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2067/4179] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:27 2022] POST /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/action => generated 32 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:51:27.386147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bca35753-6406-4bdb-8dc5-10fb864a4a13 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:27.389977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bca35753-6406-4bdb-8dc5-10fb864a4a13 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:27.404240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bca35753-6406-4bdb-8dc5-10fb864a4a13 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:27.404494 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fb47da0e-7a43-4d8d-9005-a0557adb2081 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "DELETE /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c" status: 204 len: 0 microversion: 2.1 time: 0.216615 Sep 07 12:51:27.405009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bca35753-6406-4bdb-8dc5-10fb864a4a13 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:27.405850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bca35753-6406-4bdb-8dc5-10fb864a4a13 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:27.411240 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2113/4180] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:51:27 2022] DELETE /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:51:27.411504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bca35753-6406-4bdb-8dc5-10fb864a4a13 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:27.411504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bca35753-6406-4bdb-8dc5-10fb864a4a13 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:27.411504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bca35753-6406-4bdb-8dc5-10fb864a4a13 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:27.418056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e3de74d4-ec51-4fe4-8405-2f59943fa7d2 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:27.419218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e3de74d4-ec51-4fe4-8405-2f59943fa7d2 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:27.428462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3de74d4-ec51-4fe4-8405-2f59943fa7d2 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:27.429042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3de74d4-ec51-4fe4-8405-2f59943fa7d2 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:27.429859 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3de74d4-ec51-4fe4-8405-2f59943fa7d2 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:27.430674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3de74d4-ec51-4fe4-8405-2f59943fa7d2 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:27.431160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3de74d4-ec51-4fe4-8405-2f59943fa7d2 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:27.431769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3de74d4-ec51-4fe4-8405-2f59943fa7d2 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:27.682838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e3de74d4-ec51-4fe4-8405-2f59943fa7d2 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:27.698719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bca35753-6406-4bdb-8dc5-10fb864a4a13 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:27.699080 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e3de74d4-ec51-4fe4-8405-2f59943fa7d2 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1733 microversion: 2.1 time: 0.290996 Sep 07 12:51:27.700007 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2114/4181] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:27 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1733 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:27.714753 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bca35753-6406-4bdb-8dc5-10fb864a4a13 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.348570 Sep 07 12:51:27.716705 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2068/4182] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:27 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:27.737671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-39a2b4ab-3a1e-43d4-8bf7-c906fbd36c10 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:27.738890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-39a2b4ab-3a1e-43d4-8bf7-c906fbd36c10 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 99bf1197-df2d-4baa-adbe-dc0032977a9c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:27.743337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:27.748868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e340482-cec7-4058-8c1f-e86f61174b0e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:27.751468 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2e340482-cec7-4058-8c1f-e86f61174b0e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:27.757297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39a2b4ab-3a1e-43d4-8bf7-c906fbd36c10 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:27.758225 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39a2b4ab-3a1e-43d4-8bf7-c906fbd36c10 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:27.759039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39a2b4ab-3a1e-43d4-8bf7-c906fbd36c10 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:27.760900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39a2b4ab-3a1e-43d4-8bf7-c906fbd36c10 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:27.761954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39a2b4ab-3a1e-43d4-8bf7-c906fbd36c10 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:27.763012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39a2b4ab-3a1e-43d4-8bf7-c906fbd36c10 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:27.766438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e340482-cec7-4058-8c1f-e86f61174b0e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:27.770027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e340482-cec7-4058-8c1f-e86f61174b0e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:27.770735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e340482-cec7-4058-8c1f-e86f61174b0e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:27.773095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e340482-cec7-4058-8c1f-e86f61174b0e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:27.776214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e340482-cec7-4058-8c1f-e86f61174b0e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:27.776837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e340482-cec7-4058-8c1f-e86f61174b0e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:28.194436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-39a2b4ab-3a1e-43d4-8bf7-c906fbd36c10 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:28.208448 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-39a2b4ab-3a1e-43d4-8bf7-c906fbd36c10 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c" status: 200 len: 1517 microversion: 2.1 time: 0.496767 Sep 07 12:51:28.209284 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2115/4183] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:27 2022] GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c => generated 1517 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:28.232512 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec12b495-9266-4170-b668-43a63bce1aa4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:28.233077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ec12b495-9266-4170-b668-43a63bce1aa4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:28.241296 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec12b495-9266-4170-b668-43a63bce1aa4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:28.242092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec12b495-9266-4170-b668-43a63bce1aa4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:28.242688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec12b495-9266-4170-b668-43a63bce1aa4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:28.243899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec12b495-9266-4170-b668-43a63bce1aa4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:28.244516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec12b495-9266-4170-b668-43a63bce1aa4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:28.244972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec12b495-9266-4170-b668-43a63bce1aa4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:28.245796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2e340482-cec7-4058-8c1f-e86f61174b0e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:28.261027 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2e340482-cec7-4058-8c1f-e86f61174b0e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1679 microversion: 2.1 time: 0.542400 Sep 07 12:51:28.262164 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2069/4184] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:27 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1679 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:28.271760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d6751cc5-9ec2-4ccd-b152-5f254d593bb7 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:28.272952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d6751cc5-9ec2-4ccd-b152-5f254d593bb7 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:28.274548 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-ec12b495-9266-4170-b668-43a63bce1aa4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Cannot 'resume' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state active Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec12b495-9266-4170-b668-43a63bce1aa4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action HTTP/1.1 Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 14 Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: {"resume": {}} Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: exception: Cannot 'resume' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state active Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860', 'body': {'resume': {}}} Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 in vm_state active. Cannot resume while the instance is in this state. Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state active Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:28.276608 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:28.283662 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:28.283662 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:28.283662 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:28.283662 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:51:28.283662 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:51:28.283662 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state active Sep 07 12:51:28.283662 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:28.283662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec12b495-9266-4170-b668-43a63bce1aa4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 409 to user: Cannot 'resume' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state active {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:51:28.283662 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ec12b495-9266-4170-b668-43a63bce1aa4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action" status: 409 len: 144 microversion: 2.1 time: 0.051350 Sep 07 12:51:28.283662 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2116/4185] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:28 2022] POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action => generated 144 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:51:28.287163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9e18f8bb-d2dc-464a-a253-17723cbb4f84 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:28.287163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9e18f8bb-d2dc-464a-a253-17723cbb4f84 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:28.289763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6751cc5-9ec2-4ccd-b152-5f254d593bb7 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:28.290593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6751cc5-9ec2-4ccd-b152-5f254d593bb7 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:28.291623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6751cc5-9ec2-4ccd-b152-5f254d593bb7 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:28.293006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6751cc5-9ec2-4ccd-b152-5f254d593bb7 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:28.293336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e18f8bb-d2dc-464a-a253-17723cbb4f84 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:28.293990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e18f8bb-d2dc-464a-a253-17723cbb4f84 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:28.294177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6751cc5-9ec2-4ccd-b152-5f254d593bb7 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:28.294437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e18f8bb-d2dc-464a-a253-17723cbb4f84 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:28.294761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6751cc5-9ec2-4ccd-b152-5f254d593bb7 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:28.295177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e18f8bb-d2dc-464a-a253-17723cbb4f84 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:28.295646 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e18f8bb-d2dc-464a-a253-17723cbb4f84 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:28.296195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e18f8bb-d2dc-464a-a253-17723cbb4f84 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:28.828340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9e18f8bb-d2dc-464a-a253-17723cbb4f84 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:28.843821 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9e18f8bb-d2dc-464a-a253-17723cbb4f84 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472" status: 200 len: 1312 microversion: 2.1 time: 0.563388 Sep 07 12:51:28.855999 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2117/4186] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:28 2022] GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 => generated 1312 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:28.855999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5d7b78e4-2f84-49c6-8b23-433ff8ce48b9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:28.855999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5d7b78e4-2f84-49c6-8b23-433ff8ce48b9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:28.867991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d7b78e4-2f84-49c6-8b23-433ff8ce48b9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:28.868873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d7b78e4-2f84-49c6-8b23-433ff8ce48b9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:28.869760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d7b78e4-2f84-49c6-8b23-433ff8ce48b9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:28.870982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d7b78e4-2f84-49c6-8b23-433ff8ce48b9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:28.871858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d7b78e4-2f84-49c6-8b23-433ff8ce48b9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:28.872613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d7b78e4-2f84-49c6-8b23-433ff8ce48b9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:28.890494 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d6751cc5-9ec2-4ccd-b152-5f254d593bb7 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:28.907948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d6751cc5-9ec2-4ccd-b152-5f254d593bb7 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:28.910084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d6751cc5-9ec2-4ccd-b152-5f254d593bb7 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:28.911850 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d6751cc5-9ec2-4ccd-b152-5f254d593bb7 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1880 microversion: 2.32 time: 0.647848 Sep 07 12:51:28.912566 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2070/4187] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:28 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1880 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:51:28.922149 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0bbb3c93-cb94-4298-a2cd-2c8d61e13806 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:28.923366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0bbb3c93-cb94-4298-a2cd-2c8d61e13806 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:28.935744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0bbb3c93-cb94-4298-a2cd-2c8d61e13806 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:28.936599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0bbb3c93-cb94-4298-a2cd-2c8d61e13806 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:28.937394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0bbb3c93-cb94-4298-a2cd-2c8d61e13806 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:28.938712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0bbb3c93-cb94-4298-a2cd-2c8d61e13806 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:28.939560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0bbb3c93-cb94-4298-a2cd-2c8d61e13806 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:28.941073 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0bbb3c93-cb94-4298-a2cd-2c8d61e13806 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:29.123609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5d7b78e4-2f84-49c6-8b23-433ff8ce48b9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:29.151546 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5d7b78e4-2f84-49c6-8b23-433ff8ce48b9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.304836 Sep 07 12:51:29.153007 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2118/4188] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:28 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:29.168092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0bbb3c93-cb94-4298-a2cd-2c8d61e13806 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:29.207969 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0bbb3c93-cb94-4298-a2cd-2c8d61e13806 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1733 microversion: 2.1 time: 0.293578 Sep 07 12:51:29.209742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e710106c-18c6-42e4-8d8a-209dd1397b22 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:29.212493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e710106c-18c6-42e4-8d8a-209dd1397b22 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:29.227999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e710106c-18c6-42e4-8d8a-209dd1397b22 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:29.229332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e710106c-18c6-42e4-8d8a-209dd1397b22 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:29.230426 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e710106c-18c6-42e4-8d8a-209dd1397b22 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:29.233634 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2071/4189] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:28 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1733 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:29.239417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e710106c-18c6-42e4-8d8a-209dd1397b22 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:29.240703 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e710106c-18c6-42e4-8d8a-209dd1397b22 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:29.241524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e710106c-18c6-42e4-8d8a-209dd1397b22 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:29.258908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8bbed51c-9270-471b-b7c8-8b5e31e07209 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:29.259733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8bbed51c-9270-471b-b7c8-8b5e31e07209 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 99bf1197-df2d-4baa-adbe-dc0032977a9c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:29.269904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bbed51c-9270-471b-b7c8-8b5e31e07209 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:29.271803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bbed51c-9270-471b-b7c8-8b5e31e07209 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:29.272394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bbed51c-9270-471b-b7c8-8b5e31e07209 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:29.273236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bbed51c-9270-471b-b7c8-8b5e31e07209 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:29.273983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bbed51c-9270-471b-b7c8-8b5e31e07209 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:29.274956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8bbed51c-9270-471b-b7c8-8b5e31e07209 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:29.687487 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8bbed51c-9270-471b-b7c8-8b5e31e07209 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:29.704395 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8bbed51c-9270-471b-b7c8-8b5e31e07209 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c" status: 200 len: 1517 microversion: 2.1 time: 0.458596 Sep 07 12:51:29.704990 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2072/4190] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:29 2022] GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c => generated 1517 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:29.717790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-85e09977-454c-4442-b3ff-7f51b0abd3cc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:29.725746 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-85e09977-454c-4442-b3ff-7f51b0abd3cc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:29.730912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e710106c-18c6-42e4-8d8a-209dd1397b22 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:29.736167 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85e09977-454c-4442-b3ff-7f51b0abd3cc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:29.737043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85e09977-454c-4442-b3ff-7f51b0abd3cc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:29.737960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85e09977-454c-4442-b3ff-7f51b0abd3cc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:29.741236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85e09977-454c-4442-b3ff-7f51b0abd3cc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:29.742802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85e09977-454c-4442-b3ff-7f51b0abd3cc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:29.744050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85e09977-454c-4442-b3ff-7f51b0abd3cc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:29.746839 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e710106c-18c6-42e4-8d8a-209dd1397b22 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.551200 Sep 07 12:51:29.747773 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2119/4191] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:29 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:29.868776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ddcab495-8a91-473f-ae45-11cc57361dd4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "b810bb5d-8084-47d5-9b9e-6ea4661cdf5f"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ddcab495-8a91-473f-ae45-11cc57361dd4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 160 Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: {"server": {"name": "", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "b810bb5d-8084-47d5-9b9e-6ea4661cdf5f"}]}} Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': '', 'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f', 'flavorRef': '452', 'networks': [{'uuid': 'b810bb5d-8084-47d5-9b9e-6ea4661cdf5f'}]}}} Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi '' Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:51:29.876467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:51:29.886931 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:51:29.886931 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 07 12:51:29.886931 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:29.886931 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:29.886931 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:29.886931 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:29.886931 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:29.886931 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:29.886931 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:51:29.886931 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:51:29.886931 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 07 12:51:29.886931 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:29.886931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ddcab495-8a91-473f-ae45-11cc57361dd4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:51:29.886931 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ddcab495-8a91-473f-ae45-11cc57361dd4 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.017993 Sep 07 12:51:29.886931 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2120/4192] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:51:29 2022] POST /compute/v2.1/servers => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 07 12:51:29.893535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c199feec-1075-4dc3-9c69-5696723c3c68 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:29.896312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c199feec-1075-4dc3-9c69-5696723c3c68 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:29.920590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c199feec-1075-4dc3-9c69-5696723c3c68 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:29.921514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c199feec-1075-4dc3-9c69-5696723c3c68 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:29.922335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c199feec-1075-4dc3-9c69-5696723c3c68 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:29.924042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c199feec-1075-4dc3-9c69-5696723c3c68 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:29.924913 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c199feec-1075-4dc3-9c69-5696723c3c68 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:29.926207 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c199feec-1075-4dc3-9c69-5696723c3c68 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:30.399661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-85e09977-454c-4442-b3ff-7f51b0abd3cc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:30.418626 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-85e09977-454c-4442-b3ff-7f51b0abd3cc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1679 microversion: 2.1 time: 0.711060 Sep 07 12:51:30.420261 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2073/4193] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:29 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1679 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:30.433045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3087c856-1971-40d5-80e9-ee3ae898209e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:30.435406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3087c856-1971-40d5-80e9-ee3ae898209e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:30.449532 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3087c856-1971-40d5-80e9-ee3ae898209e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:30.450812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3087c856-1971-40d5-80e9-ee3ae898209e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:30.451942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3087c856-1971-40d5-80e9-ee3ae898209e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:30.453546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3087c856-1971-40d5-80e9-ee3ae898209e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:30.455296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3087c856-1971-40d5-80e9-ee3ae898209e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:30.456776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3087c856-1971-40d5-80e9-ee3ae898209e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:30.494044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c199feec-1075-4dc3-9c69-5696723c3c68 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:30.520999 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c199feec-1075-4dc3-9c69-5696723c3c68 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472" status: 200 len: 1312 microversion: 2.1 time: 0.636957 Sep 07 12:51:30.535217 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2121/4194] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:29 2022] GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 => generated 1312 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:30.559720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-618eba63-d6e0-4c7c-aee1-3d78aaa4f52c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:30.560826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-618eba63-d6e0-4c7c-aee1-3d78aaa4f52c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:30.577261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-618eba63-d6e0-4c7c-aee1-3d78aaa4f52c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:30.578167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-618eba63-d6e0-4c7c-aee1-3d78aaa4f52c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:30.578968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-618eba63-d6e0-4c7c-aee1-3d78aaa4f52c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:30.580255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-618eba63-d6e0-4c7c-aee1-3d78aaa4f52c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:30.581072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-618eba63-d6e0-4c7c-aee1-3d78aaa4f52c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:30.581958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-618eba63-d6e0-4c7c-aee1-3d78aaa4f52c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:31.201882 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3087c856-1971-40d5-80e9-ee3ae898209e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:31.206985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-618eba63-d6e0-4c7c-aee1-3d78aaa4f52c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:31.223319 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3087c856-1971-40d5-80e9-ee3ae898209e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.798444 Sep 07 12:51:31.226254 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2074/4195] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:30 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:31.231715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a21fd957-9936-4931-8d23-2c7f12e2af15 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:31.233174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a21fd957-9936-4931-8d23-2c7f12e2af15 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:31.245149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-618eba63-d6e0-4c7c-aee1-3d78aaa4f52c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:31.251284 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-618eba63-d6e0-4c7c-aee1-3d78aaa4f52c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:31.252415 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a21fd957-9936-4931-8d23-2c7f12e2af15 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:31.252946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a21fd957-9936-4931-8d23-2c7f12e2af15 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:31.253396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a21fd957-9936-4931-8d23-2c7f12e2af15 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:31.255599 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-618eba63-d6e0-4c7c-aee1-3d78aaa4f52c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 2830 microversion: 2.32 time: 0.718238 Sep 07 12:51:31.256696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a21fd957-9936-4931-8d23-2c7f12e2af15 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:31.257799 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2122/4196] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:30 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 2830 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:51:31.260307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a21fd957-9936-4931-8d23-2c7f12e2af15 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:31.261001 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a21fd957-9936-4931-8d23-2c7f12e2af15 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:31.267662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-56cdf66e-f093-49fc-a89c-e72628216237 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:31.270125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-56cdf66e-f093-49fc-a89c-e72628216237 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 99bf1197-df2d-4baa-adbe-dc0032977a9c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:31.296163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56cdf66e-f093-49fc-a89c-e72628216237 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:31.297635 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56cdf66e-f093-49fc-a89c-e72628216237 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:31.302311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56cdf66e-f093-49fc-a89c-e72628216237 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:31.303241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56cdf66e-f093-49fc-a89c-e72628216237 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:31.304690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56cdf66e-f093-49fc-a89c-e72628216237 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:31.305274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56cdf66e-f093-49fc-a89c-e72628216237 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:31.657228 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 12:51:31.658041 n-d-852087-9 devstack@n-api.service[122432]: Wed Sep 7 12:51:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c (ip 10.222.0.16) !!! Sep 07 12:51:32.433565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-56cdf66e-f093-49fc-a89c-e72628216237 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:32.434364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a21fd957-9936-4931-8d23-2c7f12e2af15 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:32.450447 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a21fd957-9936-4931-8d23-2c7f12e2af15 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1733 microversion: 2.1 time: 1.221947 Sep 07 12:51:32.451239 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-56cdf66e-f093-49fc-a89c-e72628216237 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c" status: 200 len: 1517 microversion: 2.1 time: 1.189200 Sep 07 12:51:32.452111 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2075/4197] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:31 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1733 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:32.460344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-728a7017-9fb4-4443-939f-ff9fe8bdc759 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:32.461436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-728a7017-9fb4-4443-939f-ff9fe8bdc759 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:32.469616 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2123/4198] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:31 2022] GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c => generated 1517 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:32.475248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-728a7017-9fb4-4443-939f-ff9fe8bdc759 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:32.476182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-728a7017-9fb4-4443-939f-ff9fe8bdc759 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:32.477031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-728a7017-9fb4-4443-939f-ff9fe8bdc759 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:32.477930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-41c1ab25-3329-4733-9806-50bb569ebb45 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:32.478449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-728a7017-9fb4-4443-939f-ff9fe8bdc759 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:32.478833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-41c1ab25-3329-4733-9806-50bb569ebb45 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:32.479421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-728a7017-9fb4-4443-939f-ff9fe8bdc759 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:32.480260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-728a7017-9fb4-4443-939f-ff9fe8bdc759 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:32.487149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41c1ab25-3329-4733-9806-50bb569ebb45 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:32.488010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41c1ab25-3329-4733-9806-50bb569ebb45 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:32.488698 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41c1ab25-3329-4733-9806-50bb569ebb45 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:32.489848 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41c1ab25-3329-4733-9806-50bb569ebb45 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:32.490533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41c1ab25-3329-4733-9806-50bb569ebb45 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:32.491150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41c1ab25-3329-4733-9806-50bb569ebb45 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:32.829049 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-41c1ab25-3329-4733-9806-50bb569ebb45 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.357644 Sep 07 12:51:32.829924 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2124/4199] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Sep 7 12:51:32 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2/os-interface => generated 1830 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:51:32.835505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e507f0ea-2e0d-4917-b869-1b32cf645680 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:32.836538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e507f0ea-2e0d-4917-b869-1b32cf645680 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:32.844100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e507f0ea-2e0d-4917-b869-1b32cf645680 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:32.845223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e507f0ea-2e0d-4917-b869-1b32cf645680 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:32.845904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e507f0ea-2e0d-4917-b869-1b32cf645680 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:32.846860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e507f0ea-2e0d-4917-b869-1b32cf645680 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:32.847619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e507f0ea-2e0d-4917-b869-1b32cf645680 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:32.848225 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e507f0ea-2e0d-4917-b869-1b32cf645680 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:32.948376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-728a7017-9fb4-4443-939f-ff9fe8bdc759 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:32.958231 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-728a7017-9fb4-4443-939f-ff9fe8bdc759 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.503896 Sep 07 12:51:32.969561 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2076/4200] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:32 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:32.980862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e0c02f97-8761-45c9-8669-5ccfedc19256 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:32.981866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e0c02f97-8761-45c9-8669-5ccfedc19256 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:32.986471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:33.001233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0c02f97-8761-45c9-8669-5ccfedc19256 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:33.001903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0c02f97-8761-45c9-8669-5ccfedc19256 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:33.003335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0c02f97-8761-45c9-8669-5ccfedc19256 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:33.006054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0c02f97-8761-45c9-8669-5ccfedc19256 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:33.006822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0c02f97-8761-45c9-8669-5ccfedc19256 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:33.008170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0c02f97-8761-45c9-8669-5ccfedc19256 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:33.021696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:33.462248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:33.604656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e507f0ea-2e0d-4917-b869-1b32cf645680 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:33.617906 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e507f0ea-2e0d-4917-b869-1b32cf645680 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1679 microversion: 2.1 time: 0.786449 Sep 07 12:51:33.618815 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2125/4201] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:32 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1679 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:33.624553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-35f6105f-66b7-4bbd-b939-ae4d38009f7a req-c51c32b3-929e-43ab-b725-83fd58fb1f52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e76105-cf05-4f29-9469-b3bb4b1f7472", "tag": "3e057dd1-11db-45a6-8a3f-f8f318956247"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:33.651265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-35f6105f-66b7-4bbd-b939-ae4d38009f7a req-c51c32b3-929e-43ab-b725-83fd58fb1f52 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:33.652071 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-35f6105f-66b7-4bbd-b939-ae4d38009f7a req-c51c32b3-929e-43ab-b725-83fd58fb1f52 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:33.655165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-35f6105f-66b7-4bbd-b939-ae4d38009f7a req-c51c32b3-929e-43ab-b725-83fd58fb1f52 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:33.665964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e0c02f97-8761-45c9-8669-5ccfedc19256 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:33.680690 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-35f6105f-66b7-4bbd-b939-ae4d38009f7a req-c51c32b3-929e-43ab-b725-83fd58fb1f52 service nova] Creating event network-changed:3e057dd1-11db-45a6-8a3f-f8f318956247 for instance 95e76105-cf05-4f29-9469-b3bb4b1f7472 on n-h1-852087-9 Sep 07 12:51:33.682310 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e0c02f97-8761-45c9-8669-5ccfedc19256 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472" status: 200 len: 1333 microversion: 2.1 time: 0.709772 Sep 07 12:51:33.701695 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2077/4202] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:32 2022] GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 => generated 1333 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:33.702139 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-35f6105f-66b7-4bbd-b939-ae4d38009f7a req-c51c32b3-929e-43ab-b725-83fd58fb1f52 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081111 Sep 07 12:51:33.703921 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2126/4203] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:51:33.722902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-877bd5b1-e547-4b38-adb9-793b9b9fbabb req-bf04670e-f521-470c-a67a-fedde62ed626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99bf1197-df2d-4baa-adbe-dc0032977a9c", "name": "network-vif-deleted", "tag": "7282a636-5215-4e21-8a64-6beb646297a1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:33.728102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b2724cc2-129f-4c52-9414-41d238b72203 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:33.729359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b2724cc2-129f-4c52-9414-41d238b72203 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 37094bd3-ab8f-4722-bb48-ef5406728c46] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:33.741234 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-b2724cc2-129f-4c52-9414-41d238b72203 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Instance 37094bd3-ab8f-4722-bb48-ef5406728c46 could not be found. Sep 07 12:51:33.745154 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-877bd5b1-e547-4b38-adb9-793b9b9fbabb req-bf04670e-f521-470c-a67a-fedde62ed626 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:33.746545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-877bd5b1-e547-4b38-adb9-793b9b9fbabb req-bf04670e-f521-470c-a67a-fedde62ed626 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b2724cc2-129f-4c52-9414-41d238b72203 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/37094bd3-ab8f-4722-bb48-ef5406728c46/action HTTP/1.1 Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 14 Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: {"shelve": {}} Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 37094bd3-ab8f-4722-bb48-ef5406728c46 could not be found. Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '37094bd3-ab8f-4722-bb48-ef5406728c46', 'body': {'shelve': {}}} Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37094bd3-ab8f-4722-bb48-ef5406728c46 could not be found. Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37094bd3-ab8f-4722-bb48-ef5406728c46 could not be found. Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:33.749085 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:33.758782 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:51:33.758782 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:51:33.758782 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37094bd3-ab8f-4722-bb48-ef5406728c46 could not be found. Sep 07 12:51:33.758782 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:33.759194 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-877bd5b1-e547-4b38-adb9-793b9b9fbabb req-bf04670e-f521-470c-a67a-fedde62ed626 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:33.761166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b2724cc2-129f-4c52-9414-41d238b72203 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 404 to user: Instance 37094bd3-ab8f-4722-bb48-ef5406728c46 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:51:33.767321 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b2724cc2-129f-4c52-9414-41d238b72203 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers/37094bd3-ab8f-4722-bb48-ef5406728c46/action" status: 404 len: 111 microversion: 2.1 time: 0.053869 Sep 07 12:51:33.768846 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2127/4204] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:33 2022] POST /compute/v2.1/servers/37094bd3-ab8f-4722-bb48-ef5406728c46/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:51:33.785426 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d715e25c-abcf-468d-868c-ade9caac8ec0 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:33.787257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d715e25c-abcf-468d-868c-ade9caac8ec0 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:33.799342 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-877bd5b1-e547-4b38-adb9-793b9b9fbabb req-bf04670e-f521-470c-a67a-fedde62ed626 service nova] Creating event network-vif-deleted:7282a636-5215-4e21-8a64-6beb646297a1 for instance 99bf1197-df2d-4baa-adbe-dc0032977a9c on n-h1-852087-9 Sep 07 12:51:33.803895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d715e25c-abcf-468d-868c-ade9caac8ec0 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:33.805249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d715e25c-abcf-468d-868c-ade9caac8ec0 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:33.806348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d715e25c-abcf-468d-868c-ade9caac8ec0 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:33.809878 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d715e25c-abcf-468d-868c-ade9caac8ec0 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:33.811045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d715e25c-abcf-468d-868c-ade9caac8ec0 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:33.812288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d715e25c-abcf-468d-868c-ade9caac8ec0 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:33.813547 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-877bd5b1-e547-4b38-adb9-793b9b9fbabb req-bf04670e-f521-470c-a67a-fedde62ed626 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106920 Sep 07 12:51:33.814996 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2078/4205] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:51:33.829916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6f9a66fa-b747-444c-8588-7c1add9eed52 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:33.831749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6f9a66fa-b747-444c-8588-7c1add9eed52 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 99bf1197-df2d-4baa-adbe-dc0032977a9c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:33.844321 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f9a66fa-b747-444c-8588-7c1add9eed52 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:33.846907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f9a66fa-b747-444c-8588-7c1add9eed52 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:33.848200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f9a66fa-b747-444c-8588-7c1add9eed52 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:33.850250 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f9a66fa-b747-444c-8588-7c1add9eed52 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:33.851558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f9a66fa-b747-444c-8588-7c1add9eed52 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:33.854430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f9a66fa-b747-444c-8588-7c1add9eed52 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:33.888853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=10 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:33.898640 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-6f9a66fa-b747-444c-8588-7c1add9eed52 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] HTTP exception thrown: Instance 99bf1197-df2d-4baa-adbe-dc0032977a9c could not be found. Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6f9a66fa-b747-444c-8588-7c1add9eed52 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Request method failure captured: Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c HTTP/1.1 Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJN6N1kjGi4p4zlIZ-MsXyEy7HXrm7zCzopdIYKEw3BspuglKORnXbw97eWbduBZiUik6Q97i7IBdpLdVw82NLq9mj4blEv_8H62C2CKEJLdbyB72NvJZaolB4eQunoDK-X6x7BQ3v6P4bctEAdzsLFbSY-ueVtlir4StLV1Bzj7PQs Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: ab7bfa5688d5406da8f755efff3cf54e Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ListServerFiltersTestJSON-2038474308 Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7bfa5688d5406da8f755efff3cf54e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ab7bfa5688d5406da8f755efff3cf54e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ab7bfa5688d5406da8f755efff3cf54e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7bfa5688d5406da8f755efff3cf54e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ListServerFiltersTestJSON-2038474308 Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: ab7bfa5688d5406da8f755efff3cf54e Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2038474308 Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ListServerFiltersTestJSON-2038474308-project Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 30c27a3ca32e4f4d976d1351372b0fb1 Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ListServerFiltersTestJSON-2038474308-project Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 99bf1197-df2d-4baa-adbe-dc0032977a9c could not be found. Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '99bf1197-df2d-4baa-adbe-dc0032977a9c'} Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99bf1197-df2d-4baa-adbe-dc0032977a9c could not be found. Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99bf1197-df2d-4baa-adbe-dc0032977a9c could not be found. Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:33.903004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:33.906576 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:33.906576 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:33.906576 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:33.906576 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:51:33.906576 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:51:33.906576 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99bf1197-df2d-4baa-adbe-dc0032977a9c could not be found. Sep 07 12:51:33.906576 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:51:33.909543 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6f9a66fa-b747-444c-8588-7c1add9eed52 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Returning 404 to user: Instance 99bf1197-df2d-4baa-adbe-dc0032977a9c could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:51:33.911219 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6f9a66fa-b747-444c-8588-7c1add9eed52 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c" status: 404 len: 111 microversion: 2.1 time: 0.092770 Sep 07 12:51:33.915183 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2079/4206] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:33 2022] GET /compute/v2.1/servers/99bf1197-df2d-4baa-adbe-dc0032977a9c => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:51:33.919896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a26652e8-0a00-4dcd-9ba8-4d8aa85f15b8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:33.920545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a26652e8-0a00-4dcd-9ba8-4d8aa85f15b8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:33.932405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a26652e8-0a00-4dcd-9ba8-4d8aa85f15b8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:33.933091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a26652e8-0a00-4dcd-9ba8-4d8aa85f15b8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:33.933803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a26652e8-0a00-4dcd-9ba8-4d8aa85f15b8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:33.934590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a26652e8-0a00-4dcd-9ba8-4d8aa85f15b8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:33.935059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a26652e8-0a00-4dcd-9ba8-4d8aa85f15b8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:33.935485 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a26652e8-0a00-4dcd-9ba8-4d8aa85f15b8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:34.468413 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d715e25c-abcf-468d-868c-ade9caac8ec0 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:34.486713 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d715e25c-abcf-468d-868c-ade9caac8ec0 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1733 microversion: 2.1 time: 0.710917 Sep 07 12:51:34.488143 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2128/4207] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:33 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1733 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:34.499036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d63274c-cbda-4fde-9959-1e2c5d8c368e tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:34.500367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1d63274c-cbda-4fde-9959-1e2c5d8c368e tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 290d9a42-9d80-495f-8e45-879687fea820] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:34.512569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d63274c-cbda-4fde-9959-1e2c5d8c368e tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:34.514712 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d63274c-cbda-4fde-9959-1e2c5d8c368e tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:34.515769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d63274c-cbda-4fde-9959-1e2c5d8c368e tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:34.516686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d63274c-cbda-4fde-9959-1e2c5d8c368e tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:34.517443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d63274c-cbda-4fde-9959-1e2c5d8c368e tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:34.518126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d63274c-cbda-4fde-9959-1e2c5d8c368e tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:34.561404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a26652e8-0a00-4dcd-9ba8-4d8aa85f15b8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:34.567675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1d63274c-cbda-4fde-9959-1e2c5d8c368e tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 290d9a42-9d80-495f-8e45-879687fea820] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:51:34.587682 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a26652e8-0a00-4dcd-9ba8-4d8aa85f15b8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.673095 Sep 07 12:51:34.589188 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2080/4208] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:33 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:34.598276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d37b4ad9-f241-4fa8-a3a3-6e56cb8d6fca tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:34.599562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d37b4ad9-f241-4fa8-a3a3-6e56cb8d6fca tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:34.616021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d37b4ad9-f241-4fa8-a3a3-6e56cb8d6fca tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:34.617370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d37b4ad9-f241-4fa8-a3a3-6e56cb8d6fca tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:34.618534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d37b4ad9-f241-4fa8-a3a3-6e56cb8d6fca tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:34.620347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d37b4ad9-f241-4fa8-a3a3-6e56cb8d6fca tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:34.621606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d37b4ad9-f241-4fa8-a3a3-6e56cb8d6fca tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:34.622626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d37b4ad9-f241-4fa8-a3a3-6e56cb8d6fca tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:34.654471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:34.674012 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d37b4ad9-f241-4fa8-a3a3-6e56cb8d6fca tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4/ips" status: 200 len: 151 microversion: 2.20 time: 0.082433 Sep 07 12:51:34.675978 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2081/4209] 10.222.0.16 () {60 vars in 1289 bytes} [Wed Sep 7 12:51:34 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4/ips => generated 151 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:51:34.685429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-de6677ee-4c54-4fac-bbd3-e2b92ecef579 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:34.687009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-de6677ee-4c54-4fac-bbd3-e2b92ecef579 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:34.698435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de6677ee-4c54-4fac-bbd3-e2b92ecef579 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:34.699919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de6677ee-4c54-4fac-bbd3-e2b92ecef579 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:34.700869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de6677ee-4c54-4fac-bbd3-e2b92ecef579 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:34.702396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de6677ee-4c54-4fac-bbd3-e2b92ecef579 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:34.703557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de6677ee-4c54-4fac-bbd3-e2b92ecef579 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:34.704680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de6677ee-4c54-4fac-bbd3-e2b92ecef579 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:34.742159 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1d63274c-cbda-4fde-9959-1e2c5d8c368e tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "DELETE /compute/v2.1/servers/290d9a42-9d80-495f-8e45-879687fea820" status: 204 len: 0 microversion: 2.1 time: 0.251267 Sep 07 12:51:34.746662 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2129/4210] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:51:34 2022] DELETE /compute/v2.1/servers/290d9a42-9d80-495f-8e45-879687fea820 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:51:34.765222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4cc26812-3205-426d-82df-b8704a61c924 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:34.767406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4cc26812-3205-426d-82df-b8704a61c924 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:34.778221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cc26812-3205-426d-82df-b8704a61c924 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:34.778828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cc26812-3205-426d-82df-b8704a61c924 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:34.779332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cc26812-3205-426d-82df-b8704a61c924 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:34.780162 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cc26812-3205-426d-82df-b8704a61c924 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:34.780737 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cc26812-3205-426d-82df-b8704a61c924 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:34.781228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4cc26812-3205-426d-82df-b8704a61c924 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:35.283541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-de6677ee-4c54-4fac-bbd3-e2b92ecef579 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:35.298452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4cc26812-3205-426d-82df-b8704a61c924 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:35.316955 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-de6677ee-4c54-4fac-bbd3-e2b92ecef579 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.638543 Sep 07 12:51:35.326985 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4cc26812-3205-426d-82df-b8704a61c924 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1679 microversion: 2.1 time: 0.577872 Sep 07 12:51:35.333708 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2082/4211] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:34 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:35.348281 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-67d507d2-1bca-49bc-9383-f4b669beb9d4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:35.352716 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2130/4212] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:34 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1679 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:35.359122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2dcb76c3-da4f-44fd-8477-80b9f0cc26d6 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:35.359419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-67d507d2-1bca-49bc-9383-f4b669beb9d4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:35.360901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2dcb76c3-da4f-44fd-8477-80b9f0cc26d6 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 290d9a42-9d80-495f-8e45-879687fea820] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:35.373870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dcb76c3-da4f-44fd-8477-80b9f0cc26d6 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:35.374740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dcb76c3-da4f-44fd-8477-80b9f0cc26d6 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:35.375384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dcb76c3-da4f-44fd-8477-80b9f0cc26d6 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:35.376310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dcb76c3-da4f-44fd-8477-80b9f0cc26d6 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:35.377749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dcb76c3-da4f-44fd-8477-80b9f0cc26d6 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:35.378419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dcb76c3-da4f-44fd-8477-80b9f0cc26d6 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:35.384904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67d507d2-1bca-49bc-9383-f4b669beb9d4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:35.385822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67d507d2-1bca-49bc-9383-f4b669beb9d4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:35.386474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67d507d2-1bca-49bc-9383-f4b669beb9d4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:35.388464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67d507d2-1bca-49bc-9383-f4b669beb9d4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:35.389544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67d507d2-1bca-49bc-9383-f4b669beb9d4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:35.390183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67d507d2-1bca-49bc-9383-f4b669beb9d4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:35.809044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-67d507d2-1bca-49bc-9383-f4b669beb9d4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:35.826980 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-67d507d2-1bca-49bc-9383-f4b669beb9d4 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472" status: 200 len: 1333 microversion: 2.1 time: 0.491211 Sep 07 12:51:35.832949 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2083/4213] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:35 2022] GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 => generated 1333 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:35.847756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3c566fb8-9f45-49b2-9561-076ced2f089d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:35.849628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3c566fb8-9f45-49b2-9561-076ced2f089d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:35.863500 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c566fb8-9f45-49b2-9561-076ced2f089d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:35.864335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c566fb8-9f45-49b2-9561-076ced2f089d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:35.866098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c566fb8-9f45-49b2-9561-076ced2f089d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:35.866674 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c566fb8-9f45-49b2-9561-076ced2f089d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:35.867560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c566fb8-9f45-49b2-9561-076ced2f089d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:35.868717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c566fb8-9f45-49b2-9561-076ced2f089d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:35.897202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2dcb76c3-da4f-44fd-8477-80b9f0cc26d6 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:35.926755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-3c566fb8-9f45-49b2-9561-076ced2f089d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lazy-loading 'flavor' on Instance uuid 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:51:35.969456 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2dcb76c3-da4f-44fd-8477-80b9f0cc26d6 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/290d9a42-9d80-495f-8e45-879687fea820" status: 200 len: 1516 microversion: 2.1 time: 0.614622 Sep 07 12:51:35.978876 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2131/4214] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:35 2022] GET /compute/v2.1/servers/290d9a42-9d80-495f-8e45-879687fea820 => generated 1516 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:35.978876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5524eef7-c165-414b-92ed-b2fd57655936 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:35.978876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5524eef7-c165-414b-92ed-b2fd57655936 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:35.986896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5524eef7-c165-414b-92ed-b2fd57655936 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:35.987645 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5524eef7-c165-414b-92ed-b2fd57655936 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:35.988293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5524eef7-c165-414b-92ed-b2fd57655936 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:35.989252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5524eef7-c165-414b-92ed-b2fd57655936 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:35.989941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5524eef7-c165-414b-92ed-b2fd57655936 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:35.990551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5524eef7-c165-414b-92ed-b2fd57655936 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:36.035766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=12 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:36.284756 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3c566fb8-9f45-49b2-9561-076ced2f089d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action" status: 202 len: 0 microversion: 2.1 time: 0.447225 Sep 07 12:51:36.285766 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2084/4215] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:35 2022] POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:51:36.295820 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-8023d19e-d507-40a6-a636-927250ad8198 req-52e970d7-a68a-47ca-9fbb-add389d4efd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e76105-cf05-4f29-9469-b3bb4b1f7472", "tag": "dee55a92-0caf-4a4d-8da1-9359d0c72291"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:36.315529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8023d19e-d507-40a6-a636-927250ad8198 req-52e970d7-a68a-47ca-9fbb-add389d4efd3 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:36.316099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8023d19e-d507-40a6-a636-927250ad8198 req-52e970d7-a68a-47ca-9fbb-add389d4efd3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:36.316559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8023d19e-d507-40a6-a636-927250ad8198 req-52e970d7-a68a-47ca-9fbb-add389d4efd3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:36.342126 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-8023d19e-d507-40a6-a636-927250ad8198 req-52e970d7-a68a-47ca-9fbb-add389d4efd3 service nova] Creating event network-changed:dee55a92-0caf-4a4d-8da1-9359d0c72291 for instance 95e76105-cf05-4f29-9469-b3bb4b1f7472 on n-h1-852087-9 Sep 07 12:51:36.355972 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-8023d19e-d507-40a6-a636-927250ad8198 req-52e970d7-a68a-47ca-9fbb-add389d4efd3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066964 Sep 07 12:51:36.364968 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2085/4216] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:51:36.392559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-50491d85-520b-44f0-bfdc-457ebf8287b6 req-16ac2ba8-0dd7-4688-ab0e-e1825b56d608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9352ac2-475e-4c77-aa85-5ecd566563b2", "tag": "3a4e33c1-9c34-429f-8cce-622597db4c32"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:36.433440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-50491d85-520b-44f0-bfdc-457ebf8287b6 req-16ac2ba8-0dd7-4688-ab0e-e1825b56d608 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:36.433440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-50491d85-520b-44f0-bfdc-457ebf8287b6 req-16ac2ba8-0dd7-4688-ab0e-e1825b56d608 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:36.434577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-50491d85-520b-44f0-bfdc-457ebf8287b6 req-16ac2ba8-0dd7-4688-ab0e-e1825b56d608 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:36.470653 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-50491d85-520b-44f0-bfdc-457ebf8287b6 req-16ac2ba8-0dd7-4688-ab0e-e1825b56d608 service nova] Creating event network-changed:3a4e33c1-9c34-429f-8cce-622597db4c32 for instance e9352ac2-475e-4c77-aa85-5ecd566563b2 on n-h2-852087-9 Sep 07 12:51:36.483867 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-50491d85-520b-44f0-bfdc-457ebf8287b6 req-16ac2ba8-0dd7-4688-ab0e-e1825b56d608 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111364 Sep 07 12:51:36.485408 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2086/4217] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:51:36.497678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f222e9eb-b9f5-4d79-bf2c-a2d1684c2a7b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:36.498975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f222e9eb-b9f5-4d79-bf2c-a2d1684c2a7b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:36.510981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f222e9eb-b9f5-4d79-bf2c-a2d1684c2a7b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:36.512821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f222e9eb-b9f5-4d79-bf2c-a2d1684c2a7b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:36.513601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f222e9eb-b9f5-4d79-bf2c-a2d1684c2a7b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:36.515008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f222e9eb-b9f5-4d79-bf2c-a2d1684c2a7b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:36.515755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f222e9eb-b9f5-4d79-bf2c-a2d1684c2a7b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:36.516513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f222e9eb-b9f5-4d79-bf2c-a2d1684c2a7b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:36.841708 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5524eef7-c165-414b-92ed-b2fd57655936 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:36.854457 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5524eef7-c165-414b-92ed-b2fd57655936 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1733 microversion: 2.1 time: 0.882740 Sep 07 12:51:36.854925 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2132/4218] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:35 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1733 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:36.860423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b7d43114-1eb5-4388-8a04-d554e0c97051 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:36.863628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b7d43114-1eb5-4388-8a04-d554e0c97051 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:36.870867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7d43114-1eb5-4388-8a04-d554e0c97051 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:36.871604 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7d43114-1eb5-4388-8a04-d554e0c97051 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:36.872194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7d43114-1eb5-4388-8a04-d554e0c97051 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:36.873402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7d43114-1eb5-4388-8a04-d554e0c97051 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:36.874699 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7d43114-1eb5-4388-8a04-d554e0c97051 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:36.875297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7d43114-1eb5-4388-8a04-d554e0c97051 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:37.397426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f222e9eb-b9f5-4d79-bf2c-a2d1684c2a7b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:37.409224 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f222e9eb-b9f5-4d79-bf2c-a2d1684c2a7b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1511 microversion: 2.1 time: 0.921980 Sep 07 12:51:37.410593 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2087/4219] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:36 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1511 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:37.415818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3cfcf3b6-13bf-4ba1-9de3-b0a6449f304c tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:37.416817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3cfcf3b6-13bf-4ba1-9de3-b0a6449f304c tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:37.453922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cfcf3b6-13bf-4ba1-9de3-b0a6449f304c tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:37.455661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cfcf3b6-13bf-4ba1-9de3-b0a6449f304c tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:37.456450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cfcf3b6-13bf-4ba1-9de3-b0a6449f304c tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:37.457705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cfcf3b6-13bf-4ba1-9de3-b0a6449f304c tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:37.458532 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cfcf3b6-13bf-4ba1-9de3-b0a6449f304c tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:37.459239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cfcf3b6-13bf-4ba1-9de3-b0a6449f304c tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:37.530896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b7d43114-1eb5-4388-8a04-d554e0c97051 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:37.542015 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b7d43114-1eb5-4388-8a04-d554e0c97051 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1679 microversion: 2.1 time: 0.685630 Sep 07 12:51:37.549726 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2133/4220] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:36 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1679 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:37.557856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b885a206-9ece-469b-9e95-1f0f2ad33b45 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:37.560416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b885a206-9ece-469b-9e95-1f0f2ad33b45 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 290d9a42-9d80-495f-8e45-879687fea820] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:37.580970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b885a206-9ece-469b-9e95-1f0f2ad33b45 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:37.581508 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b885a206-9ece-469b-9e95-1f0f2ad33b45 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:37.581963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b885a206-9ece-469b-9e95-1f0f2ad33b45 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:37.582820 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b885a206-9ece-469b-9e95-1f0f2ad33b45 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:37.583298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b885a206-9ece-469b-9e95-1f0f2ad33b45 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:37.583740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b885a206-9ece-469b-9e95-1f0f2ad33b45 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:38.424205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3cfcf3b6-13bf-4ba1-9de3-b0a6449f304c tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:38.447363 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3cfcf3b6-13bf-4ba1-9de3-b0a6449f304c tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472" status: 200 len: 1333 microversion: 2.1 time: 1.035349 Sep 07 12:51:38.448590 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2088/4221] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:37 2022] GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 => generated 1333 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:38.453586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-07cc2e29-1bf0-4b96-be01-ac61e57a9cfc tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:38.458167 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-07cc2e29-1bf0-4b96-be01-ac61e57a9cfc tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:38.478466 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07cc2e29-1bf0-4b96-be01-ac61e57a9cfc tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:38.486848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07cc2e29-1bf0-4b96-be01-ac61e57a9cfc tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:38.487822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07cc2e29-1bf0-4b96-be01-ac61e57a9cfc tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:38.494503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07cc2e29-1bf0-4b96-be01-ac61e57a9cfc tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:38.496700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07cc2e29-1bf0-4b96-be01-ac61e57a9cfc tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:38.500342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07cc2e29-1bf0-4b96-be01-ac61e57a9cfc tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:38.717669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b885a206-9ece-469b-9e95-1f0f2ad33b45 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:38.730067 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b885a206-9ece-469b-9e95-1f0f2ad33b45 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/290d9a42-9d80-495f-8e45-879687fea820" status: 200 len: 1516 microversion: 2.1 time: 1.178702 Sep 07 12:51:38.731415 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2134/4222] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:37 2022] GET /compute/v2.1/servers/290d9a42-9d80-495f-8e45-879687fea820 => generated 1516 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:38.736701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-247cd27b-b841-467d-9500-d9df5df61874 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:38.737504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-247cd27b-b841-467d-9500-d9df5df61874 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:38.744696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-247cd27b-b841-467d-9500-d9df5df61874 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:38.745694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-247cd27b-b841-467d-9500-d9df5df61874 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:38.746301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-247cd27b-b841-467d-9500-d9df5df61874 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:38.747188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-247cd27b-b841-467d-9500-d9df5df61874 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:38.747867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-247cd27b-b841-467d-9500-d9df5df61874 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:38.748583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-247cd27b-b841-467d-9500-d9df5df61874 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:38.783304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-247cd27b-b841-467d-9500-d9df5df61874 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lazy-loading 'flavor' on Instance uuid ffe6581c-7070-48c5-a16d-fa30b22567d4 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:51:39.107706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-07cc2e29-1bf0-4b96-be01-ac61e57a9cfc tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:39.143823 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-07cc2e29-1bf0-4b96-be01-ac61e57a9cfc tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1733 microversion: 2.1 time: 0.686766 Sep 07 12:51:39.146875 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2089/4223] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:38 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1733 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:39.174901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-bcb39280-0fcb-4c65-a106-0bb8b5fdcc7a req-eff6a564-33cf-4f8b-9db6-663940e97562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "290d9a42-9d80-495f-8e45-879687fea820", "name": "network-vif-deleted", "tag": "732db7ed-1d4a-40a0-984a-7df4b79e7f0d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:39.206488 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-bcb39280-0fcb-4c65-a106-0bb8b5fdcc7a req-eff6a564-33cf-4f8b-9db6-663940e97562 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:39.207441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-bcb39280-0fcb-4c65-a106-0bb8b5fdcc7a req-eff6a564-33cf-4f8b-9db6-663940e97562 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:39.208232 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-bcb39280-0fcb-4c65-a106-0bb8b5fdcc7a req-eff6a564-33cf-4f8b-9db6-663940e97562 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:39.235918 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-bcb39280-0fcb-4c65-a106-0bb8b5fdcc7a req-eff6a564-33cf-4f8b-9db6-663940e97562 service nova] Creating event network-vif-deleted:732db7ed-1d4a-40a0-984a-7df4b79e7f0d for instance 290d9a42-9d80-495f-8e45-879687fea820 on n-h2-852087-9 Sep 07 12:51:39.250155 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-bcb39280-0fcb-4c65-a106-0bb8b5fdcc7a req-eff6a564-33cf-4f8b-9db6-663940e97562 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094676 Sep 07 12:51:39.253055 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2090/4224] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:51:39.268746 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-449d8c5f-ca13-4301-921f-794788af0f1e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:39.270725 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-449d8c5f-ca13-4301-921f-794788af0f1e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:39.293607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-449d8c5f-ca13-4301-921f-794788af0f1e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:39.295560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-449d8c5f-ca13-4301-921f-794788af0f1e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:39.296834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-449d8c5f-ca13-4301-921f-794788af0f1e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:39.298585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-449d8c5f-ca13-4301-921f-794788af0f1e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:39.302035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-449d8c5f-ca13-4301-921f-794788af0f1e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:39.304049 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-449d8c5f-ca13-4301-921f-794788af0f1e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:39.519996 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-247cd27b-b841-467d-9500-d9df5df61874 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "POST /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4/action" status: 202 len: 0 microversion: 2.20 time: 0.784028 Sep 07 12:51:39.521213 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2135/4225] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Sep 7 12:51:38 2022] POST /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4/action => generated 0 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:51:39.552074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c378dd83-536f-4d6b-b1b8-3e9c9a571267 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:39.553443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c378dd83-536f-4d6b-b1b8-3e9c9a571267 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:39.589277 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c378dd83-536f-4d6b-b1b8-3e9c9a571267 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:39.592697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c378dd83-536f-4d6b-b1b8-3e9c9a571267 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:39.603123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c378dd83-536f-4d6b-b1b8-3e9c9a571267 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:39.608376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c378dd83-536f-4d6b-b1b8-3e9c9a571267 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:39.609623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c378dd83-536f-4d6b-b1b8-3e9c9a571267 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:39.610772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c378dd83-536f-4d6b-b1b8-3e9c9a571267 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:39.799535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-449d8c5f-ca13-4301-921f-794788af0f1e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:39.834550 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-449d8c5f-ca13-4301-921f-794788af0f1e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1511 microversion: 2.1 time: 0.578693 Sep 07 12:51:39.836277 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2091/4226] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:39 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1511 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:39.853037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5506392e-e972-47b6-9607-d8b9d8b1e841 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:39.863089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5506392e-e972-47b6-9607-d8b9d8b1e841 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:39.874304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5506392e-e972-47b6-9607-d8b9d8b1e841 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:39.875289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5506392e-e972-47b6-9607-d8b9d8b1e841 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:39.876137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5506392e-e972-47b6-9607-d8b9d8b1e841 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:39.877499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5506392e-e972-47b6-9607-d8b9d8b1e841 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:39.878454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5506392e-e972-47b6-9607-d8b9d8b1e841 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:39.879318 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5506392e-e972-47b6-9607-d8b9d8b1e841 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:40.046659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c378dd83-536f-4d6b-b1b8-3e9c9a571267 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:40.060349 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c378dd83-536f-4d6b-b1b8-3e9c9a571267 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1656 microversion: 2.1 time: 0.527628 Sep 07 12:51:40.064962 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2136/4227] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:39 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1656 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:40.079302 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b0596301-c71b-48aa-9291-bcf7a646a967 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:40.080179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b0596301-c71b-48aa-9291-bcf7a646a967 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:40.092430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0596301-c71b-48aa-9291-bcf7a646a967 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:40.093214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0596301-c71b-48aa-9291-bcf7a646a967 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:40.093879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0596301-c71b-48aa-9291-bcf7a646a967 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:40.094826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0596301-c71b-48aa-9291-bcf7a646a967 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:40.095481 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0596301-c71b-48aa-9291-bcf7a646a967 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:40.097252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0596301-c71b-48aa-9291-bcf7a646a967 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:40.175128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5506392e-e972-47b6-9607-d8b9d8b1e841 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:40.199491 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5506392e-e972-47b6-9607-d8b9d8b1e841 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472" status: 200 len: 1333 microversion: 2.1 time: 0.360771 Sep 07 12:51:40.230120 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2092/4228] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:39 2022] GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 => generated 1333 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:40.256742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4fc38d1a-7664-4afb-8fbb-d4d291f699c8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:40.258270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4fc38d1a-7664-4afb-8fbb-d4d291f699c8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 290d9a42-9d80-495f-8e45-879687fea820] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:40.278973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fc38d1a-7664-4afb-8fbb-d4d291f699c8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:40.281908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fc38d1a-7664-4afb-8fbb-d4d291f699c8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:40.282458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fc38d1a-7664-4afb-8fbb-d4d291f699c8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:40.283237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fc38d1a-7664-4afb-8fbb-d4d291f699c8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:40.285030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fc38d1a-7664-4afb-8fbb-d4d291f699c8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:40.285562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fc38d1a-7664-4afb-8fbb-d4d291f699c8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:40.353633 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fc38d1a-7664-4afb-8fbb-d4d291f699c8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:40.354624 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fc38d1a-7664-4afb-8fbb-d4d291f699c8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:40.355718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fc38d1a-7664-4afb-8fbb-d4d291f699c8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:40.355861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-4fc38d1a-7664-4afb-8fbb-d4d291f699c8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lazy-loading 'fault' on Instance uuid 290d9a42-9d80-495f-8e45-879687fea820 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:51:40.405814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b0596301-c71b-48aa-9291-bcf7a646a967 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:40.426920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b0596301-c71b-48aa-9291-bcf7a646a967 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:40.445142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b0596301-c71b-48aa-9291-bcf7a646a967 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:40.456641 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b0596301-c71b-48aa-9291-bcf7a646a967 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1723 microversion: 2.20 time: 0.389777 Sep 07 12:51:40.459037 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2137/4229] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:40 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1723 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:51:40.468459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-82c10b12-d3ed-4f80-981b-362bbba88574 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:40.487418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4fc38d1a-7664-4afb-8fbb-d4d291f699c8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:40.511897 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82c10b12-d3ed-4f80-981b-362bbba88574 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:40.519569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82c10b12-d3ed-4f80-981b-362bbba88574 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:40.524317 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4fc38d1a-7664-4afb-8fbb-d4d291f699c8 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/290d9a42-9d80-495f-8e45-879687fea820" status: 200 len: 1310 microversion: 2.1 time: 0.291938 Sep 07 12:51:40.526602 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-82c10b12-d3ed-4f80-981b-362bbba88574 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:40.529430 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2093/4230] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:40 2022] GET /compute/v2.1/servers/290d9a42-9d80-495f-8e45-879687fea820 => generated 1310 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:40.539653 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e8288dbb-a852-4ac8-b28d-97f07ca94075 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:40.540852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e8288dbb-a852-4ac8-b28d-97f07ca94075 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:40.552031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8288dbb-a852-4ac8-b28d-97f07ca94075 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:40.553403 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8288dbb-a852-4ac8-b28d-97f07ca94075 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:40.554366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8288dbb-a852-4ac8-b28d-97f07ca94075 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:40.556079 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8288dbb-a852-4ac8-b28d-97f07ca94075 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:40.557041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8288dbb-a852-4ac8-b28d-97f07ca94075 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:40.557933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8288dbb-a852-4ac8-b28d-97f07ca94075 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:40.647111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-82c10b12-d3ed-4f80-981b-362bbba88574 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Going to try to start instance {{(pid=122433) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 12:51:40.708630 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-82c10b12-d3ed-4f80-981b-362bbba88574 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action" status: 202 len: 0 microversion: 2.1 time: 0.247494 Sep 07 12:51:40.709960 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2138/4231] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:40 2022] POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:51:40.718783 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-93eb58b6-6280-4845-831d-68186bdf0f43 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:40.719793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-93eb58b6-6280-4845-831d-68186bdf0f43 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:40.729236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93eb58b6-6280-4845-831d-68186bdf0f43 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:40.730463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93eb58b6-6280-4845-831d-68186bdf0f43 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:40.731245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93eb58b6-6280-4845-831d-68186bdf0f43 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:40.733111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93eb58b6-6280-4845-831d-68186bdf0f43 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:40.734037 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93eb58b6-6280-4845-831d-68186bdf0f43 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:40.735030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93eb58b6-6280-4845-831d-68186bdf0f43 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:40.865603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e8288dbb-a852-4ac8-b28d-97f07ca94075 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:40.896200 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e8288dbb-a852-4ac8-b28d-97f07ca94075 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1733 microversion: 2.1 time: 0.363585 Sep 07 12:51:40.897222 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2094/4232] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:40 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1733 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:40.926177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-203c7ffc-4a2b-4dcc-8378-151f1cc1b91c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:40.927536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-203c7ffc-4a2b-4dcc-8378-151f1cc1b91c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:40.939427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-203c7ffc-4a2b-4dcc-8378-151f1cc1b91c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:40.940360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-203c7ffc-4a2b-4dcc-8378-151f1cc1b91c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:40.941129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-203c7ffc-4a2b-4dcc-8378-151f1cc1b91c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:40.942498 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-203c7ffc-4a2b-4dcc-8378-151f1cc1b91c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:40.943319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-203c7ffc-4a2b-4dcc-8378-151f1cc1b91c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:40.944059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-203c7ffc-4a2b-4dcc-8378-151f1cc1b91c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:40.955182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:41.163619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-93eb58b6-6280-4845-831d-68186bdf0f43 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:41.173760 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-93eb58b6-6280-4845-831d-68186bdf0f43 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1665 microversion: 2.1 time: 0.459400 Sep 07 12:51:41.174603 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2139/4233] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:40 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1665 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:41.262903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1ca31750-26b1-49ae-97ac-dbfedd9197fe tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:41.264039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1ca31750-26b1-49ae-97ac-dbfedd9197fe tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:41.270680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ca31750-26b1-49ae-97ac-dbfedd9197fe tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:41.271445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ca31750-26b1-49ae-97ac-dbfedd9197fe tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:41.271904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ca31750-26b1-49ae-97ac-dbfedd9197fe tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:41.272725 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ca31750-26b1-49ae-97ac-dbfedd9197fe tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:41.273375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ca31750-26b1-49ae-97ac-dbfedd9197fe tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:41.273847 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ca31750-26b1-49ae-97ac-dbfedd9197fe tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:41.395787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-203c7ffc-4a2b-4dcc-8378-151f1cc1b91c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:41.409678 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-203c7ffc-4a2b-4dcc-8378-151f1cc1b91c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1511 microversion: 2.1 time: 0.510462 Sep 07 12:51:41.411106 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2095/4234] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:40 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1511 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:41.495244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-443ed2df-2dce-41ae-8792-b5ced3b3ca8f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:41.497225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-443ed2df-2dce-41ae-8792-b5ced3b3ca8f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:41.515332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-443ed2df-2dce-41ae-8792-b5ced3b3ca8f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:41.517290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-443ed2df-2dce-41ae-8792-b5ced3b3ca8f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:41.518896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-443ed2df-2dce-41ae-8792-b5ced3b3ca8f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:41.520818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-443ed2df-2dce-41ae-8792-b5ced3b3ca8f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:41.522067 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-443ed2df-2dce-41ae-8792-b5ced3b3ca8f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:41.523132 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-443ed2df-2dce-41ae-8792-b5ced3b3ca8f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:41.735159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1ca31750-26b1-49ae-97ac-dbfedd9197fe tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:41.743719 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1ca31750-26b1-49ae-97ac-dbfedd9197fe tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472" status: 200 len: 1333 microversion: 2.1 time: 0.485307 Sep 07 12:51:41.744722 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2140/4235] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:41 2022] GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 => generated 1333 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:41.749787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-10262c34-a0dc-4b84-a095-eb2475392ec9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:41.750438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-10262c34-a0dc-4b84-a095-eb2475392ec9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 290d9a42-9d80-495f-8e45-879687fea820] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:41.758107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10262c34-a0dc-4b84-a095-eb2475392ec9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:41.758565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10262c34-a0dc-4b84-a095-eb2475392ec9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:41.759224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10262c34-a0dc-4b84-a095-eb2475392ec9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:41.760308 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10262c34-a0dc-4b84-a095-eb2475392ec9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:41.761195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10262c34-a0dc-4b84-a095-eb2475392ec9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:41.762211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10262c34-a0dc-4b84-a095-eb2475392ec9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:41.779619 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-10262c34-a0dc-4b84-a095-eb2475392ec9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] HTTP exception thrown: Instance 290d9a42-9d80-495f-8e45-879687fea820 could not be found. Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-10262c34-a0dc-4b84-a095-eb2475392ec9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Request method failure captured: Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/290d9a42-9d80-495f-8e45-879687fea820 HTTP/1.1 Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJN6N1kjGi4p4zlIZ-MsXyEy7HXrm7zCzopdIYKEw3BspuglKORnXbw97eWbduBZiUik6Q97i7IBdpLdVw82NLq9mj4blEv_8H62C2CKEJLdbyB72NvJZaolB4eQunoDK-X6x7BQ3v6P4bctEAdzsLFbSY-ueVtlir4StLV1Bzj7PQs Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: ab7bfa5688d5406da8f755efff3cf54e Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ListServerFiltersTestJSON-2038474308 Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7bfa5688d5406da8f755efff3cf54e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ab7bfa5688d5406da8f755efff3cf54e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ab7bfa5688d5406da8f755efff3cf54e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7bfa5688d5406da8f755efff3cf54e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ListServerFiltersTestJSON-2038474308 Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: ab7bfa5688d5406da8f755efff3cf54e Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2038474308 Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ListServerFiltersTestJSON-2038474308-project Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 30c27a3ca32e4f4d976d1351372b0fb1 Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ListServerFiltersTestJSON-2038474308-project Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 290d9a42-9d80-495f-8e45-879687fea820 could not be found. Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '290d9a42-9d80-495f-8e45-879687fea820'} Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 290d9a42-9d80-495f-8e45-879687fea820 could not be found. Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 290d9a42-9d80-495f-8e45-879687fea820 could not be found. Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:41.781331 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:41.785298 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:41.785298 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:41.785298 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:41.785298 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:51:41.785298 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:51:41.785298 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 290d9a42-9d80-495f-8e45-879687fea820 could not be found. Sep 07 12:51:41.785298 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:41.785298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-10262c34-a0dc-4b84-a095-eb2475392ec9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Returning 404 to user: Instance 290d9a42-9d80-495f-8e45-879687fea820 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:51:41.785298 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-10262c34-a0dc-4b84-a095-eb2475392ec9 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/290d9a42-9d80-495f-8e45-879687fea820" status: 404 len: 111 microversion: 2.1 time: 0.037154 Sep 07 12:51:41.787037 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2141/4236] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:41 2022] GET /compute/v2.1/servers/290d9a42-9d80-495f-8e45-879687fea820 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:51:41.792548 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-122d6dc5-b692-43d6-b172-a8ea55b17048 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:41.793051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-122d6dc5-b692-43d6-b172-a8ea55b17048 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:41.800360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-122d6dc5-b692-43d6-b172-a8ea55b17048 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:41.801023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-122d6dc5-b692-43d6-b172-a8ea55b17048 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:41.801564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-122d6dc5-b692-43d6-b172-a8ea55b17048 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:41.802397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-122d6dc5-b692-43d6-b172-a8ea55b17048 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:41.802963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-122d6dc5-b692-43d6-b172-a8ea55b17048 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:41.803401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-122d6dc5-b692-43d6-b172-a8ea55b17048 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:41.834796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-122d6dc5-b692-43d6-b172-a8ea55b17048 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:51:41.851435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:41.940370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-443ed2df-2dce-41ae-8792-b5ced3b3ca8f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:41.957281 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-443ed2df-2dce-41ae-8792-b5ced3b3ca8f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:41.961026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-443ed2df-2dce-41ae-8792-b5ced3b3ca8f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:41.963668 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-443ed2df-2dce-41ae-8792-b5ced3b3ca8f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1723 microversion: 2.20 time: 0.475633 Sep 07 12:51:41.970427 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2096/4237] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:41 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1723 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:51:41.978351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d1cb150e-7430-4f90-86b8-fc452fa2dd9e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:41.979504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d1cb150e-7430-4f90-86b8-fc452fa2dd9e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:41.983564 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-122d6dc5-b692-43d6-b172-a8ea55b17048 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0" status: 204 len: 0 microversion: 2.1 time: 0.194065 Sep 07 12:51:41.984967 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2142/4238] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:51:41 2022] DELETE /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:51:41.992177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1cb150e-7430-4f90-86b8-fc452fa2dd9e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:41.993160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1cb150e-7430-4f90-86b8-fc452fa2dd9e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:41.994005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1cb150e-7430-4f90-86b8-fc452fa2dd9e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:41.995271 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1cb150e-7430-4f90-86b8-fc452fa2dd9e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:41.996216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1cb150e-7430-4f90-86b8-fc452fa2dd9e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:41.997238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1cb150e-7430-4f90-86b8-fc452fa2dd9e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:42.006692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f6f531c1-77a5-4b90-aea8-8752859c6bbc tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:42.007755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f6f531c1-77a5-4b90-aea8-8752859c6bbc tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:42.019383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6f531c1-77a5-4b90-aea8-8752859c6bbc tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:42.020198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6f531c1-77a5-4b90-aea8-8752859c6bbc tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:42.020948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6f531c1-77a5-4b90-aea8-8752859c6bbc tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:42.022225 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6f531c1-77a5-4b90-aea8-8752859c6bbc tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:42.023093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6f531c1-77a5-4b90-aea8-8752859c6bbc tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:42.023809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6f531c1-77a5-4b90-aea8-8752859c6bbc tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:42.248495 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d1cb150e-7430-4f90-86b8-fc452fa2dd9e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:42.256400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f6f531c1-77a5-4b90-aea8-8752859c6bbc tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:42.265192 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d1cb150e-7430-4f90-86b8-fc452fa2dd9e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1733 microversion: 2.1 time: 0.298238 Sep 07 12:51:42.266397 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2097/4239] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:41 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1733 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:42.269730 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f6f531c1-77a5-4b90-aea8-8752859c6bbc tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0" status: 200 len: 1517 microversion: 2.1 time: 0.278879 Sep 07 12:51:42.270655 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2143/4240] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:41 2022] GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0 => generated 1517 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:42.276332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-36b00f89-a67e-4313-8e35-06899864dc9c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:42.277520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-36b00f89-a67e-4313-8e35-06899864dc9c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:42.286049 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36b00f89-a67e-4313-8e35-06899864dc9c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:42.286553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36b00f89-a67e-4313-8e35-06899864dc9c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:42.286999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36b00f89-a67e-4313-8e35-06899864dc9c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:42.287766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36b00f89-a67e-4313-8e35-06899864dc9c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:42.288473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36b00f89-a67e-4313-8e35-06899864dc9c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:42.289083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36b00f89-a67e-4313-8e35-06899864dc9c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:42.446889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-36b00f89-a67e-4313-8e35-06899864dc9c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:42.453076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a2f55da4-eec5-45a7-a5d6-baebde7c28d7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:42.454237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a2f55da4-eec5-45a7-a5d6-baebde7c28d7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:42.456659 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-36b00f89-a67e-4313-8e35-06899864dc9c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1665 microversion: 2.1 time: 0.188416 Sep 07 12:51:42.457972 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2098/4241] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:42 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1665 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:42.466715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2f55da4-eec5-45a7-a5d6-baebde7c28d7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:42.467669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2f55da4-eec5-45a7-a5d6-baebde7c28d7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:42.468476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2f55da4-eec5-45a7-a5d6-baebde7c28d7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:42.469852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2f55da4-eec5-45a7-a5d6-baebde7c28d7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:42.470701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2f55da4-eec5-45a7-a5d6-baebde7c28d7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:42.471482 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2f55da4-eec5-45a7-a5d6-baebde7c28d7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:42.636433 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a2f55da4-eec5-45a7-a5d6-baebde7c28d7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:42.651607 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a2f55da4-eec5-45a7-a5d6-baebde7c28d7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1511 microversion: 2.1 time: 0.205733 Sep 07 12:51:42.652619 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2144/4242] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:42 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1511 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:42.770170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3360063b-c881-448f-bb18-3fbf693d5ea6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:42.770939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3360063b-c881-448f-bb18-3fbf693d5ea6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:42.778954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3360063b-c881-448f-bb18-3fbf693d5ea6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:42.779457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3360063b-c881-448f-bb18-3fbf693d5ea6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:42.779900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3360063b-c881-448f-bb18-3fbf693d5ea6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:42.780630 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3360063b-c881-448f-bb18-3fbf693d5ea6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:42.781091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3360063b-c881-448f-bb18-3fbf693d5ea6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:42.781650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3360063b-c881-448f-bb18-3fbf693d5ea6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:42.949359 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3360063b-c881-448f-bb18-3fbf693d5ea6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:42.962009 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3360063b-c881-448f-bb18-3fbf693d5ea6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472" status: 200 len: 1333 microversion: 2.1 time: 0.196391 Sep 07 12:51:42.962621 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2099/4243] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:42 2022] GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 => generated 1333 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:42.996826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b6da9138-06d2-4c54-bde9-1704c852ae79 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:42.997452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b6da9138-06d2-4c54-bde9-1704c852ae79 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:43.004838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6da9138-06d2-4c54-bde9-1704c852ae79 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:43.005345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6da9138-06d2-4c54-bde9-1704c852ae79 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:43.005830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6da9138-06d2-4c54-bde9-1704c852ae79 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:43.006579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6da9138-06d2-4c54-bde9-1704c852ae79 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:43.007060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6da9138-06d2-4c54-bde9-1704c852ae79 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:43.007496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6da9138-06d2-4c54-bde9-1704c852ae79 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:43.210188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b6da9138-06d2-4c54-bde9-1704c852ae79 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:43.220115 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b6da9138-06d2-4c54-bde9-1704c852ae79 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:43.221629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b6da9138-06d2-4c54-bde9-1704c852ae79 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:43.222876 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b6da9138-06d2-4c54-bde9-1704c852ae79 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1723 microversion: 2.20 time: 0.230358 Sep 07 12:51:43.223485 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2145/4244] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:42 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:51:43.290885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4c94a714-0b73-48b5-b410-ca263f4eb110 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:43.291428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4c94a714-0b73-48b5-b410-ca263f4eb110 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:43.293889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-59faff8b-a43a-4301-a227-ac9e2dfd4572 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:43.294772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-59faff8b-a43a-4301-a227-ac9e2dfd4572 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:43.299118 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c94a714-0b73-48b5-b410-ca263f4eb110 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:43.299620 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c94a714-0b73-48b5-b410-ca263f4eb110 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:43.300066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c94a714-0b73-48b5-b410-ca263f4eb110 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:43.300950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c94a714-0b73-48b5-b410-ca263f4eb110 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:43.301551 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c94a714-0b73-48b5-b410-ca263f4eb110 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:43.302005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c94a714-0b73-48b5-b410-ca263f4eb110 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:43.302788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59faff8b-a43a-4301-a227-ac9e2dfd4572 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:43.303405 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59faff8b-a43a-4301-a227-ac9e2dfd4572 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:43.304045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59faff8b-a43a-4301-a227-ac9e2dfd4572 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:43.305115 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59faff8b-a43a-4301-a227-ac9e2dfd4572 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:43.305782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59faff8b-a43a-4301-a227-ac9e2dfd4572 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:43.306364 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59faff8b-a43a-4301-a227-ac9e2dfd4572 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:43.534664 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4c94a714-0b73-48b5-b410-ca263f4eb110 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:43.549845 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4c94a714-0b73-48b5-b410-ca263f4eb110 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1733 microversion: 2.1 time: 0.263061 Sep 07 12:51:43.551255 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2100/4245] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:43 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1733 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:43.556471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-77338381-d2e5-4ff1-9081-e1ab1c43fe08 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:43.557106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-77338381-d2e5-4ff1-9081-e1ab1c43fe08 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:43.558318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-59faff8b-a43a-4301-a227-ac9e2dfd4572 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:43.567397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77338381-d2e5-4ff1-9081-e1ab1c43fe08 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:43.568500 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77338381-d2e5-4ff1-9081-e1ab1c43fe08 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:43.569526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77338381-d2e5-4ff1-9081-e1ab1c43fe08 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:43.570748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77338381-d2e5-4ff1-9081-e1ab1c43fe08 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:43.571358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77338381-d2e5-4ff1-9081-e1ab1c43fe08 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:43.572159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77338381-d2e5-4ff1-9081-e1ab1c43fe08 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:43.575818 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-59faff8b-a43a-4301-a227-ac9e2dfd4572 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0" status: 200 len: 1517 microversion: 2.1 time: 0.286004 Sep 07 12:51:43.585517 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2146/4246] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:43 2022] GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0 => generated 1517 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:43.695906 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-61952560-30f6-4d71-af5c-bf5439b41a0f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:43.697200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-61952560-30f6-4d71-af5c-bf5439b41a0f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:43.711963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61952560-30f6-4d71-af5c-bf5439b41a0f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:43.713215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61952560-30f6-4d71-af5c-bf5439b41a0f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:43.714200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61952560-30f6-4d71-af5c-bf5439b41a0f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:43.715924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61952560-30f6-4d71-af5c-bf5439b41a0f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:43.716927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61952560-30f6-4d71-af5c-bf5439b41a0f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:43.717904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61952560-30f6-4d71-af5c-bf5439b41a0f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:44.038634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-77338381-d2e5-4ff1-9081-e1ab1c43fe08 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:44.059910 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-77338381-d2e5-4ff1-9081-e1ab1c43fe08 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1665 microversion: 2.1 time: 0.507112 Sep 07 12:51:44.075270 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2101/4247] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:43 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1665 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:44.082503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-61952560-30f6-4d71-af5c-bf5439b41a0f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:44.087744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-87763ecb-16ef-4732-af11-cb482e022abb req-94c2cc03-49f9-4067-befd-c120230ed247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e76105-cf05-4f29-9469-b3bb4b1f7472", "name": "network-vif-plugged", "status": "completed", "tag": "3e057dd1-11db-45a6-8a3f-f8f318956247"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:44.098141 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-61952560-30f6-4d71-af5c-bf5439b41a0f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1511 microversion: 2.1 time: 0.411000 Sep 07 12:51:44.099563 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2147/4248] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:43 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1511 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:44.122874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-87763ecb-16ef-4732-af11-cb482e022abb req-94c2cc03-49f9-4067-befd-c120230ed247 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:44.123701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-87763ecb-16ef-4732-af11-cb482e022abb req-94c2cc03-49f9-4067-befd-c120230ed247 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:44.125454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-87763ecb-16ef-4732-af11-cb482e022abb req-94c2cc03-49f9-4067-befd-c120230ed247 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:44.129986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-110b622e-ffc2-4db6-a09c-08d76bc76e9b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:44.131169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-110b622e-ffc2-4db6-a09c-08d76bc76e9b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:44.142645 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-110b622e-ffc2-4db6-a09c-08d76bc76e9b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:44.143535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-110b622e-ffc2-4db6-a09c-08d76bc76e9b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:44.144440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-110b622e-ffc2-4db6-a09c-08d76bc76e9b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:44.145743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-110b622e-ffc2-4db6-a09c-08d76bc76e9b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:44.146603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-110b622e-ffc2-4db6-a09c-08d76bc76e9b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:44.147373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-110b622e-ffc2-4db6-a09c-08d76bc76e9b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:44.148597 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-87763ecb-16ef-4732-af11-cb482e022abb req-94c2cc03-49f9-4067-befd-c120230ed247 service nova] Creating event network-vif-plugged:3e057dd1-11db-45a6-8a3f-f8f318956247 for instance 95e76105-cf05-4f29-9469-b3bb4b1f7472 on n-h1-852087-9 Sep 07 12:51:44.157740 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-87763ecb-16ef-4732-af11-cb482e022abb req-94c2cc03-49f9-4067-befd-c120230ed247 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079809 Sep 07 12:51:44.159119 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2102/4249] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:51:44.255150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-636e8d40-7ac9-49fb-a255-06214d7fe876 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:44.256724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-636e8d40-7ac9-49fb-a255-06214d7fe876 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:44.265852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-636e8d40-7ac9-49fb-a255-06214d7fe876 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:44.267280 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-636e8d40-7ac9-49fb-a255-06214d7fe876 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:44.267558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-636e8d40-7ac9-49fb-a255-06214d7fe876 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:44.268705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-636e8d40-7ac9-49fb-a255-06214d7fe876 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:44.269389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-636e8d40-7ac9-49fb-a255-06214d7fe876 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:44.270235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-636e8d40-7ac9-49fb-a255-06214d7fe876 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:44.534596 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-110b622e-ffc2-4db6-a09c-08d76bc76e9b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:44.548681 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-110b622e-ffc2-4db6-a09c-08d76bc76e9b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472" status: 200 len: 1333 microversion: 2.1 time: 0.447007 Sep 07 12:51:44.561524 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2148/4250] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:44 2022] GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 => generated 1333 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:44.598470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8268bf86-0f8e-4631-9350-00793990dee6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:44.602346 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8268bf86-0f8e-4631-9350-00793990dee6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:44.607515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8268bf86-0f8e-4631-9350-00793990dee6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:44.608186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8268bf86-0f8e-4631-9350-00793990dee6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:44.608703 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8268bf86-0f8e-4631-9350-00793990dee6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:44.609645 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8268bf86-0f8e-4631-9350-00793990dee6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:44.610188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8268bf86-0f8e-4631-9350-00793990dee6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:44.610689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8268bf86-0f8e-4631-9350-00793990dee6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:44.618458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-636e8d40-7ac9-49fb-a255-06214d7fe876 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:44.650336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-636e8d40-7ac9-49fb-a255-06214d7fe876 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:44.661911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-636e8d40-7ac9-49fb-a255-06214d7fe876 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:44.665814 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-636e8d40-7ac9-49fb-a255-06214d7fe876 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1723 microversion: 2.20 time: 0.414620 Sep 07 12:51:44.666794 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2103/4251] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:44 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1723 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:51:44.687840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-24399e57-6ff8-432e-8498-12b6af7af651 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:44.689665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-24399e57-6ff8-432e-8498-12b6af7af651 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:44.710434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24399e57-6ff8-432e-8498-12b6af7af651 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:44.711666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24399e57-6ff8-432e-8498-12b6af7af651 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:44.713916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24399e57-6ff8-432e-8498-12b6af7af651 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:44.716055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24399e57-6ff8-432e-8498-12b6af7af651 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:44.716819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24399e57-6ff8-432e-8498-12b6af7af651 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:44.717691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24399e57-6ff8-432e-8498-12b6af7af651 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:44.937400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8268bf86-0f8e-4631-9350-00793990dee6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:44.949691 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8268bf86-0f8e-4631-9350-00793990dee6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1733 microversion: 2.1 time: 0.359568 Sep 07 12:51:44.950306 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2149/4252] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:44 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1733 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:45.012830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-24399e57-6ff8-432e-8498-12b6af7af651 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c27a3ca32e4f4d976d1351372b0fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bfa5688d5406da8f755efff3cf54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:45.035958 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-24399e57-6ff8-432e-8498-12b6af7af651 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0" status: 200 len: 1517 microversion: 2.1 time: 0.359253 Sep 07 12:51:45.036585 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2104/4253] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:44 2022] GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0 => generated 1517 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:45.109699 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-deca271f-9e75-48b8-9195-dba666cb7949 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:45.111445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-deca271f-9e75-48b8-9195-dba666cb7949 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:45.124396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-deca271f-9e75-48b8-9195-dba666cb7949 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:45.125613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-deca271f-9e75-48b8-9195-dba666cb7949 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:45.126700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-deca271f-9e75-48b8-9195-dba666cb7949 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:45.127948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-deca271f-9e75-48b8-9195-dba666cb7949 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:45.128629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-deca271f-9e75-48b8-9195-dba666cb7949 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:45.129515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-deca271f-9e75-48b8-9195-dba666cb7949 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:45.148524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bf4e6acb-bed3-4fed-a191-4f50ec9d8ce8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:45.150601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bf4e6acb-bed3-4fed-a191-4f50ec9d8ce8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:45.165766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf4e6acb-bed3-4fed-a191-4f50ec9d8ce8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:45.166823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf4e6acb-bed3-4fed-a191-4f50ec9d8ce8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:45.167844 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf4e6acb-bed3-4fed-a191-4f50ec9d8ce8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:45.169446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf4e6acb-bed3-4fed-a191-4f50ec9d8ce8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:45.170819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf4e6acb-bed3-4fed-a191-4f50ec9d8ce8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:45.171682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf4e6acb-bed3-4fed-a191-4f50ec9d8ce8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:45.420301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-deca271f-9e75-48b8-9195-dba666cb7949 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:45.435905 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-deca271f-9e75-48b8-9195-dba666cb7949 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.334058 Sep 07 12:51:45.437612 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2150/4254] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:45 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:45.446627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8c32ed16-998e-4793-ab03-0739f40a93b0 req-165ca1d6-29b7-483a-8115-8ba0d51bc6d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aaad486-bd76-4c89-af5b-3443b3d53da0", "name": "network-vif-deleted", "tag": "907dde1f-7429-4a22-9b69-83154943daee"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:45.458079 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bf4e6acb-bed3-4fed-a191-4f50ec9d8ce8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:45.467309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8c32ed16-998e-4793-ab03-0739f40a93b0 req-165ca1d6-29b7-483a-8115-8ba0d51bc6d1 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:45.468114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8c32ed16-998e-4793-ab03-0739f40a93b0 req-165ca1d6-29b7-483a-8115-8ba0d51bc6d1 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:45.469598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8c32ed16-998e-4793-ab03-0739f40a93b0 req-165ca1d6-29b7-483a-8115-8ba0d51bc6d1 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:45.470652 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bf4e6acb-bed3-4fed-a191-4f50ec9d8ce8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1511 microversion: 2.1 time: 0.334941 Sep 07 12:51:45.479829 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2105/4255] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:45 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1511 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:45.487536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-520471f5-418f-4caf-9eba-d1bcdf13996c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:45.488723 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-520471f5-418f-4caf-9eba-d1bcdf13996c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:45.496040 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8c32ed16-998e-4793-ab03-0739f40a93b0 req-165ca1d6-29b7-483a-8115-8ba0d51bc6d1 service nova] Creating event network-vif-deleted:907dde1f-7429-4a22-9b69-83154943daee for instance 6aaad486-bd76-4c89-af5b-3443b3d53da0 on n-h1-852087-9 Sep 07 12:51:45.499509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-520471f5-418f-4caf-9eba-d1bcdf13996c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:45.500014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-520471f5-418f-4caf-9eba-d1bcdf13996c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:45.500736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-520471f5-418f-4caf-9eba-d1bcdf13996c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:45.502060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-520471f5-418f-4caf-9eba-d1bcdf13996c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:45.502887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-520471f5-418f-4caf-9eba-d1bcdf13996c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:45.503699 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-520471f5-418f-4caf-9eba-d1bcdf13996c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:45.505739 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8c32ed16-998e-4793-ab03-0739f40a93b0 req-165ca1d6-29b7-483a-8115-8ba0d51bc6d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066162 Sep 07 12:51:45.513687 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2151/4256] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:51:45.575882 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b85e1790-fb82-4407-800b-b0d99d08b0d6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:45.576959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b85e1790-fb82-4407-800b-b0d99d08b0d6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:45.584329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b85e1790-fb82-4407-800b-b0d99d08b0d6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:45.584829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b85e1790-fb82-4407-800b-b0d99d08b0d6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:45.585274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b85e1790-fb82-4407-800b-b0d99d08b0d6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:45.586042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b85e1790-fb82-4407-800b-b0d99d08b0d6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:45.586506 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b85e1790-fb82-4407-800b-b0d99d08b0d6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:45.586946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b85e1790-fb82-4407-800b-b0d99d08b0d6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:45.742398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-520471f5-418f-4caf-9eba-d1bcdf13996c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:45.754307 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-520471f5-418f-4caf-9eba-d1bcdf13996c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.273825 Sep 07 12:51:45.755275 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2106/4257] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:45 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:45.765112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-54d11ea4-049b-4c8d-9027-e0f5945e69b3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:45.766086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-54d11ea4-049b-4c8d-9027-e0f5945e69b3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:45.780939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54d11ea4-049b-4c8d-9027-e0f5945e69b3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:45.781601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54d11ea4-049b-4c8d-9027-e0f5945e69b3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:45.782556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54d11ea4-049b-4c8d-9027-e0f5945e69b3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:45.783651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54d11ea4-049b-4c8d-9027-e0f5945e69b3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:45.784453 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54d11ea4-049b-4c8d-9027-e0f5945e69b3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:45.785282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54d11ea4-049b-4c8d-9027-e0f5945e69b3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:45.821749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b85e1790-fb82-4407-800b-b0d99d08b0d6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:45.833155 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b85e1790-fb82-4407-800b-b0d99d08b0d6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472" status: 200 len: 1333 microversion: 2.1 time: 0.262091 Sep 07 12:51:45.834058 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2152/4258] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:45 2022] GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 => generated 1333 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:45.844325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3e6b97c0-c25b-4217-92b8-3efe187afb51 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:45.845423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3e6b97c0-c25b-4217-92b8-3efe187afb51 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:45.858430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e6b97c0-c25b-4217-92b8-3efe187afb51 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:45.859350 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e6b97c0-c25b-4217-92b8-3efe187afb51 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:45.860473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e6b97c0-c25b-4217-92b8-3efe187afb51 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:45.863912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e6b97c0-c25b-4217-92b8-3efe187afb51 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:45.865054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e6b97c0-c25b-4217-92b8-3efe187afb51 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:45.866293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e6b97c0-c25b-4217-92b8-3efe187afb51 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:45.938991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3e6b97c0-c25b-4217-92b8-3efe187afb51 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Unlocking {{(pid=122433) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 07 12:51:46.006317 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3e6b97c0-c25b-4217-92b8-3efe187afb51 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action" status: 202 len: 0 microversion: 2.1 time: 0.169751 Sep 07 12:51:46.009543 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2153/4259] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:45 2022] POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:51:46.012403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-23a094e2-d38b-46a6-a802-1171a90c47c9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:46.013105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-23a094e2-d38b-46a6-a802-1171a90c47c9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:46.021137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23a094e2-d38b-46a6-a802-1171a90c47c9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:46.021686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23a094e2-d38b-46a6-a802-1171a90c47c9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:46.022139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23a094e2-d38b-46a6-a802-1171a90c47c9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:46.023091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23a094e2-d38b-46a6-a802-1171a90c47c9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:46.023543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23a094e2-d38b-46a6-a802-1171a90c47c9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:46.024103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23a094e2-d38b-46a6-a802-1171a90c47c9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:46.050747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-54d11ea4-049b-4c8d-9027-e0f5945e69b3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:46.063162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-54d11ea4-049b-4c8d-9027-e0f5945e69b3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:46.064933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-54d11ea4-049b-4c8d-9027-e0f5945e69b3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:46.067011 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-54d11ea4-049b-4c8d-9027-e0f5945e69b3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1723 microversion: 2.20 time: 0.309927 Sep 07 12:51:46.067751 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2107/4260] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:45 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1723 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:51:46.075503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3f96e3f2-598d-435d-8071-2c7a966cf5e9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:46.076131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3f96e3f2-598d-435d-8071-2c7a966cf5e9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:46.099201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f96e3f2-598d-435d-8071-2c7a966cf5e9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:46.099715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f96e3f2-598d-435d-8071-2c7a966cf5e9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:46.100162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f96e3f2-598d-435d-8071-2c7a966cf5e9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:46.100892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f96e3f2-598d-435d-8071-2c7a966cf5e9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:46.101357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f96e3f2-598d-435d-8071-2c7a966cf5e9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:46.104443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f96e3f2-598d-435d-8071-2c7a966cf5e9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:46.378596 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-23a094e2-d38b-46a6-a802-1171a90c47c9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:46.388853 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-23a094e2-d38b-46a6-a802-1171a90c47c9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1733 microversion: 2.1 time: 0.380707 Sep 07 12:51:46.389427 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2154/4261] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:46 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1733 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:46.412443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-83aae258-30e4-44f3-a9f0-39c4f5cf8b39 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:46.413088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-83aae258-30e4-44f3-a9f0-39c4f5cf8b39 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] [instance: 6aaad486-bd76-4c89-af5b-3443b3d53da0] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:46.420413 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83aae258-30e4-44f3-a9f0-39c4f5cf8b39 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:46.420919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83aae258-30e4-44f3-a9f0-39c4f5cf8b39 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:46.421339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83aae258-30e4-44f3-a9f0-39c4f5cf8b39 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:46.422116 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83aae258-30e4-44f3-a9f0-39c4f5cf8b39 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:46.422608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83aae258-30e4-44f3-a9f0-39c4f5cf8b39 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:46.423040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83aae258-30e4-44f3-a9f0-39c4f5cf8b39 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:46.426128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3f96e3f2-598d-435d-8071-2c7a966cf5e9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:46.438367 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-83aae258-30e4-44f3-a9f0-39c4f5cf8b39 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] HTTP exception thrown: Instance 6aaad486-bd76-4c89-af5b-3443b3d53da0 could not be found. Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-83aae258-30e4-44f3-a9f0-39c4f5cf8b39 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Request method failure captured: Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0 HTTP/1.1 Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJN6N1kjGi4p4zlIZ-MsXyEy7HXrm7zCzopdIYKEw3BspuglKORnXbw97eWbduBZiUik6Q97i7IBdpLdVw82NLq9mj4blEv_8H62C2CKEJLdbyB72NvJZaolB4eQunoDK-X6x7BQ3v6P4bctEAdzsLFbSY-ueVtlir4StLV1Bzj7PQs Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: ab7bfa5688d5406da8f755efff3cf54e Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ListServerFiltersTestJSON-2038474308 Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7bfa5688d5406da8f755efff3cf54e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ab7bfa5688d5406da8f755efff3cf54e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ab7bfa5688d5406da8f755efff3cf54e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab7bfa5688d5406da8f755efff3cf54e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ListServerFiltersTestJSON-2038474308 Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: ab7bfa5688d5406da8f755efff3cf54e Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2038474308 Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ListServerFiltersTestJSON-2038474308-project Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 30c27a3ca32e4f4d976d1351372b0fb1 Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ListServerFiltersTestJSON-2038474308-project Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 6aaad486-bd76-4c89-af5b-3443b3d53da0 could not be found. Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '6aaad486-bd76-4c89-af5b-3443b3d53da0'} Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aaad486-bd76-4c89-af5b-3443b3d53da0 could not be found. Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aaad486-bd76-4c89-af5b-3443b3d53da0 could not be found. Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:51:46.439997 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:46.446696 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:51:46.446696 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:51:46.446696 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:51:46.446696 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:51:46.446696 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:51:46.446696 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aaad486-bd76-4c89-af5b-3443b3d53da0 could not be found. Sep 07 12:51:46.446696 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:51:46.446696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-83aae258-30e4-44f3-a9f0-39c4f5cf8b39 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] Returning 404 to user: Instance 6aaad486-bd76-4c89-af5b-3443b3d53da0 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:51:46.447524 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3f96e3f2-598d-435d-8071-2c7a966cf5e9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.371902 Sep 07 12:51:46.447660 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-83aae258-30e4-44f3-a9f0-39c4f5cf8b39 tempest-ListServerFiltersTestJSON-2038474308 tempest-ListServerFiltersTestJSON-2038474308-project] 10.222.0.16 "GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0" status: 404 len: 111 microversion: 2.1 time: 0.038322 Sep 07 12:51:46.447660 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2155/4262] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:46 2022] GET /compute/v2.1/servers/6aaad486-bd76-4c89-af5b-3443b3d53da0 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:51:46.454066 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2108/4263] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:46 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:46.454237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-2d923f7f-9cf3-4e9a-aea4-71abe9aa3a7a req-3d8351e8-891f-41d5-8dfa-c257a5f455df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e76105-cf05-4f29-9469-b3bb4b1f7472", "name": "network-vif-plugged", "status": "completed", "tag": "dee55a92-0caf-4a4d-8da1-9359d0c72291"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:46.464423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2d923f7f-9cf3-4e9a-aea4-71abe9aa3a7a req-3d8351e8-891f-41d5-8dfa-c257a5f455df service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:46.465208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2d923f7f-9cf3-4e9a-aea4-71abe9aa3a7a req-3d8351e8-891f-41d5-8dfa-c257a5f455df service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:46.465781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2d923f7f-9cf3-4e9a-aea4-71abe9aa3a7a req-3d8351e8-891f-41d5-8dfa-c257a5f455df service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:46.480000 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-2d923f7f-9cf3-4e9a-aea4-71abe9aa3a7a req-3d8351e8-891f-41d5-8dfa-c257a5f455df service nova] Creating event network-vif-plugged:dee55a92-0caf-4a4d-8da1-9359d0c72291 for instance 95e76105-cf05-4f29-9469-b3bb4b1f7472 on n-h1-852087-9 Sep 07 12:51:46.486224 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-2d923f7f-9cf3-4e9a-aea4-71abe9aa3a7a req-3d8351e8-891f-41d5-8dfa-c257a5f455df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042274 Sep 07 12:51:46.487725 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2156/4264] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:51:46.496105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-77e765ee-7c72-402c-9eb7-6472b14c7c3a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:46.497192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-77e765ee-7c72-402c-9eb7-6472b14c7c3a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:46.500973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5d76a661-74af-4d21-8aec-da877cbccb5d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:46.501979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5d76a661-74af-4d21-8aec-da877cbccb5d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:46.509121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77e765ee-7c72-402c-9eb7-6472b14c7c3a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:46.510536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77e765ee-7c72-402c-9eb7-6472b14c7c3a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:46.511343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77e765ee-7c72-402c-9eb7-6472b14c7c3a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:46.512418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d76a661-74af-4d21-8aec-da877cbccb5d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:46.512917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d76a661-74af-4d21-8aec-da877cbccb5d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:46.513358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77e765ee-7c72-402c-9eb7-6472b14c7c3a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:46.513584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d76a661-74af-4d21-8aec-da877cbccb5d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:46.514119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d76a661-74af-4d21-8aec-da877cbccb5d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:46.514279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77e765ee-7c72-402c-9eb7-6472b14c7c3a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:46.514580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d76a661-74af-4d21-8aec-da877cbccb5d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:46.515657 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d76a661-74af-4d21-8aec-da877cbccb5d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:46.515848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77e765ee-7c72-402c-9eb7-6472b14c7c3a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:46.541687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:47.286680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-77e765ee-7c72-402c-9eb7-6472b14c7c3a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:47.290002 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5d76a661-74af-4d21-8aec-da877cbccb5d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:47.301404 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5d76a661-74af-4d21-8aec-da877cbccb5d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1511 microversion: 2.1 time: 0.807766 Sep 07 12:51:47.301823 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-77e765ee-7c72-402c-9eb7-6472b14c7c3a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.813091 Sep 07 12:51:47.302733 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2157/4265] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:46 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1511 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:47.308646 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9da5825e-7576-4321-90f5-ff75045040d6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:47.309541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9da5825e-7576-4321-90f5-ff75045040d6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:47.316180 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2109/4266] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:46 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:47.322426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bdc65f39-c58f-4ff4-9242-19e1021b040b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:47.323187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bdc65f39-c58f-4ff4-9242-19e1021b040b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:47.329076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9da5825e-7576-4321-90f5-ff75045040d6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:47.329945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9da5825e-7576-4321-90f5-ff75045040d6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:47.330666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9da5825e-7576-4321-90f5-ff75045040d6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:47.332280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9da5825e-7576-4321-90f5-ff75045040d6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:47.332914 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9da5825e-7576-4321-90f5-ff75045040d6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:47.333617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9da5825e-7576-4321-90f5-ff75045040d6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:47.342447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdc65f39-c58f-4ff4-9242-19e1021b040b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:47.343328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdc65f39-c58f-4ff4-9242-19e1021b040b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:47.344125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdc65f39-c58f-4ff4-9242-19e1021b040b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:47.345281 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdc65f39-c58f-4ff4-9242-19e1021b040b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:47.346147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdc65f39-c58f-4ff4-9242-19e1021b040b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:47.346913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdc65f39-c58f-4ff4-9242-19e1021b040b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:47.645348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9da5825e-7576-4321-90f5-ff75045040d6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:47.650191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bdc65f39-c58f-4ff4-9242-19e1021b040b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:47.659883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bdc65f39-c58f-4ff4-9242-19e1021b040b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:47.663168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bdc65f39-c58f-4ff4-9242-19e1021b040b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:47.665448 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9da5825e-7576-4321-90f5-ff75045040d6 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472" status: 200 len: 1333 microversion: 2.1 time: 0.359735 Sep 07 12:51:47.669104 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2158/4267] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:47 2022] GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 => generated 1333 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:47.669894 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bdc65f39-c58f-4ff4-9242-19e1021b040b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1723 microversion: 2.20 time: 0.352062 Sep 07 12:51:47.670860 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2110/4268] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:47 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1723 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:51:47.676370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-928325ef-085b-49ac-81b7-26f55c562fa7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:47.677290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-928325ef-085b-49ac-81b7-26f55c562fa7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:47.681127 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-098bd6e3-429e-41cd-a2f0-3e87c03b535a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:47.682792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-098bd6e3-429e-41cd-a2f0-3e87c03b535a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:47.684602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-928325ef-085b-49ac-81b7-26f55c562fa7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:47.685089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-928325ef-085b-49ac-81b7-26f55c562fa7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:47.685770 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-928325ef-085b-49ac-81b7-26f55c562fa7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:47.686654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-928325ef-085b-49ac-81b7-26f55c562fa7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:47.687463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-928325ef-085b-49ac-81b7-26f55c562fa7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:47.688050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-928325ef-085b-49ac-81b7-26f55c562fa7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:47.701990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-098bd6e3-429e-41cd-a2f0-3e87c03b535a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:47.703519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-098bd6e3-429e-41cd-a2f0-3e87c03b535a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:47.705116 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-098bd6e3-429e-41cd-a2f0-3e87c03b535a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:47.707817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-098bd6e3-429e-41cd-a2f0-3e87c03b535a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:47.709055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-098bd6e3-429e-41cd-a2f0-3e87c03b535a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:47.714204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-098bd6e3-429e-41cd-a2f0-3e87c03b535a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:47.970691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-928325ef-085b-49ac-81b7-26f55c562fa7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:48.001125 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-928325ef-085b-49ac-81b7-26f55c562fa7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1733 microversion: 2.1 time: 0.327678 Sep 07 12:51:48.013548 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2111/4269] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:47 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1733 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:48.023673 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-098bd6e3-429e-41cd-a2f0-3e87c03b535a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:48.032466 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-098bd6e3-429e-41cd-a2f0-3e87c03b535a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.361487 Sep 07 12:51:48.033378 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2159/4270] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:47 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:48.074240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cc9af5e4-959c-4249-928d-7313183e6ca6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:48.075035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cc9af5e4-959c-4249-928d-7313183e6ca6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:48.085807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc9af5e4-959c-4249-928d-7313183e6ca6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:48.086819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc9af5e4-959c-4249-928d-7313183e6ca6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:48.087425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc9af5e4-959c-4249-928d-7313183e6ca6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:48.088857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc9af5e4-959c-4249-928d-7313183e6ca6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:48.089721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc9af5e4-959c-4249-928d-7313183e6ca6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:48.090459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc9af5e4-959c-4249-928d-7313183e6ca6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:48.126014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:48.208183 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cc9af5e4-959c-4249-928d-7313183e6ca6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action" status: 202 len: 0 microversion: 2.1 time: 0.140510 Sep 07 12:51:48.209457 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2112/4271] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:48 2022] POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:51:48.218534 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-42d66212-73e8-42ff-9336-664d3e133404 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:48.219190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-42d66212-73e8-42ff-9336-664d3e133404 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:48.221320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:48.227666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42d66212-73e8-42ff-9336-664d3e133404 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:48.228209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42d66212-73e8-42ff-9336-664d3e133404 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:48.228823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42d66212-73e8-42ff-9336-664d3e133404 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:48.229592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42d66212-73e8-42ff-9336-664d3e133404 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:48.230062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42d66212-73e8-42ff-9336-664d3e133404 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:48.230486 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42d66212-73e8-42ff-9336-664d3e133404 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:48.346038 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bb70189b-16f6-4196-923b-35dee3a33a67 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:48.347802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bb70189b-16f6-4196-923b-35dee3a33a67 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:48.360691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb70189b-16f6-4196-923b-35dee3a33a67 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:48.361940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb70189b-16f6-4196-923b-35dee3a33a67 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:48.362995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb70189b-16f6-4196-923b-35dee3a33a67 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:48.364723 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb70189b-16f6-4196-923b-35dee3a33a67 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:48.365909 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb70189b-16f6-4196-923b-35dee3a33a67 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:48.366970 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb70189b-16f6-4196-923b-35dee3a33a67 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:48.520514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-42d66212-73e8-42ff-9336-664d3e133404 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:48.530843 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-42d66212-73e8-42ff-9336-664d3e133404 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1674 microversion: 2.1 time: 0.316174 Sep 07 12:51:48.531524 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2160/4272] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:48 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1674 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:48.642267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bb70189b-16f6-4196-923b-35dee3a33a67 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:48.654846 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bb70189b-16f6-4196-923b-35dee3a33a67 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1511 microversion: 2.1 time: 0.317834 Sep 07 12:51:48.656251 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2113/4273] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:48 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1511 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:48.716401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-42bd8da7-a6b0-4e0d-9a9c-c0fdc95885d0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:48.717020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-42bd8da7-a6b0-4e0d-9a9c-c0fdc95885d0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:48.721109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1f8d5be7-2d67-4570-a4bb-505d46a0e686 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:48.721861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1f8d5be7-2d67-4570-a4bb-505d46a0e686 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:48.732218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42bd8da7-a6b0-4e0d-9a9c-c0fdc95885d0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:48.732585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f8d5be7-2d67-4570-a4bb-505d46a0e686 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:48.733147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42bd8da7-a6b0-4e0d-9a9c-c0fdc95885d0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:48.733577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f8d5be7-2d67-4570-a4bb-505d46a0e686 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:48.733885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42bd8da7-a6b0-4e0d-9a9c-c0fdc95885d0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:48.734521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f8d5be7-2d67-4570-a4bb-505d46a0e686 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:48.735225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f8d5be7-2d67-4570-a4bb-505d46a0e686 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:48.735732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42bd8da7-a6b0-4e0d-9a9c-c0fdc95885d0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:48.736207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f8d5be7-2d67-4570-a4bb-505d46a0e686 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:48.737091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f8d5be7-2d67-4570-a4bb-505d46a0e686 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:48.738065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42bd8da7-a6b0-4e0d-9a9c-c0fdc95885d0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:48.739450 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42bd8da7-a6b0-4e0d-9a9c-c0fdc95885d0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:49.038290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1f8d5be7-2d67-4570-a4bb-505d46a0e686 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:49.054692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-42bd8da7-a6b0-4e0d-9a9c-c0fdc95885d0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:49.062566 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1f8d5be7-2d67-4570-a4bb-505d46a0e686 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472" status: 200 len: 1333 microversion: 2.1 time: 0.352753 Sep 07 12:51:49.064243 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2114/4274] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:48 2022] GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 => generated 1333 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:49.071993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8142effe-1815-4917-81e3-b6df6d8a5b45 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:49.073393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-42bd8da7-a6b0-4e0d-9a9c-c0fdc95885d0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:49.073625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8142effe-1815-4917-81e3-b6df6d8a5b45 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:49.077633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-42bd8da7-a6b0-4e0d-9a9c-c0fdc95885d0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:49.082845 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-42bd8da7-a6b0-4e0d-9a9c-c0fdc95885d0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1723 microversion: 2.20 time: 0.375502 Sep 07 12:51:49.083963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8142effe-1815-4917-81e3-b6df6d8a5b45 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:49.084502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8142effe-1815-4917-81e3-b6df6d8a5b45 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:49.085124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8142effe-1815-4917-81e3-b6df6d8a5b45 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:49.088044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8142effe-1815-4917-81e3-b6df6d8a5b45 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:49.088044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8142effe-1815-4917-81e3-b6df6d8a5b45 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:49.088044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8142effe-1815-4917-81e3-b6df6d8a5b45 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:49.089382 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2161/4275] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:48 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1723 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:51:49.333711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8142effe-1815-4917-81e3-b6df6d8a5b45 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:49.351588 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8142effe-1815-4917-81e3-b6df6d8a5b45 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1733 microversion: 2.1 time: 0.285604 Sep 07 12:51:49.362194 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2115/4276] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:49 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1733 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:49.573366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b03a3e32-2643-4cb9-a858-311d212c67c0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:49.575216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b03a3e32-2643-4cb9-a858-311d212c67c0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:49.588189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b03a3e32-2643-4cb9-a858-311d212c67c0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:49.589233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b03a3e32-2643-4cb9-a858-311d212c67c0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:49.590071 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b03a3e32-2643-4cb9-a858-311d212c67c0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:49.591383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b03a3e32-2643-4cb9-a858-311d212c67c0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:49.592358 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b03a3e32-2643-4cb9-a858-311d212c67c0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:49.593224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b03a3e32-2643-4cb9-a858-311d212c67c0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:49.680906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-394a5bc8-3405-4943-a2bc-ecdac37e1a29 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:49.682481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-394a5bc8-3405-4943-a2bc-ecdac37e1a29 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:49.690572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-394a5bc8-3405-4943-a2bc-ecdac37e1a29 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:49.691073 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-394a5bc8-3405-4943-a2bc-ecdac37e1a29 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:49.693525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-394a5bc8-3405-4943-a2bc-ecdac37e1a29 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:49.694296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-394a5bc8-3405-4943-a2bc-ecdac37e1a29 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:49.694777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-394a5bc8-3405-4943-a2bc-ecdac37e1a29 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:49.695385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-394a5bc8-3405-4943-a2bc-ecdac37e1a29 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:49.990050 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b03a3e32-2643-4cb9-a858-311d212c67c0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:49.997402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-394a5bc8-3405-4943-a2bc-ecdac37e1a29 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:50.002332 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b03a3e32-2643-4cb9-a858-311d212c67c0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1654 microversion: 2.1 time: 0.436321 Sep 07 12:51:50.003306 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2162/4277] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:49 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1654 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:50.010593 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-394a5bc8-3405-4943-a2bc-ecdac37e1a29 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1532 microversion: 2.1 time: 0.334060 Sep 07 12:51:50.012215 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2116/4278] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:49 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1532 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:50.040512 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c73774c-255d-4119-80be-e7ae40280fbc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:50.041121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7c73774c-255d-4119-80be-e7ae40280fbc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:50.050224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c73774c-255d-4119-80be-e7ae40280fbc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:50.050979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c73774c-255d-4119-80be-e7ae40280fbc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:50.051538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c73774c-255d-4119-80be-e7ae40280fbc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:50.052672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c73774c-255d-4119-80be-e7ae40280fbc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:50.053460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c73774c-255d-4119-80be-e7ae40280fbc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:50.054237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c73774c-255d-4119-80be-e7ae40280fbc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:50.110757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a5c08080-ac85-48ac-a58e-ac9610e21927 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:50.112284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a5c08080-ac85-48ac-a58e-ac9610e21927 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:50.131350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5c08080-ac85-48ac-a58e-ac9610e21927 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:50.132234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5c08080-ac85-48ac-a58e-ac9610e21927 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:50.132988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5c08080-ac85-48ac-a58e-ac9610e21927 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:50.134411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5c08080-ac85-48ac-a58e-ac9610e21927 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:50.135276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5c08080-ac85-48ac-a58e-ac9610e21927 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:50.136304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5c08080-ac85-48ac-a58e-ac9610e21927 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:50.160236 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7c73774c-255d-4119-80be-e7ae40280fbc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action" status: 202 len: 0 microversion: 2.1 time: 0.129563 Sep 07 12:51:50.161800 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2163/4279] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:51:50 2022] POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:51:50.184002 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5a5653df-6fd0-4353-9652-ed4b3fb1245c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:50.185729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5a5653df-6fd0-4353-9652-ed4b3fb1245c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:50.200770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a5653df-6fd0-4353-9652-ed4b3fb1245c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:50.201834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a5653df-6fd0-4353-9652-ed4b3fb1245c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:50.203723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a5653df-6fd0-4353-9652-ed4b3fb1245c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:50.205311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a5653df-6fd0-4353-9652-ed4b3fb1245c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:50.206178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a5653df-6fd0-4353-9652-ed4b3fb1245c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:50.207384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a5653df-6fd0-4353-9652-ed4b3fb1245c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:50.447952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a5c08080-ac85-48ac-a58e-ac9610e21927 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:50.483161 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a5c08080-ac85-48ac-a58e-ac9610e21927 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472" status: 200 len: 1669 microversion: 2.1 time: 0.381036 Sep 07 12:51:50.497969 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2117/4280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:50 2022] GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 => generated 1669 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:50.517601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5a5653df-6fd0-4353-9652-ed4b3fb1245c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:50.517601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5a5653df-6fd0-4353-9652-ed4b3fb1245c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:50.517601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5a5653df-6fd0-4353-9652-ed4b3fb1245c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:50.517601 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5a5653df-6fd0-4353-9652-ed4b3fb1245c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1723 microversion: 2.20 time: 0.354158 Sep 07 12:51:50.532625 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2164/4281] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:50 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1723 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:51:50.535778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8198dbbd-b2eb-4d8e-9e87-96da7603b745 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:50.537896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8198dbbd-b2eb-4d8e-9e87-96da7603b745 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:50.547288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e39eae9f-9cb6-4fc1-a58f-6c7561fd9497 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:50.550320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e39eae9f-9cb6-4fc1-a58f-6c7561fd9497 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:50.552573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8198dbbd-b2eb-4d8e-9e87-96da7603b745 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:50.553417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8198dbbd-b2eb-4d8e-9e87-96da7603b745 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:50.554471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8198dbbd-b2eb-4d8e-9e87-96da7603b745 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:50.555808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8198dbbd-b2eb-4d8e-9e87-96da7603b745 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:50.556966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8198dbbd-b2eb-4d8e-9e87-96da7603b745 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:50.558009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8198dbbd-b2eb-4d8e-9e87-96da7603b745 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:50.563353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e39eae9f-9cb6-4fc1-a58f-6c7561fd9497 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:50.564364 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e39eae9f-9cb6-4fc1-a58f-6c7561fd9497 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:50.565443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e39eae9f-9cb6-4fc1-a58f-6c7561fd9497 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:50.566782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e39eae9f-9cb6-4fc1-a58f-6c7561fd9497 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:50.567794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e39eae9f-9cb6-4fc1-a58f-6c7561fd9497 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:50.568663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e39eae9f-9cb6-4fc1-a58f-6c7561fd9497 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:50.830144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8198dbbd-b2eb-4d8e-9e87-96da7603b745 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:50.841885 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8198dbbd-b2eb-4d8e-9e87-96da7603b745 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.341532 Sep 07 12:51:50.843559 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2118/4282] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:50 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:50.849149 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-16e3ff67-6783-4e18-9087-550c35d30f5f tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:50.850074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-16e3ff67-6783-4e18-9087-550c35d30f5f tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:50.856986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16e3ff67-6783-4e18-9087-550c35d30f5f tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:50.858002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16e3ff67-6783-4e18-9087-550c35d30f5f tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:50.858675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16e3ff67-6783-4e18-9087-550c35d30f5f tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:50.859641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16e3ff67-6783-4e18-9087-550c35d30f5f tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:50.860346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16e3ff67-6783-4e18-9087-550c35d30f5f tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:50.860997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16e3ff67-6783-4e18-9087-550c35d30f5f tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:50.896744 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-16e3ff67-6783-4e18-9087-550c35d30f5f tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472/ips" status: 200 len: 180 microversion: 2.1 time: 0.051665 Sep 07 12:51:50.897993 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2119/4283] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Sep 7 12:51:50 2022] GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472/ips => generated 180 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:51:50.906105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e39eae9f-9cb6-4fc1-a58f-6c7561fd9497 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:50.913541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6fb1656a-dbdd-4ce5-a4c4-4d1e8796b7ff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:50.914195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6fb1656a-dbdd-4ce5-a4c4-4d1e8796b7ff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:50.923024 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e39eae9f-9cb6-4fc1-a58f-6c7561fd9497 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1733 microversion: 2.1 time: 0.385971 Sep 07 12:51:50.923895 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2165/4284] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:50 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1733 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:50.924655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6fb1656a-dbdd-4ce5-a4c4-4d1e8796b7ff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:50.925560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6fb1656a-dbdd-4ce5-a4c4-4d1e8796b7ff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:50.926568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6fb1656a-dbdd-4ce5-a4c4-4d1e8796b7ff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:50.928047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6fb1656a-dbdd-4ce5-a4c4-4d1e8796b7ff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:50.930336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fc24c79b-08bd-4e86-b635-3c196e8bf31f tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:50.930528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6fb1656a-dbdd-4ce5-a4c4-4d1e8796b7ff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:50.932006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fc24c79b-08bd-4e86-b635-3c196e8bf31f tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:50.932374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6fb1656a-dbdd-4ce5-a4c4-4d1e8796b7ff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:50.941543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc24c79b-08bd-4e86-b635-3c196e8bf31f tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:50.942345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc24c79b-08bd-4e86-b635-3c196e8bf31f tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:50.943112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc24c79b-08bd-4e86-b635-3c196e8bf31f tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:50.943908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc24c79b-08bd-4e86-b635-3c196e8bf31f tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:50.944389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc24c79b-08bd-4e86-b635-3c196e8bf31f tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:50.944825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc24c79b-08bd-4e86-b635-3c196e8bf31f tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:50.977783 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fc24c79b-08bd-4e86-b635-3c196e8bf31f tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:51:51.082826 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fc24c79b-08bd-4e86-b635-3c196e8bf31f tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "DELETE /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472" status: 204 len: 0 microversion: 2.1 time: 0.156087 Sep 07 12:51:51.084003 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2166/4285] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:51:50 2022] DELETE /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:51:51.094179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6bd2c3a6-e322-4182-acf4-8bf6ec7747a2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:51.095416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6bd2c3a6-e322-4182-acf4-8bf6ec7747a2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:51.104039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bd2c3a6-e322-4182-acf4-8bf6ec7747a2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:51.104827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bd2c3a6-e322-4182-acf4-8bf6ec7747a2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:51.105568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bd2c3a6-e322-4182-acf4-8bf6ec7747a2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:51.106479 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bd2c3a6-e322-4182-acf4-8bf6ec7747a2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:51.107155 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bd2c3a6-e322-4182-acf4-8bf6ec7747a2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:51.107765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bd2c3a6-e322-4182-acf4-8bf6ec7747a2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:51.191455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6fb1656a-dbdd-4ce5-a4c4-4d1e8796b7ff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:51.218701 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6fb1656a-dbdd-4ce5-a4c4-4d1e8796b7ff tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.318651 Sep 07 12:51:51.220887 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2120/4286] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:50 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:51.231100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8a5aa293-efe1-4832-8f76-38b78ad5c4d0 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:51.232451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8a5aa293-efe1-4832-8f76-38b78ad5c4d0 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:51.245203 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a5aa293-efe1-4832-8f76-38b78ad5c4d0 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:51.246570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a5aa293-efe1-4832-8f76-38b78ad5c4d0 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:51.247605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a5aa293-efe1-4832-8f76-38b78ad5c4d0 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:51.249691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a5aa293-efe1-4832-8f76-38b78ad5c4d0 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:51.250857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a5aa293-efe1-4832-8f76-38b78ad5c4d0 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:51.251946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a5aa293-efe1-4832-8f76-38b78ad5c4d0 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:51.452454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6bd2c3a6-e322-4182-acf4-8bf6ec7747a2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:51.469978 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6bd2c3a6-e322-4182-acf4-8bf6ec7747a2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1532 microversion: 2.1 time: 0.383901 Sep 07 12:51:51.470881 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2167/4287] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:51 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1532 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:51.480756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c06e67b6-c136-4efd-9b9f-3bb5fb872896 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:51.482319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c06e67b6-c136-4efd-9b9f-3bb5fb872896 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:51.497390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c06e67b6-c136-4efd-9b9f-3bb5fb872896 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:51.497390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c06e67b6-c136-4efd-9b9f-3bb5fb872896 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:51.497390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c06e67b6-c136-4efd-9b9f-3bb5fb872896 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:51.499312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c06e67b6-c136-4efd-9b9f-3bb5fb872896 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:51.500293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c06e67b6-c136-4efd-9b9f-3bb5fb872896 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:51.500920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c06e67b6-c136-4efd-9b9f-3bb5fb872896 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:51.614128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8a5aa293-efe1-4832-8f76-38b78ad5c4d0 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:51.639409 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8a5aa293-efe1-4832-8f76-38b78ad5c4d0 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472" status: 200 len: 1675 microversion: 2.1 time: 0.415979 Sep 07 12:51:51.641551 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2121/4288] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:51 2022] GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 => generated 1675 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:51.650492 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6d667eaf-607f-4f2e-a513-b9d8adf628c7 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:51.651983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6d667eaf-607f-4f2e-a513-b9d8adf628c7 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:51.664360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d667eaf-607f-4f2e-a513-b9d8adf628c7 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:51.666109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d667eaf-607f-4f2e-a513-b9d8adf628c7 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:51.667146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d667eaf-607f-4f2e-a513-b9d8adf628c7 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:51.668778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d667eaf-607f-4f2e-a513-b9d8adf628c7 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:51.669811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d667eaf-607f-4f2e-a513-b9d8adf628c7 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:51.670698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d667eaf-607f-4f2e-a513-b9d8adf628c7 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:51.914064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c06e67b6-c136-4efd-9b9f-3bb5fb872896 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:51.923668 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c06e67b6-c136-4efd-9b9f-3bb5fb872896 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.451221 Sep 07 12:51:51.924652 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2168/4289] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:51 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:51.969995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c1415bce-fba2-493b-9d3b-1ed937a021d8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:51.971442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c1415bce-fba2-493b-9d3b-1ed937a021d8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:51.982469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1415bce-fba2-493b-9d3b-1ed937a021d8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:51.983625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1415bce-fba2-493b-9d3b-1ed937a021d8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:51.984628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1415bce-fba2-493b-9d3b-1ed937a021d8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:51.986066 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1415bce-fba2-493b-9d3b-1ed937a021d8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:51.987057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1415bce-fba2-493b-9d3b-1ed937a021d8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:51.988036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1415bce-fba2-493b-9d3b-1ed937a021d8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:52.006569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6d667eaf-607f-4f2e-a513-b9d8adf628c7 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:52.027441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6d667eaf-607f-4f2e-a513-b9d8adf628c7 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:52.031400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6d667eaf-607f-4f2e-a513-b9d8adf628c7 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:52.034262 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6d667eaf-607f-4f2e-a513-b9d8adf628c7 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1723 microversion: 2.20 time: 0.391151 Sep 07 12:51:52.036180 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2122/4290] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:51 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1723 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:51:52.045697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-105e6cad-16e1-43f3-92b0-afb92a6cb83d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:52.047020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-105e6cad-16e1-43f3-92b0-afb92a6cb83d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:52.061755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-105e6cad-16e1-43f3-92b0-afb92a6cb83d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:52.062808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-105e6cad-16e1-43f3-92b0-afb92a6cb83d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:52.063955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-105e6cad-16e1-43f3-92b0-afb92a6cb83d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:52.065289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-105e6cad-16e1-43f3-92b0-afb92a6cb83d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:52.066379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-105e6cad-16e1-43f3-92b0-afb92a6cb83d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:52.067416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-105e6cad-16e1-43f3-92b0-afb92a6cb83d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:52.332824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c1415bce-fba2-493b-9d3b-1ed937a021d8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:52.354087 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c1415bce-fba2-493b-9d3b-1ed937a021d8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.395834 Sep 07 12:51:52.370855 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2169/4291] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:51 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:52.403013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-95ef283e-dca0-4153-bff5-419c27337498 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:52.404167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-95ef283e-dca0-4153-bff5-419c27337498 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:52.416647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-105e6cad-16e1-43f3-92b0-afb92a6cb83d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:52.430221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95ef283e-dca0-4153-bff5-419c27337498 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:52.431333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95ef283e-dca0-4153-bff5-419c27337498 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:52.432571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95ef283e-dca0-4153-bff5-419c27337498 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:52.434060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95ef283e-dca0-4153-bff5-419c27337498 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:52.435454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95ef283e-dca0-4153-bff5-419c27337498 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:52.436547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95ef283e-dca0-4153-bff5-419c27337498 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:52.444260 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-105e6cad-16e1-43f3-92b0-afb92a6cb83d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1733 microversion: 2.1 time: 0.405857 Sep 07 12:51:52.445354 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2123/4292] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:52 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1733 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:52.515555 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c90b0dd7-b2dc-4838-95a7-0e4cca866f0f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:52.517152 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c90b0dd7-b2dc-4838-95a7-0e4cca866f0f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:52.535527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c90b0dd7-b2dc-4838-95a7-0e4cca866f0f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:52.538008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c90b0dd7-b2dc-4838-95a7-0e4cca866f0f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:52.541660 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c90b0dd7-b2dc-4838-95a7-0e4cca866f0f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:52.545076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c90b0dd7-b2dc-4838-95a7-0e4cca866f0f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:52.551062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c90b0dd7-b2dc-4838-95a7-0e4cca866f0f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:52.554210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c90b0dd7-b2dc-4838-95a7-0e4cca866f0f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:52.851170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-95ef283e-dca0-4153-bff5-419c27337498 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:52.860437 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-95ef283e-dca0-4153-bff5-419c27337498 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.465796 Sep 07 12:51:52.878011 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2170/4293] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:52 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:52.883956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2b8f03cc-536d-4085-abd2-847ae23779f0 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:52.884880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2b8f03cc-536d-4085-abd2-847ae23779f0 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:52.892000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b8f03cc-536d-4085-abd2-847ae23779f0 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:52.892778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b8f03cc-536d-4085-abd2-847ae23779f0 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:52.893389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b8f03cc-536d-4085-abd2-847ae23779f0 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:52.894573 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b8f03cc-536d-4085-abd2-847ae23779f0 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:52.895209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b8f03cc-536d-4085-abd2-847ae23779f0 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:52.895793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b8f03cc-536d-4085-abd2-847ae23779f0 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:52.921928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:52.937541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c90b0dd7-b2dc-4838-95a7-0e4cca866f0f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:52.948016 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c90b0dd7-b2dc-4838-95a7-0e4cca866f0f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1532 microversion: 2.1 time: 0.442708 Sep 07 12:51:52.965135 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2124/4294] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:52 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1532 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:52.972842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d7fff20-c654-482f-8fea-69f0e402713e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:52.973793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9d7fff20-c654-482f-8fea-69f0e402713e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:52.983742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d7fff20-c654-482f-8fea-69f0e402713e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:52.984690 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d7fff20-c654-482f-8fea-69f0e402713e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:52.985727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d7fff20-c654-482f-8fea-69f0e402713e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:52.986747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d7fff20-c654-482f-8fea-69f0e402713e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:52.987506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d7fff20-c654-482f-8fea-69f0e402713e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:52.988242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d7fff20-c654-482f-8fea-69f0e402713e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:53.356331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2b8f03cc-536d-4085-abd2-847ae23779f0 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:53.383498 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2b8f03cc-536d-4085-abd2-847ae23779f0 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472" status: 200 len: 1675 microversion: 2.1 time: 0.503293 Sep 07 12:51:53.388808 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2171/4295] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:52 2022] GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 => generated 1675 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:53.394026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-756fc196-7898-4df4-855a-2c94ef4c68ae tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:53.394677 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-756fc196-7898-4df4-855a-2c94ef4c68ae tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:53.416418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-756fc196-7898-4df4-855a-2c94ef4c68ae tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:53.417422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-756fc196-7898-4df4-855a-2c94ef4c68ae tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:53.418398 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-756fc196-7898-4df4-855a-2c94ef4c68ae tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:53.419400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-756fc196-7898-4df4-855a-2c94ef4c68ae tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:53.420232 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-756fc196-7898-4df4-855a-2c94ef4c68ae tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:53.426190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-756fc196-7898-4df4-855a-2c94ef4c68ae tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:53.433120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9d7fff20-c654-482f-8fea-69f0e402713e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:53.448467 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9d7fff20-c654-482f-8fea-69f0e402713e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.481326 Sep 07 12:51:53.450229 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2125/4296] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:52 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:53.517380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32a32bc0-0f05-4369-85c8-1195abb6fa99 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:53.519226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-32a32bc0-0f05-4369-85c8-1195abb6fa99 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:53.533595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:53.558323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32a32bc0-0f05-4369-85c8-1195abb6fa99 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:53.559244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32a32bc0-0f05-4369-85c8-1195abb6fa99 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:53.560057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32a32bc0-0f05-4369-85c8-1195abb6fa99 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:53.561340 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32a32bc0-0f05-4369-85c8-1195abb6fa99 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:53.562208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32a32bc0-0f05-4369-85c8-1195abb6fa99 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:53.562991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32a32bc0-0f05-4369-85c8-1195abb6fa99 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:54.058638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-756fc196-7898-4df4-855a-2c94ef4c68ae tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:54.069574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-756fc196-7898-4df4-855a-2c94ef4c68ae tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:54.081334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-756fc196-7898-4df4-855a-2c94ef4c68ae tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:54.083333 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-756fc196-7898-4df4-855a-2c94ef4c68ae tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1723 microversion: 2.20 time: 0.697379 Sep 07 12:51:54.084191 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2172/4297] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:53 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1723 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:51:54.098742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c02a9857-51bb-4e8a-bc64-0b7eafef1606 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:54.099717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c02a9857-51bb-4e8a-bc64-0b7eafef1606 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:54.119734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c02a9857-51bb-4e8a-bc64-0b7eafef1606 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:54.120733 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c02a9857-51bb-4e8a-bc64-0b7eafef1606 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:54.121258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c02a9857-51bb-4e8a-bc64-0b7eafef1606 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:54.122123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c02a9857-51bb-4e8a-bc64-0b7eafef1606 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:54.122667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c02a9857-51bb-4e8a-bc64-0b7eafef1606 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:54.123173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c02a9857-51bb-4e8a-bc64-0b7eafef1606 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:54.242525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-32a32bc0-0f05-4369-85c8-1195abb6fa99 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:54.258235 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-32a32bc0-0f05-4369-85c8-1195abb6fa99 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1733 microversion: 2.1 time: 0.760765 Sep 07 12:51:54.259528 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2126/4298] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:53 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1733 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:54.274337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-1ab94ec4-abc3-4ba2-8001-d6f153130855 req-01b05a41-f1c7-4a69-b72b-c8d7a052faa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860", "name": "network-vif-plugged", "status": "completed", "tag": "01afecc6-db9f-4ad9-84b4-c7038640dcd0"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:54.306685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1ab94ec4-abc3-4ba2-8001-d6f153130855 req-01b05a41-f1c7-4a69-b72b-c8d7a052faa2 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:54.307296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1ab94ec4-abc3-4ba2-8001-d6f153130855 req-01b05a41-f1c7-4a69-b72b-c8d7a052faa2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:54.307824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1ab94ec4-abc3-4ba2-8001-d6f153130855 req-01b05a41-f1c7-4a69-b72b-c8d7a052faa2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:54.329952 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-1ab94ec4-abc3-4ba2-8001-d6f153130855 req-01b05a41-f1c7-4a69-b72b-c8d7a052faa2 service nova] Creating event network-vif-plugged:01afecc6-db9f-4ad9-84b4-c7038640dcd0 for instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 on n-h1-852087-9 Sep 07 12:51:54.352736 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-1ab94ec4-abc3-4ba2-8001-d6f153130855 req-01b05a41-f1c7-4a69-b72b-c8d7a052faa2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090492 Sep 07 12:51:54.354285 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2127/4299] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:51:54.435641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dce77598-f556-4a64-8432-0ae81602a871 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:54.442391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dce77598-f556-4a64-8432-0ae81602a871 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:54.456184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dce77598-f556-4a64-8432-0ae81602a871 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:54.457151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dce77598-f556-4a64-8432-0ae81602a871 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:54.457930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dce77598-f556-4a64-8432-0ae81602a871 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:54.459120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dce77598-f556-4a64-8432-0ae81602a871 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:54.460118 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dce77598-f556-4a64-8432-0ae81602a871 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:54.460791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dce77598-f556-4a64-8432-0ae81602a871 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:54.747718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c02a9857-51bb-4e8a-bc64-0b7eafef1606 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:54.767348 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c02a9857-51bb-4e8a-bc64-0b7eafef1606 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1532 microversion: 2.1 time: 0.678938 Sep 07 12:51:54.769898 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2173/4300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:54 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1532 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:55.017258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dce77598-f556-4a64-8432-0ae81602a871 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:55.031184 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dce77598-f556-4a64-8432-0ae81602a871 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472" status: 200 len: 1675 microversion: 2.1 time: 0.609363 Sep 07 12:51:55.032457 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2128/4301] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:54 2022] GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 => generated 1675 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:55.137568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1b44b3be-5db2-4d69-a671-383a28f9b2e2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:55.140715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1b44b3be-5db2-4d69-a671-383a28f9b2e2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:55.166787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b44b3be-5db2-4d69-a671-383a28f9b2e2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:55.167589 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b44b3be-5db2-4d69-a671-383a28f9b2e2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:55.168380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b44b3be-5db2-4d69-a671-383a28f9b2e2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:55.172629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b44b3be-5db2-4d69-a671-383a28f9b2e2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:55.180690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b44b3be-5db2-4d69-a671-383a28f9b2e2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:55.182498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b44b3be-5db2-4d69-a671-383a28f9b2e2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:55.230787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-807d69fd-841d-4995-a6b1-8c93e3265587 req-686ab364-9bdb-459a-a29a-731d9e0f458a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e76105-cf05-4f29-9469-b3bb4b1f7472", "name": "network-vif-deleted", "tag": "3e057dd1-11db-45a6-8a3f-f8f318956247"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:55.261737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-807d69fd-841d-4995-a6b1-8c93e3265587 req-686ab364-9bdb-459a-a29a-731d9e0f458a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:55.262257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-807d69fd-841d-4995-a6b1-8c93e3265587 req-686ab364-9bdb-459a-a29a-731d9e0f458a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:55.262701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-807d69fd-841d-4995-a6b1-8c93e3265587 req-686ab364-9bdb-459a-a29a-731d9e0f458a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:55.285757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:55.327459 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-807d69fd-841d-4995-a6b1-8c93e3265587 req-686ab364-9bdb-459a-a29a-731d9e0f458a service nova] Creating event network-vif-deleted:3e057dd1-11db-45a6-8a3f-f8f318956247 for instance 95e76105-cf05-4f29-9469-b3bb4b1f7472 on n-h1-852087-9 Sep 07 12:51:55.352989 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-807d69fd-841d-4995-a6b1-8c93e3265587 req-686ab364-9bdb-459a-a29a-731d9e0f458a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121988 Sep 07 12:51:55.354148 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2129/4302] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:51:55.364813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d34a8886-ee87-4c7d-8a8c-7e54f18fe809 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:55.365546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d34a8886-ee87-4c7d-8a8c-7e54f18fe809 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:55.378838 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d34a8886-ee87-4c7d-8a8c-7e54f18fe809 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:55.379369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d34a8886-ee87-4c7d-8a8c-7e54f18fe809 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:55.380894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d34a8886-ee87-4c7d-8a8c-7e54f18fe809 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:55.383026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d34a8886-ee87-4c7d-8a8c-7e54f18fe809 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:55.383806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d34a8886-ee87-4c7d-8a8c-7e54f18fe809 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:55.384164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d34a8886-ee87-4c7d-8a8c-7e54f18fe809 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:55.746049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1b44b3be-5db2-4d69-a671-383a28f9b2e2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:55.762665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1b44b3be-5db2-4d69-a671-383a28f9b2e2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:55.764417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1b44b3be-5db2-4d69-a671-383a28f9b2e2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:55.766069 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1b44b3be-5db2-4d69-a671-383a28f9b2e2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1723 microversion: 2.20 time: 0.642115 Sep 07 12:51:55.769658 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2174/4303] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:55 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1723 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:51:55.809389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-209bb200-5212-4938-87e6-20f9570437a5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:55.810295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-209bb200-5212-4938-87e6-20f9570437a5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:55.818779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-209bb200-5212-4938-87e6-20f9570437a5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:55.820269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-209bb200-5212-4938-87e6-20f9570437a5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:55.820867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-209bb200-5212-4938-87e6-20f9570437a5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:55.821741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-209bb200-5212-4938-87e6-20f9570437a5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:55.822449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-209bb200-5212-4938-87e6-20f9570437a5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:55.823087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-209bb200-5212-4938-87e6-20f9570437a5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:55.860053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d34a8886-ee87-4c7d-8a8c-7e54f18fe809 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:55.877473 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d34a8886-ee87-4c7d-8a8c-7e54f18fe809 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1733 microversion: 2.1 time: 0.521513 Sep 07 12:51:55.881267 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2130/4304] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:55 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1733 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:56.061016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-573aa17c-96f9-4219-8615-3a2a138e8759 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:56.061895 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-573aa17c-96f9-4219-8615-3a2a138e8759 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:56.081686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-573aa17c-96f9-4219-8615-3a2a138e8759 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:56.082402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-573aa17c-96f9-4219-8615-3a2a138e8759 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:56.082950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-573aa17c-96f9-4219-8615-3a2a138e8759 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:56.083805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-573aa17c-96f9-4219-8615-3a2a138e8759 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:56.084361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-573aa17c-96f9-4219-8615-3a2a138e8759 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:56.084915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-573aa17c-96f9-4219-8615-3a2a138e8759 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:56.386771 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-209bb200-5212-4938-87e6-20f9570437a5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:56.410408 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-209bb200-5212-4938-87e6-20f9570437a5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1532 microversion: 2.1 time: 0.604620 Sep 07 12:51:56.413373 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2175/4305] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:55 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1532 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:56.635193 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-573aa17c-96f9-4219-8615-3a2a138e8759 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:56.669785 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-573aa17c-96f9-4219-8615-3a2a138e8759 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472" status: 200 len: 1496 microversion: 2.1 time: 0.611391 Sep 07 12:51:56.670907 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2131/4306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:56 2022] GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 => generated 1496 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:56.818328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6653dbf7-406f-43eb-879f-f915d94e078d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:56.821293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6653dbf7-406f-43eb-879f-f915d94e078d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:56.835056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6653dbf7-406f-43eb-879f-f915d94e078d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:56.836410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6653dbf7-406f-43eb-879f-f915d94e078d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:56.837571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6653dbf7-406f-43eb-879f-f915d94e078d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:56.838798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6653dbf7-406f-43eb-879f-f915d94e078d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:56.840326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6653dbf7-406f-43eb-879f-f915d94e078d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:56.841241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6653dbf7-406f-43eb-879f-f915d94e078d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:56.949553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-19b9c4a6-98fb-4fd4-9c0d-5f6f44d07d02 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:56.950777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-19b9c4a6-98fb-4fd4-9c0d-5f6f44d07d02 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:56.968812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19b9c4a6-98fb-4fd4-9c0d-5f6f44d07d02 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:56.972645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19b9c4a6-98fb-4fd4-9c0d-5f6f44d07d02 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:56.974037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19b9c4a6-98fb-4fd4-9c0d-5f6f44d07d02 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:56.975868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19b9c4a6-98fb-4fd4-9c0d-5f6f44d07d02 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:56.980202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19b9c4a6-98fb-4fd4-9c0d-5f6f44d07d02 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:56.981686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19b9c4a6-98fb-4fd4-9c0d-5f6f44d07d02 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:57.259142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6653dbf7-406f-43eb-879f-f915d94e078d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:57.276601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6653dbf7-406f-43eb-879f-f915d94e078d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:57.280526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6653dbf7-406f-43eb-879f-f915d94e078d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:57.292103 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6653dbf7-406f-43eb-879f-f915d94e078d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1744 microversion: 2.20 time: 0.490592 Sep 07 12:51:57.293001 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2176/4307] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:56 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1744 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:51:57.360786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-19b9c4a6-98fb-4fd4-9c0d-5f6f44d07d02 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:57.375153 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-19b9c4a6-98fb-4fd4-9c0d-5f6f44d07d02 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1733 microversion: 2.1 time: 0.450082 Sep 07 12:51:57.376675 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2132/4308] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:56 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1733 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:57.433042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c10256ff-c870-4cd0-97c5-9269942f43f8 req-d5b79063-9a4f-41af-a0ac-dd8add85dbd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e76105-cf05-4f29-9469-b3bb4b1f7472", "name": "network-vif-deleted", "tag": "dee55a92-0caf-4a4d-8da1-9359d0c72291"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:57.459316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5d622ceb-9dee-4a47-8fee-06b46ba2752e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:57.460755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5d622ceb-9dee-4a47-8fee-06b46ba2752e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:57.464811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c10256ff-c870-4cd0-97c5-9269942f43f8 req-d5b79063-9a4f-41af-a0ac-dd8add85dbd9 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:57.469995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c10256ff-c870-4cd0-97c5-9269942f43f8 req-d5b79063-9a4f-41af-a0ac-dd8add85dbd9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:57.472226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c10256ff-c870-4cd0-97c5-9269942f43f8 req-d5b79063-9a4f-41af-a0ac-dd8add85dbd9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:57.473524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d622ceb-9dee-4a47-8fee-06b46ba2752e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:57.474536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d622ceb-9dee-4a47-8fee-06b46ba2752e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:57.475522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d622ceb-9dee-4a47-8fee-06b46ba2752e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:57.476924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d622ceb-9dee-4a47-8fee-06b46ba2752e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:57.478442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d622ceb-9dee-4a47-8fee-06b46ba2752e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:57.479383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d622ceb-9dee-4a47-8fee-06b46ba2752e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:57.515773 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c10256ff-c870-4cd0-97c5-9269942f43f8 req-d5b79063-9a4f-41af-a0ac-dd8add85dbd9 service nova] Creating event network-vif-deleted:dee55a92-0caf-4a4d-8da1-9359d0c72291 for instance 95e76105-cf05-4f29-9469-b3bb4b1f7472 on n-h1-852087-9 Sep 07 12:51:57.542929 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c10256ff-c870-4cd0-97c5-9269942f43f8 req-d5b79063-9a4f-41af-a0ac-dd8add85dbd9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110731 Sep 07 12:51:57.544827 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2177/4309] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:51:57.714016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f82c1ac4-6cfb-4f18-a4c1-76e4ea37dc60 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:57.716045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f82c1ac4-6cfb-4f18-a4c1-76e4ea37dc60 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:57.750126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f82c1ac4-6cfb-4f18-a4c1-76e4ea37dc60 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:57.754379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f82c1ac4-6cfb-4f18-a4c1-76e4ea37dc60 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:57.760330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f82c1ac4-6cfb-4f18-a4c1-76e4ea37dc60 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:57.765157 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f82c1ac4-6cfb-4f18-a4c1-76e4ea37dc60 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:57.770645 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f82c1ac4-6cfb-4f18-a4c1-76e4ea37dc60 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:57.772224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f82c1ac4-6cfb-4f18-a4c1-76e4ea37dc60 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:57.938204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f82c1ac4-6cfb-4f18-a4c1-76e4ea37dc60 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:57.941364 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f82c1ac4-6cfb-4f18-a4c1-76e4ea37dc60 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:57.957044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f82c1ac4-6cfb-4f18-a4c1-76e4ea37dc60 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:57.965121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-f82c1ac4-6cfb-4f18-a4c1-76e4ea37dc60 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lazy-loading 'fault' on Instance uuid 95e76105-cf05-4f29-9469-b3bb4b1f7472 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:51:58.043549 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5d622ceb-9dee-4a47-8fee-06b46ba2752e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:58.076474 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5d622ceb-9dee-4a47-8fee-06b46ba2752e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1527 microversion: 2.1 time: 0.624264 Sep 07 12:51:58.077467 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2133/4310] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:57 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1527 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:58.163008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f82c1ac4-6cfb-4f18-a4c1-76e4ea37dc60 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:58.214531 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f82c1ac4-6cfb-4f18-a4c1-76e4ea37dc60 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472" status: 200 len: 1302 microversion: 2.1 time: 0.502074 Sep 07 12:51:58.217013 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2178/4311] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:57 2022] GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 => generated 1302 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:58.345462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-370e4b7c-d637-49a5-98f2-82a6927ede3b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:58.346572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-370e4b7c-d637-49a5-98f2-82a6927ede3b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:58.361214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-370e4b7c-d637-49a5-98f2-82a6927ede3b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:58.362072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-370e4b7c-d637-49a5-98f2-82a6927ede3b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:58.362877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-370e4b7c-d637-49a5-98f2-82a6927ede3b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:58.364450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-370e4b7c-d637-49a5-98f2-82a6927ede3b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:58.365789 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-370e4b7c-d637-49a5-98f2-82a6927ede3b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:58.366764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-370e4b7c-d637-49a5-98f2-82a6927ede3b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:58.420193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fa3073b9-7638-4cf8-b450-57205f19332b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:58.422847 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fa3073b9-7638-4cf8-b450-57205f19332b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:58.452320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa3073b9-7638-4cf8-b450-57205f19332b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:58.454849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa3073b9-7638-4cf8-b450-57205f19332b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:58.458663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa3073b9-7638-4cf8-b450-57205f19332b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:58.464842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa3073b9-7638-4cf8-b450-57205f19332b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:58.468157 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa3073b9-7638-4cf8-b450-57205f19332b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:58.471342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa3073b9-7638-4cf8-b450-57205f19332b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:58.910357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-370e4b7c-d637-49a5-98f2-82a6927ede3b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:58.922149 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-370e4b7c-d637-49a5-98f2-82a6927ede3b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:58.924217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-370e4b7c-d637-49a5-98f2-82a6927ede3b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:58.925903 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-370e4b7c-d637-49a5-98f2-82a6927ede3b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1744 microversion: 2.20 time: 0.590166 Sep 07 12:51:58.927115 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2134/4312] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:58 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1744 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:51:59.051270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fa3073b9-7638-4cf8-b450-57205f19332b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:59.077108 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fa3073b9-7638-4cf8-b450-57205f19332b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1733 microversion: 2.1 time: 0.664869 Sep 07 12:51:59.116758 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2179/4313] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:58 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1733 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:59.134203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-83a445bf-0d4e-42e7-9150-4f21e7f3c3a7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:59.138198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-83a445bf-0d4e-42e7-9150-4f21e7f3c3a7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:59.166003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83a445bf-0d4e-42e7-9150-4f21e7f3c3a7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:59.172053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83a445bf-0d4e-42e7-9150-4f21e7f3c3a7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:59.173717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83a445bf-0d4e-42e7-9150-4f21e7f3c3a7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:59.181584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83a445bf-0d4e-42e7-9150-4f21e7f3c3a7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:59.185147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83a445bf-0d4e-42e7-9150-4f21e7f3c3a7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:59.186297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83a445bf-0d4e-42e7-9150-4f21e7f3c3a7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:59.302765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bb31c1b4-670d-4149-8316-0f5d29c0618d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-651232369", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "689caa4b-8230-4dc8-843e-e1b1dbd97a11"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:51:59.522706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-83a445bf-0d4e-42e7-9150-4f21e7f3c3a7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:59.527952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-bb31c1b4-670d-4149-8316-0f5d29c0618d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] validate_networks() for [('689caa4b-8230-4dc8-843e-e1b1dbd97a11', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:51:59.551783 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-83a445bf-0d4e-42e7-9150-4f21e7f3c3a7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1527 microversion: 2.1 time: 0.423932 Sep 07 12:51:59.570105 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2180/4314] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:59 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1527 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:59.580879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d05caea1-d9b9-4891-bcc0-8703fbc1a8ea tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:59.587110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d05caea1-d9b9-4891-bcc0-8703fbc1a8ea tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:59.603806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d05caea1-d9b9-4891-bcc0-8703fbc1a8ea tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:59.608651 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d05caea1-d9b9-4891-bcc0-8703fbc1a8ea tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:59.617004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d05caea1-d9b9-4891-bcc0-8703fbc1a8ea tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:59.619118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d05caea1-d9b9-4891-bcc0-8703fbc1a8ea tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:59.620811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d05caea1-d9b9-4891-bcc0-8703fbc1a8ea tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:59.621730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d05caea1-d9b9-4891-bcc0-8703fbc1a8ea tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:59.711113 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d05caea1-d9b9-4891-bcc0-8703fbc1a8ea tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:59.712084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d05caea1-d9b9-4891-bcc0-8703fbc1a8ea tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:59.712763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d05caea1-d9b9-4891-bcc0-8703fbc1a8ea tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:59.713553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-d05caea1-d9b9-4891-bcc0-8703fbc1a8ea tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lazy-loading 'fault' on Instance uuid 95e76105-cf05-4f29-9469-b3bb4b1f7472 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:51:59.832453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d05caea1-d9b9-4891-bcc0-8703fbc1a8ea tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73853219b29241269ce4bb94155b204e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea9c8446d545d1ae1bd49f67d6008b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:51:59.848206 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d05caea1-d9b9-4891-bcc0-8703fbc1a8ea tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472" status: 200 len: 1302 microversion: 2.1 time: 0.276678 Sep 07 12:51:59.854014 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2181/4315] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:51:59 2022] GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 => generated 1302 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:59.976170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7cf399e3-9250-47bf-b1fd-74002b2d2b01 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:51:59.977150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7cf399e3-9250-47bf-b1fd-74002b2d2b01 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:51:59.988870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7cf399e3-9250-47bf-b1fd-74002b2d2b01 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:59.990263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7cf399e3-9250-47bf-b1fd-74002b2d2b01 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:59.994587 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7cf399e3-9250-47bf-b1fd-74002b2d2b01 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:51:59.995855 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7cf399e3-9250-47bf-b1fd-74002b2d2b01 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:51:59.996912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7cf399e3-9250-47bf-b1fd-74002b2d2b01 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:51:59.998843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7cf399e3-9250-47bf-b1fd-74002b2d2b01 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:00.512750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7cf399e3-9250-47bf-b1fd-74002b2d2b01 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:00.524926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7cf399e3-9250-47bf-b1fd-74002b2d2b01 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:00.535118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7cf399e3-9250-47bf-b1fd-74002b2d2b01 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:00.536683 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7cf399e3-9250-47bf-b1fd-74002b2d2b01 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1739 microversion: 2.20 time: 0.565285 Sep 07 12:52:00.537795 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2182/4316] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:51:59 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1739 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:00.553420 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d9661251-fc03-413a-88bf-961b99b99627 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:00.554567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d9661251-fc03-413a-88bf-961b99b99627 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:00.583847 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9661251-fc03-413a-88bf-961b99b99627 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:00.584966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9661251-fc03-413a-88bf-961b99b99627 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:00.585823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9661251-fc03-413a-88bf-961b99b99627 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:00.590561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9661251-fc03-413a-88bf-961b99b99627 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:00.592007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9661251-fc03-413a-88bf-961b99b99627 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:00.593802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9661251-fc03-413a-88bf-961b99b99627 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:01.008486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bb31c1b4-670d-4149-8316-0f5d29c0618d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:52:01.009552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bb31c1b4-670d-4149-8316-0f5d29c0618d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:52:01.010208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bb31c1b4-670d-4149-8316-0f5d29c0618d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:52:01.010645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bb31c1b4-670d-4149-8316-0f5d29c0618d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:52:01.011059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bb31c1b4-670d-4149-8316-0f5d29c0618d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:52:01.028723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d9661251-fc03-413a-88bf-961b99b99627 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:01.030714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb31c1b4-670d-4149-8316-0f5d29c0618d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:01.031211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb31c1b4-670d-4149-8316-0f5d29c0618d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:01.031662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb31c1b4-670d-4149-8316-0f5d29c0618d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:01.032408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb31c1b4-670d-4149-8316-0f5d29c0618d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:01.032866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb31c1b4-670d-4149-8316-0f5d29c0618d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:01.040339 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d9661251-fc03-413a-88bf-961b99b99627 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1713 microversion: 2.1 time: 0.500186 Sep 07 12:52:01.051428 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2183/4317] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:00 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1713 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:01.051650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb31c1b4-670d-4149-8316-0f5d29c0618d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:01.055292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-09e4ffda-a6f4-4ef0-bf42-354b89ee2235 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:01.060698 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-09e4ffda-a6f4-4ef0-bf42-354b89ee2235 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:01.075886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09e4ffda-a6f4-4ef0-bf42-354b89ee2235 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:01.076995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09e4ffda-a6f4-4ef0-bf42-354b89ee2235 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:01.079578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09e4ffda-a6f4-4ef0-bf42-354b89ee2235 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:01.081079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09e4ffda-a6f4-4ef0-bf42-354b89ee2235 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:01.097408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09e4ffda-a6f4-4ef0-bf42-354b89ee2235 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:01.099472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09e4ffda-a6f4-4ef0-bf42-354b89ee2235 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:01.144667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-bb31c1b4-670d-4149-8316-0f5d29c0618d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Getting quotas for project 71088375c4114b17977834198ab2bb89. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:52:01.179110 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-bb31c1b4-670d-4149-8316-0f5d29c0618d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Getting quotas for user 7c230da9ab3d44a68af28b364b956b46 and project 71088375c4114b17977834198ab2bb89. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:52:01.264747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bb31c1b4-670d-4149-8316-0f5d29c0618d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:52:01.267395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bb31c1b4-670d-4149-8316-0f5d29c0618d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] [instance: 0f99e18e-8ba9-434e-b143-81c456497bbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:52:01.484188 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bb31c1b4-670d-4149-8316-0f5d29c0618d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.551386 Sep 07 12:52:01.493591 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2135/4318] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:51:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:52:01.499413 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7ee8b65e-6cfa-4d83-8af8-c8e7e1f83202 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:01.509899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7ee8b65e-6cfa-4d83-8af8-c8e7e1f83202 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:01.522607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ee8b65e-6cfa-4d83-8af8-c8e7e1f83202 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:01.523479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ee8b65e-6cfa-4d83-8af8-c8e7e1f83202 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:01.524271 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ee8b65e-6cfa-4d83-8af8-c8e7e1f83202 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:01.525822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ee8b65e-6cfa-4d83-8af8-c8e7e1f83202 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:01.526573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ee8b65e-6cfa-4d83-8af8-c8e7e1f83202 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:01.534943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ee8b65e-6cfa-4d83-8af8-c8e7e1f83202 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:01.559303 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-7ee8b65e-6cfa-4d83-8af8-c8e7e1f83202 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] HTTP exception thrown: Instance 95e76105-cf05-4f29-9469-b3bb4b1f7472 could not be found. Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7ee8b65e-6cfa-4d83-8af8-c8e7e1f83202 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Request method failure captured: Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 HTTP/1.1 Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJN8NqKxBwConiCWO9bIXJk7c-FVKnSUYjAvdT7C5Od3Elyr9LGtszVr5mluLtiRpomLOBsLJLzY7W19SIqLmM-OZ_Lh5-sXVLTNU7jLpVnaQDZH2__l9Mw78gUnVvJbtz6Lr6bt6XcnIB4QpY7Mwb79DiXYgGdQrs0zAO51eh0Aozo Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 55ea9c8446d545d1ae1bd49f67d6008b Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestMultiNic-151275201 Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/55ea9c8446d545d1ae1bd49f67d6008b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_55ea9c8446d545d1ae1bd49f67d6008b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/55ea9c8446d545d1ae1bd49f67d6008b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/55ea9c8446d545d1ae1bd49f67d6008b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestMultiNic-151275201 Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 55ea9c8446d545d1ae1bd49f67d6008b Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestMultiNic-151275201 Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersTestMultiNic-151275201-project Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 73853219b29241269ce4bb94155b204e Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestMultiNic-151275201-project Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 95e76105-cf05-4f29-9469-b3bb4b1f7472 could not be found. Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '95e76105-cf05-4f29-9469-b3bb4b1f7472'} Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95e76105-cf05-4f29-9469-b3bb4b1f7472 could not be found. Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95e76105-cf05-4f29-9469-b3bb4b1f7472 could not be found. Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:52:01.561316 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:01.567372 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:52:01.567372 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:52:01.567372 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:52:01.567372 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:52:01.567372 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:52:01.567372 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95e76105-cf05-4f29-9469-b3bb4b1f7472 could not be found. Sep 07 12:52:01.567372 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:01.569302 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7ee8b65e-6cfa-4d83-8af8-c8e7e1f83202 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Returning 404 to user: Instance 95e76105-cf05-4f29-9469-b3bb4b1f7472 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:52:01.570495 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7ee8b65e-6cfa-4d83-8af8-c8e7e1f83202 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472" status: 404 len: 111 microversion: 2.1 time: 0.075436 Sep 07 12:52:01.575996 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2136/4319] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:01 2022] GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:52:01.583470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eaa3ba2d-5e44-42ce-a7c2-3b69c4355a1d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:01.584409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eaa3ba2d-5e44-42ce-a7c2-3b69c4355a1d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:01.592529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaa3ba2d-5e44-42ce-a7c2-3b69c4355a1d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:01.593414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaa3ba2d-5e44-42ce-a7c2-3b69c4355a1d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:01.594384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaa3ba2d-5e44-42ce-a7c2-3b69c4355a1d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:01.595444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaa3ba2d-5e44-42ce-a7c2-3b69c4355a1d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:01.596270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaa3ba2d-5e44-42ce-a7c2-3b69c4355a1d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:01.597306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaa3ba2d-5e44-42ce-a7c2-3b69c4355a1d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:01.654202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-09e4ffda-a6f4-4ef0-bf42-354b89ee2235 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:01.671578 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-09e4ffda-a6f4-4ef0-bf42-354b89ee2235 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1527 microversion: 2.1 time: 0.625103 Sep 07 12:52:01.692985 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2184/4320] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:01 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1527 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:01.704421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3870e938-ba8b-4a4c-84bf-d585f61bfb10 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:01.708074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3870e938-ba8b-4a4c-84bf-d585f61bfb10 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] [instance: 0f99e18e-8ba9-434e-b143-81c456497bbe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:01.908471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3870e938-ba8b-4a4c-84bf-d585f61bfb10 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c230da9ab3d44a68af28b364b956b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71088375c4114b17977834198ab2bb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:01.929777 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3870e938-ba8b-4a4c-84bf-d585f61bfb10 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] 10.222.0.16 "GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe" status: 200 len: 1215 microversion: 2.1 time: 0.230604 Sep 07 12:52:01.932875 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2185/4321] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:01 2022] GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe => generated 1215 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:01.975221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-30209381-b7c1-49b2-a6d6-c10cde9c621c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:01.976964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-30209381-b7c1-49b2-a6d6-c10cde9c621c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:02.049508 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30209381-b7c1-49b2-a6d6-c10cde9c621c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:02.062794 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-eaa3ba2d-5e44-42ce-a7c2-3b69c4355a1d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] HTTP exception thrown: Cannot 'detach_volume' instance 4b52328c-937b-46cf-abdf-8629194fc25c while it is in vm_state rescued Sep 07 12:52:02.074102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30209381-b7c1-49b2-a6d6-c10cde9c621c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:02.074880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30209381-b7c1-49b2-a6d6-c10cde9c621c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eaa3ba2d-5e44-42ce-a7c2-3b69c4355a1d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Request method failure captured: Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments/d0796098-a0c7-4c63-abf5-469004cdf31a HTTP/1.1 Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJKZVQHWlJ74Dx2W8ZEdML0xF-2AOg7c1kyx3sCL0Z6KLQM5ezA45HggvILiFiNDg07ylWr0Vwzz5BQco3_h-9AY0fLV1Rv4K5sggvhMC6zI5NaP-U7NrDZHMoSQThjt2D27IAAoa8B5_g5vq1oNty_s1bxD15UYFAJm0Q--CvZRoS0 Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 256a95a81360419dbaf33382dd369262 Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1632514538 Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/256a95a81360419dbaf33382dd369262"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_256a95a81360419dbaf33382dd369262"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/256a95a81360419dbaf33382dd369262"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/256a95a81360419dbaf33382dd369262"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1632514538 Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 256a95a81360419dbaf33382dd369262 Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1632514538 Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerRescueNegativeTestJSON-1632514538-project Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: a6d92e694e984ad8b126b94ed8effb3f Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1632514538-project Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: exception: Cannot 'detach_volume' instance 4b52328c-937b-46cf-abdf-8629194fc25c while it is in vm_state rescued Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'server_id': '4b52328c-937b-46cf-abdf-8629194fc25c', 'id': 'd0796098-a0c7-4c63-abf5-469004cdf31a'} Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4b52328c-937b-46cf-abdf-8629194fc25c in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4b52328c-937b-46cf-abdf-8629194fc25c while it is in vm_state rescued Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:02.076768 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:52:02.084139 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:52:02.084139 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:52:02.084139 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:52:02.084139 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:52:02.084139 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4b52328c-937b-46cf-abdf-8629194fc25c while it is in vm_state rescued Sep 07 12:52:02.084139 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:02.084139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eaa3ba2d-5e44-42ce-a7c2-3b69c4355a1d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Returning 409 to user: Cannot 'detach_volume' instance 4b52328c-937b-46cf-abdf-8629194fc25c while it is in vm_state rescued {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:52:02.084976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30209381-b7c1-49b2-a6d6-c10cde9c621c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:02.084976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30209381-b7c1-49b2-a6d6-c10cde9c621c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:02.085245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30209381-b7c1-49b2-a6d6-c10cde9c621c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:02.088431 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eaa3ba2d-5e44-42ce-a7c2-3b69c4355a1d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments/d0796098-a0c7-4c63-abf5-469004cdf31a" status: 409 len: 152 microversion: 2.1 time: 0.506427 Sep 07 12:52:02.091760 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2137/4322] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Sep 7 12:52:01 2022] DELETE /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments/d0796098-a0c7-4c63-abf5-469004cdf31a => generated 152 bytes in 513 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:52:02.123290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-cb303a38-cfea-47e0-94e7-9f5a45b23bfa req-a0e5bef1-1593-4ae9-9a96-0f9c82f4afcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe6581c-7070-48c5-a16d-fa30b22567d4", "name": "network-vif-plugged", "status": "completed", "tag": "57759270-a8de-4adc-a2ba-ccbb3e371878"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:52:02.177104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cb303a38-cfea-47e0-94e7-9f5a45b23bfa req-a0e5bef1-1593-4ae9-9a96-0f9c82f4afcd service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:02.181748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cb303a38-cfea-47e0-94e7-9f5a45b23bfa req-a0e5bef1-1593-4ae9-9a96-0f9c82f4afcd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:02.184884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cb303a38-cfea-47e0-94e7-9f5a45b23bfa req-a0e5bef1-1593-4ae9-9a96-0f9c82f4afcd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:02.287774 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-cb303a38-cfea-47e0-94e7-9f5a45b23bfa req-a0e5bef1-1593-4ae9-9a96-0f9c82f4afcd service nova] Creating event network-vif-plugged:57759270-a8de-4adc-a2ba-ccbb3e371878 for instance ffe6581c-7070-48c5-a16d-fa30b22567d4 on n-h2-852087-9 Sep 07 12:52:02.345719 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-cb303a38-cfea-47e0-94e7-9f5a45b23bfa req-a0e5bef1-1593-4ae9-9a96-0f9c82f4afcd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235074 Sep 07 12:52:02.347022 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2138/4323] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:52:02.394381 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a3aec76b-365d-47a5-a3d8-fae0f3bc5ffe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:52:02.395544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a3aec76b-365d-47a5-a3d8-fae0f3bc5ffe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:02.416708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3aec76b-365d-47a5-a3d8-fae0f3bc5ffe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:02.417601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3aec76b-365d-47a5-a3d8-fae0f3bc5ffe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:02.418503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3aec76b-365d-47a5-a3d8-fae0f3bc5ffe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:02.452023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3aec76b-365d-47a5-a3d8-fae0f3bc5ffe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:02.461370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3aec76b-365d-47a5-a3d8-fae0f3bc5ffe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:02.465442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3aec76b-365d-47a5-a3d8-fae0f3bc5ffe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:02.703668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-30209381-b7c1-49b2-a6d6-c10cde9c621c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:02.762626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-30209381-b7c1-49b2-a6d6-c10cde9c621c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:02.789805 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-30209381-b7c1-49b2-a6d6-c10cde9c621c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:02.803750 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-30209381-b7c1-49b2-a6d6-c10cde9c621c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1739 microversion: 2.20 time: 0.839978 Sep 07 12:52:02.808613 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2186/4324] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:01 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1739 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:02.857673 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2efaddb0-97c6-4fb7-8008-dc72ca11a2ba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:02.884668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2efaddb0-97c6-4fb7-8008-dc72ca11a2ba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:02.923315 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a3aec76b-365d-47a5-a3d8-fae0f3bc5ffe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "POST /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/action" status: 202 len: 0 microversion: 2.1 time: 0.557458 Sep 07 12:52:02.936205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2efaddb0-97c6-4fb7-8008-dc72ca11a2ba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:02.937102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2efaddb0-97c6-4fb7-8008-dc72ca11a2ba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:02.937962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2efaddb0-97c6-4fb7-8008-dc72ca11a2ba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:02.941640 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2139/4325] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:52:02 2022] POST /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:52:02.958687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2efaddb0-97c6-4fb7-8008-dc72ca11a2ba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:02.963695 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2efaddb0-97c6-4fb7-8008-dc72ca11a2ba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:02.966169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2efaddb0-97c6-4fb7-8008-dc72ca11a2ba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:02.988186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a594f335-4329-4608-a2ae-8995355aabeb tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:02.990041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a594f335-4329-4608-a2ae-8995355aabeb tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:03.081815 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a594f335-4329-4608-a2ae-8995355aabeb tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:03.086934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a594f335-4329-4608-a2ae-8995355aabeb tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:03.092414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a594f335-4329-4608-a2ae-8995355aabeb tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:03.097648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a594f335-4329-4608-a2ae-8995355aabeb tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:03.098346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a594f335-4329-4608-a2ae-8995355aabeb tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:03.099050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a594f335-4329-4608-a2ae-8995355aabeb tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:04.309153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2efaddb0-97c6-4fb7-8008-dc72ca11a2ba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:04.325336 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2efaddb0-97c6-4fb7-8008-dc72ca11a2ba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1527 microversion: 2.1 time: 1.510638 Sep 07 12:52:04.333244 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2187/4326] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:02 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1527 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:04.360816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ee02d19a-e0a9-4133-a2ec-f2ee8545d047 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:04.362322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ee02d19a-e0a9-4133-a2ec-f2ee8545d047 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] [instance: 0f99e18e-8ba9-434e-b143-81c456497bbe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:04.390423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee02d19a-e0a9-4133-a2ec-f2ee8545d047 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:04.395346 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee02d19a-e0a9-4133-a2ec-f2ee8545d047 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:04.400328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee02d19a-e0a9-4133-a2ec-f2ee8545d047 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:04.400328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee02d19a-e0a9-4133-a2ec-f2ee8545d047 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:04.400328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee02d19a-e0a9-4133-a2ec-f2ee8545d047 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:04.403956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee02d19a-e0a9-4133-a2ec-f2ee8545d047 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:04.482037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a594f335-4329-4608-a2ae-8995355aabeb tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:04.508692 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a594f335-4329-4608-a2ae-8995355aabeb tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1721 microversion: 2.1 time: 1.553469 Sep 07 12:52:04.513661 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2140/4327] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:02 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1721 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:04.538602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d34d32c6-9f58-42c4-9fff-fda4f79f442a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:04.541272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d34d32c6-9f58-42c4-9fff-fda4f79f442a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:04.565831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d34d32c6-9f58-42c4-9fff-fda4f79f442a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:04.568752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d34d32c6-9f58-42c4-9fff-fda4f79f442a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:04.572580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d34d32c6-9f58-42c4-9fff-fda4f79f442a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:04.579215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d34d32c6-9f58-42c4-9fff-fda4f79f442a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:04.580301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d34d32c6-9f58-42c4-9fff-fda4f79f442a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:04.581426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d34d32c6-9f58-42c4-9fff-fda4f79f442a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:04.753322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ee02d19a-e0a9-4133-a2ec-f2ee8545d047 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c230da9ab3d44a68af28b364b956b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71088375c4114b17977834198ab2bb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:04.814004 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ee02d19a-e0a9-4133-a2ec-f2ee8545d047 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] 10.222.0.16 "GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe" status: 200 len: 1267 microversion: 2.1 time: 0.476984 Sep 07 12:52:04.814004 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2188/4328] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:04 2022] GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe => generated 1267 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:05.396192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-baa6edc5-008d-4ba9-ad75-924b22edd589 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:05.402434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-baa6edc5-008d-4ba9-ad75-924b22edd589 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:05.465552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-baa6edc5-008d-4ba9-ad75-924b22edd589 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:05.472994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-baa6edc5-008d-4ba9-ad75-924b22edd589 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:05.483027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-baa6edc5-008d-4ba9-ad75-924b22edd589 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:05.484928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-baa6edc5-008d-4ba9-ad75-924b22edd589 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:05.492445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-baa6edc5-008d-4ba9-ad75-924b22edd589 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:05.493895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-baa6edc5-008d-4ba9-ad75-924b22edd589 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:05.591847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d34d32c6-9f58-42c4-9fff-fda4f79f442a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:05.607255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:05.686978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d34d32c6-9f58-42c4-9fff-fda4f79f442a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:05.700092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d34d32c6-9f58-42c4-9fff-fda4f79f442a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:05.711138 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d34d32c6-9f58-42c4-9fff-fda4f79f442a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1739 microversion: 2.20 time: 1.195897 Sep 07 12:52:05.726960 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2141/4329] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:04 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1739 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:05.766487 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d3d043c8-c062-4faf-8847-046fb680d26f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:05.769151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d3d043c8-c062-4faf-8847-046fb680d26f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:05.823558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3d043c8-c062-4faf-8847-046fb680d26f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:05.832650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3d043c8-c062-4faf-8847-046fb680d26f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:05.842819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3d043c8-c062-4faf-8847-046fb680d26f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:05.849756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3d043c8-c062-4faf-8847-046fb680d26f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:05.853515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3d043c8-c062-4faf-8847-046fb680d26f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:05.869080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3d043c8-c062-4faf-8847-046fb680d26f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:07.864634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d3d043c8-c062-4faf-8847-046fb680d26f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:07.885535 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d3d043c8-c062-4faf-8847-046fb680d26f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1721 microversion: 2.1 time: 2.150077 Sep 07 12:52:07.897704 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2142/4330] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:05 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1721 bytes in 2169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:07.918642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d6755035-c056-4625-9e13-853f2ad4ea9c tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:07.922626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d6755035-c056-4625-9e13-853f2ad4ea9c tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] [instance: 0f99e18e-8ba9-434e-b143-81c456497bbe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:07.940205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6755035-c056-4625-9e13-853f2ad4ea9c tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:07.942689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6755035-c056-4625-9e13-853f2ad4ea9c tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:07.947066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6755035-c056-4625-9e13-853f2ad4ea9c tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:07.949802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6755035-c056-4625-9e13-853f2ad4ea9c tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:07.950692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6755035-c056-4625-9e13-853f2ad4ea9c tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:07.953677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d6755035-c056-4625-9e13-853f2ad4ea9c tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:08.577137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-baa6edc5-008d-4ba9-ad75-924b22edd589 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:08.644722 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-baa6edc5-008d-4ba9-ad75-924b22edd589 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1527 microversion: 2.1 time: 3.253750 Sep 07 12:52:08.649846 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2189/4331] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:05 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1527 bytes in 3269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:52:08.686633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-da175450-e6c8-43b6-8bb6-513241e0dc9b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:08.692789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-da175450-e6c8-43b6-8bb6-513241e0dc9b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:08.728590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da175450-e6c8-43b6-8bb6-513241e0dc9b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:08.735679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da175450-e6c8-43b6-8bb6-513241e0dc9b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:08.741614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da175450-e6c8-43b6-8bb6-513241e0dc9b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:08.748212 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da175450-e6c8-43b6-8bb6-513241e0dc9b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:08.758838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da175450-e6c8-43b6-8bb6-513241e0dc9b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:08.771575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da175450-e6c8-43b6-8bb6-513241e0dc9b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:09.535543 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d6755035-c056-4625-9e13-853f2ad4ea9c tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c230da9ab3d44a68af28b364b956b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71088375c4114b17977834198ab2bb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:09.552794 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d6755035-c056-4625-9e13-853f2ad4ea9c tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] 10.222.0.16 "GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe" status: 200 len: 1315 microversion: 2.1 time: 1.637887 Sep 07 12:52:09.564244 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2143/4332] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:07 2022] GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe => generated 1315 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:09.586949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-58bff01e-0414-41a7-80a5-cc23fac0cee8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:09.594604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-58bff01e-0414-41a7-80a5-cc23fac0cee8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:09.617234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58bff01e-0414-41a7-80a5-cc23fac0cee8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:09.622872 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58bff01e-0414-41a7-80a5-cc23fac0cee8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:09.625085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58bff01e-0414-41a7-80a5-cc23fac0cee8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:09.626272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58bff01e-0414-41a7-80a5-cc23fac0cee8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:09.630860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58bff01e-0414-41a7-80a5-cc23fac0cee8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:09.636596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58bff01e-0414-41a7-80a5-cc23fac0cee8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:10.414256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da175450-e6c8-43b6-8bb6-513241e0dc9b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:10.474373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da175450-e6c8-43b6-8bb6-513241e0dc9b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:10.478036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da175450-e6c8-43b6-8bb6-513241e0dc9b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:10.491362 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-da175450-e6c8-43b6-8bb6-513241e0dc9b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1739 microversion: 2.20 time: 1.839110 Sep 07 12:52:10.524263 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2190/4333] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:08 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1739 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:10.551751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5f89e519-adb9-49db-ae8d-99d04138fbf0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:10.566567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5f89e519-adb9-49db-ae8d-99d04138fbf0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:10.600194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f89e519-adb9-49db-ae8d-99d04138fbf0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:10.612140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f89e519-adb9-49db-ae8d-99d04138fbf0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:10.613690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f89e519-adb9-49db-ae8d-99d04138fbf0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:10.615795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f89e519-adb9-49db-ae8d-99d04138fbf0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:10.628103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f89e519-adb9-49db-ae8d-99d04138fbf0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:10.629251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5f89e519-adb9-49db-ae8d-99d04138fbf0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:10.803155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-58bff01e-0414-41a7-80a5-cc23fac0cee8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:10.853509 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-58bff01e-0414-41a7-80a5-cc23fac0cee8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1721 microversion: 2.1 time: 1.285160 Sep 07 12:52:10.857533 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2144/4334] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:09 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1721 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:10.879068 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0f88ac78-c4ec-4cc3-a479-052cfce0f112 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:10.884811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0f88ac78-c4ec-4cc3-a479-052cfce0f112 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] [instance: 0f99e18e-8ba9-434e-b143-81c456497bbe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:10.906567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f88ac78-c4ec-4cc3-a479-052cfce0f112 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:10.907493 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f88ac78-c4ec-4cc3-a479-052cfce0f112 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:10.910116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f88ac78-c4ec-4cc3-a479-052cfce0f112 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:10.911218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f88ac78-c4ec-4cc3-a479-052cfce0f112 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:10.912521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f88ac78-c4ec-4cc3-a479-052cfce0f112 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:10.916540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f88ac78-c4ec-4cc3-a479-052cfce0f112 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:11.069132 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:11.226212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:11.922074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:11.973813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0f88ac78-c4ec-4cc3-a479-052cfce0f112 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c230da9ab3d44a68af28b364b956b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71088375c4114b17977834198ab2bb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:12.010549 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0f88ac78-c4ec-4cc3-a479-052cfce0f112 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] 10.222.0.16 "GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe" status: 200 len: 1315 microversion: 2.1 time: 1.151216 Sep 07 12:52:12.015728 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2145/4335] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:10 2022] GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe => generated 1315 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:12.027764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a16c0b1d-6cc6-4e68-8956-57a445253139 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:12.028403 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a16c0b1d-6cc6-4e68-8956-57a445253139 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:12.030434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5f89e519-adb9-49db-ae8d-99d04138fbf0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:12.046607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a16c0b1d-6cc6-4e68-8956-57a445253139 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:12.047126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a16c0b1d-6cc6-4e68-8956-57a445253139 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:12.047587 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a16c0b1d-6cc6-4e68-8956-57a445253139 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:12.048339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a16c0b1d-6cc6-4e68-8956-57a445253139 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:12.048809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a16c0b1d-6cc6-4e68-8956-57a445253139 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:12.049282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a16c0b1d-6cc6-4e68-8956-57a445253139 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:12.071148 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5f89e519-adb9-49db-ae8d-99d04138fbf0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1527 microversion: 2.1 time: 1.545366 Sep 07 12:52:12.071754 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2191/4336] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:10 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1527 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:12.085793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-15d925b7-be1d-4af4-9d1f-9544cb0d64bf req-8eba3f01-e58d-499c-bc89-c95005db4fae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f99e18e-8ba9-434e-b143-81c456497bbe", "tag": "ac49414e-9b8e-4066-8be2-4546299644eb"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:52:12.116838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-15d925b7-be1d-4af4-9d1f-9544cb0d64bf req-8eba3f01-e58d-499c-bc89-c95005db4fae service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:12.119905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-15d925b7-be1d-4af4-9d1f-9544cb0d64bf req-8eba3f01-e58d-499c-bc89-c95005db4fae service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:12.121438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-15d925b7-be1d-4af4-9d1f-9544cb0d64bf req-8eba3f01-e58d-499c-bc89-c95005db4fae service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:12.160354 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-15d925b7-be1d-4af4-9d1f-9544cb0d64bf req-8eba3f01-e58d-499c-bc89-c95005db4fae service nova] Creating event network-changed:ac49414e-9b8e-4066-8be2-4546299644eb for instance 0f99e18e-8ba9-434e-b143-81c456497bbe on n-h1-852087-9 Sep 07 12:52:12.169412 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-15d925b7-be1d-4af4-9d1f-9544cb0d64bf req-8eba3f01-e58d-499c-bc89-c95005db4fae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089938 Sep 07 12:52:12.177694 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2192/4337] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:52:12.189971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9a31d768-0d6f-4397-88b4-661b4a4dabf7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:12.192709 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9a31d768-0d6f-4397-88b4-661b4a4dabf7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:12.218269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a31d768-0d6f-4397-88b4-661b4a4dabf7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:12.219089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a31d768-0d6f-4397-88b4-661b4a4dabf7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:12.219705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a31d768-0d6f-4397-88b4-661b4a4dabf7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:12.220654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a31d768-0d6f-4397-88b4-661b4a4dabf7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:12.224730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a31d768-0d6f-4397-88b4-661b4a4dabf7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:12.231690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a31d768-0d6f-4397-88b4-661b4a4dabf7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:13.032888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a16c0b1d-6cc6-4e68-8956-57a445253139 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:13.088667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a16c0b1d-6cc6-4e68-8956-57a445253139 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:13.108005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a16c0b1d-6cc6-4e68-8956-57a445253139 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:13.118338 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a16c0b1d-6cc6-4e68-8956-57a445253139 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1739 microversion: 2.20 time: 1.100940 Sep 07 12:52:13.123151 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2146/4338] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:12 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1739 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:13.142165 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-68f27405-4289-4a65-81d7-6c2a616d17ba tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:13.143053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-68f27405-4289-4a65-81d7-6c2a616d17ba tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:13.176384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68f27405-4289-4a65-81d7-6c2a616d17ba tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:13.177072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68f27405-4289-4a65-81d7-6c2a616d17ba tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:13.177777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68f27405-4289-4a65-81d7-6c2a616d17ba tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:13.179007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68f27405-4289-4a65-81d7-6c2a616d17ba tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:13.180260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68f27405-4289-4a65-81d7-6c2a616d17ba tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:13.180778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68f27405-4289-4a65-81d7-6c2a616d17ba tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:13.205820 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9a31d768-0d6f-4397-88b4-661b4a4dabf7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:13.232867 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9a31d768-0d6f-4397-88b4-661b4a4dabf7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1727 microversion: 2.1 time: 1.053575 Sep 07 12:52:13.234276 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-68f27405-4289-4a65-81d7-6c2a616d17ba tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] HTTP exception thrown: Instance 95e76105-cf05-4f29-9469-b3bb4b1f7472 could not be found. Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-68f27405-4289-4a65-81d7-6c2a616d17ba tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Request method failure captured: Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 HTTP/1.1 Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJN8NqKxBwConiCWO9bIXJk7c-FVKnSUYjAvdT7C5Od3Elyr9LGtszVr5mluLtiRpomLOBsLJLzY7W19SIqLmM-OZ_Lh5-sXVLTNU7jLpVnaQDZH2__l9Mw78gUnVvJbtz6Lr6bt6XcnIB4QpY7Mwb79DiXYgGdQrs0zAO51eh0Aozo Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 55ea9c8446d545d1ae1bd49f67d6008b Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestMultiNic-151275201 Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/55ea9c8446d545d1ae1bd49f67d6008b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_55ea9c8446d545d1ae1bd49f67d6008b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/55ea9c8446d545d1ae1bd49f67d6008b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/55ea9c8446d545d1ae1bd49f67d6008b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestMultiNic-151275201 Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 55ea9c8446d545d1ae1bd49f67d6008b Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestMultiNic-151275201 Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersTestMultiNic-151275201-project Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 73853219b29241269ce4bb94155b204e Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestMultiNic-151275201-project Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 95e76105-cf05-4f29-9469-b3bb4b1f7472 could not be found. Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '95e76105-cf05-4f29-9469-b3bb4b1f7472'} Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95e76105-cf05-4f29-9469-b3bb4b1f7472 could not be found. Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:52:13.236078 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:52:13.243613 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95e76105-cf05-4f29-9469-b3bb4b1f7472 could not be found. Sep 07 12:52:13.243613 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:13.243613 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:52:13.243613 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:13.243613 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:52:13.243613 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:52:13.243613 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:52:13.243613 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:52:13.243613 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:52:13.243613 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95e76105-cf05-4f29-9469-b3bb4b1f7472 could not be found. Sep 07 12:52:13.243613 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:13.243613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-68f27405-4289-4a65-81d7-6c2a616d17ba tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Returning 404 to user: Instance 95e76105-cf05-4f29-9469-b3bb4b1f7472 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:52:13.258752 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2193/4339] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:12 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1727 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:13.259954 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-68f27405-4289-4a65-81d7-6c2a616d17ba tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "DELETE /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472" status: 404 len: 111 microversion: 2.1 time: 0.134110 Sep 07 12:52:13.261804 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2147/4340] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:52:13 2022] DELETE /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:52:13.271989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9bd65a8a-d84e-4d66-9916-ec8d08a566ed tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:13.273230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9bd65a8a-d84e-4d66-9916-ec8d08a566ed tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] [instance: 0f99e18e-8ba9-434e-b143-81c456497bbe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:13.279309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92098e65-1772-436c-b20f-48a1d6411f44 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:13.283462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-92098e65-1772-436c-b20f-48a1d6411f44 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:13.291965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bd65a8a-d84e-4d66-9916-ec8d08a566ed tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:13.292281 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92098e65-1772-436c-b20f-48a1d6411f44 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:13.292449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92098e65-1772-436c-b20f-48a1d6411f44 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:13.292916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92098e65-1772-436c-b20f-48a1d6411f44 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:13.293132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bd65a8a-d84e-4d66-9916-ec8d08a566ed tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:13.293744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92098e65-1772-436c-b20f-48a1d6411f44 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:13.294120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bd65a8a-d84e-4d66-9916-ec8d08a566ed tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:13.294310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92098e65-1772-436c-b20f-48a1d6411f44 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:13.294621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92098e65-1772-436c-b20f-48a1d6411f44 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:13.295697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bd65a8a-d84e-4d66-9916-ec8d08a566ed tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:13.296583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bd65a8a-d84e-4d66-9916-ec8d08a566ed tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:13.297276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bd65a8a-d84e-4d66-9916-ec8d08a566ed tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:13.300512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:13.797585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-92098e65-1772-436c-b20f-48a1d6411f44 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:13.847450 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-92098e65-1772-436c-b20f-48a1d6411f44 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1527 microversion: 2.1 time: 0.583913 Sep 07 12:52:13.848812 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2148/4341] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:13 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1527 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:13.855294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7433395d-907e-4e41-a4e5-c45c57b150e7 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:13.859460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7433395d-907e-4e41-a4e5-c45c57b150e7 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: 95e76105-cf05-4f29-9469-b3bb4b1f7472] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:13.872011 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7433395d-907e-4e41-a4e5-c45c57b150e7 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:13.873380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7433395d-907e-4e41-a4e5-c45c57b150e7 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:13.874130 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7433395d-907e-4e41-a4e5-c45c57b150e7 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:13.882884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7433395d-907e-4e41-a4e5-c45c57b150e7 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:13.884535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7433395d-907e-4e41-a4e5-c45c57b150e7 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:13.885533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7433395d-907e-4e41-a4e5-c45c57b150e7 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:13.923347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9bd65a8a-d84e-4d66-9916-ec8d08a566ed tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c230da9ab3d44a68af28b364b956b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71088375c4114b17977834198ab2bb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-7433395d-907e-4e41-a4e5-c45c57b150e7 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] HTTP exception thrown: Instance 95e76105-cf05-4f29-9469-b3bb4b1f7472 could not be found. Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7433395d-907e-4e41-a4e5-c45c57b150e7 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Request method failure captured: Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 HTTP/1.1 Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJN8NqKxBwConiCWO9bIXJk7c-FVKnSUYjAvdT7C5Od3Elyr9LGtszVr5mluLtiRpomLOBsLJLzY7W19SIqLmM-OZ_Lh5-sXVLTNU7jLpVnaQDZH2__l9Mw78gUnVvJbtz6Lr6bt6XcnIB4QpY7Mwb79DiXYgGdQrs0zAO51eh0Aozo Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 55ea9c8446d545d1ae1bd49f67d6008b Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestMultiNic-151275201 Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/55ea9c8446d545d1ae1bd49f67d6008b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_55ea9c8446d545d1ae1bd49f67d6008b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/55ea9c8446d545d1ae1bd49f67d6008b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/55ea9c8446d545d1ae1bd49f67d6008b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestMultiNic-151275201 Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 55ea9c8446d545d1ae1bd49f67d6008b Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestMultiNic-151275201 Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersTestMultiNic-151275201-project Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 73853219b29241269ce4bb94155b204e Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestMultiNic-151275201-project Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 95e76105-cf05-4f29-9469-b3bb4b1f7472 could not be found. Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '95e76105-cf05-4f29-9469-b3bb4b1f7472'} Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95e76105-cf05-4f29-9469-b3bb4b1f7472 could not be found. Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:52:13.982108 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:52:13.986517 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95e76105-cf05-4f29-9469-b3bb4b1f7472 could not be found. Sep 07 12:52:13.986517 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:13.986517 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:52:13.986517 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:13.986517 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:52:13.986517 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:52:13.986517 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:52:13.986517 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:52:13.986517 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:52:13.986517 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95e76105-cf05-4f29-9469-b3bb4b1f7472 could not be found. Sep 07 12:52:13.986517 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:13.986517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7433395d-907e-4e41-a4e5-c45c57b150e7 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Returning 404 to user: Instance 95e76105-cf05-4f29-9469-b3bb4b1f7472 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:52:13.986517 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7433395d-907e-4e41-a4e5-c45c57b150e7 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472" status: 404 len: 111 microversion: 2.1 time: 0.096884 Sep 07 12:52:13.986517 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2149/4342] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:13 2022] GET /compute/v2.1/servers/95e76105-cf05-4f29-9469-b3bb4b1f7472 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:52:13.986517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-86c76c48-bcea-47ae-a33a-91424e951903 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:13.986517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-86c76c48-bcea-47ae-a33a-91424e951903 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:13.986517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86c76c48-bcea-47ae-a33a-91424e951903 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:13.986517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86c76c48-bcea-47ae-a33a-91424e951903 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:13.986517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86c76c48-bcea-47ae-a33a-91424e951903 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:13.986517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86c76c48-bcea-47ae-a33a-91424e951903 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:13.986517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86c76c48-bcea-47ae-a33a-91424e951903 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:13.986517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86c76c48-bcea-47ae-a33a-91424e951903 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:13.987944 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9bd65a8a-d84e-4d66-9916-ec8d08a566ed tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] 10.222.0.16 "GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe" status: 200 len: 1315 microversion: 2.1 time: 0.690251 Sep 07 12:52:13.987944 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2194/4343] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:13 2022] GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe => generated 1315 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:14.265076 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-86c76c48-bcea-47ae-a33a-91424e951903 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.312168 Sep 07 12:52:14.269803 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2150/4344] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Sep 7 12:52:13 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-interface => generated 284 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:52:14.314402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bbe2401e-9cf8-44eb-9ea1-4d599a518f2b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:14.318200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bbe2401e-9cf8-44eb-9ea1-4d599a518f2b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:14.335088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fd98ffdc-ddb4-4edf-bd00-2feb7a970faa tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:14.338754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fd98ffdc-ddb4-4edf-bd00-2feb7a970faa tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:14.354779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbe2401e-9cf8-44eb-9ea1-4d599a518f2b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:14.356116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbe2401e-9cf8-44eb-9ea1-4d599a518f2b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:14.357137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbe2401e-9cf8-44eb-9ea1-4d599a518f2b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:14.358718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbe2401e-9cf8-44eb-9ea1-4d599a518f2b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:14.359833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbe2401e-9cf8-44eb-9ea1-4d599a518f2b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:14.360860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbe2401e-9cf8-44eb-9ea1-4d599a518f2b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:14.373761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd98ffdc-ddb4-4edf-bd00-2feb7a970faa tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:14.378824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd98ffdc-ddb4-4edf-bd00-2feb7a970faa tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:14.379665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd98ffdc-ddb4-4edf-bd00-2feb7a970faa tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:14.389570 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd98ffdc-ddb4-4edf-bd00-2feb7a970faa tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:14.397991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd98ffdc-ddb4-4edf-bd00-2feb7a970faa tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:14.399107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd98ffdc-ddb4-4edf-bd00-2feb7a970faa tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:14.412095 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-bbe2401e-9cf8-44eb-9ea1-4d599a518f2b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] HTTP exception thrown: Instance a05521d0-a89d-418b-93c8-8bb32e9877b3 could not be found. Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bbe2401e-9cf8-44eb-9ea1-4d599a518f2b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Request method failure captured: Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 HTTP/1.1 Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJN8NqKxBwConiCWO9bIXJk7c-FVKnSUYjAvdT7C5Od3Elyr9LGtszVr5mluLtiRpomLOBsLJLzY7W19SIqLmM-OZ_Lh5-sXVLTNU7jLpVnaQDZH2__l9Mw78gUnVvJbtz6Lr6bt6XcnIB4QpY7Mwb79DiXYgGdQrs0zAO51eh0Aozo Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 55ea9c8446d545d1ae1bd49f67d6008b Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestMultiNic-151275201 Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/55ea9c8446d545d1ae1bd49f67d6008b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_55ea9c8446d545d1ae1bd49f67d6008b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/55ea9c8446d545d1ae1bd49f67d6008b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/55ea9c8446d545d1ae1bd49f67d6008b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestMultiNic-151275201 Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 55ea9c8446d545d1ae1bd49f67d6008b Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestMultiNic-151275201 Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersTestMultiNic-151275201-project Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 73853219b29241269ce4bb94155b204e Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestMultiNic-151275201-project Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance a05521d0-a89d-418b-93c8-8bb32e9877b3 could not be found. Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'a05521d0-a89d-418b-93c8-8bb32e9877b3'} Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a05521d0-a89d-418b-93c8-8bb32e9877b3 could not be found. Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:52:14.426160 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:52:14.433763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a05521d0-a89d-418b-93c8-8bb32e9877b3 could not be found. Sep 07 12:52:14.433763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:14.433763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:52:14.433763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:14.433763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:52:14.433763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:52:14.433763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:52:14.433763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:52:14.433763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:52:14.433763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a05521d0-a89d-418b-93c8-8bb32e9877b3 could not be found. Sep 07 12:52:14.433763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:14.457721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bbe2401e-9cf8-44eb-9ea1-4d599a518f2b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Returning 404 to user: Instance a05521d0-a89d-418b-93c8-8bb32e9877b3 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:52:14.458878 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bbe2401e-9cf8-44eb-9ea1-4d599a518f2b tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 404 len: 111 microversion: 2.1 time: 0.187085 Sep 07 12:52:14.463938 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2151/4345] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:52:14 2022] DELETE /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:52:14.469772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-17642740-a50f-4c6f-88de-37b45412f733 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:14.471117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-17642740-a50f-4c6f-88de-37b45412f733 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:14.482523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17642740-a50f-4c6f-88de-37b45412f733 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:14.483055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17642740-a50f-4c6f-88de-37b45412f733 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:14.483536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17642740-a50f-4c6f-88de-37b45412f733 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:14.484239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17642740-a50f-4c6f-88de-37b45412f733 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:14.484714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17642740-a50f-4c6f-88de-37b45412f733 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:14.485148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17642740-a50f-4c6f-88de-37b45412f733 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:14.545640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fd98ffdc-ddb4-4edf-bd00-2feb7a970faa tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:52:14.765122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-17642740-a50f-4c6f-88de-37b45412f733 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:14.805076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-17642740-a50f-4c6f-88de-37b45412f733 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:14.811672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-17642740-a50f-4c6f-88de-37b45412f733 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:14.823202 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-17642740-a50f-4c6f-88de-37b45412f733 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1739 microversion: 2.20 time: 0.358985 Sep 07 12:52:14.841219 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2152/4346] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:14 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1739 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:14.841219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a1a3c73d-4d99-4c15-a04a-4b13cda54750 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:14.841219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a1a3c73d-4d99-4c15-a04a-4b13cda54750 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] [instance: a05521d0-a89d-418b-93c8-8bb32e9877b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:14.855695 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1a3c73d-4d99-4c15-a04a-4b13cda54750 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:14.855695 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1a3c73d-4d99-4c15-a04a-4b13cda54750 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:14.855695 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1a3c73d-4d99-4c15-a04a-4b13cda54750 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:14.865634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1a3c73d-4d99-4c15-a04a-4b13cda54750 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:14.865634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1a3c73d-4d99-4c15-a04a-4b13cda54750 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:14.865634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1a3c73d-4d99-4c15-a04a-4b13cda54750 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:14.949219 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-a1a3c73d-4d99-4c15-a04a-4b13cda54750 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] HTTP exception thrown: Instance a05521d0-a89d-418b-93c8-8bb32e9877b3 could not be found. Sep 07 12:52:14.953909 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fd98ffdc-ddb4-4edf-bd00-2feb7a970faa tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 204 len: 0 microversion: 2.42 time: 0.965210 Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a1a3c73d-4d99-4c15-a04a-4b13cda54750 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Request method failure captured: Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 HTTP/1.1 Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJN8NqKxBwConiCWO9bIXJk7c-FVKnSUYjAvdT7C5Od3Elyr9LGtszVr5mluLtiRpomLOBsLJLzY7W19SIqLmM-OZ_Lh5-sXVLTNU7jLpVnaQDZH2__l9Mw78gUnVvJbtz6Lr6bt6XcnIB4QpY7Mwb79DiXYgGdQrs0zAO51eh0Aozo Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 55ea9c8446d545d1ae1bd49f67d6008b Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestMultiNic-151275201 Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/55ea9c8446d545d1ae1bd49f67d6008b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_55ea9c8446d545d1ae1bd49f67d6008b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/55ea9c8446d545d1ae1bd49f67d6008b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/55ea9c8446d545d1ae1bd49f67d6008b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestMultiNic-151275201 Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 55ea9c8446d545d1ae1bd49f67d6008b Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestMultiNic-151275201 Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersTestMultiNic-151275201-project Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 73853219b29241269ce4bb94155b204e Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestMultiNic-151275201-project Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance a05521d0-a89d-418b-93c8-8bb32e9877b3 could not be found. Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'a05521d0-a89d-418b-93c8-8bb32e9877b3'} Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a05521d0-a89d-418b-93c8-8bb32e9877b3 could not be found. Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a05521d0-a89d-418b-93c8-8bb32e9877b3 could not be found. Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:52:14.958848 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:14.975041 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:52:14.975041 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:52:14.975041 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:52:14.975041 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:52:14.975041 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:52:14.975041 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a05521d0-a89d-418b-93c8-8bb32e9877b3 could not be found. Sep 07 12:52:14.975041 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:14.975041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a1a3c73d-4d99-4c15-a04a-4b13cda54750 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] Returning 404 to user: Instance a05521d0-a89d-418b-93c8-8bb32e9877b3 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:52:14.978969 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2195/4347] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 12:52:13 2022] DELETE /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 0 bytes in 975 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:52:14.979492 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a1a3c73d-4d99-4c15-a04a-4b13cda54750 tempest-ServersTestMultiNic-151275201 tempest-ServersTestMultiNic-151275201-project] 10.222.0.16 "GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3" status: 404 len: 111 microversion: 2.1 time: 0.136046 Sep 07 12:52:14.979492 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2153/4348] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:14 2022] GET /compute/v2.1/servers/a05521d0-a89d-418b-93c8-8bb32e9877b3 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:52:14.990458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ff656dc5-5cca-4b42-9f99-5208e48c4942 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:14.996999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ff656dc5-5cca-4b42-9f99-5208e48c4942 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:15.002208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f5828e0e-54af-4be0-98e5-fd2ded24e9bb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:15.004466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f5828e0e-54af-4be0-98e5-fd2ded24e9bb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:15.014564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5828e0e-54af-4be0-98e5-fd2ded24e9bb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:15.015136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5828e0e-54af-4be0-98e5-fd2ded24e9bb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:15.015766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5828e0e-54af-4be0-98e5-fd2ded24e9bb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:15.016908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5828e0e-54af-4be0-98e5-fd2ded24e9bb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:15.017347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5828e0e-54af-4be0-98e5-fd2ded24e9bb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:15.018020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5828e0e-54af-4be0-98e5-fd2ded24e9bb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:15.029108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff656dc5-5cca-4b42-9f99-5208e48c4942 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:15.030006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff656dc5-5cca-4b42-9f99-5208e48c4942 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:15.030886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff656dc5-5cca-4b42-9f99-5208e48c4942 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:15.037539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff656dc5-5cca-4b42-9f99-5208e48c4942 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:15.041968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff656dc5-5cca-4b42-9f99-5208e48c4942 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:15.044154 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff656dc5-5cca-4b42-9f99-5208e48c4942 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:15.865792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f5828e0e-54af-4be0-98e5-fd2ded24e9bb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:15.881140 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f5828e0e-54af-4be0-98e5-fd2ded24e9bb tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1527 microversion: 2.1 time: 0.914224 Sep 07 12:52:15.881782 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2196/4349] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:14 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1527 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:15.894044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5e8720b1-f268-4e61-8e55-049814ad5354 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:15.894772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5e8720b1-f268-4e61-8e55-049814ad5354 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] [instance: 0f99e18e-8ba9-434e-b143-81c456497bbe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:15.922280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e8720b1-f268-4e61-8e55-049814ad5354 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:15.922784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e8720b1-f268-4e61-8e55-049814ad5354 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:15.923189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e8720b1-f268-4e61-8e55-049814ad5354 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:15.923914 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e8720b1-f268-4e61-8e55-049814ad5354 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:15.924404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e8720b1-f268-4e61-8e55-049814ad5354 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:15.924933 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e8720b1-f268-4e61-8e55-049814ad5354 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:16.036276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ff656dc5-5cca-4b42-9f99-5208e48c4942 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:16.049900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ff656dc5-5cca-4b42-9f99-5208e48c4942 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:16.067175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ff656dc5-5cca-4b42-9f99-5208e48c4942 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:16.068593 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ff656dc5-5cca-4b42-9f99-5208e48c4942 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 2959 microversion: 2.42 time: 1.094368 Sep 07 12:52:16.069449 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2154/4350] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:14 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 2959 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:16.075483 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-06b3007a-f9f1-4c4b-8e3f-d24e10430bd5 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:16.076508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-06b3007a-f9f1-4c4b-8e3f-d24e10430bd5 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:16.095446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06b3007a-f9f1-4c4b-8e3f-d24e10430bd5 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:16.096413 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06b3007a-f9f1-4c4b-8e3f-d24e10430bd5 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:16.097092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06b3007a-f9f1-4c4b-8e3f-d24e10430bd5 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:16.098128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06b3007a-f9f1-4c4b-8e3f-d24e10430bd5 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:16.098853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06b3007a-f9f1-4c4b-8e3f-d24e10430bd5 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:16.099512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06b3007a-f9f1-4c4b-8e3f-d24e10430bd5 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:16.794606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-06b3007a-f9f1-4c4b-8e3f-d24e10430bd5 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:16.858395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-06b3007a-f9f1-4c4b-8e3f-d24e10430bd5 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:16.895852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-06b3007a-f9f1-4c4b-8e3f-d24e10430bd5 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:16.905121 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-06b3007a-f9f1-4c4b-8e3f-d24e10430bd5 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1739 microversion: 2.20 time: 0.834116 Sep 07 12:52:16.913094 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2155/4351] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:16 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1739 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:16.948833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ef30e217-034f-4105-91e2-80c69596e46b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:16.959528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ef30e217-034f-4105-91e2-80c69596e46b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:16.999361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef30e217-034f-4105-91e2-80c69596e46b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:17.013523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef30e217-034f-4105-91e2-80c69596e46b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:17.016175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef30e217-034f-4105-91e2-80c69596e46b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:17.020366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5e8720b1-f268-4e61-8e55-049814ad5354 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c230da9ab3d44a68af28b364b956b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71088375c4114b17977834198ab2bb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:17.025143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef30e217-034f-4105-91e2-80c69596e46b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:17.027170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef30e217-034f-4105-91e2-80c69596e46b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:17.034089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef30e217-034f-4105-91e2-80c69596e46b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:17.037327 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5e8720b1-f268-4e61-8e55-049814ad5354 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] 10.222.0.16 "GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe" status: 200 len: 1315 microversion: 2.1 time: 1.152231 Sep 07 12:52:17.038585 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2197/4352] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:15 2022] GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe => generated 1315 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:17.146543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bfb9c749-0de4-4a5c-a09d-dfab3557e1a8 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:17.148044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bfb9c749-0de4-4a5c-a09d-dfab3557e1a8 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:17.192171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bfb9c749-0de4-4a5c-a09d-dfab3557e1a8 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:17.193426 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bfb9c749-0de4-4a5c-a09d-dfab3557e1a8 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:17.194440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bfb9c749-0de4-4a5c-a09d-dfab3557e1a8 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:17.195988 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bfb9c749-0de4-4a5c-a09d-dfab3557e1a8 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:17.197040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bfb9c749-0de4-4a5c-a09d-dfab3557e1a8 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:17.200408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bfb9c749-0de4-4a5c-a09d-dfab3557e1a8 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:18.562482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ef30e217-034f-4105-91e2-80c69596e46b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:18.597330 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ef30e217-034f-4105-91e2-80c69596e46b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1527 microversion: 2.1 time: 1.656663 Sep 07 12:52:18.632896 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2156/4353] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:16 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1527 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:18.673275 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-64151f48-859a-43fb-a3b5-2581b3c91917 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:18.675042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-64151f48-859a-43fb-a3b5-2581b3c91917 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:18.697160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64151f48-859a-43fb-a3b5-2581b3c91917 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:18.702428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64151f48-859a-43fb-a3b5-2581b3c91917 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:18.705002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64151f48-859a-43fb-a3b5-2581b3c91917 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:18.712895 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64151f48-859a-43fb-a3b5-2581b3c91917 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:18.714968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64151f48-859a-43fb-a3b5-2581b3c91917 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:18.717402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64151f48-859a-43fb-a3b5-2581b3c91917 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:19.132653 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bfb9c749-0de4-4a5c-a09d-dfab3557e1a8 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:19.194028 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bfb9c749-0de4-4a5c-a09d-dfab3557e1a8 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:19.204834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bfb9c749-0de4-4a5c-a09d-dfab3557e1a8 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:19.217882 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bfb9c749-0de4-4a5c-a09d-dfab3557e1a8 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 2959 microversion: 2.42 time: 2.074177 Sep 07 12:52:19.238812 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2198/4354] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:17 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 2959 bytes in 2094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:19.250581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-083a811f-dbb4-421c-bfc1-73b418fd2d2b tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:19.250581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-083a811f-dbb4-421c-bfc1-73b418fd2d2b tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] [instance: 0f99e18e-8ba9-434e-b143-81c456497bbe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:19.270953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:19.281975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-083a811f-dbb4-421c-bfc1-73b418fd2d2b tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:19.283125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-083a811f-dbb4-421c-bfc1-73b418fd2d2b tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:19.283982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-083a811f-dbb4-421c-bfc1-73b418fd2d2b tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:19.285352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-083a811f-dbb4-421c-bfc1-73b418fd2d2b tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:19.286353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-083a811f-dbb4-421c-bfc1-73b418fd2d2b tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:19.287120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-083a811f-dbb4-421c-bfc1-73b418fd2d2b tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:19.472563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-64151f48-859a-43fb-a3b5-2581b3c91917 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:19.513319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-64151f48-859a-43fb-a3b5-2581b3c91917 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:19.519241 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-64151f48-859a-43fb-a3b5-2581b3c91917 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:19.522729 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-64151f48-859a-43fb-a3b5-2581b3c91917 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1739 microversion: 2.20 time: 0.879309 Sep 07 12:52:19.526618 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2157/4355] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:18 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1739 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:19.539563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-cdafb6f0-c1be-45a1-8acf-4d7f959bac21 req-fedcca43-0a5f-429c-85d7-323a8cba02ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b52328c-937b-46cf-abdf-8629194fc25c", "tag": "3adf0f69-1af4-4072-9454-5e1b89d8b2f7"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:52:19.568872 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cdafb6f0-c1be-45a1-8acf-4d7f959bac21 req-fedcca43-0a5f-429c-85d7-323a8cba02ef service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:19.577196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cdafb6f0-c1be-45a1-8acf-4d7f959bac21 req-fedcca43-0a5f-429c-85d7-323a8cba02ef service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:19.578796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cdafb6f0-c1be-45a1-8acf-4d7f959bac21 req-fedcca43-0a5f-429c-85d7-323a8cba02ef service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:19.637905 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-cdafb6f0-c1be-45a1-8acf-4d7f959bac21 req-fedcca43-0a5f-429c-85d7-323a8cba02ef service nova] Creating event network-changed:3adf0f69-1af4-4072-9454-5e1b89d8b2f7 for instance 4b52328c-937b-46cf-abdf-8629194fc25c on n-h1-852087-9 Sep 07 12:52:19.667608 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-cdafb6f0-c1be-45a1-8acf-4d7f959bac21 req-fedcca43-0a5f-429c-85d7-323a8cba02ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134053 Sep 07 12:52:19.682194 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2158/4356] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:52:19.709294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-062a23d6-d0af-4a0f-b3c9-a4cdafb5c283 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:19.716016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-062a23d6-d0af-4a0f-b3c9-a4cdafb5c283 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:19.769197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-062a23d6-d0af-4a0f-b3c9-a4cdafb5c283 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:19.775526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-062a23d6-d0af-4a0f-b3c9-a4cdafb5c283 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:19.779569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-062a23d6-d0af-4a0f-b3c9-a4cdafb5c283 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:19.782267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-062a23d6-d0af-4a0f-b3c9-a4cdafb5c283 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:19.786588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-062a23d6-d0af-4a0f-b3c9-a4cdafb5c283 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:19.794859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-062a23d6-d0af-4a0f-b3c9-a4cdafb5c283 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:20.603384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-083a811f-dbb4-421c-bfc1-73b418fd2d2b tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c230da9ab3d44a68af28b364b956b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71088375c4114b17977834198ab2bb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:20.647526 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-083a811f-dbb4-421c-bfc1-73b418fd2d2b tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] 10.222.0.16 "GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe" status: 200 len: 1315 microversion: 2.1 time: 1.411551 Sep 07 12:52:20.679503 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2199/4357] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:19 2022] GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe => generated 1315 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:20.714612 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8d553057-708f-45cd-86cf-bcf6ac578c02 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:20.717206 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8d553057-708f-45cd-86cf-bcf6ac578c02 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:20.748784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d553057-708f-45cd-86cf-bcf6ac578c02 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:20.750470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d553057-708f-45cd-86cf-bcf6ac578c02 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:20.751645 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d553057-708f-45cd-86cf-bcf6ac578c02 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:20.754339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d553057-708f-45cd-86cf-bcf6ac578c02 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:20.759128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d553057-708f-45cd-86cf-bcf6ac578c02 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:20.760887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d553057-708f-45cd-86cf-bcf6ac578c02 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:21.114819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-062a23d6-d0af-4a0f-b3c9-a4cdafb5c283 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:21.125639 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-062a23d6-d0af-4a0f-b3c9-a4cdafb5c283 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1527 microversion: 2.1 time: 1.436677 Sep 07 12:52:21.145263 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2159/4358] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:19 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1527 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:21.151225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ff56bc58-9677-40e9-808b-f078c3c530e6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:21.152004 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ff56bc58-9677-40e9-808b-f078c3c530e6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:21.191200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff56bc58-9677-40e9-808b-f078c3c530e6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:21.191831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff56bc58-9677-40e9-808b-f078c3c530e6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:21.192296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff56bc58-9677-40e9-808b-f078c3c530e6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:21.193066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff56bc58-9677-40e9-808b-f078c3c530e6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:21.193598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff56bc58-9677-40e9-808b-f078c3c530e6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:21.194118 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff56bc58-9677-40e9-808b-f078c3c530e6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:22.487486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ff56bc58-9677-40e9-808b-f078c3c530e6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:22.510309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ff56bc58-9677-40e9-808b-f078c3c530e6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:22.512482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ff56bc58-9677-40e9-808b-f078c3c530e6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:22.514465 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ff56bc58-9677-40e9-808b-f078c3c530e6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1739 microversion: 2.20 time: 1.367488 Sep 07 12:52:22.515339 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2160/4359] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:21 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1739 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:22.521561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8b275edf-924a-4459-af13-08eeb8c86062 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:22.523313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8b275edf-924a-4459-af13-08eeb8c86062 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] [instance: 0f99e18e-8ba9-434e-b143-81c456497bbe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:22.539500 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b275edf-924a-4459-af13-08eeb8c86062 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:22.540408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b275edf-924a-4459-af13-08eeb8c86062 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:22.542932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b275edf-924a-4459-af13-08eeb8c86062 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:22.544021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b275edf-924a-4459-af13-08eeb8c86062 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:22.545945 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b275edf-924a-4459-af13-08eeb8c86062 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:22.547090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b275edf-924a-4459-af13-08eeb8c86062 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:22.547497 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8d553057-708f-45cd-86cf-bcf6ac578c02 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:22.584092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8d553057-708f-45cd-86cf-bcf6ac578c02 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:22.587662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8d553057-708f-45cd-86cf-bcf6ac578c02 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:22.590356 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8d553057-708f-45cd-86cf-bcf6ac578c02 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 2959 microversion: 2.42 time: 1.895425 Sep 07 12:52:22.617315 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2200/4360] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:20 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 2959 bytes in 1926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:22.640618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-e553888c-f617-4fe9-8cf7-bc3b307d2dcd req-503863d5-797a-4212-8e2d-0632f28653af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b52328c-937b-46cf-abdf-8629194fc25c", "tag": "3adf0f69-1af4-4072-9454-5e1b89d8b2f7"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:52:22.680948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e553888c-f617-4fe9-8cf7-bc3b307d2dcd req-503863d5-797a-4212-8e2d-0632f28653af service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:22.681871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e553888c-f617-4fe9-8cf7-bc3b307d2dcd req-503863d5-797a-4212-8e2d-0632f28653af service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:22.682697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e553888c-f617-4fe9-8cf7-bc3b307d2dcd req-503863d5-797a-4212-8e2d-0632f28653af service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:22.733943 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-e553888c-f617-4fe9-8cf7-bc3b307d2dcd req-503863d5-797a-4212-8e2d-0632f28653af service nova] Creating event network-changed:3adf0f69-1af4-4072-9454-5e1b89d8b2f7 for instance 4b52328c-937b-46cf-abdf-8629194fc25c on n-h1-852087-9 Sep 07 12:52:22.751523 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-e553888c-f617-4fe9-8cf7-bc3b307d2dcd req-503863d5-797a-4212-8e2d-0632f28653af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131866 Sep 07 12:52:22.752579 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2201/4361] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:52:22.762099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8147704b-b224-474e-9e6c-25d2dbab7697 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:22.763181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8147704b-b224-474e-9e6c-25d2dbab7697 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:22.773345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8147704b-b224-474e-9e6c-25d2dbab7697 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:22.774784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8147704b-b224-474e-9e6c-25d2dbab7697 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:22.775472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8147704b-b224-474e-9e6c-25d2dbab7697 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:22.776611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8147704b-b224-474e-9e6c-25d2dbab7697 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:22.777266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8147704b-b224-474e-9e6c-25d2dbab7697 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:22.778128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8147704b-b224-474e-9e6c-25d2dbab7697 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:24.555443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8b275edf-924a-4459-af13-08eeb8c86062 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c230da9ab3d44a68af28b364b956b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71088375c4114b17977834198ab2bb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:24.581810 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8b275edf-924a-4459-af13-08eeb8c86062 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] 10.222.0.16 "GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe" status: 200 len: 1315 microversion: 2.1 time: 2.065014 Sep 07 12:52:24.582485 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2161/4362] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:22 2022] GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe => generated 1315 bytes in 2066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:24.589222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8147704b-b224-474e-9e6c-25d2dbab7697 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:24.597135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-bab64561-3d6e-460e-892b-de8b3d6ad476 req-fd5ebf75-558b-41c5-9107-72b5c00640da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f99e18e-8ba9-434e-b143-81c456497bbe", "name": "network-vif-plugged", "status": "completed", "tag": "ac49414e-9b8e-4066-8be2-4546299644eb"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:52:24.603931 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8147704b-b224-474e-9e6c-25d2dbab7697 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1527 microversion: 2.1 time: 1.849745 Sep 07 12:52:24.607401 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2202/4363] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:22 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1527 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:24.621327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:24.624384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b025adad-3087-4d66-bf8d-7658c3fb5c53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:24.625298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b025adad-3087-4d66-bf8d-7658c3fb5c53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:24.625853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-bab64561-3d6e-460e-892b-de8b3d6ad476 req-fd5ebf75-558b-41c5-9107-72b5c00640da service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:24.630272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-bab64561-3d6e-460e-892b-de8b3d6ad476 req-fd5ebf75-558b-41c5-9107-72b5c00640da service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:24.630796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-bab64561-3d6e-460e-892b-de8b3d6ad476 req-fd5ebf75-558b-41c5-9107-72b5c00640da service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:24.640493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b025adad-3087-4d66-bf8d-7658c3fb5c53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:24.643228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b025adad-3087-4d66-bf8d-7658c3fb5c53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:24.644914 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b025adad-3087-4d66-bf8d-7658c3fb5c53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:24.648741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b025adad-3087-4d66-bf8d-7658c3fb5c53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:24.649595 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b025adad-3087-4d66-bf8d-7658c3fb5c53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:24.650513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b025adad-3087-4d66-bf8d-7658c3fb5c53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:24.669821 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-bab64561-3d6e-460e-892b-de8b3d6ad476 req-fd5ebf75-558b-41c5-9107-72b5c00640da service nova] Creating event network-vif-plugged:ac49414e-9b8e-4066-8be2-4546299644eb for instance 0f99e18e-8ba9-434e-b143-81c456497bbe on n-h1-852087-9 Sep 07 12:52:24.690828 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-bab64561-3d6e-460e-892b-de8b3d6ad476 req-fd5ebf75-558b-41c5-9107-72b5c00640da service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106965 Sep 07 12:52:24.697386 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2162/4364] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:52:24.708246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2af93306-a56a-4df1-89f6-909496cafc4b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:24.708985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2af93306-a56a-4df1-89f6-909496cafc4b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:24.740238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2af93306-a56a-4df1-89f6-909496cafc4b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:24.741522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2af93306-a56a-4df1-89f6-909496cafc4b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:24.742617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2af93306-a56a-4df1-89f6-909496cafc4b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:24.744750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2af93306-a56a-4df1-89f6-909496cafc4b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:24.746000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2af93306-a56a-4df1-89f6-909496cafc4b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:24.747063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2af93306-a56a-4df1-89f6-909496cafc4b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:25.231001 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b025adad-3087-4d66-bf8d-7658c3fb5c53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:25.256690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b025adad-3087-4d66-bf8d-7658c3fb5c53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:25.258295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b025adad-3087-4d66-bf8d-7658c3fb5c53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:25.263387 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b025adad-3087-4d66-bf8d-7658c3fb5c53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1739 microversion: 2.20 time: 0.644651 Sep 07 12:52:25.264692 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2203/4365] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:24 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1739 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:25.429643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2af93306-a56a-4df1-89f6-909496cafc4b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:25.441990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2af93306-a56a-4df1-89f6-909496cafc4b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:25.443482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2af93306-a56a-4df1-89f6-909496cafc4b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:25.445000 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2af93306-a56a-4df1-89f6-909496cafc4b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 2959 microversion: 2.42 time: 0.746275 Sep 07 12:52:25.445610 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2163/4366] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:24 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 2959 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:25.622940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-24433268-6131-4835-bb4b-5d92f075bb83 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:25.626532 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-24433268-6131-4835-bb4b-5d92f075bb83 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] [instance: 0f99e18e-8ba9-434e-b143-81c456497bbe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:25.645563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-954f6083-6e5e-423d-9ddf-c8fa4135e0d3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:25.647259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-954f6083-6e5e-423d-9ddf-c8fa4135e0d3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:25.661865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24433268-6131-4835-bb4b-5d92f075bb83 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:25.663136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24433268-6131-4835-bb4b-5d92f075bb83 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:25.663931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24433268-6131-4835-bb4b-5d92f075bb83 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:25.665191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24433268-6131-4835-bb4b-5d92f075bb83 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:25.666305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24433268-6131-4835-bb4b-5d92f075bb83 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:25.667131 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24433268-6131-4835-bb4b-5d92f075bb83 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:25.671189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-954f6083-6e5e-423d-9ddf-c8fa4135e0d3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:25.672314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-954f6083-6e5e-423d-9ddf-c8fa4135e0d3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:25.673375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-954f6083-6e5e-423d-9ddf-c8fa4135e0d3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:25.675220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-954f6083-6e5e-423d-9ddf-c8fa4135e0d3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:25.676400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-954f6083-6e5e-423d-9ddf-c8fa4135e0d3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:25.677106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-954f6083-6e5e-423d-9ddf-c8fa4135e0d3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:26.502662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-24433268-6131-4835-bb4b-5d92f075bb83 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c230da9ab3d44a68af28b364b956b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71088375c4114b17977834198ab2bb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:26.511555 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-24433268-6131-4835-bb4b-5d92f075bb83 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] 10.222.0.16 "GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe" status: 200 len: 1315 microversion: 2.1 time: 0.904914 Sep 07 12:52:26.531088 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2204/4367] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:25 2022] GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe => generated 1315 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:52:26.539294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ded24492-c89f-44e7-8a01-e1f1884332aa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:26.540011 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ded24492-c89f-44e7-8a01-e1f1884332aa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:26.547407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ded24492-c89f-44e7-8a01-e1f1884332aa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:26.547927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ded24492-c89f-44e7-8a01-e1f1884332aa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:26.548395 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ded24492-c89f-44e7-8a01-e1f1884332aa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:26.549164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ded24492-c89f-44e7-8a01-e1f1884332aa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:26.549876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ded24492-c89f-44e7-8a01-e1f1884332aa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:26.550483 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ded24492-c89f-44e7-8a01-e1f1884332aa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:26.568895 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-954f6083-6e5e-423d-9ddf-c8fa4135e0d3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:26.594797 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:26.596400 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-954f6083-6e5e-423d-9ddf-c8fa4135e0d3 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1509 microversion: 2.1 time: 0.963802 Sep 07 12:52:26.598047 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2164/4368] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:25 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1509 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:26.613842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-83c972e7-f6ee-4b79-96f0-a4612bdc75f2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:26.618046 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-83c972e7-f6ee-4b79-96f0-a4612bdc75f2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:26.625098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83c972e7-f6ee-4b79-96f0-a4612bdc75f2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:26.625921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83c972e7-f6ee-4b79-96f0-a4612bdc75f2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:26.626530 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83c972e7-f6ee-4b79-96f0-a4612bdc75f2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:26.627542 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83c972e7-f6ee-4b79-96f0-a4612bdc75f2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:26.628208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83c972e7-f6ee-4b79-96f0-a4612bdc75f2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:26.628811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83c972e7-f6ee-4b79-96f0-a4612bdc75f2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:27.836079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ded24492-c89f-44e7-8a01-e1f1884332aa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:27.846212 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ded24492-c89f-44e7-8a01-e1f1884332aa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:27.848022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ded24492-c89f-44e7-8a01-e1f1884332aa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:27.849669 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ded24492-c89f-44e7-8a01-e1f1884332aa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1721 microversion: 2.20 time: 1.317076 Sep 07 12:52:27.851153 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2205/4369] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:26 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1721 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:27.856496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-73da21c0-ea17-4f50-a102-55b9e3c798e7 req-5b8d37ae-82aa-476b-8218-221051b13818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f90d70b2-052c-4840-8008-9d9b2b08772a", "name": "network-vif-unplugged", "status": "completed", "tag": "3b263aff-c35a-41f4-8ce7-a3994b2d62ea"}, {"server_uuid": "f90d70b2-052c-4840-8008-9d9b2b08772a", "name": "network-vif-unplugged", "status": "completed", "tag": "ff4033b6-7d47-4ed1-9c26-6cc0e709c6e8"}, {"server_uuid": "f90d70b2-052c-4840-8008-9d9b2b08772a", "name": "network-vif-unplugged", "status": "completed", "tag": "4884ea30-6481-4544-a1c7-5f3beab54e8d"}, {"server_uuid": "f90d70b2-052c-4840-8008-9d9b2b08772a", "name": "network-vif-unplugged", "status": "completed", "tag": "c36949c2-d7d4-432d-beb4-1b6f8be02a34"}, {"server_uuid": "f90d70b2-052c-4840-8008-9d9b2b08772a", "name": "network-vif-unplugged", "status": "completed", "tag": "32b44f36-cd89-4a45-8da9-812f25573ca9"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:52:27.875293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-73da21c0-ea17-4f50-a102-55b9e3c798e7 req-5b8d37ae-82aa-476b-8218-221051b13818 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:27.876085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-73da21c0-ea17-4f50-a102-55b9e3c798e7 req-5b8d37ae-82aa-476b-8218-221051b13818 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:27.876822 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-73da21c0-ea17-4f50-a102-55b9e3c798e7 req-5b8d37ae-82aa-476b-8218-221051b13818 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:27.896170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-83c972e7-f6ee-4b79-96f0-a4612bdc75f2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:27.901728 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-73da21c0-ea17-4f50-a102-55b9e3c798e7 req-5b8d37ae-82aa-476b-8218-221051b13818 service nova] Creating event network-vif-unplugged:3b263aff-c35a-41f4-8ce7-a3994b2d62ea for instance f90d70b2-052c-4840-8008-9d9b2b08772a on n-h2-852087-9 Sep 07 12:52:27.905866 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-73da21c0-ea17-4f50-a102-55b9e3c798e7 req-5b8d37ae-82aa-476b-8218-221051b13818 service nova] Creating event network-vif-unplugged:ff4033b6-7d47-4ed1-9c26-6cc0e709c6e8 for instance f90d70b2-052c-4840-8008-9d9b2b08772a on n-h2-852087-9 Sep 07 12:52:27.907606 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-73da21c0-ea17-4f50-a102-55b9e3c798e7 req-5b8d37ae-82aa-476b-8218-221051b13818 service nova] Creating event network-vif-unplugged:4884ea30-6481-4544-a1c7-5f3beab54e8d for instance f90d70b2-052c-4840-8008-9d9b2b08772a on n-h2-852087-9 Sep 07 12:52:27.911624 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-83c972e7-f6ee-4b79-96f0-a4612bdc75f2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:27.912850 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-73da21c0-ea17-4f50-a102-55b9e3c798e7 req-5b8d37ae-82aa-476b-8218-221051b13818 service nova] Creating event network-vif-unplugged:c36949c2-d7d4-432d-beb4-1b6f8be02a34 for instance f90d70b2-052c-4840-8008-9d9b2b08772a on n-h2-852087-9 Sep 07 12:52:27.913606 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-73da21c0-ea17-4f50-a102-55b9e3c798e7 req-5b8d37ae-82aa-476b-8218-221051b13818 service nova] Creating event network-vif-unplugged:32b44f36-cd89-4a45-8da9-812f25573ca9 for instance f90d70b2-052c-4840-8008-9d9b2b08772a on n-h2-852087-9 Sep 07 12:52:27.919417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-83c972e7-f6ee-4b79-96f0-a4612bdc75f2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:27.922545 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-83c972e7-f6ee-4b79-96f0-a4612bdc75f2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 2938 microversion: 2.42 time: 1.322446 Sep 07 12:52:27.925824 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-73da21c0-ea17-4f50-a102-55b9e3c798e7 req-5b8d37ae-82aa-476b-8218-221051b13818 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.071997 Sep 07 12:52:27.927091 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2165/4370] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:26 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 2938 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:27.929029 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2206/4371] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:52:27.940215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c2be1da7-5ff8-411a-a79e-ca35f3ba448b tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:27.940773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f7435901-40c4-47f0-95b7-49a0986214f0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:27.941674 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c2be1da7-5ff8-411a-a79e-ca35f3ba448b tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] [instance: 0f99e18e-8ba9-434e-b143-81c456497bbe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:27.942683 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f7435901-40c4-47f0-95b7-49a0986214f0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:27.959923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7435901-40c4-47f0-95b7-49a0986214f0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:27.961076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2be1da7-5ff8-411a-a79e-ca35f3ba448b tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:27.961783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2be1da7-5ff8-411a-a79e-ca35f3ba448b tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:27.962545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7435901-40c4-47f0-95b7-49a0986214f0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:27.963207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2be1da7-5ff8-411a-a79e-ca35f3ba448b tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:27.964608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2be1da7-5ff8-411a-a79e-ca35f3ba448b tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:27.964988 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7435901-40c4-47f0-95b7-49a0986214f0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:27.966134 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7435901-40c4-47f0-95b7-49a0986214f0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:27.966976 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2be1da7-5ff8-411a-a79e-ca35f3ba448b tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:27.968394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2be1da7-5ff8-411a-a79e-ca35f3ba448b tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:27.968623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7435901-40c4-47f0-95b7-49a0986214f0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:27.969230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7435901-40c4-47f0-95b7-49a0986214f0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:28.622508 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f7435901-40c4-47f0-95b7-49a0986214f0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:28.631805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c2be1da7-5ff8-411a-a79e-ca35f3ba448b tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c230da9ab3d44a68af28b364b956b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71088375c4114b17977834198ab2bb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:28.637390 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f7435901-40c4-47f0-95b7-49a0986214f0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1509 microversion: 2.1 time: 0.706721 Sep 07 12:52:28.638288 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2207/4372] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:27 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1509 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:28.646843 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c2be1da7-5ff8-411a-a79e-ca35f3ba448b tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] 10.222.0.16 "GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe" status: 200 len: 1502 microversion: 2.1 time: 0.718253 Sep 07 12:52:28.648147 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2166/4373] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:27 2022] GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe => generated 1502 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:28.703050 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-78b8aacf-f660-455e-897b-951b4a84b218 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:28.704351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-78b8aacf-f660-455e-897b-951b4a84b218 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] [instance: 0f99e18e-8ba9-434e-b143-81c456497bbe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:28.722178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78b8aacf-f660-455e-897b-951b4a84b218 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:28.723759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78b8aacf-f660-455e-897b-951b4a84b218 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:28.724809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78b8aacf-f660-455e-897b-951b4a84b218 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:28.726146 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78b8aacf-f660-455e-897b-951b4a84b218 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:28.727221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78b8aacf-f660-455e-897b-951b4a84b218 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:28.727994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78b8aacf-f660-455e-897b-951b4a84b218 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:28.886543 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-78b8aacf-f660-455e-897b-951b4a84b218 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.191353 Sep 07 12:52:28.888706 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2208/4374] 10.222.0.16 () {58 vars in 1296 bytes} [Wed Sep 7 12:52:28 2022] DELETE /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe/os-server-password => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 12:52:28.900273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f0c88cd1-9f4d-49d4-8d9d-bf6a40c72d21 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:28.902415 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f0c88cd1-9f4d-49d4-8d9d-bf6a40c72d21 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:28.905094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d2f37e67-5764-4f22-b961-ba8f056beed4 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:28.905707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d2f37e67-5764-4f22-b961-ba8f056beed4 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] [instance: 0f99e18e-8ba9-434e-b143-81c456497bbe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:28.915148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0c88cd1-9f4d-49d4-8d9d-bf6a40c72d21 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:28.916014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0c88cd1-9f4d-49d4-8d9d-bf6a40c72d21 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:28.916899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0c88cd1-9f4d-49d4-8d9d-bf6a40c72d21 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:28.918938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0c88cd1-9f4d-49d4-8d9d-bf6a40c72d21 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:28.920218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0c88cd1-9f4d-49d4-8d9d-bf6a40c72d21 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:28.920637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2f37e67-5764-4f22-b961-ba8f056beed4 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:28.921157 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2f37e67-5764-4f22-b961-ba8f056beed4 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:28.921641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2f37e67-5764-4f22-b961-ba8f056beed4 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:28.922208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0c88cd1-9f4d-49d4-8d9d-bf6a40c72d21 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:28.922404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2f37e67-5764-4f22-b961-ba8f056beed4 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:28.923027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2f37e67-5764-4f22-b961-ba8f056beed4 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:28.923576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2f37e67-5764-4f22-b961-ba8f056beed4 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:28.982517 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d2f37e67-5764-4f22-b961-ba8f056beed4 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] 10.222.0.16 "GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.083916 Sep 07 12:52:28.992742 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2209/4375] 10.222.0.16 () {58 vars in 1293 bytes} [Wed Sep 7 12:52:28 2022] GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe/os-server-password => generated 16 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 12:52:28.992742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cd1e2e79-46fc-4427-bc11-9fc8f1b9df55 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:28.992742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cd1e2e79-46fc-4427-bc11-9fc8f1b9df55 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:29.000003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd1e2e79-46fc-4427-bc11-9fc8f1b9df55 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:29.000003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd1e2e79-46fc-4427-bc11-9fc8f1b9df55 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:29.000003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd1e2e79-46fc-4427-bc11-9fc8f1b9df55 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:29.000003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd1e2e79-46fc-4427-bc11-9fc8f1b9df55 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:29.000003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd1e2e79-46fc-4427-bc11-9fc8f1b9df55 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:29.003599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd1e2e79-46fc-4427-bc11-9fc8f1b9df55 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:29.388849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f0c88cd1-9f4d-49d4-8d9d-bf6a40c72d21 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:29.402885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cd1e2e79-46fc-4427-bc11-9fc8f1b9df55 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:29.426581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cd1e2e79-46fc-4427-bc11-9fc8f1b9df55 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:29.430929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cd1e2e79-46fc-4427-bc11-9fc8f1b9df55 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:29.433906 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cd1e2e79-46fc-4427-bc11-9fc8f1b9df55 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 2917 microversion: 2.42 time: 0.448878 Sep 07 12:52:29.444312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f0c88cd1-9f4d-49d4-8d9d-bf6a40c72d21 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:29.448234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f0c88cd1-9f4d-49d4-8d9d-bf6a40c72d21 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:29.450034 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2210/4376] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:28 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 2917 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:29.461747 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f0c88cd1-9f4d-49d4-8d9d-bf6a40c72d21 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1721 microversion: 2.20 time: 0.579848 Sep 07 12:52:29.461747 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2167/4377] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:28 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1721 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:29.466569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0db6b6f1-96fc-48fd-acb1-9b1a13f57815 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:29.467542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0db6b6f1-96fc-48fd-acb1-9b1a13f57815 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] [instance: 0f99e18e-8ba9-434e-b143-81c456497bbe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:29.489621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0db6b6f1-96fc-48fd-acb1-9b1a13f57815 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:29.490516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0db6b6f1-96fc-48fd-acb1-9b1a13f57815 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:29.491294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0db6b6f1-96fc-48fd-acb1-9b1a13f57815 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:29.492953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0db6b6f1-96fc-48fd-acb1-9b1a13f57815 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:29.494384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0db6b6f1-96fc-48fd-acb1-9b1a13f57815 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:29.496314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0db6b6f1-96fc-48fd-acb1-9b1a13f57815 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:29.551615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0db6b6f1-96fc-48fd-acb1-9b1a13f57815 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] [instance: 0f99e18e-8ba9-434e-b143-81c456497bbe] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:52:29.698041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-94816e33-f0e0-4f84-827f-308d8ec0e903 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:29.707023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-94816e33-f0e0-4f84-827f-308d8ec0e903 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:29.742562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94816e33-f0e0-4f84-827f-308d8ec0e903 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:29.749212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94816e33-f0e0-4f84-827f-308d8ec0e903 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:29.752550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94816e33-f0e0-4f84-827f-308d8ec0e903 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:29.753923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94816e33-f0e0-4f84-827f-308d8ec0e903 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:29.755399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94816e33-f0e0-4f84-827f-308d8ec0e903 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:29.760543 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94816e33-f0e0-4f84-827f-308d8ec0e903 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:29.771663 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0db6b6f1-96fc-48fd-acb1-9b1a13f57815 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe" status: 204 len: 0 microversion: 2.1 time: 0.317626 Sep 07 12:52:29.780890 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2211/4378] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:52:29 2022] DELETE /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:29.800025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b0868b11-0c20-48dd-b6e6-8a12f02ed6a0 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:29.802931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b0868b11-0c20-48dd-b6e6-8a12f02ed6a0 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] [instance: 0f99e18e-8ba9-434e-b143-81c456497bbe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:29.822315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:29.824274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0868b11-0c20-48dd-b6e6-8a12f02ed6a0 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:29.825528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0868b11-0c20-48dd-b6e6-8a12f02ed6a0 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:29.827136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0868b11-0c20-48dd-b6e6-8a12f02ed6a0 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:29.831264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0868b11-0c20-48dd-b6e6-8a12f02ed6a0 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:29.834925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0868b11-0c20-48dd-b6e6-8a12f02ed6a0 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:29.834925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0868b11-0c20-48dd-b6e6-8a12f02ed6a0 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:30.344294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-94816e33-f0e0-4f84-827f-308d8ec0e903 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:30.367212 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-94816e33-f0e0-4f84-827f-308d8ec0e903 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1509 microversion: 2.1 time: 0.686373 Sep 07 12:52:30.373712 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2168/4379] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:29 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1509 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:30.381063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-97b97fc2-09a0-40e5-ab44-b675a4e91478 req-2edee2f7-97ed-4d9d-84f4-12256d707892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f90d70b2-052c-4840-8008-9d9b2b08772a", "name": "network-vif-unplugged", "status": "completed", "tag": "bb3dbd1e-6aad-4076-9d60-f092ced32e09"}, {"server_uuid": "6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860", "name": "network-vif-unplugged", "status": "completed", "tag": "01afecc6-db9f-4ad9-84b4-c7038640dcd0"}, {"server_uuid": "ffe6581c-7070-48c5-a16d-fa30b22567d4", "name": "network-vif-unplugged", "status": "completed", "tag": "57759270-a8de-4adc-a2ba-ccbb3e371878"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:52:30.420500 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-97b97fc2-09a0-40e5-ab44-b675a4e91478 req-2edee2f7-97ed-4d9d-84f4-12256d707892 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:30.421522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-97b97fc2-09a0-40e5-ab44-b675a4e91478 req-2edee2f7-97ed-4d9d-84f4-12256d707892 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:30.423036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-97b97fc2-09a0-40e5-ab44-b675a4e91478 req-2edee2f7-97ed-4d9d-84f4-12256d707892 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:30.449766 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-97b97fc2-09a0-40e5-ab44-b675a4e91478 req-2edee2f7-97ed-4d9d-84f4-12256d707892 service nova] Creating event network-vif-unplugged:bb3dbd1e-6aad-4076-9d60-f092ced32e09 for instance f90d70b2-052c-4840-8008-9d9b2b08772a on n-h2-852087-9 Sep 07 12:52:30.450921 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-97b97fc2-09a0-40e5-ab44-b675a4e91478 req-2edee2f7-97ed-4d9d-84f4-12256d707892 service nova] Creating event network-vif-unplugged:01afecc6-db9f-4ad9-84b4-c7038640dcd0 for instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 on n-h1-852087-9 Sep 07 12:52:30.452108 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-97b97fc2-09a0-40e5-ab44-b675a4e91478 req-2edee2f7-97ed-4d9d-84f4-12256d707892 service nova] Creating event network-vif-unplugged:57759270-a8de-4adc-a2ba-ccbb3e371878 for instance ffe6581c-7070-48c5-a16d-fa30b22567d4 on n-h2-852087-9 Sep 07 12:52:30.472997 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-97b97fc2-09a0-40e5-ab44-b675a4e91478 req-2edee2f7-97ed-4d9d-84f4-12256d707892 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.096194 Sep 07 12:52:30.474448 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2169/4380] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:52:30.493886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fdc0d931-9efb-49be-aa5d-c6ca8affa0ae tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:30.494616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fdc0d931-9efb-49be-aa5d-c6ca8affa0ae tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:30.507077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b0868b11-0c20-48dd-b6e6-8a12f02ed6a0 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c230da9ab3d44a68af28b364b956b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71088375c4114b17977834198ab2bb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:30.515588 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b0868b11-0c20-48dd-b6e6-8a12f02ed6a0 tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] 10.222.0.16 "GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe" status: 200 len: 1508 microversion: 2.1 time: 0.731829 Sep 07 12:52:30.536990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdc0d931-9efb-49be-aa5d-c6ca8affa0ae tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:30.537529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdc0d931-9efb-49be-aa5d-c6ca8affa0ae tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:30.537824 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2212/4381] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:29 2022] GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe => generated 1508 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:30.543045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-68f8c1b1-cdee-48a9-b18c-4d4c6aba54cf tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:30.548081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdc0d931-9efb-49be-aa5d-c6ca8affa0ae tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:30.549233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdc0d931-9efb-49be-aa5d-c6ca8affa0ae tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:30.550273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-68f8c1b1-cdee-48a9-b18c-4d4c6aba54cf tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:30.555785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdc0d931-9efb-49be-aa5d-c6ca8affa0ae tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:30.559684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdc0d931-9efb-49be-aa5d-c6ca8affa0ae tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:30.569022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68f8c1b1-cdee-48a9-b18c-4d4c6aba54cf tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:30.571396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68f8c1b1-cdee-48a9-b18c-4d4c6aba54cf tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:30.571957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68f8c1b1-cdee-48a9-b18c-4d4c6aba54cf tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:30.575837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68f8c1b1-cdee-48a9-b18c-4d4c6aba54cf tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:30.577137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68f8c1b1-cdee-48a9-b18c-4d4c6aba54cf tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:30.578762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68f8c1b1-cdee-48a9-b18c-4d4c6aba54cf tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:31.061257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-68f8c1b1-cdee-48a9-b18c-4d4c6aba54cf tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:31.090603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-68f8c1b1-cdee-48a9-b18c-4d4c6aba54cf tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:31.096034 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-68f8c1b1-cdee-48a9-b18c-4d4c6aba54cf tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:31.099337 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-68f8c1b1-cdee-48a9-b18c-4d4c6aba54cf tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1724 microversion: 2.20 time: 0.559789 Sep 07 12:52:31.103706 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2213/4382] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:30 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1724 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:31.169261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ccb291d1-2c93-4551-9073-5c1260214a05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60a03179-dfc5-4d9f-bfef-9c7b3eee7282"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:52:31.177004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ccb291d1-2c93-4551-9073-5c1260214a05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:31.194026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ccb291d1-2c93-4551-9073-5c1260214a05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:31.196472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ccb291d1-2c93-4551-9073-5c1260214a05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:31.197966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ccb291d1-2c93-4551-9073-5c1260214a05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:31.199752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ccb291d1-2c93-4551-9073-5c1260214a05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:31.200874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ccb291d1-2c93-4551-9073-5c1260214a05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:31.201778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ccb291d1-2c93-4551-9073-5c1260214a05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:31.257791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fdc0d931-9efb-49be-aa5d-c6ca8affa0ae tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:31.274721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fdc0d931-9efb-49be-aa5d-c6ca8affa0ae tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:31.282999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fdc0d931-9efb-49be-aa5d-c6ca8affa0ae tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:31.286027 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fdc0d931-9efb-49be-aa5d-c6ca8affa0ae tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 2917 microversion: 2.42 time: 0.802719 Sep 07 12:52:31.305590 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2170/4383] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:30 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 2917 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:31.422132 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3efb7554-8664-4f43-8c92-fd7f6a14305f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:31.425739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3efb7554-8664-4f43-8c92-fd7f6a14305f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:31.451812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3efb7554-8664-4f43-8c92-fd7f6a14305f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:31.453188 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3efb7554-8664-4f43-8c92-fd7f6a14305f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:31.454030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3efb7554-8664-4f43-8c92-fd7f6a14305f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:31.456501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3efb7554-8664-4f43-8c92-fd7f6a14305f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:31.457753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3efb7554-8664-4f43-8c92-fd7f6a14305f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:31.459121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3efb7554-8664-4f43-8c92-fd7f6a14305f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:31.673198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3efb7554-8664-4f43-8c92-fd7f6a14305f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:31.708270 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3efb7554-8664-4f43-8c92-fd7f6a14305f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1512 microversion: 2.1 time: 0.291952 Sep 07 12:52:31.712822 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2171/4384] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:31 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1512 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:52:31.722565 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-fe310a65-d719-4bd4-8647-34de1b53ff1b req-1d509dd3-6ab9-41e7-a1b1-9b8f32d92c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f90d70b2-052c-4840-8008-9d9b2b08772a", "name": "network-vif-deleted", "tag": "32b44f36-cd89-4a45-8da9-812f25573ca9"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:52:31.756712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fe310a65-d719-4bd4-8647-34de1b53ff1b req-1d509dd3-6ab9-41e7-a1b1-9b8f32d92c6a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:31.758592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fe310a65-d719-4bd4-8647-34de1b53ff1b req-1d509dd3-6ab9-41e7-a1b1-9b8f32d92c6a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:31.759213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fe310a65-d719-4bd4-8647-34de1b53ff1b req-1d509dd3-6ab9-41e7-a1b1-9b8f32d92c6a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:31.793005 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ccb291d1-2c93-4551-9073-5c1260214a05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "POST /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.634979 Sep 07 12:52:31.797354 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-fe310a65-d719-4bd4-8647-34de1b53ff1b req-1d509dd3-6ab9-41e7-a1b1-9b8f32d92c6a service nova] Creating event network-vif-deleted:32b44f36-cd89-4a45-8da9-812f25573ca9 for instance f90d70b2-052c-4840-8008-9d9b2b08772a on n-h2-852087-9 Sep 07 12:52:31.804562 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-fe310a65-d719-4bd4-8647-34de1b53ff1b req-1d509dd3-6ab9-41e7-a1b1-9b8f32d92c6a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085396 Sep 07 12:52:31.806161 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2172/4385] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:52:31.811136 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2214/4386] 10.222.0.16 () {62 vars in 1364 bytes} [Wed Sep 7 12:52:31 2022] POST /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4/os-volume_attachments => generated 188 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 12:52:31.817084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-15f7fa66-66af-4e42-9729-294bb9fa0c4d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:31.833475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-15f7fa66-66af-4e42-9729-294bb9fa0c4d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] [instance: 0f99e18e-8ba9-434e-b143-81c456497bbe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:31.836845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9d895d6e-2659-430c-81ca-54ea8d31b1f2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:31.839581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9d895d6e-2659-430c-81ca-54ea8d31b1f2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:31.864800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d895d6e-2659-430c-81ca-54ea8d31b1f2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:31.874570 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d895d6e-2659-430c-81ca-54ea8d31b1f2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:31.875386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d895d6e-2659-430c-81ca-54ea8d31b1f2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:31.878469 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15f7fa66-66af-4e42-9729-294bb9fa0c4d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:31.881999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15f7fa66-66af-4e42-9729-294bb9fa0c4d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:31.886891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d895d6e-2659-430c-81ca-54ea8d31b1f2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:31.893226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d895d6e-2659-430c-81ca-54ea8d31b1f2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:31.898778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d895d6e-2659-430c-81ca-54ea8d31b1f2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:31.913908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15f7fa66-66af-4e42-9729-294bb9fa0c4d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:31.915348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15f7fa66-66af-4e42-9729-294bb9fa0c4d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:31.916491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15f7fa66-66af-4e42-9729-294bb9fa0c4d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:31.918542 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15f7fa66-66af-4e42-9729-294bb9fa0c4d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:32.379491 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9d895d6e-2659-430c-81ca-54ea8d31b1f2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:32.392113 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9d895d6e-2659-430c-81ca-54ea8d31b1f2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1512 microversion: 2.1 time: 0.570544 Sep 07 12:52:32.394237 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2215/4387] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:31 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1512 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:32.405071 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-37db911e-2431-494d-9c87-9903d982d8af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:52:32.406687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-37db911e-2431-494d-9c87-9903d982d8af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:32.424643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37db911e-2431-494d-9c87-9903d982d8af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:32.426017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37db911e-2431-494d-9c87-9903d982d8af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:32.426781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37db911e-2431-494d-9c87-9903d982d8af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:32.428111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37db911e-2431-494d-9c87-9903d982d8af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:32.429148 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37db911e-2431-494d-9c87-9903d982d8af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:32.431760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37db911e-2431-494d-9c87-9903d982d8af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:32.701090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-37db911e-2431-494d-9c87-9903d982d8af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122433) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 12:52:32.723125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-15f7fa66-66af-4e42-9729-294bb9fa0c4d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c230da9ab3d44a68af28b364b956b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71088375c4114b17977834198ab2bb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:32.745371 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-15f7fa66-66af-4e42-9729-294bb9fa0c4d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] 10.222.0.16 "GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe" status: 200 len: 1508 microversion: 2.1 time: 0.937114 Sep 07 12:52:32.746658 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2173/4388] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:31 2022] GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe => generated 1508 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:32.755544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f46c8b06-fa28-4cad-bde8-0800be703292 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:32.756537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f46c8b06-fa28-4cad-bde8-0800be703292 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:32.767174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f46c8b06-fa28-4cad-bde8-0800be703292 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:32.768367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f46c8b06-fa28-4cad-bde8-0800be703292 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:32.769620 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f46c8b06-fa28-4cad-bde8-0800be703292 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:32.771273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f46c8b06-fa28-4cad-bde8-0800be703292 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:32.772767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f46c8b06-fa28-4cad-bde8-0800be703292 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:32.773832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f46c8b06-fa28-4cad-bde8-0800be703292 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:32.829285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=7,nova_cell1:INSERT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:32.877955 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-37db911e-2431-494d-9c87-9903d982d8af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "POST /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4/action" status: 202 len: 0 microversion: 2.20 time: 0.481284 Sep 07 12:52:32.878952 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2216/4389] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Sep 7 12:52:32 2022] POST /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:32.889575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e229c111-9a58-4dcf-9c88-bb872c3b2a85 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:52:32.891020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e229c111-9a58-4dcf-9c88-bb872c3b2a85 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:32.908393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e229c111-9a58-4dcf-9c88-bb872c3b2a85 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:32.910020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e229c111-9a58-4dcf-9c88-bb872c3b2a85 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:32.910020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e229c111-9a58-4dcf-9c88-bb872c3b2a85 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:32.911482 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e229c111-9a58-4dcf-9c88-bb872c3b2a85 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:32.912035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e229c111-9a58-4dcf-9c88-bb872c3b2a85 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:32.913120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e229c111-9a58-4dcf-9c88-bb872c3b2a85 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:32.973731 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-e229c111-9a58-4dcf-9c88-bb872c3b2a85 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lazy-loading 'flavor' on Instance uuid 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:52:33.002967 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-e229c111-9a58-4dcf-9c88-bb872c3b2a85 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Cannot 'shelve' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state shelved_offloaded Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e229c111-9a58-4dcf-9c88-bb872c3b2a85 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action HTTP/1.1 Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 14 Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: {"shelve": {}} Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: exception: Cannot 'shelve' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state shelved_offloaded Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860', 'body': {'shelve': {}}} Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 12:52:33.006187 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 12:52:33.016163 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state shelved_offloaded Sep 07 12:52:33.016163 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:52:33.016163 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:52:33.016163 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:52:33.016163 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:52:33.016163 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:52:33.016163 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:52:33.016163 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:52:33.016163 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:52:33.016163 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state shelved_offloaded Sep 07 12:52:33.016163 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:52:33.016163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e229c111-9a58-4dcf-9c88-bb872c3b2a85 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 409 to user: Cannot 'shelve' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state shelved_offloaded {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:52:33.016163 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e229c111-9a58-4dcf-9c88-bb872c3b2a85 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action" status: 409 len: 155 microversion: 2.1 time: 0.128298 Sep 07 12:52:33.016163 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2217/4390] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:52:32 2022] POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action => generated 155 bytes in 135 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:52:33.032456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7b09af15-0d8c-4d3e-913d-a868080462c3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:33.033387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7b09af15-0d8c-4d3e-913d-a868080462c3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:33.043561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b09af15-0d8c-4d3e-913d-a868080462c3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:33.045166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b09af15-0d8c-4d3e-913d-a868080462c3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:33.045431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b09af15-0d8c-4d3e-913d-a868080462c3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:33.046626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b09af15-0d8c-4d3e-913d-a868080462c3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:33.047298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b09af15-0d8c-4d3e-913d-a868080462c3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:33.049296 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b09af15-0d8c-4d3e-913d-a868080462c3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:33.504329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f46c8b06-fa28-4cad-bde8-0800be703292 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:33.524708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f46c8b06-fa28-4cad-bde8-0800be703292 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:33.527927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f46c8b06-fa28-4cad-bde8-0800be703292 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:33.530530 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f46c8b06-fa28-4cad-bde8-0800be703292 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 2756 microversion: 2.42 time: 0.781840 Sep 07 12:52:33.532281 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2174/4391] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:32 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 2756 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:33.545995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e586f4ec-14de-48c5-ac0d-711be23f389c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:52:33.547375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e586f4ec-14de-48c5-ac0d-711be23f389c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:33.579855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e586f4ec-14de-48c5-ac0d-711be23f389c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:33.582476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e586f4ec-14de-48c5-ac0d-711be23f389c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:33.585992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e586f4ec-14de-48c5-ac0d-711be23f389c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:33.587669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e586f4ec-14de-48c5-ac0d-711be23f389c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:33.588931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e586f4ec-14de-48c5-ac0d-711be23f389c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:33.590243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e586f4ec-14de-48c5-ac0d-711be23f389c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:33.648544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7b09af15-0d8c-4d3e-913d-a868080462c3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:33.669213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7b09af15-0d8c-4d3e-913d-a868080462c3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:33.670846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7b09af15-0d8c-4d3e-913d-a868080462c3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:33.672125 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7b09af15-0d8c-4d3e-913d-a868080462c3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1750 microversion: 2.20 time: 0.654647 Sep 07 12:52:33.686088 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2218/4392] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:33 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1750 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:33.699769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e586f4ec-14de-48c5-ac0d-711be23f389c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122432) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 12:52:33.799469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5e9ac84f-6743-43b3-978d-9b47e0b38acb tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:33.800509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5e9ac84f-6743-43b3-978d-9b47e0b38acb tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] [instance: 0f99e18e-8ba9-434e-b143-81c456497bbe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:33.808768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e9ac84f-6743-43b3-978d-9b47e0b38acb tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:33.809450 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e9ac84f-6743-43b3-978d-9b47e0b38acb tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:33.810522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e9ac84f-6743-43b3-978d-9b47e0b38acb tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:33.811679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e9ac84f-6743-43b3-978d-9b47e0b38acb tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:33.812350 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e9ac84f-6743-43b3-978d-9b47e0b38acb tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:33.812957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e9ac84f-6743-43b3-978d-9b47e0b38acb tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:33.898188 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e586f4ec-14de-48c5-ac0d-711be23f389c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action" status: 202 len: 0 microversion: 2.1 time: 0.363712 Sep 07 12:52:33.903689 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2175/4393] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:52:33 2022] POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:52:33.918816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-37e0379c-d523-4300-8dec-89f6cbc2e70f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:33.919724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-37e0379c-d523-4300-8dec-89f6cbc2e70f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:33.927495 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37e0379c-d523-4300-8dec-89f6cbc2e70f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:33.929590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37e0379c-d523-4300-8dec-89f6cbc2e70f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:33.930424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37e0379c-d523-4300-8dec-89f6cbc2e70f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:33.933391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37e0379c-d523-4300-8dec-89f6cbc2e70f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:33.934908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37e0379c-d523-4300-8dec-89f6cbc2e70f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:33.935644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37e0379c-d523-4300-8dec-89f6cbc2e70f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:34.723839 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37e0379c-d523-4300-8dec-89f6cbc2e70f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:34.740771 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-37e0379c-d523-4300-8dec-89f6cbc2e70f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1460 microversion: 2.1 time: 0.830662 Sep 07 12:52:34.741374 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2176/4394] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:33 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1460 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:34.758521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f061d62b-5886-47c7-acaf-d133fb59dcd3 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:34.762835 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f061d62b-5886-47c7-acaf-d133fb59dcd3 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:34.772839 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f061d62b-5886-47c7-acaf-d133fb59dcd3 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:34.778443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f061d62b-5886-47c7-acaf-d133fb59dcd3 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:34.778841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f061d62b-5886-47c7-acaf-d133fb59dcd3 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:34.779681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f061d62b-5886-47c7-acaf-d133fb59dcd3 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:34.781046 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f061d62b-5886-47c7-acaf-d133fb59dcd3 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:34.786477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f061d62b-5886-47c7-acaf-d133fb59dcd3 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:34.791969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5e9ac84f-6743-43b3-978d-9b47e0b38acb tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c230da9ab3d44a68af28b364b956b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71088375c4114b17977834198ab2bb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:34.811180 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5e9ac84f-6743-43b3-978d-9b47e0b38acb tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] 10.222.0.16 "GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe" status: 200 len: 1508 microversion: 2.1 time: 1.016171 Sep 07 12:52:34.811784 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2219/4395] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:33 2022] GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe => generated 1508 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:52:34.825009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f1997ef3-738d-4a13-afd5-eb20e0879516 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:34.837469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f1997ef3-738d-4a13-afd5-eb20e0879516 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:34.863830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1997ef3-738d-4a13-afd5-eb20e0879516 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:34.864841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1997ef3-738d-4a13-afd5-eb20e0879516 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:34.865533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1997ef3-738d-4a13-afd5-eb20e0879516 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:34.866490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1997ef3-738d-4a13-afd5-eb20e0879516 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:34.870329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1997ef3-738d-4a13-afd5-eb20e0879516 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:34.871286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1997ef3-738d-4a13-afd5-eb20e0879516 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:36.429394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f1997ef3-738d-4a13-afd5-eb20e0879516 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:36.464874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f1997ef3-738d-4a13-afd5-eb20e0879516 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:36.470134 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f1997ef3-738d-4a13-afd5-eb20e0879516 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:36.473554 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f1997ef3-738d-4a13-afd5-eb20e0879516 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1750 microversion: 2.20 time: 1.658308 Sep 07 12:52:36.475673 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2220/4396] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:34 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1750 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:36.504323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-2b778630-5cd5-4a22-991e-0cb90d158c73 req-752c85e9-be39-407f-b148-9fee58c76a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f99e18e-8ba9-434e-b143-81c456497bbe", "name": "network-vif-deleted", "tag": "ac49414e-9b8e-4066-8be2-4546299644eb"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:52:36.547300 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2b778630-5cd5-4a22-991e-0cb90d158c73 req-752c85e9-be39-407f-b148-9fee58c76a66 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:36.553760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2b778630-5cd5-4a22-991e-0cb90d158c73 req-752c85e9-be39-407f-b148-9fee58c76a66 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:36.555312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2b778630-5cd5-4a22-991e-0cb90d158c73 req-752c85e9-be39-407f-b148-9fee58c76a66 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:36.587152 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-2b778630-5cd5-4a22-991e-0cb90d158c73 req-752c85e9-be39-407f-b148-9fee58c76a66 service nova] Creating event network-vif-deleted:ac49414e-9b8e-4066-8be2-4546299644eb for instance 0f99e18e-8ba9-434e-b143-81c456497bbe on n-h1-852087-9 Sep 07 12:52:36.587885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f061d62b-5886-47c7-acaf-d133fb59dcd3 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:36.598068 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-2b778630-5cd5-4a22-991e-0cb90d158c73 req-752c85e9-be39-407f-b148-9fee58c76a66 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120159 Sep 07 12:52:36.601075 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2221/4397] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:52:36.614675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0e26d37b-2746-49a5-85b9-d687e8a4303a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:36.616882 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0e26d37b-2746-49a5-85b9-d687e8a4303a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:36.635954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e26d37b-2746-49a5-85b9-d687e8a4303a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:36.638117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e26d37b-2746-49a5-85b9-d687e8a4303a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:36.641464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e26d37b-2746-49a5-85b9-d687e8a4303a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:36.644594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e26d37b-2746-49a5-85b9-d687e8a4303a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:36.646376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e26d37b-2746-49a5-85b9-d687e8a4303a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:36.647780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e26d37b-2746-49a5-85b9-d687e8a4303a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:36.667399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f061d62b-5886-47c7-acaf-d133fb59dcd3 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:36.671123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f061d62b-5886-47c7-acaf-d133fb59dcd3 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:36.695933 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f061d62b-5886-47c7-acaf-d133fb59dcd3 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 2709 microversion: 2.42 time: 1.953112 Sep 07 12:52:36.713274 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2177/4398] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:34 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 2709 bytes in 1955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:36.713274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b446a1e7-eb81-44d7-95c4-f8888fa7e62d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:36.713274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b446a1e7-eb81-44d7-95c4-f8888fa7e62d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] [instance: 0f99e18e-8ba9-434e-b143-81c456497bbe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:36.738168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b446a1e7-eb81-44d7-95c4-f8888fa7e62d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:36.738547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b446a1e7-eb81-44d7-95c4-f8888fa7e62d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:36.743987 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b446a1e7-eb81-44d7-95c4-f8888fa7e62d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:36.745059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b446a1e7-eb81-44d7-95c4-f8888fa7e62d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:36.752330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b446a1e7-eb81-44d7-95c4-f8888fa7e62d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:36.753178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b446a1e7-eb81-44d7-95c4-f8888fa7e62d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:36.795494 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-b446a1e7-eb81-44d7-95c4-f8888fa7e62d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] HTTP exception thrown: Instance 0f99e18e-8ba9-434e-b143-81c456497bbe could not be found. Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b446a1e7-eb81-44d7-95c4-f8888fa7e62d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Request method failure captured: Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe HTTP/1.1 Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJPuPJiWdhM2CHrjny69ZRLq3SfKUrPmKkZmplMxUNnKajzkWk9dm41RE9dyyepAapBOs9qeK1mNbCIcHc8fPUeV6y8ptPzyq4b2MjB_BYLpwe6J9OzSnknMD-r3JzuAuC3cIdasLFOAuda6w2xlM9_4qCLO_STVVoQ2ej184xCN07Y Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 71088375c4114b17977834198ab2bb89 Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerPasswordTestJSON-1610962582 Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71088375c4114b17977834198ab2bb89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_71088375c4114b17977834198ab2bb89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/71088375c4114b17977834198ab2bb89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71088375c4114b17977834198ab2bb89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerPasswordTestJSON-1610962582 Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 71088375c4114b17977834198ab2bb89 Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1610962582 Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerPasswordTestJSON-1610962582-project Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 7c230da9ab3d44a68af28b364b956b46 Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerPasswordTestJSON-1610962582-project Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 0f99e18e-8ba9-434e-b143-81c456497bbe could not be found. Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '0f99e18e-8ba9-434e-b143-81c456497bbe'} Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f99e18e-8ba9-434e-b143-81c456497bbe could not be found. Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f99e18e-8ba9-434e-b143-81c456497bbe could not be found. Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:52:36.797399 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:36.803593 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:52:36.803593 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:52:36.803593 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:52:36.803593 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:52:36.803593 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:52:36.803593 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f99e18e-8ba9-434e-b143-81c456497bbe could not be found. Sep 07 12:52:36.803593 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:52:36.803593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b446a1e7-eb81-44d7-95c4-f8888fa7e62d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] Returning 404 to user: Instance 0f99e18e-8ba9-434e-b143-81c456497bbe could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:52:36.807226 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b446a1e7-eb81-44d7-95c4-f8888fa7e62d tempest-ServerPasswordTestJSON-1610962582 tempest-ServerPasswordTestJSON-1610962582-project] 10.222.0.16 "GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe" status: 404 len: 111 microversion: 2.1 time: 0.100450 Sep 07 12:52:36.807226 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2178/4399] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:36 2022] GET /compute/v2.1/servers/0f99e18e-8ba9-434e-b143-81c456497bbe => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:52:37.339918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0e26d37b-2746-49a5-85b9-d687e8a4303a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:37.355780 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0e26d37b-2746-49a5-85b9-d687e8a4303a tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1460 microversion: 2.1 time: 0.752363 Sep 07 12:52:37.356557 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2222/4400] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:36 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1460 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:37.525373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-419497f1-743a-41a8-849b-ef4317f319ce tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:37.526368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-419497f1-743a-41a8-849b-ef4317f319ce tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:37.542567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-419497f1-743a-41a8-849b-ef4317f319ce tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:37.543562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-419497f1-743a-41a8-849b-ef4317f319ce tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:37.544125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-419497f1-743a-41a8-849b-ef4317f319ce tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:37.544886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-419497f1-743a-41a8-849b-ef4317f319ce tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:37.545385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-419497f1-743a-41a8-849b-ef4317f319ce tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:37.545814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-419497f1-743a-41a8-849b-ef4317f319ce tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:37.759271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-99ac354d-cfb0-48a1-846a-656271f7fa19 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:37.760823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-99ac354d-cfb0-48a1-846a-656271f7fa19 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:37.772700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99ac354d-cfb0-48a1-846a-656271f7fa19 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:37.773215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99ac354d-cfb0-48a1-846a-656271f7fa19 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:37.773888 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99ac354d-cfb0-48a1-846a-656271f7fa19 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:37.777458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99ac354d-cfb0-48a1-846a-656271f7fa19 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:37.777997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99ac354d-cfb0-48a1-846a-656271f7fa19 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:37.778453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99ac354d-cfb0-48a1-846a-656271f7fa19 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:38.812744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-419497f1-743a-41a8-849b-ef4317f319ce tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:38.856424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-419497f1-743a-41a8-849b-ef4317f319ce tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:38.868580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-419497f1-743a-41a8-849b-ef4317f319ce tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:38.878169 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-419497f1-743a-41a8-849b-ef4317f319ce tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1752 microversion: 2.20 time: 1.353547 Sep 07 12:52:38.880957 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2179/4401] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:37 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1752 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:52:38.904203 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6b08e8ec-e89a-45f2-a636-2e5210b25589 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:38.906083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6b08e8ec-e89a-45f2-a636-2e5210b25589 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:38.933477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b08e8ec-e89a-45f2-a636-2e5210b25589 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:38.936293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b08e8ec-e89a-45f2-a636-2e5210b25589 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:38.939626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b08e8ec-e89a-45f2-a636-2e5210b25589 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:38.950094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b08e8ec-e89a-45f2-a636-2e5210b25589 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:38.953125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b08e8ec-e89a-45f2-a636-2e5210b25589 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:38.956578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b08e8ec-e89a-45f2-a636-2e5210b25589 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:39.733341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-99ac354d-cfb0-48a1-846a-656271f7fa19 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:39.840862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-99ac354d-cfb0-48a1-846a-656271f7fa19 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:39.849378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-99ac354d-cfb0-48a1-846a-656271f7fa19 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:39.855805 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-99ac354d-cfb0-48a1-846a-656271f7fa19 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 2709 microversion: 2.42 time: 2.101849 Sep 07 12:52:39.862819 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2223/4402] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:37 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 2709 bytes in 2110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:39.898171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-1de5d818-f9a1-4b01-9dc9-0c1ca50dfa64 req-e0e747a3-c0db-4581-a4b3-872e047e0bff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f90d70b2-052c-4840-8008-9d9b2b08772a", "name": "network-vif-deleted", "tag": "c36949c2-d7d4-432d-beb4-1b6f8be02a34"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:52:39.941425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1de5d818-f9a1-4b01-9dc9-0c1ca50dfa64 req-e0e747a3-c0db-4581-a4b3-872e047e0bff service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:39.942407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1de5d818-f9a1-4b01-9dc9-0c1ca50dfa64 req-e0e747a3-c0db-4581-a4b3-872e047e0bff service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:39.943174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1de5d818-f9a1-4b01-9dc9-0c1ca50dfa64 req-e0e747a3-c0db-4581-a4b3-872e047e0bff service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:39.972176 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-1de5d818-f9a1-4b01-9dc9-0c1ca50dfa64 req-e0e747a3-c0db-4581-a4b3-872e047e0bff service nova] Creating event network-vif-deleted:c36949c2-d7d4-432d-beb4-1b6f8be02a34 for instance f90d70b2-052c-4840-8008-9d9b2b08772a on n-h2-852087-9 Sep 07 12:52:39.983144 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-1de5d818-f9a1-4b01-9dc9-0c1ca50dfa64 req-e0e747a3-c0db-4581-a4b3-872e047e0bff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116712 Sep 07 12:52:39.986768 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2224/4403] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:52:40.338377 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6b08e8ec-e89a-45f2-a636-2e5210b25589 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:40.374755 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6b08e8ec-e89a-45f2-a636-2e5210b25589 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 1.488364 Sep 07 12:52:40.378204 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2180/4404] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:38 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:40.400661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ef151098-20d4-4e4f-9ed3-ca098bc04232 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:40.403279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ef151098-20d4-4e4f-9ed3-ca098bc04232 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:40.434120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef151098-20d4-4e4f-9ed3-ca098bc04232 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:40.437295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef151098-20d4-4e4f-9ed3-ca098bc04232 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:40.441263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef151098-20d4-4e4f-9ed3-ca098bc04232 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:40.445374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef151098-20d4-4e4f-9ed3-ca098bc04232 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:40.446691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef151098-20d4-4e4f-9ed3-ca098bc04232 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:40.447607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef151098-20d4-4e4f-9ed3-ca098bc04232 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:40.655670 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ab3a5da3-4339-4d7c-a4d8-e1f42d126aa3 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:40.658530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ab3a5da3-4339-4d7c-a4d8-e1f42d126aa3 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:40.707643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab3a5da3-4339-4d7c-a4d8-e1f42d126aa3 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:40.708510 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab3a5da3-4339-4d7c-a4d8-e1f42d126aa3 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:40.733555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab3a5da3-4339-4d7c-a4d8-e1f42d126aa3 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:40.747889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab3a5da3-4339-4d7c-a4d8-e1f42d126aa3 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:40.752243 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab3a5da3-4339-4d7c-a4d8-e1f42d126aa3 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:40.758869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab3a5da3-4339-4d7c-a4d8-e1f42d126aa3 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:41.596636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ef151098-20d4-4e4f-9ed3-ca098bc04232 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:41.615597 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ef151098-20d4-4e4f-9ed3-ca098bc04232 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:41.626452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ef151098-20d4-4e4f-9ed3-ca098bc04232 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:41.628214 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ef151098-20d4-4e4f-9ed3-ca098bc04232 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1752 microversion: 2.20 time: 1.248154 Sep 07 12:52:41.646963 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2181/4405] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:40 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1752 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:41.657357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-61be2e4b-1c6b-40eb-832b-4a75ec649048 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:41.658198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-61be2e4b-1c6b-40eb-832b-4a75ec649048 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:41.675338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61be2e4b-1c6b-40eb-832b-4a75ec649048 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:41.675879 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61be2e4b-1c6b-40eb-832b-4a75ec649048 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:41.680547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61be2e4b-1c6b-40eb-832b-4a75ec649048 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:41.681687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61be2e4b-1c6b-40eb-832b-4a75ec649048 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:41.682374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61be2e4b-1c6b-40eb-832b-4a75ec649048 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:41.682998 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61be2e4b-1c6b-40eb-832b-4a75ec649048 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:42.231965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ab3a5da3-4339-4d7c-a4d8-e1f42d126aa3 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:42.258740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ab3a5da3-4339-4d7c-a4d8-e1f42d126aa3 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:42.266849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ab3a5da3-4339-4d7c-a4d8-e1f42d126aa3 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:42.277607 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ab3a5da3-4339-4d7c-a4d8-e1f42d126aa3 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 2948 microversion: 2.32 time: 2.286992 Sep 07 12:52:42.278812 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2225/4406] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:39 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 2948 bytes in 2291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:42.293882 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b780d1de-d95a-43aa-819e-94f65a99231c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:42.294815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b780d1de-d95a-43aa-819e-94f65a99231c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:42.310337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b780d1de-d95a-43aa-819e-94f65a99231c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:42.311147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b780d1de-d95a-43aa-819e-94f65a99231c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:42.313217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b780d1de-d95a-43aa-819e-94f65a99231c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:42.314419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b780d1de-d95a-43aa-819e-94f65a99231c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:42.316086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b780d1de-d95a-43aa-819e-94f65a99231c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:42.317695 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b780d1de-d95a-43aa-819e-94f65a99231c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:43.968643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-61be2e4b-1c6b-40eb-832b-4a75ec649048 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:43.988570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-61be2e4b-1c6b-40eb-832b-4a75ec649048 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:44.000299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-61be2e4b-1c6b-40eb-832b-4a75ec649048 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:44.009211 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-61be2e4b-1c6b-40eb-832b-4a75ec649048 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 2324 microversion: 2.42 time: 2.358172 Sep 07 12:52:44.035091 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2182/4407] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:41 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 2324 bytes in 2388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:44.043746 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-6c16dc92-d83a-47b7-b6ba-2ea35e913e13 req-a121fb64-f972-4af2-b986-ce19548ec2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f90d70b2-052c-4840-8008-9d9b2b08772a", "name": "network-vif-deleted", "tag": "3b263aff-c35a-41f4-8ce7-a3994b2d62ea"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:52:44.056409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6c16dc92-d83a-47b7-b6ba-2ea35e913e13 req-a121fb64-f972-4af2-b986-ce19548ec2b8 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:44.057196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6c16dc92-d83a-47b7-b6ba-2ea35e913e13 req-a121fb64-f972-4af2-b986-ce19548ec2b8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:44.058162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6c16dc92-d83a-47b7-b6ba-2ea35e913e13 req-a121fb64-f972-4af2-b986-ce19548ec2b8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:44.077728 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-6c16dc92-d83a-47b7-b6ba-2ea35e913e13 req-a121fb64-f972-4af2-b986-ce19548ec2b8 service nova] Creating event network-vif-deleted:3b263aff-c35a-41f4-8ce7-a3994b2d62ea for instance f90d70b2-052c-4840-8008-9d9b2b08772a on n-h2-852087-9 Sep 07 12:52:44.088083 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-6c16dc92-d83a-47b7-b6ba-2ea35e913e13 req-a121fb64-f972-4af2-b986-ce19548ec2b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050129 Sep 07 12:52:44.090269 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2183/4408] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:52:44.098892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-76d1b972-0395-47b4-bb52-bdc4774e3211 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:44.099926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-76d1b972-0395-47b4-bb52-bdc4774e3211 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:44.105394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b780d1de-d95a-43aa-819e-94f65a99231c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:44.110434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76d1b972-0395-47b4-bb52-bdc4774e3211 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:44.111326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76d1b972-0395-47b4-bb52-bdc4774e3211 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:44.111959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76d1b972-0395-47b4-bb52-bdc4774e3211 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:44.114234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76d1b972-0395-47b4-bb52-bdc4774e3211 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:44.115132 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76d1b972-0395-47b4-bb52-bdc4774e3211 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:44.115765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76d1b972-0395-47b4-bb52-bdc4774e3211 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:44.136980 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b780d1de-d95a-43aa-819e-94f65a99231c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 1.856307 Sep 07 12:52:44.146030 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2226/4409] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:42 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:44.166189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e879fa45-942b-42b5-9203-5d120bf64f56 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:44.168028 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e879fa45-942b-42b5-9203-5d120bf64f56 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:44.183117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e879fa45-942b-42b5-9203-5d120bf64f56 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:44.184262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e879fa45-942b-42b5-9203-5d120bf64f56 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:44.185260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e879fa45-942b-42b5-9203-5d120bf64f56 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:44.187065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e879fa45-942b-42b5-9203-5d120bf64f56 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:44.191046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e879fa45-942b-42b5-9203-5d120bf64f56 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:44.192146 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e879fa45-942b-42b5-9203-5d120bf64f56 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:45.051952 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-76d1b972-0395-47b4-bb52-bdc4774e3211 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.958926 Sep 07 12:52:45.053126 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2184/4410] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Sep 7 12:52:44 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2/os-interface => generated 1830 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:45.076461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1330f0d0-b584-49cc-8203-236dd09ae2fa tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:45.090133 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1330f0d0-b584-49cc-8203-236dd09ae2fa tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:45.132068 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1330f0d0-b584-49cc-8203-236dd09ae2fa tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:45.132952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1330f0d0-b584-49cc-8203-236dd09ae2fa tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:45.133965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1330f0d0-b584-49cc-8203-236dd09ae2fa tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:45.138622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1330f0d0-b584-49cc-8203-236dd09ae2fa tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:45.140775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1330f0d0-b584-49cc-8203-236dd09ae2fa tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:45.146410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1330f0d0-b584-49cc-8203-236dd09ae2fa tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:45.416606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e879fa45-942b-42b5-9203-5d120bf64f56 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:45.444751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e879fa45-942b-42b5-9203-5d120bf64f56 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:45.448408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e879fa45-942b-42b5-9203-5d120bf64f56 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:45.451829 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e879fa45-942b-42b5-9203-5d120bf64f56 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1752 microversion: 2.20 time: 1.303819 Sep 07 12:52:45.454313 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2227/4411] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:44 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1752 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:45.464930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6a87ad0f-5252-461a-9b9d-dade22538758 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:45.466705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6a87ad0f-5252-461a-9b9d-dade22538758 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:45.483055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a87ad0f-5252-461a-9b9d-dade22538758 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:45.484294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a87ad0f-5252-461a-9b9d-dade22538758 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:45.485301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a87ad0f-5252-461a-9b9d-dade22538758 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:45.487396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a87ad0f-5252-461a-9b9d-dade22538758 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:45.488529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a87ad0f-5252-461a-9b9d-dade22538758 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:45.489585 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a87ad0f-5252-461a-9b9d-dade22538758 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:46.612420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1330f0d0-b584-49cc-8203-236dd09ae2fa tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:46.682420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1330f0d0-b584-49cc-8203-236dd09ae2fa tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:46.688138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1330f0d0-b584-49cc-8203-236dd09ae2fa tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:46.700766 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1330f0d0-b584-49cc-8203-236dd09ae2fa tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 2210 microversion: 2.42 time: 1.645626 Sep 07 12:52:46.762060 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2185/4412] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:45 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 2210 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:46.945203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6a87ad0f-5252-461a-9b9d-dade22538758 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:46.983118 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6a87ad0f-5252-461a-9b9d-dade22538758 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 1.526501 Sep 07 12:52:46.986503 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2228/4413] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:45 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:47.015126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-80ce2708-c4dd-4f47-a70d-bd14140c0cc6 req-733fcf9e-adde-4a42-a8c2-e959e1ccec4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f90d70b2-052c-4840-8008-9d9b2b08772a", "name": "network-vif-deleted", "tag": "4884ea30-6481-4544-a1c7-5f3beab54e8d"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:52:47.070837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-80ce2708-c4dd-4f47-a70d-bd14140c0cc6 req-733fcf9e-adde-4a42-a8c2-e959e1ccec4c service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:47.072228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-80ce2708-c4dd-4f47-a70d-bd14140c0cc6 req-733fcf9e-adde-4a42-a8c2-e959e1ccec4c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:47.073590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-80ce2708-c4dd-4f47-a70d-bd14140c0cc6 req-733fcf9e-adde-4a42-a8c2-e959e1ccec4c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:47.074995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2a0e5388-4443-4bf2-aca4-8ea38c600673 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-386929364", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "7ffee519-0b92-4e58-9bd7-4093cccb9685"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:52:47.146680 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-80ce2708-c4dd-4f47-a70d-bd14140c0cc6 req-733fcf9e-adde-4a42-a8c2-e959e1ccec4c service nova] Creating event network-vif-deleted:4884ea30-6481-4544-a1c7-5f3beab54e8d for instance f90d70b2-052c-4840-8008-9d9b2b08772a on n-h2-852087-9 Sep 07 12:52:47.170329 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-80ce2708-c4dd-4f47-a70d-bd14140c0cc6 req-733fcf9e-adde-4a42-a8c2-e959e1ccec4c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178877 Sep 07 12:52:47.171321 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2229/4414] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:52:47.200760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-64281248-03e2-41b2-866b-d799f558655a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:47.204946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-64281248-03e2-41b2-866b-d799f558655a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:47.222227 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-2a0e5388-4443-4bf2-aca4-8ea38c600673 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] validate_networks() for [('7ffee519-0b92-4e58-9bd7-4093cccb9685', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:52:47.239267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64281248-03e2-41b2-866b-d799f558655a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:47.240780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64281248-03e2-41b2-866b-d799f558655a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:47.241917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64281248-03e2-41b2-866b-d799f558655a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:47.244701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64281248-03e2-41b2-866b-d799f558655a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:47.258032 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64281248-03e2-41b2-866b-d799f558655a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:47.261270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64281248-03e2-41b2-866b-d799f558655a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:48.062096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-64281248-03e2-41b2-866b-d799f558655a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:48.081734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-64281248-03e2-41b2-866b-d799f558655a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:48.091060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-64281248-03e2-41b2-866b-d799f558655a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:48.104563 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-64281248-03e2-41b2-866b-d799f558655a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1752 microversion: 2.20 time: 0.912750 Sep 07 12:52:48.107749 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2230/4415] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:47 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1752 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:48.142868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f0aa2f88-2578-4b8a-b9ee-ead727b590b2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:48.150541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f0aa2f88-2578-4b8a-b9ee-ead727b590b2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:48.177748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0aa2f88-2578-4b8a-b9ee-ead727b590b2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:48.182619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0aa2f88-2578-4b8a-b9ee-ead727b590b2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:48.183508 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0aa2f88-2578-4b8a-b9ee-ead727b590b2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:48.203111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0aa2f88-2578-4b8a-b9ee-ead727b590b2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:48.206409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0aa2f88-2578-4b8a-b9ee-ead727b590b2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:48.207589 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0aa2f88-2578-4b8a-b9ee-ead727b590b2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:48.499465 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f0aa2f88-2578-4b8a-b9ee-ead727b590b2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:48.546519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f0aa2f88-2578-4b8a-b9ee-ead727b590b2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:48.568148 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f0aa2f88-2578-4b8a-b9ee-ead727b590b2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:48.571370 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f0aa2f88-2578-4b8a-b9ee-ead727b590b2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1604 microversion: 2.42 time: 0.460853 Sep 07 12:52:48.610305 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2231/4416] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:48 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1604 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:48.647837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-32cc5612-ba6f-453f-8463-23803fb98904 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:48.649457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-32cc5612-ba6f-453f-8463-23803fb98904 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:48.675694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32cc5612-ba6f-453f-8463-23803fb98904 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:48.676988 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32cc5612-ba6f-453f-8463-23803fb98904 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:48.678148 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32cc5612-ba6f-453f-8463-23803fb98904 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:48.684861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32cc5612-ba6f-453f-8463-23803fb98904 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:48.686158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32cc5612-ba6f-453f-8463-23803fb98904 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:48.687329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-32cc5612-ba6f-453f-8463-23803fb98904 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:49.316258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2a0e5388-4443-4bf2-aca4-8ea38c600673 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:52:49.317577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2a0e5388-4443-4bf2-aca4-8ea38c600673 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:52:49.318500 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2a0e5388-4443-4bf2-aca4-8ea38c600673 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:52:49.319299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2a0e5388-4443-4bf2-aca4-8ea38c600673 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:52:49.320027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-2a0e5388-4443-4bf2-aca4-8ea38c600673 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:52:49.389106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a0e5388-4443-4bf2-aca4-8ea38c600673 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:49.390708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a0e5388-4443-4bf2-aca4-8ea38c600673 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:49.391541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a0e5388-4443-4bf2-aca4-8ea38c600673 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:49.393116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a0e5388-4443-4bf2-aca4-8ea38c600673 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:49.398143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a0e5388-4443-4bf2-aca4-8ea38c600673 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:49.399471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a0e5388-4443-4bf2-aca4-8ea38c600673 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:49.494243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-2a0e5388-4443-4bf2-aca4-8ea38c600673 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Getting quotas for project c09672887f9048669b654d28ab70a69c. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:52:49.532935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-2a0e5388-4443-4bf2-aca4-8ea38c600673 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Getting quotas for user 6a594d9b6bb04b3abc496db65e49ff09 and project c09672887f9048669b654d28ab70a69c. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:52:49.611565 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2a0e5388-4443-4bf2-aca4-8ea38c600673 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:52:49.624978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2a0e5388-4443-4bf2-aca4-8ea38c600673 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:52:49.683127 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-32cc5612-ba6f-453f-8463-23803fb98904 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:49.713106 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-32cc5612-ba6f-453f-8463-23803fb98904 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 1.095492 Sep 07 12:52:49.722041 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2232/4417] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:48 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:49.746026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ba2c8676-e6bc-47a8-8682-7edc8f8dc651 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:49.747814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ba2c8676-e6bc-47a8-8682-7edc8f8dc651 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:49.773052 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:49.782817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba2c8676-e6bc-47a8-8682-7edc8f8dc651 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:49.785724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba2c8676-e6bc-47a8-8682-7edc8f8dc651 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:49.787629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba2c8676-e6bc-47a8-8682-7edc8f8dc651 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:49.788895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba2c8676-e6bc-47a8-8682-7edc8f8dc651 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:49.789646 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba2c8676-e6bc-47a8-8682-7edc8f8dc651 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:49.790478 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba2c8676-e6bc-47a8-8682-7edc8f8dc651 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:49.848843 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2a0e5388-4443-4bf2-aca4-8ea38c600673 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.077268 Sep 07 12:52:49.851875 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2186/4418] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:52:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:52:49.896878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9ac4fdc2-163a-4126-b7d3-baa25815fa72 req-92ab353a-ae7f-4dc3-acbe-d98feb647b19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f90d70b2-052c-4840-8008-9d9b2b08772a", "name": "network-vif-deleted", "tag": "bb3dbd1e-6aad-4076-9d60-f092ced32e09"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:52:49.930459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9ac4fdc2-163a-4126-b7d3-baa25815fa72 req-92ab353a-ae7f-4dc3-acbe-d98feb647b19 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:49.939200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9ac4fdc2-163a-4126-b7d3-baa25815fa72 req-92ab353a-ae7f-4dc3-acbe-d98feb647b19 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:49.940451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9ac4fdc2-163a-4126-b7d3-baa25815fa72 req-92ab353a-ae7f-4dc3-acbe-d98feb647b19 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:49.975358 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9ac4fdc2-163a-4126-b7d3-baa25815fa72 req-92ab353a-ae7f-4dc3-acbe-d98feb647b19 service nova] Creating event network-vif-deleted:bb3dbd1e-6aad-4076-9d60-f092ced32e09 for instance f90d70b2-052c-4840-8008-9d9b2b08772a on n-h2-852087-9 Sep 07 12:52:49.988554 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9ac4fdc2-163a-4126-b7d3-baa25815fa72 req-92ab353a-ae7f-4dc3-acbe-d98feb647b19 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134433 Sep 07 12:52:49.994418 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2187/4419] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:52:50.018207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-234f815d-80a8-41fd-aa28-64546ac38dab tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:50.020188 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-234f815d-80a8-41fd-aa28-64546ac38dab tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:50.047035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-234f815d-80a8-41fd-aa28-64546ac38dab tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:50.052754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-234f815d-80a8-41fd-aa28-64546ac38dab tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:50.054045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-234f815d-80a8-41fd-aa28-64546ac38dab tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:50.058907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-234f815d-80a8-41fd-aa28-64546ac38dab tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:50.063532 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-234f815d-80a8-41fd-aa28-64546ac38dab tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:50.067203 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-234f815d-80a8-41fd-aa28-64546ac38dab tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:50.183089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ba2c8676-e6bc-47a8-8682-7edc8f8dc651 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:50.198716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ba2c8676-e6bc-47a8-8682-7edc8f8dc651 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:50.206779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ba2c8676-e6bc-47a8-8682-7edc8f8dc651 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:50.209877 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ba2c8676-e6bc-47a8-8682-7edc8f8dc651 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1752 microversion: 2.20 time: 0.485718 Sep 07 12:52:50.211484 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2233/4420] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:49 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1752 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:50.218019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bc21a100-6672-43e2-93a2-a7fa0e19ff19 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:52:50.219389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:50.221125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bc21a100-6672-43e2-93a2-a7fa0e19ff19 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:50.238689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc21a100-6672-43e2-93a2-a7fa0e19ff19 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:50.239227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc21a100-6672-43e2-93a2-a7fa0e19ff19 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:50.239697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc21a100-6672-43e2-93a2-a7fa0e19ff19 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:50.240489 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc21a100-6672-43e2-93a2-a7fa0e19ff19 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:50.240985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc21a100-6672-43e2-93a2-a7fa0e19ff19 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:50.241442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc21a100-6672-43e2-93a2-a7fa0e19ff19 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:50.383603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:50.453790 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bc21a100-6672-43e2-93a2-a7fa0e19ff19 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action" status: 202 len: 0 microversion: 2.1 time: 0.240457 Sep 07 12:52:50.454925 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2234/4421] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:52:50 2022] POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:52:50.456041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-234f815d-80a8-41fd-aa28-64546ac38dab tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:50.480726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6dc92e47-597c-4571-883f-f1ff0ca9dfb9 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:50.488624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6dc92e47-597c-4571-883f-f1ff0ca9dfb9 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:50.564109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-234f815d-80a8-41fd-aa28-64546ac38dab tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:50.578782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-234f815d-80a8-41fd-aa28-64546ac38dab tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:50.594233 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-234f815d-80a8-41fd-aa28-64546ac38dab tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1604 microversion: 2.42 time: 0.597433 Sep 07 12:52:50.596450 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2188/4422] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:49 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1604 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:50.670849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-09db93bc-950d-4062-9420-a09aab990f6a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:50.676306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-09db93bc-950d-4062-9420-a09aab990f6a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:50.681100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6dc92e47-597c-4571-883f-f1ff0ca9dfb9 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:50.692612 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6dc92e47-597c-4571-883f-f1ff0ca9dfb9 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1224 microversion: 2.1 time: 0.235415 Sep 07 12:52:50.696668 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2235/4423] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:50 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1224 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:50.736442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09db93bc-950d-4062-9420-a09aab990f6a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:50.744929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09db93bc-950d-4062-9420-a09aab990f6a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:50.751880 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09db93bc-950d-4062-9420-a09aab990f6a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:50.758401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9569cb73-23d4-47be-93a6-b8eaac26fbd0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:50.760912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9569cb73-23d4-47be-93a6-b8eaac26fbd0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:50.770962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09db93bc-950d-4062-9420-a09aab990f6a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:50.772183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09db93bc-950d-4062-9420-a09aab990f6a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:50.774648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09db93bc-950d-4062-9420-a09aab990f6a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:50.802245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9569cb73-23d4-47be-93a6-b8eaac26fbd0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:50.805591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9569cb73-23d4-47be-93a6-b8eaac26fbd0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:50.806643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9569cb73-23d4-47be-93a6-b8eaac26fbd0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:50.811734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9569cb73-23d4-47be-93a6-b8eaac26fbd0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:50.817162 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9569cb73-23d4-47be-93a6-b8eaac26fbd0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:50.821129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9569cb73-23d4-47be-93a6-b8eaac26fbd0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:51.920343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-09db93bc-950d-4062-9420-a09aab990f6a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:51.936513 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-09db93bc-950d-4062-9420-a09aab990f6a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1671 microversion: 2.1 time: 1.322994 Sep 07 12:52:51.939258 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2189/4424] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:50 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1671 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:51.954401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aa5da437-dce4-4740-8c43-0c5fae35c668 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:51.956312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aa5da437-dce4-4740-8c43-0c5fae35c668 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:51.975293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa5da437-dce4-4740-8c43-0c5fae35c668 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:51.976327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa5da437-dce4-4740-8c43-0c5fae35c668 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:51.978818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa5da437-dce4-4740-8c43-0c5fae35c668 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:51.979824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa5da437-dce4-4740-8c43-0c5fae35c668 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:51.988086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa5da437-dce4-4740-8c43-0c5fae35c668 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:51.990117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa5da437-dce4-4740-8c43-0c5fae35c668 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:52.351088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9569cb73-23d4-47be-93a6-b8eaac26fbd0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:52.367485 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9569cb73-23d4-47be-93a6-b8eaac26fbd0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 1.622162 Sep 07 12:52:52.385237 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2236/4425] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:50 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:52:52.391606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8354e6cf-b13e-4ebd-abdc-3e1a589c74cf tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:52.393299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8354e6cf-b13e-4ebd-abdc-3e1a589c74cf tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:52.400686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8354e6cf-b13e-4ebd-abdc-3e1a589c74cf tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:52.401539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8354e6cf-b13e-4ebd-abdc-3e1a589c74cf tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:52.402404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8354e6cf-b13e-4ebd-abdc-3e1a589c74cf tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:52.404064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8354e6cf-b13e-4ebd-abdc-3e1a589c74cf tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:52.404743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8354e6cf-b13e-4ebd-abdc-3e1a589c74cf tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:52.405419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8354e6cf-b13e-4ebd-abdc-3e1a589c74cf tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:52.687059 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8354e6cf-b13e-4ebd-abdc-3e1a589c74cf tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:52.711069 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8354e6cf-b13e-4ebd-abdc-3e1a589c74cf tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:52.712624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8354e6cf-b13e-4ebd-abdc-3e1a589c74cf tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:52.714007 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8354e6cf-b13e-4ebd-abdc-3e1a589c74cf tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1604 microversion: 2.42 time: 0.326580 Sep 07 12:52:52.731666 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2237/4426] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:52 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1604 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:52.740011 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d1f0a86-0c21-4958-9dcd-0a0f392af470 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:52.744356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1d1f0a86-0c21-4958-9dcd-0a0f392af470 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:52.763696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d1f0a86-0c21-4958-9dcd-0a0f392af470 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:52.764535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d1f0a86-0c21-4958-9dcd-0a0f392af470 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:52.765003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d1f0a86-0c21-4958-9dcd-0a0f392af470 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:52.765886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d1f0a86-0c21-4958-9dcd-0a0f392af470 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:52.767300 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d1f0a86-0c21-4958-9dcd-0a0f392af470 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:52.770268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d1f0a86-0c21-4958-9dcd-0a0f392af470 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:52.962558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aa5da437-dce4-4740-8c43-0c5fae35c668 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:53.013610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1d1f0a86-0c21-4958-9dcd-0a0f392af470 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:53.018596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aa5da437-dce4-4740-8c43-0c5fae35c668 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:53.032045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aa5da437-dce4-4740-8c43-0c5fae35c668 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:53.038096 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1d1f0a86-0c21-4958-9dcd-0a0f392af470 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1276 microversion: 2.1 time: 0.300736 Sep 07 12:52:53.039025 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aa5da437-dce4-4740-8c43-0c5fae35c668 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1752 microversion: 2.20 time: 1.095736 Sep 07 12:52:53.080945 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2238/4427] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:52 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1276 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:53.093558 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2190/4428] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:51 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1752 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:53.108149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d10622b1-37f7-458e-9e7b-7d784dca9d7e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:53.109187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d10622b1-37f7-458e-9e7b-7d784dca9d7e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:53.120376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d10622b1-37f7-458e-9e7b-7d784dca9d7e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:53.121181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d10622b1-37f7-458e-9e7b-7d784dca9d7e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:53.122118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d10622b1-37f7-458e-9e7b-7d784dca9d7e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:53.123329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d10622b1-37f7-458e-9e7b-7d784dca9d7e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:53.124491 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d10622b1-37f7-458e-9e7b-7d784dca9d7e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:53.125105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d10622b1-37f7-458e-9e7b-7d784dca9d7e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:53.397073 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-11415d5f-1e24-4680-ae3f-b6e02c15b745 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:53.399135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-11415d5f-1e24-4680-ae3f-b6e02c15b745 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:53.410537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11415d5f-1e24-4680-ae3f-b6e02c15b745 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:53.411515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11415d5f-1e24-4680-ae3f-b6e02c15b745 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:53.412143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11415d5f-1e24-4680-ae3f-b6e02c15b745 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:53.413749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11415d5f-1e24-4680-ae3f-b6e02c15b745 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:53.414607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11415d5f-1e24-4680-ae3f-b6e02c15b745 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:53.415219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11415d5f-1e24-4680-ae3f-b6e02c15b745 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:53.780370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-11415d5f-1e24-4680-ae3f-b6e02c15b745 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:53.818539 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-11415d5f-1e24-4680-ae3f-b6e02c15b745 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.429598 Sep 07 12:52:53.837167 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2191/4429] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:53 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:53.862482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ab9db00c-d7a4-40d1-9fd4-29a26a92028e tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:53.863577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ab9db00c-d7a4-40d1-9fd4-29a26a92028e tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:53.884617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d10622b1-37f7-458e-9e7b-7d784dca9d7e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:53.906386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab9db00c-d7a4-40d1-9fd4-29a26a92028e tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:53.906978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab9db00c-d7a4-40d1-9fd4-29a26a92028e tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:53.907453 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab9db00c-d7a4-40d1-9fd4-29a26a92028e tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:53.908258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab9db00c-d7a4-40d1-9fd4-29a26a92028e tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:53.908739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab9db00c-d7a4-40d1-9fd4-29a26a92028e tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:53.909185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab9db00c-d7a4-40d1-9fd4-29a26a92028e tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:53.922558 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d10622b1-37f7-458e-9e7b-7d784dca9d7e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1671 microversion: 2.1 time: 0.831585 Sep 07 12:52:53.924722 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2239/4430] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:53 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1671 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:54.084446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-41b29c2e-5bdd-4c48-985e-a17f77547d73 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:54.091760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-41b29c2e-5bdd-4c48-985e-a17f77547d73 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:54.110853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41b29c2e-5bdd-4c48-985e-a17f77547d73 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:54.116904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41b29c2e-5bdd-4c48-985e-a17f77547d73 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:54.122366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41b29c2e-5bdd-4c48-985e-a17f77547d73 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:54.123932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41b29c2e-5bdd-4c48-985e-a17f77547d73 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:54.124989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41b29c2e-5bdd-4c48-985e-a17f77547d73 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:54.126256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41b29c2e-5bdd-4c48-985e-a17f77547d73 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:54.304472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ab9db00c-d7a4-40d1-9fd4-29a26a92028e tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:54.371628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ab9db00c-d7a4-40d1-9fd4-29a26a92028e tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:54.391235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ab9db00c-d7a4-40d1-9fd4-29a26a92028e tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:54.402663 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ab9db00c-d7a4-40d1-9fd4-29a26a92028e tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1604 microversion: 2.42 time: 0.557193 Sep 07 12:52:54.424359 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2192/4431] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:53 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1604 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:54.463643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-738c25f6-4ace-4423-995f-3f5f7151aabf tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:54.463643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-738c25f6-4ace-4423-995f-3f5f7151aabf tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:54.481785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-738c25f6-4ace-4423-995f-3f5f7151aabf tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:54.482654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-738c25f6-4ace-4423-995f-3f5f7151aabf tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:54.484514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-738c25f6-4ace-4423-995f-3f5f7151aabf tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:54.486183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-738c25f6-4ace-4423-995f-3f5f7151aabf tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:54.487017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-738c25f6-4ace-4423-995f-3f5f7151aabf tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:54.489417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-738c25f6-4ace-4423-995f-3f5f7151aabf tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:55.121014 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-41b29c2e-5bdd-4c48-985e-a17f77547d73 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:55.176785 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-41b29c2e-5bdd-4c48-985e-a17f77547d73 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1276 microversion: 2.1 time: 1.109984 Sep 07 12:52:55.177831 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2240/4432] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:54 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1276 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:52:55.212618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b5d06ca3-13fb-4c58-bfde-d4a8e2404646 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:55.230180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b5d06ca3-13fb-4c58-bfde-d4a8e2404646 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:55.274115 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5d06ca3-13fb-4c58-bfde-d4a8e2404646 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:55.275121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5d06ca3-13fb-4c58-bfde-d4a8e2404646 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:55.276112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5d06ca3-13fb-4c58-bfde-d4a8e2404646 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:55.280335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5d06ca3-13fb-4c58-bfde-d4a8e2404646 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:55.282933 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5d06ca3-13fb-4c58-bfde-d4a8e2404646 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:55.286585 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5d06ca3-13fb-4c58-bfde-d4a8e2404646 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:55.400420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-738c25f6-4ace-4423-995f-3f5f7151aabf tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:55.432432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-738c25f6-4ace-4423-995f-3f5f7151aabf tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:55.435339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-738c25f6-4ace-4423-995f-3f5f7151aabf tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:55.452316 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-738c25f6-4ace-4423-995f-3f5f7151aabf tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1752 microversion: 2.20 time: 1.014507 Sep 07 12:52:55.471922 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2193/4433] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:54 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1752 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:55.494362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a5675bb9-f045-441e-bc9f-0fb5b39eb694 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:55.495196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a5675bb9-f045-441e-bc9f-0fb5b39eb694 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:55.524955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:55.545233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5675bb9-f045-441e-bc9f-0fb5b39eb694 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:55.560005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5675bb9-f045-441e-bc9f-0fb5b39eb694 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:55.568057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5675bb9-f045-441e-bc9f-0fb5b39eb694 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:55.569473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5675bb9-f045-441e-bc9f-0fb5b39eb694 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:55.570256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5675bb9-f045-441e-bc9f-0fb5b39eb694 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:55.578743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5675bb9-f045-441e-bc9f-0fb5b39eb694 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:56.059335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b5d06ca3-13fb-4c58-bfde-d4a8e2404646 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:56.101779 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b5d06ca3-13fb-4c58-bfde-d4a8e2404646 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.908015 Sep 07 12:52:56.104409 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2241/4434] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:55 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:56.144432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-02bca6c8-cc12-463a-b1dc-8414678f316d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:56.145331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-02bca6c8-cc12-463a-b1dc-8414678f316d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:56.172108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02bca6c8-cc12-463a-b1dc-8414678f316d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:56.177361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02bca6c8-cc12-463a-b1dc-8414678f316d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:56.178081 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02bca6c8-cc12-463a-b1dc-8414678f316d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:56.182380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02bca6c8-cc12-463a-b1dc-8414678f316d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:56.185200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02bca6c8-cc12-463a-b1dc-8414678f316d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:56.186869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02bca6c8-cc12-463a-b1dc-8414678f316d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:56.596172 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-02bca6c8-cc12-463a-b1dc-8414678f316d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:56.677362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-02bca6c8-cc12-463a-b1dc-8414678f316d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:56.688405 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-02bca6c8-cc12-463a-b1dc-8414678f316d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:56.696965 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-02bca6c8-cc12-463a-b1dc-8414678f316d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1604 microversion: 2.42 time: 0.573410 Sep 07 12:52:56.705111 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2242/4435] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:56 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1604 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:56.727849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-26e9487c-4f0a-4d62-8486-a1cfa3487654 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:56.729069 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-26e9487c-4f0a-4d62-8486-a1cfa3487654 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:56.767790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26e9487c-4f0a-4d62-8486-a1cfa3487654 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:56.771011 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26e9487c-4f0a-4d62-8486-a1cfa3487654 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:56.771948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26e9487c-4f0a-4d62-8486-a1cfa3487654 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:56.776803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26e9487c-4f0a-4d62-8486-a1cfa3487654 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:56.780495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26e9487c-4f0a-4d62-8486-a1cfa3487654 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:56.785576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26e9487c-4f0a-4d62-8486-a1cfa3487654 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:56.809132 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a5675bb9-f045-441e-bc9f-0fb5b39eb694 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:56.826589 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a5675bb9-f045-441e-bc9f-0fb5b39eb694 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1676 microversion: 2.1 time: 1.349808 Sep 07 12:52:56.827770 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2194/4436] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:55 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1676 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:56.841838 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ba7db543-eef5-4e16-b258-cb6d63eba511 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:56.843034 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ba7db543-eef5-4e16-b258-cb6d63eba511 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:56.859761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba7db543-eef5-4e16-b258-cb6d63eba511 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:56.861447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba7db543-eef5-4e16-b258-cb6d63eba511 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:56.862369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba7db543-eef5-4e16-b258-cb6d63eba511 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:56.863529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba7db543-eef5-4e16-b258-cb6d63eba511 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:56.864253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba7db543-eef5-4e16-b258-cb6d63eba511 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:56.866105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba7db543-eef5-4e16-b258-cb6d63eba511 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:57.434494 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ba7db543-eef5-4e16-b258-cb6d63eba511 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:57.449911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-26e9487c-4f0a-4d62-8486-a1cfa3487654 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:57.468254 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-26e9487c-4f0a-4d62-8486-a1cfa3487654 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1324 microversion: 2.1 time: 0.761385 Sep 07 12:52:57.469408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ba7db543-eef5-4e16-b258-cb6d63eba511 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:57.470455 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2243/4437] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:56 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1324 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:57.473627 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ba7db543-eef5-4e16-b258-cb6d63eba511 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:57.483328 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ba7db543-eef5-4e16-b258-cb6d63eba511 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.653833 Sep 07 12:52:57.504634 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2195/4438] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:56 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:57.505614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-115105cc-a26e-4b06-864d-b7cac772ef4c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:57.506635 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-115105cc-a26e-4b06-864d-b7cac772ef4c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:57.524293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-115105cc-a26e-4b06-864d-b7cac772ef4c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:57.525213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-115105cc-a26e-4b06-864d-b7cac772ef4c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:57.530304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-115105cc-a26e-4b06-864d-b7cac772ef4c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:57.531578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-115105cc-a26e-4b06-864d-b7cac772ef4c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:57.533214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-115105cc-a26e-4b06-864d-b7cac772ef4c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:57.534105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-115105cc-a26e-4b06-864d-b7cac772ef4c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:57.775890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6dc8296a-3673-4828-ac22-9f0430df18f5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:57.780395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6dc8296a-3673-4828-ac22-9f0430df18f5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:57.812598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6dc8296a-3673-4828-ac22-9f0430df18f5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:57.815248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6dc8296a-3673-4828-ac22-9f0430df18f5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:57.815248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6dc8296a-3673-4828-ac22-9f0430df18f5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:57.820731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6dc8296a-3673-4828-ac22-9f0430df18f5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:57.823389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6dc8296a-3673-4828-ac22-9f0430df18f5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:57.839162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6dc8296a-3673-4828-ac22-9f0430df18f5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:57.999138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6dc8296a-3673-4828-ac22-9f0430df18f5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:58.017888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6dc8296a-3673-4828-ac22-9f0430df18f5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:58.019873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6dc8296a-3673-4828-ac22-9f0430df18f5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:58.028799 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6dc8296a-3673-4828-ac22-9f0430df18f5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1604 microversion: 2.42 time: 0.269107 Sep 07 12:52:58.053141 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2196/4439] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:52:57 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1604 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:52:58.067211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d0fcb29c-1e21-4034-96be-dff4bf6dbba3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:58.068124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d0fcb29c-1e21-4034-96be-dff4bf6dbba3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:58.088030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0fcb29c-1e21-4034-96be-dff4bf6dbba3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:58.088833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0fcb29c-1e21-4034-96be-dff4bf6dbba3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:58.089452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0fcb29c-1e21-4034-96be-dff4bf6dbba3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:58.094120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0fcb29c-1e21-4034-96be-dff4bf6dbba3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:58.094808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0fcb29c-1e21-4034-96be-dff4bf6dbba3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:58.095449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0fcb29c-1e21-4034-96be-dff4bf6dbba3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:58.232322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-115105cc-a26e-4b06-864d-b7cac772ef4c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:52:58.247658 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-115105cc-a26e-4b06-864d-b7cac772ef4c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.770769 Sep 07 12:52:58.249750 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2244/4440] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:57 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:58.522126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a8a658ca-66e7-4fe9-bab2-b8ab0d27998a tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:52:58.536262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a8a658ca-66e7-4fe9-bab2-b8ab0d27998a tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:52:58.576118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8a658ca-66e7-4fe9-bab2-b8ab0d27998a tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:58.577549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8a658ca-66e7-4fe9-bab2-b8ab0d27998a tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:58.583043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8a658ca-66e7-4fe9-bab2-b8ab0d27998a tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:58.588127 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8a658ca-66e7-4fe9-bab2-b8ab0d27998a tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:52:58.589296 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8a658ca-66e7-4fe9-bab2-b8ab0d27998a tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:52:58.591899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8a658ca-66e7-4fe9-bab2-b8ab0d27998a tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:52:59.435173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:59.577588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:00.543861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d0fcb29c-1e21-4034-96be-dff4bf6dbba3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:00.608452 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d0fcb29c-1e21-4034-96be-dff4bf6dbba3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 2.551820 Sep 07 12:53:00.612498 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2197/4441] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:58 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 2558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:00.623858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d5f7c43f-9905-4038-90fe-724eca2c1da1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:00.627014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d5f7c43f-9905-4038-90fe-724eca2c1da1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:00.653043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5f7c43f-9905-4038-90fe-724eca2c1da1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:00.653652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5f7c43f-9905-4038-90fe-724eca2c1da1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:00.654174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5f7c43f-9905-4038-90fe-724eca2c1da1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:00.655447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5f7c43f-9905-4038-90fe-724eca2c1da1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:00.656047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5f7c43f-9905-4038-90fe-724eca2c1da1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:00.656499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5f7c43f-9905-4038-90fe-724eca2c1da1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:00.686273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:01.107134 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a8a658ca-66e7-4fe9-bab2-b8ab0d27998a tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:01.137043 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a8a658ca-66e7-4fe9-bab2-b8ab0d27998a tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1324 microversion: 2.1 time: 2.628615 Sep 07 12:53:01.162069 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2245/4442] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:52:58 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1324 bytes in 2656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:01.186308 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5ddff42d-6428-431d-a659-726dd92a0d08 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:01.187466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5ddff42d-6428-431d-a659-726dd92a0d08 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:01.226646 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ddff42d-6428-431d-a659-726dd92a0d08 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:01.227638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ddff42d-6428-431d-a659-726dd92a0d08 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:01.233090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ddff42d-6428-431d-a659-726dd92a0d08 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:01.234237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ddff42d-6428-431d-a659-726dd92a0d08 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:01.234925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ddff42d-6428-431d-a659-726dd92a0d08 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:01.235649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ddff42d-6428-431d-a659-726dd92a0d08 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:01.581435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5ddff42d-6428-431d-a659-726dd92a0d08 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:01.601051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5ddff42d-6428-431d-a659-726dd92a0d08 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:01.609958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5ddff42d-6428-431d-a659-726dd92a0d08 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:01.614773 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5ddff42d-6428-431d-a659-726dd92a0d08 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1604 microversion: 2.42 time: 0.447712 Sep 07 12:53:01.617110 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2246/4443] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:01 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1604 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:01.632304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-66941c33-0ae7-4af6-8149-fd07c33ed700 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:01.635109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-66941c33-0ae7-4af6-8149-fd07c33ed700 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:01.653439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66941c33-0ae7-4af6-8149-fd07c33ed700 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:01.655759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66941c33-0ae7-4af6-8149-fd07c33ed700 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:01.658398 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66941c33-0ae7-4af6-8149-fd07c33ed700 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:01.662312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66941c33-0ae7-4af6-8149-fd07c33ed700 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:01.664367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66941c33-0ae7-4af6-8149-fd07c33ed700 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:01.667369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66941c33-0ae7-4af6-8149-fd07c33ed700 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:01.732485 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d5f7c43f-9905-4038-90fe-724eca2c1da1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:01.751961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d5f7c43f-9905-4038-90fe-724eca2c1da1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:01.755775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d5f7c43f-9905-4038-90fe-724eca2c1da1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:01.762881 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d5f7c43f-9905-4038-90fe-724eca2c1da1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 1.143389 Sep 07 12:53:01.762881 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2198/4444] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:00 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:01.776927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-058ddd29-1c18-4eb4-a4cb-767872295ace req-65640ea8-faec-45ad-a3fb-e8920a64abcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ae560a6-de3d-4c7d-892d-e53d9f8da941", "tag": "feefcfa5-a9aa-4f77-bf84-1e0236841758"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:53:01.823428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-058ddd29-1c18-4eb4-a4cb-767872295ace req-65640ea8-faec-45ad-a3fb-e8920a64abcc service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:01.824439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-058ddd29-1c18-4eb4-a4cb-767872295ace req-65640ea8-faec-45ad-a3fb-e8920a64abcc service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:01.825334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-058ddd29-1c18-4eb4-a4cb-767872295ace req-65640ea8-faec-45ad-a3fb-e8920a64abcc service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:01.874094 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-058ddd29-1c18-4eb4-a4cb-767872295ace req-65640ea8-faec-45ad-a3fb-e8920a64abcc service nova] Creating event network-changed:feefcfa5-a9aa-4f77-bf84-1e0236841758 for instance 2ae560a6-de3d-4c7d-892d-e53d9f8da941 on n-h1-852087-9 Sep 07 12:53:01.892645 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-058ddd29-1c18-4eb4-a4cb-767872295ace req-65640ea8-faec-45ad-a3fb-e8920a64abcc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130296 Sep 07 12:53:01.894405 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2199/4445] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:53:02.048087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-66941c33-0ae7-4af6-8149-fd07c33ed700 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:02.063261 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-66941c33-0ae7-4af6-8149-fd07c33ed700 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.443978 Sep 07 12:53:02.065175 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2247/4446] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:01 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:02.165298 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f4b79e40-e904-4088-8da8-61d6789ec7c4 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-258763799", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": "none"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:53:02.169731 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dacdb5e2-c78e-4751-a74e-2ba9cf5d5b2c tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:02.171723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dacdb5e2-c78e-4751-a74e-2ba9cf5d5b2c tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:02.180082 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dacdb5e2-c78e-4751-a74e-2ba9cf5d5b2c tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:02.180707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dacdb5e2-c78e-4751-a74e-2ba9cf5d5b2c tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:02.182108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dacdb5e2-c78e-4751-a74e-2ba9cf5d5b2c tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:02.183149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dacdb5e2-c78e-4751-a74e-2ba9cf5d5b2c tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:02.183715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dacdb5e2-c78e-4751-a74e-2ba9cf5d5b2c tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:02.184222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dacdb5e2-c78e-4751-a74e-2ba9cf5d5b2c tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:02.287878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f4b79e40-e904-4088-8da8-61d6789ec7c4 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:53:02.289563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f4b79e40-e904-4088-8da8-61d6789ec7c4 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:53:02.290544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f4b79e40-e904-4088-8da8-61d6789ec7c4 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:53:02.291364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f4b79e40-e904-4088-8da8-61d6789ec7c4 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:53:02.292163 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f4b79e40-e904-4088-8da8-61d6789ec7c4 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:53:02.314431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4b79e40-e904-4088-8da8-61d6789ec7c4 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:02.316263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4b79e40-e904-4088-8da8-61d6789ec7c4 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:02.316974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4b79e40-e904-4088-8da8-61d6789ec7c4 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:02.319449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4b79e40-e904-4088-8da8-61d6789ec7c4 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:02.321155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4b79e40-e904-4088-8da8-61d6789ec7c4 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:02.321860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4b79e40-e904-4088-8da8-61d6789ec7c4 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:02.345682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-f4b79e40-e904-4088-8da8-61d6789ec7c4 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Getting quotas for project b615c73bf02a424f887f4c44ec9e67ea. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:53:02.352759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-f4b79e40-e904-4088-8da8-61d6789ec7c4 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Getting quotas for user c6fe2a4bf33848db91947f2fc7f29842 and project b615c73bf02a424f887f4c44ec9e67ea. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:53:02.369746 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f4b79e40-e904-4088-8da8-61d6789ec7c4 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:53:02.372329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f4b79e40-e904-4088-8da8-61d6789ec7c4 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:53:02.448215 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f4b79e40-e904-4088-8da8-61d6789ec7c4 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.551244 Sep 07 12:53:02.453883 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2200/4447] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Sep 7 12:53:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 12:53:02.472806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0aeedb6c-cdf5-494f-b9de-92612e1280b5 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:02.473885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0aeedb6c-cdf5-494f-b9de-92612e1280b5 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:02.619503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0aeedb6c-cdf5-494f-b9de-92612e1280b5 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:02.624863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dacdb5e2-c78e-4751-a74e-2ba9cf5d5b2c tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:02.637940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0aeedb6c-cdf5-494f-b9de-92612e1280b5 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:02.642119 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0aeedb6c-cdf5-494f-b9de-92612e1280b5 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:02.648953 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0aeedb6c-cdf5-494f-b9de-92612e1280b5 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e" status: 200 len: 1277 microversion: 2.47 time: 0.189540 Sep 07 12:53:02.661743 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2201/4448] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:02 2022] GET /compute/v2.1/servers/4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e => generated 1277 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:02.661743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-cc216918-23e8-411f-8c7b-5e22247b62a5 req-95d2ef0f-a459-4348-b00b-7ca686da2fcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe6581c-7070-48c5-a16d-fa30b22567d4", "tag": "57759270-a8de-4adc-a2ba-ccbb3e371878"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:53:02.666665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cc216918-23e8-411f-8c7b-5e22247b62a5 req-95d2ef0f-a459-4348-b00b-7ca686da2fcf service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:02.667501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cc216918-23e8-411f-8c7b-5e22247b62a5 req-95d2ef0f-a459-4348-b00b-7ca686da2fcf service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:02.668135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cc216918-23e8-411f-8c7b-5e22247b62a5 req-95d2ef0f-a459-4348-b00b-7ca686da2fcf service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:02.686586 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-cc216918-23e8-411f-8c7b-5e22247b62a5 req-95d2ef0f-a459-4348-b00b-7ca686da2fcf service nova] Creating event network-changed:57759270-a8de-4adc-a2ba-ccbb3e371878 for instance ffe6581c-7070-48c5-a16d-fa30b22567d4 on n-h1-852087-9 Sep 07 12:53:02.687010 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dacdb5e2-c78e-4751-a74e-2ba9cf5d5b2c tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1324 microversion: 2.1 time: 0.480143 Sep 07 12:53:02.694928 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-cc216918-23e8-411f-8c7b-5e22247b62a5 req-95d2ef0f-a459-4348-b00b-7ca686da2fcf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043485 Sep 07 12:53:02.698657 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2248/4449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:02 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1324 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:53:02.699515 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2202/4450] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:53:02.721656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-373a255f-f2ec-4b8d-8c56-89ab538ad1a5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:02.724269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-373a255f-f2ec-4b8d-8c56-89ab538ad1a5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:02.736431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-373a255f-f2ec-4b8d-8c56-89ab538ad1a5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:02.737111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-373a255f-f2ec-4b8d-8c56-89ab538ad1a5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:02.737879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-373a255f-f2ec-4b8d-8c56-89ab538ad1a5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:02.739070 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-373a255f-f2ec-4b8d-8c56-89ab538ad1a5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:02.740050 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-373a255f-f2ec-4b8d-8c56-89ab538ad1a5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:02.741784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-373a255f-f2ec-4b8d-8c56-89ab538ad1a5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:02.796795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f5d8062d-21ed-4132-8e9c-a2b25a6f55ab tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:02.798309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f5d8062d-21ed-4132-8e9c-a2b25a6f55ab tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:02.806331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5d8062d-21ed-4132-8e9c-a2b25a6f55ab tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:02.807095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5d8062d-21ed-4132-8e9c-a2b25a6f55ab tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:02.807894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5d8062d-21ed-4132-8e9c-a2b25a6f55ab tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:02.808821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5d8062d-21ed-4132-8e9c-a2b25a6f55ab tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:02.809510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5d8062d-21ed-4132-8e9c-a2b25a6f55ab tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:02.810108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5d8062d-21ed-4132-8e9c-a2b25a6f55ab tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:02.920584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-373a255f-f2ec-4b8d-8c56-89ab538ad1a5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:02.940264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-373a255f-f2ec-4b8d-8c56-89ab538ad1a5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:02.943888 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-373a255f-f2ec-4b8d-8c56-89ab538ad1a5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:02.947180 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-373a255f-f2ec-4b8d-8c56-89ab538ad1a5 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1604 microversion: 2.42 time: 0.246617 Sep 07 12:53:02.959865 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2249/4451] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:02 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1604 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:02.961386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a4fe788-6c14-45ec-b892-599f21fde16b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1481235285", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": "none"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:53:03.074653 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f5d8062d-21ed-4132-8e9c-a2b25a6f55ab tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:03.078970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-7a4fe788-6c14-45ec-b892-599f21fde16b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:53:03.081262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-7a4fe788-6c14-45ec-b892-599f21fde16b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:53:03.082539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-7a4fe788-6c14-45ec-b892-599f21fde16b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:53:03.083655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-7a4fe788-6c14-45ec-b892-599f21fde16b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:53:03.084697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-7a4fe788-6c14-45ec-b892-599f21fde16b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:53:03.086957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f5d8062d-21ed-4132-8e9c-a2b25a6f55ab tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:03.090001 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f5d8062d-21ed-4132-8e9c-a2b25a6f55ab tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:03.091353 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f5d8062d-21ed-4132-8e9c-a2b25a6f55ab tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.301326 Sep 07 12:53:03.093158 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2203/4452] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:02 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:03.103889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5883cc0c-0f10-4479-b194-2be8d8d4bb70 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:03.105280 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5883cc0c-0f10-4479-b194-2be8d8d4bb70 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:03.118588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5883cc0c-0f10-4479-b194-2be8d8d4bb70 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:03.119113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5883cc0c-0f10-4479-b194-2be8d8d4bb70 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:03.120028 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5883cc0c-0f10-4479-b194-2be8d8d4bb70 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:03.120916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a4fe788-6c14-45ec-b892-599f21fde16b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:03.121126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5883cc0c-0f10-4479-b194-2be8d8d4bb70 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:03.121454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5883cc0c-0f10-4479-b194-2be8d8d4bb70 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:03.121947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5883cc0c-0f10-4479-b194-2be8d8d4bb70 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:03.123181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a4fe788-6c14-45ec-b892-599f21fde16b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:03.124302 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a4fe788-6c14-45ec-b892-599f21fde16b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:03.126232 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a4fe788-6c14-45ec-b892-599f21fde16b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:03.127324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a4fe788-6c14-45ec-b892-599f21fde16b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:03.128451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a4fe788-6c14-45ec-b892-599f21fde16b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:03.174203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-7a4fe788-6c14-45ec-b892-599f21fde16b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Getting quotas for project b615c73bf02a424f887f4c44ec9e67ea. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:53:03.186756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-7a4fe788-6c14-45ec-b892-599f21fde16b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Getting quotas for user c6fe2a4bf33848db91947f2fc7f29842 and project b615c73bf02a424f887f4c44ec9e67ea. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:53:03.215934 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7a4fe788-6c14-45ec-b892-599f21fde16b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:53:03.221804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7a4fe788-6c14-45ec-b892-599f21fde16b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:53:03.330898 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7a4fe788-6c14-45ec-b892-599f21fde16b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.379445 Sep 07 12:53:03.345201 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2250/4453] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Sep 7 12:53:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 384 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 12:53:03.357378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5c82c2ed-1019-4e2c-9133-c8434548688d tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:53:03.366930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5c82c2ed-1019-4e2c-9133-c8434548688d tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:03.420224 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5c82c2ed-1019-4e2c-9133-c8434548688d tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "PUT /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 992 microversion: 2.47 time: 0.072594 Sep 07 12:53:03.433692 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2251/4454] 10.222.0.16 () {62 vars in 1297 bytes} [Wed Sep 7 12:53:03 2022] PUT /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 992 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:53:03.456464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e55db544-9f0c-4ca5-9771-4f1bafb56a49 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:03.457372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e55db544-9f0c-4ca5-9771-4f1bafb56a49 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:03.461712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5883cc0c-0f10-4479-b194-2be8d8d4bb70 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:03.487478 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5883cc0c-0f10-4479-b194-2be8d8d4bb70 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.392003 Sep 07 12:53:03.489889 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2204/4455] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:03 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:03.571117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e55db544-9f0c-4ca5-9771-4f1bafb56a49 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:03.586255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e55db544-9f0c-4ca5-9771-4f1bafb56a49 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:03.590108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e55db544-9f0c-4ca5-9771-4f1bafb56a49 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:03.594061 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e55db544-9f0c-4ca5-9771-4f1bafb56a49 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1278 microversion: 2.47 time: 0.142156 Sep 07 12:53:03.595497 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2252/4456] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:03 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1278 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:03.745796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d2364ddc-4c01-49cd-a2b4-7adf14f58948 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:03.747519 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d2364ddc-4c01-49cd-a2b4-7adf14f58948 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:03.762534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2364ddc-4c01-49cd-a2b4-7adf14f58948 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:03.765313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2364ddc-4c01-49cd-a2b4-7adf14f58948 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:03.767245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2364ddc-4c01-49cd-a2b4-7adf14f58948 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:03.768966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2364ddc-4c01-49cd-a2b4-7adf14f58948 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:03.770951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2364ddc-4c01-49cd-a2b4-7adf14f58948 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:03.772136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2364ddc-4c01-49cd-a2b4-7adf14f58948 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:04.012332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0483d4f7-f3e5-495a-91d3-a233a6984ce3 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:04.017733 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0483d4f7-f3e5-495a-91d3-a233a6984ce3 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:04.033685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0483d4f7-f3e5-495a-91d3-a233a6984ce3 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:04.035176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0483d4f7-f3e5-495a-91d3-a233a6984ce3 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:04.037137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0483d4f7-f3e5-495a-91d3-a233a6984ce3 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:04.039493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0483d4f7-f3e5-495a-91d3-a233a6984ce3 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:04.040758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0483d4f7-f3e5-495a-91d3-a233a6984ce3 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:04.042731 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0483d4f7-f3e5-495a-91d3-a233a6984ce3 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:04.198296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d2364ddc-4c01-49cd-a2b4-7adf14f58948 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:04.212022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0483d4f7-f3e5-495a-91d3-a233a6984ce3 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:04.227218 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d2364ddc-4c01-49cd-a2b4-7adf14f58948 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1324 microversion: 2.1 time: 0.489825 Sep 07 12:53:04.233529 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2205/4457] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:03 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1324 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:04.250040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-af628e85-aede-4971-9732-8e4ac0647225 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:04.251296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-af628e85-aede-4971-9732-8e4ac0647225 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:04.255585 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0483d4f7-f3e5-495a-91d3-a233a6984ce3 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:04.263226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0483d4f7-f3e5-495a-91d3-a233a6984ce3 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:04.267373 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0483d4f7-f3e5-495a-91d3-a233a6984ce3 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1604 microversion: 2.42 time: 0.274625 Sep 07 12:53:04.274833 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2253/4458] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:03 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1604 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:04.275160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af628e85-aede-4971-9732-8e4ac0647225 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:04.275926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af628e85-aede-4971-9732-8e4ac0647225 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:04.276987 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af628e85-aede-4971-9732-8e4ac0647225 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:04.278964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af628e85-aede-4971-9732-8e4ac0647225 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:04.280197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af628e85-aede-4971-9732-8e4ac0647225 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:04.281170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af628e85-aede-4971-9732-8e4ac0647225 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:04.541263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-20bb8411-b251-4df3-af3d-7ba733368b06 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:04.549767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-20bb8411-b251-4df3-af3d-7ba733368b06 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:04.585331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20bb8411-b251-4df3-af3d-7ba733368b06 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:04.586280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20bb8411-b251-4df3-af3d-7ba733368b06 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:04.587135 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20bb8411-b251-4df3-af3d-7ba733368b06 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:04.588455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20bb8411-b251-4df3-af3d-7ba733368b06 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:04.589205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20bb8411-b251-4df3-af3d-7ba733368b06 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:04.616668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20bb8411-b251-4df3-af3d-7ba733368b06 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:04.622115 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-af628e85-aede-4971-9732-8e4ac0647225 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:04.633294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-af628e85-aede-4971-9732-8e4ac0647225 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:04.636761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-af628e85-aede-4971-9732-8e4ac0647225 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:04.639642 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-af628e85-aede-4971-9732-8e4ac0647225 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.409609 Sep 07 12:53:04.654720 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2206/4459] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:04 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:04.677451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2385e41d-4cb4-4763-a29b-2e41249f8e0e tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:04.678514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2385e41d-4cb4-4763-a29b-2e41249f8e0e tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:04.685950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2385e41d-4cb4-4763-a29b-2e41249f8e0e tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:04.687128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2385e41d-4cb4-4763-a29b-2e41249f8e0e tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:04.687823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2385e41d-4cb4-4763-a29b-2e41249f8e0e tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:04.688828 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2385e41d-4cb4-4763-a29b-2e41249f8e0e tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:04.689549 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2385e41d-4cb4-4763-a29b-2e41249f8e0e tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:04.690213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2385e41d-4cb4-4763-a29b-2e41249f8e0e tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:04.705207 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:04.807785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2385e41d-4cb4-4763-a29b-2e41249f8e0e tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:04.821266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2385e41d-4cb4-4763-a29b-2e41249f8e0e tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:04.826964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2385e41d-4cb4-4763-a29b-2e41249f8e0e tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:04.832288 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2385e41d-4cb4-4763-a29b-2e41249f8e0e tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1282 microversion: 2.47 time: 0.175553 Sep 07 12:53:04.882638 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2207/4460] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:04 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1282 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:05.077829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-20bb8411-b251-4df3-af3d-7ba733368b06 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:05.152378 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-20bb8411-b251-4df3-af3d-7ba733368b06 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.627001 Sep 07 12:53:05.155308 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2254/4461] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:04 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:05.266863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1674760a-9504-4253-af32-50cc981e9815 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:05.267994 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1674760a-9504-4253-af32-50cc981e9815 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:05.278081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1674760a-9504-4253-af32-50cc981e9815 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:05.278694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1674760a-9504-4253-af32-50cc981e9815 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:05.279364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1674760a-9504-4253-af32-50cc981e9815 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:05.280202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1674760a-9504-4253-af32-50cc981e9815 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:05.280769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1674760a-9504-4253-af32-50cc981e9815 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:05.281295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1674760a-9504-4253-af32-50cc981e9815 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:05.286817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:05.307766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c8ef584e-3ef5-498c-8090-16c9e70a68be tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:05.310794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c8ef584e-3ef5-498c-8090-16c9e70a68be tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:05.323430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8ef584e-3ef5-498c-8090-16c9e70a68be tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:05.324231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8ef584e-3ef5-498c-8090-16c9e70a68be tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:05.325023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8ef584e-3ef5-498c-8090-16c9e70a68be tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:05.327024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8ef584e-3ef5-498c-8090-16c9e70a68be tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:05.327791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8ef584e-3ef5-498c-8090-16c9e70a68be tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:05.329457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8ef584e-3ef5-498c-8090-16c9e70a68be tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:05.471188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c8ef584e-3ef5-498c-8090-16c9e70a68be tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:05.485135 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c8ef584e-3ef5-498c-8090-16c9e70a68be tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:05.487055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c8ef584e-3ef5-498c-8090-16c9e70a68be tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:05.488359 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c8ef584e-3ef5-498c-8090-16c9e70a68be tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1604 microversion: 2.42 time: 0.191155 Sep 07 12:53:05.493830 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2255/4462] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:05 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1604 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:05.572202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1674760a-9504-4253-af32-50cc981e9815 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:05.587322 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1674760a-9504-4253-af32-50cc981e9815 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1324 microversion: 2.1 time: 0.324528 Sep 07 12:53:05.588300 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2208/4463] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:05 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1324 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:05.673149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2729e03a-2da3-4013-92a8-3a4e410f683f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:05.675942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2729e03a-2da3-4013-92a8-3a4e410f683f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:05.683483 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2729e03a-2da3-4013-92a8-3a4e410f683f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:05.684013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2729e03a-2da3-4013-92a8-3a4e410f683f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:05.684455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2729e03a-2da3-4013-92a8-3a4e410f683f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:05.685182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2729e03a-2da3-4013-92a8-3a4e410f683f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:05.685682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2729e03a-2da3-4013-92a8-3a4e410f683f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:05.686123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2729e03a-2da3-4013-92a8-3a4e410f683f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:05.844691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2729e03a-2da3-4013-92a8-3a4e410f683f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:05.855080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2729e03a-2da3-4013-92a8-3a4e410f683f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:05.856570 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2729e03a-2da3-4013-92a8-3a4e410f683f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:05.857832 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2729e03a-2da3-4013-92a8-3a4e410f683f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.188816 Sep 07 12:53:05.858404 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2256/4464] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:05 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:05.884185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-708cb941-d0d4-4c78-bf38-8e83497a4ed6 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:05.885378 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-708cb941-d0d4-4c78-bf38-8e83497a4ed6 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:05.900256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-708cb941-d0d4-4c78-bf38-8e83497a4ed6 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:05.903750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-708cb941-d0d4-4c78-bf38-8e83497a4ed6 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:05.905017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-708cb941-d0d4-4c78-bf38-8e83497a4ed6 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:05.907737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-708cb941-d0d4-4c78-bf38-8e83497a4ed6 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:05.908557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-708cb941-d0d4-4c78-bf38-8e83497a4ed6 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:05.909382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-708cb941-d0d4-4c78-bf38-8e83497a4ed6 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:06.024888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-708cb941-d0d4-4c78-bf38-8e83497a4ed6 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:06.037368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-708cb941-d0d4-4c78-bf38-8e83497a4ed6 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:06.040179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-708cb941-d0d4-4c78-bf38-8e83497a4ed6 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:06.041898 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-708cb941-d0d4-4c78-bf38-8e83497a4ed6 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1330 microversion: 2.47 time: 0.162853 Sep 07 12:53:06.042880 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2209/4465] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:05 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1330 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:53:06.181372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-65b9cd7f-fb21-4152-ad3e-d1560770a860 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:06.183729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-65b9cd7f-fb21-4152-ad3e-d1560770a860 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:06.200010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65b9cd7f-fb21-4152-ad3e-d1560770a860 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:06.200949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65b9cd7f-fb21-4152-ad3e-d1560770a860 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:06.201768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65b9cd7f-fb21-4152-ad3e-d1560770a860 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:06.203038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65b9cd7f-fb21-4152-ad3e-d1560770a860 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:06.207713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65b9cd7f-fb21-4152-ad3e-d1560770a860 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:06.212010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65b9cd7f-fb21-4152-ad3e-d1560770a860 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:06.431873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-65b9cd7f-fb21-4152-ad3e-d1560770a860 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:06.441803 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-65b9cd7f-fb21-4152-ad3e-d1560770a860 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.266067 Sep 07 12:53:06.442529 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2257/4466] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:06 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:06.553802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-62fd90be-1522-42ae-b693-9bb4fa5a99f6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:06.555272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-62fd90be-1522-42ae-b693-9bb4fa5a99f6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:06.568794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62fd90be-1522-42ae-b693-9bb4fa5a99f6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:06.571750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62fd90be-1522-42ae-b693-9bb4fa5a99f6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:06.573166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62fd90be-1522-42ae-b693-9bb4fa5a99f6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:06.574931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62fd90be-1522-42ae-b693-9bb4fa5a99f6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:06.576084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62fd90be-1522-42ae-b693-9bb4fa5a99f6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:06.577196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62fd90be-1522-42ae-b693-9bb4fa5a99f6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:06.631214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1bd88b49-c4c3-4ce5-916d-e999340747c6 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:06.631214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1bd88b49-c4c3-4ce5-916d-e999340747c6 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:06.646772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bd88b49-c4c3-4ce5-916d-e999340747c6 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:06.647911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bd88b49-c4c3-4ce5-916d-e999340747c6 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:06.648751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bd88b49-c4c3-4ce5-916d-e999340747c6 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:06.653954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bd88b49-c4c3-4ce5-916d-e999340747c6 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:06.655035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bd88b49-c4c3-4ce5-916d-e999340747c6 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:06.655813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bd88b49-c4c3-4ce5-916d-e999340747c6 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:06.755571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-62fd90be-1522-42ae-b693-9bb4fa5a99f6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:06.776343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-62fd90be-1522-42ae-b693-9bb4fa5a99f6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:06.780120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-62fd90be-1522-42ae-b693-9bb4fa5a99f6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:06.782827 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-62fd90be-1522-42ae-b693-9bb4fa5a99f6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1604 microversion: 2.42 time: 0.252149 Sep 07 12:53:06.785945 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2210/4467] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:06 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1604 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:06.872673 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1bd88b49-c4c3-4ce5-916d-e999340747c6 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:06.886727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9ebafdca-d34d-4749-8cd0-f886a44a0e53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:06.887932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9ebafdca-d34d-4749-8cd0-f886a44a0e53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:06.888470 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1bd88b49-c4c3-4ce5-916d-e999340747c6 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1324 microversion: 2.1 time: 0.266302 Sep 07 12:53:06.895711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ebafdca-d34d-4749-8cd0-f886a44a0e53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:06.896587 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ebafdca-d34d-4749-8cd0-f886a44a0e53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:06.897228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ebafdca-d34d-4749-8cd0-f886a44a0e53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:06.898216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ebafdca-d34d-4749-8cd0-f886a44a0e53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:06.898908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ebafdca-d34d-4749-8cd0-f886a44a0e53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:06.899535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ebafdca-d34d-4749-8cd0-f886a44a0e53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:06.902549 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2258/4468] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:06 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1324 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:07.068981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a36a6bbd-a5a7-4a3a-b29e-469ee15bbb3f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:07.070213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a36a6bbd-a5a7-4a3a-b29e-469ee15bbb3f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:07.084204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a36a6bbd-a5a7-4a3a-b29e-469ee15bbb3f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:07.084954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a36a6bbd-a5a7-4a3a-b29e-469ee15bbb3f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:07.085419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a36a6bbd-a5a7-4a3a-b29e-469ee15bbb3f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:07.086197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a36a6bbd-a5a7-4a3a-b29e-469ee15bbb3f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:07.086664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a36a6bbd-a5a7-4a3a-b29e-469ee15bbb3f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:07.087190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a36a6bbd-a5a7-4a3a-b29e-469ee15bbb3f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:07.135411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9ebafdca-d34d-4749-8cd0-f886a44a0e53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:07.146085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9ebafdca-d34d-4749-8cd0-f886a44a0e53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:07.147367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9ebafdca-d34d-4749-8cd0-f886a44a0e53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:07.148788 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9ebafdca-d34d-4749-8cd0-f886a44a0e53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.267050 Sep 07 12:53:07.150120 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2211/4469] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:06 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:53:07.192397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a36a6bbd-a5a7-4a3a-b29e-469ee15bbb3f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:07.202287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a36a6bbd-a5a7-4a3a-b29e-469ee15bbb3f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:07.203929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a36a6bbd-a5a7-4a3a-b29e-469ee15bbb3f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:07.205220 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a36a6bbd-a5a7-4a3a-b29e-469ee15bbb3f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1330 microversion: 2.47 time: 0.140686 Sep 07 12:53:07.205872 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2259/4470] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:07 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1330 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:07.472352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-811a7cb7-0e33-44e4-a86c-adaf22e82dcc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:07.474066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-811a7cb7-0e33-44e4-a86c-adaf22e82dcc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:07.487674 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-811a7cb7-0e33-44e4-a86c-adaf22e82dcc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:07.489683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-811a7cb7-0e33-44e4-a86c-adaf22e82dcc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:07.491167 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-811a7cb7-0e33-44e4-a86c-adaf22e82dcc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:07.493048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-811a7cb7-0e33-44e4-a86c-adaf22e82dcc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:07.494528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-811a7cb7-0e33-44e4-a86c-adaf22e82dcc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:07.495668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-811a7cb7-0e33-44e4-a86c-adaf22e82dcc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:07.823932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a9041cf5-d2f9-4912-897e-1d6c859b465a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:07.825836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a9041cf5-d2f9-4912-897e-1d6c859b465a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:07.846958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9041cf5-d2f9-4912-897e-1d6c859b465a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:07.851686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9041cf5-d2f9-4912-897e-1d6c859b465a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:07.852936 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9041cf5-d2f9-4912-897e-1d6c859b465a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:07.854343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9041cf5-d2f9-4912-897e-1d6c859b465a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:07.855487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9041cf5-d2f9-4912-897e-1d6c859b465a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:07.856358 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9041cf5-d2f9-4912-897e-1d6c859b465a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:07.936762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-811a7cb7-0e33-44e4-a86c-adaf22e82dcc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:07.959633 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-811a7cb7-0e33-44e4-a86c-adaf22e82dcc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.495745 Sep 07 12:53:07.960632 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2212/4471] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:07 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:07.974630 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bdfc2207-eaaa-4f55-a5b3-debd25536f1e tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:07.975947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bdfc2207-eaaa-4f55-a5b3-debd25536f1e tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:07.991612 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdfc2207-eaaa-4f55-a5b3-debd25536f1e tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:07.993430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdfc2207-eaaa-4f55-a5b3-debd25536f1e tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:07.994174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdfc2207-eaaa-4f55-a5b3-debd25536f1e tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:07.995163 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdfc2207-eaaa-4f55-a5b3-debd25536f1e tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:07.995635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdfc2207-eaaa-4f55-a5b3-debd25536f1e tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:07.996067 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdfc2207-eaaa-4f55-a5b3-debd25536f1e tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:08.014968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a9041cf5-d2f9-4912-897e-1d6c859b465a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:08.025955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a9041cf5-d2f9-4912-897e-1d6c859b465a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:08.028307 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a9041cf5-d2f9-4912-897e-1d6c859b465a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:08.029926 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a9041cf5-d2f9-4912-897e-1d6c859b465a tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1604 microversion: 2.42 time: 0.214647 Sep 07 12:53:08.031205 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2260/4472] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:07 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1604 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:08.167266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bdfc2207-eaaa-4f55-a5b3-debd25536f1e tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:08.195962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b1e89866-e463-4efe-8d5b-97c8a059e73d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:08.197431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b1e89866-e463-4efe-8d5b-97c8a059e73d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:08.206180 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bdfc2207-eaaa-4f55-a5b3-debd25536f1e tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1324 microversion: 2.1 time: 0.243933 Sep 07 12:53:08.208172 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2213/4473] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:07 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1324 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:08.221195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1e89866-e463-4efe-8d5b-97c8a059e73d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:08.229016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1e89866-e463-4efe-8d5b-97c8a059e73d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:08.229512 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1e89866-e463-4efe-8d5b-97c8a059e73d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:08.230464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1e89866-e463-4efe-8d5b-97c8a059e73d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:08.230981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1e89866-e463-4efe-8d5b-97c8a059e73d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:08.231434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1e89866-e463-4efe-8d5b-97c8a059e73d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:08.237877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-69d9ff29-7b68-436e-8c12-60d3313195f7 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:08.239102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-69d9ff29-7b68-436e-8c12-60d3313195f7 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:08.254627 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69d9ff29-7b68-436e-8c12-60d3313195f7 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:08.255482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69d9ff29-7b68-436e-8c12-60d3313195f7 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:08.256278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69d9ff29-7b68-436e-8c12-60d3313195f7 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:08.257655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69d9ff29-7b68-436e-8c12-60d3313195f7 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:08.258422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69d9ff29-7b68-436e-8c12-60d3313195f7 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:08.259145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69d9ff29-7b68-436e-8c12-60d3313195f7 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:08.452838 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-69d9ff29-7b68-436e-8c12-60d3313195f7 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:08.473979 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-69d9ff29-7b68-436e-8c12-60d3313195f7 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:08.476199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-69d9ff29-7b68-436e-8c12-60d3313195f7 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:08.477151 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-69d9ff29-7b68-436e-8c12-60d3313195f7 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1348 microversion: 2.47 time: 0.247592 Sep 07 12:53:08.478322 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2214/4474] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:08 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1348 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:53:08.516996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b12bb7ee-39aa-45e2-b67a-5b7458dd91b9 req-33cdb564-e2b5-4744-8cf3-074045d0500b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae560a6-de3d-4c7d-892d-e53d9f8da941", "name": "network-vif-plugged", "status": "completed", "tag": "feefcfa5-a9aa-4f77-bf84-1e0236841758"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:53:08.529985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b12bb7ee-39aa-45e2-b67a-5b7458dd91b9 req-33cdb564-e2b5-4744-8cf3-074045d0500b service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:08.530486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b12bb7ee-39aa-45e2-b67a-5b7458dd91b9 req-33cdb564-e2b5-4744-8cf3-074045d0500b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:08.530932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b12bb7ee-39aa-45e2-b67a-5b7458dd91b9 req-33cdb564-e2b5-4744-8cf3-074045d0500b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:08.550871 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b12bb7ee-39aa-45e2-b67a-5b7458dd91b9 req-33cdb564-e2b5-4744-8cf3-074045d0500b service nova] Creating event network-vif-plugged:feefcfa5-a9aa-4f77-bf84-1e0236841758 for instance 2ae560a6-de3d-4c7d-892d-e53d9f8da941 on n-h1-852087-9 Sep 07 12:53:08.558809 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b12bb7ee-39aa-45e2-b67a-5b7458dd91b9 req-33cdb564-e2b5-4744-8cf3-074045d0500b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046278 Sep 07 12:53:08.559785 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2215/4475] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:53:08.592727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b1e89866-e463-4efe-8d5b-97c8a059e73d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:08.607214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b1e89866-e463-4efe-8d5b-97c8a059e73d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:08.609154 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b1e89866-e463-4efe-8d5b-97c8a059e73d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:08.611073 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b1e89866-e463-4efe-8d5b-97c8a059e73d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.422769 Sep 07 12:53:08.612212 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2261/4476] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:08 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:53:09.002974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-38b7578e-2a39-429a-b042-bdabd1e44e03 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:09.004026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-38b7578e-2a39-429a-b042-bdabd1e44e03 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:09.012716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38b7578e-2a39-429a-b042-bdabd1e44e03 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:09.013209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38b7578e-2a39-429a-b042-bdabd1e44e03 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:09.013688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38b7578e-2a39-429a-b042-bdabd1e44e03 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:09.014419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38b7578e-2a39-429a-b042-bdabd1e44e03 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:09.014877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38b7578e-2a39-429a-b042-bdabd1e44e03 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:09.015309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38b7578e-2a39-429a-b042-bdabd1e44e03 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:09.086246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-73d8149c-c9b9-47e9-9092-547302aaf1e8 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:09.087582 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-73d8149c-c9b9-47e9-9092-547302aaf1e8 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:09.102583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73d8149c-c9b9-47e9-9092-547302aaf1e8 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:09.103489 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73d8149c-c9b9-47e9-9092-547302aaf1e8 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:09.104605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73d8149c-c9b9-47e9-9092-547302aaf1e8 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:09.105857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73d8149c-c9b9-47e9-9092-547302aaf1e8 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:09.106674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73d8149c-c9b9-47e9-9092-547302aaf1e8 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:09.107445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-73d8149c-c9b9-47e9-9092-547302aaf1e8 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:09.148960 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 12:53:09.149216 n-d-852087-9 devstack@n-api.service[122433]: Wed Sep 7 12:53:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a (ip 10.222.0.16) !!! Sep 07 12:53:09.244017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-73d8149c-c9b9-47e9-9092-547302aaf1e8 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:09.258652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-73d8149c-c9b9-47e9-9092-547302aaf1e8 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:09.261630 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-73d8149c-c9b9-47e9-9092-547302aaf1e8 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:09.264305 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-73d8149c-c9b9-47e9-9092-547302aaf1e8 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1604 microversion: 2.42 time: 0.190610 Sep 07 12:53:09.265354 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2262/4477] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:09 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1604 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:53:09.274552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d8df973d-9dc9-4fca-85b2-a22045f52910 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:09.275816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d8df973d-9dc9-4fca-85b2-a22045f52910 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:09.281890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-38b7578e-2a39-429a-b042-bdabd1e44e03 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:09.287906 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8df973d-9dc9-4fca-85b2-a22045f52910 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:09.289253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8df973d-9dc9-4fca-85b2-a22045f52910 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:09.290316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8df973d-9dc9-4fca-85b2-a22045f52910 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:09.291871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8df973d-9dc9-4fca-85b2-a22045f52910 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:09.292934 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8df973d-9dc9-4fca-85b2-a22045f52910 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:09.294057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8df973d-9dc9-4fca-85b2-a22045f52910 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:09.294898 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-38b7578e-2a39-429a-b042-bdabd1e44e03 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.297972 Sep 07 12:53:09.295982 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2216/4478] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:08 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:53:09.523249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a1a1bdbc-cff8-4b49-bce5-1e61679ee576 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:09.524501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a1a1bdbc-cff8-4b49-bce5-1e61679ee576 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:09.536025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1a1bdbc-cff8-4b49-bce5-1e61679ee576 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:09.536759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1a1bdbc-cff8-4b49-bce5-1e61679ee576 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:09.537460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1a1bdbc-cff8-4b49-bce5-1e61679ee576 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:09.538668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d8df973d-9dc9-4fca-85b2-a22045f52910 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:09.538991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1a1bdbc-cff8-4b49-bce5-1e61679ee576 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:09.539717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1a1bdbc-cff8-4b49-bce5-1e61679ee576 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:09.540402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1a1bdbc-cff8-4b49-bce5-1e61679ee576 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:09.556848 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d8df973d-9dc9-4fca-85b2-a22045f52910 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1324 microversion: 2.1 time: 0.289525 Sep 07 12:53:09.558667 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2263/4479] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:09 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1324 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:09.639340 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a1a1bdbc-cff8-4b49-bce5-1e61679ee576 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:09.650795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f066c89c-f83f-4f64-9503-79503dcf86cd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:09.652046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f066c89c-f83f-4f64-9503-79503dcf86cd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:09.652607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a1a1bdbc-cff8-4b49-bce5-1e61679ee576 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:09.654933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a1a1bdbc-cff8-4b49-bce5-1e61679ee576 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:09.656617 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a1a1bdbc-cff8-4b49-bce5-1e61679ee576 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1336 microversion: 2.47 time: 0.140921 Sep 07 12:53:09.657785 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2217/4480] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:09 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1336 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:53:09.664491 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f066c89c-f83f-4f64-9503-79503dcf86cd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:09.665385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f066c89c-f83f-4f64-9503-79503dcf86cd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:09.666231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f066c89c-f83f-4f64-9503-79503dcf86cd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:09.667507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f066c89c-f83f-4f64-9503-79503dcf86cd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:09.668527 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f066c89c-f83f-4f64-9503-79503dcf86cd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:09.669110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f066c89c-f83f-4f64-9503-79503dcf86cd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:09.901955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f066c89c-f83f-4f64-9503-79503dcf86cd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:09.915503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f066c89c-f83f-4f64-9503-79503dcf86cd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:09.917210 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f066c89c-f83f-4f64-9503-79503dcf86cd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:09.918814 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f066c89c-f83f-4f64-9503-79503dcf86cd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.275790 Sep 07 12:53:09.921541 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2264/4481] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:09 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:10.314339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-57f9d689-cd71-44de-b68d-598d4ebf1108 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:10.315407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-57f9d689-cd71-44de-b68d-598d4ebf1108 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:10.325121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57f9d689-cd71-44de-b68d-598d4ebf1108 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:10.326332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57f9d689-cd71-44de-b68d-598d4ebf1108 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:10.326963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57f9d689-cd71-44de-b68d-598d4ebf1108 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:10.327979 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57f9d689-cd71-44de-b68d-598d4ebf1108 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:10.328668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57f9d689-cd71-44de-b68d-598d4ebf1108 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:10.329289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57f9d689-cd71-44de-b68d-598d4ebf1108 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:10.330994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-105db573-73a9-4b3f-ad9a-b66df1fea01d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:10.331755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-105db573-73a9-4b3f-ad9a-b66df1fea01d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:10.339553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-105db573-73a9-4b3f-ad9a-b66df1fea01d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:10.340058 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-105db573-73a9-4b3f-ad9a-b66df1fea01d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:10.340509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-105db573-73a9-4b3f-ad9a-b66df1fea01d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:10.341241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-105db573-73a9-4b3f-ad9a-b66df1fea01d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:10.341763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-105db573-73a9-4b3f-ad9a-b66df1fea01d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:10.342223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-105db573-73a9-4b3f-ad9a-b66df1fea01d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:10.427666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-57f9d689-cd71-44de-b68d-598d4ebf1108 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:10.446237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-57f9d689-cd71-44de-b68d-598d4ebf1108 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:10.449712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-57f9d689-cd71-44de-b68d-598d4ebf1108 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:10.452968 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-57f9d689-cd71-44de-b68d-598d4ebf1108 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1604 microversion: 2.42 time: 0.141892 Sep 07 12:53:10.453643 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2218/4482] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:10 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1604 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:10.557218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-105db573-73a9-4b3f-ad9a-b66df1fea01d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:10.568746 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-105db573-73a9-4b3f-ad9a-b66df1fea01d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.241434 Sep 07 12:53:10.582609 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2265/4483] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:10 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:53:10.590914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aaecb765-56e5-455b-8c1e-74c805bdd7de tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:10.598071 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aaecb765-56e5-455b-8c1e-74c805bdd7de tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:10.622229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaecb765-56e5-455b-8c1e-74c805bdd7de tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:10.624825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaecb765-56e5-455b-8c1e-74c805bdd7de tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:10.625768 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaecb765-56e5-455b-8c1e-74c805bdd7de tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:10.627027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaecb765-56e5-455b-8c1e-74c805bdd7de tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:10.628044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaecb765-56e5-455b-8c1e-74c805bdd7de tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:10.628904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaecb765-56e5-455b-8c1e-74c805bdd7de tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:10.688414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c57ecd0-5bd7-4725-b41a-49381cd25679 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:10.689050 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2c57ecd0-5bd7-4725-b41a-49381cd25679 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:10.717164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c57ecd0-5bd7-4725-b41a-49381cd25679 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:10.718435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c57ecd0-5bd7-4725-b41a-49381cd25679 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:10.719570 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c57ecd0-5bd7-4725-b41a-49381cd25679 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:10.721138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c57ecd0-5bd7-4725-b41a-49381cd25679 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:10.722312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c57ecd0-5bd7-4725-b41a-49381cd25679 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:10.723424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c57ecd0-5bd7-4725-b41a-49381cd25679 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:10.977012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2c57ecd0-5bd7-4725-b41a-49381cd25679 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:10.987325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2c57ecd0-5bd7-4725-b41a-49381cd25679 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:10.989238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2c57ecd0-5bd7-4725-b41a-49381cd25679 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:10.990903 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2c57ecd0-5bd7-4725-b41a-49381cd25679 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1336 microversion: 2.47 time: 0.307633 Sep 07 12:53:11.002564 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2266/4484] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:10 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1336 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:11.002564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1cf37515-7aa6-4d4c-943d-d914b9e57bbd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:11.002564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1cf37515-7aa6-4d4c-943d-d914b9e57bbd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:11.009332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cf37515-7aa6-4d4c-943d-d914b9e57bbd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:11.011019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cf37515-7aa6-4d4c-943d-d914b9e57bbd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:11.011476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cf37515-7aa6-4d4c-943d-d914b9e57bbd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:11.012230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cf37515-7aa6-4d4c-943d-d914b9e57bbd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:11.014171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cf37515-7aa6-4d4c-943d-d914b9e57bbd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:11.014813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cf37515-7aa6-4d4c-943d-d914b9e57bbd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:11.130872 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aaecb765-56e5-455b-8c1e-74c805bdd7de tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:11.143005 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aaecb765-56e5-455b-8c1e-74c805bdd7de tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1324 microversion: 2.1 time: 0.564993 Sep 07 12:53:11.145564 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2219/4485] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:10 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1324 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:53:11.215243 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1cf37515-7aa6-4d4c-943d-d914b9e57bbd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:11.225402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1cf37515-7aa6-4d4c-943d-d914b9e57bbd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:11.226907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1cf37515-7aa6-4d4c-943d-d914b9e57bbd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:11.228204 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1cf37515-7aa6-4d4c-943d-d914b9e57bbd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.235289 Sep 07 12:53:11.228815 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2267/4486] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:10 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:11.481948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4c8d82e2-cdce-4ab6-9ff6-47709b860e5d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:11.482741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4c8d82e2-cdce-4ab6-9ff6-47709b860e5d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:11.490715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c8d82e2-cdce-4ab6-9ff6-47709b860e5d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:11.491248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c8d82e2-cdce-4ab6-9ff6-47709b860e5d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:11.491698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c8d82e2-cdce-4ab6-9ff6-47709b860e5d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:11.492453 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c8d82e2-cdce-4ab6-9ff6-47709b860e5d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:11.493116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c8d82e2-cdce-4ab6-9ff6-47709b860e5d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:11.493780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4c8d82e2-cdce-4ab6-9ff6-47709b860e5d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:11.611894 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c22f8df3-0b77-4689-bd45-6fe5e2bf5d10 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:11.613154 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c22f8df3-0b77-4689-bd45-6fe5e2bf5d10 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:11.624574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c22f8df3-0b77-4689-bd45-6fe5e2bf5d10 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:11.625461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c22f8df3-0b77-4689-bd45-6fe5e2bf5d10 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:11.626195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c22f8df3-0b77-4689-bd45-6fe5e2bf5d10 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:11.627227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c22f8df3-0b77-4689-bd45-6fe5e2bf5d10 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:11.628154 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c22f8df3-0b77-4689-bd45-6fe5e2bf5d10 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:11.629075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c22f8df3-0b77-4689-bd45-6fe5e2bf5d10 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:11.640979 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4c8d82e2-cdce-4ab6-9ff6-47709b860e5d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:11.659957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4c8d82e2-cdce-4ab6-9ff6-47709b860e5d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:11.663517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4c8d82e2-cdce-4ab6-9ff6-47709b860e5d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:11.666211 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4c8d82e2-cdce-4ab6-9ff6-47709b860e5d tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1604 microversion: 2.42 time: 0.188384 Sep 07 12:53:11.667236 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2220/4487] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:11 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1604 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:11.788536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c22f8df3-0b77-4689-bd45-6fe5e2bf5d10 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:11.797931 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c22f8df3-0b77-4689-bd45-6fe5e2bf5d10 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.190687 Sep 07 12:53:11.798544 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2268/4488] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:11 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:53:12.022427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7a422f38-af9a-46fe-9a7a-26395f3bef8c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:12.023620 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7a422f38-af9a-46fe-9a7a-26395f3bef8c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:12.034369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a422f38-af9a-46fe-9a7a-26395f3bef8c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:12.034930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a422f38-af9a-46fe-9a7a-26395f3bef8c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:12.035516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a422f38-af9a-46fe-9a7a-26395f3bef8c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:12.036354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a422f38-af9a-46fe-9a7a-26395f3bef8c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:12.036908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a422f38-af9a-46fe-9a7a-26395f3bef8c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:12.037517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a422f38-af9a-46fe-9a7a-26395f3bef8c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:12.131457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7a422f38-af9a-46fe-9a7a-26395f3bef8c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:12.149151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7a422f38-af9a-46fe-9a7a-26395f3bef8c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:12.152796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7a422f38-af9a-46fe-9a7a-26395f3bef8c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:12.155475 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7a422f38-af9a-46fe-9a7a-26395f3bef8c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1357 microversion: 2.47 time: 0.139781 Sep 07 12:53:12.161562 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2221/4489] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:12 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1357 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:53:12.180500 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c3caa337-919e-47d5-9642-51cb75b8a390 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:12.181318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c3caa337-919e-47d5-9642-51cb75b8a390 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:12.188548 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3caa337-919e-47d5-9642-51cb75b8a390 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:12.189411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3caa337-919e-47d5-9642-51cb75b8a390 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:12.190610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3caa337-919e-47d5-9642-51cb75b8a390 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:12.192234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3caa337-919e-47d5-9642-51cb75b8a390 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:12.193401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3caa337-919e-47d5-9642-51cb75b8a390 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:12.194611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3caa337-919e-47d5-9642-51cb75b8a390 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:12.199371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fc49788c-c3fa-4337-993b-7696d3b91660 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:53:12.204924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fc49788c-c3fa-4337-993b-7696d3b91660 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:12.216284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc49788c-c3fa-4337-993b-7696d3b91660 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:12.217118 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc49788c-c3fa-4337-993b-7696d3b91660 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:12.217942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc49788c-c3fa-4337-993b-7696d3b91660 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:12.219136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc49788c-c3fa-4337-993b-7696d3b91660 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:12.219988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc49788c-c3fa-4337-993b-7696d3b91660 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:12.221649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc49788c-c3fa-4337-993b-7696d3b91660 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:12.341727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:12.508953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fc49788c-c3fa-4337-993b-7696d3b91660 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:53:12.509991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fc49788c-c3fa-4337-993b-7696d3b91660 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:53:12.510599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fc49788c-c3fa-4337-993b-7696d3b91660 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:53:12.511355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fc49788c-c3fa-4337-993b-7696d3b91660 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:53:12.512431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fc49788c-c3fa-4337-993b-7696d3b91660 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:53:12.634876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:12.652185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c3caa337-919e-47d5-9642-51cb75b8a390 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:12.676685 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c3caa337-919e-47d5-9642-51cb75b8a390 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1324 microversion: 2.1 time: 0.499732 Sep 07 12:53:12.698626 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2269/4490] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:12 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1324 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:12.712442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-666f21d4-abed-4766-81f8-ce8bed5402ff tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:12.713566 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-666f21d4-abed-4766-81f8-ce8bed5402ff tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:12.733325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-666f21d4-abed-4766-81f8-ce8bed5402ff tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:12.734222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-666f21d4-abed-4766-81f8-ce8bed5402ff tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:12.735039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-666f21d4-abed-4766-81f8-ce8bed5402ff tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:12.736357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-666f21d4-abed-4766-81f8-ce8bed5402ff tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:12.737306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-666f21d4-abed-4766-81f8-ce8bed5402ff tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:12.737921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-666f21d4-abed-4766-81f8-ce8bed5402ff tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:12.743834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fc49788c-c3fa-4337-993b-7696d3b91660 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:12.768565 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc49788c-c3fa-4337-993b-7696d3b91660 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:12.769433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc49788c-c3fa-4337-993b-7696d3b91660 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:12.770252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc49788c-c3fa-4337-993b-7696d3b91660 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:12.771473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc49788c-c3fa-4337-993b-7696d3b91660 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:12.772296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc49788c-c3fa-4337-993b-7696d3b91660 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:12.773009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc49788c-c3fa-4337-993b-7696d3b91660 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:12.864746 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fc49788c-c3fa-4337-993b-7696d3b91660 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "POST /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543/action" status: 202 len: 1079 microversion: 2.47 time: 0.672433 Sep 07 12:53:12.869243 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2222/4491] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Sep 7 12:53:12 2022] POST /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543/action => generated 1079 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 07 12:53:12.876825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e73fd07e-15a8-4891-af28-be158a870cb4 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:12.877971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e73fd07e-15a8-4891-af28-be158a870cb4 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:12.889090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e73fd07e-15a8-4891-af28-be158a870cb4 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:12.890021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e73fd07e-15a8-4891-af28-be158a870cb4 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:12.890636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e73fd07e-15a8-4891-af28-be158a870cb4 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:12.901977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e73fd07e-15a8-4891-af28-be158a870cb4 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:12.909709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e73fd07e-15a8-4891-af28-be158a870cb4 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:12.910151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e73fd07e-15a8-4891-af28-be158a870cb4 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:12.953299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:13.112807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e73fd07e-15a8-4891-af28-be158a870cb4 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:13.129908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e73fd07e-15a8-4891-af28-be158a870cb4 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:13.131970 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e73fd07e-15a8-4891-af28-be158a870cb4 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:13.133386 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e73fd07e-15a8-4891-af28-be158a870cb4 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1604 microversion: 2.42 time: 0.262608 Sep 07 12:53:13.133965 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2223/4492] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:12 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1604 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:13.149274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:13.158613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-993bb27d-cf4f-4a00-922b-f035ebb1f938 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:13.159588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-993bb27d-cf4f-4a00-922b-f035ebb1f938 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:13.169320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-993bb27d-cf4f-4a00-922b-f035ebb1f938 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:13.170669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-993bb27d-cf4f-4a00-922b-f035ebb1f938 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:13.171682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-993bb27d-cf4f-4a00-922b-f035ebb1f938 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:13.172976 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-993bb27d-cf4f-4a00-922b-f035ebb1f938 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:13.173759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-993bb27d-cf4f-4a00-922b-f035ebb1f938 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:13.174442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-993bb27d-cf4f-4a00-922b-f035ebb1f938 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:13.178088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-666f21d4-abed-4766-81f8-ce8bed5402ff tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:13.212812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-666f21d4-abed-4766-81f8-ce8bed5402ff tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:13.220263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-666f21d4-abed-4766-81f8-ce8bed5402ff tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:13.226439 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-666f21d4-abed-4766-81f8-ce8bed5402ff tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.524876 Sep 07 12:53:13.228872 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2270/4493] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:12 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:13.266169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e647abf4-afa2-4847-b2bc-f11a6ddc9a3d tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:13.267536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e647abf4-afa2-4847-b2bc-f11a6ddc9a3d tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:13.280443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:13.284311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e647abf4-afa2-4847-b2bc-f11a6ddc9a3d tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:13.286574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e647abf4-afa2-4847-b2bc-f11a6ddc9a3d tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:13.287892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e647abf4-afa2-4847-b2bc-f11a6ddc9a3d tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:13.289628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e647abf4-afa2-4847-b2bc-f11a6ddc9a3d tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:13.291875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e647abf4-afa2-4847-b2bc-f11a6ddc9a3d tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:13.293219 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e647abf4-afa2-4847-b2bc-f11a6ddc9a3d tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:13.309050 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:13.583464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:13.702345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e647abf4-afa2-4847-b2bc-f11a6ddc9a3d tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:13.737410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e647abf4-afa2-4847-b2bc-f11a6ddc9a3d tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:13.746440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e647abf4-afa2-4847-b2bc-f11a6ddc9a3d tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:13.750530 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e647abf4-afa2-4847-b2bc-f11a6ddc9a3d tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1366 microversion: 2.47 time: 0.518537 Sep 07 12:53:13.768727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-993bb27d-cf4f-4a00-922b-f035ebb1f938 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:13.771420 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2271/4494] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:13 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1366 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:13.798712 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-993bb27d-cf4f-4a00-922b-f035ebb1f938 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.644776 Sep 07 12:53:13.801588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8a1ccf05-b8f9-4ad8-a26c-1d64c814c93c tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:13.803091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8a1ccf05-b8f9-4ad8-a26c-1d64c814c93c tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:13.818852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a1ccf05-b8f9-4ad8-a26c-1d64c814c93c tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:13.820110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a1ccf05-b8f9-4ad8-a26c-1d64c814c93c tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:13.821249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a1ccf05-b8f9-4ad8-a26c-1d64c814c93c tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:13.823084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a1ccf05-b8f9-4ad8-a26c-1d64c814c93c tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:13.824211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a1ccf05-b8f9-4ad8-a26c-1d64c814c93c tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:13.825260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a1ccf05-b8f9-4ad8-a26c-1d64c814c93c tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:13.840878 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2224/4495] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:13 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:14.164943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4e7852af-fbba-4d39-bbbc-7fb0d14d4cf6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:14.172253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4e7852af-fbba-4d39-bbbc-7fb0d14d4cf6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:14.195322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e7852af-fbba-4d39-bbbc-7fb0d14d4cf6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:14.196869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e7852af-fbba-4d39-bbbc-7fb0d14d4cf6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:14.198340 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e7852af-fbba-4d39-bbbc-7fb0d14d4cf6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:14.199996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e7852af-fbba-4d39-bbbc-7fb0d14d4cf6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:14.204709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e7852af-fbba-4d39-bbbc-7fb0d14d4cf6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:14.211687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e7852af-fbba-4d39-bbbc-7fb0d14d4cf6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:14.367674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8a1ccf05-b8f9-4ad8-a26c-1d64c814c93c tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:14.374276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4e7852af-fbba-4d39-bbbc-7fb0d14d4cf6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:14.384063 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8a1ccf05-b8f9-4ad8-a26c-1d64c814c93c tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1521 microversion: 2.1 time: 0.610179 Sep 07 12:53:14.386929 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2272/4496] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:13 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1521 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:14.396137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e60dc9a4-4bd1-44e7-a63d-cab26ba78123 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:14.396137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e60dc9a4-4bd1-44e7-a63d-cab26ba78123 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:14.406293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4e7852af-fbba-4d39-bbbc-7fb0d14d4cf6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:14.409801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4e7852af-fbba-4d39-bbbc-7fb0d14d4cf6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:14.410590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e60dc9a4-4bd1-44e7-a63d-cab26ba78123 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:14.412480 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4e7852af-fbba-4d39-bbbc-7fb0d14d4cf6 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1604 microversion: 2.42 time: 0.254616 Sep 07 12:53:14.412767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e60dc9a4-4bd1-44e7-a63d-cab26ba78123 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:14.413216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e60dc9a4-4bd1-44e7-a63d-cab26ba78123 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:14.414229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e60dc9a4-4bd1-44e7-a63d-cab26ba78123 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:14.414867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e60dc9a4-4bd1-44e7-a63d-cab26ba78123 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:14.415455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e60dc9a4-4bd1-44e7-a63d-cab26ba78123 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:14.430863 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2225/4497] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:14 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1604 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:53:14.463414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ccfc0895-44ed-47b5-9af2-d2dfe01079fd tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:14.464118 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ccfc0895-44ed-47b5-9af2-d2dfe01079fd tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:14.487936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccfc0895-44ed-47b5-9af2-d2dfe01079fd tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:14.488440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccfc0895-44ed-47b5-9af2-d2dfe01079fd tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:14.492717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccfc0895-44ed-47b5-9af2-d2dfe01079fd tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:14.494284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccfc0895-44ed-47b5-9af2-d2dfe01079fd tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:14.494978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccfc0895-44ed-47b5-9af2-d2dfe01079fd tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:14.508972 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccfc0895-44ed-47b5-9af2-d2dfe01079fd tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:14.598752 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-ccfc0895-44ed-47b5-9af2-d2dfe01079fd tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] HTTP exception thrown: Action 999 not found Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ccfc0895-44ed-47b5-9af2-d2dfe01079fd tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Request method failure captured: Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941/os-instance-actions/999 HTTP/1.1 Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJQd318XRTvmQHDRWhNM7XSVUGfOtpivWeFXsfnkoqYeFeoJYdzPsmk4v_HCMbXvwno0s8ivna8uyraN2LwoOyHI5wnpbTGNQ9JsHGeG28rLjU7-1OcR-8JoPyp3S6EQg4yVVCA35EpR9SU74j4XAoVNB69NXRkppv5zDExMFDknGpU Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: c09672887f9048669b654d28ab70a69c Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-940754013 Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c09672887f9048669b654d28ab70a69c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c09672887f9048669b654d28ab70a69c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c09672887f9048669b654d28ab70a69c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c09672887f9048669b654d28ab70a69c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-940754013 Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: c09672887f9048669b654d28ab70a69c Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-940754013 Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-InstanceActionsNegativeTestJSON-940754013-project Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6a594d9b6bb04b3abc496db65e49ff09 Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-940754013-project Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: exception: Action 999 not found Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'server_id': '2ae560a6-de3d-4c7d-892d-e53d9f8da941', 'id': '999'} Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Sep 07 12:53:14.604569 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:14.609400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ccfc0895-44ed-47b5-9af2-d2dfe01079fd tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Returning 404 to user: Action 999 not found {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:53:14.610594 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ccfc0895-44ed-47b5-9af2-d2dfe01079fd tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.177662 Sep 07 12:53:14.611466 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2226/4498] 10.222.0.16 () {58 vars in 1308 bytes} [Wed Sep 7 12:53:14 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941/os-instance-actions/999 => generated 66 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:53:14.626814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-965027f0-00b5-4d97-ab5a-40a22c5fa3d9 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '.version_select at 0x7fc419051af0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:14.635138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-965027f0-00b5-4d97-ab5a-40a22c5fa3d9 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 39d2ba41-f62e-40c3-ae65-db6a711808e5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:14.658080 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-965027f0-00b5-4d97-ab5a-40a22c5fa3d9 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] HTTP exception thrown: Instance 39d2ba41-f62e-40c3-ae65-db6a711808e5 could not be found. Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-965027f0-00b5-4d97-ab5a-40a22c5fa3d9 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Request method failure captured: Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/39d2ba41-f62e-40c3-ae65-db6a711808e5/os-instance-actions HTTP/1.1 Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJQd318XRTvmQHDRWhNM7XSVUGfOtpivWeFXsfnkoqYeFeoJYdzPsmk4v_HCMbXvwno0s8ivna8uyraN2LwoOyHI5wnpbTGNQ9JsHGeG28rLjU7-1OcR-8JoPyp3S6EQg4yVVCA35EpR9SU74j4XAoVNB69NXRkppv5zDExMFDknGpU Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: c09672887f9048669b654d28ab70a69c Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-940754013 Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c09672887f9048669b654d28ab70a69c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c09672887f9048669b654d28ab70a69c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c09672887f9048669b654d28ab70a69c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c09672887f9048669b654d28ab70a69c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-940754013 Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: c09672887f9048669b654d28ab70a69c Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-940754013 Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-InstanceActionsNegativeTestJSON-940754013-project Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6a594d9b6bb04b3abc496db65e49ff09 Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-940754013-project Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 39d2ba41-f62e-40c3-ae65-db6a711808e5 could not be found. Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'server_id': '39d2ba41-f62e-40c3-ae65-db6a711808e5'} Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39d2ba41-f62e-40c3-ae65-db6a711808e5 could not be found. Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:53:14.662377 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:53:14.665888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39d2ba41-f62e-40c3-ae65-db6a711808e5 could not be found. Sep 07 12:53:14.665888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:14.665888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:14.665888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:14.665888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:14.665888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:14.665888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:14.665888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:53:14.665888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:53:14.665888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39d2ba41-f62e-40c3-ae65-db6a711808e5 could not be found. Sep 07 12:53:14.665888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:14.665888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-965027f0-00b5-4d97-ab5a-40a22c5fa3d9 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Returning 404 to user: Instance 39d2ba41-f62e-40c3-ae65-db6a711808e5 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:53:14.665888 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-965027f0-00b5-4d97-ab5a-40a22c5fa3d9 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/39d2ba41-f62e-40c3-ae65-db6a711808e5/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.042132 Sep 07 12:53:14.666666 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2227/4499] 10.222.0.16 () {58 vars in 1296 bytes} [Wed Sep 7 12:53:14 2022] GET /compute/v2.1/servers/39d2ba41-f62e-40c3-ae65-db6a711808e5/os-instance-actions => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:53:14.684569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-27e0fddc-8130-45f7-915f-456d3db43612 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:14.685447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-27e0fddc-8130-45f7-915f-456d3db43612 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:14.745418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27e0fddc-8130-45f7-915f-456d3db43612 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:14.746503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27e0fddc-8130-45f7-915f-456d3db43612 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:14.747434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27e0fddc-8130-45f7-915f-456d3db43612 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:14.748945 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27e0fddc-8130-45f7-915f-456d3db43612 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:14.749826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27e0fddc-8130-45f7-915f-456d3db43612 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:14.750617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27e0fddc-8130-45f7-915f-456d3db43612 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:14.781028 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e60dc9a4-4bd1-44e7-a63d-cab26ba78123 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:14.809309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e60dc9a4-4bd1-44e7-a63d-cab26ba78123 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:14.814460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e60dc9a4-4bd1-44e7-a63d-cab26ba78123 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:14.818692 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e60dc9a4-4bd1-44e7-a63d-cab26ba78123 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.430377 Sep 07 12:53:14.819660 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2273/4500] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:14 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:14.839670 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7dac11f6-6460-4504-b424-02c896cf6cc1 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:14.844035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7dac11f6-6460-4504-b424-02c896cf6cc1 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:14.846628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-27e0fddc-8130-45f7-915f-456d3db43612 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:53:14.868990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7dac11f6-6460-4504-b424-02c896cf6cc1 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:14.884273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7dac11f6-6460-4504-b424-02c896cf6cc1 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:14.884933 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7dac11f6-6460-4504-b424-02c896cf6cc1 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:14.886176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7dac11f6-6460-4504-b424-02c896cf6cc1 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:14.886983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7dac11f6-6460-4504-b424-02c896cf6cc1 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:14.887703 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7dac11f6-6460-4504-b424-02c896cf6cc1 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:15.081091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7dac11f6-6460-4504-b424-02c896cf6cc1 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:15.096985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7dac11f6-6460-4504-b424-02c896cf6cc1 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:15.102287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7dac11f6-6460-4504-b424-02c896cf6cc1 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:15.111273 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7dac11f6-6460-4504-b424-02c896cf6cc1 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1366 microversion: 2.47 time: 0.284565 Sep 07 12:53:15.112608 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2274/4501] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:14 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:15.125615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ee6b4b4-595a-4d1b-8eae-384da2dc7c91 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:15.126931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8ee6b4b4-595a-4d1b-8eae-384da2dc7c91 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:15.151273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ee6b4b4-595a-4d1b-8eae-384da2dc7c91 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:15.152075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ee6b4b4-595a-4d1b-8eae-384da2dc7c91 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:15.152908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ee6b4b4-595a-4d1b-8eae-384da2dc7c91 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:15.153680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ee6b4b4-595a-4d1b-8eae-384da2dc7c91 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:15.154141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ee6b4b4-595a-4d1b-8eae-384da2dc7c91 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:15.154737 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ee6b4b4-595a-4d1b-8eae-384da2dc7c91 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:15.154980 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-27e0fddc-8130-45f7-915f-456d3db43612 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 204 len: 0 microversion: 2.1 time: 0.474426 Sep 07 12:53:15.156713 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2228/4502] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:53:14 2022] DELETE /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:15.175545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-49b5918c-12ec-4339-9537-85a72158c200 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:15.176978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-49b5918c-12ec-4339-9537-85a72158c200 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:15.190806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49b5918c-12ec-4339-9537-85a72158c200 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:15.192084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49b5918c-12ec-4339-9537-85a72158c200 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:15.193264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49b5918c-12ec-4339-9537-85a72158c200 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:15.198473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49b5918c-12ec-4339-9537-85a72158c200 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:15.199760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49b5918c-12ec-4339-9537-85a72158c200 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:15.208637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49b5918c-12ec-4339-9537-85a72158c200 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:15.485451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8ee6b4b4-595a-4d1b-8eae-384da2dc7c91 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:15.500141 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8ee6b4b4-595a-4d1b-8eae-384da2dc7c91 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.386178 Sep 07 12:53:15.503530 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2275/4503] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:15 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:15.521338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-27d376a5-311e-4e2a-96eb-87fbdc645e26 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:15.526914 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-27d376a5-311e-4e2a-96eb-87fbdc645e26 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:15.555122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27d376a5-311e-4e2a-96eb-87fbdc645e26 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:15.560652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27d376a5-311e-4e2a-96eb-87fbdc645e26 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:15.561826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27d376a5-311e-4e2a-96eb-87fbdc645e26 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:15.563152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27d376a5-311e-4e2a-96eb-87fbdc645e26 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:15.563970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27d376a5-311e-4e2a-96eb-87fbdc645e26 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:15.571504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27d376a5-311e-4e2a-96eb-87fbdc645e26 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:16.073817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-49b5918c-12ec-4339-9537-85a72158c200 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:16.089905 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-49b5918c-12ec-4339-9537-85a72158c200 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1527 microversion: 2.1 time: 0.923488 Sep 07 12:53:16.101516 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2229/4504] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:15 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1527 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:16.101516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-4071ff73-5453-4802-840d-e92b226e6633 req-fd099e7f-0154-4e9a-a206-1b70b3c92046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860", "name": "network-vif-plugged", "status": "completed", "tag": "01afecc6-db9f-4ad9-84b4-c7038640dcd0"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:53:16.120030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4071ff73-5453-4802-840d-e92b226e6633 req-fd099e7f-0154-4e9a-a206-1b70b3c92046 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:16.121366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4071ff73-5453-4802-840d-e92b226e6633 req-fd099e7f-0154-4e9a-a206-1b70b3c92046 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:16.122222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4071ff73-5453-4802-840d-e92b226e6633 req-fd099e7f-0154-4e9a-a206-1b70b3c92046 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:16.146593 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-4071ff73-5453-4802-840d-e92b226e6633 req-fd099e7f-0154-4e9a-a206-1b70b3c92046 service nova] Creating event network-vif-plugged:01afecc6-db9f-4ad9-84b4-c7038640dcd0 for instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 on n-h1-852087-9 Sep 07 12:53:16.156723 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-4071ff73-5453-4802-840d-e92b226e6633 req-fd099e7f-0154-4e9a-a206-1b70b3c92046 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062878 Sep 07 12:53:16.158285 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2230/4505] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:53:16.169399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-26eae5bc-53e2-4f11-a297-db62144ae6c8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:16.171165 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-26eae5bc-53e2-4f11-a297-db62144ae6c8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:16.184051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:16.188520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26eae5bc-53e2-4f11-a297-db62144ae6c8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:16.189348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26eae5bc-53e2-4f11-a297-db62144ae6c8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:16.190050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26eae5bc-53e2-4f11-a297-db62144ae6c8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:16.191200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26eae5bc-53e2-4f11-a297-db62144ae6c8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:16.192128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26eae5bc-53e2-4f11-a297-db62144ae6c8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:16.192908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26eae5bc-53e2-4f11-a297-db62144ae6c8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:16.224970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-27d376a5-311e-4e2a-96eb-87fbdc645e26 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:16.242450 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-27d376a5-311e-4e2a-96eb-87fbdc645e26 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:16.247168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-27d376a5-311e-4e2a-96eb-87fbdc645e26 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:16.250406 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-27d376a5-311e-4e2a-96eb-87fbdc645e26 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1604 microversion: 2.42 time: 0.743932 Sep 07 12:53:16.252434 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2276/4506] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:15 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1604 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:16.270949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e8fe261a-7ee6-4694-b0a6-15f7d5c1878c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:16.275716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e8fe261a-7ee6-4694-b0a6-15f7d5c1878c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:16.295596 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8fe261a-7ee6-4694-b0a6-15f7d5c1878c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:16.296125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8fe261a-7ee6-4694-b0a6-15f7d5c1878c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:16.296617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8fe261a-7ee6-4694-b0a6-15f7d5c1878c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:16.297472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8fe261a-7ee6-4694-b0a6-15f7d5c1878c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:16.297989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8fe261a-7ee6-4694-b0a6-15f7d5c1878c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:16.298430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8fe261a-7ee6-4694-b0a6-15f7d5c1878c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:16.480882 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e8fe261a-7ee6-4694-b0a6-15f7d5c1878c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:16.502171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e8fe261a-7ee6-4694-b0a6-15f7d5c1878c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:16.507414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e8fe261a-7ee6-4694-b0a6-15f7d5c1878c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:16.511495 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e8fe261a-7ee6-4694-b0a6-15f7d5c1878c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1366 microversion: 2.47 time: 0.255512 Sep 07 12:53:16.526998 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2277/4507] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:16 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:16.546148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-26eae5bc-53e2-4f11-a297-db62144ae6c8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:16.550986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f68b7c92-aaf2-449c-a230-3ef2a1a371c7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:16.552095 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f68b7c92-aaf2-449c-a230-3ef2a1a371c7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:16.559811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f68b7c92-aaf2-449c-a230-3ef2a1a371c7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:16.560467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f68b7c92-aaf2-449c-a230-3ef2a1a371c7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:16.560928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f68b7c92-aaf2-449c-a230-3ef2a1a371c7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:16.561881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f68b7c92-aaf2-449c-a230-3ef2a1a371c7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:16.562358 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f68b7c92-aaf2-449c-a230-3ef2a1a371c7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:16.563655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f68b7c92-aaf2-449c-a230-3ef2a1a371c7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:16.581557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-26eae5bc-53e2-4f11-a297-db62144ae6c8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:16.594692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-26eae5bc-53e2-4f11-a297-db62144ae6c8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:16.599402 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-26eae5bc-53e2-4f11-a297-db62144ae6c8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.437894 Sep 07 12:53:16.601047 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2231/4508] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:16 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:16.855499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f68b7c92-aaf2-449c-a230-3ef2a1a371c7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:16.888687 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f68b7c92-aaf2-449c-a230-3ef2a1a371c7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.342227 Sep 07 12:53:16.902335 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2278/4509] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:16 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:17.130926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dc6d97c3-7b3a-4f42-a96b-077ba2fe3650 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:17.131797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dc6d97c3-7b3a-4f42-a96b-077ba2fe3650 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:17.138933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc6d97c3-7b3a-4f42-a96b-077ba2fe3650 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:17.139448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc6d97c3-7b3a-4f42-a96b-077ba2fe3650 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:17.139907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc6d97c3-7b3a-4f42-a96b-077ba2fe3650 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:17.140949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc6d97c3-7b3a-4f42-a96b-077ba2fe3650 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:17.141385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc6d97c3-7b3a-4f42-a96b-077ba2fe3650 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:17.141834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc6d97c3-7b3a-4f42-a96b-077ba2fe3650 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:17.300449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8a59f252-6618-442c-a548-be0cd5655a85 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:17.302051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8a59f252-6618-442c-a548-be0cd5655a85 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:17.310389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a59f252-6618-442c-a548-be0cd5655a85 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:17.311185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a59f252-6618-442c-a548-be0cd5655a85 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:17.311803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a59f252-6618-442c-a548-be0cd5655a85 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:17.312975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a59f252-6618-442c-a548-be0cd5655a85 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:17.313686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a59f252-6618-442c-a548-be0cd5655a85 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:17.314286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a59f252-6618-442c-a548-be0cd5655a85 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:17.352327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dc6d97c3-7b3a-4f42-a96b-077ba2fe3650 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:17.357993 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dc6d97c3-7b3a-4f42-a96b-077ba2fe3650 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1527 microversion: 2.1 time: 0.230293 Sep 07 12:53:17.377700 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2232/4510] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:17 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1527 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:17.495958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8a59f252-6618-442c-a548-be0cd5655a85 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:17.525355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8a59f252-6618-442c-a548-be0cd5655a85 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:17.529878 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8a59f252-6618-442c-a548-be0cd5655a85 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:17.531537 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8a59f252-6618-442c-a548-be0cd5655a85 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1604 microversion: 2.42 time: 0.236506 Sep 07 12:53:17.532712 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2279/4511] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:17 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1604 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:17.565618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7125ef61-54d4-4c9f-8912-35b134fbdd24 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:17.566752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7125ef61-54d4-4c9f-8912-35b134fbdd24 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:17.590461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7125ef61-54d4-4c9f-8912-35b134fbdd24 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:17.593982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7125ef61-54d4-4c9f-8912-35b134fbdd24 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:17.594650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7125ef61-54d4-4c9f-8912-35b134fbdd24 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:17.602864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7125ef61-54d4-4c9f-8912-35b134fbdd24 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:17.603399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7125ef61-54d4-4c9f-8912-35b134fbdd24 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:17.603945 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7125ef61-54d4-4c9f-8912-35b134fbdd24 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:17.641788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-72db7d7b-7b9f-4e29-9012-394346294c2f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:17.650027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-72db7d7b-7b9f-4e29-9012-394346294c2f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:17.663791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72db7d7b-7b9f-4e29-9012-394346294c2f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:17.664394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72db7d7b-7b9f-4e29-9012-394346294c2f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:17.664934 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72db7d7b-7b9f-4e29-9012-394346294c2f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:17.665819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72db7d7b-7b9f-4e29-9012-394346294c2f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:17.672661 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72db7d7b-7b9f-4e29-9012-394346294c2f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:17.673287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72db7d7b-7b9f-4e29-9012-394346294c2f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:17.763080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7125ef61-54d4-4c9f-8912-35b134fbdd24 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:17.807111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7125ef61-54d4-4c9f-8912-35b134fbdd24 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:17.809024 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7125ef61-54d4-4c9f-8912-35b134fbdd24 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:17.810478 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7125ef61-54d4-4c9f-8912-35b134fbdd24 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1366 microversion: 2.47 time: 0.252882 Sep 07 12:53:17.811516 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2233/4512] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:17 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:17.944671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-78cb1c55-c920-4ed0-a495-8d9ec9ccac91 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:17.950669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-78cb1c55-c920-4ed0-a495-8d9ec9ccac91 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:17.984529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78cb1c55-c920-4ed0-a495-8d9ec9ccac91 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:17.986035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78cb1c55-c920-4ed0-a495-8d9ec9ccac91 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:17.988608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78cb1c55-c920-4ed0-a495-8d9ec9ccac91 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:17.991734 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78cb1c55-c920-4ed0-a495-8d9ec9ccac91 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:17.996595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78cb1c55-c920-4ed0-a495-8d9ec9ccac91 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:17.998254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78cb1c55-c920-4ed0-a495-8d9ec9ccac91 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:18.048758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-72db7d7b-7b9f-4e29-9012-394346294c2f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:18.074779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-72db7d7b-7b9f-4e29-9012-394346294c2f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:18.079366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-72db7d7b-7b9f-4e29-9012-394346294c2f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:18.083796 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-72db7d7b-7b9f-4e29-9012-394346294c2f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.446584 Sep 07 12:53:18.086820 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2280/4513] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:17 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:53:18.342517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-78cb1c55-c920-4ed0-a495-8d9ec9ccac91 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:18.354984 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-78cb1c55-c920-4ed0-a495-8d9ec9ccac91 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.434069 Sep 07 12:53:18.369520 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2234/4514] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:17 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:18.386348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9e98e978-308a-4194-b51e-437cc8b8a37a tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:18.387424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9e98e978-308a-4194-b51e-437cc8b8a37a tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:18.401772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e98e978-308a-4194-b51e-437cc8b8a37a tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:18.403431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e98e978-308a-4194-b51e-437cc8b8a37a tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:18.404869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e98e978-308a-4194-b51e-437cc8b8a37a tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:18.407187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e98e978-308a-4194-b51e-437cc8b8a37a tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:18.408526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e98e978-308a-4194-b51e-437cc8b8a37a tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:18.409659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e98e978-308a-4194-b51e-437cc8b8a37a tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:18.590515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-40e1df83-4dde-46a2-b231-6e126f9c25ba tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:18.591717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-40e1df83-4dde-46a2-b231-6e126f9c25ba tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:18.616198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40e1df83-4dde-46a2-b231-6e126f9c25ba tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:18.624242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40e1df83-4dde-46a2-b231-6e126f9c25ba tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:18.630535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40e1df83-4dde-46a2-b231-6e126f9c25ba tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:18.632999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40e1df83-4dde-46a2-b231-6e126f9c25ba tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:18.634219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40e1df83-4dde-46a2-b231-6e126f9c25ba tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:18.635233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40e1df83-4dde-46a2-b231-6e126f9c25ba tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:18.775315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-40e1df83-4dde-46a2-b231-6e126f9c25ba tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:18.783527 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9e98e978-308a-4194-b51e-437cc8b8a37a tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:18.800995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-40e1df83-4dde-46a2-b231-6e126f9c25ba tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:18.804391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-40e1df83-4dde-46a2-b231-6e126f9c25ba tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:18.807512 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-40e1df83-4dde-46a2-b231-6e126f9c25ba tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1604 microversion: 2.42 time: 0.228688 Sep 07 12:53:18.826523 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2235/4515] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:18 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1604 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:18.829679 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9e98e978-308a-4194-b51e-437cc8b8a37a tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1527 microversion: 2.1 time: 0.433281 Sep 07 12:53:18.831229 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2281/4516] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:18 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1527 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:18.855441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b369743e-8cad-40ba-a026-e2658a94dd2a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:18.856074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b369743e-8cad-40ba-a026-e2658a94dd2a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:18.867882 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b369743e-8cad-40ba-a026-e2658a94dd2a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:18.868468 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b369743e-8cad-40ba-a026-e2658a94dd2a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:18.868950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b369743e-8cad-40ba-a026-e2658a94dd2a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:18.869760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b369743e-8cad-40ba-a026-e2658a94dd2a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:18.870246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b369743e-8cad-40ba-a026-e2658a94dd2a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:18.870720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b369743e-8cad-40ba-a026-e2658a94dd2a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:18.962368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b369743e-8cad-40ba-a026-e2658a94dd2a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:18.976655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b369743e-8cad-40ba-a026-e2658a94dd2a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:18.979242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b369743e-8cad-40ba-a026-e2658a94dd2a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:18.981443 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b369743e-8cad-40ba-a026-e2658a94dd2a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1366 microversion: 2.47 time: 0.129879 Sep 07 12:53:18.996993 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2236/4517] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:18 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:19.112351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3c8de8c-0b13-4142-bb1c-2ac9820ffd11 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:19.113054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d3c8de8c-0b13-4142-bb1c-2ac9820ffd11 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:19.120929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3c8de8c-0b13-4142-bb1c-2ac9820ffd11 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:19.121590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3c8de8c-0b13-4142-bb1c-2ac9820ffd11 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:19.122137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3c8de8c-0b13-4142-bb1c-2ac9820ffd11 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:19.122983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3c8de8c-0b13-4142-bb1c-2ac9820ffd11 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:19.123548 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3c8de8c-0b13-4142-bb1c-2ac9820ffd11 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:19.124140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3c8de8c-0b13-4142-bb1c-2ac9820ffd11 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:19.402972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d3c8de8c-0b13-4142-bb1c-2ac9820ffd11 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:19.417141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d3c8de8c-0b13-4142-bb1c-2ac9820ffd11 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:19.420139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d3c8de8c-0b13-4142-bb1c-2ac9820ffd11 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:19.421850 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d3c8de8c-0b13-4142-bb1c-2ac9820ffd11 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.313979 Sep 07 12:53:19.422199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d862e93-0792-4307-9f5d-42e3bf37cb53 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:19.423254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1d862e93-0792-4307-9f5d-42e3bf37cb53 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:19.424290 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2282/4518] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:19 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:19.434142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d862e93-0792-4307-9f5d-42e3bf37cb53 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:19.435490 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d862e93-0792-4307-9f5d-42e3bf37cb53 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:19.436461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d862e93-0792-4307-9f5d-42e3bf37cb53 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:19.437884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d862e93-0792-4307-9f5d-42e3bf37cb53 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:19.438725 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d862e93-0792-4307-9f5d-42e3bf37cb53 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:19.439421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d862e93-0792-4307-9f5d-42e3bf37cb53 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:19.641709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1d862e93-0792-4307-9f5d-42e3bf37cb53 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:19.651761 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1d862e93-0792-4307-9f5d-42e3bf37cb53 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.236563 Sep 07 12:53:19.656741 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2237/4519] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:19 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:19.851957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c724d0b-a401-4a82-a545-5e7f620fee1b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:19.853181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7c724d0b-a401-4a82-a545-5e7f620fee1b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:19.861120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c724d0b-a401-4a82-a545-5e7f620fee1b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:19.862028 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c724d0b-a401-4a82-a545-5e7f620fee1b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:19.862737 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c724d0b-a401-4a82-a545-5e7f620fee1b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:19.863656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c724d0b-a401-4a82-a545-5e7f620fee1b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:19.864309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c724d0b-a401-4a82-a545-5e7f620fee1b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:19.865136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c724d0b-a401-4a82-a545-5e7f620fee1b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:19.869526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1e1e760e-86bb-4640-9c89-7bd7fa264376 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:19.873103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1e1e760e-86bb-4640-9c89-7bd7fa264376 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:19.929047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e1e760e-86bb-4640-9c89-7bd7fa264376 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:19.930142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e1e760e-86bb-4640-9c89-7bd7fa264376 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:19.931235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e1e760e-86bb-4640-9c89-7bd7fa264376 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:19.931796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c724d0b-a401-4a82-a545-5e7f620fee1b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:19.932732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e1e760e-86bb-4640-9c89-7bd7fa264376 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:19.933061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c724d0b-a401-4a82-a545-5e7f620fee1b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:19.933794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c724d0b-a401-4a82-a545-5e7f620fee1b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:19.934487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-7c724d0b-a401-4a82-a545-5e7f620fee1b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lazy-loading 'fault' on Instance uuid f90d70b2-052c-4840-8008-9d9b2b08772a {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:53:19.944408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e1e760e-86bb-4640-9c89-7bd7fa264376 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:19.945414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e1e760e-86bb-4640-9c89-7bd7fa264376 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:19.988656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7c724d0b-a401-4a82-a545-5e7f620fee1b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:20.005601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7c724d0b-a401-4a82-a545-5e7f620fee1b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:20.007860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7c724d0b-a401-4a82-a545-5e7f620fee1b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ca81088a7ce4c3fafc90d36c07711ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0713651a514386bcf37ee6cc3d8e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:20.009586 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7c724d0b-a401-4a82-a545-5e7f620fee1b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 200 len: 1609 microversion: 2.42 time: 0.163040 Sep 07 12:53:20.010812 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2283/4520] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:19 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 1609 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:20.031516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-41f49518-8eae-4fc0-a2da-0f4c9069935b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:20.037939 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-41f49518-8eae-4fc0-a2da-0f4c9069935b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:20.060964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41f49518-8eae-4fc0-a2da-0f4c9069935b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:20.061782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41f49518-8eae-4fc0-a2da-0f4c9069935b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:20.075518 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41f49518-8eae-4fc0-a2da-0f4c9069935b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:20.076569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41f49518-8eae-4fc0-a2da-0f4c9069935b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:20.077087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41f49518-8eae-4fc0-a2da-0f4c9069935b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:20.077577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41f49518-8eae-4fc0-a2da-0f4c9069935b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:20.226764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-41f49518-8eae-4fc0-a2da-0f4c9069935b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:20.244721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-41f49518-8eae-4fc0-a2da-0f4c9069935b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:20.246532 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-41f49518-8eae-4fc0-a2da-0f4c9069935b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:20.247847 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-41f49518-8eae-4fc0-a2da-0f4c9069935b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1366 microversion: 2.47 time: 0.222224 Sep 07 12:53:20.257933 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2284/4521] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:20 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:20.381236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1e1e760e-86bb-4640-9c89-7bd7fa264376 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:20.396162 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1e1e760e-86bb-4640-9c89-7bd7fa264376 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1527 microversion: 2.1 time: 0.542595 Sep 07 12:53:20.396967 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2238/4522] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:19 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1527 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:20.455531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-97c932e0-b534-4d19-a539-d3257cc649ca tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:20.456168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-97c932e0-b534-4d19-a539-d3257cc649ca tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:20.462738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97c932e0-b534-4d19-a539-d3257cc649ca tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:20.463235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97c932e0-b534-4d19-a539-d3257cc649ca tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:20.463678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97c932e0-b534-4d19-a539-d3257cc649ca tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:20.464391 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97c932e0-b534-4d19-a539-d3257cc649ca tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:20.464863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97c932e0-b534-4d19-a539-d3257cc649ca tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:20.465283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97c932e0-b534-4d19-a539-d3257cc649ca tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:20.682290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-97c932e0-b534-4d19-a539-d3257cc649ca tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:20.700481 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-97c932e0-b534-4d19-a539-d3257cc649ca tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:20.704074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d611a658-a8c2-4420-8c72-d7c5c3943847 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:20.706956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d611a658-a8c2-4420-8c72-d7c5c3943847 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:20.717926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-97c932e0-b534-4d19-a539-d3257cc649ca tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:20.720279 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-97c932e0-b534-4d19-a539-d3257cc649ca tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.268839 Sep 07 12:53:20.721651 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2285/4523] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:20 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:20.760546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d611a658-a8c2-4420-8c72-d7c5c3943847 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:20.761424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d611a658-a8c2-4420-8c72-d7c5c3943847 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:20.762243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d611a658-a8c2-4420-8c72-d7c5c3943847 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:20.764028 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d611a658-a8c2-4420-8c72-d7c5c3943847 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:20.764831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d611a658-a8c2-4420-8c72-d7c5c3943847 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:20.765622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d611a658-a8c2-4420-8c72-d7c5c3943847 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:21.089444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f9aee5a6-4328-4b89-b6fa-6ffc2b9f683e tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:21.091019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f9aee5a6-4328-4b89-b6fa-6ffc2b9f683e tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:21.105642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9aee5a6-4328-4b89-b6fa-6ffc2b9f683e tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:21.106766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9aee5a6-4328-4b89-b6fa-6ffc2b9f683e tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:21.107722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9aee5a6-4328-4b89-b6fa-6ffc2b9f683e tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:21.110611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9aee5a6-4328-4b89-b6fa-6ffc2b9f683e tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:21.111619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9aee5a6-4328-4b89-b6fa-6ffc2b9f683e tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:21.112517 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f9aee5a6-4328-4b89-b6fa-6ffc2b9f683e tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:21.119373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d611a658-a8c2-4420-8c72-d7c5c3943847 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:21.133766 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d611a658-a8c2-4420-8c72-d7c5c3943847 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.441385 Sep 07 12:53:21.134894 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2239/4524] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:20 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-f9aee5a6-4328-4b89-b6fa-6ffc2b9f683e tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] HTTP exception thrown: Instance f90d70b2-052c-4840-8008-9d9b2b08772a could not be found. Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f9aee5a6-4328-4b89-b6fa-6ffc2b9f683e tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Request method failure captured: Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a HTTP/1.1 Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJJeMgj-NYp10xiddesrUhyVDDUhvhZSNwB9hbaLLyOLu2WTItPdJSQFZ-LWBQ4Deu497a01soTpY1tp3FvoYf7obxdHD0LcMRecp4f9-lNHjZpwsPhoSM8S5HD899opI8RX2cQNaWP4dI1Z2qDNfNk3ETIn_IQ9CRucvszwcju7kM0 Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.42 Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 9a0713651a514386bcf37ee6cc3d8e2f Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2121279622 Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9a0713651a514386bcf37ee6cc3d8e2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9a0713651a514386bcf37ee6cc3d8e2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9a0713651a514386bcf37ee6cc3d8e2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9a0713651a514386bcf37ee6cc3d8e2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2121279622 Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 9a0713651a514386bcf37ee6cc3d8e2f Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2121279622 Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TaggedBootDevicesTest_v242-2121279622-project Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 3ca81088a7ce4c3fafc90d36c07711ff Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2121279622-project Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance f90d70b2-052c-4840-8008-9d9b2b08772a could not be found. Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'f90d70b2-052c-4840-8008-9d9b2b08772a'} Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f90d70b2-052c-4840-8008-9d9b2b08772a could not be found. Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:53:21.153859 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:53:21.162667 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:53:21.162667 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f90d70b2-052c-4840-8008-9d9b2b08772a could not be found. Sep 07 12:53:21.162667 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:21.162667 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:21.162667 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:21.162667 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:21.162667 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:21.162667 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:21.162667 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:53:21.162667 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:53:21.162667 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f90d70b2-052c-4840-8008-9d9b2b08772a could not be found. Sep 07 12:53:21.162667 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:21.162667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f9aee5a6-4328-4b89-b6fa-6ffc2b9f683e tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Returning 404 to user: Instance f90d70b2-052c-4840-8008-9d9b2b08772a could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:53:21.162667 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f9aee5a6-4328-4b89-b6fa-6ffc2b9f683e tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 404 len: 111 microversion: 2.42 time: 0.082720 Sep 07 12:53:21.162667 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2286/4525] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:21 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 07 12:53:21.172328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-23bfb0f4-28cc-44e7-90d6-2726d4482c5b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '.version_select at 0x7fc41d28eaf0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:21.208125 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-23bfb0f4-28cc-44e7-90d6-2726d4482c5b tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-617594435" status: 204 len: 0 microversion: 2.42 time: 0.052024 Sep 07 12:53:21.209358 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2240/4526] 10.222.0.16 () {60 vars in 1259 bytes} [Wed Sep 7 12:53:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-617594435 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:53:21.279846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bb224b15-66c5-40ca-b47f-a4c99a1a3e17 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:21.280470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bb224b15-66c5-40ca-b47f-a4c99a1a3e17 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:21.287206 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb224b15-66c5-40ca-b47f-a4c99a1a3e17 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:21.287745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb224b15-66c5-40ca-b47f-a4c99a1a3e17 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:21.288565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb224b15-66c5-40ca-b47f-a4c99a1a3e17 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:21.289683 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb224b15-66c5-40ca-b47f-a4c99a1a3e17 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:21.290393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb224b15-66c5-40ca-b47f-a4c99a1a3e17 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:21.291042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb224b15-66c5-40ca-b47f-a4c99a1a3e17 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:21.373958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bb224b15-66c5-40ca-b47f-a4c99a1a3e17 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:21.397040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bb224b15-66c5-40ca-b47f-a4c99a1a3e17 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:21.400947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bb224b15-66c5-40ca-b47f-a4c99a1a3e17 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:21.404414 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bb224b15-66c5-40ca-b47f-a4c99a1a3e17 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1366 microversion: 2.47 time: 0.128373 Sep 07 12:53:21.405940 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2287/4527] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:21 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1366 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:53:21.426326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dc755339-d074-4445-8fef-212190a06bd0 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:21.430161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dc755339-d074-4445-8fef-212190a06bd0 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:21.451645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc755339-d074-4445-8fef-212190a06bd0 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:21.452132 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc755339-d074-4445-8fef-212190a06bd0 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:21.463308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc755339-d074-4445-8fef-212190a06bd0 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:21.465419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc755339-d074-4445-8fef-212190a06bd0 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:21.466838 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc755339-d074-4445-8fef-212190a06bd0 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:21.485477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc755339-d074-4445-8fef-212190a06bd0 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:21.514914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:21.771211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ee32cc9b-bd24-4290-aa43-67ae02032dac tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:21.772398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dc755339-d074-4445-8fef-212190a06bd0 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:21.773018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ee32cc9b-bd24-4290-aa43-67ae02032dac tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:21.779103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee32cc9b-bd24-4290-aa43-67ae02032dac tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:21.779948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee32cc9b-bd24-4290-aa43-67ae02032dac tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:21.780484 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee32cc9b-bd24-4290-aa43-67ae02032dac tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:21.781294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee32cc9b-bd24-4290-aa43-67ae02032dac tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:21.781940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee32cc9b-bd24-4290-aa43-67ae02032dac tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:21.782448 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee32cc9b-bd24-4290-aa43-67ae02032dac tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:21.786666 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dc755339-d074-4445-8fef-212190a06bd0 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1527 microversion: 2.1 time: 0.368557 Sep 07 12:53:21.788077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:21.802361 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2241/4528] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:21 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1527 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:22.085380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ee32cc9b-bd24-4290-aa43-67ae02032dac tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:22.113960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ee32cc9b-bd24-4290-aa43-67ae02032dac tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:22.116243 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ee32cc9b-bd24-4290-aa43-67ae02032dac tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:22.117678 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ee32cc9b-bd24-4290-aa43-67ae02032dac tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.350821 Sep 07 12:53:22.121607 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2288/4529] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:21 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:22.130930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-36e76993-5d6b-49dd-9b64-d7881bb12ad8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:22.131428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-36e76993-5d6b-49dd-9b64-d7881bb12ad8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:22.151595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36e76993-5d6b-49dd-9b64-d7881bb12ad8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:22.153162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36e76993-5d6b-49dd-9b64-d7881bb12ad8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:22.154571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36e76993-5d6b-49dd-9b64-d7881bb12ad8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:22.156528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36e76993-5d6b-49dd-9b64-d7881bb12ad8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:22.157986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36e76993-5d6b-49dd-9b64-d7881bb12ad8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:22.158759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36e76993-5d6b-49dd-9b64-d7881bb12ad8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:22.180046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b1881964-5cd9-4854-95c9-097e583fd02f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:22.190166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b1881964-5cd9-4854-95c9-097e583fd02f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:22.201918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1881964-5cd9-4854-95c9-097e583fd02f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:22.202793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1881964-5cd9-4854-95c9-097e583fd02f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:22.203632 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1881964-5cd9-4854-95c9-097e583fd02f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:22.204991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1881964-5cd9-4854-95c9-097e583fd02f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:22.205889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1881964-5cd9-4854-95c9-097e583fd02f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:22.206642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1881964-5cd9-4854-95c9-097e583fd02f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:22.371812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-36e76993-5d6b-49dd-9b64-d7881bb12ad8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lazy-loading 'services' on Instance uuid 4b52328c-937b-46cf-abdf-8629194fc25c {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:53:22.541645 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b1881964-5cd9-4854-95c9-097e583fd02f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:22.564865 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b1881964-5cd9-4854-95c9-097e583fd02f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.393397 Sep 07 12:53:22.569817 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2289/4530] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:22 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:22.581995 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-36e76993-5d6b-49dd-9b64-d7881bb12ad8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments/d0796098-a0c7-4c63-abf5-469004cdf31a" status: 202 len: 0 microversion: 2.1 time: 0.450855 Sep 07 12:53:22.585469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4709c859-edfe-4ba0-8ed0-72c328ec3b13 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:22.586789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4709c859-edfe-4ba0-8ed0-72c328ec3b13 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:22.586998 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2242/4531] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Sep 7 12:53:22 2022] DELETE /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments/d0796098-a0c7-4c63-abf5-469004cdf31a => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:53:22.596201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4709c859-edfe-4ba0-8ed0-72c328ec3b13 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:22.597086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4709c859-edfe-4ba0-8ed0-72c328ec3b13 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:22.597795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4709c859-edfe-4ba0-8ed0-72c328ec3b13 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:22.598795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4709c859-edfe-4ba0-8ed0-72c328ec3b13 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:22.599498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4709c859-edfe-4ba0-8ed0-72c328ec3b13 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:22.600138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4709c859-edfe-4ba0-8ed0-72c328ec3b13 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:22.622615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2d4527ca-7938-41f4-8ef6-d75d6708e7db tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:22.630789 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2d4527ca-7938-41f4-8ef6-d75d6708e7db tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:22.646920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d4527ca-7938-41f4-8ef6-d75d6708e7db tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:22.648607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d4527ca-7938-41f4-8ef6-d75d6708e7db tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:22.650117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d4527ca-7938-41f4-8ef6-d75d6708e7db tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:22.651869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d4527ca-7938-41f4-8ef6-d75d6708e7db tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:22.652817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d4527ca-7938-41f4-8ef6-d75d6708e7db tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:22.653854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d4527ca-7938-41f4-8ef6-d75d6708e7db tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:22.722379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4709c859-edfe-4ba0-8ed0-72c328ec3b13 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:22.741155 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4709c859-edfe-4ba0-8ed0-72c328ec3b13 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:22.743049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4709c859-edfe-4ba0-8ed0-72c328ec3b13 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:22.744963 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4709c859-edfe-4ba0-8ed0-72c328ec3b13 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1366 microversion: 2.47 time: 0.172154 Sep 07 12:53:22.752042 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2290/4532] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:22 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:22.765907 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2d4527ca-7938-41f4-8ef6-d75d6708e7db tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172114 Sep 07 12:53:22.767994 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2243/4533] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:53:22 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:53:22.823122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-467dc3fe-7647-42dc-82e9-dfd77d2cf354 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:22.825165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-467dc3fe-7647-42dc-82e9-dfd77d2cf354 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:22.836616 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-467dc3fe-7647-42dc-82e9-dfd77d2cf354 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:22.837935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-467dc3fe-7647-42dc-82e9-dfd77d2cf354 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:22.838987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-467dc3fe-7647-42dc-82e9-dfd77d2cf354 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:22.840612 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-467dc3fe-7647-42dc-82e9-dfd77d2cf354 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:22.841797 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-467dc3fe-7647-42dc-82e9-dfd77d2cf354 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:22.843101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-467dc3fe-7647-42dc-82e9-dfd77d2cf354 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:23.144680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-59964df5-b3c7-47d4-9913-17ee313af808 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:23.145685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-59964df5-b3c7-47d4-9913-17ee313af808 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:23.164217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59964df5-b3c7-47d4-9913-17ee313af808 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:23.164737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59964df5-b3c7-47d4-9913-17ee313af808 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:23.165469 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59964df5-b3c7-47d4-9913-17ee313af808 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:23.166835 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59964df5-b3c7-47d4-9913-17ee313af808 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:23.167410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59964df5-b3c7-47d4-9913-17ee313af808 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:23.167861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59964df5-b3c7-47d4-9913-17ee313af808 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:23.734804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-467dc3fe-7647-42dc-82e9-dfd77d2cf354 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:23.754617 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-467dc3fe-7647-42dc-82e9-dfd77d2cf354 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1527 microversion: 2.1 time: 0.937331 Sep 07 12:53:23.755474 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2291/4534] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:22 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1527 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:23.777865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-106ec013-435c-4b63-ae8e-5b9584bc1c8d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:23.778592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-106ec013-435c-4b63-ae8e-5b9584bc1c8d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:23.786715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-106ec013-435c-4b63-ae8e-5b9584bc1c8d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:23.787593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-106ec013-435c-4b63-ae8e-5b9584bc1c8d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:23.787964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-106ec013-435c-4b63-ae8e-5b9584bc1c8d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:23.788978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-106ec013-435c-4b63-ae8e-5b9584bc1c8d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:23.789609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-106ec013-435c-4b63-ae8e-5b9584bc1c8d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:23.790128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-106ec013-435c-4b63-ae8e-5b9584bc1c8d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:23.816596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-59964df5-b3c7-47d4-9913-17ee313af808 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:23.838385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-59964df5-b3c7-47d4-9913-17ee313af808 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:23.841762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-59964df5-b3c7-47d4-9913-17ee313af808 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:23.844481 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-59964df5-b3c7-47d4-9913-17ee313af808 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.704227 Sep 07 12:53:23.851076 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2244/4535] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:23 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:23.865461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e28b44e9-562c-450c-a732-f1753293ae9d tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:23.866196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e28b44e9-562c-450c-a732-f1753293ae9d tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:23.877175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e28b44e9-562c-450c-a732-f1753293ae9d tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:23.877856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e28b44e9-562c-450c-a732-f1753293ae9d tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:23.878421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e28b44e9-562c-450c-a732-f1753293ae9d tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:23.879303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e28b44e9-562c-450c-a732-f1753293ae9d tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:23.879825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e28b44e9-562c-450c-a732-f1753293ae9d tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:23.880271 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e28b44e9-562c-450c-a732-f1753293ae9d tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:23.998391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e28b44e9-562c-450c-a732-f1753293ae9d tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:24.010689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e28b44e9-562c-450c-a732-f1753293ae9d tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:24.012270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e28b44e9-562c-450c-a732-f1753293ae9d tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:24.013525 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e28b44e9-562c-450c-a732-f1753293ae9d tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1366 microversion: 2.47 time: 0.161235 Sep 07 12:53:24.018396 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2245/4536] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:23 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:24.024726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fd19af77-5dd1-47fe-a4a5-84c2821fb1be tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:24.027332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fd19af77-5dd1-47fe-a4a5-84c2821fb1be tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:24.034682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd19af77-5dd1-47fe-a4a5-84c2821fb1be tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:24.034934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd19af77-5dd1-47fe-a4a5-84c2821fb1be tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:24.035234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd19af77-5dd1-47fe-a4a5-84c2821fb1be tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:24.036100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd19af77-5dd1-47fe-a4a5-84c2821fb1be tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:24.037531 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd19af77-5dd1-47fe-a4a5-84c2821fb1be tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:24.037531 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd19af77-5dd1-47fe-a4a5-84c2821fb1be tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:24.079844 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fd19af77-5dd1-47fe-a4a5-84c2821fb1be tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059302 Sep 07 12:53:24.081336 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2246/4537] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:53:24 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:53:24.129750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-106ec013-435c-4b63-ae8e-5b9584bc1c8d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:24.145298 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-106ec013-435c-4b63-ae8e-5b9584bc1c8d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.373237 Sep 07 12:53:24.146751 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2292/4538] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:23 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:24.783581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-080a734e-ed04-40c8-9f3f-2e1ae61e3e5b tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:24.784818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-080a734e-ed04-40c8-9f3f-2e1ae61e3e5b tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:24.793737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-080a734e-ed04-40c8-9f3f-2e1ae61e3e5b tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:24.794673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-080a734e-ed04-40c8-9f3f-2e1ae61e3e5b tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:24.795506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-080a734e-ed04-40c8-9f3f-2e1ae61e3e5b tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:24.796611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-080a734e-ed04-40c8-9f3f-2e1ae61e3e5b tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:24.797377 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-080a734e-ed04-40c8-9f3f-2e1ae61e3e5b tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:24.798048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-080a734e-ed04-40c8-9f3f-2e1ae61e3e5b tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:24.874714 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1e5023ed-62ae-4179-a21f-c2941c406a5a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:24.875603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1e5023ed-62ae-4179-a21f-c2941c406a5a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:24.907147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e5023ed-62ae-4179-a21f-c2941c406a5a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:24.910932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e5023ed-62ae-4179-a21f-c2941c406a5a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:24.912614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e5023ed-62ae-4179-a21f-c2941c406a5a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:24.914063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e5023ed-62ae-4179-a21f-c2941c406a5a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:24.915001 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e5023ed-62ae-4179-a21f-c2941c406a5a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:24.916153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e5023ed-62ae-4179-a21f-c2941c406a5a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:25.284453 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-080a734e-ed04-40c8-9f3f-2e1ae61e3e5b tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:25.293804 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-080a734e-ed04-40c8-9f3f-2e1ae61e3e5b tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1527 microversion: 2.1 time: 0.514086 Sep 07 12:53:25.295243 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2247/4539] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:24 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1527 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:25.300437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-645eb755-777d-46e9-8c78-ff937ebcd1a0 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:25.301333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-645eb755-777d-46e9-8c78-ff937ebcd1a0 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:25.309358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-645eb755-777d-46e9-8c78-ff937ebcd1a0 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:25.310169 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-645eb755-777d-46e9-8c78-ff937ebcd1a0 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:25.310768 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-645eb755-777d-46e9-8c78-ff937ebcd1a0 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:25.311698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-645eb755-777d-46e9-8c78-ff937ebcd1a0 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:25.312299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-645eb755-777d-46e9-8c78-ff937ebcd1a0 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:25.312871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-645eb755-777d-46e9-8c78-ff937ebcd1a0 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:25.409840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1e5023ed-62ae-4179-a21f-c2941c406a5a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:25.419599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1e5023ed-62ae-4179-a21f-c2941c406a5a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:25.421194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1e5023ed-62ae-4179-a21f-c2941c406a5a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:25.422559 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1e5023ed-62ae-4179-a21f-c2941c406a5a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.554471 Sep 07 12:53:25.423210 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2293/4540] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:24 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:53:25.428407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a822a5fa-4da2-4214-afde-149f6a49efec tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:25.433293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a822a5fa-4da2-4214-afde-149f6a49efec tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:25.440085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a822a5fa-4da2-4214-afde-149f6a49efec tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:25.440613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a822a5fa-4da2-4214-afde-149f6a49efec tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:25.441064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a822a5fa-4da2-4214-afde-149f6a49efec tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:25.441851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a822a5fa-4da2-4214-afde-149f6a49efec tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:25.442326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a822a5fa-4da2-4214-afde-149f6a49efec tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:25.442768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a822a5fa-4da2-4214-afde-149f6a49efec tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:25.465170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-645eb755-777d-46e9-8c78-ff937ebcd1a0 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:25.475621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-645eb755-777d-46e9-8c78-ff937ebcd1a0 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:25.477921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-645eb755-777d-46e9-8c78-ff937ebcd1a0 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:25.478097 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a822a5fa-4da2-4214-afde-149f6a49efec tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053627 Sep 07 12:53:25.478780 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2294/4541] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:53:25 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:53:25.479222 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-645eb755-777d-46e9-8c78-ff937ebcd1a0 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1366 microversion: 2.47 time: 0.182706 Sep 07 12:53:25.479860 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2248/4542] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:25 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:25.484798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d6b7d7fa-ae16-4474-a42d-bc50ee06f62e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:25.485422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d6b7d7fa-ae16-4474-a42d-bc50ee06f62e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:25.492341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6b7d7fa-ae16-4474-a42d-bc50ee06f62e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:25.492858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6b7d7fa-ae16-4474-a42d-bc50ee06f62e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:25.493322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6b7d7fa-ae16-4474-a42d-bc50ee06f62e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:25.494195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6b7d7fa-ae16-4474-a42d-bc50ee06f62e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:25.494711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6b7d7fa-ae16-4474-a42d-bc50ee06f62e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:25.495121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6b7d7fa-ae16-4474-a42d-bc50ee06f62e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:25.768920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d6b7d7fa-ae16-4474-a42d-bc50ee06f62e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:25.783827 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d6b7d7fa-ae16-4474-a42d-bc50ee06f62e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.303864 Sep 07 12:53:25.796470 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2295/4543] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:25 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:26.083628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1a6866fe-229e-4afe-b158-726e27357b39 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:26.084446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1a6866fe-229e-4afe-b158-726e27357b39 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:26.092153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a6866fe-229e-4afe-b158-726e27357b39 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:26.092649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a6866fe-229e-4afe-b158-726e27357b39 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:26.093103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a6866fe-229e-4afe-b158-726e27357b39 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:26.093933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a6866fe-229e-4afe-b158-726e27357b39 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:26.094417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a6866fe-229e-4afe-b158-726e27357b39 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:26.094937 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a6866fe-229e-4afe-b158-726e27357b39 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:26.120081 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-1a6866fe-229e-4afe-b158-726e27357b39 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] HTTP exception thrown: Instance f90d70b2-052c-4840-8008-9d9b2b08772a could not be found. Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1a6866fe-229e-4afe-b158-726e27357b39 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Request method failure captured: Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a HTTP/1.1 Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJJeMgj-NYp10xiddesrUhyVDDUhvhZSNwB9hbaLLyOLu2WTItPdJSQFZ-LWBQ4Deu497a01soTpY1tp3FvoYf7obxdHD0LcMRecp4f9-lNHjZpwsPhoSM8S5HD899opI8RX2cQNaWP4dI1Z2qDNfNk3ETIn_IQ9CRucvszwcju7kM0 Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.42 Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 9a0713651a514386bcf37ee6cc3d8e2f Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2121279622 Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9a0713651a514386bcf37ee6cc3d8e2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9a0713651a514386bcf37ee6cc3d8e2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9a0713651a514386bcf37ee6cc3d8e2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9a0713651a514386bcf37ee6cc3d8e2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2121279622 Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 9a0713651a514386bcf37ee6cc3d8e2f Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2121279622 Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TaggedBootDevicesTest_v242-2121279622-project Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 3ca81088a7ce4c3fafc90d36c07711ff Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2121279622-project Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance f90d70b2-052c-4840-8008-9d9b2b08772a could not be found. Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'f90d70b2-052c-4840-8008-9d9b2b08772a'} Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f90d70b2-052c-4840-8008-9d9b2b08772a could not be found. Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:53:26.123686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:53:26.128373 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f90d70b2-052c-4840-8008-9d9b2b08772a could not be found. Sep 07 12:53:26.128373 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:26.128373 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:26.128373 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:26.128373 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:26.128373 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:26.128373 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:26.128373 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:53:26.128373 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:53:26.128373 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f90d70b2-052c-4840-8008-9d9b2b08772a could not be found. Sep 07 12:53:26.128373 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:26.128373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1a6866fe-229e-4afe-b158-726e27357b39 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Returning 404 to user: Instance f90d70b2-052c-4840-8008-9d9b2b08772a could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:53:26.128373 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1a6866fe-229e-4afe-b158-726e27357b39 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 404 len: 111 microversion: 2.42 time: 0.046455 Sep 07 12:53:26.128373 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2249/4544] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 12:53:26 2022] DELETE /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:53:26.136878 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5640bbf1-1648-41dd-85fe-825985ff85b2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:26.137531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5640bbf1-1648-41dd-85fe-825985ff85b2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] [instance: f90d70b2-052c-4840-8008-9d9b2b08772a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:26.145096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5640bbf1-1648-41dd-85fe-825985ff85b2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:26.145627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5640bbf1-1648-41dd-85fe-825985ff85b2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:26.146071 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5640bbf1-1648-41dd-85fe-825985ff85b2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:26.146790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5640bbf1-1648-41dd-85fe-825985ff85b2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:26.147254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5640bbf1-1648-41dd-85fe-825985ff85b2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:26.147693 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5640bbf1-1648-41dd-85fe-825985ff85b2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:26.167163 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-5640bbf1-1648-41dd-85fe-825985ff85b2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] HTTP exception thrown: Instance f90d70b2-052c-4840-8008-9d9b2b08772a could not be found. Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5640bbf1-1648-41dd-85fe-825985ff85b2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Request method failure captured: Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a HTTP/1.1 Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJJeMgj-NYp10xiddesrUhyVDDUhvhZSNwB9hbaLLyOLu2WTItPdJSQFZ-LWBQ4Deu497a01soTpY1tp3FvoYf7obxdHD0LcMRecp4f9-lNHjZpwsPhoSM8S5HD899opI8RX2cQNaWP4dI1Z2qDNfNk3ETIn_IQ9CRucvszwcju7kM0 Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.42 Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 9a0713651a514386bcf37ee6cc3d8e2f Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2121279622 Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9a0713651a514386bcf37ee6cc3d8e2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9a0713651a514386bcf37ee6cc3d8e2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9a0713651a514386bcf37ee6cc3d8e2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9a0713651a514386bcf37ee6cc3d8e2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2121279622 Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 9a0713651a514386bcf37ee6cc3d8e2f Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2121279622 Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TaggedBootDevicesTest_v242-2121279622-project Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 3ca81088a7ce4c3fafc90d36c07711ff Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2121279622-project Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance f90d70b2-052c-4840-8008-9d9b2b08772a could not be found. Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'f90d70b2-052c-4840-8008-9d9b2b08772a'} Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f90d70b2-052c-4840-8008-9d9b2b08772a could not be found. Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f90d70b2-052c-4840-8008-9d9b2b08772a could not be found. Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:26.168687 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:26.179529 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:26.179529 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:26.179529 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:26.179529 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:26.179529 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:53:26.179529 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:53:26.179529 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f90d70b2-052c-4840-8008-9d9b2b08772a could not be found. Sep 07 12:53:26.179529 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:26.179529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5640bbf1-1648-41dd-85fe-825985ff85b2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] Returning 404 to user: Instance f90d70b2-052c-4840-8008-9d9b2b08772a could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:53:26.179529 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5640bbf1-1648-41dd-85fe-825985ff85b2 tempest-TaggedBootDevicesTest_v242-2121279622 tempest-TaggedBootDevicesTest_v242-2121279622-project] 10.222.0.16 "GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a" status: 404 len: 111 microversion: 2.42 time: 0.037690 Sep 07 12:53:26.179529 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2296/4545] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:26 2022] GET /compute/v2.1/servers/f90d70b2-052c-4840-8008-9d9b2b08772a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:53:26.329061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-486a90b9-c56a-4caa-9ec7-46d4784112c3 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:26.329726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-486a90b9-c56a-4caa-9ec7-46d4784112c3 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:26.340431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-486a90b9-c56a-4caa-9ec7-46d4784112c3 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:26.341448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-486a90b9-c56a-4caa-9ec7-46d4784112c3 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:26.341966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-486a90b9-c56a-4caa-9ec7-46d4784112c3 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:26.342740 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-486a90b9-c56a-4caa-9ec7-46d4784112c3 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:26.343788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-486a90b9-c56a-4caa-9ec7-46d4784112c3 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:26.344227 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-486a90b9-c56a-4caa-9ec7-46d4784112c3 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:26.453103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-63c057d4-32e4-441f-abb1-032e15045eaa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:26.455226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-63c057d4-32e4-441f-abb1-032e15045eaa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:26.466856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63c057d4-32e4-441f-abb1-032e15045eaa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:26.467601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63c057d4-32e4-441f-abb1-032e15045eaa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:26.468253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63c057d4-32e4-441f-abb1-032e15045eaa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:26.469572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63c057d4-32e4-441f-abb1-032e15045eaa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:26.470374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63c057d4-32e4-441f-abb1-032e15045eaa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:26.471039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63c057d4-32e4-441f-abb1-032e15045eaa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:26.789601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-486a90b9-c56a-4caa-9ec7-46d4784112c3 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:26.802676 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-486a90b9-c56a-4caa-9ec7-46d4784112c3 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1527 microversion: 2.1 time: 0.477819 Sep 07 12:53:26.805876 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2250/4546] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:26 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1527 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:26.816131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea4cd260-fb11-4e56-b637-29fcd778fa46 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:26.820954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ea4cd260-fb11-4e56-b637-29fcd778fa46 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:26.834934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea4cd260-fb11-4e56-b637-29fcd778fa46 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:26.836326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea4cd260-fb11-4e56-b637-29fcd778fa46 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:26.837209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea4cd260-fb11-4e56-b637-29fcd778fa46 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:26.838670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea4cd260-fb11-4e56-b637-29fcd778fa46 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:26.839618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea4cd260-fb11-4e56-b637-29fcd778fa46 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:26.840451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea4cd260-fb11-4e56-b637-29fcd778fa46 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:26.909830 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ea4cd260-fb11-4e56-b637-29fcd778fa46 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101500 Sep 07 12:53:26.910843 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2251/4547] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:53:26 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:53:26.919605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-63c057d4-32e4-441f-abb1-032e15045eaa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:26.922054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-deacc8ab-63cf-4fd8-939a-3c1f47c7a630 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:26.923498 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-deacc8ab-63cf-4fd8-939a-3c1f47c7a630 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:26.930297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-63c057d4-32e4-441f-abb1-032e15045eaa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:26.931793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-63c057d4-32e4-441f-abb1-032e15045eaa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:26.933267 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-63c057d4-32e4-441f-abb1-032e15045eaa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.487867 Sep 07 12:53:26.936707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-deacc8ab-63cf-4fd8-939a-3c1f47c7a630 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:26.938479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-deacc8ab-63cf-4fd8-939a-3c1f47c7a630 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:26.939485 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-deacc8ab-63cf-4fd8-939a-3c1f47c7a630 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:26.940995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-deacc8ab-63cf-4fd8-939a-3c1f47c7a630 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:26.942047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-deacc8ab-63cf-4fd8-939a-3c1f47c7a630 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:26.943282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-deacc8ab-63cf-4fd8-939a-3c1f47c7a630 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:26.953663 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2297/4548] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:26 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:26.963994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3599f0fc-2df4-47aa-bf34-7a92e5804a54 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:26.965551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3599f0fc-2df4-47aa-bf34-7a92e5804a54 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:26.978510 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3599f0fc-2df4-47aa-bf34-7a92e5804a54 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:26.980140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3599f0fc-2df4-47aa-bf34-7a92e5804a54 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:26.981158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3599f0fc-2df4-47aa-bf34-7a92e5804a54 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:26.983490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3599f0fc-2df4-47aa-bf34-7a92e5804a54 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:26.984911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3599f0fc-2df4-47aa-bf34-7a92e5804a54 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:26.985912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3599f0fc-2df4-47aa-bf34-7a92e5804a54 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:27.054538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-deacc8ab-63cf-4fd8-939a-3c1f47c7a630 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:27.068011 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-deacc8ab-63cf-4fd8-939a-3c1f47c7a630 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:27.070964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-deacc8ab-63cf-4fd8-939a-3c1f47c7a630 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:27.073297 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-deacc8ab-63cf-4fd8-939a-3c1f47c7a630 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1366 microversion: 2.47 time: 0.159168 Sep 07 12:53:27.074484 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2252/4549] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:26 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:27.303445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3599f0fc-2df4-47aa-bf34-7a92e5804a54 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:27.316914 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3599f0fc-2df4-47aa-bf34-7a92e5804a54 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.361227 Sep 07 12:53:27.331474 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2298/4550] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:26 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:27.843121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ba7b1b30-c4cc-419e-ba75-9fb6dc0299eb tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:27.844245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ba7b1b30-c4cc-419e-ba75-9fb6dc0299eb tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:27.852540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba7b1b30-c4cc-419e-ba75-9fb6dc0299eb tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:27.853052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba7b1b30-c4cc-419e-ba75-9fb6dc0299eb tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:27.853548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba7b1b30-c4cc-419e-ba75-9fb6dc0299eb tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:27.854285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba7b1b30-c4cc-419e-ba75-9fb6dc0299eb tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:27.854755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba7b1b30-c4cc-419e-ba75-9fb6dc0299eb tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:27.855189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba7b1b30-c4cc-419e-ba75-9fb6dc0299eb tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:27.924108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-08d64a2d-8764-4db2-8845-dd219e93439d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:27.927326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-08d64a2d-8764-4db2-8845-dd219e93439d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:27.936664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08d64a2d-8764-4db2-8845-dd219e93439d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:27.937773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08d64a2d-8764-4db2-8845-dd219e93439d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:27.938708 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08d64a2d-8764-4db2-8845-dd219e93439d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:27.939877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08d64a2d-8764-4db2-8845-dd219e93439d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:27.940561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08d64a2d-8764-4db2-8845-dd219e93439d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:27.941178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08d64a2d-8764-4db2-8845-dd219e93439d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:27.985749 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-08d64a2d-8764-4db2-8845-dd219e93439d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065728 Sep 07 12:53:27.993173 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2299/4551] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:53:27 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:53:27.993173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0e01e4bd-9bb4-41aa-bf3a-702016e13d14 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:27.993173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0e01e4bd-9bb4-41aa-bf3a-702016e13d14 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:28.000260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e01e4bd-9bb4-41aa-bf3a-702016e13d14 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:28.000928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e01e4bd-9bb4-41aa-bf3a-702016e13d14 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:28.001413 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e01e4bd-9bb4-41aa-bf3a-702016e13d14 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:28.002230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e01e4bd-9bb4-41aa-bf3a-702016e13d14 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:28.002703 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e01e4bd-9bb4-41aa-bf3a-702016e13d14 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:28.003901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e01e4bd-9bb4-41aa-bf3a-702016e13d14 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:28.027909 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ba7b1b30-c4cc-419e-ba75-9fb6dc0299eb tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:28.042741 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ba7b1b30-c4cc-419e-ba75-9fb6dc0299eb tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1527 microversion: 2.1 time: 0.203672 Sep 07 12:53:28.043790 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2253/4552] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:27 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1527 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:28.115876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2dc29508-9862-47c7-8e6a-6183d37f13d1 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:28.116782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2dc29508-9862-47c7-8e6a-6183d37f13d1 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:28.124658 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dc29508-9862-47c7-8e6a-6183d37f13d1 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:28.125434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dc29508-9862-47c7-8e6a-6183d37f13d1 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:28.126179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dc29508-9862-47c7-8e6a-6183d37f13d1 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:28.127201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dc29508-9862-47c7-8e6a-6183d37f13d1 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:28.127831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dc29508-9862-47c7-8e6a-6183d37f13d1 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:28.128440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dc29508-9862-47c7-8e6a-6183d37f13d1 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:28.266308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2dc29508-9862-47c7-8e6a-6183d37f13d1 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:28.272294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0e01e4bd-9bb4-41aa-bf3a-702016e13d14 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:28.286573 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0e01e4bd-9bb4-41aa-bf3a-702016e13d14 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:28.289173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0e01e4bd-9bb4-41aa-bf3a-702016e13d14 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:28.290627 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0e01e4bd-9bb4-41aa-bf3a-702016e13d14 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.302861 Sep 07 12:53:28.291460 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2300/4553] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:27 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:28.293692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2dc29508-9862-47c7-8e6a-6183d37f13d1 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:28.296276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2dc29508-9862-47c7-8e6a-6183d37f13d1 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:28.297996 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2dc29508-9862-47c7-8e6a-6183d37f13d1 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1366 microversion: 2.47 time: 0.186166 Sep 07 12:53:28.299222 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2254/4554] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:28 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:53:28.348175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-090dbe88-bded-49e3-82de-4c0bf685a932 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:28.349124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-090dbe88-bded-49e3-82de-4c0bf685a932 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:28.356447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-090dbe88-bded-49e3-82de-4c0bf685a932 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:28.357120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-090dbe88-bded-49e3-82de-4c0bf685a932 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:28.357735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-090dbe88-bded-49e3-82de-4c0bf685a932 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:28.358571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-090dbe88-bded-49e3-82de-4c0bf685a932 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:28.359173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-090dbe88-bded-49e3-82de-4c0bf685a932 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:28.359891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-090dbe88-bded-49e3-82de-4c0bf685a932 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:28.529844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-090dbe88-bded-49e3-82de-4c0bf685a932 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:28.539180 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-090dbe88-bded-49e3-82de-4c0bf685a932 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.196097 Sep 07 12:53:28.539902 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2301/4555] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:28 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:53:29.001756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-18869dd3-1559-4e3b-8b60-3255fe6647c7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:29.004201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-18869dd3-1559-4e3b-8b60-3255fe6647c7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:29.012164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18869dd3-1559-4e3b-8b60-3255fe6647c7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:29.012665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18869dd3-1559-4e3b-8b60-3255fe6647c7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:29.013103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18869dd3-1559-4e3b-8b60-3255fe6647c7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:29.013877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18869dd3-1559-4e3b-8b60-3255fe6647c7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:29.014355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18869dd3-1559-4e3b-8b60-3255fe6647c7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:29.014779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18869dd3-1559-4e3b-8b60-3255fe6647c7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:29.052578 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-18869dd3-1559-4e3b-8b60-3255fe6647c7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054999 Sep 07 12:53:29.053056 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2255/4556] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:53:28 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:53:29.067833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e53d5aa1-7ad3-47f2-8b12-7ea03e8984fc tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:29.069100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e53d5aa1-7ad3-47f2-8b12-7ea03e8984fc tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:29.077509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e53d5aa1-7ad3-47f2-8b12-7ea03e8984fc tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:29.078181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e53d5aa1-7ad3-47f2-8b12-7ea03e8984fc tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:29.078753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e53d5aa1-7ad3-47f2-8b12-7ea03e8984fc tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:29.079563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e53d5aa1-7ad3-47f2-8b12-7ea03e8984fc tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:29.080108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e53d5aa1-7ad3-47f2-8b12-7ea03e8984fc tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:29.080620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e53d5aa1-7ad3-47f2-8b12-7ea03e8984fc tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:29.226632 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e53d5aa1-7ad3-47f2-8b12-7ea03e8984fc tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:29.235490 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e53d5aa1-7ad3-47f2-8b12-7ea03e8984fc tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1527 microversion: 2.1 time: 0.172083 Sep 07 12:53:29.236095 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2302/4557] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:29 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1527 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:29.317607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e6ab4b9e-f6b1-4fd7-8d44-2e233c54bbe6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:29.318262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e6ab4b9e-f6b1-4fd7-8d44-2e233c54bbe6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:29.325503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6ab4b9e-f6b1-4fd7-8d44-2e233c54bbe6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:29.326009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6ab4b9e-f6b1-4fd7-8d44-2e233c54bbe6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:29.326446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6ab4b9e-f6b1-4fd7-8d44-2e233c54bbe6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:29.327153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6ab4b9e-f6b1-4fd7-8d44-2e233c54bbe6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:29.327606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6ab4b9e-f6b1-4fd7-8d44-2e233c54bbe6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:29.328061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6ab4b9e-f6b1-4fd7-8d44-2e233c54bbe6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:29.343725 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d4a6e815-51a7-473e-8df0-c5ad4e152b31 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:29.344363 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d4a6e815-51a7-473e-8df0-c5ad4e152b31 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:29.352481 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4a6e815-51a7-473e-8df0-c5ad4e152b31 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:29.353288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4a6e815-51a7-473e-8df0-c5ad4e152b31 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:29.353952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4a6e815-51a7-473e-8df0-c5ad4e152b31 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:29.354694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4a6e815-51a7-473e-8df0-c5ad4e152b31 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:29.355158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4a6e815-51a7-473e-8df0-c5ad4e152b31 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:29.355745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4a6e815-51a7-473e-8df0-c5ad4e152b31 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:29.441814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d4a6e815-51a7-473e-8df0-c5ad4e152b31 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:29.456028 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d4a6e815-51a7-473e-8df0-c5ad4e152b31 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:29.458912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d4a6e815-51a7-473e-8df0-c5ad4e152b31 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:29.460783 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d4a6e815-51a7-473e-8df0-c5ad4e152b31 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1366 microversion: 2.47 time: 0.121562 Sep 07 12:53:29.464389 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2303/4558] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:29 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1366 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:29.532747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e6ab4b9e-f6b1-4fd7-8d44-2e233c54bbe6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:29.568743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c9aff8be-6c81-4f6d-98f4-7aac2023fee2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:29.571239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e6ab4b9e-f6b1-4fd7-8d44-2e233c54bbe6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:29.574912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c9aff8be-6c81-4f6d-98f4-7aac2023fee2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:29.583934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e6ab4b9e-f6b1-4fd7-8d44-2e233c54bbe6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:29.586353 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e6ab4b9e-f6b1-4fd7-8d44-2e233c54bbe6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.272611 Sep 07 12:53:29.587370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9aff8be-6c81-4f6d-98f4-7aac2023fee2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:29.587565 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2256/4559] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:29 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:29.589024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9aff8be-6c81-4f6d-98f4-7aac2023fee2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:29.590320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9aff8be-6c81-4f6d-98f4-7aac2023fee2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:29.591850 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9aff8be-6c81-4f6d-98f4-7aac2023fee2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:29.592697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9aff8be-6c81-4f6d-98f4-7aac2023fee2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:29.593515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9aff8be-6c81-4f6d-98f4-7aac2023fee2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:29.895816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c9aff8be-6c81-4f6d-98f4-7aac2023fee2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:29.912281 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c9aff8be-6c81-4f6d-98f4-7aac2023fee2 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.351767 Sep 07 12:53:29.913135 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2304/4560] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:29 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:30.066330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-799e88da-c7fa-4232-9501-a9610634efa8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:30.069252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-799e88da-c7fa-4232-9501-a9610634efa8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:30.078044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-799e88da-c7fa-4232-9501-a9610634efa8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:30.078568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-799e88da-c7fa-4232-9501-a9610634efa8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:30.079096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-799e88da-c7fa-4232-9501-a9610634efa8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:30.079950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-799e88da-c7fa-4232-9501-a9610634efa8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:30.080498 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-799e88da-c7fa-4232-9501-a9610634efa8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:30.081009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-799e88da-c7fa-4232-9501-a9610634efa8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:30.123464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:30.130261 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-799e88da-c7fa-4232-9501-a9610634efa8 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068293 Sep 07 12:53:30.131327 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2257/4561] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:53:30 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:53:30.260904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-895260b9-acb9-4fe1-96e8-61be86cfbe07 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:30.262128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-895260b9-acb9-4fe1-96e8-61be86cfbe07 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:30.271033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-895260b9-acb9-4fe1-96e8-61be86cfbe07 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:30.271704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-895260b9-acb9-4fe1-96e8-61be86cfbe07 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:30.272348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-895260b9-acb9-4fe1-96e8-61be86cfbe07 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:30.273230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-895260b9-acb9-4fe1-96e8-61be86cfbe07 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:30.273861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-895260b9-acb9-4fe1-96e8-61be86cfbe07 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:30.274515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-895260b9-acb9-4fe1-96e8-61be86cfbe07 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:30.298684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:30.460059 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-895260b9-acb9-4fe1-96e8-61be86cfbe07 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:30.471573 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-895260b9-acb9-4fe1-96e8-61be86cfbe07 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1527 microversion: 2.1 time: 0.215642 Sep 07 12:53:30.472241 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2305/4562] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:30 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1527 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:30.497401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c4d97d83-ae5b-4f0b-a00c-9900b1c7de71 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:30.498442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c4d97d83-ae5b-4f0b-a00c-9900b1c7de71 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:30.509536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4d97d83-ae5b-4f0b-a00c-9900b1c7de71 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:30.510383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4d97d83-ae5b-4f0b-a00c-9900b1c7de71 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:30.511089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4d97d83-ae5b-4f0b-a00c-9900b1c7de71 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:30.512553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4d97d83-ae5b-4f0b-a00c-9900b1c7de71 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:30.515162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4d97d83-ae5b-4f0b-a00c-9900b1c7de71 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:30.515993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4d97d83-ae5b-4f0b-a00c-9900b1c7de71 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:30.633332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dc3338f8-c5e0-47d2-945e-c6763a8dd2e4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:30.635305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dc3338f8-c5e0-47d2-945e-c6763a8dd2e4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:30.646445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c4d97d83-ae5b-4f0b-a00c-9900b1c7de71 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:30.646874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc3338f8-c5e0-47d2-945e-c6763a8dd2e4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:30.647541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc3338f8-c5e0-47d2-945e-c6763a8dd2e4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:30.648306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc3338f8-c5e0-47d2-945e-c6763a8dd2e4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:30.649711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc3338f8-c5e0-47d2-945e-c6763a8dd2e4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:30.650567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc3338f8-c5e0-47d2-945e-c6763a8dd2e4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:30.651357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc3338f8-c5e0-47d2-945e-c6763a8dd2e4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:30.673614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c4d97d83-ae5b-4f0b-a00c-9900b1c7de71 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:30.677458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c4d97d83-ae5b-4f0b-a00c-9900b1c7de71 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:30.680399 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c4d97d83-ae5b-4f0b-a00c-9900b1c7de71 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1366 microversion: 2.47 time: 0.190886 Sep 07 12:53:30.681313 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2258/4563] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:30 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:53:30.943837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4669a3ef-dae0-486a-bb93-36db707f439c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:30.945222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4669a3ef-dae0-486a-bb93-36db707f439c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:30.965655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4669a3ef-dae0-486a-bb93-36db707f439c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:30.966813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4669a3ef-dae0-486a-bb93-36db707f439c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:30.967064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dc3338f8-c5e0-47d2-945e-c6763a8dd2e4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:30.967961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4669a3ef-dae0-486a-bb93-36db707f439c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:30.969720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4669a3ef-dae0-486a-bb93-36db707f439c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:30.972508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4669a3ef-dae0-486a-bb93-36db707f439c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:30.973692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4669a3ef-dae0-486a-bb93-36db707f439c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:31.006108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dc3338f8-c5e0-47d2-945e-c6763a8dd2e4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:31.013105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dc3338f8-c5e0-47d2-945e-c6763a8dd2e4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:31.015998 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dc3338f8-c5e0-47d2-945e-c6763a8dd2e4 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.392503 Sep 07 12:53:31.021432 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2306/4564] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:30 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:53:31.149392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eacefe1c-6333-4a77-831c-b49246a37c09 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:31.154628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-eacefe1c-6333-4a77-831c-b49246a37c09 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:31.167039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eacefe1c-6333-4a77-831c-b49246a37c09 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:31.168312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eacefe1c-6333-4a77-831c-b49246a37c09 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:31.169564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eacefe1c-6333-4a77-831c-b49246a37c09 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:31.172225 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eacefe1c-6333-4a77-831c-b49246a37c09 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:31.173400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eacefe1c-6333-4a77-831c-b49246a37c09 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:31.174461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eacefe1c-6333-4a77-831c-b49246a37c09 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:31.257104 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eacefe1c-6333-4a77-831c-b49246a37c09 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111772 Sep 07 12:53:31.258576 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2307/4565] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:53:31 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:53:31.296446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4669a3ef-dae0-486a-bb93-36db707f439c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:31.314173 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4669a3ef-dae0-486a-bb93-36db707f439c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.378332 Sep 07 12:53:31.315591 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2259/4566] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:30 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:31.501603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b95f1386-3d71-4939-925e-936159f7ef13 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:31.502504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b95f1386-3d71-4939-925e-936159f7ef13 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:31.515696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b95f1386-3d71-4939-925e-936159f7ef13 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:31.516942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b95f1386-3d71-4939-925e-936159f7ef13 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:31.518968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b95f1386-3d71-4939-925e-936159f7ef13 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:31.520520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b95f1386-3d71-4939-925e-936159f7ef13 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:31.521620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b95f1386-3d71-4939-925e-936159f7ef13 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:31.522622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b95f1386-3d71-4939-925e-936159f7ef13 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:31.731363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b308a441-ca84-45c1-84ab-7b55065b6440 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:31.733093 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b308a441-ca84-45c1-84ab-7b55065b6440 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:31.743251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b95f1386-3d71-4939-925e-936159f7ef13 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:31.746767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b308a441-ca84-45c1-84ab-7b55065b6440 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:31.747582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b308a441-ca84-45c1-84ab-7b55065b6440 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:31.748797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b308a441-ca84-45c1-84ab-7b55065b6440 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:31.750445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b308a441-ca84-45c1-84ab-7b55065b6440 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:31.752722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b308a441-ca84-45c1-84ab-7b55065b6440 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:31.759128 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b95f1386-3d71-4939-925e-936159f7ef13 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1527 microversion: 2.1 time: 0.264235 Sep 07 12:53:31.760161 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2308/4567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:31 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1527 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:31.765140 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b308a441-ca84-45c1-84ab-7b55065b6440 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:31.908406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b308a441-ca84-45c1-84ab-7b55065b6440 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:31.932030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b308a441-ca84-45c1-84ab-7b55065b6440 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:31.933876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b308a441-ca84-45c1-84ab-7b55065b6440 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:31.935607 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b308a441-ca84-45c1-84ab-7b55065b6440 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1366 microversion: 2.47 time: 0.211833 Sep 07 12:53:31.936480 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2260/4568] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:31 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:32.064098 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0b32e70f-0507-4ff1-97cf-9f0d8b0c308f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:32.064604 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0b32e70f-0507-4ff1-97cf-9f0d8b0c308f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:32.073325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b32e70f-0507-4ff1-97cf-9f0d8b0c308f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:32.073928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b32e70f-0507-4ff1-97cf-9f0d8b0c308f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:32.074411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b32e70f-0507-4ff1-97cf-9f0d8b0c308f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:32.075238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b32e70f-0507-4ff1-97cf-9f0d8b0c308f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:32.075720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b32e70f-0507-4ff1-97cf-9f0d8b0c308f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:32.076160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b32e70f-0507-4ff1-97cf-9f0d8b0c308f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:32.276823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0b32e70f-0507-4ff1-97cf-9f0d8b0c308f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:32.279230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d24ebb7e-fb67-40d9-b6a4-fcdc4537a2fe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:32.284102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d24ebb7e-fb67-40d9-b6a4-fcdc4537a2fe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:32.300191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0b32e70f-0507-4ff1-97cf-9f0d8b0c308f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:32.306058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d24ebb7e-fb67-40d9-b6a4-fcdc4537a2fe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:32.307264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0b32e70f-0507-4ff1-97cf-9f0d8b0c308f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:32.309828 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d24ebb7e-fb67-40d9-b6a4-fcdc4537a2fe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:32.310708 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0b32e70f-0507-4ff1-97cf-9f0d8b0c308f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.250383 Sep 07 12:53:32.313131 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2309/4569] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:32 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:32.313516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d24ebb7e-fb67-40d9-b6a4-fcdc4537a2fe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:32.315249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d24ebb7e-fb67-40d9-b6a4-fcdc4537a2fe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:32.321068 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d24ebb7e-fb67-40d9-b6a4-fcdc4537a2fe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:32.323521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d24ebb7e-fb67-40d9-b6a4-fcdc4537a2fe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:32.344997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c62287c7-5196-4e0b-837f-06558aee73ff tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:32.350018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c62287c7-5196-4e0b-837f-06558aee73ff tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:32.365211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c62287c7-5196-4e0b-837f-06558aee73ff tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:32.366604 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c62287c7-5196-4e0b-837f-06558aee73ff tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:32.368956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c62287c7-5196-4e0b-837f-06558aee73ff tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:32.370858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c62287c7-5196-4e0b-837f-06558aee73ff tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:32.371946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c62287c7-5196-4e0b-837f-06558aee73ff tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:32.373924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c62287c7-5196-4e0b-837f-06558aee73ff tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:32.390854 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d24ebb7e-fb67-40d9-b6a4-fcdc4537a2fe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118956 Sep 07 12:53:32.400052 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2261/4570] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:53:32 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:53:32.715835 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c62287c7-5196-4e0b-837f-06558aee73ff tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:32.732724 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c62287c7-5196-4e0b-837f-06558aee73ff tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.394703 Sep 07 12:53:32.734215 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2310/4571] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:32 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:32.809599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-da69111e-03b3-44fc-97ff-3e949bc17947 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:32.810934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-da69111e-03b3-44fc-97ff-3e949bc17947 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:32.821674 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da69111e-03b3-44fc-97ff-3e949bc17947 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:32.822794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da69111e-03b3-44fc-97ff-3e949bc17947 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:32.824106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da69111e-03b3-44fc-97ff-3e949bc17947 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:32.825646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da69111e-03b3-44fc-97ff-3e949bc17947 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:32.826681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da69111e-03b3-44fc-97ff-3e949bc17947 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:32.827683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da69111e-03b3-44fc-97ff-3e949bc17947 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:32.982488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6ecb87b0-d0f1-477d-86cd-b04ad8405c6f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:32.983630 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6ecb87b0-d0f1-477d-86cd-b04ad8405c6f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:32.996814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ecb87b0-d0f1-477d-86cd-b04ad8405c6f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:32.999044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ecb87b0-d0f1-477d-86cd-b04ad8405c6f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:33.000049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ecb87b0-d0f1-477d-86cd-b04ad8405c6f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:33.002270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ecb87b0-d0f1-477d-86cd-b04ad8405c6f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:33.004371 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ecb87b0-d0f1-477d-86cd-b04ad8405c6f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:33.004792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ecb87b0-d0f1-477d-86cd-b04ad8405c6f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:33.100691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-da69111e-03b3-44fc-97ff-3e949bc17947 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:33.120133 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-da69111e-03b3-44fc-97ff-3e949bc17947 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1527 microversion: 2.1 time: 0.317235 Sep 07 12:53:33.121334 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2262/4572] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:32 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1527 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:33.161354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6ecb87b0-d0f1-477d-86cd-b04ad8405c6f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:33.171245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6ecb87b0-d0f1-477d-86cd-b04ad8405c6f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:33.173023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6ecb87b0-d0f1-477d-86cd-b04ad8405c6f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:33.174559 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6ecb87b0-d0f1-477d-86cd-b04ad8405c6f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1366 microversion: 2.47 time: 0.204751 Sep 07 12:53:33.175559 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2311/4573] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:32 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:33.357934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c6f1c849-fae1-4911-ade8-508c4afb7f3d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:33.358937 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c6f1c849-fae1-4911-ade8-508c4afb7f3d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:33.371251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6f1c849-fae1-4911-ade8-508c4afb7f3d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:33.372173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6f1c849-fae1-4911-ade8-508c4afb7f3d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:33.372638 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6f1c849-fae1-4911-ade8-508c4afb7f3d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:33.373600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6f1c849-fae1-4911-ade8-508c4afb7f3d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:33.374080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6f1c849-fae1-4911-ade8-508c4afb7f3d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:33.374729 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6f1c849-fae1-4911-ade8-508c4afb7f3d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:33.413170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a0456b66-7afd-405a-82a1-4a032d3a429e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:33.418020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a0456b66-7afd-405a-82a1-4a032d3a429e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:33.437641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0456b66-7afd-405a-82a1-4a032d3a429e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:33.438894 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0456b66-7afd-405a-82a1-4a032d3a429e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:33.441340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0456b66-7afd-405a-82a1-4a032d3a429e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:33.444303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0456b66-7afd-405a-82a1-4a032d3a429e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:33.448304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0456b66-7afd-405a-82a1-4a032d3a429e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:33.450323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0456b66-7afd-405a-82a1-4a032d3a429e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:33.488057 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a0456b66-7afd-405a-82a1-4a032d3a429e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083620 Sep 07 12:53:33.488999 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2312/4574] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:53:33 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:53:33.493825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c2ee25c7-a7c9-4e25-8b9b-93a150bf12fb req-b8c8650d-3b61-49ea-aa09-e93aa666f0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae560a6-de3d-4c7d-892d-e53d9f8da941", "name": "network-vif-deleted", "tag": "feefcfa5-a9aa-4f77-bf84-1e0236841758"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:53:33.504799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c2ee25c7-a7c9-4e25-8b9b-93a150bf12fb req-b8c8650d-3b61-49ea-aa09-e93aa666f0c7 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:33.505684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c2ee25c7-a7c9-4e25-8b9b-93a150bf12fb req-b8c8650d-3b61-49ea-aa09-e93aa666f0c7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:33.506161 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c2ee25c7-a7c9-4e25-8b9b-93a150bf12fb req-b8c8650d-3b61-49ea-aa09-e93aa666f0c7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:33.521761 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c2ee25c7-a7c9-4e25-8b9b-93a150bf12fb req-b8c8650d-3b61-49ea-aa09-e93aa666f0c7 service nova] Creating event network-vif-deleted:feefcfa5-a9aa-4f77-bf84-1e0236841758 for instance 2ae560a6-de3d-4c7d-892d-e53d9f8da941 on n-h1-852087-9 Sep 07 12:53:33.528316 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c2ee25c7-a7c9-4e25-8b9b-93a150bf12fb req-b8c8650d-3b61-49ea-aa09-e93aa666f0c7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037975 Sep 07 12:53:33.532837 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2313/4575] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:53:33.624756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c6f1c849-fae1-4911-ade8-508c4afb7f3d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:33.634749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c6f1c849-fae1-4911-ade8-508c4afb7f3d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:33.636382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c6f1c849-fae1-4911-ade8-508c4afb7f3d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:33.638759 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c6f1c849-fae1-4911-ade8-508c4afb7f3d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.286186 Sep 07 12:53:33.639345 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2263/4576] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:33 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:53:33.772573 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-88d3e370-96cd-4365-9e65-a3d175f16f03 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:33.773457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-88d3e370-96cd-4365-9e65-a3d175f16f03 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:33.781073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88d3e370-96cd-4365-9e65-a3d175f16f03 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:33.781606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88d3e370-96cd-4365-9e65-a3d175f16f03 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:33.782060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88d3e370-96cd-4365-9e65-a3d175f16f03 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:33.782866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88d3e370-96cd-4365-9e65-a3d175f16f03 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:33.783384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88d3e370-96cd-4365-9e65-a3d175f16f03 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:33.783945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88d3e370-96cd-4365-9e65-a3d175f16f03 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:33.993452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-88d3e370-96cd-4365-9e65-a3d175f16f03 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:34.002970 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-88d3e370-96cd-4365-9e65-a3d175f16f03 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.236977 Sep 07 12:53:34.003888 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2314/4577] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:33 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:34.160728 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-58173c14-1395-423f-b3e6-4a81da0ebfa8 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:34.161908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-58173c14-1395-423f-b3e6-4a81da0ebfa8 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:34.174349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58173c14-1395-423f-b3e6-4a81da0ebfa8 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:34.175273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58173c14-1395-423f-b3e6-4a81da0ebfa8 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:34.175978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58173c14-1395-423f-b3e6-4a81da0ebfa8 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:34.177244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58173c14-1395-423f-b3e6-4a81da0ebfa8 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:34.178107 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58173c14-1395-423f-b3e6-4a81da0ebfa8 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:34.178856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58173c14-1395-423f-b3e6-4a81da0ebfa8 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:34.205061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4c296248-8ae6-4708-9594-6ebe06341725 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:34.218000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4c296248-8ae6-4708-9594-6ebe06341725 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:34.229616 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c296248-8ae6-4708-9594-6ebe06341725 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:34.230445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c296248-8ae6-4708-9594-6ebe06341725 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:34.231228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c296248-8ae6-4708-9594-6ebe06341725 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:34.236147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c296248-8ae6-4708-9594-6ebe06341725 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:34.236890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c296248-8ae6-4708-9594-6ebe06341725 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:34.237592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c296248-8ae6-4708-9594-6ebe06341725 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:34.278136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58173c14-1395-423f-b3e6-4a81da0ebfa8 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:34.278674 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58173c14-1395-423f-b3e6-4a81da0ebfa8 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:34.280112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58173c14-1395-423f-b3e6-4a81da0ebfa8 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:34.282415 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-58173c14-1395-423f-b3e6-4a81da0ebfa8 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lazy-loading 'fault' on Instance uuid 2ae560a6-de3d-4c7d-892d-e53d9f8da941 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:53:34.389959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-58173c14-1395-423f-b3e6-4a81da0ebfa8 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:34.401319 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-58173c14-1395-423f-b3e6-4a81da0ebfa8 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1314 microversion: 2.1 time: 0.247230 Sep 07 12:53:34.402598 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2264/4578] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:34 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:34.423417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4c296248-8ae6-4708-9594-6ebe06341725 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:34.435147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4c296248-8ae6-4708-9594-6ebe06341725 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:34.437161 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4c296248-8ae6-4708-9594-6ebe06341725 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:34.438793 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4c296248-8ae6-4708-9594-6ebe06341725 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1366 microversion: 2.47 time: 0.241159 Sep 07 12:53:34.439524 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2315/4579] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:34 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:34.509411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3efa4fcd-4b3f-4a78-bb6f-771ef1b86d2e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:34.513536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3efa4fcd-4b3f-4a78-bb6f-771ef1b86d2e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:34.524913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3efa4fcd-4b3f-4a78-bb6f-771ef1b86d2e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:34.525799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3efa4fcd-4b3f-4a78-bb6f-771ef1b86d2e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:34.526583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3efa4fcd-4b3f-4a78-bb6f-771ef1b86d2e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:34.527881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3efa4fcd-4b3f-4a78-bb6f-771ef1b86d2e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:34.528711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3efa4fcd-4b3f-4a78-bb6f-771ef1b86d2e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:34.529700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3efa4fcd-4b3f-4a78-bb6f-771ef1b86d2e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:34.591175 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3efa4fcd-4b3f-4a78-bb6f-771ef1b86d2e tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089405 Sep 07 12:53:34.592361 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2265/4580] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:53:34 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:53:34.666589 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f219dc7-ab2b-4554-b3e5-f5a068d14e05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:34.667754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0f219dc7-ab2b-4554-b3e5-f5a068d14e05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:34.679522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f219dc7-ab2b-4554-b3e5-f5a068d14e05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:34.681118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f219dc7-ab2b-4554-b3e5-f5a068d14e05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:34.682060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f219dc7-ab2b-4554-b3e5-f5a068d14e05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:34.683397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f219dc7-ab2b-4554-b3e5-f5a068d14e05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:34.684348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f219dc7-ab2b-4554-b3e5-f5a068d14e05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:34.685270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f219dc7-ab2b-4554-b3e5-f5a068d14e05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:34.935727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0f219dc7-ab2b-4554-b3e5-f5a068d14e05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:34.959304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0f219dc7-ab2b-4554-b3e5-f5a068d14e05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:34.966947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0f219dc7-ab2b-4554-b3e5-f5a068d14e05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:34.970216 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0f219dc7-ab2b-4554-b3e5-f5a068d14e05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.308260 Sep 07 12:53:34.971822 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2316/4581] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:34 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:35.027064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e6c4b6e2-cec0-4b00-abca-1835ea979113 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:35.028021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e6c4b6e2-cec0-4b00-abca-1835ea979113 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:35.050196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6c4b6e2-cec0-4b00-abca-1835ea979113 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:35.050715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6c4b6e2-cec0-4b00-abca-1835ea979113 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:35.051169 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6c4b6e2-cec0-4b00-abca-1835ea979113 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:35.052109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6c4b6e2-cec0-4b00-abca-1835ea979113 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:35.052389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6c4b6e2-cec0-4b00-abca-1835ea979113 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:35.052831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6c4b6e2-cec0-4b00-abca-1835ea979113 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:35.393149 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e6c4b6e2-cec0-4b00-abca-1835ea979113 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:35.402300 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e6c4b6e2-cec0-4b00-abca-1835ea979113 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.379750 Sep 07 12:53:35.411370 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2266/4582] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:35 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:35.442652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-88b0aa6a-87d9-49c6-866e-ca5f89b34fdb tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:35.443351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-88b0aa6a-87d9-49c6-866e-ca5f89b34fdb tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:35.460011 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88b0aa6a-87d9-49c6-866e-ca5f89b34fdb tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:35.460580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88b0aa6a-87d9-49c6-866e-ca5f89b34fdb tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:35.461397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88b0aa6a-87d9-49c6-866e-ca5f89b34fdb tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:35.462198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88b0aa6a-87d9-49c6-866e-ca5f89b34fdb tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:35.462672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88b0aa6a-87d9-49c6-866e-ca5f89b34fdb tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:35.463112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88b0aa6a-87d9-49c6-866e-ca5f89b34fdb tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:35.491085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-07da3958-85c8-4bc7-8a6f-09defabe0209 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:35.491714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-07da3958-85c8-4bc7-8a6f-09defabe0209 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:35.502749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07da3958-85c8-4bc7-8a6f-09defabe0209 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:35.503254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07da3958-85c8-4bc7-8a6f-09defabe0209 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:35.503700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07da3958-85c8-4bc7-8a6f-09defabe0209 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:35.504436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07da3958-85c8-4bc7-8a6f-09defabe0209 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:35.504905 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07da3958-85c8-4bc7-8a6f-09defabe0209 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:35.505337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07da3958-85c8-4bc7-8a6f-09defabe0209 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:35.564287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88b0aa6a-87d9-49c6-866e-ca5f89b34fdb tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:35.567450 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88b0aa6a-87d9-49c6-866e-ca5f89b34fdb tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:35.568986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88b0aa6a-87d9-49c6-866e-ca5f89b34fdb tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:35.569859 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-88b0aa6a-87d9-49c6-866e-ca5f89b34fdb tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lazy-loading 'fault' on Instance uuid 2ae560a6-de3d-4c7d-892d-e53d9f8da941 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:53:35.676891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-88b0aa6a-87d9-49c6-866e-ca5f89b34fdb tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a594d9b6bb04b3abc496db65e49ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09672887f9048669b654d28ab70a69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:35.698739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-07da3958-85c8-4bc7-8a6f-09defabe0209 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:35.700505 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-88b0aa6a-87d9-49c6-866e-ca5f89b34fdb tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 200 len: 1314 microversion: 2.1 time: 0.261627 Sep 07 12:53:35.701194 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2317/4583] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:35 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:35.710331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-07da3958-85c8-4bc7-8a6f-09defabe0209 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:35.712235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-07da3958-85c8-4bc7-8a6f-09defabe0209 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:35.713818 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-07da3958-85c8-4bc7-8a6f-09defabe0209 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1366 microversion: 2.47 time: 0.228500 Sep 07 12:53:35.714124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d511163f-8794-4ab1-b20a-8fcffc21d33b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:35.721317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d511163f-8794-4ab1-b20a-8fcffc21d33b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:35.726187 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2267/4584] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:35 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:53:35.738320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d511163f-8794-4ab1-b20a-8fcffc21d33b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:35.739217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d511163f-8794-4ab1-b20a-8fcffc21d33b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:35.739866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d511163f-8794-4ab1-b20a-8fcffc21d33b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:35.740955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d511163f-8794-4ab1-b20a-8fcffc21d33b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:35.741945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d511163f-8794-4ab1-b20a-8fcffc21d33b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:35.742568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d511163f-8794-4ab1-b20a-8fcffc21d33b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:35.803505 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d511163f-8794-4ab1-b20a-8fcffc21d33b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101119 Sep 07 12:53:35.805073 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2318/4585] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:53:35 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:53:36.016701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-37dd7149-ac1c-4e74-8310-566ab4ebaf59 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:36.018479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-37dd7149-ac1c-4e74-8310-566ab4ebaf59 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:36.034571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37dd7149-ac1c-4e74-8310-566ab4ebaf59 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:36.035892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37dd7149-ac1c-4e74-8310-566ab4ebaf59 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:36.036981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37dd7149-ac1c-4e74-8310-566ab4ebaf59 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:36.039012 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37dd7149-ac1c-4e74-8310-566ab4ebaf59 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:36.040336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37dd7149-ac1c-4e74-8310-566ab4ebaf59 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:36.041563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37dd7149-ac1c-4e74-8310-566ab4ebaf59 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:36.432246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a2ec73ab-e3c2-483e-866a-9ca5f6405103 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:36.440344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a2ec73ab-e3c2-483e-866a-9ca5f6405103 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:36.446808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37dd7149-ac1c-4e74-8310-566ab4ebaf59 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:36.450569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:36.465272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37dd7149-ac1c-4e74-8310-566ab4ebaf59 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:36.467666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2ec73ab-e3c2-483e-866a-9ca5f6405103 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:36.471246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2ec73ab-e3c2-483e-866a-9ca5f6405103 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:36.471589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37dd7149-ac1c-4e74-8310-566ab4ebaf59 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:36.474801 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-37dd7149-ac1c-4e74-8310-566ab4ebaf59 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.464586 Sep 07 12:53:36.476927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2ec73ab-e3c2-483e-866a-9ca5f6405103 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:36.478043 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2268/4586] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:36 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:36.486732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2ec73ab-e3c2-483e-866a-9ca5f6405103 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:36.487623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2ec73ab-e3c2-483e-866a-9ca5f6405103 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:36.488312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a2ec73ab-e3c2-483e-866a-9ca5f6405103 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:36.748297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2f94245d-8709-40c4-9be2-3ee86a1b9a9f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:36.748836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2f94245d-8709-40c4-9be2-3ee86a1b9a9f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:36.760994 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f94245d-8709-40c4-9be2-3ee86a1b9a9f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:36.761877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f94245d-8709-40c4-9be2-3ee86a1b9a9f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:36.763938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f94245d-8709-40c4-9be2-3ee86a1b9a9f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:36.764965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f94245d-8709-40c4-9be2-3ee86a1b9a9f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:36.767421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f94245d-8709-40c4-9be2-3ee86a1b9a9f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:36.768082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f94245d-8709-40c4-9be2-3ee86a1b9a9f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:36.803360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a2ec73ab-e3c2-483e-866a-9ca5f6405103 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:36.820165 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a2ec73ab-e3c2-483e-866a-9ca5f6405103 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1518 microversion: 2.1 time: 0.396329 Sep 07 12:53:36.821057 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2319/4587] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:36 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1518 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:53:36.827301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-20c59ddf-3f9a-4e64-8be3-94985f70bc90 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:36.840525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-20c59ddf-3f9a-4e64-8be3-94985f70bc90 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] [instance: 2ae560a6-de3d-4c7d-892d-e53d9f8da941] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:36.857351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20c59ddf-3f9a-4e64-8be3-94985f70bc90 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:36.857892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20c59ddf-3f9a-4e64-8be3-94985f70bc90 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:36.870317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20c59ddf-3f9a-4e64-8be3-94985f70bc90 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:36.871178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20c59ddf-3f9a-4e64-8be3-94985f70bc90 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:36.871744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20c59ddf-3f9a-4e64-8be3-94985f70bc90 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:36.872202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20c59ddf-3f9a-4e64-8be3-94985f70bc90 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:36.894102 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-20c59ddf-3f9a-4e64-8be3-94985f70bc90 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] HTTP exception thrown: Instance 2ae560a6-de3d-4c7d-892d-e53d9f8da941 could not be found. Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-20c59ddf-3f9a-4e64-8be3-94985f70bc90 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Request method failure captured: Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 HTTP/1.1 Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJQd318XRTvmQHDRWhNM7XSVUGfOtpivWeFXsfnkoqYeFeoJYdzPsmk4v_HCMbXvwno0s8ivna8uyraN2LwoOyHI5wnpbTGNQ9JsHGeG28rLjU7-1OcR-8JoPyp3S6EQg4yVVCA35EpR9SU74j4XAoVNB69NXRkppv5zDExMFDknGpU Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: c09672887f9048669b654d28ab70a69c Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-940754013 Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c09672887f9048669b654d28ab70a69c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c09672887f9048669b654d28ab70a69c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c09672887f9048669b654d28ab70a69c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c09672887f9048669b654d28ab70a69c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-940754013 Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: c09672887f9048669b654d28ab70a69c Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-940754013 Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-InstanceActionsNegativeTestJSON-940754013-project Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6a594d9b6bb04b3abc496db65e49ff09 Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-940754013-project Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 2ae560a6-de3d-4c7d-892d-e53d9f8da941 could not be found. Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '2ae560a6-de3d-4c7d-892d-e53d9f8da941'} Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ae560a6-de3d-4c7d-892d-e53d9f8da941 could not be found. Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ae560a6-de3d-4c7d-892d-e53d9f8da941 could not be found. Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:36.896982 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:36.905136 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:36.905136 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:36.905136 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:36.905136 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:36.905136 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:53:36.905136 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:53:36.905136 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ae560a6-de3d-4c7d-892d-e53d9f8da941 could not be found. Sep 07 12:53:36.905136 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:36.905136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-20c59ddf-3f9a-4e64-8be3-94985f70bc90 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] Returning 404 to user: Instance 2ae560a6-de3d-4c7d-892d-e53d9f8da941 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:53:36.905136 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-20c59ddf-3f9a-4e64-8be3-94985f70bc90 tempest-InstanceActionsNegativeTestJSON-940754013 tempest-InstanceActionsNegativeTestJSON-940754013-project] 10.222.0.16 "GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941" status: 404 len: 111 microversion: 2.1 time: 0.077517 Sep 07 12:53:36.908580 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2320/4588] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:36 2022] GET /compute/v2.1/servers/2ae560a6-de3d-4c7d-892d-e53d9f8da941 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:53:36.913436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b50973cb-419e-4f14-8263-b61fd18173c9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:36.917023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b50973cb-419e-4f14-8263-b61fd18173c9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:36.928532 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b50973cb-419e-4f14-8263-b61fd18173c9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:36.929900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b50973cb-419e-4f14-8263-b61fd18173c9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:36.930621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2f94245d-8709-40c4-9be2-3ee86a1b9a9f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:36.931245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b50973cb-419e-4f14-8263-b61fd18173c9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:36.933338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b50973cb-419e-4f14-8263-b61fd18173c9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:36.934732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b50973cb-419e-4f14-8263-b61fd18173c9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:36.935856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b50973cb-419e-4f14-8263-b61fd18173c9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:36.953471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2f94245d-8709-40c4-9be2-3ee86a1b9a9f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:36.957360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2f94245d-8709-40c4-9be2-3ee86a1b9a9f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:36.961011 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2f94245d-8709-40c4-9be2-3ee86a1b9a9f tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1366 microversion: 2.47 time: 0.218548 Sep 07 12:53:36.977522 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2269/4589] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:36 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:37.006957 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b50973cb-419e-4f14-8263-b61fd18173c9 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099266 Sep 07 12:53:37.012230 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2321/4590] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:53:36 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:53:37.534234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-20270f60-9ccb-4655-89b2-51e9894487f1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:37.542711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-20270f60-9ccb-4655-89b2-51e9894487f1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:37.558190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20270f60-9ccb-4655-89b2-51e9894487f1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:37.559610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20270f60-9ccb-4655-89b2-51e9894487f1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:37.560711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20270f60-9ccb-4655-89b2-51e9894487f1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:37.565521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20270f60-9ccb-4655-89b2-51e9894487f1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:37.567031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20270f60-9ccb-4655-89b2-51e9894487f1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:37.568724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20270f60-9ccb-4655-89b2-51e9894487f1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:37.717397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-3cafc9ec-487a-48c9-94b8-1776f5a64211 req-0d2ca456-2fc0-45d4-ae6a-6f0922d13f09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe6581c-7070-48c5-a16d-fa30b22567d4", "name": "network-vif-plugged", "status": "completed", "tag": "57759270-a8de-4adc-a2ba-ccbb3e371878"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:53:37.739132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3cafc9ec-487a-48c9-94b8-1776f5a64211 req-0d2ca456-2fc0-45d4-ae6a-6f0922d13f09 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:37.742101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3cafc9ec-487a-48c9-94b8-1776f5a64211 req-0d2ca456-2fc0-45d4-ae6a-6f0922d13f09 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:37.742608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3cafc9ec-487a-48c9-94b8-1776f5a64211 req-0d2ca456-2fc0-45d4-ae6a-6f0922d13f09 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:37.769512 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-3cafc9ec-487a-48c9-94b8-1776f5a64211 req-0d2ca456-2fc0-45d4-ae6a-6f0922d13f09 service nova] Creating event network-vif-plugged:57759270-a8de-4adc-a2ba-ccbb3e371878 for instance ffe6581c-7070-48c5-a16d-fa30b22567d4 on n-h1-852087-9 Sep 07 12:53:37.779736 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-3cafc9ec-487a-48c9-94b8-1776f5a64211 req-0d2ca456-2fc0-45d4-ae6a-6f0922d13f09 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067307 Sep 07 12:53:37.782444 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2322/4591] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:53:37.817476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-20270f60-9ccb-4655-89b2-51e9894487f1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:37.833826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-20270f60-9ccb-4655-89b2-51e9894487f1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:37.835459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-20270f60-9ccb-4655-89b2-51e9894487f1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:37.836793 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-20270f60-9ccb-4655-89b2-51e9894487f1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.314133 Sep 07 12:53:37.837388 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2270/4592] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:37 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:37.855825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e146e09a-a8dc-44f6-97fd-7346dfe82b83 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:37.856565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e146e09a-a8dc-44f6-97fd-7346dfe82b83 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:37.869128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e146e09a-a8dc-44f6-97fd-7346dfe82b83 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:37.870628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e146e09a-a8dc-44f6-97fd-7346dfe82b83 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:37.872526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e146e09a-a8dc-44f6-97fd-7346dfe82b83 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:37.874605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e146e09a-a8dc-44f6-97fd-7346dfe82b83 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:37.875917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e146e09a-a8dc-44f6-97fd-7346dfe82b83 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:37.876998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e146e09a-a8dc-44f6-97fd-7346dfe82b83 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:38.005360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-febf2a95-51e3-4a93-8170-92509c79b63b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:38.006075 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-febf2a95-51e3-4a93-8170-92509c79b63b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:38.024040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-febf2a95-51e3-4a93-8170-92509c79b63b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:38.024559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-febf2a95-51e3-4a93-8170-92509c79b63b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:38.025013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-febf2a95-51e3-4a93-8170-92509c79b63b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:38.025810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-febf2a95-51e3-4a93-8170-92509c79b63b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:38.026291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-febf2a95-51e3-4a93-8170-92509c79b63b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:38.026742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-febf2a95-51e3-4a93-8170-92509c79b63b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:38.163384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e146e09a-a8dc-44f6-97fd-7346dfe82b83 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:38.177401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:38.195259 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e146e09a-a8dc-44f6-97fd-7346dfe82b83 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.349267 Sep 07 12:53:38.210677 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2323/4593] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:37 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:38.234030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-febf2a95-51e3-4a93-8170-92509c79b63b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:38.240185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-887652fa-4809-4cc3-9b86-835d918f74b6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:38.244235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-febf2a95-51e3-4a93-8170-92509c79b63b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:38.244661 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-887652fa-4809-4cc3-9b86-835d918f74b6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:38.246566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-febf2a95-51e3-4a93-8170-92509c79b63b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:38.247919 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-febf2a95-51e3-4a93-8170-92509c79b63b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1366 microversion: 2.47 time: 0.247811 Sep 07 12:53:38.248983 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2271/4594] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:37 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:53:38.256237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-943f5cee-649e-49ee-b8fd-b61de4c98407 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:38.257095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-943f5cee-649e-49ee-b8fd-b61de4c98407 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:38.265204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-943f5cee-649e-49ee-b8fd-b61de4c98407 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:38.265817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-943f5cee-649e-49ee-b8fd-b61de4c98407 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:38.266629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-943f5cee-649e-49ee-b8fd-b61de4c98407 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:38.267463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-943f5cee-649e-49ee-b8fd-b61de4c98407 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:38.267949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-943f5cee-649e-49ee-b8fd-b61de4c98407 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:38.268386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-943f5cee-649e-49ee-b8fd-b61de4c98407 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:38.295541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-887652fa-4809-4cc3-9b86-835d918f74b6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:38.296492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-887652fa-4809-4cc3-9b86-835d918f74b6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:38.297299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-887652fa-4809-4cc3-9b86-835d918f74b6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:38.299120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-887652fa-4809-4cc3-9b86-835d918f74b6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:38.300474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-887652fa-4809-4cc3-9b86-835d918f74b6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:38.301468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-887652fa-4809-4cc3-9b86-835d918f74b6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:38.402856 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-887652fa-4809-4cc3-9b86-835d918f74b6 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190028 Sep 07 12:53:38.406394 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2324/4595] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:53:38 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:53:38.600862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-943f5cee-649e-49ee-b8fd-b61de4c98407 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:38.621087 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-943f5cee-649e-49ee-b8fd-b61de4c98407 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.370491 Sep 07 12:53:38.628149 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2272/4596] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:38 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:38.718922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d482a129-b2b0-4b06-8be4-733b8e5ed963 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:38.720327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d482a129-b2b0-4b06-8be4-733b8e5ed963 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:38.749374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d482a129-b2b0-4b06-8be4-733b8e5ed963 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:38.755610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d482a129-b2b0-4b06-8be4-733b8e5ed963 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:38.756849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d482a129-b2b0-4b06-8be4-733b8e5ed963 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:38.760197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d482a129-b2b0-4b06-8be4-733b8e5ed963 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:38.762293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d482a129-b2b0-4b06-8be4-733b8e5ed963 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:38.763188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d482a129-b2b0-4b06-8be4-733b8e5ed963 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:38.884505 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32b59e4b-6e78-4f8e-a860-d499d91446b9 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:38.886199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-32b59e4b-6e78-4f8e-a860-d499d91446b9 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:38.913199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32b59e4b-6e78-4f8e-a860-d499d91446b9 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:38.915704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32b59e4b-6e78-4f8e-a860-d499d91446b9 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:38.916642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32b59e4b-6e78-4f8e-a860-d499d91446b9 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:38.918199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32b59e4b-6e78-4f8e-a860-d499d91446b9 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:38.919338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32b59e4b-6e78-4f8e-a860-d499d91446b9 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:38.921708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32b59e4b-6e78-4f8e-a860-d499d91446b9 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:39.202672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d482a129-b2b0-4b06-8be4-733b8e5ed963 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:39.215308 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d482a129-b2b0-4b06-8be4-733b8e5ed963 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.504753 Sep 07 12:53:39.216138 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2325/4597] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:38 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:53:39.239883 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-390d64a8-c1e9-47d7-af63-31ecbe47c0f0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:53:39.247003 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-390d64a8-c1e9-47d7-af63-31ecbe47c0f0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Instance a7ea0a6d-7be8-4ff3-9d89-b4f28434ea65 has no mapping to a cell. Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-390d64a8-c1e9-47d7-af63-31ecbe47c0f0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/a7ea0a6d-7be8-4ff3-9d89-b4f28434ea65/action HTTP/1.1 Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 15 Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: {"os-stop": {}} Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance a7ea0a6d-7be8-4ff3-9d89-b4f28434ea65 has no mapping to a cell. Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'a7ea0a6d-7be8-4ff3-9d89-b4f28434ea65', 'body': {'os-stop': {}}} Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance a7ea0a6d-7be8-4ff3-9d89-b4f28434ea65 has no mapping to a cell. Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:53:39.254421 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7ea0a6d-7be8-4ff3-9d89-b4f28434ea65 has no mapping to a cell. Sep 07 12:53:39.258488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:39.258488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:39.258488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:39.258488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:39.258488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:39.258488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:39.258488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:53:39.258488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:53:39.258488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7ea0a6d-7be8-4ff3-9d89-b4f28434ea65 has no mapping to a cell. Sep 07 12:53:39.258488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:39.258488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-390d64a8-c1e9-47d7-af63-31ecbe47c0f0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 404 to user: Instance a7ea0a6d-7be8-4ff3-9d89-b4f28434ea65 has no mapping to a cell. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:53:39.258488 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-390d64a8-c1e9-47d7-af63-31ecbe47c0f0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers/a7ea0a6d-7be8-4ff3-9d89-b4f28434ea65/action" status: 404 len: 117 microversion: 2.1 time: 0.020940 Sep 07 12:53:39.260701 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2326/4598] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:53:39 2022] POST /compute/v2.1/servers/a7ea0a6d-7be8-4ff3-9d89-b4f28434ea65/action => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:53:39.261990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-32b59e4b-6e78-4f8e-a860-d499d91446b9 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:39.266471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2edd0efc-f900-4ccd-8ad7-b72375673004 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:39.267117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2edd0efc-f900-4ccd-8ad7-b72375673004 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:39.277543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2edd0efc-f900-4ccd-8ad7-b72375673004 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:39.277820 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2edd0efc-f900-4ccd-8ad7-b72375673004 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:39.278167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2edd0efc-f900-4ccd-8ad7-b72375673004 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:39.279599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2edd0efc-f900-4ccd-8ad7-b72375673004 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:39.280473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2edd0efc-f900-4ccd-8ad7-b72375673004 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:39.280850 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2edd0efc-f900-4ccd-8ad7-b72375673004 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:39.281551 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-32b59e4b-6e78-4f8e-a860-d499d91446b9 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:39.284804 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-32b59e4b-6e78-4f8e-a860-d499d91446b9 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:39.289817 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-32b59e4b-6e78-4f8e-a860-d499d91446b9 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.423967 Sep 07 12:53:39.307223 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2273/4599] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:38 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:39.329268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3d6f7f09-2b5d-4bad-b4a2-990bc2c22c13 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:39.333403 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3d6f7f09-2b5d-4bad-b4a2-990bc2c22c13 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:39.342592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d6f7f09-2b5d-4bad-b4a2-990bc2c22c13 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:39.343332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d6f7f09-2b5d-4bad-b4a2-990bc2c22c13 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:39.344528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d6f7f09-2b5d-4bad-b4a2-990bc2c22c13 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:39.344718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d6f7f09-2b5d-4bad-b4a2-990bc2c22c13 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:39.345298 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d6f7f09-2b5d-4bad-b4a2-990bc2c22c13 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:39.345864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d6f7f09-2b5d-4bad-b4a2-990bc2c22c13 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:39.352841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:39.510182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3d6f7f09-2b5d-4bad-b4a2-990bc2c22c13 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:39.531623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3d6f7f09-2b5d-4bad-b4a2-990bc2c22c13 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:39.533344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3d6f7f09-2b5d-4bad-b4a2-990bc2c22c13 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:39.534836 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3d6f7f09-2b5d-4bad-b4a2-990bc2c22c13 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1366 microversion: 2.47 time: 0.226006 Sep 07 12:53:39.549567 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2274/4600] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:39 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:39.549567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-72d90864-eccb-4a98-bc70-deedc53b1509 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:39.550981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-72d90864-eccb-4a98-bc70-deedc53b1509 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:39.569927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72d90864-eccb-4a98-bc70-deedc53b1509 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:39.570810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72d90864-eccb-4a98-bc70-deedc53b1509 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:39.571485 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72d90864-eccb-4a98-bc70-deedc53b1509 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:39.572719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72d90864-eccb-4a98-bc70-deedc53b1509 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:39.577716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72d90864-eccb-4a98-bc70-deedc53b1509 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:39.578648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72d90864-eccb-4a98-bc70-deedc53b1509 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:39.659388 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-72d90864-eccb-4a98-bc70-deedc53b1509 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121906 Sep 07 12:53:39.660403 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2275/4601] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:53:39 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:53:39.695100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2edd0efc-f900-4ccd-8ad7-b72375673004 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:39.716409 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2edd0efc-f900-4ccd-8ad7-b72375673004 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.454390 Sep 07 12:53:39.717548 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2327/4602] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:39 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:39.751253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f870d75a-0865-4134-b6bc-35630c772f29 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:39.752260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f870d75a-0865-4134-b6bc-35630c772f29 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:39.763056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f870d75a-0865-4134-b6bc-35630c772f29 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:39.774370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f870d75a-0865-4134-b6bc-35630c772f29 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:39.775496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f870d75a-0865-4134-b6bc-35630c772f29 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:39.776706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f870d75a-0865-4134-b6bc-35630c772f29 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:39.777471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f870d75a-0865-4134-b6bc-35630c772f29 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:39.778264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f870d75a-0865-4134-b6bc-35630c772f29 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:40.099103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f870d75a-0865-4134-b6bc-35630c772f29 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:40.110640 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f870d75a-0865-4134-b6bc-35630c772f29 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.363380 Sep 07 12:53:40.125659 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2276/4603] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:39 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:53:40.133872 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-07d39a20-612e-4f10-a53e-3c7bfc0a4cc8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:53:40.134758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-07d39a20-612e-4f10-a53e-3c7bfc0a4cc8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: d1a4bbbf-b8cc-462d-bd4a-cfdb26597732] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:40.141958 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-07d39a20-612e-4f10-a53e-3c7bfc0a4cc8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Instance d1a4bbbf-b8cc-462d-bd4a-cfdb26597732 could not be found. Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-07d39a20-612e-4f10-a53e-3c7bfc0a4cc8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/d1a4bbbf-b8cc-462d-bd4a-cfdb26597732/action HTTP/1.1 Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 15 Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: {"suspend": {}} Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance d1a4bbbf-b8cc-462d-bd4a-cfdb26597732 could not be found. Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'd1a4bbbf-b8cc-462d-bd4a-cfdb26597732', 'body': {'suspend': {}}} Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1a4bbbf-b8cc-462d-bd4a-cfdb26597732 could not be found. Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1a4bbbf-b8cc-462d-bd4a-cfdb26597732 could not be found. Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:40.143578 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:40.151528 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:53:40.151528 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:53:40.151528 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1a4bbbf-b8cc-462d-bd4a-cfdb26597732 could not be found. Sep 07 12:53:40.151528 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:40.151528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-07d39a20-612e-4f10-a53e-3c7bfc0a4cc8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 404 to user: Instance d1a4bbbf-b8cc-462d-bd4a-cfdb26597732 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:53:40.151528 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-07d39a20-612e-4f10-a53e-3c7bfc0a4cc8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers/d1a4bbbf-b8cc-462d-bd4a-cfdb26597732/action" status: 404 len: 111 microversion: 2.1 time: 0.015465 Sep 07 12:53:40.154401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3c872e69-8cbf-4be6-a953-b25743b1ce51 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:40.155040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3c872e69-8cbf-4be6-a953-b25743b1ce51 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:40.162287 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2328/4604] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:53:40 2022] POST /compute/v2.1/servers/d1a4bbbf-b8cc-462d-bd4a-cfdb26597732/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:53:40.175267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c872e69-8cbf-4be6-a953-b25743b1ce51 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:40.175787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c872e69-8cbf-4be6-a953-b25743b1ce51 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:40.176244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c872e69-8cbf-4be6-a953-b25743b1ce51 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:40.176993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c872e69-8cbf-4be6-a953-b25743b1ce51 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:40.177546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c872e69-8cbf-4be6-a953-b25743b1ce51 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:40.177985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c872e69-8cbf-4be6-a953-b25743b1ce51 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:40.350425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-24342a33-cecf-41e9-9ddb-a35ba6e017bc tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:40.358292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-24342a33-cecf-41e9-9ddb-a35ba6e017bc tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:40.402827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24342a33-cecf-41e9-9ddb-a35ba6e017bc tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:40.410291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24342a33-cecf-41e9-9ddb-a35ba6e017bc tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:40.412742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24342a33-cecf-41e9-9ddb-a35ba6e017bc tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:40.414599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24342a33-cecf-41e9-9ddb-a35ba6e017bc tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:40.419822 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24342a33-cecf-41e9-9ddb-a35ba6e017bc tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:40.420655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24342a33-cecf-41e9-9ddb-a35ba6e017bc tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:40.546824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3c872e69-8cbf-4be6-a953-b25743b1ce51 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:40.575200 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3c872e69-8cbf-4be6-a953-b25743b1ce51 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.423865 Sep 07 12:53:40.592966 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2277/4605] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:40 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:40.610153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-37bb3e64-d760-4241-b173-bdceb499ba23 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:40.614981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-37bb3e64-d760-4241-b173-bdceb499ba23 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:40.644309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37bb3e64-d760-4241-b173-bdceb499ba23 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:40.645200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37bb3e64-d760-4241-b173-bdceb499ba23 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:40.646031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37bb3e64-d760-4241-b173-bdceb499ba23 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:40.658387 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37bb3e64-d760-4241-b173-bdceb499ba23 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:40.659599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37bb3e64-d760-4241-b173-bdceb499ba23 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:40.661505 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37bb3e64-d760-4241-b173-bdceb499ba23 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:40.963760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37bb3e64-d760-4241-b173-bdceb499ba23 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:41.001957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37bb3e64-d760-4241-b173-bdceb499ba23 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:41.019689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37bb3e64-d760-4241-b173-bdceb499ba23 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:41.024993 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-37bb3e64-d760-4241-b173-bdceb499ba23 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1366 microversion: 2.47 time: 0.429938 Sep 07 12:53:41.028777 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2278/4606] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:40 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1366 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:41.055964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4e9cdac3-516e-461f-9259-617d9d1838a7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:41.057635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4e9cdac3-516e-461f-9259-617d9d1838a7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:41.096681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:41.101959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e9cdac3-516e-461f-9259-617d9d1838a7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:41.102893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e9cdac3-516e-461f-9259-617d9d1838a7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:41.108287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e9cdac3-516e-461f-9259-617d9d1838a7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:41.110748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e9cdac3-516e-461f-9259-617d9d1838a7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:41.111659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e9cdac3-516e-461f-9259-617d9d1838a7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:41.119419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e9cdac3-516e-461f-9259-617d9d1838a7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:41.178871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-24342a33-cecf-41e9-9ddb-a35ba6e017bc tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:41.218183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-24342a33-cecf-41e9-9ddb-a35ba6e017bc tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:41.226360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-24342a33-cecf-41e9-9ddb-a35ba6e017bc tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:41.233017 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-24342a33-cecf-41e9-9ddb-a35ba6e017bc tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1808 microversion: 2.20 time: 0.890043 Sep 07 12:53:41.237529 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2329/4607] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:40 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1808 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:41.273662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-20d800ef-5078-4b68-b0e6-e7ff3f1e3288 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:41.303250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-20d800ef-5078-4b68-b0e6-e7ff3f1e3288 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:41.350661 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20d800ef-5078-4b68-b0e6-e7ff3f1e3288 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:41.352539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20d800ef-5078-4b68-b0e6-e7ff3f1e3288 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:41.353684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20d800ef-5078-4b68-b0e6-e7ff3f1e3288 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:41.355698 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20d800ef-5078-4b68-b0e6-e7ff3f1e3288 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:41.357218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20d800ef-5078-4b68-b0e6-e7ff3f1e3288 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:41.358557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-20d800ef-5078-4b68-b0e6-e7ff3f1e3288 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:41.440557 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-20d800ef-5078-4b68-b0e6-e7ff3f1e3288 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.200656 Sep 07 12:53:41.442652 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2330/4608] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:53:41 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c/os-volume_attachments => generated 25 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:53:41.595596 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8573bf86-36f3-4ff8-aab9-e13de86b8ead tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:53:41.598392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8573bf86-36f3-4ff8-aab9-e13de86b8ead tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:41.607013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8573bf86-36f3-4ff8-aab9-e13de86b8ead tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:41.607827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8573bf86-36f3-4ff8-aab9-e13de86b8ead tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:41.608451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8573bf86-36f3-4ff8-aab9-e13de86b8ead tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:41.609529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8573bf86-36f3-4ff8-aab9-e13de86b8ead tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:41.610162 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8573bf86-36f3-4ff8-aab9-e13de86b8ead tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:41.610760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8573bf86-36f3-4ff8-aab9-e13de86b8ead tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:41.650388 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-8573bf86-36f3-4ff8-aab9-e13de86b8ead tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] HTTP exception thrown: Cannot 'reboot' instance f2c8a9c1-51cc-4b6c-9b68-6ec76021310e while it is in vm_state rescued Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8573bf86-36f3-4ff8-aab9-e13de86b8ead tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Request method failure captured: Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e/action HTTP/1.1 Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 28 Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJKZVQHWlJ74Dx2W8ZEdML0xF-2AOg7c1kyx3sCL0Z6KLQM5ezA45HggvILiFiNDg07ylWr0Vwzz5BQco3_h-9AY0fLV1Rv4K5sggvhMC6zI5NaP-U7NrDZHMoSQThjt2D27IAAoa8B5_g5vq1oNty_s1bxD15UYFAJm0Q--CvZRoS0 Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 256a95a81360419dbaf33382dd369262 Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1632514538 Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/256a95a81360419dbaf33382dd369262"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_256a95a81360419dbaf33382dd369262"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/256a95a81360419dbaf33382dd369262"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/256a95a81360419dbaf33382dd369262"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1632514538 Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 256a95a81360419dbaf33382dd369262 Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1632514538 Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerRescueNegativeTestJSON-1632514538-project Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: a6d92e694e984ad8b126b94ed8effb3f Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1632514538-project Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: {"reboot": {"type": "HARD"}} Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: exception: Cannot 'reboot' instance f2c8a9c1-51cc-4b6c-9b68-6ec76021310e while it is in vm_state rescued Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'f2c8a9c1-51cc-4b6c-9b68-6ec76021310e', 'body': {'reboot': {'type': 'HARD'}}} Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f2c8a9c1-51cc-4b6c-9b68-6ec76021310e in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 12:53:41.654227 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 12:53:41.658262 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance f2c8a9c1-51cc-4b6c-9b68-6ec76021310e while it is in vm_state rescued Sep 07 12:53:41.658262 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:41.658262 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:41.658262 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:41.658262 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:41.658262 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:41.658262 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:41.658262 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:53:41.658262 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:53:41.658262 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance f2c8a9c1-51cc-4b6c-9b68-6ec76021310e while it is in vm_state rescued Sep 07 12:53:41.658262 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:41.663477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8573bf86-36f3-4ff8-aab9-e13de86b8ead tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Returning 409 to user: Cannot 'reboot' instance f2c8a9c1-51cc-4b6c-9b68-6ec76021310e while it is in vm_state rescued {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:53:41.666225 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8573bf86-36f3-4ff8-aab9-e13de86b8ead tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "POST /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e/action" status: 409 len: 145 microversion: 2.1 time: 0.081103 Sep 07 12:53:41.667408 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2331/4609] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:53:41 2022] POST /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e/action => generated 145 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:53:41.677906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4e9cdac3-516e-461f-9259-617d9d1838a7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:41.701101 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4e9cdac3-516e-461f-9259-617d9d1838a7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.670134 Sep 07 12:53:41.701775 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2279/4610] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:41 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:41.729153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f4d86cc6-20a7-439c-9caa-10080fba87d7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:53:41.743989 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7b0ac376-d393-458b-8cda-39df62eb5e57 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:53:41.744621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7b0ac376-d393-458b-8cda-39df62eb5e57 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:41.753459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b0ac376-d393-458b-8cda-39df62eb5e57 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:41.754127 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f4d86cc6-20a7-439c-9caa-10080fba87d7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:41.755829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b0ac376-d393-458b-8cda-39df62eb5e57 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:41.756805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b0ac376-d393-458b-8cda-39df62eb5e57 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:41.758355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b0ac376-d393-458b-8cda-39df62eb5e57 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:41.759041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b0ac376-d393-458b-8cda-39df62eb5e57 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:41.759637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b0ac376-d393-458b-8cda-39df62eb5e57 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:41.766447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4d86cc6-20a7-439c-9caa-10080fba87d7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:41.776459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4d86cc6-20a7-439c-9caa-10080fba87d7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:41.786435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4d86cc6-20a7-439c-9caa-10080fba87d7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:41.787435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4d86cc6-20a7-439c-9caa-10080fba87d7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:41.788058 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4d86cc6-20a7-439c-9caa-10080fba87d7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:41.788622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4d86cc6-20a7-439c-9caa-10080fba87d7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:41.793908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-7b0ac376-d393-458b-8cda-39df62eb5e57 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lazy-loading 'flavor' on Instance uuid 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:53:41.864075 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-f4d86cc6-20a7-439c-9caa-10080fba87d7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] HTTP exception thrown: Cannot 'rebuild' instance f2c8a9c1-51cc-4b6c-9b68-6ec76021310e while it is in vm_state rescued Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f4d86cc6-20a7-439c-9caa-10080fba87d7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Request method failure captured: Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e/action HTTP/1.1 Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 65 Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJKZVQHWlJ74Dx2W8ZEdML0xF-2AOg7c1kyx3sCL0Z6KLQM5ezA45HggvILiFiNDg07ylWr0Vwzz5BQco3_h-9AY0fLV1Rv4K5sggvhMC6zI5NaP-U7NrDZHMoSQThjt2D27IAAoa8B5_g5vq1oNty_s1bxD15UYFAJm0Q--CvZRoS0 Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 256a95a81360419dbaf33382dd369262 Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1632514538 Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/256a95a81360419dbaf33382dd369262"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_256a95a81360419dbaf33382dd369262"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/256a95a81360419dbaf33382dd369262"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/256a95a81360419dbaf33382dd369262"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1632514538 Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 256a95a81360419dbaf33382dd369262 Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1632514538 Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerRescueNegativeTestJSON-1632514538-project Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: a6d92e694e984ad8b126b94ed8effb3f Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1632514538-project Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: {"rebuild": {"imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f"}} Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: exception: Cannot 'rebuild' instance f2c8a9c1-51cc-4b6c-9b68-6ec76021310e while it is in vm_state rescued Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'f2c8a9c1-51cc-4b6c-9b68-6ec76021310e', 'body': {'rebuild': {'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f'}}} Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f2c8a9c1-51cc-4b6c-9b68-6ec76021310e in vm_state rescued. Cannot rebuild while the instance is in this state. Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:53:41.867131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:53:41.871445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:53:41.871445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 07 12:53:41.871445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Sep 07 12:53:41.871445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 12:53:41.871445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 12:53:41.871445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 12:53:41.871445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance f2c8a9c1-51cc-4b6c-9b68-6ec76021310e while it is in vm_state rescued Sep 07 12:53:41.871445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:41.871445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:41.871445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:41.871445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:41.871445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:41.871445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:41.871445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:53:41.871445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:53:41.871445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance f2c8a9c1-51cc-4b6c-9b68-6ec76021310e while it is in vm_state rescued Sep 07 12:53:41.871445 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:41.879111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f4d86cc6-20a7-439c-9caa-10080fba87d7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Returning 409 to user: Cannot 'rebuild' instance f2c8a9c1-51cc-4b6c-9b68-6ec76021310e while it is in vm_state rescued {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:53:41.880384 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f4d86cc6-20a7-439c-9caa-10080fba87d7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "POST /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e/action" status: 409 len: 146 microversion: 2.1 time: 0.187502 Sep 07 12:53:41.881310 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2332/4611] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:53:41 2022] POST /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e/action => generated 146 bytes in 195 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:53:41.897800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9c0e047e-f431-45d6-9472-14d7b09fecb0 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:41.898781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9c0e047e-f431-45d6-9472-14d7b09fecb0 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:41.914963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c0e047e-f431-45d6-9472-14d7b09fecb0 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:41.925526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c0e047e-f431-45d6-9472-14d7b09fecb0 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:41.926386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c0e047e-f431-45d6-9472-14d7b09fecb0 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:41.927559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c0e047e-f431-45d6-9472-14d7b09fecb0 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:41.928339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c0e047e-f431-45d6-9472-14d7b09fecb0 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:41.929199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c0e047e-f431-45d6-9472-14d7b09fecb0 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:41.995769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9c0e047e-f431-45d6-9472-14d7b09fecb0 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:53:42.082659 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7b0ac376-d393-458b-8cda-39df62eb5e57 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action" status: 202 len: 0 microversion: 2.1 time: 0.359465 Sep 07 12:53:42.090929 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2280/4612] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:53:41 2022] POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:53:42.130033 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ecb16cae-9027-4be9-abe0-21f0b27f7e35 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:42.142873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ecb16cae-9027-4be9-abe0-21f0b27f7e35 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:42.170905 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecb16cae-9027-4be9-abe0-21f0b27f7e35 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:42.172325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecb16cae-9027-4be9-abe0-21f0b27f7e35 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:42.173721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecb16cae-9027-4be9-abe0-21f0b27f7e35 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:42.174752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecb16cae-9027-4be9-abe0-21f0b27f7e35 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:42.175613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecb16cae-9027-4be9-abe0-21f0b27f7e35 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:42.176436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecb16cae-9027-4be9-abe0-21f0b27f7e35 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:42.220894 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9c0e047e-f431-45d6-9472-14d7b09fecb0 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 204 len: 0 microversion: 2.1 time: 0.329897 Sep 07 12:53:42.222195 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2333/4613] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:53:41 2022] DELETE /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 12:53:42.232216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9350d771-4221-4bb2-9227-8935cf0fc91b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:42.234033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9350d771-4221-4bb2-9227-8935cf0fc91b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:42.250153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9350d771-4221-4bb2-9227-8935cf0fc91b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:42.251373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9350d771-4221-4bb2-9227-8935cf0fc91b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:42.252279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9350d771-4221-4bb2-9227-8935cf0fc91b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:42.253145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9350d771-4221-4bb2-9227-8935cf0fc91b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:42.253791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9350d771-4221-4bb2-9227-8935cf0fc91b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:42.255633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9350d771-4221-4bb2-9227-8935cf0fc91b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:42.515343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ecb16cae-9027-4be9-abe0-21f0b27f7e35 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:42.528572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ecb16cae-9027-4be9-abe0-21f0b27f7e35 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:42.533958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ecb16cae-9027-4be9-abe0-21f0b27f7e35 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:42.538916 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ecb16cae-9027-4be9-abe0-21f0b27f7e35 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1366 microversion: 2.47 time: 0.446086 Sep 07 12:53:42.541415 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2281/4614] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:42 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1366 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:42.553970 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1b6d91d4-896b-4135-b616-8bd87ca1b1e1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:42.559797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1b6d91d4-896b-4135-b616-8bd87ca1b1e1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:42.573581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b6d91d4-896b-4135-b616-8bd87ca1b1e1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:42.577078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b6d91d4-896b-4135-b616-8bd87ca1b1e1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:42.577728 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b6d91d4-896b-4135-b616-8bd87ca1b1e1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:42.579392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b6d91d4-896b-4135-b616-8bd87ca1b1e1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:42.584142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b6d91d4-896b-4135-b616-8bd87ca1b1e1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:42.584701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b6d91d4-896b-4135-b616-8bd87ca1b1e1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:42.664227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9350d771-4221-4bb2-9227-8935cf0fc91b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:42.673679 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9350d771-4221-4bb2-9227-8935cf0fc91b tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1513 microversion: 2.1 time: 0.449577 Sep 07 12:53:42.674608 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2334/4615] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:42 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1513 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:42.680311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4c2ce1bc-8e45-464d-8482-7353b6cb9cfa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:42.681319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4c2ce1bc-8e45-464d-8482-7353b6cb9cfa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:42.700711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c2ce1bc-8e45-464d-8482-7353b6cb9cfa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:42.701826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c2ce1bc-8e45-464d-8482-7353b6cb9cfa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:42.702593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c2ce1bc-8e45-464d-8482-7353b6cb9cfa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:42.708106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c2ce1bc-8e45-464d-8482-7353b6cb9cfa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:42.708734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c2ce1bc-8e45-464d-8482-7353b6cb9cfa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:42.709291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c2ce1bc-8e45-464d-8482-7353b6cb9cfa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:42.937288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1b6d91d4-896b-4135-b616-8bd87ca1b1e1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:42.950333 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1b6d91d4-896b-4135-b616-8bd87ca1b1e1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1687 microversion: 2.1 time: 0.406902 Sep 07 12:53:42.952097 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2282/4616] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:42 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1687 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:43.030227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4c2ce1bc-8e45-464d-8482-7353b6cb9cfa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:43.041711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4c2ce1bc-8e45-464d-8482-7353b6cb9cfa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:43.043986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4c2ce1bc-8e45-464d-8482-7353b6cb9cfa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:43.045824 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4c2ce1bc-8e45-464d-8482-7353b6cb9cfa tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1795 microversion: 2.20 time: 0.369865 Sep 07 12:53:43.047317 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2335/4617] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:42 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1795 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:43.572687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bf597900-5570-4ca8-aeab-014b20ab26ad tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:43.575503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bf597900-5570-4ca8-aeab-014b20ab26ad tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:43.588185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf597900-5570-4ca8-aeab-014b20ab26ad tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:43.588693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf597900-5570-4ca8-aeab-014b20ab26ad tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:43.589154 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf597900-5570-4ca8-aeab-014b20ab26ad tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:43.590006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf597900-5570-4ca8-aeab-014b20ab26ad tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:43.590682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf597900-5570-4ca8-aeab-014b20ab26ad tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:43.591345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf597900-5570-4ca8-aeab-014b20ab26ad tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:43.696384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bf597900-5570-4ca8-aeab-014b20ab26ad tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:43.712285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bf597900-5570-4ca8-aeab-014b20ab26ad tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:43.714898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bf597900-5570-4ca8-aeab-014b20ab26ad tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:43.715628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-297e046d-b351-4fa3-82b5-cb6a65f3ff71 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:43.716574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-297e046d-b351-4fa3-82b5-cb6a65f3ff71 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:43.717773 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bf597900-5570-4ca8-aeab-014b20ab26ad tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1366 microversion: 2.47 time: 0.149420 Sep 07 12:53:43.719201 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2283/4618] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:43 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:53:43.733815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-297e046d-b351-4fa3-82b5-cb6a65f3ff71 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:43.736466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-297e046d-b351-4fa3-82b5-cb6a65f3ff71 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:43.737289 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-297e046d-b351-4fa3-82b5-cb6a65f3ff71 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:43.738540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-297e046d-b351-4fa3-82b5-cb6a65f3ff71 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:43.739262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-297e046d-b351-4fa3-82b5-cb6a65f3ff71 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:43.739842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-297e046d-b351-4fa3-82b5-cb6a65f3ff71 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:43.979800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-297e046d-b351-4fa3-82b5-cb6a65f3ff71 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:43.992543 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-297e046d-b351-4fa3-82b5-cb6a65f3ff71 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1513 microversion: 2.1 time: 0.281325 Sep 07 12:53:43.993671 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2336/4619] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:43 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1513 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:43.994312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1fca285b-49c2-4119-9333-d46217361fc4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:43.995562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1fca285b-49c2-4119-9333-d46217361fc4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:44.004032 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fca285b-49c2-4119-9333-d46217361fc4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:44.005065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fca285b-49c2-4119-9333-d46217361fc4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:44.005746 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fca285b-49c2-4119-9333-d46217361fc4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:44.006754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fca285b-49c2-4119-9333-d46217361fc4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:44.007532 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fca285b-49c2-4119-9333-d46217361fc4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:44.008127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fca285b-49c2-4119-9333-d46217361fc4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:44.227062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1fca285b-49c2-4119-9333-d46217361fc4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:44.241621 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1fca285b-49c2-4119-9333-d46217361fc4 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1687 microversion: 2.1 time: 0.251976 Sep 07 12:53:44.243053 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2284/4620] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:43 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1687 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:53:44.754223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-58e21b8d-743e-434e-b82a-fa42cab796ee tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:44.755686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-58e21b8d-743e-434e-b82a-fa42cab796ee tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:44.768097 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58e21b8d-743e-434e-b82a-fa42cab796ee tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:44.768866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58e21b8d-743e-434e-b82a-fa42cab796ee tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:44.769532 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58e21b8d-743e-434e-b82a-fa42cab796ee tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:44.770499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58e21b8d-743e-434e-b82a-fa42cab796ee tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:44.771126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58e21b8d-743e-434e-b82a-fa42cab796ee tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:44.771830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58e21b8d-743e-434e-b82a-fa42cab796ee tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:44.880129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-58e21b8d-743e-434e-b82a-fa42cab796ee tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:44.906717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-58e21b8d-743e-434e-b82a-fa42cab796ee tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:44.907973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-58e21b8d-743e-434e-b82a-fa42cab796ee tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:44.912380 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-58e21b8d-743e-434e-b82a-fa42cab796ee tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1366 microversion: 2.47 time: 0.161067 Sep 07 12:53:44.912380 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2337/4621] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:44 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:45.026346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ffb3aded-3ef4-4fa7-a158-f1fc63a04f5d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:45.027601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ffb3aded-3ef4-4fa7-a158-f1fc63a04f5d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:45.049638 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffb3aded-3ef4-4fa7-a158-f1fc63a04f5d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:45.051197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffb3aded-3ef4-4fa7-a158-f1fc63a04f5d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:45.057588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffb3aded-3ef4-4fa7-a158-f1fc63a04f5d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:45.057588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffb3aded-3ef4-4fa7-a158-f1fc63a04f5d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:45.057588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffb3aded-3ef4-4fa7-a158-f1fc63a04f5d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:45.057588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ffb3aded-3ef4-4fa7-a158-f1fc63a04f5d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:45.289527 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9a8457a8-a119-4549-a5f4-2fff66a3ac37 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:45.291253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9a8457a8-a119-4549-a5f4-2fff66a3ac37 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:45.294857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ffb3aded-3ef4-4fa7-a158-f1fc63a04f5d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:45.303473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a8457a8-a119-4549-a5f4-2fff66a3ac37 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:45.304439 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ffb3aded-3ef4-4fa7-a158-f1fc63a04f5d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1513 microversion: 2.1 time: 0.288004 Sep 07 12:53:45.305124 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2285/4622] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:45 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1513 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:45.305393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a8457a8-a119-4549-a5f4-2fff66a3ac37 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:45.306460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a8457a8-a119-4549-a5f4-2fff66a3ac37 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:45.307997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a8457a8-a119-4549-a5f4-2fff66a3ac37 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:45.309080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a8457a8-a119-4549-a5f4-2fff66a3ac37 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:45.310111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a8457a8-a119-4549-a5f4-2fff66a3ac37 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:45.546050 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9a8457a8-a119-4549-a5f4-2fff66a3ac37 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:45.564915 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9a8457a8-a119-4549-a5f4-2fff66a3ac37 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1687 microversion: 2.1 time: 0.283439 Sep 07 12:53:45.566408 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2338/4623] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:45 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1687 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:45.940138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eb765f4b-741f-4b94-8319-715c161ff1a6 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:45.941812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eb765f4b-741f-4b94-8319-715c161ff1a6 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:45.956448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb765f4b-741f-4b94-8319-715c161ff1a6 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:45.959994 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb765f4b-741f-4b94-8319-715c161ff1a6 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:45.961104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb765f4b-741f-4b94-8319-715c161ff1a6 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:45.962339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb765f4b-741f-4b94-8319-715c161ff1a6 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:45.964948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb765f4b-741f-4b94-8319-715c161ff1a6 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:45.965951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb765f4b-741f-4b94-8319-715c161ff1a6 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:46.127652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eb765f4b-741f-4b94-8319-715c161ff1a6 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:46.146255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eb765f4b-741f-4b94-8319-715c161ff1a6 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:46.146255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eb765f4b-741f-4b94-8319-715c161ff1a6 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:46.149993 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eb765f4b-741f-4b94-8319-715c161ff1a6 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1366 microversion: 2.47 time: 0.215782 Sep 07 12:53:46.166297 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2286/4624] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:45 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:46.335239 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4dd87d1c-8ec3-4c1d-960a-b04aac0033bc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:46.338499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4dd87d1c-8ec3-4c1d-960a-b04aac0033bc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:46.351824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4dd87d1c-8ec3-4c1d-960a-b04aac0033bc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:46.352768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4dd87d1c-8ec3-4c1d-960a-b04aac0033bc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:46.353445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4dd87d1c-8ec3-4c1d-960a-b04aac0033bc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:46.354605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4dd87d1c-8ec3-4c1d-960a-b04aac0033bc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:46.355353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4dd87d1c-8ec3-4c1d-960a-b04aac0033bc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:46.355950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4dd87d1c-8ec3-4c1d-960a-b04aac0033bc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:46.599971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f27bd670-8173-47af-a56a-c50904852cbe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:46.601733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f27bd670-8173-47af-a56a-c50904852cbe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:46.615120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f27bd670-8173-47af-a56a-c50904852cbe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:46.616369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f27bd670-8173-47af-a56a-c50904852cbe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:46.617442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f27bd670-8173-47af-a56a-c50904852cbe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:46.619170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f27bd670-8173-47af-a56a-c50904852cbe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:46.620344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f27bd670-8173-47af-a56a-c50904852cbe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:46.621278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f27bd670-8173-47af-a56a-c50904852cbe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:46.658887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4dd87d1c-8ec3-4c1d-960a-b04aac0033bc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:46.679549 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4dd87d1c-8ec3-4c1d-960a-b04aac0033bc tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1496 microversion: 2.1 time: 0.353706 Sep 07 12:53:46.686893 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2339/4625] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:46 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1496 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:46.719058 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ace676c-e812-4819-b4f2-32a669e91e52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:53:46.720476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3ace676c-e812-4819-b4f2-32a669e91e52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:46.734045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ace676c-e812-4819-b4f2-32a669e91e52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:46.734893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ace676c-e812-4819-b4f2-32a669e91e52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:46.735922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ace676c-e812-4819-b4f2-32a669e91e52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:46.737474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ace676c-e812-4819-b4f2-32a669e91e52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:46.738366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ace676c-e812-4819-b4f2-32a669e91e52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:46.740390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ace676c-e812-4819-b4f2-32a669e91e52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:46.801249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-3ace676c-e812-4819-b4f2-32a669e91e52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lazy-loading 'flavor' on Instance uuid 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:53:46.829609 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-3ace676c-e812-4819-b4f2-32a669e91e52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Cannot 'suspend' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state suspended Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ace676c-e812-4819-b4f2-32a669e91e52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action HTTP/1.1 Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 15 Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: {"suspend": {}} Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: exception: Cannot 'suspend' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state suspended Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860', 'body': {'suspend': {}}} Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 in vm_state suspended. Cannot suspend while the instance is in this state. Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Sep 07 12:53:46.833102 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 12:53:46.840393 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 12:53:46.840393 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 12:53:46.840393 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state suspended Sep 07 12:53:46.840393 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:46.840393 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:46.840393 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:46.840393 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:46.840393 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:46.840393 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:46.840393 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:53:46.840393 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:53:46.840393 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state suspended Sep 07 12:53:46.840393 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:46.840393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ace676c-e812-4819-b4f2-32a669e91e52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 409 to user: Cannot 'suspend' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state suspended {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:53:46.840393 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ace676c-e812-4819-b4f2-32a669e91e52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action" status: 409 len: 148 microversion: 2.1 time: 0.126168 Sep 07 12:53:46.840393 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2340/4626] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:53:46 2022] POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action => generated 148 bytes in 129 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:53:46.858129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6cbba94f-b622-4462-8a56-99b6fadf2af0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:53:46.859356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6cbba94f-b622-4462-8a56-99b6fadf2af0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:46.873659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cbba94f-b622-4462-8a56-99b6fadf2af0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:46.874923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cbba94f-b622-4462-8a56-99b6fadf2af0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:46.876153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cbba94f-b622-4462-8a56-99b6fadf2af0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:46.878910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cbba94f-b622-4462-8a56-99b6fadf2af0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:46.881321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cbba94f-b622-4462-8a56-99b6fadf2af0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:46.881744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cbba94f-b622-4462-8a56-99b6fadf2af0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:46.938352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:47.068048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f27bd670-8173-47af-a56a-c50904852cbe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:47.088998 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f27bd670-8173-47af-a56a-c50904852cbe tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1687 microversion: 2.1 time: 0.500480 Sep 07 12:53:47.091310 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2287/4627] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:46 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1687 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:47.114067 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6cbba94f-b622-4462-8a56-99b6fadf2af0 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action" status: 202 len: 0 microversion: 2.1 time: 0.269827 Sep 07 12:53:47.117195 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2341/4628] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:53:46 2022] POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:53:47.132041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e2656371-a9e1-4db9-bb91-96f2c6466f6f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:47.135387 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e2656371-a9e1-4db9-bb91-96f2c6466f6f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:47.162111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2656371-a9e1-4db9-bb91-96f2c6466f6f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:47.166614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2656371-a9e1-4db9-bb91-96f2c6466f6f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:47.167728 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2656371-a9e1-4db9-bb91-96f2c6466f6f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:47.170489 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2656371-a9e1-4db9-bb91-96f2c6466f6f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:47.171757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2656371-a9e1-4db9-bb91-96f2c6466f6f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:47.174351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2656371-a9e1-4db9-bb91-96f2c6466f6f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:47.194577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-94882287-abbe-4d11-90ef-7d8b121c1852 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:47.198047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-94882287-abbe-4d11-90ef-7d8b121c1852 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:47.230806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94882287-abbe-4d11-90ef-7d8b121c1852 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:47.231978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94882287-abbe-4d11-90ef-7d8b121c1852 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:47.233294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94882287-abbe-4d11-90ef-7d8b121c1852 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:47.237143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94882287-abbe-4d11-90ef-7d8b121c1852 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:47.240255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94882287-abbe-4d11-90ef-7d8b121c1852 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:47.241016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94882287-abbe-4d11-90ef-7d8b121c1852 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:47.481936 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-94882287-abbe-4d11-90ef-7d8b121c1852 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:47.494419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-94882287-abbe-4d11-90ef-7d8b121c1852 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:47.501597 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-94882287-abbe-4d11-90ef-7d8b121c1852 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:47.504318 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-94882287-abbe-4d11-90ef-7d8b121c1852 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1372 microversion: 2.47 time: 0.325162 Sep 07 12:53:47.517530 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2342/4629] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:47 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1372 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:53:47.751193 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e2656371-a9e1-4db9-bb91-96f2c6466f6f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:47.780006 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e2656371-a9e1-4db9-bb91-96f2c6466f6f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1502 microversion: 2.1 time: 0.658444 Sep 07 12:53:47.783427 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2288/4630] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:47 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1502 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:48.117962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-489038c7-3126-4713-b2f0-da672f0cdf03 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:48.119417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-489038c7-3126-4713-b2f0-da672f0cdf03 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:48.135337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-489038c7-3126-4713-b2f0-da672f0cdf03 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:48.135877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-489038c7-3126-4713-b2f0-da672f0cdf03 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:48.136323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-489038c7-3126-4713-b2f0-da672f0cdf03 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:48.137074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-489038c7-3126-4713-b2f0-da672f0cdf03 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:48.137584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-489038c7-3126-4713-b2f0-da672f0cdf03 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:48.138034 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-489038c7-3126-4713-b2f0-da672f0cdf03 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:48.477966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-489038c7-3126-4713-b2f0-da672f0cdf03 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:48.493306 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-489038c7-3126-4713-b2f0-da672f0cdf03 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1687 microversion: 2.1 time: 0.381096 Sep 07 12:53:48.529860 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2343/4631] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:48 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1687 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:48.555707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e4ec27c5-c2e6-439f-9987-f8f08a22f967 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:48.556568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e4ec27c5-c2e6-439f-9987-f8f08a22f967 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:48.568074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4ec27c5-c2e6-439f-9987-f8f08a22f967 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:48.568596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4ec27c5-c2e6-439f-9987-f8f08a22f967 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:48.569158 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4ec27c5-c2e6-439f-9987-f8f08a22f967 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:48.569953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4ec27c5-c2e6-439f-9987-f8f08a22f967 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:48.570431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4ec27c5-c2e6-439f-9987-f8f08a22f967 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:48.570866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4ec27c5-c2e6-439f-9987-f8f08a22f967 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:48.579748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:48.812778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-61843c71-421a-4555-a5f6-31b627265b6c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:48.813913 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-61843c71-421a-4555-a5f6-31b627265b6c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:48.830263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61843c71-421a-4555-a5f6-31b627265b6c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:48.830745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61843c71-421a-4555-a5f6-31b627265b6c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:48.831210 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61843c71-421a-4555-a5f6-31b627265b6c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:48.832501 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61843c71-421a-4555-a5f6-31b627265b6c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:48.832501 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61843c71-421a-4555-a5f6-31b627265b6c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:48.833823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61843c71-421a-4555-a5f6-31b627265b6c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:49.360571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e4ec27c5-c2e6-439f-9987-f8f08a22f967 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:49.374742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e4ec27c5-c2e6-439f-9987-f8f08a22f967 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:49.383697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e4ec27c5-c2e6-439f-9987-f8f08a22f967 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:49.384980 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e4ec27c5-c2e6-439f-9987-f8f08a22f967 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1372 microversion: 2.47 time: 0.843453 Sep 07 12:53:49.395335 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2289/4632] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:48 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1372 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:49.418934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-4171268d-c0be-48bd-ad21-8ebaf6a4bff4 req-a5633454-19b7-472b-acc8-81ebf4d4af2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b52328c-937b-46cf-abdf-8629194fc25c", "name": "network-vif-deleted", "tag": "3adf0f69-1af4-4072-9454-5e1b89d8b2f7"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:53:49.468571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4171268d-c0be-48bd-ad21-8ebaf6a4bff4 req-a5633454-19b7-472b-acc8-81ebf4d4af2e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:49.469458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4171268d-c0be-48bd-ad21-8ebaf6a4bff4 req-a5633454-19b7-472b-acc8-81ebf4d4af2e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:49.470278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4171268d-c0be-48bd-ad21-8ebaf6a4bff4 req-a5633454-19b7-472b-acc8-81ebf4d4af2e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:49.523713 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-4171268d-c0be-48bd-ad21-8ebaf6a4bff4 req-a5633454-19b7-472b-acc8-81ebf4d4af2e service nova] Creating event network-vif-deleted:3adf0f69-1af4-4072-9454-5e1b89d8b2f7 for instance 4b52328c-937b-46cf-abdf-8629194fc25c on n-h1-852087-9 Sep 07 12:53:49.539315 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-4171268d-c0be-48bd-ad21-8ebaf6a4bff4 req-a5633454-19b7-472b-acc8-81ebf4d4af2e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141773 Sep 07 12:53:49.540449 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2290/4633] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:53:49.568050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5896b5a8-1b5c-49f3-aa83-aa39124e0e78 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:49.569121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5896b5a8-1b5c-49f3-aa83-aa39124e0e78 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:49.581735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5896b5a8-1b5c-49f3-aa83-aa39124e0e78 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:49.582393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5896b5a8-1b5c-49f3-aa83-aa39124e0e78 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:49.583056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5896b5a8-1b5c-49f3-aa83-aa39124e0e78 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:49.583814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5896b5a8-1b5c-49f3-aa83-aa39124e0e78 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:49.584317 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5896b5a8-1b5c-49f3-aa83-aa39124e0e78 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:49.584886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5896b5a8-1b5c-49f3-aa83-aa39124e0e78 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:49.598949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-61843c71-421a-4555-a5f6-31b627265b6c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:49.615583 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-61843c71-421a-4555-a5f6-31b627265b6c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1502 microversion: 2.1 time: 0.807325 Sep 07 12:53:49.629525 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2344/4634] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:48 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1502 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:53:49.667099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5896b5a8-1b5c-49f3-aa83-aa39124e0e78 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:49.667601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5896b5a8-1b5c-49f3-aa83-aa39124e0e78 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:49.668059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5896b5a8-1b5c-49f3-aa83-aa39124e0e78 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:49.673136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-5896b5a8-1b5c-49f3-aa83-aa39124e0e78 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lazy-loading 'fault' on Instance uuid 4b52328c-937b-46cf-abdf-8629194fc25c {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:53:49.747626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5896b5a8-1b5c-49f3-aa83-aa39124e0e78 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:49.757688 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5896b5a8-1b5c-49f3-aa83-aa39124e0e78 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 200 len: 1334 microversion: 2.1 time: 0.205715 Sep 07 12:53:49.759385 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2291/4635] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:49 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 1334 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:53:50.432881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-37665228-7f67-4bbf-a43a-a21074d8f41c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:50.433857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-37665228-7f67-4bbf-a43a-a21074d8f41c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:50.443759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37665228-7f67-4bbf-a43a-a21074d8f41c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:50.444636 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37665228-7f67-4bbf-a43a-a21074d8f41c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:50.444972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37665228-7f67-4bbf-a43a-a21074d8f41c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:50.446175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37665228-7f67-4bbf-a43a-a21074d8f41c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:50.447353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37665228-7f67-4bbf-a43a-a21074d8f41c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:50.447974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37665228-7f67-4bbf-a43a-a21074d8f41c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:50.572815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-37665228-7f67-4bbf-a43a-a21074d8f41c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:50.585825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-37665228-7f67-4bbf-a43a-a21074d8f41c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:50.588895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-37665228-7f67-4bbf-a43a-a21074d8f41c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:50.591106 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-37665228-7f67-4bbf-a43a-a21074d8f41c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1357 microversion: 2.47 time: 0.162446 Sep 07 12:53:50.613946 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2345/4636] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:50 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:50.629375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-61d24a78-c433-4d3b-b23b-c38ac76a211a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:50.643651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-61d24a78-c433-4d3b-b23b-c38ac76a211a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:50.657175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-61d24a78-c433-4d3b-b23b-c38ac76a211a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Searching by: {'deleted': False, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea'} {{(pid=122432) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 12:53:50.661797 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-657d3e46-eed9-4fba-88d8-81bef349d831 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:50.662728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-657d3e46-eed9-4fba-88d8-81bef349d831 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:50.675680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61d24a78-c433-4d3b-b23b-c38ac76a211a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:50.680381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-657d3e46-eed9-4fba-88d8-81bef349d831 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:50.681547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-657d3e46-eed9-4fba-88d8-81bef349d831 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:50.681850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61d24a78-c433-4d3b-b23b-c38ac76a211a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:50.682485 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61d24a78-c433-4d3b-b23b-c38ac76a211a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:50.683566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61d24a78-c433-4d3b-b23b-c38ac76a211a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:50.683720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-657d3e46-eed9-4fba-88d8-81bef349d831 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:50.684344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-657d3e46-eed9-4fba-88d8-81bef349d831 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:50.684507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61d24a78-c433-4d3b-b23b-c38ac76a211a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:50.684821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-657d3e46-eed9-4fba-88d8-81bef349d831 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:50.685246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61d24a78-c433-4d3b-b23b-c38ac76a211a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:50.687680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-657d3e46-eed9-4fba-88d8-81bef349d831 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:50.987422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.multi_cell_list [None req-61d24a78-c433-4d3b-b23b-c38ac76a211a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 12:53:51.217754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-61d24a78-c433-4d3b-b23b-c38ac76a211a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:51.229384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61d24a78-c433-4d3b-b23b-c38ac76a211a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:51.230195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61d24a78-c433-4d3b-b23b-c38ac76a211a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:51.230793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-61d24a78-c433-4d3b-b23b-c38ac76a211a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:51.249625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-61d24a78-c433-4d3b-b23b-c38ac76a211a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:51.251692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-61d24a78-c433-4d3b-b23b-c38ac76a211a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:51.546613 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-61d24a78-c433-4d3b-b23b-c38ac76a211a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.921381 Sep 07 12:53:51.562086 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2292/4637] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Sep 7 12:53:50 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:51.567105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4b324772-c229-4497-aee3-5406592463e1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:51.569760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4b324772-c229-4497-aee3-5406592463e1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 4b52328c-937b-46cf-abdf-8629194fc25c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:51.580434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b324772-c229-4497-aee3-5406592463e1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:51.583721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b324772-c229-4497-aee3-5406592463e1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:51.584490 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b324772-c229-4497-aee3-5406592463e1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:51.586960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b324772-c229-4497-aee3-5406592463e1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:51.587740 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b324772-c229-4497-aee3-5406592463e1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:51.588367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b324772-c229-4497-aee3-5406592463e1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:51.627732 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-4b324772-c229-4497-aee3-5406592463e1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] HTTP exception thrown: Instance 4b52328c-937b-46cf-abdf-8629194fc25c could not be found. Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4b324772-c229-4497-aee3-5406592463e1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Request method failure captured: Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c HTTP/1.1 Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJKZVQHWlJ74Dx2W8ZEdML0xF-2AOg7c1kyx3sCL0Z6KLQM5ezA45HggvILiFiNDg07ylWr0Vwzz5BQco3_h-9AY0fLV1Rv4K5sggvhMC6zI5NaP-U7NrDZHMoSQThjt2D27IAAoa8B5_g5vq1oNty_s1bxD15UYFAJm0Q--CvZRoS0 Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 256a95a81360419dbaf33382dd369262 Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1632514538 Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/256a95a81360419dbaf33382dd369262"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_256a95a81360419dbaf33382dd369262"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/256a95a81360419dbaf33382dd369262"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/256a95a81360419dbaf33382dd369262"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1632514538 Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 256a95a81360419dbaf33382dd369262 Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1632514538 Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerRescueNegativeTestJSON-1632514538-project Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: a6d92e694e984ad8b126b94ed8effb3f Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1632514538-project Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 4b52328c-937b-46cf-abdf-8629194fc25c could not be found. Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '4b52328c-937b-46cf-abdf-8629194fc25c'} Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b52328c-937b-46cf-abdf-8629194fc25c could not be found. Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b52328c-937b-46cf-abdf-8629194fc25c could not be found. Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:51.630243 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:51.645957 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:51.645957 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:51.645957 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:51.645957 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:51.645957 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:53:51.645957 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:53:51.645957 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b52328c-937b-46cf-abdf-8629194fc25c could not be found. Sep 07 12:53:51.645957 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:51.645957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4b324772-c229-4497-aee3-5406592463e1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Returning 404 to user: Instance 4b52328c-937b-46cf-abdf-8629194fc25c could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:53:51.645957 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4b324772-c229-4497-aee3-5406592463e1 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c" status: 404 len: 111 microversion: 2.1 time: 0.080502 Sep 07 12:53:51.645957 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2293/4638] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:51 2022] GET /compute/v2.1/servers/4b52328c-937b-46cf-abdf-8629194fc25c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:53:51.649242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-27ce6b1d-0e63-4f31-afbe-9d57dc737190 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:51.649443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-27ce6b1d-0e63-4f31-afbe-9d57dc737190 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:51.660466 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27ce6b1d-0e63-4f31-afbe-9d57dc737190 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:51.661140 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27ce6b1d-0e63-4f31-afbe-9d57dc737190 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:51.661667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27ce6b1d-0e63-4f31-afbe-9d57dc737190 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:51.662561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27ce6b1d-0e63-4f31-afbe-9d57dc737190 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:51.664038 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27ce6b1d-0e63-4f31-afbe-9d57dc737190 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:51.664484 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27ce6b1d-0e63-4f31-afbe-9d57dc737190 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:51.665214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-657d3e46-eed9-4fba-88d8-81bef349d831 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:51.700066 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-657d3e46-eed9-4fba-88d8-81bef349d831 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1502 microversion: 2.1 time: 1.043749 Sep 07 12:53:51.704605 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2346/4639] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:50 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1502 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:51.712921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-27ce6b1d-0e63-4f31-afbe-9d57dc737190 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:53:51.741644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-05535bfd-2e70-4104-82fe-02d02845d6ce tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '.version_select at 0x7fc4188ca790>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:51.793169 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-05535bfd-2e70-4104-82fe-02d02845d6ce tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-883330946" status: 202 len: 0 microversion: 2.1 time: 0.082049 Sep 07 12:53:51.795112 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2347/4640] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Sep 7 12:53:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-883330946 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:53:51.875932 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-27ce6b1d-0e63-4f31-afbe-9d57dc737190 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 204 len: 0 microversion: 2.47 time: 0.240601 Sep 07 12:53:51.876965 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2294/4641] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 12:53:51 2022] DELETE /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:53:51.899643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2e5c419f-211e-41f6-add6-128921fb884b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:51.901962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2e5c419f-211e-41f6-add6-128921fb884b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:51.927493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e5c419f-211e-41f6-add6-128921fb884b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:51.928236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e5c419f-211e-41f6-add6-128921fb884b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:51.928937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e5c419f-211e-41f6-add6-128921fb884b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:51.930679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e5c419f-211e-41f6-add6-128921fb884b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:51.931173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e5c419f-211e-41f6-add6-128921fb884b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:51.931619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e5c419f-211e-41f6-add6-128921fb884b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:52.086809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2e5c419f-211e-41f6-add6-128921fb884b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:52.102867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2e5c419f-211e-41f6-add6-128921fb884b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:52.106286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2e5c419f-211e-41f6-add6-128921fb884b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:52.109333 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2e5c419f-211e-41f6-add6-128921fb884b tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1363 microversion: 2.47 time: 0.222921 Sep 07 12:53:52.111553 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2348/4642] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:51 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:52.748567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-02850612-75f1-448f-9bac-50e2e8dfffea tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:52.749436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-02850612-75f1-448f-9bac-50e2e8dfffea tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:52.760944 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02850612-75f1-448f-9bac-50e2e8dfffea tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:52.770375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02850612-75f1-448f-9bac-50e2e8dfffea tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:52.770959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02850612-75f1-448f-9bac-50e2e8dfffea tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:52.771841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02850612-75f1-448f-9bac-50e2e8dfffea tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:52.772433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02850612-75f1-448f-9bac-50e2e8dfffea tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:52.772970 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02850612-75f1-448f-9bac-50e2e8dfffea tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:53.065350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-02850612-75f1-448f-9bac-50e2e8dfffea tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:53.082013 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-02850612-75f1-448f-9bac-50e2e8dfffea tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.337416 Sep 07 12:53:53.083057 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2295/4643] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:52 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:53:53.108194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-06d9557f-073b-4a1e-9119-61dc48665220 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:53.109666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-06d9557f-073b-4a1e-9119-61dc48665220 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:53.117977 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06d9557f-073b-4a1e-9119-61dc48665220 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:53.118757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06d9557f-073b-4a1e-9119-61dc48665220 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:53.119366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06d9557f-073b-4a1e-9119-61dc48665220 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:53.120272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06d9557f-073b-4a1e-9119-61dc48665220 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:53.120928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06d9557f-073b-4a1e-9119-61dc48665220 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:53.121650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06d9557f-073b-4a1e-9119-61dc48665220 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:53.160432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d8395ee-2e84-476f-9cd6-613f98fe8bbe tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:53.161371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9d8395ee-2e84-476f-9cd6-613f98fe8bbe tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:53.184102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d8395ee-2e84-476f-9cd6-613f98fe8bbe tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:53.184931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d8395ee-2e84-476f-9cd6-613f98fe8bbe tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:53.185733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d8395ee-2e84-476f-9cd6-613f98fe8bbe tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:53.187040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d8395ee-2e84-476f-9cd6-613f98fe8bbe tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:53.187859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d8395ee-2e84-476f-9cd6-613f98fe8bbe tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:53.188555 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d8395ee-2e84-476f-9cd6-613f98fe8bbe tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:53.325086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9d8395ee-2e84-476f-9cd6-613f98fe8bbe tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:53.337036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9d8395ee-2e84-476f-9cd6-613f98fe8bbe tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:53.340062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9d8395ee-2e84-476f-9cd6-613f98fe8bbe tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:53.343911 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9d8395ee-2e84-476f-9cd6-613f98fe8bbe tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1363 microversion: 2.47 time: 0.189650 Sep 07 12:53:53.344780 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2296/4644] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:53 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:53:53.364840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-06d9557f-073b-4a1e-9119-61dc48665220 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:53.376438 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-06d9557f-073b-4a1e-9119-61dc48665220 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.272265 Sep 07 12:53:53.377743 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2349/4645] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:53 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:53.408987 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-918a6f5d-22d8-4963-83b3-15b576fca766 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:53:53.409833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-918a6f5d-22d8-4963-83b3-15b576fca766 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: faa80911-c5bd-4c68-a318-996c93479f2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:53.420955 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-918a6f5d-22d8-4963-83b3-15b576fca766 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Instance faa80911-c5bd-4c68-a318-996c93479f2b could not be found. Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-918a6f5d-22d8-4963-83b3-15b576fca766 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/faa80911-c5bd-4c68-a318-996c93479f2b/action HTTP/1.1 Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 15 Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: {"unpause": {}} Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance faa80911-c5bd-4c68-a318-996c93479f2b could not be found. Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'faa80911-c5bd-4c68-a318-996c93479f2b', 'body': {'unpause': {}}} Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faa80911-c5bd-4c68-a318-996c93479f2b could not be found. Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faa80911-c5bd-4c68-a318-996c93479f2b could not be found. Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:53.422798 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:53.429920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:53:53.429920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:53:53.429920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faa80911-c5bd-4c68-a318-996c93479f2b could not be found. Sep 07 12:53:53.429920 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:53.429920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-918a6f5d-22d8-4963-83b3-15b576fca766 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 404 to user: Instance faa80911-c5bd-4c68-a318-996c93479f2b could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:53:53.429920 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-918a6f5d-22d8-4963-83b3-15b576fca766 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers/faa80911-c5bd-4c68-a318-996c93479f2b/action" status: 404 len: 111 microversion: 2.1 time: 0.021700 Sep 07 12:53:53.429920 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2297/4646] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:53:53 2022] POST /compute/v2.1/servers/faa80911-c5bd-4c68-a318-996c93479f2b/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:53:53.438056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-347bcd8a-fa1d-47d5-be5f-7589e974b509 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:53.438999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-347bcd8a-fa1d-47d5-be5f-7589e974b509 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:53.450383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-347bcd8a-fa1d-47d5-be5f-7589e974b509 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:53.451621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-347bcd8a-fa1d-47d5-be5f-7589e974b509 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:53.452590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-347bcd8a-fa1d-47d5-be5f-7589e974b509 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:53.454216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-347bcd8a-fa1d-47d5-be5f-7589e974b509 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:53.455059 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-347bcd8a-fa1d-47d5-be5f-7589e974b509 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:53.455837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-347bcd8a-fa1d-47d5-be5f-7589e974b509 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:53.724063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-347bcd8a-fa1d-47d5-be5f-7589e974b509 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:53.754629 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-347bcd8a-fa1d-47d5-be5f-7589e974b509 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.324205 Sep 07 12:53:53.756946 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2350/4647] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:53 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:53.789891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-843e71c0-0e94-44e5-b833-6701e16a6fba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:53.794412 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-843e71c0-0e94-44e5-b833-6701e16a6fba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:53.838504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-843e71c0-0e94-44e5-b833-6701e16a6fba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:53.842501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-843e71c0-0e94-44e5-b833-6701e16a6fba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:53.846954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-843e71c0-0e94-44e5-b833-6701e16a6fba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:53.848856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-843e71c0-0e94-44e5-b833-6701e16a6fba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:53.851706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-843e71c0-0e94-44e5-b833-6701e16a6fba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:53.852745 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-843e71c0-0e94-44e5-b833-6701e16a6fba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:54.388842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-843e71c0-0e94-44e5-b833-6701e16a6fba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:54.394999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9f95f638-9544-474d-ab02-5250c2a27950 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:54.402773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9f95f638-9544-474d-ab02-5250c2a27950 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:54.414017 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-843e71c0-0e94-44e5-b833-6701e16a6fba tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.633377 Sep 07 12:53:54.416253 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2298/4648] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:53 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:54.417534 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f95f638-9544-474d-ab02-5250c2a27950 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:54.426841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f95f638-9544-474d-ab02-5250c2a27950 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:54.427625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f95f638-9544-474d-ab02-5250c2a27950 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:54.428918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f95f638-9544-474d-ab02-5250c2a27950 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:54.430127 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f95f638-9544-474d-ab02-5250c2a27950 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:54.430600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f95f638-9544-474d-ab02-5250c2a27950 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:54.446811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-361927e6-7ee2-4049-8ce9-30e8513489ef tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:53:54.448110 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-361927e6-7ee2-4049-8ce9-30e8513489ef tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:54.476017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-361927e6-7ee2-4049-8ce9-30e8513489ef tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:54.482816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-361927e6-7ee2-4049-8ce9-30e8513489ef tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:54.483787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-361927e6-7ee2-4049-8ce9-30e8513489ef tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:54.486833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-361927e6-7ee2-4049-8ce9-30e8513489ef tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:54.487823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-361927e6-7ee2-4049-8ce9-30e8513489ef tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:54.491674 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-361927e6-7ee2-4049-8ce9-30e8513489ef tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:54.573757 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-361927e6-7ee2-4049-8ce9-30e8513489ef tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Cannot 'unpause' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state active Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-361927e6-7ee2-4049-8ce9-30e8513489ef tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action HTTP/1.1 Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 15 Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: {"unpause": {}} Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: exception: Cannot 'unpause' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state active Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860', 'body': {'unpause': {}}} Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 in vm_state active. Cannot unpause while the instance is in this state. Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state active Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:54.585019 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:54.590047 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:54.590047 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:53:54.590047 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:53:54.590047 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state active Sep 07 12:53:54.590047 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:54.593890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-361927e6-7ee2-4049-8ce9-30e8513489ef tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 409 to user: Cannot 'unpause' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state active {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:53:54.597384 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-361927e6-7ee2-4049-8ce9-30e8513489ef tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action" status: 409 len: 145 microversion: 2.1 time: 0.159845 Sep 07 12:53:54.599146 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2299/4649] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:53:54 2022] POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action => generated 145 bytes in 165 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 07 12:53:54.619039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-97323545-63f3-4433-b0ac-35d2de06caf8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:54.623145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-97323545-63f3-4433-b0ac-35d2de06caf8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:54.648097 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97323545-63f3-4433-b0ac-35d2de06caf8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:54.653222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97323545-63f3-4433-b0ac-35d2de06caf8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:54.654273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97323545-63f3-4433-b0ac-35d2de06caf8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:54.655823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97323545-63f3-4433-b0ac-35d2de06caf8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:54.656766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97323545-63f3-4433-b0ac-35d2de06caf8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:54.667082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97323545-63f3-4433-b0ac-35d2de06caf8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:54.760262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9f95f638-9544-474d-ab02-5250c2a27950 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:54.795455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9f95f638-9544-474d-ab02-5250c2a27950 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:54.798801 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9f95f638-9544-474d-ab02-5250c2a27950 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:54.801248 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9f95f638-9544-474d-ab02-5250c2a27950 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1363 microversion: 2.47 time: 0.415293 Sep 07 12:53:54.826001 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2351/4650] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:54 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1363 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:55.225008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-97323545-63f3-4433-b0ac-35d2de06caf8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:55.241427 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-97323545-63f3-4433-b0ac-35d2de06caf8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.633764 Sep 07 12:53:55.243274 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2300/4651] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:54 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:55.273933 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bb74182f-1bc8-4c5c-b21f-920bab84de92 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:55.275124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bb74182f-1bc8-4c5c-b21f-920bab84de92 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:55.285700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb74182f-1bc8-4c5c-b21f-920bab84de92 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:55.287198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb74182f-1bc8-4c5c-b21f-920bab84de92 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:55.288311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb74182f-1bc8-4c5c-b21f-920bab84de92 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:55.289716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb74182f-1bc8-4c5c-b21f-920bab84de92 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:55.290823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb74182f-1bc8-4c5c-b21f-920bab84de92 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:55.291863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb74182f-1bc8-4c5c-b21f-920bab84de92 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:55.694422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bb74182f-1bc8-4c5c-b21f-920bab84de92 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:55.708531 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bb74182f-1bc8-4c5c-b21f-920bab84de92 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.442230 Sep 07 12:53:55.711337 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2352/4652] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:55 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:55.736068 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9649fa98-f2c1-40f2-90de-32994e997ef5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:53:55.737436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9649fa98-f2c1-40f2-90de-32994e997ef5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 0c2ac025-b48d-4061-8ec5-aed67f1a8b83] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:55.745583 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-9649fa98-f2c1-40f2-90de-32994e997ef5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Instance 0c2ac025-b48d-4061-8ec5-aed67f1a8b83 could not be found. Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9649fa98-f2c1-40f2-90de-32994e997ef5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/0c2ac025-b48d-4061-8ec5-aed67f1a8b83/action HTTP/1.1 Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 18 Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: {"unshelve": null} Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 0c2ac025-b48d-4061-8ec5-aed67f1a8b83 could not be found. Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '0c2ac025-b48d-4061-8ec5-aed67f1a8b83', 'body': {'unshelve': None}} Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c2ac025-b48d-4061-8ec5-aed67f1a8b83 could not be found. Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c2ac025-b48d-4061-8ec5-aed67f1a8b83 could not be found. Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:55.748181 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:55.752644 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:55.752644 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:55.752644 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:55.752644 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:55.752644 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:53:55.752644 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:53:55.752644 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c2ac025-b48d-4061-8ec5-aed67f1a8b83 could not be found. Sep 07 12:53:55.752644 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:55.754638 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9649fa98-f2c1-40f2-90de-32994e997ef5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 404 to user: Instance 0c2ac025-b48d-4061-8ec5-aed67f1a8b83 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:53:55.756048 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9649fa98-f2c1-40f2-90de-32994e997ef5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers/0c2ac025-b48d-4061-8ec5-aed67f1a8b83/action" status: 404 len: 111 microversion: 2.1 time: 0.025976 Sep 07 12:53:55.757198 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2301/4653] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:53:55 2022] POST /compute/v2.1/servers/0c2ac025-b48d-4061-8ec5-aed67f1a8b83/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:53:55.766383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4fce4f02-a6d9-4a6b-bf99-171940d274d9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:55.767026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4fce4f02-a6d9-4a6b-bf99-171940d274d9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:55.778508 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fce4f02-a6d9-4a6b-bf99-171940d274d9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:55.779402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fce4f02-a6d9-4a6b-bf99-171940d274d9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:55.780191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fce4f02-a6d9-4a6b-bf99-171940d274d9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:55.781182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fce4f02-a6d9-4a6b-bf99-171940d274d9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:55.784373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fce4f02-a6d9-4a6b-bf99-171940d274d9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:55.785808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fce4f02-a6d9-4a6b-bf99-171940d274d9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:55.865513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b23cb057-a972-455c-be85-48e8425170fd tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:55.868178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b23cb057-a972-455c-be85-48e8425170fd tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:55.891609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b23cb057-a972-455c-be85-48e8425170fd tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:55.905831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b23cb057-a972-455c-be85-48e8425170fd tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:55.908630 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b23cb057-a972-455c-be85-48e8425170fd tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:55.911746 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b23cb057-a972-455c-be85-48e8425170fd tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:55.919752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b23cb057-a972-455c-be85-48e8425170fd tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:55.920946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b23cb057-a972-455c-be85-48e8425170fd tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:56.029165 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b23cb057-a972-455c-be85-48e8425170fd tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:56.032069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b23cb057-a972-455c-be85-48e8425170fd tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:56.043714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b23cb057-a972-455c-be85-48e8425170fd tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:56.044954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-b23cb057-a972-455c-be85-48e8425170fd tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lazy-loading 'fault' on Instance uuid 2e665f29-f758-44f3-a6fb-6031f5508543 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:53:56.055792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4fce4f02-a6d9-4a6b-bf99-171940d274d9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:56.075112 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4fce4f02-a6d9-4a6b-bf99-171940d274d9 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.313354 Sep 07 12:53:56.076621 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2353/4654] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:55 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:53:56.104394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f4f86528-ab0a-45be-a642-b4d203a1193e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:56.105671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f4f86528-ab0a-45be-a642-b4d203a1193e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:56.113860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4f86528-ab0a-45be-a642-b4d203a1193e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:56.114798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4f86528-ab0a-45be-a642-b4d203a1193e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:56.115419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4f86528-ab0a-45be-a642-b4d203a1193e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:56.116390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4f86528-ab0a-45be-a642-b4d203a1193e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:56.117297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4f86528-ab0a-45be-a642-b4d203a1193e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:56.118098 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4f86528-ab0a-45be-a642-b4d203a1193e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:56.173419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b23cb057-a972-455c-be85-48e8425170fd tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:56.202475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b23cb057-a972-455c-be85-48e8425170fd tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:56.204860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b23cb057-a972-455c-be85-48e8425170fd tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:56.217728 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b23cb057-a972-455c-be85-48e8425170fd tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 200 len: 1368 microversion: 2.47 time: 0.360448 Sep 07 12:53:56.236968 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2302/4655] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:55 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 1368 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:53:56.446432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f4f86528-ab0a-45be-a642-b4d203a1193e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:56.475062 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f4f86528-ab0a-45be-a642-b4d203a1193e tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.378636 Sep 07 12:53:56.477009 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2354/4656] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:56 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:56.516966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-97a625e2-d055-408e-891e-e964ffe95365 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:53:56.517981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-97a625e2-d055-408e-891e-e964ffe95365 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:56.526790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97a625e2-d055-408e-891e-e964ffe95365 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:56.528192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97a625e2-d055-408e-891e-e964ffe95365 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:56.529043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97a625e2-d055-408e-891e-e964ffe95365 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:56.531830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97a625e2-d055-408e-891e-e964ffe95365 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:56.532760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97a625e2-d055-408e-891e-e964ffe95365 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:56.533429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97a625e2-d055-408e-891e-e964ffe95365 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:56.577240 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-97a625e2-d055-408e-891e-e964ffe95365 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Cannot 'unshelve' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state active Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-97a625e2-d055-408e-891e-e964ffe95365 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action HTTP/1.1 Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 18 Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: {"unshelve": null} Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: exception: Cannot 'unshelve' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state active Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860', 'body': {'unshelve': None}} Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 in vm_state active. Cannot unshelve while the instance is in this state. Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 12:53:56.580628 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 12:53:56.584448 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state active Sep 07 12:53:56.584448 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:56.584448 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:56.584448 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:56.584448 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:56.584448 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:56.584448 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:56.584448 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:53:56.584448 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:53:56.584448 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state active Sep 07 12:53:56.584448 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:56.584448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-97a625e2-d055-408e-891e-e964ffe95365 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 409 to user: Cannot 'unshelve' instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 while it is in vm_state active {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:53:56.585222 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-97a625e2-d055-408e-891e-e964ffe95365 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action" status: 409 len: 146 microversion: 2.1 time: 0.073220 Sep 07 12:53:56.586120 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2303/4657] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:53:56 2022] POST /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860/action => generated 146 bytes in 75 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:53:56.602913 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-387127ea-52aa-4e49-89fb-9f18db233d52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:56.604711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-387127ea-52aa-4e49-89fb-9f18db233d52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:56.620426 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-387127ea-52aa-4e49-89fb-9f18db233d52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:56.621652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-387127ea-52aa-4e49-89fb-9f18db233d52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:56.622746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-387127ea-52aa-4e49-89fb-9f18db233d52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:56.624161 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-387127ea-52aa-4e49-89fb-9f18db233d52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:56.625223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-387127ea-52aa-4e49-89fb-9f18db233d52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:56.626667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-387127ea-52aa-4e49-89fb-9f18db233d52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:56.853788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-387127ea-52aa-4e49-89fb-9f18db233d52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:56.872492 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-387127ea-52aa-4e49-89fb-9f18db233d52 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.278841 Sep 07 12:53:56.873144 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2355/4658] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:56 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:56.904501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-76178243-9a24-4934-bf3f-4e8e5f7fcdf7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:56.905535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-76178243-9a24-4934-bf3f-4e8e5f7fcdf7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:56.914825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76178243-9a24-4934-bf3f-4e8e5f7fcdf7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:56.915764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76178243-9a24-4934-bf3f-4e8e5f7fcdf7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:56.916487 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76178243-9a24-4934-bf3f-4e8e5f7fcdf7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:56.917699 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76178243-9a24-4934-bf3f-4e8e5f7fcdf7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:56.918489 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76178243-9a24-4934-bf3f-4e8e5f7fcdf7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:56.919370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76178243-9a24-4934-bf3f-4e8e5f7fcdf7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:57.234472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-76178243-9a24-4934-bf3f-4e8e5f7fcdf7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:57.253086 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-76178243-9a24-4934-bf3f-4e8e5f7fcdf7 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.353711 Sep 07 12:53:57.257842 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2304/4659] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:56 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:57.269967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1708a971-b779-4ade-8226-ba313416e13a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:57.270143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1708a971-b779-4ade-8226-ba313416e13a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 2e665f29-f758-44f3-a6fb-6031f5508543] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:57.288526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1708a971-b779-4ade-8226-ba313416e13a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:57.289794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1708a971-b779-4ade-8226-ba313416e13a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:57.290786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1708a971-b779-4ade-8226-ba313416e13a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:57.292649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1708a971-b779-4ade-8226-ba313416e13a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:57.294184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1708a971-b779-4ade-8226-ba313416e13a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:57.295221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1708a971-b779-4ade-8226-ba313416e13a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:57.303334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1b14b9ca-f30b-4680-8601-e95748edd46f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1704807662_updated"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:53:57.309393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1b14b9ca-f30b-4680-8601-e95748edd46f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 689c6807-1874-4d83-8c80-03648418b323] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:57.325818 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-1b14b9ca-f30b-4680-8601-e95748edd46f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Instance 689c6807-1874-4d83-8c80-03648418b323 could not be found. Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1b14b9ca-f30b-4680-8601-e95748edd46f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: request: PUT /compute/v2.1/servers/689c6807-1874-4d83-8c80-03648418b323 HTTP/1.1 Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 81 Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1704807662_updated"}} Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 689c6807-1874-4d83-8c80-03648418b323 could not be found. Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '689c6807-1874-4d83-8c80-03648418b323', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1704807662_updated'}}} Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 689c6807-1874-4d83-8c80-03648418b323 could not be found. Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 07 12:53:57.330299 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:53:57.338877 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:53:57.338877 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:53:57.338877 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:53:57.338877 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 689c6807-1874-4d83-8c80-03648418b323 could not be found. Sep 07 12:53:57.338877 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:57.338877 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:57.338877 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:57.338877 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:57.338877 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:57.338877 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:57.338877 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:53:57.338877 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:53:57.338877 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 689c6807-1874-4d83-8c80-03648418b323 could not be found. Sep 07 12:53:57.338877 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:53:57.338877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1b14b9ca-f30b-4680-8601-e95748edd46f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 404 to user: Instance 689c6807-1874-4d83-8c80-03648418b323 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:53:57.343678 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1b14b9ca-f30b-4680-8601-e95748edd46f tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "PUT /compute/v2.1/servers/689c6807-1874-4d83-8c80-03648418b323" status: 404 len: 111 microversion: 2.1 time: 0.046006 Sep 07 12:53:57.349897 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2305/4660] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Sep 7 12:53:57 2022] PUT /compute/v2.1/servers/689c6807-1874-4d83-8c80-03648418b323 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:53:57.361077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-01676591-5b98-4d20-b728-4339487b64ac tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:57.363428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-01676591-5b98-4d20-b728-4339487b64ac tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:57.373735 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-1708a971-b779-4ade-8226-ba313416e13a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] HTTP exception thrown: Instance 2e665f29-f758-44f3-a6fb-6031f5508543 could not be found. Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1708a971-b779-4ade-8226-ba313416e13a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Request method failure captured: Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 HTTP/1.1 Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJQsTVWHe6oh3KikWysTdRI2Pj02vjg-LmfkgBoY_deAPNUk7yA58RCLBiPU72VNSjXEYSBRkRywlDISlzKF1U7uBxKcM5XfKxMsj7SlTOHVL3sAXd5Q2G8aL4sLo622s0KUcJhVF_ZfvTv9XpWrMuUNrtNxsVQdImxeiF9aVpJpOPU Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.47 Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: b615c73bf02a424f887f4c44ec9e67ea Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerShowV247Test-1373380653 Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b615c73bf02a424f887f4c44ec9e67ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b615c73bf02a424f887f4c44ec9e67ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b615c73bf02a424f887f4c44ec9e67ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b615c73bf02a424f887f4c44ec9e67ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerShowV247Test-1373380653 Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: b615c73bf02a424f887f4c44ec9e67ea Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerShowV247Test-1373380653 Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerShowV247Test-1373380653-project Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: c6fe2a4bf33848db91947f2fc7f29842 Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerShowV247Test-1373380653-project Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 2e665f29-f758-44f3-a6fb-6031f5508543 could not be found. Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '2e665f29-f758-44f3-a6fb-6031f5508543'} Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e665f29-f758-44f3-a6fb-6031f5508543 could not be found. Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e665f29-f758-44f3-a6fb-6031f5508543 could not be found. Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:57.375899 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:57.380109 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:57.380109 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:57.380109 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:57.380109 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:53:57.380109 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:53:57.380109 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e665f29-f758-44f3-a6fb-6031f5508543 could not be found. Sep 07 12:53:57.380109 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:57.381453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1708a971-b779-4ade-8226-ba313416e13a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Returning 404 to user: Instance 2e665f29-f758-44f3-a6fb-6031f5508543 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:53:57.382594 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1708a971-b779-4ade-8226-ba313416e13a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543" status: 404 len: 111 microversion: 2.47 time: 0.125091 Sep 07 12:53:57.383700 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2356/4661] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:57 2022] GET /compute/v2.1/servers/2e665f29-f758-44f3-a6fb-6031f5508543 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:53:57.385376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01676591-5b98-4d20-b728-4339487b64ac tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:57.386542 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01676591-5b98-4d20-b728-4339487b64ac tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:57.387470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01676591-5b98-4d20-b728-4339487b64ac tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:57.389201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01676591-5b98-4d20-b728-4339487b64ac tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:57.390279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01676591-5b98-4d20-b728-4339487b64ac tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:57.392836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01676591-5b98-4d20-b728-4339487b64ac tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:57.394008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-90e68567-8a07-43b2-b3ec-945e502bf752 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:57.394592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-90e68567-8a07-43b2-b3ec-945e502bf752 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:57.409733 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90e68567-8a07-43b2-b3ec-945e502bf752 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:57.410254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90e68567-8a07-43b2-b3ec-945e502bf752 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:57.410716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90e68567-8a07-43b2-b3ec-945e502bf752 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:57.411467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90e68567-8a07-43b2-b3ec-945e502bf752 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:57.411946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90e68567-8a07-43b2-b3ec-945e502bf752 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:57.412395 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90e68567-8a07-43b2-b3ec-945e502bf752 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:57.466906 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-90e68567-8a07-43b2-b3ec-945e502bf752 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:53:57.541024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:57.674211 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-90e68567-8a07-43b2-b3ec-945e502bf752 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e" status: 204 len: 0 microversion: 2.47 time: 0.282787 Sep 07 12:53:57.675135 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2357/4662] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 12:53:57 2022] DELETE /compute/v2.1/servers/4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:53:57.696786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0a2eb20c-49bf-4004-a0a7-612d1a334921 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:57.700517 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0a2eb20c-49bf-4004-a0a7-612d1a334921 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:57.718440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a2eb20c-49bf-4004-a0a7-612d1a334921 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:57.719217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a2eb20c-49bf-4004-a0a7-612d1a334921 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:57.720486 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a2eb20c-49bf-4004-a0a7-612d1a334921 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:57.722067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a2eb20c-49bf-4004-a0a7-612d1a334921 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:57.723268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a2eb20c-49bf-4004-a0a7-612d1a334921 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:57.725157 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a2eb20c-49bf-4004-a0a7-612d1a334921 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:57.758389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-01676591-5b98-4d20-b728-4339487b64ac tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:57.786632 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-01676591-5b98-4d20-b728-4339487b64ac tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.433903 Sep 07 12:53:57.787708 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2306/4663] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:57 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:57.818496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7a3437e4-a84f-429b-b756-254cf78cc3d8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:57.820048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7a3437e4-a84f-429b-b756-254cf78cc3d8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:57.833913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a3437e4-a84f-429b-b756-254cf78cc3d8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:57.835182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a3437e4-a84f-429b-b756-254cf78cc3d8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:57.836228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a3437e4-a84f-429b-b756-254cf78cc3d8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:57.838032 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a3437e4-a84f-429b-b756-254cf78cc3d8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:57.839122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a3437e4-a84f-429b-b756-254cf78cc3d8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:57.840428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a3437e4-a84f-429b-b756-254cf78cc3d8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:57.995369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0a2eb20c-49bf-4004-a0a7-612d1a334921 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:58.048952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0a2eb20c-49bf-4004-a0a7-612d1a334921 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:58.055476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0a2eb20c-49bf-4004-a0a7-612d1a334921 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:58.058386 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0a2eb20c-49bf-4004-a0a7-612d1a334921 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e" status: 200 len: 1362 microversion: 2.47 time: 0.376348 Sep 07 12:53:58.060396 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2358/4664] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:57 2022] GET /compute/v2.1/servers/4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e => generated 1362 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:53:58.577367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7a3437e4-a84f-429b-b756-254cf78cc3d8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:58.591424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:58.606882 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7a3437e4-a84f-429b-b756-254cf78cc3d8 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.792790 Sep 07 12:53:58.626819 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2307/4665] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:57 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:53:58.671134 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e08545bd-2477-43b4-8a1e-68b9f84e29e5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e08545bd-2477-43b4-8a1e-68b9f84e29e5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: request: PUT /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 HTTP/1.1 Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 280 Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:58.680444 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:58.687196 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:58.687196 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:58.687196 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:53:58.687196 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:53:58.687196 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:53:58.687196 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:53:58.687196 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:53:58.687196 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:53:58.687196 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:53:58.687196 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:53:58.687196 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:53:58.687196 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:53:58.687196 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:53:58.687196 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:53:58.687196 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 12:53:58.687196 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:58.687196 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:58.687196 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:58.687196 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:58.687196 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:58.687196 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:58.687196 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:53:58.687196 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:53:58.687196 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 07 12:53:58.687196 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:58.692193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e08545bd-2477-43b4-8a1e-68b9f84e29e5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:53:58.694331 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e08545bd-2477-43b4-8a1e-68b9f84e29e5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "PUT /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 400 len: 619 microversion: 2.1 time: 0.032340 Sep 07 12:53:58.696082 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2359/4666] 10.222.0.16 () {60 vars in 1257 bytes} [Wed Sep 7 12:53:58 2022] PUT /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 619 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:53:58.716843 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-128af6d8-a464-4c9d-b7e7-f44d190d0198 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:58.718085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-128af6d8-a464-4c9d-b7e7-f44d190d0198 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:58.743066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-128af6d8-a464-4c9d-b7e7-f44d190d0198 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:58.743957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-128af6d8-a464-4c9d-b7e7-f44d190d0198 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:58.744738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-128af6d8-a464-4c9d-b7e7-f44d190d0198 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:58.746065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-128af6d8-a464-4c9d-b7e7-f44d190d0198 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:58.746910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-128af6d8-a464-4c9d-b7e7-f44d190d0198 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:58.747695 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-128af6d8-a464-4c9d-b7e7-f44d190d0198 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:59.111168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4e3ab2a9-4178-4783-8e47-b39329e3b40c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:59.112211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4e3ab2a9-4178-4783-8e47-b39329e3b40c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:59.133169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e3ab2a9-4178-4783-8e47-b39329e3b40c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:59.136045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e3ab2a9-4178-4783-8e47-b39329e3b40c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:59.136958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e3ab2a9-4178-4783-8e47-b39329e3b40c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:59.140703 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e3ab2a9-4178-4783-8e47-b39329e3b40c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:59.141670 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e3ab2a9-4178-4783-8e47-b39329e3b40c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:59.142614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e3ab2a9-4178-4783-8e47-b39329e3b40c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:59.197224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-128af6d8-a464-4c9d-b7e7-f44d190d0198 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:59.233525 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-128af6d8-a464-4c9d-b7e7-f44d190d0198 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.517391 Sep 07 12:53:59.237071 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2308/4667] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:58 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:59.284570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d168f919-d8cb-4ec8-8d7a-8e89ff92c477 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:53:59.287821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d168f919-d8cb-4ec8-8d7a-8e89ff92c477 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:53:59.318702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d168f919-d8cb-4ec8-8d7a-8e89ff92c477 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:59.319970 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d168f919-d8cb-4ec8-8d7a-8e89ff92c477 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:59.320785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d168f919-d8cb-4ec8-8d7a-8e89ff92c477 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:59.322505 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d168f919-d8cb-4ec8-8d7a-8e89ff92c477 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:53:59.323351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d168f919-d8cb-4ec8-8d7a-8e89ff92c477 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:53:59.324052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d168f919-d8cb-4ec8-8d7a-8e89ff92c477 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:53:59.366216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4e3ab2a9-4178-4783-8e47-b39329e3b40c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:59.385814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4e3ab2a9-4178-4783-8e47-b39329e3b40c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:59.390037 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4e3ab2a9-4178-4783-8e47-b39329e3b40c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:59.393041 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4e3ab2a9-4178-4783-8e47-b39329e3b40c tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e" status: 200 len: 1362 microversion: 2.47 time: 0.288281 Sep 07 12:53:59.394444 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2360/4668] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:53:59 2022] GET /compute/v2.1/servers/4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e => generated 1362 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:53:59.828555 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d168f919-d8cb-4ec8-8d7a-8e89ff92c477 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:53:59.888300 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d168f919-d8cb-4ec8-8d7a-8e89ff92c477 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.607648 Sep 07 12:53:59.917082 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2309/4669] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:59 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:53:59.951031 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3cdcb74d-4ea2-4e65-8987-610cf3f3f8f5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3cdcb74d-4ea2-4e65-8987-610cf3f3f8f5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: request: PUT /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 HTTP/1.1 Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 24 Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: {"server": {"name": ""}} Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860', 'body': {'server': {'name': ''}}} Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi '' Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:53:59.973561 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 07 12:53:59.977696 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:59.977696 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:53:59.977696 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:59.977696 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:53:59.977696 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:53:59.977696 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:53:59.977696 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:53:59.977696 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:53:59.977696 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 07 12:53:59.977696 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:53:59.977696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3cdcb74d-4ea2-4e65-8987-610cf3f3f8f5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:53:59.982899 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3cdcb74d-4ea2-4e65-8987-610cf3f3f8f5 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "PUT /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 400 len: 108 microversion: 2.1 time: 0.045775 Sep 07 12:53:59.991122 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2361/4670] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Sep 7 12:53:59 2022] PUT /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 108 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:53:59.999104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7fcabc0d-62cb-4938-a766-606c7cdba3aa tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:00.000291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7fcabc0d-62cb-4938-a766-606c7cdba3aa tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:00.068388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fcabc0d-62cb-4938-a766-606c7cdba3aa tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:00.069406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fcabc0d-62cb-4938-a766-606c7cdba3aa tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:00.070163 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fcabc0d-62cb-4938-a766-606c7cdba3aa tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:00.071380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fcabc0d-62cb-4938-a766-606c7cdba3aa tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:00.072479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fcabc0d-62cb-4938-a766-606c7cdba3aa tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:00.073217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7fcabc0d-62cb-4938-a766-606c7cdba3aa tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:00.461952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bbfb4a85-e930-4d5f-bcd8-a1bb5bdfcd9a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:00.466939 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bbfb4a85-e930-4d5f-bcd8-a1bb5bdfcd9a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:00.509344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7fcabc0d-62cb-4938-a766-606c7cdba3aa tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:00.567770 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7fcabc0d-62cb-4938-a766-606c7cdba3aa tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1505 microversion: 2.1 time: 0.573964 Sep 07 12:54:00.571008 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2310/4671] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:53:59 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1505 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:00.571542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbfb4a85-e930-4d5f-bcd8-a1bb5bdfcd9a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:00.572926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbfb4a85-e930-4d5f-bcd8-a1bb5bdfcd9a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:00.574047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbfb4a85-e930-4d5f-bcd8-a1bb5bdfcd9a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:00.578830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbfb4a85-e930-4d5f-bcd8-a1bb5bdfcd9a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:00.580270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbfb4a85-e930-4d5f-bcd8-a1bb5bdfcd9a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:00.580999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbfb4a85-e930-4d5f-bcd8-a1bb5bdfcd9a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:00.970686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bbfb4a85-e930-4d5f-bcd8-a1bb5bdfcd9a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:01.022047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bbfb4a85-e930-4d5f-bcd8-a1bb5bdfcd9a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:01.034534 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bbfb4a85-e930-4d5f-bcd8-a1bb5bdfcd9a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:01.036988 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bbfb4a85-e930-4d5f-bcd8-a1bb5bdfcd9a tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e" status: 200 len: 1362 microversion: 2.47 time: 0.605954 Sep 07 12:54:01.038182 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2362/4672] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:54:00 2022] GET /compute/v2.1/servers/4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e => generated 1362 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:54:02.071536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aadfbe6b-6495-4e3f-88e0-eaf0f432e2cf tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:02.073259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aadfbe6b-6495-4e3f-88e0-eaf0f432e2cf tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:02.075796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:02.077900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:02.085608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aadfbe6b-6495-4e3f-88e0-eaf0f432e2cf tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:02.086467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aadfbe6b-6495-4e3f-88e0-eaf0f432e2cf tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:02.087139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aadfbe6b-6495-4e3f-88e0-eaf0f432e2cf tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:02.088106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aadfbe6b-6495-4e3f-88e0-eaf0f432e2cf tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:02.088777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aadfbe6b-6495-4e3f-88e0-eaf0f432e2cf tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:02.089410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aadfbe6b-6495-4e3f-88e0-eaf0f432e2cf tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:02.130609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aadfbe6b-6495-4e3f-88e0-eaf0f432e2cf tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:02.131496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aadfbe6b-6495-4e3f-88e0-eaf0f432e2cf tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:02.132172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aadfbe6b-6495-4e3f-88e0-eaf0f432e2cf tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:02.132870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-aadfbe6b-6495-4e3f-88e0-eaf0f432e2cf tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lazy-loading 'fault' on Instance uuid 4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:54:02.272654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aadfbe6b-6495-4e3f-88e0-eaf0f432e2cf tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:02.300039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aadfbe6b-6495-4e3f-88e0-eaf0f432e2cf tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:02.303104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aadfbe6b-6495-4e3f-88e0-eaf0f432e2cf tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6fe2a4bf33848db91947f2fc7f29842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b615c73bf02a424f887f4c44ec9e67ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:02.305133 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aadfbe6b-6495-4e3f-88e0-eaf0f432e2cf tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e" status: 200 len: 1367 microversion: 2.47 time: 0.237927 Sep 07 12:54:02.319064 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2311/4673] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:54:02 2022] GET /compute/v2.1/servers/4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:54:03.345779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-330883f7-db16-41e5-af6f-de7041125879 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:03.346797 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-330883f7-db16-41e5-af6f-de7041125879 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] [instance: 4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:03.382292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-330883f7-db16-41e5-af6f-de7041125879 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:03.395031 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-330883f7-db16-41e5-af6f-de7041125879 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:03.396045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-330883f7-db16-41e5-af6f-de7041125879 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:03.397326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-330883f7-db16-41e5-af6f-de7041125879 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:03.398228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-330883f7-db16-41e5-af6f-de7041125879 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:03.398994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-330883f7-db16-41e5-af6f-de7041125879 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:03.507911 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-330883f7-db16-41e5-af6f-de7041125879 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] HTTP exception thrown: Instance 4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e could not be found. Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-330883f7-db16-41e5-af6f-de7041125879 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Request method failure captured: Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e HTTP/1.1 Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJQsTVWHe6oh3KikWysTdRI2Pj02vjg-LmfkgBoY_deAPNUk7yA58RCLBiPU72VNSjXEYSBRkRywlDISlzKF1U7uBxKcM5XfKxMsj7SlTOHVL3sAXd5Q2G8aL4sLo622s0KUcJhVF_ZfvTv9XpWrMuUNrtNxsVQdImxeiF9aVpJpOPU Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.47 Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: b615c73bf02a424f887f4c44ec9e67ea Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerShowV247Test-1373380653 Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b615c73bf02a424f887f4c44ec9e67ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b615c73bf02a424f887f4c44ec9e67ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b615c73bf02a424f887f4c44ec9e67ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b615c73bf02a424f887f4c44ec9e67ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerShowV247Test-1373380653 Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: b615c73bf02a424f887f4c44ec9e67ea Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerShowV247Test-1373380653 Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerShowV247Test-1373380653-project Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: c6fe2a4bf33848db91947f2fc7f29842 Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerShowV247Test-1373380653-project Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e could not be found. Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e'} Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e could not be found. Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e could not be found. Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:54:03.519282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:54:03.523993 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:54:03.523993 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:54:03.523993 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:54:03.523993 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:54:03.523993 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:54:03.523993 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e could not be found. Sep 07 12:54:03.523993 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:54:03.523993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-330883f7-db16-41e5-af6f-de7041125879 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] Returning 404 to user: Instance 4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:54:03.523993 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-330883f7-db16-41e5-af6f-de7041125879 tempest-ServerShowV247Test-1373380653 tempest-ServerShowV247Test-1373380653-project] 10.222.0.16 "GET /compute/v2.1/servers/4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e" status: 404 len: 111 microversion: 2.47 time: 0.190075 Sep 07 12:54:03.549113 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2363/4674] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:54:03 2022] GET /compute/v2.1/servers/4a2fbd2f-17ee-4f0d-9b39-a1ddfcde304e => generated 111 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:54:04.669272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-75bfc9e1-51eb-466c-9ee7-d778b172b93f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:04.669904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-75bfc9e1-51eb-466c-9ee7-d778b172b93f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:04.690962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75bfc9e1-51eb-466c-9ee7-d778b172b93f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:04.692045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75bfc9e1-51eb-466c-9ee7-d778b172b93f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:04.694678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75bfc9e1-51eb-466c-9ee7-d778b172b93f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:04.697536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75bfc9e1-51eb-466c-9ee7-d778b172b93f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:04.698953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75bfc9e1-51eb-466c-9ee7-d778b172b93f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:04.700251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75bfc9e1-51eb-466c-9ee7-d778b172b93f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:04.768649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-75bfc9e1-51eb-466c-9ee7-d778b172b93f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:54:04.932589 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-75bfc9e1-51eb-466c-9ee7-d778b172b93f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e" status: 204 len: 0 microversion: 2.1 time: 0.263040 Sep 07 12:54:04.954087 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2312/4675] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:54:04 2022] DELETE /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:04.965020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-db68735e-c334-419c-892a-9c9980ecd013 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:04.965846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-db68735e-c334-419c-892a-9c9980ecd013 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:04.969263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:04.986749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db68735e-c334-419c-892a-9c9980ecd013 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:04.987265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db68735e-c334-419c-892a-9c9980ecd013 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:04.987722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db68735e-c334-419c-892a-9c9980ecd013 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:04.988741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db68735e-c334-419c-892a-9c9980ecd013 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:04.989451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db68735e-c334-419c-892a-9c9980ecd013 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:04.990143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db68735e-c334-419c-892a-9c9980ecd013 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:05.348149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-db68735e-c334-419c-892a-9c9980ecd013 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:05.364583 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-db68735e-c334-419c-892a-9c9980ecd013 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e" status: 200 len: 1508 microversion: 2.1 time: 0.400824 Sep 07 12:54:05.365338 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2364/4676] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:04 2022] GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e => generated 1508 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:06.394021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a90caf3b-de4e-4543-9733-45107714dd59 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:06.398646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a90caf3b-de4e-4543-9733-45107714dd59 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:06.429585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a90caf3b-de4e-4543-9733-45107714dd59 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:06.432309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a90caf3b-de4e-4543-9733-45107714dd59 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:06.435109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a90caf3b-de4e-4543-9733-45107714dd59 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:06.437824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a90caf3b-de4e-4543-9733-45107714dd59 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:06.441899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a90caf3b-de4e-4543-9733-45107714dd59 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:06.443545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a90caf3b-de4e-4543-9733-45107714dd59 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:06.906847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a90caf3b-de4e-4543-9733-45107714dd59 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:06.949862 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a90caf3b-de4e-4543-9733-45107714dd59 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e" status: 200 len: 1466 microversion: 2.1 time: 0.563121 Sep 07 12:54:06.954441 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2313/4677] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:06 2022] GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e => generated 1466 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:54:07.025739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-af106049-ded5-4a3a-97ce-ea697ed84aed req-9640f1ca-ee04-4d39-9c05-d23c1ef37a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c8a9c1-51cc-4b6c-9b68-6ec76021310e", "name": "network-vif-deleted", "tag": "6472e7b8-dd8f-4bc2-98be-2d89ad9c1aa6"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:54:07.078213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-af106049-ded5-4a3a-97ce-ea697ed84aed req-9640f1ca-ee04-4d39-9c05-d23c1ef37a39 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:07.079803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-af106049-ded5-4a3a-97ce-ea697ed84aed req-9640f1ca-ee04-4d39-9c05-d23c1ef37a39 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:07.080847 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-af106049-ded5-4a3a-97ce-ea697ed84aed req-9640f1ca-ee04-4d39-9c05-d23c1ef37a39 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:07.112062 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-af106049-ded5-4a3a-97ce-ea697ed84aed req-9640f1ca-ee04-4d39-9c05-d23c1ef37a39 service nova] Creating event network-vif-deleted:6472e7b8-dd8f-4bc2-98be-2d89ad9c1aa6 for instance f2c8a9c1-51cc-4b6c-9b68-6ec76021310e on n-h2-852087-9 Sep 07 12:54:07.128874 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-af106049-ded5-4a3a-97ce-ea697ed84aed req-9640f1ca-ee04-4d39-9c05-d23c1ef37a39 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115079 Sep 07 12:54:07.147188 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2365/4678] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:54:07.989776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7b075bb2-118e-404f-a9dd-6dfbda84c382 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:07.990806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7b075bb2-118e-404f-a9dd-6dfbda84c382 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:08.006340 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b075bb2-118e-404f-a9dd-6dfbda84c382 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:08.007632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b075bb2-118e-404f-a9dd-6dfbda84c382 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:08.008692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b075bb2-118e-404f-a9dd-6dfbda84c382 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:08.009148 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-27b62e37-8edb-4e9a-a0b8-d0bbfde999ed tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:08.010651 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-27b62e37-8edb-4e9a-a0b8-d0bbfde999ed tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:08.011047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b075bb2-118e-404f-a9dd-6dfbda84c382 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:08.012422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b075bb2-118e-404f-a9dd-6dfbda84c382 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:08.013470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b075bb2-118e-404f-a9dd-6dfbda84c382 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:08.022983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27b62e37-8edb-4e9a-a0b8-d0bbfde999ed tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:08.024347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27b62e37-8edb-4e9a-a0b8-d0bbfde999ed tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:08.025417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27b62e37-8edb-4e9a-a0b8-d0bbfde999ed tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:08.026652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27b62e37-8edb-4e9a-a0b8-d0bbfde999ed tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:08.028011 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27b62e37-8edb-4e9a-a0b8-d0bbfde999ed tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:08.028946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27b62e37-8edb-4e9a-a0b8-d0bbfde999ed tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:08.118060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27b62e37-8edb-4e9a-a0b8-d0bbfde999ed tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:08.118751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27b62e37-8edb-4e9a-a0b8-d0bbfde999ed tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:08.120995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27b62e37-8edb-4e9a-a0b8-d0bbfde999ed tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:08.124192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-27b62e37-8edb-4e9a-a0b8-d0bbfde999ed tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lazy-loading 'fault' on Instance uuid f2c8a9c1-51cc-4b6c-9b68-6ec76021310e {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:54:08.257813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-27b62e37-8edb-4e9a-a0b8-d0bbfde999ed tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:08.281745 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-27b62e37-8edb-4e9a-a0b8-d0bbfde999ed tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e" status: 200 len: 1312 microversion: 2.1 time: 0.282942 Sep 07 12:54:08.282793 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2366/4679] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:07 2022] GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e => generated 1312 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:08.432471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7b075bb2-118e-404f-a9dd-6dfbda84c382 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:08.448903 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7b075bb2-118e-404f-a9dd-6dfbda84c382 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.465079 Sep 07 12:54:08.450885 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2314/4680] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:07 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:54:08.506198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-497de5ad-0a82-4f50-8bde-4cd635356ae5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:08.507976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-497de5ad-0a82-4f50-8bde-4cd635356ae5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:08.520416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-497de5ad-0a82-4f50-8bde-4cd635356ae5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:08.522056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-497de5ad-0a82-4f50-8bde-4cd635356ae5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:08.523624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-497de5ad-0a82-4f50-8bde-4cd635356ae5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:08.525256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-497de5ad-0a82-4f50-8bde-4cd635356ae5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:08.526592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-497de5ad-0a82-4f50-8bde-4cd635356ae5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:08.527709 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-497de5ad-0a82-4f50-8bde-4cd635356ae5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:08.823868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-497de5ad-0a82-4f50-8bde-4cd635356ae5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:08.873411 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-497de5ad-0a82-4f50-8bde-4cd635356ae5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.375133 Sep 07 12:54:08.874854 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2367/4681] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:08 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:54:08.913269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1b2f921e-98cb-4e45-8f4d-d00626b47d2e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:08.914262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1b2f921e-98cb-4e45-8f4d-d00626b47d2e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:08.925654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b2f921e-98cb-4e45-8f4d-d00626b47d2e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:08.926474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b2f921e-98cb-4e45-8f4d-d00626b47d2e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:08.931484 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b2f921e-98cb-4e45-8f4d-d00626b47d2e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:08.932522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b2f921e-98cb-4e45-8f4d-d00626b47d2e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:08.933013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b2f921e-98cb-4e45-8f4d-d00626b47d2e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:08.933450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b2f921e-98cb-4e45-8f4d-d00626b47d2e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:09.279200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1b2f921e-98cb-4e45-8f4d-d00626b47d2e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:09.301293 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1b2f921e-98cb-4e45-8f4d-d00626b47d2e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.391883 Sep 07 12:54:09.304367 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2315/4682] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:08 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:09.333234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-352f7912-6d8c-4f54-92d4-e893dd49175b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:09.338717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-352f7912-6d8c-4f54-92d4-e893dd49175b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: f2c8a9c1-51cc-4b6c-9b68-6ec76021310e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:09.348293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0c1e671f-5849-4889-be5d-90aa33ce661a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:09.349762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0c1e671f-5849-4889-be5d-90aa33ce661a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:09.360326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-352f7912-6d8c-4f54-92d4-e893dd49175b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:09.361176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-352f7912-6d8c-4f54-92d4-e893dd49175b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:09.361971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-352f7912-6d8c-4f54-92d4-e893dd49175b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:09.362191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c1e671f-5849-4889-be5d-90aa33ce661a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:09.363031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c1e671f-5849-4889-be5d-90aa33ce661a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:09.363282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-352f7912-6d8c-4f54-92d4-e893dd49175b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:09.364186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-352f7912-6d8c-4f54-92d4-e893dd49175b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:09.364650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c1e671f-5849-4889-be5d-90aa33ce661a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:09.365001 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-352f7912-6d8c-4f54-92d4-e893dd49175b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:09.366552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c1e671f-5849-4889-be5d-90aa33ce661a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:09.367782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c1e671f-5849-4889-be5d-90aa33ce661a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:09.368898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c1e671f-5849-4889-be5d-90aa33ce661a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:09.428893 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-352f7912-6d8c-4f54-92d4-e893dd49175b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] HTTP exception thrown: Instance f2c8a9c1-51cc-4b6c-9b68-6ec76021310e could not be found. Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-352f7912-6d8c-4f54-92d4-e893dd49175b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Request method failure captured: Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e HTTP/1.1 Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJKZVQHWlJ74Dx2W8ZEdML0xF-2AOg7c1kyx3sCL0Z6KLQM5ezA45HggvILiFiNDg07ylWr0Vwzz5BQco3_h-9AY0fLV1Rv4K5sggvhMC6zI5NaP-U7NrDZHMoSQThjt2D27IAAoa8B5_g5vq1oNty_s1bxD15UYFAJm0Q--CvZRoS0 Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 256a95a81360419dbaf33382dd369262 Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1632514538 Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/256a95a81360419dbaf33382dd369262"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_256a95a81360419dbaf33382dd369262"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/256a95a81360419dbaf33382dd369262"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/256a95a81360419dbaf33382dd369262"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1632514538 Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 256a95a81360419dbaf33382dd369262 Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1632514538 Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerRescueNegativeTestJSON-1632514538-project Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: a6d92e694e984ad8b126b94ed8effb3f Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1632514538-project Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance f2c8a9c1-51cc-4b6c-9b68-6ec76021310e could not be found. Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'f2c8a9c1-51cc-4b6c-9b68-6ec76021310e'} Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2c8a9c1-51cc-4b6c-9b68-6ec76021310e could not be found. Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2c8a9c1-51cc-4b6c-9b68-6ec76021310e could not be found. Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:54:09.432446 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:54:09.441282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:54:09.441282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:54:09.441282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:54:09.441282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:54:09.441282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:54:09.441282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:54:09.441282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2c8a9c1-51cc-4b6c-9b68-6ec76021310e could not be found. Sep 07 12:54:09.441282 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:54:09.441282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-352f7912-6d8c-4f54-92d4-e893dd49175b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Returning 404 to user: Instance f2c8a9c1-51cc-4b6c-9b68-6ec76021310e could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:54:09.441282 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-352f7912-6d8c-4f54-92d4-e893dd49175b tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e" status: 404 len: 111 microversion: 2.1 time: 0.109839 Sep 07 12:54:09.441282 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2368/4683] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:09 2022] GET /compute/v2.1/servers/f2c8a9c1-51cc-4b6c-9b68-6ec76021310e => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:54:09.452125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-29c960c9-3711-4a9a-abf3-930a79ce685f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:09.452993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-29c960c9-3711-4a9a-abf3-930a79ce685f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:09.465803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29c960c9-3711-4a9a-abf3-930a79ce685f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:09.466835 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29c960c9-3711-4a9a-abf3-930a79ce685f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:09.467777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29c960c9-3711-4a9a-abf3-930a79ce685f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:09.469324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29c960c9-3711-4a9a-abf3-930a79ce685f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:09.470522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29c960c9-3711-4a9a-abf3-930a79ce685f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:09.471412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29c960c9-3711-4a9a-abf3-930a79ce685f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:09.539776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-29c960c9-3711-4a9a-abf3-930a79ce685f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:54:09.774150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0c1e671f-5849-4889-be5d-90aa33ce661a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:09.785565 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-29c960c9-3711-4a9a-abf3-930a79ce685f tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2" status: 204 len: 0 microversion: 2.1 time: 0.340012 Sep 07 12:54:09.788429 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2369/4684] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:54:09 2022] DELETE /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:09.792281 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0c1e671f-5849-4889-be5d-90aa33ce661a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.452587 Sep 07 12:54:09.806779 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2316/4685] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:09 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:09.825875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-deae5b47-ce2c-43cb-a597-cd7f9be9b82d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:09.833098 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-deae5b47-ce2c-43cb-a597-cd7f9be9b82d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:09.862691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-deae5b47-ce2c-43cb-a597-cd7f9be9b82d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:09.864775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-deae5b47-ce2c-43cb-a597-cd7f9be9b82d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:09.868631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-deae5b47-ce2c-43cb-a597-cd7f9be9b82d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:09.871713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-deae5b47-ce2c-43cb-a597-cd7f9be9b82d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:09.875733 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-deae5b47-ce2c-43cb-a597-cd7f9be9b82d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:09.877998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-deae5b47-ce2c-43cb-a597-cd7f9be9b82d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:10.317258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-deae5b47-ce2c-43cb-a597-cd7f9be9b82d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:10.343641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c45ab030-b76a-4300-b8e6-ddd5b84f391d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1450307699", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "49960e13-4e80-4757-a207-47071e716cc5"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:54:10.362721 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-deae5b47-ce2c-43cb-a597-cd7f9be9b82d tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2" status: 200 len: 1520 microversion: 2.1 time: 0.563589 Sep 07 12:54:10.364587 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2370/4686] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:09 2022] GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2 => generated 1520 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:10.462426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-c45ab030-b76a-4300-b8e6-ddd5b84f391d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] validate_networks() for [('49960e13-4e80-4757-a207-47071e716cc5', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:54:11.371861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cce32734-e1aa-4197-807b-bcca7ab2a96d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:11.374420 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cce32734-e1aa-4197-807b-bcca7ab2a96d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 0f92440f-8b32-4731-8383-d9e57e575ae7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:11.395598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cce32734-e1aa-4197-807b-bcca7ab2a96d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:11.397335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cce32734-e1aa-4197-807b-bcca7ab2a96d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:11.398388 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cce32734-e1aa-4197-807b-bcca7ab2a96d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:11.400649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cce32734-e1aa-4197-807b-bcca7ab2a96d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:11.402009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cce32734-e1aa-4197-807b-bcca7ab2a96d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:11.403232 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cce32734-e1aa-4197-807b-bcca7ab2a96d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:11.444436 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-cce32734-e1aa-4197-807b-bcca7ab2a96d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cce32734-e1aa-4197-807b-bcca7ab2a96d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7 HTTP/1.1 Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '0f92440f-8b32-4731-8383-d9e57e575ae7'} Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:54:11.449930 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:54:11.457877 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. Sep 07 12:54:11.457877 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:54:11.457877 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:54:11.457877 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:54:11.457877 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:54:11.457877 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:54:11.457877 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:54:11.457877 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:54:11.457877 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:54:11.457877 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. Sep 07 12:54:11.457877 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:54:11.462310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cce32734-e1aa-4197-807b-bcca7ab2a96d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 404 to user: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:54:11.464327 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cce32734-e1aa-4197-807b-bcca7ab2a96d tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7" status: 404 len: 111 microversion: 2.1 time: 0.103032 Sep 07 12:54:11.466651 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2371/4687] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:54:11 2022] DELETE /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:54:11.477805 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bc83d773-958b-4775-a2c0-f20ca94f0681 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:11.479463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bc83d773-958b-4775-a2c0-f20ca94f0681 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:11.495756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc83d773-958b-4775-a2c0-f20ca94f0681 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:11.499819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc83d773-958b-4775-a2c0-f20ca94f0681 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:11.501345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc83d773-958b-4775-a2c0-f20ca94f0681 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:11.503074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc83d773-958b-4775-a2c0-f20ca94f0681 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:11.504428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc83d773-958b-4775-a2c0-f20ca94f0681 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:11.505833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc83d773-958b-4775-a2c0-f20ca94f0681 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:11.983373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bc83d773-958b-4775-a2c0-f20ca94f0681 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:11.998213 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bc83d773-958b-4775-a2c0-f20ca94f0681 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2" status: 200 len: 1520 microversion: 2.1 time: 0.528396 Sep 07 12:54:12.006057 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2372/4688] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:11 2022] GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2 => generated 1520 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:12.023725 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-29ab7ada-2710-4df8-b9dd-f125387db175 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:12.024798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-29ab7ada-2710-4df8-b9dd-f125387db175 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 0f92440f-8b32-4731-8383-d9e57e575ae7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:12.044132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29ab7ada-2710-4df8-b9dd-f125387db175 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:12.045008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29ab7ada-2710-4df8-b9dd-f125387db175 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:12.045848 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29ab7ada-2710-4df8-b9dd-f125387db175 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:12.047051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29ab7ada-2710-4df8-b9dd-f125387db175 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:12.047764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29ab7ada-2710-4df8-b9dd-f125387db175 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:12.048386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29ab7ada-2710-4df8-b9dd-f125387db175 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:12.088368 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-29ab7ada-2710-4df8-b9dd-f125387db175 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-29ab7ada-2710-4df8-b9dd-f125387db175 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7 HTTP/1.1 Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '0f92440f-8b32-4731-8383-d9e57e575ae7'} Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:54:12.093739 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:54:12.097309 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:54:12.097309 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:54:12.097309 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:54:12.097309 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:54:12.097309 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:54:12.097309 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. Sep 07 12:54:12.097309 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:54:12.102650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-29ab7ada-2710-4df8-b9dd-f125387db175 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 404 to user: Instance 0f92440f-8b32-4731-8383-d9e57e575ae7 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:54:12.104050 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-29ab7ada-2710-4df8-b9dd-f125387db175 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7" status: 404 len: 111 microversion: 2.1 time: 0.096617 Sep 07 12:54:12.108098 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2373/4689] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:12 2022] GET /compute/v2.1/servers/0f92440f-8b32-4731-8383-d9e57e575ae7 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:54:12.115367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7741d4de-d250-4016-b423-5ab8f667d041 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:12.120195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7741d4de-d250-4016-b423-5ab8f667d041 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:12.134473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7741d4de-d250-4016-b423-5ab8f667d041 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:12.139466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7741d4de-d250-4016-b423-5ab8f667d041 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:12.140253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7741d4de-d250-4016-b423-5ab8f667d041 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:12.143370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7741d4de-d250-4016-b423-5ab8f667d041 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:12.144230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7741d4de-d250-4016-b423-5ab8f667d041 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:12.146889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7741d4de-d250-4016-b423-5ab8f667d041 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:12.224762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7741d4de-d250-4016-b423-5ab8f667d041 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:54:12.415990 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7741d4de-d250-4016-b423-5ab8f667d041 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 204 len: 0 microversion: 2.1 time: 0.304449 Sep 07 12:54:12.416928 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2374/4690] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:54:12 2022] DELETE /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:12.427870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5657dd14-ee9c-4cff-8f10-b2025879aaad tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:12.428743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5657dd14-ee9c-4cff-8f10-b2025879aaad tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:12.450380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5657dd14-ee9c-4cff-8f10-b2025879aaad tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:12.450896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5657dd14-ee9c-4cff-8f10-b2025879aaad tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:12.451422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5657dd14-ee9c-4cff-8f10-b2025879aaad tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:12.452352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5657dd14-ee9c-4cff-8f10-b2025879aaad tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:12.453092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5657dd14-ee9c-4cff-8f10-b2025879aaad tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:12.453587 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5657dd14-ee9c-4cff-8f10-b2025879aaad tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:12.510815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:13.192038 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c45ab030-b76a-4300-b8e6-ddd5b84f391d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:54:13.193100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c45ab030-b76a-4300-b8e6-ddd5b84f391d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:54:13.194212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c45ab030-b76a-4300-b8e6-ddd5b84f391d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:54:13.198687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c45ab030-b76a-4300-b8e6-ddd5b84f391d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:54:13.201434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c45ab030-b76a-4300-b8e6-ddd5b84f391d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:54:13.213104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:13.242244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c45ab030-b76a-4300-b8e6-ddd5b84f391d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:13.243447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c45ab030-b76a-4300-b8e6-ddd5b84f391d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:13.244500 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c45ab030-b76a-4300-b8e6-ddd5b84f391d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:13.248309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c45ab030-b76a-4300-b8e6-ddd5b84f391d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:13.249641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c45ab030-b76a-4300-b8e6-ddd5b84f391d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:13.250738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c45ab030-b76a-4300-b8e6-ddd5b84f391d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:13.314117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-c45ab030-b76a-4300-b8e6-ddd5b84f391d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Getting quotas for project af1de494abea4aa7841c00fb199e8aec. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:54:13.314837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5657dd14-ee9c-4cff-8f10-b2025879aaad tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:13.326731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-c45ab030-b76a-4300-b8e6-ddd5b84f391d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Getting quotas for user 22ec4509710f446d843f6882120c5d6e and project af1de494abea4aa7841c00fb199e8aec. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:54:13.342517 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5657dd14-ee9c-4cff-8f10-b2025879aaad tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1511 microversion: 2.1 time: 0.918814 Sep 07 12:54:13.354986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c45ab030-b76a-4300-b8e6-ddd5b84f391d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:54:13.360622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c45ab030-b76a-4300-b8e6-ddd5b84f391d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: ed9ee1fe-336d-4562-b888-1cac8fb86dff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:54:13.363304 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2375/4691] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:12 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1511 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:13.403086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-379d68e0-563d-4bb9-8312-59ed4339b56c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:13.410484 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-379d68e0-563d-4bb9-8312-59ed4339b56c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:13.458521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-379d68e0-563d-4bb9-8312-59ed4339b56c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:13.469723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-379d68e0-563d-4bb9-8312-59ed4339b56c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:13.470389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-379d68e0-563d-4bb9-8312-59ed4339b56c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:13.471783 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-379d68e0-563d-4bb9-8312-59ed4339b56c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:13.472592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-379d68e0-563d-4bb9-8312-59ed4339b56c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:13.477774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-379d68e0-563d-4bb9-8312-59ed4339b56c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:13.482662 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c45ab030-b76a-4300-b8e6-ddd5b84f391d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.143941 Sep 07 12:54:13.488829 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2317/4692] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:54:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 12:54:13.531551 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4a4f78a1-2bc0-4bc5-b341-9dc128b8129e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:13.556152 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4a4f78a1-2bc0-4bc5-b341-9dc128b8129e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: ed9ee1fe-336d-4562-b888-1cac8fb86dff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:13.963783 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-379d68e0-563d-4bb9-8312-59ed4339b56c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:13.987381 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-379d68e0-563d-4bb9-8312-59ed4339b56c tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2" status: 200 len: 1478 microversion: 2.1 time: 0.622138 Sep 07 12:54:13.992142 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2376/4693] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:13 2022] GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2 => generated 1478 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:14.169521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4a4f78a1-2bc0-4bc5-b341-9dc128b8129e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:14.199190 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4a4f78a1-2bc0-4bc5-b341-9dc128b8129e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff" status: 200 len: 1215 microversion: 2.1 time: 0.679818 Sep 07 12:54:14.202557 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2318/4694] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:13 2022] GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff => generated 1215 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:14.389859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e7fbc4f1-b77f-4879-ab8c-33a02975386c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:14.390508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e7fbc4f1-b77f-4879-ab8c-33a02975386c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:14.415801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7fbc4f1-b77f-4879-ab8c-33a02975386c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:14.423272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7fbc4f1-b77f-4879-ab8c-33a02975386c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:14.427247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7fbc4f1-b77f-4879-ab8c-33a02975386c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:14.428422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7fbc4f1-b77f-4879-ab8c-33a02975386c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:14.430990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7fbc4f1-b77f-4879-ab8c-33a02975386c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:14.431479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7fbc4f1-b77f-4879-ab8c-33a02975386c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:15.273231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-78b3e833-d8a3-4db6-9c64-4a898b77c283 req-6ff05597-345e-406e-b947-24d4e4da46ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8425f313-f6b3-462f-92d7-8803be5ff8f2", "name": "network-vif-deleted", "tag": "b1e3f8b5-9eca-480a-8b03-6f52f4a3fc53"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:54:15.316314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-78b3e833-d8a3-4db6-9c64-4a898b77c283 req-6ff05597-345e-406e-b947-24d4e4da46ee service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:15.316707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-78b3e833-d8a3-4db6-9c64-4a898b77c283 req-6ff05597-345e-406e-b947-24d4e4da46ee service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:15.330019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-78b3e833-d8a3-4db6-9c64-4a898b77c283 req-6ff05597-345e-406e-b947-24d4e4da46ee service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:15.356974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e7fbc4f1-b77f-4879-ab8c-33a02975386c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:15.368163 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e7fbc4f1-b77f-4879-ab8c-33a02975386c tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1511 microversion: 2.1 time: 0.983524 Sep 07 12:54:15.370389 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-78b3e833-d8a3-4db6-9c64-4a898b77c283 req-6ff05597-345e-406e-b947-24d4e4da46ee service nova] Creating event network-vif-deleted:b1e3f8b5-9eca-480a-8b03-6f52f4a3fc53 for instance 8425f313-f6b3-462f-92d7-8803be5ff8f2 on n-h1-852087-9 Sep 07 12:54:15.374886 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2319/4695] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:14 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1511 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:54:15.381950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aca58bd7-efe3-43cb-8ba5-1b7426ef0fc7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:15.382863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aca58bd7-efe3-43cb-8ba5-1b7426ef0fc7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:15.396425 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-78b3e833-d8a3-4db6-9c64-4a898b77c283 req-6ff05597-345e-406e-b947-24d4e4da46ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.122517 Sep 07 12:54:15.397648 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2377/4696] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:54:15.409286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f4160928-be45-4ea0-b254-ef29b87e36dc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:15.410544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f4160928-be45-4ea0-b254-ef29b87e36dc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: ed9ee1fe-336d-4562-b888-1cac8fb86dff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:15.416330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aca58bd7-efe3-43cb-8ba5-1b7426ef0fc7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:15.422381 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aca58bd7-efe3-43cb-8ba5-1b7426ef0fc7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:15.425852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aca58bd7-efe3-43cb-8ba5-1b7426ef0fc7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:15.430562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aca58bd7-efe3-43cb-8ba5-1b7426ef0fc7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:15.431258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aca58bd7-efe3-43cb-8ba5-1b7426ef0fc7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:15.432649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aca58bd7-efe3-43cb-8ba5-1b7426ef0fc7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:15.505847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aca58bd7-efe3-43cb-8ba5-1b7426ef0fc7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:15.506562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aca58bd7-efe3-43cb-8ba5-1b7426ef0fc7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:15.507172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aca58bd7-efe3-43cb-8ba5-1b7426ef0fc7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:15.507790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-aca58bd7-efe3-43cb-8ba5-1b7426ef0fc7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lazy-loading 'fault' on Instance uuid 8425f313-f6b3-462f-92d7-8803be5ff8f2 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:54:15.592890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f4160928-be45-4ea0-b254-ef29b87e36dc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:15.606639 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f4160928-be45-4ea0-b254-ef29b87e36dc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff" status: 200 len: 1215 microversion: 2.1 time: 0.207469 Sep 07 12:54:15.607661 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2378/4697] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:15 2022] GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff => generated 1215 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:15.760341 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aca58bd7-efe3-43cb-8ba5-1b7426ef0fc7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6d92e694e984ad8b126b94ed8effb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a95a81360419dbaf33382dd369262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:15.774353 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aca58bd7-efe3-43cb-8ba5-1b7426ef0fc7 tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2" status: 200 len: 1311 microversion: 2.1 time: 0.397932 Sep 07 12:54:15.794161 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2320/4698] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:15 2022] GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2 => generated 1311 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:16.424879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8fbfa500-389e-4240-affb-89f54bbf9248 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:16.427055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8fbfa500-389e-4240-affb-89f54bbf9248 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:16.458689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fbfa500-389e-4240-affb-89f54bbf9248 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:16.460114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fbfa500-389e-4240-affb-89f54bbf9248 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:16.463809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fbfa500-389e-4240-affb-89f54bbf9248 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:16.471529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fbfa500-389e-4240-affb-89f54bbf9248 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:16.472783 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fbfa500-389e-4240-affb-89f54bbf9248 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:16.474072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fbfa500-389e-4240-affb-89f54bbf9248 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:16.662291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c6d3ac62-8381-4086-82d6-3258b3548bbc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:16.664596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c6d3ac62-8381-4086-82d6-3258b3548bbc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: ed9ee1fe-336d-4562-b888-1cac8fb86dff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:16.697436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6d3ac62-8381-4086-82d6-3258b3548bbc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:16.698464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6d3ac62-8381-4086-82d6-3258b3548bbc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:16.700380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6d3ac62-8381-4086-82d6-3258b3548bbc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:16.702829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6d3ac62-8381-4086-82d6-3258b3548bbc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:16.707345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6d3ac62-8381-4086-82d6-3258b3548bbc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:16.708506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6d3ac62-8381-4086-82d6-3258b3548bbc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:17.167052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c6d3ac62-8381-4086-82d6-3258b3548bbc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:17.198873 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c6d3ac62-8381-4086-82d6-3258b3548bbc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff" status: 200 len: 1267 microversion: 2.1 time: 0.543717 Sep 07 12:54:17.213695 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2321/4699] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:16 2022] GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff => generated 1267 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:54:17.229932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e02f4585-3c92-42d7-954a-19fc7abb6c4a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:17.229932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e02f4585-3c92-42d7-954a-19fc7abb6c4a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] [instance: 8425f313-f6b3-462f-92d7-8803be5ff8f2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:17.230663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8fbfa500-389e-4240-affb-89f54bbf9248 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da37082c7e74cc3be74ce6104983f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e605280bfcc43c6862a1181dabb3d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:17.265516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e02f4585-3c92-42d7-954a-19fc7abb6c4a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:17.267605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e02f4585-3c92-42d7-954a-19fc7abb6c4a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:17.269624 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e02f4585-3c92-42d7-954a-19fc7abb6c4a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:17.273301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e02f4585-3c92-42d7-954a-19fc7abb6c4a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:17.275337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e02f4585-3c92-42d7-954a-19fc7abb6c4a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:17.277041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e02f4585-3c92-42d7-954a-19fc7abb6c4a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:17.288590 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8fbfa500-389e-4240-affb-89f54bbf9248 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 200 len: 1511 microversion: 2.1 time: 0.872008 Sep 07 12:54:17.290226 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2379/4700] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:16 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 1511 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:17.319979 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-e02f4585-3c92-42d7-954a-19fc7abb6c4a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] HTTP exception thrown: Instance 8425f313-f6b3-462f-92d7-8803be5ff8f2 could not be found. Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e02f4585-3c92-42d7-954a-19fc7abb6c4a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Request method failure captured: Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2 HTTP/1.1 Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJKZVQHWlJ74Dx2W8ZEdML0xF-2AOg7c1kyx3sCL0Z6KLQM5ezA45HggvILiFiNDg07ylWr0Vwzz5BQco3_h-9AY0fLV1Rv4K5sggvhMC6zI5NaP-U7NrDZHMoSQThjt2D27IAAoa8B5_g5vq1oNty_s1bxD15UYFAJm0Q--CvZRoS0 Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 256a95a81360419dbaf33382dd369262 Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1632514538 Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/256a95a81360419dbaf33382dd369262"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_256a95a81360419dbaf33382dd369262"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/256a95a81360419dbaf33382dd369262"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/256a95a81360419dbaf33382dd369262"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1632514538 Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 256a95a81360419dbaf33382dd369262 Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1632514538 Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerRescueNegativeTestJSON-1632514538-project Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: a6d92e694e984ad8b126b94ed8effb3f Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1632514538-project Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 8425f313-f6b3-462f-92d7-8803be5ff8f2 could not be found. Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '8425f313-f6b3-462f-92d7-8803be5ff8f2'} Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8425f313-f6b3-462f-92d7-8803be5ff8f2 could not be found. Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8425f313-f6b3-462f-92d7-8803be5ff8f2 could not be found. Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:54:17.324385 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:54:17.332831 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:54:17.332831 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:54:17.332831 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:54:17.332831 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:54:17.332831 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:54:17.332831 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:54:17.332831 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8425f313-f6b3-462f-92d7-8803be5ff8f2 could not be found. Sep 07 12:54:17.332831 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:54:17.337969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e02f4585-3c92-42d7-954a-19fc7abb6c4a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] Returning 404 to user: Instance 8425f313-f6b3-462f-92d7-8803be5ff8f2 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:54:17.337969 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e02f4585-3c92-42d7-954a-19fc7abb6c4a tempest-ServerRescueNegativeTestJSON-1632514538 tempest-ServerRescueNegativeTestJSON-1632514538-project] 10.222.0.16 "GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2" status: 404 len: 111 microversion: 2.1 time: 0.120959 Sep 07 12:54:17.339265 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2322/4701] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:17 2022] GET /compute/v2.1/servers/8425f313-f6b3-462f-92d7-8803be5ff8f2 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:54:17.530477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-1e74ae00-b7ee-4950-a899-03aeaaca5190 req-0a32f468-9db1-4d63-a38e-7156f5f1e8e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860", "name": "network-vif-deleted", "tag": "01afecc6-db9f-4ad9-84b4-c7038640dcd0"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:54:17.581305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1e74ae00-b7ee-4950-a899-03aeaaca5190 req-0a32f468-9db1-4d63-a38e-7156f5f1e8e7 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:17.582731 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1e74ae00-b7ee-4950-a899-03aeaaca5190 req-0a32f468-9db1-4d63-a38e-7156f5f1e8e7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:17.584145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1e74ae00-b7ee-4950-a899-03aeaaca5190 req-0a32f468-9db1-4d63-a38e-7156f5f1e8e7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:17.624952 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-1e74ae00-b7ee-4950-a899-03aeaaca5190 req-0a32f468-9db1-4d63-a38e-7156f5f1e8e7 service nova] Creating event network-vif-deleted:01afecc6-db9f-4ad9-84b4-c7038640dcd0 for instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 on n-h1-852087-9 Sep 07 12:54:17.645681 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-1e74ae00-b7ee-4950-a899-03aeaaca5190 req-0a32f468-9db1-4d63-a38e-7156f5f1e8e7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125299 Sep 07 12:54:17.647571 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2380/4702] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:54:18.244259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-652be1dc-3866-4e37-8eba-3b8b6478afb2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:18.245549 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-652be1dc-3866-4e37-8eba-3b8b6478afb2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: ed9ee1fe-336d-4562-b888-1cac8fb86dff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:18.267459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-652be1dc-3866-4e37-8eba-3b8b6478afb2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:18.268179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-652be1dc-3866-4e37-8eba-3b8b6478afb2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:18.268788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-652be1dc-3866-4e37-8eba-3b8b6478afb2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:18.269751 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-652be1dc-3866-4e37-8eba-3b8b6478afb2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:18.270682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-652be1dc-3866-4e37-8eba-3b8b6478afb2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:18.271333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-652be1dc-3866-4e37-8eba-3b8b6478afb2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:18.336895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5bb898d0-572d-4cc0-9493-e8094bfe5e58 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:18.338135 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5bb898d0-572d-4cc0-9493-e8094bfe5e58 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] [instance: 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:18.364202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5bb898d0-572d-4cc0-9493-e8094bfe5e58 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:18.365126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5bb898d0-572d-4cc0-9493-e8094bfe5e58 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:18.365946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5bb898d0-572d-4cc0-9493-e8094bfe5e58 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:18.367040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5bb898d0-572d-4cc0-9493-e8094bfe5e58 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:18.367706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5bb898d0-572d-4cc0-9493-e8094bfe5e58 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:18.368229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5bb898d0-572d-4cc0-9493-e8094bfe5e58 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:18.413033 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-5bb898d0-572d-4cc0-9493-e8094bfe5e58 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] HTTP exception thrown: Instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 could not be found. Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5bb898d0-572d-4cc0-9493-e8094bfe5e58 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Request method failure captured: Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 HTTP/1.1 Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNZQRZADnsXVMyPuyYmWjWF18fLWrTM6DfyzoZuZOj7jlc4LaXkM_yJXLCNeWKykFPiDTwKx74lw2Z5GFSkIEipBEOVkzKUUjSAjqOUkVtSdbJxGgNyHzlY9ZcGwnet99TrI1CigjEZs3Lmdacsefx45sucZPaTS8ZrpgFD212avWE Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e605280bfcc43c6862a1181dabb3d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8e605280bfcc43c6862a1181dabb3d2f Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-811453595 Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5da37082c7e74cc3be74ce6104983f03 Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-811453595-project Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 could not be found. Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860'} Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 could not be found. Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 could not be found. Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:54:18.423216 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:54:18.428296 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:54:18.428296 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:54:18.428296 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:54:18.428296 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:54:18.428296 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:54:18.428296 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 could not be found. Sep 07 12:54:18.428296 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:54:18.430759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5bb898d0-572d-4cc0-9493-e8094bfe5e58 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] Returning 404 to user: Instance 6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:54:18.431906 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5bb898d0-572d-4cc0-9493-e8094bfe5e58 tempest-ServersNegativeTestJSON-811453595 tempest-ServersNegativeTestJSON-811453595-project] 10.222.0.16 "GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860" status: 404 len: 111 microversion: 2.1 time: 0.103715 Sep 07 12:54:18.433095 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2381/4703] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:18 2022] GET /compute/v2.1/servers/6aa2c5e0-ae50-40c7-9ee4-a4ed04c7b860 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:54:18.495063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-652be1dc-3866-4e37-8eba-3b8b6478afb2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:18.508157 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-652be1dc-3866-4e37-8eba-3b8b6478afb2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff" status: 200 len: 1285 microversion: 2.1 time: 0.267843 Sep 07 12:54:18.514541 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2323/4704] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:18 2022] GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff => generated 1285 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:54:19.544138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-00f9df79-d733-45e5-b083-1d1d6273b0fc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:19.546543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-00f9df79-d733-45e5-b083-1d1d6273b0fc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: ed9ee1fe-336d-4562-b888-1cac8fb86dff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:19.561825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00f9df79-d733-45e5-b083-1d1d6273b0fc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:19.563242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00f9df79-d733-45e5-b083-1d1d6273b0fc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:19.564685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00f9df79-d733-45e5-b083-1d1d6273b0fc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:19.566798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00f9df79-d733-45e5-b083-1d1d6273b0fc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:19.568640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00f9df79-d733-45e5-b083-1d1d6273b0fc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:19.570265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00f9df79-d733-45e5-b083-1d1d6273b0fc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:20.297753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-00f9df79-d733-45e5-b083-1d1d6273b0fc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:20.320412 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-00f9df79-d733-45e5-b083-1d1d6273b0fc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff" status: 200 len: 1273 microversion: 2.1 time: 0.784067 Sep 07 12:54:20.322694 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2382/4705] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:19 2022] GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff => generated 1273 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:21.365581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2542ea4c-d450-4b7a-aaf6-e66573f2d40d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:21.367704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2542ea4c-d450-4b7a-aaf6-e66573f2d40d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: ed9ee1fe-336d-4562-b888-1cac8fb86dff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:21.380616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2542ea4c-d450-4b7a-aaf6-e66573f2d40d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:21.381901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2542ea4c-d450-4b7a-aaf6-e66573f2d40d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:21.383131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2542ea4c-d450-4b7a-aaf6-e66573f2d40d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:21.384793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2542ea4c-d450-4b7a-aaf6-e66573f2d40d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:21.386019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2542ea4c-d450-4b7a-aaf6-e66573f2d40d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:21.387038 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2542ea4c-d450-4b7a-aaf6-e66573f2d40d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:21.428883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:22.269359 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2542ea4c-d450-4b7a-aaf6-e66573f2d40d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:22.294728 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2542ea4c-d450-4b7a-aaf6-e66573f2d40d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff" status: 200 len: 1315 microversion: 2.1 time: 0.932987 Sep 07 12:54:22.301642 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2324/4706] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:21 2022] GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff => generated 1315 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:54:23.342138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7d70d1ff-b43b-4fe7-ad21-73f82f668a30 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:23.346431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7d70d1ff-b43b-4fe7-ad21-73f82f668a30 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: ed9ee1fe-336d-4562-b888-1cac8fb86dff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:23.382881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d70d1ff-b43b-4fe7-ad21-73f82f668a30 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:23.384338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d70d1ff-b43b-4fe7-ad21-73f82f668a30 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:23.390111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d70d1ff-b43b-4fe7-ad21-73f82f668a30 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:23.413836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d70d1ff-b43b-4fe7-ad21-73f82f668a30 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:23.417896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d70d1ff-b43b-4fe7-ad21-73f82f668a30 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:23.419258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d70d1ff-b43b-4fe7-ad21-73f82f668a30 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:23.964288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7d70d1ff-b43b-4fe7-ad21-73f82f668a30 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:23.998261 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7d70d1ff-b43b-4fe7-ad21-73f82f668a30 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff" status: 200 len: 1315 microversion: 2.1 time: 0.667493 Sep 07 12:54:23.999534 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2383/4707] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:23 2022] GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff => generated 1315 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:24.829119 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:24.830512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:24.835631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-25887832-a5d9-440d-b616-e5a3c51e3e49 req-86e7a2f6-3885-474f-b755-4e2dc18f9f0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed9ee1fe-336d-4562-b888-1cac8fb86dff", "tag": "3594a5d6-0f87-4626-8620-00caba30dae7"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:54:24.870816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-25887832-a5d9-440d-b616-e5a3c51e3e49 req-86e7a2f6-3885-474f-b755-4e2dc18f9f0d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:24.871626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-25887832-a5d9-440d-b616-e5a3c51e3e49 req-86e7a2f6-3885-474f-b755-4e2dc18f9f0d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:24.875726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-25887832-a5d9-440d-b616-e5a3c51e3e49 req-86e7a2f6-3885-474f-b755-4e2dc18f9f0d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:24.938947 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-25887832-a5d9-440d-b616-e5a3c51e3e49 req-86e7a2f6-3885-474f-b755-4e2dc18f9f0d service nova] Creating event network-changed:3594a5d6-0f87-4626-8620-00caba30dae7 for instance ed9ee1fe-336d-4562-b888-1cac8fb86dff on n-h1-852087-9 Sep 07 12:54:24.960494 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-25887832-a5d9-440d-b616-e5a3c51e3e49 req-86e7a2f6-3885-474f-b755-4e2dc18f9f0d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132296 Sep 07 12:54:24.977106 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2325/4708] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:54:25.036881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ba7df921-b3a2-46df-8b9f-4d742909c016 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:25.042488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ba7df921-b3a2-46df-8b9f-4d742909c016 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: ed9ee1fe-336d-4562-b888-1cac8fb86dff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:25.082857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba7df921-b3a2-46df-8b9f-4d742909c016 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:25.085294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba7df921-b3a2-46df-8b9f-4d742909c016 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:25.089576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba7df921-b3a2-46df-8b9f-4d742909c016 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:25.098473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba7df921-b3a2-46df-8b9f-4d742909c016 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:25.102529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba7df921-b3a2-46df-8b9f-4d742909c016 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:25.103825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba7df921-b3a2-46df-8b9f-4d742909c016 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:25.598768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:26.664705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ba7df921-b3a2-46df-8b9f-4d742909c016 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:26.679148 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ba7df921-b3a2-46df-8b9f-4d742909c016 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff" status: 200 len: 1315 microversion: 2.1 time: 1.654864 Sep 07 12:54:26.680598 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2384/4709] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:25 2022] GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff => generated 1315 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:27.737820 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-95895afd-435d-4917-b835-c8e38274314d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:27.741080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-95895afd-435d-4917-b835-c8e38274314d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: ed9ee1fe-336d-4562-b888-1cac8fb86dff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:27.775486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95895afd-435d-4917-b835-c8e38274314d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:27.778902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95895afd-435d-4917-b835-c8e38274314d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:27.779975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95895afd-435d-4917-b835-c8e38274314d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:27.783563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95895afd-435d-4917-b835-c8e38274314d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:27.788746 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95895afd-435d-4917-b835-c8e38274314d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:27.793366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95895afd-435d-4917-b835-c8e38274314d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:28.815822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-95895afd-435d-4917-b835-c8e38274314d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:28.851165 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-95895afd-435d-4917-b835-c8e38274314d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff" status: 200 len: 1315 microversion: 2.1 time: 1.128431 Sep 07 12:54:28.875375 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2326/4710] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:27 2022] GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff => generated 1315 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:54:29.778707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-64dc3106-460a-4005-bdae-8d5122bfe51b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-143259716", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "1c45fce2-7bfe-4e93-8f9c-12b9830de28b"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:54:29.894261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5275d034-eee6-43a2-9d7a-8666a45346fd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:29.906743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5275d034-eee6-43a2-9d7a-8666a45346fd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: ed9ee1fe-336d-4562-b888-1cac8fb86dff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:29.925057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5275d034-eee6-43a2-9d7a-8666a45346fd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:29.926309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5275d034-eee6-43a2-9d7a-8666a45346fd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:29.927419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5275d034-eee6-43a2-9d7a-8666a45346fd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:29.929432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5275d034-eee6-43a2-9d7a-8666a45346fd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:29.931008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5275d034-eee6-43a2-9d7a-8666a45346fd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:29.934545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5275d034-eee6-43a2-9d7a-8666a45346fd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:30.016705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-64dc3106-460a-4005-bdae-8d5122bfe51b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] validate_networks() for [('1c45fce2-7bfe-4e93-8f9c-12b9830de28b', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:54:31.470159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5275d034-eee6-43a2-9d7a-8666a45346fd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:31.479403 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5275d034-eee6-43a2-9d7a-8666a45346fd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff" status: 200 len: 1315 microversion: 2.1 time: 1.601186 Sep 07 12:54:31.480280 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2327/4711] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:29 2022] GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff => generated 1315 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:32.540006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea4a6bfa-c200-49a4-bca5-93f2e9150fd4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:32.543556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ea4a6bfa-c200-49a4-bca5-93f2e9150fd4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: ed9ee1fe-336d-4562-b888-1cac8fb86dff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:32.568594 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea4a6bfa-c200-49a4-bca5-93f2e9150fd4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:32.571645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea4a6bfa-c200-49a4-bca5-93f2e9150fd4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:32.572266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea4a6bfa-c200-49a4-bca5-93f2e9150fd4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:32.576837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea4a6bfa-c200-49a4-bca5-93f2e9150fd4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:32.577999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea4a6bfa-c200-49a4-bca5-93f2e9150fd4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:32.579958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea4a6bfa-c200-49a4-bca5-93f2e9150fd4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:33.004992 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-64dc3106-460a-4005-bdae-8d5122bfe51b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:54:33.006871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-64dc3106-460a-4005-bdae-8d5122bfe51b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:54:33.008376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-64dc3106-460a-4005-bdae-8d5122bfe51b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:54:33.008976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-64dc3106-460a-4005-bdae-8d5122bfe51b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:54:33.010287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-64dc3106-460a-4005-bdae-8d5122bfe51b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:54:33.055117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64dc3106-460a-4005-bdae-8d5122bfe51b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:33.056108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64dc3106-460a-4005-bdae-8d5122bfe51b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:33.057890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64dc3106-460a-4005-bdae-8d5122bfe51b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:33.060313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64dc3106-460a-4005-bdae-8d5122bfe51b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:33.067564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64dc3106-460a-4005-bdae-8d5122bfe51b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:33.072093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64dc3106-460a-4005-bdae-8d5122bfe51b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:33.118588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-64dc3106-460a-4005-bdae-8d5122bfe51b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Getting quotas for project 854c6a81bbfd4ab79126799ec40c954e. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:54:33.132233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-64dc3106-460a-4005-bdae-8d5122bfe51b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Getting quotas for user 6ac786dc6d7847f582262dcd912c3f06 and project 854c6a81bbfd4ab79126799ec40c954e. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:54:33.164746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-64dc3106-460a-4005-bdae-8d5122bfe51b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:54:33.168495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-64dc3106-460a-4005-bdae-8d5122bfe51b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: d2cbb4b8-d0fd-4230-8370-cedded0a7a16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:54:33.199566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ea4a6bfa-c200-49a4-bca5-93f2e9150fd4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:33.220497 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ea4a6bfa-c200-49a4-bca5-93f2e9150fd4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff" status: 200 len: 1315 microversion: 2.1 time: 0.704259 Sep 07 12:54:33.258335 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2328/4712] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:32 2022] GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff => generated 1315 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:33.316703 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-64dc3106-460a-4005-bdae-8d5122bfe51b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.038981 Sep 07 12:54:33.318347 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2385/4713] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:54:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 4042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 12:54:33.338779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ab4113b8-e223-4354-ac98-6ef8bd3b314e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:33.339825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ab4113b8-e223-4354-ac98-6ef8bd3b314e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: d2cbb4b8-d0fd-4230-8370-cedded0a7a16] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:33.483357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ab4113b8-e223-4354-ac98-6ef8bd3b314e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:33.504150 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ab4113b8-e223-4354-ac98-6ef8bd3b314e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16" status: 200 len: 1192 microversion: 2.1 time: 0.172467 Sep 07 12:54:33.510822 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2329/4714] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:33 2022] GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16 => generated 1192 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:34.266667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4384ab74-9e45-452f-b3c5-545e81fb5b3b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:34.281437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4384ab74-9e45-452f-b3c5-545e81fb5b3b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: ed9ee1fe-336d-4562-b888-1cac8fb86dff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:34.349397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4384ab74-9e45-452f-b3c5-545e81fb5b3b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:34.350920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4384ab74-9e45-452f-b3c5-545e81fb5b3b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:34.352047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4384ab74-9e45-452f-b3c5-545e81fb5b3b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:34.353709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4384ab74-9e45-452f-b3c5-545e81fb5b3b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:34.354854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4384ab74-9e45-452f-b3c5-545e81fb5b3b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:34.356095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4384ab74-9e45-452f-b3c5-545e81fb5b3b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:34.361093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-42f1151b-243a-4779-b019-deb5802215c3 tempest-QuotasTestJSON-615589292 tempest-QuotasTestJSON-615589292-project] Calling method '.version_select at 0x7fc41874e9d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:34.538514 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-42f1151b-243a-4779-b019-deb5802215c3 tempest-QuotasTestJSON-615589292 tempest-QuotasTestJSON-615589292-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/8611528f08fb4a55966217745fdd9735/defaults" status: 200 len: 371 microversion: 2.1 time: 0.754700 Sep 07 12:54:34.543474 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2386/4715] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Sep 7 12:54:33 2022] GET /compute/v2.1/os-quota-sets/8611528f08fb4a55966217745fdd9735/defaults => generated 371 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:54:34.749008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8bc9f751-80c2-4c70-b621-e358f378e946 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-441874066", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "8cf317d2-2719-4bdc-bb98-dd78e8b3d652"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:54:34.850047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4384ab74-9e45-452f-b3c5-545e81fb5b3b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:34.884066 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4384ab74-9e45-452f-b3c5-545e81fb5b3b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff" status: 200 len: 1315 microversion: 2.1 time: 0.621097 Sep 07 12:54:34.888032 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2330/4716] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:34 2022] GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:34.904945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-8bc9f751-80c2-4c70-b621-e358f378e946 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] validate_networks() for [('8cf317d2-2719-4bdc-bb98-dd78e8b3d652', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:54:34.910180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d8a5266-a87b-45d8-b03b-6eb50d8f9baf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:34.927462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1d8a5266-a87b-45d8-b03b-6eb50d8f9baf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: d2cbb4b8-d0fd-4230-8370-cedded0a7a16] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:34.948191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d8a5266-a87b-45d8-b03b-6eb50d8f9baf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:34.949448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d8a5266-a87b-45d8-b03b-6eb50d8f9baf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:34.955282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d8a5266-a87b-45d8-b03b-6eb50d8f9baf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:34.958224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d8a5266-a87b-45d8-b03b-6eb50d8f9baf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:34.959560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d8a5266-a87b-45d8-b03b-6eb50d8f9baf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:34.960302 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d8a5266-a87b-45d8-b03b-6eb50d8f9baf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:35.180126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1d8a5266-a87b-45d8-b03b-6eb50d8f9baf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:35.198272 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1d8a5266-a87b-45d8-b03b-6eb50d8f9baf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16" status: 200 len: 1188 microversion: 2.1 time: 0.308556 Sep 07 12:54:35.204497 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2331/4717] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:34 2022] GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16 => generated 1188 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:35.230263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2907d066-d575-40e6-bcd4-e9288a08aac6 tempest-QuotasTestJSON-615589292 tempest-QuotasTestJSON-615589292-project] Calling method '.version_select at 0x7fc4139fc280>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:36.064031 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2907d066-d575-40e6-bcd4-e9288a08aac6 tempest-QuotasTestJSON-615589292 tempest-QuotasTestJSON-615589292-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/8611528f08fb4a55966217745fdd9735" status: 200 len: 371 microversion: 2.1 time: 0.857296 Sep 07 12:54:36.082422 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2332/4718] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Sep 7 12:54:35 2022] GET /compute/v2.1/os-quota-sets/8611528f08fb4a55966217745fdd9735 => generated 371 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:54:36.098845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d0617f2b-9b8b-4ecc-9cf2-dc97d75a931d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:36.100632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d0617f2b-9b8b-4ecc-9cf2-dc97d75a931d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: ed9ee1fe-336d-4562-b888-1cac8fb86dff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:36.114752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0617f2b-9b8b-4ecc-9cf2-dc97d75a931d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:36.116245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0617f2b-9b8b-4ecc-9cf2-dc97d75a931d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:36.117693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0617f2b-9b8b-4ecc-9cf2-dc97d75a931d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:36.119364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0617f2b-9b8b-4ecc-9cf2-dc97d75a931d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:36.120462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0617f2b-9b8b-4ecc-9cf2-dc97d75a931d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:36.121858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0617f2b-9b8b-4ecc-9cf2-dc97d75a931d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:36.347330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8bc9f751-80c2-4c70-b621-e358f378e946 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:54:36.348159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8bc9f751-80c2-4c70-b621-e358f378e946 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:54:36.348547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8bc9f751-80c2-4c70-b621-e358f378e946 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:54:36.348709 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8bc9f751-80c2-4c70-b621-e358f378e946 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:54:36.349043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8bc9f751-80c2-4c70-b621-e358f378e946 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:54:36.358912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:36.382343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bc9f751-80c2-4c70-b621-e358f378e946 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:36.382890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bc9f751-80c2-4c70-b621-e358f378e946 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:36.383382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bc9f751-80c2-4c70-b621-e358f378e946 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:36.384330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bc9f751-80c2-4c70-b621-e358f378e946 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:36.384831 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bc9f751-80c2-4c70-b621-e358f378e946 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:36.385268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bc9f751-80c2-4c70-b621-e358f378e946 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:36.477996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-8bc9f751-80c2-4c70-b621-e358f378e946 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Getting quotas for project 4e6a79b860544015b08e7e22a888ee9a. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:54:36.498374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-8bc9f751-80c2-4c70-b621-e358f378e946 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Getting quotas for user 83061653a9bf4487a1ea9778ef5d7951 and project 4e6a79b860544015b08e7e22a888ee9a. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:54:36.547062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8bc9f751-80c2-4c70-b621-e358f378e946 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:54:36.556526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8bc9f751-80c2-4c70-b621-e358f378e946 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] [instance: e6109fe8-30c8-42a8-b428-8a62e6e34fca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:54:36.693442 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8bc9f751-80c2-4c70-b621-e358f378e946 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.144432 Sep 07 12:54:36.701944 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2387/4719] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:54:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2157 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:54:36.709211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6c4f3858-78e5-44df-8f10-9bb56c09015d tempest-QuotasTestJSON-615589292 tempest-QuotasTestJSON-615589292-project] Calling method '.version_select at 0x7fc4192be700>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:36.832675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d0617f2b-9b8b-4ecc-9cf2-dc97d75a931d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:36.873085 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d0617f2b-9b8b-4ecc-9cf2-dc97d75a931d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff" status: 200 len: 1315 microversion: 2.1 time: 0.787825 Sep 07 12:54:36.874260 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2333/4720] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:36 2022] GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff => generated 1315 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:36.925977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0a464ff9-315b-4488-a740-69747823bdab tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:36.927184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0a464ff9-315b-4488-a740-69747823bdab tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: d2cbb4b8-d0fd-4230-8370-cedded0a7a16] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:36.940388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a464ff9-315b-4488-a740-69747823bdab tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:36.941641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a464ff9-315b-4488-a740-69747823bdab tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:36.942807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a464ff9-315b-4488-a740-69747823bdab tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:36.944432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a464ff9-315b-4488-a740-69747823bdab tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:36.947539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a464ff9-315b-4488-a740-69747823bdab tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:36.948813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a464ff9-315b-4488-a740-69747823bdab tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:37.177581 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6c4f3858-78e5-44df-8f10-9bb56c09015d tempest-QuotasTestJSON-615589292 tempest-QuotasTestJSON-615589292-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/8611528f08fb4a55966217745fdd9735/defaults" status: 200 len: 371 microversion: 2.1 time: 0.473603 Sep 07 12:54:37.189539 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2388/4721] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Sep 7 12:54:36 2022] GET /compute/v2.1/os-quota-sets/8611528f08fb4a55966217745fdd9735/defaults => generated 371 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:54:37.211944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-38b77658-210a-477f-b5c0-8f916294461c tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:37.219708 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-38b77658-210a-477f-b5c0-8f916294461c tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] [instance: e6109fe8-30c8-42a8-b428-8a62e6e34fca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:37.339611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0a464ff9-315b-4488-a740-69747823bdab tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:37.362895 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0a464ff9-315b-4488-a740-69747823bdab tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16" status: 200 len: 1250 microversion: 2.1 time: 0.486733 Sep 07 12:54:37.373995 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2334/4722] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:36 2022] GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16 => generated 1250 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:37.383247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b184c8b4-3314-4d20-83af-03488188fd08 tempest-QuotasTestJSON-615589292 tempest-QuotasTestJSON-615589292-project] Calling method '.version_select at 0x7fc418873550>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:37.492182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-38b77658-210a-477f-b5c0-8f916294461c tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83061653a9bf4487a1ea9778ef5d7951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6a79b860544015b08e7e22a888ee9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:37.522626 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-38b77658-210a-477f-b5c0-8f916294461c tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] 10.222.0.16 "GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca" status: 200 len: 1216 microversion: 2.1 time: 0.329393 Sep 07 12:54:37.529300 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2389/4723] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:37 2022] GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca => generated 1216 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:37.904626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d6e7aa35-aecd-47e4-bb06-3e96f613fb5a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:37.909221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d6e7aa35-aecd-47e4-bb06-3e96f613fb5a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: ed9ee1fe-336d-4562-b888-1cac8fb86dff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:37.948561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6e7aa35-aecd-47e4-bb06-3e96f613fb5a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:37.955768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6e7aa35-aecd-47e4-bb06-3e96f613fb5a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:37.957079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6e7aa35-aecd-47e4-bb06-3e96f613fb5a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:37.964649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6e7aa35-aecd-47e4-bb06-3e96f613fb5a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:37.966234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6e7aa35-aecd-47e4-bb06-3e96f613fb5a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:37.967231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6e7aa35-aecd-47e4-bb06-3e96f613fb5a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:38.230115 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b184c8b4-3314-4d20-83af-03488188fd08 tempest-QuotasTestJSON-615589292 tempest-QuotasTestJSON-615589292-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/8611528f08fb4a55966217745fdd9735" status: 200 len: 371 microversion: 2.1 time: 0.850281 Sep 07 12:54:38.230812 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2335/4724] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Sep 7 12:54:37 2022] GET /compute/v2.1/os-quota-sets/8611528f08fb4a55966217745fdd9735 => generated 371 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:54:38.250851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fd4e2295-be65-4df8-a7e8-177dedb32bed tempest-QuotasTestJSON-615589292 tempest-QuotasTestJSON-615589292-project] Calling method '.version_select at 0x7fc418804af0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:38.505889 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fd4e2295-be65-4df8-a7e8-177dedb32bed tempest-QuotasTestJSON-615589292 tempest-QuotasTestJSON-615589292-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/8611528f08fb4a55966217745fdd9735?user_id=bfc5aef731604c7a890c1adb250eeebb" status: 200 len: 371 microversion: 2.1 time: 0.265762 Sep 07 12:54:38.526790 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2336/4725] 10.222.0.16 () {58 vars in 1323 bytes} [Wed Sep 7 12:54:38 2022] GET /compute/v2.1/os-quota-sets/8611528f08fb4a55966217745fdd9735?user_id=bfc5aef731604c7a890c1adb250eeebb => generated 371 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:54:38.684818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d6e7aa35-aecd-47e4-bb06-3e96f613fb5a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:38.707702 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d6e7aa35-aecd-47e4-bb06-3e96f613fb5a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff" status: 200 len: 1315 microversion: 2.1 time: 0.810005 Sep 07 12:54:38.708325 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2390/4726] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:37 2022] GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff => generated 1315 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:54:38.720305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-5aa9e739-6aec-42a0-9ab6-ab42fe8f7a62 req-e07352f2-e3d4-4849-ab66-e84ee570ebad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed9ee1fe-336d-4562-b888-1cac8fb86dff", "name": "network-vif-plugged", "status": "completed", "tag": "3594a5d6-0f87-4626-8620-00caba30dae7"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:54:38.742847 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9a658945-5251-462a-8f57-522e4646aa73 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:38.744829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9a658945-5251-462a-8f57-522e4646aa73 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: d2cbb4b8-d0fd-4230-8370-cedded0a7a16] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:38.748560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5aa9e739-6aec-42a0-9ab6-ab42fe8f7a62 req-e07352f2-e3d4-4849-ab66-e84ee570ebad service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:38.749640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5aa9e739-6aec-42a0-9ab6-ab42fe8f7a62 req-e07352f2-e3d4-4849-ab66-e84ee570ebad service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:38.751910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5aa9e739-6aec-42a0-9ab6-ab42fe8f7a62 req-e07352f2-e3d4-4849-ab66-e84ee570ebad service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:38.775043 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-5aa9e739-6aec-42a0-9ab6-ab42fe8f7a62 req-e07352f2-e3d4-4849-ab66-e84ee570ebad service nova] Creating event network-vif-plugged:3594a5d6-0f87-4626-8620-00caba30dae7 for instance ed9ee1fe-336d-4562-b888-1cac8fb86dff on n-h1-852087-9 Sep 07 12:54:38.779917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a658945-5251-462a-8f57-522e4646aa73 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:38.784299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a658945-5251-462a-8f57-522e4646aa73 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:38.786950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a658945-5251-462a-8f57-522e4646aa73 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:38.791637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a658945-5251-462a-8f57-522e4646aa73 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:38.794909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a658945-5251-462a-8f57-522e4646aa73 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:38.797108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a658945-5251-462a-8f57-522e4646aa73 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:38.797280 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-5aa9e739-6aec-42a0-9ab6-ab42fe8f7a62 req-e07352f2-e3d4-4849-ab66-e84ee570ebad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.281592 Sep 07 12:54:38.798703 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2337/4727] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:54:38.817835 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0fef360d-1058-4c92-8664-7a0f1cc5c9ab tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:38.826907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0fef360d-1058-4c92-8664-7a0f1cc5c9ab tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] [instance: e6109fe8-30c8-42a8-b428-8a62e6e34fca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:38.854679 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fef360d-1058-4c92-8664-7a0f1cc5c9ab tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:38.855161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fef360d-1058-4c92-8664-7a0f1cc5c9ab tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:38.857159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fef360d-1058-4c92-8664-7a0f1cc5c9ab tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:38.860666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fef360d-1058-4c92-8664-7a0f1cc5c9ab tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:38.861213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fef360d-1058-4c92-8664-7a0f1cc5c9ab tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:38.868365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0fef360d-1058-4c92-8664-7a0f1cc5c9ab tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:39.204084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0fef360d-1058-4c92-8664-7a0f1cc5c9ab tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83061653a9bf4487a1ea9778ef5d7951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6a79b860544015b08e7e22a888ee9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:39.219821 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0fef360d-1058-4c92-8664-7a0f1cc5c9ab tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] 10.222.0.16 "GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca" status: 200 len: 1212 microversion: 2.1 time: 0.416568 Sep 07 12:54:39.234247 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2338/4728] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:38 2022] GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca => generated 1212 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:39.296306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9a658945-5251-462a-8f57-522e4646aa73 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:39.311991 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9a658945-5251-462a-8f57-522e4646aa73 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16" status: 200 len: 1250 microversion: 2.1 time: 0.602057 Sep 07 12:54:39.313358 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2391/4729] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:38 2022] GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16 => generated 1250 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:39.763477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1792c3cb-eac0-478d-bca6-bc4c3f985f4e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:39.766368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1792c3cb-eac0-478d-bca6-bc4c3f985f4e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: ed9ee1fe-336d-4562-b888-1cac8fb86dff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:39.779445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1792c3cb-eac0-478d-bca6-bc4c3f985f4e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:39.791603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1792c3cb-eac0-478d-bca6-bc4c3f985f4e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:39.792906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1792c3cb-eac0-478d-bca6-bc4c3f985f4e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:39.794747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1792c3cb-eac0-478d-bca6-bc4c3f985f4e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:39.796015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1792c3cb-eac0-478d-bca6-bc4c3f985f4e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:39.799406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1792c3cb-eac0-478d-bca6-bc4c3f985f4e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:40.281610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6fe3aa46-499b-430b-a879-2a08dbfbe5c2 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:40.290024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6fe3aa46-499b-430b-a879-2a08dbfbe5c2 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] [instance: e6109fe8-30c8-42a8-b428-8a62e6e34fca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:40.346140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fe3aa46-499b-430b-a879-2a08dbfbe5c2 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:40.346140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fe3aa46-499b-430b-a879-2a08dbfbe5c2 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:40.346140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fe3aa46-499b-430b-a879-2a08dbfbe5c2 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:40.347944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fe3aa46-499b-430b-a879-2a08dbfbe5c2 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:40.348490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fe3aa46-499b-430b-a879-2a08dbfbe5c2 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:40.349043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fe3aa46-499b-430b-a879-2a08dbfbe5c2 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:41.398286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6fe3aa46-499b-430b-a879-2a08dbfbe5c2 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83061653a9bf4487a1ea9778ef5d7951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6a79b860544015b08e7e22a888ee9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:41.439257 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6fe3aa46-499b-430b-a879-2a08dbfbe5c2 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] 10.222.0.16 "GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca" status: 200 len: 1268 microversion: 2.1 time: 1.165531 Sep 07 12:54:41.443876 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2392/4730] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:40 2022] GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca => generated 1268 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:41.481525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-19d336a2-880a-4b6c-b975-98f1fa722002 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:41.485035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-19d336a2-880a-4b6c-b975-98f1fa722002 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: d2cbb4b8-d0fd-4230-8370-cedded0a7a16] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:41.536028 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19d336a2-880a-4b6c-b975-98f1fa722002 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:41.541576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19d336a2-880a-4b6c-b975-98f1fa722002 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:41.542937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19d336a2-880a-4b6c-b975-98f1fa722002 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:41.544818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19d336a2-880a-4b6c-b975-98f1fa722002 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:41.547184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19d336a2-880a-4b6c-b975-98f1fa722002 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:41.548231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19d336a2-880a-4b6c-b975-98f1fa722002 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:41.698807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1792c3cb-eac0-478d-bca6-bc4c3f985f4e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:41.720433 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1792c3cb-eac0-478d-bca6-bc4c3f985f4e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff" status: 200 len: 1315 microversion: 2.1 time: 1.971829 Sep 07 12:54:41.721172 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2339/4731] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:39 2022] GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff => generated 1315 bytes in 1974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:42.250764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-19d336a2-880a-4b6c-b975-98f1fa722002 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:42.273764 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-19d336a2-880a-4b6c-b975-98f1fa722002 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16" status: 200 len: 1292 microversion: 2.1 time: 0.827511 Sep 07 12:54:42.305620 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2393/4732] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:41 2022] GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16 => generated 1292 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:42.493201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8ef5bec4-54b8-4d5e-897d-464a4619d8a7 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:42.494360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8ef5bec4-54b8-4d5e-897d-464a4619d8a7 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] [instance: e6109fe8-30c8-42a8-b428-8a62e6e34fca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:42.524817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ef5bec4-54b8-4d5e-897d-464a4619d8a7 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:42.526488 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ef5bec4-54b8-4d5e-897d-464a4619d8a7 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:42.530129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ef5bec4-54b8-4d5e-897d-464a4619d8a7 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:42.532262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ef5bec4-54b8-4d5e-897d-464a4619d8a7 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:42.536809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ef5bec4-54b8-4d5e-897d-464a4619d8a7 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:42.538434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ef5bec4-54b8-4d5e-897d-464a4619d8a7 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:42.790770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-80f26c78-bc64-4ee3-a883-cfc6d2f47be3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:42.793433 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-80f26c78-bc64-4ee3-a883-cfc6d2f47be3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: ed9ee1fe-336d-4562-b888-1cac8fb86dff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:42.812417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80f26c78-bc64-4ee3-a883-cfc6d2f47be3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:42.813261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80f26c78-bc64-4ee3-a883-cfc6d2f47be3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:42.817151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80f26c78-bc64-4ee3-a883-cfc6d2f47be3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:42.818499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80f26c78-bc64-4ee3-a883-cfc6d2f47be3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:42.819354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80f26c78-bc64-4ee3-a883-cfc6d2f47be3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:42.820084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80f26c78-bc64-4ee3-a883-cfc6d2f47be3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:42.847385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=67 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:42.895266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8ef5bec4-54b8-4d5e-897d-464a4619d8a7 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83061653a9bf4487a1ea9778ef5d7951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6a79b860544015b08e7e22a888ee9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:42.914995 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8ef5bec4-54b8-4d5e-897d-464a4619d8a7 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] 10.222.0.16 "GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca" status: 200 len: 1274 microversion: 2.1 time: 0.430525 Sep 07 12:54:42.917276 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2340/4733] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:42 2022] GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca => generated 1274 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:43.321956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d9892330-bac3-40f6-a37f-64c48341e0ef tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:43.322584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d9892330-bac3-40f6-a37f-64c48341e0ef tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: d2cbb4b8-d0fd-4230-8370-cedded0a7a16] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:43.324776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:43.342280 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9892330-bac3-40f6-a37f-64c48341e0ef tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:43.354262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9892330-bac3-40f6-a37f-64c48341e0ef tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:43.354845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9892330-bac3-40f6-a37f-64c48341e0ef tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:43.355702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9892330-bac3-40f6-a37f-64c48341e0ef tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:43.356288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9892330-bac3-40f6-a37f-64c48341e0ef tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:43.356879 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9892330-bac3-40f6-a37f-64c48341e0ef tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:43.379208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-80f26c78-bc64-4ee3-a883-cfc6d2f47be3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:43.389164 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-80f26c78-bc64-4ee3-a883-cfc6d2f47be3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff" status: 200 len: 1502 microversion: 2.1 time: 0.609899 Sep 07 12:54:43.396510 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2394/4734] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:42 2022] GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff => generated 1502 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:43.431035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6a19033d-4350-4705-9954-b0ce5665e0c5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:54:43.432543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6a19033d-4350-4705-9954-b0ce5665e0c5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: ed9ee1fe-336d-4562-b888-1cac8fb86dff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:43.459312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a19033d-4350-4705-9954-b0ce5665e0c5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:43.461032 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a19033d-4350-4705-9954-b0ce5665e0c5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:43.462524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a19033d-4350-4705-9954-b0ce5665e0c5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:43.464716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a19033d-4350-4705-9954-b0ce5665e0c5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:43.466033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a19033d-4350-4705-9954-b0ce5665e0c5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:43.467252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6a19033d-4350-4705-9954-b0ce5665e0c5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:43.935138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d9892330-bac3-40f6-a37f-64c48341e0ef tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:43.957315 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d9892330-bac3-40f6-a37f-64c48341e0ef tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16" status: 200 len: 1292 microversion: 2.1 time: 0.639356 Sep 07 12:54:43.959609 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2341/4735] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:43 2022] GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16 => generated 1292 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:54:43.970282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fd09ab5d-638c-4541-862c-0aec9ede428a tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:43.972908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fd09ab5d-638c-4541-862c-0aec9ede428a tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] [instance: e6109fe8-30c8-42a8-b428-8a62e6e34fca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:43.989288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd09ab5d-638c-4541-862c-0aec9ede428a tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:43.991246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd09ab5d-638c-4541-862c-0aec9ede428a tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:43.992885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd09ab5d-638c-4541-862c-0aec9ede428a tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:43.994852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd09ab5d-638c-4541-862c-0aec9ede428a tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:43.996037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd09ab5d-638c-4541-862c-0aec9ede428a tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:43.997359 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd09ab5d-638c-4541-862c-0aec9ede428a tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:44.175867 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.network.security_group_api [None req-6a19033d-4350-4705-9954-b0ce5665e0c5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Removing security group 98f85486-4d05-4313-816a-fe32192ae639 from port 3594a5d6-0f87-4626-8620-00caba30dae7 Sep 07 12:54:45.042803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fd09ab5d-638c-4541-862c-0aec9ede428a tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83061653a9bf4487a1ea9778ef5d7951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6a79b860544015b08e7e22a888ee9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:45.056408 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fd09ab5d-638c-4541-862c-0aec9ede428a tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] 10.222.0.16 "GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca" status: 200 len: 1316 microversion: 2.1 time: 1.095165 Sep 07 12:54:45.060105 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2342/4736] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:43 2022] GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca => generated 1316 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:45.075420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e68dddf1-e6dc-429b-91bb-6a4a02c88da8 req-aaa7787e-bde5-48fe-95a1-b5ce3b5ad05a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2cbb4b8-d0fd-4230-8370-cedded0a7a16", "tag": "a705fc80-a97c-4539-bb7f-f53c8f00ce22"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:54:45.112383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e68dddf1-e6dc-429b-91bb-6a4a02c88da8 req-aaa7787e-bde5-48fe-95a1-b5ce3b5ad05a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:45.113841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e68dddf1-e6dc-429b-91bb-6a4a02c88da8 req-aaa7787e-bde5-48fe-95a1-b5ce3b5ad05a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:45.114306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e68dddf1-e6dc-429b-91bb-6a4a02c88da8 req-aaa7787e-bde5-48fe-95a1-b5ce3b5ad05a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:45.175797 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e68dddf1-e6dc-429b-91bb-6a4a02c88da8 req-aaa7787e-bde5-48fe-95a1-b5ce3b5ad05a service nova] Creating event network-changed:a705fc80-a97c-4539-bb7f-f53c8f00ce22 for instance d2cbb4b8-d0fd-4230-8370-cedded0a7a16 on n-h2-852087-9 Sep 07 12:54:45.211806 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e68dddf1-e6dc-429b-91bb-6a4a02c88da8 req-aaa7787e-bde5-48fe-95a1-b5ce3b5ad05a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134017 Sep 07 12:54:45.216909 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2343/4737] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:54:45.237100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a7847088-0b87-4951-b51f-1e8a536d89c7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:45.239073 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a7847088-0b87-4951-b51f-1e8a536d89c7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: d2cbb4b8-d0fd-4230-8370-cedded0a7a16] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:45.254697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7847088-0b87-4951-b51f-1e8a536d89c7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:45.256063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7847088-0b87-4951-b51f-1e8a536d89c7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:45.260121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7847088-0b87-4951-b51f-1e8a536d89c7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:45.262039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7847088-0b87-4951-b51f-1e8a536d89c7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:45.263408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7847088-0b87-4951-b51f-1e8a536d89c7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:45.264533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7847088-0b87-4951-b51f-1e8a536d89c7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:45.776787 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6a19033d-4350-4705-9954-b0ce5665e0c5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff/action" status: 202 len: 0 microversion: 2.1 time: 2.352830 Sep 07 12:54:45.789340 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2395/4738] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:54:43 2022] POST /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff/action => generated 0 bytes in 2367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 12:54:45.833929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0cf33795-26ae-4611-8bed-23d1e8078f25 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:45.835940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0cf33795-26ae-4611-8bed-23d1e8078f25 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: ed9ee1fe-336d-4562-b888-1cac8fb86dff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:45.852309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cf33795-26ae-4611-8bed-23d1e8078f25 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:45.854008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cf33795-26ae-4611-8bed-23d1e8078f25 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:45.856185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cf33795-26ae-4611-8bed-23d1e8078f25 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:45.858009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cf33795-26ae-4611-8bed-23d1e8078f25 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:45.859509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cf33795-26ae-4611-8bed-23d1e8078f25 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:45.860644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cf33795-26ae-4611-8bed-23d1e8078f25 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:45.957420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a7847088-0b87-4951-b51f-1e8a536d89c7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:46.006455 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a7847088-0b87-4951-b51f-1e8a536d89c7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16" status: 200 len: 1292 microversion: 2.1 time: 0.785006 Sep 07 12:54:46.008933 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2344/4739] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:45 2022] GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16 => generated 1292 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:46.109466 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-790581a0-2dd1-4579-856d-b15d2a314976 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:46.115809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-790581a0-2dd1-4579-856d-b15d2a314976 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] [instance: e6109fe8-30c8-42a8-b428-8a62e6e34fca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:46.132196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-790581a0-2dd1-4579-856d-b15d2a314976 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:46.133941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-790581a0-2dd1-4579-856d-b15d2a314976 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:46.136623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-790581a0-2dd1-4579-856d-b15d2a314976 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:46.142751 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-790581a0-2dd1-4579-856d-b15d2a314976 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:46.144455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-790581a0-2dd1-4579-856d-b15d2a314976 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:46.145763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-790581a0-2dd1-4579-856d-b15d2a314976 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:46.442264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:47.111458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0cf33795-26ae-4611-8bed-23d1e8078f25 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:47.167226 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0cf33795-26ae-4611-8bed-23d1e8078f25 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff" status: 200 len: 1460 microversion: 2.1 time: 1.370197 Sep 07 12:54:47.171437 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2396/4740] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:45 2022] GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff => generated 1460 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:47.190301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4224c439-b6a6-4286-99f9-905fd34c166e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:47.191252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4224c439-b6a6-4286-99f9-905fd34c166e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: d2cbb4b8-d0fd-4230-8370-cedded0a7a16] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:47.212881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4224c439-b6a6-4286-99f9-905fd34c166e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:47.213860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4224c439-b6a6-4286-99f9-905fd34c166e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:47.214975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4224c439-b6a6-4286-99f9-905fd34c166e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:47.216717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4224c439-b6a6-4286-99f9-905fd34c166e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:47.218069 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4224c439-b6a6-4286-99f9-905fd34c166e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:47.219214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4224c439-b6a6-4286-99f9-905fd34c166e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:47.499678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=14 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:47.584485 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-790581a0-2dd1-4579-856d-b15d2a314976 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83061653a9bf4487a1ea9778ef5d7951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6a79b860544015b08e7e22a888ee9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:47.621103 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-790581a0-2dd1-4579-856d-b15d2a314976 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] 10.222.0.16 "GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca" status: 200 len: 1316 microversion: 2.1 time: 1.535758 Sep 07 12:54:47.638513 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2345/4741] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:46 2022] GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca => generated 1316 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:54:47.644495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4224c439-b6a6-4286-99f9-905fd34c166e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:47.664403 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4224c439-b6a6-4286-99f9-905fd34c166e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16" status: 200 len: 1292 microversion: 2.1 time: 0.489051 Sep 07 12:54:47.665520 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2397/4742] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:47 2022] GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16 => generated 1292 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:47.681789 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fecbe31b-fcbd-4a58-8562-cb813c431692 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:47.683230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fecbe31b-fcbd-4a58-8562-cb813c431692 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:47.683430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c0661693-b3ec-4e94-8062-5207251aa0ae req-1ac3332d-2853-4c51-bad0-75d37c7a07fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed9ee1fe-336d-4562-b888-1cac8fb86dff", "tag": "3594a5d6-0f87-4626-8620-00caba30dae7"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:54:47.694849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c0661693-b3ec-4e94-8062-5207251aa0ae req-1ac3332d-2853-4c51-bad0-75d37c7a07fb service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:47.698282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c0661693-b3ec-4e94-8062-5207251aa0ae req-1ac3332d-2853-4c51-bad0-75d37c7a07fb service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:47.701478 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c0661693-b3ec-4e94-8062-5207251aa0ae req-1ac3332d-2853-4c51-bad0-75d37c7a07fb service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:47.717604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fecbe31b-fcbd-4a58-8562-cb813c431692 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:47.718256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fecbe31b-fcbd-4a58-8562-cb813c431692 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:47.718825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fecbe31b-fcbd-4a58-8562-cb813c431692 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:47.719726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fecbe31b-fcbd-4a58-8562-cb813c431692 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:47.720322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fecbe31b-fcbd-4a58-8562-cb813c431692 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:47.720881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fecbe31b-fcbd-4a58-8562-cb813c431692 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:47.733860 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c0661693-b3ec-4e94-8062-5207251aa0ae req-1ac3332d-2853-4c51-bad0-75d37c7a07fb service nova] Creating event network-changed:3594a5d6-0f87-4626-8620-00caba30dae7 for instance ed9ee1fe-336d-4562-b888-1cac8fb86dff on n-h1-852087-9 Sep 07 12:54:47.768837 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c0661693-b3ec-4e94-8062-5207251aa0ae req-1ac3332d-2853-4c51-bad0-75d37c7a07fb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101238 Sep 07 12:54:47.777006 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2398/4743] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:54:48.206739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fecbe31b-fcbd-4a58-8562-cb813c431692 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:48.236970 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fecbe31b-fcbd-4a58-8562-cb813c431692 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.595895 Sep 07 12:54:48.240509 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2346/4744] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:47 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:48.298389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e3a62dd2-00c0-462d-8684-3a530329712e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:48.301222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e3a62dd2-00c0-462d-8684-3a530329712e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:48.322787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3a62dd2-00c0-462d-8684-3a530329712e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:48.324205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3a62dd2-00c0-462d-8684-3a530329712e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:48.325352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3a62dd2-00c0-462d-8684-3a530329712e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:48.332918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3a62dd2-00c0-462d-8684-3a530329712e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:48.336381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3a62dd2-00c0-462d-8684-3a530329712e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:48.337967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e3a62dd2-00c0-462d-8684-3a530329712e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:48.670785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fa9f56e7-4174-4abd-98f5-da82481297cd tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:48.671761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fa9f56e7-4174-4abd-98f5-da82481297cd tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] [instance: e6109fe8-30c8-42a8-b428-8a62e6e34fca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:48.677658 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=10 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:48.687989 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa9f56e7-4174-4abd-98f5-da82481297cd tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:48.688561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa9f56e7-4174-4abd-98f5-da82481297cd tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:48.689026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa9f56e7-4174-4abd-98f5-da82481297cd tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:48.690053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa9f56e7-4174-4abd-98f5-da82481297cd tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:48.691424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa9f56e7-4174-4abd-98f5-da82481297cd tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:48.691927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa9f56e7-4174-4abd-98f5-da82481297cd tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:48.704396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:48.788845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e3a62dd2-00c0-462d-8684-3a530329712e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:48.825401 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e3a62dd2-00c0-462d-8684-3a530329712e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.537314 Sep 07 12:54:48.831318 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2399/4745] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:48 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:48.843621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-10a41124-4be1-4273-bf92-30c5f0a86235 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:48.844293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-10a41124-4be1-4273-bf92-30c5f0a86235 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: d2cbb4b8-d0fd-4230-8370-cedded0a7a16] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:48.866998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10a41124-4be1-4273-bf92-30c5f0a86235 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:48.868017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10a41124-4be1-4273-bf92-30c5f0a86235 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:48.869456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10a41124-4be1-4273-bf92-30c5f0a86235 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:48.872319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10a41124-4be1-4273-bf92-30c5f0a86235 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:48.874600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10a41124-4be1-4273-bf92-30c5f0a86235 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:48.875303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10a41124-4be1-4273-bf92-30c5f0a86235 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:49.688196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fa9f56e7-4174-4abd-98f5-da82481297cd tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83061653a9bf4487a1ea9778ef5d7951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6a79b860544015b08e7e22a888ee9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:49.712539 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fa9f56e7-4174-4abd-98f5-da82481297cd tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] 10.222.0.16 "GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca" status: 200 len: 1316 microversion: 2.1 time: 1.049489 Sep 07 12:54:49.714585 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2347/4746] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:48 2022] GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca => generated 1316 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:54:49.727651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b5146a3c-8aed-44fd-a231-7790641f57d7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:49.729191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b5146a3c-8aed-44fd-a231-7790641f57d7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:49.758571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5146a3c-8aed-44fd-a231-7790641f57d7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:49.759856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5146a3c-8aed-44fd-a231-7790641f57d7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:49.760898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5146a3c-8aed-44fd-a231-7790641f57d7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:49.762561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5146a3c-8aed-44fd-a231-7790641f57d7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:49.764361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5146a3c-8aed-44fd-a231-7790641f57d7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:49.768146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5146a3c-8aed-44fd-a231-7790641f57d7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:49.794129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-10a41124-4be1-4273-bf92-30c5f0a86235 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:49.841360 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-10a41124-4be1-4273-bf92-30c5f0a86235 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16" status: 200 len: 1292 microversion: 2.1 time: 1.007233 Sep 07 12:54:49.848307 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2400/4747] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:48 2022] GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16 => generated 1292 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:49.871372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-7e467dac-bbc7-418c-bc61-8857bb3a4b78 req-6ffcfa0b-a182-4cc2-916e-5fe93c96ae33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6109fe8-30c8-42a8-b428-8a62e6e34fca", "tag": "c50827f8-5fd6-4c3c-80e1-41032a36b97c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:54:49.932413 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7e467dac-bbc7-418c-bc61-8857bb3a4b78 req-6ffcfa0b-a182-4cc2-916e-5fe93c96ae33 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:49.938908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7e467dac-bbc7-418c-bc61-8857bb3a4b78 req-6ffcfa0b-a182-4cc2-916e-5fe93c96ae33 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:49.939592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7e467dac-bbc7-418c-bc61-8857bb3a4b78 req-6ffcfa0b-a182-4cc2-916e-5fe93c96ae33 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:49.979401 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-7e467dac-bbc7-418c-bc61-8857bb3a4b78 req-6ffcfa0b-a182-4cc2-916e-5fe93c96ae33 service nova] Creating event network-changed:c50827f8-5fd6-4c3c-80e1-41032a36b97c for instance e6109fe8-30c8-42a8-b428-8a62e6e34fca on n-h1-852087-9 Sep 07 12:54:49.990291 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-7e467dac-bbc7-418c-bc61-8857bb3a4b78 req-6ffcfa0b-a182-4cc2-916e-5fe93c96ae33 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137896 Sep 07 12:54:50.013342 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2401/4748] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:54:50.260247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bc6db966-5e3c-4e0b-ac51-582cf7d8a037 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:50.260875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bc6db966-5e3c-4e0b-ac51-582cf7d8a037 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:50.280429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc6db966-5e3c-4e0b-ac51-582cf7d8a037 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:50.284306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc6db966-5e3c-4e0b-ac51-582cf7d8a037 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:50.285136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc6db966-5e3c-4e0b-ac51-582cf7d8a037 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:50.289549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc6db966-5e3c-4e0b-ac51-582cf7d8a037 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:50.290504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc6db966-5e3c-4e0b-ac51-582cf7d8a037 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:50.293394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc6db966-5e3c-4e0b-ac51-582cf7d8a037 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:50.415247 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bc6db966-5e3c-4e0b-ac51-582cf7d8a037 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4/os-volume_attachments/60a03179-dfc5-4d9f-bfef-9c7b3eee7282" status: 200 len: 194 microversion: 2.20 time: 0.161620 Sep 07 12:54:50.415914 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2402/4749] 10.222.0.16 () {60 vars in 1454 bytes} [Wed Sep 7 12:54:50 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4/os-volume_attachments/60a03179-dfc5-4d9f-bfef-9c7b3eee7282 => generated 194 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 12:54:50.599595 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-305e8623-e93f-4663-b53d-ad027f1591c0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:50.600111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-305e8623-e93f-4663-b53d-ad027f1591c0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:50.626088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-305e8623-e93f-4663-b53d-ad027f1591c0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:50.626323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-305e8623-e93f-4663-b53d-ad027f1591c0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:50.627172 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-305e8623-e93f-4663-b53d-ad027f1591c0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:50.628276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-305e8623-e93f-4663-b53d-ad027f1591c0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:50.628920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-305e8623-e93f-4663-b53d-ad027f1591c0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:50.629590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-305e8623-e93f-4663-b53d-ad027f1591c0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:50.814927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b5146a3c-8aed-44fd-a231-7790641f57d7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:50.826153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-305e8623-e93f-4663-b53d-ad027f1591c0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lazy-loading 'services' on Instance uuid ffe6581c-7070-48c5-a16d-fa30b22567d4 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:54:50.852496 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b5146a3c-8aed-44fd-a231-7790641f57d7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 1.111561 Sep 07 12:54:50.853899 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2348/4750] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:49 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:50.875410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-754a5839-a7be-435b-bb52-dddf5bc65eb9 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:50.879448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-754a5839-a7be-435b-bb52-dddf5bc65eb9 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] [instance: e6109fe8-30c8-42a8-b428-8a62e6e34fca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:50.895934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-754a5839-a7be-435b-bb52-dddf5bc65eb9 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:50.896755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-754a5839-a7be-435b-bb52-dddf5bc65eb9 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:50.899859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-754a5839-a7be-435b-bb52-dddf5bc65eb9 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:50.904358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-754a5839-a7be-435b-bb52-dddf5bc65eb9 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:50.911793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-754a5839-a7be-435b-bb52-dddf5bc65eb9 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:50.912704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-754a5839-a7be-435b-bb52-dddf5bc65eb9 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:51.051477 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-305e8623-e93f-4663-b53d-ad027f1591c0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4/os-volume_attachments/60a03179-dfc5-4d9f-bfef-9c7b3eee7282" status: 202 len: 0 microversion: 2.20 time: 0.454306 Sep 07 12:54:51.058715 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2403/4751] 10.222.0.16 () {60 vars in 1457 bytes} [Wed Sep 7 12:54:50 2022] DELETE /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4/os-volume_attachments/60a03179-dfc5-4d9f-bfef-9c7b3eee7282 => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:54:51.064895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bc2c2e00-f171-4d4e-9ded-a059f0a9cb95 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:51.084313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bc2c2e00-f171-4d4e-9ded-a059f0a9cb95 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: d2cbb4b8-d0fd-4230-8370-cedded0a7a16] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:51.106664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc2c2e00-f171-4d4e-9ded-a059f0a9cb95 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:51.114749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc2c2e00-f171-4d4e-9ded-a059f0a9cb95 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:51.117004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc2c2e00-f171-4d4e-9ded-a059f0a9cb95 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:51.118739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc2c2e00-f171-4d4e-9ded-a059f0a9cb95 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:51.122439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc2c2e00-f171-4d4e-9ded-a059f0a9cb95 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:51.128262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc2c2e00-f171-4d4e-9ded-a059f0a9cb95 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:52.016331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-754a5839-a7be-435b-bb52-dddf5bc65eb9 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83061653a9bf4487a1ea9778ef5d7951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6a79b860544015b08e7e22a888ee9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:52.033602 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-754a5839-a7be-435b-bb52-dddf5bc65eb9 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] 10.222.0.16 "GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca" status: 200 len: 1316 microversion: 2.1 time: 1.177838 Sep 07 12:54:52.053468 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2349/4752] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:50 2022] GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca => generated 1316 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:52.079655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d91d52d5-d0ba-4cd0-af2d-1cd65c33bee9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:52.085954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d91d52d5-d0ba-4cd0-af2d-1cd65c33bee9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:52.109527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d91d52d5-d0ba-4cd0-af2d-1cd65c33bee9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:52.125938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d91d52d5-d0ba-4cd0-af2d-1cd65c33bee9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:52.126810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d91d52d5-d0ba-4cd0-af2d-1cd65c33bee9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:52.134345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d91d52d5-d0ba-4cd0-af2d-1cd65c33bee9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:52.135323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d91d52d5-d0ba-4cd0-af2d-1cd65c33bee9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:52.141275 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d91d52d5-d0ba-4cd0-af2d-1cd65c33bee9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:52.674313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bc2c2e00-f171-4d4e-9ded-a059f0a9cb95 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:52.709246 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bc2c2e00-f171-4d4e-9ded-a059f0a9cb95 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16" status: 200 len: 1292 microversion: 2.1 time: 1.648726 Sep 07 12:54:52.714063 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2404/4753] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:51 2022] GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16 => generated 1292 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:52.732908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f1460ce-680f-4c36-ad40-54f192d01429 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:52.740435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0f1460ce-680f-4c36-ad40-54f192d01429 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:52.755161 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f1460ce-680f-4c36-ad40-54f192d01429 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:52.756260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f1460ce-680f-4c36-ad40-54f192d01429 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:52.757169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f1460ce-680f-4c36-ad40-54f192d01429 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:52.758440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f1460ce-680f-4c36-ad40-54f192d01429 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:52.759179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f1460ce-680f-4c36-ad40-54f192d01429 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:52.759805 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f1460ce-680f-4c36-ad40-54f192d01429 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:52.852975 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0f1460ce-680f-4c36-ad40-54f192d01429 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.133492 Sep 07 12:54:52.855435 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2405/4754] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Sep 7 12:54:52 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:54:52.875824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d30fe5b4-67bc-4eab-a3c0-714870734e1b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:52.877193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d30fe5b4-67bc-4eab-a3c0-714870734e1b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:52.893160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d30fe5b4-67bc-4eab-a3c0-714870734e1b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:52.920561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d30fe5b4-67bc-4eab-a3c0-714870734e1b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:52.922345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d30fe5b4-67bc-4eab-a3c0-714870734e1b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:52.925573 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d30fe5b4-67bc-4eab-a3c0-714870734e1b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:52.926962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d30fe5b4-67bc-4eab-a3c0-714870734e1b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:52.930650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d30fe5b4-67bc-4eab-a3c0-714870734e1b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:52.943092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d91d52d5-d0ba-4cd0-af2d-1cd65c33bee9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:52.999498 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d91d52d5-d0ba-4cd0-af2d-1cd65c33bee9 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.940302 Sep 07 12:54:53.007983 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2350/4755] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:52 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:53.027555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d30fe5b4-67bc-4eab-a3c0-714870734e1b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:54:53.056821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-791b3e71-1407-426c-9485-26bd3c2fc133 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:53.059880 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-791b3e71-1407-426c-9485-26bd3c2fc133 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] [instance: e6109fe8-30c8-42a8-b428-8a62e6e34fca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:53.075771 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-791b3e71-1407-426c-9485-26bd3c2fc133 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:53.079519 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-791b3e71-1407-426c-9485-26bd3c2fc133 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:53.080715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-791b3e71-1407-426c-9485-26bd3c2fc133 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:53.082619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-791b3e71-1407-426c-9485-26bd3c2fc133 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:53.085430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-791b3e71-1407-426c-9485-26bd3c2fc133 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:53.088260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-791b3e71-1407-426c-9485-26bd3c2fc133 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:53.415914 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d30fe5b4-67bc-4eab-a3c0-714870734e1b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 204 len: 0 microversion: 2.32 time: 0.540863 Sep 07 12:54:53.416862 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2406/4756] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 12:54:52 2022] DELETE /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:54:53.428534 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-81b6f261-10c8-482b-839e-7c0b5c6eda59 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1833782379", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "49960e13-4e80-4757-a207-47071e716cc5"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:54:53.615344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-81b6f261-10c8-482b-839e-7c0b5c6eda59 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] validate_networks() for [('49960e13-4e80-4757-a207-47071e716cc5', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:54:54.169005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-791b3e71-1407-426c-9485-26bd3c2fc133 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83061653a9bf4487a1ea9778ef5d7951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6a79b860544015b08e7e22a888ee9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:54.185616 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-791b3e71-1407-426c-9485-26bd3c2fc133 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] 10.222.0.16 "GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca" status: 200 len: 1316 microversion: 2.1 time: 1.128513 Sep 07 12:54:54.191868 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2351/4757] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:53 2022] GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca => generated 1316 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:54.213369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f0c9040e-136f-4b94-9e2d-e43f21f124d6 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:54.215531 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f0c9040e-136f-4b94-9e2d-e43f21f124d6 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:54.238908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0c9040e-136f-4b94-9e2d-e43f21f124d6 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:54.239667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0c9040e-136f-4b94-9e2d-e43f21f124d6 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:54.242509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0c9040e-136f-4b94-9e2d-e43f21f124d6 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:54.244117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0c9040e-136f-4b94-9e2d-e43f21f124d6 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:54.247388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0c9040e-136f-4b94-9e2d-e43f21f124d6 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:54.253179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0c9040e-136f-4b94-9e2d-e43f21f124d6 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:55.037215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f0c9040e-136f-4b94-9e2d-e43f21f124d6 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:55.085128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f0c9040e-136f-4b94-9e2d-e43f21f124d6 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:55.106147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f0c9040e-136f-4b94-9e2d-e43f21f124d6 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:55.120022 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f0c9040e-136f-4b94-9e2d-e43f21f124d6 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 2954 microversion: 2.32 time: 0.926005 Sep 07 12:54:55.127611 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2352/4758] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:54:54 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 2954 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:54:55.151615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-059c72e1-9c4d-49bd-a806-df08783ed90f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:55.152859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-059c72e1-9c4d-49bd-a806-df08783ed90f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: d2cbb4b8-d0fd-4230-8370-cedded0a7a16] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:55.191391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-059c72e1-9c4d-49bd-a806-df08783ed90f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:55.199441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-059c72e1-9c4d-49bd-a806-df08783ed90f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:55.201655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-059c72e1-9c4d-49bd-a806-df08783ed90f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:55.203236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-059c72e1-9c4d-49bd-a806-df08783ed90f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:55.208868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-059c72e1-9c4d-49bd-a806-df08783ed90f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:55.213451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-059c72e1-9c4d-49bd-a806-df08783ed90f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:56.143638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-81b6f261-10c8-482b-839e-7c0b5c6eda59 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:54:56.145501 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-81b6f261-10c8-482b-839e-7c0b5c6eda59 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:54:56.146593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-81b6f261-10c8-482b-839e-7c0b5c6eda59 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:54:56.147579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-81b6f261-10c8-482b-839e-7c0b5c6eda59 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:54:56.148593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-81b6f261-10c8-482b-839e-7c0b5c6eda59 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:54:56.187651 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81b6f261-10c8-482b-839e-7c0b5c6eda59 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:56.198348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81b6f261-10c8-482b-839e-7c0b5c6eda59 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:56.198818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81b6f261-10c8-482b-839e-7c0b5c6eda59 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:56.199951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81b6f261-10c8-482b-839e-7c0b5c6eda59 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:56.200652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81b6f261-10c8-482b-839e-7c0b5c6eda59 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:56.201269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81b6f261-10c8-482b-839e-7c0b5c6eda59 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:56.266810 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-81b6f261-10c8-482b-839e-7c0b5c6eda59 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Getting quotas for project af1de494abea4aa7841c00fb199e8aec. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:54:56.290385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-81b6f261-10c8-482b-839e-7c0b5c6eda59 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Getting quotas for user 22ec4509710f446d843f6882120c5d6e and project af1de494abea4aa7841c00fb199e8aec. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:54:56.338045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-81b6f261-10c8-482b-839e-7c0b5c6eda59 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:54:56.340702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-81b6f261-10c8-482b-839e-7c0b5c6eda59 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:54:56.441098 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-81b6f261-10c8-482b-839e-7c0b5c6eda59 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.022961 Sep 07 12:54:56.442434 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2407/4759] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:54:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 3025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:54:56.448141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f3c12a04-fcd0-447a-8961-8d0251e7e8af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:56.459889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f3c12a04-fcd0-447a-8961-8d0251e7e8af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:56.475077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3c12a04-fcd0-447a-8961-8d0251e7e8af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:56.475873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3c12a04-fcd0-447a-8961-8d0251e7e8af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:56.476484 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3c12a04-fcd0-447a-8961-8d0251e7e8af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:56.478351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3c12a04-fcd0-447a-8961-8d0251e7e8af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:56.480657 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3c12a04-fcd0-447a-8961-8d0251e7e8af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:56.481318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3c12a04-fcd0-447a-8961-8d0251e7e8af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:56.534931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-059c72e1-9c4d-49bd-a806-df08783ed90f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:56.546327 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f3c12a04-fcd0-447a-8961-8d0251e7e8af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.102098 Sep 07 12:54:56.550821 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2408/4760] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Sep 7 12:54:56 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:54:56.555896 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-059c72e1-9c4d-49bd-a806-df08783ed90f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16" status: 200 len: 1292 microversion: 2.1 time: 1.425690 Sep 07 12:54:56.560257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c75d5398-328c-41a3-bde7-190ee3fcc73c tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:56.560893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c75d5398-328c-41a3-bde7-190ee3fcc73c tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] [instance: e6109fe8-30c8-42a8-b428-8a62e6e34fca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:56.564353 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2353/4761] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:55 2022] GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16 => generated 1292 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:56.568493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c75d5398-328c-41a3-bde7-190ee3fcc73c tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:56.569408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c75d5398-328c-41a3-bde7-190ee3fcc73c tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:56.570288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c75d5398-328c-41a3-bde7-190ee3fcc73c tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:56.571585 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c75d5398-328c-41a3-bde7-190ee3fcc73c tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:56.572290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c75d5398-328c-41a3-bde7-190ee3fcc73c tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:56.573408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c75d5398-328c-41a3-bde7-190ee3fcc73c tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:56.580860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c39ae6a8-05c6-4597-b2e9-9fef4385339b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:56.583557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c39ae6a8-05c6-4597-b2e9-9fef4385339b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:56.620849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c39ae6a8-05c6-4597-b2e9-9fef4385339b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:56.624079 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c39ae6a8-05c6-4597-b2e9-9fef4385339b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:56.629221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c39ae6a8-05c6-4597-b2e9-9fef4385339b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:56.636613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c39ae6a8-05c6-4597-b2e9-9fef4385339b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:56.638114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c39ae6a8-05c6-4597-b2e9-9fef4385339b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:56.641099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c39ae6a8-05c6-4597-b2e9-9fef4385339b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:58.550311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c75d5398-328c-41a3-bde7-190ee3fcc73c tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83061653a9bf4487a1ea9778ef5d7951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6a79b860544015b08e7e22a888ee9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:58.595424 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c75d5398-328c-41a3-bde7-190ee3fcc73c tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] 10.222.0.16 "GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca" status: 200 len: 1316 microversion: 2.1 time: 2.039449 Sep 07 12:54:58.610139 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2409/4762] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:56 2022] GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca => generated 1316 bytes in 2059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:58.630059 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4db690a3-0193-4d0d-825f-5f15524b6e34 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:58.639477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4db690a3-0193-4d0d-825f-5f15524b6e34 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:58.686205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4db690a3-0193-4d0d-825f-5f15524b6e34 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:58.690211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4db690a3-0193-4d0d-825f-5f15524b6e34 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:58.695271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4db690a3-0193-4d0d-825f-5f15524b6e34 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:58.706495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4db690a3-0193-4d0d-825f-5f15524b6e34 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:58.707411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4db690a3-0193-4d0d-825f-5f15524b6e34 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:58.713557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4db690a3-0193-4d0d-825f-5f15524b6e34 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:59.392997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c39ae6a8-05c6-4597-b2e9-9fef4385339b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:59.417941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c39ae6a8-05c6-4597-b2e9-9fef4385339b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:59.419527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c39ae6a8-05c6-4597-b2e9-9fef4385339b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:59.420884 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c39ae6a8-05c6-4597-b2e9-9fef4385339b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 2954 microversion: 2.32 time: 2.855128 Sep 07 12:54:59.446302 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2354/4763] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:54:56 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 2954 bytes in 2881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:54:59.452006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5fae58ac-843d-4854-b958-5e375fdd1a57 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:59.476729 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5fae58ac-843d-4854-b958-5e375fdd1a57 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:59.485254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fae58ac-843d-4854-b958-5e375fdd1a57 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:59.486050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fae58ac-843d-4854-b958-5e375fdd1a57 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:59.486747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fae58ac-843d-4854-b958-5e375fdd1a57 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:59.487701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fae58ac-843d-4854-b958-5e375fdd1a57 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:59.488341 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fae58ac-843d-4854-b958-5e375fdd1a57 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:59.488938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fae58ac-843d-4854-b958-5e375fdd1a57 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:59.494719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4db690a3-0193-4d0d-825f-5f15524b6e34 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:54:59.512329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:59.544600 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5fae58ac-843d-4854-b958-5e375fdd1a57 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.096764 Sep 07 12:54:59.545966 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2355/4764] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Sep 7 12:54:59 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:54:59.553136 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4db690a3-0193-4d0d-825f-5f15524b6e34 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1267 microversion: 2.1 time: 0.939520 Sep 07 12:54:59.558399 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2410/4765] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:58 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1267 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:54:59.576430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f3ca4a72-edf5-4947-a06c-dc60f1d558a0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:59.578289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f3ca4a72-edf5-4947-a06c-dc60f1d558a0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: d2cbb4b8-d0fd-4230-8370-cedded0a7a16] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:59.581439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-3c4d4f1c-f60f-4a48-9c02-b87adf5dadc0 req-3e402106-bfc8-4482-bbb4-f322f0a86e29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2cbb4b8-d0fd-4230-8370-cedded0a7a16", "name": "network-vif-plugged", "status": "completed", "tag": "a705fc80-a97c-4539-bb7f-f53c8f00ce22"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:54:59.595892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3ca4a72-edf5-4947-a06c-dc60f1d558a0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:59.596858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3ca4a72-edf5-4947-a06c-dc60f1d558a0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:59.597582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3ca4a72-edf5-4947-a06c-dc60f1d558a0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:59.598488 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3ca4a72-edf5-4947-a06c-dc60f1d558a0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:59.599119 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3ca4a72-edf5-4947-a06c-dc60f1d558a0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:59.601541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3ca4a72-edf5-4947-a06c-dc60f1d558a0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:59.622586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3c4d4f1c-f60f-4a48-9c02-b87adf5dadc0 req-3e402106-bfc8-4482-bbb4-f322f0a86e29 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:59.623399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3c4d4f1c-f60f-4a48-9c02-b87adf5dadc0 req-3e402106-bfc8-4482-bbb4-f322f0a86e29 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:59.624171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3c4d4f1c-f60f-4a48-9c02-b87adf5dadc0 req-3e402106-bfc8-4482-bbb4-f322f0a86e29 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:59.660643 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-3c4d4f1c-f60f-4a48-9c02-b87adf5dadc0 req-3e402106-bfc8-4482-bbb4-f322f0a86e29 service nova] Creating event network-vif-plugged:a705fc80-a97c-4539-bb7f-f53c8f00ce22 for instance d2cbb4b8-d0fd-4230-8370-cedded0a7a16 on n-h2-852087-9 Sep 07 12:54:59.672520 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-3c4d4f1c-f60f-4a48-9c02-b87adf5dadc0 req-3e402106-bfc8-4482-bbb4-f322f0a86e29 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096471 Sep 07 12:54:59.673430 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2411/4766] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:54:59.684733 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-431ff1c7-1a43-48e4-b19c-06a1bb0b4e85 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:54:59.685920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-431ff1c7-1a43-48e4-b19c-06a1bb0b4e85 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] [instance: e6109fe8-30c8-42a8-b428-8a62e6e34fca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:54:59.694619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-431ff1c7-1a43-48e4-b19c-06a1bb0b4e85 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:59.695411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-431ff1c7-1a43-48e4-b19c-06a1bb0b4e85 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:59.696323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-431ff1c7-1a43-48e4-b19c-06a1bb0b4e85 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:54:59.697223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-431ff1c7-1a43-48e4-b19c-06a1bb0b4e85 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:54:59.698005 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-431ff1c7-1a43-48e4-b19c-06a1bb0b4e85 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:54:59.698605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-431ff1c7-1a43-48e4-b19c-06a1bb0b4e85 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:00.748385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-431ff1c7-1a43-48e4-b19c-06a1bb0b4e85 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83061653a9bf4487a1ea9778ef5d7951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6a79b860544015b08e7e22a888ee9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:00.760005 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-431ff1c7-1a43-48e4-b19c-06a1bb0b4e85 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] 10.222.0.16 "GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca" status: 200 len: 1316 microversion: 2.1 time: 1.079965 Sep 07 12:55:00.760618 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2412/4767] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:59 2022] GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca => generated 1316 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:00.775203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-76c6c38a-cdfa-453f-afec-6f49686eede8 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:00.778317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-76c6c38a-cdfa-453f-afec-6f49686eede8 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:00.803655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76c6c38a-cdfa-453f-afec-6f49686eede8 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:00.804477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76c6c38a-cdfa-453f-afec-6f49686eede8 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:00.805097 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76c6c38a-cdfa-453f-afec-6f49686eede8 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:00.806086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76c6c38a-cdfa-453f-afec-6f49686eede8 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:00.806728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76c6c38a-cdfa-453f-afec-6f49686eede8 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:00.807323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76c6c38a-cdfa-453f-afec-6f49686eede8 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:00.831828 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f3ca4a72-edf5-4947-a06c-dc60f1d558a0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:00.863962 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f3ca4a72-edf5-4947-a06c-dc60f1d558a0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16" status: 200 len: 1292 microversion: 2.1 time: 1.305024 Sep 07 12:55:00.880849 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2356/4768] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:54:59 2022] GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16 => generated 1292 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:00.896639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ec964ecb-4103-4808-9476-dc4433b804c3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:00.899017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ec964ecb-4103-4808-9476-dc4433b804c3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:00.928480 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec964ecb-4103-4808-9476-dc4433b804c3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:00.929797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec964ecb-4103-4808-9476-dc4433b804c3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:00.930429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec964ecb-4103-4808-9476-dc4433b804c3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:00.931172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec964ecb-4103-4808-9476-dc4433b804c3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:00.931638 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec964ecb-4103-4808-9476-dc4433b804c3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:00.932073 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ec964ecb-4103-4808-9476-dc4433b804c3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:01.012531 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ec964ecb-4103-4808-9476-dc4433b804c3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.129952 Sep 07 12:55:01.017688 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2357/4769] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Sep 7 12:55:00 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:55:01.024014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9ec69c02-9f9d-4e00-849e-2ed7859f24b6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:01.025049 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9ec69c02-9f9d-4e00-849e-2ed7859f24b6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:01.039278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ec69c02-9f9d-4e00-849e-2ed7859f24b6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:01.041844 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ec69c02-9f9d-4e00-849e-2ed7859f24b6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:01.042657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ec69c02-9f9d-4e00-849e-2ed7859f24b6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:01.044136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ec69c02-9f9d-4e00-849e-2ed7859f24b6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:01.044916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ec69c02-9f9d-4e00-849e-2ed7859f24b6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:01.045731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ec69c02-9f9d-4e00-849e-2ed7859f24b6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:01.840215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9ec69c02-9f9d-4e00-849e-2ed7859f24b6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:01.866735 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9ec69c02-9f9d-4e00-849e-2ed7859f24b6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1273 microversion: 2.1 time: 0.847302 Sep 07 12:55:01.873270 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2358/4770] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:01 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1273 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:01.892453 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d7fd4510-82a7-4dcf-b5c7-30f5ceeafbb3 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:01.895623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d7fd4510-82a7-4dcf-b5c7-30f5ceeafbb3 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] [instance: e6109fe8-30c8-42a8-b428-8a62e6e34fca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:01.943823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7fd4510-82a7-4dcf-b5c7-30f5ceeafbb3 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:01.960799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7fd4510-82a7-4dcf-b5c7-30f5ceeafbb3 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:01.962486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7fd4510-82a7-4dcf-b5c7-30f5ceeafbb3 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:01.963602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7fd4510-82a7-4dcf-b5c7-30f5ceeafbb3 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:01.967226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7fd4510-82a7-4dcf-b5c7-30f5ceeafbb3 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:01.975800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7fd4510-82a7-4dcf-b5c7-30f5ceeafbb3 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:02.310375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-76c6c38a-cdfa-453f-afec-6f49686eede8 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:02.339722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-76c6c38a-cdfa-453f-afec-6f49686eede8 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:02.343626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-76c6c38a-cdfa-453f-afec-6f49686eede8 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:02.345975 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-76c6c38a-cdfa-453f-afec-6f49686eede8 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 2954 microversion: 2.32 time: 1.574767 Sep 07 12:55:02.347297 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2413/4771] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:00 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 2954 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:02.355037 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-92067645-ae45-4017-a198-f409615557d1 req-d113fc4a-f76a-4cf4-b70e-217272f46f94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9352ac2-475e-4c77-aa85-5ecd566563b2", "name": "network-vif-unplugged", "status": "completed", "tag": "52acc413-bd10-4aa6-9f53-f86a0cad3f9b"}, {"server_uuid": "e9352ac2-475e-4c77-aa85-5ecd566563b2", "name": "network-vif-unplugged", "status": "completed", "tag": "763b76c0-527c-4cf7-87d0-1d9905756999"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:02.372461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-92067645-ae45-4017-a198-f409615557d1 req-d113fc4a-f76a-4cf4-b70e-217272f46f94 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:02.374269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-92067645-ae45-4017-a198-f409615557d1 req-d113fc4a-f76a-4cf4-b70e-217272f46f94 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:02.375139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-92067645-ae45-4017-a198-f409615557d1 req-d113fc4a-f76a-4cf4-b70e-217272f46f94 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:02.406811 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-92067645-ae45-4017-a198-f409615557d1 req-d113fc4a-f76a-4cf4-b70e-217272f46f94 service nova] Creating event network-vif-unplugged:52acc413-bd10-4aa6-9f53-f86a0cad3f9b for instance e9352ac2-475e-4c77-aa85-5ecd566563b2 on n-h2-852087-9 Sep 07 12:55:02.407630 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-92067645-ae45-4017-a198-f409615557d1 req-d113fc4a-f76a-4cf4-b70e-217272f46f94 service nova] Creating event network-vif-unplugged:763b76c0-527c-4cf7-87d0-1d9905756999 for instance e9352ac2-475e-4c77-aa85-5ecd566563b2 on n-h2-852087-9 Sep 07 12:55:02.436096 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-92067645-ae45-4017-a198-f409615557d1 req-d113fc4a-f76a-4cf4-b70e-217272f46f94 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.083544 Sep 07 12:55:02.438203 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2414/4772] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:55:02.464157 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4d2d20be-737f-4389-9af7-f0f305f3310d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:02.464779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4d2d20be-737f-4389-9af7-f0f305f3310d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: d2cbb4b8-d0fd-4230-8370-cedded0a7a16] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:02.490495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d2d20be-737f-4389-9af7-f0f305f3310d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:02.492775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d2d20be-737f-4389-9af7-f0f305f3310d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:02.496748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d2d20be-737f-4389-9af7-f0f305f3310d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:02.497821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d2d20be-737f-4389-9af7-f0f305f3310d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:02.498441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d2d20be-737f-4389-9af7-f0f305f3310d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:02.499011 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d2d20be-737f-4389-9af7-f0f305f3310d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:03.774985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d7fd4510-82a7-4dcf-b5c7-30f5ceeafbb3 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83061653a9bf4487a1ea9778ef5d7951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6a79b860544015b08e7e22a888ee9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:03.805160 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d7fd4510-82a7-4dcf-b5c7-30f5ceeafbb3 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] 10.222.0.16 "GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca" status: 200 len: 1316 microversion: 2.1 time: 1.928748 Sep 07 12:55:03.818752 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2359/4773] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:01 2022] GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca => generated 1316 bytes in 1943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:03.839780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-83388d99-90fe-495d-9346-6268702e4c07 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:03.856929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-83388d99-90fe-495d-9346-6268702e4c07 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:03.877154 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83388d99-90fe-495d-9346-6268702e4c07 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:03.879357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83388d99-90fe-495d-9346-6268702e4c07 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:03.880933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83388d99-90fe-495d-9346-6268702e4c07 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:03.882049 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83388d99-90fe-495d-9346-6268702e4c07 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:03.886867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83388d99-90fe-495d-9346-6268702e4c07 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:03.887732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83388d99-90fe-495d-9346-6268702e4c07 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:03.956418 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-83388d99-90fe-495d-9346-6268702e4c07 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.134796 Sep 07 12:55:03.962030 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2360/4774] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Sep 7 12:55:03 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:55:03.975513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8354d358-6d99-4e6c-866c-c35816ec7948 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:03.982485 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8354d358-6d99-4e6c-866c-c35816ec7948 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:03.998709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8354d358-6d99-4e6c-866c-c35816ec7948 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:04.001329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8354d358-6d99-4e6c-866c-c35816ec7948 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:04.002426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8354d358-6d99-4e6c-866c-c35816ec7948 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:04.005049 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8354d358-6d99-4e6c-866c-c35816ec7948 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:04.007886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8354d358-6d99-4e6c-866c-c35816ec7948 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:04.008585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8354d358-6d99-4e6c-866c-c35816ec7948 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:04.255684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4d2d20be-737f-4389-9af7-f0f305f3310d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:04.285235 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4d2d20be-737f-4389-9af7-f0f305f3310d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16" status: 200 len: 1474 microversion: 2.1 time: 1.841987 Sep 07 12:55:04.287301 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2415/4775] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:02 2022] GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16 => generated 1474 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:04.303725 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-50816391-8e14-4bac-b4e9-89a3d094cb47 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:04.319039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-50816391-8e14-4bac-b4e9-89a3d094cb47 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:04.344073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50816391-8e14-4bac-b4e9-89a3d094cb47 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:04.344981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50816391-8e14-4bac-b4e9-89a3d094cb47 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:04.346819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50816391-8e14-4bac-b4e9-89a3d094cb47 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:04.348716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50816391-8e14-4bac-b4e9-89a3d094cb47 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:04.349929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50816391-8e14-4bac-b4e9-89a3d094cb47 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:04.351533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50816391-8e14-4bac-b4e9-89a3d094cb47 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:04.528226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8354d358-6d99-4e6c-866c-c35816ec7948 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:04.566131 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8354d358-6d99-4e6c-866c-c35816ec7948 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1273 microversion: 2.1 time: 0.594097 Sep 07 12:55:04.567595 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2361/4776] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:03 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1273 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:04.577311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-f348c9f5-c14f-478f-abb6-586410797c22 req-a588f1cf-8b20-40e8-9009-8d6c8ab30b0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9352ac2-475e-4c77-aa85-5ecd566563b2", "name": "network-vif-unplugged", "status": "completed", "tag": "6dd24b36-3c01-41dd-97ac-f83db2b44791"}, {"server_uuid": "e6109fe8-30c8-42a8-b428-8a62e6e34fca", "name": "network-vif-plugged", "status": "completed", "tag": "c50827f8-5fd6-4c3c-80e1-41032a36b97c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:04.611281 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f348c9f5-c14f-478f-abb6-586410797c22 req-a588f1cf-8b20-40e8-9009-8d6c8ab30b0c service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:04.612570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f348c9f5-c14f-478f-abb6-586410797c22 req-a588f1cf-8b20-40e8-9009-8d6c8ab30b0c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:04.613655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f348c9f5-c14f-478f-abb6-586410797c22 req-a588f1cf-8b20-40e8-9009-8d6c8ab30b0c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:04.645439 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-f348c9f5-c14f-478f-abb6-586410797c22 req-a588f1cf-8b20-40e8-9009-8d6c8ab30b0c service nova] Creating event network-vif-unplugged:6dd24b36-3c01-41dd-97ac-f83db2b44791 for instance e9352ac2-475e-4c77-aa85-5ecd566563b2 on n-h2-852087-9 Sep 07 12:55:04.646358 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-f348c9f5-c14f-478f-abb6-586410797c22 req-a588f1cf-8b20-40e8-9009-8d6c8ab30b0c service nova] Creating event network-vif-plugged:c50827f8-5fd6-4c3c-80e1-41032a36b97c for instance e6109fe8-30c8-42a8-b428-8a62e6e34fca on n-h1-852087-9 Sep 07 12:55:04.679382 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-f348c9f5-c14f-478f-abb6-586410797c22 req-a588f1cf-8b20-40e8-9009-8d6c8ab30b0c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.109613 Sep 07 12:55:04.681012 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2362/4777] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:55:04.690435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-91455a49-a080-4f57-b5ff-7fe48aa683e6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-737065664", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:04.819295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-91455a49-a080-4f57-b5ff-7fe48aa683e6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] validate_networks() for [('1c45fce2-7bfe-4e93-8f9c-12b9830de28b', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:55:06.240432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:06.327750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:06.561052 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-50816391-8e14-4bac-b4e9-89a3d094cb47 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:06.611659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-50816391-8e14-4bac-b4e9-89a3d094cb47 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:06.624360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-50816391-8e14-4bac-b4e9-89a3d094cb47 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:06.629750 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-50816391-8e14-4bac-b4e9-89a3d094cb47 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 2933 microversion: 2.32 time: 2.337917 Sep 07 12:55:06.634805 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2416/4778] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:04 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 2933 bytes in 2345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:06.649628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-64be05f5-467f-47ec-a839-d2271b5b45f0 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:06.665052 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-64be05f5-467f-47ec-a839-d2271b5b45f0 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] [instance: e6109fe8-30c8-42a8-b428-8a62e6e34fca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:06.683373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:06.687814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64be05f5-467f-47ec-a839-d2271b5b45f0 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:06.689538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64be05f5-467f-47ec-a839-d2271b5b45f0 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:06.690774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64be05f5-467f-47ec-a839-d2271b5b45f0 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:06.692628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64be05f5-467f-47ec-a839-d2271b5b45f0 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:06.694485 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64be05f5-467f-47ec-a839-d2271b5b45f0 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:06.696178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64be05f5-467f-47ec-a839-d2271b5b45f0 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:07.588639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-64be05f5-467f-47ec-a839-d2271b5b45f0 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83061653a9bf4487a1ea9778ef5d7951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6a79b860544015b08e7e22a888ee9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:07.616953 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-64be05f5-467f-47ec-a839-d2271b5b45f0 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] 10.222.0.16 "GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca" status: 200 len: 1316 microversion: 2.1 time: 0.978930 Sep 07 12:55:07.625413 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2417/4779] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:06 2022] GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca => generated 1316 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:07.637274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ec0f052-64a7-4e57-85f9-6496b5f53f0b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:07.643321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3ec0f052-64a7-4e57-85f9-6496b5f53f0b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:07.662003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ec0f052-64a7-4e57-85f9-6496b5f53f0b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:07.663098 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ec0f052-64a7-4e57-85f9-6496b5f53f0b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:07.664025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ec0f052-64a7-4e57-85f9-6496b5f53f0b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:07.665436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ec0f052-64a7-4e57-85f9-6496b5f53f0b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:07.666719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ec0f052-64a7-4e57-85f9-6496b5f53f0b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:07.667557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ec0f052-64a7-4e57-85f9-6496b5f53f0b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:07.739994 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ec0f052-64a7-4e57-85f9-6496b5f53f0b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.111864 Sep 07 12:55:07.740964 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2418/4780] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Sep 7 12:55:07 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:07.750485 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d734c7a4-990c-4af3-8d6f-d71157910b88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:07.751388 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d734c7a4-990c-4af3-8d6f-d71157910b88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:07.759505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d734c7a4-990c-4af3-8d6f-d71157910b88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:07.760066 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d734c7a4-990c-4af3-8d6f-d71157910b88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:07.760525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d734c7a4-990c-4af3-8d6f-d71157910b88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:07.761364 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d734c7a4-990c-4af3-8d6f-d71157910b88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:07.761969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d734c7a4-990c-4af3-8d6f-d71157910b88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:07.762415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d734c7a4-990c-4af3-8d6f-d71157910b88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:08.376019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-91455a49-a080-4f57-b5ff-7fe48aa683e6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:55:08.376556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-91455a49-a080-4f57-b5ff-7fe48aa683e6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:55:08.377199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-91455a49-a080-4f57-b5ff-7fe48aa683e6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:55:08.377776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-91455a49-a080-4f57-b5ff-7fe48aa683e6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:55:08.378424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-91455a49-a080-4f57-b5ff-7fe48aa683e6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:55:08.392440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91455a49-a080-4f57-b5ff-7fe48aa683e6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:08.392946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91455a49-a080-4f57-b5ff-7fe48aa683e6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:08.393545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91455a49-a080-4f57-b5ff-7fe48aa683e6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:08.394470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91455a49-a080-4f57-b5ff-7fe48aa683e6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:08.394937 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91455a49-a080-4f57-b5ff-7fe48aa683e6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:08.395580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91455a49-a080-4f57-b5ff-7fe48aa683e6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:08.431370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-91455a49-a080-4f57-b5ff-7fe48aa683e6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Getting quotas for project 854c6a81bbfd4ab79126799ec40c954e. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:55:08.439732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-91455a49-a080-4f57-b5ff-7fe48aa683e6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Getting quotas for user 6ac786dc6d7847f582262dcd912c3f06 and project 854c6a81bbfd4ab79126799ec40c954e. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:55:08.474233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-91455a49-a080-4f57-b5ff-7fe48aa683e6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:55:08.477810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-91455a49-a080-4f57-b5ff-7fe48aa683e6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 333a253e-8804-4171-8e84-aabbdb54a345] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:55:08.562627 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-91455a49-a080-4f57-b5ff-7fe48aa683e6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.879416 Sep 07 12:55:08.563955 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2363/4781] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:55:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:55:08.574439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-cef09916-ea65-4ce8-b505-397865e41691 req-a8019091-ed05-4264-8242-ab63030daf9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9352ac2-475e-4c77-aa85-5ecd566563b2", "name": "network-vif-unplugged", "status": "completed", "tag": "2d928931-3783-4efe-a479-33f49c27cfb9"}, {"server_uuid": "e9352ac2-475e-4c77-aa85-5ecd566563b2", "name": "network-vif-unplugged", "status": "completed", "tag": "3a4e33c1-9c34-429f-8cce-622597db4c32"}, {"server_uuid": "e9352ac2-475e-4c77-aa85-5ecd566563b2", "name": "network-vif-unplugged", "status": "completed", "tag": "acffd0c4-1273-4d97-8465-26984f8e6d9d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:08.604322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cef09916-ea65-4ce8-b505-397865e41691 req-a8019091-ed05-4264-8242-ab63030daf9c service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:08.609969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cef09916-ea65-4ce8-b505-397865e41691 req-a8019091-ed05-4264-8242-ab63030daf9c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:08.610721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cef09916-ea65-4ce8-b505-397865e41691 req-a8019091-ed05-4264-8242-ab63030daf9c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:08.629869 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-cef09916-ea65-4ce8-b505-397865e41691 req-a8019091-ed05-4264-8242-ab63030daf9c service nova] Creating event network-vif-unplugged:2d928931-3783-4efe-a479-33f49c27cfb9 for instance e9352ac2-475e-4c77-aa85-5ecd566563b2 on n-h2-852087-9 Sep 07 12:55:08.630673 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-cef09916-ea65-4ce8-b505-397865e41691 req-a8019091-ed05-4264-8242-ab63030daf9c service nova] Creating event network-vif-unplugged:3a4e33c1-9c34-429f-8cce-622597db4c32 for instance e9352ac2-475e-4c77-aa85-5ecd566563b2 on n-h2-852087-9 Sep 07 12:55:08.631433 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-cef09916-ea65-4ce8-b505-397865e41691 req-a8019091-ed05-4264-8242-ab63030daf9c service nova] Creating event network-vif-unplugged:acffd0c4-1273-4d97-8465-26984f8e6d9d for instance e9352ac2-475e-4c77-aa85-5ecd566563b2 on n-h2-852087-9 Sep 07 12:55:08.638790 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-cef09916-ea65-4ce8-b505-397865e41691 req-a8019091-ed05-4264-8242-ab63030daf9c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.072575 Sep 07 12:55:08.640114 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2364/4782] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:55:08.652860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a1d01715-f19a-4403-aa99-91d0a28727b5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:08.653916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a1d01715-f19a-4403-aa99-91d0a28727b5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:08.663611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1d01715-f19a-4403-aa99-91d0a28727b5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:08.664459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1d01715-f19a-4403-aa99-91d0a28727b5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:08.665420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1d01715-f19a-4403-aa99-91d0a28727b5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:08.666438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1d01715-f19a-4403-aa99-91d0a28727b5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:08.667100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1d01715-f19a-4403-aa99-91d0a28727b5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:08.668312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1d01715-f19a-4403-aa99-91d0a28727b5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:09.264649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d734c7a4-990c-4af3-8d6f-d71157910b88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:09.276380 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d734c7a4-990c-4af3-8d6f-d71157910b88 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1315 microversion: 2.1 time: 1.534069 Sep 07 12:55:09.289522 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2419/4783] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:07 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1315 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:09.289522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8604ac2b-569d-4363-b242-13e376c65f0d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:09.289522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8604ac2b-569d-4363-b242-13e376c65f0d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:09.312702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8604ac2b-569d-4363-b242-13e376c65f0d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:09.312702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8604ac2b-569d-4363-b242-13e376c65f0d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:09.312702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8604ac2b-569d-4363-b242-13e376c65f0d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:09.312702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8604ac2b-569d-4363-b242-13e376c65f0d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:09.312702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8604ac2b-569d-4363-b242-13e376c65f0d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:09.312702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8604ac2b-569d-4363-b242-13e376c65f0d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:09.351160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8604ac2b-569d-4363-b242-13e376c65f0d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:55:09.522127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a1d01715-f19a-4403-aa99-91d0a28727b5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:09.526105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:09.537187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a1d01715-f19a-4403-aa99-91d0a28727b5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:09.538747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a1d01715-f19a-4403-aa99-91d0a28727b5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:09.540609 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8604ac2b-569d-4363-b242-13e376c65f0d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 204 len: 0 microversion: 2.20 time: 0.257842 Sep 07 12:55:09.548376 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2420/4784] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 12:55:09 2022] DELETE /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:55:09.548686 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a1d01715-f19a-4403-aa99-91d0a28727b5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 2912 microversion: 2.32 time: 0.893598 Sep 07 12:55:09.548686 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2365/4785] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:08 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 2912 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:09.562210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-561e25f1-fe72-462e-9dec-5373a5caab56 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:09.562687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-561e25f1-fe72-462e-9dec-5373a5caab56 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] [instance: e6109fe8-30c8-42a8-b428-8a62e6e34fca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:09.566241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5fd74a3a-8fb2-4a24-9348-60f1c6f1617b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:09.566241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5fd74a3a-8fb2-4a24-9348-60f1c6f1617b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 333a253e-8804-4171-8e84-aabbdb54a345] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:09.581361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-561e25f1-fe72-462e-9dec-5373a5caab56 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:09.581746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fd74a3a-8fb2-4a24-9348-60f1c6f1617b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:09.581948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-561e25f1-fe72-462e-9dec-5373a5caab56 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:09.582200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-561e25f1-fe72-462e-9dec-5373a5caab56 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:09.582699 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fd74a3a-8fb2-4a24-9348-60f1c6f1617b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:09.583108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-561e25f1-fe72-462e-9dec-5373a5caab56 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:09.583297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fd74a3a-8fb2-4a24-9348-60f1c6f1617b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:09.583574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-561e25f1-fe72-462e-9dec-5373a5caab56 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:09.584010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-561e25f1-fe72-462e-9dec-5373a5caab56 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:09.585023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fd74a3a-8fb2-4a24-9348-60f1c6f1617b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:09.586209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fd74a3a-8fb2-4a24-9348-60f1c6f1617b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:09.586836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fd74a3a-8fb2-4a24-9348-60f1c6f1617b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:09.637321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5fd74a3a-8fb2-4a24-9348-60f1c6f1617b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 333a253e-8804-4171-8e84-aabbdb54a345] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:55:09.650068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fd74a3a-8fb2-4a24-9348-60f1c6f1617b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:09.650576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fd74a3a-8fb2-4a24-9348-60f1c6f1617b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:09.651023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5fd74a3a-8fb2-4a24-9348-60f1c6f1617b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:09.668689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-5fd74a3a-8fb2-4a24-9348-60f1c6f1617b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lazy-loading 'flavor' on Instance uuid 333a253e-8804-4171-8e84-aabbdb54a345 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:55:09.687382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-5fd74a3a-8fb2-4a24-9348-60f1c6f1617b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lazy-loading 'system_metadata' on Instance uuid 333a253e-8804-4171-8e84-aabbdb54a345 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:55:09.730680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-5fd74a3a-8fb2-4a24-9348-60f1c6f1617b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lazy-loading 'metadata' on Instance uuid 333a253e-8804-4171-8e84-aabbdb54a345 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:55:10.184356 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.scheduler.client.report [None req-5fd74a3a-8fb2-4a24-9348-60f1c6f1617b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Deleted allocations for instance 333a253e-8804-4171-8e84-aabbdb54a345 Sep 07 12:55:10.225626 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5fd74a3a-8fb2-4a24-9348-60f1c6f1617b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "DELETE /compute/v2.1/servers/333a253e-8804-4171-8e84-aabbdb54a345" status: 204 len: 0 microversion: 2.1 time: 0.678366 Sep 07 12:55:10.232775 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2421/4786] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:55:09 2022] DELETE /compute/v2.1/servers/333a253e-8804-4171-8e84-aabbdb54a345 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:55:10.243532 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-561e25f1-fe72-462e-9dec-5373a5caab56 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83061653a9bf4487a1ea9778ef5d7951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6a79b860544015b08e7e22a888ee9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:10.249844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7b54fb05-529b-4d7a-902f-86b9c9323056 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:10.253267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7b54fb05-529b-4d7a-902f-86b9c9323056 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:10.271759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b54fb05-529b-4d7a-902f-86b9c9323056 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:10.272782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b54fb05-529b-4d7a-902f-86b9c9323056 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:10.273287 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-561e25f1-fe72-462e-9dec-5373a5caab56 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] 10.222.0.16 "GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca" status: 200 len: 1504 microversion: 2.1 time: 0.725811 Sep 07 12:55:10.274302 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b54fb05-529b-4d7a-902f-86b9c9323056 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:10.274605 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2366/4787] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:09 2022] GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca => generated 1504 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:10.278813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b54fb05-529b-4d7a-902f-86b9c9323056 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:10.288753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e513e96-35a4-44a3-bf34-097d1a336a2d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:10.290528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2e513e96-35a4-44a3-bf34-097d1a336a2d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 333a253e-8804-4171-8e84-aabbdb54a345] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:10.299784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b54fb05-529b-4d7a-902f-86b9c9323056 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:10.306578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e513e96-35a4-44a3-bf34-097d1a336a2d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:10.308206 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e513e96-35a4-44a3-bf34-097d1a336a2d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:10.309700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b54fb05-529b-4d7a-902f-86b9c9323056 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:10.310881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e513e96-35a4-44a3-bf34-097d1a336a2d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:10.313810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e513e96-35a4-44a3-bf34-097d1a336a2d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:10.315915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e513e96-35a4-44a3-bf34-097d1a336a2d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:10.317081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e513e96-35a4-44a3-bf34-097d1a336a2d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:10.354413 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-2e513e96-35a4-44a3-bf34-097d1a336a2d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] HTTP exception thrown: Instance 333a253e-8804-4171-8e84-aabbdb54a345 could not be found. Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e513e96-35a4-44a3-bf34-097d1a336a2d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Request method failure captured: Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/333a253e-8804-4171-8e84-aabbdb54a345 HTTP/1.1 Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJSE5qt3MMvCiXM6JMYUN7f1buxIi7ST_NSWH8b3Iy1XPUp8KO4zG-NXQgWVN1Z7GE3sHXszWiKCVOYqqXwQROrdr4ZEFwz_8XPZaHXiJBQID0HYLx7sZ_BMJTKC5v-6tuUaVizJ_CnloOe2V1xTk5bkZGekyl16F75E8fKcPIskPJo Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestJSON-553840835 Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestJSON-553840835 Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestJSON-553840835 Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersTestJSON-553840835-project Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6ac786dc6d7847f582262dcd912c3f06 Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestJSON-553840835-project Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 333a253e-8804-4171-8e84-aabbdb54a345 could not be found. Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '333a253e-8804-4171-8e84-aabbdb54a345'} Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 333a253e-8804-4171-8e84-aabbdb54a345 could not be found. Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 333a253e-8804-4171-8e84-aabbdb54a345 could not be found. Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:55:10.362218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:55:10.375485 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:55:10.375485 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:55:10.375485 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:55:10.375485 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:55:10.375485 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 333a253e-8804-4171-8e84-aabbdb54a345 could not be found. Sep 07 12:55:10.375485 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:55:10.375485 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e513e96-35a4-44a3-bf34-097d1a336a2d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Returning 404 to user: Instance 333a253e-8804-4171-8e84-aabbdb54a345 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:55:10.375485 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2e513e96-35a4-44a3-bf34-097d1a336a2d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/333a253e-8804-4171-8e84-aabbdb54a345" status: 404 len: 111 microversion: 2.1 time: 0.084131 Sep 07 12:55:10.375485 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2367/4788] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:10 2022] GET /compute/v2.1/servers/333a253e-8804-4171-8e84-aabbdb54a345 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:55:10.379983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a6c4cff9-1d0a-475a-a77a-6648f6e43128 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:10.379983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a6c4cff9-1d0a-475a-a77a-6648f6e43128 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:10.389093 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6c4cff9-1d0a-475a-a77a-6648f6e43128 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:10.389795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6c4cff9-1d0a-475a-a77a-6648f6e43128 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:10.391038 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6c4cff9-1d0a-475a-a77a-6648f6e43128 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:10.392044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6c4cff9-1d0a-475a-a77a-6648f6e43128 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:10.395430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6c4cff9-1d0a-475a-a77a-6648f6e43128 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:10.395991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6c4cff9-1d0a-475a-a77a-6648f6e43128 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:11.065911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7b54fb05-529b-4d7a-902f-86b9c9323056 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:11.070309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=12,nova_cell1:INSERT=1,nova_cell1:DELETE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:11.078118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7b54fb05-529b-4d7a-902f-86b9c9323056 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:11.087434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a6c4cff9-1d0a-475a-a77a-6648f6e43128 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:11.097876 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a6c4cff9-1d0a-475a-a77a-6648f6e43128 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1315 microversion: 2.1 time: 0.726989 Sep 07 12:55:11.107495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7b54fb05-529b-4d7a-902f-86b9c9323056 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:11.108647 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2368/4789] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:10 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1315 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:11.114314 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7b54fb05-529b-4d7a-902f-86b9c9323056 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1723 microversion: 2.20 time: 0.879689 Sep 07 12:55:11.126942 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2422/4790] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:10 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1723 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:11.139794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a4627e99-8084-4f7e-8a25-3af85971c697 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:11.145144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-37e20e93-be6f-4842-9f4e-e8b18209f4a2 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:11.154393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a4627e99-8084-4f7e-8a25-3af85971c697 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] [instance: e6109fe8-30c8-42a8-b428-8a62e6e34fca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:11.158533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-37e20e93-be6f-4842-9f4e-e8b18209f4a2 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:11.169595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4627e99-8084-4f7e-8a25-3af85971c697 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:11.170242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4627e99-8084-4f7e-8a25-3af85971c697 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:11.178170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4627e99-8084-4f7e-8a25-3af85971c697 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:11.179297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4627e99-8084-4f7e-8a25-3af85971c697 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:11.179907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4627e99-8084-4f7e-8a25-3af85971c697 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:11.180513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4627e99-8084-4f7e-8a25-3af85971c697 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:11.188101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37e20e93-be6f-4842-9f4e-e8b18209f4a2 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:11.188851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37e20e93-be6f-4842-9f4e-e8b18209f4a2 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:11.189525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37e20e93-be6f-4842-9f4e-e8b18209f4a2 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:11.190434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37e20e93-be6f-4842-9f4e-e8b18209f4a2 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:11.191032 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37e20e93-be6f-4842-9f4e-e8b18209f4a2 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:11.202194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37e20e93-be6f-4842-9f4e-e8b18209f4a2 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:11.280662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a4627e99-8084-4f7e-8a25-3af85971c697 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '83061653a9bf4487a1ea9778ef5d7951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6a79b860544015b08e7e22a888ee9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:11.286838 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a4627e99-8084-4f7e-8a25-3af85971c697 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] 10.222.0.16 "GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca/os-instance-actions/req-8bc9f751-80c2-4c70-b621-e358f378e946" status: 200 len: 313 microversion: 2.1 time: 0.176695 Sep 07 12:55:11.287667 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2369/4791] 10.222.0.16 () {58 vars in 1419 bytes} [Wed Sep 7 12:55:11 2022] GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca/os-instance-actions/req-8bc9f751-80c2-4c70-b621-e358f378e946 => generated 313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:55:11.309604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cd985eaf-7ab3-4356-bb7d-3b5ca50ef006 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1607014804", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "1c45fce2-7bfe-4e93-8f9c-12b9830de28b"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:11.388469 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-cd985eaf-7ab3-4356-bb7d-3b5ca50ef006 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] validate_networks() for [('1c45fce2-7bfe-4e93-8f9c-12b9830de28b', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:55:12.227742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-37e20e93-be6f-4842-9f4e-e8b18209f4a2 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:12.246509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-37e20e93-be6f-4842-9f4e-e8b18209f4a2 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:12.253310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-37e20e93-be6f-4842-9f4e-e8b18209f4a2 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:12.259204 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-37e20e93-be6f-4842-9f4e-e8b18209f4a2 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 2912 microversion: 2.32 time: 1.130303 Sep 07 12:55:12.262623 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2423/4792] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:11 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 2912 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:12.279720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-51d2d69c-2560-4e95-91cc-f8283b4c6b94 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:12.287430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-51d2d69c-2560-4e95-91cc-f8283b4c6b94 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] [instance: e6109fe8-30c8-42a8-b428-8a62e6e34fca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:12.303784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51d2d69c-2560-4e95-91cc-f8283b4c6b94 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:12.306552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51d2d69c-2560-4e95-91cc-f8283b4c6b94 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:12.311226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51d2d69c-2560-4e95-91cc-f8283b4c6b94 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:12.312405 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51d2d69c-2560-4e95-91cc-f8283b4c6b94 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:12.316072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51d2d69c-2560-4e95-91cc-f8283b4c6b94 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:12.321591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51d2d69c-2560-4e95-91cc-f8283b4c6b94 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:12.542129 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-51d2d69c-2560-4e95-91cc-f8283b4c6b94 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] 10.222.0.16 "POST /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca/action" status: 202 len: 0 microversion: 2.1 time: 0.277596 Sep 07 12:55:12.543669 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2424/4793] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:55:12 2022] POST /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:55:12.550735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4db0abe0-f2f3-464c-8f54-588e8ac22b74 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:12.551888 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4db0abe0-f2f3-464c-8f54-588e8ac22b74 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:12.560729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4db0abe0-f2f3-464c-8f54-588e8ac22b74 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:12.561675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4db0abe0-f2f3-464c-8f54-588e8ac22b74 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:12.562427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4db0abe0-f2f3-464c-8f54-588e8ac22b74 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:12.563532 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4db0abe0-f2f3-464c-8f54-588e8ac22b74 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:12.564285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4db0abe0-f2f3-464c-8f54-588e8ac22b74 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:12.564996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4db0abe0-f2f3-464c-8f54-588e8ac22b74 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:13.965140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4db0abe0-f2f3-464c-8f54-588e8ac22b74 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:13.981685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4db0abe0-f2f3-464c-8f54-588e8ac22b74 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:13.989238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4db0abe0-f2f3-464c-8f54-588e8ac22b74 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:13.991145 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4db0abe0-f2f3-464c-8f54-588e8ac22b74 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1723 microversion: 2.20 time: 1.445832 Sep 07 12:55:13.992009 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2425/4794] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:12 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1723 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:14.003698 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8f5c11d3-2e90-4614-8227-3b9e74280c3c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:14.006099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8f5c11d3-2e90-4614-8227-3b9e74280c3c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:14.040013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f5c11d3-2e90-4614-8227-3b9e74280c3c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:14.040969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f5c11d3-2e90-4614-8227-3b9e74280c3c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:14.041689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f5c11d3-2e90-4614-8227-3b9e74280c3c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:14.042697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f5c11d3-2e90-4614-8227-3b9e74280c3c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:14.043401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f5c11d3-2e90-4614-8227-3b9e74280c3c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:14.044078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f5c11d3-2e90-4614-8227-3b9e74280c3c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:14.366341 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cd985eaf-7ab3-4356-bb7d-3b5ca50ef006 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:55:14.367221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cd985eaf-7ab3-4356-bb7d-3b5ca50ef006 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:55:14.368276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cd985eaf-7ab3-4356-bb7d-3b5ca50ef006 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:55:14.368863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cd985eaf-7ab3-4356-bb7d-3b5ca50ef006 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:55:14.369393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cd985eaf-7ab3-4356-bb7d-3b5ca50ef006 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:55:14.376217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:14.396182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd985eaf-7ab3-4356-bb7d-3b5ca50ef006 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:14.396746 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd985eaf-7ab3-4356-bb7d-3b5ca50ef006 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:14.397327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd985eaf-7ab3-4356-bb7d-3b5ca50ef006 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:14.398289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd985eaf-7ab3-4356-bb7d-3b5ca50ef006 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:14.398884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd985eaf-7ab3-4356-bb7d-3b5ca50ef006 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:14.399425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd985eaf-7ab3-4356-bb7d-3b5ca50ef006 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:14.447197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-cd985eaf-7ab3-4356-bb7d-3b5ca50ef006 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Getting quotas for project 854c6a81bbfd4ab79126799ec40c954e. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:55:14.469633 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-cd985eaf-7ab3-4356-bb7d-3b5ca50ef006 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Getting quotas for user 6ac786dc6d7847f582262dcd912c3f06 and project 854c6a81bbfd4ab79126799ec40c954e. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:55:14.489992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cd985eaf-7ab3-4356-bb7d-3b5ca50ef006 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:55:14.502939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cd985eaf-7ab3-4356-bb7d-3b5ca50ef006 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 1b76a312-8d25-432f-913b-2e8be8df9246] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:55:14.632588 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cd985eaf-7ab3-4356-bb7d-3b5ca50ef006 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.328587 Sep 07 12:55:14.634915 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2370/4795] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:55:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:55:14.652916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-473c0419-73dd-44c5-bdcf-1c93892c00e7 req-24a56991-2a5a-4de8-808d-2bf0c7f1bed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9352ac2-475e-4c77-aa85-5ecd566563b2", "name": "network-vif-deleted", "tag": "acffd0c4-1273-4d97-8465-26984f8e6d9d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:14.666608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-473c0419-73dd-44c5-bdcf-1c93892c00e7 req-24a56991-2a5a-4de8-808d-2bf0c7f1bed3 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:14.667912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-473c0419-73dd-44c5-bdcf-1c93892c00e7 req-24a56991-2a5a-4de8-808d-2bf0c7f1bed3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:14.669090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-473c0419-73dd-44c5-bdcf-1c93892c00e7 req-24a56991-2a5a-4de8-808d-2bf0c7f1bed3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:14.695564 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-473c0419-73dd-44c5-bdcf-1c93892c00e7 req-24a56991-2a5a-4de8-808d-2bf0c7f1bed3 service nova] Creating event network-vif-deleted:acffd0c4-1273-4d97-8465-26984f8e6d9d for instance e9352ac2-475e-4c77-aa85-5ecd566563b2 on n-h2-852087-9 Sep 07 12:55:14.706370 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-473c0419-73dd-44c5-bdcf-1c93892c00e7 req-24a56991-2a5a-4de8-808d-2bf0c7f1bed3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069444 Sep 07 12:55:14.709228 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2371/4796] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:55:15.266295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-73def9fb-9df4-444d-95c8-5efcf54ea016 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Action: 'create', calling method: .version_select at 0x7fc413941d30>, body: {"keypair": {"name": "tempest-keypair-188964110", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBq4TTKetKdN798z9jOXyEFSJwPEyk9Qk7eV++gGQ/eeH/s/wYrnQ+bI1ka0wplYy2+lh9F8Oqm5cA12SwmXProyb/L0w821+YJfKGRnxANSUrrLh+mQdhDIwXzQ3yuJQ=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:15.299236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-73def9fb-9df4-444d-95c8-5efcf54ea016 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Getting quotas for project 059d18cef73a40b49cb707c7838973a9. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:55:15.309036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-73def9fb-9df4-444d-95c8-5efcf54ea016 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Getting quotas for user 384329dd16dd48a1af7f197c71af2f4c and project 059d18cef73a40b49cb707c7838973a9. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:55:15.356796 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-73def9fb-9df4-444d-95c8-5efcf54ea016 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.643406 Sep 07 12:55:15.359943 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2372/4797] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 12:55:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:55:15.380401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-93c50fa1-715e-4dbd-a784-2591214c0d1e tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:15.381144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-93c50fa1-715e-4dbd-a784-2591214c0d1e tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] [instance: e6109fe8-30c8-42a8-b428-8a62e6e34fca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:15.421322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93c50fa1-715e-4dbd-a784-2591214c0d1e tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:15.422490 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93c50fa1-715e-4dbd-a784-2591214c0d1e tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:15.422959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93c50fa1-715e-4dbd-a784-2591214c0d1e tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:15.425957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93c50fa1-715e-4dbd-a784-2591214c0d1e tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:15.427779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93c50fa1-715e-4dbd-a784-2591214c0d1e tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:15.428246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93c50fa1-715e-4dbd-a784-2591214c0d1e tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:15.977128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8f5c11d3-2e90-4614-8227-3b9e74280c3c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:16.052697 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8f5c11d3-2e90-4614-8227-3b9e74280c3c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1315 microversion: 2.1 time: 2.058893 Sep 07 12:55:16.058910 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2426/4798] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:13 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1315 bytes in 2066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:16.091952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7eb51b3a-ae40-420b-b528-1758f2cd6f27 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:16.097573 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7eb51b3a-ae40-420b-b528-1758f2cd6f27 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:16.149410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7eb51b3a-ae40-420b-b528-1758f2cd6f27 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:16.154214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7eb51b3a-ae40-420b-b528-1758f2cd6f27 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:16.165285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7eb51b3a-ae40-420b-b528-1758f2cd6f27 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:16.171928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7eb51b3a-ae40-420b-b528-1758f2cd6f27 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:16.175640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7eb51b3a-ae40-420b-b528-1758f2cd6f27 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:16.177319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7eb51b3a-ae40-420b-b528-1758f2cd6f27 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:16.917335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-93c50fa1-715e-4dbd-a784-2591214c0d1e tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83061653a9bf4487a1ea9778ef5d7951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6a79b860544015b08e7e22a888ee9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:16.952954 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-93c50fa1-715e-4dbd-a784-2591214c0d1e tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] 10.222.0.16 "GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca" status: 200 len: 1506 microversion: 2.1 time: 1.591047 Sep 07 12:55:16.968377 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2373/4799] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:15 2022] GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca => generated 1506 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:16.984476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7641778a-ee8b-4005-9670-e1a82e2e6095 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:16.985106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7641778a-ee8b-4005-9670-e1a82e2e6095 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 1b76a312-8d25-432f-913b-2e8be8df9246] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:17.010184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7641778a-ee8b-4005-9670-e1a82e2e6095 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:17.010747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7641778a-ee8b-4005-9670-e1a82e2e6095 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:17.011333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7641778a-ee8b-4005-9670-e1a82e2e6095 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:17.012791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7641778a-ee8b-4005-9670-e1a82e2e6095 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:17.012791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7641778a-ee8b-4005-9670-e1a82e2e6095 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:17.013063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7641778a-ee8b-4005-9670-e1a82e2e6095 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:17.345403 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7641778a-ee8b-4005-9670-e1a82e2e6095 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:17.359134 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7641778a-ee8b-4005-9670-e1a82e2e6095 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246" status: 200 len: 1217 microversion: 2.1 time: 0.389711 Sep 07 12:55:17.360039 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2374/4800] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:16 2022] GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246 => generated 1217 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:17.377775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8a9f434c-75f4-454f-9ff6-cca44fcdfa27 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:17.403943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8a9f434c-75f4-454f-9ff6-cca44fcdfa27 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:17.424069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a9f434c-75f4-454f-9ff6-cca44fcdfa27 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:17.430392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a9f434c-75f4-454f-9ff6-cca44fcdfa27 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:17.431481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a9f434c-75f4-454f-9ff6-cca44fcdfa27 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:17.433938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a9f434c-75f4-454f-9ff6-cca44fcdfa27 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:17.437784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a9f434c-75f4-454f-9ff6-cca44fcdfa27 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:17.442320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a9f434c-75f4-454f-9ff6-cca44fcdfa27 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:17.593925 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a9f434c-75f4-454f-9ff6-cca44fcdfa27 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:17.594603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a9f434c-75f4-454f-9ff6-cca44fcdfa27 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:17.596282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a9f434c-75f4-454f-9ff6-cca44fcdfa27 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:17.607253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-8a9f434c-75f4-454f-9ff6-cca44fcdfa27 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lazy-loading 'fault' on Instance uuid ffe6581c-7070-48c5-a16d-fa30b22567d4 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:55:18.260656 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8a9f434c-75f4-454f-9ff6-cca44fcdfa27 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:18.272168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8a9f434c-75f4-454f-9ff6-cca44fcdfa27 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:18.291965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8a9f434c-75f4-454f-9ff6-cca44fcdfa27 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:18.295420 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8a9f434c-75f4-454f-9ff6-cca44fcdfa27 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 200 len: 1371 microversion: 2.20 time: 0.922696 Sep 07 12:55:18.324677 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2375/4801] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:17 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 1371 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:18.865127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-da942f17-4a3a-4e80-a94c-67b063eba90b req-b0327135-004d-4e8b-a1a9-1d4d88ca2ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe6581c-7070-48c5-a16d-fa30b22567d4", "name": "network-vif-deleted", "tag": "57759270-a8de-4adc-a2ba-ccbb3e371878"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:18.952345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-da942f17-4a3a-4e80-a94c-67b063eba90b req-b0327135-004d-4e8b-a1a9-1d4d88ca2ee0 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:18.986324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-da942f17-4a3a-4e80-a94c-67b063eba90b req-b0327135-004d-4e8b-a1a9-1d4d88ca2ee0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:18.987190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-da942f17-4a3a-4e80-a94c-67b063eba90b req-b0327135-004d-4e8b-a1a9-1d4d88ca2ee0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:19.045551 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-da942f17-4a3a-4e80-a94c-67b063eba90b req-b0327135-004d-4e8b-a1a9-1d4d88ca2ee0 service nova] Creating event network-vif-deleted:57759270-a8de-4adc-a2ba-ccbb3e371878 for instance ffe6581c-7070-48c5-a16d-fa30b22567d4 on n-h1-852087-9 Sep 07 12:55:19.083572 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-da942f17-4a3a-4e80-a94c-67b063eba90b req-b0327135-004d-4e8b-a1a9-1d4d88ca2ee0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.749321 Sep 07 12:55:19.085661 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2376/4802] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:55:19.110067 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-7aa42d33-81fb-424c-ae26-6fa8b15a7013 req-ba6f73f9-dbdb-4c52-a4e8-3f61f17da340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9352ac2-475e-4c77-aa85-5ecd566563b2", "name": "network-vif-deleted", "tag": "2d928931-3783-4efe-a479-33f49c27cfb9"}, {"name": "network-changed", "server_uuid": "812b8c7f-9408-4862-a000-4b444babe995", "tag": "f22238e2-dfbe-46a4-8e28-684befdd390b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:19.155244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7aa42d33-81fb-424c-ae26-6fa8b15a7013 req-ba6f73f9-dbdb-4c52-a4e8-3f61f17da340 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:19.157908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7aa42d33-81fb-424c-ae26-6fa8b15a7013 req-ba6f73f9-dbdb-4c52-a4e8-3f61f17da340 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:19.158963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7aa42d33-81fb-424c-ae26-6fa8b15a7013 req-ba6f73f9-dbdb-4c52-a4e8-3f61f17da340 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:19.208801 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7aa42d33-81fb-424c-ae26-6fa8b15a7013 req-ba6f73f9-dbdb-4c52-a4e8-3f61f17da340 service nova] Creating event network-vif-deleted:2d928931-3783-4efe-a479-33f49c27cfb9 for instance e9352ac2-475e-4c77-aa85-5ecd566563b2 on n-h2-852087-9 Sep 07 12:55:19.215411 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7aa42d33-81fb-424c-ae26-6fa8b15a7013 req-ba6f73f9-dbdb-4c52-a4e8-3f61f17da340 service nova] Creating event network-changed:f22238e2-dfbe-46a4-8e28-684befdd390b for instance 812b8c7f-9408-4862-a000-4b444babe995 on n-h2-852087-9 Sep 07 12:55:19.277808 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-7aa42d33-81fb-424c-ae26-6fa8b15a7013 req-ba6f73f9-dbdb-4c52-a4e8-3f61f17da340 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.189246 Sep 07 12:55:19.294715 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2377/4803] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:55:19.336406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-09a96555-c21c-4a23-b38c-f877cfd6324d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:19.342739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-09a96555-c21c-4a23-b38c-f877cfd6324d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:19.359281 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09a96555-c21c-4a23-b38c-f877cfd6324d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:19.371291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09a96555-c21c-4a23-b38c-f877cfd6324d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:19.372059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09a96555-c21c-4a23-b38c-f877cfd6324d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:19.373000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09a96555-c21c-4a23-b38c-f877cfd6324d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:19.373708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09a96555-c21c-4a23-b38c-f877cfd6324d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:19.374307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09a96555-c21c-4a23-b38c-f877cfd6324d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:19.508879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7eb51b3a-ae40-420b-b528-1758f2cd6f27 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:19.558482 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7eb51b3a-ae40-420b-b528-1758f2cd6f27 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:19.576038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7eb51b3a-ae40-420b-b528-1758f2cd6f27 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:19.578029 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7eb51b3a-ae40-420b-b528-1758f2cd6f27 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 2704 microversion: 2.32 time: 3.515247 Sep 07 12:55:19.607057 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2427/4804] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:16 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 2704 bytes in 3527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:19.629422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b76be6fb-9dd5-45c9-9b45-c5d3c90cb2f1 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:19.632861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b76be6fb-9dd5-45c9-9b45-c5d3c90cb2f1 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] [instance: e6109fe8-30c8-42a8-b428-8a62e6e34fca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:19.649098 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b76be6fb-9dd5-45c9-9b45-c5d3c90cb2f1 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:19.652295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b76be6fb-9dd5-45c9-9b45-c5d3c90cb2f1 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:19.653089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b76be6fb-9dd5-45c9-9b45-c5d3c90cb2f1 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:19.654381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b76be6fb-9dd5-45c9-9b45-c5d3c90cb2f1 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:19.655175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b76be6fb-9dd5-45c9-9b45-c5d3c90cb2f1 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:19.656172 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b76be6fb-9dd5-45c9-9b45-c5d3c90cb2f1 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:20.928130 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-09a96555-c21c-4a23-b38c-f877cfd6324d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:20.941852 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-09a96555-c21c-4a23-b38c-f877cfd6324d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1315 microversion: 2.1 time: 1.644640 Sep 07 12:55:20.953988 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2378/4805] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:19 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1315 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:21.326682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b76be6fb-9dd5-45c9-9b45-c5d3c90cb2f1 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83061653a9bf4487a1ea9778ef5d7951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6a79b860544015b08e7e22a888ee9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:21.343067 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b76be6fb-9dd5-45c9-9b45-c5d3c90cb2f1 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] 10.222.0.16 "GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca" status: 200 len: 1511 microversion: 2.1 time: 1.726190 Sep 07 12:55:21.344109 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2428/4806] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:19 2022] GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca => generated 1511 bytes in 1736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:21.350026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-33d38710-361a-429f-a444-a822c7a65253 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:21.351037 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-33d38710-361a-429f-a444-a822c7a65253 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 1b76a312-8d25-432f-913b-2e8be8df9246] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:21.359504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33d38710-361a-429f-a444-a822c7a65253 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:21.360417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33d38710-361a-429f-a444-a822c7a65253 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:21.368790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-18d0ccfe-aa97-454d-985b-79746344f906 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-2046035862", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "99ebfcd0-f9b6-4f19-95a1-a819fade985e"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:21.375017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33d38710-361a-429f-a444-a822c7a65253 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:21.376045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33d38710-361a-429f-a444-a822c7a65253 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:21.376940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33d38710-361a-429f-a444-a822c7a65253 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:21.377404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-33d38710-361a-429f-a444-a822c7a65253 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:21.497604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-18d0ccfe-aa97-454d-985b-79746344f906 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] validate_networks() for [('99ebfcd0-f9b6-4f19-95a1-a819fade985e', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:55:21.891645 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-33d38710-361a-429f-a444-a822c7a65253 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:21.910088 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-33d38710-361a-429f-a444-a822c7a65253 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246" status: 200 len: 1279 microversion: 2.1 time: 0.562891 Sep 07 12:55:21.915696 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2429/4807] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:21 2022] GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246 => generated 1279 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:21.926519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7b43ae8d-a6c1-46ef-8260-cffcea6ce3a6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:21.928260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7b43ae8d-a6c1-46ef-8260-cffcea6ce3a6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:21.943031 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b43ae8d-a6c1-46ef-8260-cffcea6ce3a6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:21.944353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b43ae8d-a6c1-46ef-8260-cffcea6ce3a6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:21.945470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b43ae8d-a6c1-46ef-8260-cffcea6ce3a6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:21.947638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b43ae8d-a6c1-46ef-8260-cffcea6ce3a6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:21.948894 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b43ae8d-a6c1-46ef-8260-cffcea6ce3a6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:21.950071 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b43ae8d-a6c1-46ef-8260-cffcea6ce3a6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:21.982658 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-7b43ae8d-a6c1-46ef-8260-cffcea6ce3a6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] HTTP exception thrown: Instance ffe6581c-7070-48c5-a16d-fa30b22567d4 could not be found. Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7b43ae8d-a6c1-46ef-8260-cffcea6ce3a6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Request method failure captured: Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 HTTP/1.1 Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNw5hacCrPa_HA67UL8Q8JsIVT06ZBnDw_7nEL37LMgyCxq7HTiBwQQLT7YgngjCO9dDbCsgT7vkiCHkYFkVZvw6W7F-_hBjld_38ZCU8IPDT9dG3fgXHphQDQ20Ayfi0-lKCoj-hwol4f9c1wYW0KnUBkrb3phyz4ShjlWqaTo78s Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: fdbe65a861ac4b9ea7e5c2bbd4d955b3 Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-358704052 Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdbe65a861ac4b9ea7e5c2bbd4d955b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fdbe65a861ac4b9ea7e5c2bbd4d955b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fdbe65a861ac4b9ea7e5c2bbd4d955b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdbe65a861ac4b9ea7e5c2bbd4d955b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AttachVolumeShelveTestJSON-358704052 Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: fdbe65a861ac4b9ea7e5c2bbd4d955b3 Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-358704052 Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AttachVolumeShelveTestJSON-358704052-project Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 9e1c3623bbda4cbdbf6b5d2dedb48f74 Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AttachVolumeShelveTestJSON-358704052-project Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance ffe6581c-7070-48c5-a16d-fa30b22567d4 could not be found. Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'ffe6581c-7070-48c5-a16d-fa30b22567d4'} Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe6581c-7070-48c5-a16d-fa30b22567d4 could not be found. Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe6581c-7070-48c5-a16d-fa30b22567d4 could not be found. Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:55:21.988592 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:55:21.996876 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:55:21.996876 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:55:21.996876 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:55:21.996876 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:55:21.996876 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:55:21.996876 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:55:21.996876 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe6581c-7070-48c5-a16d-fa30b22567d4 could not be found. Sep 07 12:55:21.996876 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:55:22.001598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7b43ae8d-a6c1-46ef-8260-cffcea6ce3a6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Returning 404 to user: Instance ffe6581c-7070-48c5-a16d-fa30b22567d4 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:55:22.002477 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7b43ae8d-a6c1-46ef-8260-cffcea6ce3a6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 404 len: 111 microversion: 2.20 time: 0.084389 Sep 07 12:55:22.005599 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2430/4808] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:21 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:55:22.047472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b8d43000-9291-4577-adb3-0f13cd0404ba tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:22.051306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b8d43000-9291-4577-adb3-0f13cd0404ba tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:22.085393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8d43000-9291-4577-adb3-0f13cd0404ba tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:22.085945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8d43000-9291-4577-adb3-0f13cd0404ba tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:22.086397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8d43000-9291-4577-adb3-0f13cd0404ba tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:22.087141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8d43000-9291-4577-adb3-0f13cd0404ba tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:22.087611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8d43000-9291-4577-adb3-0f13cd0404ba tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:22.092929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8d43000-9291-4577-adb3-0f13cd0404ba tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:22.977082 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b8d43000-9291-4577-adb3-0f13cd0404ba tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:23.015691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b8d43000-9291-4577-adb3-0f13cd0404ba tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:23.021518 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b8d43000-9291-4577-adb3-0f13cd0404ba tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:23.025385 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b8d43000-9291-4577-adb3-0f13cd0404ba tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 2546 microversion: 2.32 time: 1.017323 Sep 07 12:55:23.027913 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2431/4809] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:22 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 2546 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:23.041380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5df59a7e-0577-4442-9504-696e1fb54582 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-984825756", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6de05969-ecdd-4737-b986-07da50b5eaf7"}], "security_groups": [{"name": "tempest-securitygroup--1655471486"}], "key_name": "tempest-keypair-188964110", "user_data": "}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:23.380909 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-18d0ccfe-aa97-454d-985b-79746344f906 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:55:23.382150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-18d0ccfe-aa97-454d-985b-79746344f906 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:55:23.383174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-18d0ccfe-aa97-454d-985b-79746344f906 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:55:23.384033 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-18d0ccfe-aa97-454d-985b-79746344f906 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:55:23.384902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-18d0ccfe-aa97-454d-985b-79746344f906 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:55:23.431430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18d0ccfe-aa97-454d-985b-79746344f906 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:23.433133 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18d0ccfe-aa97-454d-985b-79746344f906 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:23.435009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18d0ccfe-aa97-454d-985b-79746344f906 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:23.437247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18d0ccfe-aa97-454d-985b-79746344f906 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:23.438728 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18d0ccfe-aa97-454d-985b-79746344f906 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:23.439686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18d0ccfe-aa97-454d-985b-79746344f906 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:23.457029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-5df59a7e-0577-4442-9504-696e1fb54582 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] validate_networks() for [('6de05969-ecdd-4737-b986-07da50b5eaf7', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:55:23.481935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-18d0ccfe-aa97-454d-985b-79746344f906 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Getting quotas for project beea504630b84817b11d85cd03f92215. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:55:23.499769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-18d0ccfe-aa97-454d-985b-79746344f906 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Getting quotas for user a9a08986ff6f4c0592c850b2dabc931b and project beea504630b84817b11d85cd03f92215. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:55:23.528592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-18d0ccfe-aa97-454d-985b-79746344f906 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:55:23.534714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-18d0ccfe-aa97-454d-985b-79746344f906 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] [instance: a642f02a-a904-4117-8e50-5418e731ff50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:55:23.727071 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-18d0ccfe-aa97-454d-985b-79746344f906 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.762653 Sep 07 12:55:23.742390 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2379/4810] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:55:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:55:23.787182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3e5b7f09-087f-40fe-9ade-cf6a595bce31 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:23.792264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3e5b7f09-087f-40fe-9ade-cf6a595bce31 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:23.816876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e5b7f09-087f-40fe-9ade-cf6a595bce31 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:23.818273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e5b7f09-087f-40fe-9ade-cf6a595bce31 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:23.822997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e5b7f09-087f-40fe-9ade-cf6a595bce31 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:23.828547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e5b7f09-087f-40fe-9ade-cf6a595bce31 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:23.830234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e5b7f09-087f-40fe-9ade-cf6a595bce31 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:23.831982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e5b7f09-087f-40fe-9ade-cf6a595bce31 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:25.285937 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3e5b7f09-087f-40fe-9ade-cf6a595bce31 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:25.328699 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3e5b7f09-087f-40fe-9ade-cf6a595bce31 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1315 microversion: 2.1 time: 1.582950 Sep 07 12:55:25.330581 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2380/4811] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:23 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1315 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:25.344574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-88e771fe-0291-4eda-a075-43ef5a40ef0d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '.version_select at 0x7fc4139ad160>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:25.392164 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-88e771fe-0291-4eda-a075-43ef5a40ef0d tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-357939483" status: 204 len: 0 microversion: 2.20 time: 0.059256 Sep 07 12:55:25.393648 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2381/4812] 10.222.0.16 () {60 vars in 1259 bytes} [Wed Sep 7 12:55:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-357939483 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:55:25.406680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-307b42e2-e39f-4998-8054-60fb65a5b400 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:25.409834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-307b42e2-e39f-4998-8054-60fb65a5b400 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] [instance: e6109fe8-30c8-42a8-b428-8a62e6e34fca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:25.433008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-307b42e2-e39f-4998-8054-60fb65a5b400 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:25.434519 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-307b42e2-e39f-4998-8054-60fb65a5b400 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:25.437006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-307b42e2-e39f-4998-8054-60fb65a5b400 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:25.439466 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-307b42e2-e39f-4998-8054-60fb65a5b400 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:25.440865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-307b42e2-e39f-4998-8054-60fb65a5b400 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:25.441920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-307b42e2-e39f-4998-8054-60fb65a5b400 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:26.663837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-307b42e2-e39f-4998-8054-60fb65a5b400 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83061653a9bf4487a1ea9778ef5d7951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6a79b860544015b08e7e22a888ee9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:26.681475 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-307b42e2-e39f-4998-8054-60fb65a5b400 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] 10.222.0.16 "GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca" status: 200 len: 1504 microversion: 2.1 time: 1.285058 Sep 07 12:55:26.684985 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2382/4813] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:25 2022] GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca => generated 1504 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:26.696736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b1f2af11-cfd6-4662-bdb5-896f4dfaf956 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:26.701920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b1f2af11-cfd6-4662-bdb5-896f4dfaf956 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 1b76a312-8d25-432f-913b-2e8be8df9246] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:26.731112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1f2af11-cfd6-4662-bdb5-896f4dfaf956 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:26.731951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1f2af11-cfd6-4662-bdb5-896f4dfaf956 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:26.732563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1f2af11-cfd6-4662-bdb5-896f4dfaf956 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:26.733665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1f2af11-cfd6-4662-bdb5-896f4dfaf956 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:26.734326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1f2af11-cfd6-4662-bdb5-896f4dfaf956 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:26.739499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1f2af11-cfd6-4662-bdb5-896f4dfaf956 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:26.795509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-5df59a7e-0577-4442-9504-696e1fb54582 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:55:26.796875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-5df59a7e-0577-4442-9504-696e1fb54582 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:55:26.797577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-5df59a7e-0577-4442-9504-696e1fb54582 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:55:26.798165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-5df59a7e-0577-4442-9504-696e1fb54582 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:55:26.798755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-5df59a7e-0577-4442-9504-696e1fb54582 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:55:26.823626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5df59a7e-0577-4442-9504-696e1fb54582 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:26.825808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5df59a7e-0577-4442-9504-696e1fb54582 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:26.836468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5df59a7e-0577-4442-9504-696e1fb54582 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:26.841534 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5df59a7e-0577-4442-9504-696e1fb54582 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:26.842080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5df59a7e-0577-4442-9504-696e1fb54582 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:26.852557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5df59a7e-0577-4442-9504-696e1fb54582 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:26.949335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-5df59a7e-0577-4442-9504-696e1fb54582 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Getting quotas for project 059d18cef73a40b49cb707c7838973a9. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:55:26.987444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-5df59a7e-0577-4442-9504-696e1fb54582 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Getting quotas for user 384329dd16dd48a1af7f197c71af2f4c and project 059d18cef73a40b49cb707c7838973a9. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:55:27.071153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5df59a7e-0577-4442-9504-696e1fb54582 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:55:27.083868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5df59a7e-0577-4442-9504-696e1fb54582 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:55:27.223659 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5df59a7e-0577-4442-9504-696e1fb54582 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.192832 Sep 07 12:55:27.224866 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2432/4814] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:55:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 4196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:55:27.234325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6ba246fb-417c-43b4-b465-3f734ab016b9 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:27.235834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6ba246fb-417c-43b4-b465-3f734ab016b9 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] [instance: a642f02a-a904-4117-8e50-5418e731ff50] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:27.249177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ba246fb-417c-43b4-b465-3f734ab016b9 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:27.250684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ba246fb-417c-43b4-b465-3f734ab016b9 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:27.253685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ba246fb-417c-43b4-b465-3f734ab016b9 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:27.255840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ba246fb-417c-43b4-b465-3f734ab016b9 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:27.257286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ba246fb-417c-43b4-b465-3f734ab016b9 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:27.258766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ba246fb-417c-43b4-b465-3f734ab016b9 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:27.504424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6ba246fb-417c-43b4-b465-3f734ab016b9 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a08986ff6f4c0592c850b2dabc931b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beea504630b84817b11d85cd03f92215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:27.547294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b1f2af11-cfd6-4662-bdb5-896f4dfaf956 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:27.570729 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6ba246fb-417c-43b4-b465-3f734ab016b9 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] 10.222.0.16 "GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50" status: 200 len: 1286 microversion: 2.1 time: 0.341507 Sep 07 12:55:27.576315 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2433/4815] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:27 2022] GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50 => generated 1286 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:27.588184 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b1f2af11-cfd6-4662-bdb5-896f4dfaf956 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246" status: 200 len: 1321 microversion: 2.1 time: 0.898034 Sep 07 12:55:27.594003 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2383/4816] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:26 2022] GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246 => generated 1321 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:27.597092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-361c8ec9-6014-4fe7-a5c0-39a047275021 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:27.600570 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-361c8ec9-6014-4fe7-a5c0-39a047275021 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:27.619856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361c8ec9-6014-4fe7-a5c0-39a047275021 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:27.621354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361c8ec9-6014-4fe7-a5c0-39a047275021 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:27.622240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361c8ec9-6014-4fe7-a5c0-39a047275021 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:27.623656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361c8ec9-6014-4fe7-a5c0-39a047275021 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:27.624612 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361c8ec9-6014-4fe7-a5c0-39a047275021 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:27.625430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-27666552-639e-475a-81be-675087f25bae req-ac5eb9d5-28c4-4eed-b881-69d7b40de67a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9352ac2-475e-4c77-aa85-5ecd566563b2", "name": "network-vif-deleted", "tag": "3a4e33c1-9c34-429f-8cce-622597db4c32"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:27.625596 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361c8ec9-6014-4fe7-a5c0-39a047275021 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:27.638816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-27666552-639e-475a-81be-675087f25bae req-ac5eb9d5-28c4-4eed-b881-69d7b40de67a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:27.639488 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-27666552-639e-475a-81be-675087f25bae req-ac5eb9d5-28c4-4eed-b881-69d7b40de67a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:27.639926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-27666552-639e-475a-81be-675087f25bae req-ac5eb9d5-28c4-4eed-b881-69d7b40de67a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:27.666622 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-27666552-639e-475a-81be-675087f25bae req-ac5eb9d5-28c4-4eed-b881-69d7b40de67a service nova] Creating event network-vif-deleted:3a4e33c1-9c34-429f-8cce-622597db4c32 for instance e9352ac2-475e-4c77-aa85-5ecd566563b2 on n-h2-852087-9 Sep 07 12:55:27.684958 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-27666552-639e-475a-81be-675087f25bae req-ac5eb9d5-28c4-4eed-b881-69d7b40de67a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085195 Sep 07 12:55:27.686009 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2384/4817] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:55:27.703267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0466e99c-48f9-4488-995c-897717686e89 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:27.706669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0466e99c-48f9-4488-995c-897717686e89 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:27.724609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0466e99c-48f9-4488-995c-897717686e89 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:27.725112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0466e99c-48f9-4488-995c-897717686e89 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:27.725583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0466e99c-48f9-4488-995c-897717686e89 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:27.726535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0466e99c-48f9-4488-995c-897717686e89 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:27.727170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0466e99c-48f9-4488-995c-897717686e89 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:27.729409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0466e99c-48f9-4488-995c-897717686e89 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:28.284547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-361c8ec9-6014-4fe7-a5c0-39a047275021 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:28.315222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-361c8ec9-6014-4fe7-a5c0-39a047275021 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:28.331356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-361c8ec9-6014-4fe7-a5c0-39a047275021 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:28.333926 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-361c8ec9-6014-4fe7-a5c0-39a047275021 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 2452 microversion: 2.32 time: 0.755521 Sep 07 12:55:28.337972 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2434/4818] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:27 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 2452 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:28.350404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6637bf49-7aea-4ecf-8216-31c94e531647 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Action: 'create', calling method: .version_select at 0x7fc41850bf70>, body: {"keypair": {"name": "tempest-keypair-706282161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHr1XPKfpuWjDu0UHk8eh3+83w3QWOYzAJAZj+5IpMlqvH6F0SuIaSIjRCTB/1MzTavakrDUhZphwHwajnK+YsPp5l07VP1xpSEYUWpQRGOS1HHeMgw7Qukwmc5mmR/gNQ=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:28.421112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-6637bf49-7aea-4ecf-8216-31c94e531647 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Getting quotas for project fdbe65a861ac4b9ea7e5c2bbd4d955b3. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:55:28.442343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-6637bf49-7aea-4ecf-8216-31c94e531647 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Getting quotas for user 9e1c3623bbda4cbdbf6b5d2dedb48f74 and project fdbe65a861ac4b9ea7e5c2bbd4d955b3. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:55:28.464741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0466e99c-48f9-4488-995c-897717686e89 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:28.480715 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0466e99c-48f9-4488-995c-897717686e89 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1315 microversion: 2.1 time: 0.791024 Sep 07 12:55:28.482238 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2385/4819] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:27 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1315 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:28.492295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fb142512-f21c-45e2-91a5-cc5af43509cc tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Calling method '.version_select at 0x7fc4139db5e0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:28.508186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fb142512-f21c-45e2-91a5-cc5af43509cc tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] [instance: e6109fe8-30c8-42a8-b428-8a62e6e34fca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:28.531790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb142512-f21c-45e2-91a5-cc5af43509cc tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:28.532737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb142512-f21c-45e2-91a5-cc5af43509cc tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:28.533430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb142512-f21c-45e2-91a5-cc5af43509cc tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:28.538447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb142512-f21c-45e2-91a5-cc5af43509cc tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:28.539399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb142512-f21c-45e2-91a5-cc5af43509cc tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:28.543545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb142512-f21c-45e2-91a5-cc5af43509cc tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:28.580205 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6637bf49-7aea-4ecf-8216-31c94e531647 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.239241 Sep 07 12:55:28.583048 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2435/4820] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Sep 7 12:55:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 244 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:28.639176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1fe23c27-cf48-4746-9421-a05ba642a562 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:28.644262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1fe23c27-cf48-4746-9421-a05ba642a562 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:28.658536 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fb142512-f21c-45e2-91a5-cc5af43509cc tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] 10.222.0.16 "GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.174914 Sep 07 12:55:28.669155 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2386/4821] 10.222.0.16 () {58 vars in 1296 bytes} [Wed Sep 7 12:55:28 2022] GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca/os-instance-actions => generated 611 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:55:28.679820 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-186703a2-45a4-419b-a91b-ab3f004bd917 req-68227ea6-4a54-4304-a1bc-23715c29af54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812b8c7f-9408-4862-a000-4b444babe995", "name": "network-vif-plugged", "status": "completed", "tag": "f22238e2-dfbe-46a4-8e28-684befdd390b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:28.681850 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fe23c27-cf48-4746-9421-a05ba642a562 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:28.687470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fe23c27-cf48-4746-9421-a05ba642a562 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:28.688980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fe23c27-cf48-4746-9421-a05ba642a562 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:28.696250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fe23c27-cf48-4746-9421-a05ba642a562 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:28.699221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fe23c27-cf48-4746-9421-a05ba642a562 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:28.705433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-186703a2-45a4-419b-a91b-ab3f004bd917 req-68227ea6-4a54-4304-a1bc-23715c29af54 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:28.712761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-186703a2-45a4-419b-a91b-ab3f004bd917 req-68227ea6-4a54-4304-a1bc-23715c29af54 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:28.718301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-186703a2-45a4-419b-a91b-ab3f004bd917 req-68227ea6-4a54-4304-a1bc-23715c29af54 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:28.722880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fe23c27-cf48-4746-9421-a05ba642a562 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:28.747756 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-186703a2-45a4-419b-a91b-ab3f004bd917 req-68227ea6-4a54-4304-a1bc-23715c29af54 service nova] Creating event network-vif-plugged:f22238e2-dfbe-46a4-8e28-684befdd390b for instance 812b8c7f-9408-4862-a000-4b444babe995 on n-h2-852087-9 Sep 07 12:55:28.758152 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-186703a2-45a4-419b-a91b-ab3f004bd917 req-68227ea6-4a54-4304-a1bc-23715c29af54 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086688 Sep 07 12:55:28.762296 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2387/4822] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:55:28.781027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b2ab659b-e5bf-47f3-925e-b24837f40019 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:28.783711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b2ab659b-e5bf-47f3-925e-b24837f40019 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] [instance: a642f02a-a904-4117-8e50-5418e731ff50] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:28.801660 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2ab659b-e5bf-47f3-925e-b24837f40019 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:28.802585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2ab659b-e5bf-47f3-925e-b24837f40019 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:28.803274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2ab659b-e5bf-47f3-925e-b24837f40019 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:28.804306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2ab659b-e5bf-47f3-925e-b24837f40019 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:28.805055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2ab659b-e5bf-47f3-925e-b24837f40019 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:28.805746 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2ab659b-e5bf-47f3-925e-b24837f40019 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:29.231621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1fe23c27-cf48-4746-9421-a05ba642a562 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:29.258153 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1fe23c27-cf48-4746-9421-a05ba642a562 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1288 microversion: 2.1 time: 0.670934 Sep 07 12:55:29.261546 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2436/4823] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:28 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1288 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:29.278747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f8293a88-3bb4-41ad-8708-5849b88454be tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:29.280620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f8293a88-3bb4-41ad-8708-5849b88454be tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 1b76a312-8d25-432f-913b-2e8be8df9246] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:29.297453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8293a88-3bb4-41ad-8708-5849b88454be tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:29.298484 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8293a88-3bb4-41ad-8708-5849b88454be tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:29.299298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8293a88-3bb4-41ad-8708-5849b88454be tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:29.302058 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8293a88-3bb4-41ad-8708-5849b88454be tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:29.303092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8293a88-3bb4-41ad-8708-5849b88454be tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:29.305825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8293a88-3bb4-41ad-8708-5849b88454be tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:29.801755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b2ab659b-e5bf-47f3-925e-b24837f40019 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a08986ff6f4c0592c850b2dabc931b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beea504630b84817b11d85cd03f92215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:29.811475 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b2ab659b-e5bf-47f3-925e-b24837f40019 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] 10.222.0.16 "GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50" status: 200 len: 1328 microversion: 2.1 time: 1.047545 Sep 07 12:55:29.841049 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2388/4824] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:28 2022] GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50 => generated 1328 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:29.853879 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fb8aebfb-e61c-4d30-afae-424b15c641ce tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:29.854884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fb8aebfb-e61c-4d30-afae-424b15c641ce tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] [instance: e6109fe8-30c8-42a8-b428-8a62e6e34fca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:29.874258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb8aebfb-e61c-4d30-afae-424b15c641ce tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:29.875055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb8aebfb-e61c-4d30-afae-424b15c641ce tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:29.875781 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb8aebfb-e61c-4d30-afae-424b15c641ce tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:29.876787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb8aebfb-e61c-4d30-afae-424b15c641ce tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:29.877416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb8aebfb-e61c-4d30-afae-424b15c641ce tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:29.878159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb8aebfb-e61c-4d30-afae-424b15c641ce tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:29.920931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:29.941721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fb8aebfb-e61c-4d30-afae-424b15c641ce tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] [instance: e6109fe8-30c8-42a8-b428-8a62e6e34fca] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:55:30.098349 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fb8aebfb-e61c-4d30-afae-424b15c641ce tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca" status: 204 len: 0 microversion: 2.1 time: 0.255301 Sep 07 12:55:30.101759 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2389/4825] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:55:29 2022] DELETE /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:55:30.114040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-57f9dd87-bc87-4735-9451-c2d1ef140c4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:30.115260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-57f9dd87-bc87-4735-9451-c2d1ef140c4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:30.124093 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57f9dd87-bc87-4735-9451-c2d1ef140c4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:30.124851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57f9dd87-bc87-4735-9451-c2d1ef140c4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:30.125716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57f9dd87-bc87-4735-9451-c2d1ef140c4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:30.126801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57f9dd87-bc87-4735-9451-c2d1ef140c4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:30.127526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57f9dd87-bc87-4735-9451-c2d1ef140c4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:30.128173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57f9dd87-bc87-4735-9451-c2d1ef140c4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:30.211755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f8293a88-3bb4-41ad-8708-5849b88454be tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:30.229594 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f8293a88-3bb4-41ad-8708-5849b88454be tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246" status: 200 len: 1321 microversion: 2.1 time: 0.965964 Sep 07 12:55:30.230925 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2437/4826] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:29 2022] GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246 => generated 1321 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:30.237959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4e2edae0-2819-4477-a4fb-bc827d93a7e0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:30.238964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4e2edae0-2819-4477-a4fb-bc827d93a7e0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:30.274742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e2edae0-2819-4477-a4fb-bc827d93a7e0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:30.280327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e2edae0-2819-4477-a4fb-bc827d93a7e0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:30.282202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e2edae0-2819-4477-a4fb-bc827d93a7e0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:30.297635 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e2edae0-2819-4477-a4fb-bc827d93a7e0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:30.300944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e2edae0-2819-4477-a4fb-bc827d93a7e0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:30.301749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e2edae0-2819-4477-a4fb-bc827d93a7e0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:30.625458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-57f9dd87-bc87-4735-9451-c2d1ef140c4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:30.656170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-57f9dd87-bc87-4735-9451-c2d1ef140c4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:30.661767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-57f9dd87-bc87-4735-9451-c2d1ef140c4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:30.664640 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-57f9dd87-bc87-4735-9451-c2d1ef140c4a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 2166 microversion: 2.32 time: 0.560793 Sep 07 12:55:30.668167 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2390/4827] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:30 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 2166 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:30.687687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-71536187-9702-4466-b1cb-82a5863e54a0 req-82477f97-b3b8-46ea-be65-86dc0839f438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9352ac2-475e-4c77-aa85-5ecd566563b2", "name": "network-vif-deleted", "tag": "6dd24b36-3c01-41dd-97ac-f83db2b44791"}, {"name": "network-changed", "server_uuid": "1b76a312-8d25-432f-913b-2e8be8df9246", "tag": "7a67b18f-9508-47b8-b212-f42631849d0b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:30.701748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-71536187-9702-4466-b1cb-82a5863e54a0 req-82477f97-b3b8-46ea-be65-86dc0839f438 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:30.702696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-71536187-9702-4466-b1cb-82a5863e54a0 req-82477f97-b3b8-46ea-be65-86dc0839f438 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:30.703316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-71536187-9702-4466-b1cb-82a5863e54a0 req-82477f97-b3b8-46ea-be65-86dc0839f438 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:30.739675 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-71536187-9702-4466-b1cb-82a5863e54a0 req-82477f97-b3b8-46ea-be65-86dc0839f438 service nova] Creating event network-vif-deleted:6dd24b36-3c01-41dd-97ac-f83db2b44791 for instance e9352ac2-475e-4c77-aa85-5ecd566563b2 on n-h2-852087-9 Sep 07 12:55:30.740789 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-71536187-9702-4466-b1cb-82a5863e54a0 req-82477f97-b3b8-46ea-be65-86dc0839f438 service nova] Creating event network-changed:7a67b18f-9508-47b8-b212-f42631849d0b for instance 1b76a312-8d25-432f-913b-2e8be8df9246 on n-h1-852087-9 Sep 07 12:55:30.768121 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-71536187-9702-4466-b1cb-82a5863e54a0 req-82477f97-b3b8-46ea-be65-86dc0839f438 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.096974 Sep 07 12:55:30.771042 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2391/4828] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:55:30.788456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4e2edae0-2819-4477-a4fb-bc827d93a7e0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:30.791076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b9d6e365-fcb2-4fef-acb7-f09a64fd1135 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:30.792930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b9d6e365-fcb2-4fef-acb7-f09a64fd1135 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] [instance: e6109fe8-30c8-42a8-b428-8a62e6e34fca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:30.800043 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4e2edae0-2819-4477-a4fb-bc827d93a7e0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1315 microversion: 2.1 time: 0.567219 Sep 07 12:55:30.800763 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2438/4829] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:30 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1315 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:30.806674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1816688d-95d5-47b9-9d8e-44a6664aca92 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:30.807692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1816688d-95d5-47b9-9d8e-44a6664aca92 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:30.809846 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9d6e365-fcb2-4fef-acb7-f09a64fd1135 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:30.810511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9d6e365-fcb2-4fef-acb7-f09a64fd1135 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:30.812501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9d6e365-fcb2-4fef-acb7-f09a64fd1135 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:30.825816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1816688d-95d5-47b9-9d8e-44a6664aca92 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:30.826758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1816688d-95d5-47b9-9d8e-44a6664aca92 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:30.827502 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1816688d-95d5-47b9-9d8e-44a6664aca92 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:30.828534 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1816688d-95d5-47b9-9d8e-44a6664aca92 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:30.829431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1816688d-95d5-47b9-9d8e-44a6664aca92 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:30.830172 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1816688d-95d5-47b9-9d8e-44a6664aca92 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:30.839550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9d6e365-fcb2-4fef-acb7-f09a64fd1135 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:30.841713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9d6e365-fcb2-4fef-acb7-f09a64fd1135 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:30.842749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9d6e365-fcb2-4fef-acb7-f09a64fd1135 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:30.956181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1816688d-95d5-47b9-9d8e-44a6664aca92 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:30.970810 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1816688d-95d5-47b9-9d8e-44a6664aca92 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1306 microversion: 2.1 time: 0.168432 Sep 07 12:55:30.971854 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2439/4830] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:30 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1306 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:30.977233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e9744bd0-77b0-45cf-9df3-428e4d7da496 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:30.978610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e9744bd0-77b0-45cf-9df3-428e4d7da496 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] [instance: a642f02a-a904-4117-8e50-5418e731ff50] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:30.992947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9744bd0-77b0-45cf-9df3-428e4d7da496 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:31.001195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9744bd0-77b0-45cf-9df3-428e4d7da496 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:31.001871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9744bd0-77b0-45cf-9df3-428e4d7da496 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:31.002762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9744bd0-77b0-45cf-9df3-428e4d7da496 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:31.003355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9744bd0-77b0-45cf-9df3-428e4d7da496 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:31.003900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9744bd0-77b0-45cf-9df3-428e4d7da496 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:32.711161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b9d6e365-fcb2-4fef-acb7-f09a64fd1135 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83061653a9bf4487a1ea9778ef5d7951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6a79b860544015b08e7e22a888ee9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:32.720294 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b9d6e365-fcb2-4fef-acb7-f09a64fd1135 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] 10.222.0.16 "GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca" status: 200 len: 1510 microversion: 2.1 time: 1.947884 Sep 07 12:55:32.724574 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2392/4831] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:30 2022] GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca => generated 1510 bytes in 1953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:32.729842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e9744bd0-77b0-45cf-9df3-428e4d7da496 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a08986ff6f4c0592c850b2dabc931b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beea504630b84817b11d85cd03f92215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:32.736908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:32.739350 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e9744bd0-77b0-45cf-9df3-428e4d7da496 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] 10.222.0.16 "GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50" status: 200 len: 1328 microversion: 2.1 time: 1.766145 Sep 07 12:55:32.739731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ea90fa2-779c-4cd8-8b36-be32f9bee715 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:32.739947 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2440/4832] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:30 2022] GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50 => generated 1328 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:32.742044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5ea90fa2-779c-4cd8-8b36-be32f9bee715 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 1b76a312-8d25-432f-913b-2e8be8df9246] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:32.761027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ea90fa2-779c-4cd8-8b36-be32f9bee715 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:32.761694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ea90fa2-779c-4cd8-8b36-be32f9bee715 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:32.762148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ea90fa2-779c-4cd8-8b36-be32f9bee715 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:32.762881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ea90fa2-779c-4cd8-8b36-be32f9bee715 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:32.763334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ea90fa2-779c-4cd8-8b36-be32f9bee715 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:32.763971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ea90fa2-779c-4cd8-8b36-be32f9bee715 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:32.766395 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dcf448ed-dfd2-4c2b-88dc-eaf501e7f61b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:32.767454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dcf448ed-dfd2-4c2b-88dc-eaf501e7f61b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:32.791515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcf448ed-dfd2-4c2b-88dc-eaf501e7f61b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:32.792373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcf448ed-dfd2-4c2b-88dc-eaf501e7f61b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:32.793092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcf448ed-dfd2-4c2b-88dc-eaf501e7f61b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:32.794339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcf448ed-dfd2-4c2b-88dc-eaf501e7f61b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:32.795112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcf448ed-dfd2-4c2b-88dc-eaf501e7f61b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:32.801461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dcf448ed-dfd2-4c2b-88dc-eaf501e7f61b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:32.994234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dcf448ed-dfd2-4c2b-88dc-eaf501e7f61b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:33.024110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dcf448ed-dfd2-4c2b-88dc-eaf501e7f61b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:33.026888 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dcf448ed-dfd2-4c2b-88dc-eaf501e7f61b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:33.028962 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dcf448ed-dfd2-4c2b-88dc-eaf501e7f61b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1605 microversion: 2.32 time: 0.273619 Sep 07 12:55:33.038362 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2441/4833] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:32 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1605 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:33.058297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-662f8c25-eaa8-48d2-9cd1-d1ddde9623d0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:33.059510 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-662f8c25-eaa8-48d2-9cd1-d1ddde9623d0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:33.082063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-662f8c25-eaa8-48d2-9cd1-d1ddde9623d0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:33.083030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-662f8c25-eaa8-48d2-9cd1-d1ddde9623d0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:33.083622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-662f8c25-eaa8-48d2-9cd1-d1ddde9623d0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:33.084869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-662f8c25-eaa8-48d2-9cd1-d1ddde9623d0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:33.085693 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-662f8c25-eaa8-48d2-9cd1-d1ddde9623d0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:33.086417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-662f8c25-eaa8-48d2-9cd1-d1ddde9623d0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:33.402380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5ea90fa2-779c-4cd8-8b36-be32f9bee715 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:33.422679 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5ea90fa2-779c-4cd8-8b36-be32f9bee715 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246" status: 200 len: 1321 microversion: 2.1 time: 0.694515 Sep 07 12:55:33.431857 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2393/4834] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:32 2022] GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246 => generated 1321 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:33.467743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8486beac-e97e-4f09-ab06-bbeb90852c0c tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:33.474900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8486beac-e97e-4f09-ab06-bbeb90852c0c tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:33.505836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:33.513687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8486beac-e97e-4f09-ab06-bbeb90852c0c tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:33.515802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8486beac-e97e-4f09-ab06-bbeb90852c0c tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:33.516677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8486beac-e97e-4f09-ab06-bbeb90852c0c tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:33.522005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8486beac-e97e-4f09-ab06-bbeb90852c0c tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:33.522871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8486beac-e97e-4f09-ab06-bbeb90852c0c tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:33.523823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8486beac-e97e-4f09-ab06-bbeb90852c0c tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:33.526854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=22 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:33.724391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8486beac-e97e-4f09-ab06-bbeb90852c0c tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:33.729850 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-662f8c25-eaa8-48d2-9cd1-d1ddde9623d0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:33.750386 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8486beac-e97e-4f09-ab06-bbeb90852c0c tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1294 microversion: 2.1 time: 0.315870 Sep 07 12:55:33.772651 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2394/4835] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:33 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1294 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:33.778692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-aebb81e6-3068-4e88-af78-c608edbd7d95 req-7c2c0d92-cc69-484b-8a30-2f7a5e3c3021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9352ac2-475e-4c77-aa85-5ecd566563b2", "name": "network-vif-deleted", "tag": "763b76c0-527c-4cf7-87d0-1d9905756999"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:33.790027 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-662f8c25-eaa8-48d2-9cd1-d1ddde9623d0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1502 microversion: 2.1 time: 0.749720 Sep 07 12:55:33.792515 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2442/4836] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:33 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1502 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:33.815850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-aebb81e6-3068-4e88-af78-c608edbd7d95 req-7c2c0d92-cc69-484b-8a30-2f7a5e3c3021 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:33.816363 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-39fa1ea6-6fdc-47cc-b83d-afa4a4f23398 req-f6f227df-2256-4a56-87fa-8928b01040f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a642f02a-a904-4117-8e50-5418e731ff50", "tag": "994f6a7e-ed3d-4aa9-a1a1-f470367499cb"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:33.817222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-aebb81e6-3068-4e88-af78-c608edbd7d95 req-7c2c0d92-cc69-484b-8a30-2f7a5e3c3021 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:33.818089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-aebb81e6-3068-4e88-af78-c608edbd7d95 req-7c2c0d92-cc69-484b-8a30-2f7a5e3c3021 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:33.852371 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-aebb81e6-3068-4e88-af78-c608edbd7d95 req-7c2c0d92-cc69-484b-8a30-2f7a5e3c3021 service nova] Creating event network-vif-deleted:763b76c0-527c-4cf7-87d0-1d9905756999 for instance e9352ac2-475e-4c77-aa85-5ecd566563b2 on n-h2-852087-9 Sep 07 12:55:33.866195 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-aebb81e6-3068-4e88-af78-c608edbd7d95 req-7c2c0d92-cc69-484b-8a30-2f7a5e3c3021 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089954 Sep 07 12:55:33.871173 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2395/4837] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:55:33.876473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-39fa1ea6-6fdc-47cc-b83d-afa4a4f23398 req-f6f227df-2256-4a56-87fa-8928b01040f9 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:33.883292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-39fa1ea6-6fdc-47cc-b83d-afa4a4f23398 req-f6f227df-2256-4a56-87fa-8928b01040f9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:33.884596 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-39fa1ea6-6fdc-47cc-b83d-afa4a4f23398 req-f6f227df-2256-4a56-87fa-8928b01040f9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:33.892515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-93681a80-f69e-458a-acd2-f0758cb9b67a tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:33.895864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-93681a80-f69e-458a-acd2-f0758cb9b67a tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] [instance: e6109fe8-30c8-42a8-b428-8a62e6e34fca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:33.915760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93681a80-f69e-458a-acd2-f0758cb9b67a tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:33.917003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93681a80-f69e-458a-acd2-f0758cb9b67a tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:33.918369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93681a80-f69e-458a-acd2-f0758cb9b67a tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:33.920099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93681a80-f69e-458a-acd2-f0758cb9b67a tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:33.921917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93681a80-f69e-458a-acd2-f0758cb9b67a tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:33.923306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93681a80-f69e-458a-acd2-f0758cb9b67a tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:33.930363 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-39fa1ea6-6fdc-47cc-b83d-afa4a4f23398 req-f6f227df-2256-4a56-87fa-8928b01040f9 service nova] Creating event network-changed:994f6a7e-ed3d-4aa9-a1a1-f470367499cb for instance a642f02a-a904-4117-8e50-5418e731ff50 on n-h2-852087-9 Sep 07 12:55:33.948086 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-39fa1ea6-6fdc-47cc-b83d-afa4a4f23398 req-f6f227df-2256-4a56-87fa-8928b01040f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151928 Sep 07 12:55:33.956718 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2443/4838] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:55:33.982608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf0ff66e-bab0-47a6-98fb-0645ed03cb29 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:33.991130 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cf0ff66e-bab0-47a6-98fb-0645ed03cb29 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] [instance: a642f02a-a904-4117-8e50-5418e731ff50] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:34.002728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0ff66e-bab0-47a6-98fb-0645ed03cb29 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:34.003530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0ff66e-bab0-47a6-98fb-0645ed03cb29 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:34.004230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0ff66e-bab0-47a6-98fb-0645ed03cb29 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:34.005550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0ff66e-bab0-47a6-98fb-0645ed03cb29 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:34.007442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0ff66e-bab0-47a6-98fb-0645ed03cb29 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:34.008380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf0ff66e-bab0-47a6-98fb-0645ed03cb29 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:34.420129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cf0ff66e-bab0-47a6-98fb-0645ed03cb29 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a08986ff6f4c0592c850b2dabc931b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beea504630b84817b11d85cd03f92215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:34.430136 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cf0ff66e-bab0-47a6-98fb-0645ed03cb29 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] 10.222.0.16 "GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50" status: 200 len: 1328 microversion: 2.1 time: 0.463629 Sep 07 12:55:34.436120 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2444/4839] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:33 2022] GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50 => generated 1328 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:34.447731 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4e4e2ea1-dfae-4e06-bd1e-a95950bef9d6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:34.448858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4e4e2ea1-dfae-4e06-bd1e-a95950bef9d6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:34.462866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e4e2ea1-dfae-4e06-bd1e-a95950bef9d6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:34.466855 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e4e2ea1-dfae-4e06-bd1e-a95950bef9d6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:34.467879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e4e2ea1-dfae-4e06-bd1e-a95950bef9d6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:34.469536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e4e2ea1-dfae-4e06-bd1e-a95950bef9d6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:34.471948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e4e2ea1-dfae-4e06-bd1e-a95950bef9d6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:34.472732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e4e2ea1-dfae-4e06-bd1e-a95950bef9d6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:34.483800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-93681a80-f69e-458a-acd2-f0758cb9b67a tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83061653a9bf4487a1ea9778ef5d7951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6a79b860544015b08e7e22a888ee9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:34.495431 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-93681a80-f69e-458a-acd2-f0758cb9b67a tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] 10.222.0.16 "GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca" status: 200 len: 1510 microversion: 2.1 time: 0.621180 Sep 07 12:55:34.498228 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2396/4840] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:33 2022] GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca => generated 1510 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:34.505728 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-884b70b6-46fe-4f04-adfd-b72f3d6e270b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:34.506791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-884b70b6-46fe-4f04-adfd-b72f3d6e270b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:34.516200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:34.518401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-884b70b6-46fe-4f04-adfd-b72f3d6e270b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:34.519104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-884b70b6-46fe-4f04-adfd-b72f3d6e270b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:34.519700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-884b70b6-46fe-4f04-adfd-b72f3d6e270b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:34.520593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-884b70b6-46fe-4f04-adfd-b72f3d6e270b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:34.522355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-884b70b6-46fe-4f04-adfd-b72f3d6e270b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:34.523460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-884b70b6-46fe-4f04-adfd-b72f3d6e270b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:34.645703 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4e4e2ea1-dfae-4e06-bd1e-a95950bef9d6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995/action" status: 202 len: 0 microversion: 2.1 time: 0.206364 Sep 07 12:55:34.651809 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2445/4841] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:55:34 2022] POST /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:55:34.666565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-89e12356-aca0-4615-b06c-9e2ef4d12288 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:34.670580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-89e12356-aca0-4615-b06c-9e2ef4d12288 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 1b76a312-8d25-432f-913b-2e8be8df9246] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:34.680361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:34.688580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-884b70b6-46fe-4f04-adfd-b72f3d6e270b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:34.707947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-884b70b6-46fe-4f04-adfd-b72f3d6e270b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:34.711412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89e12356-aca0-4615-b06c-9e2ef4d12288 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:34.713408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89e12356-aca0-4615-b06c-9e2ef4d12288 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:34.717121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89e12356-aca0-4615-b06c-9e2ef4d12288 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:34.717685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-884b70b6-46fe-4f04-adfd-b72f3d6e270b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:34.724283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89e12356-aca0-4615-b06c-9e2ef4d12288 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:34.725990 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-884b70b6-46fe-4f04-adfd-b72f3d6e270b tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1605 microversion: 2.32 time: 0.226331 Sep 07 12:55:34.727972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89e12356-aca0-4615-b06c-9e2ef4d12288 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:34.728446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89e12356-aca0-4615-b06c-9e2ef4d12288 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:34.732116 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2397/4842] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:34 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1605 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:34.742481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2f704555-ee80-4b0d-bfd8-42fd40476602 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:34.743116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2f704555-ee80-4b0d-bfd8-42fd40476602 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:34.764852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f704555-ee80-4b0d-bfd8-42fd40476602 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:34.765371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f704555-ee80-4b0d-bfd8-42fd40476602 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:34.765857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f704555-ee80-4b0d-bfd8-42fd40476602 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:34.766599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f704555-ee80-4b0d-bfd8-42fd40476602 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:34.770954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f704555-ee80-4b0d-bfd8-42fd40476602 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:34.771433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f704555-ee80-4b0d-bfd8-42fd40476602 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:35.380084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-89e12356-aca0-4615-b06c-9e2ef4d12288 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:35.407488 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-89e12356-aca0-4615-b06c-9e2ef4d12288 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246" status: 200 len: 1321 microversion: 2.1 time: 0.752203 Sep 07 12:55:35.408574 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2446/4843] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:34 2022] GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246 => generated 1321 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:35.452542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a48fd839-6ba4-4048-a816-2e5aea89dc27 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:35.455032 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a48fd839-6ba4-4048-a816-2e5aea89dc27 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:35.465352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a48fd839-6ba4-4048-a816-2e5aea89dc27 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:35.466585 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a48fd839-6ba4-4048-a816-2e5aea89dc27 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:35.467479 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a48fd839-6ba4-4048-a816-2e5aea89dc27 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:35.468996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a48fd839-6ba4-4048-a816-2e5aea89dc27 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:35.469959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a48fd839-6ba4-4048-a816-2e5aea89dc27 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:35.470813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a48fd839-6ba4-4048-a816-2e5aea89dc27 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:35.545590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2f704555-ee80-4b0d-bfd8-42fd40476602 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:35.560445 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2f704555-ee80-4b0d-bfd8-42fd40476602 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1507 microversion: 2.1 time: 0.826759 Sep 07 12:55:35.561964 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2398/4844] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:34 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1507 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:35.571408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9b8af145-b613-4eee-8987-a7ad5310e965 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:35.572901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9b8af145-b613-4eee-8987-a7ad5310e965 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] [instance: a642f02a-a904-4117-8e50-5418e731ff50] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:35.584251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b8af145-b613-4eee-8987-a7ad5310e965 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:35.585475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b8af145-b613-4eee-8987-a7ad5310e965 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:35.586538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b8af145-b613-4eee-8987-a7ad5310e965 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:35.588098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b8af145-b613-4eee-8987-a7ad5310e965 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:35.589425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b8af145-b613-4eee-8987-a7ad5310e965 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:35.590474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b8af145-b613-4eee-8987-a7ad5310e965 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:36.203865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a48fd839-6ba4-4048-a816-2e5aea89dc27 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:36.233880 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a48fd839-6ba4-4048-a816-2e5aea89dc27 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1362 microversion: 2.1 time: 0.787925 Sep 07 12:55:36.235242 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2447/4845] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:35 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1362 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:36.254891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9b8af145-b613-4eee-8987-a7ad5310e965 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a08986ff6f4c0592c850b2dabc931b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beea504630b84817b11d85cd03f92215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:36.266203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f26109fd-af6a-48db-bfd6-8c3b72aa9806 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:36.273942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f26109fd-af6a-48db-bfd6-8c3b72aa9806 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] [instance: e6109fe8-30c8-42a8-b428-8a62e6e34fca] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:36.287849 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9b8af145-b613-4eee-8987-a7ad5310e965 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] 10.222.0.16 "GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50" status: 200 len: 1328 microversion: 2.1 time: 0.719328 Sep 07 12:55:36.292696 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2399/4846] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:35 2022] GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50 => generated 1328 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:36.302921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f26109fd-af6a-48db-bfd6-8c3b72aa9806 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:36.304358 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f26109fd-af6a-48db-bfd6-8c3b72aa9806 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:36.310151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f26109fd-af6a-48db-bfd6-8c3b72aa9806 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:36.312439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f26109fd-af6a-48db-bfd6-8c3b72aa9806 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:36.313675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f26109fd-af6a-48db-bfd6-8c3b72aa9806 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:36.314796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f26109fd-af6a-48db-bfd6-8c3b72aa9806 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:36.319068 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8c33ecb9-3788-4c0f-a98f-6adc21acfd8a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:36.319833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8c33ecb9-3788-4c0f-a98f-6adc21acfd8a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:36.333838 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c33ecb9-3788-4c0f-a98f-6adc21acfd8a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:36.335010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c33ecb9-3788-4c0f-a98f-6adc21acfd8a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:36.337161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c33ecb9-3788-4c0f-a98f-6adc21acfd8a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:36.338500 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c33ecb9-3788-4c0f-a98f-6adc21acfd8a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:36.339359 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c33ecb9-3788-4c0f-a98f-6adc21acfd8a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:36.340028 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c33ecb9-3788-4c0f-a98f-6adc21acfd8a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:36.518749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f26109fd-af6a-48db-bfd6-8c3b72aa9806 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83061653a9bf4487a1ea9778ef5d7951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6a79b860544015b08e7e22a888ee9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:36.538219 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f26109fd-af6a-48db-bfd6-8c3b72aa9806 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] 10.222.0.16 "GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca" status: 200 len: 1301 microversion: 2.1 time: 0.292932 Sep 07 12:55:36.539528 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2448/4847] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:36 2022] GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca => generated 1301 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:36.551783 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-b3cec27f-3ca1-463a-a081-353056627242 req-96650777-14ea-4258-b98b-bce472aedcbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6109fe8-30c8-42a8-b428-8a62e6e34fca", "name": "network-vif-deleted", "tag": "c50827f8-5fd6-4c3c-80e1-41032a36b97c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:36.586299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b3cec27f-3ca1-463a-a081-353056627242 req-96650777-14ea-4258-b98b-bce472aedcbf service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:36.587191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b3cec27f-3ca1-463a-a081-353056627242 req-96650777-14ea-4258-b98b-bce472aedcbf service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:36.588181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b3cec27f-3ca1-463a-a081-353056627242 req-96650777-14ea-4258-b98b-bce472aedcbf service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:36.611724 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-b3cec27f-3ca1-463a-a081-353056627242 req-96650777-14ea-4258-b98b-bce472aedcbf service nova] Creating event network-vif-deleted:c50827f8-5fd6-4c3c-80e1-41032a36b97c for instance e6109fe8-30c8-42a8-b428-8a62e6e34fca on n-h1-852087-9 Sep 07 12:55:36.621236 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-b3cec27f-3ca1-463a-a081-353056627242 req-96650777-14ea-4258-b98b-bce472aedcbf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079269 Sep 07 12:55:36.623029 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2449/4848] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:55:36.634698 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3a801cc0-dab6-4f7c-801a-4f39013481d9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:36.636403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3a801cc0-dab6-4f7c-801a-4f39013481d9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 1b76a312-8d25-432f-913b-2e8be8df9246] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:36.650477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a801cc0-dab6-4f7c-801a-4f39013481d9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:36.651785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a801cc0-dab6-4f7c-801a-4f39013481d9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:36.652846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a801cc0-dab6-4f7c-801a-4f39013481d9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:36.654476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a801cc0-dab6-4f7c-801a-4f39013481d9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:36.655613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a801cc0-dab6-4f7c-801a-4f39013481d9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:36.656719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a801cc0-dab6-4f7c-801a-4f39013481d9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:36.683485 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8c33ecb9-3788-4c0f-a98f-6adc21acfd8a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:36.707399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8c33ecb9-3788-4c0f-a98f-6adc21acfd8a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:36.717104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8c33ecb9-3788-4c0f-a98f-6adc21acfd8a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:36.721619 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8c33ecb9-3788-4c0f-a98f-6adc21acfd8a tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1605 microversion: 2.32 time: 0.425526 Sep 07 12:55:36.722537 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2400/4849] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:36 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1605 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:36.754836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ea864b6-ca62-483e-9060-9c749f890298 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:36.757014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6ea864b6-ca62-483e-9060-9c749f890298 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:36.772268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea864b6-ca62-483e-9060-9c749f890298 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:36.774201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea864b6-ca62-483e-9060-9c749f890298 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:36.774658 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea864b6-ca62-483e-9060-9c749f890298 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:36.775413 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea864b6-ca62-483e-9060-9c749f890298 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:36.775902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea864b6-ca62-483e-9060-9c749f890298 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:36.776390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ea864b6-ca62-483e-9060-9c749f890298 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:36.890832 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:37.117749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3a801cc0-dab6-4f7c-801a-4f39013481d9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:37.143588 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3a801cc0-dab6-4f7c-801a-4f39013481d9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246" status: 200 len: 1321 microversion: 2.1 time: 0.518374 Sep 07 12:55:37.152365 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2450/4850] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:36 2022] GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246 => generated 1321 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:37.212911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-40f774f5-193f-4876-bab9-bd9b687ce9fc req-2562a9b0-a322-4e32-9f14-d6c76b896cae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f37444bc-ff3d-40dd-8501-7b8794d8b1ef", "tag": "f71d91c1-fd88-4617-a671-95e43e01a47c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:37.238741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-40f774f5-193f-4876-bab9-bd9b687ce9fc req-2562a9b0-a322-4e32-9f14-d6c76b896cae service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:37.242890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-40f774f5-193f-4876-bab9-bd9b687ce9fc req-2562a9b0-a322-4e32-9f14-d6c76b896cae service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:37.243545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-40f774f5-193f-4876-bab9-bd9b687ce9fc req-2562a9b0-a322-4e32-9f14-d6c76b896cae service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:37.279558 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-40f774f5-193f-4876-bab9-bd9b687ce9fc req-2562a9b0-a322-4e32-9f14-d6c76b896cae service nova] Creating event network-changed:f71d91c1-fd88-4617-a671-95e43e01a47c for instance f37444bc-ff3d-40dd-8501-7b8794d8b1ef on n-h2-852087-9 Sep 07 12:55:37.286600 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-40f774f5-193f-4876-bab9-bd9b687ce9fc req-2562a9b0-a322-4e32-9f14-d6c76b896cae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077136 Sep 07 12:55:37.288984 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2451/4851] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:55:37.297463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d68e9c95-6980-456b-b491-2116f3657e2d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:37.298650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d68e9c95-6980-456b-b491-2116f3657e2d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:37.312040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d68e9c95-6980-456b-b491-2116f3657e2d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:37.313321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d68e9c95-6980-456b-b491-2116f3657e2d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:37.314377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d68e9c95-6980-456b-b491-2116f3657e2d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:37.316422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d68e9c95-6980-456b-b491-2116f3657e2d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:37.317233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d68e9c95-6980-456b-b491-2116f3657e2d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:37.318936 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d68e9c95-6980-456b-b491-2116f3657e2d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:37.346617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6ea864b6-ca62-483e-9060-9c749f890298 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:37.374791 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6ea864b6-ca62-483e-9060-9c749f890298 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1487 microversion: 2.1 time: 0.632218 Sep 07 12:55:37.376115 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2401/4852] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:36 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1487 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:37.407805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e4b828b8-7886-4009-9fde-b01b52ef74be tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:37.408952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e4b828b8-7886-4009-9fde-b01b52ef74be tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] [instance: a642f02a-a904-4117-8e50-5418e731ff50] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:37.424026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4b828b8-7886-4009-9fde-b01b52ef74be tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:37.425274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4b828b8-7886-4009-9fde-b01b52ef74be tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:37.426470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4b828b8-7886-4009-9fde-b01b52ef74be tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:37.428234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4b828b8-7886-4009-9fde-b01b52ef74be tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:37.429339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4b828b8-7886-4009-9fde-b01b52ef74be tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:37.430366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4b828b8-7886-4009-9fde-b01b52ef74be tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:37.656722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d68e9c95-6980-456b-b491-2116f3657e2d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:37.688812 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d68e9c95-6980-456b-b491-2116f3657e2d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1362 microversion: 2.1 time: 0.397391 Sep 07 12:55:37.702595 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2452/4853] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:37 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1362 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:37.707985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2d5700bc-4331-4738-b4fb-ac70d399c567 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:37.708880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2d5700bc-4331-4738-b4fb-ac70d399c567 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:37.717876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d5700bc-4331-4738-b4fb-ac70d399c567 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:37.718400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d5700bc-4331-4738-b4fb-ac70d399c567 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:37.718879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d5700bc-4331-4738-b4fb-ac70d399c567 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:37.719799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d5700bc-4331-4738-b4fb-ac70d399c567 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:37.720327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d5700bc-4331-4738-b4fb-ac70d399c567 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:37.720770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2d5700bc-4331-4738-b4fb-ac70d399c567 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:37.727034 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e4b828b8-7886-4009-9fde-b01b52ef74be tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a08986ff6f4c0592c850b2dabc931b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beea504630b84817b11d85cd03f92215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:37.745723 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e4b828b8-7886-4009-9fde-b01b52ef74be tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] 10.222.0.16 "GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50" status: 200 len: 1328 microversion: 2.1 time: 0.367264 Sep 07 12:55:37.757654 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2402/4854] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:37 2022] GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50 => generated 1328 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:37.757654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d06b31ea-8f8b-4eec-9f38-ee1a74846ea5 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:37.758129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d06b31ea-8f8b-4eec-9f38-ee1a74846ea5 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] [instance: e6109fe8-30c8-42a8-b428-8a62e6e34fca] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:37.769949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-2d5700bc-4331-4738-b4fb-ac70d399c567 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lazy-loading 'flavor' on Instance uuid 812b8c7f-9408-4862-a000-4b444babe995 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:55:37.780002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d06b31ea-8f8b-4eec-9f38-ee1a74846ea5 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:37.781478 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d06b31ea-8f8b-4eec-9f38-ee1a74846ea5 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:37.783100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d06b31ea-8f8b-4eec-9f38-ee1a74846ea5 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:37.785151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d06b31ea-8f8b-4eec-9f38-ee1a74846ea5 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:37.785923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d06b31ea-8f8b-4eec-9f38-ee1a74846ea5 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:37.786556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d06b31ea-8f8b-4eec-9f38-ee1a74846ea5 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:37.808313 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-d06b31ea-8f8b-4eec-9f38-ee1a74846ea5 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] HTTP exception thrown: Instance e6109fe8-30c8-42a8-b428-8a62e6e34fca could not be found. Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d06b31ea-8f8b-4eec-9f38-ee1a74846ea5 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Request method failure captured: Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca HTTP/1.1 Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJSJ9ByF9cA0mkPb5BqJdkXhYEztG0tndmjvP5IJuZQ3obULtGorGvEYbzSe3HwGZPvULlOJWrgUSiw0AF-QRt4ZgVACCd5KsYGZrJo3hcR093KuSAbDgYW3XSWmBl00pDjBlygraZz73Wo2DeTYv-F8SDHaAsBEHP5klTgjKFp2U6I Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 4e6a79b860544015b08e7e22a888ee9a Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-InstanceActionsTestJSON-1260398438 Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4e6a79b860544015b08e7e22a888ee9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4e6a79b860544015b08e7e22a888ee9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4e6a79b860544015b08e7e22a888ee9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4e6a79b860544015b08e7e22a888ee9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-InstanceActionsTestJSON-1260398438 Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 4e6a79b860544015b08e7e22a888ee9a Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1260398438 Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-InstanceActionsTestJSON-1260398438-project Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 83061653a9bf4487a1ea9778ef5d7951 Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-InstanceActionsTestJSON-1260398438-project Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance e6109fe8-30c8-42a8-b428-8a62e6e34fca could not be found. Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'e6109fe8-30c8-42a8-b428-8a62e6e34fca'} Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6109fe8-30c8-42a8-b428-8a62e6e34fca could not be found. Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6109fe8-30c8-42a8-b428-8a62e6e34fca could not be found. Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:55:37.810573 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:55:37.819064 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:55:37.819064 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:55:37.819064 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:55:37.819064 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:55:37.819064 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:55:37.819064 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6109fe8-30c8-42a8-b428-8a62e6e34fca could not be found. Sep 07 12:55:37.819064 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:55:37.819064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d06b31ea-8f8b-4eec-9f38-ee1a74846ea5 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] Returning 404 to user: Instance e6109fe8-30c8-42a8-b428-8a62e6e34fca could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:55:37.819064 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d06b31ea-8f8b-4eec-9f38-ee1a74846ea5 tempest-InstanceActionsTestJSON-1260398438 tempest-InstanceActionsTestJSON-1260398438-project] 10.222.0.16 "GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca" status: 404 len: 111 microversion: 2.1 time: 0.059674 Sep 07 12:55:37.819064 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2403/4855] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:37 2022] GET /compute/v2.1/servers/e6109fe8-30c8-42a8-b428-8a62e6e34fca => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:55:37.824682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0b7dfa14-d063-4f83-bf91-6dd767e22161 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-771184653", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cbe13b8b-97d8-4e5e-bde8-fa59eb5ebba9"}], "security_groups": [{"name": "tempest-securitygroup--243319870"}], "key_name": "tempest-keypair-706282161", "user_data": "}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:38.017820 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-0b7dfa14-d063-4f83-bf91-6dd767e22161 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] validate_networks() for [('cbe13b8b-97d8-4e5e-bde8-fa59eb5ebba9', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:55:38.152270 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2d5700bc-4331-4738-b4fb-ac70d399c567 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995/action" status: 202 len: 0 microversion: 2.1 time: 0.448004 Sep 07 12:55:38.156607 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2453/4856] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:55:37 2022] POST /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:55:38.167121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-30f0adf6-7a38-48d6-8b61-8c85eb5fdfee tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:38.168522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-30f0adf6-7a38-48d6-8b61-8c85eb5fdfee tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:38.180437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30f0adf6-7a38-48d6-8b61-8c85eb5fdfee tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:38.180707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30f0adf6-7a38-48d6-8b61-8c85eb5fdfee tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:38.181225 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30f0adf6-7a38-48d6-8b61-8c85eb5fdfee tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:38.182022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30f0adf6-7a38-48d6-8b61-8c85eb5fdfee tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:38.182586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30f0adf6-7a38-48d6-8b61-8c85eb5fdfee tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:38.183089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30f0adf6-7a38-48d6-8b61-8c85eb5fdfee tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:38.376606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-30f0adf6-7a38-48d6-8b61-8c85eb5fdfee tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:38.392117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-30f0adf6-7a38-48d6-8b61-8c85eb5fdfee tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:38.394423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-30f0adf6-7a38-48d6-8b61-8c85eb5fdfee tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:38.396071 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-30f0adf6-7a38-48d6-8b61-8c85eb5fdfee tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1605 microversion: 2.32 time: 0.240344 Sep 07 12:55:38.398117 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2454/4857] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:38 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1605 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:38.404447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-637f87c7-09b1-4a2b-8d12-08c377286173 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:38.405429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-637f87c7-09b1-4a2b-8d12-08c377286173 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:38.415631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-637f87c7-09b1-4a2b-8d12-08c377286173 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:38.416614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-637f87c7-09b1-4a2b-8d12-08c377286173 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:38.417329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-637f87c7-09b1-4a2b-8d12-08c377286173 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:38.420974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-637f87c7-09b1-4a2b-8d12-08c377286173 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:38.422439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-637f87c7-09b1-4a2b-8d12-08c377286173 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:38.423413 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-637f87c7-09b1-4a2b-8d12-08c377286173 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:38.482096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=10 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:39.735851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-637f87c7-09b1-4a2b-8d12-08c377286173 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:39.746363 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-637f87c7-09b1-4a2b-8d12-08c377286173 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1493 microversion: 2.1 time: 1.346265 Sep 07 12:55:39.753436 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2455/4858] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:38 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1493 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:39.770969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f1f24bd4-5ffa-4640-be44-3dec343d64ed tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:39.772101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f1f24bd4-5ffa-4640-be44-3dec343d64ed tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 1b76a312-8d25-432f-913b-2e8be8df9246] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:39.783801 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1f24bd4-5ffa-4640-be44-3dec343d64ed tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:39.788681 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1f24bd4-5ffa-4640-be44-3dec343d64ed tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:39.789810 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1f24bd4-5ffa-4640-be44-3dec343d64ed tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:39.791040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1f24bd4-5ffa-4640-be44-3dec343d64ed tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:39.794533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1f24bd4-5ffa-4640-be44-3dec343d64ed tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:39.798652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f1f24bd4-5ffa-4640-be44-3dec343d64ed tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:39.876556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:40.167492 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0b7dfa14-d063-4f83-bf91-6dd767e22161 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:55:40.168937 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0b7dfa14-d063-4f83-bf91-6dd767e22161 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:55:40.170010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0b7dfa14-d063-4f83-bf91-6dd767e22161 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:55:40.170721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0b7dfa14-d063-4f83-bf91-6dd767e22161 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:55:40.171363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-0b7dfa14-d063-4f83-bf91-6dd767e22161 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:55:40.197266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b7dfa14-d063-4f83-bf91-6dd767e22161 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:40.205330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b7dfa14-d063-4f83-bf91-6dd767e22161 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:40.206612 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b7dfa14-d063-4f83-bf91-6dd767e22161 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:40.207749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b7dfa14-d063-4f83-bf91-6dd767e22161 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:40.208493 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b7dfa14-d063-4f83-bf91-6dd767e22161 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:40.209535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b7dfa14-d063-4f83-bf91-6dd767e22161 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:40.307014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-0b7dfa14-d063-4f83-bf91-6dd767e22161 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Getting quotas for project fdbe65a861ac4b9ea7e5c2bbd4d955b3. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:55:40.314155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-0b7dfa14-d063-4f83-bf91-6dd767e22161 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Getting quotas for user 9e1c3623bbda4cbdbf6b5d2dedb48f74 and project fdbe65a861ac4b9ea7e5c2bbd4d955b3. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:55:40.355222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0b7dfa14-d063-4f83-bf91-6dd767e22161 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:55:40.379389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0b7dfa14-d063-4f83-bf91-6dd767e22161 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:55:40.569472 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0b7dfa14-d063-4f83-bf91-6dd767e22161 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.754126 Sep 07 12:55:40.591560 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2404/4859] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Sep 7 12:55:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 2777 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 12:55:40.604289 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f1f24bd4-5ffa-4640-be44-3dec343d64ed tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:40.614672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-82e035fd-8cfe-4c39-9cea-a84c227fc067 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:40.615663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-82e035fd-8cfe-4c39-9cea-a84c227fc067 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:40.644160 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f1f24bd4-5ffa-4640-be44-3dec343d64ed tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246" status: 200 len: 1321 microversion: 2.1 time: 0.888656 Sep 07 12:55:40.675782 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2456/4860] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:39 2022] GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246 => generated 1321 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:40.689598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82e035fd-8cfe-4c39-9cea-a84c227fc067 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:40.690500 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82e035fd-8cfe-4c39-9cea-a84c227fc067 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:40.691293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82e035fd-8cfe-4c39-9cea-a84c227fc067 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:40.692921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82e035fd-8cfe-4c39-9cea-a84c227fc067 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:40.698039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82e035fd-8cfe-4c39-9cea-a84c227fc067 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:40.699193 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82e035fd-8cfe-4c39-9cea-a84c227fc067 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:40.700558 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-605a7cfe-74c0-4e8e-bdfe-d94fdeb2f21a tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:40.705520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-605a7cfe-74c0-4e8e-bdfe-d94fdeb2f21a tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] [instance: a642f02a-a904-4117-8e50-5418e731ff50] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:40.734328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-605a7cfe-74c0-4e8e-bdfe-d94fdeb2f21a tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:40.734903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-605a7cfe-74c0-4e8e-bdfe-d94fdeb2f21a tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:40.740866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-605a7cfe-74c0-4e8e-bdfe-d94fdeb2f21a tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:40.743749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-605a7cfe-74c0-4e8e-bdfe-d94fdeb2f21a tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:40.746521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-605a7cfe-74c0-4e8e-bdfe-d94fdeb2f21a tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:40.752815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-605a7cfe-74c0-4e8e-bdfe-d94fdeb2f21a tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:41.497853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-82e035fd-8cfe-4c39-9cea-a84c227fc067 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:41.536724 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-82e035fd-8cfe-4c39-9cea-a84c227fc067 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1362 microversion: 2.1 time: 0.942590 Sep 07 12:55:41.538045 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2405/4861] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:40 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1362 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:41.561923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b6b8cd75-c368-40d7-995a-e2fd7b7235f5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:41.563313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b6b8cd75-c368-40d7-995a-e2fd7b7235f5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:41.587840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6b8cd75-c368-40d7-995a-e2fd7b7235f5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:41.589178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6b8cd75-c368-40d7-995a-e2fd7b7235f5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:41.592640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6b8cd75-c368-40d7-995a-e2fd7b7235f5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:41.594310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6b8cd75-c368-40d7-995a-e2fd7b7235f5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:41.605239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6b8cd75-c368-40d7-995a-e2fd7b7235f5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:41.606387 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6b8cd75-c368-40d7-995a-e2fd7b7235f5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:41.823462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b6b8cd75-c368-40d7-995a-e2fd7b7235f5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:41.832271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-605a7cfe-74c0-4e8e-bdfe-d94fdeb2f21a tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a08986ff6f4c0592c850b2dabc931b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beea504630b84817b11d85cd03f92215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:41.872372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b6b8cd75-c368-40d7-995a-e2fd7b7235f5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:41.874390 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-605a7cfe-74c0-4e8e-bdfe-d94fdeb2f21a tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] 10.222.0.16 "GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50" status: 200 len: 1328 microversion: 2.1 time: 1.193277 Sep 07 12:55:41.875751 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2457/4862] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:40 2022] GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50 => generated 1328 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:41.892645 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e4a66c1c-8e67-4217-a6be-0b3056e170f6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:41.894635 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e4a66c1c-8e67-4217-a6be-0b3056e170f6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:41.899145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b6b8cd75-c368-40d7-995a-e2fd7b7235f5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:41.900624 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b6b8cd75-c368-40d7-995a-e2fd7b7235f5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1605 microversion: 2.32 time: 0.359873 Sep 07 12:55:41.906570 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2406/4863] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:41 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1605 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:41.913581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8f23caf0-a5d6-4c91-a91e-41f01ea037d8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:41.918625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8f23caf0-a5d6-4c91-a91e-41f01ea037d8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:41.919978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4a66c1c-8e67-4217-a6be-0b3056e170f6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:41.921249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4a66c1c-8e67-4217-a6be-0b3056e170f6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:41.922390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4a66c1c-8e67-4217-a6be-0b3056e170f6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:41.923940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4a66c1c-8e67-4217-a6be-0b3056e170f6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:41.925275 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4a66c1c-8e67-4217-a6be-0b3056e170f6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:41.926352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4a66c1c-8e67-4217-a6be-0b3056e170f6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:41.942166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f23caf0-a5d6-4c91-a91e-41f01ea037d8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:41.948489 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f23caf0-a5d6-4c91-a91e-41f01ea037d8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:41.949996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f23caf0-a5d6-4c91-a91e-41f01ea037d8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:41.951772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f23caf0-a5d6-4c91-a91e-41f01ea037d8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:41.955662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f23caf0-a5d6-4c91-a91e-41f01ea037d8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:41.957027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f23caf0-a5d6-4c91-a91e-41f01ea037d8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:41.976610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:42.248904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e4a66c1c-8e67-4217-a6be-0b3056e170f6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:42.281377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e4a66c1c-8e67-4217-a6be-0b3056e170f6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:42.291440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e4a66c1c-8e67-4217-a6be-0b3056e170f6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:42.299486 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e4a66c1c-8e67-4217-a6be-0b3056e170f6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1284 microversion: 2.20 time: 0.418379 Sep 07 12:55:42.302396 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2458/4864] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:41 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1284 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:42.338753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-64d3c03a-c23b-4e0e-a768-de4fc3929ce2 req-744d796a-ee2a-4d96-b955-616def356c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b76a312-8d25-432f-913b-2e8be8df9246", "name": "network-vif-plugged", "status": "completed", "tag": "7a67b18f-9508-47b8-b212-f42631849d0b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:42.384331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-64d3c03a-c23b-4e0e-a768-de4fc3929ce2 req-744d796a-ee2a-4d96-b955-616def356c51 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:42.392545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-64d3c03a-c23b-4e0e-a768-de4fc3929ce2 req-744d796a-ee2a-4d96-b955-616def356c51 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:42.398896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-64d3c03a-c23b-4e0e-a768-de4fc3929ce2 req-744d796a-ee2a-4d96-b955-616def356c51 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:42.449345 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-64d3c03a-c23b-4e0e-a768-de4fc3929ce2 req-744d796a-ee2a-4d96-b955-616def356c51 service nova] Creating event network-vif-plugged:7a67b18f-9508-47b8-b212-f42631849d0b for instance 1b76a312-8d25-432f-913b-2e8be8df9246 on n-h1-852087-9 Sep 07 12:55:42.459666 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-64d3c03a-c23b-4e0e-a768-de4fc3929ce2 req-744d796a-ee2a-4d96-b955-616def356c51 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154473 Sep 07 12:55:42.461623 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2459/4865] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:55:42.473079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aaecc87a-5890-40a3-8bb2-ff856a46b244 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:42.474827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aaecc87a-5890-40a3-8bb2-ff856a46b244 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 1b76a312-8d25-432f-913b-2e8be8df9246] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:42.488343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aaecc87a-5890-40a3-8bb2-ff856a46b244 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:42.492305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aaecc87a-5890-40a3-8bb2-ff856a46b244 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:42.493215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aaecc87a-5890-40a3-8bb2-ff856a46b244 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:42.497835 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aaecc87a-5890-40a3-8bb2-ff856a46b244 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:42.498577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aaecc87a-5890-40a3-8bb2-ff856a46b244 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:42.499511 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aaecc87a-5890-40a3-8bb2-ff856a46b244 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:42.564776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8f23caf0-a5d6-4c91-a91e-41f01ea037d8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:42.603052 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8f23caf0-a5d6-4c91-a91e-41f01ea037d8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1514 microversion: 2.1 time: 0.695070 Sep 07 12:55:42.607181 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2407/4866] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:41 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1514 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:42.614410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e421256f-1b7d-4b88-a65f-995b586999a4 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:42.623199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e421256f-1b7d-4b88-a65f-995b586999a4 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:42.639580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e421256f-1b7d-4b88-a65f-995b586999a4 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:42.642376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e421256f-1b7d-4b88-a65f-995b586999a4 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:42.643039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e421256f-1b7d-4b88-a65f-995b586999a4 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:42.643925 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e421256f-1b7d-4b88-a65f-995b586999a4 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:42.649109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e421256f-1b7d-4b88-a65f-995b586999a4 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:42.649856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e421256f-1b7d-4b88-a65f-995b586999a4 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:43.136398 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aaecc87a-5890-40a3-8bb2-ff856a46b244 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:43.149943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e421256f-1b7d-4b88-a65f-995b586999a4 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:43.182659 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e421256f-1b7d-4b88-a65f-995b586999a4 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1362 microversion: 2.1 time: 0.573769 Sep 07 12:55:43.183277 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2408/4867] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:42 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1362 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:43.197980 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aaecc87a-5890-40a3-8bb2-ff856a46b244 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246" status: 200 len: 1321 microversion: 2.1 time: 0.721752 Sep 07 12:55:43.200284 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2460/4868] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:42 2022] GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246 => generated 1321 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:43.216317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0c76b981-773e-4d84-b997-b636efb2de08 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:43.216996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0c76b981-773e-4d84-b997-b636efb2de08 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:43.222339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-73c0e588-f10d-4f9d-bc20-8f55c3656155 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:43.222988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-73c0e588-f10d-4f9d-bc20-8f55c3656155 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] [instance: a642f02a-a904-4117-8e50-5418e731ff50] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:43.244360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c76b981-773e-4d84-b997-b636efb2de08 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:43.244955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c76b981-773e-4d84-b997-b636efb2de08 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:43.245394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c76b981-773e-4d84-b997-b636efb2de08 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:43.246174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c76b981-773e-4d84-b997-b636efb2de08 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:43.246646 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c76b981-773e-4d84-b997-b636efb2de08 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:43.247075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c76b981-773e-4d84-b997-b636efb2de08 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:43.250623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73c0e588-f10d-4f9d-bc20-8f55c3656155 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:43.251244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73c0e588-f10d-4f9d-bc20-8f55c3656155 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:43.251945 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73c0e588-f10d-4f9d-bc20-8f55c3656155 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:43.253102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73c0e588-f10d-4f9d-bc20-8f55c3656155 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:43.253590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73c0e588-f10d-4f9d-bc20-8f55c3656155 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:43.253969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73c0e588-f10d-4f9d-bc20-8f55c3656155 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:43.526721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0c76b981-773e-4d84-b997-b636efb2de08 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:43.579750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0c76b981-773e-4d84-b997-b636efb2de08 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:43.583744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0c76b981-773e-4d84-b997-b636efb2de08 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:43.586877 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0c76b981-773e-4d84-b997-b636efb2de08 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1605 microversion: 2.32 time: 0.386461 Sep 07 12:55:43.588714 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2461/4869] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:43 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1605 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:43.597749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1202abfd-ce68-4ac3-859f-ee913f4a9245 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:43.599180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1202abfd-ce68-4ac3-859f-ee913f4a9245 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:43.613438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1202abfd-ce68-4ac3-859f-ee913f4a9245 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:43.615041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1202abfd-ce68-4ac3-859f-ee913f4a9245 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:43.616197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1202abfd-ce68-4ac3-859f-ee913f4a9245 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:43.617583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1202abfd-ce68-4ac3-859f-ee913f4a9245 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:43.618660 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1202abfd-ce68-4ac3-859f-ee913f4a9245 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:43.619740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1202abfd-ce68-4ac3-859f-ee913f4a9245 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:44.063235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1202abfd-ce68-4ac3-859f-ee913f4a9245 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:44.103371 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1202abfd-ce68-4ac3-859f-ee913f4a9245 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:44.117680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1202abfd-ce68-4ac3-859f-ee913f4a9245 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:44.119931 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1202abfd-ce68-4ac3-859f-ee913f4a9245 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1332 microversion: 2.20 time: 0.528818 Sep 07 12:55:44.125972 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2462/4870] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:43 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1332 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:44.139586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-854efaaf-6274-4a14-bdae-69fb1747b195 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:44.148357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-854efaaf-6274-4a14-bdae-69fb1747b195 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:44.162328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-73c0e588-f10d-4f9d-bc20-8f55c3656155 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a08986ff6f4c0592c850b2dabc931b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beea504630b84817b11d85cd03f92215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:44.195923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-854efaaf-6274-4a14-bdae-69fb1747b195 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:44.196736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-854efaaf-6274-4a14-bdae-69fb1747b195 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:44.201235 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-73c0e588-f10d-4f9d-bc20-8f55c3656155 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] 10.222.0.16 "GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50" status: 200 len: 1328 microversion: 2.1 time: 1.016483 Sep 07 12:55:44.211080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-854efaaf-6274-4a14-bdae-69fb1747b195 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:44.212847 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-854efaaf-6274-4a14-bdae-69fb1747b195 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:44.213435 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2409/4871] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:43 2022] GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50 => generated 1328 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:44.217235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-854efaaf-6274-4a14-bdae-69fb1747b195 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:44.218895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-854efaaf-6274-4a14-bdae-69fb1747b195 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:44.232280 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-328d5e96-de2a-4bca-a257-e1d36953faec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:44.239424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-328d5e96-de2a-4bca-a257-e1d36953faec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 1b76a312-8d25-432f-913b-2e8be8df9246] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:44.266755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-328d5e96-de2a-4bca-a257-e1d36953faec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:44.267823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-328d5e96-de2a-4bca-a257-e1d36953faec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:44.268676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-328d5e96-de2a-4bca-a257-e1d36953faec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:44.274346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-328d5e96-de2a-4bca-a257-e1d36953faec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:44.275204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-328d5e96-de2a-4bca-a257-e1d36953faec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:44.276006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-328d5e96-de2a-4bca-a257-e1d36953faec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:45.081626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-328d5e96-de2a-4bca-a257-e1d36953faec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:45.124675 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-328d5e96-de2a-4bca-a257-e1d36953faec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246" status: 200 len: 1321 microversion: 2.1 time: 0.908241 Sep 07 12:55:45.145084 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2410/4872] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:44 2022] GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246 => generated 1321 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:45.174592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fb1f4aac-c839-423a-8b4f-26c74f970595 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:45.182566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fb1f4aac-c839-423a-8b4f-26c74f970595 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:45.223180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb1f4aac-c839-423a-8b4f-26c74f970595 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:45.224692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb1f4aac-c839-423a-8b4f-26c74f970595 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:45.226829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb1f4aac-c839-423a-8b4f-26c74f970595 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:45.229553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb1f4aac-c839-423a-8b4f-26c74f970595 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:45.230810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb1f4aac-c839-423a-8b4f-26c74f970595 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:45.231854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb1f4aac-c839-423a-8b4f-26c74f970595 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:45.248788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-854efaaf-6274-4a14-bdae-69fb1747b195 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:45.267092 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-854efaaf-6274-4a14-bdae-69fb1747b195 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1509 microversion: 2.1 time: 1.139411 Sep 07 12:55:45.267893 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2463/4873] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:44 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1509 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:45.290297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c0c7a3e1-29cf-4d62-ae26-645d587f228f req-94a7ae3c-922d-4a0e-8926-2beae1dc5dbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a642f02a-a904-4117-8e50-5418e731ff50", "name": "network-vif-plugged", "status": "completed", "tag": "994f6a7e-ed3d-4aa9-a1a1-f470367499cb"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:45.337265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c0c7a3e1-29cf-4d62-ae26-645d587f228f req-94a7ae3c-922d-4a0e-8926-2beae1dc5dbe service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:45.337907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c0c7a3e1-29cf-4d62-ae26-645d587f228f req-94a7ae3c-922d-4a0e-8926-2beae1dc5dbe service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:45.338597 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c0c7a3e1-29cf-4d62-ae26-645d587f228f req-94a7ae3c-922d-4a0e-8926-2beae1dc5dbe service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:45.363876 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c0c7a3e1-29cf-4d62-ae26-645d587f228f req-94a7ae3c-922d-4a0e-8926-2beae1dc5dbe service nova] Creating event network-vif-plugged:994f6a7e-ed3d-4aa9-a1a1-f470367499cb for instance a642f02a-a904-4117-8e50-5418e731ff50 on n-h2-852087-9 Sep 07 12:55:45.382125 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c0c7a3e1-29cf-4d62-ae26-645d587f228f req-94a7ae3c-922d-4a0e-8926-2beae1dc5dbe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112886 Sep 07 12:55:45.383015 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2464/4874] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:55:45.396492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a31d762e-6540-445e-b7e0-cfa497dcbcf9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:45.397713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a31d762e-6540-445e-b7e0-cfa497dcbcf9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:45.415267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a31d762e-6540-445e-b7e0-cfa497dcbcf9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:45.416090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a31d762e-6540-445e-b7e0-cfa497dcbcf9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:45.416743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a31d762e-6540-445e-b7e0-cfa497dcbcf9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:45.417765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a31d762e-6540-445e-b7e0-cfa497dcbcf9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:45.418417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a31d762e-6540-445e-b7e0-cfa497dcbcf9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:45.422281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a31d762e-6540-445e-b7e0-cfa497dcbcf9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:45.676060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a31d762e-6540-445e-b7e0-cfa497dcbcf9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:45.691480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a31d762e-6540-445e-b7e0-cfa497dcbcf9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:45.703500 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a31d762e-6540-445e-b7e0-cfa497dcbcf9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:45.705111 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a31d762e-6540-445e-b7e0-cfa497dcbcf9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1605 microversion: 2.32 time: 0.320740 Sep 07 12:55:45.705948 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2465/4875] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:45 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1605 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:45.711398 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4fcd671d-9f28-47fd-b2a3-84b9d23e3b53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:45.722495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4fcd671d-9f28-47fd-b2a3-84b9d23e3b53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:45.729317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fcd671d-9f28-47fd-b2a3-84b9d23e3b53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:45.730101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fcd671d-9f28-47fd-b2a3-84b9d23e3b53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:45.730734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fcd671d-9f28-47fd-b2a3-84b9d23e3b53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:45.731873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fcd671d-9f28-47fd-b2a3-84b9d23e3b53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:45.732580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fcd671d-9f28-47fd-b2a3-84b9d23e3b53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:45.746321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fcd671d-9f28-47fd-b2a3-84b9d23e3b53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:45.753729 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fb1f4aac-c839-423a-8b4f-26c74f970595 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:45.768969 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fb1f4aac-c839-423a-8b4f-26c74f970595 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1362 microversion: 2.1 time: 0.609972 Sep 07 12:55:45.770558 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2411/4876] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:45 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1362 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:45.795039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2c5f4a10-c08d-49bb-a8c2-589a953c1d6c tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:45.801111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2c5f4a10-c08d-49bb-a8c2-589a953c1d6c tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] [instance: a642f02a-a904-4117-8e50-5418e731ff50] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:45.828312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c5f4a10-c08d-49bb-a8c2-589a953c1d6c tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:45.838546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c5f4a10-c08d-49bb-a8c2-589a953c1d6c tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:45.840090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c5f4a10-c08d-49bb-a8c2-589a953c1d6c tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:45.841852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c5f4a10-c08d-49bb-a8c2-589a953c1d6c tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:45.843082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c5f4a10-c08d-49bb-a8c2-589a953c1d6c tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:45.844189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c5f4a10-c08d-49bb-a8c2-589a953c1d6c tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:46.195614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4fcd671d-9f28-47fd-b2a3-84b9d23e3b53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:46.221425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4fcd671d-9f28-47fd-b2a3-84b9d23e3b53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:46.230654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4fcd671d-9f28-47fd-b2a3-84b9d23e3b53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:46.236624 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4fcd671d-9f28-47fd-b2a3-84b9d23e3b53 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1338 microversion: 2.20 time: 0.528986 Sep 07 12:55:46.241043 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2466/4877] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:45 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1338 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:46.273628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-03de297d-8266-476b-b280-4a7748a4f7be tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:46.278832 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-03de297d-8266-476b-b280-4a7748a4f7be tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 1b76a312-8d25-432f-913b-2e8be8df9246] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:46.314409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03de297d-8266-476b-b280-4a7748a4f7be tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:46.317513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03de297d-8266-476b-b280-4a7748a4f7be tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:46.322711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03de297d-8266-476b-b280-4a7748a4f7be tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:46.336254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03de297d-8266-476b-b280-4a7748a4f7be tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:46.340379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03de297d-8266-476b-b280-4a7748a4f7be tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:46.341215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03de297d-8266-476b-b280-4a7748a4f7be tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:46.695682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2c5f4a10-c08d-49bb-a8c2-589a953c1d6c tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a08986ff6f4c0592c850b2dabc931b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beea504630b84817b11d85cd03f92215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:46.732235 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2c5f4a10-c08d-49bb-a8c2-589a953c1d6c tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] 10.222.0.16 "GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50" status: 200 len: 1328 microversion: 2.1 time: 0.959779 Sep 07 12:55:46.752410 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2412/4878] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:45 2022] GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50 => generated 1328 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:46.779963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-afd74107-00db-462f-a305-04075711f727 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:46.781675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-afd74107-00db-462f-a305-04075711f727 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:46.813800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afd74107-00db-462f-a305-04075711f727 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:46.814763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afd74107-00db-462f-a305-04075711f727 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:46.818137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afd74107-00db-462f-a305-04075711f727 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:46.823345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afd74107-00db-462f-a305-04075711f727 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:46.824792 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afd74107-00db-462f-a305-04075711f727 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:46.830066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afd74107-00db-462f-a305-04075711f727 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:46.930728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-03de297d-8266-476b-b280-4a7748a4f7be tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:46.948126 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-03de297d-8266-476b-b280-4a7748a4f7be tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246" status: 200 len: 1502 microversion: 2.1 time: 0.703655 Sep 07 12:55:46.961752 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2467/4879] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:46 2022] GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246 => generated 1502 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:46.976536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fa676171-e031-477f-8086-1e61b50a77a5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:46.978656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fa676171-e031-477f-8086-1e61b50a77a5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:47.003518 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa676171-e031-477f-8086-1e61b50a77a5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:47.006552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa676171-e031-477f-8086-1e61b50a77a5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:47.007083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa676171-e031-477f-8086-1e61b50a77a5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:47.011352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa676171-e031-477f-8086-1e61b50a77a5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:47.012241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa676171-e031-477f-8086-1e61b50a77a5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:47.015016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa676171-e031-477f-8086-1e61b50a77a5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:47.310213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fa676171-e031-477f-8086-1e61b50a77a5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:47.333316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fa676171-e031-477f-8086-1e61b50a77a5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:47.335862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fa676171-e031-477f-8086-1e61b50a77a5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:47.338473 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fa676171-e031-477f-8086-1e61b50a77a5 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1605 microversion: 2.32 time: 0.380845 Sep 07 12:55:47.345027 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2468/4880] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:46 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1605 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:47.358595 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fd269f56-628e-4874-a564-c7cd339156cb tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:47.363018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fd269f56-628e-4874-a564-c7cd339156cb tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:47.386126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd269f56-628e-4874-a564-c7cd339156cb tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:47.387078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd269f56-628e-4874-a564-c7cd339156cb tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:47.387765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd269f56-628e-4874-a564-c7cd339156cb tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:47.388773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd269f56-628e-4874-a564-c7cd339156cb tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:47.389813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd269f56-628e-4874-a564-c7cd339156cb tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:47.390707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fd269f56-628e-4874-a564-c7cd339156cb tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:47.491231 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-afd74107-00db-462f-a305-04075711f727 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:47.512124 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-afd74107-00db-462f-a305-04075711f727 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1509 microversion: 2.1 time: 0.754400 Sep 07 12:55:47.514280 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2413/4881] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:46 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1509 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:47.528634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0b3a7f28-7ad5-4aa8-b993-5abef78a5f26 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:47.530104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0b3a7f28-7ad5-4aa8-b993-5abef78a5f26 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 1b76a312-8d25-432f-913b-2e8be8df9246] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:47.539580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b3a7f28-7ad5-4aa8-b993-5abef78a5f26 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:47.540085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b3a7f28-7ad5-4aa8-b993-5abef78a5f26 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:47.540531 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b3a7f28-7ad5-4aa8-b993-5abef78a5f26 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:47.541743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b3a7f28-7ad5-4aa8-b993-5abef78a5f26 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:47.543661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b3a7f28-7ad5-4aa8-b993-5abef78a5f26 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:47.544450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b3a7f28-7ad5-4aa8-b993-5abef78a5f26 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:48.210966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fd269f56-628e-4874-a564-c7cd339156cb tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:48.226248 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fd269f56-628e-4874-a564-c7cd339156cb tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1362 microversion: 2.1 time: 0.881316 Sep 07 12:55:48.227219 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2469/4882] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:47 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1362 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:48.232944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-189222e0-7626-42e4-ae2f-f53d265f1f65 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:48.236315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-189222e0-7626-42e4-ae2f-f53d265f1f65 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:48.274890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-189222e0-7626-42e4-ae2f-f53d265f1f65 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:48.275833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-189222e0-7626-42e4-ae2f-f53d265f1f65 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:48.276742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-189222e0-7626-42e4-ae2f-f53d265f1f65 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:48.277773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-189222e0-7626-42e4-ae2f-f53d265f1f65 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:48.278528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-189222e0-7626-42e4-ae2f-f53d265f1f65 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:48.279178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-189222e0-7626-42e4-ae2f-f53d265f1f65 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:48.344209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0b3a7f28-7ad5-4aa8-b993-5abef78a5f26 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:48.357908 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0b3a7f28-7ad5-4aa8-b993-5abef78a5f26 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246" status: 200 len: 1502 microversion: 2.1 time: 0.842449 Sep 07 12:55:48.363496 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2414/4883] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:47 2022] GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246 => generated 1502 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:48.368735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-513045b6-18b2-49a4-8bd0-65fe4b546003 req-63f07666-c2e6-4318-a9a6-939ad685c673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812b8c7f-9408-4862-a000-4b444babe995", "name": "network-vif-plugged", "status": "completed", "tag": "f22238e2-dfbe-46a4-8e28-684befdd390b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:48.407331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-513045b6-18b2-49a4-8bd0-65fe4b546003 req-63f07666-c2e6-4318-a9a6-939ad685c673 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:48.410862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-513045b6-18b2-49a4-8bd0-65fe4b546003 req-63f07666-c2e6-4318-a9a6-939ad685c673 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:48.411637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-513045b6-18b2-49a4-8bd0-65fe4b546003 req-63f07666-c2e6-4318-a9a6-939ad685c673 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:48.437224 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-513045b6-18b2-49a4-8bd0-65fe4b546003 req-63f07666-c2e6-4318-a9a6-939ad685c673 service nova] Creating event network-vif-plugged:f22238e2-dfbe-46a4-8e28-684befdd390b for instance 812b8c7f-9408-4862-a000-4b444babe995 on n-h2-852087-9 Sep 07 12:55:48.470993 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-513045b6-18b2-49a4-8bd0-65fe4b546003 req-63f07666-c2e6-4318-a9a6-939ad685c673 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098561 Sep 07 12:55:48.486842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-189222e0-7626-42e4-ae2f-f53d265f1f65 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:48.497615 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2415/4884] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:55:48.510319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-189222e0-7626-42e4-ae2f-f53d265f1f65 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:48.517359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-189222e0-7626-42e4-ae2f-f53d265f1f65 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:48.522169 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-189222e0-7626-42e4-ae2f-f53d265f1f65 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1338 microversion: 2.20 time: 0.289129 Sep 07 12:55:48.539867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6c3cced8-1d94-4c11-9a50-d2ba67cfb637 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:48.548276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6c3cced8-1d94-4c11-9a50-d2ba67cfb637 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] [instance: a642f02a-a904-4117-8e50-5418e731ff50] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:48.564917 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2470/4885] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:48 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1338 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:48.600783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c3cced8-1d94-4c11-9a50-d2ba67cfb637 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:48.602400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c3cced8-1d94-4c11-9a50-d2ba67cfb637 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:48.603006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-02359e5b-7dc8-4204-a837-00be295d1af3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:48.607463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c3cced8-1d94-4c11-9a50-d2ba67cfb637 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:48.609248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-02359e5b-7dc8-4204-a837-00be295d1af3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 1b76a312-8d25-432f-913b-2e8be8df9246] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:48.613436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c3cced8-1d94-4c11-9a50-d2ba67cfb637 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:48.617430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c3cced8-1d94-4c11-9a50-d2ba67cfb637 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:48.618194 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c3cced8-1d94-4c11-9a50-d2ba67cfb637 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:48.639204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02359e5b-7dc8-4204-a837-00be295d1af3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:48.644807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02359e5b-7dc8-4204-a837-00be295d1af3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:48.645738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02359e5b-7dc8-4204-a837-00be295d1af3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:48.648140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02359e5b-7dc8-4204-a837-00be295d1af3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:48.650440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02359e5b-7dc8-4204-a837-00be295d1af3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:48.652364 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-02359e5b-7dc8-4204-a837-00be295d1af3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:48.747259 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-02359e5b-7dc8-4204-a837-00be295d1af3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 1b76a312-8d25-432f-913b-2e8be8df9246] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:55:49.066748 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-02359e5b-7dc8-4204-a837-00be295d1af3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246" status: 204 len: 0 microversion: 2.1 time: 0.499022 Sep 07 12:55:49.074334 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2471/4886] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:55:48 2022] DELETE /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:55:49.097842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-63fc4772-c65a-4af7-afb4-628c6b00ac23 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:49.098903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-63fc4772-c65a-4af7-afb4-628c6b00ac23 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:49.111764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63fc4772-c65a-4af7-afb4-628c6b00ac23 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:49.114395 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63fc4772-c65a-4af7-afb4-628c6b00ac23 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:49.116524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63fc4772-c65a-4af7-afb4-628c6b00ac23 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:49.118665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63fc4772-c65a-4af7-afb4-628c6b00ac23 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:49.127435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63fc4772-c65a-4af7-afb4-628c6b00ac23 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:49.128073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63fc4772-c65a-4af7-afb4-628c6b00ac23 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:49.830017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-63fc4772-c65a-4af7-afb4-628c6b00ac23 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:49.834417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:49.852610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6c3cced8-1d94-4c11-9a50-d2ba67cfb637 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a08986ff6f4c0592c850b2dabc931b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beea504630b84817b11d85cd03f92215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:49.855218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-63fc4772-c65a-4af7-afb4-628c6b00ac23 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:49.862948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-63fc4772-c65a-4af7-afb4-628c6b00ac23 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:49.866164 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-63fc4772-c65a-4af7-afb4-628c6b00ac23 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1605 microversion: 2.32 time: 0.790001 Sep 07 12:55:49.880233 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6c3cced8-1d94-4c11-9a50-d2ba67cfb637 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] 10.222.0.16 "GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50" status: 200 len: 1528 microversion: 2.1 time: 1.378379 Sep 07 12:55:49.881080 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2416/4887] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:48 2022] GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50 => generated 1528 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:49.887567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c568d169-7e15-46d5-a0e2-3625e892d235 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:49.890635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c568d169-7e15-46d5-a0e2-3625e892d235 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:49.891722 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2472/4888] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:49 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1605 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:49.908383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c568d169-7e15-46d5-a0e2-3625e892d235 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:49.909153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c568d169-7e15-46d5-a0e2-3625e892d235 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:49.909798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c568d169-7e15-46d5-a0e2-3625e892d235 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:49.911083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c568d169-7e15-46d5-a0e2-3625e892d235 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:49.911835 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c568d169-7e15-46d5-a0e2-3625e892d235 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:49.913574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c568d169-7e15-46d5-a0e2-3625e892d235 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:49.936141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2bf8f3cb-d94c-4559-a1d6-77af6b394ef2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:49.937300 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2bf8f3cb-d94c-4559-a1d6-77af6b394ef2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 1b76a312-8d25-432f-913b-2e8be8df9246] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:49.976221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bf8f3cb-d94c-4559-a1d6-77af6b394ef2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:49.977371 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bf8f3cb-d94c-4559-a1d6-77af6b394ef2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:49.983367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bf8f3cb-d94c-4559-a1d6-77af6b394ef2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:49.986662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bf8f3cb-d94c-4559-a1d6-77af6b394ef2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:49.991268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bf8f3cb-d94c-4559-a1d6-77af6b394ef2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:49.992077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2bf8f3cb-d94c-4559-a1d6-77af6b394ef2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:50.265216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:50.334293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:50.592553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c568d169-7e15-46d5-a0e2-3625e892d235 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:50.601781 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c568d169-7e15-46d5-a0e2-3625e892d235 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1509 microversion: 2.1 time: 0.719356 Sep 07 12:55:50.610737 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2417/4889] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:49 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1509 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:50.636617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cb2358ee-789e-4686-962f-6a31a4ec87ed tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:50.637537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cb2358ee-789e-4686-962f-6a31a4ec87ed tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:50.653895 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb2358ee-789e-4686-962f-6a31a4ec87ed tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:50.655059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb2358ee-789e-4686-962f-6a31a4ec87ed tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:50.656158 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb2358ee-789e-4686-962f-6a31a4ec87ed tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:50.661167 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb2358ee-789e-4686-962f-6a31a4ec87ed tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:50.662697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb2358ee-789e-4686-962f-6a31a4ec87ed tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:50.666948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb2358ee-789e-4686-962f-6a31a4ec87ed tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:50.684509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2bf8f3cb-d94c-4559-a1d6-77af6b394ef2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:50.704653 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2bf8f3cb-d94c-4559-a1d6-77af6b394ef2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246" status: 200 len: 1508 microversion: 2.1 time: 0.808626 Sep 07 12:55:50.707178 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2473/4890] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:49 2022] GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246 => generated 1508 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:50.713093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-be19f55c-ecda-4b62-900c-d71076138341 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:50.736316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-be19f55c-ecda-4b62-900c-d71076138341 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:50.757547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be19f55c-ecda-4b62-900c-d71076138341 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:50.758688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be19f55c-ecda-4b62-900c-d71076138341 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:50.767391 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be19f55c-ecda-4b62-900c-d71076138341 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:50.769233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be19f55c-ecda-4b62-900c-d71076138341 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:50.774280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be19f55c-ecda-4b62-900c-d71076138341 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:50.775089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be19f55c-ecda-4b62-900c-d71076138341 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:51.393399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cb2358ee-789e-4686-962f-6a31a4ec87ed tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:51.445719 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cb2358ee-789e-4686-962f-6a31a4ec87ed tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1362 microversion: 2.1 time: 0.797230 Sep 07 12:55:51.446623 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2418/4891] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:50 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1362 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:51.480201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3ed8837c-0b1f-4c4c-b25b-4471d5668ef8 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:51.481073 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3ed8837c-0b1f-4c4c-b25b-4471d5668ef8 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] [instance: a642f02a-a904-4117-8e50-5418e731ff50] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:51.498235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ed8837c-0b1f-4c4c-b25b-4471d5668ef8 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:51.499005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ed8837c-0b1f-4c4c-b25b-4471d5668ef8 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:51.503260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ed8837c-0b1f-4c4c-b25b-4471d5668ef8 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:51.504509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ed8837c-0b1f-4c4c-b25b-4471d5668ef8 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:51.509291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ed8837c-0b1f-4c4c-b25b-4471d5668ef8 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:51.513524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3ed8837c-0b1f-4c4c-b25b-4471d5668ef8 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:52.033322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-be19f55c-ecda-4b62-900c-d71076138341 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:52.059715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-be19f55c-ecda-4b62-900c-d71076138341 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:52.069103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-be19f55c-ecda-4b62-900c-d71076138341 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:52.076073 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-be19f55c-ecda-4b62-900c-d71076138341 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1405 microversion: 2.20 time: 1.362067 Sep 07 12:55:52.093527 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2474/4892] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:50 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1405 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:52.099955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-9cb7fef4-68a8-46b1-b454-be7e76ee6b2d req-4e554182-bf33-4ab7-9ae3-5298a5c20f9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37444bc-ff3d-40dd-8501-7b8794d8b1ef", "name": "network-vif-plugged", "status": "completed", "tag": "f71d91c1-fd88-4617-a671-95e43e01a47c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:52.125765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9cb7fef4-68a8-46b1-b454-be7e76ee6b2d req-4e554182-bf33-4ab7-9ae3-5298a5c20f9f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:52.126760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9cb7fef4-68a8-46b1-b454-be7e76ee6b2d req-4e554182-bf33-4ab7-9ae3-5298a5c20f9f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:52.127849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9cb7fef4-68a8-46b1-b454-be7e76ee6b2d req-4e554182-bf33-4ab7-9ae3-5298a5c20f9f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:52.171384 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-9cb7fef4-68a8-46b1-b454-be7e76ee6b2d req-4e554182-bf33-4ab7-9ae3-5298a5c20f9f service nova] Creating event network-vif-plugged:f71d91c1-fd88-4617-a671-95e43e01a47c for instance f37444bc-ff3d-40dd-8501-7b8794d8b1ef on n-h2-852087-9 Sep 07 12:55:52.185025 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-9cb7fef4-68a8-46b1-b454-be7e76ee6b2d req-4e554182-bf33-4ab7-9ae3-5298a5c20f9f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103270 Sep 07 12:55:52.188083 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2475/4893] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:55:52.202755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-26739db7-c934-4c46-bf80-5a2fb754a715 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:52.203740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-26739db7-c934-4c46-bf80-5a2fb754a715 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:52.218500 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26739db7-c934-4c46-bf80-5a2fb754a715 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:52.231527 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26739db7-c934-4c46-bf80-5a2fb754a715 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:52.233313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26739db7-c934-4c46-bf80-5a2fb754a715 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:52.239061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26739db7-c934-4c46-bf80-5a2fb754a715 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:52.239663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26739db7-c934-4c46-bf80-5a2fb754a715 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:52.261344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26739db7-c934-4c46-bf80-5a2fb754a715 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:52.761170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-26739db7-c934-4c46-bf80-5a2fb754a715 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:52.781622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-26739db7-c934-4c46-bf80-5a2fb754a715 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:52.783758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-26739db7-c934-4c46-bf80-5a2fb754a715 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:52.785056 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-26739db7-c934-4c46-bf80-5a2fb754a715 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1605 microversion: 2.32 time: 0.595764 Sep 07 12:55:52.785673 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2476/4894] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:52 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1605 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:52.800927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3b99b7ee-41cf-4ce3-8c1b-6853085a2bf6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:52.801577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3b99b7ee-41cf-4ce3-8c1b-6853085a2bf6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:52.822121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b99b7ee-41cf-4ce3-8c1b-6853085a2bf6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:52.822598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b99b7ee-41cf-4ce3-8c1b-6853085a2bf6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:52.826193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b99b7ee-41cf-4ce3-8c1b-6853085a2bf6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:52.830353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b99b7ee-41cf-4ce3-8c1b-6853085a2bf6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:52.830910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b99b7ee-41cf-4ce3-8c1b-6853085a2bf6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:52.831370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b99b7ee-41cf-4ce3-8c1b-6853085a2bf6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:52.908931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3ed8837c-0b1f-4c4c-b25b-4471d5668ef8 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a08986ff6f4c0592c850b2dabc931b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beea504630b84817b11d85cd03f92215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:52.917723 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3ed8837c-0b1f-4c4c-b25b-4471d5668ef8 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] 10.222.0.16 "GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50" status: 200 len: 1528 microversion: 2.1 time: 1.452432 Sep 07 12:55:52.929845 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2419/4895] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:51 2022] GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50 => generated 1528 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:52.935152 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-284c4a20-89ef-436b-887e-ca89c7500742 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:52.941018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-284c4a20-89ef-436b-887e-ca89c7500742 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 1b76a312-8d25-432f-913b-2e8be8df9246] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:52.954862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-284c4a20-89ef-436b-887e-ca89c7500742 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:52.965808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-284c4a20-89ef-436b-887e-ca89c7500742 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:52.971731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-284c4a20-89ef-436b-887e-ca89c7500742 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:52.972088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-284c4a20-89ef-436b-887e-ca89c7500742 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:52.972686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-284c4a20-89ef-436b-887e-ca89c7500742 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:52.979269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-284c4a20-89ef-436b-887e-ca89c7500742 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:53.175961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-284c4a20-89ef-436b-887e-ca89c7500742 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:53.202753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-284c4a20-89ef-436b-887e-ca89c7500742 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:53.204095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-284c4a20-89ef-436b-887e-ca89c7500742 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:53.205327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-284c4a20-89ef-436b-887e-ca89c7500742 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lazy-loading 'fault' on Instance uuid 1b76a312-8d25-432f-913b-2e8be8df9246 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:55:53.803945 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-284c4a20-89ef-436b-887e-ca89c7500742 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:53.845958 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-284c4a20-89ef-436b-887e-ca89c7500742 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246" status: 200 len: 1311 microversion: 2.1 time: 0.914310 Sep 07 12:55:53.847531 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2420/4896] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:52 2022] GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246 => generated 1311 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:53.857738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-cd361279-f8da-4fce-a077-90227b4ca6b0 req-76a4347d-d54b-4121-9193-c61143102864 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35f328e5-ec00-4403-8196-cbefa047877b", "tag": "13d7f17d-cb66-4016-a84a-aec1e39c3e03"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:53.916497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cd361279-f8da-4fce-a077-90227b4ca6b0 req-76a4347d-d54b-4121-9193-c61143102864 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:53.920196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cd361279-f8da-4fce-a077-90227b4ca6b0 req-76a4347d-d54b-4121-9193-c61143102864 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:53.922595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cd361279-f8da-4fce-a077-90227b4ca6b0 req-76a4347d-d54b-4121-9193-c61143102864 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:53.961946 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-cd361279-f8da-4fce-a077-90227b4ca6b0 req-76a4347d-d54b-4121-9193-c61143102864 service nova] Creating event network-changed:13d7f17d-cb66-4016-a84a-aec1e39c3e03 for instance 35f328e5-ec00-4403-8196-cbefa047877b on n-h2-852087-9 Sep 07 12:55:53.977362 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-cd361279-f8da-4fce-a077-90227b4ca6b0 req-76a4347d-d54b-4121-9193-c61143102864 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127378 Sep 07 12:55:53.978481 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2421/4897] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:55:53.997627 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7b98c74e-9f82-4d61-af0e-999c91f5c4d9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:53.999627 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7b98c74e-9f82-4d61-af0e-999c91f5c4d9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:54.029867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b98c74e-9f82-4d61-af0e-999c91f5c4d9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:54.036764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b98c74e-9f82-4d61-af0e-999c91f5c4d9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:54.037331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b98c74e-9f82-4d61-af0e-999c91f5c4d9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:54.038293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b98c74e-9f82-4d61-af0e-999c91f5c4d9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:54.038960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b98c74e-9f82-4d61-af0e-999c91f5c4d9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:54.039578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b98c74e-9f82-4d61-af0e-999c91f5c4d9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:54.490027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3b99b7ee-41cf-4ce3-8c1b-6853085a2bf6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:54.511123 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3b99b7ee-41cf-4ce3-8c1b-6853085a2bf6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1509 microversion: 2.1 time: 1.723776 Sep 07 12:55:54.512552 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2477/4898] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:52 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1509 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:54.731180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7b98c74e-9f82-4d61-af0e-999c91f5c4d9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:54.762111 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7b98c74e-9f82-4d61-af0e-999c91f5c4d9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1362 microversion: 2.1 time: 0.780327 Sep 07 12:55:54.766458 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2422/4899] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:53 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1362 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:54.815175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a4a1713e-754f-4c39-be04-38b13f86d836 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:54.821881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a4a1713e-754f-4c39-be04-38b13f86d836 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:54.850191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4a1713e-754f-4c39-be04-38b13f86d836 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:54.851075 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4a1713e-754f-4c39-be04-38b13f86d836 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:54.853868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4a1713e-754f-4c39-be04-38b13f86d836 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:54.854808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4a1713e-754f-4c39-be04-38b13f86d836 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:54.855307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4a1713e-754f-4c39-be04-38b13f86d836 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:54.855763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a4a1713e-754f-4c39-be04-38b13f86d836 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:55.193508 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e5c5f2e0-180f-4363-bc4b-09db7e7fd6b5 tempest-ServersNegativeTestMultiTenantJSON-705128906 tempest-ServersNegativeTestMultiTenantJSON-705128906-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:55.194374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e5c5f2e0-180f-4363-bc4b-09db7e7fd6b5 tempest-ServersNegativeTestMultiTenantJSON-705128906 tempest-ServersNegativeTestMultiTenantJSON-705128906-project] [instance: a642f02a-a904-4117-8e50-5418e731ff50] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:55.245769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5c5f2e0-180f-4363-bc4b-09db7e7fd6b5 tempest-ServersNegativeTestMultiTenantJSON-705128906 tempest-ServersNegativeTestMultiTenantJSON-705128906-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:55.249023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5c5f2e0-180f-4363-bc4b-09db7e7fd6b5 tempest-ServersNegativeTestMultiTenantJSON-705128906 tempest-ServersNegativeTestMultiTenantJSON-705128906-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:55.255073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5c5f2e0-180f-4363-bc4b-09db7e7fd6b5 tempest-ServersNegativeTestMultiTenantJSON-705128906 tempest-ServersNegativeTestMultiTenantJSON-705128906-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:55.256990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5c5f2e0-180f-4363-bc4b-09db7e7fd6b5 tempest-ServersNegativeTestMultiTenantJSON-705128906 tempest-ServersNegativeTestMultiTenantJSON-705128906-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:55.263366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5c5f2e0-180f-4363-bc4b-09db7e7fd6b5 tempest-ServersNegativeTestMultiTenantJSON-705128906 tempest-ServersNegativeTestMultiTenantJSON-705128906-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:55.264701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5c5f2e0-180f-4363-bc4b-09db7e7fd6b5 tempest-ServersNegativeTestMultiTenantJSON-705128906 tempest-ServersNegativeTestMultiTenantJSON-705128906-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:55.300792 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a4a1713e-754f-4c39-be04-38b13f86d836 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:55.314065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a4a1713e-754f-4c39-be04-38b13f86d836 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:55.321738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a4a1713e-754f-4c39-be04-38b13f86d836 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:55.323539 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a4a1713e-754f-4c39-be04-38b13f86d836 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1405 microversion: 2.20 time: 0.554113 Sep 07 12:55:55.324422 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2423/4900] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:54 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1405 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:55.339661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-38dc7493-cc81-4f0e-9e05-10bc469c149c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:55.340687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-38dc7493-cc81-4f0e-9e05-10bc469c149c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:55.354820 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-e5c5f2e0-180f-4363-bc4b-09db7e7fd6b5 tempest-ServersNegativeTestMultiTenantJSON-705128906 tempest-ServersNegativeTestMultiTenantJSON-705128906-project] HTTP exception thrown: Instance a642f02a-a904-4117-8e50-5418e731ff50 could not be found. Sep 07 12:55:55.357111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38dc7493-cc81-4f0e-9e05-10bc469c149c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:55.357967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38dc7493-cc81-4f0e-9e05-10bc469c149c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:55.358819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38dc7493-cc81-4f0e-9e05-10bc469c149c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:55.359824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38dc7493-cc81-4f0e-9e05-10bc469c149c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:55.360518 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38dc7493-cc81-4f0e-9e05-10bc469c149c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:55.361202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38dc7493-cc81-4f0e-9e05-10bc469c149c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e5c5f2e0-180f-4363-bc4b-09db7e7fd6b5 tempest-ServersNegativeTestMultiTenantJSON-705128906 tempest-ServersNegativeTestMultiTenantJSON-705128906-project] Request method failure captured: Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50 HTTP/1.1 Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJS1GDooJku-csvmdgbc_DgM-tbOJT8NUfttv-WpVRjukaI1CMLtIsoTJmtSmb1LLl1FteSVC8BPw8PaxyhRMXygx-FDaf6XVMLoatzFT6fCw3ctgq88ScbjKB0t1ExB5fU_avJgaYAUEmcZ_1j8XHHQNiv1UT8UodF1rgfAXtRXrbw Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 49a4dc05807440cbaa7b64a15bf111e1 Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-705128906 Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/49a4dc05807440cbaa7b64a15bf111e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_49a4dc05807440cbaa7b64a15bf111e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/49a4dc05807440cbaa7b64a15bf111e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/49a4dc05807440cbaa7b64a15bf111e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-705128906 Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 49a4dc05807440cbaa7b64a15bf111e1 Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-705128906 Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestMultiTenantJSON-705128906-project Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: a3bfc3b4ac054268a857d46bb0bdb148 Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-705128906-project Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance a642f02a-a904-4117-8e50-5418e731ff50 could not be found. Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'a642f02a-a904-4117-8e50-5418e731ff50'} Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a642f02a-a904-4117-8e50-5418e731ff50 could not be found. Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:55:55.374928 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:55:55.383805 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a642f02a-a904-4117-8e50-5418e731ff50 could not be found. Sep 07 12:55:55.383805 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:55:55.383805 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:55:55.383805 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:55:55.383805 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:55:55.383805 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:55:55.383805 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:55:55.383805 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:55:55.383805 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:55:55.383805 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a642f02a-a904-4117-8e50-5418e731ff50 could not be found. Sep 07 12:55:55.383805 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:55:55.390359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e5c5f2e0-180f-4363-bc4b-09db7e7fd6b5 tempest-ServersNegativeTestMultiTenantJSON-705128906 tempest-ServersNegativeTestMultiTenantJSON-705128906-project] Returning 404 to user: Instance a642f02a-a904-4117-8e50-5418e731ff50 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:55:55.394001 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e5c5f2e0-180f-4363-bc4b-09db7e7fd6b5 tempest-ServersNegativeTestMultiTenantJSON-705128906 tempest-ServersNegativeTestMultiTenantJSON-705128906-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50" status: 404 len: 111 microversion: 2.1 time: 0.875481 Sep 07 12:55:55.402965 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2478/4901] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:55:54 2022] DELETE /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50 => generated 111 bytes in 888 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:55:55.431977 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6988ff62-0e83-4a94-a08b-8edfdf22fe6c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:55.432704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6988ff62-0e83-4a94-a08b-8edfdf22fe6c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 1b76a312-8d25-432f-913b-2e8be8df9246] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:55.461347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6988ff62-0e83-4a94-a08b-8edfdf22fe6c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:55.461864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6988ff62-0e83-4a94-a08b-8edfdf22fe6c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:55.462294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6988ff62-0e83-4a94-a08b-8edfdf22fe6c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:55.463080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6988ff62-0e83-4a94-a08b-8edfdf22fe6c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:55.463546 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6988ff62-0e83-4a94-a08b-8edfdf22fe6c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:55.463978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6988ff62-0e83-4a94-a08b-8edfdf22fe6c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:55.486917 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-6988ff62-0e83-4a94-a08b-8edfdf22fe6c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] HTTP exception thrown: Instance 1b76a312-8d25-432f-913b-2e8be8df9246 could not be found. Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6988ff62-0e83-4a94-a08b-8edfdf22fe6c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Request method failure captured: Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246 HTTP/1.1 Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJSE5qt3MMvCiXM6JMYUN7f1buxIi7ST_NSWH8b3Iy1XPUp8KO4zG-NXQgWVN1Z7GE3sHXszWiKCVOYqqXwQROrdr4ZEFwz_8XPZaHXiJBQID0HYLx7sZ_BMJTKC5v-6tuUaVizJ_CnloOe2V1xTk5bkZGekyl16F75E8fKcPIskPJo Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestJSON-553840835 Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestJSON-553840835 Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestJSON-553840835 Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersTestJSON-553840835-project Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6ac786dc6d7847f582262dcd912c3f06 Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestJSON-553840835-project Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 1b76a312-8d25-432f-913b-2e8be8df9246 could not be found. Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '1b76a312-8d25-432f-913b-2e8be8df9246'} Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b76a312-8d25-432f-913b-2e8be8df9246 could not be found. Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b76a312-8d25-432f-913b-2e8be8df9246 could not be found. Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:55:55.488827 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:55:55.494628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:55:55.494628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:55:55.494628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:55:55.494628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:55:55.494628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b76a312-8d25-432f-913b-2e8be8df9246 could not be found. Sep 07 12:55:55.494628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:55:55.497244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6988ff62-0e83-4a94-a08b-8edfdf22fe6c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Returning 404 to user: Instance 1b76a312-8d25-432f-913b-2e8be8df9246 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:55:55.498393 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6988ff62-0e83-4a94-a08b-8edfdf22fe6c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246" status: 404 len: 111 microversion: 2.1 time: 0.090275 Sep 07 12:55:55.499480 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2479/4902] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:55 2022] GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:55:55.505234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-494b33f4-b1dc-4be2-85a8-43162bffd745 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:55.506185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-494b33f4-b1dc-4be2-85a8-43162bffd745 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] [instance: a642f02a-a904-4117-8e50-5418e731ff50] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:55.515564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-494b33f4-b1dc-4be2-85a8-43162bffd745 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:55.520089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-38dc7493-cc81-4f0e-9e05-10bc469c149c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:55.527102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-494b33f4-b1dc-4be2-85a8-43162bffd745 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:55.531975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-494b33f4-b1dc-4be2-85a8-43162bffd745 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:55.535549 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:55.540728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-494b33f4-b1dc-4be2-85a8-43162bffd745 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:55.540971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-494b33f4-b1dc-4be2-85a8-43162bffd745 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:55.541346 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-494b33f4-b1dc-4be2-85a8-43162bffd745 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:55.551653 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-38dc7493-cc81-4f0e-9e05-10bc469c149c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:55.552869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-38dc7493-cc81-4f0e-9e05-10bc469c149c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:55.554147 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-38dc7493-cc81-4f0e-9e05-10bc469c149c tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1605 microversion: 2.32 time: 0.227888 Sep 07 12:55:55.566356 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2424/4903] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:55 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1605 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:55.591782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a4e535b2-538b-41ab-be7b-438fa6f7aedc tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Action: 'create', calling method: .version_select at 0x7fc41399b9d0>, body: {"keypair": {"name": "tempest-key-1534632533", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKZ6tSgsaYtQ0W0SgCGRf41/ZIoSLud+RiK1CUYZcIc5pEcRi5sF25wYGJ7AXUROL0qmFIOmQOQlkuObOMMGQfbCiKx8eKo72ubGkCuggW2Sp47NTtq+CJFaapvwyjBMQ=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:55.657961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-a4e535b2-538b-41ab-be7b-438fa6f7aedc tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Getting quotas for project 854c6a81bbfd4ab79126799ec40c954e. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:55:55.672882 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-a4e535b2-538b-41ab-be7b-438fa6f7aedc tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Getting quotas for user 6ac786dc6d7847f582262dcd912c3f06 and project 854c6a81bbfd4ab79126799ec40c954e. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:55:55.741206 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a4e535b2-538b-41ab-be7b-438fa6f7aedc tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.173174 Sep 07 12:55:55.743440 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2425/4904] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 12:55:55 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:55:55.754961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5a1d0dae-0726-4efc-8b13-5f911d4cf5bd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:55.756719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5a1d0dae-0726-4efc-8b13-5f911d4cf5bd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:55.781300 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a1d0dae-0726-4efc-8b13-5f911d4cf5bd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:55.782860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a1d0dae-0726-4efc-8b13-5f911d4cf5bd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:55.784243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a1d0dae-0726-4efc-8b13-5f911d4cf5bd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:55.786386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a1d0dae-0726-4efc-8b13-5f911d4cf5bd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:55.787555 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a1d0dae-0726-4efc-8b13-5f911d4cf5bd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:55.788978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a1d0dae-0726-4efc-8b13-5f911d4cf5bd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:56.518478 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5a1d0dae-0726-4efc-8b13-5f911d4cf5bd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:56.528955 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5a1d0dae-0726-4efc-8b13-5f911d4cf5bd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1509 microversion: 2.1 time: 0.783192 Sep 07 12:55:56.537895 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2426/4905] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:55 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1509 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:56.549685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1bf3399f-2efa-4ac5-9fd0-5fe1bd0a134a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '.version_select at 0x7fc4139695e0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:56.563163 n-d-852087-9 devstack@n-api.service[122432]: WARNING oslo_db.sqlalchemy.utils [None req-1bf3399f-2efa-4ac5-9fd0-5fe1bd0a134a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 07 12:55:56.565662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-494b33f4-b1dc-4be2-85a8-43162bffd745 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a08986ff6f4c0592c850b2dabc931b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beea504630b84817b11d85cd03f92215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:56.576918 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1bf3399f-2efa-4ac5-9fd0-5fe1bd0a134a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.037878 Sep 07 12:55:56.586398 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2427/4906] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:55:56 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:55:56.591853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4de8c486-f0be-4da9-abfe-e406344b26f7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:56.592883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4de8c486-f0be-4da9-abfe-e406344b26f7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:56.614373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4de8c486-f0be-4da9-abfe-e406344b26f7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:56.616267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4de8c486-f0be-4da9-abfe-e406344b26f7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:56.618150 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-494b33f4-b1dc-4be2-85a8-43162bffd745 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] 10.222.0.16 "GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50" status: 200 len: 1528 microversion: 2.1 time: 1.116873 Sep 07 12:55:56.620085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4de8c486-f0be-4da9-abfe-e406344b26f7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:56.621129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4de8c486-f0be-4da9-abfe-e406344b26f7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:56.625887 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2480/4907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:55 2022] GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50 => generated 1528 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:56.640767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4de8c486-f0be-4da9-abfe-e406344b26f7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:56.641339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4de8c486-f0be-4da9-abfe-e406344b26f7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:56.644693 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-2efdf6b7-9c27-4561-937d-ffbfbae3edba req-35b8db8f-5ac6-42a3-b638-d5ef37dd46cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b76a312-8d25-432f-913b-2e8be8df9246", "name": "network-vif-deleted", "tag": "7a67b18f-9508-47b8-b212-f42631849d0b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:56.678635 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2efdf6b7-9c27-4561-937d-ffbfbae3edba req-35b8db8f-5ac6-42a3-b638-d5ef37dd46cd service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:56.680625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2efdf6b7-9c27-4561-937d-ffbfbae3edba req-35b8db8f-5ac6-42a3-b638-d5ef37dd46cd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:56.684160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2efdf6b7-9c27-4561-937d-ffbfbae3edba req-35b8db8f-5ac6-42a3-b638-d5ef37dd46cd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:56.706714 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-2efdf6b7-9c27-4561-937d-ffbfbae3edba req-35b8db8f-5ac6-42a3-b638-d5ef37dd46cd service nova] Creating event network-vif-deleted:7a67b18f-9508-47b8-b212-f42631849d0b for instance 1b76a312-8d25-432f-913b-2e8be8df9246 on n-h1-852087-9 Sep 07 12:55:56.713621 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-2efdf6b7-9c27-4561-937d-ffbfbae3edba req-35b8db8f-5ac6-42a3-b638-d5ef37dd46cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085860 Sep 07 12:55:56.715405 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2481/4908] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:55:56.723186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f21104a-7e58-45c2-bdbd-e5b7da829205 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:56.724187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0f21104a-7e58-45c2-bdbd-e5b7da829205 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:56.733167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f21104a-7e58-45c2-bdbd-e5b7da829205 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:56.734028 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f21104a-7e58-45c2-bdbd-e5b7da829205 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:56.734953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f21104a-7e58-45c2-bdbd-e5b7da829205 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:56.736222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f21104a-7e58-45c2-bdbd-e5b7da829205 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:56.736938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f21104a-7e58-45c2-bdbd-e5b7da829205 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:56.737641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f21104a-7e58-45c2-bdbd-e5b7da829205 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:57.513947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0f21104a-7e58-45c2-bdbd-e5b7da829205 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:57.525458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4de8c486-f0be-4da9-abfe-e406344b26f7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:57.565571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0f21104a-7e58-45c2-bdbd-e5b7da829205 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:57.573037 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4de8c486-f0be-4da9-abfe-e406344b26f7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1549 microversion: 2.1 time: 0.979563 Sep 07 12:55:57.602060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0f21104a-7e58-45c2-bdbd-e5b7da829205 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:57.604549 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2428/4909] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:56 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1549 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:57.619788 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0f21104a-7e58-45c2-bdbd-e5b7da829205 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1405 microversion: 2.20 time: 0.902014 Sep 07 12:55:57.637211 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2482/4910] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:56 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1405 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:57.666246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-be963d83-e02b-45af-99a7-0aee7b6334c6 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:57.675026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-be963d83-e02b-45af-99a7-0aee7b6334c6 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:57.687986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b6b61d7e-28c4-468e-8fa3-693bf083e860 tempest-ServersNegativeTestMultiTenantJSON-705128906 tempest-ServersNegativeTestMultiTenantJSON-705128906-project] Action: 'update', calling method: >, body: {"server": {"name": "a642f02a-a904-4117-8e50-5418e731ff50_new"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:57.728267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be963d83-e02b-45af-99a7-0aee7b6334c6 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:57.729155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be963d83-e02b-45af-99a7-0aee7b6334c6 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:57.730099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b6b61d7e-28c4-468e-8fa3-693bf083e860 tempest-ServersNegativeTestMultiTenantJSON-705128906 tempest-ServersNegativeTestMultiTenantJSON-705128906-project] [instance: a642f02a-a904-4117-8e50-5418e731ff50] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:57.739486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be963d83-e02b-45af-99a7-0aee7b6334c6 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:57.744061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be963d83-e02b-45af-99a7-0aee7b6334c6 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:57.750574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be963d83-e02b-45af-99a7-0aee7b6334c6 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:57.752051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be963d83-e02b-45af-99a7-0aee7b6334c6 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:57.760995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6b61d7e-28c4-468e-8fa3-693bf083e860 tempest-ServersNegativeTestMultiTenantJSON-705128906 tempest-ServersNegativeTestMultiTenantJSON-705128906-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:57.767165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6b61d7e-28c4-468e-8fa3-693bf083e860 tempest-ServersNegativeTestMultiTenantJSON-705128906 tempest-ServersNegativeTestMultiTenantJSON-705128906-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:57.771496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6b61d7e-28c4-468e-8fa3-693bf083e860 tempest-ServersNegativeTestMultiTenantJSON-705128906 tempest-ServersNegativeTestMultiTenantJSON-705128906-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:57.773359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6b61d7e-28c4-468e-8fa3-693bf083e860 tempest-ServersNegativeTestMultiTenantJSON-705128906 tempest-ServersNegativeTestMultiTenantJSON-705128906-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:57.774566 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6b61d7e-28c4-468e-8fa3-693bf083e860 tempest-ServersNegativeTestMultiTenantJSON-705128906 tempest-ServersNegativeTestMultiTenantJSON-705128906-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:57.786702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6b61d7e-28c4-468e-8fa3-693bf083e860 tempest-ServersNegativeTestMultiTenantJSON-705128906 tempest-ServersNegativeTestMultiTenantJSON-705128906-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:57.834388 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-b6b61d7e-28c4-468e-8fa3-693bf083e860 tempest-ServersNegativeTestMultiTenantJSON-705128906 tempest-ServersNegativeTestMultiTenantJSON-705128906-project] HTTP exception thrown: Instance a642f02a-a904-4117-8e50-5418e731ff50 could not be found. Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b6b61d7e-28c4-468e-8fa3-693bf083e860 tempest-ServersNegativeTestMultiTenantJSON-705128906 tempest-ServersNegativeTestMultiTenantJSON-705128906-project] Request method failure captured: Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: request: PUT /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50 HTTP/1.1 Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 64 Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJS1GDooJku-csvmdgbc_DgM-tbOJT8NUfttv-WpVRjukaI1CMLtIsoTJmtSmb1LLl1FteSVC8BPw8PaxyhRMXygx-FDaf6XVMLoatzFT6fCw3ctgq88ScbjKB0t1ExB5fU_avJgaYAUEmcZ_1j8XHHQNiv1UT8UodF1rgfAXtRXrbw Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 49a4dc05807440cbaa7b64a15bf111e1 Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-705128906 Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/49a4dc05807440cbaa7b64a15bf111e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_49a4dc05807440cbaa7b64a15bf111e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/49a4dc05807440cbaa7b64a15bf111e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/49a4dc05807440cbaa7b64a15bf111e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-705128906 Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 49a4dc05807440cbaa7b64a15bf111e1 Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-705128906 Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestMultiTenantJSON-705128906-project Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: a3bfc3b4ac054268a857d46bb0bdb148 Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-705128906-project Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: {"server": {"name": "a642f02a-a904-4117-8e50-5418e731ff50_new"}} Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance a642f02a-a904-4117-8e50-5418e731ff50 could not be found. Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'a642f02a-a904-4117-8e50-5418e731ff50', 'body': {'server': {'name': 'a642f02a-a904-4117-8e50-5418e731ff50_new'}}} Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a642f02a-a904-4117-8e50-5418e731ff50 could not be found. Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:55:57.850846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 07 12:55:57.857681 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 07 12:55:57.857681 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 07 12:55:57.857681 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:55:57.857681 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:55:57.857681 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:55:57.857681 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:55:57.857681 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a642f02a-a904-4117-8e50-5418e731ff50 could not be found. Sep 07 12:55:57.857681 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:55:57.857681 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:55:57.857681 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:55:57.857681 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:55:57.857681 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:55:57.857681 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:55:57.857681 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:55:57.857681 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:55:57.857681 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a642f02a-a904-4117-8e50-5418e731ff50 could not be found. Sep 07 12:55:57.857681 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:55:57.860393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b6b61d7e-28c4-468e-8fa3-693bf083e860 tempest-ServersNegativeTestMultiTenantJSON-705128906 tempest-ServersNegativeTestMultiTenantJSON-705128906-project] Returning 404 to user: Instance a642f02a-a904-4117-8e50-5418e731ff50 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:55:57.862385 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b6b61d7e-28c4-468e-8fa3-693bf083e860 tempest-ServersNegativeTestMultiTenantJSON-705128906 tempest-ServersNegativeTestMultiTenantJSON-705128906-project] 10.222.0.16 "PUT /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50" status: 404 len: 111 microversion: 2.1 time: 0.222789 Sep 07 12:55:57.867122 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2483/4911] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Sep 7 12:55:57 2022] PUT /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50 => generated 111 bytes in 229 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:55:57.914170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ab137e46-0c5f-4a2e-a6e8-f164a324f856 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-501336312", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "key_name": "tempest-key-1534632533", "networks": [{"uuid": "1c45fce2-7bfe-4e93-8f9c-12b9830de28b"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:55:58.054038 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-be963d83-e02b-45af-99a7-0aee7b6334c6 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:58.085636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-be963d83-e02b-45af-99a7-0aee7b6334c6 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:58.092856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-be963d83-e02b-45af-99a7-0aee7b6334c6 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b0cc4dd3ef645b18341a7273cb0522c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c0c643a1704bc2be7aaedfd11802e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:58.096176 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-be963d83-e02b-45af-99a7-0aee7b6334c6 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 200 len: 1605 microversion: 2.32 time: 0.484644 Sep 07 12:55:58.101360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-ab137e46-0c5f-4a2e-a6e8-f164a324f856 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] validate_networks() for [('1c45fce2-7bfe-4e93-8f9c-12b9830de28b', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:55:58.101711 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2429/4912] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:57 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 1605 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:55:58.137124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b453507-5332-4053-b815-ff2228bc9b6b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:58.138802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2b453507-5332-4053-b815-ff2228bc9b6b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:58.157023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b453507-5332-4053-b815-ff2228bc9b6b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:58.158442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b453507-5332-4053-b815-ff2228bc9b6b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:58.159778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b453507-5332-4053-b815-ff2228bc9b6b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:58.161429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b453507-5332-4053-b815-ff2228bc9b6b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:58.162724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b453507-5332-4053-b815-ff2228bc9b6b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:58.163951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b453507-5332-4053-b815-ff2228bc9b6b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:58.601022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2b453507-5332-4053-b815-ff2228bc9b6b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:55:58.612403 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2b453507-5332-4053-b815-ff2228bc9b6b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1509 microversion: 2.1 time: 0.508804 Sep 07 12:55:58.613002 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2430/4913] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:55:58 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1509 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:55:58.626037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-17635693-4782-421e-9e74-49af25b5eba1 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:58.628785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-17635693-4782-421e-9e74-49af25b5eba1 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:58.658729 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17635693-4782-421e-9e74-49af25b5eba1 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:58.659550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17635693-4782-421e-9e74-49af25b5eba1 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:58.660275 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17635693-4782-421e-9e74-49af25b5eba1 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:58.661220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17635693-4782-421e-9e74-49af25b5eba1 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:58.661915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17635693-4782-421e-9e74-49af25b5eba1 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:58.662518 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17635693-4782-421e-9e74-49af25b5eba1 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:58.948601 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-17635693-4782-421e-9e74-49af25b5eba1 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.333430 Sep 07 12:55:58.967526 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2431/4914] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Sep 7 12:55:58 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef/os-interface => generated 285 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:55:58.975262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-24602aa8-2aad-4f65-b50c-4795d66f1011 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:58.976616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-24602aa8-2aad-4f65-b50c-4795d66f1011 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] [instance: a642f02a-a904-4117-8e50-5418e731ff50] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:58.999699 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24602aa8-2aad-4f65-b50c-4795d66f1011 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:59.000496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24602aa8-2aad-4f65-b50c-4795d66f1011 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:59.000943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24602aa8-2aad-4f65-b50c-4795d66f1011 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:59.002051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24602aa8-2aad-4f65-b50c-4795d66f1011 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:59.002704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24602aa8-2aad-4f65-b50c-4795d66f1011 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:59.003558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24602aa8-2aad-4f65-b50c-4795d66f1011 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:59.063454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-24602aa8-2aad-4f65-b50c-4795d66f1011 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] [instance: a642f02a-a904-4117-8e50-5418e731ff50] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:55:59.219324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:59.258652 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-24602aa8-2aad-4f65-b50c-4795d66f1011 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50" status: 204 len: 0 microversion: 2.1 time: 0.289337 Sep 07 12:55:59.260490 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2432/4915] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:55:58 2022] DELETE /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:55:59.278217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-deb9ee14-57d3-41e3-ae0b-b4c1996f95af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:55:59.279812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-deb9ee14-57d3-41e3-ae0b-b4c1996f95af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:55:59.296394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-deb9ee14-57d3-41e3-ae0b-b4c1996f95af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:59.297374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-deb9ee14-57d3-41e3-ae0b-b4c1996f95af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:59.298216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-deb9ee14-57d3-41e3-ae0b-b4c1996f95af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:55:59.299227 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-deb9ee14-57d3-41e3-ae0b-b4c1996f95af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:55:59.299943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-deb9ee14-57d3-41e3-ae0b-b4c1996f95af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:55:59.301645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-deb9ee14-57d3-41e3-ae0b-b4c1996f95af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:00.080517 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ab137e46-0c5f-4a2e-a6e8-f164a324f856 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:56:00.081839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ab137e46-0c5f-4a2e-a6e8-f164a324f856 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:56:00.082610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ab137e46-0c5f-4a2e-a6e8-f164a324f856 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:56:00.083262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ab137e46-0c5f-4a2e-a6e8-f164a324f856 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:56:00.083864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-ab137e46-0c5f-4a2e-a6e8-f164a324f856 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:56:00.104934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-deb9ee14-57d3-41e3-ae0b-b4c1996f95af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:00.117043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab137e46-0c5f-4a2e-a6e8-f164a324f856 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:00.119441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab137e46-0c5f-4a2e-a6e8-f164a324f856 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:00.120292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab137e46-0c5f-4a2e-a6e8-f164a324f856 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:00.121295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab137e46-0c5f-4a2e-a6e8-f164a324f856 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:00.122051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab137e46-0c5f-4a2e-a6e8-f164a324f856 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:00.122713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab137e46-0c5f-4a2e-a6e8-f164a324f856 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:00.138944 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-deb9ee14-57d3-41e3-ae0b-b4c1996f95af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:00.158352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-deb9ee14-57d3-41e3-ae0b-b4c1996f95af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:00.163818 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-deb9ee14-57d3-41e3-ae0b-b4c1996f95af tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1405 microversion: 2.20 time: 0.898512 Sep 07 12:56:00.164854 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2433/4916] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:55:59 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1405 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:56:00.172449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-ab137e46-0c5f-4a2e-a6e8-f164a324f856 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Getting quotas for project 854c6a81bbfd4ab79126799ec40c954e. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:56:00.182019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-359e3f4e-e38f-4002-bdc6-4024a7f02da9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:00.183009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-359e3f4e-e38f-4002-bdc6-4024a7f02da9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:00.188869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-ab137e46-0c5f-4a2e-a6e8-f164a324f856 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Getting quotas for user 6ac786dc6d7847f582262dcd912c3f06 and project 854c6a81bbfd4ab79126799ec40c954e. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:56:00.197249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-359e3f4e-e38f-4002-bdc6-4024a7f02da9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:00.198128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-359e3f4e-e38f-4002-bdc6-4024a7f02da9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:00.198793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-359e3f4e-e38f-4002-bdc6-4024a7f02da9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:00.201123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-359e3f4e-e38f-4002-bdc6-4024a7f02da9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:00.202463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-359e3f4e-e38f-4002-bdc6-4024a7f02da9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:00.207040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-359e3f4e-e38f-4002-bdc6-4024a7f02da9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:00.222354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ab137e46-0c5f-4a2e-a6e8-f164a324f856 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:56:00.226450 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ab137e46-0c5f-4a2e-a6e8-f164a324f856 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7ebb91d2-1102-474c-acb1-2791dfbd422a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:56:00.272271 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-359e3f4e-e38f-4002-bdc6-4024a7f02da9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] HTTP exception thrown: Instance e9352ac2-475e-4c77-aa85-5ecd566563b2 could not be found. Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-359e3f4e-e38f-4002-bdc6-4024a7f02da9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Request method failure captured: Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 HTTP/1.1 Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJLWBuiK9Zwtf-5SJBGQ_yHHu0Iad1RHxrRcWUBDwgXSJ1GR31PEZrJdB9KCga6FWHK7ZaCy9AAqAi8NS7CPhyyDapn9WD__TAuEoH2XS2hGu6GREMs29eY74y6ndxhK6E1U_yTDaQ4AQw9rEnDBW5jk3Z_vUby6JGKsL-PupP7jojw Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.32 Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 17c0c643a1704bc2be7aaedfd11802e8 Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TaggedBootDevicesTest-1570794625 Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/17c0c643a1704bc2be7aaedfd11802e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_17c0c643a1704bc2be7aaedfd11802e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/17c0c643a1704bc2be7aaedfd11802e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/17c0c643a1704bc2be7aaedfd11802e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TaggedBootDevicesTest-1570794625 Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 17c0c643a1704bc2be7aaedfd11802e8 Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1570794625 Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TaggedBootDevicesTest-1570794625-project Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 9b0cc4dd3ef645b18341a7273cb0522c Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TaggedBootDevicesTest-1570794625-project Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance e9352ac2-475e-4c77-aa85-5ecd566563b2 could not be found. Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'e9352ac2-475e-4c77-aa85-5ecd566563b2'} Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9352ac2-475e-4c77-aa85-5ecd566563b2 could not be found. Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9352ac2-475e-4c77-aa85-5ecd566563b2 could not be found. Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:56:00.277444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:56:00.281374 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:56:00.281374 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:56:00.281374 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:56:00.281374 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:56:00.281374 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:56:00.281374 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:56:00.281374 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9352ac2-475e-4c77-aa85-5ecd566563b2 could not be found. Sep 07 12:56:00.281374 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:56:00.291064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-359e3f4e-e38f-4002-bdc6-4024a7f02da9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Returning 404 to user: Instance e9352ac2-475e-4c77-aa85-5ecd566563b2 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:56:00.292382 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-359e3f4e-e38f-4002-bdc6-4024a7f02da9 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 404 len: 111 microversion: 2.32 time: 0.123990 Sep 07 12:56:00.295595 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2434/4917] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:56:00 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:56:00.321630 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7f0423db-5a08-4bee-a3a1-502bdce16c4f tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:00.323732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7f0423db-5a08-4bee-a3a1-502bdce16c4f tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] [instance: a642f02a-a904-4117-8e50-5418e731ff50] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:00.347297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f0423db-5a08-4bee-a3a1-502bdce16c4f tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:00.349759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f0423db-5a08-4bee-a3a1-502bdce16c4f tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:00.350935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f0423db-5a08-4bee-a3a1-502bdce16c4f tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:00.352294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f0423db-5a08-4bee-a3a1-502bdce16c4f tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:00.353462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f0423db-5a08-4bee-a3a1-502bdce16c4f tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:00.355256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f0423db-5a08-4bee-a3a1-502bdce16c4f tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:00.382781 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ab137e46-0c5f-4a2e-a6e8-f164a324f856 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.513746 Sep 07 12:56:00.387562 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2484/4918] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:55:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:56:00.402018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f14bf103-9f42-4df5-ba55-92cfcbf3aae3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:00.404085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f14bf103-9f42-4df5-ba55-92cfcbf3aae3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:00.410878 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:00.414571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f14bf103-9f42-4df5-ba55-92cfcbf3aae3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:00.415354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f14bf103-9f42-4df5-ba55-92cfcbf3aae3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:00.416294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f14bf103-9f42-4df5-ba55-92cfcbf3aae3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:00.417236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f14bf103-9f42-4df5-ba55-92cfcbf3aae3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:00.417919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f14bf103-9f42-4df5-ba55-92cfcbf3aae3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:00.419192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f14bf103-9f42-4df5-ba55-92cfcbf3aae3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:00.974997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7f0423db-5a08-4bee-a3a1-502bdce16c4f tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a08986ff6f4c0592c850b2dabc931b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beea504630b84817b11d85cd03f92215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:01.004270 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7f0423db-5a08-4bee-a3a1-502bdce16c4f tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] 10.222.0.16 "GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50" status: 200 len: 1534 microversion: 2.1 time: 0.702600 Sep 07 12:56:01.004765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f14bf103-9f42-4df5-ba55-92cfcbf3aae3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:01.023732 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2435/4919] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:00 2022] GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50 => generated 1534 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:01.041590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-51527c91-f20d-4cca-9c76-94523959b453 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '.version_select at 0x7fc41393bb80>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:01.041858 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f14bf103-9f42-4df5-ba55-92cfcbf3aae3 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1509 microversion: 2.1 time: 0.649384 Sep 07 12:56:01.042878 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2485/4920] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:00 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1509 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:01.080120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-21255c0c-b14f-418a-bedb-41df36842c8f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:01.080771 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-21255c0c-b14f-418a-bedb-41df36842c8f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7ebb91d2-1102-474c-acb1-2791dfbd422a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:01.086789 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-51527c91-f20d-4cca-9c76-94523959b453 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1546266145" status: 204 len: 0 microversion: 2.32 time: 0.059255 Sep 07 12:56:01.087688 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2436/4921] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Sep 7 12:56:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1546266145 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:56:01.213714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e58b74c5-bb13-4112-8575-4cff65a6bbec tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:01.214748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e58b74c5-bb13-4112-8575-4cff65a6bbec tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:01.227998 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e58b74c5-bb13-4112-8575-4cff65a6bbec tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:01.228600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e58b74c5-bb13-4112-8575-4cff65a6bbec tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:01.229049 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e58b74c5-bb13-4112-8575-4cff65a6bbec tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:01.230339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e58b74c5-bb13-4112-8575-4cff65a6bbec tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:01.232027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e58b74c5-bb13-4112-8575-4cff65a6bbec tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:01.234053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-21255c0c-b14f-418a-bedb-41df36842c8f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:01.234763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e58b74c5-bb13-4112-8575-4cff65a6bbec tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:01.249304 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-21255c0c-b14f-418a-bedb-41df36842c8f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a" status: 200 len: 1228 microversion: 2.1 time: 0.189442 Sep 07 12:56:01.254728 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2486/4922] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:01 2022] GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a => generated 1228 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:01.720919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e58b74c5-bb13-4112-8575-4cff65a6bbec tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:01.781932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e58b74c5-bb13-4112-8575-4cff65a6bbec tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:01.785919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e58b74c5-bb13-4112-8575-4cff65a6bbec tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:01.788234 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e58b74c5-bb13-4112-8575-4cff65a6bbec tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1405 microversion: 2.20 time: 0.578725 Sep 07 12:56:01.789299 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2437/4923] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:56:01 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1405 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:56:01.861859 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-3ba24581-04ad-47d1-ba07-7a938cd0bd78 req-473bd4a6-2763-4316-a475-437ea506e99a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f328e5-ec00-4403-8196-cbefa047877b", "name": "network-vif-plugged", "status": "completed", "tag": "13d7f17d-cb66-4016-a84a-aec1e39c3e03"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:56:01.913718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3ba24581-04ad-47d1-ba07-7a938cd0bd78 req-473bd4a6-2763-4316-a475-437ea506e99a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:01.914906 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3ba24581-04ad-47d1-ba07-7a938cd0bd78 req-473bd4a6-2763-4316-a475-437ea506e99a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:01.917430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3ba24581-04ad-47d1-ba07-7a938cd0bd78 req-473bd4a6-2763-4316-a475-437ea506e99a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:01.950698 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-3ba24581-04ad-47d1-ba07-7a938cd0bd78 req-473bd4a6-2763-4316-a475-437ea506e99a service nova] Creating event network-vif-plugged:13d7f17d-cb66-4016-a84a-aec1e39c3e03 for instance 35f328e5-ec00-4403-8196-cbefa047877b on n-h2-852087-9 Sep 07 12:56:01.964634 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-3ba24581-04ad-47d1-ba07-7a938cd0bd78 req-473bd4a6-2763-4316-a475-437ea506e99a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106232 Sep 07 12:56:01.966933 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2487/4924] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:56:02.043312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fbd21fb3-5f21-4665-bba8-0e2a68a0bf91 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:02.043969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fbd21fb3-5f21-4665-bba8-0e2a68a0bf91 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] [instance: a642f02a-a904-4117-8e50-5418e731ff50] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:02.067594 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbd21fb3-5f21-4665-bba8-0e2a68a0bf91 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:02.068127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbd21fb3-5f21-4665-bba8-0e2a68a0bf91 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:02.070933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbd21fb3-5f21-4665-bba8-0e2a68a0bf91 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:02.071804 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbd21fb3-5f21-4665-bba8-0e2a68a0bf91 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:02.077457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbd21fb3-5f21-4665-bba8-0e2a68a0bf91 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:02.085618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-05636519-5790-453c-94dc-e8dc216b7f44 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:02.087191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-05636519-5790-453c-94dc-e8dc216b7f44 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:02.091482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbd21fb3-5f21-4665-bba8-0e2a68a0bf91 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:02.107941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05636519-5790-453c-94dc-e8dc216b7f44 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:02.111444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05636519-5790-453c-94dc-e8dc216b7f44 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:02.112475 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05636519-5790-453c-94dc-e8dc216b7f44 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:02.114903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05636519-5790-453c-94dc-e8dc216b7f44 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:02.115825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05636519-5790-453c-94dc-e8dc216b7f44 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:02.116530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05636519-5790-453c-94dc-e8dc216b7f44 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:02.813571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fbd21fb3-5f21-4665-bba8-0e2a68a0bf91 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a08986ff6f4c0592c850b2dabc931b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beea504630b84817b11d85cd03f92215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:02.826718 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fbd21fb3-5f21-4665-bba8-0e2a68a0bf91 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] 10.222.0.16 "GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50" status: 200 len: 1534 microversion: 2.1 time: 0.787635 Sep 07 12:56:02.829407 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2438/4925] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:02 2022] GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50 => generated 1534 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:56:02.846154 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8cc6d921-8c8a-4304-afed-00724d3e89a2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:02.847552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8cc6d921-8c8a-4304-afed-00724d3e89a2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7ebb91d2-1102-474c-acb1-2791dfbd422a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:02.870200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc6d921-8c8a-4304-afed-00724d3e89a2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:02.871209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc6d921-8c8a-4304-afed-00724d3e89a2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:02.873520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc6d921-8c8a-4304-afed-00724d3e89a2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:02.877655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc6d921-8c8a-4304-afed-00724d3e89a2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:02.879722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc6d921-8c8a-4304-afed-00724d3e89a2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:02.882059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cc6d921-8c8a-4304-afed-00724d3e89a2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:02.994144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-05636519-5790-453c-94dc-e8dc216b7f44 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:03.007016 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-05636519-5790-453c-94dc-e8dc216b7f44 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1509 microversion: 2.1 time: 0.927148 Sep 07 12:56:03.012112 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2488/4926] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:02 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1509 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:03.030611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e2553b3e-e920-4262-8c7c-ac2608f5a555 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:03.033584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e2553b3e-e920-4262-8c7c-ac2608f5a555 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:03.056770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2553b3e-e920-4262-8c7c-ac2608f5a555 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:03.064669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2553b3e-e920-4262-8c7c-ac2608f5a555 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:03.065603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2553b3e-e920-4262-8c7c-ac2608f5a555 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:03.070522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2553b3e-e920-4262-8c7c-ac2608f5a555 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:03.072430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2553b3e-e920-4262-8c7c-ac2608f5a555 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:03.075291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2553b3e-e920-4262-8c7c-ac2608f5a555 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:03.158734 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8cc6d921-8c8a-4304-afed-00724d3e89a2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:03.174775 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8cc6d921-8c8a-4304-afed-00724d3e89a2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a" status: 200 len: 1288 microversion: 2.1 time: 0.338465 Sep 07 12:56:03.188939 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2439/4927] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:02 2022] GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a => generated 1288 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:03.670150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e2553b3e-e920-4262-8c7c-ac2608f5a555 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:03.699755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c6c2b4bb-4793-4e37-bfe4-b3446a38340a req-efdbddd1-6733-46a8-ba8c-18e6f3ab4eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f37444bc-ff3d-40dd-8501-7b8794d8b1ef", "tag": "f71d91c1-fd88-4617-a671-95e43e01a47c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:56:03.702614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e2553b3e-e920-4262-8c7c-ac2608f5a555 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:03.712720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e2553b3e-e920-4262-8c7c-ac2608f5a555 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:03.718260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c6c2b4bb-4793-4e37-bfe4-b3446a38340a req-efdbddd1-6733-46a8-ba8c-18e6f3ab4eb6 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:03.718485 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e2553b3e-e920-4262-8c7c-ac2608f5a555 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1405 microversion: 2.20 time: 0.699028 Sep 07 12:56:03.723781 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c6c2b4bb-4793-4e37-bfe4-b3446a38340a req-efdbddd1-6733-46a8-ba8c-18e6f3ab4eb6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:03.727378 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c6c2b4bb-4793-4e37-bfe4-b3446a38340a req-efdbddd1-6733-46a8-ba8c-18e6f3ab4eb6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:03.751247 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2489/4928] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:56:03 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1405 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:56:03.756555 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c6c2b4bb-4793-4e37-bfe4-b3446a38340a req-efdbddd1-6733-46a8-ba8c-18e6f3ab4eb6 service nova] Creating event network-changed:f71d91c1-fd88-4617-a671-95e43e01a47c for instance f37444bc-ff3d-40dd-8501-7b8794d8b1ef on n-h2-852087-9 Sep 07 12:56:03.779545 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c6c2b4bb-4793-4e37-bfe4-b3446a38340a req-efdbddd1-6733-46a8-ba8c-18e6f3ab4eb6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083468 Sep 07 12:56:03.781092 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2440/4929] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:56:03.886527 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-49cff9e7-7124-450c-aadd-c01178d38283 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:03.921739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-49cff9e7-7124-450c-aadd-c01178d38283 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] [instance: a642f02a-a904-4117-8e50-5418e731ff50] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:03.921739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49cff9e7-7124-450c-aadd-c01178d38283 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:03.921739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49cff9e7-7124-450c-aadd-c01178d38283 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:03.921739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49cff9e7-7124-450c-aadd-c01178d38283 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:03.921739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49cff9e7-7124-450c-aadd-c01178d38283 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:03.926045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49cff9e7-7124-450c-aadd-c01178d38283 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:03.926297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49cff9e7-7124-450c-aadd-c01178d38283 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:04.064943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d2b048d7-4941-4c17-8ed3-af4c0ddf7fb4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:04.071970 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d2b048d7-4941-4c17-8ed3-af4c0ddf7fb4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:04.095742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2b048d7-4941-4c17-8ed3-af4c0ddf7fb4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:04.103274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2b048d7-4941-4c17-8ed3-af4c0ddf7fb4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:04.104342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2b048d7-4941-4c17-8ed3-af4c0ddf7fb4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:04.110765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2b048d7-4941-4c17-8ed3-af4c0ddf7fb4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:04.123486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2b048d7-4941-4c17-8ed3-af4c0ddf7fb4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:04.124560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2b048d7-4941-4c17-8ed3-af4c0ddf7fb4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:05.012265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-49cff9e7-7124-450c-aadd-c01178d38283 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a08986ff6f4c0592c850b2dabc931b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beea504630b84817b11d85cd03f92215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:05.145057 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-49cff9e7-7124-450c-aadd-c01178d38283 tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] 10.222.0.16 "GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50" status: 200 len: 1492 microversion: 2.1 time: 1.269079 Sep 07 12:56:05.154506 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2490/4930] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:03 2022] GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50 => generated 1492 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:05.192337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c7da5819-7d89-41f3-bc78-7e94d059201c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:05.196494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c7da5819-7d89-41f3-bc78-7e94d059201c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7ebb91d2-1102-474c-acb1-2791dfbd422a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:05.215075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7da5819-7d89-41f3-bc78-7e94d059201c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:05.215893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7da5819-7d89-41f3-bc78-7e94d059201c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:05.216503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7da5819-7d89-41f3-bc78-7e94d059201c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:05.217413 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7da5819-7d89-41f3-bc78-7e94d059201c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:05.218071 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7da5819-7d89-41f3-bc78-7e94d059201c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:05.218658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7da5819-7d89-41f3-bc78-7e94d059201c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:05.690254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:05.826351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c7da5819-7d89-41f3-bc78-7e94d059201c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:05.883009 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c7da5819-7d89-41f3-bc78-7e94d059201c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a" status: 200 len: 1286 microversion: 2.1 time: 0.717277 Sep 07 12:56:05.908456 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2491/4931] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:05 2022] GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a => generated 1286 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:05.931430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-01d5bb4a-f4c5-46cc-ab82-3f2f3501a273 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:05.932152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-01d5bb4a-f4c5-46cc-ab82-3f2f3501a273 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:05.973705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01d5bb4a-f4c5-46cc-ab82-3f2f3501a273 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:05.974223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01d5bb4a-f4c5-46cc-ab82-3f2f3501a273 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:05.974677 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01d5bb4a-f4c5-46cc-ab82-3f2f3501a273 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:05.996319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01d5bb4a-f4c5-46cc-ab82-3f2f3501a273 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:06.002768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01d5bb4a-f4c5-46cc-ab82-3f2f3501a273 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:06.004573 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01d5bb4a-f4c5-46cc-ab82-3f2f3501a273 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:07.461095 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-01d5bb4a-f4c5-46cc-ab82-3f2f3501a273 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:07.474493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-01d5bb4a-f4c5-46cc-ab82-3f2f3501a273 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:07.483981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-01d5bb4a-f4c5-46cc-ab82-3f2f3501a273 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:07.486530 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-01d5bb4a-f4c5-46cc-ab82-3f2f3501a273 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1597 microversion: 2.20 time: 1.576234 Sep 07 12:56:07.489821 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2492/4932] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:56:05 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1597 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:56:07.501540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-e17d9a2b-bf81-48d1-ab69-d43a077893c0 req-7e4e9f1c-506d-4f04-87c7-2f0b85fb2f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a642f02a-a904-4117-8e50-5418e731ff50", "name": "network-vif-deleted", "tag": "994f6a7e-ed3d-4aa9-a1a1-f470367499cb"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:56:07.527297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e17d9a2b-bf81-48d1-ab69-d43a077893c0 req-7e4e9f1c-506d-4f04-87c7-2f0b85fb2f5e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:07.528689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e17d9a2b-bf81-48d1-ab69-d43a077893c0 req-7e4e9f1c-506d-4f04-87c7-2f0b85fb2f5e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:07.531210 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e17d9a2b-bf81-48d1-ab69-d43a077893c0 req-7e4e9f1c-506d-4f04-87c7-2f0b85fb2f5e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:07.574212 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-e17d9a2b-bf81-48d1-ab69-d43a077893c0 req-7e4e9f1c-506d-4f04-87c7-2f0b85fb2f5e service nova] Creating event network-vif-deleted:994f6a7e-ed3d-4aa9-a1a1-f470367499cb for instance a642f02a-a904-4117-8e50-5418e731ff50 on n-h2-852087-9 Sep 07 12:56:07.595664 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-e17d9a2b-bf81-48d1-ab69-d43a077893c0 req-7e4e9f1c-506d-4f04-87c7-2f0b85fb2f5e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101322 Sep 07 12:56:07.598270 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2493/4933] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:56:07.612472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eb2f7dc3-596b-4f50-a790-6519e99be6ef tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:07.614535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-eb2f7dc3-596b-4f50-a790-6519e99be6ef tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] [instance: a642f02a-a904-4117-8e50-5418e731ff50] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:07.633838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb2f7dc3-596b-4f50-a790-6519e99be6ef tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:07.636808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb2f7dc3-596b-4f50-a790-6519e99be6ef tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:07.640152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb2f7dc3-596b-4f50-a790-6519e99be6ef tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:07.642397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb2f7dc3-596b-4f50-a790-6519e99be6ef tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:07.643321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb2f7dc3-596b-4f50-a790-6519e99be6ef tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:07.644155 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb2f7dc3-596b-4f50-a790-6519e99be6ef tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:07.694172 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-eb2f7dc3-596b-4f50-a790-6519e99be6ef tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] HTTP exception thrown: Instance a642f02a-a904-4117-8e50-5418e731ff50 could not be found. Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eb2f7dc3-596b-4f50-a790-6519e99be6ef tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Request method failure captured: Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50 HTTP/1.1 Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJSbBQPIgwgAJceAD88Fw0roPNUbUdUGiatGr2eZKAq1-5PWRx7eYGDvL2njyZ6u4PyfEG-w9OlIy0D1JYGiImkgiQdEqDOSqM-EM6UxFXXa1pufQ5Ft7Ezf_jwjO4DoPDnKHUoBm2cLkcA1rWdsqkMGJkPVg-AiI3EEg8VNRsFn1UI Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: beea504630b84817b11d85cd03f92215 Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-285764940 Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/beea504630b84817b11d85cd03f92215"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_beea504630b84817b11d85cd03f92215"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/beea504630b84817b11d85cd03f92215"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/beea504630b84817b11d85cd03f92215"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-285764940 Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: beea504630b84817b11d85cd03f92215 Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-285764940 Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestMultiTenantJSON-285764940-project Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: a9a08986ff6f4c0592c850b2dabc931b Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-285764940-project Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance a642f02a-a904-4117-8e50-5418e731ff50 could not be found. Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'a642f02a-a904-4117-8e50-5418e731ff50'} Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a642f02a-a904-4117-8e50-5418e731ff50 could not be found. Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a642f02a-a904-4117-8e50-5418e731ff50 could not be found. Sep 07 12:56:07.698335 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:07.702191 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:56:07.702191 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:07.702191 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:56:07.702191 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:56:07.702191 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:56:07.702191 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:56:07.702191 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:56:07.702191 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a642f02a-a904-4117-8e50-5418e731ff50 could not be found. Sep 07 12:56:07.702191 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:07.702191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eb2f7dc3-596b-4f50-a790-6519e99be6ef tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] Returning 404 to user: Instance a642f02a-a904-4117-8e50-5418e731ff50 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:56:07.702191 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eb2f7dc3-596b-4f50-a790-6519e99be6ef tempest-ServersNegativeTestMultiTenantJSON-285764940 tempest-ServersNegativeTestMultiTenantJSON-285764940-project] 10.222.0.16 "GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50" status: 404 len: 111 microversion: 2.1 time: 0.100226 Sep 07 12:56:07.709432 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2494/4934] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:07 2022] GET /compute/v2.1/servers/a642f02a-a904-4117-8e50-5418e731ff50 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:56:07.722368 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-440ca23f-fde3-4b95-87d3-08c1b8f6f42d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:07.723688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-440ca23f-fde3-4b95-87d3-08c1b8f6f42d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7ebb91d2-1102-474c-acb1-2791dfbd422a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:07.738303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-440ca23f-fde3-4b95-87d3-08c1b8f6f42d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:07.739310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-440ca23f-fde3-4b95-87d3-08c1b8f6f42d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:07.741044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-440ca23f-fde3-4b95-87d3-08c1b8f6f42d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:07.742402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-440ca23f-fde3-4b95-87d3-08c1b8f6f42d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:07.743242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-440ca23f-fde3-4b95-87d3-08c1b8f6f42d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:07.744111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-440ca23f-fde3-4b95-87d3-08c1b8f6f42d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:08.050387 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d2b048d7-4941-4c17-8ed3-af4c0ddf7fb4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:08.065449 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d2b048d7-4941-4c17-8ed3-af4c0ddf7fb4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1509 microversion: 2.1 time: 4.009078 Sep 07 12:56:08.075949 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2441/4935] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:04 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1509 bytes in 4021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:08.082086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b5a97f1-f991-40e7-91fc-7badac8e1cef tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:08.086495 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2b5a97f1-f991-40e7-91fc-7badac8e1cef tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:08.105213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b5a97f1-f991-40e7-91fc-7badac8e1cef tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:08.106361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b5a97f1-f991-40e7-91fc-7badac8e1cef tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:08.107101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b5a97f1-f991-40e7-91fc-7badac8e1cef tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:08.108294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b5a97f1-f991-40e7-91fc-7badac8e1cef tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:08.109210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b5a97f1-f991-40e7-91fc-7badac8e1cef tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:08.109939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b5a97f1-f991-40e7-91fc-7badac8e1cef tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:08.334840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-440ca23f-fde3-4b95-87d3-08c1b8f6f42d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:08.349905 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-440ca23f-fde3-4b95-87d3-08c1b8f6f42d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a" status: 200 len: 1328 microversion: 2.1 time: 0.638704 Sep 07 12:56:08.355296 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2495/4936] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:07 2022] GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a => generated 1328 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:08.381952 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2b5a97f1-f991-40e7-91fc-7badac8e1cef tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.292531 Sep 07 12:56:08.381952 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2442/4937] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Sep 7 12:56:08 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b/os-interface => generated 284 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:56:09.125986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c74ef518-3a5f-4dd3-8ae1-6608b48eaa6f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:09.126731 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c74ef518-3a5f-4dd3-8ae1-6608b48eaa6f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:09.144021 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c74ef518-3a5f-4dd3-8ae1-6608b48eaa6f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:09.144634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c74ef518-3a5f-4dd3-8ae1-6608b48eaa6f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:09.145158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c74ef518-3a5f-4dd3-8ae1-6608b48eaa6f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:09.146007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c74ef518-3a5f-4dd3-8ae1-6608b48eaa6f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:09.146553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c74ef518-3a5f-4dd3-8ae1-6608b48eaa6f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:09.147097 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c74ef518-3a5f-4dd3-8ae1-6608b48eaa6f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:09.187368 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:09.441352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c607c50e-ada1-4afb-b29f-d798e0292fc8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:09.442812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c607c50e-ada1-4afb-b29f-d798e0292fc8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7ebb91d2-1102-474c-acb1-2791dfbd422a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:09.461605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c607c50e-ada1-4afb-b29f-d798e0292fc8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:09.462496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c607c50e-ada1-4afb-b29f-d798e0292fc8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:09.465199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c607c50e-ada1-4afb-b29f-d798e0292fc8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:09.466326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c607c50e-ada1-4afb-b29f-d798e0292fc8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:09.467007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c607c50e-ada1-4afb-b29f-d798e0292fc8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:09.468092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c607c50e-ada1-4afb-b29f-d798e0292fc8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:10.136180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:10.250738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c74ef518-3a5f-4dd3-8ae1-6608b48eaa6f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:10.307647 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c74ef518-3a5f-4dd3-8ae1-6608b48eaa6f tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1509 microversion: 2.1 time: 1.185565 Sep 07 12:56:10.310027 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2496/4938] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:09 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1509 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:10.336748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-b9e5a073-03e8-453c-a3db-2cf0c2afb5b9 req-a7e50188-6831-4e9a-8738-4a404c3aba44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ebb91d2-1102-474c-acb1-2791dfbd422a", "tag": "648d6b6f-f663-4dea-97c9-ae0e93504e67"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:56:10.355167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b9e5a073-03e8-453c-a3db-2cf0c2afb5b9 req-a7e50188-6831-4e9a-8738-4a404c3aba44 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:10.357816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b9e5a073-03e8-453c-a3db-2cf0c2afb5b9 req-a7e50188-6831-4e9a-8738-4a404c3aba44 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:10.358942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b9e5a073-03e8-453c-a3db-2cf0c2afb5b9 req-a7e50188-6831-4e9a-8738-4a404c3aba44 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:10.398624 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-b9e5a073-03e8-453c-a3db-2cf0c2afb5b9 req-a7e50188-6831-4e9a-8738-4a404c3aba44 service nova] Creating event network-changed:648d6b6f-f663-4dea-97c9-ae0e93504e67 for instance 7ebb91d2-1102-474c-acb1-2791dfbd422a on n-h1-852087-9 Sep 07 12:56:10.416465 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-b9e5a073-03e8-453c-a3db-2cf0c2afb5b9 req-a7e50188-6831-4e9a-8738-4a404c3aba44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103746 Sep 07 12:56:10.418088 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2497/4939] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:56:10.541550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c607c50e-ada1-4afb-b29f-d798e0292fc8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:10.577164 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c607c50e-ada1-4afb-b29f-d798e0292fc8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a" status: 200 len: 1328 microversion: 2.1 time: 1.139459 Sep 07 12:56:10.606432 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2443/4940] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:09 2022] GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a => generated 1328 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:56:11.343333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a8876b0f-38a1-4b78-8ad6-46628be66d2c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:11.349405 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a8876b0f-38a1-4b78-8ad6-46628be66d2c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:11.365992 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:11.370776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8876b0f-38a1-4b78-8ad6-46628be66d2c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:11.371901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8876b0f-38a1-4b78-8ad6-46628be66d2c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:11.373050 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8876b0f-38a1-4b78-8ad6-46628be66d2c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:11.374882 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8876b0f-38a1-4b78-8ad6-46628be66d2c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:11.376474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8876b0f-38a1-4b78-8ad6-46628be66d2c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:11.377927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8876b0f-38a1-4b78-8ad6-46628be66d2c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:11.653780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-40ffe37a-c639-4ab2-b4b1-fe63bf85e990 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:11.657471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-40ffe37a-c639-4ab2-b4b1-fe63bf85e990 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7ebb91d2-1102-474c-acb1-2791dfbd422a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:11.686136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40ffe37a-c639-4ab2-b4b1-fe63bf85e990 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:11.688516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40ffe37a-c639-4ab2-b4b1-fe63bf85e990 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:11.692183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40ffe37a-c639-4ab2-b4b1-fe63bf85e990 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:11.695320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40ffe37a-c639-4ab2-b4b1-fe63bf85e990 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:11.696386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40ffe37a-c639-4ab2-b4b1-fe63bf85e990 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:11.697665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40ffe37a-c639-4ab2-b4b1-fe63bf85e990 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:12.394788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-40ffe37a-c639-4ab2-b4b1-fe63bf85e990 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:12.401464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:12.431284 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-40ffe37a-c639-4ab2-b4b1-fe63bf85e990 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a" status: 200 len: 1328 microversion: 2.1 time: 0.789917 Sep 07 12:56:12.457281 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2444/4941] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:11 2022] GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a => generated 1328 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:13.190550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a8876b0f-38a1-4b78-8ad6-46628be66d2c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:13.206590 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a8876b0f-38a1-4b78-8ad6-46628be66d2c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1509 microversion: 2.1 time: 1.875253 Sep 07 12:56:13.208825 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2498/4942] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:11 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1509 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:13.479776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-63a6e69b-7a4f-43fc-96cf-54696c814e7d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:13.482026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-63a6e69b-7a4f-43fc-96cf-54696c814e7d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7ebb91d2-1102-474c-acb1-2791dfbd422a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:13.498376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63a6e69b-7a4f-43fc-96cf-54696c814e7d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:13.499985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63a6e69b-7a4f-43fc-96cf-54696c814e7d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:13.503878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63a6e69b-7a4f-43fc-96cf-54696c814e7d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:13.505861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63a6e69b-7a4f-43fc-96cf-54696c814e7d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:13.507046 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63a6e69b-7a4f-43fc-96cf-54696c814e7d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:13.508170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63a6e69b-7a4f-43fc-96cf-54696c814e7d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:14.246774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e4e7abea-c1e9-4190-9d37-09a3d9bc97d7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:14.247982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e4e7abea-c1e9-4190-9d37-09a3d9bc97d7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:14.258612 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4e7abea-c1e9-4190-9d37-09a3d9bc97d7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:14.259325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4e7abea-c1e9-4190-9d37-09a3d9bc97d7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:14.260983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4e7abea-c1e9-4190-9d37-09a3d9bc97d7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:14.262489 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4e7abea-c1e9-4190-9d37-09a3d9bc97d7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:14.263113 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4e7abea-c1e9-4190-9d37-09a3d9bc97d7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:14.263684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4e7abea-c1e9-4190-9d37-09a3d9bc97d7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:14.419764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-63a6e69b-7a4f-43fc-96cf-54696c814e7d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:14.445623 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-63a6e69b-7a4f-43fc-96cf-54696c814e7d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a" status: 200 len: 1328 microversion: 2.1 time: 0.972354 Sep 07 12:56:14.459248 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2445/4943] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:13 2022] GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a => generated 1328 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:15.417297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e4e7abea-c1e9-4190-9d37-09a3d9bc97d7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:15.442563 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e4e7abea-c1e9-4190-9d37-09a3d9bc97d7 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1506 microversion: 2.1 time: 1.201180 Sep 07 12:56:15.443640 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2499/4944] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:14 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1506 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:15.498536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a5465d96-4c3f-4674-901b-63a6f7a33e58 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:15.511087 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a5465d96-4c3f-4674-901b-63a6f7a33e58 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7ebb91d2-1102-474c-acb1-2791dfbd422a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:15.531842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5465d96-4c3f-4674-901b-63a6f7a33e58 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:15.533002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5465d96-4c3f-4674-901b-63a6f7a33e58 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:15.533699 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5465d96-4c3f-4674-901b-63a6f7a33e58 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:15.534642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5465d96-4c3f-4674-901b-63a6f7a33e58 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:15.535279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5465d96-4c3f-4674-901b-63a6f7a33e58 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:15.535877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5465d96-4c3f-4674-901b-63a6f7a33e58 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:15.623543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-3c173ed3-f192-432d-8dde-bbd5aa3bbc56 req-aebef3a5-cdef-42b7-86a6-19f5cc01e268 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35f328e5-ec00-4403-8196-cbefa047877b", "tag": "13d7f17d-cb66-4016-a84a-aec1e39c3e03"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:56:15.644198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3c173ed3-f192-432d-8dde-bbd5aa3bbc56 req-aebef3a5-cdef-42b7-86a6-19f5cc01e268 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:15.645430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3c173ed3-f192-432d-8dde-bbd5aa3bbc56 req-aebef3a5-cdef-42b7-86a6-19f5cc01e268 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:15.646568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3c173ed3-f192-432d-8dde-bbd5aa3bbc56 req-aebef3a5-cdef-42b7-86a6-19f5cc01e268 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:15.670754 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-3c173ed3-f192-432d-8dde-bbd5aa3bbc56 req-aebef3a5-cdef-42b7-86a6-19f5cc01e268 service nova] Creating event network-changed:13d7f17d-cb66-4016-a84a-aec1e39c3e03 for instance 35f328e5-ec00-4403-8196-cbefa047877b on n-h2-852087-9 Sep 07 12:56:15.691674 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-3c173ed3-f192-432d-8dde-bbd5aa3bbc56 req-aebef3a5-cdef-42b7-86a6-19f5cc01e268 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072153 Sep 07 12:56:15.693082 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2500/4945] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:56:15.996736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a5465d96-4c3f-4674-901b-63a6f7a33e58 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:16.009968 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a5465d96-4c3f-4674-901b-63a6f7a33e58 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a" status: 200 len: 1328 microversion: 2.1 time: 0.518657 Sep 07 12:56:16.012679 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2446/4946] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:15 2022] GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a => generated 1328 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:56:16.489584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-37a7a2d5-83f2-437a-b864-890fe5961911 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:16.490748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-37a7a2d5-83f2-437a-b864-890fe5961911 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:16.517996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37a7a2d5-83f2-437a-b864-890fe5961911 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:16.518567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37a7a2d5-83f2-437a-b864-890fe5961911 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:16.519009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37a7a2d5-83f2-437a-b864-890fe5961911 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:16.519932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37a7a2d5-83f2-437a-b864-890fe5961911 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:16.520769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37a7a2d5-83f2-437a-b864-890fe5961911 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:16.521573 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37a7a2d5-83f2-437a-b864-890fe5961911 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:17.058162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e77611bb-7f26-43d2-8d50-d1fb9765ff45 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:17.059397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e77611bb-7f26-43d2-8d50-d1fb9765ff45 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7ebb91d2-1102-474c-acb1-2791dfbd422a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:17.071893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e77611bb-7f26-43d2-8d50-d1fb9765ff45 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:17.076346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e77611bb-7f26-43d2-8d50-d1fb9765ff45 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:17.078476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e77611bb-7f26-43d2-8d50-d1fb9765ff45 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:17.082696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e77611bb-7f26-43d2-8d50-d1fb9765ff45 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:17.083365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e77611bb-7f26-43d2-8d50-d1fb9765ff45 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:17.083992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e77611bb-7f26-43d2-8d50-d1fb9765ff45 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:18.232646 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-37a7a2d5-83f2-437a-b864-890fe5961911 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:18.248118 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-37a7a2d5-83f2-437a-b864-890fe5961911 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1506 microversion: 2.1 time: 1.763966 Sep 07 12:56:18.249320 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2501/4947] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:16 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1506 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:18.490562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e77611bb-7f26-43d2-8d50-d1fb9765ff45 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:18.501823 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e77611bb-7f26-43d2-8d50-d1fb9765ff45 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a" status: 200 len: 1328 microversion: 2.1 time: 1.449142 Sep 07 12:56:18.502317 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2447/4948] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:17 2022] GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a => generated 1328 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:56:19.305904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c4327df3-bda2-4939-964e-d32095761d4b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:19.307247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c4327df3-bda2-4939-964e-d32095761d4b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:19.323746 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-294b29aa-41e2-46d4-9925-e3587101c15f req-cc5f9c6a-8d2a-4c0d-aa2e-0f6f577e07ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812b8c7f-9408-4862-a000-4b444babe995", "name": "network-vif-unplugged", "status": "completed", "tag": "f22238e2-dfbe-46a4-8e28-684befdd390b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:56:19.347104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4327df3-bda2-4939-964e-d32095761d4b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:19.347915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4327df3-bda2-4939-964e-d32095761d4b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:19.355356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4327df3-bda2-4939-964e-d32095761d4b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:19.356964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4327df3-bda2-4939-964e-d32095761d4b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:19.358714 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4327df3-bda2-4939-964e-d32095761d4b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:19.361805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-294b29aa-41e2-46d4-9925-e3587101c15f req-cc5f9c6a-8d2a-4c0d-aa2e-0f6f577e07ca service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:19.362736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4327df3-bda2-4939-964e-d32095761d4b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:19.365179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-294b29aa-41e2-46d4-9925-e3587101c15f req-cc5f9c6a-8d2a-4c0d-aa2e-0f6f577e07ca service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:19.366614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-294b29aa-41e2-46d4-9925-e3587101c15f req-cc5f9c6a-8d2a-4c0d-aa2e-0f6f577e07ca service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:19.426560 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-294b29aa-41e2-46d4-9925-e3587101c15f req-cc5f9c6a-8d2a-4c0d-aa2e-0f6f577e07ca service nova] Creating event network-vif-unplugged:f22238e2-dfbe-46a4-8e28-684befdd390b for instance 812b8c7f-9408-4862-a000-4b444babe995 on n-h2-852087-9 Sep 07 12:56:19.443292 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-294b29aa-41e2-46d4-9925-e3587101c15f req-cc5f9c6a-8d2a-4c0d-aa2e-0f6f577e07ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125982 Sep 07 12:56:19.448104 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2448/4949] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:56:19.546898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ac345779-d440-44f3-a8ec-8a3cbab4cd22 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:19.548137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ac345779-d440-44f3-a8ec-8a3cbab4cd22 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7ebb91d2-1102-474c-acb1-2791dfbd422a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:19.561299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac345779-d440-44f3-a8ec-8a3cbab4cd22 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:19.566444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac345779-d440-44f3-a8ec-8a3cbab4cd22 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:19.566902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac345779-d440-44f3-a8ec-8a3cbab4cd22 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:19.567652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac345779-d440-44f3-a8ec-8a3cbab4cd22 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:19.572641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac345779-d440-44f3-a8ec-8a3cbab4cd22 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:19.573572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac345779-d440-44f3-a8ec-8a3cbab4cd22 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:20.395727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c4327df3-bda2-4939-964e-d32095761d4b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:20.488280 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c4327df3-bda2-4939-964e-d32095761d4b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1506 microversion: 2.1 time: 1.189929 Sep 07 12:56:20.489435 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2502/4950] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:19 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1506 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:20.585643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ac345779-d440-44f3-a8ec-8a3cbab4cd22 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:20.600143 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ac345779-d440-44f3-a8ec-8a3cbab4cd22 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a" status: 200 len: 1328 microversion: 2.1 time: 1.060492 Sep 07 12:56:20.605981 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2449/4951] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:19 2022] GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a => generated 1328 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:21.513017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b392a972-efff-4e53-bc94-5ad8d642ce73 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:21.515692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b392a972-efff-4e53-bc94-5ad8d642ce73 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:21.535966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b392a972-efff-4e53-bc94-5ad8d642ce73 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:21.536900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b392a972-efff-4e53-bc94-5ad8d642ce73 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:21.541154 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b392a972-efff-4e53-bc94-5ad8d642ce73 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:21.543758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b392a972-efff-4e53-bc94-5ad8d642ce73 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:21.549741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b392a972-efff-4e53-bc94-5ad8d642ce73 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:21.552207 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b392a972-efff-4e53-bc94-5ad8d642ce73 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:21.653064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9315595c-d848-4a48-9aa6-37d12c70b475 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:21.653064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9315595c-d848-4a48-9aa6-37d12c70b475 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7ebb91d2-1102-474c-acb1-2791dfbd422a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:21.669374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9315595c-d848-4a48-9aa6-37d12c70b475 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:21.669951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9315595c-d848-4a48-9aa6-37d12c70b475 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:21.672012 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9315595c-d848-4a48-9aa6-37d12c70b475 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:21.672875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9315595c-d848-4a48-9aa6-37d12c70b475 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:21.673407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9315595c-d848-4a48-9aa6-37d12c70b475 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:21.679171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9315595c-d848-4a48-9aa6-37d12c70b475 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:22.325105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b392a972-efff-4e53-bc94-5ad8d642ce73 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:22.350613 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b392a972-efff-4e53-bc94-5ad8d642ce73 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 200 len: 1509 microversion: 2.1 time: 0.837534 Sep 07 12:56:22.373365 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2503/4952] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:21 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 1509 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:22.384210 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-de7479c2-e55b-431b-a524-b63b79fbe099 req-d53af28c-8824-4ce0-b97e-3344004577cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ebb91d2-1102-474c-acb1-2791dfbd422a", "name": "network-vif-plugged", "status": "completed", "tag": "648d6b6f-f663-4dea-97c9-ae0e93504e67"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:56:22.400487 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9315595c-d848-4a48-9aa6-37d12c70b475 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:22.409456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-de7479c2-e55b-431b-a524-b63b79fbe099 req-d53af28c-8824-4ce0-b97e-3344004577cd service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:22.411424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-de7479c2-e55b-431b-a524-b63b79fbe099 req-d53af28c-8824-4ce0-b97e-3344004577cd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:22.412110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-de7479c2-e55b-431b-a524-b63b79fbe099 req-d53af28c-8824-4ce0-b97e-3344004577cd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:22.419791 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9315595c-d848-4a48-9aa6-37d12c70b475 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a" status: 200 len: 1328 microversion: 2.1 time: 0.773780 Sep 07 12:56:22.435475 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2450/4953] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:21 2022] GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a => generated 1328 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:56:22.436962 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-de7479c2-e55b-431b-a524-b63b79fbe099 req-d53af28c-8824-4ce0-b97e-3344004577cd service nova] Creating event network-vif-plugged:648d6b6f-f663-4dea-97c9-ae0e93504e67 for instance 7ebb91d2-1102-474c-acb1-2791dfbd422a on n-h1-852087-9 Sep 07 12:56:22.446442 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-de7479c2-e55b-431b-a524-b63b79fbe099 req-d53af28c-8824-4ce0-b97e-3344004577cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069235 Sep 07 12:56:22.447573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-48d4d556-871f-400e-a0b3-bf9f7420adde tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:22.449353 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2504/4954] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:56:22.455609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-48d4d556-871f-400e-a0b3-bf9f7420adde tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:22.473227 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48d4d556-871f-400e-a0b3-bf9f7420adde tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:22.475418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48d4d556-871f-400e-a0b3-bf9f7420adde tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:22.476446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48d4d556-871f-400e-a0b3-bf9f7420adde tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:22.478037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48d4d556-871f-400e-a0b3-bf9f7420adde tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:22.478811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48d4d556-871f-400e-a0b3-bf9f7420adde tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:22.479457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48d4d556-871f-400e-a0b3-bf9f7420adde tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:22.639536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aabe1c70-e894-4da1-bcd0-9f5df0b21237 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:22.640695 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aabe1c70-e894-4da1-bcd0-9f5df0b21237 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:22.662120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aabe1c70-e894-4da1-bcd0-9f5df0b21237 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:22.664505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aabe1c70-e894-4da1-bcd0-9f5df0b21237 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:22.665327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aabe1c70-e894-4da1-bcd0-9f5df0b21237 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:22.666407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aabe1c70-e894-4da1-bcd0-9f5df0b21237 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:22.666978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aabe1c70-e894-4da1-bcd0-9f5df0b21237 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:22.667667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aabe1c70-e894-4da1-bcd0-9f5df0b21237 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:22.714037 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-aabe1c70-e894-4da1-bcd0-9f5df0b21237 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] HTTP exception thrown: Instance e9352ac2-475e-4c77-aa85-5ecd566563b2 could not be found. Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aabe1c70-e894-4da1-bcd0-9f5df0b21237 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Request method failure captured: Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 HTTP/1.1 Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJLWBuiK9Zwtf-5SJBGQ_yHHu0Iad1RHxrRcWUBDwgXSJ1GR31PEZrJdB9KCga6FWHK7ZaCy9AAqAi8NS7CPhyyDapn9WD__TAuEoH2XS2hGu6GREMs29eY74y6ndxhK6E1U_yTDaQ4AQw9rEnDBW5jk3Z_vUby6JGKsL-PupP7jojw Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.32 Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 17c0c643a1704bc2be7aaedfd11802e8 Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TaggedBootDevicesTest-1570794625 Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/17c0c643a1704bc2be7aaedfd11802e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_17c0c643a1704bc2be7aaedfd11802e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/17c0c643a1704bc2be7aaedfd11802e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/17c0c643a1704bc2be7aaedfd11802e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TaggedBootDevicesTest-1570794625 Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 17c0c643a1704bc2be7aaedfd11802e8 Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1570794625 Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TaggedBootDevicesTest-1570794625-project Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 9b0cc4dd3ef645b18341a7273cb0522c Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TaggedBootDevicesTest-1570794625-project Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance e9352ac2-475e-4c77-aa85-5ecd566563b2 could not be found. Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'e9352ac2-475e-4c77-aa85-5ecd566563b2'} Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9352ac2-475e-4c77-aa85-5ecd566563b2 could not be found. Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:56:22.717932 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:56:22.723785 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9352ac2-475e-4c77-aa85-5ecd566563b2 could not be found. Sep 07 12:56:22.723785 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:22.723785 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:56:22.723785 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:22.723785 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:56:22.723785 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:56:22.723785 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:56:22.723785 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:56:22.723785 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:56:22.723785 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9352ac2-475e-4c77-aa85-5ecd566563b2 could not be found. Sep 07 12:56:22.723785 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:22.730996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aabe1c70-e894-4da1-bcd0-9f5df0b21237 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Returning 404 to user: Instance e9352ac2-475e-4c77-aa85-5ecd566563b2 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:56:22.732255 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aabe1c70-e894-4da1-bcd0-9f5df0b21237 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 404 len: 111 microversion: 2.32 time: 0.104509 Sep 07 12:56:22.732862 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2505/4955] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 12:56:22 2022] DELETE /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:56:22.742685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8fd4088f-4678-4f07-a57d-9b1396f12f41 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:22.743690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8fd4088f-4678-4f07-a57d-9b1396f12f41 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] [instance: e9352ac2-475e-4c77-aa85-5ecd566563b2] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:22.753893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fd4088f-4678-4f07-a57d-9b1396f12f41 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:22.754678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fd4088f-4678-4f07-a57d-9b1396f12f41 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:22.755238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fd4088f-4678-4f07-a57d-9b1396f12f41 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:22.756106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fd4088f-4678-4f07-a57d-9b1396f12f41 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:22.758355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fd4088f-4678-4f07-a57d-9b1396f12f41 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:22.760249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8fd4088f-4678-4f07-a57d-9b1396f12f41 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:22.790900 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-8fd4088f-4678-4f07-a57d-9b1396f12f41 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] HTTP exception thrown: Instance e9352ac2-475e-4c77-aa85-5ecd566563b2 could not be found. Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8fd4088f-4678-4f07-a57d-9b1396f12f41 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Request method failure captured: Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 HTTP/1.1 Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJLWBuiK9Zwtf-5SJBGQ_yHHu0Iad1RHxrRcWUBDwgXSJ1GR31PEZrJdB9KCga6FWHK7ZaCy9AAqAi8NS7CPhyyDapn9WD__TAuEoH2XS2hGu6GREMs29eY74y6ndxhK6E1U_yTDaQ4AQw9rEnDBW5jk3Z_vUby6JGKsL-PupP7jojw Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.32 Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 17c0c643a1704bc2be7aaedfd11802e8 Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TaggedBootDevicesTest-1570794625 Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/17c0c643a1704bc2be7aaedfd11802e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_17c0c643a1704bc2be7aaedfd11802e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/17c0c643a1704bc2be7aaedfd11802e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/17c0c643a1704bc2be7aaedfd11802e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TaggedBootDevicesTest-1570794625 Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 17c0c643a1704bc2be7aaedfd11802e8 Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1570794625 Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TaggedBootDevicesTest-1570794625-project Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 9b0cc4dd3ef645b18341a7273cb0522c Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TaggedBootDevicesTest-1570794625-project Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance e9352ac2-475e-4c77-aa85-5ecd566563b2 could not be found. Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'e9352ac2-475e-4c77-aa85-5ecd566563b2'} Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9352ac2-475e-4c77-aa85-5ecd566563b2 could not be found. Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9352ac2-475e-4c77-aa85-5ecd566563b2 could not be found. Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:22.792999 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:56:22.797043 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:22.797043 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:56:22.797043 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:56:22.797043 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:56:22.797043 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:56:22.797043 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:56:22.797043 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9352ac2-475e-4c77-aa85-5ecd566563b2 could not be found. Sep 07 12:56:22.797043 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:22.797043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8fd4088f-4678-4f07-a57d-9b1396f12f41 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] Returning 404 to user: Instance e9352ac2-475e-4c77-aa85-5ecd566563b2 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:56:22.797043 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8fd4088f-4678-4f07-a57d-9b1396f12f41 tempest-TaggedBootDevicesTest-1570794625 tempest-TaggedBootDevicesTest-1570794625-project] 10.222.0.16 "GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2" status: 404 len: 111 microversion: 2.32 time: 0.057826 Sep 07 12:56:22.800200 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2506/4956] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:56:22 2022] GET /compute/v2.1/servers/e9352ac2-475e-4c77-aa85-5ecd566563b2 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 07 12:56:22.887258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-48d4d556-871f-400e-a0b3-bf9f7420adde tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:22.916167 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-48d4d556-871f-400e-a0b3-bf9f7420adde tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.478536 Sep 07 12:56:22.922720 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2451/4957] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:22 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:22.954444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9e53073d-a672-461e-8b73-ac5273fe7718 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:22.955085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9e53073d-a672-461e-8b73-ac5273fe7718 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:22.965319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e53073d-a672-461e-8b73-ac5273fe7718 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:22.965889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e53073d-a672-461e-8b73-ac5273fe7718 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:22.966366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e53073d-a672-461e-8b73-ac5273fe7718 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:22.967149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e53073d-a672-461e-8b73-ac5273fe7718 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:22.976256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e53073d-a672-461e-8b73-ac5273fe7718 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:22.977120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e53073d-a672-461e-8b73-ac5273fe7718 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:23.340091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9e53073d-a672-461e-8b73-ac5273fe7718 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:23.351288 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9e53073d-a672-461e-8b73-ac5273fe7718 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.402617 Sep 07 12:56:23.379778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c96caad9-63c6-47e1-9952-612b2c1d6321 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:23.380840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c96caad9-63c6-47e1-9952-612b2c1d6321 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:23.385900 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2507/4958] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:22 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:23.388469 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c96caad9-63c6-47e1-9952-612b2c1d6321 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:23.389365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c96caad9-63c6-47e1-9952-612b2c1d6321 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:23.390026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c96caad9-63c6-47e1-9952-612b2c1d6321 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:23.390988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c96caad9-63c6-47e1-9952-612b2c1d6321 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:23.391784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c96caad9-63c6-47e1-9952-612b2c1d6321 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:23.392407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c96caad9-63c6-47e1-9952-612b2c1d6321 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:23.453390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8e54c106-71ba-49aa-a625-8272f4c83b45 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:23.454497 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8e54c106-71ba-49aa-a625-8272f4c83b45 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7ebb91d2-1102-474c-acb1-2791dfbd422a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:23.469845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e54c106-71ba-49aa-a625-8272f4c83b45 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:23.470960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e54c106-71ba-49aa-a625-8272f4c83b45 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:23.471701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e54c106-71ba-49aa-a625-8272f4c83b45 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:23.472915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e54c106-71ba-49aa-a625-8272f4c83b45 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:23.473679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e54c106-71ba-49aa-a625-8272f4c83b45 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:23.474364 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e54c106-71ba-49aa-a625-8272f4c83b45 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:23.855098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c96caad9-63c6-47e1-9952-612b2c1d6321 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:23.899909 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c96caad9-63c6-47e1-9952-612b2c1d6321 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.525792 Sep 07 12:56:23.916710 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2452/4959] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:23 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:56:23.924483 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8e54c106-71ba-49aa-a625-8272f4c83b45 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:23.937280 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8e54c106-71ba-49aa-a625-8272f4c83b45 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a" status: 200 len: 1328 microversion: 2.1 time: 0.492513 Sep 07 12:56:23.937852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-000c9b60-67d4-4e29-8a57-21ca9f58c1a0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:23.938496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-000c9b60-67d4-4e29-8a57-21ca9f58c1a0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:23.939124 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2508/4960] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:23 2022] GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a => generated 1328 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:23.961292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-000c9b60-67d4-4e29-8a57-21ca9f58c1a0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:23.961911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-000c9b60-67d4-4e29-8a57-21ca9f58c1a0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:23.962936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-000c9b60-67d4-4e29-8a57-21ca9f58c1a0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:23.964757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-000c9b60-67d4-4e29-8a57-21ca9f58c1a0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:23.968007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-000c9b60-67d4-4e29-8a57-21ca9f58c1a0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:23.968814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-000c9b60-67d4-4e29-8a57-21ca9f58c1a0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:24.245149 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-000c9b60-67d4-4e29-8a57-21ca9f58c1a0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:24.255160 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-000c9b60-67d4-4e29-8a57-21ca9f58c1a0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.328196 Sep 07 12:56:24.256236 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2453/4961] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:23 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:24.286097 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-45c9c6a1-b412-4def-ae2d-e9ab3cda0aab tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:56:24.300384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45c9c6a1-b412-4def-ae2d-e9ab3cda0aab tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:24.300642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45c9c6a1-b412-4def-ae2d-e9ab3cda0aab tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:24.304349 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45c9c6a1-b412-4def-ae2d-e9ab3cda0aab tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:24.363950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-45c9c6a1-b412-4def-ae2d-e9ab3cda0aab tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Going to try to stop instance {{(pid=122433) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 12:56:24.511991 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-45c9c6a1-b412-4def-ae2d-e9ab3cda0aab tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action" status: 202 len: 0 microversion: 2.1 time: 0.226272 Sep 07 12:56:24.529711 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2509/4962] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:56:24 2022] POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:56:24.535896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92b20022-111b-49d1-bb58-11719d7f7f4c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:24.536736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-92b20022-111b-49d1-bb58-11719d7f7f4c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:24.551541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92b20022-111b-49d1-bb58-11719d7f7f4c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:24.554545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92b20022-111b-49d1-bb58-11719d7f7f4c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:24.555160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92b20022-111b-49d1-bb58-11719d7f7f4c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:24.557861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92b20022-111b-49d1-bb58-11719d7f7f4c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:24.558641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92b20022-111b-49d1-bb58-11719d7f7f4c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:24.560647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92b20022-111b-49d1-bb58-11719d7f7f4c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:24.835129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f7774373-76ff-4523-843b-e96c91b1f655 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1806003983", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "a2486514-95b3-4cd1-8b74-3a1cadc6ceac"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:56:24.886050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-92b20022-111b-49d1-bb58-11719d7f7f4c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:24.896985 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-92b20022-111b-49d1-bb58-11719d7f7f4c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1679 microversion: 2.1 time: 0.365599 Sep 07 12:56:24.914913 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2454/4963] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:24 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1679 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:56:24.969713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7805adf5-0970-4cd0-bad1-decdac0b404c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:24.971564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7805adf5-0970-4cd0-bad1-decdac0b404c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7ebb91d2-1102-474c-acb1-2791dfbd422a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:24.974910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-f7774373-76ff-4523-843b-e96c91b1f655 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] validate_networks() for [('a2486514-95b3-4cd1-8b74-3a1cadc6ceac', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:56:24.984668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7805adf5-0970-4cd0-bad1-decdac0b404c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:24.986094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7805adf5-0970-4cd0-bad1-decdac0b404c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:24.987185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7805adf5-0970-4cd0-bad1-decdac0b404c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:24.989030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7805adf5-0970-4cd0-bad1-decdac0b404c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:24.991365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7805adf5-0970-4cd0-bad1-decdac0b404c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:24.992593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7805adf5-0970-4cd0-bad1-decdac0b404c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:25.423476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7805adf5-0970-4cd0-bad1-decdac0b404c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:25.455589 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7805adf5-0970-4cd0-bad1-decdac0b404c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a" status: 200 len: 1510 microversion: 2.1 time: 0.494667 Sep 07 12:56:25.458230 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2455/4964] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:24 2022] GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a => generated 1510 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:25.485084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ae27ea3c-c063-464b-b794-bf6ef887529f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:25.486030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ae27ea3c-c063-464b-b794-bf6ef887529f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7ebb91d2-1102-474c-acb1-2791dfbd422a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:25.499291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae27ea3c-c063-464b-b794-bf6ef887529f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:25.500101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae27ea3c-c063-464b-b794-bf6ef887529f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:25.500747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae27ea3c-c063-464b-b794-bf6ef887529f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:25.501696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae27ea3c-c063-464b-b794-bf6ef887529f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:25.505968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae27ea3c-c063-464b-b794-bf6ef887529f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:25.506716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae27ea3c-c063-464b-b794-bf6ef887529f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:25.810154 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-f7774373-76ff-4523-843b-e96c91b1f655 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:56:25.810511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ae27ea3c-c063-464b-b794-bf6ef887529f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:25.810960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-f7774373-76ff-4523-843b-e96c91b1f655 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:56:25.811947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-f7774373-76ff-4523-843b-e96c91b1f655 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:56:25.813248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-f7774373-76ff-4523-843b-e96c91b1f655 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:56:25.814243 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-f7774373-76ff-4523-843b-e96c91b1f655 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:56:25.837401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7774373-76ff-4523-843b-e96c91b1f655 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:25.838426 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7774373-76ff-4523-843b-e96c91b1f655 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:25.839462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7774373-76ff-4523-843b-e96c91b1f655 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:25.840894 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7774373-76ff-4523-843b-e96c91b1f655 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:25.844382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7774373-76ff-4523-843b-e96c91b1f655 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:25.845464 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ae27ea3c-c063-464b-b794-bf6ef887529f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a" status: 200 len: 1510 microversion: 2.1 time: 0.363398 Sep 07 12:56:25.846684 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2456/4965] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:25 2022] GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a => generated 1510 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:56:25.847338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7774373-76ff-4523-843b-e96c91b1f655 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:25.875459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-71e2ea81-1103-4311-a2b1-3238ec8a49cf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:25.876734 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-71e2ea81-1103-4311-a2b1-3238ec8a49cf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7ebb91d2-1102-474c-acb1-2791dfbd422a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:25.890307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71e2ea81-1103-4311-a2b1-3238ec8a49cf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:25.891793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71e2ea81-1103-4311-a2b1-3238ec8a49cf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:25.895882 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f7774373-76ff-4523-843b-e96c91b1f655 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Getting quotas for project f418a0675df74978838b37f052c788c2. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:56:25.898350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71e2ea81-1103-4311-a2b1-3238ec8a49cf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:25.899785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71e2ea81-1103-4311-a2b1-3238ec8a49cf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:25.900455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71e2ea81-1103-4311-a2b1-3238ec8a49cf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:25.901070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71e2ea81-1103-4311-a2b1-3238ec8a49cf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:25.911775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f7774373-76ff-4523-843b-e96c91b1f655 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Getting quotas for user 9c58cee04d67494a94895e61ea116fb4 and project f418a0675df74978838b37f052c788c2. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:56:25.945022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f7774373-76ff-4523-843b-e96c91b1f655 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:56:25.947773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f7774373-76ff-4523-843b-e96c91b1f655 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] [instance: cd2715f4-fb54-4e6f-be46-406f17deea65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:56:26.021173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-71e2ea81-1103-4311-a2b1-3238ec8a49cf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7ebb91d2-1102-474c-acb1-2791dfbd422a] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:56:26.043098 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f7774373-76ff-4523-843b-e96c91b1f655 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.487367 Sep 07 12:56:26.045073 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2510/4966] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Sep 7 12:56:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1490 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 07 12:56:26.064614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e4b35d62-acce-4002-a297-c7b9038a0a2d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:26.068298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e4b35d62-acce-4002-a297-c7b9038a0a2d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:26.095579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4b35d62-acce-4002-a297-c7b9038a0a2d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:26.101152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4b35d62-acce-4002-a297-c7b9038a0a2d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:26.101903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4b35d62-acce-4002-a297-c7b9038a0a2d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:26.103075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4b35d62-acce-4002-a297-c7b9038a0a2d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:26.103716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4b35d62-acce-4002-a297-c7b9038a0a2d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:26.104308 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4b35d62-acce-4002-a297-c7b9038a0a2d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:26.222693 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-71e2ea81-1103-4311-a2b1-3238ec8a49cf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a" status: 204 len: 0 microversion: 2.1 time: 0.355477 Sep 07 12:56:26.230816 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2457/4967] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:56:25 2022] DELETE /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:56:26.252545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4f63824c-a783-478f-9149-5e7b250dc102 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:26.253294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4f63824c-a783-478f-9149-5e7b250dc102 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] [instance: cd2715f4-fb54-4e6f-be46-406f17deea65] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:27.147054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4f63824c-a783-478f-9149-5e7b250dc102 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:27.170696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4f63824c-a783-478f-9149-5e7b250dc102 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:27.178174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4f63824c-a783-478f-9149-5e7b250dc102 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:27.179389 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4f63824c-a783-478f-9149-5e7b250dc102 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] 10.222.0.16 "GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65" status: 200 len: 1259 microversion: 2.21 time: 0.941233 Sep 07 12:56:27.184921 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2458/4968] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:56:26 2022] GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65 => generated 1259 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:56:27.198073 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-40f8a9f9-2309-46bc-b287-2facdd0bf587 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:27.199574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-40f8a9f9-2309-46bc-b287-2facdd0bf587 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7ebb91d2-1102-474c-acb1-2791dfbd422a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:27.217771 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40f8a9f9-2309-46bc-b287-2facdd0bf587 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:27.218610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40f8a9f9-2309-46bc-b287-2facdd0bf587 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:27.221662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40f8a9f9-2309-46bc-b287-2facdd0bf587 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:27.226865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40f8a9f9-2309-46bc-b287-2facdd0bf587 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:27.228126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40f8a9f9-2309-46bc-b287-2facdd0bf587 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:27.233244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-40f8a9f9-2309-46bc-b287-2facdd0bf587 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:27.871795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e4b35d62-acce-4002-a297-c7b9038a0a2d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:27.909526 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e4b35d62-acce-4002-a297-c7b9038a0a2d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1679 microversion: 2.1 time: 1.862590 Sep 07 12:56:27.911554 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2511/4969] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:26 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1679 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:28.200248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-40f8a9f9-2309-46bc-b287-2facdd0bf587 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:28.218905 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-40f8a9f9-2309-46bc-b287-2facdd0bf587 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a" status: 200 len: 1516 microversion: 2.1 time: 1.031797 Sep 07 12:56:28.221539 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2459/4970] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:27 2022] GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a => generated 1516 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:28.244394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4f0f16d0-5984-4b79-bf69-3be32fe9d1a2 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:28.246356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4f0f16d0-5984-4b79-bf69-3be32fe9d1a2 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] [instance: cd2715f4-fb54-4e6f-be46-406f17deea65] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:28.259455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f0f16d0-5984-4b79-bf69-3be32fe9d1a2 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:28.260713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f0f16d0-5984-4b79-bf69-3be32fe9d1a2 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:28.262347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f0f16d0-5984-4b79-bf69-3be32fe9d1a2 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:28.264508 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f0f16d0-5984-4b79-bf69-3be32fe9d1a2 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:28.265588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f0f16d0-5984-4b79-bf69-3be32fe9d1a2 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:28.266834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f0f16d0-5984-4b79-bf69-3be32fe9d1a2 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:28.941230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fa2d7625-e439-4488-ba2b-a92aad3625c4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:28.946795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fa2d7625-e439-4488-ba2b-a92aad3625c4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:28.976120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa2d7625-e439-4488-ba2b-a92aad3625c4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:28.976634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa2d7625-e439-4488-ba2b-a92aad3625c4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:28.980446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa2d7625-e439-4488-ba2b-a92aad3625c4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:28.992388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa2d7625-e439-4488-ba2b-a92aad3625c4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:28.993634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa2d7625-e439-4488-ba2b-a92aad3625c4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:28.994099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa2d7625-e439-4488-ba2b-a92aad3625c4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:29.046423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4f0f16d0-5984-4b79-bf69-3be32fe9d1a2 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:29.073814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4f0f16d0-5984-4b79-bf69-3be32fe9d1a2 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:29.077275 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4f0f16d0-5984-4b79-bf69-3be32fe9d1a2 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:29.082380 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4f0f16d0-5984-4b79-bf69-3be32fe9d1a2 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] 10.222.0.16 "GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65" status: 200 len: 1255 microversion: 2.21 time: 0.849514 Sep 07 12:56:29.082984 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2512/4971] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:56:28 2022] GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65 => generated 1255 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:56:29.248119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6dab4379-005f-4137-845b-aa35eb4c55dd tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:29.249105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6dab4379-005f-4137-845b-aa35eb4c55dd tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7ebb91d2-1102-474c-acb1-2791dfbd422a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:29.271974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dab4379-005f-4137-845b-aa35eb4c55dd tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:29.272092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dab4379-005f-4137-845b-aa35eb4c55dd tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:29.272688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dab4379-005f-4137-845b-aa35eb4c55dd tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:29.283464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dab4379-005f-4137-845b-aa35eb4c55dd tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:29.284461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dab4379-005f-4137-845b-aa35eb4c55dd tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:29.285283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dab4379-005f-4137-845b-aa35eb4c55dd tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:30.304889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fa2d7625-e439-4488-ba2b-a92aad3625c4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:30.317046 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fa2d7625-e439-4488-ba2b-a92aad3625c4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1679 microversion: 2.1 time: 1.384961 Sep 07 12:56:30.317693 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2460/4972] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:28 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1679 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:56:30.334129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ede62943-8243-48c3-8a30-046f110be2c8 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:30.335188 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ede62943-8243-48c3-8a30-046f110be2c8 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] [instance: cd2715f4-fb54-4e6f-be46-406f17deea65] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:30.352639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:30.358785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ede62943-8243-48c3-8a30-046f110be2c8 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:30.360372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ede62943-8243-48c3-8a30-046f110be2c8 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:30.362394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ede62943-8243-48c3-8a30-046f110be2c8 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:30.364207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ede62943-8243-48c3-8a30-046f110be2c8 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:30.364798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ede62943-8243-48c3-8a30-046f110be2c8 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:30.365122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ede62943-8243-48c3-8a30-046f110be2c8 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:30.422762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:30.576301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ede62943-8243-48c3-8a30-046f110be2c8 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:30.590274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6dab4379-005f-4137-845b-aa35eb4c55dd tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:30.610562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ede62943-8243-48c3-8a30-046f110be2c8 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:30.612584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ede62943-8243-48c3-8a30-046f110be2c8 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:30.623770 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ede62943-8243-48c3-8a30-046f110be2c8 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] 10.222.0.16 "GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65" status: 200 len: 1317 microversion: 2.21 time: 0.299120 Sep 07 12:56:30.627461 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6dab4379-005f-4137-845b-aa35eb4c55dd tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a" status: 200 len: 1516 microversion: 2.1 time: 1.378474 Sep 07 12:56:30.642151 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2513/4974] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:29 2022] GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a => generated 1516 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:30.642441 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2461/4974] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:56:30 2022] GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65 => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:56:31.077256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c0097ca4-0b9f-4ac9-978f-62227e480619 req-d5a372e0-7ea0-4e4b-8b73-91620303fc94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ebb91d2-1102-474c-acb1-2791dfbd422a", "name": "network-vif-deleted", "tag": "648d6b6f-f663-4dea-97c9-ae0e93504e67"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:56:31.109596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c0097ca4-0b9f-4ac9-978f-62227e480619 req-d5a372e0-7ea0-4e4b-8b73-91620303fc94 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:31.113189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c0097ca4-0b9f-4ac9-978f-62227e480619 req-d5a372e0-7ea0-4e4b-8b73-91620303fc94 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:31.127218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c0097ca4-0b9f-4ac9-978f-62227e480619 req-d5a372e0-7ea0-4e4b-8b73-91620303fc94 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:31.165190 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c0097ca4-0b9f-4ac9-978f-62227e480619 req-d5a372e0-7ea0-4e4b-8b73-91620303fc94 service nova] Creating event network-vif-deleted:648d6b6f-f663-4dea-97c9-ae0e93504e67 for instance 7ebb91d2-1102-474c-acb1-2791dfbd422a on n-h1-852087-9 Sep 07 12:56:31.181965 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c0097ca4-0b9f-4ac9-978f-62227e480619 req-d5a372e0-7ea0-4e4b-8b73-91620303fc94 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108639 Sep 07 12:56:31.189497 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2462/4975] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:56:31.369773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd857d32-ddaa-48f8-9ae8-9d50209277c6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:31.370888 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dd857d32-ddaa-48f8-9ae8-9d50209277c6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:31.380905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:31.414198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd857d32-ddaa-48f8-9ae8-9d50209277c6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:31.417084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd857d32-ddaa-48f8-9ae8-9d50209277c6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:31.419801 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd857d32-ddaa-48f8-9ae8-9d50209277c6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:31.424056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd857d32-ddaa-48f8-9ae8-9d50209277c6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:31.427063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd857d32-ddaa-48f8-9ae8-9d50209277c6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:31.434162 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd857d32-ddaa-48f8-9ae8-9d50209277c6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:31.651478 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d7e20b53-da08-4d1f-9340-4b2eba274707 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:31.652308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d7e20b53-da08-4d1f-9340-4b2eba274707 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] [instance: cd2715f4-fb54-4e6f-be46-406f17deea65] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:31.670461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7e20b53-da08-4d1f-9340-4b2eba274707 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:31.673203 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7e20b53-da08-4d1f-9340-4b2eba274707 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:31.674077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7e20b53-da08-4d1f-9340-4b2eba274707 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:31.676481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7e20b53-da08-4d1f-9340-4b2eba274707 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:31.679457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7e20b53-da08-4d1f-9340-4b2eba274707 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:31.680487 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7e20b53-da08-4d1f-9340-4b2eba274707 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:31.902230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d7e20b53-da08-4d1f-9340-4b2eba274707 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:31.947906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d7e20b53-da08-4d1f-9340-4b2eba274707 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:31.957916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d7e20b53-da08-4d1f-9340-4b2eba274707 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:31.963797 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d7e20b53-da08-4d1f-9340-4b2eba274707 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] 10.222.0.16 "GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65" status: 200 len: 1317 microversion: 2.21 time: 0.315022 Sep 07 12:56:31.969818 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2463/4976] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:56:31 2022] GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:56:31.971873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dd857d32-ddaa-48f8-9ae8-9d50209277c6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:31.983349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c6cdde39-95e0-4fcd-9d45-129a1a269ad1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:31.991014 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dd857d32-ddaa-48f8-9ae8-9d50209277c6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1679 microversion: 2.1 time: 0.629327 Sep 07 12:56:31.991803 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2514/4977] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:31 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1679 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:32.004355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c6cdde39-95e0-4fcd-9d45-129a1a269ad1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7ebb91d2-1102-474c-acb1-2791dfbd422a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:32.026134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6cdde39-95e0-4fcd-9d45-129a1a269ad1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:32.027835 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6cdde39-95e0-4fcd-9d45-129a1a269ad1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:32.030376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6cdde39-95e0-4fcd-9d45-129a1a269ad1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:32.031431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6cdde39-95e0-4fcd-9d45-129a1a269ad1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:32.042296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6cdde39-95e0-4fcd-9d45-129a1a269ad1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:32.044132 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6cdde39-95e0-4fcd-9d45-129a1a269ad1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:32.153388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6cdde39-95e0-4fcd-9d45-129a1a269ad1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:32.157633 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6cdde39-95e0-4fcd-9d45-129a1a269ad1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:32.159164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6cdde39-95e0-4fcd-9d45-129a1a269ad1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:32.161318 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-c6cdde39-95e0-4fcd-9d45-129a1a269ad1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lazy-loading 'fault' on Instance uuid 7ebb91d2-1102-474c-acb1-2791dfbd422a {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:56:32.348478 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c6cdde39-95e0-4fcd-9d45-129a1a269ad1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:32.369687 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c6cdde39-95e0-4fcd-9d45-129a1a269ad1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a" status: 200 len: 1318 microversion: 2.1 time: 0.397775 Sep 07 12:56:32.373724 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2464/4978] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:31 2022] GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:33.001027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c35f067-9348-430a-a967-5f33b83cd0cd tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:33.002053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7c35f067-9348-430a-a967-5f33b83cd0cd tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] [instance: cd2715f4-fb54-4e6f-be46-406f17deea65] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:33.054688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-555106db-dbd0-4d09-8f6e-4fb66327a730 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:33.060288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-555106db-dbd0-4d09-8f6e-4fb66327a730 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:33.063550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c35f067-9348-430a-a967-5f33b83cd0cd tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:33.066926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c35f067-9348-430a-a967-5f33b83cd0cd tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:33.071390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c35f067-9348-430a-a967-5f33b83cd0cd tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:33.077348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c35f067-9348-430a-a967-5f33b83cd0cd tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:33.079837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c35f067-9348-430a-a967-5f33b83cd0cd tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:33.083240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c35f067-9348-430a-a967-5f33b83cd0cd tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:33.096293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-555106db-dbd0-4d09-8f6e-4fb66327a730 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:33.097258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-555106db-dbd0-4d09-8f6e-4fb66327a730 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:33.098198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-555106db-dbd0-4d09-8f6e-4fb66327a730 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:33.100693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-555106db-dbd0-4d09-8f6e-4fb66327a730 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:33.106523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-555106db-dbd0-4d09-8f6e-4fb66327a730 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:33.111121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-555106db-dbd0-4d09-8f6e-4fb66327a730 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:33.645696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7c35f067-9348-430a-a967-5f33b83cd0cd tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:33.658142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7c35f067-9348-430a-a967-5f33b83cd0cd tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:33.662041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7c35f067-9348-430a-a967-5f33b83cd0cd tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:33.664656 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7c35f067-9348-430a-a967-5f33b83cd0cd tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] 10.222.0.16 "GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65" status: 200 len: 1359 microversion: 2.21 time: 0.671993 Sep 07 12:56:33.666356 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2515/4979] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:56:32 2022] GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65 => generated 1359 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:56:33.676873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6034be6a-b050-4e98-9e33-ebee5ad1e660 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:33.678820 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6034be6a-b050-4e98-9e33-ebee5ad1e660 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7ebb91d2-1102-474c-acb1-2791dfbd422a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:33.692189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6034be6a-b050-4e98-9e33-ebee5ad1e660 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:33.695439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6034be6a-b050-4e98-9e33-ebee5ad1e660 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:33.696908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6034be6a-b050-4e98-9e33-ebee5ad1e660 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:33.701149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6034be6a-b050-4e98-9e33-ebee5ad1e660 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:33.704002 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6034be6a-b050-4e98-9e33-ebee5ad1e660 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:33.705915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6034be6a-b050-4e98-9e33-ebee5ad1e660 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:33.724166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:33.744919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-555106db-dbd0-4d09-8f6e-4fb66327a730 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:33.752867 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-6034be6a-b050-4e98-9e33-ebee5ad1e660 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] HTTP exception thrown: Instance 7ebb91d2-1102-474c-acb1-2791dfbd422a could not be found. Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6034be6a-b050-4e98-9e33-ebee5ad1e660 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Request method failure captured: Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a HTTP/1.1 Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJSE5qt3MMvCiXM6JMYUN7f1buxIi7ST_NSWH8b3Iy1XPUp8KO4zG-NXQgWVN1Z7GE3sHXszWiKCVOYqqXwQROrdr4ZEFwz_8XPZaHXiJBQID0HYLx7sZ_BMJTKC5v-6tuUaVizJ_CnloOe2V1xTk5bkZGekyl16F75E8fKcPIskPJo Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestJSON-553840835 Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestJSON-553840835 Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestJSON-553840835 Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersTestJSON-553840835-project Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6ac786dc6d7847f582262dcd912c3f06 Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestJSON-553840835-project Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 7ebb91d2-1102-474c-acb1-2791dfbd422a could not be found. Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '7ebb91d2-1102-474c-acb1-2791dfbd422a'} Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ebb91d2-1102-474c-acb1-2791dfbd422a could not be found. Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ebb91d2-1102-474c-acb1-2791dfbd422a could not be found. Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:33.756954 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:56:33.762596 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:56:33.762596 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:56:33.762596 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:56:33.762596 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:56:33.762596 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ebb91d2-1102-474c-acb1-2791dfbd422a could not be found. Sep 07 12:56:33.762596 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:33.764167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6034be6a-b050-4e98-9e33-ebee5ad1e660 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Returning 404 to user: Instance 7ebb91d2-1102-474c-acb1-2791dfbd422a could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:56:33.765999 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6034be6a-b050-4e98-9e33-ebee5ad1e660 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a" status: 404 len: 111 microversion: 2.1 time: 0.097122 Sep 07 12:56:33.772716 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-555106db-dbd0-4d09-8f6e-4fb66327a730 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1679 microversion: 2.1 time: 0.737280 Sep 07 12:56:33.773288 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2516/4980] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:33 2022] GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:56:33.777268 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2465/4981] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:33 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1679 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:33.785921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-429db4b9-4542-4566-8a49-59f1e5d8f3e0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '.version_select at 0x7fc418a96b80>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:33.822876 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-429db4b9-4542-4566-8a49-59f1e5d8f3e0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-key-1534632533" status: 202 len: 0 microversion: 2.1 time: 0.047324 Sep 07 12:56:33.832275 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2517/4982] 10.222.0.16 () {58 vars in 1209 bytes} [Wed Sep 7 12:56:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1534632533 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:56:34.039713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d79d17bd-a534-45ca-843b-d9fc6d5dedf1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1781624175", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "1c45fce2-7bfe-4e93-8f9c-12b9830de28b"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:56:34.131802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-d79d17bd-a534-45ca-843b-d9fc6d5dedf1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] validate_networks() for [('1c45fce2-7bfe-4e93-8f9c-12b9830de28b', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:56:34.721070 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ebdc121b-01e3-4048-b200-dd7abcbbde16 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:34.722697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ebdc121b-01e3-4048-b200-dd7abcbbde16 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] [instance: cd2715f4-fb54-4e6f-be46-406f17deea65] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:34.743436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebdc121b-01e3-4048-b200-dd7abcbbde16 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:34.745140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebdc121b-01e3-4048-b200-dd7abcbbde16 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:34.745881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebdc121b-01e3-4048-b200-dd7abcbbde16 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:34.746808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebdc121b-01e3-4048-b200-dd7abcbbde16 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:34.747462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebdc121b-01e3-4048-b200-dd7abcbbde16 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:34.748062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebdc121b-01e3-4048-b200-dd7abcbbde16 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:35.047016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d79d17bd-a534-45ca-843b-d9fc6d5dedf1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:56:35.047508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d79d17bd-a534-45ca-843b-d9fc6d5dedf1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:56:35.047924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d79d17bd-a534-45ca-843b-d9fc6d5dedf1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:56:35.048545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d79d17bd-a534-45ca-843b-d9fc6d5dedf1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:56:35.049146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-d79d17bd-a534-45ca-843b-d9fc6d5dedf1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:56:35.074772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d79d17bd-a534-45ca-843b-d9fc6d5dedf1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:35.075825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d79d17bd-a534-45ca-843b-d9fc6d5dedf1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:35.076706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d79d17bd-a534-45ca-843b-d9fc6d5dedf1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:35.077615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d79d17bd-a534-45ca-843b-d9fc6d5dedf1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:35.078116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d79d17bd-a534-45ca-843b-d9fc6d5dedf1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:35.078540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d79d17bd-a534-45ca-843b-d9fc6d5dedf1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:35.104398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-d79d17bd-a534-45ca-843b-d9fc6d5dedf1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Getting quotas for project 854c6a81bbfd4ab79126799ec40c954e. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:56:35.111364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-d79d17bd-a534-45ca-843b-d9fc6d5dedf1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Getting quotas for user 6ac786dc6d7847f582262dcd912c3f06 and project 854c6a81bbfd4ab79126799ec40c954e. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:56:35.129785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d79d17bd-a534-45ca-843b-d9fc6d5dedf1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:56:35.132731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d79d17bd-a534-45ca-843b-d9fc6d5dedf1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d870ac2-825e-4d5b-825b-fcc194138508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:56:35.219487 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d79d17bd-a534-45ca-843b-d9fc6d5dedf1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.186508 Sep 07 12:56:35.222535 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2466/4983] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:56:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:56:35.235769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7f352732-2f9f-474a-b05b-a5e82c5b3cd1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:35.239634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7f352732-2f9f-474a-b05b-a5e82c5b3cd1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:35.250424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f352732-2f9f-474a-b05b-a5e82c5b3cd1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:35.250927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f352732-2f9f-474a-b05b-a5e82c5b3cd1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:35.252177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f352732-2f9f-474a-b05b-a5e82c5b3cd1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:35.252945 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f352732-2f9f-474a-b05b-a5e82c5b3cd1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:35.253579 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f352732-2f9f-474a-b05b-a5e82c5b3cd1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:35.254166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f352732-2f9f-474a-b05b-a5e82c5b3cd1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:35.401713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ebdc121b-01e3-4048-b200-dd7abcbbde16 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:35.419835 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ebdc121b-01e3-4048-b200-dd7abcbbde16 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:35.422248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ebdc121b-01e3-4048-b200-dd7abcbbde16 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:35.423495 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ebdc121b-01e3-4048-b200-dd7abcbbde16 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] 10.222.0.16 "GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65" status: 200 len: 1359 microversion: 2.21 time: 0.726823 Sep 07 12:56:35.429291 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2518/4984] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:56:34 2022] GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65 => generated 1359 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:56:35.439427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-5df4566b-d05e-46bb-83ca-f9e6b0c38931 req-6a5db59b-f96d-46cb-9572-717fff352d96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd2715f4-fb54-4e6f-be46-406f17deea65", "tag": "42f4f2cf-62b8-4634-9689-39feea1a49af"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:56:35.470877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5df4566b-d05e-46bb-83ca-f9e6b0c38931 req-6a5db59b-f96d-46cb-9572-717fff352d96 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:35.474388 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5df4566b-d05e-46bb-83ca-f9e6b0c38931 req-6a5db59b-f96d-46cb-9572-717fff352d96 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:35.475067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5df4566b-d05e-46bb-83ca-f9e6b0c38931 req-6a5db59b-f96d-46cb-9572-717fff352d96 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:35.502238 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-5df4566b-d05e-46bb-83ca-f9e6b0c38931 req-6a5db59b-f96d-46cb-9572-717fff352d96 service nova] Creating event network-changed:42f4f2cf-62b8-4634-9689-39feea1a49af for instance cd2715f4-fb54-4e6f-be46-406f17deea65 on n-h1-852087-9 Sep 07 12:56:35.515255 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-5df4566b-d05e-46bb-83ca-f9e6b0c38931 req-6a5db59b-f96d-46cb-9572-717fff352d96 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084329 Sep 07 12:56:35.520221 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2519/4985] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:56:35.526645 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fcd9d1b9-abab-473f-a11f-d557df5b8715 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:35.534656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fcd9d1b9-abab-473f-a11f-d557df5b8715 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d870ac2-825e-4d5b-825b-fcc194138508] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:35.878630 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:35.931051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:35.976351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fcd9d1b9-abab-473f-a11f-d557df5b8715 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:36.015323 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fcd9d1b9-abab-473f-a11f-d557df5b8715 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508" status: 200 len: 1209 microversion: 2.1 time: 0.479576 Sep 07 12:56:36.019232 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2520/4986] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:35 2022] GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508 => generated 1209 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:36.471317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c875a57-ca0d-46b3-93e0-27bec30d0695 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:36.471966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2c875a57-ca0d-46b3-93e0-27bec30d0695 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] [instance: cd2715f4-fb54-4e6f-be46-406f17deea65] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:36.482338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7f352732-2f9f-474a-b05b-a5e82c5b3cd1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:36.491716 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7f352732-2f9f-474a-b05b-a5e82c5b3cd1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1679 microversion: 2.1 time: 1.267741 Sep 07 12:56:36.495767 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2467/4987] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:35 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1679 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:36.502105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c875a57-ca0d-46b3-93e0-27bec30d0695 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:36.502880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c875a57-ca0d-46b3-93e0-27bec30d0695 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:36.503517 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c875a57-ca0d-46b3-93e0-27bec30d0695 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:36.504734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c875a57-ca0d-46b3-93e0-27bec30d0695 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:36.505427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c875a57-ca0d-46b3-93e0-27bec30d0695 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:36.512717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c875a57-ca0d-46b3-93e0-27bec30d0695 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:36.809951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2c875a57-ca0d-46b3-93e0-27bec30d0695 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:36.821887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2c875a57-ca0d-46b3-93e0-27bec30d0695 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:36.824331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2c875a57-ca0d-46b3-93e0-27bec30d0695 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:36.826301 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2c875a57-ca0d-46b3-93e0-27bec30d0695 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] 10.222.0.16 "GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65" status: 200 len: 1359 microversion: 2.21 time: 0.359012 Sep 07 12:56:36.827535 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2521/4988] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:56:36 2022] GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65 => generated 1359 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:56:37.052881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fa38ccc8-d326-4992-9634-ee785413efcc tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:37.054026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fa38ccc8-d326-4992-9634-ee785413efcc tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d870ac2-825e-4d5b-825b-fcc194138508] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:37.081907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa38ccc8-d326-4992-9634-ee785413efcc tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:37.087069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa38ccc8-d326-4992-9634-ee785413efcc tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:37.087876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa38ccc8-d326-4992-9634-ee785413efcc tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:37.089058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa38ccc8-d326-4992-9634-ee785413efcc tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:37.090052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa38ccc8-d326-4992-9634-ee785413efcc tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:37.096256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa38ccc8-d326-4992-9634-ee785413efcc tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:37.423831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fa38ccc8-d326-4992-9634-ee785413efcc tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:37.453458 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fa38ccc8-d326-4992-9634-ee785413efcc tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508" status: 200 len: 1205 microversion: 2.1 time: 0.409346 Sep 07 12:56:37.455686 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2468/4989] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:37 2022] GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508 => generated 1205 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:37.525053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1411c8b0-df54-444e-8c3c-8dc814f7e84a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:37.526436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1411c8b0-df54-444e-8c3c-8dc814f7e84a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:37.535715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1411c8b0-df54-444e-8c3c-8dc814f7e84a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:37.536755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1411c8b0-df54-444e-8c3c-8dc814f7e84a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:37.537420 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1411c8b0-df54-444e-8c3c-8dc814f7e84a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:37.538397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1411c8b0-df54-444e-8c3c-8dc814f7e84a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:37.539049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1411c8b0-df54-444e-8c3c-8dc814f7e84a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:37.539689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1411c8b0-df54-444e-8c3c-8dc814f7e84a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:37.754444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1411c8b0-df54-444e-8c3c-8dc814f7e84a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:37.779202 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1411c8b0-df54-444e-8c3c-8dc814f7e84a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1679 microversion: 2.1 time: 0.258622 Sep 07 12:56:37.785973 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2522/4990] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:37 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1679 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:56:37.891802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fbd9c5d5-1abe-47c5-864c-3974023fb99c tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:37.892463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fbd9c5d5-1abe-47c5-864c-3974023fb99c tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] [instance: cd2715f4-fb54-4e6f-be46-406f17deea65] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:37.908829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbd9c5d5-1abe-47c5-864c-3974023fb99c tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:37.909416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbd9c5d5-1abe-47c5-864c-3974023fb99c tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:37.909908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbd9c5d5-1abe-47c5-864c-3974023fb99c tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:37.910639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbd9c5d5-1abe-47c5-864c-3974023fb99c tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:37.913211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbd9c5d5-1abe-47c5-864c-3974023fb99c tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:37.913626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbd9c5d5-1abe-47c5-864c-3974023fb99c tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:38.301281 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fbd9c5d5-1abe-47c5-864c-3974023fb99c tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:38.366989 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fbd9c5d5-1abe-47c5-864c-3974023fb99c tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:38.403102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fbd9c5d5-1abe-47c5-864c-3974023fb99c tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:38.405449 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fbd9c5d5-1abe-47c5-864c-3974023fb99c tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] 10.222.0.16 "GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65" status: 200 len: 1359 microversion: 2.21 time: 0.522554 Sep 07 12:56:38.410015 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2469/4991] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:56:37 2022] GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65 => generated 1359 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:56:38.511921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-934d1f7e-ae23-46ab-999b-a6b266381ca0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:38.513291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-934d1f7e-ae23-46ab-999b-a6b266381ca0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d870ac2-825e-4d5b-825b-fcc194138508] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:38.533039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-934d1f7e-ae23-46ab-999b-a6b266381ca0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:38.537384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-934d1f7e-ae23-46ab-999b-a6b266381ca0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:38.538885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-934d1f7e-ae23-46ab-999b-a6b266381ca0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:38.540984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-934d1f7e-ae23-46ab-999b-a6b266381ca0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:38.541962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-934d1f7e-ae23-46ab-999b-a6b266381ca0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:38.543105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-934d1f7e-ae23-46ab-999b-a6b266381ca0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:38.718956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-934d1f7e-ae23-46ab-999b-a6b266381ca0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:38.742956 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-934d1f7e-ae23-46ab-999b-a6b266381ca0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508" status: 200 len: 1261 microversion: 2.1 time: 0.233470 Sep 07 12:56:38.744231 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2523/4992] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:38 2022] GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508 => generated 1261 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:56:38.823409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5b406281-37fc-4509-9a4e-7236901bb2cf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:38.824467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5b406281-37fc-4509-9a4e-7236901bb2cf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:38.860813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b406281-37fc-4509-9a4e-7236901bb2cf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:38.861700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b406281-37fc-4509-9a4e-7236901bb2cf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:38.862531 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b406281-37fc-4509-9a4e-7236901bb2cf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:38.874537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b406281-37fc-4509-9a4e-7236901bb2cf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:38.875366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b406281-37fc-4509-9a4e-7236901bb2cf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:38.876356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5b406281-37fc-4509-9a4e-7236901bb2cf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:39.567545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-848b7971-c47b-4152-9bff-12c0e4e69940 tempest-ComputeTenantNetworksTest-962784026 tempest-ComputeTenantNetworksTest-962784026-project] Calling method '.version_select at 0x7fc4192cc1f0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:40.466752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5b406281-37fc-4509-9a4e-7236901bb2cf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:40.486416 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5b406281-37fc-4509-9a4e-7236901bb2cf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1679 microversion: 2.1 time: 1.669802 Sep 07 12:56:40.503083 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2470/4993] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:38 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1679 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:40.532531 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6421be3e-ebba-4b68-a656-d8e6b62fe6ae tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:40.536348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6421be3e-ebba-4b68-a656-d8e6b62fe6ae tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] [instance: cd2715f4-fb54-4e6f-be46-406f17deea65] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:40.550544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6421be3e-ebba-4b68-a656-d8e6b62fe6ae tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:40.551233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6421be3e-ebba-4b68-a656-d8e6b62fe6ae tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:40.551849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6421be3e-ebba-4b68-a656-d8e6b62fe6ae tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:40.552856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6421be3e-ebba-4b68-a656-d8e6b62fe6ae tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:40.553859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6421be3e-ebba-4b68-a656-d8e6b62fe6ae tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:40.554459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6421be3e-ebba-4b68-a656-d8e6b62fe6ae tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:41.092723 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-848b7971-c47b-4152-9bff-12c0e4e69940 tempest-ComputeTenantNetworksTest-962784026 tempest-ComputeTenantNetworksTest-962784026-project] 10.222.0.16 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.875137 Sep 07 12:56:41.096510 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2524/4994] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Sep 7 12:56:39 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1881 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:56:41.120550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d0520004-84be-49a1-b100-96edab562505 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:41.122881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d0520004-84be-49a1-b100-96edab562505 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d870ac2-825e-4d5b-825b-fcc194138508] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:41.138463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0520004-84be-49a1-b100-96edab562505 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:41.141232 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0520004-84be-49a1-b100-96edab562505 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:41.143352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0520004-84be-49a1-b100-96edab562505 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:41.145746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0520004-84be-49a1-b100-96edab562505 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:41.149218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0520004-84be-49a1-b100-96edab562505 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:41.150836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0520004-84be-49a1-b100-96edab562505 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:41.388875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6421be3e-ebba-4b68-a656-d8e6b62fe6ae tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:41.407226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6421be3e-ebba-4b68-a656-d8e6b62fe6ae tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:41.411917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6421be3e-ebba-4b68-a656-d8e6b62fe6ae tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:41.420515 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6421be3e-ebba-4b68-a656-d8e6b62fe6ae tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] 10.222.0.16 "GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65" status: 200 len: 1359 microversion: 2.21 time: 0.915239 Sep 07 12:56:41.439952 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2471/4995] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:56:40 2022] GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65 => generated 1359 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:56:41.469969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-71978617-4a92-4eba-a717-a64135966863 tempest-ComputeTenantNetworksTest-962784026 tempest-ComputeTenantNetworksTest-962784026-project] Calling method '.version_select at 0x7fc4138a8310>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:41.480417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d0520004-84be-49a1-b100-96edab562505 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:41.494463 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d0520004-84be-49a1-b100-96edab562505 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508" status: 200 len: 1267 microversion: 2.1 time: 0.393002 Sep 07 12:56:41.496667 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2525/4996] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:41 2022] GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508 => generated 1267 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:41.557118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ff224b5c-1b4c-4973-89e3-2e3f62b86e71 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:41.561386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ff224b5c-1b4c-4973-89e3-2e3f62b86e71 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:41.623985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff224b5c-1b4c-4973-89e3-2e3f62b86e71 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:41.628504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff224b5c-1b4c-4973-89e3-2e3f62b86e71 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:41.632629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff224b5c-1b4c-4973-89e3-2e3f62b86e71 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:41.636447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff224b5c-1b4c-4973-89e3-2e3f62b86e71 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:41.649057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff224b5c-1b4c-4973-89e3-2e3f62b86e71 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:41.650350 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff224b5c-1b4c-4973-89e3-2e3f62b86e71 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:41.693689 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-71978617-4a92-4eba-a717-a64135966863 tempest-ComputeTenantNetworksTest-962784026 tempest-ComputeTenantNetworksTest-962784026-project] 10.222.0.16 "GET /compute/v2.1/os-tenant-networks/c131834b-4e09-472d-adff-62e37b48b359" status: 200 len: 140 microversion: 2.1 time: 0.250490 Sep 07 12:56:41.696526 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2472/4997] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Sep 7 12:56:41 2022] GET /compute/v2.1/os-tenant-networks/c131834b-4e09-472d-adff-62e37b48b359 => generated 140 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:56:42.326501 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ff224b5c-1b4c-4973-89e3-2e3f62b86e71 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:42.350565 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ff224b5c-1b4c-4973-89e3-2e3f62b86e71 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1656 microversion: 2.1 time: 0.811206 Sep 07 12:56:42.353578 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2526/4998] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:41 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1656 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:42.409182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1c472b55-706e-43bc-8d53-befa4e0b5e51 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:56:42.429418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c472b55-706e-43bc-8d53-befa4e0b5e51 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:42.430782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c472b55-706e-43bc-8d53-befa4e0b5e51 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:42.431917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c472b55-706e-43bc-8d53-befa4e0b5e51 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:42.475984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a7a91933-324c-48b5-9c1b-41002f008824 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:42.476997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a7a91933-324c-48b5-9c1b-41002f008824 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] [instance: cd2715f4-fb54-4e6f-be46-406f17deea65] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:42.494958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7a91933-324c-48b5-9c1b-41002f008824 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:42.505352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7a91933-324c-48b5-9c1b-41002f008824 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:42.506698 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7a91933-324c-48b5-9c1b-41002f008824 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:42.508369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7a91933-324c-48b5-9c1b-41002f008824 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:42.511461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7a91933-324c-48b5-9c1b-41002f008824 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:42.514359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7a91933-324c-48b5-9c1b-41002f008824 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:42.529439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1c472b55-706e-43bc-8d53-befa4e0b5e51 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Going to try to start instance {{(pid=122432) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 12:56:42.730802 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1c472b55-706e-43bc-8d53-befa4e0b5e51 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action" status: 202 len: 0 microversion: 2.1 time: 0.331320 Sep 07 12:56:42.737726 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2473/4999] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:56:42 2022] POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:56:42.776283 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4a4cbbee-a3c4-4186-aba7-5f7565d46436 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:42.780108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4a4cbbee-a3c4-4186-aba7-5f7565d46436 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d870ac2-825e-4d5b-825b-fcc194138508] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:42.812592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a4cbbee-a3c4-4186-aba7-5f7565d46436 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:42.813884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a4cbbee-a3c4-4186-aba7-5f7565d46436 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:42.814762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a4cbbee-a3c4-4186-aba7-5f7565d46436 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:42.816045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a4cbbee-a3c4-4186-aba7-5f7565d46436 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:42.816875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a4cbbee-a3c4-4186-aba7-5f7565d46436 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:42.817777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4a4cbbee-a3c4-4186-aba7-5f7565d46436 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:43.380209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4a4cbbee-a3c4-4186-aba7-5f7565d46436 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:43.399775 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4a4cbbee-a3c4-4186-aba7-5f7565d46436 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508" status: 200 len: 1309 microversion: 2.1 time: 0.651555 Sep 07 12:56:43.417268 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2474/5000] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:42 2022] GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508 => generated 1309 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:43.428303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-550f17f7-e255-4ea7-800f-1f37e5f96e09 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:43.429338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-550f17f7-e255-4ea7-800f-1f37e5f96e09 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:43.438597 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-550f17f7-e255-4ea7-800f-1f37e5f96e09 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:43.439108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-550f17f7-e255-4ea7-800f-1f37e5f96e09 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:43.439554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-550f17f7-e255-4ea7-800f-1f37e5f96e09 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:43.440272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-550f17f7-e255-4ea7-800f-1f37e5f96e09 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:43.440732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-550f17f7-e255-4ea7-800f-1f37e5f96e09 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:43.441163 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-550f17f7-e255-4ea7-800f-1f37e5f96e09 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:43.515440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a7a91933-324c-48b5-9c1b-41002f008824 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:43.544552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a7a91933-324c-48b5-9c1b-41002f008824 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:43.548356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a7a91933-324c-48b5-9c1b-41002f008824 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:43.551133 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a7a91933-324c-48b5-9c1b-41002f008824 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] 10.222.0.16 "GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65" status: 200 len: 1359 microversion: 2.21 time: 1.080248 Sep 07 12:56:43.552625 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2527/5001] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:56:42 2022] GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65 => generated 1359 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:56:43.562746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-56c5c630-e128-4a86-9012-140da85babc1 req-3b37b214-7745-4781-9d15-ee45737b3bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd2715f4-fb54-4e6f-be46-406f17deea65", "name": "network-vif-plugged", "status": "completed", "tag": "42f4f2cf-62b8-4634-9689-39feea1a49af"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:56:43.584117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-56c5c630-e128-4a86-9012-140da85babc1 req-3b37b214-7745-4781-9d15-ee45737b3bb8 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:43.585639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-56c5c630-e128-4a86-9012-140da85babc1 req-3b37b214-7745-4781-9d15-ee45737b3bb8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:43.586940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-56c5c630-e128-4a86-9012-140da85babc1 req-3b37b214-7745-4781-9d15-ee45737b3bb8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:43.612699 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-56c5c630-e128-4a86-9012-140da85babc1 req-3b37b214-7745-4781-9d15-ee45737b3bb8 service nova] Creating event network-vif-plugged:42f4f2cf-62b8-4634-9689-39feea1a49af for instance cd2715f4-fb54-4e6f-be46-406f17deea65 on n-h1-852087-9 Sep 07 12:56:43.623391 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-56c5c630-e128-4a86-9012-140da85babc1 req-3b37b214-7745-4781-9d15-ee45737b3bb8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068051 Sep 07 12:56:43.625943 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2528/5002] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:56:44.350095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-550f17f7-e255-4ea7-800f-1f37e5f96e09 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:44.388555 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-550f17f7-e255-4ea7-800f-1f37e5f96e09 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1665 microversion: 2.1 time: 0.969352 Sep 07 12:56:44.390159 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2475/5003] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:43 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1665 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:44.439845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3851e6e4-e28f-4d61-a34c-61396dc29009 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:44.441684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3851e6e4-e28f-4d61-a34c-61396dc29009 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d870ac2-825e-4d5b-825b-fcc194138508] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:44.454399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3851e6e4-e28f-4d61-a34c-61396dc29009 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:44.462220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3851e6e4-e28f-4d61-a34c-61396dc29009 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:44.463275 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3851e6e4-e28f-4d61-a34c-61396dc29009 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:44.475360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3851e6e4-e28f-4d61-a34c-61396dc29009 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:44.477728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3851e6e4-e28f-4d61-a34c-61396dc29009 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:44.478599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3851e6e4-e28f-4d61-a34c-61396dc29009 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:44.613188 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-519066c9-7a9c-4f48-a006-8fc289a8e171 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:44.623673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-519066c9-7a9c-4f48-a006-8fc289a8e171 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] [instance: cd2715f4-fb54-4e6f-be46-406f17deea65] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:44.655227 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-519066c9-7a9c-4f48-a006-8fc289a8e171 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:44.656072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-519066c9-7a9c-4f48-a006-8fc289a8e171 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:44.656865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-519066c9-7a9c-4f48-a006-8fc289a8e171 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:44.658154 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-519066c9-7a9c-4f48-a006-8fc289a8e171 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:44.658963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-519066c9-7a9c-4f48-a006-8fc289a8e171 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:44.659729 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-519066c9-7a9c-4f48-a006-8fc289a8e171 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:45.094280 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:45.122792 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:45.257176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3851e6e4-e28f-4d61-a34c-61396dc29009 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:45.280372 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3851e6e4-e28f-4d61-a34c-61396dc29009 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508" status: 200 len: 1309 microversion: 2.1 time: 0.849107 Sep 07 12:56:45.307590 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2529/5004] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:44 2022] GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508 => generated 1309 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:45.342402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-519066c9-7a9c-4f48-a006-8fc289a8e171 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:45.369373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-519066c9-7a9c-4f48-a006-8fc289a8e171 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:45.376458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-519066c9-7a9c-4f48-a006-8fc289a8e171 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:45.379859 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-519066c9-7a9c-4f48-a006-8fc289a8e171 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] 10.222.0.16 "GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65" status: 200 len: 1359 microversion: 2.21 time: 0.773207 Sep 07 12:56:45.381648 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2476/5005] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:56:44 2022] GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65 => generated 1359 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:56:45.418514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3d69b29e-e41c-4a82-be26-f5f4f53570d5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:45.420092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3d69b29e-e41c-4a82-be26-f5f4f53570d5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:45.435302 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d69b29e-e41c-4a82-be26-f5f4f53570d5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:45.437228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d69b29e-e41c-4a82-be26-f5f4f53570d5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:45.438345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d69b29e-e41c-4a82-be26-f5f4f53570d5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:45.440237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d69b29e-e41c-4a82-be26-f5f4f53570d5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:45.441875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d69b29e-e41c-4a82-be26-f5f4f53570d5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:45.443152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d69b29e-e41c-4a82-be26-f5f4f53570d5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:45.989384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:46.166728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3d69b29e-e41c-4a82-be26-f5f4f53570d5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:46.210988 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3d69b29e-e41c-4a82-be26-f5f4f53570d5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1665 microversion: 2.1 time: 0.799191 Sep 07 12:56:46.213389 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2530/5006] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:45 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1665 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:46.344939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-60bd9a7a-1675-413e-8efd-45743a0776cf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:46.348511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-60bd9a7a-1675-413e-8efd-45743a0776cf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d870ac2-825e-4d5b-825b-fcc194138508] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:46.389375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60bd9a7a-1675-413e-8efd-45743a0776cf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:46.395872 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60bd9a7a-1675-413e-8efd-45743a0776cf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:46.397903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60bd9a7a-1675-413e-8efd-45743a0776cf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:46.404037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60bd9a7a-1675-413e-8efd-45743a0776cf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:46.405723 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60bd9a7a-1675-413e-8efd-45743a0776cf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:46.408212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60bd9a7a-1675-413e-8efd-45743a0776cf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:46.428536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-676af418-9b6a-4814-87e6-d496268460d8 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:46.430040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-676af418-9b6a-4814-87e6-d496268460d8 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] [instance: cd2715f4-fb54-4e6f-be46-406f17deea65] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:46.471626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-676af418-9b6a-4814-87e6-d496268460d8 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:46.476319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-676af418-9b6a-4814-87e6-d496268460d8 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:46.485840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-676af418-9b6a-4814-87e6-d496268460d8 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:46.489258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-676af418-9b6a-4814-87e6-d496268460d8 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:46.495260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-676af418-9b6a-4814-87e6-d496268460d8 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:46.499044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-676af418-9b6a-4814-87e6-d496268460d8 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:47.213850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-60bd9a7a-1675-413e-8efd-45743a0776cf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:47.223464 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-60bd9a7a-1675-413e-8efd-45743a0776cf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508" status: 200 len: 1309 microversion: 2.1 time: 0.900236 Sep 07 12:56:47.226124 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2477/5007] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:46 2022] GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508 => generated 1309 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:47.244285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d6db31a7-dd4b-4351-9d33-f06916d0618d req-1e23321e-a6bf-4514-8beb-f18f72585fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d870ac2-825e-4d5b-825b-fcc194138508", "tag": "5f3edcd8-420a-40d3-8325-b00f4f96f637"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:56:47.263808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d6db31a7-dd4b-4351-9d33-f06916d0618d req-1e23321e-a6bf-4514-8beb-f18f72585fd6 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:47.264386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d6db31a7-dd4b-4351-9d33-f06916d0618d req-1e23321e-a6bf-4514-8beb-f18f72585fd6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:47.264842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d6db31a7-dd4b-4351-9d33-f06916d0618d req-1e23321e-a6bf-4514-8beb-f18f72585fd6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:47.291915 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d6db31a7-dd4b-4351-9d33-f06916d0618d req-1e23321e-a6bf-4514-8beb-f18f72585fd6 service nova] Creating event network-changed:5f3edcd8-420a-40d3-8325-b00f4f96f637 for instance 7d870ac2-825e-4d5b-825b-fcc194138508 on n-h2-852087-9 Sep 07 12:56:47.301290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-676af418-9b6a-4814-87e6-d496268460d8 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:47.306937 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d6db31a7-dd4b-4351-9d33-f06916d0618d req-1e23321e-a6bf-4514-8beb-f18f72585fd6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079525 Sep 07 12:56:47.308537 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2478/5008] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:56:47.319664 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b1950e7e-de6a-4648-aa94-3d828ed7fb01 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:47.320304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b1950e7e-de6a-4648-aa94-3d828ed7fb01 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:47.329256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-676af418-9b6a-4814-87e6-d496268460d8 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:47.333121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-676af418-9b6a-4814-87e6-d496268460d8 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:47.336200 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-676af418-9b6a-4814-87e6-d496268460d8 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] 10.222.0.16 "GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65" status: 200 len: 1551 microversion: 2.21 time: 0.919330 Sep 07 12:56:47.353062 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2531/5009] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:56:46 2022] GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65 => generated 1551 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:56:47.353353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1950e7e-de6a-4648-aa94-3d828ed7fb01 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:47.353353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1950e7e-de6a-4648-aa94-3d828ed7fb01 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:47.353353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1950e7e-de6a-4648-aa94-3d828ed7fb01 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:47.354326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1950e7e-de6a-4648-aa94-3d828ed7fb01 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:47.355199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1950e7e-de6a-4648-aa94-3d828ed7fb01 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:47.355826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1950e7e-de6a-4648-aa94-3d828ed7fb01 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:47.365339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b51b023f-b867-408d-8548-5d729efe0367 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:47.367129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b51b023f-b867-408d-8548-5d729efe0367 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:47.393656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b51b023f-b867-408d-8548-5d729efe0367 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:47.404932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b51b023f-b867-408d-8548-5d729efe0367 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:47.405813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b51b023f-b867-408d-8548-5d729efe0367 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:47.407186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b51b023f-b867-408d-8548-5d729efe0367 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:47.408322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b51b023f-b867-408d-8548-5d729efe0367 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:47.409102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b51b023f-b867-408d-8548-5d729efe0367 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:47.411498 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b1950e7e-de6a-4648-aa94-3d828ed7fb01 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef/ips" status: 200 len: 147 microversion: 2.1 time: 0.101621 Sep 07 12:56:47.416769 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2479/5010] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Sep 7 12:56:47 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef/ips => generated 147 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:56:47.422457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-29058495-545b-4bdd-abf4-7a88396036c7 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:47.431054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-29058495-545b-4bdd-abf4-7a88396036c7 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] [instance: cd2715f4-fb54-4e6f-be46-406f17deea65] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:47.447432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29058495-545b-4bdd-abf4-7a88396036c7 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:47.448560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29058495-545b-4bdd-abf4-7a88396036c7 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:47.449284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29058495-545b-4bdd-abf4-7a88396036c7 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:47.450344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29058495-545b-4bdd-abf4-7a88396036c7 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:47.451104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29058495-545b-4bdd-abf4-7a88396036c7 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:47.451774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29058495-545b-4bdd-abf4-7a88396036c7 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:47.460518 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:47.523073 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-29058495-545b-4bdd-abf4-7a88396036c7 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] [instance: cd2715f4-fb54-4e6f-be46-406f17deea65] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:56:47.831403 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-29058495-545b-4bdd-abf4-7a88396036c7 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65" status: 204 len: 0 microversion: 2.21 time: 0.409048 Sep 07 12:56:47.834164 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2480/5011] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 12:56:47 2022] DELETE /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 12:56:47.857889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-81cc2267-2356-4976-ac71-0bc8f0b25c4e tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:47.864259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-81cc2267-2356-4976-ac71-0bc8f0b25c4e tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] [instance: cd2715f4-fb54-4e6f-be46-406f17deea65] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:47.881912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81cc2267-2356-4976-ac71-0bc8f0b25c4e tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:47.882939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81cc2267-2356-4976-ac71-0bc8f0b25c4e tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:47.883626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81cc2267-2356-4976-ac71-0bc8f0b25c4e tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:47.884653 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81cc2267-2356-4976-ac71-0bc8f0b25c4e tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:47.885366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81cc2267-2356-4976-ac71-0bc8f0b25c4e tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:47.886056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81cc2267-2356-4976-ac71-0bc8f0b25c4e tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:48.089041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b51b023f-b867-408d-8548-5d729efe0367 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:48.120093 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b51b023f-b867-408d-8548-5d729efe0367 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.780812 Sep 07 12:56:48.126869 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2532/5012] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:47 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:48.177616 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8d224208-28c6-4779-b3d8-ae2f085d41cb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:48.183844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8d224208-28c6-4779-b3d8-ae2f085d41cb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:48.202720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d224208-28c6-4779-b3d8-ae2f085d41cb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:48.204137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d224208-28c6-4779-b3d8-ae2f085d41cb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:48.205971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d224208-28c6-4779-b3d8-ae2f085d41cb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:48.207817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d224208-28c6-4779-b3d8-ae2f085d41cb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:48.209248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d224208-28c6-4779-b3d8-ae2f085d41cb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:48.210845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d224208-28c6-4779-b3d8-ae2f085d41cb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:48.644342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-81cc2267-2356-4976-ac71-0bc8f0b25c4e tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:48.676619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-81cc2267-2356-4976-ac71-0bc8f0b25c4e tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:48.679666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-81cc2267-2356-4976-ac71-0bc8f0b25c4e tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:48.685039 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-81cc2267-2356-4976-ac71-0bc8f0b25c4e tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] 10.222.0.16 "GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65" status: 200 len: 1557 microversion: 2.21 time: 0.836716 Sep 07 12:56:48.706783 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2481/5013] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:56:47 2022] GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65 => generated 1557 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:56:48.729946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ae0721a-a96f-420e-9f32-ffde7eb66568 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:48.734563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6ae0721a-a96f-420e-9f32-ffde7eb66568 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d870ac2-825e-4d5b-825b-fcc194138508] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:48.750710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8d224208-28c6-4779-b3d8-ae2f085d41cb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:48.764464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ae0721a-a96f-420e-9f32-ffde7eb66568 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:48.765356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ae0721a-a96f-420e-9f32-ffde7eb66568 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:48.766374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ae0721a-a96f-420e-9f32-ffde7eb66568 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:48.768608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ae0721a-a96f-420e-9f32-ffde7eb66568 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:48.770635 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8d224208-28c6-4779-b3d8-ae2f085d41cb tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.602417 Sep 07 12:56:48.771844 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ae0721a-a96f-420e-9f32-ffde7eb66568 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:48.774338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ae0721a-a96f-420e-9f32-ffde7eb66568 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:48.774926 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2533/5014] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:48 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:48.822362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c776cfb-5324-4acd-ba76-9ba529725c19 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:48.825588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2c776cfb-5324-4acd-ba76-9ba529725c19 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:48.853534 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c776cfb-5324-4acd-ba76-9ba529725c19 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:48.855027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c776cfb-5324-4acd-ba76-9ba529725c19 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:48.856301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c776cfb-5324-4acd-ba76-9ba529725c19 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:48.860518 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c776cfb-5324-4acd-ba76-9ba529725c19 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:48.866923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c776cfb-5324-4acd-ba76-9ba529725c19 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:48.868042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c776cfb-5324-4acd-ba76-9ba529725c19 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:49.212081 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2c776cfb-5324-4acd-ba76-9ba529725c19 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:49.235507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6ae0721a-a96f-420e-9f32-ffde7eb66568 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:49.243343 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2c776cfb-5324-4acd-ba76-9ba529725c19 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.427534 Sep 07 12:56:49.245050 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2534/5015] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:48 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:49.268768 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6ae0721a-a96f-420e-9f32-ffde7eb66568 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508" status: 200 len: 1309 microversion: 2.1 time: 0.545353 Sep 07 12:56:49.277524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-66150314-c9aa-49a2-a68d-e6b263d0c08d tempest-VolumesTestJSON-1083079829 tempest-VolumesTestJSON-1083079829-project] Calling method '.version_select at 0x7fc418b81160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:49.277882 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2482/5016] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:48 2022] GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508 => generated 1309 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:49.310851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f17f0f1c-48d6-47c8-96db-c6fb3ce8ba05 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:49.311199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f17f0f1c-48d6-47c8-96db-c6fb3ce8ba05 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:49.322625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f17f0f1c-48d6-47c8-96db-c6fb3ce8ba05 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:49.323345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f17f0f1c-48d6-47c8-96db-c6fb3ce8ba05 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:49.324132 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f17f0f1c-48d6-47c8-96db-c6fb3ce8ba05 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:49.325680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f17f0f1c-48d6-47c8-96db-c6fb3ce8ba05 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:49.326583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f17f0f1c-48d6-47c8-96db-c6fb3ce8ba05 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:49.327350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f17f0f1c-48d6-47c8-96db-c6fb3ce8ba05 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:49.382932 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-66150314-c9aa-49a2-a68d-e6b263d0c08d tempest-VolumesTestJSON-1083079829 tempest-VolumesTestJSON-1083079829-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4e679764-b800-43a9-ab45-f94eb037e91f" status: 200 len: 351 microversion: 2.1 time: 0.116509 Sep 07 12:56:49.383895 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2535/5017] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Sep 7 12:56:49 2022] GET /compute/v2.1/os-volumes/4e679764-b800-43a9-ab45-f94eb037e91f => generated 351 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:56:49.546524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f17f0f1c-48d6-47c8-96db-c6fb3ce8ba05 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:49.555203 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f17f0f1c-48d6-47c8-96db-c6fb3ce8ba05 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.267869 Sep 07 12:56:49.559853 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2483/5018] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:49 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:49.603284 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d888e7f5-1c37-4663-a646-695d2f2c7e8d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:49.605654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d888e7f5-1c37-4663-a646-695d2f2c7e8d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:49.625658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d888e7f5-1c37-4663-a646-695d2f2c7e8d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:49.632104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d888e7f5-1c37-4663-a646-695d2f2c7e8d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:49.633890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d888e7f5-1c37-4663-a646-695d2f2c7e8d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:49.635782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d888e7f5-1c37-4663-a646-695d2f2c7e8d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:49.636885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d888e7f5-1c37-4663-a646-695d2f2c7e8d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:49.638258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d888e7f5-1c37-4663-a646-695d2f2c7e8d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:49.720421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2044f3c7-eda8-4ef0-a651-c69e9c089f62 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:49.721258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2044f3c7-eda8-4ef0-a651-c69e9c089f62 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] [instance: cd2715f4-fb54-4e6f-be46-406f17deea65] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:49.732598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2044f3c7-eda8-4ef0-a651-c69e9c089f62 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:49.737671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2044f3c7-eda8-4ef0-a651-c69e9c089f62 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:49.738852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2044f3c7-eda8-4ef0-a651-c69e9c089f62 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:49.739825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2044f3c7-eda8-4ef0-a651-c69e9c089f62 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:49.740279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2044f3c7-eda8-4ef0-a651-c69e9c089f62 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:49.744173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2044f3c7-eda8-4ef0-a651-c69e9c089f62 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:51.527104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d888e7f5-1c37-4663-a646-695d2f2c7e8d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:51.557818 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d888e7f5-1c37-4663-a646-695d2f2c7e8d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 1.969903 Sep 07 12:56:51.563361 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2536/5019] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:49 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 1979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:51.585666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-84795fe1-210f-45bc-8ea7-998f0a9d11cc tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:51.596607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-84795fe1-210f-45bc-8ea7-998f0a9d11cc tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d870ac2-825e-4d5b-825b-fcc194138508] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:51.617192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84795fe1-210f-45bc-8ea7-998f0a9d11cc tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:51.622599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2044f3c7-eda8-4ef0-a651-c69e9c089f62 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:51.627383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84795fe1-210f-45bc-8ea7-998f0a9d11cc tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:51.628251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84795fe1-210f-45bc-8ea7-998f0a9d11cc tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:51.629564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84795fe1-210f-45bc-8ea7-998f0a9d11cc tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:51.630394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84795fe1-210f-45bc-8ea7-998f0a9d11cc tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:51.638675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84795fe1-210f-45bc-8ea7-998f0a9d11cc tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:51.681208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2044f3c7-eda8-4ef0-a651-c69e9c089f62 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:51.699806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2044f3c7-eda8-4ef0-a651-c69e9c089f62 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:51.702707 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2044f3c7-eda8-4ef0-a651-c69e9c089f62 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] 10.222.0.16 "GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65" status: 200 len: 1557 microversion: 2.21 time: 1.987240 Sep 07 12:56:51.707667 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2484/5020] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:56:49 2022] GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65 => generated 1557 bytes in 1993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:56:51.734422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-369c4f60-3b0e-4de6-86ec-0999011d13b2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:56:51.735940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-369c4f60-3b0e-4de6-86ec-0999011d13b2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:51.755919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-369c4f60-3b0e-4de6-86ec-0999011d13b2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:51.760647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-369c4f60-3b0e-4de6-86ec-0999011d13b2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:51.766951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-369c4f60-3b0e-4de6-86ec-0999011d13b2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:51.768552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-369c4f60-3b0e-4de6-86ec-0999011d13b2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:51.769690 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-369c4f60-3b0e-4de6-86ec-0999011d13b2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:51.772442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-369c4f60-3b0e-4de6-86ec-0999011d13b2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:52.009135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-369c4f60-3b0e-4de6-86ec-0999011d13b2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lazy-loading 'flavor' on Instance uuid edf38c92-ffc2-492b-8642-88ca59537acd {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:56:52.320105 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-369c4f60-3b0e-4de6-86ec-0999011d13b2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action" status: 202 len: 0 microversion: 2.1 time: 0.596883 Sep 07 12:56:52.320997 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2485/5021] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:56:51 2022] POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:56:52.332361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-a4e0b3da-cdd6-4363-bcb5-8bd944b92343 req-500debde-7f8a-4e7e-8df7-e0c66c252935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd2715f4-fb54-4e6f-be46-406f17deea65", "name": "network-vif-deleted", "tag": "42f4f2cf-62b8-4634-9689-39feea1a49af"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:56:52.404303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a4e0b3da-cdd6-4363-bcb5-8bd944b92343 req-500debde-7f8a-4e7e-8df7-e0c66c252935 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:52.405142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a4e0b3da-cdd6-4363-bcb5-8bd944b92343 req-500debde-7f8a-4e7e-8df7-e0c66c252935 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:52.405872 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a4e0b3da-cdd6-4363-bcb5-8bd944b92343 req-500debde-7f8a-4e7e-8df7-e0c66c252935 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:52.467472 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-a4e0b3da-cdd6-4363-bcb5-8bd944b92343 req-500debde-7f8a-4e7e-8df7-e0c66c252935 service nova] Creating event network-vif-deleted:42f4f2cf-62b8-4634-9689-39feea1a49af for instance cd2715f4-fb54-4e6f-be46-406f17deea65 on n-h1-852087-9 Sep 07 12:56:52.482876 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-a4e0b3da-cdd6-4363-bcb5-8bd944b92343 req-500debde-7f8a-4e7e-8df7-e0c66c252935 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159974 Sep 07 12:56:52.485505 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2486/5022] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:56:52.495580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ef9ddef0-0f2f-4e6d-af4b-a2079a65a1bf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:52.496327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ef9ddef0-0f2f-4e6d-af4b-a2079a65a1bf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:52.519489 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef9ddef0-0f2f-4e6d-af4b-a2079a65a1bf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:52.519896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef9ddef0-0f2f-4e6d-af4b-a2079a65a1bf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:52.520350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef9ddef0-0f2f-4e6d-af4b-a2079a65a1bf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:52.521330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef9ddef0-0f2f-4e6d-af4b-a2079a65a1bf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:52.521843 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef9ddef0-0f2f-4e6d-af4b-a2079a65a1bf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:52.522284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef9ddef0-0f2f-4e6d-af4b-a2079a65a1bf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:52.656359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-84795fe1-210f-45bc-8ea7-998f0a9d11cc tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:52.694775 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-84795fe1-210f-45bc-8ea7-998f0a9d11cc tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508" status: 200 len: 1309 microversion: 2.1 time: 1.125820 Sep 07 12:56:52.700026 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2537/5023] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:51 2022] GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508 => generated 1309 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:52.769238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b4ab9a14-0d10-4f83-840a-436e1cb19d3d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:52.771504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b4ab9a14-0d10-4f83-840a-436e1cb19d3d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] [instance: cd2715f4-fb54-4e6f-be46-406f17deea65] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:52.793077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4ab9a14-0d10-4f83-840a-436e1cb19d3d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:52.793666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4ab9a14-0d10-4f83-840a-436e1cb19d3d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:52.795623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4ab9a14-0d10-4f83-840a-436e1cb19d3d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:52.798434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4ab9a14-0d10-4f83-840a-436e1cb19d3d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:52.799106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4ab9a14-0d10-4f83-840a-436e1cb19d3d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:52.807192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4ab9a14-0d10-4f83-840a-436e1cb19d3d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:52.946332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4ab9a14-0d10-4f83-840a-436e1cb19d3d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:52.947653 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4ab9a14-0d10-4f83-840a-436e1cb19d3d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:52.951277 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4ab9a14-0d10-4f83-840a-436e1cb19d3d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:52.952549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-b4ab9a14-0d10-4f83-840a-436e1cb19d3d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lazy-loading 'fault' on Instance uuid cd2715f4-fb54-4e6f-be46-406f17deea65 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:56:52.972743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:52.990998 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ef9ddef0-0f2f-4e6d-af4b-a2079a65a1bf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:53.005445 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ef9ddef0-0f2f-4e6d-af4b-a2079a65a1bf tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1677 microversion: 2.1 time: 0.518591 Sep 07 12:56:53.010694 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2487/5024] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:52 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1677 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:53.125882 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b4ab9a14-0d10-4f83-840a-436e1cb19d3d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:53.165993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-14ed47ab-8309-4ca4-846b-d443336b557f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:53.171753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-14ed47ab-8309-4ca4-846b-d443336b557f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:53.197957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b4ab9a14-0d10-4f83-840a-436e1cb19d3d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:53.201423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b4ab9a14-0d10-4f83-840a-436e1cb19d3d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c58cee04d67494a94895e61ea116fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f418a0675df74978838b37f052c788c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:53.212129 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b4ab9a14-0d10-4f83-840a-436e1cb19d3d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] 10.222.0.16 "GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65" status: 200 len: 1349 microversion: 2.21 time: 0.455670 Sep 07 12:56:53.227265 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2538/5025] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:56:52 2022] GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65 => generated 1349 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:56:53.229991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14ed47ab-8309-4ca4-846b-d443336b557f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:53.230935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14ed47ab-8309-4ca4-846b-d443336b557f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:53.232990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14ed47ab-8309-4ca4-846b-d443336b557f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:53.235265 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14ed47ab-8309-4ca4-846b-d443336b557f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:53.236556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14ed47ab-8309-4ca4-846b-d443336b557f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:53.237589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14ed47ab-8309-4ca4-846b-d443336b557f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:53.398955 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-14ed47ab-8309-4ca4-846b-d443336b557f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b/ips" status: 200 len: 151 microversion: 2.20 time: 0.249898 Sep 07 12:56:53.415103 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2488/5026] 10.222.0.16 () {60 vars in 1289 bytes} [Wed Sep 7 12:56:53 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b/ips => generated 151 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 12:56:53.747036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-def5c217-4ffe-4c9c-bfb6-186b948a1296 tempest-VolumesTestJSON-1083079829 tempest-VolumesTestJSON-1083079829-project] Calling method '.version_select at 0x7fc41840d0d0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:53.754623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-36ce9377-7e11-467e-a79c-56fdaa55a903 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:53.759270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-36ce9377-7e11-467e-a79c-56fdaa55a903 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d870ac2-825e-4d5b-825b-fcc194138508] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:53.791826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36ce9377-7e11-467e-a79c-56fdaa55a903 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:53.800814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36ce9377-7e11-467e-a79c-56fdaa55a903 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:53.809291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36ce9377-7e11-467e-a79c-56fdaa55a903 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:53.811920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36ce9377-7e11-467e-a79c-56fdaa55a903 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:53.813403 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36ce9377-7e11-467e-a79c-56fdaa55a903 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:53.814550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36ce9377-7e11-467e-a79c-56fdaa55a903 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:53.918867 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-def5c217-4ffe-4c9c-bfb6-186b948a1296 tempest-VolumesTestJSON-1083079829 tempest-VolumesTestJSON-1083079829-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/b919f5e2-8ce3-48c1-b94b-09bb5183b011" status: 200 len: 349 microversion: 2.1 time: 0.176049 Sep 07 12:56:53.920677 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2539/5027] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Sep 7 12:56:53 2022] GET /compute/v2.1/os-volumes/b919f5e2-8ce3-48c1-b94b-09bb5183b011 => generated 349 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:56:54.065886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-879bcf88-d49d-44c2-afed-a1f5edd5645c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:54.067655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-879bcf88-d49d-44c2-afed-a1f5edd5645c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:54.081188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-879bcf88-d49d-44c2-afed-a1f5edd5645c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:54.090436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-879bcf88-d49d-44c2-afed-a1f5edd5645c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:54.091587 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-879bcf88-d49d-44c2-afed-a1f5edd5645c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:54.093225 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-879bcf88-d49d-44c2-afed-a1f5edd5645c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:54.094370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-879bcf88-d49d-44c2-afed-a1f5edd5645c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:54.095401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-879bcf88-d49d-44c2-afed-a1f5edd5645c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:54.419042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-36ce9377-7e11-467e-a79c-56fdaa55a903 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:54.427722 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-36ce9377-7e11-467e-a79c-56fdaa55a903 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508" status: 200 len: 1309 microversion: 2.1 time: 0.681700 Sep 07 12:56:54.437708 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2489/5028] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:53 2022] GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508 => generated 1309 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:54.443199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a9b6a325-2702-4538-8ee8-6e26a8b21274 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:54.444428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a9b6a325-2702-4538-8ee8-6e26a8b21274 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] [instance: cd2715f4-fb54-4e6f-be46-406f17deea65] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:54.459901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9b6a325-2702-4538-8ee8-6e26a8b21274 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:54.460460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9b6a325-2702-4538-8ee8-6e26a8b21274 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:54.464147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9b6a325-2702-4538-8ee8-6e26a8b21274 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:54.468432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9b6a325-2702-4538-8ee8-6e26a8b21274 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:54.472911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9b6a325-2702-4538-8ee8-6e26a8b21274 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:54.473614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9b6a325-2702-4538-8ee8-6e26a8b21274 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:54.499549 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-a9b6a325-2702-4538-8ee8-6e26a8b21274 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] HTTP exception thrown: Instance cd2715f4-fb54-4e6f-be46-406f17deea65 could not be found. Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a9b6a325-2702-4538-8ee8-6e26a8b21274 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Request method failure captured: Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65 HTTP/1.1 Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJT4H2j4PU9YpoAj9K45DYxJAebqcDDXxgD1AcJ4-upot-Yx34ioSLg8G-AftRQTGgXXMHPNMKmPm8mQAjJi_79U_7huMn6JupzzPmRZkK0qpxlUiKs-5EkP8WstP2jYJGRrsk_zXDUqxaPBtTi6mLvav6gTw65tcKxya4-5gh_FG9A Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.21 Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: f418a0675df74978838b37f052c788c2 Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-InstanceActionsV221TestJSON-884117802 Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f418a0675df74978838b37f052c788c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f418a0675df74978838b37f052c788c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f418a0675df74978838b37f052c788c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f418a0675df74978838b37f052c788c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-InstanceActionsV221TestJSON-884117802 Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: f418a0675df74978838b37f052c788c2 Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-884117802 Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-InstanceActionsV221TestJSON-884117802-project Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 9c58cee04d67494a94895e61ea116fb4 Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-InstanceActionsV221TestJSON-884117802-project Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance cd2715f4-fb54-4e6f-be46-406f17deea65 could not be found. Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'cd2715f4-fb54-4e6f-be46-406f17deea65'} Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd2715f4-fb54-4e6f-be46-406f17deea65 could not be found. Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd2715f4-fb54-4e6f-be46-406f17deea65 could not be found. Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:56:54.501636 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:56:54.512116 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:56:54.512116 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:56:54.512116 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:56:54.512116 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:56:54.512116 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:56:54.512116 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:56:54.512116 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd2715f4-fb54-4e6f-be46-406f17deea65 could not be found. Sep 07 12:56:54.512116 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:56:54.512116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a9b6a325-2702-4538-8ee8-6e26a8b21274 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Returning 404 to user: Instance cd2715f4-fb54-4e6f-be46-406f17deea65 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:56:54.512116 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a9b6a325-2702-4538-8ee8-6e26a8b21274 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] 10.222.0.16 "GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65" status: 404 len: 111 microversion: 2.21 time: 0.064090 Sep 07 12:56:54.512116 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2490/5029] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:56:54 2022] GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:56:54.519832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9055f86c-aa9d-4cf9-9543-61e2b3306b7b tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Calling method '.version_select at 0x7fc4138ca9d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:54.520703 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9055f86c-aa9d-4cf9-9543-61e2b3306b7b tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] [instance: cd2715f4-fb54-4e6f-be46-406f17deea65] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:54.528022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9055f86c-aa9d-4cf9-9543-61e2b3306b7b tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:54.528837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9055f86c-aa9d-4cf9-9543-61e2b3306b7b tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:54.529453 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9055f86c-aa9d-4cf9-9543-61e2b3306b7b tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:54.530429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9055f86c-aa9d-4cf9-9543-61e2b3306b7b tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:54.531061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9055f86c-aa9d-4cf9-9543-61e2b3306b7b tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:54.531654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9055f86c-aa9d-4cf9-9543-61e2b3306b7b tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:54.557265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-879bcf88-d49d-44c2-afed-a1f5edd5645c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:54.592536 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-879bcf88-d49d-44c2-afed-a1f5edd5645c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1660 microversion: 2.1 time: 0.546887 Sep 07 12:56:54.594020 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2540/5030] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:54 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1660 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:56:54.669563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d60ffbe8-32cb-4060-a267-d2de6fedf40b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:56:54.671003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d60ffbe8-32cb-4060-a267-d2de6fedf40b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:54.677597 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9055f86c-aa9d-4cf9-9543-61e2b3306b7b tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] 10.222.0.16 "GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.162592 Sep 07 12:56:54.686853 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2491/5031] 10.222.0.16 () {60 vars in 1337 bytes} [Wed Sep 7 12:56:54 2022] GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65/os-instance-actions => generated 611 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:56:54.691227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d60ffbe8-32cb-4060-a267-d2de6fedf40b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:54.692372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d60ffbe8-32cb-4060-a267-d2de6fedf40b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:54.693280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d60ffbe8-32cb-4060-a267-d2de6fedf40b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:54.694368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eb042372-fb62-49c9-866e-ee0835fad668 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "428b8f19-cc79-4c5d-b08c-ee7dfb9c7d22"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:56:54.695189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d60ffbe8-32cb-4060-a267-d2de6fedf40b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:54.696229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d60ffbe8-32cb-4060-a267-d2de6fedf40b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:54.697115 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d60ffbe8-32cb-4060-a267-d2de6fedf40b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:54.698451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eb042372-fb62-49c9-866e-ee0835fad668 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:54.706334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb042372-fb62-49c9-866e-ee0835fad668 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:54.707166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb042372-fb62-49c9-866e-ee0835fad668 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:54.707607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb042372-fb62-49c9-866e-ee0835fad668 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:54.708578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb042372-fb62-49c9-866e-ee0835fad668 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:54.709207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb042372-fb62-49c9-866e-ee0835fad668 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:54.709953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb042372-fb62-49c9-866e-ee0835fad668 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:54.854544 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d60ffbe8-32cb-4060-a267-d2de6fedf40b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action" status: 202 len: 0 microversion: 2.1 time: 0.215276 Sep 07 12:56:54.864773 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2541/5032] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:56:54 2022] POST /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:56:54.885165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8e4f3878-299f-4fc1-8220-47407b99533d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:54.886445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8e4f3878-299f-4fc1-8220-47407b99533d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] [instance: cd2715f4-fb54-4e6f-be46-406f17deea65] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:54.898915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e4f3878-299f-4fc1-8220-47407b99533d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:54.900215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e4f3878-299f-4fc1-8220-47407b99533d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:54.901297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e4f3878-299f-4fc1-8220-47407b99533d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:54.902874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e4f3878-299f-4fc1-8220-47407b99533d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:54.904037 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e4f3878-299f-4fc1-8220-47407b99533d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:54.905079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e4f3878-299f-4fc1-8220-47407b99533d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:54.939419 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-8e4f3878-299f-4fc1-8220-47407b99533d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] HTTP exception thrown: Instance cd2715f4-fb54-4e6f-be46-406f17deea65 could not be found. Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8e4f3878-299f-4fc1-8220-47407b99533d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Request method failure captured: Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65 HTTP/1.1 Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJT4H2j4PU9YpoAj9K45DYxJAebqcDDXxgD1AcJ4-upot-Yx34ioSLg8G-AftRQTGgXXMHPNMKmPm8mQAjJi_79U_7huMn6JupzzPmRZkK0qpxlUiKs-5EkP8WstP2jYJGRrsk_zXDUqxaPBtTi6mLvav6gTw65tcKxya4-5gh_FG9A Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.21 Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: f418a0675df74978838b37f052c788c2 Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-InstanceActionsV221TestJSON-884117802 Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f418a0675df74978838b37f052c788c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f418a0675df74978838b37f052c788c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f418a0675df74978838b37f052c788c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f418a0675df74978838b37f052c788c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-InstanceActionsV221TestJSON-884117802 Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: f418a0675df74978838b37f052c788c2 Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-884117802 Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-InstanceActionsV221TestJSON-884117802-project Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 9c58cee04d67494a94895e61ea116fb4 Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-InstanceActionsV221TestJSON-884117802-project Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance cd2715f4-fb54-4e6f-be46-406f17deea65 could not be found. Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'cd2715f4-fb54-4e6f-be46-406f17deea65'} Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd2715f4-fb54-4e6f-be46-406f17deea65 could not be found. Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:56:54.943771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:56:54.953146 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd2715f4-fb54-4e6f-be46-406f17deea65 could not be found. Sep 07 12:56:54.953146 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:54.953146 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:56:54.953146 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:54.953146 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:56:54.953146 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:56:54.953146 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:56:54.953146 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:56:54.953146 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:56:54.953146 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd2715f4-fb54-4e6f-be46-406f17deea65 could not be found. Sep 07 12:56:54.953146 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:54.956343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8e4f3878-299f-4fc1-8220-47407b99533d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Returning 404 to user: Instance cd2715f4-fb54-4e6f-be46-406f17deea65 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:56:54.957899 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8e4f3878-299f-4fc1-8220-47407b99533d tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65" status: 404 len: 111 microversion: 2.21 time: 0.090022 Sep 07 12:56:54.959168 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2542/5033] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 12:56:54 2022] DELETE /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:56:54.972315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-60e9c74c-5522-460e-bde0-d7bebad51b82 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:54.974429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-60e9c74c-5522-460e-bde0-d7bebad51b82 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:54.987853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60e9c74c-5522-460e-bde0-d7bebad51b82 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:54.988941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60e9c74c-5522-460e-bde0-d7bebad51b82 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:54.989910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60e9c74c-5522-460e-bde0-d7bebad51b82 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:54.991587 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60e9c74c-5522-460e-bde0-d7bebad51b82 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:54.992618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60e9c74c-5522-460e-bde0-d7bebad51b82 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:54.993710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60e9c74c-5522-460e-bde0-d7bebad51b82 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:55.360118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-60e9c74c-5522-460e-bde0-d7bebad51b82 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:55.381446 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-60e9c74c-5522-460e-bde0-d7bebad51b82 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1666 microversion: 2.1 time: 0.419661 Sep 07 12:56:55.382760 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2543/5034] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:54 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1666 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:55.414499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d0845fe4-03ee-4c8b-9b2c-df9fea1e2a87 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:55.415189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d0845fe4-03ee-4c8b-9b2c-df9fea1e2a87 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] [instance: cd2715f4-fb54-4e6f-be46-406f17deea65] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:55.448416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0845fe4-03ee-4c8b-9b2c-df9fea1e2a87 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:55.449936 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0845fe4-03ee-4c8b-9b2c-df9fea1e2a87 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:55.450419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0845fe4-03ee-4c8b-9b2c-df9fea1e2a87 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:55.452168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0845fe4-03ee-4c8b-9b2c-df9fea1e2a87 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:55.452668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0845fe4-03ee-4c8b-9b2c-df9fea1e2a87 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:55.457349 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0845fe4-03ee-4c8b-9b2c-df9fea1e2a87 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:55.461818 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eb042372-fb62-49c9-866e-ee0835fad668 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "POST /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.772640 Sep 07 12:56:55.477059 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2492/5035] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Sep 7 12:56:54 2022] POST /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef/os-volume_attachments => generated 194 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:56:55.490125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-34d41d06-93b7-4a14-8ecf-fb4f9cc2245b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:55.494501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-34d41d06-93b7-4a14-8ecf-fb4f9cc2245b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d870ac2-825e-4d5b-825b-fcc194138508] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:55.525287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34d41d06-93b7-4a14-8ecf-fb4f9cc2245b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:55.531018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34d41d06-93b7-4a14-8ecf-fb4f9cc2245b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:55.531913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34d41d06-93b7-4a14-8ecf-fb4f9cc2245b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:55.533207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34d41d06-93b7-4a14-8ecf-fb4f9cc2245b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:55.538606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34d41d06-93b7-4a14-8ecf-fb4f9cc2245b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:55.538938 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-d0845fe4-03ee-4c8b-9b2c-df9fea1e2a87 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] HTTP exception thrown: Instance cd2715f4-fb54-4e6f-be46-406f17deea65 could not be found. Sep 07 12:56:55.539760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34d41d06-93b7-4a14-8ecf-fb4f9cc2245b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d0845fe4-03ee-4c8b-9b2c-df9fea1e2a87 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Request method failure captured: Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65 HTTP/1.1 Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJT4H2j4PU9YpoAj9K45DYxJAebqcDDXxgD1AcJ4-upot-Yx34ioSLg8G-AftRQTGgXXMHPNMKmPm8mQAjJi_79U_7huMn6JupzzPmRZkK0qpxlUiKs-5EkP8WstP2jYJGRrsk_zXDUqxaPBtTi6mLvav6gTw65tcKxya4-5gh_FG9A Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.21 Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: f418a0675df74978838b37f052c788c2 Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-InstanceActionsV221TestJSON-884117802 Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f418a0675df74978838b37f052c788c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f418a0675df74978838b37f052c788c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f418a0675df74978838b37f052c788c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f418a0675df74978838b37f052c788c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-InstanceActionsV221TestJSON-884117802 Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: f418a0675df74978838b37f052c788c2 Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-884117802 Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-InstanceActionsV221TestJSON-884117802-project Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 9c58cee04d67494a94895e61ea116fb4 Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-InstanceActionsV221TestJSON-884117802-project Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance cd2715f4-fb54-4e6f-be46-406f17deea65 could not be found. Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'cd2715f4-fb54-4e6f-be46-406f17deea65'} Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd2715f4-fb54-4e6f-be46-406f17deea65 could not be found. Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd2715f4-fb54-4e6f-be46-406f17deea65 could not be found. Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:55.540439 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:56:55.550807 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:55.550807 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:56:55.550807 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:56:55.550807 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:56:55.550807 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:56:55.550807 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:56:55.550807 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd2715f4-fb54-4e6f-be46-406f17deea65 could not be found. Sep 07 12:56:55.550807 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:56:55.550807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d0845fe4-03ee-4c8b-9b2c-df9fea1e2a87 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] Returning 404 to user: Instance cd2715f4-fb54-4e6f-be46-406f17deea65 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:56:55.550807 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d0845fe4-03ee-4c8b-9b2c-df9fea1e2a87 tempest-InstanceActionsV221TestJSON-884117802 tempest-InstanceActionsV221TestJSON-884117802-project] 10.222.0.16 "GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65" status: 404 len: 111 microversion: 2.21 time: 0.145987 Sep 07 12:56:55.570472 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2544/5036] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:56:55 2022] GET /compute/v2.1/servers/cd2715f4-fb54-4e6f-be46-406f17deea65 => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:56:56.201882 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-bbf0f715-7f67-48da-88e0-92e3fe8dc7f6 req-26769bb4-551a-42bc-976c-bf3c88475108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d870ac2-825e-4d5b-825b-fcc194138508", "name": "network-vif-plugged", "status": "completed", "tag": "5f3edcd8-420a-40d3-8325-b00f4f96f637"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:56:56.231649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bbf0f715-7f67-48da-88e0-92e3fe8dc7f6 req-26769bb4-551a-42bc-976c-bf3c88475108 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:56.237080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bbf0f715-7f67-48da-88e0-92e3fe8dc7f6 req-26769bb4-551a-42bc-976c-bf3c88475108 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:56.244823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-bbf0f715-7f67-48da-88e0-92e3fe8dc7f6 req-26769bb4-551a-42bc-976c-bf3c88475108 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:56.302066 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-bbf0f715-7f67-48da-88e0-92e3fe8dc7f6 req-26769bb4-551a-42bc-976c-bf3c88475108 service nova] Creating event network-vif-plugged:5f3edcd8-420a-40d3-8325-b00f4f96f637 for instance 7d870ac2-825e-4d5b-825b-fcc194138508 on n-h2-852087-9 Sep 07 12:56:56.320815 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-bbf0f715-7f67-48da-88e0-92e3fe8dc7f6 req-26769bb4-551a-42bc-976c-bf3c88475108 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123741 Sep 07 12:56:56.328159 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2545/5037] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:56:56.434353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-15e479e9-84d5-4a40-8587-e9d27659ceb6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:56.438341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-15e479e9-84d5-4a40-8587-e9d27659ceb6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:56.501079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15e479e9-84d5-4a40-8587-e9d27659ceb6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:56.503416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15e479e9-84d5-4a40-8587-e9d27659ceb6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:56.504694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15e479e9-84d5-4a40-8587-e9d27659ceb6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:56.509245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15e479e9-84d5-4a40-8587-e9d27659ceb6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:56.512609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15e479e9-84d5-4a40-8587-e9d27659ceb6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:56.514159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15e479e9-84d5-4a40-8587-e9d27659ceb6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:56.632559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-34d41d06-93b7-4a14-8ecf-fb4f9cc2245b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:56.642343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:56.675806 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-34d41d06-93b7-4a14-8ecf-fb4f9cc2245b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508" status: 200 len: 1309 microversion: 2.1 time: 1.195915 Sep 07 12:56:56.678016 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2493/5038] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:55 2022] GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508 => generated 1309 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:57.249113 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-15e479e9-84d5-4a40-8587-e9d27659ceb6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:57.292331 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-15e479e9-84d5-4a40-8587-e9d27659ceb6 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1666 microversion: 2.1 time: 0.856654 Sep 07 12:56:57.327928 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2546/5039] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:56 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1666 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:57.732539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-86ab75ed-2d06-4f8f-9937-d4a667926c65 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:57.742584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-86ab75ed-2d06-4f8f-9937-d4a667926c65 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d870ac2-825e-4d5b-825b-fcc194138508] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:57.758591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86ab75ed-2d06-4f8f-9937-d4a667926c65 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:57.759763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86ab75ed-2d06-4f8f-9937-d4a667926c65 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:57.761071 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86ab75ed-2d06-4f8f-9937-d4a667926c65 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:57.762918 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86ab75ed-2d06-4f8f-9937-d4a667926c65 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:57.764078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86ab75ed-2d06-4f8f-9937-d4a667926c65 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:57.765074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86ab75ed-2d06-4f8f-9937-d4a667926c65 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:58.180526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-86ab75ed-2d06-4f8f-9937-d4a667926c65 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:58.205186 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-86ab75ed-2d06-4f8f-9937-d4a667926c65 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508" status: 200 len: 1309 microversion: 2.1 time: 0.480716 Sep 07 12:56:58.218299 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2494/5040] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:57 2022] GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508 => generated 1309 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:58.347937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ad46166-f2a4-4e50-ba4e-85f8b5453f7c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:58.354363 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3ad46166-f2a4-4e50-ba4e-85f8b5453f7c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:58.374195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ad46166-f2a4-4e50-ba4e-85f8b5453f7c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:58.375519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ad46166-f2a4-4e50-ba4e-85f8b5453f7c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:58.376671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ad46166-f2a4-4e50-ba4e-85f8b5453f7c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:58.394726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ad46166-f2a4-4e50-ba4e-85f8b5453f7c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:58.396258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ad46166-f2a4-4e50-ba4e-85f8b5453f7c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:58.398713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ad46166-f2a4-4e50-ba4e-85f8b5453f7c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:58.420473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6b11e10f-bd55-4342-9d5d-2eaaf477c909 tempest-VolumesTestJSON-1083079829 tempest-VolumesTestJSON-1083079829-project] Calling method '.version_select at 0x7fc41385fd30>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:58.555418 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6b11e10f-bd55-4342-9d5d-2eaaf477c909 tempest-VolumesTestJSON-1083079829 tempest-VolumesTestJSON-1083079829-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/8ec8a1f7-ef2b-4232-9cc1-db44a4548a0c" status: 200 len: 351 microversion: 2.1 time: 0.149074 Sep 07 12:56:58.557154 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2495/5041] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Sep 7 12:56:58 2022] GET /compute/v2.1/os-volumes/8ec8a1f7-ef2b-4232-9cc1-db44a4548a0c => generated 351 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:56:58.582873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b1d5cb23-40ea-4c1b-b854-1989059b0d8f tempest-VolumesTestJSON-1083079829 tempest-VolumesTestJSON-1083079829-project] Calling method '.version_select at 0x7fc4138b0ee0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:58.844777 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b1d5cb23-40ea-4c1b-b854-1989059b0d8f tempest-VolumesTestJSON-1083079829 tempest-VolumesTestJSON-1083079829-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.268799 Sep 07 12:56:58.847521 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2496/5042] 10.222.0.16 () {58 vars in 1134 bytes} [Wed Sep 7 12:56:58 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:56:58.858041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3ad46166-f2a4-4e50-ba4e-85f8b5453f7c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:58.880167 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4919d37c-b436-46ea-bd7e-7e31f0bf6414 tempest-VolumesTestJSON-1083079829 tempest-VolumesTestJSON-1083079829-project] Calling method '.version_select at 0x7fc413a93940>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:58.894702 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ad46166-f2a4-4e50-ba4e-85f8b5453f7c tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1666 microversion: 2.1 time: 0.553634 Sep 07 12:56:58.907872 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2547/5043] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:58 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1666 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:58.972469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-88d4e42f-41c9-450c-9d2f-3cfceecc8845 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:56:58.976058 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-88d4e42f-41c9-450c-9d2f-3cfceecc8845 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:59.000102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88d4e42f-41c9-450c-9d2f-3cfceecc8845 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:59.008181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88d4e42f-41c9-450c-9d2f-3cfceecc8845 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:59.012378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88d4e42f-41c9-450c-9d2f-3cfceecc8845 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:59.016821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88d4e42f-41c9-450c-9d2f-3cfceecc8845 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:59.023905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88d4e42f-41c9-450c-9d2f-3cfceecc8845 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:59.025588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88d4e42f-41c9-450c-9d2f-3cfceecc8845 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:59.131697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-88d4e42f-41c9-450c-9d2f-3cfceecc8845 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lazy-loading 'flavor' on Instance uuid 35f328e5-ec00-4403-8196-cbefa047877b {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:56:59.284410 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4919d37c-b436-46ea-bd7e-7e31f0bf6414 tempest-VolumesTestJSON-1083079829 tempest-VolumesTestJSON-1083079829-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.411500 Sep 07 12:56:59.285992 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2497/5044] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Sep 7 12:56:58 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:56:59.303081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0c9c51f8-2f4f-4fbc-9269-af744571b995 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:59.305346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0c9c51f8-2f4f-4fbc-9269-af744571b995 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d870ac2-825e-4d5b-825b-fcc194138508] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:59.350517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c9c51f8-2f4f-4fbc-9269-af744571b995 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:59.355183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c9c51f8-2f4f-4fbc-9269-af744571b995 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:59.359164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c9c51f8-2f4f-4fbc-9269-af744571b995 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:59.363995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c9c51f8-2f4f-4fbc-9269-af744571b995 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:59.368845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c9c51f8-2f4f-4fbc-9269-af744571b995 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:59.369679 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c9c51f8-2f4f-4fbc-9269-af744571b995 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:59.683061 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-88d4e42f-41c9-450c-9d2f-3cfceecc8845 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "POST /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b/action" status: 202 len: 0 microversion: 2.20 time: 0.723939 Sep 07 12:56:59.685094 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2548/5045] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Sep 7 12:56:58 2022] POST /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b/action => generated 0 bytes in 730 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:56:59.702452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7f858379-cb48-4384-99c4-62eb4487ead7 tempest-VolumesTestJSON-1083079829 tempest-VolumesTestJSON-1083079829-project] Calling method '.version_select at 0x7fc418bf7ca0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:59.805819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0c9c51f8-2f4f-4fbc-9269-af744571b995 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:56:59.818705 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0c9c51f8-2f4f-4fbc-9269-af744571b995 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508" status: 200 len: 1490 microversion: 2.1 time: 0.531156 Sep 07 12:56:59.819682 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2498/5046] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:59 2022] GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508 => generated 1490 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:59.827859 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7f858379-cb48-4384-99c4-62eb4487ead7 tempest-VolumesTestJSON-1083079829 tempest-VolumesTestJSON-1083079829-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.140619 Sep 07 12:56:59.829000 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2549/5047] 10.222.0.16 () {58 vars in 1134 bytes} [Wed Sep 7 12:56:59 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:56:59.834021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-31722ad3-a8e3-4eef-9202-410b43d5b038 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:59.834905 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-31722ad3-a8e3-4eef-9202-410b43d5b038 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:56:59.842431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31722ad3-a8e3-4eef-9202-410b43d5b038 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:59.843315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31722ad3-a8e3-4eef-9202-410b43d5b038 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:59.843936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31722ad3-a8e3-4eef-9202-410b43d5b038 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:59.844881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31722ad3-a8e3-4eef-9202-410b43d5b038 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:56:59.846052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31722ad3-a8e3-4eef-9202-410b43d5b038 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:56:59.846654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31722ad3-a8e3-4eef-9202-410b43d5b038 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:56:59.853925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-38b02de7-a7d3-4cfa-9f7f-7e2e6a829555 tempest-VolumesTestJSON-1083079829 tempest-VolumesTestJSON-1083079829-project] Calling method '.version_select at 0x7fc418bcc160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:56:59.994351 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-38b02de7-a7d3-4cfa-9f7f-7e2e6a829555 tempest-VolumesTestJSON-1083079829 tempest-VolumesTestJSON-1083079829-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.144168 Sep 07 12:56:59.995620 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2550/5048] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Sep 7 12:56:59 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:57:00.002873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-86dd2db0-1a7d-4be6-8555-cb4cbfe22cb0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:00.004970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-86dd2db0-1a7d-4be6-8555-cb4cbfe22cb0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:00.019178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86dd2db0-1a7d-4be6-8555-cb4cbfe22cb0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:00.020100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86dd2db0-1a7d-4be6-8555-cb4cbfe22cb0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:00.020932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86dd2db0-1a7d-4be6-8555-cb4cbfe22cb0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:00.022305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86dd2db0-1a7d-4be6-8555-cb4cbfe22cb0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:00.023251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86dd2db0-1a7d-4be6-8555-cb4cbfe22cb0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:00.024052 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86dd2db0-1a7d-4be6-8555-cb4cbfe22cb0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:00.294794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-31722ad3-a8e3-4eef-9202-410b43d5b038 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:00.317277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-31722ad3-a8e3-4eef-9202-410b43d5b038 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:00.329366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-31722ad3-a8e3-4eef-9202-410b43d5b038 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:00.334923 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-31722ad3-a8e3-4eef-9202-410b43d5b038 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1721 microversion: 2.20 time: 0.509985 Sep 07 12:57:00.352702 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2499/5049] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:56:59 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1721 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:57:00.376996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fda2c002-c73d-4c6f-b673-2dacbb9ac8d9 tempest-VolumesTestJSON-1083079829 tempest-VolumesTestJSON-1083079829-project] Calling method '.version_select at 0x7fc4138cac10>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:00.610894 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-86dd2db0-1a7d-4be6-8555-cb4cbfe22cb0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:00.626840 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-86dd2db0-1a7d-4be6-8555-cb4cbfe22cb0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.628410 Sep 07 12:57:00.630557 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2551/5050] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:56:59 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:00.659763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-442547e4-0ff9-41f4-be16-c3aa62a6d03a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1781624175", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "1c45fce2-7bfe-4e93-8f9c-12b9830de28b"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:57:00.844987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-442547e4-0ff9-41f4-be16-c3aa62a6d03a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] validate_networks() for [('1c45fce2-7bfe-4e93-8f9c-12b9830de28b', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:57:00.906208 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fda2c002-c73d-4c6f-b673-2dacbb9ac8d9 tempest-VolumesTestJSON-1083079829 tempest-VolumesTestJSON-1083079829-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.547685 Sep 07 12:57:00.907336 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2500/5051] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Sep 7 12:57:00 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:57:00.928453 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a9616ec3-4c3c-4b7a-ac98-b77b6bd26a2e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:00.936265 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a9616ec3-4c3c-4b7a-ac98-b77b6bd26a2e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:00.946305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:00.982193 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9616ec3-4c3c-4b7a-ac98-b77b6bd26a2e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:00.987535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9616ec3-4c3c-4b7a-ac98-b77b6bd26a2e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:00.992583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9616ec3-4c3c-4b7a-ac98-b77b6bd26a2e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:00.995222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9616ec3-4c3c-4b7a-ac98-b77b6bd26a2e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:00.998721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9616ec3-4c3c-4b7a-ac98-b77b6bd26a2e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:00.999946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9616ec3-4c3c-4b7a-ac98-b77b6bd26a2e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:01.774796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a9616ec3-4c3c-4b7a-ac98-b77b6bd26a2e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:01.808697 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a9616ec3-4c3c-4b7a-ac98-b77b6bd26a2e tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1669 microversion: 2.1 time: 0.894341 Sep 07 12:57:01.808697 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2501/5052] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:00 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1669 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:01.813238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d0253de4-5aa1-40a9-ad8c-6d0dcfce2075 tempest-VolumesTestJSON-1083079829 tempest-VolumesTestJSON-1083079829-project] Calling method '.version_select at 0x7fc4138510d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:02.127948 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d0253de4-5aa1-40a9-ad8c-6d0dcfce2075 tempest-VolumesTestJSON-1083079829 tempest-VolumesTestJSON-1083079829-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.321011 Sep 07 12:57:02.130056 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2502/5053] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Sep 7 12:57:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:02.138975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4fbfbd0e-a215-40d9-ae23-208b680de3f6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:02.150257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4fbfbd0e-a215-40d9-ae23-208b680de3f6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:02.204377 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fbfbd0e-a215-40d9-ae23-208b680de3f6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:02.205297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fbfbd0e-a215-40d9-ae23-208b680de3f6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:02.206172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fbfbd0e-a215-40d9-ae23-208b680de3f6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:02.207724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fbfbd0e-a215-40d9-ae23-208b680de3f6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:02.211039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fbfbd0e-a215-40d9-ae23-208b680de3f6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:02.214086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fbfbd0e-a215-40d9-ae23-208b680de3f6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:02.905496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4fbfbd0e-a215-40d9-ae23-208b680de3f6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:02.946202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4fbfbd0e-a215-40d9-ae23-208b680de3f6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:02.954784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4fbfbd0e-a215-40d9-ae23-208b680de3f6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:02.957014 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4fbfbd0e-a215-40d9-ae23-208b680de3f6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1721 microversion: 2.20 time: 0.824887 Sep 07 12:57:02.982436 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2503/5054] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:57:02 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1721 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:57:03.012518 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7faae063-db2b-44f9-974f-e3690dc4b1db tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:03.013692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7faae063-db2b-44f9-974f-e3690dc4b1db tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:03.046733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7faae063-db2b-44f9-974f-e3690dc4b1db tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:03.058415 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7faae063-db2b-44f9-974f-e3690dc4b1db tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:03.059321 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7faae063-db2b-44f9-974f-e3690dc4b1db tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:03.064212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7faae063-db2b-44f9-974f-e3690dc4b1db tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:03.069206 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7faae063-db2b-44f9-974f-e3690dc4b1db tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:03.073608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7faae063-db2b-44f9-974f-e3690dc4b1db tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:03.176234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7faae063-db2b-44f9-974f-e3690dc4b1db tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:57:03.192938 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.compute.api [None req-7faae063-db2b-44f9-974f-e3690dc4b1db tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Working on deleting snapshot 66fd7ba3-2b47-4601-812d-6a58ef6ba747 from shelved instance... Sep 07 12:57:03.738553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-442547e4-0ff9-41f4-be16-c3aa62a6d03a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:57:03.739390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-442547e4-0ff9-41f4-be16-c3aa62a6d03a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:57:03.739555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-442547e4-0ff9-41f4-be16-c3aa62a6d03a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:57:03.739858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-442547e4-0ff9-41f4-be16-c3aa62a6d03a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:57:03.740285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-442547e4-0ff9-41f4-be16-c3aa62a6d03a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:57:03.744504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:03.765579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-442547e4-0ff9-41f4-be16-c3aa62a6d03a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:03.765579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-442547e4-0ff9-41f4-be16-c3aa62a6d03a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:03.766112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-442547e4-0ff9-41f4-be16-c3aa62a6d03a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:03.766800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-442547e4-0ff9-41f4-be16-c3aa62a6d03a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:03.767263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-442547e4-0ff9-41f4-be16-c3aa62a6d03a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:03.772446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-442547e4-0ff9-41f4-be16-c3aa62a6d03a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:03.855921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-442547e4-0ff9-41f4-be16-c3aa62a6d03a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Getting quotas for project 854c6a81bbfd4ab79126799ec40c954e. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:57:03.887112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-442547e4-0ff9-41f4-be16-c3aa62a6d03a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Getting quotas for user 6ac786dc6d7847f582262dcd912c3f06 and project 854c6a81bbfd4ab79126799ec40c954e. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:57:03.916528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-442547e4-0ff9-41f4-be16-c3aa62a6d03a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:57:03.922075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-442547e4-0ff9-41f4-be16-c3aa62a6d03a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d9cff1f-6cd8-4472-be56-757c5ce15956] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:57:04.040892 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-442547e4-0ff9-41f4-be16-c3aa62a6d03a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.393433 Sep 07 12:57:04.045850 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2552/5055] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:57:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:57:04.063973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b2fb8439-5b87-4cd4-8697-8cb8afd52b07 tempest-VolumesTestJSON-1083079829 tempest-VolumesTestJSON-1083079829-project] Calling method '.version_select at 0x7fc418a963a0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:04.541621 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b2fb8439-5b87-4cd4-8697-8cb8afd52b07 tempest-VolumesTestJSON-1083079829 tempest-VolumesTestJSON-1083079829-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.493279 Sep 07 12:57:04.542522 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2553/5056] 10.222.0.16 () {58 vars in 1188 bytes} [Wed Sep 7 12:57:04 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:57:04.547520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f6484d32-0fa6-42ef-b793-c81c44024064 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:04.548159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f6484d32-0fa6-42ef-b793-c81c44024064 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:04.592394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6484d32-0fa6-42ef-b793-c81c44024064 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:04.593845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6484d32-0fa6-42ef-b793-c81c44024064 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:04.600828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6484d32-0fa6-42ef-b793-c81c44024064 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:04.601774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6484d32-0fa6-42ef-b793-c81c44024064 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:04.602502 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6484d32-0fa6-42ef-b793-c81c44024064 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:04.603077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6484d32-0fa6-42ef-b793-c81c44024064 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:05.100227 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7faae063-db2b-44f9-974f-e3690dc4b1db tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Doing local delete in cell 9e0290a2-728a-49bc-bfb2-19275e06ed31(cell1) {{(pid=122432) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 07 12:57:05.102539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7faae063-db2b-44f9-974f-e3690dc4b1db tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:05.103040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7faae063-db2b-44f9-974f-e3690dc4b1db tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:05.125915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7faae063-db2b-44f9-974f-e3690dc4b1db tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:05.127210 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.compute.api [None req-7faae063-db2b-44f9-974f-e3690dc4b1db tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 07 12:57:05.137783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-7faae063-db2b-44f9-974f-e3690dc4b1db tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] deallocate_for_instance() {{(pid=122432) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 07 12:57:05.341543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f6484d32-0fa6-42ef-b793-c81c44024064 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:05.364711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f6484d32-0fa6-42ef-b793-c81c44024064 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:05.368866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f6484d32-0fa6-42ef-b793-c81c44024064 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:05.372402 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f6484d32-0fa6-42ef-b793-c81c44024064 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1721 microversion: 2.20 time: 0.829057 Sep 07 12:57:05.375514 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2554/5057] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:57:04 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1721 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:57:05.388966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-06b52c44-ddc7-45ec-8ab4-8a0e884d2bf4 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:05.392070 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-06b52c44-ddc7-45ec-8ab4-8a0e884d2bf4 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d9cff1f-6cd8-4472-be56-757c5ce15956] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:05.406603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06b52c44-ddc7-45ec-8ab4-8a0e884d2bf4 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:05.407403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06b52c44-ddc7-45ec-8ab4-8a0e884d2bf4 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:05.409271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06b52c44-ddc7-45ec-8ab4-8a0e884d2bf4 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:05.412569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06b52c44-ddc7-45ec-8ab4-8a0e884d2bf4 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:05.414173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06b52c44-ddc7-45ec-8ab4-8a0e884d2bf4 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:05.415369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06b52c44-ddc7-45ec-8ab4-8a0e884d2bf4 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:05.607208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-06b52c44-ddc7-45ec-8ab4-8a0e884d2bf4 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:05.628947 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-06b52c44-ddc7-45ec-8ab4-8a0e884d2bf4 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956" status: 200 len: 1205 microversion: 2.1 time: 0.251373 Sep 07 12:57:05.632168 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2555/5058] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:05 2022] GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956 => generated 1205 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:05.645587 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6018433a-fd55-47c9-a62b-75b120e1ad80 tempest-VolumesTestJSON-1083079829 tempest-VolumesTestJSON-1083079829-project] Calling method '.version_select at 0x7fc418c09d30>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:05.885475 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6018433a-fd55-47c9-a62b-75b120e1ad80 tempest-VolumesTestJSON-1083079829 tempest-VolumesTestJSON-1083079829-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.251031 Sep 07 12:57:05.897678 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2556/5059] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Sep 7 12:57:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:06.409428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-06f77c03-b3c0-49a1-8c5b-838329ce8493 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:06.410299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-06f77c03-b3c0-49a1-8c5b-838329ce8493 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:06.449864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06f77c03-b3c0-49a1-8c5b-838329ce8493 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:06.456516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06f77c03-b3c0-49a1-8c5b-838329ce8493 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:06.458611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06f77c03-b3c0-49a1-8c5b-838329ce8493 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:06.463702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06f77c03-b3c0-49a1-8c5b-838329ce8493 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:06.464653 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06f77c03-b3c0-49a1-8c5b-838329ce8493 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:06.465636 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06f77c03-b3c0-49a1-8c5b-838329ce8493 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:07.376303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-06f77c03-b3c0-49a1-8c5b-838329ce8493 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:07.392815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-06f77c03-b3c0-49a1-8c5b-838329ce8493 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:07.394775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-06f77c03-b3c0-49a1-8c5b-838329ce8493 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:07.398828 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-06f77c03-b3c0-49a1-8c5b-838329ce8493 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1721 microversion: 2.20 time: 1.001448 Sep 07 12:57:07.403075 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2557/5060] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:57:06 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1721 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:57:07.418550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8d93529c-a37b-44fb-9f25-512922600132 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:07.427788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8d93529c-a37b-44fb-9f25-512922600132 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d9cff1f-6cd8-4472-be56-757c5ce15956] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:07.458617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d93529c-a37b-44fb-9f25-512922600132 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:07.460269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d93529c-a37b-44fb-9f25-512922600132 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:07.461277 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d93529c-a37b-44fb-9f25-512922600132 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:07.464150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d93529c-a37b-44fb-9f25-512922600132 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:07.464649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d93529c-a37b-44fb-9f25-512922600132 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:07.466541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d93529c-a37b-44fb-9f25-512922600132 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:07.714650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-7faae063-db2b-44f9-974f-e3690dc4b1db tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Updating instance_info_cache with network_info: [] {{(pid=122432) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 07 12:57:07.837245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8d93529c-a37b-44fb-9f25-512922600132 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:07.858409 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8d93529c-a37b-44fb-9f25-512922600132 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956" status: 200 len: 1267 microversion: 2.1 time: 0.453253 Sep 07 12:57:07.861812 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2558/5061] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:07 2022] GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956 => generated 1267 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:07.867343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c23c6d77-9d92-46f0-ac01-76d16e26f482 req-838ef2ae-97c3-4d7a-81b6-c0c3bb2d0428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812b8c7f-9408-4862-a000-4b444babe995", "name": "network-vif-deleted", "tag": "f22238e2-dfbe-46a4-8e28-684befdd390b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:57:07.924661 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c23c6d77-9d92-46f0-ac01-76d16e26f482 req-838ef2ae-97c3-4d7a-81b6-c0c3bb2d0428 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:07.925185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c23c6d77-9d92-46f0-ac01-76d16e26f482 req-838ef2ae-97c3-4d7a-81b6-c0c3bb2d0428 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:07.925672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c23c6d77-9d92-46f0-ac01-76d16e26f482 req-838ef2ae-97c3-4d7a-81b6-c0c3bb2d0428 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:07.967098 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.compute.server_external_events [req-c23c6d77-9d92-46f0-ac01-76d16e26f482 req-838ef2ae-97c3-4d7a-81b6-c0c3bb2d0428 service nova] Unable to find a host for instance 812b8c7f-9408-4862-a000-4b444babe995. Dropping event network-vif-deleted {{(pid=122433) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 07 12:57:07.968154 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c23c6d77-9d92-46f0-ac01-76d16e26f482 req-838ef2ae-97c3-4d7a-81b6-c0c3bb2d0428 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.104977 Sep 07 12:57:07.978014 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2559/5062] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 114 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 07 12:57:08.459105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8254e602-08a2-4267-af65-b2f335d71e65 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:08.460242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8254e602-08a2-4267-af65-b2f335d71e65 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:08.487617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8254e602-08a2-4267-af65-b2f335d71e65 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:08.488136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8254e602-08a2-4267-af65-b2f335d71e65 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:08.488594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8254e602-08a2-4267-af65-b2f335d71e65 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:08.489343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8254e602-08a2-4267-af65-b2f335d71e65 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:08.495562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8254e602-08a2-4267-af65-b2f335d71e65 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:08.496081 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8254e602-08a2-4267-af65-b2f335d71e65 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:08.606970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:08.766503 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7faae063-db2b-44f9-974f-e3690dc4b1db tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "DELETE /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 204 len: 0 microversion: 2.1 time: 5.781178 Sep 07 12:57:08.767762 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2504/5063] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:57:02 2022] DELETE /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 0 bytes in 5784 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:57:08.776931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3da7a7d0-f8c1-4e0f-8b81-a30ebad21dc0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:08.790529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3da7a7d0-f8c1-4e0f-8b81-a30ebad21dc0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 812b8c7f-9408-4862-a000-4b444babe995] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:08.799418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3da7a7d0-f8c1-4e0f-8b81-a30ebad21dc0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:08.800184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3da7a7d0-f8c1-4e0f-8b81-a30ebad21dc0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:08.800786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3da7a7d0-f8c1-4e0f-8b81-a30ebad21dc0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:08.801763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3da7a7d0-f8c1-4e0f-8b81-a30ebad21dc0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:08.802403 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3da7a7d0-f8c1-4e0f-8b81-a30ebad21dc0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:08.802991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3da7a7d0-f8c1-4e0f-8b81-a30ebad21dc0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:08.842959 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-3da7a7d0-f8c1-4e0f-8b81-a30ebad21dc0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] HTTP exception thrown: Instance 812b8c7f-9408-4862-a000-4b444babe995 could not be found. Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3da7a7d0-f8c1-4e0f-8b81-a30ebad21dc0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Request method failure captured: Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 HTTP/1.1 Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJIYLgiUrD1FdG9a7jmdNUMsZflZ3IWVyV8jqJSyV7T-w7h1XqCWsHPlozQTxQ2SU2jPLptx_fK_PvA-9nGk2l4mDj334XTiP3wjCP9pCC7M8WLyWD7z_wyZ-hqyLowt8RL_r5UCBhe13xhmSDGs-ilkA2aO2hODHauJwGHwZVM1f9E Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: af1de494abea4aa7841c00fb199e8aec Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerActionsTestJSON-835038512 Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/af1de494abea4aa7841c00fb199e8aec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_af1de494abea4aa7841c00fb199e8aec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/af1de494abea4aa7841c00fb199e8aec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/af1de494abea4aa7841c00fb199e8aec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerActionsTestJSON-835038512 Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: af1de494abea4aa7841c00fb199e8aec Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerActionsTestJSON-835038512 Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerActionsTestJSON-835038512-project Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 22ec4509710f446d843f6882120c5d6e Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerActionsTestJSON-835038512-project Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 812b8c7f-9408-4862-a000-4b444babe995 could not be found. Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '812b8c7f-9408-4862-a000-4b444babe995'} Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 812b8c7f-9408-4862-a000-4b444babe995 could not be found. Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 812b8c7f-9408-4862-a000-4b444babe995 could not be found. Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:57:08.845032 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:57:08.848932 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:08.848932 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:57:08.848932 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:57:08.848932 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:57:08.848932 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:57:08.848932 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 812b8c7f-9408-4862-a000-4b444babe995 could not be found. Sep 07 12:57:08.848932 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:57:08.850592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3da7a7d0-f8c1-4e0f-8b81-a30ebad21dc0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Returning 404 to user: Instance 812b8c7f-9408-4862-a000-4b444babe995 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:57:08.852619 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3da7a7d0-f8c1-4e0f-8b81-a30ebad21dc0 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995" status: 404 len: 111 microversion: 2.1 time: 0.079124 Sep 07 12:57:08.853862 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2505/5064] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:08 2022] GET /compute/v2.1/servers/812b8c7f-9408-4862-a000-4b444babe995 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:57:08.867033 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8be86580-439d-4985-9620-c10ae435102d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:08.867818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8be86580-439d-4985-9620-c10ae435102d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: ed9ee1fe-336d-4562-b888-1cac8fb86dff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:08.883039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8be86580-439d-4985-9620-c10ae435102d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:08.892827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8be86580-439d-4985-9620-c10ae435102d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:08.893637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8be86580-439d-4985-9620-c10ae435102d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:08.894595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8be86580-439d-4985-9620-c10ae435102d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:08.914441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8be86580-439d-4985-9620-c10ae435102d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:08.915141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8be86580-439d-4985-9620-c10ae435102d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:08.967856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8be86580-439d-4985-9620-c10ae435102d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: ed9ee1fe-336d-4562-b888-1cac8fb86dff] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:57:09.231219 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8be86580-439d-4985-9620-c10ae435102d tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff" status: 204 len: 0 microversion: 2.1 time: 0.367650 Sep 07 12:57:09.237516 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2506/5065] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:57:08 2022] DELETE /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:57:09.252244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5c90b227-11c5-4f50-b868-3eaaee487f4a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:09.253641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5c90b227-11c5-4f50-b868-3eaaee487f4a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d9cff1f-6cd8-4472-be56-757c5ce15956] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:09.269340 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c90b227-11c5-4f50-b868-3eaaee487f4a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:09.270663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c90b227-11c5-4f50-b868-3eaaee487f4a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:09.272656 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c90b227-11c5-4f50-b868-3eaaee487f4a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:09.275709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c90b227-11c5-4f50-b868-3eaaee487f4a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:09.277201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c90b227-11c5-4f50-b868-3eaaee487f4a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:09.277970 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c90b227-11c5-4f50-b868-3eaaee487f4a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:10.263786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5c90b227-11c5-4f50-b868-3eaaee487f4a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:10.275147 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5c90b227-11c5-4f50-b868-3eaaee487f4a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956" status: 200 len: 1309 microversion: 2.1 time: 1.033741 Sep 07 12:57:10.278268 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2507/5066] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:09 2022] GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956 => generated 1309 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:10.290371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-39bd30e6-8e58-4035-b896-4785e4858dc5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:10.292793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-39bd30e6-8e58-4035-b896-4785e4858dc5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: ed9ee1fe-336d-4562-b888-1cac8fb86dff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:10.308435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39bd30e6-8e58-4035-b896-4785e4858dc5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:10.309027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39bd30e6-8e58-4035-b896-4785e4858dc5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:10.312990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39bd30e6-8e58-4035-b896-4785e4858dc5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:10.313799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39bd30e6-8e58-4035-b896-4785e4858dc5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:10.314294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39bd30e6-8e58-4035-b896-4785e4858dc5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:10.314731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39bd30e6-8e58-4035-b896-4785e4858dc5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:10.334404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:10.370489 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8254e602-08a2-4267-af65-b2f335d71e65 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:10.415633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8254e602-08a2-4267-af65-b2f335d71e65 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:10.424102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8254e602-08a2-4267-af65-b2f335d71e65 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:10.430392 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8254e602-08a2-4267-af65-b2f335d71e65 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1721 microversion: 2.20 time: 1.973890 Sep 07 12:57:10.436648 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2560/5067] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:57:08 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1721 bytes in 1982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:57:11.062947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-39bd30e6-8e58-4035-b896-4785e4858dc5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:11.085320 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-39bd30e6-8e58-4035-b896-4785e4858dc5 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff" status: 200 len: 1466 microversion: 2.1 time: 0.803559 Sep 07 12:57:11.098776 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2508/5068] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:10 2022] GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff => generated 1466 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:11.307476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-71ed4bed-d503-4abd-9ffb-00922af5008d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:11.309134 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-71ed4bed-d503-4abd-9ffb-00922af5008d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d9cff1f-6cd8-4472-be56-757c5ce15956] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:11.325214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71ed4bed-d503-4abd-9ffb-00922af5008d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:11.326717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71ed4bed-d503-4abd-9ffb-00922af5008d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:11.327986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71ed4bed-d503-4abd-9ffb-00922af5008d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:11.329714 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71ed4bed-d503-4abd-9ffb-00922af5008d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:11.331174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71ed4bed-d503-4abd-9ffb-00922af5008d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:11.332360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71ed4bed-d503-4abd-9ffb-00922af5008d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:11.465832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2d0d5f71-cd9b-4d68-97be-1b13381ccf59 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:11.466712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2d0d5f71-cd9b-4d68-97be-1b13381ccf59 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:11.479992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d0d5f71-cd9b-4d68-97be-1b13381ccf59 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:11.480497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d0d5f71-cd9b-4d68-97be-1b13381ccf59 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:11.480942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d0d5f71-cd9b-4d68-97be-1b13381ccf59 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:11.490705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d0d5f71-cd9b-4d68-97be-1b13381ccf59 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:11.491334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d0d5f71-cd9b-4d68-97be-1b13381ccf59 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:11.491790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2d0d5f71-cd9b-4d68-97be-1b13381ccf59 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:11.711780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-71ed4bed-d503-4abd-9ffb-00922af5008d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:11.729761 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-71ed4bed-d503-4abd-9ffb-00922af5008d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956" status: 200 len: 1309 microversion: 2.1 time: 0.429940 Sep 07 12:57:11.744111 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2561/5069] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:11 2022] GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956 => generated 1309 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:12.126643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5ec50ccf-089a-4af2-a63b-ea9212abf0c4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:12.126643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5ec50ccf-089a-4af2-a63b-ea9212abf0c4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: ed9ee1fe-336d-4562-b888-1cac8fb86dff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:12.139391 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ec50ccf-089a-4af2-a63b-ea9212abf0c4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:12.140285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ec50ccf-089a-4af2-a63b-ea9212abf0c4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:12.146166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ec50ccf-089a-4af2-a63b-ea9212abf0c4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:12.150391 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ec50ccf-089a-4af2-a63b-ea9212abf0c4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:12.151218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ec50ccf-089a-4af2-a63b-ea9212abf0c4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:12.155888 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ec50ccf-089a-4af2-a63b-ea9212abf0c4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:12.204812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2d0d5f71-cd9b-4d68-97be-1b13381ccf59 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:12.220282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2d0d5f71-cd9b-4d68-97be-1b13381ccf59 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:12.233625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2d0d5f71-cd9b-4d68-97be-1b13381ccf59 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:12.237107 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2d0d5f71-cd9b-4d68-97be-1b13381ccf59 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1721 microversion: 2.20 time: 0.775994 Sep 07 12:57:12.240226 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2509/5070] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:57:11 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1721 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:57:12.688720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5ec50ccf-089a-4af2-a63b-ea9212abf0c4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:12.727601 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5ec50ccf-089a-4af2-a63b-ea9212abf0c4 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff" status: 200 len: 1466 microversion: 2.1 time: 0.612262 Sep 07 12:57:12.730553 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2562/5071] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:12 2022] GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff => generated 1466 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:12.763700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-22afc9b2-cdf5-46a8-9517-521e04a03206 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:12.764539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-22afc9b2-cdf5-46a8-9517-521e04a03206 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d9cff1f-6cd8-4472-be56-757c5ce15956] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:12.778673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22afc9b2-cdf5-46a8-9517-521e04a03206 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:12.779517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22afc9b2-cdf5-46a8-9517-521e04a03206 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:12.780383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22afc9b2-cdf5-46a8-9517-521e04a03206 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:12.781368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22afc9b2-cdf5-46a8-9517-521e04a03206 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:12.782104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22afc9b2-cdf5-46a8-9517-521e04a03206 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:12.782702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22afc9b2-cdf5-46a8-9517-521e04a03206 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:13.274357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1acbab4e-ee48-45bf-a561-e55c61513bae tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:13.279746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1acbab4e-ee48-45bf-a561-e55c61513bae tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:13.317345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1acbab4e-ee48-45bf-a561-e55c61513bae tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:13.318403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1acbab4e-ee48-45bf-a561-e55c61513bae tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:13.320141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1acbab4e-ee48-45bf-a561-e55c61513bae tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:13.323364 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1acbab4e-ee48-45bf-a561-e55c61513bae tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:13.329227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1acbab4e-ee48-45bf-a561-e55c61513bae tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:13.331043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1acbab4e-ee48-45bf-a561-e55c61513bae tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:13.526821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-22afc9b2-cdf5-46a8-9517-521e04a03206 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:13.547685 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-22afc9b2-cdf5-46a8-9517-521e04a03206 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956" status: 200 len: 1309 microversion: 2.1 time: 0.787578 Sep 07 12:57:13.565100 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2510/5072] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:12 2022] GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956 => generated 1309 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:57:13.764045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-091e3d2a-0ab1-49f8-a73d-3d37e2f7cc75 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:13.766663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-091e3d2a-0ab1-49f8-a73d-3d37e2f7cc75 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: ed9ee1fe-336d-4562-b888-1cac8fb86dff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:13.778793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-091e3d2a-0ab1-49f8-a73d-3d37e2f7cc75 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:13.780274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-091e3d2a-0ab1-49f8-a73d-3d37e2f7cc75 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:13.781670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-091e3d2a-0ab1-49f8-a73d-3d37e2f7cc75 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:13.782867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-091e3d2a-0ab1-49f8-a73d-3d37e2f7cc75 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:13.784159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-091e3d2a-0ab1-49f8-a73d-3d37e2f7cc75 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:13.798074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:13.807162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-091e3d2a-0ab1-49f8-a73d-3d37e2f7cc75 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:13.899645 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:14.161420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-091e3d2a-0ab1-49f8-a73d-3d37e2f7cc75 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:14.172458 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-091e3d2a-0ab1-49f8-a73d-3d37e2f7cc75 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff" status: 200 len: 1466 microversion: 2.1 time: 0.417356 Sep 07 12:57:14.183439 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2511/5073] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:13 2022] GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff => generated 1466 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:57:14.223775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-5a5b1b68-0aa1-4a01-8d93-a6bed61d5bfb req-25998bff-0f25-45a7-9c4c-6378142cef56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d9cff1f-6cd8-4472-be56-757c5ce15956", "tag": "760c1473-9e94-40f1-8783-916905448982"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:57:14.271776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5a5b1b68-0aa1-4a01-8d93-a6bed61d5bfb req-25998bff-0f25-45a7-9c4c-6378142cef56 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:14.272679 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5a5b1b68-0aa1-4a01-8d93-a6bed61d5bfb req-25998bff-0f25-45a7-9c4c-6378142cef56 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:14.273288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5a5b1b68-0aa1-4a01-8d93-a6bed61d5bfb req-25998bff-0f25-45a7-9c4c-6378142cef56 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:14.309351 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-5a5b1b68-0aa1-4a01-8d93-a6bed61d5bfb req-25998bff-0f25-45a7-9c4c-6378142cef56 service nova] Creating event network-changed:760c1473-9e94-40f1-8783-916905448982 for instance 7d9cff1f-6cd8-4472-be56-757c5ce15956 on n-h1-852087-9 Sep 07 12:57:14.328488 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-5a5b1b68-0aa1-4a01-8d93-a6bed61d5bfb req-25998bff-0f25-45a7-9c4c-6378142cef56 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151641 Sep 07 12:57:14.333042 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2512/5074] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:57:14.451495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1acbab4e-ee48-45bf-a561-e55c61513bae tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:14.503925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1acbab4e-ee48-45bf-a561-e55c61513bae tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:14.508559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1acbab4e-ee48-45bf-a561-e55c61513bae tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:14.515841 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1acbab4e-ee48-45bf-a561-e55c61513bae tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1721 microversion: 2.20 time: 1.250505 Sep 07 12:57:14.517114 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2563/5075] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:57:13 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1721 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:57:14.578101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a84e0ffb-3d78-40ef-9bc0-cb05d04cad50 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:14.579029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a84e0ffb-3d78-40ef-9bc0-cb05d04cad50 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d9cff1f-6cd8-4472-be56-757c5ce15956] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:14.599041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a84e0ffb-3d78-40ef-9bc0-cb05d04cad50 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:14.601721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a84e0ffb-3d78-40ef-9bc0-cb05d04cad50 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:14.605932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a84e0ffb-3d78-40ef-9bc0-cb05d04cad50 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:14.608595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a84e0ffb-3d78-40ef-9bc0-cb05d04cad50 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:14.611766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a84e0ffb-3d78-40ef-9bc0-cb05d04cad50 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:14.613007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a84e0ffb-3d78-40ef-9bc0-cb05d04cad50 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:15.135734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3bacd63b-021c-4d0d-88ee-ebd297742bd6 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:57:15.154965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bacd63b-021c-4d0d-88ee-ebd297742bd6 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:15.160030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bacd63b-021c-4d0d-88ee-ebd297742bd6 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:15.160613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3bacd63b-021c-4d0d-88ee-ebd297742bd6 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:15.223685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a84e0ffb-3d78-40ef-9bc0-cb05d04cad50 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:15.239697 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a84e0ffb-3d78-40ef-9bc0-cb05d04cad50 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956" status: 200 len: 1309 microversion: 2.1 time: 0.669719 Sep 07 12:57:15.271250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3bacd63b-021c-4d0d-88ee-ebd297742bd6 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Going to try to stop instance {{(pid=122433) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 12:57:15.296860 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2513/5076] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:14 2022] GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956 => generated 1309 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:15.314720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-58ef78f3-afa2-4736-95c6-56dcf0803905 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:15.315891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-58ef78f3-afa2-4736-95c6-56dcf0803905 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: ed9ee1fe-336d-4562-b888-1cac8fb86dff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:15.336861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58ef78f3-afa2-4736-95c6-56dcf0803905 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:15.338878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58ef78f3-afa2-4736-95c6-56dcf0803905 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:15.341551 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58ef78f3-afa2-4736-95c6-56dcf0803905 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:15.343078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58ef78f3-afa2-4736-95c6-56dcf0803905 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:15.345888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58ef78f3-afa2-4736-95c6-56dcf0803905 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:15.346727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58ef78f3-afa2-4736-95c6-56dcf0803905 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:15.435270 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3bacd63b-021c-4d0d-88ee-ebd297742bd6 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "POST /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef/action" status: 202 len: 0 microversion: 2.1 time: 0.303681 Sep 07 12:57:15.436275 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2564/5077] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:57:15 2022] POST /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 12:57:15.454683 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-40d49f30-fab4-4f09-bc38-e0d17ef8a3f2 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:15.457266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-40d49f30-fab4-4f09-bc38-e0d17ef8a3f2 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:15.493680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40d49f30-fab4-4f09-bc38-e0d17ef8a3f2 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:15.494722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40d49f30-fab4-4f09-bc38-e0d17ef8a3f2 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:15.500044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40d49f30-fab4-4f09-bc38-e0d17ef8a3f2 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:15.500842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40d49f30-fab4-4f09-bc38-e0d17ef8a3f2 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:15.504920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40d49f30-fab4-4f09-bc38-e0d17ef8a3f2 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:15.507832 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40d49f30-fab4-4f09-bc38-e0d17ef8a3f2 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:15.959847 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-40d49f30-fab4-4f09-bc38-e0d17ef8a3f2 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:15.970650 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-40d49f30-fab4-4f09-bc38-e0d17ef8a3f2 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1724 microversion: 2.1 time: 0.528702 Sep 07 12:57:15.993233 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2565/5078] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:15 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1724 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:15.999405 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-51f15760-7cfd-4463-88f7-c56eebe970c0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:16.010445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-51f15760-7cfd-4463-88f7-c56eebe970c0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:16.017832 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51f15760-7cfd-4463-88f7-c56eebe970c0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:16.018526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51f15760-7cfd-4463-88f7-c56eebe970c0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:16.022330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51f15760-7cfd-4463-88f7-c56eebe970c0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:16.023264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51f15760-7cfd-4463-88f7-c56eebe970c0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:16.023916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51f15760-7cfd-4463-88f7-c56eebe970c0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:16.024457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51f15760-7cfd-4463-88f7-c56eebe970c0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:16.066188 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58ef78f3-afa2-4736-95c6-56dcf0803905 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:16.066899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58ef78f3-afa2-4736-95c6-56dcf0803905 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:16.072884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-58ef78f3-afa2-4736-95c6-56dcf0803905 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:16.074731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-58ef78f3-afa2-4736-95c6-56dcf0803905 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lazy-loading 'fault' on Instance uuid ed9ee1fe-336d-4562-b888-1cac8fb86dff {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:57:16.636003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-58ef78f3-afa2-4736-95c6-56dcf0803905 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:16.655443 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-58ef78f3-afa2-4736-95c6-56dcf0803905 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff" status: 200 len: 1305 microversion: 2.1 time: 1.354265 Sep 07 12:57:16.657765 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2514/5079] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:15 2022] GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff => generated 1305 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:16.719760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-51f15760-7cfd-4463-88f7-c56eebe970c0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:16.733060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-51f15760-7cfd-4463-88f7-c56eebe970c0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:16.735335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-51f15760-7cfd-4463-88f7-c56eebe970c0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:16.738244 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-51f15760-7cfd-4463-88f7-c56eebe970c0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1721 microversion: 2.20 time: 0.743727 Sep 07 12:57:16.739065 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2566/5080] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:57:15 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1721 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:57:16.754530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-530d6a50-8de4-4b05-a001-782fab0f138f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:16.762463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-530d6a50-8de4-4b05-a001-782fab0f138f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d9cff1f-6cd8-4472-be56-757c5ce15956] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:16.774046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-530d6a50-8de4-4b05-a001-782fab0f138f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:16.774832 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-530d6a50-8de4-4b05-a001-782fab0f138f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:16.775447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-530d6a50-8de4-4b05-a001-782fab0f138f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:16.776360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-530d6a50-8de4-4b05-a001-782fab0f138f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:16.777005 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-530d6a50-8de4-4b05-a001-782fab0f138f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:16.782263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-530d6a50-8de4-4b05-a001-782fab0f138f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:17.001074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b30deced-6d33-421b-a74f-9202a5773324 tempest-MultipleCreateNegativeTestJSON-790417113 tempest-MultipleCreateNegativeTestJSON-790417113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-318180225", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:57:17.026733 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-b30deced-6d33-421b-a74f-9202a5773324 tempest-MultipleCreateNegativeTestJSON-790417113 tempest-MultipleCreateNegativeTestJSON-790417113-project] HTTP exception thrown: min_count must be <= max_count Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b30deced-6d33-421b-a74f-9202a5773324 tempest-MultipleCreateNegativeTestJSON-790417113 tempest-MultipleCreateNegativeTestJSON-790417113-project] Request method failure captured: Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 183 Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJUruUH6yvPGOOFoHmAzdprElUFThk0y1R68ypPXw845Ny2AY5MLZIgbBaqxQ_9fTaTcYbugl2x9mt6PgGUw_urC5GMfkHyOas-_QnP7-cHrsWHlkeuaGtg1Ok6EStMzipN2RE5chejukWDklfcN3qnGQAsprhI1sSRx1ocjL-PSxzg Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 5f004818321f46b1ac2b677395fe565b Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-790417113 Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5f004818321f46b1ac2b677395fe565b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5f004818321f46b1ac2b677395fe565b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5f004818321f46b1ac2b677395fe565b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5f004818321f46b1ac2b677395fe565b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-790417113 Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 5f004818321f46b1ac2b677395fe565b Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-790417113 Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-MultipleCreateNegativeTestJSON-790417113-project Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: d962f30a3c1c4728821e24ce799a70ad Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-790417113-project Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-318180225", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "min_count": 3, "max_count": 2}} Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: exception: min_count must be <= max_count Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-318180225', 'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Sep 07 12:57:17.030506 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.040794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b30deced-6d33-421b-a74f-9202a5773324 tempest-MultipleCreateNegativeTestJSON-790417113 tempest-MultipleCreateNegativeTestJSON-790417113-project] Returning 400 to user: min_count must be <= max_count {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:57:17.042962 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b30deced-6d33-421b-a74f-9202a5773324 tempest-MultipleCreateNegativeTestJSON-790417113 tempest-MultipleCreateNegativeTestJSON-790417113-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.381687 Sep 07 12:57:17.048336 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2515/5081] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:57:16 2022] POST /compute/v2.1/servers => generated 74 bytes in 389 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 07 12:57:17.080607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-829acae6-d595-4e19-a0b0-06901e9b897d req-20bcfb99-d4eb-4210-b8bc-4ad6eb56efad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed9ee1fe-336d-4562-b888-1cac8fb86dff", "name": "network-vif-deleted", "tag": "3594a5d6-0f87-4626-8620-00caba30dae7"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:57:17.128198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-829acae6-d595-4e19-a0b0-06901e9b897d req-20bcfb99-d4eb-4210-b8bc-4ad6eb56efad service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:17.129680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-829acae6-d595-4e19-a0b0-06901e9b897d req-20bcfb99-d4eb-4210-b8bc-4ad6eb56efad service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:17.130772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-829acae6-d595-4e19-a0b0-06901e9b897d req-20bcfb99-d4eb-4210-b8bc-4ad6eb56efad service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:17.185032 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-829acae6-d595-4e19-a0b0-06901e9b897d req-20bcfb99-d4eb-4210-b8bc-4ad6eb56efad service nova] Creating event network-vif-deleted:3594a5d6-0f87-4626-8620-00caba30dae7 for instance ed9ee1fe-336d-4562-b888-1cac8fb86dff on n-h1-852087-9 Sep 07 12:57:17.204980 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-829acae6-d595-4e19-a0b0-06901e9b897d req-20bcfb99-d4eb-4210-b8bc-4ad6eb56efad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152120 Sep 07 12:57:17.207449 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2516/5082] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:57:17.228580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-97c8b39c-31e8-4b53-957f-65df79d58574 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:17.229928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-97c8b39c-31e8-4b53-957f-65df79d58574 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:17.247141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-530d6a50-8de4-4b05-a001-782fab0f138f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:17.258331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97c8b39c-31e8-4b53-957f-65df79d58574 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:17.258988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97c8b39c-31e8-4b53-957f-65df79d58574 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:17.259774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97c8b39c-31e8-4b53-957f-65df79d58574 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:17.261039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97c8b39c-31e8-4b53-957f-65df79d58574 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:17.261365 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-530d6a50-8de4-4b05-a001-782fab0f138f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956" status: 200 len: 1309 microversion: 2.1 time: 0.513741 Sep 07 12:57:17.262060 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2567/5083] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:16 2022] GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956 => generated 1309 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:17.262533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97c8b39c-31e8-4b53-957f-65df79d58574 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:17.264529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97c8b39c-31e8-4b53-957f-65df79d58574 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:17.310326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3cc734d6-02d4-49bb-808c-5f6f61f218f4 tempest-MultipleCreateNegativeTestJSON-790417113 tempest-MultipleCreateNegativeTestJSON-790417113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-92893595", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "max_count": 0}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3cc734d6-02d4-49bb-808c-5f6f61f218f4 tempest-MultipleCreateNegativeTestJSON-790417113 tempest-MultipleCreateNegativeTestJSON-790417113-project] Request method failure captured: Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 166 Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJUruUH6yvPGOOFoHmAzdprElUFThk0y1R68ypPXw845Ny2AY5MLZIgbBaqxQ_9fTaTcYbugl2x9mt6PgGUw_urC5GMfkHyOas-_QnP7-cHrsWHlkeuaGtg1Ok6EStMzipN2RE5chejukWDklfcN3qnGQAsprhI1sSRx1ocjL-PSxzg Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 5f004818321f46b1ac2b677395fe565b Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-790417113 Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5f004818321f46b1ac2b677395fe565b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5f004818321f46b1ac2b677395fe565b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5f004818321f46b1ac2b677395fe565b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5f004818321f46b1ac2b677395fe565b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-790417113 Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 5f004818321f46b1ac2b677395fe565b Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-790417113 Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-MultipleCreateNegativeTestJSON-790417113-project Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: d962f30a3c1c4728821e24ce799a70ad Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-790417113-project Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-92893595", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "max_count": 0}} Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-92893595', 'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f', 'flavorRef': '452', 'max_count': 0}}} Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 0 Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:57:17.316188 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:57:17.322173 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:57:17.322173 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:57:17.322173 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:57:17.322173 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:57:17.322173 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 07 12:57:17.322173 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.322173 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:57:17.322173 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.322173 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:17.322173 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:57:17.322173 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:57:17.322173 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:57:17.322173 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:57:17.322173 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 07 12:57:17.322173 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.322173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3cc734d6-02d4-49bb-808c-5f6f61f218f4 tempest-MultipleCreateNegativeTestJSON-790417113 tempest-MultipleCreateNegativeTestJSON-790417113-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:57:17.325584 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3cc734d6-02d4-49bb-808c-5f6f61f218f4 tempest-MultipleCreateNegativeTestJSON-790417113 tempest-MultipleCreateNegativeTestJSON-790417113-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.019118 Sep 07 12:57:17.332952 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2568/5084] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:57:17 2022] POST /compute/v2.1/servers => generated 130 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 07 12:57:17.538241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9032698b-6e6f-49ed-98d9-0cbe8a6603cf tempest-MultipleCreateNegativeTestJSON-790417113 tempest-MultipleCreateNegativeTestJSON-790417113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-192765150", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "max_count": 2.5}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9032698b-6e6f-49ed-98d9-0cbe8a6603cf tempest-MultipleCreateNegativeTestJSON-790417113 tempest-MultipleCreateNegativeTestJSON-790417113-project] Request method failure captured: Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 169 Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJUruUH6yvPGOOFoHmAzdprElUFThk0y1R68ypPXw845Ny2AY5MLZIgbBaqxQ_9fTaTcYbugl2x9mt6PgGUw_urC5GMfkHyOas-_QnP7-cHrsWHlkeuaGtg1Ok6EStMzipN2RE5chejukWDklfcN3qnGQAsprhI1sSRx1ocjL-PSxzg Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 5f004818321f46b1ac2b677395fe565b Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-790417113 Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5f004818321f46b1ac2b677395fe565b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5f004818321f46b1ac2b677395fe565b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5f004818321f46b1ac2b677395fe565b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5f004818321f46b1ac2b677395fe565b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-790417113 Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 5f004818321f46b1ac2b677395fe565b Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-790417113 Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-MultipleCreateNegativeTestJSON-790417113-project Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: d962f30a3c1c4728821e24ce799a70ad Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-790417113-project Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-192765150", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "max_count": 2.5}} Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-192765150', 'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f', 'flavorRef': '452', 'max_count': 2.5}}} Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 2.5 Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:57:17.543019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:57:17.547271 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:57:17.547271 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:57:17.547271 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:57:17.547271 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:57:17.547271 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 07 12:57:17.547271 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.547271 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:57:17.547271 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.547271 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:17.547271 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:57:17.547271 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:57:17.547271 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:57:17.547271 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:57:17.547271 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 07 12:57:17.547271 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.553262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9032698b-6e6f-49ed-98d9-0cbe8a6603cf tempest-MultipleCreateNegativeTestJSON-790417113 tempest-MultipleCreateNegativeTestJSON-790417113-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:57:17.554498 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9032698b-6e6f-49ed-98d9-0cbe8a6603cf tempest-MultipleCreateNegativeTestJSON-790417113 tempest-MultipleCreateNegativeTestJSON-790417113-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.021820 Sep 07 12:57:17.560066 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2569/5085] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:57:17 2022] POST /compute/v2.1/servers => generated 139 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 07 12:57:17.647221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-97c8b39c-31e8-4b53-957f-65df79d58574 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:17.656810 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b59a8ada-5efb-40b4-8372-8be9156a432c tempest-MultipleCreateNegativeTestJSON-790417113 tempest-MultipleCreateNegativeTestJSON-790417113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-569312373", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "min_count": 0}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b59a8ada-5efb-40b4-8372-8be9156a432c tempest-MultipleCreateNegativeTestJSON-790417113 tempest-MultipleCreateNegativeTestJSON-790417113-project] Request method failure captured: Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 167 Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJUruUH6yvPGOOFoHmAzdprElUFThk0y1R68ypPXw845Ny2AY5MLZIgbBaqxQ_9fTaTcYbugl2x9mt6PgGUw_urC5GMfkHyOas-_QnP7-cHrsWHlkeuaGtg1Ok6EStMzipN2RE5chejukWDklfcN3qnGQAsprhI1sSRx1ocjL-PSxzg Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 5f004818321f46b1ac2b677395fe565b Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-790417113 Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5f004818321f46b1ac2b677395fe565b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5f004818321f46b1ac2b677395fe565b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5f004818321f46b1ac2b677395fe565b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5f004818321f46b1ac2b677395fe565b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-790417113 Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 5f004818321f46b1ac2b677395fe565b Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-790417113 Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-MultipleCreateNegativeTestJSON-790417113-project Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: d962f30a3c1c4728821e24ce799a70ad Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-790417113-project Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-569312373", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "min_count": 0}} Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-569312373', 'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f', 'flavorRef': '452', 'min_count': 0}}} Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 0 Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:57:17.662220 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:57:17.672316 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:57:17.672316 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:57:17.672316 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:57:17.672316 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:57:17.672316 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 07 12:57:17.672316 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.672316 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:57:17.672316 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.672316 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:17.672316 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:57:17.672316 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:57:17.672316 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:57:17.672316 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:57:17.672316 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 07 12:57:17.672316 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.672316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b59a8ada-5efb-40b4-8372-8be9156a432c tempest-MultipleCreateNegativeTestJSON-790417113 tempest-MultipleCreateNegativeTestJSON-790417113-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:57:17.672316 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b59a8ada-5efb-40b4-8372-8be9156a432c tempest-MultipleCreateNegativeTestJSON-790417113 tempest-MultipleCreateNegativeTestJSON-790417113-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.015907 Sep 07 12:57:17.672316 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2570/5086] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:57:17 2022] POST /compute/v2.1/servers => generated 130 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:57:17.679805 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-97c8b39c-31e8-4b53-957f-65df79d58574 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1724 microversion: 2.1 time: 0.457562 Sep 07 12:57:17.679805 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2517/5087] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:17 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1724 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:17.704494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-23e59306-b8b8-43de-94fd-2c02e385c6ac tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:17.705842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-23e59306-b8b8-43de-94fd-2c02e385c6ac tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: ed9ee1fe-336d-4562-b888-1cac8fb86dff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:17.715799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23e59306-b8b8-43de-94fd-2c02e385c6ac tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:17.716291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23e59306-b8b8-43de-94fd-2c02e385c6ac tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:17.717160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23e59306-b8b8-43de-94fd-2c02e385c6ac tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:17.719446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23e59306-b8b8-43de-94fd-2c02e385c6ac tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:17.720274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23e59306-b8b8-43de-94fd-2c02e385c6ac tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:17.721723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23e59306-b8b8-43de-94fd-2c02e385c6ac tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:17.753424 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-23e59306-b8b8-43de-94fd-2c02e385c6ac tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] HTTP exception thrown: Instance ed9ee1fe-336d-4562-b888-1cac8fb86dff could not be found. Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-23e59306-b8b8-43de-94fd-2c02e385c6ac tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Request method failure captured: Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff HTTP/1.1 Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJIYLgiUrD1FdG9a7jmdNUMsZflZ3IWVyV8jqJSyV7T-w7h1XqCWsHPlozQTxQ2SU2jPLptx_fK_PvA-9nGk2l4mDj334XTiP3wjCP9pCC7M8WLyWD7z_wyZ-hqyLowt8RL_r5UCBhe13xhmSDGs-ilkA2aO2hODHauJwGHwZVM1f9E Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: af1de494abea4aa7841c00fb199e8aec Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerActionsTestJSON-835038512 Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/af1de494abea4aa7841c00fb199e8aec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_af1de494abea4aa7841c00fb199e8aec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/af1de494abea4aa7841c00fb199e8aec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/af1de494abea4aa7841c00fb199e8aec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerActionsTestJSON-835038512 Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: af1de494abea4aa7841c00fb199e8aec Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerActionsTestJSON-835038512 Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerActionsTestJSON-835038512-project Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 22ec4509710f446d843f6882120c5d6e Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerActionsTestJSON-835038512-project Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance ed9ee1fe-336d-4562-b888-1cac8fb86dff could not be found. Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'ed9ee1fe-336d-4562-b888-1cac8fb86dff'} Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed9ee1fe-336d-4562-b888-1cac8fb86dff could not be found. Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed9ee1fe-336d-4562-b888-1cac8fb86dff could not be found. Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:57:17.756701 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.769588 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:17.769588 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:57:17.769588 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:57:17.769588 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:57:17.769588 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:57:17.769588 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed9ee1fe-336d-4562-b888-1cac8fb86dff could not be found. Sep 07 12:57:17.769588 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:17.769588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-23e59306-b8b8-43de-94fd-2c02e385c6ac tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Returning 404 to user: Instance ed9ee1fe-336d-4562-b888-1cac8fb86dff could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:57:17.769588 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-23e59306-b8b8-43de-94fd-2c02e385c6ac tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff" status: 404 len: 111 microversion: 2.1 time: 0.071343 Sep 07 12:57:17.769588 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2571/5088] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:17 2022] GET /compute/v2.1/servers/ed9ee1fe-336d-4562-b888-1cac8fb86dff => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:57:17.776996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-24d539e1-78d1-4f44-8c18-a9d2de0a852e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:17.778173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-24d539e1-78d1-4f44-8c18-a9d2de0a852e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:17.778412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-144fa4c8-8822-49be-842a-0849d315dd9b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:17.779010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-144fa4c8-8822-49be-842a-0849d315dd9b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:17.789754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-144fa4c8-8822-49be-842a-0849d315dd9b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:17.790562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-144fa4c8-8822-49be-842a-0849d315dd9b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:17.791701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-144fa4c8-8822-49be-842a-0849d315dd9b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:17.792611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-144fa4c8-8822-49be-842a-0849d315dd9b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:17.793288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-144fa4c8-8822-49be-842a-0849d315dd9b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:17.793779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-144fa4c8-8822-49be-842a-0849d315dd9b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:17.824156 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24d539e1-78d1-4f44-8c18-a9d2de0a852e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:17.825023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24d539e1-78d1-4f44-8c18-a9d2de0a852e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:17.840266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24d539e1-78d1-4f44-8c18-a9d2de0a852e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:17.841900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24d539e1-78d1-4f44-8c18-a9d2de0a852e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:17.846715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24d539e1-78d1-4f44-8c18-a9d2de0a852e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:17.848595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24d539e1-78d1-4f44-8c18-a9d2de0a852e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:17.877472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-144fa4c8-8822-49be-842a-0849d315dd9b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:57:18.210456 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-144fa4c8-8822-49be-842a-0849d315dd9b tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef" status: 204 len: 0 microversion: 2.1 time: 0.438896 Sep 07 12:57:18.214007 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2572/5089] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:57:17 2022] DELETE /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:57:18.240348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4efc30a0-a549-4bb8-afdb-772aae4f7f05 tempest-MultipleCreateNegativeTestJSON-790417113 tempest-MultipleCreateNegativeTestJSON-790417113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1541386325", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "min_count": 2.5}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4efc30a0-a549-4bb8-afdb-772aae4f7f05 tempest-MultipleCreateNegativeTestJSON-790417113 tempest-MultipleCreateNegativeTestJSON-790417113-project] Request method failure captured: Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 170 Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJUruUH6yvPGOOFoHmAzdprElUFThk0y1R68ypPXw845Ny2AY5MLZIgbBaqxQ_9fTaTcYbugl2x9mt6PgGUw_urC5GMfkHyOas-_QnP7-cHrsWHlkeuaGtg1Ok6EStMzipN2RE5chejukWDklfcN3qnGQAsprhI1sSRx1ocjL-PSxzg Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 5f004818321f46b1ac2b677395fe565b Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-790417113 Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5f004818321f46b1ac2b677395fe565b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5f004818321f46b1ac2b677395fe565b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5f004818321f46b1ac2b677395fe565b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5f004818321f46b1ac2b677395fe565b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-790417113 Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 5f004818321f46b1ac2b677395fe565b Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-790417113 Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-MultipleCreateNegativeTestJSON-790417113-project Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: d962f30a3c1c4728821e24ce799a70ad Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-790417113-project Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1541386325", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "min_count": 2.5}} Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1541386325', 'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f', 'flavorRef': '452', 'min_count': 2.5}}} Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi 2.5 Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:57:18.250848 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:57:18.257126 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:57:18.257126 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:57:18.257126 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:57:18.257126 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:57:18.257126 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 07 12:57:18.257126 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:18.257126 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:57:18.257126 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:18.257126 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:18.257126 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:57:18.257126 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:57:18.257126 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:57:18.257126 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:57:18.257126 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 07 12:57:18.257126 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:18.257126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4efc30a0-a549-4bb8-afdb-772aae4f7f05 tempest-MultipleCreateNegativeTestJSON-790417113 tempest-MultipleCreateNegativeTestJSON-790417113-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:57:18.259313 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4efc30a0-a549-4bb8-afdb-772aae4f7f05 tempest-MultipleCreateNegativeTestJSON-790417113 tempest-MultipleCreateNegativeTestJSON-790417113-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.040631 Sep 07 12:57:18.265909 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2573/5090] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:57:18 2022] POST /compute/v2.1/servers => generated 139 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:57:18.282166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb4b9139-4584-479e-830c-f645e1afe832 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:18.286736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cb4b9139-4584-479e-830c-f645e1afe832 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:18.310051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb4b9139-4584-479e-830c-f645e1afe832 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:18.311671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb4b9139-4584-479e-830c-f645e1afe832 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:18.314138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb4b9139-4584-479e-830c-f645e1afe832 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:18.315276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb4b9139-4584-479e-830c-f645e1afe832 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:18.317912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb4b9139-4584-479e-830c-f645e1afe832 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:18.320467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb4b9139-4584-479e-830c-f645e1afe832 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:18.665140 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-24d539e1-78d1-4f44-8c18-a9d2de0a852e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:18.690074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-24d539e1-78d1-4f44-8c18-a9d2de0a852e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:18.693174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-24d539e1-78d1-4f44-8c18-a9d2de0a852e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:18.704108 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-24d539e1-78d1-4f44-8c18-a9d2de0a852e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1721 microversion: 2.20 time: 0.938601 Sep 07 12:57:18.734093 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2518/5091] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:57:17 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1721 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:57:18.765847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ebed84e-94dd-45dd-9222-f9821a4e7dbe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:18.767046 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5ebed84e-94dd-45dd-9222-f9821a4e7dbe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d9cff1f-6cd8-4472-be56-757c5ce15956] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:18.781796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ebed84e-94dd-45dd-9222-f9821a4e7dbe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:18.791823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ebed84e-94dd-45dd-9222-f9821a4e7dbe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:18.792619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ebed84e-94dd-45dd-9222-f9821a4e7dbe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:18.793980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ebed84e-94dd-45dd-9222-f9821a4e7dbe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:18.794716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ebed84e-94dd-45dd-9222-f9821a4e7dbe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:18.795493 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ebed84e-94dd-45dd-9222-f9821a4e7dbe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:19.284382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cb4b9139-4584-479e-830c-f645e1afe832 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:19.302078 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cb4b9139-4584-479e-830c-f645e1afe832 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef" status: 200 len: 1507 microversion: 2.1 time: 1.040361 Sep 07 12:57:19.303197 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2574/5092] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:18 2022] GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef => generated 1507 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:19.338311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bcb773d8-4860-464c-9a5d-7c9eca18d0a9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:19.339408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bcb773d8-4860-464c-9a5d-7c9eca18d0a9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:19.360549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcb773d8-4860-464c-9a5d-7c9eca18d0a9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:19.361071 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcb773d8-4860-464c-9a5d-7c9eca18d0a9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:19.366988 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcb773d8-4860-464c-9a5d-7c9eca18d0a9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:19.368325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcb773d8-4860-464c-9a5d-7c9eca18d0a9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:19.369814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcb773d8-4860-464c-9a5d-7c9eca18d0a9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:19.370552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bcb773d8-4860-464c-9a5d-7c9eca18d0a9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:19.922548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5ebed84e-94dd-45dd-9222-f9821a4e7dbe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:19.948046 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5ebed84e-94dd-45dd-9222-f9821a4e7dbe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956" status: 200 len: 1309 microversion: 2.1 time: 1.212249 Sep 07 12:57:19.949069 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2519/5093] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:18 2022] GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956 => generated 1309 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:19.969320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0ab39da6-2285-4aad-ba3f-1e1bc5b0131c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:19.971089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0ab39da6-2285-4aad-ba3f-1e1bc5b0131c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:20.000230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ab39da6-2285-4aad-ba3f-1e1bc5b0131c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:20.001107 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ab39da6-2285-4aad-ba3f-1e1bc5b0131c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:20.001919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ab39da6-2285-4aad-ba3f-1e1bc5b0131c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:20.003253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ab39da6-2285-4aad-ba3f-1e1bc5b0131c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:20.004076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ab39da6-2285-4aad-ba3f-1e1bc5b0131c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:20.005387 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ab39da6-2285-4aad-ba3f-1e1bc5b0131c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:20.686348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0ab39da6-2285-4aad-ba3f-1e1bc5b0131c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:20.701302 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0ab39da6-2285-4aad-ba3f-1e1bc5b0131c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:20.706621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bcb773d8-4860-464c-9a5d-7c9eca18d0a9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:20.721694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0ab39da6-2285-4aad-ba3f-1e1bc5b0131c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:20.725690 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bcb773d8-4860-464c-9a5d-7c9eca18d0a9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1724 microversion: 2.1 time: 1.399651 Sep 07 12:57:20.728886 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2575/5094] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:19 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1724 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:20.731500 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0ab39da6-2285-4aad-ba3f-1e1bc5b0131c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1721 microversion: 2.20 time: 0.774123 Sep 07 12:57:20.732582 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2520/5095] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:57:19 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1721 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:57:20.740844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-206b5800-5da9-4633-a84a-576997823897 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:20.741707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-206b5800-5da9-4633-a84a-576997823897 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:20.760696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-206b5800-5da9-4633-a84a-576997823897 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:20.764826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-206b5800-5da9-4633-a84a-576997823897 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:20.766018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-206b5800-5da9-4633-a84a-576997823897 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:20.775973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-206b5800-5da9-4633-a84a-576997823897 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:20.782346 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-206b5800-5da9-4633-a84a-576997823897 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:20.785591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-206b5800-5da9-4633-a84a-576997823897 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:21.000313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b6d00a4e-021d-47b8-99e3-6216e90f7fdf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:21.002129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b6d00a4e-021d-47b8-99e3-6216e90f7fdf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d9cff1f-6cd8-4472-be56-757c5ce15956] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:21.022904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6d00a4e-021d-47b8-99e3-6216e90f7fdf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:21.026582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6d00a4e-021d-47b8-99e3-6216e90f7fdf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:21.027467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6d00a4e-021d-47b8-99e3-6216e90f7fdf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:21.028540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6d00a4e-021d-47b8-99e3-6216e90f7fdf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:21.029910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6d00a4e-021d-47b8-99e3-6216e90f7fdf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:21.031709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6d00a4e-021d-47b8-99e3-6216e90f7fdf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:21.272922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-206b5800-5da9-4633-a84a-576997823897 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:21.287242 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-206b5800-5da9-4633-a84a-576997823897 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef" status: 200 len: 1507 microversion: 2.1 time: 0.556793 Sep 07 12:57:21.288279 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2576/5096] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:20 2022] GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef => generated 1507 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:21.764482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b6d00a4e-021d-47b8-99e3-6216e90f7fdf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:21.764768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-274d4a44-66fa-40b8-9caf-7552de432ee0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:21.765528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-274d4a44-66fa-40b8-9caf-7552de432ee0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:21.778585 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-274d4a44-66fa-40b8-9caf-7552de432ee0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:21.784329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-274d4a44-66fa-40b8-9caf-7552de432ee0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:21.786203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-274d4a44-66fa-40b8-9caf-7552de432ee0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:21.786832 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-274d4a44-66fa-40b8-9caf-7552de432ee0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:21.787748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-274d4a44-66fa-40b8-9caf-7552de432ee0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:21.787987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-274d4a44-66fa-40b8-9caf-7552de432ee0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:21.803473 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b6d00a4e-021d-47b8-99e3-6216e90f7fdf tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956" status: 200 len: 1309 microversion: 2.1 time: 0.807158 Sep 07 12:57:21.819104 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2521/5097] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:20 2022] GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956 => generated 1309 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:57:21.840042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d268ba28-978f-4b46-91f2-0091f2dac245 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:21.841906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d268ba28-978f-4b46-91f2-0091f2dac245 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:21.881168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d268ba28-978f-4b46-91f2-0091f2dac245 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:21.889623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d268ba28-978f-4b46-91f2-0091f2dac245 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:21.899996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d268ba28-978f-4b46-91f2-0091f2dac245 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:21.904981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d268ba28-978f-4b46-91f2-0091f2dac245 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:21.910738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d268ba28-978f-4b46-91f2-0091f2dac245 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:21.911583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d268ba28-978f-4b46-91f2-0091f2dac245 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:23.353655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-274d4a44-66fa-40b8-9caf-7552de432ee0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:23.390966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-274d4a44-66fa-40b8-9caf-7552de432ee0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:23.395229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-274d4a44-66fa-40b8-9caf-7552de432ee0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:23.399367 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-274d4a44-66fa-40b8-9caf-7552de432ee0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1742 microversion: 2.20 time: 1.639465 Sep 07 12:57:23.401616 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2577/5098] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:57:21 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1742 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:57:23.413442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3e249652-85d4-409c-8d75-6f9168f6003a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:23.414438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d268ba28-978f-4b46-91f2-0091f2dac245 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:23.417524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3e249652-85d4-409c-8d75-6f9168f6003a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:23.431060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e249652-85d4-409c-8d75-6f9168f6003a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:23.431500 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e249652-85d4-409c-8d75-6f9168f6003a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:23.433074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e249652-85d4-409c-8d75-6f9168f6003a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:23.434605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e249652-85d4-409c-8d75-6f9168f6003a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:23.436013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e249652-85d4-409c-8d75-6f9168f6003a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:23.437064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e249652-85d4-409c-8d75-6f9168f6003a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:23.450179 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d268ba28-978f-4b46-91f2-0091f2dac245 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1724 microversion: 2.1 time: 1.642816 Sep 07 12:57:23.458272 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2522/5099] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:21 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1724 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:23.469310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-013b1693-9ba3-4b4f-b799-846890ce2880 req-b84c7972-1c0d-4180-a7b5-dae8960b56cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaef0385-5f99-4b42-97b2-5c412f4007ef", "name": "network-vif-deleted", "tag": "5f3b27e0-c172-4e5b-a0d2-e417964e9c1b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:57:23.512384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-013b1693-9ba3-4b4f-b799-846890ce2880 req-b84c7972-1c0d-4180-a7b5-dae8960b56cf service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:23.513818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-013b1693-9ba3-4b4f-b799-846890ce2880 req-b84c7972-1c0d-4180-a7b5-dae8960b56cf service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:23.514957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-013b1693-9ba3-4b4f-b799-846890ce2880 req-b84c7972-1c0d-4180-a7b5-dae8960b56cf service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:23.536146 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-013b1693-9ba3-4b4f-b799-846890ce2880 req-b84c7972-1c0d-4180-a7b5-dae8960b56cf service nova] Creating event network-vif-deleted:5f3b27e0-c172-4e5b-a0d2-e417964e9c1b for instance aaef0385-5f99-4b42-97b2-5c412f4007ef on n-h2-852087-9 Sep 07 12:57:23.542949 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-013b1693-9ba3-4b4f-b799-846890ce2880 req-b84c7972-1c0d-4180-a7b5-dae8960b56cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081094 Sep 07 12:57:23.544474 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2523/5100] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:57:23.552492 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-633867ab-bb85-4906-8c18-34f7bb70e39c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:23.553676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-633867ab-bb85-4906-8c18-34f7bb70e39c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d9cff1f-6cd8-4472-be56-757c5ce15956] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:23.562930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-633867ab-bb85-4906-8c18-34f7bb70e39c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:23.564403 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-633867ab-bb85-4906-8c18-34f7bb70e39c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:23.565269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-633867ab-bb85-4906-8c18-34f7bb70e39c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:23.566270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-633867ab-bb85-4906-8c18-34f7bb70e39c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:23.566967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-633867ab-bb85-4906-8c18-34f7bb70e39c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:23.567622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-633867ab-bb85-4906-8c18-34f7bb70e39c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:23.591092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e249652-85d4-409c-8d75-6f9168f6003a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:23.592566 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e249652-85d4-409c-8d75-6f9168f6003a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:23.593778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e249652-85d4-409c-8d75-6f9168f6003a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:23.594969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-3e249652-85d4-409c-8d75-6f9168f6003a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lazy-loading 'fault' on Instance uuid aaef0385-5f99-4b42-97b2-5c412f4007ef {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:57:23.945654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3e249652-85d4-409c-8d75-6f9168f6003a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:23.987521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:24.022067 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3e249652-85d4-409c-8d75-6f9168f6003a tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef" status: 200 len: 1305 microversion: 2.1 time: 0.618220 Sep 07 12:57:24.040398 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2578/5101] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:23 2022] GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef => generated 1305 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:24.074401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-800bcba2-3305-4f93-b556-222bd67c5b68 req-cfd17e4c-7fb3-423d-b6e1-d2b08dbe0785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d9cff1f-6cd8-4472-be56-757c5ce15956", "name": "network-vif-plugged", "status": "completed", "tag": "760c1473-9e94-40f1-8783-916905448982"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:57:24.118286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-800bcba2-3305-4f93-b556-222bd67c5b68 req-cfd17e4c-7fb3-423d-b6e1-d2b08dbe0785 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:24.118949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-800bcba2-3305-4f93-b556-222bd67c5b68 req-cfd17e4c-7fb3-423d-b6e1-d2b08dbe0785 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:24.121866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-800bcba2-3305-4f93-b556-222bd67c5b68 req-cfd17e4c-7fb3-423d-b6e1-d2b08dbe0785 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:24.166616 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-800bcba2-3305-4f93-b556-222bd67c5b68 req-cfd17e4c-7fb3-423d-b6e1-d2b08dbe0785 service nova] Creating event network-vif-plugged:760c1473-9e94-40f1-8783-916905448982 for instance 7d9cff1f-6cd8-4472-be56-757c5ce15956 on n-h1-852087-9 Sep 07 12:57:24.183879 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-800bcba2-3305-4f93-b556-222bd67c5b68 req-cfd17e4c-7fb3-423d-b6e1-d2b08dbe0785 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140508 Sep 07 12:57:24.187728 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2579/5102] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:57:24.387310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-633867ab-bb85-4906-8c18-34f7bb70e39c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:24.396309 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-633867ab-bb85-4906-8c18-34f7bb70e39c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956" status: 200 len: 1309 microversion: 2.1 time: 0.849535 Sep 07 12:57:24.402036 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2524/5103] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:23 2022] GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956 => generated 1309 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:24.436042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0172b739-8ef8-4cef-b7d1-ca8f95c87aa2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:24.437477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0172b739-8ef8-4cef-b7d1-ca8f95c87aa2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:24.449754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0172b739-8ef8-4cef-b7d1-ca8f95c87aa2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:24.453075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0172b739-8ef8-4cef-b7d1-ca8f95c87aa2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:24.453828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0172b739-8ef8-4cef-b7d1-ca8f95c87aa2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:24.457500 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0172b739-8ef8-4cef-b7d1-ca8f95c87aa2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:24.458242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0172b739-8ef8-4cef-b7d1-ca8f95c87aa2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:24.459468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0172b739-8ef8-4cef-b7d1-ca8f95c87aa2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:24.512985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-731f3b67-797a-4696-8933-1d94e6c38b85 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:24.513668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-731f3b67-797a-4696-8933-1d94e6c38b85 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:24.526055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-731f3b67-797a-4696-8933-1d94e6c38b85 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:24.527589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-731f3b67-797a-4696-8933-1d94e6c38b85 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:24.528297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-731f3b67-797a-4696-8933-1d94e6c38b85 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:24.529296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-731f3b67-797a-4696-8933-1d94e6c38b85 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:24.529968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-731f3b67-797a-4696-8933-1d94e6c38b85 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:24.531253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-731f3b67-797a-4696-8933-1d94e6c38b85 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:25.218936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-731f3b67-797a-4696-8933-1d94e6c38b85 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:25.224522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0172b739-8ef8-4cef-b7d1-ca8f95c87aa2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:25.236579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0172b739-8ef8-4cef-b7d1-ca8f95c87aa2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:25.238497 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0172b739-8ef8-4cef-b7d1-ca8f95c87aa2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:25.239995 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0172b739-8ef8-4cef-b7d1-ca8f95c87aa2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1737 microversion: 2.20 time: 0.809804 Sep 07 12:57:25.242582 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-731f3b67-797a-4696-8933-1d94e6c38b85 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1724 microversion: 2.1 time: 0.733492 Sep 07 12:57:25.250070 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2525/5104] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:24 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1724 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:25.270022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-391e7148-469f-4418-92c6-3b9e50fbe0ad tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:25.271710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-391e7148-469f-4418-92c6-3b9e50fbe0ad tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: aaef0385-5f99-4b42-97b2-5c412f4007ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:25.276620 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2580/5105] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:57:24 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1737 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:57:25.298758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-391e7148-469f-4418-92c6-3b9e50fbe0ad tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:25.300398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-391e7148-469f-4418-92c6-3b9e50fbe0ad tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:25.301457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-391e7148-469f-4418-92c6-3b9e50fbe0ad tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:25.309200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-391e7148-469f-4418-92c6-3b9e50fbe0ad tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:25.310650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-391e7148-469f-4418-92c6-3b9e50fbe0ad tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:25.311654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-391e7148-469f-4418-92c6-3b9e50fbe0ad tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:25.381850 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-391e7148-469f-4418-92c6-3b9e50fbe0ad tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] HTTP exception thrown: Instance aaef0385-5f99-4b42-97b2-5c412f4007ef could not be found. Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-391e7148-469f-4418-92c6-3b9e50fbe0ad tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Request method failure captured: Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef HTTP/1.1 Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJIYLgiUrD1FdG9a7jmdNUMsZflZ3IWVyV8jqJSyV7T-w7h1XqCWsHPlozQTxQ2SU2jPLptx_fK_PvA-9nGk2l4mDj334XTiP3wjCP9pCC7M8WLyWD7z_wyZ-hqyLowt8RL_r5UCBhe13xhmSDGs-ilkA2aO2hODHauJwGHwZVM1f9E Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: af1de494abea4aa7841c00fb199e8aec Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerActionsTestJSON-835038512 Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/af1de494abea4aa7841c00fb199e8aec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_af1de494abea4aa7841c00fb199e8aec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/af1de494abea4aa7841c00fb199e8aec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/af1de494abea4aa7841c00fb199e8aec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerActionsTestJSON-835038512 Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: af1de494abea4aa7841c00fb199e8aec Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerActionsTestJSON-835038512 Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerActionsTestJSON-835038512-project Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 22ec4509710f446d843f6882120c5d6e Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerActionsTestJSON-835038512-project Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance aaef0385-5f99-4b42-97b2-5c412f4007ef could not be found. Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'aaef0385-5f99-4b42-97b2-5c412f4007ef'} Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaef0385-5f99-4b42-97b2-5c412f4007ef could not be found. Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaef0385-5f99-4b42-97b2-5c412f4007ef could not be found. Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:57:25.384141 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:57:25.392183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:25.392183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:57:25.392183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:57:25.392183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:57:25.392183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:57:25.392183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaef0385-5f99-4b42-97b2-5c412f4007ef could not be found. Sep 07 12:57:25.392183 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:57:25.394823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-391e7148-469f-4418-92c6-3b9e50fbe0ad tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Returning 404 to user: Instance aaef0385-5f99-4b42-97b2-5c412f4007ef could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:57:25.396193 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-391e7148-469f-4418-92c6-3b9e50fbe0ad tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef" status: 404 len: 111 microversion: 2.1 time: 0.144214 Sep 07 12:57:25.401626 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2526/5106] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:25 2022] GET /compute/v2.1/servers/aaef0385-5f99-4b42-97b2-5c412f4007ef => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:57:25.407127 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-61500095-59a7-4218-8540-c272f36b89ef tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:25.407637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-61500095-59a7-4218-8540-c272f36b89ef tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:25.421717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61500095-59a7-4218-8540-c272f36b89ef tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:25.422531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61500095-59a7-4218-8540-c272f36b89ef tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:25.423965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61500095-59a7-4218-8540-c272f36b89ef tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:25.425067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61500095-59a7-4218-8540-c272f36b89ef tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:25.428251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61500095-59a7-4218-8540-c272f36b89ef tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:25.429440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-01124286-5e4e-4da9-a647-7fb5d6f5bd93 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:25.430544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61500095-59a7-4218-8540-c272f36b89ef tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:25.436216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-01124286-5e4e-4da9-a647-7fb5d6f5bd93 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d9cff1f-6cd8-4472-be56-757c5ce15956] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:25.463357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01124286-5e4e-4da9-a647-7fb5d6f5bd93 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:25.464727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01124286-5e4e-4da9-a647-7fb5d6f5bd93 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:25.465859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01124286-5e4e-4da9-a647-7fb5d6f5bd93 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:25.467542 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01124286-5e4e-4da9-a647-7fb5d6f5bd93 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:25.468813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01124286-5e4e-4da9-a647-7fb5d6f5bd93 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:25.469901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01124286-5e4e-4da9-a647-7fb5d6f5bd93 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:25.502609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-61500095-59a7-4218-8540-c272f36b89ef tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:57:25.784807 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-61500095-59a7-4218-8540-c272f36b89ef tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 204 len: 0 microversion: 2.1 time: 0.380994 Sep 07 12:57:25.790667 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2581/5107] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:57:25 2022] DELETE /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 12:57:25.806488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3cff3261-39df-45ac-ad3b-aa3a9084fcb8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:25.808042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3cff3261-39df-45ac-ad3b-aa3a9084fcb8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:25.829725 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-01124286-5e4e-4da9-a647-7fb5d6f5bd93 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:25.835391 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cff3261-39df-45ac-ad3b-aa3a9084fcb8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:25.836408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cff3261-39df-45ac-ad3b-aa3a9084fcb8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:25.837218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cff3261-39df-45ac-ad3b-aa3a9084fcb8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:25.839036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cff3261-39df-45ac-ad3b-aa3a9084fcb8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:25.840365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cff3261-39df-45ac-ad3b-aa3a9084fcb8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:25.841127 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cff3261-39df-45ac-ad3b-aa3a9084fcb8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:25.869759 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-01124286-5e4e-4da9-a647-7fb5d6f5bd93 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956" status: 200 len: 1309 microversion: 2.1 time: 0.447255 Sep 07 12:57:25.893852 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2527/5108] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:25 2022] GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956 => generated 1309 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:57:26.258635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-58f781fa-8df8-4198-8a98-e1e87bdbf3db req-386cb5fb-9e6a-4b58-acc1-09f7d3ea53a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f328e5-ec00-4403-8196-cbefa047877b", "name": "network-vif-plugged", "status": "completed", "tag": "13d7f17d-cb66-4016-a84a-aec1e39c3e03"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:57:26.282386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-58f781fa-8df8-4198-8a98-e1e87bdbf3db req-386cb5fb-9e6a-4b58-acc1-09f7d3ea53a5 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:26.283060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-58f781fa-8df8-4198-8a98-e1e87bdbf3db req-386cb5fb-9e6a-4b58-acc1-09f7d3ea53a5 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:26.285062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3cff3261-39df-45ac-ad3b-aa3a9084fcb8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:26.285283 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-58f781fa-8df8-4198-8a98-e1e87bdbf3db req-386cb5fb-9e6a-4b58-acc1-09f7d3ea53a5 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:26.299322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:26.312079 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3cff3261-39df-45ac-ad3b-aa3a9084fcb8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1494 microversion: 2.1 time: 0.518989 Sep 07 12:57:26.315711 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-58f781fa-8df8-4198-8a98-e1e87bdbf3db req-386cb5fb-9e6a-4b58-acc1-09f7d3ea53a5 service nova] Creating event network-vif-plugged:13d7f17d-cb66-4016-a84a-aec1e39c3e03 for instance 35f328e5-ec00-4403-8196-cbefa047877b on n-h2-852087-9 Sep 07 12:57:26.319958 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2582/5109] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:25 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1494 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:57:26.325601 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-58f781fa-8df8-4198-8a98-e1e87bdbf3db req-386cb5fb-9e6a-4b58-acc1-09f7d3ea53a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070744 Sep 07 12:57:26.330220 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2528/5110] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:57:26.341746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-28051bff-2684-46ea-9cc7-3f70c07885f0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:26.343298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-28051bff-2684-46ea-9cc7-3f70c07885f0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:26.343446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5d8c87d7-4f23-4c02-a4c1-87c9fc8ca201 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:26.344249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5d8c87d7-4f23-4c02-a4c1-87c9fc8ca201 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:26.363844 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d8c87d7-4f23-4c02-a4c1-87c9fc8ca201 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:26.364771 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d8c87d7-4f23-4c02-a4c1-87c9fc8ca201 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:26.373094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d8c87d7-4f23-4c02-a4c1-87c9fc8ca201 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:26.374418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d8c87d7-4f23-4c02-a4c1-87c9fc8ca201 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:26.375177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d8c87d7-4f23-4c02-a4c1-87c9fc8ca201 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:26.375845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d8c87d7-4f23-4c02-a4c1-87c9fc8ca201 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:26.376066 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28051bff-2684-46ea-9cc7-3f70c07885f0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:26.377370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28051bff-2684-46ea-9cc7-3f70c07885f0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:26.378353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28051bff-2684-46ea-9cc7-3f70c07885f0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:26.383134 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28051bff-2684-46ea-9cc7-3f70c07885f0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:26.384787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28051bff-2684-46ea-9cc7-3f70c07885f0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:26.386076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28051bff-2684-46ea-9cc7-3f70c07885f0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:27.527064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-28051bff-2684-46ea-9cc7-3f70c07885f0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:27.545183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-28051bff-2684-46ea-9cc7-3f70c07885f0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:27.552443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-28051bff-2684-46ea-9cc7-3f70c07885f0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:27.553832 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-28051bff-2684-46ea-9cc7-3f70c07885f0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1737 microversion: 2.20 time: 1.231550 Sep 07 12:57:27.559550 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2583/5111] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:57:26 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1737 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:57:27.572010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bb823ebc-1fd8-442f-aa5e-b1ba4fe6eca8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:27.576720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bb823ebc-1fd8-442f-aa5e-b1ba4fe6eca8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d9cff1f-6cd8-4472-be56-757c5ce15956] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:27.591568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb823ebc-1fd8-442f-aa5e-b1ba4fe6eca8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:27.601723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb823ebc-1fd8-442f-aa5e-b1ba4fe6eca8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:27.602249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb823ebc-1fd8-442f-aa5e-b1ba4fe6eca8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:27.603006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb823ebc-1fd8-442f-aa5e-b1ba4fe6eca8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:27.603483 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb823ebc-1fd8-442f-aa5e-b1ba4fe6eca8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:27.603918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb823ebc-1fd8-442f-aa5e-b1ba4fe6eca8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:28.028796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5d8c87d7-4f23-4c02-a4c1-87c9fc8ca201 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:28.060497 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5d8c87d7-4f23-4c02-a4c1-87c9fc8ca201 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1724 microversion: 2.1 time: 1.728420 Sep 07 12:57:28.070475 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2529/5112] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:26 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1724 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:28.080019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1da4c38e-2dba-45b4-a075-d45e08df8ffe tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:28.081704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1da4c38e-2dba-45b4-a075-d45e08df8ffe tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:28.095503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1da4c38e-2dba-45b4-a075-d45e08df8ffe tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:28.096977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1da4c38e-2dba-45b4-a075-d45e08df8ffe tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:28.098092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1da4c38e-2dba-45b4-a075-d45e08df8ffe tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:28.099954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1da4c38e-2dba-45b4-a075-d45e08df8ffe tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:28.101204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1da4c38e-2dba-45b4-a075-d45e08df8ffe tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:28.104150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1da4c38e-2dba-45b4-a075-d45e08df8ffe tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:28.662248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bb823ebc-1fd8-442f-aa5e-b1ba4fe6eca8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:28.698984 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bb823ebc-1fd8-442f-aa5e-b1ba4fe6eca8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956" status: 200 len: 1491 microversion: 2.1 time: 1.137647 Sep 07 12:57:28.700997 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2584/5113] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:27 2022] GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956 => generated 1491 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:28.720642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-baa93c03-6db1-48f8-a4b7-bd166b53d8cd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:28.723307 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-baa93c03-6db1-48f8-a4b7-bd166b53d8cd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:28.772462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-baa93c03-6db1-48f8-a4b7-bd166b53d8cd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:28.777787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-baa93c03-6db1-48f8-a4b7-bd166b53d8cd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:28.779133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-baa93c03-6db1-48f8-a4b7-bd166b53d8cd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:28.780239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1da4c38e-2dba-45b4-a075-d45e08df8ffe tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:28.787476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-baa93c03-6db1-48f8-a4b7-bd166b53d8cd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:28.788718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-baa93c03-6db1-48f8-a4b7-bd166b53d8cd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:28.789563 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1da4c38e-2dba-45b4-a075-d45e08df8ffe tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1494 microversion: 2.1 time: 0.717114 Sep 07 12:57:28.792251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-baa93c03-6db1-48f8-a4b7-bd166b53d8cd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:28.798909 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2530/5114] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:28 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1494 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:28.812065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-30abd1fb-8f5d-433e-82cf-66844645cd31 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:28.829566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-30abd1fb-8f5d-433e-82cf-66844645cd31 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d870ac2-825e-4d5b-825b-fcc194138508] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:28.866399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30abd1fb-8f5d-433e-82cf-66844645cd31 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:28.870655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30abd1fb-8f5d-433e-82cf-66844645cd31 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:28.878270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30abd1fb-8f5d-433e-82cf-66844645cd31 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:28.879447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30abd1fb-8f5d-433e-82cf-66844645cd31 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:28.880892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30abd1fb-8f5d-433e-82cf-66844645cd31 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:28.881652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30abd1fb-8f5d-433e-82cf-66844645cd31 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:30.324800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-baa93c03-6db1-48f8-a4b7-bd166b53d8cd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:30.357041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-baa93c03-6db1-48f8-a4b7-bd166b53d8cd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:30.377949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-baa93c03-6db1-48f8-a4b7-bd166b53d8cd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:30.399882 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-baa93c03-6db1-48f8-a4b7-bd166b53d8cd tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1737 microversion: 2.20 time: 1.684090 Sep 07 12:57:30.407999 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2585/5115] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:57:28 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1737 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:57:30.482324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-30abd1fb-8f5d-433e-82cf-66844645cd31 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:30.491620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-00a1395d-8c36-4f73-8192-10afc5803867 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:30.501916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-00a1395d-8c36-4f73-8192-10afc5803867 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:30.523697 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-30abd1fb-8f5d-433e-82cf-66844645cd31 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508" status: 200 len: 1490 microversion: 2.1 time: 1.722905 Sep 07 12:57:30.532352 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2531/5116] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:28 2022] GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508 => generated 1490 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:30.557544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4bf7fb2c-6cf0-4522-a090-91daf12498c2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:30.575497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4bf7fb2c-6cf0-4522-a090-91daf12498c2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:30.576802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00a1395d-8c36-4f73-8192-10afc5803867 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:30.584097 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00a1395d-8c36-4f73-8192-10afc5803867 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:30.589810 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00a1395d-8c36-4f73-8192-10afc5803867 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:30.600165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00a1395d-8c36-4f73-8192-10afc5803867 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:30.606341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00a1395d-8c36-4f73-8192-10afc5803867 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:30.612135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4bf7fb2c-6cf0-4522-a090-91daf12498c2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:30.615885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-00a1395d-8c36-4f73-8192-10afc5803867 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:30.621846 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4bf7fb2c-6cf0-4522-a090-91daf12498c2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:30.627791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4bf7fb2c-6cf0-4522-a090-91daf12498c2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:30.639103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4bf7fb2c-6cf0-4522-a090-91daf12498c2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:30.643862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4bf7fb2c-6cf0-4522-a090-91daf12498c2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:30.650899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4bf7fb2c-6cf0-4522-a090-91daf12498c2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:31.202246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4bf7fb2c-6cf0-4522-a090-91daf12498c2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:31.212202 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4bf7fb2c-6cf0-4522-a090-91daf12498c2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1287 microversion: 2.1 time: 0.677598 Sep 07 12:57:31.224390 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2532/5117] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:30 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1287 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:31.230982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-120b9bbd-9575-4847-9011-838d86f803e1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:31.232091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-120b9bbd-9575-4847-9011-838d86f803e1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d9cff1f-6cd8-4472-be56-757c5ce15956] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:31.279432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:31.280976 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-120b9bbd-9575-4847-9011-838d86f803e1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:31.281476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-120b9bbd-9575-4847-9011-838d86f803e1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:31.281935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-120b9bbd-9575-4847-9011-838d86f803e1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:31.282813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-120b9bbd-9575-4847-9011-838d86f803e1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:31.283282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-120b9bbd-9575-4847-9011-838d86f803e1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:31.283713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-120b9bbd-9575-4847-9011-838d86f803e1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:31.459865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-00a1395d-8c36-4f73-8192-10afc5803867 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:31.476283 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-00a1395d-8c36-4f73-8192-10afc5803867 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1724 microversion: 2.1 time: 1.065759 Sep 07 12:57:31.484499 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2586/5118] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:30 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1724 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:31.508792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-3cb63d7b-b2e9-4c56-9c4b-3e9340574a28 req-2301dc45-bfa2-42c1-a593-ff63229f3b70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0983070f-5877-49b6-8e6b-0a2a2471517d", "name": "network-vif-deleted", "tag": "a097e437-e2eb-467f-9143-e1c6b1a563aa"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:57:31.552912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3cb63d7b-b2e9-4c56-9c4b-3e9340574a28 req-2301dc45-bfa2-42c1-a593-ff63229f3b70 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:31.554011 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3cb63d7b-b2e9-4c56-9c4b-3e9340574a28 req-2301dc45-bfa2-42c1-a593-ff63229f3b70 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:31.554813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3cb63d7b-b2e9-4c56-9c4b-3e9340574a28 req-2301dc45-bfa2-42c1-a593-ff63229f3b70 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:31.604895 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-3cb63d7b-b2e9-4c56-9c4b-3e9340574a28 req-2301dc45-bfa2-42c1-a593-ff63229f3b70 service nova] Creating event network-vif-deleted:a097e437-e2eb-467f-9143-e1c6b1a563aa for instance 0983070f-5877-49b6-8e6b-0a2a2471517d on n-h2-852087-9 Sep 07 12:57:31.630163 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-3cb63d7b-b2e9-4c56-9c4b-3e9340574a28 req-2301dc45-bfa2-42c1-a593-ff63229f3b70 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142857 Sep 07 12:57:31.631700 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2587/5119] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:57:31.644821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0b2a0752-3edc-4268-9e4f-0e91b00303ba tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:31.657208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0b2a0752-3edc-4268-9e4f-0e91b00303ba tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:31.676712 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b2a0752-3edc-4268-9e4f-0e91b00303ba tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:31.694946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b2a0752-3edc-4268-9e4f-0e91b00303ba tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:31.700226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b2a0752-3edc-4268-9e4f-0e91b00303ba tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:31.705344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b2a0752-3edc-4268-9e4f-0e91b00303ba tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:31.710998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b2a0752-3edc-4268-9e4f-0e91b00303ba tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:31.716383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b2a0752-3edc-4268-9e4f-0e91b00303ba tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:31.882284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-120b9bbd-9575-4847-9011-838d86f803e1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:31.948563 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-120b9bbd-9575-4847-9011-838d86f803e1 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956" status: 200 len: 1491 microversion: 2.1 time: 0.719551 Sep 07 12:57:31.954359 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2533/5120] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:31 2022] GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956 => generated 1491 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:31.982396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e3adfe6d-2fc0-4476-b4e0-9d6b605716ec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:31.983169 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e3adfe6d-2fc0-4476-b4e0-9d6b605716ec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d9cff1f-6cd8-4472-be56-757c5ce15956] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:31.997427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3adfe6d-2fc0-4476-b4e0-9d6b605716ec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:31.998815 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3adfe6d-2fc0-4476-b4e0-9d6b605716ec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:32.002195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3adfe6d-2fc0-4476-b4e0-9d6b605716ec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:32.003277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3adfe6d-2fc0-4476-b4e0-9d6b605716ec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:32.004118 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3adfe6d-2fc0-4476-b4e0-9d6b605716ec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:32.007371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3adfe6d-2fc0-4476-b4e0-9d6b605716ec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:32.058411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e3adfe6d-2fc0-4476-b4e0-9d6b605716ec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d9cff1f-6cd8-4472-be56-757c5ce15956] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:57:32.529347 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e3adfe6d-2fc0-4476-b4e0-9d6b605716ec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956" status: 204 len: 0 microversion: 2.1 time: 0.550276 Sep 07 12:57:32.547132 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2534/5121] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:57:31 2022] DELETE /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:57:32.567248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0b2a0752-3edc-4268-9e4f-0e91b00303ba tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:32.589040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-75ea8ba9-d71b-44ba-bb7f-d25fb2e7cbcd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:32.593720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-75ea8ba9-d71b-44ba-bb7f-d25fb2e7cbcd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:32.610634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0b2a0752-3edc-4268-9e4f-0e91b00303ba tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:32.617356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0b2a0752-3edc-4268-9e4f-0e91b00303ba tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:32.618294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75ea8ba9-d71b-44ba-bb7f-d25fb2e7cbcd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:32.619434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75ea8ba9-d71b-44ba-bb7f-d25fb2e7cbcd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:32.622742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75ea8ba9-d71b-44ba-bb7f-d25fb2e7cbcd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:32.625946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75ea8ba9-d71b-44ba-bb7f-d25fb2e7cbcd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:32.626449 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0b2a0752-3edc-4268-9e4f-0e91b00303ba tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1737 microversion: 2.20 time: 0.990758 Sep 07 12:57:32.627562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75ea8ba9-d71b-44ba-bb7f-d25fb2e7cbcd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:32.629908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75ea8ba9-d71b-44ba-bb7f-d25fb2e7cbcd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:32.631555 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2588/5122] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:57:31 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1737 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:57:32.667681 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3716924d-dedf-4234-8189-a9416a34e70d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:32.676008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3716924d-dedf-4234-8189-a9416a34e70d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:32.718580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3716924d-dedf-4234-8189-a9416a34e70d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:32.722344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3716924d-dedf-4234-8189-a9416a34e70d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:32.723618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3716924d-dedf-4234-8189-a9416a34e70d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:32.730622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3716924d-dedf-4234-8189-a9416a34e70d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:32.732461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3716924d-dedf-4234-8189-a9416a34e70d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:32.733595 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3716924d-dedf-4234-8189-a9416a34e70d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:32.823225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75ea8ba9-d71b-44ba-bb7f-d25fb2e7cbcd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:32.826884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75ea8ba9-d71b-44ba-bb7f-d25fb2e7cbcd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:32.834763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75ea8ba9-d71b-44ba-bb7f-d25fb2e7cbcd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:32.835964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-75ea8ba9-d71b-44ba-bb7f-d25fb2e7cbcd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lazy-loading 'fault' on Instance uuid 0983070f-5877-49b6-8e6b-0a2a2471517d {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:57:32.977970 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-75ea8ba9-d71b-44ba-bb7f-d25fb2e7cbcd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:33.017887 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-75ea8ba9-d71b-44ba-bb7f-d25fb2e7cbcd tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 200 len: 1305 microversion: 2.1 time: 0.458879 Sep 07 12:57:33.019313 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2535/5123] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:32 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 1305 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:33.070601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c3656570-8e36-46de-8d7d-b3773c50c862 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:33.071860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c3656570-8e36-46de-8d7d-b3773c50c862 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d9cff1f-6cd8-4472-be56-757c5ce15956] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:33.092851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3656570-8e36-46de-8d7d-b3773c50c862 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:33.093964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3656570-8e36-46de-8d7d-b3773c50c862 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:33.099381 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3656570-8e36-46de-8d7d-b3773c50c862 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:33.108611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3656570-8e36-46de-8d7d-b3773c50c862 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:33.109686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3656570-8e36-46de-8d7d-b3773c50c862 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:33.110332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c3656570-8e36-46de-8d7d-b3773c50c862 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:33.401874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3716924d-dedf-4234-8189-a9416a34e70d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:33.417133 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3716924d-dedf-4234-8189-a9416a34e70d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1724 microversion: 2.1 time: 0.779685 Sep 07 12:57:33.418006 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2589/5124] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:32 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1724 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:33.578329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c3656570-8e36-46de-8d7d-b3773c50c862 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:33.588600 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c3656570-8e36-46de-8d7d-b3773c50c862 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956" status: 200 len: 1497 microversion: 2.1 time: 0.552015 Sep 07 12:57:33.590914 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2536/5125] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:33 2022] GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956 => generated 1497 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:33.679431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-44327fa2-44a8-4929-b210-6248b9e7ad05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:33.680890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-44327fa2-44a8-4929-b210-6248b9e7ad05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:33.694253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44327fa2-44a8-4929-b210-6248b9e7ad05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:33.694792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44327fa2-44a8-4929-b210-6248b9e7ad05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:33.702541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44327fa2-44a8-4929-b210-6248b9e7ad05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:33.703663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44327fa2-44a8-4929-b210-6248b9e7ad05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:33.704283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44327fa2-44a8-4929-b210-6248b9e7ad05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:33.704765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44327fa2-44a8-4929-b210-6248b9e7ad05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:34.071254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5f9ceb83-d6e9-4c22-b6e2-9dd62b78e090 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:34.072425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5f9ceb83-d6e9-4c22-b6e2-9dd62b78e090 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: 0983070f-5877-49b6-8e6b-0a2a2471517d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:34.084396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f9ceb83-d6e9-4c22-b6e2-9dd62b78e090 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:34.090922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f9ceb83-d6e9-4c22-b6e2-9dd62b78e090 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:34.094445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f9ceb83-d6e9-4c22-b6e2-9dd62b78e090 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:34.099985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f9ceb83-d6e9-4c22-b6e2-9dd62b78e090 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:34.100815 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f9ceb83-d6e9-4c22-b6e2-9dd62b78e090 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:34.102634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f9ceb83-d6e9-4c22-b6e2-9dd62b78e090 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:34.147645 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-5f9ceb83-d6e9-4c22-b6e2-9dd62b78e090 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] HTTP exception thrown: Instance 0983070f-5877-49b6-8e6b-0a2a2471517d could not be found. Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5f9ceb83-d6e9-4c22-b6e2-9dd62b78e090 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Request method failure captured: Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d HTTP/1.1 Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJIYLgiUrD1FdG9a7jmdNUMsZflZ3IWVyV8jqJSyV7T-w7h1XqCWsHPlozQTxQ2SU2jPLptx_fK_PvA-9nGk2l4mDj334XTiP3wjCP9pCC7M8WLyWD7z_wyZ-hqyLowt8RL_r5UCBhe13xhmSDGs-ilkA2aO2hODHauJwGHwZVM1f9E Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: af1de494abea4aa7841c00fb199e8aec Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerActionsTestJSON-835038512 Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/af1de494abea4aa7841c00fb199e8aec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_af1de494abea4aa7841c00fb199e8aec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/af1de494abea4aa7841c00fb199e8aec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/af1de494abea4aa7841c00fb199e8aec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerActionsTestJSON-835038512 Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: af1de494abea4aa7841c00fb199e8aec Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerActionsTestJSON-835038512 Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerActionsTestJSON-835038512-project Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 22ec4509710f446d843f6882120c5d6e Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerActionsTestJSON-835038512-project Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 0983070f-5877-49b6-8e6b-0a2a2471517d could not be found. Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '0983070f-5877-49b6-8e6b-0a2a2471517d'} Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0983070f-5877-49b6-8e6b-0a2a2471517d could not be found. Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0983070f-5877-49b6-8e6b-0a2a2471517d could not be found. Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:57:34.151734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:57:34.164140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:34.164140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:57:34.164140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:57:34.164140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:57:34.164140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:57:34.164140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0983070f-5877-49b6-8e6b-0a2a2471517d could not be found. Sep 07 12:57:34.164140 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:57:34.164140 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5f9ceb83-d6e9-4c22-b6e2-9dd62b78e090 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Returning 404 to user: Instance 0983070f-5877-49b6-8e6b-0a2a2471517d could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:57:34.164140 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5f9ceb83-d6e9-4c22-b6e2-9dd62b78e090 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d" status: 404 len: 111 microversion: 2.1 time: 0.088831 Sep 07 12:57:34.166988 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2537/5126] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:34 2022] GET /compute/v2.1/servers/0983070f-5877-49b6-8e6b-0a2a2471517d => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:57:34.173411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-94b9ad91-0ce1-4d5b-a376-f9cf4d503e75 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:34.173966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-94b9ad91-0ce1-4d5b-a376-f9cf4d503e75 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:34.197836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94b9ad91-0ce1-4d5b-a376-f9cf4d503e75 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:34.198339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94b9ad91-0ce1-4d5b-a376-f9cf4d503e75 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:34.204765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94b9ad91-0ce1-4d5b-a376-f9cf4d503e75 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:34.206500 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94b9ad91-0ce1-4d5b-a376-f9cf4d503e75 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:34.209269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94b9ad91-0ce1-4d5b-a376-f9cf4d503e75 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:34.214346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94b9ad91-0ce1-4d5b-a376-f9cf4d503e75 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:34.271813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-94b9ad91-0ce1-4d5b-a376-f9cf4d503e75 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:57:34.556856 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-94b9ad91-0ce1-4d5b-a376-f9cf4d503e75 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "DELETE /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 204 len: 0 microversion: 2.1 time: 0.388034 Sep 07 12:57:34.565317 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2538/5127] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:57:34 2022] DELETE /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:57:34.580294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c470df3e-de70-481c-a6fd-89993a28494f tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:34.582988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c470df3e-de70-481c-a6fd-89993a28494f tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:34.596930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c470df3e-de70-481c-a6fd-89993a28494f tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:34.601004 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c470df3e-de70-481c-a6fd-89993a28494f tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:34.605195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c470df3e-de70-481c-a6fd-89993a28494f tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:34.610504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c470df3e-de70-481c-a6fd-89993a28494f tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:34.612603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c470df3e-de70-481c-a6fd-89993a28494f tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:34.615595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c470df3e-de70-481c-a6fd-89993a28494f tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:34.872032 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-44327fa2-44a8-4929-b210-6248b9e7ad05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:34.892091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-44327fa2-44a8-4929-b210-6248b9e7ad05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:34.897813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-44327fa2-44a8-4929-b210-6248b9e7ad05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:34.901185 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-44327fa2-44a8-4929-b210-6248b9e7ad05 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1737 microversion: 2.20 time: 1.224702 Sep 07 12:57:34.902470 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2590/5128] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:57:33 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1737 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:57:34.912679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1401d337-e7d3-448c-8a74-46be3a8d68c8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:34.924370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1401d337-e7d3-448c-8a74-46be3a8d68c8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:34.928938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:34.945615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1401d337-e7d3-448c-8a74-46be3a8d68c8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:34.952306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1401d337-e7d3-448c-8a74-46be3a8d68c8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:34.954523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1401d337-e7d3-448c-8a74-46be3a8d68c8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:34.955935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1401d337-e7d3-448c-8a74-46be3a8d68c8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:34.958147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1401d337-e7d3-448c-8a74-46be3a8d68c8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:34.961111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1401d337-e7d3-448c-8a74-46be3a8d68c8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:35.083939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c470df3e-de70-481c-a6fd-89993a28494f tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:35.098168 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c470df3e-de70-481c-a6fd-89993a28494f tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1724 microversion: 2.1 time: 0.529849 Sep 07 12:57:35.116293 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2539/5129] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:34 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1724 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:35.150523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1be2c852-ee3d-4107-9b0f-c01b3e972122 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:35.151191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1be2c852-ee3d-4107-9b0f-c01b3e972122 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d9cff1f-6cd8-4472-be56-757c5ce15956] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:35.172546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1be2c852-ee3d-4107-9b0f-c01b3e972122 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:35.173109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1be2c852-ee3d-4107-9b0f-c01b3e972122 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:35.173745 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1be2c852-ee3d-4107-9b0f-c01b3e972122 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:35.174562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1be2c852-ee3d-4107-9b0f-c01b3e972122 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:35.175052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1be2c852-ee3d-4107-9b0f-c01b3e972122 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:35.181836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1be2c852-ee3d-4107-9b0f-c01b3e972122 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:36.126517 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1401d337-e7d3-448c-8a74-46be3a8d68c8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:36.148961 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1401d337-e7d3-448c-8a74-46be3a8d68c8 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1675 microversion: 2.1 time: 1.241069 Sep 07 12:57:36.151954 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2591/5130] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:34 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1675 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:36.167599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4f4c3b87-fccf-4ef6-be74-b7a4fb9f8195 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:36.172494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4f4c3b87-fccf-4ef6-be74-b7a4fb9f8195 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:36.207621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f4c3b87-fccf-4ef6-be74-b7a4fb9f8195 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:36.208285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f4c3b87-fccf-4ef6-be74-b7a4fb9f8195 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:36.209799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f4c3b87-fccf-4ef6-be74-b7a4fb9f8195 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:36.210635 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f4c3b87-fccf-4ef6-be74-b7a4fb9f8195 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:36.211521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f4c3b87-fccf-4ef6-be74-b7a4fb9f8195 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:36.212052 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f4c3b87-fccf-4ef6-be74-b7a4fb9f8195 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:36.233827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1be2c852-ee3d-4107-9b0f-c01b3e972122 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:36.248333 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1be2c852-ee3d-4107-9b0f-c01b3e972122 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956" status: 200 len: 1497 microversion: 2.1 time: 1.103055 Sep 07 12:57:36.252793 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2540/5131] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:35 2022] GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956 => generated 1497 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:36.269853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-98372935-cde3-4ec4-9a3b-1bcb1361f623 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:36.270570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-98372935-cde3-4ec4-9a3b-1bcb1361f623 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:36.311186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98372935-cde3-4ec4-9a3b-1bcb1361f623 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:36.312095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98372935-cde3-4ec4-9a3b-1bcb1361f623 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:36.313317 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98372935-cde3-4ec4-9a3b-1bcb1361f623 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:36.314353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98372935-cde3-4ec4-9a3b-1bcb1361f623 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:36.315054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98372935-cde3-4ec4-9a3b-1bcb1361f623 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:36.315706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98372935-cde3-4ec4-9a3b-1bcb1361f623 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:36.659099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-98372935-cde3-4ec4-9a3b-1bcb1361f623 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:36.672537 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-98372935-cde3-4ec4-9a3b-1bcb1361f623 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1724 microversion: 2.1 time: 0.418339 Sep 07 12:57:36.678762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4f4c3b87-fccf-4ef6-be74-b7a4fb9f8195 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:36.683516 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2541/5132] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:36 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1724 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:36.740445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4f4c3b87-fccf-4ef6-be74-b7a4fb9f8195 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:36.757774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4f4c3b87-fccf-4ef6-be74-b7a4fb9f8195 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:36.760385 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4f4c3b87-fccf-4ef6-be74-b7a4fb9f8195 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1737 microversion: 2.20 time: 0.606356 Sep 07 12:57:36.767355 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2592/5133] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:57:36 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1737 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:57:37.210640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e6bfa0e-0c02-4ae2-b9e5-e57d643e42bc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:37.212403 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6e6bfa0e-0c02-4ae2-b9e5-e57d643e42bc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:37.250037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e6bfa0e-0c02-4ae2-b9e5-e57d643e42bc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:37.251053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e6bfa0e-0c02-4ae2-b9e5-e57d643e42bc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:37.252894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e6bfa0e-0c02-4ae2-b9e5-e57d643e42bc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:37.266563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e6bfa0e-0c02-4ae2-b9e5-e57d643e42bc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:37.267436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e6bfa0e-0c02-4ae2-b9e5-e57d643e42bc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:37.268232 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e6bfa0e-0c02-4ae2-b9e5-e57d643e42bc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:37.296049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-161652ef-43e1-46ec-9c79-e3c9adea48d3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:37.305007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-161652ef-43e1-46ec-9c79-e3c9adea48d3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d9cff1f-6cd8-4472-be56-757c5ce15956] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:37.352299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-161652ef-43e1-46ec-9c79-e3c9adea48d3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:37.354257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-161652ef-43e1-46ec-9c79-e3c9adea48d3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:37.375727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-161652ef-43e1-46ec-9c79-e3c9adea48d3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:37.377259 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-161652ef-43e1-46ec-9c79-e3c9adea48d3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:37.384707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-161652ef-43e1-46ec-9c79-e3c9adea48d3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:37.385635 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-161652ef-43e1-46ec-9c79-e3c9adea48d3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:37.516999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:38.498711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6e6bfa0e-0c02-4ae2-b9e5-e57d643e42bc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:38.543334 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6e6bfa0e-0c02-4ae2-b9e5-e57d643e42bc tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1675 microversion: 2.1 time: 1.337557 Sep 07 12:57:38.545965 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2542/5134] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:37 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1675 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:38.633412 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c5751579-32f0-45b2-9c2b-9e2c9481c4e8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:38.635005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c5751579-32f0-45b2-9c2b-9e2c9481c4e8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:38.665565 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5751579-32f0-45b2-9c2b-9e2c9481c4e8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:38.666596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5751579-32f0-45b2-9c2b-9e2c9481c4e8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:38.668044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5751579-32f0-45b2-9c2b-9e2c9481c4e8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:38.669681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5751579-32f0-45b2-9c2b-9e2c9481c4e8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:38.675427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5751579-32f0-45b2-9c2b-9e2c9481c4e8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:38.676314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5751579-32f0-45b2-9c2b-9e2c9481c4e8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:38.729465 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-161652ef-43e1-46ec-9c79-e3c9adea48d3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:38.769390 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-161652ef-43e1-46ec-9c79-e3c9adea48d3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956" status: 200 len: 1497 microversion: 2.1 time: 1.479989 Sep 07 12:57:38.784694 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2593/5135] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:37 2022] GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956 => generated 1497 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:38.809695 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c1116a51-a203-47f2-8f93-a4e5ad110ffc tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:38.820487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c1116a51-a203-47f2-8f93-a4e5ad110ffc tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:38.852475 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1116a51-a203-47f2-8f93-a4e5ad110ffc tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:38.856011 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1116a51-a203-47f2-8f93-a4e5ad110ffc tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:38.857436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1116a51-a203-47f2-8f93-a4e5ad110ffc tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:38.859517 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1116a51-a203-47f2-8f93-a4e5ad110ffc tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:38.861477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1116a51-a203-47f2-8f93-a4e5ad110ffc tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:38.866296 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1116a51-a203-47f2-8f93-a4e5ad110ffc tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:40.885021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c5751579-32f0-45b2-9c2b-9e2c9481c4e8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:40.968934 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c5751579-32f0-45b2-9c2b-9e2c9481c4e8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1724 microversion: 2.1 time: 2.342466 Sep 07 12:57:41.017469 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2543/5136] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:38 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1724 bytes in 2414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:41.078077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-10c886c3-6fe8-4cc2-92b2-e8feaa5f54fe tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:41.086327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-10c886c3-6fe8-4cc2-92b2-e8feaa5f54fe tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:41.137330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10c886c3-6fe8-4cc2-92b2-e8feaa5f54fe tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:41.139019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10c886c3-6fe8-4cc2-92b2-e8feaa5f54fe tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:41.141882 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10c886c3-6fe8-4cc2-92b2-e8feaa5f54fe tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:41.160908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10c886c3-6fe8-4cc2-92b2-e8feaa5f54fe tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:41.162308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10c886c3-6fe8-4cc2-92b2-e8feaa5f54fe tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:41.169918 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-10c886c3-6fe8-4cc2-92b2-e8feaa5f54fe tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:41.307131 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c1116a51-a203-47f2-8f93-a4e5ad110ffc tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:41.343286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c1116a51-a203-47f2-8f93-a4e5ad110ffc tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:41.348333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c1116a51-a203-47f2-8f93-a4e5ad110ffc tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:41.354399 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c1116a51-a203-47f2-8f93-a4e5ad110ffc tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1737 microversion: 2.20 time: 2.567328 Sep 07 12:57:41.375277 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2594/5137] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:57:38 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1737 bytes in 2590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:57:41.410681 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-95b7e7bb-94e3-4f71-b3ea-95c580af7bba tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:41.434862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-95b7e7bb-94e3-4f71-b3ea-95c580af7bba tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d9cff1f-6cd8-4472-be56-757c5ce15956] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:41.482924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95b7e7bb-94e3-4f71-b3ea-95c580af7bba tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:41.503162 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95b7e7bb-94e3-4f71-b3ea-95c580af7bba tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:41.504551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95b7e7bb-94e3-4f71-b3ea-95c580af7bba tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:41.516934 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95b7e7bb-94e3-4f71-b3ea-95c580af7bba tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:41.522670 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95b7e7bb-94e3-4f71-b3ea-95c580af7bba tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:41.534929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95b7e7bb-94e3-4f71-b3ea-95c580af7bba tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:41.577089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-10c886c3-6fe8-4cc2-92b2-e8feaa5f54fe tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ec4509710f446d843f6882120c5d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1de494abea4aa7841c00fb199e8aec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:41.609931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:41.652703 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-10c886c3-6fe8-4cc2-92b2-e8feaa5f54fe tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 200 len: 1607 microversion: 2.1 time: 0.617887 Sep 07 12:57:41.658620 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2544/5138] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:41 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 1607 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:41.701243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-87b4d756-199b-4531-9c7d-d5b9fe7924ca req-7ab5d209-c4cb-46f2-802b-363311e17874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d9cff1f-6cd8-4472-be56-757c5ce15956", "name": "network-vif-deleted", "tag": "760c1473-9e94-40f1-8783-916905448982"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:57:41.785286 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-87b4d756-199b-4531-9c7d-d5b9fe7924ca req-7ab5d209-c4cb-46f2-802b-363311e17874 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:41.788342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-87b4d756-199b-4531-9c7d-d5b9fe7924ca req-7ab5d209-c4cb-46f2-802b-363311e17874 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:41.792402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95b7e7bb-94e3-4f71-b3ea-95c580af7bba tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:41.793357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95b7e7bb-94e3-4f71-b3ea-95c580af7bba tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:41.794184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95b7e7bb-94e3-4f71-b3ea-95c580af7bba tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:41.795509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-95b7e7bb-94e3-4f71-b3ea-95c580af7bba tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lazy-loading 'fault' on Instance uuid 7d9cff1f-6cd8-4472-be56-757c5ce15956 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:57:41.797254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-87b4d756-199b-4531-9c7d-d5b9fe7924ca req-7ab5d209-c4cb-46f2-802b-363311e17874 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:41.876451 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-87b4d756-199b-4531-9c7d-d5b9fe7924ca req-7ab5d209-c4cb-46f2-802b-363311e17874 service nova] Creating event network-vif-deleted:760c1473-9e94-40f1-8783-916905448982 for instance 7d9cff1f-6cd8-4472-be56-757c5ce15956 on n-h1-852087-9 Sep 07 12:57:41.896390 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-87b4d756-199b-4531-9c7d-d5b9fe7924ca req-7ab5d209-c4cb-46f2-802b-363311e17874 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.232290 Sep 07 12:57:41.899932 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2545/5139] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:57:42.027564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-af527912-3cd5-4577-8d6f-f68d5d0d9edd tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:42.028661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-af527912-3cd5-4577-8d6f-f68d5d0d9edd tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:42.092756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af527912-3cd5-4577-8d6f-f68d5d0d9edd tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:42.098131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af527912-3cd5-4577-8d6f-f68d5d0d9edd tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:42.102406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af527912-3cd5-4577-8d6f-f68d5d0d9edd tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:42.111890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-95b7e7bb-94e3-4f71-b3ea-95c580af7bba tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:42.121711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af527912-3cd5-4577-8d6f-f68d5d0d9edd tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:42.123238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af527912-3cd5-4577-8d6f-f68d5d0d9edd tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:42.127351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af527912-3cd5-4577-8d6f-f68d5d0d9edd tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:42.168115 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-95b7e7bb-94e3-4f71-b3ea-95c580af7bba tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956" status: 200 len: 1299 microversion: 2.1 time: 0.776712 Sep 07 12:57:42.171126 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2595/5140] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:41 2022] GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956 => generated 1299 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:42.396307 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a7193fea-c8dd-4a08-826b-7e873a5b7ba5 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:42.406267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a7193fea-c8dd-4a08-826b-7e873a5b7ba5 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:42.433896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7193fea-c8dd-4a08-826b-7e873a5b7ba5 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:42.435111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7193fea-c8dd-4a08-826b-7e873a5b7ba5 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:42.439852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7193fea-c8dd-4a08-826b-7e873a5b7ba5 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:42.442509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7193fea-c8dd-4a08-826b-7e873a5b7ba5 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:42.448730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7193fea-c8dd-4a08-826b-7e873a5b7ba5 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:42.449863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7193fea-c8dd-4a08-826b-7e873a5b7ba5 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:44.005445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a7193fea-c8dd-4a08-826b-7e873a5b7ba5 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:44.051335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a7193fea-c8dd-4a08-826b-7e873a5b7ba5 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:44.060474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a7193fea-c8dd-4a08-826b-7e873a5b7ba5 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:44.067951 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a7193fea-c8dd-4a08-826b-7e873a5b7ba5 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1737 microversion: 2.20 time: 1.679469 Sep 07 12:57:44.073944 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2596/5141] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:57:42 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1737 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:57:44.101253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-739e593b-ec0b-4af4-b2d4-ed3e7445e1a1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:44.104786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-739e593b-ec0b-4af4-b2d4-ed3e7445e1a1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] [instance: edf38c92-ffc2-492b-8642-88ca59537acd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:44.131672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-739e593b-ec0b-4af4-b2d4-ed3e7445e1a1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:44.136674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-739e593b-ec0b-4af4-b2d4-ed3e7445e1a1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:44.139068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-739e593b-ec0b-4af4-b2d4-ed3e7445e1a1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:44.143513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-af527912-3cd5-4577-8d6f-f68d5d0d9edd tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:44.144477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-739e593b-ec0b-4af4-b2d4-ed3e7445e1a1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:44.146950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-739e593b-ec0b-4af4-b2d4-ed3e7445e1a1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:44.150013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-739e593b-ec0b-4af4-b2d4-ed3e7445e1a1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:44.169920 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-af527912-3cd5-4577-8d6f-f68d5d0d9edd tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1701 microversion: 2.1 time: 2.153219 Sep 07 12:57:44.186315 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2546/5142] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:42 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1701 bytes in 2171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:44.211717 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-739e593b-ec0b-4af4-b2d4-ed3e7445e1a1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] HTTP exception thrown: Instance edf38c92-ffc2-492b-8642-88ca59537acd could not be found. Sep 07 12:57:44.214732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cb05a5ee-aba8-4e17-808a-bd4643181c24 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:44.215430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cb05a5ee-aba8-4e17-808a-bd4643181c24 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d9cff1f-6cd8-4472-be56-757c5ce15956] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-739e593b-ec0b-4af4-b2d4-ed3e7445e1a1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Request method failure captured: Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd HTTP/1.1 Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJIYLgiUrD1FdG9a7jmdNUMsZflZ3IWVyV8jqJSyV7T-w7h1XqCWsHPlozQTxQ2SU2jPLptx_fK_PvA-9nGk2l4mDj334XTiP3wjCP9pCC7M8WLyWD7z_wyZ-hqyLowt8RL_r5UCBhe13xhmSDGs-ilkA2aO2hODHauJwGHwZVM1f9E Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: af1de494abea4aa7841c00fb199e8aec Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerActionsTestJSON-835038512 Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/af1de494abea4aa7841c00fb199e8aec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_af1de494abea4aa7841c00fb199e8aec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/af1de494abea4aa7841c00fb199e8aec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/af1de494abea4aa7841c00fb199e8aec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerActionsTestJSON-835038512 Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: af1de494abea4aa7841c00fb199e8aec Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerActionsTestJSON-835038512 Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerActionsTestJSON-835038512-project Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 22ec4509710f446d843f6882120c5d6e Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerActionsTestJSON-835038512-project Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance edf38c92-ffc2-492b-8642-88ca59537acd could not be found. Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'edf38c92-ffc2-492b-8642-88ca59537acd'} Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edf38c92-ffc2-492b-8642-88ca59537acd could not be found. Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edf38c92-ffc2-492b-8642-88ca59537acd could not be found. Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:57:44.239562 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:44.251280 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:44.251280 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:57:44.251280 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:57:44.251280 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:57:44.251280 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:57:44.251280 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edf38c92-ffc2-492b-8642-88ca59537acd could not be found. Sep 07 12:57:44.251280 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:44.251280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-739e593b-ec0b-4af4-b2d4-ed3e7445e1a1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Returning 404 to user: Instance edf38c92-ffc2-492b-8642-88ca59537acd could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:57:44.251280 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-739e593b-ec0b-4af4-b2d4-ed3e7445e1a1 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd" status: 404 len: 111 microversion: 2.1 time: 0.162541 Sep 07 12:57:44.260020 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2597/5143] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:44 2022] GET /compute/v2.1/servers/edf38c92-ffc2-492b-8642-88ca59537acd => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:57:44.264347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb05a5ee-aba8-4e17-808a-bd4643181c24 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:44.269181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb05a5ee-aba8-4e17-808a-bd4643181c24 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:44.270066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb05a5ee-aba8-4e17-808a-bd4643181c24 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:44.270926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb05a5ee-aba8-4e17-808a-bd4643181c24 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:44.281094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb05a5ee-aba8-4e17-808a-bd4643181c24 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:44.284091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb05a5ee-aba8-4e17-808a-bd4643181c24 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:44.298420 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-15c25b86-f4e6-4704-824a-560ad02fdf24 req-365f5951-67b2-4882-93a8-24cdc419cd5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edf38c92-ffc2-492b-8642-88ca59537acd", "name": "network-vif-deleted", "tag": "23b18fbd-594f-42e0-a655-6b5f01607b28"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:57:44.340042 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-cb05a5ee-aba8-4e17-808a-bd4643181c24 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] HTTP exception thrown: Instance 7d9cff1f-6cd8-4472-be56-757c5ce15956 could not be found. Sep 07 12:57:44.352513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-15c25b86-f4e6-4704-824a-560ad02fdf24 req-365f5951-67b2-4882-93a8-24cdc419cd5c service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:44.353474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-15c25b86-f4e6-4704-824a-560ad02fdf24 req-365f5951-67b2-4882-93a8-24cdc419cd5c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:44.359306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-15c25b86-f4e6-4704-824a-560ad02fdf24 req-365f5951-67b2-4882-93a8-24cdc419cd5c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cb05a5ee-aba8-4e17-808a-bd4643181c24 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Request method failure captured: Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956 HTTP/1.1 Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJSE5qt3MMvCiXM6JMYUN7f1buxIi7ST_NSWH8b3Iy1XPUp8KO4zG-NXQgWVN1Z7GE3sHXszWiKCVOYqqXwQROrdr4ZEFwz_8XPZaHXiJBQID0HYLx7sZ_BMJTKC5v-6tuUaVizJ_CnloOe2V1xTk5bkZGekyl16F75E8fKcPIskPJo Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestJSON-553840835 Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestJSON-553840835 Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestJSON-553840835 Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersTestJSON-553840835-project Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6ac786dc6d7847f582262dcd912c3f06 Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestJSON-553840835-project Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 7d9cff1f-6cd8-4472-be56-757c5ce15956 could not be found. Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '7d9cff1f-6cd8-4472-be56-757c5ce15956'} Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d9cff1f-6cd8-4472-be56-757c5ce15956 could not be found. Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d9cff1f-6cd8-4472-be56-757c5ce15956 could not be found. Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:57:44.365266 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:44.369402 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:57:44.369402 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:57:44.369402 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:57:44.369402 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:57:44.369402 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d9cff1f-6cd8-4472-be56-757c5ce15956 could not be found. Sep 07 12:57:44.369402 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:57:44.372621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cb05a5ee-aba8-4e17-808a-bd4643181c24 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Returning 404 to user: Instance 7d9cff1f-6cd8-4472-be56-757c5ce15956 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:57:44.378816 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cb05a5ee-aba8-4e17-808a-bd4643181c24 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956" status: 404 len: 111 microversion: 2.1 time: 0.186806 Sep 07 12:57:44.390534 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2547/5144] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:44 2022] GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:57:44.407202 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-15c25b86-f4e6-4704-824a-560ad02fdf24 req-365f5951-67b2-4882-93a8-24cdc419cd5c service nova] Creating event network-vif-deleted:23b18fbd-594f-42e0-a655-6b5f01607b28 for instance edf38c92-ffc2-492b-8642-88ca59537acd on n-h1-852087-9 Sep 07 12:57:44.412278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7afa8b7e-e07d-45b7-a1c5-6ec3201beafe tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:57:44.428254 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-15c25b86-f4e6-4704-824a-560ad02fdf24 req-365f5951-67b2-4882-93a8-24cdc419cd5c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166775 Sep 07 12:57:44.438939 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2598/5145] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:57:44.452699 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7afa8b7e-e07d-45b7-a1c5-6ec3201beafe tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:44.452699 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7afa8b7e-e07d-45b7-a1c5-6ec3201beafe tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:44.453173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7afa8b7e-e07d-45b7-a1c5-6ec3201beafe tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:44.459469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf3b5723-6048-4d9d-9b05-7975fc0302d2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] Calling method '.version_select at 0x7fc418260e50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:44.564282 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cf3b5723-6048-4d9d-9b05-7975fc0302d2 tempest-ServerActionsTestJSON-835038512 tempest-ServerActionsTestJSON-835038512-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1673796667" status: 202 len: 0 microversion: 2.1 time: 0.123279 Sep 07 12:57:44.565329 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2599/5146] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Sep 7 12:57:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1673796667 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:57:44.623539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-14ca7445-988f-40ea-8792-c299295201eb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:44.624695 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-14ca7445-988f-40ea-8792-c299295201eb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d870ac2-825e-4d5b-825b-fcc194138508] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:44.629855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7afa8b7e-e07d-45b7-a1c5-6ec3201beafe tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Going to try to start instance {{(pid=122432) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 12:57:44.676824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ca7445-988f-40ea-8792-c299295201eb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:44.694921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ca7445-988f-40ea-8792-c299295201eb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:44.696269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ca7445-988f-40ea-8792-c299295201eb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:44.699985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ca7445-988f-40ea-8792-c299295201eb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:44.711186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ca7445-988f-40ea-8792-c299295201eb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:44.711967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ca7445-988f-40ea-8792-c299295201eb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:44.819441 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7afa8b7e-e07d-45b7-a1c5-6ec3201beafe tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "POST /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef/action" status: 202 len: 0 microversion: 2.1 time: 0.424816 Sep 07 12:57:44.822831 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2548/5147] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:57:44 2022] POST /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:57:44.858483 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-43229c4a-0cda-4b45-bed5-571471cc3648 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:44.862009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-43229c4a-0cda-4b45-bed5-571471cc3648 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:44.913377 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43229c4a-0cda-4b45-bed5-571471cc3648 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:44.914498 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43229c4a-0cda-4b45-bed5-571471cc3648 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:44.917473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43229c4a-0cda-4b45-bed5-571471cc3648 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:44.921105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43229c4a-0cda-4b45-bed5-571471cc3648 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:44.922124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43229c4a-0cda-4b45-bed5-571471cc3648 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:44.922745 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43229c4a-0cda-4b45-bed5-571471cc3648 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:44.945768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-14ca7445-988f-40ea-8792-c299295201eb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d870ac2-825e-4d5b-825b-fcc194138508] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:57:45.234096 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-14ca7445-988f-40ea-8792-c299295201eb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508" status: 204 len: 0 microversion: 2.1 time: 0.653781 Sep 07 12:57:45.249520 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2600/5148] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:57:44 2022] DELETE /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:57:45.284542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-052f938c-5dc1-4fd5-9ba4-a303e933df7a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:45.286096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-052f938c-5dc1-4fd5-9ba4-a303e933df7a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:45.348688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-052f938c-5dc1-4fd5-9ba4-a303e933df7a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:45.352884 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-052f938c-5dc1-4fd5-9ba4-a303e933df7a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:45.353892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-052f938c-5dc1-4fd5-9ba4-a303e933df7a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:45.363813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-052f938c-5dc1-4fd5-9ba4-a303e933df7a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:45.364920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-052f938c-5dc1-4fd5-9ba4-a303e933df7a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:45.367924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-052f938c-5dc1-4fd5-9ba4-a303e933df7a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:46.133358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-43229c4a-0cda-4b45-bed5-571471cc3648 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:46.150985 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-43229c4a-0cda-4b45-bed5-571471cc3648 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1710 microversion: 2.1 time: 1.311981 Sep 07 12:57:46.154355 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2549/5149] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:44 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1710 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:46.167088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5f4ea135-a81c-4589-990b-616be662692e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:46.169473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5f4ea135-a81c-4589-990b-616be662692e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d870ac2-825e-4d5b-825b-fcc194138508] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:46.189187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f4ea135-a81c-4589-990b-616be662692e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:46.190173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f4ea135-a81c-4589-990b-616be662692e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:46.190882 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f4ea135-a81c-4589-990b-616be662692e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:46.191910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f4ea135-a81c-4589-990b-616be662692e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:46.192745 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f4ea135-a81c-4589-990b-616be662692e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:46.193820 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f4ea135-a81c-4589-990b-616be662692e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:46.317789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-052f938c-5dc1-4fd5-9ba4-a303e933df7a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:46.335945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-052f938c-5dc1-4fd5-9ba4-a303e933df7a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:46.338327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-052f938c-5dc1-4fd5-9ba4-a303e933df7a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:46.341263 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-052f938c-5dc1-4fd5-9ba4-a303e933df7a tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1737 microversion: 2.20 time: 1.089758 Sep 07 12:57:46.359782 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2601/5150] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:57:45 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1737 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:57:47.105816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5f4ea135-a81c-4589-990b-616be662692e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:47.138226 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5f4ea135-a81c-4589-990b-616be662692e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508" status: 200 len: 1496 microversion: 2.1 time: 0.981006 Sep 07 12:57:47.142740 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2550/5151] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:46 2022] GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508 => generated 1496 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:47.203089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fc6778a0-852d-462a-88ea-f22a30161df5 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:47.211102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fc6778a0-852d-462a-88ea-f22a30161df5 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:47.238055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc6778a0-852d-462a-88ea-f22a30161df5 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:47.241776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc6778a0-852d-462a-88ea-f22a30161df5 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:47.246430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc6778a0-852d-462a-88ea-f22a30161df5 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:47.248535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc6778a0-852d-462a-88ea-f22a30161df5 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:47.249423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc6778a0-852d-462a-88ea-f22a30161df5 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:47.251707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc6778a0-852d-462a-88ea-f22a30161df5 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:47.381697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aa9c8cd9-dc30-4f0a-bfc2-f5ecc75fe5be tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:47.382585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aa9c8cd9-dc30-4f0a-bfc2-f5ecc75fe5be tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:47.397792 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa9c8cd9-dc30-4f0a-bfc2-f5ecc75fe5be tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:47.401000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa9c8cd9-dc30-4f0a-bfc2-f5ecc75fe5be tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:47.405269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa9c8cd9-dc30-4f0a-bfc2-f5ecc75fe5be tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:47.407577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa9c8cd9-dc30-4f0a-bfc2-f5ecc75fe5be tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:47.409694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa9c8cd9-dc30-4f0a-bfc2-f5ecc75fe5be tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:47.412038 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa9c8cd9-dc30-4f0a-bfc2-f5ecc75fe5be tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:48.022391 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fc6778a0-852d-462a-88ea-f22a30161df5 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:48.059303 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fc6778a0-852d-462a-88ea-f22a30161df5 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1710 microversion: 2.1 time: 0.861542 Sep 07 12:57:48.061231 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2602/5152] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:47 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1710 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:57:48.602159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aa9c8cd9-dc30-4f0a-bfc2-f5ecc75fe5be tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:48.611326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aa9c8cd9-dc30-4f0a-bfc2-f5ecc75fe5be tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:48.612931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aa9c8cd9-dc30-4f0a-bfc2-f5ecc75fe5be tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:48.626187 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aa9c8cd9-dc30-4f0a-bfc2-f5ecc75fe5be tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1737 microversion: 2.20 time: 1.252726 Sep 07 12:57:48.633131 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2551/5153] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:57:47 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1737 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:57:48.645422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-53e2492e-5991-4db7-8c2d-e868f62c279a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:48.646124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-53e2492e-5991-4db7-8c2d-e868f62c279a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d870ac2-825e-4d5b-825b-fcc194138508] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:48.695977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53e2492e-5991-4db7-8c2d-e868f62c279a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:48.701266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53e2492e-5991-4db7-8c2d-e868f62c279a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:48.709584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53e2492e-5991-4db7-8c2d-e868f62c279a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:48.712101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53e2492e-5991-4db7-8c2d-e868f62c279a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:48.724401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53e2492e-5991-4db7-8c2d-e868f62c279a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:48.724994 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53e2492e-5991-4db7-8c2d-e868f62c279a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:48.955337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a9a2c64-a455-4adf-a276-6098bca6608e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1976104389", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "b8012bfa-56ea-4763-82cb-b03ecb769998"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:57:49.216528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-7a9a2c64-a455-4adf-a276-6098bca6608e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] validate_networks() for [('b8012bfa-56ea-4763-82cb-b03ecb769998', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:57:49.731096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-53e2492e-5991-4db7-8c2d-e868f62c279a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:49.749105 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-53e2492e-5991-4db7-8c2d-e868f62c279a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508" status: 200 len: 1496 microversion: 2.1 time: 1.112386 Sep 07 12:57:49.750248 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2552/5154] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:48 2022] GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508 => generated 1496 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:49.758973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4b6e990d-2b0c-4331-b47c-fbc9f2b02e5d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:49.778244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4b6e990d-2b0c-4331-b47c-fbc9f2b02e5d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:49.817231 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b6e990d-2b0c-4331-b47c-fbc9f2b02e5d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:49.818531 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b6e990d-2b0c-4331-b47c-fbc9f2b02e5d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:49.841427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b6e990d-2b0c-4331-b47c-fbc9f2b02e5d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:49.850359 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b6e990d-2b0c-4331-b47c-fbc9f2b02e5d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:49.855502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b6e990d-2b0c-4331-b47c-fbc9f2b02e5d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:49.862743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b6e990d-2b0c-4331-b47c-fbc9f2b02e5d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:51.409550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4b6e990d-2b0c-4331-b47c-fbc9f2b02e5d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:51.454225 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4b6e990d-2b0c-4331-b47c-fbc9f2b02e5d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1710 microversion: 2.1 time: 1.702544 Sep 07 12:57:51.478412 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2553/5155] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:49 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1710 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:51.497156 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-698da080-97ff-4dfd-960f-3ad4c966e875 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:51.499717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-698da080-97ff-4dfd-960f-3ad4c966e875 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:51.523190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-698da080-97ff-4dfd-960f-3ad4c966e875 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:51.524516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-698da080-97ff-4dfd-960f-3ad4c966e875 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:51.525429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-698da080-97ff-4dfd-960f-3ad4c966e875 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:51.526454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-698da080-97ff-4dfd-960f-3ad4c966e875 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:51.527337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-698da080-97ff-4dfd-960f-3ad4c966e875 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:51.527989 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-698da080-97ff-4dfd-960f-3ad4c966e875 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:51.768363 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-7a9a2c64-a455-4adf-a276-6098bca6608e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:57:51.770266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-7a9a2c64-a455-4adf-a276-6098bca6608e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:57:51.772175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-7a9a2c64-a455-4adf-a276-6098bca6608e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:57:51.773249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-7a9a2c64-a455-4adf-a276-6098bca6608e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:57:51.777371 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-7a9a2c64-a455-4adf-a276-6098bca6608e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:57:51.840848 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a9a2c64-a455-4adf-a276-6098bca6608e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:51.851706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a9a2c64-a455-4adf-a276-6098bca6608e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:51.852692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a9a2c64-a455-4adf-a276-6098bca6608e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:51.855513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a9a2c64-a455-4adf-a276-6098bca6608e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:51.860612 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a9a2c64-a455-4adf-a276-6098bca6608e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:51.862924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a9a2c64-a455-4adf-a276-6098bca6608e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:51.959954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-7a9a2c64-a455-4adf-a276-6098bca6608e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Getting quotas for project d519233d78e742ca8d835998527fbf2d. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:57:51.990028 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-7a9a2c64-a455-4adf-a276-6098bca6608e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Getting quotas for user 658ee744811d4061b12d8c89b1f107fa and project d519233d78e742ca8d835998527fbf2d. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:57:52.046663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7a9a2c64-a455-4adf-a276-6098bca6608e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:57:52.068533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7a9a2c64-a455-4adf-a276-6098bca6608e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] [instance: d67fed78-36e7-4fbb-b165-823e47708ae4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:57:52.320665 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7a9a2c64-a455-4adf-a276-6098bca6608e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.257281 Sep 07 12:57:52.324196 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2603/5156] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:57:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 4262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:57:52.331901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3f290399-fc58-42a6-b4b9-8dff9dc88ac4 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:52.333418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3f290399-fc58-42a6-b4b9-8dff9dc88ac4 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d870ac2-825e-4d5b-825b-fcc194138508] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:52.365669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f290399-fc58-42a6-b4b9-8dff9dc88ac4 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:52.366693 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f290399-fc58-42a6-b4b9-8dff9dc88ac4 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:52.370878 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f290399-fc58-42a6-b4b9-8dff9dc88ac4 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:52.372014 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f290399-fc58-42a6-b4b9-8dff9dc88ac4 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:52.377463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f290399-fc58-42a6-b4b9-8dff9dc88ac4 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:52.379137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f290399-fc58-42a6-b4b9-8dff9dc88ac4 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:52.502278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-698da080-97ff-4dfd-960f-3ad4c966e875 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:52.522798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f290399-fc58-42a6-b4b9-8dff9dc88ac4 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:52.531824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f290399-fc58-42a6-b4b9-8dff9dc88ac4 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:52.534685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-698da080-97ff-4dfd-960f-3ad4c966e875 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:52.534989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f290399-fc58-42a6-b4b9-8dff9dc88ac4 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:52.535352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-3f290399-fc58-42a6-b4b9-8dff9dc88ac4 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lazy-loading 'fault' on Instance uuid 7d870ac2-825e-4d5b-825b-fcc194138508 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:57:52.545216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-698da080-97ff-4dfd-960f-3ad4c966e875 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:52.551185 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-698da080-97ff-4dfd-960f-3ad4c966e875 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1737 microversion: 2.20 time: 1.068601 Sep 07 12:57:52.557213 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2554/5157] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:57:51 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1737 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:57:52.570881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-fd62be73-2b35-4064-b51f-4b87ddc57ead req-87a548df-8c49-4635-b1bf-e7ae1eb063b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d870ac2-825e-4d5b-825b-fcc194138508", "name": "network-vif-deleted", "tag": "5f3edcd8-420a-40d3-8325-b00f4f96f637"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:57:52.645582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fd62be73-2b35-4064-b51f-4b87ddc57ead req-87a548df-8c49-4635-b1bf-e7ae1eb063b8 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:52.655845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fd62be73-2b35-4064-b51f-4b87ddc57ead req-87a548df-8c49-4635-b1bf-e7ae1eb063b8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:52.659156 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fd62be73-2b35-4064-b51f-4b87ddc57ead req-87a548df-8c49-4635-b1bf-e7ae1eb063b8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:52.776418 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-fd62be73-2b35-4064-b51f-4b87ddc57ead req-87a548df-8c49-4635-b1bf-e7ae1eb063b8 service nova] Creating event network-vif-deleted:5f3edcd8-420a-40d3-8325-b00f4f96f637 for instance 7d870ac2-825e-4d5b-825b-fcc194138508 on n-h2-852087-9 Sep 07 12:57:52.803415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3f290399-fc58-42a6-b4b9-8dff9dc88ac4 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:52.809116 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-fd62be73-2b35-4064-b51f-4b87ddc57ead req-87a548df-8c49-4635-b1bf-e7ae1eb063b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.247635 Sep 07 12:57:52.826572 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3f290399-fc58-42a6-b4b9-8dff9dc88ac4 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508" status: 200 len: 1299 microversion: 2.1 time: 0.495627 Sep 07 12:57:52.827285 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2555/5158] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:57:52.830176 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2604/5159] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:52 2022] GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508 => generated 1299 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:52.841887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-96b439a9-e819-4ddb-b0d6-90c43ba4aebf tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:52.841887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-96b439a9-e819-4ddb-b0d6-90c43ba4aebf tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] [instance: d67fed78-36e7-4fbb-b165-823e47708ae4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:52.875642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-37b4bca9-df4e-42fc-857b-d5973498e3dd tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:52.881725 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-37b4bca9-df4e-42fc-857b-d5973498e3dd tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:52.910925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37b4bca9-df4e-42fc-857b-d5973498e3dd tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:52.918183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37b4bca9-df4e-42fc-857b-d5973498e3dd tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:52.923962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37b4bca9-df4e-42fc-857b-d5973498e3dd tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:52.924775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37b4bca9-df4e-42fc-857b-d5973498e3dd tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:52.935521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37b4bca9-df4e-42fc-857b-d5973498e3dd tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:52.937042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37b4bca9-df4e-42fc-857b-d5973498e3dd tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:52.962422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-96b439a9-e819-4ddb-b0d6-90c43ba4aebf tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ee744811d4061b12d8c89b1f107fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd519233d78e742ca8d835998527fbf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:52.971876 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-96b439a9-e819-4ddb-b0d6-90c43ba4aebf tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] 10.222.0.16 "GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4" status: 200 len: 1217 microversion: 2.1 time: 0.141601 Sep 07 12:57:52.971876 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2556/5160] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:52 2022] GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4 => generated 1217 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:53.566433 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-37b4bca9-df4e-42fc-857b-d5973498e3dd tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:53.579319 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-37b4bca9-df4e-42fc-857b-d5973498e3dd tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1710 microversion: 2.1 time: 0.721874 Sep 07 12:57:53.586811 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2605/5161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:52 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1710 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:53.595437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-63a536e5-4eab-493c-b6dd-fe10c8ec52b8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:53.597835 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-63a536e5-4eab-493c-b6dd-fe10c8ec52b8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:53.627247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63a536e5-4eab-493c-b6dd-fe10c8ec52b8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:53.637784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63a536e5-4eab-493c-b6dd-fe10c8ec52b8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:53.639385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63a536e5-4eab-493c-b6dd-fe10c8ec52b8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:53.642132 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63a536e5-4eab-493c-b6dd-fe10c8ec52b8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:53.642803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63a536e5-4eab-493c-b6dd-fe10c8ec52b8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:53.648810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63a536e5-4eab-493c-b6dd-fe10c8ec52b8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:53.865727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c058dcf-26f2-4d1d-855b-160934fb0dba tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:53.867170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2c058dcf-26f2-4d1d-855b-160934fb0dba tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d870ac2-825e-4d5b-825b-fcc194138508] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:53.891036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c058dcf-26f2-4d1d-855b-160934fb0dba tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:53.891542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c058dcf-26f2-4d1d-855b-160934fb0dba tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:53.891991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c058dcf-26f2-4d1d-855b-160934fb0dba tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:53.892758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c058dcf-26f2-4d1d-855b-160934fb0dba tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:53.893514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c058dcf-26f2-4d1d-855b-160934fb0dba tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:53.910739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c058dcf-26f2-4d1d-855b-160934fb0dba tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:53.996145 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-2c058dcf-26f2-4d1d-855b-160934fb0dba tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] HTTP exception thrown: Instance 7d870ac2-825e-4d5b-825b-fcc194138508 could not be found. Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c058dcf-26f2-4d1d-855b-160934fb0dba tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Request method failure captured: Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508 HTTP/1.1 Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJSE5qt3MMvCiXM6JMYUN7f1buxIi7ST_NSWH8b3Iy1XPUp8KO4zG-NXQgWVN1Z7GE3sHXszWiKCVOYqqXwQROrdr4ZEFwz_8XPZaHXiJBQID0HYLx7sZ_BMJTKC5v-6tuUaVizJ_CnloOe2V1xTk5bkZGekyl16F75E8fKcPIskPJo Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestJSON-553840835 Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestJSON-553840835 Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestJSON-553840835 Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersTestJSON-553840835-project Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6ac786dc6d7847f582262dcd912c3f06 Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestJSON-553840835-project Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 7d870ac2-825e-4d5b-825b-fcc194138508 could not be found. Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '7d870ac2-825e-4d5b-825b-fcc194138508'} Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d870ac2-825e-4d5b-825b-fcc194138508 could not be found. Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d870ac2-825e-4d5b-825b-fcc194138508 could not be found. Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:54.007370 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:57:54.016493 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:57:54.016493 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:57:54.016493 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:57:54.016493 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:57:54.016493 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d870ac2-825e-4d5b-825b-fcc194138508 could not be found. Sep 07 12:57:54.016493 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:57:54.024834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c058dcf-26f2-4d1d-855b-160934fb0dba tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Returning 404 to user: Instance 7d870ac2-825e-4d5b-825b-fcc194138508 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:57:54.036396 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2c058dcf-26f2-4d1d-855b-160934fb0dba tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508" status: 404 len: 111 microversion: 2.1 time: 0.176818 Sep 07 12:57:54.041719 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2606/5162] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:53 2022] GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508 => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:57:54.087072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d98f9a06-a9ee-4d6f-acd3-ae557f17afac tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:54.094049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d98f9a06-a9ee-4d6f-acd3-ae557f17afac tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] [instance: d67fed78-36e7-4fbb-b165-823e47708ae4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:54.650444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d98f9a06-a9ee-4d6f-acd3-ae557f17afac tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ee744811d4061b12d8c89b1f107fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd519233d78e742ca8d835998527fbf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:54.677276 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d98f9a06-a9ee-4d6f-acd3-ae557f17afac tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] 10.222.0.16 "GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4" status: 200 len: 1217 microversion: 2.1 time: 0.631420 Sep 07 12:57:54.686099 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2607/5163] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:54 2022] GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4 => generated 1217 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:54.714672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d274ea60-a76e-4548-8a21-dfd4b7655cf0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1882083924", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "1c45fce2-7bfe-4e93-8f9c-12b9830de28b"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:57:54.916487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-d274ea60-a76e-4548-8a21-dfd4b7655cf0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] validate_networks() for [('1c45fce2-7bfe-4e93-8f9c-12b9830de28b', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:57:55.336762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-63a536e5-4eab-493c-b6dd-fe10c8ec52b8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:55.365086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-63a536e5-4eab-493c-b6dd-fe10c8ec52b8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:55.366630 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-63a536e5-4eab-493c-b6dd-fe10c8ec52b8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:55.388661 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-63a536e5-4eab-493c-b6dd-fe10c8ec52b8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1737 microversion: 2.20 time: 1.798616 Sep 07 12:57:55.394967 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2557/5164] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:57:53 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1737 bytes in 1811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:57:55.419387 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a04c6a6d-9368-4ae1-a04c-3921b3c3b9a8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:55.421574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a04c6a6d-9368-4ae1-a04c-3921b3c3b9a8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:55.447208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a04c6a6d-9368-4ae1-a04c-3921b3c3b9a8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:55.447896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a04c6a6d-9368-4ae1-a04c-3921b3c3b9a8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:55.450871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a04c6a6d-9368-4ae1-a04c-3921b3c3b9a8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:55.452092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a04c6a6d-9368-4ae1-a04c-3921b3c3b9a8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:55.452664 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a04c6a6d-9368-4ae1-a04c-3921b3c3b9a8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:55.453208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a04c6a6d-9368-4ae1-a04c-3921b3c3b9a8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:56.399051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a04c6a6d-9368-4ae1-a04c-3921b3c3b9a8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:56.441658 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a04c6a6d-9368-4ae1-a04c-3921b3c3b9a8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1714 microversion: 2.1 time: 1.043721 Sep 07 12:57:56.447794 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2558/5165] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:55 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1714 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:56.466722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-de4a0277-9ea6-402e-973b-7d94e5639578 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:56.475332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-de4a0277-9ea6-402e-973b-7d94e5639578 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] [instance: d67fed78-36e7-4fbb-b165-823e47708ae4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:56.506278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de4a0277-9ea6-402e-973b-7d94e5639578 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:56.509949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de4a0277-9ea6-402e-973b-7d94e5639578 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:56.513477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de4a0277-9ea6-402e-973b-7d94e5639578 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:56.518547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de4a0277-9ea6-402e-973b-7d94e5639578 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:56.520347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de4a0277-9ea6-402e-973b-7d94e5639578 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:56.521556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de4a0277-9ea6-402e-973b-7d94e5639578 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:56.795520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-de4a0277-9ea6-402e-973b-7d94e5639578 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ee744811d4061b12d8c89b1f107fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd519233d78e742ca8d835998527fbf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:56.825075 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-de4a0277-9ea6-402e-973b-7d94e5639578 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] 10.222.0.16 "GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4" status: 200 len: 1275 microversion: 2.1 time: 0.375282 Sep 07 12:57:56.826849 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2559/5166] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:56 2022] GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4 => generated 1275 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:56.848262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92ea2bba-f79c-4d7f-beb9-da16c348ac33 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:56.852011 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-92ea2bba-f79c-4d7f-beb9-da16c348ac33 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:56.912855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92ea2bba-f79c-4d7f-beb9-da16c348ac33 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:56.914204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92ea2bba-f79c-4d7f-beb9-da16c348ac33 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:56.917271 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92ea2bba-f79c-4d7f-beb9-da16c348ac33 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:56.920324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92ea2bba-f79c-4d7f-beb9-da16c348ac33 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:56.924544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92ea2bba-f79c-4d7f-beb9-da16c348ac33 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:56.925728 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92ea2bba-f79c-4d7f-beb9-da16c348ac33 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:57.012798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d274ea60-a76e-4548-8a21-dfd4b7655cf0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:57:57.012798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d274ea60-a76e-4548-8a21-dfd4b7655cf0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:57:57.012798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d274ea60-a76e-4548-8a21-dfd4b7655cf0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:57:57.013907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d274ea60-a76e-4548-8a21-dfd4b7655cf0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:57:57.014246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d274ea60-a76e-4548-8a21-dfd4b7655cf0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:57:57.060180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d274ea60-a76e-4548-8a21-dfd4b7655cf0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:57.061168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d274ea60-a76e-4548-8a21-dfd4b7655cf0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:57.061966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d274ea60-a76e-4548-8a21-dfd4b7655cf0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:57.070472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d274ea60-a76e-4548-8a21-dfd4b7655cf0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:57.071318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d274ea60-a76e-4548-8a21-dfd4b7655cf0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:57.072076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d274ea60-a76e-4548-8a21-dfd4b7655cf0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:57.171214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-d274ea60-a76e-4548-8a21-dfd4b7655cf0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Getting quotas for project 854c6a81bbfd4ab79126799ec40c954e. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:57:57.197979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-d274ea60-a76e-4548-8a21-dfd4b7655cf0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Getting quotas for user 6ac786dc6d7847f582262dcd912c3f06 and project 854c6a81bbfd4ab79126799ec40c954e. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:57:57.268979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d274ea60-a76e-4548-8a21-dfd4b7655cf0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:57:57.275274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d274ea60-a76e-4548-8a21-dfd4b7655cf0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 0c054466-0769-4190-b9bd-ffe3b4a98706] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:57:57.474455 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d274ea60-a76e-4548-8a21-dfd4b7655cf0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.786279 Sep 07 12:57:57.496250 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2608/5167] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:57:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:57:57.501779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d42b4219-ea10-4dcf-8dbb-4c44086eea75 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:57.502816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d42b4219-ea10-4dcf-8dbb-4c44086eea75 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 0c054466-0769-4190-b9bd-ffe3b4a98706] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:57.526774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-92ea2bba-f79c-4d7f-beb9-da16c348ac33 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:57.591293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-92ea2bba-f79c-4d7f-beb9-da16c348ac33 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:57.602096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-92ea2bba-f79c-4d7f-beb9-da16c348ac33 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:57.604242 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-92ea2bba-f79c-4d7f-beb9-da16c348ac33 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1737 microversion: 2.20 time: 0.774769 Sep 07 12:57:57.605708 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2560/5168] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:57:56 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1737 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:57:57.666662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d42b4219-ea10-4dcf-8dbb-4c44086eea75 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:57.679251 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d42b4219-ea10-4dcf-8dbb-4c44086eea75 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706" status: 200 len: 1209 microversion: 2.1 time: 0.181495 Sep 07 12:57:57.681640 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2609/5169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:57 2022] GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 => generated 1209 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:57:57.873670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-396ff41e-6117-4749-bffd-bd0b93f8db04 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:57.874382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-396ff41e-6117-4749-bffd-bd0b93f8db04 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] [instance: d67fed78-36e7-4fbb-b165-823e47708ae4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:57.897095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-396ff41e-6117-4749-bffd-bd0b93f8db04 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:57.903593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-396ff41e-6117-4749-bffd-bd0b93f8db04 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:57.907064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-396ff41e-6117-4749-bffd-bd0b93f8db04 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:57.911401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-396ff41e-6117-4749-bffd-bd0b93f8db04 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:57.916351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-396ff41e-6117-4749-bffd-bd0b93f8db04 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:57.919959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-396ff41e-6117-4749-bffd-bd0b93f8db04 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:57.953871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:58.173657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-396ff41e-6117-4749-bffd-bd0b93f8db04 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ee744811d4061b12d8c89b1f107fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd519233d78e742ca8d835998527fbf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:58.192261 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-396ff41e-6117-4749-bffd-bd0b93f8db04 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] 10.222.0.16 "GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4" status: 200 len: 1275 microversion: 2.1 time: 0.322510 Sep 07 12:57:58.224385 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2561/5170] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:57 2022] GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4 => generated 1275 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:58.638266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7b065444-0828-4bb7-9fdb-9788ca975f75 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:58.638905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7b065444-0828-4bb7-9fdb-9788ca975f75 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:58.662718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b065444-0828-4bb7-9fdb-9788ca975f75 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:58.663264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b065444-0828-4bb7-9fdb-9788ca975f75 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:58.664269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b065444-0828-4bb7-9fdb-9788ca975f75 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:58.665622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b065444-0828-4bb7-9fdb-9788ca975f75 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:58.666794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b065444-0828-4bb7-9fdb-9788ca975f75 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:58.674336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7b065444-0828-4bb7-9fdb-9788ca975f75 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:58.736691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-93d399a9-2209-477a-b22e-06fbee17bbae tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:58.737947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-93d399a9-2209-477a-b22e-06fbee17bbae tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 0c054466-0769-4190-b9bd-ffe3b4a98706] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:59.186138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-93d399a9-2209-477a-b22e-06fbee17bbae tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:59.213997 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-93d399a9-2209-477a-b22e-06fbee17bbae tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706" status: 200 len: 1209 microversion: 2.1 time: 0.485068 Sep 07 12:57:59.217587 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2562/5171] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:58 2022] GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 => generated 1209 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:57:59.246802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7a7b82b4-36be-4479-94f2-a83cd0810d21 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:57:59.248328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7a7b82b4-36be-4479-94f2-a83cd0810d21 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] [instance: d67fed78-36e7-4fbb-b165-823e47708ae4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:57:59.276636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a7b82b4-36be-4479-94f2-a83cd0810d21 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:59.279344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a7b82b4-36be-4479-94f2-a83cd0810d21 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:59.279876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a7b82b4-36be-4479-94f2-a83cd0810d21 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:59.290813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a7b82b4-36be-4479-94f2-a83cd0810d21 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:57:59.293821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a7b82b4-36be-4479-94f2-a83cd0810d21 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:57:59.297447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a7b82b4-36be-4479-94f2-a83cd0810d21 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:57:59.318841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7b065444-0828-4bb7-9fdb-9788ca975f75 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:59.359282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7b065444-0828-4bb7-9fdb-9788ca975f75 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:59.360997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7b065444-0828-4bb7-9fdb-9788ca975f75 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:59.375942 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7b065444-0828-4bb7-9fdb-9788ca975f75 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1737 microversion: 2.20 time: 0.742017 Sep 07 12:57:59.378655 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2610/5172] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:57:58 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1737 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:57:59.646261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7a7b82b4-36be-4479-94f2-a83cd0810d21 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ee744811d4061b12d8c89b1f107fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd519233d78e742ca8d835998527fbf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:57:59.669071 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7a7b82b4-36be-4479-94f2-a83cd0810d21 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] 10.222.0.16 "GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4" status: 200 len: 1275 microversion: 2.1 time: 0.430978 Sep 07 12:57:59.670249 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2563/5173] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:57:59 2022] GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4 => generated 1275 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:00.263117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ceee428c-e4ed-46fb-b1fd-efa9ac6f6d26 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:00.264696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ceee428c-e4ed-46fb-b1fd-efa9ac6f6d26 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 0c054466-0769-4190-b9bd-ffe3b4a98706] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:00.301758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ceee428c-e4ed-46fb-b1fd-efa9ac6f6d26 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:00.302926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ceee428c-e4ed-46fb-b1fd-efa9ac6f6d26 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:00.303721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ceee428c-e4ed-46fb-b1fd-efa9ac6f6d26 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:00.305072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ceee428c-e4ed-46fb-b1fd-efa9ac6f6d26 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:00.305975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ceee428c-e4ed-46fb-b1fd-efa9ac6f6d26 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:00.329579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ceee428c-e4ed-46fb-b1fd-efa9ac6f6d26 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:00.461291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a7f86375-d5fd-44fd-9047-b0a25c32899b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:00.470904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a7f86375-d5fd-44fd-9047-b0a25c32899b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:00.493119 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7f86375-d5fd-44fd-9047-b0a25c32899b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:00.499392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7f86375-d5fd-44fd-9047-b0a25c32899b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:00.500894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7f86375-d5fd-44fd-9047-b0a25c32899b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:00.512035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7f86375-d5fd-44fd-9047-b0a25c32899b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:00.513400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7f86375-d5fd-44fd-9047-b0a25c32899b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:00.514681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7f86375-d5fd-44fd-9047-b0a25c32899b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:00.639959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ceee428c-e4ed-46fb-b1fd-efa9ac6f6d26 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:00.661286 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ceee428c-e4ed-46fb-b1fd-efa9ac6f6d26 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706" status: 200 len: 1261 microversion: 2.1 time: 0.400337 Sep 07 12:58:00.665540 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2611/5174] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:00 2022] GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 => generated 1261 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:58:00.764552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c00c1632-cf5a-4834-acd2-f644cdf94d9e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:00.767354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c00c1632-cf5a-4834-acd2-f644cdf94d9e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] [instance: d67fed78-36e7-4fbb-b165-823e47708ae4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:00.809668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c00c1632-cf5a-4834-acd2-f644cdf94d9e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:00.819095 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c00c1632-cf5a-4834-acd2-f644cdf94d9e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:00.826276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c00c1632-cf5a-4834-acd2-f644cdf94d9e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:00.828099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c00c1632-cf5a-4834-acd2-f644cdf94d9e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:00.829231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c00c1632-cf5a-4834-acd2-f644cdf94d9e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:00.837249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c00c1632-cf5a-4834-acd2-f644cdf94d9e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:02.232682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c00c1632-cf5a-4834-acd2-f644cdf94d9e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ee744811d4061b12d8c89b1f107fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd519233d78e742ca8d835998527fbf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:02.242456 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c00c1632-cf5a-4834-acd2-f644cdf94d9e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] 10.222.0.16 "GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4" status: 200 len: 1317 microversion: 2.1 time: 1.526731 Sep 07 12:58:02.249554 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2612/5175] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:00 2022] GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4 => generated 1317 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:02.261793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f16a403b-f06f-4931-8ffd-a725ef2999f6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:02.262746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f16a403b-f06f-4931-8ffd-a725ef2999f6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 0c054466-0769-4190-b9bd-ffe3b4a98706] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:02.287336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f16a403b-f06f-4931-8ffd-a725ef2999f6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:02.294359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f16a403b-f06f-4931-8ffd-a725ef2999f6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:02.295184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f16a403b-f06f-4931-8ffd-a725ef2999f6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:02.296218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f16a403b-f06f-4931-8ffd-a725ef2999f6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:02.297119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f16a403b-f06f-4931-8ffd-a725ef2999f6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:02.298301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f16a403b-f06f-4931-8ffd-a725ef2999f6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:02.474588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a7f86375-d5fd-44fd-9047-b0a25c32899b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:02.490037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a7f86375-d5fd-44fd-9047-b0a25c32899b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:02.491805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a7f86375-d5fd-44fd-9047-b0a25c32899b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:02.495248 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a7f86375-d5fd-44fd-9047-b0a25c32899b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1737 microversion: 2.20 time: 2.077870 Sep 07 12:58:02.516917 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2564/5176] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:58:00 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1737 bytes in 2104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:58:02.526150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f16a403b-f06f-4931-8ffd-a725ef2999f6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:02.538853 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f16a403b-f06f-4931-8ffd-a725ef2999f6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706" status: 200 len: 1267 microversion: 2.1 time: 0.287529 Sep 07 12:58:02.540727 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2613/5177] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:02 2022] GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 => generated 1267 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:03.275571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-47d788cf-5f01-422f-b8e3-a84b8c485a29 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:03.276225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-47d788cf-5f01-422f-b8e3-a84b8c485a29 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] [instance: d67fed78-36e7-4fbb-b165-823e47708ae4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:03.288975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:03.291135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47d788cf-5f01-422f-b8e3-a84b8c485a29 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:03.291700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47d788cf-5f01-422f-b8e3-a84b8c485a29 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:03.298870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47d788cf-5f01-422f-b8e3-a84b8c485a29 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:03.299871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47d788cf-5f01-422f-b8e3-a84b8c485a29 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:03.300380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47d788cf-5f01-422f-b8e3-a84b8c485a29 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:03.300837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47d788cf-5f01-422f-b8e3-a84b8c485a29 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:03.528349 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a6eae0e8-495f-4124-a31c-358a8a47c14c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:03.529144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a6eae0e8-495f-4124-a31c-358a8a47c14c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:03.545397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6eae0e8-495f-4124-a31c-358a8a47c14c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:03.545958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6eae0e8-495f-4124-a31c-358a8a47c14c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:03.550228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6eae0e8-495f-4124-a31c-358a8a47c14c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:03.552514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6eae0e8-495f-4124-a31c-358a8a47c14c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:03.553061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6eae0e8-495f-4124-a31c-358a8a47c14c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:03.554172 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6eae0e8-495f-4124-a31c-358a8a47c14c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:04.479950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-47d788cf-5f01-422f-b8e3-a84b8c485a29 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ee744811d4061b12d8c89b1f107fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd519233d78e742ca8d835998527fbf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:04.493193 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-47d788cf-5f01-422f-b8e3-a84b8c485a29 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] 10.222.0.16 "GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4" status: 200 len: 1317 microversion: 2.1 time: 1.217508 Sep 07 12:58:04.510626 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2565/5178] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:03 2022] GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4 => generated 1317 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:04.527375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-60191399-9293-4954-9aad-f920a6d59d24 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:04.527993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-60191399-9293-4954-9aad-f920a6d59d24 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 0c054466-0769-4190-b9bd-ffe3b4a98706] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:04.544928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a6eae0e8-495f-4124-a31c-358a8a47c14c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:04.548408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60191399-9293-4954-9aad-f920a6d59d24 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:04.549245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60191399-9293-4954-9aad-f920a6d59d24 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:04.550027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60191399-9293-4954-9aad-f920a6d59d24 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:04.551021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60191399-9293-4954-9aad-f920a6d59d24 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:04.554623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60191399-9293-4954-9aad-f920a6d59d24 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:04.555405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60191399-9293-4954-9aad-f920a6d59d24 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:04.591368 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a6eae0e8-495f-4124-a31c-358a8a47c14c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:04.601101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a6eae0e8-495f-4124-a31c-358a8a47c14c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:04.603674 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a6eae0e8-495f-4124-a31c-358a8a47c14c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1737 microversion: 2.20 time: 1.083355 Sep 07 12:58:04.610326 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2614/5179] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:58:03 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1737 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:58:04.809084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-3922d49b-25bc-4cff-a5e7-8a01bbea44d3 req-abec92e9-cc29-4b19-bd0c-ba142cc0c238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d67fed78-36e7-4fbb-b165-823e47708ae4", "tag": "411864e9-e097-4ab4-99cb-e5103da5d8c5"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:58:04.846829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-60191399-9293-4954-9aad-f920a6d59d24 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:04.852873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3922d49b-25bc-4cff-a5e7-8a01bbea44d3 req-abec92e9-cc29-4b19-bd0c-ba142cc0c238 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:04.866731 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3922d49b-25bc-4cff-a5e7-8a01bbea44d3 req-abec92e9-cc29-4b19-bd0c-ba142cc0c238 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:04.867649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3922d49b-25bc-4cff-a5e7-8a01bbea44d3 req-abec92e9-cc29-4b19-bd0c-ba142cc0c238 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:04.872311 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-60191399-9293-4954-9aad-f920a6d59d24 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706" status: 200 len: 1267 microversion: 2.1 time: 0.360351 Sep 07 12:58:04.877750 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2566/5180] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:04 2022] GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 => generated 1267 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:04.909823 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-3922d49b-25bc-4cff-a5e7-8a01bbea44d3 req-abec92e9-cc29-4b19-bd0c-ba142cc0c238 service nova] Creating event network-changed:411864e9-e097-4ab4-99cb-e5103da5d8c5 for instance d67fed78-36e7-4fbb-b165-823e47708ae4 on n-h1-852087-9 Sep 07 12:58:04.930982 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-3922d49b-25bc-4cff-a5e7-8a01bbea44d3 req-abec92e9-cc29-4b19-bd0c-ba142cc0c238 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145071 Sep 07 12:58:04.935168 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2615/5181] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:58:05.520563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-623075f1-f5d7-41c4-8ce7-3775059c609d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:05.521173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-623075f1-f5d7-41c4-8ce7-3775059c609d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] [instance: d67fed78-36e7-4fbb-b165-823e47708ae4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:05.529446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-623075f1-f5d7-41c4-8ce7-3775059c609d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:05.530470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-623075f1-f5d7-41c4-8ce7-3775059c609d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:05.531239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-623075f1-f5d7-41c4-8ce7-3775059c609d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:05.532250 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-623075f1-f5d7-41c4-8ce7-3775059c609d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:05.532900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-623075f1-f5d7-41c4-8ce7-3775059c609d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:05.533517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-623075f1-f5d7-41c4-8ce7-3775059c609d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:05.662611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6f17d2fd-512f-42e5-9c7f-b1cc43faa0a2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:05.665042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6f17d2fd-512f-42e5-9c7f-b1cc43faa0a2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:05.675533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:05.679423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f17d2fd-512f-42e5-9c7f-b1cc43faa0a2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:05.680719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f17d2fd-512f-42e5-9c7f-b1cc43faa0a2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:05.681859 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f17d2fd-512f-42e5-9c7f-b1cc43faa0a2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:05.683461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f17d2fd-512f-42e5-9c7f-b1cc43faa0a2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:05.684556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f17d2fd-512f-42e5-9c7f-b1cc43faa0a2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:05.685614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f17d2fd-512f-42e5-9c7f-b1cc43faa0a2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:05.759838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:06.504952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-623075f1-f5d7-41c4-8ce7-3775059c609d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ee744811d4061b12d8c89b1f107fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd519233d78e742ca8d835998527fbf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:06.536262 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-623075f1-f5d7-41c4-8ce7-3775059c609d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] 10.222.0.16 "GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4" status: 200 len: 1317 microversion: 2.1 time: 1.017161 Sep 07 12:58:06.559054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6f17d2fd-512f-42e5-9c7f-b1cc43faa0a2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:06.576849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6f17d2fd-512f-42e5-9c7f-b1cc43faa0a2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:06.581720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6f17d2fd-512f-42e5-9c7f-b1cc43faa0a2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:06.584074 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6f17d2fd-512f-42e5-9c7f-b1cc43faa0a2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1719 microversion: 2.20 time: 0.931507 Sep 07 12:58:06.588848 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2616/5182] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:58:05 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1719 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:58:06.597732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4aca24a4-7229-49aa-a76e-a1fd23067474 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:06.603067 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2567/5183] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:05 2022] GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4 => generated 1317 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:06.604354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4aca24a4-7229-49aa-a76e-a1fd23067474 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 0c054466-0769-4190-b9bd-ffe3b4a98706] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:06.633082 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4aca24a4-7229-49aa-a76e-a1fd23067474 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:06.636392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4aca24a4-7229-49aa-a76e-a1fd23067474 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:06.640128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4aca24a4-7229-49aa-a76e-a1fd23067474 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:06.641498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4aca24a4-7229-49aa-a76e-a1fd23067474 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:06.644686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4aca24a4-7229-49aa-a76e-a1fd23067474 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:06.647151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4aca24a4-7229-49aa-a76e-a1fd23067474 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:07.128130 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:07.278271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4aca24a4-7229-49aa-a76e-a1fd23067474 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:07.301445 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4aca24a4-7229-49aa-a76e-a1fd23067474 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706" status: 200 len: 1309 microversion: 2.1 time: 0.710038 Sep 07 12:58:07.320338 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2617/5184] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:06 2022] GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 => generated 1309 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:07.593322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dcda4278-6a4a-4b42-acdf-795ffd6a0c3d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:07.599767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dcda4278-6a4a-4b42-acdf-795ffd6a0c3d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] [instance: d67fed78-36e7-4fbb-b165-823e47708ae4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:07.625788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dcda4278-6a4a-4b42-acdf-795ffd6a0c3d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:07.628592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dcda4278-6a4a-4b42-acdf-795ffd6a0c3d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:07.631833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dcda4278-6a4a-4b42-acdf-795ffd6a0c3d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:07.632904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dcda4278-6a4a-4b42-acdf-795ffd6a0c3d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:07.633644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dcda4278-6a4a-4b42-acdf-795ffd6a0c3d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:07.634281 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dcda4278-6a4a-4b42-acdf-795ffd6a0c3d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:07.645152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2988f126-f5fc-4547-845e-c9b4078f6018 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:07.646447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2988f126-f5fc-4547-845e-c9b4078f6018 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:07.664955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2988f126-f5fc-4547-845e-c9b4078f6018 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:07.675048 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2988f126-f5fc-4547-845e-c9b4078f6018 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:07.679996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2988f126-f5fc-4547-845e-c9b4078f6018 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:07.681679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2988f126-f5fc-4547-845e-c9b4078f6018 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:07.682575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2988f126-f5fc-4547-845e-c9b4078f6018 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:07.704817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2988f126-f5fc-4547-845e-c9b4078f6018 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:07.708926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=16 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:08.663157 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2988f126-f5fc-4547-845e-c9b4078f6018 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:08.689354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2988f126-f5fc-4547-845e-c9b4078f6018 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:08.695519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2988f126-f5fc-4547-845e-c9b4078f6018 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:08.696807 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2988f126-f5fc-4547-845e-c9b4078f6018 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1719 microversion: 2.20 time: 1.057683 Sep 07 12:58:08.700483 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2618/5185] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:58:07 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1719 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:58:08.715106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7d293c66-b046-4a2b-b566-02984d74dc77 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:08.715751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7d293c66-b046-4a2b-b566-02984d74dc77 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 0c054466-0769-4190-b9bd-ffe3b4a98706] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:08.731161 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d293c66-b046-4a2b-b566-02984d74dc77 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:08.731161 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d293c66-b046-4a2b-b566-02984d74dc77 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:08.731699 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d293c66-b046-4a2b-b566-02984d74dc77 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:08.739549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d293c66-b046-4a2b-b566-02984d74dc77 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:08.740336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d293c66-b046-4a2b-b566-02984d74dc77 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:08.740940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d293c66-b046-4a2b-b566-02984d74dc77 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:08.852958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dcda4278-6a4a-4b42-acdf-795ffd6a0c3d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ee744811d4061b12d8c89b1f107fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd519233d78e742ca8d835998527fbf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:08.948283 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dcda4278-6a4a-4b42-acdf-795ffd6a0c3d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] 10.222.0.16 "GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4" status: 200 len: 1317 microversion: 2.1 time: 1.356699 Sep 07 12:58:08.949452 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2568/5186] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:07 2022] GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4 => generated 1317 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:09.062162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-8376a0bd-4240-4a57-9e25-e38334ecd853 req-e5f5cbb3-0e65-4dc9-97fe-76dbdff20bdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f328e5-ec00-4403-8196-cbefa047877b", "name": "network-vif-unplugged", "status": "completed", "tag": "13d7f17d-cb66-4016-a84a-aec1e39c3e03"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:58:09.127993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8376a0bd-4240-4a57-9e25-e38334ecd853 req-e5f5cbb3-0e65-4dc9-97fe-76dbdff20bdf service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:09.128880 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8376a0bd-4240-4a57-9e25-e38334ecd853 req-e5f5cbb3-0e65-4dc9-97fe-76dbdff20bdf service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:09.130011 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8376a0bd-4240-4a57-9e25-e38334ecd853 req-e5f5cbb3-0e65-4dc9-97fe-76dbdff20bdf service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:09.160591 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-8376a0bd-4240-4a57-9e25-e38334ecd853 req-e5f5cbb3-0e65-4dc9-97fe-76dbdff20bdf service nova] Creating event network-vif-unplugged:13d7f17d-cb66-4016-a84a-aec1e39c3e03 for instance 35f328e5-ec00-4403-8196-cbefa047877b on n-h2-852087-9 Sep 07 12:58:09.189921 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-8376a0bd-4240-4a57-9e25-e38334ecd853 req-e5f5cbb3-0e65-4dc9-97fe-76dbdff20bdf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145691 Sep 07 12:58:09.191958 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2569/5187] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:58:09.639241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7d293c66-b046-4a2b-b566-02984d74dc77 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:09.671120 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7d293c66-b046-4a2b-b566-02984d74dc77 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706" status: 200 len: 1309 microversion: 2.1 time: 0.964273 Sep 07 12:58:09.672890 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2619/5188] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:08 2022] GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 => generated 1309 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:09.760826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ef0f8ec-0b07-43e8-a738-321a873096a3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:09.762158 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5ef0f8ec-0b07-43e8-a738-321a873096a3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:09.777431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:09.787268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ef0f8ec-0b07-43e8-a738-321a873096a3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:09.791210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ef0f8ec-0b07-43e8-a738-321a873096a3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:09.792016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ef0f8ec-0b07-43e8-a738-321a873096a3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:09.793030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ef0f8ec-0b07-43e8-a738-321a873096a3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:09.795024 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ef0f8ec-0b07-43e8-a738-321a873096a3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:09.796125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ef0f8ec-0b07-43e8-a738-321a873096a3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:09.980242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9ebf1ee0-c753-4674-b797-966fb4bd7b44 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:09.980854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9ebf1ee0-c753-4674-b797-966fb4bd7b44 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] [instance: d67fed78-36e7-4fbb-b165-823e47708ae4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:10.008004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ebf1ee0-c753-4674-b797-966fb4bd7b44 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:10.008861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ebf1ee0-c753-4674-b797-966fb4bd7b44 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:10.011423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ebf1ee0-c753-4674-b797-966fb4bd7b44 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:10.014446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ebf1ee0-c753-4674-b797-966fb4bd7b44 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:10.016294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ebf1ee0-c753-4674-b797-966fb4bd7b44 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:10.017775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ebf1ee0-c753-4674-b797-966fb4bd7b44 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:10.343185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5ef0f8ec-0b07-43e8-a738-321a873096a3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:10.361178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5ef0f8ec-0b07-43e8-a738-321a873096a3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:10.366326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5ef0f8ec-0b07-43e8-a738-321a873096a3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:10.372086 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5ef0f8ec-0b07-43e8-a738-321a873096a3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1719 microversion: 2.20 time: 0.615915 Sep 07 12:58:10.373192 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2570/5189] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:58:09 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1719 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:58:10.730368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e93ae847-a82a-4f9b-981d-a69b700bb892 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:10.731070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e93ae847-a82a-4f9b-981d-a69b700bb892 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 0c054466-0769-4190-b9bd-ffe3b4a98706] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:10.744498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9ebf1ee0-c753-4674-b797-966fb4bd7b44 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ee744811d4061b12d8c89b1f107fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd519233d78e742ca8d835998527fbf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:10.748012 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e93ae847-a82a-4f9b-981d-a69b700bb892 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:10.750640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e93ae847-a82a-4f9b-981d-a69b700bb892 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:10.751473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e93ae847-a82a-4f9b-981d-a69b700bb892 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:10.753344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e93ae847-a82a-4f9b-981d-a69b700bb892 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:10.756184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e93ae847-a82a-4f9b-981d-a69b700bb892 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:10.758268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e93ae847-a82a-4f9b-981d-a69b700bb892 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:10.773319 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9ebf1ee0-c753-4674-b797-966fb4bd7b44 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] 10.222.0.16 "GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4" status: 200 len: 1317 microversion: 2.1 time: 0.800159 Sep 07 12:58:10.784130 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2620/5190] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:09 2022] GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4 => generated 1317 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:58:11.042192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-255d90ad-2a2d-4626-924c-fa9c2f18379e req-f3ef4a7c-06aa-45d0-900a-00d141512c33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c054466-0769-4190-b9bd-ffe3b4a98706", "tag": "639ebb5e-8d7d-4cc2-9542-be315d9b3af1"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:58:11.074172 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-255d90ad-2a2d-4626-924c-fa9c2f18379e req-f3ef4a7c-06aa-45d0-900a-00d141512c33 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:11.075679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-255d90ad-2a2d-4626-924c-fa9c2f18379e req-f3ef4a7c-06aa-45d0-900a-00d141512c33 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:11.078254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-255d90ad-2a2d-4626-924c-fa9c2f18379e req-f3ef4a7c-06aa-45d0-900a-00d141512c33 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:11.136177 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-255d90ad-2a2d-4626-924c-fa9c2f18379e req-f3ef4a7c-06aa-45d0-900a-00d141512c33 service nova] Creating event network-changed:639ebb5e-8d7d-4cc2-9542-be315d9b3af1 for instance 0c054466-0769-4190-b9bd-ffe3b4a98706 on n-h2-852087-9 Sep 07 12:58:11.149731 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-255d90ad-2a2d-4626-924c-fa9c2f18379e req-f3ef4a7c-06aa-45d0-900a-00d141512c33 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121126 Sep 07 12:58:11.153310 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2621/5191] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:58:11.233123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e93ae847-a82a-4f9b-981d-a69b700bb892 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:11.256159 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e93ae847-a82a-4f9b-981d-a69b700bb892 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706" status: 200 len: 1309 microversion: 2.1 time: 0.539991 Sep 07 12:58:11.258624 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2571/5192] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:10 2022] GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 => generated 1309 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:11.426667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-60ac300d-3edf-44b5-a7a4-f8607a7d6066 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:11.429535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-60ac300d-3edf-44b5-a7a4-f8607a7d6066 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:11.461093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60ac300d-3edf-44b5-a7a4-f8607a7d6066 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:11.465592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60ac300d-3edf-44b5-a7a4-f8607a7d6066 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:11.467632 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60ac300d-3edf-44b5-a7a4-f8607a7d6066 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:11.472166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60ac300d-3edf-44b5-a7a4-f8607a7d6066 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:11.478313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60ac300d-3edf-44b5-a7a4-f8607a7d6066 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:11.486327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60ac300d-3edf-44b5-a7a4-f8607a7d6066 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:11.830398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3bdd65e8-6026-40f2-bf39-9828d10df33e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:11.833831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3bdd65e8-6026-40f2-bf39-9828d10df33e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] [instance: d67fed78-36e7-4fbb-b165-823e47708ae4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:11.870147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3bdd65e8-6026-40f2-bf39-9828d10df33e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:11.876107 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3bdd65e8-6026-40f2-bf39-9828d10df33e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:11.881763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3bdd65e8-6026-40f2-bf39-9828d10df33e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:11.883277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3bdd65e8-6026-40f2-bf39-9828d10df33e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:11.895042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3bdd65e8-6026-40f2-bf39-9828d10df33e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:11.899848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3bdd65e8-6026-40f2-bf39-9828d10df33e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:12.455199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-60ac300d-3edf-44b5-a7a4-f8607a7d6066 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:12.499605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-60ac300d-3edf-44b5-a7a4-f8607a7d6066 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:12.514596 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-60ac300d-3edf-44b5-a7a4-f8607a7d6066 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:12.517552 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-60ac300d-3edf-44b5-a7a4-f8607a7d6066 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1662 microversion: 2.20 time: 1.103677 Sep 07 12:58:12.525160 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2622/5193] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:58:11 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1662 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:58:12.545161 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7ba4cc00-fc57-4d03-9a68-36389d265fe7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:12.553475 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7ba4cc00-fc57-4d03-9a68-36389d265fe7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 0c054466-0769-4190-b9bd-ffe3b4a98706] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:12.580189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3bdd65e8-6026-40f2-bf39-9828d10df33e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ee744811d4061b12d8c89b1f107fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd519233d78e742ca8d835998527fbf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:12.581593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ba4cc00-fc57-4d03-9a68-36389d265fe7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:12.583205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ba4cc00-fc57-4d03-9a68-36389d265fe7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:12.586067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ba4cc00-fc57-4d03-9a68-36389d265fe7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:12.590666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ba4cc00-fc57-4d03-9a68-36389d265fe7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:12.595811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ba4cc00-fc57-4d03-9a68-36389d265fe7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:12.599726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ba4cc00-fc57-4d03-9a68-36389d265fe7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:12.601135 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3bdd65e8-6026-40f2-bf39-9828d10df33e tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] 10.222.0.16 "GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4" status: 200 len: 1317 microversion: 2.1 time: 0.778734 Sep 07 12:58:12.602704 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2572/5194] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:11 2022] GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4 => generated 1317 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:58:12.622604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ddb3b098-672b-4bc8-98fa-97526ded5db9 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17d9902b-299d-4ebb-8c67-bbb78e7dd403"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:58:12.627447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ddb3b098-672b-4bc8-98fa-97526ded5db9 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:12.660393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddb3b098-672b-4bc8-98fa-97526ded5db9 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:12.661255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddb3b098-672b-4bc8-98fa-97526ded5db9 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:12.662582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddb3b098-672b-4bc8-98fa-97526ded5db9 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:12.664467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddb3b098-672b-4bc8-98fa-97526ded5db9 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:12.665853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddb3b098-672b-4bc8-98fa-97526ded5db9 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:12.667012 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddb3b098-672b-4bc8-98fa-97526ded5db9 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:13.042880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7ba4cc00-fc57-4d03-9a68-36389d265fe7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:13.063529 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7ba4cc00-fc57-4d03-9a68-36389d265fe7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706" status: 200 len: 1309 microversion: 2.1 time: 0.535784 Sep 07 12:58:13.065635 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2623/5195] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:12 2022] GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 => generated 1309 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:13.367141 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ddb3b098-672b-4bc8-98fa-97526ded5db9 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "POST /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.759451 Sep 07 12:58:13.369259 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2573/5196] 10.222.0.16 () {62 vars in 1364 bytes} [Wed Sep 7 12:58:12 2022] POST /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b/os-volume_attachments => generated 188 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:58:13.562754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0a64d36f-8494-4aa6-a678-dda7b49bc685 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:13.563809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0a64d36f-8494-4aa6-a678-dda7b49bc685 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:13.576886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a64d36f-8494-4aa6-a678-dda7b49bc685 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:13.577821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a64d36f-8494-4aa6-a678-dda7b49bc685 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:13.579262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a64d36f-8494-4aa6-a678-dda7b49bc685 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:13.579980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a64d36f-8494-4aa6-a678-dda7b49bc685 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:13.580816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a64d36f-8494-4aa6-a678-dda7b49bc685 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:13.581589 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a64d36f-8494-4aa6-a678-dda7b49bc685 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:13.635756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-441d82b2-153c-4672-8873-2f7530abc7e5 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:13.636414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-441d82b2-153c-4672-8873-2f7530abc7e5 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] [instance: d67fed78-36e7-4fbb-b165-823e47708ae4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:13.649517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-441d82b2-153c-4672-8873-2f7530abc7e5 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:13.651364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-441d82b2-153c-4672-8873-2f7530abc7e5 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:13.652238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-441d82b2-153c-4672-8873-2f7530abc7e5 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:13.654457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-441d82b2-153c-4672-8873-2f7530abc7e5 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:13.655594 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-441d82b2-153c-4672-8873-2f7530abc7e5 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:13.657067 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-441d82b2-153c-4672-8873-2f7530abc7e5 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:14.002774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-441d82b2-153c-4672-8873-2f7530abc7e5 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ee744811d4061b12d8c89b1f107fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd519233d78e742ca8d835998527fbf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:14.018245 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-441d82b2-153c-4672-8873-2f7530abc7e5 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] 10.222.0.16 "GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4" status: 200 len: 1317 microversion: 2.1 time: 0.388747 Sep 07 12:58:14.024542 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2574/5197] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:13 2022] GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4 => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:14.061903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-1fa9cbe5-c1f9-492b-8c82-9c0a73daf8a7 req-23e4a731-ce4d-4962-aef9-1dd4e59e2125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67fed78-36e7-4fbb-b165-823e47708ae4", "name": "network-vif-plugged", "status": "completed", "tag": "411864e9-e097-4ab4-99cb-e5103da5d8c5"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:58:14.088070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1fa9cbe5-c1f9-492b-8c82-9c0a73daf8a7 req-23e4a731-ce4d-4962-aef9-1dd4e59e2125 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:14.092526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1fa9cbe5-c1f9-492b-8c82-9c0a73daf8a7 req-23e4a731-ce4d-4962-aef9-1dd4e59e2125 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:14.093180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1fa9cbe5-c1f9-492b-8c82-9c0a73daf8a7 req-23e4a731-ce4d-4962-aef9-1dd4e59e2125 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:14.132539 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-1fa9cbe5-c1f9-492b-8c82-9c0a73daf8a7 req-23e4a731-ce4d-4962-aef9-1dd4e59e2125 service nova] Creating event network-vif-plugged:411864e9-e097-4ab4-99cb-e5103da5d8c5 for instance d67fed78-36e7-4fbb-b165-823e47708ae4 on n-h1-852087-9 Sep 07 12:58:14.148696 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-1fa9cbe5-c1f9-492b-8c82-9c0a73daf8a7 req-23e4a731-ce4d-4962-aef9-1dd4e59e2125 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090611 Sep 07 12:58:14.151257 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2575/5198] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:58:14.161718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9ce2a156-4fc7-4db6-b8aa-a38638a5c08f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:14.168449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9ce2a156-4fc7-4db6-b8aa-a38638a5c08f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 0c054466-0769-4190-b9bd-ffe3b4a98706] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:14.183547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ce2a156-4fc7-4db6-b8aa-a38638a5c08f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:14.186831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ce2a156-4fc7-4db6-b8aa-a38638a5c08f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:14.187873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ce2a156-4fc7-4db6-b8aa-a38638a5c08f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:14.188928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ce2a156-4fc7-4db6-b8aa-a38638a5c08f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:14.207139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ce2a156-4fc7-4db6-b8aa-a38638a5c08f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:14.208191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ce2a156-4fc7-4db6-b8aa-a38638a5c08f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:14.316966 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0a64d36f-8494-4aa6-a678-dda7b49bc685 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "DELETE /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b/os-volume_attachments/17d9902b-299d-4ebb-8c67-bbb78e7dd403" status: 202 len: 0 microversion: 2.20 time: 0.779603 Sep 07 12:58:14.319332 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2624/5199] 10.222.0.16 () {60 vars in 1457 bytes} [Wed Sep 7 12:58:13 2022] DELETE /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b/os-volume_attachments/17d9902b-299d-4ebb-8c67-bbb78e7dd403 => generated 0 bytes in 783 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:14.420867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f4910df6-27e3-4768-820d-8d63d755c0ee tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:58:14.422330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f4910df6-27e3-4768-820d-8d63d755c0ee tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:14.439328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4910df6-27e3-4768-820d-8d63d755c0ee tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:14.444934 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4910df6-27e3-4768-820d-8d63d755c0ee tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:14.446105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4910df6-27e3-4768-820d-8d63d755c0ee tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:14.447701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4910df6-27e3-4768-820d-8d63d755c0ee tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:14.448640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4910df6-27e3-4768-820d-8d63d755c0ee tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:14.449851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4910df6-27e3-4768-820d-8d63d755c0ee tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:14.512804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f4910df6-27e3-4768-820d-8d63d755c0ee tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122433) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 12:58:14.677785 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f4910df6-27e3-4768-820d-8d63d755c0ee tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "POST /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b/action" status: 202 len: 0 microversion: 2.20 time: 0.262088 Sep 07 12:58:14.680247 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2625/5200] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Sep 7 12:58:14 2022] POST /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 07 12:58:14.693867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-23c132df-a68f-41da-9398-ab802b0a5436 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:14.696125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-23c132df-a68f-41da-9398-ab802b0a5436 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:14.714309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23c132df-a68f-41da-9398-ab802b0a5436 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:14.715744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23c132df-a68f-41da-9398-ab802b0a5436 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:14.717247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23c132df-a68f-41da-9398-ab802b0a5436 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:14.719347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23c132df-a68f-41da-9398-ab802b0a5436 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:14.721085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23c132df-a68f-41da-9398-ab802b0a5436 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:14.722849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23c132df-a68f-41da-9398-ab802b0a5436 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:15.093576 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9ce2a156-4fc7-4db6-b8aa-a38638a5c08f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:15.105052 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9ce2a156-4fc7-4db6-b8aa-a38638a5c08f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706" status: 200 len: 1309 microversion: 2.1 time: 0.950727 Sep 07 12:58:15.109422 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2576/5201] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:14 2022] GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 => generated 1309 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:15.114641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2fcf709d-2027-448a-acfb-8568fd44db1c tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:15.124515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2fcf709d-2027-448a-acfb-8568fd44db1c tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] [instance: d67fed78-36e7-4fbb-b165-823e47708ae4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:15.140717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fcf709d-2027-448a-acfb-8568fd44db1c tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:15.142207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fcf709d-2027-448a-acfb-8568fd44db1c tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:15.142679 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fcf709d-2027-448a-acfb-8568fd44db1c tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:15.143436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fcf709d-2027-448a-acfb-8568fd44db1c tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:15.143898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fcf709d-2027-448a-acfb-8568fd44db1c tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:15.144313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fcf709d-2027-448a-acfb-8568fd44db1c tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:15.181418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:15.231719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-23c132df-a68f-41da-9398-ab802b0a5436 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:15.270051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-23c132df-a68f-41da-9398-ab802b0a5436 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:15.276389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-23c132df-a68f-41da-9398-ab802b0a5436 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:15.283847 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-23c132df-a68f-41da-9398-ab802b0a5436 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1670 microversion: 2.20 time: 0.598170 Sep 07 12:58:15.288992 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2626/5202] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:58:14 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1670 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:58:15.597647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2fcf709d-2027-448a-acfb-8568fd44db1c tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ee744811d4061b12d8c89b1f107fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd519233d78e742ca8d835998527fbf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:15.609236 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2fcf709d-2027-448a-acfb-8568fd44db1c tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] 10.222.0.16 "GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4" status: 200 len: 1317 microversion: 2.1 time: 0.498286 Sep 07 12:58:15.624377 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2577/5203] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:15 2022] GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4 => generated 1317 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:16.156188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-69f57ebd-4168-4c1a-a223-0ace8a108139 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:16.158675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-69f57ebd-4168-4c1a-a223-0ace8a108139 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 0c054466-0769-4190-b9bd-ffe3b4a98706] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:16.174928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69f57ebd-4168-4c1a-a223-0ace8a108139 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:16.175908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69f57ebd-4168-4c1a-a223-0ace8a108139 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:16.176596 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69f57ebd-4168-4c1a-a223-0ace8a108139 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:16.178212 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69f57ebd-4168-4c1a-a223-0ace8a108139 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:16.179016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69f57ebd-4168-4c1a-a223-0ace8a108139 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:16.179724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69f57ebd-4168-4c1a-a223-0ace8a108139 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:16.326595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bedab4ee-d43d-4ab7-a673-278ca8050e94 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:16.327934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bedab4ee-d43d-4ab7-a673-278ca8050e94 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:16.346224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bedab4ee-d43d-4ab7-a673-278ca8050e94 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:16.347010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bedab4ee-d43d-4ab7-a673-278ca8050e94 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:16.347718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bedab4ee-d43d-4ab7-a673-278ca8050e94 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:16.348626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bedab4ee-d43d-4ab7-a673-278ca8050e94 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:16.349261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bedab4ee-d43d-4ab7-a673-278ca8050e94 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:16.349893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bedab4ee-d43d-4ab7-a673-278ca8050e94 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:16.518136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-69f57ebd-4168-4c1a-a223-0ace8a108139 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:16.538957 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-69f57ebd-4168-4c1a-a223-0ace8a108139 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706" status: 200 len: 1309 microversion: 2.1 time: 0.391974 Sep 07 12:58:16.540800 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2627/5204] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:16 2022] GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 => generated 1309 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:16.642146 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-65f5d734-2898-4e8c-b41b-00090d864ead tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:16.643794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-65f5d734-2898-4e8c-b41b-00090d864ead tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] [instance: d67fed78-36e7-4fbb-b165-823e47708ae4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:16.655935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65f5d734-2898-4e8c-b41b-00090d864ead tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:16.656801 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65f5d734-2898-4e8c-b41b-00090d864ead tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:16.658281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65f5d734-2898-4e8c-b41b-00090d864ead tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:16.660059 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65f5d734-2898-4e8c-b41b-00090d864ead tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:16.660995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65f5d734-2898-4e8c-b41b-00090d864ead tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:16.661979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65f5d734-2898-4e8c-b41b-00090d864ead tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:16.947553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-65f5d734-2898-4e8c-b41b-00090d864ead tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ee744811d4061b12d8c89b1f107fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd519233d78e742ca8d835998527fbf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:16.970182 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-65f5d734-2898-4e8c-b41b-00090d864ead tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] 10.222.0.16 "GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4" status: 200 len: 1506 microversion: 2.1 time: 0.333369 Sep 07 12:58:16.986078 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2628/5205] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:16 2022] GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4 => generated 1506 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:17.016034 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-67d86852-9ce1-4d12-813e-c2a345462b5d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:17.016558 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-67d86852-9ce1-4d12-813e-c2a345462b5d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] [instance: d67fed78-36e7-4fbb-b165-823e47708ae4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:17.037908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67d86852-9ce1-4d12-813e-c2a345462b5d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:17.041295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67d86852-9ce1-4d12-813e-c2a345462b5d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:17.041801 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67d86852-9ce1-4d12-813e-c2a345462b5d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:17.044769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67d86852-9ce1-4d12-813e-c2a345462b5d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:17.046896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67d86852-9ce1-4d12-813e-c2a345462b5d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:17.049507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67d86852-9ce1-4d12-813e-c2a345462b5d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:17.123957 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-67d86852-9ce1-4d12-813e-c2a345462b5d tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] 10.222.0.16 "GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4/ips" status: 200 len: 109 microversion: 2.1 time: 0.110277 Sep 07 12:58:17.135377 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2629/5206] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Sep 7 12:58:17 2022] GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4/ips => generated 109 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:58:17.147305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-922a39aa-e093-4676-bd0a-27cc5b366ee2 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:17.148196 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-922a39aa-e093-4676-bd0a-27cc5b366ee2 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] [instance: d67fed78-36e7-4fbb-b165-823e47708ae4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:17.164828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-922a39aa-e093-4676-bd0a-27cc5b366ee2 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:17.166375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-922a39aa-e093-4676-bd0a-27cc5b366ee2 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:17.169298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-922a39aa-e093-4676-bd0a-27cc5b366ee2 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:17.172658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-922a39aa-e093-4676-bd0a-27cc5b366ee2 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:17.174415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-922a39aa-e093-4676-bd0a-27cc5b366ee2 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:17.177277 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-922a39aa-e093-4676-bd0a-27cc5b366ee2 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:17.241872 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-922a39aa-e093-4676-bd0a-27cc5b366ee2 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] 10.222.0.16 "GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4/ips" status: 200 len: 109 microversion: 2.1 time: 0.104992 Sep 07 12:58:17.254747 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2630/5207] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Sep 7 12:58:17 2022] GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4/ips => generated 109 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:58:17.266539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f3038fd4-a922-49d8-b86d-57e54ae3763c tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:17.267569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f3038fd4-a922-49d8-b86d-57e54ae3763c tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] [instance: d67fed78-36e7-4fbb-b165-823e47708ae4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:17.286654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3038fd4-a922-49d8-b86d-57e54ae3763c tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:17.287644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3038fd4-a922-49d8-b86d-57e54ae3763c tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:17.288863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3038fd4-a922-49d8-b86d-57e54ae3763c tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:17.289814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3038fd4-a922-49d8-b86d-57e54ae3763c tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:17.290640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3038fd4-a922-49d8-b86d-57e54ae3763c tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:17.291566 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3038fd4-a922-49d8-b86d-57e54ae3763c tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:17.305324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:17.373431 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f3038fd4-a922-49d8-b86d-57e54ae3763c tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] 10.222.0.16 "GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4/ips/tempest-ServerAddressesTestJSON-405622375-network" status: 200 len: 94 microversion: 2.1 time: 0.111913 Sep 07 12:58:17.374151 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2631/5208] 10.222.0.16 () {58 vars in 1398 bytes} [Wed Sep 7 12:58:17 2022] GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4/ips/tempest-ServerAddressesTestJSON-405622375-network => generated 94 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 12:58:17.388911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0349d330-2b2d-4dd6-b3d2-cfc6d7138304 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:17.393407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0349d330-2b2d-4dd6-b3d2-cfc6d7138304 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] [instance: d67fed78-36e7-4fbb-b165-823e47708ae4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:17.409336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0349d330-2b2d-4dd6-b3d2-cfc6d7138304 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:17.414590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0349d330-2b2d-4dd6-b3d2-cfc6d7138304 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:17.415722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0349d330-2b2d-4dd6-b3d2-cfc6d7138304 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:17.419231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0349d330-2b2d-4dd6-b3d2-cfc6d7138304 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:17.421314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0349d330-2b2d-4dd6-b3d2-cfc6d7138304 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:17.422563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0349d330-2b2d-4dd6-b3d2-cfc6d7138304 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:17.466119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0349d330-2b2d-4dd6-b3d2-cfc6d7138304 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] [instance: d67fed78-36e7-4fbb-b165-823e47708ae4] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:58:17.547492 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bedab4ee-d43d-4ab7-a673-278ca8050e94 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:17.561875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bedab4ee-d43d-4ab7-a673-278ca8050e94 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:17.567943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bedab4ee-d43d-4ab7-a673-278ca8050e94 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:17.571926 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bedab4ee-d43d-4ab7-a673-278ca8050e94 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1670 microversion: 2.20 time: 1.248035 Sep 07 12:58:17.592510 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2578/5209] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:58:16 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1670 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:58:17.606382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-4a304a12-6afc-416e-888f-336bb017ef61 req-db2638e4-0215-4563-8687-fcdf8b15d465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c054466-0769-4190-b9bd-ffe3b4a98706", "name": "network-vif-plugged", "status": "completed", "tag": "639ebb5e-8d7d-4cc2-9542-be315d9b3af1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:58:17.634749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4a304a12-6afc-416e-888f-336bb017ef61 req-db2638e4-0215-4563-8687-fcdf8b15d465 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:17.635247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4a304a12-6afc-416e-888f-336bb017ef61 req-db2638e4-0215-4563-8687-fcdf8b15d465 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:17.635686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4a304a12-6afc-416e-888f-336bb017ef61 req-db2638e4-0215-4563-8687-fcdf8b15d465 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:17.667478 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-4a304a12-6afc-416e-888f-336bb017ef61 req-db2638e4-0215-4563-8687-fcdf8b15d465 service nova] Creating event network-vif-plugged:639ebb5e-8d7d-4cc2-9542-be315d9b3af1 for instance 0c054466-0769-4190-b9bd-ffe3b4a98706 on n-h2-852087-9 Sep 07 12:58:17.690470 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-4a304a12-6afc-416e-888f-336bb017ef61 req-db2638e4-0215-4563-8687-fcdf8b15d465 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088115 Sep 07 12:58:17.698666 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2579/5210] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:58:17.703137 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0349d330-2b2d-4dd6-b3d2-cfc6d7138304 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4" status: 204 len: 0 microversion: 2.1 time: 0.318216 Sep 07 12:58:17.704566 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2632/5211] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:58:17 2022] DELETE /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:17.722362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ce7a1fbb-fd2e-4a12-98d0-dbf16beef468 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:17.723407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ce7a1fbb-fd2e-4a12-98d0-dbf16beef468 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] [instance: d67fed78-36e7-4fbb-b165-823e47708ae4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:17.727775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f1c61294-3423-4049-a438-45d4ae307296 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:17.731955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce7a1fbb-fd2e-4a12-98d0-dbf16beef468 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:17.732723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce7a1fbb-fd2e-4a12-98d0-dbf16beef468 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:17.733250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce7a1fbb-fd2e-4a12-98d0-dbf16beef468 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:17.734148 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce7a1fbb-fd2e-4a12-98d0-dbf16beef468 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:17.735096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f1c61294-3423-4049-a438-45d4ae307296 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 0c054466-0769-4190-b9bd-ffe3b4a98706] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:17.735231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce7a1fbb-fd2e-4a12-98d0-dbf16beef468 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:17.735853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce7a1fbb-fd2e-4a12-98d0-dbf16beef468 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:17.796683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1c61294-3423-4049-a438-45d4ae307296 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:17.797559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1c61294-3423-4049-a438-45d4ae307296 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:17.805900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1c61294-3423-4049-a438-45d4ae307296 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:17.807184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1c61294-3423-4049-a438-45d4ae307296 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:17.807893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1c61294-3423-4049-a438-45d4ae307296 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:17.808586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1c61294-3423-4049-a438-45d4ae307296 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:18.319753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ce7a1fbb-fd2e-4a12-98d0-dbf16beef468 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ee744811d4061b12d8c89b1f107fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd519233d78e742ca8d835998527fbf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:18.336268 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ce7a1fbb-fd2e-4a12-98d0-dbf16beef468 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] 10.222.0.16 "GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4" status: 200 len: 1512 microversion: 2.1 time: 0.624250 Sep 07 12:58:18.336869 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2633/5212] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:17 2022] GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4 => generated 1512 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:58:18.410879 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f1c61294-3423-4049-a438-45d4ae307296 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:18.424264 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f1c61294-3423-4049-a438-45d4ae307296 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706" status: 200 len: 1309 microversion: 2.1 time: 0.720815 Sep 07 12:58:18.440660 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2580/5213] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:17 2022] GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 => generated 1309 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:18.610717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4c91c252-c7c9-4baf-be8b-4b82d7128835 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:18.611914 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4c91c252-c7c9-4baf-be8b-4b82d7128835 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:18.647195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c91c252-c7c9-4baf-be8b-4b82d7128835 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:18.647392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c91c252-c7c9-4baf-be8b-4b82d7128835 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:18.648333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c91c252-c7c9-4baf-be8b-4b82d7128835 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:18.657393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c91c252-c7c9-4baf-be8b-4b82d7128835 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:18.658350 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c91c252-c7c9-4baf-be8b-4b82d7128835 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:18.660686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c91c252-c7c9-4baf-be8b-4b82d7128835 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:19.362863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0e9a0441-aa3d-4396-88d2-d59b9d0aa51a tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:19.363758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0e9a0441-aa3d-4396-88d2-d59b9d0aa51a tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] [instance: d67fed78-36e7-4fbb-b165-823e47708ae4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:19.386817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4c91c252-c7c9-4baf-be8b-4b82d7128835 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:19.391035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e9a0441-aa3d-4396-88d2-d59b9d0aa51a tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:19.395643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e9a0441-aa3d-4396-88d2-d59b9d0aa51a tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:19.396003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e9a0441-aa3d-4396-88d2-d59b9d0aa51a tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:19.396769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e9a0441-aa3d-4396-88d2-d59b9d0aa51a tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:19.397243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e9a0441-aa3d-4396-88d2-d59b9d0aa51a tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:19.397707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e9a0441-aa3d-4396-88d2-d59b9d0aa51a tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:19.400279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4c91c252-c7c9-4baf-be8b-4b82d7128835 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:19.407419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4c91c252-c7c9-4baf-be8b-4b82d7128835 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:19.413890 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4c91c252-c7c9-4baf-be8b-4b82d7128835 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1670 microversion: 2.20 time: 0.816564 Sep 07 12:58:19.435576 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2634/5214] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:58:18 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1670 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:58:19.450818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2ca50b84-8bca-4a0e-affb-44d70a2ba70a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:19.451821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2ca50b84-8bca-4a0e-affb-44d70a2ba70a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 0c054466-0769-4190-b9bd-ffe3b4a98706] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:19.462676 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ca50b84-8bca-4a0e-affb-44d70a2ba70a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:19.463701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ca50b84-8bca-4a0e-affb-44d70a2ba70a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:19.464337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ca50b84-8bca-4a0e-affb-44d70a2ba70a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:19.465506 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ca50b84-8bca-4a0e-affb-44d70a2ba70a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:19.466828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ca50b84-8bca-4a0e-affb-44d70a2ba70a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:19.467525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ca50b84-8bca-4a0e-affb-44d70a2ba70a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:20.282008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0e9a0441-aa3d-4396-88d2-d59b9d0aa51a tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ee744811d4061b12d8c89b1f107fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd519233d78e742ca8d835998527fbf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:20.293210 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0e9a0441-aa3d-4396-88d2-d59b9d0aa51a tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] 10.222.0.16 "GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4" status: 200 len: 1512 microversion: 2.1 time: 0.935376 Sep 07 12:58:20.298088 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2581/5215] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:19 2022] GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4 => generated 1512 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:58:20.445914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-27963e58-6f7c-4d41-99a5-825d6580137b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:20.447661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-27963e58-6f7c-4d41-99a5-825d6580137b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:20.464543 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27963e58-6f7c-4d41-99a5-825d6580137b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:20.475642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27963e58-6f7c-4d41-99a5-825d6580137b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:20.476526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27963e58-6f7c-4d41-99a5-825d6580137b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:20.477537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27963e58-6f7c-4d41-99a5-825d6580137b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:20.481142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27963e58-6f7c-4d41-99a5-825d6580137b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:20.482027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-27963e58-6f7c-4d41-99a5-825d6580137b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:20.574466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2ca50b84-8bca-4a0e-affb-44d70a2ba70a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:20.601778 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2ca50b84-8bca-4a0e-affb-44d70a2ba70a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706" status: 200 len: 1309 microversion: 2.1 time: 1.156898 Sep 07 12:58:20.605065 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2635/5216] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:19 2022] GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 => generated 1309 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:58:21.145576 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-27963e58-6f7c-4d41-99a5-825d6580137b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:21.155750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-27963e58-6f7c-4d41-99a5-825d6580137b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:21.163854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-27963e58-6f7c-4d41-99a5-825d6580137b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:21.165461 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-27963e58-6f7c-4d41-99a5-825d6580137b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1728 microversion: 2.20 time: 0.725583 Sep 07 12:58:21.170331 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2582/5217] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:58:20 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1728 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:58:21.347508 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-233c2117-05ea-4dca-9562-fa8bb7a8e507 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:21.349676 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-233c2117-05ea-4dca-9562-fa8bb7a8e507 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] [instance: d67fed78-36e7-4fbb-b165-823e47708ae4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:21.369098 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-233c2117-05ea-4dca-9562-fa8bb7a8e507 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:21.371057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-233c2117-05ea-4dca-9562-fa8bb7a8e507 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:21.373801 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-233c2117-05ea-4dca-9562-fa8bb7a8e507 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:21.376179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-233c2117-05ea-4dca-9562-fa8bb7a8e507 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:21.378225 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-233c2117-05ea-4dca-9562-fa8bb7a8e507 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:21.379432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-233c2117-05ea-4dca-9562-fa8bb7a8e507 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:21.640358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0a56dbf7-9210-4759-a8a9-5b4f73b84173 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:21.641398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0a56dbf7-9210-4759-a8a9-5b4f73b84173 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 0c054466-0769-4190-b9bd-ffe3b4a98706] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:21.684694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a56dbf7-9210-4759-a8a9-5b4f73b84173 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:21.690844 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a56dbf7-9210-4759-a8a9-5b4f73b84173 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:21.691957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a56dbf7-9210-4759-a8a9-5b4f73b84173 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:21.697757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a56dbf7-9210-4759-a8a9-5b4f73b84173 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:21.699038 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a56dbf7-9210-4759-a8a9-5b4f73b84173 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:21.700446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a56dbf7-9210-4759-a8a9-5b4f73b84173 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:22.578459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-233c2117-05ea-4dca-9562-fa8bb7a8e507 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ee744811d4061b12d8c89b1f107fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd519233d78e742ca8d835998527fbf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:22.587263 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-233c2117-05ea-4dca-9562-fa8bb7a8e507 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] 10.222.0.16 "GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4" status: 200 len: 1512 microversion: 2.1 time: 1.263624 Sep 07 12:58:22.597402 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2636/5218] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:21 2022] GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4 => generated 1512 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:22.613692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a20a4dff-78dd-4885-aed4-c52d8290a312 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:22.619882 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a20a4dff-78dd-4885-aed4-c52d8290a312 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:22.644311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a20a4dff-78dd-4885-aed4-c52d8290a312 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:22.645091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a20a4dff-78dd-4885-aed4-c52d8290a312 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:22.645733 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a20a4dff-78dd-4885-aed4-c52d8290a312 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:22.646694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a20a4dff-78dd-4885-aed4-c52d8290a312 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:22.647571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a20a4dff-78dd-4885-aed4-c52d8290a312 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:22.648230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a20a4dff-78dd-4885-aed4-c52d8290a312 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:23.203484 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0a56dbf7-9210-4759-a8a9-5b4f73b84173 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:23.231947 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0a56dbf7-9210-4759-a8a9-5b4f73b84173 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706" status: 200 len: 1491 microversion: 2.1 time: 1.597910 Sep 07 12:58:23.236860 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2583/5219] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:21 2022] GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 => generated 1491 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:23.256162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-95dcd4e0-6f86-4d86-9372-8ee9a2cf6e04 req-252ee7e7-e190-4d5e-9481-55a1a4c1f831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67fed78-36e7-4fbb-b165-823e47708ae4", "name": "network-vif-deleted", "tag": "411864e9-e097-4ab4-99cb-e5103da5d8c5"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:58:23.339615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-95dcd4e0-6f86-4d86-9372-8ee9a2cf6e04 req-252ee7e7-e190-4d5e-9481-55a1a4c1f831 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:23.341147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-95dcd4e0-6f86-4d86-9372-8ee9a2cf6e04 req-252ee7e7-e190-4d5e-9481-55a1a4c1f831 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:23.346705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-95dcd4e0-6f86-4d86-9372-8ee9a2cf6e04 req-252ee7e7-e190-4d5e-9481-55a1a4c1f831 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:23.408800 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-95dcd4e0-6f86-4d86-9372-8ee9a2cf6e04 req-252ee7e7-e190-4d5e-9481-55a1a4c1f831 service nova] Creating event network-vif-deleted:411864e9-e097-4ab4-99cb-e5103da5d8c5 for instance d67fed78-36e7-4fbb-b165-823e47708ae4 on n-h1-852087-9 Sep 07 12:58:23.467179 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-95dcd4e0-6f86-4d86-9372-8ee9a2cf6e04 req-252ee7e7-e190-4d5e-9481-55a1a4c1f831 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227549 Sep 07 12:58:23.488931 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2584/5220] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:58:23.523418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-59561fbd-43fa-4f98-8789-d9ea4e292efe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:58:23.533193 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-59561fbd-43fa-4f98-8789-d9ea4e292efe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 0c054466-0769-4190-b9bd-ffe3b4a98706] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:23.561131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59561fbd-43fa-4f98-8789-d9ea4e292efe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:23.562440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59561fbd-43fa-4f98-8789-d9ea4e292efe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:23.566863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59561fbd-43fa-4f98-8789-d9ea4e292efe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:23.569146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59561fbd-43fa-4f98-8789-d9ea4e292efe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:23.570080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59561fbd-43fa-4f98-8789-d9ea4e292efe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:23.570858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59561fbd-43fa-4f98-8789-d9ea4e292efe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:23.774124 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-59561fbd-43fa-4f98-8789-d9ea4e292efe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "PUT /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706" status: 200 len: 1086 microversion: 2.1 time: 0.276692 Sep 07 12:58:23.775685 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2585/5221] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Sep 7 12:58:23 2022] PUT /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 => generated 1086 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:23.781410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8f5aeca0-1795-4138-bb66-cab6f7c235a6 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:23.782640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8f5aeca0-1795-4138-bb66-cab6f7c235a6 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] [instance: d67fed78-36e7-4fbb-b165-823e47708ae4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:23.791475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f5aeca0-1795-4138-bb66-cab6f7c235a6 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:23.793666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f5aeca0-1795-4138-bb66-cab6f7c235a6 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:23.794502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f5aeca0-1795-4138-bb66-cab6f7c235a6 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:23.795511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f5aeca0-1795-4138-bb66-cab6f7c235a6 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:23.796199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f5aeca0-1795-4138-bb66-cab6f7c235a6 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:23.796830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8f5aeca0-1795-4138-bb66-cab6f7c235a6 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:23.827762 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-8f5aeca0-1795-4138-bb66-cab6f7c235a6 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] HTTP exception thrown: Instance d67fed78-36e7-4fbb-b165-823e47708ae4 could not be found. Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8f5aeca0-1795-4138-bb66-cab6f7c235a6 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Request method failure captured: Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4 HTTP/1.1 Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJVKd-KJrEfZyRHbnnkUN6qCzRwvi2YnRCszrYWgOf0-jIG1mEhdyUWBNAR6T4DmWlpTDUK2zxiaBDQhyLQDi1n1ajQSOYL6AnbxDlri4US3LZONwpTryF9a_rFrpw4pxh3uaQFQZNJkhrFBnrhaouEsf8qdlbVWaPIshxNzEumKwn0 Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: d519233d78e742ca8d835998527fbf2d Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerAddressesTestJSON-2025830526 Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d519233d78e742ca8d835998527fbf2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d519233d78e742ca8d835998527fbf2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d519233d78e742ca8d835998527fbf2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d519233d78e742ca8d835998527fbf2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerAddressesTestJSON-2025830526 Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: d519233d78e742ca8d835998527fbf2d Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerAddressesTestJSON-2025830526 Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerAddressesTestJSON-2025830526-project Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 658ee744811d4061b12d8c89b1f107fa Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerAddressesTestJSON-2025830526-project Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance d67fed78-36e7-4fbb-b165-823e47708ae4 could not be found. Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'd67fed78-36e7-4fbb-b165-823e47708ae4'} Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d67fed78-36e7-4fbb-b165-823e47708ae4 could not be found. Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d67fed78-36e7-4fbb-b165-823e47708ae4 could not be found. Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:58:23.832711 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:58:23.839003 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:58:23.839003 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:58:23.839003 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:58:23.839003 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:58:23.839003 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:58:23.839003 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d67fed78-36e7-4fbb-b165-823e47708ae4 could not be found. Sep 07 12:58:23.839003 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:58:23.839003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8f5aeca0-1795-4138-bb66-cab6f7c235a6 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] Returning 404 to user: Instance d67fed78-36e7-4fbb-b165-823e47708ae4 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:58:23.840154 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8f5aeca0-1795-4138-bb66-cab6f7c235a6 tempest-ServerAddressesTestJSON-2025830526 tempest-ServerAddressesTestJSON-2025830526-project] 10.222.0.16 "GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4" status: 404 len: 111 microversion: 2.1 time: 0.061510 Sep 07 12:58:23.840889 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2586/5222] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:23 2022] GET /compute/v2.1/servers/d67fed78-36e7-4fbb-b165-823e47708ae4 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:58:23.867793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c1adf022-f60c-4998-92b5-d5586224c5f2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:23.882860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c1adf022-f60c-4998-92b5-d5586224c5f2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 0c054466-0769-4190-b9bd-ffe3b4a98706] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:23.899852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1adf022-f60c-4998-92b5-d5586224c5f2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:23.900985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1adf022-f60c-4998-92b5-d5586224c5f2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:23.902827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1adf022-f60c-4998-92b5-d5586224c5f2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:23.904856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1adf022-f60c-4998-92b5-d5586224c5f2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:23.905752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1adf022-f60c-4998-92b5-d5586224c5f2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:23.907106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1adf022-f60c-4998-92b5-d5586224c5f2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:24.139781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a20a4dff-78dd-4885-aed4-c52d8290a312 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:24.149100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a20a4dff-78dd-4885-aed4-c52d8290a312 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:24.157918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a20a4dff-78dd-4885-aed4-c52d8290a312 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:24.159674 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a20a4dff-78dd-4885-aed4-c52d8290a312 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1728 microversion: 2.20 time: 1.560903 Sep 07 12:58:24.163076 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2637/5223] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:58:22 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1728 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:58:24.609552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c1adf022-f60c-4998-92b5-d5586224c5f2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:24.631699 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c1adf022-f60c-4998-92b5-d5586224c5f2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706" status: 200 len: 1512 microversion: 2.1 time: 0.788248 Sep 07 12:58:24.634910 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2587/5224] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:23 2022] GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 => generated 1512 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:24.665037 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9ec0de04-54b5-42aa-8a71-1ba90770cf52 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:24.667841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9ec0de04-54b5-42aa-8a71-1ba90770cf52 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 0c054466-0769-4190-b9bd-ffe3b4a98706] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:24.688178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ec0de04-54b5-42aa-8a71-1ba90770cf52 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:24.689841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ec0de04-54b5-42aa-8a71-1ba90770cf52 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:24.690687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ec0de04-54b5-42aa-8a71-1ba90770cf52 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:24.692664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ec0de04-54b5-42aa-8a71-1ba90770cf52 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:24.693554 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ec0de04-54b5-42aa-8a71-1ba90770cf52 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:24.694471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ec0de04-54b5-42aa-8a71-1ba90770cf52 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:25.205360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32f7983c-89a4-4831-95a3-5d3ff28f529b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:25.206371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-32f7983c-89a4-4831-95a3-5d3ff28f529b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:25.214604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32f7983c-89a4-4831-95a3-5d3ff28f529b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:25.215121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32f7983c-89a4-4831-95a3-5d3ff28f529b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:25.215784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32f7983c-89a4-4831-95a3-5d3ff28f529b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:25.216590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32f7983c-89a4-4831-95a3-5d3ff28f529b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:25.217227 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32f7983c-89a4-4831-95a3-5d3ff28f529b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:25.217885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32f7983c-89a4-4831-95a3-5d3ff28f529b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:25.429355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9ec0de04-54b5-42aa-8a71-1ba90770cf52 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:25.443040 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9ec0de04-54b5-42aa-8a71-1ba90770cf52 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706" status: 200 len: 1512 microversion: 2.1 time: 0.790578 Sep 07 12:58:25.443977 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2638/5225] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:24 2022] GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 => generated 1512 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:25.486042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c52566a1-3546-421f-af46-b2b99a016ddd tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:25.486979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c52566a1-3546-421f-af46-b2b99a016ddd tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 0c054466-0769-4190-b9bd-ffe3b4a98706] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:25.504660 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c52566a1-3546-421f-af46-b2b99a016ddd tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:25.505281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c52566a1-3546-421f-af46-b2b99a016ddd tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:25.506492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c52566a1-3546-421f-af46-b2b99a016ddd tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:25.507160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c52566a1-3546-421f-af46-b2b99a016ddd tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:25.507925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c52566a1-3546-421f-af46-b2b99a016ddd tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:25.508653 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c52566a1-3546-421f-af46-b2b99a016ddd tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:25.550070 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c52566a1-3546-421f-af46-b2b99a016ddd tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 0c054466-0769-4190-b9bd-ffe3b4a98706] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:58:25.716847 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c52566a1-3546-421f-af46-b2b99a016ddd tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706" status: 204 len: 0 microversion: 2.1 time: 0.237950 Sep 07 12:58:25.719752 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2639/5226] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:58:25 2022] DELETE /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:25.736649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-f81922db-d0c4-4127-ab11-30fb2e9aa07a req-1f707834-6ed3-4236-a64d-215deeb2f4ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35f328e5-ec00-4403-8196-cbefa047877b", "tag": "13d7f17d-cb66-4016-a84a-aec1e39c3e03"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:58:25.768750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f81922db-d0c4-4127-ab11-30fb2e9aa07a req-1f707834-6ed3-4236-a64d-215deeb2f4ea service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:25.769670 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f81922db-d0c4-4127-ab11-30fb2e9aa07a req-1f707834-6ed3-4236-a64d-215deeb2f4ea service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:25.770329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f81922db-d0c4-4127-ab11-30fb2e9aa07a req-1f707834-6ed3-4236-a64d-215deeb2f4ea service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:25.791063 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-f81922db-d0c4-4127-ab11-30fb2e9aa07a req-1f707834-6ed3-4236-a64d-215deeb2f4ea service nova] Creating event network-changed:13d7f17d-cb66-4016-a84a-aec1e39c3e03 for instance 35f328e5-ec00-4403-8196-cbefa047877b on n-h1-852087-9 Sep 07 12:58:25.796991 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-f81922db-d0c4-4127-ab11-30fb2e9aa07a req-1f707834-6ed3-4236-a64d-215deeb2f4ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074420 Sep 07 12:58:25.799528 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2640/5227] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:58:25.807503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5671fcc8-d0aa-4310-999a-a7c7bc26938b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:25.807503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5671fcc8-d0aa-4310-999a-a7c7bc26938b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 0c054466-0769-4190-b9bd-ffe3b4a98706] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:25.827082 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5671fcc8-d0aa-4310-999a-a7c7bc26938b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:25.827514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5671fcc8-d0aa-4310-999a-a7c7bc26938b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:25.828105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5671fcc8-d0aa-4310-999a-a7c7bc26938b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:25.828931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5671fcc8-d0aa-4310-999a-a7c7bc26938b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:25.830403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5671fcc8-d0aa-4310-999a-a7c7bc26938b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:25.831137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5671fcc8-d0aa-4310-999a-a7c7bc26938b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:25.882112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-32f7983c-89a4-4831-95a3-5d3ff28f529b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:25.911876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-32f7983c-89a4-4831-95a3-5d3ff28f529b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:25.923616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-32f7983c-89a4-4831-95a3-5d3ff28f529b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:25.925546 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-32f7983c-89a4-4831-95a3-5d3ff28f529b tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1728 microversion: 2.20 time: 0.727791 Sep 07 12:58:25.926655 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2588/5228] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:58:25 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1728 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:58:26.653906 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5671fcc8-d0aa-4310-999a-a7c7bc26938b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:26.678697 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5671fcc8-d0aa-4310-999a-a7c7bc26938b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706" status: 200 len: 1518 microversion: 2.1 time: 0.876251 Sep 07 12:58:26.679536 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2641/5229] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:25 2022] GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 => generated 1518 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:27.000069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3227c6d0-3336-4a1d-879c-c06b826bbd8c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:27.008662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3227c6d0-3336-4a1d-879c-c06b826bbd8c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:27.064558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3227c6d0-3336-4a1d-879c-c06b826bbd8c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:27.072923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3227c6d0-3336-4a1d-879c-c06b826bbd8c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:27.082573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3227c6d0-3336-4a1d-879c-c06b826bbd8c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:27.085859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3227c6d0-3336-4a1d-879c-c06b826bbd8c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:27.086856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3227c6d0-3336-4a1d-879c-c06b826bbd8c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:27.088437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3227c6d0-3336-4a1d-879c-c06b826bbd8c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:27.715137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dc137ee4-0d18-422f-8fb0-d59f74f61420 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:27.721935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dc137ee4-0d18-422f-8fb0-d59f74f61420 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 0c054466-0769-4190-b9bd-ffe3b4a98706] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:27.746415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc137ee4-0d18-422f-8fb0-d59f74f61420 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:27.749033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc137ee4-0d18-422f-8fb0-d59f74f61420 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:27.751170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc137ee4-0d18-422f-8fb0-d59f74f61420 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:27.758972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc137ee4-0d18-422f-8fb0-d59f74f61420 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:27.760188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc137ee4-0d18-422f-8fb0-d59f74f61420 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:27.761140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc137ee4-0d18-422f-8fb0-d59f74f61420 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:28.310420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3227c6d0-3336-4a1d-879c-c06b826bbd8c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:28.332741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3227c6d0-3336-4a1d-879c-c06b826bbd8c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:28.334493 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3227c6d0-3336-4a1d-879c-c06b826bbd8c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:28.335764 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3227c6d0-3336-4a1d-879c-c06b826bbd8c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1728 microversion: 2.20 time: 1.363045 Sep 07 12:58:28.346426 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2589/5230] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:58:26 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1728 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:58:28.698142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dc137ee4-0d18-422f-8fb0-d59f74f61420 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:28.728223 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dc137ee4-0d18-422f-8fb0-d59f74f61420 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706" status: 200 len: 1518 microversion: 2.1 time: 1.020129 Sep 07 12:58:28.745677 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2642/5231] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:27 2022] GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 => generated 1518 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:29.391589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9c9d2d71-9e42-4b27-a937-5ac9f64650c1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:29.397761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9c9d2d71-9e42-4b27-a937-5ac9f64650c1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:29.439234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c9d2d71-9e42-4b27-a937-5ac9f64650c1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:29.441349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c9d2d71-9e42-4b27-a937-5ac9f64650c1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:29.444888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c9d2d71-9e42-4b27-a937-5ac9f64650c1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:29.446964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c9d2d71-9e42-4b27-a937-5ac9f64650c1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:29.448176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c9d2d71-9e42-4b27-a937-5ac9f64650c1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:29.449743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c9d2d71-9e42-4b27-a937-5ac9f64650c1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:29.755954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5002ae57-7edc-4133-8a9f-b41e471eb803 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:29.756944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5002ae57-7edc-4133-8a9f-b41e471eb803 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 0c054466-0769-4190-b9bd-ffe3b4a98706] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:29.781782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5002ae57-7edc-4133-8a9f-b41e471eb803 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:29.782300 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5002ae57-7edc-4133-8a9f-b41e471eb803 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:29.789436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5002ae57-7edc-4133-8a9f-b41e471eb803 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:29.792668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5002ae57-7edc-4133-8a9f-b41e471eb803 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:29.793172 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5002ae57-7edc-4133-8a9f-b41e471eb803 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:29.793661 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5002ae57-7edc-4133-8a9f-b41e471eb803 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:31.326663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5002ae57-7edc-4133-8a9f-b41e471eb803 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:31.336799 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5002ae57-7edc-4133-8a9f-b41e471eb803 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706" status: 200 len: 1518 microversion: 2.1 time: 1.586019 Sep 07 12:58:31.347426 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2643/5232] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:29 2022] GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 => generated 1518 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:58:32.024959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9c9d2d71-9e42-4b27-a937-5ac9f64650c1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:32.044023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9c9d2d71-9e42-4b27-a937-5ac9f64650c1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:32.048877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9c9d2d71-9e42-4b27-a937-5ac9f64650c1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:32.054505 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9c9d2d71-9e42-4b27-a937-5ac9f64650c1 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1728 microversion: 2.20 time: 2.678463 Sep 07 12:58:32.056959 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2590/5233] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:58:29 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1728 bytes in 2683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:58:32.377007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-95c3bd9f-3000-47af-8708-81ff98475eda tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:32.377926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-95c3bd9f-3000-47af-8708-81ff98475eda tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 0c054466-0769-4190-b9bd-ffe3b4a98706] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:32.403160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95c3bd9f-3000-47af-8708-81ff98475eda tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:32.403671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95c3bd9f-3000-47af-8708-81ff98475eda tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:32.406862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95c3bd9f-3000-47af-8708-81ff98475eda tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:32.407655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95c3bd9f-3000-47af-8708-81ff98475eda tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:32.408141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95c3bd9f-3000-47af-8708-81ff98475eda tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:32.408603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95c3bd9f-3000-47af-8708-81ff98475eda tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:32.528598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-470c9644-7e24-432a-be6e-10f60315591a req-a7fd1784-d3f1-4173-b3af-3ef6957f3e18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c054466-0769-4190-b9bd-ffe3b4a98706", "name": "network-vif-deleted", "tag": "639ebb5e-8d7d-4cc2-9542-be315d9b3af1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:58:32.608287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-470c9644-7e24-432a-be6e-10f60315591a req-a7fd1784-d3f1-4173-b3af-3ef6957f3e18 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:32.609843 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-470c9644-7e24-432a-be6e-10f60315591a req-a7fd1784-d3f1-4173-b3af-3ef6957f3e18 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:32.610366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-470c9644-7e24-432a-be6e-10f60315591a req-a7fd1784-d3f1-4173-b3af-3ef6957f3e18 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:32.699200 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-470c9644-7e24-432a-be6e-10f60315591a req-a7fd1784-d3f1-4173-b3af-3ef6957f3e18 service nova] Creating event network-vif-deleted:639ebb5e-8d7d-4cc2-9542-be315d9b3af1 for instance 0c054466-0769-4190-b9bd-ffe3b4a98706 on n-h2-852087-9 Sep 07 12:58:32.724391 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-470c9644-7e24-432a-be6e-10f60315591a req-a7fd1784-d3f1-4173-b3af-3ef6957f3e18 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200625 Sep 07 12:58:32.727667 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2591/5234] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:58:33.113525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9f2be723-9e77-45a7-b4ac-aaa8aa8c1237 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:33.115163 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9f2be723-9e77-45a7-b4ac-aaa8aa8c1237 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:33.130995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f2be723-9e77-45a7-b4ac-aaa8aa8c1237 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:33.134101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f2be723-9e77-45a7-b4ac-aaa8aa8c1237 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:33.134563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f2be723-9e77-45a7-b4ac-aaa8aa8c1237 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:33.139270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f2be723-9e77-45a7-b4ac-aaa8aa8c1237 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:33.139533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f2be723-9e77-45a7-b4ac-aaa8aa8c1237 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:33.140663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9f2be723-9e77-45a7-b4ac-aaa8aa8c1237 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:33.785361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-95c3bd9f-3000-47af-8708-81ff98475eda tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:33.799032 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-95c3bd9f-3000-47af-8708-81ff98475eda tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706" status: 200 len: 1476 microversion: 2.1 time: 1.426116 Sep 07 12:58:33.820976 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2644/5235] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:32 2022] GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 => generated 1476 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:34.443717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9f2be723-9e77-45a7-b4ac-aaa8aa8c1237 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:34.458422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9f2be723-9e77-45a7-b4ac-aaa8aa8c1237 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:34.461128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9f2be723-9e77-45a7-b4ac-aaa8aa8c1237 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:34.464593 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9f2be723-9e77-45a7-b4ac-aaa8aa8c1237 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1728 microversion: 2.20 time: 1.355800 Sep 07 12:58:34.467643 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2592/5236] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:58:33 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1728 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:58:34.829287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fdcd0ebc-6a61-4b24-9207-0a315a230eff tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:34.831238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fdcd0ebc-6a61-4b24-9207-0a315a230eff tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 0c054466-0769-4190-b9bd-ffe3b4a98706] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:34.849542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdcd0ebc-6a61-4b24-9207-0a315a230eff tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:34.850572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdcd0ebc-6a61-4b24-9207-0a315a230eff tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:34.851442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdcd0ebc-6a61-4b24-9207-0a315a230eff tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:34.852429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdcd0ebc-6a61-4b24-9207-0a315a230eff tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:34.853129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdcd0ebc-6a61-4b24-9207-0a315a230eff tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:34.853956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fdcd0ebc-6a61-4b24-9207-0a315a230eff tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:34.880655 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-fdcd0ebc-6a61-4b24-9207-0a315a230eff tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] HTTP exception thrown: Instance 0c054466-0769-4190-b9bd-ffe3b4a98706 could not be found. Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fdcd0ebc-6a61-4b24-9207-0a315a230eff tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Request method failure captured: Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 HTTP/1.1 Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJSE5qt3MMvCiXM6JMYUN7f1buxIi7ST_NSWH8b3Iy1XPUp8KO4zG-NXQgWVN1Z7GE3sHXszWiKCVOYqqXwQROrdr4ZEFwz_8XPZaHXiJBQID0HYLx7sZ_BMJTKC5v-6tuUaVizJ_CnloOe2V1xTk5bkZGekyl16F75E8fKcPIskPJo Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestJSON-553840835 Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestJSON-553840835 Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestJSON-553840835 Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersTestJSON-553840835-project Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6ac786dc6d7847f582262dcd912c3f06 Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestJSON-553840835-project Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 0c054466-0769-4190-b9bd-ffe3b4a98706 could not be found. Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '0c054466-0769-4190-b9bd-ffe3b4a98706'} Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c054466-0769-4190-b9bd-ffe3b4a98706 could not be found. Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c054466-0769-4190-b9bd-ffe3b4a98706 could not be found. Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:58:34.883401 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:58:34.890014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:58:34.890014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:58:34.890014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:58:34.890014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:58:34.890014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c054466-0769-4190-b9bd-ffe3b4a98706 could not be found. Sep 07 12:58:34.890014 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:58:34.892898 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fdcd0ebc-6a61-4b24-9207-0a315a230eff tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Returning 404 to user: Instance 0c054466-0769-4190-b9bd-ffe3b4a98706 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:58:34.894339 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fdcd0ebc-6a61-4b24-9207-0a315a230eff tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706" status: 404 len: 111 microversion: 2.1 time: 0.069924 Sep 07 12:58:34.906791 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2645/5237] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:34 2022] GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:58:35.234679 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-756f047c-b556-470d-b810-d5074620c577 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-263915057", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "1c45fce2-7bfe-4e93-8f9c-12b9830de28b"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:58:35.267351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=56 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:35.415297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-756f047c-b556-470d-b810-d5074620c577 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] validate_networks() for [('1c45fce2-7bfe-4e93-8f9c-12b9830de28b', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:58:35.520708 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cdecf090-ea90-4908-8e55-b4d7792e815c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:35.521788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cdecf090-ea90-4908-8e55-b4d7792e815c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:35.542062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdecf090-ea90-4908-8e55-b4d7792e815c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:35.546376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdecf090-ea90-4908-8e55-b4d7792e815c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:35.547246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdecf090-ea90-4908-8e55-b4d7792e815c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:35.548248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdecf090-ea90-4908-8e55-b4d7792e815c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:35.548999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdecf090-ea90-4908-8e55-b4d7792e815c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:35.549711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdecf090-ea90-4908-8e55-b4d7792e815c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:35.656509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:36.389810 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cdecf090-ea90-4908-8e55-b4d7792e815c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:36.458857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cdecf090-ea90-4908-8e55-b4d7792e815c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:36.473194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cdecf090-ea90-4908-8e55-b4d7792e815c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:36.480315 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cdecf090-ea90-4908-8e55-b4d7792e815c tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1728 microversion: 2.20 time: 0.958853 Sep 07 12:58:36.482125 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2646/5238] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:58:35 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1728 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:58:37.530470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e22b4ccf-c560-4168-b894-21b516ddf712 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:37.536425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e22b4ccf-c560-4168-b894-21b516ddf712 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:37.564917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:37.568376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e22b4ccf-c560-4168-b894-21b516ddf712 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:37.569532 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e22b4ccf-c560-4168-b894-21b516ddf712 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:37.570094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e22b4ccf-c560-4168-b894-21b516ddf712 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:37.571856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e22b4ccf-c560-4168-b894-21b516ddf712 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:37.580891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e22b4ccf-c560-4168-b894-21b516ddf712 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:37.585422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e22b4ccf-c560-4168-b894-21b516ddf712 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:39.855263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e22b4ccf-c560-4168-b894-21b516ddf712 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:39.891481 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e22b4ccf-c560-4168-b894-21b516ddf712 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:39.899173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e22b4ccf-c560-4168-b894-21b516ddf712 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:39.905370 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e22b4ccf-c560-4168-b894-21b516ddf712 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1728 microversion: 2.20 time: 2.380977 Sep 07 12:58:39.910240 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2647/5239] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:58:37 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1728 bytes in 2389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:58:39.934727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-278f675a-184d-4a7d-90a9-3be9704be0ff tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:39.935977 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-278f675a-184d-4a7d-90a9-3be9704be0ff tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:39.963039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-278f675a-184d-4a7d-90a9-3be9704be0ff tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:39.970348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-278f675a-184d-4a7d-90a9-3be9704be0ff tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:39.971407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-278f675a-184d-4a7d-90a9-3be9704be0ff tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:39.973137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-278f675a-184d-4a7d-90a9-3be9704be0ff tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:39.974283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-278f675a-184d-4a7d-90a9-3be9704be0ff tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:39.975622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-278f675a-184d-4a7d-90a9-3be9704be0ff tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:40.324609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-278f675a-184d-4a7d-90a9-3be9704be0ff tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lazy-loading 'services' on Instance uuid f37444bc-ff3d-40dd-8501-7b8794d8b1ef {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:58:40.715987 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-278f675a-184d-4a7d-90a9-3be9704be0ff tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef/os-volume_attachments/428b8f19-cc79-4c5d-b08c-ee7dfb9c7d22" status: 202 len: 0 microversion: 2.1 time: 0.800788 Sep 07 12:58:40.717066 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2648/5240] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Sep 7 12:58:39 2022] DELETE /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef/os-volume_attachments/428b8f19-cc79-4c5d-b08c-ee7dfb9c7d22 => generated 0 bytes in 806 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:58:40.969412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0001392c-8b50-4cde-83c5-9b60fdbab427 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:40.983544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0001392c-8b50-4cde-83c5-9b60fdbab427 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:41.004838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0001392c-8b50-4cde-83c5-9b60fdbab427 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:41.006615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0001392c-8b50-4cde-83c5-9b60fdbab427 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:41.007609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0001392c-8b50-4cde-83c5-9b60fdbab427 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:41.009266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0001392c-8b50-4cde-83c5-9b60fdbab427 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:41.010402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0001392c-8b50-4cde-83c5-9b60fdbab427 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:41.011318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0001392c-8b50-4cde-83c5-9b60fdbab427 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:44.033992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-756f047c-b556-470d-b810-d5074620c577 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:58:44.035765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-756f047c-b556-470d-b810-d5074620c577 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:58:44.039453 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-756f047c-b556-470d-b810-d5074620c577 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:58:44.043472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-756f047c-b556-470d-b810-d5074620c577 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:58:44.047395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-756f047c-b556-470d-b810-d5074620c577 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:58:44.090971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-756f047c-b556-470d-b810-d5074620c577 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:44.093059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-756f047c-b556-470d-b810-d5074620c577 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:44.110495 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-756f047c-b556-470d-b810-d5074620c577 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:44.112907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-756f047c-b556-470d-b810-d5074620c577 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:44.114289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-756f047c-b556-470d-b810-d5074620c577 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:44.116414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-756f047c-b556-470d-b810-d5074620c577 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:44.202468 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-756f047c-b556-470d-b810-d5074620c577 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Getting quotas for project 854c6a81bbfd4ab79126799ec40c954e. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:58:44.220718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-756f047c-b556-470d-b810-d5074620c577 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Getting quotas for user 6ac786dc6d7847f582262dcd912c3f06 and project 854c6a81bbfd4ab79126799ec40c954e. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:58:44.259622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-756f047c-b556-470d-b810-d5074620c577 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:58:44.264701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-756f047c-b556-470d-b810-d5074620c577 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:58:44.421004 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-756f047c-b556-470d-b810-d5074620c577 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.190227 Sep 07 12:58:44.422703 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2593/5241] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:58:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 9194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:58:44.450270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d33b1039-bfde-4681-aedd-6f5e79e86669 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:44.452183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d33b1039-bfde-4681-aedd-6f5e79e86669 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:45.195680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d33b1039-bfde-4681-aedd-6f5e79e86669 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:45.232841 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d33b1039-bfde-4681-aedd-6f5e79e86669 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1208 microversion: 2.1 time: 0.794108 Sep 07 12:58:45.233708 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2594/5242] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:44 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1208 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:58:45.407423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0001392c-8b50-4cde-83c5-9b60fdbab427 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:45.469608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0001392c-8b50-4cde-83c5-9b60fdbab427 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:45.471169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0001392c-8b50-4cde-83c5-9b60fdbab427 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:45.472688 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0001392c-8b50-4cde-83c5-9b60fdbab427 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1728 microversion: 2.20 time: 4.524746 Sep 07 12:58:45.479451 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2649/5243] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:58:40 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1728 bytes in 4533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:58:46.271449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e8a2e170-f4fe-4836-a2dc-766d72eab96b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:46.273301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e8a2e170-f4fe-4836-a2dc-766d72eab96b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:46.321540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8a2e170-f4fe-4836-a2dc-766d72eab96b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:46.326053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8a2e170-f4fe-4836-a2dc-766d72eab96b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:46.327869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8a2e170-f4fe-4836-a2dc-766d72eab96b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:46.331397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8a2e170-f4fe-4836-a2dc-766d72eab96b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:46.338729 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8a2e170-f4fe-4836-a2dc-766d72eab96b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:46.341288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e8a2e170-f4fe-4836-a2dc-766d72eab96b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:46.501333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:46.535512 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-938bb3f2-6052-48b2-b203-9c16ffcd4593 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:46.536705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-938bb3f2-6052-48b2-b203-9c16ffcd4593 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:46.583158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-938bb3f2-6052-48b2-b203-9c16ffcd4593 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:46.584199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-938bb3f2-6052-48b2-b203-9c16ffcd4593 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:46.587647 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-938bb3f2-6052-48b2-b203-9c16ffcd4593 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:46.593179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-938bb3f2-6052-48b2-b203-9c16ffcd4593 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:46.594065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-938bb3f2-6052-48b2-b203-9c16ffcd4593 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:46.597464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-938bb3f2-6052-48b2-b203-9c16ffcd4593 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:47.255439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e8a2e170-f4fe-4836-a2dc-766d72eab96b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:47.299262 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e8a2e170-f4fe-4836-a2dc-766d72eab96b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1204 microversion: 2.1 time: 1.033410 Sep 07 12:58:47.309618 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2595/5244] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:46 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1204 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:58:48.218985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-938bb3f2-6052-48b2-b203-9c16ffcd4593 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:48.238954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-938bb3f2-6052-48b2-b203-9c16ffcd4593 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:48.243845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-938bb3f2-6052-48b2-b203-9c16ffcd4593 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:48.249648 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-938bb3f2-6052-48b2-b203-9c16ffcd4593 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1728 microversion: 2.20 time: 1.721141 Sep 07 12:58:48.262592 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2650/5245] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:58:46 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1728 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:58:48.338988 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-54e51583-0127-4d2e-ae6f-86d8b0ed789c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:48.339985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-54e51583-0127-4d2e-ae6f-86d8b0ed789c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:48.354851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54e51583-0127-4d2e-ae6f-86d8b0ed789c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:48.355836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54e51583-0127-4d2e-ae6f-86d8b0ed789c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:48.358133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54e51583-0127-4d2e-ae6f-86d8b0ed789c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:48.360247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54e51583-0127-4d2e-ae6f-86d8b0ed789c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:48.362025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54e51583-0127-4d2e-ae6f-86d8b0ed789c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:48.364142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54e51583-0127-4d2e-ae6f-86d8b0ed789c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:48.614037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dfba3dc2-8ef1-4e93-ae14-ca247d2384dd tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Action: 'create', calling method: .version_select at 0x7fc41d105040>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-393362178", "policies": ["affinity"]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:58:48.679319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-54e51583-0127-4d2e-ae6f-86d8b0ed789c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:48.708774 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-54e51583-0127-4d2e-ae6f-86d8b0ed789c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1278 microversion: 2.1 time: 0.375335 Sep 07 12:58:48.713790 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2651/5246] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:48 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1278 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:48.770018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-dfba3dc2-8ef1-4e93-ae14-ca247d2384dd tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Getting quotas for project 726d822016574a8b8502ad5a171d9a60. Resources: {'server_groups'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:58:48.811688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-dfba3dc2-8ef1-4e93-ae14-ca247d2384dd tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Getting quotas for user ee9a619903be4381b50f09b6fee489be and project 726d822016574a8b8502ad5a171d9a60. Resources: {'server_groups'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:58:49.066686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-dfba3dc2-8ef1-4e93-ae14-ca247d2384dd tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Getting quotas for project 726d822016574a8b8502ad5a171d9a60. Resources: {'server_groups'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:58:49.085450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-dfba3dc2-8ef1-4e93-ae14-ca247d2384dd tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Getting quotas for user ee9a619903be4381b50f09b6fee489be and project 726d822016574a8b8502ad5a171d9a60. Resources: {'server_groups'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:58:49.163654 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dfba3dc2-8ef1-4e93-ae14-ca247d2384dd tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 1.852207 Sep 07 12:58:49.171199 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2596/5247] 10.222.0.16 () {60 vars in 1174 bytes} [Wed Sep 7 12:58:47 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:58:49.187870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3704ee99-5098-4f5b-ad51-110b770c347e tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Action: 'create', calling method: .version_select at 0x7fc41d2fdd30>, body: {"server_group": {"name": "tempest-server-group-1374052334", "policies": ["affinity"]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:58:49.273536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-3704ee99-5098-4f5b-ad51-110b770c347e tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Getting quotas for project 726d822016574a8b8502ad5a171d9a60. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:58:49.296680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-3704ee99-5098-4f5b-ad51-110b770c347e tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Getting quotas for user ee9a619903be4381b50f09b6fee489be and project 726d822016574a8b8502ad5a171d9a60. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:58:49.315180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f9b23c17-0630-4193-86ab-3f775f08e2bb tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:49.316085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f9b23c17-0630-4193-86ab-3f775f08e2bb tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:49.353044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9b23c17-0630-4193-86ab-3f775f08e2bb tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:49.355881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9b23c17-0630-4193-86ab-3f775f08e2bb tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:49.357023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9b23c17-0630-4193-86ab-3f775f08e2bb tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:49.359680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9b23c17-0630-4193-86ab-3f775f08e2bb tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:49.360782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9b23c17-0630-4193-86ab-3f775f08e2bb tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:49.362514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9b23c17-0630-4193-86ab-3f775f08e2bb tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:49.486424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-3704ee99-5098-4f5b-ad51-110b770c347e tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Getting quotas for project 726d822016574a8b8502ad5a171d9a60. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:58:49.502589 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-3704ee99-5098-4f5b-ad51-110b770c347e tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Getting quotas for user ee9a619903be4381b50f09b6fee489be and project 726d822016574a8b8502ad5a171d9a60. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:58:49.579548 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3704ee99-5098-4f5b-ad51-110b770c347e tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.400558 Sep 07 12:58:49.580905 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2652/5248] 10.222.0.16 () {60 vars in 1173 bytes} [Wed Sep 7 12:58:49 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:58:49.626103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-631be6f1-93ad-4e17-9d6f-9e170ff9cd69 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Action: 'create', calling method: .version_select at 0x7fc413f05670>, body: {"server_group": {"name": "tempest-server-group-1374052334", "policies": ["affinity"]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:58:49.736558 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-631be6f1-93ad-4e17-9d6f-9e170ff9cd69 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Getting quotas for project 726d822016574a8b8502ad5a171d9a60. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:58:49.756616 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-631be6f1-93ad-4e17-9d6f-9e170ff9cd69 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Getting quotas for user ee9a619903be4381b50f09b6fee489be and project 726d822016574a8b8502ad5a171d9a60. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:58:49.863238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-631be6f1-93ad-4e17-9d6f-9e170ff9cd69 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Getting quotas for project 726d822016574a8b8502ad5a171d9a60. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:58:49.894801 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-631be6f1-93ad-4e17-9d6f-9e170ff9cd69 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Getting quotas for user ee9a619903be4381b50f09b6fee489be and project 726d822016574a8b8502ad5a171d9a60. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:58:49.939995 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-631be6f1-93ad-4e17-9d6f-9e170ff9cd69 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.339457 Sep 07 12:58:49.941268 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2653/5249] 10.222.0.16 () {60 vars in 1173 bytes} [Wed Sep 7 12:58:49 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:58:49.971998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eeb03d8a-e3bd-4e49-9fbd-49f3e88e2225 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:49.973152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-eeb03d8a-e3bd-4e49-9fbd-49f3e88e2225 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:50.005039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eeb03d8a-e3bd-4e49-9fbd-49f3e88e2225 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:50.009201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eeb03d8a-e3bd-4e49-9fbd-49f3e88e2225 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:50.015722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eeb03d8a-e3bd-4e49-9fbd-49f3e88e2225 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:50.017125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eeb03d8a-e3bd-4e49-9fbd-49f3e88e2225 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:50.021162 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eeb03d8a-e3bd-4e49-9fbd-49f3e88e2225 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:50.023225 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eeb03d8a-e3bd-4e49-9fbd-49f3e88e2225 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:50.244785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f9b23c17-0630-4193-86ab-3f775f08e2bb tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:50.282695 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f9b23c17-0630-4193-86ab-3f775f08e2bb tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:50.293918 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f9b23c17-0630-4193-86ab-3f775f08e2bb tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:50.300379 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f9b23c17-0630-4193-86ab-3f775f08e2bb tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1728 microversion: 2.20 time: 0.995791 Sep 07 12:58:50.302770 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2597/5250] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:58:49 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1728 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:58:50.368520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4d644190-15d4-4fea-8fb1-186b5d34a8d9 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:50.474201 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4d644190-15d4-4fea-8fb1-186b5d34a8d9 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/7c1dd4ca-759e-4751-b65f-1453b728a81a" status: 204 len: 0 microversion: 2.1 time: 0.150460 Sep 07 12:58:50.480719 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2598/5251] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Sep 7 12:58:50 2022] DELETE /compute/v2.1/os-server-groups/7c1dd4ca-759e-4751-b65f-1453b728a81a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:50.505105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c0518a8b-bfd8-4f34-9500-cca5d7e696f2 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:50.573379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-eeb03d8a-e3bd-4e49-9fbd-49f3e88e2225 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:50.584069 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c0518a8b-bfd8-4f34-9500-cca5d7e696f2 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.095812 Sep 07 12:58:50.592857 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2599/5252] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Sep 7 12:58:50 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:58:50.626951 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eeb03d8a-e3bd-4e49-9fbd-49f3e88e2225 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1278 microversion: 2.1 time: 0.683346 Sep 07 12:58:50.627997 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2654/5253] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:49 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1278 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:50.646800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-84565e2c-b2e1-4d58-ac57-c26eb3fa4a67 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:50.761812 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-84565e2c-b2e1-4d58-ac57-c26eb3fa4a67 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/d6ca57f4-5d98-41c9-a39a-f67f9c43dfcc" status: 204 len: 0 microversion: 2.1 time: 0.152595 Sep 07 12:58:50.763841 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2600/5254] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Sep 7 12:58:50 2022] DELETE /compute/v2.1/os-server-groups/d6ca57f4-5d98-41c9-a39a-f67f9c43dfcc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:50.777441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0c76bfd1-c167-4a6f-82e7-63a71e8cfa46 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:50.820224 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0c76bfd1-c167-4a6f-82e7-63a71e8cfa46 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.046771 Sep 07 12:58:50.823402 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2655/5255] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Sep 7 12:58:50 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:58:50.852557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-269614f3-6a1f-42c6-8ca1-fcd7e3621e02 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Action: 'create', calling method: .version_select at 0x7fc41d105d30>, body: {"server_group": {"name": "tempest-server-group-1735338495", "policies": ["affinity"]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:58:50.902955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-269614f3-6a1f-42c6-8ca1-fcd7e3621e02 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Getting quotas for project 726d822016574a8b8502ad5a171d9a60. Resources: {'server_groups'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:58:50.922431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-269614f3-6a1f-42c6-8ca1-fcd7e3621e02 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Getting quotas for user ee9a619903be4381b50f09b6fee489be and project 726d822016574a8b8502ad5a171d9a60. Resources: {'server_groups'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:58:51.038591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-269614f3-6a1f-42c6-8ca1-fcd7e3621e02 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Getting quotas for project 726d822016574a8b8502ad5a171d9a60. Resources: {'server_groups'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:58:51.052421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-269614f3-6a1f-42c6-8ca1-fcd7e3621e02 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Getting quotas for user ee9a619903be4381b50f09b6fee489be and project 726d822016574a8b8502ad5a171d9a60. Resources: {'server_groups'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:58:51.097679 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-269614f3-6a1f-42c6-8ca1-fcd7e3621e02 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.254632 Sep 07 12:58:51.118490 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2601/5256] 10.222.0.16 () {60 vars in 1173 bytes} [Wed Sep 7 12:58:50 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:58:51.139927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5b4fcac4-103e-4921-8c1b-f7523b88ff59 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:51.212102 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5b4fcac4-103e-4921-8c1b-f7523b88ff59 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/1b9a9d09-cc0e-4893-a84b-759878734031" status: 204 len: 0 microversion: 2.1 time: 0.084915 Sep 07 12:58:51.212989 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2656/5257] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Sep 7 12:58:51 2022] DELETE /compute/v2.1/os-server-groups/1b9a9d09-cc0e-4893-a84b-759878734031 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:51.241821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fd1a5ff9-fb93-40b7-bae5-5fd54cfb169e tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:51.296346 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fd1a5ff9-fb93-40b7-bae5-5fd54cfb169e tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.068862 Sep 07 12:58:51.301319 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2602/5258] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Sep 7 12:58:51 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:58:51.325466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-09f09cb4-a244-4edd-8def-9c280dfa5f9c tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Action: 'create', calling method: .version_select at 0x7fc413f570d0>, body: {"server_group": {"name": "tempest-server-group-617200488", "policies": ["anti-affinity"]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:58:51.367066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9426373b-af6c-4f9c-98bc-ba6a022f7a02 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:51.368245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9426373b-af6c-4f9c-98bc-ba6a022f7a02 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:51.405147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9426373b-af6c-4f9c-98bc-ba6a022f7a02 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:51.408168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-09f09cb4-a244-4edd-8def-9c280dfa5f9c tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Getting quotas for project 726d822016574a8b8502ad5a171d9a60. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:58:51.408835 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9426373b-af6c-4f9c-98bc-ba6a022f7a02 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:51.410871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9426373b-af6c-4f9c-98bc-ba6a022f7a02 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:51.413601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9426373b-af6c-4f9c-98bc-ba6a022f7a02 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:51.417314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9426373b-af6c-4f9c-98bc-ba6a022f7a02 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:51.419313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9426373b-af6c-4f9c-98bc-ba6a022f7a02 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:51.437187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-09f09cb4-a244-4edd-8def-9c280dfa5f9c tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Getting quotas for user ee9a619903be4381b50f09b6fee489be and project 726d822016574a8b8502ad5a171d9a60. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:58:51.646593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-09f09cb4-a244-4edd-8def-9c280dfa5f9c tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Getting quotas for project 726d822016574a8b8502ad5a171d9a60. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:58:51.660529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-09f09cb4-a244-4edd-8def-9c280dfa5f9c tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Getting quotas for user ee9a619903be4381b50f09b6fee489be and project 726d822016574a8b8502ad5a171d9a60. Resources: {'server_groups'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:58:51.671432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:51.731640 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-09f09cb4-a244-4edd-8def-9c280dfa5f9c tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.411010 Sep 07 12:58:51.736206 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2657/5259] 10.222.0.16 () {60 vars in 1173 bytes} [Wed Sep 7 12:58:51 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:58:51.755221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e85f4766-5679-4c65-9dd5-230d947a5db6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:51.762074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e85f4766-5679-4c65-9dd5-230d947a5db6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:51.778647 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85f4766-5679-4c65-9dd5-230d947a5db6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:51.789629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85f4766-5679-4c65-9dd5-230d947a5db6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:51.790855 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85f4766-5679-4c65-9dd5-230d947a5db6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:51.797818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85f4766-5679-4c65-9dd5-230d947a5db6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:51.800435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85f4766-5679-4c65-9dd5-230d947a5db6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:51.801550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e85f4766-5679-4c65-9dd5-230d947a5db6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:52.626555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e85f4766-5679-4c65-9dd5-230d947a5db6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:52.662218 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e85f4766-5679-4c65-9dd5-230d947a5db6 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1308 microversion: 2.1 time: 0.924056 Sep 07 12:58:52.685643 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2658/5260] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:51 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1308 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:52.720542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-04446c40-41d9-4b8b-a053-5704435c072b tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:52.783096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9426373b-af6c-4f9c-98bc-ba6a022f7a02 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:52.800931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9426373b-af6c-4f9c-98bc-ba6a022f7a02 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:52.808723 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9426373b-af6c-4f9c-98bc-ba6a022f7a02 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:52.810425 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9426373b-af6c-4f9c-98bc-ba6a022f7a02 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1728 microversion: 2.20 time: 1.456625 Sep 07 12:58:52.817043 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2603/5261] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:58:51 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1728 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:58:52.831371 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-04446c40-41d9-4b8b-a053-5704435c072b tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/c44dbd5f-70c7-4f91-bd5a-da27b1a19de6" status: 204 len: 0 microversion: 2.1 time: 0.128605 Sep 07 12:58:52.838373 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2659/5262] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Sep 7 12:58:52 2022] DELETE /compute/v2.1/os-server-groups/c44dbd5f-70c7-4f91-bd5a-da27b1a19de6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:52.855988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b2c44014-3a2d-4450-86ea-cf9a5fcfb7a9 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:52.878581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:52.914796 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b2c44014-3a2d-4450-86ea-cf9a5fcfb7a9 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.071915 Sep 07 12:58:52.928633 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2604/5263] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Sep 7 12:58:52 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:58:53.359026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-30173476-31a3-4ea0-bf1d-5b59646de0d0 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1372774067", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "34794b70-287d-4bdc-8783-184b522e90dd"}]}, "os:scheduler_hints": {"group": "bbac1c8e-c88d-448b-beec-574d80ad7197"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:58:53.597471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-30173476-31a3-4ea0-bf1d-5b59646de0d0 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] validate_networks() for [('34794b70-287d-4bdc-8783-184b522e90dd', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:58:53.717684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5cb73def-83d2-42fa-b8ea-2e200c4e51fe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:53.718320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5cb73def-83d2-42fa-b8ea-2e200c4e51fe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:53.753040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cb73def-83d2-42fa-b8ea-2e200c4e51fe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:53.755087 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cb73def-83d2-42fa-b8ea-2e200c4e51fe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:53.756347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cb73def-83d2-42fa-b8ea-2e200c4e51fe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:53.775759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cb73def-83d2-42fa-b8ea-2e200c4e51fe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:53.786645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cb73def-83d2-42fa-b8ea-2e200c4e51fe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:53.791368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cb73def-83d2-42fa-b8ea-2e200c4e51fe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:54.154612 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:55.346705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5cb73def-83d2-42fa-b8ea-2e200c4e51fe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:55.356201 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5cb73def-83d2-42fa-b8ea-2e200c4e51fe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1308 microversion: 2.1 time: 1.643251 Sep 07 12:58:55.365038 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2605/5264] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:53 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1308 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:58:55.378736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bf8681c4-c5ec-4896-9a1f-89cced4d727f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:55.379370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bf8681c4-c5ec-4896-9a1f-89cced4d727f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:55.401562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf8681c4-c5ec-4896-9a1f-89cced4d727f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:55.402073 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf8681c4-c5ec-4896-9a1f-89cced4d727f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:55.402527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf8681c4-c5ec-4896-9a1f-89cced4d727f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:55.403273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf8681c4-c5ec-4896-9a1f-89cced4d727f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:55.403741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf8681c4-c5ec-4896-9a1f-89cced4d727f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:55.404164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf8681c4-c5ec-4896-9a1f-89cced4d727f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:56.199254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bf8681c4-c5ec-4896-9a1f-89cced4d727f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:56.215023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bf8681c4-c5ec-4896-9a1f-89cced4d727f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:56.216675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bf8681c4-c5ec-4896-9a1f-89cced4d727f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:56.218148 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bf8681c4-c5ec-4896-9a1f-89cced4d727f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1728 microversion: 2.20 time: 0.860232 Sep 07 12:58:56.218759 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2606/5265] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:58:55 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1728 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:58:56.241674 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d1683fcf-5d17-419c-a508-82386437599c tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:58:56.252177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1683fcf-5d17-419c-a508-82386437599c tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:56.255091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1683fcf-5d17-419c-a508-82386437599c tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:56.257722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1683fcf-5d17-419c-a508-82386437599c tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:56.317957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d1683fcf-5d17-419c-a508-82386437599c tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Going to try to stop instance {{(pid=122432) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 12:58:56.460018 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d1683fcf-5d17-419c-a508-82386437599c tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "POST /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef/action" status: 202 len: 0 microversion: 2.1 time: 0.224507 Sep 07 12:58:56.461734 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2607/5266] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:58:56 2022] POST /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:58:56.490349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-031cd7a0-c835-4cd2-b96a-74aefe61def9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:56.492139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-031cd7a0-c835-4cd2-b96a-74aefe61def9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:56.508362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-031cd7a0-c835-4cd2-b96a-74aefe61def9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:56.509923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-031cd7a0-c835-4cd2-b96a-74aefe61def9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:56.511135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-031cd7a0-c835-4cd2-b96a-74aefe61def9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:56.512804 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-031cd7a0-c835-4cd2-b96a-74aefe61def9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:56.514225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-031cd7a0-c835-4cd2-b96a-74aefe61def9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:56.516527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-031cd7a0-c835-4cd2-b96a-74aefe61def9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:56.565904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-30173476-31a3-4ea0-bf1d-5b59646de0d0 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:58:56.567020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-30173476-31a3-4ea0-bf1d-5b59646de0d0 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:58:56.567151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-30173476-31a3-4ea0-bf1d-5b59646de0d0 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:58:56.567847 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-30173476-31a3-4ea0-bf1d-5b59646de0d0 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:58:56.568297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-30173476-31a3-4ea0-bf1d-5b59646de0d0 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:58:56.590325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30173476-31a3-4ea0-bf1d-5b59646de0d0 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:56.590816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30173476-31a3-4ea0-bf1d-5b59646de0d0 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:56.591257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30173476-31a3-4ea0-bf1d-5b59646de0d0 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:56.592286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30173476-31a3-4ea0-bf1d-5b59646de0d0 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:56.593170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30173476-31a3-4ea0-bf1d-5b59646de0d0 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:56.593705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30173476-31a3-4ea0-bf1d-5b59646de0d0 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:56.620551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-30173476-31a3-4ea0-bf1d-5b59646de0d0 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Getting quotas for project 726d822016574a8b8502ad5a171d9a60. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:58:56.631657 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-30173476-31a3-4ea0-bf1d-5b59646de0d0 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Getting quotas for user ee9a619903be4381b50f09b6fee489be and project 726d822016574a8b8502ad5a171d9a60. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:58:56.667527 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-30173476-31a3-4ea0-bf1d-5b59646de0d0 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:58:56.672673 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-30173476-31a3-4ea0-bf1d-5b59646de0d0 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] [instance: 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:58:56.784166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-30173476-31a3-4ea0-bf1d-5b59646de0d0 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Getting quotas for project 726d822016574a8b8502ad5a171d9a60. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:58:56.795536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-30173476-31a3-4ea0-bf1d-5b59646de0d0 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Getting quotas for user ee9a619903be4381b50f09b6fee489be and project 726d822016574a8b8502ad5a171d9a60. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:58:56.804109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-031cd7a0-c835-4cd2-b96a-74aefe61def9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:56.838055 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-031cd7a0-c835-4cd2-b96a-74aefe61def9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1308 microversion: 2.1 time: 0.361351 Sep 07 12:58:56.843548 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2608/5267] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:56 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1308 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:56.883281 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-abe7a3a6-5c0d-453b-b2f6-671122dfc2d7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:56.886883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-abe7a3a6-5c0d-453b-b2f6-671122dfc2d7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:56.890264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-30173476-31a3-4ea0-bf1d-5b59646de0d0 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Getting quotas for project 726d822016574a8b8502ad5a171d9a60. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:58:56.902998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-30173476-31a3-4ea0-bf1d-5b59646de0d0 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Getting quotas for user ee9a619903be4381b50f09b6fee489be and project 726d822016574a8b8502ad5a171d9a60. Resources: {'server_group_members'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:58:56.905932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abe7a3a6-5c0d-453b-b2f6-671122dfc2d7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:56.913679 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abe7a3a6-5c0d-453b-b2f6-671122dfc2d7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:56.914561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abe7a3a6-5c0d-453b-b2f6-671122dfc2d7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:56.918600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abe7a3a6-5c0d-453b-b2f6-671122dfc2d7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:56.919349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abe7a3a6-5c0d-453b-b2f6-671122dfc2d7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:56.924516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abe7a3a6-5c0d-453b-b2f6-671122dfc2d7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:56.964306 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-30173476-31a3-4ea0-bf1d-5b59646de0d0 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.620014 Sep 07 12:58:56.966019 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2660/5268] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:58:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 3623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:58:56.999237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c27106b8-9d94-46d6-822a-bf5f2f1d9824 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:57.000386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c27106b8-9d94-46d6-822a-bf5f2f1d9824 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] [instance: 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:57.236250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c27106b8-9d94-46d6-822a-bf5f2f1d9824 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a619903be4381b50f09b6fee489be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d822016574a8b8502ad5a171d9a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:57.244547 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c27106b8-9d94-46d6-822a-bf5f2f1d9824 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369" status: 200 len: 1213 microversion: 2.1 time: 0.262230 Sep 07 12:58:57.261595 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2661/5269] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:56 2022] GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 => generated 1213 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:57.273406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-870b8dcf-1db7-4545-9043-a99e4cbab7e3 req-1476ea62-5f8d-4e81-be64-110a842ef827 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "998c0280-c44f-43db-84f9-7112e80100ff", "tag": "34a80aea-b68b-4c0b-b28b-ca7783c457a5"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:58:57.296020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-870b8dcf-1db7-4545-9043-a99e4cbab7e3 req-1476ea62-5f8d-4e81-be64-110a842ef827 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:57.296583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-870b8dcf-1db7-4545-9043-a99e4cbab7e3 req-1476ea62-5f8d-4e81-be64-110a842ef827 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:57.298464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-870b8dcf-1db7-4545-9043-a99e4cbab7e3 req-1476ea62-5f8d-4e81-be64-110a842ef827 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:57.338480 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-870b8dcf-1db7-4545-9043-a99e4cbab7e3 req-1476ea62-5f8d-4e81-be64-110a842ef827 service nova] Creating event network-changed:34a80aea-b68b-4c0b-b28b-ca7783c457a5 for instance 998c0280-c44f-43db-84f9-7112e80100ff on n-h1-852087-9 Sep 07 12:58:57.353467 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-870b8dcf-1db7-4545-9043-a99e4cbab7e3 req-1476ea62-5f8d-4e81-be64-110a842ef827 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095717 Sep 07 12:58:57.355063 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2662/5270] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:58:57.379061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0be8a94c-35dc-416b-94b7-203fc801fc47 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:57.381566 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0be8a94c-35dc-416b-94b7-203fc801fc47 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:57.409732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0be8a94c-35dc-416b-94b7-203fc801fc47 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:57.413699 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0be8a94c-35dc-416b-94b7-203fc801fc47 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:57.419108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0be8a94c-35dc-416b-94b7-203fc801fc47 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:57.421996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0be8a94c-35dc-416b-94b7-203fc801fc47 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:57.422988 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0be8a94c-35dc-416b-94b7-203fc801fc47 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:57.425086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0be8a94c-35dc-416b-94b7-203fc801fc47 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:57.778915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-abe7a3a6-5c0d-453b-b2f6-671122dfc2d7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:57.804804 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-abe7a3a6-5c0d-453b-b2f6-671122dfc2d7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1678 microversion: 2.1 time: 0.936008 Sep 07 12:58:57.808963 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2609/5271] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:56 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1678 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:57.875341 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bd315714-b11c-458c-9570-c911bdaddace tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:57.876491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bd315714-b11c-458c-9570-c911bdaddace tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:57.913511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd315714-b11c-458c-9570-c911bdaddace tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:57.919231 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd315714-b11c-458c-9570-c911bdaddace tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:57.922910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd315714-b11c-458c-9570-c911bdaddace tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:57.925808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd315714-b11c-458c-9570-c911bdaddace tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:57.933547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd315714-b11c-458c-9570-c911bdaddace tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:57.936224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bd315714-b11c-458c-9570-c911bdaddace tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:57.951859 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0be8a94c-35dc-416b-94b7-203fc801fc47 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:57.987495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0be8a94c-35dc-416b-94b7-203fc801fc47 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:57.999772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0be8a94c-35dc-416b-94b7-203fc801fc47 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:58.010240 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0be8a94c-35dc-416b-94b7-203fc801fc47 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1728 microversion: 2.20 time: 0.644913 Sep 07 12:58:58.011806 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2663/5272] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:58:57 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1728 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:58:58.115351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-94560202-c419-4d62-b9fc-e137d5173eeb req-0dc36f91-611c-4f74-a612-53eb1d6271e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f328e5-ec00-4403-8196-cbefa047877b", "name": "network-vif-plugged", "status": "completed", "tag": "13d7f17d-cb66-4016-a84a-aec1e39c3e03"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:58:58.148139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-94560202-c419-4d62-b9fc-e137d5173eeb req-0dc36f91-611c-4f74-a612-53eb1d6271e8 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:58.149126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-94560202-c419-4d62-b9fc-e137d5173eeb req-0dc36f91-611c-4f74-a612-53eb1d6271e8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:58.149971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-94560202-c419-4d62-b9fc-e137d5173eeb req-0dc36f91-611c-4f74-a612-53eb1d6271e8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:58.181910 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-94560202-c419-4d62-b9fc-e137d5173eeb req-0dc36f91-611c-4f74-a612-53eb1d6271e8 service nova] Creating event network-vif-plugged:13d7f17d-cb66-4016-a84a-aec1e39c3e03 for instance 35f328e5-ec00-4403-8196-cbefa047877b on n-h1-852087-9 Sep 07 12:58:58.194390 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-94560202-c419-4d62-b9fc-e137d5173eeb req-0dc36f91-611c-4f74-a612-53eb1d6271e8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083767 Sep 07 12:58:58.195489 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2664/5273] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:58:58.300417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a8be7edd-06d4-430c-9c22-3d219f516257 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:58.301465 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a8be7edd-06d4-430c-9c22-3d219f516257 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] [instance: 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:58.315016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8be7edd-06d4-430c-9c22-3d219f516257 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:58.315591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8be7edd-06d4-430c-9c22-3d219f516257 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:58.318297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8be7edd-06d4-430c-9c22-3d219f516257 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:58.319081 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8be7edd-06d4-430c-9c22-3d219f516257 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:58.319573 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8be7edd-06d4-430c-9c22-3d219f516257 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:58.332559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8be7edd-06d4-430c-9c22-3d219f516257 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:58.536698 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a8be7edd-06d4-430c-9c22-3d219f516257 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a619903be4381b50f09b6fee489be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d822016574a8b8502ad5a171d9a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:58.557553 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a8be7edd-06d4-430c-9c22-3d219f516257 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369" status: 200 len: 1217 microversion: 2.1 time: 0.262631 Sep 07 12:58:58.562520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bd315714-b11c-458c-9570-c911bdaddace tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:58.566419 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2665/5274] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:58 2022] GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 => generated 1217 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:58:58.587640 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bd315714-b11c-458c-9570-c911bdaddace tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1308 microversion: 2.1 time: 0.716262 Sep 07 12:58:58.598640 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2610/5275] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:57 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1308 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:58:58.854394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5e049efc-51a7-4763-9337-9910f06ac80d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:58.857678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5e049efc-51a7-4763-9337-9910f06ac80d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:58.892091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e049efc-51a7-4763-9337-9910f06ac80d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:58.895212 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e049efc-51a7-4763-9337-9910f06ac80d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:58.895795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e049efc-51a7-4763-9337-9910f06ac80d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:58.897921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e049efc-51a7-4763-9337-9910f06ac80d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:58.899580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e049efc-51a7-4763-9337-9910f06ac80d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:58.900167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e049efc-51a7-4763-9337-9910f06ac80d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:59.044561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f6dae9e6-2b49-4849-9f78-d30059367f9e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:59.045411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f6dae9e6-2b49-4849-9f78-d30059367f9e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:59.059358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6dae9e6-2b49-4849-9f78-d30059367f9e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:59.059978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6dae9e6-2b49-4849-9f78-d30059367f9e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:59.060640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6dae9e6-2b49-4849-9f78-d30059367f9e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:59.066546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6dae9e6-2b49-4849-9f78-d30059367f9e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:59.070731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6dae9e6-2b49-4849-9f78-d30059367f9e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:59.071785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6dae9e6-2b49-4849-9f78-d30059367f9e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:59.280851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5e049efc-51a7-4763-9337-9910f06ac80d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:59.326621 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5e049efc-51a7-4763-9337-9910f06ac80d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1678 microversion: 2.1 time: 0.492656 Sep 07 12:58:59.331784 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2666/5276] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:58 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1678 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:59.594499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f6dae9e6-2b49-4849-9f78-d30059367f9e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:59.603416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4e836391-d070-466b-9bee-b9dbc3306ae9 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:59.606187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4e836391-d070-466b-9bee-b9dbc3306ae9 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] [instance: 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:59.646917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f6dae9e6-2b49-4849-9f78-d30059367f9e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:59.648961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e836391-d070-466b-9bee-b9dbc3306ae9 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:59.649993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e836391-d070-466b-9bee-b9dbc3306ae9 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:59.651196 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e836391-d070-466b-9bee-b9dbc3306ae9 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:59.657962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e836391-d070-466b-9bee-b9dbc3306ae9 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:59.659418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f6dae9e6-2b49-4849-9f78-d30059367f9e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:58:59.664528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e836391-d070-466b-9bee-b9dbc3306ae9 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:59.668757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e836391-d070-466b-9bee-b9dbc3306ae9 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:59.670001 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f6dae9e6-2b49-4849-9f78-d30059367f9e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1728 microversion: 2.20 time: 0.627747 Sep 07 12:58:59.674078 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2611/5277] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:58:59 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1728 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:58:59.699037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9c02fe2f-073e-4769-8dd5-1ebfdc1976fa tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:58:59.700563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9c02fe2f-073e-4769-8dd5-1ebfdc1976fa tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:58:59.725899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c02fe2f-073e-4769-8dd5-1ebfdc1976fa tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:59.737094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c02fe2f-073e-4769-8dd5-1ebfdc1976fa tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:59.741913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c02fe2f-073e-4769-8dd5-1ebfdc1976fa tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:58:59.750736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c02fe2f-073e-4769-8dd5-1ebfdc1976fa tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:58:59.753113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c02fe2f-073e-4769-8dd5-1ebfdc1976fa tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:58:59.762199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c02fe2f-073e-4769-8dd5-1ebfdc1976fa tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:00.092686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4e836391-d070-466b-9bee-b9dbc3306ae9 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a619903be4381b50f09b6fee489be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d822016574a8b8502ad5a171d9a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:00.104226 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4e836391-d070-466b-9bee-b9dbc3306ae9 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369" status: 200 len: 1273 microversion: 2.1 time: 0.523560 Sep 07 12:59:00.107581 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2667/5278] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:59 2022] GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 => generated 1273 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:00.375945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b15daefa-c7c4-499c-be00-8e1357f54dfc tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:00.377112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b15daefa-c7c4-499c-be00-8e1357f54dfc tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:00.405378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b15daefa-c7c4-499c-be00-8e1357f54dfc tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:00.406551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b15daefa-c7c4-499c-be00-8e1357f54dfc tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:00.407174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b15daefa-c7c4-499c-be00-8e1357f54dfc tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:00.411542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b15daefa-c7c4-499c-be00-8e1357f54dfc tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:00.412444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b15daefa-c7c4-499c-be00-8e1357f54dfc tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:00.413353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b15daefa-c7c4-499c-be00-8e1357f54dfc tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:00.465031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9c02fe2f-073e-4769-8dd5-1ebfdc1976fa tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:00.476124 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9c02fe2f-073e-4769-8dd5-1ebfdc1976fa tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1308 microversion: 2.1 time: 0.800041 Sep 07 12:59:00.486531 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2612/5279] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:58:59 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1308 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:00.734837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-16c23acd-7437-471e-8846-abd6163ba7d2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:00.736667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-16c23acd-7437-471e-8846-abd6163ba7d2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:00.767038 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16c23acd-7437-471e-8846-abd6163ba7d2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:00.768000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16c23acd-7437-471e-8846-abd6163ba7d2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:00.768807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16c23acd-7437-471e-8846-abd6163ba7d2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:00.770162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16c23acd-7437-471e-8846-abd6163ba7d2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:00.771019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16c23acd-7437-471e-8846-abd6163ba7d2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:00.784074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16c23acd-7437-471e-8846-abd6163ba7d2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:01.075959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=24 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:01.199726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b15daefa-c7c4-499c-be00-8e1357f54dfc tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:01.222547 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b15daefa-c7c4-499c-be00-8e1357f54dfc tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1678 microversion: 2.1 time: 0.851856 Sep 07 12:59:01.223547 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2668/5280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:00 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1678 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:59:01.235441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3af255ee-15e5-43f3-b058-46b86b0119fc tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:01.236682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3af255ee-15e5-43f3-b058-46b86b0119fc tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] [instance: 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:01.248475 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3af255ee-15e5-43f3-b058-46b86b0119fc tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:01.251949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3af255ee-15e5-43f3-b058-46b86b0119fc tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:01.262581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3af255ee-15e5-43f3-b058-46b86b0119fc tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:01.264401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3af255ee-15e5-43f3-b058-46b86b0119fc tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:01.266580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3af255ee-15e5-43f3-b058-46b86b0119fc tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:01.268979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3af255ee-15e5-43f3-b058-46b86b0119fc tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:01.402761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-16c23acd-7437-471e-8846-abd6163ba7d2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:01.420878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-16c23acd-7437-471e-8846-abd6163ba7d2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:01.423620 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-16c23acd-7437-471e-8846-abd6163ba7d2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:01.425508 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-16c23acd-7437-471e-8846-abd6163ba7d2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1728 microversion: 2.20 time: 0.698720 Sep 07 12:59:01.426796 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2613/5281] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:59:00 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1728 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:59:01.454421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3af255ee-15e5-43f3-b058-46b86b0119fc tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a619903be4381b50f09b6fee489be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d822016574a8b8502ad5a171d9a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:01.480762 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3af255ee-15e5-43f3-b058-46b86b0119fc tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369" status: 200 len: 1271 microversion: 2.1 time: 0.252391 Sep 07 12:59:01.482266 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2669/5282] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:01 2022] GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 => generated 1271 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:01.533327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2c1eead4-bf64-497a-acff-18b21fc150e0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:01.534254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2c1eead4-bf64-497a-acff-18b21fc150e0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:01.553857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c1eead4-bf64-497a-acff-18b21fc150e0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:01.554854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c1eead4-bf64-497a-acff-18b21fc150e0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:01.556319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c1eead4-bf64-497a-acff-18b21fc150e0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:01.557599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c1eead4-bf64-497a-acff-18b21fc150e0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:01.558344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c1eead4-bf64-497a-acff-18b21fc150e0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:01.559083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c1eead4-bf64-497a-acff-18b21fc150e0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:02.003113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2c1eead4-bf64-497a-acff-18b21fc150e0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:02.018890 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2c1eead4-bf64-497a-acff-18b21fc150e0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1308 microversion: 2.1 time: 0.489735 Sep 07 12:59:02.026023 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2614/5283] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:01 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1308 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:02.268446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4e0d3807-8c4a-482f-a1f7-98a962c1f086 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:02.270348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4e0d3807-8c4a-482f-a1f7-98a962c1f086 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:02.295241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e0d3807-8c4a-482f-a1f7-98a962c1f086 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:02.296723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e0d3807-8c4a-482f-a1f7-98a962c1f086 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:02.300186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e0d3807-8c4a-482f-a1f7-98a962c1f086 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:02.308209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e0d3807-8c4a-482f-a1f7-98a962c1f086 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:02.309109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e0d3807-8c4a-482f-a1f7-98a962c1f086 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:02.310588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e0d3807-8c4a-482f-a1f7-98a962c1f086 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:02.473830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2589be56-d711-4787-ae5e-a175dd6127c6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:02.477670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2589be56-d711-4787-ae5e-a175dd6127c6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:02.522630 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2589be56-d711-4787-ae5e-a175dd6127c6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:02.528973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2589be56-d711-4787-ae5e-a175dd6127c6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:02.532623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2589be56-d711-4787-ae5e-a175dd6127c6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:02.546505 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2589be56-d711-4787-ae5e-a175dd6127c6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:02.548744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2589be56-d711-4787-ae5e-a175dd6127c6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:02.550103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2589be56-d711-4787-ae5e-a175dd6127c6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:03.251049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4e0d3807-8c4a-482f-a1f7-98a962c1f086 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:03.292779 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4e0d3807-8c4a-482f-a1f7-98a962c1f086 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1678 microversion: 2.1 time: 1.032630 Sep 07 12:59:03.298909 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2670/5284] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:02 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1678 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:03.320716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0a3d9ad9-9f62-4da0-a78f-11248d978437 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:03.327900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0a3d9ad9-9f62-4da0-a78f-11248d978437 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] [instance: 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:03.372620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a3d9ad9-9f62-4da0-a78f-11248d978437 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:03.380803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a3d9ad9-9f62-4da0-a78f-11248d978437 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:03.384747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a3d9ad9-9f62-4da0-a78f-11248d978437 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:03.388104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a3d9ad9-9f62-4da0-a78f-11248d978437 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:03.392639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a3d9ad9-9f62-4da0-a78f-11248d978437 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:03.393507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a3d9ad9-9f62-4da0-a78f-11248d978437 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:03.418965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2589be56-d711-4787-ae5e-a175dd6127c6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:03.445991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2589be56-d711-4787-ae5e-a175dd6127c6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:03.451937 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2589be56-d711-4787-ae5e-a175dd6127c6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:03.457295 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2589be56-d711-4787-ae5e-a175dd6127c6 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1728 microversion: 2.20 time: 0.988824 Sep 07 12:59:03.467579 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2615/5285] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:59:02 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1728 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 12:59:03.482006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d99a84b-a7ac-4c3e-94e5-372070581255 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:03.485707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1d99a84b-a7ac-4c3e-94e5-372070581255 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:03.503769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d99a84b-a7ac-4c3e-94e5-372070581255 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:03.504671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d99a84b-a7ac-4c3e-94e5-372070581255 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:03.505594 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d99a84b-a7ac-4c3e-94e5-372070581255 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:03.508274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d99a84b-a7ac-4c3e-94e5-372070581255 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:03.510115 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d99a84b-a7ac-4c3e-94e5-372070581255 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:03.511681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d99a84b-a7ac-4c3e-94e5-372070581255 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:03.524310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:04.538228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0a3d9ad9-9f62-4da0-a78f-11248d978437 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a619903be4381b50f09b6fee489be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d822016574a8b8502ad5a171d9a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:04.552605 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0a3d9ad9-9f62-4da0-a78f-11248d978437 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369" status: 200 len: 1313 microversion: 2.1 time: 1.249955 Sep 07 12:59:04.554008 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2671/5286] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:03 2022] GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 => generated 1313 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:04.570107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-573ceafa-ee35-4237-8cd9-5d745791deb7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:04.571203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-573ceafa-ee35-4237-8cd9-5d745791deb7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:04.587252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-573ceafa-ee35-4237-8cd9-5d745791deb7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:04.588189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-573ceafa-ee35-4237-8cd9-5d745791deb7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:04.588879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-573ceafa-ee35-4237-8cd9-5d745791deb7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:04.589944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-573ceafa-ee35-4237-8cd9-5d745791deb7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:04.590680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-573ceafa-ee35-4237-8cd9-5d745791deb7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:04.591347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-573ceafa-ee35-4237-8cd9-5d745791deb7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:04.619204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1d99a84b-a7ac-4c3e-94e5-372070581255 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:04.656628 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1d99a84b-a7ac-4c3e-94e5-372070581255 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1308 microversion: 2.1 time: 1.187158 Sep 07 12:59:04.657719 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2616/5287] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:03 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1308 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:04.689636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-53eb3444-880f-4076-a603-30e685a80b17 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:04.698351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-53eb3444-880f-4076-a603-30e685a80b17 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:04.729897 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53eb3444-880f-4076-a603-30e685a80b17 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:04.733162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53eb3444-880f-4076-a603-30e685a80b17 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:04.734129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53eb3444-880f-4076-a603-30e685a80b17 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:04.735125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53eb3444-880f-4076-a603-30e685a80b17 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:04.735774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53eb3444-880f-4076-a603-30e685a80b17 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:04.736494 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53eb3444-880f-4076-a603-30e685a80b17 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:05.152561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-573ceafa-ee35-4237-8cd9-5d745791deb7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:05.174892 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-573ceafa-ee35-4237-8cd9-5d745791deb7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1678 microversion: 2.1 time: 0.618568 Sep 07 12:59:05.175821 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2672/5288] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:04 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1678 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:05.215783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-53eb3444-880f-4076-a603-30e685a80b17 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:05.218868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:05.232030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-53eb3444-880f-4076-a603-30e685a80b17 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:05.235541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-53eb3444-880f-4076-a603-30e685a80b17 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:05.243171 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-53eb3444-880f-4076-a603-30e685a80b17 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1728 microversion: 2.20 time: 0.579614 Sep 07 12:59:05.244108 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2617/5289] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:59:04 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1728 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:59:05.561033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0681e376-b515-4f3d-88cb-2ac52f91eeac req-ecd78090-d236-4aba-82e5-26b4078b8d1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1456a21a-1f2e-4de3-bbc3-f4eb32b1d369", "tag": "801ec14b-bcbb-4411-823c-7f229594cab3"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:05.582311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-580bad33-b17e-4cd4-9031-5ec8a0ca9247 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:05.582901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-580bad33-b17e-4cd4-9031-5ec8a0ca9247 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] [instance: 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:05.589875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0681e376-b515-4f3d-88cb-2ac52f91eeac req-ecd78090-d236-4aba-82e5-26b4078b8d1a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:05.591249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0681e376-b515-4f3d-88cb-2ac52f91eeac req-ecd78090-d236-4aba-82e5-26b4078b8d1a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:05.591249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0681e376-b515-4f3d-88cb-2ac52f91eeac req-ecd78090-d236-4aba-82e5-26b4078b8d1a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:05.639889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-580bad33-b17e-4cd4-9031-5ec8a0ca9247 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:05.640802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-580bad33-b17e-4cd4-9031-5ec8a0ca9247 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:05.646269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-580bad33-b17e-4cd4-9031-5ec8a0ca9247 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:05.647326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-580bad33-b17e-4cd4-9031-5ec8a0ca9247 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:05.650410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-580bad33-b17e-4cd4-9031-5ec8a0ca9247 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:05.656719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-580bad33-b17e-4cd4-9031-5ec8a0ca9247 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:05.689125 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0681e376-b515-4f3d-88cb-2ac52f91eeac req-ecd78090-d236-4aba-82e5-26b4078b8d1a service nova] Creating event network-changed:801ec14b-bcbb-4411-823c-7f229594cab3 for instance 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 on n-h2-852087-9 Sep 07 12:59:05.709937 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0681e376-b515-4f3d-88cb-2ac52f91eeac req-ecd78090-d236-4aba-82e5-26b4078b8d1a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152037 Sep 07 12:59:05.717783 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2673/5290] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:59:05.761274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c7a317f9-d20a-4821-8509-4054b5be1f40 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:05.763627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c7a317f9-d20a-4821-8509-4054b5be1f40 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:05.790898 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7a317f9-d20a-4821-8509-4054b5be1f40 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:05.798111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7a317f9-d20a-4821-8509-4054b5be1f40 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:05.799631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7a317f9-d20a-4821-8509-4054b5be1f40 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:05.801397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7a317f9-d20a-4821-8509-4054b5be1f40 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:05.802340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7a317f9-d20a-4821-8509-4054b5be1f40 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:05.803234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7a317f9-d20a-4821-8509-4054b5be1f40 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:06.211916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-580bad33-b17e-4cd4-9031-5ec8a0ca9247 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a619903be4381b50f09b6fee489be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d822016574a8b8502ad5a171d9a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:06.235956 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-580bad33-b17e-4cd4-9031-5ec8a0ca9247 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369" status: 200 len: 1313 microversion: 2.1 time: 0.657825 Sep 07 12:59:06.253519 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2618/5291] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:05 2022] GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 => generated 1313 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:59:06.258761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2fc1f33c-40a8-4a0a-ac6d-0bc7c5818747 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:06.260577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2fc1f33c-40a8-4a0a-ac6d-0bc7c5818747 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:06.284888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fc1f33c-40a8-4a0a-ac6d-0bc7c5818747 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:06.286470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fc1f33c-40a8-4a0a-ac6d-0bc7c5818747 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:06.287674 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fc1f33c-40a8-4a0a-ac6d-0bc7c5818747 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:06.288946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fc1f33c-40a8-4a0a-ac6d-0bc7c5818747 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:06.289802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fc1f33c-40a8-4a0a-ac6d-0bc7c5818747 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:06.290570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2fc1f33c-40a8-4a0a-ac6d-0bc7c5818747 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:06.373535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c7a317f9-d20a-4821-8509-4054b5be1f40 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:06.410779 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c7a317f9-d20a-4821-8509-4054b5be1f40 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1308 microversion: 2.1 time: 0.684644 Sep 07 12:59:06.415250 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2674/5292] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:05 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1308 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:06.426931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1f4a5812-5b80-4711-89ff-996ff308e491 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:06.428818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1f4a5812-5b80-4711-89ff-996ff308e491 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:06.464018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f4a5812-5b80-4711-89ff-996ff308e491 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:06.466971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f4a5812-5b80-4711-89ff-996ff308e491 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:06.486895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f4a5812-5b80-4711-89ff-996ff308e491 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:06.493441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f4a5812-5b80-4711-89ff-996ff308e491 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:06.495936 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f4a5812-5b80-4711-89ff-996ff308e491 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:06.502028 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f4a5812-5b80-4711-89ff-996ff308e491 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:06.608012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:07.036121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2fc1f33c-40a8-4a0a-ac6d-0bc7c5818747 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:07.087906 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2fc1f33c-40a8-4a0a-ac6d-0bc7c5818747 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1678 microversion: 2.1 time: 0.844052 Sep 07 12:59:07.098648 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2619/5293] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:06 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1678 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:07.110825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-0e84eb3b-1779-41f0-8239-a5087672cb78 req-30a2d069-bf3d-4190-aec6-a02f0896b67b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "998c0280-c44f-43db-84f9-7112e80100ff", "name": "network-vif-plugged", "status": "completed", "tag": "34a80aea-b68b-4c0b-b28b-ca7783c457a5"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:07.152385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0e84eb3b-1779-41f0-8239-a5087672cb78 req-30a2d069-bf3d-4190-aec6-a02f0896b67b service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:07.154431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0e84eb3b-1779-41f0-8239-a5087672cb78 req-30a2d069-bf3d-4190-aec6-a02f0896b67b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:07.155959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0e84eb3b-1779-41f0-8239-a5087672cb78 req-30a2d069-bf3d-4190-aec6-a02f0896b67b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:07.204491 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-0e84eb3b-1779-41f0-8239-a5087672cb78 req-30a2d069-bf3d-4190-aec6-a02f0896b67b service nova] Creating event network-vif-plugged:34a80aea-b68b-4c0b-b28b-ca7783c457a5 for instance 998c0280-c44f-43db-84f9-7112e80100ff on n-h1-852087-9 Sep 07 12:59:07.225347 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-0e84eb3b-1779-41f0-8239-a5087672cb78 req-30a2d069-bf3d-4190-aec6-a02f0896b67b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123111 Sep 07 12:59:07.234217 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2620/5294] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:59:07.240941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=40 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:07.284059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-848cced6-c561-4705-b9fc-443a973c3ce1 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:07.287153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-848cced6-c561-4705-b9fc-443a973c3ce1 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] [instance: 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:07.329155 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1f4a5812-5b80-4711-89ff-996ff308e491 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:07.331733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-848cced6-c561-4705-b9fc-443a973c3ce1 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:07.333331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-848cced6-c561-4705-b9fc-443a973c3ce1 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:07.337770 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-848cced6-c561-4705-b9fc-443a973c3ce1 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:07.340792 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-848cced6-c561-4705-b9fc-443a973c3ce1 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:07.342012 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-848cced6-c561-4705-b9fc-443a973c3ce1 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:07.343096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-848cced6-c561-4705-b9fc-443a973c3ce1 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:07.357251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1f4a5812-5b80-4711-89ff-996ff308e491 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:07.365544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1f4a5812-5b80-4711-89ff-996ff308e491 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:07.372577 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1f4a5812-5b80-4711-89ff-996ff308e491 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1715 microversion: 2.20 time: 0.951983 Sep 07 12:59:07.373977 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2675/5295] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 12:59:06 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1715 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 12:59:07.443424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a1dca55a-52fe-4dc5-a687-33315b4029ff tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:07.445252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a1dca55a-52fe-4dc5-a687-33315b4029ff tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:07.477401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1dca55a-52fe-4dc5-a687-33315b4029ff tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:07.478784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1dca55a-52fe-4dc5-a687-33315b4029ff tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:07.482488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1dca55a-52fe-4dc5-a687-33315b4029ff tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:07.484808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1dca55a-52fe-4dc5-a687-33315b4029ff tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:07.485677 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1dca55a-52fe-4dc5-a687-33315b4029ff tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:07.486704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1dca55a-52fe-4dc5-a687-33315b4029ff tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:07.827176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-848cced6-c561-4705-b9fc-443a973c3ce1 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a619903be4381b50f09b6fee489be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d822016574a8b8502ad5a171d9a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:07.852917 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-848cced6-c561-4705-b9fc-443a973c3ce1 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369" status: 200 len: 1313 microversion: 2.1 time: 0.581069 Sep 07 12:59:07.857077 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2621/5296] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:07 2022] GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 => generated 1313 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:59:07.922152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a1dca55a-52fe-4dc5-a687-33315b4029ff tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:07.931147 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a1dca55a-52fe-4dc5-a687-33315b4029ff tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1308 microversion: 2.1 time: 0.495805 Sep 07 12:59:07.948991 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2676/5297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:07 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1308 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:08.150902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1a6fbe4c-d77d-478a-9900-8645eb081698 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:08.153812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1a6fbe4c-d77d-478a-9900-8645eb081698 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:08.193206 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a6fbe4c-d77d-478a-9900-8645eb081698 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:08.194274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a6fbe4c-d77d-478a-9900-8645eb081698 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:08.194834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a6fbe4c-d77d-478a-9900-8645eb081698 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:08.196132 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a6fbe4c-d77d-478a-9900-8645eb081698 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:08.196957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a6fbe4c-d77d-478a-9900-8645eb081698 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:08.208156 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a6fbe4c-d77d-478a-9900-8645eb081698 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:08.840088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1a6fbe4c-d77d-478a-9900-8645eb081698 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:08.849396 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1a6fbe4c-d77d-478a-9900-8645eb081698 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1655 microversion: 2.1 time: 0.708877 Sep 07 12:59:08.859537 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2622/5298] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:08 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1655 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:08.881335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eaca692c-5c79-4ac0-ba12-7b38c70d57ab tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:08.906996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-934d5f94-7407-4797-8b8d-8d6613e88c60 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:08.910820 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-934d5f94-7407-4797-8b8d-8d6613e88c60 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] [instance: 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:08.933375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-934d5f94-7407-4797-8b8d-8d6613e88c60 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:08.935614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eaca692c-5c79-4ac0-ba12-7b38c70d57ab tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:08.936151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eaca692c-5c79-4ac0-ba12-7b38c70d57ab tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:08.936558 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eaca692c-5c79-4ac0-ba12-7b38c70d57ab tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:08.944746 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-934d5f94-7407-4797-8b8d-8d6613e88c60 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:08.945556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-934d5f94-7407-4797-8b8d-8d6613e88c60 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:08.946450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-934d5f94-7407-4797-8b8d-8d6613e88c60 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:08.946942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-934d5f94-7407-4797-8b8d-8d6613e88c60 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:08.947509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-934d5f94-7407-4797-8b8d-8d6613e88c60 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:09.080418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-eaca692c-5c79-4ac0-ba12-7b38c70d57ab tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Going to try to start instance {{(pid=122433) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 12:59:09.295468 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eaca692c-5c79-4ac0-ba12-7b38c70d57ab tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "POST /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef/action" status: 202 len: 0 microversion: 2.1 time: 0.415287 Sep 07 12:59:09.302016 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2677/5299] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:59:08 2022] POST /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 12:59:09.327964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3362d2e5-c17a-4f1f-b5a4-c3367ecabf0d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:09.333372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3362d2e5-c17a-4f1f-b5a4-c3367ecabf0d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:09.391832 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3362d2e5-c17a-4f1f-b5a4-c3367ecabf0d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:09.398851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3362d2e5-c17a-4f1f-b5a4-c3367ecabf0d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:09.402626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3362d2e5-c17a-4f1f-b5a4-c3367ecabf0d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:09.405014 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3362d2e5-c17a-4f1f-b5a4-c3367ecabf0d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:09.411760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3362d2e5-c17a-4f1f-b5a4-c3367ecabf0d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:09.413189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3362d2e5-c17a-4f1f-b5a4-c3367ecabf0d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:10.463168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-934d5f94-7407-4797-8b8d-8d6613e88c60 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a619903be4381b50f09b6fee489be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d822016574a8b8502ad5a171d9a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:10.476691 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-934d5f94-7407-4797-8b8d-8d6613e88c60 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369" status: 200 len: 1313 microversion: 2.1 time: 1.591909 Sep 07 12:59:10.477118 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2623/5300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:08 2022] GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 => generated 1313 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:59:10.493848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4e3a877c-508c-4bf5-942d-76754c958014 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:10.494390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4e3a877c-508c-4bf5-942d-76754c958014 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:10.508778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e3a877c-508c-4bf5-942d-76754c958014 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:10.509331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e3a877c-508c-4bf5-942d-76754c958014 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:10.526761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e3a877c-508c-4bf5-942d-76754c958014 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:10.528678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e3a877c-508c-4bf5-942d-76754c958014 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:10.528991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e3a877c-508c-4bf5-942d-76754c958014 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:10.530088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e3a877c-508c-4bf5-942d-76754c958014 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:10.738918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3362d2e5-c17a-4f1f-b5a4-c3367ecabf0d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:10.765585 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3362d2e5-c17a-4f1f-b5a4-c3367ecabf0d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1308 microversion: 2.1 time: 1.459343 Sep 07 12:59:10.769114 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2678/5301] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:09 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1308 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:11.227429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-986e6e7e-6a45-4f11-91c5-b805c04900f5 req-d0304541-4dd4-4b33-a1bb-e0238f08c35d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1456a21a-1f2e-4de3-bbc3-f4eb32b1d369", "name": "network-vif-plugged", "status": "completed", "tag": "801ec14b-bcbb-4411-823c-7f229594cab3"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:11.255697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-986e6e7e-6a45-4f11-91c5-b805c04900f5 req-d0304541-4dd4-4b33-a1bb-e0238f08c35d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:11.256268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-986e6e7e-6a45-4f11-91c5-b805c04900f5 req-d0304541-4dd4-4b33-a1bb-e0238f08c35d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:11.259121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-986e6e7e-6a45-4f11-91c5-b805c04900f5 req-d0304541-4dd4-4b33-a1bb-e0238f08c35d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:11.288407 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-986e6e7e-6a45-4f11-91c5-b805c04900f5 req-d0304541-4dd4-4b33-a1bb-e0238f08c35d service nova] Creating event network-vif-plugged:801ec14b-bcbb-4411-823c-7f229594cab3 for instance 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 on n-h2-852087-9 Sep 07 12:59:11.298829 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-986e6e7e-6a45-4f11-91c5-b805c04900f5 req-d0304541-4dd4-4b33-a1bb-e0238f08c35d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078166 Sep 07 12:59:11.301030 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2679/5302] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:59:11.518358 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f7c2afbe-5a09-4734-aaf9-d31b97ef9e33 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:11.519487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f7c2afbe-5a09-4734-aaf9-d31b97ef9e33 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] [instance: 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:11.534605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7c2afbe-5a09-4734-aaf9-d31b97ef9e33 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:11.535465 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7c2afbe-5a09-4734-aaf9-d31b97ef9e33 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:11.536503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7c2afbe-5a09-4734-aaf9-d31b97ef9e33 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:11.538088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7c2afbe-5a09-4734-aaf9-d31b97ef9e33 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:11.539200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7c2afbe-5a09-4734-aaf9-d31b97ef9e33 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:11.540271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7c2afbe-5a09-4734-aaf9-d31b97ef9e33 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:11.542319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4e3a877c-508c-4bf5-942d-76754c958014 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:11.551155 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4e3a877c-508c-4bf5-942d-76754c958014 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1664 microversion: 2.1 time: 1.068268 Sep 07 12:59:11.565855 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2624/5303] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:10 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1664 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:11.814871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6281729f-fd4d-4c33-ba8e-732db844c541 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:11.815509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6281729f-fd4d-4c33-ba8e-732db844c541 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:11.835448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6281729f-fd4d-4c33-ba8e-732db844c541 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:11.835967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6281729f-fd4d-4c33-ba8e-732db844c541 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:11.836426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6281729f-fd4d-4c33-ba8e-732db844c541 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:11.837192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6281729f-fd4d-4c33-ba8e-732db844c541 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:11.837737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6281729f-fd4d-4c33-ba8e-732db844c541 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:11.838166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6281729f-fd4d-4c33-ba8e-732db844c541 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:12.423966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f7c2afbe-5a09-4734-aaf9-d31b97ef9e33 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a619903be4381b50f09b6fee489be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d822016574a8b8502ad5a171d9a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:12.485536 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f7c2afbe-5a09-4734-aaf9-d31b97ef9e33 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369" status: 200 len: 1313 microversion: 2.1 time: 0.970042 Sep 07 12:59:12.487296 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2680/5304] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:11 2022] GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 => generated 1313 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:12.497353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6281729f-fd4d-4c33-ba8e-732db844c541 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:12.508561 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6281729f-fd4d-4c33-ba8e-732db844c541 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1490 microversion: 2.1 time: 0.697988 Sep 07 12:59:12.518320 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2625/5305] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:11 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1490 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:59:12.541080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f6f5b579-97bf-47b6-95f3-c066d3e24331 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-864572296"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:12.547039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f6f5b579-97bf-47b6-95f3-c066d3e24331 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:12.561439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6f5b579-97bf-47b6-95f3-c066d3e24331 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:12.562081 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6f5b579-97bf-47b6-95f3-c066d3e24331 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:12.562845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6f5b579-97bf-47b6-95f3-c066d3e24331 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:12.563808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6f5b579-97bf-47b6-95f3-c066d3e24331 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:12.564563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6f5b579-97bf-47b6-95f3-c066d3e24331 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:12.565169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6f5b579-97bf-47b6-95f3-c066d3e24331 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:12.593243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b2af0888-0933-4ebd-a048-151e8b2199b3 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:12.600387 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b2af0888-0933-4ebd-a048-151e8b2199b3 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:12.617590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2af0888-0933-4ebd-a048-151e8b2199b3 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:12.617914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2af0888-0933-4ebd-a048-151e8b2199b3 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:12.622134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2af0888-0933-4ebd-a048-151e8b2199b3 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:12.623059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2af0888-0933-4ebd-a048-151e8b2199b3 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:12.623584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2af0888-0933-4ebd-a048-151e8b2199b3 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:12.624901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2af0888-0933-4ebd-a048-151e8b2199b3 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:12.676829 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f6f5b579-97bf-47b6-95f3-c066d3e24331 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "PUT /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1075 microversion: 2.1 time: 0.144651 Sep 07 12:59:12.679697 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2681/5306] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Sep 7 12:59:12 2022] PUT /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1075 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:12.707469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4b3103e8-1c30-417e-be4e-d612f6d1926d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:12.707469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4b3103e8-1c30-417e-be4e-d612f6d1926d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:12.711800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:12.714298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b3103e8-1c30-417e-be4e-d612f6d1926d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:12.714955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b3103e8-1c30-417e-be4e-d612f6d1926d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:12.715676 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b3103e8-1c30-417e-be4e-d612f6d1926d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:12.717644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b3103e8-1c30-417e-be4e-d612f6d1926d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:12.718266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b3103e8-1c30-417e-be4e-d612f6d1926d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:12.718793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b3103e8-1c30-417e-be4e-d612f6d1926d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:13.835105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b2af0888-0933-4ebd-a048-151e8b2199b3 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:13.852608 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b2af0888-0933-4ebd-a048-151e8b2199b3 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1668 microversion: 2.1 time: 1.266496 Sep 07 12:59:13.853908 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2626/5307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:12 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1668 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:13.940478 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4b3103e8-1c30-417e-be4e-d612f6d1926d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:13.964077 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4b3103e8-1c30-417e-be4e-d612f6d1926d tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1501 microversion: 2.1 time: 1.263659 Sep 07 12:59:13.971554 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2682/5308] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:12 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1501 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:59:14.180448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-94434481-9299-469f-93b3-0486d86f7266 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-958409111", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "b3336e1f-f1f6-4d53-8b98-6cfc46a9fcbd"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:14.262937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-451805e6-348c-4de8-a6fe-bbb31ac5b273 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1871253530 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1871253530-project-admin] Calling method '.version_select at 0x7fc413f9b670>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:14.277352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-451805e6-348c-4de8-a6fe-bbb31ac5b273 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1871253530 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1871253530-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:14.278124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-451805e6-348c-4de8-a6fe-bbb31ac5b273 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1871253530 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1871253530-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:14.285442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-451805e6-348c-4de8-a6fe-bbb31ac5b273 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1871253530 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1871253530-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:14.347522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-94434481-9299-469f-93b3-0486d86f7266 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] validate_networks() for [('b3336e1f-f1f6-4d53-8b98-6cfc46a9fcbd', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 12:59:14.350523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-451805e6-348c-4de8-a6fe-bbb31ac5b273 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1871253530 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1871253530-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:14.351768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-451805e6-348c-4de8-a6fe-bbb31ac5b273 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1871253530 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1871253530-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:14.352827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-451805e6-348c-4de8-a6fe-bbb31ac5b273 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1871253530 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1871253530-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:14.371784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-451805e6-348c-4de8-a6fe-bbb31ac5b273 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1871253530 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1871253530-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:14.372853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-451805e6-348c-4de8-a6fe-bbb31ac5b273 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1871253530 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1871253530-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:14.375759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-451805e6-348c-4de8-a6fe-bbb31ac5b273 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1871253530 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1871253530-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:14.400230 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-451805e6-348c-4de8-a6fe-bbb31ac5b273 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1871253530 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1871253530-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.426072 Sep 07 12:59:14.401324 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2683/5309] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 12:59:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:59:14.422315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d6d046bd-b387-435b-adeb-4c476dc2fbb2 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:14.427692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d6d046bd-b387-435b-adeb-4c476dc2fbb2 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] [instance: 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:14.454276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6d046bd-b387-435b-adeb-4c476dc2fbb2 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:14.455099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6d046bd-b387-435b-adeb-4c476dc2fbb2 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:14.455721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6d046bd-b387-435b-adeb-4c476dc2fbb2 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:14.456564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6d046bd-b387-435b-adeb-4c476dc2fbb2 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:14.457119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6d046bd-b387-435b-adeb-4c476dc2fbb2 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:14.457951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6d046bd-b387-435b-adeb-4c476dc2fbb2 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:15.021642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d6d046bd-b387-435b-adeb-4c476dc2fbb2 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a619903be4381b50f09b6fee489be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d822016574a8b8502ad5a171d9a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:15.032234 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d6d046bd-b387-435b-adeb-4c476dc2fbb2 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369" status: 200 len: 1497 microversion: 2.1 time: 0.629357 Sep 07 12:59:15.033183 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2684/5310] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:14 2022] GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 => generated 1497 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:15.038465 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae271a0f-6eb7-40ce-9865-1c29a34a29fe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:15.039472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ae271a0f-6eb7-40ce-9865-1c29a34a29fe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:15.046581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae271a0f-6eb7-40ce-9865-1c29a34a29fe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:15.047395 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae271a0f-6eb7-40ce-9865-1c29a34a29fe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:15.048009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae271a0f-6eb7-40ce-9865-1c29a34a29fe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:15.048942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae271a0f-6eb7-40ce-9865-1c29a34a29fe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:15.049617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae271a0f-6eb7-40ce-9865-1c29a34a29fe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:15.050244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae271a0f-6eb7-40ce-9865-1c29a34a29fe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:15.911772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ae271a0f-6eb7-40ce-9865-1c29a34a29fe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:15.923403 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ae271a0f-6eb7-40ce-9865-1c29a34a29fe tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1501 microversion: 2.1 time: 0.888849 Sep 07 12:59:15.924020 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2685/5311] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:15 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1501 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:15.940542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5e37fd42-e065-419b-8ba5-49d19df0249e tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:15.973658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.compute.server_groups [None req-5e37fd42-e065-419b-8ba5-49d19df0249e tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Querying cell 9e0290a2-728a-49bc-bfb2-19275e06ed31(cell1) for 1 instances {{(pid=122433) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 07 12:59:15.975441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e37fd42-e065-419b-8ba5-49d19df0249e tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:15.976515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e37fd42-e065-419b-8ba5-49d19df0249e tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:15.977683 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e37fd42-e065-419b-8ba5-49d19df0249e tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:16.016189 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5e37fd42-e065-419b-8ba5-49d19df0249e tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/bbac1c8e-c88d-448b-beec-574d80ad7197" status: 200 len: 221 microversion: 2.1 time: 0.090262 Sep 07 12:59:16.023222 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2686/5312] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Sep 7 12:59:15 2022] GET /compute/v2.1/os-server-groups/bbac1c8e-c88d-448b-beec-574d80ad7197 => generated 221 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:59:16.028182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5afac100-1717-4193-9c92-07da8b2917fa tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:16.040287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5afac100-1717-4193-9c92-07da8b2917fa tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:16.041355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5afac100-1717-4193-9c92-07da8b2917fa tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:16.042161 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5afac100-1717-4193-9c92-07da8b2917fa tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:16.092812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5afac100-1717-4193-9c92-07da8b2917fa tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Going to try to stop instance {{(pid=122433) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 12:59:16.102454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:16.190359 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5afac100-1717-4193-9c92-07da8b2917fa tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "POST /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff/action" status: 202 len: 0 microversion: 2.1 time: 0.170187 Sep 07 12:59:16.197357 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2687/5313] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 12:59:16 2022] POST /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 12:59:16.212489 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9009c52b-6606-447a-b0f1-dafc8dd1236d tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:16.214101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9009c52b-6606-447a-b0f1-dafc8dd1236d tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] [instance: 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:16.225075 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-94434481-9299-469f-93b3-0486d86f7266 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 12:59:16.226205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-94434481-9299-469f-93b3-0486d86f7266 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 12:59:16.226702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-94434481-9299-469f-93b3-0486d86f7266 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 12:59:16.227121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-94434481-9299-469f-93b3-0486d86f7266 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 12:59:16.227541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-94434481-9299-469f-93b3-0486d86f7266 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 12:59:16.234644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9009c52b-6606-447a-b0f1-dafc8dd1236d tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:16.235205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9009c52b-6606-447a-b0f1-dafc8dd1236d tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:16.235931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9009c52b-6606-447a-b0f1-dafc8dd1236d tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:16.237359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9009c52b-6606-447a-b0f1-dafc8dd1236d tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:16.238411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9009c52b-6606-447a-b0f1-dafc8dd1236d tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:16.239868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9009c52b-6606-447a-b0f1-dafc8dd1236d tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:16.247905 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94434481-9299-469f-93b3-0486d86f7266 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:16.248414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94434481-9299-469f-93b3-0486d86f7266 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:16.248870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94434481-9299-469f-93b3-0486d86f7266 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:16.249690 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94434481-9299-469f-93b3-0486d86f7266 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:16.250173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94434481-9299-469f-93b3-0486d86f7266 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:16.250619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-94434481-9299-469f-93b3-0486d86f7266 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:16.284169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9009c52b-6606-447a-b0f1-dafc8dd1236d tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] [instance: 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:59:16.297535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-94434481-9299-469f-93b3-0486d86f7266 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Getting quotas for project 03c23f2e6caa450286d406171c97dd31. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 12:59:16.304182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-94434481-9299-469f-93b3-0486d86f7266 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Getting quotas for user 1fd24d5039654ee4970759257ceaf028 and project 03c23f2e6caa450286d406171c97dd31. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 12:59:16.359800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-94434481-9299-469f-93b3-0486d86f7266 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 12:59:16.374827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-94434481-9299-469f-93b3-0486d86f7266 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] [instance: ab987f7a-2da5-45f4-9609-2e25300a1131] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 12:59:16.471356 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9009c52b-6606-447a-b0f1-dafc8dd1236d tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369" status: 204 len: 0 microversion: 2.1 time: 0.268709 Sep 07 12:59:16.480378 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2688/5314] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:59:16 2022] DELETE /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:16.488139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d525888d-5a93-484f-ac78-41c696116a7a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:16.488868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d525888d-5a93-484f-ac78-41c696116a7a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:16.498410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d525888d-5a93-484f-ac78-41c696116a7a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:16.498916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d525888d-5a93-484f-ac78-41c696116a7a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:16.499351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d525888d-5a93-484f-ac78-41c696116a7a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:16.500127 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d525888d-5a93-484f-ac78-41c696116a7a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:16.501137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d525888d-5a93-484f-ac78-41c696116a7a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:16.501721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d525888d-5a93-484f-ac78-41c696116a7a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:16.508340 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-94434481-9299-469f-93b3-0486d86f7266 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.652406 Sep 07 12:59:16.518128 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2627/5315] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:59:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 12:59:16.525689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e3925fee-b53b-4c40-b2ad-d55eaf9b0eda tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:16.526848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e3925fee-b53b-4c40-b2ad-d55eaf9b0eda tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] [instance: 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:16.535602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3925fee-b53b-4c40-b2ad-d55eaf9b0eda tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:16.536371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3925fee-b53b-4c40-b2ad-d55eaf9b0eda tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:16.537117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3925fee-b53b-4c40-b2ad-d55eaf9b0eda tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:16.538475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3925fee-b53b-4c40-b2ad-d55eaf9b0eda tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:16.539241 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3925fee-b53b-4c40-b2ad-d55eaf9b0eda tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:16.539954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e3925fee-b53b-4c40-b2ad-d55eaf9b0eda tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:16.975639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d525888d-5a93-484f-ac78-41c696116a7a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:16.990053 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d525888d-5a93-484f-ac78-41c696116a7a tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1511 microversion: 2.1 time: 0.503737 Sep 07 12:59:16.990744 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2689/5316] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:16 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1511 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:17.010104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2f7df100-03dc-482f-be15-d278362eb07a tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:17.011558 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2f7df100-03dc-482f-be15-d278362eb07a tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] [instance: ab987f7a-2da5-45f4-9609-2e25300a1131] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:17.089723 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e3925fee-b53b-4c40-b2ad-d55eaf9b0eda tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a619903be4381b50f09b6fee489be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d822016574a8b8502ad5a171d9a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:17.102229 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e3925fee-b53b-4c40-b2ad-d55eaf9b0eda tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369" status: 200 len: 1503 microversion: 2.1 time: 0.582036 Sep 07 12:59:17.106317 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2628/5317] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:16 2022] GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 => generated 1503 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:17.171199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2f7df100-03dc-482f-be15-d278362eb07a tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd24d5039654ee4970759257ceaf028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c23f2e6caa450286d406171c97dd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:17.205194 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2f7df100-03dc-482f-be15-d278362eb07a tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] 10.222.0.16 "GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131" status: 200 len: 1223 microversion: 2.1 time: 0.205151 Sep 07 12:59:17.206556 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2690/5318] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:16 2022] GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131 => generated 1223 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:18.039786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7d220393-6fdd-469a-b4df-fe369e547057 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:18.040418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7d220393-6fdd-469a-b4df-fe369e547057 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:18.057293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d220393-6fdd-469a-b4df-fe369e547057 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:18.064935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d220393-6fdd-469a-b4df-fe369e547057 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:18.065396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d220393-6fdd-469a-b4df-fe369e547057 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:18.066697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d220393-6fdd-469a-b4df-fe369e547057 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:18.073792 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d220393-6fdd-469a-b4df-fe369e547057 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:18.074566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7d220393-6fdd-469a-b4df-fe369e547057 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:18.150233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c8ac697-9109-4fa1-b7d9-5d18fae02451 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:18.162220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2c8ac697-9109-4fa1-b7d9-5d18fae02451 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] [instance: 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:18.193974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c8ac697-9109-4fa1-b7d9-5d18fae02451 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:18.194860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c8ac697-9109-4fa1-b7d9-5d18fae02451 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:18.196138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c8ac697-9109-4fa1-b7d9-5d18fae02451 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:18.197903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c8ac697-9109-4fa1-b7d9-5d18fae02451 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:18.199331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c8ac697-9109-4fa1-b7d9-5d18fae02451 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:18.199954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c8ac697-9109-4fa1-b7d9-5d18fae02451 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:19.062997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7d220393-6fdd-469a-b4df-fe369e547057 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:19.084407 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7d220393-6fdd-469a-b4df-fe369e547057 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1511 microversion: 2.1 time: 1.046321 Sep 07 12:59:19.089095 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2629/5319] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:18 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1511 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:19.099507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4eaacb6a-a63c-47ef-acad-870f77865f65 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:19.101307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4eaacb6a-a63c-47ef-acad-870f77865f65 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] [instance: ab987f7a-2da5-45f4-9609-2e25300a1131] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:19.135195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4eaacb6a-a63c-47ef-acad-870f77865f65 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:19.144842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4eaacb6a-a63c-47ef-acad-870f77865f65 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:19.145871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4eaacb6a-a63c-47ef-acad-870f77865f65 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:19.148788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4eaacb6a-a63c-47ef-acad-870f77865f65 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:19.149289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4eaacb6a-a63c-47ef-acad-870f77865f65 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:19.149764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4eaacb6a-a63c-47ef-acad-870f77865f65 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:19.195257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2c8ac697-9109-4fa1-b7d9-5d18fae02451 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a619903be4381b50f09b6fee489be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d822016574a8b8502ad5a171d9a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:19.208017 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2c8ac697-9109-4fa1-b7d9-5d18fae02451 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369" status: 200 len: 1503 microversion: 2.1 time: 1.079370 Sep 07 12:59:19.227405 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2691/5320] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:18 2022] GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 => generated 1503 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:19.496991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4eaacb6a-a63c-47ef-acad-870f77865f65 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd24d5039654ee4970759257ceaf028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c23f2e6caa450286d406171c97dd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:19.506259 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4eaacb6a-a63c-47ef-acad-870f77865f65 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] 10.222.0.16 "GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131" status: 200 len: 1283 microversion: 2.1 time: 0.414812 Sep 07 12:59:19.518255 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2630/5321] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:19 2022] GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131 => generated 1283 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:20.137295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c5ce941b-6a49-463a-9fcb-f58a9b6e95e8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:20.138876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c5ce941b-6a49-463a-9fcb-f58a9b6e95e8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:20.151629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5ce941b-6a49-463a-9fcb-f58a9b6e95e8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:20.152849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5ce941b-6a49-463a-9fcb-f58a9b6e95e8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:20.155237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5ce941b-6a49-463a-9fcb-f58a9b6e95e8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:20.156182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5ce941b-6a49-463a-9fcb-f58a9b6e95e8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:20.158897 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5ce941b-6a49-463a-9fcb-f58a9b6e95e8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:20.159538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5ce941b-6a49-463a-9fcb-f58a9b6e95e8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:20.243055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dcbc1d72-45e0-4eef-bc84-9561526ccea5 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:20.244609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dcbc1d72-45e0-4eef-bc84-9561526ccea5 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] [instance: 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:20.260040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dcbc1d72-45e0-4eef-bc84-9561526ccea5 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:20.262168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dcbc1d72-45e0-4eef-bc84-9561526ccea5 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:20.264285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dcbc1d72-45e0-4eef-bc84-9561526ccea5 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:20.265306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dcbc1d72-45e0-4eef-bc84-9561526ccea5 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:20.268694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dcbc1d72-45e0-4eef-bc84-9561526ccea5 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:20.270152 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dcbc1d72-45e0-4eef-bc84-9561526ccea5 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:20.623661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dcbc1d72-45e0-4eef-bc84-9561526ccea5 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a619903be4381b50f09b6fee489be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d822016574a8b8502ad5a171d9a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:20.637788 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dcbc1d72-45e0-4eef-bc84-9561526ccea5 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369" status: 200 len: 1461 microversion: 2.1 time: 0.399353 Sep 07 12:59:20.640645 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2631/5322] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:20 2022] GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 => generated 1461 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:59:20.664446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-59b22531-5534-4ce2-b558-cebc71b5678c tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:20.665299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-59b22531-5534-4ce2-b558-cebc71b5678c tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] [instance: ab987f7a-2da5-45f4-9609-2e25300a1131] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:20.693518 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59b22531-5534-4ce2-b558-cebc71b5678c tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:20.697341 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59b22531-5534-4ce2-b558-cebc71b5678c tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:20.699461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59b22531-5534-4ce2-b558-cebc71b5678c tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:20.701124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59b22531-5534-4ce2-b558-cebc71b5678c tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:20.706299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59b22531-5534-4ce2-b558-cebc71b5678c tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:20.706612 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59b22531-5534-4ce2-b558-cebc71b5678c tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:21.039190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-59b22531-5534-4ce2-b558-cebc71b5678c tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd24d5039654ee4970759257ceaf028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c23f2e6caa450286d406171c97dd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:21.051564 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-59b22531-5534-4ce2-b558-cebc71b5678c tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] 10.222.0.16 "GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131" status: 200 len: 1281 microversion: 2.1 time: 0.409423 Sep 07 12:59:21.054808 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2632/5323] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:20 2022] GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131 => generated 1281 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:21.111983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c5ce941b-6a49-463a-9fcb-f58a9b6e95e8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:21.165026 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c5ce941b-6a49-463a-9fcb-f58a9b6e95e8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1511 microversion: 2.1 time: 1.027753 Sep 07 12:59:21.167868 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2692/5324] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:20 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1511 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:21.615525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e6ea75fe-e028-4583-bd91-740299aa2c7a req-136a6f49-48e6-42dd-b6e6-91772a2796b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1456a21a-1f2e-4de3-bbc3-f4eb32b1d369", "name": "network-vif-deleted", "tag": "801ec14b-bcbb-4411-823c-7f229594cab3"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:21.636821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e6ea75fe-e028-4583-bd91-740299aa2c7a req-136a6f49-48e6-42dd-b6e6-91772a2796b9 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:21.654361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e6ea75fe-e028-4583-bd91-740299aa2c7a req-136a6f49-48e6-42dd-b6e6-91772a2796b9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:21.655145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e6ea75fe-e028-4583-bd91-740299aa2c7a req-136a6f49-48e6-42dd-b6e6-91772a2796b9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:21.681364 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-462ce436-9307-4aeb-9dcc-9bdaceaf222b tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:21.689331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-462ce436-9307-4aeb-9dcc-9bdaceaf222b tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] [instance: 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:21.773404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-462ce436-9307-4aeb-9dcc-9bdaceaf222b tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:21.788900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-462ce436-9307-4aeb-9dcc-9bdaceaf222b tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:21.789845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-462ce436-9307-4aeb-9dcc-9bdaceaf222b tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:21.808996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-462ce436-9307-4aeb-9dcc-9bdaceaf222b tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:21.810164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-462ce436-9307-4aeb-9dcc-9bdaceaf222b tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:21.815188 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e6ea75fe-e028-4583-bd91-740299aa2c7a req-136a6f49-48e6-42dd-b6e6-91772a2796b9 service nova] Creating event network-vif-deleted:801ec14b-bcbb-4411-823c-7f229594cab3 for instance 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 on n-h2-852087-9 Sep 07 12:59:21.829871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-462ce436-9307-4aeb-9dcc-9bdaceaf222b tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:21.847379 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e6ea75fe-e028-4583-bd91-740299aa2c7a req-136a6f49-48e6-42dd-b6e6-91772a2796b9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.786983 Sep 07 12:59:21.849065 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2633/5325] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:59:21.905262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-462ce436-9307-4aeb-9dcc-9bdaceaf222b tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:21.906236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-462ce436-9307-4aeb-9dcc-9bdaceaf222b tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:21.906860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-462ce436-9307-4aeb-9dcc-9bdaceaf222b tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:21.907658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-462ce436-9307-4aeb-9dcc-9bdaceaf222b tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lazy-loading 'fault' on Instance uuid 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:59:22.033719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-462ce436-9307-4aeb-9dcc-9bdaceaf222b tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9a619903be4381b50f09b6fee489be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726d822016574a8b8502ad5a171d9a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:22.095791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c49feb60-07bf-408b-a177-bdbd00d33be7 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:22.096967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c49feb60-07bf-408b-a177-bdbd00d33be7 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] [instance: ab987f7a-2da5-45f4-9609-2e25300a1131] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:22.098536 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-462ce436-9307-4aeb-9dcc-9bdaceaf222b tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369" status: 200 len: 1303 microversion: 2.1 time: 0.425041 Sep 07 12:59:22.101921 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2693/5326] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:21 2022] GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 => generated 1303 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:22.112927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c49feb60-07bf-408b-a177-bdbd00d33be7 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:22.113967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c49feb60-07bf-408b-a177-bdbd00d33be7 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:22.115270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c49feb60-07bf-408b-a177-bdbd00d33be7 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:22.116713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c49feb60-07bf-408b-a177-bdbd00d33be7 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:22.117527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c49feb60-07bf-408b-a177-bdbd00d33be7 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:22.117921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c49feb60-07bf-408b-a177-bdbd00d33be7 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:22.194298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8f9073cb-2242-4640-a505-8bc486f4095b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:22.194918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8f9073cb-2242-4640-a505-8bc486f4095b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:22.215036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f9073cb-2242-4640-a505-8bc486f4095b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:22.217080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f9073cb-2242-4640-a505-8bc486f4095b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:22.223391 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f9073cb-2242-4640-a505-8bc486f4095b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:22.230064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f9073cb-2242-4640-a505-8bc486f4095b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:22.232124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f9073cb-2242-4640-a505-8bc486f4095b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:22.235158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f9073cb-2242-4640-a505-8bc486f4095b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:22.742933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c49feb60-07bf-408b-a177-bdbd00d33be7 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd24d5039654ee4970759257ceaf028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c23f2e6caa450286d406171c97dd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:22.763676 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c49feb60-07bf-408b-a177-bdbd00d33be7 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] 10.222.0.16 "GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131" status: 200 len: 1323 microversion: 2.1 time: 0.671915 Sep 07 12:59:22.765346 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2634/5327] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:22 2022] GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131 => generated 1323 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:22.786716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8f9073cb-2242-4640-a505-8bc486f4095b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:22.805273 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8f9073cb-2242-4640-a505-8bc486f4095b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1511 microversion: 2.1 time: 0.614963 Sep 07 12:59:22.806472 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2694/5328] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:22 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1511 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:23.130272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dc8c7582-7ffc-43bb-b9be-fd12deb6e2bf tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:23.132334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dc8c7582-7ffc-43bb-b9be-fd12deb6e2bf tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] [instance: 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:23.145783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc8c7582-7ffc-43bb-b9be-fd12deb6e2bf tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:23.147593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc8c7582-7ffc-43bb-b9be-fd12deb6e2bf tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:23.148812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc8c7582-7ffc-43bb-b9be-fd12deb6e2bf tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:23.150588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc8c7582-7ffc-43bb-b9be-fd12deb6e2bf tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:23.151848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc8c7582-7ffc-43bb-b9be-fd12deb6e2bf tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:23.152991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc8c7582-7ffc-43bb-b9be-fd12deb6e2bf tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:23.183522 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-dc8c7582-7ffc-43bb-b9be-fd12deb6e2bf tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] HTTP exception thrown: Instance 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 could not be found. Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dc8c7582-7ffc-43bb-b9be-fd12deb6e2bf tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Request method failure captured: Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 HTTP/1.1 Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJWGhT9hyyPS0seVunsv0cQN42ptsHyVck4ejYkp4OtChyarNGjzYJ6Dck9YxaHmS75D4b3IdDiSaaYrpcHyOpIn15QrpdgSsibXFF1XOCKWLFzDQge2f2mIvfFpmBopcFIqLPfW6Q-k8tJKMbO73kYuOdTV1iBD-uf8Rc_HTnIbFrQ Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 726d822016574a8b8502ad5a171d9a60 Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerGroupTestJSON-897715056 Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/726d822016574a8b8502ad5a171d9a60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_726d822016574a8b8502ad5a171d9a60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/726d822016574a8b8502ad5a171d9a60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/726d822016574a8b8502ad5a171d9a60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerGroupTestJSON-897715056 Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 726d822016574a8b8502ad5a171d9a60 Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerGroupTestJSON-897715056 Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerGroupTestJSON-897715056-project Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: ee9a619903be4381b50f09b6fee489be Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerGroupTestJSON-897715056-project Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 could not be found. Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '1456a21a-1f2e-4de3-bbc3-f4eb32b1d369'} Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 could not be found. Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 could not be found. Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:23.187423 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.195994 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:23.195994 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:23.195994 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:23.195994 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:23.195994 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:23.195994 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 could not be found. Sep 07 12:59:23.195994 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.198449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dc8c7582-7ffc-43bb-b9be-fd12deb6e2bf tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Returning 404 to user: Instance 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:23.207570 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dc8c7582-7ffc-43bb-b9be-fd12deb6e2bf tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369" status: 404 len: 111 microversion: 2.1 time: 0.084069 Sep 07 12:59:23.209254 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2635/5329] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:23 2022] GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:59:23.225030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3305c2b8-70a7-44d5-bc85-8048abf472c2 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:23.261127 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.compute.server_groups [None req-3305c2b8-70a7-44d5-bc85-8048abf472c2 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Querying cell 9e0290a2-728a-49bc-bfb2-19275e06ed31(cell1) for 1 instances {{(pid=122433) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 07 12:59:23.263756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3305c2b8-70a7-44d5-bc85-8048abf472c2 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:23.265103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3305c2b8-70a7-44d5-bc85-8048abf472c2 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:23.266222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3305c2b8-70a7-44d5-bc85-8048abf472c2 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:23.320769 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3305c2b8-70a7-44d5-bc85-8048abf472c2 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.101662 Sep 07 12:59:23.322158 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2695/5330] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Sep 7 12:59:23 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:59:23.346722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aa67a108-a6ac-4fb6-ae65-c146cc08cfa3 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:23.405247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.compute.server_groups [None req-aa67a108-a6ac-4fb6-ae65-c146cc08cfa3 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Querying cell 9e0290a2-728a-49bc-bfb2-19275e06ed31(cell1) for 1 instances {{(pid=122432) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 07 12:59:23.407256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa67a108-a6ac-4fb6-ae65-c146cc08cfa3 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:23.408509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa67a108-a6ac-4fb6-ae65-c146cc08cfa3 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:23.411959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa67a108-a6ac-4fb6-ae65-c146cc08cfa3 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:23.446005 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aa67a108-a6ac-4fb6-ae65-c146cc08cfa3 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/bbac1c8e-c88d-448b-beec-574d80ad7197" status: 200 len: 183 microversion: 2.1 time: 0.109341 Sep 07 12:59:23.450226 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2636/5331] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Sep 7 12:59:23 2022] GET /compute/v2.1/os-server-groups/bbac1c8e-c88d-448b-beec-574d80ad7197 => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:59:23.471986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-605c2d32-23c6-4fb8-8deb-7e952996bbcc tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:23.473599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-605c2d32-23c6-4fb8-8deb-7e952996bbcc tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] [instance: 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:23.491382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-605c2d32-23c6-4fb8-8deb-7e952996bbcc tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:23.493468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-605c2d32-23c6-4fb8-8deb-7e952996bbcc tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:23.494819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-605c2d32-23c6-4fb8-8deb-7e952996bbcc tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:23.496653 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-605c2d32-23c6-4fb8-8deb-7e952996bbcc tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:23.497737 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-605c2d32-23c6-4fb8-8deb-7e952996bbcc tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:23.498764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-605c2d32-23c6-4fb8-8deb-7e952996bbcc tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:23.534527 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-605c2d32-23c6-4fb8-8deb-7e952996bbcc tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] HTTP exception thrown: Instance 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 could not be found. Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-605c2d32-23c6-4fb8-8deb-7e952996bbcc tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Request method failure captured: Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 HTTP/1.1 Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJWGhT9hyyPS0seVunsv0cQN42ptsHyVck4ejYkp4OtChyarNGjzYJ6Dck9YxaHmS75D4b3IdDiSaaYrpcHyOpIn15QrpdgSsibXFF1XOCKWLFzDQge2f2mIvfFpmBopcFIqLPfW6Q-k8tJKMbO73kYuOdTV1iBD-uf8Rc_HTnIbFrQ Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 726d822016574a8b8502ad5a171d9a60 Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerGroupTestJSON-897715056 Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/726d822016574a8b8502ad5a171d9a60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_726d822016574a8b8502ad5a171d9a60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/726d822016574a8b8502ad5a171d9a60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/726d822016574a8b8502ad5a171d9a60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerGroupTestJSON-897715056 Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 726d822016574a8b8502ad5a171d9a60 Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerGroupTestJSON-897715056 Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerGroupTestJSON-897715056-project Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: ee9a619903be4381b50f09b6fee489be Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerGroupTestJSON-897715056-project Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 could not be found. Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '1456a21a-1f2e-4de3-bbc3-f4eb32b1d369'} Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 could not be found. Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:59:23.538946 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:23.547374 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 could not be found. Sep 07 12:59:23.547374 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.547374 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:23.547374 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.547374 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:23.547374 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:23.547374 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:23.547374 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:23.547374 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:23.547374 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 could not be found. Sep 07 12:59:23.547374 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.550744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-605c2d32-23c6-4fb8-8deb-7e952996bbcc tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Returning 404 to user: Instance 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:23.552572 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-605c2d32-23c6-4fb8-8deb-7e952996bbcc tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369" status: 404 len: 111 microversion: 2.1 time: 0.088716 Sep 07 12:59:23.554322 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2696/5332] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:59:23 2022] DELETE /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:59:23.567281 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-18d8abe5-35b4-4e14-a512-a0648926957f tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:23.567917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-18d8abe5-35b4-4e14-a512-a0648926957f tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] [instance: 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:23.580336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18d8abe5-35b4-4e14-a512-a0648926957f tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:23.580842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18d8abe5-35b4-4e14-a512-a0648926957f tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:23.581511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18d8abe5-35b4-4e14-a512-a0648926957f tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:23.582613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18d8abe5-35b4-4e14-a512-a0648926957f tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:23.583354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18d8abe5-35b4-4e14-a512-a0648926957f tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:23.584013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18d8abe5-35b4-4e14-a512-a0648926957f tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:23.612097 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-18d8abe5-35b4-4e14-a512-a0648926957f tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] HTTP exception thrown: Instance 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 could not be found. Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-18d8abe5-35b4-4e14-a512-a0648926957f tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Request method failure captured: Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 HTTP/1.1 Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJWGhT9hyyPS0seVunsv0cQN42ptsHyVck4ejYkp4OtChyarNGjzYJ6Dck9YxaHmS75D4b3IdDiSaaYrpcHyOpIn15QrpdgSsibXFF1XOCKWLFzDQge2f2mIvfFpmBopcFIqLPfW6Q-k8tJKMbO73kYuOdTV1iBD-uf8Rc_HTnIbFrQ Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 726d822016574a8b8502ad5a171d9a60 Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerGroupTestJSON-897715056 Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/726d822016574a8b8502ad5a171d9a60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_726d822016574a8b8502ad5a171d9a60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/726d822016574a8b8502ad5a171d9a60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/726d822016574a8b8502ad5a171d9a60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerGroupTestJSON-897715056 Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 726d822016574a8b8502ad5a171d9a60 Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerGroupTestJSON-897715056 Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerGroupTestJSON-897715056-project Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: ee9a619903be4381b50f09b6fee489be Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerGroupTestJSON-897715056-project Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 could not be found. Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '1456a21a-1f2e-4de3-bbc3-f4eb32b1d369'} Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 could not be found. Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 could not be found. Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:23.613886 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.621347 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:23.621347 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:23.621347 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:23.621347 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:23.621347 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:23.621347 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 could not be found. Sep 07 12:59:23.621347 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.621347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-18d8abe5-35b4-4e14-a512-a0648926957f tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Returning 404 to user: Instance 1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:23.621347 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-18d8abe5-35b4-4e14-a512-a0648926957f tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369" status: 404 len: 111 microversion: 2.1 time: 0.055623 Sep 07 12:59:23.621347 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2637/5333] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:23 2022] GET /compute/v2.1/servers/1456a21a-1f2e-4de3-bbc3-f4eb32b1d369 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:59:23.630472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ef04876-d2cb-49ef-91e2-bc713e73492c tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:23.645784 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-4ef04876-d2cb-49ef-91e2-bc713e73492c tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] HTTP exception thrown: Instance group c44dbd5f-70c7-4f91-bd5a-da27b1a19de6 could not be found. Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ef04876-d2cb-49ef-91e2-bc713e73492c tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Request method failure captured: Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-server-groups/c44dbd5f-70c7-4f91-bd5a-da27b1a19de6 HTTP/1.1 Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJWGhT9hyyPS0seVunsv0cQN42ptsHyVck4ejYkp4OtChyarNGjzYJ6Dck9YxaHmS75D4b3IdDiSaaYrpcHyOpIn15QrpdgSsibXFF1XOCKWLFzDQge2f2mIvfFpmBopcFIqLPfW6Q-k8tJKMbO73kYuOdTV1iBD-uf8Rc_HTnIbFrQ Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 726d822016574a8b8502ad5a171d9a60 Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerGroupTestJSON-897715056 Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/726d822016574a8b8502ad5a171d9a60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_726d822016574a8b8502ad5a171d9a60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/726d822016574a8b8502ad5a171d9a60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/726d822016574a8b8502ad5a171d9a60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerGroupTestJSON-897715056 Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 726d822016574a8b8502ad5a171d9a60 Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerGroupTestJSON-897715056 Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerGroupTestJSON-897715056-project Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: ee9a619903be4381b50f09b6fee489be Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerGroupTestJSON-897715056-project Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance group c44dbd5f-70c7-4f91-bd5a-da27b1a19de6 could not be found. Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'c44dbd5f-70c7-4f91-bd5a-da27b1a19de6'} Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c44dbd5f-70c7-4f91-bd5a-da27b1a19de6 could not be found. Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c44dbd5f-70c7-4f91-bd5a-da27b1a19de6 could not be found. Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.649962 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:23.664589 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:23.664589 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:23.664589 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:23.664589 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:23.664589 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c44dbd5f-70c7-4f91-bd5a-da27b1a19de6 could not be found. Sep 07 12:59:23.664589 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.664589 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ef04876-d2cb-49ef-91e2-bc713e73492c tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Returning 404 to user: Instance group c44dbd5f-70c7-4f91-bd5a-da27b1a19de6 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:23.664589 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ef04876-d2cb-49ef-91e2-bc713e73492c tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/c44dbd5f-70c7-4f91-bd5a-da27b1a19de6" status: 404 len: 117 microversion: 2.1 time: 0.032065 Sep 07 12:59:23.664589 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2697/5334] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Sep 7 12:59:23 2022] DELETE /compute/v2.1/os-server-groups/c44dbd5f-70c7-4f91-bd5a-da27b1a19de6 => generated 117 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:59:23.667521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e4127fc8-014f-4399-a7b9-b23dd35a506a tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:23.674731 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-e4127fc8-014f-4399-a7b9-b23dd35a506a tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] HTTP exception thrown: Instance group 1b9a9d09-cc0e-4893-a84b-759878734031 could not be found. Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e4127fc8-014f-4399-a7b9-b23dd35a506a tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Request method failure captured: Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/os-server-groups/1b9a9d09-cc0e-4893-a84b-759878734031 HTTP/1.1 Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJWGhT9hyyPS0seVunsv0cQN42ptsHyVck4ejYkp4OtChyarNGjzYJ6Dck9YxaHmS75D4b3IdDiSaaYrpcHyOpIn15QrpdgSsibXFF1XOCKWLFzDQge2f2mIvfFpmBopcFIqLPfW6Q-k8tJKMbO73kYuOdTV1iBD-uf8Rc_HTnIbFrQ Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 726d822016574a8b8502ad5a171d9a60 Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerGroupTestJSON-897715056 Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/726d822016574a8b8502ad5a171d9a60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_726d822016574a8b8502ad5a171d9a60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/726d822016574a8b8502ad5a171d9a60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/726d822016574a8b8502ad5a171d9a60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerGroupTestJSON-897715056 Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 726d822016574a8b8502ad5a171d9a60 Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerGroupTestJSON-897715056 Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerGroupTestJSON-897715056-project Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: ee9a619903be4381b50f09b6fee489be Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerGroupTestJSON-897715056-project Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance group 1b9a9d09-cc0e-4893-a84b-759878734031 could not be found. Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '1b9a9d09-cc0e-4893-a84b-759878734031'} Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1b9a9d09-cc0e-4893-a84b-759878734031 could not be found. Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1b9a9d09-cc0e-4893-a84b-759878734031 could not be found. Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.685050 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:23.700775 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:23.700775 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:23.700775 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:23.700775 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:23.700775 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1b9a9d09-cc0e-4893-a84b-759878734031 could not be found. Sep 07 12:59:23.700775 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.700775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e4127fc8-014f-4399-a7b9-b23dd35a506a tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Returning 404 to user: Instance group 1b9a9d09-cc0e-4893-a84b-759878734031 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:23.700775 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e4127fc8-014f-4399-a7b9-b23dd35a506a tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/1b9a9d09-cc0e-4893-a84b-759878734031" status: 404 len: 117 microversion: 2.1 time: 0.025735 Sep 07 12:59:23.700775 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2638/5335] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Sep 7 12:59:23 2022] DELETE /compute/v2.1/os-server-groups/1b9a9d09-cc0e-4893-a84b-759878734031 => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:59:23.701970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-29590613-711e-44ed-87b3-d5c9b9dc7884 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:23.714252 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-29590613-711e-44ed-87b3-d5c9b9dc7884 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] HTTP exception thrown: Instance group d6ca57f4-5d98-41c9-a39a-f67f9c43dfcc could not be found. Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-29590613-711e-44ed-87b3-d5c9b9dc7884 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Request method failure captured: Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-server-groups/d6ca57f4-5d98-41c9-a39a-f67f9c43dfcc HTTP/1.1 Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJWGhT9hyyPS0seVunsv0cQN42ptsHyVck4ejYkp4OtChyarNGjzYJ6Dck9YxaHmS75D4b3IdDiSaaYrpcHyOpIn15QrpdgSsibXFF1XOCKWLFzDQge2f2mIvfFpmBopcFIqLPfW6Q-k8tJKMbO73kYuOdTV1iBD-uf8Rc_HTnIbFrQ Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 726d822016574a8b8502ad5a171d9a60 Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerGroupTestJSON-897715056 Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/726d822016574a8b8502ad5a171d9a60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_726d822016574a8b8502ad5a171d9a60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/726d822016574a8b8502ad5a171d9a60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/726d822016574a8b8502ad5a171d9a60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerGroupTestJSON-897715056 Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 726d822016574a8b8502ad5a171d9a60 Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerGroupTestJSON-897715056 Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerGroupTestJSON-897715056-project Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: ee9a619903be4381b50f09b6fee489be Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerGroupTestJSON-897715056-project Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance group d6ca57f4-5d98-41c9-a39a-f67f9c43dfcc could not be found. Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'd6ca57f4-5d98-41c9-a39a-f67f9c43dfcc'} Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d6ca57f4-5d98-41c9-a39a-f67f9c43dfcc could not be found. Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d6ca57f4-5d98-41c9-a39a-f67f9c43dfcc could not be found. Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.717912 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:23.731121 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:23.731121 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:23.731121 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:23.731121 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:23.731121 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d6ca57f4-5d98-41c9-a39a-f67f9c43dfcc could not be found. Sep 07 12:59:23.731121 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.731121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-29590613-711e-44ed-87b3-d5c9b9dc7884 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Returning 404 to user: Instance group d6ca57f4-5d98-41c9-a39a-f67f9c43dfcc could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:23.734366 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-29590613-711e-44ed-87b3-d5c9b9dc7884 tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/d6ca57f4-5d98-41c9-a39a-f67f9c43dfcc" status: 404 len: 117 microversion: 2.1 time: 0.041686 Sep 07 12:59:23.738617 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2698/5336] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Sep 7 12:59:23 2022] DELETE /compute/v2.1/os-server-groups/d6ca57f4-5d98-41c9-a39a-f67f9c43dfcc => generated 117 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:59:23.747093 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e159eb8-a820-4dd8-bfdb-a1bceaa3aa2c tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:23.755742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:23.756943 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-6e159eb8-a820-4dd8-bfdb-a1bceaa3aa2c tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] HTTP exception thrown: Instance group 7c1dd4ca-759e-4751-b65f-1453b728a81a could not be found. Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e159eb8-a820-4dd8-bfdb-a1bceaa3aa2c tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Request method failure captured: Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/os-server-groups/7c1dd4ca-759e-4751-b65f-1453b728a81a HTTP/1.1 Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJWGhT9hyyPS0seVunsv0cQN42ptsHyVck4ejYkp4OtChyarNGjzYJ6Dck9YxaHmS75D4b3IdDiSaaYrpcHyOpIn15QrpdgSsibXFF1XOCKWLFzDQge2f2mIvfFpmBopcFIqLPfW6Q-k8tJKMbO73kYuOdTV1iBD-uf8Rc_HTnIbFrQ Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 726d822016574a8b8502ad5a171d9a60 Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerGroupTestJSON-897715056 Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/726d822016574a8b8502ad5a171d9a60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_726d822016574a8b8502ad5a171d9a60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/726d822016574a8b8502ad5a171d9a60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/726d822016574a8b8502ad5a171d9a60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerGroupTestJSON-897715056 Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 726d822016574a8b8502ad5a171d9a60 Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerGroupTestJSON-897715056 Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerGroupTestJSON-897715056-project Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: ee9a619903be4381b50f09b6fee489be Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerGroupTestJSON-897715056-project Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance group 7c1dd4ca-759e-4751-b65f-1453b728a81a could not be found. Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '7c1dd4ca-759e-4751-b65f-1453b728a81a'} Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7c1dd4ca-759e-4751-b65f-1453b728a81a could not be found. Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7c1dd4ca-759e-4751-b65f-1453b728a81a could not be found. Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.760016 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:23.769780 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:23.769780 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:23.769780 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:23.769780 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:23.769780 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7c1dd4ca-759e-4751-b65f-1453b728a81a could not be found. Sep 07 12:59:23.769780 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:23.769780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e159eb8-a820-4dd8-bfdb-a1bceaa3aa2c tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Returning 404 to user: Instance group 7c1dd4ca-759e-4751-b65f-1453b728a81a could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:23.769780 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6e159eb8-a820-4dd8-bfdb-a1bceaa3aa2c tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/7c1dd4ca-759e-4751-b65f-1453b728a81a" status: 404 len: 117 microversion: 2.1 time: 0.019516 Sep 07 12:59:23.769780 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2639/5337] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Sep 7 12:59:23 2022] DELETE /compute/v2.1/os-server-groups/7c1dd4ca-759e-4751-b65f-1453b728a81a => generated 117 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:59:23.786532 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-37596782-1400-4982-8df6-d63106867cbc tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:23.789445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-04f8867d-e12e-4028-9edf-2c537c46729b tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:23.790144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-04f8867d-e12e-4028-9edf-2c537c46729b tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] [instance: ab987f7a-2da5-45f4-9609-2e25300a1131] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:23.797414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04f8867d-e12e-4028-9edf-2c537c46729b tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:23.798100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04f8867d-e12e-4028-9edf-2c537c46729b tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:23.798545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04f8867d-e12e-4028-9edf-2c537c46729b tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:23.799282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04f8867d-e12e-4028-9edf-2c537c46729b tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:23.799850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04f8867d-e12e-4028-9edf-2c537c46729b tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:23.800288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04f8867d-e12e-4028-9edf-2c537c46729b tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:23.826483 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:23.880996 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-37596782-1400-4982-8df6-d63106867cbc tempest-ServerGroupTestJSON-897715056 tempest-ServerGroupTestJSON-897715056-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/bbac1c8e-c88d-448b-beec-574d80ad7197" status: 204 len: 0 microversion: 2.1 time: 0.111305 Sep 07 12:59:23.893555 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2699/5338] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Sep 7 12:59:23 2022] DELETE /compute/v2.1/os-server-groups/bbac1c8e-c88d-448b-beec-574d80ad7197 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:23.912414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bd5f7fc3-e18b-4d7d-a5c4-fd1b811f05b8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:23.913657 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bd5f7fc3-e18b-4d7d-a5c4-fd1b811f05b8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:23.926664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd5f7fc3-e18b-4d7d-a5c4-fd1b811f05b8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:23.927799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd5f7fc3-e18b-4d7d-a5c4-fd1b811f05b8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:23.930192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd5f7fc3-e18b-4d7d-a5c4-fd1b811f05b8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:23.931901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd5f7fc3-e18b-4d7d-a5c4-fd1b811f05b8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:23.932954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd5f7fc3-e18b-4d7d-a5c4-fd1b811f05b8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:23.933982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd5f7fc3-e18b-4d7d-a5c4-fd1b811f05b8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:24.814949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-04f8867d-e12e-4028-9edf-2c537c46729b tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd24d5039654ee4970759257ceaf028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c23f2e6caa450286d406171c97dd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:24.836384 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-04f8867d-e12e-4028-9edf-2c537c46729b tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] 10.222.0.16 "GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131" status: 200 len: 1323 microversion: 2.1 time: 1.050090 Sep 07 12:59:24.839044 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2640/5339] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:23 2022] GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131 => generated 1323 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:24.856345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-64435f00-3ba0-4c77-8608-4c9024ff3474 req-0b0ad72a-d63a-4f66-b0b5-075856f5a707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab987f7a-2da5-45f4-9609-2e25300a1131", "tag": "9f4e6537-9ec8-4724-98e6-f4c4508ce870"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:24.875775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-64435f00-3ba0-4c77-8608-4c9024ff3474 req-0b0ad72a-d63a-4f66-b0b5-075856f5a707 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:24.876802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-64435f00-3ba0-4c77-8608-4c9024ff3474 req-0b0ad72a-d63a-4f66-b0b5-075856f5a707 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:24.877712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-64435f00-3ba0-4c77-8608-4c9024ff3474 req-0b0ad72a-d63a-4f66-b0b5-075856f5a707 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:24.912408 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-64435f00-3ba0-4c77-8608-4c9024ff3474 req-0b0ad72a-d63a-4f66-b0b5-075856f5a707 service nova] Creating event network-changed:9f4e6537-9ec8-4724-98e6-f4c4508ce870 for instance ab987f7a-2da5-45f4-9609-2e25300a1131 on n-h1-852087-9 Sep 07 12:59:24.920668 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-64435f00-3ba0-4c77-8608-4c9024ff3474 req-0b0ad72a-d63a-4f66-b0b5-075856f5a707 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077868 Sep 07 12:59:24.921837 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2641/5340] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:59:24.958084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bd5f7fc3-e18b-4d7d-a5c4-fd1b811f05b8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:24.978794 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bd5f7fc3-e18b-4d7d-a5c4-fd1b811f05b8 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1511 microversion: 2.1 time: 1.083148 Sep 07 12:59:25.001185 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2700/5341] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:23 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1511 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:25.870898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-04c1a8d7-2174-46b1-bae2-bef3a1c4e703 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:25.872357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-04c1a8d7-2174-46b1-bae2-bef3a1c4e703 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] [instance: ab987f7a-2da5-45f4-9609-2e25300a1131] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:25.887832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04c1a8d7-2174-46b1-bae2-bef3a1c4e703 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:25.889061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04c1a8d7-2174-46b1-bae2-bef3a1c4e703 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:25.891755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04c1a8d7-2174-46b1-bae2-bef3a1c4e703 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:25.899755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04c1a8d7-2174-46b1-bae2-bef3a1c4e703 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:25.901237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04c1a8d7-2174-46b1-bae2-bef3a1c4e703 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:25.902540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04c1a8d7-2174-46b1-bae2-bef3a1c4e703 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:26.015931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-10872832-b2c8-45e9-a789-19398e5a86e3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:26.017437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-10872832-b2c8-45e9-a789-19398e5a86e3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:26.025918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10872832-b2c8-45e9-a789-19398e5a86e3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:26.026817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10872832-b2c8-45e9-a789-19398e5a86e3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:26.027433 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10872832-b2c8-45e9-a789-19398e5a86e3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:26.028849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10872832-b2c8-45e9-a789-19398e5a86e3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:26.029676 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10872832-b2c8-45e9-a789-19398e5a86e3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:26.031120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10872832-b2c8-45e9-a789-19398e5a86e3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:26.279115 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:26.329402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:26.607570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-04c1a8d7-2174-46b1-bae2-bef3a1c4e703 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd24d5039654ee4970759257ceaf028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c23f2e6caa450286d406171c97dd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:26.623045 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-04c1a8d7-2174-46b1-bae2-bef3a1c4e703 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] 10.222.0.16 "GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131" status: 200 len: 1323 microversion: 2.1 time: 0.765707 Sep 07 12:59:26.626557 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2642/5342] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:25 2022] GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131 => generated 1323 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:26.642445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-10872832-b2c8-45e9-a789-19398e5a86e3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:26.688828 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-10872832-b2c8-45e9-a789-19398e5a86e3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1511 microversion: 2.1 time: 0.672131 Sep 07 12:59:26.697126 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2701/5343] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:26 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1511 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:59:27.667420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-540c33a4-858f-4fdd-bc10-d785ed84d1c1 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:27.668270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-540c33a4-858f-4fdd-bc10-d785ed84d1c1 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] [instance: ab987f7a-2da5-45f4-9609-2e25300a1131] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:27.678228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-540c33a4-858f-4fdd-bc10-d785ed84d1c1 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:27.679447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-540c33a4-858f-4fdd-bc10-d785ed84d1c1 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:27.680267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-540c33a4-858f-4fdd-bc10-d785ed84d1c1 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:27.682254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-540c33a4-858f-4fdd-bc10-d785ed84d1c1 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:27.683238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-540c33a4-858f-4fdd-bc10-d785ed84d1c1 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:27.684983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-540c33a4-858f-4fdd-bc10-d785ed84d1c1 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:27.733380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b9bdef3a-fe6b-4519-a7aa-2a209f4f2243 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:27.734340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b9bdef3a-fe6b-4519-a7aa-2a209f4f2243 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:27.741380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:27.743949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9bdef3a-fe6b-4519-a7aa-2a209f4f2243 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:27.745006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9bdef3a-fe6b-4519-a7aa-2a209f4f2243 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:27.745844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9bdef3a-fe6b-4519-a7aa-2a209f4f2243 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:27.746787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9bdef3a-fe6b-4519-a7aa-2a209f4f2243 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:27.747428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9bdef3a-fe6b-4519-a7aa-2a209f4f2243 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:27.748026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9bdef3a-fe6b-4519-a7aa-2a209f4f2243 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:28.344280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b9bdef3a-fe6b-4519-a7aa-2a209f4f2243 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:28.351626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-540c33a4-858f-4fdd-bc10-d785ed84d1c1 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd24d5039654ee4970759257ceaf028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c23f2e6caa450286d406171c97dd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:28.382283 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-540c33a4-858f-4fdd-bc10-d785ed84d1c1 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] 10.222.0.16 "GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131" status: 200 len: 1323 microversion: 2.1 time: 0.718840 Sep 07 12:59:28.383450 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2643/5344] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:27 2022] GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131 => generated 1323 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:59:28.391505 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b9bdef3a-fe6b-4519-a7aa-2a209f4f2243 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1511 microversion: 2.1 time: 0.661911 Sep 07 12:59:28.400231 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2702/5345] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:27 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1511 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:59:29.415678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-38752971-bc82-4dd3-9a41-3e2de64212ec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:29.416381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-38752971-bc82-4dd3-9a41-3e2de64212ec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:29.420439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-18a132c7-be7b-45c0-93d5-6264e18fac64 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:29.424079 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-18a132c7-be7b-45c0-93d5-6264e18fac64 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] [instance: ab987f7a-2da5-45f4-9609-2e25300a1131] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:29.428209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38752971-bc82-4dd3-9a41-3e2de64212ec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:29.431224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38752971-bc82-4dd3-9a41-3e2de64212ec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:29.433093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38752971-bc82-4dd3-9a41-3e2de64212ec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:29.434626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38752971-bc82-4dd3-9a41-3e2de64212ec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:29.436558 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38752971-bc82-4dd3-9a41-3e2de64212ec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:29.438700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38752971-bc82-4dd3-9a41-3e2de64212ec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:29.462080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18a132c7-be7b-45c0-93d5-6264e18fac64 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:29.465117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18a132c7-be7b-45c0-93d5-6264e18fac64 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:29.465635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18a132c7-be7b-45c0-93d5-6264e18fac64 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:29.469638 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18a132c7-be7b-45c0-93d5-6264e18fac64 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:29.470248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18a132c7-be7b-45c0-93d5-6264e18fac64 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:29.470748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18a132c7-be7b-45c0-93d5-6264e18fac64 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:30.206370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-18a132c7-be7b-45c0-93d5-6264e18fac64 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd24d5039654ee4970759257ceaf028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c23f2e6caa450286d406171c97dd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:30.222272 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-18a132c7-be7b-45c0-93d5-6264e18fac64 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] 10.222.0.16 "GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131" status: 200 len: 1323 microversion: 2.1 time: 0.819479 Sep 07 12:59:30.227428 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2644/5346] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:29 2022] GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131 => generated 1323 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:30.477127 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-38752971-bc82-4dd3-9a41-3e2de64212ec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:30.495252 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-38752971-bc82-4dd3-9a41-3e2de64212ec tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1511 microversion: 2.1 time: 1.080562 Sep 07 12:59:30.511411 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2703/5347] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:29 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1511 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:59:31.270586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7af4acc0-4894-47b0-81bd-c586ec857ee3 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:31.271496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7af4acc0-4894-47b0-81bd-c586ec857ee3 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] [instance: ab987f7a-2da5-45f4-9609-2e25300a1131] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:31.296744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7af4acc0-4894-47b0-81bd-c586ec857ee3 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:31.297168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7af4acc0-4894-47b0-81bd-c586ec857ee3 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:31.297837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7af4acc0-4894-47b0-81bd-c586ec857ee3 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:31.298649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7af4acc0-4894-47b0-81bd-c586ec857ee3 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:31.308015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7af4acc0-4894-47b0-81bd-c586ec857ee3 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:31.308593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7af4acc0-4894-47b0-81bd-c586ec857ee3 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:31.532506 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-43a94430-f875-4a36-b920-15b4d544ab52 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:31.540723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-43a94430-f875-4a36-b920-15b4d544ab52 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:31.558897 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43a94430-f875-4a36-b920-15b4d544ab52 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:31.559965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43a94430-f875-4a36-b920-15b4d544ab52 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:31.561857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43a94430-f875-4a36-b920-15b4d544ab52 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:31.563378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43a94430-f875-4a36-b920-15b4d544ab52 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:31.564403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43a94430-f875-4a36-b920-15b4d544ab52 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:31.565424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43a94430-f875-4a36-b920-15b4d544ab52 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:31.742315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7af4acc0-4894-47b0-81bd-c586ec857ee3 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd24d5039654ee4970759257ceaf028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c23f2e6caa450286d406171c97dd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:31.757379 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7af4acc0-4894-47b0-81bd-c586ec857ee3 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] 10.222.0.16 "GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131" status: 200 len: 1323 microversion: 2.1 time: 0.492615 Sep 07 12:59:31.775318 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2645/5348] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:31 2022] GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131 => generated 1323 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:59:32.179972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-43a94430-f875-4a36-b920-15b4d544ab52 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:32.196697 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-43a94430-f875-4a36-b920-15b4d544ab52 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1511 microversion: 2.1 time: 0.672195 Sep 07 12:59:32.215423 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2704/5349] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:31 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1511 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:32.270643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9a2d392f-8ed4-4bd9-bf53-294733a05690 req-ad383f25-67f7-4b69-af53-a503b0a866a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab987f7a-2da5-45f4-9609-2e25300a1131", "name": "network-vif-plugged", "status": "completed", "tag": "9f4e6537-9ec8-4724-98e6-f4c4508ce870"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:32.319886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9a2d392f-8ed4-4bd9-bf53-294733a05690 req-ad383f25-67f7-4b69-af53-a503b0a866a0 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:32.322960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9a2d392f-8ed4-4bd9-bf53-294733a05690 req-ad383f25-67f7-4b69-af53-a503b0a866a0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:32.326851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9a2d392f-8ed4-4bd9-bf53-294733a05690 req-ad383f25-67f7-4b69-af53-a503b0a866a0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:32.350083 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9a2d392f-8ed4-4bd9-bf53-294733a05690 req-ad383f25-67f7-4b69-af53-a503b0a866a0 service nova] Creating event network-vif-plugged:9f4e6537-9ec8-4724-98e6-f4c4508ce870 for instance ab987f7a-2da5-45f4-9609-2e25300a1131 on n-h1-852087-9 Sep 07 12:59:32.356673 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9a2d392f-8ed4-4bd9-bf53-294733a05690 req-ad383f25-67f7-4b69-af53-a503b0a866a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097907 Sep 07 12:59:32.358191 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2646/5350] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:59:32.801613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2a5a080d-cb12-419a-9675-362f907c6205 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:32.802904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2a5a080d-cb12-419a-9675-362f907c6205 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] [instance: ab987f7a-2da5-45f4-9609-2e25300a1131] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:32.824342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a5a080d-cb12-419a-9675-362f907c6205 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:32.825628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a5a080d-cb12-419a-9675-362f907c6205 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:32.826253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a5a080d-cb12-419a-9675-362f907c6205 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:32.827178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a5a080d-cb12-419a-9675-362f907c6205 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:32.827918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a5a080d-cb12-419a-9675-362f907c6205 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:32.828732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a5a080d-cb12-419a-9675-362f907c6205 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:33.231309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-47fc885e-c563-4229-986b-28de34d8aea2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:33.232897 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-47fc885e-c563-4229-986b-28de34d8aea2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:33.254484 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47fc885e-c563-4229-986b-28de34d8aea2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:33.255262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47fc885e-c563-4229-986b-28de34d8aea2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:33.256783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47fc885e-c563-4229-986b-28de34d8aea2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:33.257943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47fc885e-c563-4229-986b-28de34d8aea2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:33.258950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47fc885e-c563-4229-986b-28de34d8aea2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:33.259552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47fc885e-c563-4229-986b-28de34d8aea2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:33.699767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2a5a080d-cb12-419a-9675-362f907c6205 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd24d5039654ee4970759257ceaf028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c23f2e6caa450286d406171c97dd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:33.731050 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2a5a080d-cb12-419a-9675-362f907c6205 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] 10.222.0.16 "GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131" status: 200 len: 1323 microversion: 2.1 time: 0.931444 Sep 07 12:59:33.737162 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2705/5351] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:32 2022] GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131 => generated 1323 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:33.817325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-47fc885e-c563-4229-986b-28de34d8aea2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:33.829040 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-47fc885e-c563-4229-986b-28de34d8aea2 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1511 microversion: 2.1 time: 0.605601 Sep 07 12:59:33.837395 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2647/5352] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:33 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1511 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:59:34.781511 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9d41b20c-f117-4d8b-a884-c0e2a5a095b1 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:34.784078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9d41b20c-f117-4d8b-a884-c0e2a5a095b1 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] [instance: ab987f7a-2da5-45f4-9609-2e25300a1131] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:34.812754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d41b20c-f117-4d8b-a884-c0e2a5a095b1 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:34.813346 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d41b20c-f117-4d8b-a884-c0e2a5a095b1 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:34.813947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d41b20c-f117-4d8b-a884-c0e2a5a095b1 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:34.814650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d41b20c-f117-4d8b-a884-c0e2a5a095b1 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:34.815214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d41b20c-f117-4d8b-a884-c0e2a5a095b1 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:34.815538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d41b20c-f117-4d8b-a884-c0e2a5a095b1 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:34.870348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-215f6a7c-7a99-4c08-9530-fe39b3882258 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:34.871652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-215f6a7c-7a99-4c08-9530-fe39b3882258 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:34.898314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-215f6a7c-7a99-4c08-9530-fe39b3882258 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:34.901293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-215f6a7c-7a99-4c08-9530-fe39b3882258 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:34.902627 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-215f6a7c-7a99-4c08-9530-fe39b3882258 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:34.905336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-215f6a7c-7a99-4c08-9530-fe39b3882258 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:34.906253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-215f6a7c-7a99-4c08-9530-fe39b3882258 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:34.907375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-215f6a7c-7a99-4c08-9530-fe39b3882258 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:35.768888 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9d41b20c-f117-4d8b-a884-c0e2a5a095b1 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd24d5039654ee4970759257ceaf028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c23f2e6caa450286d406171c97dd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:35.774233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:35.791554 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9d41b20c-f117-4d8b-a884-c0e2a5a095b1 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] 10.222.0.16 "GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131" status: 200 len: 1519 microversion: 2.1 time: 1.019888 Sep 07 12:59:35.792924 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2706/5353] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:34 2022] GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131 => generated 1519 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:35.991570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-215f6a7c-7a99-4c08-9530-fe39b3882258 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:36.005214 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-215f6a7c-7a99-4c08-9530-fe39b3882258 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1488 microversion: 2.1 time: 1.148684 Sep 07 12:59:36.031609 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2648/5354] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:34 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1488 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:36.036834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cd34b7e5-54b3-4140-a7d5-11ed4525cb40 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1548560307"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:36.040927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cd34b7e5-54b3-4140-a7d5-11ed4525cb40 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:36.077020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd34b7e5-54b3-4140-a7d5-11ed4525cb40 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:36.085909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd34b7e5-54b3-4140-a7d5-11ed4525cb40 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:36.086495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd34b7e5-54b3-4140-a7d5-11ed4525cb40 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:36.087298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd34b7e5-54b3-4140-a7d5-11ed4525cb40 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:36.090364 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd34b7e5-54b3-4140-a7d5-11ed4525cb40 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:36.092518 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd34b7e5-54b3-4140-a7d5-11ed4525cb40 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:36.168893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea35b97a-cad7-4427-9961-80232bea3d54 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-600169924", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "b3336e1f-f1f6-4d53-8b98-6cfc46a9fcbd"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea35b97a-cad7-4427-9961-80232bea3d54 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Request method failure captured: Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 242 Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJWhD3ayLjGUrRDEa6HVQiZSRE-kC6gdDZQfyjaXyy0g9zvRte89CjbSQJhU9DtE12Shg7x2AFh44okcMcTJKvqZTEA19CrSpEoIn1jr_JVIJvDV47D_cmiSFnKzgu4ovaVFDJbM8jp4vNJB2JXUhvzk32Ktuu27XMW_iMyh-wydP34 Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 03c23f2e6caa450286d406171c97dd31 Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1057595811 Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/03c23f2e6caa450286d406171c97dd31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_03c23f2e6caa450286d406171c97dd31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/03c23f2e6caa450286d406171c97dd31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/03c23f2e6caa450286d406171c97dd31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1057595811 Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 03c23f2e6caa450286d406171c97dd31 Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1057595811 Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerMetadataNegativeTestJSON-1057595811-project Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 1fd24d5039654ee4970759257ceaf028 Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1057595811-project Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-600169924", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "b3336e1f-f1f6-4d53-8b98-6cfc46a9fcbd"}]}} Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-600169924', 'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'b3336e1f-f1f6-4d53-8b98-6cfc46a9fcbd'}]}}} Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'': 'data1'} Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:36.174731 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:59:36.179529 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:59:36.179529 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:59:36.179529 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:59:36.179529 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:59:36.179529 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:59:36.179529 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:59:36.179529 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:59:36.179529 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:59:36.179529 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.179529 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:36.179529 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.179529 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:36.179529 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:36.179529 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:36.179529 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:59:36.179529 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:59:36.179529 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:59:36.179529 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.179529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea35b97a-cad7-4427-9961-80232bea3d54 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:36.179529 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ea35b97a-cad7-4427-9961-80232bea3d54 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.015016 Sep 07 12:59:36.180909 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2649/5355] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:59:36 2022] POST /compute/v2.1/servers => generated 175 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:59:36.219360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6bd9b889-50d2-43d2-bd5b-3fe07bf14f61 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:36.220089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6bd9b889-50d2-43d2-bd5b-3fe07bf14f61 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] [instance: 97c404ef-f6ce-49c1-a85f-c655b6dbcba3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:36.254397 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-6bd9b889-50d2-43d2-bd5b-3fe07bf14f61 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] HTTP exception thrown: Instance 97c404ef-f6ce-49c1-a85f-c655b6dbcba3 could not be found. Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6bd9b889-50d2-43d2-bd5b-3fe07bf14f61 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Request method failure captured: Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/97c404ef-f6ce-49c1-a85f-c655b6dbcba3/metadata HTTP/1.1 Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJWhD3ayLjGUrRDEa6HVQiZSRE-kC6gdDZQfyjaXyy0g9zvRte89CjbSQJhU9DtE12Shg7x2AFh44okcMcTJKvqZTEA19CrSpEoIn1jr_JVIJvDV47D_cmiSFnKzgu4ovaVFDJbM8jp4vNJB2JXUhvzk32Ktuu27XMW_iMyh-wydP34 Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 03c23f2e6caa450286d406171c97dd31 Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1057595811 Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/03c23f2e6caa450286d406171c97dd31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_03c23f2e6caa450286d406171c97dd31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/03c23f2e6caa450286d406171c97dd31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/03c23f2e6caa450286d406171c97dd31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1057595811 Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 03c23f2e6caa450286d406171c97dd31 Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1057595811 Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerMetadataNegativeTestJSON-1057595811-project Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 1fd24d5039654ee4970759257ceaf028 Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1057595811-project Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 97c404ef-f6ce-49c1-a85f-c655b6dbcba3 could not be found. Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'server_id': '97c404ef-f6ce-49c1-a85f-c655b6dbcba3'} Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97c404ef-f6ce-49c1-a85f-c655b6dbcba3 could not be found. Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97c404ef-f6ce-49c1-a85f-c655b6dbcba3 could not be found. Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:36.264044 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:36.268888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:36.268888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:36.268888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97c404ef-f6ce-49c1-a85f-c655b6dbcba3 could not be found. Sep 07 12:59:36.268888 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.269170 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cd34b7e5-54b3-4140-a7d5-11ed4525cb40 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "PUT /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1062 microversion: 2.1 time: 0.238657 Sep 07 12:59:36.271035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6bd9b889-50d2-43d2-bd5b-3fe07bf14f61 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Returning 404 to user: Instance 97c404ef-f6ce-49c1-a85f-c655b6dbcba3 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:36.271322 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2707/5356] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Sep 7 12:59:36 2022] PUT /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1062 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:36.273383 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6bd9b889-50d2-43d2-bd5b-3fe07bf14f61 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] 10.222.0.16 "GET /compute/v2.1/servers/97c404ef-f6ce-49c1-a85f-c655b6dbcba3/metadata" status: 404 len: 111 microversion: 2.1 time: 0.074444 Sep 07 12:59:36.275460 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2650/5357] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Sep 7 12:59:36 2022] GET /compute/v2.1/servers/97c404ef-f6ce-49c1-a85f-c655b6dbcba3/metadata => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:59:36.317958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1ac6cdc6-ef4f-4511-b621-cb8d19a6906c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:36.323171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1ac6cdc6-ef4f-4511-b621-cb8d19a6906c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:36.346214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ac6cdc6-ef4f-4511-b621-cb8d19a6906c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:36.347055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ac6cdc6-ef4f-4511-b621-cb8d19a6906c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:36.347673 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ac6cdc6-ef4f-4511-b621-cb8d19a6906c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:36.348556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ac6cdc6-ef4f-4511-b621-cb8d19a6906c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:36.349317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ac6cdc6-ef4f-4511-b621-cb8d19a6906c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:36.349945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ac6cdc6-ef4f-4511-b621-cb8d19a6906c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:36.413925 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-af5b1d7a-ec21-44d2-823e-3b05ed49991e tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-512065125", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b3336e1f-f1f6-4d53-8b98-6cfc46a9fcbd"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-af5b1d7a-ec21-44d2-823e-3b05ed49991e tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Request method failure captured: Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 498 Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJWhD3ayLjGUrRDEa6HVQiZSRE-kC6gdDZQfyjaXyy0g9zvRte89CjbSQJhU9DtE12Shg7x2AFh44okcMcTJKvqZTEA19CrSpEoIn1jr_JVIJvDV47D_cmiSFnKzgu4ovaVFDJbM8jp4vNJB2JXUhvzk32Ktuu27XMW_iMyh-wydP34 Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 03c23f2e6caa450286d406171c97dd31 Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1057595811 Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/03c23f2e6caa450286d406171c97dd31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_03c23f2e6caa450286d406171c97dd31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/03c23f2e6caa450286d406171c97dd31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/03c23f2e6caa450286d406171c97dd31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1057595811 Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 03c23f2e6caa450286d406171c97dd31 Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1057595811 Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerMetadataNegativeTestJSON-1057595811-project Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 1fd24d5039654ee4970759257ceaf028 Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1057595811-project Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-512065125", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b3336e1f-f1f6-4d53-8b98-6cfc46a9fcbd"}]}} Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-512065125', 'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b3336e1f-f1f6-4d53-8b98-6cfc46a9fcbd'}]}}} Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 07 12:59:36.422777 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-af5b1d7a-ec21-44d2-823e-3b05ed49991e tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-af5b1d7a-ec21-44d2-823e-3b05ed49991e tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.014942 Sep 07 12:59:36.447093 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2651/5358] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:59:36 2022] POST /compute/v2.1/servers => generated 687 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:59:36.526408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b748aa26-57a0-4e83-9106-219cbba19446 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1077536435", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b3336e1f-f1f6-4d53-8b98-6cfc46a9fcbd"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b748aa26-57a0-4e83-9106-219cbba19446 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Request method failure captured: Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 500 Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJWhD3ayLjGUrRDEa6HVQiZSRE-kC6gdDZQfyjaXyy0g9zvRte89CjbSQJhU9DtE12Shg7x2AFh44okcMcTJKvqZTEA19CrSpEoIn1jr_JVIJvDV47D_cmiSFnKzgu4ovaVFDJbM8jp4vNJB2JXUhvzk32Ktuu27XMW_iMyh-wydP34 Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 03c23f2e6caa450286d406171c97dd31 Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1057595811 Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/03c23f2e6caa450286d406171c97dd31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_03c23f2e6caa450286d406171c97dd31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/03c23f2e6caa450286d406171c97dd31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/03c23f2e6caa450286d406171c97dd31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1057595811 Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 03c23f2e6caa450286d406171c97dd31 Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1057595811 Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerMetadataNegativeTestJSON-1057595811-project Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 1fd24d5039654ee4970759257ceaf028 Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1057595811-project Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1077536435", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b3336e1f-f1f6-4d53-8b98-6cfc46a9fcbd"}]}} Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1077536435', 'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b3336e1f-f1f6-4d53-8b98-6cfc46a9fcbd'}]}}} Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 07 12:59:36.536912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:59:36.543789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.557378 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b748aa26-57a0-4e83-9106-219cbba19446 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:36.559609 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b748aa26-57a0-4e83-9106-219cbba19446 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.040851 Sep 07 12:59:36.562822 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2652/5359] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:59:36 2022] POST /compute/v2.1/servers => generated 689 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:59:36.738466 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-788671aa-21f9-4244-ab4f-2fa47b75060c tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-955411717", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b3336e1f-f1f6-4d53-8b98-6cfc46a9fcbd"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-788671aa-21f9-4244-ab4f-2fa47b75060c tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Request method failure captured: Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 753 Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJWhD3ayLjGUrRDEa6HVQiZSRE-kC6gdDZQfyjaXyy0g9zvRte89CjbSQJhU9DtE12Shg7x2AFh44okcMcTJKvqZTEA19CrSpEoIn1jr_JVIJvDV47D_cmiSFnKzgu4ovaVFDJbM8jp4vNJB2JXUhvzk32Ktuu27XMW_iMyh-wydP34 Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 03c23f2e6caa450286d406171c97dd31 Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1057595811 Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/03c23f2e6caa450286d406171c97dd31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_03c23f2e6caa450286d406171c97dd31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/03c23f2e6caa450286d406171c97dd31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/03c23f2e6caa450286d406171c97dd31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1057595811 Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 03c23f2e6caa450286d406171c97dd31 Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1057595811 Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerMetadataNegativeTestJSON-1057595811-project Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 1fd24d5039654ee4970759257ceaf028 Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1057595811-project Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-955411717", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b3336e1f-f1f6-4d53-8b98-6cfc46a9fcbd"}]}} Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-955411717', 'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b3336e1f-f1f6-4d53-8b98-6cfc46a9fcbd'}]}}} Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:59:36.748378 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:59:36.753951 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:59:36.759245 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:59:36.759245 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.759245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-788671aa-21f9-4244-ab4f-2fa47b75060c tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:36.759245 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-788671aa-21f9-4244-ab4f-2fa47b75060c tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.026584 Sep 07 12:59:36.759245 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2653/5360] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 12:59:36 2022] POST /compute/v2.1/servers => generated 1197 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Sep 07 12:59:36.918334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-51d7ff89-7d48-4b71-9f90-d134834a6436 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-951889534", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b3336e1f-f1f6-4d53-8b98-6cfc46a9fcbd"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-51d7ff89-7d48-4b71-9f90-d134834a6436 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Request method failure captured: Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 1265 Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJWhD3ayLjGUrRDEa6HVQiZSRE-kC6gdDZQfyjaXyy0g9zvRte89CjbSQJhU9DtE12Shg7x2AFh44okcMcTJKvqZTEA19CrSpEoIn1jr_JVIJvDV47D_cmiSFnKzgu4ovaVFDJbM8jp4vNJB2JXUhvzk32Ktuu27XMW_iMyh-wydP34 Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 03c23f2e6caa450286d406171c97dd31 Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1057595811 Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/03c23f2e6caa450286d406171c97dd31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_03c23f2e6caa450286d406171c97dd31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/03c23f2e6caa450286d406171c97dd31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/03c23f2e6caa450286d406171c97dd31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1057595811 Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 03c23f2e6caa450286d406171c97dd31 Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1057595811 Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerMetadataNegativeTestJSON-1057595811-project Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 1fd24d5039654ee4970759257ceaf028 Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1057595811-project Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-951889534", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b3336e1f-f1f6-4d53-8b98-6cfc46a9fcbd"}]}} Sep 07 12:59:36.928321 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:59:36.931004 n-d-852087-9 devstack@n-api.service[122432]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:59:36.931004 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-951889534', 'imageRef': 'a5dd2b4d-ee9d-44eb-b267-89e80edd276f', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b3336e1f-f1f6-4d53-8b98-6cfc46a9fcbd'}]}}} Sep 07 12:59:36.931004 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:36.931004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:36.931004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:59:36.931004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:59:36.931004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:59:36.931004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:59:36.931004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:59:36.931004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.931004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 07 12:59:36.931004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 07 12:59:36.931004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 07 12:59:36.931004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 07 12:59:36.931004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 07 12:59:36.931004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.931004 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:59:36.932269 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:59:36.934474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 07 12:59:36.934474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:36.939697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-51d7ff89-7d48-4b71-9f90-d134834a6436 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:36.944370 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-51d7ff89-7d48-4b71-9f90-d134834a6436 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.039794 Sep 07 12:59:36.947820 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2654/5361] 10.222.0.16 () {60 vars in 1148 bytes} [Wed Sep 7 12:59:36 2022] POST /compute/v2.1/servers => generated 2221 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 07 12:59:36.976395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eae0f482-4582-4b39-9b57-8a0f20457a40 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:36.977773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eae0f482-4582-4b39-9b57-8a0f20457a40 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] [instance: 906c4d59-c170-4203-9238-ad0f02402cfe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:36.991456 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-eae0f482-4582-4b39-9b57-8a0f20457a40 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] HTTP exception thrown: Instance 906c4d59-c170-4203-9238-ad0f02402cfe could not be found. Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eae0f482-4582-4b39-9b57-8a0f20457a40 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Request method failure captured: Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/906c4d59-c170-4203-9238-ad0f02402cfe/metadata/test2 HTTP/1.1 Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJWhD3ayLjGUrRDEa6HVQiZSRE-kC6gdDZQfyjaXyy0g9zvRte89CjbSQJhU9DtE12Shg7x2AFh44okcMcTJKvqZTEA19CrSpEoIn1jr_JVIJvDV47D_cmiSFnKzgu4ovaVFDJbM8jp4vNJB2JXUhvzk32Ktuu27XMW_iMyh-wydP34 Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 03c23f2e6caa450286d406171c97dd31 Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1057595811 Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/03c23f2e6caa450286d406171c97dd31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_03c23f2e6caa450286d406171c97dd31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/03c23f2e6caa450286d406171c97dd31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/03c23f2e6caa450286d406171c97dd31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1057595811 Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 03c23f2e6caa450286d406171c97dd31 Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1057595811 Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerMetadataNegativeTestJSON-1057595811-project Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 1fd24d5039654ee4970759257ceaf028 Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1057595811-project Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 906c4d59-c170-4203-9238-ad0f02402cfe could not be found. Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'server_id': '906c4d59-c170-4203-9238-ad0f02402cfe', 'id': 'test2'} Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 906c4d59-c170-4203-9238-ad0f02402cfe could not be found. Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 906c4d59-c170-4203-9238-ad0f02402cfe could not be found. Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:37.006222 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:37.011578 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:37.011578 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:37.011578 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 906c4d59-c170-4203-9238-ad0f02402cfe could not be found. Sep 07 12:59:37.011578 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:37.015776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eae0f482-4582-4b39-9b57-8a0f20457a40 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Returning 404 to user: Instance 906c4d59-c170-4203-9238-ad0f02402cfe could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:37.034999 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eae0f482-4582-4b39-9b57-8a0f20457a40 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] 10.222.0.16 "GET /compute/v2.1/servers/906c4d59-c170-4203-9238-ad0f02402cfe/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.052972 Sep 07 12:59:37.065540 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2655/5362] 10.222.0.16 () {58 vars in 1281 bytes} [Wed Sep 7 12:59:36 2022] GET /compute/v2.1/servers/906c4d59-c170-4203-9238-ad0f02402cfe/metadata/test2 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:59:37.092294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1ac6cdc6-ef4f-4511-b621-cb8d19a6906c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:37.092949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b69087c6-2d17-47d2-b9d6-c596de12c8d0 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:37.094420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b69087c6-2d17-47d2-b9d6-c596de12c8d0 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] [instance: ab987f7a-2da5-45f4-9609-2e25300a1131] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:37.123490 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b69087c6-2d17-47d2-b9d6-c596de12c8d0 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:37.124705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b69087c6-2d17-47d2-b9d6-c596de12c8d0 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:37.130444 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1ac6cdc6-ef4f-4511-b621-cb8d19a6906c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1489 microversion: 2.1 time: 0.818781 Sep 07 12:59:37.132047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b69087c6-2d17-47d2-b9d6-c596de12c8d0 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:37.134298 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b69087c6-2d17-47d2-b9d6-c596de12c8d0 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:37.135386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b69087c6-2d17-47d2-b9d6-c596de12c8d0 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:37.136342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b69087c6-2d17-47d2-b9d6-c596de12c8d0 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:37.138701 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2708/5363] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:36 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1489 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:37.192369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2b18ff93-90b1-4fcb-8ec1-bbfab9a0b2c3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:37.193397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2b18ff93-90b1-4fcb-8ec1-bbfab9a0b2c3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:37.216989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b18ff93-90b1-4fcb-8ec1-bbfab9a0b2c3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:37.222093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b18ff93-90b1-4fcb-8ec1-bbfab9a0b2c3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:37.222761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b18ff93-90b1-4fcb-8ec1-bbfab9a0b2c3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:37.226761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b18ff93-90b1-4fcb-8ec1-bbfab9a0b2c3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:37.229457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b18ff93-90b1-4fcb-8ec1-bbfab9a0b2c3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:37.229968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b18ff93-90b1-4fcb-8ec1-bbfab9a0b2c3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:37.255637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b69087c6-2d17-47d2-b9d6-c596de12c8d0 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] [instance: ab987f7a-2da5-45f4-9609-2e25300a1131] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:59:37.498213 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b69087c6-2d17-47d2-b9d6-c596de12c8d0 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131" status: 204 len: 0 microversion: 2.1 time: 0.412715 Sep 07 12:59:37.499306 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2656/5364] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:59:37 2022] DELETE /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 12:59:37.515365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8cb11d52-6183-4c5d-aa26-c3cbae2fc1cc tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:37.516561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8cb11d52-6183-4c5d-aa26-c3cbae2fc1cc tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] [instance: ab987f7a-2da5-45f4-9609-2e25300a1131] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:37.528843 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cb11d52-6183-4c5d-aa26-c3cbae2fc1cc tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:37.529822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cb11d52-6183-4c5d-aa26-c3cbae2fc1cc tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:37.529822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cb11d52-6183-4c5d-aa26-c3cbae2fc1cc tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:37.530576 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cb11d52-6183-4c5d-aa26-c3cbae2fc1cc tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:37.531052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cb11d52-6183-4c5d-aa26-c3cbae2fc1cc tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:37.531493 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8cb11d52-6183-4c5d-aa26-c3cbae2fc1cc tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:37.826934 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2b18ff93-90b1-4fcb-8ec1-bbfab9a0b2c3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:37.842631 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2b18ff93-90b1-4fcb-8ec1-bbfab9a0b2c3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1489 microversion: 2.1 time: 0.655174 Sep 07 12:59:37.844501 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2709/5365] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:37 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1489 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:37.870780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0c7bf155-fdbc-4a1f-ac04-39e28f702bbb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:37.872193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0c7bf155-fdbc-4a1f-ac04-39e28f702bbb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:37.886679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c7bf155-fdbc-4a1f-ac04-39e28f702bbb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:37.888596 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c7bf155-fdbc-4a1f-ac04-39e28f702bbb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:37.891422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c7bf155-fdbc-4a1f-ac04-39e28f702bbb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:37.892688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c7bf155-fdbc-4a1f-ac04-39e28f702bbb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:37.893449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c7bf155-fdbc-4a1f-ac04-39e28f702bbb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:37.894123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c7bf155-fdbc-4a1f-ac04-39e28f702bbb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:37.972514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8cb11d52-6183-4c5d-aa26-c3cbae2fc1cc tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd24d5039654ee4970759257ceaf028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c23f2e6caa450286d406171c97dd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:37.975641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0c7bf155-fdbc-4a1f-ac04-39e28f702bbb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:59:37.997895 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8cb11d52-6183-4c5d-aa26-c3cbae2fc1cc tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] 10.222.0.16 "GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131" status: 200 len: 1525 microversion: 2.1 time: 0.491963 Sep 07 12:59:38.000577 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2657/5366] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:37 2022] GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131 => generated 1525 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:38.317606 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0c7bf155-fdbc-4a1f-ac04-39e28f702bbb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "DELETE /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 204 len: 0 microversion: 2.1 time: 0.454646 Sep 07 12:59:38.321955 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2710/5367] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:59:37 2022] DELETE /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 12:59:38.351436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92044fab-9b80-43b7-8ad9-13699eccfdfb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:38.354022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-92044fab-9b80-43b7-8ad9-13699eccfdfb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:38.369023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92044fab-9b80-43b7-8ad9-13699eccfdfb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:38.371838 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92044fab-9b80-43b7-8ad9-13699eccfdfb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:38.372766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92044fab-9b80-43b7-8ad9-13699eccfdfb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:38.375973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92044fab-9b80-43b7-8ad9-13699eccfdfb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:38.377304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92044fab-9b80-43b7-8ad9-13699eccfdfb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:38.378471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92044fab-9b80-43b7-8ad9-13699eccfdfb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:39.021652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-92044fab-9b80-43b7-8ad9-13699eccfdfb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:39.046472 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-92044fab-9b80-43b7-8ad9-13699eccfdfb tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1495 microversion: 2.1 time: 0.721321 Sep 07 12:59:39.056674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-14b6ea8f-5441-4454-aa3c-74ac80b30001 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:39.058704 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2658/5368] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:38 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1495 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:39.061726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-14b6ea8f-5441-4454-aa3c-74ac80b30001 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] [instance: ab987f7a-2da5-45f4-9609-2e25300a1131] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:39.093222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14b6ea8f-5441-4454-aa3c-74ac80b30001 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:39.097182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14b6ea8f-5441-4454-aa3c-74ac80b30001 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:39.098639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14b6ea8f-5441-4454-aa3c-74ac80b30001 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:39.102075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14b6ea8f-5441-4454-aa3c-74ac80b30001 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:39.103622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14b6ea8f-5441-4454-aa3c-74ac80b30001 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:39.105355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14b6ea8f-5441-4454-aa3c-74ac80b30001 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:39.512255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-14b6ea8f-5441-4454-aa3c-74ac80b30001 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd24d5039654ee4970759257ceaf028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c23f2e6caa450286d406171c97dd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:39.522735 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-14b6ea8f-5441-4454-aa3c-74ac80b30001 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] 10.222.0.16 "GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131" status: 200 len: 1525 microversion: 2.1 time: 0.477293 Sep 07 12:59:39.550984 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2711/5369] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:39 2022] GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131 => generated 1525 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:59:40.097849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-824fa6e5-fda0-41bc-b196-693d41e693b0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:40.099901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-824fa6e5-fda0-41bc-b196-693d41e693b0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:40.114431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-824fa6e5-fda0-41bc-b196-693d41e693b0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:40.121475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-824fa6e5-fda0-41bc-b196-693d41e693b0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:40.122757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-824fa6e5-fda0-41bc-b196-693d41e693b0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:40.124562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-824fa6e5-fda0-41bc-b196-693d41e693b0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:40.125968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-824fa6e5-fda0-41bc-b196-693d41e693b0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:40.127320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-824fa6e5-fda0-41bc-b196-693d41e693b0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:40.567591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b98605a4-a250-406b-8ae4-2f3af285b78b tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:40.568425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b98605a4-a250-406b-8ae4-2f3af285b78b tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] [instance: ab987f7a-2da5-45f4-9609-2e25300a1131] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:40.598106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b98605a4-a250-406b-8ae4-2f3af285b78b tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:40.600935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b98605a4-a250-406b-8ae4-2f3af285b78b tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:40.602256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b98605a4-a250-406b-8ae4-2f3af285b78b tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:40.606062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b98605a4-a250-406b-8ae4-2f3af285b78b tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:40.612467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b98605a4-a250-406b-8ae4-2f3af285b78b tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:40.614545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b98605a4-a250-406b-8ae4-2f3af285b78b tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:40.791741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-824fa6e5-fda0-41bc-b196-693d41e693b0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:40.819295 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-824fa6e5-fda0-41bc-b196-693d41e693b0 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1495 microversion: 2.1 time: 0.740339 Sep 07 12:59:40.825944 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2659/5370] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:40 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1495 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:41.319046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b98605a4-a250-406b-8ae4-2f3af285b78b tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd24d5039654ee4970759257ceaf028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c23f2e6caa450286d406171c97dd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:41.347141 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b98605a4-a250-406b-8ae4-2f3af285b78b tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] 10.222.0.16 "GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131" status: 200 len: 1525 microversion: 2.1 time: 0.791359 Sep 07 12:59:41.351436 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2712/5371] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:40 2022] GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131 => generated 1525 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:41.864128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-98baedb6-3796-4c05-805d-01683a0b6366 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:41.865053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-98baedb6-3796-4c05-805d-01683a0b6366 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:41.959389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98baedb6-3796-4c05-805d-01683a0b6366 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:41.960243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98baedb6-3796-4c05-805d-01683a0b6366 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:41.961036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98baedb6-3796-4c05-805d-01683a0b6366 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:41.973408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98baedb6-3796-4c05-805d-01683a0b6366 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:41.974370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98baedb6-3796-4c05-805d-01683a0b6366 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:41.986176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98baedb6-3796-4c05-805d-01683a0b6366 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:42.206624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b98605a4-a250-406b-8ae4-2f3af285b78b tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:42.211167 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b98605a4-a250-406b-8ae4-2f3af285b78b tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003777 Sep 07 12:59:42.213156 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2713/5372] 10.222.0.16 () {56 vars in 886 bytes} [Wed Sep 7 12:59:42 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 07 12:59:42.392278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-49cb2403-9c2f-46d7-b275-61330bbb1cd9 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:42.394012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-49cb2403-9c2f-46d7-b275-61330bbb1cd9 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] [instance: ab987f7a-2da5-45f4-9609-2e25300a1131] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:42.418262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49cb2403-9c2f-46d7-b275-61330bbb1cd9 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:42.419770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49cb2403-9c2f-46d7-b275-61330bbb1cd9 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:42.420949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49cb2403-9c2f-46d7-b275-61330bbb1cd9 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:42.423062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49cb2403-9c2f-46d7-b275-61330bbb1cd9 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:42.424406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49cb2403-9c2f-46d7-b275-61330bbb1cd9 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:42.428551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49cb2403-9c2f-46d7-b275-61330bbb1cd9 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:43.226837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-98baedb6-3796-4c05-805d-01683a0b6366 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:43.237987 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-98baedb6-3796-4c05-805d-01683a0b6366 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1495 microversion: 2.1 time: 1.381781 Sep 07 12:59:43.238969 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2660/5373] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:41 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1495 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:59:43.320617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-49cb2403-9c2f-46d7-b275-61330bbb1cd9 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd24d5039654ee4970759257ceaf028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c23f2e6caa450286d406171c97dd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:43.330487 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-49cb2403-9c2f-46d7-b275-61330bbb1cd9 tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] 10.222.0.16 "GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131" status: 200 len: 1525 microversion: 2.1 time: 0.953454 Sep 07 12:59:43.331086 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2714/5374] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:42 2022] GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131 => generated 1525 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:43.587425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-4298bcb7-b4ee-4481-a5b4-58af97a01b2d req-00111eb4-4fe8-4dcc-b8a1-b2a1ea37e0fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "998c0280-c44f-43db-84f9-7112e80100ff", "name": "network-vif-deleted", "tag": "34a80aea-b68b-4c0b-b28b-ca7783c457a5"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:43.614813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4298bcb7-b4ee-4481-a5b4-58af97a01b2d req-00111eb4-4fe8-4dcc-b8a1-b2a1ea37e0fc service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:43.615326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4298bcb7-b4ee-4481-a5b4-58af97a01b2d req-00111eb4-4fe8-4dcc-b8a1-b2a1ea37e0fc service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:43.620650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4298bcb7-b4ee-4481-a5b4-58af97a01b2d req-00111eb4-4fe8-4dcc-b8a1-b2a1ea37e0fc service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:43.670131 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-4298bcb7-b4ee-4481-a5b4-58af97a01b2d req-00111eb4-4fe8-4dcc-b8a1-b2a1ea37e0fc service nova] Creating event network-vif-deleted:34a80aea-b68b-4c0b-b28b-ca7783c457a5 for instance 998c0280-c44f-43db-84f9-7112e80100ff on n-h1-852087-9 Sep 07 12:59:43.697825 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-4298bcb7-b4ee-4481-a5b4-58af97a01b2d req-00111eb4-4fe8-4dcc-b8a1-b2a1ea37e0fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103580 Sep 07 12:59:43.699480 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2661/5375] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 12:59:44.273806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d6f6858-cffc-4e2e-bb18-b5a13f7371b3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:44.275636 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1d6f6858-cffc-4e2e-bb18-b5a13f7371b3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:44.294726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:44.329983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d6f6858-cffc-4e2e-bb18-b5a13f7371b3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:44.333924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d6f6858-cffc-4e2e-bb18-b5a13f7371b3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:44.335326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d6f6858-cffc-4e2e-bb18-b5a13f7371b3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:44.336375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d6f6858-cffc-4e2e-bb18-b5a13f7371b3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:44.337457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d6f6858-cffc-4e2e-bb18-b5a13f7371b3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:44.338419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d6f6858-cffc-4e2e-bb18-b5a13f7371b3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:44.372501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-38008996-7535-4259-acac-5340d8cb1e5d tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:44.375673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-38008996-7535-4259-acac-5340d8cb1e5d tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] [instance: ab987f7a-2da5-45f4-9609-2e25300a1131] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:44.423352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38008996-7535-4259-acac-5340d8cb1e5d tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:44.424386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38008996-7535-4259-acac-5340d8cb1e5d tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:44.429415 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38008996-7535-4259-acac-5340d8cb1e5d tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:44.430941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38008996-7535-4259-acac-5340d8cb1e5d tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:44.435943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38008996-7535-4259-acac-5340d8cb1e5d tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:44.438406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38008996-7535-4259-acac-5340d8cb1e5d tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:44.609353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d6f6858-cffc-4e2e-bb18-b5a13f7371b3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:44.611476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d6f6858-cffc-4e2e-bb18-b5a13f7371b3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:44.613074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d6f6858-cffc-4e2e-bb18-b5a13f7371b3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:44.614331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-1d6f6858-cffc-4e2e-bb18-b5a13f7371b3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lazy-loading 'fault' on Instance uuid 998c0280-c44f-43db-84f9-7112e80100ff {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:59:44.862555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1d6f6858-cffc-4e2e-bb18-b5a13f7371b3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:44.907597 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1d6f6858-cffc-4e2e-bb18-b5a13f7371b3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 200 len: 1310 microversion: 2.1 time: 0.638471 Sep 07 12:59:44.909526 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2715/5376] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:44 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 1310 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:59:44.941664 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-38008996-7535-4259-acac-5340d8cb1e5d tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd24d5039654ee4970759257ceaf028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c23f2e6caa450286d406171c97dd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:44.967123 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-38008996-7535-4259-acac-5340d8cb1e5d tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] 10.222.0.16 "GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131" status: 200 len: 1308 microversion: 2.1 time: 0.611928 Sep 07 12:59:44.974059 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2662/5377] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:44 2022] GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131 => generated 1308 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:59:45.781528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-f0503f5c-7fd3-471f-8901-b81e9edcdee7 req-181a310b-0a9b-4285-87f4-f48f3bb36794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab987f7a-2da5-45f4-9609-2e25300a1131", "name": "network-vif-deleted", "tag": "9f4e6537-9ec8-4724-98e6-f4c4508ce870"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:45.809053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f0503f5c-7fd3-471f-8901-b81e9edcdee7 req-181a310b-0a9b-4285-87f4-f48f3bb36794 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:45.825941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f0503f5c-7fd3-471f-8901-b81e9edcdee7 req-181a310b-0a9b-4285-87f4-f48f3bb36794 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:45.831665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f0503f5c-7fd3-471f-8901-b81e9edcdee7 req-181a310b-0a9b-4285-87f4-f48f3bb36794 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:45.901628 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-f0503f5c-7fd3-471f-8901-b81e9edcdee7 req-181a310b-0a9b-4285-87f4-f48f3bb36794 service nova] Creating event network-vif-deleted:9f4e6537-9ec8-4724-98e6-f4c4508ce870 for instance ab987f7a-2da5-45f4-9609-2e25300a1131 on n-h1-852087-9 Sep 07 12:59:45.935359 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-f0503f5c-7fd3-471f-8901-b81e9edcdee7 req-181a310b-0a9b-4285-87f4-f48f3bb36794 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175793 Sep 07 12:59:45.936605 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2716/5378] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:59:45.960122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-703f56f4-a1b3-4783-b77e-f9263b540350 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:45.961847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-703f56f4-a1b3-4783-b77e-f9263b540350 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:45.969668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-703f56f4-a1b3-4783-b77e-f9263b540350 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:45.970575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-703f56f4-a1b3-4783-b77e-f9263b540350 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:45.971409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-703f56f4-a1b3-4783-b77e-f9263b540350 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:45.973943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-703f56f4-a1b3-4783-b77e-f9263b540350 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:45.976195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-703f56f4-a1b3-4783-b77e-f9263b540350 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:45.976825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-703f56f4-a1b3-4783-b77e-f9263b540350 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:45.994946 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-703f56f4-a1b3-4783-b77e-f9263b540350 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] HTTP exception thrown: Instance 998c0280-c44f-43db-84f9-7112e80100ff could not be found. Sep 07 12:59:46.001783 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-455f25e9-bce1-495f-864a-741333edda2f tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:46.003056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-455f25e9-bce1-495f-864a-741333edda2f tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] [instance: ab987f7a-2da5-45f4-9609-2e25300a1131] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-703f56f4-a1b3-4783-b77e-f9263b540350 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Request method failure captured: Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff HTTP/1.1 Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJSE5qt3MMvCiXM6JMYUN7f1buxIi7ST_NSWH8b3Iy1XPUp8KO4zG-NXQgWVN1Z7GE3sHXszWiKCVOYqqXwQROrdr4ZEFwz_8XPZaHXiJBQID0HYLx7sZ_BMJTKC5v-6tuUaVizJ_CnloOe2V1xTk5bkZGekyl16F75E8fKcPIskPJo Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestJSON-553840835 Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersTestJSON-553840835-project Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6ac786dc6d7847f582262dcd912c3f06 Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestJSON-553840835-project Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 998c0280-c44f-43db-84f9-7112e80100ff could not be found. Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '998c0280-c44f-43db-84f9-7112e80100ff'} Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 998c0280-c44f-43db-84f9-7112e80100ff could not be found. Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 998c0280-c44f-43db-84f9-7112e80100ff could not be found. Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.009202 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.013444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:46.013444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:46.013444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:46.013444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:46.013444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 998c0280-c44f-43db-84f9-7112e80100ff could not be found. Sep 07 12:59:46.013444 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.017671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-703f56f4-a1b3-4783-b77e-f9263b540350 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Returning 404 to user: Instance 998c0280-c44f-43db-84f9-7112e80100ff could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:46.022110 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-703f56f4-a1b3-4783-b77e-f9263b540350 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 404 len: 111 microversion: 2.1 time: 0.063986 Sep 07 12:59:46.022977 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2663/5379] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:45 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:59:46.024328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-455f25e9-bce1-495f-864a-741333edda2f tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:46.025094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-455f25e9-bce1-495f-864a-741333edda2f tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:46.025800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-455f25e9-bce1-495f-864a-741333edda2f tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:46.026809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-455f25e9-bce1-495f-864a-741333edda2f tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:46.027571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-455f25e9-bce1-495f-864a-741333edda2f tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:46.028284 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-455f25e9-bce1-495f-864a-741333edda2f tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:46.044705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a49f2da3-519b-41bf-b38e-ec1cebf48091 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:46.045671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a49f2da3-519b-41bf-b38e-ec1cebf48091 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:46.060311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a49f2da3-519b-41bf-b38e-ec1cebf48091 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:46.065407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a49f2da3-519b-41bf-b38e-ec1cebf48091 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:46.066949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a49f2da3-519b-41bf-b38e-ec1cebf48091 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:46.068890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a49f2da3-519b-41bf-b38e-ec1cebf48091 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:46.070060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a49f2da3-519b-41bf-b38e-ec1cebf48091 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:46.075266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a49f2da3-519b-41bf-b38e-ec1cebf48091 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:46.087063 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-455f25e9-bce1-495f-864a-741333edda2f tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] HTTP exception thrown: Instance ab987f7a-2da5-45f4-9609-2e25300a1131 could not be found. Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-455f25e9-bce1-495f-864a-741333edda2f tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Request method failure captured: Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131 HTTP/1.1 Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJWhD3ayLjGUrRDEa6HVQiZSRE-kC6gdDZQfyjaXyy0g9zvRte89CjbSQJhU9DtE12Shg7x2AFh44okcMcTJKvqZTEA19CrSpEoIn1jr_JVIJvDV47D_cmiSFnKzgu4ovaVFDJbM8jp4vNJB2JXUhvzk32Ktuu27XMW_iMyh-wydP34 Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 03c23f2e6caa450286d406171c97dd31 Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1057595811 Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/03c23f2e6caa450286d406171c97dd31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_03c23f2e6caa450286d406171c97dd31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/03c23f2e6caa450286d406171c97dd31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/03c23f2e6caa450286d406171c97dd31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1057595811 Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 03c23f2e6caa450286d406171c97dd31 Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1057595811 Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerMetadataNegativeTestJSON-1057595811-project Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 1fd24d5039654ee4970759257ceaf028 Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1057595811-project Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance ab987f7a-2da5-45f4-9609-2e25300a1131 could not be found. Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'ab987f7a-2da5-45f4-9609-2e25300a1131'} Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab987f7a-2da5-45f4-9609-2e25300a1131 could not be found. Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab987f7a-2da5-45f4-9609-2e25300a1131 could not be found. Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.096929 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:46.101604 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.101604 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.101604 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:46.101604 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:46.101604 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:46.101604 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:46.101604 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab987f7a-2da5-45f4-9609-2e25300a1131 could not be found. Sep 07 12:59:46.101604 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.103742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-455f25e9-bce1-495f-864a-741333edda2f tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] Returning 404 to user: Instance ab987f7a-2da5-45f4-9609-2e25300a1131 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:46.105254 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-455f25e9-bce1-495f-864a-741333edda2f tempest-ServerMetadataNegativeTestJSON-1057595811 tempest-ServerMetadataNegativeTestJSON-1057595811-project] 10.222.0.16 "GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131" status: 404 len: 111 microversion: 2.1 time: 0.108203 Sep 07 12:59:46.106697 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2717/5380] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:45 2022] GET /compute/v2.1/servers/ab987f7a-2da5-45f4-9609-2e25300a1131 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:59:46.112610 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-a49f2da3-519b-41bf-b38e-ec1cebf48091 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] HTTP exception thrown: Instance 998c0280-c44f-43db-84f9-7112e80100ff could not be found. Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a49f2da3-519b-41bf-b38e-ec1cebf48091 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Request method failure captured: Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff HTTP/1.1 Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJSE5qt3MMvCiXM6JMYUN7f1buxIi7ST_NSWH8b3Iy1XPUp8KO4zG-NXQgWVN1Z7GE3sHXszWiKCVOYqqXwQROrdr4ZEFwz_8XPZaHXiJBQID0HYLx7sZ_BMJTKC5v-6tuUaVizJ_CnloOe2V1xTk5bkZGekyl16F75E8fKcPIskPJo Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestJSON-553840835 Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersTestJSON-553840835-project Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6ac786dc6d7847f582262dcd912c3f06 Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestJSON-553840835-project Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 998c0280-c44f-43db-84f9-7112e80100ff could not be found. Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '998c0280-c44f-43db-84f9-7112e80100ff'} Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 998c0280-c44f-43db-84f9-7112e80100ff could not be found. Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:46.114803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 998c0280-c44f-43db-84f9-7112e80100ff could not be found. Sep 07 12:59:46.120125 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.120125 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:46.120125 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.120125 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.120125 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:46.120125 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:46.120125 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:46.120125 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:46.120125 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 998c0280-c44f-43db-84f9-7112e80100ff could not be found. Sep 07 12:59:46.120125 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.122357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a49f2da3-519b-41bf-b38e-ec1cebf48091 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Returning 404 to user: Instance 998c0280-c44f-43db-84f9-7112e80100ff could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:46.123745 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a49f2da3-519b-41bf-b38e-ec1cebf48091 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "DELETE /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 404 len: 111 microversion: 2.1 time: 0.083388 Sep 07 12:59:46.124968 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2664/5381] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:59:46 2022] DELETE /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:59:46.135568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-11e328e6-b02f-4b2d-81a3-40323006ed8c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:46.137107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-11e328e6-b02f-4b2d-81a3-40323006ed8c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 998c0280-c44f-43db-84f9-7112e80100ff] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:46.155767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11e328e6-b02f-4b2d-81a3-40323006ed8c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:46.156726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11e328e6-b02f-4b2d-81a3-40323006ed8c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:46.157420 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11e328e6-b02f-4b2d-81a3-40323006ed8c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:46.158477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11e328e6-b02f-4b2d-81a3-40323006ed8c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:46.159318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11e328e6-b02f-4b2d-81a3-40323006ed8c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:46.160082 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11e328e6-b02f-4b2d-81a3-40323006ed8c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:46.200676 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-11e328e6-b02f-4b2d-81a3-40323006ed8c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] HTTP exception thrown: Instance 998c0280-c44f-43db-84f9-7112e80100ff could not be found. Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-11e328e6-b02f-4b2d-81a3-40323006ed8c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Request method failure captured: Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff HTTP/1.1 Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJSE5qt3MMvCiXM6JMYUN7f1buxIi7ST_NSWH8b3Iy1XPUp8KO4zG-NXQgWVN1Z7GE3sHXszWiKCVOYqqXwQROrdr4ZEFwz_8XPZaHXiJBQID0HYLx7sZ_BMJTKC5v-6tuUaVizJ_CnloOe2V1xTk5bkZGekyl16F75E8fKcPIskPJo Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestJSON-553840835 Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersTestJSON-553840835-project Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6ac786dc6d7847f582262dcd912c3f06 Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestJSON-553840835-project Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 998c0280-c44f-43db-84f9-7112e80100ff could not be found. Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '998c0280-c44f-43db-84f9-7112e80100ff'} Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 998c0280-c44f-43db-84f9-7112e80100ff could not be found. Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 998c0280-c44f-43db-84f9-7112e80100ff could not be found. Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.206628 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.211392 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:46.211392 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:46.211392 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:46.211392 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:46.211392 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 998c0280-c44f-43db-84f9-7112e80100ff could not be found. Sep 07 12:59:46.211392 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.215332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-11e328e6-b02f-4b2d-81a3-40323006ed8c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Returning 404 to user: Instance 998c0280-c44f-43db-84f9-7112e80100ff could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:46.221132 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-11e328e6-b02f-4b2d-81a3-40323006ed8c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff" status: 404 len: 111 microversion: 2.1 time: 0.090344 Sep 07 12:59:46.225894 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2718/5382] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:46 2022] GET /compute/v2.1/servers/998c0280-c44f-43db-84f9-7112e80100ff => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:59:46.236733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-44ecb837-2312-40cf-b8dc-592bb23c00e3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:46.240184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-44ecb837-2312-40cf-b8dc-592bb23c00e3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 0c054466-0769-4190-b9bd-ffe3b4a98706] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:46.268539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44ecb837-2312-40cf-b8dc-592bb23c00e3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:46.273923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44ecb837-2312-40cf-b8dc-592bb23c00e3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:46.276598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44ecb837-2312-40cf-b8dc-592bb23c00e3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:46.278578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44ecb837-2312-40cf-b8dc-592bb23c00e3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:46.283707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44ecb837-2312-40cf-b8dc-592bb23c00e3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:46.285101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-44ecb837-2312-40cf-b8dc-592bb23c00e3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:46.343482 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-44ecb837-2312-40cf-b8dc-592bb23c00e3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] HTTP exception thrown: Instance 0c054466-0769-4190-b9bd-ffe3b4a98706 could not be found. Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-44ecb837-2312-40cf-b8dc-592bb23c00e3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Request method failure captured: Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 HTTP/1.1 Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJSE5qt3MMvCiXM6JMYUN7f1buxIi7ST_NSWH8b3Iy1XPUp8KO4zG-NXQgWVN1Z7GE3sHXszWiKCVOYqqXwQROrdr4ZEFwz_8XPZaHXiJBQID0HYLx7sZ_BMJTKC5v-6tuUaVizJ_CnloOe2V1xTk5bkZGekyl16F75E8fKcPIskPJo Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestJSON-553840835 Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersTestJSON-553840835-project Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6ac786dc6d7847f582262dcd912c3f06 Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestJSON-553840835-project Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 0c054466-0769-4190-b9bd-ffe3b4a98706 could not be found. Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '0c054466-0769-4190-b9bd-ffe3b4a98706'} Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c054466-0769-4190-b9bd-ffe3b4a98706 could not be found. Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:46.355917 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c054466-0769-4190-b9bd-ffe3b4a98706 could not be found. Sep 07 12:59:46.369916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.369916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:46.369916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.369916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.369916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:46.369916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:46.369916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:46.369916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:46.369916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c054466-0769-4190-b9bd-ffe3b4a98706 could not be found. Sep 07 12:59:46.369916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.369916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-44ecb837-2312-40cf-b8dc-592bb23c00e3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Returning 404 to user: Instance 0c054466-0769-4190-b9bd-ffe3b4a98706 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:46.373076 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-44ecb837-2312-40cf-b8dc-592bb23c00e3 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706" status: 404 len: 111 microversion: 2.1 time: 0.139902 Sep 07 12:59:46.374669 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2665/5383] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:59:46 2022] DELETE /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:59:46.386509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-056c3208-7e3b-48ef-bb63-9d17c0b5f735 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:46.387396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-056c3208-7e3b-48ef-bb63-9d17c0b5f735 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 0c054466-0769-4190-b9bd-ffe3b4a98706] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:46.407461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-056c3208-7e3b-48ef-bb63-9d17c0b5f735 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:46.409344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-056c3208-7e3b-48ef-bb63-9d17c0b5f735 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:46.414703 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-056c3208-7e3b-48ef-bb63-9d17c0b5f735 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:46.420604 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-056c3208-7e3b-48ef-bb63-9d17c0b5f735 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:46.421536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-056c3208-7e3b-48ef-bb63-9d17c0b5f735 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:46.422349 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-056c3208-7e3b-48ef-bb63-9d17c0b5f735 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:46.467947 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-056c3208-7e3b-48ef-bb63-9d17c0b5f735 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] HTTP exception thrown: Instance 0c054466-0769-4190-b9bd-ffe3b4a98706 could not be found. Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-056c3208-7e3b-48ef-bb63-9d17c0b5f735 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Request method failure captured: Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 HTTP/1.1 Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJSE5qt3MMvCiXM6JMYUN7f1buxIi7ST_NSWH8b3Iy1XPUp8KO4zG-NXQgWVN1Z7GE3sHXszWiKCVOYqqXwQROrdr4ZEFwz_8XPZaHXiJBQID0HYLx7sZ_BMJTKC5v-6tuUaVizJ_CnloOe2V1xTk5bkZGekyl16F75E8fKcPIskPJo Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestJSON-553840835 Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersTestJSON-553840835-project Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6ac786dc6d7847f582262dcd912c3f06 Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestJSON-553840835-project Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 0c054466-0769-4190-b9bd-ffe3b4a98706 could not be found. Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '0c054466-0769-4190-b9bd-ffe3b4a98706'} Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c054466-0769-4190-b9bd-ffe3b4a98706 could not be found. Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c054466-0769-4190-b9bd-ffe3b4a98706 could not be found. Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.483754 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.488144 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:46.488144 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:46.488144 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:46.488144 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:46.488144 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c054466-0769-4190-b9bd-ffe3b4a98706 could not be found. Sep 07 12:59:46.488144 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.492347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-056c3208-7e3b-48ef-bb63-9d17c0b5f735 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Returning 404 to user: Instance 0c054466-0769-4190-b9bd-ffe3b4a98706 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:46.493751 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-056c3208-7e3b-48ef-bb63-9d17c0b5f735 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706" status: 404 len: 111 microversion: 2.1 time: 0.114650 Sep 07 12:59:46.500481 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2719/5384] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:46 2022] GET /compute/v2.1/servers/0c054466-0769-4190-b9bd-ffe3b4a98706 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:59:46.507756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df7572f2-040e-49a9-b494-65405781e736 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:46.511899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-df7572f2-040e-49a9-b494-65405781e736 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d9cff1f-6cd8-4472-be56-757c5ce15956] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:46.543955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df7572f2-040e-49a9-b494-65405781e736 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:46.545352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df7572f2-040e-49a9-b494-65405781e736 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:46.546463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df7572f2-040e-49a9-b494-65405781e736 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:46.548196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df7572f2-040e-49a9-b494-65405781e736 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:46.552526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df7572f2-040e-49a9-b494-65405781e736 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:46.553858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df7572f2-040e-49a9-b494-65405781e736 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:46.610811 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-df7572f2-040e-49a9-b494-65405781e736 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] HTTP exception thrown: Instance 7d9cff1f-6cd8-4472-be56-757c5ce15956 could not be found. Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df7572f2-040e-49a9-b494-65405781e736 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Request method failure captured: Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956 HTTP/1.1 Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJSE5qt3MMvCiXM6JMYUN7f1buxIi7ST_NSWH8b3Iy1XPUp8KO4zG-NXQgWVN1Z7GE3sHXszWiKCVOYqqXwQROrdr4ZEFwz_8XPZaHXiJBQID0HYLx7sZ_BMJTKC5v-6tuUaVizJ_CnloOe2V1xTk5bkZGekyl16F75E8fKcPIskPJo Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestJSON-553840835 Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersTestJSON-553840835-project Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6ac786dc6d7847f582262dcd912c3f06 Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestJSON-553840835-project Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 7d9cff1f-6cd8-4472-be56-757c5ce15956 could not be found. Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '7d9cff1f-6cd8-4472-be56-757c5ce15956'} Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d9cff1f-6cd8-4472-be56-757c5ce15956 could not be found. Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:46.619218 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d9cff1f-6cd8-4472-be56-757c5ce15956 could not be found. Sep 07 12:59:46.624010 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.624010 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:46.624010 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.624010 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.624010 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:46.624010 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:46.624010 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:46.624010 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:46.624010 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d9cff1f-6cd8-4472-be56-757c5ce15956 could not be found. Sep 07 12:59:46.624010 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.625974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df7572f2-040e-49a9-b494-65405781e736 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Returning 404 to user: Instance 7d9cff1f-6cd8-4472-be56-757c5ce15956 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:46.631460 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-df7572f2-040e-49a9-b494-65405781e736 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956" status: 404 len: 111 microversion: 2.1 time: 0.127074 Sep 07 12:59:46.632753 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2666/5385] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:59:46 2022] DELETE /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:59:46.641068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-87baa873-a1ea-46f4-9c6f-f325e69a72a9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:46.641940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-87baa873-a1ea-46f4-9c6f-f325e69a72a9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d9cff1f-6cd8-4472-be56-757c5ce15956] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:46.652779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87baa873-a1ea-46f4-9c6f-f325e69a72a9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:46.661188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87baa873-a1ea-46f4-9c6f-f325e69a72a9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:46.668538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87baa873-a1ea-46f4-9c6f-f325e69a72a9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:46.671377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87baa873-a1ea-46f4-9c6f-f325e69a72a9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:46.673884 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87baa873-a1ea-46f4-9c6f-f325e69a72a9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:46.674375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87baa873-a1ea-46f4-9c6f-f325e69a72a9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:46.711586 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-87baa873-a1ea-46f4-9c6f-f325e69a72a9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] HTTP exception thrown: Instance 7d9cff1f-6cd8-4472-be56-757c5ce15956 could not be found. Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-87baa873-a1ea-46f4-9c6f-f325e69a72a9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Request method failure captured: Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956 HTTP/1.1 Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJSE5qt3MMvCiXM6JMYUN7f1buxIi7ST_NSWH8b3Iy1XPUp8KO4zG-NXQgWVN1Z7GE3sHXszWiKCVOYqqXwQROrdr4ZEFwz_8XPZaHXiJBQID0HYLx7sZ_BMJTKC5v-6tuUaVizJ_CnloOe2V1xTk5bkZGekyl16F75E8fKcPIskPJo Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestJSON-553840835 Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersTestJSON-553840835-project Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6ac786dc6d7847f582262dcd912c3f06 Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestJSON-553840835-project Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 7d9cff1f-6cd8-4472-be56-757c5ce15956 could not be found. Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '7d9cff1f-6cd8-4472-be56-757c5ce15956'} Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d9cff1f-6cd8-4472-be56-757c5ce15956 could not be found. Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d9cff1f-6cd8-4472-be56-757c5ce15956 could not be found. Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.713281 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.721154 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:46.721154 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:46.721154 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:46.721154 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:46.721154 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d9cff1f-6cd8-4472-be56-757c5ce15956 could not be found. Sep 07 12:59:46.721154 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.721154 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-87baa873-a1ea-46f4-9c6f-f325e69a72a9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Returning 404 to user: Instance 7d9cff1f-6cd8-4472-be56-757c5ce15956 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:46.721154 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-87baa873-a1ea-46f4-9c6f-f325e69a72a9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956" status: 404 len: 111 microversion: 2.1 time: 0.078095 Sep 07 12:59:46.732468 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2720/5386] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:46 2022] GET /compute/v2.1/servers/7d9cff1f-6cd8-4472-be56-757c5ce15956 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:59:46.739009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-56f4700b-93ca-4d15-85cd-d71f52b96340 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:46.740453 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-56f4700b-93ca-4d15-85cd-d71f52b96340 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d870ac2-825e-4d5b-825b-fcc194138508] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:46.763446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56f4700b-93ca-4d15-85cd-d71f52b96340 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:46.770030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56f4700b-93ca-4d15-85cd-d71f52b96340 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:46.774721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56f4700b-93ca-4d15-85cd-d71f52b96340 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:46.776019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56f4700b-93ca-4d15-85cd-d71f52b96340 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:46.777405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56f4700b-93ca-4d15-85cd-d71f52b96340 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:46.780091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56f4700b-93ca-4d15-85cd-d71f52b96340 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:46.789831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:46.823236 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-56f4700b-93ca-4d15-85cd-d71f52b96340 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] HTTP exception thrown: Instance 7d870ac2-825e-4d5b-825b-fcc194138508 could not be found. Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-56f4700b-93ca-4d15-85cd-d71f52b96340 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Request method failure captured: Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508 HTTP/1.1 Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJSE5qt3MMvCiXM6JMYUN7f1buxIi7ST_NSWH8b3Iy1XPUp8KO4zG-NXQgWVN1Z7GE3sHXszWiKCVOYqqXwQROrdr4ZEFwz_8XPZaHXiJBQID0HYLx7sZ_BMJTKC5v-6tuUaVizJ_CnloOe2V1xTk5bkZGekyl16F75E8fKcPIskPJo Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestJSON-553840835 Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersTestJSON-553840835-project Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6ac786dc6d7847f582262dcd912c3f06 Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestJSON-553840835-project Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 7d870ac2-825e-4d5b-825b-fcc194138508 could not be found. Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '7d870ac2-825e-4d5b-825b-fcc194138508'} Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d870ac2-825e-4d5b-825b-fcc194138508 could not be found. Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:46.826690 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d870ac2-825e-4d5b-825b-fcc194138508 could not be found. Sep 07 12:59:46.830996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.830996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:46.830996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.830996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.830996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:46.830996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:46.830996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:46.830996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:46.830996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d870ac2-825e-4d5b-825b-fcc194138508 could not be found. Sep 07 12:59:46.830996 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.830996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-56f4700b-93ca-4d15-85cd-d71f52b96340 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Returning 404 to user: Instance 7d870ac2-825e-4d5b-825b-fcc194138508 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:46.830996 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-56f4700b-93ca-4d15-85cd-d71f52b96340 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508" status: 404 len: 111 microversion: 2.1 time: 0.094344 Sep 07 12:59:46.830996 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2667/5387] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:59:46 2022] DELETE /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:59:46.838226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a35fe5b1-4018-4226-98f0-76429837d81e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:46.839686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a35fe5b1-4018-4226-98f0-76429837d81e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7d870ac2-825e-4d5b-825b-fcc194138508] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:46.856895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a35fe5b1-4018-4226-98f0-76429837d81e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:46.865198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a35fe5b1-4018-4226-98f0-76429837d81e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:46.865822 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a35fe5b1-4018-4226-98f0-76429837d81e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:46.868436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a35fe5b1-4018-4226-98f0-76429837d81e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:46.869046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a35fe5b1-4018-4226-98f0-76429837d81e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:46.869387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a35fe5b1-4018-4226-98f0-76429837d81e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:46.914697 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-a35fe5b1-4018-4226-98f0-76429837d81e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] HTTP exception thrown: Instance 7d870ac2-825e-4d5b-825b-fcc194138508 could not be found. Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a35fe5b1-4018-4226-98f0-76429837d81e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Request method failure captured: Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508 HTTP/1.1 Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJSE5qt3MMvCiXM6JMYUN7f1buxIi7ST_NSWH8b3Iy1XPUp8KO4zG-NXQgWVN1Z7GE3sHXszWiKCVOYqqXwQROrdr4ZEFwz_8XPZaHXiJBQID0HYLx7sZ_BMJTKC5v-6tuUaVizJ_CnloOe2V1xTk5bkZGekyl16F75E8fKcPIskPJo Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestJSON-553840835 Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersTestJSON-553840835-project Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6ac786dc6d7847f582262dcd912c3f06 Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestJSON-553840835-project Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 7d870ac2-825e-4d5b-825b-fcc194138508 could not be found. Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '7d870ac2-825e-4d5b-825b-fcc194138508'} Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d870ac2-825e-4d5b-825b-fcc194138508 could not be found. Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d870ac2-825e-4d5b-825b-fcc194138508 could not be found. Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.916390 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:46.920834 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:46.920834 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:46.920834 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:46.920834 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:46.920834 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d870ac2-825e-4d5b-825b-fcc194138508 could not be found. Sep 07 12:59:46.920834 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:46.921641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a35fe5b1-4018-4226-98f0-76429837d81e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Returning 404 to user: Instance 7d870ac2-825e-4d5b-825b-fcc194138508 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:46.923472 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a35fe5b1-4018-4226-98f0-76429837d81e tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508" status: 404 len: 111 microversion: 2.1 time: 0.089594 Sep 07 12:59:46.926244 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2721/5388] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:46 2022] GET /compute/v2.1/servers/7d870ac2-825e-4d5b-825b-fcc194138508 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:59:46.942584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d3166b58-c8b3-4fd6-bf07-f8d470cf0e84 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:46.943088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d3166b58-c8b3-4fd6-bf07-f8d470cf0e84 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7ebb91d2-1102-474c-acb1-2791dfbd422a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:46.962790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3166b58-c8b3-4fd6-bf07-f8d470cf0e84 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:46.964428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3166b58-c8b3-4fd6-bf07-f8d470cf0e84 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:46.965383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3166b58-c8b3-4fd6-bf07-f8d470cf0e84 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:46.966454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3166b58-c8b3-4fd6-bf07-f8d470cf0e84 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:46.967698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3166b58-c8b3-4fd6-bf07-f8d470cf0e84 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:46.968346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3166b58-c8b3-4fd6-bf07-f8d470cf0e84 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:47.032606 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-d3166b58-c8b3-4fd6-bf07-f8d470cf0e84 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] HTTP exception thrown: Instance 7ebb91d2-1102-474c-acb1-2791dfbd422a could not be found. Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d3166b58-c8b3-4fd6-bf07-f8d470cf0e84 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Request method failure captured: Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a HTTP/1.1 Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJSE5qt3MMvCiXM6JMYUN7f1buxIi7ST_NSWH8b3Iy1XPUp8KO4zG-NXQgWVN1Z7GE3sHXszWiKCVOYqqXwQROrdr4ZEFwz_8XPZaHXiJBQID0HYLx7sZ_BMJTKC5v-6tuUaVizJ_CnloOe2V1xTk5bkZGekyl16F75E8fKcPIskPJo Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestJSON-553840835 Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersTestJSON-553840835-project Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6ac786dc6d7847f582262dcd912c3f06 Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestJSON-553840835-project Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 7ebb91d2-1102-474c-acb1-2791dfbd422a could not be found. Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '7ebb91d2-1102-474c-acb1-2791dfbd422a'} Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ebb91d2-1102-474c-acb1-2791dfbd422a could not be found. Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:47.054414 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ebb91d2-1102-474c-acb1-2791dfbd422a could not be found. Sep 07 12:59:47.058867 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.058867 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:47.058867 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.058867 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:47.058867 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:47.058867 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:47.058867 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:47.058867 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:47.058867 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ebb91d2-1102-474c-acb1-2791dfbd422a could not be found. Sep 07 12:59:47.058867 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.066504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d3166b58-c8b3-4fd6-bf07-f8d470cf0e84 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Returning 404 to user: Instance 7ebb91d2-1102-474c-acb1-2791dfbd422a could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:47.067760 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d3166b58-c8b3-4fd6-bf07-f8d470cf0e84 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a" status: 404 len: 111 microversion: 2.1 time: 0.136957 Sep 07 12:59:47.074906 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2668/5389] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:59:46 2022] DELETE /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:59:47.083231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-adbe07e8-bef3-494a-8b9a-0f379edb2375 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:47.084355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-adbe07e8-bef3-494a-8b9a-0f379edb2375 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 7ebb91d2-1102-474c-acb1-2791dfbd422a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:47.104264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-adbe07e8-bef3-494a-8b9a-0f379edb2375 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:47.114751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-adbe07e8-bef3-494a-8b9a-0f379edb2375 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:47.115942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-adbe07e8-bef3-494a-8b9a-0f379edb2375 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:47.117456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-adbe07e8-bef3-494a-8b9a-0f379edb2375 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:47.121206 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-adbe07e8-bef3-494a-8b9a-0f379edb2375 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:47.124094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-adbe07e8-bef3-494a-8b9a-0f379edb2375 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:47.178994 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-adbe07e8-bef3-494a-8b9a-0f379edb2375 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] HTTP exception thrown: Instance 7ebb91d2-1102-474c-acb1-2791dfbd422a could not be found. Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-adbe07e8-bef3-494a-8b9a-0f379edb2375 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Request method failure captured: Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a HTTP/1.1 Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJSE5qt3MMvCiXM6JMYUN7f1buxIi7ST_NSWH8b3Iy1XPUp8KO4zG-NXQgWVN1Z7GE3sHXszWiKCVOYqqXwQROrdr4ZEFwz_8XPZaHXiJBQID0HYLx7sZ_BMJTKC5v-6tuUaVizJ_CnloOe2V1xTk5bkZGekyl16F75E8fKcPIskPJo Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestJSON-553840835 Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersTestJSON-553840835-project Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6ac786dc6d7847f582262dcd912c3f06 Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestJSON-553840835-project Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 7ebb91d2-1102-474c-acb1-2791dfbd422a could not be found. Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '7ebb91d2-1102-474c-acb1-2791dfbd422a'} Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ebb91d2-1102-474c-acb1-2791dfbd422a could not be found. Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ebb91d2-1102-474c-acb1-2791dfbd422a could not be found. Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.194918 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:47.204172 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:47.204172 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:47.204172 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:47.204172 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:47.204172 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ebb91d2-1102-474c-acb1-2791dfbd422a could not be found. Sep 07 12:59:47.204172 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.208648 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-adbe07e8-bef3-494a-8b9a-0f379edb2375 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Returning 404 to user: Instance 7ebb91d2-1102-474c-acb1-2791dfbd422a could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:47.210644 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-adbe07e8-bef3-494a-8b9a-0f379edb2375 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a" status: 404 len: 111 microversion: 2.1 time: 0.135394 Sep 07 12:59:47.215312 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2722/5390] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:47 2022] GET /compute/v2.1/servers/7ebb91d2-1102-474c-acb1-2791dfbd422a => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:59:47.223711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9c0b600a-75b8-40f1-80e5-022d93723503 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:47.224291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9c0b600a-75b8-40f1-80e5-022d93723503 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 1b76a312-8d25-432f-913b-2e8be8df9246] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:47.237824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c0b600a-75b8-40f1-80e5-022d93723503 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:47.238337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c0b600a-75b8-40f1-80e5-022d93723503 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:47.238791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c0b600a-75b8-40f1-80e5-022d93723503 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:47.239634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c0b600a-75b8-40f1-80e5-022d93723503 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:47.240105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c0b600a-75b8-40f1-80e5-022d93723503 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:47.240539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9c0b600a-75b8-40f1-80e5-022d93723503 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:47.318028 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-9c0b600a-75b8-40f1-80e5-022d93723503 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] HTTP exception thrown: Instance 1b76a312-8d25-432f-913b-2e8be8df9246 could not be found. Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9c0b600a-75b8-40f1-80e5-022d93723503 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Request method failure captured: Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246 HTTP/1.1 Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJSE5qt3MMvCiXM6JMYUN7f1buxIi7ST_NSWH8b3Iy1XPUp8KO4zG-NXQgWVN1Z7GE3sHXszWiKCVOYqqXwQROrdr4ZEFwz_8XPZaHXiJBQID0HYLx7sZ_BMJTKC5v-6tuUaVizJ_CnloOe2V1xTk5bkZGekyl16F75E8fKcPIskPJo Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestJSON-553840835 Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersTestJSON-553840835-project Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6ac786dc6d7847f582262dcd912c3f06 Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestJSON-553840835-project Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 1b76a312-8d25-432f-913b-2e8be8df9246 could not be found. Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '1b76a312-8d25-432f-913b-2e8be8df9246'} Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b76a312-8d25-432f-913b-2e8be8df9246 could not be found. Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:47.321714 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b76a312-8d25-432f-913b-2e8be8df9246 could not be found. Sep 07 12:59:47.330740 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.330740 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:47.330740 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.330740 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:47.330740 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:47.330740 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:47.330740 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:47.330740 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:47.330740 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b76a312-8d25-432f-913b-2e8be8df9246 could not be found. Sep 07 12:59:47.330740 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.336127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9c0b600a-75b8-40f1-80e5-022d93723503 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Returning 404 to user: Instance 1b76a312-8d25-432f-913b-2e8be8df9246 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:47.338349 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9c0b600a-75b8-40f1-80e5-022d93723503 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246" status: 404 len: 111 microversion: 2.1 time: 0.119452 Sep 07 12:59:47.340155 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2669/5391] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:59:47 2022] DELETE /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:59:47.352791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9a83788c-ec9e-42d7-919b-c4544b755ce7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:47.357542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9a83788c-ec9e-42d7-919b-c4544b755ce7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 1b76a312-8d25-432f-913b-2e8be8df9246] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:47.386295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a83788c-ec9e-42d7-919b-c4544b755ce7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:47.392121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a83788c-ec9e-42d7-919b-c4544b755ce7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:47.393661 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a83788c-ec9e-42d7-919b-c4544b755ce7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:47.397740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a83788c-ec9e-42d7-919b-c4544b755ce7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:47.402973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a83788c-ec9e-42d7-919b-c4544b755ce7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:47.403989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a83788c-ec9e-42d7-919b-c4544b755ce7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:47.435194 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-9a83788c-ec9e-42d7-919b-c4544b755ce7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] HTTP exception thrown: Instance 1b76a312-8d25-432f-913b-2e8be8df9246 could not be found. Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9a83788c-ec9e-42d7-919b-c4544b755ce7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Request method failure captured: Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246 HTTP/1.1 Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJSE5qt3MMvCiXM6JMYUN7f1buxIi7ST_NSWH8b3Iy1XPUp8KO4zG-NXQgWVN1Z7GE3sHXszWiKCVOYqqXwQROrdr4ZEFwz_8XPZaHXiJBQID0HYLx7sZ_BMJTKC5v-6tuUaVizJ_CnloOe2V1xTk5bkZGekyl16F75E8fKcPIskPJo Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersTestJSON-553840835 Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersTestJSON-553840835-project Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6ac786dc6d7847f582262dcd912c3f06 Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersTestJSON-553840835-project Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 1b76a312-8d25-432f-913b-2e8be8df9246 could not be found. Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '1b76a312-8d25-432f-913b-2e8be8df9246'} Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b76a312-8d25-432f-913b-2e8be8df9246 could not be found. Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b76a312-8d25-432f-913b-2e8be8df9246 could not be found. Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.439694 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:47.444357 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:47.444357 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:47.444357 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:47.444357 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:47.444357 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b76a312-8d25-432f-913b-2e8be8df9246 could not be found. Sep 07 12:59:47.444357 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.450581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9a83788c-ec9e-42d7-919b-c4544b755ce7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Returning 404 to user: Instance 1b76a312-8d25-432f-913b-2e8be8df9246 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:47.452068 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9a83788c-ec9e-42d7-919b-c4544b755ce7 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246" status: 404 len: 111 microversion: 2.1 time: 0.107100 Sep 07 12:59:47.453299 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2723/5392] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:47 2022] GET /compute/v2.1/servers/1b76a312-8d25-432f-913b-2e8be8df9246 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:59:47.469827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8934314e-f6af-476c-a0bc-87a655845f0b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:47.474417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8934314e-f6af-476c-a0bc-87a655845f0b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 333a253e-8804-4171-8e84-aabbdb54a345] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:47.531535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8934314e-f6af-476c-a0bc-87a655845f0b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:47.532636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8934314e-f6af-476c-a0bc-87a655845f0b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:47.538875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8934314e-f6af-476c-a0bc-87a655845f0b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:47.540099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8934314e-f6af-476c-a0bc-87a655845f0b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:47.550728 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8934314e-f6af-476c-a0bc-87a655845f0b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:47.551085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8934314e-f6af-476c-a0bc-87a655845f0b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:47.611461 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-8934314e-f6af-476c-a0bc-87a655845f0b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] HTTP exception thrown: Instance 333a253e-8804-4171-8e84-aabbdb54a345 could not be found. Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8934314e-f6af-476c-a0bc-87a655845f0b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Request method failure captured: Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/333a253e-8804-4171-8e84-aabbdb54a345 HTTP/1.1 Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJSE5qt3MMvCiXM6JMYUN7f1buxIi7ST_NSWH8b3Iy1XPUp8KO4zG-NXQgWVN1Z7GE3sHXszWiKCVOYqqXwQROrdr4ZEFwz_8XPZaHXiJBQID0HYLx7sZ_BMJTKC5v-6tuUaVizJ_CnloOe2V1xTk5bkZGekyl16F75E8fKcPIskPJo Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestJSON-553840835 Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersTestJSON-553840835-project Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6ac786dc6d7847f582262dcd912c3f06 Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestJSON-553840835-project Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 333a253e-8804-4171-8e84-aabbdb54a345 could not be found. Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '333a253e-8804-4171-8e84-aabbdb54a345'} Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 333a253e-8804-4171-8e84-aabbdb54a345 could not be found. Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:47.613121 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 333a253e-8804-4171-8e84-aabbdb54a345 could not be found. Sep 07 12:59:47.620642 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.620642 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:47.620642 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.620642 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:47.620642 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:47.620642 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:47.620642 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:47.620642 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:47.620642 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 333a253e-8804-4171-8e84-aabbdb54a345 could not be found. Sep 07 12:59:47.620642 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.620642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8934314e-f6af-476c-a0bc-87a655845f0b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Returning 404 to user: Instance 333a253e-8804-4171-8e84-aabbdb54a345 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:47.620642 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8934314e-f6af-476c-a0bc-87a655845f0b tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "DELETE /compute/v2.1/servers/333a253e-8804-4171-8e84-aabbdb54a345" status: 404 len: 111 microversion: 2.1 time: 0.156019 Sep 07 12:59:47.620642 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2670/5393] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:59:47 2022] DELETE /compute/v2.1/servers/333a253e-8804-4171-8e84-aabbdb54a345 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:59:47.623680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-46caead2-8a8d-42ce-b8d0-471d9d5ad9e9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:47.624312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-46caead2-8a8d-42ce-b8d0-471d9d5ad9e9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: 333a253e-8804-4171-8e84-aabbdb54a345] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:47.636800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46caead2-8a8d-42ce-b8d0-471d9d5ad9e9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:47.637277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46caead2-8a8d-42ce-b8d0-471d9d5ad9e9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:47.637764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46caead2-8a8d-42ce-b8d0-471d9d5ad9e9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:47.638501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46caead2-8a8d-42ce-b8d0-471d9d5ad9e9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:47.638962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46caead2-8a8d-42ce-b8d0-471d9d5ad9e9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:47.639395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46caead2-8a8d-42ce-b8d0-471d9d5ad9e9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:47.672118 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-46caead2-8a8d-42ce-b8d0-471d9d5ad9e9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] HTTP exception thrown: Instance 333a253e-8804-4171-8e84-aabbdb54a345 could not be found. Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-46caead2-8a8d-42ce-b8d0-471d9d5ad9e9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Request method failure captured: Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/333a253e-8804-4171-8e84-aabbdb54a345 HTTP/1.1 Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJSE5qt3MMvCiXM6JMYUN7f1buxIi7ST_NSWH8b3Iy1XPUp8KO4zG-NXQgWVN1Z7GE3sHXszWiKCVOYqqXwQROrdr4ZEFwz_8XPZaHXiJBQID0HYLx7sZ_BMJTKC5v-6tuUaVizJ_CnloOe2V1xTk5bkZGekyl16F75E8fKcPIskPJo Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestJSON-553840835 Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersTestJSON-553840835-project Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6ac786dc6d7847f582262dcd912c3f06 Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestJSON-553840835-project Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 333a253e-8804-4171-8e84-aabbdb54a345 could not be found. Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '333a253e-8804-4171-8e84-aabbdb54a345'} Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 333a253e-8804-4171-8e84-aabbdb54a345 could not be found. Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 333a253e-8804-4171-8e84-aabbdb54a345 could not be found. Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.675142 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:47.683429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:47.683429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:47.683429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:47.683429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:47.683429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 333a253e-8804-4171-8e84-aabbdb54a345 could not be found. Sep 07 12:59:47.683429 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:47.683429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-46caead2-8a8d-42ce-b8d0-471d9d5ad9e9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Returning 404 to user: Instance 333a253e-8804-4171-8e84-aabbdb54a345 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:47.683429 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-46caead2-8a8d-42ce-b8d0-471d9d5ad9e9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/333a253e-8804-4171-8e84-aabbdb54a345" status: 404 len: 111 microversion: 2.1 time: 0.057118 Sep 07 12:59:47.701060 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2671/5394] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:47 2022] GET /compute/v2.1/servers/333a253e-8804-4171-8e84-aabbdb54a345 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 12:59:47.719783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ba2c77a-2b4d-4880-b331-374e92b78c94 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:47.725440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6ba2c77a-2b4d-4880-b331-374e92b78c94 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: d2cbb4b8-d0fd-4230-8370-cedded0a7a16] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:47.738715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ba2c77a-2b4d-4880-b331-374e92b78c94 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:47.739954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ba2c77a-2b4d-4880-b331-374e92b78c94 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:47.745638 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ba2c77a-2b4d-4880-b331-374e92b78c94 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:47.746454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ba2c77a-2b4d-4880-b331-374e92b78c94 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:47.748408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ba2c77a-2b4d-4880-b331-374e92b78c94 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:47.748771 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ba2c77a-2b4d-4880-b331-374e92b78c94 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:47.834387 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6ba2c77a-2b4d-4880-b331-374e92b78c94 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: d2cbb4b8-d0fd-4230-8370-cedded0a7a16] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:59:48.108418 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6ba2c77a-2b4d-4880-b331-374e92b78c94 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16" status: 204 len: 0 microversion: 2.1 time: 0.401810 Sep 07 12:59:48.111046 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2672/5395] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:59:47 2022] DELETE /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:48.128848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-73492774-8a24-4dca-8b9c-cc5bb4feab90 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:48.131910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-73492774-8a24-4dca-8b9c-cc5bb4feab90 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: d2cbb4b8-d0fd-4230-8370-cedded0a7a16] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:48.156426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73492774-8a24-4dca-8b9c-cc5bb4feab90 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:48.160563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73492774-8a24-4dca-8b9c-cc5bb4feab90 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:48.161398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73492774-8a24-4dca-8b9c-cc5bb4feab90 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:48.163062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73492774-8a24-4dca-8b9c-cc5bb4feab90 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:48.166618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73492774-8a24-4dca-8b9c-cc5bb4feab90 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:48.167909 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73492774-8a24-4dca-8b9c-cc5bb4feab90 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:48.328430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2171eca5-e435-41c0-a80a-cbf607757964 tempest-ExtensionsTest-1162521983 tempest-ExtensionsTest-1162521983-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:48.330251 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2171eca5-e435-41c0-a80a-cbf607757964 tempest-ExtensionsTest-1162521983 tempest-ExtensionsTest-1162521983-project] 10.222.0.16 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.757349 Sep 07 12:59:48.335808 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2724/5396] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Sep 7 12:59:47 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:59:48.346825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-378d15ae-f124-4265-af60-a0804fe60664 tempest-ExtensionsTest-1162521983 tempest-ExtensionsTest-1162521983-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:48.358007 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-378d15ae-f124-4265-af60-a0804fe60664 tempest-ExtensionsTest-1162521983 tempest-ExtensionsTest-1162521983-project] 10.222.0.16 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.020762 Sep 07 12:59:48.358596 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2725/5397] 10.222.0.16 () {58 vars in 1134 bytes} [Wed Sep 7 12:59:48 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 12:59:48.595173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-73492774-8a24-4dca-8b9c-cc5bb4feab90 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:48.609320 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-73492774-8a24-4dca-8b9c-cc5bb4feab90 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16" status: 200 len: 1480 microversion: 2.1 time: 0.492455 Sep 07 12:59:48.613812 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2673/5398] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:48 2022] GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16 => generated 1480 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:59:49.652310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ff0ce6f7-f896-4509-8b7e-518bd9d76a6c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:49.653768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ff0ce6f7-f896-4509-8b7e-518bd9d76a6c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: d2cbb4b8-d0fd-4230-8370-cedded0a7a16] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:49.668804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff0ce6f7-f896-4509-8b7e-518bd9d76a6c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:49.673080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff0ce6f7-f896-4509-8b7e-518bd9d76a6c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:49.673881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff0ce6f7-f896-4509-8b7e-518bd9d76a6c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:49.679907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff0ce6f7-f896-4509-8b7e-518bd9d76a6c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:49.680723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff0ce6f7-f896-4509-8b7e-518bd9d76a6c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:49.681519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff0ce6f7-f896-4509-8b7e-518bd9d76a6c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:50.900832 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ff0ce6f7-f896-4509-8b7e-518bd9d76a6c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:50.920031 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ff0ce6f7-f896-4509-8b7e-518bd9d76a6c tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16" status: 200 len: 1480 microversion: 2.1 time: 1.272392 Sep 07 12:59:50.921630 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2726/5399] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:49 2022] GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16 => generated 1480 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:51.947304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-50df9294-5f2d-4f17-a13c-c2655ec5a581 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:51.948015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-50df9294-5f2d-4f17-a13c-c2655ec5a581 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: d2cbb4b8-d0fd-4230-8370-cedded0a7a16] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:51.972219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50df9294-5f2d-4f17-a13c-c2655ec5a581 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:51.973369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50df9294-5f2d-4f17-a13c-c2655ec5a581 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:51.977042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50df9294-5f2d-4f17-a13c-c2655ec5a581 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:51.981440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50df9294-5f2d-4f17-a13c-c2655ec5a581 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:51.984853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50df9294-5f2d-4f17-a13c-c2655ec5a581 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:51.987304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50df9294-5f2d-4f17-a13c-c2655ec5a581 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:52.422016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-14ffd6e3-7940-4cc7-aba2-c199770e9f4a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:52.429339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-14ffd6e3-7940-4cc7-aba2-c199770e9f4a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:52.472688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ffd6e3-7940-4cc7-aba2-c199770e9f4a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:52.480837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ffd6e3-7940-4cc7-aba2-c199770e9f4a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:52.483694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ffd6e3-7940-4cc7-aba2-c199770e9f4a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:52.488650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ffd6e3-7940-4cc7-aba2-c199770e9f4a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:52.489838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ffd6e3-7940-4cc7-aba2-c199770e9f4a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:52.492327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ffd6e3-7940-4cc7-aba2-c199770e9f4a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:52.656266 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-14ffd6e3-7940-4cc7-aba2-c199770e9f4a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.236439 Sep 07 12:59:52.663547 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2727/5400] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 12:59:52 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef/os-volume_attachments => generated 25 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 12:59:52.843950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4b8c374d-7e5a-43f2-872d-db421dbb53e0 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:52.845463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4b8c374d-7e5a-43f2-872d-db421dbb53e0 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:52.864700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b8c374d-7e5a-43f2-872d-db421dbb53e0 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:52.866752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b8c374d-7e5a-43f2-872d-db421dbb53e0 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:52.867684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b8c374d-7e5a-43f2-872d-db421dbb53e0 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:52.869293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b8c374d-7e5a-43f2-872d-db421dbb53e0 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:52.870494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b8c374d-7e5a-43f2-872d-db421dbb53e0 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:52.874999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b8c374d-7e5a-43f2-872d-db421dbb53e0 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:53.037193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4b8c374d-7e5a-43f2-872d-db421dbb53e0 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 12:59:53.132376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:53.198549 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-50df9294-5f2d-4f17-a13c-c2655ec5a581 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:53.231359 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-50df9294-5f2d-4f17-a13c-c2655ec5a581 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16" status: 200 len: 1480 microversion: 2.1 time: 1.287225 Sep 07 12:59:53.236680 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2674/5401] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:51 2022] GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16 => generated 1480 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:53.426273 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4b8c374d-7e5a-43f2-872d-db421dbb53e0 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 204 len: 0 microversion: 2.1 time: 0.588351 Sep 07 12:59:53.450624 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fda96ee1-b507-416b-b1b3-aa20cdeeaf52 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:53.451393 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2728/5402] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 12:59:52 2022] DELETE /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 0 bytes in 597 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 12:59:53.452361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fda96ee1-b507-416b-b1b3-aa20cdeeaf52 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:53.479227 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fda96ee1-b507-416b-b1b3-aa20cdeeaf52 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:53.482705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fda96ee1-b507-416b-b1b3-aa20cdeeaf52 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:53.483403 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fda96ee1-b507-416b-b1b3-aa20cdeeaf52 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:53.485018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fda96ee1-b507-416b-b1b3-aa20cdeeaf52 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:53.486977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fda96ee1-b507-416b-b1b3-aa20cdeeaf52 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:53.491509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fda96ee1-b507-416b-b1b3-aa20cdeeaf52 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:54.275009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae76d331-8a92-42e9-b424-b4a152b910f9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:54.276356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ae76d331-8a92-42e9-b424-b4a152b910f9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: d2cbb4b8-d0fd-4230-8370-cedded0a7a16] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:54.292249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae76d331-8a92-42e9-b424-b4a152b910f9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:54.297193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae76d331-8a92-42e9-b424-b4a152b910f9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:54.299312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae76d331-8a92-42e9-b424-b4a152b910f9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:54.300425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae76d331-8a92-42e9-b424-b4a152b910f9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:54.303323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae76d331-8a92-42e9-b424-b4a152b910f9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:54.303877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae76d331-8a92-42e9-b424-b4a152b910f9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:54.714116 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ae76d331-8a92-42e9-b424-b4a152b910f9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:54.729467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fda96ee1-b507-416b-b1b3-aa20cdeeaf52 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:54.751985 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fda96ee1-b507-416b-b1b3-aa20cdeeaf52 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1674 microversion: 2.1 time: 1.313644 Sep 07 12:59:54.753014 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ae76d331-8a92-42e9-b424-b4a152b910f9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16" status: 200 len: 1438 microversion: 2.1 time: 0.481964 Sep 07 12:59:54.756170 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2675/5403] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:53 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1674 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:54.757113 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2729/5404] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:54 2022] GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16 => generated 1438 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:54.794617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9828adf1-22b3-4da8-be7b-7a29c4497088 req-9cd00274-2065-44dd-b994-438142568026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2cbb4b8-d0fd-4230-8370-cedded0a7a16", "name": "network-vif-deleted", "tag": "a705fc80-a97c-4539-bb7f-f53c8f00ce22"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:54.809023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:54.823798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9828adf1-22b3-4da8-be7b-7a29c4497088 req-9cd00274-2065-44dd-b994-438142568026 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:54.824373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9828adf1-22b3-4da8-be7b-7a29c4497088 req-9cd00274-2065-44dd-b994-438142568026 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:54.826228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9828adf1-22b3-4da8-be7b-7a29c4497088 req-9cd00274-2065-44dd-b994-438142568026 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:54.863476 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9828adf1-22b3-4da8-be7b-7a29c4497088 req-9cd00274-2065-44dd-b994-438142568026 service nova] Creating event network-vif-deleted:a705fc80-a97c-4539-bb7f-f53c8f00ce22 for instance d2cbb4b8-d0fd-4230-8370-cedded0a7a16 on n-h2-852087-9 Sep 07 12:59:54.877500 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9828adf1-22b3-4da8-be7b-7a29c4497088 req-9cd00274-2065-44dd-b994-438142568026 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086417 Sep 07 12:59:54.880683 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2676/5405] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 12:59:55.788338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d58ce371-293d-4c83-bdac-8ed6075db65d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:55.789136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d58ce371-293d-4c83-bdac-8ed6075db65d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:55.793254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92f359e2-6b24-417c-a2ac-160b2765500f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:55.794950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-92f359e2-6b24-417c-a2ac-160b2765500f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: d2cbb4b8-d0fd-4230-8370-cedded0a7a16] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:55.817194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d58ce371-293d-4c83-bdac-8ed6075db65d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:55.819889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92f359e2-6b24-417c-a2ac-160b2765500f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:55.822563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92f359e2-6b24-417c-a2ac-160b2765500f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:55.823517 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d58ce371-293d-4c83-bdac-8ed6075db65d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:55.824258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92f359e2-6b24-417c-a2ac-160b2765500f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:55.825328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d58ce371-293d-4c83-bdac-8ed6075db65d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:55.828534 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d58ce371-293d-4c83-bdac-8ed6075db65d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:55.829826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92f359e2-6b24-417c-a2ac-160b2765500f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:55.830528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d58ce371-293d-4c83-bdac-8ed6075db65d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:55.831295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92f359e2-6b24-417c-a2ac-160b2765500f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:55.831876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d58ce371-293d-4c83-bdac-8ed6075db65d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:55.832433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92f359e2-6b24-417c-a2ac-160b2765500f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:55.950361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92f359e2-6b24-417c-a2ac-160b2765500f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:55.951015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92f359e2-6b24-417c-a2ac-160b2765500f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:55.951482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92f359e2-6b24-417c-a2ac-160b2765500f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:55.953163 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-92f359e2-6b24-417c-a2ac-160b2765500f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lazy-loading 'fault' on Instance uuid d2cbb4b8-d0fd-4230-8370-cedded0a7a16 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 12:59:56.062632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-92f359e2-6b24-417c-a2ac-160b2765500f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac786dc6d7847f582262dcd912c3f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854c6a81bbfd4ab79126799ec40c954e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:56.082822 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-92f359e2-6b24-417c-a2ac-160b2765500f tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16" status: 200 len: 1282 microversion: 2.1 time: 0.301251 Sep 07 12:59:56.088747 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2677/5406] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:55 2022] GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16 => generated 1282 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:56.676418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d58ce371-293d-4c83-bdac-8ed6075db65d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:56.692522 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d58ce371-293d-4c83-bdac-8ed6075db65d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1674 microversion: 2.1 time: 0.914054 Sep 07 12:59:56.693798 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2730/5407] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:55 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1674 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 12:59:57.136684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-16f286a9-e59d-40a9-9216-335068ccc0c9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:57.139185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-16f286a9-e59d-40a9-9216-335068ccc0c9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] [instance: d2cbb4b8-d0fd-4230-8370-cedded0a7a16] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:57.169619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16f286a9-e59d-40a9-9216-335068ccc0c9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:57.172415 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16f286a9-e59d-40a9-9216-335068ccc0c9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:57.174969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16f286a9-e59d-40a9-9216-335068ccc0c9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:57.179046 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16f286a9-e59d-40a9-9216-335068ccc0c9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:57.180074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16f286a9-e59d-40a9-9216-335068ccc0c9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:57.184557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16f286a9-e59d-40a9-9216-335068ccc0c9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:57.242920 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-16f286a9-e59d-40a9-9216-335068ccc0c9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] HTTP exception thrown: Instance d2cbb4b8-d0fd-4230-8370-cedded0a7a16 could not be found. Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-16f286a9-e59d-40a9-9216-335068ccc0c9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Request method failure captured: Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16 HTTP/1.1 Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJSE5qt3MMvCiXM6JMYUN7f1buxIi7ST_NSWH8b3Iy1XPUp8KO4zG-NXQgWVN1Z7GE3sHXszWiKCVOYqqXwQROrdr4ZEFwz_8XPZaHXiJBQID0HYLx7sZ_BMJTKC5v-6tuUaVizJ_CnloOe2V1xTk5bkZGekyl16F75E8fKcPIskPJo Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/854c6a81bbfd4ab79126799ec40c954e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersTestJSON-553840835 Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 854c6a81bbfd4ab79126799ec40c954e Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersTestJSON-553840835 Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersTestJSON-553840835-project Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6ac786dc6d7847f582262dcd912c3f06 Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersTestJSON-553840835-project Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance d2cbb4b8-d0fd-4230-8370-cedded0a7a16 could not be found. Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'd2cbb4b8-d0fd-4230-8370-cedded0a7a16'} Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2cbb4b8-d0fd-4230-8370-cedded0a7a16 could not be found. Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2cbb4b8-d0fd-4230-8370-cedded0a7a16 could not be found. Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:57.256582 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:57.264653 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:57.264653 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:57.264653 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:57.264653 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:57.264653 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2cbb4b8-d0fd-4230-8370-cedded0a7a16 could not be found. Sep 07 12:59:57.264653 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:57.271074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-16f286a9-e59d-40a9-9216-335068ccc0c9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] Returning 404 to user: Instance d2cbb4b8-d0fd-4230-8370-cedded0a7a16 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:57.277232 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-16f286a9-e59d-40a9-9216-335068ccc0c9 tempest-ServersTestJSON-553840835 tempest-ServersTestJSON-553840835-project] 10.222.0.16 "GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16" status: 404 len: 111 microversion: 2.1 time: 0.151747 Sep 07 12:59:57.279437 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2678/5408] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:57 2022] GET /compute/v2.1/servers/d2cbb4b8-d0fd-4230-8370-cedded0a7a16 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:59:57.743316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-601f31fe-3d96-40c6-b697-c261193f1c64 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:57.744545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-601f31fe-3d96-40c6-b697-c261193f1c64 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 12:59:57.761647 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-601f31fe-3d96-40c6-b697-c261193f1c64 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:57.763943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-601f31fe-3d96-40c6-b697-c261193f1c64 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:57.765186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-601f31fe-3d96-40c6-b697-c261193f1c64 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:57.776706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-601f31fe-3d96-40c6-b697-c261193f1c64 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:57.791698 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-601f31fe-3d96-40c6-b697-c261193f1c64 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:57.799298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-601f31fe-3d96-40c6-b697-c261193f1c64 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:58.980379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-282ee9eb-ba8d-401e-ae54-fcc1dea50a93 tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] Action: 'create', calling method: .version_select at 0x7fc4139fcca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-864499185", "metadata": {"Type": "work"}}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-282ee9eb-ba8d-401e-ae54-fcc1dea50a93 tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] Request method failure captured: Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 121 Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJXOe0vxvG0KE9IcFsdycog_ClMnSjTVROlyv7J71kWAPoJkUUHiggsn6d0PE5yDnyjEYD61m32ap_6lik0yK_svNpZZva0DAHvXnBCR2l2r-Nb0xc94z80O71brip7MdbWJL1tX5V9RyQJ534yp7Ic52R0m1toNowvQaUqGiPUb034 Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 18da10180baa486bb7eb507c43adc7cb Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-VolumesNegativeTest-1606103981 Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18da10180baa486bb7eb507c43adc7cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_18da10180baa486bb7eb507c43adc7cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/18da10180baa486bb7eb507c43adc7cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18da10180baa486bb7eb507c43adc7cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-VolumesNegativeTest-1606103981 Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 18da10180baa486bb7eb507c43adc7cb Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-VolumesNegativeTest-1606103981 Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-VolumesNegativeTest-1606103981-project Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: fb18d7987116415980f6a90eb0e2f717 Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-VolumesNegativeTest-1606103981-project Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-864499185", "metadata": {"Type": "work"}}} Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-864499185', 'metadata': {'Type': 'work'}}}} Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi '#$%' Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:59:59.001086 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:59:59.015660 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 12:59:59.015660 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.015660 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:59.015660 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.015660 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:59.015660 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:59.015660 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:59.015660 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:59:59.015660 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:59:59.015660 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 12:59:59.015660 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.029926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-282ee9eb-ba8d-401e-ae54-fcc1dea50a93 tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:59.032367 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-282ee9eb-ba8d-401e-ae54-fcc1dea50a93 tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.422856 Sep 07 12:59:59.047101 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2679/5409] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Sep 7 12:59:58 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 439 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:59:59.060812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-601f31fe-3d96-40c6-b697-c261193f1c64 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 12:59:59.071932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-31eeef8e-079f-474a-b6fe-784329628258 tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] Action: 'create', calling method: .version_select at 0x7fc4138e4160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1304537307", "metadata": {"Type": "work"}}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-31eeef8e-079f-474a-b6fe-784329628258 tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] Request method failure captured: Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 120 Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJXOe0vxvG0KE9IcFsdycog_ClMnSjTVROlyv7J71kWAPoJkUUHiggsn6d0PE5yDnyjEYD61m32ap_6lik0yK_svNpZZva0DAHvXnBCR2l2r-Nb0xc94z80O71brip7MdbWJL1tX5V9RyQJ534yp7Ic52R0m1toNowvQaUqGiPUb034 Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 18da10180baa486bb7eb507c43adc7cb Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-VolumesNegativeTest-1606103981 Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18da10180baa486bb7eb507c43adc7cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_18da10180baa486bb7eb507c43adc7cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/18da10180baa486bb7eb507c43adc7cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18da10180baa486bb7eb507c43adc7cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-VolumesNegativeTest-1606103981 Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 18da10180baa486bb7eb507c43adc7cb Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-VolumesNegativeTest-1606103981 Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-VolumesNegativeTest-1606103981-project Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: fb18d7987116415980f6a90eb0e2f717 Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-VolumesNegativeTest-1606103981-project Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1304537307", "metadata": {"Type": "work"}}} Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1304537307', 'metadata': {'Type': 'work'}}}} Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi '0' Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:59:59.084943 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:59:59.091899 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 12:59:59.091899 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.091899 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:59.091899 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.091899 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:59.091899 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:59.091899 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:59.091899 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:59:59.091899 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:59:59.091899 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 12:59:59.091899 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.095139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-31eeef8e-079f-474a-b6fe-784329628258 tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:59.096931 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-31eeef8e-079f-474a-b6fe-784329628258 tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.045949 Sep 07 12:59:59.098292 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2680/5410] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Sep 7 12:59:59 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:59:59.102116 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-601f31fe-3d96-40c6-b697-c261193f1c64 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1674 microversion: 2.1 time: 1.366699 Sep 07 12:59:59.106222 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2731/5411] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 12:59:57 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1674 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:59.112406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-907a40f1-7446-4e95-9ea2-b8fb475aede9 tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] Action: 'create', calling method: .version_select at 0x7fc41d195a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1213539458", "metadata": {"Type": "work"}}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-907a40f1-7446-4e95-9ea2-b8fb475aede9 tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] Request method failure captured: Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 119 Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJXOe0vxvG0KE9IcFsdycog_ClMnSjTVROlyv7J71kWAPoJkUUHiggsn6d0PE5yDnyjEYD61m32ap_6lik0yK_svNpZZva0DAHvXnBCR2l2r-Nb0xc94z80O71brip7MdbWJL1tX5V9RyQJ534yp7Ic52R0m1toNowvQaUqGiPUb034 Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 18da10180baa486bb7eb507c43adc7cb Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-VolumesNegativeTest-1606103981 Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18da10180baa486bb7eb507c43adc7cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_18da10180baa486bb7eb507c43adc7cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/18da10180baa486bb7eb507c43adc7cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18da10180baa486bb7eb507c43adc7cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-VolumesNegativeTest-1606103981 Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 18da10180baa486bb7eb507c43adc7cb Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-VolumesNegativeTest-1606103981 Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-VolumesNegativeTest-1606103981-project Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: fb18d7987116415980f6a90eb0e2f717 Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-VolumesNegativeTest-1606103981-project Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1213539458", "metadata": {"Type": "work"}}} Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1213539458', 'metadata': {'Type': 'work'}}}} Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise error Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi '' Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 12:59:59.120925 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 12:59:59.127835 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 12:59:59.127835 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.127835 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:59.127835 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.127835 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:59.127835 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:59.127835 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:59.127835 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 12:59:59.127835 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 12:59:59.127835 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 12:59:59.127835 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.127835 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-907a40f1-7446-4e95-9ea2-b8fb475aede9 tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:59.127835 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-907a40f1-7446-4e95-9ea2-b8fb475aede9 tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014736 Sep 07 12:59:59.136033 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2681/5412] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Sep 7 12:59:59 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 12:59:59.145020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ff756ac-65d9-4899-ab59-10e8f810f23b tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] Calling method '.version_select at 0x7fc41872a280>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:59.242720 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-3ff756ac-65d9-4899-ab59-10e8f810f23b tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] HTTP exception thrown: Volume tempest-invalid-395168307 could not be found. Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ff756ac-65d9-4899-ab59-10e8f810f23b tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] Request method failure captured: Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-395168307 HTTP/1.1 Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJXOe0vxvG0KE9IcFsdycog_ClMnSjTVROlyv7J71kWAPoJkUUHiggsn6d0PE5yDnyjEYD61m32ap_6lik0yK_svNpZZva0DAHvXnBCR2l2r-Nb0xc94z80O71brip7MdbWJL1tX5V9RyQJ534yp7Ic52R0m1toNowvQaUqGiPUb034 Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 18da10180baa486bb7eb507c43adc7cb Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-VolumesNegativeTest-1606103981 Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18da10180baa486bb7eb507c43adc7cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_18da10180baa486bb7eb507c43adc7cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/18da10180baa486bb7eb507c43adc7cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18da10180baa486bb7eb507c43adc7cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-VolumesNegativeTest-1606103981 Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 18da10180baa486bb7eb507c43adc7cb Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-VolumesNegativeTest-1606103981 Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-VolumesNegativeTest-1606103981-project Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: fb18d7987116415980f6a90eb0e2f717 Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-VolumesNegativeTest-1606103981-project Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: exception: Volume tempest-invalid-395168307 could not be found. Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'tempest-invalid-395168307'} Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-395168307 could not be found. (HTTP 404) (Request-ID: req-59e043b5-9fb9-4889-9a64-befe59ce9545) Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 12:59:59.244910 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-395168307 could not be found. Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-395168307 could not be found. Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-395168307 could not be found. Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ff756ac-65d9-4899-ab59-10e8f810f23b tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] Returning 404 to user: Volume tempest-invalid-395168307 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:59.255584 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ff756ac-65d9-4899-ab59-10e8f810f23b tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-395168307" status: 404 len: 98 microversion: 2.1 time: 0.115478 Sep 07 12:59:59.265546 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-01e01f9d-3715-44d8-bf10-e7b77e96cc50 tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003985 Sep 07 12:59:59.274156 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2682/5413] 10.222.0.16 () {58 vars in 1140 bytes} [Wed Sep 7 12:59:59 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 07 12:59:59.279404 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dbdfea25-6455-4637-9528-90426332da91 tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003980 Sep 07 12:59:59.286260 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2732/5414] 10.222.0.16 () {58 vars in 1215 bytes} [Wed Sep 7 12:59:59 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-395168307 => generated 98 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 12:59:59.291414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6655706a-c261-416c-9c03-844d5a43e141 tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] Calling method '.version_select at 0x7fc413f32dc0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:59.298594 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2683/5415] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Sep 7 12:59:59 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 07 12:59:59.370335 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-6655706a-c261-416c-9c03-844d5a43e141 tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] HTTP exception thrown: Volume 717f977f-8330-470d-b801-a90272734b72 could not be found. Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6655706a-c261-416c-9c03-844d5a43e141 tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] Request method failure captured: Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-volumes/717f977f-8330-470d-b801-a90272734b72 HTTP/1.1 Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJXOe0vxvG0KE9IcFsdycog_ClMnSjTVROlyv7J71kWAPoJkUUHiggsn6d0PE5yDnyjEYD61m32ap_6lik0yK_svNpZZva0DAHvXnBCR2l2r-Nb0xc94z80O71brip7MdbWJL1tX5V9RyQJ534yp7Ic52R0m1toNowvQaUqGiPUb034 Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 18da10180baa486bb7eb507c43adc7cb Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-VolumesNegativeTest-1606103981 Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18da10180baa486bb7eb507c43adc7cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_18da10180baa486bb7eb507c43adc7cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/18da10180baa486bb7eb507c43adc7cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18da10180baa486bb7eb507c43adc7cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-VolumesNegativeTest-1606103981 Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 18da10180baa486bb7eb507c43adc7cb Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-VolumesNegativeTest-1606103981 Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-VolumesNegativeTest-1606103981-project Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: fb18d7987116415980f6a90eb0e2f717 Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-VolumesNegativeTest-1606103981-project Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: exception: Volume 717f977f-8330-470d-b801-a90272734b72 could not be found. Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '717f977f-8330-470d-b801-a90272734b72'} Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 717f977f-8330-470d-b801-a90272734b72 could not be found. (HTTP 404) (Request-ID: req-4eaf4f61-33eb-4851-95cd-d73b6e449147) Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 12:59:59.372750 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 717f977f-8330-470d-b801-a90272734b72 could not be found. Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 717f977f-8330-470d-b801-a90272734b72 could not be found. Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 717f977f-8330-470d-b801-a90272734b72 could not be found. Sep 07 12:59:59.376786 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.381139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6655706a-c261-416c-9c03-844d5a43e141 tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] Returning 404 to user: Volume 717f977f-8330-470d-b801-a90272734b72 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:59.382427 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6655706a-c261-416c-9c03-844d5a43e141 tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/717f977f-8330-470d-b801-a90272734b72" status: 404 len: 109 microversion: 2.1 time: 0.095042 Sep 07 12:59:59.383329 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2733/5416] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Sep 7 12:59:59 2022] DELETE /compute/v2.1/os-volumes/717f977f-8330-470d-b801-a90272734b72 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:59:59.395453 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cd4c1f97-e79f-495d-ba53-ad3b2676627b tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] Calling method '.version_select at 0x7fc41d1884c0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 12:59:59.471685 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-cd4c1f97-e79f-495d-ba53-ad3b2676627b tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] HTTP exception thrown: Volume 505fc1db-71e7-4d7c-8f67-14e078fc73ac could not be found. Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cd4c1f97-e79f-495d-ba53-ad3b2676627b tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] Request method failure captured: Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-volumes/505fc1db-71e7-4d7c-8f67-14e078fc73ac HTTP/1.1 Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJXOe0vxvG0KE9IcFsdycog_ClMnSjTVROlyv7J71kWAPoJkUUHiggsn6d0PE5yDnyjEYD61m32ap_6lik0yK_svNpZZva0DAHvXnBCR2l2r-Nb0xc94z80O71brip7MdbWJL1tX5V9RyQJ534yp7Ic52R0m1toNowvQaUqGiPUb034 Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 18da10180baa486bb7eb507c43adc7cb Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-VolumesNegativeTest-1606103981 Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18da10180baa486bb7eb507c43adc7cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_18da10180baa486bb7eb507c43adc7cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/18da10180baa486bb7eb507c43adc7cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18da10180baa486bb7eb507c43adc7cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-VolumesNegativeTest-1606103981 Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 18da10180baa486bb7eb507c43adc7cb Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-VolumesNegativeTest-1606103981 Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-VolumesNegativeTest-1606103981-project Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: fb18d7987116415980f6a90eb0e2f717 Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-VolumesNegativeTest-1606103981-project Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: exception: Volume 505fc1db-71e7-4d7c-8f67-14e078fc73ac could not be found. Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '505fc1db-71e7-4d7c-8f67-14e078fc73ac'} Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 505fc1db-71e7-4d7c-8f67-14e078fc73ac could not be found. (HTTP 404) (Request-ID: req-9bbf024c-7225-4e54-a608-fdebe3bc0186) Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 12:59:59.473869 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 505fc1db-71e7-4d7c-8f67-14e078fc73ac could not be found. Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 505fc1db-71e7-4d7c-8f67-14e078fc73ac could not be found. Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 505fc1db-71e7-4d7c-8f67-14e078fc73ac could not be found. Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cd4c1f97-e79f-495d-ba53-ad3b2676627b tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] Returning 404 to user: Volume 505fc1db-71e7-4d7c-8f67-14e078fc73ac could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 12:59:59.483296 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cd4c1f97-e79f-495d-ba53-ad3b2676627b tempest-VolumesNegativeTest-1606103981 tempest-VolumesNegativeTest-1606103981-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/505fc1db-71e7-4d7c-8f67-14e078fc73ac" status: 404 len: 109 microversion: 2.1 time: 0.086107 Sep 07 12:59:59.496164 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2684/5417] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Sep 7 12:59:59 2022] GET /compute/v2.1/os-volumes/505fc1db-71e7-4d7c-8f67-14e078fc73ac => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 12:59:59.798279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-b340604b-77e3-416a-a20f-99a7e583de91 req-5386dcf5-b5c3-4134-8b07-3bed8cbf9492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37444bc-ff3d-40dd-8501-7b8794d8b1ef", "name": "network-vif-deleted", "tag": "f71d91c1-fd88-4617-a671-95e43e01a47c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 12:59:59.844701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b340604b-77e3-416a-a20f-99a7e583de91 req-5386dcf5-b5c3-4134-8b07-3bed8cbf9492 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 12:59:59.845290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b340604b-77e3-416a-a20f-99a7e583de91 req-5386dcf5-b5c3-4134-8b07-3bed8cbf9492 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 12:59:59.845672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b340604b-77e3-416a-a20f-99a7e583de91 req-5386dcf5-b5c3-4134-8b07-3bed8cbf9492 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 12:59:59.879364 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-b340604b-77e3-416a-a20f-99a7e583de91 req-5386dcf5-b5c3-4134-8b07-3bed8cbf9492 service nova] Creating event network-vif-deleted:f71d91c1-fd88-4617-a671-95e43e01a47c for instance f37444bc-ff3d-40dd-8501-7b8794d8b1ef on n-h2-852087-9 Sep 07 12:59:59.895852 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-b340604b-77e3-416a-a20f-99a7e583de91 req-5386dcf5-b5c3-4134-8b07-3bed8cbf9492 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111297 Sep 07 12:59:59.897467 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2734/5418] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 12:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:00:00.144456 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-81143ebf-0df8-4676-aef7-7ba9f1e8bc54 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:00.145879 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-81143ebf-0df8-4676-aef7-7ba9f1e8bc54 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:00.172665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81143ebf-0df8-4676-aef7-7ba9f1e8bc54 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:00.175061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81143ebf-0df8-4676-aef7-7ba9f1e8bc54 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:00.176555 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81143ebf-0df8-4676-aef7-7ba9f1e8bc54 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:00.179041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81143ebf-0df8-4676-aef7-7ba9f1e8bc54 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:00.190379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81143ebf-0df8-4676-aef7-7ba9f1e8bc54 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:00.192473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81143ebf-0df8-4676-aef7-7ba9f1e8bc54 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:00.264777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81143ebf-0df8-4676-aef7-7ba9f1e8bc54 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:00.266516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81143ebf-0df8-4676-aef7-7ba9f1e8bc54 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:00.268614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81143ebf-0df8-4676-aef7-7ba9f1e8bc54 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:00.269545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-81143ebf-0df8-4676-aef7-7ba9f1e8bc54 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lazy-loading 'fault' on Instance uuid f37444bc-ff3d-40dd-8501-7b8794d8b1ef {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:00:00.349005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-81143ebf-0df8-4676-aef7-7ba9f1e8bc54 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:00.363389 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-81143ebf-0df8-4676-aef7-7ba9f1e8bc54 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 200 len: 1326 microversion: 2.1 time: 0.224493 Sep 07 13:00:00.368765 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2685/5419] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:00:00 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 1326 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:00:01.394811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec4d38ba-519d-42e8-a042-3cde8f64512e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:01.395581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ec4d38ba-519d-42e8-a042-3cde8f64512e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:01.415963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec4d38ba-519d-42e8-a042-3cde8f64512e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:01.416942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec4d38ba-519d-42e8-a042-3cde8f64512e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:01.417416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec4d38ba-519d-42e8-a042-3cde8f64512e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:01.418210 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec4d38ba-519d-42e8-a042-3cde8f64512e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:01.418690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec4d38ba-519d-42e8-a042-3cde8f64512e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:01.419127 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec4d38ba-519d-42e8-a042-3cde8f64512e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:01.472345 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-ec4d38ba-519d-42e8-a042-3cde8f64512e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] HTTP exception thrown: Instance f37444bc-ff3d-40dd-8501-7b8794d8b1ef could not be found. Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec4d38ba-519d-42e8-a042-3cde8f64512e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Request method failure captured: Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef HTTP/1.1 Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJSwrdCTJZT039O4ZFBiDNF-9lnSNJ5qqRLPDE3jJHhPAuZ6xSXr3ekQWDw7lgbDe8omv1w6tBQ6o27AyuoefCVq-QB4sZnxss5gbNHXOE8Em7Af2Hrzho9qF1EQDE_ezya2iFFwxu4aUR8xxgpI_a9J5V4s0T2xCMenjg2QkpA5JNY Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 059d18cef73a40b49cb707c7838973a9 Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AttachVolumeTestJSON-483833901 Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/059d18cef73a40b49cb707c7838973a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_059d18cef73a40b49cb707c7838973a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/059d18cef73a40b49cb707c7838973a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/059d18cef73a40b49cb707c7838973a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AttachVolumeTestJSON-483833901 Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 059d18cef73a40b49cb707c7838973a9 Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AttachVolumeTestJSON-483833901 Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AttachVolumeTestJSON-483833901-project Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 384329dd16dd48a1af7f197c71af2f4c Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AttachVolumeTestJSON-483833901-project Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance f37444bc-ff3d-40dd-8501-7b8794d8b1ef could not be found. Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'f37444bc-ff3d-40dd-8501-7b8794d8b1ef'} Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f37444bc-ff3d-40dd-8501-7b8794d8b1ef could not be found. Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f37444bc-ff3d-40dd-8501-7b8794d8b1ef could not be found. Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:00:01.477621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:00:01.482015 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:00:01.482015 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:00:01.482015 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:00:01.482015 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:00:01.482015 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:00:01.482015 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f37444bc-ff3d-40dd-8501-7b8794d8b1ef could not be found. Sep 07 13:00:01.482015 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:00:01.487227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec4d38ba-519d-42e8-a042-3cde8f64512e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Returning 404 to user: Instance f37444bc-ff3d-40dd-8501-7b8794d8b1ef could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:00:01.490292 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ec4d38ba-519d-42e8-a042-3cde8f64512e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 404 len: 111 microversion: 2.1 time: 0.099783 Sep 07 13:00:01.503887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0c83da36-e97c-4a9f-95af-27cf13095044 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '.version_select at 0x7fc41d1885e0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:01.512795 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2735/5420] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:00:01 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:00:01.551466 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0c83da36-e97c-4a9f-95af-27cf13095044 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-188964110" status: 202 len: 0 microversion: 2.1 time: 0.051304 Sep 07 13:00:01.557926 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2686/5421] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Sep 7 13:00:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-188964110 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:00:04.153463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3fb1224-cb5c-4eee-bb99-d0f934ae48f0 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Action: 'create', calling method: .version_select at 0x7fc413ecc790>, body: {"keypair": {"name": "tempest-keypair-2098577368", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtwSvtdcMrLrSiFPoCRp7RMnqnotyl7HtuFloQiksJ16DANBeOMIXRMK8faQwHExxyj3qngEMBEcmhe91EzI6EzogTzbqbILU2lXeSLc973tmquVXHJxCwW+OxnYE/XTg=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:00:04.177996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-d3fb1224-cb5c-4eee-bb99-d0f934ae48f0 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Getting quotas for project 059d18cef73a40b49cb707c7838973a9. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:00:04.184793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-d3fb1224-cb5c-4eee-bb99-d0f934ae48f0 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Getting quotas for user 384329dd16dd48a1af7f197c71af2f4c and project 059d18cef73a40b49cb707c7838973a9. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:00:04.236088 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d3fb1224-cb5c-4eee-bb99-d0f934ae48f0 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.088884 Sep 07 13:00:04.251394 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2736/5422] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 13:00:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:00:13.511173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:13.514111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:13.547179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1df077d9-363c-4266-856f-c8b8ac8ff88a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1047229254", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6de05969-ecdd-4737-b986-07da50b5eaf7"}], "security_groups": [{"name": "tempest-securitygroup--1330655323"}], "key_name": "tempest-keypair-2098577368", "user_data": "}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:00:14.217251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-1df077d9-363c-4266-856f-c8b8ac8ff88a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] validate_networks() for [('6de05969-ecdd-4737-b986-07da50b5eaf7', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:00:17.919878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-1df077d9-363c-4266-856f-c8b8ac8ff88a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:00:17.920813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-1df077d9-363c-4266-856f-c8b8ac8ff88a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:00:17.921885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-1df077d9-363c-4266-856f-c8b8ac8ff88a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:00:17.922779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-1df077d9-363c-4266-856f-c8b8ac8ff88a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:00:17.924967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-1df077d9-363c-4266-856f-c8b8ac8ff88a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:00:17.975629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1df077d9-363c-4266-856f-c8b8ac8ff88a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:17.976258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1df077d9-363c-4266-856f-c8b8ac8ff88a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:17.977218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1df077d9-363c-4266-856f-c8b8ac8ff88a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:17.980953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1df077d9-363c-4266-856f-c8b8ac8ff88a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:17.982541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1df077d9-363c-4266-856f-c8b8ac8ff88a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:17.988178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1df077d9-363c-4266-856f-c8b8ac8ff88a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:18.064313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-1df077d9-363c-4266-856f-c8b8ac8ff88a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Getting quotas for project 059d18cef73a40b49cb707c7838973a9. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:00:18.080936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-1df077d9-363c-4266-856f-c8b8ac8ff88a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Getting quotas for user 384329dd16dd48a1af7f197c71af2f4c and project 059d18cef73a40b49cb707c7838973a9. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:00:18.122623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1df077d9-363c-4266-856f-c8b8ac8ff88a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:00:18.128166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1df077d9-363c-4266-856f-c8b8ac8ff88a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:00:18.347216 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1df077d9-363c-4266-856f-c8b8ac8ff88a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.837128 Sep 07 13:00:18.363765 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2687/5423] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:00:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 4857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:00:18.393794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-126f2c66-ab0c-44e6-bc2c-83a3adb1ce59 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:18.418264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-126f2c66-ab0c-44e6-bc2c-83a3adb1ce59 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:18.462375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:18.470227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:18.472835 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:18.685305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-126f2c66-ab0c-44e6-bc2c-83a3adb1ce59 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:18.713926 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-126f2c66-ab0c-44e6-bc2c-83a3adb1ce59 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c" status: 200 len: 1238 microversion: 2.1 time: 0.343161 Sep 07 13:00:18.728889 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2737/5424] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:00:18 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c => generated 1238 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:00:19.782811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-70b6d44b-8bc0-4f9e-8319-896c0b6642b6 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:19.784233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-70b6d44b-8bc0-4f9e-8319-896c0b6642b6 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:19.803403 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70b6d44b-8bc0-4f9e-8319-896c0b6642b6 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:19.804796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70b6d44b-8bc0-4f9e-8319-896c0b6642b6 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:19.805893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70b6d44b-8bc0-4f9e-8319-896c0b6642b6 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:19.808819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70b6d44b-8bc0-4f9e-8319-896c0b6642b6 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:19.809590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70b6d44b-8bc0-4f9e-8319-896c0b6642b6 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:19.811416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70b6d44b-8bc0-4f9e-8319-896c0b6642b6 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:20.447599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-70b6d44b-8bc0-4f9e-8319-896c0b6642b6 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:20.534530 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-70b6d44b-8bc0-4f9e-8319-896c0b6642b6 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c" status: 200 len: 1242 microversion: 2.1 time: 0.759444 Sep 07 13:00:20.549223 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2688/5425] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:00:19 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c => generated 1242 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:00:20.775157 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6a2ed001-800f-4017-ae84-c58647c11d57 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Action: 'create', calling method: .version_select at 0x7fc413eda430>, body: {"keypair": {"name": "tempest-keypair-1859603308", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUa0tY6r8MebwPVOS4/BF1Ko50HdS9yHEGelzgdLwy3qLn/YPmORJVrda3JBQ7wcPaza75h9tpmFkXtqNujayc0DVNUVHdypPEmE03xvut/4CobAaBu15xWgcx+HX4bHQ=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:00:20.822476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-6a2ed001-800f-4017-ae84-c58647c11d57 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Getting quotas for project cb9b61f78ca140c5870961647ff04cfe. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:00:20.836049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-6a2ed001-800f-4017-ae84-c58647c11d57 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Getting quotas for user c9f85a4002bd40eb8514aa91056c77d8 and project cb9b61f78ca140c5870961647ff04cfe. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:00:20.884060 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6a2ed001-800f-4017-ae84-c58647c11d57 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.999398 Sep 07 13:00:20.884849 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2738/5426] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 13:00:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:00:21.598313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7a6e5c0f-a48f-4d74-a013-365ad9774559 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:21.603003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7a6e5c0f-a48f-4d74-a013-365ad9774559 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:21.630986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a6e5c0f-a48f-4d74-a013-365ad9774559 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:21.633782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a6e5c0f-a48f-4d74-a013-365ad9774559 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:21.634948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a6e5c0f-a48f-4d74-a013-365ad9774559 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:21.640267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a6e5c0f-a48f-4d74-a013-365ad9774559 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:21.642760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a6e5c0f-a48f-4d74-a013-365ad9774559 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:21.644761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a6e5c0f-a48f-4d74-a013-365ad9774559 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:23.373099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7a6e5c0f-a48f-4d74-a013-365ad9774559 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:23.386363 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7a6e5c0f-a48f-4d74-a013-365ad9774559 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c" status: 200 len: 1296 microversion: 2.1 time: 1.796671 Sep 07 13:00:23.390570 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2689/5427] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:00:21 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c => generated 1296 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:00:24.442490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f6178dca-b3fa-42c7-bba9-1e410d328219 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:24.456767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f6178dca-b3fa-42c7-bba9-1e410d328219 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:24.468223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6178dca-b3fa-42c7-bba9-1e410d328219 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:24.468947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6178dca-b3fa-42c7-bba9-1e410d328219 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:24.470321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6178dca-b3fa-42c7-bba9-1e410d328219 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:24.472144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6178dca-b3fa-42c7-bba9-1e410d328219 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:24.473351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6178dca-b3fa-42c7-bba9-1e410d328219 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:24.474421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f6178dca-b3fa-42c7-bba9-1e410d328219 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:24.962979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f6178dca-b3fa-42c7-bba9-1e410d328219 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:25.001907 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f6178dca-b3fa-42c7-bba9-1e410d328219 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c" status: 200 len: 1296 microversion: 2.1 time: 0.571850 Sep 07 13:00:25.010704 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2739/5428] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:00:24 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c => generated 1296 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:00:25.357617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-177c21a7-b578-4e03-b1e7-d8d11615b914 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:25.377308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-177c21a7-b578-4e03-b1e7-d8d11615b914 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:25.403034 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-177c21a7-b578-4e03-b1e7-d8d11615b914 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:25.404446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-177c21a7-b578-4e03-b1e7-d8d11615b914 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:25.417187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-177c21a7-b578-4e03-b1e7-d8d11615b914 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:25.420598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-177c21a7-b578-4e03-b1e7-d8d11615b914 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:25.430913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-177c21a7-b578-4e03-b1e7-d8d11615b914 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:25.432082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-177c21a7-b578-4e03-b1e7-d8d11615b914 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:25.579467 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-177c21a7-b578-4e03-b1e7-d8d11615b914 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.233474 Sep 07 13:00:25.582987 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2690/5429] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Sep 7 13:00:25 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b/os-volume_attachments => generated 25 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:00:25.797248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a91e3cb-e868-41f3-ac3f-c1ab23d3e853 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:25.797861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4a91e3cb-e868-41f3-ac3f-c1ab23d3e853 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:25.832270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a91e3cb-e868-41f3-ac3f-c1ab23d3e853 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:25.832825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a91e3cb-e868-41f3-ac3f-c1ab23d3e853 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:25.838722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a91e3cb-e868-41f3-ac3f-c1ab23d3e853 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:25.842889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a91e3cb-e868-41f3-ac3f-c1ab23d3e853 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:25.845815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a91e3cb-e868-41f3-ac3f-c1ab23d3e853 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:25.846365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a91e3cb-e868-41f3-ac3f-c1ab23d3e853 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:26.017612 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4a91e3cb-e868-41f3-ac3f-c1ab23d3e853 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:00:26.068248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d4fb6069-b68b-4de7-87b8-97179b6ee420 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:26.078053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d4fb6069-b68b-4de7-87b8-97179b6ee420 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:26.101320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4fb6069-b68b-4de7-87b8-97179b6ee420 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:26.113862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4fb6069-b68b-4de7-87b8-97179b6ee420 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:26.115121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4fb6069-b68b-4de7-87b8-97179b6ee420 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:26.116756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4fb6069-b68b-4de7-87b8-97179b6ee420 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:26.118272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4fb6069-b68b-4de7-87b8-97179b6ee420 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:26.119467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4fb6069-b68b-4de7-87b8-97179b6ee420 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:26.534174 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4a91e3cb-e868-41f3-ac3f-c1ab23d3e853 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "DELETE /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 204 len: 0 microversion: 2.20 time: 0.741732 Sep 07 13:00:26.536179 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2740/5430] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 13:00:25 2022] DELETE /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 0 bytes in 750 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 13:00:26.932367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d4fb6069-b68b-4de7-87b8-97179b6ee420 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:26.990045 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d4fb6069-b68b-4de7-87b8-97179b6ee420 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c" status: 200 len: 1364 microversion: 2.1 time: 0.952184 Sep 07 13:00:27.006020 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2691/5431] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:00:26 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c => generated 1364 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:00:27.043933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5fc34dd5-fe23-40bb-b109-4e4177e7a238 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:27.060647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5fc34dd5-fe23-40bb-b109-4e4177e7a238 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:27.124658 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fc34dd5-fe23-40bb-b109-4e4177e7a238 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:27.130355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fc34dd5-fe23-40bb-b109-4e4177e7a238 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:27.131712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fc34dd5-fe23-40bb-b109-4e4177e7a238 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:27.134817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fc34dd5-fe23-40bb-b109-4e4177e7a238 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:27.140051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fc34dd5-fe23-40bb-b109-4e4177e7a238 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:27.142911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fc34dd5-fe23-40bb-b109-4e4177e7a238 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:27.305279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-04e107cf-3f92-4bb0-922e-c2974df45fc7 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1507368521", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": "none"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:00:27.547494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-04e107cf-3f92-4bb0-922e-c2974df45fc7 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:00:27.549524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-04e107cf-3f92-4bb0-922e-c2974df45fc7 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:00:27.552552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-04e107cf-3f92-4bb0-922e-c2974df45fc7 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:00:27.553931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-04e107cf-3f92-4bb0-922e-c2974df45fc7 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:00:27.555754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-04e107cf-3f92-4bb0-922e-c2974df45fc7 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:00:27.588193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04e107cf-3f92-4bb0-922e-c2974df45fc7 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:27.591778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04e107cf-3f92-4bb0-922e-c2974df45fc7 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:27.594895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04e107cf-3f92-4bb0-922e-c2974df45fc7 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:27.598679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04e107cf-3f92-4bb0-922e-c2974df45fc7 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:27.613563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04e107cf-3f92-4bb0-922e-c2974df45fc7 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:27.615168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04e107cf-3f92-4bb0-922e-c2974df45fc7 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:27.671328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-04e107cf-3f92-4bb0-922e-c2974df45fc7 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Getting quotas for project ba08766ddf2d4a01b95b3e54a734bd78. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:00:27.687319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-04e107cf-3f92-4bb0-922e-c2974df45fc7 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Getting quotas for user ceff9982dde545f08aa7a57cc48775cf and project ba08766ddf2d4a01b95b3e54a734bd78. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:00:27.727477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-04e107cf-3f92-4bb0-922e-c2974df45fc7 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:00:27.744579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-04e107cf-3f92-4bb0-922e-c2974df45fc7 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:00:28.039151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:28.100417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:28.199538 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-04e107cf-3f92-4bb0-922e-c2974df45fc7 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 1.660805 Sep 07 13:00:28.200685 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2741/5432] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Sep 7 13:00:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1664 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 13:00:28.233818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5fc34dd5-fe23-40bb-b109-4e4177e7a238 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:28.234878 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-260ddfc5-b89f-4bc0-ba0b-36bbed69599f tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:28.235991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-260ddfc5-b89f-4bc0-ba0b-36bbed69599f tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:28.269308 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-260ddfc5-b89f-4bc0-ba0b-36bbed69599f tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:28.280884 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-260ddfc5-b89f-4bc0-ba0b-36bbed69599f tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:28.286594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-260ddfc5-b89f-4bc0-ba0b-36bbed69599f tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:28.293067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-260ddfc5-b89f-4bc0-ba0b-36bbed69599f tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:28.295469 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5fc34dd5-fe23-40bb-b109-4e4177e7a238 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:28.298171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-260ddfc5-b89f-4bc0-ba0b-36bbed69599f tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:28.298747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5fc34dd5-fe23-40bb-b109-4e4177e7a238 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:28.300877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-260ddfc5-b89f-4bc0-ba0b-36bbed69599f tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:28.313062 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5fc34dd5-fe23-40bb-b109-4e4177e7a238 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1721 microversion: 2.20 time: 1.304531 Sep 07 13:00:28.316509 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2692/5433] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:00:27 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1721 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:00:28.349472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-41f412e2-5ee0-4f7c-ab54-37c6eb22a6b6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:28.361414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-41f412e2-5ee0-4f7c-ab54-37c6eb22a6b6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:29.489401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-41f412e2-5ee0-4f7c-ab54-37c6eb22a6b6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:29.519362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-41f412e2-5ee0-4f7c-ab54-37c6eb22a6b6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:29.536160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-41f412e2-5ee0-4f7c-ab54-37c6eb22a6b6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:29.544597 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-41f412e2-5ee0-4f7c-ab54-37c6eb22a6b6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1278 microversion: 2.54 time: 1.225640 Sep 07 13:00:29.570163 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2693/5434] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:00:28 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1278 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:00:29.611353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-34d14a4a-def2-4942-bfeb-0146ca905ca2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:29.612430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-34d14a4a-def2-4942-bfeb-0146ca905ca2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:29.656798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34d14a4a-def2-4942-bfeb-0146ca905ca2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:29.657785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34d14a4a-def2-4942-bfeb-0146ca905ca2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:29.661250 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34d14a4a-def2-4942-bfeb-0146ca905ca2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:29.673399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34d14a4a-def2-4942-bfeb-0146ca905ca2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:29.687830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34d14a4a-def2-4942-bfeb-0146ca905ca2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:29.689373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34d14a4a-def2-4942-bfeb-0146ca905ca2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:30.079635 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-260ddfc5-b89f-4bc0-ba0b-36bbed69599f tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:30.114384 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-260ddfc5-b89f-4bc0-ba0b-36bbed69599f tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c" status: 200 len: 1364 microversion: 2.1 time: 1.904167 Sep 07 13:00:30.119645 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2742/5435] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:00:28 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c => generated 1364 bytes in 1917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:00:30.612723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d5fd7e51-7ef4-4790-b23a-9804b771108c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:30.618634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d5fd7e51-7ef4-4790-b23a-9804b771108c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:30.663353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5fd7e51-7ef4-4790-b23a-9804b771108c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:30.667740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5fd7e51-7ef4-4790-b23a-9804b771108c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:30.676056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5fd7e51-7ef4-4790-b23a-9804b771108c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:30.678582 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5fd7e51-7ef4-4790-b23a-9804b771108c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:30.686230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5fd7e51-7ef4-4790-b23a-9804b771108c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:30.693117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5fd7e51-7ef4-4790-b23a-9804b771108c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:30.902632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-34d14a4a-def2-4942-bfeb-0146ca905ca2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:30.971766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-34d14a4a-def2-4942-bfeb-0146ca905ca2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:30.993081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-34d14a4a-def2-4942-bfeb-0146ca905ca2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:30.998094 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-34d14a4a-def2-4942-bfeb-0146ca905ca2 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1721 microversion: 2.20 time: 1.425773 Sep 07 13:00:31.000132 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2694/5436] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:00:29 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1721 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:00:31.142036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d5fd7e51-7ef4-4790-b23a-9804b771108c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:31.151372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a9683018-7d50-450a-9bd4-d27bd61c39e8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:31.171747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a9683018-7d50-450a-9bd4-d27bd61c39e8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:31.193262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d5fd7e51-7ef4-4790-b23a-9804b771108c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:31.209073 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9683018-7d50-450a-9bd4-d27bd61c39e8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:31.209602 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d5fd7e51-7ef4-4790-b23a-9804b771108c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:31.213334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9683018-7d50-450a-9bd4-d27bd61c39e8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:31.217016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9683018-7d50-450a-9bd4-d27bd61c39e8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:31.218284 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d5fd7e51-7ef4-4790-b23a-9804b771108c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1330 microversion: 2.54 time: 0.615157 Sep 07 13:00:31.222109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9683018-7d50-450a-9bd4-d27bd61c39e8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:31.222800 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2743/5437] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:00:30 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1330 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:00:31.224181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9683018-7d50-450a-9bd4-d27bd61c39e8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:31.225254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9683018-7d50-450a-9bd4-d27bd61c39e8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:32.059800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e06ef7a7-4963-409e-bb9d-464b792dc166 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:32.067752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e06ef7a7-4963-409e-bb9d-464b792dc166 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:32.121027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e06ef7a7-4963-409e-bb9d-464b792dc166 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:32.121997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e06ef7a7-4963-409e-bb9d-464b792dc166 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:32.143538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e06ef7a7-4963-409e-bb9d-464b792dc166 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:32.148602 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e06ef7a7-4963-409e-bb9d-464b792dc166 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:32.153604 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e06ef7a7-4963-409e-bb9d-464b792dc166 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:32.162122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e06ef7a7-4963-409e-bb9d-464b792dc166 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:33.014283 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a9683018-7d50-450a-9bd4-d27bd61c39e8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:33.028378 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a9683018-7d50-450a-9bd4-d27bd61c39e8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c" status: 200 len: 1364 microversion: 2.1 time: 1.891465 Sep 07 13:00:33.043004 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2695/5438] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:00:31 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c => generated 1364 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:00:33.055960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8655ea3a-c774-40ee-af21-749ee1ca441c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:33.058928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8655ea3a-c774-40ee-af21-749ee1ca441c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:33.075387 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8655ea3a-c774-40ee-af21-749ee1ca441c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:33.076693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8655ea3a-c774-40ee-af21-749ee1ca441c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:33.078510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8655ea3a-c774-40ee-af21-749ee1ca441c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:33.079591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8655ea3a-c774-40ee-af21-749ee1ca441c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:33.083373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8655ea3a-c774-40ee-af21-749ee1ca441c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:33.084189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8655ea3a-c774-40ee-af21-749ee1ca441c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:33.308860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8655ea3a-c774-40ee-af21-749ee1ca441c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:33.310524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e06ef7a7-4963-409e-bb9d-464b792dc166 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:33.324502 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e06ef7a7-4963-409e-bb9d-464b792dc166 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:33.328494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e06ef7a7-4963-409e-bb9d-464b792dc166 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:33.342420 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e06ef7a7-4963-409e-bb9d-464b792dc166 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1721 microversion: 2.20 time: 1.308065 Sep 07 13:00:33.353968 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2744/5439] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:00:32 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1721 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:00:33.376934 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-03ee6168-74c5-4b3b-8fc0-532d46dd7230 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1351495759", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "477b0efc-1e3a-4288-a7c3-16de8a1f2f66"}], "security_groups": [{"name": "tempest-securitygroup--1998657161"}], "key_name": "tempest-keypair-1859603308", "user_data": "}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:00:33.379187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8655ea3a-c774-40ee-af21-749ee1ca441c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:33.382726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8655ea3a-c774-40ee-af21-749ee1ca441c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:33.385410 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8655ea3a-c774-40ee-af21-749ee1ca441c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1336 microversion: 2.54 time: 0.336852 Sep 07 13:00:33.386592 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2696/5440] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:00:33 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1336 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:00:34.019648 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-03ee6168-74c5-4b3b-8fc0-532d46dd7230 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] validate_networks() for [('477b0efc-1e3a-4288-a7c3-16de8a1f2f66', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:00:34.612379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d1cb18b9-4c18-4776-860b-f88b8596358d req-2ec7c9bf-37ea-42d9-8bb4-b428f3dec628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f328e5-ec00-4403-8196-cbefa047877b", "name": "network-vif-deleted", "tag": "13d7f17d-cb66-4016-a84a-aec1e39c3e03"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:00:34.656284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d1cb18b9-4c18-4776-860b-f88b8596358d req-2ec7c9bf-37ea-42d9-8bb4-b428f3dec628 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:34.658203 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d1cb18b9-4c18-4776-860b-f88b8596358d req-2ec7c9bf-37ea-42d9-8bb4-b428f3dec628 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:34.662438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d1cb18b9-4c18-4776-860b-f88b8596358d req-2ec7c9bf-37ea-42d9-8bb4-b428f3dec628 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:34.711045 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d1cb18b9-4c18-4776-860b-f88b8596358d req-2ec7c9bf-37ea-42d9-8bb4-b428f3dec628 service nova] Creating event network-vif-deleted:13d7f17d-cb66-4016-a84a-aec1e39c3e03 for instance 35f328e5-ec00-4403-8196-cbefa047877b on n-h1-852087-9 Sep 07 13:00:34.728641 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d1cb18b9-4c18-4776-860b-f88b8596358d req-2ec7c9bf-37ea-42d9-8bb4-b428f3dec628 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.889727 Sep 07 13:00:34.735497 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2697/5441] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:00:34.768429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5a6104cc-cb88-4193-bcaa-bd0027e17691 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:34.772216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5a6104cc-cb88-4193-bcaa-bd0027e17691 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:34.798156 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a6104cc-cb88-4193-bcaa-bd0027e17691 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:34.804015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a6104cc-cb88-4193-bcaa-bd0027e17691 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:34.804592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a6104cc-cb88-4193-bcaa-bd0027e17691 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:34.806911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a6104cc-cb88-4193-bcaa-bd0027e17691 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:34.811586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a6104cc-cb88-4193-bcaa-bd0027e17691 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:34.812865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a6104cc-cb88-4193-bcaa-bd0027e17691 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:36.915561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5a6104cc-cb88-4193-bcaa-bd0027e17691 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:36.931177 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5a6104cc-cb88-4193-bcaa-bd0027e17691 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c" status: 200 len: 1364 microversion: 2.1 time: 2.190626 Sep 07 13:00:36.932092 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2698/5442] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:00:34 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c => generated 1364 bytes in 2196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:00:36.948129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-91a6bf21-414a-42e6-8fb9-1526eb4e1c5e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:36.948129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-91a6bf21-414a-42e6-8fb9-1526eb4e1c5e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:36.981349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91a6bf21-414a-42e6-8fb9-1526eb4e1c5e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:36.986429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91a6bf21-414a-42e6-8fb9-1526eb4e1c5e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:36.987280 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91a6bf21-414a-42e6-8fb9-1526eb4e1c5e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:36.988407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91a6bf21-414a-42e6-8fb9-1526eb4e1c5e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:36.989169 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91a6bf21-414a-42e6-8fb9-1526eb4e1c5e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:36.990384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91a6bf21-414a-42e6-8fb9-1526eb4e1c5e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:37.193299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91a6bf21-414a-42e6-8fb9-1526eb4e1c5e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:37.194135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91a6bf21-414a-42e6-8fb9-1526eb4e1c5e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:37.194919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91a6bf21-414a-42e6-8fb9-1526eb4e1c5e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:37.195770 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-91a6bf21-414a-42e6-8fb9-1526eb4e1c5e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lazy-loading 'fault' on Instance uuid 35f328e5-ec00-4403-8196-cbefa047877b {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:00:37.456991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-91a6bf21-414a-42e6-8fb9-1526eb4e1c5e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:37.467773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-91a6bf21-414a-42e6-8fb9-1526eb4e1c5e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:37.476627 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-91a6bf21-414a-42e6-8fb9-1526eb4e1c5e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e1c3623bbda4cbdbf6b5d2dedb48f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbe65a861ac4b9ea7e5c2bbd4d955b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:37.478075 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-91a6bf21-414a-42e6-8fb9-1526eb4e1c5e tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 200 len: 1370 microversion: 2.20 time: 0.544915 Sep 07 13:00:37.478661 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2699/5443] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:00:36 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 1370 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:00:37.501568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8e8947b7-a849-4d16-9c00-45465aabb279 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:37.502497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8e8947b7-a849-4d16-9c00-45465aabb279 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:37.509672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e8947b7-a849-4d16-9c00-45465aabb279 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:37.510622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e8947b7-a849-4d16-9c00-45465aabb279 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:37.511333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e8947b7-a849-4d16-9c00-45465aabb279 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:37.512417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e8947b7-a849-4d16-9c00-45465aabb279 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:37.513140 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e8947b7-a849-4d16-9c00-45465aabb279 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:37.514056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e8947b7-a849-4d16-9c00-45465aabb279 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:37.651032 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:37.713411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=12 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:37.906524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-03ee6168-74c5-4b3b-8fc0-532d46dd7230 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:00:37.907112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8e8947b7-a849-4d16-9c00-45465aabb279 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:37.916985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-03ee6168-74c5-4b3b-8fc0-532d46dd7230 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:00:37.918143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-03ee6168-74c5-4b3b-8fc0-532d46dd7230 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:00:37.922057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-03ee6168-74c5-4b3b-8fc0-532d46dd7230 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:00:37.923298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-03ee6168-74c5-4b3b-8fc0-532d46dd7230 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:00:37.946369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8e8947b7-a849-4d16-9c00-45465aabb279 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:37.951045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8e8947b7-a849-4d16-9c00-45465aabb279 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:37.952751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03ee6168-74c5-4b3b-8fc0-532d46dd7230 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:37.955418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03ee6168-74c5-4b3b-8fc0-532d46dd7230 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:37.958985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03ee6168-74c5-4b3b-8fc0-532d46dd7230 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:37.960065 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8e8947b7-a849-4d16-9c00-45465aabb279 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1357 microversion: 2.54 time: 0.466667 Sep 07 13:00:37.961340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03ee6168-74c5-4b3b-8fc0-532d46dd7230 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:37.964459 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2700/5444] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:00:37 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1357 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:00:37.966654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03ee6168-74c5-4b3b-8fc0-532d46dd7230 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:37.968009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03ee6168-74c5-4b3b-8fc0-532d46dd7230 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:37.985245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-16be23cf-298f-4788-b11e-36e19ff66e52 req-34f8d44b-0034-4465-b6bc-477711105b20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43152d55-6621-43f6-bb60-1be3d638859c", "tag": "443262c8-fc2a-41c4-b789-a7672d694de2"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:00:38.017868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-16be23cf-298f-4788-b11e-36e19ff66e52 req-34f8d44b-0034-4465-b6bc-477711105b20 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:38.020162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-16be23cf-298f-4788-b11e-36e19ff66e52 req-34f8d44b-0034-4465-b6bc-477711105b20 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:38.021476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-03ee6168-74c5-4b3b-8fc0-532d46dd7230 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Getting quotas for project cb9b61f78ca140c5870961647ff04cfe. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:00:38.021791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-16be23cf-298f-4788-b11e-36e19ff66e52 req-34f8d44b-0034-4465-b6bc-477711105b20 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:38.030264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-03ee6168-74c5-4b3b-8fc0-532d46dd7230 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Getting quotas for user c9f85a4002bd40eb8514aa91056c77d8 and project cb9b61f78ca140c5870961647ff04cfe. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:00:38.045980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-03ee6168-74c5-4b3b-8fc0-532d46dd7230 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:00:38.049287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-03ee6168-74c5-4b3b-8fc0-532d46dd7230 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:00:38.057328 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-16be23cf-298f-4788-b11e-36e19ff66e52 req-34f8d44b-0034-4465-b6bc-477711105b20 service nova] Creating event network-changed:443262c8-fc2a-41c4-b789-a7672d694de2 for instance 43152d55-6621-43f6-bb60-1be3d638859c on n-h2-852087-9 Sep 07 13:00:38.085981 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-16be23cf-298f-4788-b11e-36e19ff66e52 req-34f8d44b-0034-4465-b6bc-477711105b20 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117806 Sep 07 13:00:38.087987 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2701/5445] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:00:38.116175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b1b8d0aa-7145-4f2a-9068-dbc8da4bcd5d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:38.120442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b1b8d0aa-7145-4f2a-9068-dbc8da4bcd5d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:38.138072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1b8d0aa-7145-4f2a-9068-dbc8da4bcd5d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:38.140212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1b8d0aa-7145-4f2a-9068-dbc8da4bcd5d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:38.141807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1b8d0aa-7145-4f2a-9068-dbc8da4bcd5d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:38.145201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1b8d0aa-7145-4f2a-9068-dbc8da4bcd5d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:38.146012 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1b8d0aa-7145-4f2a-9068-dbc8da4bcd5d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:38.147880 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1b8d0aa-7145-4f2a-9068-dbc8da4bcd5d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:38.157204 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-03ee6168-74c5-4b3b-8fc0-532d46dd7230 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.801968 Sep 07 13:00:38.172833 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2745/5446] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:00:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 4818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:00:38.179716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-728eaab1-f2ee-48c6-93cb-139dd9073687 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Action: 'create', calling method: .version_select at 0x7fc413f34430>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1514236465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmahVDoeBSsIhV+42L1UXInknCy1pyhsSSADnAnGehvHQT3ffZ9A9SynwxPL/xFbhDLWBZsGVCDyhC+9Qg5Iyctq+k51PBzHiVDQ8vs+dN+Z1usNfMDc9DAespZ8Pyo1Q=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:00:38.225216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-728eaab1-f2ee-48c6-93cb-139dd9073687 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Getting quotas for project ba08766ddf2d4a01b95b3e54a734bd78. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:00:38.242746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-728eaab1-f2ee-48c6-93cb-139dd9073687 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Getting quotas for user ceff9982dde545f08aa7a57cc48775cf and project ba08766ddf2d4a01b95b3e54a734bd78. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:00:38.311695 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-728eaab1-f2ee-48c6-93cb-139dd9073687 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.135661 Sep 07 13:00:38.314062 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2746/5447] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Sep 7 13:00:38 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 140 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:38.325260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e15097f0-56bc-4885-b38f-bfda12533b6e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:38.330853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e15097f0-56bc-4885-b38f-bfda12533b6e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:38.672788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e15097f0-56bc-4885-b38f-bfda12533b6e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:38.703469 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e15097f0-56bc-4885-b38f-bfda12533b6e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63" status: 200 len: 1242 microversion: 2.1 time: 0.386157 Sep 07 13:00:38.706908 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2747/5448] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:00:38 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63 => generated 1242 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:00:38.719430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-569a4077-831e-4e07-baa1-85f35228e25a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1514236465", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:00:38.735915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-569a4077-831e-4e07-baa1-85f35228e25a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:38.755015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-569a4077-831e-4e07-baa1-85f35228e25a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:38.755928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-569a4077-831e-4e07-baa1-85f35228e25a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:38.756734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-569a4077-831e-4e07-baa1-85f35228e25a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:38.758342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-569a4077-831e-4e07-baa1-85f35228e25a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:38.759861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-569a4077-831e-4e07-baa1-85f35228e25a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:38.760887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-569a4077-831e-4e07-baa1-85f35228e25a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:38.957763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b1b8d0aa-7145-4f2a-9068-dbc8da4bcd5d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:39.006450 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-569a4077-831e-4e07-baa1-85f35228e25a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:00:39.008067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-569a4077-831e-4e07-baa1-85f35228e25a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:00:39.011699 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-569a4077-831e-4e07-baa1-85f35228e25a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:00:39.019073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-569a4077-831e-4e07-baa1-85f35228e25a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:00:39.023593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-569a4077-831e-4e07-baa1-85f35228e25a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:00:39.026550 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b1b8d0aa-7145-4f2a-9068-dbc8da4bcd5d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c" status: 200 len: 1364 microversion: 2.1 time: 0.930461 Sep 07 13:00:39.030751 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2702/5449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:00:38 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c => generated 1364 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:00:39.063075 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e788181f-eec1-4095-af4f-ed1cf1d8876f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:39.065314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e788181f-eec1-4095-af4f-ed1cf1d8876f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:39.081011 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e788181f-eec1-4095-af4f-ed1cf1d8876f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:39.083033 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e788181f-eec1-4095-af4f-ed1cf1d8876f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:39.084315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e788181f-eec1-4095-af4f-ed1cf1d8876f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:39.086333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e788181f-eec1-4095-af4f-ed1cf1d8876f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:39.087567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e788181f-eec1-4095-af4f-ed1cf1d8876f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:39.089112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e788181f-eec1-4095-af4f-ed1cf1d8876f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:39.124211 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-e788181f-eec1-4095-af4f-ed1cf1d8876f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] HTTP exception thrown: Instance 35f328e5-ec00-4403-8196-cbefa047877b could not be found. Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e788181f-eec1-4095-af4f-ed1cf1d8876f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Request method failure captured: Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b HTTP/1.1 Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJNw5hacCrPa_HA67UL8Q8JsIVT06ZBnDw_7nEL37LMgyCxq7HTiBwQQLT7YgngjCO9dDbCsgT7vkiCHkYFkVZvw6W7F-_hBjld_38ZCU8IPDT9dG3fgXHphQDQ20Ayfi0-lKCoj-hwol4f9c1wYW0KnUBkrb3phyz4ShjlWqaTo78s Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: fdbe65a861ac4b9ea7e5c2bbd4d955b3 Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-358704052 Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdbe65a861ac4b9ea7e5c2bbd4d955b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fdbe65a861ac4b9ea7e5c2bbd4d955b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fdbe65a861ac4b9ea7e5c2bbd4d955b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdbe65a861ac4b9ea7e5c2bbd4d955b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeShelveTestJSON-358704052 Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: fdbe65a861ac4b9ea7e5c2bbd4d955b3 Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-358704052 Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeShelveTestJSON-358704052-project Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 9e1c3623bbda4cbdbf6b5d2dedb48f74 Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeShelveTestJSON-358704052-project Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 35f328e5-ec00-4403-8196-cbefa047877b could not be found. Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '35f328e5-ec00-4403-8196-cbefa047877b'} Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35f328e5-ec00-4403-8196-cbefa047877b could not be found. Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35f328e5-ec00-4403-8196-cbefa047877b could not be found. Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:00:39.128168 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:00:39.139315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:00:39.139315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:00:39.139315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:00:39.139315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:00:39.139315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:00:39.139315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:00:39.139315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35f328e5-ec00-4403-8196-cbefa047877b could not be found. Sep 07 13:00:39.139315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:00:39.139315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e788181f-eec1-4095-af4f-ed1cf1d8876f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Returning 404 to user: Instance 35f328e5-ec00-4403-8196-cbefa047877b could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:00:39.139315 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e788181f-eec1-4095-af4f-ed1cf1d8876f tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 404 len: 111 microversion: 2.20 time: 0.099130 Sep 07 13:00:39.154604 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2703/5450] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:00:39 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:00:39.166293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-70e64ca5-79ce-4155-bf46-2442add441f3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '.version_select at 0x7fc41d1de820>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:39.229213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-569a4077-831e-4e07-baa1-85f35228e25a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:39.230484 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-70e64ca5-79ce-4155-bf46-2442add441f3 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-706282161" status: 204 len: 0 microversion: 2.20 time: 0.070351 Sep 07 13:00:39.235422 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2704/5451] 10.222.0.16 () {60 vars in 1259 bytes} [Wed Sep 7 13:00:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-706282161 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 13:00:39.261797 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-569a4077-831e-4e07-baa1-85f35228e25a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:39.263466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-569a4077-831e-4e07-baa1-85f35228e25a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:39.267665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-569a4077-831e-4e07-baa1-85f35228e25a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:39.270482 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-569a4077-831e-4e07-baa1-85f35228e25a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:39.282949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-569a4077-831e-4e07-baa1-85f35228e25a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:39.283245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-569a4077-831e-4e07-baa1-85f35228e25a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:39.356559 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-569a4077-831e-4e07-baa1-85f35228e25a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "POST /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7/action" status: 202 len: 1140 microversion: 2.54 time: 0.648000 Sep 07 13:00:39.373862 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2748/5452] 10.222.0.16 () {62 vars in 1320 bytes} [Wed Sep 7 13:00:38 2022] POST /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7/action => generated 1140 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 07 13:00:39.383064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a3081476-f9ba-48d8-8b53-6a0dbe2d0296 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:39.389333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a3081476-f9ba-48d8-8b53-6a0dbe2d0296 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:39.433018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3081476-f9ba-48d8-8b53-6a0dbe2d0296 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:39.436571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3081476-f9ba-48d8-8b53-6a0dbe2d0296 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:39.438704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3081476-f9ba-48d8-8b53-6a0dbe2d0296 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:39.445018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3081476-f9ba-48d8-8b53-6a0dbe2d0296 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:39.446151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3081476-f9ba-48d8-8b53-6a0dbe2d0296 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:39.446953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3081476-f9ba-48d8-8b53-6a0dbe2d0296 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:39.517800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:39.729780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6f7c4ce5-a820-4866-b8e1-962396a2dc58 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:39.731639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6f7c4ce5-a820-4866-b8e1-962396a2dc58 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:39.747797 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f7c4ce5-a820-4866-b8e1-962396a2dc58 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:39.748294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f7c4ce5-a820-4866-b8e1-962396a2dc58 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:39.748749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f7c4ce5-a820-4866-b8e1-962396a2dc58 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:39.749527 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f7c4ce5-a820-4866-b8e1-962396a2dc58 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:39.749989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f7c4ce5-a820-4866-b8e1-962396a2dc58 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:39.750425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f7c4ce5-a820-4866-b8e1-962396a2dc58 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:40.115525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a3081476-f9ba-48d8-8b53-6a0dbe2d0296 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:40.196988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a3081476-f9ba-48d8-8b53-6a0dbe2d0296 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:40.217086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a3081476-f9ba-48d8-8b53-6a0dbe2d0296 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:40.235103 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a3081476-f9ba-48d8-8b53-6a0dbe2d0296 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1409 microversion: 2.54 time: 0.843956 Sep 07 13:00:40.253722 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2705/5453] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:00:39 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1409 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:00:40.263812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6f7c4ce5-a820-4866-b8e1-962396a2dc58 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:40.268241 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4fe5fd7e-f5b1-4eae-9ee9-cecc812fe9be tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:40.271257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4fe5fd7e-f5b1-4eae-9ee9-cecc812fe9be tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:40.288131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fe5fd7e-f5b1-4eae-9ee9-cecc812fe9be tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:40.291588 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6f7c4ce5-a820-4866-b8e1-962396a2dc58 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63" status: 200 len: 1246 microversion: 2.1 time: 0.559608 Sep 07 13:00:40.302429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fe5fd7e-f5b1-4eae-9ee9-cecc812fe9be tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:40.303471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fe5fd7e-f5b1-4eae-9ee9-cecc812fe9be tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:40.304992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fe5fd7e-f5b1-4eae-9ee9-cecc812fe9be tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:40.305324 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2749/5454] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:00:39 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63 => generated 1246 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:00:40.306032 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fe5fd7e-f5b1-4eae-9ee9-cecc812fe9be tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:40.308184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4fe5fd7e-f5b1-4eae-9ee9-cecc812fe9be tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:41.270388 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7d7c0be2-e79b-4102-8d05-a73b45a73800 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:41.271414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7d7c0be2-e79b-4102-8d05-a73b45a73800 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:41.292522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d7c0be2-e79b-4102-8d05-a73b45a73800 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:41.296186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d7c0be2-e79b-4102-8d05-a73b45a73800 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:41.297376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d7c0be2-e79b-4102-8d05-a73b45a73800 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:41.299950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d7c0be2-e79b-4102-8d05-a73b45a73800 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:41.302773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d7c0be2-e79b-4102-8d05-a73b45a73800 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:41.304308 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d7c0be2-e79b-4102-8d05-a73b45a73800 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:41.672629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7d7c0be2-e79b-4102-8d05-a73b45a73800 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:41.687194 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4fe5fd7e-f5b1-4eae-9ee9-cecc812fe9be tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:41.700826 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4fe5fd7e-f5b1-4eae-9ee9-cecc812fe9be tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c" status: 200 len: 1364 microversion: 2.1 time: 1.437166 Sep 07 13:00:41.701439 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2706/5455] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:00:40 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c => generated 1364 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:00:41.710823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-af3ba6ea-ff9e-474f-8969-ee980e107b2e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:41.711654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-af3ba6ea-ff9e-474f-8969-ee980e107b2e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:41.728519 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af3ba6ea-ff9e-474f-8969-ee980e107b2e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:41.728918 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af3ba6ea-ff9e-474f-8969-ee980e107b2e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:41.732235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7d7c0be2-e79b-4102-8d05-a73b45a73800 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:41.732541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af3ba6ea-ff9e-474f-8969-ee980e107b2e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:41.733311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af3ba6ea-ff9e-474f-8969-ee980e107b2e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:41.733997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af3ba6ea-ff9e-474f-8969-ee980e107b2e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:41.737410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af3ba6ea-ff9e-474f-8969-ee980e107b2e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:41.745598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7d7c0be2-e79b-4102-8d05-a73b45a73800 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:41.750582 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7d7c0be2-e79b-4102-8d05-a73b45a73800 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1409 microversion: 2.54 time: 0.484235 Sep 07 13:00:41.758765 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2750/5456] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:00:41 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1409 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:00:41.915829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-af3ba6ea-ff9e-474f-8969-ee980e107b2e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:41.919609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:41.929122 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-af3ba6ea-ff9e-474f-8969-ee980e107b2e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63" status: 200 len: 1300 microversion: 2.1 time: 0.226503 Sep 07 13:00:41.938672 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2707/5457] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:00:41 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63 => generated 1300 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:00:42.780321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a5db9595-a19d-4e70-96ea-a04932af7c8a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:42.786385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a5db9595-a19d-4e70-96ea-a04932af7c8a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:42.796503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5db9595-a19d-4e70-96ea-a04932af7c8a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:42.797384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5db9595-a19d-4e70-96ea-a04932af7c8a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:42.798070 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5db9595-a19d-4e70-96ea-a04932af7c8a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:42.798988 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5db9595-a19d-4e70-96ea-a04932af7c8a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:42.799638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5db9595-a19d-4e70-96ea-a04932af7c8a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:42.800903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5db9595-a19d-4e70-96ea-a04932af7c8a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:42.809402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f317d9b7-6549-4c21-9a4e-521cf3cefbab tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:42.812106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f317d9b7-6549-4c21-9a4e-521cf3cefbab tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:42.837990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f317d9b7-6549-4c21-9a4e-521cf3cefbab tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:42.840686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f317d9b7-6549-4c21-9a4e-521cf3cefbab tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:42.842195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f317d9b7-6549-4c21-9a4e-521cf3cefbab tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:42.843933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f317d9b7-6549-4c21-9a4e-521cf3cefbab tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:42.845150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f317d9b7-6549-4c21-9a4e-521cf3cefbab tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:42.846538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f317d9b7-6549-4c21-9a4e-521cf3cefbab tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:43.299320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a5db9595-a19d-4e70-96ea-a04932af7c8a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:43.320647 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a5db9595-a19d-4e70-96ea-a04932af7c8a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c" status: 200 len: 1364 microversion: 2.1 time: 0.588352 Sep 07 13:00:43.322317 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2751/5458] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:00:42 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c => generated 1364 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:00:43.324082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f317d9b7-6549-4c21-9a4e-521cf3cefbab tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:43.328483 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3e9884a9-c311-4d05-8613-302f3e7037ca tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:43.329536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3e9884a9-c311-4d05-8613-302f3e7037ca tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:43.342572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e9884a9-c311-4d05-8613-302f3e7037ca tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:43.344915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e9884a9-c311-4d05-8613-302f3e7037ca tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:43.350246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e9884a9-c311-4d05-8613-302f3e7037ca tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:43.353252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e9884a9-c311-4d05-8613-302f3e7037ca tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:43.354072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e9884a9-c311-4d05-8613-302f3e7037ca tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:43.354842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e9884a9-c311-4d05-8613-302f3e7037ca tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:43.365841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f317d9b7-6549-4c21-9a4e-521cf3cefbab tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:43.374843 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f317d9b7-6549-4c21-9a4e-521cf3cefbab tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:43.376567 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f317d9b7-6549-4c21-9a4e-521cf3cefbab tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1409 microversion: 2.54 time: 0.577241 Sep 07 13:00:43.386025 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2708/5459] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:00:42 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1409 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:00:43.489287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3e9884a9-c311-4d05-8613-302f3e7037ca tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:43.501473 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3e9884a9-c311-4d05-8613-302f3e7037ca tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63" status: 200 len: 1300 microversion: 2.1 time: 0.177657 Sep 07 13:00:43.514668 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2752/5460] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:00:43 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63 => generated 1300 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:00:44.370509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d8e6b87e-0799-4b40-a660-f3098bae5193 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:44.372709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d8e6b87e-0799-4b40-a660-f3098bae5193 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:44.399977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:44.402806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8e6b87e-0799-4b40-a660-f3098bae5193 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:44.406642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8e6b87e-0799-4b40-a660-f3098bae5193 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:44.411888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8e6b87e-0799-4b40-a660-f3098bae5193 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:44.413658 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8e6b87e-0799-4b40-a660-f3098bae5193 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:44.415155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8e6b87e-0799-4b40-a660-f3098bae5193 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:44.417303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8e6b87e-0799-4b40-a660-f3098bae5193 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:44.447475 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d7f908c5-6ab1-46de-925f-4b9d12c9e946 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:44.457601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d7f908c5-6ab1-46de-925f-4b9d12c9e946 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:44.490821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:44.508956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7f908c5-6ab1-46de-925f-4b9d12c9e946 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:44.515178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7f908c5-6ab1-46de-925f-4b9d12c9e946 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:44.519647 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7f908c5-6ab1-46de-925f-4b9d12c9e946 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:44.524830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7f908c5-6ab1-46de-925f-4b9d12c9e946 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:44.528203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7f908c5-6ab1-46de-925f-4b9d12c9e946 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:44.529359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7f908c5-6ab1-46de-925f-4b9d12c9e946 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:44.885346 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d7f908c5-6ab1-46de-925f-4b9d12c9e946 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:44.912080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d7f908c5-6ab1-46de-925f-4b9d12c9e946 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:44.931561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d7f908c5-6ab1-46de-925f-4b9d12c9e946 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:44.951349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d8e6b87e-0799-4b40-a660-f3098bae5193 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:44.959898 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d7f908c5-6ab1-46de-925f-4b9d12c9e946 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1409 microversion: 2.54 time: 0.523086 Sep 07 13:00:44.974909 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2753/5461] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:00:44 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1409 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:00:44.988925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-47bbacf8-7e5b-4fcb-88f5-ccca68e47326 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:44.998817 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d8e6b87e-0799-4b40-a660-f3098bae5193 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c" status: 200 len: 1364 microversion: 2.1 time: 0.635712 Sep 07 13:00:45.004266 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2709/5462] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:00:44 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c => generated 1364 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:00:45.005442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-47bbacf8-7e5b-4fcb-88f5-ccca68e47326 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:45.032903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47bbacf8-7e5b-4fcb-88f5-ccca68e47326 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:45.033886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47bbacf8-7e5b-4fcb-88f5-ccca68e47326 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:45.039749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47bbacf8-7e5b-4fcb-88f5-ccca68e47326 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:45.049266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47bbacf8-7e5b-4fcb-88f5-ccca68e47326 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:45.051896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47bbacf8-7e5b-4fcb-88f5-ccca68e47326 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:45.053061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47bbacf8-7e5b-4fcb-88f5-ccca68e47326 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:46.003273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c2d19cd1-79ca-4667-bc16-dec722aa40f0 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:46.003909 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c2d19cd1-79ca-4667-bc16-dec722aa40f0 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:46.024590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2d19cd1-79ca-4667-bc16-dec722aa40f0 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:46.032690 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2d19cd1-79ca-4667-bc16-dec722aa40f0 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:46.042837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2d19cd1-79ca-4667-bc16-dec722aa40f0 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:46.043915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2d19cd1-79ca-4667-bc16-dec722aa40f0 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:46.045271 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2d19cd1-79ca-4667-bc16-dec722aa40f0 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:46.049660 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2d19cd1-79ca-4667-bc16-dec722aa40f0 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:46.591026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c2d19cd1-79ca-4667-bc16-dec722aa40f0 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:46.618391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c2d19cd1-79ca-4667-bc16-dec722aa40f0 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:46.624554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c2d19cd1-79ca-4667-bc16-dec722aa40f0 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:46.631152 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c2d19cd1-79ca-4667-bc16-dec722aa40f0 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1409 microversion: 2.54 time: 0.633713 Sep 07 13:00:46.639973 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2710/5463] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:00:45 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1409 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:00:46.664903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8216a2cc-0331-4366-b6df-1ec5bfd0b25a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:46.665795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8216a2cc-0331-4366-b6df-1ec5bfd0b25a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:46.703119 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8216a2cc-0331-4366-b6df-1ec5bfd0b25a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:46.705202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8216a2cc-0331-4366-b6df-1ec5bfd0b25a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:46.705202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8216a2cc-0331-4366-b6df-1ec5bfd0b25a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:46.705667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8216a2cc-0331-4366-b6df-1ec5bfd0b25a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:46.706077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8216a2cc-0331-4366-b6df-1ec5bfd0b25a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:46.706506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8216a2cc-0331-4366-b6df-1ec5bfd0b25a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:46.773818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-47bbacf8-7e5b-4fcb-88f5-ccca68e47326 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:46.779310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:46.786950 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-47bbacf8-7e5b-4fcb-88f5-ccca68e47326 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63" status: 200 len: 1368 microversion: 2.1 time: 1.810392 Sep 07 13:00:46.790610 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2754/5464] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:00:44 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63 => generated 1368 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:00:47.057779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-049a84fd-c040-4bf3-bf04-b94cb56a9846 req-bc517abc-56d0-4a55-9daa-c473bd3e401d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43152d55-6621-43f6-bb60-1be3d638859c", "name": "network-vif-plugged", "status": "completed", "tag": "443262c8-fc2a-41c4-b789-a7672d694de2"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:00:47.090175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-049a84fd-c040-4bf3-bf04-b94cb56a9846 req-bc517abc-56d0-4a55-9daa-c473bd3e401d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:47.091001 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-049a84fd-c040-4bf3-bf04-b94cb56a9846 req-bc517abc-56d0-4a55-9daa-c473bd3e401d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:47.091562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-049a84fd-c040-4bf3-bf04-b94cb56a9846 req-bc517abc-56d0-4a55-9daa-c473bd3e401d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:47.144835 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-049a84fd-c040-4bf3-bf04-b94cb56a9846 req-bc517abc-56d0-4a55-9daa-c473bd3e401d service nova] Creating event network-vif-plugged:443262c8-fc2a-41c4-b789-a7672d694de2 for instance 43152d55-6621-43f6-bb60-1be3d638859c on n-h2-852087-9 Sep 07 13:00:47.155176 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-049a84fd-c040-4bf3-bf04-b94cb56a9846 req-bc517abc-56d0-4a55-9daa-c473bd3e401d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.362881 Sep 07 13:00:47.164791 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2755/5465] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:00:47.292294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8216a2cc-0331-4366-b6df-1ec5bfd0b25a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:47.328738 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8216a2cc-0331-4366-b6df-1ec5bfd0b25a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c" status: 200 len: 1364 microversion: 2.1 time: 0.684676 Sep 07 13:00:47.335228 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2711/5466] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:00:46 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c => generated 1364 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:00:47.672118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9b1fbbda-c330-4eba-9656-641d84820f7d tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:47.685824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9b1fbbda-c330-4eba-9656-641d84820f7d tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:47.749870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b1fbbda-c330-4eba-9656-641d84820f7d tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:47.755025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b1fbbda-c330-4eba-9656-641d84820f7d tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:47.756092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b1fbbda-c330-4eba-9656-641d84820f7d tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:47.763440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b1fbbda-c330-4eba-9656-641d84820f7d tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:47.764346 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b1fbbda-c330-4eba-9656-641d84820f7d tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:47.773077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b1fbbda-c330-4eba-9656-641d84820f7d tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:47.845993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f4b1ff3d-b1cb-4045-9228-0d702e83f8af tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:47.847375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f4b1ff3d-b1cb-4045-9228-0d702e83f8af tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:47.891523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4b1ff3d-b1cb-4045-9228-0d702e83f8af tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:47.897666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4b1ff3d-b1cb-4045-9228-0d702e83f8af tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:47.898819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4b1ff3d-b1cb-4045-9228-0d702e83f8af tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:47.904659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4b1ff3d-b1cb-4045-9228-0d702e83f8af tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:47.906525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4b1ff3d-b1cb-4045-9228-0d702e83f8af tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:47.914632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f4b1ff3d-b1cb-4045-9228-0d702e83f8af tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:48.001418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:48.632054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9b1fbbda-c330-4eba-9656-641d84820f7d tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:48.670385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9b1fbbda-c330-4eba-9656-641d84820f7d tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:48.673259 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9b1fbbda-c330-4eba-9656-641d84820f7d tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:48.707244 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9b1fbbda-c330-4eba-9656-641d84820f7d tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1409 microversion: 2.54 time: 1.044433 Sep 07 13:00:48.730929 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2756/5467] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:00:47 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1409 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:00:48.756513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-b1549add-43d0-432a-8577-690c147b0fce req-097112bb-91b8-4e92-826e-6069f13d58a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dbd6ebd-a395-40cf-9aee-a3ec45adac63", "tag": "6d4c0a71-ad7c-4f97-8d06-18723a168f78"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:00:48.809056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=12 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:48.822808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b1549add-43d0-432a-8577-690c147b0fce req-097112bb-91b8-4e92-826e-6069f13d58a3 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:48.826470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b1549add-43d0-432a-8577-690c147b0fce req-097112bb-91b8-4e92-826e-6069f13d58a3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:48.830331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b1549add-43d0-432a-8577-690c147b0fce req-097112bb-91b8-4e92-826e-6069f13d58a3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:48.895953 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-b1549add-43d0-432a-8577-690c147b0fce req-097112bb-91b8-4e92-826e-6069f13d58a3 service nova] Creating event network-changed:6d4c0a71-ad7c-4f97-8d06-18723a168f78 for instance 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 on n-h2-852087-9 Sep 07 13:00:48.918963 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-b1549add-43d0-432a-8577-690c147b0fce req-097112bb-91b8-4e92-826e-6069f13d58a3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175061 Sep 07 13:00:48.922380 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2757/5468] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:00:48.943809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a49203f5-6348-425a-beda-dc4e96f7380b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:48.946188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a49203f5-6348-425a-beda-dc4e96f7380b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:48.969864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a49203f5-6348-425a-beda-dc4e96f7380b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:48.971282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a49203f5-6348-425a-beda-dc4e96f7380b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:48.972187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a49203f5-6348-425a-beda-dc4e96f7380b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:48.973586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a49203f5-6348-425a-beda-dc4e96f7380b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:48.978969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a49203f5-6348-425a-beda-dc4e96f7380b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:48.982445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a49203f5-6348-425a-beda-dc4e96f7380b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:49.342210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f4b1ff3d-b1cb-4045-9228-0d702e83f8af tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:49.369671 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f4b1ff3d-b1cb-4045-9228-0d702e83f8af tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63" status: 200 len: 1368 microversion: 2.1 time: 1.528191 Sep 07 13:00:49.374489 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2712/5469] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:00:47 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63 => generated 1368 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:00:49.770289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3d6a1c21-bf58-413f-b26a-418ef0b06129 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:49.772790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3d6a1c21-bf58-413f-b26a-418ef0b06129 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:49.790853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d6a1c21-bf58-413f-b26a-418ef0b06129 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:49.791362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d6a1c21-bf58-413f-b26a-418ef0b06129 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:49.791797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d6a1c21-bf58-413f-b26a-418ef0b06129 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:49.792524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d6a1c21-bf58-413f-b26a-418ef0b06129 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:49.792992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d6a1c21-bf58-413f-b26a-418ef0b06129 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:49.793428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d6a1c21-bf58-413f-b26a-418ef0b06129 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:49.854254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a49203f5-6348-425a-beda-dc4e96f7380b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:49.877827 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a49203f5-6348-425a-beda-dc4e96f7380b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c" status: 200 len: 1364 microversion: 2.1 time: 0.947229 Sep 07 13:00:49.884104 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2758/5470] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:00:48 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c => generated 1364 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:00:50.107311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3d6a1c21-bf58-413f-b26a-418ef0b06129 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:50.129582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3d6a1c21-bf58-413f-b26a-418ef0b06129 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:50.131675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3d6a1c21-bf58-413f-b26a-418ef0b06129 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:50.133388 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3d6a1c21-bf58-413f-b26a-418ef0b06129 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1409 microversion: 2.54 time: 0.376865 Sep 07 13:00:50.150322 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2713/5471] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:00:49 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1409 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:00:50.423308 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aef67c65-1289-4277-b259-8ee0b65b8024 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:50.424435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aef67c65-1289-4277-b259-8ee0b65b8024 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:50.466299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aef67c65-1289-4277-b259-8ee0b65b8024 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:50.466894 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aef67c65-1289-4277-b259-8ee0b65b8024 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:50.468183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aef67c65-1289-4277-b259-8ee0b65b8024 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:50.469165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aef67c65-1289-4277-b259-8ee0b65b8024 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:50.470215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aef67c65-1289-4277-b259-8ee0b65b8024 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:50.470868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aef67c65-1289-4277-b259-8ee0b65b8024 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:50.921180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-555dc409-c30f-49e6-9027-cf3e9e6701d8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:50.924759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-555dc409-c30f-49e6-9027-cf3e9e6701d8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:50.970218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-555dc409-c30f-49e6-9027-cf3e9e6701d8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:50.974423 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-555dc409-c30f-49e6-9027-cf3e9e6701d8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:50.977837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-555dc409-c30f-49e6-9027-cf3e9e6701d8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:50.985503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-555dc409-c30f-49e6-9027-cf3e9e6701d8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:50.987182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-555dc409-c30f-49e6-9027-cf3e9e6701d8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:50.992546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-555dc409-c30f-49e6-9027-cf3e9e6701d8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:51.389384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aef67c65-1289-4277-b259-8ee0b65b8024 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:51.437929 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aef67c65-1289-4277-b259-8ee0b65b8024 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63" status: 200 len: 1368 microversion: 2.1 time: 1.036819 Sep 07 13:00:51.443888 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2759/5472] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:00:50 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63 => generated 1368 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:00:51.478550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-18f01ed2-9579-401f-8685-85dd941daadc tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:51.487266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-18f01ed2-9579-401f-8685-85dd941daadc tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:51.527568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18f01ed2-9579-401f-8685-85dd941daadc tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:51.528072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18f01ed2-9579-401f-8685-85dd941daadc tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:51.528560 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18f01ed2-9579-401f-8685-85dd941daadc tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:51.529276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18f01ed2-9579-401f-8685-85dd941daadc tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:51.549830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18f01ed2-9579-401f-8685-85dd941daadc tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:51.552963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18f01ed2-9579-401f-8685-85dd941daadc tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:51.823812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-555dc409-c30f-49e6-9027-cf3e9e6701d8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:51.842060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-18f01ed2-9579-401f-8685-85dd941daadc tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:51.846504 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-555dc409-c30f-49e6-9027-cf3e9e6701d8 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c" status: 200 len: 1551 microversion: 2.1 time: 0.923048 Sep 07 13:00:51.863647 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2714/5473] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:00:50 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c => generated 1551 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:00:51.868884 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-18f01ed2-9579-401f-8685-85dd941daadc tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:51.871825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1f17fe08-aa11-49de-9262-febce94101a0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:51.875860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-18f01ed2-9579-401f-8685-85dd941daadc tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:51.878364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1f17fe08-aa11-49de-9262-febce94101a0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:51.879562 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-18f01ed2-9579-401f-8685-85dd941daadc tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1409 microversion: 2.54 time: 0.432881 Sep 07 13:00:51.914243 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2760/5474] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:00:51 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1409 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:00:51.938153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6bba7294-637e-4421-9ca2-8fd308cc9538 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:51.940540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f17fe08-aa11-49de-9262-febce94101a0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:51.954401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6bba7294-637e-4421-9ca2-8fd308cc9538 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:51.958492 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f17fe08-aa11-49de-9262-febce94101a0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:51.966980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f17fe08-aa11-49de-9262-febce94101a0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:51.972556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f17fe08-aa11-49de-9262-febce94101a0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:51.977461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f17fe08-aa11-49de-9262-febce94101a0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:51.984567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1f17fe08-aa11-49de-9262-febce94101a0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:51.995046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bba7294-637e-4421-9ca2-8fd308cc9538 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:52.000167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bba7294-637e-4421-9ca2-8fd308cc9538 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:52.000870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bba7294-637e-4421-9ca2-8fd308cc9538 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:52.004584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bba7294-637e-4421-9ca2-8fd308cc9538 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:52.005275 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bba7294-637e-4421-9ca2-8fd308cc9538 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:52.014300 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bba7294-637e-4421-9ca2-8fd308cc9538 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:52.042360 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-1f17fe08-aa11-49de-9262-febce94101a0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] HTTP exception thrown: Instance 35f328e5-ec00-4403-8196-cbefa047877b could not be found. Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1f17fe08-aa11-49de-9262-febce94101a0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Request method failure captured: Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b HTTP/1.1 Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJNw5hacCrPa_HA67UL8Q8JsIVT06ZBnDw_7nEL37LMgyCxq7HTiBwQQLT7YgngjCO9dDbCsgT7vkiCHkYFkVZvw6W7F-_hBjld_38ZCU8IPDT9dG3fgXHphQDQ20Ayfi0-lKCoj-hwol4f9c1wYW0KnUBkrb3phyz4ShjlWqaTo78s Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: fdbe65a861ac4b9ea7e5c2bbd4d955b3 Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-358704052 Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdbe65a861ac4b9ea7e5c2bbd4d955b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fdbe65a861ac4b9ea7e5c2bbd4d955b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fdbe65a861ac4b9ea7e5c2bbd4d955b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdbe65a861ac4b9ea7e5c2bbd4d955b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeShelveTestJSON-358704052 Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: fdbe65a861ac4b9ea7e5c2bbd4d955b3 Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-358704052 Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeShelveTestJSON-358704052-project Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 9e1c3623bbda4cbdbf6b5d2dedb48f74 Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeShelveTestJSON-358704052-project Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 35f328e5-ec00-4403-8196-cbefa047877b could not be found. Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '35f328e5-ec00-4403-8196-cbefa047877b'} Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35f328e5-ec00-4403-8196-cbefa047877b could not be found. Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:00:52.046993 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:00:52.052599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35f328e5-ec00-4403-8196-cbefa047877b could not be found. Sep 07 13:00:52.052599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:00:52.052599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:00:52.052599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:00:52.052599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:00:52.052599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:00:52.052599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:00:52.052599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:00:52.052599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:00:52.052599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35f328e5-ec00-4403-8196-cbefa047877b could not be found. Sep 07 13:00:52.052599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:00:52.062000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1f17fe08-aa11-49de-9262-febce94101a0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Returning 404 to user: Instance 35f328e5-ec00-4403-8196-cbefa047877b could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:00:52.065122 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1f17fe08-aa11-49de-9262-febce94101a0 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "DELETE /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 404 len: 111 microversion: 2.20 time: 0.198349 Sep 07 13:00:52.066512 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2715/5475] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 13:00:51 2022] DELETE /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 111 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:00:52.080309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-08fe3a71-f727-4f16-8f9d-310378ec5c69 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:52.086072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-08fe3a71-f727-4f16-8f9d-310378ec5c69 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: 35f328e5-ec00-4403-8196-cbefa047877b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:52.105230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08fe3a71-f727-4f16-8f9d-310378ec5c69 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:52.107816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08fe3a71-f727-4f16-8f9d-310378ec5c69 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:52.108467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08fe3a71-f727-4f16-8f9d-310378ec5c69 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:52.110914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08fe3a71-f727-4f16-8f9d-310378ec5c69 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:52.111766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08fe3a71-f727-4f16-8f9d-310378ec5c69 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:52.112407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08fe3a71-f727-4f16-8f9d-310378ec5c69 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:52.153106 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-08fe3a71-f727-4f16-8f9d-310378ec5c69 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] HTTP exception thrown: Instance 35f328e5-ec00-4403-8196-cbefa047877b could not be found. Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-08fe3a71-f727-4f16-8f9d-310378ec5c69 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Request method failure captured: Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b HTTP/1.1 Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJNw5hacCrPa_HA67UL8Q8JsIVT06ZBnDw_7nEL37LMgyCxq7HTiBwQQLT7YgngjCO9dDbCsgT7vkiCHkYFkVZvw6W7F-_hBjld_38ZCU8IPDT9dG3fgXHphQDQ20Ayfi0-lKCoj-hwol4f9c1wYW0KnUBkrb3phyz4ShjlWqaTo78s Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: fdbe65a861ac4b9ea7e5c2bbd4d955b3 Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-358704052 Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdbe65a861ac4b9ea7e5c2bbd4d955b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fdbe65a861ac4b9ea7e5c2bbd4d955b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fdbe65a861ac4b9ea7e5c2bbd4d955b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdbe65a861ac4b9ea7e5c2bbd4d955b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeShelveTestJSON-358704052 Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: fdbe65a861ac4b9ea7e5c2bbd4d955b3 Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-358704052 Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeShelveTestJSON-358704052-project Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 9e1c3623bbda4cbdbf6b5d2dedb48f74 Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeShelveTestJSON-358704052-project Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 35f328e5-ec00-4403-8196-cbefa047877b could not be found. Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '35f328e5-ec00-4403-8196-cbefa047877b'} Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35f328e5-ec00-4403-8196-cbefa047877b could not be found. Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35f328e5-ec00-4403-8196-cbefa047877b could not be found. Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:00:52.159503 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:00:52.164424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:00:52.164424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:00:52.164424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:00:52.164424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:00:52.164424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:00:52.164424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:00:52.164424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35f328e5-ec00-4403-8196-cbefa047877b could not be found. Sep 07 13:00:52.164424 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:00:52.172650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-08fe3a71-f727-4f16-8f9d-310378ec5c69 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Returning 404 to user: Instance 35f328e5-ec00-4403-8196-cbefa047877b could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:00:52.174834 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-08fe3a71-f727-4f16-8f9d-310378ec5c69 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b" status: 404 len: 111 microversion: 2.20 time: 0.101454 Sep 07 13:00:52.177003 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2716/5476] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:00:52 2022] GET /compute/v2.1/servers/35f328e5-ec00-4403-8196-cbefa047877b => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:00:52.475901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e1b56e2d-1393-4aba-80bb-a3145fb0da20 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:52.476995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e1b56e2d-1393-4aba-80bb-a3145fb0da20 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:52.492910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1b56e2d-1393-4aba-80bb-a3145fb0da20 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:52.495099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1b56e2d-1393-4aba-80bb-a3145fb0da20 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:52.501429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1b56e2d-1393-4aba-80bb-a3145fb0da20 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:52.508565 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1b56e2d-1393-4aba-80bb-a3145fb0da20 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:52.511907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1b56e2d-1393-4aba-80bb-a3145fb0da20 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:52.512626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e1b56e2d-1393-4aba-80bb-a3145fb0da20 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:52.874663 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6bba7294-637e-4421-9ca2-8fd308cc9538 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.957669 Sep 07 13:00:52.876010 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2761/5477] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Sep 7 13:00:51 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c/os-interface => generated 285 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:00:52.972339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-202b2a67-0649-4aee-aa31-40a77714d5df tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:52.972979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-202b2a67-0649-4aee-aa31-40a77714d5df tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:52.990083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-202b2a67-0649-4aee-aa31-40a77714d5df tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:52.993259 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-202b2a67-0649-4aee-aa31-40a77714d5df tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:52.997120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-202b2a67-0649-4aee-aa31-40a77714d5df tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:53.000715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-202b2a67-0649-4aee-aa31-40a77714d5df tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:53.007156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-202b2a67-0649-4aee-aa31-40a77714d5df tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:53.008383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-202b2a67-0649-4aee-aa31-40a77714d5df tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:53.287836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-202b2a67-0649-4aee-aa31-40a77714d5df tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:53.318841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-202b2a67-0649-4aee-aa31-40a77714d5df tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:53.326749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-202b2a67-0649-4aee-aa31-40a77714d5df tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:53.333098 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-202b2a67-0649-4aee-aa31-40a77714d5df tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1409 microversion: 2.54 time: 0.361793 Sep 07 13:00:53.338055 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2762/5478] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:00:52 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1409 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:00:54.380744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-21502ab2-a565-46e0-98a5-1368f875fb7a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:54.381907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-21502ab2-a565-46e0-98a5-1368f875fb7a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:54.409665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21502ab2-a565-46e0-98a5-1368f875fb7a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:54.414453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21502ab2-a565-46e0-98a5-1368f875fb7a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:54.418579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21502ab2-a565-46e0-98a5-1368f875fb7a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:54.422661 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21502ab2-a565-46e0-98a5-1368f875fb7a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:54.432173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21502ab2-a565-46e0-98a5-1368f875fb7a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:54.435413 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-21502ab2-a565-46e0-98a5-1368f875fb7a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:54.484220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e1b56e2d-1393-4aba-80bb-a3145fb0da20 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:54.495332 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e1b56e2d-1393-4aba-80bb-a3145fb0da20 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63" status: 200 len: 1368 microversion: 2.1 time: 2.027094 Sep 07 13:00:54.502828 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2717/5479] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:00:52 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63 => generated 1368 bytes in 2036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:00:54.650847 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-21502ab2-a565-46e0-98a5-1368f875fb7a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:54.700692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-21502ab2-a565-46e0-98a5-1368f875fb7a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:54.704063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-21502ab2-a565-46e0-98a5-1368f875fb7a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:54.712770 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-21502ab2-a565-46e0-98a5-1368f875fb7a tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1409 microversion: 2.54 time: 0.332259 Sep 07 13:00:54.714109 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2763/5480] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:00:54 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1409 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:00:55.541591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f81b9fb2-a89f-4f82-8692-d81bb78b3409 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:55.544547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f81b9fb2-a89f-4f82-8692-d81bb78b3409 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:55.563665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f81b9fb2-a89f-4f82-8692-d81bb78b3409 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:55.564756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f81b9fb2-a89f-4f82-8692-d81bb78b3409 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:55.568267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f81b9fb2-a89f-4f82-8692-d81bb78b3409 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:55.569686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f81b9fb2-a89f-4f82-8692-d81bb78b3409 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:55.571865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f81b9fb2-a89f-4f82-8692-d81bb78b3409 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:55.573142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f81b9fb2-a89f-4f82-8692-d81bb78b3409 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:55.756266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dbccfd0e-d985-4e62-a895-7bd02735a20b tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:55.757343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dbccfd0e-d985-4e62-a895-7bd02735a20b tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:55.777282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dbccfd0e-d985-4e62-a895-7bd02735a20b tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:55.778812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dbccfd0e-d985-4e62-a895-7bd02735a20b tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:55.780119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dbccfd0e-d985-4e62-a895-7bd02735a20b tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:55.781903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dbccfd0e-d985-4e62-a895-7bd02735a20b tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:55.783061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dbccfd0e-d985-4e62-a895-7bd02735a20b tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:55.784190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dbccfd0e-d985-4e62-a895-7bd02735a20b tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:56.696819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dbccfd0e-d985-4e62-a895-7bd02735a20b tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:56.728534 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dbccfd0e-d985-4e62-a895-7bd02735a20b tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:56.730076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dbccfd0e-d985-4e62-a895-7bd02735a20b tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:56.740289 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dbccfd0e-d985-4e62-a895-7bd02735a20b tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1409 microversion: 2.54 time: 0.988054 Sep 07 13:00:56.741997 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2764/5481] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:00:55 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1409 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:00:57.090125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f81b9fb2-a89f-4f82-8692-d81bb78b3409 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:57.124286 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f81b9fb2-a89f-4f82-8692-d81bb78b3409 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63" status: 200 len: 1368 microversion: 2.1 time: 1.597318 Sep 07 13:00:57.138147 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2718/5482] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:00:55 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63 => generated 1368 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:00:57.792123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c58c2a4-b0d6-407a-921d-f4a73e455f41 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:57.793574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7c58c2a4-b0d6-407a-921d-f4a73e455f41 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:57.823961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c58c2a4-b0d6-407a-921d-f4a73e455f41 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:57.824728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c58c2a4-b0d6-407a-921d-f4a73e455f41 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:57.826104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c58c2a4-b0d6-407a-921d-f4a73e455f41 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:57.828605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c58c2a4-b0d6-407a-921d-f4a73e455f41 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:57.830341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c58c2a4-b0d6-407a-921d-f4a73e455f41 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:57.832755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c58c2a4-b0d6-407a-921d-f4a73e455f41 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:58.181269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-46082e54-20b0-4194-94ae-2db25b9fc033 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:58.183283 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-46082e54-20b0-4194-94ae-2db25b9fc033 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:58.205029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46082e54-20b0-4194-94ae-2db25b9fc033 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:58.206574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46082e54-20b0-4194-94ae-2db25b9fc033 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:58.208852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46082e54-20b0-4194-94ae-2db25b9fc033 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:58.210344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46082e54-20b0-4194-94ae-2db25b9fc033 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:58.214440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46082e54-20b0-4194-94ae-2db25b9fc033 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:58.215428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46082e54-20b0-4194-94ae-2db25b9fc033 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:58.275122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7c58c2a4-b0d6-407a-921d-f4a73e455f41 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:58.311642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7c58c2a4-b0d6-407a-921d-f4a73e455f41 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:58.313461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7c58c2a4-b0d6-407a-921d-f4a73e455f41 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:58.325909 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7c58c2a4-b0d6-407a-921d-f4a73e455f41 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1409 microversion: 2.54 time: 0.542744 Sep 07 13:00:58.327809 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2765/5483] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:00:57 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1409 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:00:59.387123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ecdf2ea4-5e78-4a56-8316-d7d4454a7c92 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:59.388824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ecdf2ea4-5e78-4a56-8316-d7d4454a7c92 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:59.416276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ecdf2ea4-5e78-4a56-8316-d7d4454a7c92 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:59.421009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ecdf2ea4-5e78-4a56-8316-d7d4454a7c92 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:59.424709 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ecdf2ea4-5e78-4a56-8316-d7d4454a7c92 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:59.426312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ecdf2ea4-5e78-4a56-8316-d7d4454a7c92 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:00:59.428131 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ecdf2ea4-5e78-4a56-8316-d7d4454a7c92 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:00:59.435331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ecdf2ea4-5e78-4a56-8316-d7d4454a7c92 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:00:59.796473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ecdf2ea4-5e78-4a56-8316-d7d4454a7c92 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:59.834681 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ecdf2ea4-5e78-4a56-8316-d7d4454a7c92 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:59.853154 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ecdf2ea4-5e78-4a56-8316-d7d4454a7c92 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:59.855272 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ecdf2ea4-5e78-4a56-8316-d7d4454a7c92 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1409 microversion: 2.54 time: 0.474530 Sep 07 13:00:59.913609 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2766/5484] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:00:59 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1409 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:00:59.938806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2dcb3eb3-a0f3-4a7d-82c5-5281259013ef tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:00:59.958567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2dcb3eb3-a0f3-4a7d-82c5-5281259013ef tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:00:59.959398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-46082e54-20b0-4194-94ae-2db25b9fc033 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:00:59.973798 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-46082e54-20b0-4194-94ae-2db25b9fc033 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63" status: 200 len: 1368 microversion: 2.1 time: 1.798006 Sep 07 13:00:59.974258 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2719/5485] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:00:58 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63 => generated 1368 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:00:59.995998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dcb3eb3-a0f3-4a7d-82c5-5281259013ef tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:00.001621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dcb3eb3-a0f3-4a7d-82c5-5281259013ef tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:00.003313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dcb3eb3-a0f3-4a7d-82c5-5281259013ef tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:00.009705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-bc8bad1b-2002-47c9-a8b7-fe0c114b0aba req-0d5c6de7-a2f7-4d5b-9142-990558414a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43152d55-6621-43f6-bb60-1be3d638859c", "tag": "443262c8-fc2a-41c4-b789-a7672d694de2"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:01:00.011888 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dcb3eb3-a0f3-4a7d-82c5-5281259013ef tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:00.013228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dcb3eb3-a0f3-4a7d-82c5-5281259013ef tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:00.014459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2dcb3eb3-a0f3-4a7d-82c5-5281259013ef tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:00.064090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-bc8bad1b-2002-47c9-a8b7-fe0c114b0aba req-0d5c6de7-a2f7-4d5b-9142-990558414a18 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:00.074052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-bc8bad1b-2002-47c9-a8b7-fe0c114b0aba req-0d5c6de7-a2f7-4d5b-9142-990558414a18 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:00.077091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-bc8bad1b-2002-47c9-a8b7-fe0c114b0aba req-0d5c6de7-a2f7-4d5b-9142-990558414a18 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:00.114190 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-2dcb3eb3-a0f3-4a7d-82c5-5281259013ef tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] HTTP exception thrown: Instance ffe6581c-7070-48c5-a16d-fa30b22567d4 could not be found. Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2dcb3eb3-a0f3-4a7d-82c5-5281259013ef tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Request method failure captured: Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 HTTP/1.1 Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNw5hacCrPa_HA67UL8Q8JsIVT06ZBnDw_7nEL37LMgyCxq7HTiBwQQLT7YgngjCO9dDbCsgT7vkiCHkYFkVZvw6W7F-_hBjld_38ZCU8IPDT9dG3fgXHphQDQ20Ayfi0-lKCoj-hwol4f9c1wYW0KnUBkrb3phyz4ShjlWqaTo78s Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: fdbe65a861ac4b9ea7e5c2bbd4d955b3 Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-358704052 Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdbe65a861ac4b9ea7e5c2bbd4d955b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fdbe65a861ac4b9ea7e5c2bbd4d955b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fdbe65a861ac4b9ea7e5c2bbd4d955b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdbe65a861ac4b9ea7e5c2bbd4d955b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AttachVolumeShelveTestJSON-358704052 Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: fdbe65a861ac4b9ea7e5c2bbd4d955b3 Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-358704052 Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AttachVolumeShelveTestJSON-358704052-project Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 9e1c3623bbda4cbdbf6b5d2dedb48f74 Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AttachVolumeShelveTestJSON-358704052-project Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance ffe6581c-7070-48c5-a16d-fa30b22567d4 could not be found. Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'ffe6581c-7070-48c5-a16d-fa30b22567d4'} Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe6581c-7070-48c5-a16d-fa30b22567d4 could not be found. Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:01:00.119402 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:01:00.124295 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe6581c-7070-48c5-a16d-fa30b22567d4 could not be found. Sep 07 13:01:00.124295 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:01:00.124295 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:01:00.124295 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:01:00.124295 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:00.124295 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:01:00.124295 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:01:00.124295 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:01:00.124295 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:01:00.124295 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe6581c-7070-48c5-a16d-fa30b22567d4 could not be found. Sep 07 13:01:00.124295 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:01:00.126242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2dcb3eb3-a0f3-4a7d-82c5-5281259013ef tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Returning 404 to user: Instance ffe6581c-7070-48c5-a16d-fa30b22567d4 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:01:00.128331 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2dcb3eb3-a0f3-4a7d-82c5-5281259013ef tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 404 len: 111 microversion: 2.20 time: 0.213220 Sep 07 13:01:00.139109 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2767/5486] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 13:00:59 2022] DELETE /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 111 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:01:00.177953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6daf19bd-ac1d-4ed5-b37e-e8a980ac45b8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:00.179498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6daf19bd-ac1d-4ed5-b37e-e8a980ac45b8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] [instance: ffe6581c-7070-48c5-a16d-fa30b22567d4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:01:00.179924 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-bc8bad1b-2002-47c9-a8b7-fe0c114b0aba req-0d5c6de7-a2f7-4d5b-9142-990558414a18 service nova] Creating event network-changed:443262c8-fc2a-41c4-b789-a7672d694de2 for instance 43152d55-6621-43f6-bb60-1be3d638859c on n-h2-852087-9 Sep 07 13:01:00.213855 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6daf19bd-ac1d-4ed5-b37e-e8a980ac45b8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:00.217849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6daf19bd-ac1d-4ed5-b37e-e8a980ac45b8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:00.218107 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-bc8bad1b-2002-47c9-a8b7-fe0c114b0aba req-0d5c6de7-a2f7-4d5b-9142-990558414a18 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215319 Sep 07 13:01:00.218948 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2720/5487] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:00.220328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6daf19bd-ac1d-4ed5-b37e-e8a980ac45b8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:00.235186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6daf19bd-ac1d-4ed5-b37e-e8a980ac45b8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:00.236263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6daf19bd-ac1d-4ed5-b37e-e8a980ac45b8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:00.237524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6daf19bd-ac1d-4ed5-b37e-e8a980ac45b8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:00.342266 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-6daf19bd-ac1d-4ed5-b37e-e8a980ac45b8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] HTTP exception thrown: Instance ffe6581c-7070-48c5-a16d-fa30b22567d4 could not be found. Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6daf19bd-ac1d-4ed5-b37e-e8a980ac45b8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Request method failure captured: Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 HTTP/1.1 Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJNw5hacCrPa_HA67UL8Q8JsIVT06ZBnDw_7nEL37LMgyCxq7HTiBwQQLT7YgngjCO9dDbCsgT7vkiCHkYFkVZvw6W7F-_hBjld_38ZCU8IPDT9dG3fgXHphQDQ20Ayfi0-lKCoj-hwol4f9c1wYW0KnUBkrb3phyz4ShjlWqaTo78s Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: fdbe65a861ac4b9ea7e5c2bbd4d955b3 Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-358704052 Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdbe65a861ac4b9ea7e5c2bbd4d955b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fdbe65a861ac4b9ea7e5c2bbd4d955b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fdbe65a861ac4b9ea7e5c2bbd4d955b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdbe65a861ac4b9ea7e5c2bbd4d955b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AttachVolumeShelveTestJSON-358704052 Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: fdbe65a861ac4b9ea7e5c2bbd4d955b3 Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-358704052 Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AttachVolumeShelveTestJSON-358704052-project Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 9e1c3623bbda4cbdbf6b5d2dedb48f74 Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AttachVolumeShelveTestJSON-358704052-project Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance ffe6581c-7070-48c5-a16d-fa30b22567d4 could not be found. Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'ffe6581c-7070-48c5-a16d-fa30b22567d4'} Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe6581c-7070-48c5-a16d-fa30b22567d4 could not be found. Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe6581c-7070-48c5-a16d-fa30b22567d4 could not be found. Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:01:00.350735 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:01:00.364301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:01:00.364301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:00.364301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:01:00.364301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:01:00.364301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:01:00.364301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:01:00.364301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe6581c-7070-48c5-a16d-fa30b22567d4 could not be found. Sep 07 13:01:00.364301 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:01:00.369405 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6daf19bd-ac1d-4ed5-b37e-e8a980ac45b8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] Returning 404 to user: Instance ffe6581c-7070-48c5-a16d-fa30b22567d4 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:01:00.381684 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6daf19bd-ac1d-4ed5-b37e-e8a980ac45b8 tempest-AttachVolumeShelveTestJSON-358704052 tempest-AttachVolumeShelveTestJSON-358704052-project] 10.222.0.16 "GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4" status: 404 len: 111 microversion: 2.20 time: 0.219862 Sep 07 13:01:00.383434 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2768/5488] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:01:00 2022] GET /compute/v2.1/servers/ffe6581c-7070-48c5-a16d-fa30b22567d4 => generated 111 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:01:00.941824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-25b64588-5439-4293-924f-32cb729993ab tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:00.953632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-25b64588-5439-4293-924f-32cb729993ab tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:01:01.001916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dec47a61-f410-45ea-a263-e0df60b7e58a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:01.005544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dec47a61-f410-45ea-a263-e0df60b7e58a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:01:01.057295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dec47a61-f410-45ea-a263-e0df60b7e58a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:01.061347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dec47a61-f410-45ea-a263-e0df60b7e58a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:01.062593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25b64588-5439-4293-924f-32cb729993ab tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:01.067531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dec47a61-f410-45ea-a263-e0df60b7e58a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:01.071107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dec47a61-f410-45ea-a263-e0df60b7e58a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:01.073752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25b64588-5439-4293-924f-32cb729993ab tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:01.074699 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25b64588-5439-4293-924f-32cb729993ab tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:01.075580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25b64588-5439-4293-924f-32cb729993ab tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:01.076183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25b64588-5439-4293-924f-32cb729993ab tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:01.078834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dec47a61-f410-45ea-a263-e0df60b7e58a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:01.080165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dec47a61-f410-45ea-a263-e0df60b7e58a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:01.081343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25b64588-5439-4293-924f-32cb729993ab tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:02.627382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-25b64588-5439-4293-924f-32cb729993ab tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:02.639408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-25b64588-5439-4293-924f-32cb729993ab tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:02.641347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-25b64588-5439-4293-924f-32cb729993ab tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:02.653520 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-25b64588-5439-4293-924f-32cb729993ab tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1409 microversion: 2.54 time: 1.719953 Sep 07 13:01:02.670482 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2721/5489] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:01:00 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1409 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:01:02.697241 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-01156725-1a4c-471b-a7b4-a2a05dcbbda8 req-36c70c8f-f5a6-466d-888e-85854d0955fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dbd6ebd-a395-40cf-9aee-a3ec45adac63", "name": "network-vif-plugged", "status": "completed", "tag": "6d4c0a71-ad7c-4f97-8d06-18723a168f78"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:01:02.782137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-01156725-1a4c-471b-a7b4-a2a05dcbbda8 req-36c70c8f-f5a6-466d-888e-85854d0955fb service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:02.801041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-01156725-1a4c-471b-a7b4-a2a05dcbbda8 req-36c70c8f-f5a6-466d-888e-85854d0955fb service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:02.805026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-01156725-1a4c-471b-a7b4-a2a05dcbbda8 req-36c70c8f-f5a6-466d-888e-85854d0955fb service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:02.895330 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-01156725-1a4c-471b-a7b4-a2a05dcbbda8 req-36c70c8f-f5a6-466d-888e-85854d0955fb service nova] Creating event network-vif-plugged:6d4c0a71-ad7c-4f97-8d06-18723a168f78 for instance 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 on n-h2-852087-9 Sep 07 13:01:02.920112 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-01156725-1a4c-471b-a7b4-a2a05dcbbda8 req-36c70c8f-f5a6-466d-888e-85854d0955fb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.236419 Sep 07 13:01:02.921365 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2722/5490] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:03.727817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d5ecb82e-7459-4bcd-ae0f-a0fe39315be6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:03.728809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d5ecb82e-7459-4bcd-ae0f-a0fe39315be6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:01:03.742676 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dec47a61-f410-45ea-a263-e0df60b7e58a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:03.751044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5ecb82e-7459-4bcd-ae0f-a0fe39315be6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:03.758308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5ecb82e-7459-4bcd-ae0f-a0fe39315be6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:03.765893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5ecb82e-7459-4bcd-ae0f-a0fe39315be6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:03.766677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5ecb82e-7459-4bcd-ae0f-a0fe39315be6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:03.767318 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5ecb82e-7459-4bcd-ae0f-a0fe39315be6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:03.767786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5ecb82e-7459-4bcd-ae0f-a0fe39315be6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:03.798644 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dec47a61-f410-45ea-a263-e0df60b7e58a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63" status: 200 len: 1368 microversion: 2.1 time: 2.801671 Sep 07 13:01:03.809541 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2769/5491] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:01:00 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63 => generated 1368 bytes in 2817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:01:04.151607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d5ecb82e-7459-4bcd-ae0f-a0fe39315be6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:04.190297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d5ecb82e-7459-4bcd-ae0f-a0fe39315be6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:04.202344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d5ecb82e-7459-4bcd-ae0f-a0fe39315be6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:04.204590 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d5ecb82e-7459-4bcd-ae0f-a0fe39315be6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1409 microversion: 2.54 time: 0.484771 Sep 07 13:01:04.222177 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2723/5492] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:01:03 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1409 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:01:04.840190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5c546cd2-de8b-4aaf-8855-10332dec9b69 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:04.841826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5c546cd2-de8b-4aaf-8855-10332dec9b69 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:01:04.866098 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c546cd2-de8b-4aaf-8855-10332dec9b69 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:04.866948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c546cd2-de8b-4aaf-8855-10332dec9b69 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:04.867721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c546cd2-de8b-4aaf-8855-10332dec9b69 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:04.868697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c546cd2-de8b-4aaf-8855-10332dec9b69 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:04.869389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c546cd2-de8b-4aaf-8855-10332dec9b69 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:04.870053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c546cd2-de8b-4aaf-8855-10332dec9b69 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:05.248407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-de2382d8-d77f-4cdc-a473-bdf4ecdeb6a6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:05.249228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-de2382d8-d77f-4cdc-a473-bdf4ecdeb6a6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:01:05.264312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de2382d8-d77f-4cdc-a473-bdf4ecdeb6a6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:05.264698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de2382d8-d77f-4cdc-a473-bdf4ecdeb6a6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:05.266656 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de2382d8-d77f-4cdc-a473-bdf4ecdeb6a6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:05.268679 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de2382d8-d77f-4cdc-a473-bdf4ecdeb6a6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:05.269343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de2382d8-d77f-4cdc-a473-bdf4ecdeb6a6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:05.270971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de2382d8-d77f-4cdc-a473-bdf4ecdeb6a6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:05.718744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-de2382d8-d77f-4cdc-a473-bdf4ecdeb6a6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:05.739708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-de2382d8-d77f-4cdc-a473-bdf4ecdeb6a6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:05.743182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-de2382d8-d77f-4cdc-a473-bdf4ecdeb6a6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:05.759996 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-de2382d8-d77f-4cdc-a473-bdf4ecdeb6a6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1409 microversion: 2.54 time: 0.502517 Sep 07 13:01:05.763251 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2724/5493] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:01:05 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1409 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:01:06.256997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5c546cd2-de8b-4aaf-8855-10332dec9b69 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:06.280069 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5c546cd2-de8b-4aaf-8855-10332dec9b69 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63" status: 200 len: 1368 microversion: 2.1 time: 1.451448 Sep 07 13:01:06.299219 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2770/5494] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:01:04 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63 => generated 1368 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:01:06.797005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6970ecf5-1986-4af6-b730-4e227284dbdf tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:06.801696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6970ecf5-1986-4af6-b730-4e227284dbdf tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:01:06.832517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6970ecf5-1986-4af6-b730-4e227284dbdf tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:06.833428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6970ecf5-1986-4af6-b730-4e227284dbdf tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:06.841059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6970ecf5-1986-4af6-b730-4e227284dbdf tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:06.842649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6970ecf5-1986-4af6-b730-4e227284dbdf tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:06.843536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6970ecf5-1986-4af6-b730-4e227284dbdf tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:06.844351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6970ecf5-1986-4af6-b730-4e227284dbdf tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:07.287795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6970ecf5-1986-4af6-b730-4e227284dbdf tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:07.329199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-226a9cce-41ca-4f8f-9520-1a93e2fe455c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:07.335413 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-226a9cce-41ca-4f8f-9520-1a93e2fe455c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:01:07.345847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6970ecf5-1986-4af6-b730-4e227284dbdf tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:07.348901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-226a9cce-41ca-4f8f-9520-1a93e2fe455c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:07.350630 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-226a9cce-41ca-4f8f-9520-1a93e2fe455c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:07.351300 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-226a9cce-41ca-4f8f-9520-1a93e2fe455c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:07.352310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-226a9cce-41ca-4f8f-9520-1a93e2fe455c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:07.353915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-226a9cce-41ca-4f8f-9520-1a93e2fe455c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:07.355271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-226a9cce-41ca-4f8f-9520-1a93e2fe455c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:07.358966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6970ecf5-1986-4af6-b730-4e227284dbdf tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:07.361396 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6970ecf5-1986-4af6-b730-4e227284dbdf tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1409 microversion: 2.54 time: 0.572748 Sep 07 13:01:07.378822 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2725/5495] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:01:06 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1409 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:01:07.747695 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-226a9cce-41ca-4f8f-9520-1a93e2fe455c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:07.765514 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-226a9cce-41ca-4f8f-9520-1a93e2fe455c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63" status: 200 len: 1557 microversion: 2.1 time: 0.440888 Sep 07 13:01:07.769331 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2771/5496] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:01:07 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63 => generated 1557 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:01:07.796086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5e9780af-966c-4f65-8d25-6921ecba1be8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:07.797010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5e9780af-966c-4f65-8d25-6921ecba1be8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:01:07.815880 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e9780af-966c-4f65-8d25-6921ecba1be8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:07.816640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e9780af-966c-4f65-8d25-6921ecba1be8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:07.821143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e9780af-966c-4f65-8d25-6921ecba1be8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:07.827858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e9780af-966c-4f65-8d25-6921ecba1be8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:07.828645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e9780af-966c-4f65-8d25-6921ecba1be8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:07.829257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e9780af-966c-4f65-8d25-6921ecba1be8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:08.018891 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5e9780af-966c-4f65-8d25-6921ecba1be8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.227352 Sep 07 13:01:08.019820 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2726/5497] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Sep 7 13:01:07 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-interface => generated 284 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:08.400912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-172e1885-7b36-41eb-8566-7e9f7bc61ff9 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:08.402513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-172e1885-7b36-41eb-8566-7e9f7bc61ff9 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:01:08.421636 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-172e1885-7b36-41eb-8566-7e9f7bc61ff9 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:08.422276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-172e1885-7b36-41eb-8566-7e9f7bc61ff9 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:08.422739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-172e1885-7b36-41eb-8566-7e9f7bc61ff9 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:08.426719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-172e1885-7b36-41eb-8566-7e9f7bc61ff9 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:08.428140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-172e1885-7b36-41eb-8566-7e9f7bc61ff9 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:08.429186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-172e1885-7b36-41eb-8566-7e9f7bc61ff9 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:08.561326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-172e1885-7b36-41eb-8566-7e9f7bc61ff9 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:08.613365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-172e1885-7b36-41eb-8566-7e9f7bc61ff9 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:08.622851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-172e1885-7b36-41eb-8566-7e9f7bc61ff9 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:08.630437 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-172e1885-7b36-41eb-8566-7e9f7bc61ff9 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1415 microversion: 2.54 time: 0.229908 Sep 07 13:01:08.633386 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2772/5498] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:01:08 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1415 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:01:09.680310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8dace3b7-eb7d-4221-8210-c0daaf047037 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:09.686807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8dace3b7-eb7d-4221-8210-c0daaf047037 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:01:09.722157 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dace3b7-eb7d-4221-8210-c0daaf047037 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:09.724304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dace3b7-eb7d-4221-8210-c0daaf047037 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:09.726484 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dace3b7-eb7d-4221-8210-c0daaf047037 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:09.750483 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dace3b7-eb7d-4221-8210-c0daaf047037 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:09.752684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dace3b7-eb7d-4221-8210-c0daaf047037 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:09.753697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8dace3b7-eb7d-4221-8210-c0daaf047037 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:09.916226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:10.256268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8dace3b7-eb7d-4221-8210-c0daaf047037 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:10.274737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8dace3b7-eb7d-4221-8210-c0daaf047037 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:10.277025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8dace3b7-eb7d-4221-8210-c0daaf047037 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:10.306019 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8dace3b7-eb7d-4221-8210-c0daaf047037 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1415 microversion: 2.54 time: 0.638744 Sep 07 13:01:10.329466 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2727/5499] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:01:09 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1415 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:01:11.345934 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-97d94404-011b-4452-a7cd-65adc8e549bb tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:11.350292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-97d94404-011b-4452-a7cd-65adc8e549bb tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:01:11.398519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97d94404-011b-4452-a7cd-65adc8e549bb tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:11.400366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97d94404-011b-4452-a7cd-65adc8e549bb tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:11.401823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97d94404-011b-4452-a7cd-65adc8e549bb tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:11.405367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97d94404-011b-4452-a7cd-65adc8e549bb tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:11.409239 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97d94404-011b-4452-a7cd-65adc8e549bb tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:11.410863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97d94404-011b-4452-a7cd-65adc8e549bb tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:11.567957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-97d94404-011b-4452-a7cd-65adc8e549bb tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:11.584559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-97d94404-011b-4452-a7cd-65adc8e549bb tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:11.589567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-97d94404-011b-4452-a7cd-65adc8e549bb tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:11.593196 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-97d94404-011b-4452-a7cd-65adc8e549bb tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1415 microversion: 2.54 time: 0.260943 Sep 07 13:01:11.609236 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2773/5500] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:01:11 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1415 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:01:12.667451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e25f7c59-8a8c-41e1-be52-40d6286e1dcd tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:12.668725 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e25f7c59-8a8c-41e1-be52-40d6286e1dcd tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:01:12.723939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e25f7c59-8a8c-41e1-be52-40d6286e1dcd tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:12.725248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e25f7c59-8a8c-41e1-be52-40d6286e1dcd tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:12.726323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e25f7c59-8a8c-41e1-be52-40d6286e1dcd tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:12.727936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e25f7c59-8a8c-41e1-be52-40d6286e1dcd tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:12.729043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e25f7c59-8a8c-41e1-be52-40d6286e1dcd tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:12.730187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e25f7c59-8a8c-41e1-be52-40d6286e1dcd tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:13.059755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e25f7c59-8a8c-41e1-be52-40d6286e1dcd tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:13.095300 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e25f7c59-8a8c-41e1-be52-40d6286e1dcd tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:13.106884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e25f7c59-8a8c-41e1-be52-40d6286e1dcd tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:13.109293 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e25f7c59-8a8c-41e1-be52-40d6286e1dcd tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1400 microversion: 2.54 time: 0.468348 Sep 07 13:01:13.114878 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2728/5501] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:01:12 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1400 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:01:13.151910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-55c6fe02-6286-4c8c-a4c6-1f475d95fa46 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '.version_select at 0x7fc418269700>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:13.230289 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-55c6fe02-6286-4c8c-a4c6-1f475d95fa46 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1514236465" status: 204 len: 0 microversion: 2.54 time: 0.088805 Sep 07 13:01:13.231800 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2774/5502] 10.222.0.16 () {60 vars in 1319 bytes} [Wed Sep 7 13:01:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1514236465 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 13:01:13.248490 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f12d657f-aae7-4858-8f8d-fda069fd3a64 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:13.250152 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f12d657f-aae7-4858-8f8d-fda069fd3a64 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:01:13.259670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f12d657f-aae7-4858-8f8d-fda069fd3a64 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:13.260464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f12d657f-aae7-4858-8f8d-fda069fd3a64 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:13.261134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f12d657f-aae7-4858-8f8d-fda069fd3a64 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:13.262175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f12d657f-aae7-4858-8f8d-fda069fd3a64 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:13.263108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f12d657f-aae7-4858-8f8d-fda069fd3a64 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:13.263972 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f12d657f-aae7-4858-8f8d-fda069fd3a64 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:13.305361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f12d657f-aae7-4858-8f8d-fda069fd3a64 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:01:13.523820 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f12d657f-aae7-4858-8f8d-fda069fd3a64 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 204 len: 0 microversion: 2.54 time: 0.278845 Sep 07 13:01:13.526931 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2729/5503] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Sep 7 13:01:13 2022] DELETE /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 13:01:13.539551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b087d888-3165-47db-a7aa-0f2d3f5838f6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:13.540395 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b087d888-3165-47db-a7aa-0f2d3f5838f6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:01:13.560743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b087d888-3165-47db-a7aa-0f2d3f5838f6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:13.564350 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b087d888-3165-47db-a7aa-0f2d3f5838f6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:13.566336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b087d888-3165-47db-a7aa-0f2d3f5838f6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:13.568390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b087d888-3165-47db-a7aa-0f2d3f5838f6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:13.571457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b087d888-3165-47db-a7aa-0f2d3f5838f6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:13.572916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b087d888-3165-47db-a7aa-0f2d3f5838f6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:13.662902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:13.859955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b087d888-3165-47db-a7aa-0f2d3f5838f6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:13.875459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b087d888-3165-47db-a7aa-0f2d3f5838f6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:13.877348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b087d888-3165-47db-a7aa-0f2d3f5838f6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:13.878661 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b087d888-3165-47db-a7aa-0f2d3f5838f6 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1406 microversion: 2.54 time: 0.345506 Sep 07 13:01:13.879247 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2775/5504] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:01:13 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1406 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:01:14.692416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-630e5743-da0c-479b-b4fd-541f996eb5c1 req-a5988dc5-8e4b-4f33-ba09-52efd4d0b58a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dbd6ebd-a395-40cf-9aee-a3ec45adac63", "tag": "6d4c0a71-ad7c-4f97-8d06-18723a168f78"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:01:14.734022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:14.738291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-630e5743-da0c-479b-b4fd-541f996eb5c1 req-a5988dc5-8e4b-4f33-ba09-52efd4d0b58a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:14.738828 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-630e5743-da0c-479b-b4fd-541f996eb5c1 req-a5988dc5-8e4b-4f33-ba09-52efd4d0b58a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:14.741154 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-630e5743-da0c-479b-b4fd-541f996eb5c1 req-a5988dc5-8e4b-4f33-ba09-52efd4d0b58a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:14.787898 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-630e5743-da0c-479b-b4fd-541f996eb5c1 req-a5988dc5-8e4b-4f33-ba09-52efd4d0b58a service nova] Creating event network-changed:6d4c0a71-ad7c-4f97-8d06-18723a168f78 for instance 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 on n-h2-852087-9 Sep 07 13:01:14.804831 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-630e5743-da0c-479b-b4fd-541f996eb5c1 req-a5988dc5-8e4b-4f33-ba09-52efd4d0b58a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117296 Sep 07 13:01:14.805920 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2730/5505] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:01:14.912117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a1d687ae-a3a2-4ef7-9a8b-d99ca8275e3c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:14.913110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a1d687ae-a3a2-4ef7-9a8b-d99ca8275e3c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:01:14.937231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:14.944272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1d687ae-a3a2-4ef7-9a8b-d99ca8275e3c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:14.944979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1d687ae-a3a2-4ef7-9a8b-d99ca8275e3c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:14.945449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1d687ae-a3a2-4ef7-9a8b-d99ca8275e3c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:14.948652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1d687ae-a3a2-4ef7-9a8b-d99ca8275e3c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:14.949158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1d687ae-a3a2-4ef7-9a8b-d99ca8275e3c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:14.950808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1d687ae-a3a2-4ef7-9a8b-d99ca8275e3c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:15.225433 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a1d687ae-a3a2-4ef7-9a8b-d99ca8275e3c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:15.245600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a1d687ae-a3a2-4ef7-9a8b-d99ca8275e3c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:15.251523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a1d687ae-a3a2-4ef7-9a8b-d99ca8275e3c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:15.257795 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a1d687ae-a3a2-4ef7-9a8b-d99ca8275e3c tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1406 microversion: 2.54 time: 0.352320 Sep 07 13:01:15.258566 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2776/5506] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:01:14 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1406 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 13:01:16.316446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-214fcc6b-d56b-4ce5-912a-242b9a94f29f tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:16.317465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-214fcc6b-d56b-4ce5-912a-242b9a94f29f tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:01:16.345427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-214fcc6b-d56b-4ce5-912a-242b9a94f29f tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:16.350124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-214fcc6b-d56b-4ce5-912a-242b9a94f29f tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:16.350819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-214fcc6b-d56b-4ce5-912a-242b9a94f29f tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:16.351841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-214fcc6b-d56b-4ce5-912a-242b9a94f29f tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:16.352613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-214fcc6b-d56b-4ce5-912a-242b9a94f29f tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:16.353166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-214fcc6b-d56b-4ce5-912a-242b9a94f29f tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:16.675726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-214fcc6b-d56b-4ce5-912a-242b9a94f29f tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:16.692305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-214fcc6b-d56b-4ce5-912a-242b9a94f29f tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:16.694443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-214fcc6b-d56b-4ce5-912a-242b9a94f29f tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ceff9982dde545f08aa7a57cc48775cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba08766ddf2d4a01b95b3e54a734bd78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:01:16.723732 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-214fcc6b-d56b-4ce5-912a-242b9a94f29f tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 200 len: 1406 microversion: 2.54 time: 0.393502 Sep 07 13:01:16.725817 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2731/5507] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:01:16 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 1406 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 13:01:17.652221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e4f8ae73-14d1-40f4-bdb3-66ebc317fe53 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Action: 'create', calling method: .version_select at 0x7fc413ee15e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-185553610"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:01:17.777676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c72b28bc-528f-4d1f-92f5-364d5b1dd600 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:17.782829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c72b28bc-528f-4d1f-92f5-364d5b1dd600 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] [instance: 1537d630-a6cb-41c7-a09c-e97a46e42df7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:01:17.805465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c72b28bc-528f-4d1f-92f5-364d5b1dd600 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:17.806113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c72b28bc-528f-4d1f-92f5-364d5b1dd600 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:17.807072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c72b28bc-528f-4d1f-92f5-364d5b1dd600 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:17.808994 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c72b28bc-528f-4d1f-92f5-364d5b1dd600 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:17.810934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c72b28bc-528f-4d1f-92f5-364d5b1dd600 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:17.811550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c72b28bc-528f-4d1f-92f5-364d5b1dd600 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:17.836801 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-c72b28bc-528f-4d1f-92f5-364d5b1dd600 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] HTTP exception thrown: Instance 1537d630-a6cb-41c7-a09c-e97a46e42df7 could not be found. Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c72b28bc-528f-4d1f-92f5-364d5b1dd600 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Request method failure captured: Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 HTTP/1.1 Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJXpn098fHVC_TH-vOl0tA-nt6EL5L0CQ1-YKuXFO60G9AikUxjdek9o5QhYgJgtrF1T40P3-HJ78LYQqPI7CBj6mBJ9tuQU_ASCCMuFz_vhteT92uuW2N5sWPT4JwQ4-HheMlBbaNg7FMoTPZGRwk3TAjX9bpQVH1-cslhdJn-jbjQ Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: X-Openstack-Nova-Api-Version: 2.54 Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: ba08766ddf2d4a01b95b3e54a734bd78 Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerShowV254Test-61130201 Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba08766ddf2d4a01b95b3e54a734bd78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba08766ddf2d4a01b95b3e54a734bd78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba08766ddf2d4a01b95b3e54a734bd78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba08766ddf2d4a01b95b3e54a734bd78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerShowV254Test-61130201 Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: ba08766ddf2d4a01b95b3e54a734bd78 Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerShowV254Test-61130201 Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerShowV254Test-61130201-project Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: ceff9982dde545f08aa7a57cc48775cf Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerShowV254Test-61130201-project Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 1537d630-a6cb-41c7-a09c-e97a46e42df7 could not be found. Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '1537d630-a6cb-41c7-a09c-e97a46e42df7'} Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1537d630-a6cb-41c7-a09c-e97a46e42df7 could not be found. Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1537d630-a6cb-41c7-a09c-e97a46e42df7 could not be found. Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:01:17.840533 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:01:17.849357 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:17.849357 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:01:17.849357 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:01:17.849357 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:01:17.849357 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:01:17.849357 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1537d630-a6cb-41c7-a09c-e97a46e42df7 could not be found. Sep 07 13:01:17.849357 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:01:17.849357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c72b28bc-528f-4d1f-92f5-364d5b1dd600 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] Returning 404 to user: Instance 1537d630-a6cb-41c7-a09c-e97a46e42df7 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:01:17.849357 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c72b28bc-528f-4d1f-92f5-364d5b1dd600 tempest-ServerShowV254Test-61130201 tempest-ServerShowV254Test-61130201-project] 10.222.0.16 "GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7" status: 404 len: 111 microversion: 2.54 time: 0.070675 Sep 07 13:01:17.849357 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2732/5508] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Sep 7 13:01:17 2022] GET /compute/v2.1/servers/1537d630-a6cb-41c7-a09c-e97a46e42df7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 07 13:01:18.542230 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e4f8ae73-14d1-40f4-bdb3-66ebc317fe53 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.146441 Sep 07 13:01:18.543460 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2777/5509] 10.222.0.16 () {60 vars in 1155 bytes} [Wed Sep 7 13:01:17 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1149 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 07 13:01:18.561773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-319f57b2-ec40-4c1d-b763-e2eda083d0d9 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Calling method '.version_select at 0x7fc418196d30>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:18.691044 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-319f57b2-ec40-4c1d-b763-e2eda083d0d9 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/160126d0-7245-403b-a190-05fcb0f501d8" status: 200 len: 344 microversion: 2.1 time: 0.138566 Sep 07 13:01:18.691648 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2733/5510] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Sep 7 13:01:18 2022] GET /compute/v2.1/os-volumes/160126d0-7245-403b-a190-05fcb0f501d8 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:19.711964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3126886c-8f77-4ebc-ad8e-c0416263e9ef tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Calling method '.version_select at 0x7fc413ee1160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:19.920462 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3126886c-8f77-4ebc-ad8e-c0416263e9ef tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/160126d0-7245-403b-a190-05fcb0f501d8" status: 200 len: 344 microversion: 2.1 time: 0.216215 Sep 07 13:01:19.938758 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2778/5511] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Sep 7 13:01:19 2022] GET /compute/v2.1/os-volumes/160126d0-7245-403b-a190-05fcb0f501d8 => generated 344 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:20.947698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c738f91b-be9f-441b-aa5d-82248ca9261d tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Calling method '.version_select at 0x7fc419336430>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:21.075950 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c738f91b-be9f-441b-aa5d-82248ca9261d tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/160126d0-7245-403b-a190-05fcb0f501d8" status: 200 len: 345 microversion: 2.1 time: 0.133660 Sep 07 13:01:21.077575 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2734/5512] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Sep 7 13:01:20 2022] GET /compute/v2.1/os-volumes/160126d0-7245-403b-a190-05fcb0f501d8 => generated 345 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:21.108195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-26551f24-5a5f-4a07-97f2-56e8e8f9081b tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Action: 'create', calling method: .version_select at 0x7fc4183ad040>, body: {"snapshot": {"volume_id": "160126d0-7245-403b-a190-05fcb0f501d8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-446091826"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:01:21.579951 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-26551f24-5a5f-4a07-97f2-56e8e8f9081b tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.480617 Sep 07 13:01:21.580986 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2779/5513] 10.222.0.16 () {60 vars in 1162 bytes} [Wed Sep 7 13:01:21 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:21.602560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-628c952b-008f-4fcd-a216-e8289c0298dd tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Calling method '.version_select at 0x7fc419230dc0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:21.799579 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-628c952b-008f-4fcd-a216-e8289c0298dd tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/0318a09d-7105-4c33-a245-807554366ce3" status: 200 len: 286 microversion: 2.1 time: 0.203974 Sep 07 13:01:21.814546 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2735/5514] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Sep 7 13:01:21 2022] GET /compute/v2.1/os-snapshots/0318a09d-7105-4c33-a245-807554366ce3 => generated 286 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:01:21.820491 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-694a11e2-bd39-43ea-8a16-89ec303dface tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Calling method '.version_select at 0x7fc4183f6c10>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:21.922488 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-694a11e2-bd39-43ea-8a16-89ec303dface tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.106664 Sep 07 13:01:21.930259 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2780/5515] 10.222.0.16 () {58 vars in 1140 bytes} [Wed Sep 7 13:01:21 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:01:21.936441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b3b37eb5-99f6-4c2a-a8a2-ca83fb7371ef tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Calling method '.version_select at 0x7fc41d20fdc0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:21.981001 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b3b37eb5-99f6-4c2a-a8a2-ca83fb7371ef tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/0318a09d-7105-4c33-a245-807554366ce3" status: 200 len: 286 microversion: 2.1 time: 0.048790 Sep 07 13:01:21.982470 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2736/5516] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Sep 7 13:01:21 2022] GET /compute/v2.1/os-snapshots/0318a09d-7105-4c33-a245-807554366ce3 => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:23.003758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-42d56fc6-2123-46a9-a918-9f7085ffd095 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Calling method '.version_select at 0x7fc413e91ca0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:23.098369 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-42d56fc6-2123-46a9-a918-9f7085ffd095 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/0318a09d-7105-4c33-a245-807554366ce3" status: 200 len: 286 microversion: 2.1 time: 0.104697 Sep 07 13:01:23.100246 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2781/5517] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Sep 7 13:01:22 2022] GET /compute/v2.1/os-snapshots/0318a09d-7105-4c33-a245-807554366ce3 => generated 286 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:24.139901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e5f668ee-6a61-40e9-b890-2aa863288f23 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Calling method '.version_select at 0x7fc4190b3af0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:24.213881 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e5f668ee-6a61-40e9-b890-2aa863288f23 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/0318a09d-7105-4c33-a245-807554366ce3" status: 200 len: 286 microversion: 2.1 time: 0.098793 Sep 07 13:01:24.215130 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2737/5518] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Sep 7 13:01:24 2022] GET /compute/v2.1/os-snapshots/0318a09d-7105-4c33-a245-807554366ce3 => generated 286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:25.241853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:25.243466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:25.275696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2df0ea5d-7ca0-4e0b-9c74-463c3f9d91ae tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Calling method '.version_select at 0x7fc413fb43a0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:25.576318 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2df0ea5d-7ca0-4e0b-9c74-463c3f9d91ae tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/0318a09d-7105-4c33-a245-807554366ce3" status: 200 len: 286 microversion: 2.1 time: 0.345834 Sep 07 13:01:25.577840 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2782/5519] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Sep 7 13:01:25 2022] GET /compute/v2.1/os-snapshots/0318a09d-7105-4c33-a245-807554366ce3 => generated 286 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:26.592262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-06e9faaa-d3e7-4b1f-bbea-da091262acb4 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Calling method '.version_select at 0x7fc41982fd30>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:26.665111 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-06e9faaa-d3e7-4b1f-bbea-da091262acb4 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/0318a09d-7105-4c33-a245-807554366ce3" status: 200 len: 287 microversion: 2.1 time: 0.076258 Sep 07 13:01:26.666913 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2738/5520] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Sep 7 13:01:26 2022] GET /compute/v2.1/os-snapshots/0318a09d-7105-4c33-a245-807554366ce3 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:26.686910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d19bd88-9b35-40d6-99f0-fab74e3d6b5f tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Calling method '.version_select at 0x7fc413e9aa60>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:26.820254 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1d19bd88-9b35-40d6-99f0-fab74e3d6b5f tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/0318a09d-7105-4c33-a245-807554366ce3" status: 202 len: 0 microversion: 2.1 time: 0.142609 Sep 07 13:01:26.823251 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2783/5521] 10.222.0.16 () {58 vars in 1254 bytes} [Wed Sep 7 13:01:26 2022] DELETE /compute/v2.1/os-snapshots/0318a09d-7105-4c33-a245-807554366ce3 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:01:26.836825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c54a7a1f-98c5-47b8-be2d-3f97c675bff0 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Calling method '.version_select at 0x7fc4198ce940>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:26.939431 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c54a7a1f-98c5-47b8-be2d-3f97c675bff0 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/0318a09d-7105-4c33-a245-807554366ce3" status: 200 len: 286 microversion: 2.1 time: 0.109458 Sep 07 13:01:26.945527 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2739/5522] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Sep 7 13:01:26 2022] GET /compute/v2.1/os-snapshots/0318a09d-7105-4c33-a245-807554366ce3 => generated 286 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:27.975809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-999045b9-1ae3-4719-b8d1-158a367593cd tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Calling method '.version_select at 0x7fc413e91e50>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:28.106567 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-999045b9-1ae3-4719-b8d1-158a367593cd tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/0318a09d-7105-4c33-a245-807554366ce3" status: 200 len: 286 microversion: 2.1 time: 0.147457 Sep 07 13:01:28.118320 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2784/5523] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Sep 7 13:01:27 2022] GET /compute/v2.1/os-snapshots/0318a09d-7105-4c33-a245-807554366ce3 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:01:29.124821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3ce75720-00f9-4cc4-9a5b-9249629e39eb tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Calling method '.version_select at 0x7fc4191e29d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:29.147461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=5 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:29.154484 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:29.291098 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3ce75720-00f9-4cc4-9a5b-9249629e39eb tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/0318a09d-7105-4c33-a245-807554366ce3" status: 200 len: 286 microversion: 2.1 time: 0.170351 Sep 07 13:01:29.291714 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2740/5524] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Sep 7 13:01:29 2022] GET /compute/v2.1/os-snapshots/0318a09d-7105-4c33-a245-807554366ce3 => generated 286 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:30.323754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b4b9cd94-c0c5-4c3b-9239-a09964429de9 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Calling method '.version_select at 0x7fc413e9ac10>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:30.504577 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b4b9cd94-c0c5-4c3b-9239-a09964429de9 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/0318a09d-7105-4c33-a245-807554366ce3" status: 200 len: 286 microversion: 2.1 time: 0.199060 Sep 07 13:01:30.506319 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2785/5525] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Sep 7 13:01:30 2022] GET /compute/v2.1/os-snapshots/0318a09d-7105-4c33-a245-807554366ce3 => generated 286 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:31.559219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b035692c-6dc1-4835-b8d7-e4645a733664 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Calling method '.version_select at 0x7fc4190b3430>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:31.676148 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-b035692c-6dc1-4835-b8d7-e4645a733664 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] HTTP exception thrown: Snapshot 0318a09d-7105-4c33-a245-807554366ce3 could not be found. Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b035692c-6dc1-4835-b8d7-e4645a733664 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Request method failure captured: Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-snapshots/0318a09d-7105-4c33-a245-807554366ce3 HTTP/1.1 Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJYdBNdWtlmFxQPclEvN9L2yXeZ2_nKqkF_GQ5hz7FaGaaoo8vY6e3-aL651vk5SHd-02aKeAEgP2L4UMTdGD8IoOIq3cfOnVK7IOdPxyA9kFsqdAU6nVR8XzNHKeatJpQumierAbruCDrIpBxBnS8UngdWzewnR236OSBx9Nf33OVs Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8e1ee9bba1824593960a735254954960 Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1478800577 Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e1ee9bba1824593960a735254954960"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e1ee9bba1824593960a735254954960"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e1ee9bba1824593960a735254954960"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e1ee9bba1824593960a735254954960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1478800577 Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8e1ee9bba1824593960a735254954960 Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1478800577 Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-VolumesSnapshotsTestJSON-1478800577-project Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 64990ef381ec4163a7abcc05a73ec6e6 Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1478800577-project Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: exception: Snapshot 0318a09d-7105-4c33-a245-807554366ce3 could not be found. Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '0318a09d-7105-4c33-a245-807554366ce3'} Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0318a09d-7105-4c33-a245-807554366ce3 could not be found. (HTTP 404) (Request-ID: req-eabb895f-1856-4a29-9904-457be06514c6) Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:01:31.682904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0318a09d-7105-4c33-a245-807554366ce3 could not be found. Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0318a09d-7105-4c33-a245-807554366ce3 could not be found. Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0318a09d-7105-4c33-a245-807554366ce3 could not be found. Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b035692c-6dc1-4835-b8d7-e4645a733664 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Returning 404 to user: Snapshot 0318a09d-7105-4c33-a245-807554366ce3 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b035692c-6dc1-4835-b8d7-e4645a733664 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/0318a09d-7105-4c33-a245-807554366ce3" status: 404 len: 111 microversion: 2.1 time: 0.166024 Sep 07 13:01:31.692901 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2741/5526] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Sep 7 13:01:31 2022] GET /compute/v2.1/os-snapshots/0318a09d-7105-4c33-a245-807554366ce3 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:01:31.708303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a03d81fc-ae6a-43e8-8ae2-db09ed02a83b tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Calling method '.version_select at 0x7fc413e8e820>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:31.975989 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a03d81fc-ae6a-43e8-8ae2-db09ed02a83b tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/160126d0-7245-403b-a190-05fcb0f501d8" status: 202 len: 0 microversion: 2.1 time: 0.283091 Sep 07 13:01:31.977409 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2786/5527] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Sep 7 13:01:31 2022] DELETE /compute/v2.1/os-volumes/160126d0-7245-403b-a190-05fcb0f501d8 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:01:31.989600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8a90f36d-ebf8-4c51-8dd2-995878c45729 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Calling method '.version_select at 0x7fc41971ec10>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:32.219674 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8a90f36d-ebf8-4c51-8dd2-995878c45729 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/160126d0-7245-403b-a190-05fcb0f501d8" status: 200 len: 344 microversion: 2.1 time: 0.235559 Sep 07 13:01:32.252177 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2742/5528] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Sep 7 13:01:31 2022] GET /compute/v2.1/os-volumes/160126d0-7245-403b-a190-05fcb0f501d8 => generated 344 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:33.253395 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5b2f7e62-f3fb-4eb9-a518-456e795e4546 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Calling method '.version_select at 0x7fc413ea1f70>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:33.471461 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5b2f7e62-f3fb-4eb9-a518-456e795e4546 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/160126d0-7245-403b-a190-05fcb0f501d8" status: 200 len: 344 microversion: 2.1 time: 0.233310 Sep 07 13:01:33.472661 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2787/5529] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Sep 7 13:01:33 2022] GET /compute/v2.1/os-volumes/160126d0-7245-403b-a190-05fcb0f501d8 => generated 344 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:01:34.493896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-519af4ca-1b98-4d15-9ada-39f65097dae4 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Calling method '.version_select at 0x7fc4190b3d30>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:34.798443 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-519af4ca-1b98-4d15-9ada-39f65097dae4 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/160126d0-7245-403b-a190-05fcb0f501d8" status: 200 len: 344 microversion: 2.1 time: 0.310508 Sep 07 13:01:34.808343 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2743/5530] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Sep 7 13:01:34 2022] GET /compute/v2.1/os-volumes/160126d0-7245-403b-a190-05fcb0f501d8 => generated 344 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:35.834536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7e8a12d0-6fea-4170-97e8-27183905286e tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Calling method '.version_select at 0x7fc413ee1ee0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:35.961440 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7e8a12d0-6fea-4170-97e8-27183905286e tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/160126d0-7245-403b-a190-05fcb0f501d8" status: 200 len: 344 microversion: 2.1 time: 0.149309 Sep 07 13:01:35.962467 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2788/5531] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Sep 7 13:01:35 2022] GET /compute/v2.1/os-volumes/160126d0-7245-403b-a190-05fcb0f501d8 => generated 344 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:36.981786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-73443094-dd21-4a37-8d85-007712b931d2 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Calling method '.version_select at 0x7fc41971ea60>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:37.102314 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-73443094-dd21-4a37-8d85-007712b931d2 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] HTTP exception thrown: Volume 160126d0-7245-403b-a190-05fcb0f501d8 could not be found. Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-73443094-dd21-4a37-8d85-007712b931d2 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Request method failure captured: Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-volumes/160126d0-7245-403b-a190-05fcb0f501d8 HTTP/1.1 Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJYdBNdWtlmFxQPclEvN9L2yXeZ2_nKqkF_GQ5hz7FaGaaoo8vY6e3-aL651vk5SHd-02aKeAEgP2L4UMTdGD8IoOIq3cfOnVK7IOdPxyA9kFsqdAU6nVR8XzNHKeatJpQumierAbruCDrIpBxBnS8UngdWzewnR236OSBx9Nf33OVs Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8e1ee9bba1824593960a735254954960 Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1478800577 Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e1ee9bba1824593960a735254954960"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e1ee9bba1824593960a735254954960"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e1ee9bba1824593960a735254954960"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e1ee9bba1824593960a735254954960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1478800577 Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8e1ee9bba1824593960a735254954960 Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1478800577 Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-VolumesSnapshotsTestJSON-1478800577-project Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 64990ef381ec4163a7abcc05a73ec6e6 Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1478800577-project Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: exception: Volume 160126d0-7245-403b-a190-05fcb0f501d8 could not be found. Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '160126d0-7245-403b-a190-05fcb0f501d8'} Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 160126d0-7245-403b-a190-05fcb0f501d8 could not be found. (HTTP 404) (Request-ID: req-e86fd36d-82ce-4f2f-9460-36107ea138ad) Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:01:37.105825 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 160126d0-7245-403b-a190-05fcb0f501d8 could not be found. Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 160126d0-7245-403b-a190-05fcb0f501d8 could not be found. Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 160126d0-7245-403b-a190-05fcb0f501d8 could not be found. Sep 07 13:01:37.110757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:01:37.118126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-73443094-dd21-4a37-8d85-007712b931d2 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Returning 404 to user: Volume 160126d0-7245-403b-a190-05fcb0f501d8 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:01:37.120171 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-73443094-dd21-4a37-8d85-007712b931d2 tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/160126d0-7245-403b-a190-05fcb0f501d8" status: 404 len: 109 microversion: 2.1 time: 0.146443 Sep 07 13:01:37.121168 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2744/5532] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Sep 7 13:01:36 2022] GET /compute/v2.1/os-volumes/160126d0-7245-403b-a190-05fcb0f501d8 => generated 109 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:01:37.147861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6be79f59-7c51-461d-9c97-ba2164699d4f tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Calling method '.version_select at 0x7fc413ea45e0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:37.268735 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-6be79f59-7c51-461d-9c97-ba2164699d4f tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] HTTP exception thrown: Volume 160126d0-7245-403b-a190-05fcb0f501d8 could not be found. Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6be79f59-7c51-461d-9c97-ba2164699d4f tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Request method failure captured: Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/os-volumes/160126d0-7245-403b-a190-05fcb0f501d8 HTTP/1.1 Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJYdBNdWtlmFxQPclEvN9L2yXeZ2_nKqkF_GQ5hz7FaGaaoo8vY6e3-aL651vk5SHd-02aKeAEgP2L4UMTdGD8IoOIq3cfOnVK7IOdPxyA9kFsqdAU6nVR8XzNHKeatJpQumierAbruCDrIpBxBnS8UngdWzewnR236OSBx9Nf33OVs Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8e1ee9bba1824593960a735254954960 Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1478800577 Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e1ee9bba1824593960a735254954960"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e1ee9bba1824593960a735254954960"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e1ee9bba1824593960a735254954960"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e1ee9bba1824593960a735254954960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1478800577 Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8e1ee9bba1824593960a735254954960 Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1478800577 Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-VolumesSnapshotsTestJSON-1478800577-project Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 64990ef381ec4163a7abcc05a73ec6e6 Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1478800577-project Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: exception: Volume 160126d0-7245-403b-a190-05fcb0f501d8 could not be found. Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '160126d0-7245-403b-a190-05fcb0f501d8'} Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 160126d0-7245-403b-a190-05fcb0f501d8 could not be found. (HTTP 404) (Request-ID: req-5a1a404e-7e4b-4ce1-a3bc-89631e629850) Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:01:37.279286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 160126d0-7245-403b-a190-05fcb0f501d8 could not be found. Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 160126d0-7245-403b-a190-05fcb0f501d8 could not be found. Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 160126d0-7245-403b-a190-05fcb0f501d8 could not be found. Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6be79f59-7c51-461d-9c97-ba2164699d4f tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Returning 404 to user: Volume 160126d0-7245-403b-a190-05fcb0f501d8 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:01:37.299090 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6be79f59-7c51-461d-9c97-ba2164699d4f tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/160126d0-7245-403b-a190-05fcb0f501d8" status: 404 len: 109 microversion: 2.1 time: 0.166571 Sep 07 13:01:37.324295 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2789/5533] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Sep 7 13:01:37 2022] DELETE /compute/v2.1/os-volumes/160126d0-7245-403b-a190-05fcb0f501d8 => generated 109 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:01:37.330264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e64f530d-a366-46bc-8d45-f47f7424fe7a tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Calling method '.version_select at 0x7fc4190b39d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:37.397861 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-e64f530d-a366-46bc-8d45-f47f7424fe7a tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] HTTP exception thrown: Volume 160126d0-7245-403b-a190-05fcb0f501d8 could not be found. Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e64f530d-a366-46bc-8d45-f47f7424fe7a tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Request method failure captured: Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/os-volumes/160126d0-7245-403b-a190-05fcb0f501d8 HTTP/1.1 Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJYdBNdWtlmFxQPclEvN9L2yXeZ2_nKqkF_GQ5hz7FaGaaoo8vY6e3-aL651vk5SHd-02aKeAEgP2L4UMTdGD8IoOIq3cfOnVK7IOdPxyA9kFsqdAU6nVR8XzNHKeatJpQumierAbruCDrIpBxBnS8UngdWzewnR236OSBx9Nf33OVs Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8e1ee9bba1824593960a735254954960 Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1478800577 Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e1ee9bba1824593960a735254954960"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e1ee9bba1824593960a735254954960"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e1ee9bba1824593960a735254954960"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e1ee9bba1824593960a735254954960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1478800577 Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8e1ee9bba1824593960a735254954960 Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1478800577 Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-VolumesSnapshotsTestJSON-1478800577-project Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 64990ef381ec4163a7abcc05a73ec6e6 Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1478800577-project Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: method: Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: exception: Volume 160126d0-7245-403b-a190-05fcb0f501d8 could not be found. Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '160126d0-7245-403b-a190-05fcb0f501d8'} Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 160126d0-7245-403b-a190-05fcb0f501d8 could not be found. (HTTP 404) (Request-ID: req-cdf3f0b7-7246-4a7e-a56a-f60d8365e416) Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:01:37.405232 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 160126d0-7245-403b-a190-05fcb0f501d8 could not be found. Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 160126d0-7245-403b-a190-05fcb0f501d8 could not be found. Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 160126d0-7245-403b-a190-05fcb0f501d8 could not be found. Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e64f530d-a366-46bc-8d45-f47f7424fe7a tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] Returning 404 to user: Volume 160126d0-7245-403b-a190-05fcb0f501d8 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e64f530d-a366-46bc-8d45-f47f7424fe7a tempest-VolumesSnapshotsTestJSON-1478800577 tempest-VolumesSnapshotsTestJSON-1478800577-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/160126d0-7245-403b-a190-05fcb0f501d8" status: 404 len: 109 microversion: 2.1 time: 0.082016 Sep 07 13:01:37.414602 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2745/5534] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Sep 7 13:01:37 2022] GET /compute/v2.1/os-volumes/160126d0-7245-403b-a190-05fcb0f501d8 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:01:40.360772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-51ba4654-7c30-4a2a-bfd0-acc192e752bf tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:40.366309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-51ba4654-7c30-4a2a-bfd0-acc192e752bf tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:01:40.399114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51ba4654-7c30-4a2a-bfd0-acc192e752bf tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:40.400534 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51ba4654-7c30-4a2a-bfd0-acc192e752bf tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:40.402465 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51ba4654-7c30-4a2a-bfd0-acc192e752bf tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:40.414878 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51ba4654-7c30-4a2a-bfd0-acc192e752bf tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:40.417332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51ba4654-7c30-4a2a-bfd0-acc192e752bf tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:40.418261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51ba4654-7c30-4a2a-bfd0-acc192e752bf tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:40.578322 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-51ba4654-7c30-4a2a-bfd0-acc192e752bf tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c/ips" status: 200 len: 145 microversion: 2.1 time: 0.206612 Sep 07 13:01:40.585757 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2790/5535] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Sep 7 13:01:40 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c/ips => generated 145 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:44.106881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c19dc5a4-d97d-4109-b2b1-23eff02e1580 tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] Action: 'create', calling method: .version_select at 0x7fc4190b3d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1492674434", "metadata": {"Type": "work"}}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:01:45.391030 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c19dc5a4-d97d-4109-b2b1-23eff02e1580 tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.736990 Sep 07 13:01:45.406578 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2746/5536] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Sep 7 13:01:43 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1753 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 07 13:01:45.411593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-183dccda-d508-421d-bd01-1eb28b71d950 tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] Calling method '.version_select at 0x7fc413e9a550>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:45.580413 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-183dccda-d508-421d-bd01-1eb28b71d950 tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f0b961e0-10b5-4816-96cb-a309fb76b975" status: 200 len: 353 microversion: 2.1 time: 0.172931 Sep 07 13:01:45.584310 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2791/5537] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Sep 7 13:01:45 2022] GET /compute/v2.1/os-volumes/f0b961e0-10b5-4816-96cb-a309fb76b975 => generated 353 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:01:45.720580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4e74e96a-8177-46eb-8d15-cf43c874edaf tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd5d04bb-40b5-4907-865a-4a461a649b67"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:01:45.742870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4e74e96a-8177-46eb-8d15-cf43c874edaf tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:01:45.776389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e74e96a-8177-46eb-8d15-cf43c874edaf tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:45.778033 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e74e96a-8177-46eb-8d15-cf43c874edaf tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:45.779658 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e74e96a-8177-46eb-8d15-cf43c874edaf tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:45.785704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e74e96a-8177-46eb-8d15-cf43c874edaf tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:45.786894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e74e96a-8177-46eb-8d15-cf43c874edaf tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:45.787658 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e74e96a-8177-46eb-8d15-cf43c874edaf tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:46.639743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-466c3360-72ad-469c-abe1-11e3b57c4c6c tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] Calling method '.version_select at 0x7fc41872a940>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:46.704996 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4e74e96a-8177-46eb-8d15-cf43c874edaf tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "POST /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.989886 Sep 07 13:01:46.745660 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2747/5538] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Sep 7 13:01:45 2022] POST /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c/os-volume_attachments => generated 194 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:46.792310 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-466c3360-72ad-469c-abe1-11e3b57c4c6c tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f0b961e0-10b5-4816-96cb-a309fb76b975" status: 200 len: 353 microversion: 2.1 time: 0.193567 Sep 07 13:01:46.804375 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2792/5539] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Sep 7 13:01:46 2022] GET /compute/v2.1/os-volumes/f0b961e0-10b5-4816-96cb-a309fb76b975 => generated 353 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:47.816945 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e8aed2fa-a462-4f09-b668-ee878d7b4341 tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] Calling method '.version_select at 0x7fc419336550>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:48.195489 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-466c3360-72ad-469c-abe1-11e3b57c4c6c tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:48.197077 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-466c3360-72ad-469c-abe1-11e3b57c4c6c tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001970 Sep 07 13:01:48.202218 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2793/5540] 10.222.0.16 () {56 vars in 886 bytes} [Wed Sep 7 13:01:48 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 07 13:01:48.275881 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e8aed2fa-a462-4f09-b668-ee878d7b4341 tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f0b961e0-10b5-4816-96cb-a309fb76b975" status: 200 len: 353 microversion: 2.1 time: 0.468204 Sep 07 13:01:48.277840 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2748/5541] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Sep 7 13:01:47 2022] GET /compute/v2.1/os-volumes/f0b961e0-10b5-4816-96cb-a309fb76b975 => generated 353 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:49.413053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0a39c212-2452-476d-bfe2-048430f06472 tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] Calling method '.version_select at 0x7fc418204a60>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:49.629784 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0a39c212-2452-476d-bfe2-048430f06472 tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f0b961e0-10b5-4816-96cb-a309fb76b975" status: 200 len: 354 microversion: 2.1 time: 0.222536 Sep 07 13:01:49.630825 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2794/5542] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Sep 7 13:01:49 2022] GET /compute/v2.1/os-volumes/f0b961e0-10b5-4816-96cb-a309fb76b975 => generated 354 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:49.665847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d7bb2506-78ff-4fa6-9e61-45c3746a01bf tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] Calling method '.version_select at 0x7fc41848e040>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:50.045380 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d7bb2506-78ff-4fa6-9e61-45c3746a01bf tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f0b961e0-10b5-4816-96cb-a309fb76b975" status: 200 len: 354 microversion: 2.1 time: 0.384755 Sep 07 13:01:50.046284 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2749/5543] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Sep 7 13:01:49 2022] GET /compute/v2.1/os-volumes/f0b961e0-10b5-4816-96cb-a309fb76b975 => generated 354 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:50.073590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f5d57566-8698-441f-9fae-5f0c48fadce8 tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] Calling method '.version_select at 0x7fc413e9a4c0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:50.297288 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f5d57566-8698-441f-9fae-5f0c48fadce8 tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/f0b961e0-10b5-4816-96cb-a309fb76b975" status: 202 len: 0 microversion: 2.1 time: 0.228884 Sep 07 13:01:50.298222 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2795/5544] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Sep 7 13:01:50 2022] DELETE /compute/v2.1/os-volumes/f0b961e0-10b5-4816-96cb-a309fb76b975 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:01:50.308707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-43f046f2-d3d1-4a50-bd67-fd06d835e5c5 tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] Calling method '.version_select at 0x7fc418fb4f70>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:50.540771 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-43f046f2-d3d1-4a50-bd67-fd06d835e5c5 tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f0b961e0-10b5-4816-96cb-a309fb76b975" status: 200 len: 353 microversion: 2.1 time: 0.236957 Sep 07 13:01:50.541743 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2750/5545] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Sep 7 13:01:50 2022] GET /compute/v2.1/os-volumes/f0b961e0-10b5-4816-96cb-a309fb76b975 => generated 353 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:51.554318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:51.557233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:51.564407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c215568a-c98c-46fd-808d-ed4ba8e5c6d6 tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] Calling method '.version_select at 0x7fc413e9a1f0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:51.754040 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c215568a-c98c-46fd-808d-ed4ba8e5c6d6 tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f0b961e0-10b5-4816-96cb-a309fb76b975" status: 200 len: 353 microversion: 2.1 time: 0.200467 Sep 07 13:01:51.755344 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2796/5546] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Sep 7 13:01:51 2022] GET /compute/v2.1/os-volumes/f0b961e0-10b5-4816-96cb-a309fb76b975 => generated 353 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:01:51.872381 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8c5a797a-a5d2-4106-b757-c217c11a660e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:51.873999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8c5a797a-a5d2-4106-b757-c217c11a660e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:01:51.912506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c5a797a-a5d2-4106-b757-c217c11a660e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:51.916148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c5a797a-a5d2-4106-b757-c217c11a660e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:51.916757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c5a797a-a5d2-4106-b757-c217c11a660e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:51.917751 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c5a797a-a5d2-4106-b757-c217c11a660e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:51.918253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c5a797a-a5d2-4106-b757-c217c11a660e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:51.918858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c5a797a-a5d2-4106-b757-c217c11a660e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:51.968493 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8c5a797a-a5d2-4106-b757-c217c11a660e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/ips" status: 200 len: 149 microversion: 2.1 time: 0.111189 Sep 07 13:01:51.969712 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2751/5547] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Sep 7 13:01:51 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/ips => generated 149 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:52.773792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-874febba-6f50-4810-9293-fac3083ab7e2 tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] Calling method '.version_select at 0x7fc4181bbf70>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:53.022457 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-874febba-6f50-4810-9293-fac3083ab7e2 tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f0b961e0-10b5-4816-96cb-a309fb76b975" status: 200 len: 353 microversion: 2.1 time: 0.254851 Sep 07 13:01:53.023618 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2797/5548] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Sep 7 13:01:52 2022] GET /compute/v2.1/os-volumes/f0b961e0-10b5-4816-96cb-a309fb76b975 => generated 353 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:54.070336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2873d38c-be81-463a-a168-4d8e28ac23b7 tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] Calling method '.version_select at 0x7fc41922fee0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:54.243731 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2873d38c-be81-463a-a168-4d8e28ac23b7 tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f0b961e0-10b5-4816-96cb-a309fb76b975" status: 200 len: 353 microversion: 2.1 time: 0.207273 Sep 07 13:01:54.244840 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2752/5549] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Sep 7 13:01:54 2022] GET /compute/v2.1/os-volumes/f0b961e0-10b5-4816-96cb-a309fb76b975 => generated 353 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:55.263814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3890957-3569-4198-9fb1-83b259ad453a tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] Calling method '.version_select at 0x7fc413ee1ee0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:55.405387 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-244a3091-1039-4893-93c2-dda2b0274cea tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da53e011-d759-45db-a1cd-f98260d5ba31"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:01:55.420502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-244a3091-1039-4893-93c2-dda2b0274cea tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:01:55.447333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-244a3091-1039-4893-93c2-dda2b0274cea tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:55.448797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-244a3091-1039-4893-93c2-dda2b0274cea tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:55.450018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-244a3091-1039-4893-93c2-dda2b0274cea tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:55.454688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-244a3091-1039-4893-93c2-dda2b0274cea tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:01:55.461055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-244a3091-1039-4893-93c2-dda2b0274cea tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:01:55.462357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-244a3091-1039-4893-93c2-dda2b0274cea tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:01:55.470434 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d3890957-3569-4198-9fb1-83b259ad453a tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f0b961e0-10b5-4816-96cb-a309fb76b975" status: 200 len: 353 microversion: 2.1 time: 0.213574 Sep 07 13:01:55.471924 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2798/5550] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Sep 7 13:01:55 2022] GET /compute/v2.1/os-volumes/f0b961e0-10b5-4816-96cb-a309fb76b975 => generated 353 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:56.443646 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-244a3091-1039-4893-93c2-dda2b0274cea tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "POST /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.044955 Sep 07 13:01:56.447238 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2753/5551] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Sep 7 13:01:55 2022] POST /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments => generated 194 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:01:56.491687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a7684b97-c244-4179-864a-77bf09ff647a tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] Calling method '.version_select at 0x7fc41872ad30>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:01:56.694997 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-a7684b97-c244-4179-864a-77bf09ff647a tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] HTTP exception thrown: Volume f0b961e0-10b5-4816-96cb-a309fb76b975 could not be found. Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a7684b97-c244-4179-864a-77bf09ff647a tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] Request method failure captured: Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/os-volumes/f0b961e0-10b5-4816-96cb-a309fb76b975 HTTP/1.1 Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJY3dyL6npvoe8-81ZlADTXVSmTuf-tdb8A9wnXT12UdJJUQs-rOTk09senzHE3S9Z29ALgy2rIPLapWhWpV6yyv83i9818u081fAujFGYsETb62Dw-WZxqAckOtcKojp_nbwkDAtoo8WYJ-Yma2Lba3v94afVvwfqh_Bu_9KOWVrDU Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 6eec946f86824e3f93212e5502abb737 Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-VolumesGetTestJSON-1653341589 Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6eec946f86824e3f93212e5502abb737"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6eec946f86824e3f93212e5502abb737"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6eec946f86824e3f93212e5502abb737"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6eec946f86824e3f93212e5502abb737"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-VolumesGetTestJSON-1653341589 Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 6eec946f86824e3f93212e5502abb737 Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-VolumesGetTestJSON-1653341589 Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-VolumesGetTestJSON-1653341589-project Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 0616b9750654485c8c5841f6983ef4ad Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-VolumesGetTestJSON-1653341589-project Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: method: Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: exception: Volume f0b961e0-10b5-4816-96cb-a309fb76b975 could not be found. Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'f0b961e0-10b5-4816-96cb-a309fb76b975'} Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f0b961e0-10b5-4816-96cb-a309fb76b975 could not be found. (HTTP 404) (Request-ID: req-3a6543fb-580b-4486-9053-12499a43c864) Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 13:01:56.697369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f0b961e0-10b5-4816-96cb-a309fb76b975 could not be found. Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f0b961e0-10b5-4816-96cb-a309fb76b975 could not be found. Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f0b961e0-10b5-4816-96cb-a309fb76b975 could not be found. Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:01:56.703019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a7684b97-c244-4179-864a-77bf09ff647a tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] Returning 404 to user: Volume f0b961e0-10b5-4816-96cb-a309fb76b975 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:01:56.709592 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a7684b97-c244-4179-864a-77bf09ff647a tempest-VolumesGetTestJSON-1653341589 tempest-VolumesGetTestJSON-1653341589-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f0b961e0-10b5-4816-96cb-a309fb76b975" status: 404 len: 109 microversion: 2.1 time: 0.219332 Sep 07 13:01:56.709592 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2799/5552] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Sep 7 13:01:56 2022] GET /compute/v2.1/os-volumes/f0b961e0-10b5-4816-96cb-a309fb76b975 => generated 109 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:02:09.144262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3480ffe9-817e-4efb-bac6-9d432d28ed9b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:09.158086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3480ffe9-817e-4efb-bac6-9d432d28ed9b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:02:09.197002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:09.202448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:09.215767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3480ffe9-817e-4efb-bac6-9d432d28ed9b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:09.217107 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3480ffe9-817e-4efb-bac6-9d432d28ed9b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:09.218230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3480ffe9-817e-4efb-bac6-9d432d28ed9b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:09.219906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3480ffe9-817e-4efb-bac6-9d432d28ed9b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:09.221039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3480ffe9-817e-4efb-bac6-9d432d28ed9b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:09.222086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3480ffe9-817e-4efb-bac6-9d432d28ed9b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:09.365072 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3480ffe9-817e-4efb-bac6-9d432d28ed9b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.223959 Sep 07 13:02:09.369448 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2754/5553] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:02:09 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c/os-volume_attachments => generated 197 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:02:09.396593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b1fb13a2-66bb-44cf-8292-e632757f203e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:09.399343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b1fb13a2-66bb-44cf-8292-e632757f203e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:02:09.430680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1fb13a2-66bb-44cf-8292-e632757f203e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:09.435317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1fb13a2-66bb-44cf-8292-e632757f203e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:09.436477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1fb13a2-66bb-44cf-8292-e632757f203e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:09.440890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1fb13a2-66bb-44cf-8292-e632757f203e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:09.442167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1fb13a2-66bb-44cf-8292-e632757f203e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:09.447889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1fb13a2-66bb-44cf-8292-e632757f203e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:09.623959 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b1fb13a2-66bb-44cf-8292-e632757f203e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c/os-volume_attachments/dd5d04bb-40b5-4907-865a-4a461a649b67" status: 200 len: 194 microversion: 2.1 time: 0.241788 Sep 07 13:02:09.628527 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2800/5554] 10.222.0.16 () {58 vars in 1413 bytes} [Wed Sep 7 13:02:09 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c/os-volume_attachments/dd5d04bb-40b5-4907-865a-4a461a649b67 => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:02:10.402550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3480ffe9-817e-4efb-bac6-9d432d28ed9b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:10.404814 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3480ffe9-817e-4efb-bac6-9d432d28ed9b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002616 Sep 07 13:02:10.405372 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2755/5555] 10.222.0.16 () {56 vars in 886 bytes} [Wed Sep 7 13:02:10 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 07 13:02:10.420478 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b1fb13a2-66bb-44cf-8292-e632757f203e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:10.423320 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b1fb13a2-66bb-44cf-8292-e632757f203e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.003581 Sep 07 13:02:10.430632 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2801/5556] 10.222.0.16 () {54 vars in 1035 bytes} [Wed Sep 7 13:02:10 2022] GET /compute/v2/ => generated 379 bytes in 6 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Sep 07 13:02:10.433865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3480ffe9-817e-4efb-bac6-9d432d28ed9b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:10.436274 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3480ffe9-817e-4efb-bac6-9d432d28ed9b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003149 Sep 07 13:02:10.437118 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2756/5557] 10.222.0.16 () {54 vars in 1041 bytes} [Wed Sep 7 13:02:10 2022] GET /compute/v2.1/ => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:02:10.448677 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b1fb13a2-66bb-44cf-8292-e632757f203e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:10.450546 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b1fb13a2-66bb-44cf-8292-e632757f203e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002425 Sep 07 13:02:10.459274 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2802/5558] 10.222.0.16 () {56 vars in 886 bytes} [Wed Sep 7 13:02:10 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 07 13:02:13.618453 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9eabce98-e4bd-4270-9780-86f7c8c747db tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d9036aa-4b61-44d6-b531-9ac2f12b916f"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:02:13.622579 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9eabce98-e4bd-4270-9780-86f7c8c747db tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:02:13.631333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9eabce98-e4bd-4270-9780-86f7c8c747db tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:13.632331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9eabce98-e4bd-4270-9780-86f7c8c747db tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:13.633429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9eabce98-e4bd-4270-9780-86f7c8c747db tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:13.634513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9eabce98-e4bd-4270-9780-86f7c8c747db tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:13.635295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9eabce98-e4bd-4270-9780-86f7c8c747db tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:13.635957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9eabce98-e4bd-4270-9780-86f7c8c747db tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:15.392909 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9eabce98-e4bd-4270-9780-86f7c8c747db tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "POST /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.790007 Sep 07 13:02:15.399169 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2757/5559] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Sep 7 13:02:13 2022] POST /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c/os-volume_attachments => generated 194 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:02:22.007671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d0e8e44b-a9fc-4258-b9bb-3dbe8d83225b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Action: 'create', calling method: .version_select at 0x7fc418204af0>, body: {"keypair": {"name": "tempest-keypair-997832085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHiYbNMFQHbLe+ZRyrvM/bLhmpQUF//dxP5EWnSpp+0r2AZ1wk0H8Xhu82jdjMpR5YoKmmjpgT7D/e+hU0RJUSANXfHzpaKjcC93TYeXYYr5dLRbisaDJEIx5xEQxagQw=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:02:22.017996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:22.019578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:22.037363 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-d0e8e44b-a9fc-4258-b9bb-3dbe8d83225b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Getting quotas for project cb9b61f78ca140c5870961647ff04cfe. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:02:22.044854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-d0e8e44b-a9fc-4258-b9bb-3dbe8d83225b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Getting quotas for user c9f85a4002bd40eb8514aa91056c77d8 and project cb9b61f78ca140c5870961647ff04cfe. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:02:22.087758 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d0e8e44b-a9fc-4258-b9bb-3dbe8d83225b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.086090 Sep 07 13:02:22.091476 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2803/5560] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 13:02:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:02:28.373958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7226c85a-c96d-490f-9c11-9ca55d045c50 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-30583272", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "477b0efc-1e3a-4288-a7c3-16de8a1f2f66"}], "security_groups": [{"name": "tempest-securitygroup--1213967969"}], "key_name": "tempest-keypair-997832085", "user_data": "}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:02:28.433860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:28.436412 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:28.719759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-7226c85a-c96d-490f-9c11-9ca55d045c50 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] validate_networks() for [('477b0efc-1e3a-4288-a7c3-16de8a1f2f66', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:02:29.915749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7226c85a-c96d-490f-9c11-9ca55d045c50 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:02:29.916549 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7226c85a-c96d-490f-9c11-9ca55d045c50 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:02:29.916672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7226c85a-c96d-490f-9c11-9ca55d045c50 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:02:29.917923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7226c85a-c96d-490f-9c11-9ca55d045c50 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:02:29.918698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7226c85a-c96d-490f-9c11-9ca55d045c50 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:02:29.931564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7226c85a-c96d-490f-9c11-9ca55d045c50 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:29.932379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7226c85a-c96d-490f-9c11-9ca55d045c50 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:29.932980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7226c85a-c96d-490f-9c11-9ca55d045c50 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:29.934492 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7226c85a-c96d-490f-9c11-9ca55d045c50 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:29.935171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7226c85a-c96d-490f-9c11-9ca55d045c50 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:29.935821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7226c85a-c96d-490f-9c11-9ca55d045c50 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:29.961220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-7226c85a-c96d-490f-9c11-9ca55d045c50 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Getting quotas for project cb9b61f78ca140c5870961647ff04cfe. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:02:29.970605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-7226c85a-c96d-490f-9c11-9ca55d045c50 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Getting quotas for user c9f85a4002bd40eb8514aa91056c77d8 and project cb9b61f78ca140c5870961647ff04cfe. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:02:29.990310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7226c85a-c96d-490f-9c11-9ca55d045c50 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:02:29.994025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7226c85a-c96d-490f-9c11-9ca55d045c50 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:02:30.074554 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7226c85a-c96d-490f-9c11-9ca55d045c50 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.712015 Sep 07 13:02:30.081060 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2758/5561] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:02:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 1719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:02:30.097070 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0d6a448a-0e67-4bd9-8672-2120bdad532b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:30.098898 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0d6a448a-0e67-4bd9-8672-2120bdad532b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:02:30.270501 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0d6a448a-0e67-4bd9-8672-2120bdad532b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:02:30.279520 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0d6a448a-0e67-4bd9-8672-2120bdad532b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f" status: 200 len: 1239 microversion: 2.1 time: 0.188196 Sep 07 13:02:30.283430 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2804/5562] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:02:30 2022] GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f => generated 1239 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:02:31.342673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-09399097-384c-4807-8ade-b02b795955c3 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:31.345877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-09399097-384c-4807-8ade-b02b795955c3 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:02:31.696949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-09399097-384c-4807-8ade-b02b795955c3 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:02:31.738923 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-09399097-384c-4807-8ade-b02b795955c3 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f" status: 200 len: 1239 microversion: 2.1 time: 0.396596 Sep 07 13:02:31.785148 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2759/5563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:02:31 2022] GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f => generated 1239 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:02:32.175029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-71a7b2a0-cf04-45ec-a7fc-3e0624ef355b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:32.184619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-71a7b2a0-cf04-45ec-a7fc-3e0624ef355b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:02:32.235665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71a7b2a0-cf04-45ec-a7fc-3e0624ef355b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:32.243670 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71a7b2a0-cf04-45ec-a7fc-3e0624ef355b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:32.244491 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71a7b2a0-cf04-45ec-a7fc-3e0624ef355b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:32.245737 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71a7b2a0-cf04-45ec-a7fc-3e0624ef355b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:32.246551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71a7b2a0-cf04-45ec-a7fc-3e0624ef355b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:32.255460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71a7b2a0-cf04-45ec-a7fc-3e0624ef355b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:32.427710 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-71a7b2a0-cf04-45ec-a7fc-3e0624ef355b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.261583 Sep 07 13:02:32.430294 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2805/5564] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:02:32 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c/os-volume_attachments => generated 371 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:02:32.579776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b4002694-8e1b-48ad-9db6-955d3182a74a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:32.582078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b4002694-8e1b-48ad-9db6-955d3182a74a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:02:32.608934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4002694-8e1b-48ad-9db6-955d3182a74a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:32.610885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4002694-8e1b-48ad-9db6-955d3182a74a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:32.616239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4002694-8e1b-48ad-9db6-955d3182a74a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:32.618184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4002694-8e1b-48ad-9db6-955d3182a74a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:32.618914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4002694-8e1b-48ad-9db6-955d3182a74a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:32.621667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4002694-8e1b-48ad-9db6-955d3182a74a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:32.764284 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b4002694-8e1b-48ad-9db6-955d3182a74a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c/os-volume_attachments/dd5d04bb-40b5-4907-865a-4a461a649b67" status: 200 len: 194 microversion: 2.1 time: 0.184319 Sep 07 13:02:32.773793 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2760/5565] 10.222.0.16 () {58 vars in 1413 bytes} [Wed Sep 7 13:02:32 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c/os-volume_attachments/dd5d04bb-40b5-4907-865a-4a461a649b67 => generated 194 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:02:32.803990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dc47469d-7e10-4728-b53d-9ec3b9d889b2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:32.805070 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dc47469d-7e10-4728-b53d-9ec3b9d889b2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:02:32.809770 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9496fd46-3a92-42b1-9bbd-5f9b148e79d7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:32.810589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9496fd46-3a92-42b1-9bbd-5f9b148e79d7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:02:32.844341 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9496fd46-3a92-42b1-9bbd-5f9b148e79d7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:32.844777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9496fd46-3a92-42b1-9bbd-5f9b148e79d7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:32.845788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9496fd46-3a92-42b1-9bbd-5f9b148e79d7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:32.858669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9496fd46-3a92-42b1-9bbd-5f9b148e79d7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:32.862745 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9496fd46-3a92-42b1-9bbd-5f9b148e79d7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:32.864083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9496fd46-3a92-42b1-9bbd-5f9b148e79d7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:32.868342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc47469d-7e10-4728-b53d-9ec3b9d889b2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:32.869221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc47469d-7e10-4728-b53d-9ec3b9d889b2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:32.874203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc47469d-7e10-4728-b53d-9ec3b9d889b2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:32.876669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc47469d-7e10-4728-b53d-9ec3b9d889b2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:32.877827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc47469d-7e10-4728-b53d-9ec3b9d889b2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:32.879763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc47469d-7e10-4728-b53d-9ec3b9d889b2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:33.186888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-9496fd46-3a92-42b1-9bbd-5f9b148e79d7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lazy-loading 'services' on Instance uuid 43152d55-6621-43f6-bb60-1be3d638859c {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:02:33.265327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dc47469d-7e10-4728-b53d-9ec3b9d889b2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:02:33.275499 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dc47469d-7e10-4728-b53d-9ec3b9d889b2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f" status: 200 len: 1291 microversion: 2.1 time: 0.495375 Sep 07 13:02:33.281453 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2806/5566] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:02:32 2022] GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f => generated 1291 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:02:33.590733 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9496fd46-3a92-42b1-9bbd-5f9b148e79d7 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "DELETE /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c/os-volume_attachments/dd5d04bb-40b5-4907-865a-4a461a649b67" status: 202 len: 0 microversion: 2.1 time: 0.802874 Sep 07 13:02:33.596027 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2761/5567] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Sep 7 13:02:32 2022] DELETE /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c/os-volume_attachments/dd5d04bb-40b5-4907-865a-4a461a649b67 => generated 0 bytes in 812 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:02:34.311812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0936efc0-c378-4330-afac-0516cffc5fa0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:34.314590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0936efc0-c378-4330-afac-0516cffc5fa0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:02:34.370281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0936efc0-c378-4330-afac-0516cffc5fa0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:34.371141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0936efc0-c378-4330-afac-0516cffc5fa0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:34.371881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0936efc0-c378-4330-afac-0516cffc5fa0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:34.373086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0936efc0-c378-4330-afac-0516cffc5fa0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:34.373898 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0936efc0-c378-4330-afac-0516cffc5fa0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:34.374602 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0936efc0-c378-4330-afac-0516cffc5fa0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:34.693966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0936efc0-c378-4330-afac-0516cffc5fa0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:02:34.735800 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0936efc0-c378-4330-afac-0516cffc5fa0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f" status: 200 len: 1297 microversion: 2.1 time: 0.433455 Sep 07 13:02:34.739856 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2807/5568] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:02:34 2022] GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f => generated 1297 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:02:35.818106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b9a2bb5a-339f-4039-9606-4f50a800e1ab tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:35.819710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b9a2bb5a-339f-4039-9606-4f50a800e1ab tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:02:35.868617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9a2bb5a-339f-4039-9606-4f50a800e1ab tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:35.869520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9a2bb5a-339f-4039-9606-4f50a800e1ab tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:35.870304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9a2bb5a-339f-4039-9606-4f50a800e1ab tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:35.875434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9a2bb5a-339f-4039-9606-4f50a800e1ab tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:35.876267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9a2bb5a-339f-4039-9606-4f50a800e1ab tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:35.877043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9a2bb5a-339f-4039-9606-4f50a800e1ab tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:36.612215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b9a2bb5a-339f-4039-9606-4f50a800e1ab tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:02:36.629952 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b9a2bb5a-339f-4039-9606-4f50a800e1ab tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f" status: 200 len: 1297 microversion: 2.1 time: 0.871613 Sep 07 13:02:36.631287 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2762/5569] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:02:35 2022] GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f => generated 1297 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:02:37.676497 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-12d9cfee-d1e1-475d-bc02-5116ee6525d0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:37.677381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-12d9cfee-d1e1-475d-bc02-5116ee6525d0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:02:37.700711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12d9cfee-d1e1-475d-bc02-5116ee6525d0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:37.703915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12d9cfee-d1e1-475d-bc02-5116ee6525d0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:37.708088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12d9cfee-d1e1-475d-bc02-5116ee6525d0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:37.709389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12d9cfee-d1e1-475d-bc02-5116ee6525d0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:37.712481 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12d9cfee-d1e1-475d-bc02-5116ee6525d0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:37.716610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12d9cfee-d1e1-475d-bc02-5116ee6525d0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:38.191086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-12d9cfee-d1e1-475d-bc02-5116ee6525d0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:02:38.205138 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-12d9cfee-d1e1-475d-bc02-5116ee6525d0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f" status: 200 len: 1365 microversion: 2.1 time: 0.533001 Sep 07 13:02:38.207494 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2808/5570] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:02:37 2022] GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f => generated 1365 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:02:39.259140 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d2638e7f-b562-4976-bf2a-f9e9c7262b2d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:39.266755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d2638e7f-b562-4976-bf2a-f9e9c7262b2d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:02:39.323105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2638e7f-b562-4976-bf2a-f9e9c7262b2d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:39.326243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2638e7f-b562-4976-bf2a-f9e9c7262b2d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:39.328921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2638e7f-b562-4976-bf2a-f9e9c7262b2d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:39.332752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2638e7f-b562-4976-bf2a-f9e9c7262b2d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:39.336109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2638e7f-b562-4976-bf2a-f9e9c7262b2d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:39.339042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2638e7f-b562-4976-bf2a-f9e9c7262b2d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:39.948986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:41.578669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d2638e7f-b562-4976-bf2a-f9e9c7262b2d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:02:41.631881 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d2638e7f-b562-4976-bf2a-f9e9c7262b2d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f" status: 200 len: 1365 microversion: 2.1 time: 2.384115 Sep 07 13:02:41.635333 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2763/5571] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:02:39 2022] GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f => generated 1365 bytes in 2394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:02:42.691721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-49bd97bf-6141-47f0-82d9-7c52917fdf71 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:42.694697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-49bd97bf-6141-47f0-82d9-7c52917fdf71 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:02:42.715314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:42.721796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49bd97bf-6141-47f0-82d9-7c52917fdf71 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:42.723047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49bd97bf-6141-47f0-82d9-7c52917fdf71 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:42.724146 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49bd97bf-6141-47f0-82d9-7c52917fdf71 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:42.726029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49bd97bf-6141-47f0-82d9-7c52917fdf71 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:42.727984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49bd97bf-6141-47f0-82d9-7c52917fdf71 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:42.729703 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49bd97bf-6141-47f0-82d9-7c52917fdf71 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:43.491438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-49bd97bf-6141-47f0-82d9-7c52917fdf71 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:02:43.501063 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-49bd97bf-6141-47f0-82d9-7c52917fdf71 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f" status: 200 len: 1365 microversion: 2.1 time: 0.821729 Sep 07 13:02:43.512462 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2809/5572] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:02:42 2022] GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f => generated 1365 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:02:44.563510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-da64983d-fcae-47af-9682-a27a8e7965fd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:44.572391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-da64983d-fcae-47af-9682-a27a8e7965fd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:02:44.588396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:44.619343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da64983d-fcae-47af-9682-a27a8e7965fd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:44.631219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da64983d-fcae-47af-9682-a27a8e7965fd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:44.632330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da64983d-fcae-47af-9682-a27a8e7965fd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:44.634759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da64983d-fcae-47af-9682-a27a8e7965fd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:44.639949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da64983d-fcae-47af-9682-a27a8e7965fd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:44.642307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da64983d-fcae-47af-9682-a27a8e7965fd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:45.677174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-872542c2-e728-4366-941f-1fb860a76c6e req-6e94a9ae-3581-477a-82fb-721eb2103d39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "925a496f-7b54-406f-8d4b-5470d75f637f", "tag": "409569fc-fee9-4fea-a617-c3cecedc0305"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:02:45.717437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-872542c2-e728-4366-941f-1fb860a76c6e req-6e94a9ae-3581-477a-82fb-721eb2103d39 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:45.726458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-872542c2-e728-4366-941f-1fb860a76c6e req-6e94a9ae-3581-477a-82fb-721eb2103d39 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:45.728171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-872542c2-e728-4366-941f-1fb860a76c6e req-6e94a9ae-3581-477a-82fb-721eb2103d39 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:45.783049 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-872542c2-e728-4366-941f-1fb860a76c6e req-6e94a9ae-3581-477a-82fb-721eb2103d39 service nova] Creating event network-changed:409569fc-fee9-4fea-a617-c3cecedc0305 for instance 925a496f-7b54-406f-8d4b-5470d75f637f on n-h1-852087-9 Sep 07 13:02:45.843858 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-872542c2-e728-4366-941f-1fb860a76c6e req-6e94a9ae-3581-477a-82fb-721eb2103d39 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163691 Sep 07 13:02:45.844584 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2810/5573] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:02:46.190890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-da64983d-fcae-47af-9682-a27a8e7965fd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:02:46.217514 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-da64983d-fcae-47af-9682-a27a8e7965fd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f" status: 200 len: 1365 microversion: 2.1 time: 1.663248 Sep 07 13:02:46.223362 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2764/5574] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:02:44 2022] GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f => generated 1365 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:02:47.274852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6f728635-c15c-4a01-9eec-a872b994f647 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:47.275744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6f728635-c15c-4a01-9eec-a872b994f647 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:02:47.300322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f728635-c15c-4a01-9eec-a872b994f647 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:47.300838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f728635-c15c-4a01-9eec-a872b994f647 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:47.301284 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f728635-c15c-4a01-9eec-a872b994f647 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:47.302078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f728635-c15c-4a01-9eec-a872b994f647 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:47.302488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f728635-c15c-4a01-9eec-a872b994f647 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:47.302922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f728635-c15c-4a01-9eec-a872b994f647 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:47.684155 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6f728635-c15c-4a01-9eec-a872b994f647 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:02:47.698075 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6f728635-c15c-4a01-9eec-a872b994f647 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f" status: 200 len: 1365 microversion: 2.1 time: 0.427498 Sep 07 13:02:47.705104 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2811/5575] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:02:47 2022] GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f => generated 1365 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:02:48.776346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ca03e5c6-c681-432e-9412-330ed1be04ad tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:48.779282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ca03e5c6-c681-432e-9412-330ed1be04ad tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:02:48.838233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca03e5c6-c681-432e-9412-330ed1be04ad tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:48.839310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca03e5c6-c681-432e-9412-330ed1be04ad tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:48.840161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca03e5c6-c681-432e-9412-330ed1be04ad tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:48.841470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca03e5c6-c681-432e-9412-330ed1be04ad tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:48.845117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca03e5c6-c681-432e-9412-330ed1be04ad tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:48.846242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca03e5c6-c681-432e-9412-330ed1be04ad tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:49.648690 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ca03e5c6-c681-432e-9412-330ed1be04ad tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:02:49.683634 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ca03e5c6-c681-432e-9412-330ed1be04ad tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f" status: 200 len: 1365 microversion: 2.1 time: 0.932249 Sep 07 13:02:49.707861 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2765/5576] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:02:48 2022] GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f => generated 1365 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:02:50.220853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ef41fb0-3a91-4f52-8036-6ee3f863fee9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:50.222991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0ef41fb0-3a91-4f52-8036-6ee3f863fee9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:02:50.234917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ef41fb0-3a91-4f52-8036-6ee3f863fee9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:50.236056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ef41fb0-3a91-4f52-8036-6ee3f863fee9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:50.237087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ef41fb0-3a91-4f52-8036-6ee3f863fee9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:50.239801 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ef41fb0-3a91-4f52-8036-6ee3f863fee9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:50.240859 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ef41fb0-3a91-4f52-8036-6ee3f863fee9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:50.241869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ef41fb0-3a91-4f52-8036-6ee3f863fee9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:50.368293 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ef41fb0-3a91-4f52-8036-6ee3f863fee9 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c/os-volume_attachments/5d9036aa-4b61-44d6-b531-9ac2f12b916f" status: 200 len: 194 microversion: 2.1 time: 0.156551 Sep 07 13:02:50.394457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1a5b1886-0074-4fa5-956b-437af9c3a64e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:50.400321 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1a5b1886-0074-4fa5-956b-437af9c3a64e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:02:50.400795 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2812/5577] 10.222.0.16 () {58 vars in 1413 bytes} [Wed Sep 7 13:02:50 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c/os-volume_attachments/5d9036aa-4b61-44d6-b531-9ac2f12b916f => generated 194 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:02:50.432089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a5b1886-0074-4fa5-956b-437af9c3a64e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:50.439767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a5b1886-0074-4fa5-956b-437af9c3a64e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:50.440840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a5b1886-0074-4fa5-956b-437af9c3a64e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:50.446029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a5b1886-0074-4fa5-956b-437af9c3a64e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:50.447208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a5b1886-0074-4fa5-956b-437af9c3a64e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:50.448228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a5b1886-0074-4fa5-956b-437af9c3a64e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:50.749411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0196350f-0949-488d-8205-969bbc68b736 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:50.751150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0196350f-0949-488d-8205-969bbc68b736 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:02:50.820279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0196350f-0949-488d-8205-969bbc68b736 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:50.821210 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0196350f-0949-488d-8205-969bbc68b736 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:50.830584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0196350f-0949-488d-8205-969bbc68b736 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:50.839011 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0196350f-0949-488d-8205-969bbc68b736 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:50.844942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0196350f-0949-488d-8205-969bbc68b736 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:50.845807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0196350f-0949-488d-8205-969bbc68b736 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:50.848416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-1a5b1886-0074-4fa5-956b-437af9c3a64e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lazy-loading 'services' on Instance uuid 43152d55-6621-43f6-bb60-1be3d638859c {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:02:51.273712 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1a5b1886-0074-4fa5-956b-437af9c3a64e tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "DELETE /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c/os-volume_attachments/5d9036aa-4b61-44d6-b531-9ac2f12b916f" status: 202 len: 0 microversion: 2.1 time: 0.886302 Sep 07 13:02:51.279981 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2766/5578] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Sep 7 13:02:50 2022] DELETE /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c/os-volume_attachments/5d9036aa-4b61-44d6-b531-9ac2f12b916f => generated 0 bytes in 894 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:02:51.787977 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0196350f-0949-488d-8205-969bbc68b736 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:02:51.826807 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0196350f-0949-488d-8205-969bbc68b736 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f" status: 200 len: 1365 microversion: 2.1 time: 1.084901 Sep 07 13:02:51.828212 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2813/5579] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:02:50 2022] GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f => generated 1365 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:02:52.874171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d8ea133a-1da2-44b2-ad68-da5c5edcf2c0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:52.887063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d8ea133a-1da2-44b2-ad68-da5c5edcf2c0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:02:52.907491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8ea133a-1da2-44b2-ad68-da5c5edcf2c0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:52.908499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8ea133a-1da2-44b2-ad68-da5c5edcf2c0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:52.909303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8ea133a-1da2-44b2-ad68-da5c5edcf2c0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:52.910618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8ea133a-1da2-44b2-ad68-da5c5edcf2c0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:52.914675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8ea133a-1da2-44b2-ad68-da5c5edcf2c0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:52.923323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8ea133a-1da2-44b2-ad68-da5c5edcf2c0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:53.528638 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d8ea133a-1da2-44b2-ad68-da5c5edcf2c0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:02:53.557391 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d8ea133a-1da2-44b2-ad68-da5c5edcf2c0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f" status: 200 len: 1365 microversion: 2.1 time: 0.693145 Sep 07 13:02:53.559205 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2767/5580] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:02:52 2022] GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f => generated 1365 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:02:54.600021 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bbebe5ad-1109-458e-9654-76bb3b6adf8d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:54.602418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bbebe5ad-1109-458e-9654-76bb3b6adf8d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:02:54.607631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:54.632261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbebe5ad-1109-458e-9654-76bb3b6adf8d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:54.632868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbebe5ad-1109-458e-9654-76bb3b6adf8d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:54.633313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbebe5ad-1109-458e-9654-76bb3b6adf8d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:54.641980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbebe5ad-1109-458e-9654-76bb3b6adf8d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:54.646170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbebe5ad-1109-458e-9654-76bb3b6adf8d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:54.648806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbebe5ad-1109-458e-9654-76bb3b6adf8d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:55.221045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bbebe5ad-1109-458e-9654-76bb3b6adf8d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:02:55.252652 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bbebe5ad-1109-458e-9654-76bb3b6adf8d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f" status: 200 len: 1365 microversion: 2.1 time: 0.654285 Sep 07 13:02:55.277822 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2814/5581] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:02:54 2022] GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f => generated 1365 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:02:56.307960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d2242e21-1b69-4132-898f-9d2c1918e59c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:56.310160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d2242e21-1b69-4132-898f-9d2c1918e59c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:02:56.332269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2242e21-1b69-4132-898f-9d2c1918e59c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:56.333789 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2242e21-1b69-4132-898f-9d2c1918e59c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:56.334904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2242e21-1b69-4132-898f-9d2c1918e59c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:56.337562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2242e21-1b69-4132-898f-9d2c1918e59c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:56.338660 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2242e21-1b69-4132-898f-9d2c1918e59c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:56.340660 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2242e21-1b69-4132-898f-9d2c1918e59c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:56.932134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d2242e21-1b69-4132-898f-9d2c1918e59c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:02:56.961860 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d2242e21-1b69-4132-898f-9d2c1918e59c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f" status: 200 len: 1365 microversion: 2.1 time: 0.661211 Sep 07 13:02:56.963315 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2768/5582] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:02:56 2022] GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f => generated 1365 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:02:58.015016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0d7bf697-5d6b-4d59-9564-9d9f21898b62 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:58.022970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0d7bf697-5d6b-4d59-9564-9d9f21898b62 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:02:58.066298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d7bf697-5d6b-4d59-9564-9d9f21898b62 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:58.067158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d7bf697-5d6b-4d59-9564-9d9f21898b62 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:58.068182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d7bf697-5d6b-4d59-9564-9d9f21898b62 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:58.069135 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d7bf697-5d6b-4d59-9564-9d9f21898b62 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:58.070083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d7bf697-5d6b-4d59-9564-9d9f21898b62 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:58.070853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d7bf697-5d6b-4d59-9564-9d9f21898b62 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:58.890043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0d7bf697-5d6b-4d59-9564-9d9f21898b62 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:02:58.920749 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0d7bf697-5d6b-4d59-9564-9d9f21898b62 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f" status: 200 len: 1365 microversion: 2.1 time: 0.916001 Sep 07 13:02:58.925253 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2815/5583] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:02:58 2022] GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f => generated 1365 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:02:59.323320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-2bd8d85a-e0c8-408c-8f00-9c1f002b0fe3 req-bee4fda8-fd90-4023-8dc3-dde7cdeb1b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "925a496f-7b54-406f-8d4b-5470d75f637f", "name": "network-vif-plugged", "status": "completed", "tag": "409569fc-fee9-4fea-a617-c3cecedc0305"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:02:59.381019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9c7ecd14-e499-447e-b4de-bb469bc705c5 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-679524886", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "89bfd9b1-1f66-41f4-8727-9072e3747601"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:02:59.407302 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:59.424013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2bd8d85a-e0c8-408c-8f00-9c1f002b0fe3 req-bee4fda8-fd90-4023-8dc3-dde7cdeb1b08 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:02:59.424875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2bd8d85a-e0c8-408c-8f00-9c1f002b0fe3 req-bee4fda8-fd90-4023-8dc3-dde7cdeb1b08 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:02:59.428605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2bd8d85a-e0c8-408c-8f00-9c1f002b0fe3 req-bee4fda8-fd90-4023-8dc3-dde7cdeb1b08 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:02:59.459843 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:59.509469 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-2bd8d85a-e0c8-408c-8f00-9c1f002b0fe3 req-bee4fda8-fd90-4023-8dc3-dde7cdeb1b08 service nova] Creating event network-vif-plugged:409569fc-fee9-4fea-a617-c3cecedc0305 for instance 925a496f-7b54-406f-8d4b-5470d75f637f on n-h1-852087-9 Sep 07 13:02:59.520458 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-2bd8d85a-e0c8-408c-8f00-9c1f002b0fe3 req-bee4fda8-fd90-4023-8dc3-dde7cdeb1b08 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204134 Sep 07 13:02:59.522819 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2769/5584] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:02:59.580305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-9c7ecd14-e499-447e-b4de-bb469bc705c5 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] validate_networks() for [('89bfd9b1-1f66-41f4-8727-9072e3747601', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:02:59.985146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-86d915b6-bc26-4eaa-87f5-d5433355a87d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:02:59.996769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-86d915b6-bc26-4eaa-87f5-d5433355a87d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:00.060621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86d915b6-bc26-4eaa-87f5-d5433355a87d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:00.061520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86d915b6-bc26-4eaa-87f5-d5433355a87d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:00.062525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86d915b6-bc26-4eaa-87f5-d5433355a87d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:00.063486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86d915b6-bc26-4eaa-87f5-d5433355a87d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:00.064236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86d915b6-bc26-4eaa-87f5-d5433355a87d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:00.072671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86d915b6-bc26-4eaa-87f5-d5433355a87d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:00.593223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-86d915b6-bc26-4eaa-87f5-d5433355a87d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:00.608159 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-86d915b6-bc26-4eaa-87f5-d5433355a87d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f" status: 200 len: 1365 microversion: 2.1 time: 0.645116 Sep 07 13:03:00.612633 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2770/5585] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:02:59 2022] GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f => generated 1365 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:00.962382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-9c7ecd14-e499-447e-b4de-bb469bc705c5 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:03:00.963324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-9c7ecd14-e499-447e-b4de-bb469bc705c5 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:03:00.964088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-9c7ecd14-e499-447e-b4de-bb469bc705c5 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:03:00.964481 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-9c7ecd14-e499-447e-b4de-bb469bc705c5 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:03:00.964909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-9c7ecd14-e499-447e-b4de-bb469bc705c5 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:03:00.980903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c7ecd14-e499-447e-b4de-bb469bc705c5 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:00.981409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c7ecd14-e499-447e-b4de-bb469bc705c5 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:00.981897 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c7ecd14-e499-447e-b4de-bb469bc705c5 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:00.982661 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c7ecd14-e499-447e-b4de-bb469bc705c5 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:00.983134 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c7ecd14-e499-447e-b4de-bb469bc705c5 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:00.992287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c7ecd14-e499-447e-b4de-bb469bc705c5 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:01.084472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-9c7ecd14-e499-447e-b4de-bb469bc705c5 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Getting quotas for project 7f8ccc06e20b4c5e98030d208abaa13b. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:03:01.123994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-9c7ecd14-e499-447e-b4de-bb469bc705c5 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Getting quotas for user a01aef6b538748118cc315eee680fee3 and project 7f8ccc06e20b4c5e98030d208abaa13b. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:03:01.210668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9c7ecd14-e499-447e-b4de-bb469bc705c5 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:03:01.217706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9c7ecd14-e499-447e-b4de-bb469bc705c5 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 66dad4f0-53a7-4251-ba1f-0abff51898fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:03:01.342230 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9c7ecd14-e499-447e-b4de-bb469bc705c5 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.996088 Sep 07 13:03:01.345033 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2816/5586] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:02:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:03:01.356722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fa68e823-e84a-4aa6-9275-80bae08c9bc3 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:01.357894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fa68e823-e84a-4aa6-9275-80bae08c9bc3 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 66dad4f0-53a7-4251-ba1f-0abff51898fe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:01.642203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ee84e20b-3ed5-474a-8ec3-0e842c566a44 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:01.643164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ee84e20b-3ed5-474a-8ec3-0e842c566a44 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:01.698153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fa68e823-e84a-4aa6-9275-80bae08c9bc3 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:01.708752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee84e20b-3ed5-474a-8ec3-0e842c566a44 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:01.711785 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fa68e823-e84a-4aa6-9275-80bae08c9bc3 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe" status: 200 len: 1213 microversion: 2.1 time: 0.359135 Sep 07 13:03:01.713835 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee84e20b-3ed5-474a-8ec3-0e842c566a44 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:01.716519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee84e20b-3ed5-474a-8ec3-0e842c566a44 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:01.720198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee84e20b-3ed5-474a-8ec3-0e842c566a44 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:01.724374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee84e20b-3ed5-474a-8ec3-0e842c566a44 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:01.732255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee84e20b-3ed5-474a-8ec3-0e842c566a44 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:01.736639 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2771/5587] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:01 2022] GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe => generated 1213 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:02.335525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ee84e20b-3ed5-474a-8ec3-0e842c566a44 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:02.369975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=69 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:02.374268 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ee84e20b-3ed5-474a-8ec3-0e842c566a44 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f" status: 200 len: 1555 microversion: 2.1 time: 0.737050 Sep 07 13:03:02.388256 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2817/5588] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:01 2022] GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f => generated 1555 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:02.449474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-606c8943-17b5-45bf-a232-f28d5b94f084 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:02.452848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-606c8943-17b5-45bf-a232-f28d5b94f084 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:02.480870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-606c8943-17b5-45bf-a232-f28d5b94f084 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:02.484407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-606c8943-17b5-45bf-a232-f28d5b94f084 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:02.490088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-606c8943-17b5-45bf-a232-f28d5b94f084 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:02.491392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-606c8943-17b5-45bf-a232-f28d5b94f084 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:02.493383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-606c8943-17b5-45bf-a232-f28d5b94f084 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:02.524301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-606c8943-17b5-45bf-a232-f28d5b94f084 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:02.744188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7408ea37-65c5-4ee2-bc02-6856e741a80a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:02.745239 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7408ea37-65c5-4ee2-bc02-6856e741a80a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 66dad4f0-53a7-4251-ba1f-0abff51898fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:02.924627 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-606c8943-17b5-45bf-a232-f28d5b94f084 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.485612 Sep 07 13:03:02.925875 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2772/5589] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Sep 7 13:03:02 2022] GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f/os-interface => generated 285 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:03:04.235946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7408ea37-65c5-4ee2-bc02-6856e741a80a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:04.274072 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7408ea37-65c5-4ee2-bc02-6856e741a80a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe" status: 200 len: 1213 microversion: 2.1 time: 1.533160 Sep 07 13:03:04.289510 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2818/5590] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:02 2022] GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe => generated 1213 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:05.318472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0759ec4e-b95c-423e-ae88-65753a642654 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:05.322040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0759ec4e-b95c-423e-ae88-65753a642654 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 66dad4f0-53a7-4251-ba1f-0abff51898fe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:05.400437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0759ec4e-b95c-423e-ae88-65753a642654 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:05.402384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0759ec4e-b95c-423e-ae88-65753a642654 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:05.403422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0759ec4e-b95c-423e-ae88-65753a642654 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:05.408355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0759ec4e-b95c-423e-ae88-65753a642654 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:05.411197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0759ec4e-b95c-423e-ae88-65753a642654 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:05.426929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0759ec4e-b95c-423e-ae88-65753a642654 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:06.075615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0759ec4e-b95c-423e-ae88-65753a642654 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:06.116358 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0759ec4e-b95c-423e-ae88-65753a642654 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe" status: 200 len: 1265 microversion: 2.1 time: 0.813818 Sep 07 13:03:06.131574 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2773/5591] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:05 2022] GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe => generated 1265 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:03:07.154785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-72ea9e97-39e7-4da3-8ea7-f5d1a8a6234e tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:07.160994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-72ea9e97-39e7-4da3-8ea7-f5d1a8a6234e tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 66dad4f0-53a7-4251-ba1f-0abff51898fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:07.194351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72ea9e97-39e7-4da3-8ea7-f5d1a8a6234e tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:07.202221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72ea9e97-39e7-4da3-8ea7-f5d1a8a6234e tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:07.206582 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72ea9e97-39e7-4da3-8ea7-f5d1a8a6234e tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:07.227654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72ea9e97-39e7-4da3-8ea7-f5d1a8a6234e tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:07.235175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72ea9e97-39e7-4da3-8ea7-f5d1a8a6234e tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:07.241746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72ea9e97-39e7-4da3-8ea7-f5d1a8a6234e tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:08.117410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-763ae5b3-f372-4ae9-95b6-2fe190f06c2a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:08.130560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-763ae5b3-f372-4ae9-95b6-2fe190f06c2a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:08.158971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-763ae5b3-f372-4ae9-95b6-2fe190f06c2a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:08.162228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-763ae5b3-f372-4ae9-95b6-2fe190f06c2a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:08.167699 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-763ae5b3-f372-4ae9-95b6-2fe190f06c2a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:08.169370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-763ae5b3-f372-4ae9-95b6-2fe190f06c2a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:08.170465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-763ae5b3-f372-4ae9-95b6-2fe190f06c2a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:08.174262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-763ae5b3-f372-4ae9-95b6-2fe190f06c2a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:08.364344 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-763ae5b3-f372-4ae9-95b6-2fe190f06c2a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.249319 Sep 07 13:03:08.370472 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2774/5592] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:03:08 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c/os-volume_attachments => generated 25 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 13:03:08.750049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-72ea9e97-39e7-4da3-8ea7-f5d1a8a6234e tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:08.766652 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-72ea9e97-39e7-4da3-8ea7-f5d1a8a6234e tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe" status: 200 len: 1271 microversion: 2.1 time: 1.621846 Sep 07 13:03:08.772813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-8220b35a-4775-4b6b-8ed3-45a05ecd712b req-a9640341-21c9-437a-ae71-63d0f9172b3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "925a496f-7b54-406f-8d4b-5470d75f637f", "tag": "409569fc-fee9-4fea-a617-c3cecedc0305"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:03:08.775480 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2819/5593] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:07 2022] GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe => generated 1271 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:03:08.794604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8220b35a-4775-4b6b-8ed3-45a05ecd712b req-a9640341-21c9-437a-ae71-63d0f9172b3a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:08.797979 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8220b35a-4775-4b6b-8ed3-45a05ecd712b req-a9640341-21c9-437a-ae71-63d0f9172b3a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:08.799181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8220b35a-4775-4b6b-8ed3-45a05ecd712b req-a9640341-21c9-437a-ae71-63d0f9172b3a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:08.836594 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-8220b35a-4775-4b6b-8ed3-45a05ecd712b req-a9640341-21c9-437a-ae71-63d0f9172b3a service nova] Creating event network-changed:409569fc-fee9-4fea-a617-c3cecedc0305 for instance 925a496f-7b54-406f-8d4b-5470d75f637f on n-h1-852087-9 Sep 07 13:03:08.848722 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-8220b35a-4775-4b6b-8ed3-45a05ecd712b req-a9640341-21c9-437a-ae71-63d0f9172b3a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085167 Sep 07 13:03:08.851036 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2775/5594] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:03:08.862639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-966c9cd8-906e-4933-a3c7-3914a2585443 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:08.865544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-966c9cd8-906e-4933-a3c7-3914a2585443 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:08.920957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-966c9cd8-906e-4933-a3c7-3914a2585443 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:08.924453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-966c9cd8-906e-4933-a3c7-3914a2585443 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:08.930736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-966c9cd8-906e-4933-a3c7-3914a2585443 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:08.931732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-966c9cd8-906e-4933-a3c7-3914a2585443 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:08.940442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-966c9cd8-906e-4933-a3c7-3914a2585443 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:08.941112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-966c9cd8-906e-4933-a3c7-3914a2585443 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:09.079751 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-966c9cd8-906e-4933-a3c7-3914a2585443 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.220033 Sep 07 13:03:09.080413 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2820/5595] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:03:08 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c/os-volume_attachments => generated 25 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 13:03:09.290214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-260df140-e568-4b5a-a813-36b0f3e86c2d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:09.299262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-260df140-e568-4b5a-a813-36b0f3e86c2d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:09.346558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-260df140-e568-4b5a-a813-36b0f3e86c2d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:09.352936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-260df140-e568-4b5a-a813-36b0f3e86c2d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:09.353763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-260df140-e568-4b5a-a813-36b0f3e86c2d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:09.363324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-260df140-e568-4b5a-a813-36b0f3e86c2d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:09.364345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-260df140-e568-4b5a-a813-36b0f3e86c2d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:09.369455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-260df140-e568-4b5a-a813-36b0f3e86c2d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:09.615115 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-260df140-e568-4b5a-a813-36b0f3e86c2d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:03:09.814038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-77bb8651-2c0a-44a6-bd5b-218adfde603f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:09.814748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-77bb8651-2c0a-44a6-bd5b-218adfde603f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 66dad4f0-53a7-4251-ba1f-0abff51898fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:09.839707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77bb8651-2c0a-44a6-bd5b-218adfde603f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:09.846724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77bb8651-2c0a-44a6-bd5b-218adfde603f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:09.847576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77bb8651-2c0a-44a6-bd5b-218adfde603f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:09.850311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77bb8651-2c0a-44a6-bd5b-218adfde603f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:09.858020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77bb8651-2c0a-44a6-bd5b-218adfde603f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:09.859956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77bb8651-2c0a-44a6-bd5b-218adfde603f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:10.021655 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-260df140-e568-4b5a-a813-36b0f3e86c2d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "DELETE /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c" status: 204 len: 0 microversion: 2.1 time: 0.760041 Sep 07 13:03:10.030590 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2776/5596] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:03:09 2022] DELETE /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c => generated 0 bytes in 770 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:03:10.049339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ab129498-5228-4e47-8867-e74308617a7d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:10.052123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ab129498-5228-4e47-8867-e74308617a7d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:10.065794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab129498-5228-4e47-8867-e74308617a7d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:10.066592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab129498-5228-4e47-8867-e74308617a7d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:10.067789 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab129498-5228-4e47-8867-e74308617a7d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:10.069076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab129498-5228-4e47-8867-e74308617a7d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:10.069911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab129498-5228-4e47-8867-e74308617a7d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:10.070614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ab129498-5228-4e47-8867-e74308617a7d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:10.342857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-77bb8651-2c0a-44a6-bd5b-218adfde603f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:10.366402 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-77bb8651-2c0a-44a6-bd5b-218adfde603f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe" status: 200 len: 1271 microversion: 2.1 time: 0.549342 Sep 07 13:03:10.367851 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2821/5597] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:09 2022] GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe => generated 1271 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:03:10.948999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ab129498-5228-4e47-8867-e74308617a7d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:10.984610 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ab129498-5228-4e47-8867-e74308617a7d tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c" status: 200 len: 1674 microversion: 2.1 time: 0.948962 Sep 07 13:03:10.988629 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2777/5598] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:10 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c => generated 1674 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:11.413466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:11.427743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-93dcb4d8-8ac3-4e12-b5a2-f6eb1ac34bf8 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:11.429057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-93dcb4d8-8ac3-4e12-b5a2-f6eb1ac34bf8 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 66dad4f0-53a7-4251-ba1f-0abff51898fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:11.469226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93dcb4d8-8ac3-4e12-b5a2-f6eb1ac34bf8 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:11.470564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93dcb4d8-8ac3-4e12-b5a2-f6eb1ac34bf8 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:11.473414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93dcb4d8-8ac3-4e12-b5a2-f6eb1ac34bf8 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:11.487255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93dcb4d8-8ac3-4e12-b5a2-f6eb1ac34bf8 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:11.490624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93dcb4d8-8ac3-4e12-b5a2-f6eb1ac34bf8 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:11.491719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93dcb4d8-8ac3-4e12-b5a2-f6eb1ac34bf8 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:12.121694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-506d958a-e3b6-4a89-9cbd-ec98e8a309f6 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:12.132428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-506d958a-e3b6-4a89-9cbd-ec98e8a309f6 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:12.167112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:12.185968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-506d958a-e3b6-4a89-9cbd-ec98e8a309f6 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:12.190629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-506d958a-e3b6-4a89-9cbd-ec98e8a309f6 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:12.192092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-506d958a-e3b6-4a89-9cbd-ec98e8a309f6 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:12.193120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-506d958a-e3b6-4a89-9cbd-ec98e8a309f6 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:12.194210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-506d958a-e3b6-4a89-9cbd-ec98e8a309f6 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:12.198119 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-506d958a-e3b6-4a89-9cbd-ec98e8a309f6 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:12.915679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-93dcb4d8-8ac3-4e12-b5a2-f6eb1ac34bf8 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:12.940560 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-93dcb4d8-8ac3-4e12-b5a2-f6eb1ac34bf8 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe" status: 200 len: 1271 microversion: 2.1 time: 1.529437 Sep 07 13:03:12.941321 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2822/5599] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:11 2022] GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe => generated 1271 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:13.216357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-506d958a-e3b6-4a89-9cbd-ec98e8a309f6 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:13.258019 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-506d958a-e3b6-4a89-9cbd-ec98e8a309f6 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c" status: 200 len: 1674 microversion: 2.1 time: 1.230878 Sep 07 13:03:13.268349 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2778/5600] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:12 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c => generated 1674 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:14.005698 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1c658171-bf24-494e-b9be-c1920b5b5a29 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:14.011992 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1c658171-bf24-494e-b9be-c1920b5b5a29 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 66dad4f0-53a7-4251-ba1f-0abff51898fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:14.043761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c658171-bf24-494e-b9be-c1920b5b5a29 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:14.044793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c658171-bf24-494e-b9be-c1920b5b5a29 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:14.046519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c658171-bf24-494e-b9be-c1920b5b5a29 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:14.047678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c658171-bf24-494e-b9be-c1920b5b5a29 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:14.050792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c658171-bf24-494e-b9be-c1920b5b5a29 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:14.054898 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c658171-bf24-494e-b9be-c1920b5b5a29 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:14.258459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:14.329443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-172169a8-dbfe-4f12-8f59-c3a21138b264 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:14.335697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-172169a8-dbfe-4f12-8f59-c3a21138b264 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:14.367813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-172169a8-dbfe-4f12-8f59-c3a21138b264 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:14.369802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-172169a8-dbfe-4f12-8f59-c3a21138b264 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:14.372711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-172169a8-dbfe-4f12-8f59-c3a21138b264 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:14.374787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-172169a8-dbfe-4f12-8f59-c3a21138b264 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:14.379419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-172169a8-dbfe-4f12-8f59-c3a21138b264 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:14.380517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-172169a8-dbfe-4f12-8f59-c3a21138b264 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:14.795279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1c658171-bf24-494e-b9be-c1920b5b5a29 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:14.804033 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1c658171-bf24-494e-b9be-c1920b5b5a29 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe" status: 200 len: 1313 microversion: 2.1 time: 0.809035 Sep 07 13:03:14.810132 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2823/5601] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:13 2022] GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe => generated 1313 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:15.016990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-172169a8-dbfe-4f12-8f59-c3a21138b264 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:15.079653 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-172169a8-dbfe-4f12-8f59-c3a21138b264 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c" status: 200 len: 1674 microversion: 2.1 time: 0.767850 Sep 07 13:03:15.080818 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2779/5602] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:14 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c => generated 1674 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:03:15.861852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-51e41308-cb1f-407e-a645-ff8f890cd463 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:15.866437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-51e41308-cb1f-407e-a645-ff8f890cd463 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 66dad4f0-53a7-4251-ba1f-0abff51898fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:15.927231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51e41308-cb1f-407e-a645-ff8f890cd463 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:15.927231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51e41308-cb1f-407e-a645-ff8f890cd463 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:15.927862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51e41308-cb1f-407e-a645-ff8f890cd463 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:15.935529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51e41308-cb1f-407e-a645-ff8f890cd463 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:15.938276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51e41308-cb1f-407e-a645-ff8f890cd463 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:15.940017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51e41308-cb1f-407e-a645-ff8f890cd463 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:16.132621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1b664f8b-0a5d-4e0e-9ffa-cd976244fe6b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:16.134836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1b664f8b-0a5d-4e0e-9ffa-cd976244fe6b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:16.159468 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b664f8b-0a5d-4e0e-9ffa-cd976244fe6b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:16.166730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b664f8b-0a5d-4e0e-9ffa-cd976244fe6b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:16.167805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b664f8b-0a5d-4e0e-9ffa-cd976244fe6b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:16.169332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b664f8b-0a5d-4e0e-9ffa-cd976244fe6b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:16.170448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b664f8b-0a5d-4e0e-9ffa-cd976244fe6b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:16.172326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b664f8b-0a5d-4e0e-9ffa-cd976244fe6b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:16.593466 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1b664f8b-0a5d-4e0e-9ffa-cd976244fe6b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:16.623144 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1b664f8b-0a5d-4e0e-9ffa-cd976244fe6b tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c" status: 200 len: 1606 microversion: 2.1 time: 0.496797 Sep 07 13:03:16.630001 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2780/5603] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:16 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c => generated 1606 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:17.632082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-baa509d6-a046-43a2-8d74-f5d21bcd11ec req-f51276ad-679e-4e76-9299-2d32dda82ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66dad4f0-53a7-4251-ba1f-0abff51898fe", "tag": "b7beeee5-17f2-4cc4-b4cb-78de2da07ddf"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:03:17.655316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-baa509d6-a046-43a2-8d74-f5d21bcd11ec req-f51276ad-679e-4e76-9299-2d32dda82ab6 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:17.655825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-baa509d6-a046-43a2-8d74-f5d21bcd11ec req-f51276ad-679e-4e76-9299-2d32dda82ab6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:17.656263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-baa509d6-a046-43a2-8d74-f5d21bcd11ec req-f51276ad-679e-4e76-9299-2d32dda82ab6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:17.711295 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-baa509d6-a046-43a2-8d74-f5d21bcd11ec req-f51276ad-679e-4e76-9299-2d32dda82ab6 service nova] Creating event network-changed:b7beeee5-17f2-4cc4-b4cb-78de2da07ddf for instance 66dad4f0-53a7-4251-ba1f-0abff51898fe on n-h2-852087-9 Sep 07 13:03:17.722884 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-baa509d6-a046-43a2-8d74-f5d21bcd11ec req-f51276ad-679e-4e76-9299-2d32dda82ab6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101860 Sep 07 13:03:17.729716 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2781/5604] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:03:17.742164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-51e41308-cb1f-407e-a645-ff8f890cd463 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:17.747009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-70a7b461-2953-4515-9c1b-36837fbc87fb tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:17.748605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-70a7b461-2953-4515-9c1b-36837fbc87fb tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:17.774563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70a7b461-2953-4515-9c1b-36837fbc87fb tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:17.775934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70a7b461-2953-4515-9c1b-36837fbc87fb tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:17.781741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70a7b461-2953-4515-9c1b-36837fbc87fb tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:17.782871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70a7b461-2953-4515-9c1b-36837fbc87fb tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:17.783594 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70a7b461-2953-4515-9c1b-36837fbc87fb tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:17.784609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70a7b461-2953-4515-9c1b-36837fbc87fb tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:17.807338 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-51e41308-cb1f-407e-a645-ff8f890cd463 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe" status: 200 len: 1313 microversion: 2.1 time: 1.957317 Sep 07 13:03:17.822044 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2824/5605] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:15 2022] GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe => generated 1313 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:03:18.841810 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd0e757d-a2d7-4f43-afed-e82f3babbedd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:18.844103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dd0e757d-a2d7-4f43-afed-e82f3babbedd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 66dad4f0-53a7-4251-ba1f-0abff51898fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:18.880247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd0e757d-a2d7-4f43-afed-e82f3babbedd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:18.881669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd0e757d-a2d7-4f43-afed-e82f3babbedd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:18.882737 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd0e757d-a2d7-4f43-afed-e82f3babbedd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:18.885030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd0e757d-a2d7-4f43-afed-e82f3babbedd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:18.886795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd0e757d-a2d7-4f43-afed-e82f3babbedd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:18.891816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd0e757d-a2d7-4f43-afed-e82f3babbedd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:18.979069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-70a7b461-2953-4515-9c1b-36837fbc87fb tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:19.076391 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-70a7b461-2953-4515-9c1b-36837fbc87fb tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c" status: 200 len: 1606 microversion: 2.1 time: 1.342888 Sep 07 13:03:19.097538 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2782/5606] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:17 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c => generated 1606 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:19.117020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-14402196-85d7-40ce-9463-fb64181c14b9 req-bf9c4a55-19ae-4d1e-ad67-8629aed339cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43152d55-6621-43f6-bb60-1be3d638859c", "name": "network-vif-deleted", "tag": "443262c8-fc2a-41c4-b789-a7672d694de2"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:03:19.226824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-14402196-85d7-40ce-9463-fb64181c14b9 req-bf9c4a55-19ae-4d1e-ad67-8629aed339cd service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:19.231177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-14402196-85d7-40ce-9463-fb64181c14b9 req-bf9c4a55-19ae-4d1e-ad67-8629aed339cd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:19.236092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-14402196-85d7-40ce-9463-fb64181c14b9 req-bf9c4a55-19ae-4d1e-ad67-8629aed339cd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:19.305791 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-14402196-85d7-40ce-9463-fb64181c14b9 req-bf9c4a55-19ae-4d1e-ad67-8629aed339cd service nova] Creating event network-vif-deleted:443262c8-fc2a-41c4-b789-a7672d694de2 for instance 43152d55-6621-43f6-bb60-1be3d638859c on n-h2-852087-9 Sep 07 13:03:19.316928 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-14402196-85d7-40ce-9463-fb64181c14b9 req-bf9c4a55-19ae-4d1e-ad67-8629aed339cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.231353 Sep 07 13:03:19.326064 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2783/5607] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:03:19.832456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dd0e757d-a2d7-4f43-afed-e82f3babbedd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:19.866759 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dd0e757d-a2d7-4f43-afed-e82f3babbedd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe" status: 200 len: 1313 microversion: 2.1 time: 1.032634 Sep 07 13:03:19.898550 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2825/5608] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:18 2022] GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe => generated 1313 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:03:20.115065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-17615391-3d31-441b-ad6c-7ab3dee91cf2 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:20.115859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-17615391-3d31-441b-ad6c-7ab3dee91cf2 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:20.142433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17615391-3d31-441b-ad6c-7ab3dee91cf2 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:20.142946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17615391-3d31-441b-ad6c-7ab3dee91cf2 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:20.149010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17615391-3d31-441b-ad6c-7ab3dee91cf2 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:20.150444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17615391-3d31-441b-ad6c-7ab3dee91cf2 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:20.152527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17615391-3d31-441b-ad6c-7ab3dee91cf2 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:20.159559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17615391-3d31-441b-ad6c-7ab3dee91cf2 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:20.309505 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17615391-3d31-441b-ad6c-7ab3dee91cf2 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:20.312595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17615391-3d31-441b-ad6c-7ab3dee91cf2 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:20.314813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-17615391-3d31-441b-ad6c-7ab3dee91cf2 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:20.315471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-17615391-3d31-441b-ad6c-7ab3dee91cf2 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lazy-loading 'fault' on Instance uuid 43152d55-6621-43f6-bb60-1be3d638859c {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:03:20.450022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-17615391-3d31-441b-ad6c-7ab3dee91cf2 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384329dd16dd48a1af7f197c71af2f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '059d18cef73a40b49cb707c7838973a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:20.471978 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-17615391-3d31-441b-ad6c-7ab3dee91cf2 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c" status: 200 len: 1328 microversion: 2.1 time: 0.363684 Sep 07 13:03:20.507531 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2784/5609] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:20 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c => generated 1328 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:20.940170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-821caffd-36bb-4e2e-8241-bbcd175a6068 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:20.941676 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-821caffd-36bb-4e2e-8241-bbcd175a6068 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 66dad4f0-53a7-4251-ba1f-0abff51898fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:21.034755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-821caffd-36bb-4e2e-8241-bbcd175a6068 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:21.042461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-821caffd-36bb-4e2e-8241-bbcd175a6068 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:21.044501 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-821caffd-36bb-4e2e-8241-bbcd175a6068 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:21.051962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-821caffd-36bb-4e2e-8241-bbcd175a6068 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:21.062086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-821caffd-36bb-4e2e-8241-bbcd175a6068 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:21.071762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-821caffd-36bb-4e2e-8241-bbcd175a6068 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:21.534512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2a61efba-1c3f-4fb9-b319-2397ef8cc611 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:21.542301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2a61efba-1c3f-4fb9-b319-2397ef8cc611 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:21.579460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a61efba-1c3f-4fb9-b319-2397ef8cc611 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:21.581122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a61efba-1c3f-4fb9-b319-2397ef8cc611 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:21.582737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a61efba-1c3f-4fb9-b319-2397ef8cc611 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:21.584777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a61efba-1c3f-4fb9-b319-2397ef8cc611 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:21.586077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a61efba-1c3f-4fb9-b319-2397ef8cc611 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:21.587184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a61efba-1c3f-4fb9-b319-2397ef8cc611 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:21.623296 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-2a61efba-1c3f-4fb9-b319-2397ef8cc611 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] HTTP exception thrown: Instance 43152d55-6621-43f6-bb60-1be3d638859c could not be found. Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2a61efba-1c3f-4fb9-b319-2397ef8cc611 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Request method failure captured: Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c HTTP/1.1 Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJSwrdCTJZT039O4ZFBiDNF-9lnSNJ5qqRLPDE3jJHhPAuZ6xSXr3ekQWDw7lgbDe8omv1w6tBQ6o27AyuoefCVq-QB4sZnxss5gbNHXOE8Em7Af2Hrzho9qF1EQDE_ezya2iFFwxu4aUR8xxgpI_a9J5V4s0T2xCMenjg2QkpA5JNY Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 059d18cef73a40b49cb707c7838973a9 Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeTestJSON-483833901 Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/059d18cef73a40b49cb707c7838973a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_059d18cef73a40b49cb707c7838973a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/059d18cef73a40b49cb707c7838973a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/059d18cef73a40b49cb707c7838973a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeTestJSON-483833901 Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 059d18cef73a40b49cb707c7838973a9 Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeTestJSON-483833901 Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeTestJSON-483833901-project Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 384329dd16dd48a1af7f197c71af2f4c Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeTestJSON-483833901-project Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 43152d55-6621-43f6-bb60-1be3d638859c could not be found. Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '43152d55-6621-43f6-bb60-1be3d638859c'} Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43152d55-6621-43f6-bb60-1be3d638859c could not be found. Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43152d55-6621-43f6-bb60-1be3d638859c could not be found. Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:03:21.650237 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:03:21.656094 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:21.656094 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:03:21.656094 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:03:21.656094 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:03:21.656094 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:03:21.656094 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43152d55-6621-43f6-bb60-1be3d638859c could not be found. Sep 07 13:03:21.656094 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:03:21.664498 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2a61efba-1c3f-4fb9-b319-2397ef8cc611 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Returning 404 to user: Instance 43152d55-6621-43f6-bb60-1be3d638859c could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:03:21.669160 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2a61efba-1c3f-4fb9-b319-2397ef8cc611 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c" status: 404 len: 111 microversion: 2.1 time: 0.142655 Sep 07 13:03:21.681588 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2785/5610] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:21 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:03:21.709580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4ffb9ae1-374a-4b38-a8bd-979c126e2d81 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '.version_select at 0x7fc41d1f1790>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:21.795909 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4ffb9ae1-374a-4b38-a8bd-979c126e2d81 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2098577368" status: 202 len: 0 microversion: 2.1 time: 0.110434 Sep 07 13:03:21.799801 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-821caffd-36bb-4e2e-8241-bbcd175a6068 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:21.806300 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2786/5611] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Sep 7 13:03:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2098577368 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:03:21.823691 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-821caffd-36bb-4e2e-8241-bbcd175a6068 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe" status: 200 len: 1313 microversion: 2.1 time: 0.915251 Sep 07 13:03:21.827640 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2826/5612] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:20 2022] GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe => generated 1313 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:22.879145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ce6c6824-7c67-4351-9a90-345f12128d84 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:22.881888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ce6c6824-7c67-4351-9a90-345f12128d84 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 66dad4f0-53a7-4251-ba1f-0abff51898fe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:22.896633 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce6c6824-7c67-4351-9a90-345f12128d84 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:22.898159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce6c6824-7c67-4351-9a90-345f12128d84 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:22.900566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce6c6824-7c67-4351-9a90-345f12128d84 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:22.903413 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce6c6824-7c67-4351-9a90-345f12128d84 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:22.904824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce6c6824-7c67-4351-9a90-345f12128d84 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:22.905935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce6c6824-7c67-4351-9a90-345f12128d84 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:23.348283 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ce6c6824-7c67-4351-9a90-345f12128d84 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:23.395532 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ce6c6824-7c67-4351-9a90-345f12128d84 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe" status: 200 len: 1313 microversion: 2.1 time: 0.523575 Sep 07 13:03:23.396331 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2787/5613] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:22 2022] GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe => generated 1313 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:24.440797 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f47d4599-cf93-42dd-baa5-034dc95cfb50 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:24.447617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f47d4599-cf93-42dd-baa5-034dc95cfb50 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 66dad4f0-53a7-4251-ba1f-0abff51898fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:24.482175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f47d4599-cf93-42dd-baa5-034dc95cfb50 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:24.504303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f47d4599-cf93-42dd-baa5-034dc95cfb50 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:24.505220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f47d4599-cf93-42dd-baa5-034dc95cfb50 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:24.508235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f47d4599-cf93-42dd-baa5-034dc95cfb50 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:24.509246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f47d4599-cf93-42dd-baa5-034dc95cfb50 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:24.516217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f47d4599-cf93-42dd-baa5-034dc95cfb50 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:25.470810 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f47d4599-cf93-42dd-baa5-034dc95cfb50 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:25.563333 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f47d4599-cf93-42dd-baa5-034dc95cfb50 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe" status: 200 len: 1313 microversion: 2.1 time: 1.136032 Sep 07 13:03:25.564597 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2827/5614] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:24 2022] GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe => generated 1313 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:26.600227 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b188e7c-4d9f-4c73-9bf5-7ebae85ca947 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:26.601018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2b188e7c-4d9f-4c73-9bf5-7ebae85ca947 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 66dad4f0-53a7-4251-ba1f-0abff51898fe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:26.622461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b188e7c-4d9f-4c73-9bf5-7ebae85ca947 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:26.622993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b188e7c-4d9f-4c73-9bf5-7ebae85ca947 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:26.623460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b188e7c-4d9f-4c73-9bf5-7ebae85ca947 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:26.624249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b188e7c-4d9f-4c73-9bf5-7ebae85ca947 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:26.624741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b188e7c-4d9f-4c73-9bf5-7ebae85ca947 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:26.625180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b188e7c-4d9f-4c73-9bf5-7ebae85ca947 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:27.192717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2b188e7c-4d9f-4c73-9bf5-7ebae85ca947 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:27.209114 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2b188e7c-4d9f-4c73-9bf5-7ebae85ca947 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe" status: 200 len: 1313 microversion: 2.1 time: 0.613604 Sep 07 13:03:27.212862 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2788/5615] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:26 2022] GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe => generated 1313 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:03:27.834931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-580ad263-a109-4adc-a208-287d3e7d19a0 req-74dfe2be-4368-47db-bec7-ff52bb5ee329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66dad4f0-53a7-4251-ba1f-0abff51898fe", "name": "network-vif-plugged", "status": "completed", "tag": "b7beeee5-17f2-4cc4-b4cb-78de2da07ddf"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:03:27.873767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:27.912520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-580ad263-a109-4adc-a208-287d3e7d19a0 req-74dfe2be-4368-47db-bec7-ff52bb5ee329 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:27.913025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-580ad263-a109-4adc-a208-287d3e7d19a0 req-74dfe2be-4368-47db-bec7-ff52bb5ee329 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:27.913475 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-580ad263-a109-4adc-a208-287d3e7d19a0 req-74dfe2be-4368-47db-bec7-ff52bb5ee329 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:27.972369 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-580ad263-a109-4adc-a208-287d3e7d19a0 req-74dfe2be-4368-47db-bec7-ff52bb5ee329 service nova] Creating event network-vif-plugged:b7beeee5-17f2-4cc4-b4cb-78de2da07ddf for instance 66dad4f0-53a7-4251-ba1f-0abff51898fe on n-h2-852087-9 Sep 07 13:03:27.994135 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-580ad263-a109-4adc-a208-287d3e7d19a0 req-74dfe2be-4368-47db-bec7-ff52bb5ee329 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165786 Sep 07 13:03:27.998486 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2828/5616] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:03:28.263832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c91a222a-3a70-4e73-b53e-b4929b6fac6f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:28.268155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c91a222a-3a70-4e73-b53e-b4929b6fac6f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 66dad4f0-53a7-4251-ba1f-0abff51898fe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:28.305620 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c91a222a-3a70-4e73-b53e-b4929b6fac6f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:28.309689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c91a222a-3a70-4e73-b53e-b4929b6fac6f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:28.311147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c91a222a-3a70-4e73-b53e-b4929b6fac6f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:28.313760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c91a222a-3a70-4e73-b53e-b4929b6fac6f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:28.315356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c91a222a-3a70-4e73-b53e-b4929b6fac6f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:28.316717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c91a222a-3a70-4e73-b53e-b4929b6fac6f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:28.362227 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:29.034557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c91a222a-3a70-4e73-b53e-b4929b6fac6f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:29.071462 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c91a222a-3a70-4e73-b53e-b4929b6fac6f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe" status: 200 len: 1313 microversion: 2.1 time: 0.816736 Sep 07 13:03:29.112034 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2789/5617] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:28 2022] GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe => generated 1313 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:30.143793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f019a457-ad84-423c-952c-7528161a8c9a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:30.145260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f019a457-ad84-423c-952c-7528161a8c9a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 66dad4f0-53a7-4251-ba1f-0abff51898fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:30.205594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f019a457-ad84-423c-952c-7528161a8c9a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:30.208044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f019a457-ad84-423c-952c-7528161a8c9a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:30.209171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f019a457-ad84-423c-952c-7528161a8c9a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:30.213949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f019a457-ad84-423c-952c-7528161a8c9a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:30.214997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f019a457-ad84-423c-952c-7528161a8c9a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:30.221758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f019a457-ad84-423c-952c-7528161a8c9a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:31.479117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f019a457-ad84-423c-952c-7528161a8c9a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:31.519651 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f019a457-ad84-423c-952c-7528161a8c9a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe" status: 200 len: 1496 microversion: 2.1 time: 1.393699 Sep 07 13:03:31.532668 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2829/5618] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:30 2022] GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe => generated 1496 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:03:32.900061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b2e98a34-3af9-4c93-ba0b-cfb7229b37c4 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:32.903587 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b2e98a34-3af9-4c93-ba0b-cfb7229b37c4 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 66dad4f0-53a7-4251-ba1f-0abff51898fe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:32.920760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:32.952633 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2e98a34-3af9-4c93-ba0b-cfb7229b37c4 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:32.965841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2e98a34-3af9-4c93-ba0b-cfb7229b37c4 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:32.966844 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2e98a34-3af9-4c93-ba0b-cfb7229b37c4 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:32.987842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2e98a34-3af9-4c93-ba0b-cfb7229b37c4 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:32.990648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2e98a34-3af9-4c93-ba0b-cfb7229b37c4 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:32.995833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b2e98a34-3af9-4c93-ba0b-cfb7229b37c4 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:33.197625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b2e98a34-3af9-4c93-ba0b-cfb7229b37c4 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 66dad4f0-53a7-4251-ba1f-0abff51898fe] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:03:33.533632 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b2e98a34-3af9-4c93-ba0b-cfb7229b37c4 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "DELETE /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe" status: 204 len: 0 microversion: 2.1 time: 0.641349 Sep 07 13:03:33.566725 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d8afaed0-8853-4635-be2f-93fe6a113642 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:33.568303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d8afaed0-8853-4635-be2f-93fe6a113642 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 66dad4f0-53a7-4251-ba1f-0abff51898fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:33.571107 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2790/5619] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:03:32 2022] DELETE /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe => generated 0 bytes in 651 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:03:33.596289 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8afaed0-8853-4635-be2f-93fe6a113642 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:33.597537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8afaed0-8853-4635-be2f-93fe6a113642 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:33.602543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8afaed0-8853-4635-be2f-93fe6a113642 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:33.603752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8afaed0-8853-4635-be2f-93fe6a113642 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:33.604553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8afaed0-8853-4635-be2f-93fe6a113642 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:33.605564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8afaed0-8853-4635-be2f-93fe6a113642 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:33.625058 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=64 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:36.885275 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d8afaed0-8853-4635-be2f-93fe6a113642 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:36.932659 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d8afaed0-8853-4635-be2f-93fe6a113642 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe" status: 200 len: 1502 microversion: 2.1 time: 3.380803 Sep 07 13:03:36.962261 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2830/5620] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:33 2022] GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe => generated 1502 bytes in 3406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:38.015421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b766589b-2e1b-4413-a356-010e9ba6eb3a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:38.025292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b766589b-2e1b-4413-a356-010e9ba6eb3a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 66dad4f0-53a7-4251-ba1f-0abff51898fe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:38.073277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b766589b-2e1b-4413-a356-010e9ba6eb3a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:38.074370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b766589b-2e1b-4413-a356-010e9ba6eb3a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:38.076597 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b766589b-2e1b-4413-a356-010e9ba6eb3a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:38.083707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b766589b-2e1b-4413-a356-010e9ba6eb3a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:38.088801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b766589b-2e1b-4413-a356-010e9ba6eb3a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:38.090923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b766589b-2e1b-4413-a356-010e9ba6eb3a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:38.697552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b766589b-2e1b-4413-a356-010e9ba6eb3a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:38.723211 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b766589b-2e1b-4413-a356-010e9ba6eb3a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe" status: 200 len: 1460 microversion: 2.1 time: 0.740839 Sep 07 13:03:38.730328 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2791/5621] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:37 2022] GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe => generated 1460 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:38.878612 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-4afa7054-5162-4e53-983c-932528af9dc2 req-e435780c-5184-44fb-8f9a-e681413cbde1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66dad4f0-53a7-4251-ba1f-0abff51898fe", "name": "network-vif-deleted", "tag": "b7beeee5-17f2-4cc4-b4cb-78de2da07ddf"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:03:38.920519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4afa7054-5162-4e53-983c-932528af9dc2 req-e435780c-5184-44fb-8f9a-e681413cbde1 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:38.921224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4afa7054-5162-4e53-983c-932528af9dc2 req-e435780c-5184-44fb-8f9a-e681413cbde1 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:38.921866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4afa7054-5162-4e53-983c-932528af9dc2 req-e435780c-5184-44fb-8f9a-e681413cbde1 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:38.981219 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-4afa7054-5162-4e53-983c-932528af9dc2 req-e435780c-5184-44fb-8f9a-e681413cbde1 service nova] Creating event network-vif-deleted:b7beeee5-17f2-4cc4-b4cb-78de2da07ddf for instance 66dad4f0-53a7-4251-ba1f-0abff51898fe on n-h2-852087-9 Sep 07 13:03:39.004285 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-4afa7054-5162-4e53-983c-932528af9dc2 req-e435780c-5184-44fb-8f9a-e681413cbde1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129517 Sep 07 13:03:39.009514 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2831/5622] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:03:39.753720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-617e7ee3-7d12-473c-9fef-b6cf2ae7247e tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:39.757239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-617e7ee3-7d12-473c-9fef-b6cf2ae7247e tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 66dad4f0-53a7-4251-ba1f-0abff51898fe] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:39.793143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-617e7ee3-7d12-473c-9fef-b6cf2ae7247e tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:39.794506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-617e7ee3-7d12-473c-9fef-b6cf2ae7247e tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:39.795554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-617e7ee3-7d12-473c-9fef-b6cf2ae7247e tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:39.798581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-617e7ee3-7d12-473c-9fef-b6cf2ae7247e tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:39.800015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-617e7ee3-7d12-473c-9fef-b6cf2ae7247e tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:39.800989 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-617e7ee3-7d12-473c-9fef-b6cf2ae7247e tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:39.935857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-617e7ee3-7d12-473c-9fef-b6cf2ae7247e tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:39.939117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-617e7ee3-7d12-473c-9fef-b6cf2ae7247e tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:39.941713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-617e7ee3-7d12-473c-9fef-b6cf2ae7247e tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:39.943786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-617e7ee3-7d12-473c-9fef-b6cf2ae7247e tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lazy-loading 'fault' on Instance uuid 66dad4f0-53a7-4251-ba1f-0abff51898fe {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:03:40.231709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-617e7ee3-7d12-473c-9fef-b6cf2ae7247e tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:40.309720 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-617e7ee3-7d12-473c-9fef-b6cf2ae7247e tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe" status: 200 len: 1303 microversion: 2.1 time: 0.559268 Sep 07 13:03:40.311913 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2792/5623] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:39 2022] GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe => generated 1303 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:41.352801 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-993751d2-a3a8-4c1d-a1e6-133cdc006ccf tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:41.357760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-993751d2-a3a8-4c1d-a1e6-133cdc006ccf tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 66dad4f0-53a7-4251-ba1f-0abff51898fe] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:41.374286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-993751d2-a3a8-4c1d-a1e6-133cdc006ccf tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:41.375253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-993751d2-a3a8-4c1d-a1e6-133cdc006ccf tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:41.376074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-993751d2-a3a8-4c1d-a1e6-133cdc006ccf tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:41.377435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-993751d2-a3a8-4c1d-a1e6-133cdc006ccf tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:41.379160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-993751d2-a3a8-4c1d-a1e6-133cdc006ccf tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:41.380017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-993751d2-a3a8-4c1d-a1e6-133cdc006ccf tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:41.409044 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-993751d2-a3a8-4c1d-a1e6-133cdc006ccf tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] HTTP exception thrown: Instance 66dad4f0-53a7-4251-ba1f-0abff51898fe could not be found. Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-993751d2-a3a8-4c1d-a1e6-133cdc006ccf tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Request method failure captured: Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe HTTP/1.1 Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJZ7vmtq09lROEG0ct5H6imB0iMXypTZygIxDw4YTQng2MeRSb4pjMDU9HXmwatdx-1qVb3D8-JSYbjsDVbXvrcWOSLDGbcJNFLE05HLsP158KYmL66Z2yeDoWDbsxBdo4sfXArJs-0eMLI5fc3-I4dE-mYMjRQvUyok4-1bKhpl3QA Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 7f8ccc06e20b4c5e98030d208abaa13b Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-VolumesActionsTest-1895097975 Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7f8ccc06e20b4c5e98030d208abaa13b"}]}, {"type": "tempest-type-214560723", "name": "tempest-service-325995263", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7f8ccc06e20b4c5e98030d208abaa13b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7f8ccc06e20b4c5e98030d208abaa13b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7f8ccc06e20b4c5e98030d208abaa13b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-VolumesActionsTest-1895097975 Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 7f8ccc06e20b4c5e98030d208abaa13b Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-VolumesActionsTest-1895097975 Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-VolumesActionsTest-1895097975-project Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: a01aef6b538748118cc315eee680fee3 Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-VolumesActionsTest-1895097975-project Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 66dad4f0-53a7-4251-ba1f-0abff51898fe could not be found. Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '66dad4f0-53a7-4251-ba1f-0abff51898fe'} Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66dad4f0-53a7-4251-ba1f-0abff51898fe could not be found. Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66dad4f0-53a7-4251-ba1f-0abff51898fe could not be found. Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:03:41.413448 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:03:41.416617 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:03:41.416617 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:41.416617 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:03:41.416617 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:03:41.416617 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:03:41.416617 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:03:41.416617 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66dad4f0-53a7-4251-ba1f-0abff51898fe could not be found. Sep 07 13:03:41.416617 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:03:41.424437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-993751d2-a3a8-4c1d-a1e6-133cdc006ccf tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Returning 404 to user: Instance 66dad4f0-53a7-4251-ba1f-0abff51898fe could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:03:41.426464 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-993751d2-a3a8-4c1d-a1e6-133cdc006ccf tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe" status: 404 len: 111 microversion: 2.1 time: 0.089761 Sep 07 13:03:41.429266 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2832/5624] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:41 2022] GET /compute/v2.1/servers/66dad4f0-53a7-4251-ba1f-0abff51898fe => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:03:41.841991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b8e6f5ef-03b3-48e2-ab21-ca791ce4e8be tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-838624457", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "89bfd9b1-1f66-41f4-8727-9072e3747601"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:03:42.012020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-b8e6f5ef-03b3-48e2-ab21-ca791ce4e8be tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] validate_networks() for [('89bfd9b1-1f66-41f4-8727-9072e3747601', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:03:43.492822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b8e6f5ef-03b3-48e2-ab21-ca791ce4e8be tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:03:43.495211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b8e6f5ef-03b3-48e2-ab21-ca791ce4e8be tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:03:43.498199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b8e6f5ef-03b3-48e2-ab21-ca791ce4e8be tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:03:43.499119 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b8e6f5ef-03b3-48e2-ab21-ca791ce4e8be tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:03:43.500288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b8e6f5ef-03b3-48e2-ab21-ca791ce4e8be tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:03:43.524710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8e6f5ef-03b3-48e2-ab21-ca791ce4e8be tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:43.525790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8e6f5ef-03b3-48e2-ab21-ca791ce4e8be tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:43.526788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8e6f5ef-03b3-48e2-ab21-ca791ce4e8be tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:43.528559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8e6f5ef-03b3-48e2-ab21-ca791ce4e8be tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:43.529631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8e6f5ef-03b3-48e2-ab21-ca791ce4e8be tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:43.530511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8e6f5ef-03b3-48e2-ab21-ca791ce4e8be tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:43.569346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-b8e6f5ef-03b3-48e2-ab21-ca791ce4e8be tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Getting quotas for project 7f8ccc06e20b4c5e98030d208abaa13b. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:03:43.582472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-b8e6f5ef-03b3-48e2-ab21-ca791ce4e8be tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Getting quotas for user a01aef6b538748118cc315eee680fee3 and project 7f8ccc06e20b4c5e98030d208abaa13b. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:03:43.610697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b8e6f5ef-03b3-48e2-ab21-ca791ce4e8be tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:03:43.615819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b8e6f5ef-03b3-48e2-ab21-ca791ce4e8be tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 1cf751ea-4948-41d8-8ae2-0659e210001b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:03:43.723804 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b8e6f5ef-03b3-48e2-ab21-ca791ce4e8be tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.886525 Sep 07 13:03:43.725575 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2793/5625] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:03:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:03:43.746162 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a8acad46-0160-4a88-9e9e-c7f94addb8bc tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:43.747470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a8acad46-0160-4a88-9e9e-c7f94addb8bc tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 1cf751ea-4948-41d8-8ae2-0659e210001b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:43.971380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a8acad46-0160-4a88-9e9e-c7f94addb8bc tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:43.998779 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a8acad46-0160-4a88-9e9e-c7f94addb8bc tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b" status: 200 len: 1213 microversion: 2.1 time: 0.258139 Sep 07 13:03:44.018808 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2833/5626] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:43 2022] GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b => generated 1213 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:44.808431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1a299e04-b5d5-465d-8581-6e3cb0f2b319 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:44.809034 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1a299e04-b5d5-465d-8581-6e3cb0f2b319 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:44.827673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a299e04-b5d5-465d-8581-6e3cb0f2b319 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:44.830040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a299e04-b5d5-465d-8581-6e3cb0f2b319 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:44.830783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a299e04-b5d5-465d-8581-6e3cb0f2b319 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:44.833561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a299e04-b5d5-465d-8581-6e3cb0f2b319 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:44.834975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a299e04-b5d5-465d-8581-6e3cb0f2b319 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:44.839855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1a299e04-b5d5-465d-8581-6e3cb0f2b319 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:44.875989 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-1a299e04-b5d5-465d-8581-6e3cb0f2b319 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] HTTP exception thrown: Instance 43152d55-6621-43f6-bb60-1be3d638859c could not be found. Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1a299e04-b5d5-465d-8581-6e3cb0f2b319 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Request method failure captured: Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c HTTP/1.1 Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJSwrdCTJZT039O4ZFBiDNF-9lnSNJ5qqRLPDE3jJHhPAuZ6xSXr3ekQWDw7lgbDe8omv1w6tBQ6o27AyuoefCVq-QB4sZnxss5gbNHXOE8Em7Af2Hrzho9qF1EQDE_ezya2iFFwxu4aUR8xxgpI_a9J5V4s0T2xCMenjg2QkpA5JNY Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 059d18cef73a40b49cb707c7838973a9 Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeTestJSON-483833901 Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/059d18cef73a40b49cb707c7838973a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_059d18cef73a40b49cb707c7838973a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/059d18cef73a40b49cb707c7838973a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/059d18cef73a40b49cb707c7838973a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeTestJSON-483833901 Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 059d18cef73a40b49cb707c7838973a9 Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeTestJSON-483833901 Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeTestJSON-483833901-project Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 384329dd16dd48a1af7f197c71af2f4c Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeTestJSON-483833901-project Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 43152d55-6621-43f6-bb60-1be3d638859c could not be found. Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '43152d55-6621-43f6-bb60-1be3d638859c'} Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43152d55-6621-43f6-bb60-1be3d638859c could not be found. Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:03:44.881963 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:03:44.885018 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43152d55-6621-43f6-bb60-1be3d638859c could not be found. Sep 07 13:03:44.885018 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:03:44.885018 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:03:44.885018 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:03:44.885018 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:44.885018 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:03:44.885018 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:03:44.885018 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:03:44.885018 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:03:44.885018 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43152d55-6621-43f6-bb60-1be3d638859c could not be found. Sep 07 13:03:44.885018 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:03:44.887801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1a299e04-b5d5-465d-8581-6e3cb0f2b319 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Returning 404 to user: Instance 43152d55-6621-43f6-bb60-1be3d638859c could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:03:44.890796 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1a299e04-b5d5-465d-8581-6e3cb0f2b319 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "DELETE /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c" status: 404 len: 111 microversion: 2.1 time: 0.086490 Sep 07 13:03:44.901217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-678a7578-99f8-43f9-b034-9a5a322f5047 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:44.903233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-678a7578-99f8-43f9-b034-9a5a322f5047 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: 43152d55-6621-43f6-bb60-1be3d638859c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:44.910479 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2794/5627] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:03:44 2022] DELETE /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:03:44.931968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-678a7578-99f8-43f9-b034-9a5a322f5047 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:44.935845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-678a7578-99f8-43f9-b034-9a5a322f5047 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:44.938224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-678a7578-99f8-43f9-b034-9a5a322f5047 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:44.942633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-678a7578-99f8-43f9-b034-9a5a322f5047 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:44.946573 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-678a7578-99f8-43f9-b034-9a5a322f5047 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:44.947269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-678a7578-99f8-43f9-b034-9a5a322f5047 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:44.986637 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-678a7578-99f8-43f9-b034-9a5a322f5047 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] HTTP exception thrown: Instance 43152d55-6621-43f6-bb60-1be3d638859c could not be found. Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-678a7578-99f8-43f9-b034-9a5a322f5047 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Request method failure captured: Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c HTTP/1.1 Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJSwrdCTJZT039O4ZFBiDNF-9lnSNJ5qqRLPDE3jJHhPAuZ6xSXr3ekQWDw7lgbDe8omv1w6tBQ6o27AyuoefCVq-QB4sZnxss5gbNHXOE8Em7Af2Hrzho9qF1EQDE_ezya2iFFwxu4aUR8xxgpI_a9J5V4s0T2xCMenjg2QkpA5JNY Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 059d18cef73a40b49cb707c7838973a9 Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AttachVolumeTestJSON-483833901 Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/059d18cef73a40b49cb707c7838973a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_059d18cef73a40b49cb707c7838973a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/059d18cef73a40b49cb707c7838973a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/059d18cef73a40b49cb707c7838973a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AttachVolumeTestJSON-483833901 Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 059d18cef73a40b49cb707c7838973a9 Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AttachVolumeTestJSON-483833901 Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AttachVolumeTestJSON-483833901-project Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 384329dd16dd48a1af7f197c71af2f4c Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AttachVolumeTestJSON-483833901-project Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 43152d55-6621-43f6-bb60-1be3d638859c could not be found. Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '43152d55-6621-43f6-bb60-1be3d638859c'} Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43152d55-6621-43f6-bb60-1be3d638859c could not be found. Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43152d55-6621-43f6-bb60-1be3d638859c could not be found. Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:03:44.990334 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:03:44.993642 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:44.993642 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:03:44.993642 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:03:44.993642 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:03:44.993642 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:03:44.993642 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43152d55-6621-43f6-bb60-1be3d638859c could not be found. Sep 07 13:03:44.993642 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:03:44.998769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-678a7578-99f8-43f9-b034-9a5a322f5047 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Returning 404 to user: Instance 43152d55-6621-43f6-bb60-1be3d638859c could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:03:44.999871 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-678a7578-99f8-43f9-b034-9a5a322f5047 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c" status: 404 len: 111 microversion: 2.1 time: 0.103870 Sep 07 13:03:45.006337 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2834/5628] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:44 2022] GET /compute/v2.1/servers/43152d55-6621-43f6-bb60-1be3d638859c => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:03:45.027417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5f590967-e318-4fcc-968b-321f9711a9d2 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:45.028421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5f590967-e318-4fcc-968b-321f9711a9d2 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 1cf751ea-4948-41d8-8ae2-0659e210001b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:45.687694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5f590967-e318-4fcc-968b-321f9711a9d2 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:45.703233 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5f590967-e318-4fcc-968b-321f9711a9d2 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b" status: 200 len: 1213 microversion: 2.1 time: 0.680200 Sep 07 13:03:45.712988 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2795/5629] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:45 2022] GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b => generated 1213 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:46.765445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9d883345-ef68-490b-a62d-dcb0c653acae tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:46.768583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9d883345-ef68-490b-a62d-dcb0c653acae tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 1cf751ea-4948-41d8-8ae2-0659e210001b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:46.808012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d883345-ef68-490b-a62d-dcb0c653acae tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:46.813359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d883345-ef68-490b-a62d-dcb0c653acae tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:46.817383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d883345-ef68-490b-a62d-dcb0c653acae tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:46.824944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d883345-ef68-490b-a62d-dcb0c653acae tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:46.828908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d883345-ef68-490b-a62d-dcb0c653acae tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:46.830603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d883345-ef68-490b-a62d-dcb0c653acae tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:47.480043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9d883345-ef68-490b-a62d-dcb0c653acae tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:47.507516 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9d883345-ef68-490b-a62d-dcb0c653acae tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b" status: 200 len: 1265 microversion: 2.1 time: 0.742783 Sep 07 13:03:47.508918 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2835/5630] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:46 2022] GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b => generated 1265 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:03:48.563695 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-629f430d-aa6f-43b6-b91b-a8c109b40121 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:48.564416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-629f430d-aa6f-43b6-b91b-a8c109b40121 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 1cf751ea-4948-41d8-8ae2-0659e210001b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:48.590938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-629f430d-aa6f-43b6-b91b-a8c109b40121 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:48.591483 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-629f430d-aa6f-43b6-b91b-a8c109b40121 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:48.591940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-629f430d-aa6f-43b6-b91b-a8c109b40121 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:48.596786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-629f430d-aa6f-43b6-b91b-a8c109b40121 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:48.597339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-629f430d-aa6f-43b6-b91b-a8c109b40121 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:48.597831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-629f430d-aa6f-43b6-b91b-a8c109b40121 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:48.831783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-629f430d-aa6f-43b6-b91b-a8c109b40121 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:48.851559 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-629f430d-aa6f-43b6-b91b-a8c109b40121 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b" status: 200 len: 1271 microversion: 2.1 time: 0.292274 Sep 07 13:03:48.857355 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2796/5631] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:48 2022] GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b => generated 1271 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:49.905046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6cd0d9dc-71a3-40af-8e33-4c5af7bc3558 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:49.906961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6cd0d9dc-71a3-40af-8e33-4c5af7bc3558 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 1cf751ea-4948-41d8-8ae2-0659e210001b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:49.930472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cd0d9dc-71a3-40af-8e33-4c5af7bc3558 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:49.933311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cd0d9dc-71a3-40af-8e33-4c5af7bc3558 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:49.934227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cd0d9dc-71a3-40af-8e33-4c5af7bc3558 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:49.935547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cd0d9dc-71a3-40af-8e33-4c5af7bc3558 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:49.938146 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cd0d9dc-71a3-40af-8e33-4c5af7bc3558 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:49.938879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6cd0d9dc-71a3-40af-8e33-4c5af7bc3558 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:50.432759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6cd0d9dc-71a3-40af-8e33-4c5af7bc3558 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:50.467678 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6cd0d9dc-71a3-40af-8e33-4c5af7bc3558 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b" status: 200 len: 1313 microversion: 2.1 time: 0.566496 Sep 07 13:03:50.475389 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2836/5632] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:49 2022] GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b => generated 1313 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:51.526798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ddbcebe7-70d4-4e06-bac3-273a48ce849f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:51.528897 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ddbcebe7-70d4-4e06-bac3-273a48ce849f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 1cf751ea-4948-41d8-8ae2-0659e210001b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:51.560468 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddbcebe7-70d4-4e06-bac3-273a48ce849f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:51.561683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddbcebe7-70d4-4e06-bac3-273a48ce849f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:51.562444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddbcebe7-70d4-4e06-bac3-273a48ce849f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:51.575639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddbcebe7-70d4-4e06-bac3-273a48ce849f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:51.576637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddbcebe7-70d4-4e06-bac3-273a48ce849f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:51.577350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ddbcebe7-70d4-4e06-bac3-273a48ce849f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:53.405246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ddbcebe7-70d4-4e06-bac3-273a48ce849f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:53.462406 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ddbcebe7-70d4-4e06-bac3-273a48ce849f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b" status: 200 len: 1313 microversion: 2.1 time: 1.933940 Sep 07 13:03:53.469828 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2797/5633] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:51 2022] GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b => generated 1313 bytes in 1951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:54.519270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4f6cf51c-22f6-4ece-81de-99a98e70a729 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:54.520074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4f6cf51c-22f6-4ece-81de-99a98e70a729 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 1cf751ea-4948-41d8-8ae2-0659e210001b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:54.524804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:54.566266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f6cf51c-22f6-4ece-81de-99a98e70a729 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:54.567132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f6cf51c-22f6-4ece-81de-99a98e70a729 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:54.567996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f6cf51c-22f6-4ece-81de-99a98e70a729 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:54.569334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f6cf51c-22f6-4ece-81de-99a98e70a729 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:54.581357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f6cf51c-22f6-4ece-81de-99a98e70a729 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:54.582167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f6cf51c-22f6-4ece-81de-99a98e70a729 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:55.118755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-6e68e4ed-9c45-4aee-8b34-6ede7472295e req-7c248445-b594-4f0a-9779-13b6a3774dad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cf751ea-4948-41d8-8ae2-0659e210001b", "tag": "19f42b83-322a-4a7e-9e2a-23b81a02793f"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:03:55.129125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:55.149454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6e68e4ed-9c45-4aee-8b34-6ede7472295e req-7c248445-b594-4f0a-9779-13b6a3774dad service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:55.152894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6e68e4ed-9c45-4aee-8b34-6ede7472295e req-7c248445-b594-4f0a-9779-13b6a3774dad service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:55.153713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6e68e4ed-9c45-4aee-8b34-6ede7472295e req-7c248445-b594-4f0a-9779-13b6a3774dad service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:55.186516 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-6e68e4ed-9c45-4aee-8b34-6ede7472295e req-7c248445-b594-4f0a-9779-13b6a3774dad service nova] Creating event network-changed:19f42b83-322a-4a7e-9e2a-23b81a02793f for instance 1cf751ea-4948-41d8-8ae2-0659e210001b on n-h2-852087-9 Sep 07 13:03:55.194060 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-6e68e4ed-9c45-4aee-8b34-6ede7472295e req-7c248445-b594-4f0a-9779-13b6a3774dad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079181 Sep 07 13:03:55.197502 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2798/5634] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:03:56.031619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:56.042745 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5a629f75-afc9-42c3-9140-9c1b913ed84a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:56.043365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5a629f75-afc9-42c3-9140-9c1b913ed84a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:56.066222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a629f75-afc9-42c3-9140-9c1b913ed84a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:56.066954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a629f75-afc9-42c3-9140-9c1b913ed84a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:56.070334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a629f75-afc9-42c3-9140-9c1b913ed84a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:56.072570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a629f75-afc9-42c3-9140-9c1b913ed84a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:56.073294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a629f75-afc9-42c3-9140-9c1b913ed84a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:56.078540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a629f75-afc9-42c3-9140-9c1b913ed84a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:56.112739 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-5a629f75-afc9-42c3-9140-9c1b913ed84a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] HTTP exception thrown: Instance f37444bc-ff3d-40dd-8501-7b8794d8b1ef could not be found. Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5a629f75-afc9-42c3-9140-9c1b913ed84a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Request method failure captured: Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef HTTP/1.1 Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJSwrdCTJZT039O4ZFBiDNF-9lnSNJ5qqRLPDE3jJHhPAuZ6xSXr3ekQWDw7lgbDe8omv1w6tBQ6o27AyuoefCVq-QB4sZnxss5gbNHXOE8Em7Af2Hrzho9qF1EQDE_ezya2iFFwxu4aUR8xxgpI_a9J5V4s0T2xCMenjg2QkpA5JNY Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 059d18cef73a40b49cb707c7838973a9 Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeTestJSON-483833901 Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/059d18cef73a40b49cb707c7838973a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_059d18cef73a40b49cb707c7838973a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/059d18cef73a40b49cb707c7838973a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/059d18cef73a40b49cb707c7838973a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeTestJSON-483833901 Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 059d18cef73a40b49cb707c7838973a9 Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeTestJSON-483833901 Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeTestJSON-483833901-project Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 384329dd16dd48a1af7f197c71af2f4c Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeTestJSON-483833901-project Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance f37444bc-ff3d-40dd-8501-7b8794d8b1ef could not be found. Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'f37444bc-ff3d-40dd-8501-7b8794d8b1ef'} Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f37444bc-ff3d-40dd-8501-7b8794d8b1ef could not be found. Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:03:56.116940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:03:56.120883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f37444bc-ff3d-40dd-8501-7b8794d8b1ef could not be found. Sep 07 13:03:56.120883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:03:56.120883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:03:56.120883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:03:56.120883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:56.120883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:03:56.120883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:03:56.120883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:03:56.120883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:03:56.120883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f37444bc-ff3d-40dd-8501-7b8794d8b1ef could not be found. Sep 07 13:03:56.120883 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:03:56.123845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5a629f75-afc9-42c3-9140-9c1b913ed84a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Returning 404 to user: Instance f37444bc-ff3d-40dd-8501-7b8794d8b1ef could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:03:56.125217 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5a629f75-afc9-42c3-9140-9c1b913ed84a tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 404 len: 111 microversion: 2.1 time: 0.094566 Sep 07 13:03:56.126447 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2799/5635] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:03:56 2022] DELETE /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:03:56.139592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d41cf169-d615-4a25-9857-c705f3742755 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:56.141424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d41cf169-d615-4a25-9857-c705f3742755 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] [instance: f37444bc-ff3d-40dd-8501-7b8794d8b1ef] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:56.155651 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4f6cf51c-22f6-4ece-81de-99a98e70a729 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:56.181732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d41cf169-d615-4a25-9857-c705f3742755 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:56.190212 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4f6cf51c-22f6-4ece-81de-99a98e70a729 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b" status: 200 len: 1313 microversion: 2.1 time: 1.677996 Sep 07 13:03:56.191061 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2837/5636] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:54 2022] GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b => generated 1313 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:56.192783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d41cf169-d615-4a25-9857-c705f3742755 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:56.202314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d41cf169-d615-4a25-9857-c705f3742755 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:56.204839 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d41cf169-d615-4a25-9857-c705f3742755 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:56.205831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d41cf169-d615-4a25-9857-c705f3742755 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:56.206689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d41cf169-d615-4a25-9857-c705f3742755 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:56.248811 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-d41cf169-d615-4a25-9857-c705f3742755 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] HTTP exception thrown: Instance f37444bc-ff3d-40dd-8501-7b8794d8b1ef could not be found. Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d41cf169-d615-4a25-9857-c705f3742755 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Request method failure captured: Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef HTTP/1.1 Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJSwrdCTJZT039O4ZFBiDNF-9lnSNJ5qqRLPDE3jJHhPAuZ6xSXr3ekQWDw7lgbDe8omv1w6tBQ6o27AyuoefCVq-QB4sZnxss5gbNHXOE8Em7Af2Hrzho9qF1EQDE_ezya2iFFwxu4aUR8xxgpI_a9J5V4s0T2xCMenjg2QkpA5JNY Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 059d18cef73a40b49cb707c7838973a9 Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeTestJSON-483833901 Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/059d18cef73a40b49cb707c7838973a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_059d18cef73a40b49cb707c7838973a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/059d18cef73a40b49cb707c7838973a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/059d18cef73a40b49cb707c7838973a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeTestJSON-483833901 Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 059d18cef73a40b49cb707c7838973a9 Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeTestJSON-483833901 Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeTestJSON-483833901-project Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 384329dd16dd48a1af7f197c71af2f4c Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeTestJSON-483833901-project Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance f37444bc-ff3d-40dd-8501-7b8794d8b1ef could not be found. Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'f37444bc-ff3d-40dd-8501-7b8794d8b1ef'} Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f37444bc-ff3d-40dd-8501-7b8794d8b1ef could not be found. Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f37444bc-ff3d-40dd-8501-7b8794d8b1ef could not be found. Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:03:56.258361 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:03:56.267080 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:03:56.267080 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:03:56.267080 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:03:56.267080 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:03:56.267080 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:03:56.267080 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f37444bc-ff3d-40dd-8501-7b8794d8b1ef could not be found. Sep 07 13:03:56.267080 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:03:56.267080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d41cf169-d615-4a25-9857-c705f3742755 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] Returning 404 to user: Instance f37444bc-ff3d-40dd-8501-7b8794d8b1ef could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:03:56.267080 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d41cf169-d615-4a25-9857-c705f3742755 tempest-AttachVolumeTestJSON-483833901 tempest-AttachVolumeTestJSON-483833901-project] 10.222.0.16 "GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef" status: 404 len: 111 microversion: 2.1 time: 0.128112 Sep 07 13:03:56.267080 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2800/5637] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:56 2022] GET /compute/v2.1/servers/f37444bc-ff3d-40dd-8501-7b8794d8b1ef => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:03:57.234083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-47f3e49e-5c7b-48fa-84a6-95bd53826aae tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:57.235741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-47f3e49e-5c7b-48fa-84a6-95bd53826aae tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 1cf751ea-4948-41d8-8ae2-0659e210001b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:57.251514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47f3e49e-5c7b-48fa-84a6-95bd53826aae tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:57.257313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47f3e49e-5c7b-48fa-84a6-95bd53826aae tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:57.260153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47f3e49e-5c7b-48fa-84a6-95bd53826aae tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:57.263728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47f3e49e-5c7b-48fa-84a6-95bd53826aae tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:57.264788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47f3e49e-5c7b-48fa-84a6-95bd53826aae tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:57.266393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47f3e49e-5c7b-48fa-84a6-95bd53826aae tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:57.672625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-47f3e49e-5c7b-48fa-84a6-95bd53826aae tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:57.728337 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-47f3e49e-5c7b-48fa-84a6-95bd53826aae tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b" status: 200 len: 1313 microversion: 2.1 time: 0.499566 Sep 07 13:03:57.737104 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2838/5638] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:57 2022] GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b => generated 1313 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:03:58.765910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b5419a30-e02e-4227-848a-91f5dd8cae6f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:03:58.767307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b5419a30-e02e-4227-848a-91f5dd8cae6f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 1cf751ea-4948-41d8-8ae2-0659e210001b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:03:58.781546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5419a30-e02e-4227-848a-91f5dd8cae6f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:58.782447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5419a30-e02e-4227-848a-91f5dd8cae6f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:58.783135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5419a30-e02e-4227-848a-91f5dd8cae6f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:58.785841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5419a30-e02e-4227-848a-91f5dd8cae6f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:03:58.787208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5419a30-e02e-4227-848a-91f5dd8cae6f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:03:58.788736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5419a30-e02e-4227-848a-91f5dd8cae6f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:03:58.811626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:59.919345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b5419a30-e02e-4227-848a-91f5dd8cae6f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:03:59.939396 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b5419a30-e02e-4227-848a-91f5dd8cae6f tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b" status: 200 len: 1313 microversion: 2.1 time: 1.174271 Sep 07 13:03:59.953973 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2801/5639] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:03:58 2022] GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b => generated 1313 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:04:00.975345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-85b79aa0-a031-49a0-afdf-214afcd82ddd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:00.979595 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-85b79aa0-a031-49a0-afdf-214afcd82ddd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 1cf751ea-4948-41d8-8ae2-0659e210001b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:00.993131 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=24 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:04:01.018070 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85b79aa0-a031-49a0-afdf-214afcd82ddd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:01.022432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85b79aa0-a031-49a0-afdf-214afcd82ddd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:01.023780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85b79aa0-a031-49a0-afdf-214afcd82ddd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:01.025457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85b79aa0-a031-49a0-afdf-214afcd82ddd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:01.029345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85b79aa0-a031-49a0-afdf-214afcd82ddd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:01.035630 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85b79aa0-a031-49a0-afdf-214afcd82ddd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:01.829898 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-85b79aa0-a031-49a0-afdf-214afcd82ddd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:04:01.845725 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-85b79aa0-a031-49a0-afdf-214afcd82ddd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b" status: 200 len: 1313 microversion: 2.1 time: 0.879991 Sep 07 13:04:01.849338 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2839/5640] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:04:00 2022] GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b => generated 1313 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:04:02.888002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-435936f7-736e-45ec-ba40-b422628f96e2 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:02.888977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-435936f7-736e-45ec-ba40-b422628f96e2 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 1cf751ea-4948-41d8-8ae2-0659e210001b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:02.924719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-435936f7-736e-45ec-ba40-b422628f96e2 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:02.925822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-435936f7-736e-45ec-ba40-b422628f96e2 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:02.926749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-435936f7-736e-45ec-ba40-b422628f96e2 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:02.929760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-435936f7-736e-45ec-ba40-b422628f96e2 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:02.936476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-435936f7-736e-45ec-ba40-b422628f96e2 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:02.941719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-435936f7-736e-45ec-ba40-b422628f96e2 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:03.572509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-435936f7-736e-45ec-ba40-b422628f96e2 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:04:03.607554 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-435936f7-736e-45ec-ba40-b422628f96e2 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b" status: 200 len: 1313 microversion: 2.1 time: 0.741272 Sep 07 13:04:03.609718 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2802/5641] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:04:02 2022] GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b => generated 1313 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:04:04.663924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8d95e6cc-e2ee-4366-88d3-1aead28f08c0 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:04.672563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8d95e6cc-e2ee-4366-88d3-1aead28f08c0 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 1cf751ea-4948-41d8-8ae2-0659e210001b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:04.711862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d95e6cc-e2ee-4366-88d3-1aead28f08c0 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:04.728967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d95e6cc-e2ee-4366-88d3-1aead28f08c0 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:04.730311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d95e6cc-e2ee-4366-88d3-1aead28f08c0 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:04.736049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d95e6cc-e2ee-4366-88d3-1aead28f08c0 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:04.739364 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d95e6cc-e2ee-4366-88d3-1aead28f08c0 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:04.751755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d95e6cc-e2ee-4366-88d3-1aead28f08c0 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:04.914469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=42 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:04:05.706770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8d95e6cc-e2ee-4366-88d3-1aead28f08c0 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:04:05.728899 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8d95e6cc-e2ee-4366-88d3-1aead28f08c0 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b" status: 200 len: 1313 microversion: 2.1 time: 1.079391 Sep 07 13:04:05.745059 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2840/5642] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:04:04 2022] GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b => generated 1313 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:04:06.457319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-ea629461-dd12-4a05-830e-20e072d109cd req-afbaf4a3-31cc-4c38-8a8c-9a3e912b7a57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cf751ea-4948-41d8-8ae2-0659e210001b", "name": "network-vif-plugged", "status": "completed", "tag": "19f42b83-322a-4a7e-9e2a-23b81a02793f"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:04:06.479679 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:04:06.482862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ea629461-dd12-4a05-830e-20e072d109cd req-afbaf4a3-31cc-4c38-8a8c-9a3e912b7a57 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:06.483650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ea629461-dd12-4a05-830e-20e072d109cd req-afbaf4a3-31cc-4c38-8a8c-9a3e912b7a57 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:06.485081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ea629461-dd12-4a05-830e-20e072d109cd req-afbaf4a3-31cc-4c38-8a8c-9a3e912b7a57 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:06.574924 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-ea629461-dd12-4a05-830e-20e072d109cd req-afbaf4a3-31cc-4c38-8a8c-9a3e912b7a57 service nova] Creating event network-vif-plugged:19f42b83-322a-4a7e-9e2a-23b81a02793f for instance 1cf751ea-4948-41d8-8ae2-0659e210001b on n-h2-852087-9 Sep 07 13:04:06.589019 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-ea629461-dd12-4a05-830e-20e072d109cd req-afbaf4a3-31cc-4c38-8a8c-9a3e912b7a57 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136737 Sep 07 13:04:06.592661 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2803/5643] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:04:06.799218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a076213d-2044-4a45-9fee-9b99aa20e03a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:06.808979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a076213d-2044-4a45-9fee-9b99aa20e03a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 1cf751ea-4948-41d8-8ae2-0659e210001b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:06.888674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a076213d-2044-4a45-9fee-9b99aa20e03a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:06.912927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a076213d-2044-4a45-9fee-9b99aa20e03a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:06.924068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a076213d-2044-4a45-9fee-9b99aa20e03a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:06.927085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a076213d-2044-4a45-9fee-9b99aa20e03a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:06.932204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a076213d-2044-4a45-9fee-9b99aa20e03a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:06.936109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a076213d-2044-4a45-9fee-9b99aa20e03a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:07.620305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a076213d-2044-4a45-9fee-9b99aa20e03a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:04:07.651011 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a076213d-2044-4a45-9fee-9b99aa20e03a tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b" status: 200 len: 1313 microversion: 2.1 time: 0.896288 Sep 07 13:04:07.652246 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2841/5644] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:04:06 2022] GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b => generated 1313 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:04:08.703332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c5c3dbb8-55a2-4bc1-a33c-7a3df39abcab tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:08.725813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c5c3dbb8-55a2-4bc1-a33c-7a3df39abcab tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 1cf751ea-4948-41d8-8ae2-0659e210001b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:08.758181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5c3dbb8-55a2-4bc1-a33c-7a3df39abcab tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:08.759058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5c3dbb8-55a2-4bc1-a33c-7a3df39abcab tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:08.762520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5c3dbb8-55a2-4bc1-a33c-7a3df39abcab tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:08.764261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5c3dbb8-55a2-4bc1-a33c-7a3df39abcab tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:08.795377 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5c3dbb8-55a2-4bc1-a33c-7a3df39abcab tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:08.796872 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5c3dbb8-55a2-4bc1-a33c-7a3df39abcab tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:09.531675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c5c3dbb8-55a2-4bc1-a33c-7a3df39abcab tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:04:09.553254 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c5c3dbb8-55a2-4bc1-a33c-7a3df39abcab tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b" status: 200 len: 1313 microversion: 2.1 time: 0.856918 Sep 07 13:04:09.553601 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2804/5645] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:04:08 2022] GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b => generated 1313 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:04:09.603359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cbca9341-0e03-40d2-8d56-4195209fe140 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:09.610305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cbca9341-0e03-40d2-8d56-4195209fe140 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:09.619620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbca9341-0e03-40d2-8d56-4195209fe140 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:09.623566 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbca9341-0e03-40d2-8d56-4195209fe140 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:09.627117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbca9341-0e03-40d2-8d56-4195209fe140 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:09.628188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbca9341-0e03-40d2-8d56-4195209fe140 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:09.628841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbca9341-0e03-40d2-8d56-4195209fe140 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:09.630838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cbca9341-0e03-40d2-8d56-4195209fe140 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:09.695101 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cbca9341-0e03-40d2-8d56-4195209fe140 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f/ips" status: 200 len: 150 microversion: 2.1 time: 0.101377 Sep 07 13:04:09.697452 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2842/5646] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Sep 7 13:04:09 2022] GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f/ips => generated 150 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:04:09.715321 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b6f10b0e-810a-45d1-a7b5-d50ece8c39d4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da53e011-d759-45db-a1cd-f98260d5ba31"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:04:09.722467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b6f10b0e-810a-45d1-a7b5-d50ece8c39d4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:09.742599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6f10b0e-810a-45d1-a7b5-d50ece8c39d4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:09.743971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6f10b0e-810a-45d1-a7b5-d50ece8c39d4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:09.745334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6f10b0e-810a-45d1-a7b5-d50ece8c39d4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:09.747557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6f10b0e-810a-45d1-a7b5-d50ece8c39d4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:09.748782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6f10b0e-810a-45d1-a7b5-d50ece8c39d4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:09.749910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6f10b0e-810a-45d1-a7b5-d50ece8c39d4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:10.024730 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-b6f10b0e-810a-45d1-a7b5-d50ece8c39d4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] HTTP exception thrown: Invalid volume: volume da53e011-d759-45db-a1cd-f98260d5ba31 is already attached to instances: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b6f10b0e-810a-45d1-a7b5-d50ece8c39d4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Request method failure captured: Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f/os-volume_attachments HTTP/1.1 Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 74 Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJXjmtPm9YRFN-tztsi8TNQI9Hp8XLmIE4m4vovyCrvi10-eliNzw5RJ69qhXEwc5_GMz3l7wuK2ojP23vdsllISKFk4XviY8iZt7qikWDIyUcyEqbNGcGcZaYafPWwxZ6tUqEf0DAj26macVBxWQF5nsZe6v99sjs3_jT8xGYwPOpM Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: c9f85a4002bd40eb8514aa91056c77d8 Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: {"volumeAttachment": {"volumeId": "da53e011-d759-45db-a1cd-f98260d5ba31"}} Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: exception: Invalid volume: volume da53e011-d759-45db-a1cd-f98260d5ba31 is already attached to instances: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'server_id': '925a496f-7b54-406f-8d4b-5470d75f637f', 'body': {'volumeAttachment': {'volumeId': 'da53e011-d759-45db-a1cd-f98260d5ba31'}}} Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume da53e011-d759-45db-a1cd-f98260d5ba31 is already attached to instances: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:04:10.030823 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:04:10.041924 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:04:10.041924 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:04:10.041924 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 07 13:04:10.041924 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 13:04:10.041924 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume da53e011-d759-45db-a1cd-f98260d5ba31 is already attached to instances: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 Sep 07 13:04:10.041924 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:04:10.041924 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:04:10.041924 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:04:10.041924 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:04:10.041924 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:04:10.041924 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:04:10.041924 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:04:10.041924 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:04:10.041924 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume da53e011-d759-45db-a1cd-f98260d5ba31 is already attached to instances: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 Sep 07 13:04:10.041924 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:04:10.048187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b6f10b0e-810a-45d1-a7b5-d50ece8c39d4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Returning 400 to user: Invalid volume: volume da53e011-d759-45db-a1cd-f98260d5ba31 is already attached to instances: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:04:10.053149 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b6f10b0e-810a-45d1-a7b5-d50ece8c39d4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "POST /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.341654 Sep 07 13:04:10.057056 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2805/5647] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Sep 7 13:04:09 2022] POST /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f/os-volume_attachments => generated 174 bytes in 349 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:04:10.070731 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-79383d1f-1d1f-42c1-8604-38ed340eb9b7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:10.071803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-79383d1f-1d1f-42c1-8604-38ed340eb9b7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:10.092565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79383d1f-1d1f-42c1-8604-38ed340eb9b7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:10.094093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79383d1f-1d1f-42c1-8604-38ed340eb9b7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:10.095917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79383d1f-1d1f-42c1-8604-38ed340eb9b7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:10.097687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79383d1f-1d1f-42c1-8604-38ed340eb9b7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:10.099201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79383d1f-1d1f-42c1-8604-38ed340eb9b7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:10.100890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79383d1f-1d1f-42c1-8604-38ed340eb9b7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:10.162755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-79383d1f-1d1f-42c1-8604-38ed340eb9b7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:04:10.427038 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-79383d1f-1d1f-42c1-8604-38ed340eb9b7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "DELETE /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f" status: 204 len: 0 microversion: 2.1 time: 0.363639 Sep 07 13:04:10.429081 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2843/5648] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:04:10 2022] DELETE /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:04:10.439712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d4b8ed9c-cc81-4ca0-89d8-93f0d5e3dfc2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:10.440661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d4b8ed9c-cc81-4ca0-89d8-93f0d5e3dfc2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:10.448949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4b8ed9c-cc81-4ca0-89d8-93f0d5e3dfc2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:10.449800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4b8ed9c-cc81-4ca0-89d8-93f0d5e3dfc2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:10.450543 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4b8ed9c-cc81-4ca0-89d8-93f0d5e3dfc2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:10.451728 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4b8ed9c-cc81-4ca0-89d8-93f0d5e3dfc2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:10.452253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4b8ed9c-cc81-4ca0-89d8-93f0d5e3dfc2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:10.452965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4b8ed9c-cc81-4ca0-89d8-93f0d5e3dfc2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:10.596772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1ce5f40d-a2d2-43f5-b054-62ea2dc0aa17 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:10.597854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1ce5f40d-a2d2-43f5-b054-62ea2dc0aa17 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 1cf751ea-4948-41d8-8ae2-0659e210001b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:10.615399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ce5f40d-a2d2-43f5-b054-62ea2dc0aa17 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:10.620835 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ce5f40d-a2d2-43f5-b054-62ea2dc0aa17 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:10.621986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ce5f40d-a2d2-43f5-b054-62ea2dc0aa17 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:10.623261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ce5f40d-a2d2-43f5-b054-62ea2dc0aa17 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:10.623997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ce5f40d-a2d2-43f5-b054-62ea2dc0aa17 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:10.624446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ce5f40d-a2d2-43f5-b054-62ea2dc0aa17 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:10.861619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d4b8ed9c-cc81-4ca0-89d8-93f0d5e3dfc2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:04:10.871762 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d4b8ed9c-cc81-4ca0-89d8-93f0d5e3dfc2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f" status: 200 len: 1680 microversion: 2.1 time: 0.436522 Sep 07 13:04:10.875590 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2806/5649] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:04:10 2022] GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f => generated 1680 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:04:11.070023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1ce5f40d-a2d2-43f5-b054-62ea2dc0aa17 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:04:11.083356 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1ce5f40d-a2d2-43f5-b054-62ea2dc0aa17 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b" status: 200 len: 1497 microversion: 2.1 time: 0.492189 Sep 07 13:04:11.085304 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2844/5650] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:04:10 2022] GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b => generated 1497 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:04:11.927802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d1fe4ba-48e9-4b26-ba4c-a76687a35dd1 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:11.942172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9d1fe4ba-48e9-4b26-ba4c-a76687a35dd1 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:12.012857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d1fe4ba-48e9-4b26-ba4c-a76687a35dd1 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:12.018184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d1fe4ba-48e9-4b26-ba4c-a76687a35dd1 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:12.020704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d1fe4ba-48e9-4b26-ba4c-a76687a35dd1 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:12.031016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d1fe4ba-48e9-4b26-ba4c-a76687a35dd1 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:12.032906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d1fe4ba-48e9-4b26-ba4c-a76687a35dd1 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:12.036415 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d1fe4ba-48e9-4b26-ba4c-a76687a35dd1 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:12.454865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0bbea2c6-3e9d-46c3-9263-6d33bac9dc80 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:12.472254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0bbea2c6-3e9d-46c3-9263-6d33bac9dc80 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 1cf751ea-4948-41d8-8ae2-0659e210001b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:12.505525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bbea2c6-3e9d-46c3-9263-6d33bac9dc80 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:12.510559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bbea2c6-3e9d-46c3-9263-6d33bac9dc80 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:12.512874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bbea2c6-3e9d-46c3-9263-6d33bac9dc80 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:12.522798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bbea2c6-3e9d-46c3-9263-6d33bac9dc80 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:12.523027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bbea2c6-3e9d-46c3-9263-6d33bac9dc80 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:12.523487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bbea2c6-3e9d-46c3-9263-6d33bac9dc80 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:12.666827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0bbea2c6-3e9d-46c3-9263-6d33bac9dc80 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 1cf751ea-4948-41d8-8ae2-0659e210001b] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:04:12.912467 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0bbea2c6-3e9d-46c3-9263-6d33bac9dc80 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b" status: 204 len: 0 microversion: 2.1 time: 0.464411 Sep 07 13:04:12.916390 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2845/5651] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:04:12 2022] DELETE /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:04:12.933992 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-39476754-4383-45ce-b34e-491facb1c985 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:12.937887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-39476754-4383-45ce-b34e-491facb1c985 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 1cf751ea-4948-41d8-8ae2-0659e210001b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:12.957358 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39476754-4383-45ce-b34e-491facb1c985 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:12.958397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39476754-4383-45ce-b34e-491facb1c985 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:12.963783 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39476754-4383-45ce-b34e-491facb1c985 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:12.966023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39476754-4383-45ce-b34e-491facb1c985 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:12.966936 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39476754-4383-45ce-b34e-491facb1c985 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:12.969065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-39476754-4383-45ce-b34e-491facb1c985 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:13.399551 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9d1fe4ba-48e9-4b26-ba4c-a76687a35dd1 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:04:13.434800 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9d1fe4ba-48e9-4b26-ba4c-a76687a35dd1 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f" status: 200 len: 1680 microversion: 2.1 time: 1.525245 Sep 07 13:04:13.439724 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2807/5652] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:04:11 2022] GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f => generated 1680 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:04:13.549604 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-39476754-4383-45ce-b34e-491facb1c985 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:04:13.572886 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-39476754-4383-45ce-b34e-491facb1c985 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b" status: 200 len: 1503 microversion: 2.1 time: 0.648744 Sep 07 13:04:13.577457 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2846/5653] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:04:12 2022] GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b => generated 1503 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:04:14.495850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0b818844-b2a4-4db9-8e29-98f0496f54c7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:14.502791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0b818844-b2a4-4db9-8e29-98f0496f54c7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:14.572165 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b818844-b2a4-4db9-8e29-98f0496f54c7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:14.573177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b818844-b2a4-4db9-8e29-98f0496f54c7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:14.573901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b818844-b2a4-4db9-8e29-98f0496f54c7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:14.575176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b818844-b2a4-4db9-8e29-98f0496f54c7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:14.575985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b818844-b2a4-4db9-8e29-98f0496f54c7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:14.582982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b818844-b2a4-4db9-8e29-98f0496f54c7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:14.610677 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ac783b34-2ac6-43ef-8fad-86507fb91edd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:14.611829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ac783b34-2ac6-43ef-8fad-86507fb91edd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 1cf751ea-4948-41d8-8ae2-0659e210001b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:14.652413 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac783b34-2ac6-43ef-8fad-86507fb91edd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:14.656141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac783b34-2ac6-43ef-8fad-86507fb91edd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:14.662314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac783b34-2ac6-43ef-8fad-86507fb91edd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:14.666310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac783b34-2ac6-43ef-8fad-86507fb91edd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:14.670118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac783b34-2ac6-43ef-8fad-86507fb91edd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:14.672914 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac783b34-2ac6-43ef-8fad-86507fb91edd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:15.042926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0b818844-b2a4-4db9-8e29-98f0496f54c7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:04:15.078405 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0b818844-b2a4-4db9-8e29-98f0496f54c7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f" status: 200 len: 1612 microversion: 2.1 time: 0.589994 Sep 07 13:04:15.084876 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2808/5654] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:04:14 2022] GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f => generated 1612 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:04:15.430078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ac783b34-2ac6-43ef-8fad-86507fb91edd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:04:15.451326 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ac783b34-2ac6-43ef-8fad-86507fb91edd tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b" status: 200 len: 1503 microversion: 2.1 time: 0.842239 Sep 07 13:04:15.452186 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2847/5655] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:04:14 2022] GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b => generated 1503 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:04:16.134467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0ef64632-846c-4dcf-8bb6-ce62c2b5752c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:16.136797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0ef64632-846c-4dcf-8bb6-ce62c2b5752c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:16.153109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-2babff51-b49d-41cb-b9a7-3fa03b6ce63c req-8901cfe0-1b7d-48b7-91b5-054d5306e6b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "925a496f-7b54-406f-8d4b-5470d75f637f", "name": "network-vif-deleted", "tag": "409569fc-fee9-4fea-a617-c3cecedc0305"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:04:16.176871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ef64632-846c-4dcf-8bb6-ce62c2b5752c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:16.178036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ef64632-846c-4dcf-8bb6-ce62c2b5752c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:16.196844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2babff51-b49d-41cb-b9a7-3fa03b6ce63c req-8901cfe0-1b7d-48b7-91b5-054d5306e6b3 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:16.196985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2babff51-b49d-41cb-b9a7-3fa03b6ce63c req-8901cfe0-1b7d-48b7-91b5-054d5306e6b3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:16.197440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2babff51-b49d-41cb-b9a7-3fa03b6ce63c req-8901cfe0-1b7d-48b7-91b5-054d5306e6b3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:16.202091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ef64632-846c-4dcf-8bb6-ce62c2b5752c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:16.203426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ef64632-846c-4dcf-8bb6-ce62c2b5752c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:16.206398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ef64632-846c-4dcf-8bb6-ce62c2b5752c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:16.209790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ef64632-846c-4dcf-8bb6-ce62c2b5752c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:16.258057 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-2babff51-b49d-41cb-b9a7-3fa03b6ce63c req-8901cfe0-1b7d-48b7-91b5-054d5306e6b3 service nova] Creating event network-vif-deleted:409569fc-fee9-4fea-a617-c3cecedc0305 for instance 925a496f-7b54-406f-8d4b-5470d75f637f on n-h1-852087-9 Sep 07 13:04:16.282800 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-2babff51-b49d-41cb-b9a7-3fa03b6ce63c req-8901cfe0-1b7d-48b7-91b5-054d5306e6b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135430 Sep 07 13:04:16.291787 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2848/5656] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:04:16.482703 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7712be24-9764-4458-9a65-ee4e07f8fe2d tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:16.483718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7712be24-9764-4458-9a65-ee4e07f8fe2d tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 1cf751ea-4948-41d8-8ae2-0659e210001b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:16.504812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7712be24-9764-4458-9a65-ee4e07f8fe2d tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:16.507548 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7712be24-9764-4458-9a65-ee4e07f8fe2d tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:16.508255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7712be24-9764-4458-9a65-ee4e07f8fe2d tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:16.509395 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7712be24-9764-4458-9a65-ee4e07f8fe2d tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:16.512207 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7712be24-9764-4458-9a65-ee4e07f8fe2d tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:16.514705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7712be24-9764-4458-9a65-ee4e07f8fe2d tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:16.620067 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0ef64632-846c-4dcf-8bb6-ce62c2b5752c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:04:16.671606 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0ef64632-846c-4dcf-8bb6-ce62c2b5752c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f" status: 200 len: 1324 microversion: 2.1 time: 0.544344 Sep 07 13:04:16.681350 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2809/5657] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:04:16 2022] GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f => generated 1324 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:04:16.768003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7712be24-9764-4458-9a65-ee4e07f8fe2d tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:04:16.791682 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7712be24-9764-4458-9a65-ee4e07f8fe2d tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b" status: 200 len: 1461 microversion: 2.1 time: 0.313708 Sep 07 13:04:16.792982 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2849/5658] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:04:16 2022] GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b => generated 1461 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:04:17.055677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-ffe29a3b-8123-4646-a70c-fab7e6ce33b5 req-3b3ac184-dd57-429a-9905-1f7bef234a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cf751ea-4948-41d8-8ae2-0659e210001b", "name": "network-vif-deleted", "tag": "19f42b83-322a-4a7e-9e2a-23b81a02793f"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:04:17.148418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ffe29a3b-8123-4646-a70c-fab7e6ce33b5 req-3b3ac184-dd57-429a-9905-1f7bef234a5c service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:17.148418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ffe29a3b-8123-4646-a70c-fab7e6ce33b5 req-3b3ac184-dd57-429a-9905-1f7bef234a5c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:17.148418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ffe29a3b-8123-4646-a70c-fab7e6ce33b5 req-3b3ac184-dd57-429a-9905-1f7bef234a5c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:17.195147 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-ffe29a3b-8123-4646-a70c-fab7e6ce33b5 req-3b3ac184-dd57-429a-9905-1f7bef234a5c service nova] Creating event network-vif-deleted:19f42b83-322a-4a7e-9e2a-23b81a02793f for instance 1cf751ea-4948-41d8-8ae2-0659e210001b on n-h2-852087-9 Sep 07 13:04:17.217460 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-ffe29a3b-8123-4646-a70c-fab7e6ce33b5 req-3b3ac184-dd57-429a-9905-1f7bef234a5c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172177 Sep 07 13:04:17.219934 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2810/5659] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:04:17.725379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-22d91caa-b3b4-4635-a6ea-9609b52365bd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:17.726142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-22d91caa-b3b4-4635-a6ea-9609b52365bd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:17.740317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22d91caa-b3b4-4635-a6ea-9609b52365bd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:17.740826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22d91caa-b3b4-4635-a6ea-9609b52365bd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:17.741273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22d91caa-b3b4-4635-a6ea-9609b52365bd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:17.742051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22d91caa-b3b4-4635-a6ea-9609b52365bd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:17.742517 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22d91caa-b3b4-4635-a6ea-9609b52365bd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:17.742953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22d91caa-b3b4-4635-a6ea-9609b52365bd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:17.794463 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-22d91caa-b3b4-4635-a6ea-9609b52365bd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] HTTP exception thrown: Instance 925a496f-7b54-406f-8d4b-5470d75f637f could not be found. Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-22d91caa-b3b4-4635-a6ea-9609b52365bd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Request method failure captured: Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f HTTP/1.1 Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJXjmtPm9YRFN-tztsi8TNQI9Hp8XLmIE4m4vovyCrvi10-eliNzw5RJ69qhXEwc5_GMz3l7wuK2ojP23vdsllISKFk4XviY8iZt7qikWDIyUcyEqbNGcGcZaYafPWwxZ6tUqEf0DAj26macVBxWQF5nsZe6v99sjs3_jT8xGYwPOpM Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: c9f85a4002bd40eb8514aa91056c77d8 Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 925a496f-7b54-406f-8d4b-5470d75f637f could not be found. Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '925a496f-7b54-406f-8d4b-5470d75f637f'} Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 925a496f-7b54-406f-8d4b-5470d75f637f could not be found. Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 925a496f-7b54-406f-8d4b-5470d75f637f could not be found. Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:04:17.805397 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:04:17.813443 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:04:17.813443 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:04:17.813443 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:04:17.813443 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:04:17.813443 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:04:17.813443 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 925a496f-7b54-406f-8d4b-5470d75f637f could not be found. Sep 07 13:04:17.813443 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:04:17.815864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-22d91caa-b3b4-4635-a6ea-9609b52365bd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Returning 404 to user: Instance 925a496f-7b54-406f-8d4b-5470d75f637f could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:04:17.829514 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-22d91caa-b3b4-4635-a6ea-9609b52365bd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f" status: 404 len: 111 microversion: 2.1 time: 0.096388 Sep 07 13:04:17.837184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d4abc3b-f5a4-48c2-8332-b575c69baf56 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:17.839113 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2850/5660] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:04:17 2022] GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:04:17.841531 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9d4abc3b-f5a4-48c2-8332-b575c69baf56 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 1cf751ea-4948-41d8-8ae2-0659e210001b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:17.861151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6ed058df-a019-452c-9799-71905f14d12b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '.version_select at 0x7fc4182aac10>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:17.873572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d4abc3b-f5a4-48c2-8332-b575c69baf56 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:17.876106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d4abc3b-f5a4-48c2-8332-b575c69baf56 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:17.877329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d4abc3b-f5a4-48c2-8332-b575c69baf56 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:17.879381 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d4abc3b-f5a4-48c2-8332-b575c69baf56 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:17.880715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d4abc3b-f5a4-48c2-8332-b575c69baf56 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:17.881889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d4abc3b-f5a4-48c2-8332-b575c69baf56 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:17.952371 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6ed058df-a019-452c-9799-71905f14d12b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-997832085" status: 202 len: 0 microversion: 2.1 time: 0.110839 Sep 07 13:04:17.962101 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2851/5661] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Sep 7 13:04:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-997832085 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:04:18.051874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d4abc3b-f5a4-48c2-8332-b575c69baf56 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:18.052833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d4abc3b-f5a4-48c2-8332-b575c69baf56 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:18.053676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d4abc3b-f5a4-48c2-8332-b575c69baf56 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:18.054508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-9d4abc3b-f5a4-48c2-8332-b575c69baf56 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lazy-loading 'fault' on Instance uuid 1cf751ea-4948-41d8-8ae2-0659e210001b {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:04:18.159092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9d4abc3b-f5a4-48c2-8332-b575c69baf56 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01aef6b538748118cc315eee680fee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8ccc06e20b4c5e98030d208abaa13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:04:18.195051 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9d4abc3b-f5a4-48c2-8332-b575c69baf56 tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b" status: 200 len: 1303 microversion: 2.1 time: 0.374468 Sep 07 13:04:18.205676 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2811/5662] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:04:17 2022] GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b => generated 1303 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:04:19.240210 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-25f2ba59-9523-41e6-8fd3-0f289bd0b27b tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:19.241662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-25f2ba59-9523-41e6-8fd3-0f289bd0b27b tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] [instance: 1cf751ea-4948-41d8-8ae2-0659e210001b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:19.257615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25f2ba59-9523-41e6-8fd3-0f289bd0b27b tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:19.258605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25f2ba59-9523-41e6-8fd3-0f289bd0b27b tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:19.261210 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25f2ba59-9523-41e6-8fd3-0f289bd0b27b tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:19.266433 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25f2ba59-9523-41e6-8fd3-0f289bd0b27b tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:19.267319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25f2ba59-9523-41e6-8fd3-0f289bd0b27b tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:19.267991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-25f2ba59-9523-41e6-8fd3-0f289bd0b27b tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:19.299791 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-25f2ba59-9523-41e6-8fd3-0f289bd0b27b tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] HTTP exception thrown: Instance 1cf751ea-4948-41d8-8ae2-0659e210001b could not be found. Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-25f2ba59-9523-41e6-8fd3-0f289bd0b27b tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Request method failure captured: Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b HTTP/1.1 Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJZ7vmtq09lROEG0ct5H6imB0iMXypTZygIxDw4YTQng2MeRSb4pjMDU9HXmwatdx-1qVb3D8-JSYbjsDVbXvrcWOSLDGbcJNFLE05HLsP158KYmL66Z2yeDoWDbsxBdo4sfXArJs-0eMLI5fc3-I4dE-mYMjRQvUyok4-1bKhpl3QA Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 7f8ccc06e20b4c5e98030d208abaa13b Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-VolumesActionsTest-1895097975 Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7f8ccc06e20b4c5e98030d208abaa13b"}]}, {"type": "tempest-type-214560723", "name": "tempest-service-325995263", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7f8ccc06e20b4c5e98030d208abaa13b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7f8ccc06e20b4c5e98030d208abaa13b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7f8ccc06e20b4c5e98030d208abaa13b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-VolumesActionsTest-1895097975 Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 7f8ccc06e20b4c5e98030d208abaa13b Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-VolumesActionsTest-1895097975 Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-VolumesActionsTest-1895097975-project Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: a01aef6b538748118cc315eee680fee3 Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-VolumesActionsTest-1895097975-project Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 1cf751ea-4948-41d8-8ae2-0659e210001b could not be found. Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '1cf751ea-4948-41d8-8ae2-0659e210001b'} Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cf751ea-4948-41d8-8ae2-0659e210001b could not be found. Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cf751ea-4948-41d8-8ae2-0659e210001b could not be found. Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:04:19.307851 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:04:19.312552 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:04:19.312552 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:04:19.312552 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:04:19.312552 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:04:19.312552 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:04:19.312552 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:04:19.312552 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cf751ea-4948-41d8-8ae2-0659e210001b could not be found. Sep 07 13:04:19.312552 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:04:19.316964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-25f2ba59-9523-41e6-8fd3-0f289bd0b27b tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] Returning 404 to user: Instance 1cf751ea-4948-41d8-8ae2-0659e210001b could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:04:19.319937 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-25f2ba59-9523-41e6-8fd3-0f289bd0b27b tempest-VolumesActionsTest-1895097975 tempest-VolumesActionsTest-1895097975-project] 10.222.0.16 "GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b" status: 404 len: 111 microversion: 2.1 time: 0.086330 Sep 07 13:04:19.322637 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2852/5663] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:04:19 2022] GET /compute/v2.1/servers/1cf751ea-4948-41d8-8ae2-0659e210001b => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:04:21.120782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-357a757c-f703-47e1-b8d0-3c4a27bdba7b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:21.122021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-357a757c-f703-47e1-b8d0-3c4a27bdba7b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:21.132361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-357a757c-f703-47e1-b8d0-3c4a27bdba7b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:21.133207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-357a757c-f703-47e1-b8d0-3c4a27bdba7b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:21.136278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-357a757c-f703-47e1-b8d0-3c4a27bdba7b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:21.137385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-357a757c-f703-47e1-b8d0-3c4a27bdba7b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:21.138065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-357a757c-f703-47e1-b8d0-3c4a27bdba7b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:21.138661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-357a757c-f703-47e1-b8d0-3c4a27bdba7b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:21.287406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-357a757c-f703-47e1-b8d0-3c4a27bdba7b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lazy-loading 'services' on Instance uuid 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:04:21.512966 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-357a757c-f703-47e1-b8d0-3c4a27bdba7b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments/da53e011-d759-45db-a1cd-f98260d5ba31" status: 202 len: 0 microversion: 2.1 time: 0.396556 Sep 07 13:04:21.514212 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2812/5664] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Sep 7 13:04:21 2022] DELETE /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments/da53e011-d759-45db-a1cd-f98260d5ba31 => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:04:21.527392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f5e6e94-4bdb-4722-9774-d0cbc571e02a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:21.535218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0f5e6e94-4bdb-4722-9774-d0cbc571e02a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:21.557571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f5e6e94-4bdb-4722-9774-d0cbc571e02a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:21.560057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f5e6e94-4bdb-4722-9774-d0cbc571e02a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:21.561886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f5e6e94-4bdb-4722-9774-d0cbc571e02a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:21.564809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f5e6e94-4bdb-4722-9774-d0cbc571e02a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:21.565583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f5e6e94-4bdb-4722-9774-d0cbc571e02a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:21.567167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f5e6e94-4bdb-4722-9774-d0cbc571e02a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:21.652994 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0f5e6e94-4bdb-4722-9774-d0cbc571e02a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129211 Sep 07 13:04:21.654434 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2853/5665] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:04:21 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:04:22.684319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-72989b98-84d6-4aa9-b10d-c1644bbae284 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:22.698374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-72989b98-84d6-4aa9-b10d-c1644bbae284 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:22.740781 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72989b98-84d6-4aa9-b10d-c1644bbae284 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:22.743541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72989b98-84d6-4aa9-b10d-c1644bbae284 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:22.747824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72989b98-84d6-4aa9-b10d-c1644bbae284 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:22.750155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72989b98-84d6-4aa9-b10d-c1644bbae284 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:22.753945 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72989b98-84d6-4aa9-b10d-c1644bbae284 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:22.756593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72989b98-84d6-4aa9-b10d-c1644bbae284 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:22.934017 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-72989b98-84d6-4aa9-b10d-c1644bbae284 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.267345 Sep 07 13:04:22.938636 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2813/5666] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:04:22 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments => generated 197 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:04:23.963236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-16bd4c11-db2d-4902-b127-1aa54b4923f6 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:23.976308 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-16bd4c11-db2d-4902-b127-1aa54b4923f6 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:24.046451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16bd4c11-db2d-4902-b127-1aa54b4923f6 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:24.047418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16bd4c11-db2d-4902-b127-1aa54b4923f6 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:24.053056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16bd4c11-db2d-4902-b127-1aa54b4923f6 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:24.058328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16bd4c11-db2d-4902-b127-1aa54b4923f6 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:24.063774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16bd4c11-db2d-4902-b127-1aa54b4923f6 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:24.067211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16bd4c11-db2d-4902-b127-1aa54b4923f6 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:24.245150 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-16bd4c11-db2d-4902-b127-1aa54b4923f6 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.292601 Sep 07 13:04:24.250386 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2854/5667] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:04:23 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments => generated 197 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:04:25.275670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-76a7ae7c-6af9-4cdb-9305-10f7caefce8d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:25.287255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-76a7ae7c-6af9-4cdb-9305-10f7caefce8d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:25.341097 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76a7ae7c-6af9-4cdb-9305-10f7caefce8d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:25.350705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76a7ae7c-6af9-4cdb-9305-10f7caefce8d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:25.356980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76a7ae7c-6af9-4cdb-9305-10f7caefce8d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:25.359821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76a7ae7c-6af9-4cdb-9305-10f7caefce8d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:25.364146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76a7ae7c-6af9-4cdb-9305-10f7caefce8d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:25.375383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76a7ae7c-6af9-4cdb-9305-10f7caefce8d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:25.581705 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-76a7ae7c-6af9-4cdb-9305-10f7caefce8d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.317485 Sep 07 13:04:25.585079 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2814/5668] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:04:25 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments => generated 197 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:04:26.606615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec339216-c7b7-4411-8092-e07eba162362 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:26.608583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ec339216-c7b7-4411-8092-e07eba162362 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:26.638618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec339216-c7b7-4411-8092-e07eba162362 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:26.641331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec339216-c7b7-4411-8092-e07eba162362 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:26.642669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec339216-c7b7-4411-8092-e07eba162362 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:26.649612 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec339216-c7b7-4411-8092-e07eba162362 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:26.651450 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec339216-c7b7-4411-8092-e07eba162362 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:26.658458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec339216-c7b7-4411-8092-e07eba162362 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:26.787173 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ec339216-c7b7-4411-8092-e07eba162362 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191058 Sep 07 13:04:26.800943 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2855/5669] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:04:26 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments => generated 197 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:04:27.823123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eddad322-6320-4edf-9830-3ebd2a8c22be tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:27.828388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eddad322-6320-4edf-9830-3ebd2a8c22be tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:27.848375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eddad322-6320-4edf-9830-3ebd2a8c22be tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:27.848862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eddad322-6320-4edf-9830-3ebd2a8c22be tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:27.849310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eddad322-6320-4edf-9830-3ebd2a8c22be tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:27.850083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eddad322-6320-4edf-9830-3ebd2a8c22be tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:27.850554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eddad322-6320-4edf-9830-3ebd2a8c22be tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:27.850986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eddad322-6320-4edf-9830-3ebd2a8c22be tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:27.916191 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eddad322-6320-4edf-9830-3ebd2a8c22be tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100429 Sep 07 13:04:27.922552 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2815/5670] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:04:27 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:04:28.951736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b8fd2d0e-0c09-42cd-914b-4a4ace5100a5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:28.970438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b8fd2d0e-0c09-42cd-914b-4a4ace5100a5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:28.997608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8fd2d0e-0c09-42cd-914b-4a4ace5100a5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:29.000356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8fd2d0e-0c09-42cd-914b-4a4ace5100a5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:29.002344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8fd2d0e-0c09-42cd-914b-4a4ace5100a5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:29.005439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8fd2d0e-0c09-42cd-914b-4a4ace5100a5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:29.006699 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8fd2d0e-0c09-42cd-914b-4a4ace5100a5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:29.008033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8fd2d0e-0c09-42cd-914b-4a4ace5100a5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:29.083297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:04:29.103545 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b8fd2d0e-0c09-42cd-914b-4a4ace5100a5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170149 Sep 07 13:04:29.114252 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2856/5671] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:04:28 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:04:30.126396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-603db757-5087-48fc-b5ae-38b4cb0c2032 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:30.149799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-603db757-5087-48fc-b5ae-38b4cb0c2032 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:30.185724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-603db757-5087-48fc-b5ae-38b4cb0c2032 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:30.187104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-603db757-5087-48fc-b5ae-38b4cb0c2032 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:30.191581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-603db757-5087-48fc-b5ae-38b4cb0c2032 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:30.195200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-603db757-5087-48fc-b5ae-38b4cb0c2032 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:30.197228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-603db757-5087-48fc-b5ae-38b4cb0c2032 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:30.200892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-603db757-5087-48fc-b5ae-38b4cb0c2032 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:30.231355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:04:30.380277 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-603db757-5087-48fc-b5ae-38b4cb0c2032 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.264772 Sep 07 13:04:30.391781 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2816/5672] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:04:30 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments => generated 197 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:04:31.406975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e6d9bd0d-afd8-4b6e-804b-7b6758bbadd8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:31.411440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e6d9bd0d-afd8-4b6e-804b-7b6758bbadd8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:31.417245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:04:31.435891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6d9bd0d-afd8-4b6e-804b-7b6758bbadd8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:31.438211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6d9bd0d-afd8-4b6e-804b-7b6758bbadd8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:31.439074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6d9bd0d-afd8-4b6e-804b-7b6758bbadd8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:31.440802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6d9bd0d-afd8-4b6e-804b-7b6758bbadd8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:31.442621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6d9bd0d-afd8-4b6e-804b-7b6758bbadd8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:31.445178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e6d9bd0d-afd8-4b6e-804b-7b6758bbadd8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:31.502950 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e6d9bd0d-afd8-4b6e-804b-7b6758bbadd8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102749 Sep 07 13:04:31.508991 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2857/5673] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:04:31 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:04:32.516954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1c57c80d-7647-4692-a4fa-9970b5d090d5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:32.519460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1c57c80d-7647-4692-a4fa-9970b5d090d5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:32.553827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c57c80d-7647-4692-a4fa-9970b5d090d5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:32.554344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c57c80d-7647-4692-a4fa-9970b5d090d5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:32.554787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c57c80d-7647-4692-a4fa-9970b5d090d5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:32.567605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c57c80d-7647-4692-a4fa-9970b5d090d5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:32.573067 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c57c80d-7647-4692-a4fa-9970b5d090d5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:32.593024 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1c57c80d-7647-4692-a4fa-9970b5d090d5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:32.761902 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1c57c80d-7647-4692-a4fa-9970b5d090d5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.249338 Sep 07 13:04:32.768672 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2817/5674] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:04:32 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments => generated 197 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:04:33.800014 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1469b481-4f6b-47bc-9db6-00db376afedf tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:33.818948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1469b481-4f6b-47bc-9db6-00db376afedf tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:33.892477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1469b481-4f6b-47bc-9db6-00db376afedf tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:33.896278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1469b481-4f6b-47bc-9db6-00db376afedf tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:33.906762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1469b481-4f6b-47bc-9db6-00db376afedf tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:33.908740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1469b481-4f6b-47bc-9db6-00db376afedf tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:33.918141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1469b481-4f6b-47bc-9db6-00db376afedf tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:33.919856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1469b481-4f6b-47bc-9db6-00db376afedf tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:34.090162 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1469b481-4f6b-47bc-9db6-00db376afedf tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.308941 Sep 07 13:04:34.092959 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2858/5675] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:04:33 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments => generated 197 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:04:35.114702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a09bf207-9224-4609-b0fa-d8a4d6d87042 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:35.121299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a09bf207-9224-4609-b0fa-d8a4d6d87042 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:35.143874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a09bf207-9224-4609-b0fa-d8a4d6d87042 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:35.145169 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a09bf207-9224-4609-b0fa-d8a4d6d87042 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:35.145911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a09bf207-9224-4609-b0fa-d8a4d6d87042 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:35.148598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a09bf207-9224-4609-b0fa-d8a4d6d87042 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:35.151348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a09bf207-9224-4609-b0fa-d8a4d6d87042 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:35.152381 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a09bf207-9224-4609-b0fa-d8a4d6d87042 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:35.304318 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a09bf207-9224-4609-b0fa-d8a4d6d87042 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193864 Sep 07 13:04:35.308338 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2818/5676] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:04:35 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:04:36.326471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e25c23ee-2a63-4fef-b08f-bfba10f21c42 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:36.343924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e25c23ee-2a63-4fef-b08f-bfba10f21c42 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:36.398380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e25c23ee-2a63-4fef-b08f-bfba10f21c42 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:36.399499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e25c23ee-2a63-4fef-b08f-bfba10f21c42 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:36.400269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e25c23ee-2a63-4fef-b08f-bfba10f21c42 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:36.401820 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e25c23ee-2a63-4fef-b08f-bfba10f21c42 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:36.402516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e25c23ee-2a63-4fef-b08f-bfba10f21c42 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:36.403318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e25c23ee-2a63-4fef-b08f-bfba10f21c42 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:36.657269 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e25c23ee-2a63-4fef-b08f-bfba10f21c42 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.340143 Sep 07 13:04:36.688864 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2859/5677] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:04:36 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63/os-volume_attachments => generated 25 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:04:36.856523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6d8d28f9-c8d0-4b21-bc44-16fff3bd7122 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:36.858292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6d8d28f9-c8d0-4b21-bc44-16fff3bd7122 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:36.876952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d8d28f9-c8d0-4b21-bc44-16fff3bd7122 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:36.878284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d8d28f9-c8d0-4b21-bc44-16fff3bd7122 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:36.879266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d8d28f9-c8d0-4b21-bc44-16fff3bd7122 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:36.880898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d8d28f9-c8d0-4b21-bc44-16fff3bd7122 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:36.882695 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d8d28f9-c8d0-4b21-bc44-16fff3bd7122 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:36.883640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d8d28f9-c8d0-4b21-bc44-16fff3bd7122 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:36.943914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6d8d28f9-c8d0-4b21-bc44-16fff3bd7122 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:04:37.267487 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6d8d28f9-c8d0-4b21-bc44-16fff3bd7122 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63" status: 204 len: 0 microversion: 2.1 time: 0.417194 Sep 07 13:04:37.269717 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2819/5678] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:04:36 2022] DELETE /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:04:37.292235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-899ac219-6943-4ace-ad38-092a3611a6fc tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:37.298971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-899ac219-6943-4ace-ad38-092a3611a6fc tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:37.323911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-899ac219-6943-4ace-ad38-092a3611a6fc tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:37.326609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-899ac219-6943-4ace-ad38-092a3611a6fc tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:37.329075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-899ac219-6943-4ace-ad38-092a3611a6fc tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:37.334869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-899ac219-6943-4ace-ad38-092a3611a6fc tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:37.337002 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-899ac219-6943-4ace-ad38-092a3611a6fc tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:37.338447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-899ac219-6943-4ace-ad38-092a3611a6fc tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:38.193112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-899ac219-6943-4ace-ad38-092a3611a6fc tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:04:38.235380 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-899ac219-6943-4ace-ad38-092a3611a6fc tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63" status: 200 len: 1682 microversion: 2.1 time: 0.956001 Sep 07 13:04:38.249884 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2860/5679] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:04:37 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63 => generated 1682 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:04:39.267354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9848c11f-1074-4cd2-b567-509013d8c8bf tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:39.269200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9848c11f-1074-4cd2-b567-509013d8c8bf tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:39.290632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:04:39.298177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9848c11f-1074-4cd2-b567-509013d8c8bf tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:39.307564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9848c11f-1074-4cd2-b567-509013d8c8bf tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:39.309207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9848c11f-1074-4cd2-b567-509013d8c8bf tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:39.310612 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9848c11f-1074-4cd2-b567-509013d8c8bf tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:39.312446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9848c11f-1074-4cd2-b567-509013d8c8bf tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:39.318124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9848c11f-1074-4cd2-b567-509013d8c8bf tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:40.368041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9848c11f-1074-4cd2-b567-509013d8c8bf tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:04:40.390169 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9848c11f-1074-4cd2-b567-509013d8c8bf tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63" status: 200 len: 1682 microversion: 2.1 time: 1.127608 Sep 07 13:04:40.393892 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2820/5680] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:04:39 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63 => generated 1682 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:04:41.446072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5ffbe6db-aef0-4061-bbb9-4f29284ab0c4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:41.447712 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5ffbe6db-aef0-4061-bbb9-4f29284ab0c4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:41.467448 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ffbe6db-aef0-4061-bbb9-4f29284ab0c4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:41.468593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ffbe6db-aef0-4061-bbb9-4f29284ab0c4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:41.469246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ffbe6db-aef0-4061-bbb9-4f29284ab0c4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:41.470394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ffbe6db-aef0-4061-bbb9-4f29284ab0c4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:41.473154 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ffbe6db-aef0-4061-bbb9-4f29284ab0c4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:41.474530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ffbe6db-aef0-4061-bbb9-4f29284ab0c4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:42.536269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5ffbe6db-aef0-4061-bbb9-4f29284ab0c4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:04:42.559358 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5ffbe6db-aef0-4061-bbb9-4f29284ab0c4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63" status: 200 len: 1682 microversion: 2.1 time: 1.108305 Sep 07 13:04:42.574711 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2861/5681] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:04:41 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63 => generated 1682 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:04:43.593927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-168ff189-05d5-4c21-8157-00f3ea073ef5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:43.598695 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-168ff189-05d5-4c21-8157-00f3ea073ef5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:43.645473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-168ff189-05d5-4c21-8157-00f3ea073ef5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:43.648189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-168ff189-05d5-4c21-8157-00f3ea073ef5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:43.650731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-168ff189-05d5-4c21-8157-00f3ea073ef5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:43.653659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-168ff189-05d5-4c21-8157-00f3ea073ef5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:43.662048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-168ff189-05d5-4c21-8157-00f3ea073ef5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:43.672200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-168ff189-05d5-4c21-8157-00f3ea073ef5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:44.139718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-168ff189-05d5-4c21-8157-00f3ea073ef5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:04:44.171091 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-168ff189-05d5-4c21-8157-00f3ea073ef5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63" status: 200 len: 1614 microversion: 2.1 time: 0.581300 Sep 07 13:04:44.184326 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2821/5682] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:04:43 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63 => generated 1614 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:04:45.247291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fba20e0b-b86d-4882-bcc2-bc434c45be3e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:45.252463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fba20e0b-b86d-4882-bcc2-bc434c45be3e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:45.303634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fba20e0b-b86d-4882-bcc2-bc434c45be3e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:45.304877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fba20e0b-b86d-4882-bcc2-bc434c45be3e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:45.309466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fba20e0b-b86d-4882-bcc2-bc434c45be3e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:45.314463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fba20e0b-b86d-4882-bcc2-bc434c45be3e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:45.318514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fba20e0b-b86d-4882-bcc2-bc434c45be3e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:45.321767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fba20e0b-b86d-4882-bcc2-bc434c45be3e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:45.619017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fba20e0b-b86d-4882-bcc2-bc434c45be3e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:04:45.651942 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fba20e0b-b86d-4882-bcc2-bc434c45be3e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63" status: 200 len: 1327 microversion: 2.1 time: 0.417357 Sep 07 13:04:45.670543 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2862/5683] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:04:45 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63 => generated 1327 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:04:46.387511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b4f164e0-d25e-4ba8-ba2b-b400d3f60525 req-9c82e7c8-60cc-4e94-af81-800ad69d01f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dbd6ebd-a395-40cf-9aee-a3ec45adac63", "name": "network-vif-deleted", "tag": "6d4c0a71-ad7c-4f97-8d06-18723a168f78"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:04:46.439856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b4f164e0-d25e-4ba8-ba2b-b400d3f60525 req-9c82e7c8-60cc-4e94-af81-800ad69d01f6 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:46.446867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b4f164e0-d25e-4ba8-ba2b-b400d3f60525 req-9c82e7c8-60cc-4e94-af81-800ad69d01f6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:46.450991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b4f164e0-d25e-4ba8-ba2b-b400d3f60525 req-9c82e7c8-60cc-4e94-af81-800ad69d01f6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:46.506087 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b4f164e0-d25e-4ba8-ba2b-b400d3f60525 req-9c82e7c8-60cc-4e94-af81-800ad69d01f6 service nova] Creating event network-vif-deleted:6d4c0a71-ad7c-4f97-8d06-18723a168f78 for instance 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 on n-h2-852087-9 Sep 07 13:04:46.545663 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b4f164e0-d25e-4ba8-ba2b-b400d3f60525 req-9c82e7c8-60cc-4e94-af81-800ad69d01f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.234636 Sep 07 13:04:46.557699 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2822/5684] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:04:46.706898 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3e1e2004-d4e6-4db7-ac9d-38e4b0444687 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:46.719747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3e1e2004-d4e6-4db7-ac9d-38e4b0444687 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:46.787076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e1e2004-d4e6-4db7-ac9d-38e4b0444687 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:46.788936 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e1e2004-d4e6-4db7-ac9d-38e4b0444687 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:46.798624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e1e2004-d4e6-4db7-ac9d-38e4b0444687 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:46.822343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e1e2004-d4e6-4db7-ac9d-38e4b0444687 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:46.828030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e1e2004-d4e6-4db7-ac9d-38e4b0444687 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:46.838253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e1e2004-d4e6-4db7-ac9d-38e4b0444687 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:47.038287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e1e2004-d4e6-4db7-ac9d-38e4b0444687 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:47.039768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e1e2004-d4e6-4db7-ac9d-38e4b0444687 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:47.043266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e1e2004-d4e6-4db7-ac9d-38e4b0444687 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:47.044559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-3e1e2004-d4e6-4db7-ac9d-38e4b0444687 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lazy-loading 'fault' on Instance uuid 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:04:47.523370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3e1e2004-d4e6-4db7-ac9d-38e4b0444687 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:04:47.574018 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3e1e2004-d4e6-4db7-ac9d-38e4b0444687 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63" status: 200 len: 1332 microversion: 2.1 time: 0.870534 Sep 07 13:04:47.582475 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2863/5685] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:04:46 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63 => generated 1332 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:04:48.643354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ca55be09-021f-496c-81cb-1537061bcc10 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:48.651211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ca55be09-021f-496c-81cb-1537061bcc10 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:04:48.700861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca55be09-021f-496c-81cb-1537061bcc10 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:48.708882 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca55be09-021f-496c-81cb-1537061bcc10 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:48.715057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca55be09-021f-496c-81cb-1537061bcc10 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:48.716470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca55be09-021f-496c-81cb-1537061bcc10 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:48.717186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca55be09-021f-496c-81cb-1537061bcc10 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:48.718017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca55be09-021f-496c-81cb-1537061bcc10 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:48.763793 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-ca55be09-021f-496c-81cb-1537061bcc10 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] HTTP exception thrown: Instance 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 could not be found. Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ca55be09-021f-496c-81cb-1537061bcc10 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Request method failure captured: Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63 HTTP/1.1 Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJXjmtPm9YRFN-tztsi8TNQI9Hp8XLmIE4m4vovyCrvi10-eliNzw5RJ69qhXEwc5_GMz3l7wuK2ojP23vdsllISKFk4XviY8iZt7qikWDIyUcyEqbNGcGcZaYafPWwxZ6tUqEf0DAj26macVBxWQF5nsZe6v99sjs3_jT8xGYwPOpM Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: c9f85a4002bd40eb8514aa91056c77d8 Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 could not be found. Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '0dbd6ebd-a395-40cf-9aee-a3ec45adac63'} Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 could not be found. Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 could not be found. Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:04:48.764904 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:04:48.768544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:04:48.768544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:04:48.768544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:04:48.768544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:04:48.768544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:04:48.768544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 could not be found. Sep 07 13:04:48.768544 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:04:48.771791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ca55be09-021f-496c-81cb-1537061bcc10 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Returning 404 to user: Instance 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:04:48.773188 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ca55be09-021f-496c-81cb-1537061bcc10 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63" status: 404 len: 111 microversion: 2.1 time: 0.144354 Sep 07 13:04:48.775018 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2823/5686] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:04:48 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:04:48.787720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-284e4d05-f09c-4818-ae82-07bce57d386f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '.version_select at 0x7fc4182aa940>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:04:48.839762 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-284e4d05-f09c-4818-ae82-07bce57d386f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1859603308" status: 202 len: 0 microversion: 2.1 time: 0.058880 Sep 07 13:04:48.842880 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2864/5687] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Sep 7 13:04:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1859603308 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:04:50.705153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dcda0210-b655-409f-9b43-a9f3e66bf2c2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Action: 'create', calling method: .version_select at 0x7fc41d2f31f0>, body: {"keypair": {"name": "tempest-keypair-1342096873", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF5MZcKcCnfCFPyoUvx/3LSW7COFZG3UXaY0RjQZ6Fr0V/OgZPwjIQnSLRQuIQgTBD5Ut+EqBnhLy0XYR0fyeHthtL10S6+JjYfQy9jElBDHjplMubhFu9vqtHPH1hUyA=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:04:50.798088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-dcda0210-b655-409f-9b43-a9f3e66bf2c2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Getting quotas for project cb9b61f78ca140c5870961647ff04cfe. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:04:50.819009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-dcda0210-b655-409f-9b43-a9f3e66bf2c2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Getting quotas for user c9f85a4002bd40eb8514aa91056c77d8 and project cb9b61f78ca140c5870961647ff04cfe. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:04:50.977983 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dcda0210-b655-409f-9b43-a9f3e66bf2c2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.292991 Sep 07 13:04:50.979724 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2824/5688] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 13:04:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:04:57.532197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=45 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:04:57.674402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0d19f9e5-1bfc-4bac-80b5-28b5515161da tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-719584473", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "32f072dd-3117-4f25-8134-fb80f2094d63"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:04:57.886384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-0d19f9e5-1bfc-4bac-80b5-28b5515161da tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] validate_networks() for [('32f072dd-3117-4f25-8134-fb80f2094d63', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:04:59.474274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0d19f9e5-1bfc-4bac-80b5-28b5515161da tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:04:59.475583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0d19f9e5-1bfc-4bac-80b5-28b5515161da tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:04:59.476370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0d19f9e5-1bfc-4bac-80b5-28b5515161da tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:04:59.477544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0d19f9e5-1bfc-4bac-80b5-28b5515161da tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:04:59.478341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-0d19f9e5-1bfc-4bac-80b5-28b5515161da tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:04:59.531066 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d19f9e5-1bfc-4bac-80b5-28b5515161da tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:59.532030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d19f9e5-1bfc-4bac-80b5-28b5515161da tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:59.533077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d19f9e5-1bfc-4bac-80b5-28b5515161da tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:59.549704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d19f9e5-1bfc-4bac-80b5-28b5515161da tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:04:59.554093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d19f9e5-1bfc-4bac-80b5-28b5515161da tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:04:59.554902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d19f9e5-1bfc-4bac-80b5-28b5515161da tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:04:59.579751 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-af0fbaa7-13f2-435b-ba95-5f2765e19c96 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1591800999", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "477b0efc-1e3a-4288-a7c3-16de8a1f2f66"}], "security_groups": [{"name": "tempest-securitygroup--506733970"}], "key_name": "tempest-keypair-1342096873", "user_data": "}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:04:59.670459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:04:59.681712 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-0d19f9e5-1bfc-4bac-80b5-28b5515161da tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Getting quotas for project b718b41e479c4141bb4a1a12cfced511. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:04:59.700468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-0d19f9e5-1bfc-4bac-80b5-28b5515161da tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Getting quotas for user 40f6d286320b455da9a89337128684e5 and project b718b41e479c4141bb4a1a12cfced511. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:04:59.759328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0d19f9e5-1bfc-4bac-80b5-28b5515161da tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:04:59.774682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0d19f9e5-1bfc-4bac-80b5-28b5515161da tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] [instance: 60b20969-b90f-43d0-997c-4ab915ece0d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:04:59.992808 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0d19f9e5-1bfc-4bac-80b5-28b5515161da tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.305476 Sep 07 13:05:00.012699 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2865/5689] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:04:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:05:00.031829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-db22ccd5-3b7e-456f-b4b8-2b3f76c2ac58 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:00.033388 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-db22ccd5-3b7e-456f-b4b8-2b3f76c2ac58 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] [instance: 60b20969-b90f-43d0-997c-4ab915ece0d7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:00.289358 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-db22ccd5-3b7e-456f-b4b8-2b3f76c2ac58 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f6d286320b455da9a89337128684e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b718b41e479c4141bb4a1a12cfced511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:00.327062 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-db22ccd5-3b7e-456f-b4b8-2b3f76c2ac58 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] 10.222.0.16 "GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7" status: 200 len: 1213 microversion: 2.1 time: 0.311868 Sep 07 13:05:00.330159 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2866/5690] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:00 2022] GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7 => generated 1213 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:00.844564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:01.374901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3f9861ae-72a5-41da-98c5-88016ae1dc85 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:01.375845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3f9861ae-72a5-41da-98c5-88016ae1dc85 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] [instance: 60b20969-b90f-43d0-997c-4ab915ece0d7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:01.589555 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-af0fbaa7-13f2-435b-ba95-5f2765e19c96 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] validate_networks() for [('477b0efc-1e3a-4288-a7c3-16de8a1f2f66', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:05:02.104278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3f9861ae-72a5-41da-98c5-88016ae1dc85 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f6d286320b455da9a89337128684e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b718b41e479c4141bb4a1a12cfced511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:02.121217 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3f9861ae-72a5-41da-98c5-88016ae1dc85 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] 10.222.0.16 "GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7" status: 200 len: 1213 microversion: 2.1 time: 0.750453 Sep 07 13:05:02.127656 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2867/5691] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:01 2022] GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7 => generated 1213 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:05:03.173932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-31d03213-5156-4e1c-9235-f3df1466a2df tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:03.174949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-31d03213-5156-4e1c-9235-f3df1466a2df tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] [instance: 60b20969-b90f-43d0-997c-4ab915ece0d7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:03.189789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:03.204410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31d03213-5156-4e1c-9235-f3df1466a2df tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:03.205096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31d03213-5156-4e1c-9235-f3df1466a2df tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:03.206616 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31d03213-5156-4e1c-9235-f3df1466a2df tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:03.210249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31d03213-5156-4e1c-9235-f3df1466a2df tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:03.211119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31d03213-5156-4e1c-9235-f3df1466a2df tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:03.212761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31d03213-5156-4e1c-9235-f3df1466a2df tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:03.599050 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-31d03213-5156-4e1c-9235-f3df1466a2df tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f6d286320b455da9a89337128684e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b718b41e479c4141bb4a1a12cfced511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:03.625073 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-31d03213-5156-4e1c-9235-f3df1466a2df tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] 10.222.0.16 "GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7" status: 200 len: 1209 microversion: 2.1 time: 0.465291 Sep 07 13:05:03.634163 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2868/5692] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:03 2022] GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7 => generated 1209 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:03.653369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-af0fbaa7-13f2-435b-ba95-5f2765e19c96 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:05:03.655266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-af0fbaa7-13f2-435b-ba95-5f2765e19c96 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:05:03.656494 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-af0fbaa7-13f2-435b-ba95-5f2765e19c96 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:05:03.657693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-af0fbaa7-13f2-435b-ba95-5f2765e19c96 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:05:03.663657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-af0fbaa7-13f2-435b-ba95-5f2765e19c96 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:05:03.765821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af0fbaa7-13f2-435b-ba95-5f2765e19c96 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:03.767526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af0fbaa7-13f2-435b-ba95-5f2765e19c96 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:03.769861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af0fbaa7-13f2-435b-ba95-5f2765e19c96 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:03.772971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af0fbaa7-13f2-435b-ba95-5f2765e19c96 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:03.775136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af0fbaa7-13f2-435b-ba95-5f2765e19c96 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:03.779513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af0fbaa7-13f2-435b-ba95-5f2765e19c96 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:03.867379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-af0fbaa7-13f2-435b-ba95-5f2765e19c96 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Getting quotas for project cb9b61f78ca140c5870961647ff04cfe. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:05:03.906245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-af0fbaa7-13f2-435b-ba95-5f2765e19c96 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Getting quotas for user c9f85a4002bd40eb8514aa91056c77d8 and project cb9b61f78ca140c5870961647ff04cfe. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:05:03.947241 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-af0fbaa7-13f2-435b-ba95-5f2765e19c96 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:05:03.950003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-af0fbaa7-13f2-435b-ba95-5f2765e19c96 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:05:04.076308 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-af0fbaa7-13f2-435b-ba95-5f2765e19c96 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.512238 Sep 07 13:05:04.082907 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2825/5693] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:04:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 4522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:05:04.109694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7dacc677-6ad5-4757-a3c9-469fa908cbae tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:04.111449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7dacc677-6ad5-4757-a3c9-469fa908cbae tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:04.334604 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7dacc677-6ad5-4757-a3c9-469fa908cbae tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:04.359992 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7dacc677-6ad5-4757-a3c9-469fa908cbae tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8" status: 200 len: 1242 microversion: 2.1 time: 0.266947 Sep 07 13:05:04.362439 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2869/5694] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:04 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8 => generated 1242 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:04.686911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-886f104d-af94-41df-a408-61e7a103dd0a tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:04.694346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-886f104d-af94-41df-a408-61e7a103dd0a tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] [instance: 60b20969-b90f-43d0-997c-4ab915ece0d7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:04.750537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-886f104d-af94-41df-a408-61e7a103dd0a tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:04.757779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-886f104d-af94-41df-a408-61e7a103dd0a tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:04.761724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-886f104d-af94-41df-a408-61e7a103dd0a tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:04.770833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-886f104d-af94-41df-a408-61e7a103dd0a tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:04.778005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-886f104d-af94-41df-a408-61e7a103dd0a tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:04.785103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-886f104d-af94-41df-a408-61e7a103dd0a tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:05.056348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-886f104d-af94-41df-a408-61e7a103dd0a tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f6d286320b455da9a89337128684e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b718b41e479c4141bb4a1a12cfced511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:05.104608 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-886f104d-af94-41df-a408-61e7a103dd0a tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] 10.222.0.16 "GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7" status: 200 len: 1273 microversion: 2.1 time: 0.435936 Sep 07 13:05:05.109844 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2826/5695] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:04 2022] GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7 => generated 1273 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:05.407033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-02ee507a-ae03-4228-be53-107daeeeed01 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:05.409183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-02ee507a-ae03-4228-be53-107daeeeed01 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:06.136879 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-33834239-9310-4842-a78a-275cf0b16d37 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:06.137818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-33834239-9310-4842-a78a-275cf0b16d37 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] [instance: 60b20969-b90f-43d0-997c-4ab915ece0d7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:06.183871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33834239-9310-4842-a78a-275cf0b16d37 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:06.186107 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33834239-9310-4842-a78a-275cf0b16d37 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:06.187915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33834239-9310-4842-a78a-275cf0b16d37 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:06.195080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33834239-9310-4842-a78a-275cf0b16d37 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:06.197842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33834239-9310-4842-a78a-275cf0b16d37 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:06.200545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33834239-9310-4842-a78a-275cf0b16d37 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:06.580583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-02ee507a-ae03-4228-be53-107daeeeed01 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:06.590088 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-02ee507a-ae03-4228-be53-107daeeeed01 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8" status: 200 len: 1242 microversion: 2.1 time: 1.188231 Sep 07 13:05:06.591064 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2870/5696] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:05 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8 => generated 1242 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:06.879728 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-33834239-9310-4842-a78a-275cf0b16d37 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f6d286320b455da9a89337128684e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b718b41e479c4141bb4a1a12cfced511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:06.936977 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-33834239-9310-4842-a78a-275cf0b16d37 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] 10.222.0.16 "GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7" status: 200 len: 1271 microversion: 2.1 time: 0.807530 Sep 07 13:05:06.946797 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2827/5697] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:06 2022] GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7 => generated 1271 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:07.625520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-962c6738-c75b-4933-915d-f34c9244ea8f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:07.626494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-962c6738-c75b-4933-915d-f34c9244ea8f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:07.654234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-962c6738-c75b-4933-915d-f34c9244ea8f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:07.654799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-962c6738-c75b-4933-915d-f34c9244ea8f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:07.658559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-962c6738-c75b-4933-915d-f34c9244ea8f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:07.663674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-962c6738-c75b-4933-915d-f34c9244ea8f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:07.668010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-962c6738-c75b-4933-915d-f34c9244ea8f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:07.669320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-962c6738-c75b-4933-915d-f34c9244ea8f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:07.974984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-66e769f2-f47b-4648-b87e-1a4e9141a85a tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:07.975776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-66e769f2-f47b-4648-b87e-1a4e9141a85a tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] [instance: 60b20969-b90f-43d0-997c-4ab915ece0d7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:07.991043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e769f2-f47b-4648-b87e-1a4e9141a85a tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:07.993229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e769f2-f47b-4648-b87e-1a4e9141a85a tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:07.994914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e769f2-f47b-4648-b87e-1a4e9141a85a tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:07.996690 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e769f2-f47b-4648-b87e-1a4e9141a85a tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:07.999249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e769f2-f47b-4648-b87e-1a4e9141a85a tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:08.000395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66e769f2-f47b-4648-b87e-1a4e9141a85a tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:08.774787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-962c6738-c75b-4933-915d-f34c9244ea8f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:08.813457 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-962c6738-c75b-4933-915d-f34c9244ea8f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8" status: 200 len: 1300 microversion: 2.1 time: 1.201908 Sep 07 13:05:08.826580 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2871/5698] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:07 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8 => generated 1300 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:08.872416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-66e769f2-f47b-4648-b87e-1a4e9141a85a tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f6d286320b455da9a89337128684e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b718b41e479c4141bb4a1a12cfced511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:08.936592 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-66e769f2-f47b-4648-b87e-1a4e9141a85a tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] 10.222.0.16 "GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7" status: 200 len: 1271 microversion: 2.1 time: 0.966753 Sep 07 13:05:08.941572 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2828/5699] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:07 2022] GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7 => generated 1271 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:05:09.870962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fec1682f-d058-4508-af8c-40afa58670be tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:09.874226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fec1682f-d058-4508-af8c-40afa58670be tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:09.901190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:09.908746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fec1682f-d058-4508-af8c-40afa58670be tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:09.919781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fec1682f-d058-4508-af8c-40afa58670be tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:09.924302 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fec1682f-d058-4508-af8c-40afa58670be tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:09.925510 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fec1682f-d058-4508-af8c-40afa58670be tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:09.931509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fec1682f-d058-4508-af8c-40afa58670be tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:09.938157 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fec1682f-d058-4508-af8c-40afa58670be tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:09.980241 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b51f3c64-45da-4edf-a0c6-04f87533125d tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:09.982275 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b51f3c64-45da-4edf-a0c6-04f87533125d tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] [instance: 60b20969-b90f-43d0-997c-4ab915ece0d7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:09.997649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:10.047067 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b51f3c64-45da-4edf-a0c6-04f87533125d tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:10.047994 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b51f3c64-45da-4edf-a0c6-04f87533125d tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:10.048877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b51f3c64-45da-4edf-a0c6-04f87533125d tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:10.062717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b51f3c64-45da-4edf-a0c6-04f87533125d tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:10.064343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b51f3c64-45da-4edf-a0c6-04f87533125d tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:10.071803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b51f3c64-45da-4edf-a0c6-04f87533125d tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:10.262975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fec1682f-d058-4508-af8c-40afa58670be tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:10.292986 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fec1682f-d058-4508-af8c-40afa58670be tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8" status: 200 len: 1300 microversion: 2.1 time: 0.426194 Sep 07 13:05:10.296874 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2872/5700] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:09 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8 => generated 1300 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:11.349161 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-585f27a7-5a9e-4ed1-8eb7-00d711530aee tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:11.350568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-585f27a7-5a9e-4ed1-8eb7-00d711530aee tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:11.401720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-585f27a7-5a9e-4ed1-8eb7-00d711530aee tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:11.406078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-585f27a7-5a9e-4ed1-8eb7-00d711530aee tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:11.409315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-585f27a7-5a9e-4ed1-8eb7-00d711530aee tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:11.415194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-585f27a7-5a9e-4ed1-8eb7-00d711530aee tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:11.418075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-585f27a7-5a9e-4ed1-8eb7-00d711530aee tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:11.422751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-585f27a7-5a9e-4ed1-8eb7-00d711530aee tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:11.753383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b51f3c64-45da-4edf-a0c6-04f87533125d tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f6d286320b455da9a89337128684e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b718b41e479c4141bb4a1a12cfced511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:11.785325 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b51f3c64-45da-4edf-a0c6-04f87533125d tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] 10.222.0.16 "GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7" status: 200 len: 1313 microversion: 2.1 time: 1.815137 Sep 07 13:05:11.789563 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2829/5701] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:09 2022] GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7 => generated 1313 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:12.529463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-585f27a7-5a9e-4ed1-8eb7-00d711530aee tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:12.566863 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-585f27a7-5a9e-4ed1-8eb7-00d711530aee tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8" status: 200 len: 1367 microversion: 2.1 time: 1.225245 Sep 07 13:05:12.592563 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2873/5702] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:11 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8 => generated 1367 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:05:12.837127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-50023190-9590-4a6b-a12b-508fff46b585 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:12.840382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-50023190-9590-4a6b-a12b-508fff46b585 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] [instance: 60b20969-b90f-43d0-997c-4ab915ece0d7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:12.881360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50023190-9590-4a6b-a12b-508fff46b585 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:12.905064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50023190-9590-4a6b-a12b-508fff46b585 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:12.913055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50023190-9590-4a6b-a12b-508fff46b585 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:12.923663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50023190-9590-4a6b-a12b-508fff46b585 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:12.924800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50023190-9590-4a6b-a12b-508fff46b585 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:12.926104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50023190-9590-4a6b-a12b-508fff46b585 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:13.692779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4b005538-99f6-4943-a9e4-a9be8f777746 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:13.708917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4b005538-99f6-4943-a9e4-a9be8f777746 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:13.814724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b005538-99f6-4943-a9e4-a9be8f777746 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:13.820957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b005538-99f6-4943-a9e4-a9be8f777746 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:13.821458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b005538-99f6-4943-a9e4-a9be8f777746 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:13.822291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b005538-99f6-4943-a9e4-a9be8f777746 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:13.826301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b005538-99f6-4943-a9e4-a9be8f777746 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:13.826769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4b005538-99f6-4943-a9e4-a9be8f777746 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:13.826885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:13.941288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:15.915347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-50023190-9590-4a6b-a12b-508fff46b585 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f6d286320b455da9a89337128684e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b718b41e479c4141bb4a1a12cfced511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:15.916172 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4b005538-99f6-4943-a9e4-a9be8f777746 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:15.952438 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4b005538-99f6-4943-a9e4-a9be8f777746 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8" status: 200 len: 1367 microversion: 2.1 time: 2.329660 Sep 07 13:05:15.953543 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2874/5703] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:13 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8 => generated 1367 bytes in 2332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:15.970487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-fc1e3189-cd14-45ba-9d70-8969d935f988 req-1f26d1ce-b41f-4526-8597-4e6a91c3e1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3531114-92cc-4ecb-a97c-0c05170f41f8", "tag": "02d26819-44be-494d-b371-66e56263bd4b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:05:15.990465 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-50023190-9590-4a6b-a12b-508fff46b585 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] 10.222.0.16 "GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7" status: 200 len: 1313 microversion: 2.1 time: 3.168694 Sep 07 13:05:15.992294 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2830/5704] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:12 2022] GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7 => generated 1313 bytes in 3173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:16.072640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fc1e3189-cd14-45ba-9d70-8969d935f988 req-1f26d1ce-b41f-4526-8597-4e6a91c3e1e0 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:16.077911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fc1e3189-cd14-45ba-9d70-8969d935f988 req-1f26d1ce-b41f-4526-8597-4e6a91c3e1e0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:16.081026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fc1e3189-cd14-45ba-9d70-8969d935f988 req-1f26d1ce-b41f-4526-8597-4e6a91c3e1e0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:16.158375 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-fc1e3189-cd14-45ba-9d70-8969d935f988 req-1f26d1ce-b41f-4526-8597-4e6a91c3e1e0 service nova] Creating event network-changed:02d26819-44be-494d-b371-66e56263bd4b for instance c3531114-92cc-4ecb-a97c-0c05170f41f8 on n-h1-852087-9 Sep 07 13:05:16.199122 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-fc1e3189-cd14-45ba-9d70-8969d935f988 req-1f26d1ce-b41f-4526-8597-4e6a91c3e1e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.238433 Sep 07 13:05:16.207169 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2875/5705] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:05:17.019351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-570ab497-bd42-4c07-a740-70221b29a61c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:17.026079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-225e4270-2fe4-492a-8d3a-3519f73b9049 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:17.026840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-225e4270-2fe4-492a-8d3a-3519f73b9049 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] [instance: 60b20969-b90f-43d0-997c-4ab915ece0d7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:17.027529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-570ab497-bd42-4c07-a740-70221b29a61c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:17.029864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=14 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:17.072839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-225e4270-2fe4-492a-8d3a-3519f73b9049 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:17.073819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-225e4270-2fe4-492a-8d3a-3519f73b9049 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:17.074469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-225e4270-2fe4-492a-8d3a-3519f73b9049 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:17.075434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-225e4270-2fe4-492a-8d3a-3519f73b9049 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:17.076076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-225e4270-2fe4-492a-8d3a-3519f73b9049 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:17.076899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-225e4270-2fe4-492a-8d3a-3519f73b9049 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:17.096648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-570ab497-bd42-4c07-a740-70221b29a61c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:17.097572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-570ab497-bd42-4c07-a740-70221b29a61c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:17.098589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-570ab497-bd42-4c07-a740-70221b29a61c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:17.100089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-570ab497-bd42-4c07-a740-70221b29a61c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:17.103587 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-570ab497-bd42-4c07-a740-70221b29a61c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:17.104616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-570ab497-bd42-4c07-a740-70221b29a61c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:18.351868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-570ab497-bd42-4c07-a740-70221b29a61c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:18.391778 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-570ab497-bd42-4c07-a740-70221b29a61c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8" status: 200 len: 1367 microversion: 2.1 time: 1.391330 Sep 07 13:05:18.397149 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2831/5706] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:16 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8 => generated 1367 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:18.519371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9da38dd8-a33e-4276-b41c-c0dfe442c809 req-b06828a8-5862-4a41-88d7-5a3d7c217c4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60b20969-b90f-43d0-997c-4ab915ece0d7", "tag": "dbee2a2b-e2d2-49d0-bad3-c856875f226b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:05:18.561149 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9da38dd8-a33e-4276-b41c-c0dfe442c809 req-b06828a8-5862-4a41-88d7-5a3d7c217c4c service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:18.562516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9da38dd8-a33e-4276-b41c-c0dfe442c809 req-b06828a8-5862-4a41-88d7-5a3d7c217c4c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:18.563596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9da38dd8-a33e-4276-b41c-c0dfe442c809 req-b06828a8-5862-4a41-88d7-5a3d7c217c4c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:18.569320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-225e4270-2fe4-492a-8d3a-3519f73b9049 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f6d286320b455da9a89337128684e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b718b41e479c4141bb4a1a12cfced511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:18.590240 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9da38dd8-a33e-4276-b41c-c0dfe442c809 req-b06828a8-5862-4a41-88d7-5a3d7c217c4c service nova] Creating event network-changed:dbee2a2b-e2d2-49d0-bad3-c856875f226b for instance 60b20969-b90f-43d0-997c-4ab915ece0d7 on n-h2-852087-9 Sep 07 13:05:18.592960 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-225e4270-2fe4-492a-8d3a-3519f73b9049 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] 10.222.0.16 "GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7" status: 200 len: 1313 microversion: 2.1 time: 1.570378 Sep 07 13:05:18.596757 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2876/5707] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:17 2022] GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7 => generated 1313 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:18.602321 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9da38dd8-a33e-4276-b41c-c0dfe442c809 req-b06828a8-5862-4a41-88d7-5a3d7c217c4c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098154 Sep 07 13:05:18.604083 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2832/5708] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:05:19.458354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-29523af3-1112-4bcf-aea4-16178340d97c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:19.460790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-29523af3-1112-4bcf-aea4-16178340d97c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:19.479529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29523af3-1112-4bcf-aea4-16178340d97c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:19.481085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29523af3-1112-4bcf-aea4-16178340d97c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:19.482322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29523af3-1112-4bcf-aea4-16178340d97c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:19.485250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29523af3-1112-4bcf-aea4-16178340d97c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:19.486911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29523af3-1112-4bcf-aea4-16178340d97c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:19.488145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29523af3-1112-4bcf-aea4-16178340d97c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:19.629544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-451889e8-a745-4262-a9c1-9e71284e1da3 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:19.636314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-451889e8-a745-4262-a9c1-9e71284e1da3 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] [instance: 60b20969-b90f-43d0-997c-4ab915ece0d7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:19.664408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-451889e8-a745-4262-a9c1-9e71284e1da3 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:19.665682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-451889e8-a745-4262-a9c1-9e71284e1da3 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:19.670400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-451889e8-a745-4262-a9c1-9e71284e1da3 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:19.672518 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-451889e8-a745-4262-a9c1-9e71284e1da3 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:19.673747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-451889e8-a745-4262-a9c1-9e71284e1da3 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:19.675022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-451889e8-a745-4262-a9c1-9e71284e1da3 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:20.407956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-29523af3-1112-4bcf-aea4-16178340d97c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:20.442452 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-29523af3-1112-4bcf-aea4-16178340d97c tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8" status: 200 len: 1367 microversion: 2.1 time: 0.994574 Sep 07 13:05:20.448802 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2877/5709] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:19 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8 => generated 1367 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:20.964710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-451889e8-a745-4262-a9c1-9e71284e1da3 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f6d286320b455da9a89337128684e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b718b41e479c4141bb4a1a12cfced511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:20.994772 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-451889e8-a745-4262-a9c1-9e71284e1da3 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] 10.222.0.16 "GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7" status: 200 len: 1313 microversion: 2.1 time: 1.363829 Sep 07 13:05:20.997899 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2833/5710] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:19 2022] GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7 => generated 1313 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:22.029537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2ab7fd3b-92e5-41e5-bae5-92493e672065 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:22.029537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2ab7fd3b-92e5-41e5-bae5-92493e672065 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] [instance: 60b20969-b90f-43d0-997c-4ab915ece0d7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:22.055573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ab7fd3b-92e5-41e5-bae5-92493e672065 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:22.057993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ab7fd3b-92e5-41e5-bae5-92493e672065 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:22.060114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ab7fd3b-92e5-41e5-bae5-92493e672065 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:22.064380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ab7fd3b-92e5-41e5-bae5-92493e672065 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:22.065245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ab7fd3b-92e5-41e5-bae5-92493e672065 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:22.066390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2ab7fd3b-92e5-41e5-bae5-92493e672065 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:22.192305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-81893bb1-1d76-44b7-9a78-a5c93d1aa964 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:22.195237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-81893bb1-1d76-44b7-9a78-a5c93d1aa964 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:22.215128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81893bb1-1d76-44b7-9a78-a5c93d1aa964 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:22.216294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81893bb1-1d76-44b7-9a78-a5c93d1aa964 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:22.217249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81893bb1-1d76-44b7-9a78-a5c93d1aa964 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:22.218590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81893bb1-1d76-44b7-9a78-a5c93d1aa964 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:22.219394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81893bb1-1d76-44b7-9a78-a5c93d1aa964 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:22.220481 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-81893bb1-1d76-44b7-9a78-a5c93d1aa964 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:22.773947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2ab7fd3b-92e5-41e5-bae5-92493e672065 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f6d286320b455da9a89337128684e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b718b41e479c4141bb4a1a12cfced511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:22.809977 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2ab7fd3b-92e5-41e5-bae5-92493e672065 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] 10.222.0.16 "GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7" status: 200 len: 1313 microversion: 2.1 time: 0.786651 Sep 07 13:05:22.818750 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2834/5711] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:22 2022] GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7 => generated 1313 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:05:22.842622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-7a48fa57-3b71-4b60-923c-4ee04cd6e6a4 req-1d8cb9c5-6787-412f-ab77-370e9cc12488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3531114-92cc-4ecb-a97c-0c05170f41f8", "name": "network-vif-plugged", "status": "completed", "tag": "02d26819-44be-494d-b371-66e56263bd4b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:05:22.879569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7a48fa57-3b71-4b60-923c-4ee04cd6e6a4 req-1d8cb9c5-6787-412f-ab77-370e9cc12488 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:22.880534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7a48fa57-3b71-4b60-923c-4ee04cd6e6a4 req-1d8cb9c5-6787-412f-ab77-370e9cc12488 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:22.884342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7a48fa57-3b71-4b60-923c-4ee04cd6e6a4 req-1d8cb9c5-6787-412f-ab77-370e9cc12488 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:22.930445 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7a48fa57-3b71-4b60-923c-4ee04cd6e6a4 req-1d8cb9c5-6787-412f-ab77-370e9cc12488 service nova] Creating event network-vif-plugged:02d26819-44be-494d-b371-66e56263bd4b for instance c3531114-92cc-4ecb-a97c-0c05170f41f8 on n-h1-852087-9 Sep 07 13:05:22.947783 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-7a48fa57-3b71-4b60-923c-4ee04cd6e6a4 req-1d8cb9c5-6787-412f-ab77-370e9cc12488 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125506 Sep 07 13:05:22.949901 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2835/5712] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:05:23.028829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-81893bb1-1d76-44b7-9a78-a5c93d1aa964 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:23.046363 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-81893bb1-1d76-44b7-9a78-a5c93d1aa964 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8" status: 200 len: 1367 microversion: 2.1 time: 1.577786 Sep 07 13:05:23.047413 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2878/5713] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:21 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8 => generated 1367 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:23.853367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32a7c2ea-5465-4738-83ea-24af761f94d0 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:23.859649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-32a7c2ea-5465-4738-83ea-24af761f94d0 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] [instance: 60b20969-b90f-43d0-997c-4ab915ece0d7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:23.894490 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32a7c2ea-5465-4738-83ea-24af761f94d0 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:23.896122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32a7c2ea-5465-4738-83ea-24af761f94d0 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:23.902782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32a7c2ea-5465-4738-83ea-24af761f94d0 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:23.904818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32a7c2ea-5465-4738-83ea-24af761f94d0 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:23.906481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32a7c2ea-5465-4738-83ea-24af761f94d0 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:23.907429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32a7c2ea-5465-4738-83ea-24af761f94d0 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:24.098918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f3d364e7-c498-401c-b7d4-634d2e95fadb tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:24.102334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f3d364e7-c498-401c-b7d4-634d2e95fadb tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:24.141371 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3d364e7-c498-401c-b7d4-634d2e95fadb tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:24.148576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3d364e7-c498-401c-b7d4-634d2e95fadb tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:24.149901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3d364e7-c498-401c-b7d4-634d2e95fadb tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:24.151423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3d364e7-c498-401c-b7d4-634d2e95fadb tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:24.155786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3d364e7-c498-401c-b7d4-634d2e95fadb tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:24.158550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f3d364e7-c498-401c-b7d4-634d2e95fadb tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:24.516899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-32a7c2ea-5465-4738-83ea-24af761f94d0 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f6d286320b455da9a89337128684e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b718b41e479c4141bb4a1a12cfced511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:24.594968 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-32a7c2ea-5465-4738-83ea-24af761f94d0 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] 10.222.0.16 "GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7" status: 200 len: 1313 microversion: 2.1 time: 0.749583 Sep 07 13:05:24.610985 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2836/5714] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:23 2022] GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7 => generated 1313 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:24.761446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f3d364e7-c498-401c-b7d4-634d2e95fadb tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:24.784146 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f3d364e7-c498-401c-b7d4-634d2e95fadb tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8" status: 200 len: 1367 microversion: 2.1 time: 0.693509 Sep 07 13:05:24.789084 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2879/5715] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:24 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8 => generated 1367 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:25.680075 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-54b8021c-2887-47ed-bcab-91c9c436e3b5 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:25.691048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-54b8021c-2887-47ed-bcab-91c9c436e3b5 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] [instance: 60b20969-b90f-43d0-997c-4ab915ece0d7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:25.734300 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54b8021c-2887-47ed-bcab-91c9c436e3b5 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:25.754702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54b8021c-2887-47ed-bcab-91c9c436e3b5 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:25.755571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54b8021c-2887-47ed-bcab-91c9c436e3b5 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:25.759875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54b8021c-2887-47ed-bcab-91c9c436e3b5 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:25.764420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54b8021c-2887-47ed-bcab-91c9c436e3b5 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:25.765429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54b8021c-2887-47ed-bcab-91c9c436e3b5 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:25.850142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6363226a-f5a0-4b34-bdde-a43e3b928026 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:25.851488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6363226a-f5a0-4b34-bdde-a43e3b928026 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:25.927844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6363226a-f5a0-4b34-bdde-a43e3b928026 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:25.929084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6363226a-f5a0-4b34-bdde-a43e3b928026 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:25.932262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6363226a-f5a0-4b34-bdde-a43e3b928026 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:25.937325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6363226a-f5a0-4b34-bdde-a43e3b928026 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:25.952719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6363226a-f5a0-4b34-bdde-a43e3b928026 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:25.957684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6363226a-f5a0-4b34-bdde-a43e3b928026 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:27.073235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-54b8021c-2887-47ed-bcab-91c9c436e3b5 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f6d286320b455da9a89337128684e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b718b41e479c4141bb4a1a12cfced511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:27.155801 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-54b8021c-2887-47ed-bcab-91c9c436e3b5 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] 10.222.0.16 "GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7" status: 200 len: 1313 microversion: 2.1 time: 1.485480 Sep 07 13:05:27.175423 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2837/5716] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:25 2022] GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7 => generated 1313 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:27.683081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-0d7b54ee-9e3e-4f9c-8313-bf5ce5f4db8b req-a2adb038-3005-45f2-bc90-d4dbf0f6b70e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60b20969-b90f-43d0-997c-4ab915ece0d7", "name": "network-vif-plugged", "status": "completed", "tag": "dbee2a2b-e2d2-49d0-bad3-c856875f226b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:05:27.736393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0d7b54ee-9e3e-4f9c-8313-bf5ce5f4db8b req-a2adb038-3005-45f2-bc90-d4dbf0f6b70e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:27.741343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0d7b54ee-9e3e-4f9c-8313-bf5ce5f4db8b req-a2adb038-3005-45f2-bc90-d4dbf0f6b70e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:27.742272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0d7b54ee-9e3e-4f9c-8313-bf5ce5f4db8b req-a2adb038-3005-45f2-bc90-d4dbf0f6b70e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:27.799546 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-0d7b54ee-9e3e-4f9c-8313-bf5ce5f4db8b req-a2adb038-3005-45f2-bc90-d4dbf0f6b70e service nova] Creating event network-vif-plugged:dbee2a2b-e2d2-49d0-bad3-c856875f226b for instance 60b20969-b90f-43d0-997c-4ab915ece0d7 on n-h2-852087-9 Sep 07 13:05:27.844691 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-0d7b54ee-9e3e-4f9c-8313-bf5ce5f4db8b req-a2adb038-3005-45f2-bc90-d4dbf0f6b70e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168290 Sep 07 13:05:27.849830 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2838/5717] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:05:28.220021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-18e5a6bb-0c99-4a81-b64b-a265db0e4e6f tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:28.221577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-18e5a6bb-0c99-4a81-b64b-a265db0e4e6f tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] [instance: 60b20969-b90f-43d0-997c-4ab915ece0d7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:28.231320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18e5a6bb-0c99-4a81-b64b-a265db0e4e6f tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:28.232518 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18e5a6bb-0c99-4a81-b64b-a265db0e4e6f tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:28.235435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18e5a6bb-0c99-4a81-b64b-a265db0e4e6f tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:28.236748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18e5a6bb-0c99-4a81-b64b-a265db0e4e6f tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:28.237767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18e5a6bb-0c99-4a81-b64b-a265db0e4e6f tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:28.238426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18e5a6bb-0c99-4a81-b64b-a265db0e4e6f tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:28.244125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6363226a-f5a0-4b34-bdde-a43e3b928026 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:28.254744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=63 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:28.270841 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6363226a-f5a0-4b34-bdde-a43e3b928026 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8" status: 200 len: 1556 microversion: 2.1 time: 2.424454 Sep 07 13:05:28.278337 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2880/5718] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:25 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8 => generated 1556 bytes in 2438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:05:28.310376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3e65c5a2-9990-4e30-9ceb-6193f804557a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:28.311343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3e65c5a2-9990-4e30-9ceb-6193f804557a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:28.328336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e65c5a2-9990-4e30-9ceb-6193f804557a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:28.329416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e65c5a2-9990-4e30-9ceb-6193f804557a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:28.331164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e65c5a2-9990-4e30-9ceb-6193f804557a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:28.332920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e65c5a2-9990-4e30-9ceb-6193f804557a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:28.339694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e65c5a2-9990-4e30-9ceb-6193f804557a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:28.340776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e65c5a2-9990-4e30-9ceb-6193f804557a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:28.927279 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3e65c5a2-9990-4e30-9ceb-6193f804557a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.624681 Sep 07 13:05:28.928439 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2881/5719] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Sep 7 13:05:28 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-interface => generated 284 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:05:29.037429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-18e5a6bb-0c99-4a81-b64b-a265db0e4e6f tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f6d286320b455da9a89337128684e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b718b41e479c4141bb4a1a12cfced511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:29.061542 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-18e5a6bb-0c99-4a81-b64b-a265db0e4e6f tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] 10.222.0.16 "GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7" status: 200 len: 1313 microversion: 2.1 time: 0.849438 Sep 07 13:05:29.074935 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2839/5720] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:28 2022] GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7 => generated 1313 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:30.136053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-439794ac-ceed-4c88-8011-25d0ed23d1fa tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:30.136868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-439794ac-ceed-4c88-8011-25d0ed23d1fa tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] [instance: 60b20969-b90f-43d0-997c-4ab915ece0d7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:30.183317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-439794ac-ceed-4c88-8011-25d0ed23d1fa tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:30.184133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-439794ac-ceed-4c88-8011-25d0ed23d1fa tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:30.184603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-439794ac-ceed-4c88-8011-25d0ed23d1fa tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:30.194590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-439794ac-ceed-4c88-8011-25d0ed23d1fa tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:30.197569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-439794ac-ceed-4c88-8011-25d0ed23d1fa tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:30.197944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-439794ac-ceed-4c88-8011-25d0ed23d1fa tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:30.860524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-439794ac-ceed-4c88-8011-25d0ed23d1fa tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f6d286320b455da9a89337128684e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b718b41e479c4141bb4a1a12cfced511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:30.913454 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-439794ac-ceed-4c88-8011-25d0ed23d1fa tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] 10.222.0.16 "GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7" status: 200 len: 1313 microversion: 2.1 time: 0.813189 Sep 07 13:05:30.915831 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2882/5721] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:30 2022] GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7 => generated 1313 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:31.942849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2988ca4a-cc0d-48ee-aa77-47087a6d7446 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:31.946841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2988ca4a-cc0d-48ee-aa77-47087a6d7446 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] [instance: 60b20969-b90f-43d0-997c-4ab915ece0d7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:31.971928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2988ca4a-cc0d-48ee-aa77-47087a6d7446 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:31.978184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2988ca4a-cc0d-48ee-aa77-47087a6d7446 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:31.979468 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2988ca4a-cc0d-48ee-aa77-47087a6d7446 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:31.981311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2988ca4a-cc0d-48ee-aa77-47087a6d7446 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:31.984442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2988ca4a-cc0d-48ee-aa77-47087a6d7446 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:31.986105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2988ca4a-cc0d-48ee-aa77-47087a6d7446 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:32.008138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=75 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:32.733588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2988ca4a-cc0d-48ee-aa77-47087a6d7446 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f6d286320b455da9a89337128684e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b718b41e479c4141bb4a1a12cfced511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:32.765317 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2988ca4a-cc0d-48ee-aa77-47087a6d7446 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] 10.222.0.16 "GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7" status: 200 len: 1497 microversion: 2.1 time: 0.827296 Sep 07 13:05:32.768098 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2840/5722] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:31 2022] GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7 => generated 1497 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:33.423418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-49520af7-6e25-481a-952d-dac4a7163a21 req-0efeb629-2fa9-4cc4-bbe6-d4a9a9dcfd66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3531114-92cc-4ecb-a97c-0c05170f41f8", "tag": "02d26819-44be-494d-b371-66e56263bd4b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:05:33.443629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=34 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:33.475870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-49520af7-6e25-481a-952d-dac4a7163a21 req-0efeb629-2fa9-4cc4-bbe6-d4a9a9dcfd66 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:33.479821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-49520af7-6e25-481a-952d-dac4a7163a21 req-0efeb629-2fa9-4cc4-bbe6-d4a9a9dcfd66 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:33.482620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-49520af7-6e25-481a-952d-dac4a7163a21 req-0efeb629-2fa9-4cc4-bbe6-d4a9a9dcfd66 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:33.520269 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-49520af7-6e25-481a-952d-dac4a7163a21 req-0efeb629-2fa9-4cc4-bbe6-d4a9a9dcfd66 service nova] Creating event network-changed:02d26819-44be-494d-b371-66e56263bd4b for instance c3531114-92cc-4ecb-a97c-0c05170f41f8 on n-h1-852087-9 Sep 07 13:05:33.545858 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-49520af7-6e25-481a-952d-dac4a7163a21 req-0efeb629-2fa9-4cc4-bbe6-d4a9a9dcfd66 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124203 Sep 07 13:05:33.546793 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2883/5723] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:05:40.665909 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aeb11b31-d59c-428b-bcfa-0e616b463381 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:40.666862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aeb11b31-d59c-428b-bcfa-0e616b463381 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] [instance: 60b20969-b90f-43d0-997c-4ab915ece0d7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:40.695289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=24 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:40.716523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aeb11b31-d59c-428b-bcfa-0e616b463381 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:40.719216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aeb11b31-d59c-428b-bcfa-0e616b463381 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:40.720475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aeb11b31-d59c-428b-bcfa-0e616b463381 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:40.722233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aeb11b31-d59c-428b-bcfa-0e616b463381 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:40.723407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aeb11b31-d59c-428b-bcfa-0e616b463381 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:40.724314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aeb11b31-d59c-428b-bcfa-0e616b463381 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:40.846444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aeb11b31-d59c-428b-bcfa-0e616b463381 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] [instance: 60b20969-b90f-43d0-997c-4ab915ece0d7] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:05:41.068808 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aeb11b31-d59c-428b-bcfa-0e616b463381 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] 10.222.0.16 "DELETE /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7" status: 204 len: 0 microversion: 2.1 time: 0.410464 Sep 07 13:05:41.070138 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2841/5724] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:05:40 2022] DELETE /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:05:41.090523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6b6a7490-2401-49ce-bc58-983dedabcc5c tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:41.098102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6b6a7490-2401-49ce-bc58-983dedabcc5c tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] [instance: 60b20969-b90f-43d0-997c-4ab915ece0d7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:41.131368 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b6a7490-2401-49ce-bc58-983dedabcc5c tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:41.133631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b6a7490-2401-49ce-bc58-983dedabcc5c tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:41.135960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b6a7490-2401-49ce-bc58-983dedabcc5c tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:41.141356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b6a7490-2401-49ce-bc58-983dedabcc5c tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:41.142916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b6a7490-2401-49ce-bc58-983dedabcc5c tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:41.146761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b6a7490-2401-49ce-bc58-983dedabcc5c tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:41.677235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6b6a7490-2401-49ce-bc58-983dedabcc5c tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f6d286320b455da9a89337128684e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b718b41e479c4141bb4a1a12cfced511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:41.755111 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6b6a7490-2401-49ce-bc58-983dedabcc5c tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] 10.222.0.16 "GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7" status: 200 len: 1503 microversion: 2.1 time: 0.674872 Sep 07 13:05:41.761830 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2884/5725] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:41 2022] GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7 => generated 1503 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:42.784678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e6cd926-c99c-48fb-943f-3ca7e396da08 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:42.790629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6e6cd926-c99c-48fb-943f-3ca7e396da08 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] [instance: 60b20969-b90f-43d0-997c-4ab915ece0d7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:42.826507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e6cd926-c99c-48fb-943f-3ca7e396da08 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:42.826927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e6cd926-c99c-48fb-943f-3ca7e396da08 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:42.827719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e6cd926-c99c-48fb-943f-3ca7e396da08 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:42.829148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e6cd926-c99c-48fb-943f-3ca7e396da08 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:42.862097 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e6cd926-c99c-48fb-943f-3ca7e396da08 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:42.863026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e6cd926-c99c-48fb-943f-3ca7e396da08 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:43.458050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6e6cd926-c99c-48fb-943f-3ca7e396da08 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f6d286320b455da9a89337128684e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b718b41e479c4141bb4a1a12cfced511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:43.475366 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6e6cd926-c99c-48fb-943f-3ca7e396da08 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] 10.222.0.16 "GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7" status: 200 len: 1503 microversion: 2.1 time: 0.698779 Sep 07 13:05:43.476320 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2842/5726] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:42 2022] GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7 => generated 1503 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:43.890775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9a0f2553-582b-46e0-83ba-1a2b5df87a74 tempest-PortsAdminExtendedAttrsTestJSON-1347309479 tempest-PortsAdminExtendedAttrsTestJSON-1347309479-project-admin] Calling method '.version_select at 0x7fc413e46550>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:43.902216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a0f2553-582b-46e0-83ba-1a2b5df87a74 tempest-PortsAdminExtendedAttrsTestJSON-1347309479 tempest-PortsAdminExtendedAttrsTestJSON-1347309479-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:43.905466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a0f2553-582b-46e0-83ba-1a2b5df87a74 tempest-PortsAdminExtendedAttrsTestJSON-1347309479 tempest-PortsAdminExtendedAttrsTestJSON-1347309479-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:43.915087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a0f2553-582b-46e0-83ba-1a2b5df87a74 tempest-PortsAdminExtendedAttrsTestJSON-1347309479 tempest-PortsAdminExtendedAttrsTestJSON-1347309479-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:43.944569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a0f2553-582b-46e0-83ba-1a2b5df87a74 tempest-PortsAdminExtendedAttrsTestJSON-1347309479 tempest-PortsAdminExtendedAttrsTestJSON-1347309479-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:43.945661 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a0f2553-582b-46e0-83ba-1a2b5df87a74 tempest-PortsAdminExtendedAttrsTestJSON-1347309479 tempest-PortsAdminExtendedAttrsTestJSON-1347309479-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:43.946481 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a0f2553-582b-46e0-83ba-1a2b5df87a74 tempest-PortsAdminExtendedAttrsTestJSON-1347309479 tempest-PortsAdminExtendedAttrsTestJSON-1347309479-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:43.977394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a0f2553-582b-46e0-83ba-1a2b5df87a74 tempest-PortsAdminExtendedAttrsTestJSON-1347309479 tempest-PortsAdminExtendedAttrsTestJSON-1347309479-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:43.982856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a0f2553-582b-46e0-83ba-1a2b5df87a74 tempest-PortsAdminExtendedAttrsTestJSON-1347309479 tempest-PortsAdminExtendedAttrsTestJSON-1347309479-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:43.985291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a0f2553-582b-46e0-83ba-1a2b5df87a74 tempest-PortsAdminExtendedAttrsTestJSON-1347309479 tempest-PortsAdminExtendedAttrsTestJSON-1347309479-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:43.996441 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9a0f2553-582b-46e0-83ba-1a2b5df87a74 tempest-PortsAdminExtendedAttrsTestJSON-1347309479 tempest-PortsAdminExtendedAttrsTestJSON-1347309479-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.911366 Sep 07 13:05:44.001336 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2885/5727] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 13:05:43 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:05:44.536724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-90be2765-abe9-4aee-8d6c-65a926ea1ffa tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:44.541832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-90be2765-abe9-4aee-8d6c-65a926ea1ffa tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] [instance: 60b20969-b90f-43d0-997c-4ab915ece0d7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:44.612150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90be2765-abe9-4aee-8d6c-65a926ea1ffa tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:44.616869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90be2765-abe9-4aee-8d6c-65a926ea1ffa tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:44.620230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90be2765-abe9-4aee-8d6c-65a926ea1ffa tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:44.622182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90be2765-abe9-4aee-8d6c-65a926ea1ffa tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:44.623912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90be2765-abe9-4aee-8d6c-65a926ea1ffa tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:44.625968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-90be2765-abe9-4aee-8d6c-65a926ea1ffa tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:45.341852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-90be2765-abe9-4aee-8d6c-65a926ea1ffa tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f6d286320b455da9a89337128684e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b718b41e479c4141bb4a1a12cfced511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:45.363078 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-90be2765-abe9-4aee-8d6c-65a926ea1ffa tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] 10.222.0.16 "GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7" status: 200 len: 1503 microversion: 2.1 time: 0.841643 Sep 07 13:05:45.363707 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2843/5728] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:44 2022] GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7 => generated 1503 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:46.407026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c919573-9ee5-43d2-b4f4-55e2608bb413 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:46.424042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7c919573-9ee5-43d2-b4f4-55e2608bb413 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] [instance: 60b20969-b90f-43d0-997c-4ab915ece0d7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:46.470225 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c919573-9ee5-43d2-b4f4-55e2608bb413 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:46.480501 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c919573-9ee5-43d2-b4f4-55e2608bb413 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:46.482066 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c919573-9ee5-43d2-b4f4-55e2608bb413 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:46.483878 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c919573-9ee5-43d2-b4f4-55e2608bb413 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:46.485090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c919573-9ee5-43d2-b4f4-55e2608bb413 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:46.486167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c919573-9ee5-43d2-b4f4-55e2608bb413 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:46.672189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-06972d1b-062e-44f9-a77b-52fe44a2a875 req-9e997652-64f1-468f-9494-d9849fb1d14d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60b20969-b90f-43d0-997c-4ab915ece0d7", "name": "network-vif-deleted", "tag": "dbee2a2b-e2d2-49d0-bad3-c856875f226b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:05:46.732239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-06972d1b-062e-44f9-a77b-52fe44a2a875 req-9e997652-64f1-468f-9494-d9849fb1d14d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:46.736104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-06972d1b-062e-44f9-a77b-52fe44a2a875 req-9e997652-64f1-468f-9494-d9849fb1d14d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:46.738518 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-06972d1b-062e-44f9-a77b-52fe44a2a875 req-9e997652-64f1-468f-9494-d9849fb1d14d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:46.772458 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-06972d1b-062e-44f9-a77b-52fe44a2a875 req-9e997652-64f1-468f-9494-d9849fb1d14d service nova] Creating event network-vif-deleted:dbee2a2b-e2d2-49d0-bad3-c856875f226b for instance 60b20969-b90f-43d0-997c-4ab915ece0d7 on n-h2-852087-9 Sep 07 13:05:46.775226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7c919573-9ee5-43d2-b4f4-55e2608bb413 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f6d286320b455da9a89337128684e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b718b41e479c4141bb4a1a12cfced511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:05:46.789034 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-06972d1b-062e-44f9-a77b-52fe44a2a875 req-9e997652-64f1-468f-9494-d9849fb1d14d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120433 Sep 07 13:05:46.791148 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2844/5729] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:05:46.804717 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7c919573-9ee5-43d2-b4f4-55e2608bb413 tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] 10.222.0.16 "GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7" status: 200 len: 1461 microversion: 2.1 time: 0.405581 Sep 07 13:05:46.806958 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2886/5730] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:46 2022] GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7 => generated 1461 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:05:47.846047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8ccaf2f4-e46f-48b1-9f77-0d1594a3fa7b tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:05:47.849953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8ccaf2f4-e46f-48b1-9f77-0d1594a3fa7b tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] [instance: 60b20969-b90f-43d0-997c-4ab915ece0d7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:05:47.869648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ccaf2f4-e46f-48b1-9f77-0d1594a3fa7b tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:47.871087 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ccaf2f4-e46f-48b1-9f77-0d1594a3fa7b tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:47.872382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ccaf2f4-e46f-48b1-9f77-0d1594a3fa7b tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:47.874382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ccaf2f4-e46f-48b1-9f77-0d1594a3fa7b tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:05:47.875552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ccaf2f4-e46f-48b1-9f77-0d1594a3fa7b tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:05:47.877447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ccaf2f4-e46f-48b1-9f77-0d1594a3fa7b tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:05:47.916568 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-8ccaf2f4-e46f-48b1-9f77-0d1594a3fa7b tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] HTTP exception thrown: Instance 60b20969-b90f-43d0-997c-4ab915ece0d7 could not be found. Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8ccaf2f4-e46f-48b1-9f77-0d1594a3fa7b tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Request method failure captured: Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7 HTTP/1.1 Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJbtNCM9gbGEF2tc3QBlm-0nNJs94kY9Iy5MdUWwetEylsgohSVnJznkFL4MKVFkV1fDic7NvX85jlE6LuAOYlBcgfXb9RpxLaC5mQRxF-4keZLpJDO0MtInMItOQF3_h7kRDIl6Tvf0LIbkFQRZEnJ3FQZufjFpHT5Ur1FyEQi_iWM Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: b718b41e479c4141bb4a1a12cfced511 Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-VolumesActionsTest-898435301 Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b718b41e479c4141bb4a1a12cfced511"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b718b41e479c4141bb4a1a12cfced511"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b718b41e479c4141bb4a1a12cfced511"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b718b41e479c4141bb4a1a12cfced511"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-VolumesActionsTest-898435301 Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: b718b41e479c4141bb4a1a12cfced511 Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-VolumesActionsTest-898435301 Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-VolumesActionsTest-898435301-project Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 40f6d286320b455da9a89337128684e5 Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-VolumesActionsTest-898435301-project Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 60b20969-b90f-43d0-997c-4ab915ece0d7 could not be found. Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '60b20969-b90f-43d0-997c-4ab915ece0d7'} Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60b20969-b90f-43d0-997c-4ab915ece0d7 could not be found. Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60b20969-b90f-43d0-997c-4ab915ece0d7 could not be found. Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:05:47.935781 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:05:47.945791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:05:47.945791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:05:47.945791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:05:47.945791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:05:47.945791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:05:47.945791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60b20969-b90f-43d0-997c-4ab915ece0d7 could not be found. Sep 07 13:05:47.945791 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:05:47.950440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8ccaf2f4-e46f-48b1-9f77-0d1594a3fa7b tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] Returning 404 to user: Instance 60b20969-b90f-43d0-997c-4ab915ece0d7 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:05:47.954388 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8ccaf2f4-e46f-48b1-9f77-0d1594a3fa7b tempest-VolumesActionsTest-898435301 tempest-VolumesActionsTest-898435301-project] 10.222.0.16 "GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7" status: 404 len: 111 microversion: 2.1 time: 0.121709 Sep 07 13:05:47.957074 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2845/5731] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:05:47 2022] GET /compute/v2.1/servers/60b20969-b90f-43d0-997c-4ab915ece0d7 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:06:34.302055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0417e041-08b4-42be-8798-7250155dd9de tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:06:34.304542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0417e041-08b4-42be-8798-7250155dd9de tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:34.328792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=9 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:34.338383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=31 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:34.341469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0417e041-08b4-42be-8798-7250155dd9de tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:34.342632 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0417e041-08b4-42be-8798-7250155dd9de tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:34.343366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0417e041-08b4-42be-8798-7250155dd9de tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:34.347021 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0417e041-08b4-42be-8798-7250155dd9de tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:34.349077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0417e041-08b4-42be-8798-7250155dd9de tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:34.353683 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0417e041-08b4-42be-8798-7250155dd9de tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:34.533585 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0417e041-08b4-42be-8798-7250155dd9de tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/ips" status: 200 len: 149 microversion: 2.1 time: 0.239969 Sep 07 13:06:34.540987 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2887/5732] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Sep 7 13:06:34 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/ips => generated 149 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:06:39.464516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a49df434-6de1-4bc2-9e86-fcb1bee2404f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4078109-e1db-4e52-aeef-f26252ab5fb4"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:06:39.467354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a49df434-6de1-4bc2-9e86-fcb1bee2404f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:06:39.482727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:39.484798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:39.504606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a49df434-6de1-4bc2-9e86-fcb1bee2404f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:39.505422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a49df434-6de1-4bc2-9e86-fcb1bee2404f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:39.507428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a49df434-6de1-4bc2-9e86-fcb1bee2404f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:39.508209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a49df434-6de1-4bc2-9e86-fcb1bee2404f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:06:39.508688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a49df434-6de1-4bc2-9e86-fcb1bee2404f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:06:39.509122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a49df434-6de1-4bc2-9e86-fcb1bee2404f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:06:40.384689 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a49df434-6de1-4bc2-9e86-fcb1bee2404f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "POST /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.923615 Sep 07 13:06:40.395319 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2846/5733] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Sep 7 13:06:39 2022] POST /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments => generated 194 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:07:02.509020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-12fdec20-61fd-4ec6-b176-5b6a47351203 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4078109-e1db-4e52-aeef-f26252ab5fb4"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:07:02.524301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-12fdec20-61fd-4ec6-b176-5b6a47351203 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:02.544863 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 07 13:07:02.550038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:02.553341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:02.558043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12fdec20-61fd-4ec6-b176-5b6a47351203 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:02.559799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12fdec20-61fd-4ec6-b176-5b6a47351203 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:02.560962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12fdec20-61fd-4ec6-b176-5b6a47351203 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:02.564491 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12fdec20-61fd-4ec6-b176-5b6a47351203 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:02.566331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12fdec20-61fd-4ec6-b176-5b6a47351203 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:02.567362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12fdec20-61fd-4ec6-b176-5b6a47351203 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:02.777569 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-12fdec20-61fd-4ec6-b176-5b6a47351203 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] HTTP exception thrown: Invalid volume: volume f4078109-e1db-4e52-aeef-f26252ab5fb4 is already attached to instances: c3531114-92cc-4ecb-a97c-0c05170f41f8 Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-12fdec20-61fd-4ec6-b176-5b6a47351203 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Request method failure captured: Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments HTTP/1.1 Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 74 Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJXjmtPm9YRFN-tztsi8TNQI9Hp8XLmIE4m4vovyCrvi10-eliNzw5RJ69qhXEwc5_GMz3l7wuK2ojP23vdsllISKFk4XviY8iZt7qikWDIyUcyEqbNGcGcZaYafPWwxZ6tUqEf0DAj26macVBxWQF5nsZe6v99sjs3_jT8xGYwPOpM Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: c9f85a4002bd40eb8514aa91056c77d8 Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: {"volumeAttachment": {"volumeId": "f4078109-e1db-4e52-aeef-f26252ab5fb4"}} Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: exception: Invalid volume: volume f4078109-e1db-4e52-aeef-f26252ab5fb4 is already attached to instances: c3531114-92cc-4ecb-a97c-0c05170f41f8 Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'server_id': 'c3531114-92cc-4ecb-a97c-0c05170f41f8', 'body': {'volumeAttachment': {'volumeId': 'f4078109-e1db-4e52-aeef-f26252ab5fb4'}}} Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f4078109-e1db-4e52-aeef-f26252ab5fb4 is already attached to instances: c3531114-92cc-4ecb-a97c-0c05170f41f8 Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:07:02.794889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:07:02.798574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:07:02.798574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:07:02.798574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 07 13:07:02.798574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 13:07:02.798574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f4078109-e1db-4e52-aeef-f26252ab5fb4 is already attached to instances: c3531114-92cc-4ecb-a97c-0c05170f41f8 Sep 07 13:07:02.798574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:07:02.798574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:07:02.798574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:07:02.798574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:07:02.798574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:07:02.798574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:07:02.798574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:07:02.798574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:07:02.798574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f4078109-e1db-4e52-aeef-f26252ab5fb4 is already attached to instances: c3531114-92cc-4ecb-a97c-0c05170f41f8 Sep 07 13:07:02.798574 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:07:02.798574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-12fdec20-61fd-4ec6-b176-5b6a47351203 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Returning 400 to user: Invalid volume: volume f4078109-e1db-4e52-aeef-f26252ab5fb4 is already attached to instances: c3531114-92cc-4ecb-a97c-0c05170f41f8 {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:07:02.798574 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-12fdec20-61fd-4ec6-b176-5b6a47351203 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "POST /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.298796 Sep 07 13:07:02.798574 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2888/5734] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Sep 7 13:07:02 2022] POST /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments => generated 174 bytes in 301 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:07:02.981424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:02.983019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:03.009304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e5edbbfd-10e4-44cd-806c-57bfdead23a8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:03.018156 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e5edbbfd-10e4-44cd-806c-57bfdead23a8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:03.042331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5edbbfd-10e4-44cd-806c-57bfdead23a8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:03.047999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5edbbfd-10e4-44cd-806c-57bfdead23a8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:03.049856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5edbbfd-10e4-44cd-806c-57bfdead23a8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:03.052259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5edbbfd-10e4-44cd-806c-57bfdead23a8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:03.056605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5edbbfd-10e4-44cd-806c-57bfdead23a8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:03.059681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5edbbfd-10e4-44cd-806c-57bfdead23a8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:03.323223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-e5edbbfd-10e4-44cd-806c-57bfdead23a8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lazy-loading 'services' on Instance uuid c3531114-92cc-4ecb-a97c-0c05170f41f8 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:07:03.654617 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e5edbbfd-10e4-44cd-806c-57bfdead23a8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments/f4078109-e1db-4e52-aeef-f26252ab5fb4" status: 202 len: 0 microversion: 2.1 time: 0.677239 Sep 07 13:07:03.655703 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2847/5735] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Sep 7 13:07:02 2022] DELETE /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments/f4078109-e1db-4e52-aeef-f26252ab5fb4 => generated 0 bytes in 680 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:07:03.666743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f442276-1c36-4f43-b953-76d2a0e2629a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:03.670429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0f442276-1c36-4f43-b953-76d2a0e2629a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:03.694548 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f442276-1c36-4f43-b953-76d2a0e2629a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:03.695798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f442276-1c36-4f43-b953-76d2a0e2629a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:03.698260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f442276-1c36-4f43-b953-76d2a0e2629a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:03.699437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f442276-1c36-4f43-b953-76d2a0e2629a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:03.705289 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f442276-1c36-4f43-b953-76d2a0e2629a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:03.707236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f442276-1c36-4f43-b953-76d2a0e2629a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:03.854008 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0f442276-1c36-4f43-b953-76d2a0e2629a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.192463 Sep 07 13:07:03.855293 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2889/5736] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:07:03 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:07:04.874256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-09c12ff9-ed0f-480f-87ab-2c07e5c7cf12 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:04.881229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-09c12ff9-ed0f-480f-87ab-2c07e5c7cf12 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:04.907351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09c12ff9-ed0f-480f-87ab-2c07e5c7cf12 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:04.910309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09c12ff9-ed0f-480f-87ab-2c07e5c7cf12 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:04.911308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09c12ff9-ed0f-480f-87ab-2c07e5c7cf12 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:04.914382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09c12ff9-ed0f-480f-87ab-2c07e5c7cf12 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:04.917964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09c12ff9-ed0f-480f-87ab-2c07e5c7cf12 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:04.918698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09c12ff9-ed0f-480f-87ab-2c07e5c7cf12 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:05.040648 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-09c12ff9-ed0f-480f-87ab-2c07e5c7cf12 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172182 Sep 07 13:07:05.043800 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2848/5737] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:07:04 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:07:06.072149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3f9fcced-23d4-440f-89a1-d04ab13c9e84 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:06.076595 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3f9fcced-23d4-440f-89a1-d04ab13c9e84 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:06.109227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f9fcced-23d4-440f-89a1-d04ab13c9e84 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:06.109785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f9fcced-23d4-440f-89a1-d04ab13c9e84 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:06.110243 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f9fcced-23d4-440f-89a1-d04ab13c9e84 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:06.118178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f9fcced-23d4-440f-89a1-d04ab13c9e84 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:06.120678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f9fcced-23d4-440f-89a1-d04ab13c9e84 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:06.120678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f9fcced-23d4-440f-89a1-d04ab13c9e84 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:06.236731 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3f9fcced-23d4-440f-89a1-d04ab13c9e84 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179308 Sep 07 13:07:06.242083 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2890/5738] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:07:06 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:07:07.258755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1679ab11-b144-456f-a8c5-4fa6fba2e567 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:07.261298 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1679ab11-b144-456f-a8c5-4fa6fba2e567 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:07.280887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1679ab11-b144-456f-a8c5-4fa6fba2e567 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:07.280887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1679ab11-b144-456f-a8c5-4fa6fba2e567 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:07.280887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1679ab11-b144-456f-a8c5-4fa6fba2e567 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:07.280887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1679ab11-b144-456f-a8c5-4fa6fba2e567 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:07.280887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1679ab11-b144-456f-a8c5-4fa6fba2e567 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:07.280887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1679ab11-b144-456f-a8c5-4fa6fba2e567 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:07.478308 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1679ab11-b144-456f-a8c5-4fa6fba2e567 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.220822 Sep 07 13:07:07.480374 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2849/5739] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:07:07 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments => generated 197 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:07:08.498503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-716a9b3b-69f2-44a4-9e8c-44ea8092fc88 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:08.502789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-716a9b3b-69f2-44a4-9e8c-44ea8092fc88 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:08.522929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-716a9b3b-69f2-44a4-9e8c-44ea8092fc88 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:08.523530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-716a9b3b-69f2-44a4-9e8c-44ea8092fc88 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:08.523984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-716a9b3b-69f2-44a4-9e8c-44ea8092fc88 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:08.524769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-716a9b3b-69f2-44a4-9e8c-44ea8092fc88 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:08.527074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-716a9b3b-69f2-44a4-9e8c-44ea8092fc88 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:08.527788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-716a9b3b-69f2-44a4-9e8c-44ea8092fc88 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:08.669629 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-716a9b3b-69f2-44a4-9e8c-44ea8092fc88 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175788 Sep 07 13:07:08.671036 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2891/5740] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:07:08 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:07:09.683982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-556f555d-e614-44b2-b315-e556e81fd496 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:09.686921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-556f555d-e614-44b2-b315-e556e81fd496 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:09.706504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-556f555d-e614-44b2-b315-e556e81fd496 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:09.707172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-556f555d-e614-44b2-b315-e556e81fd496 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:09.710386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-556f555d-e614-44b2-b315-e556e81fd496 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:09.711565 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-556f555d-e614-44b2-b315-e556e81fd496 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:09.713270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-556f555d-e614-44b2-b315-e556e81fd496 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:09.714039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-556f555d-e614-44b2-b315-e556e81fd496 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:09.796129 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-556f555d-e614-44b2-b315-e556e81fd496 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114564 Sep 07 13:07:09.798494 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2850/5741] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:07:09 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:07:10.819916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9d06c50e-f520-4345-a891-f0915c5e9a6a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:10.833037 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9d06c50e-f520-4345-a891-f0915c5e9a6a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:10.874920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d06c50e-f520-4345-a891-f0915c5e9a6a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:10.876059 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d06c50e-f520-4345-a891-f0915c5e9a6a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:10.877083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d06c50e-f520-4345-a891-f0915c5e9a6a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:10.878608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d06c50e-f520-4345-a891-f0915c5e9a6a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:10.879259 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d06c50e-f520-4345-a891-f0915c5e9a6a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:10.894264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9d06c50e-f520-4345-a891-f0915c5e9a6a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:11.144163 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9d06c50e-f520-4345-a891-f0915c5e9a6a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.330585 Sep 07 13:07:11.147848 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2892/5742] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:07:10 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments => generated 197 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:07:12.163655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-93bc25d4-5742-4a81-b550-a6909de7cbb8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:12.165593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-93bc25d4-5742-4a81-b550-a6909de7cbb8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:12.202414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93bc25d4-5742-4a81-b550-a6909de7cbb8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:12.202414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93bc25d4-5742-4a81-b550-a6909de7cbb8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:12.202732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93bc25d4-5742-4a81-b550-a6909de7cbb8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:12.203605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93bc25d4-5742-4a81-b550-a6909de7cbb8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:12.217910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93bc25d4-5742-4a81-b550-a6909de7cbb8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:12.217910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93bc25d4-5742-4a81-b550-a6909de7cbb8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:12.367211 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-93bc25d4-5742-4a81-b550-a6909de7cbb8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.205019 Sep 07 13:07:12.368168 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2851/5743] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:07:12 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments => generated 197 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:07:13.384549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4eb76311-5fe1-449c-828d-4e3a10b8d7c5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:13.387141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4eb76311-5fe1-449c-828d-4e3a10b8d7c5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:13.401284 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4eb76311-5fe1-449c-828d-4e3a10b8d7c5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:13.401827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4eb76311-5fe1-449c-828d-4e3a10b8d7c5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:13.402275 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4eb76311-5fe1-449c-828d-4e3a10b8d7c5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:13.403106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4eb76311-5fe1-449c-828d-4e3a10b8d7c5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:13.418295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4eb76311-5fe1-449c-828d-4e3a10b8d7c5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:13.424286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4eb76311-5fe1-449c-828d-4e3a10b8d7c5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:13.512953 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4eb76311-5fe1-449c-828d-4e3a10b8d7c5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131052 Sep 07 13:07:13.515543 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2893/5744] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:07:13 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:07:14.528445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8ac6f225-6013-4d77-8294-706fac1d6aad tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:14.531746 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8ac6f225-6013-4d77-8294-706fac1d6aad tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:14.554394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ac6f225-6013-4d77-8294-706fac1d6aad tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:14.562537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ac6f225-6013-4d77-8294-706fac1d6aad tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:14.563416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ac6f225-6013-4d77-8294-706fac1d6aad tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:14.574687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ac6f225-6013-4d77-8294-706fac1d6aad tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:14.575459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ac6f225-6013-4d77-8294-706fac1d6aad tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:14.576284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ac6f225-6013-4d77-8294-706fac1d6aad tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:14.709958 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8ac6f225-6013-4d77-8294-706fac1d6aad tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183286 Sep 07 13:07:14.713212 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2852/5745] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:07:14 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:07:15.742681 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9a9f240c-051e-4e55-b709-266f3d9c3066 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:15.749523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9a9f240c-051e-4e55-b709-266f3d9c3066 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:15.790567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a9f240c-051e-4e55-b709-266f3d9c3066 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:15.791464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a9f240c-051e-4e55-b709-266f3d9c3066 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:15.792263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a9f240c-051e-4e55-b709-266f3d9c3066 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:15.793691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a9f240c-051e-4e55-b709-266f3d9c3066 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:15.794530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a9f240c-051e-4e55-b709-266f3d9c3066 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:15.795316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a9f240c-051e-4e55-b709-266f3d9c3066 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:16.071478 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9a9f240c-051e-4e55-b709-266f3d9c3066 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.345752 Sep 07 13:07:16.072954 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2894/5746] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:07:15 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments => generated 197 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:07:17.090469 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-517845c2-0f70-4774-9c86-e2107c02ed62 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:17.094000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-517845c2-0f70-4774-9c86-e2107c02ed62 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:17.112653 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-517845c2-0f70-4774-9c86-e2107c02ed62 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:17.113175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-517845c2-0f70-4774-9c86-e2107c02ed62 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:17.113678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-517845c2-0f70-4774-9c86-e2107c02ed62 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:17.118750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-517845c2-0f70-4774-9c86-e2107c02ed62 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:17.119339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-517845c2-0f70-4774-9c86-e2107c02ed62 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:17.119806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-517845c2-0f70-4774-9c86-e2107c02ed62 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:17.252752 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-517845c2-0f70-4774-9c86-e2107c02ed62 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.167277 Sep 07 13:07:17.261290 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2853/5747] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:07:17 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8/os-volume_attachments => generated 25 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 13:07:17.452278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e5c5ab38-86c0-4470-8e86-20e1c5708a31 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:17.456168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e5c5ab38-86c0-4470-8e86-20e1c5708a31 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:17.520810 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5c5ab38-86c0-4470-8e86-20e1c5708a31 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:17.524539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5c5ab38-86c0-4470-8e86-20e1c5708a31 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:17.527147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5c5ab38-86c0-4470-8e86-20e1c5708a31 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:17.533045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5c5ab38-86c0-4470-8e86-20e1c5708a31 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:17.534390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5c5ab38-86c0-4470-8e86-20e1c5708a31 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:17.541344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e5c5ab38-86c0-4470-8e86-20e1c5708a31 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:17.692077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e5c5ab38-86c0-4470-8e86-20e1c5708a31 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:07:18.023941 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e5c5ab38-86c0-4470-8e86-20e1c5708a31 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8" status: 204 len: 0 microversion: 2.1 time: 0.587622 Sep 07 13:07:18.027233 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2895/5748] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:07:17 2022] DELETE /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:07:18.042698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a14363f7-43ce-40a0-90b7-9bbd2aef5ba6 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:18.045817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a14363f7-43ce-40a0-90b7-9bbd2aef5ba6 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:18.074311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a14363f7-43ce-40a0-90b7-9bbd2aef5ba6 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:18.078012 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a14363f7-43ce-40a0-90b7-9bbd2aef5ba6 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:18.088590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a14363f7-43ce-40a0-90b7-9bbd2aef5ba6 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:18.090343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a14363f7-43ce-40a0-90b7-9bbd2aef5ba6 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:18.091515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a14363f7-43ce-40a0-90b7-9bbd2aef5ba6 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:18.093388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a14363f7-43ce-40a0-90b7-9bbd2aef5ba6 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:18.745656 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a14363f7-43ce-40a0-90b7-9bbd2aef5ba6 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:18.776694 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a14363f7-43ce-40a0-90b7-9bbd2aef5ba6 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8" status: 200 len: 1681 microversion: 2.1 time: 0.744294 Sep 07 13:07:18.777759 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2854/5749] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:18 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8 => generated 1681 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:19.822077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3f7e42a2-206b-4be1-b408-a406dc0e02f9 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:19.823516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3f7e42a2-206b-4be1-b408-a406dc0e02f9 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:19.838576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f7e42a2-206b-4be1-b408-a406dc0e02f9 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:19.839478 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f7e42a2-206b-4be1-b408-a406dc0e02f9 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:19.840284 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f7e42a2-206b-4be1-b408-a406dc0e02f9 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:19.841312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f7e42a2-206b-4be1-b408-a406dc0e02f9 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:19.842074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f7e42a2-206b-4be1-b408-a406dc0e02f9 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:19.842745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3f7e42a2-206b-4be1-b408-a406dc0e02f9 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:20.722915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3f7e42a2-206b-4be1-b408-a406dc0e02f9 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:20.735733 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3f7e42a2-206b-4be1-b408-a406dc0e02f9 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8" status: 200 len: 1681 microversion: 2.1 time: 0.917879 Sep 07 13:07:20.747000 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2896/5750] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:19 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8 => generated 1681 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:21.777456 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-91c897fc-096e-4f2c-b359-da34aed2a1a0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:21.785526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-91c897fc-096e-4f2c-b359-da34aed2a1a0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:21.808229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91c897fc-096e-4f2c-b359-da34aed2a1a0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:21.810936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91c897fc-096e-4f2c-b359-da34aed2a1a0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:21.812132 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91c897fc-096e-4f2c-b359-da34aed2a1a0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:21.824451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91c897fc-096e-4f2c-b359-da34aed2a1a0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:21.826007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91c897fc-096e-4f2c-b359-da34aed2a1a0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:21.833533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91c897fc-096e-4f2c-b359-da34aed2a1a0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:22.436199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-91c897fc-096e-4f2c-b359-da34aed2a1a0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:22.463808 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-91c897fc-096e-4f2c-b359-da34aed2a1a0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8" status: 200 len: 1681 microversion: 2.1 time: 0.694342 Sep 07 13:07:22.467219 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2855/5751] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:21 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8 => generated 1681 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:23.516209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9cd92fdb-0a6a-41f4-b83b-8c4ec74c4805 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:23.517898 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9cd92fdb-0a6a-41f4-b83b-8c4ec74c4805 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:23.560341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cd92fdb-0a6a-41f4-b83b-8c4ec74c4805 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:23.568651 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cd92fdb-0a6a-41f4-b83b-8c4ec74c4805 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:23.569545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cd92fdb-0a6a-41f4-b83b-8c4ec74c4805 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:23.570938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cd92fdb-0a6a-41f4-b83b-8c4ec74c4805 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:23.574808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cd92fdb-0a6a-41f4-b83b-8c4ec74c4805 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:23.575925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9cd92fdb-0a6a-41f4-b83b-8c4ec74c4805 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:24.027758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e0d86dfd-375f-4239-bd1f-a10cbfc4a587 req-a6551d93-f3f2-4573-ab83-5e0e6fcd1d1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3531114-92cc-4ecb-a97c-0c05170f41f8", "name": "network-vif-unplugged", "status": "completed", "tag": "02d26819-44be-494d-b371-66e56263bd4b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:07:24.081397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e0d86dfd-375f-4239-bd1f-a10cbfc4a587 req-a6551d93-f3f2-4573-ab83-5e0e6fcd1d1d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:24.085040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e0d86dfd-375f-4239-bd1f-a10cbfc4a587 req-a6551d93-f3f2-4573-ab83-5e0e6fcd1d1d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:24.090287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e0d86dfd-375f-4239-bd1f-a10cbfc4a587 req-a6551d93-f3f2-4573-ab83-5e0e6fcd1d1d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:24.152913 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e0d86dfd-375f-4239-bd1f-a10cbfc4a587 req-a6551d93-f3f2-4573-ab83-5e0e6fcd1d1d service nova] Creating event network-vif-unplugged:02d26819-44be-494d-b371-66e56263bd4b for instance c3531114-92cc-4ecb-a97c-0c05170f41f8 on n-h1-852087-9 Sep 07 13:07:24.169436 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e0d86dfd-375f-4239-bd1f-a10cbfc4a587 req-a6551d93-f3f2-4573-ab83-5e0e6fcd1d1d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.499122 Sep 07 13:07:24.175692 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2856/5752] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:07:24.756281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9cd92fdb-0a6a-41f4-b83b-8c4ec74c4805 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:24.771854 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9cd92fdb-0a6a-41f4-b83b-8c4ec74c4805 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8" status: 200 len: 1681 microversion: 2.1 time: 1.262132 Sep 07 13:07:24.773270 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2897/5753] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:23 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8 => generated 1681 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:25.810996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-326dc4b3-1356-4ace-b3b8-3aa9cf92a3bb tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:25.815583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-326dc4b3-1356-4ace-b3b8-3aa9cf92a3bb tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:25.983662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-326dc4b3-1356-4ace-b3b8-3aa9cf92a3bb tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:25.988262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-326dc4b3-1356-4ace-b3b8-3aa9cf92a3bb tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:25.991176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-326dc4b3-1356-4ace-b3b8-3aa9cf92a3bb tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:25.992406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-326dc4b3-1356-4ace-b3b8-3aa9cf92a3bb tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:25.994112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-326dc4b3-1356-4ace-b3b8-3aa9cf92a3bb tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:25.995070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-326dc4b3-1356-4ace-b3b8-3aa9cf92a3bb tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:26.168537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0a8d9045-4a16-43f5-ac10-3970b6e89d68 req-609b600e-da60-486a-a838-6e00855814a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3531114-92cc-4ecb-a97c-0c05170f41f8", "name": "network-vif-deleted", "tag": "02d26819-44be-494d-b371-66e56263bd4b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:07:26.291297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0a8d9045-4a16-43f5-ac10-3970b6e89d68 req-609b600e-da60-486a-a838-6e00855814a5 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:26.291816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0a8d9045-4a16-43f5-ac10-3970b6e89d68 req-609b600e-da60-486a-a838-6e00855814a5 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:26.292274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0a8d9045-4a16-43f5-ac10-3970b6e89d68 req-609b600e-da60-486a-a838-6e00855814a5 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:26.321196 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0a8d9045-4a16-43f5-ac10-3970b6e89d68 req-609b600e-da60-486a-a838-6e00855814a5 service nova] Creating event network-vif-deleted:02d26819-44be-494d-b371-66e56263bd4b for instance c3531114-92cc-4ecb-a97c-0c05170f41f8 on n-h1-852087-9 Sep 07 13:07:26.338049 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0a8d9045-4a16-43f5-ac10-3970b6e89d68 req-609b600e-da60-486a-a838-6e00855814a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.484709 Sep 07 13:07:26.341970 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2898/5754] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:07:26.463250 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-326dc4b3-1356-4ace-b3b8-3aa9cf92a3bb tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:26.476637 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-326dc4b3-1356-4ace-b3b8-3aa9cf92a3bb tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8" status: 200 len: 1327 microversion: 2.1 time: 0.683108 Sep 07 13:07:26.481546 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2857/5755] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:25 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8 => generated 1327 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:27.514575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ae8d7c8-fb25-4a06-872f-5684421cf398 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:27.523720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8ae8d7c8-fb25-4a06-872f-5684421cf398 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:27.574987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ae8d7c8-fb25-4a06-872f-5684421cf398 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:27.576147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ae8d7c8-fb25-4a06-872f-5684421cf398 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:27.576987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ae8d7c8-fb25-4a06-872f-5684421cf398 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:27.586843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ae8d7c8-fb25-4a06-872f-5684421cf398 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:27.591279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ae8d7c8-fb25-4a06-872f-5684421cf398 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:27.592281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ae8d7c8-fb25-4a06-872f-5684421cf398 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:27.715054 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-8ae8d7c8-fb25-4a06-872f-5684421cf398 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] HTTP exception thrown: Instance c3531114-92cc-4ecb-a97c-0c05170f41f8 could not be found. Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ae8d7c8-fb25-4a06-872f-5684421cf398 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Request method failure captured: Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8 HTTP/1.1 Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJXjmtPm9YRFN-tztsi8TNQI9Hp8XLmIE4m4vovyCrvi10-eliNzw5RJ69qhXEwc5_GMz3l7wuK2ojP23vdsllISKFk4XviY8iZt7qikWDIyUcyEqbNGcGcZaYafPWwxZ6tUqEf0DAj26macVBxWQF5nsZe6v99sjs3_jT8xGYwPOpM Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: c9f85a4002bd40eb8514aa91056c77d8 Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance c3531114-92cc-4ecb-a97c-0c05170f41f8 could not be found. Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'c3531114-92cc-4ecb-a97c-0c05170f41f8'} Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3531114-92cc-4ecb-a97c-0c05170f41f8 could not be found. Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3531114-92cc-4ecb-a97c-0c05170f41f8 could not be found. Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:07:27.725549 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:07:27.729441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:07:27.729441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:07:27.729441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:07:27.729441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:07:27.729441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:07:27.729441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3531114-92cc-4ecb-a97c-0c05170f41f8 could not be found. Sep 07 13:07:27.729441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:07:27.731937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ae8d7c8-fb25-4a06-872f-5684421cf398 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Returning 404 to user: Instance c3531114-92cc-4ecb-a97c-0c05170f41f8 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:07:27.735361 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8ae8d7c8-fb25-4a06-872f-5684421cf398 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8" status: 404 len: 111 microversion: 2.1 time: 0.233088 Sep 07 13:07:27.742350 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2899/5756] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:27 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8 => generated 111 bytes in 242 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:07:27.753910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2c9d32cc-714a-49ad-ad21-b9992b1741cf tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '.version_select at 0x7fc4194879d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:27.818102 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2c9d32cc-714a-49ad-ad21-b9992b1741cf tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1342096873" status: 202 len: 0 microversion: 2.1 time: 0.068554 Sep 07 13:07:27.818956 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2858/5757] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Sep 7 13:07:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1342096873 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:07:31.435800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b18fcd8d-095c-44f8-a5e6-3d7d9d4a5def tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Action: 'create', calling method: .version_select at 0x7fc4182aa8b0>, body: {"keypair": {"name": "tempest-keypair-350590180", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJXKY2kBpe7gVRNCZxSTfPmHqQ7AAdZ1sOINuPChcMf3xXDls6YBeB8IqYgeq3jtXYOXfeb9p7ZXz6sLlfSZ9fj/TPoIo6fSJAX9hxatMxqazhX4zNWmHmvJzWwsYuprQ=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:07:31.513775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b18fcd8d-095c-44f8-a5e6-3d7d9d4a5def tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Getting quotas for project cb9b61f78ca140c5870961647ff04cfe. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:07:31.532641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b18fcd8d-095c-44f8-a5e6-3d7d9d4a5def tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Getting quotas for user c9f85a4002bd40eb8514aa91056c77d8 and project cb9b61f78ca140c5870961647ff04cfe. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:07:31.633282 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b18fcd8d-095c-44f8-a5e6-3d7d9d4a5def tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.205031 Sep 07 13:07:31.634397 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2900/5758] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 13:07:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:07:41.693677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:41.694510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:41.716239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-507285f4-5d84-4d9b-a5af-2e2caa2f8767 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-860734262", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "477b0efc-1e3a-4288-a7c3-16de8a1f2f66"}], "security_groups": [{"name": "tempest-securitygroup--1650366667"}], "key_name": "tempest-keypair-350590180", "user_data": "}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:07:42.386979 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-507285f4-5d84-4d9b-a5af-2e2caa2f8767 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] validate_networks() for [('477b0efc-1e3a-4288-a7c3-16de8a1f2f66', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:07:44.205931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-507285f4-5d84-4d9b-a5af-2e2caa2f8767 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:07:44.207096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-507285f4-5d84-4d9b-a5af-2e2caa2f8767 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:07:44.207828 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-507285f4-5d84-4d9b-a5af-2e2caa2f8767 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:07:44.208434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-507285f4-5d84-4d9b-a5af-2e2caa2f8767 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:07:44.209030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-507285f4-5d84-4d9b-a5af-2e2caa2f8767 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:07:44.234890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-507285f4-5d84-4d9b-a5af-2e2caa2f8767 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:44.235513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-507285f4-5d84-4d9b-a5af-2e2caa2f8767 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:44.236126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-507285f4-5d84-4d9b-a5af-2e2caa2f8767 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:44.241513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-507285f4-5d84-4d9b-a5af-2e2caa2f8767 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:44.244358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-507285f4-5d84-4d9b-a5af-2e2caa2f8767 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:44.244896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-507285f4-5d84-4d9b-a5af-2e2caa2f8767 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:44.323333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-507285f4-5d84-4d9b-a5af-2e2caa2f8767 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Getting quotas for project cb9b61f78ca140c5870961647ff04cfe. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:07:44.341540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-507285f4-5d84-4d9b-a5af-2e2caa2f8767 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Getting quotas for user c9f85a4002bd40eb8514aa91056c77d8 and project cb9b61f78ca140c5870961647ff04cfe. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:07:44.440753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-507285f4-5d84-4d9b-a5af-2e2caa2f8767 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:07:44.451246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-507285f4-5d84-4d9b-a5af-2e2caa2f8767 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:07:44.627883 n-d-852087-9 devstack@n-api.service[122432]: ERROR oslo.messaging._drivers.impl_rabbit [None req-507285f4-5d84-4d9b-a5af-2e2caa2f8767 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [51116dcc-d3b6-4051-b11b-8934b98898f4] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 13:07:45.639850 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [None req-507285f4-5d84-4d9b-a5af-2e2caa2f8767 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [51116dcc-d3b6-4051-b11b-8934b98898f4] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 39616. Sep 07 13:07:45.658506 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-507285f4-5d84-4d9b-a5af-2e2caa2f8767 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.966749 Sep 07 13:07:45.671904 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2859/5759] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:07:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 3981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:07:45.675800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:45.677550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:45.678987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:45.716358 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-02152a59-364f-4813-ae91-919cee8222cf tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:45.717760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-02152a59-364f-4813-ae91-919cee8222cf tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:46.224255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-02152a59-364f-4813-ae91-919cee8222cf tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:46.248468 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-02152a59-364f-4813-ae91-919cee8222cf tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 200 len: 1240 microversion: 2.1 time: 0.573095 Sep 07 13:07:46.252371 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2901/5760] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:45 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 1240 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:47.290799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e0b9f11a-f49d-4ec8-9adc-73c70c12408e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:47.298687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e0b9f11a-f49d-4ec8-9adc-73c70c12408e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:47.868809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e0b9f11a-f49d-4ec8-9adc-73c70c12408e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:47.895151 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e0b9f11a-f49d-4ec8-9adc-73c70c12408e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 200 len: 1240 microversion: 2.1 time: 0.606194 Sep 07 13:07:47.905547 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2860/5761] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:47 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 1240 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:48.956089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-665f2bd8-1180-4460-a6f7-4447d932f240 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:48.962137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-665f2bd8-1180-4460-a6f7-4447d932f240 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:49.361874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-665f2bd8-1180-4460-a6f7-4447d932f240 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:49.407961 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-665f2bd8-1180-4460-a6f7-4447d932f240 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 200 len: 1240 microversion: 2.1 time: 0.462429 Sep 07 13:07:49.411205 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2902/5762] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:48 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 1240 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:50.459914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-490251f9-3963-4694-8ac1-5ea7185bf6e0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:50.463827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-490251f9-3963-4694-8ac1-5ea7185bf6e0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:50.493031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-490251f9-3963-4694-8ac1-5ea7185bf6e0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:50.494335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-490251f9-3963-4694-8ac1-5ea7185bf6e0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:50.495502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-490251f9-3963-4694-8ac1-5ea7185bf6e0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:50.498198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-490251f9-3963-4694-8ac1-5ea7185bf6e0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:50.500360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-490251f9-3963-4694-8ac1-5ea7185bf6e0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:50.501505 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-490251f9-3963-4694-8ac1-5ea7185bf6e0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:50.767143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-490251f9-3963-4694-8ac1-5ea7185bf6e0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:50.779171 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-490251f9-3963-4694-8ac1-5ea7185bf6e0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 200 len: 1292 microversion: 2.1 time: 0.327010 Sep 07 13:07:50.780972 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2861/5763] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:50 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 1292 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:51.858319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1a499769-e0c0-4b7c-bb02-bb87925c3844 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:51.862176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1a499769-e0c0-4b7c-bb02-bb87925c3844 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:51.917279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a499769-e0c0-4b7c-bb02-bb87925c3844 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:51.918593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a499769-e0c0-4b7c-bb02-bb87925c3844 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:51.934286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a499769-e0c0-4b7c-bb02-bb87925c3844 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:51.934286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a499769-e0c0-4b7c-bb02-bb87925c3844 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:51.934286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a499769-e0c0-4b7c-bb02-bb87925c3844 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:51.934286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a499769-e0c0-4b7c-bb02-bb87925c3844 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:52.784013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1a499769-e0c0-4b7c-bb02-bb87925c3844 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:52.815165 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1a499769-e0c0-4b7c-bb02-bb87925c3844 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 200 len: 1298 microversion: 2.1 time: 0.961888 Sep 07 13:07:52.864838 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2903/5764] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:51 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 1298 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:53.859783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c9efe31c-944d-4a21-86ad-029ae3008910 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:53.860876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c9efe31c-944d-4a21-86ad-029ae3008910 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:53.924772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9efe31c-944d-4a21-86ad-029ae3008910 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:53.925634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9efe31c-944d-4a21-86ad-029ae3008910 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:53.926384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9efe31c-944d-4a21-86ad-029ae3008910 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:53.927507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9efe31c-944d-4a21-86ad-029ae3008910 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:53.928266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9efe31c-944d-4a21-86ad-029ae3008910 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:53.928960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9efe31c-944d-4a21-86ad-029ae3008910 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:54.279824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:54.337964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c9efe31c-944d-4a21-86ad-029ae3008910 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:54.353511 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c9efe31c-944d-4a21-86ad-029ae3008910 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 200 len: 1298 microversion: 2.1 time: 0.500763 Sep 07 13:07:54.376787 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2862/5765] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:53 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 1298 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:55.425470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-31d824fe-5a1d-4b9d-becc-e58fa6ed0c16 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:55.442254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-31d824fe-5a1d-4b9d-becc-e58fa6ed0c16 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:55.471719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31d824fe-5a1d-4b9d-becc-e58fa6ed0c16 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:55.474881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31d824fe-5a1d-4b9d-becc-e58fa6ed0c16 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:55.479840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31d824fe-5a1d-4b9d-becc-e58fa6ed0c16 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:55.481438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31d824fe-5a1d-4b9d-becc-e58fa6ed0c16 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:55.486276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31d824fe-5a1d-4b9d-becc-e58fa6ed0c16 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:55.487274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31d824fe-5a1d-4b9d-becc-e58fa6ed0c16 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:55.891393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-31d824fe-5a1d-4b9d-becc-e58fa6ed0c16 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:55.916836 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-31d824fe-5a1d-4b9d-becc-e58fa6ed0c16 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 200 len: 1298 microversion: 2.1 time: 0.510635 Sep 07 13:07:55.918005 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2904/5766] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:55 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 1298 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:56.970443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-38a4ecab-682e-4676-9d1f-afef277104fa tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:56.975441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-38a4ecab-682e-4676-9d1f-afef277104fa tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:57.012112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38a4ecab-682e-4676-9d1f-afef277104fa tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:57.013854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38a4ecab-682e-4676-9d1f-afef277104fa tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:57.015709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38a4ecab-682e-4676-9d1f-afef277104fa tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:57.018674 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38a4ecab-682e-4676-9d1f-afef277104fa tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:57.025647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38a4ecab-682e-4676-9d1f-afef277104fa tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:57.026779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-38a4ecab-682e-4676-9d1f-afef277104fa tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:57.879604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:58.233905 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-38a4ecab-682e-4676-9d1f-afef277104fa tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:07:58.267213 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-38a4ecab-682e-4676-9d1f-afef277104fa tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 200 len: 1366 microversion: 2.1 time: 1.302199 Sep 07 13:07:58.272177 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2863/5767] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:56 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 1366 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:07:59.311729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9dcdec79-9590-42ff-bcca-f8cce639b4e4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:07:59.318286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9dcdec79-9590-42ff-bcca-f8cce639b4e4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:07:59.395159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:59.406102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9dcdec79-9590-42ff-bcca-f8cce639b4e4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:59.419231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9dcdec79-9590-42ff-bcca-f8cce639b4e4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:59.429762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9dcdec79-9590-42ff-bcca-f8cce639b4e4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:07:59.432219 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9dcdec79-9590-42ff-bcca-f8cce639b4e4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:07:59.441957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9dcdec79-9590-42ff-bcca-f8cce639b4e4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:07:59.445467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9dcdec79-9590-42ff-bcca-f8cce639b4e4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:00.559616 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9dcdec79-9590-42ff-bcca-f8cce639b4e4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:00.582190 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9dcdec79-9590-42ff-bcca-f8cce639b4e4 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 200 len: 1366 microversion: 2.1 time: 1.284448 Sep 07 13:08:00.582831 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2905/5768] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:07:59 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 1366 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:01.638966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a2dcaa47-6c6c-41b1-90d0-a82351225888 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:01.640066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a2dcaa47-6c6c-41b1-90d0-a82351225888 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:01.669224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2dcaa47-6c6c-41b1-90d0-a82351225888 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:01.669224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2dcaa47-6c6c-41b1-90d0-a82351225888 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:01.669224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2dcaa47-6c6c-41b1-90d0-a82351225888 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:01.670164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2dcaa47-6c6c-41b1-90d0-a82351225888 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:01.670650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2dcaa47-6c6c-41b1-90d0-a82351225888 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:01.671282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2dcaa47-6c6c-41b1-90d0-a82351225888 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:03.057660 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a2dcaa47-6c6c-41b1-90d0-a82351225888 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:03.101451 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a2dcaa47-6c6c-41b1-90d0-a82351225888 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 200 len: 1366 microversion: 2.1 time: 1.483781 Sep 07 13:08:03.121287 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2864/5769] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:01 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 1366 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:03.365591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c5619f40-1853-4d4e-bbfe-79ee359ea760 req-e9f8f926-dfa8-435c-8014-95a13fbf5799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a99032d9-37f6-4c7d-b813-207e3190d4b4", "tag": "2ffae4f2-ea5d-46a1-8de9-3a5145fd0b77"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:03.401705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c5619f40-1853-4d4e-bbfe-79ee359ea760 req-e9f8f926-dfa8-435c-8014-95a13fbf5799 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:03.403081 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c5619f40-1853-4d4e-bbfe-79ee359ea760 req-e9f8f926-dfa8-435c-8014-95a13fbf5799 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:03.409999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c5619f40-1853-4d4e-bbfe-79ee359ea760 req-e9f8f926-dfa8-435c-8014-95a13fbf5799 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:03.443989 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c5619f40-1853-4d4e-bbfe-79ee359ea760 req-e9f8f926-dfa8-435c-8014-95a13fbf5799 service nova] Creating event network-changed:2ffae4f2-ea5d-46a1-8de9-3a5145fd0b77 for instance a99032d9-37f6-4c7d-b813-207e3190d4b4 on n-h2-852087-9 Sep 07 13:08:03.463224 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c5619f40-1853-4d4e-bbfe-79ee359ea760 req-e9f8f926-dfa8-435c-8014-95a13fbf5799 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104326 Sep 07 13:08:03.464612 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2906/5770] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:08:04.164131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-36c05801-2a4e-40b8-bdf5-6b6bce1c0ff1 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:04.167859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-36c05801-2a4e-40b8-bdf5-6b6bce1c0ff1 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:04.184529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36c05801-2a4e-40b8-bdf5-6b6bce1c0ff1 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:04.185411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36c05801-2a4e-40b8-bdf5-6b6bce1c0ff1 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:04.186212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36c05801-2a4e-40b8-bdf5-6b6bce1c0ff1 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:04.187508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36c05801-2a4e-40b8-bdf5-6b6bce1c0ff1 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:04.188760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36c05801-2a4e-40b8-bdf5-6b6bce1c0ff1 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:04.189601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36c05801-2a4e-40b8-bdf5-6b6bce1c0ff1 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:05.189920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-36c05801-2a4e-40b8-bdf5-6b6bce1c0ff1 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:05.227258 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-36c05801-2a4e-40b8-bdf5-6b6bce1c0ff1 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 200 len: 1366 microversion: 2.1 time: 1.067763 Sep 07 13:08:05.241626 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2865/5771] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:04 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 1366 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:06.279025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fc2519db-59f2-4307-91e1-1ccf729ef521 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:06.287468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fc2519db-59f2-4307-91e1-1ccf729ef521 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:06.329888 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc2519db-59f2-4307-91e1-1ccf729ef521 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:06.334740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc2519db-59f2-4307-91e1-1ccf729ef521 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:06.341263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc2519db-59f2-4307-91e1-1ccf729ef521 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:06.343251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc2519db-59f2-4307-91e1-1ccf729ef521 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:06.350832 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc2519db-59f2-4307-91e1-1ccf729ef521 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:06.352410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc2519db-59f2-4307-91e1-1ccf729ef521 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:06.878361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fc2519db-59f2-4307-91e1-1ccf729ef521 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:06.895965 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fc2519db-59f2-4307-91e1-1ccf729ef521 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 200 len: 1366 microversion: 2.1 time: 0.624078 Sep 07 13:08:06.898624 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2907/5772] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:06 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 1366 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:07.942906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1105c0db-6b5f-4742-b320-4e57b05b523f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:07.944261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1105c0db-6b5f-4742-b320-4e57b05b523f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:07.968848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1105c0db-6b5f-4742-b320-4e57b05b523f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:07.969774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1105c0db-6b5f-4742-b320-4e57b05b523f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:07.975678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1105c0db-6b5f-4742-b320-4e57b05b523f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:07.977306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1105c0db-6b5f-4742-b320-4e57b05b523f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:07.980558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1105c0db-6b5f-4742-b320-4e57b05b523f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:07.981363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1105c0db-6b5f-4742-b320-4e57b05b523f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:08.983954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1105c0db-6b5f-4742-b320-4e57b05b523f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:09.012955 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1105c0db-6b5f-4742-b320-4e57b05b523f tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 200 len: 1366 microversion: 2.1 time: 1.073617 Sep 07 13:08:09.020619 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2866/5773] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:07 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 1366 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:10.087150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d2b6e773-d0cb-48b4-8098-0ecd1654a31a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:10.089994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d2b6e773-d0cb-48b4-8098-0ecd1654a31a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:10.160959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2b6e773-d0cb-48b4-8098-0ecd1654a31a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:10.162163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2b6e773-d0cb-48b4-8098-0ecd1654a31a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:10.163004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2b6e773-d0cb-48b4-8098-0ecd1654a31a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:10.166320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2b6e773-d0cb-48b4-8098-0ecd1654a31a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:10.167452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2b6e773-d0cb-48b4-8098-0ecd1654a31a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:10.168327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d2b6e773-d0cb-48b4-8098-0ecd1654a31a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:10.812490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d2b6e773-d0cb-48b4-8098-0ecd1654a31a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:10.839027 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d2b6e773-d0cb-48b4-8098-0ecd1654a31a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 200 len: 1366 microversion: 2.1 time: 0.757693 Sep 07 13:08:10.841794 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2908/5774] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:10 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 1366 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:11.886905 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2bea7e73-a70c-4298-b202-69483ff7cc22 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:11.888259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2bea7e73-a70c-4298-b202-69483ff7cc22 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:11.911086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:11.912722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bea7e73-a70c-4298-b202-69483ff7cc22 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:11.916385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bea7e73-a70c-4298-b202-69483ff7cc22 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:11.918202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bea7e73-a70c-4298-b202-69483ff7cc22 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:11.919135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bea7e73-a70c-4298-b202-69483ff7cc22 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:11.922700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bea7e73-a70c-4298-b202-69483ff7cc22 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:11.923156 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bea7e73-a70c-4298-b202-69483ff7cc22 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:11.979550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=39 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:13.093700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2bea7e73-a70c-4298-b202-69483ff7cc22 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:13.142939 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2bea7e73-a70c-4298-b202-69483ff7cc22 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 200 len: 1366 microversion: 2.1 time: 1.260586 Sep 07 13:08:13.146976 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2867/5775] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:11 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 1366 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:14.185597 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-272d7518-d2c6-41e6-ae21-6c81e8af2f92 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:14.186368 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-272d7518-d2c6-41e6-ae21-6c81e8af2f92 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:14.202842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-272d7518-d2c6-41e6-ae21-6c81e8af2f92 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:14.203288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-272d7518-d2c6-41e6-ae21-6c81e8af2f92 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:14.203760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-272d7518-d2c6-41e6-ae21-6c81e8af2f92 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:14.204532 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-272d7518-d2c6-41e6-ae21-6c81e8af2f92 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:14.205009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-272d7518-d2c6-41e6-ae21-6c81e8af2f92 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:14.205455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-272d7518-d2c6-41e6-ae21-6c81e8af2f92 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:14.505153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-272d7518-d2c6-41e6-ae21-6c81e8af2f92 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:14.532246 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-272d7518-d2c6-41e6-ae21-6c81e8af2f92 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 200 len: 1366 microversion: 2.1 time: 0.351272 Sep 07 13:08:14.540837 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2909/5776] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:14 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 1366 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:08:15.556778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-174d7004-f84f-43e5-83b8-3e5d2bfb8711 req-46476fab-b9da-4aab-bc42-1e65dcfa7951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99032d9-37f6-4c7d-b813-207e3190d4b4", "name": "network-vif-plugged", "status": "completed", "tag": "2ffae4f2-ea5d-46a1-8de9-3a5145fd0b77"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:15.590084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-405fe3ab-bbb4-4587-884d-94b83f089555 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:15.591735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-405fe3ab-bbb4-4587-884d-94b83f089555 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:15.600513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-405fe3ab-bbb4-4587-884d-94b83f089555 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:15.601352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-405fe3ab-bbb4-4587-884d-94b83f089555 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:15.602081 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-405fe3ab-bbb4-4587-884d-94b83f089555 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:15.603660 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-405fe3ab-bbb4-4587-884d-94b83f089555 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:15.605115 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-405fe3ab-bbb4-4587-884d-94b83f089555 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:15.605780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-405fe3ab-bbb4-4587-884d-94b83f089555 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:15.608877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-174d7004-f84f-43e5-83b8-3e5d2bfb8711 req-46476fab-b9da-4aab-bc42-1e65dcfa7951 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:15.610108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-174d7004-f84f-43e5-83b8-3e5d2bfb8711 req-46476fab-b9da-4aab-bc42-1e65dcfa7951 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:15.614823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-174d7004-f84f-43e5-83b8-3e5d2bfb8711 req-46476fab-b9da-4aab-bc42-1e65dcfa7951 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:15.646290 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-174d7004-f84f-43e5-83b8-3e5d2bfb8711 req-46476fab-b9da-4aab-bc42-1e65dcfa7951 service nova] Creating event network-vif-plugged:2ffae4f2-ea5d-46a1-8de9-3a5145fd0b77 for instance a99032d9-37f6-4c7d-b813-207e3190d4b4 on n-h2-852087-9 Sep 07 13:08:15.658764 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-174d7004-f84f-43e5-83b8-3e5d2bfb8711 req-46476fab-b9da-4aab-bc42-1e65dcfa7951 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109056 Sep 07 13:08:15.662660 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2868/5777] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:08:16.881441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-405fe3ab-bbb4-4587-884d-94b83f089555 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:16.885799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=43 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:16.910762 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-405fe3ab-bbb4-4587-884d-94b83f089555 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 200 len: 1366 microversion: 2.1 time: 1.324841 Sep 07 13:08:16.937559 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2910/5778] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:15 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 1366 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:17.953177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c11a5905-4b68-489f-82b9-c61b2e256505 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:17.953943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c11a5905-4b68-489f-82b9-c61b2e256505 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:17.984356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c11a5905-4b68-489f-82b9-c61b2e256505 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:17.984882 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c11a5905-4b68-489f-82b9-c61b2e256505 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:17.985336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c11a5905-4b68-489f-82b9-c61b2e256505 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:17.986129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c11a5905-4b68-489f-82b9-c61b2e256505 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:17.986606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c11a5905-4b68-489f-82b9-c61b2e256505 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:17.987055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c11a5905-4b68-489f-82b9-c61b2e256505 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:19.565992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c11a5905-4b68-489f-82b9-c61b2e256505 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:19.590701 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c11a5905-4b68-489f-82b9-c61b2e256505 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 200 len: 1366 microversion: 2.1 time: 1.642802 Sep 07 13:08:19.592066 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2869/5779] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:17 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 1366 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:20.651644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a5faadac-d731-4bfb-85d4-80bc93e29ca5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:20.652838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a5faadac-d731-4bfb-85d4-80bc93e29ca5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:20.685127 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=25 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:20.696672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5faadac-d731-4bfb-85d4-80bc93e29ca5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:20.706843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5faadac-d731-4bfb-85d4-80bc93e29ca5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:20.708024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5faadac-d731-4bfb-85d4-80bc93e29ca5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:20.709694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5faadac-d731-4bfb-85d4-80bc93e29ca5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:20.710843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5faadac-d731-4bfb-85d4-80bc93e29ca5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:20.711987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5faadac-d731-4bfb-85d4-80bc93e29ca5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:21.557053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a5faadac-d731-4bfb-85d4-80bc93e29ca5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:08:21.585953 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a5faadac-d731-4bfb-85d4-80bc93e29ca5 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 200 len: 1556 microversion: 2.1 time: 0.941559 Sep 07 13:08:21.587529 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2911/5780] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:08:20 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 1556 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:08:21.654777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e7c0472c-cdd9-417d-b48f-5491405ca409 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:21.655496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e7c0472c-cdd9-417d-b48f-5491405ca409 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:21.670275 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7c0472c-cdd9-417d-b48f-5491405ca409 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:21.672074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7c0472c-cdd9-417d-b48f-5491405ca409 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:21.673151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7c0472c-cdd9-417d-b48f-5491405ca409 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:21.674397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7c0472c-cdd9-417d-b48f-5491405ca409 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:21.675215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7c0472c-cdd9-417d-b48f-5491405ca409 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:21.675935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7c0472c-cdd9-417d-b48f-5491405ca409 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:22.352527 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e7c0472c-cdd9-417d-b48f-5491405ca409 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.718235 Sep 07 13:08:22.353401 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2870/5781] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Sep 7 13:08:21 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-interface => generated 285 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:08:27.357691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-e33b5498-1b7b-4862-ad58-c60e99100bce req-a5c73b71-7616-4b18-b99d-4c3900e12b75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a99032d9-37f6-4c7d-b813-207e3190d4b4", "tag": "2ffae4f2-ea5d-46a1-8de9-3a5145fd0b77"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:08:27.413868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e33b5498-1b7b-4862-ad58-c60e99100bce req-a5c73b71-7616-4b18-b99d-4c3900e12b75 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:27.414890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e33b5498-1b7b-4862-ad58-c60e99100bce req-a5c73b71-7616-4b18-b99d-4c3900e12b75 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:27.415685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e33b5498-1b7b-4862-ad58-c60e99100bce req-a5c73b71-7616-4b18-b99d-4c3900e12b75 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:27.452467 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-e33b5498-1b7b-4862-ad58-c60e99100bce req-a5c73b71-7616-4b18-b99d-4c3900e12b75 service nova] Creating event network-changed:2ffae4f2-ea5d-46a1-8de9-3a5145fd0b77 for instance a99032d9-37f6-4c7d-b813-207e3190d4b4 on n-h2-852087-9 Sep 07 13:08:27.467533 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-e33b5498-1b7b-4862-ad58-c60e99100bce req-a5c73b71-7616-4b18-b99d-4c3900e12b75 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120570 Sep 07 13:08:27.478123 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2912/5782] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:08:59.139427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=7 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:59.141558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=17 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:59.154132 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bfdc25dd-dcfe-41b3-81d3-9a9fa4bfa591 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:08:59.154704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bfdc25dd-dcfe-41b3-81d3-9a9fa4bfa591 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:08:59.168393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfdc25dd-dcfe-41b3-81d3-9a9fa4bfa591 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:59.168876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfdc25dd-dcfe-41b3-81d3-9a9fa4bfa591 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:59.169253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfdc25dd-dcfe-41b3-81d3-9a9fa4bfa591 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:59.170064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfdc25dd-dcfe-41b3-81d3-9a9fa4bfa591 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:08:59.170534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfdc25dd-dcfe-41b3-81d3-9a9fa4bfa591 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:08:59.171069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfdc25dd-dcfe-41b3-81d3-9a9fa4bfa591 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:08:59.266801 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bfdc25dd-dcfe-41b3-81d3-9a9fa4bfa591 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/ips" status: 200 len: 150 microversion: 2.1 time: 0.129527 Sep 07 13:08:59.273946 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2871/5783] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Sep 7 13:08:59 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/ips => generated 150 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:09:03.814536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:03.815330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=9 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:03.816126 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:09:03.816257 n-d-852087-9 devstack@n-api.service[122433]: Wed Sep 7 13:09:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Sep 07 13:09:03.822239 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9f4bc142-7ac7-4f61-92c9-d7fc01b14e76 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-317187190", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "2191e414-c63c-4fb3-bede-cd6728183361"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:09:04.439415 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dc25d63c-b370-48bf-9b08-61a7487747c0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3bbe6235-6745-4f77-b1b4-966fe2401f73"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:09:04.445824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dc25d63c-b370-48bf-9b08-61a7487747c0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:04.462641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc25d63c-b370-48bf-9b08-61a7487747c0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:04.465269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc25d63c-b370-48bf-9b08-61a7487747c0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:04.466844 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc25d63c-b370-48bf-9b08-61a7487747c0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:04.467988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc25d63c-b370-48bf-9b08-61a7487747c0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:04.470296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc25d63c-b370-48bf-9b08-61a7487747c0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:04.471012 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc25d63c-b370-48bf-9b08-61a7487747c0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:04.747700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-9f4bc142-7ac7-4f61-92c9-d7fc01b14e76 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] validate_networks() for [('2191e414-c63c-4fb3-bede-cd6728183361', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:09:05.046941 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dc25d63c-b370-48bf-9b08-61a7487747c0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "POST /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.616141 Sep 07 13:09:05.049626 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2872/5784] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Sep 7 13:09:04 2022] POST /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments => generated 194 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:07.301515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-9f4bc142-7ac7-4f61-92c9-d7fc01b14e76 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:09:07.302123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-9f4bc142-7ac7-4f61-92c9-d7fc01b14e76 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:09:07.302468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-9f4bc142-7ac7-4f61-92c9-d7fc01b14e76 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:09:07.303226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-9f4bc142-7ac7-4f61-92c9-d7fc01b14e76 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:09:07.304356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-9f4bc142-7ac7-4f61-92c9-d7fc01b14e76 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:09:07.332591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f4bc142-7ac7-4f61-92c9-d7fc01b14e76 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:07.334090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f4bc142-7ac7-4f61-92c9-d7fc01b14e76 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:07.338038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f4bc142-7ac7-4f61-92c9-d7fc01b14e76 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:07.361336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f4bc142-7ac7-4f61-92c9-d7fc01b14e76 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:07.362379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f4bc142-7ac7-4f61-92c9-d7fc01b14e76 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:07.363023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f4bc142-7ac7-4f61-92c9-d7fc01b14e76 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:07.410212 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-9f4bc142-7ac7-4f61-92c9-d7fc01b14e76 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Getting quotas for project 82a5845654bb49638492b2b4a05b76a8. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:09:07.423680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-9f4bc142-7ac7-4f61-92c9-d7fc01b14e76 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Getting quotas for user 57c002bf4fcd4f33a5304a8ca26a262b and project 82a5845654bb49638492b2b4a05b76a8. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:09:07.470855 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9f4bc142-7ac7-4f61-92c9-d7fc01b14e76 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:09:07.475738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9f4bc142-7ac7-4f61-92c9-d7fc01b14e76 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: b6fc8dec-29e5-4879-b83a-e15a9b37dda4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:09:07.564251 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9f4bc142-7ac7-4f61-92c9-d7fc01b14e76 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.747420 Sep 07 13:09:07.570521 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2913/5785] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:09:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:09:07.587588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8541d537-96c2-46eb-993d-5234e1b342de tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:07.589321 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8541d537-96c2-46eb-993d-5234e1b342de tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: b6fc8dec-29e5-4879-b83a-e15a9b37dda4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:08.709029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8541d537-96c2-46eb-993d-5234e1b342de tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:08.735766 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8541d537-96c2-46eb-993d-5234e1b342de tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4" status: 200 len: 1218 microversion: 2.1 time: 1.156830 Sep 07 13:09:08.746829 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2873/5786] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:07 2022] GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4 => generated 1218 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:09.778250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4e927a85-06d1-429b-bb87-871e635587b6 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:09.779410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4e927a85-06d1-429b-bb87-871e635587b6 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: b6fc8dec-29e5-4879-b83a-e15a9b37dda4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:09.803210 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e927a85-06d1-429b-bb87-871e635587b6 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:09.803793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e927a85-06d1-429b-bb87-871e635587b6 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:09.804316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e927a85-06d1-429b-bb87-871e635587b6 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:09.805450 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e927a85-06d1-429b-bb87-871e635587b6 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:09.806089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e927a85-06d1-429b-bb87-871e635587b6 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:09.806538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e927a85-06d1-429b-bb87-871e635587b6 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:10.110936 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4e927a85-06d1-429b-bb87-871e635587b6 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:10.119585 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4e927a85-06d1-429b-bb87-871e635587b6 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4" status: 200 len: 1270 microversion: 2.1 time: 0.346321 Sep 07 13:09:10.120197 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2914/5787] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:09 2022] GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4 => generated 1270 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:09:11.168554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9586bc3e-f1b3-435e-81bc-b06889f417ad tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:11.171014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9586bc3e-f1b3-435e-81bc-b06889f417ad tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: b6fc8dec-29e5-4879-b83a-e15a9b37dda4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:11.234582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9586bc3e-f1b3-435e-81bc-b06889f417ad tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:11.237302 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9586bc3e-f1b3-435e-81bc-b06889f417ad tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:11.238425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9586bc3e-f1b3-435e-81bc-b06889f417ad tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:11.241334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9586bc3e-f1b3-435e-81bc-b06889f417ad tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:11.242638 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9586bc3e-f1b3-435e-81bc-b06889f417ad tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:11.243610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9586bc3e-f1b3-435e-81bc-b06889f417ad tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:11.431739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9586bc3e-f1b3-435e-81bc-b06889f417ad tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:11.441471 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9586bc3e-f1b3-435e-81bc-b06889f417ad tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4" status: 200 len: 1276 microversion: 2.1 time: 0.282613 Sep 07 13:09:11.446928 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2874/5788] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:11 2022] GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4 => generated 1276 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:09:12.476488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-14c81fb1-66da-485e-b546-99f1d9085f16 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:12.478142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-14c81fb1-66da-485e-b546-99f1d9085f16 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: b6fc8dec-29e5-4879-b83a-e15a9b37dda4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:12.504231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14c81fb1-66da-485e-b546-99f1d9085f16 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:12.505227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14c81fb1-66da-485e-b546-99f1d9085f16 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:12.505932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14c81fb1-66da-485e-b546-99f1d9085f16 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:12.507066 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14c81fb1-66da-485e-b546-99f1d9085f16 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:12.510105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14c81fb1-66da-485e-b546-99f1d9085f16 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:12.510895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14c81fb1-66da-485e-b546-99f1d9085f16 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:12.693357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-14c81fb1-66da-485e-b546-99f1d9085f16 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:12.703869 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-14c81fb1-66da-485e-b546-99f1d9085f16 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4" status: 200 len: 1276 microversion: 2.1 time: 0.232366 Sep 07 13:09:12.709406 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2915/5789] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:12 2022] GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4 => generated 1276 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:13.747530 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1cabc7dd-8d28-4f67-ba4a-138fe387930f tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:13.748152 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1cabc7dd-8d28-4f67-ba4a-138fe387930f tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: b6fc8dec-29e5-4879-b83a-e15a9b37dda4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:13.762611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cabc7dd-8d28-4f67-ba4a-138fe387930f tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:13.763123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cabc7dd-8d28-4f67-ba4a-138fe387930f tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:13.763644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cabc7dd-8d28-4f67-ba4a-138fe387930f tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:13.764456 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cabc7dd-8d28-4f67-ba4a-138fe387930f tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:13.764852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cabc7dd-8d28-4f67-ba4a-138fe387930f tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:13.765393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cabc7dd-8d28-4f67-ba4a-138fe387930f tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:14.311982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1cabc7dd-8d28-4f67-ba4a-138fe387930f tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:14.328641 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1cabc7dd-8d28-4f67-ba4a-138fe387930f tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4" status: 200 len: 1318 microversion: 2.1 time: 0.585538 Sep 07 13:09:14.338339 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2875/5790] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:13 2022] GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4 => generated 1318 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:15.396003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-453c41fa-6078-426f-9fd4-f233ca6055ea tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:15.396842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-453c41fa-6078-426f-9fd4-f233ca6055ea tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: b6fc8dec-29e5-4879-b83a-e15a9b37dda4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:15.411294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-453c41fa-6078-426f-9fd4-f233ca6055ea tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:15.412310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-453c41fa-6078-426f-9fd4-f233ca6055ea tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:15.413075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-453c41fa-6078-426f-9fd4-f233ca6055ea tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:15.414301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-453c41fa-6078-426f-9fd4-f233ca6055ea tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:15.414973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-453c41fa-6078-426f-9fd4-f233ca6055ea tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:15.415724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-453c41fa-6078-426f-9fd4-f233ca6055ea tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:15.912646 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-453c41fa-6078-426f-9fd4-f233ca6055ea tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:15.921601 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-453c41fa-6078-426f-9fd4-f233ca6055ea tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4" status: 200 len: 1318 microversion: 2.1 time: 0.530298 Sep 07 13:09:15.934358 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2916/5791] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:15 2022] GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4 => generated 1318 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:09:16.974969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-083ab96f-b125-4d05-9162-b40e97883596 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:16.976264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-083ab96f-b125-4d05-9162-b40e97883596 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: b6fc8dec-29e5-4879-b83a-e15a9b37dda4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:16.992849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-083ab96f-b125-4d05-9162-b40e97883596 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:17.005261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-083ab96f-b125-4d05-9162-b40e97883596 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:17.006488 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-083ab96f-b125-4d05-9162-b40e97883596 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:17.008114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-083ab96f-b125-4d05-9162-b40e97883596 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:17.009239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-083ab96f-b125-4d05-9162-b40e97883596 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:17.010311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-083ab96f-b125-4d05-9162-b40e97883596 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:18.037654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-083ab96f-b125-4d05-9162-b40e97883596 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:18.066750 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-083ab96f-b125-4d05-9162-b40e97883596 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4" status: 200 len: 1318 microversion: 2.1 time: 1.095829 Sep 07 13:09:18.069318 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2876/5792] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:16 2022] GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4 => generated 1318 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:18.851385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-1d4ce820-444f-419e-9121-f15f8a0e65c6 req-e7438040-4d88-4591-b316-7839fd5d3b50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6fc8dec-29e5-4879-b83a-e15a9b37dda4", "tag": "4fa5a024-9da7-430e-9773-ba94fad40100"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:09:18.864557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:18.874139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:18.892990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1d4ce820-444f-419e-9121-f15f8a0e65c6 req-e7438040-4d88-4591-b316-7839fd5d3b50 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:18.893510 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1d4ce820-444f-419e-9121-f15f8a0e65c6 req-e7438040-4d88-4591-b316-7839fd5d3b50 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:18.893955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1d4ce820-444f-419e-9121-f15f8a0e65c6 req-e7438040-4d88-4591-b316-7839fd5d3b50 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:18.938710 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-1d4ce820-444f-419e-9121-f15f8a0e65c6 req-e7438040-4d88-4591-b316-7839fd5d3b50 service nova] Creating event network-changed:4fa5a024-9da7-430e-9773-ba94fad40100 for instance b6fc8dec-29e5-4879-b83a-e15a9b37dda4 on n-h1-852087-9 Sep 07 13:09:18.947975 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-1d4ce820-444f-419e-9121-f15f8a0e65c6 req-e7438040-4d88-4591-b316-7839fd5d3b50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096813 Sep 07 13:09:18.948890 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2917/5793] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:19.116237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f61e9583-05e0-4da4-90c8-004756f66090 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:19.118478 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f61e9583-05e0-4da4-90c8-004756f66090 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: b6fc8dec-29e5-4879-b83a-e15a9b37dda4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:19.126433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:19.162889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f61e9583-05e0-4da4-90c8-004756f66090 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:19.164031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f61e9583-05e0-4da4-90c8-004756f66090 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:19.165354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f61e9583-05e0-4da4-90c8-004756f66090 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:19.166667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f61e9583-05e0-4da4-90c8-004756f66090 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:19.167537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f61e9583-05e0-4da4-90c8-004756f66090 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:19.169712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f61e9583-05e0-4da4-90c8-004756f66090 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:20.881935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f61e9583-05e0-4da4-90c8-004756f66090 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:20.900980 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f61e9583-05e0-4da4-90c8-004756f66090 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4" status: 200 len: 1318 microversion: 2.1 time: 1.796374 Sep 07 13:09:20.904413 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2877/5794] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:19 2022] GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4 => generated 1318 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:09:21.936666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1907d807-c699-47de-83e8-a152556139a1 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:21.947687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1907d807-c699-47de-83e8-a152556139a1 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: b6fc8dec-29e5-4879-b83a-e15a9b37dda4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:21.962922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1907d807-c699-47de-83e8-a152556139a1 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:21.964252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1907d807-c699-47de-83e8-a152556139a1 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:21.965339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1907d807-c699-47de-83e8-a152556139a1 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:21.967117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1907d807-c699-47de-83e8-a152556139a1 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:21.968634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1907d807-c699-47de-83e8-a152556139a1 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:21.969753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1907d807-c699-47de-83e8-a152556139a1 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:22.957510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-13354cd8-45f2-4992-827c-290d4d5d4f7d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:22.958834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-13354cd8-45f2-4992-827c-290d4d5d4f7d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:22.968351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13354cd8-45f2-4992-827c-290d4d5d4f7d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:22.969574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13354cd8-45f2-4992-827c-290d4d5d4f7d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:22.970330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13354cd8-45f2-4992-827c-290d4d5d4f7d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:22.971632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13354cd8-45f2-4992-827c-290d4d5d4f7d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:22.972646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13354cd8-45f2-4992-827c-290d4d5d4f7d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:22.973391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13354cd8-45f2-4992-827c-290d4d5d4f7d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:23.037849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1907d807-c699-47de-83e8-a152556139a1 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:23.059909 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1907d807-c699-47de-83e8-a152556139a1 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4" status: 200 len: 1318 microversion: 2.1 time: 1.125574 Sep 07 13:09:23.062450 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2918/5795] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:21 2022] GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4 => generated 1318 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:23.264269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-13354cd8-45f2-4992-827c-290d4d5d4f7d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lazy-loading 'services' on Instance uuid a99032d9-37f6-4c7d-b813-207e3190d4b4 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:09:23.481171 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-13354cd8-45f2-4992-827c-290d4d5d4f7d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments/3bbe6235-6745-4f77-b1b4-966fe2401f73" status: 202 len: 0 microversion: 2.1 time: 0.513479 Sep 07 13:09:23.482806 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2878/5796] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Sep 7 13:09:22 2022] DELETE /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments/3bbe6235-6745-4f77-b1b4-966fe2401f73 => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:09:23.492739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-43f8d328-e0e0-4f09-a3ba-aae6458a507a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:23.495634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-43f8d328-e0e0-4f09-a3ba-aae6458a507a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:23.515260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43f8d328-e0e0-4f09-a3ba-aae6458a507a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:23.515260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43f8d328-e0e0-4f09-a3ba-aae6458a507a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:23.516085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43f8d328-e0e0-4f09-a3ba-aae6458a507a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:23.517841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43f8d328-e0e0-4f09-a3ba-aae6458a507a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:23.548212 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43f8d328-e0e0-4f09-a3ba-aae6458a507a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:23.551255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43f8d328-e0e0-4f09-a3ba-aae6458a507a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:23.633025 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-43f8d328-e0e0-4f09-a3ba-aae6458a507a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145187 Sep 07 13:09:23.633739 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2919/5797] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:09:23 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:09:24.086260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f5ea2de8-6a4a-4ecb-8b0e-645becf8f7cf tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:24.087823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f5ea2de8-6a4a-4ecb-8b0e-645becf8f7cf tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: b6fc8dec-29e5-4879-b83a-e15a9b37dda4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:24.099887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5ea2de8-6a4a-4ecb-8b0e-645becf8f7cf tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:24.101178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5ea2de8-6a4a-4ecb-8b0e-645becf8f7cf tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:24.101959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5ea2de8-6a4a-4ecb-8b0e-645becf8f7cf tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:24.104267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5ea2de8-6a4a-4ecb-8b0e-645becf8f7cf tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:24.105019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5ea2de8-6a4a-4ecb-8b0e-645becf8f7cf tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:24.105708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5ea2de8-6a4a-4ecb-8b0e-645becf8f7cf tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:24.455961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f5ea2de8-6a4a-4ecb-8b0e-645becf8f7cf tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:24.471077 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f5ea2de8-6a4a-4ecb-8b0e-645becf8f7cf tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4" status: 200 len: 1318 microversion: 2.1 time: 0.390478 Sep 07 13:09:24.492343 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2879/5798] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:24 2022] GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4 => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:24.649302 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-467fed65-6275-46c7-9a83-8080e3fe0829 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:24.652730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-467fed65-6275-46c7-9a83-8080e3fe0829 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:24.671318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-467fed65-6275-46c7-9a83-8080e3fe0829 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:24.674961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-467fed65-6275-46c7-9a83-8080e3fe0829 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:24.676220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-467fed65-6275-46c7-9a83-8080e3fe0829 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:24.681280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-467fed65-6275-46c7-9a83-8080e3fe0829 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:24.683867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-467fed65-6275-46c7-9a83-8080e3fe0829 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:24.686450 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-467fed65-6275-46c7-9a83-8080e3fe0829 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:24.780990 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-467fed65-6275-46c7-9a83-8080e3fe0829 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138722 Sep 07 13:09:24.792277 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2920/5799] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:09:24 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:25.503195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2dbdb17a-76f1-48e3-9352-558d49d82ddc tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:25.504955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2dbdb17a-76f1-48e3-9352-558d49d82ddc tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: b6fc8dec-29e5-4879-b83a-e15a9b37dda4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:25.522388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dbdb17a-76f1-48e3-9352-558d49d82ddc tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:25.525851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dbdb17a-76f1-48e3-9352-558d49d82ddc tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:25.526563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dbdb17a-76f1-48e3-9352-558d49d82ddc tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:25.529855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dbdb17a-76f1-48e3-9352-558d49d82ddc tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:25.542772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dbdb17a-76f1-48e3-9352-558d49d82ddc tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:25.544864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dbdb17a-76f1-48e3-9352-558d49d82ddc tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:25.796010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fa100580-103c-4d80-8e32-f87a3fe72926 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:25.805741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fa100580-103c-4d80-8e32-f87a3fe72926 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:25.832553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa100580-103c-4d80-8e32-f87a3fe72926 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:25.840784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa100580-103c-4d80-8e32-f87a3fe72926 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:25.841402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa100580-103c-4d80-8e32-f87a3fe72926 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:25.842349 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa100580-103c-4d80-8e32-f87a3fe72926 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:25.842915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa100580-103c-4d80-8e32-f87a3fe72926 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:25.848905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa100580-103c-4d80-8e32-f87a3fe72926 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:25.940683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2dbdb17a-76f1-48e3-9352-558d49d82ddc tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:25.959770 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fa100580-103c-4d80-8e32-f87a3fe72926 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168054 Sep 07 13:09:25.961450 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2dbdb17a-76f1-48e3-9352-558d49d82ddc tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4" status: 200 len: 1318 microversion: 2.1 time: 0.464654 Sep 07 13:09:25.962923 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2880/5800] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:25 2022] GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4 => generated 1318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:09:25.966650 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2921/5801] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:09:25 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:26.880992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9aa0772b-9d69-428c-b067-ea019bce062e req-083bf03f-af49-4aba-bb2b-81dfed65a841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6fc8dec-29e5-4879-b83a-e15a9b37dda4", "name": "network-vif-plugged", "status": "completed", "tag": "4fa5a024-9da7-430e-9773-ba94fad40100"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:09:26.911008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9aa0772b-9d69-428c-b067-ea019bce062e req-083bf03f-af49-4aba-bb2b-81dfed65a841 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:26.911789 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9aa0772b-9d69-428c-b067-ea019bce062e req-083bf03f-af49-4aba-bb2b-81dfed65a841 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:26.912473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9aa0772b-9d69-428c-b067-ea019bce062e req-083bf03f-af49-4aba-bb2b-81dfed65a841 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:26.930990 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9aa0772b-9d69-428c-b067-ea019bce062e req-083bf03f-af49-4aba-bb2b-81dfed65a841 service nova] Creating event network-vif-plugged:4fa5a024-9da7-430e-9773-ba94fad40100 for instance b6fc8dec-29e5-4879-b83a-e15a9b37dda4 on n-h1-852087-9 Sep 07 13:09:26.942829 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9aa0772b-9d69-428c-b067-ea019bce062e req-083bf03f-af49-4aba-bb2b-81dfed65a841 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067019 Sep 07 13:09:26.944343 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2881/5802] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:26.973427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-63cf3d15-e6af-4f8f-9ee7-95eef5e0da94 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:26.976136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-63cf3d15-e6af-4f8f-9ee7-95eef5e0da94 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:26.995822 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63cf3d15-e6af-4f8f-9ee7-95eef5e0da94 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:27.000231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63cf3d15-e6af-4f8f-9ee7-95eef5e0da94 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:27.002468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63cf3d15-e6af-4f8f-9ee7-95eef5e0da94 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:27.008333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63cf3d15-e6af-4f8f-9ee7-95eef5e0da94 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:27.009172 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63cf3d15-e6af-4f8f-9ee7-95eef5e0da94 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:27.010558 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-63cf3d15-e6af-4f8f-9ee7-95eef5e0da94 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:27.020534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b5378093-0441-4319-917c-ecd2c441add4 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:27.021537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b5378093-0441-4319-917c-ecd2c441add4 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: b6fc8dec-29e5-4879-b83a-e15a9b37dda4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:27.073688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5378093-0441-4319-917c-ecd2c441add4 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:27.075147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5378093-0441-4319-917c-ecd2c441add4 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:27.076254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5378093-0441-4319-917c-ecd2c441add4 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:27.082985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5378093-0441-4319-917c-ecd2c441add4 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:27.084287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5378093-0441-4319-917c-ecd2c441add4 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:27.085558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5378093-0441-4319-917c-ecd2c441add4 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:27.140343 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-63cf3d15-e6af-4f8f-9ee7-95eef5e0da94 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165876 Sep 07 13:09:27.144520 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2922/5803] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:09:26 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:09:27.794069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b5378093-0441-4319-917c-ecd2c441add4 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:27.840588 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b5378093-0441-4319-917c-ecd2c441add4 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4" status: 200 len: 1318 microversion: 2.1 time: 0.835250 Sep 07 13:09:27.909296 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2882/5804] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:27 2022] GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4 => generated 1318 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:28.159075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-19ccae2d-3a3e-4d2c-9aab-bf3bc5777ef7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:28.166533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-19ccae2d-3a3e-4d2c-9aab-bf3bc5777ef7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:28.190344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19ccae2d-3a3e-4d2c-9aab-bf3bc5777ef7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:28.194230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19ccae2d-3a3e-4d2c-9aab-bf3bc5777ef7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:28.197982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19ccae2d-3a3e-4d2c-9aab-bf3bc5777ef7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:28.201804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19ccae2d-3a3e-4d2c-9aab-bf3bc5777ef7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:28.202408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19ccae2d-3a3e-4d2c-9aab-bf3bc5777ef7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:28.205279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19ccae2d-3a3e-4d2c-9aab-bf3bc5777ef7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:28.327906 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-19ccae2d-3a3e-4d2c-9aab-bf3bc5777ef7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175445 Sep 07 13:09:28.329032 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2923/5805] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:09:28 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:28.897109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6b6bc773-b08f-44fc-b7bb-c490a5413620 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:28.901257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6b6bc773-b08f-44fc-b7bb-c490a5413620 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: b6fc8dec-29e5-4879-b83a-e15a9b37dda4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:28.950632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b6bc773-b08f-44fc-b7bb-c490a5413620 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:28.959082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b6bc773-b08f-44fc-b7bb-c490a5413620 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:28.963952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b6bc773-b08f-44fc-b7bb-c490a5413620 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:28.969124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b6bc773-b08f-44fc-b7bb-c490a5413620 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:28.975339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b6bc773-b08f-44fc-b7bb-c490a5413620 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:28.976647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b6bc773-b08f-44fc-b7bb-c490a5413620 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:29.355713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de271deb-12cd-493e-bfee-ab041a27d621 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:29.368012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-de271deb-12cd-493e-bfee-ab041a27d621 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:29.402767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de271deb-12cd-493e-bfee-ab041a27d621 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:29.404010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de271deb-12cd-493e-bfee-ab041a27d621 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:29.408548 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de271deb-12cd-493e-bfee-ab041a27d621 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:29.414501 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de271deb-12cd-493e-bfee-ab041a27d621 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:29.415909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de271deb-12cd-493e-bfee-ab041a27d621 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:29.435992 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de271deb-12cd-493e-bfee-ab041a27d621 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:29.635588 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-de271deb-12cd-493e-bfee-ab041a27d621 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.292698 Sep 07 13:09:29.642966 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2924/5806] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:09:29 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments => generated 197 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:30.402759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6b6bc773-b08f-44fc-b7bb-c490a5413620 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:30.414386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:30.417728 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6b6bc773-b08f-44fc-b7bb-c490a5413620 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4" status: 200 len: 1318 microversion: 2.1 time: 1.529979 Sep 07 13:09:30.419324 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2883/5807] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:28 2022] GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4 => generated 1318 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:30.655235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2eb1e367-3845-4d8c-bd8d-b965b8bf7821 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:30.663255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2eb1e367-3845-4d8c-bd8d-b965b8bf7821 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:30.705819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2eb1e367-3845-4d8c-bd8d-b965b8bf7821 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:30.706621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2eb1e367-3845-4d8c-bd8d-b965b8bf7821 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:30.707326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2eb1e367-3845-4d8c-bd8d-b965b8bf7821 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:30.708519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2eb1e367-3845-4d8c-bd8d-b965b8bf7821 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:30.709636 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2eb1e367-3845-4d8c-bd8d-b965b8bf7821 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:30.710541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2eb1e367-3845-4d8c-bd8d-b965b8bf7821 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:30.800395 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2eb1e367-3845-4d8c-bd8d-b965b8bf7821 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153687 Sep 07 13:09:30.809837 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2925/5808] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:09:30 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:31.479187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-66b5adf8-6bca-4841-bf70-671de3f64551 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:31.480992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-66b5adf8-6bca-4841-bf70-671de3f64551 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: b6fc8dec-29e5-4879-b83a-e15a9b37dda4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:31.506146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=29 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:31.511288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66b5adf8-6bca-4841-bf70-671de3f64551 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:31.514369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66b5adf8-6bca-4841-bf70-671de3f64551 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:31.515174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66b5adf8-6bca-4841-bf70-671de3f64551 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:31.518813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66b5adf8-6bca-4841-bf70-671de3f64551 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:31.519644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66b5adf8-6bca-4841-bf70-671de3f64551 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:31.521425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66b5adf8-6bca-4841-bf70-671de3f64551 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:31.826777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cb532681-7251-4f41-b505-39ea0598cb3d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:31.839061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cb532681-7251-4f41-b505-39ea0598cb3d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:31.879727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb532681-7251-4f41-b505-39ea0598cb3d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:31.910612 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb532681-7251-4f41-b505-39ea0598cb3d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:31.912590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb532681-7251-4f41-b505-39ea0598cb3d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:31.917095 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb532681-7251-4f41-b505-39ea0598cb3d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:31.918047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb532681-7251-4f41-b505-39ea0598cb3d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:31.919442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cb532681-7251-4f41-b505-39ea0598cb3d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:32.036224 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cb532681-7251-4f41-b505-39ea0598cb3d tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.220510 Sep 07 13:09:32.037887 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2926/5809] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:09:31 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments => generated 197 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:32.788433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-66b5adf8-6bca-4841-bf70-671de3f64551 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:32.836022 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-66b5adf8-6bca-4841-bf70-671de3f64551 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4" status: 200 len: 1506 microversion: 2.1 time: 1.392845 Sep 07 13:09:32.844852 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2884/5810] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:31 2022] GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4 => generated 1506 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:33.059857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-74fdd4fc-693c-4f3d-84c9-72cc2513e5db tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:33.072203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-74fdd4fc-693c-4f3d-84c9-72cc2513e5db tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:33.101774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74fdd4fc-693c-4f3d-84c9-72cc2513e5db tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:33.104468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74fdd4fc-693c-4f3d-84c9-72cc2513e5db tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:33.105903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74fdd4fc-693c-4f3d-84c9-72cc2513e5db tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:33.107724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74fdd4fc-693c-4f3d-84c9-72cc2513e5db tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:33.113832 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74fdd4fc-693c-4f3d-84c9-72cc2513e5db tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:33.117049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74fdd4fc-693c-4f3d-84c9-72cc2513e5db tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:33.277266 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-74fdd4fc-693c-4f3d-84c9-72cc2513e5db tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.226683 Sep 07 13:09:33.278421 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2927/5811] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:09:33 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments => generated 197 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:34.304862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c2eeb371-ba76-4645-9753-69b136fcf375 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:34.320535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c2eeb371-ba76-4645-9753-69b136fcf375 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:34.346172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2eeb371-ba76-4645-9753-69b136fcf375 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:34.347799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2eeb371-ba76-4645-9753-69b136fcf375 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:34.348847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2eeb371-ba76-4645-9753-69b136fcf375 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:34.358407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2eeb371-ba76-4645-9753-69b136fcf375 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:34.360486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2eeb371-ba76-4645-9753-69b136fcf375 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:34.364553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2eeb371-ba76-4645-9753-69b136fcf375 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:34.644723 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c2eeb371-ba76-4645-9753-69b136fcf375 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.354376 Sep 07 13:09:34.648475 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2885/5812] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:09:34 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments => generated 197 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:35.669766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-baba4de0-4abc-48a5-ba5f-b5abf7c3271e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:35.677196 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-baba4de0-4abc-48a5-ba5f-b5abf7c3271e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:35.705433 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:35.768418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-baba4de0-4abc-48a5-ba5f-b5abf7c3271e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:35.772934 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-baba4de0-4abc-48a5-ba5f-b5abf7c3271e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:35.778086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-baba4de0-4abc-48a5-ba5f-b5abf7c3271e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:35.783829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-baba4de0-4abc-48a5-ba5f-b5abf7c3271e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:35.789392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-baba4de0-4abc-48a5-ba5f-b5abf7c3271e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:35.791004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-baba4de0-4abc-48a5-ba5f-b5abf7c3271e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:35.849268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=83 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:35.998278 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-baba4de0-4abc-48a5-ba5f-b5abf7c3271e tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.336513 Sep 07 13:09:36.004464 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2928/5813] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:09:35 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments => generated 197 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:09:37.024095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ebb40877-5865-41f8-98e0-1eac66342324 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:37.043164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ebb40877-5865-41f8-98e0-1eac66342324 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:37.093508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebb40877-5865-41f8-98e0-1eac66342324 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:37.098871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebb40877-5865-41f8-98e0-1eac66342324 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:37.102456 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebb40877-5865-41f8-98e0-1eac66342324 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:37.111406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebb40877-5865-41f8-98e0-1eac66342324 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:37.112621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebb40877-5865-41f8-98e0-1eac66342324 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:37.117995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebb40877-5865-41f8-98e0-1eac66342324 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:37.265279 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ebb40877-5865-41f8-98e0-1eac66342324 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.249906 Sep 07 13:09:37.280341 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2886/5814] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:09:37 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4/os-volume_attachments => generated 25 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:09:37.499382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-50009e4a-520e-43fa-b33b-6d46f41f9e79 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:37.505284 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-50009e4a-520e-43fa-b33b-6d46f41f9e79 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:37.537060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50009e4a-520e-43fa-b33b-6d46f41f9e79 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:37.540452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50009e4a-520e-43fa-b33b-6d46f41f9e79 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:37.543099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50009e4a-520e-43fa-b33b-6d46f41f9e79 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:37.544911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50009e4a-520e-43fa-b33b-6d46f41f9e79 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:37.559801 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50009e4a-520e-43fa-b33b-6d46f41f9e79 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:37.563679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50009e4a-520e-43fa-b33b-6d46f41f9e79 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:37.690506 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-50009e4a-520e-43fa-b33b-6d46f41f9e79 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:09:38.001846 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-50009e4a-520e-43fa-b33b-6d46f41f9e79 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 204 len: 0 microversion: 2.1 time: 0.520351 Sep 07 13:09:38.012999 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2929/5815] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:09:37 2022] DELETE /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:09:38.024610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b3915641-1b79-447d-9d64-d4b481240ab2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:38.025998 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b3915641-1b79-447d-9d64-d4b481240ab2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:38.055062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3915641-1b79-447d-9d64-d4b481240ab2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:38.064680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3915641-1b79-447d-9d64-d4b481240ab2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:38.067891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3915641-1b79-447d-9d64-d4b481240ab2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:38.074850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3915641-1b79-447d-9d64-d4b481240ab2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:38.076165 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3915641-1b79-447d-9d64-d4b481240ab2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:38.077162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3915641-1b79-447d-9d64-d4b481240ab2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:38.663446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b3915641-1b79-447d-9d64-d4b481240ab2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:38.719238 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b3915641-1b79-447d-9d64-d4b481240ab2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 200 len: 1681 microversion: 2.1 time: 0.703306 Sep 07 13:09:38.733517 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2887/5816] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:38 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 1681 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:39.753854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-16d28444-65a1-4aa8-9526-758cd4878ef2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:39.754811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-16d28444-65a1-4aa8-9526-758cd4878ef2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:39.788470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16d28444-65a1-4aa8-9526-758cd4878ef2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:39.791601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16d28444-65a1-4aa8-9526-758cd4878ef2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:39.798466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16d28444-65a1-4aa8-9526-758cd4878ef2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:39.821235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16d28444-65a1-4aa8-9526-758cd4878ef2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:39.825932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16d28444-65a1-4aa8-9526-758cd4878ef2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:39.830345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16d28444-65a1-4aa8-9526-758cd4878ef2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:40.610499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-16d28444-65a1-4aa8-9526-758cd4878ef2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:40.628566 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-16d28444-65a1-4aa8-9526-758cd4878ef2 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 200 len: 1681 microversion: 2.1 time: 0.883568 Sep 07 13:09:40.639562 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2930/5817] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:39 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 1681 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:41.671925 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-04634db9-10a4-456e-9f70-522d5fa9e3d8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:41.680388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-04634db9-10a4-456e-9f70-522d5fa9e3d8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:41.707581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04634db9-10a4-456e-9f70-522d5fa9e3d8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:41.722263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04634db9-10a4-456e-9f70-522d5fa9e3d8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:41.729959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04634db9-10a4-456e-9f70-522d5fa9e3d8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:41.743639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04634db9-10a4-456e-9f70-522d5fa9e3d8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:41.746284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04634db9-10a4-456e-9f70-522d5fa9e3d8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:41.746284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04634db9-10a4-456e-9f70-522d5fa9e3d8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:43.112679 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-04634db9-10a4-456e-9f70-522d5fa9e3d8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:43.129085 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-04634db9-10a4-456e-9f70-522d5fa9e3d8 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 200 len: 1681 microversion: 2.1 time: 1.464790 Sep 07 13:09:43.146719 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2888/5818] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:41 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 1681 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:44.186897 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-60bd811d-284d-4e37-ad86-d73722252bf7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:44.196078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-60bd811d-284d-4e37-ad86-d73722252bf7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:44.238108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60bd811d-284d-4e37-ad86-d73722252bf7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:44.254909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60bd811d-284d-4e37-ad86-d73722252bf7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:44.256575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60bd811d-284d-4e37-ad86-d73722252bf7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:44.259664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60bd811d-284d-4e37-ad86-d73722252bf7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:44.280300 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60bd811d-284d-4e37-ad86-d73722252bf7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:44.282316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60bd811d-284d-4e37-ad86-d73722252bf7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:44.601739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-60bd811d-284d-4e37-ad86-d73722252bf7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:44.644854 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-60bd811d-284d-4e37-ad86-d73722252bf7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 200 len: 1613 microversion: 2.1 time: 0.477221 Sep 07 13:09:44.654790 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2931/5819] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:44 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 1613 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:09:45.679708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d84b524a-2730-4cf2-b17c-8f0e166acabd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:45.680476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d84b524a-2730-4cf2-b17c-8f0e166acabd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:45.710957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d84b524a-2730-4cf2-b17c-8f0e166acabd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:45.711493 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d84b524a-2730-4cf2-b17c-8f0e166acabd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:45.711951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d84b524a-2730-4cf2-b17c-8f0e166acabd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:45.723855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d84b524a-2730-4cf2-b17c-8f0e166acabd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:45.725540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d84b524a-2730-4cf2-b17c-8f0e166acabd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:45.727996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d84b524a-2730-4cf2-b17c-8f0e166acabd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:46.410120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d84b524a-2730-4cf2-b17c-8f0e166acabd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f85a4002bd40eb8514aa91056c77d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9b61f78ca140c5870961647ff04cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:09:46.440193 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d84b524a-2730-4cf2-b17c-8f0e166acabd tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 200 len: 1613 microversion: 2.1 time: 0.763471 Sep 07 13:09:46.442453 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2889/5820] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:45 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 1613 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:09:46.957788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-443f580f-97bd-4cda-9139-15f7d771b996 req-63481053-ebd7-423a-84f2-efeb1f226b55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99032d9-37f6-4c7d-b813-207e3190d4b4", "name": "network-vif-deleted", "tag": "2ffae4f2-ea5d-46a1-8de9-3a5145fd0b77"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:09:46.980301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-443f580f-97bd-4cda-9139-15f7d771b996 req-63481053-ebd7-423a-84f2-efeb1f226b55 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:46.981247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-443f580f-97bd-4cda-9139-15f7d771b996 req-63481053-ebd7-423a-84f2-efeb1f226b55 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:46.981951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-443f580f-97bd-4cda-9139-15f7d771b996 req-63481053-ebd7-423a-84f2-efeb1f226b55 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:47.000808 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-443f580f-97bd-4cda-9139-15f7d771b996 req-63481053-ebd7-423a-84f2-efeb1f226b55 service nova] Creating event network-vif-deleted:2ffae4f2-ea5d-46a1-8de9-3a5145fd0b77 for instance a99032d9-37f6-4c7d-b813-207e3190d4b4 on n-h2-852087-9 Sep 07 13:09:47.011613 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-443f580f-97bd-4cda-9139-15f7d771b996 req-63481053-ebd7-423a-84f2-efeb1f226b55 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.614510 Sep 07 13:09:47.012572 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2932/5821] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:09:47.494602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c7f77ba7-a7c9-4a72-8b69-d8a1efbc81ac tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:47.495447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c7f77ba7-a7c9-4a72-8b69-d8a1efbc81ac tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:09:47.522578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7f77ba7-a7c9-4a72-8b69-d8a1efbc81ac tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:47.523351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7f77ba7-a7c9-4a72-8b69-d8a1efbc81ac tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:47.523824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7f77ba7-a7c9-4a72-8b69-d8a1efbc81ac tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:47.526543 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7f77ba7-a7c9-4a72-8b69-d8a1efbc81ac tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:09:47.528808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7f77ba7-a7c9-4a72-8b69-d8a1efbc81ac tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:09:47.529318 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7f77ba7-a7c9-4a72-8b69-d8a1efbc81ac tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:09:47.575374 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-c7f77ba7-a7c9-4a72-8b69-d8a1efbc81ac tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] HTTP exception thrown: Instance a99032d9-37f6-4c7d-b813-207e3190d4b4 could not be found. Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c7f77ba7-a7c9-4a72-8b69-d8a1efbc81ac tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Request method failure captured: Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 HTTP/1.1 Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJXjmtPm9YRFN-tztsi8TNQI9Hp8XLmIE4m4vovyCrvi10-eliNzw5RJ69qhXEwc5_GMz3l7wuK2ojP23vdsllISKFk4XviY8iZt7qikWDIyUcyEqbNGcGcZaYafPWwxZ6tUqEf0DAj26macVBxWQF5nsZe6v99sjs3_jT8xGYwPOpM Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: c9f85a4002bd40eb8514aa91056c77d8 Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance a99032d9-37f6-4c7d-b813-207e3190d4b4 could not be found. Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'a99032d9-37f6-4c7d-b813-207e3190d4b4'} Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a99032d9-37f6-4c7d-b813-207e3190d4b4 could not be found. Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a99032d9-37f6-4c7d-b813-207e3190d4b4 could not be found. Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:09:47.588288 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:09:47.593734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:09:47.593734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:09:47.593734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:09:47.593734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:09:47.593734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:09:47.593734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a99032d9-37f6-4c7d-b813-207e3190d4b4 could not be found. Sep 07 13:09:47.593734 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:09:47.603707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c7f77ba7-a7c9-4a72-8b69-d8a1efbc81ac tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Returning 404 to user: Instance a99032d9-37f6-4c7d-b813-207e3190d4b4 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:09:47.606639 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c7f77ba7-a7c9-4a72-8b69-d8a1efbc81ac tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 404 len: 111 microversion: 2.1 time: 0.115807 Sep 07 13:09:47.609862 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2890/5822] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:09:47 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:09:47.621414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d1bd14db-dde7-4442-bdbd-a05af7bedcd9 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '.version_select at 0x7fc418bf7160>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:09:47.680913 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d1bd14db-dde7-4442-bdbd-a05af7bedcd9 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-350590180" status: 202 len: 0 microversion: 2.1 time: 0.064397 Sep 07 13:09:47.687500 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2933/5823] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Sep 7 13:09:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-350590180 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:10:03.290626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5112182c-6192-42f6-8df8-55a34ab6e572 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:03.294302 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5112182c-6192-42f6-8df8-55a34ab6e572 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:03.327654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=13 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:03.331861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=39 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:03.338373 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:10:03.339585 n-d-852087-9 devstack@n-api.service[122432]: Wed Sep 7 13:10:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 (ip 10.222.0.16) !!! Sep 07 13:10:03.354349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5112182c-6192-42f6-8df8-55a34ab6e572 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:03.359237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5112182c-6192-42f6-8df8-55a34ab6e572 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:03.368787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5112182c-6192-42f6-8df8-55a34ab6e572 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:03.373893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5112182c-6192-42f6-8df8-55a34ab6e572 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:03.376482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5112182c-6192-42f6-8df8-55a34ab6e572 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:03.407656 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5112182c-6192-42f6-8df8-55a34ab6e572 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:03.502715 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-5112182c-6192-42f6-8df8-55a34ab6e572 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] HTTP exception thrown: Instance a99032d9-37f6-4c7d-b813-207e3190d4b4 could not be found. Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5112182c-6192-42f6-8df8-55a34ab6e572 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Request method failure captured: Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 HTTP/1.1 Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJXjmtPm9YRFN-tztsi8TNQI9Hp8XLmIE4m4vovyCrvi10-eliNzw5RJ69qhXEwc5_GMz3l7wuK2ojP23vdsllISKFk4XviY8iZt7qikWDIyUcyEqbNGcGcZaYafPWwxZ6tUqEf0DAj26macVBxWQF5nsZe6v99sjs3_jT8xGYwPOpM Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: c9f85a4002bd40eb8514aa91056c77d8 Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance a99032d9-37f6-4c7d-b813-207e3190d4b4 could not be found. Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'a99032d9-37f6-4c7d-b813-207e3190d4b4'} Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a99032d9-37f6-4c7d-b813-207e3190d4b4 could not be found. Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:10:03.508971 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:10:03.520474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a99032d9-37f6-4c7d-b813-207e3190d4b4 could not be found. Sep 07 13:10:03.520474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:10:03.520474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:03.520474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:10:03.520474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:03.520474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:03.520474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:03.520474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:10:03.520474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:10:03.520474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a99032d9-37f6-4c7d-b813-207e3190d4b4 could not be found. Sep 07 13:10:03.520474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:10:03.525849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5112182c-6192-42f6-8df8-55a34ab6e572 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Returning 404 to user: Instance a99032d9-37f6-4c7d-b813-207e3190d4b4 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:10:03.528456 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5112182c-6192-42f6-8df8-55a34ab6e572 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 404 len: 111 microversion: 2.1 time: 0.251809 Sep 07 13:10:03.530011 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2891/5824] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:10:03 2022] DELETE /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 111 bytes in 255 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:10:03.544825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a328b425-940e-4ed1-9109-9036ccd7c9da tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:03.546055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a328b425-940e-4ed1-9109-9036ccd7c9da tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: a99032d9-37f6-4c7d-b813-207e3190d4b4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:03.552402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:03.554233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:03.584344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a328b425-940e-4ed1-9109-9036ccd7c9da tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:03.589702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a328b425-940e-4ed1-9109-9036ccd7c9da tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:03.595398 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a328b425-940e-4ed1-9109-9036ccd7c9da tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:03.597474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a328b425-940e-4ed1-9109-9036ccd7c9da tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:03.607505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a328b425-940e-4ed1-9109-9036ccd7c9da tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:03.610826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a328b425-940e-4ed1-9109-9036ccd7c9da tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:03.674724 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-a328b425-940e-4ed1-9109-9036ccd7c9da tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] HTTP exception thrown: Instance a99032d9-37f6-4c7d-b813-207e3190d4b4 could not be found. Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a328b425-940e-4ed1-9109-9036ccd7c9da tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Request method failure captured: Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 HTTP/1.1 Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJXjmtPm9YRFN-tztsi8TNQI9Hp8XLmIE4m4vovyCrvi10-eliNzw5RJ69qhXEwc5_GMz3l7wuK2ojP23vdsllISKFk4XviY8iZt7qikWDIyUcyEqbNGcGcZaYafPWwxZ6tUqEf0DAj26macVBxWQF5nsZe6v99sjs3_jT8xGYwPOpM Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: c9f85a4002bd40eb8514aa91056c77d8 Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance a99032d9-37f6-4c7d-b813-207e3190d4b4 could not be found. Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'a99032d9-37f6-4c7d-b813-207e3190d4b4'} Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a99032d9-37f6-4c7d-b813-207e3190d4b4 could not be found. Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a99032d9-37f6-4c7d-b813-207e3190d4b4 could not be found. Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:03.677723 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:10:03.681548 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:03.681548 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:03.681548 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:03.681548 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:10:03.681548 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:10:03.681548 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a99032d9-37f6-4c7d-b813-207e3190d4b4 could not be found. Sep 07 13:10:03.681548 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:10:03.686196 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a328b425-940e-4ed1-9109-9036ccd7c9da tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Returning 404 to user: Instance a99032d9-37f6-4c7d-b813-207e3190d4b4 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:10:03.688107 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a328b425-940e-4ed1-9109-9036ccd7c9da tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4" status: 404 len: 111 microversion: 2.1 time: 0.151452 Sep 07 13:10:03.692713 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2934/5825] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:03 2022] GET /compute/v2.1/servers/a99032d9-37f6-4c7d-b813-207e3190d4b4 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:10:13.974304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c0f4b7ff-ab52-414c-b7fd-cf089d2f35d0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:13.975225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c0f4b7ff-ab52-414c-b7fd-cf089d2f35d0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:14.022946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:14.024200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:14.027684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0f4b7ff-ab52-414c-b7fd-cf089d2f35d0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:14.028682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0f4b7ff-ab52-414c-b7fd-cf089d2f35d0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:14.029500 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0f4b7ff-ab52-414c-b7fd-cf089d2f35d0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:14.030891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0f4b7ff-ab52-414c-b7fd-cf089d2f35d0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:14.045924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0f4b7ff-ab52-414c-b7fd-cf089d2f35d0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:14.046965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0f4b7ff-ab52-414c-b7fd-cf089d2f35d0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:14.156184 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-c0f4b7ff-ab52-414c-b7fd-cf089d2f35d0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] HTTP exception thrown: Instance c3531114-92cc-4ecb-a97c-0c05170f41f8 could not be found. Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c0f4b7ff-ab52-414c-b7fd-cf089d2f35d0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Request method failure captured: Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8 HTTP/1.1 Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJXjmtPm9YRFN-tztsi8TNQI9Hp8XLmIE4m4vovyCrvi10-eliNzw5RJ69qhXEwc5_GMz3l7wuK2ojP23vdsllISKFk4XviY8iZt7qikWDIyUcyEqbNGcGcZaYafPWwxZ6tUqEf0DAj26macVBxWQF5nsZe6v99sjs3_jT8xGYwPOpM Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: c9f85a4002bd40eb8514aa91056c77d8 Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance c3531114-92cc-4ecb-a97c-0c05170f41f8 could not be found. Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'c3531114-92cc-4ecb-a97c-0c05170f41f8'} Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3531114-92cc-4ecb-a97c-0c05170f41f8 could not be found. Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:10:14.163789 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:10:14.169223 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3531114-92cc-4ecb-a97c-0c05170f41f8 could not be found. Sep 07 13:10:14.169223 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:10:14.169223 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:14.169223 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:10:14.169223 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:14.169223 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:14.169223 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:14.169223 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:10:14.169223 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:10:14.169223 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3531114-92cc-4ecb-a97c-0c05170f41f8 could not be found. Sep 07 13:10:14.169223 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:10:14.169223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c0f4b7ff-ab52-414c-b7fd-cf089d2f35d0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Returning 404 to user: Instance c3531114-92cc-4ecb-a97c-0c05170f41f8 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:10:14.180818 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c0f4b7ff-ab52-414c-b7fd-cf089d2f35d0 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8" status: 404 len: 111 microversion: 2.1 time: 0.217662 Sep 07 13:10:14.181931 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2892/5826] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:10:13 2022] DELETE /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8 => generated 111 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:10:14.195918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3d779a0-d157-4b03-9335-a638ed4a5d19 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:14.197117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d3d779a0-d157-4b03-9335-a638ed4a5d19 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: c3531114-92cc-4ecb-a97c-0c05170f41f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:14.213278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:14.219912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:14.243808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3d779a0-d157-4b03-9335-a638ed4a5d19 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:14.248439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3d779a0-d157-4b03-9335-a638ed4a5d19 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:14.249336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3d779a0-d157-4b03-9335-a638ed4a5d19 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:14.263705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3d779a0-d157-4b03-9335-a638ed4a5d19 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:14.263705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3d779a0-d157-4b03-9335-a638ed4a5d19 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:14.263705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3d779a0-d157-4b03-9335-a638ed4a5d19 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:14.307347 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-d3d779a0-d157-4b03-9335-a638ed4a5d19 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] HTTP exception thrown: Instance c3531114-92cc-4ecb-a97c-0c05170f41f8 could not be found. Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3d779a0-d157-4b03-9335-a638ed4a5d19 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Request method failure captured: Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8 HTTP/1.1 Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJXjmtPm9YRFN-tztsi8TNQI9Hp8XLmIE4m4vovyCrvi10-eliNzw5RJ69qhXEwc5_GMz3l7wuK2ojP23vdsllISKFk4XviY8iZt7qikWDIyUcyEqbNGcGcZaYafPWwxZ6tUqEf0DAj26macVBxWQF5nsZe6v99sjs3_jT8xGYwPOpM Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: c9f85a4002bd40eb8514aa91056c77d8 Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance c3531114-92cc-4ecb-a97c-0c05170f41f8 could not be found. Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'c3531114-92cc-4ecb-a97c-0c05170f41f8'} Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3531114-92cc-4ecb-a97c-0c05170f41f8 could not be found. Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3531114-92cc-4ecb-a97c-0c05170f41f8 could not be found. Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:14.320522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:10:14.325131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:14.325131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:14.325131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:14.325131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:10:14.325131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:10:14.325131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3531114-92cc-4ecb-a97c-0c05170f41f8 could not be found. Sep 07 13:10:14.325131 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:10:14.334508 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3d779a0-d157-4b03-9335-a638ed4a5d19 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Returning 404 to user: Instance c3531114-92cc-4ecb-a97c-0c05170f41f8 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:10:14.335827 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d3d779a0-d157-4b03-9335-a638ed4a5d19 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8" status: 404 len: 111 microversion: 2.1 time: 0.148428 Sep 07 13:10:14.337150 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2935/5827] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:14 2022] GET /compute/v2.1/servers/c3531114-92cc-4ecb-a97c-0c05170f41f8 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:10:14.351254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b81767ad-8906-423f-b9ab-81d0377dd1f7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:14.353758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b81767ad-8906-423f-b9ab-81d0377dd1f7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:14.387709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b81767ad-8906-423f-b9ab-81d0377dd1f7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:14.388505 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b81767ad-8906-423f-b9ab-81d0377dd1f7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:14.389297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b81767ad-8906-423f-b9ab-81d0377dd1f7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:14.404215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b81767ad-8906-423f-b9ab-81d0377dd1f7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:14.405173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b81767ad-8906-423f-b9ab-81d0377dd1f7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:14.406294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b81767ad-8906-423f-b9ab-81d0377dd1f7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:14.470047 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-b81767ad-8906-423f-b9ab-81d0377dd1f7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] HTTP exception thrown: Instance 925a496f-7b54-406f-8d4b-5470d75f637f could not be found. Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b81767ad-8906-423f-b9ab-81d0377dd1f7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Request method failure captured: Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f HTTP/1.1 Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJXjmtPm9YRFN-tztsi8TNQI9Hp8XLmIE4m4vovyCrvi10-eliNzw5RJ69qhXEwc5_GMz3l7wuK2ojP23vdsllISKFk4XviY8iZt7qikWDIyUcyEqbNGcGcZaYafPWwxZ6tUqEf0DAj26macVBxWQF5nsZe6v99sjs3_jT8xGYwPOpM Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: c9f85a4002bd40eb8514aa91056c77d8 Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 925a496f-7b54-406f-8d4b-5470d75f637f could not be found. Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '925a496f-7b54-406f-8d4b-5470d75f637f'} Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 925a496f-7b54-406f-8d4b-5470d75f637f could not be found. Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:10:14.471905 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:10:14.475872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 925a496f-7b54-406f-8d4b-5470d75f637f could not be found. Sep 07 13:10:14.475872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:10:14.475872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:14.475872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:10:14.475872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:14.475872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:14.475872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:14.475872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:10:14.475872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:10:14.475872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 925a496f-7b54-406f-8d4b-5470d75f637f could not be found. Sep 07 13:10:14.475872 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:10:14.481171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b81767ad-8906-423f-b9ab-81d0377dd1f7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Returning 404 to user: Instance 925a496f-7b54-406f-8d4b-5470d75f637f could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:10:14.482459 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b81767ad-8906-423f-b9ab-81d0377dd1f7 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "DELETE /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f" status: 404 len: 111 microversion: 2.1 time: 0.140479 Sep 07 13:10:14.483268 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2893/5828] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:10:14 2022] DELETE /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:10:14.493004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6c2f015b-9e00-4c5c-be13-f7425a342f65 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:14.493965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6c2f015b-9e00-4c5c-be13-f7425a342f65 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 925a496f-7b54-406f-8d4b-5470d75f637f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:14.505300 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c2f015b-9e00-4c5c-be13-f7425a342f65 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:14.506123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c2f015b-9e00-4c5c-be13-f7425a342f65 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:14.516726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c2f015b-9e00-4c5c-be13-f7425a342f65 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:14.517834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c2f015b-9e00-4c5c-be13-f7425a342f65 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:14.518487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c2f015b-9e00-4c5c-be13-f7425a342f65 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:14.519090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c2f015b-9e00-4c5c-be13-f7425a342f65 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:14.546995 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-6c2f015b-9e00-4c5c-be13-f7425a342f65 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] HTTP exception thrown: Instance 925a496f-7b54-406f-8d4b-5470d75f637f could not be found. Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6c2f015b-9e00-4c5c-be13-f7425a342f65 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Request method failure captured: Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f HTTP/1.1 Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJXjmtPm9YRFN-tztsi8TNQI9Hp8XLmIE4m4vovyCrvi10-eliNzw5RJ69qhXEwc5_GMz3l7wuK2ojP23vdsllISKFk4XviY8iZt7qikWDIyUcyEqbNGcGcZaYafPWwxZ6tUqEf0DAj26macVBxWQF5nsZe6v99sjs3_jT8xGYwPOpM Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: c9f85a4002bd40eb8514aa91056c77d8 Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 925a496f-7b54-406f-8d4b-5470d75f637f could not be found. Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '925a496f-7b54-406f-8d4b-5470d75f637f'} Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 925a496f-7b54-406f-8d4b-5470d75f637f could not be found. Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 925a496f-7b54-406f-8d4b-5470d75f637f could not be found. Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:14.549222 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:10:14.553066 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:14.553066 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:14.553066 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:14.553066 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:10:14.553066 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:10:14.553066 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 925a496f-7b54-406f-8d4b-5470d75f637f could not be found. Sep 07 13:10:14.553066 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:10:14.558532 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6c2f015b-9e00-4c5c-be13-f7425a342f65 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Returning 404 to user: Instance 925a496f-7b54-406f-8d4b-5470d75f637f could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:10:14.559773 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6c2f015b-9e00-4c5c-be13-f7425a342f65 tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f" status: 404 len: 111 microversion: 2.1 time: 0.071739 Sep 07 13:10:14.561229 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2936/5829] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:14 2022] GET /compute/v2.1/servers/925a496f-7b54-406f-8d4b-5470d75f637f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:10:29.010838 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a589a3d8-7501-4b5d-84fc-d9c16aca676b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:29.011406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a589a3d8-7501-4b5d-84fc-d9c16aca676b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:29.015482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:29.018874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:29.074435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a589a3d8-7501-4b5d-84fc-d9c16aca676b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:29.075694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a589a3d8-7501-4b5d-84fc-d9c16aca676b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:29.078251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a589a3d8-7501-4b5d-84fc-d9c16aca676b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:29.085268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a589a3d8-7501-4b5d-84fc-d9c16aca676b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:29.088210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a589a3d8-7501-4b5d-84fc-d9c16aca676b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:29.093916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a589a3d8-7501-4b5d-84fc-d9c16aca676b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:29.195268 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-a589a3d8-7501-4b5d-84fc-d9c16aca676b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] HTTP exception thrown: Instance 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 could not be found. Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a589a3d8-7501-4b5d-84fc-d9c16aca676b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Request method failure captured: Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63 HTTP/1.1 Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJXjmtPm9YRFN-tztsi8TNQI9Hp8XLmIE4m4vovyCrvi10-eliNzw5RJ69qhXEwc5_GMz3l7wuK2ojP23vdsllISKFk4XviY8iZt7qikWDIyUcyEqbNGcGcZaYafPWwxZ6tUqEf0DAj26macVBxWQF5nsZe6v99sjs3_jT8xGYwPOpM Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: c9f85a4002bd40eb8514aa91056c77d8 Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 could not be found. Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '0dbd6ebd-a395-40cf-9aee-a3ec45adac63'} Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 could not be found. Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:10:29.209350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:10:29.214204 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 could not be found. Sep 07 13:10:29.214204 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:10:29.214204 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:29.214204 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:10:29.214204 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:29.214204 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:29.214204 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:29.214204 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:10:29.214204 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:10:29.214204 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 could not be found. Sep 07 13:10:29.214204 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:10:29.214204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a589a3d8-7501-4b5d-84fc-d9c16aca676b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Returning 404 to user: Instance 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:10:29.220259 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a589a3d8-7501-4b5d-84fc-d9c16aca676b tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63" status: 404 len: 111 microversion: 2.1 time: 0.213485 Sep 07 13:10:29.221306 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2894/5830] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:10:29 2022] DELETE /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63 => generated 111 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:10:29.230999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-34f72118-c79a-4fba-b60b-79e6f042fa2a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:10:29.232332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-34f72118-c79a-4fba-b60b-79e6f042fa2a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] [instance: 0dbd6ebd-a395-40cf-9aee-a3ec45adac63] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:29.241682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:29.243005 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:29.273996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34f72118-c79a-4fba-b60b-79e6f042fa2a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:29.275008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34f72118-c79a-4fba-b60b-79e6f042fa2a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:29.275625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34f72118-c79a-4fba-b60b-79e6f042fa2a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:29.276861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34f72118-c79a-4fba-b60b-79e6f042fa2a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:29.277960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34f72118-c79a-4fba-b60b-79e6f042fa2a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:29.285291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-34f72118-c79a-4fba-b60b-79e6f042fa2a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:29.337414 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-34f72118-c79a-4fba-b60b-79e6f042fa2a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] HTTP exception thrown: Instance 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 could not be found. Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-34f72118-c79a-4fba-b60b-79e6f042fa2a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Request method failure captured: Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63 HTTP/1.1 Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJXjmtPm9YRFN-tztsi8TNQI9Hp8XLmIE4m4vovyCrvi10-eliNzw5RJ69qhXEwc5_GMz3l7wuK2ojP23vdsllISKFk4XviY8iZt7qikWDIyUcyEqbNGcGcZaYafPWwxZ6tUqEf0DAj26macVBxWQF5nsZe6v99sjs3_jT8xGYwPOpM Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb9b61f78ca140c5870961647ff04cfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: cb9b61f78ca140c5870961647ff04cfe Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544363165 Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: c9f85a4002bd40eb8514aa91056c77d8 Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-AttachVolumeNegativeTest-544363165-project Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 could not be found. Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '0dbd6ebd-a395-40cf-9aee-a3ec45adac63'} Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 could not be found. Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 could not be found. Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:10:29.345411 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:10:29.356165 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:10:29.356165 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:10:29.356165 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:10:29.356165 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:10:29.356165 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:10:29.356165 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 could not be found. Sep 07 13:10:29.356165 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:10:29.356165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-34f72118-c79a-4fba-b60b-79e6f042fa2a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] Returning 404 to user: Instance 0dbd6ebd-a395-40cf-9aee-a3ec45adac63 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:10:29.357184 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-34f72118-c79a-4fba-b60b-79e6f042fa2a tempest-AttachVolumeNegativeTest-544363165 tempest-AttachVolumeNegativeTest-544363165-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63" status: 404 len: 111 microversion: 2.1 time: 0.129563 Sep 07 13:10:29.364042 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2937/5831] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:10:29 2022] GET /compute/v2.1/servers/0dbd6ebd-a395-40cf-9aee-a3ec45adac63 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:10:30.284115 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-29282a20-ddfc-49b1-a862-add4daa5dd70 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7282714f-a08f-459a-ac1a-16440d70d681", "device": "/dev/sdb"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:10:30.288257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-29282a20-ddfc-49b1-a862-add4daa5dd70 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: b6fc8dec-29e5-4879-b83a-e15a9b37dda4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:10:30.319062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29282a20-ddfc-49b1-a862-add4daa5dd70 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:30.319961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29282a20-ddfc-49b1-a862-add4daa5dd70 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:30.323594 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29282a20-ddfc-49b1-a862-add4daa5dd70 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:30.325005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29282a20-ddfc-49b1-a862-add4daa5dd70 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:10:30.329988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29282a20-ddfc-49b1-a862-add4daa5dd70 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:10:30.335809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29282a20-ddfc-49b1-a862-add4daa5dd70 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:10:30.940991 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-29282a20-ddfc-49b1-a862-add4daa5dd70 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "POST /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.661340 Sep 07 13:10:30.942087 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2895/5832] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Sep 7 13:10:30 2022] POST /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4/os-volume_attachments => generated 194 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:11:25.233173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-095955d2-e3e9-48cf-bb01-1f2d4cf036db tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:25.234023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-095955d2-e3e9-48cf-bb01-1f2d4cf036db tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: b6fc8dec-29e5-4879-b83a-e15a9b37dda4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:25.258386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:25.264442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:25.277670 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-095955d2-e3e9-48cf-bb01-1f2d4cf036db tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:25.278583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-095955d2-e3e9-48cf-bb01-1f2d4cf036db tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:25.279408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-095955d2-e3e9-48cf-bb01-1f2d4cf036db tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:25.280846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-095955d2-e3e9-48cf-bb01-1f2d4cf036db tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:25.286441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-095955d2-e3e9-48cf-bb01-1f2d4cf036db tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:25.287623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-095955d2-e3e9-48cf-bb01-1f2d4cf036db tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:25.872574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-095955d2-e3e9-48cf-bb01-1f2d4cf036db tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lazy-loading 'services' on Instance uuid b6fc8dec-29e5-4879-b83a-e15a9b37dda4 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:11:26.184316 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-095955d2-e3e9-48cf-bb01-1f2d4cf036db tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4/os-volume_attachments/7282714f-a08f-459a-ac1a-16440d70d681" status: 202 len: 0 microversion: 2.1 time: 0.938484 Sep 07 13:11:26.187393 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2938/5833] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Sep 7 13:11:25 2022] DELETE /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4/os-volume_attachments/7282714f-a08f-459a-ac1a-16440d70d681 => generated 0 bytes in 964 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:11:39.627026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:39.631131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:39.656939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3145a63e-05a9-4b66-ae0e-329f5149b5a0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:39.661066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3145a63e-05a9-4b66-ae0e-329f5149b5a0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: b6fc8dec-29e5-4879-b83a-e15a9b37dda4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:39.688950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3145a63e-05a9-4b66-ae0e-329f5149b5a0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:39.691284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3145a63e-05a9-4b66-ae0e-329f5149b5a0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:39.701299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3145a63e-05a9-4b66-ae0e-329f5149b5a0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:39.705390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3145a63e-05a9-4b66-ae0e-329f5149b5a0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:39.720253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3145a63e-05a9-4b66-ae0e-329f5149b5a0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:39.726471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3145a63e-05a9-4b66-ae0e-329f5149b5a0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:39.918061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3145a63e-05a9-4b66-ae0e-329f5149b5a0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: b6fc8dec-29e5-4879-b83a-e15a9b37dda4] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:11:40.360492 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3145a63e-05a9-4b66-ae0e-329f5149b5a0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4" status: 204 len: 0 microversion: 2.1 time: 0.738687 Sep 07 13:11:40.362988 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2896/5834] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:11:39 2022] DELETE /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:11:40.372835 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c30aeed-18b7-43e0-b1f8-13a968b27279 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:40.373582 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2c30aeed-18b7-43e0-b1f8-13a968b27279 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: b6fc8dec-29e5-4879-b83a-e15a9b37dda4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:40.379509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:40.383078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:40.422365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c30aeed-18b7-43e0-b1f8-13a968b27279 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:40.422939 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c30aeed-18b7-43e0-b1f8-13a968b27279 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:40.423601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c30aeed-18b7-43e0-b1f8-13a968b27279 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:40.427833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c30aeed-18b7-43e0-b1f8-13a968b27279 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:40.433299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c30aeed-18b7-43e0-b1f8-13a968b27279 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:40.434134 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c30aeed-18b7-43e0-b1f8-13a968b27279 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:41.994957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2c30aeed-18b7-43e0-b1f8-13a968b27279 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:42.037657 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2c30aeed-18b7-43e0-b1f8-13a968b27279 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4" status: 200 len: 1512 microversion: 2.1 time: 1.668697 Sep 07 13:11:42.054425 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2939/5835] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:40 2022] GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4 => generated 1512 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:11:43.097544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cac1cc63-c870-4a08-a85d-35255737c8f3 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:43.098771 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cac1cc63-c870-4a08-a85d-35255737c8f3 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: b6fc8dec-29e5-4879-b83a-e15a9b37dda4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:43.142418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cac1cc63-c870-4a08-a85d-35255737c8f3 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:43.147991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cac1cc63-c870-4a08-a85d-35255737c8f3 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:43.153326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cac1cc63-c870-4a08-a85d-35255737c8f3 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:43.155951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cac1cc63-c870-4a08-a85d-35255737c8f3 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:43.156474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cac1cc63-c870-4a08-a85d-35255737c8f3 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:43.165244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cac1cc63-c870-4a08-a85d-35255737c8f3 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:43.762583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cac1cc63-c870-4a08-a85d-35255737c8f3 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:43.794544 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cac1cc63-c870-4a08-a85d-35255737c8f3 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4" status: 200 len: 1512 microversion: 2.1 time: 0.704932 Sep 07 13:11:43.815887 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2897/5836] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:43 2022] GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4 => generated 1512 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:44.154238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-1da623af-6c93-4391-83af-f12b9e75f48e req-fe7625fd-0d40-4f7b-8dca-8f07b3a16166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6fc8dec-29e5-4879-b83a-e15a9b37dda4", "name": "network-vif-deleted", "tag": "4fa5a024-9da7-430e-9773-ba94fad40100"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:11:44.184319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1da623af-6c93-4391-83af-f12b9e75f48e req-fe7625fd-0d40-4f7b-8dca-8f07b3a16166 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:44.185090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1da623af-6c93-4391-83af-f12b9e75f48e req-fe7625fd-0d40-4f7b-8dca-8f07b3a16166 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:44.186089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1da623af-6c93-4391-83af-f12b9e75f48e req-fe7625fd-0d40-4f7b-8dca-8f07b3a16166 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:44.206938 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-1da623af-6c93-4391-83af-f12b9e75f48e req-fe7625fd-0d40-4f7b-8dca-8f07b3a16166 service nova] Creating event network-vif-deleted:4fa5a024-9da7-430e-9773-ba94fad40100 for instance b6fc8dec-29e5-4879-b83a-e15a9b37dda4 on n-h1-852087-9 Sep 07 13:11:44.215231 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-1da623af-6c93-4391-83af-f12b9e75f48e req-fe7625fd-0d40-4f7b-8dca-8f07b3a16166 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070612 Sep 07 13:11:44.217264 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2940/5837] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:11:44.854840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c70860de-676f-4c6b-aa80-acce9ed5cf1e tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:44.857258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c70860de-676f-4c6b-aa80-acce9ed5cf1e tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: b6fc8dec-29e5-4879-b83a-e15a9b37dda4] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:44.866904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c70860de-676f-4c6b-aa80-acce9ed5cf1e tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:44.867749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c70860de-676f-4c6b-aa80-acce9ed5cf1e tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:44.868450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c70860de-676f-4c6b-aa80-acce9ed5cf1e tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:44.870181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c70860de-676f-4c6b-aa80-acce9ed5cf1e tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:44.871714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c70860de-676f-4c6b-aa80-acce9ed5cf1e tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:44.872353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c70860de-676f-4c6b-aa80-acce9ed5cf1e tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:44.978000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c70860de-676f-4c6b-aa80-acce9ed5cf1e tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:44.978842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c70860de-676f-4c6b-aa80-acce9ed5cf1e tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:44.979561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c70860de-676f-4c6b-aa80-acce9ed5cf1e tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:44.980354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-c70860de-676f-4c6b-aa80-acce9ed5cf1e tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lazy-loading 'fault' on Instance uuid b6fc8dec-29e5-4879-b83a-e15a9b37dda4 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:11:45.086591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c70860de-676f-4c6b-aa80-acce9ed5cf1e tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:11:45.128828 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c70860de-676f-4c6b-aa80-acce9ed5cf1e tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4" status: 200 len: 1308 microversion: 2.1 time: 0.279177 Sep 07 13:11:45.143734 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2898/5838] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:44 2022] GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4 => generated 1308 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:11:46.179493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ff88425a-1f6e-454d-939a-64d674296e8c tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:11:46.181361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ff88425a-1f6e-454d-939a-64d674296e8c tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: b6fc8dec-29e5-4879-b83a-e15a9b37dda4] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:11:46.204705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff88425a-1f6e-454d-939a-64d674296e8c tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:46.206089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff88425a-1f6e-454d-939a-64d674296e8c tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:46.211004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff88425a-1f6e-454d-939a-64d674296e8c tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:46.212538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff88425a-1f6e-454d-939a-64d674296e8c tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:11:46.215743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff88425a-1f6e-454d-939a-64d674296e8c tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:11:46.217734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff88425a-1f6e-454d-939a-64d674296e8c tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:11:46.284670 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-ff88425a-1f6e-454d-939a-64d674296e8c tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] HTTP exception thrown: Instance b6fc8dec-29e5-4879-b83a-e15a9b37dda4 could not be found. Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ff88425a-1f6e-454d-939a-64d674296e8c tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Request method failure captured: Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4 HTTP/1.1 Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJdXnCfA3hy9qurHHVpa9hcOsS2vJ4KpnCpIkSpQ8WqlpeVde-2FHDCKhjCZHdOmKInaPfk39hO7q_qainGbfWSCtTtBy4Fsr63cUzjvZEIwbY2eNKtfTRRh1AJ1cKa7QoU6F_Vpfhs8dbUn_VnTqKM22TlAne8hHfsIS_6yJoVUKDk Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 82a5845654bb49638492b2b4a05b76a8 Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-VolumesSnapshotTestJSON-796309807 Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82a5845654bb49638492b2b4a05b76a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_82a5845654bb49638492b2b4a05b76a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/82a5845654bb49638492b2b4a05b76a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82a5845654bb49638492b2b4a05b76a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-VolumesSnapshotTestJSON-796309807 Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 82a5845654bb49638492b2b4a05b76a8 Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-796309807 Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-VolumesSnapshotTestJSON-796309807-project Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 57c002bf4fcd4f33a5304a8ca26a262b Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-VolumesSnapshotTestJSON-796309807-project Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance b6fc8dec-29e5-4879-b83a-e15a9b37dda4 could not be found. Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'b6fc8dec-29e5-4879-b83a-e15a9b37dda4'} Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6fc8dec-29e5-4879-b83a-e15a9b37dda4 could not be found. Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6fc8dec-29e5-4879-b83a-e15a9b37dda4 could not be found. Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:11:46.288505 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:11:46.294353 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:11:46.294353 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:11:46.294353 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:11:46.294353 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:11:46.294353 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:11:46.294353 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6fc8dec-29e5-4879-b83a-e15a9b37dda4 could not be found. Sep 07 13:11:46.294353 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:11:46.308105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ff88425a-1f6e-454d-939a-64d674296e8c tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Returning 404 to user: Instance b6fc8dec-29e5-4879-b83a-e15a9b37dda4 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:11:46.308105 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ff88425a-1f6e-454d-939a-64d674296e8c tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4" status: 404 len: 111 microversion: 2.1 time: 0.131871 Sep 07 13:11:46.308105 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2941/5839] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:11:46 2022] GET /compute/v2.1/servers/b6fc8dec-29e5-4879-b83a-e15a9b37dda4 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:12:02.352587 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7de0a5c0-0608-4385-a1c9-5306eff18a10 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1978323624", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "2191e414-c63c-4fb3-bede-cd6728183361"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:12:02.384485 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:02.387022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:02.517313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-7de0a5c0-0608-4385-a1c9-5306eff18a10 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] validate_networks() for [('2191e414-c63c-4fb3-bede-cd6728183361', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:12:05.355289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7de0a5c0-0608-4385-a1c9-5306eff18a10 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:12:05.356349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7de0a5c0-0608-4385-a1c9-5306eff18a10 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:12:05.356349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7de0a5c0-0608-4385-a1c9-5306eff18a10 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:12:05.356963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7de0a5c0-0608-4385-a1c9-5306eff18a10 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:12:05.357849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7de0a5c0-0608-4385-a1c9-5306eff18a10 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:12:05.376121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7de0a5c0-0608-4385-a1c9-5306eff18a10 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:05.378672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7de0a5c0-0608-4385-a1c9-5306eff18a10 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:05.379396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7de0a5c0-0608-4385-a1c9-5306eff18a10 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:05.382638 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7de0a5c0-0608-4385-a1c9-5306eff18a10 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:05.383348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7de0a5c0-0608-4385-a1c9-5306eff18a10 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:05.384693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7de0a5c0-0608-4385-a1c9-5306eff18a10 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:05.440124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-7de0a5c0-0608-4385-a1c9-5306eff18a10 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Getting quotas for project 82a5845654bb49638492b2b4a05b76a8. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:12:05.457933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-7de0a5c0-0608-4385-a1c9-5306eff18a10 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Getting quotas for user 57c002bf4fcd4f33a5304a8ca26a262b and project 82a5845654bb49638492b2b4a05b76a8. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:12:05.499105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7de0a5c0-0608-4385-a1c9-5306eff18a10 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:12:05.503539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7de0a5c0-0608-4385-a1c9-5306eff18a10 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: 079df104-daab-42b3-95d5-ec241b9564bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:12:05.639714 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7de0a5c0-0608-4385-a1c9-5306eff18a10 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.291575 Sep 07 13:12:05.640834 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2899/5840] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:12:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:12:05.669361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-be73f50d-a51d-42fa-b85b-a3c25cd80d15 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:05.670544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-be73f50d-a51d-42fa-b85b-a3c25cd80d15 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: 079df104-daab-42b3-95d5-ec241b9564bf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:05.701034 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:05.703624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=10 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:06.087872 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-be73f50d-a51d-42fa-b85b-a3c25cd80d15 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:06.111298 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-be73f50d-a51d-42fa-b85b-a3c25cd80d15 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf" status: 200 len: 1219 microversion: 2.1 time: 0.456810 Sep 07 13:12:06.114783 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2942/5841] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:05 2022] GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf => generated 1219 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:07.163752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f68c5473-4891-4c40-a0ae-153533f494d3 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:07.170691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f68c5473-4891-4c40-a0ae-153533f494d3 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: 079df104-daab-42b3-95d5-ec241b9564bf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:07.419261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f68c5473-4891-4c40-a0ae-153533f494d3 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:07.433321 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f68c5473-4891-4c40-a0ae-153533f494d3 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf" status: 200 len: 1219 microversion: 2.1 time: 0.287179 Sep 07 13:12:07.437942 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2900/5842] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:07 2022] GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf => generated 1219 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:08.496046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9a29132e-9b28-460b-864d-cc7aa5e5fd6a tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:08.498295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9a29132e-9b28-460b-864d-cc7aa5e5fd6a tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: 079df104-daab-42b3-95d5-ec241b9564bf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:08.545013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a29132e-9b28-460b-864d-cc7aa5e5fd6a tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:08.565095 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a29132e-9b28-460b-864d-cc7aa5e5fd6a tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:08.566151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a29132e-9b28-460b-864d-cc7aa5e5fd6a tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:08.575132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a29132e-9b28-460b-864d-cc7aa5e5fd6a tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:08.576000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a29132e-9b28-460b-864d-cc7aa5e5fd6a tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:08.579884 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a29132e-9b28-460b-864d-cc7aa5e5fd6a tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:09.128183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9a29132e-9b28-460b-864d-cc7aa5e5fd6a tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:09.146534 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9a29132e-9b28-460b-864d-cc7aa5e5fd6a tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf" status: 200 len: 1271 microversion: 2.1 time: 0.660733 Sep 07 13:12:09.149693 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2943/5843] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:08 2022] GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf => generated 1271 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:10.198799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fad55599-b970-41a9-be08-3551a68db3a6 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:10.200541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fad55599-b970-41a9-be08-3551a68db3a6 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: 079df104-daab-42b3-95d5-ec241b9564bf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:10.218196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fad55599-b970-41a9-be08-3551a68db3a6 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:10.220883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fad55599-b970-41a9-be08-3551a68db3a6 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:10.221773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fad55599-b970-41a9-be08-3551a68db3a6 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:10.222873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fad55599-b970-41a9-be08-3551a68db3a6 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:10.225016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fad55599-b970-41a9-be08-3551a68db3a6 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:10.228390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fad55599-b970-41a9-be08-3551a68db3a6 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:10.589917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fad55599-b970-41a9-be08-3551a68db3a6 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:10.674928 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fad55599-b970-41a9-be08-3551a68db3a6 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf" status: 200 len: 1277 microversion: 2.1 time: 0.478954 Sep 07 13:12:10.680283 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2901/5844] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:10 2022] GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf => generated 1277 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:11.710430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0fb9a908-1c2c-4a9f-9c9d-01c92e72a9e9 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:11.711408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0fb9a908-1c2c-4a9f-9c9d-01c92e72a9e9 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: 079df104-daab-42b3-95d5-ec241b9564bf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:11.727926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fb9a908-1c2c-4a9f-9c9d-01c92e72a9e9 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:11.728592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fb9a908-1c2c-4a9f-9c9d-01c92e72a9e9 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:11.729159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fb9a908-1c2c-4a9f-9c9d-01c92e72a9e9 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:11.731325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fb9a908-1c2c-4a9f-9c9d-01c92e72a9e9 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:11.734074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fb9a908-1c2c-4a9f-9c9d-01c92e72a9e9 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:11.734719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fb9a908-1c2c-4a9f-9c9d-01c92e72a9e9 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:12.269464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0fb9a908-1c2c-4a9f-9c9d-01c92e72a9e9 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:12.285368 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0fb9a908-1c2c-4a9f-9c9d-01c92e72a9e9 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf" status: 200 len: 1277 microversion: 2.1 time: 0.578744 Sep 07 13:12:12.304437 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2944/5845] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:11 2022] GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf => generated 1277 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:12:13.353182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9a5f77e8-517b-442f-91a0-64d1bc5e7907 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:13.354137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9a5f77e8-517b-442f-91a0-64d1bc5e7907 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: 079df104-daab-42b3-95d5-ec241b9564bf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:13.371657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a5f77e8-517b-442f-91a0-64d1bc5e7907 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:13.372628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a5f77e8-517b-442f-91a0-64d1bc5e7907 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:13.373792 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a5f77e8-517b-442f-91a0-64d1bc5e7907 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:13.374773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a5f77e8-517b-442f-91a0-64d1bc5e7907 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:13.375661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a5f77e8-517b-442f-91a0-64d1bc5e7907 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:13.376974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a5f77e8-517b-442f-91a0-64d1bc5e7907 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:14.206350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9a5f77e8-517b-442f-91a0-64d1bc5e7907 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:14.244231 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9a5f77e8-517b-442f-91a0-64d1bc5e7907 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf" status: 200 len: 1319 microversion: 2.1 time: 0.889639 Sep 07 13:12:14.273021 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2902/5846] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:13 2022] GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf => generated 1319 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:15.291169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c206218c-b0f0-4ad0-ae18-2340eab2a550 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:15.292485 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c206218c-b0f0-4ad0-ae18-2340eab2a550 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: 079df104-daab-42b3-95d5-ec241b9564bf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:15.307789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c206218c-b0f0-4ad0-ae18-2340eab2a550 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:15.308780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c206218c-b0f0-4ad0-ae18-2340eab2a550 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:15.312353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c206218c-b0f0-4ad0-ae18-2340eab2a550 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:15.313699 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c206218c-b0f0-4ad0-ae18-2340eab2a550 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:15.314614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c206218c-b0f0-4ad0-ae18-2340eab2a550 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:15.315361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c206218c-b0f0-4ad0-ae18-2340eab2a550 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:16.101607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:16.338198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c206218c-b0f0-4ad0-ae18-2340eab2a550 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:16.352915 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c206218c-b0f0-4ad0-ae18-2340eab2a550 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf" status: 200 len: 1319 microversion: 2.1 time: 1.066755 Sep 07 13:12:16.353904 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2945/5847] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:15 2022] GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf => generated 1319 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:17.273516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-8904ed01-07ba-49bd-8bfb-139df652ea9c req-7cc48f1b-d713-4e1d-91e3-d94e7b1d8c86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "079df104-daab-42b3-95d5-ec241b9564bf", "tag": "4d281b62-3d8e-409f-83a7-36e5ba90964d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:12:17.298344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:17.305467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8904ed01-07ba-49bd-8bfb-139df652ea9c req-7cc48f1b-d713-4e1d-91e3-d94e7b1d8c86 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:17.306666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8904ed01-07ba-49bd-8bfb-139df652ea9c req-7cc48f1b-d713-4e1d-91e3-d94e7b1d8c86 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:17.308994 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8904ed01-07ba-49bd-8bfb-139df652ea9c req-7cc48f1b-d713-4e1d-91e3-d94e7b1d8c86 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:17.346527 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-8904ed01-07ba-49bd-8bfb-139df652ea9c req-7cc48f1b-d713-4e1d-91e3-d94e7b1d8c86 service nova] Creating event network-changed:4d281b62-3d8e-409f-83a7-36e5ba90964d for instance 079df104-daab-42b3-95d5-ec241b9564bf on n-h2-852087-9 Sep 07 13:12:17.383089 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-8904ed01-07ba-49bd-8bfb-139df652ea9c req-7cc48f1b-d713-4e1d-91e3-d94e7b1d8c86 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146810 Sep 07 13:12:17.384936 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2903/5848] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:12:17.399414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5cb7d351-0609-4e63-9664-cb037380e5f0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:17.405757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5cb7d351-0609-4e63-9664-cb037380e5f0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: 079df104-daab-42b3-95d5-ec241b9564bf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:17.436892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5cb7d351-0609-4e63-9664-cb037380e5f0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:17.444186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5cb7d351-0609-4e63-9664-cb037380e5f0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:17.448294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5cb7d351-0609-4e63-9664-cb037380e5f0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:17.450367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5cb7d351-0609-4e63-9664-cb037380e5f0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:17.453187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5cb7d351-0609-4e63-9664-cb037380e5f0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:17.456799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5cb7d351-0609-4e63-9664-cb037380e5f0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:18.385303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5cb7d351-0609-4e63-9664-cb037380e5f0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:18.413952 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5cb7d351-0609-4e63-9664-cb037380e5f0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf" status: 200 len: 1319 microversion: 2.1 time: 1.023812 Sep 07 13:12:18.438746 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2946/5849] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:17 2022] GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf => generated 1319 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:19.458603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:19.482213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bbd58752-415c-41fd-81b5-58437e0f016e tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:19.483741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bbd58752-415c-41fd-81b5-58437e0f016e tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: 079df104-daab-42b3-95d5-ec241b9564bf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:19.512770 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd58752-415c-41fd-81b5-58437e0f016e tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:19.532521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd58752-415c-41fd-81b5-58437e0f016e tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:19.533561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd58752-415c-41fd-81b5-58437e0f016e tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:19.534826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd58752-415c-41fd-81b5-58437e0f016e tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:19.535636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd58752-415c-41fd-81b5-58437e0f016e tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:19.536486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbd58752-415c-41fd-81b5-58437e0f016e tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:20.180263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bbd58752-415c-41fd-81b5-58437e0f016e tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:20.213526 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bbd58752-415c-41fd-81b5-58437e0f016e tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf" status: 200 len: 1319 microversion: 2.1 time: 0.756341 Sep 07 13:12:20.215576 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2904/5850] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:19 2022] GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf => generated 1319 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:21.285472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-145a018b-9e7e-44f4-9cb6-a3ecf5bc830d tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:21.289603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-145a018b-9e7e-44f4-9cb6-a3ecf5bc830d tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: 079df104-daab-42b3-95d5-ec241b9564bf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:21.334080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-145a018b-9e7e-44f4-9cb6-a3ecf5bc830d tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:21.339267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-145a018b-9e7e-44f4-9cb6-a3ecf5bc830d tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:21.343263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-145a018b-9e7e-44f4-9cb6-a3ecf5bc830d tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:21.363107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-145a018b-9e7e-44f4-9cb6-a3ecf5bc830d tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:21.368049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-145a018b-9e7e-44f4-9cb6-a3ecf5bc830d tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:21.372980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-145a018b-9e7e-44f4-9cb6-a3ecf5bc830d tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:22.910958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-145a018b-9e7e-44f4-9cb6-a3ecf5bc830d tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:23.013362 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-145a018b-9e7e-44f4-9cb6-a3ecf5bc830d tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf" status: 200 len: 1319 microversion: 2.1 time: 1.756618 Sep 07 13:12:23.020722 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2947/5851] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:21 2022] GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf => generated 1319 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:12:24.066763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e4d7d387-9faf-4d9e-b5e9-490b93bc2df4 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:24.075958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e4d7d387-9faf-4d9e-b5e9-490b93bc2df4 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: 079df104-daab-42b3-95d5-ec241b9564bf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:24.122547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4d7d387-9faf-4d9e-b5e9-490b93bc2df4 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:24.123611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4d7d387-9faf-4d9e-b5e9-490b93bc2df4 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:24.125758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4d7d387-9faf-4d9e-b5e9-490b93bc2df4 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:24.129247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4d7d387-9faf-4d9e-b5e9-490b93bc2df4 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:24.130897 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4d7d387-9faf-4d9e-b5e9-490b93bc2df4 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:24.140062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4d7d387-9faf-4d9e-b5e9-490b93bc2df4 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:24.949105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e4d7d387-9faf-4d9e-b5e9-490b93bc2df4 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:24.982783 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e4d7d387-9faf-4d9e-b5e9-490b93bc2df4 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf" status: 200 len: 1319 microversion: 2.1 time: 0.938314 Sep 07 13:12:24.994308 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2905/5852] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:24 2022] GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf => generated 1319 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:26.029938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-08305c43-633c-4112-a51d-a68c84604417 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:26.035118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-08305c43-633c-4112-a51d-a68c84604417 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: 079df104-daab-42b3-95d5-ec241b9564bf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:26.095239 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08305c43-633c-4112-a51d-a68c84604417 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:26.096221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08305c43-633c-4112-a51d-a68c84604417 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:26.096994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08305c43-633c-4112-a51d-a68c84604417 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:26.098184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08305c43-633c-4112-a51d-a68c84604417 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:26.099007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08305c43-633c-4112-a51d-a68c84604417 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:26.105382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08305c43-633c-4112-a51d-a68c84604417 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:26.910759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6b988fff-5119-4742-876e-49dff6e0cb87 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:26.913431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b988fff-5119-4742-876e-49dff6e0cb87 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:26.914244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b988fff-5119-4742-876e-49dff6e0cb87 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:26.914935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b988fff-5119-4742-876e-49dff6e0cb87 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:26.916182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b988fff-5119-4742-876e-49dff6e0cb87 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:26.918343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b988fff-5119-4742-876e-49dff6e0cb87 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:26.919060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b988fff-5119-4742-876e-49dff6e0cb87 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:26.950045 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6b988fff-5119-4742-876e-49dff6e0cb87 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.400675 Sep 07 13:12:26.951294 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2906/5853] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Sep 7 13:12:26 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:12:27.147088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cbeccf82-60af-4cf1-bac9-cb4f4c417755 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-733596523", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "availability_zone": "nova:n-h1-852087-9", "networks": [{"uuid": "f79a89b2-f0a7-471c-b017-ddef1a27ffe8"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:12:27.298454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-08305c43-633c-4112-a51d-a68c84604417 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:27.332001 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-cbeccf82-60af-4cf1-bac9-cb4f4c417755 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] validate_networks() for [('f79a89b2-f0a7-471c-b017-ddef1a27ffe8', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:12:27.347581 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-08305c43-633c-4112-a51d-a68c84604417 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf" status: 200 len: 1319 microversion: 2.1 time: 1.325748 Sep 07 13:12:27.351536 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2948/5854] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:26 2022] GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf => generated 1319 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:28.790314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-30a387fc-01f0-4d40-97c5-0409d2c0ba47 req-d60d53e4-0042-465e-ad25-1f3b35d40ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "079df104-daab-42b3-95d5-ec241b9564bf", "name": "network-vif-plugged", "status": "completed", "tag": "4d281b62-3d8e-409f-83a7-36e5ba90964d"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:12:28.810223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cbeccf82-60af-4cf1-bac9-cb4f4c417755 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:12:28.811543 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cbeccf82-60af-4cf1-bac9-cb4f4c417755 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:12:28.812245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cbeccf82-60af-4cf1-bac9-cb4f4c417755 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:12:28.812835 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cbeccf82-60af-4cf1-bac9-cb4f4c417755 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:12:28.814863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-cbeccf82-60af-4cf1-bac9-cb4f4c417755 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:12:28.830513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-30a387fc-01f0-4d40-97c5-0409d2c0ba47 req-d60d53e4-0042-465e-ad25-1f3b35d40ca1 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:28.831376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-30a387fc-01f0-4d40-97c5-0409d2c0ba47 req-d60d53e4-0042-465e-ad25-1f3b35d40ca1 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:28.832156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-30a387fc-01f0-4d40-97c5-0409d2c0ba47 req-d60d53e4-0042-465e-ad25-1f3b35d40ca1 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:28.837932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbeccf82-60af-4cf1-bac9-cb4f4c417755 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:28.838847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbeccf82-60af-4cf1-bac9-cb4f4c417755 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:28.840712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbeccf82-60af-4cf1-bac9-cb4f4c417755 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:28.842577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbeccf82-60af-4cf1-bac9-cb4f4c417755 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:28.846634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbeccf82-60af-4cf1-bac9-cb4f4c417755 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:28.847958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbeccf82-60af-4cf1-bac9-cb4f4c417755 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:28.900391 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-30a387fc-01f0-4d40-97c5-0409d2c0ba47 req-d60d53e4-0042-465e-ad25-1f3b35d40ca1 service nova] Creating event network-vif-plugged:4d281b62-3d8e-409f-83a7-36e5ba90964d for instance 079df104-daab-42b3-95d5-ec241b9564bf on n-h2-852087-9 Sep 07 13:12:28.920055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-cbeccf82-60af-4cf1-bac9-cb4f4c417755 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Getting quotas for project 5eaba6050f9049b1a42520080092e17a. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:12:28.922396 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-30a387fc-01f0-4d40-97c5-0409d2c0ba47 req-d60d53e4-0042-465e-ad25-1f3b35d40ca1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.623327 Sep 07 13:12:28.927480 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2949/5855] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:12:28.941788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d1219978-c325-429c-b39a-e4a0fa67ac90 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:28.944295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-cbeccf82-60af-4cf1-bac9-cb4f4c417755 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Getting quotas for user b272adc4c70245e190d5b40697350adf and project 5eaba6050f9049b1a42520080092e17a. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:12:28.944796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d1219978-c325-429c-b39a-e4a0fa67ac90 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: 079df104-daab-42b3-95d5-ec241b9564bf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:28.958619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1219978-c325-429c-b39a-e4a0fa67ac90 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:28.963839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1219978-c325-429c-b39a-e4a0fa67ac90 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:28.965917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1219978-c325-429c-b39a-e4a0fa67ac90 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:28.968701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cbeccf82-60af-4cf1-bac9-cb4f4c417755 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:12:28.969203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1219978-c325-429c-b39a-e4a0fa67ac90 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:28.970905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1219978-c325-429c-b39a-e4a0fa67ac90 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:28.972186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1219978-c325-429c-b39a-e4a0fa67ac90 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:28.987683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cbeccf82-60af-4cf1-bac9-cb4f4c417755 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:12:29.085947 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cbeccf82-60af-4cf1-bac9-cb4f4c417755 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.942404 Sep 07 13:12:29.097344 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2907/5856] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:12:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:12:29.109442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f11e08ed-b43a-4b35-9647-87b362d3719c tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:29.111050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f11e08ed-b43a-4b35-9647-87b362d3719c tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:29.320100 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f11e08ed-b43a-4b35-9647-87b362d3719c tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935" status: 200 len: 1328 microversion: 2.1 time: 0.220626 Sep 07 13:12:29.326705 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2908/5857] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:29 2022] GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 => generated 1328 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:29.459040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d1219978-c325-429c-b39a-e4a0fa67ac90 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:29.469970 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d1219978-c325-429c-b39a-e4a0fa67ac90 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf" status: 200 len: 1319 microversion: 2.1 time: 0.541631 Sep 07 13:12:29.489872 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2950/5858] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:28 2022] GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf => generated 1319 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:30.358450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0c3b4d36-18ae-4d37-b467-727cf117990a tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:30.364320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0c3b4d36-18ae-4d37-b467-727cf117990a tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:30.415784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c3b4d36-18ae-4d37-b467-727cf117990a tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:30.417104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c3b4d36-18ae-4d37-b467-727cf117990a tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:30.419110 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c3b4d36-18ae-4d37-b467-727cf117990a tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:30.421103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c3b4d36-18ae-4d37-b467-727cf117990a tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:30.429663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c3b4d36-18ae-4d37-b467-727cf117990a tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:30.430841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c3b4d36-18ae-4d37-b467-727cf117990a tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:30.502289 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-03002015-df27-4d33-85a3-059e368832ee tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:30.504708 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-03002015-df27-4d33-85a3-059e368832ee tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: 079df104-daab-42b3-95d5-ec241b9564bf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:30.553454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03002015-df27-4d33-85a3-059e368832ee tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:30.554539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03002015-df27-4d33-85a3-059e368832ee tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:30.555275 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03002015-df27-4d33-85a3-059e368832ee tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:30.556474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03002015-df27-4d33-85a3-059e368832ee tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:30.566989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03002015-df27-4d33-85a3-059e368832ee tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:30.568253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03002015-df27-4d33-85a3-059e368832ee tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:30.822508 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0c3b4d36-18ae-4d37-b467-727cf117990a tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935" status: 200 len: 1337 microversion: 2.1 time: 0.478022 Sep 07 13:12:30.831402 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2909/5859] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:30 2022] GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 => generated 1337 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:31.173400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-03002015-df27-4d33-85a3-059e368832ee tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:31.187752 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-03002015-df27-4d33-85a3-059e368832ee tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf" status: 200 len: 1319 microversion: 2.1 time: 0.693280 Sep 07 13:12:31.193568 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2951/5860] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:30 2022] GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf => generated 1319 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:31.876586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7b7981c6-727d-4877-b932-77db04a7e0fd tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:31.877876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7b7981c6-727d-4877-b932-77db04a7e0fd tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:31.929661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b7981c6-727d-4877-b932-77db04a7e0fd tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:31.930220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b7981c6-727d-4877-b932-77db04a7e0fd tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:31.930681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b7981c6-727d-4877-b932-77db04a7e0fd tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:31.931442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b7981c6-727d-4877-b932-77db04a7e0fd tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:31.931915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b7981c6-727d-4877-b932-77db04a7e0fd tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:31.932346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b7981c6-727d-4877-b932-77db04a7e0fd tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:32.204929 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7b7981c6-727d-4877-b932-77db04a7e0fd tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935" status: 200 len: 1415 microversion: 2.1 time: 0.333200 Sep 07 13:12:32.206577 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2910/5861] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:31 2022] GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 => generated 1415 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:12:32.236581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0397e315-587c-4f93-97f2-ffc26d29a740 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:32.237953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0397e315-587c-4f93-97f2-ffc26d29a740 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: 079df104-daab-42b3-95d5-ec241b9564bf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:32.249868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0397e315-587c-4f93-97f2-ffc26d29a740 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:32.253895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0397e315-587c-4f93-97f2-ffc26d29a740 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:32.254735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0397e315-587c-4f93-97f2-ffc26d29a740 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:32.255746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0397e315-587c-4f93-97f2-ffc26d29a740 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:32.259449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0397e315-587c-4f93-97f2-ffc26d29a740 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:32.260275 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0397e315-587c-4f93-97f2-ffc26d29a740 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:32.665197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0397e315-587c-4f93-97f2-ffc26d29a740 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:12:32.689325 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0397e315-587c-4f93-97f2-ffc26d29a740 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf" status: 200 len: 1507 microversion: 2.1 time: 0.456904 Sep 07 13:12:32.692279 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2952/5862] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:32 2022] GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf => generated 1507 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:32.716666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ceebd998-8774-408a-8a2f-7820b08bc930 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3a3a10d-56a2-4ff5-932e-ce63f5565128", "device": "/dev/sdb"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:12:32.731374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ceebd998-8774-408a-8a2f-7820b08bc930 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: 079df104-daab-42b3-95d5-ec241b9564bf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:32.755112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:32.757424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ceebd998-8774-408a-8a2f-7820b08bc930 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:32.758365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ceebd998-8774-408a-8a2f-7820b08bc930 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:32.760561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ceebd998-8774-408a-8a2f-7820b08bc930 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:32.766760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ceebd998-8774-408a-8a2f-7820b08bc930 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:32.768435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ceebd998-8774-408a-8a2f-7820b08bc930 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:32.769613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ceebd998-8774-408a-8a2f-7820b08bc930 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:32.787910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=45 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:33.243041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-941affb6-9455-4c99-8614-c91b8dd5b0d1 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:33.248558 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-941affb6-9455-4c99-8614-c91b8dd5b0d1 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:33.295259 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-941affb6-9455-4c99-8614-c91b8dd5b0d1 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:33.301019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-941affb6-9455-4c99-8614-c91b8dd5b0d1 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:33.304582 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-941affb6-9455-4c99-8614-c91b8dd5b0d1 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:33.313947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-941affb6-9455-4c99-8614-c91b8dd5b0d1 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:33.324649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-941affb6-9455-4c99-8614-c91b8dd5b0d1 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:33.325679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-941affb6-9455-4c99-8614-c91b8dd5b0d1 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:33.703195 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-941affb6-9455-4c99-8614-c91b8dd5b0d1 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935" status: 200 len: 1423 microversion: 2.1 time: 0.475837 Sep 07 13:12:33.723248 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2953/5863] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:33 2022] GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 => generated 1423 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:12:33.733105 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ceebd998-8774-408a-8a2f-7820b08bc930 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "POST /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.020440 Sep 07 13:12:33.753371 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2911/5864] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Sep 7 13:12:32 2022] POST /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf/os-volume_attachments => generated 194 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:12:34.736169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a3305631-8a79-46b1-816b-632f5034a449 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:34.737431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a3305631-8a79-46b1-816b-632f5034a449 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:34.748904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3305631-8a79-46b1-816b-632f5034a449 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:34.750578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3305631-8a79-46b1-816b-632f5034a449 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:34.751667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3305631-8a79-46b1-816b-632f5034a449 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:34.754161 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3305631-8a79-46b1-816b-632f5034a449 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:34.755917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3305631-8a79-46b1-816b-632f5034a449 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:34.756624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3305631-8a79-46b1-816b-632f5034a449 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:34.993987 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a3305631-8a79-46b1-816b-632f5034a449 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935" status: 200 len: 1421 microversion: 2.1 time: 0.261360 Sep 07 13:12:35.014740 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2954/5865] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:34 2022] GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 => generated 1421 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:36.041713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1fd8cd57-fba0-41dc-b523-1af61ada4bad tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:36.042761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1fd8cd57-fba0-41dc-b523-1af61ada4bad tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:36.092364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fd8cd57-fba0-41dc-b523-1af61ada4bad tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:36.093129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fd8cd57-fba0-41dc-b523-1af61ada4bad tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:36.096504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fd8cd57-fba0-41dc-b523-1af61ada4bad tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:36.099180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fd8cd57-fba0-41dc-b523-1af61ada4bad tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:36.102966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fd8cd57-fba0-41dc-b523-1af61ada4bad tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:36.104771 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fd8cd57-fba0-41dc-b523-1af61ada4bad tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:36.927959 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1fd8cd57-fba0-41dc-b523-1af61ada4bad tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935" status: 200 len: 1463 microversion: 2.1 time: 0.908118 Sep 07 13:12:36.929034 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2912/5866] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:36 2022] GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 => generated 1463 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:37.963651 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7d3e22de-9d0c-4f0e-8b68-313d6db4fd1d tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:37.964798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7d3e22de-9d0c-4f0e-8b68-313d6db4fd1d tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:37.980627 n-d-852087-9 devstack@n-api.service[122433]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e81ee00-bfe8-4eb4-a476-35156d4bea97] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 07 13:12:37.985209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=29 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:38.015640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d3e22de-9d0c-4f0e-8b68-313d6db4fd1d tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:38.016517 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d3e22de-9d0c-4f0e-8b68-313d6db4fd1d tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:38.029975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d3e22de-9d0c-4f0e-8b68-313d6db4fd1d tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:38.033761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d3e22de-9d0c-4f0e-8b68-313d6db4fd1d tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:38.041946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d3e22de-9d0c-4f0e-8b68-313d6db4fd1d tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:38.042727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d3e22de-9d0c-4f0e-8b68-313d6db4fd1d tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:38.057719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=69 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:38.782106 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7d3e22de-9d0c-4f0e-8b68-313d6db4fd1d tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935" status: 200 len: 1463 microversion: 2.1 time: 0.828006 Sep 07 13:12:38.794978 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2955/5867] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:37 2022] GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 => generated 1463 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:39.516598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:39.524813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:39.837751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e4a9ad70-eb67-43b0-bf1a-65b6d3b4f292 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:39.847354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e4a9ad70-eb67-43b0-bf1a-65b6d3b4f292 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:39.921315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4a9ad70-eb67-43b0-bf1a-65b6d3b4f292 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:39.921987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4a9ad70-eb67-43b0-bf1a-65b6d3b4f292 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:39.922446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4a9ad70-eb67-43b0-bf1a-65b6d3b4f292 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:39.923330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4a9ad70-eb67-43b0-bf1a-65b6d3b4f292 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:39.923807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4a9ad70-eb67-43b0-bf1a-65b6d3b4f292 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:39.924546 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4a9ad70-eb67-43b0-bf1a-65b6d3b4f292 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:40.026738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-65c6dc07-cbde-4067-a374-5e50f700da29 req-73e7e1a7-81fb-4d97-ba6d-378e7d38a3ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f8d12cf-2c1e-4e13-8f93-194bcdb1d935", "tag": "d8405c9c-cb3f-4796-b161-d84a746e3378"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:12:40.028958 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e81ee00-bfe8-4eb4-a476-35156d4bea97] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 46112. Sep 07 13:12:40.058229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-65c6dc07-cbde-4067-a374-5e50f700da29 req-73e7e1a7-81fb-4d97-ba6d-378e7d38a3ae service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:40.059452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-65c6dc07-cbde-4067-a374-5e50f700da29 req-73e7e1a7-81fb-4d97-ba6d-378e7d38a3ae service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:40.060185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-65c6dc07-cbde-4067-a374-5e50f700da29 req-73e7e1a7-81fb-4d97-ba6d-378e7d38a3ae service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:40.099360 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-65c6dc07-cbde-4067-a374-5e50f700da29 req-73e7e1a7-81fb-4d97-ba6d-378e7d38a3ae service nova] Creating event network-changed:d8405c9c-cb3f-4796-b161-d84a746e3378 for instance 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 on n-h1-852087-9 Sep 07 13:12:40.106381 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-65c6dc07-cbde-4067-a374-5e50f700da29 req-73e7e1a7-81fb-4d97-ba6d-378e7d38a3ae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.615000 Sep 07 13:12:40.107401 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2913/5868] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:12:40.847670 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e4a9ad70-eb67-43b0-bf1a-65b6d3b4f292 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935" status: 200 len: 1463 microversion: 2.1 time: 1.017621 Sep 07 13:12:40.900767 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2956/5869] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:39 2022] GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 => generated 1463 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:41.911688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7160d84a-fd9c-41fd-877b-d5d38409269f tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:41.926057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7160d84a-fd9c-41fd-877b-d5d38409269f tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:41.941057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7160d84a-fd9c-41fd-877b-d5d38409269f tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:41.946066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7160d84a-fd9c-41fd-877b-d5d38409269f tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:41.947258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7160d84a-fd9c-41fd-877b-d5d38409269f tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:41.956043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7160d84a-fd9c-41fd-877b-d5d38409269f tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:41.957423 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7160d84a-fd9c-41fd-877b-d5d38409269f tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:41.958522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7160d84a-fd9c-41fd-877b-d5d38409269f tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:43.421047 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7160d84a-fd9c-41fd-877b-d5d38409269f tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935" status: 200 len: 1463 microversion: 2.1 time: 1.498388 Sep 07 13:12:43.424809 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2914/5870] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:41 2022] GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 => generated 1463 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:44.466144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d97cd662-0f9c-4d29-8bc5-78706ec7db24 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:44.466863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d97cd662-0f9c-4d29-8bc5-78706ec7db24 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:44.503275 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d97cd662-0f9c-4d29-8bc5-78706ec7db24 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:44.503766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d97cd662-0f9c-4d29-8bc5-78706ec7db24 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:44.504273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d97cd662-0f9c-4d29-8bc5-78706ec7db24 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:44.509223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d97cd662-0f9c-4d29-8bc5-78706ec7db24 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:44.510135 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d97cd662-0f9c-4d29-8bc5-78706ec7db24 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:44.510778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d97cd662-0f9c-4d29-8bc5-78706ec7db24 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:45.138279 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d97cd662-0f9c-4d29-8bc5-78706ec7db24 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935" status: 200 len: 1463 microversion: 2.1 time: 0.675381 Sep 07 13:12:45.140633 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2957/5871] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:44 2022] GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 => generated 1463 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:46.183480 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e96f419b-9293-48bc-bf4e-37fa1bbecf7f tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:46.184776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e96f419b-9293-48bc-bf4e-37fa1bbecf7f tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:46.206379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e96f419b-9293-48bc-bf4e-37fa1bbecf7f tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:46.207441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e96f419b-9293-48bc-bf4e-37fa1bbecf7f tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:46.214261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e96f419b-9293-48bc-bf4e-37fa1bbecf7f tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:46.215348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e96f419b-9293-48bc-bf4e-37fa1bbecf7f tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:46.222463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e96f419b-9293-48bc-bf4e-37fa1bbecf7f tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:46.223207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e96f419b-9293-48bc-bf4e-37fa1bbecf7f tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:47.306591 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e96f419b-9293-48bc-bf4e-37fa1bbecf7f tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935" status: 200 len: 1463 microversion: 2.1 time: 1.130509 Sep 07 13:12:47.314821 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2915/5872] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:46 2022] GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 => generated 1463 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:48.351802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-053a3589-3313-4f0d-915d-44018255a327 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:48.353316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-053a3589-3313-4f0d-915d-44018255a327 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:48.375034 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-053a3589-3313-4f0d-915d-44018255a327 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:48.381519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-053a3589-3313-4f0d-915d-44018255a327 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:48.382707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-053a3589-3313-4f0d-915d-44018255a327 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:48.388384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-053a3589-3313-4f0d-915d-44018255a327 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:48.389945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-053a3589-3313-4f0d-915d-44018255a327 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:48.393745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-053a3589-3313-4f0d-915d-44018255a327 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:48.958022 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-053a3589-3313-4f0d-915d-44018255a327 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935" status: 200 len: 1463 microversion: 2.1 time: 0.610960 Sep 07 13:12:48.964459 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2958/5873] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:48 2022] GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 => generated 1463 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:49.994250 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-36fea10f-d200-4938-8db7-bb11dd9b7107 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:49.999531 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-36fea10f-d200-4938-8db7-bb11dd9b7107 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:50.039047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36fea10f-d200-4938-8db7-bb11dd9b7107 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:50.042231 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36fea10f-d200-4938-8db7-bb11dd9b7107 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:50.046379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36fea10f-d200-4938-8db7-bb11dd9b7107 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:50.053906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36fea10f-d200-4938-8db7-bb11dd9b7107 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:50.053906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36fea10f-d200-4938-8db7-bb11dd9b7107 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:50.053906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-36fea10f-d200-4938-8db7-bb11dd9b7107 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:51.199500 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-36fea10f-d200-4938-8db7-bb11dd9b7107 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935" status: 200 len: 1463 microversion: 2.1 time: 1.207553 Sep 07 13:12:51.202069 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2916/5874] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:49 2022] GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 => generated 1463 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:52.248915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e0d939a5-9a6f-44de-b272-0406072476c8 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:52.250296 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e0d939a5-9a6f-44de-b272-0406072476c8 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:52.270415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0d939a5-9a6f-44de-b272-0406072476c8 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:52.278570 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0d939a5-9a6f-44de-b272-0406072476c8 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:52.284374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0d939a5-9a6f-44de-b272-0406072476c8 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:52.285255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0d939a5-9a6f-44de-b272-0406072476c8 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:52.285852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0d939a5-9a6f-44de-b272-0406072476c8 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:52.287069 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0d939a5-9a6f-44de-b272-0406072476c8 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:52.695279 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e0d939a5-9a6f-44de-b272-0406072476c8 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935" status: 200 len: 1463 microversion: 2.1 time: 0.449361 Sep 07 13:12:52.696882 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2959/5875] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:52 2022] GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 => generated 1463 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:53.176567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-836c9ba2-abf7-4cd1-9a2d-007e525014f9 req-36683955-043d-4d54-a548-fbcc4e838e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8d12cf-2c1e-4e13-8f93-194bcdb1d935", "name": "network-vif-plugged", "status": "completed", "tag": "d8405c9c-cb3f-4796-b161-d84a746e3378"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:12:53.228775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-836c9ba2-abf7-4cd1-9a2d-007e525014f9 req-36683955-043d-4d54-a548-fbcc4e838e9b service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:53.246439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-836c9ba2-abf7-4cd1-9a2d-007e525014f9 req-36683955-043d-4d54-a548-fbcc4e838e9b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:53.250639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-836c9ba2-abf7-4cd1-9a2d-007e525014f9 req-36683955-043d-4d54-a548-fbcc4e838e9b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:53.322310 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-836c9ba2-abf7-4cd1-9a2d-007e525014f9 req-36683955-043d-4d54-a548-fbcc4e838e9b service nova] Creating event network-vif-plugged:d8405c9c-cb3f-4796-b161-d84a746e3378 for instance 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 on n-h1-852087-9 Sep 07 13:12:53.360501 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-836c9ba2-abf7-4cd1-9a2d-007e525014f9 req-36683955-043d-4d54-a548-fbcc4e838e9b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191417 Sep 07 13:12:53.369391 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2917/5876] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:12:53.729902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-49d3b2db-b674-4aa1-8b47-3dc33f6ee407 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:53.731199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-49d3b2db-b674-4aa1-8b47-3dc33f6ee407 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:53.743742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49d3b2db-b674-4aa1-8b47-3dc33f6ee407 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:53.747463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49d3b2db-b674-4aa1-8b47-3dc33f6ee407 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:53.748202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49d3b2db-b674-4aa1-8b47-3dc33f6ee407 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:53.749184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49d3b2db-b674-4aa1-8b47-3dc33f6ee407 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:53.751783 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49d3b2db-b674-4aa1-8b47-3dc33f6ee407 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:53.752498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49d3b2db-b674-4aa1-8b47-3dc33f6ee407 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:54.295670 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-49d3b2db-b674-4aa1-8b47-3dc33f6ee407 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935" status: 200 len: 1463 microversion: 2.1 time: 0.571775 Sep 07 13:12:54.302027 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2960/5877] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:53 2022] GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 => generated 1463 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:12:55.339426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f03bae1e-608e-486a-ada6-2474bfd32d50 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:55.340383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f03bae1e-608e-486a-ada6-2474bfd32d50 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:55.354408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f03bae1e-608e-486a-ada6-2474bfd32d50 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:55.354913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f03bae1e-608e-486a-ada6-2474bfd32d50 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:55.355352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f03bae1e-608e-486a-ada6-2474bfd32d50 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:55.356218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f03bae1e-608e-486a-ada6-2474bfd32d50 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:55.356516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f03bae1e-608e-486a-ada6-2474bfd32d50 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:55.356943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f03bae1e-608e-486a-ada6-2474bfd32d50 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:55.724238 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f03bae1e-608e-486a-ada6-2474bfd32d50 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935" status: 200 len: 1463 microversion: 2.1 time: 0.389621 Sep 07 13:12:55.747186 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2918/5878] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:55 2022] GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 => generated 1463 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:56.776712 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-92316e84-fb41-4297-837b-f6151373175d tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:56.778178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-92316e84-fb41-4297-837b-f6151373175d tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:56.797846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92316e84-fb41-4297-837b-f6151373175d tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:56.808456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92316e84-fb41-4297-837b-f6151373175d tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:56.809087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92316e84-fb41-4297-837b-f6151373175d tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:56.812205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92316e84-fb41-4297-837b-f6151373175d tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:56.812790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92316e84-fb41-4297-837b-f6151373175d tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:56.813247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-92316e84-fb41-4297-837b-f6151373175d tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:57.270705 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-92316e84-fb41-4297-837b-f6151373175d tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935" status: 200 len: 1648 microversion: 2.1 time: 0.501230 Sep 07 13:12:57.271985 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2961/5879] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:56 2022] GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 => generated 1648 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:57.328504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-378c22b7-52dd-4a12-8d38-6df15eca2a8d tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:57.330384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-378c22b7-52dd-4a12-8d38-6df15eca2a8d tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:57.359709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-378c22b7-52dd-4a12-8d38-6df15eca2a8d tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:57.361970 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-378c22b7-52dd-4a12-8d38-6df15eca2a8d tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:57.363634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-378c22b7-52dd-4a12-8d38-6df15eca2a8d tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:57.367476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-378c22b7-52dd-4a12-8d38-6df15eca2a8d tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:57.370487 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-378c22b7-52dd-4a12-8d38-6df15eca2a8d tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:57.373438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-378c22b7-52dd-4a12-8d38-6df15eca2a8d tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:58.020332 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-378c22b7-52dd-4a12-8d38-6df15eca2a8d tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935" status: 200 len: 1648 microversion: 2.1 time: 0.702286 Sep 07 13:12:58.024832 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2919/5880] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:57 2022] GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 => generated 1648 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:58.083209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b6890af5-508a-4927-9687-b9060ede4dfc tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:12:58.089581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b6890af5-508a-4927-9687-b9060ede4dfc tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:12:58.110978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6890af5-508a-4927-9687-b9060ede4dfc tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:58.111870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6890af5-508a-4927-9687-b9060ede4dfc tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:58.112861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6890af5-508a-4927-9687-b9060ede4dfc tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:58.113903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6890af5-508a-4927-9687-b9060ede4dfc tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:12:58.116439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6890af5-508a-4927-9687-b9060ede4dfc tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:12:58.120159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6890af5-508a-4927-9687-b9060ede4dfc tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:12:58.544762 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b6890af5-508a-4927-9687-b9060ede4dfc tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935" status: 200 len: 1648 microversion: 2.1 time: 0.469727 Sep 07 13:12:58.549283 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2962/5881] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:12:58 2022] GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 => generated 1648 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:12:59.014716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b8b81844-958a-4717-a755-722cd57a5eb6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-444898076", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "availability_zone": "nova:n-h2-852087-9", "networks": [{"uuid": "f79a89b2-f0a7-471c-b017-ddef1a27ffe8"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:12:59.359670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-b8b81844-958a-4717-a755-722cd57a5eb6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] validate_networks() for [('f79a89b2-f0a7-471c-b017-ddef1a27ffe8', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:13:03.411029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b8b81844-958a-4717-a755-722cd57a5eb6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:13:03.414645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b8b81844-958a-4717-a755-722cd57a5eb6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:13:03.416028 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b8b81844-958a-4717-a755-722cd57a5eb6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:13:03.417013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b8b81844-958a-4717-a755-722cd57a5eb6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:13:03.418014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-b8b81844-958a-4717-a755-722cd57a5eb6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:13:03.424875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=22 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:03.510687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8b81844-958a-4717-a755-722cd57a5eb6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:03.511440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8b81844-958a-4717-a755-722cd57a5eb6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:03.526959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8b81844-958a-4717-a755-722cd57a5eb6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:03.527800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8b81844-958a-4717-a755-722cd57a5eb6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:03.528576 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8b81844-958a-4717-a755-722cd57a5eb6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:03.529303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8b81844-958a-4717-a755-722cd57a5eb6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:03.579149 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:03.636539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-b8b81844-958a-4717-a755-722cd57a5eb6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Getting quotas for project 5eaba6050f9049b1a42520080092e17a. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:13:03.659057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-b8b81844-958a-4717-a755-722cd57a5eb6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Getting quotas for user b272adc4c70245e190d5b40697350adf and project 5eaba6050f9049b1a42520080092e17a. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:13:03.723357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b8b81844-958a-4717-a755-722cd57a5eb6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:13:03.737720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b8b81844-958a-4717-a755-722cd57a5eb6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: d134faaa-b15e-4b19-ba32-3a35b779234f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:13:03.901097 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b8b81844-958a-4717-a755-722cd57a5eb6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.908934 Sep 07 13:13:03.913596 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2920/5882] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:12:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 4919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 13:13:03.924064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-70896170-7fd8-402b-aef7-f82a6a8e352b tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:03.929052 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-70896170-7fd8-402b-aef7-f82a6a8e352b tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: d134faaa-b15e-4b19-ba32-3a35b779234f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:04.586119 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-70896170-7fd8-402b-aef7-f82a6a8e352b tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f" status: 200 len: 1328 microversion: 2.1 time: 0.662531 Sep 07 13:13:04.589624 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2963/5883] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:03 2022] GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f => generated 1328 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:05.629295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1247c6c4-1e4c-4694-854b-0983eb01c44c tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:05.639245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1247c6c4-1e4c-4694-854b-0983eb01c44c tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: d134faaa-b15e-4b19-ba32-3a35b779234f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:05.712885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1247c6c4-1e4c-4694-854b-0983eb01c44c tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:05.714130 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1247c6c4-1e4c-4694-854b-0983eb01c44c tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:05.721032 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1247c6c4-1e4c-4694-854b-0983eb01c44c tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:05.740641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1247c6c4-1e4c-4694-854b-0983eb01c44c tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:05.748907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1247c6c4-1e4c-4694-854b-0983eb01c44c tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:05.750398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1247c6c4-1e4c-4694-854b-0983eb01c44c tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:06.344853 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1247c6c4-1e4c-4694-854b-0983eb01c44c tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f" status: 200 len: 1345 microversion: 2.1 time: 0.733182 Sep 07 13:13:06.354870 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2921/5884] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:05 2022] GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f => generated 1345 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:07.393121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3d28a5ba-ae9e-452b-aff8-5198df03d68e tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:07.394046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3d28a5ba-ae9e-452b-aff8-5198df03d68e tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: d134faaa-b15e-4b19-ba32-3a35b779234f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:07.401414 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:13:07.401753 n-d-852087-9 devstack@n-api.service[122433]: Wed Sep 7 13:13:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f (ip 10.222.0.16) !!! Sep 07 13:13:07.407776 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:13:07.408142 n-d-852087-9 devstack@n-api.service[122433]: Wed Sep 7 13:13:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f (ip 10.222.0.16) !!! Sep 07 13:13:07.448054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d28a5ba-ae9e-452b-aff8-5198df03d68e tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:07.448560 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d28a5ba-ae9e-452b-aff8-5198df03d68e tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:07.449043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d28a5ba-ae9e-452b-aff8-5198df03d68e tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:07.466049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d28a5ba-ae9e-452b-aff8-5198df03d68e tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:07.466618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d28a5ba-ae9e-452b-aff8-5198df03d68e tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:07.467087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d28a5ba-ae9e-452b-aff8-5198df03d68e tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:07.867198 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3d28a5ba-ae9e-452b-aff8-5198df03d68e tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f" status: 200 len: 1337 microversion: 2.1 time: 0.474687 Sep 07 13:13:07.886359 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2964/5885] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:07 2022] GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f => generated 1337 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:08.921791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b404a0f0-26ac-40c5-93a2-2e14b90064c8 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:08.922923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b404a0f0-26ac-40c5-93a2-2e14b90064c8 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: d134faaa-b15e-4b19-ba32-3a35b779234f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:08.973248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b404a0f0-26ac-40c5-93a2-2e14b90064c8 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:08.983053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b404a0f0-26ac-40c5-93a2-2e14b90064c8 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:08.988439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b404a0f0-26ac-40c5-93a2-2e14b90064c8 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:08.993111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b404a0f0-26ac-40c5-93a2-2e14b90064c8 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:09.002752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b404a0f0-26ac-40c5-93a2-2e14b90064c8 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:09.009921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b404a0f0-26ac-40c5-93a2-2e14b90064c8 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:09.799422 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b404a0f0-26ac-40c5-93a2-2e14b90064c8 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f" status: 200 len: 1423 microversion: 2.1 time: 0.885416 Sep 07 13:13:09.830780 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2922/5886] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:08 2022] GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f => generated 1423 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:10.876461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4e7c2096-fb5f-443e-8415-fe0c86436bef tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:10.880947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4e7c2096-fb5f-443e-8415-fe0c86436bef tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: d134faaa-b15e-4b19-ba32-3a35b779234f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:10.926617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=22 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:10.930482 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e7c2096-fb5f-443e-8415-fe0c86436bef tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:10.931627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e7c2096-fb5f-443e-8415-fe0c86436bef tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:10.932295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e7c2096-fb5f-443e-8415-fe0c86436bef tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:10.939338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e7c2096-fb5f-443e-8415-fe0c86436bef tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:10.941165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e7c2096-fb5f-443e-8415-fe0c86436bef tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:10.941930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e7c2096-fb5f-443e-8415-fe0c86436bef tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:10.966105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=54 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:11.467721 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4e7c2096-fb5f-443e-8415-fe0c86436bef tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f" status: 200 len: 1463 microversion: 2.1 time: 0.598871 Sep 07 13:13:11.489518 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2965/5887] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:10 2022] GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f => generated 1463 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:12.506695 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-49490e27-a070-4116-b94f-7780cb7f3465 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:12.507424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-49490e27-a070-4116-b94f-7780cb7f3465 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: d134faaa-b15e-4b19-ba32-3a35b779234f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:12.520456 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49490e27-a070-4116-b94f-7780cb7f3465 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:12.530350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49490e27-a070-4116-b94f-7780cb7f3465 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:12.531183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49490e27-a070-4116-b94f-7780cb7f3465 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:12.532207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49490e27-a070-4116-b94f-7780cb7f3465 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:12.532905 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49490e27-a070-4116-b94f-7780cb7f3465 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:12.533654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49490e27-a070-4116-b94f-7780cb7f3465 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:13.397969 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-49490e27-a070-4116-b94f-7780cb7f3465 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f" status: 200 len: 1463 microversion: 2.1 time: 0.894955 Sep 07 13:13:13.424266 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2923/5888] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:12 2022] GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f => generated 1463 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:14.456314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3756690b-f40d-4586-8715-7df05089e411 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:14.458175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3756690b-f40d-4586-8715-7df05089e411 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: d134faaa-b15e-4b19-ba32-3a35b779234f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:14.485976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3756690b-f40d-4586-8715-7df05089e411 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:14.486577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3756690b-f40d-4586-8715-7df05089e411 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:14.487419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3756690b-f40d-4586-8715-7df05089e411 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:14.494764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3756690b-f40d-4586-8715-7df05089e411 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:14.495569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3756690b-f40d-4586-8715-7df05089e411 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:14.497901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3756690b-f40d-4586-8715-7df05089e411 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:14.586618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:15.740377 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-a656ee5e-2da5-449d-ac96-6a9639e1430d req-99b4ce22-6a7f-46e0-bb68-aec9e575c182 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d134faaa-b15e-4b19-ba32-3a35b779234f", "tag": "bad10794-a3f1-4221-87b9-1b2b496a5be4"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:15.781740 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:15.788710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:15.838143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a656ee5e-2da5-449d-ac96-6a9639e1430d req-99b4ce22-6a7f-46e0-bb68-aec9e575c182 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:15.844377 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a656ee5e-2da5-449d-ac96-6a9639e1430d req-99b4ce22-6a7f-46e0-bb68-aec9e575c182 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:15.845194 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a656ee5e-2da5-449d-ac96-6a9639e1430d req-99b4ce22-6a7f-46e0-bb68-aec9e575c182 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:15.915695 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-a656ee5e-2da5-449d-ac96-6a9639e1430d req-99b4ce22-6a7f-46e0-bb68-aec9e575c182 service nova] Creating event network-changed:bad10794-a3f1-4221-87b9-1b2b496a5be4 for instance d134faaa-b15e-4b19-ba32-3a35b779234f on n-h2-852087-9 Sep 07 13:13:15.953565 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-a656ee5e-2da5-449d-ac96-6a9639e1430d req-99b4ce22-6a7f-46e0-bb68-aec9e575c182 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.222633 Sep 07 13:13:15.962527 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2924/5889] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:13:16.355249 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3756690b-f40d-4586-8715-7df05089e411 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f" status: 200 len: 1463 microversion: 2.1 time: 1.906136 Sep 07 13:13:16.392095 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2966/5890] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:14 2022] GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f => generated 1463 bytes in 1944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:17.399443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-53b52437-d377-489f-91ba-96ef12bb05d0 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:17.400965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-53b52437-d377-489f-91ba-96ef12bb05d0 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: d134faaa-b15e-4b19-ba32-3a35b779234f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:17.423417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53b52437-d377-489f-91ba-96ef12bb05d0 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:17.427408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53b52437-d377-489f-91ba-96ef12bb05d0 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:17.428398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53b52437-d377-489f-91ba-96ef12bb05d0 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:17.431066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53b52437-d377-489f-91ba-96ef12bb05d0 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:17.434594 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53b52437-d377-489f-91ba-96ef12bb05d0 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:17.443174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53b52437-d377-489f-91ba-96ef12bb05d0 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:18.920193 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-53b52437-d377-489f-91ba-96ef12bb05d0 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f" status: 200 len: 1463 microversion: 2.1 time: 1.526234 Sep 07 13:13:18.946813 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2925/5891] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:17 2022] GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f => generated 1463 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:19.987979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c939ab0e-c88c-4b2d-b70c-66c5d1255e6a tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:19.992460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c939ab0e-c88c-4b2d-b70c-66c5d1255e6a tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: d134faaa-b15e-4b19-ba32-3a35b779234f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:20.077081 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c939ab0e-c88c-4b2d-b70c-66c5d1255e6a tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:20.078457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c939ab0e-c88c-4b2d-b70c-66c5d1255e6a tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:20.082327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c939ab0e-c88c-4b2d-b70c-66c5d1255e6a tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:20.088234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c939ab0e-c88c-4b2d-b70c-66c5d1255e6a tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:20.089618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c939ab0e-c88c-4b2d-b70c-66c5d1255e6a tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:20.093250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c939ab0e-c88c-4b2d-b70c-66c5d1255e6a tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:20.895654 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c939ab0e-c88c-4b2d-b70c-66c5d1255e6a tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f" status: 200 len: 1463 microversion: 2.1 time: 0.943570 Sep 07 13:13:20.953136 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2967/5892] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:19 2022] GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f => generated 1463 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:21.939853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-73921d56-6dbc-4ee2-bf63-f320400088b7 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:21.950688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-73921d56-6dbc-4ee2-bf63-f320400088b7 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: d134faaa-b15e-4b19-ba32-3a35b779234f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:21.982786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73921d56-6dbc-4ee2-bf63-f320400088b7 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:21.995155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73921d56-6dbc-4ee2-bf63-f320400088b7 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:21.995957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73921d56-6dbc-4ee2-bf63-f320400088b7 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:21.997153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73921d56-6dbc-4ee2-bf63-f320400088b7 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:21.997990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73921d56-6dbc-4ee2-bf63-f320400088b7 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:21.998673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73921d56-6dbc-4ee2-bf63-f320400088b7 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:25.682825 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-73921d56-6dbc-4ee2-bf63-f320400088b7 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f" status: 200 len: 1463 microversion: 2.1 time: 3.745483 Sep 07 13:13:25.687425 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2926/5893] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:21 2022] GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f => generated 1463 bytes in 3755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:26.730586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-68e68bb0-2ef1-4743-aae0-800221ee5a6b tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:26.739771 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-68e68bb0-2ef1-4743-aae0-800221ee5a6b tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: d134faaa-b15e-4b19-ba32-3a35b779234f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:26.797014 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68e68bb0-2ef1-4743-aae0-800221ee5a6b tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:26.802538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68e68bb0-2ef1-4743-aae0-800221ee5a6b tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:26.804851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68e68bb0-2ef1-4743-aae0-800221ee5a6b tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:26.821471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68e68bb0-2ef1-4743-aae0-800221ee5a6b tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:26.822659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68e68bb0-2ef1-4743-aae0-800221ee5a6b tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:26.840643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68e68bb0-2ef1-4743-aae0-800221ee5a6b tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:27.340293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4999c68f-639f-4108-a099-90e1b2e5c700 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:27.344533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4999c68f-639f-4108-a099-90e1b2e5c700 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: 079df104-daab-42b3-95d5-ec241b9564bf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:27.420866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4999c68f-639f-4108-a099-90e1b2e5c700 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:27.424959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4999c68f-639f-4108-a099-90e1b2e5c700 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:27.426274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4999c68f-639f-4108-a099-90e1b2e5c700 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:27.429094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4999c68f-639f-4108-a099-90e1b2e5c700 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:27.429907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4999c68f-639f-4108-a099-90e1b2e5c700 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:27.435063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4999c68f-639f-4108-a099-90e1b2e5c700 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:27.818171 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-68e68bb0-2ef1-4743-aae0-800221ee5a6b tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f" status: 200 len: 1463 microversion: 2.1 time: 1.094173 Sep 07 13:13:27.819566 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2968/5894] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:26 2022] GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f => generated 1463 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:27.868153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-4999c68f-639f-4108-a099-90e1b2e5c700 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lazy-loading 'services' on Instance uuid 079df104-daab-42b3-95d5-ec241b9564bf {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:13:28.141291 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4999c68f-639f-4108-a099-90e1b2e5c700 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "DELETE /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf/os-volume_attachments/f3a3a10d-56a2-4ff5-932e-ce63f5565128" status: 202 len: 0 microversion: 2.1 time: 0.830860 Sep 07 13:13:28.146100 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2927/5895] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Sep 7 13:13:27 2022] DELETE /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf/os-volume_attachments/f3a3a10d-56a2-4ff5-932e-ce63f5565128 => generated 0 bytes in 837 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:13:28.589036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8ac00275-5e91-4417-a259-1f9ebaa0a956 req-74a0743f-5c73-4efc-a4f4-79bf927b86e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d134faaa-b15e-4b19-ba32-3a35b779234f", "name": "network-vif-plugged", "status": "completed", "tag": "bad10794-a3f1-4221-87b9-1b2b496a5be4"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:28.624578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8ac00275-5e91-4417-a259-1f9ebaa0a956 req-74a0743f-5c73-4efc-a4f4-79bf927b86e9 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:28.626609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8ac00275-5e91-4417-a259-1f9ebaa0a956 req-74a0743f-5c73-4efc-a4f4-79bf927b86e9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:28.627211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8ac00275-5e91-4417-a259-1f9ebaa0a956 req-74a0743f-5c73-4efc-a4f4-79bf927b86e9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:28.734592 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8ac00275-5e91-4417-a259-1f9ebaa0a956 req-74a0743f-5c73-4efc-a4f4-79bf927b86e9 service nova] Creating event network-vif-plugged:bad10794-a3f1-4221-87b9-1b2b496a5be4 for instance d134faaa-b15e-4b19-ba32-3a35b779234f on n-h2-852087-9 Sep 07 13:13:28.776607 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8ac00275-5e91-4417-a259-1f9ebaa0a956 req-74a0743f-5c73-4efc-a4f4-79bf927b86e9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172876 Sep 07 13:13:28.777804 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2969/5896] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:13:28.854784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d74d3ed6-8d67-4337-b5f8-9b99635dab81 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:28.856231 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d74d3ed6-8d67-4337-b5f8-9b99635dab81 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: d134faaa-b15e-4b19-ba32-3a35b779234f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:28.872175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d74d3ed6-8d67-4337-b5f8-9b99635dab81 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:28.873192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d74d3ed6-8d67-4337-b5f8-9b99635dab81 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:28.874055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d74d3ed6-8d67-4337-b5f8-9b99635dab81 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:28.879711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d74d3ed6-8d67-4337-b5f8-9b99635dab81 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:28.880592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d74d3ed6-8d67-4337-b5f8-9b99635dab81 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:28.881202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d74d3ed6-8d67-4337-b5f8-9b99635dab81 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:30.515370 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d74d3ed6-8d67-4337-b5f8-9b99635dab81 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f" status: 200 len: 1463 microversion: 2.1 time: 1.671547 Sep 07 13:13:30.523107 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2928/5897] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:28 2022] GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f => generated 1463 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:31.568561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-af216fb7-3cb3-493d-af9f-f5c54dfe9963 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:31.588643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-af216fb7-3cb3-493d-af9f-f5c54dfe9963 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: d134faaa-b15e-4b19-ba32-3a35b779234f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:31.634265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af216fb7-3cb3-493d-af9f-f5c54dfe9963 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:31.635314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af216fb7-3cb3-493d-af9f-f5c54dfe9963 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:31.639579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af216fb7-3cb3-493d-af9f-f5c54dfe9963 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:31.641016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af216fb7-3cb3-493d-af9f-f5c54dfe9963 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:31.645220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af216fb7-3cb3-493d-af9f-f5c54dfe9963 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:31.647609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af216fb7-3cb3-493d-af9f-f5c54dfe9963 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:33.295653 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-af216fb7-3cb3-493d-af9f-f5c54dfe9963 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f" status: 200 len: 1463 microversion: 2.1 time: 1.729456 Sep 07 13:13:33.320363 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2970/5898] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:31 2022] GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f => generated 1463 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:34.332704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-293b4157-51af-4abb-b407-7aa04e48e545 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:34.338655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-293b4157-51af-4abb-b407-7aa04e48e545 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: d134faaa-b15e-4b19-ba32-3a35b779234f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:34.363581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:34.368235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-293b4157-51af-4abb-b407-7aa04e48e545 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:34.375317 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-293b4157-51af-4abb-b407-7aa04e48e545 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:34.376547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-293b4157-51af-4abb-b407-7aa04e48e545 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:34.379674 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-293b4157-51af-4abb-b407-7aa04e48e545 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:34.383306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-293b4157-51af-4abb-b407-7aa04e48e545 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:34.384864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-293b4157-51af-4abb-b407-7aa04e48e545 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:34.411816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:35.719145 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-293b4157-51af-4abb-b407-7aa04e48e545 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f" status: 200 len: 1648 microversion: 2.1 time: 1.393894 Sep 07 13:13:35.743034 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2929/5899] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:34 2022] GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f => generated 1648 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:35.766438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d5090183-32db-4a2e-8a79-0733630c38ef tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:35.768867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d5090183-32db-4a2e-8a79-0733630c38ef tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: d134faaa-b15e-4b19-ba32-3a35b779234f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:35.800323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5090183-32db-4a2e-8a79-0733630c38ef tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:35.801655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5090183-32db-4a2e-8a79-0733630c38ef tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:35.816167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5090183-32db-4a2e-8a79-0733630c38ef tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:35.820826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5090183-32db-4a2e-8a79-0733630c38ef tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:35.826221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5090183-32db-4a2e-8a79-0733630c38ef tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:35.827733 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5090183-32db-4a2e-8a79-0733630c38ef tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:37.917044 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d5090183-32db-4a2e-8a79-0733630c38ef tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f" status: 200 len: 1648 microversion: 2.1 time: 2.161924 Sep 07 13:13:37.944016 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2971/5900] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:35 2022] GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f => generated 1648 bytes in 2165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:37.956011 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-81f45b80-5538-4a6a-8fe5-ead4e8d5a2f7 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:37.957827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-81f45b80-5538-4a6a-8fe5-ead4e8d5a2f7 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: d134faaa-b15e-4b19-ba32-3a35b779234f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:37.975466 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81f45b80-5538-4a6a-8fe5-ead4e8d5a2f7 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:37.976323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81f45b80-5538-4a6a-8fe5-ead4e8d5a2f7 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:37.977438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81f45b80-5538-4a6a-8fe5-ead4e8d5a2f7 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:37.978803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81f45b80-5538-4a6a-8fe5-ead4e8d5a2f7 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:37.981892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81f45b80-5538-4a6a-8fe5-ead4e8d5a2f7 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:38.024645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81f45b80-5538-4a6a-8fe5-ead4e8d5a2f7 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.044s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:39.196691 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-81f45b80-5538-4a6a-8fe5-ead4e8d5a2f7 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f" status: 200 len: 1648 microversion: 2.1 time: 1.250993 Sep 07 13:13:39.219643 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2930/5901] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:37 2022] GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f => generated 1648 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:39.228733 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fa1bddcd-330a-4e8d-8076-6022ccf9e231 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:39.230094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fa1bddcd-330a-4e8d-8076-6022ccf9e231 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: d134faaa-b15e-4b19-ba32-3a35b779234f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:39.247641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa1bddcd-330a-4e8d-8076-6022ccf9e231 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:39.249190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa1bddcd-330a-4e8d-8076-6022ccf9e231 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:39.250244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa1bddcd-330a-4e8d-8076-6022ccf9e231 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:39.251400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa1bddcd-330a-4e8d-8076-6022ccf9e231 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:39.252065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa1bddcd-330a-4e8d-8076-6022ccf9e231 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:39.254648 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fa1bddcd-330a-4e8d-8076-6022ccf9e231 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:39.334201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fa1bddcd-330a-4e8d-8076-6022ccf9e231 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: d134faaa-b15e-4b19-ba32-3a35b779234f] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:13:39.588691 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fa1bddcd-330a-4e8d-8076-6022ccf9e231 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f" status: 204 len: 0 microversion: 2.1 time: 0.364748 Sep 07 13:13:39.589326 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2972/5902] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:13:39 2022] DELETE /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:13:39.602671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5192af18-fa15-4554-9fc9-ad325ea19da7 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:39.604149 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5192af18-fa15-4554-9fc9-ad325ea19da7 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: d134faaa-b15e-4b19-ba32-3a35b779234f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:39.632102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5192af18-fa15-4554-9fc9-ad325ea19da7 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:39.635022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5192af18-fa15-4554-9fc9-ad325ea19da7 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:39.638383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5192af18-fa15-4554-9fc9-ad325ea19da7 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:39.641978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5192af18-fa15-4554-9fc9-ad325ea19da7 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:39.644556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5192af18-fa15-4554-9fc9-ad325ea19da7 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:39.648855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5192af18-fa15-4554-9fc9-ad325ea19da7 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:41.055202 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5192af18-fa15-4554-9fc9-ad325ea19da7 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f" status: 200 len: 1654 microversion: 2.1 time: 1.460640 Sep 07 13:13:41.061948 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2931/5903] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:39 2022] GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f => generated 1654 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:42.118162 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-61467427-a465-47fc-b2f6-d67137a6388f tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:42.120422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-61467427-a465-47fc-b2f6-d67137a6388f tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: d134faaa-b15e-4b19-ba32-3a35b779234f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:42.131333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:42.136240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61467427-a465-47fc-b2f6-d67137a6388f tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:42.137765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61467427-a465-47fc-b2f6-d67137a6388f tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:42.138999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61467427-a465-47fc-b2f6-d67137a6388f tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:42.140833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61467427-a465-47fc-b2f6-d67137a6388f tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:42.145854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61467427-a465-47fc-b2f6-d67137a6388f tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:42.147252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61467427-a465-47fc-b2f6-d67137a6388f tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:42.279292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:42.944958 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-61467427-a465-47fc-b2f6-d67137a6388f tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f" status: 200 len: 1654 microversion: 2.1 time: 0.834868 Sep 07 13:13:42.970137 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2973/5904] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:42 2022] GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f => generated 1654 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:43.995618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-89464022-4edf-4aee-85c8-03205fecee00 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:43.997264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-89464022-4edf-4aee-85c8-03205fecee00 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: d134faaa-b15e-4b19-ba32-3a35b779234f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:44.002757 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:13:44.002995 n-d-852087-9 devstack@n-api.service[122432]: Wed Sep 7 13:13:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f (ip 10.222.0.16) !!! Sep 07 13:13:44.045881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89464022-4edf-4aee-85c8-03205fecee00 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:44.051959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89464022-4edf-4aee-85c8-03205fecee00 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:44.053105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89464022-4edf-4aee-85c8-03205fecee00 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:44.054124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89464022-4edf-4aee-85c8-03205fecee00 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:44.059183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89464022-4edf-4aee-85c8-03205fecee00 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:44.060326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89464022-4edf-4aee-85c8-03205fecee00 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:44.344559 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-89464022-4edf-4aee-85c8-03205fecee00 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f" status: 200 len: 1612 microversion: 2.1 time: 0.355804 Sep 07 13:13:44.355027 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2932/5905] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:43 2022] GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f => generated 1612 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:44.604711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-b579fe07-7aa1-4091-8ec4-d7ce1765a927 req-a23249a9-513d-4332-800d-ac2d0b5562b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d134faaa-b15e-4b19-ba32-3a35b779234f", "name": "network-vif-deleted", "tag": "bad10794-a3f1-4221-87b9-1b2b496a5be4"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:44.630626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b579fe07-7aa1-4091-8ec4-d7ce1765a927 req-a23249a9-513d-4332-800d-ac2d0b5562b4 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:44.633430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b579fe07-7aa1-4091-8ec4-d7ce1765a927 req-a23249a9-513d-4332-800d-ac2d0b5562b4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:44.639959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b579fe07-7aa1-4091-8ec4-d7ce1765a927 req-a23249a9-513d-4332-800d-ac2d0b5562b4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:44.679939 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-b579fe07-7aa1-4091-8ec4-d7ce1765a927 req-a23249a9-513d-4332-800d-ac2d0b5562b4 service nova] Creating event network-vif-deleted:bad10794-a3f1-4221-87b9-1b2b496a5be4 for instance d134faaa-b15e-4b19-ba32-3a35b779234f on n-h2-852087-9 Sep 07 13:13:44.689469 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-b579fe07-7aa1-4091-8ec4-d7ce1765a927 req-a23249a9-513d-4332-800d-ac2d0b5562b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089330 Sep 07 13:13:44.694211 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2974/5906] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:13:45.105090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e40b63b7-b20a-496a-aade-45a031120a18 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:45.105754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e40b63b7-b20a-496a-aade-45a031120a18 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: 079df104-daab-42b3-95d5-ec241b9564bf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:45.120257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e40b63b7-b20a-496a-aade-45a031120a18 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.123529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e40b63b7-b20a-496a-aade-45a031120a18 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.124278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e40b63b7-b20a-496a-aade-45a031120a18 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.127183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e40b63b7-b20a-496a-aade-45a031120a18 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.129520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e40b63b7-b20a-496a-aade-45a031120a18 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.130148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e40b63b7-b20a-496a-aade-45a031120a18 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.247348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e40b63b7-b20a-496a-aade-45a031120a18 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: 079df104-daab-42b3-95d5-ec241b9564bf] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:13:45.383849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-12080550-a5dc-487c-94fe-c3326f294129 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:45.390376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-12080550-a5dc-487c-94fe-c3326f294129 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: d134faaa-b15e-4b19-ba32-3a35b779234f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:45.437206 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12080550-a5dc-487c-94fe-c3326f294129 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.438201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12080550-a5dc-487c-94fe-c3326f294129 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.439005 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12080550-a5dc-487c-94fe-c3326f294129 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.455335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12080550-a5dc-487c-94fe-c3326f294129 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.456593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12080550-a5dc-487c-94fe-c3326f294129 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.457414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12080550-a5dc-487c-94fe-c3326f294129 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.570280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12080550-a5dc-487c-94fe-c3326f294129 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.573967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12080550-a5dc-487c-94fe-c3326f294129 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.574679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12080550-a5dc-487c-94fe-c3326f294129 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.575491 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-12080550-a5dc-487c-94fe-c3326f294129 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lazy-loading 'fault' on Instance uuid d134faaa-b15e-4b19-ba32-3a35b779234f {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:13:45.778153 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e40b63b7-b20a-496a-aade-45a031120a18 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "DELETE /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf" status: 204 len: 0 microversion: 2.1 time: 0.672739 Sep 07 13:13:45.783238 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2933/5907] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:13:45 2022] DELETE /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf => generated 0 bytes in 685 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:13:45.828050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-77627736-4bca-49aa-9932-77878d492350 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:45.840334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-77627736-4bca-49aa-9932-77878d492350 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: 079df104-daab-42b3-95d5-ec241b9564bf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:45.876172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77627736-4bca-49aa-9932-77878d492350 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.879323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77627736-4bca-49aa-9932-77878d492350 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.881031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77627736-4bca-49aa-9932-77878d492350 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.882158 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77627736-4bca-49aa-9932-77878d492350 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:45.893193 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77627736-4bca-49aa-9932-77878d492350 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:45.894554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77627736-4bca-49aa-9932-77878d492350 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:45.970783 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-12080550-a5dc-487c-94fe-c3326f294129 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f" status: 200 len: 1453 microversion: 2.1 time: 0.593732 Sep 07 13:13:45.979013 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2975/5908] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:45 2022] GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f => generated 1453 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:46.542030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-77627736-4bca-49aa-9932-77878d492350 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:46.555891 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-77627736-4bca-49aa-9932-77878d492350 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf" status: 200 len: 1513 microversion: 2.1 time: 0.763590 Sep 07 13:13:46.561904 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2934/5909] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:45 2022] GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf => generated 1513 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:47.029798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8066c48d-024c-415d-ab73-6d86ee739b10 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:47.034019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8066c48d-024c-415d-ab73-6d86ee739b10 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: d134faaa-b15e-4b19-ba32-3a35b779234f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:47.076576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8066c48d-024c-415d-ab73-6d86ee739b10 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:47.080564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8066c48d-024c-415d-ab73-6d86ee739b10 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:47.081438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8066c48d-024c-415d-ab73-6d86ee739b10 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:47.082636 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8066c48d-024c-415d-ab73-6d86ee739b10 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:47.083222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8066c48d-024c-415d-ab73-6d86ee739b10 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:47.092854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8066c48d-024c-415d-ab73-6d86ee739b10 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:47.238193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8066c48d-024c-415d-ab73-6d86ee739b10 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:47.245001 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8066c48d-024c-415d-ab73-6d86ee739b10 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:47.249113 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8066c48d-024c-415d-ab73-6d86ee739b10 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:47.250294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-8066c48d-024c-415d-ab73-6d86ee739b10 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lazy-loading 'fault' on Instance uuid d134faaa-b15e-4b19-ba32-3a35b779234f {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:13:47.601285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-91484535-11e0-40d8-b9e1-782380b82a27 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:47.602088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-91484535-11e0-40d8-b9e1-782380b82a27 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: 079df104-daab-42b3-95d5-ec241b9564bf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:47.622906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91484535-11e0-40d8-b9e1-782380b82a27 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:47.623774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91484535-11e0-40d8-b9e1-782380b82a27 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:47.624757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91484535-11e0-40d8-b9e1-782380b82a27 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:47.625752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91484535-11e0-40d8-b9e1-782380b82a27 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:47.626454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91484535-11e0-40d8-b9e1-782380b82a27 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:47.627110 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-91484535-11e0-40d8-b9e1-782380b82a27 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:48.222483 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8066c48d-024c-415d-ab73-6d86ee739b10 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f" status: 200 len: 1453 microversion: 2.1 time: 1.200995 Sep 07 13:13:48.266363 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2976/5910] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:47 2022] GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f => generated 1453 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:48.841723 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-91484535-11e0-40d8-b9e1-782380b82a27 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:48.880725 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-91484535-11e0-40d8-b9e1-782380b82a27 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf" status: 200 len: 1513 microversion: 2.1 time: 1.284057 Sep 07 13:13:48.902482 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2935/5911] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:47 2022] GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf => generated 1513 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:49.268899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6dc84023-481c-4f77-892f-adcd15326076 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:49.279960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6dc84023-481c-4f77-892f-adcd15326076 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: d134faaa-b15e-4b19-ba32-3a35b779234f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:49.303051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dc84023-481c-4f77-892f-adcd15326076 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:49.318633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dc84023-481c-4f77-892f-adcd15326076 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:49.319740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dc84023-481c-4f77-892f-adcd15326076 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:49.334833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dc84023-481c-4f77-892f-adcd15326076 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:49.337450 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dc84023-481c-4f77-892f-adcd15326076 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:49.348132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6dc84023-481c-4f77-892f-adcd15326076 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:49.436629 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-6dc84023-481c-4f77-892f-adcd15326076 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] HTTP exception thrown: Instance d134faaa-b15e-4b19-ba32-3a35b779234f could not be found. Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6dc84023-481c-4f77-892f-adcd15326076 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Request method failure captured: Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f HTTP/1.1 Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJi6W5uV8vuE88zlmgN_dqOZa3UroA6qgWrYpbqJG5tDPZm0lLQBotCIqus1FpJ-sUqoc9DBMS0CqPxpEoTRjN5Pp4lWquMtFnE3lq9b6GnA5GZfphnOWGeImes0AA-f8jire0jpMFUs9C_wfEc_rXaGE2ZwcWxZ-ivuzc7-CPbxvNo Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 5eaba6050f9049b1a42520080092e17a Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TestServerMultinode-1975926379 Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5eaba6050f9049b1a42520080092e17a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5eaba6050f9049b1a42520080092e17a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5eaba6050f9049b1a42520080092e17a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5eaba6050f9049b1a42520080092e17a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TestServerMultinode-1975926379 Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 5eaba6050f9049b1a42520080092e17a Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestServerMultinode-1975926379 Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TestServerMultinode-1975926379-project-admin Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: b272adc4c70245e190d5b40697350adf Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TestServerMultinode-1975926379-project-admin Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance d134faaa-b15e-4b19-ba32-3a35b779234f could not be found. Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'd134faaa-b15e-4b19-ba32-3a35b779234f'} Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d134faaa-b15e-4b19-ba32-3a35b779234f could not be found. Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d134faaa-b15e-4b19-ba32-3a35b779234f could not be found. Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:13:49.454356 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:13:49.459491 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:13:49.459491 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:13:49.459491 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:13:49.459491 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:13:49.459491 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:13:49.459491 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d134faaa-b15e-4b19-ba32-3a35b779234f could not be found. Sep 07 13:13:49.459491 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:13:49.468177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6dc84023-481c-4f77-892f-adcd15326076 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Returning 404 to user: Instance d134faaa-b15e-4b19-ba32-3a35b779234f could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:13:49.469412 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6dc84023-481c-4f77-892f-adcd15326076 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f" status: 404 len: 111 microversion: 2.1 time: 0.208013 Sep 07 13:13:49.477341 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2977/5912] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:49 2022] GET /compute/v2.1/servers/d134faaa-b15e-4b19-ba32-3a35b779234f => generated 111 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:13:49.486367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-98bc7c93-9c38-46c9-b20b-c53c7baaed76 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:49.487220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-98bc7c93-9c38-46c9-b20b-c53c7baaed76 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:49.520939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98bc7c93-9c38-46c9-b20b-c53c7baaed76 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:49.521929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98bc7c93-9c38-46c9-b20b-c53c7baaed76 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:49.522684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98bc7c93-9c38-46c9-b20b-c53c7baaed76 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:49.536111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98bc7c93-9c38-46c9-b20b-c53c7baaed76 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:49.537713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98bc7c93-9c38-46c9-b20b-c53c7baaed76 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:49.538207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98bc7c93-9c38-46c9-b20b-c53c7baaed76 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:49.681056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-98bc7c93-9c38-46c9-b20b-c53c7baaed76 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:13:49.938380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f36d9b7b-8ff3-4442-99e1-345a2b434e2c tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:49.941827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f36d9b7b-8ff3-4442-99e1-345a2b434e2c tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: 079df104-daab-42b3-95d5-ec241b9564bf] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:49.973889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f36d9b7b-8ff3-4442-99e1-345a2b434e2c tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:49.977255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f36d9b7b-8ff3-4442-99e1-345a2b434e2c tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:49.981257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f36d9b7b-8ff3-4442-99e1-345a2b434e2c tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:49.984925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f36d9b7b-8ff3-4442-99e1-345a2b434e2c tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:49.986807 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-98bc7c93-9c38-46c9-b20b-c53c7baaed76 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935" status: 204 len: 0 microversion: 2.1 time: 0.506277 Sep 07 13:13:49.997573 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2936/5913] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:13:49 2022] DELETE /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:13:50.001190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f36d9b7b-8ff3-4442-99e1-345a2b434e2c tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:50.005566 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f36d9b7b-8ff3-4442-99e1-345a2b434e2c tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:50.026858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e0b75140-3374-41c8-9aab-070ee6bd25db tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:50.034332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e0b75140-3374-41c8-9aab-070ee6bd25db tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:50.056348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0b75140-3374-41c8-9aab-070ee6bd25db tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:50.070766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0b75140-3374-41c8-9aab-070ee6bd25db tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:50.071384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0b75140-3374-41c8-9aab-070ee6bd25db tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:50.072703 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0b75140-3374-41c8-9aab-070ee6bd25db tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:50.079155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0b75140-3374-41c8-9aab-070ee6bd25db tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:50.080127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e0b75140-3374-41c8-9aab-070ee6bd25db tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:51.334982 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e0b75140-3374-41c8-9aab-070ee6bd25db tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935" status: 200 len: 1654 microversion: 2.1 time: 1.334370 Sep 07 13:13:51.349361 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2937/5914] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:49 2022] GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 => generated 1654 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:51.360073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f36d9b7b-8ff3-4442-99e1-345a2b434e2c tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:51.378719 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f36d9b7b-8ff3-4442-99e1-345a2b434e2c tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf" status: 200 len: 1513 microversion: 2.1 time: 1.457951 Sep 07 13:13:51.382234 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2978/5915] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:49 2022] GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf => generated 1513 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:51.637143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e95dbdae-bfe3-4898-8b26-349293ae6e5d req-1de72560-f5d8-45c0-911b-79191a8cd780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "079df104-daab-42b3-95d5-ec241b9564bf", "name": "network-vif-deleted", "tag": "4d281b62-3d8e-409f-83a7-36e5ba90964d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:51.704907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e95dbdae-bfe3-4898-8b26-349293ae6e5d req-1de72560-f5d8-45c0-911b-79191a8cd780 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:51.708093 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e95dbdae-bfe3-4898-8b26-349293ae6e5d req-1de72560-f5d8-45c0-911b-79191a8cd780 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:51.709742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e95dbdae-bfe3-4898-8b26-349293ae6e5d req-1de72560-f5d8-45c0-911b-79191a8cd780 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:51.758006 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e95dbdae-bfe3-4898-8b26-349293ae6e5d req-1de72560-f5d8-45c0-911b-79191a8cd780 service nova] Creating event network-vif-deleted:4d281b62-3d8e-409f-83a7-36e5ba90964d for instance 079df104-daab-42b3-95d5-ec241b9564bf on n-h2-852087-9 Sep 07 13:13:51.778853 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e95dbdae-bfe3-4898-8b26-349293ae6e5d req-1de72560-f5d8-45c0-911b-79191a8cd780 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152948 Sep 07 13:13:51.780681 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2938/5916] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:13:52.366109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1423e69d-968c-45a9-8290-52dc5e847aed tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:52.368421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1423e69d-968c-45a9-8290-52dc5e847aed tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:52.388851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1423e69d-968c-45a9-8290-52dc5e847aed tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:52.390586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1423e69d-968c-45a9-8290-52dc5e847aed tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:52.393654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1423e69d-968c-45a9-8290-52dc5e847aed tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:52.394788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1423e69d-968c-45a9-8290-52dc5e847aed tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:52.404126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c9ae249d-5d94-4d45-a351-22916348df6d tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:52.405918 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c9ae249d-5d94-4d45-a351-22916348df6d tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: 079df104-daab-42b3-95d5-ec241b9564bf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:52.410121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1423e69d-968c-45a9-8290-52dc5e847aed tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:52.411413 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1423e69d-968c-45a9-8290-52dc5e847aed tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:52.444850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9ae249d-5d94-4d45-a351-22916348df6d tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:52.446796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9ae249d-5d94-4d45-a351-22916348df6d tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:52.448164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9ae249d-5d94-4d45-a351-22916348df6d tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:52.450185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9ae249d-5d94-4d45-a351-22916348df6d tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:52.452136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9ae249d-5d94-4d45-a351-22916348df6d tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:52.453438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9ae249d-5d94-4d45-a351-22916348df6d tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:52.583579 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9ae249d-5d94-4d45-a351-22916348df6d tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:52.585291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9ae249d-5d94-4d45-a351-22916348df6d tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:52.586199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9ae249d-5d94-4d45-a351-22916348df6d tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:52.586982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-c9ae249d-5d94-4d45-a351-22916348df6d tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lazy-loading 'fault' on Instance uuid 079df104-daab-42b3-95d5-ec241b9564bf {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:13:52.888890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c9ae249d-5d94-4d45-a351-22916348df6d tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c002bf4fcd4f33a5304a8ca26a262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a5845654bb49638492b2b4a05b76a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:13:52.928232 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c9ae249d-5d94-4d45-a351-22916348df6d tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf" status: 200 len: 1309 microversion: 2.1 time: 0.528535 Sep 07 13:13:52.948302 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2939/5917] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:52 2022] GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf => generated 1309 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:53.340407 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1423e69d-968c-45a9-8290-52dc5e847aed tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935" status: 200 len: 1654 microversion: 2.1 time: 0.979366 Sep 07 13:13:53.341478 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2979/5918] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:52 2022] GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 => generated 1654 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:13:53.979974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-67654013-29f6-4f36-abee-43cbc909f0e0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:53.982707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-67654013-29f6-4f36-abee-43cbc909f0e0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] [instance: 079df104-daab-42b3-95d5-ec241b9564bf] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:54.013168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67654013-29f6-4f36-abee-43cbc909f0e0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:54.014912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67654013-29f6-4f36-abee-43cbc909f0e0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:54.016061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67654013-29f6-4f36-abee-43cbc909f0e0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:54.018993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67654013-29f6-4f36-abee-43cbc909f0e0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:54.021653 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67654013-29f6-4f36-abee-43cbc909f0e0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:54.027846 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67654013-29f6-4f36-abee-43cbc909f0e0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:54.089730 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-67654013-29f6-4f36-abee-43cbc909f0e0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] HTTP exception thrown: Instance 079df104-daab-42b3-95d5-ec241b9564bf could not be found. Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-67654013-29f6-4f36-abee-43cbc909f0e0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Request method failure captured: Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf HTTP/1.1 Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJdXnCfA3hy9qurHHVpa9hcOsS2vJ4KpnCpIkSpQ8WqlpeVde-2FHDCKhjCZHdOmKInaPfk39hO7q_qainGbfWSCtTtBy4Fsr63cUzjvZEIwbY2eNKtfTRRh1AJ1cKa7QoU6F_Vpfhs8dbUn_VnTqKM22TlAne8hHfsIS_6yJoVUKDk Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 82a5845654bb49638492b2b4a05b76a8 Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-VolumesSnapshotTestJSON-796309807 Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82a5845654bb49638492b2b4a05b76a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_82a5845654bb49638492b2b4a05b76a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/82a5845654bb49638492b2b4a05b76a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82a5845654bb49638492b2b4a05b76a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-VolumesSnapshotTestJSON-796309807 Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 82a5845654bb49638492b2b4a05b76a8 Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-796309807 Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-VolumesSnapshotTestJSON-796309807-project Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 57c002bf4fcd4f33a5304a8ca26a262b Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-VolumesSnapshotTestJSON-796309807-project Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 079df104-daab-42b3-95d5-ec241b9564bf could not be found. Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '079df104-daab-42b3-95d5-ec241b9564bf'} Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 079df104-daab-42b3-95d5-ec241b9564bf could not be found. Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 079df104-daab-42b3-95d5-ec241b9564bf could not be found. Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:13:54.095525 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:13:54.109052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:13:54.109052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:13:54.109052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:13:54.109052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:13:54.109052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:13:54.109052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 079df104-daab-42b3-95d5-ec241b9564bf could not be found. Sep 07 13:13:54.109052 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:13:54.109052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-67654013-29f6-4f36-abee-43cbc909f0e0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] Returning 404 to user: Instance 079df104-daab-42b3-95d5-ec241b9564bf could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:13:54.111447 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-67654013-29f6-4f36-abee-43cbc909f0e0 tempest-VolumesSnapshotTestJSON-796309807 tempest-VolumesSnapshotTestJSON-796309807-project] 10.222.0.16 "GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf" status: 404 len: 111 microversion: 2.1 time: 0.136615 Sep 07 13:13:54.116376 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2940/5919] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:53 2022] GET /compute/v2.1/servers/079df104-daab-42b3-95d5-ec241b9564bf => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:13:54.385845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-769fb427-870d-47b1-9036-5d803e59ce49 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:54.386659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-769fb427-870d-47b1-9036-5d803e59ce49 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:54.408001 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-769fb427-870d-47b1-9036-5d803e59ce49 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:54.416043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-769fb427-870d-47b1-9036-5d803e59ce49 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:54.418488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-769fb427-870d-47b1-9036-5d803e59ce49 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:54.419557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-769fb427-870d-47b1-9036-5d803e59ce49 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:54.423559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-769fb427-870d-47b1-9036-5d803e59ce49 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:54.426862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-769fb427-870d-47b1-9036-5d803e59ce49 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:54.760394 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-769fb427-870d-47b1-9036-5d803e59ce49 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935" status: 200 len: 1612 microversion: 2.1 time: 0.378861 Sep 07 13:13:54.765282 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2980/5920] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:54 2022] GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 => generated 1612 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:54.806269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-da3c4a6b-9e6c-46e6-95ed-1886f9676a63 req-22a2d5c4-4943-4b2c-aadd-28267547fbe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8d12cf-2c1e-4e13-8f93-194bcdb1d935", "name": "network-vif-deleted", "tag": "d8405c9c-cb3f-4796-b161-d84a746e3378"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:13:54.852022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-da3c4a6b-9e6c-46e6-95ed-1886f9676a63 req-22a2d5c4-4943-4b2c-aadd-28267547fbe1 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:54.853290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-da3c4a6b-9e6c-46e6-95ed-1886f9676a63 req-22a2d5c4-4943-4b2c-aadd-28267547fbe1 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:54.854475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-da3c4a6b-9e6c-46e6-95ed-1886f9676a63 req-22a2d5c4-4943-4b2c-aadd-28267547fbe1 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:54.905744 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-da3c4a6b-9e6c-46e6-95ed-1886f9676a63 req-22a2d5c4-4943-4b2c-aadd-28267547fbe1 service nova] Creating event network-vif-deleted:d8405c9c-cb3f-4796-b161-d84a746e3378 for instance 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 on n-h1-852087-9 Sep 07 13:13:54.929516 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-da3c4a6b-9e6c-46e6-95ed-1886f9676a63 req-22a2d5c4-4943-4b2c-aadd-28267547fbe1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129122 Sep 07 13:13:54.943339 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2941/5921] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:13:55.787425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b5187036-0bb2-48d6-8168-d1b9640b7ac6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:55.788705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b5187036-0bb2-48d6-8168-d1b9640b7ac6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:55.799096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5187036-0bb2-48d6-8168-d1b9640b7ac6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:55.799659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5187036-0bb2-48d6-8168-d1b9640b7ac6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:55.800178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5187036-0bb2-48d6-8168-d1b9640b7ac6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:55.800938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5187036-0bb2-48d6-8168-d1b9640b7ac6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:55.801550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5187036-0bb2-48d6-8168-d1b9640b7ac6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:55.822795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5187036-0bb2-48d6-8168-d1b9640b7ac6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:55.971229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5187036-0bb2-48d6-8168-d1b9640b7ac6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:55.975011 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5187036-0bb2-48d6-8168-d1b9640b7ac6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:55.975670 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5187036-0bb2-48d6-8168-d1b9640b7ac6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:55.979263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-b5187036-0bb2-48d6-8168-d1b9640b7ac6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lazy-loading 'fault' on Instance uuid 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:13:56.163684 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b5187036-0bb2-48d6-8168-d1b9640b7ac6 tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935" status: 200 len: 1453 microversion: 2.1 time: 0.380408 Sep 07 13:13:56.169233 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2981/5922] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:55 2022] GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 => generated 1453 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:13:57.241195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cc19b3fd-3f27-448e-8e0f-d44511cdc16c tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:13:57.243174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cc19b3fd-3f27-448e-8e0f-d44511cdc16c tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] [instance: 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:13:57.270714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc19b3fd-3f27-448e-8e0f-d44511cdc16c tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:57.278852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc19b3fd-3f27-448e-8e0f-d44511cdc16c tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:57.279779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc19b3fd-3f27-448e-8e0f-d44511cdc16c tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:57.280870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc19b3fd-3f27-448e-8e0f-d44511cdc16c tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:13:57.281769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc19b3fd-3f27-448e-8e0f-d44511cdc16c tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:13:57.282460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc19b3fd-3f27-448e-8e0f-d44511cdc16c tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:13:57.314630 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-cc19b3fd-3f27-448e-8e0f-d44511cdc16c tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] HTTP exception thrown: Instance 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 could not be found. Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cc19b3fd-3f27-448e-8e0f-d44511cdc16c tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Request method failure captured: Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 HTTP/1.1 Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJi6W5uV8vuE88zlmgN_dqOZa3UroA6qgWrYpbqJG5tDPZm0lLQBotCIqus1FpJ-sUqoc9DBMS0CqPxpEoTRjN5Pp4lWquMtFnE3lq9b6GnA5GZfphnOWGeImes0AA-f8jire0jpMFUs9C_wfEc_rXaGE2ZwcWxZ-ivuzc7-CPbxvNo Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 5eaba6050f9049b1a42520080092e17a Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TestServerMultinode-1975926379 Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member,admin Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member,admin Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5eaba6050f9049b1a42520080092e17a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5eaba6050f9049b1a42520080092e17a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5eaba6050f9049b1a42520080092e17a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5eaba6050f9049b1a42520080092e17a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TestServerMultinode-1975926379 Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 5eaba6050f9049b1a42520080092e17a Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestServerMultinode-1975926379 Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TestServerMultinode-1975926379-project-admin Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: b272adc4c70245e190d5b40697350adf Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TestServerMultinode-1975926379-project-admin Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 could not be found. Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '8f8d12cf-2c1e-4e13-8f93-194bcdb1d935'} Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 could not be found. Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 could not be found. Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:13:57.322298 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:13:57.327461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:13:57.327461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:13:57.327461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:13:57.327461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:13:57.327461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:13:57.327461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 could not be found. Sep 07 13:13:57.327461 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:13:57.336920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cc19b3fd-3f27-448e-8e0f-d44511cdc16c tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] Returning 404 to user: Instance 8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:13:57.338342 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cc19b3fd-3f27-448e-8e0f-d44511cdc16c tempest-TestServerMultinode-1975926379 tempest-TestServerMultinode-1975926379-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935" status: 404 len: 111 microversion: 2.1 time: 0.104698 Sep 07 13:13:57.339467 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2942/5923] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:13:57 2022] GET /compute/v2.1/servers/8f8d12cf-2c1e-4e13-8f93-194bcdb1d935 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:15:06.971468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=23 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:06.973240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=51 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:07.256290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cc5e497e-26f9-4daf-8f22-b45f2ba91c74 tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-383546433", "availability_zone": "foo_zone"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:15:07.271623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.aggregate [None req-cc5e497e-26f9-4daf-8f22-b45f2ba91c74 tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] Generated uuid 4b9adc51-f661-42ba-8293-a90ba578bdab for aggregate {{(pid=122433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 07 13:15:07.390335 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cc5e497e-26f9-4daf-8f22-b45f2ba91c74 tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.420544 Sep 07 13:15:07.397736 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2982/5924] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Sep 7 13:15:06 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:15:07.419241 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-28db387a-9d7e-47ef-a267-ad020127597d tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:15:07.461809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:07.469857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:07.630260 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-28db387a-9d7e-47ef-a267-ad020127597d tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.222186 Sep 07 13:15:07.635446 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2943/5925] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Sep 7 13:15:07 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:07.656347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ec17c44-ca36-492a-856d-44099647db8a tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:07.689928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ec17c44-ca36-492a-856d-44099647db8a tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:07.692899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ec17c44-ca36-492a-856d-44099647db8a tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:07.699107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ec17c44-ca36-492a-856d-44099647db8a tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:07.704362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ec17c44-ca36-492a-856d-44099647db8a tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:07.743095 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ec17c44-ca36-492a-856d-44099647db8a tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:07.749373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ec17c44-ca36-492a-856d-44099647db8a tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:07.853153 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ec17c44-ca36-492a-856d-44099647db8a tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.207324 Sep 07 13:15:07.855206 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2983/5926] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Sep 7 13:15:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:07.919473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1a583a5a-3f88-4756-a31d-be6c07691704 tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:07.938609 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1a583a5a-3f88-4756-a31d-be6c07691704 tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.074199 Sep 07 13:15:07.940981 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2944/5927] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Sep 7 13:15:07 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:07.959122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bde6064a-d7f5-4a2c-a241-b0d35987dff2 tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-852087-9"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:15:08.096466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bde6064a-d7f5-4a2c-a241-b0d35987dff2 tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:08.123455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bde6064a-d7f5-4a2c-a241-b0d35987dff2 tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:08.127700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bde6064a-d7f5-4a2c-a241-b0d35987dff2 tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:09.468741 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bde6064a-d7f5-4a2c-a241-b0d35987dff2 tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 1.512330 Sep 07 13:15:09.471078 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2984/5928] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Sep 7 13:15:07 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:09.492410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6fc8835d-6622-4e1a-9300-54c231b82b10 tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:09.589833 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6fc8835d-6622-4e1a-9300-54c231b82b10 tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.106741 Sep 07 13:15:09.595618 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2945/5929] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Sep 7 13:15:09 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:09.609008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a2e96c16-8892-49e0-9f6b-6e57f02b2c6c tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1596051228", "availability_zone": "foo_zone"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:15:09.822336 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a2e96c16-8892-49e0-9f6b-6e57f02b2c6c tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.221160 Sep 07 13:15:09.827098 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2985/5930] 10.222.0.16 () {60 vars in 1173 bytes} [Wed Sep 7 13:15:09 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:15:09.845062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-66b959c0-da4b-420f-b8f3-fdbbe1fd687d tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:15:10.030956 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-66b959c0-da4b-420f-b8f3-fdbbe1fd687d tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.195432 Sep 07 13:15:10.034246 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2946/5931] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Sep 7 13:15:09 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:10.050083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae70f358-a328-42ee-b8ec-dd1d4b26e06d tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:10.077537 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ae70f358-a328-42ee-b8ec-dd1d4b26e06d tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.035608 Sep 07 13:15:10.081689 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2986/5932] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Sep 7 13:15:10 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:10.102057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-77ddd240-2e02-4da0-bb91-9044ec8b7b01 tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-852087-9"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:15:10.128586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77ddd240-2e02-4da0-bb91-9044ec8b7b01 tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:10.129567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77ddd240-2e02-4da0-bb91-9044ec8b7b01 tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:10.130264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77ddd240-2e02-4da0-bb91-9044ec8b7b01 tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:11.019549 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-77ddd240-2e02-4da0-bb91-9044ec8b7b01 tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.915565 Sep 07 13:15:11.023397 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2947/5933] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Sep 7 13:15:10 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:15:11.039831 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b3f2956b-adb4-4335-8867-2d0dd1a06d4a tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:11.130841 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b3f2956b-adb4-4335-8867-2d0dd1a06d4a tempest-TestAggregatesBasicOps-1210943708 tempest-TestAggregatesBasicOps-1210943708-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.096424 Sep 07 13:15:11.133576 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2987/5934] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Sep 7 13:15:11 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 07 13:15:53.951772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c8432754-9480-4135-b175-8c8a66fc4d59 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1063344529", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:15:53.977165 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:53.980805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:54.111213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-c8432754-9480-4135-b175-8c8a66fc4d59 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:15:54.966507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c8432754-9480-4135-b175-8c8a66fc4d59 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:15:54.968168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c8432754-9480-4135-b175-8c8a66fc4d59 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:15:54.968877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c8432754-9480-4135-b175-8c8a66fc4d59 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:15:54.969556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c8432754-9480-4135-b175-8c8a66fc4d59 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:15:54.970588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c8432754-9480-4135-b175-8c8a66fc4d59 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:15:54.999821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8432754-9480-4135-b175-8c8a66fc4d59 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:55.001035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8432754-9480-4135-b175-8c8a66fc4d59 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:55.001952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8432754-9480-4135-b175-8c8a66fc4d59 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:55.003330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8432754-9480-4135-b175-8c8a66fc4d59 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:55.004122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8432754-9480-4135-b175-8c8a66fc4d59 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:55.004748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8432754-9480-4135-b175-8c8a66fc4d59 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:55.038553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-c8432754-9480-4135-b175-8c8a66fc4d59 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Getting quotas for project 834e0f8f3e54437d8f2535e55155f617. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:15:55.049179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-c8432754-9480-4135-b175-8c8a66fc4d59 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Getting quotas for user 2aee89c019d6462d81de255a29eb4a00 and project 834e0f8f3e54437d8f2535e55155f617. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:15:55.235338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c8432754-9480-4135-b175-8c8a66fc4d59 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:15:55.241861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c8432754-9480-4135-b175-8c8a66fc4d59 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] [instance: 22473ac8-0732-4434-8c14-6ba430b3bd42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:15:55.401533 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c8432754-9480-4135-b175-8c8a66fc4d59 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.463137 Sep 07 13:15:55.431592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:55.433959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:55.438404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:55.441472 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2948/5935] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:15:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:15:55.458397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-108bb4b3-1d1f-48b3-a724-224ce055c7da tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:55.459990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-108bb4b3-1d1f-48b3-a724-224ce055c7da tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] [instance: 22473ac8-0732-4434-8c14-6ba430b3bd42] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:56.379877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-108bb4b3-1d1f-48b3-a724-224ce055c7da tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aee89c019d6462d81de255a29eb4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834e0f8f3e54437d8f2535e55155f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:56.393180 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-108bb4b3-1d1f-48b3-a724-224ce055c7da tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] 10.222.0.16 "GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42" status: 200 len: 1214 microversion: 2.1 time: 0.964324 Sep 07 13:15:56.394123 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2988/5936] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:55 2022] GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42 => generated 1214 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:57.431919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-09d2e2e9-359c-490b-a97a-f982c8b16034 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:57.436640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-09d2e2e9-359c-490b-a97a-f982c8b16034 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] [instance: 22473ac8-0732-4434-8c14-6ba430b3bd42] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:57.473097 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09d2e2e9-359c-490b-a97a-f982c8b16034 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:57.474458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09d2e2e9-359c-490b-a97a-f982c8b16034 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:57.475112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09d2e2e9-359c-490b-a97a-f982c8b16034 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:57.476887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09d2e2e9-359c-490b-a97a-f982c8b16034 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:57.478593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09d2e2e9-359c-490b-a97a-f982c8b16034 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:57.479233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09d2e2e9-359c-490b-a97a-f982c8b16034 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:57.702354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-09d2e2e9-359c-490b-a97a-f982c8b16034 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aee89c019d6462d81de255a29eb4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834e0f8f3e54437d8f2535e55155f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:57.720196 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-09d2e2e9-359c-490b-a97a-f982c8b16034 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] 10.222.0.16 "GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42" status: 200 len: 1266 microversion: 2.1 time: 0.300495 Sep 07 13:15:57.723871 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2949/5937] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:57 2022] GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42 => generated 1266 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:15:58.759686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-12b0ed6f-e297-4faf-aacb-119695a3f589 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:15:58.765788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-12b0ed6f-e297-4faf-aacb-119695a3f589 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] [instance: 22473ac8-0732-4434-8c14-6ba430b3bd42] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:15:58.794672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12b0ed6f-e297-4faf-aacb-119695a3f589 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:58.803117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12b0ed6f-e297-4faf-aacb-119695a3f589 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:58.804411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12b0ed6f-e297-4faf-aacb-119695a3f589 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:58.809007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12b0ed6f-e297-4faf-aacb-119695a3f589 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:15:58.810056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12b0ed6f-e297-4faf-aacb-119695a3f589 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:15:58.810808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12b0ed6f-e297-4faf-aacb-119695a3f589 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:15:59.194933 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-12b0ed6f-e297-4faf-aacb-119695a3f589 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aee89c019d6462d81de255a29eb4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834e0f8f3e54437d8f2535e55155f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:15:59.238663 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-12b0ed6f-e297-4faf-aacb-119695a3f589 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] 10.222.0.16 "GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42" status: 200 len: 1272 microversion: 2.1 time: 0.488166 Sep 07 13:15:59.240814 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2989/5938] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:15:58 2022] GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42 => generated 1272 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:16:00.271757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-89d3e74c-a156-4fa0-b649-a8481160d97c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:00.273690 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-89d3e74c-a156-4fa0-b649-a8481160d97c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] [instance: 22473ac8-0732-4434-8c14-6ba430b3bd42] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:00.297120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89d3e74c-a156-4fa0-b649-a8481160d97c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:00.297711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89d3e74c-a156-4fa0-b649-a8481160d97c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:00.298864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89d3e74c-a156-4fa0-b649-a8481160d97c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:00.301820 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89d3e74c-a156-4fa0-b649-a8481160d97c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:00.302399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89d3e74c-a156-4fa0-b649-a8481160d97c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:00.302850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89d3e74c-a156-4fa0-b649-a8481160d97c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:00.417251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-89d3e74c-a156-4fa0-b649-a8481160d97c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aee89c019d6462d81de255a29eb4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834e0f8f3e54437d8f2535e55155f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:00.429782 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-89d3e74c-a156-4fa0-b649-a8481160d97c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] 10.222.0.16 "GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42" status: 200 len: 1272 microversion: 2.1 time: 0.163877 Sep 07 13:16:00.433922 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2950/5939] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:00 2022] GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42 => generated 1272 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:01.462809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c75f1cd7-8fa6-4c8b-9c76-d0704db029c8 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:01.469147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c75f1cd7-8fa6-4c8b-9c76-d0704db029c8 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] [instance: 22473ac8-0732-4434-8c14-6ba430b3bd42] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:01.500535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c75f1cd7-8fa6-4c8b-9c76-d0704db029c8 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:01.502667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c75f1cd7-8fa6-4c8b-9c76-d0704db029c8 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:01.503292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c75f1cd7-8fa6-4c8b-9c76-d0704db029c8 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:01.506692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c75f1cd7-8fa6-4c8b-9c76-d0704db029c8 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:01.507957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c75f1cd7-8fa6-4c8b-9c76-d0704db029c8 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:01.511121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c75f1cd7-8fa6-4c8b-9c76-d0704db029c8 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:02.611667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c75f1cd7-8fa6-4c8b-9c76-d0704db029c8 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aee89c019d6462d81de255a29eb4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834e0f8f3e54437d8f2535e55155f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:02.628632 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c75f1cd7-8fa6-4c8b-9c76-d0704db029c8 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] 10.222.0.16 "GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42" status: 200 len: 1314 microversion: 2.1 time: 1.171075 Sep 07 13:16:02.629344 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2990/5940] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:01 2022] GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42 => generated 1314 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:03.657462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-29ef085f-b3e4-4b02-a472-7a90098669f5 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:03.659904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-29ef085f-b3e4-4b02-a472-7a90098669f5 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] [instance: 22473ac8-0732-4434-8c14-6ba430b3bd42] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:03.687943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29ef085f-b3e4-4b02-a472-7a90098669f5 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:03.689447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29ef085f-b3e4-4b02-a472-7a90098669f5 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:03.689447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29ef085f-b3e4-4b02-a472-7a90098669f5 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:03.690359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29ef085f-b3e4-4b02-a472-7a90098669f5 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:03.690961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29ef085f-b3e4-4b02-a472-7a90098669f5 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:03.691544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29ef085f-b3e4-4b02-a472-7a90098669f5 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:03.699247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-de1ec275-804d-464d-bf71-03794dda7190 req-574bb3ad-be70-43bf-80aa-43bc03bdebbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22473ac8-0732-4434-8c14-6ba430b3bd42", "tag": "bbda365f-fcfd-44bb-9853-5e79a4144dc4"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:03.716544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-de1ec275-804d-464d-bf71-03794dda7190 req-574bb3ad-be70-43bf-80aa-43bc03bdebbd service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:03.717361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-de1ec275-804d-464d-bf71-03794dda7190 req-574bb3ad-be70-43bf-80aa-43bc03bdebbd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:03.718199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-de1ec275-804d-464d-bf71-03794dda7190 req-574bb3ad-be70-43bf-80aa-43bc03bdebbd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:03.748454 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-de1ec275-804d-464d-bf71-03794dda7190 req-574bb3ad-be70-43bf-80aa-43bc03bdebbd service nova] Creating event network-changed:bbda365f-fcfd-44bb-9853-5e79a4144dc4 for instance 22473ac8-0732-4434-8c14-6ba430b3bd42 on n-h2-852087-9 Sep 07 13:16:03.766451 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-de1ec275-804d-464d-bf71-03794dda7190 req-574bb3ad-be70-43bf-80aa-43bc03bdebbd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.319740 Sep 07 13:16:03.769034 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2951/5941] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:16:04.246734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-29ef085f-b3e4-4b02-a472-7a90098669f5 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aee89c019d6462d81de255a29eb4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834e0f8f3e54437d8f2535e55155f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:04.285349 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-29ef085f-b3e4-4b02-a472-7a90098669f5 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] 10.222.0.16 "GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42" status: 200 len: 1314 microversion: 2.1 time: 0.630239 Sep 07 13:16:04.291253 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2991/5942] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:03 2022] GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42 => generated 1314 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:05.319227 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-42689f69-047f-4490-9e55-262f1d54a039 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:05.320544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-42689f69-047f-4490-9e55-262f1d54a039 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] [instance: 22473ac8-0732-4434-8c14-6ba430b3bd42] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:05.336868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:05.346158 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:05.359614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42689f69-047f-4490-9e55-262f1d54a039 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:05.360844 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42689f69-047f-4490-9e55-262f1d54a039 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:05.361623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42689f69-047f-4490-9e55-262f1d54a039 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:05.363337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42689f69-047f-4490-9e55-262f1d54a039 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:05.364745 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42689f69-047f-4490-9e55-262f1d54a039 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:05.366978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42689f69-047f-4490-9e55-262f1d54a039 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:06.980542 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-42689f69-047f-4490-9e55-262f1d54a039 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aee89c019d6462d81de255a29eb4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834e0f8f3e54437d8f2535e55155f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:06.996614 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-42689f69-047f-4490-9e55-262f1d54a039 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] 10.222.0.16 "GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42" status: 200 len: 1314 microversion: 2.1 time: 1.684640 Sep 07 13:16:07.021413 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2952/5943] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:05 2022] GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42 => generated 1314 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:08.046438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1bbb381c-6ae2-4e65-b79c-1f03fcd559d1 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:08.051552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1bbb381c-6ae2-4e65-b79c-1f03fcd559d1 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] [instance: 22473ac8-0732-4434-8c14-6ba430b3bd42] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:08.067177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:08.091404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bbb381c-6ae2-4e65-b79c-1f03fcd559d1 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:08.092658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bbb381c-6ae2-4e65-b79c-1f03fcd559d1 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:08.093750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bbb381c-6ae2-4e65-b79c-1f03fcd559d1 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:08.095749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bbb381c-6ae2-4e65-b79c-1f03fcd559d1 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:08.102678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bbb381c-6ae2-4e65-b79c-1f03fcd559d1 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:08.103789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bbb381c-6ae2-4e65-b79c-1f03fcd559d1 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:08.769634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1bbb381c-6ae2-4e65-b79c-1f03fcd559d1 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aee89c019d6462d81de255a29eb4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834e0f8f3e54437d8f2535e55155f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:08.792306 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1bbb381c-6ae2-4e65-b79c-1f03fcd559d1 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] 10.222.0.16 "GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42" status: 200 len: 1314 microversion: 2.1 time: 0.754270 Sep 07 13:16:08.801113 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2992/5944] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:08 2022] GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42 => generated 1314 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:09.834335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a97ac9b7-d941-4df4-8f18-ad98f8f47a5f tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:09.835210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a97ac9b7-d941-4df4-8f18-ad98f8f47a5f tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] [instance: 22473ac8-0732-4434-8c14-6ba430b3bd42] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:09.855884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a97ac9b7-d941-4df4-8f18-ad98f8f47a5f tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:09.857085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a97ac9b7-d941-4df4-8f18-ad98f8f47a5f tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:09.857995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a97ac9b7-d941-4df4-8f18-ad98f8f47a5f tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:09.859931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a97ac9b7-d941-4df4-8f18-ad98f8f47a5f tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:09.863799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a97ac9b7-d941-4df4-8f18-ad98f8f47a5f tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:09.866235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a97ac9b7-d941-4df4-8f18-ad98f8f47a5f tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:10.744244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-45d7142b-172f-4d7c-8203-f08b5da10a90 req-e806ecd2-5505-4834-ba90-0ae0cde3a839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22473ac8-0732-4434-8c14-6ba430b3bd42", "name": "network-vif-plugged", "status": "completed", "tag": "bbda365f-fcfd-44bb-9853-5e79a4144dc4"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:10.772917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-45d7142b-172f-4d7c-8203-f08b5da10a90 req-e806ecd2-5505-4834-ba90-0ae0cde3a839 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:10.773401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-45d7142b-172f-4d7c-8203-f08b5da10a90 req-e806ecd2-5505-4834-ba90-0ae0cde3a839 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:10.783637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-45d7142b-172f-4d7c-8203-f08b5da10a90 req-e806ecd2-5505-4834-ba90-0ae0cde3a839 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:10.821336 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-45d7142b-172f-4d7c-8203-f08b5da10a90 req-e806ecd2-5505-4834-ba90-0ae0cde3a839 service nova] Creating event network-vif-plugged:bbda365f-fcfd-44bb-9853-5e79a4144dc4 for instance 22473ac8-0732-4434-8c14-6ba430b3bd42 on n-h2-852087-9 Sep 07 13:16:10.832805 n-d-852087-9 devstack@n-api.service[122433]: ERROR oslo.messaging._drivers.impl_rabbit [req-45d7142b-172f-4d7c-8203-f08b5da10a90 req-e806ecd2-5505-4834-ba90-0ae0cde3a839 service nova] [81d23c08-3e6e-4cbc-85bd-9ad2bdb76aee] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 13:16:10.973775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a97ac9b7-d941-4df4-8f18-ad98f8f47a5f tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aee89c019d6462d81de255a29eb4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834e0f8f3e54437d8f2535e55155f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:10.986926 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a97ac9b7-d941-4df4-8f18-ad98f8f47a5f tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] 10.222.0.16 "GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42" status: 200 len: 1314 microversion: 2.1 time: 1.167611 Sep 07 13:16:10.989733 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2953/5945] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:09 2022] GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42 => generated 1314 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:11.868493 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [req-45d7142b-172f-4d7c-8203-f08b5da10a90 req-e806ecd2-5505-4834-ba90-0ae0cde3a839 service nova] [81d23c08-3e6e-4cbc-85bd-9ad2bdb76aee] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 50184. Sep 07 13:16:11.879184 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-45d7142b-172f-4d7c-8203-f08b5da10a90 req-e806ecd2-5505-4834-ba90-0ae0cde3a839 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.138741 Sep 07 13:16:11.880539 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2993/5946] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:16:12.022246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-325d6f15-ba9c-4597-824c-af9e887ecf65 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:12.025566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-325d6f15-ba9c-4597-824c-af9e887ecf65 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] [instance: 22473ac8-0732-4434-8c14-6ba430b3bd42] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:12.072168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-325d6f15-ba9c-4597-824c-af9e887ecf65 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:12.076844 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-325d6f15-ba9c-4597-824c-af9e887ecf65 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:12.087929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-325d6f15-ba9c-4597-824c-af9e887ecf65 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:12.091206 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-325d6f15-ba9c-4597-824c-af9e887ecf65 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:12.106655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-325d6f15-ba9c-4597-824c-af9e887ecf65 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:12.108577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-325d6f15-ba9c-4597-824c-af9e887ecf65 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:12.609831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-325d6f15-ba9c-4597-824c-af9e887ecf65 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aee89c019d6462d81de255a29eb4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834e0f8f3e54437d8f2535e55155f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:12.666580 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-325d6f15-ba9c-4597-824c-af9e887ecf65 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] 10.222.0.16 "GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42" status: 200 len: 1314 microversion: 2.1 time: 0.654119 Sep 07 13:16:12.667631 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2954/5947] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:12 2022] GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42 => generated 1314 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:13.709984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-867db358-03a7-4385-b72b-9a80b2ac19a2 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:13.710862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-867db358-03a7-4385-b72b-9a80b2ac19a2 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] [instance: 22473ac8-0732-4434-8c14-6ba430b3bd42] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:13.731857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-867db358-03a7-4385-b72b-9a80b2ac19a2 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:13.732419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-867db358-03a7-4385-b72b-9a80b2ac19a2 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:13.734315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-867db358-03a7-4385-b72b-9a80b2ac19a2 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:13.735276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-867db358-03a7-4385-b72b-9a80b2ac19a2 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:13.735782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-867db358-03a7-4385-b72b-9a80b2ac19a2 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:13.736248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-867db358-03a7-4385-b72b-9a80b2ac19a2 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:14.362882 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-867db358-03a7-4385-b72b-9a80b2ac19a2 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aee89c019d6462d81de255a29eb4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834e0f8f3e54437d8f2535e55155f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:14.383104 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-867db358-03a7-4385-b72b-9a80b2ac19a2 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] 10.222.0.16 "GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42" status: 200 len: 1464 microversion: 2.1 time: 0.679532 Sep 07 13:16:14.403703 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2994/5948] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:13 2022] GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42 => generated 1464 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:14.424513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ee344f9e-a66c-4ea2-b673-2fa55659829c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8e5b0b3-3b96-428d-9634-253392d01731", "device": "/dev/sdb"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:14.435032 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ee344f9e-a66c-4ea2-b673-2fa55659829c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] [instance: 22473ac8-0732-4434-8c14-6ba430b3bd42] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:14.492675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee344f9e-a66c-4ea2-b673-2fa55659829c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:14.496135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee344f9e-a66c-4ea2-b673-2fa55659829c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:14.500462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee344f9e-a66c-4ea2-b673-2fa55659829c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:14.506048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee344f9e-a66c-4ea2-b673-2fa55659829c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:14.508315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee344f9e-a66c-4ea2-b673-2fa55659829c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:14.511053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee344f9e-a66c-4ea2-b673-2fa55659829c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:15.182328 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ee344f9e-a66c-4ea2-b673-2fa55659829c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] 10.222.0.16 "POST /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.768985 Sep 07 13:16:15.193562 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2955/5949] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Sep 7 13:16:14 2022] POST /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42/os-volume_attachments => generated 194 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:16:28.743323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=16 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:28.754627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=32 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:29.279492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0c95b48c-a4b0-4dd7-9020-1ba47d0e6969 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Action: 'create', calling method: .version_select at 0x7fc418b1b940>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1442745630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGDRg0gnGhCjey6/slcJrB14lCP1uZMCyT+YnKE373yIhNhb1O6YIsZlxCF+S0xwyv3CgB7pTx/eoQStFRZzl2L0bPkgpdGc2HfqI3XI+DpMeBh6+yhe3+FBQh3SR7XqA=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:29.338421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-0c95b48c-a4b0-4dd7-9020-1ba47d0e6969 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Getting quotas for project af013e51bd3f469a94e33b24c25830a9. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:16:29.358714 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-0c95b48c-a4b0-4dd7-9020-1ba47d0e6969 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Getting quotas for user 5ba809cda0244f51aa7276d5ae9b5644 and project af013e51bd3f469a94e33b24c25830a9. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:16:29.411917 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0c95b48c-a4b0-4dd7-9020-1ba47d0e6969 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.679470 Sep 07 13:16:29.419947 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2995/5950] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 13:16:28 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:16:32.816186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-00a4efe4-8622-4e36-9bce-0aae576275fc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1621384451", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1442745630", "security_groups": [{"name": "tempest-secgroup-smoke-110847064"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "cf9fe714-daf0-49c2-bbc3-aea243c364fd"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:32.857059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:32.859419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:33.284098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-00a4efe4-8622-4e36-9bce-0aae576275fc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] validate_networks() for [('cf9fe714-daf0-49c2-bbc3-aea243c364fd', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:16:34.743861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-00a4efe4-8622-4e36-9bce-0aae576275fc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Getting quotas for project af013e51bd3f469a94e33b24c25830a9. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:16:34.767752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-00a4efe4-8622-4e36-9bce-0aae576275fc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Getting quotas for user 5ba809cda0244f51aa7276d5ae9b5644 and project af013e51bd3f469a94e33b24c25830a9. Resources: dict_keys(['metadata_items']) {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:16:34.825859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-00a4efe4-8622-4e36-9bce-0aae576275fc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:16:34.827196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-00a4efe4-8622-4e36-9bce-0aae576275fc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:16:34.828266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-00a4efe4-8622-4e36-9bce-0aae576275fc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:16:34.829541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-00a4efe4-8622-4e36-9bce-0aae576275fc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:16:34.830478 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-00a4efe4-8622-4e36-9bce-0aae576275fc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:16:34.846785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00a4efe4-8622-4e36-9bce-0aae576275fc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:34.847847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00a4efe4-8622-4e36-9bce-0aae576275fc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:34.848792 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00a4efe4-8622-4e36-9bce-0aae576275fc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:34.850470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00a4efe4-8622-4e36-9bce-0aae576275fc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:34.851556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00a4efe4-8622-4e36-9bce-0aae576275fc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:34.852786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00a4efe4-8622-4e36-9bce-0aae576275fc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:34.941599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-00a4efe4-8622-4e36-9bce-0aae576275fc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Getting quotas for project af013e51bd3f469a94e33b24c25830a9. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:16:34.955290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-00a4efe4-8622-4e36-9bce-0aae576275fc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Getting quotas for user 5ba809cda0244f51aa7276d5ae9b5644 and project af013e51bd3f469a94e33b24c25830a9. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:16:34.985263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-00a4efe4-8622-4e36-9bce-0aae576275fc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:16:34.990323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-00a4efe4-8622-4e36-9bce-0aae576275fc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] [instance: 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:16:35.189992 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-00a4efe4-8622-4e36-9bce-0aae576275fc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.381228 Sep 07 13:16:35.193972 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2956/5951] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:16:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 2388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:16:35.206308 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e0601c1b-bcd9-4ca6-90fb-7f89bd4f5588 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:35.207207 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e0601c1b-bcd9-4ca6-90fb-7f89bd4f5588 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] [instance: 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:35.413424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e0601c1b-bcd9-4ca6-90fb-7f89bd4f5588 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba809cda0244f51aa7276d5ae9b5644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af013e51bd3f469a94e33b24c25830a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:35.421624 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e0601c1b-bcd9-4ca6-90fb-7f89bd4f5588 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] 10.222.0.16 "GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8" status: 200 len: 1303 microversion: 2.1 time: 0.220179 Sep 07 13:16:35.445330 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2996/5952] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:35 2022] GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 => generated 1303 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:36.462402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-082dd747-4285-4fb7-aaa3-76e21a4d3c08 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:36.463678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-082dd747-4285-4fb7-aaa3-76e21a4d3c08 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] [instance: 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:36.823567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-082dd747-4285-4fb7-aaa3-76e21a4d3c08 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba809cda0244f51aa7276d5ae9b5644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af013e51bd3f469a94e33b24c25830a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:36.852698 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-082dd747-4285-4fb7-aaa3-76e21a4d3c08 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] 10.222.0.16 "GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8" status: 200 len: 1303 microversion: 2.1 time: 0.403017 Sep 07 13:16:36.855625 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2957/5953] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:36 2022] GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 => generated 1303 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:37.879865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf132eef-972b-4959-8dbb-2625e499837d tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:37.880585 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cf132eef-972b-4959-8dbb-2625e499837d tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] [instance: 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:37.908918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf132eef-972b-4959-8dbb-2625e499837d tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:37.922374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf132eef-972b-4959-8dbb-2625e499837d tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:37.927734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf132eef-972b-4959-8dbb-2625e499837d tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:37.928611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf132eef-972b-4959-8dbb-2625e499837d tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:37.929044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf132eef-972b-4959-8dbb-2625e499837d tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:37.929521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf132eef-972b-4959-8dbb-2625e499837d tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:38.119178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cf132eef-972b-4959-8dbb-2625e499837d tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba809cda0244f51aa7276d5ae9b5644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af013e51bd3f469a94e33b24c25830a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:38.149835 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cf132eef-972b-4959-8dbb-2625e499837d tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] 10.222.0.16 "GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8" status: 200 len: 1307 microversion: 2.1 time: 0.274843 Sep 07 13:16:38.165772 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2997/5954] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:37 2022] GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 => generated 1307 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:16:39.198859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd6964ba-0a7a-4b3f-a7f8-deff4b6188ef tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:39.205332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dd6964ba-0a7a-4b3f-a7f8-deff4b6188ef tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] [instance: 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:39.249916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd6964ba-0a7a-4b3f-a7f8-deff4b6188ef tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:39.252617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd6964ba-0a7a-4b3f-a7f8-deff4b6188ef tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:39.255111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd6964ba-0a7a-4b3f-a7f8-deff4b6188ef tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:39.256494 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd6964ba-0a7a-4b3f-a7f8-deff4b6188ef tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:39.262854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd6964ba-0a7a-4b3f-a7f8-deff4b6188ef tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:39.266486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd6964ba-0a7a-4b3f-a7f8-deff4b6188ef tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:39.542745 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dd6964ba-0a7a-4b3f-a7f8-deff4b6188ef tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba809cda0244f51aa7276d5ae9b5644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af013e51bd3f469a94e33b24c25830a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:39.628407 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dd6964ba-0a7a-4b3f-a7f8-deff4b6188ef tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] 10.222.0.16 "GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8" status: 200 len: 1373 microversion: 2.1 time: 0.402930 Sep 07 13:16:39.629614 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2958/5955] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:39 2022] GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 => generated 1373 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:40.675217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4bb35536-bf22-4a6c-a976-f1778e55fc10 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:40.676900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4bb35536-bf22-4a6c-a976-f1778e55fc10 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] [instance: 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:40.684779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bb35536-bf22-4a6c-a976-f1778e55fc10 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:40.699893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bb35536-bf22-4a6c-a976-f1778e55fc10 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:40.700671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bb35536-bf22-4a6c-a976-f1778e55fc10 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:40.705207 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bb35536-bf22-4a6c-a976-f1778e55fc10 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:40.705959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bb35536-bf22-4a6c-a976-f1778e55fc10 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:40.710519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4bb35536-bf22-4a6c-a976-f1778e55fc10 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:40.933728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4bb35536-bf22-4a6c-a976-f1778e55fc10 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba809cda0244f51aa7276d5ae9b5644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af013e51bd3f469a94e33b24c25830a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:40.958748 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4bb35536-bf22-4a6c-a976-f1778e55fc10 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] 10.222.0.16 "GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8" status: 200 len: 1361 microversion: 2.1 time: 0.285531 Sep 07 13:16:40.973448 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2998/5956] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:40 2022] GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 => generated 1361 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:41.988916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c7cd80b4-5a9e-4b77-907a-b7627d97ced1 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:41.990279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c7cd80b4-5a9e-4b77-907a-b7627d97ced1 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] [instance: 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:42.007965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7cd80b4-5a9e-4b77-907a-b7627d97ced1 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:42.008667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7cd80b4-5a9e-4b77-907a-b7627d97ced1 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:42.012675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7cd80b4-5a9e-4b77-907a-b7627d97ced1 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:42.019827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7cd80b4-5a9e-4b77-907a-b7627d97ced1 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:42.020556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7cd80b4-5a9e-4b77-907a-b7627d97ced1 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:42.021220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7cd80b4-5a9e-4b77-907a-b7627d97ced1 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:42.427654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c7cd80b4-5a9e-4b77-907a-b7627d97ced1 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba809cda0244f51aa7276d5ae9b5644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af013e51bd3f469a94e33b24c25830a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:42.443035 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c7cd80b4-5a9e-4b77-907a-b7627d97ced1 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] 10.222.0.16 "GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8" status: 200 len: 1428 microversion: 2.1 time: 0.461075 Sep 07 13:16:42.444404 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2959/5957] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:41 2022] GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 => generated 1428 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:43.474041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9785ee24-7b87-440a-8d46-fa5442e9bdd5 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:43.475177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9785ee24-7b87-440a-8d46-fa5442e9bdd5 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] [instance: 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:43.501912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9785ee24-7b87-440a-8d46-fa5442e9bdd5 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:43.502741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9785ee24-7b87-440a-8d46-fa5442e9bdd5 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:43.503533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9785ee24-7b87-440a-8d46-fa5442e9bdd5 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:43.513366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9785ee24-7b87-440a-8d46-fa5442e9bdd5 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:43.514243 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9785ee24-7b87-440a-8d46-fa5442e9bdd5 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:43.515029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9785ee24-7b87-440a-8d46-fa5442e9bdd5 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:43.899080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9785ee24-7b87-440a-8d46-fa5442e9bdd5 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba809cda0244f51aa7276d5ae9b5644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af013e51bd3f469a94e33b24c25830a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:43.939789 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9785ee24-7b87-440a-8d46-fa5442e9bdd5 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] 10.222.0.16 "GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8" status: 200 len: 1428 microversion: 2.1 time: 0.473156 Sep 07 13:16:43.952624 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 2999/5958] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:43 2022] GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 => generated 1428 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:44.841531 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-dce920c3-2a68-4c2e-94bb-fd3acd42172b req-f12d3dec-efda-40e1-a0c9-46d200543f63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fcfac58-c87d-4b0d-ab83-ee865b1fadd8", "tag": "730e86e2-27a6-4096-be01-20c327916d47"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:44.897606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:44.910273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dce920c3-2a68-4c2e-94bb-fd3acd42172b req-f12d3dec-efda-40e1-a0c9-46d200543f63 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:44.911939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dce920c3-2a68-4c2e-94bb-fd3acd42172b req-f12d3dec-efda-40e1-a0c9-46d200543f63 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:44.912846 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dce920c3-2a68-4c2e-94bb-fd3acd42172b req-f12d3dec-efda-40e1-a0c9-46d200543f63 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:44.944591 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-dce920c3-2a68-4c2e-94bb-fd3acd42172b req-f12d3dec-efda-40e1-a0c9-46d200543f63 service nova] Creating event network-changed:730e86e2-27a6-4096-be01-20c327916d47 for instance 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 on n-h1-852087-9 Sep 07 13:16:44.964747 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-dce920c3-2a68-4c2e-94bb-fd3acd42172b req-f12d3dec-efda-40e1-a0c9-46d200543f63 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129755 Sep 07 13:16:44.966275 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2960/5959] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:16:44.972193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c912e0ef-8bf6-49de-8908-29f643a99db3 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:44.973318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c912e0ef-8bf6-49de-8908-29f643a99db3 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] [instance: 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:45.013902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c912e0ef-8bf6-49de-8908-29f643a99db3 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:45.017134 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c912e0ef-8bf6-49de-8908-29f643a99db3 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:45.020641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c912e0ef-8bf6-49de-8908-29f643a99db3 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:45.029237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c912e0ef-8bf6-49de-8908-29f643a99db3 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:45.030779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c912e0ef-8bf6-49de-8908-29f643a99db3 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:45.046301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c912e0ef-8bf6-49de-8908-29f643a99db3 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:45.421213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:46.525447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c912e0ef-8bf6-49de-8908-29f643a99db3 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba809cda0244f51aa7276d5ae9b5644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af013e51bd3f469a94e33b24c25830a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:46.552969 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c912e0ef-8bf6-49de-8908-29f643a99db3 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] 10.222.0.16 "GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8" status: 200 len: 1428 microversion: 2.1 time: 1.587785 Sep 07 13:16:46.559024 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3000/5960] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:44 2022] GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 => generated 1428 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:47.610327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=12 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:47.616456 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e9a31099-72fe-4b78-9632-c088602dc181 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:47.621071 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e9a31099-72fe-4b78-9632-c088602dc181 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] [instance: 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:47.645105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9a31099-72fe-4b78-9632-c088602dc181 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:47.645897 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9a31099-72fe-4b78-9632-c088602dc181 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:47.646665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9a31099-72fe-4b78-9632-c088602dc181 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:47.648701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9a31099-72fe-4b78-9632-c088602dc181 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:47.651657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9a31099-72fe-4b78-9632-c088602dc181 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:47.652878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e9a31099-72fe-4b78-9632-c088602dc181 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:48.126316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e9a31099-72fe-4b78-9632-c088602dc181 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba809cda0244f51aa7276d5ae9b5644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af013e51bd3f469a94e33b24c25830a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:48.135211 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e9a31099-72fe-4b78-9632-c088602dc181 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] 10.222.0.16 "GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8" status: 200 len: 1428 microversion: 2.1 time: 0.535143 Sep 07 13:16:48.153526 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2961/5961] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:47 2022] GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 => generated 1428 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:49.176718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a2d650f-8a62-4005-8b18-50e2350a07f4 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:49.177845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4a2d650f-8a62-4005-8b18-50e2350a07f4 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] [instance: 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:49.212593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a2d650f-8a62-4005-8b18-50e2350a07f4 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:49.213286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a2d650f-8a62-4005-8b18-50e2350a07f4 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:49.216217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a2d650f-8a62-4005-8b18-50e2350a07f4 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:49.221860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a2d650f-8a62-4005-8b18-50e2350a07f4 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:49.235246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a2d650f-8a62-4005-8b18-50e2350a07f4 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:49.236379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a2d650f-8a62-4005-8b18-50e2350a07f4 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:50.140260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4a2d650f-8a62-4005-8b18-50e2350a07f4 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba809cda0244f51aa7276d5ae9b5644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af013e51bd3f469a94e33b24c25830a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:50.187125 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4a2d650f-8a62-4005-8b18-50e2350a07f4 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] 10.222.0.16 "GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8" status: 200 len: 1428 microversion: 2.1 time: 1.019707 Sep 07 13:16:50.193597 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3001/5962] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:49 2022] GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 => generated 1428 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:51.232734 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cc0a4ab7-6f0b-4804-beed-6dd24888df99 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:51.237032 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cc0a4ab7-6f0b-4804-beed-6dd24888df99 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] [instance: 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:51.256473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc0a4ab7-6f0b-4804-beed-6dd24888df99 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:51.257231 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc0a4ab7-6f0b-4804-beed-6dd24888df99 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:51.257947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc0a4ab7-6f0b-4804-beed-6dd24888df99 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:51.259896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc0a4ab7-6f0b-4804-beed-6dd24888df99 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:51.260703 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc0a4ab7-6f0b-4804-beed-6dd24888df99 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:51.261882 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc0a4ab7-6f0b-4804-beed-6dd24888df99 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:51.703153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cc0a4ab7-6f0b-4804-beed-6dd24888df99 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba809cda0244f51aa7276d5ae9b5644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af013e51bd3f469a94e33b24c25830a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:51.733936 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cc0a4ab7-6f0b-4804-beed-6dd24888df99 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] 10.222.0.16 "GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8" status: 200 len: 1428 microversion: 2.1 time: 0.507075 Sep 07 13:16:51.735940 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2962/5963] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:51 2022] GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 => generated 1428 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:52.768958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9ac28ecd-afc9-4186-bf83-c6b245ab61a9 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:52.769623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9ac28ecd-afc9-4186-bf83-c6b245ab61a9 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] [instance: 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:52.802994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ac28ecd-afc9-4186-bf83-c6b245ab61a9 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:52.804221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ac28ecd-afc9-4186-bf83-c6b245ab61a9 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:52.808883 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ac28ecd-afc9-4186-bf83-c6b245ab61a9 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:52.810779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ac28ecd-afc9-4186-bf83-c6b245ab61a9 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:52.811844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ac28ecd-afc9-4186-bf83-c6b245ab61a9 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:52.812829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ac28ecd-afc9-4186-bf83-c6b245ab61a9 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:53.095319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-f82ffaef-c0a6-4b79-9e09-4b18d299edab req-2a08cfc2-8751-4fcb-a8c8-3216876f5300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fcfac58-c87d-4b0d-ab83-ee865b1fadd8", "name": "network-vif-plugged", "status": "completed", "tag": "730e86e2-27a6-4096-be01-20c327916d47"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:16:53.159298 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f82ffaef-c0a6-4b79-9e09-4b18d299edab req-2a08cfc2-8751-4fcb-a8c8-3216876f5300 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:53.160135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f82ffaef-c0a6-4b79-9e09-4b18d299edab req-2a08cfc2-8751-4fcb-a8c8-3216876f5300 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:53.164539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f82ffaef-c0a6-4b79-9e09-4b18d299edab req-2a08cfc2-8751-4fcb-a8c8-3216876f5300 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:53.241086 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-f82ffaef-c0a6-4b79-9e09-4b18d299edab req-2a08cfc2-8751-4fcb-a8c8-3216876f5300 service nova] Creating event network-vif-plugged:730e86e2-27a6-4096-be01-20c327916d47 for instance 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 on n-h1-852087-9 Sep 07 13:16:53.267511 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-f82ffaef-c0a6-4b79-9e09-4b18d299edab req-2a08cfc2-8751-4fcb-a8c8-3216876f5300 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177935 Sep 07 13:16:53.269407 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2963/5964] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:16:53.463960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9ac28ecd-afc9-4186-bf83-c6b245ab61a9 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba809cda0244f51aa7276d5ae9b5644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af013e51bd3f469a94e33b24c25830a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:53.477200 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9ac28ecd-afc9-4186-bf83-c6b245ab61a9 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] 10.222.0.16 "GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8" status: 200 len: 1428 microversion: 2.1 time: 0.717586 Sep 07 13:16:53.478220 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3002/5965] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:52 2022] GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 => generated 1428 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:54.507093 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-64243141-b7de-453e-91b9-ecffc4b20511 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:54.519242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-64243141-b7de-453e-91b9-ecffc4b20511 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] [instance: 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:54.547523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64243141-b7de-453e-91b9-ecffc4b20511 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:54.548937 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64243141-b7de-453e-91b9-ecffc4b20511 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:54.550497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64243141-b7de-453e-91b9-ecffc4b20511 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:54.557889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64243141-b7de-453e-91b9-ecffc4b20511 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:54.559343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64243141-b7de-453e-91b9-ecffc4b20511 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:54.560605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64243141-b7de-453e-91b9-ecffc4b20511 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:54.930646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-64243141-b7de-453e-91b9-ecffc4b20511 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba809cda0244f51aa7276d5ae9b5644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af013e51bd3f469a94e33b24c25830a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:54.947653 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-64243141-b7de-453e-91b9-ecffc4b20511 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] 10.222.0.16 "GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8" status: 200 len: 1428 microversion: 2.1 time: 0.448499 Sep 07 13:16:54.952341 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2964/5966] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:54 2022] GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 => generated 1428 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:55.976416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2b0535f1-fd9e-450f-87e5-c32482eedc80 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:55.977226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2b0535f1-fd9e-450f-87e5-c32482eedc80 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] [instance: 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:55.988409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b0535f1-fd9e-450f-87e5-c32482eedc80 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:55.988927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b0535f1-fd9e-450f-87e5-c32482eedc80 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:55.989382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b0535f1-fd9e-450f-87e5-c32482eedc80 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:55.990368 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b0535f1-fd9e-450f-87e5-c32482eedc80 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:55.990846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b0535f1-fd9e-450f-87e5-c32482eedc80 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:55.991283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b0535f1-fd9e-450f-87e5-c32482eedc80 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:56.373362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2b0535f1-fd9e-450f-87e5-c32482eedc80 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba809cda0244f51aa7276d5ae9b5644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af013e51bd3f469a94e33b24c25830a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:56.397530 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2b0535f1-fd9e-450f-87e5-c32482eedc80 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] 10.222.0.16 "GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8" status: 200 len: 1608 microversion: 2.1 time: 0.425169 Sep 07 13:16:56.403557 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3003/5967] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:55 2022] GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 => generated 1608 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:56.458680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3c976549-b1a6-4c2b-aac1-5b6626ddf630 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:56.460806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3c976549-b1a6-4c2b-aac1-5b6626ddf630 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] [instance: 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:56.476315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c976549-b1a6-4c2b-aac1-5b6626ddf630 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:56.477667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c976549-b1a6-4c2b-aac1-5b6626ddf630 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:56.478753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c976549-b1a6-4c2b-aac1-5b6626ddf630 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:56.481580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c976549-b1a6-4c2b-aac1-5b6626ddf630 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:56.483100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c976549-b1a6-4c2b-aac1-5b6626ddf630 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:56.484499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c976549-b1a6-4c2b-aac1-5b6626ddf630 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:56.852177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3c976549-b1a6-4c2b-aac1-5b6626ddf630 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba809cda0244f51aa7276d5ae9b5644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af013e51bd3f469a94e33b24c25830a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:56.864822 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3c976549-b1a6-4c2b-aac1-5b6626ddf630 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] 10.222.0.16 "GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8" status: 200 len: 1608 microversion: 2.1 time: 0.420474 Sep 07 13:16:56.888227 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2965/5968] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:56 2022] GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 => generated 1608 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:16:56.893812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f98a42f1-13fd-461a-af15-547ad4a810ae tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:16:56.894843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f98a42f1-13fd-461a-af15-547ad4a810ae tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] [instance: 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:16:56.937948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f98a42f1-13fd-461a-af15-547ad4a810ae tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:56.939312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f98a42f1-13fd-461a-af15-547ad4a810ae tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:56.940135 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f98a42f1-13fd-461a-af15-547ad4a810ae tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:56.941516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f98a42f1-13fd-461a-af15-547ad4a810ae tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:16:56.948543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f98a42f1-13fd-461a-af15-547ad4a810ae tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:16:56.949346 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f98a42f1-13fd-461a-af15-547ad4a810ae tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:16:57.574905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f98a42f1-13fd-461a-af15-547ad4a810ae tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba809cda0244f51aa7276d5ae9b5644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af013e51bd3f469a94e33b24c25830a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:16:57.633525 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f98a42f1-13fd-461a-af15-547ad4a810ae tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] 10.222.0.16 "GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8" status: 200 len: 1608 microversion: 2.1 time: 0.744358 Sep 07 13:16:57.649890 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3004/5969] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:16:56 2022] GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 => generated 1608 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:17:03.595754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-684f5076-4fb6-47c1-bda3-b35175c8ddd5 req-ed1ef079-c937-4150-a0ab-e1fe9e0ec84b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fcfac58-c87d-4b0d-ab83-ee865b1fadd8", "tag": "730e86e2-27a6-4096-be01-20c327916d47"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:17:03.622527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:03.628348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-684f5076-4fb6-47c1-bda3-b35175c8ddd5 req-ed1ef079-c937-4150-a0ab-e1fe9e0ec84b service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:17:03.632570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-684f5076-4fb6-47c1-bda3-b35175c8ddd5 req-ed1ef079-c937-4150-a0ab-e1fe9e0ec84b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:17:03.633396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-684f5076-4fb6-47c1-bda3-b35175c8ddd5 req-ed1ef079-c937-4150-a0ab-e1fe9e0ec84b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:17:03.648770 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=43 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:03.652656 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-684f5076-4fb6-47c1-bda3-b35175c8ddd5 req-ed1ef079-c937-4150-a0ab-e1fe9e0ec84b service nova] Creating event network-changed:730e86e2-27a6-4096-be01-20c327916d47 for instance 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 on n-h1-852087-9 Sep 07 13:17:03.666075 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-684f5076-4fb6-47c1-bda3-b35175c8ddd5 req-ed1ef079-c937-4150-a0ab-e1fe9e0ec84b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076036 Sep 07 13:17:03.668026 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2966/5970] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:18:08.571896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:08.572836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=48 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:08.577033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-76c0130e-789d-4621-8df0-0fd647af36f1 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:08.577585 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-76c0130e-789d-4621-8df0-0fd647af36f1 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] [instance: 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:08.606516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76c0130e-789d-4621-8df0-0fd647af36f1 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:08.606947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76c0130e-789d-4621-8df0-0fd647af36f1 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:08.607477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76c0130e-789d-4621-8df0-0fd647af36f1 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:08.608805 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76c0130e-789d-4621-8df0-0fd647af36f1 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:08.609287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76c0130e-789d-4621-8df0-0fd647af36f1 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:08.609765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76c0130e-789d-4621-8df0-0fd647af36f1 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:08.640292 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-76c0130e-789d-4621-8df0-0fd647af36f1 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] 10.222.0.16 "GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.070348 Sep 07 13:18:08.641138 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3005/5971] 10.222.0.16 () {58 vars in 1293 bytes} [Wed Sep 7 13:18:08 2022] GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8/os-server-password => generated 116 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:11.408302 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:11.409255 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:18:11.409612 n-d-852087-9 devstack@n-api.service[122432]: Wed Sep 7 13:18:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Sep 07 13:18:11.417037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-34b01a03-cfe2-4673-a568-43930ecc7fdd tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-592356409", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:11.524017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-34b01a03-cfe2-4673-a568-43930ecc7fdd tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] validate_networks() for None {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:18:11.945588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-34b01a03-cfe2-4673-a568-43930ecc7fdd tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:18:11.946241 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-34b01a03-cfe2-4673-a568-43930ecc7fdd tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:18:11.946868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-34b01a03-cfe2-4673-a568-43930ecc7fdd tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:18:11.947429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-34b01a03-cfe2-4673-a568-43930ecc7fdd tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:18:11.948007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-34b01a03-cfe2-4673-a568-43930ecc7fdd tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:18:11.960081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34b01a03-cfe2-4673-a568-43930ecc7fdd tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:11.960761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34b01a03-cfe2-4673-a568-43930ecc7fdd tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:11.961200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34b01a03-cfe2-4673-a568-43930ecc7fdd tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:11.962076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34b01a03-cfe2-4673-a568-43930ecc7fdd tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:11.962537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34b01a03-cfe2-4673-a568-43930ecc7fdd tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:11.962963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34b01a03-cfe2-4673-a568-43930ecc7fdd tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:11.985337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-34b01a03-cfe2-4673-a568-43930ecc7fdd tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Getting quotas for project 34bbed63f7ec4de8b775001f66900e98. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:18:11.992020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-34b01a03-cfe2-4673-a568-43930ecc7fdd tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Getting quotas for user 8ca294234bbd43d785d73085d1d8aee5 and project 34bbed63f7ec4de8b775001f66900e98. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:18:12.008920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-34b01a03-cfe2-4673-a568-43930ecc7fdd tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:18:12.012005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-34b01a03-cfe2-4673-a568-43930ecc7fdd tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] [instance: 16e7a450-e7a8-442a-96c8-b38f32509632] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:18:12.080364 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-34b01a03-cfe2-4673-a568-43930ecc7fdd tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674866 Sep 07 13:18:12.085949 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2967/5972] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:18:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:18:12.102701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a414832f-2fee-4e74-8877-1eaddf7ecaa0 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:12.105593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a414832f-2fee-4e74-8877-1eaddf7ecaa0 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] [instance: 16e7a450-e7a8-442a-96c8-b38f32509632] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:12.202449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a414832f-2fee-4e74-8877-1eaddf7ecaa0 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca294234bbd43d785d73085d1d8aee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bbed63f7ec4de8b775001f66900e98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:12.211888 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a414832f-2fee-4e74-8877-1eaddf7ecaa0 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] 10.222.0.16 "GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632" status: 200 len: 1214 microversion: 2.1 time: 0.115976 Sep 07 13:18:12.212757 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3006/5973] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:12 2022] GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632 => generated 1214 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:13.236575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4f53d3f0-5829-47b2-a0fa-7b4d5b4728ec tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:13.237259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4f53d3f0-5829-47b2-a0fa-7b4d5b4728ec tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] [instance: 16e7a450-e7a8-442a-96c8-b38f32509632] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:13.363199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4f53d3f0-5829-47b2-a0fa-7b4d5b4728ec tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca294234bbd43d785d73085d1d8aee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bbed63f7ec4de8b775001f66900e98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:13.381856 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4f53d3f0-5829-47b2-a0fa-7b4d5b4728ec tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] 10.222.0.16 "GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632" status: 200 len: 1214 microversion: 2.1 time: 0.142081 Sep 07 13:18:13.384489 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2968/5974] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:13 2022] GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632 => generated 1214 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:14.424448 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e20f87b9-2643-44a8-997f-2f0da658cee3 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:14.431158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e20f87b9-2643-44a8-997f-2f0da658cee3 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] [instance: 16e7a450-e7a8-442a-96c8-b38f32509632] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:14.658726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e20f87b9-2643-44a8-997f-2f0da658cee3 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca294234bbd43d785d73085d1d8aee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bbed63f7ec4de8b775001f66900e98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:14.669717 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e20f87b9-2643-44a8-997f-2f0da658cee3 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] 10.222.0.16 "GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632" status: 200 len: 1214 microversion: 2.1 time: 0.256014 Sep 07 13:18:14.673415 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3007/5975] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:14 2022] GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632 => generated 1214 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:15.713684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0120f554-dc20-4ec4-9db3-1642111cbf83 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:15.714324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0120f554-dc20-4ec4-9db3-1642111cbf83 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] [instance: 16e7a450-e7a8-442a-96c8-b38f32509632] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:15.757094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0120f554-dc20-4ec4-9db3-1642111cbf83 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:15.766445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0120f554-dc20-4ec4-9db3-1642111cbf83 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:15.767496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0120f554-dc20-4ec4-9db3-1642111cbf83 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:15.768727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0120f554-dc20-4ec4-9db3-1642111cbf83 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:15.791677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0120f554-dc20-4ec4-9db3-1642111cbf83 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:15.792281 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0120f554-dc20-4ec4-9db3-1642111cbf83 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:16.003161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0120f554-dc20-4ec4-9db3-1642111cbf83 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca294234bbd43d785d73085d1d8aee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bbed63f7ec4de8b775001f66900e98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:16.041195 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0120f554-dc20-4ec4-9db3-1642111cbf83 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] 10.222.0.16 "GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632" status: 200 len: 1218 microversion: 2.1 time: 0.337036 Sep 07 13:18:16.079610 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2969/5976] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:15 2022] GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632 => generated 1218 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:17.106755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-828681e3-42bb-4186-8ad3-8d81ade1486a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:17.107383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-828681e3-42bb-4186-8ad3-8d81ade1486a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] [instance: 16e7a450-e7a8-442a-96c8-b38f32509632] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:17.133860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-828681e3-42bb-4186-8ad3-8d81ade1486a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:17.134460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-828681e3-42bb-4186-8ad3-8d81ade1486a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:17.134936 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-828681e3-42bb-4186-8ad3-8d81ade1486a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:17.137701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-828681e3-42bb-4186-8ad3-8d81ade1486a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:17.140191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-828681e3-42bb-4186-8ad3-8d81ade1486a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:17.143839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-828681e3-42bb-4186-8ad3-8d81ade1486a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:17.392099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-828681e3-42bb-4186-8ad3-8d81ade1486a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca294234bbd43d785d73085d1d8aee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bbed63f7ec4de8b775001f66900e98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:17.425983 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-828681e3-42bb-4186-8ad3-8d81ade1486a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] 10.222.0.16 "GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632" status: 200 len: 1266 microversion: 2.1 time: 0.329776 Sep 07 13:18:17.439179 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3008/5977] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:17 2022] GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632 => generated 1266 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:18.458734 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-954d6777-564e-4345-95fc-5d7ccea5fe0f tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:18.460516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-954d6777-564e-4345-95fc-5d7ccea5fe0f tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] [instance: 16e7a450-e7a8-442a-96c8-b38f32509632] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:18.484556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-954d6777-564e-4345-95fc-5d7ccea5fe0f tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:18.485613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-954d6777-564e-4345-95fc-5d7ccea5fe0f tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:18.486433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-954d6777-564e-4345-95fc-5d7ccea5fe0f tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:18.487783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-954d6777-564e-4345-95fc-5d7ccea5fe0f tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:18.488731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-954d6777-564e-4345-95fc-5d7ccea5fe0f tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:18.489532 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-954d6777-564e-4345-95fc-5d7ccea5fe0f tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:19.420154 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-954d6777-564e-4345-95fc-5d7ccea5fe0f tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca294234bbd43d785d73085d1d8aee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bbed63f7ec4de8b775001f66900e98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:19.442063 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-954d6777-564e-4345-95fc-5d7ccea5fe0f tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] 10.222.0.16 "GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632" status: 200 len: 1272 microversion: 2.1 time: 0.991334 Sep 07 13:18:19.442993 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2970/5978] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:18 2022] GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632 => generated 1272 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:20.491837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f87646bf-5255-49fb-8d88-69316ab5313e tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:20.492975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f87646bf-5255-49fb-8d88-69316ab5313e tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] [instance: 16e7a450-e7a8-442a-96c8-b38f32509632] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:20.523449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f87646bf-5255-49fb-8d88-69316ab5313e tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:20.524384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f87646bf-5255-49fb-8d88-69316ab5313e tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:20.525184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f87646bf-5255-49fb-8d88-69316ab5313e tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:20.526463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f87646bf-5255-49fb-8d88-69316ab5313e tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:20.527330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f87646bf-5255-49fb-8d88-69316ab5313e tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:20.534521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f87646bf-5255-49fb-8d88-69316ab5313e tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:20.708282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f87646bf-5255-49fb-8d88-69316ab5313e tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca294234bbd43d785d73085d1d8aee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bbed63f7ec4de8b775001f66900e98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:20.731595 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f87646bf-5255-49fb-8d88-69316ab5313e tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] 10.222.0.16 "GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632" status: 200 len: 1272 microversion: 2.1 time: 0.248258 Sep 07 13:18:20.732799 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3009/5979] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:20 2022] GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632 => generated 1272 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:21.762237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bf4265db-3019-4678-97fc-34ce33a9037a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:21.767546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bf4265db-3019-4678-97fc-34ce33a9037a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] [instance: 16e7a450-e7a8-442a-96c8-b38f32509632] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:21.792197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf4265db-3019-4678-97fc-34ce33a9037a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:21.793246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf4265db-3019-4678-97fc-34ce33a9037a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:21.794404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-79e53336-d7cd-4c59-941e-914538e18d73 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:21.795182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-79e53336-d7cd-4c59-941e-914538e18d73 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] [instance: 22473ac8-0732-4434-8c14-6ba430b3bd42] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:21.796474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf4265db-3019-4678-97fc-34ce33a9037a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:21.800008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf4265db-3019-4678-97fc-34ce33a9037a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:21.801412 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf4265db-3019-4678-97fc-34ce33a9037a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:21.802843 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bf4265db-3019-4678-97fc-34ce33a9037a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:21.812104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79e53336-d7cd-4c59-941e-914538e18d73 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:21.813562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79e53336-d7cd-4c59-941e-914538e18d73 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:21.814096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79e53336-d7cd-4c59-941e-914538e18d73 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:21.814904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79e53336-d7cd-4c59-941e-914538e18d73 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:21.816386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79e53336-d7cd-4c59-941e-914538e18d73 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:21.816900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79e53336-d7cd-4c59-941e-914538e18d73 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:21.941329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-79e53336-d7cd-4c59-941e-914538e18d73 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lazy-loading 'services' on Instance uuid 22473ac8-0732-4434-8c14-6ba430b3bd42 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:18:21.972845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:22.052529 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-79e53336-d7cd-4c59-941e-914538e18d73 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] 10.222.0.16 "DELETE /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42/os-volume_attachments/a8e5b0b3-3b96-428d-9634-253392d01731" status: 202 len: 0 microversion: 2.1 time: 0.263479 Sep 07 13:18:22.053795 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3010/5980] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Sep 7 13:18:21 2022] DELETE /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42/os-volume_attachments/a8e5b0b3-3b96-428d-9634-253392d01731 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:18:22.519032 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bf4265db-3019-4678-97fc-34ce33a9037a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca294234bbd43d785d73085d1d8aee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bbed63f7ec4de8b775001f66900e98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:22.532559 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bf4265db-3019-4678-97fc-34ce33a9037a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] 10.222.0.16 "GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632" status: 200 len: 1314 microversion: 2.1 time: 0.778409 Sep 07 13:18:22.533184 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2971/5981] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:21 2022] GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632 => generated 1314 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:23.290881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0dd9c31e-5c9a-49bc-92d5-7f06ab5d598a req-f9dd0932-d47d-4676-b554-2e5067990f87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e7a450-e7a8-442a-96c8-b38f32509632", "tag": "9b68864f-df5e-4625-b836-bcfdd9d0d787"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:23.330321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0dd9c31e-5c9a-49bc-92d5-7f06ab5d598a req-f9dd0932-d47d-4676-b554-2e5067990f87 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:23.332024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0dd9c31e-5c9a-49bc-92d5-7f06ab5d598a req-f9dd0932-d47d-4676-b554-2e5067990f87 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:23.333445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0dd9c31e-5c9a-49bc-92d5-7f06ab5d598a req-f9dd0932-d47d-4676-b554-2e5067990f87 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:23.378220 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0dd9c31e-5c9a-49bc-92d5-7f06ab5d598a req-f9dd0932-d47d-4676-b554-2e5067990f87 service nova] Creating event network-changed:9b68864f-df5e-4625-b836-bcfdd9d0d787 for instance 16e7a450-e7a8-442a-96c8-b38f32509632 on n-h2-852087-9 Sep 07 13:18:23.393542 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0dd9c31e-5c9a-49bc-92d5-7f06ab5d598a req-f9dd0932-d47d-4676-b554-2e5067990f87 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121935 Sep 07 13:18:23.394716 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3011/5982] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:23.577875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d9f8eeea-bbd5-485e-a666-2634746cd323 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:23.580400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d9f8eeea-bbd5-485e-a666-2634746cd323 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] [instance: 16e7a450-e7a8-442a-96c8-b38f32509632] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:23.603331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:23.612887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9f8eeea-bbd5-485e-a666-2634746cd323 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:23.614765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9f8eeea-bbd5-485e-a666-2634746cd323 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:23.616670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9f8eeea-bbd5-485e-a666-2634746cd323 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:23.618926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9f8eeea-bbd5-485e-a666-2634746cd323 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:23.621709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9f8eeea-bbd5-485e-a666-2634746cd323 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:23.623113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9f8eeea-bbd5-485e-a666-2634746cd323 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:24.299599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d9f8eeea-bbd5-485e-a666-2634746cd323 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca294234bbd43d785d73085d1d8aee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bbed63f7ec4de8b775001f66900e98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:24.318214 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d9f8eeea-bbd5-485e-a666-2634746cd323 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] 10.222.0.16 "GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632" status: 200 len: 1314 microversion: 2.1 time: 0.749649 Sep 07 13:18:24.319140 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2972/5983] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:23 2022] GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632 => generated 1314 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:25.355661 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:25.372115 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-14d7b42b-39b6-4e51-8e2e-a31c92360c19 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:25.373471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-14d7b42b-39b6-4e51-8e2e-a31c92360c19 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] [instance: 16e7a450-e7a8-442a-96c8-b38f32509632] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:25.392528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14d7b42b-39b6-4e51-8e2e-a31c92360c19 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:25.393395 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14d7b42b-39b6-4e51-8e2e-a31c92360c19 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:25.393916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14d7b42b-39b6-4e51-8e2e-a31c92360c19 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:25.395589 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14d7b42b-39b6-4e51-8e2e-a31c92360c19 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:25.395589 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14d7b42b-39b6-4e51-8e2e-a31c92360c19 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:25.402697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14d7b42b-39b6-4e51-8e2e-a31c92360c19 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:26.377279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-14d7b42b-39b6-4e51-8e2e-a31c92360c19 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca294234bbd43d785d73085d1d8aee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bbed63f7ec4de8b775001f66900e98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:26.388507 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-14d7b42b-39b6-4e51-8e2e-a31c92360c19 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] 10.222.0.16 "GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632" status: 200 len: 1314 microversion: 2.1 time: 1.035945 Sep 07 13:18:26.392497 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3012/5984] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:25 2022] GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632 => generated 1314 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:27.419523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f33977bb-1a0a-479c-8bcc-c3b91ad4103e tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:27.421806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f33977bb-1a0a-479c-8bcc-c3b91ad4103e tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] [instance: 16e7a450-e7a8-442a-96c8-b38f32509632] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:27.456446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f33977bb-1a0a-479c-8bcc-c3b91ad4103e tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:27.460343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f33977bb-1a0a-479c-8bcc-c3b91ad4103e tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:27.463441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f33977bb-1a0a-479c-8bcc-c3b91ad4103e tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:27.464968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f33977bb-1a0a-479c-8bcc-c3b91ad4103e tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:27.466198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f33977bb-1a0a-479c-8bcc-c3b91ad4103e tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:27.468583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f33977bb-1a0a-479c-8bcc-c3b91ad4103e tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:27.745741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f33977bb-1a0a-479c-8bcc-c3b91ad4103e tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca294234bbd43d785d73085d1d8aee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bbed63f7ec4de8b775001f66900e98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:27.754361 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f33977bb-1a0a-479c-8bcc-c3b91ad4103e tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] 10.222.0.16 "GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632" status: 200 len: 1314 microversion: 2.1 time: 0.342293 Sep 07 13:18:27.765533 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2973/5985] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:27 2022] GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:28.800667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ffb3b73b-83db-4e9f-be78-73c2970c66ef tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:28.806379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ffb3b73b-83db-4e9f-be78-73c2970c66ef tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] [instance: 16e7a450-e7a8-442a-96c8-b38f32509632] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:28.822866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffb3b73b-83db-4e9f-be78-73c2970c66ef tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:28.829026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffb3b73b-83db-4e9f-be78-73c2970c66ef tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:28.830968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffb3b73b-83db-4e9f-be78-73c2970c66ef tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:28.838124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffb3b73b-83db-4e9f-be78-73c2970c66ef tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:28.839326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffb3b73b-83db-4e9f-be78-73c2970c66ef tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:28.840659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffb3b73b-83db-4e9f-be78-73c2970c66ef tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:29.136697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ffb3b73b-83db-4e9f-be78-73c2970c66ef tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca294234bbd43d785d73085d1d8aee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bbed63f7ec4de8b775001f66900e98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:29.166364 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ffb3b73b-83db-4e9f-be78-73c2970c66ef tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] 10.222.0.16 "GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632" status: 200 len: 1314 microversion: 2.1 time: 0.374322 Sep 07 13:18:29.184660 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3013/5986] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:28 2022] GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:30.208915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f35302ac-f43a-4b77-a10e-7a22e1d489c6 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:30.211207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f35302ac-f43a-4b77-a10e-7a22e1d489c6 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] [instance: 16e7a450-e7a8-442a-96c8-b38f32509632] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:30.235020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f35302ac-f43a-4b77-a10e-7a22e1d489c6 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:30.236103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f35302ac-f43a-4b77-a10e-7a22e1d489c6 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:30.236816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f35302ac-f43a-4b77-a10e-7a22e1d489c6 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:30.238085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f35302ac-f43a-4b77-a10e-7a22e1d489c6 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:30.239504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f35302ac-f43a-4b77-a10e-7a22e1d489c6 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:30.240538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f35302ac-f43a-4b77-a10e-7a22e1d489c6 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:30.434238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f35302ac-f43a-4b77-a10e-7a22e1d489c6 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca294234bbd43d785d73085d1d8aee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bbed63f7ec4de8b775001f66900e98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:30.444454 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f35302ac-f43a-4b77-a10e-7a22e1d489c6 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] 10.222.0.16 "GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632" status: 200 len: 1314 microversion: 2.1 time: 0.253083 Sep 07 13:18:30.457969 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2974/5987] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:30 2022] GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:31.496338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2a8503c7-d39f-40b9-861f-04cdf400594a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:31.500550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2a8503c7-d39f-40b9-861f-04cdf400594a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] [instance: 16e7a450-e7a8-442a-96c8-b38f32509632] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:31.522140 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:18:31.522879 n-d-852087-9 devstack@n-api.service[122433]: Wed Sep 7 13:18:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632 (ip 10.222.0.16) !!! Sep 07 13:18:31.531441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a8503c7-d39f-40b9-861f-04cdf400594a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:31.532974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a8503c7-d39f-40b9-861f-04cdf400594a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:31.533920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a8503c7-d39f-40b9-861f-04cdf400594a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:31.535572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a8503c7-d39f-40b9-861f-04cdf400594a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:31.536809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a8503c7-d39f-40b9-861f-04cdf400594a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:31.538032 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a8503c7-d39f-40b9-861f-04cdf400594a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:31.775676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9f0c7171-824d-475e-a243-6f78c35ff4e6 req-74cec73f-ef6d-49f4-af25-c874328f4912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e7a450-e7a8-442a-96c8-b38f32509632", "name": "network-vif-plugged", "status": "completed", "tag": "9b68864f-df5e-4625-b836-bcfdd9d0d787"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:31.788134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9f0c7171-824d-475e-a243-6f78c35ff4e6 req-74cec73f-ef6d-49f4-af25-c874328f4912 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:31.788626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9f0c7171-824d-475e-a243-6f78c35ff4e6 req-74cec73f-ef6d-49f4-af25-c874328f4912 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:31.789061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9f0c7171-824d-475e-a243-6f78c35ff4e6 req-74cec73f-ef6d-49f4-af25-c874328f4912 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:31.805561 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9f0c7171-824d-475e-a243-6f78c35ff4e6 req-74cec73f-ef6d-49f4-af25-c874328f4912 service nova] Creating event network-vif-plugged:9b68864f-df5e-4625-b836-bcfdd9d0d787 for instance 16e7a450-e7a8-442a-96c8-b38f32509632 on n-h2-852087-9 Sep 07 13:18:31.812131 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9f0c7171-824d-475e-a243-6f78c35ff4e6 req-74cec73f-ef6d-49f4-af25-c874328f4912 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228605 Sep 07 13:18:31.813420 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2975/5988] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:31.901461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2a8503c7-d39f-40b9-861f-04cdf400594a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca294234bbd43d785d73085d1d8aee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bbed63f7ec4de8b775001f66900e98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:31.912194 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2a8503c7-d39f-40b9-861f-04cdf400594a tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] 10.222.0.16 "GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632" status: 200 len: 1314 microversion: 2.1 time: 0.427196 Sep 07 13:18:31.929775 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3014/5989] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:31 2022] GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:32.162621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-73358451-040f-41aa-a6fe-10618a07171c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:32.164254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-73358451-040f-41aa-a6fe-10618a07171c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] [instance: 22473ac8-0732-4434-8c14-6ba430b3bd42] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:32.172749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73358451-040f-41aa-a6fe-10618a07171c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:32.173586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73358451-040f-41aa-a6fe-10618a07171c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:32.174195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73358451-040f-41aa-a6fe-10618a07171c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:32.175096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73358451-040f-41aa-a6fe-10618a07171c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:32.175730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73358451-040f-41aa-a6fe-10618a07171c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:32.176326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73358451-040f-41aa-a6fe-10618a07171c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:32.214874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-73358451-040f-41aa-a6fe-10618a07171c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] [instance: 22473ac8-0732-4434-8c14-6ba430b3bd42] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:18:32.339454 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-73358451-040f-41aa-a6fe-10618a07171c tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] 10.222.0.16 "DELETE /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42" status: 204 len: 0 microversion: 2.1 time: 0.180626 Sep 07 13:18:32.341166 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2976/5990] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:18:32 2022] DELETE /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:18:32.349029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6994a709-2f04-4006-902f-b20dc717e38b tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:32.349874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6994a709-2f04-4006-902f-b20dc717e38b tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] [instance: 22473ac8-0732-4434-8c14-6ba430b3bd42] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:32.356852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6994a709-2f04-4006-902f-b20dc717e38b tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:32.357633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6994a709-2f04-4006-902f-b20dc717e38b tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:32.358252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6994a709-2f04-4006-902f-b20dc717e38b tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:32.359003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6994a709-2f04-4006-902f-b20dc717e38b tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:32.359452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6994a709-2f04-4006-902f-b20dc717e38b tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:32.359920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6994a709-2f04-4006-902f-b20dc717e38b tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:32.620724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6994a709-2f04-4006-902f-b20dc717e38b tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aee89c019d6462d81de255a29eb4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834e0f8f3e54437d8f2535e55155f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:32.632920 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6994a709-2f04-4006-902f-b20dc717e38b tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] 10.222.0.16 "GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42" status: 200 len: 1470 microversion: 2.1 time: 0.287837 Sep 07 13:18:32.633673 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3015/5991] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:32 2022] GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42 => generated 1470 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:32.939790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5c110cd3-1514-44f7-b929-f12a0d1b47ff tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:32.940574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5c110cd3-1514-44f7-b929-f12a0d1b47ff tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] [instance: 16e7a450-e7a8-442a-96c8-b38f32509632] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:32.948621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c110cd3-1514-44f7-b929-f12a0d1b47ff tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:32.949126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c110cd3-1514-44f7-b929-f12a0d1b47ff tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:32.949606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c110cd3-1514-44f7-b929-f12a0d1b47ff tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:32.950607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c110cd3-1514-44f7-b929-f12a0d1b47ff tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:32.951127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c110cd3-1514-44f7-b929-f12a0d1b47ff tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:32.951606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c110cd3-1514-44f7-b929-f12a0d1b47ff tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:33.131591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5c110cd3-1514-44f7-b929-f12a0d1b47ff tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca294234bbd43d785d73085d1d8aee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bbed63f7ec4de8b775001f66900e98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:33.148563 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5c110cd3-1514-44f7-b929-f12a0d1b47ff tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] 10.222.0.16 "GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632" status: 200 len: 1314 microversion: 2.1 time: 0.213632 Sep 07 13:18:33.173312 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2977/5992] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:32 2022] GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:33.658627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8a4d0fa0-f14c-41d6-a674-1aa107029cae tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:33.659285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8a4d0fa0-f14c-41d6-a674-1aa107029cae tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] [instance: 22473ac8-0732-4434-8c14-6ba430b3bd42] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:33.671940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a4d0fa0-f14c-41d6-a674-1aa107029cae tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:33.674814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a4d0fa0-f14c-41d6-a674-1aa107029cae tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:33.676770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a4d0fa0-f14c-41d6-a674-1aa107029cae tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:33.678086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a4d0fa0-f14c-41d6-a674-1aa107029cae tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:33.679135 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a4d0fa0-f14c-41d6-a674-1aa107029cae tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:33.680023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8a4d0fa0-f14c-41d6-a674-1aa107029cae tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:33.910243 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8a4d0fa0-f14c-41d6-a674-1aa107029cae tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aee89c019d6462d81de255a29eb4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834e0f8f3e54437d8f2535e55155f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:33.926147 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8a4d0fa0-f14c-41d6-a674-1aa107029cae tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] 10.222.0.16 "GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42" status: 200 len: 1470 microversion: 2.1 time: 0.271994 Sep 07 13:18:33.927890 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3016/5993] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:33 2022] GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42 => generated 1470 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:34.197109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-52cf1f50-1f0a-42da-8f0b-6c9e9e11cb30 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:34.198563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-52cf1f50-1f0a-42da-8f0b-6c9e9e11cb30 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] [instance: 16e7a450-e7a8-442a-96c8-b38f32509632] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:34.215676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52cf1f50-1f0a-42da-8f0b-6c9e9e11cb30 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:34.217909 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52cf1f50-1f0a-42da-8f0b-6c9e9e11cb30 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:34.219160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52cf1f50-1f0a-42da-8f0b-6c9e9e11cb30 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:34.221595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52cf1f50-1f0a-42da-8f0b-6c9e9e11cb30 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:34.222497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52cf1f50-1f0a-42da-8f0b-6c9e9e11cb30 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:34.223298 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52cf1f50-1f0a-42da-8f0b-6c9e9e11cb30 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:34.484091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-52cf1f50-1f0a-42da-8f0b-6c9e9e11cb30 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca294234bbd43d785d73085d1d8aee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bbed63f7ec4de8b775001f66900e98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:34.493853 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-52cf1f50-1f0a-42da-8f0b-6c9e9e11cb30 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] 10.222.0.16 "GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632" status: 200 len: 1314 microversion: 2.1 time: 0.307305 Sep 07 13:18:34.495209 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2978/5994] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:34 2022] GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:34.956872 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-384a13f6-50cd-4dcc-bb1d-7b65a9f87aa1 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:34.959405 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-384a13f6-50cd-4dcc-bb1d-7b65a9f87aa1 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] [instance: 22473ac8-0732-4434-8c14-6ba430b3bd42] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:34.984204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-384a13f6-50cd-4dcc-bb1d-7b65a9f87aa1 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:34.984816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-384a13f6-50cd-4dcc-bb1d-7b65a9f87aa1 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:34.985629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-384a13f6-50cd-4dcc-bb1d-7b65a9f87aa1 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:34.987381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-384a13f6-50cd-4dcc-bb1d-7b65a9f87aa1 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:34.988710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-384a13f6-50cd-4dcc-bb1d-7b65a9f87aa1 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:34.989925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-384a13f6-50cd-4dcc-bb1d-7b65a9f87aa1 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:35.534648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a7b8d19e-0dab-4e54-a439-51b95d162bf9 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:35.536341 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a7b8d19e-0dab-4e54-a439-51b95d162bf9 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] [instance: 16e7a450-e7a8-442a-96c8-b38f32509632] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:35.548741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7b8d19e-0dab-4e54-a439-51b95d162bf9 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:35.551375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7b8d19e-0dab-4e54-a439-51b95d162bf9 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:35.552214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7b8d19e-0dab-4e54-a439-51b95d162bf9 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:35.553285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7b8d19e-0dab-4e54-a439-51b95d162bf9 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:35.554632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7b8d19e-0dab-4e54-a439-51b95d162bf9 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:35.555305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7b8d19e-0dab-4e54-a439-51b95d162bf9 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:35.583220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-384a13f6-50cd-4dcc-bb1d-7b65a9f87aa1 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aee89c019d6462d81de255a29eb4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834e0f8f3e54437d8f2535e55155f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:35.609617 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-384a13f6-50cd-4dcc-bb1d-7b65a9f87aa1 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] 10.222.0.16 "GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42" status: 200 len: 1470 microversion: 2.1 time: 0.658964 Sep 07 13:18:35.610954 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3017/5995] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:34 2022] GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42 => generated 1470 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:36.171577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a7b8d19e-0dab-4e54-a439-51b95d162bf9 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca294234bbd43d785d73085d1d8aee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bbed63f7ec4de8b775001f66900e98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:36.192160 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a7b8d19e-0dab-4e54-a439-51b95d162bf9 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] 10.222.0.16 "GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632" status: 200 len: 1464 microversion: 2.1 time: 0.661800 Sep 07 13:18:36.194733 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2979/5996] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:35 2022] GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632 => generated 1464 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:36.305757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-01c38d36-3e67-4892-859f-3c97825014c4 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:36.306641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-01c38d36-3e67-4892-859f-3c97825014c4 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] [instance: 16e7a450-e7a8-442a-96c8-b38f32509632] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:36.320466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01c38d36-3e67-4892-859f-3c97825014c4 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:36.321253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01c38d36-3e67-4892-859f-3c97825014c4 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:36.322077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01c38d36-3e67-4892-859f-3c97825014c4 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:36.323359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01c38d36-3e67-4892-859f-3c97825014c4 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:36.324163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01c38d36-3e67-4892-859f-3c97825014c4 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:36.324875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01c38d36-3e67-4892-859f-3c97825014c4 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:36.398504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-01c38d36-3e67-4892-859f-3c97825014c4 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] [instance: 16e7a450-e7a8-442a-96c8-b38f32509632] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:18:36.641876 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-01c38d36-3e67-4892-859f-3c97825014c4 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] 10.222.0.16 "DELETE /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632" status: 204 len: 0 microversion: 2.1 time: 0.347817 Sep 07 13:18:36.643413 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3018/5997] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:18:36 2022] DELETE /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:18:36.658430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6c382b75-826a-4ecc-a1a7-f5137772cae6 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:36.663079 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6c382b75-826a-4ecc-a1a7-f5137772cae6 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] [instance: 22473ac8-0732-4434-8c14-6ba430b3bd42] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:36.665473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-363af229-db36-4e7f-984e-f437309e24a0 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:36.670408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-363af229-db36-4e7f-984e-f437309e24a0 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] [instance: 16e7a450-e7a8-442a-96c8-b38f32509632] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:36.695907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-363af229-db36-4e7f-984e-f437309e24a0 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:36.696684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-363af229-db36-4e7f-984e-f437309e24a0 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:36.697403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-363af229-db36-4e7f-984e-f437309e24a0 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:36.702080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-363af229-db36-4e7f-984e-f437309e24a0 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:36.703029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-363af229-db36-4e7f-984e-f437309e24a0 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:36.703711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c382b75-826a-4ecc-a1a7-f5137772cae6 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:36.704557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c382b75-826a-4ecc-a1a7-f5137772cae6 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:36.711242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-363af229-db36-4e7f-984e-f437309e24a0 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:36.714700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c382b75-826a-4ecc-a1a7-f5137772cae6 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:36.715898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c382b75-826a-4ecc-a1a7-f5137772cae6 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:36.716405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c382b75-826a-4ecc-a1a7-f5137772cae6 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:36.716858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c382b75-826a-4ecc-a1a7-f5137772cae6 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:36.917986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6c382b75-826a-4ecc-a1a7-f5137772cae6 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aee89c019d6462d81de255a29eb4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834e0f8f3e54437d8f2535e55155f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:36.928891 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6c382b75-826a-4ecc-a1a7-f5137772cae6 tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] 10.222.0.16 "GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42" status: 200 len: 1428 microversion: 2.1 time: 0.282623 Sep 07 13:18:36.931691 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2980/5998] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:36 2022] GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42 => generated 1428 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:36.937188 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-4621a2b4-bfec-42f9-ac9c-0bb3d36146bb req-359d7029-d8c4-4831-a676-9c3169ff63b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22473ac8-0732-4434-8c14-6ba430b3bd42", "name": "network-vif-deleted", "tag": "bbda365f-fcfd-44bb-9853-5e79a4144dc4"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:36.959296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4621a2b4-bfec-42f9-ac9c-0bb3d36146bb req-359d7029-d8c4-4831-a676-9c3169ff63b0 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:36.965776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4621a2b4-bfec-42f9-ac9c-0bb3d36146bb req-359d7029-d8c4-4831-a676-9c3169ff63b0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:36.966707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4621a2b4-bfec-42f9-ac9c-0bb3d36146bb req-359d7029-d8c4-4831-a676-9c3169ff63b0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:36.993901 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-4621a2b4-bfec-42f9-ac9c-0bb3d36146bb req-359d7029-d8c4-4831-a676-9c3169ff63b0 service nova] Creating event network-vif-deleted:bbda365f-fcfd-44bb-9853-5e79a4144dc4 for instance 22473ac8-0732-4434-8c14-6ba430b3bd42 on n-h2-852087-9 Sep 07 13:18:37.003256 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-4621a2b4-bfec-42f9-ac9c-0bb3d36146bb req-359d7029-d8c4-4831-a676-9c3169ff63b0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069060 Sep 07 13:18:37.005607 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2981/5999] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:37.291227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-363af229-db36-4e7f-984e-f437309e24a0 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca294234bbd43d785d73085d1d8aee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bbed63f7ec4de8b775001f66900e98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:37.369894 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-363af229-db36-4e7f-984e-f437309e24a0 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] 10.222.0.16 "GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632" status: 200 len: 1470 microversion: 2.1 time: 0.709901 Sep 07 13:18:37.374304 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3019/6000] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:36 2022] GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632 => generated 1470 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:37.986771 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d489eca-8276-4ba6-97d1-556d368434ee tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:37.990634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1d489eca-8276-4ba6-97d1-556d368434ee tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] [instance: 22473ac8-0732-4434-8c14-6ba430b3bd42] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:38.016633 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d489eca-8276-4ba6-97d1-556d368434ee tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:38.017753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d489eca-8276-4ba6-97d1-556d368434ee tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:38.018511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d489eca-8276-4ba6-97d1-556d368434ee tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:38.020983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d489eca-8276-4ba6-97d1-556d368434ee tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:38.022736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d489eca-8276-4ba6-97d1-556d368434ee tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:38.023820 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d489eca-8276-4ba6-97d1-556d368434ee tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:38.199322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1d489eca-8276-4ba6-97d1-556d368434ee tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aee89c019d6462d81de255a29eb4a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834e0f8f3e54437d8f2535e55155f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:38.212270 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1d489eca-8276-4ba6-97d1-556d368434ee tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] 10.222.0.16 "GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42" status: 200 len: 1299 microversion: 2.1 time: 0.239123 Sep 07 13:18:38.212889 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2982/6001] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:37 2022] GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42 => generated 1299 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:38.412420 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-55272526-4e96-4c9a-8eab-748a1cc6d1ed tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:38.414088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-55272526-4e96-4c9a-8eab-748a1cc6d1ed tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] [instance: 16e7a450-e7a8-442a-96c8-b38f32509632] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:38.422181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55272526-4e96-4c9a-8eab-748a1cc6d1ed tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:38.423215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55272526-4e96-4c9a-8eab-748a1cc6d1ed tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:38.423969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55272526-4e96-4c9a-8eab-748a1cc6d1ed tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:38.425309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55272526-4e96-4c9a-8eab-748a1cc6d1ed tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:38.426061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55272526-4e96-4c9a-8eab-748a1cc6d1ed tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:38.426828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55272526-4e96-4c9a-8eab-748a1cc6d1ed tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:39.276753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2a66daf6-16fe-4daa-af04-4a5653d2fbba tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:39.279125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2a66daf6-16fe-4daa-af04-4a5653d2fbba tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] [instance: 22473ac8-0732-4434-8c14-6ba430b3bd42] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:39.294462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a66daf6-16fe-4daa-af04-4a5653d2fbba tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:39.297123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a66daf6-16fe-4daa-af04-4a5653d2fbba tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:39.298731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a66daf6-16fe-4daa-af04-4a5653d2fbba tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:39.300974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a66daf6-16fe-4daa-af04-4a5653d2fbba tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:39.302656 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a66daf6-16fe-4daa-af04-4a5653d2fbba tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:39.303741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2a66daf6-16fe-4daa-af04-4a5653d2fbba tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:39.355350 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-2a66daf6-16fe-4daa-af04-4a5653d2fbba tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] HTTP exception thrown: Instance 22473ac8-0732-4434-8c14-6ba430b3bd42 could not be found. Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2a66daf6-16fe-4daa-af04-4a5653d2fbba tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Request method failure captured: Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42 HTTP/1.1 Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJmGu39YL4DISXbfGZyCkt-wyCch1lFHrBL48E84VGHo4IXCPOYzYSHyiBdawNZlX4RSnQX3K_-7kbZwYVrHRE8vxr6y8kepNAgoa1PxHlh3_6Ah74nXg-fa2pE4iJzq_DJ-l2Tj4Emf1PLrvIYV4k-_8P9M-pId_FYvhSXAfBi5KoU Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 834e0f8f3e54437d8f2535e55155f617 Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-VolumesBackupsTest-2038327574 Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/834e0f8f3e54437d8f2535e55155f617"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_834e0f8f3e54437d8f2535e55155f617"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/834e0f8f3e54437d8f2535e55155f617"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/834e0f8f3e54437d8f2535e55155f617"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-VolumesBackupsTest-2038327574 Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 834e0f8f3e54437d8f2535e55155f617 Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-VolumesBackupsTest-2038327574 Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-VolumesBackupsTest-2038327574-project Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 2aee89c019d6462d81de255a29eb4a00 Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-VolumesBackupsTest-2038327574-project Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 22473ac8-0732-4434-8c14-6ba430b3bd42 could not be found. Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '22473ac8-0732-4434-8c14-6ba430b3bd42'} Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22473ac8-0732-4434-8c14-6ba430b3bd42 could not be found. Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22473ac8-0732-4434-8c14-6ba430b3bd42 could not be found. Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:39.359540 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:18:39.368327 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:39.368327 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:39.368327 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:39.368327 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:39.368327 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:39.368327 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22473ac8-0732-4434-8c14-6ba430b3bd42 could not be found. Sep 07 13:18:39.368327 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:18:39.372972 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2a66daf6-16fe-4daa-af04-4a5653d2fbba tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] Returning 404 to user: Instance 22473ac8-0732-4434-8c14-6ba430b3bd42 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:39.374563 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2a66daf6-16fe-4daa-af04-4a5653d2fbba tempest-VolumesBackupsTest-2038327574 tempest-VolumesBackupsTest-2038327574-project] 10.222.0.16 "GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42" status: 404 len: 111 microversion: 2.1 time: 0.121999 Sep 07 13:18:39.376461 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2983/6002] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:39 2022] GET /compute/v2.1/servers/22473ac8-0732-4434-8c14-6ba430b3bd42 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:18:39.386389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3a84cb4e-4cd3-42a3-90da-73d328884d06 req-d92e9658-665e-4b27-bb72-1a892495bbc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e7a450-e7a8-442a-96c8-b38f32509632", "name": "network-vif-unplugged", "status": "completed", "tag": "9b68864f-df5e-4625-b836-bcfdd9d0d787"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:39.416602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3a84cb4e-4cd3-42a3-90da-73d328884d06 req-d92e9658-665e-4b27-bb72-1a892495bbc8 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:39.435330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3a84cb4e-4cd3-42a3-90da-73d328884d06 req-d92e9658-665e-4b27-bb72-1a892495bbc8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:39.435330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3a84cb4e-4cd3-42a3-90da-73d328884d06 req-d92e9658-665e-4b27-bb72-1a892495bbc8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:39.443773 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3a84cb4e-4cd3-42a3-90da-73d328884d06 req-d92e9658-665e-4b27-bb72-1a892495bbc8 service nova] Creating event network-vif-unplugged:9b68864f-df5e-4625-b836-bcfdd9d0d787 for instance 16e7a450-e7a8-442a-96c8-b38f32509632 on n-h2-852087-9 Sep 07 13:18:39.454220 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3a84cb4e-4cd3-42a3-90da-73d328884d06 req-d92e9658-665e-4b27-bb72-1a892495bbc8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075123 Sep 07 13:18:39.456116 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2984/6003] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:39.550403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-55272526-4e96-4c9a-8eab-748a1cc6d1ed tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca294234bbd43d785d73085d1d8aee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bbed63f7ec4de8b775001f66900e98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:39.589535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:39.605070 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-55272526-4e96-4c9a-8eab-748a1cc6d1ed tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] 10.222.0.16 "GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632" status: 200 len: 1470 microversion: 2.1 time: 1.195715 Sep 07 13:18:39.624010 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3020/6004] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:38 2022] GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632 => generated 1470 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:18:40.642508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-0769ca42-06cc-4a39-9cd5-276895e588c0 req-6410cd3a-8430-4ea5-a3d8-ca08f328d72a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e7a450-e7a8-442a-96c8-b38f32509632", "name": "network-vif-deleted", "tag": "9b68864f-df5e-4625-b836-bcfdd9d0d787"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:40.657111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1318be2c-6792-4013-9da7-ac7e2fe2cae9 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:40.657111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1318be2c-6792-4013-9da7-ac7e2fe2cae9 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] [instance: 16e7a450-e7a8-442a-96c8-b38f32509632] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:40.671918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:40.679724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1318be2c-6792-4013-9da7-ac7e2fe2cae9 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:40.680597 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1318be2c-6792-4013-9da7-ac7e2fe2cae9 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:40.681392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1318be2c-6792-4013-9da7-ac7e2fe2cae9 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:40.689877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1318be2c-6792-4013-9da7-ac7e2fe2cae9 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:40.692219 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1318be2c-6792-4013-9da7-ac7e2fe2cae9 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:40.693454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1318be2c-6792-4013-9da7-ac7e2fe2cae9 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:40.717681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0769ca42-06cc-4a39-9cd5-276895e588c0 req-6410cd3a-8430-4ea5-a3d8-ca08f328d72a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:40.720636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0769ca42-06cc-4a39-9cd5-276895e588c0 req-6410cd3a-8430-4ea5-a3d8-ca08f328d72a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:40.726331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0769ca42-06cc-4a39-9cd5-276895e588c0 req-6410cd3a-8430-4ea5-a3d8-ca08f328d72a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:40.779230 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-0769ca42-06cc-4a39-9cd5-276895e588c0 req-6410cd3a-8430-4ea5-a3d8-ca08f328d72a service nova] Creating event network-vif-deleted:9b68864f-df5e-4625-b836-bcfdd9d0d787 for instance 16e7a450-e7a8-442a-96c8-b38f32509632 on n-h2-852087-9 Sep 07 13:18:40.814926 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-0769ca42-06cc-4a39-9cd5-276895e588c0 req-6410cd3a-8430-4ea5-a3d8-ca08f328d72a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167119 Sep 07 13:18:40.819227 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2985/6005] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:18:41.094505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1318be2c-6792-4013-9da7-ac7e2fe2cae9 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ca294234bbd43d785d73085d1d8aee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bbed63f7ec4de8b775001f66900e98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:18:41.112866 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1318be2c-6792-4013-9da7-ac7e2fe2cae9 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] 10.222.0.16 "GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632" status: 200 len: 1299 microversion: 2.1 time: 0.463705 Sep 07 13:18:41.129133 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3021/6006] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:40 2022] GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632 => generated 1299 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:18:42.155325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f3320d79-7d5b-4916-af57-7f587cbd9062 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:18:42.156149 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f3320d79-7d5b-4916-af57-7f587cbd9062 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] [instance: 16e7a450-e7a8-442a-96c8-b38f32509632] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:18:42.158340 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:42.174885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3320d79-7d5b-4916-af57-7f587cbd9062 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:42.175735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3320d79-7d5b-4916-af57-7f587cbd9062 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:42.176754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3320d79-7d5b-4916-af57-7f587cbd9062 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:42.182450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3320d79-7d5b-4916-af57-7f587cbd9062 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:18:42.182450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3320d79-7d5b-4916-af57-7f587cbd9062 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:18:42.182450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f3320d79-7d5b-4916-af57-7f587cbd9062 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:18:42.195320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:42.210055 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-f3320d79-7d5b-4916-af57-7f587cbd9062 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] HTTP exception thrown: Instance 16e7a450-e7a8-442a-96c8-b38f32509632 could not be found. Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f3320d79-7d5b-4916-af57-7f587cbd9062 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Request method failure captured: Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632 HTTP/1.1 Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJoQEzZROIlPyI8tm_qno2c_8fSNXdZsjrUiwTyJ96rnXHhllFA2bSXtYE4ltSAS1pPWIfKeWLTueaAyw7iqothHL_l-I5DHhsLRwOZT34TaODGs64YQLyy8TmHf2xTSZHQP21P-WzFVtvRjDfok2iZfAoN7WvlLg-Yq3L13jHDdfuc Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 34bbed63f7ec4de8b775001f66900e98 Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-VolumesNegativeTest-314007122 Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/34bbed63f7ec4de8b775001f66900e98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_34bbed63f7ec4de8b775001f66900e98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/34bbed63f7ec4de8b775001f66900e98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/34bbed63f7ec4de8b775001f66900e98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-VolumesNegativeTest-314007122 Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 34bbed63f7ec4de8b775001f66900e98 Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-VolumesNegativeTest-314007122 Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-VolumesNegativeTest-314007122-project Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 8ca294234bbd43d785d73085d1d8aee5 Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-VolumesNegativeTest-314007122-project Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 16e7a450-e7a8-442a-96c8-b38f32509632 could not be found. Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '16e7a450-e7a8-442a-96c8-b38f32509632'} Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e7a450-e7a8-442a-96c8-b38f32509632 could not be found. Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e7a450-e7a8-442a-96c8-b38f32509632 could not be found. Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:18:42.212211 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:18:42.216639 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:18:42.216639 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:18:42.216639 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:18:42.216639 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:18:42.216639 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:18:42.216639 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e7a450-e7a8-442a-96c8-b38f32509632 could not be found. Sep 07 13:18:42.216639 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:18:42.216639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f3320d79-7d5b-4916-af57-7f587cbd9062 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] Returning 404 to user: Instance 16e7a450-e7a8-442a-96c8-b38f32509632 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:18:42.216639 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f3320d79-7d5b-4916-af57-7f587cbd9062 tempest-VolumesNegativeTest-314007122 tempest-VolumesNegativeTest-314007122-project] 10.222.0.16 "GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632" status: 404 len: 111 microversion: 2.1 time: 0.066929 Sep 07 13:18:42.216639 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2986/6007] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:18:42 2022] GET /compute/v2.1/servers/16e7a450-e7a8-442a-96c8-b38f32509632 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:18:57.361450 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:57.362700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=7 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:57.689600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-564e5323-48c4-4456-8deb-8cdbcb1f3a74 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Action: 'create', calling method: .version_select at 0x7fc41d265160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1948765916", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzE5rgZqMmjPvODwDfx56MHbCVF9Tf8aIuPWNKcRv5+7nvgulYuUfmHnv1wJXiCHfq1A187cLzr5u6M1KvLIyRBDnSSgCK/jOGIRRZzUmkgPlbz3K/qmCOZaHkvBqH39w=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:18:57.722594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-564e5323-48c4-4456-8deb-8cdbcb1f3a74 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Getting quotas for project c7ff80261a1a4ffdaefba7dd7d276c00. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:18:57.734895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-564e5323-48c4-4456-8deb-8cdbcb1f3a74 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Getting quotas for user 663c3f21362d460785702e1858cc6706 and project c7ff80261a1a4ffdaefba7dd7d276c00. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:18:57.788300 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-564e5323-48c4-4456-8deb-8cdbcb1f3a74 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.431930 Sep 07 13:18:57.788986 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3022/6008] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 13:18:57 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:12.512130 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9153675a-4158-4091-b939-4dd37936837d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2116687050", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "f1d41d44-893f-4cc7-8eeb-d42269d22d76"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1948765916", "security_groups": [{"name": "tempest-secgroup-smoke-3001331"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:12.540210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:12.781686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-9153675a-4158-4091-b939-4dd37936837d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] validate_networks() for [('f1d41d44-893f-4cc7-8eeb-d42269d22d76', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:19:14.050800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9153675a-4158-4091-b939-4dd37936837d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:19:14.052555 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9153675a-4158-4091-b939-4dd37936837d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:19:14.053693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9153675a-4158-4091-b939-4dd37936837d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:19:14.054583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9153675a-4158-4091-b939-4dd37936837d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:19:14.055452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9153675a-4158-4091-b939-4dd37936837d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:19:14.072901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9153675a-4158-4091-b939-4dd37936837d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:14.074186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9153675a-4158-4091-b939-4dd37936837d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:14.075523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9153675a-4158-4091-b939-4dd37936837d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:14.076819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9153675a-4158-4091-b939-4dd37936837d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:14.078056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9153675a-4158-4091-b939-4dd37936837d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:14.078962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9153675a-4158-4091-b939-4dd37936837d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:14.110985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-9153675a-4158-4091-b939-4dd37936837d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Getting quotas for project c7ff80261a1a4ffdaefba7dd7d276c00. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:19:14.120978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-9153675a-4158-4091-b939-4dd37936837d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Getting quotas for user 663c3f21362d460785702e1858cc6706 and project c7ff80261a1a4ffdaefba7dd7d276c00. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:19:14.141767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9153675a-4158-4091-b939-4dd37936837d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:19:14.144867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9153675a-4158-4091-b939-4dd37936837d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:19:14.227122 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9153675a-4158-4091-b939-4dd37936837d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.720475 Sep 07 13:19:14.244604 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2987/6009] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:19:12 2022] POST /compute/v2.1/servers => generated 403 bytes in 1738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:19:14.251478 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-216fbbb9-1b70-422a-a685-d7ec2efad227 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:14.252104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-216fbbb9-1b70-422a-a685-d7ec2efad227 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:14.257159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:14.258014 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:14.410191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-216fbbb9-1b70-422a-a685-d7ec2efad227 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:14.429221 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-216fbbb9-1b70-422a-a685-d7ec2efad227 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1267 microversion: 2.1 time: 0.183097 Sep 07 13:19:14.434426 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3023/6010] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:14 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:15.464585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-19e4b5c8-c6ed-48ee-8c60-55a86f49e46f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:15.466160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-19e4b5c8-c6ed-48ee-8c60-55a86f49e46f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:15.581252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-19e4b5c8-c6ed-48ee-8c60-55a86f49e46f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:15.607988 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-19e4b5c8-c6ed-48ee-8c60-55a86f49e46f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1267 microversion: 2.1 time: 0.141684 Sep 07 13:19:15.622912 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2988/6011] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:15 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:16.124609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b3720e54-604e-4bd6-86b6-aeb286d7eb50 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Action: 'create', calling method: .version_select at 0x7fc418954b80>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-741780636", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENYynzay7xXo2qThxjXzdULo+4B9npmxx8f/WNxqW+/kDIF2DTKgo26asrv+F/Ja/Rr4lSJXaz4cfRfLu1kM/tQjZCu2BP5WAMyqPY4d4NHTjf4/xcIZ9CEeYFUQsK3eg=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:16.147229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b3720e54-604e-4bd6-86b6-aeb286d7eb50 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Getting quotas for project 9c211890039647b0b60730560385965e. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:19:16.156757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b3720e54-604e-4bd6-86b6-aeb286d7eb50 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Getting quotas for user e70b0b0213cb4fc897e4b579269b7f29 and project 9c211890039647b0b60730560385965e. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:19:16.195776 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b3720e54-604e-4bd6-86b6-aeb286d7eb50 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.075449 Sep 07 13:19:16.204454 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3024/6012] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 13:19:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:16.682458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2bddae8b-27e9-45d2-94f3-1a69c645d82a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:16.683935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2bddae8b-27e9-45d2-94f3-1a69c645d82a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:16.730492 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bddae8b-27e9-45d2-94f3-1a69c645d82a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:16.735172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bddae8b-27e9-45d2-94f3-1a69c645d82a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:16.736482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bddae8b-27e9-45d2-94f3-1a69c645d82a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:16.740975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bddae8b-27e9-45d2-94f3-1a69c645d82a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:16.747890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bddae8b-27e9-45d2-94f3-1a69c645d82a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:16.752605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bddae8b-27e9-45d2-94f3-1a69c645d82a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:16.995346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2bddae8b-27e9-45d2-94f3-1a69c645d82a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:17.004879 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2bddae8b-27e9-45d2-94f3-1a69c645d82a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1263 microversion: 2.1 time: 0.358511 Sep 07 13:19:17.005511 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2989/6013] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:16 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1263 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:18.041251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d69b533c-09e4-4a3a-8e85-e43a98c5e908 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:18.043414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d69b533c-09e4-4a3a-8e85-e43a98c5e908 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:18.074974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d69b533c-09e4-4a3a-8e85-e43a98c5e908 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:18.076350 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d69b533c-09e4-4a3a-8e85-e43a98c5e908 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:18.079755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d69b533c-09e4-4a3a-8e85-e43a98c5e908 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:18.082726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d69b533c-09e4-4a3a-8e85-e43a98c5e908 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:18.084691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d69b533c-09e4-4a3a-8e85-e43a98c5e908 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:18.085439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d69b533c-09e4-4a3a-8e85-e43a98c5e908 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:18.314317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d69b533c-09e4-4a3a-8e85-e43a98c5e908 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:18.335990 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d69b533c-09e4-4a3a-8e85-e43a98c5e908 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1325 microversion: 2.1 time: 0.306437 Sep 07 13:19:18.339403 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3025/6014] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:18 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1325 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:19.357043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f760dc1b-59fd-4131-8330-ec3d7d055254 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1771792315", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b2e215ea-2db9-40ae-b07b-8fbfe4888cac", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-741780636", "security_groups": [{"name": "tempest-secgroup-smoke-801088928"}], "networks": [{"uuid": "3dfd36e3-7e1c-4cce-9c8e-47e7db0876a9"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:19.383625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3e166de9-cfab-43fd-8e1e-8cd560a885c4 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:19.388838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3e166de9-cfab-43fd-8e1e-8cd560a885c4 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:19.423105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e166de9-cfab-43fd-8e1e-8cd560a885c4 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:19.428444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e166de9-cfab-43fd-8e1e-8cd560a885c4 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:19.429660 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e166de9-cfab-43fd-8e1e-8cd560a885c4 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:19.436206 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e166de9-cfab-43fd-8e1e-8cd560a885c4 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:19.437722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e166de9-cfab-43fd-8e1e-8cd560a885c4 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:19.438520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3e166de9-cfab-43fd-8e1e-8cd560a885c4 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:19.649089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3e166de9-cfab-43fd-8e1e-8cd560a885c4 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:19.695598 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3e166de9-cfab-43fd-8e1e-8cd560a885c4 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1325 microversion: 2.1 time: 0.321752 Sep 07 13:19:19.696925 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3026/6015] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:19 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1325 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:19.785715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-f760dc1b-59fd-4131-8330-ec3d7d055254 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] validate_networks() for [('3dfd36e3-7e1c-4cce-9c8e-47e7db0876a9', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:19:20.740850 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b253eb29-b222-4fc7-bbf6-8bb705d0e351 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:20.741796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b253eb29-b222-4fc7-bbf6-8bb705d0e351 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:20.750488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b253eb29-b222-4fc7-bbf6-8bb705d0e351 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:20.750987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b253eb29-b222-4fc7-bbf6-8bb705d0e351 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:20.751441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b253eb29-b222-4fc7-bbf6-8bb705d0e351 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:20.752204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b253eb29-b222-4fc7-bbf6-8bb705d0e351 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:20.752881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b253eb29-b222-4fc7-bbf6-8bb705d0e351 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:20.753312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b253eb29-b222-4fc7-bbf6-8bb705d0e351 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:21.157386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f760dc1b-59fd-4131-8330-ec3d7d055254 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:19:21.159641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f760dc1b-59fd-4131-8330-ec3d7d055254 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:19:21.160845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f760dc1b-59fd-4131-8330-ec3d7d055254 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:19:21.162037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f760dc1b-59fd-4131-8330-ec3d7d055254 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:19:21.163798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f760dc1b-59fd-4131-8330-ec3d7d055254 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:19:21.186010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f760dc1b-59fd-4131-8330-ec3d7d055254 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:21.186893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f760dc1b-59fd-4131-8330-ec3d7d055254 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:21.188303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f760dc1b-59fd-4131-8330-ec3d7d055254 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:21.189920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f760dc1b-59fd-4131-8330-ec3d7d055254 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:21.190964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f760dc1b-59fd-4131-8330-ec3d7d055254 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:21.191588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f760dc1b-59fd-4131-8330-ec3d7d055254 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:21.227480 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-f760dc1b-59fd-4131-8330-ec3d7d055254 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Getting quotas for project 9c211890039647b0b60730560385965e. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:19:21.255919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b253eb29-b222-4fc7-bbf6-8bb705d0e351 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:21.259612 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-f760dc1b-59fd-4131-8330-ec3d7d055254 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Getting quotas for user e70b0b0213cb4fc897e4b579269b7f29 and project 9c211890039647b0b60730560385965e. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:19:21.265976 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b253eb29-b222-4fc7-bbf6-8bb705d0e351 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1390 microversion: 2.1 time: 0.529420 Sep 07 13:19:21.280378 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3027/6016] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:20 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1390 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:21.361376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f760dc1b-59fd-4131-8330-ec3d7d055254 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:19:21.365231 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f760dc1b-59fd-4131-8330-ec3d7d055254 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b2e215ea-2db9-40ae-b07b-8fbfe4888cac',volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:19:21.691883 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f760dc1b-59fd-4131-8330-ec3d7d055254 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.348650 Sep 07 13:19:21.705138 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2990/6017] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:19:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 2363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:19:21.712794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-84c16aa2-0c23-493f-930a-03989e35d45a tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:21.714149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-84c16aa2-0c23-493f-930a-03989e35d45a tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:22.053292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-84c16aa2-0c23-493f-930a-03989e35d45a tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:22.077303 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-84c16aa2-0c23-493f-930a-03989e35d45a tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1098 microversion: 2.1 time: 0.370459 Sep 07 13:19:22.091038 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3028/6018] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:21 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1098 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:22.128722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-35733f3c-2ef4-4d3e-acd7-6286defc9b5d req-f673b642-ed37-4e18-bd98-fa3e7fc34656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15b5f7d7-8386-4161-8205-04924c4bd6e3", "tag": "8c5f6013-06c8-4a6b-96e3-e4323dd4b99c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:22.159288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-35733f3c-2ef4-4d3e-acd7-6286defc9b5d req-f673b642-ed37-4e18-bd98-fa3e7fc34656 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:22.161421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-35733f3c-2ef4-4d3e-acd7-6286defc9b5d req-f673b642-ed37-4e18-bd98-fa3e7fc34656 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:22.163317 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-35733f3c-2ef4-4d3e-acd7-6286defc9b5d req-f673b642-ed37-4e18-bd98-fa3e7fc34656 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:22.195385 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-35733f3c-2ef4-4d3e-acd7-6286defc9b5d req-f673b642-ed37-4e18-bd98-fa3e7fc34656 service nova] Creating event network-changed:8c5f6013-06c8-4a6b-96e3-e4323dd4b99c for instance 15b5f7d7-8386-4161-8205-04924c4bd6e3 on n-h2-852087-9 Sep 07 13:19:22.207513 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-35733f3c-2ef4-4d3e-acd7-6286defc9b5d req-f673b642-ed37-4e18-bd98-fa3e7fc34656 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098629 Sep 07 13:19:22.209228 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2991/6019] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:22.316351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f8a0d8ec-9b3e-4408-8ff2-08aa4a3e5f1e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:22.325179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f8a0d8ec-9b3e-4408-8ff2-08aa4a3e5f1e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:22.359875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8a0d8ec-9b3e-4408-8ff2-08aa4a3e5f1e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:22.367231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8a0d8ec-9b3e-4408-8ff2-08aa4a3e5f1e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:22.368745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8a0d8ec-9b3e-4408-8ff2-08aa4a3e5f1e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:22.373313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8a0d8ec-9b3e-4408-8ff2-08aa4a3e5f1e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:22.379208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8a0d8ec-9b3e-4408-8ff2-08aa4a3e5f1e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:22.381293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8a0d8ec-9b3e-4408-8ff2-08aa4a3e5f1e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:23.130166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92c5ff4c-e1d7-487a-bc87-65f7f50bc04b tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:23.131056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-92c5ff4c-e1d7-487a-bc87-65f7f50bc04b tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:23.146870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92c5ff4c-e1d7-487a-bc87-65f7f50bc04b tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:23.155562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92c5ff4c-e1d7-487a-bc87-65f7f50bc04b tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:23.156029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92c5ff4c-e1d7-487a-bc87-65f7f50bc04b tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:23.156794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92c5ff4c-e1d7-487a-bc87-65f7f50bc04b tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:23.158672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92c5ff4c-e1d7-487a-bc87-65f7f50bc04b tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:23.161682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92c5ff4c-e1d7-487a-bc87-65f7f50bc04b tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:23.847058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-92c5ff4c-e1d7-487a-bc87-65f7f50bc04b tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:23.855985 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-92c5ff4c-e1d7-487a-bc87-65f7f50bc04b tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1148 microversion: 2.1 time: 0.730837 Sep 07 13:19:23.857207 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2992/6020] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:23 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1148 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:23.873539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f8a0d8ec-9b3e-4408-8ff2-08aa4a3e5f1e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:23.883671 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f8a0d8ec-9b3e-4408-8ff2-08aa4a3e5f1e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1390 microversion: 2.1 time: 1.581041 Sep 07 13:19:23.892029 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3029/6021] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:22 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1390 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:24.889847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-75a28d75-4068-43f5-bf54-148b0b9642d8 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:24.891648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-75a28d75-4068-43f5-bf54-148b0b9642d8 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:24.926011 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75a28d75-4068-43f5-bf54-148b0b9642d8 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:24.934272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75a28d75-4068-43f5-bf54-148b0b9642d8 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:24.937758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75a28d75-4068-43f5-bf54-148b0b9642d8 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:24.939108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0bcefa51-c6e1-40d5-b93a-b3ae2eb03a39 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:24.945393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0bcefa51-c6e1-40d5-b93a-b3ae2eb03a39 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:24.945712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75a28d75-4068-43f5-bf54-148b0b9642d8 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:24.946846 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75a28d75-4068-43f5-bf54-148b0b9642d8 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:24.947811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75a28d75-4068-43f5-bf54-148b0b9642d8 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:24.972235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bcefa51-c6e1-40d5-b93a-b3ae2eb03a39 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:24.974186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bcefa51-c6e1-40d5-b93a-b3ae2eb03a39 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:24.975518 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bcefa51-c6e1-40d5-b93a-b3ae2eb03a39 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:24.978151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bcefa51-c6e1-40d5-b93a-b3ae2eb03a39 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:24.980168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bcefa51-c6e1-40d5-b93a-b3ae2eb03a39 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:24.981325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0bcefa51-c6e1-40d5-b93a-b3ae2eb03a39 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:25.199790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-75a28d75-4068-43f5-bf54-148b0b9642d8 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:25.224832 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-75a28d75-4068-43f5-bf54-148b0b9642d8 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1214 microversion: 2.1 time: 0.343174 Sep 07 13:19:25.257121 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2993/6022] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:24 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1214 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:25.805187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0bcefa51-c6e1-40d5-b93a-b3ae2eb03a39 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:25.820416 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0bcefa51-c6e1-40d5-b93a-b3ae2eb03a39 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1390 microversion: 2.1 time: 0.904329 Sep 07 13:19:25.825857 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3030/6023] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:24 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1390 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:26.285669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-371892b2-5d86-4fe9-aacc-5886f93936ce tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:26.286282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-371892b2-5d86-4fe9-aacc-5886f93936ce tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:26.298030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-371892b2-5d86-4fe9-aacc-5886f93936ce tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:26.298553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-371892b2-5d86-4fe9-aacc-5886f93936ce tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:26.298984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-371892b2-5d86-4fe9-aacc-5886f93936ce tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:26.299722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-371892b2-5d86-4fe9-aacc-5886f93936ce tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:26.300179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-371892b2-5d86-4fe9-aacc-5886f93936ce tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:26.305391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-371892b2-5d86-4fe9-aacc-5886f93936ce tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:26.580647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-371892b2-5d86-4fe9-aacc-5886f93936ce tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:26.619367 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-371892b2-5d86-4fe9-aacc-5886f93936ce tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1281 microversion: 2.1 time: 0.338208 Sep 07 13:19:26.622036 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2994/6024] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:26 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1281 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:26.856706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bee606ac-d867-405e-9b17-4154a1589c2d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:26.858016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bee606ac-d867-405e-9b17-4154a1589c2d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:26.872946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bee606ac-d867-405e-9b17-4154a1589c2d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:26.874579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bee606ac-d867-405e-9b17-4154a1589c2d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:26.875200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bee606ac-d867-405e-9b17-4154a1589c2d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:26.876124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bee606ac-d867-405e-9b17-4154a1589c2d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:26.886368 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bee606ac-d867-405e-9b17-4154a1589c2d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:26.887099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bee606ac-d867-405e-9b17-4154a1589c2d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:27.529674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bee606ac-d867-405e-9b17-4154a1589c2d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:27.543170 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bee606ac-d867-405e-9b17-4154a1589c2d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1390 microversion: 2.1 time: 0.690182 Sep 07 13:19:27.559324 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3031/6025] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:26 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1390 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:27.649081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d9629c2-2b63-4b84-bd32-157a1ce58377 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:27.660044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1d9629c2-2b63-4b84-bd32-157a1ce58377 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:27.687023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d9629c2-2b63-4b84-bd32-157a1ce58377 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:27.690165 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d9629c2-2b63-4b84-bd32-157a1ce58377 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:27.690935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d9629c2-2b63-4b84-bd32-157a1ce58377 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:27.693903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d9629c2-2b63-4b84-bd32-157a1ce58377 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:27.696390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d9629c2-2b63-4b84-bd32-157a1ce58377 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:27.698997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d9629c2-2b63-4b84-bd32-157a1ce58377 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:28.088795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1d9629c2-2b63-4b84-bd32-157a1ce58377 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:28.113711 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1d9629c2-2b63-4b84-bd32-157a1ce58377 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1281 microversion: 2.1 time: 0.468135 Sep 07 13:19:28.114871 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2995/6026] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:27 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1281 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:28.576200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c8d88714-1cc6-4c6a-8ad1-ec924c130124 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:28.578829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c8d88714-1cc6-4c6a-8ad1-ec924c130124 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:28.593448 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8d88714-1cc6-4c6a-8ad1-ec924c130124 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:28.594785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8d88714-1cc6-4c6a-8ad1-ec924c130124 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:28.595822 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8d88714-1cc6-4c6a-8ad1-ec924c130124 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:28.597464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8d88714-1cc6-4c6a-8ad1-ec924c130124 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:28.598987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8d88714-1cc6-4c6a-8ad1-ec924c130124 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:28.600282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c8d88714-1cc6-4c6a-8ad1-ec924c130124 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:28.899961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c8d88714-1cc6-4c6a-8ad1-ec924c130124 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:28.913172 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c8d88714-1cc6-4c6a-8ad1-ec924c130124 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1390 microversion: 2.1 time: 0.344739 Sep 07 13:19:28.927348 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3032/6027] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:28 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1390 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:28.985827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-40fc75dd-92e3-4c3a-bdb4-d4f9a1c96d1e req-ced83f05-132c-49e2-8586-e2b657a8034e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5377b6d0-48a5-4859-ba70-34e2567afb7f", "tag": "61bf8b6f-fe60-40af-98b6-858a66f871f7"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:29.000331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-40fc75dd-92e3-4c3a-bdb4-d4f9a1c96d1e req-ced83f05-132c-49e2-8586-e2b657a8034e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:29.001409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-40fc75dd-92e3-4c3a-bdb4-d4f9a1c96d1e req-ced83f05-132c-49e2-8586-e2b657a8034e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:29.002302 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-40fc75dd-92e3-4c3a-bdb4-d4f9a1c96d1e req-ced83f05-132c-49e2-8586-e2b657a8034e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:29.018799 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-40fc75dd-92e3-4c3a-bdb4-d4f9a1c96d1e req-ced83f05-132c-49e2-8586-e2b657a8034e service nova] Creating event network-changed:61bf8b6f-fe60-40af-98b6-858a66f871f7 for instance 5377b6d0-48a5-4859-ba70-34e2567afb7f on n-h1-852087-9 Sep 07 13:19:29.027247 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-40fc75dd-92e3-4c3a-bdb4-d4f9a1c96d1e req-ced83f05-132c-49e2-8586-e2b657a8034e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198627 Sep 07 13:19:29.028243 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2996/6028] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:19:29.168663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d72e6929-a5b4-4b83-97d7-235b072579d4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:29.169953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d72e6929-a5b4-4b83-97d7-235b072579d4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:29.200015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d72e6929-a5b4-4b83-97d7-235b072579d4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:29.202687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d72e6929-a5b4-4b83-97d7-235b072579d4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:29.204756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d72e6929-a5b4-4b83-97d7-235b072579d4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:29.206060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d72e6929-a5b4-4b83-97d7-235b072579d4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:29.211143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d72e6929-a5b4-4b83-97d7-235b072579d4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:29.212084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d72e6929-a5b4-4b83-97d7-235b072579d4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:29.750144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-fbdcdead-ea6b-488a-83cb-a04004ff25b1 req-146c5da6-3e22-424d-9c32-c3650df83056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b5f7d7-8386-4161-8205-04924c4bd6e3", "name": "network-vif-plugged", "status": "completed", "tag": "8c5f6013-06c8-4a6b-96e3-e4323dd4b99c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:29.781652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fbdcdead-ea6b-488a-83cb-a04004ff25b1 req-146c5da6-3e22-424d-9c32-c3650df83056 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:29.782170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fbdcdead-ea6b-488a-83cb-a04004ff25b1 req-146c5da6-3e22-424d-9c32-c3650df83056 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:29.782696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fbdcdead-ea6b-488a-83cb-a04004ff25b1 req-146c5da6-3e22-424d-9c32-c3650df83056 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:29.807498 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-fbdcdead-ea6b-488a-83cb-a04004ff25b1 req-146c5da6-3e22-424d-9c32-c3650df83056 service nova] Creating event network-vif-plugged:8c5f6013-06c8-4a6b-96e3-e4323dd4b99c for instance 15b5f7d7-8386-4161-8205-04924c4bd6e3 on n-h2-852087-9 Sep 07 13:19:29.838493 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-fbdcdead-ea6b-488a-83cb-a04004ff25b1 req-146c5da6-3e22-424d-9c32-c3650df83056 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093863 Sep 07 13:19:29.839924 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2997/6029] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:19:29.967752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-31472cd5-9ddf-45de-bce1-7d4c5818853c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:29.970263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-31472cd5-9ddf-45de-bce1-7d4c5818853c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:30.007327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31472cd5-9ddf-45de-bce1-7d4c5818853c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:30.008402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31472cd5-9ddf-45de-bce1-7d4c5818853c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:30.008928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31472cd5-9ddf-45de-bce1-7d4c5818853c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:30.012913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31472cd5-9ddf-45de-bce1-7d4c5818853c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:30.013906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31472cd5-9ddf-45de-bce1-7d4c5818853c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:30.014651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31472cd5-9ddf-45de-bce1-7d4c5818853c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:30.225292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d72e6929-a5b4-4b83-97d7-235b072579d4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:30.239185 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d72e6929-a5b4-4b83-97d7-235b072579d4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1281 microversion: 2.1 time: 1.080784 Sep 07 13:19:30.241123 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3033/6030] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:29 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1281 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:30.554375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-31472cd5-9ddf-45de-bce1-7d4c5818853c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:30.568097 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-31472cd5-9ddf-45de-bce1-7d4c5818853c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1390 microversion: 2.1 time: 0.628891 Sep 07 13:19:30.570707 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2998/6031] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:29 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1390 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:31.292331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ea4e4a97-ab1e-44e1-82da-7dc8b1d581ff tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:31.294520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ea4e4a97-ab1e-44e1-82da-7dc8b1d581ff tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:31.306778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea4e4a97-ab1e-44e1-82da-7dc8b1d581ff tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:31.309817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea4e4a97-ab1e-44e1-82da-7dc8b1d581ff tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:31.310789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea4e4a97-ab1e-44e1-82da-7dc8b1d581ff tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:31.312475 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea4e4a97-ab1e-44e1-82da-7dc8b1d581ff tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:31.313171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea4e4a97-ab1e-44e1-82da-7dc8b1d581ff tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:31.314686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ea4e4a97-ab1e-44e1-82da-7dc8b1d581ff tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:31.595575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d41e55d7-ed2c-4676-a080-412e21ff8516 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:31.597108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d41e55d7-ed2c-4676-a080-412e21ff8516 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:31.606115 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:31.607795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=14 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:31.609954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d41e55d7-ed2c-4676-a080-412e21ff8516 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:31.610890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d41e55d7-ed2c-4676-a080-412e21ff8516 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:31.611621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d41e55d7-ed2c-4676-a080-412e21ff8516 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:31.612735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d41e55d7-ed2c-4676-a080-412e21ff8516 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:31.613564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d41e55d7-ed2c-4676-a080-412e21ff8516 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:31.614230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d41e55d7-ed2c-4676-a080-412e21ff8516 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:31.694214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ea4e4a97-ab1e-44e1-82da-7dc8b1d581ff tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:31.717830 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ea4e4a97-ab1e-44e1-82da-7dc8b1d581ff tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1281 microversion: 2.1 time: 0.434546 Sep 07 13:19:31.718893 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3034/6032] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:31 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1281 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:31.946961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d41e55d7-ed2c-4676-a080-412e21ff8516 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:31.979374 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d41e55d7-ed2c-4676-a080-412e21ff8516 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1390 microversion: 2.1 time: 0.387760 Sep 07 13:19:32.003416 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 2999/6033] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:31 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1390 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:32.748954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2e6109d4-b4bc-463c-8638-691bd0f563f8 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:32.756763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2e6109d4-b4bc-463c-8638-691bd0f563f8 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:32.777829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:32.788536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e6109d4-b4bc-463c-8638-691bd0f563f8 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:32.790323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e6109d4-b4bc-463c-8638-691bd0f563f8 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:32.795565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e6109d4-b4bc-463c-8638-691bd0f563f8 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:32.808573 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e6109d4-b4bc-463c-8638-691bd0f563f8 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:32.810190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e6109d4-b4bc-463c-8638-691bd0f563f8 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:32.813046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2e6109d4-b4bc-463c-8638-691bd0f563f8 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:33.032019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-93247e0b-7c89-41b0-808d-89196fd08fa1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:33.033111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-93247e0b-7c89-41b0-808d-89196fd08fa1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:33.060829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93247e0b-7c89-41b0-808d-89196fd08fa1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:33.061763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93247e0b-7c89-41b0-808d-89196fd08fa1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:33.062753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93247e0b-7c89-41b0-808d-89196fd08fa1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:33.088521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93247e0b-7c89-41b0-808d-89196fd08fa1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:33.097219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93247e0b-7c89-41b0-808d-89196fd08fa1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:33.098402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-93247e0b-7c89-41b0-808d-89196fd08fa1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:33.182035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2e6109d4-b4bc-463c-8638-691bd0f563f8 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:33.212441 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2e6109d4-b4bc-463c-8638-691bd0f563f8 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1281 microversion: 2.1 time: 0.469994 Sep 07 13:19:33.217163 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3035/6034] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:32 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1281 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:33.407603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-93247e0b-7c89-41b0-808d-89196fd08fa1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:33.424836 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-93247e0b-7c89-41b0-808d-89196fd08fa1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1561 microversion: 2.1 time: 0.400058 Sep 07 13:19:33.444812 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3000/6035] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:33 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1561 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:33.470986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d8591583-811d-43b7-a3b0-71a153a07836 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:33.472465 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d8591583-811d-43b7-a3b0-71a153a07836 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:33.485601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8591583-811d-43b7-a3b0-71a153a07836 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:33.486947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8591583-811d-43b7-a3b0-71a153a07836 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:33.487687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8591583-811d-43b7-a3b0-71a153a07836 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:33.489078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8591583-811d-43b7-a3b0-71a153a07836 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:33.490437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8591583-811d-43b7-a3b0-71a153a07836 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:33.491237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8591583-811d-43b7-a3b0-71a153a07836 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:33.906922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d8591583-811d-43b7-a3b0-71a153a07836 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:33.919079 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d8591583-811d-43b7-a3b0-71a153a07836 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1561 microversion: 2.1 time: 0.455964 Sep 07 13:19:33.924726 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3036/6036] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:33 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1561 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:34.263828 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8d24d5e5-20c0-4a9e-a7cd-a797221da1fb tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:34.264711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8d24d5e5-20c0-4a9e-a7cd-a797221da1fb tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:34.281198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d24d5e5-20c0-4a9e-a7cd-a797221da1fb tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:34.281742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d24d5e5-20c0-4a9e-a7cd-a797221da1fb tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:34.286185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d24d5e5-20c0-4a9e-a7cd-a797221da1fb tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:34.289230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d24d5e5-20c0-4a9e-a7cd-a797221da1fb tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:34.291344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d24d5e5-20c0-4a9e-a7cd-a797221da1fb tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:34.295521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d24d5e5-20c0-4a9e-a7cd-a797221da1fb tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:34.601147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8d24d5e5-20c0-4a9e-a7cd-a797221da1fb tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:34.621158 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8d24d5e5-20c0-4a9e-a7cd-a797221da1fb tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1281 microversion: 2.1 time: 0.362944 Sep 07 13:19:34.621820 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3001/6037] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:34 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1281 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:35.646423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-30108f27-97cd-4f95-98f7-16176d299f1c tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:35.647860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-30108f27-97cd-4f95-98f7-16176d299f1c tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:35.660342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30108f27-97cd-4f95-98f7-16176d299f1c tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:35.665115 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30108f27-97cd-4f95-98f7-16176d299f1c tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:35.666252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30108f27-97cd-4f95-98f7-16176d299f1c tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:35.667340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30108f27-97cd-4f95-98f7-16176d299f1c tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:35.668275 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30108f27-97cd-4f95-98f7-16176d299f1c tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:35.673186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30108f27-97cd-4f95-98f7-16176d299f1c tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:36.775325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-30108f27-97cd-4f95-98f7-16176d299f1c tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:36.791571 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-30108f27-97cd-4f95-98f7-16176d299f1c tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1281 microversion: 2.1 time: 1.149666 Sep 07 13:19:36.792380 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3037/6038] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:35 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1281 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:37.840081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-99789cb1-a593-4957-ba84-7e731b435cd0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:37.841681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-99789cb1-a593-4957-ba84-7e731b435cd0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:37.858612 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99789cb1-a593-4957-ba84-7e731b435cd0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:37.862474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99789cb1-a593-4957-ba84-7e731b435cd0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:37.863885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99789cb1-a593-4957-ba84-7e731b435cd0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:37.866262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99789cb1-a593-4957-ba84-7e731b435cd0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:37.872669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99789cb1-a593-4957-ba84-7e731b435cd0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:37.873185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99789cb1-a593-4957-ba84-7e731b435cd0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:38.468843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b871b86f-3698-4837-b995-fe555205a310 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:38.469904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b871b86f-3698-4837-b995-fe555205a310 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:38.486945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b871b86f-3698-4837-b995-fe555205a310 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:38.493378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b871b86f-3698-4837-b995-fe555205a310 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:38.494616 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b871b86f-3698-4837-b995-fe555205a310 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:38.494967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b871b86f-3698-4837-b995-fe555205a310 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:38.495858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b871b86f-3698-4837-b995-fe555205a310 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:38.496546 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b871b86f-3698-4837-b995-fe555205a310 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:38.629535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-99789cb1-a593-4957-ba84-7e731b435cd0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:38.650715 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-99789cb1-a593-4957-ba84-7e731b435cd0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1281 microversion: 2.1 time: 0.823658 Sep 07 13:19:38.666885 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3002/6039] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:37 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1281 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:38.676011 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-18c432db-a26f-4d6d-99ca-ca3ed7e72829 req-2ec20874-2722-4162-a1a7-e245bf38b2c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15b5f7d7-8386-4161-8205-04924c4bd6e3", "tag": "8c5f6013-06c8-4a6b-96e3-e4323dd4b99c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:38.764658 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-18c432db-a26f-4d6d-99ca-ca3ed7e72829 req-2ec20874-2722-4162-a1a7-e245bf38b2c9 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:38.775699 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-18c432db-a26f-4d6d-99ca-ca3ed7e72829 req-2ec20874-2722-4162-a1a7-e245bf38b2c9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:38.776698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-18c432db-a26f-4d6d-99ca-ca3ed7e72829 req-2ec20874-2722-4162-a1a7-e245bf38b2c9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:38.831913 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-18c432db-a26f-4d6d-99ca-ca3ed7e72829 req-2ec20874-2722-4162-a1a7-e245bf38b2c9 service nova] Creating event network-changed:8c5f6013-06c8-4a6b-96e3-e4323dd4b99c for instance 15b5f7d7-8386-4161-8205-04924c4bd6e3 on n-h2-852087-9 Sep 07 13:19:38.852700 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-18c432db-a26f-4d6d-99ca-ca3ed7e72829 req-2ec20874-2722-4162-a1a7-e245bf38b2c9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190756 Sep 07 13:19:38.857015 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3003/6040] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:19:39.061418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b871b86f-3698-4837-b995-fe555205a310 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:39.087837 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b871b86f-3698-4837-b995-fe555205a310 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1561 microversion: 2.1 time: 0.622630 Sep 07 13:19:39.089168 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3038/6041] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:38 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1561 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:39.708665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ba12d608-835f-4c73-8685-0605840db47f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:39.713883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ba12d608-835f-4c73-8685-0605840db47f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:39.760188 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba12d608-835f-4c73-8685-0605840db47f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:39.761040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba12d608-835f-4c73-8685-0605840db47f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:39.761875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba12d608-835f-4c73-8685-0605840db47f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:39.765233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba12d608-835f-4c73-8685-0605840db47f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:39.771338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba12d608-835f-4c73-8685-0605840db47f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:39.772859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba12d608-835f-4c73-8685-0605840db47f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:40.406762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ba12d608-835f-4c73-8685-0605840db47f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:40.422618 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ba12d608-835f-4c73-8685-0605840db47f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1269 microversion: 2.1 time: 0.731668 Sep 07 13:19:40.431143 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3004/6042] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:39 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1269 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:41.481331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d54f3953-cba5-4c5c-881a-6b0bf537ab4a tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:41.482035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d54f3953-cba5-4c5c-881a-6b0bf537ab4a tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:41.501863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d54f3953-cba5-4c5c-881a-6b0bf537ab4a tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:41.502498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d54f3953-cba5-4c5c-881a-6b0bf537ab4a tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:41.502967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d54f3953-cba5-4c5c-881a-6b0bf537ab4a tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:41.503755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d54f3953-cba5-4c5c-881a-6b0bf537ab4a tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:41.504231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d54f3953-cba5-4c5c-881a-6b0bf537ab4a tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:41.512101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d54f3953-cba5-4c5c-881a-6b0bf537ab4a tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:41.792454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d54f3953-cba5-4c5c-881a-6b0bf537ab4a tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:41.802747 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d54f3953-cba5-4c5c-881a-6b0bf537ab4a tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1269 microversion: 2.1 time: 0.327577 Sep 07 13:19:41.803980 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3039/6043] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:41 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1269 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:42.851616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dc726e49-967a-486d-9260-f916fdeb48cf tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:42.857650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dc726e49-967a-486d-9260-f916fdeb48cf tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:42.881099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:42.901987 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc726e49-967a-486d-9260-f916fdeb48cf tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:42.903589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc726e49-967a-486d-9260-f916fdeb48cf tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:42.904467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc726e49-967a-486d-9260-f916fdeb48cf tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:42.905715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc726e49-967a-486d-9260-f916fdeb48cf tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:42.906356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc726e49-967a-486d-9260-f916fdeb48cf tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:42.906973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dc726e49-967a-486d-9260-f916fdeb48cf tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:42.911849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=80 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:43.174741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dc726e49-967a-486d-9260-f916fdeb48cf tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:43.194788 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dc726e49-967a-486d-9260-f916fdeb48cf tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1269 microversion: 2.1 time: 0.356114 Sep 07 13:19:43.196952 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3005/6044] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:42 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1269 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:44.220694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-831723cf-91ea-48f6-89ce-42d01dfc289e tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:44.221672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-831723cf-91ea-48f6-89ce-42d01dfc289e tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:44.238304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-831723cf-91ea-48f6-89ce-42d01dfc289e tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:44.238304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-831723cf-91ea-48f6-89ce-42d01dfc289e tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:44.238724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-831723cf-91ea-48f6-89ce-42d01dfc289e tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:44.239823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-831723cf-91ea-48f6-89ce-42d01dfc289e tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:44.239823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-831723cf-91ea-48f6-89ce-42d01dfc289e tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:44.240361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-831723cf-91ea-48f6-89ce-42d01dfc289e tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:44.264824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=87 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:45.072431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-831723cf-91ea-48f6-89ce-42d01dfc289e tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:45.095310 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-831723cf-91ea-48f6-89ce-42d01dfc289e tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1269 microversion: 2.1 time: 0.878054 Sep 07 13:19:45.097356 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3040/6045] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:44 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1269 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:19:46.142911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b4558bdb-8e51-4b9d-9cd8-204233cb5a0f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:46.145476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b4558bdb-8e51-4b9d-9cd8-204233cb5a0f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:46.161541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4558bdb-8e51-4b9d-9cd8-204233cb5a0f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:46.162824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4558bdb-8e51-4b9d-9cd8-204233cb5a0f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:46.163787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4558bdb-8e51-4b9d-9cd8-204233cb5a0f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:46.165622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4558bdb-8e51-4b9d-9cd8-204233cb5a0f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:46.167069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4558bdb-8e51-4b9d-9cd8-204233cb5a0f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:46.168395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4558bdb-8e51-4b9d-9cd8-204233cb5a0f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:46.489369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b4558bdb-8e51-4b9d-9cd8-204233cb5a0f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:46.504369 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b4558bdb-8e51-4b9d-9cd8-204233cb5a0f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1269 microversion: 2.1 time: 0.371659 Sep 07 13:19:46.506031 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3006/6046] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:46 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1269 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:47.550128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-37086fe3-1204-4c2a-ba53-1a30c9cb76c9 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:47.551394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-37086fe3-1204-4c2a-ba53-1a30c9cb76c9 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:47.558996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:47.561682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37086fe3-1204-4c2a-ba53-1a30c9cb76c9 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:47.562572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37086fe3-1204-4c2a-ba53-1a30c9cb76c9 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:47.563192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37086fe3-1204-4c2a-ba53-1a30c9cb76c9 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:47.564115 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37086fe3-1204-4c2a-ba53-1a30c9cb76c9 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:47.564760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37086fe3-1204-4c2a-ba53-1a30c9cb76c9 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:47.565452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37086fe3-1204-4c2a-ba53-1a30c9cb76c9 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:48.114689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-37086fe3-1204-4c2a-ba53-1a30c9cb76c9 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:48.130458 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-37086fe3-1204-4c2a-ba53-1a30c9cb76c9 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1269 microversion: 2.1 time: 0.584165 Sep 07 13:19:48.146114 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3041/6047] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:47 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1269 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:49.165907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d004e3ef-639e-4115-b684-638b4eb4cf42 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:49.175854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d004e3ef-639e-4115-b684-638b4eb4cf42 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:49.195988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d004e3ef-639e-4115-b684-638b4eb4cf42 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:49.200683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d004e3ef-639e-4115-b684-638b4eb4cf42 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:49.203872 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d004e3ef-639e-4115-b684-638b4eb4cf42 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:49.213281 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d004e3ef-639e-4115-b684-638b4eb4cf42 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:49.215575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d004e3ef-639e-4115-b684-638b4eb4cf42 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:49.216749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d004e3ef-639e-4115-b684-638b4eb4cf42 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:49.410767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d004e3ef-639e-4115-b684-638b4eb4cf42 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:49.419857 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d004e3ef-639e-4115-b684-638b4eb4cf42 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1269 microversion: 2.1 time: 0.265114 Sep 07 13:19:49.422117 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3007/6048] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:49 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1269 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:50.446115 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae484345-6ff2-46c0-aeda-f4ec5fc9a7b0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:50.447352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ae484345-6ff2-46c0-aeda-f4ec5fc9a7b0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:50.477728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae484345-6ff2-46c0-aeda-f4ec5fc9a7b0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:50.478538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae484345-6ff2-46c0-aeda-f4ec5fc9a7b0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:50.479146 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae484345-6ff2-46c0-aeda-f4ec5fc9a7b0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:50.480393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae484345-6ff2-46c0-aeda-f4ec5fc9a7b0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:50.481239 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae484345-6ff2-46c0-aeda-f4ec5fc9a7b0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:50.482119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae484345-6ff2-46c0-aeda-f4ec5fc9a7b0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:50.805154 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ae484345-6ff2-46c0-aeda-f4ec5fc9a7b0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:50.818960 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ae484345-6ff2-46c0-aeda-f4ec5fc9a7b0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1269 microversion: 2.1 time: 0.376797 Sep 07 13:19:50.819667 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3042/6049] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:50 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1269 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:51.861114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-97c6b551-b471-486d-a98b-dbc8d6167106 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:51.864627 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-97c6b551-b471-486d-a98b-dbc8d6167106 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:51.879855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97c6b551-b471-486d-a98b-dbc8d6167106 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:51.881247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97c6b551-b471-486d-a98b-dbc8d6167106 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:51.882404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97c6b551-b471-486d-a98b-dbc8d6167106 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:51.884585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97c6b551-b471-486d-a98b-dbc8d6167106 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:51.886081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97c6b551-b471-486d-a98b-dbc8d6167106 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:51.887068 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97c6b551-b471-486d-a98b-dbc8d6167106 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:52.136921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-97c6b551-b471-486d-a98b-dbc8d6167106 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:52.148342 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-97c6b551-b471-486d-a98b-dbc8d6167106 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1269 microversion: 2.1 time: 0.294358 Sep 07 13:19:52.150168 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3008/6050] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:51 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1269 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:53.056489 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c64ac91d-bebb-4a8b-b471-37da0d2cd990 req-5130105c-3496-42d5-a3b0-a5c4ac53bad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5377b6d0-48a5-4859-ba70-34e2567afb7f", "name": "network-vif-plugged", "status": "completed", "tag": "61bf8b6f-fe60-40af-98b6-858a66f871f7"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:53.084654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c64ac91d-bebb-4a8b-b471-37da0d2cd990 req-5130105c-3496-42d5-a3b0-a5c4ac53bad2 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:53.086309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c64ac91d-bebb-4a8b-b471-37da0d2cd990 req-5130105c-3496-42d5-a3b0-a5c4ac53bad2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:53.102114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c64ac91d-bebb-4a8b-b471-37da0d2cd990 req-5130105c-3496-42d5-a3b0-a5c4ac53bad2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:53.156514 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c64ac91d-bebb-4a8b-b471-37da0d2cd990 req-5130105c-3496-42d5-a3b0-a5c4ac53bad2 service nova] Creating event network-vif-plugged:61bf8b6f-fe60-40af-98b6-858a66f871f7 for instance 5377b6d0-48a5-4859-ba70-34e2567afb7f on n-h1-852087-9 Sep 07 13:19:53.171861 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c64ac91d-bebb-4a8b-b471-37da0d2cd990 req-5130105c-3496-42d5-a3b0-a5c4ac53bad2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123174 Sep 07 13:19:53.174066 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3043/6051] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:19:53.202729 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2cb251d9-12c1-4769-8362-73f0e5c1a5d4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:53.209730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2cb251d9-12c1-4769-8362-73f0e5c1a5d4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:53.227555 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cb251d9-12c1-4769-8362-73f0e5c1a5d4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:53.229057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cb251d9-12c1-4769-8362-73f0e5c1a5d4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:53.230346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cb251d9-12c1-4769-8362-73f0e5c1a5d4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:53.231981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cb251d9-12c1-4769-8362-73f0e5c1a5d4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:53.233037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cb251d9-12c1-4769-8362-73f0e5c1a5d4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:53.234314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cb251d9-12c1-4769-8362-73f0e5c1a5d4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:53.802854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2cb251d9-12c1-4769-8362-73f0e5c1a5d4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:53.822250 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2cb251d9-12c1-4769-8362-73f0e5c1a5d4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1269 microversion: 2.1 time: 0.632068 Sep 07 13:19:53.834787 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3009/6052] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:53 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1269 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:54.868524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d42613aa-bb81-4ca6-a467-f174e9e1ae6c tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:54.872585 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d42613aa-bb81-4ca6-a467-f174e9e1ae6c tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:54.905273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d42613aa-bb81-4ca6-a467-f174e9e1ae6c tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:54.906197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d42613aa-bb81-4ca6-a467-f174e9e1ae6c tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:54.907121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d42613aa-bb81-4ca6-a467-f174e9e1ae6c tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:54.908609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d42613aa-bb81-4ca6-a467-f174e9e1ae6c tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:54.909828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d42613aa-bb81-4ca6-a467-f174e9e1ae6c tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:54.910649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d42613aa-bb81-4ca6-a467-f174e9e1ae6c tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:55.147924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d42613aa-bb81-4ca6-a467-f174e9e1ae6c tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:55.161441 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d42613aa-bb81-4ca6-a467-f174e9e1ae6c tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1458 microversion: 2.1 time: 0.301381 Sep 07 13:19:55.162546 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3044/6053] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:54 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1458 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:55.194348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-97ee6741-19f2-43db-8cc2-1c03a18e13d0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:19:55.195423 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-97ee6741-19f2-43db-8cc2-1c03a18e13d0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:55.215229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97ee6741-19f2-43db-8cc2-1c03a18e13d0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:55.216515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97ee6741-19f2-43db-8cc2-1c03a18e13d0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:55.217294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97ee6741-19f2-43db-8cc2-1c03a18e13d0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:55.218630 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97ee6741-19f2-43db-8cc2-1c03a18e13d0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:55.219483 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97ee6741-19f2-43db-8cc2-1c03a18e13d0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:55.220242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97ee6741-19f2-43db-8cc2-1c03a18e13d0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:55.496697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-97ee6741-19f2-43db-8cc2-1c03a18e13d0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:19:55.512219 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-97ee6741-19f2-43db-8cc2-1c03a18e13d0 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1458 microversion: 2.1 time: 0.324425 Sep 07 13:19:55.516905 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3010/6054] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:19:55 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1458 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:19:58.133351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b850abb8-4caa-4307-b7a0-985a596feb23 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:58.143534 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b850abb8-4caa-4307-b7a0-985a596feb23 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:19:58.187629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b850abb8-4caa-4307-b7a0-985a596feb23 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:58.189430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b850abb8-4caa-4307-b7a0-985a596feb23 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:58.190962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b850abb8-4caa-4307-b7a0-985a596feb23 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:58.192641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b850abb8-4caa-4307-b7a0-985a596feb23 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:58.193842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b850abb8-4caa-4307-b7a0-985a596feb23 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:58.194894 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b850abb8-4caa-4307-b7a0-985a596feb23 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:58.383074 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b850abb8-4caa-4307-b7a0-985a596feb23 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "POST /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3/action" status: 200 len: 24573 microversion: 2.1 time: 0.258126 Sep 07 13:19:58.401560 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3045/6055] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:19:58 2022] POST /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3/action => generated 24573 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:19:59.888029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-2e5146bc-dada-4e92-a740-95424f0faf0b req-6b5d045d-3172-4202-8a69-2dd8f4dad145 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5377b6d0-48a5-4859-ba70-34e2567afb7f", "tag": "61bf8b6f-fe60-40af-98b6-858a66f871f7"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:19:59.908894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2e5146bc-dada-4e92-a740-95424f0faf0b req-6b5d045d-3172-4202-8a69-2dd8f4dad145 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:19:59.910194 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2e5146bc-dada-4e92-a740-95424f0faf0b req-6b5d045d-3172-4202-8a69-2dd8f4dad145 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:19:59.911199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2e5146bc-dada-4e92-a740-95424f0faf0b req-6b5d045d-3172-4202-8a69-2dd8f4dad145 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:19:59.940843 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-2e5146bc-dada-4e92-a740-95424f0faf0b req-6b5d045d-3172-4202-8a69-2dd8f4dad145 service nova] Creating event network-changed:61bf8b6f-fe60-40af-98b6-858a66f871f7 for instance 5377b6d0-48a5-4859-ba70-34e2567afb7f on n-h1-852087-9 Sep 07 13:19:59.970002 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-2e5146bc-dada-4e92-a740-95424f0faf0b req-6b5d045d-3172-4202-8a69-2dd8f4dad145 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093582 Sep 07 13:19:59.978001 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3011/6056] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:20:02.546010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-2bfe3687-259b-4ce2-a53d-5728a67faaff req-8cc95148-196a-4a45-8367-3e0a5f5d2ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5377b6d0-48a5-4859-ba70-34e2567afb7f", "tag": "61bf8b6f-fe60-40af-98b6-858a66f871f7"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:02.584643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2bfe3687-259b-4ce2-a53d-5728a67faaff req-8cc95148-196a-4a45-8367-3e0a5f5d2ec7 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:02.585642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2bfe3687-259b-4ce2-a53d-5728a67faaff req-8cc95148-196a-4a45-8367-3e0a5f5d2ec7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:02.586304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2bfe3687-259b-4ce2-a53d-5728a67faaff req-8cc95148-196a-4a45-8367-3e0a5f5d2ec7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:02.605747 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-2bfe3687-259b-4ce2-a53d-5728a67faaff req-8cc95148-196a-4a45-8367-3e0a5f5d2ec7 service nova] Creating event network-changed:61bf8b6f-fe60-40af-98b6-858a66f871f7 for instance 5377b6d0-48a5-4859-ba70-34e2567afb7f on n-h1-852087-9 Sep 07 13:20:02.628999 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-2bfe3687-259b-4ce2-a53d-5728a67faaff req-8cc95148-196a-4a45-8367-3e0a5f5d2ec7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088009 Sep 07 13:20:02.634766 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3046/6057] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:20:04.662332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-2d1b4ed2-251b-4daa-87f0-81b8f8bf5016 req-ca64a526-9561-4edb-8c97-509094f69fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5377b6d0-48a5-4859-ba70-34e2567afb7f", "tag": "61bf8b6f-fe60-40af-98b6-858a66f871f7"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:04.685198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2d1b4ed2-251b-4daa-87f0-81b8f8bf5016 req-ca64a526-9561-4edb-8c97-509094f69fe6 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:04.686255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2d1b4ed2-251b-4daa-87f0-81b8f8bf5016 req-ca64a526-9561-4edb-8c97-509094f69fe6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:04.686863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2d1b4ed2-251b-4daa-87f0-81b8f8bf5016 req-ca64a526-9561-4edb-8c97-509094f69fe6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:04.720785 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-2d1b4ed2-251b-4daa-87f0-81b8f8bf5016 req-ca64a526-9561-4edb-8c97-509094f69fe6 service nova] Creating event network-changed:61bf8b6f-fe60-40af-98b6-858a66f871f7 for instance 5377b6d0-48a5-4859-ba70-34e2567afb7f on n-h1-852087-9 Sep 07 13:20:04.731197 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-2d1b4ed2-251b-4daa-87f0-81b8f8bf5016 req-ca64a526-9561-4edb-8c97-509094f69fe6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076909 Sep 07 13:20:04.734299 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3012/6058] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:20:09.450293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a0bfbe59-78bc-48d8-9cd7-b81eac091f41 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:09.451306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a0bfbe59-78bc-48d8-9cd7-b81eac091f41 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:09.461179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0bfbe59-78bc-48d8-9cd7-b81eac091f41 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:09.466709 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0bfbe59-78bc-48d8-9cd7-b81eac091f41 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:09.469713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0bfbe59-78bc-48d8-9cd7-b81eac091f41 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:09.471793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0bfbe59-78bc-48d8-9cd7-b81eac091f41 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:09.472875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0bfbe59-78bc-48d8-9cd7-b81eac091f41 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:09.474529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0bfbe59-78bc-48d8-9cd7-b81eac091f41 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:10.161643 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a0bfbe59-78bc-48d8-9cd7-b81eac091f41 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1830 microversion: 2.1 time: 0.715854 Sep 07 13:20:10.162443 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3047/6059] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:09 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1830 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:10.205727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2cb8798d-90af-4b45-a28f-4f56fa4d3119 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:10.208210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2cb8798d-90af-4b45-a28f-4f56fa4d3119 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:10.223011 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cb8798d-90af-4b45-a28f-4f56fa4d3119 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:10.223669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cb8798d-90af-4b45-a28f-4f56fa4d3119 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:10.224185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cb8798d-90af-4b45-a28f-4f56fa4d3119 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:10.225722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cb8798d-90af-4b45-a28f-4f56fa4d3119 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:10.226442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cb8798d-90af-4b45-a28f-4f56fa4d3119 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:10.227139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2cb8798d-90af-4b45-a28f-4f56fa4d3119 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:10.469344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2cb8798d-90af-4b45-a28f-4f56fa4d3119 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:10.485063 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2cb8798d-90af-4b45-a28f-4f56fa4d3119 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1679 microversion: 2.1 time: 0.286078 Sep 07 13:20:10.485914 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3013/6060] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:10 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1679 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:10.637718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-783f0eaa-1428-49b6-83c9-6dce184379cc tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:10.641361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-783f0eaa-1428-49b6-83c9-6dce184379cc tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:10.653164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-783f0eaa-1428-49b6-83c9-6dce184379cc tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:10.654164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-783f0eaa-1428-49b6-83c9-6dce184379cc tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:10.654746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-783f0eaa-1428-49b6-83c9-6dce184379cc tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:10.655616 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-783f0eaa-1428-49b6-83c9-6dce184379cc tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:10.656959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-783f0eaa-1428-49b6-83c9-6dce184379cc tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:10.657616 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-783f0eaa-1428-49b6-83c9-6dce184379cc tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:10.737867 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-783f0eaa-1428-49b6-83c9-6dce184379cc tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "POST /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3/action" status: 200 len: 32652 microversion: 2.1 time: 0.108207 Sep 07 13:20:10.739247 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3048/6061] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:20:10 2022] POST /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3/action => generated 32652 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:20:10.888948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3275db89-36fd-4d75-bede-1e69d52ef428 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:10.890541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3275db89-36fd-4d75-bede-1e69d52ef428 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:10.907352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3275db89-36fd-4d75-bede-1e69d52ef428 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:10.908895 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3275db89-36fd-4d75-bede-1e69d52ef428 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:10.910045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3275db89-36fd-4d75-bede-1e69d52ef428 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:10.911417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3275db89-36fd-4d75-bede-1e69d52ef428 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:10.912683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3275db89-36fd-4d75-bede-1e69d52ef428 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:10.919722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3275db89-36fd-4d75-bede-1e69d52ef428 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:11.030981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3275db89-36fd-4d75-bede-1e69d52ef428 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1bdeb375d1dc4ec1aa1d7c746df11939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1375859e0541f290e207f39bbec2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:11.032687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3275db89-36fd-4d75-bede-1e69d52ef428 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] flavor_id is None. Assuming migration. {{(pid=122432) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 07 13:20:11.039199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3275db89-36fd-4d75-bede-1e69d52ef428 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122432) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 13:20:11.435463 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3275db89-36fd-4d75-bede-1e69d52ef428 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3/action" status: 202 len: 0 microversion: 2.1 time: 0.554625 Sep 07 13:20:11.439610 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3014/6062] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:20:10 2022] POST /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3/action => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:20:11.447974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bce34e5b-e25d-455f-9f3a-fb0d4b4202aa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:11.449327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bce34e5b-e25d-455f-9f3a-fb0d4b4202aa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:11.478370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bce34e5b-e25d-455f-9f3a-fb0d4b4202aa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:11.482868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bce34e5b-e25d-455f-9f3a-fb0d4b4202aa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:11.484993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bce34e5b-e25d-455f-9f3a-fb0d4b4202aa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:11.486332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bce34e5b-e25d-455f-9f3a-fb0d4b4202aa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:11.487155 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bce34e5b-e25d-455f-9f3a-fb0d4b4202aa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:11.487878 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bce34e5b-e25d-455f-9f3a-fb0d4b4202aa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:11.754002 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bce34e5b-e25d-455f-9f3a-fb0d4b4202aa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:11.776238 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bce34e5b-e25d-455f-9f3a-fb0d4b4202aa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1688 microversion: 2.1 time: 0.334856 Sep 07 13:20:11.776847 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3049/6063] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:11 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1688 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:12.812759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-de525d66-ac05-4672-895b-335886808ed8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:12.814061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-de525d66-ac05-4672-895b-335886808ed8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:12.828839 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de525d66-ac05-4672-895b-335886808ed8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:12.829925 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de525d66-ac05-4672-895b-335886808ed8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:12.830855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de525d66-ac05-4672-895b-335886808ed8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:12.832238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de525d66-ac05-4672-895b-335886808ed8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:12.833139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de525d66-ac05-4672-895b-335886808ed8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:12.834008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de525d66-ac05-4672-895b-335886808ed8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:13.117192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-de525d66-ac05-4672-895b-335886808ed8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:13.119952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:13.133657 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-de525d66-ac05-4672-895b-335886808ed8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1688 microversion: 2.1 time: 0.332420 Sep 07 13:20:13.135427 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3015/6064] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:12 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1688 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:14.178062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-37c9092c-f7f2-44f6-b940-114e072fabc8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:14.180750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-37c9092c-f7f2-44f6-b940-114e072fabc8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:14.197133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37c9092c-f7f2-44f6-b940-114e072fabc8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:14.198352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37c9092c-f7f2-44f6-b940-114e072fabc8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:14.199702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37c9092c-f7f2-44f6-b940-114e072fabc8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:14.202703 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37c9092c-f7f2-44f6-b940-114e072fabc8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:14.203786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37c9092c-f7f2-44f6-b940-114e072fabc8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:14.204947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-37c9092c-f7f2-44f6-b940-114e072fabc8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:14.633528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-37c9092c-f7f2-44f6-b940-114e072fabc8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:14.639593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=50 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:14.658858 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-37c9092c-f7f2-44f6-b940-114e072fabc8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1688 microversion: 2.1 time: 0.489491 Sep 07 13:20:14.661936 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3050/6065] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:14 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1688 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:15.704903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0565542a-343e-4b2d-8ae2-7748a725d7e8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:15.705956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0565542a-343e-4b2d-8ae2-7748a725d7e8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:15.711994 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=24 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:15.722810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0565542a-343e-4b2d-8ae2-7748a725d7e8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:15.723694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0565542a-343e-4b2d-8ae2-7748a725d7e8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:15.724515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0565542a-343e-4b2d-8ae2-7748a725d7e8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:15.725864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0565542a-343e-4b2d-8ae2-7748a725d7e8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:15.726695 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0565542a-343e-4b2d-8ae2-7748a725d7e8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:15.727488 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0565542a-343e-4b2d-8ae2-7748a725d7e8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:15.979227 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0565542a-343e-4b2d-8ae2-7748a725d7e8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:15.989214 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0565542a-343e-4b2d-8ae2-7748a725d7e8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1693 microversion: 2.1 time: 0.292166 Sep 07 13:20:15.990401 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3016/6066] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:15 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1693 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:17.031193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3b1fdb1c-9d3a-413c-bd3f-ae3690aced38 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:17.032261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3b1fdb1c-9d3a-413c-bd3f-ae3690aced38 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:17.044003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b1fdb1c-9d3a-413c-bd3f-ae3690aced38 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:17.044911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b1fdb1c-9d3a-413c-bd3f-ae3690aced38 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:17.045933 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b1fdb1c-9d3a-413c-bd3f-ae3690aced38 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:17.046820 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b1fdb1c-9d3a-413c-bd3f-ae3690aced38 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:17.047464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b1fdb1c-9d3a-413c-bd3f-ae3690aced38 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:17.047978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b1fdb1c-9d3a-413c-bd3f-ae3690aced38 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:17.257542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3b1fdb1c-9d3a-413c-bd3f-ae3690aced38 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:17.267834 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3b1fdb1c-9d3a-413c-bd3f-ae3690aced38 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1693 microversion: 2.1 time: 0.242052 Sep 07 13:20:17.268457 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3051/6067] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:17 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1693 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:18.297572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ee094bde-7ecf-4193-ac21-9cc7b5b9ed33 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:18.299712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ee094bde-7ecf-4193-ac21-9cc7b5b9ed33 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:18.313711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee094bde-7ecf-4193-ac21-9cc7b5b9ed33 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:18.315347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee094bde-7ecf-4193-ac21-9cc7b5b9ed33 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:18.316539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee094bde-7ecf-4193-ac21-9cc7b5b9ed33 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:18.318132 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee094bde-7ecf-4193-ac21-9cc7b5b9ed33 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:18.319245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee094bde-7ecf-4193-ac21-9cc7b5b9ed33 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:18.320297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee094bde-7ecf-4193-ac21-9cc7b5b9ed33 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:18.528666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ee094bde-7ecf-4193-ac21-9cc7b5b9ed33 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:18.552991 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ee094bde-7ecf-4193-ac21-9cc7b5b9ed33 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1693 microversion: 2.1 time: 0.262753 Sep 07 13:20:18.555870 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3017/6068] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:18 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1693 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:19.593919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a0d90743-a491-415a-b459-4c22532c7a47 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:19.598008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a0d90743-a491-415a-b459-4c22532c7a47 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:19.600708 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=22 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:19.608381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0d90743-a491-415a-b459-4c22532c7a47 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:19.609807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0d90743-a491-415a-b459-4c22532c7a47 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:19.610758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0d90743-a491-415a-b459-4c22532c7a47 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:19.612372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0d90743-a491-415a-b459-4c22532c7a47 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:19.613782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0d90743-a491-415a-b459-4c22532c7a47 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:19.614594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a0d90743-a491-415a-b459-4c22532c7a47 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:19.884674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a0d90743-a491-415a-b459-4c22532c7a47 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:19.899656 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a0d90743-a491-415a-b459-4c22532c7a47 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1693 microversion: 2.1 time: 0.311028 Sep 07 13:20:19.900526 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3052/6069] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:19 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1693 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:20.946654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f032c28f-4b66-4dd5-a7d0-dcc5d113fa3e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:20.947773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f032c28f-4b66-4dd5-a7d0-dcc5d113fa3e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:20.980085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f032c28f-4b66-4dd5-a7d0-dcc5d113fa3e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:20.983651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f032c28f-4b66-4dd5-a7d0-dcc5d113fa3e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:20.986634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f032c28f-4b66-4dd5-a7d0-dcc5d113fa3e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:20.990224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f032c28f-4b66-4dd5-a7d0-dcc5d113fa3e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:20.991055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f032c28f-4b66-4dd5-a7d0-dcc5d113fa3e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:20.991798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f032c28f-4b66-4dd5-a7d0-dcc5d113fa3e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:21.190259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f032c28f-4b66-4dd5-a7d0-dcc5d113fa3e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:21.204058 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f032c28f-4b66-4dd5-a7d0-dcc5d113fa3e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1693 microversion: 2.1 time: 0.270446 Sep 07 13:20:21.205045 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3018/6070] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:20 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1693 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:22.247826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-53c6d808-280b-4536-a21d-c61e12c0cce1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:22.248683 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-53c6d808-280b-4536-a21d-c61e12c0cce1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:22.260877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53c6d808-280b-4536-a21d-c61e12c0cce1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:22.262901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53c6d808-280b-4536-a21d-c61e12c0cce1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:22.262901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53c6d808-280b-4536-a21d-c61e12c0cce1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:22.265340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53c6d808-280b-4536-a21d-c61e12c0cce1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:22.266235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53c6d808-280b-4536-a21d-c61e12c0cce1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:22.266996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53c6d808-280b-4536-a21d-c61e12c0cce1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:22.464807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-53c6d808-280b-4536-a21d-c61e12c0cce1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:22.482370 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-53c6d808-280b-4536-a21d-c61e12c0cce1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1693 microversion: 2.1 time: 0.241791 Sep 07 13:20:22.488460 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3053/6071] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:22 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1693 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:23.514129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-28460691-d1e2-48ac-add1-a1e6aafef393 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:23.515969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-28460691-d1e2-48ac-add1-a1e6aafef393 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:23.527460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28460691-d1e2-48ac-add1-a1e6aafef393 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:23.528506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28460691-d1e2-48ac-add1-a1e6aafef393 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:23.529585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28460691-d1e2-48ac-add1-a1e6aafef393 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:23.531284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28460691-d1e2-48ac-add1-a1e6aafef393 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:23.532293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28460691-d1e2-48ac-add1-a1e6aafef393 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:23.533061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28460691-d1e2-48ac-add1-a1e6aafef393 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:23.824711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-28460691-d1e2-48ac-add1-a1e6aafef393 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:23.852548 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-28460691-d1e2-48ac-add1-a1e6aafef393 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1693 microversion: 2.1 time: 0.343192 Sep 07 13:20:23.856194 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3019/6072] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:23 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1693 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:24.889151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-07488d7c-877a-451b-ac35-28680613ccd1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:24.890584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-07488d7c-877a-451b-ac35-28680613ccd1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:24.899759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07488d7c-877a-451b-ac35-28680613ccd1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:24.900717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07488d7c-877a-451b-ac35-28680613ccd1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:24.901586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07488d7c-877a-451b-ac35-28680613ccd1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:24.914229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07488d7c-877a-451b-ac35-28680613ccd1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:24.915864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07488d7c-877a-451b-ac35-28680613ccd1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:24.916781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07488d7c-877a-451b-ac35-28680613ccd1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:25.153786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-07488d7c-877a-451b-ac35-28680613ccd1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:25.153786 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-07488d7c-877a-451b-ac35-28680613ccd1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1693 microversion: 2.1 time: 0.267034 Sep 07 13:20:25.164125 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3054/6073] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:24 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1693 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:26.184768 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bfd059d1-213d-48a1-b9ba-55121f8e33e3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:26.186299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bfd059d1-213d-48a1-b9ba-55121f8e33e3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:26.199808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfd059d1-213d-48a1-b9ba-55121f8e33e3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:26.200685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfd059d1-213d-48a1-b9ba-55121f8e33e3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:26.201601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfd059d1-213d-48a1-b9ba-55121f8e33e3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:26.202853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfd059d1-213d-48a1-b9ba-55121f8e33e3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:26.203694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfd059d1-213d-48a1-b9ba-55121f8e33e3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:26.204435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bfd059d1-213d-48a1-b9ba-55121f8e33e3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:26.439016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bfd059d1-213d-48a1-b9ba-55121f8e33e3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:26.453792 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bfd059d1-213d-48a1-b9ba-55121f8e33e3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1693 microversion: 2.1 time: 0.276273 Sep 07 13:20:26.469523 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3020/6074] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:26 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1693 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:27.501387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a5c0562d-89fe-4501-bbaa-77bd5bc37651 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:27.502910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a5c0562d-89fe-4501-bbaa-77bd5bc37651 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:27.516383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5c0562d-89fe-4501-bbaa-77bd5bc37651 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:27.517296 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5c0562d-89fe-4501-bbaa-77bd5bc37651 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:27.518383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5c0562d-89fe-4501-bbaa-77bd5bc37651 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:27.519790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5c0562d-89fe-4501-bbaa-77bd5bc37651 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:27.520658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5c0562d-89fe-4501-bbaa-77bd5bc37651 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:27.521539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5c0562d-89fe-4501-bbaa-77bd5bc37651 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:27.744067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a5c0562d-89fe-4501-bbaa-77bd5bc37651 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:27.759606 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a5c0562d-89fe-4501-bbaa-77bd5bc37651 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1693 microversion: 2.1 time: 0.268118 Sep 07 13:20:27.761297 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3055/6075] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:27 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1693 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:28.793964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-10994230-0979-4448-a0fb-a3532b414bf8 req-2d5ede68-9012-4501-8da2-9669cfb39471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b5f7d7-8386-4161-8205-04924c4bd6e3", "name": "network-vif-unplugged", "status": "completed", "tag": "8c5f6013-06c8-4a6b-96e3-e4323dd4b99c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:28.808277 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4fdee6e2-34fa-447a-a1be-3ed34aaadefa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:28.809322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4fdee6e2-34fa-447a-a1be-3ed34aaadefa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:28.839085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fdee6e2-34fa-447a-a1be-3ed34aaadefa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:28.842601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-10994230-0979-4448-a0fb-a3532b414bf8 req-2d5ede68-9012-4501-8da2-9669cfb39471 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:28.843165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fdee6e2-34fa-447a-a1be-3ed34aaadefa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:28.845603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fdee6e2-34fa-447a-a1be-3ed34aaadefa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:28.847355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fdee6e2-34fa-447a-a1be-3ed34aaadefa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:28.847663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-10994230-0979-4448-a0fb-a3532b414bf8 req-2d5ede68-9012-4501-8da2-9669cfb39471 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:28.849271 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-10994230-0979-4448-a0fb-a3532b414bf8 req-2d5ede68-9012-4501-8da2-9669cfb39471 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:28.850514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fdee6e2-34fa-447a-a1be-3ed34aaadefa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:28.858060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fdee6e2-34fa-447a-a1be-3ed34aaadefa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:28.892707 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-10994230-0979-4448-a0fb-a3532b414bf8 req-2d5ede68-9012-4501-8da2-9669cfb39471 service nova] Creating event network-vif-unplugged:8c5f6013-06c8-4a6b-96e3-e4323dd4b99c for instance 15b5f7d7-8386-4161-8205-04924c4bd6e3 on n-h1-852087-9 Sep 07 13:20:28.910636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-10994230-0979-4448-a0fb-a3532b414bf8 req-2d5ede68-9012-4501-8da2-9669cfb39471 service nova] Instance 15b5f7d7-8386-4161-8205-04924c4bd6e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:20:28.934485 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-10994230-0979-4448-a0fb-a3532b414bf8 req-2d5ede68-9012-4501-8da2-9669cfb39471 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145709 Sep 07 13:20:28.936416 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3021/6076] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:20:29.260807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4fdee6e2-34fa-447a-a1be-3ed34aaadefa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:29.279441 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4fdee6e2-34fa-447a-a1be-3ed34aaadefa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1692 microversion: 2.1 time: 0.479227 Sep 07 13:20:29.280494 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3056/6077] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:28 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1692 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:30.322678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-51b33c10-39e0-4289-9d70-6f3411b9bb1e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:30.324439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-51b33c10-39e0-4289-9d70-6f3411b9bb1e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:30.332724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51b33c10-39e0-4289-9d70-6f3411b9bb1e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:30.333794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51b33c10-39e0-4289-9d70-6f3411b9bb1e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:30.334496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51b33c10-39e0-4289-9d70-6f3411b9bb1e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:30.335865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51b33c10-39e0-4289-9d70-6f3411b9bb1e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:30.336797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51b33c10-39e0-4289-9d70-6f3411b9bb1e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:30.337515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51b33c10-39e0-4289-9d70-6f3411b9bb1e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:30.577534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-51b33c10-39e0-4289-9d70-6f3411b9bb1e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:30.594029 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-51b33c10-39e0-4289-9d70-6f3411b9bb1e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1692 microversion: 2.1 time: 0.278708 Sep 07 13:20:30.594656 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3022/6078] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:30 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1692 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:30.990743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-10d7d61a-cad0-4f18-8894-e2b98e9be00a req-ec79bda6-eb1e-416b-a728-ad9be1e6d8ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15b5f7d7-8386-4161-8205-04924c4bd6e3", "tag": "8c5f6013-06c8-4a6b-96e3-e4323dd4b99c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:31.011076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-10d7d61a-cad0-4f18-8894-e2b98e9be00a req-ec79bda6-eb1e-416b-a728-ad9be1e6d8ca service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:31.012323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-10d7d61a-cad0-4f18-8894-e2b98e9be00a req-ec79bda6-eb1e-416b-a728-ad9be1e6d8ca service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:31.013038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-10d7d61a-cad0-4f18-8894-e2b98e9be00a req-ec79bda6-eb1e-416b-a728-ad9be1e6d8ca service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:31.037140 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-10d7d61a-cad0-4f18-8894-e2b98e9be00a req-ec79bda6-eb1e-416b-a728-ad9be1e6d8ca service nova] Creating event network-changed:8c5f6013-06c8-4a6b-96e3-e4323dd4b99c for instance 15b5f7d7-8386-4161-8205-04924c4bd6e3 on n-h1-852087-9 Sep 07 13:20:31.048335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-10d7d61a-cad0-4f18-8894-e2b98e9be00a req-ec79bda6-eb1e-416b-a728-ad9be1e6d8ca service nova] Instance 15b5f7d7-8386-4161-8205-04924c4bd6e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:20:31.069822 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-10d7d61a-cad0-4f18-8894-e2b98e9be00a req-ec79bda6-eb1e-416b-a728-ad9be1e6d8ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086190 Sep 07 13:20:31.071145 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3057/6079] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:20:31.637258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5e0c335d-2806-4894-b002-5e4d4ba2c5a6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:31.638277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5e0c335d-2806-4894-b002-5e4d4ba2c5a6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:31.649621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e0c335d-2806-4894-b002-5e4d4ba2c5a6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:31.650376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e0c335d-2806-4894-b002-5e4d4ba2c5a6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:31.651076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e0c335d-2806-4894-b002-5e4d4ba2c5a6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:31.652181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e0c335d-2806-4894-b002-5e4d4ba2c5a6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:31.652848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e0c335d-2806-4894-b002-5e4d4ba2c5a6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:31.653474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e0c335d-2806-4894-b002-5e4d4ba2c5a6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:31.919085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5e0c335d-2806-4894-b002-5e4d4ba2c5a6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:31.948304 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5e0c335d-2806-4894-b002-5e4d4ba2c5a6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1690 microversion: 2.1 time: 0.318626 Sep 07 13:20:31.949985 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3023/6080] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:31 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1690 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:32.978063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a18d1114-00f2-40ef-ad55-5500b78534ed tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:32.978952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a18d1114-00f2-40ef-ad55-5500b78534ed tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:32.992250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a18d1114-00f2-40ef-ad55-5500b78534ed tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:32.993060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a18d1114-00f2-40ef-ad55-5500b78534ed tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:32.993887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a18d1114-00f2-40ef-ad55-5500b78534ed tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:32.994952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a18d1114-00f2-40ef-ad55-5500b78534ed tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:32.995692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a18d1114-00f2-40ef-ad55-5500b78534ed tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:32.996455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a18d1114-00f2-40ef-ad55-5500b78534ed tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:33.231618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a18d1114-00f2-40ef-ad55-5500b78534ed tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:33.241130 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a18d1114-00f2-40ef-ad55-5500b78534ed tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1690 microversion: 2.1 time: 0.269227 Sep 07 13:20:33.241900 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3058/6081] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:32 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1690 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:34.286962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eae33b53-91c2-470e-94e7-d13c7d714ce3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:34.291003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eae33b53-91c2-470e-94e7-d13c7d714ce3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:34.321965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eae33b53-91c2-470e-94e7-d13c7d714ce3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:34.326290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eae33b53-91c2-470e-94e7-d13c7d714ce3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:34.327447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eae33b53-91c2-470e-94e7-d13c7d714ce3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:34.329437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eae33b53-91c2-470e-94e7-d13c7d714ce3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:34.334835 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eae33b53-91c2-470e-94e7-d13c7d714ce3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:34.336357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eae33b53-91c2-470e-94e7-d13c7d714ce3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:34.730012 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eae33b53-91c2-470e-94e7-d13c7d714ce3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:34.741359 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eae33b53-91c2-470e-94e7-d13c7d714ce3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1687 microversion: 2.1 time: 0.461659 Sep 07 13:20:34.742839 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3024/6082] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:34 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1687 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:34.769445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aa874d45-b22c-45a9-a6b6-6ddc9b754313 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:34.770815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aa874d45-b22c-45a9-a6b6-6ddc9b754313 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:34.779176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa874d45-b22c-45a9-a6b6-6ddc9b754313 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:34.780096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa874d45-b22c-45a9-a6b6-6ddc9b754313 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:34.791860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa874d45-b22c-45a9-a6b6-6ddc9b754313 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:34.794353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa874d45-b22c-45a9-a6b6-6ddc9b754313 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:34.796816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa874d45-b22c-45a9-a6b6-6ddc9b754313 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:34.798155 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aa874d45-b22c-45a9-a6b6-6ddc9b754313 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:34.917388 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aa874d45-b22c-45a9-a6b6-6ddc9b754313 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "POST /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3/action" status: 204 len: 0 microversion: 2.1 time: 0.151558 Sep 07 13:20:34.919155 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3059/6083] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:20:34 2022] POST /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3/action => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:20:34.930047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e77de11-5a69-414e-b4cf-09cccb977c06 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:34.931638 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6e77de11-5a69-414e-b4cf-09cccb977c06 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:34.941382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e77de11-5a69-414e-b4cf-09cccb977c06 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:34.942388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e77de11-5a69-414e-b4cf-09cccb977c06 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:34.943580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e77de11-5a69-414e-b4cf-09cccb977c06 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:34.946902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e77de11-5a69-414e-b4cf-09cccb977c06 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:34.947982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e77de11-5a69-414e-b4cf-09cccb977c06 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:34.950033 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e77de11-5a69-414e-b4cf-09cccb977c06 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:35.948839 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6e77de11-5a69-414e-b4cf-09cccb977c06 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:35.966829 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6e77de11-5a69-414e-b4cf-09cccb977c06 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1687 microversion: 2.1 time: 1.042173 Sep 07 13:20:35.980035 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3025/6084] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:34 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1687 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:37.017749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1b268088-6b0d-4043-8c0e-b4f8bf367fb0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:37.021734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1b268088-6b0d-4043-8c0e-b4f8bf367fb0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:37.041025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b268088-6b0d-4043-8c0e-b4f8bf367fb0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:37.041569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b268088-6b0d-4043-8c0e-b4f8bf367fb0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:37.042023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b268088-6b0d-4043-8c0e-b4f8bf367fb0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:37.042854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b268088-6b0d-4043-8c0e-b4f8bf367fb0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:37.043342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b268088-6b0d-4043-8c0e-b4f8bf367fb0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:37.049581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b268088-6b0d-4043-8c0e-b4f8bf367fb0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:37.613792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1b268088-6b0d-4043-8c0e-b4f8bf367fb0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:37.636410 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1b268088-6b0d-4043-8c0e-b4f8bf367fb0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1687 microversion: 2.1 time: 0.629067 Sep 07 13:20:37.650091 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3060/6085] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:36 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1687 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:37.690756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b9552561-e6d9-46e4-95c4-b90a12906e50 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:37.691351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b9552561-e6d9-46e4-95c4-b90a12906e50 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:37.698885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9552561-e6d9-46e4-95c4-b90a12906e50 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:37.700644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9552561-e6d9-46e4-95c4-b90a12906e50 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:37.701346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9552561-e6d9-46e4-95c4-b90a12906e50 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:37.702310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9552561-e6d9-46e4-95c4-b90a12906e50 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:37.703139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9552561-e6d9-46e4-95c4-b90a12906e50 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:37.703940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9552561-e6d9-46e4-95c4-b90a12906e50 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:37.734291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-d2fa589f-ddca-43f1-aee4-c276adb6f45e req-050b70b7-f553-4f8d-b76a-206bb2f756b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5377b6d0-48a5-4859-ba70-34e2567afb7f", "tag": "61bf8b6f-fe60-40af-98b6-858a66f871f7"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:37.758131 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d2fa589f-ddca-43f1-aee4-c276adb6f45e req-050b70b7-f553-4f8d-b76a-206bb2f756b2 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:37.760156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d2fa589f-ddca-43f1-aee4-c276adb6f45e req-050b70b7-f553-4f8d-b76a-206bb2f756b2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:37.761335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d2fa589f-ddca-43f1-aee4-c276adb6f45e req-050b70b7-f553-4f8d-b76a-206bb2f756b2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:37.765129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b9552561-e6d9-46e4-95c4-b90a12906e50 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:20:37.805643 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-d2fa589f-ddca-43f1-aee4-c276adb6f45e req-050b70b7-f553-4f8d-b76a-206bb2f756b2 service nova] Creating event network-changed:61bf8b6f-fe60-40af-98b6-858a66f871f7 for instance 5377b6d0-48a5-4859-ba70-34e2567afb7f on n-h1-852087-9 Sep 07 13:20:37.819965 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-d2fa589f-ddca-43f1-aee4-c276adb6f45e req-050b70b7-f553-4f8d-b76a-206bb2f756b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090224 Sep 07 13:20:37.821561 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3061/6086] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:20:37.842347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-1ee2d46c-c58f-4b6f-bb93-c4f797e9612f req-333c3eb5-8f21-4814-b869-c51fb8c7b542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b5f7d7-8386-4161-8205-04924c4bd6e3", "name": "network-vif-plugged", "status": "completed", "tag": "8c5f6013-06c8-4a6b-96e3-e4323dd4b99c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:37.891397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1ee2d46c-c58f-4b6f-bb93-c4f797e9612f req-333c3eb5-8f21-4814-b869-c51fb8c7b542 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:37.895286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1ee2d46c-c58f-4b6f-bb93-c4f797e9612f req-333c3eb5-8f21-4814-b869-c51fb8c7b542 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:37.898119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1ee2d46c-c58f-4b6f-bb93-c4f797e9612f req-333c3eb5-8f21-4814-b869-c51fb8c7b542 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:37.939955 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-1ee2d46c-c58f-4b6f-bb93-c4f797e9612f req-333c3eb5-8f21-4814-b869-c51fb8c7b542 service nova] Creating event network-vif-plugged:8c5f6013-06c8-4a6b-96e3-e4323dd4b99c for instance 15b5f7d7-8386-4161-8205-04924c4bd6e3 on n-h1-852087-9 Sep 07 13:20:37.965753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-1ee2d46c-c58f-4b6f-bb93-c4f797e9612f req-333c3eb5-8f21-4814-b869-c51fb8c7b542 service nova] Instance 15b5f7d7-8386-4161-8205-04924c4bd6e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:20:38.006927 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-1ee2d46c-c58f-4b6f-bb93-c4f797e9612f req-333c3eb5-8f21-4814-b869-c51fb8c7b542 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180042 Sep 07 13:20:38.012457 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3062/6087] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:20:38.027472 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b9552561-e6d9-46e4-95c4-b90a12906e50 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 204 len: 0 microversion: 2.1 time: 0.343219 Sep 07 13:20:38.029639 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3026/6088] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:20:37 2022] DELETE /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:20:38.038005 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3dfe5142-28ca-4917-a246-e5f0aefa8882 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:38.038778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3dfe5142-28ca-4917-a246-e5f0aefa8882 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:38.051422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3dfe5142-28ca-4917-a246-e5f0aefa8882 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:38.051937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3dfe5142-28ca-4917-a246-e5f0aefa8882 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:38.052420 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3dfe5142-28ca-4917-a246-e5f0aefa8882 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:38.053184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3dfe5142-28ca-4917-a246-e5f0aefa8882 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:38.053697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3dfe5142-28ca-4917-a246-e5f0aefa8882 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:38.054140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3dfe5142-28ca-4917-a246-e5f0aefa8882 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:38.259840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3dfe5142-28ca-4917-a246-e5f0aefa8882 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:38.271843 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3dfe5142-28ca-4917-a246-e5f0aefa8882 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1583 microversion: 2.1 time: 0.237940 Sep 07 13:20:38.281538 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3063/6089] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:38 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1583 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:38.661870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-365e0a97-e6cc-49ec-b5c2-82de09bda3cb tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:38.663689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-365e0a97-e6cc-49ec-b5c2-82de09bda3cb tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:38.674688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-365e0a97-e6cc-49ec-b5c2-82de09bda3cb tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:38.675929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-365e0a97-e6cc-49ec-b5c2-82de09bda3cb tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:38.677202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-365e0a97-e6cc-49ec-b5c2-82de09bda3cb tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:38.679085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-365e0a97-e6cc-49ec-b5c2-82de09bda3cb tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:38.682302 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-365e0a97-e6cc-49ec-b5c2-82de09bda3cb tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:38.683502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-365e0a97-e6cc-49ec-b5c2-82de09bda3cb tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:38.955171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-365e0a97-e6cc-49ec-b5c2-82de09bda3cb tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:38.965937 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-365e0a97-e6cc-49ec-b5c2-82de09bda3cb tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1687 microversion: 2.1 time: 0.311831 Sep 07 13:20:38.968041 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3027/6090] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:38 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1687 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:39.317565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1a12e7bc-a726-4cd6-9d9a-5262b6f83ab1 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:39.318365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1a12e7bc-a726-4cd6-9d9a-5262b6f83ab1 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:39.339101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a12e7bc-a726-4cd6-9d9a-5262b6f83ab1 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:39.339873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a12e7bc-a726-4cd6-9d9a-5262b6f83ab1 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:39.340478 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a12e7bc-a726-4cd6-9d9a-5262b6f83ab1 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:39.341411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a12e7bc-a726-4cd6-9d9a-5262b6f83ab1 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:39.342061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a12e7bc-a726-4cd6-9d9a-5262b6f83ab1 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:39.342655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a12e7bc-a726-4cd6-9d9a-5262b6f83ab1 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:39.536692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1a12e7bc-a726-4cd6-9d9a-5262b6f83ab1 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:39.545299 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1a12e7bc-a726-4cd6-9d9a-5262b6f83ab1 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1583 microversion: 2.1 time: 0.232546 Sep 07 13:20:39.546407 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3064/6091] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:39 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1583 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:39.994851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-99a53dcd-f980-4b44-9e6d-5aacf464b6b0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:39.997353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-99a53dcd-f980-4b44-9e6d-5aacf464b6b0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:40.016924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99a53dcd-f980-4b44-9e6d-5aacf464b6b0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:40.018156 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99a53dcd-f980-4b44-9e6d-5aacf464b6b0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:40.019255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99a53dcd-f980-4b44-9e6d-5aacf464b6b0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:40.021725 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99a53dcd-f980-4b44-9e6d-5aacf464b6b0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:40.022974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99a53dcd-f980-4b44-9e6d-5aacf464b6b0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:40.024077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-99a53dcd-f980-4b44-9e6d-5aacf464b6b0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:40.307094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-99a53dcd-f980-4b44-9e6d-5aacf464b6b0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:40.328982 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-99a53dcd-f980-4b44-9e6d-5aacf464b6b0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1679 microversion: 2.1 time: 0.341448 Sep 07 13:20:40.330029 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3028/6092] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:39 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1679 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:40.574029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0a40a2f6-900a-4343-891a-cfe806929377 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:40.575496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0a40a2f6-900a-4343-891a-cfe806929377 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:40.583480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a40a2f6-900a-4343-891a-cfe806929377 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:40.584432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a40a2f6-900a-4343-891a-cfe806929377 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:40.585412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a40a2f6-900a-4343-891a-cfe806929377 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:40.586556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a40a2f6-900a-4343-891a-cfe806929377 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:40.587250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a40a2f6-900a-4343-891a-cfe806929377 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:40.587898 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a40a2f6-900a-4343-891a-cfe806929377 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:40.705110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0a40a2f6-900a-4343-891a-cfe806929377 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:40.719287 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0a40a2f6-900a-4343-891a-cfe806929377 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1397 microversion: 2.1 time: 0.149775 Sep 07 13:20:40.733513 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3065/6093] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:40 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1397 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:40.851086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-0133954d-dfe0-4598-8430-39d97cdbc600 req-70e28cd7-49c2-4118-80da-5277267d2157 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5377b6d0-48a5-4859-ba70-34e2567afb7f", "name": "network-vif-deleted", "tag": "61bf8b6f-fe60-40af-98b6-858a66f871f7"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:20:40.869244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0133954d-dfe0-4598-8430-39d97cdbc600 req-70e28cd7-49c2-4118-80da-5277267d2157 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:40.869761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0133954d-dfe0-4598-8430-39d97cdbc600 req-70e28cd7-49c2-4118-80da-5277267d2157 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:40.873134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0133954d-dfe0-4598-8430-39d97cdbc600 req-70e28cd7-49c2-4118-80da-5277267d2157 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:40.888401 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-0133954d-dfe0-4598-8430-39d97cdbc600 req-70e28cd7-49c2-4118-80da-5277267d2157 service nova] Creating event network-vif-deleted:61bf8b6f-fe60-40af-98b6-858a66f871f7 for instance 5377b6d0-48a5-4859-ba70-34e2567afb7f on n-h1-852087-9 Sep 07 13:20:40.895182 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-0133954d-dfe0-4598-8430-39d97cdbc600 req-70e28cd7-49c2-4118-80da-5277267d2157 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048756 Sep 07 13:20:40.896514 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3029/6094] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:20:41.755407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-08e966be-8ec5-4838-bc6a-44358199754f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:41.757865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-08e966be-8ec5-4838-bc6a-44358199754f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:41.769520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08e966be-8ec5-4838-bc6a-44358199754f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:41.771336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08e966be-8ec5-4838-bc6a-44358199754f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:41.773097 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08e966be-8ec5-4838-bc6a-44358199754f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:41.774170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08e966be-8ec5-4838-bc6a-44358199754f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:41.774862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08e966be-8ec5-4838-bc6a-44358199754f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:41.775573 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-08e966be-8ec5-4838-bc6a-44358199754f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:41.881281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-08e966be-8ec5-4838-bc6a-44358199754f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:41.909086 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-08e966be-8ec5-4838-bc6a-44358199754f tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1229 microversion: 2.1 time: 0.161642 Sep 07 13:20:41.909772 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3066/6095] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:41 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1229 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:42.946896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d0bd3957-cffe-4f7b-918b-d91d5a2bbee4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:42.948251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d0bd3957-cffe-4f7b-918b-d91d5a2bbee4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:42.962092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0bd3957-cffe-4f7b-918b-d91d5a2bbee4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:42.962975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0bd3957-cffe-4f7b-918b-d91d5a2bbee4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:42.963771 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0bd3957-cffe-4f7b-918b-d91d5a2bbee4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:42.964790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0bd3957-cffe-4f7b-918b-d91d5a2bbee4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:42.966241 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0bd3957-cffe-4f7b-918b-d91d5a2bbee4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:42.967301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0bd3957-cffe-4f7b-918b-d91d5a2bbee4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:43.062380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d0bd3957-cffe-4f7b-918b-d91d5a2bbee4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:43.071790 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d0bd3957-cffe-4f7b-918b-d91d5a2bbee4 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1229 microversion: 2.1 time: 0.138122 Sep 07 13:20:43.072719 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3030/6096] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:42 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1229 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:44.107045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ed21f893-6ea2-4aa5-819c-b904f3067cd2 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:44.108543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ed21f893-6ea2-4aa5-819c-b904f3067cd2 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:44.124006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed21f893-6ea2-4aa5-819c-b904f3067cd2 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:44.125336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed21f893-6ea2-4aa5-819c-b904f3067cd2 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:44.126267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed21f893-6ea2-4aa5-819c-b904f3067cd2 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:44.127409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed21f893-6ea2-4aa5-819c-b904f3067cd2 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:44.128173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed21f893-6ea2-4aa5-819c-b904f3067cd2 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:44.128706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed21f893-6ea2-4aa5-819c-b904f3067cd2 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:44.176311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:44.266036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ed21f893-6ea2-4aa5-819c-b904f3067cd2 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:44.283687 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ed21f893-6ea2-4aa5-819c-b904f3067cd2 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1229 microversion: 2.1 time: 0.182684 Sep 07 13:20:44.285310 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3067/6097] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:44 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1229 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:45.312900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea80d1a4-41e2-4453-9ff4-948fcb5fdbda tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:45.314744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ea80d1a4-41e2-4453-9ff4-948fcb5fdbda tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:45.328453 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea80d1a4-41e2-4453-9ff4-948fcb5fdbda tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:45.329649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea80d1a4-41e2-4453-9ff4-948fcb5fdbda tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:45.330409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea80d1a4-41e2-4453-9ff4-948fcb5fdbda tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:45.331307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea80d1a4-41e2-4453-9ff4-948fcb5fdbda tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:45.331930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea80d1a4-41e2-4453-9ff4-948fcb5fdbda tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:45.332657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea80d1a4-41e2-4453-9ff4-948fcb5fdbda tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:45.441675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ea80d1a4-41e2-4453-9ff4-948fcb5fdbda tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:45.448461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:45.475496 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ea80d1a4-41e2-4453-9ff4-948fcb5fdbda tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1229 microversion: 2.1 time: 0.171023 Sep 07 13:20:45.477010 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3031/6098] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:45 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1229 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:20:46.504809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-572386c9-0f70-4b1b-b209-5b5e491812da tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:46.505458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-572386c9-0f70-4b1b-b209-5b5e491812da tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:46.512976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-572386c9-0f70-4b1b-b209-5b5e491812da tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:46.513515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-572386c9-0f70-4b1b-b209-5b5e491812da tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:46.513968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-572386c9-0f70-4b1b-b209-5b5e491812da tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:46.514700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-572386c9-0f70-4b1b-b209-5b5e491812da tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:46.515169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-572386c9-0f70-4b1b-b209-5b5e491812da tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:46.515616 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-572386c9-0f70-4b1b-b209-5b5e491812da tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:46.564768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-572386c9-0f70-4b1b-b209-5b5e491812da tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:46.565421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-572386c9-0f70-4b1b-b209-5b5e491812da tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:46.565907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-572386c9-0f70-4b1b-b209-5b5e491812da tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:46.566378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-572386c9-0f70-4b1b-b209-5b5e491812da tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lazy-loading 'fault' on Instance uuid 5377b6d0-48a5-4859-ba70-34e2567afb7f {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:20:46.612659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-572386c9-0f70-4b1b-b209-5b5e491812da tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70b0b0213cb4fc897e4b579269b7f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c211890039647b0b60730560385965e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:20:46.624954 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-572386c9-0f70-4b1b-b209-5b5e491812da tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 200 len: 1234 microversion: 2.1 time: 0.124258 Sep 07 13:20:46.626029 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3068/6099] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:46 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 1234 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:20:47.652016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad8efef8-b743-4a87-acb8-227de2345f7b tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:47.653865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ad8efef8-b743-4a87-acb8-227de2345f7b tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] [instance: 5377b6d0-48a5-4859-ba70-34e2567afb7f] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:20:47.660834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:47.673230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad8efef8-b743-4a87-acb8-227de2345f7b tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:47.674794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad8efef8-b743-4a87-acb8-227de2345f7b tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:47.682409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad8efef8-b743-4a87-acb8-227de2345f7b tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:47.689145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad8efef8-b743-4a87-acb8-227de2345f7b tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:20:47.691220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad8efef8-b743-4a87-acb8-227de2345f7b tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:20:47.694041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ad8efef8-b743-4a87-acb8-227de2345f7b tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:20:47.720258 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-ad8efef8-b743-4a87-acb8-227de2345f7b tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] HTTP exception thrown: Instance 5377b6d0-48a5-4859-ba70-34e2567afb7f could not be found. Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad8efef8-b743-4a87-acb8-227de2345f7b tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Request method failure captured: Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f HTTP/1.1 Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJlUGf88EhqFA2K5kvxemm_fWu9gJ_n4F23_fKB0ZUMYXk4P9HsMINJjPXqRjOdlfJZwlWbavw7w8WmvCA479z0r-y5euLOpYJKRVfZlvDeGaJJ_BtB5vIynfymTtNQjGFGne7XGyB11wzK7xJxICHK7yHrwkOV_JDfF_CZIDzgsd9U Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 9c211890039647b0b60730560385965e Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TestVolumeBackupRestore-1239296907 Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c211890039647b0b60730560385965e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9c211890039647b0b60730560385965e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9c211890039647b0b60730560385965e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c211890039647b0b60730560385965e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TestVolumeBackupRestore-1239296907 Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 9c211890039647b0b60730560385965e Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1239296907 Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TestVolumeBackupRestore-1239296907-project Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: e70b0b0213cb4fc897e4b579269b7f29 Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TestVolumeBackupRestore-1239296907-project Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 5377b6d0-48a5-4859-ba70-34e2567afb7f could not be found. Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '5377b6d0-48a5-4859-ba70-34e2567afb7f'} Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5377b6d0-48a5-4859-ba70-34e2567afb7f could not be found. Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5377b6d0-48a5-4859-ba70-34e2567afb7f could not be found. Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:20:47.722931 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:20:47.729940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:20:47.729940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:20:47.729940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:20:47.729940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:20:47.729940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:20:47.729940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5377b6d0-48a5-4859-ba70-34e2567afb7f could not be found. Sep 07 13:20:47.729940 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:20:47.729940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ad8efef8-b743-4a87-acb8-227de2345f7b tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Returning 404 to user: Instance 5377b6d0-48a5-4859-ba70-34e2567afb7f could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:20:47.729940 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ad8efef8-b743-4a87-acb8-227de2345f7b tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f" status: 404 len: 111 microversion: 2.1 time: 0.077510 Sep 07 13:20:47.729940 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3032/6100] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:20:47 2022] GET /compute/v2.1/servers/5377b6d0-48a5-4859-ba70-34e2567afb7f => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:20:48.011030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bc670eb6-a5e3-47b6-8c5f-8b8f7d8c12c7 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] Calling method '.version_select at 0x7fc41d16c3a0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:20:48.042984 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bc670eb6-a5e3-47b6-8c5f-8b8f7d8c12c7 tempest-TestVolumeBackupRestore-1239296907 tempest-TestVolumeBackupRestore-1239296907-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-741780636" status: 202 len: 0 microversion: 2.1 time: 0.037780 Sep 07 13:20:48.045262 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3069/6101] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Sep 7 13:20:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-741780636 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:21:12.663748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-66c25034-1c68-4587-8cee-65c00c41ae97 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:12.666896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-66c25034-1c68-4587-8cee-65c00c41ae97 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:12.675450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:12.677079 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:12.680045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66c25034-1c68-4587-8cee-65c00c41ae97 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:12.680939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66c25034-1c68-4587-8cee-65c00c41ae97 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:12.681597 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66c25034-1c68-4587-8cee-65c00c41ae97 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:12.682545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66c25034-1c68-4587-8cee-65c00c41ae97 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:12.683178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66c25034-1c68-4587-8cee-65c00c41ae97 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:12.683879 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66c25034-1c68-4587-8cee-65c00c41ae97 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:12.770383 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-66c25034-1c68-4587-8cee-65c00c41ae97 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "POST /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3/action" status: 200 len: 24578 microversion: 2.1 time: 0.110399 Sep 07 13:21:12.778439 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3033/6102] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:21:12 2022] POST /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3/action => generated 24578 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:21:27.155135 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=10 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:27.156826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:27.162776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bb83ebbe-68a2-4d27-870b-c0361504af8d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1222367592", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d70b96cd-5a40-46e5-8ca9-02ad2e52f784", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7f5512e3-cd6c-43c3-ae4c-0cca06e090be"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:27.515498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-bb83ebbe-68a2-4d27-870b-c0361504af8d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] validate_networks() for [('7f5512e3-cd6c-43c3-ae4c-0cca06e090be', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:21:28.489764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-bb83ebbe-68a2-4d27-870b-c0361504af8d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:21:28.490431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-bb83ebbe-68a2-4d27-870b-c0361504af8d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:21:28.491152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-bb83ebbe-68a2-4d27-870b-c0361504af8d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:21:28.491912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-bb83ebbe-68a2-4d27-870b-c0361504af8d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:21:28.492696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-bb83ebbe-68a2-4d27-870b-c0361504af8d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:21:28.514018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb83ebbe-68a2-4d27-870b-c0361504af8d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:28.515525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb83ebbe-68a2-4d27-870b-c0361504af8d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:28.516336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb83ebbe-68a2-4d27-870b-c0361504af8d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:28.518136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb83ebbe-68a2-4d27-870b-c0361504af8d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:28.519084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb83ebbe-68a2-4d27-870b-c0361504af8d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:28.519694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb83ebbe-68a2-4d27-870b-c0361504af8d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:28.556278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-bb83ebbe-68a2-4d27-870b-c0361504af8d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Getting quotas for project b97b8dd299f145888f90fbf60321cd18. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:21:28.566836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-bb83ebbe-68a2-4d27-870b-c0361504af8d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Getting quotas for user 90d330a2d2ad4295873277de2d649182 and project b97b8dd299f145888f90fbf60321cd18. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:21:28.650819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bb83ebbe-68a2-4d27-870b-c0361504af8d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:21:28.653299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bb83ebbe-68a2-4d27-870b-c0361504af8d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d70b96cd-5a40-46e5-8ca9-02ad2e52f784',volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:21:28.857873 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bb83ebbe-68a2-4d27-870b-c0361504af8d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.704944 Sep 07 13:21:28.858552 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3070/6103] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:21:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 13:21:28.871181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-26f55b32-b866-40e5-9040-8a8d3f894fdd tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:28.872102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-26f55b32-b866-40e5-9040-8a8d3f894fdd tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:28.877873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:28.890529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:28.994429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-26f55b32-b866-40e5-9040-8a8d3f894fdd tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:29.003375 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-26f55b32-b866-40e5-9040-8a8d3f894fdd tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1057 microversion: 2.1 time: 0.136744 Sep 07 13:21:29.006595 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3034/6104] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:28 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1057 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:30.059038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b83a91a2-83a3-4e54-b39e-ca145cd8947d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:30.059038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b83a91a2-83a3-4e54-b39e-ca145cd8947d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:30.070022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b83a91a2-83a3-4e54-b39e-ca145cd8947d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:30.070022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b83a91a2-83a3-4e54-b39e-ca145cd8947d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:30.070022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b83a91a2-83a3-4e54-b39e-ca145cd8947d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:30.070022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b83a91a2-83a3-4e54-b39e-ca145cd8947d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:30.070022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b83a91a2-83a3-4e54-b39e-ca145cd8947d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:30.070022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b83a91a2-83a3-4e54-b39e-ca145cd8947d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:30.162406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b83a91a2-83a3-4e54-b39e-ca145cd8947d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:30.174128 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b83a91a2-83a3-4e54-b39e-ca145cd8947d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1099 microversion: 2.1 time: 0.129721 Sep 07 13:21:30.175159 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3071/6105] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:30 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1099 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:31.211780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7b203cbd-55f8-4c18-b6db-0352cf708a8b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:31.213317 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7b203cbd-55f8-4c18-b6db-0352cf708a8b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:31.233913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b203cbd-55f8-4c18-b6db-0352cf708a8b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:31.235122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b203cbd-55f8-4c18-b6db-0352cf708a8b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:31.242463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b203cbd-55f8-4c18-b6db-0352cf708a8b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:31.243469 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b203cbd-55f8-4c18-b6db-0352cf708a8b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:31.244156 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b203cbd-55f8-4c18-b6db-0352cf708a8b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:31.244876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b203cbd-55f8-4c18-b6db-0352cf708a8b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:31.457556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7b203cbd-55f8-4c18-b6db-0352cf708a8b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:31.510980 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7b203cbd-55f8-4c18-b6db-0352cf708a8b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1173 microversion: 2.1 time: 0.301018 Sep 07 13:21:31.517282 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3035/6106] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:31 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1173 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:21:32.546007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-79b4ccaa-f27c-4b94-86f4-e308fa0ab31c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:32.546830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-79b4ccaa-f27c-4b94-86f4-e308fa0ab31c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:32.556405 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79b4ccaa-f27c-4b94-86f4-e308fa0ab31c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:32.557025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79b4ccaa-f27c-4b94-86f4-e308fa0ab31c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:32.557602 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79b4ccaa-f27c-4b94-86f4-e308fa0ab31c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:32.558434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79b4ccaa-f27c-4b94-86f4-e308fa0ab31c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:32.559318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79b4ccaa-f27c-4b94-86f4-e308fa0ab31c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:32.560229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79b4ccaa-f27c-4b94-86f4-e308fa0ab31c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:33.106149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-79b4ccaa-f27c-4b94-86f4-e308fa0ab31c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:33.116205 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-79b4ccaa-f27c-4b94-86f4-e308fa0ab31c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1215 microversion: 2.1 time: 0.575286 Sep 07 13:21:33.117280 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3072/6107] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:32 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1215 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:21:33.777640 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:21:33.778589 n-d-852087-9 devstack@n-api.service[122432]: Wed Sep 7 13:21:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Sep 07 13:21:33.964991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-2132ba94-711d-44f4-9e84-86eb0731da79 req-77d9f06b-bebf-4e58-9f6b-eb686ce69a70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b8b496d-a984-462f-9b79-b69f13912d73", "tag": "408d9a77-0d32-47e6-a785-e6416af9890e"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:33.989915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2132ba94-711d-44f4-9e84-86eb0731da79 req-77d9f06b-bebf-4e58-9f6b-eb686ce69a70 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:33.990866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2132ba94-711d-44f4-9e84-86eb0731da79 req-77d9f06b-bebf-4e58-9f6b-eb686ce69a70 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:33.991554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2132ba94-711d-44f4-9e84-86eb0731da79 req-77d9f06b-bebf-4e58-9f6b-eb686ce69a70 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:34.010888 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-2132ba94-711d-44f4-9e84-86eb0731da79 req-77d9f06b-bebf-4e58-9f6b-eb686ce69a70 service nova] Creating event network-changed:408d9a77-0d32-47e6-a785-e6416af9890e for instance 4b8b496d-a984-462f-9b79-b69f13912d73 on n-h2-852087-9 Sep 07 13:21:34.020835 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-2132ba94-711d-44f4-9e84-86eb0731da79 req-77d9f06b-bebf-4e58-9f6b-eb686ce69a70 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.251683 Sep 07 13:21:34.022620 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3036/6108] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:21:34.140110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f0605ee0-82a6-4972-99eb-86a05cda17de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:34.140740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f0605ee0-82a6-4972-99eb-86a05cda17de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:34.165932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0605ee0-82a6-4972-99eb-86a05cda17de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:34.166710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0605ee0-82a6-4972-99eb-86a05cda17de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:34.168297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0605ee0-82a6-4972-99eb-86a05cda17de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:34.169406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0605ee0-82a6-4972-99eb-86a05cda17de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:34.170098 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0605ee0-82a6-4972-99eb-86a05cda17de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:34.170709 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0605ee0-82a6-4972-99eb-86a05cda17de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:34.482287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f0605ee0-82a6-4972-99eb-86a05cda17de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:34.492783 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f0605ee0-82a6-4972-99eb-86a05cda17de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1215 microversion: 2.1 time: 0.356814 Sep 07 13:21:34.499679 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3073/6109] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:34 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1215 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:35.520840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-674c5a09-ff1e-40b0-afa2-df0f57299418 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:35.521836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-674c5a09-ff1e-40b0-afa2-df0f57299418 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:35.531445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-674c5a09-ff1e-40b0-afa2-df0f57299418 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:35.532501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-674c5a09-ff1e-40b0-afa2-df0f57299418 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:35.533324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-674c5a09-ff1e-40b0-afa2-df0f57299418 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:35.542971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8f3ba8e2-10c6-49ab-a14a-6484581eebf2 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:35.544743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8f3ba8e2-10c6-49ab-a14a-6484581eebf2 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:35.549353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-674c5a09-ff1e-40b0-afa2-df0f57299418 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:35.551627 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-674c5a09-ff1e-40b0-afa2-df0f57299418 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:35.552510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-674c5a09-ff1e-40b0-afa2-df0f57299418 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:35.560699 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f3ba8e2-10c6-49ab-a14a-6484581eebf2 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:35.561527 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f3ba8e2-10c6-49ab-a14a-6484581eebf2 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:35.562279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f3ba8e2-10c6-49ab-a14a-6484581eebf2 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:35.563180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f3ba8e2-10c6-49ab-a14a-6484581eebf2 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:35.564628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f3ba8e2-10c6-49ab-a14a-6484581eebf2 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:35.565258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f3ba8e2-10c6-49ab-a14a-6484581eebf2 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:35.869042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-674c5a09-ff1e-40b0-afa2-df0f57299418 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:35.878521 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-674c5a09-ff1e-40b0-afa2-df0f57299418 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1215 microversion: 2.1 time: 0.363192 Sep 07 13:21:35.894081 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3037/6110] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:35 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1215 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:21:35.938746 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8f3ba8e2-10c6-49ab-a14a-6484581eebf2 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1830 microversion: 2.1 time: 0.400153 Sep 07 13:21:35.939356 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3074/6111] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:35 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1830 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:21:36.908294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ca717258-e12a-409c-a29a-dad64864e8af tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:36.909469 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ca717258-e12a-409c-a29a-dad64864e8af tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:36.936182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca717258-e12a-409c-a29a-dad64864e8af tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:36.937120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca717258-e12a-409c-a29a-dad64864e8af tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:36.937981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca717258-e12a-409c-a29a-dad64864e8af tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:36.939288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca717258-e12a-409c-a29a-dad64864e8af tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:36.940139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca717258-e12a-409c-a29a-dad64864e8af tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:36.940928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca717258-e12a-409c-a29a-dad64864e8af tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:37.392034 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ca717258-e12a-409c-a29a-dad64864e8af tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:37.401301 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ca717258-e12a-409c-a29a-dad64864e8af tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1215 microversion: 2.1 time: 0.500736 Sep 07 13:21:37.411146 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3038/6112] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:36 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1215 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:37.794698 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b829b3d1-efe6-464d-9f2d-a60386b68b14 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:37.795295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b829b3d1-efe6-464d-9f2d-a60386b68b14 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:37.805334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-cd7556d4-b439-4fb6-928c-bf4972bc7c91 req-7459d2dc-e9b2-4bf4-a16f-07e56c91d502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15b5f7d7-8386-4161-8205-04924c4bd6e3", "tag": "8c5f6013-06c8-4a6b-96e3-e4323dd4b99c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:37.815553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cd7556d4-b439-4fb6-928c-bf4972bc7c91 req-7459d2dc-e9b2-4bf4-a16f-07e56c91d502 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:37.816357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cd7556d4-b439-4fb6-928c-bf4972bc7c91 req-7459d2dc-e9b2-4bf4-a16f-07e56c91d502 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:37.817017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cd7556d4-b439-4fb6-928c-bf4972bc7c91 req-7459d2dc-e9b2-4bf4-a16f-07e56c91d502 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:37.826171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b829b3d1-efe6-464d-9f2d-a60386b68b14 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:37.827286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b829b3d1-efe6-464d-9f2d-a60386b68b14 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:37.828164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b829b3d1-efe6-464d-9f2d-a60386b68b14 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:37.829852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b829b3d1-efe6-464d-9f2d-a60386b68b14 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:37.831110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b829b3d1-efe6-464d-9f2d-a60386b68b14 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:37.832137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b829b3d1-efe6-464d-9f2d-a60386b68b14 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:37.837724 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-cd7556d4-b439-4fb6-928c-bf4972bc7c91 req-7459d2dc-e9b2-4bf4-a16f-07e56c91d502 service nova] Creating event network-changed:8c5f6013-06c8-4a6b-96e3-e4323dd4b99c for instance 15b5f7d7-8386-4161-8205-04924c4bd6e3 on n-h1-852087-9 Sep 07 13:21:37.843815 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-cd7556d4-b439-4fb6-928c-bf4972bc7c91 req-7459d2dc-e9b2-4bf4-a16f-07e56c91d502 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042229 Sep 07 13:21:37.845238 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3039/6113] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:21:37.883528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b829b3d1-efe6-464d-9f2d-a60386b68b14 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:21:38.130755 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b829b3d1-efe6-464d-9f2d-a60386b68b14 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "DELETE /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 204 len: 0 microversion: 2.1 time: 0.339820 Sep 07 13:21:38.132022 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3075/6114] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:21:37 2022] DELETE /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:21:38.144614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c7f9583c-d5bb-4a4b-baf8-5fbdebe3f667 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:38.146171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c7f9583c-d5bb-4a4b-baf8-5fbdebe3f667 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:38.160698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7f9583c-d5bb-4a4b-baf8-5fbdebe3f667 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:38.165082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7f9583c-d5bb-4a4b-baf8-5fbdebe3f667 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:38.165948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7f9583c-d5bb-4a4b-baf8-5fbdebe3f667 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:38.168411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7f9583c-d5bb-4a4b-baf8-5fbdebe3f667 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:38.171603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7f9583c-d5bb-4a4b-baf8-5fbdebe3f667 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:38.172475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7f9583c-d5bb-4a4b-baf8-5fbdebe3f667 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:38.438280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0ca5cd88-c574-4320-bfb7-3b0106242fa9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:38.442770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0ca5cd88-c574-4320-bfb7-3b0106242fa9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:38.452540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ca5cd88-c574-4320-bfb7-3b0106242fa9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:38.453429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ca5cd88-c574-4320-bfb7-3b0106242fa9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:38.454004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ca5cd88-c574-4320-bfb7-3b0106242fa9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:38.454861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ca5cd88-c574-4320-bfb7-3b0106242fa9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:38.455421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ca5cd88-c574-4320-bfb7-3b0106242fa9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:38.455935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0ca5cd88-c574-4320-bfb7-3b0106242fa9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:38.498512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c7f9583c-d5bb-4a4b-baf8-5fbdebe3f667 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:38.522498 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c7f9583c-d5bb-4a4b-baf8-5fbdebe3f667 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1685 microversion: 2.1 time: 0.378372 Sep 07 13:21:38.535371 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3040/6115] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:38 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1685 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:38.535629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:38.575464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:38.737419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0ca5cd88-c574-4320-bfb7-3b0106242fa9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:38.766559 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0ca5cd88-c574-4320-bfb7-3b0106242fa9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1215 microversion: 2.1 time: 0.341275 Sep 07 13:21:38.767163 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3076/6116] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:38 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1215 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:39.569349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4da771b6-5c25-445f-9b14-bb62195ce713 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:39.570329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4da771b6-5c25-445f-9b14-bb62195ce713 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:39.573862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:39.579251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4da771b6-5c25-445f-9b14-bb62195ce713 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:39.580201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4da771b6-5c25-445f-9b14-bb62195ce713 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:39.580659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4da771b6-5c25-445f-9b14-bb62195ce713 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:39.581414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4da771b6-5c25-445f-9b14-bb62195ce713 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:39.581951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4da771b6-5c25-445f-9b14-bb62195ce713 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:39.582459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4da771b6-5c25-445f-9b14-bb62195ce713 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:39.798097 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9c18cc6c-b635-46d4-9886-5bc51a8808f7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:39.799500 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9c18cc6c-b635-46d4-9886-5bc51a8808f7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:39.825129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c18cc6c-b635-46d4-9886-5bc51a8808f7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:39.825692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c18cc6c-b635-46d4-9886-5bc51a8808f7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:39.826120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c18cc6c-b635-46d4-9886-5bc51a8808f7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:39.829063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c18cc6c-b635-46d4-9886-5bc51a8808f7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:39.829581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c18cc6c-b635-46d4-9886-5bc51a8808f7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:39.830028 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c18cc6c-b635-46d4-9886-5bc51a8808f7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:39.887961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4da771b6-5c25-445f-9b14-bb62195ce713 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:39.927058 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4da771b6-5c25-445f-9b14-bb62195ce713 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1685 microversion: 2.1 time: 0.362452 Sep 07 13:21:39.928728 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3041/6117] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:39 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1685 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:40.193518 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9c18cc6c-b635-46d4-9886-5bc51a8808f7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:40.202640 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9c18cc6c-b635-46d4-9886-5bc51a8808f7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1203 microversion: 2.1 time: 0.412823 Sep 07 13:21:40.224425 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3077/6118] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:39 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1203 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:40.975582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9b0b3073-9df7-493d-8a8f-f9d81df98c29 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:40.978013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9b0b3073-9df7-493d-8a8f-f9d81df98c29 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:40.981523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-fb7d4809-1139-4c51-9a25-605da66228fc req-edff3ef9-ece8-488c-8d55-6499ed071fcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b5f7d7-8386-4161-8205-04924c4bd6e3", "name": "network-vif-deleted", "tag": "8c5f6013-06c8-4a6b-96e3-e4323dd4b99c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:41.004779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b0b3073-9df7-493d-8a8f-f9d81df98c29 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:41.005925 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b0b3073-9df7-493d-8a8f-f9d81df98c29 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:41.008504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b0b3073-9df7-493d-8a8f-f9d81df98c29 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:41.009883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b0b3073-9df7-493d-8a8f-f9d81df98c29 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:41.011161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b0b3073-9df7-493d-8a8f-f9d81df98c29 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:41.012204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9b0b3073-9df7-493d-8a8f-f9d81df98c29 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:41.032384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fb7d4809-1139-4c51-9a25-605da66228fc req-edff3ef9-ece8-488c-8d55-6499ed071fcd service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:41.033021 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fb7d4809-1139-4c51-9a25-605da66228fc req-edff3ef9-ece8-488c-8d55-6499ed071fcd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:41.034105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-fb7d4809-1139-4c51-9a25-605da66228fc req-edff3ef9-ece8-488c-8d55-6499ed071fcd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:41.086914 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-fb7d4809-1139-4c51-9a25-605da66228fc req-edff3ef9-ece8-488c-8d55-6499ed071fcd service nova] Creating event network-vif-deleted:8c5f6013-06c8-4a6b-96e3-e4323dd4b99c for instance 15b5f7d7-8386-4161-8205-04924c4bd6e3 on n-h1-852087-9 Sep 07 13:21:41.120412 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-fb7d4809-1139-4c51-9a25-605da66228fc req-edff3ef9-ece8-488c-8d55-6499ed071fcd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159265 Sep 07 13:21:41.121847 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3078/6119] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:21:41.238353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1116f372-7211-4df7-b009-47ee277e966d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:41.241167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1116f372-7211-4df7-b009-47ee277e966d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:41.253907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1116f372-7211-4df7-b009-47ee277e966d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:41.254624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1116f372-7211-4df7-b009-47ee277e966d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:41.255299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9b0b3073-9df7-493d-8a8f-f9d81df98c29 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:41.255448 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1116f372-7211-4df7-b009-47ee277e966d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:41.256346 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1116f372-7211-4df7-b009-47ee277e966d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:41.257854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1116f372-7211-4df7-b009-47ee277e966d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:41.258425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1116f372-7211-4df7-b009-47ee277e966d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:41.277896 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9b0b3073-9df7-493d-8a8f-f9d81df98c29 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 200 len: 1352 microversion: 2.1 time: 0.328583 Sep 07 13:21:41.278825 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3042/6120] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:40 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 1352 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:41.556944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1116f372-7211-4df7-b009-47ee277e966d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:41.567359 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1116f372-7211-4df7-b009-47ee277e966d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1203 microversion: 2.1 time: 0.339353 Sep 07 13:21:41.568829 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3079/6121] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:41 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1203 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:42.309384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5c3c3cec-1183-40e5-a400-d9757a202f57 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:42.310509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5c3c3cec-1183-40e5-a400-d9757a202f57 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 15b5f7d7-8386-4161-8205-04924c4bd6e3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:42.329070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c3c3cec-1183-40e5-a400-d9757a202f57 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:42.330354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c3c3cec-1183-40e5-a400-d9757a202f57 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:42.331386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c3c3cec-1183-40e5-a400-d9757a202f57 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:42.332627 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c3c3cec-1183-40e5-a400-d9757a202f57 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:42.333569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c3c3cec-1183-40e5-a400-d9757a202f57 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:42.334337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c3c3cec-1183-40e5-a400-d9757a202f57 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:42.360849 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-5c3c3cec-1183-40e5-a400-d9757a202f57 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] HTTP exception thrown: Instance 15b5f7d7-8386-4161-8205-04924c4bd6e3 could not be found. Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5c3c3cec-1183-40e5-a400-d9757a202f57 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Request method failure captured: Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 HTTP/1.1 Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJo_65BByUQjqxLLydngyGcQD0VqesltPK2phoKKnh2_w98MobCIT0V6J-xkzZOSe_MpyS8-hI1LHe2rGNpuHeqYkh62s-1hz08u5D4pKaIFeOnNl2E_uiZLXNKjMthRgm88PlbJ3GaVc7Wl0PE0eUQjIGoaS5gULI9m3p_XsfeTPw0 Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: c7ff80261a1a4ffdaefba7dd7d276c00 Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1063465928 Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7ff80261a1a4ffdaefba7dd7d276c00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c7ff80261a1a4ffdaefba7dd7d276c00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c7ff80261a1a4ffdaefba7dd7d276c00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7ff80261a1a4ffdaefba7dd7d276c00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1063465928 Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: c7ff80261a1a4ffdaefba7dd7d276c00 Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1063465928 Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TestNetworkAdvancedServerOps-1063465928-project Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 663c3f21362d460785702e1858cc6706 Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1063465928-project Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 15b5f7d7-8386-4161-8205-04924c4bd6e3 could not be found. Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '15b5f7d7-8386-4161-8205-04924c4bd6e3'} Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15b5f7d7-8386-4161-8205-04924c4bd6e3 could not be found. Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15b5f7d7-8386-4161-8205-04924c4bd6e3 could not be found. Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:21:42.364916 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:21:42.377304 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:21:42.377304 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:21:42.377304 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:21:42.377304 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:21:42.377304 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:21:42.377304 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:21:42.377304 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15b5f7d7-8386-4161-8205-04924c4bd6e3 could not be found. Sep 07 13:21:42.377304 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:21:42.377304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5c3c3cec-1183-40e5-a400-d9757a202f57 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Returning 404 to user: Instance 15b5f7d7-8386-4161-8205-04924c4bd6e3 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:21:42.377304 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5c3c3cec-1183-40e5-a400-d9757a202f57 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3" status: 404 len: 111 microversion: 2.1 time: 0.065617 Sep 07 13:21:42.377304 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3043/6122] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:42 2022] GET /compute/v2.1/servers/15b5f7d7-8386-4161-8205-04924c4bd6e3 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:21:42.596623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1bce1d69-3ccb-47c8-95c9-784c8cefbb92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:42.598311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1bce1d69-3ccb-47c8-95c9-784c8cefbb92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:42.607145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bce1d69-3ccb-47c8-95c9-784c8cefbb92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:42.607880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bce1d69-3ccb-47c8-95c9-784c8cefbb92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:42.608497 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bce1d69-3ccb-47c8-95c9-784c8cefbb92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:42.609535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bce1d69-3ccb-47c8-95c9-784c8cefbb92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:42.610204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bce1d69-3ccb-47c8-95c9-784c8cefbb92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:42.610812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1bce1d69-3ccb-47c8-95c9-784c8cefbb92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:42.974846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1bce1d69-3ccb-47c8-95c9-784c8cefbb92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:42.988293 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1bce1d69-3ccb-47c8-95c9-784c8cefbb92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1203 microversion: 2.1 time: 0.395233 Sep 07 13:21:42.990076 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3080/6123] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:42 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1203 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:44.012827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-59fb316c-4710-488a-ad32-2a1c131d182f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:44.013688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-59fb316c-4710-488a-ad32-2a1c131d182f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:44.020872 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59fb316c-4710-488a-ad32-2a1c131d182f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:44.021784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59fb316c-4710-488a-ad32-2a1c131d182f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:44.022407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59fb316c-4710-488a-ad32-2a1c131d182f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:44.023150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59fb316c-4710-488a-ad32-2a1c131d182f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:44.023615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59fb316c-4710-488a-ad32-2a1c131d182f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:44.024041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59fb316c-4710-488a-ad32-2a1c131d182f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:44.430411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-59fb316c-4710-488a-ad32-2a1c131d182f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:44.449938 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-59fb316c-4710-488a-ad32-2a1c131d182f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1203 microversion: 2.1 time: 0.438294 Sep 07 13:21:44.450958 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3044/6124] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:44 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1203 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:21:45.476284 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-78d5f943-41ee-4204-914d-9041fe05a713 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:45.477871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-78d5f943-41ee-4204-914d-9041fe05a713 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:45.497520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78d5f943-41ee-4204-914d-9041fe05a713 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:45.498620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78d5f943-41ee-4204-914d-9041fe05a713 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:45.499310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78d5f943-41ee-4204-914d-9041fe05a713 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:45.500435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78d5f943-41ee-4204-914d-9041fe05a713 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:45.502125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78d5f943-41ee-4204-914d-9041fe05a713 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:45.503203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78d5f943-41ee-4204-914d-9041fe05a713 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:45.754853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-78d5f943-41ee-4204-914d-9041fe05a713 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:45.777990 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-78d5f943-41ee-4204-914d-9041fe05a713 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1203 microversion: 2.1 time: 0.306972 Sep 07 13:21:45.779243 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3081/6125] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:45 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1203 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:46.808921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd9a6d2a-e2e9-4795-8183-08905e2deb62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:46.809605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dd9a6d2a-e2e9-4795-8183-08905e2deb62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:46.819968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd9a6d2a-e2e9-4795-8183-08905e2deb62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:46.820474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd9a6d2a-e2e9-4795-8183-08905e2deb62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:46.820917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd9a6d2a-e2e9-4795-8183-08905e2deb62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:46.822766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd9a6d2a-e2e9-4795-8183-08905e2deb62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:46.823771 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd9a6d2a-e2e9-4795-8183-08905e2deb62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:46.824465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd9a6d2a-e2e9-4795-8183-08905e2deb62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:47.155352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dd9a6d2a-e2e9-4795-8183-08905e2deb62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:47.189251 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dd9a6d2a-e2e9-4795-8183-08905e2deb62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1203 microversion: 2.1 time: 0.384299 Sep 07 13:21:47.190404 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3045/6126] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:46 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1203 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:48.142365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1388c599-2445-409c-a458-e7f20d68b5c8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '.version_select at 0x7fc4188ca940>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:48.188391 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1388c599-2445-409c-a458-e7f20d68b5c8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1948765916" status: 202 len: 0 microversion: 2.1 time: 0.050142 Sep 07 13:21:48.189739 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3082/6127] 10.222.0.16 () {58 vars in 1284 bytes} [Wed Sep 7 13:21:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1948765916 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:21:48.213257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-381f3e67-fdd1-4997-bd43-a59d2f336cb0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:48.213978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-381f3e67-fdd1-4997-bd43-a59d2f336cb0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:48.227528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fe36b5b3-ec5c-4d8a-97e1-32a1550ee159 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Action: 'create', calling method: .version_select at 0x7fc418517d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2112263755", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKC43GefXtq+yXfbuVjCmP/zHxIJZUVN6sc94u9IFXmxXYuW0xSFBuWixX9mWUX38fT+xnjkZIZD4Cw28dTf9h2wyKLNWRYY0wOlfATA7i5T1ET9Z+yJIwruVa7KUyynOA=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:48.233209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-381f3e67-fdd1-4997-bd43-a59d2f336cb0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:48.233741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-381f3e67-fdd1-4997-bd43-a59d2f336cb0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:48.234188 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-381f3e67-fdd1-4997-bd43-a59d2f336cb0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:48.234915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-381f3e67-fdd1-4997-bd43-a59d2f336cb0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:48.235470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-381f3e67-fdd1-4997-bd43-a59d2f336cb0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:48.235854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-381f3e67-fdd1-4997-bd43-a59d2f336cb0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:48.258156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-fe36b5b3-ec5c-4d8a-97e1-32a1550ee159 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Getting quotas for project c7ff80261a1a4ffdaefba7dd7d276c00. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:21:48.264308 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-fe36b5b3-ec5c-4d8a-97e1-32a1550ee159 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Getting quotas for user 663c3f21362d460785702e1858cc6706 and project c7ff80261a1a4ffdaefba7dd7d276c00. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:21:48.308545 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fe36b5b3-ec5c-4d8a-97e1-32a1550ee159 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.084928 Sep 07 13:21:48.313900 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3083/6128] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 13:21:48 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:21:48.548546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-381f3e67-fdd1-4997-bd43-a59d2f336cb0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:48.562573 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-381f3e67-fdd1-4997-bd43-a59d2f336cb0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1203 microversion: 2.1 time: 0.353568 Sep 07 13:21:48.564768 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3046/6129] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:48 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1203 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:21:49.593705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2ee835ec-4bb5-4c6e-ad9e-c0c851a40052 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:49.594826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2ee835ec-4bb5-4c6e-ad9e-c0c851a40052 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:49.605569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ee835ec-4bb5-4c6e-ad9e-c0c851a40052 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:49.606561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ee835ec-4bb5-4c6e-ad9e-c0c851a40052 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:49.607389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ee835ec-4bb5-4c6e-ad9e-c0c851a40052 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:49.608498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ee835ec-4bb5-4c6e-ad9e-c0c851a40052 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:49.609540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ee835ec-4bb5-4c6e-ad9e-c0c851a40052 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:49.610469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ee835ec-4bb5-4c6e-ad9e-c0c851a40052 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:49.843846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2ee835ec-4bb5-4c6e-ad9e-c0c851a40052 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:49.862443 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2ee835ec-4bb5-4c6e-ad9e-c0c851a40052 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1203 microversion: 2.1 time: 0.277292 Sep 07 13:21:49.864413 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3084/6130] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:49 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1203 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:50.139002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-269de83d-05f4-4593-a301-dec6c4e10039 req-b859d33d-841b-4834-bba0-4552a6149e04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b8b496d-a984-462f-9b79-b69f13912d73", "name": "network-vif-plugged", "status": "completed", "tag": "408d9a77-0d32-47e6-a785-e6416af9890e"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:50.164625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-269de83d-05f4-4593-a301-dec6c4e10039 req-b859d33d-841b-4834-bba0-4552a6149e04 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:50.168988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-269de83d-05f4-4593-a301-dec6c4e10039 req-b859d33d-841b-4834-bba0-4552a6149e04 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:50.169584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-269de83d-05f4-4593-a301-dec6c4e10039 req-b859d33d-841b-4834-bba0-4552a6149e04 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:50.191540 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-269de83d-05f4-4593-a301-dec6c4e10039 req-b859d33d-841b-4834-bba0-4552a6149e04 service nova] Creating event network-vif-plugged:408d9a77-0d32-47e6-a785-e6416af9890e for instance 4b8b496d-a984-462f-9b79-b69f13912d73 on n-h2-852087-9 Sep 07 13:21:50.219354 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-269de83d-05f4-4593-a301-dec6c4e10039 req-b859d33d-841b-4834-bba0-4552a6149e04 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087174 Sep 07 13:21:50.226140 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3047/6131] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:21:50.890031 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e9b5b502-3f37-49f5-8205-c225dcfa0e41 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:50.890865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e9b5b502-3f37-49f5-8205-c225dcfa0e41 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:50.912747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9b5b502-3f37-49f5-8205-c225dcfa0e41 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:50.913261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9b5b502-3f37-49f5-8205-c225dcfa0e41 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:50.913764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9b5b502-3f37-49f5-8205-c225dcfa0e41 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:50.921324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9b5b502-3f37-49f5-8205-c225dcfa0e41 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:50.922220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9b5b502-3f37-49f5-8205-c225dcfa0e41 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:50.923031 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9b5b502-3f37-49f5-8205-c225dcfa0e41 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:51.374023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e9b5b502-3f37-49f5-8205-c225dcfa0e41 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:51.386459 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e9b5b502-3f37-49f5-8205-c225dcfa0e41 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1203 microversion: 2.1 time: 0.503003 Sep 07 13:21:51.387052 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3085/6132] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:50 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1203 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:52.414513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7cf68be1-5300-4419-a5c6-bc29f3dad735 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:52.415385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7cf68be1-5300-4419-a5c6-bc29f3dad735 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:52.430204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cf68be1-5300-4419-a5c6-bc29f3dad735 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:52.431119 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cf68be1-5300-4419-a5c6-bc29f3dad735 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:52.431930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cf68be1-5300-4419-a5c6-bc29f3dad735 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:52.432752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cf68be1-5300-4419-a5c6-bc29f3dad735 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:52.433319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cf68be1-5300-4419-a5c6-bc29f3dad735 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:52.433801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cf68be1-5300-4419-a5c6-bc29f3dad735 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:52.722423 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7cf68be1-5300-4419-a5c6-bc29f3dad735 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:52.768450 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7cf68be1-5300-4419-a5c6-bc29f3dad735 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1391 microversion: 2.1 time: 0.359159 Sep 07 13:21:52.769120 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3048/6133] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:52 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1391 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:52.823809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-83326166-f8d9-4865-8479-a182c2074bbe tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:52.824547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-83326166-f8d9-4865-8479-a182c2074bbe tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:52.834188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83326166-f8d9-4865-8479-a182c2074bbe tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:52.836774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83326166-f8d9-4865-8479-a182c2074bbe tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:52.837764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83326166-f8d9-4865-8479-a182c2074bbe tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:52.838537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83326166-f8d9-4865-8479-a182c2074bbe tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:52.839358 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83326166-f8d9-4865-8479-a182c2074bbe tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:52.839624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-83326166-f8d9-4865-8479-a182c2074bbe tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:53.084331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-83326166-f8d9-4865-8479-a182c2074bbe tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:53.096780 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-83326166-f8d9-4865-8479-a182c2074bbe tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1391 microversion: 2.1 time: 0.287277 Sep 07 13:21:53.097951 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3086/6134] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:52 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1391 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:53.120848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d34c0581-2609-492e-9f95-b3dde055d795 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:53.121539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d34c0581-2609-492e-9f95-b3dde055d795 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:53.128570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d34c0581-2609-492e-9f95-b3dde055d795 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:53.129449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d34c0581-2609-492e-9f95-b3dde055d795 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:53.130014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d34c0581-2609-492e-9f95-b3dde055d795 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:53.130933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d34c0581-2609-492e-9f95-b3dde055d795 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:53.131535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d34c0581-2609-492e-9f95-b3dde055d795 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:53.132218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d34c0581-2609-492e-9f95-b3dde055d795 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:53.559276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d34c0581-2609-492e-9f95-b3dde055d795 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:53.573155 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d34c0581-2609-492e-9f95-b3dde055d795 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1391 microversion: 2.1 time: 0.456721 Sep 07 13:21:53.575781 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3049/6135] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:53 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1391 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:53.603480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-05ecf699-b12f-4f7e-86d9-19faff840cdb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:53.604521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-05ecf699-b12f-4f7e-86d9-19faff840cdb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:53.620932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05ecf699-b12f-4f7e-86d9-19faff840cdb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:53.622118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05ecf699-b12f-4f7e-86d9-19faff840cdb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:53.622677 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05ecf699-b12f-4f7e-86d9-19faff840cdb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:53.623425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05ecf699-b12f-4f7e-86d9-19faff840cdb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:53.623893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05ecf699-b12f-4f7e-86d9-19faff840cdb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:53.624330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05ecf699-b12f-4f7e-86d9-19faff840cdb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:53.708523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-05ecf699-b12f-4f7e-86d9-19faff840cdb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:21:53.731928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:53.893258 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-05ecf699-b12f-4f7e-86d9-19faff840cdb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 204 len: 0 microversion: 2.1 time: 0.295131 Sep 07 13:21:53.895074 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3087/6136] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:21:53 2022] DELETE /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:21:53.913624 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2f594060-5d63-4bfe-8331-bc79a230bf88 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:53.914251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2f594060-5d63-4bfe-8331-bc79a230bf88 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:53.929465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f594060-5d63-4bfe-8331-bc79a230bf88 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:53.929962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f594060-5d63-4bfe-8331-bc79a230bf88 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:53.930409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f594060-5d63-4bfe-8331-bc79a230bf88 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:53.931324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f594060-5d63-4bfe-8331-bc79a230bf88 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:53.931860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f594060-5d63-4bfe-8331-bc79a230bf88 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:53.932290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f594060-5d63-4bfe-8331-bc79a230bf88 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:54.203304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2f594060-5d63-4bfe-8331-bc79a230bf88 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:54.221706 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2f594060-5d63-4bfe-8331-bc79a230bf88 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1397 microversion: 2.1 time: 0.313856 Sep 07 13:21:54.222926 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3050/6137] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:53 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1397 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:55.251565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fcb23819-86fb-4769-95a3-e33f674186b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:55.256215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fcb23819-86fb-4769-95a3-e33f674186b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:55.266444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcb23819-86fb-4769-95a3-e33f674186b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:55.266945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcb23819-86fb-4769-95a3-e33f674186b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:55.267541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcb23819-86fb-4769-95a3-e33f674186b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:55.268564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcb23819-86fb-4769-95a3-e33f674186b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:55.269062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcb23819-86fb-4769-95a3-e33f674186b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:55.269674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcb23819-86fb-4769-95a3-e33f674186b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:55.471867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fcb23819-86fb-4769-95a3-e33f674186b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:55.486464 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fcb23819-86fb-4769-95a3-e33f674186b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1397 microversion: 2.1 time: 0.242687 Sep 07 13:21:55.487505 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3088/6138] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:55 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1397 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:21:56.513450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2742dcf5-1c61-4639-8f60-201114ac969f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:56.514265 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2742dcf5-1c61-4639-8f60-201114ac969f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:56.559120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2742dcf5-1c61-4639-8f60-201114ac969f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:56.559841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2742dcf5-1c61-4639-8f60-201114ac969f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:56.562558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2742dcf5-1c61-4639-8f60-201114ac969f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:56.567869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2742dcf5-1c61-4639-8f60-201114ac969f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:56.568707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2742dcf5-1c61-4639-8f60-201114ac969f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:56.577416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2742dcf5-1c61-4639-8f60-201114ac969f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:56.914999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2742dcf5-1c61-4639-8f60-201114ac969f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:56.934509 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2742dcf5-1c61-4639-8f60-201114ac969f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1355 microversion: 2.1 time: 0.425066 Sep 07 13:21:56.942603 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3051/6139] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:56 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1355 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:57.100774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-b2fb7d52-ca5d-498f-a81a-4d22e1798751 req-47cdadbf-626f-4498-8bd1-9a4113ec0c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b8b496d-a984-462f-9b79-b69f13912d73", "name": "network-vif-deleted", "tag": "408d9a77-0d32-47e6-a785-e6416af9890e"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:57.183841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b2fb7d52-ca5d-498f-a81a-4d22e1798751 req-47cdadbf-626f-4498-8bd1-9a4113ec0c55 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:57.184343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b2fb7d52-ca5d-498f-a81a-4d22e1798751 req-47cdadbf-626f-4498-8bd1-9a4113ec0c55 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:57.184831 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b2fb7d52-ca5d-498f-a81a-4d22e1798751 req-47cdadbf-626f-4498-8bd1-9a4113ec0c55 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:57.238506 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-b2fb7d52-ca5d-498f-a81a-4d22e1798751 req-47cdadbf-626f-4498-8bd1-9a4113ec0c55 service nova] Creating event network-vif-deleted:408d9a77-0d32-47e6-a785-e6416af9890e for instance 4b8b496d-a984-462f-9b79-b69f13912d73 on n-h2-852087-9 Sep 07 13:21:57.252438 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-b2fb7d52-ca5d-498f-a81a-4d22e1798751 req-47cdadbf-626f-4498-8bd1-9a4113ec0c55 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171441 Sep 07 13:21:57.266086 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3089/6140] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:21:57.965755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a0c9c0a8-e55c-4cf4-8bda-115570182ad2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:57.966387 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a0c9c0a8-e55c-4cf4-8bda-115570182ad2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:57.996027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0c9c0a8-e55c-4cf4-8bda-115570182ad2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:58.004621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0c9c0a8-e55c-4cf4-8bda-115570182ad2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:58.005442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0c9c0a8-e55c-4cf4-8bda-115570182ad2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:58.006716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0c9c0a8-e55c-4cf4-8bda-115570182ad2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:58.010245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0c9c0a8-e55c-4cf4-8bda-115570182ad2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:58.013375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0c9c0a8-e55c-4cf4-8bda-115570182ad2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:58.151105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a0c9c0a8-e55c-4cf4-8bda-115570182ad2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:58.161331 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a0c9c0a8-e55c-4cf4-8bda-115570182ad2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1188 microversion: 2.1 time: 0.200708 Sep 07 13:21:58.178147 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3052/6141] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:57 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1188 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:21:59.123821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d7dbc53e-23b9-4a43-a1d8-5d4af74f904c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-625548913", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "d7f77cfd-74a2-4389-89b4-29ad9110899d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2112263755", "security_groups": [{"name": "tempest-secgroup-smoke-408882973"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:21:59.169211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:59.169211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:59.189230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-37c9709d-3929-49f5-9f0f-9f354fc8cd87 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:21:59.193818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-37c9709d-3929-49f5-9f0f-9f354fc8cd87 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:21:59.224436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=41 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:59.245952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37c9709d-3929-49f5-9f0f-9f354fc8cd87 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:59.253843 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37c9709d-3929-49f5-9f0f-9f354fc8cd87 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:59.255261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37c9709d-3929-49f5-9f0f-9f354fc8cd87 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:59.256089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37c9709d-3929-49f5-9f0f-9f354fc8cd87 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:21:59.256583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37c9709d-3929-49f5-9f0f-9f354fc8cd87 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:21:59.257026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37c9709d-3929-49f5-9f0f-9f354fc8cd87 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:21:59.281843 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=93 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:59.387169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-d7dbc53e-23b9-4a43-a1d8-5d4af74f904c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] validate_networks() for [('d7f77cfd-74a2-4389-89b4-29ad9110899d', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:21:59.510855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-37c9709d-3929-49f5-9f0f-9f354fc8cd87 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:21:59.530011 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-37c9709d-3929-49f5-9f0f-9f354fc8cd87 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1188 microversion: 2.1 time: 0.341475 Sep 07 13:21:59.534649 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3053/6142] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:21:59 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1188 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:00.282112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d7dbc53e-23b9-4a43-a1d8-5d4af74f904c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:22:00.283510 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d7dbc53e-23b9-4a43-a1d8-5d4af74f904c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:22:00.284224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d7dbc53e-23b9-4a43-a1d8-5d4af74f904c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:22:00.284919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d7dbc53e-23b9-4a43-a1d8-5d4af74f904c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:22:00.285741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d7dbc53e-23b9-4a43-a1d8-5d4af74f904c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:22:00.298393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7dbc53e-23b9-4a43-a1d8-5d4af74f904c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:00.299092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7dbc53e-23b9-4a43-a1d8-5d4af74f904c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:00.299880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7dbc53e-23b9-4a43-a1d8-5d4af74f904c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:00.300811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7dbc53e-23b9-4a43-a1d8-5d4af74f904c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:00.301409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7dbc53e-23b9-4a43-a1d8-5d4af74f904c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:00.302052 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7dbc53e-23b9-4a43-a1d8-5d4af74f904c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:00.327144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-d7dbc53e-23b9-4a43-a1d8-5d4af74f904c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Getting quotas for project c7ff80261a1a4ffdaefba7dd7d276c00. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:22:00.349247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-d7dbc53e-23b9-4a43-a1d8-5d4af74f904c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Getting quotas for user 663c3f21362d460785702e1858cc6706 and project c7ff80261a1a4ffdaefba7dd7d276c00. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:22:00.389687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d7dbc53e-23b9-4a43-a1d8-5d4af74f904c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:22:00.397825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d7dbc53e-23b9-4a43-a1d8-5d4af74f904c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:22:00.490015 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d7dbc53e-23b9-4a43-a1d8-5d4af74f904c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.380908 Sep 07 13:22:00.499349 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3090/6143] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:21:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 1390 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:22:00.507489 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-08eb69e9-fd84-40e4-b1d6-8718188bf66f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:00.511058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-08eb69e9-fd84-40e4-b1d6-8718188bf66f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:00.564688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9c19d965-69e5-45fa-8976-dfaadaa25a2f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:00.565375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9c19d965-69e5-45fa-8976-dfaadaa25a2f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:00.589160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c19d965-69e5-45fa-8976-dfaadaa25a2f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:00.589788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c19d965-69e5-45fa-8976-dfaadaa25a2f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:00.591906 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c19d965-69e5-45fa-8976-dfaadaa25a2f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:00.595185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c19d965-69e5-45fa-8976-dfaadaa25a2f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:00.596162 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c19d965-69e5-45fa-8976-dfaadaa25a2f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:00.602047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c19d965-69e5-45fa-8976-dfaadaa25a2f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:00.684753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-08eb69e9-fd84-40e4-b1d6-8718188bf66f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:00.697255 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-08eb69e9-fd84-40e4-b1d6-8718188bf66f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1266 microversion: 2.1 time: 0.197694 Sep 07 13:22:00.699795 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3054/6144] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:00 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:00.774942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9c19d965-69e5-45fa-8976-dfaadaa25a2f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:00.785301 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9c19d965-69e5-45fa-8976-dfaadaa25a2f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1188 microversion: 2.1 time: 0.227020 Sep 07 13:22:00.787307 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3091/6145] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:00 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1188 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:22:01.723842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d5e2733a-409a-4ed8-a46a-d3623652be79 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:01.725119 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d5e2733a-409a-4ed8-a46a-d3623652be79 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:01.741924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5e2733a-409a-4ed8-a46a-d3623652be79 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:01.742914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5e2733a-409a-4ed8-a46a-d3623652be79 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:01.747167 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5e2733a-409a-4ed8-a46a-d3623652be79 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:01.748506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5e2733a-409a-4ed8-a46a-d3623652be79 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:01.749022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5e2733a-409a-4ed8-a46a-d3623652be79 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:01.751880 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d5e2733a-409a-4ed8-a46a-d3623652be79 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:01.824081 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b1c29914-cefc-4b16-b868-2b5b71b34694 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:01.826403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b1c29914-cefc-4b16-b868-2b5b71b34694 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:01.857352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1c29914-cefc-4b16-b868-2b5b71b34694 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:01.863278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1c29914-cefc-4b16-b868-2b5b71b34694 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:01.864675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1c29914-cefc-4b16-b868-2b5b71b34694 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:01.866086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1c29914-cefc-4b16-b868-2b5b71b34694 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:01.870474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1c29914-cefc-4b16-b868-2b5b71b34694 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:01.871684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1c29914-cefc-4b16-b868-2b5b71b34694 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:01.932738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d5e2733a-409a-4ed8-a46a-d3623652be79 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:01.970949 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d5e2733a-409a-4ed8-a46a-d3623652be79 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1262 microversion: 2.1 time: 0.239183 Sep 07 13:22:02.003956 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3055/6146] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:01 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1262 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:02.090438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b1c29914-cefc-4b16-b868-2b5b71b34694 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:02.103078 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b1c29914-cefc-4b16-b868-2b5b71b34694 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1188 microversion: 2.1 time: 0.294582 Sep 07 13:22:02.103685 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3092/6147] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:01 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1188 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:02.997050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a7cf08e6-5498-4150-9a83-6a1e527ce364 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:02.997947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a7cf08e6-5498-4150-9a83-6a1e527ce364 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:03.011785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7cf08e6-5498-4150-9a83-6a1e527ce364 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:03.012443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7cf08e6-5498-4150-9a83-6a1e527ce364 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:03.014782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7cf08e6-5498-4150-9a83-6a1e527ce364 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:03.016236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7cf08e6-5498-4150-9a83-6a1e527ce364 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:03.016236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7cf08e6-5498-4150-9a83-6a1e527ce364 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:03.026459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7cf08e6-5498-4150-9a83-6a1e527ce364 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:03.132500 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bbe3decc-3b58-4777-9bb0-119159e53f99 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:03.135530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bbe3decc-3b58-4777-9bb0-119159e53f99 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:03.182959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbe3decc-3b58-4777-9bb0-119159e53f99 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:03.186295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbe3decc-3b58-4777-9bb0-119159e53f99 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:03.205406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbe3decc-3b58-4777-9bb0-119159e53f99 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:03.208985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a7cf08e6-5498-4150-9a83-6a1e527ce364 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:03.210042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbe3decc-3b58-4777-9bb0-119159e53f99 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:03.213563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbe3decc-3b58-4777-9bb0-119159e53f99 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:03.225538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bbe3decc-3b58-4777-9bb0-119159e53f99 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:03.225810 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a7cf08e6-5498-4150-9a83-6a1e527ce364 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1324 microversion: 2.1 time: 0.233911 Sep 07 13:22:03.238255 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3056/6148] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:02 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1324 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:03.421684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bbe3decc-3b58-4777-9bb0-119159e53f99 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:03.436346 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bbe3decc-3b58-4777-9bb0-119159e53f99 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1188 microversion: 2.1 time: 0.312422 Sep 07 13:22:03.437712 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3093/6149] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:03 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1188 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:04.256088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3c501595-a651-4405-8442-6058db2de07a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:04.257477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3c501595-a651-4405-8442-6058db2de07a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:04.294811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c501595-a651-4405-8442-6058db2de07a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:04.295324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c501595-a651-4405-8442-6058db2de07a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:04.295859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c501595-a651-4405-8442-6058db2de07a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:04.296731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c501595-a651-4405-8442-6058db2de07a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:04.297216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c501595-a651-4405-8442-6058db2de07a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:04.297758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3c501595-a651-4405-8442-6058db2de07a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:04.481052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3c501595-a651-4405-8442-6058db2de07a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:04.482498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d89f4597-2d56-4352-a5b4-efe4d39b45a2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:04.483978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d89f4597-2d56-4352-a5b4-efe4d39b45a2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:04.500515 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3c501595-a651-4405-8442-6058db2de07a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1391 microversion: 2.1 time: 0.251588 Sep 07 13:22:04.501533 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3057/6150] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:04 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1391 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:04.510900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d89f4597-2d56-4352-a5b4-efe4d39b45a2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:04.514015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d89f4597-2d56-4352-a5b4-efe4d39b45a2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:04.521245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d89f4597-2d56-4352-a5b4-efe4d39b45a2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:04.524427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d89f4597-2d56-4352-a5b4-efe4d39b45a2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:04.527706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d89f4597-2d56-4352-a5b4-efe4d39b45a2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:04.528319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d89f4597-2d56-4352-a5b4-efe4d39b45a2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:04.738444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d89f4597-2d56-4352-a5b4-efe4d39b45a2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:04.749805 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d89f4597-2d56-4352-a5b4-efe4d39b45a2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 200 len: 1188 microversion: 2.1 time: 0.293283 Sep 07 13:22:04.751992 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3094/6151] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:04 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 1188 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:05.528118 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-64adc9b0-338c-4cbd-a5ec-df7b1d41a61f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:05.528745 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-64adc9b0-338c-4cbd-a5ec-df7b1d41a61f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:05.538256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64adc9b0-338c-4cbd-a5ec-df7b1d41a61f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:05.539053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64adc9b0-338c-4cbd-a5ec-df7b1d41a61f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:05.539690 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64adc9b0-338c-4cbd-a5ec-df7b1d41a61f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:05.540599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64adc9b0-338c-4cbd-a5ec-df7b1d41a61f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:05.541242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64adc9b0-338c-4cbd-a5ec-df7b1d41a61f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:05.541879 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64adc9b0-338c-4cbd-a5ec-df7b1d41a61f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:05.777071 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9da17eaf-04d7-4a0e-832f-d1b434d8bcd0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:05.777912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9da17eaf-04d7-4a0e-832f-d1b434d8bcd0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 4b8b496d-a984-462f-9b79-b69f13912d73] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:05.789957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9da17eaf-04d7-4a0e-832f-d1b434d8bcd0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:05.792868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9da17eaf-04d7-4a0e-832f-d1b434d8bcd0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:05.794008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9da17eaf-04d7-4a0e-832f-d1b434d8bcd0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:05.797521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9da17eaf-04d7-4a0e-832f-d1b434d8bcd0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:05.798301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9da17eaf-04d7-4a0e-832f-d1b434d8bcd0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:05.800231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9da17eaf-04d7-4a0e-832f-d1b434d8bcd0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:05.838111 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-9da17eaf-04d7-4a0e-832f-d1b434d8bcd0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] HTTP exception thrown: Instance 4b8b496d-a984-462f-9b79-b69f13912d73 could not be found. Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9da17eaf-04d7-4a0e-832f-d1b434d8bcd0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Request method failure captured: Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 HTTP/1.1 Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJrKtGg8mTUS8TVRSUKjETENKgBfLqI2oUMffXPZtsQfHAGfvsCSe64IHdsu1gAtG3a2XlfVJiJMXBeXoxoYCkAhaL6z1XH8667-SWfmJ5tkR4WMw-DlaHMfOvoGzJHrmW4OvMTJQgI9_G9o9R2vidCDnbLRABw8OsiYOeqYc9Klp2E Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 90d330a2d2ad4295873277de2d649182 Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 4b8b496d-a984-462f-9b79-b69f13912d73 could not be found. Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '4b8b496d-a984-462f-9b79-b69f13912d73'} Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b8b496d-a984-462f-9b79-b69f13912d73 could not be found. Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b8b496d-a984-462f-9b79-b69f13912d73 could not be found. Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:22:05.844494 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:22:05.849975 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:22:05.849975 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:22:05.849975 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:22:05.849975 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:22:05.849975 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:22:05.849975 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b8b496d-a984-462f-9b79-b69f13912d73 could not be found. Sep 07 13:22:05.849975 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:22:05.850480 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-64adc9b0-338c-4cbd-a5ec-df7b1d41a61f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:05.853047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9da17eaf-04d7-4a0e-832f-d1b434d8bcd0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Returning 404 to user: Instance 4b8b496d-a984-462f-9b79-b69f13912d73 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:22:05.854746 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9da17eaf-04d7-4a0e-832f-d1b434d8bcd0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73" status: 404 len: 111 microversion: 2.1 time: 0.082035 Sep 07 13:22:05.856250 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3095/6152] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:05 2022] GET /compute/v2.1/servers/4b8b496d-a984-462f-9b79-b69f13912d73 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:22:05.867360 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-64adc9b0-338c-4cbd-a5ec-df7b1d41a61f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1391 microversion: 2.1 time: 0.343312 Sep 07 13:22:05.868582 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3058/6153] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:05 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1391 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:06.079614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0e823a60-a4bf-44c5-85ca-4522a8ac98e8 req-26966e32-f8ec-47a7-981e-e80459bab6ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431", "tag": "4de6c447-da78-427b-b139-6c02f7484224"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:06.121321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0e823a60-a4bf-44c5-85ca-4522a8ac98e8 req-26966e32-f8ec-47a7-981e-e80459bab6ad service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:06.121766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0e823a60-a4bf-44c5-85ca-4522a8ac98e8 req-26966e32-f8ec-47a7-981e-e80459bab6ad service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:06.122218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0e823a60-a4bf-44c5-85ca-4522a8ac98e8 req-26966e32-f8ec-47a7-981e-e80459bab6ad service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:06.158357 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0e823a60-a4bf-44c5-85ca-4522a8ac98e8 req-26966e32-f8ec-47a7-981e-e80459bab6ad service nova] Creating event network-changed:4de6c447-da78-427b-b139-6c02f7484224 for instance 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 on n-h1-852087-9 Sep 07 13:22:06.164713 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0e823a60-a4bf-44c5-85ca-4522a8ac98e8 req-26966e32-f8ec-47a7-981e-e80459bab6ad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094484 Sep 07 13:22:06.165678 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3096/6154] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:22:06.894984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d84eff3f-e6ac-4bdf-9f71-791adb49f2d7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:06.896434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d84eff3f-e6ac-4bdf-9f71-791adb49f2d7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:06.904918 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d84eff3f-e6ac-4bdf-9f71-791adb49f2d7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:06.905719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d84eff3f-e6ac-4bdf-9f71-791adb49f2d7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:06.906419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d84eff3f-e6ac-4bdf-9f71-791adb49f2d7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:06.907272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d84eff3f-e6ac-4bdf-9f71-791adb49f2d7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:06.907928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d84eff3f-e6ac-4bdf-9f71-791adb49f2d7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:06.908754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d84eff3f-e6ac-4bdf-9f71-791adb49f2d7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:07.084411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d84eff3f-e6ac-4bdf-9f71-791adb49f2d7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:07.093293 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d84eff3f-e6ac-4bdf-9f71-791adb49f2d7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1391 microversion: 2.1 time: 0.203593 Sep 07 13:22:07.102199 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3059/6155] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:06 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1391 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:08.118855 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a8d07739-5ba0-44ea-98ad-f1b62271329d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:08.120239 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a8d07739-5ba0-44ea-98ad-f1b62271329d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:08.128669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8d07739-5ba0-44ea-98ad-f1b62271329d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:08.129476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8d07739-5ba0-44ea-98ad-f1b62271329d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:08.130021 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8d07739-5ba0-44ea-98ad-f1b62271329d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:08.130781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8d07739-5ba0-44ea-98ad-f1b62271329d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:08.131411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8d07739-5ba0-44ea-98ad-f1b62271329d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:08.131845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a8d07739-5ba0-44ea-98ad-f1b62271329d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:08.299940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a8d07739-5ba0-44ea-98ad-f1b62271329d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:08.317740 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a8d07739-5ba0-44ea-98ad-f1b62271329d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1391 microversion: 2.1 time: 0.203271 Sep 07 13:22:08.318352 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3097/6156] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:08 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1391 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:09.344646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-381b439d-4687-4fdb-acba-ea4748fcb7fa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:09.345770 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-381b439d-4687-4fdb-acba-ea4748fcb7fa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:09.358193 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-381b439d-4687-4fdb-acba-ea4748fcb7fa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:09.358709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-381b439d-4687-4fdb-acba-ea4748fcb7fa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:09.359159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-381b439d-4687-4fdb-acba-ea4748fcb7fa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:09.359891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-381b439d-4687-4fdb-acba-ea4748fcb7fa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:09.360356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-381b439d-4687-4fdb-acba-ea4748fcb7fa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:09.360825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-381b439d-4687-4fdb-acba-ea4748fcb7fa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:09.650749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-381b439d-4687-4fdb-acba-ea4748fcb7fa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:09.663411 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-381b439d-4687-4fdb-acba-ea4748fcb7fa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1391 microversion: 2.1 time: 0.323436 Sep 07 13:22:09.664625 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3060/6157] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:09 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1391 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:10.690723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bb76bce4-3e7d-48af-b83a-4110fc55ee71 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:10.691802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bb76bce4-3e7d-48af-b83a-4110fc55ee71 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:10.707757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:10.709725 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:10.712496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb76bce4-3e7d-48af-b83a-4110fc55ee71 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:10.713205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb76bce4-3e7d-48af-b83a-4110fc55ee71 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:10.713884 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb76bce4-3e7d-48af-b83a-4110fc55ee71 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:10.714828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb76bce4-3e7d-48af-b83a-4110fc55ee71 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:10.715287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb76bce4-3e7d-48af-b83a-4110fc55ee71 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:10.715768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bb76bce4-3e7d-48af-b83a-4110fc55ee71 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:10.940470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bb76bce4-3e7d-48af-b83a-4110fc55ee71 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:10.949902 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bb76bce4-3e7d-48af-b83a-4110fc55ee71 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1391 microversion: 2.1 time: 0.262236 Sep 07 13:22:10.953946 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3098/6158] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:10 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1391 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:11.981751 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c1a0b85d-0875-467f-9a28-ef07a2fecf98 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:11.983111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c1a0b85d-0875-467f-9a28-ef07a2fecf98 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:11.989958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:11.992231 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1a0b85d-0875-467f-9a28-ef07a2fecf98 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:11.993081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1a0b85d-0875-467f-9a28-ef07a2fecf98 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:11.993862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1a0b85d-0875-467f-9a28-ef07a2fecf98 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:11.994842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1a0b85d-0875-467f-9a28-ef07a2fecf98 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:11.995548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1a0b85d-0875-467f-9a28-ef07a2fecf98 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:11.996196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1a0b85d-0875-467f-9a28-ef07a2fecf98 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:12.263303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c1a0b85d-0875-467f-9a28-ef07a2fecf98 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:12.275985 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c1a0b85d-0875-467f-9a28-ef07a2fecf98 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1391 microversion: 2.1 time: 0.298465 Sep 07 13:22:12.290153 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3061/6159] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:11 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1391 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:12.519738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c639c7c4-f555-48e4-a1c8-b9b35573a71a tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:12.521253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c639c7c4-f555-48e4-a1c8-b9b35573a71a tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] [instance: 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:12.529342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c639c7c4-f555-48e4-a1c8-b9b35573a71a tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:12.530405 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c639c7c4-f555-48e4-a1c8-b9b35573a71a tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:12.531156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c639c7c4-f555-48e4-a1c8-b9b35573a71a tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:12.532089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c639c7c4-f555-48e4-a1c8-b9b35573a71a tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:12.532784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c639c7c4-f555-48e4-a1c8-b9b35573a71a tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:12.533342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c639c7c4-f555-48e4-a1c8-b9b35573a71a tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:12.566306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c639c7c4-f555-48e4-a1c8-b9b35573a71a tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] [instance: 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:22:12.729186 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c639c7c4-f555-48e4-a1c8-b9b35573a71a tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8" status: 204 len: 0 microversion: 2.1 time: 0.504131 Sep 07 13:22:12.732240 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3099/6160] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:22:12 2022] DELETE /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:22:12.742764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-39e15193-e212-4469-b411-7a6fba1b4f2d tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:12.743756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-39e15193-e212-4469-b411-7a6fba1b4f2d tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] [instance: 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:12.774471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39e15193-e212-4469-b411-7a6fba1b4f2d tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:12.774471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39e15193-e212-4469-b411-7a6fba1b4f2d tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:12.774471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39e15193-e212-4469-b411-7a6fba1b4f2d tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:12.774471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39e15193-e212-4469-b411-7a6fba1b4f2d tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:12.774471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39e15193-e212-4469-b411-7a6fba1b4f2d tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:12.774471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39e15193-e212-4469-b411-7a6fba1b4f2d tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:13.063328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-39e15193-e212-4469-b411-7a6fba1b4f2d tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba809cda0244f51aa7276d5ae9b5644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af013e51bd3f469a94e33b24c25830a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:13.106417 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-39e15193-e212-4469-b411-7a6fba1b4f2d tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] 10.222.0.16 "GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8" status: 200 len: 1733 microversion: 2.1 time: 0.368137 Sep 07 13:22:13.108641 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3062/6161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:12 2022] GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 => generated 1733 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:22:13.305853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ff36a715-fcf2-411d-ab31-0103504e8440 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:13.306931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ff36a715-fcf2-411d-ab31-0103504e8440 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:13.314441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff36a715-fcf2-411d-ab31-0103504e8440 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:13.315295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff36a715-fcf2-411d-ab31-0103504e8440 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:13.317813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff36a715-fcf2-411d-ab31-0103504e8440 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:13.334087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff36a715-fcf2-411d-ab31-0103504e8440 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:13.334940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff36a715-fcf2-411d-ab31-0103504e8440 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:13.335611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff36a715-fcf2-411d-ab31-0103504e8440 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:13.627576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ff36a715-fcf2-411d-ab31-0103504e8440 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:13.638745 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ff36a715-fcf2-411d-ab31-0103504e8440 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1391 microversion: 2.1 time: 0.337641 Sep 07 13:22:13.639669 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3100/6162] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:13 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1391 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:14.048477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-366f8c18-ee98-4e03-96a8-5b756e23c578 req-8e9f95b2-bd3b-4058-be8b-40a8f9caa2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431", "name": "network-vif-plugged", "status": "completed", "tag": "4de6c447-da78-427b-b139-6c02f7484224"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:14.077941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-366f8c18-ee98-4e03-96a8-5b756e23c578 req-8e9f95b2-bd3b-4058-be8b-40a8f9caa2c3 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:14.087303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-366f8c18-ee98-4e03-96a8-5b756e23c578 req-8e9f95b2-bd3b-4058-be8b-40a8f9caa2c3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:14.088292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-366f8c18-ee98-4e03-96a8-5b756e23c578 req-8e9f95b2-bd3b-4058-be8b-40a8f9caa2c3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:14.114763 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-366f8c18-ee98-4e03-96a8-5b756e23c578 req-8e9f95b2-bd3b-4058-be8b-40a8f9caa2c3 service nova] Creating event network-vif-plugged:4de6c447-da78-427b-b139-6c02f7484224 for instance 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 on n-h1-852087-9 Sep 07 13:22:14.127559 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-366f8c18-ee98-4e03-96a8-5b756e23c578 req-8e9f95b2-bd3b-4058-be8b-40a8f9caa2c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088053 Sep 07 13:22:14.129603 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3063/6163] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:22:14.137160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cc709877-736b-40d6-8071-30c0891e3405 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:14.138383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cc709877-736b-40d6-8071-30c0891e3405 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] [instance: 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:14.152156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc709877-736b-40d6-8071-30c0891e3405 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:14.152663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc709877-736b-40d6-8071-30c0891e3405 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:14.153112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc709877-736b-40d6-8071-30c0891e3405 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:14.153862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc709877-736b-40d6-8071-30c0891e3405 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:14.155085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc709877-736b-40d6-8071-30c0891e3405 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:14.155718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc709877-736b-40d6-8071-30c0891e3405 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:14.380823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cc709877-736b-40d6-8071-30c0891e3405 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba809cda0244f51aa7276d5ae9b5644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af013e51bd3f469a94e33b24c25830a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:14.401285 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cc709877-736b-40d6-8071-30c0891e3405 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] 10.222.0.16 "GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8" status: 200 len: 1733 microversion: 2.1 time: 0.269730 Sep 07 13:22:14.413531 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3101/6164] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:14 2022] GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 => generated 1733 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:14.669677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-96f249d9-a4a3-4d04-9692-4e22571bff62 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:14.670692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-96f249d9-a4a3-4d04-9692-4e22571bff62 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:14.697814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96f249d9-a4a3-4d04-9692-4e22571bff62 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:14.699279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96f249d9-a4a3-4d04-9692-4e22571bff62 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:14.700391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96f249d9-a4a3-4d04-9692-4e22571bff62 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:14.702486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96f249d9-a4a3-4d04-9692-4e22571bff62 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:14.703535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96f249d9-a4a3-4d04-9692-4e22571bff62 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:14.704657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96f249d9-a4a3-4d04-9692-4e22571bff62 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:14.805663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a79cfe48-baaa-4672-8eaf-091584f4a2a1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1594923941", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f56b7b6b-6426-46f5-ba91-fa8522754bc3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7f5512e3-cd6c-43c3-ae4c-0cca06e090be"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:15.000224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-a79cfe48-baaa-4672-8eaf-091584f4a2a1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] validate_networks() for [('7f5512e3-cd6c-43c3-ae4c-0cca06e090be', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:22:15.106288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-96f249d9-a4a3-4d04-9692-4e22571bff62 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:15.122601 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-96f249d9-a4a3-4d04-9692-4e22571bff62 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1391 microversion: 2.1 time: 0.460503 Sep 07 13:22:15.127282 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3064/6165] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:14 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1391 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:15.443119 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6551f74a-ba0e-476e-9520-b269efe575c8 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:15.446859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6551f74a-ba0e-476e-9520-b269efe575c8 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] [instance: 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:15.455438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6551f74a-ba0e-476e-9520-b269efe575c8 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:15.456237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6551f74a-ba0e-476e-9520-b269efe575c8 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:15.458208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6551f74a-ba0e-476e-9520-b269efe575c8 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:15.459192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6551f74a-ba0e-476e-9520-b269efe575c8 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:15.459855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6551f74a-ba0e-476e-9520-b269efe575c8 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:15.460523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6551f74a-ba0e-476e-9520-b269efe575c8 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:16.061015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6551f74a-ba0e-476e-9520-b269efe575c8 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba809cda0244f51aa7276d5ae9b5644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af013e51bd3f469a94e33b24c25830a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:16.083853 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6551f74a-ba0e-476e-9520-b269efe575c8 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] 10.222.0.16 "GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8" status: 200 len: 1666 microversion: 2.1 time: 0.645413 Sep 07 13:22:16.085780 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3065/6166] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:15 2022] GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 => generated 1666 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:22:16.096528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3a7aa905-79e8-4846-9ee3-b15c1a0484b0 req-b346de9a-514b-4510-a8d2-421d2b061462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fcfac58-c87d-4b0d-ab83-ee865b1fadd8", "name": "network-vif-deleted", "tag": "730e86e2-27a6-4096-be01-20c327916d47"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:16.126330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3a7aa905-79e8-4846-9ee3-b15c1a0484b0 req-b346de9a-514b-4510-a8d2-421d2b061462 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:16.127158 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3a7aa905-79e8-4846-9ee3-b15c1a0484b0 req-b346de9a-514b-4510-a8d2-421d2b061462 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:16.129465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3a7aa905-79e8-4846-9ee3-b15c1a0484b0 req-b346de9a-514b-4510-a8d2-421d2b061462 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:16.145460 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3a7aa905-79e8-4846-9ee3-b15c1a0484b0 req-b346de9a-514b-4510-a8d2-421d2b061462 service nova] Creating event network-vif-deleted:730e86e2-27a6-4096-be01-20c327916d47 for instance 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 on n-h1-852087-9 Sep 07 13:22:16.152107 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3a7aa905-79e8-4846-9ee3-b15c1a0484b0 req-b346de9a-514b-4510-a8d2-421d2b061462 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063898 Sep 07 13:22:16.153083 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3066/6167] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:22:16.167988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b3fc9fa6-e26e-41e1-853f-e0eae560d309 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:16.169850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b3fc9fa6-e26e-41e1-853f-e0eae560d309 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:16.179849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3fc9fa6-e26e-41e1-853f-e0eae560d309 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:16.181158 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3fc9fa6-e26e-41e1-853f-e0eae560d309 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:16.182051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3fc9fa6-e26e-41e1-853f-e0eae560d309 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:16.183390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3fc9fa6-e26e-41e1-853f-e0eae560d309 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:16.184507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3fc9fa6-e26e-41e1-853f-e0eae560d309 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:16.185306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3fc9fa6-e26e-41e1-853f-e0eae560d309 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:16.254545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a79cfe48-baaa-4672-8eaf-091584f4a2a1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:22:16.255449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a79cfe48-baaa-4672-8eaf-091584f4a2a1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:22:16.255449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a79cfe48-baaa-4672-8eaf-091584f4a2a1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:22:16.256079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a79cfe48-baaa-4672-8eaf-091584f4a2a1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:22:16.256498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-a79cfe48-baaa-4672-8eaf-091584f4a2a1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:22:16.268250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a79cfe48-baaa-4672-8eaf-091584f4a2a1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:16.268753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a79cfe48-baaa-4672-8eaf-091584f4a2a1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:16.269192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a79cfe48-baaa-4672-8eaf-091584f4a2a1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:16.269987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a79cfe48-baaa-4672-8eaf-091584f4a2a1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:16.270522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a79cfe48-baaa-4672-8eaf-091584f4a2a1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:16.270955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a79cfe48-baaa-4672-8eaf-091584f4a2a1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:16.338073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-a79cfe48-baaa-4672-8eaf-091584f4a2a1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Getting quotas for project b97b8dd299f145888f90fbf60321cd18. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:22:16.345417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-a79cfe48-baaa-4672-8eaf-091584f4a2a1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Getting quotas for user 90d330a2d2ad4295873277de2d649182 and project b97b8dd299f145888f90fbf60321cd18. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:22:16.419200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a79cfe48-baaa-4672-8eaf-091584f4a2a1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:22:16.422142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a79cfe48-baaa-4672-8eaf-091584f4a2a1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f56b7b6b-6426-46f5-ba91-fa8522754bc3',volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:22:16.626433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b3fc9fa6-e26e-41e1-853f-e0eae560d309 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:16.642549 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b3fc9fa6-e26e-41e1-853f-e0eae560d309 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1391 microversion: 2.1 time: 0.482416 Sep 07 13:22:16.643916 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3067/6168] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:16 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1391 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:16.796732 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a79cfe48-baaa-4672-8eaf-091584f4a2a1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.007357 Sep 07 13:22:16.808486 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3102/6169] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:22:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:22:16.823242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ed4c8d16-0deb-4f5e-baec-90084d8605c1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:16.824831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ed4c8d16-0deb-4f5e-baec-90084d8605c1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:17.054085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ed4c8d16-0deb-4f5e-baec-90084d8605c1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:17.108939 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ed4c8d16-0deb-4f5e-baec-90084d8605c1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1057 microversion: 2.1 time: 0.285345 Sep 07 13:22:17.110677 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3068/6170] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:16 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1057 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:17.143384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-35882254-5f1b-4d40-b2c0-a46ed0eb40cc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:17.144667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-35882254-5f1b-4d40-b2c0-a46ed0eb40cc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] [instance: 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:17.169728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35882254-5f1b-4d40-b2c0-a46ed0eb40cc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:17.171922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35882254-5f1b-4d40-b2c0-a46ed0eb40cc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:17.178057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35882254-5f1b-4d40-b2c0-a46ed0eb40cc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:17.180313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35882254-5f1b-4d40-b2c0-a46ed0eb40cc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:17.185787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35882254-5f1b-4d40-b2c0-a46ed0eb40cc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:17.187470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35882254-5f1b-4d40-b2c0-a46ed0eb40cc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:17.237551 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-35882254-5f1b-4d40-b2c0-a46ed0eb40cc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] HTTP exception thrown: Instance 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 could not be found. Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-35882254-5f1b-4d40-b2c0-a46ed0eb40cc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Request method failure captured: Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 HTTP/1.1 Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJmgwbt2yW2bfS3N4Hc-zLwdylUXH1-qXsY1pMQqjSi3hI8SbKfAyamgsTNGDePU7161b-hIxOfQdOVnlEKvo466FXtKp9GRXatg5_C2WSuKxLvRTmgb3vSGtQszeTyJFwUFEfNc5tjwI3rmFwzVQ0Zm2EyKUxPILYPXSDjCSG9Mq2U Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: af013e51bd3f469a94e33b24c25830a9 Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TestServerBasicOps-395147439 Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/af013e51bd3f469a94e33b24c25830a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_af013e51bd3f469a94e33b24c25830a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/af013e51bd3f469a94e33b24c25830a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/af013e51bd3f469a94e33b24c25830a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TestServerBasicOps-395147439 Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: af013e51bd3f469a94e33b24c25830a9 Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestServerBasicOps-395147439 Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TestServerBasicOps-395147439-project Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5ba809cda0244f51aa7276d5ae9b5644 Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TestServerBasicOps-395147439-project Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 could not be found. Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '2fcfac58-c87d-4b0d-ab83-ee865b1fadd8'} Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 could not be found. Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 could not be found. Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:22:17.246498 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:22:17.251286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:22:17.251286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:22:17.251286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:22:17.251286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:22:17.251286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:22:17.251286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 could not be found. Sep 07 13:22:17.251286 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:22:17.251286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-35882254-5f1b-4d40-b2c0-a46ed0eb40cc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Returning 404 to user: Instance 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:22:17.251286 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-35882254-5f1b-4d40-b2c0-a46ed0eb40cc tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] 10.222.0.16 "GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8" status: 404 len: 111 microversion: 2.1 time: 0.120801 Sep 07 13:22:17.251286 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3103/6171] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:17 2022] GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:22:17.693621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-86dd90ea-8225-4636-9d91-f408e1800aac tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:17.695855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-86dd90ea-8225-4636-9d91-f408e1800aac tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:17.723032 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86dd90ea-8225-4636-9d91-f408e1800aac tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:17.725469 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86dd90ea-8225-4636-9d91-f408e1800aac tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:17.728160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86dd90ea-8225-4636-9d91-f408e1800aac tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:17.729379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86dd90ea-8225-4636-9d91-f408e1800aac tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:17.731430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86dd90ea-8225-4636-9d91-f408e1800aac tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:17.733985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86dd90ea-8225-4636-9d91-f408e1800aac tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:18.152353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-99cc8bc6-9bc0-447c-afef-a2f52c4f45cd tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:18.158430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-99cc8bc6-9bc0-447c-afef-a2f52c4f45cd tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:18.175393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99cc8bc6-9bc0-447c-afef-a2f52c4f45cd tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:18.175909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99cc8bc6-9bc0-447c-afef-a2f52c4f45cd tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:18.176428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99cc8bc6-9bc0-447c-afef-a2f52c4f45cd tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:18.177162 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99cc8bc6-9bc0-447c-afef-a2f52c4f45cd tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:18.181184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99cc8bc6-9bc0-447c-afef-a2f52c4f45cd tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:18.182114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99cc8bc6-9bc0-447c-afef-a2f52c4f45cd tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:18.256007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-86dd90ea-8225-4636-9d91-f408e1800aac tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:18.267221 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-86dd90ea-8225-4636-9d91-f408e1800aac tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1563 microversion: 2.1 time: 0.579819 Sep 07 13:22:18.268219 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3069/6172] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:17 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1563 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:22:18.300052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5cc84e55-237f-4474-8dab-ed0fb5cecd50 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:18.300904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5cc84e55-237f-4474-8dab-ed0fb5cecd50 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:18.309406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-99cc8bc6-9bc0-447c-afef-a2f52c4f45cd tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:18.322721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cc84e55-237f-4474-8dab-ed0fb5cecd50 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:18.323693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cc84e55-237f-4474-8dab-ed0fb5cecd50 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:18.324467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cc84e55-237f-4474-8dab-ed0fb5cecd50 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:18.325591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cc84e55-237f-4474-8dab-ed0fb5cecd50 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:18.326631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cc84e55-237f-4474-8dab-ed0fb5cecd50 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:18.327314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cc84e55-237f-4474-8dab-ed0fb5cecd50 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:18.333059 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-99cc8bc6-9bc0-447c-afef-a2f52c4f45cd tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1099 microversion: 2.1 time: 0.184903 Sep 07 13:22:18.344090 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3104/6173] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:18 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1099 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:18.358894 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e88ca3fb-2fc4-43d0-aee4-93653a365865 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:18.359447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e88ca3fb-2fc4-43d0-aee4-93653a365865 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] [instance: 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:18.368634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e88ca3fb-2fc4-43d0-aee4-93653a365865 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:18.369144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e88ca3fb-2fc4-43d0-aee4-93653a365865 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:18.369637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e88ca3fb-2fc4-43d0-aee4-93653a365865 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:18.370373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e88ca3fb-2fc4-43d0-aee4-93653a365865 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:18.371671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e88ca3fb-2fc4-43d0-aee4-93653a365865 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:18.373212 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e88ca3fb-2fc4-43d0-aee4-93653a365865 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:18.403621 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-e88ca3fb-2fc4-43d0-aee4-93653a365865 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] HTTP exception thrown: Instance 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 could not be found. Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e88ca3fb-2fc4-43d0-aee4-93653a365865 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Request method failure captured: Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 HTTP/1.1 Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJmgwbt2yW2bfS3N4Hc-zLwdylUXH1-qXsY1pMQqjSi3hI8SbKfAyamgsTNGDePU7161b-hIxOfQdOVnlEKvo466FXtKp9GRXatg5_C2WSuKxLvRTmgb3vSGtQszeTyJFwUFEfNc5tjwI3rmFwzVQ0Zm2EyKUxPILYPXSDjCSG9Mq2U Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: af013e51bd3f469a94e33b24c25830a9 Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TestServerBasicOps-395147439 Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/af013e51bd3f469a94e33b24c25830a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_af013e51bd3f469a94e33b24c25830a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/af013e51bd3f469a94e33b24c25830a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/af013e51bd3f469a94e33b24c25830a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TestServerBasicOps-395147439 Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: af013e51bd3f469a94e33b24c25830a9 Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestServerBasicOps-395147439 Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TestServerBasicOps-395147439-project Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5ba809cda0244f51aa7276d5ae9b5644 Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TestServerBasicOps-395147439-project Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 could not be found. Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '2fcfac58-c87d-4b0d-ab83-ee865b1fadd8'} Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 could not be found. Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:22:18.405781 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:22:18.421815 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 could not be found. Sep 07 13:22:18.421815 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:22:18.421815 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:22:18.421815 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:22:18.421815 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:22:18.421815 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:22:18.421815 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:22:18.421815 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:22:18.421815 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:22:18.421815 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 could not be found. Sep 07 13:22:18.421815 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:22:18.421815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e88ca3fb-2fc4-43d0-aee4-93653a365865 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Returning 404 to user: Instance 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:22:18.421815 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e88ca3fb-2fc4-43d0-aee4-93653a365865 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8" status: 404 len: 111 microversion: 2.1 time: 0.061115 Sep 07 13:22:18.421815 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3105/6174] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:22:18 2022] DELETE /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:22:18.421815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-19ca0062-2921-4bb7-a4ba-e36cd8e22458 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:18.421815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-19ca0062-2921-4bb7-a4ba-e36cd8e22458 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] [instance: 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:18.428569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19ca0062-2921-4bb7-a4ba-e36cd8e22458 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:18.429138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19ca0062-2921-4bb7-a4ba-e36cd8e22458 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:18.429695 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19ca0062-2921-4bb7-a4ba-e36cd8e22458 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:18.430493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19ca0062-2921-4bb7-a4ba-e36cd8e22458 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:18.432841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19ca0062-2921-4bb7-a4ba-e36cd8e22458 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:18.433387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19ca0062-2921-4bb7-a4ba-e36cd8e22458 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:18.441967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:18.455291 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-19ca0062-2921-4bb7-a4ba-e36cd8e22458 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] HTTP exception thrown: Instance 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 could not be found. Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-19ca0062-2921-4bb7-a4ba-e36cd8e22458 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Request method failure captured: Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 HTTP/1.1 Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJmgwbt2yW2bfS3N4Hc-zLwdylUXH1-qXsY1pMQqjSi3hI8SbKfAyamgsTNGDePU7161b-hIxOfQdOVnlEKvo466FXtKp9GRXatg5_C2WSuKxLvRTmgb3vSGtQszeTyJFwUFEfNc5tjwI3rmFwzVQ0Zm2EyKUxPILYPXSDjCSG9Mq2U Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: af013e51bd3f469a94e33b24c25830a9 Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TestServerBasicOps-395147439 Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/af013e51bd3f469a94e33b24c25830a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_af013e51bd3f469a94e33b24c25830a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/af013e51bd3f469a94e33b24c25830a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/af013e51bd3f469a94e33b24c25830a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TestServerBasicOps-395147439 Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: af013e51bd3f469a94e33b24c25830a9 Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestServerBasicOps-395147439 Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TestServerBasicOps-395147439-project Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 5ba809cda0244f51aa7276d5ae9b5644 Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TestServerBasicOps-395147439-project Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 could not be found. Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '2fcfac58-c87d-4b0d-ab83-ee865b1fadd8'} Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 could not be found. Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 could not be found. Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:22:18.457522 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:22:18.463215 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:22:18.463215 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:22:18.463215 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:22:18.463215 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:22:18.463215 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:22:18.463215 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 could not be found. Sep 07 13:22:18.463215 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:22:18.463215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-19ca0062-2921-4bb7-a4ba-e36cd8e22458 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Returning 404 to user: Instance 2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:22:18.463215 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-19ca0062-2921-4bb7-a4ba-e36cd8e22458 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] 10.222.0.16 "GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8" status: 404 len: 111 microversion: 2.1 time: 0.044437 Sep 07 13:22:18.463215 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3106/6175] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:18 2022] GET /compute/v2.1/servers/2fcfac58-c87d-4b0d-ab83-ee865b1fadd8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:22:18.585012 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5cc84e55-237f-4474-8dab-ed0fb5cecd50 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:18.611456 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5cc84e55-237f-4474-8dab-ed0fb5cecd50 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1563 microversion: 2.1 time: 0.315534 Sep 07 13:22:18.625725 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3070/6176] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:18 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1563 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:22:18.730803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5e9dbca9-9f7c-433e-a4ef-35a2294ce4b7 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] Calling method '.version_select at 0x7fc41d2d34c0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:18.768805 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5e9dbca9-9f7c-433e-a4ef-35a2294ce4b7 tempest-TestServerBasicOps-395147439 tempest-TestServerBasicOps-395147439-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1442745630" status: 202 len: 0 microversion: 2.1 time: 0.067730 Sep 07 13:22:18.790882 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3107/6177] 10.222.0.16 () {58 vars in 1254 bytes} [Wed Sep 7 13:22:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1442745630 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:22:19.370775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e6062621-3ca9-4638-814d-2374b2c0dbf9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:19.379068 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e6062621-3ca9-4638-814d-2374b2c0dbf9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:19.398636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6062621-3ca9-4638-814d-2374b2c0dbf9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:19.399396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6062621-3ca9-4638-814d-2374b2c0dbf9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:19.400065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6062621-3ca9-4638-814d-2374b2c0dbf9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:19.406481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6062621-3ca9-4638-814d-2374b2c0dbf9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:19.411788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6062621-3ca9-4638-814d-2374b2c0dbf9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:19.415371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6062621-3ca9-4638-814d-2374b2c0dbf9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:19.687764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e6062621-3ca9-4638-814d-2374b2c0dbf9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:19.718002 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e6062621-3ca9-4638-814d-2374b2c0dbf9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1173 microversion: 2.1 time: 0.354548 Sep 07 13:22:19.721070 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3071/6178] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:19 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1173 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:20.761928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-10fdbb95-4107-4c0a-b9eb-f79dca117228 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:20.762717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-10fdbb95-4107-4c0a-b9eb-f79dca117228 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:20.786088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10fdbb95-4107-4c0a-b9eb-f79dca117228 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:20.786599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10fdbb95-4107-4c0a-b9eb-f79dca117228 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:20.789341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10fdbb95-4107-4c0a-b9eb-f79dca117228 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:20.790374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10fdbb95-4107-4c0a-b9eb-f79dca117228 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:20.790866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10fdbb95-4107-4c0a-b9eb-f79dca117228 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:20.791534 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10fdbb95-4107-4c0a-b9eb-f79dca117228 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:21.213456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-10fdbb95-4107-4c0a-b9eb-f79dca117228 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:21.249582 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-10fdbb95-4107-4c0a-b9eb-f79dca117228 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1215 microversion: 2.1 time: 0.494452 Sep 07 13:22:21.271454 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3108/6179] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:20 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1215 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:22.303278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-149f875f-dfd9-416d-890f-9f13f7142594 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:22.304052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-149f875f-dfd9-416d-890f-9f13f7142594 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:22.321512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-149f875f-dfd9-416d-890f-9f13f7142594 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:22.341801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-149f875f-dfd9-416d-890f-9f13f7142594 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:22.341801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-149f875f-dfd9-416d-890f-9f13f7142594 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:22.341801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-149f875f-dfd9-416d-890f-9f13f7142594 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:22.341801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-149f875f-dfd9-416d-890f-9f13f7142594 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:22.341801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-149f875f-dfd9-416d-890f-9f13f7142594 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:23.180840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-149f875f-dfd9-416d-890f-9f13f7142594 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:23.193382 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-149f875f-dfd9-416d-890f-9f13f7142594 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1215 microversion: 2.1 time: 0.896256 Sep 07 13:22:23.194406 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3072/6180] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:22 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1215 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:24.245142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9f35737b-39ec-4be9-8980-f9c1a3714563 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:24.246518 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9f35737b-39ec-4be9-8980-f9c1a3714563 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:24.262221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f35737b-39ec-4be9-8980-f9c1a3714563 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:24.262789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f35737b-39ec-4be9-8980-f9c1a3714563 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:24.263271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f35737b-39ec-4be9-8980-f9c1a3714563 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:24.264412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f35737b-39ec-4be9-8980-f9c1a3714563 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:24.264552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f35737b-39ec-4be9-8980-f9c1a3714563 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:24.265303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f35737b-39ec-4be9-8980-f9c1a3714563 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:24.788585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-fd4a9636-8240-46f6-af53-544e0fc6207f req-06842299-b399-44b6-b2fd-a3cde5362e20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cb0e375-69cb-4cc9-8791-33c4e2db7089", "tag": "0222f50a-8e7c-4c74-93a4-c5767e7c50da"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:24.829980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fd4a9636-8240-46f6-af53-544e0fc6207f req-06842299-b399-44b6-b2fd-a3cde5362e20 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:24.831499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fd4a9636-8240-46f6-af53-544e0fc6207f req-06842299-b399-44b6-b2fd-a3cde5362e20 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:24.832165 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fd4a9636-8240-46f6-af53-544e0fc6207f req-06842299-b399-44b6-b2fd-a3cde5362e20 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:24.851506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:24.883407 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-fd4a9636-8240-46f6-af53-544e0fc6207f req-06842299-b399-44b6-b2fd-a3cde5362e20 service nova] Creating event network-changed:0222f50a-8e7c-4c74-93a4-c5767e7c50da for instance 9cb0e375-69cb-4cc9-8791-33c4e2db7089 on n-h2-852087-9 Sep 07 13:22:24.933567 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-fd4a9636-8240-46f6-af53-544e0fc6207f req-06842299-b399-44b6-b2fd-a3cde5362e20 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144575 Sep 07 13:22:24.933567 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3073/6181] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:22:25.258953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9f35737b-39ec-4be9-8980-f9c1a3714563 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:25.274990 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9f35737b-39ec-4be9-8980-f9c1a3714563 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1215 microversion: 2.1 time: 1.036120 Sep 07 13:22:25.281935 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3109/6182] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:24 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1215 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:22:25.607610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7c6b39f2-09a0-4abc-9589-94bdda0080fa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:25.608357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7c6b39f2-09a0-4abc-9589-94bdda0080fa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:25.624930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c6b39f2-09a0-4abc-9589-94bdda0080fa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:25.625437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c6b39f2-09a0-4abc-9589-94bdda0080fa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:25.625916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c6b39f2-09a0-4abc-9589-94bdda0080fa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:25.626655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c6b39f2-09a0-4abc-9589-94bdda0080fa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:25.627286 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c6b39f2-09a0-4abc-9589-94bdda0080fa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:25.627905 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c6b39f2-09a0-4abc-9589-94bdda0080fa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:26.288511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7c6b39f2-09a0-4abc-9589-94bdda0080fa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:26.309886 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7c6b39f2-09a0-4abc-9589-94bdda0080fa tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1563 microversion: 2.1 time: 0.706917 Sep 07 13:22:26.321904 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3074/6183] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:25 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1563 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:26.332471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8deaa4a0-d815-42a2-a478-fc655d42a057 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:26.337384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8deaa4a0-d815-42a2-a478-fc655d42a057 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:26.352060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:26.390205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:26.396468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8deaa4a0-d815-42a2-a478-fc655d42a057 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:26.397676 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8deaa4a0-d815-42a2-a478-fc655d42a057 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:26.398947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8deaa4a0-d815-42a2-a478-fc655d42a057 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:26.399553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8deaa4a0-d815-42a2-a478-fc655d42a057 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:26.400034 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8deaa4a0-d815-42a2-a478-fc655d42a057 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:26.404136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8deaa4a0-d815-42a2-a478-fc655d42a057 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:26.977784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-65173038-1071-40b4-b8b0-406edab81447 req-57fab0f3-eea4-4d6c-9adf-fde3b1114f17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431", "tag": "4de6c447-da78-427b-b139-6c02f7484224"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:27.002355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8deaa4a0-d815-42a2-a478-fc655d42a057 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:27.019668 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8deaa4a0-d815-42a2-a478-fc655d42a057 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1215 microversion: 2.1 time: 0.692491 Sep 07 13:22:27.034617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-65173038-1071-40b4-b8b0-406edab81447 req-57fab0f3-eea4-4d6c-9adf-fde3b1114f17 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:27.035128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-65173038-1071-40b4-b8b0-406edab81447 req-57fab0f3-eea4-4d6c-9adf-fde3b1114f17 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:27.035572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-65173038-1071-40b4-b8b0-406edab81447 req-57fab0f3-eea4-4d6c-9adf-fde3b1114f17 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:27.038311 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3110/6184] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:26 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1215 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:27.070999 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-65173038-1071-40b4-b8b0-406edab81447 req-57fab0f3-eea4-4d6c-9adf-fde3b1114f17 service nova] Creating event network-changed:4de6c447-da78-427b-b139-6c02f7484224 for instance 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 on n-h1-852087-9 Sep 07 13:22:27.082200 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-65173038-1071-40b4-b8b0-406edab81447 req-57fab0f3-eea4-4d6c-9adf-fde3b1114f17 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109194 Sep 07 13:22:27.082883 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3075/6185] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:22:28.046915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-916d4c41-db01-4f7b-b079-9b631c6453ef tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:28.048323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-916d4c41-db01-4f7b-b079-9b631c6453ef tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:28.058781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-916d4c41-db01-4f7b-b079-9b631c6453ef tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:28.059595 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-916d4c41-db01-4f7b-b079-9b631c6453ef tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:28.060210 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-916d4c41-db01-4f7b-b079-9b631c6453ef tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:28.061116 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-916d4c41-db01-4f7b-b079-9b631c6453ef tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:28.061948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-916d4c41-db01-4f7b-b079-9b631c6453ef tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:28.062561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-916d4c41-db01-4f7b-b079-9b631c6453ef tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:28.229748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-916d4c41-db01-4f7b-b079-9b631c6453ef tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:28.243819 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-916d4c41-db01-4f7b-b079-9b631c6453ef tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1215 microversion: 2.1 time: 0.203893 Sep 07 13:22:28.260802 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3111/6186] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:28 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1215 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:29.269384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-18e7538d-bc8a-469a-bf5f-d853794f06eb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:29.271569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-18e7538d-bc8a-469a-bf5f-d853794f06eb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:29.272521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:29.274553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=50 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:29.283994 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18e7538d-bc8a-469a-bf5f-d853794f06eb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:29.284801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18e7538d-bc8a-469a-bf5f-d853794f06eb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:29.285567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18e7538d-bc8a-469a-bf5f-d853794f06eb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:29.286513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18e7538d-bc8a-469a-bf5f-d853794f06eb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:29.287016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18e7538d-bc8a-469a-bf5f-d853794f06eb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:29.287770 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18e7538d-bc8a-469a-bf5f-d853794f06eb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:29.620932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-18e7538d-bc8a-469a-bf5f-d853794f06eb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:29.631283 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-18e7538d-bc8a-469a-bf5f-d853794f06eb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1215 microversion: 2.1 time: 0.366887 Sep 07 13:22:29.631999 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3076/6187] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:29 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1215 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:30.661729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b9a5550e-a3cb-493f-82aa-8f33ebb5d010 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:30.662458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b9a5550e-a3cb-493f-82aa-8f33ebb5d010 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:30.670923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:30.689913 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9a5550e-a3cb-493f-82aa-8f33ebb5d010 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:30.692966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9a5550e-a3cb-493f-82aa-8f33ebb5d010 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:30.693528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9a5550e-a3cb-493f-82aa-8f33ebb5d010 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:30.694520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9a5550e-a3cb-493f-82aa-8f33ebb5d010 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:30.696209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9a5550e-a3cb-493f-82aa-8f33ebb5d010 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:30.700169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b9a5550e-a3cb-493f-82aa-8f33ebb5d010 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:31.276383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b9a5550e-a3cb-493f-82aa-8f33ebb5d010 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:31.286768 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b9a5550e-a3cb-493f-82aa-8f33ebb5d010 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1215 microversion: 2.1 time: 0.633304 Sep 07 13:22:31.288523 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3112/6188] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:30 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1215 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:32.316353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b5268980-772f-4935-8b7a-31142fbfe250 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:32.318035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b5268980-772f-4935-8b7a-31142fbfe250 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:32.334334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5268980-772f-4935-8b7a-31142fbfe250 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:32.344113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5268980-772f-4935-8b7a-31142fbfe250 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:32.345004 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5268980-772f-4935-8b7a-31142fbfe250 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:32.352564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5268980-772f-4935-8b7a-31142fbfe250 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:32.353958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5268980-772f-4935-8b7a-31142fbfe250 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:32.354607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5268980-772f-4935-8b7a-31142fbfe250 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:32.887134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b5268980-772f-4935-8b7a-31142fbfe250 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:32.929413 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b5268980-772f-4935-8b7a-31142fbfe250 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1203 microversion: 2.1 time: 0.617845 Sep 07 13:22:32.930404 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3077/6189] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:32 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1203 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:33.970663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6fcf1c01-cbd3-42db-86c3-7d1199bed5b8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:33.971899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6fcf1c01-cbd3-42db-86c3-7d1199bed5b8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:33.982947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fcf1c01-cbd3-42db-86c3-7d1199bed5b8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:33.984011 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fcf1c01-cbd3-42db-86c3-7d1199bed5b8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:33.984764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fcf1c01-cbd3-42db-86c3-7d1199bed5b8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:33.985945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fcf1c01-cbd3-42db-86c3-7d1199bed5b8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:33.986634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fcf1c01-cbd3-42db-86c3-7d1199bed5b8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:33.988253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fcf1c01-cbd3-42db-86c3-7d1199bed5b8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:34.273279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6fcf1c01-cbd3-42db-86c3-7d1199bed5b8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:34.305379 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6fcf1c01-cbd3-42db-86c3-7d1199bed5b8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1203 microversion: 2.1 time: 0.340143 Sep 07 13:22:34.308457 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3113/6190] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:33 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1203 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:22:35.349395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f69d2eba-4274-450e-b3d7-9604cdcd788d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:35.352777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f69d2eba-4274-450e-b3d7-9604cdcd788d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:35.370128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f69d2eba-4274-450e-b3d7-9604cdcd788d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:35.371184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f69d2eba-4274-450e-b3d7-9604cdcd788d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:35.372131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f69d2eba-4274-450e-b3d7-9604cdcd788d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:35.373629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f69d2eba-4274-450e-b3d7-9604cdcd788d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:35.374645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f69d2eba-4274-450e-b3d7-9604cdcd788d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:35.375985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f69d2eba-4274-450e-b3d7-9604cdcd788d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:35.614090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f69d2eba-4274-450e-b3d7-9604cdcd788d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:35.640644 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f69d2eba-4274-450e-b3d7-9604cdcd788d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1203 microversion: 2.1 time: 0.310644 Sep 07 13:22:35.642033 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3078/6191] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:35 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1203 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:36.680844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0547b2f8-e12a-40cd-b992-8f68b9101440 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:36.685194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0547b2f8-e12a-40cd-b992-8f68b9101440 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:36.700219 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0547b2f8-e12a-40cd-b992-8f68b9101440 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:36.700722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0547b2f8-e12a-40cd-b992-8f68b9101440 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:36.701169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0547b2f8-e12a-40cd-b992-8f68b9101440 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:36.701952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0547b2f8-e12a-40cd-b992-8f68b9101440 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:36.702420 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0547b2f8-e12a-40cd-b992-8f68b9101440 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:36.702860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0547b2f8-e12a-40cd-b992-8f68b9101440 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:37.011841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0547b2f8-e12a-40cd-b992-8f68b9101440 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:37.026053 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0547b2f8-e12a-40cd-b992-8f68b9101440 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1203 microversion: 2.1 time: 0.354042 Sep 07 13:22:37.028584 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3114/6192] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:36 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1203 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:38.053614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b79fe07a-70e3-4118-a783-dda9a048600f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:38.055450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b79fe07a-70e3-4118-a783-dda9a048600f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:38.070887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b79fe07a-70e3-4118-a783-dda9a048600f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:38.072415 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b79fe07a-70e3-4118-a783-dda9a048600f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:38.073275 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b79fe07a-70e3-4118-a783-dda9a048600f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:38.078447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b79fe07a-70e3-4118-a783-dda9a048600f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:38.079209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b79fe07a-70e3-4118-a783-dda9a048600f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:38.079848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b79fe07a-70e3-4118-a783-dda9a048600f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:38.545048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b79fe07a-70e3-4118-a783-dda9a048600f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:38.579525 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b79fe07a-70e3-4118-a783-dda9a048600f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1203 microversion: 2.1 time: 0.530703 Sep 07 13:22:38.592537 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3079/6193] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:38 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1203 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:39.635142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5575ec06-0229-4b74-8a31-4df4ac9d0996 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:39.636205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5575ec06-0229-4b74-8a31-4df4ac9d0996 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:39.700088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5575ec06-0229-4b74-8a31-4df4ac9d0996 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:39.700871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5575ec06-0229-4b74-8a31-4df4ac9d0996 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:39.702402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5575ec06-0229-4b74-8a31-4df4ac9d0996 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:39.703793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5575ec06-0229-4b74-8a31-4df4ac9d0996 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:39.704619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5575ec06-0229-4b74-8a31-4df4ac9d0996 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:39.705765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5575ec06-0229-4b74-8a31-4df4ac9d0996 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:40.520948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5575ec06-0229-4b74-8a31-4df4ac9d0996 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:40.535252 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5575ec06-0229-4b74-8a31-4df4ac9d0996 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1203 microversion: 2.1 time: 0.907937 Sep 07 13:22:40.540371 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3115/6194] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:39 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1203 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:41.571077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f92f197c-3437-4b3c-b51d-d67a3ffecd66 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:41.571958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f92f197c-3437-4b3c-b51d-d67a3ffecd66 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:41.584963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f92f197c-3437-4b3c-b51d-d67a3ffecd66 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:41.585468 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f92f197c-3437-4b3c-b51d-d67a3ffecd66 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:41.585950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f92f197c-3437-4b3c-b51d-d67a3ffecd66 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:41.586694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f92f197c-3437-4b3c-b51d-d67a3ffecd66 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:41.592486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f92f197c-3437-4b3c-b51d-d67a3ffecd66 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:41.593261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f92f197c-3437-4b3c-b51d-d67a3ffecd66 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:41.916517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f92f197c-3437-4b3c-b51d-d67a3ffecd66 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:41.933020 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f92f197c-3437-4b3c-b51d-d67a3ffecd66 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1203 microversion: 2.1 time: 0.366000 Sep 07 13:22:41.933720 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3080/6195] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:41 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1203 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:42.698379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-81e1aa0b-10e1-4597-9483-edf032eb25a1 req-6ce3d8a8-308c-4164-a70c-2eab22610e95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cb0e375-69cb-4cc9-8791-33c4e2db7089", "name": "network-vif-plugged", "status": "completed", "tag": "0222f50a-8e7c-4c74-93a4-c5767e7c50da"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:42.720740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-81e1aa0b-10e1-4597-9483-edf032eb25a1 req-6ce3d8a8-308c-4164-a70c-2eab22610e95 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:42.721235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-81e1aa0b-10e1-4597-9483-edf032eb25a1 req-6ce3d8a8-308c-4164-a70c-2eab22610e95 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:42.721718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-81e1aa0b-10e1-4597-9483-edf032eb25a1 req-6ce3d8a8-308c-4164-a70c-2eab22610e95 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:42.745889 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-81e1aa0b-10e1-4597-9483-edf032eb25a1 req-6ce3d8a8-308c-4164-a70c-2eab22610e95 service nova] Creating event network-vif-plugged:0222f50a-8e7c-4c74-93a4-c5767e7c50da for instance 9cb0e375-69cb-4cc9-8791-33c4e2db7089 on n-h2-852087-9 Sep 07 13:22:42.766699 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-81e1aa0b-10e1-4597-9483-edf032eb25a1 req-6ce3d8a8-308c-4164-a70c-2eab22610e95 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089558 Sep 07 13:22:42.767638 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3116/6196] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:22:42.965002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-74568020-07dc-4bdc-bb97-6d119c279f97 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:42.965874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-74568020-07dc-4bdc-bb97-6d119c279f97 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:42.990501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74568020-07dc-4bdc-bb97-6d119c279f97 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:42.992820 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74568020-07dc-4bdc-bb97-6d119c279f97 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:42.997876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74568020-07dc-4bdc-bb97-6d119c279f97 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:42.999351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74568020-07dc-4bdc-bb97-6d119c279f97 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:43.000088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74568020-07dc-4bdc-bb97-6d119c279f97 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:43.000679 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74568020-07dc-4bdc-bb97-6d119c279f97 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:43.323274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-74568020-07dc-4bdc-bb97-6d119c279f97 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:43.335784 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-74568020-07dc-4bdc-bb97-6d119c279f97 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1203 microversion: 2.1 time: 0.376810 Sep 07 13:22:43.337966 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3081/6197] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:42 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1203 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:44.365142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-295947d7-33f9-4496-950e-d5da6b320373 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:44.366064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-295947d7-33f9-4496-950e-d5da6b320373 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:44.383062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-295947d7-33f9-4496-950e-d5da6b320373 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:44.383841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-295947d7-33f9-4496-950e-d5da6b320373 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:44.384289 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-295947d7-33f9-4496-950e-d5da6b320373 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:44.385591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-295947d7-33f9-4496-950e-d5da6b320373 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:44.386467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-295947d7-33f9-4496-950e-d5da6b320373 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:44.387257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-295947d7-33f9-4496-950e-d5da6b320373 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:44.652260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-295947d7-33f9-4496-950e-d5da6b320373 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:44.664456 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-295947d7-33f9-4496-950e-d5da6b320373 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1391 microversion: 2.1 time: 0.305866 Sep 07 13:22:44.678647 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3117/6198] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:44 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1391 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:44.689657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-06fd7f86-2de2-486b-a7a4-aa2a54c915db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:44.690492 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-06fd7f86-2de2-486b-a7a4-aa2a54c915db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:44.703266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06fd7f86-2de2-486b-a7a4-aa2a54c915db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:44.703921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06fd7f86-2de2-486b-a7a4-aa2a54c915db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:44.704631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06fd7f86-2de2-486b-a7a4-aa2a54c915db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:44.709398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06fd7f86-2de2-486b-a7a4-aa2a54c915db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:44.710642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06fd7f86-2de2-486b-a7a4-aa2a54c915db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:44.713130 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06fd7f86-2de2-486b-a7a4-aa2a54c915db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:45.085472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-06fd7f86-2de2-486b-a7a4-aa2a54c915db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:45.105181 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-06fd7f86-2de2-486b-a7a4-aa2a54c915db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1391 microversion: 2.1 time: 0.419253 Sep 07 13:22:45.107120 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3082/6199] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:44 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1391 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:45.140987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-95e3c7c3-ec24-4a10-80c8-a196a98afd92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:45.141864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-95e3c7c3-ec24-4a10-80c8-a196a98afd92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:45.165045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95e3c7c3-ec24-4a10-80c8-a196a98afd92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:45.166074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95e3c7c3-ec24-4a10-80c8-a196a98afd92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:45.167051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95e3c7c3-ec24-4a10-80c8-a196a98afd92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:45.170252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95e3c7c3-ec24-4a10-80c8-a196a98afd92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:45.171362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95e3c7c3-ec24-4a10-80c8-a196a98afd92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:45.172757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-95e3c7c3-ec24-4a10-80c8-a196a98afd92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:45.436965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-95e3c7c3-ec24-4a10-80c8-a196a98afd92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:45.446961 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-95e3c7c3-ec24-4a10-80c8-a196a98afd92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1391 microversion: 2.1 time: 0.320587 Sep 07 13:22:45.465376 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3118/6200] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:45 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1391 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:45.474540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e126cc6c-fc7d-4a4c-a292-bc14bd9a04ef tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:45.475214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e126cc6c-fc7d-4a4c-a292-bc14bd9a04ef tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:45.482901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e126cc6c-fc7d-4a4c-a292-bc14bd9a04ef tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:45.483669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e126cc6c-fc7d-4a4c-a292-bc14bd9a04ef tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:45.484370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e126cc6c-fc7d-4a4c-a292-bc14bd9a04ef tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:45.485510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e126cc6c-fc7d-4a4c-a292-bc14bd9a04ef tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:45.486152 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e126cc6c-fc7d-4a4c-a292-bc14bd9a04ef tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:45.486737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e126cc6c-fc7d-4a4c-a292-bc14bd9a04ef tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:45.519935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e126cc6c-fc7d-4a4c-a292-bc14bd9a04ef tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:22:45.680964 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e126cc6c-fc7d-4a4c-a292-bc14bd9a04ef tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 204 len: 0 microversion: 2.1 time: 0.211389 Sep 07 13:22:45.693251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-15af8014-32ba-46e1-907b-2b40125ffa73 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:45.694159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-15af8014-32ba-46e1-907b-2b40125ffa73 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:45.698037 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3083/6201] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:22:45 2022] DELETE /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:22:45.702700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15af8014-32ba-46e1-907b-2b40125ffa73 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:45.703548 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15af8014-32ba-46e1-907b-2b40125ffa73 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:45.704392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15af8014-32ba-46e1-907b-2b40125ffa73 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:45.705732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15af8014-32ba-46e1-907b-2b40125ffa73 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:45.706892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15af8014-32ba-46e1-907b-2b40125ffa73 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:45.707685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-15af8014-32ba-46e1-907b-2b40125ffa73 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:45.986382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-15af8014-32ba-46e1-907b-2b40125ffa73 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:45.997755 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-15af8014-32ba-46e1-907b-2b40125ffa73 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1397 microversion: 2.1 time: 0.310381 Sep 07 13:22:45.999118 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3119/6202] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:45 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1397 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:47.028289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-de898e8f-90f2-42fe-84f7-ab6ce969d58e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:47.029206 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-de898e8f-90f2-42fe-84f7-ab6ce969d58e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:47.041700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de898e8f-90f2-42fe-84f7-ab6ce969d58e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:47.042504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de898e8f-90f2-42fe-84f7-ab6ce969d58e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:47.043111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de898e8f-90f2-42fe-84f7-ab6ce969d58e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:47.044003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de898e8f-90f2-42fe-84f7-ab6ce969d58e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:47.044649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de898e8f-90f2-42fe-84f7-ab6ce969d58e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:47.045288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de898e8f-90f2-42fe-84f7-ab6ce969d58e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:47.332762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-de898e8f-90f2-42fe-84f7-ab6ce969d58e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:47.347912 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-de898e8f-90f2-42fe-84f7-ab6ce969d58e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1397 microversion: 2.1 time: 0.324066 Sep 07 13:22:47.349303 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3084/6203] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:47 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1397 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:48.374290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-24f14f0d-9da3-44ed-b8d9-dbd7cf02a2db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:48.374290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-24f14f0d-9da3-44ed-b8d9-dbd7cf02a2db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:48.384146 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24f14f0d-9da3-44ed-b8d9-dbd7cf02a2db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:48.401137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24f14f0d-9da3-44ed-b8d9-dbd7cf02a2db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:48.401137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24f14f0d-9da3-44ed-b8d9-dbd7cf02a2db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:48.401137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24f14f0d-9da3-44ed-b8d9-dbd7cf02a2db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:48.401137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24f14f0d-9da3-44ed-b8d9-dbd7cf02a2db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:48.401137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-24f14f0d-9da3-44ed-b8d9-dbd7cf02a2db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:48.491171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-24f14f0d-9da3-44ed-b8d9-dbd7cf02a2db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:48.509273 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-24f14f0d-9da3-44ed-b8d9-dbd7cf02a2db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1355 microversion: 2.1 time: 0.140477 Sep 07 13:22:48.512677 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3120/6204] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:48 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1355 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:48.552548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-27368e42-f5f3-4f87-8d49-d2857fe6506e req-bfaf881c-c9a0-4444-b7a3-674baea959b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cb0e375-69cb-4cc9-8791-33c4e2db7089", "name": "network-vif-deleted", "tag": "0222f50a-8e7c-4c74-93a4-c5767e7c50da"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:22:48.586404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-27368e42-f5f3-4f87-8d49-d2857fe6506e req-bfaf881c-c9a0-4444-b7a3-674baea959b5 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:48.587193 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-27368e42-f5f3-4f87-8d49-d2857fe6506e req-bfaf881c-c9a0-4444-b7a3-674baea959b5 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:48.592597 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-27368e42-f5f3-4f87-8d49-d2857fe6506e req-bfaf881c-c9a0-4444-b7a3-674baea959b5 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:48.613950 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-27368e42-f5f3-4f87-8d49-d2857fe6506e req-bfaf881c-c9a0-4444-b7a3-674baea959b5 service nova] Creating event network-vif-deleted:0222f50a-8e7c-4c74-93a4-c5767e7c50da for instance 9cb0e375-69cb-4cc9-8791-33c4e2db7089 on n-h2-852087-9 Sep 07 13:22:48.623876 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-27368e42-f5f3-4f87-8d49-d2857fe6506e req-bfaf881c-c9a0-4444-b7a3-674baea959b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075026 Sep 07 13:22:48.630078 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3085/6205] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:22:49.538799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ee5791d4-930a-4a32-a1aa-61fe9d0ef67d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:49.539863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ee5791d4-930a-4a32-a1aa-61fe9d0ef67d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:49.556888 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee5791d4-930a-4a32-a1aa-61fe9d0ef67d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:49.562383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee5791d4-930a-4a32-a1aa-61fe9d0ef67d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:49.565046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee5791d4-930a-4a32-a1aa-61fe9d0ef67d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:49.566130 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee5791d4-930a-4a32-a1aa-61fe9d0ef67d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:49.566833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee5791d4-930a-4a32-a1aa-61fe9d0ef67d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:49.569312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee5791d4-930a-4a32-a1aa-61fe9d0ef67d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:49.574158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=75 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:49.871092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ee5791d4-930a-4a32-a1aa-61fe9d0ef67d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:49.885326 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ee5791d4-930a-4a32-a1aa-61fe9d0ef67d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1188 microversion: 2.1 time: 0.350930 Sep 07 13:22:49.885326 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3121/6206] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:49 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1188 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:22:50.924412 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e877de52-2c06-416d-827f-276e5948f3b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:50.925383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e877de52-2c06-416d-827f-276e5948f3b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:50.958359 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e877de52-2c06-416d-827f-276e5948f3b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:50.958996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e877de52-2c06-416d-827f-276e5948f3b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:50.959548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e877de52-2c06-416d-827f-276e5948f3b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:50.961870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e877de52-2c06-416d-827f-276e5948f3b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:50.962739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e877de52-2c06-416d-827f-276e5948f3b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:50.963951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e877de52-2c06-416d-827f-276e5948f3b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:51.117444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e877de52-2c06-416d-827f-276e5948f3b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:51.129979 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e877de52-2c06-416d-827f-276e5948f3b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1188 microversion: 2.1 time: 0.216262 Sep 07 13:22:51.134321 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3086/6207] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:50 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1188 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:52.172030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e0b80275-0525-452b-84f0-09a1d2441326 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:52.173093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e0b80275-0525-452b-84f0-09a1d2441326 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:52.217137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0b80275-0525-452b-84f0-09a1d2441326 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:52.218648 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0b80275-0525-452b-84f0-09a1d2441326 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:52.219419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0b80275-0525-452b-84f0-09a1d2441326 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:52.240734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0b80275-0525-452b-84f0-09a1d2441326 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:52.241746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0b80275-0525-452b-84f0-09a1d2441326 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:52.242533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0b80275-0525-452b-84f0-09a1d2441326 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:52.659094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e0b80275-0525-452b-84f0-09a1d2441326 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:52.685583 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e0b80275-0525-452b-84f0-09a1d2441326 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1188 microversion: 2.1 time: 0.522247 Sep 07 13:22:52.686226 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3122/6208] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:52 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1188 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:53.710381 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-79e79e8b-05ba-4626-ab7e-210c8240bb5a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:53.711644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-79e79e8b-05ba-4626-ab7e-210c8240bb5a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:53.719441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79e79e8b-05ba-4626-ab7e-210c8240bb5a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:53.723216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79e79e8b-05ba-4626-ab7e-210c8240bb5a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:53.724370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79e79e8b-05ba-4626-ab7e-210c8240bb5a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:53.725364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79e79e8b-05ba-4626-ab7e-210c8240bb5a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:53.727094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79e79e8b-05ba-4626-ab7e-210c8240bb5a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:53.727873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79e79e8b-05ba-4626-ab7e-210c8240bb5a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:53.804905 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-79e79e8b-05ba-4626-ab7e-210c8240bb5a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:53.822659 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-79e79e8b-05ba-4626-ab7e-210c8240bb5a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1188 microversion: 2.1 time: 0.117705 Sep 07 13:22:53.839261 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3087/6209] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:53 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1188 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:54.848792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c2d4fa6c-37f2-4b51-82d7-bfb193acafc8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:54.849433 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c2d4fa6c-37f2-4b51-82d7-bfb193acafc8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:54.865445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2d4fa6c-37f2-4b51-82d7-bfb193acafc8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:54.866689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2d4fa6c-37f2-4b51-82d7-bfb193acafc8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:54.870547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2d4fa6c-37f2-4b51-82d7-bfb193acafc8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:54.871863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2d4fa6c-37f2-4b51-82d7-bfb193acafc8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:54.872719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2d4fa6c-37f2-4b51-82d7-bfb193acafc8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:54.886580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2d4fa6c-37f2-4b51-82d7-bfb193acafc8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:54.978817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c2d4fa6c-37f2-4b51-82d7-bfb193acafc8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:54.993554 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c2d4fa6c-37f2-4b51-82d7-bfb193acafc8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1188 microversion: 2.1 time: 0.149009 Sep 07 13:22:54.995143 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3123/6210] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:54 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1188 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:56.019670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-917a007e-a8ef-4431-9885-08e9b2e05fb2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:56.021123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-917a007e-a8ef-4431-9885-08e9b2e05fb2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:56.051571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-917a007e-a8ef-4431-9885-08e9b2e05fb2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:56.052074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-917a007e-a8ef-4431-9885-08e9b2e05fb2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:56.052531 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-917a007e-a8ef-4431-9885-08e9b2e05fb2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:56.053224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-917a007e-a8ef-4431-9885-08e9b2e05fb2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:56.053741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-917a007e-a8ef-4431-9885-08e9b2e05fb2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:56.062978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-917a007e-a8ef-4431-9885-08e9b2e05fb2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:56.069371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:56.105151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-917a007e-a8ef-4431-9885-08e9b2e05fb2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:56.105684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-917a007e-a8ef-4431-9885-08e9b2e05fb2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:56.106120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-917a007e-a8ef-4431-9885-08e9b2e05fb2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:56.106570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-917a007e-a8ef-4431-9885-08e9b2e05fb2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lazy-loading 'fault' on Instance uuid 9cb0e375-69cb-4cc9-8791-33c4e2db7089 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:22:56.156686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-917a007e-a8ef-4431-9885-08e9b2e05fb2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:22:56.176993 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-917a007e-a8ef-4431-9885-08e9b2e05fb2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 200 len: 1193 microversion: 2.1 time: 0.163718 Sep 07 13:22:56.178931 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3088/6211] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:56 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 1193 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:22:57.205785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b5a797f1-e513-4b42-b72f-94046b9f7886 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:22:57.207262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b5a797f1-e513-4b42-b72f-94046b9f7886 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 9cb0e375-69cb-4cc9-8791-33c4e2db7089] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:22:57.216856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5a797f1-e513-4b42-b72f-94046b9f7886 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:57.217289 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5a797f1-e513-4b42-b72f-94046b9f7886 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:57.217946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5a797f1-e513-4b42-b72f-94046b9f7886 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:57.218577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5a797f1-e513-4b42-b72f-94046b9f7886 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:22:57.219079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5a797f1-e513-4b42-b72f-94046b9f7886 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:22:57.219507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b5a797f1-e513-4b42-b72f-94046b9f7886 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:22:57.247595 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-b5a797f1-e513-4b42-b72f-94046b9f7886 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] HTTP exception thrown: Instance 9cb0e375-69cb-4cc9-8791-33c4e2db7089 could not be found. Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b5a797f1-e513-4b42-b72f-94046b9f7886 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Request method failure captured: Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 HTTP/1.1 Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJrKtGg8mTUS8TVRSUKjETENKgBfLqI2oUMffXPZtsQfHAGfvsCSe64IHdsu1gAtG3a2XlfVJiJMXBeXoxoYCkAhaL6z1XH8667-SWfmJ5tkR4WMw-DlaHMfOvoGzJHrmW4OvMTJQgI9_G9o9R2vidCDnbLRABw8OsiYOeqYc9Klp2E Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 90d330a2d2ad4295873277de2d649182 Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 9cb0e375-69cb-4cc9-8791-33c4e2db7089 could not be found. Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '9cb0e375-69cb-4cc9-8791-33c4e2db7089'} Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cb0e375-69cb-4cc9-8791-33c4e2db7089 could not be found. Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cb0e375-69cb-4cc9-8791-33c4e2db7089 could not be found. Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:22:57.250773 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:22:57.255963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:22:57.255963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:22:57.255963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:22:57.255963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:22:57.255963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:22:57.255963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cb0e375-69cb-4cc9-8791-33c4e2db7089 could not be found. Sep 07 13:22:57.255963 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:22:57.255963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b5a797f1-e513-4b42-b72f-94046b9f7886 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Returning 404 to user: Instance 9cb0e375-69cb-4cc9-8791-33c4e2db7089 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:22:57.255963 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b5a797f1-e513-4b42-b72f-94046b9f7886 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089" status: 404 len: 111 microversion: 2.1 time: 0.051706 Sep 07 13:22:57.263104 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3124/6212] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:22:57 2022] GET /compute/v2.1/servers/9cb0e375-69cb-4cc9-8791-33c4e2db7089 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:23:03.059929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b9bef5d7-ca1b-477c-a590-a531304a2adc tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:23:03.063579 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b9bef5d7-ca1b-477c-a590-a531304a2adc tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:03.072025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:03.076573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9bef5d7-ca1b-477c-a590-a531304a2adc tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:03.077335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9bef5d7-ca1b-477c-a590-a531304a2adc tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:03.078321 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9bef5d7-ca1b-477c-a590-a531304a2adc tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:03.079623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9bef5d7-ca1b-477c-a590-a531304a2adc tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:03.080479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9bef5d7-ca1b-477c-a590-a531304a2adc tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:03.081350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9bef5d7-ca1b-477c-a590-a531304a2adc tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:03.174966 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b9bef5d7-ca1b-477c-a590-a531304a2adc tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "POST /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431/action" status: 200 len: 24553 microversion: 2.1 time: 0.119732 Sep 07 13:23:03.176506 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3089/6213] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:23:03 2022] POST /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431/action => generated 24553 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 13:23:25.976301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6944e6eb-ebd2-4a2d-abf9-ba5f2b9b077b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1169738354", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8dc827e1-5fa8-4bcc-be24-c2df43eb6da0", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "7f5512e3-cd6c-43c3-ae4c-0cca06e090be"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:23:25.993211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=25 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:25.994864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=19 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:26.120029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-6944e6eb-ebd2-4a2d-abf9-ba5f2b9b077b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] validate_networks() for [('7f5512e3-cd6c-43c3-ae4c-0cca06e090be', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:23:26.640022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-6944e6eb-ebd2-4a2d-abf9-ba5f2b9b077b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:23:26.640492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-6944e6eb-ebd2-4a2d-abf9-ba5f2b9b077b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:23:26.640967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-6944e6eb-ebd2-4a2d-abf9-ba5f2b9b077b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:23:26.641583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-6944e6eb-ebd2-4a2d-abf9-ba5f2b9b077b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:23:26.642215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-6944e6eb-ebd2-4a2d-abf9-ba5f2b9b077b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:23:26.654044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6944e6eb-ebd2-4a2d-abf9-ba5f2b9b077b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:26.654593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6944e6eb-ebd2-4a2d-abf9-ba5f2b9b077b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:26.658036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6944e6eb-ebd2-4a2d-abf9-ba5f2b9b077b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:26.659165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6944e6eb-ebd2-4a2d-abf9-ba5f2b9b077b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:26.659840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6944e6eb-ebd2-4a2d-abf9-ba5f2b9b077b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:26.660555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6944e6eb-ebd2-4a2d-abf9-ba5f2b9b077b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:26.684442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-6944e6eb-ebd2-4a2d-abf9-ba5f2b9b077b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Getting quotas for project b97b8dd299f145888f90fbf60321cd18. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:23:26.691796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-6944e6eb-ebd2-4a2d-abf9-ba5f2b9b077b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Getting quotas for user 90d330a2d2ad4295873277de2d649182 and project b97b8dd299f145888f90fbf60321cd18. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:23:26.706837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6944e6eb-ebd2-4a2d-abf9-ba5f2b9b077b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:23:26.708981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6944e6eb-ebd2-4a2d-abf9-ba5f2b9b077b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='8dc827e1-5fa8-4bcc-be24-c2df43eb6da0',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:23:26.802046 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6944e6eb-ebd2-4a2d-abf9-ba5f2b9b077b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.830888 Sep 07 13:23:26.812384 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3125/6214] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:23:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:23:26.819296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f57a2339-583c-4d5b-998d-640f0000d112 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:26.820051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f57a2339-583c-4d5b-998d-640f0000d112 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:26.825876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:26.827291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=11 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:27.194498 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f57a2339-583c-4d5b-998d-640f0000d112 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:27.202546 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f57a2339-583c-4d5b-998d-640f0000d112 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1057 microversion: 2.1 time: 0.388362 Sep 07 13:23:27.203146 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3090/6215] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:26 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1057 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:23:28.226908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4787e01a-af6d-40c6-8d89-51c3ee321468 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:28.227665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4787e01a-af6d-40c6-8d89-51c3ee321468 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:28.234471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4787e01a-af6d-40c6-8d89-51c3ee321468 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:28.234999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4787e01a-af6d-40c6-8d89-51c3ee321468 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:28.235512 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4787e01a-af6d-40c6-8d89-51c3ee321468 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:28.236157 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4787e01a-af6d-40c6-8d89-51c3ee321468 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:28.236622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4787e01a-af6d-40c6-8d89-51c3ee321468 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:28.237184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4787e01a-af6d-40c6-8d89-51c3ee321468 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:28.332689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4787e01a-af6d-40c6-8d89-51c3ee321468 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:28.342724 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4787e01a-af6d-40c6-8d89-51c3ee321468 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1109 microversion: 2.1 time: 0.120758 Sep 07 13:23:28.344007 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3126/6216] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:28 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1109 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:29.370329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b67145a7-38d5-49e1-a7e3-ca1b0335d25a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:29.374807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b67145a7-38d5-49e1-a7e3-ca1b0335d25a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:29.383705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b67145a7-38d5-49e1-a7e3-ca1b0335d25a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:29.384720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b67145a7-38d5-49e1-a7e3-ca1b0335d25a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:29.397628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b67145a7-38d5-49e1-a7e3-ca1b0335d25a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:29.399388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b67145a7-38d5-49e1-a7e3-ca1b0335d25a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:29.402305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b67145a7-38d5-49e1-a7e3-ca1b0335d25a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:29.403213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b67145a7-38d5-49e1-a7e3-ca1b0335d25a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:29.721543 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b67145a7-38d5-49e1-a7e3-ca1b0335d25a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:29.736421 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b67145a7-38d5-49e1-a7e3-ca1b0335d25a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1127 microversion: 2.1 time: 0.370760 Sep 07 13:23:29.753713 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3091/6217] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:29 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1127 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:30.770095 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-26563917-7a1c-4d55-a98b-5a261c9843bf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:30.771556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-26563917-7a1c-4d55-a98b-5a261c9843bf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:30.780088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26563917-7a1c-4d55-a98b-5a261c9843bf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:30.781247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26563917-7a1c-4d55-a98b-5a261c9843bf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:30.781908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26563917-7a1c-4d55-a98b-5a261c9843bf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:30.782849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26563917-7a1c-4d55-a98b-5a261c9843bf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:30.783479 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26563917-7a1c-4d55-a98b-5a261c9843bf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:30.784089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26563917-7a1c-4d55-a98b-5a261c9843bf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:31.167766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-26563917-7a1c-4d55-a98b-5a261c9843bf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:31.184035 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-26563917-7a1c-4d55-a98b-5a261c9843bf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1169 microversion: 2.1 time: 0.419325 Sep 07 13:23:31.184648 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3127/6218] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:30 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1169 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:31.446008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-cbc0a41c-6a93-46fa-a78e-a652d7332702 req-85dc82e5-d4f7-4f7f-aaf5-716a10da79f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "542b204f-c194-4efd-99f2-20e451a73ce5", "tag": "fc0b8290-c4f2-4c15-a113-94c583fdfeaf"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:23:31.477846 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cbc0a41c-6a93-46fa-a78e-a652d7332702 req-85dc82e5-d4f7-4f7f-aaf5-716a10da79f7 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:31.480131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cbc0a41c-6a93-46fa-a78e-a652d7332702 req-85dc82e5-d4f7-4f7f-aaf5-716a10da79f7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:31.500199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cbc0a41c-6a93-46fa-a78e-a652d7332702 req-85dc82e5-d4f7-4f7f-aaf5-716a10da79f7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:31.530481 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-cbc0a41c-6a93-46fa-a78e-a652d7332702 req-85dc82e5-d4f7-4f7f-aaf5-716a10da79f7 service nova] Creating event network-changed:fc0b8290-c4f2-4c15-a113-94c583fdfeaf for instance 542b204f-c194-4efd-99f2-20e451a73ce5 on n-h2-852087-9 Sep 07 13:23:31.539563 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-cbc0a41c-6a93-46fa-a78e-a652d7332702 req-85dc82e5-d4f7-4f7f-aaf5-716a10da79f7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101919 Sep 07 13:23:31.540783 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3092/6219] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:23:32.211107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cde70cdd-cd38-4c09-bb6a-842b9c5bb367 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:32.218563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cde70cdd-cd38-4c09-bb6a-842b9c5bb367 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:32.227650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cde70cdd-cd38-4c09-bb6a-842b9c5bb367 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:32.228164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cde70cdd-cd38-4c09-bb6a-842b9c5bb367 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:32.228614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cde70cdd-cd38-4c09-bb6a-842b9c5bb367 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:32.229360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cde70cdd-cd38-4c09-bb6a-842b9c5bb367 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:32.229845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cde70cdd-cd38-4c09-bb6a-842b9c5bb367 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:32.232302 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cde70cdd-cd38-4c09-bb6a-842b9c5bb367 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:32.610229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cde70cdd-cd38-4c09-bb6a-842b9c5bb367 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:32.621038 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cde70cdd-cd38-4c09-bb6a-842b9c5bb367 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1169 microversion: 2.1 time: 0.412702 Sep 07 13:23:32.633916 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3128/6220] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:32 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1169 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:33.652078 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:23:33.653635 n-d-852087-9 devstack@n-api.service[122432]: Wed Sep 7 13:23:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 (ip 10.222.0.16) !!! Sep 07 13:23:33.687709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-981ece2f-e415-4d09-9299-5fa3bc65e817 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:33.688424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-981ece2f-e415-4d09-9299-5fa3bc65e817 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:33.696126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-981ece2f-e415-4d09-9299-5fa3bc65e817 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:33.696903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-981ece2f-e415-4d09-9299-5fa3bc65e817 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:33.698163 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-981ece2f-e415-4d09-9299-5fa3bc65e817 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:33.699090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-981ece2f-e415-4d09-9299-5fa3bc65e817 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:33.699759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-981ece2f-e415-4d09-9299-5fa3bc65e817 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:33.700183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-981ece2f-e415-4d09-9299-5fa3bc65e817 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:33.986341 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-981ece2f-e415-4d09-9299-5fa3bc65e817 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:34.001702 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-981ece2f-e415-4d09-9299-5fa3bc65e817 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1169 microversion: 2.1 time: 0.351282 Sep 07 13:23:34.002362 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3093/6221] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:33 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1169 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:35.034965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cc2fce7f-c9f8-4957-97b9-2d193f2d325b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:35.036779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cc2fce7f-c9f8-4957-97b9-2d193f2d325b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:35.056002 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc2fce7f-c9f8-4957-97b9-2d193f2d325b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:35.056164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc2fce7f-c9f8-4957-97b9-2d193f2d325b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:35.056631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc2fce7f-c9f8-4957-97b9-2d193f2d325b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:35.057303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc2fce7f-c9f8-4957-97b9-2d193f2d325b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:35.057802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc2fce7f-c9f8-4957-97b9-2d193f2d325b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:35.058277 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc2fce7f-c9f8-4957-97b9-2d193f2d325b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:35.271451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cc2fce7f-c9f8-4957-97b9-2d193f2d325b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:35.283489 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cc2fce7f-c9f8-4957-97b9-2d193f2d325b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1169 microversion: 2.1 time: 0.254864 Sep 07 13:23:35.289614 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3129/6222] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:35 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1169 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:36.336814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f790e850-58cb-4dbe-a188-ada5f6b85ffe tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:36.339865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f790e850-58cb-4dbe-a188-ada5f6b85ffe tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:36.354573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f790e850-58cb-4dbe-a188-ada5f6b85ffe tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:36.355588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f790e850-58cb-4dbe-a188-ada5f6b85ffe tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:36.356372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f790e850-58cb-4dbe-a188-ada5f6b85ffe tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:36.358951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f790e850-58cb-4dbe-a188-ada5f6b85ffe tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:36.359509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f790e850-58cb-4dbe-a188-ada5f6b85ffe tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:36.360092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f790e850-58cb-4dbe-a188-ada5f6b85ffe tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:36.553611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f790e850-58cb-4dbe-a188-ada5f6b85ffe tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:36.566420 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f790e850-58cb-4dbe-a188-ada5f6b85ffe tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1169 microversion: 2.1 time: 0.237340 Sep 07 13:23:36.581520 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3094/6223] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:36 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1169 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:37.603577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cdc38829-e61e-48bd-b343-882fbfdfb425 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:37.611915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cdc38829-e61e-48bd-b343-882fbfdfb425 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:37.624348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:37.625829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:37.642540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdc38829-e61e-48bd-b343-882fbfdfb425 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:37.643232 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdc38829-e61e-48bd-b343-882fbfdfb425 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:37.643838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdc38829-e61e-48bd-b343-882fbfdfb425 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:37.644785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdc38829-e61e-48bd-b343-882fbfdfb425 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:37.645557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdc38829-e61e-48bd-b343-882fbfdfb425 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:37.645904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdc38829-e61e-48bd-b343-882fbfdfb425 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:37.981215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cdc38829-e61e-48bd-b343-882fbfdfb425 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:37.993231 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cdc38829-e61e-48bd-b343-882fbfdfb425 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1169 microversion: 2.1 time: 0.399905 Sep 07 13:23:38.001544 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3130/6224] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:37 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1169 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:39.018041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1ac3743e-d31a-4d32-ab13-d0da49e360ec tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:39.019731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1ac3743e-d31a-4d32-ab13-d0da49e360ec tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:39.025595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:39.028558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ac3743e-d31a-4d32-ab13-d0da49e360ec tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:39.029396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ac3743e-d31a-4d32-ab13-d0da49e360ec tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:39.030207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ac3743e-d31a-4d32-ab13-d0da49e360ec tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:39.031414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ac3743e-d31a-4d32-ab13-d0da49e360ec tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:39.032144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ac3743e-d31a-4d32-ab13-d0da49e360ec tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:39.032820 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ac3743e-d31a-4d32-ab13-d0da49e360ec tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:39.200798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1ac3743e-d31a-4d32-ab13-d0da49e360ec tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:39.211813 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1ac3743e-d31a-4d32-ab13-d0da49e360ec tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1169 microversion: 2.1 time: 0.198042 Sep 07 13:23:39.213028 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3095/6225] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:39 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1169 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:40.242456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-677d3b46-dae5-411c-a610-1562957c0b78 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:40.249106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-677d3b46-dae5-411c-a610-1562957c0b78 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:40.263590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-677d3b46-dae5-411c-a610-1562957c0b78 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:40.264265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-677d3b46-dae5-411c-a610-1562957c0b78 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:40.265205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-677d3b46-dae5-411c-a610-1562957c0b78 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:40.266165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-677d3b46-dae5-411c-a610-1562957c0b78 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:40.266858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-677d3b46-dae5-411c-a610-1562957c0b78 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:40.267564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-677d3b46-dae5-411c-a610-1562957c0b78 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:40.515195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-677d3b46-dae5-411c-a610-1562957c0b78 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:40.532153 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-677d3b46-dae5-411c-a610-1562957c0b78 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1169 microversion: 2.1 time: 0.298324 Sep 07 13:23:40.533239 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3131/6226] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:40 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1169 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:41.572207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d55766cc-1e80-4ea0-9816-0504e1e799f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:41.574297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d55766cc-1e80-4ea0-9816-0504e1e799f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:41.586167 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d55766cc-1e80-4ea0-9816-0504e1e799f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:41.586922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d55766cc-1e80-4ea0-9816-0504e1e799f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:41.587821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d55766cc-1e80-4ea0-9816-0504e1e799f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:41.588778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d55766cc-1e80-4ea0-9816-0504e1e799f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:41.589371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d55766cc-1e80-4ea0-9816-0504e1e799f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:41.590120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d55766cc-1e80-4ea0-9816-0504e1e799f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:41.815658 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d55766cc-1e80-4ea0-9816-0504e1e799f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:41.825281 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d55766cc-1e80-4ea0-9816-0504e1e799f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1169 microversion: 2.1 time: 0.260240 Sep 07 13:23:41.841518 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3096/6227] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:41 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1169 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:42.863013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-72d87229-f599-4632-a4b5-84de0cef2a62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:42.864277 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-72d87229-f599-4632-a4b5-84de0cef2a62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:42.878027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72d87229-f599-4632-a4b5-84de0cef2a62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:42.879118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72d87229-f599-4632-a4b5-84de0cef2a62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:42.880019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72d87229-f599-4632-a4b5-84de0cef2a62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:42.881454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72d87229-f599-4632-a4b5-84de0cef2a62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:42.882397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72d87229-f599-4632-a4b5-84de0cef2a62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:42.883228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72d87229-f599-4632-a4b5-84de0cef2a62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:43.132641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-72d87229-f599-4632-a4b5-84de0cef2a62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:43.142454 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-72d87229-f599-4632-a4b5-84de0cef2a62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1169 microversion: 2.1 time: 0.292465 Sep 07 13:23:43.143945 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3132/6228] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:42 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1169 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:44.167609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a7e46389-c9ed-4040-ae4f-a115bc25a769 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:44.168224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a7e46389-c9ed-4040-ae4f-a115bc25a769 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:44.179765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7e46389-c9ed-4040-ae4f-a115bc25a769 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:44.180480 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7e46389-c9ed-4040-ae4f-a115bc25a769 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:44.185322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7e46389-c9ed-4040-ae4f-a115bc25a769 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:44.186754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7e46389-c9ed-4040-ae4f-a115bc25a769 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:44.192390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7e46389-c9ed-4040-ae4f-a115bc25a769 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:44.192906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7e46389-c9ed-4040-ae4f-a115bc25a769 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:44.455082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a7e46389-c9ed-4040-ae4f-a115bc25a769 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:44.464055 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a7e46389-c9ed-4040-ae4f-a115bc25a769 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1169 microversion: 2.1 time: 0.301307 Sep 07 13:23:44.481545 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3097/6229] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:44 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1169 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:45.500212 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7cc7bc55-1a9c-492a-a22a-b70ab29309ea tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:45.500970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7cc7bc55-1a9c-492a-a22a-b70ab29309ea tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:45.510365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7cc7bc55-1a9c-492a-a22a-b70ab29309ea tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:45.516204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7cc7bc55-1a9c-492a-a22a-b70ab29309ea tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:45.518710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7cc7bc55-1a9c-492a-a22a-b70ab29309ea tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:45.521147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7cc7bc55-1a9c-492a-a22a-b70ab29309ea tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:45.526007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7cc7bc55-1a9c-492a-a22a-b70ab29309ea tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:45.526007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7cc7bc55-1a9c-492a-a22a-b70ab29309ea tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:45.699380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7cc7bc55-1a9c-492a-a22a-b70ab29309ea tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:45.710168 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7cc7bc55-1a9c-492a-a22a-b70ab29309ea tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1169 microversion: 2.1 time: 0.214276 Sep 07 13:23:45.711342 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3133/6230] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:45 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1169 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:46.755559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-562a5671-17c3-4459-96c2-857fde8841e0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:46.759231 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-562a5671-17c3-4459-96c2-857fde8841e0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:46.774250 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-562a5671-17c3-4459-96c2-857fde8841e0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:46.774940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-562a5671-17c3-4459-96c2-857fde8841e0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:46.776906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-562a5671-17c3-4459-96c2-857fde8841e0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:46.777116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-562a5671-17c3-4459-96c2-857fde8841e0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:46.777926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-562a5671-17c3-4459-96c2-857fde8841e0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:46.779039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-562a5671-17c3-4459-96c2-857fde8841e0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:47.118677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-562a5671-17c3-4459-96c2-857fde8841e0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:47.133386 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-562a5671-17c3-4459-96c2-857fde8841e0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1169 microversion: 2.1 time: 0.387782 Sep 07 13:23:47.134359 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3098/6231] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:46 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1169 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:48.159849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4d32acaf-b799-4867-8398-ccbc9b1054f0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:48.160773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4d32acaf-b799-4867-8398-ccbc9b1054f0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:48.173062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d32acaf-b799-4867-8398-ccbc9b1054f0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:48.174325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d32acaf-b799-4867-8398-ccbc9b1054f0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:48.174992 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d32acaf-b799-4867-8398-ccbc9b1054f0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:48.176691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d32acaf-b799-4867-8398-ccbc9b1054f0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:48.177395 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d32acaf-b799-4867-8398-ccbc9b1054f0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:48.178128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d32acaf-b799-4867-8398-ccbc9b1054f0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:48.386980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4d32acaf-b799-4867-8398-ccbc9b1054f0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:48.404455 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4d32acaf-b799-4867-8398-ccbc9b1054f0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1169 microversion: 2.1 time: 0.250557 Sep 07 13:23:48.405739 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3134/6232] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:48 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1169 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:49.448878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ef75cb02-cbf0-4da3-bc4c-22bb3b06892c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:49.449801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ef75cb02-cbf0-4da3-bc4c-22bb3b06892c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:49.458297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef75cb02-cbf0-4da3-bc4c-22bb3b06892c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:49.458827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef75cb02-cbf0-4da3-bc4c-22bb3b06892c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:49.459319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef75cb02-cbf0-4da3-bc4c-22bb3b06892c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:49.460069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef75cb02-cbf0-4da3-bc4c-22bb3b06892c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:49.460565 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef75cb02-cbf0-4da3-bc4c-22bb3b06892c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:49.461246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef75cb02-cbf0-4da3-bc4c-22bb3b06892c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:49.639235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ef75cb02-cbf0-4da3-bc4c-22bb3b06892c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:49.648944 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ef75cb02-cbf0-4da3-bc4c-22bb3b06892c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1203 microversion: 2.1 time: 0.214226 Sep 07 13:23:49.649836 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3099/6233] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:49 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1203 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:50.687113 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4e487961-6afd-4bfc-81aa-879127906cb3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:50.687694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4e487961-6afd-4bfc-81aa-879127906cb3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:50.695928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e487961-6afd-4bfc-81aa-879127906cb3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:50.696541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e487961-6afd-4bfc-81aa-879127906cb3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:50.697060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e487961-6afd-4bfc-81aa-879127906cb3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:50.698022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e487961-6afd-4bfc-81aa-879127906cb3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:50.698402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e487961-6afd-4bfc-81aa-879127906cb3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:50.699027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e487961-6afd-4bfc-81aa-879127906cb3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:50.920895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4e487961-6afd-4bfc-81aa-879127906cb3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:50.931446 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4e487961-6afd-4bfc-81aa-879127906cb3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1203 microversion: 2.1 time: 0.248104 Sep 07 13:23:50.931446 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3135/6234] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:50 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1203 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:51.633907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a16a0440-62c0-438f-b6ff-622274441cf6 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:51.634484 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a16a0440-62c0-438f-b6ff-622274441cf6 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:51.648560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a16a0440-62c0-438f-b6ff-622274441cf6 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:51.649342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a16a0440-62c0-438f-b6ff-622274441cf6 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:51.650183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a16a0440-62c0-438f-b6ff-622274441cf6 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:51.651331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a16a0440-62c0-438f-b6ff-622274441cf6 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:51.652174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a16a0440-62c0-438f-b6ff-622274441cf6 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:51.653540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a16a0440-62c0-438f-b6ff-622274441cf6 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:51.845020 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a16a0440-62c0-438f-b6ff-622274441cf6 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1832 microversion: 2.1 time: 0.217074 Sep 07 13:23:51.852524 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3100/6235] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:51 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1832 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:51.875511 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f426a3e-f1bc-4d38-b3af-6c23b6185933 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:51.876174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0f426a3e-f1bc-4d38-b3af-6c23b6185933 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:51.888664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f426a3e-f1bc-4d38-b3af-6c23b6185933 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:51.889474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f426a3e-f1bc-4d38-b3af-6c23b6185933 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:51.890101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f426a3e-f1bc-4d38-b3af-6c23b6185933 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:51.890942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f426a3e-f1bc-4d38-b3af-6c23b6185933 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:51.891488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f426a3e-f1bc-4d38-b3af-6c23b6185933 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:51.892003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f426a3e-f1bc-4d38-b3af-6c23b6185933 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:51.969458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d16afbfd-b17b-44aa-9b35-79ae4b493a62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:51.970139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d16afbfd-b17b-44aa-9b35-79ae4b493a62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:51.986145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d16afbfd-b17b-44aa-9b35-79ae4b493a62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:51.998350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d16afbfd-b17b-44aa-9b35-79ae4b493a62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:51.998803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d16afbfd-b17b-44aa-9b35-79ae4b493a62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:51.999843 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d16afbfd-b17b-44aa-9b35-79ae4b493a62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:52.000317 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d16afbfd-b17b-44aa-9b35-79ae4b493a62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:52.000761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d16afbfd-b17b-44aa-9b35-79ae4b493a62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:52.134884 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0f426a3e-f1bc-4d38-b3af-6c23b6185933 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:52.148948 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0f426a3e-f1bc-4d38-b3af-6c23b6185933 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1681 microversion: 2.1 time: 0.275941 Sep 07 13:23:52.150357 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3136/6236] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:51 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1681 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:23:52.268911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d16afbfd-b17b-44aa-9b35-79ae4b493a62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:52.280378 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d16afbfd-b17b-44aa-9b35-79ae4b493a62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1203 microversion: 2.1 time: 0.315967 Sep 07 13:23:52.291174 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3101/6237] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:51 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1203 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:23:52.310499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-80418b56-6988-4d3d-baa8-5eb0d2b554d1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:23:52.315053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-80418b56-6988-4d3d-baa8-5eb0d2b554d1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:52.329339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80418b56-6988-4d3d-baa8-5eb0d2b554d1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:52.330447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80418b56-6988-4d3d-baa8-5eb0d2b554d1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:52.331864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80418b56-6988-4d3d-baa8-5eb0d2b554d1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:52.333591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80418b56-6988-4d3d-baa8-5eb0d2b554d1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:52.334726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80418b56-6988-4d3d-baa8-5eb0d2b554d1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:52.335639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80418b56-6988-4d3d-baa8-5eb0d2b554d1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:52.425752 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-80418b56-6988-4d3d-baa8-5eb0d2b554d1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "POST /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431/action" status: 200 len: 32626 microversion: 2.1 time: 0.121783 Sep 07 13:23:52.427310 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3137/6238] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:23:52 2022] POST /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431/action => generated 32626 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:23:52.615467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-20208992-8f13-43fb-a4e3-de8e93aa3634 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:23:52.616410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-20208992-8f13-43fb-a4e3-de8e93aa3634 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:52.628395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20208992-8f13-43fb-a4e3-de8e93aa3634 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:52.629282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20208992-8f13-43fb-a4e3-de8e93aa3634 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:52.630065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20208992-8f13-43fb-a4e3-de8e93aa3634 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:52.631331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20208992-8f13-43fb-a4e3-de8e93aa3634 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:52.632117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20208992-8f13-43fb-a4e3-de8e93aa3634 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:52.632853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20208992-8f13-43fb-a4e3-de8e93aa3634 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:52.679715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-20208992-8f13-43fb-a4e3-de8e93aa3634 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1bdeb375d1dc4ec1aa1d7c746df11939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff1375859e0541f290e207f39bbec2f1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:52.680933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-20208992-8f13-43fb-a4e3-de8e93aa3634 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] flavor_id is None. Assuming migration. {{(pid=122432) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 07 13:23:52.681398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-20208992-8f13-43fb-a4e3-de8e93aa3634 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122432) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 13:23:52.867678 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-20208992-8f13-43fb-a4e3-de8e93aa3634 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431/action" status: 202 len: 0 microversion: 2.1 time: 0.260582 Sep 07 13:23:52.869045 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3102/6239] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:23:52 2022] POST /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:23:52.878542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c88a3c06-78a4-4771-a443-65f8581bd8f1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:52.879328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c88a3c06-78a4-4771-a443-65f8581bd8f1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:52.889324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c88a3c06-78a4-4771-a443-65f8581bd8f1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:52.890137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c88a3c06-78a4-4771-a443-65f8581bd8f1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:52.890798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c88a3c06-78a4-4771-a443-65f8581bd8f1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:52.891736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c88a3c06-78a4-4771-a443-65f8581bd8f1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:52.892425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c88a3c06-78a4-4771-a443-65f8581bd8f1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:52.893324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c88a3c06-78a4-4771-a443-65f8581bd8f1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:53.105681 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c88a3c06-78a4-4771-a443-65f8581bd8f1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:53.126035 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c88a3c06-78a4-4771-a443-65f8581bd8f1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1690 microversion: 2.1 time: 0.252034 Sep 07 13:23:53.127365 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3138/6240] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:52 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1690 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:53.319778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fb2dd09c-5b8a-481a-9e16-77e618b9bda1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:53.320867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fb2dd09c-5b8a-481a-9e16-77e618b9bda1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:53.332304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb2dd09c-5b8a-481a-9e16-77e618b9bda1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:53.333581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb2dd09c-5b8a-481a-9e16-77e618b9bda1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:53.334597 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb2dd09c-5b8a-481a-9e16-77e618b9bda1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:53.336114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb2dd09c-5b8a-481a-9e16-77e618b9bda1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:53.337458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb2dd09c-5b8a-481a-9e16-77e618b9bda1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:53.338845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb2dd09c-5b8a-481a-9e16-77e618b9bda1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:53.630839 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fb2dd09c-5b8a-481a-9e16-77e618b9bda1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:53.652681 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fb2dd09c-5b8a-481a-9e16-77e618b9bda1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1203 microversion: 2.1 time: 0.341160 Sep 07 13:23:53.654079 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3103/6241] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:53 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1203 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:54.156863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a32e1527-5d4f-46e0-ba89-41c047e7d98b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:54.162533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a32e1527-5d4f-46e0-ba89-41c047e7d98b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:54.183997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a32e1527-5d4f-46e0-ba89-41c047e7d98b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:54.189010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a32e1527-5d4f-46e0-ba89-41c047e7d98b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:54.193578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a32e1527-5d4f-46e0-ba89-41c047e7d98b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:54.195800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a32e1527-5d4f-46e0-ba89-41c047e7d98b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:54.200092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a32e1527-5d4f-46e0-ba89-41c047e7d98b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:54.203713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a32e1527-5d4f-46e0-ba89-41c047e7d98b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:54.450416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a32e1527-5d4f-46e0-ba89-41c047e7d98b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:54.483674 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a32e1527-5d4f-46e0-ba89-41c047e7d98b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1690 microversion: 2.1 time: 0.333437 Sep 07 13:23:54.503262 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3139/6242] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:54 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1690 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:54.676996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d48a628-a808-4ac2-8a79-cd12f36d9916 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:54.677889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1d48a628-a808-4ac2-8a79-cd12f36d9916 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:54.685798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d48a628-a808-4ac2-8a79-cd12f36d9916 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:54.685798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d48a628-a808-4ac2-8a79-cd12f36d9916 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:54.686105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d48a628-a808-4ac2-8a79-cd12f36d9916 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:54.686900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d48a628-a808-4ac2-8a79-cd12f36d9916 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:54.687450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d48a628-a808-4ac2-8a79-cd12f36d9916 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:54.688622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d48a628-a808-4ac2-8a79-cd12f36d9916 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:54.880341 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1d48a628-a808-4ac2-8a79-cd12f36d9916 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:54.888885 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1d48a628-a808-4ac2-8a79-cd12f36d9916 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1203 microversion: 2.1 time: 0.216166 Sep 07 13:23:54.889942 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3104/6243] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:54 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1203 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:55.528333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bd92021e-ca1e-4630-a8ac-99e2a5713634 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:55.529233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bd92021e-ca1e-4630-a8ac-99e2a5713634 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:55.537675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd92021e-ca1e-4630-a8ac-99e2a5713634 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:55.538547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd92021e-ca1e-4630-a8ac-99e2a5713634 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:55.539004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd92021e-ca1e-4630-a8ac-99e2a5713634 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:55.539734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd92021e-ca1e-4630-a8ac-99e2a5713634 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:55.540216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd92021e-ca1e-4630-a8ac-99e2a5713634 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:55.540812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd92021e-ca1e-4630-a8ac-99e2a5713634 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:55.777444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bd92021e-ca1e-4630-a8ac-99e2a5713634 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:55.786817 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bd92021e-ca1e-4630-a8ac-99e2a5713634 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1690 microversion: 2.1 time: 0.263736 Sep 07 13:23:55.787452 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3140/6244] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:55 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1690 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:55.946494 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5c31769f-1954-46a0-a535-12f7511c011f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:55.949817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5c31769f-1954-46a0-a535-12f7511c011f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:55.967748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c31769f-1954-46a0-a535-12f7511c011f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:55.968609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c31769f-1954-46a0-a535-12f7511c011f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:55.969386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c31769f-1954-46a0-a535-12f7511c011f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:55.970956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c31769f-1954-46a0-a535-12f7511c011f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:55.971903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c31769f-1954-46a0-a535-12f7511c011f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:55.972755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c31769f-1954-46a0-a535-12f7511c011f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:56.190030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5c31769f-1954-46a0-a535-12f7511c011f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:56.199757 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5c31769f-1954-46a0-a535-12f7511c011f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1203 microversion: 2.1 time: 0.272260 Sep 07 13:23:56.201018 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3105/6245] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:55 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1203 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:56.821314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d1994f9f-9f74-4b82-aac8-f7e467b773c5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:56.822204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d1994f9f-9f74-4b82-aac8-f7e467b773c5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:56.826287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:56.834470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1994f9f-9f74-4b82-aac8-f7e467b773c5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:56.834953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1994f9f-9f74-4b82-aac8-f7e467b773c5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:56.835414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1994f9f-9f74-4b82-aac8-f7e467b773c5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:56.836264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1994f9f-9f74-4b82-aac8-f7e467b773c5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:56.836679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1994f9f-9f74-4b82-aac8-f7e467b773c5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:56.837128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1994f9f-9f74-4b82-aac8-f7e467b773c5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:56.841730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=91 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:57.224101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d0e95002-62dc-4b2e-8b60-d012ff6a79a6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:57.224965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d0e95002-62dc-4b2e-8b60-d012ff6a79a6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:57.241886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=37 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:57.251395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0e95002-62dc-4b2e-8b60-d012ff6a79a6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:57.251911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0e95002-62dc-4b2e-8b60-d012ff6a79a6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:57.252354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0e95002-62dc-4b2e-8b60-d012ff6a79a6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:57.253084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0e95002-62dc-4b2e-8b60-d012ff6a79a6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:57.253652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0e95002-62dc-4b2e-8b60-d012ff6a79a6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:57.254325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d0e95002-62dc-4b2e-8b60-d012ff6a79a6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:57.258512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:57.287540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d1994f9f-9f74-4b82-aac8-f7e467b773c5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:57.307713 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d1994f9f-9f74-4b82-aac8-f7e467b773c5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1690 microversion: 2.1 time: 0.496511 Sep 07 13:23:57.319310 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3141/6246] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:56 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1690 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:57.494365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d0e95002-62dc-4b2e-8b60-d012ff6a79a6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:57.507536 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d0e95002-62dc-4b2e-8b60-d012ff6a79a6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1203 microversion: 2.1 time: 0.287192 Sep 07 13:23:57.508490 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3106/6247] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:57 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1203 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:23:58.357945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1a92f372-fe66-4549-a8a6-23052eda4bbf tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:58.359256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1a92f372-fe66-4549-a8a6-23052eda4bbf tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:58.374255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a92f372-fe66-4549-a8a6-23052eda4bbf tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:58.375308 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a92f372-fe66-4549-a8a6-23052eda4bbf tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:58.376223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a92f372-fe66-4549-a8a6-23052eda4bbf tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:58.377689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a92f372-fe66-4549-a8a6-23052eda4bbf tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:58.379145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a92f372-fe66-4549-a8a6-23052eda4bbf tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:58.380336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a92f372-fe66-4549-a8a6-23052eda4bbf tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:58.547378 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a2eea795-0ce3-4afa-954e-fbbfddfd2490 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:58.548903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a2eea795-0ce3-4afa-954e-fbbfddfd2490 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:58.569887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2eea795-0ce3-4afa-954e-fbbfddfd2490 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:58.571254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2eea795-0ce3-4afa-954e-fbbfddfd2490 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:58.573814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2eea795-0ce3-4afa-954e-fbbfddfd2490 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:58.575858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2eea795-0ce3-4afa-954e-fbbfddfd2490 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:58.577679 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2eea795-0ce3-4afa-954e-fbbfddfd2490 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:58.578654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2eea795-0ce3-4afa-954e-fbbfddfd2490 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:58.685719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1a92f372-fe66-4549-a8a6-23052eda4bbf tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:58.702306 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1a92f372-fe66-4549-a8a6-23052eda4bbf tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1695 microversion: 2.1 time: 0.352789 Sep 07 13:23:58.703258 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3142/6248] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:58 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1695 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:23:58.869311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a2eea795-0ce3-4afa-954e-fbbfddfd2490 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:58.893268 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a2eea795-0ce3-4afa-954e-fbbfddfd2490 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1203 microversion: 2.1 time: 0.351395 Sep 07 13:23:58.894571 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3107/6249] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:58 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1203 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:23:59.129885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-e6e5be6a-e1f4-42a6-9a2c-423df95adf59 req-70150272-026c-4478-aaae-08b1d5cb782d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "542b204f-c194-4efd-99f2-20e451a73ce5", "name": "network-vif-plugged", "status": "completed", "tag": "fc0b8290-c4f2-4c15-a113-94c583fdfeaf"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:23:59.141032 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e6e5be6a-e1f4-42a6-9a2c-423df95adf59 req-70150272-026c-4478-aaae-08b1d5cb782d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:59.141560 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e6e5be6a-e1f4-42a6-9a2c-423df95adf59 req-70150272-026c-4478-aaae-08b1d5cb782d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:59.142143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e6e5be6a-e1f4-42a6-9a2c-423df95adf59 req-70150272-026c-4478-aaae-08b1d5cb782d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:59.155343 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-e6e5be6a-e1f4-42a6-9a2c-423df95adf59 req-70150272-026c-4478-aaae-08b1d5cb782d service nova] Creating event network-vif-plugged:fc0b8290-c4f2-4c15-a113-94c583fdfeaf for instance 542b204f-c194-4efd-99f2-20e451a73ce5 on n-h2-852087-9 Sep 07 13:23:59.163188 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-e6e5be6a-e1f4-42a6-9a2c-423df95adf59 req-70150272-026c-4478-aaae-08b1d5cb782d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.369667 Sep 07 13:23:59.164200 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3143/6250] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:23:59.738766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-03c5c88c-6c07-4441-a7c5-b06a0b9f81b8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:59.739531 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-03c5c88c-6c07-4441-a7c5-b06a0b9f81b8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:59.748412 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03c5c88c-6c07-4441-a7c5-b06a0b9f81b8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:59.749157 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03c5c88c-6c07-4441-a7c5-b06a0b9f81b8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:59.749919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03c5c88c-6c07-4441-a7c5-b06a0b9f81b8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:59.751162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03c5c88c-6c07-4441-a7c5-b06a0b9f81b8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:59.751757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03c5c88c-6c07-4441-a7c5-b06a0b9f81b8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:59.752573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03c5c88c-6c07-4441-a7c5-b06a0b9f81b8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:59.934318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e0d74318-f773-4563-bce2-28ebccb8da57 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:23:59.938340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e0d74318-f773-4563-bce2-28ebccb8da57 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:23:59.947326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-03c5c88c-6c07-4441-a7c5-b06a0b9f81b8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:23:59.959282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0d74318-f773-4563-bce2-28ebccb8da57 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:59.960525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0d74318-f773-4563-bce2-28ebccb8da57 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:59.960525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0d74318-f773-4563-bce2-28ebccb8da57 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:59.962194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0d74318-f773-4563-bce2-28ebccb8da57 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:23:59.964004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0d74318-f773-4563-bce2-28ebccb8da57 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:23:59.965096 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-03c5c88c-6c07-4441-a7c5-b06a0b9f81b8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1695 microversion: 2.1 time: 0.230095 Sep 07 13:23:59.965457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e0d74318-f773-4563-bce2-28ebccb8da57 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:23:59.966339 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3108/6251] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:59 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1695 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:00.184731 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e0d74318-f773-4563-bce2-28ebccb8da57 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:00.205681 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e0d74318-f773-4563-bce2-28ebccb8da57 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1203 microversion: 2.1 time: 0.281857 Sep 07 13:24:00.213182 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3144/6252] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:23:59 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1203 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:00.994805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c6b9594c-968d-470c-9fd5-97eb7f32f01d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:00.997127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c6b9594c-968d-470c-9fd5-97eb7f32f01d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:01.017434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6b9594c-968d-470c-9fd5-97eb7f32f01d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:01.018094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6b9594c-968d-470c-9fd5-97eb7f32f01d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:01.018876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6b9594c-968d-470c-9fd5-97eb7f32f01d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:01.019592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6b9594c-968d-470c-9fd5-97eb7f32f01d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:01.020052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6b9594c-968d-470c-9fd5-97eb7f32f01d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:01.020480 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6b9594c-968d-470c-9fd5-97eb7f32f01d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:01.199501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c6b9594c-968d-470c-9fd5-97eb7f32f01d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:01.212243 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c6b9594c-968d-470c-9fd5-97eb7f32f01d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1695 microversion: 2.1 time: 0.223624 Sep 07 13:24:01.225573 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3109/6253] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:00 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1695 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:01.239924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2171e33c-f04b-4032-9111-cc5c0e72b958 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:01.240715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2171e33c-f04b-4032-9111-cc5c0e72b958 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:01.248845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2171e33c-f04b-4032-9111-cc5c0e72b958 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:01.249389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2171e33c-f04b-4032-9111-cc5c0e72b958 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:01.249941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2171e33c-f04b-4032-9111-cc5c0e72b958 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:01.250999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2171e33c-f04b-4032-9111-cc5c0e72b958 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:01.251495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2171e33c-f04b-4032-9111-cc5c0e72b958 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:01.251938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2171e33c-f04b-4032-9111-cc5c0e72b958 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:01.440087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2171e33c-f04b-4032-9111-cc5c0e72b958 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:01.461972 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2171e33c-f04b-4032-9111-cc5c0e72b958 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1390 microversion: 2.1 time: 0.226772 Sep 07 13:24:01.463184 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3145/6254] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:01 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1390 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:01.486391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-63d46081-109c-429e-8aef-e398190f9e17 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:01.487355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-63d46081-109c-429e-8aef-e398190f9e17 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:01.496095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63d46081-109c-429e-8aef-e398190f9e17 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:01.496598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63d46081-109c-429e-8aef-e398190f9e17 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:01.497156 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63d46081-109c-429e-8aef-e398190f9e17 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:01.497785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63d46081-109c-429e-8aef-e398190f9e17 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:01.498247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63d46081-109c-429e-8aef-e398190f9e17 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:01.498677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63d46081-109c-429e-8aef-e398190f9e17 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:01.669035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-63d46081-109c-429e-8aef-e398190f9e17 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:01.678561 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-63d46081-109c-429e-8aef-e398190f9e17 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1390 microversion: 2.1 time: 0.196615 Sep 07 13:24:01.680387 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3110/6255] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:01 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1390 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:01.702743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a73eb699-851b-44d1-bbda-90ca984a94c2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:01.703552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a73eb699-851b-44d1-bbda-90ca984a94c2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:01.710798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a73eb699-851b-44d1-bbda-90ca984a94c2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:01.711206 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a73eb699-851b-44d1-bbda-90ca984a94c2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:01.711655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a73eb699-851b-44d1-bbda-90ca984a94c2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:01.712378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a73eb699-851b-44d1-bbda-90ca984a94c2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:01.713193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a73eb699-851b-44d1-bbda-90ca984a94c2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:01.713692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a73eb699-851b-44d1-bbda-90ca984a94c2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:01.896857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a73eb699-851b-44d1-bbda-90ca984a94c2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:01.914864 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a73eb699-851b-44d1-bbda-90ca984a94c2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1390 microversion: 2.1 time: 0.217340 Sep 07 13:24:01.915476 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3146/6256] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:01 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1390 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:02.014122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a9b52474-a418-4fc1-9d6a-079d57acfe19 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:02.014926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a9b52474-a418-4fc1-9d6a-079d57acfe19 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:02.024899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9b52474-a418-4fc1-9d6a-079d57acfe19 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:02.025526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9b52474-a418-4fc1-9d6a-079d57acfe19 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:02.026197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9b52474-a418-4fc1-9d6a-079d57acfe19 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:02.027168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9b52474-a418-4fc1-9d6a-079d57acfe19 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:02.027633 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9b52474-a418-4fc1-9d6a-079d57acfe19 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:02.028066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9b52474-a418-4fc1-9d6a-079d57acfe19 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:02.079746 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a9b52474-a418-4fc1-9d6a-079d57acfe19 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:24:02.188957 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a9b52474-a418-4fc1-9d6a-079d57acfe19 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "DELETE /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 204 len: 0 microversion: 2.1 time: 0.180495 Sep 07 13:24:02.190149 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3111/6257] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:24:02 2022] DELETE /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:24:02.198607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-906df584-9703-4d69-aae8-04d55fb03070 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:02.199227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-906df584-9703-4d69-aae8-04d55fb03070 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:02.206851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-906df584-9703-4d69-aae8-04d55fb03070 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:02.207714 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-906df584-9703-4d69-aae8-04d55fb03070 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:02.208156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-906df584-9703-4d69-aae8-04d55fb03070 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:02.208874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-906df584-9703-4d69-aae8-04d55fb03070 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:02.209326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-906df584-9703-4d69-aae8-04d55fb03070 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:02.210041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-906df584-9703-4d69-aae8-04d55fb03070 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:02.242992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f1a29fe5-7bdd-4766-9e84-4de3e1b77b70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:02.244527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f1a29fe5-7bdd-4766-9e84-4de3e1b77b70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:02.256456 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1a29fe5-7bdd-4766-9e84-4de3e1b77b70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:02.257108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1a29fe5-7bdd-4766-9e84-4de3e1b77b70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:02.259271 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1a29fe5-7bdd-4766-9e84-4de3e1b77b70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:02.259271 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1a29fe5-7bdd-4766-9e84-4de3e1b77b70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:02.259271 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1a29fe5-7bdd-4766-9e84-4de3e1b77b70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:02.261152 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f1a29fe5-7bdd-4766-9e84-4de3e1b77b70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:02.459273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-906df584-9703-4d69-aae8-04d55fb03070 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:02.468805 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-906df584-9703-4d69-aae8-04d55fb03070 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1396 microversion: 2.1 time: 0.274194 Sep 07 13:24:02.470030 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3147/6258] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:02 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1396 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:02.486035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f1a29fe5-7bdd-4766-9e84-4de3e1b77b70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:02.499585 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f1a29fe5-7bdd-4766-9e84-4de3e1b77b70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1695 microversion: 2.1 time: 0.263094 Sep 07 13:24:02.501062 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3112/6259] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:02 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1695 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:03.492650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-51b4b524-b9f7-45d9-817f-776580cb1e1d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:03.493375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-51b4b524-b9f7-45d9-817f-776580cb1e1d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:03.504834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51b4b524-b9f7-45d9-817f-776580cb1e1d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:03.505753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51b4b524-b9f7-45d9-817f-776580cb1e1d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:03.506530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51b4b524-b9f7-45d9-817f-776580cb1e1d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:03.507423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51b4b524-b9f7-45d9-817f-776580cb1e1d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:03.507831 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51b4b524-b9f7-45d9-817f-776580cb1e1d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:03.508267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51b4b524-b9f7-45d9-817f-776580cb1e1d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:03.525641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-53ac177a-ffff-495c-be59-2d5273bb147d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:03.527143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-53ac177a-ffff-495c-be59-2d5273bb147d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:03.537903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53ac177a-ffff-495c-be59-2d5273bb147d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:03.538753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53ac177a-ffff-495c-be59-2d5273bb147d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:03.539377 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53ac177a-ffff-495c-be59-2d5273bb147d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:03.540299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53ac177a-ffff-495c-be59-2d5273bb147d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:03.541324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53ac177a-ffff-495c-be59-2d5273bb147d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:03.543942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-53ac177a-ffff-495c-be59-2d5273bb147d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:03.762184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-51b4b524-b9f7-45d9-817f-776580cb1e1d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:03.773791 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-51b4b524-b9f7-45d9-817f-776580cb1e1d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1396 microversion: 2.1 time: 0.285101 Sep 07 13:24:03.774893 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3148/6260] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:03 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1396 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:03.775535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-53ac177a-ffff-495c-be59-2d5273bb147d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:03.784674 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-53ac177a-ffff-495c-be59-2d5273bb147d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1695 microversion: 2.1 time: 0.263082 Sep 07 13:24:03.786051 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3113/6261] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:03 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1695 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:04.611499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-920ed3fe-c559-47c7-8235-946b0eefb56b req-8df90793-50dd-4f74-8cc6-a1a928ced07d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "542b204f-c194-4efd-99f2-20e451a73ce5", "name": "network-vif-deleted", "tag": "fc0b8290-c4f2-4c15-a113-94c583fdfeaf"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:04.654032 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-920ed3fe-c559-47c7-8235-946b0eefb56b req-8df90793-50dd-4f74-8cc6-a1a928ced07d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:04.654846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-920ed3fe-c559-47c7-8235-946b0eefb56b req-8df90793-50dd-4f74-8cc6-a1a928ced07d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:04.655830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-920ed3fe-c559-47c7-8235-946b0eefb56b req-8df90793-50dd-4f74-8cc6-a1a928ced07d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:04.676776 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-920ed3fe-c559-47c7-8235-946b0eefb56b req-8df90793-50dd-4f74-8cc6-a1a928ced07d service nova] Creating event network-vif-deleted:fc0b8290-c4f2-4c15-a113-94c583fdfeaf for instance 542b204f-c194-4efd-99f2-20e451a73ce5 on n-h2-852087-9 Sep 07 13:24:04.685596 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-920ed3fe-c559-47c7-8235-946b0eefb56b req-8df90793-50dd-4f74-8cc6-a1a928ced07d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080916 Sep 07 13:24:04.696787 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3149/6262] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:24:04.806631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8487e3ba-d4f6-42ac-9c08-9eadad21b0d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:04.807262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8487e3ba-d4f6-42ac-9c08-9eadad21b0d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:04.812461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-65e6875a-6a32-42a7-ade7-3f0195e74ddd tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:04.814238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-65e6875a-6a32-42a7-ade7-3f0195e74ddd tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:04.816311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8487e3ba-d4f6-42ac-9c08-9eadad21b0d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:04.817554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8487e3ba-d4f6-42ac-9c08-9eadad21b0d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:04.818245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8487e3ba-d4f6-42ac-9c08-9eadad21b0d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:04.819454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8487e3ba-d4f6-42ac-9c08-9eadad21b0d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:04.820260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8487e3ba-d4f6-42ac-9c08-9eadad21b0d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:04.820869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8487e3ba-d4f6-42ac-9c08-9eadad21b0d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:04.821845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65e6875a-6a32-42a7-ade7-3f0195e74ddd tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:04.822687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65e6875a-6a32-42a7-ade7-3f0195e74ddd tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:04.823322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65e6875a-6a32-42a7-ade7-3f0195e74ddd tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:04.824328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65e6875a-6a32-42a7-ade7-3f0195e74ddd tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:04.824973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65e6875a-6a32-42a7-ade7-3f0195e74ddd tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:04.825695 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-65e6875a-6a32-42a7-ade7-3f0195e74ddd tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:04.923369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8487e3ba-d4f6-42ac-9c08-9eadad21b0d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:04.933621 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8487e3ba-d4f6-42ac-9c08-9eadad21b0d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1188 microversion: 2.1 time: 0.132368 Sep 07 13:24:04.946635 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3114/6263] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:04 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1188 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:05.083393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-65e6875a-6a32-42a7-ade7-3f0195e74ddd tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:05.095737 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-65e6875a-6a32-42a7-ade7-3f0195e74ddd tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1695 microversion: 2.1 time: 0.287594 Sep 07 13:24:05.097920 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3150/6264] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:04 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1695 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:05.958605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7377f4ee-bc81-48d7-9609-5a2c80481755 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:05.959856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7377f4ee-bc81-48d7-9609-5a2c80481755 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:05.967426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7377f4ee-bc81-48d7-9609-5a2c80481755 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:05.967928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7377f4ee-bc81-48d7-9609-5a2c80481755 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:05.968389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7377f4ee-bc81-48d7-9609-5a2c80481755 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:05.969081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7377f4ee-bc81-48d7-9609-5a2c80481755 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:05.969578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7377f4ee-bc81-48d7-9609-5a2c80481755 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:05.970006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7377f4ee-bc81-48d7-9609-5a2c80481755 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:06.044922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7377f4ee-bc81-48d7-9609-5a2c80481755 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:06.054000 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7377f4ee-bc81-48d7-9609-5a2c80481755 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1188 microversion: 2.1 time: 0.099227 Sep 07 13:24:06.054582 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3115/6265] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:05 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1188 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:06.127537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cd566c09-b505-44a5-b3a4-00d068e17ce2 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:06.129624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cd566c09-b505-44a5-b3a4-00d068e17ce2 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:06.141835 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd566c09-b505-44a5-b3a4-00d068e17ce2 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:06.142571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd566c09-b505-44a5-b3a4-00d068e17ce2 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:06.143178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd566c09-b505-44a5-b3a4-00d068e17ce2 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:06.144355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd566c09-b505-44a5-b3a4-00d068e17ce2 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:06.144837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd566c09-b505-44a5-b3a4-00d068e17ce2 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:06.145285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd566c09-b505-44a5-b3a4-00d068e17ce2 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:06.303979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cd566c09-b505-44a5-b3a4-00d068e17ce2 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:06.313462 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cd566c09-b505-44a5-b3a4-00d068e17ce2 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1695 microversion: 2.1 time: 0.195820 Sep 07 13:24:06.314574 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3151/6266] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:06 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1695 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:07.077294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6c8f2492-6260-445a-95fc-5be4dc62a573 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:07.078116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6c8f2492-6260-445a-95fc-5be4dc62a573 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:07.086772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c8f2492-6260-445a-95fc-5be4dc62a573 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:07.087597 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c8f2492-6260-445a-95fc-5be4dc62a573 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:07.088541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c8f2492-6260-445a-95fc-5be4dc62a573 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:07.089714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c8f2492-6260-445a-95fc-5be4dc62a573 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:07.090418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c8f2492-6260-445a-95fc-5be4dc62a573 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:07.093791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c8f2492-6260-445a-95fc-5be4dc62a573 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:07.177533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6c8f2492-6260-445a-95fc-5be4dc62a573 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:07.186291 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6c8f2492-6260-445a-95fc-5be4dc62a573 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1188 microversion: 2.1 time: 0.113468 Sep 07 13:24:07.187148 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3116/6267] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:07 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1188 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:07.341960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f995fdac-76bf-4b6e-b949-03c528d1505e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:07.344279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f995fdac-76bf-4b6e-b949-03c528d1505e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:07.356134 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f995fdac-76bf-4b6e-b949-03c528d1505e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:07.357612 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f995fdac-76bf-4b6e-b949-03c528d1505e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:07.359456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f995fdac-76bf-4b6e-b949-03c528d1505e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:07.360986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f995fdac-76bf-4b6e-b949-03c528d1505e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:07.363393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f995fdac-76bf-4b6e-b949-03c528d1505e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:07.364148 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f995fdac-76bf-4b6e-b949-03c528d1505e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:07.581879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f995fdac-76bf-4b6e-b949-03c528d1505e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:07.593382 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f995fdac-76bf-4b6e-b949-03c528d1505e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1695 microversion: 2.1 time: 0.258471 Sep 07 13:24:07.594611 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3152/6268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:07 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1695 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:08.212689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a3296e03-1d74-4a48-9da1-37aff7319e2e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:08.214202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a3296e03-1d74-4a48-9da1-37aff7319e2e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:08.223042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3296e03-1d74-4a48-9da1-37aff7319e2e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:08.223709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3296e03-1d74-4a48-9da1-37aff7319e2e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:08.224624 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3296e03-1d74-4a48-9da1-37aff7319e2e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:08.225929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3296e03-1d74-4a48-9da1-37aff7319e2e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:08.226830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3296e03-1d74-4a48-9da1-37aff7319e2e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:08.227581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3296e03-1d74-4a48-9da1-37aff7319e2e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:08.312474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a3296e03-1d74-4a48-9da1-37aff7319e2e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:08.321712 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a3296e03-1d74-4a48-9da1-37aff7319e2e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1188 microversion: 2.1 time: 0.114168 Sep 07 13:24:08.322655 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3117/6269] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:08 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1188 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:08.625251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cdcd6a18-9c6a-4763-9e6d-5331ed6df2b7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:08.626492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cdcd6a18-9c6a-4763-9e6d-5331ed6df2b7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:08.642210 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdcd6a18-9c6a-4763-9e6d-5331ed6df2b7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:08.643760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdcd6a18-9c6a-4763-9e6d-5331ed6df2b7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:08.644898 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdcd6a18-9c6a-4763-9e6d-5331ed6df2b7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:08.646439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdcd6a18-9c6a-4763-9e6d-5331ed6df2b7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:08.647463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdcd6a18-9c6a-4763-9e6d-5331ed6df2b7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:08.648455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdcd6a18-9c6a-4763-9e6d-5331ed6df2b7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:08.857527 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cdcd6a18-9c6a-4763-9e6d-5331ed6df2b7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:08.868074 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cdcd6a18-9c6a-4763-9e6d-5331ed6df2b7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1695 microversion: 2.1 time: 0.250991 Sep 07 13:24:08.888462 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3153/6270] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:08 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1695 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:09.355042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-715b4a96-9dd5-448d-93e9-fe391bbead35 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:09.357009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-715b4a96-9dd5-448d-93e9-fe391bbead35 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:09.370883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-715b4a96-9dd5-448d-93e9-fe391bbead35 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:09.371816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-715b4a96-9dd5-448d-93e9-fe391bbead35 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:09.372538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-715b4a96-9dd5-448d-93e9-fe391bbead35 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:09.373933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-715b4a96-9dd5-448d-93e9-fe391bbead35 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:09.374798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-715b4a96-9dd5-448d-93e9-fe391bbead35 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:09.375494 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-715b4a96-9dd5-448d-93e9-fe391bbead35 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:09.540574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-715b4a96-9dd5-448d-93e9-fe391bbead35 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:09.556126 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-715b4a96-9dd5-448d-93e9-fe391bbead35 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1188 microversion: 2.1 time: 0.204135 Sep 07 13:24:09.558103 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3118/6271] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:09 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1188 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:09.895404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1c2a137a-4686-4bd5-8319-b7e63ce646c6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:09.896179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1c2a137a-4686-4bd5-8319-b7e63ce646c6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:09.908142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c2a137a-4686-4bd5-8319-b7e63ce646c6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:09.908928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c2a137a-4686-4bd5-8319-b7e63ce646c6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:09.909945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c2a137a-4686-4bd5-8319-b7e63ce646c6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:09.910870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c2a137a-4686-4bd5-8319-b7e63ce646c6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:09.913246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c2a137a-4686-4bd5-8319-b7e63ce646c6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:09.914379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c2a137a-4686-4bd5-8319-b7e63ce646c6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:10.530778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1c2a137a-4686-4bd5-8319-b7e63ce646c6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:10.541893 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1c2a137a-4686-4bd5-8319-b7e63ce646c6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1694 microversion: 2.1 time: 0.652973 Sep 07 13:24:10.567368 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3154/6272] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:09 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1694 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:10.583620 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-379150c1-898d-43be-b9f6-2397873b903b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:10.584548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-379150c1-898d-43be-b9f6-2397873b903b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:10.593261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-379150c1-898d-43be-b9f6-2397873b903b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:10.593797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-379150c1-898d-43be-b9f6-2397873b903b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:10.594523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-379150c1-898d-43be-b9f6-2397873b903b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:10.595306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-379150c1-898d-43be-b9f6-2397873b903b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:10.595788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-379150c1-898d-43be-b9f6-2397873b903b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:10.596224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-379150c1-898d-43be-b9f6-2397873b903b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:10.650776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-379150c1-898d-43be-b9f6-2397873b903b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:10.651657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-379150c1-898d-43be-b9f6-2397873b903b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:10.652240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-379150c1-898d-43be-b9f6-2397873b903b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:10.652731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-379150c1-898d-43be-b9f6-2397873b903b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lazy-loading 'fault' on Instance uuid 542b204f-c194-4efd-99f2-20e451a73ce5 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:24:10.727154 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-379150c1-898d-43be-b9f6-2397873b903b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:10.736162 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-379150c1-898d-43be-b9f6-2397873b903b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 200 len: 1147 microversion: 2.1 time: 0.156738 Sep 07 13:24:10.738025 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3119/6273] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:10 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 1147 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:10.758774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-db4ea58c-d1f2-4ad4-b93d-6222d66450fc req-991a3554-a31d-4d75-a6d6-5377580805dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431", "name": "network-vif-unplugged", "status": "completed", "tag": "4de6c447-da78-427b-b139-6c02f7484224"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:10.770775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-db4ea58c-d1f2-4ad4-b93d-6222d66450fc req-991a3554-a31d-4d75-a6d6-5377580805dc service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:10.771141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-db4ea58c-d1f2-4ad4-b93d-6222d66450fc req-991a3554-a31d-4d75-a6d6-5377580805dc service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:10.772177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-db4ea58c-d1f2-4ad4-b93d-6222d66450fc req-991a3554-a31d-4d75-a6d6-5377580805dc service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:10.785671 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-db4ea58c-d1f2-4ad4-b93d-6222d66450fc req-991a3554-a31d-4d75-a6d6-5377580805dc service nova] Creating event network-vif-unplugged:4de6c447-da78-427b-b139-6c02f7484224 for instance 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 on n-h2-852087-9 Sep 07 13:24:10.794013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-db4ea58c-d1f2-4ad4-b93d-6222d66450fc req-991a3554-a31d-4d75-a6d6-5377580805dc service nova] Instance 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:24:10.807669 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-db4ea58c-d1f2-4ad4-b93d-6222d66450fc req-991a3554-a31d-4d75-a6d6-5377580805dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052822 Sep 07 13:24:10.808615 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3155/6274] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:11.578292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c5c04898-cc28-4245-9cf3-8918822a1211 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:11.579774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c5c04898-cc28-4245-9cf3-8918822a1211 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:11.595460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5c04898-cc28-4245-9cf3-8918822a1211 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:11.597807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5c04898-cc28-4245-9cf3-8918822a1211 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:11.599118 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5c04898-cc28-4245-9cf3-8918822a1211 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:11.600887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5c04898-cc28-4245-9cf3-8918822a1211 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:11.602221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5c04898-cc28-4245-9cf3-8918822a1211 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:11.603217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5c04898-cc28-4245-9cf3-8918822a1211 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:11.765650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8d45c3a4-5231-43ef-92e8-3b0d3a87c3bf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:11.767932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8d45c3a4-5231-43ef-92e8-3b0d3a87c3bf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:11.781764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d45c3a4-5231-43ef-92e8-3b0d3a87c3bf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:11.782960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d45c3a4-5231-43ef-92e8-3b0d3a87c3bf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:11.784010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d45c3a4-5231-43ef-92e8-3b0d3a87c3bf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:11.785719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d45c3a4-5231-43ef-92e8-3b0d3a87c3bf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:11.786498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d45c3a4-5231-43ef-92e8-3b0d3a87c3bf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:11.787529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d45c3a4-5231-43ef-92e8-3b0d3a87c3bf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:11.816547 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-8d45c3a4-5231-43ef-92e8-3b0d3a87c3bf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] HTTP exception thrown: Instance 542b204f-c194-4efd-99f2-20e451a73ce5 could not be found. Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8d45c3a4-5231-43ef-92e8-3b0d3a87c3bf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Request method failure captured: Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 HTTP/1.1 Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJrKtGg8mTUS8TVRSUKjETENKgBfLqI2oUMffXPZtsQfHAGfvsCSe64IHdsu1gAtG3a2XlfVJiJMXBeXoxoYCkAhaL6z1XH8667-SWfmJ5tkR4WMw-DlaHMfOvoGzJHrmW4OvMTJQgI9_G9o9R2vidCDnbLRABw8OsiYOeqYc9Klp2E Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 90d330a2d2ad4295873277de2d649182 Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 542b204f-c194-4efd-99f2-20e451a73ce5 could not be found. Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '542b204f-c194-4efd-99f2-20e451a73ce5'} Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 542b204f-c194-4efd-99f2-20e451a73ce5 could not be found. Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 542b204f-c194-4efd-99f2-20e451a73ce5 could not be found. Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:11.820889 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:24:11.830322 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:11.830322 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:11.830322 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:11.830322 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:24:11.830322 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:24:11.830322 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 542b204f-c194-4efd-99f2-20e451a73ce5 could not be found. Sep 07 13:24:11.830322 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:24:11.833293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8d45c3a4-5231-43ef-92e8-3b0d3a87c3bf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Returning 404 to user: Instance 542b204f-c194-4efd-99f2-20e451a73ce5 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:24:11.835233 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8d45c3a4-5231-43ef-92e8-3b0d3a87c3bf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 404 len: 111 microversion: 2.1 time: 0.077227 Sep 07 13:24:11.836987 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3156/6275] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:11 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:24:12.037794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c5c04898-cc28-4245-9cf3-8918822a1211 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:12.047965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:12.053048 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c5c04898-cc28-4245-9cf3-8918822a1211 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1694 microversion: 2.1 time: 0.482585 Sep 07 13:24:12.054930 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3120/6276] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:11 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1694 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:12.871453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-519589e0-4276-44a1-8b06-89058b980f2f req-0dfdbde1-b9a9-4979-8638-659e7a384d21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431", "tag": "4de6c447-da78-427b-b139-6c02f7484224"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:12.888268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-519589e0-4276-44a1-8b06-89058b980f2f req-0dfdbde1-b9a9-4979-8638-659e7a384d21 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:12.889112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-519589e0-4276-44a1-8b06-89058b980f2f req-0dfdbde1-b9a9-4979-8638-659e7a384d21 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:12.889824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-519589e0-4276-44a1-8b06-89058b980f2f req-0dfdbde1-b9a9-4979-8638-659e7a384d21 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:12.907998 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-519589e0-4276-44a1-8b06-89058b980f2f req-0dfdbde1-b9a9-4979-8638-659e7a384d21 service nova] Creating event network-changed:4de6c447-da78-427b-b139-6c02f7484224 for instance 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 on n-h2-852087-9 Sep 07 13:24:12.930774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-519589e0-4276-44a1-8b06-89058b980f2f req-0dfdbde1-b9a9-4979-8638-659e7a384d21 service nova] Instance 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:24:12.958574 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-519589e0-4276-44a1-8b06-89058b980f2f req-0dfdbde1-b9a9-4979-8638-659e7a384d21 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090857 Sep 07 13:24:12.959751 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3157/6277] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:13.084458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0b52f7ac-6b25-4f40-b32b-c20a09e2ea10 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:13.085107 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0b52f7ac-6b25-4f40-b32b-c20a09e2ea10 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:13.098622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b52f7ac-6b25-4f40-b32b-c20a09e2ea10 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:13.100014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b52f7ac-6b25-4f40-b32b-c20a09e2ea10 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:13.100923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b52f7ac-6b25-4f40-b32b-c20a09e2ea10 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:13.102159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b52f7ac-6b25-4f40-b32b-c20a09e2ea10 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:13.102850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b52f7ac-6b25-4f40-b32b-c20a09e2ea10 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:13.103707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b52f7ac-6b25-4f40-b32b-c20a09e2ea10 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:13.717699 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0b52f7ac-6b25-4f40-b32b-c20a09e2ea10 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:13.727158 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0b52f7ac-6b25-4f40-b32b-c20a09e2ea10 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1692 microversion: 2.1 time: 0.648447 Sep 07 13:24:13.727867 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3121/6278] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:13 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1692 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:14.780167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-241da510-61bf-407f-acea-97ee96479c64 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:14.785367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-241da510-61bf-407f-acea-97ee96479c64 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:14.799584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-241da510-61bf-407f-acea-97ee96479c64 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:14.801233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-241da510-61bf-407f-acea-97ee96479c64 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:14.801992 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-241da510-61bf-407f-acea-97ee96479c64 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:14.803259 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-241da510-61bf-407f-acea-97ee96479c64 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:14.804777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-241da510-61bf-407f-acea-97ee96479c64 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:14.805521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-241da510-61bf-407f-acea-97ee96479c64 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:15.020808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-241da510-61bf-407f-acea-97ee96479c64 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:15.032179 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-241da510-61bf-407f-acea-97ee96479c64 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1689 microversion: 2.1 time: 0.267642 Sep 07 13:24:15.034963 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3158/6279] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:14 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1689 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:15.057941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92e88362-ed32-466e-8472-414e25a71db0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:15.059249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-92e88362-ed32-466e-8472-414e25a71db0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:15.068725 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92e88362-ed32-466e-8472-414e25a71db0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:15.069584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92e88362-ed32-466e-8472-414e25a71db0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:15.070599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92e88362-ed32-466e-8472-414e25a71db0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:15.071277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92e88362-ed32-466e-8472-414e25a71db0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:15.071773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92e88362-ed32-466e-8472-414e25a71db0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:15.072432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92e88362-ed32-466e-8472-414e25a71db0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:15.266683 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-92e88362-ed32-466e-8472-414e25a71db0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "POST /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431/action" status: 202 len: 0 microversion: 2.1 time: 0.211944 Sep 07 13:24:15.276325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8b21ab28-40f5-4268-891c-c617cb83b560 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:15.277173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8b21ab28-40f5-4268-891c-c617cb83b560 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:15.282943 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3122/6280] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:24:15 2022] POST /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:24:15.284838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b21ab28-40f5-4268-891c-c617cb83b560 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:15.285342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b21ab28-40f5-4268-891c-c617cb83b560 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:15.285885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b21ab28-40f5-4268-891c-c617cb83b560 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:15.286780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b21ab28-40f5-4268-891c-c617cb83b560 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:15.287305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b21ab28-40f5-4268-891c-c617cb83b560 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:15.287745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8b21ab28-40f5-4268-891c-c617cb83b560 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:15.609911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8b21ab28-40f5-4268-891c-c617cb83b560 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:15.620871 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8b21ab28-40f5-4268-891c-c617cb83b560 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1688 microversion: 2.1 time: 0.348730 Sep 07 13:24:15.623790 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3159/6281] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:15 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1688 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:16.393577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8da78ac7-5d89-434e-8e83-2e0636976bdf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:16.395208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8da78ac7-5d89-434e-8e83-2e0636976bdf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:16.404936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8da78ac7-5d89-434e-8e83-2e0636976bdf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:16.405861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8da78ac7-5d89-434e-8e83-2e0636976bdf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:16.406401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8da78ac7-5d89-434e-8e83-2e0636976bdf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:16.407460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8da78ac7-5d89-434e-8e83-2e0636976bdf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:16.408423 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8da78ac7-5d89-434e-8e83-2e0636976bdf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:16.408939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8da78ac7-5d89-434e-8e83-2e0636976bdf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:16.425124 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-8da78ac7-5d89-434e-8e83-2e0636976bdf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] HTTP exception thrown: Instance 542b204f-c194-4efd-99f2-20e451a73ce5 could not be found. Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8da78ac7-5d89-434e-8e83-2e0636976bdf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Request method failure captured: Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 HTTP/1.1 Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJrKtGg8mTUS8TVRSUKjETENKgBfLqI2oUMffXPZtsQfHAGfvsCSe64IHdsu1gAtG3a2XlfVJiJMXBeXoxoYCkAhaL6z1XH8667-SWfmJ5tkR4WMw-DlaHMfOvoGzJHrmW4OvMTJQgI9_G9o9R2vidCDnbLRABw8OsiYOeqYc9Klp2E Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 90d330a2d2ad4295873277de2d649182 Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 542b204f-c194-4efd-99f2-20e451a73ce5 could not be found. Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '542b204f-c194-4efd-99f2-20e451a73ce5'} Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 542b204f-c194-4efd-99f2-20e451a73ce5 could not be found. Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:24:16.427333 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:24:16.432681 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 542b204f-c194-4efd-99f2-20e451a73ce5 could not be found. Sep 07 13:24:16.432681 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:24:16.432681 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:16.432681 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:24:16.432681 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:16.432681 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:16.432681 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:16.432681 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:24:16.432681 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:24:16.432681 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 542b204f-c194-4efd-99f2-20e451a73ce5 could not be found. Sep 07 13:24:16.432681 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:24:16.435519 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8da78ac7-5d89-434e-8e83-2e0636976bdf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Returning 404 to user: Instance 542b204f-c194-4efd-99f2-20e451a73ce5 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:24:16.436926 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8da78ac7-5d89-434e-8e83-2e0636976bdf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "DELETE /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 404 len: 111 microversion: 2.1 time: 0.049816 Sep 07 13:24:16.437942 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3123/6282] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:24:16 2022] DELETE /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:24:16.448828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-823e53c7-d743-4556-ad58-79f0e204b7a8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:16.450376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-823e53c7-d743-4556-ad58-79f0e204b7a8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 542b204f-c194-4efd-99f2-20e451a73ce5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:16.459687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-823e53c7-d743-4556-ad58-79f0e204b7a8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:16.460650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-823e53c7-d743-4556-ad58-79f0e204b7a8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:16.461108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-823e53c7-d743-4556-ad58-79f0e204b7a8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:16.461975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-823e53c7-d743-4556-ad58-79f0e204b7a8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:16.462535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-823e53c7-d743-4556-ad58-79f0e204b7a8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:16.463625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-823e53c7-d743-4556-ad58-79f0e204b7a8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:16.493908 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-823e53c7-d743-4556-ad58-79f0e204b7a8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] HTTP exception thrown: Instance 542b204f-c194-4efd-99f2-20e451a73ce5 could not be found. Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-823e53c7-d743-4556-ad58-79f0e204b7a8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Request method failure captured: Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 HTTP/1.1 Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJrKtGg8mTUS8TVRSUKjETENKgBfLqI2oUMffXPZtsQfHAGfvsCSe64IHdsu1gAtG3a2XlfVJiJMXBeXoxoYCkAhaL6z1XH8667-SWfmJ5tkR4WMw-DlaHMfOvoGzJHrmW4OvMTJQgI9_G9o9R2vidCDnbLRABw8OsiYOeqYc9Klp2E Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 90d330a2d2ad4295873277de2d649182 Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 542b204f-c194-4efd-99f2-20e451a73ce5 could not be found. Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '542b204f-c194-4efd-99f2-20e451a73ce5'} Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 542b204f-c194-4efd-99f2-20e451a73ce5 could not be found. Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 542b204f-c194-4efd-99f2-20e451a73ce5 could not be found. Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:24:16.496441 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:24:16.501885 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:24:16.501885 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:24:16.501885 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:24:16.501885 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:24:16.501885 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:24:16.501885 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 542b204f-c194-4efd-99f2-20e451a73ce5 could not be found. Sep 07 13:24:16.501885 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:24:16.503941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-823e53c7-d743-4556-ad58-79f0e204b7a8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Returning 404 to user: Instance 542b204f-c194-4efd-99f2-20e451a73ce5 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:24:16.505092 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-823e53c7-d743-4556-ad58-79f0e204b7a8 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5" status: 404 len: 111 microversion: 2.1 time: 0.060750 Sep 07 13:24:16.506676 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3160/6283] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:16 2022] GET /compute/v2.1/servers/542b204f-c194-4efd-99f2-20e451a73ce5 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:24:16.648842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0f5c7011-9729-4089-84d1-30d2c10bb119 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:16.649836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0f5c7011-9729-4089-84d1-30d2c10bb119 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:16.664540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f5c7011-9729-4089-84d1-30d2c10bb119 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:16.669094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f5c7011-9729-4089-84d1-30d2c10bb119 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:16.669731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f5c7011-9729-4089-84d1-30d2c10bb119 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:16.671422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f5c7011-9729-4089-84d1-30d2c10bb119 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:16.671916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f5c7011-9729-4089-84d1-30d2c10bb119 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:16.672367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f5c7011-9729-4089-84d1-30d2c10bb119 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:16.933881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0f5c7011-9729-4089-84d1-30d2c10bb119 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:16.948519 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0f5c7011-9729-4089-84d1-30d2c10bb119 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1688 microversion: 2.1 time: 0.304469 Sep 07 13:24:16.952827 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3124/6284] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:16 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1688 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:18.002657 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-272a1df3-3f90-4569-8048-ed83a9371cf6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:18.003581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-272a1df3-3f90-4569-8048-ed83a9371cf6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:18.011707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-272a1df3-3f90-4569-8048-ed83a9371cf6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:18.013735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-272a1df3-3f90-4569-8048-ed83a9371cf6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:18.014396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-272a1df3-3f90-4569-8048-ed83a9371cf6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:18.015614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-272a1df3-3f90-4569-8048-ed83a9371cf6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:18.016266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-272a1df3-3f90-4569-8048-ed83a9371cf6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:18.016890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-272a1df3-3f90-4569-8048-ed83a9371cf6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:18.020312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:18.329700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-272a1df3-3f90-4569-8048-ed83a9371cf6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:18.339678 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-272a1df3-3f90-4569-8048-ed83a9371cf6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1688 microversion: 2.1 time: 0.341156 Sep 07 13:24:18.340617 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3161/6285] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:17 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1688 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:19.370373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dcffa88b-49fc-45cb-9af5-37c15b29162f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:19.371010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dcffa88b-49fc-45cb-9af5-37c15b29162f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:19.379131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dcffa88b-49fc-45cb-9af5-37c15b29162f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:19.379640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dcffa88b-49fc-45cb-9af5-37c15b29162f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:19.380084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dcffa88b-49fc-45cb-9af5-37c15b29162f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:19.380809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dcffa88b-49fc-45cb-9af5-37c15b29162f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:19.381461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dcffa88b-49fc-45cb-9af5-37c15b29162f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:19.382108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dcffa88b-49fc-45cb-9af5-37c15b29162f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:19.619697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dcffa88b-49fc-45cb-9af5-37c15b29162f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:19.628830 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dcffa88b-49fc-45cb-9af5-37c15b29162f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1688 microversion: 2.1 time: 0.262906 Sep 07 13:24:19.636822 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3125/6286] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:19 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1688 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:20.654143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c0b6e85f-8c71-4afa-95fa-5833e29b188d req-39de38ef-1448-4248-9439-59c0c46ae6fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431", "tag": "4de6c447-da78-427b-b139-6c02f7484224"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:20.673160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0706c69f-7581-404d-96cf-d21f3d17bfe9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:20.675897 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0706c69f-7581-404d-96cf-d21f3d17bfe9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:20.685182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0706c69f-7581-404d-96cf-d21f3d17bfe9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:20.686671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0706c69f-7581-404d-96cf-d21f3d17bfe9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:20.687506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0706c69f-7581-404d-96cf-d21f3d17bfe9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:20.688728 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0706c69f-7581-404d-96cf-d21f3d17bfe9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:20.689574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0706c69f-7581-404d-96cf-d21f3d17bfe9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:20.690591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0706c69f-7581-404d-96cf-d21f3d17bfe9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:20.694114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c0b6e85f-8c71-4afa-95fa-5833e29b188d req-39de38ef-1448-4248-9439-59c0c46ae6fa service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:20.695710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c0b6e85f-8c71-4afa-95fa-5833e29b188d req-39de38ef-1448-4248-9439-59c0c46ae6fa service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:20.698731 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c0b6e85f-8c71-4afa-95fa-5833e29b188d req-39de38ef-1448-4248-9439-59c0c46ae6fa service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:20.732817 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c0b6e85f-8c71-4afa-95fa-5833e29b188d req-39de38ef-1448-4248-9439-59c0c46ae6fa service nova] Creating event network-changed:4de6c447-da78-427b-b139-6c02f7484224 for instance 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 on n-h1-852087-9 Sep 07 13:24:20.750808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-c0b6e85f-8c71-4afa-95fa-5833e29b188d req-39de38ef-1448-4248-9439-59c0c46ae6fa service nova] Instance 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:24:20.774096 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c0b6e85f-8c71-4afa-95fa-5833e29b188d req-39de38ef-1448-4248-9439-59c0c46ae6fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128790 Sep 07 13:24:20.776313 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3162/6287] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:21.135760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0706c69f-7581-404d-96cf-d21f3d17bfe9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:21.151513 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0706c69f-7581-404d-96cf-d21f3d17bfe9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1688 microversion: 2.1 time: 0.491097 Sep 07 13:24:21.153377 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3126/6288] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:20 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1688 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:22.196617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b70ec074-0fad-4367-b72d-dc44e1f596af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:22.197785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b70ec074-0fad-4367-b72d-dc44e1f596af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:22.209692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b70ec074-0fad-4367-b72d-dc44e1f596af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:22.210506 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b70ec074-0fad-4367-b72d-dc44e1f596af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:22.211194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b70ec074-0fad-4367-b72d-dc44e1f596af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:22.212581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b70ec074-0fad-4367-b72d-dc44e1f596af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:22.213637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b70ec074-0fad-4367-b72d-dc44e1f596af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:22.214355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b70ec074-0fad-4367-b72d-dc44e1f596af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:22.526672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b70ec074-0fad-4367-b72d-dc44e1f596af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:22.541389 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b70ec074-0fad-4367-b72d-dc44e1f596af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1688 microversion: 2.1 time: 0.353829 Sep 07 13:24:22.542518 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3163/6289] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:22 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1688 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:23.592410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-03dbefae-4313-4391-a29a-c0e74e8a4350 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:23.593977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-03dbefae-4313-4391-a29a-c0e74e8a4350 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:23.605964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03dbefae-4313-4391-a29a-c0e74e8a4350 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:23.606969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03dbefae-4313-4391-a29a-c0e74e8a4350 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:23.607636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03dbefae-4313-4391-a29a-c0e74e8a4350 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:23.609877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03dbefae-4313-4391-a29a-c0e74e8a4350 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:23.610804 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03dbefae-4313-4391-a29a-c0e74e8a4350 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:23.611321 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03dbefae-4313-4391-a29a-c0e74e8a4350 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:24.005848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-03dbefae-4313-4391-a29a-c0e74e8a4350 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:24.022365 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-03dbefae-4313-4391-a29a-c0e74e8a4350 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1688 microversion: 2.1 time: 0.434962 Sep 07 13:24:24.024032 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3127/6290] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:23 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1688 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:25.068523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3fdd353c-6bc0-4fde-873e-7804f2ad48d9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:25.070981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3fdd353c-6bc0-4fde-873e-7804f2ad48d9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:25.080957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fdd353c-6bc0-4fde-873e-7804f2ad48d9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:25.082018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fdd353c-6bc0-4fde-873e-7804f2ad48d9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:25.082688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fdd353c-6bc0-4fde-873e-7804f2ad48d9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:25.083689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fdd353c-6bc0-4fde-873e-7804f2ad48d9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:25.084379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fdd353c-6bc0-4fde-873e-7804f2ad48d9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:25.085000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3fdd353c-6bc0-4fde-873e-7804f2ad48d9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:25.319916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3fdd353c-6bc0-4fde-873e-7804f2ad48d9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:25.330465 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3fdd353c-6bc0-4fde-873e-7804f2ad48d9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1688 microversion: 2.1 time: 0.269826 Sep 07 13:24:25.331740 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3164/6291] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:25 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1688 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:26.357396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1310edd0-9374-4b33-94b0-edf8a0dd3553 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:26.358407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1310edd0-9374-4b33-94b0-edf8a0dd3553 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:26.371620 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1310edd0-9374-4b33-94b0-edf8a0dd3553 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:26.376700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1310edd0-9374-4b33-94b0-edf8a0dd3553 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:26.377465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1310edd0-9374-4b33-94b0-edf8a0dd3553 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:26.378493 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1310edd0-9374-4b33-94b0-edf8a0dd3553 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:26.382530 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1310edd0-9374-4b33-94b0-edf8a0dd3553 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:26.383294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1310edd0-9374-4b33-94b0-edf8a0dd3553 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:26.632919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1310edd0-9374-4b33-94b0-edf8a0dd3553 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:26.643932 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1310edd0-9374-4b33-94b0-edf8a0dd3553 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1681 microversion: 2.1 time: 0.290817 Sep 07 13:24:26.651877 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3128/6292] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:26 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1681 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:28.959689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-9a52d98f-c50d-4d46-bd70-ac641f7f5e68 req-e351778a-9df8-448c-9527-069335fb412d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431", "name": "network-vif-plugged", "status": "completed", "tag": "4de6c447-da78-427b-b139-6c02f7484224"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:28.980529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=48 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:28.985583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9a52d98f-c50d-4d46-bd70-ac641f7f5e68 req-e351778a-9df8-448c-9527-069335fb412d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:28.986751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9a52d98f-c50d-4d46-bd70-ac641f7f5e68 req-e351778a-9df8-448c-9527-069335fb412d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:28.987396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9a52d98f-c50d-4d46-bd70-ac641f7f5e68 req-e351778a-9df8-448c-9527-069335fb412d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:29.010451 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-9a52d98f-c50d-4d46-bd70-ac641f7f5e68 req-e351778a-9df8-448c-9527-069335fb412d service nova] Creating event network-vif-plugged:4de6c447-da78-427b-b139-6c02f7484224 for instance 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 on n-h1-852087-9 Sep 07 13:24:29.025710 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-9a52d98f-c50d-4d46-bd70-ac641f7f5e68 req-e351778a-9df8-448c-9527-069335fb412d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073776 Sep 07 13:24:29.026738 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3165/6293] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:51.288595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-480c5441-bfdf-4549-add7-fda3ecde79b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1254296283", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "61d0ce95-f387-4858-9d98-c239af43ee3f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "7f5512e3-cd6c-43c3-ae4c-0cca06e090be"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:51.301134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:51.302155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:51.378553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-480c5441-bfdf-4549-add7-fda3ecde79b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] validate_networks() for [('7f5512e3-cd6c-43c3-ae4c-0cca06e090be', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:24:52.005035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-480c5441-bfdf-4549-add7-fda3ecde79b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:24:52.005510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-480c5441-bfdf-4549-add7-fda3ecde79b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:24:52.005993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-480c5441-bfdf-4549-add7-fda3ecde79b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:24:52.006670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-480c5441-bfdf-4549-add7-fda3ecde79b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:24:52.007090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-480c5441-bfdf-4549-add7-fda3ecde79b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:24:52.019493 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-480c5441-bfdf-4549-add7-fda3ecde79b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:52.020003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-480c5441-bfdf-4549-add7-fda3ecde79b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:52.020441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-480c5441-bfdf-4549-add7-fda3ecde79b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:52.021187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-480c5441-bfdf-4549-add7-fda3ecde79b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:52.021678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-480c5441-bfdf-4549-add7-fda3ecde79b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:52.022200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-480c5441-bfdf-4549-add7-fda3ecde79b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:52.044006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-480c5441-bfdf-4549-add7-fda3ecde79b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Getting quotas for project b97b8dd299f145888f90fbf60321cd18. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:24:52.054937 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-480c5441-bfdf-4549-add7-fda3ecde79b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Getting quotas for user 90d330a2d2ad4295873277de2d649182 and project b97b8dd299f145888f90fbf60321cd18. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:24:52.151496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-480c5441-bfdf-4549-add7-fda3ecde79b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:24:52.153913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-480c5441-bfdf-4549-add7-fda3ecde79b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='61d0ce95-f387-4858-9d98-c239af43ee3f',volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:24:52.309177 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-480c5441-bfdf-4549-add7-fda3ecde79b7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.024598 Sep 07 13:24:52.310891 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3129/6294] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:24:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:24:52.320208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:52.321429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=23 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:52.327192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-78c56fc1-0053-4565-8102-2f6b9243d5ef tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:52.328418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-78c56fc1-0053-4565-8102-2f6b9243d5ef tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:52.443385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-78c56fc1-0053-4565-8102-2f6b9243d5ef tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:52.481530 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-78c56fc1-0053-4565-8102-2f6b9243d5ef tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 200 len: 1071 microversion: 2.1 time: 0.160328 Sep 07 13:24:52.482365 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3166/6295] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:52 2022] GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 1071 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:53.508831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3e8d4fa1-ddad-4085-a86c-d15328ff9293 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:53.509592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3e8d4fa1-ddad-4085-a86c-d15328ff9293 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:53.531812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e8d4fa1-ddad-4085-a86c-d15328ff9293 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:53.533123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e8d4fa1-ddad-4085-a86c-d15328ff9293 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:53.533760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e8d4fa1-ddad-4085-a86c-d15328ff9293 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:53.534719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e8d4fa1-ddad-4085-a86c-d15328ff9293 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:53.535349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e8d4fa1-ddad-4085-a86c-d15328ff9293 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:53.535951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e8d4fa1-ddad-4085-a86c-d15328ff9293 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:53.631715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3e8d4fa1-ddad-4085-a86c-d15328ff9293 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:53.649144 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3e8d4fa1-ddad-4085-a86c-d15328ff9293 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 200 len: 1169 microversion: 2.1 time: 0.145404 Sep 07 13:24:53.650364 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3130/6296] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:53 2022] GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 1169 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:54.674342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8c32180f-159e-460c-a484-52b947ed615a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:54.675004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8c32180f-159e-460c-a484-52b947ed615a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:54.684773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c32180f-159e-460c-a484-52b947ed615a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:54.690678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c32180f-159e-460c-a484-52b947ed615a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:54.691461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c32180f-159e-460c-a484-52b947ed615a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:54.692434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c32180f-159e-460c-a484-52b947ed615a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:54.706393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c32180f-159e-460c-a484-52b947ed615a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:54.707353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c32180f-159e-460c-a484-52b947ed615a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:54.900684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8c32180f-159e-460c-a484-52b947ed615a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:54.923607 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8c32180f-159e-460c-a484-52b947ed615a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 200 len: 1187 microversion: 2.1 time: 0.253302 Sep 07 13:24:54.924581 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3167/6297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:54 2022] GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 1187 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:55.980480 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-68d84ec0-10d9-4cf2-9570-f36b0a5eb6ee tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:55.981750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-68d84ec0-10d9-4cf2-9570-f36b0a5eb6ee tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:56.024688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68d84ec0-10d9-4cf2-9570-f36b0a5eb6ee tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:56.029526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68d84ec0-10d9-4cf2-9570-f36b0a5eb6ee tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:56.035313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68d84ec0-10d9-4cf2-9570-f36b0a5eb6ee tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:56.040199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68d84ec0-10d9-4cf2-9570-f36b0a5eb6ee tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:56.041225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68d84ec0-10d9-4cf2-9570-f36b0a5eb6ee tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:56.050618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68d84ec0-10d9-4cf2-9570-f36b0a5eb6ee tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:56.572914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-68d84ec0-10d9-4cf2-9570-f36b0a5eb6ee tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:56.582442 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-68d84ec0-10d9-4cf2-9570-f36b0a5eb6ee tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 200 len: 1229 microversion: 2.1 time: 0.614117 Sep 07 13:24:56.585970 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3131/6298] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:55 2022] GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 1229 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:24:57.299738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-f611d642-b558-46b6-af29-666044fc2f9e req-277195d0-12a4-45fd-a377-7a83a0a8c026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c00236d6-af50-477e-ab01-73e4be911d90", "tag": "34b5bdcc-cd11-4c75-8dcc-14f70cfd9050"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:24:57.326943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f611d642-b558-46b6-af29-666044fc2f9e req-277195d0-12a4-45fd-a377-7a83a0a8c026 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:57.327442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f611d642-b558-46b6-af29-666044fc2f9e req-277195d0-12a4-45fd-a377-7a83a0a8c026 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:57.328165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f611d642-b558-46b6-af29-666044fc2f9e req-277195d0-12a4-45fd-a377-7a83a0a8c026 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:57.352857 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-f611d642-b558-46b6-af29-666044fc2f9e req-277195d0-12a4-45fd-a377-7a83a0a8c026 service nova] Creating event network-changed:34b5bdcc-cd11-4c75-8dcc-14f70cfd9050 for instance c00236d6-af50-477e-ab01-73e4be911d90 on n-h2-852087-9 Sep 07 13:24:57.368084 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-f611d642-b558-46b6-af29-666044fc2f9e req-277195d0-12a4-45fd-a377-7a83a0a8c026 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073375 Sep 07 13:24:57.369008 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3168/6299] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:24:57.612308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c6c4bf31-e393-4a8f-b3ef-a5b5a2075f28 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:57.612942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c6c4bf31-e393-4a8f-b3ef-a5b5a2075f28 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:57.631240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6c4bf31-e393-4a8f-b3ef-a5b5a2075f28 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:57.631886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6c4bf31-e393-4a8f-b3ef-a5b5a2075f28 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:57.632314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6c4bf31-e393-4a8f-b3ef-a5b5a2075f28 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:57.633142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6c4bf31-e393-4a8f-b3ef-a5b5a2075f28 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:57.633672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6c4bf31-e393-4a8f-b3ef-a5b5a2075f28 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:57.634218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6c4bf31-e393-4a8f-b3ef-a5b5a2075f28 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:57.921354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c6c4bf31-e393-4a8f-b3ef-a5b5a2075f28 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:57.933821 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c6c4bf31-e393-4a8f-b3ef-a5b5a2075f28 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 200 len: 1229 microversion: 2.1 time: 0.325678 Sep 07 13:24:57.934427 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3132/6300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:57 2022] GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 1229 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:24:58.976448 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d8faa926-e019-4b21-8711-22a4c2b2300b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:24:58.977849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d8faa926-e019-4b21-8711-22a4c2b2300b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:24:58.987851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8faa926-e019-4b21-8711-22a4c2b2300b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:58.988672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8faa926-e019-4b21-8711-22a4c2b2300b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:58.989907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8faa926-e019-4b21-8711-22a4c2b2300b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:58.991007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8faa926-e019-4b21-8711-22a4c2b2300b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:24:58.991484 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8faa926-e019-4b21-8711-22a4c2b2300b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:24:58.992238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8faa926-e019-4b21-8711-22a4c2b2300b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:24:59.203457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d8faa926-e019-4b21-8711-22a4c2b2300b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:24:59.212674 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d8faa926-e019-4b21-8711-22a4c2b2300b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 200 len: 1229 microversion: 2.1 time: 0.246034 Sep 07 13:24:59.213931 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3169/6301] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:24:58 2022] GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 1229 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:00.240216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b5bd18c-995e-468a-b734-20acdd5f4958 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:00.241617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2b5bd18c-995e-468a-b734-20acdd5f4958 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:00.256397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b5bd18c-995e-468a-b734-20acdd5f4958 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:00.257038 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b5bd18c-995e-468a-b734-20acdd5f4958 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:00.257687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b5bd18c-995e-468a-b734-20acdd5f4958 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:00.260850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b5bd18c-995e-468a-b734-20acdd5f4958 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:00.261307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b5bd18c-995e-468a-b734-20acdd5f4958 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:00.261857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b5bd18c-995e-468a-b734-20acdd5f4958 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:00.548106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2b5bd18c-995e-468a-b734-20acdd5f4958 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:00.560113 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2b5bd18c-995e-468a-b734-20acdd5f4958 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 200 len: 1229 microversion: 2.1 time: 0.323907 Sep 07 13:25:00.561353 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3133/6302] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:00 2022] GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 1229 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:01.607420 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-38990b80-cfcc-4f4f-8fca-aea9fc0e84f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:01.608722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-38990b80-cfcc-4f4f-8fca-aea9fc0e84f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:01.616728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38990b80-cfcc-4f4f-8fca-aea9fc0e84f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:01.617220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38990b80-cfcc-4f4f-8fca-aea9fc0e84f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:01.617923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38990b80-cfcc-4f4f-8fca-aea9fc0e84f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:01.618934 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38990b80-cfcc-4f4f-8fca-aea9fc0e84f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:01.619421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38990b80-cfcc-4f4f-8fca-aea9fc0e84f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:01.619851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38990b80-cfcc-4f4f-8fca-aea9fc0e84f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:01.819078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-38990b80-cfcc-4f4f-8fca-aea9fc0e84f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:01.828442 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-38990b80-cfcc-4f4f-8fca-aea9fc0e84f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 200 len: 1217 microversion: 2.1 time: 0.225128 Sep 07 13:25:01.829063 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3170/6303] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:01 2022] GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 1217 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:02.852840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-324d9c34-ff22-4282-9265-4d8f135d2988 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:02.853764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-324d9c34-ff22-4282-9265-4d8f135d2988 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:02.856553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:02.857244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:02.870216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-324d9c34-ff22-4282-9265-4d8f135d2988 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:02.872178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-324d9c34-ff22-4282-9265-4d8f135d2988 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:02.872859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-324d9c34-ff22-4282-9265-4d8f135d2988 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:02.873861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-324d9c34-ff22-4282-9265-4d8f135d2988 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:02.874493 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-324d9c34-ff22-4282-9265-4d8f135d2988 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:02.875102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-324d9c34-ff22-4282-9265-4d8f135d2988 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:02.974321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c12928e4-b330-44ca-a9cd-1650f4d0b7c0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:02.980357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c12928e4-b330-44ca-a9cd-1650f4d0b7c0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:02.984847 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:02.998733 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c12928e4-b330-44ca-a9cd-1650f4d0b7c0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:02.999706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c12928e4-b330-44ca-a9cd-1650f4d0b7c0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:03.000323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c12928e4-b330-44ca-a9cd-1650f4d0b7c0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:03.001322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c12928e4-b330-44ca-a9cd-1650f4d0b7c0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:03.003922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c12928e4-b330-44ca-a9cd-1650f4d0b7c0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:03.004335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c12928e4-b330-44ca-a9cd-1650f4d0b7c0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:03.105158 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c12928e4-b330-44ca-a9cd-1650f4d0b7c0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "POST /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431/action" status: 200 len: 62919 microversion: 2.1 time: 0.140821 Sep 07 13:25:03.106618 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3171/6304] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:25:02 2022] POST /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431/action => generated 62919 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:25:03.133313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-324d9c34-ff22-4282-9265-4d8f135d2988 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:03.147683 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-324d9c34-ff22-4282-9265-4d8f135d2988 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 200 len: 1217 microversion: 2.1 time: 0.298775 Sep 07 13:25:03.157766 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3134/6305] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:02 2022] GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 1217 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:25:04.175050 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ee10f0ff-c544-4b59-aa2b-8ae979d73e37 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:04.175842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ee10f0ff-c544-4b59-aa2b-8ae979d73e37 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:04.186345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee10f0ff-c544-4b59-aa2b-8ae979d73e37 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:04.186854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee10f0ff-c544-4b59-aa2b-8ae979d73e37 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:04.187295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee10f0ff-c544-4b59-aa2b-8ae979d73e37 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:04.188037 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee10f0ff-c544-4b59-aa2b-8ae979d73e37 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:04.188506 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee10f0ff-c544-4b59-aa2b-8ae979d73e37 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:04.188957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee10f0ff-c544-4b59-aa2b-8ae979d73e37 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:04.505235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ee10f0ff-c544-4b59-aa2b-8ae979d73e37 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:04.519598 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ee10f0ff-c544-4b59-aa2b-8ae979d73e37 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 200 len: 1217 microversion: 2.1 time: 0.350875 Sep 07 13:25:04.521730 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3172/6306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:04 2022] GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 1217 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:05.393094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4e15b426-df99-407a-9be3-6d750e76b023 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-666491339", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "7d190c7e-1e9f-4175-90bc-aae9b015eea9"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:05.466338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-4e15b426-df99-407a-9be3-6d750e76b023 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] validate_networks() for [('7d190c7e-1e9f-4175-90bc-aae9b015eea9', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:25:05.561311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-61997219-245e-42fb-ad29-d83438f77bf0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:05.562683 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-61997219-245e-42fb-ad29-d83438f77bf0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:05.577108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61997219-245e-42fb-ad29-d83438f77bf0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:05.578078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61997219-245e-42fb-ad29-d83438f77bf0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:05.578873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61997219-245e-42fb-ad29-d83438f77bf0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:05.581122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61997219-245e-42fb-ad29-d83438f77bf0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:05.581122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61997219-245e-42fb-ad29-d83438f77bf0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:05.581990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61997219-245e-42fb-ad29-d83438f77bf0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:05.906330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-61997219-245e-42fb-ad29-d83438f77bf0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:05.915775 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-61997219-245e-42fb-ad29-d83438f77bf0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 200 len: 1217 microversion: 2.1 time: 0.361676 Sep 07 13:25:05.916522 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3173/6307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:05 2022] GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 1217 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:06.059911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-4e15b426-df99-407a-9be3-6d750e76b023 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:25:06.060684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-4e15b426-df99-407a-9be3-6d750e76b023 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:25:06.061421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-4e15b426-df99-407a-9be3-6d750e76b023 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:25:06.061881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-4e15b426-df99-407a-9be3-6d750e76b023 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:25:06.062646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-4e15b426-df99-407a-9be3-6d750e76b023 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:25:06.078033 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e15b426-df99-407a-9be3-6d750e76b023 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:06.078869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e15b426-df99-407a-9be3-6d750e76b023 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:06.079657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e15b426-df99-407a-9be3-6d750e76b023 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:06.081384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e15b426-df99-407a-9be3-6d750e76b023 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:06.082365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e15b426-df99-407a-9be3-6d750e76b023 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:06.083387 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e15b426-df99-407a-9be3-6d750e76b023 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:06.109313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-4e15b426-df99-407a-9be3-6d750e76b023 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Getting quotas for project b1ab9fc262994a92a967325448662f61. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:25:06.118549 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-4e15b426-df99-407a-9be3-6d750e76b023 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Getting quotas for user 900134259cce49f5bcb1e1d35a7690c3 and project b1ab9fc262994a92a967325448662f61. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:25:06.133991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4e15b426-df99-407a-9be3-6d750e76b023 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:25:06.136727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4e15b426-df99-407a-9be3-6d750e76b023 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:25:06.188638 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4e15b426-df99-407a-9be3-6d750e76b023 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.980651 Sep 07 13:25:06.189195 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3135/6308] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:25:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 13:25:06.205367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1bb763d2-c902-40df-a23c-921c87bee6df tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:06.206203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1bb763d2-c902-40df-a23c-921c87bee6df tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:06.281537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1bb763d2-c902-40df-a23c-921c87bee6df tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900134259cce49f5bcb1e1d35a7690c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ab9fc262994a92a967325448662f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:06.292131 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1bb763d2-c902-40df-a23c-921c87bee6df tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 200 len: 1214 microversion: 2.1 time: 0.090334 Sep 07 13:25:06.300803 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3174/6309] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:06 2022] GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:06.940921 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:25:06.941510 n-d-852087-9 devstack@n-api.service[122432]: Wed Sep 7 13:25:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 (ip 10.222.0.16) !!! Sep 07 13:25:06.946499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fc1f6f36-9e6e-45a8-8c57-ca8e14398d81 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:06.947536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fc1f6f36-9e6e-45a8-8c57-ca8e14398d81 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:06.954858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc1f6f36-9e6e-45a8-8c57-ca8e14398d81 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:06.955351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc1f6f36-9e6e-45a8-8c57-ca8e14398d81 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:06.955867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc1f6f36-9e6e-45a8-8c57-ca8e14398d81 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:06.956589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc1f6f36-9e6e-45a8-8c57-ca8e14398d81 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:06.957048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc1f6f36-9e6e-45a8-8c57-ca8e14398d81 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:06.957504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc1f6f36-9e6e-45a8-8c57-ca8e14398d81 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:07.164136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fc1f6f36-9e6e-45a8-8c57-ca8e14398d81 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:07.173344 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fc1f6f36-9e6e-45a8-8c57-ca8e14398d81 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 200 len: 1217 microversion: 2.1 time: 0.234068 Sep 07 13:25:07.174279 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3136/6310] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:06 2022] GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 1217 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:07.315493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-134df863-088a-4e3f-996b-3da583419fec tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:07.316806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-134df863-088a-4e3f-996b-3da583419fec tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:07.326807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-134df863-088a-4e3f-996b-3da583419fec tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:07.327481 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-134df863-088a-4e3f-996b-3da583419fec tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:07.328121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-134df863-088a-4e3f-996b-3da583419fec tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:07.329075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-134df863-088a-4e3f-996b-3da583419fec tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:07.329678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-134df863-088a-4e3f-996b-3da583419fec tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:07.330127 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-134df863-088a-4e3f-996b-3da583419fec tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:07.422306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-134df863-088a-4e3f-996b-3da583419fec tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900134259cce49f5bcb1e1d35a7690c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ab9fc262994a92a967325448662f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:07.431062 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-134df863-088a-4e3f-996b-3da583419fec tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 200 len: 1266 microversion: 2.1 time: 0.120275 Sep 07 13:25:07.431773 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3175/6311] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:07 2022] GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:08.197670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7120f1b7-9f32-449a-97a3-849a78ff7e37 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:08.198442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7120f1b7-9f32-449a-97a3-849a78ff7e37 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:08.208662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7120f1b7-9f32-449a-97a3-849a78ff7e37 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:08.209519 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7120f1b7-9f32-449a-97a3-849a78ff7e37 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:08.210253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7120f1b7-9f32-449a-97a3-849a78ff7e37 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:08.211722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7120f1b7-9f32-449a-97a3-849a78ff7e37 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:08.212473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7120f1b7-9f32-449a-97a3-849a78ff7e37 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:08.213151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7120f1b7-9f32-449a-97a3-849a78ff7e37 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:08.412164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7120f1b7-9f32-449a-97a3-849a78ff7e37 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:08.425034 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7120f1b7-9f32-449a-97a3-849a78ff7e37 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 200 len: 1217 microversion: 2.1 time: 0.231599 Sep 07 13:25:08.425675 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3137/6312] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:08 2022] GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 1217 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:08.457970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3ced35dd-da67-4bac-9835-175009905a6f tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:08.459208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3ced35dd-da67-4bac-9835-175009905a6f tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:08.467471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ced35dd-da67-4bac-9835-175009905a6f tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:08.468321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ced35dd-da67-4bac-9835-175009905a6f tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:08.469000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ced35dd-da67-4bac-9835-175009905a6f tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:08.470151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ced35dd-da67-4bac-9835-175009905a6f tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:08.470895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ced35dd-da67-4bac-9835-175009905a6f tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:08.471687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3ced35dd-da67-4bac-9835-175009905a6f tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:08.655752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3ced35dd-da67-4bac-9835-175009905a6f tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900134259cce49f5bcb1e1d35a7690c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ab9fc262994a92a967325448662f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:08.665153 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3ced35dd-da67-4bac-9835-175009905a6f tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 200 len: 1314 microversion: 2.1 time: 0.213315 Sep 07 13:25:08.669544 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3176/6313] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:08 2022] GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:09.449460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-21d9161c-4c66-41d7-991f-6a573be8ed48 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:09.450341 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-21d9161c-4c66-41d7-991f-6a573be8ed48 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:09.470149 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21d9161c-4c66-41d7-991f-6a573be8ed48 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:09.470656 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21d9161c-4c66-41d7-991f-6a573be8ed48 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:09.471104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21d9161c-4c66-41d7-991f-6a573be8ed48 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:09.471906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21d9161c-4c66-41d7-991f-6a573be8ed48 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:09.472372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21d9161c-4c66-41d7-991f-6a573be8ed48 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:09.472794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21d9161c-4c66-41d7-991f-6a573be8ed48 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:09.644904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-21d9161c-4c66-41d7-991f-6a573be8ed48 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:09.659495 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-21d9161c-4c66-41d7-991f-6a573be8ed48 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 200 len: 1217 microversion: 2.1 time: 0.214731 Sep 07 13:25:09.664603 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3138/6314] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:09 2022] GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 1217 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:09.691033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e9fa8f31-de1f-45eb-82e3-71cb94281895 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:09.693215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e9fa8f31-de1f-45eb-82e3-71cb94281895 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:09.702209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9fa8f31-de1f-45eb-82e3-71cb94281895 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:09.703046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9fa8f31-de1f-45eb-82e3-71cb94281895 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:09.703493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9fa8f31-de1f-45eb-82e3-71cb94281895 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:09.704252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9fa8f31-de1f-45eb-82e3-71cb94281895 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:09.704903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9fa8f31-de1f-45eb-82e3-71cb94281895 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:09.705344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9fa8f31-de1f-45eb-82e3-71cb94281895 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:09.823460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-4cd982d6-0e40-4796-bfe2-084eba3ff798 req-18d7cb28-eee4-43c4-bb2d-7ea3226a2a4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b83ef98-20b5-475a-b189-e01b3c61a7c5", "tag": "fd19b6ca-97cd-4f03-9bd1-a3d101a68b33"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:09.834319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4cd982d6-0e40-4796-bfe2-084eba3ff798 req-18d7cb28-eee4-43c4-bb2d-7ea3226a2a4e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:09.834810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4cd982d6-0e40-4796-bfe2-084eba3ff798 req-18d7cb28-eee4-43c4-bb2d-7ea3226a2a4e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:09.835332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4cd982d6-0e40-4796-bfe2-084eba3ff798 req-18d7cb28-eee4-43c4-bb2d-7ea3226a2a4e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:09.848474 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-4cd982d6-0e40-4796-bfe2-084eba3ff798 req-18d7cb28-eee4-43c4-bb2d-7ea3226a2a4e service nova] Creating event network-changed:fd19b6ca-97cd-4f03-9bd1-a3d101a68b33 for instance 9b83ef98-20b5-475a-b189-e01b3c61a7c5 on n-h1-852087-9 Sep 07 13:25:09.854308 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-4cd982d6-0e40-4796-bfe2-084eba3ff798 req-18d7cb28-eee4-43c4-bb2d-7ea3226a2a4e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111175 Sep 07 13:25:09.855532 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3139/6315] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:25:09.961039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e9fa8f31-de1f-45eb-82e3-71cb94281895 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900134259cce49f5bcb1e1d35a7690c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ab9fc262994a92a967325448662f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:09.974546 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e9fa8f31-de1f-45eb-82e3-71cb94281895 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 200 len: 1314 microversion: 2.1 time: 0.288184 Sep 07 13:25:09.976055 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3177/6316] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:09 2022] GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:10.691276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-64d9f459-2b33-4183-8638-97287671ba8c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:10.691988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-64d9f459-2b33-4183-8638-97287671ba8c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:10.700669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64d9f459-2b33-4183-8638-97287671ba8c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:10.701286 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64d9f459-2b33-4183-8638-97287671ba8c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:10.701774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64d9f459-2b33-4183-8638-97287671ba8c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:10.702821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64d9f459-2b33-4183-8638-97287671ba8c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:10.704529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64d9f459-2b33-4183-8638-97287671ba8c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:10.705088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64d9f459-2b33-4183-8638-97287671ba8c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:10.872624 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-64d9f459-2b33-4183-8638-97287671ba8c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:10.884621 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-64d9f459-2b33-4183-8638-97287671ba8c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 200 len: 1217 microversion: 2.1 time: 0.199012 Sep 07 13:25:10.885229 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3140/6317] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:10 2022] GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 1217 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:11.000134 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c7ecfab8-5067-4b82-ab89-ace4e288eea8 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:11.001556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c7ecfab8-5067-4b82-ab89-ace4e288eea8 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:11.009322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7ecfab8-5067-4b82-ab89-ace4e288eea8 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:11.009920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7ecfab8-5067-4b82-ab89-ace4e288eea8 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:11.010366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7ecfab8-5067-4b82-ab89-ace4e288eea8 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:11.011173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7ecfab8-5067-4b82-ab89-ace4e288eea8 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:11.011665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7ecfab8-5067-4b82-ab89-ace4e288eea8 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:11.012220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7ecfab8-5067-4b82-ab89-ace4e288eea8 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:11.057788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-046c9227-fa71-4372-bde7-ef1797d34e01 req-ecc76517-8bad-4472-a488-c28033787c65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00236d6-af50-477e-ab01-73e4be911d90", "name": "network-vif-plugged", "status": "completed", "tag": "34b5bdcc-cd11-4c75-8dcc-14f70cfd9050"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:11.076931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-046c9227-fa71-4372-bde7-ef1797d34e01 req-ecc76517-8bad-4472-a488-c28033787c65 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:11.078195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-046c9227-fa71-4372-bde7-ef1797d34e01 req-ecc76517-8bad-4472-a488-c28033787c65 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:11.079139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-046c9227-fa71-4372-bde7-ef1797d34e01 req-ecc76517-8bad-4472-a488-c28033787c65 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:11.103160 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-046c9227-fa71-4372-bde7-ef1797d34e01 req-ecc76517-8bad-4472-a488-c28033787c65 service nova] Creating event network-vif-plugged:34b5bdcc-cd11-4c75-8dcc-14f70cfd9050 for instance c00236d6-af50-477e-ab01-73e4be911d90 on n-h2-852087-9 Sep 07 13:25:11.111238 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-046c9227-fa71-4372-bde7-ef1797d34e01 req-ecc76517-8bad-4472-a488-c28033787c65 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060581 Sep 07 13:25:11.114174 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3141/6318] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:25:11.210942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c7ecfab8-5067-4b82-ab89-ace4e288eea8 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900134259cce49f5bcb1e1d35a7690c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ab9fc262994a92a967325448662f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:11.226728 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c7ecfab8-5067-4b82-ab89-ace4e288eea8 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 200 len: 1314 microversion: 2.1 time: 0.230187 Sep 07 13:25:11.227970 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3178/6319] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:10 2022] GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:11.909735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-84f80c16-cd78-4bde-bdae-7df358eb4592 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:11.910440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-84f80c16-cd78-4bde-bdae-7df358eb4592 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:11.917369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84f80c16-cd78-4bde-bdae-7df358eb4592 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:11.917820 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84f80c16-cd78-4bde-bdae-7df358eb4592 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:11.918258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84f80c16-cd78-4bde-bdae-7df358eb4592 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:11.918980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84f80c16-cd78-4bde-bdae-7df358eb4592 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:11.919442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84f80c16-cd78-4bde-bdae-7df358eb4592 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:11.919899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84f80c16-cd78-4bde-bdae-7df358eb4592 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:12.109633 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-84f80c16-cd78-4bde-bdae-7df358eb4592 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:12.123590 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-84f80c16-cd78-4bde-bdae-7df358eb4592 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 200 len: 1217 microversion: 2.1 time: 0.219273 Sep 07 13:25:12.124223 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3142/6320] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:11 2022] GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 1217 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:25:12.261029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2f6d4d6c-df3e-408c-94d7-cb264ddfd656 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:12.261778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2f6d4d6c-df3e-408c-94d7-cb264ddfd656 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:12.271567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f6d4d6c-df3e-408c-94d7-cb264ddfd656 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:12.272248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f6d4d6c-df3e-408c-94d7-cb264ddfd656 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:12.272709 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f6d4d6c-df3e-408c-94d7-cb264ddfd656 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:12.273908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f6d4d6c-df3e-408c-94d7-cb264ddfd656 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:12.274416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f6d4d6c-df3e-408c-94d7-cb264ddfd656 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:12.274952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f6d4d6c-df3e-408c-94d7-cb264ddfd656 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:12.499730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2f6d4d6c-df3e-408c-94d7-cb264ddfd656 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900134259cce49f5bcb1e1d35a7690c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ab9fc262994a92a967325448662f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:12.517049 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2f6d4d6c-df3e-408c-94d7-cb264ddfd656 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 200 len: 1314 microversion: 2.1 time: 0.261040 Sep 07 13:25:12.517956 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3179/6321] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:12 2022] GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:13.159222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cbc7316b-aa66-4528-a4cb-6cdd3b38591b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:13.160289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cbc7316b-aa66-4528-a4cb-6cdd3b38591b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:13.183161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbc7316b-aa66-4528-a4cb-6cdd3b38591b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:13.184055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbc7316b-aa66-4528-a4cb-6cdd3b38591b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:13.185205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbc7316b-aa66-4528-a4cb-6cdd3b38591b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:13.189867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbc7316b-aa66-4528-a4cb-6cdd3b38591b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:13.190836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbc7316b-aa66-4528-a4cb-6cdd3b38591b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:13.192251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbc7316b-aa66-4528-a4cb-6cdd3b38591b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:13.451971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cbc7316b-aa66-4528-a4cb-6cdd3b38591b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:13.463236 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cbc7316b-aa66-4528-a4cb-6cdd3b38591b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 200 len: 1405 microversion: 2.1 time: 0.316141 Sep 07 13:25:13.475071 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3143/6322] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:13 2022] GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 1405 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:13.495552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-730436fc-e847-4fce-ad8b-fea8ce3a599b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:13.496605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-730436fc-e847-4fce-ad8b-fea8ce3a599b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:13.508828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-730436fc-e847-4fce-ad8b-fea8ce3a599b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:13.510419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-730436fc-e847-4fce-ad8b-fea8ce3a599b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:13.511125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-730436fc-e847-4fce-ad8b-fea8ce3a599b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:13.512535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-730436fc-e847-4fce-ad8b-fea8ce3a599b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:13.513326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-730436fc-e847-4fce-ad8b-fea8ce3a599b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:13.514087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-730436fc-e847-4fce-ad8b-fea8ce3a599b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:13.549928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6b342e82-f466-4c7e-9935-cd88ae3c57f2 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:13.551913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6b342e82-f466-4c7e-9935-cd88ae3c57f2 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:13.562108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b342e82-f466-4c7e-9935-cd88ae3c57f2 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:13.562928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b342e82-f466-4c7e-9935-cd88ae3c57f2 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:13.563932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b342e82-f466-4c7e-9935-cd88ae3c57f2 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:13.564898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b342e82-f466-4c7e-9935-cd88ae3c57f2 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:13.565899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b342e82-f466-4c7e-9935-cd88ae3c57f2 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:13.566513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b342e82-f466-4c7e-9935-cd88ae3c57f2 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:13.810850 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-730436fc-e847-4fce-ad8b-fea8ce3a599b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:13.823128 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-730436fc-e847-4fce-ad8b-fea8ce3a599b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 200 len: 1405 microversion: 2.1 time: 0.335916 Sep 07 13:25:13.841218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6b342e82-f466-4c7e-9935-cd88ae3c57f2 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900134259cce49f5bcb1e1d35a7690c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ab9fc262994a92a967325448662f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:13.842873 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3180/6323] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:13 2022] GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 1405 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:13.848690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dc0ccc9c-2fd8-49e0-8363-efa4554dcdd2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-266445960"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:13.851417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dc0ccc9c-2fd8-49e0-8363-efa4554dcdd2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:13.853950 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6b342e82-f466-4c7e-9935-cd88ae3c57f2 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 200 len: 1314 microversion: 2.1 time: 0.309078 Sep 07 13:25:13.854576 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3144/6324] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:13 2022] GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:13.859954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc0ccc9c-2fd8-49e0-8363-efa4554dcdd2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:13.860664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc0ccc9c-2fd8-49e0-8363-efa4554dcdd2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:13.861290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc0ccc9c-2fd8-49e0-8363-efa4554dcdd2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:13.862270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc0ccc9c-2fd8-49e0-8363-efa4554dcdd2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:13.863085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc0ccc9c-2fd8-49e0-8363-efa4554dcdd2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:13.863680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc0ccc9c-2fd8-49e0-8363-efa4554dcdd2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:14.011100 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.compute.api [None req-dc0ccc9c-2fd8-49e0-8363-efa4554dcdd2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Attempting to quiesce instance before volume snapshot. Sep 07 13:25:14.093869 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.compute.api [None req-dc0ccc9c-2fd8-49e0-8363-efa4554dcdd2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Sep 07 13:25:14.184928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dc0ccc9c-2fd8-49e0-8363-efa4554dcdd2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Creating snapshot from volume 61d0ce95-f387-4858-9d98-c239af43ee3f. {{(pid=122433) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Sep 07 13:25:14.909123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2bc8bef1-8c9d-4635-966f-72110cb456d2 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:14.909999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2bc8bef1-8c9d-4635-966f-72110cb456d2 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:14.924595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bc8bef1-8c9d-4635-966f-72110cb456d2 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:14.925902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bc8bef1-8c9d-4635-966f-72110cb456d2 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:14.926125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bc8bef1-8c9d-4635-966f-72110cb456d2 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:14.926761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bc8bef1-8c9d-4635-966f-72110cb456d2 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:14.927214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bc8bef1-8c9d-4635-966f-72110cb456d2 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:14.927922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2bc8bef1-8c9d-4635-966f-72110cb456d2 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:15.056100 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:25:15.056701 n-d-852087-9 devstack@n-api.service[122433]: Wed Sep 7 13:25:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90/action (ip 10.222.0.16) !!! Sep 07 13:25:15.231581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2bc8bef1-8c9d-4635-966f-72110cb456d2 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900134259cce49f5bcb1e1d35a7690c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ab9fc262994a92a967325448662f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:15.252023 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2bc8bef1-8c9d-4635-966f-72110cb456d2 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 200 len: 1314 microversion: 2.1 time: 0.366653 Sep 07 13:25:15.254332 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3145/6325] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:14 2022] GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:15.620895 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dc0ccc9c-2fd8-49e0-8363-efa4554dcdd2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "POST /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90/action" status: 202 len: 0 microversion: 2.1 time: 1.776413 Sep 07 13:25:15.621587 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3181/6326] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:25:13 2022] POST /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90/action => generated 0 bytes in 1778 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 07 13:25:16.296692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0a56ecec-7a93-4a07-b14c-26e602e62986 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:16.297449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0a56ecec-7a93-4a07-b14c-26e602e62986 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:16.301806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:16.303540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:16.310565 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a56ecec-7a93-4a07-b14c-26e602e62986 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:16.311069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a56ecec-7a93-4a07-b14c-26e602e62986 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:16.311549 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a56ecec-7a93-4a07-b14c-26e602e62986 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:16.312217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a56ecec-7a93-4a07-b14c-26e602e62986 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:16.312681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a56ecec-7a93-4a07-b14c-26e602e62986 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:16.313108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a56ecec-7a93-4a07-b14c-26e602e62986 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:16.512055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0a56ecec-7a93-4a07-b14c-26e602e62986 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900134259cce49f5bcb1e1d35a7690c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ab9fc262994a92a967325448662f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:16.522290 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0a56ecec-7a93-4a07-b14c-26e602e62986 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 200 len: 1314 microversion: 2.1 time: 0.232302 Sep 07 13:25:16.522972 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3146/6327] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:16 2022] GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:25:17.004569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-2627a7e5-1aa2-4072-b086-0c87df0f76ad req-f45fff28-a1f8-489b-ae37-4db1b6969e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b83ef98-20b5-475a-b189-e01b3c61a7c5", "name": "network-vif-plugged", "status": "completed", "tag": "fd19b6ca-97cd-4f03-9bd1-a3d101a68b33"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:17.016766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:17.026797 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2627a7e5-1aa2-4072-b086-0c87df0f76ad req-f45fff28-a1f8-489b-ae37-4db1b6969e44 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:17.027535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2627a7e5-1aa2-4072-b086-0c87df0f76ad req-f45fff28-a1f8-489b-ae37-4db1b6969e44 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:17.028522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2627a7e5-1aa2-4072-b086-0c87df0f76ad req-f45fff28-a1f8-489b-ae37-4db1b6969e44 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:17.054845 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-2627a7e5-1aa2-4072-b086-0c87df0f76ad req-f45fff28-a1f8-489b-ae37-4db1b6969e44 service nova] Creating event network-vif-plugged:fd19b6ca-97cd-4f03-9bd1-a3d101a68b33 for instance 9b83ef98-20b5-475a-b189-e01b3c61a7c5 on n-h1-852087-9 Sep 07 13:25:17.066106 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-2627a7e5-1aa2-4072-b086-0c87df0f76ad req-f45fff28-a1f8-489b-ae37-4db1b6969e44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071288 Sep 07 13:25:17.068041 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3182/6328] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:17.137160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-caf4e3d4-68d7-4771-8539-25dbe0eb005c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1338728262", "imageRef": "49976203-1129-458d-b28d-1c54d97b9453", "flavorRef": "452", "networks": [{"uuid": "7f5512e3-cd6c-43c3-ae4c-0cca06e090be"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:17.232493 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-caf4e3d4-68d7-4771-8539-25dbe0eb005c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] validate_networks() for [('7f5512e3-cd6c-43c3-ae4c-0cca06e090be', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:25:17.551905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9356dbf2-05eb-44dc-b714-c9039b60fc45 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:17.553358 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9356dbf2-05eb-44dc-b714-c9039b60fc45 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:17.565921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9356dbf2-05eb-44dc-b714-c9039b60fc45 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:17.566827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9356dbf2-05eb-44dc-b714-c9039b60fc45 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:17.567663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9356dbf2-05eb-44dc-b714-c9039b60fc45 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:17.568964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9356dbf2-05eb-44dc-b714-c9039b60fc45 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:17.569846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9356dbf2-05eb-44dc-b714-c9039b60fc45 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:17.570662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9356dbf2-05eb-44dc-b714-c9039b60fc45 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:18.169871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-caf4e3d4-68d7-4771-8539-25dbe0eb005c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:25:18.171753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-caf4e3d4-68d7-4771-8539-25dbe0eb005c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:25:18.172726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-caf4e3d4-68d7-4771-8539-25dbe0eb005c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:25:18.173508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-caf4e3d4-68d7-4771-8539-25dbe0eb005c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:25:18.174212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-caf4e3d4-68d7-4771-8539-25dbe0eb005c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:25:18.189998 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-caf4e3d4-68d7-4771-8539-25dbe0eb005c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:18.190575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-caf4e3d4-68d7-4771-8539-25dbe0eb005c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:18.190996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-caf4e3d4-68d7-4771-8539-25dbe0eb005c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:18.191741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-caf4e3d4-68d7-4771-8539-25dbe0eb005c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:18.192225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-caf4e3d4-68d7-4771-8539-25dbe0eb005c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:18.192649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-caf4e3d4-68d7-4771-8539-25dbe0eb005c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:18.193329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9356dbf2-05eb-44dc-b714-c9039b60fc45 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900134259cce49f5bcb1e1d35a7690c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ab9fc262994a92a967325448662f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:18.201803 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9356dbf2-05eb-44dc-b714-c9039b60fc45 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 200 len: 1314 microversion: 2.1 time: 0.656359 Sep 07 13:25:18.204806 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3183/6329] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:17 2022] GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 1314 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:18.215281 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-caf4e3d4-68d7-4771-8539-25dbe0eb005c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Getting quotas for project b97b8dd299f145888f90fbf60321cd18. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:25:18.222994 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-caf4e3d4-68d7-4771-8539-25dbe0eb005c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Getting quotas for user 90d330a2d2ad4295873277de2d649182 and project b97b8dd299f145888f90fbf60321cd18. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:25:18.240239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-caf4e3d4-68d7-4771-8539-25dbe0eb005c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:25:18.244951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-caf4e3d4-68d7-4771-8539-25dbe0eb005c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='6733263d-f7f9-4233-a342-4a7fccdf1264',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:25:18.365622 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-caf4e3d4-68d7-4771-8539-25dbe0eb005c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.239722 Sep 07 13:25:18.366669 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3147/6330] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:25:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:25:18.378879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-87c7ede1-8b73-4b03-b2e9-c2873ae16b44 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:18.380005 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-87c7ede1-8b73-4b03-b2e9-c2873ae16b44 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:18.447427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-87c7ede1-8b73-4b03-b2e9-c2873ae16b44 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:18.458286 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-87c7ede1-8b73-4b03-b2e9-c2873ae16b44 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1230 microversion: 2.1 time: 0.083737 Sep 07 13:25:18.459536 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3184/6331] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:18 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1230 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:25:19.227486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c781bb77-8c23-4aee-ac85-26cf4084a927 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:19.228356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c781bb77-8c23-4aee-ac85-26cf4084a927 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:19.235562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c781bb77-8c23-4aee-ac85-26cf4084a927 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:19.236352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c781bb77-8c23-4aee-ac85-26cf4084a927 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:19.236799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c781bb77-8c23-4aee-ac85-26cf4084a927 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:19.237541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c781bb77-8c23-4aee-ac85-26cf4084a927 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:19.238034 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c781bb77-8c23-4aee-ac85-26cf4084a927 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:19.238435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c781bb77-8c23-4aee-ac85-26cf4084a927 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:19.403373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c781bb77-8c23-4aee-ac85-26cf4084a927 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900134259cce49f5bcb1e1d35a7690c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ab9fc262994a92a967325448662f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:19.410896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:19.420571 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c781bb77-8c23-4aee-ac85-26cf4084a927 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 200 len: 1501 microversion: 2.1 time: 0.196953 Sep 07 13:25:19.422111 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3148/6332] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:19 2022] GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 1501 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:19.448078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4da697b5-34cf-4535-8e00-66a301d1a2e9 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:19.449304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4da697b5-34cf-4535-8e00-66a301d1a2e9 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:19.458197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4da697b5-34cf-4535-8e00-66a301d1a2e9 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:19.458733 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4da697b5-34cf-4535-8e00-66a301d1a2e9 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:19.459192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4da697b5-34cf-4535-8e00-66a301d1a2e9 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:19.459989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4da697b5-34cf-4535-8e00-66a301d1a2e9 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:19.460501 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4da697b5-34cf-4535-8e00-66a301d1a2e9 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:19.460921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4da697b5-34cf-4535-8e00-66a301d1a2e9 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:19.464651 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:19.491941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-54c66d82-4140-449e-9e4a-12d7d021e730 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:19.493783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-54c66d82-4140-449e-9e4a-12d7d021e730 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:19.503547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54c66d82-4140-449e-9e4a-12d7d021e730 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:19.504218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54c66d82-4140-449e-9e4a-12d7d021e730 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:19.504673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54c66d82-4140-449e-9e4a-12d7d021e730 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:19.509254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54c66d82-4140-449e-9e4a-12d7d021e730 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:19.509254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54c66d82-4140-449e-9e4a-12d7d021e730 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:19.509254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54c66d82-4140-449e-9e4a-12d7d021e730 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:19.607041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-54c66d82-4140-449e-9e4a-12d7d021e730 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:19.630693 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-54c66d82-4140-449e-9e4a-12d7d021e730 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1282 microversion: 2.1 time: 0.150084 Sep 07 13:25:19.631631 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3149/6333] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:19 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1282 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:19.682856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4da697b5-34cf-4535-8e00-66a301d1a2e9 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900134259cce49f5bcb1e1d35a7690c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ab9fc262994a92a967325448662f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:19.697437 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4da697b5-34cf-4535-8e00-66a301d1a2e9 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 200 len: 1501 microversion: 2.1 time: 0.255389 Sep 07 13:25:19.698110 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3185/6334] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:19 2022] GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 1501 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:19.723778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fa60e311-1ba9-433d-ade2-3a2968026115 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:19.725197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fa60e311-1ba9-433d-ade2-3a2968026115 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:19.732876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa60e311-1ba9-433d-ade2-3a2968026115 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:19.733450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa60e311-1ba9-433d-ade2-3a2968026115 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:19.733926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa60e311-1ba9-433d-ade2-3a2968026115 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:19.735701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa60e311-1ba9-433d-ade2-3a2968026115 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:19.736181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa60e311-1ba9-433d-ade2-3a2968026115 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:19.737234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa60e311-1ba9-433d-ade2-3a2968026115 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:19.765642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-fa60e311-1ba9-433d-ade2-3a2968026115 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lazy-loading 'flavor' on Instance uuid 9b83ef98-20b5-475a-b189-e01b3c61a7c5 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:25:19.887151 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fa60e311-1ba9-433d-ade2-3a2968026115 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "POST /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5/action" status: 202 len: 0 microversion: 2.1 time: 0.168868 Sep 07 13:25:19.892650 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3150/6335] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:25:19 2022] POST /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:25:19.905292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d8c2fbe4-b860-41f4-bc7d-3c0da5bc0c90 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:19.905968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d8c2fbe4-b860-41f4-bc7d-3c0da5bc0c90 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:19.920639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8c2fbe4-b860-41f4-bc7d-3c0da5bc0c90 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:19.922452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8c2fbe4-b860-41f4-bc7d-3c0da5bc0c90 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:19.923775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8c2fbe4-b860-41f4-bc7d-3c0da5bc0c90 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:19.925873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8c2fbe4-b860-41f4-bc7d-3c0da5bc0c90 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:19.927259 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8c2fbe4-b860-41f4-bc7d-3c0da5bc0c90 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:19.928622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8c2fbe4-b860-41f4-bc7d-3c0da5bc0c90 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:20.220450 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d8c2fbe4-b860-41f4-bc7d-3c0da5bc0c90 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900134259cce49f5bcb1e1d35a7690c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ab9fc262994a92a967325448662f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:20.237984 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d8c2fbe4-b860-41f4-bc7d-3c0da5bc0c90 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 200 len: 1509 microversion: 2.1 time: 0.342889 Sep 07 13:25:20.255154 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3186/6336] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:19 2022] GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 1509 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:20.664466 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c6cd2bf9-5ced-4d84-8292-4f684b8185f0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:20.665080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c6cd2bf9-5ced-4d84-8292-4f684b8185f0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:20.687248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6cd2bf9-5ced-4d84-8292-4f684b8185f0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:20.687764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6cd2bf9-5ced-4d84-8292-4f684b8185f0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:20.688213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6cd2bf9-5ced-4d84-8292-4f684b8185f0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:20.688938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6cd2bf9-5ced-4d84-8292-4f684b8185f0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:20.689408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6cd2bf9-5ced-4d84-8292-4f684b8185f0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:20.689939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6cd2bf9-5ced-4d84-8292-4f684b8185f0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:21.278018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-922f67db-4411-4771-9787-cd369a3ba569 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:21.278722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-922f67db-4411-4771-9787-cd369a3ba569 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:21.285432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c6cd2bf9-5ced-4d84-8292-4f684b8185f0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:21.290695 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-922f67db-4411-4771-9787-cd369a3ba569 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:21.291231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-922f67db-4411-4771-9787-cd369a3ba569 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:21.297171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-922f67db-4411-4771-9787-cd369a3ba569 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:21.298324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-922f67db-4411-4771-9787-cd369a3ba569 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:21.299058 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-922f67db-4411-4771-9787-cd369a3ba569 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:21.299734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-922f67db-4411-4771-9787-cd369a3ba569 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:21.302746 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c6cd2bf9-5ced-4d84-8292-4f684b8185f0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1342 microversion: 2.1 time: 0.646781 Sep 07 13:25:21.303373 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3151/6337] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:20 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1342 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:21.761336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-922f67db-4411-4771-9787-cd369a3ba569 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900134259cce49f5bcb1e1d35a7690c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ab9fc262994a92a967325448662f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:21.779323 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-922f67db-4411-4771-9787-cd369a3ba569 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 200 len: 1492 microversion: 2.1 time: 0.505309 Sep 07 13:25:21.779932 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3187/6338] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:21 2022] GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 1492 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:21.815549 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c73279aa-05ab-4e34-b576-cea3bb0bdf38 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:21.816870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c73279aa-05ab-4e34-b576-cea3bb0bdf38 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:21.820200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=9 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:21.836599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c73279aa-05ab-4e34-b576-cea3bb0bdf38 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:21.837135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c73279aa-05ab-4e34-b576-cea3bb0bdf38 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:21.837650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c73279aa-05ab-4e34-b576-cea3bb0bdf38 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:21.838801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c73279aa-05ab-4e34-b576-cea3bb0bdf38 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:21.839273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c73279aa-05ab-4e34-b576-cea3bb0bdf38 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:21.839723 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c73279aa-05ab-4e34-b576-cea3bb0bdf38 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:21.987651 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c73279aa-05ab-4e34-b576-cea3bb0bdf38 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "POST /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5/action" status: 202 len: 0 microversion: 2.1 time: 0.182522 Sep 07 13:25:22.001847 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-072fe6d9-ca6a-41ea-9fe7-37cc5dc3a214 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:22.002856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-072fe6d9-ca6a-41ea-9fe7-37cc5dc3a214 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:22.008191 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3152/6339] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:25:21 2022] POST /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:25:22.017654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-072fe6d9-ca6a-41ea-9fe7-37cc5dc3a214 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:22.019099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-072fe6d9-ca6a-41ea-9fe7-37cc5dc3a214 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:22.019716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-072fe6d9-ca6a-41ea-9fe7-37cc5dc3a214 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:22.020734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-072fe6d9-ca6a-41ea-9fe7-37cc5dc3a214 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:22.021318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-072fe6d9-ca6a-41ea-9fe7-37cc5dc3a214 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:22.022415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-072fe6d9-ca6a-41ea-9fe7-37cc5dc3a214 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:22.332993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-52f9b588-6907-4617-9902-3b7e435f7cb5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:22.333765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-52f9b588-6907-4617-9902-3b7e435f7cb5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:22.352394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52f9b588-6907-4617-9902-3b7e435f7cb5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:22.356064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52f9b588-6907-4617-9902-3b7e435f7cb5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:22.356669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52f9b588-6907-4617-9902-3b7e435f7cb5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:22.367588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52f9b588-6907-4617-9902-3b7e435f7cb5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:22.368624 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52f9b588-6907-4617-9902-3b7e435f7cb5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:22.388691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-52f9b588-6907-4617-9902-3b7e435f7cb5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:22.527205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-072fe6d9-ca6a-41ea-9fe7-37cc5dc3a214 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900134259cce49f5bcb1e1d35a7690c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ab9fc262994a92a967325448662f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:22.542304 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-072fe6d9-ca6a-41ea-9fe7-37cc5dc3a214 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 200 len: 1498 microversion: 2.1 time: 0.547219 Sep 07 13:25:22.543283 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3188/6340] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:21 2022] GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 1498 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:22.794458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-52f9b588-6907-4617-9902-3b7e435f7cb5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:22.816243 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-52f9b588-6907-4617-9902-3b7e435f7cb5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1342 microversion: 2.1 time: 0.489112 Sep 07 13:25:22.839760 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3153/6341] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:22 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1342 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:23.193105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-aba7cd12-7dbf-416e-8ce8-8b15181b4a00 req-7ab0ae07-5c85-4546-bd75-0f3676b252b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eca73d9e-2af2-41b6-a572-d5315e5fd9c5", "tag": "f8d76d3b-75de-48ca-a244-76bffd5cd60e"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:23.220212 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=53 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:23.244918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-aba7cd12-7dbf-416e-8ce8-8b15181b4a00 req-7ab0ae07-5c85-4546-bd75-0f3676b252b0 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:23.245772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-aba7cd12-7dbf-416e-8ce8-8b15181b4a00 req-7ab0ae07-5c85-4546-bd75-0f3676b252b0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:23.246268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-aba7cd12-7dbf-416e-8ce8-8b15181b4a00 req-7ab0ae07-5c85-4546-bd75-0f3676b252b0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:23.339280 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-aba7cd12-7dbf-416e-8ce8-8b15181b4a00 req-7ab0ae07-5c85-4546-bd75-0f3676b252b0 service nova] Creating event network-changed:f8d76d3b-75de-48ca-a244-76bffd5cd60e for instance eca73d9e-2af2-41b6-a572-d5315e5fd9c5 on n-h2-852087-9 Sep 07 13:25:23.346281 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-aba7cd12-7dbf-416e-8ce8-8b15181b4a00 req-7ab0ae07-5c85-4546-bd75-0f3676b252b0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158346 Sep 07 13:25:23.347705 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3189/6342] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:23.570765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-16744ed1-5db3-4b94-8562-7157e2b4aa3a tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:23.571604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-16744ed1-5db3-4b94-8562-7157e2b4aa3a tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:23.587155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16744ed1-5db3-4b94-8562-7157e2b4aa3a tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:23.589709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16744ed1-5db3-4b94-8562-7157e2b4aa3a tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:23.590444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16744ed1-5db3-4b94-8562-7157e2b4aa3a tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:23.593468 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16744ed1-5db3-4b94-8562-7157e2b4aa3a tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:23.594626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16744ed1-5db3-4b94-8562-7157e2b4aa3a tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:23.600008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16744ed1-5db3-4b94-8562-7157e2b4aa3a tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:23.849236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-60fcab44-4ddb-4efa-a798-2beefc3aae11 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:23.852084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-60fcab44-4ddb-4efa-a798-2beefc3aae11 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:23.871804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60fcab44-4ddb-4efa-a798-2beefc3aae11 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:23.873396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60fcab44-4ddb-4efa-a798-2beefc3aae11 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:23.874094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60fcab44-4ddb-4efa-a798-2beefc3aae11 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:23.877244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60fcab44-4ddb-4efa-a798-2beefc3aae11 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:23.878698 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60fcab44-4ddb-4efa-a798-2beefc3aae11 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:23.881965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-60fcab44-4ddb-4efa-a798-2beefc3aae11 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:24.283204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-16744ed1-5db3-4b94-8562-7157e2b4aa3a tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900134259cce49f5bcb1e1d35a7690c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ab9fc262994a92a967325448662f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:24.296050 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-16744ed1-5db3-4b94-8562-7157e2b4aa3a tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 200 len: 1498 microversion: 2.1 time: 0.731097 Sep 07 13:25:24.298939 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3154/6343] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:23 2022] GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 1498 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:24.507718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-60fcab44-4ddb-4efa-a798-2beefc3aae11 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:24.520868 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-60fcab44-4ddb-4efa-a798-2beefc3aae11 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1342 microversion: 2.1 time: 0.676046 Sep 07 13:25:24.523666 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3190/6344] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:23 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1342 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:25.344812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c24b3bc5-d8ab-4e29-b09f-173e4dee3e4e tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:25.345657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c24b3bc5-d8ab-4e29-b09f-173e4dee3e4e tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:25.359731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c24b3bc5-d8ab-4e29-b09f-173e4dee3e4e tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:25.361043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c24b3bc5-d8ab-4e29-b09f-173e4dee3e4e tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:25.361610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c24b3bc5-d8ab-4e29-b09f-173e4dee3e4e tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:25.362517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c24b3bc5-d8ab-4e29-b09f-173e4dee3e4e tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:25.363026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c24b3bc5-d8ab-4e29-b09f-173e4dee3e4e tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:25.363680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c24b3bc5-d8ab-4e29-b09f-173e4dee3e4e tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:25.556964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3731e00e-d57b-4c63-b92b-fbe0de55f87b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:25.559065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3731e00e-d57b-4c63-b92b-fbe0de55f87b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:25.574772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3731e00e-d57b-4c63-b92b-fbe0de55f87b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:25.580073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3731e00e-d57b-4c63-b92b-fbe0de55f87b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:25.580687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3731e00e-d57b-4c63-b92b-fbe0de55f87b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:25.582230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3731e00e-d57b-4c63-b92b-fbe0de55f87b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:25.582787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3731e00e-d57b-4c63-b92b-fbe0de55f87b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:25.583248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3731e00e-d57b-4c63-b92b-fbe0de55f87b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:25.762947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c24b3bc5-d8ab-4e29-b09f-173e4dee3e4e tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900134259cce49f5bcb1e1d35a7690c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ab9fc262994a92a967325448662f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:25.778718 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c24b3bc5-d8ab-4e29-b09f-173e4dee3e4e tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 200 len: 1501 microversion: 2.1 time: 0.438318 Sep 07 13:25:25.779956 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3155/6345] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:25 2022] GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 1501 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:25:25.828200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a0061e9f-8e50-4459-83f7-6200fad14336 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:25.828824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a0061e9f-8e50-4459-83f7-6200fad14336 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:25.844989 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0061e9f-8e50-4459-83f7-6200fad14336 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:25.845655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0061e9f-8e50-4459-83f7-6200fad14336 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:25.846121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0061e9f-8e50-4459-83f7-6200fad14336 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:25.847095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0061e9f-8e50-4459-83f7-6200fad14336 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:25.847575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0061e9f-8e50-4459-83f7-6200fad14336 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:25.848013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a0061e9f-8e50-4459-83f7-6200fad14336 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:25.915273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3731e00e-d57b-4c63-b92b-fbe0de55f87b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:25.945104 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3731e00e-d57b-4c63-b92b-fbe0de55f87b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1342 microversion: 2.1 time: 0.398598 Sep 07 13:25:25.946419 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3191/6346] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:25 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1342 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:25.947586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-a0061e9f-8e50-4459-83f7-6200fad14336 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lazy-loading 'flavor' on Instance uuid 9b83ef98-20b5-475a-b189-e01b3c61a7c5 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:25:26.130012 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a0061e9f-8e50-4459-83f7-6200fad14336 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "POST /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5/action" status: 202 len: 0 microversion: 2.1 time: 0.311229 Sep 07 13:25:26.135207 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3156/6347] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:25:25 2022] POST /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:25:26.152125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-422cc557-387d-4674-b73e-ad1f886ad107 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:26.156422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-422cc557-387d-4674-b73e-ad1f886ad107 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:26.178892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-422cc557-387d-4674-b73e-ad1f886ad107 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:26.179712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-422cc557-387d-4674-b73e-ad1f886ad107 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:26.180257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-422cc557-387d-4674-b73e-ad1f886ad107 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:26.181192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-422cc557-387d-4674-b73e-ad1f886ad107 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:26.182197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-422cc557-387d-4674-b73e-ad1f886ad107 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:26.183855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-422cc557-387d-4674-b73e-ad1f886ad107 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:26.568912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-053777eb-23f6-41bf-9f75-91a2c7c7f0a3 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:26.575010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-053777eb-23f6-41bf-9f75-91a2c7c7f0a3 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:26.603505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-053777eb-23f6-41bf-9f75-91a2c7c7f0a3 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:26.606974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-053777eb-23f6-41bf-9f75-91a2c7c7f0a3 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:26.611063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-053777eb-23f6-41bf-9f75-91a2c7c7f0a3 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:26.612956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-053777eb-23f6-41bf-9f75-91a2c7c7f0a3 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:26.615099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-053777eb-23f6-41bf-9f75-91a2c7c7f0a3 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:26.615935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-053777eb-23f6-41bf-9f75-91a2c7c7f0a3 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:26.628165 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-422cc557-387d-4674-b73e-ad1f886ad107 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900134259cce49f5bcb1e1d35a7690c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ab9fc262994a92a967325448662f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:26.645523 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-422cc557-387d-4674-b73e-ad1f886ad107 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 200 len: 1509 microversion: 2.1 time: 0.507842 Sep 07 13:25:26.646510 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3157/6348] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:26 2022] GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 1509 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:26.908527 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-053777eb-23f6-41bf-9f75-91a2c7c7f0a3 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1832 microversion: 2.1 time: 0.960321 Sep 07 13:25:26.909178 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3192/6349] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:25 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1832 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:26.973621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c5bfb52d-1ab7-45d8-92ad-99f5b6dc64ab tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:26.975364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c5bfb52d-1ab7-45d8-92ad-99f5b6dc64ab tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:27.004503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5bfb52d-1ab7-45d8-92ad-99f5b6dc64ab tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:27.005313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5bfb52d-1ab7-45d8-92ad-99f5b6dc64ab tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:27.008931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5bfb52d-1ab7-45d8-92ad-99f5b6dc64ab tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:27.009984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5bfb52d-1ab7-45d8-92ad-99f5b6dc64ab tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:27.010696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5bfb52d-1ab7-45d8-92ad-99f5b6dc64ab tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:27.011099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5bfb52d-1ab7-45d8-92ad-99f5b6dc64ab tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:27.684410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d6d88c98-2195-466b-ae5c-82dc8b207bee tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:27.685296 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d6d88c98-2195-466b-ae5c-82dc8b207bee tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:27.695119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6d88c98-2195-466b-ae5c-82dc8b207bee tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:27.695891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6d88c98-2195-466b-ae5c-82dc8b207bee tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:27.696569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6d88c98-2195-466b-ae5c-82dc8b207bee tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:27.698317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6d88c98-2195-466b-ae5c-82dc8b207bee tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:27.699042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6d88c98-2195-466b-ae5c-82dc8b207bee tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:27.699931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6d88c98-2195-466b-ae5c-82dc8b207bee tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:28.053748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c5bfb52d-1ab7-45d8-92ad-99f5b6dc64ab tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:28.094792 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c5bfb52d-1ab7-45d8-92ad-99f5b6dc64ab tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1342 microversion: 2.1 time: 1.125034 Sep 07 13:25:28.099730 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3158/6350] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:26 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1342 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:28.157778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d6d88c98-2195-466b-ae5c-82dc8b207bee tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900134259cce49f5bcb1e1d35a7690c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ab9fc262994a92a967325448662f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:28.176562 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d6d88c98-2195-466b-ae5c-82dc8b207bee tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 200 len: 1492 microversion: 2.1 time: 0.496345 Sep 07 13:25:28.179370 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3193/6351] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:27 2022] GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 1492 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:25:28.241513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-184e2210-8260-402c-9313-dc3bacc280bc tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:28.242066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-184e2210-8260-402c-9313-dc3bacc280bc tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:28.247938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:28.254693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:28.276109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-184e2210-8260-402c-9313-dc3bacc280bc tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:28.277071 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-184e2210-8260-402c-9313-dc3bacc280bc tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:28.278569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-184e2210-8260-402c-9313-dc3bacc280bc tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:28.283100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-184e2210-8260-402c-9313-dc3bacc280bc tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:28.284488 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-184e2210-8260-402c-9313-dc3bacc280bc tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:28.286795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-184e2210-8260-402c-9313-dc3bacc280bc tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:28.570488 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-184e2210-8260-402c-9313-dc3bacc280bc tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "POST /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5/action" status: 202 len: 0 microversion: 2.1 time: 0.331490 Sep 07 13:25:28.572923 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3159/6352] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:25:28 2022] POST /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:25:28.583800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2eb0e253-f30b-4c99-9c3d-f8e87f1517f5 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:28.584915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2eb0e253-f30b-4c99-9c3d-f8e87f1517f5 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:28.594200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:28.596782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2eb0e253-f30b-4c99-9c3d-f8e87f1517f5 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:28.597975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2eb0e253-f30b-4c99-9c3d-f8e87f1517f5 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:28.598790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2eb0e253-f30b-4c99-9c3d-f8e87f1517f5 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:28.600168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2eb0e253-f30b-4c99-9c3d-f8e87f1517f5 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:28.601164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2eb0e253-f30b-4c99-9c3d-f8e87f1517f5 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:28.602745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2eb0e253-f30b-4c99-9c3d-f8e87f1517f5 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:28.736743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ddfbc34d-a98d-4686-8b62-ab23245a5276 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Action: 'create', calling method: .version_select at 0x7fc4138b08b0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1647738040", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaq1XAgpI2oXB0JtLnzO8RnMAN2X82sC+DWQVeSSs30jClVcZsyFidRcLD6VQulhHqm6Eusg8DGHH9pKhU9Ermlc9QKGWkvzMlv2pX6XKSRqnFTKGw/7mTQobY5OystSg=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:28.808078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-ddfbc34d-a98d-4686-8b62-ab23245a5276 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Getting quotas for project 2bbb0cc60bcc4538a2a7ba695efcf613. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:25:28.822762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-ddfbc34d-a98d-4686-8b62-ab23245a5276 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Getting quotas for user 3fc5e615495243fd8fe6541e6c828a45 and project 2bbb0cc60bcc4538a2a7ba695efcf613. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:25:28.919310 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ddfbc34d-a98d-4686-8b62-ab23245a5276 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.187635 Sep 07 13:25:28.922170 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3160/6353] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 13:25:28 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:29.082055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2eb0e253-f30b-4c99-9c3d-f8e87f1517f5 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900134259cce49f5bcb1e1d35a7690c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ab9fc262994a92a967325448662f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:29.099116 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2eb0e253-f30b-4c99-9c3d-f8e87f1517f5 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 200 len: 1498 microversion: 2.1 time: 0.519068 Sep 07 13:25:29.106110 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3194/6354] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:28 2022] GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 1498 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:29.139383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e3547fb-484b-4a96-8381-5719498620d3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:29.142969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6e3547fb-484b-4a96-8381-5719498620d3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:29.153743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e3547fb-484b-4a96-8381-5719498620d3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:29.155256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e3547fb-484b-4a96-8381-5719498620d3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:29.156134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e3547fb-484b-4a96-8381-5719498620d3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:29.160095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e3547fb-484b-4a96-8381-5719498620d3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:29.160907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e3547fb-484b-4a96-8381-5719498620d3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:29.162502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e3547fb-484b-4a96-8381-5719498620d3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:29.177192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:29.611008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6e3547fb-484b-4a96-8381-5719498620d3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:29.658436 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6e3547fb-484b-4a96-8381-5719498620d3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1342 microversion: 2.1 time: 0.525982 Sep 07 13:25:29.663058 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3161/6355] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:29 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1342 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:30.135357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-94aa2899-50c9-4257-a4f9-533bef4e12ac tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:30.136243 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-94aa2899-50c9-4257-a4f9-533bef4e12ac tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:30.144330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94aa2899-50c9-4257-a4f9-533bef4e12ac tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:30.145244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94aa2899-50c9-4257-a4f9-533bef4e12ac tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:30.145947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94aa2899-50c9-4257-a4f9-533bef4e12ac tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:30.147019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94aa2899-50c9-4257-a4f9-533bef4e12ac tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:30.147881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94aa2899-50c9-4257-a4f9-533bef4e12ac tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:30.149030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94aa2899-50c9-4257-a4f9-533bef4e12ac tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:30.490500 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-671c5091-f267-4525-9e33-df68cc55d04c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:30.491080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-671c5091-f267-4525-9e33-df68cc55d04c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:30.540066 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-94aa2899-50c9-4257-a4f9-533bef4e12ac tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900134259cce49f5bcb1e1d35a7690c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ab9fc262994a92a967325448662f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:30.543953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-671c5091-f267-4525-9e33-df68cc55d04c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:30.547756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-671c5091-f267-4525-9e33-df68cc55d04c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:30.548879 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-671c5091-f267-4525-9e33-df68cc55d04c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:30.556082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-671c5091-f267-4525-9e33-df68cc55d04c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:30.557659 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-94aa2899-50c9-4257-a4f9-533bef4e12ac tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 200 len: 1498 microversion: 2.1 time: 0.424255 Sep 07 13:25:30.558609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-671c5091-f267-4525-9e33-df68cc55d04c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:30.563687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-671c5091-f267-4525-9e33-df68cc55d04c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:30.566122 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3195/6356] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:30 2022] GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 1498 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:25:30.607930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-df222adf-32e9-4921-ab13-6bbec49af55d req-b6fb0b4f-ed2b-4fec-8bb2-e2fca524a9ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431", "tag": "4de6c447-da78-427b-b139-6c02f7484224"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:30.652549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-df222adf-32e9-4921-ab13-6bbec49af55d req-b6fb0b4f-ed2b-4fec-8bb2-e2fca524a9ec service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:30.654492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-df222adf-32e9-4921-ab13-6bbec49af55d req-b6fb0b4f-ed2b-4fec-8bb2-e2fca524a9ec service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:30.655895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-df222adf-32e9-4921-ab13-6bbec49af55d req-b6fb0b4f-ed2b-4fec-8bb2-e2fca524a9ec service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:30.699246 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-df222adf-32e9-4921-ab13-6bbec49af55d req-b6fb0b4f-ed2b-4fec-8bb2-e2fca524a9ec service nova] Creating event network-changed:4de6c447-da78-427b-b139-6c02f7484224 for instance 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 on n-h1-852087-9 Sep 07 13:25:30.715615 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-df222adf-32e9-4921-ab13-6bbec49af55d req-b6fb0b4f-ed2b-4fec-8bb2-e2fca524a9ec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144878 Sep 07 13:25:30.716639 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3196/6357] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:30.731397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d541931c-c426-40ef-8842-84e211ad6246 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:30.732651 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d541931c-c426-40ef-8842-84e211ad6246 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:30.744372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d541931c-c426-40ef-8842-84e211ad6246 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:30.745359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d541931c-c426-40ef-8842-84e211ad6246 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:30.747519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d541931c-c426-40ef-8842-84e211ad6246 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:30.750553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d541931c-c426-40ef-8842-84e211ad6246 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:30.751802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d541931c-c426-40ef-8842-84e211ad6246 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:30.752876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d541931c-c426-40ef-8842-84e211ad6246 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:30.780210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-671c5091-f267-4525-9e33-df68cc55d04c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:25:31.016372 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-671c5091-f267-4525-9e33-df68cc55d04c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 204 len: 0 microversion: 2.1 time: 0.536752 Sep 07 13:25:31.017885 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3162/6358] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:25:30 2022] DELETE /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:25:31.031672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0311e870-04ca-43a5-84cf-a54200bcd7eb tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:31.032429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0311e870-04ca-43a5-84cf-a54200bcd7eb tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:31.142644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0311e870-04ca-43a5-84cf-a54200bcd7eb tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:31.150254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0311e870-04ca-43a5-84cf-a54200bcd7eb tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:31.157329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0311e870-04ca-43a5-84cf-a54200bcd7eb tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:31.158578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0311e870-04ca-43a5-84cf-a54200bcd7eb tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:31.166371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0311e870-04ca-43a5-84cf-a54200bcd7eb tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:31.169053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0311e870-04ca-43a5-84cf-a54200bcd7eb tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:31.572143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d541931c-c426-40ef-8842-84e211ad6246 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:31.588929 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d541931c-c426-40ef-8842-84e211ad6246 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1342 microversion: 2.1 time: 0.865059 Sep 07 13:25:31.605890 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3197/6359] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:30 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1342 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:31.650377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-42a50e91-b780-4f8f-b186-83c85def371b tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:31.651430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-42a50e91-b780-4f8f-b186-83c85def371b tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:31.673244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0311e870-04ca-43a5-84cf-a54200bcd7eb tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:31.682220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42a50e91-b780-4f8f-b186-83c85def371b tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:31.685209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42a50e91-b780-4f8f-b186-83c85def371b tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:31.685976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42a50e91-b780-4f8f-b186-83c85def371b tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:31.688519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42a50e91-b780-4f8f-b186-83c85def371b tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:31.693766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42a50e91-b780-4f8f-b186-83c85def371b tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:31.694666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-42a50e91-b780-4f8f-b186-83c85def371b tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:31.696211 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0311e870-04ca-43a5-84cf-a54200bcd7eb tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1687 microversion: 2.1 time: 0.667980 Sep 07 13:25:31.700185 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3163/6360] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:31 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1687 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:32.064872 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-42a50e91-b780-4f8f-b186-83c85def371b tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900134259cce49f5bcb1e1d35a7690c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ab9fc262994a92a967325448662f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:32.077011 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-42a50e91-b780-4f8f-b186-83c85def371b tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 200 len: 1501 microversion: 2.1 time: 0.437682 Sep 07 13:25:32.119959 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3198/6361] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:31 2022] GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 1501 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:32.131823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c4d18a5b-37ac-4318-9911-9989e7dbdd03 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:32.135700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c4d18a5b-37ac-4318-9911-9989e7dbdd03 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:32.168027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4d18a5b-37ac-4318-9911-9989e7dbdd03 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:32.169307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4d18a5b-37ac-4318-9911-9989e7dbdd03 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:32.173832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4d18a5b-37ac-4318-9911-9989e7dbdd03 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:32.175333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4d18a5b-37ac-4318-9911-9989e7dbdd03 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:32.176207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4d18a5b-37ac-4318-9911-9989e7dbdd03 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:32.177000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c4d18a5b-37ac-4318-9911-9989e7dbdd03 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:32.288251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c4d18a5b-37ac-4318-9911-9989e7dbdd03 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:25:32.623377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-16b33c37-f7a5-452b-a368-e420ad330d2c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:32.625078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-16b33c37-f7a5-452b-a368-e420ad330d2c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:32.639207 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c4d18a5b-37ac-4318-9911-9989e7dbdd03 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 204 len: 0 microversion: 2.1 time: 0.509753 Sep 07 13:25:32.648117 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3164/6362] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:25:32 2022] DELETE /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:25:32.649025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16b33c37-f7a5-452b-a368-e420ad330d2c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:32.651142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16b33c37-f7a5-452b-a368-e420ad330d2c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:32.659067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16b33c37-f7a5-452b-a368-e420ad330d2c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:32.662184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16b33c37-f7a5-452b-a368-e420ad330d2c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:32.666514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16b33c37-f7a5-452b-a368-e420ad330d2c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:32.672009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16b33c37-f7a5-452b-a368-e420ad330d2c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:32.676636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-47745949-51b5-4970-b3c4-c6dce4bfe1fc tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:32.682155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-47745949-51b5-4970-b3c4-c6dce4bfe1fc tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:32.715386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47745949-51b5-4970-b3c4-c6dce4bfe1fc tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:32.716232 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47745949-51b5-4970-b3c4-c6dce4bfe1fc tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:32.716883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47745949-51b5-4970-b3c4-c6dce4bfe1fc tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:32.720204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47745949-51b5-4970-b3c4-c6dce4bfe1fc tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:32.721343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47745949-51b5-4970-b3c4-c6dce4bfe1fc tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:32.722513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47745949-51b5-4970-b3c4-c6dce4bfe1fc tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:33.128033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-16b33c37-f7a5-452b-a368-e420ad330d2c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:33.143793 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-16b33c37-f7a5-452b-a368-e420ad330d2c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1342 microversion: 2.1 time: 0.525965 Sep 07 13:25:33.149204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-47745949-51b5-4970-b3c4-c6dce4bfe1fc tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900134259cce49f5bcb1e1d35a7690c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ab9fc262994a92a967325448662f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:33.154179 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3199/6363] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:32 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1342 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:33.163123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-14ee54fe-5396-4ef9-b5d3-9ae32b736ee1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:33.164036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-14ee54fe-5396-4ef9-b5d3-9ae32b736ee1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:33.170838 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-47745949-51b5-4970-b3c4-c6dce4bfe1fc tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 200 len: 1507 microversion: 2.1 time: 0.516397 Sep 07 13:25:33.176051 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3165/6364] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:32 2022] GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 1507 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:25:33.179947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ee54fe-5396-4ef9-b5d3-9ae32b736ee1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:33.180775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ee54fe-5396-4ef9-b5d3-9ae32b736ee1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:33.181528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ee54fe-5396-4ef9-b5d3-9ae32b736ee1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:33.182746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ee54fe-5396-4ef9-b5d3-9ae32b736ee1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:33.184550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ee54fe-5396-4ef9-b5d3-9ae32b736ee1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:33.185651 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-14ee54fe-5396-4ef9-b5d3-9ae32b736ee1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:33.540025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e2281f70-14f5-4f93-afab-a5729a221dcc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1274532968", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "96afbe42-70f1-4b4e-b280-64e23afd43fd"}], "key_name": "tempest-TestNetworkBasicOps-1647738040", "security_groups": [{"name": "tempest-secgroup-smoke-1751056467"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:33.582608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-14ee54fe-5396-4ef9-b5d3-9ae32b736ee1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:33.619443 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-14ee54fe-5396-4ef9-b5d3-9ae32b736ee1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1687 microversion: 2.1 time: 0.460114 Sep 07 13:25:33.620544 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3200/6365] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:33 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1687 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:33.799456 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-e2281f70-14f5-4f93-afab-a5729a221dcc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] validate_networks() for [('96afbe42-70f1-4b4e-b280-64e23afd43fd', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:25:34.192359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e1cfeb4d-1633-4148-b57f-4a1c5a805db9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:34.193332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e1cfeb4d-1633-4148-b57f-4a1c5a805db9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:34.217985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1cfeb4d-1633-4148-b57f-4a1c5a805db9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:34.218925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1cfeb4d-1633-4148-b57f-4a1c5a805db9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:34.219980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1cfeb4d-1633-4148-b57f-4a1c5a805db9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:34.221642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1cfeb4d-1633-4148-b57f-4a1c5a805db9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:34.222477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1cfeb4d-1633-4148-b57f-4a1c5a805db9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:34.223506 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1cfeb4d-1633-4148-b57f-4a1c5a805db9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:34.596362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e2281f70-14f5-4f93-afab-a5729a221dcc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:25:34.596799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e2281f70-14f5-4f93-afab-a5729a221dcc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:25:34.597936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e2281f70-14f5-4f93-afab-a5729a221dcc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:25:34.599845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e2281f70-14f5-4f93-afab-a5729a221dcc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:25:34.600759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e2281f70-14f5-4f93-afab-a5729a221dcc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:25:34.624993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2281f70-14f5-4f93-afab-a5729a221dcc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:34.625745 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2281f70-14f5-4f93-afab-a5729a221dcc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:34.626084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2281f70-14f5-4f93-afab-a5729a221dcc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:34.626749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2281f70-14f5-4f93-afab-a5729a221dcc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:34.627242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2281f70-14f5-4f93-afab-a5729a221dcc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:34.629236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2281f70-14f5-4f93-afab-a5729a221dcc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:34.643288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e1cfeb4d-1633-4148-b57f-4a1c5a805db9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:34.664887 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e1cfeb4d-1633-4148-b57f-4a1c5a805db9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1342 microversion: 2.1 time: 0.477113 Sep 07 13:25:34.665782 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3201/6366] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:34 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1342 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:25:34.669888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-e2281f70-14f5-4f93-afab-a5729a221dcc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Getting quotas for project 2bbb0cc60bcc4538a2a7ba695efcf613. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:25:34.686947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-03c52624-af0c-4607-bd46-7fd1b60cf2b4 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:34.688715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-03c52624-af0c-4607-bd46-7fd1b60cf2b4 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:34.692023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-e2281f70-14f5-4f93-afab-a5729a221dcc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Getting quotas for user 3fc5e615495243fd8fe6541e6c828a45 and project 2bbb0cc60bcc4538a2a7ba695efcf613. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:25:34.701477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03c52624-af0c-4607-bd46-7fd1b60cf2b4 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:34.702039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03c52624-af0c-4607-bd46-7fd1b60cf2b4 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:34.702710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03c52624-af0c-4607-bd46-7fd1b60cf2b4 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:34.703448 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03c52624-af0c-4607-bd46-7fd1b60cf2b4 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:34.703923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03c52624-af0c-4607-bd46-7fd1b60cf2b4 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:34.704361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03c52624-af0c-4607-bd46-7fd1b60cf2b4 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:34.720748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e2281f70-14f5-4f93-afab-a5729a221dcc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:25:34.724126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e2281f70-14f5-4f93-afab-a5729a221dcc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 4b030e3a-49f7-4481-98a9-878906e601b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:25:34.790360 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e2281f70-14f5-4f93-afab-a5729a221dcc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.260542 Sep 07 13:25:34.791059 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3166/6367] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:25:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:25:34.804923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d42101c0-3f76-41cf-ae1b-c657a28e3455 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:34.805878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d42101c0-3f76-41cf-ae1b-c657a28e3455 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:34.833437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d42101c0-3f76-41cf-ae1b-c657a28e3455 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:34.834160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d42101c0-3f76-41cf-ae1b-c657a28e3455 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:34.834683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d42101c0-3f76-41cf-ae1b-c657a28e3455 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:34.835434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d42101c0-3f76-41cf-ae1b-c657a28e3455 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:34.835904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d42101c0-3f76-41cf-ae1b-c657a28e3455 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:34.836339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d42101c0-3f76-41cf-ae1b-c657a28e3455 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:34.889792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-03c52624-af0c-4607-bd46-7fd1b60cf2b4 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900134259cce49f5bcb1e1d35a7690c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ab9fc262994a92a967325448662f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:34.907990 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-03c52624-af0c-4607-bd46-7fd1b60cf2b4 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 200 len: 1507 microversion: 2.1 time: 0.235799 Sep 07 13:25:34.914755 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3202/6368] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:34 2022] GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 1507 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:34.926509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0679046a-d2cb-406f-98df-f78cfe2555de tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:34.927336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0679046a-d2cb-406f-98df-f78cfe2555de tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 4b030e3a-49f7-4481-98a9-878906e601b3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:35.184586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0679046a-d2cb-406f-98df-f78cfe2555de tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:35.233309 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0679046a-d2cb-406f-98df-f78cfe2555de tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3" status: 200 len: 1249 microversion: 2.1 time: 0.315095 Sep 07 13:25:35.241466 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3203/6369] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:34 2022] GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3 => generated 1249 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:35.280747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d42101c0-3f76-41cf-ae1b-c657a28e3455 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:35.295390 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d42101c0-3f76-41cf-ae1b-c657a28e3455 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1687 microversion: 2.1 time: 0.502752 Sep 07 13:25:35.296469 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3167/6370] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:34 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1687 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:35.698219 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1357ecb7-4509-48f9-87b2-0a250a6dffcb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:35.699476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1357ecb7-4509-48f9-87b2-0a250a6dffcb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:35.727057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1357ecb7-4509-48f9-87b2-0a250a6dffcb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:35.730514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1357ecb7-4509-48f9-87b2-0a250a6dffcb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:35.733338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1357ecb7-4509-48f9-87b2-0a250a6dffcb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:35.736694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1357ecb7-4509-48f9-87b2-0a250a6dffcb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:35.737665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1357ecb7-4509-48f9-87b2-0a250a6dffcb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:35.738528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1357ecb7-4509-48f9-87b2-0a250a6dffcb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:35.747387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:35.938490 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7f620822-4c37-4337-bb06-4f192d511f2b tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:35.942975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7f620822-4c37-4337-bb06-4f192d511f2b tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:35.966703 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f620822-4c37-4337-bb06-4f192d511f2b tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:35.970277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f620822-4c37-4337-bb06-4f192d511f2b tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:35.971131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f620822-4c37-4337-bb06-4f192d511f2b tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:35.976397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f620822-4c37-4337-bb06-4f192d511f2b tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:35.978089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f620822-4c37-4337-bb06-4f192d511f2b tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:35.979430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f620822-4c37-4337-bb06-4f192d511f2b tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:36.149203 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7f620822-4c37-4337-bb06-4f192d511f2b tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900134259cce49f5bcb1e1d35a7690c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ab9fc262994a92a967325448662f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:36.173308 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7f620822-4c37-4337-bb06-4f192d511f2b tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 200 len: 1465 microversion: 2.1 time: 0.243700 Sep 07 13:25:36.174169 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3168/6371] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:35 2022] GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 1465 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:36.185438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1357ecb7-4509-48f9-87b2-0a250a6dffcb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:36.186375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-5829c94d-9d4f-42c7-b72d-734d7d4d0c50 req-7882d062-57be-4e2b-a849-7e8ac1472885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431", "name": "network-vif-deleted", "tag": "4de6c447-da78-427b-b139-6c02f7484224"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:36.204169 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1357ecb7-4509-48f9-87b2-0a250a6dffcb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1342 microversion: 2.1 time: 0.510723 Sep 07 13:25:36.208601 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3204/6372] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:35 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1342 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:36.222548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5829c94d-9d4f-42c7-b72d-734d7d4d0c50 req-7882d062-57be-4e2b-a849-7e8ac1472885 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:36.226389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5829c94d-9d4f-42c7-b72d-734d7d4d0c50 req-7882d062-57be-4e2b-a849-7e8ac1472885 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:36.227343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5829c94d-9d4f-42c7-b72d-734d7d4d0c50 req-7882d062-57be-4e2b-a849-7e8ac1472885 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:36.227628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-f465fefd-e942-4453-8ae9-cd5744192dc1 req-e4f620b6-fecd-43df-b239-ab1014979d66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b83ef98-20b5-475a-b189-e01b3c61a7c5", "name": "network-vif-deleted", "tag": "fd19b6ca-97cd-4f03-9bd1-a3d101a68b33"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:36.242384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f465fefd-e942-4453-8ae9-cd5744192dc1 req-e4f620b6-fecd-43df-b239-ab1014979d66 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:36.243292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f465fefd-e942-4453-8ae9-cd5744192dc1 req-e4f620b6-fecd-43df-b239-ab1014979d66 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:36.243602 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f465fefd-e942-4453-8ae9-cd5744192dc1 req-e4f620b6-fecd-43df-b239-ab1014979d66 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:36.247062 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-5829c94d-9d4f-42c7-b72d-734d7d4d0c50 req-7882d062-57be-4e2b-a849-7e8ac1472885 service nova] Creating event network-vif-deleted:4de6c447-da78-427b-b139-6c02f7484224 for instance 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 on n-h1-852087-9 Sep 07 13:25:36.255749 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-5829c94d-9d4f-42c7-b72d-734d7d4d0c50 req-7882d062-57be-4e2b-a849-7e8ac1472885 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079898 Sep 07 13:25:36.256750 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3169/6373] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:36.262288 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-f465fefd-e942-4453-8ae9-cd5744192dc1 req-e4f620b6-fecd-43df-b239-ab1014979d66 service nova] Creating event network-vif-deleted:fd19b6ca-97cd-4f03-9bd1-a3d101a68b33 for instance 9b83ef98-20b5-475a-b189-e01b3c61a7c5 on n-h1-852087-9 Sep 07 13:25:36.279299 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-f465fefd-e942-4453-8ae9-cd5744192dc1 req-e4f620b6-fecd-43df-b239-ab1014979d66 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067989 Sep 07 13:25:36.279672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ecb35953-e8fb-4bb8-b128-6e759cfce34a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:36.280552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ecb35953-e8fb-4bb8-b128-6e759cfce34a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 4b030e3a-49f7-4481-98a9-878906e601b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:36.287383 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3205/6374] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:36.289880 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecb35953-e8fb-4bb8-b128-6e759cfce34a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:36.290523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecb35953-e8fb-4bb8-b128-6e759cfce34a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:36.290979 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecb35953-e8fb-4bb8-b128-6e759cfce34a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:36.292058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecb35953-e8fb-4bb8-b128-6e759cfce34a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:36.293860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecb35953-e8fb-4bb8-b128-6e759cfce34a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:36.294440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecb35953-e8fb-4bb8-b128-6e759cfce34a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:36.359442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-89a4deba-9d11-456e-9882-799d221501d9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:36.365515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-89a4deba-9d11-456e-9882-799d221501d9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:36.393599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89a4deba-9d11-456e-9882-799d221501d9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:36.395620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89a4deba-9d11-456e-9882-799d221501d9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:36.396766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89a4deba-9d11-456e-9882-799d221501d9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:36.398957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89a4deba-9d11-456e-9882-799d221501d9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:36.400577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89a4deba-9d11-456e-9882-799d221501d9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:36.401941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89a4deba-9d11-456e-9882-799d221501d9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:36.435754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ecb35953-e8fb-4bb8-b128-6e759cfce34a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:36.445064 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ecb35953-e8fb-4bb8-b128-6e759cfce34a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3" status: 200 len: 1301 microversion: 2.1 time: 0.173403 Sep 07 13:25:36.445696 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3170/6375] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:36 2022] GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3 => generated 1301 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:36.493587 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89a4deba-9d11-456e-9882-799d221501d9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:36.494722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89a4deba-9d11-456e-9882-799d221501d9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:36.496932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89a4deba-9d11-456e-9882-799d221501d9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:36.498042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-89a4deba-9d11-456e-9882-799d221501d9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lazy-loading 'fault' on Instance uuid 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:25:36.561999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-89a4deba-9d11-456e-9882-799d221501d9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:36.571918 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-89a4deba-9d11-456e-9882-799d221501d9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 200 len: 1356 microversion: 2.1 time: 0.236494 Sep 07 13:25:36.572584 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3206/6376] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:36 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 1356 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:37.243558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aa16b1fc-7360-477d-9513-9b05986e9bb8 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:37.244988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aa16b1fc-7360-477d-9513-9b05986e9bb8 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:37.258237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa16b1fc-7360-477d-9513-9b05986e9bb8 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:37.258747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa16b1fc-7360-477d-9513-9b05986e9bb8 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:37.259671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa16b1fc-7360-477d-9513-9b05986e9bb8 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:37.260659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa16b1fc-7360-477d-9513-9b05986e9bb8 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:37.261645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa16b1fc-7360-477d-9513-9b05986e9bb8 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:37.262433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa16b1fc-7360-477d-9513-9b05986e9bb8 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:37.266334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-36bfc212-579c-4c9f-87d5-2bafee5f4a75 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:37.267378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-36bfc212-579c-4c9f-87d5-2bafee5f4a75 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:37.291652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36bfc212-579c-4c9f-87d5-2bafee5f4a75 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:37.293987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36bfc212-579c-4c9f-87d5-2bafee5f4a75 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:37.294708 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36bfc212-579c-4c9f-87d5-2bafee5f4a75 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:37.295716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36bfc212-579c-4c9f-87d5-2bafee5f4a75 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:37.296530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36bfc212-579c-4c9f-87d5-2bafee5f4a75 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:37.303204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36bfc212-579c-4c9f-87d5-2bafee5f4a75 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:37.327330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa16b1fc-7360-477d-9513-9b05986e9bb8 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:37.328530 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa16b1fc-7360-477d-9513-9b05986e9bb8 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:37.329669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa16b1fc-7360-477d-9513-9b05986e9bb8 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:37.330801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-aa16b1fc-7360-477d-9513-9b05986e9bb8 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lazy-loading 'fault' on Instance uuid 9b83ef98-20b5-475a-b189-e01b3c61a7c5 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:25:37.480931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aa16b1fc-7360-477d-9513-9b05986e9bb8 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '900134259cce49f5bcb1e1d35a7690c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ab9fc262994a92a967325448662f61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:37.508625 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aa16b1fc-7360-477d-9513-9b05986e9bb8 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 200 len: 1304 microversion: 2.1 time: 0.273726 Sep 07 13:25:37.509392 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3171/6377] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:37 2022] GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 1304 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:25:37.524837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-96aaaafd-b25e-4c9f-b0d8-8f11c5e4014e tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:37.524837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-96aaaafd-b25e-4c9f-b0d8-8f11c5e4014e tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 4b030e3a-49f7-4481-98a9-878906e601b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:37.544895 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96aaaafd-b25e-4c9f-b0d8-8f11c5e4014e tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:37.545877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96aaaafd-b25e-4c9f-b0d8-8f11c5e4014e tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:37.546615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96aaaafd-b25e-4c9f-b0d8-8f11c5e4014e tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:37.547570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96aaaafd-b25e-4c9f-b0d8-8f11c5e4014e tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:37.548247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96aaaafd-b25e-4c9f-b0d8-8f11c5e4014e tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:37.548882 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-96aaaafd-b25e-4c9f-b0d8-8f11c5e4014e tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:37.698437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-96aaaafd-b25e-4c9f-b0d8-8f11c5e4014e tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:37.718826 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-96aaaafd-b25e-4c9f-b0d8-8f11c5e4014e tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3" status: 200 len: 1307 microversion: 2.1 time: 0.208312 Sep 07 13:25:37.719749 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3172/6378] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:37 2022] GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3 => generated 1307 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:37.733731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-29225f73-c5a6-43b6-958e-ac3f8cb50539 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:37.733731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-29225f73-c5a6-43b6-958e-ac3f8cb50539 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:37.744022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29225f73-c5a6-43b6-958e-ac3f8cb50539 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:37.744022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29225f73-c5a6-43b6-958e-ac3f8cb50539 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:37.744022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29225f73-c5a6-43b6-958e-ac3f8cb50539 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:37.744022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29225f73-c5a6-43b6-958e-ac3f8cb50539 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:37.744022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29225f73-c5a6-43b6-958e-ac3f8cb50539 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:37.744022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-29225f73-c5a6-43b6-958e-ac3f8cb50539 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:37.779955 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-29225f73-c5a6-43b6-958e-ac3f8cb50539 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] HTTP exception thrown: Instance 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 could not be found. Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-29225f73-c5a6-43b6-958e-ac3f8cb50539 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Request method failure captured: Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 HTTP/1.1 Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJo_65BByUQjqxLLydngyGcQD0VqesltPK2phoKKnh2_w98MobCIT0V6J-xkzZOSe_MpyS8-hI1LHe2rGNpuHeqYkh62s-1hz08u5D4pKaIFeOnNl2E_uiZLXNKjMthRgm88PlbJ3GaVc7Wl0PE0eUQjIGoaS5gULI9m3p_XsfeTPw0 Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: c7ff80261a1a4ffdaefba7dd7d276c00 Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1063465928 Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7ff80261a1a4ffdaefba7dd7d276c00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c7ff80261a1a4ffdaefba7dd7d276c00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c7ff80261a1a4ffdaefba7dd7d276c00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7ff80261a1a4ffdaefba7dd7d276c00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1063465928 Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: c7ff80261a1a4ffdaefba7dd7d276c00 Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1063465928 Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TestNetworkAdvancedServerOps-1063465928-project Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 663c3f21362d460785702e1858cc6706 Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1063465928-project Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 could not be found. Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431'} Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 could not be found. Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 could not be found. Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:25:37.782350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:37.787278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:25:37.787278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:37.787278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:37.787278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:37.787278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:25:37.787278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:25:37.787278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 could not be found. Sep 07 13:25:37.787278 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:25:37.787278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-29225f73-c5a6-43b6-958e-ac3f8cb50539 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Returning 404 to user: Instance 5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:25:37.787278 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-29225f73-c5a6-43b6-958e-ac3f8cb50539 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431" status: 404 len: 111 microversion: 2.1 time: 0.063226 Sep 07 13:25:37.788328 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3173/6379] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:37 2022] GET /compute/v2.1/servers/5e7146fc-7e9d-4f3c-b602-bbe1c4fd4431 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:25:37.792201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-36bfc212-579c-4c9f-87d5-2bafee5f4a75 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:37.805689 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-36bfc212-579c-4c9f-87d5-2bafee5f4a75 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1342 microversion: 2.1 time: 0.544852 Sep 07 13:25:37.822997 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3207/6380] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:37 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1342 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:25:38.589261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ce15d2c2-ea74-4994-b858-1cde08400409 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:38.593109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ce15d2c2-ea74-4994-b858-1cde08400409 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] [instance: 9b83ef98-20b5-475a-b189-e01b3c61a7c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:38.614856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce15d2c2-ea74-4994-b858-1cde08400409 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:38.625252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce15d2c2-ea74-4994-b858-1cde08400409 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:38.626891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce15d2c2-ea74-4994-b858-1cde08400409 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:38.629350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce15d2c2-ea74-4994-b858-1cde08400409 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:38.631222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce15d2c2-ea74-4994-b858-1cde08400409 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:38.632444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce15d2c2-ea74-4994-b858-1cde08400409 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:38.691829 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-ce15d2c2-ea74-4994-b858-1cde08400409 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] HTTP exception thrown: Instance 9b83ef98-20b5-475a-b189-e01b3c61a7c5 could not be found. Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ce15d2c2-ea74-4994-b858-1cde08400409 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Request method failure captured: Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 HTTP/1.1 Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJuvwynjeE-wtIXcbbyWYLrXHiRp1ey4j2ht8gtTE7X_agR9bE2DIsvclUC6QAmJgnIS5ZnkgFzNuwIV4Vy3t6Frh7aaYliYjE2N0r8k4QSLH7iEYrETom1_RF5isQRBXS_yfJYVsOtdi6TuJW3XIkCt7yDVztCNvs6ybV_XYux3ROs Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: b1ab9fc262994a92a967325448662f61 Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TestServerAdvancedOps-1607183398 Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b1ab9fc262994a92a967325448662f61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b1ab9fc262994a92a967325448662f61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b1ab9fc262994a92a967325448662f61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b1ab9fc262994a92a967325448662f61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TestServerAdvancedOps-1607183398 Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: b1ab9fc262994a92a967325448662f61 Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestServerAdvancedOps-1607183398 Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TestServerAdvancedOps-1607183398-project Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 900134259cce49f5bcb1e1d35a7690c3 Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TestServerAdvancedOps-1607183398-project Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 9b83ef98-20b5-475a-b189-e01b3c61a7c5 could not be found. Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '9b83ef98-20b5-475a-b189-e01b3c61a7c5'} Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b83ef98-20b5-475a-b189-e01b3c61a7c5 could not be found. Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b83ef98-20b5-475a-b189-e01b3c61a7c5 could not be found. Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:25:38.697031 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:25:38.712258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:25:38.712258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:25:38.712258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:25:38.712258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:25:38.712258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:25:38.712258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b83ef98-20b5-475a-b189-e01b3c61a7c5 could not be found. Sep 07 13:25:38.712258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:25:38.712258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ce15d2c2-ea74-4994-b858-1cde08400409 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] Returning 404 to user: Instance 9b83ef98-20b5-475a-b189-e01b3c61a7c5 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:25:38.712258 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ce15d2c2-ea74-4994-b858-1cde08400409 tempest-TestServerAdvancedOps-1607183398 tempest-TestServerAdvancedOps-1607183398-project] 10.222.0.16 "GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5" status: 404 len: 111 microversion: 2.1 time: 0.143871 Sep 07 13:25:38.712258 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3174/6381] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:38 2022] GET /compute/v2.1/servers/9b83ef98-20b5-475a-b189-e01b3c61a7c5 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:25:38.767993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5db2a4f3-a4a9-4161-9ca9-c29cb861decc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:38.801334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5db2a4f3-a4a9-4161-9ca9-c29cb861decc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 4b030e3a-49f7-4481-98a9-878906e601b3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:38.842093 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-761e7953-d551-4807-bdf7-da9e49e43e29 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:38.843835 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5db2a4f3-a4a9-4161-9ca9-c29cb861decc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:38.845016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-761e7953-d551-4807-bdf7-da9e49e43e29 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:38.847406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5db2a4f3-a4a9-4161-9ca9-c29cb861decc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:38.850122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5db2a4f3-a4a9-4161-9ca9-c29cb861decc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:38.853586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5db2a4f3-a4a9-4161-9ca9-c29cb861decc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:38.858347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5db2a4f3-a4a9-4161-9ca9-c29cb861decc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:38.864494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5db2a4f3-a4a9-4161-9ca9-c29cb861decc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:38.883508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-761e7953-d551-4807-bdf7-da9e49e43e29 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:38.887291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-761e7953-d551-4807-bdf7-da9e49e43e29 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:38.890357 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-761e7953-d551-4807-bdf7-da9e49e43e29 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:38.896479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-761e7953-d551-4807-bdf7-da9e49e43e29 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:38.898954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-761e7953-d551-4807-bdf7-da9e49e43e29 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:38.904544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-761e7953-d551-4807-bdf7-da9e49e43e29 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:40.513712 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5db2a4f3-a4a9-4161-9ca9-c29cb861decc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:40.526059 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5db2a4f3-a4a9-4161-9ca9-c29cb861decc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3" status: 200 len: 1375 microversion: 2.1 time: 1.777570 Sep 07 13:25:40.526701 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3208/6382] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:38 2022] GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3 => generated 1375 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:40.558379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-761e7953-d551-4807-bdf7-da9e49e43e29 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:40.580488 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-761e7953-d551-4807-bdf7-da9e49e43e29 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1342 microversion: 2.1 time: 1.749976 Sep 07 13:25:40.587041 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3175/6383] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:38 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1342 bytes in 1758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:41.208952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-59e78a48-91f1-4e5d-a94f-8ac43178e62f req-e5ccf57b-8b44-4142-831e-44ae3567ed1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b030e3a-49f7-4481-98a9-878906e601b3", "tag": "ca58990c-3b83-44e8-ba92-86108fc9cd2f"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:41.220980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-59e78a48-91f1-4e5d-a94f-8ac43178e62f req-e5ccf57b-8b44-4142-831e-44ae3567ed1e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:41.221521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-59e78a48-91f1-4e5d-a94f-8ac43178e62f req-e5ccf57b-8b44-4142-831e-44ae3567ed1e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:41.222220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-59e78a48-91f1-4e5d-a94f-8ac43178e62f req-e5ccf57b-8b44-4142-831e-44ae3567ed1e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:41.236039 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-59e78a48-91f1-4e5d-a94f-8ac43178e62f req-e5ccf57b-8b44-4142-831e-44ae3567ed1e service nova] Creating event network-changed:ca58990c-3b83-44e8-ba92-86108fc9cd2f for instance 4b030e3a-49f7-4481-98a9-878906e601b3 on n-h1-852087-9 Sep 07 13:25:41.248453 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-59e78a48-91f1-4e5d-a94f-8ac43178e62f req-e5ccf57b-8b44-4142-831e-44ae3567ed1e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043440 Sep 07 13:25:41.249379 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3209/6384] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:41.577769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-211b91d9-ca77-48ef-9eee-460fc6035121 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:41.580776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-211b91d9-ca77-48ef-9eee-460fc6035121 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 4b030e3a-49f7-4481-98a9-878906e601b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:41.615940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-01b15a30-c944-4df1-abad-3c395454cc19 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:41.616741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-01b15a30-c944-4df1-abad-3c395454cc19 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:41.618199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-211b91d9-ca77-48ef-9eee-460fc6035121 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:41.621975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-211b91d9-ca77-48ef-9eee-460fc6035121 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:41.623328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-211b91d9-ca77-48ef-9eee-460fc6035121 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:41.627896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-211b91d9-ca77-48ef-9eee-460fc6035121 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:41.629475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-211b91d9-ca77-48ef-9eee-460fc6035121 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:41.631690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01b15a30-c944-4df1-abad-3c395454cc19 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:41.632151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01b15a30-c944-4df1-abad-3c395454cc19 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:41.632796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01b15a30-c944-4df1-abad-3c395454cc19 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:41.633641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01b15a30-c944-4df1-abad-3c395454cc19 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:41.635970 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-211b91d9-ca77-48ef-9eee-460fc6035121 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:41.640043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01b15a30-c944-4df1-abad-3c395454cc19 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:41.640554 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01b15a30-c944-4df1-abad-3c395454cc19 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:42.052549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-01b15a30-c944-4df1-abad-3c395454cc19 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:42.074267 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-01b15a30-c944-4df1-abad-3c395454cc19 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1342 microversion: 2.1 time: 0.463325 Sep 07 13:25:42.090177 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3210/6385] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:41 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1342 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:25:42.110993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-211b91d9-ca77-48ef-9eee-460fc6035121 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:42.125699 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:42.154848 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-211b91d9-ca77-48ef-9eee-460fc6035121 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3" status: 200 len: 1375 microversion: 2.1 time: 0.590399 Sep 07 13:25:42.160331 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3176/6386] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:41 2022] GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3 => generated 1375 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:43.118745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0fa268eb-51fe-467b-a31a-588c2f9fd0a2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:43.120083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0fa268eb-51fe-467b-a31a-588c2f9fd0a2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:43.159153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fa268eb-51fe-467b-a31a-588c2f9fd0a2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:43.160118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fa268eb-51fe-467b-a31a-588c2f9fd0a2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:43.161587 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fa268eb-51fe-467b-a31a-588c2f9fd0a2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:43.165638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fa268eb-51fe-467b-a31a-588c2f9fd0a2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:43.167049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fa268eb-51fe-467b-a31a-588c2f9fd0a2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:43.167806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fa268eb-51fe-467b-a31a-588c2f9fd0a2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:43.190928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b4589202-0f79-41d4-9561-e9f28e4642f0 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:43.193927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b4589202-0f79-41d4-9561-e9f28e4642f0 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 4b030e3a-49f7-4481-98a9-878906e601b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:43.207257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4589202-0f79-41d4-9561-e9f28e4642f0 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:43.208646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4589202-0f79-41d4-9561-e9f28e4642f0 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:43.210644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4589202-0f79-41d4-9561-e9f28e4642f0 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:43.212229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4589202-0f79-41d4-9561-e9f28e4642f0 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:43.213439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4589202-0f79-41d4-9561-e9f28e4642f0 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:43.214663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4589202-0f79-41d4-9561-e9f28e4642f0 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:43.550332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b4589202-0f79-41d4-9561-e9f28e4642f0 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:43.567984 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b4589202-0f79-41d4-9561-e9f28e4642f0 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3" status: 200 len: 1375 microversion: 2.1 time: 0.381140 Sep 07 13:25:43.570680 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3177/6387] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:43 2022] GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3 => generated 1375 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:43.594909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0fa268eb-51fe-467b-a31a-588c2f9fd0a2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:43.607622 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0fa268eb-51fe-467b-a31a-588c2f9fd0a2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1342 microversion: 2.1 time: 0.499887 Sep 07 13:25:43.619446 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3211/6388] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:43 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1342 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:44.601054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5d98a145-72b5-401c-8615-eeaf62ec634d tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:44.604067 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5d98a145-72b5-401c-8615-eeaf62ec634d tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 4b030e3a-49f7-4481-98a9-878906e601b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:44.614258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d98a145-72b5-401c-8615-eeaf62ec634d tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:44.615267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d98a145-72b5-401c-8615-eeaf62ec634d tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:44.616061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d98a145-72b5-401c-8615-eeaf62ec634d tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:44.617103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d98a145-72b5-401c-8615-eeaf62ec634d tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:44.617987 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d98a145-72b5-401c-8615-eeaf62ec634d tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:44.618854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d98a145-72b5-401c-8615-eeaf62ec634d tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:44.648565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c9b218e2-5956-400e-8730-a36b17d77a9c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:44.650111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c9b218e2-5956-400e-8730-a36b17d77a9c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:44.654299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:44.663916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9b218e2-5956-400e-8730-a36b17d77a9c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:44.664599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9b218e2-5956-400e-8730-a36b17d77a9c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:44.665130 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9b218e2-5956-400e-8730-a36b17d77a9c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:44.666222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9b218e2-5956-400e-8730-a36b17d77a9c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:44.675766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9b218e2-5956-400e-8730-a36b17d77a9c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:44.679563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c9b218e2-5956-400e-8730-a36b17d77a9c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:44.714345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=10 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:45.119452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5d98a145-72b5-401c-8615-eeaf62ec634d tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:45.132745 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5d98a145-72b5-401c-8615-eeaf62ec634d tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3" status: 200 len: 1375 microversion: 2.1 time: 0.537212 Sep 07 13:25:45.147339 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3178/6389] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:44 2022] GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3 => generated 1375 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:45.225913 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:45.244711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c9b218e2-5956-400e-8730-a36b17d77a9c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:45.257426 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c9b218e2-5956-400e-8730-a36b17d77a9c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1388 microversion: 2.1 time: 0.613949 Sep 07 13:25:45.260723 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3212/6390] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:44 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1388 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:45.503667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5b60e28c-433f-4ed4-bf82-59d026563be8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '.version_select at 0x7fc413c188b0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:45.550995 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5b60e28c-433f-4ed4-bf82-59d026563be8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2112263755" status: 202 len: 0 microversion: 2.1 time: 0.052248 Sep 07 13:25:45.557849 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3179/6391] 10.222.0.16 () {58 vars in 1284 bytes} [Wed Sep 7 13:25:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2112263755 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:25:45.636854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-163dd857-8713-4fd4-bb4f-5c3ea09f33d7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Action: 'create', calling method: .version_select at 0x7fc413f57ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1107653135", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpu3RMQyyL2Zx1znRhkQ0jBH33VQoMEzEeDvfdcC9fwuRvq9x1szKg9mJZUS86gxCJRIpAyUUhCu2K6cl0PGzl1/H8r9jDi8DQgx9AYqHCbdpz7j2WqxspWx4pfAvNN1A=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:45.668918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-163dd857-8713-4fd4-bb4f-5c3ea09f33d7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Getting quotas for project c7ff80261a1a4ffdaefba7dd7d276c00. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:25:45.681323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-163dd857-8713-4fd4-bb4f-5c3ea09f33d7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Getting quotas for user 663c3f21362d460785702e1858cc6706 and project c7ff80261a1a4ffdaefba7dd7d276c00. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:25:45.735786 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-163dd857-8713-4fd4-bb4f-5c3ea09f33d7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.104001 Sep 07 13:25:45.736628 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3213/6392] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 13:25:45 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:25:46.165781 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3a0e61ae-9171-403e-91ce-e878ddbc6a0f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:46.167968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3a0e61ae-9171-403e-91ce-e878ddbc6a0f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 4b030e3a-49f7-4481-98a9-878906e601b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:46.176990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a0e61ae-9171-403e-91ce-e878ddbc6a0f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:46.177562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a0e61ae-9171-403e-91ce-e878ddbc6a0f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:46.178032 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a0e61ae-9171-403e-91ce-e878ddbc6a0f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:46.178865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a0e61ae-9171-403e-91ce-e878ddbc6a0f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:46.179348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a0e61ae-9171-403e-91ce-e878ddbc6a0f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:46.179807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3a0e61ae-9171-403e-91ce-e878ddbc6a0f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:46.292197 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7302367b-4e91-4324-8fb9-2512e871458b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:46.293069 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7302367b-4e91-4324-8fb9-2512e871458b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:46.305920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7302367b-4e91-4324-8fb9-2512e871458b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:46.308175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7302367b-4e91-4324-8fb9-2512e871458b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:46.309315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7302367b-4e91-4324-8fb9-2512e871458b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:46.310505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7302367b-4e91-4324-8fb9-2512e871458b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:46.311249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7302367b-4e91-4324-8fb9-2512e871458b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:46.311750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7302367b-4e91-4324-8fb9-2512e871458b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:46.483492 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3a0e61ae-9171-403e-91ce-e878ddbc6a0f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:46.495549 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3a0e61ae-9171-403e-91ce-e878ddbc6a0f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3" status: 200 len: 1375 microversion: 2.1 time: 0.338136 Sep 07 13:25:46.505656 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3180/6393] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:46 2022] GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3 => generated 1375 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:46.565825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7302367b-4e91-4324-8fb9-2512e871458b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:46.581377 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7302367b-4e91-4324-8fb9-2512e871458b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1376 microversion: 2.1 time: 0.294755 Sep 07 13:25:46.582335 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3214/6394] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:46 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1376 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:47.529813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d13cc7f6-a297-4eee-9bb3-960896f28e10 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:47.530984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d13cc7f6-a297-4eee-9bb3-960896f28e10 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 4b030e3a-49f7-4481-98a9-878906e601b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:47.536169 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:47.549211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d13cc7f6-a297-4eee-9bb3-960896f28e10 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:47.549811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d13cc7f6-a297-4eee-9bb3-960896f28e10 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:47.550304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d13cc7f6-a297-4eee-9bb3-960896f28e10 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:47.551295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d13cc7f6-a297-4eee-9bb3-960896f28e10 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:47.551820 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d13cc7f6-a297-4eee-9bb3-960896f28e10 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:47.552365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d13cc7f6-a297-4eee-9bb3-960896f28e10 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:47.634404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9022f40b-b5e9-4adf-9ad9-ab07606f1f72 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:47.635639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9022f40b-b5e9-4adf-9ad9-ab07606f1f72 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:47.670426 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9022f40b-b5e9-4adf-9ad9-ab07606f1f72 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:47.671506 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9022f40b-b5e9-4adf-9ad9-ab07606f1f72 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:47.672385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9022f40b-b5e9-4adf-9ad9-ab07606f1f72 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:47.685960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9022f40b-b5e9-4adf-9ad9-ab07606f1f72 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:47.687000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9022f40b-b5e9-4adf-9ad9-ab07606f1f72 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:47.687892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9022f40b-b5e9-4adf-9ad9-ab07606f1f72 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:47.867701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d13cc7f6-a297-4eee-9bb3-960896f28e10 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:47.878499 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d13cc7f6-a297-4eee-9bb3-960896f28e10 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3" status: 200 len: 1375 microversion: 2.1 time: 0.355638 Sep 07 13:25:47.880168 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3181/6395] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:47 2022] GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3 => generated 1375 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:47.954737 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9022f40b-b5e9-4adf-9ad9-ab07606f1f72 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:47.964669 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9022f40b-b5e9-4adf-9ad9-ab07606f1f72 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1376 microversion: 2.1 time: 0.341206 Sep 07 13:25:47.966145 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3215/6396] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:47 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1376 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:25:48.908279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9a2e51ff-3e5d-4ce7-a76a-21b08b17a35b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:48.909142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9a2e51ff-3e5d-4ce7-a76a-21b08b17a35b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 4b030e3a-49f7-4481-98a9-878906e601b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:48.918834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a2e51ff-3e5d-4ce7-a76a-21b08b17a35b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:48.918834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a2e51ff-3e5d-4ce7-a76a-21b08b17a35b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:48.918834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a2e51ff-3e5d-4ce7-a76a-21b08b17a35b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:48.919507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a2e51ff-3e5d-4ce7-a76a-21b08b17a35b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:48.920001 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a2e51ff-3e5d-4ce7-a76a-21b08b17a35b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:48.920406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9a2e51ff-3e5d-4ce7-a76a-21b08b17a35b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:49.004940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a276eebe-1ea6-4d81-8d8d-c08c93d8b2c2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:49.007236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a276eebe-1ea6-4d81-8d8d-c08c93d8b2c2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:49.032333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a276eebe-1ea6-4d81-8d8d-c08c93d8b2c2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:49.033444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a276eebe-1ea6-4d81-8d8d-c08c93d8b2c2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:49.034617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a276eebe-1ea6-4d81-8d8d-c08c93d8b2c2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:49.036846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a276eebe-1ea6-4d81-8d8d-c08c93d8b2c2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:49.038280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a276eebe-1ea6-4d81-8d8d-c08c93d8b2c2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:49.039476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a276eebe-1ea6-4d81-8d8d-c08c93d8b2c2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:49.287589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9a2e51ff-3e5d-4ce7-a76a-21b08b17a35b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:49.298695 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9a2e51ff-3e5d-4ce7-a76a-21b08b17a35b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3" status: 200 len: 1375 microversion: 2.1 time: 0.394670 Sep 07 13:25:49.299671 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3182/6397] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:48 2022] GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3 => generated 1375 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:25:49.305339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-dda3191c-1b68-48d7-a2dc-2d788d02be1b req-56df77d6-3ea8-4abe-8c09-38cf0ee9328e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b030e3a-49f7-4481-98a9-878906e601b3", "name": "network-vif-plugged", "status": "completed", "tag": "ca58990c-3b83-44e8-ba92-86108fc9cd2f"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:49.319809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dda3191c-1b68-48d7-a2dc-2d788d02be1b req-56df77d6-3ea8-4abe-8c09-38cf0ee9328e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:49.320524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dda3191c-1b68-48d7-a2dc-2d788d02be1b req-56df77d6-3ea8-4abe-8c09-38cf0ee9328e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:49.320964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dda3191c-1b68-48d7-a2dc-2d788d02be1b req-56df77d6-3ea8-4abe-8c09-38cf0ee9328e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:49.333691 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-dda3191c-1b68-48d7-a2dc-2d788d02be1b req-56df77d6-3ea8-4abe-8c09-38cf0ee9328e service nova] Creating event network-vif-plugged:ca58990c-3b83-44e8-ba92-86108fc9cd2f for instance 4b030e3a-49f7-4481-98a9-878906e601b3 on n-h1-852087-9 Sep 07 13:25:49.340187 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-dda3191c-1b68-48d7-a2dc-2d788d02be1b req-56df77d6-3ea8-4abe-8c09-38cf0ee9328e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038772 Sep 07 13:25:49.341227 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3183/6398] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:49.359748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a276eebe-1ea6-4d81-8d8d-c08c93d8b2c2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:49.369877 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a276eebe-1ea6-4d81-8d8d-c08c93d8b2c2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1376 microversion: 2.1 time: 0.370541 Sep 07 13:25:49.370559 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3216/6399] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:48 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1376 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:50.333013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4753dd2b-8aad-4b61-822c-4041bf1fa7ef tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:50.335060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4753dd2b-8aad-4b61-822c-4041bf1fa7ef tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 4b030e3a-49f7-4481-98a9-878906e601b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:50.351765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4753dd2b-8aad-4b61-822c-4041bf1fa7ef tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:50.356228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4753dd2b-8aad-4b61-822c-4041bf1fa7ef tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:50.357194 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4753dd2b-8aad-4b61-822c-4041bf1fa7ef tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:50.358606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4753dd2b-8aad-4b61-822c-4041bf1fa7ef tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:50.359455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4753dd2b-8aad-4b61-822c-4041bf1fa7ef tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:50.360396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4753dd2b-8aad-4b61-822c-4041bf1fa7ef tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:50.403160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-970f7f12-e6c0-487f-aa03-a86722acb259 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:50.405766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-970f7f12-e6c0-487f-aa03-a86722acb259 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:50.420344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-970f7f12-e6c0-487f-aa03-a86722acb259 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:50.421796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-970f7f12-e6c0-487f-aa03-a86722acb259 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:50.423005 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-970f7f12-e6c0-487f-aa03-a86722acb259 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:50.424887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-970f7f12-e6c0-487f-aa03-a86722acb259 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:50.425816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-970f7f12-e6c0-487f-aa03-a86722acb259 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:50.427036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-970f7f12-e6c0-487f-aa03-a86722acb259 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:50.801813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4753dd2b-8aad-4b61-822c-4041bf1fa7ef tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:50.808913 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-970f7f12-e6c0-487f-aa03-a86722acb259 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:50.820233 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4753dd2b-8aad-4b61-822c-4041bf1fa7ef tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3" status: 200 len: 1375 microversion: 2.1 time: 0.498445 Sep 07 13:25:50.822338 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3184/6400] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:50 2022] GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3 => generated 1375 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:50.826499 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-970f7f12-e6c0-487f-aa03-a86722acb259 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1376 microversion: 2.1 time: 0.434754 Sep 07 13:25:50.837473 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3217/6401] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:50 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1376 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:51.849258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-72d1d15b-1285-4dde-b460-ca244890b10a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:51.850652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-72d1d15b-1285-4dde-b460-ca244890b10a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 4b030e3a-49f7-4481-98a9-878906e601b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:51.859647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72d1d15b-1285-4dde-b460-ca244890b10a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:51.860157 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72d1d15b-1285-4dde-b460-ca244890b10a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:51.860609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72d1d15b-1285-4dde-b460-ca244890b10a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:51.862089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72d1d15b-1285-4dde-b460-ca244890b10a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:51.862573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72d1d15b-1285-4dde-b460-ca244890b10a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:51.863212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-72d1d15b-1285-4dde-b460-ca244890b10a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:51.878037 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a254b14d-0dd9-45fb-bbd8-b57ad8fd2c81 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:51.878037 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a254b14d-0dd9-45fb-bbd8-b57ad8fd2c81 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:51.902849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a254b14d-0dd9-45fb-bbd8-b57ad8fd2c81 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:51.903403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a254b14d-0dd9-45fb-bbd8-b57ad8fd2c81 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:51.904006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a254b14d-0dd9-45fb-bbd8-b57ad8fd2c81 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:51.907568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a254b14d-0dd9-45fb-bbd8-b57ad8fd2c81 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:51.908343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a254b14d-0dd9-45fb-bbd8-b57ad8fd2c81 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:51.908990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a254b14d-0dd9-45fb-bbd8-b57ad8fd2c81 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:52.173788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-72d1d15b-1285-4dde-b460-ca244890b10a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:52.175738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a254b14d-0dd9-45fb-bbd8-b57ad8fd2c81 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:52.194808 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-72d1d15b-1285-4dde-b460-ca244890b10a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3" status: 200 len: 1548 microversion: 2.1 time: 0.351068 Sep 07 13:25:52.197828 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a254b14d-0dd9-45fb-bbd8-b57ad8fd2c81 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1376 microversion: 2.1 time: 0.324493 Sep 07 13:25:52.200697 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3218/6402] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:51 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1376 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:25:52.208987 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3185/6403] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:51 2022] GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3 => generated 1548 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:52.228025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1a8d8470-4eb6-4b8b-b74c-9ea8a0fb622c tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:52.229143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1a8d8470-4eb6-4b8b-b74c-9ea8a0fb622c tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 4b030e3a-49f7-4481-98a9-878906e601b3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:52.238390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a8d8470-4eb6-4b8b-b74c-9ea8a0fb622c tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:52.239285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a8d8470-4eb6-4b8b-b74c-9ea8a0fb622c tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:52.240106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a8d8470-4eb6-4b8b-b74c-9ea8a0fb622c tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:52.241899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a8d8470-4eb6-4b8b-b74c-9ea8a0fb622c tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:52.242809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a8d8470-4eb6-4b8b-b74c-9ea8a0fb622c tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:52.244538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a8d8470-4eb6-4b8b-b74c-9ea8a0fb622c tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:52.520778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1a8d8470-4eb6-4b8b-b74c-9ea8a0fb622c tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:52.540618 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1a8d8470-4eb6-4b8b-b74c-9ea8a0fb622c tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3" status: 200 len: 1548 microversion: 2.1 time: 0.316637 Sep 07 13:25:52.542311 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3219/6404] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:52 2022] GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3 => generated 1548 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:53.244716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-736f5ed6-7c35-4987-aa1f-c04f971a86c6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:53.245358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-736f5ed6-7c35-4987-aa1f-c04f971a86c6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:53.257298 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-736f5ed6-7c35-4987-aa1f-c04f971a86c6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:53.270854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-736f5ed6-7c35-4987-aa1f-c04f971a86c6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:53.271784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-736f5ed6-7c35-4987-aa1f-c04f971a86c6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:53.274615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-736f5ed6-7c35-4987-aa1f-c04f971a86c6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:53.275385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-736f5ed6-7c35-4987-aa1f-c04f971a86c6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:53.275977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-736f5ed6-7c35-4987-aa1f-c04f971a86c6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:54.051869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-736f5ed6-7c35-4987-aa1f-c04f971a86c6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:54.064105 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-736f5ed6-7c35-4987-aa1f-c04f971a86c6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1376 microversion: 2.1 time: 0.823519 Sep 07 13:25:54.065119 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3186/6405] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:53 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1376 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:54.702043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7da7e9ce-d498-4929-8723-d8f647b2d8af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-940817388", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "c669ba57-abc1-4030-8ccf-f1b06639de7a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1107653135", "security_groups": [{"name": "tempest-secgroup-smoke-1596337592"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:54.715482 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:54.949006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-7da7e9ce-d498-4929-8723-d8f647b2d8af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] validate_networks() for [('c669ba57-abc1-4030-8ccf-f1b06639de7a', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:25:55.094408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2c1b485e-c727-488f-b899-887c37567801 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:55.095325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2c1b485e-c727-488f-b899-887c37567801 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:55.103612 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c1b485e-c727-488f-b899-887c37567801 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:55.104122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c1b485e-c727-488f-b899-887c37567801 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:55.104582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c1b485e-c727-488f-b899-887c37567801 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:55.110952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c1b485e-c727-488f-b899-887c37567801 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:55.112150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c1b485e-c727-488f-b899-887c37567801 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:55.112951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c1b485e-c727-488f-b899-887c37567801 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:55.637998 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2c1b485e-c727-488f-b899-887c37567801 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:55.665762 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2c1b485e-c727-488f-b899-887c37567801 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1376 microversion: 2.1 time: 0.575856 Sep 07 13:25:55.667324 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3187/6406] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:55 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1376 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:55.691504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-4aa0270b-8a9b-4a61-bf1e-924b9968b399 req-99b97849-a5cb-4099-8fa7-e6c900b7fe5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eca73d9e-2af2-41b6-a572-d5315e5fd9c5", "name": "network-vif-plugged", "status": "completed", "tag": "f8d76d3b-75de-48ca-a244-76bffd5cd60e"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:55.693305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:55.741665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4aa0270b-8a9b-4a61-bf1e-924b9968b399 req-99b97849-a5cb-4099-8fa7-e6c900b7fe5a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:55.742288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4aa0270b-8a9b-4a61-bf1e-924b9968b399 req-99b97849-a5cb-4099-8fa7-e6c900b7fe5a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:55.744164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4aa0270b-8a9b-4a61-bf1e-924b9968b399 req-99b97849-a5cb-4099-8fa7-e6c900b7fe5a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:55.779285 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-4aa0270b-8a9b-4a61-bf1e-924b9968b399 req-99b97849-a5cb-4099-8fa7-e6c900b7fe5a service nova] Creating event network-vif-plugged:f8d76d3b-75de-48ca-a244-76bffd5cd60e for instance eca73d9e-2af2-41b6-a572-d5315e5fd9c5 on n-h2-852087-9 Sep 07 13:25:55.797841 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-4aa0270b-8a9b-4a61-bf1e-924b9968b399 req-99b97849-a5cb-4099-8fa7-e6c900b7fe5a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124875 Sep 07 13:25:55.801611 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3188/6407] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:56.474335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-7da7e9ce-d498-4929-8723-d8f647b2d8af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:25:56.479010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-7da7e9ce-d498-4929-8723-d8f647b2d8af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:25:56.480871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-7da7e9ce-d498-4929-8723-d8f647b2d8af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:25:56.482606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-7da7e9ce-d498-4929-8723-d8f647b2d8af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:25:56.484161 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-7da7e9ce-d498-4929-8723-d8f647b2d8af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:25:56.508376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7da7e9ce-d498-4929-8723-d8f647b2d8af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:56.510922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7da7e9ce-d498-4929-8723-d8f647b2d8af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:56.512572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7da7e9ce-d498-4929-8723-d8f647b2d8af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:56.514570 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7da7e9ce-d498-4929-8723-d8f647b2d8af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:56.516038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7da7e9ce-d498-4929-8723-d8f647b2d8af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:56.517613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7da7e9ce-d498-4929-8723-d8f647b2d8af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:56.572366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-7da7e9ce-d498-4929-8723-d8f647b2d8af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Getting quotas for project c7ff80261a1a4ffdaefba7dd7d276c00. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:25:56.595154 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-7da7e9ce-d498-4929-8723-d8f647b2d8af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Getting quotas for user 663c3f21362d460785702e1858cc6706 and project c7ff80261a1a4ffdaefba7dd7d276c00. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:25:56.617742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7da7e9ce-d498-4929-8723-d8f647b2d8af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:25:56.620496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7da7e9ce-d498-4929-8723-d8f647b2d8af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:25:56.688642 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7da7e9ce-d498-4929-8723-d8f647b2d8af tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.990633 Sep 07 13:25:56.691018 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3220/6408] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:25:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:25:56.710241 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ebc4ae0d-aadd-432a-b2fd-9b98cf9c3db8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:56.712142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ebc4ae0d-aadd-432a-b2fd-9b98cf9c3db8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:56.733236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-be10934e-fa42-42aa-81c4-2217f72d46de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:56.735953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-be10934e-fa42-42aa-81c4-2217f72d46de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:56.765639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be10934e-fa42-42aa-81c4-2217f72d46de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:56.766508 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be10934e-fa42-42aa-81c4-2217f72d46de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:56.769383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be10934e-fa42-42aa-81c4-2217f72d46de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:56.772759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be10934e-fa42-42aa-81c4-2217f72d46de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:56.773686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be10934e-fa42-42aa-81c4-2217f72d46de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:56.776626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-be10934e-fa42-42aa-81c4-2217f72d46de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:56.895560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ebc4ae0d-aadd-432a-b2fd-9b98cf9c3db8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:56.905709 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ebc4ae0d-aadd-432a-b2fd-9b98cf9c3db8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1266 microversion: 2.1 time: 0.201349 Sep 07 13:25:56.907260 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3189/6409] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:56 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:57.126926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-be10934e-fa42-42aa-81c4-2217f72d46de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:57.136869 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-be10934e-fa42-42aa-81c4-2217f72d46de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1376 microversion: 2.1 time: 0.430161 Sep 07 13:25:57.145123 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3221/6410] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:56 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1376 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:25:57.161355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-70214025-4377-469e-82a4-9cd7938bd51d req-ef1fdbaa-e47c-4c99-9af6-a4a84c0a9acc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b030e3a-49f7-4481-98a9-878906e601b3", "tag": "ca58990c-3b83-44e8-ba92-86108fc9cd2f"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:25:57.178171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-70214025-4377-469e-82a4-9cd7938bd51d req-ef1fdbaa-e47c-4c99-9af6-a4a84c0a9acc service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:57.179183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-70214025-4377-469e-82a4-9cd7938bd51d req-ef1fdbaa-e47c-4c99-9af6-a4a84c0a9acc service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:57.179825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-70214025-4377-469e-82a4-9cd7938bd51d req-ef1fdbaa-e47c-4c99-9af6-a4a84c0a9acc service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:57.210468 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-70214025-4377-469e-82a4-9cd7938bd51d req-ef1fdbaa-e47c-4c99-9af6-a4a84c0a9acc service nova] Creating event network-changed:ca58990c-3b83-44e8-ba92-86108fc9cd2f for instance 4b030e3a-49f7-4481-98a9-878906e601b3 on n-h1-852087-9 Sep 07 13:25:57.222935 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-70214025-4377-469e-82a4-9cd7938bd51d req-ef1fdbaa-e47c-4c99-9af6-a4a84c0a9acc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064835 Sep 07 13:25:57.231802 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3190/6411] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:25:57.945118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9f077e79-c774-4002-aadc-5dcc7767eca8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:57.947953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9f077e79-c774-4002-aadc-5dcc7767eca8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:57.967100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f077e79-c774-4002-aadc-5dcc7767eca8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:57.969078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f077e79-c774-4002-aadc-5dcc7767eca8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:57.970424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f077e79-c774-4002-aadc-5dcc7767eca8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:57.977150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f077e79-c774-4002-aadc-5dcc7767eca8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:57.979515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f077e79-c774-4002-aadc-5dcc7767eca8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:57.982219 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9f077e79-c774-4002-aadc-5dcc7767eca8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:58.134855 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9f077e79-c774-4002-aadc-5dcc7767eca8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:58.164755 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9f077e79-c774-4002-aadc-5dcc7767eca8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1262 microversion: 2.1 time: 0.229229 Sep 07 13:25:58.181785 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3222/6412] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:57 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1262 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:58.246625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9fe22bd6-e049-4f3e-9348-618708a23db0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:58.248100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9fe22bd6-e049-4f3e-9348-618708a23db0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:58.268179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fe22bd6-e049-4f3e-9348-618708a23db0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:58.276407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fe22bd6-e049-4f3e-9348-618708a23db0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:58.281731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fe22bd6-e049-4f3e-9348-618708a23db0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:58.282739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fe22bd6-e049-4f3e-9348-618708a23db0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:58.287008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fe22bd6-e049-4f3e-9348-618708a23db0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:58.290612 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9fe22bd6-e049-4f3e-9348-618708a23db0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:58.691799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9fe22bd6-e049-4f3e-9348-618708a23db0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:58.735730 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9fe22bd6-e049-4f3e-9348-618708a23db0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1564 microversion: 2.1 time: 0.538327 Sep 07 13:25:58.736979 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3191/6413] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:58 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1564 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:58.767061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b959d753-4563-4b64-82d0-3bfbb0e78baa tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:58.768416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b959d753-4563-4b64-82d0-3bfbb0e78baa tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:58.783429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b959d753-4563-4b64-82d0-3bfbb0e78baa tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:58.784743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b959d753-4563-4b64-82d0-3bfbb0e78baa tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:58.787063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b959d753-4563-4b64-82d0-3bfbb0e78baa tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:58.789183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b959d753-4563-4b64-82d0-3bfbb0e78baa tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:58.790278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b959d753-4563-4b64-82d0-3bfbb0e78baa tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:58.791472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b959d753-4563-4b64-82d0-3bfbb0e78baa tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:58.828615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:59.197326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4af2a017-a62b-4c9e-b981-9f71f9e47951 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:59.198026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4af2a017-a62b-4c9e-b981-9f71f9e47951 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:59.210246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4af2a017-a62b-4c9e-b981-9f71f9e47951 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:59.210777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4af2a017-a62b-4c9e-b981-9f71f9e47951 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:59.211227 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4af2a017-a62b-4c9e-b981-9f71f9e47951 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:59.212066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4af2a017-a62b-4c9e-b981-9f71f9e47951 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:59.212589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4af2a017-a62b-4c9e-b981-9f71f9e47951 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:59.213037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4af2a017-a62b-4c9e-b981-9f71f9e47951 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:59.312352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b959d753-4563-4b64-82d0-3bfbb0e78baa tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:59.329553 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b959d753-4563-4b64-82d0-3bfbb0e78baa tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1564 microversion: 2.1 time: 0.568955 Sep 07 13:25:59.344114 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3223/6414] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:58 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1564 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:25:59.407828 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4af2a017-a62b-4c9e-b981-9f71f9e47951 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:25:59.426037 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4af2a017-a62b-4c9e-b981-9f71f9e47951 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1336 microversion: 2.1 time: 0.233051 Sep 07 13:25:59.438568 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3192/6415] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:59 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1336 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:25:59.500388 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cff963ca-c419-4a88-ab6a-a1441ad441db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:59.501735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cff963ca-c419-4a88-ab6a-a1441ad441db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:59.516066 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cff963ca-c419-4a88-ab6a-a1441ad441db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:59.517394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cff963ca-c419-4a88-ab6a-a1441ad441db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:59.518341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cff963ca-c419-4a88-ab6a-a1441ad441db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:59.520010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cff963ca-c419-4a88-ab6a-a1441ad441db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:59.520823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cff963ca-c419-4a88-ab6a-a1441ad441db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:59.521726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cff963ca-c419-4a88-ab6a-a1441ad441db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:59.591363 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cff963ca-c419-4a88-ab6a-a1441ad441db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:25:59.822879 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cff963ca-c419-4a88-ab6a-a1441ad441db tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 204 len: 0 microversion: 2.1 time: 0.329478 Sep 07 13:25:59.829834 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3224/6416] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:25:59 2022] DELETE /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:25:59.843273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-77020bc9-80fd-4e06-9a03-424cc67ff030 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:25:59.845985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-77020bc9-80fd-4e06-9a03-424cc67ff030 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:25:59.876140 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77020bc9-80fd-4e06-9a03-424cc67ff030 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:59.916148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77020bc9-80fd-4e06-9a03-424cc67ff030 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:59.917190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77020bc9-80fd-4e06-9a03-424cc67ff030 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:25:59.918723 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77020bc9-80fd-4e06-9a03-424cc67ff030 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:25:59.920067 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77020bc9-80fd-4e06-9a03-424cc67ff030 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:25:59.921166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77020bc9-80fd-4e06-9a03-424cc67ff030 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:00.395474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-77020bc9-80fd-4e06-9a03-424cc67ff030 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:00.410598 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-77020bc9-80fd-4e06-9a03-424cc67ff030 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1570 microversion: 2.1 time: 0.578633 Sep 07 13:26:00.426042 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3193/6417] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:25:59 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1570 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:00.484166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-215e112f-48d2-478d-a516-4f0e742d0e5b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:00.485335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-215e112f-48d2-478d-a516-4f0e742d0e5b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:00.497464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-215e112f-48d2-478d-a516-4f0e742d0e5b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:00.498064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-215e112f-48d2-478d-a516-4f0e742d0e5b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:00.498534 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-215e112f-48d2-478d-a516-4f0e742d0e5b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:00.499500 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-215e112f-48d2-478d-a516-4f0e742d0e5b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:00.499925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-215e112f-48d2-478d-a516-4f0e742d0e5b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:00.500382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-215e112f-48d2-478d-a516-4f0e742d0e5b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:00.616194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-215e112f-48d2-478d-a516-4f0e742d0e5b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:00.627789 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-215e112f-48d2-478d-a516-4f0e742d0e5b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1324 microversion: 2.1 time: 0.149023 Sep 07 13:26:00.629466 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3225/6418] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:00 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1324 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:01.451037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1ed5c42a-5241-4a0f-ba9b-6132e8098580 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:01.451729 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1ed5c42a-5241-4a0f-ba9b-6132e8098580 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:01.460725 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ed5c42a-5241-4a0f-ba9b-6132e8098580 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:01.461904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ed5c42a-5241-4a0f-ba9b-6132e8098580 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:01.462512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ed5c42a-5241-4a0f-ba9b-6132e8098580 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:01.463424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ed5c42a-5241-4a0f-ba9b-6132e8098580 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:01.464375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ed5c42a-5241-4a0f-ba9b-6132e8098580 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:01.464931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ed5c42a-5241-4a0f-ba9b-6132e8098580 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:01.659750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5ef308a7-24b0-4d88-b601-3d407d45285c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:01.661576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5ef308a7-24b0-4d88-b601-3d407d45285c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:01.672593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ef308a7-24b0-4d88-b601-3d407d45285c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:01.673223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ef308a7-24b0-4d88-b601-3d407d45285c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:01.673962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ef308a7-24b0-4d88-b601-3d407d45285c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:01.674845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ef308a7-24b0-4d88-b601-3d407d45285c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:01.675508 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ef308a7-24b0-4d88-b601-3d407d45285c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:01.676030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5ef308a7-24b0-4d88-b601-3d407d45285c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:01.879897 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1ed5c42a-5241-4a0f-ba9b-6132e8098580 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:01.896983 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1ed5c42a-5241-4a0f-ba9b-6132e8098580 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1570 microversion: 2.1 time: 0.448768 Sep 07 13:26:01.900156 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3194/6419] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:01 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1570 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:02.103752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5ef308a7-24b0-4d88-b601-3d407d45285c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:02.119231 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5ef308a7-24b0-4d88-b601-3d407d45285c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1392 microversion: 2.1 time: 0.464333 Sep 07 13:26:02.120427 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3226/6420] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:01 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1392 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:26:02.856724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-fb14acb6-9d02-420e-a7cd-305fce6ab614 req-68896912-ed25-486c-aefa-515288651fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eca73d9e-2af2-41b6-a572-d5315e5fd9c5", "name": "network-vif-deleted", "tag": "f8d76d3b-75de-48ca-a244-76bffd5cd60e"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:26:02.912257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fb14acb6-9d02-420e-a7cd-305fce6ab614 req-68896912-ed25-486c-aefa-515288651fb0 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:02.914605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fb14acb6-9d02-420e-a7cd-305fce6ab614 req-68896912-ed25-486c-aefa-515288651fb0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:02.915960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-fb14acb6-9d02-420e-a7cd-305fce6ab614 req-68896912-ed25-486c-aefa-515288651fb0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:02.941111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-79c4e8aa-295e-4e11-82e4-e34c2ac5a174 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:02.942455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-79c4e8aa-295e-4e11-82e4-e34c2ac5a174 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:02.952062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79c4e8aa-295e-4e11-82e4-e34c2ac5a174 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:02.952731 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79c4e8aa-295e-4e11-82e4-e34c2ac5a174 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:02.953330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79c4e8aa-295e-4e11-82e4-e34c2ac5a174 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:02.954521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79c4e8aa-295e-4e11-82e4-e34c2ac5a174 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:02.955240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79c4e8aa-295e-4e11-82e4-e34c2ac5a174 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:02.955828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79c4e8aa-295e-4e11-82e4-e34c2ac5a174 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:02.975907 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-fb14acb6-9d02-420e-a7cd-305fce6ab614 req-68896912-ed25-486c-aefa-515288651fb0 service nova] Creating event network-vif-deleted:f8d76d3b-75de-48ca-a244-76bffd5cd60e for instance eca73d9e-2af2-41b6-a572-d5315e5fd9c5 on n-h2-852087-9 Sep 07 13:26:03.003773 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-fb14acb6-9d02-420e-a7cd-305fce6ab614 req-68896912-ed25-486c-aefa-515288651fb0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154646 Sep 07 13:26:03.005189 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3195/6421] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:26:03.156901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-79c4e8aa-295e-4e11-82e4-e34c2ac5a174 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:03.164290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a72f0091-9fe5-48e5-9edd-90c286ba97ed tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:03.165984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a72f0091-9fe5-48e5-9edd-90c286ba97ed tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:03.168194 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-79c4e8aa-295e-4e11-82e4-e34c2ac5a174 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1361 microversion: 2.1 time: 0.232385 Sep 07 13:26:03.169680 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3227/6422] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:02 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:03.181085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a72f0091-9fe5-48e5-9edd-90c286ba97ed tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:03.182474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a72f0091-9fe5-48e5-9edd-90c286ba97ed tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:03.183500 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a72f0091-9fe5-48e5-9edd-90c286ba97ed tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:03.185151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a72f0091-9fe5-48e5-9edd-90c286ba97ed tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:03.186068 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a72f0091-9fe5-48e5-9edd-90c286ba97ed tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:03.186898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a72f0091-9fe5-48e5-9edd-90c286ba97ed tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:03.655771 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a72f0091-9fe5-48e5-9edd-90c286ba97ed tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:03.672243 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a72f0091-9fe5-48e5-9edd-90c286ba97ed tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1392 microversion: 2.1 time: 0.518038 Sep 07 13:26:03.674249 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3196/6423] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:03 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1392 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:04.198119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c09813a-8a44-493f-91b2-3a0703d0dbe4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:04.198945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7c09813a-8a44-493f-91b2-3a0703d0dbe4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:04.211521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c09813a-8a44-493f-91b2-3a0703d0dbe4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:04.212382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c09813a-8a44-493f-91b2-3a0703d0dbe4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:04.213234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c09813a-8a44-493f-91b2-3a0703d0dbe4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:04.214709 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c09813a-8a44-493f-91b2-3a0703d0dbe4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:04.215401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c09813a-8a44-493f-91b2-3a0703d0dbe4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:04.216233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c09813a-8a44-493f-91b2-3a0703d0dbe4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:04.322398 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7c09813a-8a44-493f-91b2-3a0703d0dbe4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:04.334974 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7c09813a-8a44-493f-91b2-3a0703d0dbe4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1361 microversion: 2.1 time: 0.144427 Sep 07 13:26:04.335976 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3228/6424] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:04 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1361 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:04.705664 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6572344d-39fd-40b2-9088-58d2f1f76547 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:04.706294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6572344d-39fd-40b2-9088-58d2f1f76547 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:04.715376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6572344d-39fd-40b2-9088-58d2f1f76547 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:04.715887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6572344d-39fd-40b2-9088-58d2f1f76547 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:04.716345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6572344d-39fd-40b2-9088-58d2f1f76547 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:04.717075 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6572344d-39fd-40b2-9088-58d2f1f76547 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:04.717596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6572344d-39fd-40b2-9088-58d2f1f76547 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:04.718042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6572344d-39fd-40b2-9088-58d2f1f76547 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:04.942965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6572344d-39fd-40b2-9088-58d2f1f76547 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:04.953520 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6572344d-39fd-40b2-9088-58d2f1f76547 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1392 microversion: 2.1 time: 0.252234 Sep 07 13:26:04.954300 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3197/6425] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:04 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1392 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:05.053287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-777e5b06-a32b-4687-b62e-5c1a06e37db0 req-79551d8d-f1b8-4033-8ed9-f84002a89677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87ce5a84-9ebd-4540-b82f-2fc21fb9518e", "tag": "2146a517-5fea-4a11-a2e2-5cba05352f1a"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:26:05.065414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-777e5b06-a32b-4687-b62e-5c1a06e37db0 req-79551d8d-f1b8-4033-8ed9-f84002a89677 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:05.065990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-777e5b06-a32b-4687-b62e-5c1a06e37db0 req-79551d8d-f1b8-4033-8ed9-f84002a89677 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:05.066447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-777e5b06-a32b-4687-b62e-5c1a06e37db0 req-79551d8d-f1b8-4033-8ed9-f84002a89677 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:05.080198 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-777e5b06-a32b-4687-b62e-5c1a06e37db0 req-79551d8d-f1b8-4033-8ed9-f84002a89677 service nova] Creating event network-changed:2146a517-5fea-4a11-a2e2-5cba05352f1a for instance 87ce5a84-9ebd-4540-b82f-2fc21fb9518e on n-h1-852087-9 Sep 07 13:26:05.086504 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-777e5b06-a32b-4687-b62e-5c1a06e37db0 req-79551d8d-f1b8-4033-8ed9-f84002a89677 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037038 Sep 07 13:26:05.087675 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3229/6426] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:26:05.365743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a82bc0bf-7164-4030-9de9-d8f5e5f7997a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:05.366497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a82bc0bf-7164-4030-9de9-d8f5e5f7997a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:05.374291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a82bc0bf-7164-4030-9de9-d8f5e5f7997a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:05.374798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a82bc0bf-7164-4030-9de9-d8f5e5f7997a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:05.375476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a82bc0bf-7164-4030-9de9-d8f5e5f7997a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:05.375994 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a82bc0bf-7164-4030-9de9-d8f5e5f7997a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:05.376465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a82bc0bf-7164-4030-9de9-d8f5e5f7997a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:05.376913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a82bc0bf-7164-4030-9de9-d8f5e5f7997a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:05.383178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:05.469194 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a82bc0bf-7164-4030-9de9-d8f5e5f7997a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:05.483031 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a82bc0bf-7164-4030-9de9-d8f5e5f7997a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1361 microversion: 2.1 time: 0.122163 Sep 07 13:26:05.484151 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3198/6427] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:05 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1361 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:05.980687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-05058384-72ee-4dab-a744-f442a709dfd8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:05.981516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-05058384-72ee-4dab-a744-f442a709dfd8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:05.990333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05058384-72ee-4dab-a744-f442a709dfd8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:05.990906 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05058384-72ee-4dab-a744-f442a709dfd8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:05.991469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05058384-72ee-4dab-a744-f442a709dfd8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:05.992264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05058384-72ee-4dab-a744-f442a709dfd8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:05.993015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05058384-72ee-4dab-a744-f442a709dfd8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:05.993711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05058384-72ee-4dab-a744-f442a709dfd8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:06.175207 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-05058384-72ee-4dab-a744-f442a709dfd8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:06.184682 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-05058384-72ee-4dab-a744-f442a709dfd8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1392 microversion: 2.1 time: 0.210153 Sep 07 13:26:06.185444 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3230/6428] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:05 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1392 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:06.524573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-80cbf93f-1ca1-4a0e-9024-1665bf01bcc3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:06.525102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-80cbf93f-1ca1-4a0e-9024-1665bf01bcc3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:06.532896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80cbf93f-1ca1-4a0e-9024-1665bf01bcc3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:06.533549 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80cbf93f-1ca1-4a0e-9024-1665bf01bcc3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:06.533988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80cbf93f-1ca1-4a0e-9024-1665bf01bcc3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:06.534723 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80cbf93f-1ca1-4a0e-9024-1665bf01bcc3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:06.535258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80cbf93f-1ca1-4a0e-9024-1665bf01bcc3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:06.535754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80cbf93f-1ca1-4a0e-9024-1665bf01bcc3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:06.905623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:06.935034 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-80cbf93f-1ca1-4a0e-9024-1665bf01bcc3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:06.955100 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-80cbf93f-1ca1-4a0e-9024-1665bf01bcc3 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1361 microversion: 2.1 time: 0.434215 Sep 07 13:26:06.956193 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3199/6429] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:06 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1361 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:07.232648 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-898ac6d7-0ec1-4e27-b768-82734674a9ab tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:07.234919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-898ac6d7-0ec1-4e27-b768-82734674a9ab tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:07.246965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:07.248861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:07.271702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-898ac6d7-0ec1-4e27-b768-82734674a9ab tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:07.274052 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-898ac6d7-0ec1-4e27-b768-82734674a9ab tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:07.275372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-898ac6d7-0ec1-4e27-b768-82734674a9ab tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:07.277010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-898ac6d7-0ec1-4e27-b768-82734674a9ab tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:07.278333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-898ac6d7-0ec1-4e27-b768-82734674a9ab tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:07.279420 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-898ac6d7-0ec1-4e27-b768-82734674a9ab tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:07.529238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-898ac6d7-0ec1-4e27-b768-82734674a9ab tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:07.538905 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-898ac6d7-0ec1-4e27-b768-82734674a9ab tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1392 microversion: 2.1 time: 0.314785 Sep 07 13:26:07.539697 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3231/6430] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:07 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1392 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:07.999244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6b08386e-c17a-4c61-bcf6-667d6d7469be tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:08.000923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6b08386e-c17a-4c61-bcf6-667d6d7469be tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:08.012257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b08386e-c17a-4c61-bcf6-667d6d7469be tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:08.013099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b08386e-c17a-4c61-bcf6-667d6d7469be tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:08.013890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b08386e-c17a-4c61-bcf6-667d6d7469be tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:08.015018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b08386e-c17a-4c61-bcf6-667d6d7469be tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:08.015735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b08386e-c17a-4c61-bcf6-667d6d7469be tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:08.016176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b08386e-c17a-4c61-bcf6-667d6d7469be tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:08.068288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b08386e-c17a-4c61-bcf6-667d6d7469be tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:08.068923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b08386e-c17a-4c61-bcf6-667d6d7469be tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:08.069454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b08386e-c17a-4c61-bcf6-667d6d7469be tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:08.070162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-6b08386e-c17a-4c61-bcf6-667d6d7469be tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lazy-loading 'fault' on Instance uuid eca73d9e-2af2-41b6-a572-d5315e5fd9c5 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:26:08.129628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6b08386e-c17a-4c61-bcf6-667d6d7469be tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:08.139714 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6b08386e-c17a-4c61-bcf6-667d6d7469be tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 200 len: 1366 microversion: 2.1 time: 0.152557 Sep 07 13:26:08.140323 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3200/6431] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:07 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:08.579229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-99a48a50-c081-4f7b-8c29-4295415e84e1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:08.579939 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-99a48a50-c081-4f7b-8c29-4295415e84e1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:08.587862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99a48a50-c081-4f7b-8c29-4295415e84e1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:08.588486 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99a48a50-c081-4f7b-8c29-4295415e84e1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:08.589389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99a48a50-c081-4f7b-8c29-4295415e84e1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:08.590261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99a48a50-c081-4f7b-8c29-4295415e84e1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:08.590832 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99a48a50-c081-4f7b-8c29-4295415e84e1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:08.591352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-99a48a50-c081-4f7b-8c29-4295415e84e1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:08.795521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-99a48a50-c081-4f7b-8c29-4295415e84e1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:08.808433 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-99a48a50-c081-4f7b-8c29-4295415e84e1 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1392 microversion: 2.1 time: 0.234155 Sep 07 13:26:08.815046 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3232/6432] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:08 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1392 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:26:09.186964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-218a77fa-92fa-44c7-813c-a74d3e133e82 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:09.188274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-218a77fa-92fa-44c7-813c-a74d3e133e82 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:09.201568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-218a77fa-92fa-44c7-813c-a74d3e133e82 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:09.202600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-218a77fa-92fa-44c7-813c-a74d3e133e82 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:09.203612 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-218a77fa-92fa-44c7-813c-a74d3e133e82 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:09.205191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-218a77fa-92fa-44c7-813c-a74d3e133e82 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:09.206051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-218a77fa-92fa-44c7-813c-a74d3e133e82 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:09.206842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-218a77fa-92fa-44c7-813c-a74d3e133e82 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:09.238591 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-218a77fa-92fa-44c7-813c-a74d3e133e82 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] HTTP exception thrown: Instance eca73d9e-2af2-41b6-a572-d5315e5fd9c5 could not be found. Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-218a77fa-92fa-44c7-813c-a74d3e133e82 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Request method failure captured: Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 HTTP/1.1 Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJrKtGg8mTUS8TVRSUKjETENKgBfLqI2oUMffXPZtsQfHAGfvsCSe64IHdsu1gAtG3a2XlfVJiJMXBeXoxoYCkAhaL6z1XH8667-SWfmJ5tkR4WMw-DlaHMfOvoGzJHrmW4OvMTJQgI9_G9o9R2vidCDnbLRABw8OsiYOeqYc9Klp2E Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 90d330a2d2ad4295873277de2d649182 Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance eca73d9e-2af2-41b6-a572-d5315e5fd9c5 could not be found. Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'eca73d9e-2af2-41b6-a572-d5315e5fd9c5'} Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eca73d9e-2af2-41b6-a572-d5315e5fd9c5 could not be found. Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eca73d9e-2af2-41b6-a572-d5315e5fd9c5 could not be found. Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:26:09.241860 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:26:09.248289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:09.248289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:26:09.248289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:26:09.248289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:26:09.248289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:26:09.248289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eca73d9e-2af2-41b6-a572-d5315e5fd9c5 could not be found. Sep 07 13:26:09.248289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:26:09.250594 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-218a77fa-92fa-44c7-813c-a74d3e133e82 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Returning 404 to user: Instance eca73d9e-2af2-41b6-a572-d5315e5fd9c5 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:26:09.252539 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-218a77fa-92fa-44c7-813c-a74d3e133e82 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 404 len: 111 microversion: 2.1 time: 0.074486 Sep 07 13:26:09.253861 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3201/6433] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:09 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 13:26:09.840334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c34929b9-ae10-4646-ac21-2b62844b771a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:09.841759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c34929b9-ae10-4646-ac21-2b62844b771a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:09.851900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c34929b9-ae10-4646-ac21-2b62844b771a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:09.852488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c34929b9-ae10-4646-ac21-2b62844b771a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:09.853102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c34929b9-ae10-4646-ac21-2b62844b771a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:09.854280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c34929b9-ae10-4646-ac21-2b62844b771a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:09.854765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c34929b9-ae10-4646-ac21-2b62844b771a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:09.855939 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c34929b9-ae10-4646-ac21-2b62844b771a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:10.172118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c34929b9-ae10-4646-ac21-2b62844b771a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:10.187450 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c34929b9-ae10-4646-ac21-2b62844b771a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1392 microversion: 2.1 time: 0.352663 Sep 07 13:26:10.188843 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3233/6434] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:09 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1392 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:11.232538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-74a36c76-87cd-475e-8cd3-989539501ec5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:11.233683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-74a36c76-87cd-475e-8cd3-989539501ec5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:11.247046 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74a36c76-87cd-475e-8cd3-989539501ec5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:11.249434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74a36c76-87cd-475e-8cd3-989539501ec5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:11.251447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74a36c76-87cd-475e-8cd3-989539501ec5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:11.253267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74a36c76-87cd-475e-8cd3-989539501ec5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:11.254995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74a36c76-87cd-475e-8cd3-989539501ec5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:11.255473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-9e7d547d-6ce1-456e-a27d-857839e2f9f2 req-7ed4fe62-d938-44b5-895d-ffb9ce13c2a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87ce5a84-9ebd-4540-b82f-2fc21fb9518e", "name": "network-vif-plugged", "status": "completed", "tag": "2146a517-5fea-4a11-a2e2-5cba05352f1a"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:26:11.256810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74a36c76-87cd-475e-8cd3-989539501ec5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:11.279685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9e7d547d-6ce1-456e-a27d-857839e2f9f2 req-7ed4fe62-d938-44b5-895d-ffb9ce13c2a7 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:11.280744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9e7d547d-6ce1-456e-a27d-857839e2f9f2 req-7ed4fe62-d938-44b5-895d-ffb9ce13c2a7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:11.281667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9e7d547d-6ce1-456e-a27d-857839e2f9f2 req-7ed4fe62-d938-44b5-895d-ffb9ce13c2a7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:11.314635 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-9e7d547d-6ce1-456e-a27d-857839e2f9f2 req-7ed4fe62-d938-44b5-895d-ffb9ce13c2a7 service nova] Creating event network-vif-plugged:2146a517-5fea-4a11-a2e2-5cba05352f1a for instance 87ce5a84-9ebd-4540-b82f-2fc21fb9518e on n-h1-852087-9 Sep 07 13:26:11.329046 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-9e7d547d-6ce1-456e-a27d-857839e2f9f2 req-7ed4fe62-d938-44b5-895d-ffb9ce13c2a7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086229 Sep 07 13:26:11.331056 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3234/6435] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:26:11.484840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-74a36c76-87cd-475e-8cd3-989539501ec5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:11.502177 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-74a36c76-87cd-475e-8cd3-989539501ec5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1392 microversion: 2.1 time: 0.276549 Sep 07 13:26:11.503430 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3202/6436] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:11 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1392 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:12.547389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-689635ca-5eb2-449d-8375-5509349ee37f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:12.548177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-689635ca-5eb2-449d-8375-5509349ee37f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:12.556626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-689635ca-5eb2-449d-8375-5509349ee37f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:12.557224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-689635ca-5eb2-449d-8375-5509349ee37f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:12.557888 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-689635ca-5eb2-449d-8375-5509349ee37f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:12.558767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-689635ca-5eb2-449d-8375-5509349ee37f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:12.559298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-689635ca-5eb2-449d-8375-5509349ee37f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:12.559944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-689635ca-5eb2-449d-8375-5509349ee37f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:12.754836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-689635ca-5eb2-449d-8375-5509349ee37f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:12.764654 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-689635ca-5eb2-449d-8375-5509349ee37f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1392 microversion: 2.1 time: 0.224164 Sep 07 13:26:12.765291 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3235/6437] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:12 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1392 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:13.688718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8e9b5222-70b9-4a46-8078-fb8236dc9e62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:13.689991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8e9b5222-70b9-4a46-8078-fb8236dc9e62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:13.698188 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e9b5222-70b9-4a46-8078-fb8236dc9e62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:13.698705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e9b5222-70b9-4a46-8078-fb8236dc9e62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:13.699168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e9b5222-70b9-4a46-8078-fb8236dc9e62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:13.699931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e9b5222-70b9-4a46-8078-fb8236dc9e62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:13.700404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e9b5222-70b9-4a46-8078-fb8236dc9e62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:13.700849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8e9b5222-70b9-4a46-8078-fb8236dc9e62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:13.733208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8e9b5222-70b9-4a46-8078-fb8236dc9e62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:26:13.804877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ded78d61-e256-49da-9d1b-03e6f22247e8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:13.806274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ded78d61-e256-49da-9d1b-03e6f22247e8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:13.825840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ded78d61-e256-49da-9d1b-03e6f22247e8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:13.826438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ded78d61-e256-49da-9d1b-03e6f22247e8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:13.827180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ded78d61-e256-49da-9d1b-03e6f22247e8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:13.828845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ded78d61-e256-49da-9d1b-03e6f22247e8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:13.829882 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ded78d61-e256-49da-9d1b-03e6f22247e8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:13.831061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ded78d61-e256-49da-9d1b-03e6f22247e8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:13.836668 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8e9b5222-70b9-4a46-8078-fb8236dc9e62 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 204 len: 0 microversion: 2.1 time: 0.152593 Sep 07 13:26:13.837639 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3203/6438] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:26:13 2022] DELETE /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:26:13.851524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cf7b172c-09b8-4bc5-ae87-a2c00bb7d927 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:13.852783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cf7b172c-09b8-4bc5-ae87-a2c00bb7d927 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:13.866411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf7b172c-09b8-4bc5-ae87-a2c00bb7d927 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:13.867291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf7b172c-09b8-4bc5-ae87-a2c00bb7d927 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:13.868179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf7b172c-09b8-4bc5-ae87-a2c00bb7d927 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:13.869791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf7b172c-09b8-4bc5-ae87-a2c00bb7d927 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:13.870754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf7b172c-09b8-4bc5-ae87-a2c00bb7d927 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:13.871511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf7b172c-09b8-4bc5-ae87-a2c00bb7d927 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:14.097107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ded78d61-e256-49da-9d1b-03e6f22247e8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:14.108508 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ded78d61-e256-49da-9d1b-03e6f22247e8 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1563 microversion: 2.1 time: 0.310731 Sep 07 13:26:14.109310 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3236/6439] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:13 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1563 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:26:14.140024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c628684-d8ad-4a06-95ef-e2641b36b185 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:14.140930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7c628684-d8ad-4a06-95ef-e2641b36b185 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:14.149208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c628684-d8ad-4a06-95ef-e2641b36b185 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:14.150169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c628684-d8ad-4a06-95ef-e2641b36b185 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:14.151126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c628684-d8ad-4a06-95ef-e2641b36b185 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:14.152537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c628684-d8ad-4a06-95ef-e2641b36b185 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:14.153596 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c628684-d8ad-4a06-95ef-e2641b36b185 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:14.154217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c628684-d8ad-4a06-95ef-e2641b36b185 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:14.378573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cf7b172c-09b8-4bc5-ae87-a2c00bb7d927 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:14.385887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7c628684-d8ad-4a06-95ef-e2641b36b185 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:14.389208 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cf7b172c-09b8-4bc5-ae87-a2c00bb7d927 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 200 len: 1411 microversion: 2.1 time: 0.544770 Sep 07 13:26:14.389971 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3204/6440] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:13 2022] GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 1411 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:14.400178 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7c628684-d8ad-4a06-95ef-e2641b36b185 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1563 microversion: 2.1 time: 0.265926 Sep 07 13:26:14.401158 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3237/6441] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:14 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1563 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:26:15.417686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-82e3c85a-8318-4017-942f-ecd3a60a6d02 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:15.418780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-82e3c85a-8318-4017-942f-ecd3a60a6d02 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:15.430184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82e3c85a-8318-4017-942f-ecd3a60a6d02 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:15.430986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82e3c85a-8318-4017-942f-ecd3a60a6d02 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:15.431587 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82e3c85a-8318-4017-942f-ecd3a60a6d02 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:15.432455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82e3c85a-8318-4017-942f-ecd3a60a6d02 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:15.433014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82e3c85a-8318-4017-942f-ecd3a60a6d02 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:15.433837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82e3c85a-8318-4017-942f-ecd3a60a6d02 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:15.992514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-82e3c85a-8318-4017-942f-ecd3a60a6d02 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:16.003504 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-82e3c85a-8318-4017-942f-ecd3a60a6d02 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 200 len: 1411 microversion: 2.1 time: 0.593469 Sep 07 13:26:16.004732 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3205/6442] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:15 2022] GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 1411 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:16.803459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-617a796b-74be-4f92-be22-950c1e6747df req-644d49e1-1bc7-4b1d-9c97-b918097da83c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00236d6-af50-477e-ab01-73e4be911d90", "name": "network-vif-deleted", "tag": "34b5bdcc-cd11-4c75-8dcc-14f70cfd9050"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:26:16.822853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-617a796b-74be-4f92-be22-950c1e6747df req-644d49e1-1bc7-4b1d-9c97-b918097da83c service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:16.823330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-617a796b-74be-4f92-be22-950c1e6747df req-644d49e1-1bc7-4b1d-9c97-b918097da83c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:16.824346 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-617a796b-74be-4f92-be22-950c1e6747df req-644d49e1-1bc7-4b1d-9c97-b918097da83c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:16.848008 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-617a796b-74be-4f92-be22-950c1e6747df req-644d49e1-1bc7-4b1d-9c97-b918097da83c service nova] Creating event network-vif-deleted:34b5bdcc-cd11-4c75-8dcc-14f70cfd9050 for instance c00236d6-af50-477e-ab01-73e4be911d90 on n-h2-852087-9 Sep 07 13:26:16.855325 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-617a796b-74be-4f92-be22-950c1e6747df req-644d49e1-1bc7-4b1d-9c97-b918097da83c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057854 Sep 07 13:26:16.856246 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3238/6443] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:26:17.036153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1bd7dbe1-9590-4519-8be0-eaab07d1d908 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:17.037642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1bd7dbe1-9590-4519-8be0-eaab07d1d908 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:17.052971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1bd7dbe1-9590-4519-8be0-eaab07d1d908 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:17.054285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1bd7dbe1-9590-4519-8be0-eaab07d1d908 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:17.056608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1bd7dbe1-9590-4519-8be0-eaab07d1d908 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:17.058214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1bd7dbe1-9590-4519-8be0-eaab07d1d908 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:17.059307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1bd7dbe1-9590-4519-8be0-eaab07d1d908 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:17.061180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1bd7dbe1-9590-4519-8be0-eaab07d1d908 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:17.214671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1bd7dbe1-9590-4519-8be0-eaab07d1d908 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:17.232595 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1bd7dbe1-9590-4519-8be0-eaab07d1d908 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 200 len: 1202 microversion: 2.1 time: 0.203718 Sep 07 13:26:17.235845 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3206/6444] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:17 2022] GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 1202 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:17.359596 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c5121c49-e285-4017-a3b1-0ab63e41048e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:17.360636 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c5121c49-e285-4017-a3b1-0ab63e41048e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:17.370494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5121c49-e285-4017-a3b1-0ab63e41048e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:17.371237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5121c49-e285-4017-a3b1-0ab63e41048e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:17.371850 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5121c49-e285-4017-a3b1-0ab63e41048e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:17.373104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5121c49-e285-4017-a3b1-0ab63e41048e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:17.373893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5121c49-e285-4017-a3b1-0ab63e41048e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:17.374818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5121c49-e285-4017-a3b1-0ab63e41048e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:17.556417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c5121c49-e285-4017-a3b1-0ab63e41048e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:17.565454 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c5121c49-e285-4017-a3b1-0ab63e41048e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1563 microversion: 2.1 time: 0.211696 Sep 07 13:26:17.566087 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3239/6445] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:17 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1563 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:18.271738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b837e8c9-798e-4915-8ba2-d4fa477b9247 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:18.273424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b837e8c9-798e-4915-8ba2-d4fa477b9247 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:18.278990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:18.285331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b837e8c9-798e-4915-8ba2-d4fa477b9247 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:18.286017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b837e8c9-798e-4915-8ba2-d4fa477b9247 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:18.286666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b837e8c9-798e-4915-8ba2-d4fa477b9247 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:18.288000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b837e8c9-798e-4915-8ba2-d4fa477b9247 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:18.288613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b837e8c9-798e-4915-8ba2-d4fa477b9247 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:18.289155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b837e8c9-798e-4915-8ba2-d4fa477b9247 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:18.389173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b837e8c9-798e-4915-8ba2-d4fa477b9247 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:18.399211 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b837e8c9-798e-4915-8ba2-d4fa477b9247 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 200 len: 1202 microversion: 2.1 time: 0.135044 Sep 07 13:26:18.400096 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3207/6446] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:18 2022] GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 1202 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:18.939659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-d5507b80-14a5-407a-90c0-d3219a36b759 req-63885c68-d9c7-4d0c-a0cd-740da84f4575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87ce5a84-9ebd-4540-b82f-2fc21fb9518e", "tag": "2146a517-5fea-4a11-a2e2-5cba05352f1a"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:26:18.956108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d5507b80-14a5-407a-90c0-d3219a36b759 req-63885c68-d9c7-4d0c-a0cd-740da84f4575 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:18.956793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d5507b80-14a5-407a-90c0-d3219a36b759 req-63885c68-d9c7-4d0c-a0cd-740da84f4575 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:18.957582 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d5507b80-14a5-407a-90c0-d3219a36b759 req-63885c68-d9c7-4d0c-a0cd-740da84f4575 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:18.975049 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-d5507b80-14a5-407a-90c0-d3219a36b759 req-63885c68-d9c7-4d0c-a0cd-740da84f4575 service nova] Creating event network-changed:2146a517-5fea-4a11-a2e2-5cba05352f1a for instance 87ce5a84-9ebd-4540-b82f-2fc21fb9518e on n-h1-852087-9 Sep 07 13:26:18.985670 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-d5507b80-14a5-407a-90c0-d3219a36b759 req-63885c68-d9c7-4d0c-a0cd-740da84f4575 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052995 Sep 07 13:26:18.987084 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3240/6447] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:26:19.424513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-48a55006-de97-456b-9d3b-ffa043996853 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:19.425348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-48a55006-de97-456b-9d3b-ffa043996853 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:19.436907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48a55006-de97-456b-9d3b-ffa043996853 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:19.437780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48a55006-de97-456b-9d3b-ffa043996853 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:19.438499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48a55006-de97-456b-9d3b-ffa043996853 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:19.439766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48a55006-de97-456b-9d3b-ffa043996853 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:19.440520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48a55006-de97-456b-9d3b-ffa043996853 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:19.441212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48a55006-de97-456b-9d3b-ffa043996853 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:19.574573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-48a55006-de97-456b-9d3b-ffa043996853 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:19.585121 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-48a55006-de97-456b-9d3b-ffa043996853 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 200 len: 1202 microversion: 2.1 time: 0.164908 Sep 07 13:26:19.590229 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3208/6448] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:19 2022] GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 1202 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:20.615844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c06dae42-ebc2-431a-b68d-4a50b0ebc922 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:20.617045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c06dae42-ebc2-431a-b68d-4a50b0ebc922 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:20.630827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c06dae42-ebc2-431a-b68d-4a50b0ebc922 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:20.631675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c06dae42-ebc2-431a-b68d-4a50b0ebc922 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:20.632739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c06dae42-ebc2-431a-b68d-4a50b0ebc922 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:20.634074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c06dae42-ebc2-431a-b68d-4a50b0ebc922 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:20.634672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c06dae42-ebc2-431a-b68d-4a50b0ebc922 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:20.635141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c06dae42-ebc2-431a-b68d-4a50b0ebc922 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:20.638975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:20.823896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c06dae42-ebc2-431a-b68d-4a50b0ebc922 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:20.836931 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c06dae42-ebc2-431a-b68d-4a50b0ebc922 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 200 len: 1202 microversion: 2.1 time: 0.229842 Sep 07 13:26:20.837741 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3241/6449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:20 2022] GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 1202 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:21.861177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-03b4445f-f896-4be1-8fc6-274c357fec3c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:21.862094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-03b4445f-f896-4be1-8fc6-274c357fec3c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:21.871044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03b4445f-f896-4be1-8fc6-274c357fec3c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:21.871837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03b4445f-f896-4be1-8fc6-274c357fec3c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:21.872148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03b4445f-f896-4be1-8fc6-274c357fec3c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:21.873434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03b4445f-f896-4be1-8fc6-274c357fec3c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:21.874082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03b4445f-f896-4be1-8fc6-274c357fec3c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:21.874082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03b4445f-f896-4be1-8fc6-274c357fec3c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:21.976931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-03b4445f-f896-4be1-8fc6-274c357fec3c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:21.987676 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-03b4445f-f896-4be1-8fc6-274c357fec3c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 200 len: 1202 microversion: 2.1 time: 0.130757 Sep 07 13:26:21.988501 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3209/6450] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:21 2022] GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 1202 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:23.026557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-40205b69-4135-478f-bcd1-d8929d8b4cf2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:23.027229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-40205b69-4135-478f-bcd1-d8929d8b4cf2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:23.035065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40205b69-4135-478f-bcd1-d8929d8b4cf2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:23.035612 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40205b69-4135-478f-bcd1-d8929d8b4cf2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:23.036079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40205b69-4135-478f-bcd1-d8929d8b4cf2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:23.036836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40205b69-4135-478f-bcd1-d8929d8b4cf2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:23.037326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40205b69-4135-478f-bcd1-d8929d8b4cf2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:23.037816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40205b69-4135-478f-bcd1-d8929d8b4cf2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:23.054049 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-40205b69-4135-478f-bcd1-d8929d8b4cf2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] HTTP exception thrown: Instance c00236d6-af50-477e-ab01-73e4be911d90 could not be found. Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-40205b69-4135-478f-bcd1-d8929d8b4cf2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Request method failure captured: Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 HTTP/1.1 Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJrKtGg8mTUS8TVRSUKjETENKgBfLqI2oUMffXPZtsQfHAGfvsCSe64IHdsu1gAtG3a2XlfVJiJMXBeXoxoYCkAhaL6z1XH8667-SWfmJ5tkR4WMw-DlaHMfOvoGzJHrmW4OvMTJQgI9_G9o9R2vidCDnbLRABw8OsiYOeqYc9Klp2E Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 90d330a2d2ad4295873277de2d649182 Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance c00236d6-af50-477e-ab01-73e4be911d90 could not be found. Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'c00236d6-af50-477e-ab01-73e4be911d90'} Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c00236d6-af50-477e-ab01-73e4be911d90 could not be found. Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c00236d6-af50-477e-ab01-73e4be911d90 could not be found. Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:26:23.055880 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:26:23.059771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:23.059771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:26:23.059771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:26:23.059771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:26:23.059771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:26:23.059771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c00236d6-af50-477e-ab01-73e4be911d90 could not be found. Sep 07 13:26:23.059771 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:26:23.059771 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-40205b69-4135-478f-bcd1-d8929d8b4cf2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Returning 404 to user: Instance c00236d6-af50-477e-ab01-73e4be911d90 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:26:23.059771 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-40205b69-4135-478f-bcd1-d8929d8b4cf2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 404 len: 111 microversion: 2.1 time: 0.035217 Sep 07 13:26:23.061381 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3242/6451] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:23 2022] GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:26:25.416254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e4b780cd-988f-44df-b494-7d33a144632e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:25.417070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e4b780cd-988f-44df-b494-7d33a144632e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:25.424318 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4b780cd-988f-44df-b494-7d33a144632e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:25.424821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4b780cd-988f-44df-b494-7d33a144632e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:25.425267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4b780cd-988f-44df-b494-7d33a144632e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:25.426035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4b780cd-988f-44df-b494-7d33a144632e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:25.426498 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4b780cd-988f-44df-b494-7d33a144632e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:25.426926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e4b780cd-988f-44df-b494-7d33a144632e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:25.442611 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-e4b780cd-988f-44df-b494-7d33a144632e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] HTTP exception thrown: Instance eca73d9e-2af2-41b6-a572-d5315e5fd9c5 could not be found. Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e4b780cd-988f-44df-b494-7d33a144632e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Request method failure captured: Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 HTTP/1.1 Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJrKtGg8mTUS8TVRSUKjETENKgBfLqI2oUMffXPZtsQfHAGfvsCSe64IHdsu1gAtG3a2XlfVJiJMXBeXoxoYCkAhaL6z1XH8667-SWfmJ5tkR4WMw-DlaHMfOvoGzJHrmW4OvMTJQgI9_G9o9R2vidCDnbLRABw8OsiYOeqYc9Klp2E Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 90d330a2d2ad4295873277de2d649182 Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance eca73d9e-2af2-41b6-a572-d5315e5fd9c5 could not be found. Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'eca73d9e-2af2-41b6-a572-d5315e5fd9c5'} Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eca73d9e-2af2-41b6-a572-d5315e5fd9c5 could not be found. Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:26:25.444368 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:26:25.447549 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eca73d9e-2af2-41b6-a572-d5315e5fd9c5 could not be found. Sep 07 13:26:25.447549 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:26:25.447549 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:26:25.447549 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:26:25.447549 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:25.447549 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:26:25.447549 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:26:25.447549 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:26:25.447549 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:26:25.447549 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eca73d9e-2af2-41b6-a572-d5315e5fd9c5 could not be found. Sep 07 13:26:25.447549 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:26:25.447549 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e4b780cd-988f-44df-b494-7d33a144632e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Returning 404 to user: Instance eca73d9e-2af2-41b6-a572-d5315e5fd9c5 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:26:25.447549 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e4b780cd-988f-44df-b494-7d33a144632e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 404 len: 111 microversion: 2.1 time: 0.033711 Sep 07 13:26:25.447549 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3210/6452] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:26:25 2022] DELETE /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:26:25.455011 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de63f288-4b5b-4cf0-9588-c0b93964c9ec tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:25.455654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-de63f288-4b5b-4cf0-9588-c0b93964c9ec tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: eca73d9e-2af2-41b6-a572-d5315e5fd9c5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:25.458586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:25.464959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de63f288-4b5b-4cf0-9588-c0b93964c9ec tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:25.465475 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de63f288-4b5b-4cf0-9588-c0b93964c9ec tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:25.465956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de63f288-4b5b-4cf0-9588-c0b93964c9ec tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:25.466696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de63f288-4b5b-4cf0-9588-c0b93964c9ec tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:25.467170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de63f288-4b5b-4cf0-9588-c0b93964c9ec tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:25.467617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de63f288-4b5b-4cf0-9588-c0b93964c9ec tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:25.486889 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-de63f288-4b5b-4cf0-9588-c0b93964c9ec tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] HTTP exception thrown: Instance eca73d9e-2af2-41b6-a572-d5315e5fd9c5 could not be found. Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de63f288-4b5b-4cf0-9588-c0b93964c9ec tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Request method failure captured: Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 HTTP/1.1 Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJrKtGg8mTUS8TVRSUKjETENKgBfLqI2oUMffXPZtsQfHAGfvsCSe64IHdsu1gAtG3a2XlfVJiJMXBeXoxoYCkAhaL6z1XH8667-SWfmJ5tkR4WMw-DlaHMfOvoGzJHrmW4OvMTJQgI9_G9o9R2vidCDnbLRABw8OsiYOeqYc9Klp2E Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 90d330a2d2ad4295873277de2d649182 Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance eca73d9e-2af2-41b6-a572-d5315e5fd9c5 could not be found. Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'eca73d9e-2af2-41b6-a572-d5315e5fd9c5'} Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eca73d9e-2af2-41b6-a572-d5315e5fd9c5 could not be found. Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eca73d9e-2af2-41b6-a572-d5315e5fd9c5 could not be found. Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:26:25.488488 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:26:25.494108 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:25.494108 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:26:25.494108 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:26:25.494108 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:26:25.494108 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:26:25.494108 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eca73d9e-2af2-41b6-a572-d5315e5fd9c5 could not be found. Sep 07 13:26:25.494108 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:26:25.494108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de63f288-4b5b-4cf0-9588-c0b93964c9ec tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Returning 404 to user: Instance eca73d9e-2af2-41b6-a572-d5315e5fd9c5 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:26:25.494108 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-de63f288-4b5b-4cf0-9588-c0b93964c9ec tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5" status: 404 len: 111 microversion: 2.1 time: 0.039085 Sep 07 13:26:25.494108 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3243/6453] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:25 2022] GET /compute/v2.1/servers/eca73d9e-2af2-41b6-a572-d5315e5fd9c5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:26:26.146753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-196e2310-e212-4b49-a8a7-b456872e8aff tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:26.147499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-196e2310-e212-4b49-a8a7-b456872e8aff tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:26.154253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-196e2310-e212-4b49-a8a7-b456872e8aff tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:26.154758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-196e2310-e212-4b49-a8a7-b456872e8aff tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:26.155205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-196e2310-e212-4b49-a8a7-b456872e8aff tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:26.155939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-196e2310-e212-4b49-a8a7-b456872e8aff tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:26.156404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-196e2310-e212-4b49-a8a7-b456872e8aff tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:26.156840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-196e2310-e212-4b49-a8a7-b456872e8aff tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:26.178125 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-196e2310-e212-4b49-a8a7-b456872e8aff tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] HTTP exception thrown: Instance c00236d6-af50-477e-ab01-73e4be911d90 could not be found. Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-196e2310-e212-4b49-a8a7-b456872e8aff tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Request method failure captured: Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 HTTP/1.1 Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJrKtGg8mTUS8TVRSUKjETENKgBfLqI2oUMffXPZtsQfHAGfvsCSe64IHdsu1gAtG3a2XlfVJiJMXBeXoxoYCkAhaL6z1XH8667-SWfmJ5tkR4WMw-DlaHMfOvoGzJHrmW4OvMTJQgI9_G9o9R2vidCDnbLRABw8OsiYOeqYc9Klp2E Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 90d330a2d2ad4295873277de2d649182 Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance c00236d6-af50-477e-ab01-73e4be911d90 could not be found. Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'c00236d6-af50-477e-ab01-73e4be911d90'} Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c00236d6-af50-477e-ab01-73e4be911d90 could not be found. Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:26:26.181088 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:26:26.184830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c00236d6-af50-477e-ab01-73e4be911d90 could not be found. Sep 07 13:26:26.184830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:26:26.184830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:26:26.184830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:26:26.184830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:26.184830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:26:26.184830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:26:26.184830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:26:26.184830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:26:26.184830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c00236d6-af50-477e-ab01-73e4be911d90 could not be found. Sep 07 13:26:26.184830 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:26:26.186482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-196e2310-e212-4b49-a8a7-b456872e8aff tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Returning 404 to user: Instance c00236d6-af50-477e-ab01-73e4be911d90 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:26:26.188123 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-196e2310-e212-4b49-a8a7-b456872e8aff tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 404 len: 111 microversion: 2.1 time: 0.045254 Sep 07 13:26:26.189280 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3211/6454] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:26:26 2022] DELETE /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:26:26.198495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-55aefd1f-1aaa-4394-97dd-db180cd4fbea tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:26.199142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-55aefd1f-1aaa-4394-97dd-db180cd4fbea tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: c00236d6-af50-477e-ab01-73e4be911d90] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:26.206068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55aefd1f-1aaa-4394-97dd-db180cd4fbea tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:26.206583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55aefd1f-1aaa-4394-97dd-db180cd4fbea tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:26.207030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55aefd1f-1aaa-4394-97dd-db180cd4fbea tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:26.207754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55aefd1f-1aaa-4394-97dd-db180cd4fbea tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:26.208231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55aefd1f-1aaa-4394-97dd-db180cd4fbea tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:26.208669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55aefd1f-1aaa-4394-97dd-db180cd4fbea tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:26.224857 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-55aefd1f-1aaa-4394-97dd-db180cd4fbea tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] HTTP exception thrown: Instance c00236d6-af50-477e-ab01-73e4be911d90 could not be found. Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-55aefd1f-1aaa-4394-97dd-db180cd4fbea tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Request method failure captured: Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 HTTP/1.1 Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJrKtGg8mTUS8TVRSUKjETENKgBfLqI2oUMffXPZtsQfHAGfvsCSe64IHdsu1gAtG3a2XlfVJiJMXBeXoxoYCkAhaL6z1XH8667-SWfmJ5tkR4WMw-DlaHMfOvoGzJHrmW4OvMTJQgI9_G9o9R2vidCDnbLRABw8OsiYOeqYc9Klp2E Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 90d330a2d2ad4295873277de2d649182 Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance c00236d6-af50-477e-ab01-73e4be911d90 could not be found. Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'c00236d6-af50-477e-ab01-73e4be911d90'} Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c00236d6-af50-477e-ab01-73e4be911d90 could not be found. Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c00236d6-af50-477e-ab01-73e4be911d90 could not be found. Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:26:26.226523 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:26:26.232303 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:26:26.232303 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:26:26.232303 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:26:26.232303 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:26:26.232303 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:26:26.232303 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c00236d6-af50-477e-ab01-73e4be911d90 could not be found. Sep 07 13:26:26.232303 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:26:26.232303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-55aefd1f-1aaa-4394-97dd-db180cd4fbea tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Returning 404 to user: Instance c00236d6-af50-477e-ab01-73e4be911d90 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:26:26.232303 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-55aefd1f-1aaa-4394-97dd-db180cd4fbea tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90" status: 404 len: 111 microversion: 2.1 time: 0.034332 Sep 07 13:26:26.232303 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3244/6455] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:26 2022] GET /compute/v2.1/servers/c00236d6-af50-477e-ab01-73e4be911d90 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:26:26.306573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-11114493-ec67-4064-9650-f77ab289520f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Action: 'create', calling method: .version_select at 0x7fc41971b5e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2091031878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBZm/jV10lk24z9GruBIW622LZeQvMbjmWuFrEHl9a/IqO1Rn8ejx5L8wCQAV+YFHI+21fYu11OOp2OI5+DyfvIMgfO0zGtw5vN5VMiicRBcr8OFLlqaEKheHmsdKab0w=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:26:26.327277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-11114493-ec67-4064-9650-f77ab289520f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Getting quotas for project b97b8dd299f145888f90fbf60321cd18. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:26:26.333881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-11114493-ec67-4064-9650-f77ab289520f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Getting quotas for user 90d330a2d2ad4295873277de2d649182 and project b97b8dd299f145888f90fbf60321cd18. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:26:26.367390 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-11114493-ec67-4064-9650-f77ab289520f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.064783 Sep 07 13:26:26.368037 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3212/6456] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 13:26:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:26:31.007373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2879fe2f-11a0-4dc4-9c7d-dcd1025c4531 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:26:31.009989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2879fe2f-11a0-4dc4-9c7d-dcd1025c4531 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 4b030e3a-49f7-4481-98a9-878906e601b3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:31.018679 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2879fe2f-11a0-4dc4-9c7d-dcd1025c4531 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:31.019629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2879fe2f-11a0-4dc4-9c7d-dcd1025c4531 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:31.020111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2879fe2f-11a0-4dc4-9c7d-dcd1025c4531 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:31.020942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2879fe2f-11a0-4dc4-9c7d-dcd1025c4531 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:31.021456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2879fe2f-11a0-4dc4-9c7d-dcd1025c4531 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:31.021978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2879fe2f-11a0-4dc4-9c7d-dcd1025c4531 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:31.111671 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2879fe2f-11a0-4dc4-9c7d-dcd1025c4531 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "POST /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3/action" status: 200 len: 24572 microversion: 2.1 time: 0.107680 Sep 07 13:26:31.114377 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3245/6457] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:26:31 2022] POST /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3/action => generated 24572 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:26:44.167986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:44.169900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:44.170966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:44.179171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f76207f8-cdef-48a9-be8e-7bc0e38a4a67 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-719983645", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2091031878", "security_groups": [{"name": "tempest-secgroup-smoke-801476543"}], "block_device_mapping_v2": [{"uuid": "93f59304-263c-4b7a-b76a-de8ee56f65d0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7f5512e3-cd6c-43c3-ae4c-0cca06e090be"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:26:44.313774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-f76207f8-cdef-48a9-be8e-7bc0e38a4a67 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] validate_networks() for [('7f5512e3-cd6c-43c3-ae4c-0cca06e090be', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:26:45.033346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f76207f8-cdef-48a9-be8e-7bc0e38a4a67 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:26:45.033813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f76207f8-cdef-48a9-be8e-7bc0e38a4a67 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:26:45.034292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f76207f8-cdef-48a9-be8e-7bc0e38a4a67 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:26:45.034701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f76207f8-cdef-48a9-be8e-7bc0e38a4a67 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:26:45.035111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-f76207f8-cdef-48a9-be8e-7bc0e38a4a67 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:26:45.044750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f76207f8-cdef-48a9-be8e-7bc0e38a4a67 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:45.045240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f76207f8-cdef-48a9-be8e-7bc0e38a4a67 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:45.045752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f76207f8-cdef-48a9-be8e-7bc0e38a4a67 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:45.046475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f76207f8-cdef-48a9-be8e-7bc0e38a4a67 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:45.046905 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f76207f8-cdef-48a9-be8e-7bc0e38a4a67 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:45.047331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f76207f8-cdef-48a9-be8e-7bc0e38a4a67 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:45.064820 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-f76207f8-cdef-48a9-be8e-7bc0e38a4a67 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Getting quotas for project b97b8dd299f145888f90fbf60321cd18. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:26:45.070570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-f76207f8-cdef-48a9-be8e-7bc0e38a4a67 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Getting quotas for user 90d330a2d2ad4295873277de2d649182 and project b97b8dd299f145888f90fbf60321cd18. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:26:45.132746 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f76207f8-cdef-48a9-be8e-7bc0e38a4a67 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:26:45.134984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f76207f8-cdef-48a9-be8e-7bc0e38a4a67 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='93f59304-263c-4b7a-b76a-de8ee56f65d0',volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:26:45.282836 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f76207f8-cdef-48a9-be8e-7bc0e38a4a67 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.118099 Sep 07 13:26:45.283535 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3213/6458] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:26:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 1120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:26:45.295547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e5e47294-98fd-406c-913f-4d453640c13c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:45.296296 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e5e47294-98fd-406c-913f-4d453640c13c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:45.299230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=5 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:45.301072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=15 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:45.366719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e5e47294-98fd-406c-913f-4d453640c13c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:45.383797 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e5e47294-98fd-406c-913f-4d453640c13c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 200 len: 1094 microversion: 2.1 time: 0.092623 Sep 07 13:26:45.384394 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3246/6459] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:45 2022] GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 1094 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:46.409020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ee0ad56b-8141-4c05-bb6f-8aff6934a0dc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:46.409695 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ee0ad56b-8141-4c05-bb6f-8aff6934a0dc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:46.417690 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee0ad56b-8141-4c05-bb6f-8aff6934a0dc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:46.418205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee0ad56b-8141-4c05-bb6f-8aff6934a0dc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:46.418645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee0ad56b-8141-4c05-bb6f-8aff6934a0dc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:46.419376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee0ad56b-8141-4c05-bb6f-8aff6934a0dc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:46.419831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee0ad56b-8141-4c05-bb6f-8aff6934a0dc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:46.420255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ee0ad56b-8141-4c05-bb6f-8aff6934a0dc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:46.548629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ee0ad56b-8141-4c05-bb6f-8aff6934a0dc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:46.571277 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ee0ad56b-8141-4c05-bb6f-8aff6934a0dc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 200 len: 1200 microversion: 2.1 time: 0.153599 Sep 07 13:26:46.571277 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3214/6460] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:46 2022] GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 1200 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:47.610620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-af5e39b7-a6ad-4458-b8f3-8693544029e1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:47.610620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-af5e39b7-a6ad-4458-b8f3-8693544029e1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:47.626545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af5e39b7-a6ad-4458-b8f3-8693544029e1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:47.627725 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af5e39b7-a6ad-4458-b8f3-8693544029e1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:47.628937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af5e39b7-a6ad-4458-b8f3-8693544029e1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:47.630879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af5e39b7-a6ad-4458-b8f3-8693544029e1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:47.631560 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af5e39b7-a6ad-4458-b8f3-8693544029e1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:47.632477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af5e39b7-a6ad-4458-b8f3-8693544029e1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:47.912185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-af5e39b7-a6ad-4458-b8f3-8693544029e1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:47.925687 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-af5e39b7-a6ad-4458-b8f3-8693544029e1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 200 len: 1277 microversion: 2.1 time: 0.328290 Sep 07 13:26:47.927251 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3247/6461] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:47 2022] GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 1277 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:48.566893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-41e91faf-01bd-4ebb-bbfb-86ef3999b2c8 req-4fa64a16-870d-4d5c-8fd4-8cea093370fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9124e17-08d2-4641-b390-b43169aa6ca7", "tag": "56438486-fc55-406d-b77c-4295da73e413"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:26:48.585874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-41e91faf-01bd-4ebb-bbfb-86ef3999b2c8 req-4fa64a16-870d-4d5c-8fd4-8cea093370fc service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:48.587361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-41e91faf-01bd-4ebb-bbfb-86ef3999b2c8 req-4fa64a16-870d-4d5c-8fd4-8cea093370fc service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:48.588217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-41e91faf-01bd-4ebb-bbfb-86ef3999b2c8 req-4fa64a16-870d-4d5c-8fd4-8cea093370fc service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:48.614177 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-41e91faf-01bd-4ebb-bbfb-86ef3999b2c8 req-4fa64a16-870d-4d5c-8fd4-8cea093370fc service nova] Creating event network-changed:56438486-fc55-406d-b77c-4295da73e413 for instance b9124e17-08d2-4641-b390-b43169aa6ca7 on n-h2-852087-9 Sep 07 13:26:48.624554 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-41e91faf-01bd-4ebb-bbfb-86ef3999b2c8 req-4fa64a16-870d-4d5c-8fd4-8cea093370fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168680 Sep 07 13:26:48.629204 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3215/6462] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:26:48.969684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c47b72e7-5f44-4a3f-9c29-ef0090f57c43 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:48.970890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c47b72e7-5f44-4a3f-9c29-ef0090f57c43 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:48.983476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c47b72e7-5f44-4a3f-9c29-ef0090f57c43 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:48.984415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c47b72e7-5f44-4a3f-9c29-ef0090f57c43 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:48.985581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c47b72e7-5f44-4a3f-9c29-ef0090f57c43 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:48.987173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c47b72e7-5f44-4a3f-9c29-ef0090f57c43 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:48.988309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c47b72e7-5f44-4a3f-9c29-ef0090f57c43 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:48.989406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c47b72e7-5f44-4a3f-9c29-ef0090f57c43 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:49.220597 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c47b72e7-5f44-4a3f-9c29-ef0090f57c43 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:49.238384 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c47b72e7-5f44-4a3f-9c29-ef0090f57c43 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 200 len: 1277 microversion: 2.1 time: 0.276411 Sep 07 13:26:49.239580 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3248/6463] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:48 2022] GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 1277 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:26:50.279665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a3bfe640-4cb7-41b1-8d63-b6b837abea2d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:50.280522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a3bfe640-4cb7-41b1-8d63-b6b837abea2d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:50.288559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3bfe640-4cb7-41b1-8d63-b6b837abea2d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:50.289071 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3bfe640-4cb7-41b1-8d63-b6b837abea2d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:50.289557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3bfe640-4cb7-41b1-8d63-b6b837abea2d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:50.290303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3bfe640-4cb7-41b1-8d63-b6b837abea2d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:50.290774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3bfe640-4cb7-41b1-8d63-b6b837abea2d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:50.291211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a3bfe640-4cb7-41b1-8d63-b6b837abea2d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:50.474025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a3bfe640-4cb7-41b1-8d63-b6b837abea2d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:50.482908 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a3bfe640-4cb7-41b1-8d63-b6b837abea2d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 200 len: 1277 microversion: 2.1 time: 0.207793 Sep 07 13:26:50.483525 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3216/6464] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:50 2022] GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 1277 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:51.507019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ffa1bae3-b0e3-4bc3-a9af-c127a8f8a31d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:51.508667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ffa1bae3-b0e3-4bc3-a9af-c127a8f8a31d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:51.517824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffa1bae3-b0e3-4bc3-a9af-c127a8f8a31d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:51.518610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffa1bae3-b0e3-4bc3-a9af-c127a8f8a31d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:51.519164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffa1bae3-b0e3-4bc3-a9af-c127a8f8a31d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:51.519992 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffa1bae3-b0e3-4bc3-a9af-c127a8f8a31d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:51.520562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffa1bae3-b0e3-4bc3-a9af-c127a8f8a31d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:51.521097 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ffa1bae3-b0e3-4bc3-a9af-c127a8f8a31d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:51.727987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ffa1bae3-b0e3-4bc3-a9af-c127a8f8a31d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:51.743919 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ffa1bae3-b0e3-4bc3-a9af-c127a8f8a31d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 200 len: 1277 microversion: 2.1 time: 0.241068 Sep 07 13:26:51.745061 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3249/6465] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:51 2022] GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 1277 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:52.049716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6af0f37b-cab8-4767-96c2-8112a662351e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:26:52.052399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6af0f37b-cab8-4767-96c2-8112a662351e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:52.061207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6af0f37b-cab8-4767-96c2-8112a662351e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:52.061755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6af0f37b-cab8-4767-96c2-8112a662351e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:52.062210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6af0f37b-cab8-4767-96c2-8112a662351e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:52.062969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6af0f37b-cab8-4767-96c2-8112a662351e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:52.065791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6af0f37b-cab8-4767-96c2-8112a662351e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:52.065791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6af0f37b-cab8-4767-96c2-8112a662351e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:52.138931 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6af0f37b-cab8-4767-96c2-8112a662351e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "POST /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e/action" status: 200 len: 24567 microversion: 2.1 time: 0.094818 Sep 07 13:26:52.139634 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3217/6466] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:26:52 2022] POST /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e/action => generated 24567 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:26:52.782488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8286f4ea-3bda-40a0-9931-3959d1186edd tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:52.783080 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8286f4ea-3bda-40a0-9931-3959d1186edd tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:52.791187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8286f4ea-3bda-40a0-9931-3959d1186edd tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:52.791873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8286f4ea-3bda-40a0-9931-3959d1186edd tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:52.792383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8286f4ea-3bda-40a0-9931-3959d1186edd tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:52.793245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8286f4ea-3bda-40a0-9931-3959d1186edd tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:52.793815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8286f4ea-3bda-40a0-9931-3959d1186edd tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:52.794398 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8286f4ea-3bda-40a0-9931-3959d1186edd tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:52.945406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8286f4ea-3bda-40a0-9931-3959d1186edd tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:52.954664 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8286f4ea-3bda-40a0-9931-3959d1186edd tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 200 len: 1265 microversion: 2.1 time: 0.176486 Sep 07 13:26:52.955289 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3250/6467] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:52 2022] GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:53.982873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-331cca2f-43ff-4fe6-acfa-737750ba4943 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:53.983838 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-331cca2f-43ff-4fe6-acfa-737750ba4943 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:53.996972 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-331cca2f-43ff-4fe6-acfa-737750ba4943 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:53.999588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-331cca2f-43ff-4fe6-acfa-737750ba4943 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:54.000385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-331cca2f-43ff-4fe6-acfa-737750ba4943 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:54.001186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-331cca2f-43ff-4fe6-acfa-737750ba4943 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:54.001703 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-331cca2f-43ff-4fe6-acfa-737750ba4943 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:54.002137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-331cca2f-43ff-4fe6-acfa-737750ba4943 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:54.163350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-331cca2f-43ff-4fe6-acfa-737750ba4943 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:54.172146 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-331cca2f-43ff-4fe6-acfa-737750ba4943 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 200 len: 1265 microversion: 2.1 time: 0.195668 Sep 07 13:26:54.172804 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3218/6468] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:53 2022] GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:55.196214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-399a0629-f1e7-471c-9449-ae72e2af063b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:55.196797 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-399a0629-f1e7-471c-9449-ae72e2af063b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:55.205176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-399a0629-f1e7-471c-9449-ae72e2af063b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:55.205744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-399a0629-f1e7-471c-9449-ae72e2af063b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:55.206239 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-399a0629-f1e7-471c-9449-ae72e2af063b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:55.206985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-399a0629-f1e7-471c-9449-ae72e2af063b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:55.207473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-399a0629-f1e7-471c-9449-ae72e2af063b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:55.207930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-399a0629-f1e7-471c-9449-ae72e2af063b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:55.374727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-399a0629-f1e7-471c-9449-ae72e2af063b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:55.377620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:55.387366 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-399a0629-f1e7-471c-9449-ae72e2af063b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 200 len: 1265 microversion: 2.1 time: 0.195618 Sep 07 13:26:55.387985 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3251/6469] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:55 2022] GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:56.417990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1e7d8916-6534-4cc6-bb4f-9476078d6dde tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:56.418606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1e7d8916-6534-4cc6-bb4f-9476078d6dde tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:56.421682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:56.422413 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:56.431201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e7d8916-6534-4cc6-bb4f-9476078d6dde tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:56.431701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e7d8916-6534-4cc6-bb4f-9476078d6dde tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:56.432141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e7d8916-6534-4cc6-bb4f-9476078d6dde tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:56.432903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e7d8916-6534-4cc6-bb4f-9476078d6dde tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:56.433370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e7d8916-6534-4cc6-bb4f-9476078d6dde tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:56.433826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1e7d8916-6534-4cc6-bb4f-9476078d6dde tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:56.574927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1e7d8916-6534-4cc6-bb4f-9476078d6dde tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:56.583256 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1e7d8916-6534-4cc6-bb4f-9476078d6dde tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 200 len: 1265 microversion: 2.1 time: 0.169239 Sep 07 13:26:56.583840 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3219/6470] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:56 2022] GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:57.608932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d8d108ef-b31b-4f9c-9e16-d59115944752 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:57.609800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d8d108ef-b31b-4f9c-9e16-d59115944752 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:57.617393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8d108ef-b31b-4f9c-9e16-d59115944752 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:57.618041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8d108ef-b31b-4f9c-9e16-d59115944752 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:57.618635 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8d108ef-b31b-4f9c-9e16-d59115944752 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:57.619469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8d108ef-b31b-4f9c-9e16-d59115944752 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:57.620061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8d108ef-b31b-4f9c-9e16-d59115944752 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:57.620551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8d108ef-b31b-4f9c-9e16-d59115944752 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:57.768391 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d8d108ef-b31b-4f9c-9e16-d59115944752 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:57.777029 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d8d108ef-b31b-4f9c-9e16-d59115944752 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 200 len: 1265 microversion: 2.1 time: 0.172261 Sep 07 13:26:57.777664 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3252/6471] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:57 2022] GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:58.800764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fd3d0f44-540d-47a9-81f7-45b628144746 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:58.801305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fd3d0f44-540d-47a9-81f7-45b628144746 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:26:58.809078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd3d0f44-540d-47a9-81f7-45b628144746 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:58.809629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd3d0f44-540d-47a9-81f7-45b628144746 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:58.810076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd3d0f44-540d-47a9-81f7-45b628144746 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:58.810796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd3d0f44-540d-47a9-81f7-45b628144746 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:26:58.811283 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd3d0f44-540d-47a9-81f7-45b628144746 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:26:58.811718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd3d0f44-540d-47a9-81f7-45b628144746 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:26:58.961651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fd3d0f44-540d-47a9-81f7-45b628144746 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:26:58.970036 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fd3d0f44-540d-47a9-81f7-45b628144746 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 200 len: 1265 microversion: 2.1 time: 0.173242 Sep 07 13:26:58.970602 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3220/6472] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:58 2022] GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:26:59.993574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b6b7f3db-1ebb-4b86-a3ba-c1afd257dfe1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:26:59.994394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b6b7f3db-1ebb-4b86-a3ba-c1afd257dfe1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:00.002538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6b7f3db-1ebb-4b86-a3ba-c1afd257dfe1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:00.002972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6b7f3db-1ebb-4b86-a3ba-c1afd257dfe1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:00.003441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6b7f3db-1ebb-4b86-a3ba-c1afd257dfe1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:00.004183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6b7f3db-1ebb-4b86-a3ba-c1afd257dfe1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:00.004662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6b7f3db-1ebb-4b86-a3ba-c1afd257dfe1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:00.005100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6b7f3db-1ebb-4b86-a3ba-c1afd257dfe1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:00.152558 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b6b7f3db-1ebb-4b86-a3ba-c1afd257dfe1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:00.161282 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b6b7f3db-1ebb-4b86-a3ba-c1afd257dfe1 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 200 len: 1265 microversion: 2.1 time: 0.172023 Sep 07 13:27:00.161966 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3253/6473] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:26:59 2022] GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:01.185669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-316b9ce6-52d6-4c2d-8972-0407dc114e51 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:01.186281 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-316b9ce6-52d6-4c2d-8972-0407dc114e51 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:01.194421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-316b9ce6-52d6-4c2d-8972-0407dc114e51 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:01.194930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-316b9ce6-52d6-4c2d-8972-0407dc114e51 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:01.195382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-316b9ce6-52d6-4c2d-8972-0407dc114e51 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:01.196126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-316b9ce6-52d6-4c2d-8972-0407dc114e51 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:01.196597 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-316b9ce6-52d6-4c2d-8972-0407dc114e51 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:01.197038 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-316b9ce6-52d6-4c2d-8972-0407dc114e51 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:01.368186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-316b9ce6-52d6-4c2d-8972-0407dc114e51 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:01.377468 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-316b9ce6-52d6-4c2d-8972-0407dc114e51 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 200 len: 1265 microversion: 2.1 time: 0.195916 Sep 07 13:27:01.378207 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3221/6474] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:01 2022] GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:01.769408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-86c85ac8-715c-4d6a-bff7-5b45be195d7b req-f944dda4-949c-4c65-b343-651733a8ad2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9124e17-08d2-4641-b390-b43169aa6ca7", "name": "network-vif-plugged", "status": "completed", "tag": "56438486-fc55-406d-b77c-4295da73e413"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:01.779875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-86c85ac8-715c-4d6a-bff7-5b45be195d7b req-f944dda4-949c-4c65-b343-651733a8ad2f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:01.780385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-86c85ac8-715c-4d6a-bff7-5b45be195d7b req-f944dda4-949c-4c65-b343-651733a8ad2f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:01.780872 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-86c85ac8-715c-4d6a-bff7-5b45be195d7b req-f944dda4-949c-4c65-b343-651733a8ad2f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:01.794226 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-86c85ac8-715c-4d6a-bff7-5b45be195d7b req-f944dda4-949c-4c65-b343-651733a8ad2f service nova] Creating event network-vif-plugged:56438486-fc55-406d-b77c-4295da73e413 for instance b9124e17-08d2-4641-b390-b43169aa6ca7 on n-h2-852087-9 Sep 07 13:27:01.799750 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-86c85ac8-715c-4d6a-bff7-5b45be195d7b req-f944dda4-949c-4c65-b343-651733a8ad2f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088555 Sep 07 13:27:01.800362 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3254/6475] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:27:02.403787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cea6faf6-f37e-4f92-9dfd-81b614c623d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:02.404897 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cea6faf6-f37e-4f92-9dfd-81b614c623d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:02.413386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cea6faf6-f37e-4f92-9dfd-81b614c623d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:02.413980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cea6faf6-f37e-4f92-9dfd-81b614c623d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:02.414459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cea6faf6-f37e-4f92-9dfd-81b614c623d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:02.415309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cea6faf6-f37e-4f92-9dfd-81b614c623d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:02.415813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cea6faf6-f37e-4f92-9dfd-81b614c623d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:02.416341 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cea6faf6-f37e-4f92-9dfd-81b614c623d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:02.566181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cea6faf6-f37e-4f92-9dfd-81b614c623d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:02.575476 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cea6faf6-f37e-4f92-9dfd-81b614c623d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 200 len: 1265 microversion: 2.1 time: 0.177486 Sep 07 13:27:02.576108 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3222/6476] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:02 2022] GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:03.613727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-09cc453f-6af7-46d5-8c16-ad4c3f8fb48e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:03.614577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-09cc453f-6af7-46d5-8c16-ad4c3f8fb48e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:03.624369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09cc453f-6af7-46d5-8c16-ad4c3f8fb48e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:03.624885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09cc453f-6af7-46d5-8c16-ad4c3f8fb48e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:03.625346 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09cc453f-6af7-46d5-8c16-ad4c3f8fb48e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:03.626223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09cc453f-6af7-46d5-8c16-ad4c3f8fb48e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:03.626704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09cc453f-6af7-46d5-8c16-ad4c3f8fb48e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:03.627152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09cc453f-6af7-46d5-8c16-ad4c3f8fb48e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:03.791792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-09cc453f-6af7-46d5-8c16-ad4c3f8fb48e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:03.801895 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-09cc453f-6af7-46d5-8c16-ad4c3f8fb48e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 200 len: 1452 microversion: 2.1 time: 0.192627 Sep 07 13:27:03.802544 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3255/6477] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:03 2022] GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 1452 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:03.825275 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-69233423-1bbf-49a5-bb90-a9710e4babfb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:03.825981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-69233423-1bbf-49a5-bb90-a9710e4babfb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:03.834029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69233423-1bbf-49a5-bb90-a9710e4babfb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:03.834501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69233423-1bbf-49a5-bb90-a9710e4babfb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:03.834940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69233423-1bbf-49a5-bb90-a9710e4babfb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:03.835683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69233423-1bbf-49a5-bb90-a9710e4babfb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:03.836139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69233423-1bbf-49a5-bb90-a9710e4babfb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:03.836567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69233423-1bbf-49a5-bb90-a9710e4babfb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:03.985224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-69233423-1bbf-49a5-bb90-a9710e4babfb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:03.993590 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-69233423-1bbf-49a5-bb90-a9710e4babfb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 200 len: 1452 microversion: 2.1 time: 0.172504 Sep 07 13:27:03.994214 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3223/6478] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:03 2022] GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:27:06.394006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-43944ac6-a521-40f2-afbe-dac533644e76 req-5c228435-5cef-41bd-beba-6d6f31beb883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9124e17-08d2-4641-b390-b43169aa6ca7", "tag": "56438486-fc55-406d-b77c-4295da73e413"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:06.412003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-43944ac6-a521-40f2-afbe-dac533644e76 req-5c228435-5cef-41bd-beba-6d6f31beb883 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:06.413039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-43944ac6-a521-40f2-afbe-dac533644e76 req-5c228435-5cef-41bd-beba-6d6f31beb883 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:06.413991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-43944ac6-a521-40f2-afbe-dac533644e76 req-5c228435-5cef-41bd-beba-6d6f31beb883 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:06.430263 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-43944ac6-a521-40f2-afbe-dac533644e76 req-5c228435-5cef-41bd-beba-6d6f31beb883 service nova] Creating event network-changed:56438486-fc55-406d-b77c-4295da73e413 for instance b9124e17-08d2-4641-b390-b43169aa6ca7 on n-h2-852087-9 Sep 07 13:27:06.435805 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-43944ac6-a521-40f2-afbe-dac533644e76 req-5c228435-5cef-41bd-beba-6d6f31beb883 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111303 Sep 07 13:27:06.436452 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3256/6479] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:27:14.804869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4e4ec9a4-8bb7-4c2c-8b73-5351639539bb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Action: 'create', calling method: .version_select at 0x7fc413b25670>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1656350984", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5/nyX2G7G8AKNw6VgqlaSCrAqXZlz8euTjPCQNVpE5jWQLOv07UhXQ2zYMHK/OJ0sZMqSCx2zIHnaEDQUpg4gMDztEpNTwzPk0ZXX9lha9pP7D2ZKfpNqC9c2rvJ/LLg=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:14.811426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:14.812206 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=56 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:14.830017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-4e4ec9a4-8bb7-4c2c-8b73-5351639539bb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Getting quotas for project 2bbb0cc60bcc4538a2a7ba695efcf613. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:27:14.836216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-4e4ec9a4-8bb7-4c2c-8b73-5351639539bb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Getting quotas for user 3fc5e615495243fd8fe6541e6c828a45 and project 2bbb0cc60bcc4538a2a7ba695efcf613. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:27:14.870021 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4e4ec9a4-8bb7-4c2c-8b73-5351639539bb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.069169 Sep 07 13:27:14.877096 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3224/6480] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 13:27:14 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:27:16.162090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b0386f4a-0e58-43fe-9783-95f456e6ac6f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2017365620", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "0ff1dd60-deba-4f26-a52f-562f2c329a7c"}], "key_name": "tempest-TestNetworkBasicOps-1656350984", "security_groups": [{"name": "tempest-secgroup-smoke-1967047066"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:16.172114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=25 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:16.290187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-b0386f4a-0e58-43fe-9783-95f456e6ac6f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] validate_networks() for [('0ff1dd60-deba-4f26-a52f-562f2c329a7c', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:27:16.423074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=52 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:17.161238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b0386f4a-0e58-43fe-9783-95f456e6ac6f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:27:17.161835 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b0386f4a-0e58-43fe-9783-95f456e6ac6f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:27:17.162564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b0386f4a-0e58-43fe-9783-95f456e6ac6f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:27:17.163525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b0386f4a-0e58-43fe-9783-95f456e6ac6f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:27:17.163929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-b0386f4a-0e58-43fe-9783-95f456e6ac6f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:27:17.175533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0386f4a-0e58-43fe-9783-95f456e6ac6f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:17.176048 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0386f4a-0e58-43fe-9783-95f456e6ac6f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:17.176499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0386f4a-0e58-43fe-9783-95f456e6ac6f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:17.177258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0386f4a-0e58-43fe-9783-95f456e6ac6f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:17.177763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0386f4a-0e58-43fe-9783-95f456e6ac6f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:17.178217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0386f4a-0e58-43fe-9783-95f456e6ac6f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:17.197741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b0386f4a-0e58-43fe-9783-95f456e6ac6f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Getting quotas for project 2bbb0cc60bcc4538a2a7ba695efcf613. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:27:17.204306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b0386f4a-0e58-43fe-9783-95f456e6ac6f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Getting quotas for user 3fc5e615495243fd8fe6541e6c828a45 and project 2bbb0cc60bcc4538a2a7ba695efcf613. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:27:17.220177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b0386f4a-0e58-43fe-9783-95f456e6ac6f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:27:17.222775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b0386f4a-0e58-43fe-9783-95f456e6ac6f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 838a6598-c72a-4ffc-bce6-3340d8b95887] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:27:17.280154 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b0386f4a-0e58-43fe-9783-95f456e6ac6f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.123716 Sep 07 13:27:17.287383 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3257/6481] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:27:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:27:17.293956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bbbaae17-d14b-4470-b697-c34f3b073c10 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:17.294714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bbbaae17-d14b-4470-b697-c34f3b073c10 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 838a6598-c72a-4ffc-bce6-3340d8b95887] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:17.360934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bbbaae17-d14b-4470-b697-c34f3b073c10 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:17.368939 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bbbaae17-d14b-4470-b697-c34f3b073c10 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887" status: 200 len: 1249 microversion: 2.1 time: 0.079887 Sep 07 13:27:17.374084 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3225/6482] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:17 2022] GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887 => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:18.394199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-062a8b28-4f40-4b0c-9696-038781cac18f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:18.394830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-062a8b28-4f40-4b0c-9696-038781cac18f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 838a6598-c72a-4ffc-bce6-3340d8b95887] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:18.403410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062a8b28-4f40-4b0c-9696-038781cac18f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:18.403840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062a8b28-4f40-4b0c-9696-038781cac18f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:18.404297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062a8b28-4f40-4b0c-9696-038781cac18f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:18.405010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062a8b28-4f40-4b0c-9696-038781cac18f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:18.405467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062a8b28-4f40-4b0c-9696-038781cac18f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:18.405950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062a8b28-4f40-4b0c-9696-038781cac18f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:18.471920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-062a8b28-4f40-4b0c-9696-038781cac18f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:18.482903 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-062a8b28-4f40-4b0c-9696-038781cac18f tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887" status: 200 len: 1301 microversion: 2.1 time: 0.092850 Sep 07 13:27:18.483516 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3258/6483] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:18 2022] GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887 => generated 1301 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:19.509109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fbd09a0c-3632-4050-9b41-68aedb4245dc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:19.509881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fbd09a0c-3632-4050-9b41-68aedb4245dc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 838a6598-c72a-4ffc-bce6-3340d8b95887] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:19.517862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbd09a0c-3632-4050-9b41-68aedb4245dc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:19.518369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbd09a0c-3632-4050-9b41-68aedb4245dc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:19.518805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbd09a0c-3632-4050-9b41-68aedb4245dc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:19.519504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbd09a0c-3632-4050-9b41-68aedb4245dc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:19.519975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbd09a0c-3632-4050-9b41-68aedb4245dc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:19.520423 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbd09a0c-3632-4050-9b41-68aedb4245dc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:19.750996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fbd09a0c-3632-4050-9b41-68aedb4245dc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:19.759985 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fbd09a0c-3632-4050-9b41-68aedb4245dc tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887" status: 200 len: 1375 microversion: 2.1 time: 0.256047 Sep 07 13:27:19.760656 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3226/6484] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:19 2022] GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887 => generated 1375 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:20.518668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-61a77226-23ad-4e85-becb-8d57d9d793df req-38150314-f4a5-4232-bd52-1feb120a2547 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "838a6598-c72a-4ffc-bce6-3340d8b95887", "tag": "4b12bd4d-dfe3-427c-a382-80908746abe1"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:20.528628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-61a77226-23ad-4e85-becb-8d57d9d793df req-38150314-f4a5-4232-bd52-1feb120a2547 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:20.529135 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-61a77226-23ad-4e85-becb-8d57d9d793df req-38150314-f4a5-4232-bd52-1feb120a2547 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:20.529625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-61a77226-23ad-4e85-becb-8d57d9d793df req-38150314-f4a5-4232-bd52-1feb120a2547 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:20.542803 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-61a77226-23ad-4e85-becb-8d57d9d793df req-38150314-f4a5-4232-bd52-1feb120a2547 service nova] Creating event network-changed:4b12bd4d-dfe3-427c-a382-80908746abe1 for instance 838a6598-c72a-4ffc-bce6-3340d8b95887 on n-h1-852087-9 Sep 07 13:27:20.549933 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-61a77226-23ad-4e85-becb-8d57d9d793df req-38150314-f4a5-4232-bd52-1feb120a2547 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090949 Sep 07 13:27:20.551282 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3259/6485] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:27:20.792102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1ffb0026-c08e-420f-b1b7-ad9c4adcf7f8 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:20.792751 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1ffb0026-c08e-420f-b1b7-ad9c4adcf7f8 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 838a6598-c72a-4ffc-bce6-3340d8b95887] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:20.800323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ffb0026-c08e-420f-b1b7-ad9c4adcf7f8 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:20.802179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ffb0026-c08e-420f-b1b7-ad9c4adcf7f8 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:20.802179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ffb0026-c08e-420f-b1b7-ad9c4adcf7f8 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:20.802476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ffb0026-c08e-420f-b1b7-ad9c4adcf7f8 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:20.803420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ffb0026-c08e-420f-b1b7-ad9c4adcf7f8 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:20.803592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1ffb0026-c08e-420f-b1b7-ad9c4adcf7f8 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:21.020225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1ffb0026-c08e-420f-b1b7-ad9c4adcf7f8 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:21.029548 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1ffb0026-c08e-420f-b1b7-ad9c4adcf7f8 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887" status: 200 len: 1375 microversion: 2.1 time: 0.241869 Sep 07 13:27:21.030169 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3227/6486] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:20 2022] GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887 => generated 1375 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:22.060884 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f4b7198e-19dc-4e97-a292-49d4ea55c003 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:22.061583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f4b7198e-19dc-4e97-a292-49d4ea55c003 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 838a6598-c72a-4ffc-bce6-3340d8b95887] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:22.068700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4b7198e-19dc-4e97-a292-49d4ea55c003 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:22.069215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4b7198e-19dc-4e97-a292-49d4ea55c003 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:22.069736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4b7198e-19dc-4e97-a292-49d4ea55c003 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:22.070466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4b7198e-19dc-4e97-a292-49d4ea55c003 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:22.070950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4b7198e-19dc-4e97-a292-49d4ea55c003 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:22.071426 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4b7198e-19dc-4e97-a292-49d4ea55c003 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:22.211083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f4b7198e-19dc-4e97-a292-49d4ea55c003 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:22.219800 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f4b7198e-19dc-4e97-a292-49d4ea55c003 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887" status: 200 len: 1375 microversion: 2.1 time: 0.164265 Sep 07 13:27:22.220388 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3260/6487] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:22 2022] GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887 => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:23.243438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-74e2261a-8e73-4e46-a16d-266d7fe75900 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:23.243955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-74e2261a-8e73-4e46-a16d-266d7fe75900 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 838a6598-c72a-4ffc-bce6-3340d8b95887] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:23.250845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74e2261a-8e73-4e46-a16d-266d7fe75900 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:23.251394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74e2261a-8e73-4e46-a16d-266d7fe75900 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:23.251827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74e2261a-8e73-4e46-a16d-266d7fe75900 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:23.252521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74e2261a-8e73-4e46-a16d-266d7fe75900 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:23.252973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74e2261a-8e73-4e46-a16d-266d7fe75900 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:23.253391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74e2261a-8e73-4e46-a16d-266d7fe75900 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:23.414934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-74e2261a-8e73-4e46-a16d-266d7fe75900 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:23.426103 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-74e2261a-8e73-4e46-a16d-266d7fe75900 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887" status: 200 len: 1375 microversion: 2.1 time: 0.186517 Sep 07 13:27:23.426709 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3228/6488] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:23 2022] GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887 => generated 1375 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:24.462187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ab1c23a2-68eb-4e29-b10a-41cc078c62e0 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:24.462845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ab1c23a2-68eb-4e29-b10a-41cc078c62e0 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 838a6598-c72a-4ffc-bce6-3340d8b95887] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:24.474620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab1c23a2-68eb-4e29-b10a-41cc078c62e0 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:24.475193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab1c23a2-68eb-4e29-b10a-41cc078c62e0 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:24.476056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab1c23a2-68eb-4e29-b10a-41cc078c62e0 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:24.481912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab1c23a2-68eb-4e29-b10a-41cc078c62e0 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:24.481912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab1c23a2-68eb-4e29-b10a-41cc078c62e0 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:24.481912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab1c23a2-68eb-4e29-b10a-41cc078c62e0 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:24.628560 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ab1c23a2-68eb-4e29-b10a-41cc078c62e0 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:24.637963 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ab1c23a2-68eb-4e29-b10a-41cc078c62e0 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887" status: 200 len: 1375 microversion: 2.1 time: 0.182301 Sep 07 13:27:24.638560 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3261/6489] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:24 2022] GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887 => generated 1375 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:25.662181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ba66e360-af76-4a24-8042-9d84c7722046 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:25.662802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ba66e360-af76-4a24-8042-9d84c7722046 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 838a6598-c72a-4ffc-bce6-3340d8b95887] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:25.675429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba66e360-af76-4a24-8042-9d84c7722046 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:25.675924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba66e360-af76-4a24-8042-9d84c7722046 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:25.676365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba66e360-af76-4a24-8042-9d84c7722046 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:25.677073 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba66e360-af76-4a24-8042-9d84c7722046 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:25.677559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba66e360-af76-4a24-8042-9d84c7722046 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:25.678021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba66e360-af76-4a24-8042-9d84c7722046 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:25.836042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ba66e360-af76-4a24-8042-9d84c7722046 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:25.847759 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ba66e360-af76-4a24-8042-9d84c7722046 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887" status: 200 len: 1375 microversion: 2.1 time: 0.189886 Sep 07 13:27:25.848347 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3229/6490] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:25 2022] GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887 => generated 1375 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:26.873032 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bf437acd-a7f3-4fbe-85bc-6f09c2491934 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:26.873925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bf437acd-a7f3-4fbe-85bc-6f09c2491934 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 838a6598-c72a-4ffc-bce6-3340d8b95887] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:26.881465 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf437acd-a7f3-4fbe-85bc-6f09c2491934 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:26.881998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf437acd-a7f3-4fbe-85bc-6f09c2491934 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:26.882597 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf437acd-a7f3-4fbe-85bc-6f09c2491934 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:26.883384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf437acd-a7f3-4fbe-85bc-6f09c2491934 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:26.883868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf437acd-a7f3-4fbe-85bc-6f09c2491934 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:26.884318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf437acd-a7f3-4fbe-85bc-6f09c2491934 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:27.044387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bf437acd-a7f3-4fbe-85bc-6f09c2491934 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:27.053474 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bf437acd-a7f3-4fbe-85bc-6f09c2491934 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887" status: 200 len: 1375 microversion: 2.1 time: 0.184709 Sep 07 13:27:27.054169 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3262/6491] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:26 2022] GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887 => generated 1375 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:27.524529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c2194c02-bb30-4da0-a76a-10250ee0f9e5 req-03ea008c-d417-4574-bdef-5c43182e8ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "838a6598-c72a-4ffc-bce6-3340d8b95887", "name": "network-vif-plugged", "status": "completed", "tag": "4b12bd4d-dfe3-427c-a382-80908746abe1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:27.532849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:27.542493 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c2194c02-bb30-4da0-a76a-10250ee0f9e5 req-03ea008c-d417-4574-bdef-5c43182e8ebe service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:27.543145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c2194c02-bb30-4da0-a76a-10250ee0f9e5 req-03ea008c-d417-4574-bdef-5c43182e8ebe service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:27.543782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c2194c02-bb30-4da0-a76a-10250ee0f9e5 req-03ea008c-d417-4574-bdef-5c43182e8ebe service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:27.558750 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c2194c02-bb30-4da0-a76a-10250ee0f9e5 req-03ea008c-d417-4574-bdef-5c43182e8ebe service nova] Creating event network-vif-plugged:4b12bd4d-dfe3-427c-a382-80908746abe1 for instance 838a6598-c72a-4ffc-bce6-3340d8b95887 on n-h1-852087-9 Sep 07 13:27:27.565573 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c2194c02-bb30-4da0-a76a-10250ee0f9e5 req-03ea008c-d417-4574-bdef-5c43182e8ebe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046026 Sep 07 13:27:27.566662 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3230/6492] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:27:28.077717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b41ce965-b2ea-4f90-bb94-35ce85377a2a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:28.078330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b41ce965-b2ea-4f90-bb94-35ce85377a2a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 838a6598-c72a-4ffc-bce6-3340d8b95887] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:28.080816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:28.081575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:28.090249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b41ce965-b2ea-4f90-bb94-35ce85377a2a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:28.090862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b41ce965-b2ea-4f90-bb94-35ce85377a2a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:28.091463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b41ce965-b2ea-4f90-bb94-35ce85377a2a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:28.092335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b41ce965-b2ea-4f90-bb94-35ce85377a2a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:28.092920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b41ce965-b2ea-4f90-bb94-35ce85377a2a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:28.093367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b41ce965-b2ea-4f90-bb94-35ce85377a2a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:28.257359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b41ce965-b2ea-4f90-bb94-35ce85377a2a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:28.266323 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b41ce965-b2ea-4f90-bb94-35ce85377a2a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887" status: 200 len: 1375 microversion: 2.1 time: 0.192131 Sep 07 13:27:28.266538 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3263/6493] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:28 2022] GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887 => generated 1375 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:29.292869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-46d587c0-c8cb-45f0-8c20-d4abdd3abd8a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:29.294111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-46d587c0-c8cb-45f0-8c20-d4abdd3abd8a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 838a6598-c72a-4ffc-bce6-3340d8b95887] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:29.307427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46d587c0-c8cb-45f0-8c20-d4abdd3abd8a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:29.308262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46d587c0-c8cb-45f0-8c20-d4abdd3abd8a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:29.309002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46d587c0-c8cb-45f0-8c20-d4abdd3abd8a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:29.310241 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46d587c0-c8cb-45f0-8c20-d4abdd3abd8a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:29.311051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46d587c0-c8cb-45f0-8c20-d4abdd3abd8a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:29.311840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-46d587c0-c8cb-45f0-8c20-d4abdd3abd8a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:29.460289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-46d587c0-c8cb-45f0-8c20-d4abdd3abd8a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:29.468876 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-46d587c0-c8cb-45f0-8c20-d4abdd3abd8a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887" status: 200 len: 1548 microversion: 2.1 time: 0.182251 Sep 07 13:27:29.469697 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3231/6494] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:29 2022] GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887 => generated 1548 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:29.492745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b8681b47-0fe2-43a3-8903-e0d865fff229 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:29.493382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b8681b47-0fe2-43a3-8903-e0d865fff229 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 838a6598-c72a-4ffc-bce6-3340d8b95887] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:29.503141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8681b47-0fe2-43a3-8903-e0d865fff229 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:29.504092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8681b47-0fe2-43a3-8903-e0d865fff229 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:29.504704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8681b47-0fe2-43a3-8903-e0d865fff229 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:29.506453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8681b47-0fe2-43a3-8903-e0d865fff229 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:29.506949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8681b47-0fe2-43a3-8903-e0d865fff229 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:29.507410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8681b47-0fe2-43a3-8903-e0d865fff229 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:29.666147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b8681b47-0fe2-43a3-8903-e0d865fff229 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:29.674470 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b8681b47-0fe2-43a3-8903-e0d865fff229 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887" status: 200 len: 1548 microversion: 2.1 time: 0.185883 Sep 07 13:27:29.675041 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3264/6495] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:29 2022] GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887 => generated 1548 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:30.902135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e2a7879f-342c-4c7d-bdc5-d9bea75a0b01 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:30.902974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e2a7879f-342c-4c7d-bdc5-d9bea75a0b01 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:30.910919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2a7879f-342c-4c7d-bdc5-d9bea75a0b01 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:30.911362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2a7879f-342c-4c7d-bdc5-d9bea75a0b01 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:30.911831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2a7879f-342c-4c7d-bdc5-d9bea75a0b01 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:30.912592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2a7879f-342c-4c7d-bdc5-d9bea75a0b01 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:30.913051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2a7879f-342c-4c7d-bdc5-d9bea75a0b01 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:30.913706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e2a7879f-342c-4c7d-bdc5-d9bea75a0b01 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:31.070648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e2a7879f-342c-4c7d-bdc5-d9bea75a0b01 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:31.084168 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e2a7879f-342c-4c7d-bdc5-d9bea75a0b01 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1681 microversion: 2.1 time: 0.187613 Sep 07 13:27:31.090026 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3232/6496] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:30 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1681 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:31.209186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e297e999-fdce-463e-814f-d795b2e20b5e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:31.212397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e297e999-fdce-463e-814f-d795b2e20b5e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:31.223721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e297e999-fdce-463e-814f-d795b2e20b5e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:31.224237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e297e999-fdce-463e-814f-d795b2e20b5e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:31.224811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e297e999-fdce-463e-814f-d795b2e20b5e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:31.225672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e297e999-fdce-463e-814f-d795b2e20b5e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:31.226304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e297e999-fdce-463e-814f-d795b2e20b5e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:31.226824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e297e999-fdce-463e-814f-d795b2e20b5e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:31.309237 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e297e999-fdce-463e-814f-d795b2e20b5e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "POST /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e/action" status: 200 len: 32632 microversion: 2.1 time: 0.112785 Sep 07 13:27:31.310302 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3265/6497] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:27:31 2022] POST /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e/action => generated 32632 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:27:31.470465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-011d757d-7dad-42b7-9d09-52468dbf9422 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:31.470998 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-011d757d-7dad-42b7-9d09-52468dbf9422 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:31.479354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-011d757d-7dad-42b7-9d09-52468dbf9422 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:31.483510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-011d757d-7dad-42b7-9d09-52468dbf9422 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:31.483510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-011d757d-7dad-42b7-9d09-52468dbf9422 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:31.483510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-011d757d-7dad-42b7-9d09-52468dbf9422 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:31.484244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-011d757d-7dad-42b7-9d09-52468dbf9422 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:31.484467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-011d757d-7dad-42b7-9d09-52468dbf9422 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:31.654295 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-011d757d-7dad-42b7-9d09-52468dbf9422 tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1832 microversion: 2.1 time: 0.187719 Sep 07 13:27:31.654913 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3233/6498] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:31 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1832 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:31.689943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5a7d0c84-0ae8-4ad9-a9b3-f9d7594bee5d tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:31.692637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5a7d0c84-0ae8-4ad9-a9b3-f9d7594bee5d tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:31.700846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a7d0c84-0ae8-4ad9-a9b3-f9d7594bee5d tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:31.701370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a7d0c84-0ae8-4ad9-a9b3-f9d7594bee5d tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:31.701863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a7d0c84-0ae8-4ad9-a9b3-f9d7594bee5d tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:31.702597 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a7d0c84-0ae8-4ad9-a9b3-f9d7594bee5d tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:31.703077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a7d0c84-0ae8-4ad9-a9b3-f9d7594bee5d tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:31.703594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a7d0c84-0ae8-4ad9-a9b3-f9d7594bee5d tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:31.756981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-5a7d0c84-0ae8-4ad9-a9b3-f9d7594bee5d tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lazy-loading 'flavor' on Instance uuid 87ce5a84-9ebd-4540-b82f-2fc21fb9518e {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:27:31.775186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5a7d0c84-0ae8-4ad9-a9b3-f9d7594bee5d tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Going to try to live migrate instance to another host {{(pid=122433) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 07 13:27:34.121130 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5a7d0c84-0ae8-4ad9-a9b3-f9d7594bee5d tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e/action" status: 202 len: 0 microversion: 2.1 time: 2.435851 Sep 07 13:27:34.122759 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3266/6499] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:27:31 2022] POST /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e/action => generated 0 bytes in 2439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:27:34.132502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d78773e6-3ae6-42de-8907-a9edddb92d6c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:34.133268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d78773e6-3ae6-42de-8907-a9edddb92d6c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:34.143983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d78773e6-3ae6-42de-8907-a9edddb92d6c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:34.144853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d78773e6-3ae6-42de-8907-a9edddb92d6c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:34.145679 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d78773e6-3ae6-42de-8907-a9edddb92d6c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:34.146509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d78773e6-3ae6-42de-8907-a9edddb92d6c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:34.147131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d78773e6-3ae6-42de-8907-a9edddb92d6c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:34.147778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d78773e6-3ae6-42de-8907-a9edddb92d6c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:34.316069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d78773e6-3ae6-42de-8907-a9edddb92d6c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:34.325023 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d78773e6-3ae6-42de-8907-a9edddb92d6c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1691 microversion: 2.1 time: 0.197158 Sep 07 13:27:34.326215 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3234/6500] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:34 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1691 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:35.350971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-38ac1ff0-5482-4da4-88e5-65042089e355 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:35.352191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-38ac1ff0-5482-4da4-88e5-65042089e355 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:35.359922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38ac1ff0-5482-4da4-88e5-65042089e355 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:35.360444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38ac1ff0-5482-4da4-88e5-65042089e355 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:35.360917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38ac1ff0-5482-4da4-88e5-65042089e355 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:35.361677 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38ac1ff0-5482-4da4-88e5-65042089e355 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:35.362153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38ac1ff0-5482-4da4-88e5-65042089e355 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:35.362617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38ac1ff0-5482-4da4-88e5-65042089e355 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:35.582887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-38ac1ff0-5482-4da4-88e5-65042089e355 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:35.591706 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-38ac1ff0-5482-4da4-88e5-65042089e355 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1691 microversion: 2.1 time: 0.244688 Sep 07 13:27:35.592332 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3267/6501] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:35 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1691 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:35.789841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e81fb6a6-d6ca-477a-b5e4-68b4ff94ffb5 req-f0f2f37a-4d07-4335-b32c-2f2e25298358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87ce5a84-9ebd-4540-b82f-2fc21fb9518e", "name": "network-vif-unplugged", "status": "completed", "tag": "2146a517-5fea-4a11-a2e2-5cba05352f1a"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:35.810033 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e81fb6a6-d6ca-477a-b5e4-68b4ff94ffb5 req-f0f2f37a-4d07-4335-b32c-2f2e25298358 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:35.810784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e81fb6a6-d6ca-477a-b5e4-68b4ff94ffb5 req-f0f2f37a-4d07-4335-b32c-2f2e25298358 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:35.811366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e81fb6a6-d6ca-477a-b5e4-68b4ff94ffb5 req-f0f2f37a-4d07-4335-b32c-2f2e25298358 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:35.828186 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e81fb6a6-d6ca-477a-b5e4-68b4ff94ffb5 req-f0f2f37a-4d07-4335-b32c-2f2e25298358 service nova] Creating event network-vif-unplugged:2146a517-5fea-4a11-a2e2-5cba05352f1a for instance 87ce5a84-9ebd-4540-b82f-2fc21fb9518e on n-h1-852087-9 Sep 07 13:27:35.834950 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e81fb6a6-d6ca-477a-b5e4-68b4ff94ffb5 req-f0f2f37a-4d07-4335-b32c-2f2e25298358 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049100 Sep 07 13:27:35.836463 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3235/6502] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:27:36.623170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ab4e2ba9-a0c3-4ba6-993c-1ba78cdc2ef5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:36.623839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ab4e2ba9-a0c3-4ba6-993c-1ba78cdc2ef5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:36.631858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab4e2ba9-a0c3-4ba6-993c-1ba78cdc2ef5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:36.632468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab4e2ba9-a0c3-4ba6-993c-1ba78cdc2ef5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:36.632972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab4e2ba9-a0c3-4ba6-993c-1ba78cdc2ef5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:36.633890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab4e2ba9-a0c3-4ba6-993c-1ba78cdc2ef5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:36.634480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab4e2ba9-a0c3-4ba6-993c-1ba78cdc2ef5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:36.634939 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab4e2ba9-a0c3-4ba6-993c-1ba78cdc2ef5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:36.782118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ab4e2ba9-a0c3-4ba6-993c-1ba78cdc2ef5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:36.792641 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ab4e2ba9-a0c3-4ba6-993c-1ba78cdc2ef5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1691 microversion: 2.1 time: 0.174100 Sep 07 13:27:36.793532 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3268/6503] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:36 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:37.821719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-03fdf37f-c4cd-40b7-9a03-3fb512494d68 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:37.822630 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-03fdf37f-c4cd-40b7-9a03-3fb512494d68 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:37.831906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03fdf37f-c4cd-40b7-9a03-3fb512494d68 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:37.831906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03fdf37f-c4cd-40b7-9a03-3fb512494d68 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:37.831906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03fdf37f-c4cd-40b7-9a03-3fb512494d68 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:37.831906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03fdf37f-c4cd-40b7-9a03-3fb512494d68 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:37.831906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03fdf37f-c4cd-40b7-9a03-3fb512494d68 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:37.832222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03fdf37f-c4cd-40b7-9a03-3fb512494d68 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:37.872846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-e755daa2-f524-48c2-a583-5bfa03853e69 req-36db23fa-9c35-42e6-a0cd-6d2c14b9e8ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87ce5a84-9ebd-4540-b82f-2fc21fb9518e", "tag": "2146a517-5fea-4a11-a2e2-5cba05352f1a"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:37.884495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e755daa2-f524-48c2-a583-5bfa03853e69 req-36db23fa-9c35-42e6-a0cd-6d2c14b9e8ae service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:37.885136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e755daa2-f524-48c2-a583-5bfa03853e69 req-36db23fa-9c35-42e6-a0cd-6d2c14b9e8ae service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:37.885984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e755daa2-f524-48c2-a583-5bfa03853e69 req-36db23fa-9c35-42e6-a0cd-6d2c14b9e8ae service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:37.903972 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-e755daa2-f524-48c2-a583-5bfa03853e69 req-36db23fa-9c35-42e6-a0cd-6d2c14b9e8ae service nova] Creating event network-changed:2146a517-5fea-4a11-a2e2-5cba05352f1a for instance 87ce5a84-9ebd-4540-b82f-2fc21fb9518e on n-h1-852087-9 Sep 07 13:27:37.909677 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-e755daa2-f524-48c2-a583-5bfa03853e69 req-36db23fa-9c35-42e6-a0cd-6d2c14b9e8ae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041113 Sep 07 13:27:37.910297 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3269/6504] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:27:38.027271 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-03fdf37f-c4cd-40b7-9a03-3fb512494d68 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:38.041166 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-03fdf37f-c4cd-40b7-9a03-3fb512494d68 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1691 microversion: 2.1 time: 0.224957 Sep 07 13:27:38.048531 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3236/6505] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:37 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1691 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:39.076594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fc29988d-945f-443c-a7f9-22dd29888472 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:39.077271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fc29988d-945f-443c-a7f9-22dd29888472 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:39.085324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc29988d-945f-443c-a7f9-22dd29888472 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:39.085872 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc29988d-945f-443c-a7f9-22dd29888472 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:39.086303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc29988d-945f-443c-a7f9-22dd29888472 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:39.087060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc29988d-945f-443c-a7f9-22dd29888472 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:39.087537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc29988d-945f-443c-a7f9-22dd29888472 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:39.088663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc29988d-945f-443c-a7f9-22dd29888472 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:39.238807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fc29988d-945f-443c-a7f9-22dd29888472 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:39.247643 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fc29988d-945f-443c-a7f9-22dd29888472 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1691 microversion: 2.1 time: 0.177760 Sep 07 13:27:39.248233 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3270/6506] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:39 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1691 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:40.272021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6914d59b-d4ca-4825-96d0-e80ce87770f3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:40.272641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6914d59b-d4ca-4825-96d0-e80ce87770f3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:40.280572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6914d59b-d4ca-4825-96d0-e80ce87770f3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:40.281069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6914d59b-d4ca-4825-96d0-e80ce87770f3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:40.281661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6914d59b-d4ca-4825-96d0-e80ce87770f3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:40.282372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6914d59b-d4ca-4825-96d0-e80ce87770f3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:40.282827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6914d59b-d4ca-4825-96d0-e80ce87770f3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:40.283252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6914d59b-d4ca-4825-96d0-e80ce87770f3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:40.451202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6914d59b-d4ca-4825-96d0-e80ce87770f3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:40.460271 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6914d59b-d4ca-4825-96d0-e80ce87770f3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1691 microversion: 2.1 time: 0.192633 Sep 07 13:27:40.461214 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3237/6507] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:40 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1691 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:41.484971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-27ea973a-fe52-4f2a-b7d5-76897fc40ebf tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:41.485633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-27ea973a-fe52-4f2a-b7d5-76897fc40ebf tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:41.492950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27ea973a-fe52-4f2a-b7d5-76897fc40ebf tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:41.493463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27ea973a-fe52-4f2a-b7d5-76897fc40ebf tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:41.493950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27ea973a-fe52-4f2a-b7d5-76897fc40ebf tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:41.494675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27ea973a-fe52-4f2a-b7d5-76897fc40ebf tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:41.495144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27ea973a-fe52-4f2a-b7d5-76897fc40ebf tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:41.495591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-27ea973a-fe52-4f2a-b7d5-76897fc40ebf tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:41.639362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-27ea973a-fe52-4f2a-b7d5-76897fc40ebf tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:41.647561 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-27ea973a-fe52-4f2a-b7d5-76897fc40ebf tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1691 microversion: 2.1 time: 0.166956 Sep 07 13:27:41.648298 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3271/6508] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:41 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:42.672322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1fad1216-d3bb-4119-8c1e-d22f53a4f8f6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:42.672989 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1fad1216-d3bb-4119-8c1e-d22f53a4f8f6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:42.680539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fad1216-d3bb-4119-8c1e-d22f53a4f8f6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:42.681051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fad1216-d3bb-4119-8c1e-d22f53a4f8f6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:42.681545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fad1216-d3bb-4119-8c1e-d22f53a4f8f6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:42.682271 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fad1216-d3bb-4119-8c1e-d22f53a4f8f6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:42.682755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fad1216-d3bb-4119-8c1e-d22f53a4f8f6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:42.683209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fad1216-d3bb-4119-8c1e-d22f53a4f8f6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:42.865815 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1fad1216-d3bb-4119-8c1e-d22f53a4f8f6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:42.874358 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1fad1216-d3bb-4119-8c1e-d22f53a4f8f6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1691 microversion: 2.1 time: 0.206351 Sep 07 13:27:42.874977 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3238/6509] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:42 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1691 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:43.898262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-88c38162-b7a9-4380-9a56-841b45f0aca0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:43.899026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-88c38162-b7a9-4380-9a56-841b45f0aca0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:43.907248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88c38162-b7a9-4380-9a56-841b45f0aca0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:43.907852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88c38162-b7a9-4380-9a56-841b45f0aca0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:43.908378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88c38162-b7a9-4380-9a56-841b45f0aca0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:43.909194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88c38162-b7a9-4380-9a56-841b45f0aca0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:43.909791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88c38162-b7a9-4380-9a56-841b45f0aca0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:43.910297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88c38162-b7a9-4380-9a56-841b45f0aca0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:44.090010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-88c38162-b7a9-4380-9a56-841b45f0aca0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:44.098868 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-88c38162-b7a9-4380-9a56-841b45f0aca0 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1681 microversion: 2.1 time: 0.204729 Sep 07 13:27:44.099450 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3272/6510] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:43 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1681 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:44.125373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-81eec4f5-a843-4ede-a533-3a32d3a54d0c tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:44.126044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-81eec4f5-a843-4ede-a533-3a32d3a54d0c tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:44.133153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81eec4f5-a843-4ede-a533-3a32d3a54d0c tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:44.133700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81eec4f5-a843-4ede-a533-3a32d3a54d0c tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:44.134144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81eec4f5-a843-4ede-a533-3a32d3a54d0c tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:44.134856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81eec4f5-a843-4ede-a533-3a32d3a54d0c tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:44.135308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81eec4f5-a843-4ede-a533-3a32d3a54d0c tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:44.135727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81eec4f5-a843-4ede-a533-3a32d3a54d0c tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:44.274959 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-81eec4f5-a843-4ede-a533-3a32d3a54d0c tempest-TestNetworkAdvancedServerOps-1721334517 tempest-TestNetworkAdvancedServerOps-1721334517-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1832 microversion: 2.1 time: 0.154231 Sep 07 13:27:44.275691 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3239/6511] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:44 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1832 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:44.300019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-64d2f226-03a3-4332-a22d-ee449c8dbf12 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:44.300659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-64d2f226-03a3-4332-a22d-ee449c8dbf12 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:44.307822 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64d2f226-03a3-4332-a22d-ee449c8dbf12 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:44.308310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64d2f226-03a3-4332-a22d-ee449c8dbf12 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:44.308802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64d2f226-03a3-4332-a22d-ee449c8dbf12 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:44.309597 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64d2f226-03a3-4332-a22d-ee449c8dbf12 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:44.310087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64d2f226-03a3-4332-a22d-ee449c8dbf12 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:44.310534 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64d2f226-03a3-4332-a22d-ee449c8dbf12 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:44.466390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-64d2f226-03a3-4332-a22d-ee449c8dbf12 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:44.475059 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-64d2f226-03a3-4332-a22d-ee449c8dbf12 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1681 microversion: 2.1 time: 0.179304 Sep 07 13:27:44.475771 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3273/6512] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:44 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:44.576139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fc789d37-9c28-44d8-8cd4-1fee38c1707e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:44.579557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fc789d37-9c28-44d8-8cd4-1fee38c1707e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:44.586266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc789d37-9c28-44d8-8cd4-1fee38c1707e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:44.586762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc789d37-9c28-44d8-8cd4-1fee38c1707e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:44.587209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc789d37-9c28-44d8-8cd4-1fee38c1707e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:44.587950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc789d37-9c28-44d8-8cd4-1fee38c1707e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:44.588384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc789d37-9c28-44d8-8cd4-1fee38c1707e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:44.588907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc789d37-9c28-44d8-8cd4-1fee38c1707e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:44.660151 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fc789d37-9c28-44d8-8cd4-1fee38c1707e tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "POST /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e/action" status: 200 len: 38630 microversion: 2.1 time: 0.088437 Sep 07 13:27:44.660869 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3240/6513] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:27:44 2022] POST /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e/action => generated 38630 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:27:46.025746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4c309376-2ac3-40c6-82c8-05a40009808b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:46.026686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4c309376-2ac3-40c6-82c8-05a40009808b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:46.028496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-34d0ca02-4dbe-4885-ae6f-0e40e110bedd req-b217a24b-5f1f-4ca5-ad13-0c2ee3c1dac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87ce5a84-9ebd-4540-b82f-2fc21fb9518e", "tag": "2146a517-5fea-4a11-a2e2-5cba05352f1a"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:46.034539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c309376-2ac3-40c6-82c8-05a40009808b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:46.035158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c309376-2ac3-40c6-82c8-05a40009808b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:46.035517 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c309376-2ac3-40c6-82c8-05a40009808b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:46.036454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c309376-2ac3-40c6-82c8-05a40009808b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:46.037084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c309376-2ac3-40c6-82c8-05a40009808b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:46.037203 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:46.037957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c309376-2ac3-40c6-82c8-05a40009808b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:46.042988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-34d0ca02-4dbe-4885-ae6f-0e40e110bedd req-b217a24b-5f1f-4ca5-ad13-0c2ee3c1dac0 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:46.043805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-34d0ca02-4dbe-4885-ae6f-0e40e110bedd req-b217a24b-5f1f-4ca5-ad13-0c2ee3c1dac0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:46.044301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-34d0ca02-4dbe-4885-ae6f-0e40e110bedd req-b217a24b-5f1f-4ca5-ad13-0c2ee3c1dac0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:46.050721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=81 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:46.054902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:46.061368 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-34d0ca02-4dbe-4885-ae6f-0e40e110bedd req-b217a24b-5f1f-4ca5-ad13-0c2ee3c1dac0 service nova] Creating event network-changed:2146a517-5fea-4a11-a2e2-5cba05352f1a for instance 87ce5a84-9ebd-4540-b82f-2fc21fb9518e on n-h2-852087-9 Sep 07 13:27:46.067562 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-34d0ca02-4dbe-4885-ae6f-0e40e110bedd req-b217a24b-5f1f-4ca5-ad13-0c2ee3c1dac0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043388 Sep 07 13:27:46.068499 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3241/6514] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:27:46.073974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4c309376-2ac3-40c6-82c8-05a40009808b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:27:46.176302 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4c309376-2ac3-40c6-82c8-05a40009808b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "DELETE /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 204 len: 0 microversion: 2.1 time: 0.154203 Sep 07 13:27:46.181559 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3274/6515] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:27:46 2022] DELETE /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:27:46.189200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-648c347f-f123-4e7e-945f-97235dfba10d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:46.189942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-648c347f-f123-4e7e-945f-97235dfba10d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:46.196817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-648c347f-f123-4e7e-945f-97235dfba10d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:46.197312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-648c347f-f123-4e7e-945f-97235dfba10d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:46.197809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-648c347f-f123-4e7e-945f-97235dfba10d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:46.198514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-648c347f-f123-4e7e-945f-97235dfba10d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:46.198963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-648c347f-f123-4e7e-945f-97235dfba10d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:46.199387 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-648c347f-f123-4e7e-945f-97235dfba10d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:46.340913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-648c347f-f123-4e7e-945f-97235dfba10d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:46.349329 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-648c347f-f123-4e7e-945f-97235dfba10d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1687 microversion: 2.1 time: 0.165134 Sep 07 13:27:46.350313 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3242/6516] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:46 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:47.347086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-2b2d18cf-d503-4411-8ce4-81fa894233dc req-13febf95-b176-4fe9-b158-d49f85f4059b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87ce5a84-9ebd-4540-b82f-2fc21fb9518e", "name": "network-vif-deleted", "tag": "2146a517-5fea-4a11-a2e2-5cba05352f1a"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:47.353641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:47.361756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2b2d18cf-d503-4411-8ce4-81fa894233dc req-13febf95-b176-4fe9-b158-d49f85f4059b service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:47.362265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2b2d18cf-d503-4411-8ce4-81fa894233dc req-13febf95-b176-4fe9-b158-d49f85f4059b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:47.362719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2b2d18cf-d503-4411-8ce4-81fa894233dc req-13febf95-b176-4fe9-b158-d49f85f4059b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:47.373810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0f7614d0-ef8a-4933-93eb-e905046fd480 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:47.375625 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-2b2d18cf-d503-4411-8ce4-81fa894233dc req-13febf95-b176-4fe9-b158-d49f85f4059b service nova] Creating event network-vif-deleted:2146a517-5fea-4a11-a2e2-5cba05352f1a for instance 87ce5a84-9ebd-4540-b82f-2fc21fb9518e on n-h2-852087-9 Sep 07 13:27:47.375820 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0f7614d0-ef8a-4933-93eb-e905046fd480 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:47.382322 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-2b2d18cf-d503-4411-8ce4-81fa894233dc req-13febf95-b176-4fe9-b158-d49f85f4059b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039022 Sep 07 13:27:47.383362 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3275/6517] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:27:47.383836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f7614d0-ef8a-4933-93eb-e905046fd480 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:47.384763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f7614d0-ef8a-4933-93eb-e905046fd480 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:47.385937 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f7614d0-ef8a-4933-93eb-e905046fd480 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:47.387290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f7614d0-ef8a-4933-93eb-e905046fd480 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:47.387861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f7614d0-ef8a-4933-93eb-e905046fd480 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:47.388352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f7614d0-ef8a-4933-93eb-e905046fd480 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:47.459335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0f7614d0-ef8a-4933-93eb-e905046fd480 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:27:47.467661 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0f7614d0-ef8a-4933-93eb-e905046fd480 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 200 len: 1351 microversion: 2.1 time: 0.097896 Sep 07 13:27:47.468249 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3243/6518] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:47 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:27:48.507890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9e71563e-5fab-44d5-bcfc-96651bcd2b84 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:48.509150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9e71563e-5fab-44d5-bcfc-96651bcd2b84 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: 87ce5a84-9ebd-4540-b82f-2fc21fb9518e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:27:48.517858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e71563e-5fab-44d5-bcfc-96651bcd2b84 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:48.518431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e71563e-5fab-44d5-bcfc-96651bcd2b84 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:48.518921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e71563e-5fab-44d5-bcfc-96651bcd2b84 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:48.519687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e71563e-5fab-44d5-bcfc-96651bcd2b84 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:27:48.520165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e71563e-5fab-44d5-bcfc-96651bcd2b84 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:27:48.520607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e71563e-5fab-44d5-bcfc-96651bcd2b84 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:27:48.539201 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-9e71563e-5fab-44d5-bcfc-96651bcd2b84 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] HTTP exception thrown: Instance 87ce5a84-9ebd-4540-b82f-2fc21fb9518e could not be found. Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9e71563e-5fab-44d5-bcfc-96651bcd2b84 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Request method failure captured: Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e HTTP/1.1 Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJo_65BByUQjqxLLydngyGcQD0VqesltPK2phoKKnh2_w98MobCIT0V6J-xkzZOSe_MpyS8-hI1LHe2rGNpuHeqYkh62s-1hz08u5D4pKaIFeOnNl2E_uiZLXNKjMthRgm88PlbJ3GaVc7Wl0PE0eUQjIGoaS5gULI9m3p_XsfeTPw0 Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: c7ff80261a1a4ffdaefba7dd7d276c00 Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1063465928 Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7ff80261a1a4ffdaefba7dd7d276c00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c7ff80261a1a4ffdaefba7dd7d276c00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c7ff80261a1a4ffdaefba7dd7d276c00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7ff80261a1a4ffdaefba7dd7d276c00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1063465928 Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: c7ff80261a1a4ffdaefba7dd7d276c00 Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1063465928 Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TestNetworkAdvancedServerOps-1063465928-project Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 663c3f21362d460785702e1858cc6706 Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1063465928-project Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 87ce5a84-9ebd-4540-b82f-2fc21fb9518e could not be found. Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '87ce5a84-9ebd-4540-b82f-2fc21fb9518e'} Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87ce5a84-9ebd-4540-b82f-2fc21fb9518e could not be found. Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87ce5a84-9ebd-4540-b82f-2fc21fb9518e could not be found. Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:27:48.542541 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:27:48.548767 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:27:48.548767 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:27:48.548767 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:27:48.548767 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:27:48.548767 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:27:48.548767 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:27:48.548767 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87ce5a84-9ebd-4540-b82f-2fc21fb9518e could not be found. Sep 07 13:27:48.548767 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:27:48.548767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9e71563e-5fab-44d5-bcfc-96651bcd2b84 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Returning 404 to user: Instance 87ce5a84-9ebd-4540-b82f-2fc21fb9518e could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:27:48.548767 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9e71563e-5fab-44d5-bcfc-96651bcd2b84 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e" status: 404 len: 111 microversion: 2.1 time: 0.047604 Sep 07 13:27:48.548767 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3276/6519] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:27:48 2022] GET /compute/v2.1/servers/87ce5a84-9ebd-4540-b82f-2fc21fb9518e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:27:52.415829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e0ee28ce-7893-45f8-aeb4-c16ca53704f6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '.version_select at 0x7fc41389cd30>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:27:52.448551 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e0ee28ce-7893-45f8-aeb4-c16ca53704f6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1107653135" status: 202 len: 0 microversion: 2.1 time: 0.039700 Sep 07 13:27:52.449539 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3244/6520] 10.222.0.16 () {58 vars in 1284 bytes} [Wed Sep 7 13:27:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1107653135 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:27:52.486266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d55a39f9-ff8f-425a-b481-48bce945be0a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Action: 'create', calling method: .version_select at 0x7fc4183f6a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-250320579", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2/+wqUDsGWaxuFIk0+RPQfNF6wHsfE4Cu0H1n+4r9mbSQ10JSc5HkBoGGLWVcEb5q/FAnwnbn6kguTg4Zr23ZwsPeP2VRI/9XH0WsO7LL00JAqVsJl+Lq13odJbe9v8A=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:52.511470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-d55a39f9-ff8f-425a-b481-48bce945be0a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Getting quotas for project c7ff80261a1a4ffdaefba7dd7d276c00. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:27:52.518810 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-d55a39f9-ff8f-425a-b481-48bce945be0a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Getting quotas for user 663c3f21362d460785702e1858cc6706 and project c7ff80261a1a4ffdaefba7dd7d276c00. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:27:52.547045 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d55a39f9-ff8f-425a-b481-48bce945be0a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.067186 Sep 07 13:27:52.547660 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3277/6521] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 13:27:52 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:27:59.673551 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9eec607e-e772-4da7-9510-7122270bd344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-910029960", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "fddaa57c-339b-41cf-878f-8c233581d936"}], "key_name": "tempest-TestNetworkAdvancedServerOps-250320579", "security_groups": [{"name": "tempest-secgroup-smoke-299194497"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:27:59.689677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=13 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:59.817394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-9eec607e-e772-4da7-9510-7122270bd344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] validate_networks() for [('fddaa57c-339b-41cf-878f-8c233581d936', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:28:00.608214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9eec607e-e772-4da7-9510-7122270bd344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:28:00.609418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9eec607e-e772-4da7-9510-7122270bd344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:28:00.610853 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9eec607e-e772-4da7-9510-7122270bd344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:28:00.611869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9eec607e-e772-4da7-9510-7122270bd344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:28:00.612454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9eec607e-e772-4da7-9510-7122270bd344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:28:00.627454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9eec607e-e772-4da7-9510-7122270bd344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:00.628263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9eec607e-e772-4da7-9510-7122270bd344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:00.628701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9eec607e-e772-4da7-9510-7122270bd344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:00.629721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9eec607e-e772-4da7-9510-7122270bd344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:00.630360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9eec607e-e772-4da7-9510-7122270bd344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:00.632170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9eec607e-e772-4da7-9510-7122270bd344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:00.656119 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-9eec607e-e772-4da7-9510-7122270bd344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Getting quotas for project c7ff80261a1a4ffdaefba7dd7d276c00. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:28:00.663537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-9eec607e-e772-4da7-9510-7122270bd344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Getting quotas for user 663c3f21362d460785702e1858cc6706 and project c7ff80261a1a4ffdaefba7dd7d276c00. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:28:00.679814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9eec607e-e772-4da7-9510-7122270bd344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:28:00.682242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9eec607e-e772-4da7-9510-7122270bd344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:28:00.739483 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9eec607e-e772-4da7-9510-7122270bd344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.070180 Sep 07 13:28:00.740154 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3245/6522] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:27:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:28:00.750563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:00.755816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cede3966-5b5c-4706-9b37-6bd3964f2215 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:00.757769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cede3966-5b5c-4706-9b37-6bd3964f2215 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:00.829904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cede3966-5b5c-4706-9b37-6bd3964f2215 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:00.842355 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cede3966-5b5c-4706-9b37-6bd3964f2215 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1265 microversion: 2.1 time: 0.094015 Sep 07 13:28:00.843171 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3278/6523] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:00 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1265 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:01.887629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d8495a1b-a9e9-45e6-8bf7-0026ce3f81ae tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:01.888256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d8495a1b-a9e9-45e6-8bf7-0026ce3f81ae tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:01.899794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8495a1b-a9e9-45e6-8bf7-0026ce3f81ae tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:01.900302 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8495a1b-a9e9-45e6-8bf7-0026ce3f81ae tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:01.900748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8495a1b-a9e9-45e6-8bf7-0026ce3f81ae tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:01.901512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8495a1b-a9e9-45e6-8bf7-0026ce3f81ae tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:01.902013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8495a1b-a9e9-45e6-8bf7-0026ce3f81ae tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:01.902449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d8495a1b-a9e9-45e6-8bf7-0026ce3f81ae tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:02.011328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d8495a1b-a9e9-45e6-8bf7-0026ce3f81ae tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:02.028469 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d8495a1b-a9e9-45e6-8bf7-0026ce3f81ae tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1317 microversion: 2.1 time: 0.152236 Sep 07 13:28:02.029432 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3246/6524] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:01 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:03.055204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ce904af-2c60-4ebe-b93c-b1fe89347344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:03.056271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8ce904af-2c60-4ebe-b93c-b1fe89347344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:03.068160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ce904af-2c60-4ebe-b93c-b1fe89347344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:03.069996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ce904af-2c60-4ebe-b93c-b1fe89347344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:03.070861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ce904af-2c60-4ebe-b93c-b1fe89347344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:03.072001 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ce904af-2c60-4ebe-b93c-b1fe89347344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:03.072496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ce904af-2c60-4ebe-b93c-b1fe89347344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:03.073106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ce904af-2c60-4ebe-b93c-b1fe89347344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:03.272185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8ce904af-2c60-4ebe-b93c-b1fe89347344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:03.287434 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8ce904af-2c60-4ebe-b93c-b1fe89347344 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1390 microversion: 2.1 time: 0.236590 Sep 07 13:28:03.303826 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3279/6525] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:03 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1390 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:03.899176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d9efdd7c-30a5-4ca8-bce1-e30819ddee2a req-d3ff2ce3-df68-488b-8ce2-e4b2d99a1b4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9995986-5686-4d6f-9405-4a3b2d109d2d", "tag": "ecf4222b-fb2e-4879-a3e2-b2351cf66e5d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:28:03.916439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d9efdd7c-30a5-4ca8-bce1-e30819ddee2a req-d3ff2ce3-df68-488b-8ce2-e4b2d99a1b4e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:03.917256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d9efdd7c-30a5-4ca8-bce1-e30819ddee2a req-d3ff2ce3-df68-488b-8ce2-e4b2d99a1b4e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:03.917928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d9efdd7c-30a5-4ca8-bce1-e30819ddee2a req-d3ff2ce3-df68-488b-8ce2-e4b2d99a1b4e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:03.935213 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d9efdd7c-30a5-4ca8-bce1-e30819ddee2a req-d3ff2ce3-df68-488b-8ce2-e4b2d99a1b4e service nova] Creating event network-changed:ecf4222b-fb2e-4879-a3e2-b2351cf66e5d for instance e9995986-5686-4d6f-9405-4a3b2d109d2d on n-h2-852087-9 Sep 07 13:28:03.943041 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d9efdd7c-30a5-4ca8-bce1-e30819ddee2a req-d3ff2ce3-df68-488b-8ce2-e4b2d99a1b4e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047689 Sep 07 13:28:03.944554 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3247/6526] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:28:04.316132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b757ab39-65da-4334-95d3-2103de725dde tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:04.317979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b757ab39-65da-4334-95d3-2103de725dde tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:04.328650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b757ab39-65da-4334-95d3-2103de725dde tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:04.329194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b757ab39-65da-4334-95d3-2103de725dde tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:04.329710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b757ab39-65da-4334-95d3-2103de725dde tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:04.330469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b757ab39-65da-4334-95d3-2103de725dde tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:04.330955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b757ab39-65da-4334-95d3-2103de725dde tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:04.331623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b757ab39-65da-4334-95d3-2103de725dde tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:04.492186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b757ab39-65da-4334-95d3-2103de725dde tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:04.501424 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b757ab39-65da-4334-95d3-2103de725dde tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1390 microversion: 2.1 time: 0.192371 Sep 07 13:28:04.502091 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3280/6527] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:04 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1390 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:05.536348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5abc6a1f-4659-4707-aaba-73b143195f70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:05.537571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5abc6a1f-4659-4707-aaba-73b143195f70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:05.547021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5abc6a1f-4659-4707-aaba-73b143195f70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:05.547595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5abc6a1f-4659-4707-aaba-73b143195f70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:05.548106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5abc6a1f-4659-4707-aaba-73b143195f70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:05.549048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5abc6a1f-4659-4707-aaba-73b143195f70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:05.549638 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5abc6a1f-4659-4707-aaba-73b143195f70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:05.550363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5abc6a1f-4659-4707-aaba-73b143195f70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:05.726417 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5abc6a1f-4659-4707-aaba-73b143195f70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:05.741334 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5abc6a1f-4659-4707-aaba-73b143195f70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1390 microversion: 2.1 time: 0.211618 Sep 07 13:28:05.742387 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3248/6528] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:05 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1390 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:06.767168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b1b8b1cb-f993-4890-be81-52b189f9c0be tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:06.768090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b1b8b1cb-f993-4890-be81-52b189f9c0be tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:06.777159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1b8b1cb-f993-4890-be81-52b189f9c0be tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:06.779610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1b8b1cb-f993-4890-be81-52b189f9c0be tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:06.780788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1b8b1cb-f993-4890-be81-52b189f9c0be tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:06.782135 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1b8b1cb-f993-4890-be81-52b189f9c0be tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:06.782756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1b8b1cb-f993-4890-be81-52b189f9c0be tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:06.783383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b1b8b1cb-f993-4890-be81-52b189f9c0be tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:06.945031 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b1b8b1cb-f993-4890-be81-52b189f9c0be tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:06.956808 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b1b8b1cb-f993-4890-be81-52b189f9c0be tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1390 microversion: 2.1 time: 0.193652 Sep 07 13:28:06.957740 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3281/6529] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:06 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1390 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:07.982977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d93e13b-6bfe-43b0-bdcf-ce00a974ffe2 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:07.983617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1d93e13b-6bfe-43b0-bdcf-ce00a974ffe2 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:07.990616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d93e13b-6bfe-43b0-bdcf-ce00a974ffe2 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:07.991471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d93e13b-6bfe-43b0-bdcf-ce00a974ffe2 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:07.992105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d93e13b-6bfe-43b0-bdcf-ce00a974ffe2 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:07.993283 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d93e13b-6bfe-43b0-bdcf-ce00a974ffe2 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:07.993951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d93e13b-6bfe-43b0-bdcf-ce00a974ffe2 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:07.994549 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d93e13b-6bfe-43b0-bdcf-ce00a974ffe2 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:08.156303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1d93e13b-6bfe-43b0-bdcf-ce00a974ffe2 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:08.165444 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1d93e13b-6bfe-43b0-bdcf-ce00a974ffe2 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1390 microversion: 2.1 time: 0.187630 Sep 07 13:28:08.166094 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3249/6530] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:07 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1390 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:09.193046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0c19a28a-1034-45d9-996c-40fb1cea8481 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:09.194331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0c19a28a-1034-45d9-996c-40fb1cea8481 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:09.207320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c19a28a-1034-45d9-996c-40fb1cea8481 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:09.208264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c19a28a-1034-45d9-996c-40fb1cea8481 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:09.209453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c19a28a-1034-45d9-996c-40fb1cea8481 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:09.210862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c19a28a-1034-45d9-996c-40fb1cea8481 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:09.211757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c19a28a-1034-45d9-996c-40fb1cea8481 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:09.212604 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c19a28a-1034-45d9-996c-40fb1cea8481 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:09.405387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0c19a28a-1034-45d9-996c-40fb1cea8481 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:09.418737 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0c19a28a-1034-45d9-996c-40fb1cea8481 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1390 microversion: 2.1 time: 0.233028 Sep 07 13:28:09.419340 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3282/6531] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:09 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1390 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:09.969002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-2bc261cb-78e3-493b-bd7b-b9eaa1360fed req-fda9373f-dad6-457e-bfc5-3307e13e01ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9995986-5686-4d6f-9405-4a3b2d109d2d", "name": "network-vif-plugged", "status": "completed", "tag": "ecf4222b-fb2e-4879-a3e2-b2351cf66e5d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:28:09.986187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2bc261cb-78e3-493b-bd7b-b9eaa1360fed req-fda9373f-dad6-457e-bfc5-3307e13e01ee service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:09.986816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2bc261cb-78e3-493b-bd7b-b9eaa1360fed req-fda9373f-dad6-457e-bfc5-3307e13e01ee service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:09.987329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2bc261cb-78e3-493b-bd7b-b9eaa1360fed req-fda9373f-dad6-457e-bfc5-3307e13e01ee service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:10.002956 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-2bc261cb-78e3-493b-bd7b-b9eaa1360fed req-fda9373f-dad6-457e-bfc5-3307e13e01ee service nova] Creating event network-vif-plugged:ecf4222b-fb2e-4879-a3e2-b2351cf66e5d for instance e9995986-5686-4d6f-9405-4a3b2d109d2d on n-h2-852087-9 Sep 07 13:28:10.008995 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-2bc261cb-78e3-493b-bd7b-b9eaa1360fed req-fda9373f-dad6-457e-bfc5-3307e13e01ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046064 Sep 07 13:28:10.010115 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3250/6532] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:28:10.448373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f7f386e1-0108-4df0-994c-3983ef00ef3c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:10.449552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f7f386e1-0108-4df0-994c-3983ef00ef3c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:10.461300 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7f386e1-0108-4df0-994c-3983ef00ef3c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:10.462271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7f386e1-0108-4df0-994c-3983ef00ef3c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:10.463075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7f386e1-0108-4df0-994c-3983ef00ef3c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:10.464071 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7f386e1-0108-4df0-994c-3983ef00ef3c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:10.465462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7f386e1-0108-4df0-994c-3983ef00ef3c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:10.466291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7f386e1-0108-4df0-994c-3983ef00ef3c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:10.836663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:11.067702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f7f386e1-0108-4df0-994c-3983ef00ef3c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:11.080932 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f7f386e1-0108-4df0-994c-3983ef00ef3c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1390 microversion: 2.1 time: 0.639679 Sep 07 13:28:11.082030 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3283/6533] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:10 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1390 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:12.117029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:12.118913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:12.125841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-77e2ec38-f5e9-40e9-811b-2490fd2df97b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:12.126821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-77e2ec38-f5e9-40e9-811b-2490fd2df97b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:12.136328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77e2ec38-f5e9-40e9-811b-2490fd2df97b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:12.137145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77e2ec38-f5e9-40e9-811b-2490fd2df97b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:12.137790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77e2ec38-f5e9-40e9-811b-2490fd2df97b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:12.138616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77e2ec38-f5e9-40e9-811b-2490fd2df97b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:12.139311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77e2ec38-f5e9-40e9-811b-2490fd2df97b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:12.140015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-77e2ec38-f5e9-40e9-811b-2490fd2df97b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:12.377386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-77e2ec38-f5e9-40e9-811b-2490fd2df97b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:12.392593 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-77e2ec38-f5e9-40e9-811b-2490fd2df97b tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1561 microversion: 2.1 time: 0.276579 Sep 07 13:28:12.393737 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3251/6534] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:12 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1561 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:28:12.443702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c6840be0-49de-4cf2-8b11-6fd9a02fe506 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:12.445535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c6840be0-49de-4cf2-8b11-6fd9a02fe506 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:12.458283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6840be0-49de-4cf2-8b11-6fd9a02fe506 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:12.459210 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6840be0-49de-4cf2-8b11-6fd9a02fe506 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:12.460386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6840be0-49de-4cf2-8b11-6fd9a02fe506 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:12.461984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6840be0-49de-4cf2-8b11-6fd9a02fe506 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:12.462886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6840be0-49de-4cf2-8b11-6fd9a02fe506 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:12.463634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6840be0-49de-4cf2-8b11-6fd9a02fe506 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:12.501522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bce6565c-0bf0-4311-85fd-8d7dc85d0cf7 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:12.508891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bce6565c-0bf0-4311-85fd-8d7dc85d0cf7 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 838a6598-c72a-4ffc-bce6-3340d8b95887] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:12.517460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bce6565c-0bf0-4311-85fd-8d7dc85d0cf7 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:12.518559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bce6565c-0bf0-4311-85fd-8d7dc85d0cf7 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:12.519606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bce6565c-0bf0-4311-85fd-8d7dc85d0cf7 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:12.520895 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bce6565c-0bf0-4311-85fd-8d7dc85d0cf7 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:12.522223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bce6565c-0bf0-4311-85fd-8d7dc85d0cf7 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:12.522796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bce6565c-0bf0-4311-85fd-8d7dc85d0cf7 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:12.574536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bce6565c-0bf0-4311-85fd-8d7dc85d0cf7 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 838a6598-c72a-4ffc-bce6-3340d8b95887] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:28:12.665893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c6840be0-49de-4cf2-8b11-6fd9a02fe506 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:12.679986 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c6840be0-49de-4cf2-8b11-6fd9a02fe506 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1561 microversion: 2.1 time: 0.245243 Sep 07 13:28:12.682101 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3284/6535] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:12 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1561 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:12.733327 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bce6565c-0bf0-4311-85fd-8d7dc85d0cf7 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "DELETE /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887" status: 204 len: 0 microversion: 2.1 time: 0.236407 Sep 07 13:28:12.738663 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3252/6536] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:28:12 2022] DELETE /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:28:12.747989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-702d4e14-3f65-432c-a61b-af7daf1d3439 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:12.749270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-702d4e14-3f65-432c-a61b-af7daf1d3439 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 838a6598-c72a-4ffc-bce6-3340d8b95887] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:12.760522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-702d4e14-3f65-432c-a61b-af7daf1d3439 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:12.761412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-702d4e14-3f65-432c-a61b-af7daf1d3439 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:12.762255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-702d4e14-3f65-432c-a61b-af7daf1d3439 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:12.763557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-702d4e14-3f65-432c-a61b-af7daf1d3439 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:12.764592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-702d4e14-3f65-432c-a61b-af7daf1d3439 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:12.765919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-702d4e14-3f65-432c-a61b-af7daf1d3439 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:13.132885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-702d4e14-3f65-432c-a61b-af7daf1d3439 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:13.149015 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-702d4e14-3f65-432c-a61b-af7daf1d3439 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887" status: 200 len: 1554 microversion: 2.1 time: 0.408316 Sep 07 13:28:13.150540 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3285/6537] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:12 2022] GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887 => generated 1554 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:14.193844 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-67bd6c04-4715-49af-9e8e-b31a395ade3b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:14.195775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-67bd6c04-4715-49af-9e8e-b31a395ade3b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 838a6598-c72a-4ffc-bce6-3340d8b95887] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:14.207619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67bd6c04-4715-49af-9e8e-b31a395ade3b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:14.208333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67bd6c04-4715-49af-9e8e-b31a395ade3b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:14.209279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67bd6c04-4715-49af-9e8e-b31a395ade3b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:14.210841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67bd6c04-4715-49af-9e8e-b31a395ade3b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:14.211653 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67bd6c04-4715-49af-9e8e-b31a395ade3b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:14.212395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-67bd6c04-4715-49af-9e8e-b31a395ade3b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:14.591984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-67bd6c04-4715-49af-9e8e-b31a395ade3b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:14.601451 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-67bd6c04-4715-49af-9e8e-b31a395ade3b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887" status: 200 len: 1554 microversion: 2.1 time: 0.416122 Sep 07 13:28:14.602403 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3253/6538] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:14 2022] GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887 => generated 1554 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:15.625743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2934023f-180a-483e-a552-f60fd6f98bf3 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:15.627664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2934023f-180a-483e-a552-f60fd6f98bf3 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 838a6598-c72a-4ffc-bce6-3340d8b95887] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:15.635161 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2934023f-180a-483e-a552-f60fd6f98bf3 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:15.636075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2934023f-180a-483e-a552-f60fd6f98bf3 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:15.636732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2934023f-180a-483e-a552-f60fd6f98bf3 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:15.637969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2934023f-180a-483e-a552-f60fd6f98bf3 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:15.638692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2934023f-180a-483e-a552-f60fd6f98bf3 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:15.639604 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2934023f-180a-483e-a552-f60fd6f98bf3 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:15.767891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2934023f-180a-483e-a552-f60fd6f98bf3 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:15.785268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1cd38fe7-00fc-48df-a2aa-9d0ada2651dd tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:15.788345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1cd38fe7-00fc-48df-a2aa-9d0ada2651dd tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:15.794637 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2934023f-180a-483e-a552-f60fd6f98bf3 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887" status: 200 len: 1486 microversion: 2.1 time: 0.172397 Sep 07 13:28:15.806769 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3286/6539] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:15 2022] GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887 => generated 1486 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:15.807752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cd38fe7-00fc-48df-a2aa-9d0ada2651dd tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:15.809239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cd38fe7-00fc-48df-a2aa-9d0ada2651dd tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:15.810320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cd38fe7-00fc-48df-a2aa-9d0ada2651dd tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:15.811977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cd38fe7-00fc-48df-a2aa-9d0ada2651dd tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:15.813185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cd38fe7-00fc-48df-a2aa-9d0ada2651dd tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:15.814581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cd38fe7-00fc-48df-a2aa-9d0ada2651dd tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:15.815479 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-b86edbd7-7754-478f-a8e4-35bc2a60f7bf req-1198ab37-02a1-414e-8e87-51767f30b72e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9995986-5686-4d6f-9405-4a3b2d109d2d", "tag": "ecf4222b-fb2e-4879-a3e2-b2351cf66e5d"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:28:15.837225 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b86edbd7-7754-478f-a8e4-35bc2a60f7bf req-1198ab37-02a1-414e-8e87-51767f30b72e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:15.837757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b86edbd7-7754-478f-a8e4-35bc2a60f7bf req-1198ab37-02a1-414e-8e87-51767f30b72e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:15.838394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b86edbd7-7754-478f-a8e4-35bc2a60f7bf req-1198ab37-02a1-414e-8e87-51767f30b72e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:15.860637 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-b86edbd7-7754-478f-a8e4-35bc2a60f7bf req-1198ab37-02a1-414e-8e87-51767f30b72e service nova] Creating event network-changed:ecf4222b-fb2e-4879-a3e2-b2351cf66e5d for instance e9995986-5686-4d6f-9405-4a3b2d109d2d on n-h2-852087-9 Sep 07 13:28:15.870188 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-b86edbd7-7754-478f-a8e4-35bc2a60f7bf req-1198ab37-02a1-414e-8e87-51767f30b72e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061930 Sep 07 13:28:15.875461 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3287/6540] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:28:16.100195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1cd38fe7-00fc-48df-a2aa-9d0ada2651dd tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:16.122762 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1cd38fe7-00fc-48df-a2aa-9d0ada2651dd tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1561 microversion: 2.1 time: 0.345576 Sep 07 13:28:16.124446 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3254/6541] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:15 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1561 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:28:16.848848 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f125c8e3-a5cf-4e22-bf6e-2fb6e2c425af tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:16.849656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f125c8e3-a5cf-4e22-bf6e-2fb6e2c425af tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 838a6598-c72a-4ffc-bce6-3340d8b95887] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:16.857322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f125c8e3-a5cf-4e22-bf6e-2fb6e2c425af tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:16.858250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f125c8e3-a5cf-4e22-bf6e-2fb6e2c425af tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:16.858801 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f125c8e3-a5cf-4e22-bf6e-2fb6e2c425af tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:16.859889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f125c8e3-a5cf-4e22-bf6e-2fb6e2c425af tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:16.861227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f125c8e3-a5cf-4e22-bf6e-2fb6e2c425af tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:16.861766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f125c8e3-a5cf-4e22-bf6e-2fb6e2c425af tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:16.878751 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-f125c8e3-a5cf-4e22-bf6e-2fb6e2c425af tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] HTTP exception thrown: Instance 838a6598-c72a-4ffc-bce6-3340d8b95887 could not be found. Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f125c8e3-a5cf-4e22-bf6e-2fb6e2c425af tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Request method failure captured: Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887 HTTP/1.1 Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJu8nAGMibq2l4eAF7l5biF2p744erQn5M0V4SKZph7Wrzt-LbIbQka51QAnSR_58ciST0UDuAPBEX5SVse91Nhn7h7i2ynC5f2VK4N5DX2LGHbs_CoBAmNjXqjm6tb8EwVgkWv9bUN3aMjaCKCNJxOyxZM96187i0X1etOdgNlpoKw Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 2bbb0cc60bcc4538a2a7ba695efcf613 Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TestNetworkBasicOps-1540191208 Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2bbb0cc60bcc4538a2a7ba695efcf613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2bbb0cc60bcc4538a2a7ba695efcf613"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2bbb0cc60bcc4538a2a7ba695efcf613"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2bbb0cc60bcc4538a2a7ba695efcf613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TestNetworkBasicOps-1540191208 Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 2bbb0cc60bcc4538a2a7ba695efcf613 Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestNetworkBasicOps-1540191208 Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TestNetworkBasicOps-1540191208-project Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 3fc5e615495243fd8fe6541e6c828a45 Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TestNetworkBasicOps-1540191208-project Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 838a6598-c72a-4ffc-bce6-3340d8b95887 could not be found. Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '838a6598-c72a-4ffc-bce6-3340d8b95887'} Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 838a6598-c72a-4ffc-bce6-3340d8b95887 could not be found. Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 838a6598-c72a-4ffc-bce6-3340d8b95887 could not be found. Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:28:16.880665 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:28:16.887591 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:28:16.887591 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:28:16.887591 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:28:16.887591 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:28:16.887591 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:28:16.887591 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 838a6598-c72a-4ffc-bce6-3340d8b95887 could not be found. Sep 07 13:28:16.887591 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:28:16.887591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f125c8e3-a5cf-4e22-bf6e-2fb6e2c425af tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Returning 404 to user: Instance 838a6598-c72a-4ffc-bce6-3340d8b95887 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:28:16.887591 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f125c8e3-a5cf-4e22-bf6e-2fb6e2c425af tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887" status: 404 len: 111 microversion: 2.1 time: 0.049835 Sep 07 13:28:16.887591 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3288/6542] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:16 2022] GET /compute/v2.1/servers/838a6598-c72a-4ffc-bce6-3340d8b95887 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:28:17.105942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d2243017-4f31-4cda-a282-d82dc98a00d9 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '.version_select at 0x7fc41953f790>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:17.116818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:17.138383 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d2243017-4f31-4cda-a282-d82dc98a00d9 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1656350984" status: 202 len: 0 microversion: 2.1 time: 0.036446 Sep 07 13:28:17.139015 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3255/6543] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Sep 7 13:28:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1656350984 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:28:17.892503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-1a1faba6-8933-42b8-9607-54c2b31ba40b req-36e8322f-fd26-47a9-bf07-6fa55d6ab6a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "838a6598-c72a-4ffc-bce6-3340d8b95887", "name": "network-vif-deleted", "tag": "4b12bd4d-dfe3-427c-a382-80908746abe1"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:28:17.904870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:17.907186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1a1faba6-8933-42b8-9607-54c2b31ba40b req-36e8322f-fd26-47a9-bf07-6fa55d6ab6a1 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:17.907951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1a1faba6-8933-42b8-9607-54c2b31ba40b req-36e8322f-fd26-47a9-bf07-6fa55d6ab6a1 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:17.908631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1a1faba6-8933-42b8-9607-54c2b31ba40b req-36e8322f-fd26-47a9-bf07-6fa55d6ab6a1 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:17.928325 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-1a1faba6-8933-42b8-9607-54c2b31ba40b req-36e8322f-fd26-47a9-bf07-6fa55d6ab6a1 service nova] Creating event network-vif-deleted:4b12bd4d-dfe3-427c-a382-80908746abe1 for instance 838a6598-c72a-4ffc-bce6-3340d8b95887 on n-h1-852087-9 Sep 07 13:28:17.938618 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-1a1faba6-8933-42b8-9607-54c2b31ba40b req-36e8322f-fd26-47a9-bf07-6fa55d6ab6a1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051710 Sep 07 13:28:17.940638 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3289/6544] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:28:19.114301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c8be25e9-1f2f-4e8a-82a9-2a3e5218b9d1 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:19.115108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c8be25e9-1f2f-4e8a-82a9-2a3e5218b9d1 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 4b030e3a-49f7-4481-98a9-878906e601b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:19.116693 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a097ea89-01d0-4f60-9f93-5b97bc92b3ac req-5cd37d70-a346-48fd-b652-69f40e3e0b8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b030e3a-49f7-4481-98a9-878906e601b3", "tag": "ca58990c-3b83-44e8-ba92-86108fc9cd2f"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:28:19.124458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8be25e9-1f2f-4e8a-82a9-2a3e5218b9d1 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:19.125135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8be25e9-1f2f-4e8a-82a9-2a3e5218b9d1 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:19.125844 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8be25e9-1f2f-4e8a-82a9-2a3e5218b9d1 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:19.126796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8be25e9-1f2f-4e8a-82a9-2a3e5218b9d1 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:19.127406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8be25e9-1f2f-4e8a-82a9-2a3e5218b9d1 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:19.128021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8be25e9-1f2f-4e8a-82a9-2a3e5218b9d1 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:19.130411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a097ea89-01d0-4f60-9f93-5b97bc92b3ac req-5cd37d70-a346-48fd-b652-69f40e3e0b8d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:19.130907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a097ea89-01d0-4f60-9f93-5b97bc92b3ac req-5cd37d70-a346-48fd-b652-69f40e3e0b8d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:19.131579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a097ea89-01d0-4f60-9f93-5b97bc92b3ac req-5cd37d70-a346-48fd-b652-69f40e3e0b8d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:19.143459 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a097ea89-01d0-4f60-9f93-5b97bc92b3ac req-5cd37d70-a346-48fd-b652-69f40e3e0b8d service nova] Creating event network-changed:ca58990c-3b83-44e8-ba92-86108fc9cd2f for instance 4b030e3a-49f7-4481-98a9-878906e601b3 on n-h1-852087-9 Sep 07 13:28:19.148740 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a097ea89-01d0-4f60-9f93-5b97bc92b3ac req-5cd37d70-a346-48fd-b652-69f40e3e0b8d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036126 Sep 07 13:28:19.149599 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3290/6545] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:28:19.157004 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c8be25e9-1f2f-4e8a-82a9-2a3e5218b9d1 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 4b030e3a-49f7-4481-98a9-878906e601b3] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:28:19.255980 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c8be25e9-1f2f-4e8a-82a9-2a3e5218b9d1 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3" status: 204 len: 0 microversion: 2.1 time: 0.144662 Sep 07 13:28:19.257123 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3256/6546] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:28:19 2022] DELETE /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:28:19.266191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-62c909d9-560a-41b8-b066-94b4f79df51c tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:19.266926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-62c909d9-560a-41b8-b066-94b4f79df51c tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 4b030e3a-49f7-4481-98a9-878906e601b3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:19.273777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62c909d9-560a-41b8-b066-94b4f79df51c tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:19.274288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62c909d9-560a-41b8-b066-94b4f79df51c tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:19.274740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62c909d9-560a-41b8-b066-94b4f79df51c tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:19.275468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62c909d9-560a-41b8-b066-94b4f79df51c tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:19.275942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62c909d9-560a-41b8-b066-94b4f79df51c tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:19.276387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62c909d9-560a-41b8-b066-94b4f79df51c tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:19.447511 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-62c909d9-560a-41b8-b066-94b4f79df51c tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:19.456108 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-62c909d9-560a-41b8-b066-94b4f79df51c tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3" status: 200 len: 1673 microversion: 2.1 time: 0.194175 Sep 07 13:28:19.456711 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3291/6547] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:19 2022] GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3 => generated 1673 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:20.482927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-64a19b9c-60fc-44d3-a703-5798a25e7a73 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:20.483741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-64a19b9c-60fc-44d3-a703-5798a25e7a73 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 4b030e3a-49f7-4481-98a9-878906e601b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:20.491069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64a19b9c-60fc-44d3-a703-5798a25e7a73 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:20.491580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64a19b9c-60fc-44d3-a703-5798a25e7a73 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:20.492018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64a19b9c-60fc-44d3-a703-5798a25e7a73 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:20.492731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64a19b9c-60fc-44d3-a703-5798a25e7a73 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:20.493215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64a19b9c-60fc-44d3-a703-5798a25e7a73 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:20.493691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64a19b9c-60fc-44d3-a703-5798a25e7a73 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:20.678772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-64a19b9c-60fc-44d3-a703-5798a25e7a73 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:20.690990 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-64a19b9c-60fc-44d3-a703-5798a25e7a73 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3" status: 200 len: 1673 microversion: 2.1 time: 0.213205 Sep 07 13:28:20.691974 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3257/6548] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:20 2022] GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3 => generated 1673 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:21.692965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-d4da84fe-2b68-4207-ad84-55b85a2de8bc req-dc6493b1-f9eb-4e3b-9de6-11ae81cae40e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b030e3a-49f7-4481-98a9-878906e601b3", "name": "network-vif-deleted", "tag": "ca58990c-3b83-44e8-ba92-86108fc9cd2f"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:28:21.704568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d4da84fe-2b68-4207-ad84-55b85a2de8bc req-dc6493b1-f9eb-4e3b-9de6-11ae81cae40e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:21.705069 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d4da84fe-2b68-4207-ad84-55b85a2de8bc req-dc6493b1-f9eb-4e3b-9de6-11ae81cae40e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:21.705550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d4da84fe-2b68-4207-ad84-55b85a2de8bc req-dc6493b1-f9eb-4e3b-9de6-11ae81cae40e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:21.728502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ea1bfdb7-c254-4c02-ad7e-b9d86d5c964a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:21.729533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ea1bfdb7-c254-4c02-ad7e-b9d86d5c964a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 4b030e3a-49f7-4481-98a9-878906e601b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:21.737953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea1bfdb7-c254-4c02-ad7e-b9d86d5c964a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:21.738646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea1bfdb7-c254-4c02-ad7e-b9d86d5c964a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:21.739088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea1bfdb7-c254-4c02-ad7e-b9d86d5c964a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:21.739812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea1bfdb7-c254-4c02-ad7e-b9d86d5c964a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:21.740535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea1bfdb7-c254-4c02-ad7e-b9d86d5c964a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:21.740968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ea1bfdb7-c254-4c02-ad7e-b9d86d5c964a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:21.824050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ea1bfdb7-c254-4c02-ad7e-b9d86d5c964a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:21.833439 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ea1bfdb7-c254-4c02-ad7e-b9d86d5c964a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3" status: 200 len: 1334 microversion: 2.1 time: 0.119651 Sep 07 13:28:21.834866 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3258/6549] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:21 2022] GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3 => generated 1334 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:21.995869 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-d4da84fe-2b68-4207-ad84-55b85a2de8bc req-dc6493b1-f9eb-4e3b-9de6-11ae81cae40e service nova] Creating event network-vif-deleted:ca58990c-3b83-44e8-ba92-86108fc9cd2f for instance 4b030e3a-49f7-4481-98a9-878906e601b3 on n-h1-852087-9 Sep 07 13:28:22.002017 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-d4da84fe-2b68-4207-ad84-55b85a2de8bc req-dc6493b1-f9eb-4e3b-9de6-11ae81cae40e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.312339 Sep 07 13:28:22.003111 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3292/6550] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:28:22.856901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3e2ff826-c4fb-4e5b-8956-01fac866651b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:22.857571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3e2ff826-c4fb-4e5b-8956-01fac866651b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 4b030e3a-49f7-4481-98a9-878906e601b3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:22.870550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e2ff826-c4fb-4e5b-8956-01fac866651b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:22.871456 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e2ff826-c4fb-4e5b-8956-01fac866651b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:22.872264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e2ff826-c4fb-4e5b-8956-01fac866651b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:22.873525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e2ff826-c4fb-4e5b-8956-01fac866651b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:22.874550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e2ff826-c4fb-4e5b-8956-01fac866651b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:22.875343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3e2ff826-c4fb-4e5b-8956-01fac866651b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:22.896005 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-3e2ff826-c4fb-4e5b-8956-01fac866651b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] HTTP exception thrown: Instance 4b030e3a-49f7-4481-98a9-878906e601b3 could not be found. Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3e2ff826-c4fb-4e5b-8956-01fac866651b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Request method failure captured: Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3 HTTP/1.1 Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJu8nAGMibq2l4eAF7l5biF2p744erQn5M0V4SKZph7Wrzt-LbIbQka51QAnSR_58ciST0UDuAPBEX5SVse91Nhn7h7i2ynC5f2VK4N5DX2LGHbs_CoBAmNjXqjm6tb8EwVgkWv9bUN3aMjaCKCNJxOyxZM96187i0X1etOdgNlpoKw Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 2bbb0cc60bcc4538a2a7ba695efcf613 Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TestNetworkBasicOps-1540191208 Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2bbb0cc60bcc4538a2a7ba695efcf613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2bbb0cc60bcc4538a2a7ba695efcf613"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2bbb0cc60bcc4538a2a7ba695efcf613"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2bbb0cc60bcc4538a2a7ba695efcf613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TestNetworkBasicOps-1540191208 Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 2bbb0cc60bcc4538a2a7ba695efcf613 Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestNetworkBasicOps-1540191208 Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TestNetworkBasicOps-1540191208-project Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 3fc5e615495243fd8fe6541e6c828a45 Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TestNetworkBasicOps-1540191208-project Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 4b030e3a-49f7-4481-98a9-878906e601b3 could not be found. Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '4b030e3a-49f7-4481-98a9-878906e601b3'} Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b030e3a-49f7-4481-98a9-878906e601b3 could not be found. Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b030e3a-49f7-4481-98a9-878906e601b3 could not be found. Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:28:22.897788 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:28:22.903293 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:28:22.903293 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:28:22.903293 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:28:22.903293 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:28:22.903293 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:28:22.903293 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b030e3a-49f7-4481-98a9-878906e601b3 could not be found. Sep 07 13:28:22.903293 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:28:22.903293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3e2ff826-c4fb-4e5b-8956-01fac866651b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Returning 404 to user: Instance 4b030e3a-49f7-4481-98a9-878906e601b3 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:28:22.903293 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3e2ff826-c4fb-4e5b-8956-01fac866651b tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3" status: 404 len: 111 microversion: 2.1 time: 0.046631 Sep 07 13:28:22.903293 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3259/6551] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:22 2022] GET /compute/v2.1/servers/4b030e3a-49f7-4481-98a9-878906e601b3 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:28:23.083344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3eccc8c9-2316-44c4-8fd3-bbf8faa23e28 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '.version_select at 0x7fc413ea7700>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:23.125999 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3eccc8c9-2316-44c4-8fd3-bbf8faa23e28 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1647738040" status: 202 len: 0 microversion: 2.1 time: 0.048020 Sep 07 13:28:23.126593 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3293/6552] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Sep 7 13:28:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1647738040 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:28:32.288583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3306b616-954a-48f3-8def-cae363b656f6 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Action: 'create', calling method: .version_select at 0x7fc419212820>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1516964383", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTgLVOKHVlmC8Ay5kkEnP+I9/ZXJXAd0XlJULOuyb27ycQII3RTWGDvvOE82bdd+fTJ2FYQZoKcLwpgW1zKPtnB/i+KvEK812MRb87a0YJ9K/M6vX0ywZ+GZlWfZy7Tjw=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:28:32.319642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-3306b616-954a-48f3-8def-cae363b656f6 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Getting quotas for project 2bbb0cc60bcc4538a2a7ba695efcf613. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:28:32.327477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-3306b616-954a-48f3-8def-cae363b656f6 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Getting quotas for user 3fc5e615495243fd8fe6541e6c828a45 and project 2bbb0cc60bcc4538a2a7ba695efcf613. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:28:32.358681 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3306b616-954a-48f3-8def-cae363b656f6 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.081808 Sep 07 13:28:32.359882 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3260/6553] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 13:28:32 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:28:33.791689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c5afd584-7ba4-4f8e-a12a-cc47b0edb0fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-929433673", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "8c472ae5-93fd-4d0c-9894-58634e96d8dc"}], "key_name": "tempest-TestNetworkBasicOps-1516964383", "security_groups": [{"name": "tempest-secgroup-smoke-1706494090"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:28:33.803352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=64 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:33.804136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:33.974326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-c5afd584-7ba4-4f8e-a12a-cc47b0edb0fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] validate_networks() for [('8c472ae5-93fd-4d0c-9894-58634e96d8dc', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:28:34.496731 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c5afd584-7ba4-4f8e-a12a-cc47b0edb0fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:28:34.497566 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c5afd584-7ba4-4f8e-a12a-cc47b0edb0fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:28:34.498422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c5afd584-7ba4-4f8e-a12a-cc47b0edb0fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:28:34.499364 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c5afd584-7ba4-4f8e-a12a-cc47b0edb0fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:28:34.500120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-c5afd584-7ba4-4f8e-a12a-cc47b0edb0fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:28:34.512617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5afd584-7ba4-4f8e-a12a-cc47b0edb0fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:34.513183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5afd584-7ba4-4f8e-a12a-cc47b0edb0fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:34.514215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5afd584-7ba4-4f8e-a12a-cc47b0edb0fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:34.514557 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5afd584-7ba4-4f8e-a12a-cc47b0edb0fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:34.515079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5afd584-7ba4-4f8e-a12a-cc47b0edb0fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:34.515531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c5afd584-7ba4-4f8e-a12a-cc47b0edb0fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:34.540132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-c5afd584-7ba4-4f8e-a12a-cc47b0edb0fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Getting quotas for project 2bbb0cc60bcc4538a2a7ba695efcf613. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:28:34.549794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-c5afd584-7ba4-4f8e-a12a-cc47b0edb0fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Getting quotas for user 3fc5e615495243fd8fe6541e6c828a45 and project 2bbb0cc60bcc4538a2a7ba695efcf613. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:28:34.579808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c5afd584-7ba4-4f8e-a12a-cc47b0edb0fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:28:34.583226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c5afd584-7ba4-4f8e-a12a-cc47b0edb0fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:28:34.653264 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c5afd584-7ba4-4f8e-a12a-cc47b0edb0fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.865216 Sep 07 13:28:34.654465 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3294/6554] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:28:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:28:34.670908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5f9201a1-a36b-4e56-bd3f-176e963b6625 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:34.672061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5f9201a1-a36b-4e56-bd3f-176e963b6625 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:34.677600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:34.766077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5f9201a1-a36b-4e56-bd3f-176e963b6625 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:34.780034 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5f9201a1-a36b-4e56-bd3f-176e963b6625 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5" status: 200 len: 1248 microversion: 2.1 time: 0.116755 Sep 07 13:28:34.782155 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3261/6555] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:34 2022] GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 => generated 1248 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:35.807671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-073e8e27-4086-4681-848c-708f65af2e0d tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:35.808332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-073e8e27-4086-4681-848c-708f65af2e0d tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:35.816270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-073e8e27-4086-4681-848c-708f65af2e0d tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:35.816779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-073e8e27-4086-4681-848c-708f65af2e0d tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:35.817246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-073e8e27-4086-4681-848c-708f65af2e0d tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:35.818015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-073e8e27-4086-4681-848c-708f65af2e0d tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:35.818500 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-073e8e27-4086-4681-848c-708f65af2e0d tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:35.818954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-073e8e27-4086-4681-848c-708f65af2e0d tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:35.899767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-073e8e27-4086-4681-848c-708f65af2e0d tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:35.908171 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-073e8e27-4086-4681-848c-708f65af2e0d tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5" status: 200 len: 1300 microversion: 2.1 time: 0.106000 Sep 07 13:28:35.919462 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3295/6556] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:35 2022] GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 => generated 1300 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:36.520103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-06dd3202-05a9-4df2-bf96-cc394e5bcde6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:28:36.523991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-06dd3202-05a9-4df2-bf96-cc394e5bcde6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:36.533373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06dd3202-05a9-4df2-bf96-cc394e5bcde6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:36.533993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06dd3202-05a9-4df2-bf96-cc394e5bcde6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:36.534402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06dd3202-05a9-4df2-bf96-cc394e5bcde6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:36.535993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06dd3202-05a9-4df2-bf96-cc394e5bcde6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:36.535993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06dd3202-05a9-4df2-bf96-cc394e5bcde6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:36.535993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06dd3202-05a9-4df2-bf96-cc394e5bcde6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:36.609699 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-06dd3202-05a9-4df2-bf96-cc394e5bcde6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "POST /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d/action" status: 200 len: 24570 microversion: 2.1 time: 0.095880 Sep 07 13:28:36.610723 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3262/6557] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:28:36 2022] POST /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d/action => generated 24570 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:28:36.941231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-705cfe3b-cf2d-4654-9fe9-e17606c8aab4 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:36.942489 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-705cfe3b-cf2d-4654-9fe9-e17606c8aab4 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:36.957150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-705cfe3b-cf2d-4654-9fe9-e17606c8aab4 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:36.957989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-705cfe3b-cf2d-4654-9fe9-e17606c8aab4 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:36.958820 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-705cfe3b-cf2d-4654-9fe9-e17606c8aab4 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:36.961806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-705cfe3b-cf2d-4654-9fe9-e17606c8aab4 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:36.962630 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-705cfe3b-cf2d-4654-9fe9-e17606c8aab4 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:36.963270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-705cfe3b-cf2d-4654-9fe9-e17606c8aab4 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:37.273038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-705cfe3b-cf2d-4654-9fe9-e17606c8aab4 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:37.283830 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-705cfe3b-cf2d-4654-9fe9-e17606c8aab4 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5" status: 200 len: 1374 microversion: 2.1 time: 0.350479 Sep 07 13:28:37.284820 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3296/6558] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:36 2022] GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 => generated 1374 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:37.803233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-cd832842-ca7d-4452-8148-4293a630c152 req-7aa821b6-72f3-4019-b3f1-4061401fdc46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5", "tag": "2d22f316-bc9c-4580-bb41-a964a6fe27ce"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:28:37.815499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cd832842-ca7d-4452-8148-4293a630c152 req-7aa821b6-72f3-4019-b3f1-4061401fdc46 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:37.815923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cd832842-ca7d-4452-8148-4293a630c152 req-7aa821b6-72f3-4019-b3f1-4061401fdc46 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:37.816451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cd832842-ca7d-4452-8148-4293a630c152 req-7aa821b6-72f3-4019-b3f1-4061401fdc46 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:37.829529 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-cd832842-ca7d-4452-8148-4293a630c152 req-7aa821b6-72f3-4019-b3f1-4061401fdc46 service nova] Creating event network-changed:2d22f316-bc9c-4580-bb41-a964a6fe27ce for instance 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 on n-h1-852087-9 Sep 07 13:28:37.835371 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-cd832842-ca7d-4452-8148-4293a630c152 req-7aa821b6-72f3-4019-b3f1-4061401fdc46 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035938 Sep 07 13:28:37.835656 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3263/6559] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:28:38.318469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-46598e69-fbc0-41ae-b191-f4a782f01f3e tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:38.319385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-46598e69-fbc0-41ae-b191-f4a782f01f3e tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:38.328247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46598e69-fbc0-41ae-b191-f4a782f01f3e tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:38.328687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46598e69-fbc0-41ae-b191-f4a782f01f3e tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:38.329156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46598e69-fbc0-41ae-b191-f4a782f01f3e tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:38.329960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46598e69-fbc0-41ae-b191-f4a782f01f3e tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:38.330448 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46598e69-fbc0-41ae-b191-f4a782f01f3e tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:38.330901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46598e69-fbc0-41ae-b191-f4a782f01f3e tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:38.514673 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-46598e69-fbc0-41ae-b191-f4a782f01f3e tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:38.523834 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-46598e69-fbc0-41ae-b191-f4a782f01f3e tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5" status: 200 len: 1374 microversion: 2.1 time: 0.211081 Sep 07 13:28:38.524432 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3297/6560] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:38 2022] GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 => generated 1374 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:28:39.549645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-89830c55-aa49-4d69-85ca-d87809c6db3a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:39.550351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-89830c55-aa49-4d69-85ca-d87809c6db3a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:39.557118 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89830c55-aa49-4d69-85ca-d87809c6db3a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:39.557692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89830c55-aa49-4d69-85ca-d87809c6db3a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:39.558121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89830c55-aa49-4d69-85ca-d87809c6db3a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:39.558834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89830c55-aa49-4d69-85ca-d87809c6db3a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:39.559293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89830c55-aa49-4d69-85ca-d87809c6db3a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:39.559752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-89830c55-aa49-4d69-85ca-d87809c6db3a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:39.702427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-89830c55-aa49-4d69-85ca-d87809c6db3a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:39.710884 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-89830c55-aa49-4d69-85ca-d87809c6db3a tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5" status: 200 len: 1374 microversion: 2.1 time: 0.166474 Sep 07 13:28:39.711465 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3264/6561] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:39 2022] GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:40.751110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0cffc146-912c-4786-acf9-663237bb2426 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:40.760310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0cffc146-912c-4786-acf9-663237bb2426 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:40.781116 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cffc146-912c-4786-acf9-663237bb2426 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:40.781985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cffc146-912c-4786-acf9-663237bb2426 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:40.782555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cffc146-912c-4786-acf9-663237bb2426 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:40.783414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cffc146-912c-4786-acf9-663237bb2426 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:40.784021 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cffc146-912c-4786-acf9-663237bb2426 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:40.784570 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0cffc146-912c-4786-acf9-663237bb2426 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:41.056571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0cffc146-912c-4786-acf9-663237bb2426 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:41.070802 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0cffc146-912c-4786-acf9-663237bb2426 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5" status: 200 len: 1374 microversion: 2.1 time: 0.337263 Sep 07 13:28:41.076812 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3298/6562] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:40 2022] GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 => generated 1374 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:28:42.101990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b4c84a28-9ff6-4339-bbd8-fbd157b29bb2 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:42.102611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b4c84a28-9ff6-4339-bbd8-fbd157b29bb2 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:42.109265 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4c84a28-9ff6-4339-bbd8-fbd157b29bb2 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:42.109773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4c84a28-9ff6-4339-bbd8-fbd157b29bb2 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:42.110205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4c84a28-9ff6-4339-bbd8-fbd157b29bb2 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:42.111314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4c84a28-9ff6-4339-bbd8-fbd157b29bb2 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:42.111785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4c84a28-9ff6-4339-bbd8-fbd157b29bb2 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:42.112215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4c84a28-9ff6-4339-bbd8-fbd157b29bb2 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:42.261932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b4c84a28-9ff6-4339-bbd8-fbd157b29bb2 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:42.270218 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b4c84a28-9ff6-4339-bbd8-fbd157b29bb2 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5" status: 200 len: 1374 microversion: 2.1 time: 0.173445 Sep 07 13:28:42.271148 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3265/6563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:42 2022] GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:43.294124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-05355567-7ede-4c54-84ae-91ca5bb78710 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:43.294779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-05355567-7ede-4c54-84ae-91ca5bb78710 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:43.303118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05355567-7ede-4c54-84ae-91ca5bb78710 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:43.303627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05355567-7ede-4c54-84ae-91ca5bb78710 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:43.304123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05355567-7ede-4c54-84ae-91ca5bb78710 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:43.304853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05355567-7ede-4c54-84ae-91ca5bb78710 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:43.305340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05355567-7ede-4c54-84ae-91ca5bb78710 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:43.305834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-05355567-7ede-4c54-84ae-91ca5bb78710 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:43.451575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-05355567-7ede-4c54-84ae-91ca5bb78710 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:43.460290 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-05355567-7ede-4c54-84ae-91ca5bb78710 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5" status: 200 len: 1374 microversion: 2.1 time: 0.170289 Sep 07 13:28:43.460913 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3299/6564] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:43 2022] GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:43.967240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-dc838001-a7ff-4134-8b88-3f02c2d98557 req-b4024dab-e88e-4115-9a63-6f8bef2e9308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5", "name": "network-vif-plugged", "status": "completed", "tag": "2d22f316-bc9c-4580-bb41-a964a6fe27ce"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:28:43.979273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dc838001-a7ff-4134-8b88-3f02c2d98557 req-b4024dab-e88e-4115-9a63-6f8bef2e9308 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:43.979674 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dc838001-a7ff-4134-8b88-3f02c2d98557 req-b4024dab-e88e-4115-9a63-6f8bef2e9308 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:43.980214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-dc838001-a7ff-4134-8b88-3f02c2d98557 req-b4024dab-e88e-4115-9a63-6f8bef2e9308 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:43.996296 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-dc838001-a7ff-4134-8b88-3f02c2d98557 req-b4024dab-e88e-4115-9a63-6f8bef2e9308 service nova] Creating event network-vif-plugged:2d22f316-bc9c-4580-bb41-a964a6fe27ce for instance 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 on n-h1-852087-9 Sep 07 13:28:44.001858 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-dc838001-a7ff-4134-8b88-3f02c2d98557 req-b4024dab-e88e-4115-9a63-6f8bef2e9308 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038976 Sep 07 13:28:44.002809 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3266/6565] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:28:44.498719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-657c3934-812d-46e5-8438-c6175e2d2424 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:44.499554 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-657c3934-812d-46e5-8438-c6175e2d2424 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:44.508817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-657c3934-812d-46e5-8438-c6175e2d2424 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:44.509428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-657c3934-812d-46e5-8438-c6175e2d2424 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:44.509981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-657c3934-812d-46e5-8438-c6175e2d2424 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:44.510882 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-657c3934-812d-46e5-8438-c6175e2d2424 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:44.511432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-657c3934-812d-46e5-8438-c6175e2d2424 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:44.511986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-657c3934-812d-46e5-8438-c6175e2d2424 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:44.531899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:44.562576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:44.665772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-657c3934-812d-46e5-8438-c6175e2d2424 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:44.675063 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-657c3934-812d-46e5-8438-c6175e2d2424 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5" status: 200 len: 1374 microversion: 2.1 time: 0.181297 Sep 07 13:28:44.675604 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3300/6566] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:44 2022] GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:45.696797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:45.703089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3d6effee-5283-4300-b8e9-f6f84603f293 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:45.703953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3d6effee-5283-4300-b8e9-f6f84603f293 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:45.711307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d6effee-5283-4300-b8e9-f6f84603f293 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:45.711953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d6effee-5283-4300-b8e9-f6f84603f293 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:45.712625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d6effee-5283-4300-b8e9-f6f84603f293 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:45.713519 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d6effee-5283-4300-b8e9-f6f84603f293 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:45.714007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d6effee-5283-4300-b8e9-f6f84603f293 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:45.714477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d6effee-5283-4300-b8e9-f6f84603f293 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:45.892833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3d6effee-5283-4300-b8e9-f6f84603f293 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:45.901852 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3d6effee-5283-4300-b8e9-f6f84603f293 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5" status: 200 len: 1545 microversion: 2.1 time: 0.206802 Sep 07 13:28:45.902498 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3267/6567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:45 2022] GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 => generated 1545 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:45.927047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7600e0c9-0dbf-458d-bab2-e753305406f9 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:45.927713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7600e0c9-0dbf-458d-bab2-e753305406f9 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:45.934998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7600e0c9-0dbf-458d-bab2-e753305406f9 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:45.935507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7600e0c9-0dbf-458d-bab2-e753305406f9 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:45.936123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7600e0c9-0dbf-458d-bab2-e753305406f9 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:45.936906 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7600e0c9-0dbf-458d-bab2-e753305406f9 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:45.937351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7600e0c9-0dbf-458d-bab2-e753305406f9 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:45.937827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7600e0c9-0dbf-458d-bab2-e753305406f9 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:46.104436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7600e0c9-0dbf-458d-bab2-e753305406f9 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:46.113081 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7600e0c9-0dbf-458d-bab2-e753305406f9 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5" status: 200 len: 1545 microversion: 2.1 time: 0.190263 Sep 07 13:28:46.113717 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3301/6568] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:45 2022] GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 => generated 1545 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:47.678983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fc40d956-d342-44b6-9922-6af73d030022 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:28:47.682175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fc40d956-d342-44b6-9922-6af73d030022 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:47.691070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc40d956-d342-44b6-9922-6af73d030022 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:47.691563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc40d956-d342-44b6-9922-6af73d030022 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:47.692005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc40d956-d342-44b6-9922-6af73d030022 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:47.692907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc40d956-d342-44b6-9922-6af73d030022 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:47.693368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc40d956-d342-44b6-9922-6af73d030022 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:47.693865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc40d956-d342-44b6-9922-6af73d030022 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:47.791036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fc40d956-d342-44b6-9922-6af73d030022 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:28:47.791806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fc40d956-d342-44b6-9922-6af73d030022 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:28:47.792301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fc40d956-d342-44b6-9922-6af73d030022 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:28:47.792695 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fc40d956-d342-44b6-9922-6af73d030022 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:28:47.793120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fc40d956-d342-44b6-9922-6af73d030022 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:28:47.863258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fc40d956-d342-44b6-9922-6af73d030022 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:47.872611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc40d956-d342-44b6-9922-6af73d030022 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:47.873182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc40d956-d342-44b6-9922-6af73d030022 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:47.874017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc40d956-d342-44b6-9922-6af73d030022 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:47.874594 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc40d956-d342-44b6-9922-6af73d030022 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:47.875101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc40d956-d342-44b6-9922-6af73d030022 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:47.875514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc40d956-d342-44b6-9922-6af73d030022 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:47.925539 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fc40d956-d342-44b6-9922-6af73d030022 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "POST /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d/action" status: 202 len: 1136 microversion: 2.1 time: 0.250623 Sep 07 13:28:47.926307 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3268/6569] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:28:47 2022] POST /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d/action => generated 1136 bytes in 252 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Sep 07 13:28:47.946292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ff82dd34-a2c6-41ae-8f0d-376f1bd11c01 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:47.947067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ff82dd34-a2c6-41ae-8f0d-376f1bd11c01 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:47.954977 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff82dd34-a2c6-41ae-8f0d-376f1bd11c01 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:47.955620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff82dd34-a2c6-41ae-8f0d-376f1bd11c01 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:47.956543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff82dd34-a2c6-41ae-8f0d-376f1bd11c01 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:47.957281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff82dd34-a2c6-41ae-8f0d-376f1bd11c01 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:47.958000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff82dd34-a2c6-41ae-8f0d-376f1bd11c01 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:47.958556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff82dd34-a2c6-41ae-8f0d-376f1bd11c01 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:48.162882 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ff82dd34-a2c6-41ae-8f0d-376f1bd11c01 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:48.173564 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ff82dd34-a2c6-41ae-8f0d-376f1bd11c01 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1689 microversion: 2.1 time: 0.231147 Sep 07 13:28:48.174176 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3302/6570] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:47 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1689 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:48.559456 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c3a3105c-4005-4fd2-8c76-e86b36283061 req-031402b0-e10c-4ad5-b50d-ceb7884138e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5", "tag": "2d22f316-bc9c-4580-bb41-a964a6fe27ce"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:28:48.571835 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c3a3105c-4005-4fd2-8c76-e86b36283061 req-031402b0-e10c-4ad5-b50d-ceb7884138e4 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:48.571835 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c3a3105c-4005-4fd2-8c76-e86b36283061 req-031402b0-e10c-4ad5-b50d-ceb7884138e4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:48.572291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c3a3105c-4005-4fd2-8c76-e86b36283061 req-031402b0-e10c-4ad5-b50d-ceb7884138e4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:48.585725 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-c3a3105c-4005-4fd2-8c76-e86b36283061 req-031402b0-e10c-4ad5-b50d-ceb7884138e4 service nova] Creating event network-changed:2d22f316-bc9c-4580-bb41-a964a6fe27ce for instance 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 on n-h1-852087-9 Sep 07 13:28:48.592199 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c3a3105c-4005-4fd2-8c76-e86b36283061 req-031402b0-e10c-4ad5-b50d-ceb7884138e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036261 Sep 07 13:28:48.597293 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3269/6571] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:28:49.196337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1befa71e-2030-4015-a19b-5637db362441 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:49.196980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1befa71e-2030-4015-a19b-5637db362441 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:49.204267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1befa71e-2030-4015-a19b-5637db362441 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:49.204831 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1befa71e-2030-4015-a19b-5637db362441 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:49.205464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1befa71e-2030-4015-a19b-5637db362441 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:49.206471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1befa71e-2030-4015-a19b-5637db362441 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:49.207109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1befa71e-2030-4015-a19b-5637db362441 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:49.207742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1befa71e-2030-4015-a19b-5637db362441 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:49.426483 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1befa71e-2030-4015-a19b-5637db362441 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:49.435349 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1befa71e-2030-4015-a19b-5637db362441 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1689 microversion: 2.1 time: 0.242928 Sep 07 13:28:49.436301 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3303/6572] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:49 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1689 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:50.463917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c68a532e-05c8-4b55-9f03-05d0b92cb651 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:50.464911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c68a532e-05c8-4b55-9f03-05d0b92cb651 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:50.468510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:50.476307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c68a532e-05c8-4b55-9f03-05d0b92cb651 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:50.477081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c68a532e-05c8-4b55-9f03-05d0b92cb651 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:50.477729 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c68a532e-05c8-4b55-9f03-05d0b92cb651 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:50.478571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c68a532e-05c8-4b55-9f03-05d0b92cb651 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:50.479109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c68a532e-05c8-4b55-9f03-05d0b92cb651 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:50.479586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c68a532e-05c8-4b55-9f03-05d0b92cb651 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:50.647834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c68a532e-05c8-4b55-9f03-05d0b92cb651 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:50.656509 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c68a532e-05c8-4b55-9f03-05d0b92cb651 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1689 microversion: 2.1 time: 0.197674 Sep 07 13:28:50.657125 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3270/6573] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:50 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1689 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:51.696619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c7a92497-7126-42bb-a0e7-c24518bc59ba tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:51.697263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c7a92497-7126-42bb-a0e7-c24518bc59ba tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:51.705055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7a92497-7126-42bb-a0e7-c24518bc59ba tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:51.705641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7a92497-7126-42bb-a0e7-c24518bc59ba tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:51.706109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7a92497-7126-42bb-a0e7-c24518bc59ba tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:51.706870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7a92497-7126-42bb-a0e7-c24518bc59ba tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:51.707356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7a92497-7126-42bb-a0e7-c24518bc59ba tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:51.707815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7a92497-7126-42bb-a0e7-c24518bc59ba tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:51.865173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c7a92497-7126-42bb-a0e7-c24518bc59ba tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:51.879297 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c7a92497-7126-42bb-a0e7-c24518bc59ba tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1689 microversion: 2.1 time: 0.186197 Sep 07 13:28:51.880400 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3304/6574] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:51 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1689 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:52.918892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-39e15315-3e58-433a-b534-048ee0707782 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:52.919943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-39e15315-3e58-433a-b534-048ee0707782 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:52.929020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39e15315-3e58-433a-b534-048ee0707782 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:52.929607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39e15315-3e58-433a-b534-048ee0707782 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:52.930117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39e15315-3e58-433a-b534-048ee0707782 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:52.930897 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39e15315-3e58-433a-b534-048ee0707782 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:52.931350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39e15315-3e58-433a-b534-048ee0707782 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:52.931831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39e15315-3e58-433a-b534-048ee0707782 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:53.090220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-39e15315-3e58-433a-b534-048ee0707782 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:53.099481 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-39e15315-3e58-433a-b534-048ee0707782 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1689 microversion: 2.1 time: 0.184605 Sep 07 13:28:53.100135 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3271/6575] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:52 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1689 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:54.127186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-758b1034-ac90-4667-a96c-821f52a3fa69 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:54.128376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-758b1034-ac90-4667-a96c-821f52a3fa69 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:54.137571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-758b1034-ac90-4667-a96c-821f52a3fa69 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:54.138119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-758b1034-ac90-4667-a96c-821f52a3fa69 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:54.138618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-758b1034-ac90-4667-a96c-821f52a3fa69 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:54.139521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-758b1034-ac90-4667-a96c-821f52a3fa69 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:54.140007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-758b1034-ac90-4667-a96c-821f52a3fa69 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:54.140523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-758b1034-ac90-4667-a96c-821f52a3fa69 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:54.296152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-758b1034-ac90-4667-a96c-821f52a3fa69 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:54.309119 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-758b1034-ac90-4667-a96c-821f52a3fa69 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1689 microversion: 2.1 time: 0.187921 Sep 07 13:28:54.310218 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3305/6576] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:54 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1689 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:55.334189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-31cdd778-1161-4bb9-b48e-129630718a30 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:55.334743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-31cdd778-1161-4bb9-b48e-129630718a30 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:55.342742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31cdd778-1161-4bb9-b48e-129630718a30 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:55.343237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31cdd778-1161-4bb9-b48e-129630718a30 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:55.343804 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31cdd778-1161-4bb9-b48e-129630718a30 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:55.344381 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31cdd778-1161-4bb9-b48e-129630718a30 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:55.344864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31cdd778-1161-4bb9-b48e-129630718a30 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:55.346005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31cdd778-1161-4bb9-b48e-129630718a30 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:55.502756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-31cdd778-1161-4bb9-b48e-129630718a30 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:55.517997 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-31cdd778-1161-4bb9-b48e-129630718a30 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1689 microversion: 2.1 time: 0.188571 Sep 07 13:28:55.519267 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3272/6577] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:55 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1689 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:56.542809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-da93b243-146d-4e47-8eed-dc950768e74a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:56.543430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-da93b243-146d-4e47-8eed-dc950768e74a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:56.551340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da93b243-146d-4e47-8eed-dc950768e74a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:56.551893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da93b243-146d-4e47-8eed-dc950768e74a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:56.552455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da93b243-146d-4e47-8eed-dc950768e74a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:56.553189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da93b243-146d-4e47-8eed-dc950768e74a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:56.553711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da93b243-146d-4e47-8eed-dc950768e74a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:56.554164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-da93b243-146d-4e47-8eed-dc950768e74a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:56.698243 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-da93b243-146d-4e47-8eed-dc950768e74a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:56.707218 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-da93b243-146d-4e47-8eed-dc950768e74a tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1689 microversion: 2.1 time: 0.168462 Sep 07 13:28:56.707807 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3306/6578] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:56 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:57.837505 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8d97e2d3-589c-4693-bbca-dbe3810b064f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:57.838208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8d97e2d3-589c-4693-bbca-dbe3810b064f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:57.845379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d97e2d3-589c-4693-bbca-dbe3810b064f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:57.846042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d97e2d3-589c-4693-bbca-dbe3810b064f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:57.846492 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d97e2d3-589c-4693-bbca-dbe3810b064f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:57.847229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d97e2d3-589c-4693-bbca-dbe3810b064f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:57.847713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d97e2d3-589c-4693-bbca-dbe3810b064f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:57.848267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d97e2d3-589c-4693-bbca-dbe3810b064f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:57.999232 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8d97e2d3-589c-4693-bbca-dbe3810b064f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:58.010129 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8d97e2d3-589c-4693-bbca-dbe3810b064f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1689 microversion: 2.1 time: 0.281894 Sep 07 13:28:58.010733 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3273/6579] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:57 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1689 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:28:59.033670 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fef989da-9b13-4899-9b6c-d1accea36230 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:28:59.034308 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fef989da-9b13-4899-9b6c-d1accea36230 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:28:59.041937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fef989da-9b13-4899-9b6c-d1accea36230 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:59.042462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fef989da-9b13-4899-9b6c-d1accea36230 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:59.042924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fef989da-9b13-4899-9b6c-d1accea36230 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:59.043672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fef989da-9b13-4899-9b6c-d1accea36230 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:28:59.044170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fef989da-9b13-4899-9b6c-d1accea36230 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:28:59.044644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fef989da-9b13-4899-9b6c-d1accea36230 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:28:59.210881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fef989da-9b13-4899-9b6c-d1accea36230 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:28:59.219749 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fef989da-9b13-4899-9b6c-d1accea36230 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1689 microversion: 2.1 time: 0.190104 Sep 07 13:28:59.220337 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3307/6580] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:28:59 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1689 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:00.247479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-00138a26-0cba-4732-b1a1-31c4aad902b3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:00.248287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-00138a26-0cba-4732-b1a1-31c4aad902b3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:00.255717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00138a26-0cba-4732-b1a1-31c4aad902b3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:00.256205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00138a26-0cba-4732-b1a1-31c4aad902b3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:00.256647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00138a26-0cba-4732-b1a1-31c4aad902b3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:00.257338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00138a26-0cba-4732-b1a1-31c4aad902b3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:00.257826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00138a26-0cba-4732-b1a1-31c4aad902b3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:00.258252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-00138a26-0cba-4732-b1a1-31c4aad902b3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:00.411210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-00138a26-0cba-4732-b1a1-31c4aad902b3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:00.421088 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-00138a26-0cba-4732-b1a1-31c4aad902b3 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1689 microversion: 2.1 time: 0.180359 Sep 07 13:29:00.421757 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3274/6581] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:00 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1689 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:01.448505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b387c7cc-00f1-4d4a-93ff-f3fc99dbec1f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:01.449376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b387c7cc-00f1-4d4a-93ff-f3fc99dbec1f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:01.457969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b387c7cc-00f1-4d4a-93ff-f3fc99dbec1f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:01.458488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b387c7cc-00f1-4d4a-93ff-f3fc99dbec1f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:01.458949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b387c7cc-00f1-4d4a-93ff-f3fc99dbec1f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:01.459678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b387c7cc-00f1-4d4a-93ff-f3fc99dbec1f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:01.460153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b387c7cc-00f1-4d4a-93ff-f3fc99dbec1f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:01.460607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b387c7cc-00f1-4d4a-93ff-f3fc99dbec1f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:01.908524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b387c7cc-00f1-4d4a-93ff-f3fc99dbec1f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:01.916911 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b387c7cc-00f1-4d4a-93ff-f3fc99dbec1f tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1689 microversion: 2.1 time: 0.474847 Sep 07 13:29:01.917513 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3308/6582] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:01 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1689 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:02.940665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6b7eb4ae-6450-4824-9e8f-222b14d3e5c9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:02.941246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6b7eb4ae-6450-4824-9e8f-222b14d3e5c9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:02.948812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b7eb4ae-6450-4824-9e8f-222b14d3e5c9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:02.949307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b7eb4ae-6450-4824-9e8f-222b14d3e5c9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:02.949789 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b7eb4ae-6450-4824-9e8f-222b14d3e5c9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:02.950487 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b7eb4ae-6450-4824-9e8f-222b14d3e5c9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:02.950943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b7eb4ae-6450-4824-9e8f-222b14d3e5c9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:02.951372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6b7eb4ae-6450-4824-9e8f-222b14d3e5c9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:03.097422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6b7eb4ae-6450-4824-9e8f-222b14d3e5c9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:03.108816 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6b7eb4ae-6450-4824-9e8f-222b14d3e5c9 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1689 microversion: 2.1 time: 0.172156 Sep 07 13:29:03.109398 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3275/6583] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:02 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:03.895978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9a192970-d709-4fd0-96b7-5bc1b2f9e87d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:03.896663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9a192970-d709-4fd0-96b7-5bc1b2f9e87d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:03.899572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:03.908570 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a192970-d709-4fd0-96b7-5bc1b2f9e87d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:03.909156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a192970-d709-4fd0-96b7-5bc1b2f9e87d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:03.909655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a192970-d709-4fd0-96b7-5bc1b2f9e87d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:03.910410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a192970-d709-4fd0-96b7-5bc1b2f9e87d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:03.910867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a192970-d709-4fd0-96b7-5bc1b2f9e87d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:03.911332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9a192970-d709-4fd0-96b7-5bc1b2f9e87d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:03.916198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=87 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:03.944626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9a192970-d709-4fd0-96b7-5bc1b2f9e87d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:29:04.033162 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9a192970-d709-4fd0-96b7-5bc1b2f9e87d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 204 len: 0 microversion: 2.1 time: 0.142394 Sep 07 13:29:04.033962 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3309/6584] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:29:03 2022] DELETE /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:29:04.042999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-75d07083-c6bc-497e-a65f-21d5e6fc2cdc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:04.043625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-75d07083-c6bc-497e-a65f-21d5e6fc2cdc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:04.051296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75d07083-c6bc-497e-a65f-21d5e6fc2cdc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:04.051947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75d07083-c6bc-497e-a65f-21d5e6fc2cdc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:04.052398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75d07083-c6bc-497e-a65f-21d5e6fc2cdc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:04.053121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75d07083-c6bc-497e-a65f-21d5e6fc2cdc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:04.053618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75d07083-c6bc-497e-a65f-21d5e6fc2cdc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:04.054055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75d07083-c6bc-497e-a65f-21d5e6fc2cdc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:04.136449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c69e4cbc-9f5b-45ab-85ab-615bd0cc560c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:04.137906 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c69e4cbc-9f5b-45ab-85ab-615bd0cc560c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:04.147514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c69e4cbc-9f5b-45ab-85ab-615bd0cc560c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:04.148261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c69e4cbc-9f5b-45ab-85ab-615bd0cc560c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:04.148929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c69e4cbc-9f5b-45ab-85ab-615bd0cc560c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:04.150116 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c69e4cbc-9f5b-45ab-85ab-615bd0cc560c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:04.150830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c69e4cbc-9f5b-45ab-85ab-615bd0cc560c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:04.151484 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c69e4cbc-9f5b-45ab-85ab-615bd0cc560c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:04.246758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-75d07083-c6bc-497e-a65f-21d5e6fc2cdc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:04.259605 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-75d07083-c6bc-497e-a65f-21d5e6fc2cdc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 200 len: 1576 microversion: 2.1 time: 0.220584 Sep 07 13:29:04.260206 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3276/6585] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:04 2022] GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 1576 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:04.319522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c69e4cbc-9f5b-45ab-85ab-615bd0cc560c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:04.327883 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c69e4cbc-9f5b-45ab-85ab-615bd0cc560c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1689 microversion: 2.1 time: 0.198821 Sep 07 13:29:04.328495 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3310/6586] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:04 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1689 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:29:05.284080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3d242d35-7870-45e4-9444-201232c6c9e0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:05.284809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3d242d35-7870-45e4-9444-201232c6c9e0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:05.292696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d242d35-7870-45e4-9444-201232c6c9e0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:05.293185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d242d35-7870-45e4-9444-201232c6c9e0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:05.293670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d242d35-7870-45e4-9444-201232c6c9e0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:05.294414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d242d35-7870-45e4-9444-201232c6c9e0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:05.294883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d242d35-7870-45e4-9444-201232c6c9e0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:05.295410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d242d35-7870-45e4-9444-201232c6c9e0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:05.298595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:05.353931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-361f93f9-fada-43d2-a036-f00f16b1333c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:05.354697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-361f93f9-fada-43d2-a036-f00f16b1333c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:05.362204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361f93f9-fada-43d2-a036-f00f16b1333c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:05.362715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361f93f9-fada-43d2-a036-f00f16b1333c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:05.363177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361f93f9-fada-43d2-a036-f00f16b1333c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:05.364135 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361f93f9-fada-43d2-a036-f00f16b1333c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:05.364613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361f93f9-fada-43d2-a036-f00f16b1333c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:05.365054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-361f93f9-fada-43d2-a036-f00f16b1333c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:05.498098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3d242d35-7870-45e4-9444-201232c6c9e0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:05.510885 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3d242d35-7870-45e4-9444-201232c6c9e0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 200 len: 1576 microversion: 2.1 time: 0.231071 Sep 07 13:29:05.511514 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3277/6587] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:05 2022] GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 1576 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:05.540931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-361f93f9-fada-43d2-a036-f00f16b1333c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:05.553233 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-361f93f9-fada-43d2-a036-f00f16b1333c tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1689 microversion: 2.1 time: 0.205107 Sep 07 13:29:05.556536 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3311/6588] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:05 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1689 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:29:06.544999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0c575898-9953-42e5-89bf-836f7d47f714 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:06.545880 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0c575898-9953-42e5-89bf-836f7d47f714 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:06.554142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c575898-9953-42e5-89bf-836f7d47f714 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:06.554573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c575898-9953-42e5-89bf-836f7d47f714 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:06.555020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c575898-9953-42e5-89bf-836f7d47f714 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:06.558243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c575898-9953-42e5-89bf-836f7d47f714 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:06.558243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c575898-9953-42e5-89bf-836f7d47f714 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:06.558243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0c575898-9953-42e5-89bf-836f7d47f714 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:06.580410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f39e6d8e-9f6d-4d7d-b981-6afacdf4c479 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:06.581124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f39e6d8e-9f6d-4d7d-b981-6afacdf4c479 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:06.588668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f39e6d8e-9f6d-4d7d-b981-6afacdf4c479 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:06.589176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f39e6d8e-9f6d-4d7d-b981-6afacdf4c479 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:06.590674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f39e6d8e-9f6d-4d7d-b981-6afacdf4c479 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:06.590845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f39e6d8e-9f6d-4d7d-b981-6afacdf4c479 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:06.591385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f39e6d8e-9f6d-4d7d-b981-6afacdf4c479 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:06.592035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f39e6d8e-9f6d-4d7d-b981-6afacdf4c479 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:06.771796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0c575898-9953-42e5-89bf-836f7d47f714 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:06.782021 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0c575898-9953-42e5-89bf-836f7d47f714 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 200 len: 1576 microversion: 2.1 time: 0.240917 Sep 07 13:29:06.782632 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3278/6589] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:06 2022] GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 1576 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:06.807366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f39e6d8e-9f6d-4d7d-b981-6afacdf4c479 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:06.817198 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f39e6d8e-9f6d-4d7d-b981-6afacdf4c479 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1707 microversion: 2.1 time: 0.240801 Sep 07 13:29:06.820251 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3312/6590] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:06 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1707 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:07.806540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f9d6455f-852b-4447-bffb-af807e050ca0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:07.807132 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f9d6455f-852b-4447-bffb-af807e050ca0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:07.814957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9d6455f-852b-4447-bffb-af807e050ca0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:07.815437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9d6455f-852b-4447-bffb-af807e050ca0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:07.815909 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9d6455f-852b-4447-bffb-af807e050ca0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:07.816603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9d6455f-852b-4447-bffb-af807e050ca0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:07.817059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9d6455f-852b-4447-bffb-af807e050ca0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:07.817471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9d6455f-852b-4447-bffb-af807e050ca0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:07.843904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-90fca87e-2bec-4810-9203-02b2dd2da700 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:07.844455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-90fca87e-2bec-4810-9203-02b2dd2da700 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:07.852536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90fca87e-2bec-4810-9203-02b2dd2da700 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:07.853174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90fca87e-2bec-4810-9203-02b2dd2da700 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:07.853939 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90fca87e-2bec-4810-9203-02b2dd2da700 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:07.854786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90fca87e-2bec-4810-9203-02b2dd2da700 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:07.855412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90fca87e-2bec-4810-9203-02b2dd2da700 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:07.855951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-90fca87e-2bec-4810-9203-02b2dd2da700 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:07.911977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f9d6455f-852b-4447-bffb-af807e050ca0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:07.961157 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f9d6455f-852b-4447-bffb-af807e050ca0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 200 len: 1509 microversion: 2.1 time: 0.158378 Sep 07 13:29:07.977522 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3279/6591] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:07 2022] GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:07.977522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d84f8eaa-b202-4a78-8e82-8fe51e9456a3 req-f85cebd8-f343-442b-97b6-a4bc100ca822 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9124e17-08d2-4641-b390-b43169aa6ca7", "name": "network-vif-deleted", "tag": "56438486-fc55-406d-b77c-4295da73e413"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:29:07.986071 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d84f8eaa-b202-4a78-8e82-8fe51e9456a3 req-f85cebd8-f343-442b-97b6-a4bc100ca822 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:07.986962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d84f8eaa-b202-4a78-8e82-8fe51e9456a3 req-f85cebd8-f343-442b-97b6-a4bc100ca822 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:07.987146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d84f8eaa-b202-4a78-8e82-8fe51e9456a3 req-f85cebd8-f343-442b-97b6-a4bc100ca822 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:08.013806 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d84f8eaa-b202-4a78-8e82-8fe51e9456a3 req-f85cebd8-f343-442b-97b6-a4bc100ca822 service nova] Creating event network-vif-deleted:56438486-fc55-406d-b77c-4295da73e413 for instance b9124e17-08d2-4641-b390-b43169aa6ca7 on n-h2-852087-9 Sep 07 13:29:08.023122 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d84f8eaa-b202-4a78-8e82-8fe51e9456a3 req-f85cebd8-f343-442b-97b6-a4bc100ca822 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058932 Sep 07 13:29:08.024597 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3280/6592] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:29:08.085221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-90fca87e-2bec-4810-9203-02b2dd2da700 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:08.095363 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-90fca87e-2bec-4810-9203-02b2dd2da700 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1695 microversion: 2.1 time: 0.256123 Sep 07 13:29:08.100863 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3313/6593] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:07 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1695 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:08.989761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-722d385c-f863-4b40-b2f1-9ca3b209c45a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:08.991372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-722d385c-f863-4b40-b2f1-9ca3b209c45a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:09.000170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-722d385c-f863-4b40-b2f1-9ca3b209c45a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:09.001029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-722d385c-f863-4b40-b2f1-9ca3b209c45a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:09.001814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-722d385c-f863-4b40-b2f1-9ca3b209c45a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:09.002757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-722d385c-f863-4b40-b2f1-9ca3b209c45a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:09.003430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-722d385c-f863-4b40-b2f1-9ca3b209c45a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:09.004028 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-722d385c-f863-4b40-b2f1-9ca3b209c45a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:09.120113 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2146851b-0fa3-40a6-b303-eaf18cf7f442 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:09.122816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2146851b-0fa3-40a6-b303-eaf18cf7f442 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:09.136296 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2146851b-0fa3-40a6-b303-eaf18cf7f442 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:09.137305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2146851b-0fa3-40a6-b303-eaf18cf7f442 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:09.138034 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2146851b-0fa3-40a6-b303-eaf18cf7f442 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:09.139714 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2146851b-0fa3-40a6-b303-eaf18cf7f442 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:09.142563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2146851b-0fa3-40a6-b303-eaf18cf7f442 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:09.143897 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2146851b-0fa3-40a6-b303-eaf18cf7f442 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:09.163672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-722d385c-f863-4b40-b2f1-9ca3b209c45a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:09.172664 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-722d385c-f863-4b40-b2f1-9ca3b209c45a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 200 len: 1225 microversion: 2.1 time: 0.189566 Sep 07 13:29:09.173670 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3281/6594] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:08 2022] GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 1225 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:09.437091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2146851b-0fa3-40a6-b303-eaf18cf7f442 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:09.447119 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2146851b-0fa3-40a6-b303-eaf18cf7f442 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1695 microversion: 2.1 time: 0.330718 Sep 07 13:29:09.448046 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3314/6595] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:09 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1695 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:29:10.220749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-377ab70b-efcd-4462-8017-0d8d0e249fc5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:10.221541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-377ab70b-efcd-4462-8017-0d8d0e249fc5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:10.229283 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-377ab70b-efcd-4462-8017-0d8d0e249fc5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:10.230087 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-377ab70b-efcd-4462-8017-0d8d0e249fc5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:10.230752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-377ab70b-efcd-4462-8017-0d8d0e249fc5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:10.231506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-377ab70b-efcd-4462-8017-0d8d0e249fc5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:10.232032 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-377ab70b-efcd-4462-8017-0d8d0e249fc5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:10.232808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-377ab70b-efcd-4462-8017-0d8d0e249fc5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:10.312560 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-ae86fe4c-be3d-4adc-827e-91eee26ce27e req-13db549d-1a9d-4317-9d42-f6f58bdf6337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9995986-5686-4d6f-9405-4a3b2d109d2d", "name": "network-vif-unplugged", "status": "completed", "tag": "ecf4222b-fb2e-4879-a3e2-b2351cf66e5d"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:29:10.318198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-377ab70b-efcd-4462-8017-0d8d0e249fc5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:10.335472 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-377ab70b-efcd-4462-8017-0d8d0e249fc5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 200 len: 1225 microversion: 2.1 time: 0.120006 Sep 07 13:29:10.338741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ae86fe4c-be3d-4adc-827e-91eee26ce27e req-13db549d-1a9d-4317-9d42-f6f58bdf6337 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:10.339565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ae86fe4c-be3d-4adc-827e-91eee26ce27e req-13db549d-1a9d-4317-9d42-f6f58bdf6337 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:10.340482 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ae86fe4c-be3d-4adc-827e-91eee26ce27e req-13db549d-1a9d-4317-9d42-f6f58bdf6337 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:10.350253 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3282/6596] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:10 2022] GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 1225 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:10.356317 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ae86fe4c-be3d-4adc-827e-91eee26ce27e req-13db549d-1a9d-4317-9d42-f6f58bdf6337 service nova] Creating event network-vif-unplugged:ecf4222b-fb2e-4879-a3e2-b2351cf66e5d for instance e9995986-5686-4d6f-9405-4a3b2d109d2d on n-h2-852087-9 Sep 07 13:29:10.365842 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-ae86fe4c-be3d-4adc-827e-91eee26ce27e req-13db549d-1a9d-4317-9d42-f6f58bdf6337 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061478 Sep 07 13:29:10.368707 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3315/6597] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:29:10.489633 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b8b81948-eccc-47e8-a139-bb613b52d73d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:10.490732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b8b81948-eccc-47e8-a139-bb613b52d73d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:10.501085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8b81948-eccc-47e8-a139-bb613b52d73d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:10.501743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8b81948-eccc-47e8-a139-bb613b52d73d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:10.502436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8b81948-eccc-47e8-a139-bb613b52d73d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:10.503372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8b81948-eccc-47e8-a139-bb613b52d73d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:10.504105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8b81948-eccc-47e8-a139-bb613b52d73d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:10.504301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8b81948-eccc-47e8-a139-bb613b52d73d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:10.757440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b8b81948-eccc-47e8-a139-bb613b52d73d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:10.771623 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b8b81948-eccc-47e8-a139-bb613b52d73d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1680 microversion: 2.1 time: 0.287580 Sep 07 13:29:10.772580 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3283/6598] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:10 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1680 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:11.365829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fc181e4c-c565-485a-9a04-56dea52b4e49 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:11.366572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fc181e4c-c565-485a-9a04-56dea52b4e49 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:11.374130 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc181e4c-c565-485a-9a04-56dea52b4e49 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:11.374647 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc181e4c-c565-485a-9a04-56dea52b4e49 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:11.375105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc181e4c-c565-485a-9a04-56dea52b4e49 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:11.375830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc181e4c-c565-485a-9a04-56dea52b4e49 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:11.376305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc181e4c-c565-485a-9a04-56dea52b4e49 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:11.376753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fc181e4c-c565-485a-9a04-56dea52b4e49 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:11.452045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fc181e4c-c565-485a-9a04-56dea52b4e49 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:11.461016 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fc181e4c-c565-485a-9a04-56dea52b4e49 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 200 len: 1225 microversion: 2.1 time: 0.100503 Sep 07 13:29:11.461689 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3316/6599] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:11 2022] GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:12.397103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-6cf911f7-230b-4ecc-879a-2ceffd1b276d req-72fa8219-4bf9-49e1-b87d-b96c40f8c3a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9995986-5686-4d6f-9405-4a3b2d109d2d", "name": "network-vif-plugged", "status": "completed", "tag": "ecf4222b-fb2e-4879-a3e2-b2351cf66e5d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:29:12.408298 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6cf911f7-230b-4ecc-879a-2ceffd1b276d req-72fa8219-4bf9-49e1-b87d-b96c40f8c3a9 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:12.408788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6cf911f7-230b-4ecc-879a-2ceffd1b276d req-72fa8219-4bf9-49e1-b87d-b96c40f8c3a9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:12.409222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6cf911f7-230b-4ecc-879a-2ceffd1b276d req-72fa8219-4bf9-49e1-b87d-b96c40f8c3a9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:12.424937 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-6cf911f7-230b-4ecc-879a-2ceffd1b276d req-72fa8219-4bf9-49e1-b87d-b96c40f8c3a9 service nova] Creating event network-vif-plugged:ecf4222b-fb2e-4879-a3e2-b2351cf66e5d for instance e9995986-5686-4d6f-9405-4a3b2d109d2d on n-h2-852087-9 Sep 07 13:29:12.430351 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-6cf911f7-230b-4ecc-879a-2ceffd1b276d req-72fa8219-4bf9-49e1-b87d-b96c40f8c3a9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037119 Sep 07 13:29:12.431017 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3284/6600] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:29:12.501639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-131a8142-ecf4-4d15-bb7c-35e4c20a4e91 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:12.502485 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-131a8142-ecf4-4d15-bb7c-35e4c20a4e91 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:12.510392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-131a8142-ecf4-4d15-bb7c-35e4c20a4e91 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:12.511020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-131a8142-ecf4-4d15-bb7c-35e4c20a4e91 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:12.511544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-131a8142-ecf4-4d15-bb7c-35e4c20a4e91 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:12.512269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-131a8142-ecf4-4d15-bb7c-35e4c20a4e91 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:12.512741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-131a8142-ecf4-4d15-bb7c-35e4c20a4e91 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:12.513178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-131a8142-ecf4-4d15-bb7c-35e4c20a4e91 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:12.595735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-131a8142-ecf4-4d15-bb7c-35e4c20a4e91 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:12.605859 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-131a8142-ecf4-4d15-bb7c-35e4c20a4e91 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 200 len: 1225 microversion: 2.1 time: 0.108933 Sep 07 13:29:12.606480 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3317/6601] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:12 2022] GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:13.634617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4aaf2788-1c0a-498e-a27f-3ff406023984 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:13.635351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4aaf2788-1c0a-498e-a27f-3ff406023984 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:13.643308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4aaf2788-1c0a-498e-a27f-3ff406023984 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:13.643800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4aaf2788-1c0a-498e-a27f-3ff406023984 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:13.644230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4aaf2788-1c0a-498e-a27f-3ff406023984 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:13.644938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4aaf2788-1c0a-498e-a27f-3ff406023984 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:13.645394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4aaf2788-1c0a-498e-a27f-3ff406023984 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:13.645866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4aaf2788-1c0a-498e-a27f-3ff406023984 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:13.661250 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-4aaf2788-1c0a-498e-a27f-3ff406023984 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] HTTP exception thrown: Instance b9124e17-08d2-4641-b390-b43169aa6ca7 could not be found. Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4aaf2788-1c0a-498e-a27f-3ff406023984 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Request method failure captured: Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 HTTP/1.1 Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJrKtGg8mTUS8TVRSUKjETENKgBfLqI2oUMffXPZtsQfHAGfvsCSe64IHdsu1gAtG3a2XlfVJiJMXBeXoxoYCkAhaL6z1XH8667-SWfmJ5tkR4WMw-DlaHMfOvoGzJHrmW4OvMTJQgI9_G9o9R2vidCDnbLRABw8OsiYOeqYc9Klp2E Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 90d330a2d2ad4295873277de2d649182 Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance b9124e17-08d2-4641-b390-b43169aa6ca7 could not be found. Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'b9124e17-08d2-4641-b390-b43169aa6ca7'} Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9124e17-08d2-4641-b390-b43169aa6ca7 could not be found. Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9124e17-08d2-4641-b390-b43169aa6ca7 could not be found. Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:29:13.663006 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:29:13.667763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:13.667763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:29:13.667763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:29:13.667763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:29:13.667763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:29:13.667763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9124e17-08d2-4641-b390-b43169aa6ca7 could not be found. Sep 07 13:29:13.667763 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:29:13.667763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4aaf2788-1c0a-498e-a27f-3ff406023984 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Returning 404 to user: Instance b9124e17-08d2-4641-b390-b43169aa6ca7 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:29:13.667763 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4aaf2788-1c0a-498e-a27f-3ff406023984 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 404 len: 111 microversion: 2.1 time: 0.037288 Sep 07 13:29:13.667763 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3285/6602] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:13 2022] GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:29:13.719184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eef73382-63b1-4e65-90aa-834a31f5c041 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-125742048", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2091031878", "security_groups": [{"name": "tempest-secgroup-smoke-801476543"}], "block_device_mapping_v2": [{"uuid": "93f59304-263c-4b7a-b76a-de8ee56f65d0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7f5512e3-cd6c-43c3-ae4c-0cca06e090be"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:29:13.842102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-eef73382-63b1-4e65-90aa-834a31f5c041 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] validate_networks() for [('7f5512e3-cd6c-43c3-ae4c-0cca06e090be', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:29:14.228088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-eef73382-63b1-4e65-90aa-834a31f5c041 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:29:14.228639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-eef73382-63b1-4e65-90aa-834a31f5c041 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:29:14.229035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-eef73382-63b1-4e65-90aa-834a31f5c041 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:29:14.229468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-eef73382-63b1-4e65-90aa-834a31f5c041 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:29:14.229926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-eef73382-63b1-4e65-90aa-834a31f5c041 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:29:14.240134 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eef73382-63b1-4e65-90aa-834a31f5c041 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:14.240645 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eef73382-63b1-4e65-90aa-834a31f5c041 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:14.241106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eef73382-63b1-4e65-90aa-834a31f5c041 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:14.241898 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eef73382-63b1-4e65-90aa-834a31f5c041 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:14.242378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eef73382-63b1-4e65-90aa-834a31f5c041 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:14.242823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eef73382-63b1-4e65-90aa-834a31f5c041 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:14.261318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-eef73382-63b1-4e65-90aa-834a31f5c041 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Getting quotas for project b97b8dd299f145888f90fbf60321cd18. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:29:14.267603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-eef73382-63b1-4e65-90aa-834a31f5c041 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Getting quotas for user 90d330a2d2ad4295873277de2d649182 and project b97b8dd299f145888f90fbf60321cd18. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:29:14.333471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-eef73382-63b1-4e65-90aa-834a31f5c041 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:29:14.335700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-eef73382-63b1-4e65-90aa-834a31f5c041 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='93f59304-263c-4b7a-b76a-de8ee56f65d0',volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:29:14.484636 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eef73382-63b1-4e65-90aa-834a31f5c041 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.769852 Sep 07 13:29:14.485580 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3318/6603] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:29:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:29:14.498437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aac914cd-5789-4cf8-8255-f1dd309e0f19 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:14.499051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aac914cd-5789-4cf8-8255-f1dd309e0f19 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:14.556618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aac914cd-5789-4cf8-8255-f1dd309e0f19 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:14.564395 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aac914cd-5789-4cf8-8255-f1dd309e0f19 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62" status: 200 len: 1094 microversion: 2.1 time: 0.069988 Sep 07 13:29:14.564989 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3286/6604] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:14 2022] GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:29:15.588490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b7b5c1a5-d261-495b-a30d-2913afa96413 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:15.589264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b7b5c1a5-d261-495b-a30d-2913afa96413 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:15.596579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7b5c1a5-d261-495b-a30d-2913afa96413 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:15.597103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7b5c1a5-d261-495b-a30d-2913afa96413 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:15.597594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7b5c1a5-d261-495b-a30d-2913afa96413 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:15.598362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7b5c1a5-d261-495b-a30d-2913afa96413 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:15.598871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7b5c1a5-d261-495b-a30d-2913afa96413 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:15.599329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7b5c1a5-d261-495b-a30d-2913afa96413 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:15.672893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b7b5c1a5-d261-495b-a30d-2913afa96413 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:15.681864 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b7b5c1a5-d261-495b-a30d-2913afa96413 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62" status: 200 len: 1192 microversion: 2.1 time: 0.098277 Sep 07 13:29:15.686718 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3319/6605] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:15 2022] GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 => generated 1192 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:16.706070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-524f6bc9-36d2-490b-b92c-a5d7b5db4719 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:16.707601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-524f6bc9-36d2-490b-b92c-a5d7b5db4719 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:16.716293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-524f6bc9-36d2-490b-b92c-a5d7b5db4719 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:16.717152 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-524f6bc9-36d2-490b-b92c-a5d7b5db4719 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:16.717807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-524f6bc9-36d2-490b-b92c-a5d7b5db4719 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:16.718721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-524f6bc9-36d2-490b-b92c-a5d7b5db4719 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:16.719352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-524f6bc9-36d2-490b-b92c-a5d7b5db4719 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:16.719946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-524f6bc9-36d2-490b-b92c-a5d7b5db4719 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:16.970986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-524f6bc9-36d2-490b-b92c-a5d7b5db4719 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:16.979657 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-524f6bc9-36d2-490b-b92c-a5d7b5db4719 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62" status: 200 len: 1277 microversion: 2.1 time: 0.278560 Sep 07 13:29:16.980506 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3287/6606] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:16 2022] GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 => generated 1277 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:17.381919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c59533e2-2e65-4268-845f-c0ea8915427d req-690c1a7c-c261-46ae-8c01-dab9bb448efa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92678079-07b6-4d2f-abab-ed6991649e62", "tag": "c45e0b54-9119-4846-b45a-fa8f709266c4"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:29:17.401138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c59533e2-2e65-4268-845f-c0ea8915427d req-690c1a7c-c261-46ae-8c01-dab9bb448efa service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:17.401690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c59533e2-2e65-4268-845f-c0ea8915427d req-690c1a7c-c261-46ae-8c01-dab9bb448efa service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:17.402152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c59533e2-2e65-4268-845f-c0ea8915427d req-690c1a7c-c261-46ae-8c01-dab9bb448efa service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:17.416632 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c59533e2-2e65-4268-845f-c0ea8915427d req-690c1a7c-c261-46ae-8c01-dab9bb448efa service nova] Creating event network-changed:c45e0b54-9119-4846-b45a-fa8f709266c4 for instance 92678079-07b6-4d2f-abab-ed6991649e62 on n-h1-852087-9 Sep 07 13:29:17.426108 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c59533e2-2e65-4268-845f-c0ea8915427d req-690c1a7c-c261-46ae-8c01-dab9bb448efa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053695 Sep 07 13:29:17.426752 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3320/6607] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:29:18.004355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-97d267a0-2be2-4097-aa99-f87eea2f7f2e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:18.005098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-97d267a0-2be2-4097-aa99-f87eea2f7f2e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:18.013419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97d267a0-2be2-4097-aa99-f87eea2f7f2e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:18.014247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97d267a0-2be2-4097-aa99-f87eea2f7f2e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:18.014658 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97d267a0-2be2-4097-aa99-f87eea2f7f2e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:18.015671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97d267a0-2be2-4097-aa99-f87eea2f7f2e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:18.016139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97d267a0-2be2-4097-aa99-f87eea2f7f2e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:18.016602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97d267a0-2be2-4097-aa99-f87eea2f7f2e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:18.225871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-97d267a0-2be2-4097-aa99-f87eea2f7f2e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:18.235247 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-97d267a0-2be2-4097-aa99-f87eea2f7f2e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62" status: 200 len: 1277 microversion: 2.1 time: 0.235510 Sep 07 13:29:18.236221 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3288/6608] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:17 2022] GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 => generated 1277 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:19.261428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a30cf40d-7540-4629-9268-596927d09299 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:19.262196 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a30cf40d-7540-4629-9268-596927d09299 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:19.270872 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a30cf40d-7540-4629-9268-596927d09299 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:19.271394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a30cf40d-7540-4629-9268-596927d09299 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:19.271996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a30cf40d-7540-4629-9268-596927d09299 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:19.272752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a30cf40d-7540-4629-9268-596927d09299 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:19.273372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a30cf40d-7540-4629-9268-596927d09299 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:19.273856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a30cf40d-7540-4629-9268-596927d09299 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:19.423004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a30cf40d-7540-4629-9268-596927d09299 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:19.440295 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a30cf40d-7540-4629-9268-596927d09299 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62" status: 200 len: 1277 microversion: 2.1 time: 0.183403 Sep 07 13:29:19.440949 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3321/6609] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:19 2022] GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:20.467767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-039af6f1-c68e-4689-a9b4-fd4b35699a92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:20.468465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-039af6f1-c68e-4689-a9b4-fd4b35699a92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:20.476780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-039af6f1-c68e-4689-a9b4-fd4b35699a92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:20.477315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-039af6f1-c68e-4689-a9b4-fd4b35699a92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:20.477797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-039af6f1-c68e-4689-a9b4-fd4b35699a92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:20.478687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-039af6f1-c68e-4689-a9b4-fd4b35699a92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:20.479158 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-039af6f1-c68e-4689-a9b4-fd4b35699a92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:20.479623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-039af6f1-c68e-4689-a9b4-fd4b35699a92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:20.659652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-039af6f1-c68e-4689-a9b4-fd4b35699a92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:20.669023 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-039af6f1-c68e-4689-a9b4-fd4b35699a92 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62" status: 200 len: 1277 microversion: 2.1 time: 0.205808 Sep 07 13:29:20.669728 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3289/6610] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:20 2022] GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 => generated 1277 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:21.697399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c57894b7-435a-4330-938a-0f39b0e0d14e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:21.698115 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c57894b7-435a-4330-938a-0f39b0e0d14e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:21.705789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57894b7-435a-4330-938a-0f39b0e0d14e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:21.706311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57894b7-435a-4330-938a-0f39b0e0d14e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:21.706772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57894b7-435a-4330-938a-0f39b0e0d14e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:21.707504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57894b7-435a-4330-938a-0f39b0e0d14e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:21.708011 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57894b7-435a-4330-938a-0f39b0e0d14e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:21.708438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c57894b7-435a-4330-938a-0f39b0e0d14e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:21.845711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c57894b7-435a-4330-938a-0f39b0e0d14e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:21.854208 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c57894b7-435a-4330-938a-0f39b0e0d14e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62" status: 200 len: 1265 microversion: 2.1 time: 0.160885 Sep 07 13:29:21.854791 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3322/6611] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:21 2022] GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:22.878314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7c4733e4-2cd8-4c4a-b2cd-13ce9c3d1d65 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:22.878988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7c4733e4-2cd8-4c4a-b2cd-13ce9c3d1d65 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:22.881734 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=42 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:22.890335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c4733e4-2cd8-4c4a-b2cd-13ce9c3d1d65 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:22.891183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c4733e4-2cd8-4c4a-b2cd-13ce9c3d1d65 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:22.891734 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c4733e4-2cd8-4c4a-b2cd-13ce9c3d1d65 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:22.892968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c4733e4-2cd8-4c4a-b2cd-13ce9c3d1d65 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:22.893677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c4733e4-2cd8-4c4a-b2cd-13ce9c3d1d65 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:22.894259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c4733e4-2cd8-4c4a-b2cd-13ce9c3d1d65 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:23.052572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7c4733e4-2cd8-4c4a-b2cd-13ce9c3d1d65 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:23.062695 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7c4733e4-2cd8-4c4a-b2cd-13ce9c3d1d65 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62" status: 200 len: 1265 microversion: 2.1 time: 0.188415 Sep 07 13:29:23.063276 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3290/6612] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:22 2022] GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:24.085437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e70e9d6b-0e34-427b-a805-5a308d3b2206 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:24.086195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e70e9d6b-0e34-427b-a805-5a308d3b2206 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:24.093786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e70e9d6b-0e34-427b-a805-5a308d3b2206 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:24.094306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e70e9d6b-0e34-427b-a805-5a308d3b2206 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:24.094758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e70e9d6b-0e34-427b-a805-5a308d3b2206 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:24.095597 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e70e9d6b-0e34-427b-a805-5a308d3b2206 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:24.096069 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e70e9d6b-0e34-427b-a805-5a308d3b2206 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:24.096541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e70e9d6b-0e34-427b-a805-5a308d3b2206 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:24.250086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:24.275624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:24.560029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e70e9d6b-0e34-427b-a805-5a308d3b2206 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:24.570693 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e70e9d6b-0e34-427b-a805-5a308d3b2206 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62" status: 200 len: 1265 microversion: 2.1 time: 0.489325 Sep 07 13:29:24.571286 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3323/6613] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:24 2022] GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 => generated 1265 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:25.008854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-41ccd54d-b1ed-49b1-9d61-5131b66091b1 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:29:25.011361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-41ccd54d-b1ed-49b1-9d61-5131b66091b1 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:25.014262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:25.020113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41ccd54d-b1ed-49b1-9d61-5131b66091b1 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:25.020614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41ccd54d-b1ed-49b1-9d61-5131b66091b1 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:25.021045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41ccd54d-b1ed-49b1-9d61-5131b66091b1 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:25.021785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41ccd54d-b1ed-49b1-9d61-5131b66091b1 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:25.022225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41ccd54d-b1ed-49b1-9d61-5131b66091b1 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:25.022748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-41ccd54d-b1ed-49b1-9d61-5131b66091b1 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:25.096396 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-41ccd54d-b1ed-49b1-9d61-5131b66091b1 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "POST /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5/action" status: 200 len: 24561 microversion: 2.1 time: 0.091377 Sep 07 13:29:25.097102 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3291/6614] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:29:25 2022] POST /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5/action => generated 24561 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:29:25.593995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b640c91e-2b80-45e6-9586-2c5a9562718a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:25.594586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b640c91e-2b80-45e6-9586-2c5a9562718a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:25.602316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b640c91e-2b80-45e6-9586-2c5a9562718a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:25.602811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b640c91e-2b80-45e6-9586-2c5a9562718a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:25.603277 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b640c91e-2b80-45e6-9586-2c5a9562718a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:25.604200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b640c91e-2b80-45e6-9586-2c5a9562718a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:25.604671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b640c91e-2b80-45e6-9586-2c5a9562718a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:25.605124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b640c91e-2b80-45e6-9586-2c5a9562718a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:25.751610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b640c91e-2b80-45e6-9586-2c5a9562718a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:25.759716 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b640c91e-2b80-45e6-9586-2c5a9562718a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62" status: 200 len: 1265 microversion: 2.1 time: 0.170152 Sep 07 13:29:25.760336 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3324/6615] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:25 2022] GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:26.786579 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd186c41-8b35-4688-b7ba-701a2d749b9c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:26.787316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dd186c41-8b35-4688-b7ba-701a2d749b9c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:26.795613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd186c41-8b35-4688-b7ba-701a2d749b9c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:26.796114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd186c41-8b35-4688-b7ba-701a2d749b9c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:26.796557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd186c41-8b35-4688-b7ba-701a2d749b9c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:26.797271 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd186c41-8b35-4688-b7ba-701a2d749b9c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:26.797742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd186c41-8b35-4688-b7ba-701a2d749b9c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:26.798176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd186c41-8b35-4688-b7ba-701a2d749b9c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:26.946388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dd186c41-8b35-4688-b7ba-701a2d749b9c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:26.955184 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dd186c41-8b35-4688-b7ba-701a2d749b9c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62" status: 200 len: 1265 microversion: 2.1 time: 0.172906 Sep 07 13:29:26.955820 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3292/6616] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:26 2022] GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:27.981015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-97391193-c211-4421-b495-aa090ef21a1d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:27.981747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-97391193-c211-4421-b495-aa090ef21a1d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:27.989741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97391193-c211-4421-b495-aa090ef21a1d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:27.990253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97391193-c211-4421-b495-aa090ef21a1d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:27.990712 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97391193-c211-4421-b495-aa090ef21a1d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:27.991532 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97391193-c211-4421-b495-aa090ef21a1d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:27.991954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97391193-c211-4421-b495-aa090ef21a1d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:27.992398 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97391193-c211-4421-b495-aa090ef21a1d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:28.134488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-97391193-c211-4421-b495-aa090ef21a1d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:28.145247 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-97391193-c211-4421-b495-aa090ef21a1d tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62" status: 200 len: 1265 microversion: 2.1 time: 0.169480 Sep 07 13:29:28.145866 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3325/6617] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:27 2022] GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:29.173626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fd79f412-e85a-4ca7-9fc0-87dbff17f5b2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:29.174200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fd79f412-e85a-4ca7-9fc0-87dbff17f5b2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:29.181920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd79f412-e85a-4ca7-9fc0-87dbff17f5b2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:29.182419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd79f412-e85a-4ca7-9fc0-87dbff17f5b2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:29.182858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd79f412-e85a-4ca7-9fc0-87dbff17f5b2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:29.183562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd79f412-e85a-4ca7-9fc0-87dbff17f5b2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:29.184021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd79f412-e85a-4ca7-9fc0-87dbff17f5b2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:29.184452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd79f412-e85a-4ca7-9fc0-87dbff17f5b2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:29.327569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fd79f412-e85a-4ca7-9fc0-87dbff17f5b2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:29.336018 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fd79f412-e85a-4ca7-9fc0-87dbff17f5b2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62" status: 200 len: 1265 microversion: 2.1 time: 0.166580 Sep 07 13:29:29.336625 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3293/6618] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:29 2022] GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:30.359950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-538d4954-c53e-4655-9b76-2bdfb4230a1a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:30.360598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-538d4954-c53e-4655-9b76-2bdfb4230a1a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:30.368620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-538d4954-c53e-4655-9b76-2bdfb4230a1a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:30.369158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-538d4954-c53e-4655-9b76-2bdfb4230a1a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:30.369656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-538d4954-c53e-4655-9b76-2bdfb4230a1a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:30.370596 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-538d4954-c53e-4655-9b76-2bdfb4230a1a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:30.371263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-538d4954-c53e-4655-9b76-2bdfb4230a1a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:30.371802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-538d4954-c53e-4655-9b76-2bdfb4230a1a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:30.375314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:30.523442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-538d4954-c53e-4655-9b76-2bdfb4230a1a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:30.532079 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-538d4954-c53e-4655-9b76-2bdfb4230a1a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62" status: 200 len: 1265 microversion: 2.1 time: 0.176183 Sep 07 13:29:30.532889 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3326/6619] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:30 2022] GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:31.557887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aeabffcf-c600-435f-8587-02cc17c888b9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:31.558768 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aeabffcf-c600-435f-8587-02cc17c888b9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:31.570085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aeabffcf-c600-435f-8587-02cc17c888b9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:31.570792 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aeabffcf-c600-435f-8587-02cc17c888b9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:31.571470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aeabffcf-c600-435f-8587-02cc17c888b9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:31.572575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aeabffcf-c600-435f-8587-02cc17c888b9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:31.573117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aeabffcf-c600-435f-8587-02cc17c888b9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:31.573756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aeabffcf-c600-435f-8587-02cc17c888b9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:31.721740 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aeabffcf-c600-435f-8587-02cc17c888b9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:31.730108 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aeabffcf-c600-435f-8587-02cc17c888b9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62" status: 200 len: 1265 microversion: 2.1 time: 0.178187 Sep 07 13:29:31.730717 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3294/6620] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:31 2022] GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:32.140800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8160f7c6-0b67-41b9-bacb-dc1472fcf5ad req-30c18300-b8db-4a28-9658-49851e83eac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92678079-07b6-4d2f-abab-ed6991649e62", "name": "network-vif-plugged", "status": "completed", "tag": "c45e0b54-9119-4846-b45a-fa8f709266c4"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:29:32.153310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8160f7c6-0b67-41b9-bacb-dc1472fcf5ad req-30c18300-b8db-4a28-9658-49851e83eac2 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:32.153551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8160f7c6-0b67-41b9-bacb-dc1472fcf5ad req-30c18300-b8db-4a28-9658-49851e83eac2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:32.153896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8160f7c6-0b67-41b9-bacb-dc1472fcf5ad req-30c18300-b8db-4a28-9658-49851e83eac2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:32.166089 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8160f7c6-0b67-41b9-bacb-dc1472fcf5ad req-30c18300-b8db-4a28-9658-49851e83eac2 service nova] Creating event network-vif-plugged:c45e0b54-9119-4846-b45a-fa8f709266c4 for instance 92678079-07b6-4d2f-abab-ed6991649e62 on n-h1-852087-9 Sep 07 13:29:32.171529 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8160f7c6-0b67-41b9-bacb-dc1472fcf5ad req-30c18300-b8db-4a28-9658-49851e83eac2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034786 Sep 07 13:29:32.172125 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3327/6621] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:29:32.753559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5ce25239-954a-4703-a6b1-96c48ab7c12f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:32.754190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5ce25239-954a-4703-a6b1-96c48ab7c12f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:32.761942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ce25239-954a-4703-a6b1-96c48ab7c12f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:32.762469 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ce25239-954a-4703-a6b1-96c48ab7c12f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:32.762943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ce25239-954a-4703-a6b1-96c48ab7c12f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:32.763662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ce25239-954a-4703-a6b1-96c48ab7c12f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:32.764125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ce25239-954a-4703-a6b1-96c48ab7c12f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:32.764528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5ce25239-954a-4703-a6b1-96c48ab7c12f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:32.907528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5ce25239-954a-4703-a6b1-96c48ab7c12f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:32.919064 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5ce25239-954a-4703-a6b1-96c48ab7c12f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62" status: 200 len: 1265 microversion: 2.1 time: 0.169618 Sep 07 13:29:32.920089 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3295/6622] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:32 2022] GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:33.944130 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f4a9ebf8-3b5b-49e2-bf88-5961d0eac8bb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:33.944839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f4a9ebf8-3b5b-49e2-bf88-5961d0eac8bb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:33.946905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:33.952765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4a9ebf8-3b5b-49e2-bf88-5961d0eac8bb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:33.953268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4a9ebf8-3b5b-49e2-bf88-5961d0eac8bb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:33.954118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4a9ebf8-3b5b-49e2-bf88-5961d0eac8bb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:33.954854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4a9ebf8-3b5b-49e2-bf88-5961d0eac8bb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:33.955374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4a9ebf8-3b5b-49e2-bf88-5961d0eac8bb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:33.955827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f4a9ebf8-3b5b-49e2-bf88-5961d0eac8bb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:34.106073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f4a9ebf8-3b5b-49e2-bf88-5961d0eac8bb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:34.114848 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f4a9ebf8-3b5b-49e2-bf88-5961d0eac8bb tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62" status: 200 len: 1452 microversion: 2.1 time: 0.175667 Sep 07 13:29:34.115270 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3328/6623] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:33 2022] GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 => generated 1452 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:34.141246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a2a29556-7b11-4392-a524-1667f0c205de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:34.142255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a2a29556-7b11-4392-a524-1667f0c205de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:34.153394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2a29556-7b11-4392-a524-1667f0c205de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:34.154208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2a29556-7b11-4392-a524-1667f0c205de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:34.154674 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2a29556-7b11-4392-a524-1667f0c205de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:34.155391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2a29556-7b11-4392-a524-1667f0c205de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:34.155862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2a29556-7b11-4392-a524-1667f0c205de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:34.156298 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a2a29556-7b11-4392-a524-1667f0c205de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:34.299919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a2a29556-7b11-4392-a524-1667f0c205de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:34.308356 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a2a29556-7b11-4392-a524-1667f0c205de tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62" status: 200 len: 1452 microversion: 2.1 time: 0.174189 Sep 07 13:29:34.308948 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3296/6624] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:34 2022] GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:35.009068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-59362533-154f-475d-b4a8-bc38b2a36976 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:29:35.011358 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-59362533-154f-475d-b4a8-bc38b2a36976 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:35.019576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59362533-154f-475d-b4a8-bc38b2a36976 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:35.020217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59362533-154f-475d-b4a8-bc38b2a36976 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:35.020661 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59362533-154f-475d-b4a8-bc38b2a36976 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:35.021650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59362533-154f-475d-b4a8-bc38b2a36976 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:35.022165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59362533-154f-475d-b4a8-bc38b2a36976 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:35.022613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59362533-154f-475d-b4a8-bc38b2a36976 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:35.099939 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-59362533-154f-475d-b4a8-bc38b2a36976 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "POST /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d/action" status: 200 len: 24567 microversion: 2.1 time: 0.095011 Sep 07 13:29:35.107097 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3329/6625] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:29:35 2022] POST /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d/action => generated 24567 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:29:36.049071 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-26f6585f-02a7-460b-9ca4-94e79c892b57 req-0b958bc2-a325-4550-865a-2dde417d2951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92678079-07b6-4d2f-abab-ed6991649e62", "tag": "c45e0b54-9119-4846-b45a-fa8f709266c4"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:29:36.059920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-26f6585f-02a7-460b-9ca4-94e79c892b57 req-0b958bc2-a325-4550-865a-2dde417d2951 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:36.060546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-26f6585f-02a7-460b-9ca4-94e79c892b57 req-0b958bc2-a325-4550-865a-2dde417d2951 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:36.061173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-26f6585f-02a7-460b-9ca4-94e79c892b57 req-0b958bc2-a325-4550-865a-2dde417d2951 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:36.065351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:36.073767 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-26f6585f-02a7-460b-9ca4-94e79c892b57 req-0b958bc2-a325-4550-865a-2dde417d2951 service nova] Creating event network-changed:c45e0b54-9119-4846-b45a-fa8f709266c4 for instance 92678079-07b6-4d2f-abab-ed6991649e62 on n-h1-852087-9 Sep 07 13:29:36.079441 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-26f6585f-02a7-460b-9ca4-94e79c892b57 req-0b958bc2-a325-4550-865a-2dde417d2951 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034419 Sep 07 13:29:36.080177 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3297/6626] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:29:47.175200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4da86f8c-aae1-420a-a437-fdca7fe327c7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:47.176053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4da86f8c-aae1-420a-a437-fdca7fe327c7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:47.180572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=15 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:47.181520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:47.184400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:47.185855 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=17 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:47.189422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e5c9928f-20b6-4807-9772-3ebb7e60cfa3 req-8c14251c-0f73-4ea9-ad76-8df064e157b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9995986-5686-4d6f-9405-4a3b2d109d2d", "tag": "ecf4222b-fb2e-4879-a3e2-b2351cf66e5d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:29:47.195314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4da86f8c-aae1-420a-a437-fdca7fe327c7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:47.196244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4da86f8c-aae1-420a-a437-fdca7fe327c7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:47.197277 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4da86f8c-aae1-420a-a437-fdca7fe327c7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:47.198685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4da86f8c-aae1-420a-a437-fdca7fe327c7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:47.199584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4da86f8c-aae1-420a-a437-fdca7fe327c7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:47.200395 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4da86f8c-aae1-420a-a437-fdca7fe327c7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:47.208326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e5c9928f-20b6-4807-9772-3ebb7e60cfa3 req-8c14251c-0f73-4ea9-ad76-8df064e157b0 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:47.209120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e5c9928f-20b6-4807-9772-3ebb7e60cfa3 req-8c14251c-0f73-4ea9-ad76-8df064e157b0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:47.209962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e5c9928f-20b6-4807-9772-3ebb7e60cfa3 req-8c14251c-0f73-4ea9-ad76-8df064e157b0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:47.232039 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e5c9928f-20b6-4807-9772-3ebb7e60cfa3 req-8c14251c-0f73-4ea9-ad76-8df064e157b0 service nova] Creating event network-changed:ecf4222b-fb2e-4879-a3e2-b2351cf66e5d for instance e9995986-5686-4d6f-9405-4a3b2d109d2d on n-h2-852087-9 Sep 07 13:29:47.241841 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e5c9928f-20b6-4807-9772-3ebb7e60cfa3 req-8c14251c-0f73-4ea9-ad76-8df064e157b0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064560 Sep 07 13:29:47.243038 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3298/6627] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:29:47.261376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4da86f8c-aae1-420a-a437-fdca7fe327c7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:29:47.389977 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4da86f8c-aae1-420a-a437-fdca7fe327c7 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 204 len: 0 microversion: 2.1 time: 0.219789 Sep 07 13:29:47.396289 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3330/6628] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:29:47 2022] DELETE /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:29:47.407059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d49f13e6-7420-4442-8f61-1aec46ae3c70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:47.408430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d49f13e6-7420-4442-8f61-1aec46ae3c70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:47.420739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d49f13e6-7420-4442-8f61-1aec46ae3c70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:47.421889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d49f13e6-7420-4442-8f61-1aec46ae3c70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:47.422947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d49f13e6-7420-4442-8f61-1aec46ae3c70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:47.423974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d49f13e6-7420-4442-8f61-1aec46ae3c70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:47.424842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d49f13e6-7420-4442-8f61-1aec46ae3c70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:47.425406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d49f13e6-7420-4442-8f61-1aec46ae3c70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:47.607737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d49f13e6-7420-4442-8f61-1aec46ae3c70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:47.623062 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d49f13e6-7420-4442-8f61-1aec46ae3c70 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1686 microversion: 2.1 time: 0.223938 Sep 07 13:29:47.624137 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3299/6629] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:47 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1686 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:48.648953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c354919a-54ce-40e0-a035-b47b739cada5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:48.649756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c354919a-54ce-40e0-a035-b47b739cada5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:48.658565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c354919a-54ce-40e0-a035-b47b739cada5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:48.659086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c354919a-54ce-40e0-a035-b47b739cada5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:48.659545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c354919a-54ce-40e0-a035-b47b739cada5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:48.660283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c354919a-54ce-40e0-a035-b47b739cada5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:48.660759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c354919a-54ce-40e0-a035-b47b739cada5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:48.661204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c354919a-54ce-40e0-a035-b47b739cada5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:48.810579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c354919a-54ce-40e0-a035-b47b739cada5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:48.820009 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c354919a-54ce-40e0-a035-b47b739cada5 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1686 microversion: 2.1 time: 0.175336 Sep 07 13:29:48.820617 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3331/6630] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:48 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1686 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:49.799442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-5d0b2d0e-7b17-4a56-bedc-091ef0e86f64 req-54521e93-33b7-44c3-b278-28c58ec61049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9995986-5686-4d6f-9405-4a3b2d109d2d", "name": "network-vif-deleted", "tag": "ecf4222b-fb2e-4879-a3e2-b2351cf66e5d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:29:49.812654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5d0b2d0e-7b17-4a56-bedc-091ef0e86f64 req-54521e93-33b7-44c3-b278-28c58ec61049 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:49.813676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5d0b2d0e-7b17-4a56-bedc-091ef0e86f64 req-54521e93-33b7-44c3-b278-28c58ec61049 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:49.814384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-5d0b2d0e-7b17-4a56-bedc-091ef0e86f64 req-54521e93-33b7-44c3-b278-28c58ec61049 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:49.831515 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-5d0b2d0e-7b17-4a56-bedc-091ef0e86f64 req-54521e93-33b7-44c3-b278-28c58ec61049 service nova] Creating event network-vif-deleted:ecf4222b-fb2e-4879-a3e2-b2351cf66e5d for instance e9995986-5686-4d6f-9405-4a3b2d109d2d on n-h2-852087-9 Sep 07 13:29:49.837752 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-5d0b2d0e-7b17-4a56-bedc-091ef0e86f64 req-54521e93-33b7-44c3-b278-28c58ec61049 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043541 Sep 07 13:29:49.838582 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3300/6631] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:29:49.845919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-72dd3536-a8cc-4f95-8347-849372dddcc6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:49.846723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-72dd3536-a8cc-4f95-8347-849372dddcc6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:49.854449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72dd3536-a8cc-4f95-8347-849372dddcc6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:49.855175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72dd3536-a8cc-4f95-8347-849372dddcc6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:49.855935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72dd3536-a8cc-4f95-8347-849372dddcc6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:49.856735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72dd3536-a8cc-4f95-8347-849372dddcc6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:49.857259 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72dd3536-a8cc-4f95-8347-849372dddcc6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:49.857810 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72dd3536-a8cc-4f95-8347-849372dddcc6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:49.938090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-72dd3536-a8cc-4f95-8347-849372dddcc6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663c3f21362d460785702e1858cc6706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ff80261a1a4ffdaefba7dd7d276c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:29:49.954398 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-72dd3536-a8cc-4f95-8347-849372dddcc6 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 200 len: 1350 microversion: 2.1 time: 0.112782 Sep 07 13:29:49.955475 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3332/6632] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:49 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 1350 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:29:50.981710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fc8cd1ed-2072-4873-bb00-7238b1d6b72d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:50.982866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fc8cd1ed-2072-4873-bb00-7238b1d6b72d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] [instance: e9995986-5686-4d6f-9405-4a3b2d109d2d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:29:50.990644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc8cd1ed-2072-4873-bb00-7238b1d6b72d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:50.992682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc8cd1ed-2072-4873-bb00-7238b1d6b72d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:50.993175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc8cd1ed-2072-4873-bb00-7238b1d6b72d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:50.994319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc8cd1ed-2072-4873-bb00-7238b1d6b72d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:29:50.994494 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc8cd1ed-2072-4873-bb00-7238b1d6b72d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:29:50.994876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fc8cd1ed-2072-4873-bb00-7238b1d6b72d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:29:51.011555 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-fc8cd1ed-2072-4873-bb00-7238b1d6b72d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] HTTP exception thrown: Instance e9995986-5686-4d6f-9405-4a3b2d109d2d could not be found. Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fc8cd1ed-2072-4873-bb00-7238b1d6b72d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Request method failure captured: Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d HTTP/1.1 Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJo_65BByUQjqxLLydngyGcQD0VqesltPK2phoKKnh2_w98MobCIT0V6J-xkzZOSe_MpyS8-hI1LHe2rGNpuHeqYkh62s-1hz08u5D4pKaIFeOnNl2E_uiZLXNKjMthRgm88PlbJ3GaVc7Wl0PE0eUQjIGoaS5gULI9m3p_XsfeTPw0 Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: c7ff80261a1a4ffdaefba7dd7d276c00 Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1063465928 Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7ff80261a1a4ffdaefba7dd7d276c00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c7ff80261a1a4ffdaefba7dd7d276c00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c7ff80261a1a4ffdaefba7dd7d276c00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7ff80261a1a4ffdaefba7dd7d276c00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1063465928 Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: c7ff80261a1a4ffdaefba7dd7d276c00 Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1063465928 Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TestNetworkAdvancedServerOps-1063465928-project Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 663c3f21362d460785702e1858cc6706 Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1063465928-project Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance e9995986-5686-4d6f-9405-4a3b2d109d2d could not be found. Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'e9995986-5686-4d6f-9405-4a3b2d109d2d'} Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9995986-5686-4d6f-9405-4a3b2d109d2d could not be found. Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9995986-5686-4d6f-9405-4a3b2d109d2d could not be found. Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:29:51.013350 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:29:51.019998 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:29:51.019998 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:29:51.019998 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:29:51.019998 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:29:51.019998 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:29:51.019998 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:29:51.019998 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9995986-5686-4d6f-9405-4a3b2d109d2d could not be found. Sep 07 13:29:51.019998 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:29:51.019998 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fc8cd1ed-2072-4873-bb00-7238b1d6b72d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Returning 404 to user: Instance e9995986-5686-4d6f-9405-4a3b2d109d2d could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:29:51.019998 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fc8cd1ed-2072-4873-bb00-7238b1d6b72d tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d" status: 404 len: 111 microversion: 2.1 time: 0.039043 Sep 07 13:29:51.019998 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3301/6633] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:29:50 2022] GET /compute/v2.1/servers/e9995986-5686-4d6f-9405-4a3b2d109d2d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:29:55.395155 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-08e8a2ce-2668-4f96-b493-65fd47adca39 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] Calling method '.version_select at 0x7fc41842bd30>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:29:55.420485 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-08e8a2ce-2668-4f96-b493-65fd47adca39 tempest-TestNetworkAdvancedServerOps-1063465928 tempest-TestNetworkAdvancedServerOps-1063465928-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-250320579" status: 202 len: 0 microversion: 2.1 time: 0.032144 Sep 07 13:29:55.421126 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3333/6634] 10.222.0.16 () {58 vars in 1281 bytes} [Wed Sep 7 13:29:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-250320579 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:30:03.948680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b1b1f729-1d44-4923-b1d7-513d37c88c75 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:30:03.951099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b1b1f729-1d44-4923-b1d7-513d37c88c75 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:03.954246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=8 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:03.955111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=12 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:03.963001 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1b1f729-1d44-4923-b1d7-513d37c88c75 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:03.963567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1b1f729-1d44-4923-b1d7-513d37c88c75 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:03.963987 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1b1f729-1d44-4923-b1d7-513d37c88c75 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:03.964695 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1b1f729-1d44-4923-b1d7-513d37c88c75 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:03.965464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1b1f729-1d44-4923-b1d7-513d37c88c75 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:03.965952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b1b1f729-1d44-4923-b1d7-513d37c88c75 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:04.044097 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b1b1f729-1d44-4923-b1d7-513d37c88c75 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "POST /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5/action" status: 200 len: 32636 microversion: 2.1 time: 0.098824 Sep 07 13:30:04.045335 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3302/6635] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:30:03 2022] POST /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5/action => generated 32636 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:30:05.154842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:05.158588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3a8c15f1-1fd6-4417-ba48-17abe15e06bf req-0758b49a-cc7e-4593-9845-6eafe37728fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5", "tag": "2d22f316-bc9c-4580-bb41-a964a6fe27ce"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:30:05.160544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d89b058e-877b-4a0c-bddd-6a6e8e9f44f4 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:05.161314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d89b058e-877b-4a0c-bddd-6a6e8e9f44f4 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:05.169110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d89b058e-877b-4a0c-bddd-6a6e8e9f44f4 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:05.169685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3a8c15f1-1fd6-4417-ba48-17abe15e06bf req-0758b49a-cc7e-4593-9845-6eafe37728fe service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:05.170176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3a8c15f1-1fd6-4417-ba48-17abe15e06bf req-0758b49a-cc7e-4593-9845-6eafe37728fe service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:05.170614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3a8c15f1-1fd6-4417-ba48-17abe15e06bf req-0758b49a-cc7e-4593-9845-6eafe37728fe service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:05.171046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d89b058e-877b-4a0c-bddd-6a6e8e9f44f4 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:05.171574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d89b058e-877b-4a0c-bddd-6a6e8e9f44f4 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:05.172555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d89b058e-877b-4a0c-bddd-6a6e8e9f44f4 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:05.173372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d89b058e-877b-4a0c-bddd-6a6e8e9f44f4 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:05.174063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d89b058e-877b-4a0c-bddd-6a6e8e9f44f4 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:05.183553 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3a8c15f1-1fd6-4417-ba48-17abe15e06bf req-0758b49a-cc7e-4593-9845-6eafe37728fe service nova] Creating event network-changed:2d22f316-bc9c-4580-bb41-a964a6fe27ce for instance 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 on n-h1-852087-9 Sep 07 13:30:05.188743 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3a8c15f1-1fd6-4417-ba48-17abe15e06bf req-0758b49a-cc7e-4593-9845-6eafe37728fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034294 Sep 07 13:30:05.189589 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3303/6636] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:30:05.206453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d89b058e-877b-4a0c-bddd-6a6e8e9f44f4 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:30:05.298142 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d89b058e-877b-4a0c-bddd-6a6e8e9f44f4 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5" status: 204 len: 0 microversion: 2.1 time: 0.145201 Sep 07 13:30:05.299123 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3334/6637] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:30:05 2022] DELETE /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:30:05.309937 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f49e1295-93f1-4e14-8ae3-4078452897c8 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:05.311103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f49e1295-93f1-4e14-8ae3-4078452897c8 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:05.319980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f49e1295-93f1-4e14-8ae3-4078452897c8 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:05.320482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f49e1295-93f1-4e14-8ae3-4078452897c8 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:05.320927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f49e1295-93f1-4e14-8ae3-4078452897c8 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:05.321871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f49e1295-93f1-4e14-8ae3-4078452897c8 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:05.322337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f49e1295-93f1-4e14-8ae3-4078452897c8 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:05.322765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f49e1295-93f1-4e14-8ae3-4078452897c8 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:05.500988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f49e1295-93f1-4e14-8ae3-4078452897c8 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:30:05.510533 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f49e1295-93f1-4e14-8ae3-4078452897c8 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5" status: 200 len: 1670 microversion: 2.1 time: 0.205773 Sep 07 13:30:05.511154 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3304/6638] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:05 2022] GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 => generated 1670 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:30:06.539797 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3ae0caa-0797-4473-9375-cc235b01c4fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:06.541283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d3ae0caa-0797-4473-9375-cc235b01c4fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:06.553292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3ae0caa-0797-4473-9375-cc235b01c4fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:06.554247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3ae0caa-0797-4473-9375-cc235b01c4fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:06.554974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3ae0caa-0797-4473-9375-cc235b01c4fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:06.555786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3ae0caa-0797-4473-9375-cc235b01c4fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:06.556270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3ae0caa-0797-4473-9375-cc235b01c4fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:06.556719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3ae0caa-0797-4473-9375-cc235b01c4fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:06.759066 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d3ae0caa-0797-4473-9375-cc235b01c4fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:30:06.768604 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d3ae0caa-0797-4473-9375-cc235b01c4fb tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5" status: 200 len: 1670 microversion: 2.1 time: 0.236567 Sep 07 13:30:06.769189 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3335/6639] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:06 2022] GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 => generated 1670 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:30:07.481037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-460b0653-6645-4945-9507-b7eda7603057 req-58de9226-7764-4a82-984b-39b46c1bf0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5", "name": "network-vif-deleted", "tag": "2d22f316-bc9c-4580-bb41-a964a6fe27ce"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:30:07.493279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-460b0653-6645-4945-9507-b7eda7603057 req-58de9226-7764-4a82-984b-39b46c1bf0f0 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:07.493804 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-460b0653-6645-4945-9507-b7eda7603057 req-58de9226-7764-4a82-984b-39b46c1bf0f0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:07.494306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-460b0653-6645-4945-9507-b7eda7603057 req-58de9226-7764-4a82-984b-39b46c1bf0f0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:07.505960 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-460b0653-6645-4945-9507-b7eda7603057 req-58de9226-7764-4a82-984b-39b46c1bf0f0 service nova] Creating event network-vif-deleted:2d22f316-bc9c-4580-bb41-a964a6fe27ce for instance 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 on n-h1-852087-9 Sep 07 13:30:07.511636 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-460b0653-6645-4945-9507-b7eda7603057 req-58de9226-7764-4a82-984b-39b46c1bf0f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034344 Sep 07 13:30:07.512610 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3305/6640] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:30:07.792574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-19274d8a-96a8-4e33-b090-57315aa601d9 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:07.793255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-19274d8a-96a8-4e33-b090-57315aa601d9 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:07.800937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19274d8a-96a8-4e33-b090-57315aa601d9 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:07.801469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19274d8a-96a8-4e33-b090-57315aa601d9 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:07.801950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19274d8a-96a8-4e33-b090-57315aa601d9 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:07.802692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19274d8a-96a8-4e33-b090-57315aa601d9 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:07.803166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19274d8a-96a8-4e33-b090-57315aa601d9 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:07.803609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19274d8a-96a8-4e33-b090-57315aa601d9 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:07.843774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19274d8a-96a8-4e33-b090-57315aa601d9 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:07.844286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19274d8a-96a8-4e33-b090-57315aa601d9 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:07.844751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-19274d8a-96a8-4e33-b090-57315aa601d9 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:07.845216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-19274d8a-96a8-4e33-b090-57315aa601d9 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lazy-loading 'fault' on Instance uuid 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:30:07.896298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-19274d8a-96a8-4e33-b090-57315aa601d9 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5e615495243fd8fe6541e6c828a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbb0cc60bcc4538a2a7ba695efcf613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:30:07.911120 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-19274d8a-96a8-4e33-b090-57315aa601d9 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5" status: 200 len: 1338 microversion: 2.1 time: 0.122354 Sep 07 13:30:07.917557 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3336/6641] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:07 2022] GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 => generated 1338 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:30:08.950650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8b7415a3-1b34-4dad-a515-ad9fe45087ea tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:08.951380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8b7415a3-1b34-4dad-a515-ad9fe45087ea tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] [instance: 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:08.958213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b7415a3-1b34-4dad-a515-ad9fe45087ea tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:08.958712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b7415a3-1b34-4dad-a515-ad9fe45087ea tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:08.959150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b7415a3-1b34-4dad-a515-ad9fe45087ea tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:08.959863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b7415a3-1b34-4dad-a515-ad9fe45087ea tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:08.960320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b7415a3-1b34-4dad-a515-ad9fe45087ea tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:08.960745 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8b7415a3-1b34-4dad-a515-ad9fe45087ea tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:08.976992 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-8b7415a3-1b34-4dad-a515-ad9fe45087ea tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] HTTP exception thrown: Instance 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 could not be found. Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8b7415a3-1b34-4dad-a515-ad9fe45087ea tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Request method failure captured: Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 HTTP/1.1 Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJu8nAGMibq2l4eAF7l5biF2p744erQn5M0V4SKZph7Wrzt-LbIbQka51QAnSR_58ciST0UDuAPBEX5SVse91Nhn7h7i2ynC5f2VK4N5DX2LGHbs_CoBAmNjXqjm6tb8EwVgkWv9bUN3aMjaCKCNJxOyxZM96187i0X1etOdgNlpoKw Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 2bbb0cc60bcc4538a2a7ba695efcf613 Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TestNetworkBasicOps-1540191208 Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2bbb0cc60bcc4538a2a7ba695efcf613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2bbb0cc60bcc4538a2a7ba695efcf613"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2bbb0cc60bcc4538a2a7ba695efcf613"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2bbb0cc60bcc4538a2a7ba695efcf613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TestNetworkBasicOps-1540191208 Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 2bbb0cc60bcc4538a2a7ba695efcf613 Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestNetworkBasicOps-1540191208 Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TestNetworkBasicOps-1540191208-project Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 3fc5e615495243fd8fe6541e6c828a45 Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TestNetworkBasicOps-1540191208-project Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 could not be found. Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5'} Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 could not be found. Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 could not be found. Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:30:08.978921 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:30:08.985737 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:30:08.985737 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:30:08.985737 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:30:08.985737 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:30:08.985737 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:30:08.985737 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 could not be found. Sep 07 13:30:08.985737 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:30:08.985737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8b7415a3-1b34-4dad-a515-ad9fe45087ea tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Returning 404 to user: Instance 3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:30:08.985737 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8b7415a3-1b34-4dad-a515-ad9fe45087ea tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5" status: 404 len: 111 microversion: 2.1 time: 0.035048 Sep 07 13:30:08.985737 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3306/6642] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:08 2022] GET /compute/v2.1/servers/3fe3d93c-28d6-4fa6-988f-d445b6b0c3e5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:30:09.209979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-06e65ae3-0e47-401d-b510-85ab800e6316 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] Calling method '.version_select at 0x7fc4188ca3a0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:09.237448 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-06e65ae3-0e47-401d-b510-85ab800e6316 tempest-TestNetworkBasicOps-1540191208 tempest-TestNetworkBasicOps-1540191208-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1516964383" status: 202 len: 0 microversion: 2.1 time: 0.035298 Sep 07 13:30:09.238184 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3337/6643] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Sep 7 13:30:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1516964383 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:30:16.632567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-14092783-d30e-404c-9554-2afa799fbbb3 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Action: 'create', calling method: .version_select at 0x7fc41941ad30>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1034093429", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWJTFHlZGYQcgqzz5Vm3v9N5sDXyOwOGDLl2WEd3bMbsVWqZPuYuVMnkSP1PeEumKoVL2PnaIabAMnUubVjfcGKMpEGYQL7ZFoY3sfj8K3Oze6LFhWgreoCdjGRYKxOhQ=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:30:16.652301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-14092783-d30e-404c-9554-2afa799fbbb3 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Getting quotas for project cc883787099641cdab549780c967225c. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:30:16.658476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-14092783-d30e-404c-9554-2afa799fbbb3 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Getting quotas for user 77133736e0d34391973ed925eba8e7cf and project cc883787099641cdab549780c967225c. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:30:16.689720 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-14092783-d30e-404c-9554-2afa799fbbb3 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.264763 Sep 07 13:30:16.690419 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3307/6644] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 13:30:16 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:30:23.320930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8cfe9c1e-9907-4a89-8a74-25b6463c6d14 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1132788439-access_point-1376172154", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "4dca1619-34ae-446d-b405-3fff9f55d8d4"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1034093429", "security_groups": [{"name": "tempest-secgroup_access--229482526"}, {"name": "tempest-secgroup_general--654687887"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:30:23.353477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:23.354769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:23.537569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-8cfe9c1e-9907-4a89-8a74-25b6463c6d14 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] validate_networks() for [('4dca1619-34ae-446d-b405-3fff9f55d8d4', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:30:23.981323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8cfe9c1e-9907-4a89-8a74-25b6463c6d14 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:30:23.981476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8cfe9c1e-9907-4a89-8a74-25b6463c6d14 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:30:23.983035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8cfe9c1e-9907-4a89-8a74-25b6463c6d14 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:30:23.983716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8cfe9c1e-9907-4a89-8a74-25b6463c6d14 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:30:23.984438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-8cfe9c1e-9907-4a89-8a74-25b6463c6d14 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:30:24.004188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8cfe9c1e-9907-4a89-8a74-25b6463c6d14 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:24.004496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8cfe9c1e-9907-4a89-8a74-25b6463c6d14 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:24.005207 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8cfe9c1e-9907-4a89-8a74-25b6463c6d14 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:24.006577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8cfe9c1e-9907-4a89-8a74-25b6463c6d14 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:24.007696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8cfe9c1e-9907-4a89-8a74-25b6463c6d14 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:24.008643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8cfe9c1e-9907-4a89-8a74-25b6463c6d14 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:24.045447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-8cfe9c1e-9907-4a89-8a74-25b6463c6d14 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Getting quotas for project cc883787099641cdab549780c967225c. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:30:24.054042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-8cfe9c1e-9907-4a89-8a74-25b6463c6d14 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Getting quotas for user 77133736e0d34391973ed925eba8e7cf and project cc883787099641cdab549780c967225c. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:30:24.073873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8cfe9c1e-9907-4a89-8a74-25b6463c6d14 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:30:24.076890 n-d-852087-9 devstack@n-api.service[122433]: WARNING nova.utils [None req-8cfe9c1e-9907-4a89-8a74-25b6463c6d14 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1132788439-access_point-1376172154 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1132788439-ac Sep 07 13:30:24.077792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8cfe9c1e-9907-4a89-8a74-25b6463c6d14 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: eaa3c72e-6b27-422d-bd9c-664908cf9837] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:30:24.153767 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8cfe9c1e-9907-4a89-8a74-25b6463c6d14 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 0.840439 Sep 07 13:30:24.165804 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3338/6645] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:30:23 2022] POST /compute/v2.1/servers => generated 456 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:30:24.172555 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=16 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:24.178496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-63a6f663-c324-4157-a455-f9663ec0c03a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:24.179381 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-63a6f663-c324-4157-a455-f9663ec0c03a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: eaa3c72e-6b27-422d-bd9c-664908cf9837] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:24.256891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-63a6f663-c324-4157-a455-f9663ec0c03a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:30:24.265500 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-63a6f663-c324-4157-a455-f9663ec0c03a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837" status: 200 len: 1295 microversion: 2.1 time: 0.094994 Sep 07 13:30:24.266121 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3308/6646] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:24 2022] GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837 => generated 1295 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:30:25.290158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1531ea5c-54b2-495d-af15-e122fa788b55 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:25.291034 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1531ea5c-54b2-495d-af15-e122fa788b55 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: eaa3c72e-6b27-422d-bd9c-664908cf9837] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:25.300452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1531ea5c-54b2-495d-af15-e122fa788b55 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:25.301524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1531ea5c-54b2-495d-af15-e122fa788b55 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:25.302694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1531ea5c-54b2-495d-af15-e122fa788b55 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:25.304104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1531ea5c-54b2-495d-af15-e122fa788b55 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:25.304914 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1531ea5c-54b2-495d-af15-e122fa788b55 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:25.305744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1531ea5c-54b2-495d-af15-e122fa788b55 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:25.383501 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1531ea5c-54b2-495d-af15-e122fa788b55 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:30:25.395711 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1531ea5c-54b2-495d-af15-e122fa788b55 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837" status: 200 len: 1347 microversion: 2.1 time: 0.109257 Sep 07 13:30:25.396715 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3339/6647] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:25 2022] GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837 => generated 1347 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:30:26.428973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cbf637f5-cc41-418a-83cd-8ba2cf85a1e9 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:26.430799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cbf637f5-cc41-418a-83cd-8ba2cf85a1e9 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: eaa3c72e-6b27-422d-bd9c-664908cf9837] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:26.444697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbf637f5-cc41-418a-83cd-8ba2cf85a1e9 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:26.445586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbf637f5-cc41-418a-83cd-8ba2cf85a1e9 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:26.446339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbf637f5-cc41-418a-83cd-8ba2cf85a1e9 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:26.448596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbf637f5-cc41-418a-83cd-8ba2cf85a1e9 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:26.448596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbf637f5-cc41-418a-83cd-8ba2cf85a1e9 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:26.449328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cbf637f5-cc41-418a-83cd-8ba2cf85a1e9 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:26.679037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cbf637f5-cc41-418a-83cd-8ba2cf85a1e9 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:30:26.690817 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cbf637f5-cc41-418a-83cd-8ba2cf85a1e9 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837" status: 200 len: 1471 microversion: 2.1 time: 0.269618 Sep 07 13:30:26.692078 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3309/6648] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:26 2022] GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837 => generated 1471 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:30:27.422158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-2e2b83cc-4626-4b98-88d6-ae9dbc9b1a7c req-50d294f9-a215-48f5-b6b6-2de5fd0a1105 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaa3c72e-6b27-422d-bd9c-664908cf9837", "tag": "3e19c71d-fd10-4477-8d5a-e070340ca179"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:30:27.433924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2e2b83cc-4626-4b98-88d6-ae9dbc9b1a7c req-50d294f9-a215-48f5-b6b6-2de5fd0a1105 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:27.434482 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2e2b83cc-4626-4b98-88d6-ae9dbc9b1a7c req-50d294f9-a215-48f5-b6b6-2de5fd0a1105 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:27.434945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2e2b83cc-4626-4b98-88d6-ae9dbc9b1a7c req-50d294f9-a215-48f5-b6b6-2de5fd0a1105 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:27.448315 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-2e2b83cc-4626-4b98-88d6-ae9dbc9b1a7c req-50d294f9-a215-48f5-b6b6-2de5fd0a1105 service nova] Creating event network-changed:3e19c71d-fd10-4477-8d5a-e070340ca179 for instance eaa3c72e-6b27-422d-bd9c-664908cf9837 on n-h2-852087-9 Sep 07 13:30:27.454017 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-2e2b83cc-4626-4b98-88d6-ae9dbc9b1a7c req-50d294f9-a215-48f5-b6b6-2de5fd0a1105 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035907 Sep 07 13:30:27.454649 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3340/6649] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:30:27.722173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-74d2374e-71e4-48ec-80c0-35c5106c97ec tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:27.723128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-74d2374e-71e4-48ec-80c0-35c5106c97ec tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: eaa3c72e-6b27-422d-bd9c-664908cf9837] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:27.731239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74d2374e-71e4-48ec-80c0-35c5106c97ec tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:27.731960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74d2374e-71e4-48ec-80c0-35c5106c97ec tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:27.732635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74d2374e-71e4-48ec-80c0-35c5106c97ec tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:27.733954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74d2374e-71e4-48ec-80c0-35c5106c97ec tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:27.734432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74d2374e-71e4-48ec-80c0-35c5106c97ec tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:27.735677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74d2374e-71e4-48ec-80c0-35c5106c97ec tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:27.918039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-74d2374e-71e4-48ec-80c0-35c5106c97ec tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:30:27.927363 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-74d2374e-71e4-48ec-80c0-35c5106c97ec tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837" status: 200 len: 1471 microversion: 2.1 time: 0.210627 Sep 07 13:30:27.927977 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3310/6650] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:27 2022] GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837 => generated 1471 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:30:28.956543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8802b5cc-f946-4be4-a77a-8d85bd1cbaa5 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:28.957403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8802b5cc-f946-4be4-a77a-8d85bd1cbaa5 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: eaa3c72e-6b27-422d-bd9c-664908cf9837] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:28.964030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8802b5cc-f946-4be4-a77a-8d85bd1cbaa5 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:28.964538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8802b5cc-f946-4be4-a77a-8d85bd1cbaa5 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:28.965328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8802b5cc-f946-4be4-a77a-8d85bd1cbaa5 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:28.966163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8802b5cc-f946-4be4-a77a-8d85bd1cbaa5 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:28.966641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8802b5cc-f946-4be4-a77a-8d85bd1cbaa5 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:28.967099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8802b5cc-f946-4be4-a77a-8d85bd1cbaa5 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:29.125186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8802b5cc-f946-4be4-a77a-8d85bd1cbaa5 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:30:29.133779 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8802b5cc-f946-4be4-a77a-8d85bd1cbaa5 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837" status: 200 len: 1471 microversion: 2.1 time: 0.182343 Sep 07 13:30:29.134380 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3341/6651] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:28 2022] GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837 => generated 1471 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:30:30.157327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-160786d9-048f-4cdd-be8f-249c7ad3d8c5 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:30.158056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-160786d9-048f-4cdd-be8f-249c7ad3d8c5 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: eaa3c72e-6b27-422d-bd9c-664908cf9837] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:30.165352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-160786d9-048f-4cdd-be8f-249c7ad3d8c5 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:30.165898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-160786d9-048f-4cdd-be8f-249c7ad3d8c5 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:30.166336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-160786d9-048f-4cdd-be8f-249c7ad3d8c5 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:30.167059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-160786d9-048f-4cdd-be8f-249c7ad3d8c5 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:30.167518 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-160786d9-048f-4cdd-be8f-249c7ad3d8c5 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:30.167949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-160786d9-048f-4cdd-be8f-249c7ad3d8c5 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:30.331111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-160786d9-048f-4cdd-be8f-249c7ad3d8c5 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:30:30.340606 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-160786d9-048f-4cdd-be8f-249c7ad3d8c5 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837" status: 200 len: 1471 microversion: 2.1 time: 0.186973 Sep 07 13:30:30.341181 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3311/6652] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:30 2022] GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837 => generated 1471 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:30:31.364090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-72b22d1b-427c-428d-98f3-f63f734729e6 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:31.364764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-72b22d1b-427c-428d-98f3-f63f734729e6 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: eaa3c72e-6b27-422d-bd9c-664908cf9837] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:31.372440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72b22d1b-427c-428d-98f3-f63f734729e6 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:31.372959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72b22d1b-427c-428d-98f3-f63f734729e6 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:31.373432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72b22d1b-427c-428d-98f3-f63f734729e6 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:31.374207 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72b22d1b-427c-428d-98f3-f63f734729e6 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:31.374684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72b22d1b-427c-428d-98f3-f63f734729e6 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:31.375130 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72b22d1b-427c-428d-98f3-f63f734729e6 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:31.535826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-72b22d1b-427c-428d-98f3-f63f734729e6 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:30:31.543988 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-72b22d1b-427c-428d-98f3-f63f734729e6 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837" status: 200 len: 1471 microversion: 2.1 time: 0.183704 Sep 07 13:30:31.544579 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3342/6653] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:31 2022] GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837 => generated 1471 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:30:32.566708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9eb9171c-1389-4e96-886d-304ef73fe261 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:32.567497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9eb9171c-1389-4e96-886d-304ef73fe261 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: eaa3c72e-6b27-422d-bd9c-664908cf9837] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:32.575984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9eb9171c-1389-4e96-886d-304ef73fe261 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:32.576500 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9eb9171c-1389-4e96-886d-304ef73fe261 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:32.576947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9eb9171c-1389-4e96-886d-304ef73fe261 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:32.577714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9eb9171c-1389-4e96-886d-304ef73fe261 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:32.578389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9eb9171c-1389-4e96-886d-304ef73fe261 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:32.578837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9eb9171c-1389-4e96-886d-304ef73fe261 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:32.724180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-d2e25cc7-d8da-4931-a62a-c5017e2b60eb req-ec8afa3e-950a-4fd5-a8f6-33921f4a4e34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaa3c72e-6b27-422d-bd9c-664908cf9837", "name": "network-vif-plugged", "status": "completed", "tag": "3e19c71d-fd10-4477-8d5a-e070340ca179"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:30:32.739378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d2e25cc7-d8da-4931-a62a-c5017e2b60eb req-ec8afa3e-950a-4fd5-a8f6-33921f4a4e34 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:32.740201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d2e25cc7-d8da-4931-a62a-c5017e2b60eb req-ec8afa3e-950a-4fd5-a8f6-33921f4a4e34 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:32.740663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d2e25cc7-d8da-4931-a62a-c5017e2b60eb req-ec8afa3e-950a-4fd5-a8f6-33921f4a4e34 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:32.756247 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-d2e25cc7-d8da-4931-a62a-c5017e2b60eb req-ec8afa3e-950a-4fd5-a8f6-33921f4a4e34 service nova] Creating event network-vif-plugged:3e19c71d-fd10-4477-8d5a-e070340ca179 for instance eaa3c72e-6b27-422d-bd9c-664908cf9837 on n-h2-852087-9 Sep 07 13:30:32.765022 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-d2e25cc7-d8da-4931-a62a-c5017e2b60eb req-ec8afa3e-950a-4fd5-a8f6-33921f4a4e34 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046861 Sep 07 13:30:32.766364 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3343/6654] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:30:32.770753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9eb9171c-1389-4e96-886d-304ef73fe261 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:30:32.780041 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9eb9171c-1389-4e96-886d-304ef73fe261 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837" status: 200 len: 1471 microversion: 2.1 time: 0.217346 Sep 07 13:30:32.780645 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3312/6655] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:32 2022] GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837 => generated 1471 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:30:33.806134 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-40a9e8f8-708f-4d3d-ae4d-f2ba1f0d3360 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:33.806859 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-40a9e8f8-708f-4d3d-ae4d-f2ba1f0d3360 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: eaa3c72e-6b27-422d-bd9c-664908cf9837] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:33.813704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40a9e8f8-708f-4d3d-ae4d-f2ba1f0d3360 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:33.814221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40a9e8f8-708f-4d3d-ae4d-f2ba1f0d3360 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:33.814675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40a9e8f8-708f-4d3d-ae4d-f2ba1f0d3360 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:33.815408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40a9e8f8-708f-4d3d-ae4d-f2ba1f0d3360 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:33.815884 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40a9e8f8-708f-4d3d-ae4d-f2ba1f0d3360 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:33.816318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-40a9e8f8-708f-4d3d-ae4d-f2ba1f0d3360 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:33.979221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-40a9e8f8-708f-4d3d-ae4d-f2ba1f0d3360 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:30:33.987388 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-40a9e8f8-708f-4d3d-ae4d-f2ba1f0d3360 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837" status: 200 len: 1471 microversion: 2.1 time: 0.186968 Sep 07 13:30:33.987985 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3344/6656] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:33 2022] GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837 => generated 1471 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:30:35.015053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5d6471f6-dc1a-4e76-9115-2d122b782f68 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:35.015694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5d6471f6-dc1a-4e76-9115-2d122b782f68 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: eaa3c72e-6b27-422d-bd9c-664908cf9837] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:35.018382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:35.019058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:35.025978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d6471f6-dc1a-4e76-9115-2d122b782f68 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:35.026504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d6471f6-dc1a-4e76-9115-2d122b782f68 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:35.026950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d6471f6-dc1a-4e76-9115-2d122b782f68 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:35.027691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d6471f6-dc1a-4e76-9115-2d122b782f68 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:35.028221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d6471f6-dc1a-4e76-9115-2d122b782f68 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:35.028662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d6471f6-dc1a-4e76-9115-2d122b782f68 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:35.190466 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5d6471f6-dc1a-4e76-9115-2d122b782f68 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:30:35.198986 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5d6471f6-dc1a-4e76-9115-2d122b782f68 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837" status: 200 len: 1643 microversion: 2.1 time: 0.187952 Sep 07 13:30:35.199596 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3313/6657] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:35 2022] GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837 => generated 1643 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:30:35.222563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-79d74fde-a239-41a3-a0a2-da4a34064f08 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:35.223231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-79d74fde-a239-41a3-a0a2-da4a34064f08 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: eaa3c72e-6b27-422d-bd9c-664908cf9837] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:35.225255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:35.226127 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:35.233828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79d74fde-a239-41a3-a0a2-da4a34064f08 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:35.234631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79d74fde-a239-41a3-a0a2-da4a34064f08 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:35.234800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79d74fde-a239-41a3-a0a2-da4a34064f08 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:35.236026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79d74fde-a239-41a3-a0a2-da4a34064f08 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:35.236026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79d74fde-a239-41a3-a0a2-da4a34064f08 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:35.236420 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-79d74fde-a239-41a3-a0a2-da4a34064f08 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:35.399160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-79d74fde-a239-41a3-a0a2-da4a34064f08 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:30:35.407955 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-79d74fde-a239-41a3-a0a2-da4a34064f08 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837" status: 200 len: 1643 microversion: 2.1 time: 0.189454 Sep 07 13:30:35.408568 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3345/6658] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:35 2022] GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837 => generated 1643 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:30:35.432019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ce16b454-943c-4e56-8581-113ba334049a tempest-TestSecurityGroupsBasicOps-597466337 tempest-TestSecurityGroupsBasicOps-597466337-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:30:35.432679 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ce16b454-943c-4e56-8581-113ba334049a tempest-TestSecurityGroupsBasicOps-597466337 tempest-TestSecurityGroupsBasicOps-597466337-project-admin] [instance: eaa3c72e-6b27-422d-bd9c-664908cf9837] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:30:35.439139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce16b454-943c-4e56-8581-113ba334049a tempest-TestSecurityGroupsBasicOps-597466337 tempest-TestSecurityGroupsBasicOps-597466337-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:35.439631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce16b454-943c-4e56-8581-113ba334049a tempest-TestSecurityGroupsBasicOps-597466337 tempest-TestSecurityGroupsBasicOps-597466337-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:35.440073 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce16b454-943c-4e56-8581-113ba334049a tempest-TestSecurityGroupsBasicOps-597466337 tempest-TestSecurityGroupsBasicOps-597466337-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:35.440781 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce16b454-943c-4e56-8581-113ba334049a tempest-TestSecurityGroupsBasicOps-597466337 tempest-TestSecurityGroupsBasicOps-597466337-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:35.441239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce16b454-943c-4e56-8581-113ba334049a tempest-TestSecurityGroupsBasicOps-597466337 tempest-TestSecurityGroupsBasicOps-597466337-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:35.441773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce16b454-943c-4e56-8581-113ba334049a tempest-TestSecurityGroupsBasicOps-597466337 tempest-TestSecurityGroupsBasicOps-597466337-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:35.704603 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ce16b454-943c-4e56-8581-113ba334049a tempest-TestSecurityGroupsBasicOps-597466337 tempest-TestSecurityGroupsBasicOps-597466337-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837" status: 200 len: 1794 microversion: 2.1 time: 0.277571 Sep 07 13:30:35.705243 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3314/6659] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:30:35 2022] GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837 => generated 1794 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:30:37.678097 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-29a8fc99-5e58-483e-b857-efb68ca24c74 req-6cd08d3c-3a67-4411-b65a-82c3595e7cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaa3c72e-6b27-422d-bd9c-664908cf9837", "tag": "3e19c71d-fd10-4477-8d5a-e070340ca179"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:30:37.692130 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-29a8fc99-5e58-483e-b857-efb68ca24c74 req-6cd08d3c-3a67-4411-b65a-82c3595e7cc2 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:30:37.692620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-29a8fc99-5e58-483e-b857-efb68ca24c74 req-6cd08d3c-3a67-4411-b65a-82c3595e7cc2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:30:37.693322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-29a8fc99-5e58-483e-b857-efb68ca24c74 req-6cd08d3c-3a67-4411-b65a-82c3595e7cc2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:30:37.705621 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-29a8fc99-5e58-483e-b857-efb68ca24c74 req-6cd08d3c-3a67-4411-b65a-82c3595e7cc2 service nova] Creating event network-changed:3e19c71d-fd10-4477-8d5a-e070340ca179 for instance eaa3c72e-6b27-422d-bd9c-664908cf9837 on n-h2-852087-9 Sep 07 13:30:37.711813 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-29a8fc99-5e58-483e-b857-efb68ca24c74 req-6cd08d3c-3a67-4411-b65a-82c3595e7cc2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037369 Sep 07 13:30:37.712944 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3346/6660] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:31:20.695895 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dad1d5ed-00ab-4f7c-9b37-9ebfeba28c8d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1661912484", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "90da895a-0887-4031-9e80-8104352e1f74"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1034093429", "security_groups": []}, "os:scheduler_hints": {"different_host": ["eaa3c72e-6b27-422d-bd9c-664908cf9837"]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:31:20.705755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:31:20.706491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=36 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:31:20.895333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-dad1d5ed-00ab-4f7c-9b37-9ebfeba28c8d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] validate_networks() for [('90da895a-0887-4031-9e80-8104352e1f74', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:31:21.476817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-dad1d5ed-00ab-4f7c-9b37-9ebfeba28c8d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:31:21.477982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-dad1d5ed-00ab-4f7c-9b37-9ebfeba28c8d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:31:21.478802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-dad1d5ed-00ab-4f7c-9b37-9ebfeba28c8d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:31:21.479863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-dad1d5ed-00ab-4f7c-9b37-9ebfeba28c8d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:31:21.480679 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-dad1d5ed-00ab-4f7c-9b37-9ebfeba28c8d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:31:21.493369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dad1d5ed-00ab-4f7c-9b37-9ebfeba28c8d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:21.494362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dad1d5ed-00ab-4f7c-9b37-9ebfeba28c8d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:21.494885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dad1d5ed-00ab-4f7c-9b37-9ebfeba28c8d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:21.499325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dad1d5ed-00ab-4f7c-9b37-9ebfeba28c8d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:21.499878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dad1d5ed-00ab-4f7c-9b37-9ebfeba28c8d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:21.500864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dad1d5ed-00ab-4f7c-9b37-9ebfeba28c8d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:21.525994 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-dad1d5ed-00ab-4f7c-9b37-9ebfeba28c8d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Getting quotas for project cc883787099641cdab549780c967225c. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:31:21.532596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-dad1d5ed-00ab-4f7c-9b37-9ebfeba28c8d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Getting quotas for user 77133736e0d34391973ed925eba8e7cf and project cc883787099641cdab549780c967225c. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:31:21.553594 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dad1d5ed-00ab-4f7c-9b37-9ebfeba28c8d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:31:21.556359 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dad1d5ed-00ab-4f7c-9b37-9ebfeba28c8d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: 8308971d-b655-448c-86a8-8d262c2cc61d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:31:21.635976 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dad1d5ed-00ab-4f7c-9b37-9ebfeba28c8d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.943319 Sep 07 13:31:21.637353 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3315/6661] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:31:20 2022] POST /compute/v2.1/servers => generated 361 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:31:21.651288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7ae6e649-b5c2-4298-bd16-661f8f80ef4e tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:21.652269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7ae6e649-b5c2-4298-bd16-661f8f80ef4e tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: 8308971d-b655-448c-86a8-8d262c2cc61d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:21.656108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:31:21.656793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=38 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:31:21.754958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-95e21648-0a32-4386-8b8b-b562d42aa7cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-810778455", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2091031878", "security_groups": [{"name": "tempest-secgroup-smoke-801476543"}], "block_device_mapping_v2": [{"uuid": "202ba0ea-d8ca-4e1f-820d-3526382adf30", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7f5512e3-cd6c-43c3-ae4c-0cca06e090be"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:31:21.824730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7ae6e649-b5c2-4298-bd16-661f8f80ef4e tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:21.833695 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7ae6e649-b5c2-4298-bd16-661f8f80ef4e tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d" status: 200 len: 1242 microversion: 2.1 time: 0.188233 Sep 07 13:31:21.834526 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3347/6662] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:21 2022] GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d => generated 1242 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:21.937709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-95e21648-0a32-4386-8b8b-b562d42aa7cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] validate_networks() for [('7f5512e3-cd6c-43c3-ae4c-0cca06e090be', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:31:22.456452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-95e21648-0a32-4386-8b8b-b562d42aa7cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:31:22.457581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-95e21648-0a32-4386-8b8b-b562d42aa7cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:31:22.458724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-95e21648-0a32-4386-8b8b-b562d42aa7cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:31:22.459459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-95e21648-0a32-4386-8b8b-b562d42aa7cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:31:22.460477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-95e21648-0a32-4386-8b8b-b562d42aa7cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:31:22.475817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95e21648-0a32-4386-8b8b-b562d42aa7cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:22.476598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95e21648-0a32-4386-8b8b-b562d42aa7cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:22.477092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95e21648-0a32-4386-8b8b-b562d42aa7cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:22.477947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95e21648-0a32-4386-8b8b-b562d42aa7cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:22.478534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95e21648-0a32-4386-8b8b-b562d42aa7cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:22.479016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95e21648-0a32-4386-8b8b-b562d42aa7cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:22.501700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-95e21648-0a32-4386-8b8b-b562d42aa7cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Getting quotas for project b97b8dd299f145888f90fbf60321cd18. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:31:22.507987 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-95e21648-0a32-4386-8b8b-b562d42aa7cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Getting quotas for user 90d330a2d2ad4295873277de2d649182 and project b97b8dd299f145888f90fbf60321cd18. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:31:22.609859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-95e21648-0a32-4386-8b8b-b562d42aa7cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:31:22.613261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-95e21648-0a32-4386-8b8b-b562d42aa7cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='202ba0ea-d8ca-4e1f-820d-3526382adf30',volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:31:22.769443 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-95e21648-0a32-4386-8b8b-b562d42aa7cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.019291 Sep 07 13:31:22.771048 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3316/6663] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:31:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:31:22.783269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a2ad165b-363b-471f-9e37-48ee4d1d4598 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:22.784535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a2ad165b-363b-471f-9e37-48ee4d1d4598 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:22.858292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2f0c8936-6d0c-42c8-8f35-12b52603cf5b tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:22.858777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2f0c8936-6d0c-42c8-8f35-12b52603cf5b tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: 8308971d-b655-448c-86a8-8d262c2cc61d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:22.886788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a2ad165b-363b-471f-9e37-48ee4d1d4598 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:22.913189 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a2ad165b-363b-471f-9e37-48ee4d1d4598 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e" status: 200 len: 1094 microversion: 2.1 time: 0.133234 Sep 07 13:31:22.915063 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3348/6664] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:22 2022] GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e => generated 1094 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:31:22.993804 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2f0c8936-6d0c-42c8-8f35-12b52603cf5b tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:23.021068 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2f0c8936-6d0c-42c8-8f35-12b52603cf5b tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d" status: 200 len: 1242 microversion: 2.1 time: 0.166901 Sep 07 13:31:23.022130 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3317/6665] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:22 2022] GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d => generated 1242 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:24.006608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3250a213-0f2d-4e1d-924b-feb2e3732511 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:24.008266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3250a213-0f2d-4e1d-924b-feb2e3732511 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:24.017812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3250a213-0f2d-4e1d-924b-feb2e3732511 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:24.018374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3250a213-0f2d-4e1d-924b-feb2e3732511 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:24.018926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3250a213-0f2d-4e1d-924b-feb2e3732511 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:24.019801 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3250a213-0f2d-4e1d-924b-feb2e3732511 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:24.020412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3250a213-0f2d-4e1d-924b-feb2e3732511 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:24.023552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3250a213-0f2d-4e1d-924b-feb2e3732511 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:24.045193 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-01768bc6-b20a-4130-9bfd-49fe778bc1bd tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:24.045932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-01768bc6-b20a-4130-9bfd-49fe778bc1bd tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: 8308971d-b655-448c-86a8-8d262c2cc61d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:24.057048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01768bc6-b20a-4130-9bfd-49fe778bc1bd tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:24.060687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01768bc6-b20a-4130-9bfd-49fe778bc1bd tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:24.061243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01768bc6-b20a-4130-9bfd-49fe778bc1bd tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:24.062109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01768bc6-b20a-4130-9bfd-49fe778bc1bd tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:24.062644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01768bc6-b20a-4130-9bfd-49fe778bc1bd tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:24.063408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-01768bc6-b20a-4130-9bfd-49fe778bc1bd tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:24.145516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3250a213-0f2d-4e1d-924b-feb2e3732511 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:24.157849 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3250a213-0f2d-4e1d-924b-feb2e3732511 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e" status: 200 len: 1192 microversion: 2.1 time: 0.224291 Sep 07 13:31:24.160313 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3349/6666] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:23 2022] GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e => generated 1192 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:24.190902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-01768bc6-b20a-4130-9bfd-49fe778bc1bd tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:24.205025 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-01768bc6-b20a-4130-9bfd-49fe778bc1bd tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d" status: 200 len: 1246 microversion: 2.1 time: 0.163673 Sep 07 13:31:24.221011 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3318/6667] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:24 2022] GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d => generated 1246 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:25.193290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1cd0597f-2a14-427d-b104-81a40d99230c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:25.195649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1cd0597f-2a14-427d-b104-81a40d99230c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:25.211790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cd0597f-2a14-427d-b104-81a40d99230c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:25.212349 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cd0597f-2a14-427d-b104-81a40d99230c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:25.212953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cd0597f-2a14-427d-b104-81a40d99230c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:25.216388 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cd0597f-2a14-427d-b104-81a40d99230c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:25.217380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cd0597f-2a14-427d-b104-81a40d99230c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:25.218467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cd0597f-2a14-427d-b104-81a40d99230c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:25.230363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-11b82b25-2749-484a-a8b8-ccdf61391873 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:25.231647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-11b82b25-2749-484a-a8b8-ccdf61391873 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: 8308971d-b655-448c-86a8-8d262c2cc61d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:25.251504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11b82b25-2749-484a-a8b8-ccdf61391873 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:25.252363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11b82b25-2749-484a-a8b8-ccdf61391873 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:25.252983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11b82b25-2749-484a-a8b8-ccdf61391873 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:25.253946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11b82b25-2749-484a-a8b8-ccdf61391873 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:25.254838 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11b82b25-2749-484a-a8b8-ccdf61391873 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:25.255473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11b82b25-2749-484a-a8b8-ccdf61391873 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:25.399632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-11b82b25-2749-484a-a8b8-ccdf61391873 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:25.415201 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-11b82b25-2749-484a-a8b8-ccdf61391873 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d" status: 200 len: 1302 microversion: 2.1 time: 0.188946 Sep 07 13:31:25.416549 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3319/6668] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:25 2022] GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d => generated 1302 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:25.462644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1cd0597f-2a14-427d-b104-81a40d99230c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:25.471945 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1cd0597f-2a14-427d-b104-81a40d99230c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e" status: 200 len: 1277 microversion: 2.1 time: 0.290786 Sep 07 13:31:25.472632 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3350/6669] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:25 2022] GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e => generated 1277 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:31:26.446702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bbf0f78f-424e-489e-88c2-2ac3200b460d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:26.449199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bbf0f78f-424e-489e-88c2-2ac3200b460d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: 8308971d-b655-448c-86a8-8d262c2cc61d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:26.461121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbf0f78f-424e-489e-88c2-2ac3200b460d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:26.461826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbf0f78f-424e-489e-88c2-2ac3200b460d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:26.462555 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbf0f78f-424e-489e-88c2-2ac3200b460d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:26.463385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbf0f78f-424e-489e-88c2-2ac3200b460d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:26.464560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbf0f78f-424e-489e-88c2-2ac3200b460d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:26.465428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bbf0f78f-424e-489e-88c2-2ac3200b460d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:26.497009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0fb4ef17-bcc9-4547-bac5-a685950efdc0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:26.498090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0fb4ef17-bcc9-4547-bac5-a685950efdc0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:26.506896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fb4ef17-bcc9-4547-bac5-a685950efdc0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:26.507765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fb4ef17-bcc9-4547-bac5-a685950efdc0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:26.508459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fb4ef17-bcc9-4547-bac5-a685950efdc0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:26.509429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fb4ef17-bcc9-4547-bac5-a685950efdc0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:26.510141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fb4ef17-bcc9-4547-bac5-a685950efdc0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:26.510795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0fb4ef17-bcc9-4547-bac5-a685950efdc0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:26.693635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bbf0f78f-424e-489e-88c2-2ac3200b460d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:26.707461 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bbf0f78f-424e-489e-88c2-2ac3200b460d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d" status: 200 len: 1300 microversion: 2.1 time: 0.267946 Sep 07 13:31:26.709663 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3320/6670] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:26 2022] GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d => generated 1300 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:26.730871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b86d787c-6318-4d2e-8eeb-a365ae07cd10 req-0d4fe99d-e4f4-427e-9539-c910e7264a6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "269230b1-3aaa-486d-9835-7e47d18bc16e", "tag": "751321c5-12e0-4491-a76a-5e2b987f658e"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:31:26.746162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b86d787c-6318-4d2e-8eeb-a365ae07cd10 req-0d4fe99d-e4f4-427e-9539-c910e7264a6f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:26.746665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b86d787c-6318-4d2e-8eeb-a365ae07cd10 req-0d4fe99d-e4f4-427e-9539-c910e7264a6f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:26.747095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b86d787c-6318-4d2e-8eeb-a365ae07cd10 req-0d4fe99d-e4f4-427e-9539-c910e7264a6f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:26.772439 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b86d787c-6318-4d2e-8eeb-a365ae07cd10 req-0d4fe99d-e4f4-427e-9539-c910e7264a6f service nova] Creating event network-changed:751321c5-12e0-4491-a76a-5e2b987f658e for instance 269230b1-3aaa-486d-9835-7e47d18bc16e on n-h2-852087-9 Sep 07 13:31:26.790723 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b86d787c-6318-4d2e-8eeb-a365ae07cd10 req-0d4fe99d-e4f4-427e-9539-c910e7264a6f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071060 Sep 07 13:31:26.793407 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3321/6671] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:31:26.835830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0fb4ef17-bcc9-4547-bac5-a685950efdc0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:26.847650 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0fb4ef17-bcc9-4547-bac5-a685950efdc0 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e" status: 200 len: 1277 microversion: 2.1 time: 0.355415 Sep 07 13:31:26.848574 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3351/6672] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:26 2022] GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e => generated 1277 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:27.735373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3cea78fb-f723-4712-be49-d35a43f00d89 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:27.736177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3cea78fb-f723-4712-be49-d35a43f00d89 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: 8308971d-b655-448c-86a8-8d262c2cc61d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:27.744705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cea78fb-f723-4712-be49-d35a43f00d89 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:27.745856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cea78fb-f723-4712-be49-d35a43f00d89 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:27.746364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cea78fb-f723-4712-be49-d35a43f00d89 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:27.747724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cea78fb-f723-4712-be49-d35a43f00d89 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:27.748403 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cea78fb-f723-4712-be49-d35a43f00d89 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:27.749008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3cea78fb-f723-4712-be49-d35a43f00d89 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:27.857797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3cea78fb-f723-4712-be49-d35a43f00d89 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:27.868554 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3cea78fb-f723-4712-be49-d35a43f00d89 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d" status: 200 len: 1300 microversion: 2.1 time: 0.137722 Sep 07 13:31:27.871374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1630af5c-6cac-4f48-badd-720ff591153b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:27.872594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1630af5c-6cac-4f48-badd-720ff591153b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:27.883128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1630af5c-6cac-4f48-badd-720ff591153b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:27.883917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1630af5c-6cac-4f48-badd-720ff591153b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:27.884887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1630af5c-6cac-4f48-badd-720ff591153b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:27.885841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1630af5c-6cac-4f48-badd-720ff591153b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:27.886575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1630af5c-6cac-4f48-badd-720ff591153b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:27.887092 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3322/6673] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:27 2022] GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d => generated 1300 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:27.887402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1630af5c-6cac-4f48-badd-720ff591153b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:28.075574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1630af5c-6cac-4f48-badd-720ff591153b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:28.084828 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1630af5c-6cac-4f48-badd-720ff591153b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e" status: 200 len: 1277 microversion: 2.1 time: 0.217805 Sep 07 13:31:28.097371 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3352/6674] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:27 2022] GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e => generated 1277 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:28.861798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-8dcc6ea7-7f70-4b9d-9626-f1201d794fec req-cce3f515-2c48-43b1-904e-36e190646526 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8308971d-b655-448c-86a8-8d262c2cc61d", "tag": "4521f47b-e598-4264-a08e-ffe47407ee67"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:31:28.875339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8dcc6ea7-7f70-4b9d-9626-f1201d794fec req-cce3f515-2c48-43b1-904e-36e190646526 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:28.875918 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8dcc6ea7-7f70-4b9d-9626-f1201d794fec req-cce3f515-2c48-43b1-904e-36e190646526 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:28.876604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-8dcc6ea7-7f70-4b9d-9626-f1201d794fec req-cce3f515-2c48-43b1-904e-36e190646526 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:28.894790 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-8dcc6ea7-7f70-4b9d-9626-f1201d794fec req-cce3f515-2c48-43b1-904e-36e190646526 service nova] Creating event network-changed:4521f47b-e598-4264-a08e-ffe47407ee67 for instance 8308971d-b655-448c-86a8-8d262c2cc61d on n-h1-852087-9 Sep 07 13:31:28.904197 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-8dcc6ea7-7f70-4b9d-9626-f1201d794fec req-cce3f515-2c48-43b1-904e-36e190646526 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046668 Sep 07 13:31:28.906015 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3323/6675] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:31:28.911030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-72f6d1f2-5daa-4057-9b9f-6fc4928e667a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:28.912564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-72f6d1f2-5daa-4057-9b9f-6fc4928e667a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: 8308971d-b655-448c-86a8-8d262c2cc61d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:28.921044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72f6d1f2-5daa-4057-9b9f-6fc4928e667a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:28.921712 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72f6d1f2-5daa-4057-9b9f-6fc4928e667a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:28.922253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72f6d1f2-5daa-4057-9b9f-6fc4928e667a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:28.923092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72f6d1f2-5daa-4057-9b9f-6fc4928e667a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:28.923655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72f6d1f2-5daa-4057-9b9f-6fc4928e667a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:28.924531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72f6d1f2-5daa-4057-9b9f-6fc4928e667a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:29.041852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-72f6d1f2-5daa-4057-9b9f-6fc4928e667a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:29.051880 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-72f6d1f2-5daa-4057-9b9f-6fc4928e667a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d" status: 200 len: 1300 microversion: 2.1 time: 0.146174 Sep 07 13:31:29.052696 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3353/6676] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:28 2022] GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d => generated 1300 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:29.114036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a1d07694-6ecc-4508-8ec1-e5765f865bae tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:29.115326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a1d07694-6ecc-4508-8ec1-e5765f865bae tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:29.123645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1d07694-6ecc-4508-8ec1-e5765f865bae tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:29.124331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1d07694-6ecc-4508-8ec1-e5765f865bae tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:29.124908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1d07694-6ecc-4508-8ec1-e5765f865bae tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:29.125774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1d07694-6ecc-4508-8ec1-e5765f865bae tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:29.126369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1d07694-6ecc-4508-8ec1-e5765f865bae tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:29.126866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a1d07694-6ecc-4508-8ec1-e5765f865bae tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:29.291440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a1d07694-6ecc-4508-8ec1-e5765f865bae tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:29.301278 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a1d07694-6ecc-4508-8ec1-e5765f865bae tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e" status: 200 len: 1277 microversion: 2.1 time: 0.192875 Sep 07 13:31:29.302239 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3324/6677] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:29 2022] GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e => generated 1277 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:30.081065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a042b12-b439-44d0-83b4-a0e8770b3be4 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:30.082246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7a042b12-b439-44d0-83b4-a0e8770b3be4 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: 8308971d-b655-448c-86a8-8d262c2cc61d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:30.092889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a042b12-b439-44d0-83b4-a0e8770b3be4 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:30.093779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a042b12-b439-44d0-83b4-a0e8770b3be4 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:30.094374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a042b12-b439-44d0-83b4-a0e8770b3be4 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:30.095688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a042b12-b439-44d0-83b4-a0e8770b3be4 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:30.096477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a042b12-b439-44d0-83b4-a0e8770b3be4 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:30.097379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a042b12-b439-44d0-83b4-a0e8770b3be4 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:30.223476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7a042b12-b439-44d0-83b4-a0e8770b3be4 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:30.234553 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7a042b12-b439-44d0-83b4-a0e8770b3be4 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d" status: 200 len: 1300 microversion: 2.1 time: 0.160944 Sep 07 13:31:30.235528 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3354/6678] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:30 2022] GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d => generated 1300 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:31:30.328581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c1e2be34-dd7f-418a-8144-976f5ef93c8e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:30.329342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c1e2be34-dd7f-418a-8144-976f5ef93c8e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:30.336807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1e2be34-dd7f-418a-8144-976f5ef93c8e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:30.337360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1e2be34-dd7f-418a-8144-976f5ef93c8e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:30.337869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1e2be34-dd7f-418a-8144-976f5ef93c8e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:30.338602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1e2be34-dd7f-418a-8144-976f5ef93c8e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:30.339162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1e2be34-dd7f-418a-8144-976f5ef93c8e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:30.341857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c1e2be34-dd7f-418a-8144-976f5ef93c8e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:30.525923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c1e2be34-dd7f-418a-8144-976f5ef93c8e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:30.537886 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c1e2be34-dd7f-418a-8144-976f5ef93c8e tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e" status: 200 len: 1265 microversion: 2.1 time: 0.213393 Sep 07 13:31:30.538724 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3325/6679] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:30 2022] GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:31:31.259593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a5df08b8-cd7c-4c13-a4f9-ac844f2e059c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:31.260186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a5df08b8-cd7c-4c13-a4f9-ac844f2e059c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: 8308971d-b655-448c-86a8-8d262c2cc61d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:31.267718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5df08b8-cd7c-4c13-a4f9-ac844f2e059c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:31.268239 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5df08b8-cd7c-4c13-a4f9-ac844f2e059c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:31.268704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5df08b8-cd7c-4c13-a4f9-ac844f2e059c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:31.269454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5df08b8-cd7c-4c13-a4f9-ac844f2e059c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:31.269960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5df08b8-cd7c-4c13-a4f9-ac844f2e059c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:31.270407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a5df08b8-cd7c-4c13-a4f9-ac844f2e059c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:31.363403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a5df08b8-cd7c-4c13-a4f9-ac844f2e059c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:31.372473 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a5df08b8-cd7c-4c13-a4f9-ac844f2e059c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d" status: 200 len: 1300 microversion: 2.1 time: 0.116905 Sep 07 13:31:31.373144 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3355/6680] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:31 2022] GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d => generated 1300 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:31.568405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-872bbfb8-1923-4ba1-97ea-de4b47ca2fc7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:31.569334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-872bbfb8-1923-4ba1-97ea-de4b47ca2fc7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:31.582301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-872bbfb8-1923-4ba1-97ea-de4b47ca2fc7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:31.583197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-872bbfb8-1923-4ba1-97ea-de4b47ca2fc7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:31.584043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-872bbfb8-1923-4ba1-97ea-de4b47ca2fc7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:31.585262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-872bbfb8-1923-4ba1-97ea-de4b47ca2fc7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:31.586003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-872bbfb8-1923-4ba1-97ea-de4b47ca2fc7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:31.587042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-872bbfb8-1923-4ba1-97ea-de4b47ca2fc7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:31.778965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-872bbfb8-1923-4ba1-97ea-de4b47ca2fc7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:31.794311 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-872bbfb8-1923-4ba1-97ea-de4b47ca2fc7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e" status: 200 len: 1265 microversion: 2.1 time: 0.229822 Sep 07 13:31:31.795563 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3326/6681] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:31 2022] GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:32.397260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-01a44a01-a8b6-429b-981c-a76321c3b89c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:32.397970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-01a44a01-a8b6-429b-981c-a76321c3b89c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: 8308971d-b655-448c-86a8-8d262c2cc61d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:32.406482 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01a44a01-a8b6-429b-981c-a76321c3b89c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:32.407037 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01a44a01-a8b6-429b-981c-a76321c3b89c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:32.407547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01a44a01-a8b6-429b-981c-a76321c3b89c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:32.408262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01a44a01-a8b6-429b-981c-a76321c3b89c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:32.408755 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01a44a01-a8b6-429b-981c-a76321c3b89c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:32.409224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01a44a01-a8b6-429b-981c-a76321c3b89c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:32.502586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-01a44a01-a8b6-429b-981c-a76321c3b89c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:32.512229 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-01a44a01-a8b6-429b-981c-a76321c3b89c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d" status: 200 len: 1300 microversion: 2.1 time: 0.118978 Sep 07 13:31:32.512859 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3356/6682] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:32 2022] GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d => generated 1300 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:32.824930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ccd476c8-8e6c-40c5-8d8c-94ce39f96138 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:32.825589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ccd476c8-8e6c-40c5-8d8c-94ce39f96138 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:32.827719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:31:32.834291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccd476c8-8e6c-40c5-8d8c-94ce39f96138 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:32.834776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccd476c8-8e6c-40c5-8d8c-94ce39f96138 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:32.835243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccd476c8-8e6c-40c5-8d8c-94ce39f96138 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:32.835936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccd476c8-8e6c-40c5-8d8c-94ce39f96138 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:32.836388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccd476c8-8e6c-40c5-8d8c-94ce39f96138 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:32.836842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccd476c8-8e6c-40c5-8d8c-94ce39f96138 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:32.997914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ccd476c8-8e6c-40c5-8d8c-94ce39f96138 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:33.006621 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ccd476c8-8e6c-40c5-8d8c-94ce39f96138 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e" status: 200 len: 1265 microversion: 2.1 time: 0.185843 Sep 07 13:31:33.007237 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3327/6683] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:32 2022] GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:33.536781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c4061821-07a5-4954-bfea-d874fca99be4 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:33.537551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c4061821-07a5-4954-bfea-d874fca99be4 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: 8308971d-b655-448c-86a8-8d262c2cc61d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:33.539412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:31:33.545797 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4061821-07a5-4954-bfea-d874fca99be4 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:33.546400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4061821-07a5-4954-bfea-d874fca99be4 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:33.546772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4061821-07a5-4954-bfea-d874fca99be4 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:33.547509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4061821-07a5-4954-bfea-d874fca99be4 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:33.548002 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4061821-07a5-4954-bfea-d874fca99be4 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:33.548457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4061821-07a5-4954-bfea-d874fca99be4 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:33.640688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c4061821-07a5-4954-bfea-d874fca99be4 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:33.648953 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c4061821-07a5-4954-bfea-d874fca99be4 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d" status: 200 len: 1300 microversion: 2.1 time: 0.116415 Sep 07 13:31:33.649575 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3357/6684] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:33 2022] GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d => generated 1300 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:34.030625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-75dbdefa-abf8-4f80-b84b-9d513f496140 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:34.031221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-75dbdefa-abf8-4f80-b84b-9d513f496140 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:34.033349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=14 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:31:34.040468 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75dbdefa-abf8-4f80-b84b-9d513f496140 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:34.040958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75dbdefa-abf8-4f80-b84b-9d513f496140 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:34.041397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75dbdefa-abf8-4f80-b84b-9d513f496140 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:34.042174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75dbdefa-abf8-4f80-b84b-9d513f496140 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:34.042640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75dbdefa-abf8-4f80-b84b-9d513f496140 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:34.043078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75dbdefa-abf8-4f80-b84b-9d513f496140 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:34.200709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-75dbdefa-abf8-4f80-b84b-9d513f496140 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:34.209122 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-75dbdefa-abf8-4f80-b84b-9d513f496140 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e" status: 200 len: 1265 microversion: 2.1 time: 0.182642 Sep 07 13:31:34.209786 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3328/6685] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:34 2022] GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:34.660735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-817b7a68-bc57-4cd0-aa04-a1ea3d1f492a req-1d85274f-4e2f-4b9f-a9e1-117ee58d34d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8308971d-b655-448c-86a8-8d262c2cc61d", "name": "network-vif-plugged", "status": "completed", "tag": "4521f47b-e598-4264-a08e-ffe47407ee67"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:31:34.673029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-817b7a68-bc57-4cd0-aa04-a1ea3d1f492a req-1d85274f-4e2f-4b9f-a9e1-117ee58d34d5 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:34.673612 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-817b7a68-bc57-4cd0-aa04-a1ea3d1f492a req-1d85274f-4e2f-4b9f-a9e1-117ee58d34d5 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:34.673883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-18d7356d-eaa3-487b-98c9-445a5c54241b tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:34.674434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-18d7356d-eaa3-487b-98c9-445a5c54241b tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: 8308971d-b655-448c-86a8-8d262c2cc61d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:34.674702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-817b7a68-bc57-4cd0-aa04-a1ea3d1f492a req-1d85274f-4e2f-4b9f-a9e1-117ee58d34d5 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:34.681145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18d7356d-eaa3-487b-98c9-445a5c54241b tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:34.681689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18d7356d-eaa3-487b-98c9-445a5c54241b tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:34.682132 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18d7356d-eaa3-487b-98c9-445a5c54241b tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:34.683041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18d7356d-eaa3-487b-98c9-445a5c54241b tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:34.683561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18d7356d-eaa3-487b-98c9-445a5c54241b tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:34.683993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18d7356d-eaa3-487b-98c9-445a5c54241b tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:34.689851 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-817b7a68-bc57-4cd0-aa04-a1ea3d1f492a req-1d85274f-4e2f-4b9f-a9e1-117ee58d34d5 service nova] Creating event network-vif-plugged:4521f47b-e598-4264-a08e-ffe47407ee67 for instance 8308971d-b655-448c-86a8-8d262c2cc61d on n-h1-852087-9 Sep 07 13:31:34.694489 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-817b7a68-bc57-4cd0-aa04-a1ea3d1f492a req-1d85274f-4e2f-4b9f-a9e1-117ee58d34d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037539 Sep 07 13:31:34.695562 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3358/6686] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:31:34.772781 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-18d7356d-eaa3-487b-98c9-445a5c54241b tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:34.781685 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-18d7356d-eaa3-487b-98c9-445a5c54241b tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d" status: 200 len: 1300 microversion: 2.1 time: 0.113158 Sep 07 13:31:34.782250 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3329/6687] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:34 2022] GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d => generated 1300 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:35.239229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-919eca6e-d018-4a5e-8c4a-bd7b8bad03cc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:35.239982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-919eca6e-d018-4a5e-8c4a-bd7b8bad03cc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:35.247507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-919eca6e-d018-4a5e-8c4a-bd7b8bad03cc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:35.248031 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-919eca6e-d018-4a5e-8c4a-bd7b8bad03cc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:35.248495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-919eca6e-d018-4a5e-8c4a-bd7b8bad03cc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:35.249242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-919eca6e-d018-4a5e-8c4a-bd7b8bad03cc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:35.249763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-919eca6e-d018-4a5e-8c4a-bd7b8bad03cc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:35.250218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-919eca6e-d018-4a5e-8c4a-bd7b8bad03cc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:35.413647 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-919eca6e-d018-4a5e-8c4a-bd7b8bad03cc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:35.423472 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-919eca6e-d018-4a5e-8c4a-bd7b8bad03cc tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e" status: 200 len: 1265 microversion: 2.1 time: 0.188836 Sep 07 13:31:35.424111 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3359/6688] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:35 2022] GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:35.806669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-076372dd-5ba1-4711-99c8-6477adcfb64a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:35.807286 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-076372dd-5ba1-4711-99c8-6477adcfb64a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: 8308971d-b655-448c-86a8-8d262c2cc61d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:35.815358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-076372dd-5ba1-4711-99c8-6477adcfb64a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:35.815864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-076372dd-5ba1-4711-99c8-6477adcfb64a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:35.816309 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-076372dd-5ba1-4711-99c8-6477adcfb64a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:35.817039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-076372dd-5ba1-4711-99c8-6477adcfb64a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:35.817516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-076372dd-5ba1-4711-99c8-6477adcfb64a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:35.818042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-076372dd-5ba1-4711-99c8-6477adcfb64a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:35.907980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-076372dd-5ba1-4711-99c8-6477adcfb64a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:35.916095 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-076372dd-5ba1-4711-99c8-6477adcfb64a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d" status: 200 len: 1300 microversion: 2.1 time: 0.113565 Sep 07 13:31:35.916684 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3330/6689] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:35 2022] GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d => generated 1300 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:36.447361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d9fffcbe-ff84-4d81-a745-7771f853468c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:36.448000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d9fffcbe-ff84-4d81-a745-7771f853468c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:36.455846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9fffcbe-ff84-4d81-a745-7771f853468c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:36.456366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9fffcbe-ff84-4d81-a745-7771f853468c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:36.456820 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9fffcbe-ff84-4d81-a745-7771f853468c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:36.457593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9fffcbe-ff84-4d81-a745-7771f853468c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:36.458063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9fffcbe-ff84-4d81-a745-7771f853468c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:36.458509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9fffcbe-ff84-4d81-a745-7771f853468c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:36.602208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d9fffcbe-ff84-4d81-a745-7771f853468c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:36.611038 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d9fffcbe-ff84-4d81-a745-7771f853468c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e" status: 200 len: 1265 microversion: 2.1 time: 0.167660 Sep 07 13:31:36.611621 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3360/6690] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:36 2022] GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:36.940405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c914b1da-ba15-4817-bab2-c2957eec0b4c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:36.941101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c914b1da-ba15-4817-bab2-c2957eec0b4c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: 8308971d-b655-448c-86a8-8d262c2cc61d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:36.949037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c914b1da-ba15-4817-bab2-c2957eec0b4c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:36.949630 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c914b1da-ba15-4817-bab2-c2957eec0b4c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:36.950211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c914b1da-ba15-4817-bab2-c2957eec0b4c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:36.950837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c914b1da-ba15-4817-bab2-c2957eec0b4c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:36.951299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c914b1da-ba15-4817-bab2-c2957eec0b4c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:36.951732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c914b1da-ba15-4817-bab2-c2957eec0b4c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:37.050425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c914b1da-ba15-4817-bab2-c2957eec0b4c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:37.058839 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c914b1da-ba15-4817-bab2-c2957eec0b4c tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d" status: 200 len: 1472 microversion: 2.1 time: 0.122806 Sep 07 13:31:37.059461 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3331/6691] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:36 2022] GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d => generated 1472 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:37.082550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4974c13c-080f-43f9-8d1b-7ad03db83232 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:37.083198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4974c13c-080f-43f9-8d1b-7ad03db83232 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: 8308971d-b655-448c-86a8-8d262c2cc61d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:37.090680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4974c13c-080f-43f9-8d1b-7ad03db83232 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:37.091245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4974c13c-080f-43f9-8d1b-7ad03db83232 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:37.091789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4974c13c-080f-43f9-8d1b-7ad03db83232 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:37.092591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4974c13c-080f-43f9-8d1b-7ad03db83232 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:37.093088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4974c13c-080f-43f9-8d1b-7ad03db83232 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:37.093584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4974c13c-080f-43f9-8d1b-7ad03db83232 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:37.193780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4974c13c-080f-43f9-8d1b-7ad03db83232 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:37.202237 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4974c13c-080f-43f9-8d1b-7ad03db83232 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d" status: 200 len: 1472 microversion: 2.1 time: 0.123805 Sep 07 13:31:37.202851 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3361/6692] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:37 2022] GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d => generated 1472 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:37.225287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-181e7d4e-af2d-4c2f-ac67-6d6045aad159 tempest-TestSecurityGroupsBasicOps-597466337 tempest-TestSecurityGroupsBasicOps-597466337-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:37.226002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-181e7d4e-af2d-4c2f-ac67-6d6045aad159 tempest-TestSecurityGroupsBasicOps-597466337 tempest-TestSecurityGroupsBasicOps-597466337-project-admin] [instance: 8308971d-b655-448c-86a8-8d262c2cc61d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:37.232513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-181e7d4e-af2d-4c2f-ac67-6d6045aad159 tempest-TestSecurityGroupsBasicOps-597466337 tempest-TestSecurityGroupsBasicOps-597466337-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:37.233014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-181e7d4e-af2d-4c2f-ac67-6d6045aad159 tempest-TestSecurityGroupsBasicOps-597466337 tempest-TestSecurityGroupsBasicOps-597466337-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:37.233460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-181e7d4e-af2d-4c2f-ac67-6d6045aad159 tempest-TestSecurityGroupsBasicOps-597466337 tempest-TestSecurityGroupsBasicOps-597466337-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:37.234213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-181e7d4e-af2d-4c2f-ac67-6d6045aad159 tempest-TestSecurityGroupsBasicOps-597466337 tempest-TestSecurityGroupsBasicOps-597466337-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:37.234671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-181e7d4e-af2d-4c2f-ac67-6d6045aad159 tempest-TestSecurityGroupsBasicOps-597466337 tempest-TestSecurityGroupsBasicOps-597466337-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:37.235104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-181e7d4e-af2d-4c2f-ac67-6d6045aad159 tempest-TestSecurityGroupsBasicOps-597466337 tempest-TestSecurityGroupsBasicOps-597466337-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:37.323184 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-181e7d4e-af2d-4c2f-ac67-6d6045aad159 tempest-TestSecurityGroupsBasicOps-597466337 tempest-TestSecurityGroupsBasicOps-597466337-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d" status: 200 len: 1623 microversion: 2.1 time: 0.101798 Sep 07 13:31:37.323782 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3332/6693] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:37 2022] GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d => generated 1623 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:37.346874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a3704fe3-7138-46c2-8bc5-a800e9909fb4 tempest-TestSecurityGroupsBasicOps-597466337 tempest-TestSecurityGroupsBasicOps-597466337-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:37.347525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a3704fe3-7138-46c2-8bc5-a800e9909fb4 tempest-TestSecurityGroupsBasicOps-597466337 tempest-TestSecurityGroupsBasicOps-597466337-project-admin] [instance: eaa3c72e-6b27-422d-bd9c-664908cf9837] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:37.354804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3704fe3-7138-46c2-8bc5-a800e9909fb4 tempest-TestSecurityGroupsBasicOps-597466337 tempest-TestSecurityGroupsBasicOps-597466337-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:37.355534 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3704fe3-7138-46c2-8bc5-a800e9909fb4 tempest-TestSecurityGroupsBasicOps-597466337 tempest-TestSecurityGroupsBasicOps-597466337-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:37.356067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3704fe3-7138-46c2-8bc5-a800e9909fb4 tempest-TestSecurityGroupsBasicOps-597466337 tempest-TestSecurityGroupsBasicOps-597466337-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:37.356800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3704fe3-7138-46c2-8bc5-a800e9909fb4 tempest-TestSecurityGroupsBasicOps-597466337 tempest-TestSecurityGroupsBasicOps-597466337-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:37.357284 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3704fe3-7138-46c2-8bc5-a800e9909fb4 tempest-TestSecurityGroupsBasicOps-597466337 tempest-TestSecurityGroupsBasicOps-597466337-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:37.357765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a3704fe3-7138-46c2-8bc5-a800e9909fb4 tempest-TestSecurityGroupsBasicOps-597466337 tempest-TestSecurityGroupsBasicOps-597466337-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:37.533048 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a3704fe3-7138-46c2-8bc5-a800e9909fb4 tempest-TestSecurityGroupsBasicOps-597466337 tempest-TestSecurityGroupsBasicOps-597466337-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837" status: 200 len: 1912 microversion: 2.1 time: 0.190211 Sep 07 13:31:37.533794 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3362/6694] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:37 2022] GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837 => generated 1912 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:37.608538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b5f73bdb-f660-4214-ad7b-5f8bc54fe384 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:37.609049 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b5f73bdb-f660-4214-ad7b-5f8bc54fe384 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: 8308971d-b655-448c-86a8-8d262c2cc61d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:37.615589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5f73bdb-f660-4214-ad7b-5f8bc54fe384 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:37.616084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5f73bdb-f660-4214-ad7b-5f8bc54fe384 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:37.616527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5f73bdb-f660-4214-ad7b-5f8bc54fe384 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:37.617232 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5f73bdb-f660-4214-ad7b-5f8bc54fe384 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:37.617730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5f73bdb-f660-4214-ad7b-5f8bc54fe384 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:37.618167 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b5f73bdb-f660-4214-ad7b-5f8bc54fe384 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:37.638824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2902a17e-db35-4068-af4e-d5fc9e23b881 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:37.639846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2902a17e-db35-4068-af4e-d5fc9e23b881 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:37.649150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b5f73bdb-f660-4214-ad7b-5f8bc54fe384 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: 8308971d-b655-448c-86a8-8d262c2cc61d] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:31:37.650394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2902a17e-db35-4068-af4e-d5fc9e23b881 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:37.651272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2902a17e-db35-4068-af4e-d5fc9e23b881 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:37.652056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2902a17e-db35-4068-af4e-d5fc9e23b881 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:37.653287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2902a17e-db35-4068-af4e-d5fc9e23b881 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:37.654194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2902a17e-db35-4068-af4e-d5fc9e23b881 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:37.655002 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2902a17e-db35-4068-af4e-d5fc9e23b881 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:37.700013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:31:37.741166 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b5f73bdb-f660-4214-ad7b-5f8bc54fe384 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d" status: 204 len: 0 microversion: 2.1 time: 0.136683 Sep 07 13:31:37.742307 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3333/6695] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:31:37 2022] DELETE /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:31:37.751459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7e163803-2353-4a40-9753-0b1689c2cc43 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:37.752215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7e163803-2353-4a40-9753-0b1689c2cc43 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: 8308971d-b655-448c-86a8-8d262c2cc61d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:37.759205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e163803-2353-4a40-9753-0b1689c2cc43 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:37.759905 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e163803-2353-4a40-9753-0b1689c2cc43 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:37.760533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e163803-2353-4a40-9753-0b1689c2cc43 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:37.761416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e163803-2353-4a40-9753-0b1689c2cc43 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:37.762112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e163803-2353-4a40-9753-0b1689c2cc43 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:37.762705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e163803-2353-4a40-9753-0b1689c2cc43 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:37.850663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2902a17e-db35-4068-af4e-d5fc9e23b881 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:37.860883 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2902a17e-db35-4068-af4e-d5fc9e23b881 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e" status: 200 len: 1265 microversion: 2.1 time: 0.229685 Sep 07 13:31:37.861559 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3363/6696] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:37 2022] GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:31:37.871482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7e163803-2353-4a40-9753-0b1689c2cc43 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:37.880253 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7e163803-2353-4a40-9753-0b1689c2cc43 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d" status: 200 len: 1478 microversion: 2.1 time: 0.133304 Sep 07 13:31:37.880897 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3334/6697] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:37 2022] GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d => generated 1478 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:31:38.884880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-759175ad-780a-493e-8815-c39c8ae0be26 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:38.885570 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-759175ad-780a-493e-8815-c39c8ae0be26 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:38.897983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-759175ad-780a-493e-8815-c39c8ae0be26 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:38.899140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-759175ad-780a-493e-8815-c39c8ae0be26 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:38.900561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-759175ad-780a-493e-8815-c39c8ae0be26 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:38.902265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-759175ad-780a-493e-8815-c39c8ae0be26 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:38.903061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-759175ad-780a-493e-8815-c39c8ae0be26 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:38.903842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-759175ad-780a-493e-8815-c39c8ae0be26 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:38.913553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-131aae20-1bba-4f39-9997-de899e5ba82d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:38.915959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-131aae20-1bba-4f39-9997-de899e5ba82d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: 8308971d-b655-448c-86a8-8d262c2cc61d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:38.928552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-131aae20-1bba-4f39-9997-de899e5ba82d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:38.929951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-131aae20-1bba-4f39-9997-de899e5ba82d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:38.930912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-131aae20-1bba-4f39-9997-de899e5ba82d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:38.932175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-131aae20-1bba-4f39-9997-de899e5ba82d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:38.933171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-131aae20-1bba-4f39-9997-de899e5ba82d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:38.934067 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-131aae20-1bba-4f39-9997-de899e5ba82d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:39.072084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-131aae20-1bba-4f39-9997-de899e5ba82d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:39.081703 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-131aae20-1bba-4f39-9997-de899e5ba82d tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d" status: 200 len: 1478 microversion: 2.1 time: 0.179729 Sep 07 13:31:39.082435 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3335/6698] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:38 2022] GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d => generated 1478 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:39.141414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-759175ad-780a-493e-8815-c39c8ae0be26 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:39.155722 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-759175ad-780a-493e-8815-c39c8ae0be26 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e" status: 200 len: 1265 microversion: 2.1 time: 0.274555 Sep 07 13:31:39.156833 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3364/6699] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:38 2022] GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e => generated 1265 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:39.849364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-7abb2454-f727-4fc5-86ae-90849387b292 req-73fe6dc7-50bf-4d4c-a534-68631d74347f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8308971d-b655-448c-86a8-8d262c2cc61d", "name": "network-vif-deleted", "tag": "4521f47b-e598-4264-a08e-ffe47407ee67"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:31:39.873091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7abb2454-f727-4fc5-86ae-90849387b292 req-73fe6dc7-50bf-4d4c-a534-68631d74347f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:39.874260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7abb2454-f727-4fc5-86ae-90849387b292 req-73fe6dc7-50bf-4d4c-a534-68631d74347f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:39.875766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7abb2454-f727-4fc5-86ae-90849387b292 req-73fe6dc7-50bf-4d4c-a534-68631d74347f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:39.912606 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7abb2454-f727-4fc5-86ae-90849387b292 req-73fe6dc7-50bf-4d4c-a534-68631d74347f service nova] Creating event network-vif-deleted:4521f47b-e598-4264-a08e-ffe47407ee67 for instance 8308971d-b655-448c-86a8-8d262c2cc61d on n-h1-852087-9 Sep 07 13:31:39.925445 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-7abb2454-f727-4fc5-86ae-90849387b292 req-73fe6dc7-50bf-4d4c-a534-68631d74347f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085348 Sep 07 13:31:39.928319 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3336/6700] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:31:40.109321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5b682775-fc41-4680-9d85-494b606a891a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:40.110652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5b682775-fc41-4680-9d85-494b606a891a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: 8308971d-b655-448c-86a8-8d262c2cc61d] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:40.119962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b682775-fc41-4680-9d85-494b606a891a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:40.121169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b682775-fc41-4680-9d85-494b606a891a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:40.122107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b682775-fc41-4680-9d85-494b606a891a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:40.123276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b682775-fc41-4680-9d85-494b606a891a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:40.123962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b682775-fc41-4680-9d85-494b606a891a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:40.124703 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b682775-fc41-4680-9d85-494b606a891a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:40.167783 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b682775-fc41-4680-9d85-494b606a891a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:40.168177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b682775-fc41-4680-9d85-494b606a891a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:40.168640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b682775-fc41-4680-9d85-494b606a891a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:40.169118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-5b682775-fc41-4680-9d85-494b606a891a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lazy-loading 'fault' on Instance uuid 8308971d-b655-448c-86a8-8d262c2cc61d {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:31:40.191151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1acf2837-1229-4617-a98f-d6f5bcb92719 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:40.192599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1acf2837-1229-4617-a98f-d6f5bcb92719 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:40.204722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1acf2837-1229-4617-a98f-d6f5bcb92719 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:40.205298 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1acf2837-1229-4617-a98f-d6f5bcb92719 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:40.205928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1acf2837-1229-4617-a98f-d6f5bcb92719 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:40.208495 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1acf2837-1229-4617-a98f-d6f5bcb92719 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:40.209007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1acf2837-1229-4617-a98f-d6f5bcb92719 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:40.209737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1acf2837-1229-4617-a98f-d6f5bcb92719 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:40.229520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5b682775-fc41-4680-9d85-494b606a891a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:40.234249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=100 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:31:40.240985 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5b682775-fc41-4680-9d85-494b606a891a tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d" status: 200 len: 1332 microversion: 2.1 time: 0.138027 Sep 07 13:31:40.241618 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3365/6701] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:40 2022] GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d => generated 1332 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:40.402764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1acf2837-1229-4617-a98f-d6f5bcb92719 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:40.416331 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1acf2837-1229-4617-a98f-d6f5bcb92719 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e" status: 200 len: 1265 microversion: 2.1 time: 0.233838 Sep 07 13:31:40.429596 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3337/6702] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:40 2022] GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:41.004626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c83e6e47-0d64-4e3f-ba38-fd1a06b30669 req-55b7da54-3221-48a7-a75b-6915a40dc348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "269230b1-3aaa-486d-9835-7e47d18bc16e", "name": "network-vif-plugged", "status": "completed", "tag": "751321c5-12e0-4491-a76a-5e2b987f658e"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:31:41.015569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c83e6e47-0d64-4e3f-ba38-fd1a06b30669 req-55b7da54-3221-48a7-a75b-6915a40dc348 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:41.016086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c83e6e47-0d64-4e3f-ba38-fd1a06b30669 req-55b7da54-3221-48a7-a75b-6915a40dc348 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:41.016547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c83e6e47-0d64-4e3f-ba38-fd1a06b30669 req-55b7da54-3221-48a7-a75b-6915a40dc348 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:41.030124 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c83e6e47-0d64-4e3f-ba38-fd1a06b30669 req-55b7da54-3221-48a7-a75b-6915a40dc348 service nova] Creating event network-vif-plugged:751321c5-12e0-4491-a76a-5e2b987f658e for instance 269230b1-3aaa-486d-9835-7e47d18bc16e on n-h2-852087-9 Sep 07 13:31:41.040177 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c83e6e47-0d64-4e3f-ba38-fd1a06b30669 req-55b7da54-3221-48a7-a75b-6915a40dc348 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039374 Sep 07 13:31:41.041514 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3366/6703] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:31:41.264818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ce034ba-c84e-4743-ac4f-d57c22e2f3fc tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:41.265441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6ce034ba-c84e-4743-ac4f-d57c22e2f3fc tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: 8308971d-b655-448c-86a8-8d262c2cc61d] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:41.273000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ce034ba-c84e-4743-ac4f-d57c22e2f3fc tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:41.273521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ce034ba-c84e-4743-ac4f-d57c22e2f3fc tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:41.274004 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ce034ba-c84e-4743-ac4f-d57c22e2f3fc tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:41.274727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ce034ba-c84e-4743-ac4f-d57c22e2f3fc tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:41.275194 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ce034ba-c84e-4743-ac4f-d57c22e2f3fc tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:41.275624 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ce034ba-c84e-4743-ac4f-d57c22e2f3fc tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:41.293629 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-6ce034ba-c84e-4743-ac4f-d57c22e2f3fc tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] HTTP exception thrown: Instance 8308971d-b655-448c-86a8-8d262c2cc61d could not be found. Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ce034ba-c84e-4743-ac4f-d57c22e2f3fc tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Request method failure captured: Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d HTTP/1.1 Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJznDCylxHl7dFSg5H6GFG5g7dGbqgrNXFcG-czj8kTbCMIoGfMN1cYepiCHzri6HSF2fGbqvhKlrZcF94WzuLawc-yJ48CBAVKR_py0ZfBF6rG45EaKF5aWp2nW8n1wO2GG0GUcx-4VRuKT5s8I9ZUMkfiBKWvMtZQxDMTdn8uo-Qo Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: cc883787099641cdab549780c967225c Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1132788439 Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cc883787099641cdab549780c967225c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cc883787099641cdab549780c967225c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cc883787099641cdab549780c967225c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cc883787099641cdab549780c967225c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1132788439 Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: cc883787099641cdab549780c967225c Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1132788439 Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TestSecurityGroupsBasicOps-1132788439-project Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 77133736e0d34391973ed925eba8e7cf Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1132788439-project Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 8308971d-b655-448c-86a8-8d262c2cc61d could not be found. Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '8308971d-b655-448c-86a8-8d262c2cc61d'} Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8308971d-b655-448c-86a8-8d262c2cc61d could not be found. Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8308971d-b655-448c-86a8-8d262c2cc61d could not be found. Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:31:41.295364 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:31:41.299284 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:31:41.299284 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:41.299284 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:31:41.299284 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:31:41.299284 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:31:41.299284 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:31:41.299284 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8308971d-b655-448c-86a8-8d262c2cc61d could not be found. Sep 07 13:31:41.299284 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:31:41.299284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ce034ba-c84e-4743-ac4f-d57c22e2f3fc tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Returning 404 to user: Instance 8308971d-b655-448c-86a8-8d262c2cc61d could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:31:41.299284 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6ce034ba-c84e-4743-ac4f-d57c22e2f3fc tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d" status: 404 len: 111 microversion: 2.1 time: 0.036159 Sep 07 13:31:41.299284 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3338/6704] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:41 2022] GET /compute/v2.1/servers/8308971d-b655-448c-86a8-8d262c2cc61d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:31:41.445720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-74ba9e5c-49f2-49eb-90f7-fda4e16df5ba tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:41.446643 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-74ba9e5c-49f2-49eb-90f7-fda4e16df5ba tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:41.455113 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74ba9e5c-49f2-49eb-90f7-fda4e16df5ba tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:41.455639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74ba9e5c-49f2-49eb-90f7-fda4e16df5ba tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:41.456152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74ba9e5c-49f2-49eb-90f7-fda4e16df5ba tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:41.456912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74ba9e5c-49f2-49eb-90f7-fda4e16df5ba tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:41.457401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74ba9e5c-49f2-49eb-90f7-fda4e16df5ba tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:41.457888 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74ba9e5c-49f2-49eb-90f7-fda4e16df5ba tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:41.650981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-74ba9e5c-49f2-49eb-90f7-fda4e16df5ba tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:41.672340 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-74ba9e5c-49f2-49eb-90f7-fda4e16df5ba tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e" status: 200 len: 1265 microversion: 2.1 time: 0.231145 Sep 07 13:31:41.674092 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3367/6705] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:41 2022] GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:42.697758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-97644549-25fa-4aad-8328-012a18c045ad tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:42.698294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-97644549-25fa-4aad-8328-012a18c045ad tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:42.705847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97644549-25fa-4aad-8328-012a18c045ad tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:42.706347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97644549-25fa-4aad-8328-012a18c045ad tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:42.706780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97644549-25fa-4aad-8328-012a18c045ad tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:42.707506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97644549-25fa-4aad-8328-012a18c045ad tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:42.707965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97644549-25fa-4aad-8328-012a18c045ad tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:42.708383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97644549-25fa-4aad-8328-012a18c045ad tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:42.858773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-97644549-25fa-4aad-8328-012a18c045ad tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:42.868136 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-97644549-25fa-4aad-8328-012a18c045ad tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e" status: 200 len: 1452 microversion: 2.1 time: 0.174506 Sep 07 13:31:42.869135 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3339/6706] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:42 2022] GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:42.895633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bd7fce57-0416-40b5-8928-012cdeb3dca9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:42.896272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bd7fce57-0416-40b5-8928-012cdeb3dca9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:42.904103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd7fce57-0416-40b5-8928-012cdeb3dca9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:42.904655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd7fce57-0416-40b5-8928-012cdeb3dca9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:42.905108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd7fce57-0416-40b5-8928-012cdeb3dca9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:42.905848 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd7fce57-0416-40b5-8928-012cdeb3dca9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:42.906315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd7fce57-0416-40b5-8928-012cdeb3dca9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:42.906779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd7fce57-0416-40b5-8928-012cdeb3dca9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:43.065494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bd7fce57-0416-40b5-8928-012cdeb3dca9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:43.080502 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bd7fce57-0416-40b5-8928-012cdeb3dca9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e" status: 200 len: 1452 microversion: 2.1 time: 0.189186 Sep 07 13:31:43.090534 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3368/6707] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:42 2022] GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e => generated 1452 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:46.592930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-44234ba5-ebd6-4611-8faa-c4abcd763315 req-699fea70-b135-4c23-8f52-9fcb14d17235 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "269230b1-3aaa-486d-9835-7e47d18bc16e", "tag": "751321c5-12e0-4491-a76a-5e2b987f658e"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:31:46.612517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-44234ba5-ebd6-4611-8faa-c4abcd763315 req-699fea70-b135-4c23-8f52-9fcb14d17235 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:46.613715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-44234ba5-ebd6-4611-8faa-c4abcd763315 req-699fea70-b135-4c23-8f52-9fcb14d17235 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:46.614685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-44234ba5-ebd6-4611-8faa-c4abcd763315 req-699fea70-b135-4c23-8f52-9fcb14d17235 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:46.640456 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-44234ba5-ebd6-4611-8faa-c4abcd763315 req-699fea70-b135-4c23-8f52-9fcb14d17235 service nova] Creating event network-changed:751321c5-12e0-4491-a76a-5e2b987f658e for instance 269230b1-3aaa-486d-9835-7e47d18bc16e on n-h2-852087-9 Sep 07 13:31:46.650919 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-44234ba5-ebd6-4611-8faa-c4abcd763315 req-699fea70-b135-4c23-8f52-9fcb14d17235 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063667 Sep 07 13:31:46.652789 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3340/6708] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:31:47.698801 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-799d4ace-e119-4788-bb48-c5a5e900d907 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:47.699483 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-799d4ace-e119-4788-bb48-c5a5e900d907 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: eaa3c72e-6b27-422d-bd9c-664908cf9837] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:47.707874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-74e45d22-1813-4d69-98c4-dc0969611715 req-7f91b42c-5d6a-4218-8a2a-ce29472ea8a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaa3c72e-6b27-422d-bd9c-664908cf9837", "tag": "3e19c71d-fd10-4477-8d5a-e070340ca179"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:31:47.713465 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-799d4ace-e119-4788-bb48-c5a5e900d907 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:47.717039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-799d4ace-e119-4788-bb48-c5a5e900d907 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:47.717748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-799d4ace-e119-4788-bb48-c5a5e900d907 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:47.718693 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-799d4ace-e119-4788-bb48-c5a5e900d907 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:47.721664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-799d4ace-e119-4788-bb48-c5a5e900d907 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:47.722281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-799d4ace-e119-4788-bb48-c5a5e900d907 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:47.724272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-74e45d22-1813-4d69-98c4-dc0969611715 req-7f91b42c-5d6a-4218-8a2a-ce29472ea8a5 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:47.725041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-74e45d22-1813-4d69-98c4-dc0969611715 req-7f91b42c-5d6a-4218-8a2a-ce29472ea8a5 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:47.725676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-74e45d22-1813-4d69-98c4-dc0969611715 req-7f91b42c-5d6a-4218-8a2a-ce29472ea8a5 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:47.748281 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-74e45d22-1813-4d69-98c4-dc0969611715 req-7f91b42c-5d6a-4218-8a2a-ce29472ea8a5 service nova] Creating event network-changed:3e19c71d-fd10-4477-8d5a-e070340ca179 for instance eaa3c72e-6b27-422d-bd9c-664908cf9837 on n-h2-852087-9 Sep 07 13:31:47.760766 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-74e45d22-1813-4d69-98c4-dc0969611715 req-7f91b42c-5d6a-4218-8a2a-ce29472ea8a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059963 Sep 07 13:31:47.762578 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3341/6709] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:31:47.778968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-799d4ace-e119-4788-bb48-c5a5e900d907 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: eaa3c72e-6b27-422d-bd9c-664908cf9837] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:31:47.919836 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-799d4ace-e119-4788-bb48-c5a5e900d907 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837" status: 204 len: 0 microversion: 2.1 time: 0.224956 Sep 07 13:31:47.921112 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3369/6710] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:31:47 2022] DELETE /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:31:47.931448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0f9cd0f8-aa0d-4993-a4a6-4b8f79996556 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:47.932284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0f9cd0f8-aa0d-4993-a4a6-4b8f79996556 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: eaa3c72e-6b27-422d-bd9c-664908cf9837] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:47.940104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f9cd0f8-aa0d-4993-a4a6-4b8f79996556 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:47.940782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f9cd0f8-aa0d-4993-a4a6-4b8f79996556 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:47.941332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f9cd0f8-aa0d-4993-a4a6-4b8f79996556 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:47.942310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f9cd0f8-aa0d-4993-a4a6-4b8f79996556 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:47.943030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f9cd0f8-aa0d-4993-a4a6-4b8f79996556 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:47.943694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f9cd0f8-aa0d-4993-a4a6-4b8f79996556 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:48.117450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0f9cd0f8-aa0d-4993-a4a6-4b8f79996556 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:48.134364 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0f9cd0f8-aa0d-4993-a4a6-4b8f79996556 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837" status: 200 len: 1767 microversion: 2.1 time: 0.208068 Sep 07 13:31:48.134968 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3342/6711] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:47 2022] GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837 => generated 1767 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:49.164457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dbbddfd0-086e-4e41-aa8a-5ef4b8a510cf tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:49.165888 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dbbddfd0-086e-4e41-aa8a-5ef4b8a510cf tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: eaa3c72e-6b27-422d-bd9c-664908cf9837] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:49.178368 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dbbddfd0-086e-4e41-aa8a-5ef4b8a510cf tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:49.179255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dbbddfd0-086e-4e41-aa8a-5ef4b8a510cf tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:49.180072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dbbddfd0-086e-4e41-aa8a-5ef4b8a510cf tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:49.181673 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dbbddfd0-086e-4e41-aa8a-5ef4b8a510cf tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:49.182561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dbbddfd0-086e-4e41-aa8a-5ef4b8a510cf tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:49.183588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dbbddfd0-086e-4e41-aa8a-5ef4b8a510cf tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:49.376279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dbbddfd0-086e-4e41-aa8a-5ef4b8a510cf tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:49.384852 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dbbddfd0-086e-4e41-aa8a-5ef4b8a510cf tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837" status: 200 len: 1767 microversion: 2.1 time: 0.228937 Sep 07 13:31:49.385437 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3370/6712] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:49 2022] GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837 => generated 1767 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:50.073164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-aa262bb2-c1ae-4b6f-b67c-7980153931a5 req-4307c5e0-738a-4b68-9180-0b9f54b209c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaa3c72e-6b27-422d-bd9c-664908cf9837", "name": "network-vif-deleted", "tag": "3e19c71d-fd10-4477-8d5a-e070340ca179"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:31:50.086599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-aa262bb2-c1ae-4b6f-b67c-7980153931a5 req-4307c5e0-738a-4b68-9180-0b9f54b209c3 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:50.087126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-aa262bb2-c1ae-4b6f-b67c-7980153931a5 req-4307c5e0-738a-4b68-9180-0b9f54b209c3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:50.087566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-aa262bb2-c1ae-4b6f-b67c-7980153931a5 req-4307c5e0-738a-4b68-9180-0b9f54b209c3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:50.102957 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-aa262bb2-c1ae-4b6f-b67c-7980153931a5 req-4307c5e0-738a-4b68-9180-0b9f54b209c3 service nova] Creating event network-vif-deleted:3e19c71d-fd10-4477-8d5a-e070340ca179 for instance eaa3c72e-6b27-422d-bd9c-664908cf9837 on n-h2-852087-9 Sep 07 13:31:50.109082 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-aa262bb2-c1ae-4b6f-b67c-7980153931a5 req-4307c5e0-738a-4b68-9180-0b9f54b209c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040247 Sep 07 13:31:50.109816 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3343/6713] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:31:50.408944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d12f1738-cf4a-4875-913f-54bdf0927e75 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:50.409631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d12f1738-cf4a-4875-913f-54bdf0927e75 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: eaa3c72e-6b27-422d-bd9c-664908cf9837] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:50.417389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d12f1738-cf4a-4875-913f-54bdf0927e75 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:50.418171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d12f1738-cf4a-4875-913f-54bdf0927e75 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:50.418621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d12f1738-cf4a-4875-913f-54bdf0927e75 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:50.419407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d12f1738-cf4a-4875-913f-54bdf0927e75 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:50.419882 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d12f1738-cf4a-4875-913f-54bdf0927e75 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:50.420333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d12f1738-cf4a-4875-913f-54bdf0927e75 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:50.468448 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d12f1738-cf4a-4875-913f-54bdf0927e75 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:50.469203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d12f1738-cf4a-4875-913f-54bdf0927e75 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:50.469765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d12f1738-cf4a-4875-913f-54bdf0927e75 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:50.470341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-d12f1738-cf4a-4875-913f-54bdf0927e75 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lazy-loading 'fault' on Instance uuid eaa3c72e-6b27-422d-bd9c-664908cf9837 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:31:50.524592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d12f1738-cf4a-4875-913f-54bdf0927e75 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77133736e0d34391973ed925eba8e7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc883787099641cdab549780c967225c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:31:50.539013 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d12f1738-cf4a-4875-913f-54bdf0927e75 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837" status: 200 len: 1385 microversion: 2.1 time: 0.133892 Sep 07 13:31:50.540092 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3371/6714] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:50 2022] GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837 => generated 1385 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:31:51.579646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b4408d92-b84e-4b47-9a55-588c82885498 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:51.580527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b4408d92-b84e-4b47-9a55-588c82885498 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] [instance: eaa3c72e-6b27-422d-bd9c-664908cf9837] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:31:51.582647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:31:51.590572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4408d92-b84e-4b47-9a55-588c82885498 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:51.591114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4408d92-b84e-4b47-9a55-588c82885498 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:51.591655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4408d92-b84e-4b47-9a55-588c82885498 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:51.592448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4408d92-b84e-4b47-9a55-588c82885498 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:31:51.592933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4408d92-b84e-4b47-9a55-588c82885498 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:31:51.593404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4408d92-b84e-4b47-9a55-588c82885498 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:31:51.610298 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-b4408d92-b84e-4b47-9a55-588c82885498 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] HTTP exception thrown: Instance eaa3c72e-6b27-422d-bd9c-664908cf9837 could not be found. Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b4408d92-b84e-4b47-9a55-588c82885498 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Request method failure captured: Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837 HTTP/1.1 Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJznDCylxHl7dFSg5H6GFG5g7dGbqgrNXFcG-czj8kTbCMIoGfMN1cYepiCHzri6HSF2fGbqvhKlrZcF94WzuLawc-yJ48CBAVKR_py0ZfBF6rG45EaKF5aWp2nW8n1wO2GG0GUcx-4VRuKT5s8I9ZUMkfiBKWvMtZQxDMTdn8uo-Qo Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: cc883787099641cdab549780c967225c Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1132788439 Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cc883787099641cdab549780c967225c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cc883787099641cdab549780c967225c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cc883787099641cdab549780c967225c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cc883787099641cdab549780c967225c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1132788439 Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: cc883787099641cdab549780c967225c Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1132788439 Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TestSecurityGroupsBasicOps-1132788439-project Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 77133736e0d34391973ed925eba8e7cf Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1132788439-project Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance eaa3c72e-6b27-422d-bd9c-664908cf9837 could not be found. Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'eaa3c72e-6b27-422d-bd9c-664908cf9837'} Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaa3c72e-6b27-422d-bd9c-664908cf9837 could not be found. Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaa3c72e-6b27-422d-bd9c-664908cf9837 could not be found. Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:31:51.612148 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:31:51.616743 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:31:51.616743 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:31:51.616743 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:31:51.616743 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:31:51.616743 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:31:51.616743 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:31:51.616743 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaa3c72e-6b27-422d-bd9c-664908cf9837 could not be found. Sep 07 13:31:51.616743 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:31:51.616743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b4408d92-b84e-4b47-9a55-588c82885498 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Returning 404 to user: Instance eaa3c72e-6b27-422d-bd9c-664908cf9837 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:31:51.616743 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b4408d92-b84e-4b47-9a55-588c82885498 tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837" status: 404 len: 111 microversion: 2.1 time: 0.040761 Sep 07 13:31:51.616743 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3344/6715] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:31:51 2022] GET /compute/v2.1/servers/eaa3c72e-6b27-422d-bd9c-664908cf9837 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:31:55.870540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f714c4b4-4af4-4852-bb74-5dd677767e6b tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] Calling method '.version_select at 0x7fc41842bd30>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:31:55.880073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:31:55.896777 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f714c4b4-4af4-4852-bb74-5dd677767e6b tempest-TestSecurityGroupsBasicOps-1132788439 tempest-TestSecurityGroupsBasicOps-1132788439-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1034093429" status: 202 len: 0 microversion: 2.1 time: 0.034210 Sep 07 13:31:55.902811 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3372/6716] 10.222.0.16 () {58 vars in 1278 bytes} [Wed Sep 7 13:31:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1034093429 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:33:16.370745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:16.371439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-04668296-314e-40d9-b0dc-f2427d7ac6f2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:16.371439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-04668296-314e-40d9-b0dc-f2427d7ac6f2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:16.372857 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 07 13:33:16.373191 n-d-852087-9 devstack@n-api.service[122433]: Wed Sep 7 13:33:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Sep 07 13:33:16.375606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=2,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:16.377357 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 07 13:33:16.377357 n-d-852087-9 devstack@n-api.service[122432]: Wed Sep 7 13:33:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e (ip 10.222.0.16) !!! Sep 07 13:33:16.380096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:16.380912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:16.400546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04668296-314e-40d9-b0dc-f2427d7ac6f2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:16.401125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04668296-314e-40d9-b0dc-f2427d7ac6f2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:16.401708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04668296-314e-40d9-b0dc-f2427d7ac6f2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:16.402484 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04668296-314e-40d9-b0dc-f2427d7ac6f2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:16.402954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04668296-314e-40d9-b0dc-f2427d7ac6f2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:16.404029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04668296-314e-40d9-b0dc-f2427d7ac6f2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:16.442777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-04668296-314e-40d9-b0dc-f2427d7ac6f2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:33:16.527724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-5e31cbc9-6848-4c81-ade9-b122abfd65cf req-5c96add6-d99a-4f9e-8919-407bb5746b30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "269230b1-3aaa-486d-9835-7e47d18bc16e", "tag": "751321c5-12e0-4491-a76a-5e2b987f658e"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:33:16.538873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5e31cbc9-6848-4c81-ade9-b122abfd65cf req-5c96add6-d99a-4f9e-8919-407bb5746b30 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:16.539389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5e31cbc9-6848-4c81-ade9-b122abfd65cf req-5c96add6-d99a-4f9e-8919-407bb5746b30 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:16.539852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5e31cbc9-6848-4c81-ade9-b122abfd65cf req-5c96add6-d99a-4f9e-8919-407bb5746b30 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:16.552623 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-5e31cbc9-6848-4c81-ade9-b122abfd65cf req-5c96add6-d99a-4f9e-8919-407bb5746b30 service nova] Creating event network-changed:751321c5-12e0-4491-a76a-5e2b987f658e for instance 269230b1-3aaa-486d-9835-7e47d18bc16e on n-h2-852087-9 Sep 07 13:33:16.555363 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-04668296-314e-40d9-b0dc-f2427d7ac6f2 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "DELETE /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e" status: 204 len: 0 microversion: 2.1 time: 0.189632 Sep 07 13:33:16.557113 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3345/6717] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:33:16 2022] DELETE /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:33:16.562270 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-5e31cbc9-6848-4c81-ade9-b122abfd65cf req-5c96add6-d99a-4f9e-8919-407bb5746b30 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194351 Sep 07 13:33:16.563063 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3373/6718] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:33:16.570081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c5644396-7649-48d9-a8ce-fe6f058f18d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:16.571076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c5644396-7649-48d9-a8ce-fe6f058f18d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:16.577839 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5644396-7649-48d9-a8ce-fe6f058f18d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:16.578325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5644396-7649-48d9-a8ce-fe6f058f18d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:16.578767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5644396-7649-48d9-a8ce-fe6f058f18d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:16.579483 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5644396-7649-48d9-a8ce-fe6f058f18d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:16.579938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5644396-7649-48d9-a8ce-fe6f058f18d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:16.580362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c5644396-7649-48d9-a8ce-fe6f058f18d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:16.733848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c5644396-7649-48d9-a8ce-fe6f058f18d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:16.748546 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c5644396-7649-48d9-a8ce-fe6f058f18d4 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e" status: 200 len: 1577 microversion: 2.1 time: 0.186514 Sep 07 13:33:16.749793 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3346/6719] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:16 2022] GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:33:17.775949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-45c15ef2-5ae4-4fd5-b7e2-7e8ae84fdaa9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:17.776727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-45c15ef2-5ae4-4fd5-b7e2-7e8ae84fdaa9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:17.789774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45c15ef2-5ae4-4fd5-b7e2-7e8ae84fdaa9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:17.790303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45c15ef2-5ae4-4fd5-b7e2-7e8ae84fdaa9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:17.790766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45c15ef2-5ae4-4fd5-b7e2-7e8ae84fdaa9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:17.791514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45c15ef2-5ae4-4fd5-b7e2-7e8ae84fdaa9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:17.792029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45c15ef2-5ae4-4fd5-b7e2-7e8ae84fdaa9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:17.792519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45c15ef2-5ae4-4fd5-b7e2-7e8ae84fdaa9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:17.963005 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-45c15ef2-5ae4-4fd5-b7e2-7e8ae84fdaa9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:17.973235 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-45c15ef2-5ae4-4fd5-b7e2-7e8ae84fdaa9 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e" status: 200 len: 1577 microversion: 2.1 time: 0.202896 Sep 07 13:33:17.974018 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3374/6720] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:17 2022] GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e => generated 1577 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:33:18.816425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-67a9994c-66d2-45de-a938-e7b7a6d96a87 req-dd5ac425-dcc4-4034-8aae-5e2d545b7c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "269230b1-3aaa-486d-9835-7e47d18bc16e", "name": "network-vif-deleted", "tag": "751321c5-12e0-4491-a76a-5e2b987f658e"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:33:18.829047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-67a9994c-66d2-45de-a938-e7b7a6d96a87 req-dd5ac425-dcc4-4034-8aae-5e2d545b7c92 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:18.829717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-67a9994c-66d2-45de-a938-e7b7a6d96a87 req-dd5ac425-dcc4-4034-8aae-5e2d545b7c92 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:18.830190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-67a9994c-66d2-45de-a938-e7b7a6d96a87 req-dd5ac425-dcc4-4034-8aae-5e2d545b7c92 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:18.845788 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-67a9994c-66d2-45de-a938-e7b7a6d96a87 req-dd5ac425-dcc4-4034-8aae-5e2d545b7c92 service nova] Creating event network-vif-deleted:751321c5-12e0-4491-a76a-5e2b987f658e for instance 269230b1-3aaa-486d-9835-7e47d18bc16e on n-h2-852087-9 Sep 07 13:33:18.851610 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-67a9994c-66d2-45de-a938-e7b7a6d96a87 req-dd5ac425-dcc4-4034-8aae-5e2d545b7c92 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038886 Sep 07 13:33:18.852707 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3347/6721] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:33:19.010171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e1da6e19-9901-4e39-a7cc-86570b1bcb14 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:19.011387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e1da6e19-9901-4e39-a7cc-86570b1bcb14 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:19.021129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1da6e19-9901-4e39-a7cc-86570b1bcb14 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:19.021788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1da6e19-9901-4e39-a7cc-86570b1bcb14 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:19.022412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1da6e19-9901-4e39-a7cc-86570b1bcb14 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:19.023264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1da6e19-9901-4e39-a7cc-86570b1bcb14 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:19.023811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1da6e19-9901-4e39-a7cc-86570b1bcb14 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:19.024397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1da6e19-9901-4e39-a7cc-86570b1bcb14 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:19.103851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e1da6e19-9901-4e39-a7cc-86570b1bcb14 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:19.114768 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e1da6e19-9901-4e39-a7cc-86570b1bcb14 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e" status: 200 len: 1225 microversion: 2.1 time: 0.109218 Sep 07 13:33:19.115372 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3375/6722] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:19 2022] GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:20.140637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-54f78f13-7c70-4b06-9cc2-ad509e1df275 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:20.141347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-54f78f13-7c70-4b06-9cc2-ad509e1df275 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:20.148028 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54f78f13-7c70-4b06-9cc2-ad509e1df275 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:20.148523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54f78f13-7c70-4b06-9cc2-ad509e1df275 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:20.148962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54f78f13-7c70-4b06-9cc2-ad509e1df275 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:20.149714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54f78f13-7c70-4b06-9cc2-ad509e1df275 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:20.150199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54f78f13-7c70-4b06-9cc2-ad509e1df275 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:20.150630 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-54f78f13-7c70-4b06-9cc2-ad509e1df275 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:20.222476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-54f78f13-7c70-4b06-9cc2-ad509e1df275 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:20.231128 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-54f78f13-7c70-4b06-9cc2-ad509e1df275 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e" status: 200 len: 1225 microversion: 2.1 time: 0.096020 Sep 07 13:33:20.231765 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3348/6723] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:20 2022] GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:21.256483 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dc527f29-fe9b-40d4-989d-367b5c866a66 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:21.257052 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dc527f29-fe9b-40d4-989d-367b5c866a66 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:21.264904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc527f29-fe9b-40d4-989d-367b5c866a66 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:21.265429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc527f29-fe9b-40d4-989d-367b5c866a66 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:21.265925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc527f29-fe9b-40d4-989d-367b5c866a66 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:21.266684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc527f29-fe9b-40d4-989d-367b5c866a66 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:21.267171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc527f29-fe9b-40d4-989d-367b5c866a66 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:21.267625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc527f29-fe9b-40d4-989d-367b5c866a66 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:21.343207 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dc527f29-fe9b-40d4-989d-367b5c866a66 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:21.352487 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dc527f29-fe9b-40d4-989d-367b5c866a66 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e" status: 200 len: 1225 microversion: 2.1 time: 0.100296 Sep 07 13:33:21.353106 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3376/6724] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:21 2022] GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:22.380076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-98d95d12-02cb-409d-a553-01c2b68da844 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:22.380702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-98d95d12-02cb-409d-a553-01c2b68da844 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:22.388534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98d95d12-02cb-409d-a553-01c2b68da844 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:22.389268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98d95d12-02cb-409d-a553-01c2b68da844 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:22.389990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98d95d12-02cb-409d-a553-01c2b68da844 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:22.390800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98d95d12-02cb-409d-a553-01c2b68da844 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:22.391287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98d95d12-02cb-409d-a553-01c2b68da844 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:22.391782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-98d95d12-02cb-409d-a553-01c2b68da844 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:22.471643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-98d95d12-02cb-409d-a553-01c2b68da844 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:22.480977 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-98d95d12-02cb-409d-a553-01c2b68da844 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e" status: 200 len: 1225 microversion: 2.1 time: 0.104592 Sep 07 13:33:22.490509 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3349/6725] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:22 2022] GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:23.509106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-757a6d6c-422b-46b6-b745-2b1fa4866f6a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:23.509723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-757a6d6c-422b-46b6-b745-2b1fa4866f6a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:23.517018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-757a6d6c-422b-46b6-b745-2b1fa4866f6a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:23.517713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-757a6d6c-422b-46b6-b745-2b1fa4866f6a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:23.518185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-757a6d6c-422b-46b6-b745-2b1fa4866f6a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:23.519072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-757a6d6c-422b-46b6-b745-2b1fa4866f6a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:23.519549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-757a6d6c-422b-46b6-b745-2b1fa4866f6a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:23.520096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-757a6d6c-422b-46b6-b745-2b1fa4866f6a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:23.560246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-757a6d6c-422b-46b6-b745-2b1fa4866f6a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:23.560747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-757a6d6c-422b-46b6-b745-2b1fa4866f6a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:23.561311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-757a6d6c-422b-46b6-b745-2b1fa4866f6a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:23.562041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-757a6d6c-422b-46b6-b745-2b1fa4866f6a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lazy-loading 'fault' on Instance uuid 269230b1-3aaa-486d-9835-7e47d18bc16e {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:33:23.605142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-757a6d6c-422b-46b6-b745-2b1fa4866f6a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:23.614168 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-757a6d6c-422b-46b6-b745-2b1fa4866f6a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e" status: 200 len: 1230 microversion: 2.1 time: 0.109306 Sep 07 13:33:23.614753 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3377/6726] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:23 2022] GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e => generated 1230 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:24.644818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ef135956-b882-4a8a-ab3c-31cd6baf731c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:24.645732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ef135956-b882-4a8a-ab3c-31cd6baf731c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 269230b1-3aaa-486d-9835-7e47d18bc16e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:24.652997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef135956-b882-4a8a-ab3c-31cd6baf731c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:24.653511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef135956-b882-4a8a-ab3c-31cd6baf731c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:24.653999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef135956-b882-4a8a-ab3c-31cd6baf731c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:24.654718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef135956-b882-4a8a-ab3c-31cd6baf731c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:24.655184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef135956-b882-4a8a-ab3c-31cd6baf731c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:24.655709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef135956-b882-4a8a-ab3c-31cd6baf731c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:24.671830 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-ef135956-b882-4a8a-ab3c-31cd6baf731c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] HTTP exception thrown: Instance 269230b1-3aaa-486d-9835-7e47d18bc16e could not be found. Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ef135956-b882-4a8a-ab3c-31cd6baf731c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Request method failure captured: Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e HTTP/1.1 Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJrKtGg8mTUS8TVRSUKjETENKgBfLqI2oUMffXPZtsQfHAGfvsCSe64IHdsu1gAtG3a2XlfVJiJMXBeXoxoYCkAhaL6z1XH8667-SWfmJ5tkR4WMw-DlaHMfOvoGzJHrmW4OvMTJQgI9_G9o9R2vidCDnbLRABw8OsiYOeqYc9Klp2E Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 90d330a2d2ad4295873277de2d649182 Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 269230b1-3aaa-486d-9835-7e47d18bc16e could not be found. Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '269230b1-3aaa-486d-9835-7e47d18bc16e'} Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 269230b1-3aaa-486d-9835-7e47d18bc16e could not be found. Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 269230b1-3aaa-486d-9835-7e47d18bc16e could not be found. Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:33:24.673725 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:33:24.677442 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:33:24.677442 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:33:24.677442 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:33:24.677442 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:33:24.677442 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:33:24.677442 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 269230b1-3aaa-486d-9835-7e47d18bc16e could not be found. Sep 07 13:33:24.677442 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:33:24.677442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ef135956-b882-4a8a-ab3c-31cd6baf731c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Returning 404 to user: Instance 269230b1-3aaa-486d-9835-7e47d18bc16e could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:33:24.677442 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ef135956-b882-4a8a-ab3c-31cd6baf731c tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e" status: 404 len: 111 microversion: 2.1 time: 0.034964 Sep 07 13:33:24.677442 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3350/6727] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:24 2022] GET /compute/v2.1/servers/269230b1-3aaa-486d-9835-7e47d18bc16e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:33:31.019103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-194c9d8c-7ec5-4096-8355-970461d2b6cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:31.019699 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d36a98c9-3e3a-4809-a60e-87958f52378c req-64e78584-c659-4d1e-a6b8-042145d8f18f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92678079-07b6-4d2f-abab-ed6991649e62", "tag": "c45e0b54-9119-4846-b45a-fa8f709266c4"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:33:31.020057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-194c9d8c-7ec5-4096-8355-970461d2b6cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:31.028962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-194c9d8c-7ec5-4096-8355-970461d2b6cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:31.029834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-194c9d8c-7ec5-4096-8355-970461d2b6cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:31.030748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-194c9d8c-7ec5-4096-8355-970461d2b6cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:31.031641 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-194c9d8c-7ec5-4096-8355-970461d2b6cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:31.031755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d36a98c9-3e3a-4809-a60e-87958f52378c req-64e78584-c659-4d1e-a6b8-042145d8f18f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:31.032220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d36a98c9-3e3a-4809-a60e-87958f52378c req-64e78584-c659-4d1e-a6b8-042145d8f18f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:31.032328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-194c9d8c-7ec5-4096-8355-970461d2b6cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:31.032663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d36a98c9-3e3a-4809-a60e-87958f52378c req-64e78584-c659-4d1e-a6b8-042145d8f18f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:31.032794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-194c9d8c-7ec5-4096-8355-970461d2b6cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:31.048279 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d36a98c9-3e3a-4809-a60e-87958f52378c req-64e78584-c659-4d1e-a6b8-042145d8f18f service nova] Creating event network-changed:c45e0b54-9119-4846-b45a-fa8f709266c4 for instance 92678079-07b6-4d2f-abab-ed6991649e62 on n-h1-852087-9 Sep 07 13:33:31.056124 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d36a98c9-3e3a-4809-a60e-87958f52378c req-64e78584-c659-4d1e-a6b8-042145d8f18f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040013 Sep 07 13:33:31.057030 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3351/6728] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:33:31.072194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-194c9d8c-7ec5-4096-8355-970461d2b6cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:33:31.180170 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-194c9d8c-7ec5-4096-8355-970461d2b6cf tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "DELETE /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62" status: 204 len: 0 microversion: 2.1 time: 0.164725 Sep 07 13:33:31.184320 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3378/6729] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:33:31 2022] DELETE /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:33:31.191382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-105c5205-a1ec-49e9-9bff-5a849b76113a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:31.192347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-105c5205-a1ec-49e9-9bff-5a849b76113a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:31.200379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-105c5205-a1ec-49e9-9bff-5a849b76113a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:31.200886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-105c5205-a1ec-49e9-9bff-5a849b76113a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:31.201736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-105c5205-a1ec-49e9-9bff-5a849b76113a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:31.202913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-105c5205-a1ec-49e9-9bff-5a849b76113a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:31.203560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-105c5205-a1ec-49e9-9bff-5a849b76113a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:31.204358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-105c5205-a1ec-49e9-9bff-5a849b76113a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:31.347852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-105c5205-a1ec-49e9-9bff-5a849b76113a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:31.356169 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-105c5205-a1ec-49e9-9bff-5a849b76113a tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62" status: 200 len: 1576 microversion: 2.1 time: 0.169869 Sep 07 13:33:31.356810 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3352/6730] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:31 2022] GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:32.381296 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d5671d7c-dd5c-4521-9d17-1187bb2b2ed5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:32.382243 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d5671d7c-dd5c-4521-9d17-1187bb2b2ed5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:32.389912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5671d7c-dd5c-4521-9d17-1187bb2b2ed5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:32.390429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5671d7c-dd5c-4521-9d17-1187bb2b2ed5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:32.390887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5671d7c-dd5c-4521-9d17-1187bb2b2ed5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:32.391686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5671d7c-dd5c-4521-9d17-1187bb2b2ed5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:32.392181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5671d7c-dd5c-4521-9d17-1187bb2b2ed5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:32.392600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5671d7c-dd5c-4521-9d17-1187bb2b2ed5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:32.537922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d5671d7c-dd5c-4521-9d17-1187bb2b2ed5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:32.546258 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d5671d7c-dd5c-4521-9d17-1187bb2b2ed5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62" status: 200 len: 1576 microversion: 2.1 time: 0.169278 Sep 07 13:33:32.546840 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3379/6731] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:32 2022] GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:33.571610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f72ade7d-abd5-43ac-9e2d-374e8dab56f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:33.572231 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f72ade7d-abd5-43ac-9e2d-374e8dab56f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:33.582002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f72ade7d-abd5-43ac-9e2d-374e8dab56f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:33.582607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f72ade7d-abd5-43ac-9e2d-374e8dab56f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:33.583036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f72ade7d-abd5-43ac-9e2d-374e8dab56f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:33.584172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f72ade7d-abd5-43ac-9e2d-374e8dab56f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:33.584684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f72ade7d-abd5-43ac-9e2d-374e8dab56f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:33.585096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f72ade7d-abd5-43ac-9e2d-374e8dab56f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:33.638963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-f87c431e-881f-4067-84b7-4487d93a8676 req-fa2b4d16-2732-4284-83be-69d376121c5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92678079-07b6-4d2f-abab-ed6991649e62", "name": "network-vif-deleted", "tag": "c45e0b54-9119-4846-b45a-fa8f709266c4"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:33:33.649703 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f87c431e-881f-4067-84b7-4487d93a8676 req-fa2b4d16-2732-4284-83be-69d376121c5b service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:33.650215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f87c431e-881f-4067-84b7-4487d93a8676 req-fa2b4d16-2732-4284-83be-69d376121c5b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:33.650844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f87c431e-881f-4067-84b7-4487d93a8676 req-fa2b4d16-2732-4284-83be-69d376121c5b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:33.659948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f72ade7d-abd5-43ac-9e2d-374e8dab56f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:33.663865 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-f87c431e-881f-4067-84b7-4487d93a8676 req-fa2b4d16-2732-4284-83be-69d376121c5b service nova] Creating event network-vif-deleted:c45e0b54-9119-4846-b45a-fa8f709266c4 for instance 92678079-07b6-4d2f-abab-ed6991649e62 on n-h1-852087-9 Sep 07 13:33:33.669029 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-f87c431e-881f-4067-84b7-4487d93a8676 req-fa2b4d16-2732-4284-83be-69d376121c5b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097613 Sep 07 13:33:33.672255 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f72ade7d-abd5-43ac-9e2d-374e8dab56f5 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62" status: 200 len: 1391 microversion: 2.1 time: 0.105997 Sep 07 13:33:33.672973 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3380/6732] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:33:33.673433 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3353/6733] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:33 2022] GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 => generated 1391 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:34.698685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ff579d6f-bcad-4b70-a75b-efab026f6f21 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:34.699432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ff579d6f-bcad-4b70-a75b-efab026f6f21 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:34.706570 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff579d6f-bcad-4b70-a75b-efab026f6f21 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:34.707099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff579d6f-bcad-4b70-a75b-efab026f6f21 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:34.707549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff579d6f-bcad-4b70-a75b-efab026f6f21 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:34.708307 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff579d6f-bcad-4b70-a75b-efab026f6f21 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:34.708806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff579d6f-bcad-4b70-a75b-efab026f6f21 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:34.709252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ff579d6f-bcad-4b70-a75b-efab026f6f21 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:34.781633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ff579d6f-bcad-4b70-a75b-efab026f6f21 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:34.790362 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ff579d6f-bcad-4b70-a75b-efab026f6f21 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62" status: 200 len: 1225 microversion: 2.1 time: 0.097082 Sep 07 13:33:34.790961 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3381/6734] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:34 2022] GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:35.813441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d7d2a045-3167-492d-8837-7a8f9753b15b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:35.814109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d7d2a045-3167-492d-8837-7a8f9753b15b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:35.822015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7d2a045-3167-492d-8837-7a8f9753b15b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:35.822506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7d2a045-3167-492d-8837-7a8f9753b15b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:35.822962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7d2a045-3167-492d-8837-7a8f9753b15b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:35.823703 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7d2a045-3167-492d-8837-7a8f9753b15b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:35.824146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7d2a045-3167-492d-8837-7a8f9753b15b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:35.824576 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7d2a045-3167-492d-8837-7a8f9753b15b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:35.895923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d7d2a045-3167-492d-8837-7a8f9753b15b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:35.909420 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d7d2a045-3167-492d-8837-7a8f9753b15b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62" status: 200 len: 1225 microversion: 2.1 time: 0.099609 Sep 07 13:33:35.910595 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3354/6735] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:35 2022] GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:36.934930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-67c96ebf-6f64-4764-b232-5f588dbe2c3b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:36.934930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-67c96ebf-6f64-4764-b232-5f588dbe2c3b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:36.942875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67c96ebf-6f64-4764-b232-5f588dbe2c3b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:36.943409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67c96ebf-6f64-4764-b232-5f588dbe2c3b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:36.943873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67c96ebf-6f64-4764-b232-5f588dbe2c3b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:36.944623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67c96ebf-6f64-4764-b232-5f588dbe2c3b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:36.945133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67c96ebf-6f64-4764-b232-5f588dbe2c3b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:36.945552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-67c96ebf-6f64-4764-b232-5f588dbe2c3b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:37.022321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-67c96ebf-6f64-4764-b232-5f588dbe2c3b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:37.031077 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-67c96ebf-6f64-4764-b232-5f588dbe2c3b tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62" status: 200 len: 1225 microversion: 2.1 time: 0.101000 Sep 07 13:33:37.032313 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3382/6736] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:36 2022] GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:38.057465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-09c2d399-3a8a-4871-bf32-0fa28e538fb7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:38.058141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-09c2d399-3a8a-4871-bf32-0fa28e538fb7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:38.066552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09c2d399-3a8a-4871-bf32-0fa28e538fb7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:38.067055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09c2d399-3a8a-4871-bf32-0fa28e538fb7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:38.067501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09c2d399-3a8a-4871-bf32-0fa28e538fb7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:38.068229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09c2d399-3a8a-4871-bf32-0fa28e538fb7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:38.068691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09c2d399-3a8a-4871-bf32-0fa28e538fb7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:38.069120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09c2d399-3a8a-4871-bf32-0fa28e538fb7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:38.105508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09c2d399-3a8a-4871-bf32-0fa28e538fb7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:38.106018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09c2d399-3a8a-4871-bf32-0fa28e538fb7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:38.106463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-09c2d399-3a8a-4871-bf32-0fa28e538fb7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:38.106926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-09c2d399-3a8a-4871-bf32-0fa28e538fb7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lazy-loading 'fault' on Instance uuid 92678079-07b6-4d2f-abab-ed6991649e62 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:33:38.151602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-09c2d399-3a8a-4871-bf32-0fa28e538fb7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d330a2d2ad4295873277de2d649182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97b8dd299f145888f90fbf60321cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:33:38.165024 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-09c2d399-3a8a-4871-bf32-0fa28e538fb7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62" status: 200 len: 1230 microversion: 2.1 time: 0.111817 Sep 07 13:33:38.166160 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3355/6737] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:38 2022] GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 => generated 1230 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:33:39.191473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-07fa1672-1fc8-4c81-b4d4-8bad750f0bc6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:39.192296 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-07fa1672-1fc8-4c81-b4d4-8bad750f0bc6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: 92678079-07b6-4d2f-abab-ed6991649e62] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:39.202403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07fa1672-1fc8-4c81-b4d4-8bad750f0bc6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:39.202922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07fa1672-1fc8-4c81-b4d4-8bad750f0bc6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:39.203383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07fa1672-1fc8-4c81-b4d4-8bad750f0bc6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:39.204110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07fa1672-1fc8-4c81-b4d4-8bad750f0bc6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:39.204587 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07fa1672-1fc8-4c81-b4d4-8bad750f0bc6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:39.205035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07fa1672-1fc8-4c81-b4d4-8bad750f0bc6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:39.219718 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-07fa1672-1fc8-4c81-b4d4-8bad750f0bc6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] HTTP exception thrown: Instance 92678079-07b6-4d2f-abab-ed6991649e62 could not be found. Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-07fa1672-1fc8-4c81-b4d4-8bad750f0bc6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Request method failure captured: Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 HTTP/1.1 Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJrKtGg8mTUS8TVRSUKjETENKgBfLqI2oUMffXPZtsQfHAGfvsCSe64IHdsu1gAtG3a2XlfVJiJMXBeXoxoYCkAhaL6z1XH8667-SWfmJ5tkR4WMw-DlaHMfOvoGzJHrmW4OvMTJQgI9_G9o9R2vidCDnbLRABw8OsiYOeqYc9Klp2E Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 90d330a2d2ad4295873277de2d649182 Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 92678079-07b6-4d2f-abab-ed6991649e62 could not be found. Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '92678079-07b6-4d2f-abab-ed6991649e62'} Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92678079-07b6-4d2f-abab-ed6991649e62 could not be found. Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92678079-07b6-4d2f-abab-ed6991649e62 could not be found. Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:33:39.221474 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:33:39.225285 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:33:39.225285 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:33:39.225285 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:33:39.225285 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:33:39.225285 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:33:39.225285 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92678079-07b6-4d2f-abab-ed6991649e62 could not be found. Sep 07 13:33:39.225285 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:33:39.225285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-07fa1672-1fc8-4c81-b4d4-8bad750f0bc6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Returning 404 to user: Instance 92678079-07b6-4d2f-abab-ed6991649e62 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:33:39.225285 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-07fa1672-1fc8-4c81-b4d4-8bad750f0bc6 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62" status: 404 len: 111 microversion: 2.1 time: 0.036409 Sep 07 13:33:39.225285 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3383/6738] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:39 2022] GET /compute/v2.1/servers/92678079-07b6-4d2f-abab-ed6991649e62 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:33:39.712367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-95cc5741-4166-48c2-a23e-50a5035a0f4f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:39.712859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-95cc5741-4166-48c2-a23e-50a5035a0f4f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:39.720676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95cc5741-4166-48c2-a23e-50a5035a0f4f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:39.721170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95cc5741-4166-48c2-a23e-50a5035a0f4f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:39.721646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95cc5741-4166-48c2-a23e-50a5035a0f4f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:39.722352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95cc5741-4166-48c2-a23e-50a5035a0f4f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:39.722813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95cc5741-4166-48c2-a23e-50a5035a0f4f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:39.723238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95cc5741-4166-48c2-a23e-50a5035a0f4f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:39.738153 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-95cc5741-4166-48c2-a23e-50a5035a0f4f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] HTTP exception thrown: Instance b9124e17-08d2-4641-b390-b43169aa6ca7 could not be found. Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-95cc5741-4166-48c2-a23e-50a5035a0f4f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Request method failure captured: Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 HTTP/1.1 Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJrKtGg8mTUS8TVRSUKjETENKgBfLqI2oUMffXPZtsQfHAGfvsCSe64IHdsu1gAtG3a2XlfVJiJMXBeXoxoYCkAhaL6z1XH8667-SWfmJ5tkR4WMw-DlaHMfOvoGzJHrmW4OvMTJQgI9_G9o9R2vidCDnbLRABw8OsiYOeqYc9Klp2E Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 90d330a2d2ad4295873277de2d649182 Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance b9124e17-08d2-4641-b390-b43169aa6ca7 could not be found. Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'b9124e17-08d2-4641-b390-b43169aa6ca7'} Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9124e17-08d2-4641-b390-b43169aa6ca7 could not be found. Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:33:39.739995 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:33:39.743607 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9124e17-08d2-4641-b390-b43169aa6ca7 could not be found. Sep 07 13:33:39.743607 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:33:39.743607 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:33:39.743607 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:33:39.743607 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:33:39.743607 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:33:39.743607 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:33:39.743607 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:33:39.743607 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:33:39.743607 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9124e17-08d2-4641-b390-b43169aa6ca7 could not be found. Sep 07 13:33:39.743607 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:33:39.743607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-95cc5741-4166-48c2-a23e-50a5035a0f4f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Returning 404 to user: Instance b9124e17-08d2-4641-b390-b43169aa6ca7 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:33:39.743607 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-95cc5741-4166-48c2-a23e-50a5035a0f4f tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 404 len: 111 microversion: 2.1 time: 0.033077 Sep 07 13:33:39.743607 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3356/6739] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:33:39 2022] DELETE /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:33:39.750640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4d7e091c-b75e-43fb-a014-0f8672735fa7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:39.751285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4d7e091c-b75e-43fb-a014-0f8672735fa7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] [instance: b9124e17-08d2-4641-b390-b43169aa6ca7] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:33:39.757620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d7e091c-b75e-43fb-a014-0f8672735fa7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:39.758128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d7e091c-b75e-43fb-a014-0f8672735fa7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:39.758602 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d7e091c-b75e-43fb-a014-0f8672735fa7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:39.759325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d7e091c-b75e-43fb-a014-0f8672735fa7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:33:39.759807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d7e091c-b75e-43fb-a014-0f8672735fa7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:33:39.760312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4d7e091c-b75e-43fb-a014-0f8672735fa7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:33:39.774684 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-4d7e091c-b75e-43fb-a014-0f8672735fa7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] HTTP exception thrown: Instance b9124e17-08d2-4641-b390-b43169aa6ca7 could not be found. Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4d7e091c-b75e-43fb-a014-0f8672735fa7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Request method failure captured: Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 HTTP/1.1 Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJrKtGg8mTUS8TVRSUKjETENKgBfLqI2oUMffXPZtsQfHAGfvsCSe64IHdsu1gAtG3a2XlfVJiJMXBeXoxoYCkAhaL6z1XH8667-SWfmJ5tkR4WMw-DlaHMfOvoGzJHrmW4OvMTJQgI9_G9o9R2vidCDnbLRABw8OsiYOeqYc9Klp2E Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b97b8dd299f145888f90fbf60321cd18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: b97b8dd299f145888f90fbf60321cd18 Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestVolumeBootPattern-2016163185 Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 90d330a2d2ad4295873277de2d649182 Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TestVolumeBootPattern-2016163185-project Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance b9124e17-08d2-4641-b390-b43169aa6ca7 could not be found. Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'b9124e17-08d2-4641-b390-b43169aa6ca7'} Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9124e17-08d2-4641-b390-b43169aa6ca7 could not be found. Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9124e17-08d2-4641-b390-b43169aa6ca7 could not be found. Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:33:39.776276 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:33:39.782066 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:33:39.782066 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:33:39.782066 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:33:39.782066 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:33:39.782066 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:33:39.782066 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9124e17-08d2-4641-b390-b43169aa6ca7 could not be found. Sep 07 13:33:39.782066 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:33:39.782066 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4d7e091c-b75e-43fb-a014-0f8672735fa7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Returning 404 to user: Instance b9124e17-08d2-4641-b390-b43169aa6ca7 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:33:39.782066 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4d7e091c-b75e-43fb-a014-0f8672735fa7 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7" status: 404 len: 111 microversion: 2.1 time: 0.031145 Sep 07 13:33:39.782066 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3384/6740] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:33:39 2022] GET /compute/v2.1/servers/b9124e17-08d2-4641-b390-b43169aa6ca7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:33:43.237870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-95c5377e-caa5-44a5-b643-e677d5aaa334 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] Calling method '.version_select at 0x7fc413df3a60>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:33:43.267768 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-95c5377e-caa5-44a5-b643-e677d5aaa334 tempest-TestVolumeBootPattern-2016163185 tempest-TestVolumeBootPattern-2016163185-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2091031878" status: 202 len: 0 microversion: 2.1 time: 0.033824 Sep 07 13:33:43.268394 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3357/6741] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Sep 7 13:33:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2091031878 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:34:03.102631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:03.103488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:03.233134 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-16faa08d-9e13-48ed-9dd0-e074d90df376 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-414808849", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:34:03.295887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-16faa08d-9e13-48ed-9dd0-e074d90df376 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] validate_networks() for None {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:34:03.602945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-16faa08d-9e13-48ed-9dd0-e074d90df376 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:34:03.603392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-16faa08d-9e13-48ed-9dd0-e074d90df376 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:34:03.603867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-16faa08d-9e13-48ed-9dd0-e074d90df376 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:34:03.604325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-16faa08d-9e13-48ed-9dd0-e074d90df376 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:34:03.604751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-16faa08d-9e13-48ed-9dd0-e074d90df376 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:34:03.615230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16faa08d-9e13-48ed-9dd0-e074d90df376 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:03.615814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16faa08d-9e13-48ed-9dd0-e074d90df376 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:03.616275 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16faa08d-9e13-48ed-9dd0-e074d90df376 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:03.617026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16faa08d-9e13-48ed-9dd0-e074d90df376 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:03.617552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16faa08d-9e13-48ed-9dd0-e074d90df376 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:03.618003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16faa08d-9e13-48ed-9dd0-e074d90df376 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:03.637501 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-16faa08d-9e13-48ed-9dd0-e074d90df376 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Getting quotas for project 9dd0e79d7c274ee88ec9f4f53004eecc. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:34:03.643230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-16faa08d-9e13-48ed-9dd0-e074d90df376 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Getting quotas for user 3bef111d18e5463981869a02bd07cd76 and project 9dd0e79d7c274ee88ec9f4f53004eecc. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:34:03.656221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-16faa08d-9e13-48ed-9dd0-e074d90df376 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:34:03.658720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-16faa08d-9e13-48ed-9dd0-e074d90df376 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] [instance: c0af6dd9-95ef-4c22-93c0-95cf72856630] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:34:03.713623 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-16faa08d-9e13-48ed-9dd0-e074d90df376 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616233 Sep 07 13:34:03.714478 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3385/6742] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:34:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:34:03.726237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:03.727223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:03.732666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-44bf036a-d8bf-4837-a8b7-33073512851a tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:03.733368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-44bf036a-d8bf-4837-a8b7-33073512851a tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] [instance: c0af6dd9-95ef-4c22-93c0-95cf72856630] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:03.800992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-44bf036a-d8bf-4837-a8b7-33073512851a tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bef111d18e5463981869a02bd07cd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd0e79d7c274ee88ec9f4f53004eecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:03.814224 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-44bf036a-d8bf-4837-a8b7-33073512851a tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] 10.222.0.16 "GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630" status: 200 len: 1221 microversion: 2.1 time: 0.089352 Sep 07 13:34:03.815338 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3358/6743] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:03 2022] GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630 => generated 1221 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:04.855385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-768d664a-c3e5-46f3-9faa-fd5355e4eded tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:04.856003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-768d664a-c3e5-46f3-9faa-fd5355e4eded tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] [instance: c0af6dd9-95ef-4c22-93c0-95cf72856630] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:04.863300 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-768d664a-c3e5-46f3-9faa-fd5355e4eded tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:04.863819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-768d664a-c3e5-46f3-9faa-fd5355e4eded tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:04.864304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-768d664a-c3e5-46f3-9faa-fd5355e4eded tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:04.865029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-768d664a-c3e5-46f3-9faa-fd5355e4eded tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:04.865518 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-768d664a-c3e5-46f3-9faa-fd5355e4eded tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:04.865969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-768d664a-c3e5-46f3-9faa-fd5355e4eded tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:04.936550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-768d664a-c3e5-46f3-9faa-fd5355e4eded tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bef111d18e5463981869a02bd07cd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd0e79d7c274ee88ec9f4f53004eecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:04.945848 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-768d664a-c3e5-46f3-9faa-fd5355e4eded tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] 10.222.0.16 "GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630" status: 200 len: 1273 microversion: 2.1 time: 0.095583 Sep 07 13:34:04.946455 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3386/6744] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:04 2022] GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630 => generated 1273 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:05.974706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1abaf8f4-0678-497f-bd16-f0389c76bf5e tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:05.975393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1abaf8f4-0678-497f-bd16-f0389c76bf5e tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] [instance: c0af6dd9-95ef-4c22-93c0-95cf72856630] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:05.983093 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1abaf8f4-0678-497f-bd16-f0389c76bf5e tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:05.983592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1abaf8f4-0678-497f-bd16-f0389c76bf5e tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:05.984004 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1abaf8f4-0678-497f-bd16-f0389c76bf5e tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:05.984935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1abaf8f4-0678-497f-bd16-f0389c76bf5e tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:05.985412 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1abaf8f4-0678-497f-bd16-f0389c76bf5e tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:05.985864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1abaf8f4-0678-497f-bd16-f0389c76bf5e tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:06.163619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1abaf8f4-0678-497f-bd16-f0389c76bf5e tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bef111d18e5463981869a02bd07cd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd0e79d7c274ee88ec9f4f53004eecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:06.173985 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1abaf8f4-0678-497f-bd16-f0389c76bf5e tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] 10.222.0.16 "GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630" status: 200 len: 1321 microversion: 2.1 time: 0.206239 Sep 07 13:34:06.174598 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3359/6745] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:05 2022] GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:06.815656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c0bca28d-b071-450e-b73a-11ff014e93c7 req-fdb25dce-d67c-48a3-91a7-48fc16553d13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0af6dd9-95ef-4c22-93c0-95cf72856630", "tag": "fe3d2eff-4b41-43e5-acc2-e3b6d8e738cf"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:34:06.831205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c0bca28d-b071-450e-b73a-11ff014e93c7 req-fdb25dce-d67c-48a3-91a7-48fc16553d13 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:06.832037 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c0bca28d-b071-450e-b73a-11ff014e93c7 req-fdb25dce-d67c-48a3-91a7-48fc16553d13 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:06.832672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c0bca28d-b071-450e-b73a-11ff014e93c7 req-fdb25dce-d67c-48a3-91a7-48fc16553d13 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:06.849195 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c0bca28d-b071-450e-b73a-11ff014e93c7 req-fdb25dce-d67c-48a3-91a7-48fc16553d13 service nova] Creating event network-changed:fe3d2eff-4b41-43e5-acc2-e3b6d8e738cf for instance c0af6dd9-95ef-4c22-93c0-95cf72856630 on n-h2-852087-9 Sep 07 13:34:06.855048 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c0bca28d-b071-450e-b73a-11ff014e93c7 req-fdb25dce-d67c-48a3-91a7-48fc16553d13 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043371 Sep 07 13:34:06.855685 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3387/6746] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:34:07.197757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cd37478c-ed5b-4d1a-b25f-4cab3d13af41 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:07.198411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cd37478c-ed5b-4d1a-b25f-4cab3d13af41 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] [instance: c0af6dd9-95ef-4c22-93c0-95cf72856630] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:07.205861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd37478c-ed5b-4d1a-b25f-4cab3d13af41 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:07.206349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd37478c-ed5b-4d1a-b25f-4cab3d13af41 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:07.206784 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd37478c-ed5b-4d1a-b25f-4cab3d13af41 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:07.207470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd37478c-ed5b-4d1a-b25f-4cab3d13af41 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:07.207921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd37478c-ed5b-4d1a-b25f-4cab3d13af41 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:07.208344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cd37478c-ed5b-4d1a-b25f-4cab3d13af41 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:07.349453 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cd37478c-ed5b-4d1a-b25f-4cab3d13af41 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bef111d18e5463981869a02bd07cd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd0e79d7c274ee88ec9f4f53004eecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:07.360893 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cd37478c-ed5b-4d1a-b25f-4cab3d13af41 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] 10.222.0.16 "GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630" status: 200 len: 1321 microversion: 2.1 time: 0.167461 Sep 07 13:34:07.361551 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3360/6747] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:07 2022] GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:08.391329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7ed75403-a20e-4a52-949a-e4d2a350a60c tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:08.392116 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7ed75403-a20e-4a52-949a-e4d2a350a60c tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] [instance: c0af6dd9-95ef-4c22-93c0-95cf72856630] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:08.399961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ed75403-a20e-4a52-949a-e4d2a350a60c tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:08.400536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ed75403-a20e-4a52-949a-e4d2a350a60c tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:08.400943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ed75403-a20e-4a52-949a-e4d2a350a60c tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:08.401715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ed75403-a20e-4a52-949a-e4d2a350a60c tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:08.402301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ed75403-a20e-4a52-949a-e4d2a350a60c tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:08.402650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7ed75403-a20e-4a52-949a-e4d2a350a60c tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:08.548462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7ed75403-a20e-4a52-949a-e4d2a350a60c tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bef111d18e5463981869a02bd07cd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd0e79d7c274ee88ec9f4f53004eecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:08.559047 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7ed75403-a20e-4a52-949a-e4d2a350a60c tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] 10.222.0.16 "GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630" status: 200 len: 1321 microversion: 2.1 time: 0.171706 Sep 07 13:34:08.559807 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3388/6748] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:08 2022] GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:09.584102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a9dd6019-22b6-45e6-ab3c-63576e093c4b tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:09.584682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a9dd6019-22b6-45e6-ab3c-63576e093c4b tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] [instance: c0af6dd9-95ef-4c22-93c0-95cf72856630] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:09.592657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9dd6019-22b6-45e6-ab3c-63576e093c4b tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:09.593157 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9dd6019-22b6-45e6-ab3c-63576e093c4b tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:09.593637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9dd6019-22b6-45e6-ab3c-63576e093c4b tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:09.594349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9dd6019-22b6-45e6-ab3c-63576e093c4b tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:09.594806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9dd6019-22b6-45e6-ab3c-63576e093c4b tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:09.595242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a9dd6019-22b6-45e6-ab3c-63576e093c4b tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:09.755613 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a9dd6019-22b6-45e6-ab3c-63576e093c4b tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bef111d18e5463981869a02bd07cd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd0e79d7c274ee88ec9f4f53004eecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:09.765697 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a9dd6019-22b6-45e6-ab3c-63576e093c4b tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] 10.222.0.16 "GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630" status: 200 len: 1321 microversion: 2.1 time: 0.185839 Sep 07 13:34:09.766586 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3361/6749] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:09 2022] GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:10.790866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-db1202f8-b319-4fd9-91fb-193a5218b14c tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:10.791412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-db1202f8-b319-4fd9-91fb-193a5218b14c tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] [instance: c0af6dd9-95ef-4c22-93c0-95cf72856630] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:10.799027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db1202f8-b319-4fd9-91fb-193a5218b14c tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:10.799555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db1202f8-b319-4fd9-91fb-193a5218b14c tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:10.800022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db1202f8-b319-4fd9-91fb-193a5218b14c tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:10.800767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db1202f8-b319-4fd9-91fb-193a5218b14c tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:10.801254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db1202f8-b319-4fd9-91fb-193a5218b14c tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:10.801737 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db1202f8-b319-4fd9-91fb-193a5218b14c tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:10.950088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-db1202f8-b319-4fd9-91fb-193a5218b14c tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bef111d18e5463981869a02bd07cd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd0e79d7c274ee88ec9f4f53004eecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:10.963781 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-db1202f8-b319-4fd9-91fb-193a5218b14c tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] 10.222.0.16 "GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630" status: 200 len: 1321 microversion: 2.1 time: 0.176922 Sep 07 13:34:10.964514 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3389/6750] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:10 2022] GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:11.973308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-00deb4ef-41ac-4aa6-8c4a-f21b06244a78 req-82efdf43-e09e-42dc-8bb1-04e978faa8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0af6dd9-95ef-4c22-93c0-95cf72856630", "name": "network-vif-plugged", "status": "completed", "tag": "fe3d2eff-4b41-43e5-acc2-e3b6d8e738cf"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:34:11.984794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-00deb4ef-41ac-4aa6-8c4a-f21b06244a78 req-82efdf43-e09e-42dc-8bb1-04e978faa8e1 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:11.987688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-00deb4ef-41ac-4aa6-8c4a-f21b06244a78 req-82efdf43-e09e-42dc-8bb1-04e978faa8e1 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:11.988444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-00deb4ef-41ac-4aa6-8c4a-f21b06244a78 req-82efdf43-e09e-42dc-8bb1-04e978faa8e1 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:11.991267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-36216ff6-ef45-47be-83ca-e14618b868a3 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:11.991919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-36216ff6-ef45-47be-83ca-e14618b868a3 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] [instance: c0af6dd9-95ef-4c22-93c0-95cf72856630] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:11.999205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36216ff6-ef45-47be-83ca-e14618b868a3 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:11.999724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36216ff6-ef45-47be-83ca-e14618b868a3 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:12.000183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36216ff6-ef45-47be-83ca-e14618b868a3 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:12.000921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36216ff6-ef45-47be-83ca-e14618b868a3 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:12.001377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36216ff6-ef45-47be-83ca-e14618b868a3 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:12.001861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-36216ff6-ef45-47be-83ca-e14618b868a3 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:12.003681 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-00deb4ef-41ac-4aa6-8c4a-f21b06244a78 req-82efdf43-e09e-42dc-8bb1-04e978faa8e1 service nova] Creating event network-vif-plugged:fe3d2eff-4b41-43e5-acc2-e3b6d8e738cf for instance c0af6dd9-95ef-4c22-93c0-95cf72856630 on n-h2-852087-9 Sep 07 13:34:12.010093 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-00deb4ef-41ac-4aa6-8c4a-f21b06244a78 req-82efdf43-e09e-42dc-8bb1-04e978faa8e1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105114 Sep 07 13:34:12.010927 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3362/6751] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:34:12.143409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-36216ff6-ef45-47be-83ca-e14618b868a3 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bef111d18e5463981869a02bd07cd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd0e79d7c274ee88ec9f4f53004eecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:12.152431 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-36216ff6-ef45-47be-83ca-e14618b868a3 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] 10.222.0.16 "GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630" status: 200 len: 1321 microversion: 2.1 time: 0.165782 Sep 07 13:34:12.153833 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3390/6752] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:11 2022] GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:13.178571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-645ab8f5-ae49-4620-b11c-fd81a3329967 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:13.179324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-645ab8f5-ae49-4620-b11c-fd81a3329967 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] [instance: c0af6dd9-95ef-4c22-93c0-95cf72856630] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:13.185886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-645ab8f5-ae49-4620-b11c-fd81a3329967 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:13.186380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-645ab8f5-ae49-4620-b11c-fd81a3329967 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:13.186845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-645ab8f5-ae49-4620-b11c-fd81a3329967 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:13.187545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-645ab8f5-ae49-4620-b11c-fd81a3329967 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:13.188007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-645ab8f5-ae49-4620-b11c-fd81a3329967 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:13.188473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-645ab8f5-ae49-4620-b11c-fd81a3329967 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:13.327080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-645ab8f5-ae49-4620-b11c-fd81a3329967 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bef111d18e5463981869a02bd07cd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd0e79d7c274ee88ec9f4f53004eecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:13.335308 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-645ab8f5-ae49-4620-b11c-fd81a3329967 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] 10.222.0.16 "GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630" status: 200 len: 1321 microversion: 2.1 time: 0.162276 Sep 07 13:34:13.335944 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3363/6753] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:13 2022] GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:14.359410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a96df753-3d65-413c-aeba-9ba284666638 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:14.360040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a96df753-3d65-413c-aeba-9ba284666638 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] [instance: c0af6dd9-95ef-4c22-93c0-95cf72856630] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:14.363033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:14.363738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:14.370375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a96df753-3d65-413c-aeba-9ba284666638 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:14.370886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a96df753-3d65-413c-aeba-9ba284666638 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:14.371345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a96df753-3d65-413c-aeba-9ba284666638 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:14.372097 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a96df753-3d65-413c-aeba-9ba284666638 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:14.372593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a96df753-3d65-413c-aeba-9ba284666638 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:14.373029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a96df753-3d65-413c-aeba-9ba284666638 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:14.525743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a96df753-3d65-413c-aeba-9ba284666638 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bef111d18e5463981869a02bd07cd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd0e79d7c274ee88ec9f4f53004eecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:14.533831 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a96df753-3d65-413c-aeba-9ba284666638 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] 10.222.0.16 "GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630" status: 200 len: 1471 microversion: 2.1 time: 0.178698 Sep 07 13:34:14.534421 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3391/6754] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:14 2022] GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630 => generated 1471 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:14.568450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:14.618451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-56f96080-d2e7-4c29-ac1d-c8e7a083a1c0 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Calling method '.version_select at 0x7fc41941adc0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:14.703597 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-56f96080-d2e7-4c29-ac1d-c8e7a083a1c0 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/0759291cae264ef588905011b051606a" status: 200 len: 371 microversion: 2.1 time: 0.140202 Sep 07 13:34:14.704238 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3364/6755] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Sep 7 13:34:14 2022] GET /compute/v2.1/os-quota-sets/0759291cae264ef588905011b051606a => generated 371 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:34:14.717955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-36f7ea65-8d8b-4f3d-af38-12b11af36c3c tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1553196164", "id": 738022041, "os-flavor-access:is_public": "True"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:34:14.737272 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-36f7ea65-8d8b-4f3d-af38-12b11af36c3c tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.023470 Sep 07 13:34:14.737919 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3392/6756] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:34:14 2022] POST /compute/v2.1/flavors => generated 435 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:34:14.750726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-43e1ab1e-c362-4f65-84b8-7c3f103cb0bb tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "738022041"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:34:14.753159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-43e1ab1e-c362-4f65-84b8-7c3f103cb0bb tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] [instance: c0af6dd9-95ef-4c22-93c0-95cf72856630] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:14.761201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e1ab1e-c362-4f65-84b8-7c3f103cb0bb tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:14.761764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e1ab1e-c362-4f65-84b8-7c3f103cb0bb tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:14.762226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e1ab1e-c362-4f65-84b8-7c3f103cb0bb tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:14.763591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e1ab1e-c362-4f65-84b8-7c3f103cb0bb tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:14.763591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e1ab1e-c362-4f65-84b8-7c3f103cb0bb tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:14.764082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e1ab1e-c362-4f65-84b8-7c3f103cb0bb tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:14.963906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-43e1ab1e-c362-4f65-84b8-7c3f103cb0bb tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6d4e22c99aad404ba274c1347f372a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0759291cae264ef588905011b051606a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:14.971185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-43e1ab1e-c362-4f65-84b8-7c3f103cb0bb tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] [instance: c0af6dd9-95ef-4c22-93c0-95cf72856630] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1553196164 {{(pid=122432) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 13:34:14.978136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e1ab1e-c362-4f65-84b8-7c3f103cb0bb tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:14.978644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e1ab1e-c362-4f65-84b8-7c3f103cb0bb tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:14.979078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e1ab1e-c362-4f65-84b8-7c3f103cb0bb tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:14.979808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e1ab1e-c362-4f65-84b8-7c3f103cb0bb tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:14.980258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e1ab1e-c362-4f65-84b8-7c3f103cb0bb tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:14.980681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43e1ab1e-c362-4f65-84b8-7c3f103cb0bb tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:15.007023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-43e1ab1e-c362-4f65-84b8-7c3f103cb0bb tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Getting quotas for project 9dd0e79d7c274ee88ec9f4f53004eecc. Resources: {'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:34:15.012116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-43e1ab1e-c362-4f65-84b8-7c3f103cb0bb tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Getting quotas for user 3bef111d18e5463981869a02bd07cd76 and project 9dd0e79d7c274ee88ec9f4f53004eecc. Resources: {'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:34:15.026466 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.compute.api [None req-43e1ab1e-c362-4f65-84b8-7c3f103cb0bb tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] ram quota exceeded for 0759291cae264ef588905011b051606a, tried to resize instance. Sep 07 13:34:15.026999 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-43e1ab1e-c362-4f65-84b8-7c3f103cb0bb tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-43e1ab1e-c362-4f65-84b8-7c3f103cb0bb tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Request method failure captured: Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630/action HTTP/1.1 Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 38 Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJ3K4hKHm4MgOCJC9DaVLRJPmRZqAl9-zXt_Ryi9ZlX5yM_qr_NUL6WqWjdtUJY44OsMiAP1gtGvSlZDLNbjstB-5Nmh6UWWf3CV9FGO2IJZOHweDniH1FOConuWZbyE2ukcXvAEVkB2xkr4PJA2XmivmKxRtLquiB2k8fOZWZSP9w4 Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 0759291cae264ef588905011b051606a Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1019263165 Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member,admin Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member,admin Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0759291cae264ef588905011b051606a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0759291cae264ef588905011b051606a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0759291cae264ef588905011b051606a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0759291cae264ef588905011b051606a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1019263165 Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 0759291cae264ef588905011b051606a Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1019263165 Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersAdminNegativeTestJSON-1019263165-project-admin Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 6d4e22c99aad404ba274c1347f372a97 Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1019263165-project-admin Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: {"resize": {"flavorRef": "738022041"}} Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'c0af6dd9-95ef-4c22-93c0-95cf72856630', 'body': {'resize': {'flavorRef': '738022041'}}} Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 13:34:15.029079 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-43e1ab1e-c362-4f65-84b8-7c3f103cb0bb tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-43e1ab1e-c362-4f65-84b8-7c3f103cb0bb tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630/action" status: 403 len: 118 microversion: 2.1 time: 0.284013 Sep 07 13:34:15.033353 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3365/6757] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:34:14 2022] POST /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630/action => generated 118 bytes in 285 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:34:15.041648 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5e1ca1ea-62e8-4ac0-998d-f92d06e560a6 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:15.062870 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5e1ca1ea-62e8-4ac0-998d-f92d06e560a6 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/738022041" status: 202 len: 0 microversion: 2.1 time: 0.026947 Sep 07 13:34:15.063476 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3393/6758] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Sep 7 13:34:15 2022] DELETE /compute/v2.1/flavors/738022041 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:34:15.071722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cc7212c3-a382-4d37-9f6f-7bd3d4ef2694 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:15.093644 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cc7212c3-a382-4d37-9f6f-7bd3d4ef2694 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025505 Sep 07 13:34:15.094228 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3366/6759] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 13:34:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:15.118274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c4e3c72f-8690-480d-a3aa-509df40d3ab1 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Calling method '.version_select at 0x7fc41d1901f0>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:15.192132 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c4e3c72f-8690-480d-a3aa-509df40d3ab1 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/0759291cae264ef588905011b051606a" status: 200 len: 371 microversion: 2.1 time: 0.080176 Sep 07 13:34:15.192739 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3394/6760] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Sep 7 13:34:15 2022] GET /compute/v2.1/os-quota-sets/0759291cae264ef588905011b051606a => generated 371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:34:15.205099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-87bcdc43-20e1-4aba-a61b-102d983f8b06 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-82174529", "id": 1596692282, "os-flavor-access:is_public": "True"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:34:15.225430 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-87bcdc43-20e1-4aba-a61b-102d983f8b06 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.024217 Sep 07 13:34:15.226295 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3367/6761] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:34:15 2022] POST /compute/v2.1/flavors => generated 435 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:34:15.241348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b7066ffc-2ba1-4a10-8ded-2ae172eba6b8 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1596692282"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:34:15.244079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b7066ffc-2ba1-4a10-8ded-2ae172eba6b8 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] [instance: c0af6dd9-95ef-4c22-93c0-95cf72856630] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:15.251313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7066ffc-2ba1-4a10-8ded-2ae172eba6b8 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:15.251827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7066ffc-2ba1-4a10-8ded-2ae172eba6b8 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:15.252279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7066ffc-2ba1-4a10-8ded-2ae172eba6b8 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:15.253007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7066ffc-2ba1-4a10-8ded-2ae172eba6b8 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:15.253519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7066ffc-2ba1-4a10-8ded-2ae172eba6b8 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:15.253982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7066ffc-2ba1-4a10-8ded-2ae172eba6b8 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:15.408911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b7066ffc-2ba1-4a10-8ded-2ae172eba6b8 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6d4e22c99aad404ba274c1347f372a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0759291cae264ef588905011b051606a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:15.416240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b7066ffc-2ba1-4a10-8ded-2ae172eba6b8 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] [instance: c0af6dd9-95ef-4c22-93c0-95cf72856630] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-82174529 {{(pid=122433) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 13:34:15.423867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7066ffc-2ba1-4a10-8ded-2ae172eba6b8 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:15.424368 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7066ffc-2ba1-4a10-8ded-2ae172eba6b8 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:15.424796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7066ffc-2ba1-4a10-8ded-2ae172eba6b8 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:15.425589 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7066ffc-2ba1-4a10-8ded-2ae172eba6b8 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:15.426047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7066ffc-2ba1-4a10-8ded-2ae172eba6b8 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:15.426602 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7066ffc-2ba1-4a10-8ded-2ae172eba6b8 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:15.447242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b7066ffc-2ba1-4a10-8ded-2ae172eba6b8 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Getting quotas for project 9dd0e79d7c274ee88ec9f4f53004eecc. Resources: {'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:34:15.452398 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b7066ffc-2ba1-4a10-8ded-2ae172eba6b8 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Getting quotas for user 3bef111d18e5463981869a02bd07cd76 and project 9dd0e79d7c274ee88ec9f4f53004eecc. Resources: {'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:34:15.465511 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.compute.api [None req-b7066ffc-2ba1-4a10-8ded-2ae172eba6b8 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] cores quota exceeded for 0759291cae264ef588905011b051606a, tried to resize instance. Sep 07 13:34:15.466097 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-b7066ffc-2ba1-4a10-8ded-2ae172eba6b8 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b7066ffc-2ba1-4a10-8ded-2ae172eba6b8 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Request method failure captured: Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630/action HTTP/1.1 Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 39 Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJ3K4hKHm4MgOCJC9DaVLRJPmRZqAl9-zXt_Ryi9ZlX5yM_qr_NUL6WqWjdtUJY44OsMiAP1gtGvSlZDLNbjstB-5Nmh6UWWf3CV9FGO2IJZOHweDniH1FOConuWZbyE2ukcXvAEVkB2xkr4PJA2XmivmKxRtLquiB2k8fOZWZSP9w4 Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 0759291cae264ef588905011b051606a Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1019263165 Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member,admin Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member,admin Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0759291cae264ef588905011b051606a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0759291cae264ef588905011b051606a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0759291cae264ef588905011b051606a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0759291cae264ef588905011b051606a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1019263165 Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 0759291cae264ef588905011b051606a Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1019263165 Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersAdminNegativeTestJSON-1019263165-project-admin Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 6d4e22c99aad404ba274c1347f372a97 Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1019263165-project-admin Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: {"resize": {"flavorRef": "1596692282"}} Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'c0af6dd9-95ef-4c22-93c0-95cf72856630', 'body': {'resize': {'flavorRef': '1596692282'}}} Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 13:34:15.468252 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b7066ffc-2ba1-4a10-8ded-2ae172eba6b8 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b7066ffc-2ba1-4a10-8ded-2ae172eba6b8 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630/action" status: 403 len: 113 microversion: 2.1 time: 0.234004 Sep 07 13:34:15.474153 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3395/6762] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:34:15 2022] POST /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630/action => generated 113 bytes in 236 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:34:15.480435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-546b3bed-ecae-4f30-aa8c-b0c748042a46 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:15.502358 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-546b3bed-ecae-4f30-aa8c-b0c748042a46 tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1596692282" status: 202 len: 0 microversion: 2.1 time: 0.025637 Sep 07 13:34:15.502940 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3368/6763] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Sep 7 13:34:15 2022] DELETE /compute/v2.1/flavors/1596692282 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:34:15.514503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3c4e7e43-942a-4f4a-a1ce-22c9519f19ea tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:15.537576 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3c4e7e43-942a-4f4a-a1ce-22c9519f19ea tempest-ServersAdminNegativeTestJSON-1019263165 tempest-ServersAdminNegativeTestJSON-1019263165-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028721 Sep 07 13:34:15.538170 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3396/6764] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Sep 7 13:34:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:15.558948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8ee2b1e9-8a0b-43fb-9aca-25507cbdbde6 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:15.559475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8ee2b1e9-8a0b-43fb-9aca-25507cbdbde6 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] [instance: c0af6dd9-95ef-4c22-93c0-95cf72856630] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:15.566162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ee2b1e9-8a0b-43fb-9aca-25507cbdbde6 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:15.566655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ee2b1e9-8a0b-43fb-9aca-25507cbdbde6 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:15.567103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ee2b1e9-8a0b-43fb-9aca-25507cbdbde6 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:15.567803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ee2b1e9-8a0b-43fb-9aca-25507cbdbde6 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:15.568255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ee2b1e9-8a0b-43fb-9aca-25507cbdbde6 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:15.568683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ee2b1e9-8a0b-43fb-9aca-25507cbdbde6 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:15.601992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8ee2b1e9-8a0b-43fb-9aca-25507cbdbde6 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] [instance: c0af6dd9-95ef-4c22-93c0-95cf72856630] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:34:15.686751 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8ee2b1e9-8a0b-43fb-9aca-25507cbdbde6 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630" status: 204 len: 0 microversion: 2.1 time: 0.131339 Sep 07 13:34:15.687510 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3369/6765] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:34:15 2022] DELETE /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:34:15.697008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eb653e84-0886-4f2d-8250-b52afb4e3ba4 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:15.697834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-eb653e84-0886-4f2d-8250-b52afb4e3ba4 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] [instance: c0af6dd9-95ef-4c22-93c0-95cf72856630] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:15.704245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb653e84-0886-4f2d-8250-b52afb4e3ba4 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:15.704757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb653e84-0886-4f2d-8250-b52afb4e3ba4 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:15.705207 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb653e84-0886-4f2d-8250-b52afb4e3ba4 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:15.705951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb653e84-0886-4f2d-8250-b52afb4e3ba4 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:15.706424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb653e84-0886-4f2d-8250-b52afb4e3ba4 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:15.706982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eb653e84-0886-4f2d-8250-b52afb4e3ba4 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:15.847369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-eb653e84-0886-4f2d-8250-b52afb4e3ba4 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bef111d18e5463981869a02bd07cd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd0e79d7c274ee88ec9f4f53004eecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:15.855704 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eb653e84-0886-4f2d-8250-b52afb4e3ba4 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] 10.222.0.16 "GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630" status: 200 len: 1477 microversion: 2.1 time: 0.162942 Sep 07 13:34:15.856302 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3397/6766] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:15 2022] GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630 => generated 1477 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:16.881818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-25309dd0-b0fc-4f74-8a54-8e89aa6e60c4 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:16.882622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-25309dd0-b0fc-4f74-8a54-8e89aa6e60c4 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] [instance: c0af6dd9-95ef-4c22-93c0-95cf72856630] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:16.891676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25309dd0-b0fc-4f74-8a54-8e89aa6e60c4 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:16.892177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25309dd0-b0fc-4f74-8a54-8e89aa6e60c4 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:16.892619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25309dd0-b0fc-4f74-8a54-8e89aa6e60c4 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:16.893329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25309dd0-b0fc-4f74-8a54-8e89aa6e60c4 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:16.893826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25309dd0-b0fc-4f74-8a54-8e89aa6e60c4 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:16.894257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-25309dd0-b0fc-4f74-8a54-8e89aa6e60c4 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:17.037645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-25309dd0-b0fc-4f74-8a54-8e89aa6e60c4 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bef111d18e5463981869a02bd07cd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd0e79d7c274ee88ec9f4f53004eecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:17.047306 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-25309dd0-b0fc-4f74-8a54-8e89aa6e60c4 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] 10.222.0.16 "GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630" status: 200 len: 1477 microversion: 2.1 time: 0.171089 Sep 07 13:34:17.048142 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3370/6767] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:16 2022] GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630 => generated 1477 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:17.680785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-91bd4470-30a0-481b-be6b-21f1e594ddd4 req-68f4d9eb-49b4-4b99-a912-41e3938be2ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0af6dd9-95ef-4c22-93c0-95cf72856630", "name": "network-vif-deleted", "tag": "fe3d2eff-4b41-43e5-acc2-e3b6d8e738cf"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:34:17.693857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-91bd4470-30a0-481b-be6b-21f1e594ddd4 req-68f4d9eb-49b4-4b99-a912-41e3938be2ae service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:17.694356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-91bd4470-30a0-481b-be6b-21f1e594ddd4 req-68f4d9eb-49b4-4b99-a912-41e3938be2ae service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:17.694815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-91bd4470-30a0-481b-be6b-21f1e594ddd4 req-68f4d9eb-49b4-4b99-a912-41e3938be2ae service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:17.708350 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-91bd4470-30a0-481b-be6b-21f1e594ddd4 req-68f4d9eb-49b4-4b99-a912-41e3938be2ae service nova] Creating event network-vif-deleted:fe3d2eff-4b41-43e5-acc2-e3b6d8e738cf for instance c0af6dd9-95ef-4c22-93c0-95cf72856630 on n-h2-852087-9 Sep 07 13:34:17.716138 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-91bd4470-30a0-481b-be6b-21f1e594ddd4 req-68f4d9eb-49b4-4b99-a912-41e3938be2ae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038375 Sep 07 13:34:17.717074 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3398/6768] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:34:18.073065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-552b5701-16a8-4ebd-912d-f0eef909b6d7 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:18.073713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-552b5701-16a8-4ebd-912d-f0eef909b6d7 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] [instance: c0af6dd9-95ef-4c22-93c0-95cf72856630] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:18.081325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-552b5701-16a8-4ebd-912d-f0eef909b6d7 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:18.081861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-552b5701-16a8-4ebd-912d-f0eef909b6d7 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:18.082301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-552b5701-16a8-4ebd-912d-f0eef909b6d7 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:18.083007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-552b5701-16a8-4ebd-912d-f0eef909b6d7 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:18.083462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-552b5701-16a8-4ebd-912d-f0eef909b6d7 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:18.083883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-552b5701-16a8-4ebd-912d-f0eef909b6d7 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:18.116614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-552b5701-16a8-4ebd-912d-f0eef909b6d7 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:18.117110 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-552b5701-16a8-4ebd-912d-f0eef909b6d7 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:18.117575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-552b5701-16a8-4ebd-912d-f0eef909b6d7 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:18.118033 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-552b5701-16a8-4ebd-912d-f0eef909b6d7 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lazy-loading 'fault' on Instance uuid c0af6dd9-95ef-4c22-93c0-95cf72856630 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:34:18.167846 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-552b5701-16a8-4ebd-912d-f0eef909b6d7 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bef111d18e5463981869a02bd07cd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd0e79d7c274ee88ec9f4f53004eecc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:18.176292 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-552b5701-16a8-4ebd-912d-f0eef909b6d7 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] 10.222.0.16 "GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630" status: 200 len: 1311 microversion: 2.1 time: 0.107901 Sep 07 13:34:18.176900 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3371/6769] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:18 2022] GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630 => generated 1311 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:19.201330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-095d2fa9-114a-433c-9d7f-c0815e899d79 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:19.202037 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-095d2fa9-114a-433c-9d7f-c0815e899d79 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] [instance: c0af6dd9-95ef-4c22-93c0-95cf72856630] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:19.208830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-095d2fa9-114a-433c-9d7f-c0815e899d79 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:19.209355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-095d2fa9-114a-433c-9d7f-c0815e899d79 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:19.209848 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-095d2fa9-114a-433c-9d7f-c0815e899d79 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:19.210564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-095d2fa9-114a-433c-9d7f-c0815e899d79 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:19.211036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-095d2fa9-114a-433c-9d7f-c0815e899d79 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:19.211482 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-095d2fa9-114a-433c-9d7f-c0815e899d79 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:19.226256 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-095d2fa9-114a-433c-9d7f-c0815e899d79 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] HTTP exception thrown: Instance c0af6dd9-95ef-4c22-93c0-95cf72856630 could not be found. Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-095d2fa9-114a-433c-9d7f-c0815e899d79 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Request method failure captured: Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630 HTTP/1.1 Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJ3K2F5ASrioJZQPD72aSlUJ-mjeGYHYabq5EmF6d4ZWiBJ3OaVuJieKsf777fcdR92floAKmHrNGkgjSuW1uyXfecTYJdH4rnrrmDbWkkLKsBWjlg22QDdWvWE-NSOCPv6mG9Vq6CGCm_woMJr3aUpQO6ZD0Gtj6qFjTnPntgBP97w Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 9dd0e79d7c274ee88ec9f4f53004eecc Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-451957278 Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9dd0e79d7c274ee88ec9f4f53004eecc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9dd0e79d7c274ee88ec9f4f53004eecc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9dd0e79d7c274ee88ec9f4f53004eecc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9dd0e79d7c274ee88ec9f4f53004eecc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersAdminNegativeTestJSON-451957278 Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 9dd0e79d7c274ee88ec9f4f53004eecc Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-451957278 Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersAdminNegativeTestJSON-451957278-project Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 3bef111d18e5463981869a02bd07cd76 Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersAdminNegativeTestJSON-451957278-project Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance c0af6dd9-95ef-4c22-93c0-95cf72856630 could not be found. Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'c0af6dd9-95ef-4c22-93c0-95cf72856630'} Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0af6dd9-95ef-4c22-93c0-95cf72856630 could not be found. Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0af6dd9-95ef-4c22-93c0-95cf72856630 could not be found. Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:34:19.227846 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:34:19.232435 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:34:19.232435 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:34:19.232435 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:34:19.232435 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:34:19.232435 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:34:19.232435 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:34:19.232435 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0af6dd9-95ef-4c22-93c0-95cf72856630 could not be found. Sep 07 13:34:19.232435 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:34:19.232435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-095d2fa9-114a-433c-9d7f-c0815e899d79 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] Returning 404 to user: Instance c0af6dd9-95ef-4c22-93c0-95cf72856630 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:34:19.232435 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-095d2fa9-114a-433c-9d7f-c0815e899d79 tempest-ServersAdminNegativeTestJSON-451957278 tempest-ServersAdminNegativeTestJSON-451957278-project] 10.222.0.16 "GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630" status: 404 len: 111 microversion: 2.1 time: 0.033552 Sep 07 13:34:19.232435 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3399/6770] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:19 2022] GET /compute/v2.1/servers/c0af6dd9-95ef-4c22-93c0-95cf72856630 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:34:25.990444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:25.991797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:26.127573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-16220a8c-774d-488d-a25f-cc52c2a57d17 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-305020498", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "6aaac5ee-4b7e-4999-b597-8ad0e7a7902d"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:34:26.188566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-16220a8c-774d-488d-a25f-cc52c2a57d17 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] validate_networks() for [('6aaac5ee-4b7e-4999-b597-8ad0e7a7902d', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:34:26.630491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-16220a8c-774d-488d-a25f-cc52c2a57d17 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:34:26.630491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-16220a8c-774d-488d-a25f-cc52c2a57d17 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:34:26.630491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-16220a8c-774d-488d-a25f-cc52c2a57d17 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:34:26.630491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-16220a8c-774d-488d-a25f-cc52c2a57d17 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:34:26.630491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-16220a8c-774d-488d-a25f-cc52c2a57d17 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:34:26.637772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16220a8c-774d-488d-a25f-cc52c2a57d17 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:26.638377 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16220a8c-774d-488d-a25f-cc52c2a57d17 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:26.639015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16220a8c-774d-488d-a25f-cc52c2a57d17 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:26.639892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16220a8c-774d-488d-a25f-cc52c2a57d17 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:26.640469 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16220a8c-774d-488d-a25f-cc52c2a57d17 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:26.640849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16220a8c-774d-488d-a25f-cc52c2a57d17 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:26.661673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-16220a8c-774d-488d-a25f-cc52c2a57d17 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Getting quotas for project 7e7c620507ff4d2a871006d12c20d9f4. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:34:26.667929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-16220a8c-774d-488d-a25f-cc52c2a57d17 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Getting quotas for user 377d7dd7ac8e4b8f9fbc54f6558cbfed and project 7e7c620507ff4d2a871006d12c20d9f4. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:34:26.693290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-16220a8c-774d-488d-a25f-cc52c2a57d17 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:34:26.695762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-16220a8c-774d-488d-a25f-cc52c2a57d17 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:34:26.745939 n-d-852087-9 devstack@n-api.service[122432]: ERROR oslo.messaging._drivers.impl_rabbit [None req-16220a8c-774d-488d-a25f-cc52c2a57d17 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [51116dcc-d3b6-4051-b11b-8934b98898f4] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 13:34:27.754768 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [None req-16220a8c-774d-488d-a25f-cc52c2a57d17 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [51116dcc-d3b6-4051-b11b-8934b98898f4] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37166. Sep 07 13:34:27.769804 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-16220a8c-774d-488d-a25f-cc52c2a57d17 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.784739 Sep 07 13:34:27.770683 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3372/6771] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:34:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:34:27.786074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1f1253d5-b1fe-466f-a044-72dec0b28283 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:27.786661 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1f1253d5-b1fe-466f-a044-72dec0b28283 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:27.791568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:27.792408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:27.864896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1f1253d5-b1fe-466f-a044-72dec0b28283 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:27.873278 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1f1253d5-b1fe-466f-a044-72dec0b28283 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1214 microversion: 2.1 time: 0.094507 Sep 07 13:34:27.874018 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3400/6772] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:27 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:28.913451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e66f10f8-a237-4b66-9182-7f4dd478e6de tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:28.914848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e66f10f8-a237-4b66-9182-7f4dd478e6de tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:28.922622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e66f10f8-a237-4b66-9182-7f4dd478e6de tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:28.923267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e66f10f8-a237-4b66-9182-7f4dd478e6de tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:28.923714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e66f10f8-a237-4b66-9182-7f4dd478e6de tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:28.924423 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e66f10f8-a237-4b66-9182-7f4dd478e6de tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:28.924916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e66f10f8-a237-4b66-9182-7f4dd478e6de tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:28.925349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e66f10f8-a237-4b66-9182-7f4dd478e6de tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:29.000205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e66f10f8-a237-4b66-9182-7f4dd478e6de tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:29.012269 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e66f10f8-a237-4b66-9182-7f4dd478e6de tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1274 microversion: 2.1 time: 0.102245 Sep 07 13:34:29.026930 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3373/6773] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:28 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1274 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:30.042403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-535f9ad7-ff2f-4dea-8445-c601cd24a1c3 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:30.043057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-535f9ad7-ff2f-4dea-8445-c601cd24a1c3 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:30.046076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=57 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:30.052990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-535f9ad7-ff2f-4dea-8445-c601cd24a1c3 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:30.054120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-535f9ad7-ff2f-4dea-8445-c601cd24a1c3 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:30.054573 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-535f9ad7-ff2f-4dea-8445-c601cd24a1c3 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:30.055480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-535f9ad7-ff2f-4dea-8445-c601cd24a1c3 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:30.055962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-535f9ad7-ff2f-4dea-8445-c601cd24a1c3 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:30.056515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-535f9ad7-ff2f-4dea-8445-c601cd24a1c3 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:30.229018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-535f9ad7-ff2f-4dea-8445-c601cd24a1c3 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:30.252945 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-535f9ad7-ff2f-4dea-8445-c601cd24a1c3 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1314 microversion: 2.1 time: 0.215790 Sep 07 13:34:30.269952 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3401/6774] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:30 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:30.524475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-e17f7b78-d832-48d6-9fc6-bcbed5f54f66 req-c88c7c94-61bb-4198-a077-84c64c8b27ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "991eb0a8-4864-48b8-bcfe-b7d47c342275", "tag": "18f5488a-966a-4fad-9ba2-8b3fd401c296"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:34:30.549221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e17f7b78-d832-48d6-9fc6-bcbed5f54f66 req-c88c7c94-61bb-4198-a077-84c64c8b27ff service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:30.563762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e17f7b78-d832-48d6-9fc6-bcbed5f54f66 req-c88c7c94-61bb-4198-a077-84c64c8b27ff service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:30.564752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-e17f7b78-d832-48d6-9fc6-bcbed5f54f66 req-c88c7c94-61bb-4198-a077-84c64c8b27ff service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:30.595787 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-e17f7b78-d832-48d6-9fc6-bcbed5f54f66 req-c88c7c94-61bb-4198-a077-84c64c8b27ff service nova] Creating event network-changed:18f5488a-966a-4fad-9ba2-8b3fd401c296 for instance 991eb0a8-4864-48b8-bcfe-b7d47c342275 on n-h2-852087-9 Sep 07 13:34:30.605467 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-e17f7b78-d832-48d6-9fc6-bcbed5f54f66 req-c88c7c94-61bb-4198-a077-84c64c8b27ff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088315 Sep 07 13:34:30.606946 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3374/6775] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:34:31.281028 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-29ce5e66-79a2-46a4-8433-574c3f24d2dc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:31.281645 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-29ce5e66-79a2-46a4-8433-574c3f24d2dc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:31.292858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29ce5e66-79a2-46a4-8433-574c3f24d2dc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:31.294430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29ce5e66-79a2-46a4-8433-574c3f24d2dc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:31.294430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29ce5e66-79a2-46a4-8433-574c3f24d2dc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:31.295313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29ce5e66-79a2-46a4-8433-574c3f24d2dc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:31.295804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29ce5e66-79a2-46a4-8433-574c3f24d2dc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:31.296406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29ce5e66-79a2-46a4-8433-574c3f24d2dc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:31.440918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-29ce5e66-79a2-46a4-8433-574c3f24d2dc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:31.449212 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-29ce5e66-79a2-46a4-8433-574c3f24d2dc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1314 microversion: 2.1 time: 0.174961 Sep 07 13:34:31.449877 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3402/6776] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:31 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:32.478547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c0527272-1bbe-4594-b579-3acf53eb4520 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:32.479265 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c0527272-1bbe-4594-b579-3acf53eb4520 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:32.487424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0527272-1bbe-4594-b579-3acf53eb4520 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:32.487920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0527272-1bbe-4594-b579-3acf53eb4520 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:32.488376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0527272-1bbe-4594-b579-3acf53eb4520 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:32.489061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0527272-1bbe-4594-b579-3acf53eb4520 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:32.489541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0527272-1bbe-4594-b579-3acf53eb4520 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:32.489971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c0527272-1bbe-4594-b579-3acf53eb4520 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:32.628895 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c0527272-1bbe-4594-b579-3acf53eb4520 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:32.637513 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c0527272-1bbe-4594-b579-3acf53eb4520 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1314 microversion: 2.1 time: 0.168368 Sep 07 13:34:32.638152 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3375/6777] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:32 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:33.661625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bd0349ff-b13e-42af-b790-5798bcc4903d tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:33.662258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bd0349ff-b13e-42af-b790-5798bcc4903d tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:33.665042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:33.670825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd0349ff-b13e-42af-b790-5798bcc4903d tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:33.671329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd0349ff-b13e-42af-b790-5798bcc4903d tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:33.671786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd0349ff-b13e-42af-b790-5798bcc4903d tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:33.672498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd0349ff-b13e-42af-b790-5798bcc4903d tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:33.672973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd0349ff-b13e-42af-b790-5798bcc4903d tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:33.673422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd0349ff-b13e-42af-b790-5798bcc4903d tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:33.815815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bd0349ff-b13e-42af-b790-5798bcc4903d tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:33.825852 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bd0349ff-b13e-42af-b790-5798bcc4903d tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1314 microversion: 2.1 time: 0.168198 Sep 07 13:34:33.826461 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3403/6778] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:33 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:34.851384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ef4124c9-de90-469e-8ddd-bb0566187d5a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:34.851968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ef4124c9-de90-469e-8ddd-bb0566187d5a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:34.854963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:34.861318 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef4124c9-de90-469e-8ddd-bb0566187d5a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:34.861844 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef4124c9-de90-469e-8ddd-bb0566187d5a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:34.862277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef4124c9-de90-469e-8ddd-bb0566187d5a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:34.863025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef4124c9-de90-469e-8ddd-bb0566187d5a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:34.863484 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef4124c9-de90-469e-8ddd-bb0566187d5a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:34.863903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef4124c9-de90-469e-8ddd-bb0566187d5a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:34.867996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:35.036957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ef4124c9-de90-469e-8ddd-bb0566187d5a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:35.051697 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ef4124c9-de90-469e-8ddd-bb0566187d5a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1314 microversion: 2.1 time: 0.204140 Sep 07 13:34:35.052531 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3376/6779] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:34 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:36.061178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a0957f23-1b8f-4cea-953a-79200f530b5f req-ed1b819f-7130-4f16-8ce8-637538849158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991eb0a8-4864-48b8-bcfe-b7d47c342275", "name": "network-vif-plugged", "status": "completed", "tag": "18f5488a-966a-4fad-9ba2-8b3fd401c296"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:34:36.078253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-afdff29c-c0e7-40a2-9e37-83d78210b3fc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:36.078841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-afdff29c-c0e7-40a2-9e37-83d78210b3fc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:36.082827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a0957f23-1b8f-4cea-953a-79200f530b5f req-ed1b819f-7130-4f16-8ce8-637538849158 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:36.083411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a0957f23-1b8f-4cea-953a-79200f530b5f req-ed1b819f-7130-4f16-8ce8-637538849158 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:36.083846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a0957f23-1b8f-4cea-953a-79200f530b5f req-ed1b819f-7130-4f16-8ce8-637538849158 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:36.087529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afdff29c-c0e7-40a2-9e37-83d78210b3fc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:36.088425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afdff29c-c0e7-40a2-9e37-83d78210b3fc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:36.089060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afdff29c-c0e7-40a2-9e37-83d78210b3fc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:36.090194 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afdff29c-c0e7-40a2-9e37-83d78210b3fc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:36.090840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afdff29c-c0e7-40a2-9e37-83d78210b3fc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:36.091330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-afdff29c-c0e7-40a2-9e37-83d78210b3fc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:36.100835 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a0957f23-1b8f-4cea-953a-79200f530b5f req-ed1b819f-7130-4f16-8ce8-637538849158 service nova] Creating event network-vif-plugged:18f5488a-966a-4fad-9ba2-8b3fd401c296 for instance 991eb0a8-4864-48b8-bcfe-b7d47c342275 on n-h2-852087-9 Sep 07 13:34:36.106869 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a0957f23-1b8f-4cea-953a-79200f530b5f req-ed1b819f-7130-4f16-8ce8-637538849158 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049503 Sep 07 13:34:36.108351 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3404/6780] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:34:36.234645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-afdff29c-c0e7-40a2-9e37-83d78210b3fc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:36.243096 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-afdff29c-c0e7-40a2-9e37-83d78210b3fc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1314 microversion: 2.1 time: 0.169619 Sep 07 13:34:36.243762 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3377/6781] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:36 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:37.271785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0c444f02-b3aa-489f-b8bc-a5360775505d tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:37.272522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0c444f02-b3aa-489f-b8bc-a5360775505d tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:37.280260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c444f02-b3aa-489f-b8bc-a5360775505d tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:37.280818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c444f02-b3aa-489f-b8bc-a5360775505d tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:37.281279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c444f02-b3aa-489f-b8bc-a5360775505d tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:37.282036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c444f02-b3aa-489f-b8bc-a5360775505d tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:37.282540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c444f02-b3aa-489f-b8bc-a5360775505d tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:37.283023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0c444f02-b3aa-489f-b8bc-a5360775505d tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:37.436467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0c444f02-b3aa-489f-b8bc-a5360775505d tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:37.448059 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0c444f02-b3aa-489f-b8bc-a5360775505d tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1314 microversion: 2.1 time: 0.180530 Sep 07 13:34:37.448701 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3405/6782] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:37 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:34:38.473043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3f60b9f9-9cae-4cbb-9254-e070858a6133 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:38.473590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3f60b9f9-9cae-4cbb-9254-e070858a6133 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:38.475502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:38.476185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:38.483198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f60b9f9-9cae-4cbb-9254-e070858a6133 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:38.483693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f60b9f9-9cae-4cbb-9254-e070858a6133 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:38.484136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f60b9f9-9cae-4cbb-9254-e070858a6133 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:38.484846 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f60b9f9-9cae-4cbb-9254-e070858a6133 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:38.485302 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f60b9f9-9cae-4cbb-9254-e070858a6133 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:38.485836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f60b9f9-9cae-4cbb-9254-e070858a6133 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:38.641884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3f60b9f9-9cae-4cbb-9254-e070858a6133 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:38.650626 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3f60b9f9-9cae-4cbb-9254-e070858a6133 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1501 microversion: 2.1 time: 0.181678 Sep 07 13:34:38.651262 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3378/6783] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:38 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1501 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:38.674979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-87abece6-7d99-4846-abd9-4ebd4405fca9 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:34:38.677776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-87abece6-7d99-4846-abd9-4ebd4405fca9 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:38.679932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:38.687117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87abece6-7d99-4846-abd9-4ebd4405fca9 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:38.687709 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87abece6-7d99-4846-abd9-4ebd4405fca9 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:38.688174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87abece6-7d99-4846-abd9-4ebd4405fca9 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:38.688960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87abece6-7d99-4846-abd9-4ebd4405fca9 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:38.689436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87abece6-7d99-4846-abd9-4ebd4405fca9 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:38.689962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87abece6-7d99-4846-abd9-4ebd4405fca9 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:38.731304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-87abece6-7d99-4846-abd9-4ebd4405fca9 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:38.738325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-87abece6-7d99-4846-abd9-4ebd4405fca9 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Old instance type m1.heat2, new instance type m1.heat {{(pid=122433) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 13:34:38.745696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-87abece6-7d99-4846-abd9-4ebd4405fca9 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:34:38.746126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-87abece6-7d99-4846-abd9-4ebd4405fca9 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:34:38.746871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-87abece6-7d99-4846-abd9-4ebd4405fca9 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:34:38.747299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-87abece6-7d99-4846-abd9-4ebd4405fca9 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:34:38.747729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-87abece6-7d99-4846-abd9-4ebd4405fca9 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:34:38.836728 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-87abece6-7d99-4846-abd9-4ebd4405fca9 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "POST /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275/action" status: 202 len: 0 microversion: 2.1 time: 0.165992 Sep 07 13:34:38.837395 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3406/6784] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:34:38 2022] POST /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:34:38.846923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bb631cbe-62fd-40dc-a98c-36fddf579d9b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:38.847865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bb631cbe-62fd-40dc-a98c-36fddf579d9b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:38.857104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb631cbe-62fd-40dc-a98c-36fddf579d9b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:38.857648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb631cbe-62fd-40dc-a98c-36fddf579d9b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:38.858101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb631cbe-62fd-40dc-a98c-36fddf579d9b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:38.859134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb631cbe-62fd-40dc-a98c-36fddf579d9b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:38.859507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb631cbe-62fd-40dc-a98c-36fddf579d9b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:38.859880 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb631cbe-62fd-40dc-a98c-36fddf579d9b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:39.006865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bb631cbe-62fd-40dc-a98c-36fddf579d9b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:39.017398 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bb631cbe-62fd-40dc-a98c-36fddf579d9b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1510 microversion: 2.1 time: 0.175011 Sep 07 13:34:39.018246 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3379/6785] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:38 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:40.044309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b825a175-3d05-4f75-bc5d-a7a1ce5cf325 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:40.045350 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b825a175-3d05-4f75-bc5d-a7a1ce5cf325 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:40.056229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b825a175-3d05-4f75-bc5d-a7a1ce5cf325 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:40.056954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b825a175-3d05-4f75-bc5d-a7a1ce5cf325 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:40.057629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b825a175-3d05-4f75-bc5d-a7a1ce5cf325 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:40.058710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b825a175-3d05-4f75-bc5d-a7a1ce5cf325 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:40.059198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b825a175-3d05-4f75-bc5d-a7a1ce5cf325 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:40.059788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b825a175-3d05-4f75-bc5d-a7a1ce5cf325 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:40.222411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b825a175-3d05-4f75-bc5d-a7a1ce5cf325 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:40.240988 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b825a175-3d05-4f75-bc5d-a7a1ce5cf325 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1510 microversion: 2.1 time: 0.200510 Sep 07 13:34:40.241881 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3407/6786] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:40 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1510 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:41.266676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d589e27-d17c-4d63-b0ed-74b37287e32b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:41.267279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1d589e27-d17c-4d63-b0ed-74b37287e32b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:41.274614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d589e27-d17c-4d63-b0ed-74b37287e32b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:41.275121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d589e27-d17c-4d63-b0ed-74b37287e32b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:41.275563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d589e27-d17c-4d63-b0ed-74b37287e32b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:41.276266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d589e27-d17c-4d63-b0ed-74b37287e32b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:41.276781 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d589e27-d17c-4d63-b0ed-74b37287e32b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:41.277209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d589e27-d17c-4d63-b0ed-74b37287e32b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:41.418297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1d589e27-d17c-4d63-b0ed-74b37287e32b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:41.426527 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1d589e27-d17c-4d63-b0ed-74b37287e32b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1510 microversion: 2.1 time: 0.164984 Sep 07 13:34:41.427103 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3380/6787] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:41 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:34:42.454228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ca219c21-66fb-40f8-ba13-894e7c9c193b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:42.455031 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ca219c21-66fb-40f8-ba13-894e7c9c193b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:42.467033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca219c21-66fb-40f8-ba13-894e7c9c193b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:42.467952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca219c21-66fb-40f8-ba13-894e7c9c193b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:42.468813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca219c21-66fb-40f8-ba13-894e7c9c193b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:42.470238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca219c21-66fb-40f8-ba13-894e7c9c193b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:42.471135 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca219c21-66fb-40f8-ba13-894e7c9c193b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:42.471949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ca219c21-66fb-40f8-ba13-894e7c9c193b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:42.632522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ca219c21-66fb-40f8-ba13-894e7c9c193b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:42.641890 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ca219c21-66fb-40f8-ba13-894e7c9c193b tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1515 microversion: 2.1 time: 0.192057 Sep 07 13:34:42.642497 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3408/6788] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:42 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1515 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:43.665810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b352487f-1855-4297-9b7f-36a9af7631b1 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:43.666517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b352487f-1855-4297-9b7f-36a9af7631b1 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:43.673902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b352487f-1855-4297-9b7f-36a9af7631b1 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:43.674422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b352487f-1855-4297-9b7f-36a9af7631b1 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:43.674864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b352487f-1855-4297-9b7f-36a9af7631b1 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:43.675560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b352487f-1855-4297-9b7f-36a9af7631b1 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:43.676021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b352487f-1855-4297-9b7f-36a9af7631b1 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:43.676454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b352487f-1855-4297-9b7f-36a9af7631b1 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:43.822032 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b352487f-1855-4297-9b7f-36a9af7631b1 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:43.831546 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b352487f-1855-4297-9b7f-36a9af7631b1 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1515 microversion: 2.1 time: 0.169991 Sep 07 13:34:43.832139 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3381/6789] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:43 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:44.865904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6ef7c61c-1702-4ae1-9b75-08cd910e15e7 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:44.867559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6ef7c61c-1702-4ae1-9b75-08cd910e15e7 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:44.878068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ef7c61c-1702-4ae1-9b75-08cd910e15e7 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:44.879787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ef7c61c-1702-4ae1-9b75-08cd910e15e7 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:44.880087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ef7c61c-1702-4ae1-9b75-08cd910e15e7 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:44.880991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ef7c61c-1702-4ae1-9b75-08cd910e15e7 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:44.881748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ef7c61c-1702-4ae1-9b75-08cd910e15e7 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:44.882276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6ef7c61c-1702-4ae1-9b75-08cd910e15e7 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:45.027537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6ef7c61c-1702-4ae1-9b75-08cd910e15e7 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:45.035998 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6ef7c61c-1702-4ae1-9b75-08cd910e15e7 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1515 microversion: 2.1 time: 0.175397 Sep 07 13:34:45.036574 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3409/6790] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:44 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:46.059500 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-683c5b85-098f-4b78-a28f-cbfade5ff434 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:46.060154 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-683c5b85-098f-4b78-a28f-cbfade5ff434 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:46.067717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-683c5b85-098f-4b78-a28f-cbfade5ff434 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:46.068219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-683c5b85-098f-4b78-a28f-cbfade5ff434 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:46.068662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-683c5b85-098f-4b78-a28f-cbfade5ff434 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:46.069377 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-683c5b85-098f-4b78-a28f-cbfade5ff434 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:46.069874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-683c5b85-098f-4b78-a28f-cbfade5ff434 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:46.070307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-683c5b85-098f-4b78-a28f-cbfade5ff434 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:46.230191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-683c5b85-098f-4b78-a28f-cbfade5ff434 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:46.238964 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-683c5b85-098f-4b78-a28f-cbfade5ff434 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1515 microversion: 2.1 time: 0.183642 Sep 07 13:34:46.239570 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3382/6791] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:46 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:34:47.262423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c538c6ba-4139-4dc5-8359-5f56caa050d1 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:47.263042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c538c6ba-4139-4dc5-8359-5f56caa050d1 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:47.270763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c538c6ba-4139-4dc5-8359-5f56caa050d1 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:47.271283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c538c6ba-4139-4dc5-8359-5f56caa050d1 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:47.271735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c538c6ba-4139-4dc5-8359-5f56caa050d1 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:47.272481 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c538c6ba-4139-4dc5-8359-5f56caa050d1 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:47.272949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c538c6ba-4139-4dc5-8359-5f56caa050d1 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:47.273402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c538c6ba-4139-4dc5-8359-5f56caa050d1 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:47.415352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c538c6ba-4139-4dc5-8359-5f56caa050d1 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:47.424038 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c538c6ba-4139-4dc5-8359-5f56caa050d1 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1515 microversion: 2.1 time: 0.165772 Sep 07 13:34:47.424639 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3410/6792] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:47 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:48.449452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9327a639-5ee8-4c5f-9ca9-d8fcf45acdf6 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:48.450385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9327a639-5ee8-4c5f-9ca9-d8fcf45acdf6 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:48.457573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9327a639-5ee8-4c5f-9ca9-d8fcf45acdf6 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:48.458078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9327a639-5ee8-4c5f-9ca9-d8fcf45acdf6 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:48.458514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9327a639-5ee8-4c5f-9ca9-d8fcf45acdf6 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:48.459218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9327a639-5ee8-4c5f-9ca9-d8fcf45acdf6 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:48.459649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9327a639-5ee8-4c5f-9ca9-d8fcf45acdf6 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:48.460087 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9327a639-5ee8-4c5f-9ca9-d8fcf45acdf6 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:48.604131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9327a639-5ee8-4c5f-9ca9-d8fcf45acdf6 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:48.612456 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9327a639-5ee8-4c5f-9ca9-d8fcf45acdf6 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1515 microversion: 2.1 time: 0.167115 Sep 07 13:34:48.613035 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3383/6793] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:48 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:49.637214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-09f16b9d-6bfe-4deb-8ab7-f135f7e03df2 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:49.637887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-09f16b9d-6bfe-4deb-8ab7-f135f7e03df2 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:49.645888 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09f16b9d-6bfe-4deb-8ab7-f135f7e03df2 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:49.646408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09f16b9d-6bfe-4deb-8ab7-f135f7e03df2 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:49.646868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09f16b9d-6bfe-4deb-8ab7-f135f7e03df2 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:49.647654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09f16b9d-6bfe-4deb-8ab7-f135f7e03df2 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:49.648141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09f16b9d-6bfe-4deb-8ab7-f135f7e03df2 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:49.648613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09f16b9d-6bfe-4deb-8ab7-f135f7e03df2 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:49.793646 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-09f16b9d-6bfe-4deb-8ab7-f135f7e03df2 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:49.802210 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-09f16b9d-6bfe-4deb-8ab7-f135f7e03df2 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1515 microversion: 2.1 time: 0.169385 Sep 07 13:34:49.802799 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3411/6794] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:49 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:34:50.826411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-890f2c79-1a09-45bf-bdf8-02f46fe1b21c tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:50.827057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-890f2c79-1a09-45bf-bdf8-02f46fe1b21c tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:50.834486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-890f2c79-1a09-45bf-bdf8-02f46fe1b21c tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:50.834888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-890f2c79-1a09-45bf-bdf8-02f46fe1b21c tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:50.835323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-890f2c79-1a09-45bf-bdf8-02f46fe1b21c tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:50.836019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-890f2c79-1a09-45bf-bdf8-02f46fe1b21c tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:50.836474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-890f2c79-1a09-45bf-bdf8-02f46fe1b21c tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:50.836895 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-890f2c79-1a09-45bf-bdf8-02f46fe1b21c tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:51.009041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-890f2c79-1a09-45bf-bdf8-02f46fe1b21c tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:51.017935 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-890f2c79-1a09-45bf-bdf8-02f46fe1b21c tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1515 microversion: 2.1 time: 0.195530 Sep 07 13:34:51.018541 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3384/6795] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:50 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:52.041354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b4335b82-d0ff-4fa6-a575-e2633ae748c5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:52.041995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b4335b82-d0ff-4fa6-a575-e2633ae748c5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:52.049778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4335b82-d0ff-4fa6-a575-e2633ae748c5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:52.050272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4335b82-d0ff-4fa6-a575-e2633ae748c5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:52.050727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4335b82-d0ff-4fa6-a575-e2633ae748c5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:52.051450 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4335b82-d0ff-4fa6-a575-e2633ae748c5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:52.051937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4335b82-d0ff-4fa6-a575-e2633ae748c5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:52.052383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b4335b82-d0ff-4fa6-a575-e2633ae748c5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:52.190181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b4335b82-d0ff-4fa6-a575-e2633ae748c5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:52.198255 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b4335b82-d0ff-4fa6-a575-e2633ae748c5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1515 microversion: 2.1 time: 0.160932 Sep 07 13:34:52.198931 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3412/6796] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:52 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:53.222815 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ebc396bd-e83c-4676-97fa-f8a03c5ef5f9 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:53.223400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ebc396bd-e83c-4676-97fa-f8a03c5ef5f9 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:53.230700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebc396bd-e83c-4676-97fa-f8a03c5ef5f9 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:53.231194 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebc396bd-e83c-4676-97fa-f8a03c5ef5f9 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:53.231632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebc396bd-e83c-4676-97fa-f8a03c5ef5f9 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:53.232355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebc396bd-e83c-4676-97fa-f8a03c5ef5f9 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:53.232847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebc396bd-e83c-4676-97fa-f8a03c5ef5f9 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:53.233453 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebc396bd-e83c-4676-97fa-f8a03c5ef5f9 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:53.400217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ebc396bd-e83c-4676-97fa-f8a03c5ef5f9 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:53.411286 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ebc396bd-e83c-4676-97fa-f8a03c5ef5f9 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1515 microversion: 2.1 time: 0.192647 Sep 07 13:34:53.412049 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3385/6797] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:53 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1515 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:54.439429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-76d91989-30e4-4ccb-b842-219a6cc82864 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:54.440072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-76d91989-30e4-4ccb-b842-219a6cc82864 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:54.447572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76d91989-30e4-4ccb-b842-219a6cc82864 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:54.448177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76d91989-30e4-4ccb-b842-219a6cc82864 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:54.448635 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76d91989-30e4-4ccb-b842-219a6cc82864 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:54.449639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76d91989-30e4-4ccb-b842-219a6cc82864 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:54.450120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76d91989-30e4-4ccb-b842-219a6cc82864 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:54.450537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76d91989-30e4-4ccb-b842-219a6cc82864 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:54.594683 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-76d91989-30e4-4ccb-b842-219a6cc82864 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:54.603433 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-76d91989-30e4-4ccb-b842-219a6cc82864 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1515 microversion: 2.1 time: 0.168330 Sep 07 13:34:54.604029 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3413/6798] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:54 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:55.628045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-43744654-8ce1-4405-ac23-449e50644890 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:55.628664 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-43744654-8ce1-4405-ac23-449e50644890 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:55.636166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43744654-8ce1-4405-ac23-449e50644890 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:55.636642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43744654-8ce1-4405-ac23-449e50644890 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:55.637120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43744654-8ce1-4405-ac23-449e50644890 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:55.637939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43744654-8ce1-4405-ac23-449e50644890 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:55.638406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43744654-8ce1-4405-ac23-449e50644890 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:55.638842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43744654-8ce1-4405-ac23-449e50644890 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:55.788181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-43744654-8ce1-4405-ac23-449e50644890 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:55.797556 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-43744654-8ce1-4405-ac23-449e50644890 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1515 microversion: 2.1 time: 0.173442 Sep 07 13:34:55.798186 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3386/6799] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:55 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:34:56.823865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a6748c17-a68c-48e0-808a-eb41b6624aab tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:56.824549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a6748c17-a68c-48e0-808a-eb41b6624aab tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:56.827935 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:34:56.828140 n-d-852087-9 devstack@n-api.service[122433]: Wed Sep 7 13:34:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 (ip 10.222.0.16) !!! Sep 07 13:34:56.839539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6748c17-a68c-48e0-808a-eb41b6624aab tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:56.840450 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6748c17-a68c-48e0-808a-eb41b6624aab tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:56.840946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6748c17-a68c-48e0-808a-eb41b6624aab tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:56.841777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6748c17-a68c-48e0-808a-eb41b6624aab tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:56.842339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6748c17-a68c-48e0-808a-eb41b6624aab tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:56.842789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a6748c17-a68c-48e0-808a-eb41b6624aab tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:57.001443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a6748c17-a68c-48e0-808a-eb41b6624aab tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:57.010283 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a6748c17-a68c-48e0-808a-eb41b6624aab tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1515 microversion: 2.1 time: 0.190626 Sep 07 13:34:57.010963 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3414/6800] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:56 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1515 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:58.035144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0acabaeb-66b0-40ce-8edc-3bb1be0718d8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:58.035866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0acabaeb-66b0-40ce-8edc-3bb1be0718d8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:58.044890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0acabaeb-66b0-40ce-8edc-3bb1be0718d8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:58.045382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0acabaeb-66b0-40ce-8edc-3bb1be0718d8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:58.045867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0acabaeb-66b0-40ce-8edc-3bb1be0718d8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:58.046639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0acabaeb-66b0-40ce-8edc-3bb1be0718d8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:58.047108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0acabaeb-66b0-40ce-8edc-3bb1be0718d8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:58.047553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0acabaeb-66b0-40ce-8edc-3bb1be0718d8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:58.196666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0acabaeb-66b0-40ce-8edc-3bb1be0718d8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:58.206008 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0acabaeb-66b0-40ce-8edc-3bb1be0718d8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1515 microversion: 2.1 time: 0.175252 Sep 07 13:34:58.206625 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3387/6801] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:58 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:34:59.233738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c2bd554f-36db-46ad-9340-b8637e70a459 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:34:59.234452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c2bd554f-36db-46ad-9340-b8637e70a459 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:34:59.242280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2bd554f-36db-46ad-9340-b8637e70a459 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:59.242803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2bd554f-36db-46ad-9340-b8637e70a459 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:59.243260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2bd554f-36db-46ad-9340-b8637e70a459 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:59.244009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2bd554f-36db-46ad-9340-b8637e70a459 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:34:59.244486 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2bd554f-36db-46ad-9340-b8637e70a459 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:34:59.244934 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2bd554f-36db-46ad-9340-b8637e70a459 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:34:59.394690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c2bd554f-36db-46ad-9340-b8637e70a459 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:34:59.404651 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c2bd554f-36db-46ad-9340-b8637e70a459 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1515 microversion: 2.1 time: 0.175676 Sep 07 13:34:59.405288 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3415/6802] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:34:59 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:00.431080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-963cae4b-6544-4a9c-9c91-4b9a5b66d7fe tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:00.431711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-963cae4b-6544-4a9c-9c91-4b9a5b66d7fe tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:00.439534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-963cae4b-6544-4a9c-9c91-4b9a5b66d7fe tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:00.440031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-963cae4b-6544-4a9c-9c91-4b9a5b66d7fe tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:00.440471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-963cae4b-6544-4a9c-9c91-4b9a5b66d7fe tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:00.441190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-963cae4b-6544-4a9c-9c91-4b9a5b66d7fe tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:00.441739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-963cae4b-6544-4a9c-9c91-4b9a5b66d7fe tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:00.442173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-963cae4b-6544-4a9c-9c91-4b9a5b66d7fe tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:00.603139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-963cae4b-6544-4a9c-9c91-4b9a5b66d7fe tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:00.614772 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-963cae4b-6544-4a9c-9c91-4b9a5b66d7fe tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1515 microversion: 2.1 time: 0.188134 Sep 07 13:35:00.615381 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3388/6803] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:00 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:01.639202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-914b98f6-7141-4412-af5a-691a2a4023c2 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:01.639848 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-914b98f6-7141-4412-af5a-691a2a4023c2 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:01.647514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-914b98f6-7141-4412-af5a-691a2a4023c2 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:01.648028 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-914b98f6-7141-4412-af5a-691a2a4023c2 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:01.648481 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-914b98f6-7141-4412-af5a-691a2a4023c2 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:01.649211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-914b98f6-7141-4412-af5a-691a2a4023c2 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:01.649708 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-914b98f6-7141-4412-af5a-691a2a4023c2 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:01.650136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-914b98f6-7141-4412-af5a-691a2a4023c2 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:01.653082 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:01.808098 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-914b98f6-7141-4412-af5a-691a2a4023c2 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:01.816545 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-914b98f6-7141-4412-af5a-691a2a4023c2 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1515 microversion: 2.1 time: 0.181512 Sep 07 13:35:01.817179 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3416/6804] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:01 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:02.841874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f05eb4a8-fe5b-462e-b4d3-a82697a4a3d6 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:02.842646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f05eb4a8-fe5b-462e-b4d3-a82697a4a3d6 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:02.850395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f05eb4a8-fe5b-462e-b4d3-a82697a4a3d6 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:02.850902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f05eb4a8-fe5b-462e-b4d3-a82697a4a3d6 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:02.851340 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f05eb4a8-fe5b-462e-b4d3-a82697a4a3d6 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:02.852060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f05eb4a8-fe5b-462e-b4d3-a82697a4a3d6 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:02.852520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f05eb4a8-fe5b-462e-b4d3-a82697a4a3d6 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:02.852959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f05eb4a8-fe5b-462e-b4d3-a82697a4a3d6 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:03.009015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f05eb4a8-fe5b-462e-b4d3-a82697a4a3d6 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:03.017569 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f05eb4a8-fe5b-462e-b4d3-a82697a4a3d6 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1515 microversion: 2.1 time: 0.180585 Sep 07 13:35:03.018166 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3389/6805] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:02 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:04.043776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-85f151ea-d0e0-44fe-8f65-64066d2bb004 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:04.044445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-85f151ea-d0e0-44fe-8f65-64066d2bb004 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:04.047333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=32 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:04.054527 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85f151ea-d0e0-44fe-8f65-64066d2bb004 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:04.055058 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85f151ea-d0e0-44fe-8f65-64066d2bb004 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:04.055522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85f151ea-d0e0-44fe-8f65-64066d2bb004 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:04.056248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85f151ea-d0e0-44fe-8f65-64066d2bb004 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:04.056739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85f151ea-d0e0-44fe-8f65-64066d2bb004 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:04.057181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85f151ea-d0e0-44fe-8f65-64066d2bb004 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:04.208490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-85f151ea-d0e0-44fe-8f65-64066d2bb004 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:04.219032 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-85f151ea-d0e0-44fe-8f65-64066d2bb004 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1515 microversion: 2.1 time: 0.182225 Sep 07 13:35:04.219599 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3417/6806] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:04 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:05.243976 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7bd4e70a-21c5-4eb3-b05d-10dbe9ee13a8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:05.244561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7bd4e70a-21c5-4eb3-b05d-10dbe9ee13a8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:05.247436 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=28 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:05.253458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7bd4e70a-21c5-4eb3-b05d-10dbe9ee13a8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:05.253993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7bd4e70a-21c5-4eb3-b05d-10dbe9ee13a8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:05.254424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7bd4e70a-21c5-4eb3-b05d-10dbe9ee13a8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:05.255126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7bd4e70a-21c5-4eb3-b05d-10dbe9ee13a8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:05.255583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7bd4e70a-21c5-4eb3-b05d-10dbe9ee13a8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:05.256015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7bd4e70a-21c5-4eb3-b05d-10dbe9ee13a8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:05.258851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=84 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:05.406553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7bd4e70a-21c5-4eb3-b05d-10dbe9ee13a8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:05.415032 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7bd4e70a-21c5-4eb3-b05d-10dbe9ee13a8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1515 microversion: 2.1 time: 0.175680 Sep 07 13:35:05.415633 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3390/6807] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:05 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:06.439428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-375be74b-ff0d-4aba-96c4-fcc51d7f087f tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:06.440286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-375be74b-ff0d-4aba-96c4-fcc51d7f087f tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:06.447794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-375be74b-ff0d-4aba-96c4-fcc51d7f087f tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:06.448312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-375be74b-ff0d-4aba-96c4-fcc51d7f087f tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:06.448775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-375be74b-ff0d-4aba-96c4-fcc51d7f087f tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:06.449516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-375be74b-ff0d-4aba-96c4-fcc51d7f087f tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:06.450015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-375be74b-ff0d-4aba-96c4-fcc51d7f087f tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:06.450480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-375be74b-ff0d-4aba-96c4-fcc51d7f087f tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:06.592421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-375be74b-ff0d-4aba-96c4-fcc51d7f087f tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:06.600604 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-375be74b-ff0d-4aba-96c4-fcc51d7f087f tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1515 microversion: 2.1 time: 0.165697 Sep 07 13:35:06.601117 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3418/6808] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:06 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:35:07.624652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d9d540d-0dc8-4523-81d2-141e4085756a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:07.625323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1d9d540d-0dc8-4523-81d2-141e4085756a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:07.632881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d9d540d-0dc8-4523-81d2-141e4085756a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:07.633380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d9d540d-0dc8-4523-81d2-141e4085756a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:07.633856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d9d540d-0dc8-4523-81d2-141e4085756a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:07.634571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d9d540d-0dc8-4523-81d2-141e4085756a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:07.635029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d9d540d-0dc8-4523-81d2-141e4085756a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:07.635450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d9d540d-0dc8-4523-81d2-141e4085756a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:07.778520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1d9d540d-0dc8-4523-81d2-141e4085756a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:07.787148 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1d9d540d-0dc8-4523-81d2-141e4085756a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1515 microversion: 2.1 time: 0.166476 Sep 07 13:35:07.787763 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3391/6809] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:07 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:08.812763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a534b76c-75f6-401b-bd86-14eca22684cc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:08.813807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a534b76c-75f6-401b-bd86-14eca22684cc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:08.821469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a534b76c-75f6-401b-bd86-14eca22684cc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:08.822103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a534b76c-75f6-401b-bd86-14eca22684cc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:08.822552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a534b76c-75f6-401b-bd86-14eca22684cc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:08.823290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a534b76c-75f6-401b-bd86-14eca22684cc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:08.823840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a534b76c-75f6-401b-bd86-14eca22684cc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:08.824340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a534b76c-75f6-401b-bd86-14eca22684cc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:08.982823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a534b76c-75f6-401b-bd86-14eca22684cc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:08.991163 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a534b76c-75f6-401b-bd86-14eca22684cc tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1514 microversion: 2.1 time: 0.184090 Sep 07 13:35:08.991779 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3419/6810] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:08 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:09.175369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-adf72530-6602-42cf-98d9-edb61c537b1f req-f78743e2-012a-41b1-a644-92233d6b5db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991eb0a8-4864-48b8-bcfe-b7d47c342275", "name": "network-vif-unplugged", "status": "completed", "tag": "18f5488a-966a-4fad-9ba2-8b3fd401c296"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:09.187486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-adf72530-6602-42cf-98d9-edb61c537b1f req-f78743e2-012a-41b1-a644-92233d6b5db7 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:09.187870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-adf72530-6602-42cf-98d9-edb61c537b1f req-f78743e2-012a-41b1-a644-92233d6b5db7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:09.188340 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-adf72530-6602-42cf-98d9-edb61c537b1f req-f78743e2-012a-41b1-a644-92233d6b5db7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:09.202325 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-adf72530-6602-42cf-98d9-edb61c537b1f req-f78743e2-012a-41b1-a644-92233d6b5db7 service nova] Creating event network-vif-unplugged:18f5488a-966a-4fad-9ba2-8b3fd401c296 for instance 991eb0a8-4864-48b8-bcfe-b7d47c342275 on n-h1-852087-9 Sep 07 13:35:09.208670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-adf72530-6602-42cf-98d9-edb61c537b1f req-f78743e2-012a-41b1-a644-92233d6b5db7 service nova] Instance 991eb0a8-4864-48b8-bcfe-b7d47c342275 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:35:09.222875 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-adf72530-6602-42cf-98d9-edb61c537b1f req-f78743e2-012a-41b1-a644-92233d6b5db7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051392 Sep 07 13:35:09.223520 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3392/6811] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:35:10.015778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5196ac1d-98b2-465e-a7ef-d1de80ebab65 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:10.016624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5196ac1d-98b2-465e-a7ef-d1de80ebab65 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:10.024116 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5196ac1d-98b2-465e-a7ef-d1de80ebab65 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:10.024930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5196ac1d-98b2-465e-a7ef-d1de80ebab65 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:10.025700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5196ac1d-98b2-465e-a7ef-d1de80ebab65 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:10.026896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5196ac1d-98b2-465e-a7ef-d1de80ebab65 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:10.027705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5196ac1d-98b2-465e-a7ef-d1de80ebab65 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:10.028316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5196ac1d-98b2-465e-a7ef-d1de80ebab65 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:10.180924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5196ac1d-98b2-465e-a7ef-d1de80ebab65 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:10.189687 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5196ac1d-98b2-465e-a7ef-d1de80ebab65 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1514 microversion: 2.1 time: 0.178418 Sep 07 13:35:10.190335 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3420/6812] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:10 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:11.215295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f25f8039-0f3d-4b45-990e-a2b564a10612 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:11.216032 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f25f8039-0f3d-4b45-990e-a2b564a10612 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:11.224752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f25f8039-0f3d-4b45-990e-a2b564a10612 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:11.225332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f25f8039-0f3d-4b45-990e-a2b564a10612 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:11.225835 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f25f8039-0f3d-4b45-990e-a2b564a10612 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:11.226605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f25f8039-0f3d-4b45-990e-a2b564a10612 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:11.227098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f25f8039-0f3d-4b45-990e-a2b564a10612 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:11.227604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f25f8039-0f3d-4b45-990e-a2b564a10612 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:11.249629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-f0510e94-b6e2-4f6e-a7c0-d7422cc18e5e req-9989c209-a354-4a87-8037-a4e2d1d95447 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "991eb0a8-4864-48b8-bcfe-b7d47c342275", "tag": "18f5488a-966a-4fad-9ba2-8b3fd401c296"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:11.260220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f0510e94-b6e2-4f6e-a7c0-d7422cc18e5e req-9989c209-a354-4a87-8037-a4e2d1d95447 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:11.260710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f0510e94-b6e2-4f6e-a7c0-d7422cc18e5e req-9989c209-a354-4a87-8037-a4e2d1d95447 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:11.261170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-f0510e94-b6e2-4f6e-a7c0-d7422cc18e5e req-9989c209-a354-4a87-8037-a4e2d1d95447 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:11.274251 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-f0510e94-b6e2-4f6e-a7c0-d7422cc18e5e req-9989c209-a354-4a87-8037-a4e2d1d95447 service nova] Creating event network-changed:18f5488a-966a-4fad-9ba2-8b3fd401c296 for instance 991eb0a8-4864-48b8-bcfe-b7d47c342275 on n-h1-852087-9 Sep 07 13:35:11.280160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-f0510e94-b6e2-4f6e-a7c0-d7422cc18e5e req-9989c209-a354-4a87-8037-a4e2d1d95447 service nova] Instance 991eb0a8-4864-48b8-bcfe-b7d47c342275 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:35:11.291876 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-f0510e94-b6e2-4f6e-a7c0-d7422cc18e5e req-9989c209-a354-4a87-8037-a4e2d1d95447 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045945 Sep 07 13:35:11.292962 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3421/6813] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:35:11.380083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f25f8039-0f3d-4b45-990e-a2b564a10612 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:11.388760 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f25f8039-0f3d-4b45-990e-a2b564a10612 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1512 microversion: 2.1 time: 0.178440 Sep 07 13:35:11.389301 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3393/6814] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:11 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1512 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:12.415656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f7c674e9-ed2f-437d-bde2-9fc9978b9dda tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:12.416545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f7c674e9-ed2f-437d-bde2-9fc9978b9dda tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:12.423423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7c674e9-ed2f-437d-bde2-9fc9978b9dda tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:12.423975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7c674e9-ed2f-437d-bde2-9fc9978b9dda tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:12.424433 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7c674e9-ed2f-437d-bde2-9fc9978b9dda tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:12.425204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7c674e9-ed2f-437d-bde2-9fc9978b9dda tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:12.425827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7c674e9-ed2f-437d-bde2-9fc9978b9dda tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:12.426322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f7c674e9-ed2f-437d-bde2-9fc9978b9dda tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:12.574792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f7c674e9-ed2f-437d-bde2-9fc9978b9dda tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:12.584184 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f7c674e9-ed2f-437d-bde2-9fc9978b9dda tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1512 microversion: 2.1 time: 0.173984 Sep 07 13:35:12.584741 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3422/6815] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:12 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1512 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:13.609253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-75ed01cc-86c0-41e7-9557-fa77d0a9dad5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:13.610115 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-75ed01cc-86c0-41e7-9557-fa77d0a9dad5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:13.616916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75ed01cc-86c0-41e7-9557-fa77d0a9dad5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:13.617395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75ed01cc-86c0-41e7-9557-fa77d0a9dad5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:13.617884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75ed01cc-86c0-41e7-9557-fa77d0a9dad5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:13.618584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75ed01cc-86c0-41e7-9557-fa77d0a9dad5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:13.619043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75ed01cc-86c0-41e7-9557-fa77d0a9dad5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:13.619503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75ed01cc-86c0-41e7-9557-fa77d0a9dad5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:13.760746 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-75ed01cc-86c0-41e7-9557-fa77d0a9dad5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:13.770893 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-75ed01cc-86c0-41e7-9557-fa77d0a9dad5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1509 microversion: 2.1 time: 0.165838 Sep 07 13:35:13.771683 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3394/6816] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:13 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:13.794748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e4503dfa-b768-4356-8596-64606166c100 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:13.795306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e4503dfa-b768-4356-8596-64606166c100 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:13.802664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4503dfa-b768-4356-8596-64606166c100 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:13.803185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4503dfa-b768-4356-8596-64606166c100 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:13.803652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4503dfa-b768-4356-8596-64606166c100 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:13.804613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4503dfa-b768-4356-8596-64606166c100 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:13.805218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4503dfa-b768-4356-8596-64606166c100 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:13.805832 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e4503dfa-b768-4356-8596-64606166c100 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:13.834636 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e4503dfa-b768-4356-8596-64606166c100 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:35:13.888805 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.compute.api [None req-e4503dfa-b768-4356-8596-64606166c100 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Found an unconfirmed migration during delete, id: 16, status: finished Sep 07 13:35:15.573734 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e4503dfa-b768-4356-8596-64606166c100 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "DELETE /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 204 len: 0 microversion: 2.1 time: 1.782558 Sep 07 13:35:15.574643 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3423/6817] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:35:13 2022] DELETE /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 0 bytes in 1784 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:35:15.584942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1cc7c8f0-4024-4e08-a57d-6fc2f33e36f5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:15.585523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1cc7c8f0-4024-4e08-a57d-6fc2f33e36f5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:15.593345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cc7c8f0-4024-4e08-a57d-6fc2f33e36f5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:15.593985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cc7c8f0-4024-4e08-a57d-6fc2f33e36f5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:15.594531 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cc7c8f0-4024-4e08-a57d-6fc2f33e36f5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:15.595330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cc7c8f0-4024-4e08-a57d-6fc2f33e36f5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:15.595898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cc7c8f0-4024-4e08-a57d-6fc2f33e36f5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:15.596397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cc7c8f0-4024-4e08-a57d-6fc2f33e36f5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:15.734089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1cc7c8f0-4024-4e08-a57d-6fc2f33e36f5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:15.743305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a333ad9c-9261-4eff-9f39-f76714762d46 req-62cdea94-1633-402d-bd05-5382e98cd245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991eb0a8-4864-48b8-bcfe-b7d47c342275", "name": "network-vif-plugged", "status": "completed", "tag": "18f5488a-966a-4fad-9ba2-8b3fd401c296"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:15.755342 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1cc7c8f0-4024-4e08-a57d-6fc2f33e36f5 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1501 microversion: 2.1 time: 0.174933 Sep 07 13:35:15.755943 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3395/6818] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:15 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1501 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:15.760137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a333ad9c-9261-4eff-9f39-f76714762d46 req-62cdea94-1633-402d-bd05-5382e98cd245 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:15.760614 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a333ad9c-9261-4eff-9f39-f76714762d46 req-62cdea94-1633-402d-bd05-5382e98cd245 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:15.761063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a333ad9c-9261-4eff-9f39-f76714762d46 req-62cdea94-1633-402d-bd05-5382e98cd245 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:15.773696 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a333ad9c-9261-4eff-9f39-f76714762d46 req-62cdea94-1633-402d-bd05-5382e98cd245 service nova] Creating event network-vif-plugged:18f5488a-966a-4fad-9ba2-8b3fd401c296 for instance 991eb0a8-4864-48b8-bcfe-b7d47c342275 on n-h1-852087-9 Sep 07 13:35:15.778651 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a333ad9c-9261-4eff-9f39-f76714762d46 req-62cdea94-1633-402d-bd05-5382e98cd245 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039400 Sep 07 13:35:15.779233 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3424/6819] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:35:16.780095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6177a477-66ec-48d7-b84c-1df7a1e0c43a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:16.780708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6177a477-66ec-48d7-b84c-1df7a1e0c43a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:16.788411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6177a477-66ec-48d7-b84c-1df7a1e0c43a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:16.788900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6177a477-66ec-48d7-b84c-1df7a1e0c43a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:16.789342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6177a477-66ec-48d7-b84c-1df7a1e0c43a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:16.790075 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6177a477-66ec-48d7-b84c-1df7a1e0c43a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:16.790541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6177a477-66ec-48d7-b84c-1df7a1e0c43a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:16.791044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6177a477-66ec-48d7-b84c-1df7a1e0c43a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:16.933591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6177a477-66ec-48d7-b84c-1df7a1e0c43a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377d7dd7ac8e4b8f9fbc54f6558cbfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e7c620507ff4d2a871006d12c20d9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:16.941818 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6177a477-66ec-48d7-b84c-1df7a1e0c43a tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 200 len: 1501 microversion: 2.1 time: 0.165846 Sep 07 13:35:16.942420 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3396/6820] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:16 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 1501 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:17.596634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-47db6fa7-2271-4d2c-8be4-c10c43ece417 req-4aea2ed5-88d7-4ea4-818a-771d95c9e649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991eb0a8-4864-48b8-bcfe-b7d47c342275", "name": "network-vif-deleted", "tag": "18f5488a-966a-4fad-9ba2-8b3fd401c296"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:17.607284 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-47db6fa7-2271-4d2c-8be4-c10c43ece417 req-4aea2ed5-88d7-4ea4-818a-771d95c9e649 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:17.607784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-47db6fa7-2271-4d2c-8be4-c10c43ece417 req-4aea2ed5-88d7-4ea4-818a-771d95c9e649 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:17.608230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-47db6fa7-2271-4d2c-8be4-c10c43ece417 req-4aea2ed5-88d7-4ea4-818a-771d95c9e649 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:17.619918 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-47db6fa7-2271-4d2c-8be4-c10c43ece417 req-4aea2ed5-88d7-4ea4-818a-771d95c9e649 service nova] Creating event network-vif-deleted:18f5488a-966a-4fad-9ba2-8b3fd401c296 for instance 991eb0a8-4864-48b8-bcfe-b7d47c342275 on n-h1-852087-9 Sep 07 13:35:17.625163 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-47db6fa7-2271-4d2c-8be4-c10c43ece417 req-4aea2ed5-88d7-4ea4-818a-771d95c9e649 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033661 Sep 07 13:35:17.625805 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3425/6821] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:35:17.966602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4b821e51-8405-4b27-899d-f10b42489fb8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:17.967656 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4b821e51-8405-4b27-899d-f10b42489fb8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:17.975385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b821e51-8405-4b27-899d-f10b42489fb8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:17.975886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b821e51-8405-4b27-899d-f10b42489fb8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:17.976324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b821e51-8405-4b27-899d-f10b42489fb8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:17.977087 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b821e51-8405-4b27-899d-f10b42489fb8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:17.977601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b821e51-8405-4b27-899d-f10b42489fb8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:17.978064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b821e51-8405-4b27-899d-f10b42489fb8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:17.993768 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-4b821e51-8405-4b27-899d-f10b42489fb8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] HTTP exception thrown: Instance 991eb0a8-4864-48b8-bcfe-b7d47c342275 could not be found. Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4b821e51-8405-4b27-899d-f10b42489fb8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Request method failure captured: Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 HTTP/1.1 Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJ3h4DhYHTWs1RpkycODnarqTaBScBXJnB113XfVvbRcDSzv2s-9yTrDqm013Rp9Wii1RtcO_A52pocLVk0hGhnDrdD7l9-fsr9r7tEjWOEHjw7ghjze8mfKi8ttknN2xFUheWmbfo_RuiOFQef7yjEirpQG4MdYgQ_ogZaC8AL4g7Q Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 7e7c620507ff4d2a871006d12c20d9f4 Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1835290395 Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7e7c620507ff4d2a871006d12c20d9f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7e7c620507ff4d2a871006d12c20d9f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7e7c620507ff4d2a871006d12c20d9f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7e7c620507ff4d2a871006d12c20d9f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1835290395 Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 7e7c620507ff4d2a871006d12c20d9f4 Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1835290395 Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1835290395-project Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 377d7dd7ac8e4b8f9fbc54f6558cbfed Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1835290395-project Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 991eb0a8-4864-48b8-bcfe-b7d47c342275 could not be found. Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '991eb0a8-4864-48b8-bcfe-b7d47c342275'} Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 991eb0a8-4864-48b8-bcfe-b7d47c342275 could not be found. Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 991eb0a8-4864-48b8-bcfe-b7d47c342275 could not be found. Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:35:17.995599 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:35:17.999761 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:35:17.999761 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:35:17.999761 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:35:17.999761 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:35:17.999761 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:35:17.999761 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 991eb0a8-4864-48b8-bcfe-b7d47c342275 could not be found. Sep 07 13:35:17.999761 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:35:17.999761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4b821e51-8405-4b27-899d-f10b42489fb8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Returning 404 to user: Instance 991eb0a8-4864-48b8-bcfe-b7d47c342275 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:35:17.999761 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4b821e51-8405-4b27-899d-f10b42489fb8 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 404 len: 111 microversion: 2.1 time: 0.035241 Sep 07 13:35:17.999761 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3397/6822] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:17 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:35:18.012669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3096a60d-710f-48c9-91e3-21f91375dc23 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:18.013273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3096a60d-710f-48c9-91e3-21f91375dc23 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:18.020473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3096a60d-710f-48c9-91e3-21f91375dc23 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:18.020987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3096a60d-710f-48c9-91e3-21f91375dc23 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:18.021437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3096a60d-710f-48c9-91e3-21f91375dc23 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:18.022188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3096a60d-710f-48c9-91e3-21f91375dc23 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:18.022657 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3096a60d-710f-48c9-91e3-21f91375dc23 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:18.023112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3096a60d-710f-48c9-91e3-21f91375dc23 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:18.038894 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-3096a60d-710f-48c9-91e3-21f91375dc23 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] HTTP exception thrown: Instance 991eb0a8-4864-48b8-bcfe-b7d47c342275 could not be found. Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3096a60d-710f-48c9-91e3-21f91375dc23 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Request method failure captured: Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 HTTP/1.1 Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJ3h4DhYHTWs1RpkycODnarqTaBScBXJnB113XfVvbRcDSzv2s-9yTrDqm013Rp9Wii1RtcO_A52pocLVk0hGhnDrdD7l9-fsr9r7tEjWOEHjw7ghjze8mfKi8ttknN2xFUheWmbfo_RuiOFQef7yjEirpQG4MdYgQ_ogZaC8AL4g7Q Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 7e7c620507ff4d2a871006d12c20d9f4 Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-DeleteServersTestJSON-1835290395 Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7e7c620507ff4d2a871006d12c20d9f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7e7c620507ff4d2a871006d12c20d9f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7e7c620507ff4d2a871006d12c20d9f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7e7c620507ff4d2a871006d12c20d9f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-DeleteServersTestJSON-1835290395 Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 7e7c620507ff4d2a871006d12c20d9f4 Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1835290395 Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-DeleteServersTestJSON-1835290395-project Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 377d7dd7ac8e4b8f9fbc54f6558cbfed Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-DeleteServersTestJSON-1835290395-project Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 991eb0a8-4864-48b8-bcfe-b7d47c342275 could not be found. Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '991eb0a8-4864-48b8-bcfe-b7d47c342275'} Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 991eb0a8-4864-48b8-bcfe-b7d47c342275 could not be found. Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:35:18.040656 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:35:18.047318 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 991eb0a8-4864-48b8-bcfe-b7d47c342275 could not be found. Sep 07 13:35:18.047318 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:35:18.047318 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:35:18.047318 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:35:18.047318 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:35:18.047318 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:35:18.047318 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:35:18.047318 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:35:18.047318 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:35:18.047318 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 991eb0a8-4864-48b8-bcfe-b7d47c342275 could not be found. Sep 07 13:35:18.047318 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:35:18.047318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3096a60d-710f-48c9-91e3-21f91375dc23 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Returning 404 to user: Instance 991eb0a8-4864-48b8-bcfe-b7d47c342275 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:35:18.047318 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3096a60d-710f-48c9-91e3-21f91375dc23 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "DELETE /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 404 len: 111 microversion: 2.1 time: 0.033822 Sep 07 13:35:18.047318 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3426/6823] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:35:18 2022] DELETE /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:35:18.051730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a6f49a28-e2a9-4c06-8db1-24f7897ec6e7 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:18.052351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a6f49a28-e2a9-4c06-8db1-24f7897ec6e7 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] [instance: 991eb0a8-4864-48b8-bcfe-b7d47c342275] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:18.058566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6f49a28-e2a9-4c06-8db1-24f7897ec6e7 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:18.059046 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6f49a28-e2a9-4c06-8db1-24f7897ec6e7 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:18.059476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6f49a28-e2a9-4c06-8db1-24f7897ec6e7 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:18.060169 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6f49a28-e2a9-4c06-8db1-24f7897ec6e7 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:18.060659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6f49a28-e2a9-4c06-8db1-24f7897ec6e7 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:18.061121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6f49a28-e2a9-4c06-8db1-24f7897ec6e7 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:18.075302 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-a6f49a28-e2a9-4c06-8db1-24f7897ec6e7 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] HTTP exception thrown: Instance 991eb0a8-4864-48b8-bcfe-b7d47c342275 could not be found. Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a6f49a28-e2a9-4c06-8db1-24f7897ec6e7 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Request method failure captured: Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 HTTP/1.1 Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJ3h4DhYHTWs1RpkycODnarqTaBScBXJnB113XfVvbRcDSzv2s-9yTrDqm013Rp9Wii1RtcO_A52pocLVk0hGhnDrdD7l9-fsr9r7tEjWOEHjw7ghjze8mfKi8ttknN2xFUheWmbfo_RuiOFQef7yjEirpQG4MdYgQ_ogZaC8AL4g7Q Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 7e7c620507ff4d2a871006d12c20d9f4 Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-DeleteServersTestJSON-1835290395 Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7e7c620507ff4d2a871006d12c20d9f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7e7c620507ff4d2a871006d12c20d9f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7e7c620507ff4d2a871006d12c20d9f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7e7c620507ff4d2a871006d12c20d9f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-DeleteServersTestJSON-1835290395 Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 7e7c620507ff4d2a871006d12c20d9f4 Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1835290395 Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-DeleteServersTestJSON-1835290395-project Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 377d7dd7ac8e4b8f9fbc54f6558cbfed Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-DeleteServersTestJSON-1835290395-project Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 991eb0a8-4864-48b8-bcfe-b7d47c342275 could not be found. Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '991eb0a8-4864-48b8-bcfe-b7d47c342275'} Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 991eb0a8-4864-48b8-bcfe-b7d47c342275 could not be found. Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 991eb0a8-4864-48b8-bcfe-b7d47c342275 could not be found. Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:35:18.076912 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:35:18.081208 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:35:18.081208 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:35:18.081208 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:35:18.081208 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:35:18.081208 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:35:18.081208 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 991eb0a8-4864-48b8-bcfe-b7d47c342275 could not be found. Sep 07 13:35:18.081208 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:35:18.081208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a6f49a28-e2a9-4c06-8db1-24f7897ec6e7 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] Returning 404 to user: Instance 991eb0a8-4864-48b8-bcfe-b7d47c342275 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:35:18.081208 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a6f49a28-e2a9-4c06-8db1-24f7897ec6e7 tempest-DeleteServersTestJSON-1835290395 tempest-DeleteServersTestJSON-1835290395-project] 10.222.0.16 "GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275" status: 404 len: 111 microversion: 2.1 time: 0.031095 Sep 07 13:35:18.082016 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3398/6824] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:18 2022] GET /compute/v2.1/servers/991eb0a8-4864-48b8-bcfe-b7d47c342275 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:35:27.330481 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-774dd5b2-4c82-4865-b391-34793af69925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1391296766", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "b77cc80a-dc93-4840-b01d-34182ecc44e0"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:27.388310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-774dd5b2-4c82-4865-b391-34793af69925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] validate_networks() for [('b77cc80a-dc93-4840-b01d-34182ecc44e0', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:35:27.821546 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-774dd5b2-4c82-4865-b391-34793af69925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:35:27.822015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-774dd5b2-4c82-4865-b391-34793af69925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:35:27.822677 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-774dd5b2-4c82-4865-b391-34793af69925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:35:27.823109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-774dd5b2-4c82-4865-b391-34793af69925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:35:27.823540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-774dd5b2-4c82-4865-b391-34793af69925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:35:27.842842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-774dd5b2-4c82-4865-b391-34793af69925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:27.842842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-774dd5b2-4c82-4865-b391-34793af69925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:27.842842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-774dd5b2-4c82-4865-b391-34793af69925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:27.842842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-774dd5b2-4c82-4865-b391-34793af69925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:27.842842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-774dd5b2-4c82-4865-b391-34793af69925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:27.842842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-774dd5b2-4c82-4865-b391-34793af69925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:27.856361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-774dd5b2-4c82-4865-b391-34793af69925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Getting quotas for project d98fd3224d1541babd9ee0f9fc0a4fca. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:35:27.861976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-774dd5b2-4c82-4865-b391-34793af69925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Getting quotas for user 533e322376994c8a85c8e7696f4f974f and project d98fd3224d1541babd9ee0f9fc0a4fca. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:35:27.878334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-774dd5b2-4c82-4865-b391-34793af69925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:35:27.880916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-774dd5b2-4c82-4865-b391-34793af69925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:35:27.934486 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-774dd5b2-4c82-4865-b391-34793af69925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.728275 Sep 07 13:35:27.935114 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3427/6825] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:35:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:35:27.947962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-82993a1a-5978-4593-a3ca-806fa5893aba tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:27.948692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-82993a1a-5978-4593-a3ca-806fa5893aba tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:28.014586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-82993a1a-5978-4593-a3ca-806fa5893aba tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:28.021641 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-82993a1a-5978-4593-a3ca-806fa5893aba tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1218 microversion: 2.1 time: 0.078258 Sep 07 13:35:28.022222 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3399/6826] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:27 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:29.046199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-98457708-bd2e-462b-b5c6-9a2d3e8c8f5b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:29.046867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-98457708-bd2e-462b-b5c6-9a2d3e8c8f5b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:29.054003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98457708-bd2e-462b-b5c6-9a2d3e8c8f5b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:29.054765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98457708-bd2e-462b-b5c6-9a2d3e8c8f5b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:29.055421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98457708-bd2e-462b-b5c6-9a2d3e8c8f5b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:29.056133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98457708-bd2e-462b-b5c6-9a2d3e8c8f5b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:29.056702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98457708-bd2e-462b-b5c6-9a2d3e8c8f5b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:29.057130 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98457708-bd2e-462b-b5c6-9a2d3e8c8f5b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:29.131417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-98457708-bd2e-462b-b5c6-9a2d3e8c8f5b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:29.141576 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-98457708-bd2e-462b-b5c6-9a2d3e8c8f5b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1270 microversion: 2.1 time: 0.100765 Sep 07 13:35:29.142186 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3428/6827] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:29 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:30.166038 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5159eb2b-1581-4079-a4c3-18b7ee12f2f1 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:30.167426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5159eb2b-1581-4079-a4c3-18b7ee12f2f1 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:30.177425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=43 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:30.189991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5159eb2b-1581-4079-a4c3-18b7ee12f2f1 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:30.193136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5159eb2b-1581-4079-a4c3-18b7ee12f2f1 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:30.193744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5159eb2b-1581-4079-a4c3-18b7ee12f2f1 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:30.194744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5159eb2b-1581-4079-a4c3-18b7ee12f2f1 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:30.195224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5159eb2b-1581-4079-a4c3-18b7ee12f2f1 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:30.198137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5159eb2b-1581-4079-a4c3-18b7ee12f2f1 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:30.393343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5159eb2b-1581-4079-a4c3-18b7ee12f2f1 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:30.411081 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5159eb2b-1581-4079-a4c3-18b7ee12f2f1 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1318 microversion: 2.1 time: 0.249163 Sep 07 13:35:30.412287 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3400/6828] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:30 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:30.828111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8c713429-28b7-497c-b3bc-69409bce62f0 req-2fa4972a-4a25-4b18-95a4-9cb81299c09b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "135649d7-e74d-4676-a1bf-4d0d8ebd873c", "tag": "3a160f80-1ce5-450c-9771-7687472dcc1e"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:30.848271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8c713429-28b7-497c-b3bc-69409bce62f0 req-2fa4972a-4a25-4b18-95a4-9cb81299c09b service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:30.848780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8c713429-28b7-497c-b3bc-69409bce62f0 req-2fa4972a-4a25-4b18-95a4-9cb81299c09b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:30.849230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8c713429-28b7-497c-b3bc-69409bce62f0 req-2fa4972a-4a25-4b18-95a4-9cb81299c09b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:30.867693 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8c713429-28b7-497c-b3bc-69409bce62f0 req-2fa4972a-4a25-4b18-95a4-9cb81299c09b service nova] Creating event network-changed:3a160f80-1ce5-450c-9771-7687472dcc1e for instance 135649d7-e74d-4676-a1bf-4d0d8ebd873c on n-h1-852087-9 Sep 07 13:35:30.873606 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8c713429-28b7-497c-b3bc-69409bce62f0 req-2fa4972a-4a25-4b18-95a4-9cb81299c09b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049259 Sep 07 13:35:30.874458 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3429/6829] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:35:31.438678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f6e40f2b-8446-463b-9a56-e7415c1878a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:31.439649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f6e40f2b-8446-463b-9a56-e7415c1878a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:31.447221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6e40f2b-8446-463b-9a56-e7415c1878a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:31.447881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6e40f2b-8446-463b-9a56-e7415c1878a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:31.448313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6e40f2b-8446-463b-9a56-e7415c1878a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:31.449018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6e40f2b-8446-463b-9a56-e7415c1878a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:31.449471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6e40f2b-8446-463b-9a56-e7415c1878a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:31.449963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6e40f2b-8446-463b-9a56-e7415c1878a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:31.598873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f6e40f2b-8446-463b-9a56-e7415c1878a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:31.611274 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f6e40f2b-8446-463b-9a56-e7415c1878a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1318 microversion: 2.1 time: 0.177445 Sep 07 13:35:31.611871 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3401/6830] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:31 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:32.637512 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2aab5314-92d5-47e2-9ba2-df425f484299 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:32.638334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2aab5314-92d5-47e2-9ba2-df425f484299 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:32.645843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2aab5314-92d5-47e2-9ba2-df425f484299 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:32.646534 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2aab5314-92d5-47e2-9ba2-df425f484299 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:32.647115 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2aab5314-92d5-47e2-9ba2-df425f484299 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:32.647893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2aab5314-92d5-47e2-9ba2-df425f484299 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:32.648411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2aab5314-92d5-47e2-9ba2-df425f484299 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:32.648899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2aab5314-92d5-47e2-9ba2-df425f484299 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:32.652157 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:32.797047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2aab5314-92d5-47e2-9ba2-df425f484299 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:32.805622 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2aab5314-92d5-47e2-9ba2-df425f484299 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1318 microversion: 2.1 time: 0.174561 Sep 07 13:35:32.806205 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3430/6831] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:32 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:33.828883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-56512d5e-15a8-4a08-b5cb-d7590f8c6d02 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:33.829951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-56512d5e-15a8-4a08-b5cb-d7590f8c6d02 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:33.837374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56512d5e-15a8-4a08-b5cb-d7590f8c6d02 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:33.838056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56512d5e-15a8-4a08-b5cb-d7590f8c6d02 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:33.838398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56512d5e-15a8-4a08-b5cb-d7590f8c6d02 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:33.839104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56512d5e-15a8-4a08-b5cb-d7590f8c6d02 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:33.840111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56512d5e-15a8-4a08-b5cb-d7590f8c6d02 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:33.840546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-56512d5e-15a8-4a08-b5cb-d7590f8c6d02 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:34.001581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-56512d5e-15a8-4a08-b5cb-d7590f8c6d02 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:34.010159 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-56512d5e-15a8-4a08-b5cb-d7590f8c6d02 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1318 microversion: 2.1 time: 0.185441 Sep 07 13:35:34.010750 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3402/6832] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:33 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:35.034364 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-44f073e4-977f-4a5e-9199-c2323411450d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:35.035021 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-44f073e4-977f-4a5e-9199-c2323411450d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:35.037921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:35.044303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44f073e4-977f-4a5e-9199-c2323411450d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:35.044799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44f073e4-977f-4a5e-9199-c2323411450d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:35.045276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44f073e4-977f-4a5e-9199-c2323411450d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:35.046047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44f073e4-977f-4a5e-9199-c2323411450d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:35.046526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44f073e4-977f-4a5e-9199-c2323411450d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:35.046972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44f073e4-977f-4a5e-9199-c2323411450d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:35.193416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-44f073e4-977f-4a5e-9199-c2323411450d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:35.201370 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-44f073e4-977f-4a5e-9199-c2323411450d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1318 microversion: 2.1 time: 0.171117 Sep 07 13:35:35.201981 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3431/6833] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:35 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:35.842974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-a19405e3-fa6b-4402-8508-b0e7c82a21ca req-a6d26796-c9b5-4ddd-a244-0e1adf034f6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "135649d7-e74d-4676-a1bf-4d0d8ebd873c", "name": "network-vif-plugged", "status": "completed", "tag": "3a160f80-1ce5-450c-9771-7687472dcc1e"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:35.848938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=28 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:35.855459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a19405e3-fa6b-4402-8508-b0e7c82a21ca req-a6d26796-c9b5-4ddd-a244-0e1adf034f6c service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:35.855949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a19405e3-fa6b-4402-8508-b0e7c82a21ca req-a6d26796-c9b5-4ddd-a244-0e1adf034f6c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:35.856390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-a19405e3-fa6b-4402-8508-b0e7c82a21ca req-a6d26796-c9b5-4ddd-a244-0e1adf034f6c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:35.868220 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-a19405e3-fa6b-4402-8508-b0e7c82a21ca req-a6d26796-c9b5-4ddd-a244-0e1adf034f6c service nova] Creating event network-vif-plugged:3a160f80-1ce5-450c-9771-7687472dcc1e for instance 135649d7-e74d-4676-a1bf-4d0d8ebd873c on n-h1-852087-9 Sep 07 13:35:35.873353 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-a19405e3-fa6b-4402-8508-b0e7c82a21ca req-a6d26796-c9b5-4ddd-a244-0e1adf034f6c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035053 Sep 07 13:35:35.874084 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3403/6834] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:35:36.230753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-46cf9f70-8c6d-4588-bc9f-fba74a33101e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:36.231399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-46cf9f70-8c6d-4588-bc9f-fba74a33101e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:36.239126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46cf9f70-8c6d-4588-bc9f-fba74a33101e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:36.239653 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46cf9f70-8c6d-4588-bc9f-fba74a33101e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:36.240109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46cf9f70-8c6d-4588-bc9f-fba74a33101e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:36.240835 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46cf9f70-8c6d-4588-bc9f-fba74a33101e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:36.241315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46cf9f70-8c6d-4588-bc9f-fba74a33101e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:36.241830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-46cf9f70-8c6d-4588-bc9f-fba74a33101e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:36.382240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-46cf9f70-8c6d-4588-bc9f-fba74a33101e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:36.390275 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-46cf9f70-8c6d-4588-bc9f-fba74a33101e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1318 microversion: 2.1 time: 0.163583 Sep 07 13:35:36.390841 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3432/6835] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:36 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:37.414645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b76aee7-6dba-495f-ad3d-6d2711c74c65 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:37.415369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2b76aee7-6dba-495f-ad3d-6d2711c74c65 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:37.422048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b76aee7-6dba-495f-ad3d-6d2711c74c65 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:37.422540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b76aee7-6dba-495f-ad3d-6d2711c74c65 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:37.422981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b76aee7-6dba-495f-ad3d-6d2711c74c65 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:37.423687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b76aee7-6dba-495f-ad3d-6d2711c74c65 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:37.424139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b76aee7-6dba-495f-ad3d-6d2711c74c65 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:37.424573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b76aee7-6dba-495f-ad3d-6d2711c74c65 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:37.579126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2b76aee7-6dba-495f-ad3d-6d2711c74c65 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:37.587304 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2b76aee7-6dba-495f-ad3d-6d2711c74c65 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1318 microversion: 2.1 time: 0.178179 Sep 07 13:35:37.587875 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3404/6836] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:37 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:38.612059 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fcc9377c-dd7a-44c0-b561-8eb21e1332a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:38.612712 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-fcc9377c-dd7a-44c0-b561-8eb21e1332a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:38.615619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:38.616332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:38.623326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcc9377c-dd7a-44c0-b561-8eb21e1332a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:38.624141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcc9377c-dd7a-44c0-b561-8eb21e1332a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:38.624673 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcc9377c-dd7a-44c0-b561-8eb21e1332a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:38.625699 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcc9377c-dd7a-44c0-b561-8eb21e1332a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:38.626184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcc9377c-dd7a-44c0-b561-8eb21e1332a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:38.626682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-fcc9377c-dd7a-44c0-b561-8eb21e1332a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:38.773117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-fcc9377c-dd7a-44c0-b561-8eb21e1332a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:38.785284 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fcc9377c-dd7a-44c0-b561-8eb21e1332a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1508 microversion: 2.1 time: 0.177157 Sep 07 13:35:38.786482 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3433/6837] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:38 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1508 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:38.814595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-26b86667-4a01-4487-9c3b-7b8a25b744fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:38.815192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-26b86667-4a01-4487-9c3b-7b8a25b744fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:38.817286 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:38.823758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26b86667-4a01-4487-9c3b-7b8a25b744fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:38.824240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26b86667-4a01-4487-9c3b-7b8a25b744fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:38.824680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26b86667-4a01-4487-9c3b-7b8a25b744fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:38.825380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26b86667-4a01-4487-9c3b-7b8a25b744fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:38.825863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26b86667-4a01-4487-9c3b-7b8a25b744fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:38.826290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-26b86667-4a01-4487-9c3b-7b8a25b744fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:38.965188 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-26b86667-4a01-4487-9c3b-7b8a25b744fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:38.973331 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-26b86667-4a01-4487-9c3b-7b8a25b744fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1508 microversion: 2.1 time: 0.162678 Sep 07 13:35:38.973981 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3405/6838] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:38 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:38.996082 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f0f7ffa6-0f89-41e7-98f6-0ba697bf059d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:38.998753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f0f7ffa6-0f89-41e7-98f6-0ba697bf059d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:39.005090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0f7ffa6-0f89-41e7-98f6-0ba697bf059d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:39.005631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0f7ffa6-0f89-41e7-98f6-0ba697bf059d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:39.006107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0f7ffa6-0f89-41e7-98f6-0ba697bf059d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:39.006819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0f7ffa6-0f89-41e7-98f6-0ba697bf059d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:39.007285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0f7ffa6-0f89-41e7-98f6-0ba697bf059d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:39.007724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0f7ffa6-0f89-41e7-98f6-0ba697bf059d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:39.083360 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f0f7ffa6-0f89-41e7-98f6-0ba697bf059d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "PUT /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1080 microversion: 2.1 time: 0.091286 Sep 07 13:35:39.084014 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3434/6839] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Sep 7 13:35:38 2022] PUT /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1080 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:39.104195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b691363d-f59a-482f-934d-293c7ceed598 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:39.105012 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b691363d-f59a-482f-934d-293c7ceed598 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:39.111797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b691363d-f59a-482f-934d-293c7ceed598 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:39.112329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b691363d-f59a-482f-934d-293c7ceed598 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:39.112856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b691363d-f59a-482f-934d-293c7ceed598 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:39.113618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b691363d-f59a-482f-934d-293c7ceed598 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:39.114231 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b691363d-f59a-482f-934d-293c7ceed598 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:39.114662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b691363d-f59a-482f-934d-293c7ceed598 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:39.268460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b691363d-f59a-482f-934d-293c7ceed598 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:39.277330 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b691363d-f59a-482f-934d-293c7ceed598 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1506 microversion: 2.1 time: 0.177549 Sep 07 13:35:39.277951 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3406/6840] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:39 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:35:39.299995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-53e6c714-5f4d-4db4-a9fc-9cc091963676 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:39.300631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-53e6c714-5f4d-4db4-a9fc-9cc091963676 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:39.307114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53e6c714-5f4d-4db4-a9fc-9cc091963676 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:39.307630 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53e6c714-5f4d-4db4-a9fc-9cc091963676 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:39.308089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53e6c714-5f4d-4db4-a9fc-9cc091963676 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:39.308812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53e6c714-5f4d-4db4-a9fc-9cc091963676 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:39.309286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53e6c714-5f4d-4db4-a9fc-9cc091963676 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:39.309760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53e6c714-5f4d-4db4-a9fc-9cc091963676 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:39.459245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-53e6c714-5f4d-4db4-a9fc-9cc091963676 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:39.468206 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-53e6c714-5f4d-4db4-a9fc-9cc091963676 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1506 microversion: 2.1 time: 0.172298 Sep 07 13:35:39.468780 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3435/6841] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:39 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:39.493738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-adada210-9ff5-4d3d-ab15-08482e3cac40 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:35:39.496055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-adada210-9ff5-4d3d-ab15-08482e3cac40 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:39.502890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adada210-9ff5-4d3d-ab15-08482e3cac40 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:39.503753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adada210-9ff5-4d3d-ab15-08482e3cac40 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:39.503892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adada210-9ff5-4d3d-ab15-08482e3cac40 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:39.504617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adada210-9ff5-4d3d-ab15-08482e3cac40 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:39.505095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adada210-9ff5-4d3d-ab15-08482e3cac40 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:39.505526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adada210-9ff5-4d3d-ab15-08482e3cac40 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:39.586780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-adada210-9ff5-4d3d-ab15-08482e3cac40 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:39.593978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-adada210-9ff5-4d3d-ab15-08482e3cac40 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Old instance type m1.heat2, new instance type m1.heat {{(pid=122432) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 13:35:39.601982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-adada210-9ff5-4d3d-ab15-08482e3cac40 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:35:39.602432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-adada210-9ff5-4d3d-ab15-08482e3cac40 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:35:39.602900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-adada210-9ff5-4d3d-ab15-08482e3cac40 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:35:39.603306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-adada210-9ff5-4d3d-ab15-08482e3cac40 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:35:39.603722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-adada210-9ff5-4d3d-ab15-08482e3cac40 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:35:39.737123 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-adada210-9ff5-4d3d-ab15-08482e3cac40 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "POST /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c/action" status: 202 len: 0 microversion: 2.1 time: 0.247369 Sep 07 13:35:39.738735 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3407/6842] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:35:39 2022] POST /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:35:39.748374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ba4227b9-bdee-409f-b252-9137bde6c8b3 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:39.749117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ba4227b9-bdee-409f-b252-9137bde6c8b3 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:39.758013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba4227b9-bdee-409f-b252-9137bde6c8b3 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:39.758923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba4227b9-bdee-409f-b252-9137bde6c8b3 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:39.759466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba4227b9-bdee-409f-b252-9137bde6c8b3 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:39.760503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba4227b9-bdee-409f-b252-9137bde6c8b3 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:39.761065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba4227b9-bdee-409f-b252-9137bde6c8b3 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:39.761621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba4227b9-bdee-409f-b252-9137bde6c8b3 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:39.942267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ba4227b9-bdee-409f-b252-9137bde6c8b3 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:39.955344 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ba4227b9-bdee-409f-b252-9137bde6c8b3 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1517 microversion: 2.1 time: 0.210427 Sep 07 13:35:39.956690 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3436/6843] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:39 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1517 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:40.997286 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0f2cf2f8-d573-48ce-beaf-fd679ebaa00a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:40.998021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0f2cf2f8-d573-48ce-beaf-fd679ebaa00a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:41.009812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f2cf2f8-d573-48ce-beaf-fd679ebaa00a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:41.010320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f2cf2f8-d573-48ce-beaf-fd679ebaa00a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:41.010766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f2cf2f8-d573-48ce-beaf-fd679ebaa00a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:41.011471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f2cf2f8-d573-48ce-beaf-fd679ebaa00a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:41.011899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f2cf2f8-d573-48ce-beaf-fd679ebaa00a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:41.012349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f2cf2f8-d573-48ce-beaf-fd679ebaa00a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:41.151588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0f2cf2f8-d573-48ce-beaf-fd679ebaa00a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:41.159908 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0f2cf2f8-d573-48ce-beaf-fd679ebaa00a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1517 microversion: 2.1 time: 0.167235 Sep 07 13:35:41.160466 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3408/6844] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:40 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:42.187189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c79238ef-e74b-4475-ac57-a6969d2ed2d6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:42.187754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c79238ef-e74b-4475-ac57-a6969d2ed2d6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:42.195174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c79238ef-e74b-4475-ac57-a6969d2ed2d6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:42.195680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c79238ef-e74b-4475-ac57-a6969d2ed2d6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:42.196138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c79238ef-e74b-4475-ac57-a6969d2ed2d6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:42.196884 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c79238ef-e74b-4475-ac57-a6969d2ed2d6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:42.197361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c79238ef-e74b-4475-ac57-a6969d2ed2d6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:42.197877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c79238ef-e74b-4475-ac57-a6969d2ed2d6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:42.347704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c79238ef-e74b-4475-ac57-a6969d2ed2d6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:42.357962 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c79238ef-e74b-4475-ac57-a6969d2ed2d6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1522 microversion: 2.1 time: 0.174680 Sep 07 13:35:42.358371 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3437/6845] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:42 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:43.382752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ce82f731-58bf-4e28-8027-9110bd3ba535 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:43.383398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ce82f731-58bf-4e28-8027-9110bd3ba535 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:43.391222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce82f731-58bf-4e28-8027-9110bd3ba535 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:43.391724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce82f731-58bf-4e28-8027-9110bd3ba535 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:43.392176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce82f731-58bf-4e28-8027-9110bd3ba535 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:43.392880 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce82f731-58bf-4e28-8027-9110bd3ba535 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:43.393372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce82f731-58bf-4e28-8027-9110bd3ba535 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:43.393836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce82f731-58bf-4e28-8027-9110bd3ba535 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:43.543355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ce82f731-58bf-4e28-8027-9110bd3ba535 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:43.554775 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ce82f731-58bf-4e28-8027-9110bd3ba535 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1522 microversion: 2.1 time: 0.176076 Sep 07 13:35:43.555394 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3409/6846] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:43 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:44.581003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d1ce4879-eab2-45be-9f87-b463a0314925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:44.581657 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d1ce4879-eab2-45be-9f87-b463a0314925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:44.592811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1ce4879-eab2-45be-9f87-b463a0314925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:44.593651 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1ce4879-eab2-45be-9f87-b463a0314925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:44.594256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1ce4879-eab2-45be-9f87-b463a0314925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:44.595312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1ce4879-eab2-45be-9f87-b463a0314925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:44.595969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1ce4879-eab2-45be-9f87-b463a0314925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:44.596525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d1ce4879-eab2-45be-9f87-b463a0314925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:44.739688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d1ce4879-eab2-45be-9f87-b463a0314925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:44.747793 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d1ce4879-eab2-45be-9f87-b463a0314925 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1522 microversion: 2.1 time: 0.172513 Sep 07 13:35:44.748394 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3438/6847] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:44 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:45.774051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6c2ddc01-067a-4aeb-ab71-f4a2d81b4a85 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:45.774659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6c2ddc01-067a-4aeb-ab71-f4a2d81b4a85 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:45.782311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c2ddc01-067a-4aeb-ab71-f4a2d81b4a85 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:45.782806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c2ddc01-067a-4aeb-ab71-f4a2d81b4a85 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:45.783243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c2ddc01-067a-4aeb-ab71-f4a2d81b4a85 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:45.783961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c2ddc01-067a-4aeb-ab71-f4a2d81b4a85 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:45.784410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c2ddc01-067a-4aeb-ab71-f4a2d81b4a85 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:45.785124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c2ddc01-067a-4aeb-ab71-f4a2d81b4a85 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:45.930983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6c2ddc01-067a-4aeb-ab71-f4a2d81b4a85 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:45.939596 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6c2ddc01-067a-4aeb-ab71-f4a2d81b4a85 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1522 microversion: 2.1 time: 0.170009 Sep 07 13:35:45.940194 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3410/6848] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:45 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:46.964033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-68d16d96-fc1c-4cd7-8e63-9f450e70b3ee tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:46.965083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-68d16d96-fc1c-4cd7-8e63-9f450e70b3ee tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:46.972599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68d16d96-fc1c-4cd7-8e63-9f450e70b3ee tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:46.973107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68d16d96-fc1c-4cd7-8e63-9f450e70b3ee tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:46.973584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68d16d96-fc1c-4cd7-8e63-9f450e70b3ee tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:46.974309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68d16d96-fc1c-4cd7-8e63-9f450e70b3ee tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:46.974779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68d16d96-fc1c-4cd7-8e63-9f450e70b3ee tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:46.975215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68d16d96-fc1c-4cd7-8e63-9f450e70b3ee tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:47.116491 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-68d16d96-fc1c-4cd7-8e63-9f450e70b3ee tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:47.124847 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-68d16d96-fc1c-4cd7-8e63-9f450e70b3ee tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1522 microversion: 2.1 time: 0.164707 Sep 07 13:35:47.125424 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3439/6849] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:46 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:48.148842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-08ec2ce7-4c89-48e6-9470-6623ec6d2234 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:48.149470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-08ec2ce7-4c89-48e6-9470-6623ec6d2234 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:48.159127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08ec2ce7-4c89-48e6-9470-6623ec6d2234 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:48.159624 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08ec2ce7-4c89-48e6-9470-6623ec6d2234 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:48.160397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08ec2ce7-4c89-48e6-9470-6623ec6d2234 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:48.161421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08ec2ce7-4c89-48e6-9470-6623ec6d2234 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:48.161969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08ec2ce7-4c89-48e6-9470-6623ec6d2234 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:48.162564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08ec2ce7-4c89-48e6-9470-6623ec6d2234 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:48.323531 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-08ec2ce7-4c89-48e6-9470-6623ec6d2234 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:48.332997 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-08ec2ce7-4c89-48e6-9470-6623ec6d2234 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1522 microversion: 2.1 time: 0.188045 Sep 07 13:35:48.333877 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3411/6850] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:48 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:49.357592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-003ff524-f94a-4606-8025-4e14b75138f0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:49.358181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-003ff524-f94a-4606-8025-4e14b75138f0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:49.368607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-003ff524-f94a-4606-8025-4e14b75138f0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:49.369463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-003ff524-f94a-4606-8025-4e14b75138f0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:49.370219 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-003ff524-f94a-4606-8025-4e14b75138f0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:49.371783 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-003ff524-f94a-4606-8025-4e14b75138f0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:49.372449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-003ff524-f94a-4606-8025-4e14b75138f0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:49.373166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-003ff524-f94a-4606-8025-4e14b75138f0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:49.518384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-003ff524-f94a-4606-8025-4e14b75138f0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:49.528087 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-003ff524-f94a-4606-8025-4e14b75138f0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1522 microversion: 2.1 time: 0.174385 Sep 07 13:35:49.528687 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3440/6851] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:49 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:50.558412 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9be87b3e-3e36-45f6-ab72-8db56ab2d6a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:50.559022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9be87b3e-3e36-45f6-ab72-8db56ab2d6a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:50.566445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9be87b3e-3e36-45f6-ab72-8db56ab2d6a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:50.566989 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9be87b3e-3e36-45f6-ab72-8db56ab2d6a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:50.567464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9be87b3e-3e36-45f6-ab72-8db56ab2d6a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:50.568178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9be87b3e-3e36-45f6-ab72-8db56ab2d6a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:50.568607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9be87b3e-3e36-45f6-ab72-8db56ab2d6a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:50.568997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9be87b3e-3e36-45f6-ab72-8db56ab2d6a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:50.712055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9be87b3e-3e36-45f6-ab72-8db56ab2d6a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:50.720483 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9be87b3e-3e36-45f6-ab72-8db56ab2d6a0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1522 microversion: 2.1 time: 0.166078 Sep 07 13:35:50.721078 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3412/6852] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:50 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:51.744670 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7c85ebef-ad2e-4aae-a8c4-9a5aa58a65c8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:51.745291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7c85ebef-ad2e-4aae-a8c4-9a5aa58a65c8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:51.752940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c85ebef-ad2e-4aae-a8c4-9a5aa58a65c8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:51.753467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c85ebef-ad2e-4aae-a8c4-9a5aa58a65c8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:51.753970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c85ebef-ad2e-4aae-a8c4-9a5aa58a65c8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:51.754690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c85ebef-ad2e-4aae-a8c4-9a5aa58a65c8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:51.755164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c85ebef-ad2e-4aae-a8c4-9a5aa58a65c8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:51.755606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7c85ebef-ad2e-4aae-a8c4-9a5aa58a65c8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:51.912098 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7c85ebef-ad2e-4aae-a8c4-9a5aa58a65c8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:51.921634 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7c85ebef-ad2e-4aae-a8c4-9a5aa58a65c8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1522 microversion: 2.1 time: 0.181020 Sep 07 13:35:51.922234 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3441/6853] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:51 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:52.946125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-321c01e0-892f-42a0-bd21-a4523069e2fd tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:52.946718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-321c01e0-892f-42a0-bd21-a4523069e2fd tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:52.954258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-321c01e0-892f-42a0-bd21-a4523069e2fd tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:52.954717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-321c01e0-892f-42a0-bd21-a4523069e2fd tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:52.955149 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-321c01e0-892f-42a0-bd21-a4523069e2fd tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:52.955942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-321c01e0-892f-42a0-bd21-a4523069e2fd tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:52.956391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-321c01e0-892f-42a0-bd21-a4523069e2fd tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:52.956813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-321c01e0-892f-42a0-bd21-a4523069e2fd tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:53.104844 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-321c01e0-892f-42a0-bd21-a4523069e2fd tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:53.112775 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-321c01e0-892f-42a0-bd21-a4523069e2fd tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1522 microversion: 2.1 time: 0.171125 Sep 07 13:35:53.113587 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3413/6854] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:52 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:54.137003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-399132cc-7d6e-4296-aee3-7afdb1aba542 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:54.137746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-399132cc-7d6e-4296-aee3-7afdb1aba542 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:54.144798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-399132cc-7d6e-4296-aee3-7afdb1aba542 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:54.145308 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-399132cc-7d6e-4296-aee3-7afdb1aba542 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:54.145767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-399132cc-7d6e-4296-aee3-7afdb1aba542 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:54.146501 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-399132cc-7d6e-4296-aee3-7afdb1aba542 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:54.146969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-399132cc-7d6e-4296-aee3-7afdb1aba542 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:54.147406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-399132cc-7d6e-4296-aee3-7afdb1aba542 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:54.284933 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-399132cc-7d6e-4296-aee3-7afdb1aba542 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:54.293013 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-399132cc-7d6e-4296-aee3-7afdb1aba542 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1522 microversion: 2.1 time: 0.160430 Sep 07 13:35:54.293583 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3442/6855] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:54 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:55.325107 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-396a0c67-6814-44dd-b751-bf0f7ce87a9b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:55.325716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-396a0c67-6814-44dd-b751-bf0f7ce87a9b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:55.333007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-396a0c67-6814-44dd-b751-bf0f7ce87a9b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:55.333537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-396a0c67-6814-44dd-b751-bf0f7ce87a9b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:55.333975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-396a0c67-6814-44dd-b751-bf0f7ce87a9b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:55.334818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-396a0c67-6814-44dd-b751-bf0f7ce87a9b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:55.335362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-396a0c67-6814-44dd-b751-bf0f7ce87a9b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:55.335753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-396a0c67-6814-44dd-b751-bf0f7ce87a9b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:55.487297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-396a0c67-6814-44dd-b751-bf0f7ce87a9b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:55.495995 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-396a0c67-6814-44dd-b751-bf0f7ce87a9b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1522 microversion: 2.1 time: 0.174881 Sep 07 13:35:55.496634 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3414/6856] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:55 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:56.525158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-87cf1542-e3d6-4c49-9e37-4b2dde366fe7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:56.527250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-87cf1542-e3d6-4c49-9e37-4b2dde366fe7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:56.536508 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87cf1542-e3d6-4c49-9e37-4b2dde366fe7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:56.537027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87cf1542-e3d6-4c49-9e37-4b2dde366fe7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:56.537512 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87cf1542-e3d6-4c49-9e37-4b2dde366fe7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:56.538250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87cf1542-e3d6-4c49-9e37-4b2dde366fe7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:56.538742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87cf1542-e3d6-4c49-9e37-4b2dde366fe7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:56.539178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87cf1542-e3d6-4c49-9e37-4b2dde366fe7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:56.683549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-87cf1542-e3d6-4c49-9e37-4b2dde366fe7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:56.692237 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-87cf1542-e3d6-4c49-9e37-4b2dde366fe7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1522 microversion: 2.1 time: 0.174856 Sep 07 13:35:56.692834 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3443/6857] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:56 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:57.720548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b69bc823-302e-459e-ac7d-fdce43f2bf2c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:57.721158 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b69bc823-302e-459e-ac7d-fdce43f2bf2c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:57.728801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b69bc823-302e-459e-ac7d-fdce43f2bf2c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:57.729289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b69bc823-302e-459e-ac7d-fdce43f2bf2c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:57.729758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b69bc823-302e-459e-ac7d-fdce43f2bf2c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:57.730471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b69bc823-302e-459e-ac7d-fdce43f2bf2c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:57.730928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b69bc823-302e-459e-ac7d-fdce43f2bf2c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:57.731353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b69bc823-302e-459e-ac7d-fdce43f2bf2c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:57.904222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b69bc823-302e-459e-ac7d-fdce43f2bf2c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:57.909190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:35:57.915498 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b69bc823-302e-459e-ac7d-fdce43f2bf2c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1522 microversion: 2.1 time: 0.201495 Sep 07 13:35:57.916100 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3415/6858] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:57 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:35:58.940158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-17ff4379-eee0-42a1-9c76-a7c4257558cb tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:35:58.941072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-17ff4379-eee0-42a1-9c76-a7c4257558cb tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:35:58.949863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17ff4379-eee0-42a1-9c76-a7c4257558cb tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:58.950526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17ff4379-eee0-42a1-9c76-a7c4257558cb tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:58.951024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17ff4379-eee0-42a1-9c76-a7c4257558cb tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:58.951753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17ff4379-eee0-42a1-9c76-a7c4257558cb tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:35:58.952263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17ff4379-eee0-42a1-9c76-a7c4257558cb tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:35:58.952716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17ff4379-eee0-42a1-9c76-a7c4257558cb tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:35:59.110995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-17ff4379-eee0-42a1-9c76-a7c4257558cb tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:35:59.121959 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-17ff4379-eee0-42a1-9c76-a7c4257558cb tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1522 microversion: 2.1 time: 0.186239 Sep 07 13:35:59.122729 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3444/6859] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:35:58 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:00.154025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-11092cab-876e-45c9-afac-f9eadc5a7017 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:00.154556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-11092cab-876e-45c9-afac-f9eadc5a7017 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:00.163056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11092cab-876e-45c9-afac-f9eadc5a7017 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:00.163528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11092cab-876e-45c9-afac-f9eadc5a7017 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:00.163969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11092cab-876e-45c9-afac-f9eadc5a7017 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:00.164654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11092cab-876e-45c9-afac-f9eadc5a7017 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:00.165106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11092cab-876e-45c9-afac-f9eadc5a7017 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:00.165567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-11092cab-876e-45c9-afac-f9eadc5a7017 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:00.302469 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-11092cab-876e-45c9-afac-f9eadc5a7017 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:00.311740 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-11092cab-876e-45c9-afac-f9eadc5a7017 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1522 microversion: 2.1 time: 0.161988 Sep 07 13:36:00.312377 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3416/6860] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:00 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:01.338021 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3b99b1c1-f813-4f7e-adbb-568410e0e7a2 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:01.338575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3b99b1c1-f813-4f7e-adbb-568410e0e7a2 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:01.346856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b99b1c1-f813-4f7e-adbb-568410e0e7a2 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:01.347359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b99b1c1-f813-4f7e-adbb-568410e0e7a2 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:01.347821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b99b1c1-f813-4f7e-adbb-568410e0e7a2 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:01.348539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b99b1c1-f813-4f7e-adbb-568410e0e7a2 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:01.349019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b99b1c1-f813-4f7e-adbb-568410e0e7a2 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:01.349464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3b99b1c1-f813-4f7e-adbb-568410e0e7a2 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:01.502073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3b99b1c1-f813-4f7e-adbb-568410e0e7a2 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:01.511529 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3b99b1c1-f813-4f7e-adbb-568410e0e7a2 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1522 microversion: 2.1 time: 0.179208 Sep 07 13:36:01.512154 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3445/6861] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:01 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:36:02.538757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-08548616-c2b4-468e-9355-270754b819fe tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:02.539408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-08548616-c2b4-468e-9355-270754b819fe tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:02.546813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08548616-c2b4-468e-9355-270754b819fe tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:02.547336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08548616-c2b4-468e-9355-270754b819fe tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:02.547752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08548616-c2b4-468e-9355-270754b819fe tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:02.548454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08548616-c2b4-468e-9355-270754b819fe tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:02.548909 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08548616-c2b4-468e-9355-270754b819fe tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:02.549334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08548616-c2b4-468e-9355-270754b819fe tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:02.694397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-08548616-c2b4-468e-9355-270754b819fe tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:02.702418 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-08548616-c2b4-468e-9355-270754b819fe tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1522 microversion: 2.1 time: 0.168660 Sep 07 13:36:02.702980 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3417/6862] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:02 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:03.726841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-64c999a7-49c2-4f7f-b2c5-52ea64bca496 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:03.727470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-64c999a7-49c2-4f7f-b2c5-52ea64bca496 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:03.734904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64c999a7-49c2-4f7f-b2c5-52ea64bca496 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:03.735432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64c999a7-49c2-4f7f-b2c5-52ea64bca496 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:03.735879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64c999a7-49c2-4f7f-b2c5-52ea64bca496 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:03.736629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64c999a7-49c2-4f7f-b2c5-52ea64bca496 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:03.737115 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64c999a7-49c2-4f7f-b2c5-52ea64bca496 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:03.737606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64c999a7-49c2-4f7f-b2c5-52ea64bca496 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:03.740347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:03.898594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-64c999a7-49c2-4f7f-b2c5-52ea64bca496 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:03.909117 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-64c999a7-49c2-4f7f-b2c5-52ea64bca496 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1522 microversion: 2.1 time: 0.186264 Sep 07 13:36:03.909930 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3446/6863] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:03 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:04.934016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7e149b52-8a98-4a6c-a17d-58b0cb3ad916 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:04.934720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7e149b52-8a98-4a6c-a17d-58b0cb3ad916 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:04.944315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e149b52-8a98-4a6c-a17d-58b0cb3ad916 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:04.944805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e149b52-8a98-4a6c-a17d-58b0cb3ad916 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:04.945247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e149b52-8a98-4a6c-a17d-58b0cb3ad916 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:04.946002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e149b52-8a98-4a6c-a17d-58b0cb3ad916 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:04.946476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e149b52-8a98-4a6c-a17d-58b0cb3ad916 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:04.946975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e149b52-8a98-4a6c-a17d-58b0cb3ad916 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:05.107116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7e149b52-8a98-4a6c-a17d-58b0cb3ad916 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:05.117309 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7e149b52-8a98-4a6c-a17d-58b0cb3ad916 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1522 microversion: 2.1 time: 0.187411 Sep 07 13:36:05.117939 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3418/6864] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:04 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:06.141303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-50b72bec-83cd-449b-9e6e-a4b15369b426 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:06.142030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-50b72bec-83cd-449b-9e6e-a4b15369b426 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:06.144877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=32 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:06.150834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50b72bec-83cd-449b-9e6e-a4b15369b426 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:06.151431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50b72bec-83cd-449b-9e6e-a4b15369b426 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:06.151812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50b72bec-83cd-449b-9e6e-a4b15369b426 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:06.152538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50b72bec-83cd-449b-9e6e-a4b15369b426 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:06.153015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50b72bec-83cd-449b-9e6e-a4b15369b426 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:06.153444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50b72bec-83cd-449b-9e6e-a4b15369b426 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:06.291789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-50b72bec-83cd-449b-9e6e-a4b15369b426 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:06.300679 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-50b72bec-83cd-449b-9e6e-a4b15369b426 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1522 microversion: 2.1 time: 0.163396 Sep 07 13:36:06.301259 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3447/6865] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:06 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:07.333045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-24b75207-0c93-4ef4-b611-b879c8dd439d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:07.333712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-24b75207-0c93-4ef4-b611-b879c8dd439d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:07.336442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=36 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:07.342424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24b75207-0c93-4ef4-b611-b879c8dd439d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:07.342911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24b75207-0c93-4ef4-b611-b879c8dd439d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:07.343350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24b75207-0c93-4ef4-b611-b879c8dd439d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:07.344048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24b75207-0c93-4ef4-b611-b879c8dd439d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:07.344511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24b75207-0c93-4ef4-b611-b879c8dd439d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:07.344928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24b75207-0c93-4ef4-b611-b879c8dd439d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:07.490838 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-24b75207-0c93-4ef4-b611-b879c8dd439d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:07.499010 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-24b75207-0c93-4ef4-b611-b879c8dd439d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1522 microversion: 2.1 time: 0.171670 Sep 07 13:36:07.499617 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3419/6866] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:07 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:08.524953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c19bdcc0-c8be-4bfa-a809-1d6f63c73db6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:08.525583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c19bdcc0-c8be-4bfa-a809-1d6f63c73db6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:08.533088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c19bdcc0-c8be-4bfa-a809-1d6f63c73db6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:08.533631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c19bdcc0-c8be-4bfa-a809-1d6f63c73db6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:08.534097 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c19bdcc0-c8be-4bfa-a809-1d6f63c73db6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:08.534830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c19bdcc0-c8be-4bfa-a809-1d6f63c73db6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:08.535304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c19bdcc0-c8be-4bfa-a809-1d6f63c73db6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:08.535766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c19bdcc0-c8be-4bfa-a809-1d6f63c73db6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:08.699064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c19bdcc0-c8be-4bfa-a809-1d6f63c73db6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:08.710943 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c19bdcc0-c8be-4bfa-a809-1d6f63c73db6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1522 microversion: 2.1 time: 0.190176 Sep 07 13:36:08.711607 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3448/6867] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:08 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:09.417504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-51b8e2cc-27a5-4838-8f8e-09e57929f690 req-9163c1d4-c159-4a35-ac5f-64d30dda1eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "135649d7-e74d-4676-a1bf-4d0d8ebd873c", "name": "network-vif-unplugged", "status": "completed", "tag": "3a160f80-1ce5-450c-9771-7687472dcc1e"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:36:09.429111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-51b8e2cc-27a5-4838-8f8e-09e57929f690 req-9163c1d4-c159-4a35-ac5f-64d30dda1eb7 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:09.429947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-51b8e2cc-27a5-4838-8f8e-09e57929f690 req-9163c1d4-c159-4a35-ac5f-64d30dda1eb7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:09.430570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-51b8e2cc-27a5-4838-8f8e-09e57929f690 req-9163c1d4-c159-4a35-ac5f-64d30dda1eb7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:09.448928 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-51b8e2cc-27a5-4838-8f8e-09e57929f690 req-9163c1d4-c159-4a35-ac5f-64d30dda1eb7 service nova] Creating event network-vif-unplugged:3a160f80-1ce5-450c-9771-7687472dcc1e for instance 135649d7-e74d-4676-a1bf-4d0d8ebd873c on n-h2-852087-9 Sep 07 13:36:09.457707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-51b8e2cc-27a5-4838-8f8e-09e57929f690 req-9163c1d4-c159-4a35-ac5f-64d30dda1eb7 service nova] Instance 135649d7-e74d-4676-a1bf-4d0d8ebd873c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:36:09.470788 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-51b8e2cc-27a5-4838-8f8e-09e57929f690 req-9163c1d4-c159-4a35-ac5f-64d30dda1eb7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056736 Sep 07 13:36:09.471518 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3420/6868] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:36:09.735473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7a7ff1bc-38af-4c5d-96f5-1de5277f6f99 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:09.736116 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7a7ff1bc-38af-4c5d-96f5-1de5277f6f99 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:09.743401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a7ff1bc-38af-4c5d-96f5-1de5277f6f99 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:09.743918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a7ff1bc-38af-4c5d-96f5-1de5277f6f99 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:09.745338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a7ff1bc-38af-4c5d-96f5-1de5277f6f99 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:09.746461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a7ff1bc-38af-4c5d-96f5-1de5277f6f99 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:09.746969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a7ff1bc-38af-4c5d-96f5-1de5277f6f99 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:09.747411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7a7ff1bc-38af-4c5d-96f5-1de5277f6f99 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:09.889060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7a7ff1bc-38af-4c5d-96f5-1de5277f6f99 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:09.897582 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7a7ff1bc-38af-4c5d-96f5-1de5277f6f99 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1521 microversion: 2.1 time: 0.166021 Sep 07 13:36:09.898180 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3449/6869] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:09 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:10.922681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c613f915-27c4-4518-a194-9a48d8d230f7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:10.923392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c613f915-27c4-4518-a194-9a48d8d230f7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:10.930976 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c613f915-27c4-4518-a194-9a48d8d230f7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:10.931471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c613f915-27c4-4518-a194-9a48d8d230f7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:10.931917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c613f915-27c4-4518-a194-9a48d8d230f7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:10.932646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c613f915-27c4-4518-a194-9a48d8d230f7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:10.933102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c613f915-27c4-4518-a194-9a48d8d230f7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:10.933541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c613f915-27c4-4518-a194-9a48d8d230f7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:11.085195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c613f915-27c4-4518-a194-9a48d8d230f7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:11.094021 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c613f915-27c4-4518-a194-9a48d8d230f7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1519 microversion: 2.1 time: 0.175713 Sep 07 13:36:11.094625 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3421/6870] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:10 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:11.499038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-140084d3-a9a8-48d6-a059-002f3e42bfb5 req-539d96c3-b936-4c6a-8f36-90121cfd4a27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "135649d7-e74d-4676-a1bf-4d0d8ebd873c", "tag": "3a160f80-1ce5-450c-9771-7687472dcc1e"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:36:11.510207 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-140084d3-a9a8-48d6-a059-002f3e42bfb5 req-539d96c3-b936-4c6a-8f36-90121cfd4a27 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:11.510722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-140084d3-a9a8-48d6-a059-002f3e42bfb5 req-539d96c3-b936-4c6a-8f36-90121cfd4a27 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:11.511182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-140084d3-a9a8-48d6-a059-002f3e42bfb5 req-539d96c3-b936-4c6a-8f36-90121cfd4a27 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:11.524459 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-140084d3-a9a8-48d6-a059-002f3e42bfb5 req-539d96c3-b936-4c6a-8f36-90121cfd4a27 service nova] Creating event network-changed:3a160f80-1ce5-450c-9771-7687472dcc1e for instance 135649d7-e74d-4676-a1bf-4d0d8ebd873c on n-h2-852087-9 Sep 07 13:36:11.530241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-140084d3-a9a8-48d6-a059-002f3e42bfb5 req-539d96c3-b936-4c6a-8f36-90121cfd4a27 service nova] Instance 135649d7-e74d-4676-a1bf-4d0d8ebd873c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:36:11.544173 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-140084d3-a9a8-48d6-a059-002f3e42bfb5 req-539d96c3-b936-4c6a-8f36-90121cfd4a27 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048637 Sep 07 13:36:11.545017 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3450/6871] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:36:12.118094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-87f9e662-1ce1-4f8f-9457-a44f100d6a01 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:12.118701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-87f9e662-1ce1-4f8f-9457-a44f100d6a01 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:12.125773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87f9e662-1ce1-4f8f-9457-a44f100d6a01 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:12.126460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87f9e662-1ce1-4f8f-9457-a44f100d6a01 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:12.126904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87f9e662-1ce1-4f8f-9457-a44f100d6a01 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:12.127600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87f9e662-1ce1-4f8f-9457-a44f100d6a01 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:12.128073 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87f9e662-1ce1-4f8f-9457-a44f100d6a01 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:12.128506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87f9e662-1ce1-4f8f-9457-a44f100d6a01 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:12.265678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-87f9e662-1ce1-4f8f-9457-a44f100d6a01 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:12.274020 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-87f9e662-1ce1-4f8f-9457-a44f100d6a01 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1516 microversion: 2.1 time: 0.159791 Sep 07 13:36:12.274647 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3422/6872] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:12 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:12.299083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5c835550-1881-4c84-b410-cb4ea22790c8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:36:12.299825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5c835550-1881-4c84-b410-cb4ea22790c8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:12.306710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c835550-1881-4c84-b410-cb4ea22790c8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:12.307241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c835550-1881-4c84-b410-cb4ea22790c8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:12.307693 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c835550-1881-4c84-b410-cb4ea22790c8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:12.308404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c835550-1881-4c84-b410-cb4ea22790c8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:12.308905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c835550-1881-4c84-b410-cb4ea22790c8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:12.309348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5c835550-1881-4c84-b410-cb4ea22790c8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:12.374445 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5c835550-1881-4c84-b410-cb4ea22790c8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "POST /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c/action" status: 204 len: 0 microversion: 2.1 time: 0.079903 Sep 07 13:36:12.375994 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3451/6873] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:36:12 2022] POST /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c/action => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:36:12.385223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c751b266-7930-4384-92ff-0caade33582c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:12.386510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c751b266-7930-4384-92ff-0caade33582c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:12.394639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c751b266-7930-4384-92ff-0caade33582c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:12.395426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c751b266-7930-4384-92ff-0caade33582c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:12.395698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c751b266-7930-4384-92ff-0caade33582c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:12.396576 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c751b266-7930-4384-92ff-0caade33582c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:12.397158 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c751b266-7930-4384-92ff-0caade33582c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:12.397599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c751b266-7930-4384-92ff-0caade33582c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:12.592590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c751b266-7930-4384-92ff-0caade33582c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:12.602033 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c751b266-7930-4384-92ff-0caade33582c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1516 microversion: 2.1 time: 0.221162 Sep 07 13:36:12.602546 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3423/6874] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:12 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1516 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:13.626568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ce91f36-d970-4ca4-b263-b2f165c275d7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:13.627404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4ce91f36-d970-4ca4-b263-b2f165c275d7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:13.635334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ce91f36-d970-4ca4-b263-b2f165c275d7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:13.635857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ce91f36-d970-4ca4-b263-b2f165c275d7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:13.636317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ce91f36-d970-4ca4-b263-b2f165c275d7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:13.637040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ce91f36-d970-4ca4-b263-b2f165c275d7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:13.637534 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ce91f36-d970-4ca4-b263-b2f165c275d7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:13.637998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4ce91f36-d970-4ca4-b263-b2f165c275d7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:13.794524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4ce91f36-d970-4ca4-b263-b2f165c275d7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:13.803050 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ce91f36-d970-4ca4-b263-b2f165c275d7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1516 microversion: 2.1 time: 0.180936 Sep 07 13:36:13.803643 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3452/6875] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:13 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:14.570930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-bd5d2b15-d978-484a-8884-e4a87ebfc1ca req-ff2d36c7-537e-488b-b217-898937953844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "135649d7-e74d-4676-a1bf-4d0d8ebd873c", "name": "network-vif-plugged", "status": "completed", "tag": "3a160f80-1ce5-450c-9771-7687472dcc1e"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:36:14.582668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-bd5d2b15-d978-484a-8884-e4a87ebfc1ca req-ff2d36c7-537e-488b-b217-898937953844 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:14.583165 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-bd5d2b15-d978-484a-8884-e4a87ebfc1ca req-ff2d36c7-537e-488b-b217-898937953844 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:14.583597 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-bd5d2b15-d978-484a-8884-e4a87ebfc1ca req-ff2d36c7-537e-488b-b217-898937953844 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:14.602566 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-bd5d2b15-d978-484a-8884-e4a87ebfc1ca req-ff2d36c7-537e-488b-b217-898937953844 service nova] Creating event network-vif-plugged:3a160f80-1ce5-450c-9771-7687472dcc1e for instance 135649d7-e74d-4676-a1bf-4d0d8ebd873c on n-h2-852087-9 Sep 07 13:36:14.607824 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-bd5d2b15-d978-484a-8884-e4a87ebfc1ca req-ff2d36c7-537e-488b-b217-898937953844 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041472 Sep 07 13:36:14.608687 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3424/6876] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:36:14.827421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-54a53b1e-d21d-493e-9795-803f5f2a3ff0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:14.828351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-54a53b1e-d21d-493e-9795-803f5f2a3ff0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:14.835638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54a53b1e-d21d-493e-9795-803f5f2a3ff0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:14.836139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54a53b1e-d21d-493e-9795-803f5f2a3ff0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:14.836596 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54a53b1e-d21d-493e-9795-803f5f2a3ff0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:14.837287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54a53b1e-d21d-493e-9795-803f5f2a3ff0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:14.837788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54a53b1e-d21d-493e-9795-803f5f2a3ff0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:14.838228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54a53b1e-d21d-493e-9795-803f5f2a3ff0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:14.983227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-54a53b1e-d21d-493e-9795-803f5f2a3ff0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:14.991755 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-54a53b1e-d21d-493e-9795-803f5f2a3ff0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1508 microversion: 2.1 time: 0.168680 Sep 07 13:36:14.992339 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3453/6877] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:14 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:15.014887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1eb5151e-a7c5-4c0e-a7a9-b827c0276a07 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:15.015623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1eb5151e-a7c5-4c0e-a7a9-b827c0276a07 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:15.022448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eb5151e-a7c5-4c0e-a7a9-b827c0276a07 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:15.022939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eb5151e-a7c5-4c0e-a7a9-b827c0276a07 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:15.023381 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eb5151e-a7c5-4c0e-a7a9-b827c0276a07 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:15.024088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eb5151e-a7c5-4c0e-a7a9-b827c0276a07 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:15.024541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eb5151e-a7c5-4c0e-a7a9-b827c0276a07 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:15.024965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1eb5151e-a7c5-4c0e-a7a9-b827c0276a07 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:15.168977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1eb5151e-a7c5-4c0e-a7a9-b827c0276a07 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:15.177309 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1eb5151e-a7c5-4c0e-a7a9-b827c0276a07 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1508 microversion: 2.1 time: 0.166629 Sep 07 13:36:15.178056 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3425/6878] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:15 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:15.203961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-19e5780d-ab04-4cc0-999d-2c84499fd86f tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Action: 'create', calling method: .version_select at 0x7fc4189fa550>, body: {"keypair": {"name": "tempest-keypair-270809539", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzOkWdUh4UCX4TG1xi56vJA3MMyhb0mQhRR84m0VKHADQZ+64qR82fzIdzbKsR7YIySKYNpOJzwF/wkUzlm9jVlaNx9mHBuTAxuXf+aM5A0/fgsm9d/thXZpANnaQ+8Fw=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:36:15.220633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-19e5780d-ab04-4cc0-999d-2c84499fd86f tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Getting quotas for project d98fd3224d1541babd9ee0f9fc0a4fca. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:36:15.226499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-19e5780d-ab04-4cc0-999d-2c84499fd86f tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Getting quotas for user 533e322376994c8a85c8e7696f4f974f and project d98fd3224d1541babd9ee0f9fc0a4fca. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:36:15.256627 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-19e5780d-ab04-4cc0-999d-2c84499fd86f tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056795 Sep 07 13:36:15.257257 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3454/6879] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 13:36:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:36:16.722075 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3699b396-dc3d-470e-b12c-565d5ffd81dc tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:16.722711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3699b396-dc3d-470e-b12c-565d5ffd81dc tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:16.729832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3699b396-dc3d-470e-b12c-565d5ffd81dc tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:16.730334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3699b396-dc3d-470e-b12c-565d5ffd81dc tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:16.730767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3699b396-dc3d-470e-b12c-565d5ffd81dc tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:16.731444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3699b396-dc3d-470e-b12c-565d5ffd81dc tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:16.731891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3699b396-dc3d-470e-b12c-565d5ffd81dc tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:16.732290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3699b396-dc3d-470e-b12c-565d5ffd81dc tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:16.875836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3699b396-dc3d-470e-b12c-565d5ffd81dc tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:16.884538 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3699b396-dc3d-470e-b12c-565d5ffd81dc tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 200 len: 1508 microversion: 2.1 time: 0.166417 Sep 07 13:36:16.885251 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3426/6880] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:16 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:16.908727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9e11785b-baea-49d6-9fd3-540cb4f592b6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:16.909229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9e11785b-baea-49d6-9fd3-540cb4f592b6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:16.916579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e11785b-baea-49d6-9fd3-540cb4f592b6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:16.917099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e11785b-baea-49d6-9fd3-540cb4f592b6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:16.917594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e11785b-baea-49d6-9fd3-540cb4f592b6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:16.918967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e11785b-baea-49d6-9fd3-540cb4f592b6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:16.918967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e11785b-baea-49d6-9fd3-540cb4f592b6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:16.919372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9e11785b-baea-49d6-9fd3-540cb4f592b6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:16.948145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9e11785b-baea-49d6-9fd3-540cb4f592b6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:36:17.031272 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9e11785b-baea-49d6-9fd3-540cb4f592b6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "DELETE /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 204 len: 0 microversion: 2.1 time: 0.127338 Sep 07 13:36:17.032234 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3455/6881] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:36:16 2022] DELETE /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:36:17.135973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5fd22fba-af0e-41f0-b63c-f51a0aa149fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-349574854", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "b77cc80a-dc93-4840-b01d-34182ecc44e0"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:36:17.201989 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-5fd22fba-af0e-41f0-b63c-f51a0aa149fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] validate_networks() for [('b77cc80a-dc93-4840-b01d-34182ecc44e0', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:36:17.623880 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-5fd22fba-af0e-41f0-b63c-f51a0aa149fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:36:17.624432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-5fd22fba-af0e-41f0-b63c-f51a0aa149fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:36:17.625089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-5fd22fba-af0e-41f0-b63c-f51a0aa149fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:36:17.625511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-5fd22fba-af0e-41f0-b63c-f51a0aa149fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:36:17.626011 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-5fd22fba-af0e-41f0-b63c-f51a0aa149fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:36:17.636583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fd22fba-af0e-41f0-b63c-f51a0aa149fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:17.637069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fd22fba-af0e-41f0-b63c-f51a0aa149fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:17.637512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fd22fba-af0e-41f0-b63c-f51a0aa149fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:17.638268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fd22fba-af0e-41f0-b63c-f51a0aa149fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:17.638726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fd22fba-af0e-41f0-b63c-f51a0aa149fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:17.639152 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5fd22fba-af0e-41f0-b63c-f51a0aa149fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:17.656542 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-5fd22fba-af0e-41f0-b63c-f51a0aa149fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Getting quotas for project d98fd3224d1541babd9ee0f9fc0a4fca. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:36:17.661869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-5fd22fba-af0e-41f0-b63c-f51a0aa149fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Getting quotas for user 533e322376994c8a85c8e7696f4f974f and project d98fd3224d1541babd9ee0f9fc0a4fca. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:36:17.675278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5fd22fba-af0e-41f0-b63c-f51a0aa149fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:36:17.677733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5fd22fba-af0e-41f0-b63c-f51a0aa149fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:36:17.725614 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5fd22fba-af0e-41f0-b63c-f51a0aa149fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596265 Sep 07 13:36:17.726588 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3427/6882] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:36:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:36:17.738335 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2861fef5-7400-4e12-9ae9-b0b98291343d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:17.739055 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2861fef5-7400-4e12-9ae9-b0b98291343d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:17.808245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2861fef5-7400-4e12-9ae9-b0b98291343d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:17.815622 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2861fef5-7400-4e12-9ae9-b0b98291343d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1217 microversion: 2.1 time: 0.081667 Sep 07 13:36:17.816221 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3456/6883] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:17 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:18.841705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ebfe79c4-7d50-4730-97e3-eaf61a60c468 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:18.842305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ebfe79c4-7d50-4730-97e3-eaf61a60c468 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:18.849597 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebfe79c4-7d50-4730-97e3-eaf61a60c468 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:18.850099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebfe79c4-7d50-4730-97e3-eaf61a60c468 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:18.850549 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebfe79c4-7d50-4730-97e3-eaf61a60c468 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:18.851259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebfe79c4-7d50-4730-97e3-eaf61a60c468 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:18.851713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebfe79c4-7d50-4730-97e3-eaf61a60c468 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:18.852143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ebfe79c4-7d50-4730-97e3-eaf61a60c468 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:18.924510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ebfe79c4-7d50-4730-97e3-eaf61a60c468 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:18.932970 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ebfe79c4-7d50-4730-97e3-eaf61a60c468 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1269 microversion: 2.1 time: 0.098038 Sep 07 13:36:18.933693 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3428/6884] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:18 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1269 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:19.134638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-d3a282ba-6713-4944-aac1-740a4f483ce1 req-0f7a6e19-8d6f-454d-b605-566e9c6b6ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "135649d7-e74d-4676-a1bf-4d0d8ebd873c", "name": "network-vif-deleted", "tag": "3a160f80-1ce5-450c-9771-7687472dcc1e"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:36:19.148329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d3a282ba-6713-4944-aac1-740a4f483ce1 req-0f7a6e19-8d6f-454d-b605-566e9c6b6ba5 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:19.149025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d3a282ba-6713-4944-aac1-740a4f483ce1 req-0f7a6e19-8d6f-454d-b605-566e9c6b6ba5 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:19.149597 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d3a282ba-6713-4944-aac1-740a4f483ce1 req-0f7a6e19-8d6f-454d-b605-566e9c6b6ba5 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:19.162107 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-d3a282ba-6713-4944-aac1-740a4f483ce1 req-0f7a6e19-8d6f-454d-b605-566e9c6b6ba5 service nova] Creating event network-vif-deleted:3a160f80-1ce5-450c-9771-7687472dcc1e for instance 135649d7-e74d-4676-a1bf-4d0d8ebd873c on n-h2-852087-9 Sep 07 13:36:19.168126 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-d3a282ba-6713-4944-aac1-740a4f483ce1 req-0f7a6e19-8d6f-454d-b605-566e9c6b6ba5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039401 Sep 07 13:36:19.169276 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3457/6885] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:36:19.957099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cdf4c698-8970-4946-a16e-89e42e3bd5a7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:19.957720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cdf4c698-8970-4946-a16e-89e42e3bd5a7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:19.965444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdf4c698-8970-4946-a16e-89e42e3bd5a7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:19.965977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdf4c698-8970-4946-a16e-89e42e3bd5a7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:19.966427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdf4c698-8970-4946-a16e-89e42e3bd5a7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:19.967107 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdf4c698-8970-4946-a16e-89e42e3bd5a7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:19.967567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdf4c698-8970-4946-a16e-89e42e3bd5a7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:19.968001 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdf4c698-8970-4946-a16e-89e42e3bd5a7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:20.038502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cdf4c698-8970-4946-a16e-89e42e3bd5a7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:20.046673 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cdf4c698-8970-4946-a16e-89e42e3bd5a7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1275 microversion: 2.1 time: 0.093683 Sep 07 13:36:20.047302 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3429/6886] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:19 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1275 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:21.071738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-72855efc-83ef-466a-8185-f4dca517bd54 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:21.072471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-72855efc-83ef-466a-8185-f4dca517bd54 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:21.079201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72855efc-83ef-466a-8185-f4dca517bd54 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:21.079796 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72855efc-83ef-466a-8185-f4dca517bd54 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:21.080251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72855efc-83ef-466a-8185-f4dca517bd54 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:21.080974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72855efc-83ef-466a-8185-f4dca517bd54 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:21.081436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72855efc-83ef-466a-8185-f4dca517bd54 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:21.081926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72855efc-83ef-466a-8185-f4dca517bd54 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:21.205310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9e6f855e-4114-4cdb-87eb-c9b3f7098bc8 req-db17a0a1-880c-4e8d-98eb-febbdb7ea5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8823d302-e05b-4c2b-8756-d56a8381b9fb", "tag": "bf395fd0-74ab-448a-a337-057614373f6c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:36:21.218418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9e6f855e-4114-4cdb-87eb-c9b3f7098bc8 req-db17a0a1-880c-4e8d-98eb-febbdb7ea5f5 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:21.219008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9e6f855e-4114-4cdb-87eb-c9b3f7098bc8 req-db17a0a1-880c-4e8d-98eb-febbdb7ea5f5 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:21.219568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9e6f855e-4114-4cdb-87eb-c9b3f7098bc8 req-db17a0a1-880c-4e8d-98eb-febbdb7ea5f5 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:21.224530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-72855efc-83ef-466a-8185-f4dca517bd54 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:21.232019 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9e6f855e-4114-4cdb-87eb-c9b3f7098bc8 req-db17a0a1-880c-4e8d-98eb-febbdb7ea5f5 service nova] Creating event network-changed:bf395fd0-74ab-448a-a337-057614373f6c for instance 8823d302-e05b-4c2b-8756-d56a8381b9fb on n-h2-852087-9 Sep 07 13:36:21.234822 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-72855efc-83ef-466a-8185-f4dca517bd54 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1317 microversion: 2.1 time: 0.168312 Sep 07 13:36:21.235383 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3458/6887] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:21 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:21.242150 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9e6f855e-4114-4cdb-87eb-c9b3f7098bc8 req-db17a0a1-880c-4e8d-98eb-febbdb7ea5f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040798 Sep 07 13:36:21.242905 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3430/6888] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:36:22.258880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4fcf1b82-e4ec-4800-a8f6-407447676f31 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:22.259447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4fcf1b82-e4ec-4800-a8f6-407447676f31 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:22.266921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fcf1b82-e4ec-4800-a8f6-407447676f31 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:22.267438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fcf1b82-e4ec-4800-a8f6-407447676f31 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:22.267940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fcf1b82-e4ec-4800-a8f6-407447676f31 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:22.268642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fcf1b82-e4ec-4800-a8f6-407447676f31 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:22.269122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fcf1b82-e4ec-4800-a8f6-407447676f31 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:22.269598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4fcf1b82-e4ec-4800-a8f6-407447676f31 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:22.519989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4fcf1b82-e4ec-4800-a8f6-407447676f31 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:22.529523 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4fcf1b82-e4ec-4800-a8f6-407447676f31 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1317 microversion: 2.1 time: 0.274728 Sep 07 13:36:22.530133 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3459/6889] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:22 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:23.555284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2c4428c1-336d-457d-839a-a078342217fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:23.556638 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2c4428c1-336d-457d-839a-a078342217fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:23.564358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c4428c1-336d-457d-839a-a078342217fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:23.564849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c4428c1-336d-457d-839a-a078342217fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:23.565277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c4428c1-336d-457d-839a-a078342217fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:23.565993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c4428c1-336d-457d-839a-a078342217fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:23.566463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c4428c1-336d-457d-839a-a078342217fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:23.566878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c4428c1-336d-457d-839a-a078342217fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:23.761890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2c4428c1-336d-457d-839a-a078342217fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:23.771126 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2c4428c1-336d-457d-839a-a078342217fa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1317 microversion: 2.1 time: 0.222028 Sep 07 13:36:23.771728 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3431/6890] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:23 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:24.804276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9bb52b33-e077-4350-b4b1-c786af19fe57 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:24.805120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9bb52b33-e077-4350-b4b1-c786af19fe57 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:24.815665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bb52b33-e077-4350-b4b1-c786af19fe57 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:24.816487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bb52b33-e077-4350-b4b1-c786af19fe57 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:24.817154 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bb52b33-e077-4350-b4b1-c786af19fe57 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:24.818336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bb52b33-e077-4350-b4b1-c786af19fe57 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:24.819137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bb52b33-e077-4350-b4b1-c786af19fe57 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:24.820365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bb52b33-e077-4350-b4b1-c786af19fe57 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:24.967200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9bb52b33-e077-4350-b4b1-c786af19fe57 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:24.975765 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9bb52b33-e077-4350-b4b1-c786af19fe57 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1317 microversion: 2.1 time: 0.177712 Sep 07 13:36:24.976327 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3460/6891] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:24 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:25.999189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d4015504-2c24-4ffd-ae06-190904311de0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:25.999775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d4015504-2c24-4ffd-ae06-190904311de0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:26.007225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4015504-2c24-4ffd-ae06-190904311de0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:26.007732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4015504-2c24-4ffd-ae06-190904311de0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:26.008259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4015504-2c24-4ffd-ae06-190904311de0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:26.009066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4015504-2c24-4ffd-ae06-190904311de0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:26.009515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4015504-2c24-4ffd-ae06-190904311de0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:26.010131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d4015504-2c24-4ffd-ae06-190904311de0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:26.155927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d4015504-2c24-4ffd-ae06-190904311de0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:26.163992 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d4015504-2c24-4ffd-ae06-190904311de0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1317 microversion: 2.1 time: 0.168849 Sep 07 13:36:26.164585 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3432/6892] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:25 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:26.622856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-777ed7a7-d244-42da-a7a0-b056cccc0ffd req-fb362064-b054-431b-9a61-26f73419ab78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8823d302-e05b-4c2b-8756-d56a8381b9fb", "name": "network-vif-plugged", "status": "completed", "tag": "bf395fd0-74ab-448a-a337-057614373f6c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:36:26.637783 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-777ed7a7-d244-42da-a7a0-b056cccc0ffd req-fb362064-b054-431b-9a61-26f73419ab78 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:26.638516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-777ed7a7-d244-42da-a7a0-b056cccc0ffd req-fb362064-b054-431b-9a61-26f73419ab78 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:26.639016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-777ed7a7-d244-42da-a7a0-b056cccc0ffd req-fb362064-b054-431b-9a61-26f73419ab78 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:26.652619 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-777ed7a7-d244-42da-a7a0-b056cccc0ffd req-fb362064-b054-431b-9a61-26f73419ab78 service nova] Creating event network-vif-plugged:bf395fd0-74ab-448a-a337-057614373f6c for instance 8823d302-e05b-4c2b-8756-d56a8381b9fb on n-h2-852087-9 Sep 07 13:36:26.659085 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-777ed7a7-d244-42da-a7a0-b056cccc0ffd req-fb362064-b054-431b-9a61-26f73419ab78 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040112 Sep 07 13:36:26.659738 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3461/6893] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:36:27.187760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0a0c1a5e-a960-4749-957b-cff33f37f9d0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:27.188432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0a0c1a5e-a960-4749-957b-cff33f37f9d0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:27.195981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a0c1a5e-a960-4749-957b-cff33f37f9d0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:27.196468 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a0c1a5e-a960-4749-957b-cff33f37f9d0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:27.196900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a0c1a5e-a960-4749-957b-cff33f37f9d0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:27.197637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a0c1a5e-a960-4749-957b-cff33f37f9d0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:27.198087 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a0c1a5e-a960-4749-957b-cff33f37f9d0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:27.198509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0a0c1a5e-a960-4749-957b-cff33f37f9d0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:27.646260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:27.668787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:27.701352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0a0c1a5e-a960-4749-957b-cff33f37f9d0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:27.709517 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0a0c1a5e-a960-4749-957b-cff33f37f9d0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1317 microversion: 2.1 time: 0.526084 Sep 07 13:36:27.710105 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3433/6894] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:27 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1317 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:28.730969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:28.735360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-11e0f71b-97c6-424e-afe1-b3c59cb6deb0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:28.736094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-11e0f71b-97c6-424e-afe1-b3c59cb6deb0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:28.743310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11e0f71b-97c6-424e-afe1-b3c59cb6deb0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:28.743806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11e0f71b-97c6-424e-afe1-b3c59cb6deb0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:28.744280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11e0f71b-97c6-424e-afe1-b3c59cb6deb0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:28.744991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11e0f71b-97c6-424e-afe1-b3c59cb6deb0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:28.745468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11e0f71b-97c6-424e-afe1-b3c59cb6deb0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:28.745953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11e0f71b-97c6-424e-afe1-b3c59cb6deb0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:28.889922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-11e0f71b-97c6-424e-afe1-b3c59cb6deb0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:28.898311 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-11e0f71b-97c6-424e-afe1-b3c59cb6deb0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1506 microversion: 2.1 time: 0.169285 Sep 07 13:36:28.898941 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3462/6895] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:28 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:28.921546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fbb29a96-5eff-4342-8689-506f4226be85 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:28.922192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fbb29a96-5eff-4342-8689-506f4226be85 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:28.930379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbb29a96-5eff-4342-8689-506f4226be85 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:28.930379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbb29a96-5eff-4342-8689-506f4226be85 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:28.930632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbb29a96-5eff-4342-8689-506f4226be85 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:28.931373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbb29a96-5eff-4342-8689-506f4226be85 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:28.931844 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbb29a96-5eff-4342-8689-506f4226be85 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:28.932274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbb29a96-5eff-4342-8689-506f4226be85 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:29.072552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fbb29a96-5eff-4342-8689-506f4226be85 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:29.076042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:29.081522 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fbb29a96-5eff-4342-8689-506f4226be85 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1506 microversion: 2.1 time: 0.164077 Sep 07 13:36:29.082116 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3434/6896] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:28 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:29.104893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-166b3323-08fd-48f8-aa3c-1db149ba4cd5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:36:29.107263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-166b3323-08fd-48f8-aa3c-1db149ba4cd5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:29.114227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-166b3323-08fd-48f8-aa3c-1db149ba4cd5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:29.114759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-166b3323-08fd-48f8-aa3c-1db149ba4cd5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:29.115279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-166b3323-08fd-48f8-aa3c-1db149ba4cd5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:29.115998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-166b3323-08fd-48f8-aa3c-1db149ba4cd5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:29.116466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-166b3323-08fd-48f8-aa3c-1db149ba4cd5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:29.116904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-166b3323-08fd-48f8-aa3c-1db149ba4cd5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:29.140529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:29.151213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-166b3323-08fd-48f8-aa3c-1db149ba4cd5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:29.158144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-166b3323-08fd-48f8-aa3c-1db149ba4cd5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Old instance type m1.heat2, new instance type m1.heat {{(pid=122433) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 13:36:29.165461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-166b3323-08fd-48f8-aa3c-1db149ba4cd5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:36:29.165929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-166b3323-08fd-48f8-aa3c-1db149ba4cd5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:36:29.166418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-166b3323-08fd-48f8-aa3c-1db149ba4cd5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:36:29.166841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-166b3323-08fd-48f8-aa3c-1db149ba4cd5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:36:29.167265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-166b3323-08fd-48f8-aa3c-1db149ba4cd5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:36:29.248022 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-166b3323-08fd-48f8-aa3c-1db149ba4cd5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "POST /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb/action" status: 202 len: 0 microversion: 2.1 time: 0.147310 Sep 07 13:36:29.249119 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3463/6897] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:36:29 2022] POST /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:36:29.258334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b802b24b-123e-4edb-ac0a-f2d2d5ec4c5e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:29.258334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b802b24b-123e-4edb-ac0a-f2d2d5ec4c5e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:29.264835 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b802b24b-123e-4edb-ac0a-f2d2d5ec4c5e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:29.265588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b802b24b-123e-4edb-ac0a-f2d2d5ec4c5e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:29.266035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b802b24b-123e-4edb-ac0a-f2d2d5ec4c5e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:29.266765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b802b24b-123e-4edb-ac0a-f2d2d5ec4c5e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:29.267214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b802b24b-123e-4edb-ac0a-f2d2d5ec4c5e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:29.267800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b802b24b-123e-4edb-ac0a-f2d2d5ec4c5e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:29.409881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b802b24b-123e-4edb-ac0a-f2d2d5ec4c5e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:29.418345 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b802b24b-123e-4edb-ac0a-f2d2d5ec4c5e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1513 microversion: 2.1 time: 0.164683 Sep 07 13:36:29.418944 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3435/6898] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:29 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:30.443508 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0e8e4d87-aca9-461e-b0dc-787f82ce0bde tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:30.444353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0e8e4d87-aca9-461e-b0dc-787f82ce0bde tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:30.451358 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e8e4d87-aca9-461e-b0dc-787f82ce0bde tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:30.451880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e8e4d87-aca9-461e-b0dc-787f82ce0bde tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:30.452341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e8e4d87-aca9-461e-b0dc-787f82ce0bde tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:30.453100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e8e4d87-aca9-461e-b0dc-787f82ce0bde tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:30.453622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e8e4d87-aca9-461e-b0dc-787f82ce0bde tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:30.454077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0e8e4d87-aca9-461e-b0dc-787f82ce0bde tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:30.623685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0e8e4d87-aca9-461e-b0dc-787f82ce0bde tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:30.632875 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0e8e4d87-aca9-461e-b0dc-787f82ce0bde tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1513 microversion: 2.1 time: 0.194391 Sep 07 13:36:30.633711 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3464/6899] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:30 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1513 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:31.656397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e6225a49-970b-4674-9f3e-7857dc7a2ca5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:31.657006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e6225a49-970b-4674-9f3e-7857dc7a2ca5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:31.665039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6225a49-970b-4674-9f3e-7857dc7a2ca5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:31.665653 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6225a49-970b-4674-9f3e-7857dc7a2ca5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:31.666029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6225a49-970b-4674-9f3e-7857dc7a2ca5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:31.666678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6225a49-970b-4674-9f3e-7857dc7a2ca5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:31.667136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6225a49-970b-4674-9f3e-7857dc7a2ca5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:31.667551 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6225a49-970b-4674-9f3e-7857dc7a2ca5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:31.808123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e6225a49-970b-4674-9f3e-7857dc7a2ca5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:31.816900 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e6225a49-970b-4674-9f3e-7857dc7a2ca5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1518 microversion: 2.1 time: 0.164231 Sep 07 13:36:31.817579 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3436/6900] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:31 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:32.847166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c12907fd-cfd0-4e81-b32f-576cc63e019c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:32.847706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c12907fd-cfd0-4e81-b32f-576cc63e019c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:32.856941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c12907fd-cfd0-4e81-b32f-576cc63e019c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:32.857892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c12907fd-cfd0-4e81-b32f-576cc63e019c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:32.858692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c12907fd-cfd0-4e81-b32f-576cc63e019c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:32.859574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c12907fd-cfd0-4e81-b32f-576cc63e019c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:32.860193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c12907fd-cfd0-4e81-b32f-576cc63e019c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:32.860992 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c12907fd-cfd0-4e81-b32f-576cc63e019c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:33.016541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c12907fd-cfd0-4e81-b32f-576cc63e019c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:33.025260 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c12907fd-cfd0-4e81-b32f-576cc63e019c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1518 microversion: 2.1 time: 0.182267 Sep 07 13:36:33.025845 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3465/6901] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:32 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1518 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:36:34.048685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-138f7e73-9652-430b-9720-19c154419dc5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:34.049315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-138f7e73-9652-430b-9720-19c154419dc5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:34.057307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-138f7e73-9652-430b-9720-19c154419dc5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:34.057801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-138f7e73-9652-430b-9720-19c154419dc5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:34.058239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-138f7e73-9652-430b-9720-19c154419dc5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:34.058960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-138f7e73-9652-430b-9720-19c154419dc5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:34.059408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-138f7e73-9652-430b-9720-19c154419dc5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:34.059830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-138f7e73-9652-430b-9720-19c154419dc5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:34.204639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-138f7e73-9652-430b-9720-19c154419dc5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:34.213354 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-138f7e73-9652-430b-9720-19c154419dc5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1518 microversion: 2.1 time: 0.168716 Sep 07 13:36:34.213985 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3437/6902] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:34 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:35.244018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4acecfc6-4a64-4127-abbe-4cf36ae717a2 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:35.244593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4acecfc6-4a64-4127-abbe-4cf36ae717a2 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:35.252016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4acecfc6-4a64-4127-abbe-4cf36ae717a2 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:35.252513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4acecfc6-4a64-4127-abbe-4cf36ae717a2 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:35.252968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4acecfc6-4a64-4127-abbe-4cf36ae717a2 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:35.253745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4acecfc6-4a64-4127-abbe-4cf36ae717a2 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:35.254216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4acecfc6-4a64-4127-abbe-4cf36ae717a2 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:35.254665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4acecfc6-4a64-4127-abbe-4cf36ae717a2 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:35.393029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4acecfc6-4a64-4127-abbe-4cf36ae717a2 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:35.405137 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4acecfc6-4a64-4127-abbe-4cf36ae717a2 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1518 microversion: 2.1 time: 0.163693 Sep 07 13:36:35.405137 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3466/6903] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:35 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:36.432872 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eda890e9-a6f1-47f5-aec1-7c8810143929 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:36.433761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eda890e9-a6f1-47f5-aec1-7c8810143929 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:36.441308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eda890e9-a6f1-47f5-aec1-7c8810143929 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:36.441856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eda890e9-a6f1-47f5-aec1-7c8810143929 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:36.442312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eda890e9-a6f1-47f5-aec1-7c8810143929 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:36.443045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eda890e9-a6f1-47f5-aec1-7c8810143929 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:36.443508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eda890e9-a6f1-47f5-aec1-7c8810143929 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:36.443936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eda890e9-a6f1-47f5-aec1-7c8810143929 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:36.590779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eda890e9-a6f1-47f5-aec1-7c8810143929 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:36.599765 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eda890e9-a6f1-47f5-aec1-7c8810143929 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1518 microversion: 2.1 time: 0.171036 Sep 07 13:36:36.600360 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3438/6904] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:36 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:37.626593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d911a2d1-180c-4c0b-b1dc-b8fd0233d2e6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:37.627334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d911a2d1-180c-4c0b-b1dc-b8fd0233d2e6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:37.630834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:37.637604 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d911a2d1-180c-4c0b-b1dc-b8fd0233d2e6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:37.638202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d911a2d1-180c-4c0b-b1dc-b8fd0233d2e6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:37.639177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d911a2d1-180c-4c0b-b1dc-b8fd0233d2e6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:37.639430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d911a2d1-180c-4c0b-b1dc-b8fd0233d2e6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:37.639912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d911a2d1-180c-4c0b-b1dc-b8fd0233d2e6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:37.640358 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d911a2d1-180c-4c0b-b1dc-b8fd0233d2e6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:37.783759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d911a2d1-180c-4c0b-b1dc-b8fd0233d2e6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:37.793642 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d911a2d1-180c-4c0b-b1dc-b8fd0233d2e6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1518 microversion: 2.1 time: 0.171093 Sep 07 13:36:37.794315 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3467/6905] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:37 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:38.819897 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ec29e5b-a368-4276-95c3-8750c3e4b166 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:38.820486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6ec29e5b-a368-4276-95c3-8750c3e4b166 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:38.823875 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:36:38.824067 n-d-852087-9 devstack@n-api.service[122432]: Wed Sep 7 13:36:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb (ip 10.222.0.16) !!! Sep 07 13:36:38.825515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:38.833742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ec29e5b-a368-4276-95c3-8750c3e4b166 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:38.834232 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ec29e5b-a368-4276-95c3-8750c3e4b166 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:38.834677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ec29e5b-a368-4276-95c3-8750c3e4b166 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:38.835399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ec29e5b-a368-4276-95c3-8750c3e4b166 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:38.835856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ec29e5b-a368-4276-95c3-8750c3e4b166 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:38.836275 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ec29e5b-a368-4276-95c3-8750c3e4b166 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:38.993252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6ec29e5b-a368-4276-95c3-8750c3e4b166 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:39.001606 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6ec29e5b-a368-4276-95c3-8750c3e4b166 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1518 microversion: 2.1 time: 0.185683 Sep 07 13:36:39.002229 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3439/6906] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:38 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1518 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:40.028117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4831d6e3-4a40-4a34-b01d-4bfecc0c3058 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:40.028697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4831d6e3-4a40-4a34-b01d-4bfecc0c3058 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:40.036294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4831d6e3-4a40-4a34-b01d-4bfecc0c3058 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:40.036785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4831d6e3-4a40-4a34-b01d-4bfecc0c3058 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:40.037251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4831d6e3-4a40-4a34-b01d-4bfecc0c3058 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:40.038030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4831d6e3-4a40-4a34-b01d-4bfecc0c3058 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:40.038506 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4831d6e3-4a40-4a34-b01d-4bfecc0c3058 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:40.038950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4831d6e3-4a40-4a34-b01d-4bfecc0c3058 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:40.231854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4831d6e3-4a40-4a34-b01d-4bfecc0c3058 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:40.242246 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4831d6e3-4a40-4a34-b01d-4bfecc0c3058 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1518 microversion: 2.1 time: 0.220594 Sep 07 13:36:40.243032 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3468/6907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:40 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1518 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:41.280945 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-74cb2d3e-47ad-48ef-8af7-6c6ff95a20f7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:41.281777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-74cb2d3e-47ad-48ef-8af7-6c6ff95a20f7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:41.289217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74cb2d3e-47ad-48ef-8af7-6c6ff95a20f7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:41.289754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74cb2d3e-47ad-48ef-8af7-6c6ff95a20f7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:41.290187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74cb2d3e-47ad-48ef-8af7-6c6ff95a20f7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:41.290890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74cb2d3e-47ad-48ef-8af7-6c6ff95a20f7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:41.291348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74cb2d3e-47ad-48ef-8af7-6c6ff95a20f7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:41.291776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74cb2d3e-47ad-48ef-8af7-6c6ff95a20f7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:41.438630 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-74cb2d3e-47ad-48ef-8af7-6c6ff95a20f7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:41.447396 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-74cb2d3e-47ad-48ef-8af7-6c6ff95a20f7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1518 microversion: 2.1 time: 0.171775 Sep 07 13:36:41.447938 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3440/6908] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:41 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1518 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:42.472113 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0282ad55-5815-4ced-9033-69577127dc9c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:42.472733 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0282ad55-5815-4ced-9033-69577127dc9c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:42.480475 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0282ad55-5815-4ced-9033-69577127dc9c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:42.480996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0282ad55-5815-4ced-9033-69577127dc9c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:42.481453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0282ad55-5815-4ced-9033-69577127dc9c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:42.482218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0282ad55-5815-4ced-9033-69577127dc9c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:42.482697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0282ad55-5815-4ced-9033-69577127dc9c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:42.483143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0282ad55-5815-4ced-9033-69577127dc9c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:42.639891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0282ad55-5815-4ced-9033-69577127dc9c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:42.649008 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0282ad55-5815-4ced-9033-69577127dc9c tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1518 microversion: 2.1 time: 0.180965 Sep 07 13:36:42.649661 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3469/6909] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:42 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1518 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:43.675865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6177bfce-3b0b-44b0-b5e3-1f9832945593 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:43.676483 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6177bfce-3b0b-44b0-b5e3-1f9832945593 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:43.684169 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6177bfce-3b0b-44b0-b5e3-1f9832945593 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:43.684666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6177bfce-3b0b-44b0-b5e3-1f9832945593 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:43.685105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6177bfce-3b0b-44b0-b5e3-1f9832945593 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:43.685831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6177bfce-3b0b-44b0-b5e3-1f9832945593 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:43.686288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6177bfce-3b0b-44b0-b5e3-1f9832945593 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:43.686724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6177bfce-3b0b-44b0-b5e3-1f9832945593 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:43.840646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6177bfce-3b0b-44b0-b5e3-1f9832945593 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:43.849839 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6177bfce-3b0b-44b0-b5e3-1f9832945593 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1518 microversion: 2.1 time: 0.177922 Sep 07 13:36:43.850464 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3441/6910] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:43 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1518 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:44.872819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-189b531a-3a61-41c3-b3f1-cb969e4b2e0b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:44.873460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-189b531a-3a61-41c3-b3f1-cb969e4b2e0b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:44.881471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-189b531a-3a61-41c3-b3f1-cb969e4b2e0b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:44.882027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-189b531a-3a61-41c3-b3f1-cb969e4b2e0b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:44.882486 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-189b531a-3a61-41c3-b3f1-cb969e4b2e0b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:44.883198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-189b531a-3a61-41c3-b3f1-cb969e4b2e0b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:44.883681 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-189b531a-3a61-41c3-b3f1-cb969e4b2e0b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:44.884135 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-189b531a-3a61-41c3-b3f1-cb969e4b2e0b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:45.042912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-189b531a-3a61-41c3-b3f1-cb969e4b2e0b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:45.051369 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-189b531a-3a61-41c3-b3f1-cb969e4b2e0b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1518 microversion: 2.1 time: 0.182621 Sep 07 13:36:45.052021 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3470/6911] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:44 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1518 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:46.085292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5f14859a-84f6-4541-81cb-fa4061615685 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:46.086982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5f14859a-84f6-4541-81cb-fa4061615685 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:46.096013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f14859a-84f6-4541-81cb-fa4061615685 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:46.096800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f14859a-84f6-4541-81cb-fa4061615685 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:46.097653 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f14859a-84f6-4541-81cb-fa4061615685 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:46.098948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f14859a-84f6-4541-81cb-fa4061615685 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:46.099785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f14859a-84f6-4541-81cb-fa4061615685 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:46.100434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f14859a-84f6-4541-81cb-fa4061615685 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:46.246318 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5f14859a-84f6-4541-81cb-fa4061615685 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:46.254965 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5f14859a-84f6-4541-81cb-fa4061615685 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1518 microversion: 2.1 time: 0.174730 Sep 07 13:36:46.255595 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3442/6912] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:46 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:47.280623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-03e354dd-b76e-4f30-b652-2ce926941d76 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:47.281187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-03e354dd-b76e-4f30-b652-2ce926941d76 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:47.291808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03e354dd-b76e-4f30-b652-2ce926941d76 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:47.292332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03e354dd-b76e-4f30-b652-2ce926941d76 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:47.292814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03e354dd-b76e-4f30-b652-2ce926941d76 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:47.293633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03e354dd-b76e-4f30-b652-2ce926941d76 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:47.294112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03e354dd-b76e-4f30-b652-2ce926941d76 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:47.294683 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-03e354dd-b76e-4f30-b652-2ce926941d76 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:47.441961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-03e354dd-b76e-4f30-b652-2ce926941d76 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:47.451011 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-03e354dd-b76e-4f30-b652-2ce926941d76 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1518 microversion: 2.1 time: 0.175535 Sep 07 13:36:47.451618 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3471/6913] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:47 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:48.479414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aadf1a7a-7b4d-430a-a349-06f3bbef8746 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:48.480646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aadf1a7a-7b4d-430a-a349-06f3bbef8746 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:48.494038 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aadf1a7a-7b4d-430a-a349-06f3bbef8746 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:48.495131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aadf1a7a-7b4d-430a-a349-06f3bbef8746 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:48.495920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aadf1a7a-7b4d-430a-a349-06f3bbef8746 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:48.497197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aadf1a7a-7b4d-430a-a349-06f3bbef8746 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:48.498070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aadf1a7a-7b4d-430a-a349-06f3bbef8746 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:48.498872 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aadf1a7a-7b4d-430a-a349-06f3bbef8746 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:48.663160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aadf1a7a-7b4d-430a-a349-06f3bbef8746 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:48.672842 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aadf1a7a-7b4d-430a-a349-06f3bbef8746 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1518 microversion: 2.1 time: 0.201530 Sep 07 13:36:48.673498 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3443/6914] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:48 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1518 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:49.700838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-41dd009c-9d4a-4277-978a-35fb19a0c15b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:49.701575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-41dd009c-9d4a-4277-978a-35fb19a0c15b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:49.710285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41dd009c-9d4a-4277-978a-35fb19a0c15b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:49.710902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41dd009c-9d4a-4277-978a-35fb19a0c15b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:49.711501 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41dd009c-9d4a-4277-978a-35fb19a0c15b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:49.712313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41dd009c-9d4a-4277-978a-35fb19a0c15b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:49.712791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41dd009c-9d4a-4277-978a-35fb19a0c15b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:49.713258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-41dd009c-9d4a-4277-978a-35fb19a0c15b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:49.882290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-41dd009c-9d4a-4277-978a-35fb19a0c15b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:49.891513 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-41dd009c-9d4a-4277-978a-35fb19a0c15b tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1518 microversion: 2.1 time: 0.197159 Sep 07 13:36:49.892141 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3472/6915] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:49 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1518 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:50.920925 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d1e8ca10-d055-4c4e-ac0a-ce640bbcc0ac tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:50.921576 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d1e8ca10-d055-4c4e-ac0a-ce640bbcc0ac tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:50.929157 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1e8ca10-d055-4c4e-ac0a-ce640bbcc0ac tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:50.929696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1e8ca10-d055-4c4e-ac0a-ce640bbcc0ac tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:50.930142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1e8ca10-d055-4c4e-ac0a-ce640bbcc0ac tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:50.931014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1e8ca10-d055-4c4e-ac0a-ce640bbcc0ac tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:50.931481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1e8ca10-d055-4c4e-ac0a-ce640bbcc0ac tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:50.931918 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d1e8ca10-d055-4c4e-ac0a-ce640bbcc0ac tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:51.095739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d1e8ca10-d055-4c4e-ac0a-ce640bbcc0ac tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:51.103959 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d1e8ca10-d055-4c4e-ac0a-ce640bbcc0ac tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1518 microversion: 2.1 time: 0.187256 Sep 07 13:36:51.104737 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3444/6916] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:50 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1518 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:52.130648 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0b07b34f-a678-4caa-8de9-f098291de4b5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:52.131358 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0b07b34f-a678-4caa-8de9-f098291de4b5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:52.139606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b07b34f-a678-4caa-8de9-f098291de4b5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:52.140132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b07b34f-a678-4caa-8de9-f098291de4b5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:52.140598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b07b34f-a678-4caa-8de9-f098291de4b5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:52.141326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b07b34f-a678-4caa-8de9-f098291de4b5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:52.142446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b07b34f-a678-4caa-8de9-f098291de4b5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:52.142446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b07b34f-a678-4caa-8de9-f098291de4b5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:52.289004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0b07b34f-a678-4caa-8de9-f098291de4b5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:52.302287 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0b07b34f-a678-4caa-8de9-f098291de4b5 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1518 microversion: 2.1 time: 0.175375 Sep 07 13:36:52.303266 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3473/6917] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:52 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1518 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:53.329658 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0110d513-2ba9-4b4d-9fa2-ccce96ca00b0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:53.330240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0110d513-2ba9-4b4d-9fa2-ccce96ca00b0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:53.337611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0110d513-2ba9-4b4d-9fa2-ccce96ca00b0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:53.338366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0110d513-2ba9-4b4d-9fa2-ccce96ca00b0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:53.338855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0110d513-2ba9-4b4d-9fa2-ccce96ca00b0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:53.340005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0110d513-2ba9-4b4d-9fa2-ccce96ca00b0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:53.340468 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0110d513-2ba9-4b4d-9fa2-ccce96ca00b0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:53.341003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0110d513-2ba9-4b4d-9fa2-ccce96ca00b0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:53.494330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0110d513-2ba9-4b4d-9fa2-ccce96ca00b0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:53.508280 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0110d513-2ba9-4b4d-9fa2-ccce96ca00b0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1518 microversion: 2.1 time: 0.182521 Sep 07 13:36:53.509206 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3445/6918] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:53 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1518 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:54.532742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ac99e503-5bcb-4352-a045-bdfdd2965974 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:54.533416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ac99e503-5bcb-4352-a045-bdfdd2965974 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:54.540413 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac99e503-5bcb-4352-a045-bdfdd2965974 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:54.541072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac99e503-5bcb-4352-a045-bdfdd2965974 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:54.541276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac99e503-5bcb-4352-a045-bdfdd2965974 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:54.542035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac99e503-5bcb-4352-a045-bdfdd2965974 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:54.542517 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac99e503-5bcb-4352-a045-bdfdd2965974 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:54.542969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac99e503-5bcb-4352-a045-bdfdd2965974 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:54.694725 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ac99e503-5bcb-4352-a045-bdfdd2965974 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:54.703778 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ac99e503-5bcb-4352-a045-bdfdd2965974 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1518 microversion: 2.1 time: 0.174953 Sep 07 13:36:54.704360 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3474/6919] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:54 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:55.730313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0f120ce4-5850-42c6-b679-dcc96016f2a7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:55.731045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0f120ce4-5850-42c6-b679-dcc96016f2a7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:55.739894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f120ce4-5850-42c6-b679-dcc96016f2a7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:55.740445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f120ce4-5850-42c6-b679-dcc96016f2a7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:55.740919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f120ce4-5850-42c6-b679-dcc96016f2a7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:55.741721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f120ce4-5850-42c6-b679-dcc96016f2a7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:55.742247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f120ce4-5850-42c6-b679-dcc96016f2a7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:55.742723 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f120ce4-5850-42c6-b679-dcc96016f2a7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:55.899087 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0f120ce4-5850-42c6-b679-dcc96016f2a7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:55.909405 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0f120ce4-5850-42c6-b679-dcc96016f2a7 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1518 microversion: 2.1 time: 0.183509 Sep 07 13:36:55.909866 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3446/6920] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:55 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1518 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:56.935422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e965533f-87e0-47ce-b56b-3238ef110ae0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:56.936307 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e965533f-87e0-47ce-b56b-3238ef110ae0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:56.945680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e965533f-87e0-47ce-b56b-3238ef110ae0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:56.946307 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e965533f-87e0-47ce-b56b-3238ef110ae0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:56.946952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e965533f-87e0-47ce-b56b-3238ef110ae0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:56.947745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e965533f-87e0-47ce-b56b-3238ef110ae0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:56.948357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e965533f-87e0-47ce-b56b-3238ef110ae0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:56.948958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e965533f-87e0-47ce-b56b-3238ef110ae0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:57.099533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e965533f-87e0-47ce-b56b-3238ef110ae0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:57.108994 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e965533f-87e0-47ce-b56b-3238ef110ae0 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1518 microversion: 2.1 time: 0.178807 Sep 07 13:36:57.109600 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3475/6921] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:56 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1518 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:58.138817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4692dc4d-5448-434c-bdcb-55f427107f1f tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:58.140203 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4692dc4d-5448-434c-bdcb-55f427107f1f tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:58.150420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4692dc4d-5448-434c-bdcb-55f427107f1f tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:58.151128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4692dc4d-5448-434c-bdcb-55f427107f1f tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:58.151625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4692dc4d-5448-434c-bdcb-55f427107f1f tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:58.152500 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4692dc4d-5448-434c-bdcb-55f427107f1f tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:58.153236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4692dc4d-5448-434c-bdcb-55f427107f1f tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:58.153993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4692dc4d-5448-434c-bdcb-55f427107f1f tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:58.308655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4692dc4d-5448-434c-bdcb-55f427107f1f tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:58.318869 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4692dc4d-5448-434c-bdcb-55f427107f1f tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1518 microversion: 2.1 time: 0.187484 Sep 07 13:36:58.334764 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3447/6922] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:58 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1518 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:36:59.005134 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-555de2e4-93df-4e7f-a7bd-6eccc26e0579 req-f12d2c4d-e134-47a8-b1cc-7b376989a2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8823d302-e05b-4c2b-8756-d56a8381b9fb", "name": "network-vif-unplugged", "status": "completed", "tag": "bf395fd0-74ab-448a-a337-057614373f6c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:36:59.017887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-555de2e4-93df-4e7f-a7bd-6eccc26e0579 req-f12d2c4d-e134-47a8-b1cc-7b376989a2a8 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:59.018401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-555de2e4-93df-4e7f-a7bd-6eccc26e0579 req-f12d2c4d-e134-47a8-b1cc-7b376989a2a8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:59.018853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-555de2e4-93df-4e7f-a7bd-6eccc26e0579 req-f12d2c4d-e134-47a8-b1cc-7b376989a2a8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:59.032265 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-555de2e4-93df-4e7f-a7bd-6eccc26e0579 req-f12d2c4d-e134-47a8-b1cc-7b376989a2a8 service nova] Creating event network-vif-unplugged:bf395fd0-74ab-448a-a337-057614373f6c for instance 8823d302-e05b-4c2b-8756-d56a8381b9fb on n-h1-852087-9 Sep 07 13:36:59.038477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-555de2e4-93df-4e7f-a7bd-6eccc26e0579 req-f12d2c4d-e134-47a8-b1cc-7b376989a2a8 service nova] Instance 8823d302-e05b-4c2b-8756-d56a8381b9fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:36:59.053148 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-555de2e4-93df-4e7f-a7bd-6eccc26e0579 req-f12d2c4d-e134-47a8-b1cc-7b376989a2a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052112 Sep 07 13:36:59.056130 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3476/6923] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:36:59.343352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-adcc8312-42b2-46a1-b705-272d0919a71a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:36:59.344279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-adcc8312-42b2-46a1-b705-272d0919a71a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:36:59.351895 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adcc8312-42b2-46a1-b705-272d0919a71a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:59.352412 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adcc8312-42b2-46a1-b705-272d0919a71a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:59.352854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adcc8312-42b2-46a1-b705-272d0919a71a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:59.353660 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adcc8312-42b2-46a1-b705-272d0919a71a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:36:59.354103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adcc8312-42b2-46a1-b705-272d0919a71a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:36:59.354563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-adcc8312-42b2-46a1-b705-272d0919a71a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:36:59.357505 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=79 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:59.524244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-adcc8312-42b2-46a1-b705-272d0919a71a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:36:59.534153 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-adcc8312-42b2-46a1-b705-272d0919a71a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1517 microversion: 2.1 time: 0.195167 Sep 07 13:36:59.534775 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3448/6924] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:36:59 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1517 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:00.565377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-74ac5907-da8e-4f35-90ec-0735a933b405 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:00.566225 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-74ac5907-da8e-4f35-90ec-0735a933b405 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:00.575101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74ac5907-da8e-4f35-90ec-0735a933b405 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:00.575669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74ac5907-da8e-4f35-90ec-0735a933b405 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:00.576280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74ac5907-da8e-4f35-90ec-0735a933b405 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:00.577266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74ac5907-da8e-4f35-90ec-0735a933b405 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:00.577922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74ac5907-da8e-4f35-90ec-0735a933b405 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:00.578372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-74ac5907-da8e-4f35-90ec-0735a933b405 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:00.581642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:00.724606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-74ac5907-da8e-4f35-90ec-0735a933b405 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:00.736590 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-74ac5907-da8e-4f35-90ec-0735a933b405 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1515 microversion: 2.1 time: 0.176519 Sep 07 13:37:00.737220 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3477/6925] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:00 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:01.083725 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-0a0e5488-5763-4d9f-a741-c39154511fba req-c4d3b0ca-d8f1-4f4f-8669-8b41869b69dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8823d302-e05b-4c2b-8756-d56a8381b9fb", "tag": "bf395fd0-74ab-448a-a337-057614373f6c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:37:01.094926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0a0e5488-5763-4d9f-a741-c39154511fba req-c4d3b0ca-d8f1-4f4f-8669-8b41869b69dd service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:01.095449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0a0e5488-5763-4d9f-a741-c39154511fba req-c4d3b0ca-d8f1-4f4f-8669-8b41869b69dd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:01.095886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0a0e5488-5763-4d9f-a741-c39154511fba req-c4d3b0ca-d8f1-4f4f-8669-8b41869b69dd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:01.108076 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-0a0e5488-5763-4d9f-a741-c39154511fba req-c4d3b0ca-d8f1-4f4f-8669-8b41869b69dd service nova] Creating event network-changed:bf395fd0-74ab-448a-a337-057614373f6c for instance 8823d302-e05b-4c2b-8756-d56a8381b9fb on n-h1-852087-9 Sep 07 13:37:01.113819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-0a0e5488-5763-4d9f-a741-c39154511fba req-c4d3b0ca-d8f1-4f4f-8669-8b41869b69dd service nova] Instance 8823d302-e05b-4c2b-8756-d56a8381b9fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:37:01.125520 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-0a0e5488-5763-4d9f-a741-c39154511fba req-c4d3b0ca-d8f1-4f4f-8669-8b41869b69dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045527 Sep 07 13:37:01.126269 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3449/6926] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:01.761140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e2928c8c-8ed9-488f-9e8f-b6935f76313a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:01.761807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e2928c8c-8ed9-488f-9e8f-b6935f76313a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:01.769253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2928c8c-8ed9-488f-9e8f-b6935f76313a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:01.769807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2928c8c-8ed9-488f-9e8f-b6935f76313a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:01.770265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2928c8c-8ed9-488f-9e8f-b6935f76313a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:01.770982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2928c8c-8ed9-488f-9e8f-b6935f76313a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:01.771456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2928c8c-8ed9-488f-9e8f-b6935f76313a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:01.771904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2928c8c-8ed9-488f-9e8f-b6935f76313a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:01.918581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e2928c8c-8ed9-488f-9e8f-b6935f76313a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:01.927549 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e2928c8c-8ed9-488f-9e8f-b6935f76313a tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1515 microversion: 2.1 time: 0.170909 Sep 07 13:37:01.928246 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3478/6927] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:01 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:02.953760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fdfc99a1-4958-4353-89ad-77919f7ebcd3 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:02.954454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fdfc99a1-4958-4353-89ad-77919f7ebcd3 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:02.961254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdfc99a1-4958-4353-89ad-77919f7ebcd3 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:02.961830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdfc99a1-4958-4353-89ad-77919f7ebcd3 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:02.962343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdfc99a1-4958-4353-89ad-77919f7ebcd3 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:02.963056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdfc99a1-4958-4353-89ad-77919f7ebcd3 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:02.963620 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdfc99a1-4958-4353-89ad-77919f7ebcd3 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:02.964053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fdfc99a1-4958-4353-89ad-77919f7ebcd3 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:03.105582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fdfc99a1-4958-4353-89ad-77919f7ebcd3 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:03.114907 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fdfc99a1-4958-4353-89ad-77919f7ebcd3 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1515 microversion: 2.1 time: 0.166759 Sep 07 13:37:03.115488 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3450/6928] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:02 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:04.138637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-80778dce-3fae-4668-a720-358c49bc26ec tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:04.139295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-80778dce-3fae-4668-a720-358c49bc26ec tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:04.147301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80778dce-3fae-4668-a720-358c49bc26ec tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:04.147810 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80778dce-3fae-4668-a720-358c49bc26ec tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:04.148233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80778dce-3fae-4668-a720-358c49bc26ec tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:04.149663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80778dce-3fae-4668-a720-358c49bc26ec tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:04.149663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80778dce-3fae-4668-a720-358c49bc26ec tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:04.149932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-80778dce-3fae-4668-a720-358c49bc26ec tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:04.284803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-80778dce-3fae-4668-a720-358c49bc26ec tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:04.293921 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-80778dce-3fae-4668-a720-358c49bc26ec tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1512 microversion: 2.1 time: 0.159315 Sep 07 13:37:04.294505 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3479/6929] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:04 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:04.317534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1b51c4aa-7517-4246-b4f8-5bab69558bce tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:37:04.318275 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1b51c4aa-7517-4246-b4f8-5bab69558bce tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:04.325990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b51c4aa-7517-4246-b4f8-5bab69558bce tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:04.326470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b51c4aa-7517-4246-b4f8-5bab69558bce tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:04.326911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b51c4aa-7517-4246-b4f8-5bab69558bce tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:04.327609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b51c4aa-7517-4246-b4f8-5bab69558bce tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:04.328063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b51c4aa-7517-4246-b4f8-5bab69558bce tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:04.328490 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b51c4aa-7517-4246-b4f8-5bab69558bce tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:04.393044 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1b51c4aa-7517-4246-b4f8-5bab69558bce tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "POST /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb/action" status: 204 len: 0 microversion: 2.1 time: 0.079284 Sep 07 13:37:04.393752 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3451/6930] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:37:04 2022] POST /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:37:04.403304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bc7f7c77-5644-4d30-9c6c-6d6b41f1abaf tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:04.404007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bc7f7c77-5644-4d30-9c6c-6d6b41f1abaf tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:04.410986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc7f7c77-5644-4d30-9c6c-6d6b41f1abaf tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:04.411592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc7f7c77-5644-4d30-9c6c-6d6b41f1abaf tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:04.412174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc7f7c77-5644-4d30-9c6c-6d6b41f1abaf tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:04.412972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc7f7c77-5644-4d30-9c6c-6d6b41f1abaf tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:04.413519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc7f7c77-5644-4d30-9c6c-6d6b41f1abaf tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:04.414081 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bc7f7c77-5644-4d30-9c6c-6d6b41f1abaf tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:04.561140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bc7f7c77-5644-4d30-9c6c-6d6b41f1abaf tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:04.569256 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bc7f7c77-5644-4d30-9c6c-6d6b41f1abaf tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1512 microversion: 2.1 time: 0.171041 Sep 07 13:37:04.569878 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3480/6931] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:04 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:05.595066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-078d563b-fddf-4cad-8f01-fa784a5508e6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:05.595642 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-078d563b-fddf-4cad-8f01-fa784a5508e6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:05.603383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-078d563b-fddf-4cad-8f01-fa784a5508e6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:05.603902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-078d563b-fddf-4cad-8f01-fa784a5508e6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:05.604356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-078d563b-fddf-4cad-8f01-fa784a5508e6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:05.605125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-078d563b-fddf-4cad-8f01-fa784a5508e6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:05.605617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-078d563b-fddf-4cad-8f01-fa784a5508e6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:05.606025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-078d563b-fddf-4cad-8f01-fa784a5508e6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:05.753796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-078d563b-fddf-4cad-8f01-fa784a5508e6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:05.763683 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-078d563b-fddf-4cad-8f01-fa784a5508e6 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1512 microversion: 2.1 time: 0.174776 Sep 07 13:37:05.764311 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3452/6932] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:05 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:06.309458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-ee4fae46-d40e-44f9-83fe-d13bf8461789 req-c3de93e5-6bf5-4431-8f5c-d2317c08798d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8823d302-e05b-4c2b-8756-d56a8381b9fb", "name": "network-vif-plugged", "status": "completed", "tag": "bf395fd0-74ab-448a-a337-057614373f6c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:37:06.320399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ee4fae46-d40e-44f9-83fe-d13bf8461789 req-c3de93e5-6bf5-4431-8f5c-d2317c08798d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:06.320963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ee4fae46-d40e-44f9-83fe-d13bf8461789 req-c3de93e5-6bf5-4431-8f5c-d2317c08798d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:06.321498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ee4fae46-d40e-44f9-83fe-d13bf8461789 req-c3de93e5-6bf5-4431-8f5c-d2317c08798d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:06.337071 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ee4fae46-d40e-44f9-83fe-d13bf8461789 req-c3de93e5-6bf5-4431-8f5c-d2317c08798d service nova] Creating event network-vif-plugged:bf395fd0-74ab-448a-a337-057614373f6c for instance 8823d302-e05b-4c2b-8756-d56a8381b9fb on n-h1-852087-9 Sep 07 13:37:06.343596 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-ee4fae46-d40e-44f9-83fe-d13bf8461789 req-c3de93e5-6bf5-4431-8f5c-d2317c08798d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038782 Sep 07 13:37:06.344222 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3481/6933] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:06.788592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-83daa622-3dc8-4ee6-8aa1-481c217ea549 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:06.789233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-83daa622-3dc8-4ee6-8aa1-481c217ea549 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:06.796661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83daa622-3dc8-4ee6-8aa1-481c217ea549 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:06.797154 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83daa622-3dc8-4ee6-8aa1-481c217ea549 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:06.797798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83daa622-3dc8-4ee6-8aa1-481c217ea549 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:06.798336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83daa622-3dc8-4ee6-8aa1-481c217ea549 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:06.798798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83daa622-3dc8-4ee6-8aa1-481c217ea549 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:06.799300 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83daa622-3dc8-4ee6-8aa1-481c217ea549 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:06.951386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-83daa622-3dc8-4ee6-8aa1-481c217ea549 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:06.959761 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-83daa622-3dc8-4ee6-8aa1-481c217ea549 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1504 microversion: 2.1 time: 0.175092 Sep 07 13:37:06.960355 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3453/6934] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:06 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:06.983663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d158b1a5-76a9-4d84-90d4-ead4503f5be4 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:06.985395 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d158b1a5-76a9-4d84-90d4-ead4503f5be4 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:06.992619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d158b1a5-76a9-4d84-90d4-ead4503f5be4 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:06.993400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d158b1a5-76a9-4d84-90d4-ead4503f5be4 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:06.993889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d158b1a5-76a9-4d84-90d4-ead4503f5be4 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:06.994634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d158b1a5-76a9-4d84-90d4-ead4503f5be4 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:06.995101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d158b1a5-76a9-4d84-90d4-ead4503f5be4 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:06.995823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d158b1a5-76a9-4d84-90d4-ead4503f5be4 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:07.133957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d158b1a5-76a9-4d84-90d4-ead4503f5be4 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:07.142220 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d158b1a5-76a9-4d84-90d4-ead4503f5be4 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1504 microversion: 2.1 time: 0.162834 Sep 07 13:37:07.142890 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3482/6935] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:06 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:07.164871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3083807f-fcda-4303-8e34-f5409880f31e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:07.165821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3083807f-fcda-4303-8e34-f5409880f31e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:07.172127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3083807f-fcda-4303-8e34-f5409880f31e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:07.172596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3083807f-fcda-4303-8e34-f5409880f31e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:07.173068 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3083807f-fcda-4303-8e34-f5409880f31e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:07.173776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3083807f-fcda-4303-8e34-f5409880f31e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:07.174232 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3083807f-fcda-4303-8e34-f5409880f31e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:07.174661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3083807f-fcda-4303-8e34-f5409880f31e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:07.311566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3083807f-fcda-4303-8e34-f5409880f31e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:07.319603 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3083807f-fcda-4303-8e34-f5409880f31e tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1504 microversion: 2.1 time: 0.158650 Sep 07 13:37:07.320183 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3454/6936] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:07 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:07.343594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3479b872-2ff1-4a02-b819-207f4d6ec3e8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:07.344244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3479b872-2ff1-4a02-b819-207f4d6ec3e8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:07.352770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3479b872-2ff1-4a02-b819-207f4d6ec3e8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:07.353278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3479b872-2ff1-4a02-b819-207f4d6ec3e8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:07.353762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3479b872-2ff1-4a02-b819-207f4d6ec3e8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:07.354482 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3479b872-2ff1-4a02-b819-207f4d6ec3e8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:07.354957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3479b872-2ff1-4a02-b819-207f4d6ec3e8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:07.355432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3479b872-2ff1-4a02-b819-207f4d6ec3e8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:07.382544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3479b872-2ff1-4a02-b819-207f4d6ec3e8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:37:07.467699 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3479b872-2ff1-4a02-b819-207f4d6ec3e8 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 204 len: 0 microversion: 2.1 time: 0.129114 Sep 07 13:37:07.468400 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3483/6937] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:37:07 2022] DELETE /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:37:07.485299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-08371110-dfb3-4b8c-9ae7-4c99798f35aa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:07.485772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-08371110-dfb3-4b8c-9ae7-4c99798f35aa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:07.492719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08371110-dfb3-4b8c-9ae7-4c99798f35aa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:07.493226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08371110-dfb3-4b8c-9ae7-4c99798f35aa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:07.493782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08371110-dfb3-4b8c-9ae7-4c99798f35aa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:07.494588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08371110-dfb3-4b8c-9ae7-4c99798f35aa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:07.495048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08371110-dfb3-4b8c-9ae7-4c99798f35aa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:07.495526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08371110-dfb3-4b8c-9ae7-4c99798f35aa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:07.524261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-08371110-dfb3-4b8c-9ae7-4c99798f35aa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:37:07.575482 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.compute.api [None req-08371110-dfb3-4b8c-9ae7-4c99798f35aa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Instance is already in deleting state, ignoring this request Sep 07 13:37:07.575876 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-08371110-dfb3-4b8c-9ae7-4c99798f35aa tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 204 len: 0 microversion: 2.1 time: 0.094995 Sep 07 13:37:07.576446 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3455/6938] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:37:07 2022] DELETE /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:37:07.587856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-07bfac75-2e31-4d7b-bc8b-767f29356aca tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:07.588806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-07bfac75-2e31-4d7b-bc8b-767f29356aca tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:07.596155 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07bfac75-2e31-4d7b-bc8b-767f29356aca tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:07.596665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07bfac75-2e31-4d7b-bc8b-767f29356aca tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:07.597116 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07bfac75-2e31-4d7b-bc8b-767f29356aca tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:07.597941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07bfac75-2e31-4d7b-bc8b-767f29356aca tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:07.598411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07bfac75-2e31-4d7b-bc8b-767f29356aca tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:07.598855 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07bfac75-2e31-4d7b-bc8b-767f29356aca tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:07.737807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-07bfac75-2e31-4d7b-bc8b-767f29356aca tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:07.749933 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-07bfac75-2e31-4d7b-bc8b-767f29356aca tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1510 microversion: 2.1 time: 0.168046 Sep 07 13:37:07.750883 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3484/6939] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:07 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:08.777564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bc029022-089e-411c-ba48-3c96b4f3b215 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:08.778193 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bc029022-089e-411c-ba48-3c96b4f3b215 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:08.788312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc029022-089e-411c-ba48-3c96b4f3b215 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:08.788942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc029022-089e-411c-ba48-3c96b4f3b215 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:08.789576 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc029022-089e-411c-ba48-3c96b4f3b215 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:08.790601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc029022-089e-411c-ba48-3c96b4f3b215 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:08.790976 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc029022-089e-411c-ba48-3c96b4f3b215 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:08.791242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bc029022-089e-411c-ba48-3c96b4f3b215 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:08.935265 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bc029022-089e-411c-ba48-3c96b4f3b215 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:08.943367 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bc029022-089e-411c-ba48-3c96b4f3b215 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1510 microversion: 2.1 time: 0.171854 Sep 07 13:37:08.943913 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3456/6940] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:08 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:09.717775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c7825477-1caf-47b2-8bda-ad9a757b78ba req-38cdd330-f3fe-4c6c-9a0d-f4296925e60f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8823d302-e05b-4c2b-8756-d56a8381b9fb", "name": "network-vif-deleted", "tag": "bf395fd0-74ab-448a-a337-057614373f6c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:37:09.727394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:09.733065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c7825477-1caf-47b2-8bda-ad9a757b78ba req-38cdd330-f3fe-4c6c-9a0d-f4296925e60f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:09.734415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c7825477-1caf-47b2-8bda-ad9a757b78ba req-38cdd330-f3fe-4c6c-9a0d-f4296925e60f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:09.734895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c7825477-1caf-47b2-8bda-ad9a757b78ba req-38cdd330-f3fe-4c6c-9a0d-f4296925e60f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:09.748743 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c7825477-1caf-47b2-8bda-ad9a757b78ba req-38cdd330-f3fe-4c6c-9a0d-f4296925e60f service nova] Creating event network-vif-deleted:bf395fd0-74ab-448a-a337-057614373f6c for instance 8823d302-e05b-4c2b-8756-d56a8381b9fb on n-h1-852087-9 Sep 07 13:37:09.756458 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c7825477-1caf-47b2-8bda-ad9a757b78ba req-38cdd330-f3fe-4c6c-9a0d-f4296925e60f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041883 Sep 07 13:37:09.757090 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3485/6941] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:09.970077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-809c6415-0878-4471-b858-2070739d00ce tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:09.971095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-809c6415-0878-4471-b858-2070739d00ce tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:09.975691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=36 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:09.983210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-809c6415-0878-4471-b858-2070739d00ce tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:09.983773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-809c6415-0878-4471-b858-2070739d00ce tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:09.984241 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-809c6415-0878-4471-b858-2070739d00ce tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:09.985061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-809c6415-0878-4471-b858-2070739d00ce tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:09.985713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-809c6415-0878-4471-b858-2070739d00ce tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:09.986330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-809c6415-0878-4471-b858-2070739d00ce tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:10.023068 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-809c6415-0878-4471-b858-2070739d00ce tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:10.023617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-809c6415-0878-4471-b858-2070739d00ce tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:10.023969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-809c6415-0878-4471-b858-2070739d00ce tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:10.024434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-809c6415-0878-4471-b858-2070739d00ce tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lazy-loading 'fault' on Instance uuid 8823d302-e05b-4c2b-8756-d56a8381b9fb {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:37:10.070639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-809c6415-0878-4471-b858-2070739d00ce tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533e322376994c8a85c8e7696f4f974f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98fd3224d1541babd9ee0f9fc0a4fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:10.079119 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-809c6415-0878-4471-b858-2070739d00ce tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 200 len: 1305 microversion: 2.1 time: 0.114548 Sep 07 13:37:10.079909 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3457/6942] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:09 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 1305 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:11.104087 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-237054bb-b1fd-4713-a8b4-0b24674e866d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:11.105054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-237054bb-b1fd-4713-a8b4-0b24674e866d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 8823d302-e05b-4c2b-8756-d56a8381b9fb] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:11.112202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-237054bb-b1fd-4713-a8b4-0b24674e866d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:11.112690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-237054bb-b1fd-4713-a8b4-0b24674e866d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:11.113251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-237054bb-b1fd-4713-a8b4-0b24674e866d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:11.114005 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-237054bb-b1fd-4713-a8b4-0b24674e866d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:11.114475 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-237054bb-b1fd-4713-a8b4-0b24674e866d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:11.114914 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-237054bb-b1fd-4713-a8b4-0b24674e866d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:11.130558 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-237054bb-b1fd-4713-a8b4-0b24674e866d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] HTTP exception thrown: Instance 8823d302-e05b-4c2b-8756-d56a8381b9fb could not be found. Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-237054bb-b1fd-4713-a8b4-0b24674e866d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Request method failure captured: Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb HTTP/1.1 Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJ4fGew5LmdSd76w2FIjA_2liTO0MLdbEuCBvgfXxt4Ujih2DdCDD7ougMchOxVDr8n8vjvePv72z39TMAvbHIDHTy9oNj5TKI8jnYsIxQgZHMhpsRx83K4oKIjbRgLP4R-NX3AYOr9czm-ElHKjF7p_2gtOdyyLKgXuEKDbN_RAc2c Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: d98fd3224d1541babd9ee0f9fc0a4fca Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1646450186 Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d98fd3224d1541babd9ee0f9fc0a4fca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d98fd3224d1541babd9ee0f9fc0a4fca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d98fd3224d1541babd9ee0f9fc0a4fca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d98fd3224d1541babd9ee0f9fc0a4fca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerDiskConfigTestJSON-1646450186 Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: d98fd3224d1541babd9ee0f9fc0a4fca Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1646450186 Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerDiskConfigTestJSON-1646450186-project Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 533e322376994c8a85c8e7696f4f974f Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerDiskConfigTestJSON-1646450186-project Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 8823d302-e05b-4c2b-8756-d56a8381b9fb could not be found. Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '8823d302-e05b-4c2b-8756-d56a8381b9fb'} Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8823d302-e05b-4c2b-8756-d56a8381b9fb could not be found. Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8823d302-e05b-4c2b-8756-d56a8381b9fb could not be found. Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:37:11.132260 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:37:11.136940 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:37:11.136940 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:37:11.136940 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:37:11.136940 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:37:11.136940 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:37:11.136940 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8823d302-e05b-4c2b-8756-d56a8381b9fb could not be found. Sep 07 13:37:11.136940 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:37:11.136940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-237054bb-b1fd-4713-a8b4-0b24674e866d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Returning 404 to user: Instance 8823d302-e05b-4c2b-8756-d56a8381b9fb could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:37:11.136940 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-237054bb-b1fd-4713-a8b4-0b24674e866d tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb" status: 404 len: 111 microversion: 2.1 time: 0.034052 Sep 07 13:37:11.136940 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3486/6943] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:11 2022] GET /compute/v2.1/servers/8823d302-e05b-4c2b-8756-d56a8381b9fb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:37:11.144940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4cccbce7-3bb8-4355-86b3-235aa9347494 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '.version_select at 0x7fc41d1de160>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:11.173559 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4cccbce7-3bb8-4355-86b3-235aa9347494 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-270809539" status: 202 len: 0 microversion: 2.1 time: 0.034429 Sep 07 13:37:11.174082 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3458/6944] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Sep 7 13:37:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-270809539 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:37:12.121830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de2173ae-f378-40d2-9bf4-6fc18ffa1b05 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:12.122639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-de2173ae-f378-40d2-9bf4-6fc18ffa1b05 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:12.131607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de2173ae-f378-40d2-9bf4-6fc18ffa1b05 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:12.132108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de2173ae-f378-40d2-9bf4-6fc18ffa1b05 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:12.132692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de2173ae-f378-40d2-9bf4-6fc18ffa1b05 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:12.133282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de2173ae-f378-40d2-9bf4-6fc18ffa1b05 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:12.133932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de2173ae-f378-40d2-9bf4-6fc18ffa1b05 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:12.134359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de2173ae-f378-40d2-9bf4-6fc18ffa1b05 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:12.148793 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-de2173ae-f378-40d2-9bf4-6fc18ffa1b05 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] HTTP exception thrown: Instance 135649d7-e74d-4676-a1bf-4d0d8ebd873c could not be found. Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de2173ae-f378-40d2-9bf4-6fc18ffa1b05 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Request method failure captured: Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c HTTP/1.1 Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJ4fGew5LmdSd76w2FIjA_2liTO0MLdbEuCBvgfXxt4Ujih2DdCDD7ougMchOxVDr8n8vjvePv72z39TMAvbHIDHTy9oNj5TKI8jnYsIxQgZHMhpsRx83K4oKIjbRgLP4R-NX3AYOr9czm-ElHKjF7p_2gtOdyyLKgXuEKDbN_RAc2c Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: d98fd3224d1541babd9ee0f9fc0a4fca Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1646450186 Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d98fd3224d1541babd9ee0f9fc0a4fca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d98fd3224d1541babd9ee0f9fc0a4fca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d98fd3224d1541babd9ee0f9fc0a4fca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d98fd3224d1541babd9ee0f9fc0a4fca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerDiskConfigTestJSON-1646450186 Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: d98fd3224d1541babd9ee0f9fc0a4fca Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1646450186 Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerDiskConfigTestJSON-1646450186-project Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 533e322376994c8a85c8e7696f4f974f Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerDiskConfigTestJSON-1646450186-project Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 135649d7-e74d-4676-a1bf-4d0d8ebd873c could not be found. Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '135649d7-e74d-4676-a1bf-4d0d8ebd873c'} Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 135649d7-e74d-4676-a1bf-4d0d8ebd873c could not be found. Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:37:12.150016 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:37:12.154148 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 135649d7-e74d-4676-a1bf-4d0d8ebd873c could not be found. Sep 07 13:37:12.154148 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:37:12.154148 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:37:12.154148 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:37:12.154148 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:37:12.154148 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:37:12.154148 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:37:12.154148 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:37:12.154148 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:37:12.154148 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 135649d7-e74d-4676-a1bf-4d0d8ebd873c could not be found. Sep 07 13:37:12.154148 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:37:12.154148 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de2173ae-f378-40d2-9bf4-6fc18ffa1b05 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Returning 404 to user: Instance 135649d7-e74d-4676-a1bf-4d0d8ebd873c could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:37:12.154148 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-de2173ae-f378-40d2-9bf4-6fc18ffa1b05 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "DELETE /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 404 len: 111 microversion: 2.1 time: 0.036212 Sep 07 13:37:12.154148 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3487/6945] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:37:12 2022] DELETE /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:37:12.161345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-800a844a-bbc6-4423-abf0-615b99dd4385 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:12.162254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-800a844a-bbc6-4423-abf0-615b99dd4385 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] [instance: 135649d7-e74d-4676-a1bf-4d0d8ebd873c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:12.171150 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-800a844a-bbc6-4423-abf0-615b99dd4385 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:12.171655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-800a844a-bbc6-4423-abf0-615b99dd4385 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:12.172220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-800a844a-bbc6-4423-abf0-615b99dd4385 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:12.172903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-800a844a-bbc6-4423-abf0-615b99dd4385 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:12.173358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-800a844a-bbc6-4423-abf0-615b99dd4385 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:12.173812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-800a844a-bbc6-4423-abf0-615b99dd4385 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:12.187929 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-800a844a-bbc6-4423-abf0-615b99dd4385 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] HTTP exception thrown: Instance 135649d7-e74d-4676-a1bf-4d0d8ebd873c could not be found. Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-800a844a-bbc6-4423-abf0-615b99dd4385 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Request method failure captured: Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c HTTP/1.1 Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJ4fGew5LmdSd76w2FIjA_2liTO0MLdbEuCBvgfXxt4Ujih2DdCDD7ougMchOxVDr8n8vjvePv72z39TMAvbHIDHTy9oNj5TKI8jnYsIxQgZHMhpsRx83K4oKIjbRgLP4R-NX3AYOr9czm-ElHKjF7p_2gtOdyyLKgXuEKDbN_RAc2c Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: d98fd3224d1541babd9ee0f9fc0a4fca Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1646450186 Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d98fd3224d1541babd9ee0f9fc0a4fca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d98fd3224d1541babd9ee0f9fc0a4fca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d98fd3224d1541babd9ee0f9fc0a4fca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d98fd3224d1541babd9ee0f9fc0a4fca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerDiskConfigTestJSON-1646450186 Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: d98fd3224d1541babd9ee0f9fc0a4fca Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1646450186 Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerDiskConfigTestJSON-1646450186-project Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 533e322376994c8a85c8e7696f4f974f Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerDiskConfigTestJSON-1646450186-project Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 135649d7-e74d-4676-a1bf-4d0d8ebd873c could not be found. Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '135649d7-e74d-4676-a1bf-4d0d8ebd873c'} Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 135649d7-e74d-4676-a1bf-4d0d8ebd873c could not be found. Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 135649d7-e74d-4676-a1bf-4d0d8ebd873c could not be found. Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:37:12.189686 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:37:12.193997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:37:12.193997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:37:12.193997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:37:12.193997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:37:12.193997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:37:12.193997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 135649d7-e74d-4676-a1bf-4d0d8ebd873c could not be found. Sep 07 13:37:12.193997 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:37:12.193997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-800a844a-bbc6-4423-abf0-615b99dd4385 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] Returning 404 to user: Instance 135649d7-e74d-4676-a1bf-4d0d8ebd873c could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:37:12.193997 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-800a844a-bbc6-4423-abf0-615b99dd4385 tempest-ServerDiskConfigTestJSON-1646450186 tempest-ServerDiskConfigTestJSON-1646450186-project] 10.222.0.16 "GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c" status: 404 len: 111 microversion: 2.1 time: 0.034098 Sep 07 13:37:12.193997 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3459/6946] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:12 2022] GET /compute/v2.1/servers/135649d7-e74d-4676-a1bf-4d0d8ebd873c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:37:20.993876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4befff0d-e89f-4e1d-9ad3-0d612cef93d7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Action: 'create', calling method: .version_select at 0x7fc41d2651f0>, body: {"keypair": {"name": "tempest-keypair-1624528547", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8yvqbf7npbq2YhlJ/hbhUK/sdXwbmh0030z4oZgIObJgtmnAxluj7MeA3Ik3Ou+9okhLCnPnKXlEzGfs8oY6QaTFEFfFYguehyTDw59xXnmXjc7H3qptRzxXo1GWL2ew=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:37:21.013634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-4befff0d-e89f-4e1d-9ad3-0d612cef93d7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Getting quotas for project 396666be58fa42568bdfa2652d635a41. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:37:21.020626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-4befff0d-e89f-4e1d-9ad3-0d612cef93d7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Getting quotas for user bb0e9196784341cbb170c1c055e8966f and project 396666be58fa42568bdfa2652d635a41. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:37:21.052995 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4befff0d-e89f-4e1d-9ad3-0d612cef93d7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.190563 Sep 07 13:37:21.053944 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3488/6947] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 13:37:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:22.496160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e20642ba-5490-485c-ae66-29dfbff6cecc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1405953435", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c0ae2db3-d205-4102-b4b3-830cdd7a4274"}], "security_groups": [{"name": "tempest-securitygroup--971767124"}], "key_name": "tempest-keypair-1624528547", "user_data": "}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:37:22.507352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:22.508031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:22.621601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-e20642ba-5490-485c-ae66-29dfbff6cecc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] validate_networks() for [('c0ae2db3-d205-4102-b4b3-830cdd7a4274', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:37:23.015317 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e20642ba-5490-485c-ae66-29dfbff6cecc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:37:23.015768 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e20642ba-5490-485c-ae66-29dfbff6cecc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:37:23.016251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e20642ba-5490-485c-ae66-29dfbff6cecc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:37:23.017091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e20642ba-5490-485c-ae66-29dfbff6cecc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:37:23.017535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-e20642ba-5490-485c-ae66-29dfbff6cecc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:37:23.027697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e20642ba-5490-485c-ae66-29dfbff6cecc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:23.028191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e20642ba-5490-485c-ae66-29dfbff6cecc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:23.028641 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e20642ba-5490-485c-ae66-29dfbff6cecc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:23.029377 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e20642ba-5490-485c-ae66-29dfbff6cecc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:23.029871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e20642ba-5490-485c-ae66-29dfbff6cecc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:23.030305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e20642ba-5490-485c-ae66-29dfbff6cecc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:23.049126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-e20642ba-5490-485c-ae66-29dfbff6cecc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Getting quotas for project 396666be58fa42568bdfa2652d635a41. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:37:23.055030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-e20642ba-5490-485c-ae66-29dfbff6cecc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Getting quotas for user bb0e9196784341cbb170c1c055e8966f and project 396666be58fa42568bdfa2652d635a41. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:37:23.070030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e20642ba-5490-485c-ae66-29dfbff6cecc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:37:23.072363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e20642ba-5490-485c-ae66-29dfbff6cecc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:37:23.119599 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e20642ba-5490-485c-ae66-29dfbff6cecc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.627753 Sep 07 13:37:23.120483 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3460/6948] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:37:22 2022] POST /compute/v2.1/servers => generated 408 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:37:23.129932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:23.134798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-93aa4ed0-9d14-4955-a739-ee7e89973e7f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:23.135606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-93aa4ed0-9d14-4955-a739-ee7e89973e7f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:23.199176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-93aa4ed0-9d14-4955-a739-ee7e89973e7f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:23.207801 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-93aa4ed0-9d14-4955-a739-ee7e89973e7f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1239 microversion: 2.1 time: 0.079710 Sep 07 13:37:23.219643 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3489/6949] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:23 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:24.233201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0facdd6c-f613-43be-a536-b036413907e4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:24.234606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0facdd6c-f613-43be-a536-b036413907e4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:24.243343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0facdd6c-f613-43be-a536-b036413907e4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:24.243848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0facdd6c-f613-43be-a536-b036413907e4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:24.244293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0facdd6c-f613-43be-a536-b036413907e4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:24.245372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0facdd6c-f613-43be-a536-b036413907e4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:24.245867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0facdd6c-f613-43be-a536-b036413907e4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:24.246300 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0facdd6c-f613-43be-a536-b036413907e4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:24.321169 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0facdd6c-f613-43be-a536-b036413907e4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:24.335853 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0facdd6c-f613-43be-a536-b036413907e4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1291 microversion: 2.1 time: 0.108651 Sep 07 13:37:24.336948 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3461/6950] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:24 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1291 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:25.360462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-18ce1029-5e3e-41d9-8d0e-4c15b9777917 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:25.361336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-18ce1029-5e3e-41d9-8d0e-4c15b9777917 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:25.369725 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18ce1029-5e3e-41d9-8d0e-4c15b9777917 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:25.370253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18ce1029-5e3e-41d9-8d0e-4c15b9777917 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:25.370715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18ce1029-5e3e-41d9-8d0e-4c15b9777917 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:25.371453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18ce1029-5e3e-41d9-8d0e-4c15b9777917 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:25.371930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18ce1029-5e3e-41d9-8d0e-4c15b9777917 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:25.372374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-18ce1029-5e3e-41d9-8d0e-4c15b9777917 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:25.516640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-18ce1029-5e3e-41d9-8d0e-4c15b9777917 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:25.526540 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-18ce1029-5e3e-41d9-8d0e-4c15b9777917 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1364 microversion: 2.1 time: 0.170018 Sep 07 13:37:25.532656 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3490/6951] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:25 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:25.988952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-33a42ff3-2629-44e0-b759-f64eaab4d4d1 req-0ffb873a-7b23-4f99-b9ce-0bf70c0c3308 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09d82c40-2803-474d-ad84-666897e7bbf9", "tag": "7252c726-077b-46a3-b20c-c169ad3e78ec"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:37:26.001172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-33a42ff3-2629-44e0-b759-f64eaab4d4d1 req-0ffb873a-7b23-4f99-b9ce-0bf70c0c3308 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:26.001791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-33a42ff3-2629-44e0-b759-f64eaab4d4d1 req-0ffb873a-7b23-4f99-b9ce-0bf70c0c3308 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:26.002305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-33a42ff3-2629-44e0-b759-f64eaab4d4d1 req-0ffb873a-7b23-4f99-b9ce-0bf70c0c3308 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:26.014561 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-33a42ff3-2629-44e0-b759-f64eaab4d4d1 req-0ffb873a-7b23-4f99-b9ce-0bf70c0c3308 service nova] Creating event network-changed:7252c726-077b-46a3-b20c-c169ad3e78ec for instance 09d82c40-2803-474d-ad84-666897e7bbf9 on n-h2-852087-9 Sep 07 13:37:26.019734 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-33a42ff3-2629-44e0-b759-f64eaab4d4d1 req-0ffb873a-7b23-4f99-b9ce-0bf70c0c3308 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034670 Sep 07 13:37:26.020573 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3462/6952] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:26.552465 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-98cef70a-ebb8-464a-b41a-e297e1b662e0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:26.553141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-98cef70a-ebb8-464a-b41a-e297e1b662e0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:26.560889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98cef70a-ebb8-464a-b41a-e297e1b662e0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:26.561405 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98cef70a-ebb8-464a-b41a-e297e1b662e0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:26.561932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98cef70a-ebb8-464a-b41a-e297e1b662e0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:26.562657 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98cef70a-ebb8-464a-b41a-e297e1b662e0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:26.563105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98cef70a-ebb8-464a-b41a-e297e1b662e0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:26.563548 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98cef70a-ebb8-464a-b41a-e297e1b662e0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:26.700037 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-98cef70a-ebb8-464a-b41a-e297e1b662e0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:26.710698 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-98cef70a-ebb8-464a-b41a-e297e1b662e0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1364 microversion: 2.1 time: 0.163528 Sep 07 13:37:26.711302 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3491/6953] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:26 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:37:27.738683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c8536a95-ef7a-4a26-8944-d1768697ca0e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:27.739442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c8536a95-ef7a-4a26-8944-d1768697ca0e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:27.745952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8536a95-ef7a-4a26-8944-d1768697ca0e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:27.746445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8536a95-ef7a-4a26-8944-d1768697ca0e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:27.746878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8536a95-ef7a-4a26-8944-d1768697ca0e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:27.747579 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8536a95-ef7a-4a26-8944-d1768697ca0e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:27.748032 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8536a95-ef7a-4a26-8944-d1768697ca0e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:27.748447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8536a95-ef7a-4a26-8944-d1768697ca0e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:27.894674 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c8536a95-ef7a-4a26-8944-d1768697ca0e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:27.903047 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c8536a95-ef7a-4a26-8944-d1768697ca0e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1364 microversion: 2.1 time: 0.172191 Sep 07 13:37:27.903664 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3463/6954] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:27 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:28.925628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-64481876-7c03-40d5-98d8-041e854701f1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:28.926495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-64481876-7c03-40d5-98d8-041e854701f1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:28.934100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64481876-7c03-40d5-98d8-041e854701f1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:28.935215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64481876-7c03-40d5-98d8-041e854701f1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:28.935976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64481876-7c03-40d5-98d8-041e854701f1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:28.937922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64481876-7c03-40d5-98d8-041e854701f1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:28.938627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64481876-7c03-40d5-98d8-041e854701f1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:28.939288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64481876-7c03-40d5-98d8-041e854701f1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:29.078009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-64481876-7c03-40d5-98d8-041e854701f1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:29.086604 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-64481876-7c03-40d5-98d8-041e854701f1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1364 microversion: 2.1 time: 0.164850 Sep 07 13:37:29.087215 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3492/6955] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:28 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:30.110998 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5c4ec17e-0d0d-49ad-a63b-b460ae93613e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:30.111598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5c4ec17e-0d0d-49ad-a63b-b460ae93613e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:30.119349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c4ec17e-0d0d-49ad-a63b-b460ae93613e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:30.119857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c4ec17e-0d0d-49ad-a63b-b460ae93613e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:30.120304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c4ec17e-0d0d-49ad-a63b-b460ae93613e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:30.121032 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c4ec17e-0d0d-49ad-a63b-b460ae93613e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:30.121521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c4ec17e-0d0d-49ad-a63b-b460ae93613e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:30.121965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5c4ec17e-0d0d-49ad-a63b-b460ae93613e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:30.301383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5c4ec17e-0d0d-49ad-a63b-b460ae93613e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:30.309847 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5c4ec17e-0d0d-49ad-a63b-b460ae93613e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1364 microversion: 2.1 time: 0.202986 Sep 07 13:37:30.310468 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3464/6956] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:30 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1364 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:31.022600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-4d2e62dc-2faf-4e24-82f8-0de7d7e8dbd6 req-bbb5acd9-cb4c-469c-bc41-c773be8c54a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d82c40-2803-474d-ad84-666897e7bbf9", "name": "network-vif-plugged", "status": "completed", "tag": "7252c726-077b-46a3-b20c-c169ad3e78ec"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:37:31.035194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4d2e62dc-2faf-4e24-82f8-0de7d7e8dbd6 req-bbb5acd9-cb4c-469c-bc41-c773be8c54a2 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:31.035699 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4d2e62dc-2faf-4e24-82f8-0de7d7e8dbd6 req-bbb5acd9-cb4c-469c-bc41-c773be8c54a2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:31.036152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4d2e62dc-2faf-4e24-82f8-0de7d7e8dbd6 req-bbb5acd9-cb4c-469c-bc41-c773be8c54a2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:31.048801 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-4d2e62dc-2faf-4e24-82f8-0de7d7e8dbd6 req-bbb5acd9-cb4c-469c-bc41-c773be8c54a2 service nova] Creating event network-vif-plugged:7252c726-077b-46a3-b20c-c169ad3e78ec for instance 09d82c40-2803-474d-ad84-666897e7bbf9 on n-h2-852087-9 Sep 07 13:37:31.058870 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-4d2e62dc-2faf-4e24-82f8-0de7d7e8dbd6 req-bbb5acd9-cb4c-469c-bc41-c773be8c54a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036409 Sep 07 13:37:31.058870 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3493/6957] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:31.334513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-995d8a8f-5638-4cb0-9730-fc9afd68001e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:31.335254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-995d8a8f-5638-4cb0-9730-fc9afd68001e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:31.343153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-995d8a8f-5638-4cb0-9730-fc9afd68001e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:31.343684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-995d8a8f-5638-4cb0-9730-fc9afd68001e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:31.344274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-995d8a8f-5638-4cb0-9730-fc9afd68001e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:31.344998 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-995d8a8f-5638-4cb0-9730-fc9afd68001e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:31.345441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-995d8a8f-5638-4cb0-9730-fc9afd68001e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:31.345876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-995d8a8f-5638-4cb0-9730-fc9afd68001e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:31.487884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-995d8a8f-5638-4cb0-9730-fc9afd68001e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:31.497378 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-995d8a8f-5638-4cb0-9730-fc9afd68001e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1364 microversion: 2.1 time: 0.167799 Sep 07 13:37:31.498053 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3465/6958] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:31 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:32.524253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b33ac99a-7192-4109-8cb1-6c97281b049b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:32.525054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b33ac99a-7192-4109-8cb1-6c97281b049b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:32.531900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b33ac99a-7192-4109-8cb1-6c97281b049b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:32.532384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b33ac99a-7192-4109-8cb1-6c97281b049b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:32.532843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b33ac99a-7192-4109-8cb1-6c97281b049b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:32.533596 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b33ac99a-7192-4109-8cb1-6c97281b049b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:32.534073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b33ac99a-7192-4109-8cb1-6c97281b049b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:32.534516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b33ac99a-7192-4109-8cb1-6c97281b049b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:32.678515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b33ac99a-7192-4109-8cb1-6c97281b049b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:37:32.686858 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b33ac99a-7192-4109-8cb1-6c97281b049b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1550 microversion: 2.1 time: 0.168490 Sep 07 13:37:32.687513 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3494/6959] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:37:32 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1550 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:37:32.712783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4b0ee49a-1ae8-4a44-95e1-9890e506e944 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:37:32.713356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4b0ee49a-1ae8-4a44-95e1-9890e506e944 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:37:32.720758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b0ee49a-1ae8-4a44-95e1-9890e506e944 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:32.721182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b0ee49a-1ae8-4a44-95e1-9890e506e944 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:32.721650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b0ee49a-1ae8-4a44-95e1-9890e506e944 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:32.722341 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b0ee49a-1ae8-4a44-95e1-9890e506e944 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:32.722792 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b0ee49a-1ae8-4a44-95e1-9890e506e944 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:32.723217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4b0ee49a-1ae8-4a44-95e1-9890e506e944 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:32.805867 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4b0ee49a-1ae8-4a44-95e1-9890e506e944 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097947 Sep 07 13:37:32.806628 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3466/6960] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Sep 7 13:37:32 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:37:34.174403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-7a64aa50-843e-4e24-b885-5b4a0ff3121e req-21953a1a-efbc-4f67-b5c2-8e2d62107b10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09d82c40-2803-474d-ad84-666897e7bbf9", "tag": "7252c726-077b-46a3-b20c-c169ad3e78ec"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:37:34.179536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:34.186891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7a64aa50-843e-4e24-b885-5b4a0ff3121e req-21953a1a-efbc-4f67-b5c2-8e2d62107b10 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:37:34.187400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7a64aa50-843e-4e24-b885-5b4a0ff3121e req-21953a1a-efbc-4f67-b5c2-8e2d62107b10 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:37:34.188279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7a64aa50-843e-4e24-b885-5b4a0ff3121e req-21953a1a-efbc-4f67-b5c2-8e2d62107b10 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:37:34.199821 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-7a64aa50-843e-4e24-b885-5b4a0ff3121e req-21953a1a-efbc-4f67-b5c2-8e2d62107b10 service nova] Creating event network-changed:7252c726-077b-46a3-b20c-c169ad3e78ec for instance 09d82c40-2803-474d-ad84-666897e7bbf9 on n-h2-852087-9 Sep 07 13:37:34.205186 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-7a64aa50-843e-4e24-b885-5b4a0ff3121e req-21953a1a-efbc-4f67-b5c2-8e2d62107b10 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034503 Sep 07 13:37:34.205909 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3495/6961] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:38:10.184540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:10.185275 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:10.187517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:10.188221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=32 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:10.192643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6c006c6b-9b2c-4256-84c2-1b561f0348dd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:10.193269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6c006c6b-9b2c-4256-84c2-1b561f0348dd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:10.202402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c006c6b-9b2c-4256-84c2-1b561f0348dd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:10.202945 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c006c6b-9b2c-4256-84c2-1b561f0348dd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:10.203389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c006c6b-9b2c-4256-84c2-1b561f0348dd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:10.204086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c006c6b-9b2c-4256-84c2-1b561f0348dd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:10.204544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c006c6b-9b2c-4256-84c2-1b561f0348dd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:10.204967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c006c6b-9b2c-4256-84c2-1b561f0348dd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:10.357599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6c006c6b-9b2c-4256-84c2-1b561f0348dd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:10.365756 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6c006c6b-9b2c-4256-84c2-1b561f0348dd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1669 microversion: 2.1 time: 0.182271 Sep 07 13:38:10.366340 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3467/6962] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:10 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1669 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:10.390141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b76cea72-5776-4045-bf4d-5a71dd79a0bb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:10.390870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b76cea72-5776-4045-bf4d-5a71dd79a0bb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:10.393309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:10.394199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=28 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:10.401328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b76cea72-5776-4045-bf4d-5a71dd79a0bb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:10.401862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b76cea72-5776-4045-bf4d-5a71dd79a0bb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:10.402323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b76cea72-5776-4045-bf4d-5a71dd79a0bb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:10.403036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b76cea72-5776-4045-bf4d-5a71dd79a0bb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:10.403511 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b76cea72-5776-4045-bf4d-5a71dd79a0bb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:10.403973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b76cea72-5776-4045-bf4d-5a71dd79a0bb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:10.558400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b76cea72-5776-4045-bf4d-5a71dd79a0bb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:10.569928 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b76cea72-5776-4045-bf4d-5a71dd79a0bb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1669 microversion: 2.1 time: 0.184124 Sep 07 13:38:10.570728 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3496/6963] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:10 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1669 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:10.595875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d9d1fc1-ab72-4262-806f-3ab5b42be5e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:10.596483 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9d9d1fc1-ab72-4262-806f-3ab5b42be5e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:10.602813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d9d1fc1-ab72-4262-806f-3ab5b42be5e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:10.603286 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d9d1fc1-ab72-4262-806f-3ab5b42be5e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:10.603724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d9d1fc1-ab72-4262-806f-3ab5b42be5e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:10.604406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d9d1fc1-ab72-4262-806f-3ab5b42be5e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:10.604868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d9d1fc1-ab72-4262-806f-3ab5b42be5e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:10.605305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d9d1fc1-ab72-4262-806f-3ab5b42be5e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:10.750691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9d9d1fc1-ab72-4262-806f-3ab5b42be5e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:10.760187 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9d9d1fc1-ab72-4262-806f-3ab5b42be5e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1669 microversion: 2.1 time: 0.168262 Sep 07 13:38:10.760776 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3468/6964] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:10 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1669 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:10.783241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cf972585-84ba-48ca-a659-97e9ee67c014 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:10.785582 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cf972585-84ba-48ca-a659-97e9ee67c014 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:10.792639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf972585-84ba-48ca-a659-97e9ee67c014 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:10.793146 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf972585-84ba-48ca-a659-97e9ee67c014 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:10.793644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf972585-84ba-48ca-a659-97e9ee67c014 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:10.794359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf972585-84ba-48ca-a659-97e9ee67c014 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:10.794827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf972585-84ba-48ca-a659-97e9ee67c014 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:10.795286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cf972585-84ba-48ca-a659-97e9ee67c014 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:10.825921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cf972585-84ba-48ca-a659-97e9ee67c014 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:10.832271 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cf972585-84ba-48ca-a659-97e9ee67c014 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Old instance type m1.heat2, new instance type m1.heat {{(pid=122433) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 13:38:10.839345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-cf972585-84ba-48ca-a659-97e9ee67c014 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:38:10.840154 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-cf972585-84ba-48ca-a659-97e9ee67c014 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:38:10.840650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-cf972585-84ba-48ca-a659-97e9ee67c014 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:38:10.841074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-cf972585-84ba-48ca-a659-97e9ee67c014 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:38:10.841505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-cf972585-84ba-48ca-a659-97e9ee67c014 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:38:10.911340 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cf972585-84ba-48ca-a659-97e9ee67c014 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "POST /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9/action" status: 202 len: 0 microversion: 2.1 time: 0.132142 Sep 07 13:38:10.911977 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3497/6965] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:38:10 2022] POST /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:38:10.920318 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1329799d-c530-4221-a1f0-3f11d2e4181e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:10.921117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1329799d-c530-4221-a1f0-3f11d2e4181e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:10.927886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1329799d-c530-4221-a1f0-3f11d2e4181e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:10.928414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1329799d-c530-4221-a1f0-3f11d2e4181e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:10.928862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1329799d-c530-4221-a1f0-3f11d2e4181e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:10.929667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1329799d-c530-4221-a1f0-3f11d2e4181e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:10.930185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1329799d-c530-4221-a1f0-3f11d2e4181e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:10.930685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1329799d-c530-4221-a1f0-3f11d2e4181e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:11.068683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1329799d-c530-4221-a1f0-3f11d2e4181e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:11.077076 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1329799d-c530-4221-a1f0-3f11d2e4181e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1678 microversion: 2.1 time: 0.160738 Sep 07 13:38:11.077814 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3469/6966] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:10 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:12.102324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d6fe2bd-805c-484d-b8bd-905b01f2909e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:12.103034 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1d6fe2bd-805c-484d-b8bd-905b01f2909e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:12.109998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d6fe2bd-805c-484d-b8bd-905b01f2909e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:12.110515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d6fe2bd-805c-484d-b8bd-905b01f2909e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:12.110974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d6fe2bd-805c-484d-b8bd-905b01f2909e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:12.111698 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d6fe2bd-805c-484d-b8bd-905b01f2909e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:12.112178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d6fe2bd-805c-484d-b8bd-905b01f2909e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:12.112628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d6fe2bd-805c-484d-b8bd-905b01f2909e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:12.258837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1d6fe2bd-805c-484d-b8bd-905b01f2909e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:12.267365 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1d6fe2bd-805c-484d-b8bd-905b01f2909e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1678 microversion: 2.1 time: 0.170125 Sep 07 13:38:12.267963 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3498/6967] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:12 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:13.292824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-190531e6-5543-4912-949c-12edb3a090c1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:13.293650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-190531e6-5543-4912-949c-12edb3a090c1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:13.302980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-190531e6-5543-4912-949c-12edb3a090c1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:13.303478 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-190531e6-5543-4912-949c-12edb3a090c1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:13.303986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-190531e6-5543-4912-949c-12edb3a090c1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:13.304617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-190531e6-5543-4912-949c-12edb3a090c1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:13.305081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-190531e6-5543-4912-949c-12edb3a090c1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:13.305545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-190531e6-5543-4912-949c-12edb3a090c1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:13.449964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-190531e6-5543-4912-949c-12edb3a090c1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:13.460028 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-190531e6-5543-4912-949c-12edb3a090c1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1683 microversion: 2.1 time: 0.172727 Sep 07 13:38:13.460618 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3470/6968] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:13 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:14.485773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aba1f603-c2e6-4680-bc9f-0ef1da541ed6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:14.486950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aba1f603-c2e6-4680-bc9f-0ef1da541ed6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:14.497644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aba1f603-c2e6-4680-bc9f-0ef1da541ed6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:14.498287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aba1f603-c2e6-4680-bc9f-0ef1da541ed6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:14.498906 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aba1f603-c2e6-4680-bc9f-0ef1da541ed6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:14.499912 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aba1f603-c2e6-4680-bc9f-0ef1da541ed6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:14.500548 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aba1f603-c2e6-4680-bc9f-0ef1da541ed6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:14.501147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aba1f603-c2e6-4680-bc9f-0ef1da541ed6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:14.649973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aba1f603-c2e6-4680-bc9f-0ef1da541ed6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:14.662235 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aba1f603-c2e6-4680-bc9f-0ef1da541ed6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1683 microversion: 2.1 time: 0.181264 Sep 07 13:38:14.663018 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3499/6969] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:14 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1683 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:15.691195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-634368f8-9d1a-47c6-a0a0-5457b35aa683 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:15.691821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-634368f8-9d1a-47c6-a0a0-5457b35aa683 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:15.699489 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-634368f8-9d1a-47c6-a0a0-5457b35aa683 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:15.699990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-634368f8-9d1a-47c6-a0a0-5457b35aa683 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:15.700440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-634368f8-9d1a-47c6-a0a0-5457b35aa683 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:15.701159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-634368f8-9d1a-47c6-a0a0-5457b35aa683 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:15.701643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-634368f8-9d1a-47c6-a0a0-5457b35aa683 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:15.702152 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-634368f8-9d1a-47c6-a0a0-5457b35aa683 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:15.841045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-634368f8-9d1a-47c6-a0a0-5457b35aa683 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:15.849599 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-634368f8-9d1a-47c6-a0a0-5457b35aa683 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1683 microversion: 2.1 time: 0.162380 Sep 07 13:38:15.850577 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3471/6970] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:15 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:16.873499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a9c677ce-4272-49c1-9232-3fac4a9ac9db tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:16.874430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a9c677ce-4272-49c1-9232-3fac4a9ac9db tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:16.882104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9c677ce-4272-49c1-9232-3fac4a9ac9db tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:16.882616 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9c677ce-4272-49c1-9232-3fac4a9ac9db tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:16.883095 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9c677ce-4272-49c1-9232-3fac4a9ac9db tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:16.883872 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9c677ce-4272-49c1-9232-3fac4a9ac9db tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:16.884487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9c677ce-4272-49c1-9232-3fac4a9ac9db tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:16.884956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9c677ce-4272-49c1-9232-3fac4a9ac9db tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:17.026997 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a9c677ce-4272-49c1-9232-3fac4a9ac9db tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:17.035744 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a9c677ce-4272-49c1-9232-3fac4a9ac9db tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1683 microversion: 2.1 time: 0.166261 Sep 07 13:38:17.036532 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3500/6971] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:16 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:18.076765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-05e9a772-0383-42a7-a1c6-8b8c65a1f09f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:18.077371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-05e9a772-0383-42a7-a1c6-8b8c65a1f09f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:18.084708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05e9a772-0383-42a7-a1c6-8b8c65a1f09f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:18.085161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05e9a772-0383-42a7-a1c6-8b8c65a1f09f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:18.085605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05e9a772-0383-42a7-a1c6-8b8c65a1f09f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:18.086330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05e9a772-0383-42a7-a1c6-8b8c65a1f09f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:18.087174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05e9a772-0383-42a7-a1c6-8b8c65a1f09f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:18.087742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05e9a772-0383-42a7-a1c6-8b8c65a1f09f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:18.232945 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-05e9a772-0383-42a7-a1c6-8b8c65a1f09f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:18.245315 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-05e9a772-0383-42a7-a1c6-8b8c65a1f09f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1683 microversion: 2.1 time: 0.172294 Sep 07 13:38:18.246223 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3472/6972] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:18 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:19.272856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f0949595-2c60-4b44-9b47-325d25bcf77e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:19.273428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f0949595-2c60-4b44-9b47-325d25bcf77e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:19.281754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0949595-2c60-4b44-9b47-325d25bcf77e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:19.282269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0949595-2c60-4b44-9b47-325d25bcf77e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:19.282735 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0949595-2c60-4b44-9b47-325d25bcf77e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:19.283456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0949595-2c60-4b44-9b47-325d25bcf77e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:19.283942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0949595-2c60-4b44-9b47-325d25bcf77e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:19.284425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0949595-2c60-4b44-9b47-325d25bcf77e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:19.423650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f0949595-2c60-4b44-9b47-325d25bcf77e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:19.432222 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f0949595-2c60-4b44-9b47-325d25bcf77e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1683 microversion: 2.1 time: 0.164053 Sep 07 13:38:19.432811 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3501/6973] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:19 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:20.458579 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-71789242-0d3e-48cf-9a22-f7be17d64bc9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:20.459472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-71789242-0d3e-48cf-9a22-f7be17d64bc9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:20.470367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71789242-0d3e-48cf-9a22-f7be17d64bc9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:20.470899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71789242-0d3e-48cf-9a22-f7be17d64bc9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:20.471481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71789242-0d3e-48cf-9a22-f7be17d64bc9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:20.472220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71789242-0d3e-48cf-9a22-f7be17d64bc9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:20.472814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71789242-0d3e-48cf-9a22-f7be17d64bc9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:20.473313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-71789242-0d3e-48cf-9a22-f7be17d64bc9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:20.617516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-71789242-0d3e-48cf-9a22-f7be17d64bc9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:20.630297 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-71789242-0d3e-48cf-9a22-f7be17d64bc9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1683 microversion: 2.1 time: 0.176482 Sep 07 13:38:20.631209 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3473/6974] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:20 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:21.659723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8d33bbb0-79c5-4274-bb32-208a1e7de57a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:21.660296 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8d33bbb0-79c5-4274-bb32-208a1e7de57a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:21.668101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d33bbb0-79c5-4274-bb32-208a1e7de57a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:21.668625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d33bbb0-79c5-4274-bb32-208a1e7de57a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:21.669072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d33bbb0-79c5-4274-bb32-208a1e7de57a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:21.669820 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d33bbb0-79c5-4274-bb32-208a1e7de57a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:21.670294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d33bbb0-79c5-4274-bb32-208a1e7de57a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:21.670738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8d33bbb0-79c5-4274-bb32-208a1e7de57a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:21.814131 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8d33bbb0-79c5-4274-bb32-208a1e7de57a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:21.830207 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8d33bbb0-79c5-4274-bb32-208a1e7de57a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1683 microversion: 2.1 time: 0.174177 Sep 07 13:38:21.830948 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3502/6975] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:21 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:22.864601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-824c3d06-d757-4060-915d-902ac8896bcb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:22.865222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-824c3d06-d757-4060-915d-902ac8896bcb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:22.872279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-824c3d06-d757-4060-915d-902ac8896bcb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:22.872777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-824c3d06-d757-4060-915d-902ac8896bcb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:22.873213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-824c3d06-d757-4060-915d-902ac8896bcb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:22.873988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-824c3d06-d757-4060-915d-902ac8896bcb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:22.874451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-824c3d06-d757-4060-915d-902ac8896bcb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:22.874878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-824c3d06-d757-4060-915d-902ac8896bcb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:23.026817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-824c3d06-d757-4060-915d-902ac8896bcb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:23.038135 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-824c3d06-d757-4060-915d-902ac8896bcb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1683 microversion: 2.1 time: 0.178833 Sep 07 13:38:23.038731 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3474/6976] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:22 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1683 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:24.062513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-55db4fcb-2003-485e-b0f3-84370fdc47a5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:24.063176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-55db4fcb-2003-485e-b0f3-84370fdc47a5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:24.070304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55db4fcb-2003-485e-b0f3-84370fdc47a5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:24.070806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55db4fcb-2003-485e-b0f3-84370fdc47a5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:24.071267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55db4fcb-2003-485e-b0f3-84370fdc47a5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:24.071975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55db4fcb-2003-485e-b0f3-84370fdc47a5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:24.072441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55db4fcb-2003-485e-b0f3-84370fdc47a5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:24.072881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-55db4fcb-2003-485e-b0f3-84370fdc47a5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:24.217762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-55db4fcb-2003-485e-b0f3-84370fdc47a5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:24.229540 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-55db4fcb-2003-485e-b0f3-84370fdc47a5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1683 microversion: 2.1 time: 0.170804 Sep 07 13:38:24.230367 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3503/6977] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:24 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:25.259774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-03d86a15-6561-4845-9155-a6cb6f5336b3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:25.260376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-03d86a15-6561-4845-9155-a6cb6f5336b3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:25.268047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03d86a15-6561-4845-9155-a6cb6f5336b3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:25.268540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03d86a15-6561-4845-9155-a6cb6f5336b3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:25.268979 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03d86a15-6561-4845-9155-a6cb6f5336b3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:25.269923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03d86a15-6561-4845-9155-a6cb6f5336b3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:25.270380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03d86a15-6561-4845-9155-a6cb6f5336b3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:25.270828 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03d86a15-6561-4845-9155-a6cb6f5336b3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:25.409075 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-03d86a15-6561-4845-9155-a6cb6f5336b3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:25.417637 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-03d86a15-6561-4845-9155-a6cb6f5336b3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1683 microversion: 2.1 time: 0.162057 Sep 07 13:38:25.418271 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3475/6978] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:25 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:26.442093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ec29063d-a3cf-477c-8c25-4082c799d8c0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:26.442700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ec29063d-a3cf-477c-8c25-4082c799d8c0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:26.450315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec29063d-a3cf-477c-8c25-4082c799d8c0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:26.450829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec29063d-a3cf-477c-8c25-4082c799d8c0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:26.451301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec29063d-a3cf-477c-8c25-4082c799d8c0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:26.452014 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec29063d-a3cf-477c-8c25-4082c799d8c0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:26.452507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec29063d-a3cf-477c-8c25-4082c799d8c0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:26.452973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ec29063d-a3cf-477c-8c25-4082c799d8c0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:26.602195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ec29063d-a3cf-477c-8c25-4082c799d8c0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:26.610748 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ec29063d-a3cf-477c-8c25-4082c799d8c0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1683 microversion: 2.1 time: 0.172767 Sep 07 13:38:26.611342 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3504/6979] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:26 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:27.642383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7ac480b2-117f-4289-9698-7bf72cc792b3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:27.643097 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7ac480b2-117f-4289-9698-7bf72cc792b3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:27.650848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ac480b2-117f-4289-9698-7bf72cc792b3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:27.651335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ac480b2-117f-4289-9698-7bf72cc792b3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:27.651767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ac480b2-117f-4289-9698-7bf72cc792b3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:27.652463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ac480b2-117f-4289-9698-7bf72cc792b3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:27.652916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ac480b2-117f-4289-9698-7bf72cc792b3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:27.653342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7ac480b2-117f-4289-9698-7bf72cc792b3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:27.791705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7ac480b2-117f-4289-9698-7bf72cc792b3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:27.800298 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7ac480b2-117f-4289-9698-7bf72cc792b3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1683 microversion: 2.1 time: 0.161870 Sep 07 13:38:27.800941 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3476/6980] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:27 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:28.824952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e304d145-6f0b-4843-81ea-b523b5f30d7a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:28.825642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e304d145-6f0b-4843-81ea-b523b5f30d7a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:28.833412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e304d145-6f0b-4843-81ea-b523b5f30d7a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:28.833955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e304d145-6f0b-4843-81ea-b523b5f30d7a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:28.834412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e304d145-6f0b-4843-81ea-b523b5f30d7a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:28.835125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e304d145-6f0b-4843-81ea-b523b5f30d7a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:28.835595 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e304d145-6f0b-4843-81ea-b523b5f30d7a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:28.836041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e304d145-6f0b-4843-81ea-b523b5f30d7a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:28.983854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e304d145-6f0b-4843-81ea-b523b5f30d7a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:28.992334 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e304d145-6f0b-4843-81ea-b523b5f30d7a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1683 microversion: 2.1 time: 0.171552 Sep 07 13:38:28.992934 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3505/6981] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:28 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:30.016514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-19f8b47a-9cb1-45f8-be9d-a13c529e04a0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:30.017121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-19f8b47a-9cb1-45f8-be9d-a13c529e04a0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:30.024365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19f8b47a-9cb1-45f8-be9d-a13c529e04a0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:30.024860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19f8b47a-9cb1-45f8-be9d-a13c529e04a0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:30.025292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19f8b47a-9cb1-45f8-be9d-a13c529e04a0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:30.026109 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19f8b47a-9cb1-45f8-be9d-a13c529e04a0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:30.026591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19f8b47a-9cb1-45f8-be9d-a13c529e04a0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:30.026988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-19f8b47a-9cb1-45f8-be9d-a13c529e04a0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:30.167621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-19f8b47a-9cb1-45f8-be9d-a13c529e04a0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:30.176112 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-19f8b47a-9cb1-45f8-be9d-a13c529e04a0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1683 microversion: 2.1 time: 0.163587 Sep 07 13:38:30.176696 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3477/6982] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:30 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:30.652924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-dd6e6392-2198-4d0f-906d-e8943da446de req-d0e1a120-57f8-49a0-b561-3a17a019cc36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d82c40-2803-474d-ad84-666897e7bbf9", "name": "network-vif-unplugged", "status": "completed", "tag": "7252c726-077b-46a3-b20c-c169ad3e78ec"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:30.664085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-dd6e6392-2198-4d0f-906d-e8943da446de req-d0e1a120-57f8-49a0-b561-3a17a019cc36 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:30.664587 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-dd6e6392-2198-4d0f-906d-e8943da446de req-d0e1a120-57f8-49a0-b561-3a17a019cc36 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:30.665039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-dd6e6392-2198-4d0f-906d-e8943da446de req-d0e1a120-57f8-49a0-b561-3a17a019cc36 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:30.678736 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-dd6e6392-2198-4d0f-906d-e8943da446de req-d0e1a120-57f8-49a0-b561-3a17a019cc36 service nova] Creating event network-vif-unplugged:7252c726-077b-46a3-b20c-c169ad3e78ec for instance 09d82c40-2803-474d-ad84-666897e7bbf9 on n-h1-852087-9 Sep 07 13:38:30.684863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-dd6e6392-2198-4d0f-906d-e8943da446de req-d0e1a120-57f8-49a0-b561-3a17a019cc36 service nova] Instance 09d82c40-2803-474d-ad84-666897e7bbf9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:38:30.696618 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-dd6e6392-2198-4d0f-906d-e8943da446de req-d0e1a120-57f8-49a0-b561-3a17a019cc36 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047651 Sep 07 13:38:30.697205 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3506/6983] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:38:31.200009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f9f0ef15-985d-475c-aff7-0dd03b67d48f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:31.200639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f9f0ef15-985d-475c-aff7-0dd03b67d48f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:31.209153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9f0ef15-985d-475c-aff7-0dd03b67d48f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:31.210039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9f0ef15-985d-475c-aff7-0dd03b67d48f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:31.211043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9f0ef15-985d-475c-aff7-0dd03b67d48f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:31.211819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9f0ef15-985d-475c-aff7-0dd03b67d48f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:31.212406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9f0ef15-985d-475c-aff7-0dd03b67d48f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:31.213362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9f0ef15-985d-475c-aff7-0dd03b67d48f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:31.352526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f9f0ef15-985d-475c-aff7-0dd03b67d48f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:31.361148 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f9f0ef15-985d-475c-aff7-0dd03b67d48f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1682 microversion: 2.1 time: 0.165130 Sep 07 13:38:31.361797 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3478/6984] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:31 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:32.387223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c7102723-6808-408e-a2f6-781ab6916cd5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:32.387947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c7102723-6808-408e-a2f6-781ab6916cd5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:32.394911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7102723-6808-408e-a2f6-781ab6916cd5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:32.395422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7102723-6808-408e-a2f6-781ab6916cd5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:32.395880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7102723-6808-408e-a2f6-781ab6916cd5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:32.396612 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7102723-6808-408e-a2f6-781ab6916cd5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:32.397104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7102723-6808-408e-a2f6-781ab6916cd5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:32.397590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c7102723-6808-408e-a2f6-781ab6916cd5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:32.540904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c7102723-6808-408e-a2f6-781ab6916cd5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:32.549517 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c7102723-6808-408e-a2f6-781ab6916cd5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1680 microversion: 2.1 time: 0.167800 Sep 07 13:38:32.550108 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3507/6985] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:32 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:32.733006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-155529ae-78a5-4ded-a4d7-480301eecb35 req-edb1b475-38dd-4d49-ae64-62f2851d2430 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09d82c40-2803-474d-ad84-666897e7bbf9", "tag": "7252c726-077b-46a3-b20c-c169ad3e78ec"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:32.743665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-155529ae-78a5-4ded-a4d7-480301eecb35 req-edb1b475-38dd-4d49-ae64-62f2851d2430 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:32.744158 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-155529ae-78a5-4ded-a4d7-480301eecb35 req-edb1b475-38dd-4d49-ae64-62f2851d2430 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:32.744578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-155529ae-78a5-4ded-a4d7-480301eecb35 req-edb1b475-38dd-4d49-ae64-62f2851d2430 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:32.756258 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-155529ae-78a5-4ded-a4d7-480301eecb35 req-edb1b475-38dd-4d49-ae64-62f2851d2430 service nova] Creating event network-changed:7252c726-077b-46a3-b20c-c169ad3e78ec for instance 09d82c40-2803-474d-ad84-666897e7bbf9 on n-h1-852087-9 Sep 07 13:38:32.761990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-155529ae-78a5-4ded-a4d7-480301eecb35 req-edb1b475-38dd-4d49-ae64-62f2851d2430 service nova] Instance 09d82c40-2803-474d-ad84-666897e7bbf9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:38:32.772798 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-155529ae-78a5-4ded-a4d7-480301eecb35 req-edb1b475-38dd-4d49-ae64-62f2851d2430 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043799 Sep 07 13:38:32.773529 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3479/6986] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:38:33.574305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-489a9428-e5b6-40be-8474-a1f59cc09e8d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:33.574900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-489a9428-e5b6-40be-8474-a1f59cc09e8d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:33.582254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-489a9428-e5b6-40be-8474-a1f59cc09e8d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:33.582764 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-489a9428-e5b6-40be-8474-a1f59cc09e8d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:33.583214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-489a9428-e5b6-40be-8474-a1f59cc09e8d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:33.583934 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-489a9428-e5b6-40be-8474-a1f59cc09e8d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:33.584399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-489a9428-e5b6-40be-8474-a1f59cc09e8d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:33.584859 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-489a9428-e5b6-40be-8474-a1f59cc09e8d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:33.722089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-489a9428-e5b6-40be-8474-a1f59cc09e8d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:33.735073 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-489a9428-e5b6-40be-8474-a1f59cc09e8d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1680 microversion: 2.1 time: 0.164661 Sep 07 13:38:33.735917 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3508/6987] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:33 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:34.765253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ba94cd07-d421-4d90-b523-caa0d5f58d0d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:34.766742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ba94cd07-d421-4d90-b523-caa0d5f58d0d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:34.777138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba94cd07-d421-4d90-b523-caa0d5f58d0d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:34.777640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba94cd07-d421-4d90-b523-caa0d5f58d0d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:34.778084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba94cd07-d421-4d90-b523-caa0d5f58d0d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:34.778794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba94cd07-d421-4d90-b523-caa0d5f58d0d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:34.779252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba94cd07-d421-4d90-b523-caa0d5f58d0d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:34.779690 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ba94cd07-d421-4d90-b523-caa0d5f58d0d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:34.922065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ba94cd07-d421-4d90-b523-caa0d5f58d0d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:34.930173 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ba94cd07-d421-4d90-b523-caa0d5f58d0d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1680 microversion: 2.1 time: 0.173344 Sep 07 13:38:34.930761 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3480/6988] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:34 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:35.958736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ce20bf1e-64f5-46ab-94bf-09c7888e79bd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:35.959334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ce20bf1e-64f5-46ab-94bf-09c7888e79bd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:35.968902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce20bf1e-64f5-46ab-94bf-09c7888e79bd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:35.969499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce20bf1e-64f5-46ab-94bf-09c7888e79bd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:35.969972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce20bf1e-64f5-46ab-94bf-09c7888e79bd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:35.970684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce20bf1e-64f5-46ab-94bf-09c7888e79bd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:35.971155 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce20bf1e-64f5-46ab-94bf-09c7888e79bd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:35.971613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce20bf1e-64f5-46ab-94bf-09c7888e79bd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:36.109918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ce20bf1e-64f5-46ab-94bf-09c7888e79bd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:36.119762 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ce20bf1e-64f5-46ab-94bf-09c7888e79bd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1677 microversion: 2.1 time: 0.166875 Sep 07 13:38:36.123167 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3509/6989] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:35 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:36.143249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1b9a7e08-84b0-4ae2-b54b-c192e0420e58 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:36.143812 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1b9a7e08-84b0-4ae2-b54b-c192e0420e58 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:36.151255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b9a7e08-84b0-4ae2-b54b-c192e0420e58 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:36.151668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b9a7e08-84b0-4ae2-b54b-c192e0420e58 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:36.152100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b9a7e08-84b0-4ae2-b54b-c192e0420e58 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:36.152831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b9a7e08-84b0-4ae2-b54b-c192e0420e58 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:36.153278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b9a7e08-84b0-4ae2-b54b-c192e0420e58 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:36.153717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b9a7e08-84b0-4ae2-b54b-c192e0420e58 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:36.227516 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1b9a7e08-84b0-4ae2-b54b-c192e0420e58 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "POST /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9/action" status: 204 len: 0 microversion: 2.1 time: 0.087785 Sep 07 13:38:36.228331 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3481/6990] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:38:36 2022] POST /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9/action => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:38:36.237511 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-62ddaf6a-ab2c-4805-ad24-52ad46b9167b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:36.238158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-62ddaf6a-ab2c-4805-ad24-52ad46b9167b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:36.244460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62ddaf6a-ab2c-4805-ad24-52ad46b9167b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:36.245006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62ddaf6a-ab2c-4805-ad24-52ad46b9167b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:36.245533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62ddaf6a-ab2c-4805-ad24-52ad46b9167b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:36.246318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62ddaf6a-ab2c-4805-ad24-52ad46b9167b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:36.246839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62ddaf6a-ab2c-4805-ad24-52ad46b9167b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:36.247337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-62ddaf6a-ab2c-4805-ad24-52ad46b9167b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:36.397837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-62ddaf6a-ab2c-4805-ad24-52ad46b9167b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:36.406038 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-62ddaf6a-ab2c-4805-ad24-52ad46b9167b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1677 microversion: 2.1 time: 0.172362 Sep 07 13:38:36.406566 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3510/6991] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:36 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:37.430568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-acf4c094-c094-4cc1-9b93-2bbe74f8ae9f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:37.431275 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-acf4c094-c094-4cc1-9b93-2bbe74f8ae9f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:37.437899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acf4c094-c094-4cc1-9b93-2bbe74f8ae9f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:37.438399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acf4c094-c094-4cc1-9b93-2bbe74f8ae9f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:37.438840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acf4c094-c094-4cc1-9b93-2bbe74f8ae9f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:37.439552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acf4c094-c094-4cc1-9b93-2bbe74f8ae9f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:37.439998 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acf4c094-c094-4cc1-9b93-2bbe74f8ae9f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:37.440430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-acf4c094-c094-4cc1-9b93-2bbe74f8ae9f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:37.586753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-acf4c094-c094-4cc1-9b93-2bbe74f8ae9f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:37.589321 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:37.597020 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-acf4c094-c094-4cc1-9b93-2bbe74f8ae9f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1677 microversion: 2.1 time: 0.171724 Sep 07 13:38:37.597836 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3482/6992] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:37 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:38.620958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6aa2521c-6459-4d78-8d17-aa82c31096d0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:38.625151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6aa2521c-6459-4d78-8d17-aa82c31096d0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:38.636245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa2521c-6459-4d78-8d17-aa82c31096d0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:38.636245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa2521c-6459-4d78-8d17-aa82c31096d0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:38.636518 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa2521c-6459-4d78-8d17-aa82c31096d0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:38.637403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa2521c-6459-4d78-8d17-aa82c31096d0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:38.637928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa2521c-6459-4d78-8d17-aa82c31096d0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:38.638348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6aa2521c-6459-4d78-8d17-aa82c31096d0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:38.658478 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:38.777749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-376388e0-9f70-4349-b8ed-c97a80a956eb req-6c471fe8-3fad-4cb4-9e49-c1909e471f8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d82c40-2803-474d-ad84-666897e7bbf9", "name": "network-vif-plugged", "status": "completed", "tag": "7252c726-077b-46a3-b20c-c169ad3e78ec"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:38.781609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6aa2521c-6459-4d78-8d17-aa82c31096d0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:38.790179 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6aa2521c-6459-4d78-8d17-aa82c31096d0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1669 microversion: 2.1 time: 0.173239 Sep 07 13:38:38.805523 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3511/6993] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:38 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1669 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:38.805764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-376388e0-9f70-4349-b8ed-c97a80a956eb req-6c471fe8-3fad-4cb4-9e49-c1909e471f8e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:38.805764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-376388e0-9f70-4349-b8ed-c97a80a956eb req-6c471fe8-3fad-4cb4-9e49-c1909e471f8e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:38.805764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-376388e0-9f70-4349-b8ed-c97a80a956eb req-6c471fe8-3fad-4cb4-9e49-c1909e471f8e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:38.810081 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-376388e0-9f70-4349-b8ed-c97a80a956eb req-6c471fe8-3fad-4cb4-9e49-c1909e471f8e service nova] Creating event network-vif-plugged:7252c726-077b-46a3-b20c-c169ad3e78ec for instance 09d82c40-2803-474d-ad84-666897e7bbf9 on n-h1-852087-9 Sep 07 13:38:38.814528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3779ba0d-fcb6-4f57-9705-3716dfcb2a4c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:38.815163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3779ba0d-fcb6-4f57-9705-3716dfcb2a4c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:38.815311 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-376388e0-9f70-4349-b8ed-c97a80a956eb req-6c471fe8-3fad-4cb4-9e49-c1909e471f8e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042237 Sep 07 13:38:38.815865 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3483/6994] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:38:38.821257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3779ba0d-fcb6-4f57-9705-3716dfcb2a4c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:38.821803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3779ba0d-fcb6-4f57-9705-3716dfcb2a4c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:38.822259 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3779ba0d-fcb6-4f57-9705-3716dfcb2a4c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:38.822972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3779ba0d-fcb6-4f57-9705-3716dfcb2a4c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:38.823441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3779ba0d-fcb6-4f57-9705-3716dfcb2a4c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:38.823881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3779ba0d-fcb6-4f57-9705-3716dfcb2a4c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:38.963775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3779ba0d-fcb6-4f57-9705-3716dfcb2a4c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:38.972622 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3779ba0d-fcb6-4f57-9705-3716dfcb2a4c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1669 microversion: 2.1 time: 0.161893 Sep 07 13:38:38.973205 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3512/6995] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:38 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:38:38.995498 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-856bdcc1-b7fd-46fc-bc46-fb743c348eeb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:38.996311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-856bdcc1-b7fd-46fc-bc46-fb743c348eeb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:39.002924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-856bdcc1-b7fd-46fc-bc46-fb743c348eeb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:39.003457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-856bdcc1-b7fd-46fc-bc46-fb743c348eeb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:39.003898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-856bdcc1-b7fd-46fc-bc46-fb743c348eeb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:39.004599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-856bdcc1-b7fd-46fc-bc46-fb743c348eeb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:39.005056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-856bdcc1-b7fd-46fc-bc46-fb743c348eeb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:39.005610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-856bdcc1-b7fd-46fc-bc46-fb743c348eeb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:39.151478 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-856bdcc1-b7fd-46fc-bc46-fb743c348eeb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:39.160382 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-856bdcc1-b7fd-46fc-bc46-fb743c348eeb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1669 microversion: 2.1 time: 0.168943 Sep 07 13:38:39.160748 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3484/6996] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:38 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1669 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:39.182797 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ef9777d2-a791-40df-9d31-15199a208158 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:39.183368 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ef9777d2-a791-40df-9d31-15199a208158 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:39.190110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef9777d2-a791-40df-9d31-15199a208158 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:39.190646 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef9777d2-a791-40df-9d31-15199a208158 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:39.191075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef9777d2-a791-40df-9d31-15199a208158 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:39.191786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef9777d2-a791-40df-9d31-15199a208158 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:39.192270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef9777d2-a791-40df-9d31-15199a208158 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:39.192718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef9777d2-a791-40df-9d31-15199a208158 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:39.220233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ef9777d2-a791-40df-9d31-15199a208158 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:38:39.315331 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ef9777d2-a791-40df-9d31-15199a208158 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "DELETE /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 204 len: 0 microversion: 2.1 time: 0.136295 Sep 07 13:38:39.315959 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3513/6997] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:38:39 2022] DELETE /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:38:39.325104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c2d38d9b-7109-4976-8151-4f40074415e5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:39.325755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c2d38d9b-7109-4976-8151-4f40074415e5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:39.332107 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2d38d9b-7109-4976-8151-4f40074415e5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:39.332588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2d38d9b-7109-4976-8151-4f40074415e5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:39.333029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2d38d9b-7109-4976-8151-4f40074415e5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:39.333794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2d38d9b-7109-4976-8151-4f40074415e5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:39.334257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2d38d9b-7109-4976-8151-4f40074415e5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:39.334690 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c2d38d9b-7109-4976-8151-4f40074415e5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:39.484556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c2d38d9b-7109-4976-8151-4f40074415e5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:39.496273 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c2d38d9b-7109-4976-8151-4f40074415e5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1675 microversion: 2.1 time: 0.175266 Sep 07 13:38:39.496858 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3485/6998] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:39 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1675 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:40.521571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ae5d0139-b678-4977-aca6-28e75c813d07 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:40.522425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ae5d0139-b678-4977-aca6-28e75c813d07 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:40.525257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:40.531854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae5d0139-b678-4977-aca6-28e75c813d07 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:40.532372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae5d0139-b678-4977-aca6-28e75c813d07 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:40.532859 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae5d0139-b678-4977-aca6-28e75c813d07 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:40.533823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae5d0139-b678-4977-aca6-28e75c813d07 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:40.534334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae5d0139-b678-4977-aca6-28e75c813d07 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:40.534781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ae5d0139-b678-4977-aca6-28e75c813d07 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:40.686247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ae5d0139-b678-4977-aca6-28e75c813d07 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:40.696095 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ae5d0139-b678-4977-aca6-28e75c813d07 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1675 microversion: 2.1 time: 0.179236 Sep 07 13:38:40.696794 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3514/6999] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:40 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1675 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:41.723337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-95b030d4-a9d1-4957-b082-40daae66a3fd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:41.723962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-95b030d4-a9d1-4957-b082-40daae66a3fd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:41.727668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=39 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:41.733973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95b030d4-a9d1-4957-b082-40daae66a3fd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:41.734466 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95b030d4-a9d1-4957-b082-40daae66a3fd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:41.734913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95b030d4-a9d1-4957-b082-40daae66a3fd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:41.735659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95b030d4-a9d1-4957-b082-40daae66a3fd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:41.736116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95b030d4-a9d1-4957-b082-40daae66a3fd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:41.736545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95b030d4-a9d1-4957-b082-40daae66a3fd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:41.801230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-95b030d4-a9d1-4957-b082-40daae66a3fd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:41.810774 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-95b030d4-a9d1-4957-b082-40daae66a3fd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 200 len: 1608 microversion: 2.1 time: 0.091274 Sep 07 13:38:41.812027 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3486/7000] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:41 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 1608 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:41.939317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-84b41287-27cb-4349-8a30-bcd53fa67751 req-a4f2771d-4800-4d8b-aaad-4b1532e99d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d82c40-2803-474d-ad84-666897e7bbf9", "name": "network-vif-deleted", "tag": "7252c726-077b-46a3-b20c-c169ad3e78ec"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:41.953021 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-84b41287-27cb-4349-8a30-bcd53fa67751 req-a4f2771d-4800-4d8b-aaad-4b1532e99d54 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:41.953925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-84b41287-27cb-4349-8a30-bcd53fa67751 req-a4f2771d-4800-4d8b-aaad-4b1532e99d54 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:41.954382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-84b41287-27cb-4349-8a30-bcd53fa67751 req-a4f2771d-4800-4d8b-aaad-4b1532e99d54 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:41.968677 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-84b41287-27cb-4349-8a30-bcd53fa67751 req-a4f2771d-4800-4d8b-aaad-4b1532e99d54 service nova] Creating event network-vif-deleted:7252c726-077b-46a3-b20c-c169ad3e78ec for instance 09d82c40-2803-474d-ad84-666897e7bbf9 on n-h1-852087-9 Sep 07 13:38:41.974625 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-84b41287-27cb-4349-8a30-bcd53fa67751 req-a4f2771d-4800-4d8b-aaad-4b1532e99d54 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119539 Sep 07 13:38:41.975669 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3515/7001] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:38:42.835715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-16acf824-8503-46d8-b568-ef80ddec66f4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:42.836480 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-16acf824-8503-46d8-b568-ef80ddec66f4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:42.844507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16acf824-8503-46d8-b568-ef80ddec66f4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:42.845010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16acf824-8503-46d8-b568-ef80ddec66f4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:42.845441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16acf824-8503-46d8-b568-ef80ddec66f4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:42.846179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16acf824-8503-46d8-b568-ef80ddec66f4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:42.846629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16acf824-8503-46d8-b568-ef80ddec66f4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:42.847055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16acf824-8503-46d8-b568-ef80ddec66f4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:42.861474 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-16acf824-8503-46d8-b568-ef80ddec66f4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] HTTP exception thrown: Instance 09d82c40-2803-474d-ad84-666897e7bbf9 could not be found. Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-16acf824-8503-46d8-b568-ef80ddec66f4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Request method failure captured: Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 HTTP/1.1 Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJ6Qa8Wgx3edQ7CXPA7GMXkRXsD6n0ODz0fJ4U_HSdO27cMoqedxiUWhG-0C6635gytRmbSHGz9fwKnUkfS2q0gSeQ7nm1CzWfB0bTkZfTtk2qgxY2gxQer8R0l1g7MVKHxAmv0Z5uiEW3b338LhbLsy-_HbtXv9ZiSJd_u4NfmTSZM Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_396666be58fa42568bdfa2652d635a41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/396666be58fa42568bdfa2652d635a41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: bb0e9196784341cbb170c1c055e8966f Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 09d82c40-2803-474d-ad84-666897e7bbf9 could not be found. Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '09d82c40-2803-474d-ad84-666897e7bbf9'} Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09d82c40-2803-474d-ad84-666897e7bbf9 could not be found. Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09d82c40-2803-474d-ad84-666897e7bbf9 could not be found. Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:38:42.863477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:38:42.871401 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:38:42.871401 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:38:42.871401 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:38:42.871401 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:38:42.871401 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:38:42.871401 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09d82c40-2803-474d-ad84-666897e7bbf9 could not be found. Sep 07 13:38:42.871401 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:38:42.871401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-16acf824-8503-46d8-b568-ef80ddec66f4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Returning 404 to user: Instance 09d82c40-2803-474d-ad84-666897e7bbf9 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:38:42.871401 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-16acf824-8503-46d8-b568-ef80ddec66f4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 404 len: 111 microversion: 2.1 time: 0.033219 Sep 07 13:38:42.871401 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3487/7002] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:42 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:38:42.881377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3a3106a7-0d34-4614-a6ab-42ca55bb918e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:42.882435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3a3106a7-0d34-4614-a6ab-42ca55bb918e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:42.890813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a3106a7-0d34-4614-a6ab-42ca55bb918e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:42.891330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a3106a7-0d34-4614-a6ab-42ca55bb918e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:42.891808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a3106a7-0d34-4614-a6ab-42ca55bb918e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:42.892539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a3106a7-0d34-4614-a6ab-42ca55bb918e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:42.893013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a3106a7-0d34-4614-a6ab-42ca55bb918e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:42.893457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3a3106a7-0d34-4614-a6ab-42ca55bb918e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:42.912064 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-3a3106a7-0d34-4614-a6ab-42ca55bb918e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] HTTP exception thrown: Instance 09d82c40-2803-474d-ad84-666897e7bbf9 could not be found. Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3a3106a7-0d34-4614-a6ab-42ca55bb918e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Request method failure captured: Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 HTTP/1.1 Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJ6Qa8Wgx3edQ7CXPA7GMXkRXsD6n0ODz0fJ4U_HSdO27cMoqedxiUWhG-0C6635gytRmbSHGz9fwKnUkfS2q0gSeQ7nm1CzWfB0bTkZfTtk2qgxY2gxQer8R0l1g7MVKHxAmv0Z5uiEW3b338LhbLsy-_HbtXv9ZiSJd_u4NfmTSZM Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_396666be58fa42568bdfa2652d635a41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/396666be58fa42568bdfa2652d635a41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: bb0e9196784341cbb170c1c055e8966f Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 09d82c40-2803-474d-ad84-666897e7bbf9 could not be found. Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '09d82c40-2803-474d-ad84-666897e7bbf9'} Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09d82c40-2803-474d-ad84-666897e7bbf9 could not be found. Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09d82c40-2803-474d-ad84-666897e7bbf9 could not be found. Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:38:42.913813 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:38:42.917748 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:38:42.917748 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:38:42.917748 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:38:42.917748 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:38:42.917748 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:38:42.917748 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09d82c40-2803-474d-ad84-666897e7bbf9 could not be found. Sep 07 13:38:42.917748 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:38:42.917748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3a3106a7-0d34-4614-a6ab-42ca55bb918e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Returning 404 to user: Instance 09d82c40-2803-474d-ad84-666897e7bbf9 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:38:42.917748 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3a3106a7-0d34-4614-a6ab-42ca55bb918e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 404 len: 111 microversion: 2.1 time: 0.038419 Sep 07 13:38:42.917748 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3516/7003] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:42 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:38:42.966192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-78f3aaec-6c17-4e60-b76b-24ec2f597398 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-999825580", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "c0ae2db3-d205-4102-b4b3-830cdd7a4274"}], "security_groups": [{"name": "tempest-securitygroup--971767124"}], "key_name": "tempest-keypair-1624528547", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:43.080472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-78f3aaec-6c17-4e60-b76b-24ec2f597398 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] validate_networks() for [('c0ae2db3-d205-4102-b4b3-830cdd7a4274', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:38:43.490473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-78f3aaec-6c17-4e60-b76b-24ec2f597398 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:38:43.490895 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-78f3aaec-6c17-4e60-b76b-24ec2f597398 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:38:43.491507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-78f3aaec-6c17-4e60-b76b-24ec2f597398 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:38:43.491918 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-78f3aaec-6c17-4e60-b76b-24ec2f597398 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:38:43.492335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-78f3aaec-6c17-4e60-b76b-24ec2f597398 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:38:43.501985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78f3aaec-6c17-4e60-b76b-24ec2f597398 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:43.502470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78f3aaec-6c17-4e60-b76b-24ec2f597398 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:43.502908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78f3aaec-6c17-4e60-b76b-24ec2f597398 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:43.503629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78f3aaec-6c17-4e60-b76b-24ec2f597398 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:43.504240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78f3aaec-6c17-4e60-b76b-24ec2f597398 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:43.504663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78f3aaec-6c17-4e60-b76b-24ec2f597398 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:43.522794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-78f3aaec-6c17-4e60-b76b-24ec2f597398 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Getting quotas for project 396666be58fa42568bdfa2652d635a41. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:38:43.528244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-78f3aaec-6c17-4e60-b76b-24ec2f597398 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Getting quotas for user bb0e9196784341cbb170c1c055e8966f and project 396666be58fa42568bdfa2652d635a41. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:38:43.540896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-78f3aaec-6c17-4e60-b76b-24ec2f597398 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:38:43.543302 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-78f3aaec-6c17-4e60-b76b-24ec2f597398 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:38:43.591428 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-78f3aaec-6c17-4e60-b76b-24ec2f597398 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.629580 Sep 07 13:38:43.592441 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3488/7004] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:38:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:38:43.603789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0164fb8f-c285-4a74-8b78-38b1541a040f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:43.604674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0164fb8f-c285-4a74-8b78-38b1541a040f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:43.664489 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0164fb8f-c285-4a74-8b78-38b1541a040f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:43.672687 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0164fb8f-c285-4a74-8b78-38b1541a040f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1238 microversion: 2.1 time: 0.072872 Sep 07 13:38:43.673279 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3517/7005] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:43 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:44.698563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-08cc7624-3a6a-40be-b355-73a38e23a625 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:44.699636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-08cc7624-3a6a-40be-b355-73a38e23a625 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:44.709006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08cc7624-3a6a-40be-b355-73a38e23a625 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:44.709661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08cc7624-3a6a-40be-b355-73a38e23a625 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:44.710297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08cc7624-3a6a-40be-b355-73a38e23a625 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:44.711078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08cc7624-3a6a-40be-b355-73a38e23a625 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:44.711533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08cc7624-3a6a-40be-b355-73a38e23a625 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:44.711961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08cc7624-3a6a-40be-b355-73a38e23a625 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:44.786143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-08cc7624-3a6a-40be-b355-73a38e23a625 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:44.794758 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-08cc7624-3a6a-40be-b355-73a38e23a625 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1290 microversion: 2.1 time: 0.101990 Sep 07 13:38:44.795720 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3489/7006] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:44 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1290 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:45.822124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cd8bbbe9-9c52-4b4f-bad6-9572c5f814cd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:45.822761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cd8bbbe9-9c52-4b4f-bad6-9572c5f814cd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:45.831877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd8bbbe9-9c52-4b4f-bad6-9572c5f814cd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:45.832613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd8bbbe9-9c52-4b4f-bad6-9572c5f814cd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:45.833078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd8bbbe9-9c52-4b4f-bad6-9572c5f814cd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:45.833823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd8bbbe9-9c52-4b4f-bad6-9572c5f814cd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:45.834444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd8bbbe9-9c52-4b4f-bad6-9572c5f814cd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:45.834903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd8bbbe9-9c52-4b4f-bad6-9572c5f814cd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:45.970765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cd8bbbe9-9c52-4b4f-bad6-9572c5f814cd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:45.979261 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cd8bbbe9-9c52-4b4f-bad6-9572c5f814cd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1363 microversion: 2.1 time: 0.163541 Sep 07 13:38:45.979835 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3518/7007] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:45 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:46.613432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d1926d1a-75a6-4adc-a2b9-2c3c72725efd req-284344cb-05f6-46ad-bce9-0f09d12b421e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "824957b8-3a81-4a12-ac73-f3506ba5c415", "tag": "10e6ff55-0066-4641-ab78-44802055451c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:46.626604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d1926d1a-75a6-4adc-a2b9-2c3c72725efd req-284344cb-05f6-46ad-bce9-0f09d12b421e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:46.627322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d1926d1a-75a6-4adc-a2b9-2c3c72725efd req-284344cb-05f6-46ad-bce9-0f09d12b421e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:46.627859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d1926d1a-75a6-4adc-a2b9-2c3c72725efd req-284344cb-05f6-46ad-bce9-0f09d12b421e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:46.639920 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d1926d1a-75a6-4adc-a2b9-2c3c72725efd req-284344cb-05f6-46ad-bce9-0f09d12b421e service nova] Creating event network-changed:10e6ff55-0066-4641-ab78-44802055451c for instance 824957b8-3a81-4a12-ac73-f3506ba5c415 on n-h2-852087-9 Sep 07 13:38:46.644942 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d1926d1a-75a6-4adc-a2b9-2c3c72725efd req-284344cb-05f6-46ad-bce9-0f09d12b421e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035406 Sep 07 13:38:46.645576 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3490/7008] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:38:47.004305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e9a40397-d2fa-4a5e-91e5-c016a62268ad tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:47.005048 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e9a40397-d2fa-4a5e-91e5-c016a62268ad tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:47.012697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9a40397-d2fa-4a5e-91e5-c016a62268ad tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:47.013210 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9a40397-d2fa-4a5e-91e5-c016a62268ad tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:47.013695 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9a40397-d2fa-4a5e-91e5-c016a62268ad tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:47.014443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9a40397-d2fa-4a5e-91e5-c016a62268ad tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:47.014918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9a40397-d2fa-4a5e-91e5-c016a62268ad tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:47.015361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e9a40397-d2fa-4a5e-91e5-c016a62268ad tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:47.159008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e9a40397-d2fa-4a5e-91e5-c016a62268ad tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:47.167333 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e9a40397-d2fa-4a5e-91e5-c016a62268ad tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1363 microversion: 2.1 time: 0.167145 Sep 07 13:38:47.167920 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3519/7009] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:46 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:48.192141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7f866bee-c1fe-42de-ab67-b08c53ecfbee tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:48.192846 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7f866bee-c1fe-42de-ab67-b08c53ecfbee tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:48.199558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f866bee-c1fe-42de-ab67-b08c53ecfbee tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:48.200056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f866bee-c1fe-42de-ab67-b08c53ecfbee tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:48.200500 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f866bee-c1fe-42de-ab67-b08c53ecfbee tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:48.201205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f866bee-c1fe-42de-ab67-b08c53ecfbee tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:48.201715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f866bee-c1fe-42de-ab67-b08c53ecfbee tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:48.202288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7f866bee-c1fe-42de-ab67-b08c53ecfbee tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:48.343840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7f866bee-c1fe-42de-ab67-b08c53ecfbee tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:48.352912 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7f866bee-c1fe-42de-ab67-b08c53ecfbee tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1363 microversion: 2.1 time: 0.165817 Sep 07 13:38:48.354027 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3491/7010] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:48 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:49.377607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a66dfc29-e83c-4c38-b08c-c6ad6bbdca6f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:49.378292 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a66dfc29-e83c-4c38-b08c-c6ad6bbdca6f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:49.385882 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a66dfc29-e83c-4c38-b08c-c6ad6bbdca6f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:49.386377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a66dfc29-e83c-4c38-b08c-c6ad6bbdca6f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:49.386867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a66dfc29-e83c-4c38-b08c-c6ad6bbdca6f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:49.387650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a66dfc29-e83c-4c38-b08c-c6ad6bbdca6f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:49.388120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a66dfc29-e83c-4c38-b08c-c6ad6bbdca6f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:49.388571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a66dfc29-e83c-4c38-b08c-c6ad6bbdca6f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:49.529686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a66dfc29-e83c-4c38-b08c-c6ad6bbdca6f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:49.541267 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a66dfc29-e83c-4c38-b08c-c6ad6bbdca6f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1363 microversion: 2.1 time: 0.168002 Sep 07 13:38:49.542241 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3520/7011] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:49 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:50.571532 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-22ab458c-3763-498b-8261-294a19fd0e52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:50.572147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-22ab458c-3763-498b-8261-294a19fd0e52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:50.579583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22ab458c-3763-498b-8261-294a19fd0e52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:50.580262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22ab458c-3763-498b-8261-294a19fd0e52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:50.580675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22ab458c-3763-498b-8261-294a19fd0e52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:50.581379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22ab458c-3763-498b-8261-294a19fd0e52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:50.581878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22ab458c-3763-498b-8261-294a19fd0e52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:50.582305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22ab458c-3763-498b-8261-294a19fd0e52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:50.726231 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-22ab458c-3763-498b-8261-294a19fd0e52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:50.735828 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-22ab458c-3763-498b-8261-294a19fd0e52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1363 microversion: 2.1 time: 0.168398 Sep 07 13:38:50.736410 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3492/7012] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:50 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:51.423209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-6899d637-0595-4a3b-a056-f18dc52fe984 req-79402f0e-d054-4897-9f04-def4c501c6b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824957b8-3a81-4a12-ac73-f3506ba5c415", "name": "network-vif-plugged", "status": "completed", "tag": "10e6ff55-0066-4641-ab78-44802055451c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:51.434322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6899d637-0595-4a3b-a056-f18dc52fe984 req-79402f0e-d054-4897-9f04-def4c501c6b2 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:51.434829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6899d637-0595-4a3b-a056-f18dc52fe984 req-79402f0e-d054-4897-9f04-def4c501c6b2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:51.435272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6899d637-0595-4a3b-a056-f18dc52fe984 req-79402f0e-d054-4897-9f04-def4c501c6b2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:51.447108 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-6899d637-0595-4a3b-a056-f18dc52fe984 req-79402f0e-d054-4897-9f04-def4c501c6b2 service nova] Creating event network-vif-plugged:10e6ff55-0066-4641-ab78-44802055451c for instance 824957b8-3a81-4a12-ac73-f3506ba5c415 on n-h2-852087-9 Sep 07 13:38:51.452568 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-6899d637-0595-4a3b-a056-f18dc52fe984 req-79402f0e-d054-4897-9f04-def4c501c6b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033285 Sep 07 13:38:51.453147 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3521/7013] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:38:51.759680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c8d7190b-622e-4846-be25-5331f002eec1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:51.760227 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c8d7190b-622e-4846-be25-5331f002eec1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:51.767700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8d7190b-622e-4846-be25-5331f002eec1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:51.768192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8d7190b-622e-4846-be25-5331f002eec1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:51.768632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8d7190b-622e-4846-be25-5331f002eec1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:51.769332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8d7190b-622e-4846-be25-5331f002eec1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:51.769818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8d7190b-622e-4846-be25-5331f002eec1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:51.770253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8d7190b-622e-4846-be25-5331f002eec1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:51.912201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c8d7190b-622e-4846-be25-5331f002eec1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:51.922399 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c8d7190b-622e-4846-be25-5331f002eec1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1363 microversion: 2.1 time: 0.166587 Sep 07 13:38:51.923289 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3493/7014] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:51 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:52.952236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-29cb0462-9c58-496d-9b43-c425413f3775 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:52.953020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-29cb0462-9c58-496d-9b43-c425413f3775 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:52.959901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29cb0462-9c58-496d-9b43-c425413f3775 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:52.960408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29cb0462-9c58-496d-9b43-c425413f3775 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:52.960866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29cb0462-9c58-496d-9b43-c425413f3775 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:52.961620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29cb0462-9c58-496d-9b43-c425413f3775 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:52.962094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29cb0462-9c58-496d-9b43-c425413f3775 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:52.962539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-29cb0462-9c58-496d-9b43-c425413f3775 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:53.108623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-29cb0462-9c58-496d-9b43-c425413f3775 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:38:53.117355 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-29cb0462-9c58-496d-9b43-c425413f3775 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1549 microversion: 2.1 time: 0.170673 Sep 07 13:38:53.118061 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3522/7015] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:38:52 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:38:53.141862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cf13e246-e4f0-4270-99a3-d2eac5a0c1f5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:38:53.142386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cf13e246-e4f0-4270-99a3-d2eac5a0c1f5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:38:53.149344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf13e246-e4f0-4270-99a3-d2eac5a0c1f5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:53.149878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf13e246-e4f0-4270-99a3-d2eac5a0c1f5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:53.150323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf13e246-e4f0-4270-99a3-d2eac5a0c1f5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:53.151029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf13e246-e4f0-4270-99a3-d2eac5a0c1f5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:53.151494 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf13e246-e4f0-4270-99a3-d2eac5a0c1f5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:53.151930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cf13e246-e4f0-4270-99a3-d2eac5a0c1f5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:53.242495 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cf13e246-e4f0-4270-99a3-d2eac5a0c1f5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104478 Sep 07 13:38:53.243420 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3494/7016] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Sep 7 13:38:53 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:38:54.244024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:54.305426 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a2cd0877-56ef-43c9-a9e8-e134eaf98f5c req-8d60da20-87d8-4c85-9c63-650b5fa3063f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "824957b8-3a81-4a12-ac73-f3506ba5c415", "tag": "10e6ff55-0066-4641-ab78-44802055451c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:38:54.315411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a2cd0877-56ef-43c9-a9e8-e134eaf98f5c req-8d60da20-87d8-4c85-9c63-650b5fa3063f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:38:54.315899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a2cd0877-56ef-43c9-a9e8-e134eaf98f5c req-8d60da20-87d8-4c85-9c63-650b5fa3063f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:38:54.316380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a2cd0877-56ef-43c9-a9e8-e134eaf98f5c req-8d60da20-87d8-4c85-9c63-650b5fa3063f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:38:54.328528 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a2cd0877-56ef-43c9-a9e8-e134eaf98f5c req-8d60da20-87d8-4c85-9c63-650b5fa3063f service nova] Creating event network-changed:10e6ff55-0066-4641-ab78-44802055451c for instance 824957b8-3a81-4a12-ac73-f3506ba5c415 on n-h2-852087-9 Sep 07 13:38:54.333962 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a2cd0877-56ef-43c9-a9e8-e134eaf98f5c req-8d60da20-87d8-4c85-9c63-650b5fa3063f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094497 Sep 07 13:38:54.334804 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3523/7017] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:39:30.193168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:39:30.193863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:39:30.195779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:39:30.196423 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=55 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:39:30.200502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a07663a5-1370-46be-be9b-2f1f0a6c67bf tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:39:30.208988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a07663a5-1370-46be-be9b-2f1f0a6c67bf tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:30.209476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a07663a5-1370-46be-be9b-2f1f0a6c67bf tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:30.209931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a07663a5-1370-46be-be9b-2f1f0a6c67bf tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:30.233836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a07663a5-1370-46be-be9b-2f1f0a6c67bf tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Going to try to stop instance {{(pid=122432) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 13:39:30.279528 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a07663a5-1370-46be-be9b-2f1f0a6c67bf tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "POST /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415/action" status: 202 len: 0 microversion: 2.1 time: 0.087086 Sep 07 13:39:30.280185 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3495/7018] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:39:30 2022] POST /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:39:30.289286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=21 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:39:30.290122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:39:30.294635 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5717c319-bbbc-4e13-89f7-3f5db0fa7ca1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:30.295369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5717c319-bbbc-4e13-89f7-3f5db0fa7ca1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:30.304240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5717c319-bbbc-4e13-89f7-3f5db0fa7ca1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:30.306021 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5717c319-bbbc-4e13-89f7-3f5db0fa7ca1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:30.306021 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5717c319-bbbc-4e13-89f7-3f5db0fa7ca1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:30.306021 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5717c319-bbbc-4e13-89f7-3f5db0fa7ca1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:30.306446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5717c319-bbbc-4e13-89f7-3f5db0fa7ca1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:30.306991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5717c319-bbbc-4e13-89f7-3f5db0fa7ca1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:30.447530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5717c319-bbbc-4e13-89f7-3f5db0fa7ca1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:30.455851 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5717c319-bbbc-4e13-89f7-3f5db0fa7ca1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1678 microversion: 2.1 time: 0.169539 Sep 07 13:39:30.456469 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3524/7019] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:30 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:31.482164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9aab67cb-937a-4e55-a2c8-63ee98631df7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:31.482892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9aab67cb-937a-4e55-a2c8-63ee98631df7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:31.490214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9aab67cb-937a-4e55-a2c8-63ee98631df7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:31.490746 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9aab67cb-937a-4e55-a2c8-63ee98631df7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:31.491302 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9aab67cb-937a-4e55-a2c8-63ee98631df7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:31.492074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9aab67cb-937a-4e55-a2c8-63ee98631df7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:31.492532 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9aab67cb-937a-4e55-a2c8-63ee98631df7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:31.493018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9aab67cb-937a-4e55-a2c8-63ee98631df7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:31.645559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9aab67cb-937a-4e55-a2c8-63ee98631df7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:31.653789 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9aab67cb-937a-4e55-a2c8-63ee98631df7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1678 microversion: 2.1 time: 0.176995 Sep 07 13:39:31.654390 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3496/7020] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:31 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:32.682883 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e2ab98c6-c1b6-48f8-a555-bc9445c48b9a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:32.683488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e2ab98c6-c1b6-48f8-a555-bc9445c48b9a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:32.694212 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2ab98c6-c1b6-48f8-a555-bc9445c48b9a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:32.694723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2ab98c6-c1b6-48f8-a555-bc9445c48b9a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:32.695182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2ab98c6-c1b6-48f8-a555-bc9445c48b9a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:32.695896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2ab98c6-c1b6-48f8-a555-bc9445c48b9a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:32.696368 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2ab98c6-c1b6-48f8-a555-bc9445c48b9a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:32.696809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2ab98c6-c1b6-48f8-a555-bc9445c48b9a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:32.833617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e2ab98c6-c1b6-48f8-a555-bc9445c48b9a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:32.841945 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e2ab98c6-c1b6-48f8-a555-bc9445c48b9a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1678 microversion: 2.1 time: 0.165672 Sep 07 13:39:32.842527 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3525/7021] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:32 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:33.867411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c8ef9ee8-81a0-43b5-b9df-dc8d8ffba5a4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:33.868048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c8ef9ee8-81a0-43b5-b9df-dc8d8ffba5a4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:33.875404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8ef9ee8-81a0-43b5-b9df-dc8d8ffba5a4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:33.875907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8ef9ee8-81a0-43b5-b9df-dc8d8ffba5a4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:33.876346 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8ef9ee8-81a0-43b5-b9df-dc8d8ffba5a4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:33.877045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8ef9ee8-81a0-43b5-b9df-dc8d8ffba5a4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:33.877512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8ef9ee8-81a0-43b5-b9df-dc8d8ffba5a4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:33.877977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c8ef9ee8-81a0-43b5-b9df-dc8d8ffba5a4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:34.020146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c8ef9ee8-81a0-43b5-b9df-dc8d8ffba5a4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:34.032153 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c8ef9ee8-81a0-43b5-b9df-dc8d8ffba5a4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1678 microversion: 2.1 time: 0.168733 Sep 07 13:39:34.032948 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3497/7022] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:33 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:35.063513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-298f4106-c97d-415f-9d4f-5746a24290d9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:35.064117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-298f4106-c97d-415f-9d4f-5746a24290d9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:35.071747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-298f4106-c97d-415f-9d4f-5746a24290d9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:35.072267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-298f4106-c97d-415f-9d4f-5746a24290d9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:35.072730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-298f4106-c97d-415f-9d4f-5746a24290d9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:35.073458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-298f4106-c97d-415f-9d4f-5746a24290d9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:35.073983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-298f4106-c97d-415f-9d4f-5746a24290d9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:35.074435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-298f4106-c97d-415f-9d4f-5746a24290d9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:35.230370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-298f4106-c97d-415f-9d4f-5746a24290d9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:35.238989 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-298f4106-c97d-415f-9d4f-5746a24290d9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1678 microversion: 2.1 time: 0.179507 Sep 07 13:39:35.239586 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3526/7023] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:35 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:36.262125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a82837ca-0d87-4538-8269-91477827adfe tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:36.262672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a82837ca-0d87-4538-8269-91477827adfe tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:36.270457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a82837ca-0d87-4538-8269-91477827adfe tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:36.270961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a82837ca-0d87-4538-8269-91477827adfe tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:36.271406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a82837ca-0d87-4538-8269-91477827adfe tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:36.272130 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a82837ca-0d87-4538-8269-91477827adfe tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:36.272600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a82837ca-0d87-4538-8269-91477827adfe tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:36.273039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a82837ca-0d87-4538-8269-91477827adfe tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:36.427929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a82837ca-0d87-4538-8269-91477827adfe tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:36.439838 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a82837ca-0d87-4538-8269-91477827adfe tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1678 microversion: 2.1 time: 0.181660 Sep 07 13:39:36.440461 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3498/7024] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:36 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:37.465806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-efa69f5d-d5c1-472f-9eed-017856101b7f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:37.466613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-efa69f5d-d5c1-472f-9eed-017856101b7f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:37.475751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efa69f5d-d5c1-472f-9eed-017856101b7f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:37.476266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efa69f5d-d5c1-472f-9eed-017856101b7f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:37.476727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efa69f5d-d5c1-472f-9eed-017856101b7f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:37.477456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efa69f5d-d5c1-472f-9eed-017856101b7f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:37.477965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efa69f5d-d5c1-472f-9eed-017856101b7f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:37.478415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efa69f5d-d5c1-472f-9eed-017856101b7f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:37.623916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-efa69f5d-d5c1-472f-9eed-017856101b7f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:37.636367 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-efa69f5d-d5c1-472f-9eed-017856101b7f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1678 microversion: 2.1 time: 0.176396 Sep 07 13:39:37.637329 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3527/7025] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:37 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:38.665205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-80fafdff-935e-4617-be39-fcc8488fcc0f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:38.665852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-80fafdff-935e-4617-be39-fcc8488fcc0f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:38.673279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80fafdff-935e-4617-be39-fcc8488fcc0f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:38.673826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80fafdff-935e-4617-be39-fcc8488fcc0f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:38.674274 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80fafdff-935e-4617-be39-fcc8488fcc0f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:38.674978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80fafdff-935e-4617-be39-fcc8488fcc0f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:38.675437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80fafdff-935e-4617-be39-fcc8488fcc0f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:38.675866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-80fafdff-935e-4617-be39-fcc8488fcc0f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:38.833036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-80fafdff-935e-4617-be39-fcc8488fcc0f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:38.845578 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-80fafdff-935e-4617-be39-fcc8488fcc0f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1678 microversion: 2.1 time: 0.185049 Sep 07 13:39:38.846474 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3499/7026] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:38 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1678 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:39.871381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dfca8434-8527-4466-afb9-ad451fe0f096 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:39.872063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dfca8434-8527-4466-afb9-ad451fe0f096 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:39.879244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfca8434-8527-4466-afb9-ad451fe0f096 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:39.879750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfca8434-8527-4466-afb9-ad451fe0f096 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:39.880202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfca8434-8527-4466-afb9-ad451fe0f096 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:39.880921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfca8434-8527-4466-afb9-ad451fe0f096 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:39.881390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfca8434-8527-4466-afb9-ad451fe0f096 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:39.881998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfca8434-8527-4466-afb9-ad451fe0f096 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:40.019078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dfca8434-8527-4466-afb9-ad451fe0f096 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:40.027883 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dfca8434-8527-4466-afb9-ad451fe0f096 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1678 microversion: 2.1 time: 0.160663 Sep 07 13:39:40.028460 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3528/7027] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:39 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:41.052863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-580ac5ba-95b9-47cf-9f04-29f5332dcced tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:41.053458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-580ac5ba-95b9-47cf-9f04-29f5332dcced tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:41.061065 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-580ac5ba-95b9-47cf-9f04-29f5332dcced tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:41.061635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-580ac5ba-95b9-47cf-9f04-29f5332dcced tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:41.062138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-580ac5ba-95b9-47cf-9f04-29f5332dcced tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:41.062730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-580ac5ba-95b9-47cf-9f04-29f5332dcced tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:41.063187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-580ac5ba-95b9-47cf-9f04-29f5332dcced tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:41.063621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-580ac5ba-95b9-47cf-9f04-29f5332dcced tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:41.202218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-580ac5ba-95b9-47cf-9f04-29f5332dcced tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:41.212992 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-580ac5ba-95b9-47cf-9f04-29f5332dcced tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1678 microversion: 2.1 time: 0.164157 Sep 07 13:39:41.213619 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3500/7028] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:41 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:42.238956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a325dfee-ff25-4e1f-ac54-5b2abfa1ef66 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:42.239532 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a325dfee-ff25-4e1f-ac54-5b2abfa1ef66 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:42.247125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a325dfee-ff25-4e1f-ac54-5b2abfa1ef66 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:42.247627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a325dfee-ff25-4e1f-ac54-5b2abfa1ef66 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:42.248073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a325dfee-ff25-4e1f-ac54-5b2abfa1ef66 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:42.248791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a325dfee-ff25-4e1f-ac54-5b2abfa1ef66 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:42.249261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a325dfee-ff25-4e1f-ac54-5b2abfa1ef66 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:42.249746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a325dfee-ff25-4e1f-ac54-5b2abfa1ef66 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:42.391250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a325dfee-ff25-4e1f-ac54-5b2abfa1ef66 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:42.399348 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a325dfee-ff25-4e1f-ac54-5b2abfa1ef66 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1678 microversion: 2.1 time: 0.164457 Sep 07 13:39:42.399932 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3529/7029] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:42 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:43.423328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a60474b3-a82b-4dc8-94bb-21ec00cc4d52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:43.423947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a60474b3-a82b-4dc8-94bb-21ec00cc4d52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:43.431454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a60474b3-a82b-4dc8-94bb-21ec00cc4d52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:43.431954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a60474b3-a82b-4dc8-94bb-21ec00cc4d52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:43.432392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a60474b3-a82b-4dc8-94bb-21ec00cc4d52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:43.433104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a60474b3-a82b-4dc8-94bb-21ec00cc4d52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:43.433593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a60474b3-a82b-4dc8-94bb-21ec00cc4d52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:43.434029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a60474b3-a82b-4dc8-94bb-21ec00cc4d52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:43.914160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a60474b3-a82b-4dc8-94bb-21ec00cc4d52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:43.922354 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a60474b3-a82b-4dc8-94bb-21ec00cc4d52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1678 microversion: 2.1 time: 0.503036 Sep 07 13:39:43.922914 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3501/7030] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:43 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1678 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:44.946236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-acc8f3eb-e3eb-466e-a68a-8e9574ac40c9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:44.946878 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-acc8f3eb-e3eb-466e-a68a-8e9574ac40c9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:44.954421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-acc8f3eb-e3eb-466e-a68a-8e9574ac40c9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:44.954930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-acc8f3eb-e3eb-466e-a68a-8e9574ac40c9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:44.955389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-acc8f3eb-e3eb-466e-a68a-8e9574ac40c9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:44.956106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-acc8f3eb-e3eb-466e-a68a-8e9574ac40c9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:44.956581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-acc8f3eb-e3eb-466e-a68a-8e9574ac40c9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:44.957025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-acc8f3eb-e3eb-466e-a68a-8e9574ac40c9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:45.096409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-acc8f3eb-e3eb-466e-a68a-8e9574ac40c9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:45.108403 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-acc8f3eb-e3eb-466e-a68a-8e9574ac40c9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1678 microversion: 2.1 time: 0.166005 Sep 07 13:39:45.109262 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3530/7031] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:44 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:46.137707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7073e49b-0a14-4029-a933-054dae93c362 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:46.138603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7073e49b-0a14-4029-a933-054dae93c362 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:46.146113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7073e49b-0a14-4029-a933-054dae93c362 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:46.146656 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7073e49b-0a14-4029-a933-054dae93c362 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:46.147141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7073e49b-0a14-4029-a933-054dae93c362 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:46.147914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7073e49b-0a14-4029-a933-054dae93c362 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:46.148404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7073e49b-0a14-4029-a933-054dae93c362 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:46.148980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7073e49b-0a14-4029-a933-054dae93c362 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:46.288792 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7073e49b-0a14-4029-a933-054dae93c362 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:46.297234 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7073e49b-0a14-4029-a933-054dae93c362 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1655 microversion: 2.1 time: 0.164252 Sep 07 13:39:46.297875 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3502/7032] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:46 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1655 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:46.320650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e27e45ea-8a6b-4033-a974-6844bca7f24d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:39:46.323221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e27e45ea-8a6b-4033-a974-6844bca7f24d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:46.330430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e27e45ea-8a6b-4033-a974-6844bca7f24d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:46.330941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e27e45ea-8a6b-4033-a974-6844bca7f24d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:46.331403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e27e45ea-8a6b-4033-a974-6844bca7f24d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:46.332113 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e27e45ea-8a6b-4033-a974-6844bca7f24d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:46.332732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e27e45ea-8a6b-4033-a974-6844bca7f24d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:46.333184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e27e45ea-8a6b-4033-a974-6844bca7f24d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:46.362526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e27e45ea-8a6b-4033-a974-6844bca7f24d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:46.368799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e27e45ea-8a6b-4033-a974-6844bca7f24d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Old instance type m1.heat2, new instance type m1.heat {{(pid=122433) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 13:39:46.375468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e27e45ea-8a6b-4033-a974-6844bca7f24d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:39:46.375910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e27e45ea-8a6b-4033-a974-6844bca7f24d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:39:46.376403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e27e45ea-8a6b-4033-a974-6844bca7f24d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:39:46.376826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e27e45ea-8a6b-4033-a974-6844bca7f24d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:39:46.377253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-e27e45ea-8a6b-4033-a974-6844bca7f24d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:39:46.449293 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e27e45ea-8a6b-4033-a974-6844bca7f24d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "POST /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415/action" status: 202 len: 0 microversion: 2.1 time: 0.132496 Sep 07 13:39:46.449937 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3531/7033] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:39:46 2022] POST /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:39:46.458670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1cfb4cfc-a582-4c5b-8b8e-9794d6e2d0ba tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:46.459288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1cfb4cfc-a582-4c5b-8b8e-9794d6e2d0ba tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:46.466028 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cfb4cfc-a582-4c5b-8b8e-9794d6e2d0ba tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:46.466528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cfb4cfc-a582-4c5b-8b8e-9794d6e2d0ba tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:46.467080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cfb4cfc-a582-4c5b-8b8e-9794d6e2d0ba tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:46.468474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cfb4cfc-a582-4c5b-8b8e-9794d6e2d0ba tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:46.469135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cfb4cfc-a582-4c5b-8b8e-9794d6e2d0ba tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:46.469805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1cfb4cfc-a582-4c5b-8b8e-9794d6e2d0ba tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:46.616761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1cfb4cfc-a582-4c5b-8b8e-9794d6e2d0ba tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:46.625910 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1cfb4cfc-a582-4c5b-8b8e-9794d6e2d0ba tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1678 microversion: 2.1 time: 0.171493 Sep 07 13:39:46.626898 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3503/7034] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:46 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:47.652023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-22f78fae-6930-477a-a99c-d8200f9ddf96 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:47.652808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-22f78fae-6930-477a-a99c-d8200f9ddf96 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:47.659473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22f78fae-6930-477a-a99c-d8200f9ddf96 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:47.659989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22f78fae-6930-477a-a99c-d8200f9ddf96 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:47.660451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22f78fae-6930-477a-a99c-d8200f9ddf96 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:47.661181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22f78fae-6930-477a-a99c-d8200f9ddf96 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:47.661899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22f78fae-6930-477a-a99c-d8200f9ddf96 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:47.662325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22f78fae-6930-477a-a99c-d8200f9ddf96 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:47.800459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-22f78fae-6930-477a-a99c-d8200f9ddf96 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:47.808487 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-22f78fae-6930-477a-a99c-d8200f9ddf96 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1678 microversion: 2.1 time: 0.161968 Sep 07 13:39:47.809062 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3532/7035] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:47 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:48.835938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e40d821-9051-436a-b9a5-0c36ee3a59be tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:48.836507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2e40d821-9051-436a-b9a5-0c36ee3a59be tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:48.844854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e40d821-9051-436a-b9a5-0c36ee3a59be tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:48.845331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e40d821-9051-436a-b9a5-0c36ee3a59be tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:48.845831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e40d821-9051-436a-b9a5-0c36ee3a59be tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:48.846506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e40d821-9051-436a-b9a5-0c36ee3a59be tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:48.847264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e40d821-9051-436a-b9a5-0c36ee3a59be tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:48.847694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e40d821-9051-436a-b9a5-0c36ee3a59be tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:48.983100 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2e40d821-9051-436a-b9a5-0c36ee3a59be tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:48.995236 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2e40d821-9051-436a-b9a5-0c36ee3a59be tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1683 microversion: 2.1 time: 0.165631 Sep 07 13:39:48.995821 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3504/7036] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:48 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:50.020370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-307cc28e-6748-489b-8e7d-597d97a1c8cb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:50.020985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-307cc28e-6748-489b-8e7d-597d97a1c8cb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:50.028800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-307cc28e-6748-489b-8e7d-597d97a1c8cb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:50.029312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-307cc28e-6748-489b-8e7d-597d97a1c8cb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:50.029803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-307cc28e-6748-489b-8e7d-597d97a1c8cb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:50.030524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-307cc28e-6748-489b-8e7d-597d97a1c8cb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:50.031003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-307cc28e-6748-489b-8e7d-597d97a1c8cb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:50.031447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-307cc28e-6748-489b-8e7d-597d97a1c8cb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:50.175580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-307cc28e-6748-489b-8e7d-597d97a1c8cb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:50.183687 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-307cc28e-6748-489b-8e7d-597d97a1c8cb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1683 microversion: 2.1 time: 0.167554 Sep 07 13:39:50.184278 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3533/7037] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:50 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:51.208119 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-352d96aa-3633-4c16-af7d-00ab4d78f52e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:51.209689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-352d96aa-3633-4c16-af7d-00ab4d78f52e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:51.217393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-352d96aa-3633-4c16-af7d-00ab4d78f52e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:51.217965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-352d96aa-3633-4c16-af7d-00ab4d78f52e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:51.218409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-352d96aa-3633-4c16-af7d-00ab4d78f52e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:51.219348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-352d96aa-3633-4c16-af7d-00ab4d78f52e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:51.219629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-352d96aa-3633-4c16-af7d-00ab4d78f52e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:51.220074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-352d96aa-3633-4c16-af7d-00ab4d78f52e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:51.331415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-267d937d-8a05-4ee1-9ad1-5583e4a708f5 req-a1fdca4f-0889-4bb1-8c1d-3ab5ad260c6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824957b8-3a81-4a12-ac73-f3506ba5c415", "name": "network-vif-unplugged", "status": "completed", "tag": "10e6ff55-0066-4641-ab78-44802055451c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:39:51.347036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-267d937d-8a05-4ee1-9ad1-5583e4a708f5 req-a1fdca4f-0889-4bb1-8c1d-3ab5ad260c6b service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:51.348049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-267d937d-8a05-4ee1-9ad1-5583e4a708f5 req-a1fdca4f-0889-4bb1-8c1d-3ab5ad260c6b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:51.348674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-267d937d-8a05-4ee1-9ad1-5583e4a708f5 req-a1fdca4f-0889-4bb1-8c1d-3ab5ad260c6b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:51.354405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-352d96aa-3633-4c16-af7d-00ab4d78f52e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:51.363220 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-352d96aa-3633-4c16-af7d-00ab4d78f52e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1682 microversion: 2.1 time: 0.159150 Sep 07 13:39:51.363735 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3505/7038] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:51 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:51.368823 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-267d937d-8a05-4ee1-9ad1-5583e4a708f5 req-a1fdca4f-0889-4bb1-8c1d-3ab5ad260c6b service nova] Creating event network-vif-unplugged:10e6ff55-0066-4641-ab78-44802055451c for instance 824957b8-3a81-4a12-ac73-f3506ba5c415 on n-h1-852087-9 Sep 07 13:39:51.375206 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-267d937d-8a05-4ee1-9ad1-5583e4a708f5 req-a1fdca4f-0889-4bb1-8c1d-3ab5ad260c6b service nova] Instance 824957b8-3a81-4a12-ac73-f3506ba5c415 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:39:51.386488 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-267d937d-8a05-4ee1-9ad1-5583e4a708f5 req-a1fdca4f-0889-4bb1-8c1d-3ab5ad260c6b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060645 Sep 07 13:39:51.387172 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3534/7039] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:39:52.387586 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-699440f7-dae7-4b5a-a837-fcf1709e5c42 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:52.388207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-699440f7-dae7-4b5a-a837-fcf1709e5c42 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:52.395258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-699440f7-dae7-4b5a-a837-fcf1709e5c42 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:52.395775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-699440f7-dae7-4b5a-a837-fcf1709e5c42 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:52.396211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-699440f7-dae7-4b5a-a837-fcf1709e5c42 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:52.396913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-699440f7-dae7-4b5a-a837-fcf1709e5c42 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:52.397375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-699440f7-dae7-4b5a-a837-fcf1709e5c42 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:52.397837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-699440f7-dae7-4b5a-a837-fcf1709e5c42 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:52.547827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-699440f7-dae7-4b5a-a837-fcf1709e5c42 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:52.556709 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-699440f7-dae7-4b5a-a837-fcf1709e5c42 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1682 microversion: 2.1 time: 0.173074 Sep 07 13:39:52.557335 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3506/7040] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:52 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:53.420383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-7ecb79f5-07fb-44ae-87fe-85de0c321b37 req-a66b1219-f332-437c-be14-1661f601584f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "824957b8-3a81-4a12-ac73-f3506ba5c415", "tag": "10e6ff55-0066-4641-ab78-44802055451c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:39:53.437294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7ecb79f5-07fb-44ae-87fe-85de0c321b37 req-a66b1219-f332-437c-be14-1661f601584f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:53.437837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7ecb79f5-07fb-44ae-87fe-85de0c321b37 req-a66b1219-f332-437c-be14-1661f601584f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:53.438299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7ecb79f5-07fb-44ae-87fe-85de0c321b37 req-a66b1219-f332-437c-be14-1661f601584f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:53.453986 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-7ecb79f5-07fb-44ae-87fe-85de0c321b37 req-a66b1219-f332-437c-be14-1661f601584f service nova] Creating event network-changed:10e6ff55-0066-4641-ab78-44802055451c for instance 824957b8-3a81-4a12-ac73-f3506ba5c415 on n-h1-852087-9 Sep 07 13:39:53.460067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-7ecb79f5-07fb-44ae-87fe-85de0c321b37 req-a66b1219-f332-437c-be14-1661f601584f service nova] Instance 824957b8-3a81-4a12-ac73-f3506ba5c415 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:39:53.472361 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-7ecb79f5-07fb-44ae-87fe-85de0c321b37 req-a66b1219-f332-437c-be14-1661f601584f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057170 Sep 07 13:39:53.473015 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3535/7041] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:39:53.581053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-70b7467e-9d72-4c17-9eaf-33033ecc8abd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:53.581991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-70b7467e-9d72-4c17-9eaf-33033ecc8abd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:53.590062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70b7467e-9d72-4c17-9eaf-33033ecc8abd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:53.590713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70b7467e-9d72-4c17-9eaf-33033ecc8abd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:53.591259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70b7467e-9d72-4c17-9eaf-33033ecc8abd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:53.592117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70b7467e-9d72-4c17-9eaf-33033ecc8abd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:53.592701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70b7467e-9d72-4c17-9eaf-33033ecc8abd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:53.593230 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70b7467e-9d72-4c17-9eaf-33033ecc8abd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:53.730707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-70b7467e-9d72-4c17-9eaf-33033ecc8abd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:53.741537 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-70b7467e-9d72-4c17-9eaf-33033ecc8abd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1680 microversion: 2.1 time: 0.164738 Sep 07 13:39:53.742308 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3507/7042] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:53 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:54.770306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bfc26929-7ffc-4690-adc3-541d2ae01e43 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:54.771073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bfc26929-7ffc-4690-adc3-541d2ae01e43 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:54.778088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bfc26929-7ffc-4690-adc3-541d2ae01e43 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:54.778597 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bfc26929-7ffc-4690-adc3-541d2ae01e43 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:54.779053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bfc26929-7ffc-4690-adc3-541d2ae01e43 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:54.779765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bfc26929-7ffc-4690-adc3-541d2ae01e43 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:54.780241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bfc26929-7ffc-4690-adc3-541d2ae01e43 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:54.780685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bfc26929-7ffc-4690-adc3-541d2ae01e43 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:54.934305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bfc26929-7ffc-4690-adc3-541d2ae01e43 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:54.942426 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bfc26929-7ffc-4690-adc3-541d2ae01e43 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1680 microversion: 2.1 time: 0.179412 Sep 07 13:39:54.943011 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3536/7043] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:54 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:55.968626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-18ef4beb-4241-4b16-a90d-a03368ff6a9c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:55.969207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-18ef4beb-4241-4b16-a90d-a03368ff6a9c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:55.976777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18ef4beb-4241-4b16-a90d-a03368ff6a9c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:55.977270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18ef4beb-4241-4b16-a90d-a03368ff6a9c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:55.977754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18ef4beb-4241-4b16-a90d-a03368ff6a9c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:55.978452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18ef4beb-4241-4b16-a90d-a03368ff6a9c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:55.978913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18ef4beb-4241-4b16-a90d-a03368ff6a9c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:55.979344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18ef4beb-4241-4b16-a90d-a03368ff6a9c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:56.133029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-18ef4beb-4241-4b16-a90d-a03368ff6a9c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:56.143293 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-18ef4beb-4241-4b16-a90d-a03368ff6a9c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1676 microversion: 2.1 time: 0.180113 Sep 07 13:39:56.144267 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3508/7044] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:55 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1676 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:56.168678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8320eb96-6d10-4673-ad02-549e19122c6c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:39:56.169250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8320eb96-6d10-4673-ad02-549e19122c6c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:56.176346 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8320eb96-6d10-4673-ad02-549e19122c6c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:56.176859 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8320eb96-6d10-4673-ad02-549e19122c6c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:56.177317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8320eb96-6d10-4673-ad02-549e19122c6c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:56.178067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8320eb96-6d10-4673-ad02-549e19122c6c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:56.178542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8320eb96-6d10-4673-ad02-549e19122c6c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:56.178991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8320eb96-6d10-4673-ad02-549e19122c6c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:56.246552 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8320eb96-6d10-4673-ad02-549e19122c6c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "POST /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415/action" status: 204 len: 0 microversion: 2.1 time: 0.081296 Sep 07 13:39:56.247254 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3537/7045] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:39:56 2022] POST /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:39:56.258744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b903b9cf-836c-4ae6-9bb5-b7388d850782 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:56.259421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b903b9cf-836c-4ae6-9bb5-b7388d850782 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:56.266729 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b903b9cf-836c-4ae6-9bb5-b7388d850782 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:56.267224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b903b9cf-836c-4ae6-9bb5-b7388d850782 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:56.267711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b903b9cf-836c-4ae6-9bb5-b7388d850782 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:56.268416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b903b9cf-836c-4ae6-9bb5-b7388d850782 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:56.268899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b903b9cf-836c-4ae6-9bb5-b7388d850782 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:56.269579 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b903b9cf-836c-4ae6-9bb5-b7388d850782 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:56.420873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b903b9cf-836c-4ae6-9bb5-b7388d850782 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:56.429319 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b903b9cf-836c-4ae6-9bb5-b7388d850782 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1676 microversion: 2.1 time: 0.176231 Sep 07 13:39:56.429949 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3509/7046] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:56 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:39:57.455875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-54e2987e-4de9-4c85-93a8-3573e304198c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:57.456450 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-54e2987e-4de9-4c85-93a8-3573e304198c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:57.465084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54e2987e-4de9-4c85-93a8-3573e304198c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:57.465742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54e2987e-4de9-4c85-93a8-3573e304198c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:57.466717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54e2987e-4de9-4c85-93a8-3573e304198c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:57.467905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54e2987e-4de9-4c85-93a8-3573e304198c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:57.468700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54e2987e-4de9-4c85-93a8-3573e304198c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:57.469159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54e2987e-4de9-4c85-93a8-3573e304198c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:57.627021 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-54e2987e-4de9-4c85-93a8-3573e304198c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:57.629454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:39:57.636314 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-54e2987e-4de9-4c85-93a8-3573e304198c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1676 microversion: 2.1 time: 0.186912 Sep 07 13:39:57.637033 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3538/7047] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:57 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1676 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:58.662128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-86fec1f3-05b5-4fcc-a205-1422a0234330 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:58.662796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-86fec1f3-05b5-4fcc-a205-1422a0234330 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:58.671243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86fec1f3-05b5-4fcc-a205-1422a0234330 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:58.671779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86fec1f3-05b5-4fcc-a205-1422a0234330 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:58.672260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86fec1f3-05b5-4fcc-a205-1422a0234330 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:58.673073 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86fec1f3-05b5-4fcc-a205-1422a0234330 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:58.673627 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86fec1f3-05b5-4fcc-a205-1422a0234330 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:58.674104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-86fec1f3-05b5-4fcc-a205-1422a0234330 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:58.694776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:39:58.822464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-86fec1f3-05b5-4fcc-a205-1422a0234330 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:58.835011 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-86fec1f3-05b5-4fcc-a205-1422a0234330 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1655 microversion: 2.1 time: 0.177484 Sep 07 13:39:58.835992 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3510/7048] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:58 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1655 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:58.863368 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-610beced-7809-4fa0-9240-8c20ecb72418 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:58.863996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-610beced-7809-4fa0-9240-8c20ecb72418 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:58.875477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-610beced-7809-4fa0-9240-8c20ecb72418 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:58.875982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-610beced-7809-4fa0-9240-8c20ecb72418 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:58.876436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-610beced-7809-4fa0-9240-8c20ecb72418 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:58.877276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-610beced-7809-4fa0-9240-8c20ecb72418 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:58.877696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-610beced-7809-4fa0-9240-8c20ecb72418 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:58.878139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-610beced-7809-4fa0-9240-8c20ecb72418 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:59.019688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-610beced-7809-4fa0-9240-8c20ecb72418 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:59.032675 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-610beced-7809-4fa0-9240-8c20ecb72418 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1655 microversion: 2.1 time: 0.174747 Sep 07 13:39:59.034435 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3539/7049] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:58 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1655 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:59.056856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-03cf8de3-c2d1-4bf8-ba10-e0eaf5f17bf2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:39:59.063719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03cf8de3-c2d1-4bf8-ba10-e0eaf5f17bf2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:59.064232 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03cf8de3-c2d1-4bf8-ba10-e0eaf5f17bf2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:59.064681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03cf8de3-c2d1-4bf8-ba10-e0eaf5f17bf2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:59.090513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-03cf8de3-c2d1-4bf8-ba10-e0eaf5f17bf2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Going to try to start instance {{(pid=122432) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 13:39:59.139313 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-03cf8de3-c2d1-4bf8-ba10-e0eaf5f17bf2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "POST /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415/action" status: 202 len: 0 microversion: 2.1 time: 0.086210 Sep 07 13:39:59.143468 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3511/7050] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:39:59 2022] POST /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:39:59.151186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-309e74c2-db9a-4561-b0ba-fc2978562d2e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:39:59.151795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-309e74c2-db9a-4561-b0ba-fc2978562d2e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:39:59.158658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-309e74c2-db9a-4561-b0ba-fc2978562d2e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:59.159190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-309e74c2-db9a-4561-b0ba-fc2978562d2e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:59.159651 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-309e74c2-db9a-4561-b0ba-fc2978562d2e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:59.160375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-309e74c2-db9a-4561-b0ba-fc2978562d2e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:59.160857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-309e74c2-db9a-4561-b0ba-fc2978562d2e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:59.161506 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-309e74c2-db9a-4561-b0ba-fc2978562d2e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:59.279961 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:39:59.280165 n-d-852087-9 devstack@n-api.service[122433]: Wed Sep 7 13:39:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 (ip 10.222.0.16) !!! Sep 07 13:39:59.309367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-309e74c2-db9a-4561-b0ba-fc2978562d2e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:39:59.319399 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-309e74c2-db9a-4561-b0ba-fc2978562d2e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1664 microversion: 2.1 time: 0.173775 Sep 07 13:39:59.325199 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3540/7051] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:39:59 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1664 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:39:59.375025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-7de6f061-82b3-40ce-a517-1d85159cd955 req-86e3311c-682a-42c3-b358-96829624afa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824957b8-3a81-4a12-ac73-f3506ba5c415", "name": "network-vif-plugged", "status": "completed", "tag": "10e6ff55-0066-4641-ab78-44802055451c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:39:59.386355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7de6f061-82b3-40ce-a517-1d85159cd955 req-86e3311c-682a-42c3-b358-96829624afa2 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:39:59.386829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7de6f061-82b3-40ce-a517-1d85159cd955 req-86e3311c-682a-42c3-b358-96829624afa2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:39:59.387258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7de6f061-82b3-40ce-a517-1d85159cd955 req-86e3311c-682a-42c3-b358-96829624afa2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:39:59.399376 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7de6f061-82b3-40ce-a517-1d85159cd955 req-86e3311c-682a-42c3-b358-96829624afa2 service nova] Creating event network-vif-plugged:10e6ff55-0066-4641-ab78-44802055451c for instance 824957b8-3a81-4a12-ac73-f3506ba5c415 on n-h1-852087-9 Sep 07 13:39:59.403936 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-7de6f061-82b3-40ce-a517-1d85159cd955 req-86e3311c-682a-42c3-b358-96829624afa2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097496 Sep 07 13:39:59.404462 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3512/7052] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:40:00.350132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-68be3e84-0529-4942-9144-04609c5d5ec9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:00.350838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-68be3e84-0529-4942-9144-04609c5d5ec9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:00.353781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=39 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:40:00.360034 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68be3e84-0529-4942-9144-04609c5d5ec9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:00.360571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68be3e84-0529-4942-9144-04609c5d5ec9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:00.361053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68be3e84-0529-4942-9144-04609c5d5ec9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:00.361837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68be3e84-0529-4942-9144-04609c5d5ec9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:00.362353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68be3e84-0529-4942-9144-04609c5d5ec9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:00.362805 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-68be3e84-0529-4942-9144-04609c5d5ec9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:00.500157 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-68be3e84-0529-4942-9144-04609c5d5ec9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:00.508511 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-68be3e84-0529-4942-9144-04609c5d5ec9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1664 microversion: 2.1 time: 0.162653 Sep 07 13:40:00.509104 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3541/7053] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:00 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1664 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:01.531223 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:40:01.531801 n-d-852087-9 devstack@n-api.service[122432]: Wed Sep 7 13:40:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 (ip 10.222.0.16) !!! Sep 07 13:40:01.536754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a6c78c48-8d86-45a7-9f09-6535ed4dc9cc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:01.537449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a6c78c48-8d86-45a7-9f09-6535ed4dc9cc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:01.540066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=37 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:40:01.549767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6c78c48-8d86-45a7-9f09-6535ed4dc9cc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:01.550249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6c78c48-8d86-45a7-9f09-6535ed4dc9cc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:01.550684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6c78c48-8d86-45a7-9f09-6535ed4dc9cc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:01.551382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6c78c48-8d86-45a7-9f09-6535ed4dc9cc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:01.551834 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6c78c48-8d86-45a7-9f09-6535ed4dc9cc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:01.552254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6c78c48-8d86-45a7-9f09-6535ed4dc9cc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:01.701476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a6c78c48-8d86-45a7-9f09-6535ed4dc9cc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:01.710554 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a6c78c48-8d86-45a7-9f09-6535ed4dc9cc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1668 microversion: 2.1 time: 0.181563 Sep 07 13:40:01.711191 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3513/7054] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:01 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1668 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:01.736951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9b93a3f8-f058-4350-9708-5264bd32d466 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:01.737615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9b93a3f8-f058-4350-9708-5264bd32d466 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:01.745404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b93a3f8-f058-4350-9708-5264bd32d466 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:01.745952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b93a3f8-f058-4350-9708-5264bd32d466 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:01.746410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b93a3f8-f058-4350-9708-5264bd32d466 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:01.747146 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b93a3f8-f058-4350-9708-5264bd32d466 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:01.747625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b93a3f8-f058-4350-9708-5264bd32d466 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:01.748109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9b93a3f8-f058-4350-9708-5264bd32d466 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:01.776800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9b93a3f8-f058-4350-9708-5264bd32d466 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:40:01.858906 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9b93a3f8-f058-4350-9708-5264bd32d466 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "DELETE /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 204 len: 0 microversion: 2.1 time: 0.125819 Sep 07 13:40:01.859841 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3542/7055] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:40:01 2022] DELETE /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:40:01.871487 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a7e1bcd6-64d3-4239-acbb-18df3d2854cd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:01.872496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a7e1bcd6-64d3-4239-acbb-18df3d2854cd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:01.881773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7e1bcd6-64d3-4239-acbb-18df3d2854cd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:01.882462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7e1bcd6-64d3-4239-acbb-18df3d2854cd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:01.883055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7e1bcd6-64d3-4239-acbb-18df3d2854cd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:01.883900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7e1bcd6-64d3-4239-acbb-18df3d2854cd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:01.884354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7e1bcd6-64d3-4239-acbb-18df3d2854cd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:01.884781 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7e1bcd6-64d3-4239-acbb-18df3d2854cd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:02.022533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a7e1bcd6-64d3-4239-acbb-18df3d2854cd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:02.033176 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a7e1bcd6-64d3-4239-acbb-18df3d2854cd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1674 microversion: 2.1 time: 0.168150 Sep 07 13:40:02.033989 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3514/7056] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:01 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:03.062317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-54a72535-85fc-47a8-9987-46a3f37bee07 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:03.063073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-54a72535-85fc-47a8-9987-46a3f37bee07 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:03.073717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54a72535-85fc-47a8-9987-46a3f37bee07 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:03.074252 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54a72535-85fc-47a8-9987-46a3f37bee07 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:03.074681 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54a72535-85fc-47a8-9987-46a3f37bee07 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:03.075396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54a72535-85fc-47a8-9987-46a3f37bee07 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:03.075870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54a72535-85fc-47a8-9987-46a3f37bee07 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:03.076357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54a72535-85fc-47a8-9987-46a3f37bee07 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:03.223254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-54a72535-85fc-47a8-9987-46a3f37bee07 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:03.234299 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-54a72535-85fc-47a8-9987-46a3f37bee07 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1674 microversion: 2.1 time: 0.178318 Sep 07 13:40:03.234886 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3543/7057] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:03 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1674 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:04.218541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-73bc1dcd-4031-4c68-b98e-753afdffe5a1 req-af11d651-8388-4be6-b7a7-e026e3fdbe4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824957b8-3a81-4a12-ac73-f3506ba5c415", "name": "network-vif-deleted", "tag": "10e6ff55-0066-4641-ab78-44802055451c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:40:04.234820 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-73bc1dcd-4031-4c68-b98e-753afdffe5a1 req-af11d651-8388-4be6-b7a7-e026e3fdbe4f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:04.235078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-73bc1dcd-4031-4c68-b98e-753afdffe5a1 req-af11d651-8388-4be6-b7a7-e026e3fdbe4f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:04.235701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-73bc1dcd-4031-4c68-b98e-753afdffe5a1 req-af11d651-8388-4be6-b7a7-e026e3fdbe4f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:04.250383 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-73bc1dcd-4031-4c68-b98e-753afdffe5a1 req-af11d651-8388-4be6-b7a7-e026e3fdbe4f service nova] Creating event network-vif-deleted:10e6ff55-0066-4641-ab78-44802055451c for instance 824957b8-3a81-4a12-ac73-f3506ba5c415 on n-h1-852087-9 Sep 07 13:40:04.257321 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-73bc1dcd-4031-4c68-b98e-753afdffe5a1 req-af11d651-8388-4be6-b7a7-e026e3fdbe4f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043705 Sep 07 13:40:04.258302 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3515/7058] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:40:04.265881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-347391ed-9c5c-45c8-9e8e-48da27cde7eb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:04.266547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-347391ed-9c5c-45c8-9e8e-48da27cde7eb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:04.275063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-347391ed-9c5c-45c8-9e8e-48da27cde7eb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:04.275063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-347391ed-9c5c-45c8-9e8e-48da27cde7eb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:04.275499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-347391ed-9c5c-45c8-9e8e-48da27cde7eb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:04.276187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-347391ed-9c5c-45c8-9e8e-48da27cde7eb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:04.276845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-347391ed-9c5c-45c8-9e8e-48da27cde7eb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:04.277283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-347391ed-9c5c-45c8-9e8e-48da27cde7eb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:04.356623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-347391ed-9c5c-45c8-9e8e-48da27cde7eb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:04.366027 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-347391ed-9c5c-45c8-9e8e-48da27cde7eb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 200 len: 1323 microversion: 2.1 time: 0.104632 Sep 07 13:40:04.376157 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3544/7059] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:04 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 1323 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:05.393019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e58ab4b0-86f5-42ae-815f-30f915cfe9d3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:05.393638 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e58ab4b0-86f5-42ae-815f-30f915cfe9d3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:05.400677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e58ab4b0-86f5-42ae-815f-30f915cfe9d3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:05.401168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e58ab4b0-86f5-42ae-815f-30f915cfe9d3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:05.401640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e58ab4b0-86f5-42ae-815f-30f915cfe9d3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:05.402360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e58ab4b0-86f5-42ae-815f-30f915cfe9d3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:05.402817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e58ab4b0-86f5-42ae-815f-30f915cfe9d3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:05.403244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e58ab4b0-86f5-42ae-815f-30f915cfe9d3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:05.417338 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-e58ab4b0-86f5-42ae-815f-30f915cfe9d3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] HTTP exception thrown: Instance 824957b8-3a81-4a12-ac73-f3506ba5c415 could not be found. Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e58ab4b0-86f5-42ae-815f-30f915cfe9d3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Request method failure captured: Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 HTTP/1.1 Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJ6Qa8Wgx3edQ7CXPA7GMXkRXsD6n0ODz0fJ4U_HSdO27cMoqedxiUWhG-0C6635gytRmbSHGz9fwKnUkfS2q0gSeQ7nm1CzWfB0bTkZfTtk2qgxY2gxQer8R0l1g7MVKHxAmv0Z5uiEW3b338LhbLsy-_HbtXv9ZiSJd_u4NfmTSZM Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_396666be58fa42568bdfa2652d635a41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/396666be58fa42568bdfa2652d635a41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: bb0e9196784341cbb170c1c055e8966f Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 824957b8-3a81-4a12-ac73-f3506ba5c415 could not be found. Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '824957b8-3a81-4a12-ac73-f3506ba5c415'} Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 824957b8-3a81-4a12-ac73-f3506ba5c415 could not be found. Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 824957b8-3a81-4a12-ac73-f3506ba5c415 could not be found. Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:40:05.419049 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:40:05.425404 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:05.425404 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:40:05.425404 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:40:05.425404 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:40:05.425404 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:40:05.425404 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 824957b8-3a81-4a12-ac73-f3506ba5c415 could not be found. Sep 07 13:40:05.425404 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:40:05.425404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e58ab4b0-86f5-42ae-815f-30f915cfe9d3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Returning 404 to user: Instance 824957b8-3a81-4a12-ac73-f3506ba5c415 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:40:05.425404 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e58ab4b0-86f5-42ae-815f-30f915cfe9d3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 404 len: 111 microversion: 2.1 time: 0.033730 Sep 07 13:40:05.425404 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3516/7060] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:05 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:40:05.442729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e2fe7db8-ab71-47c1-b943-fe8721038e53 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:05.443428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e2fe7db8-ab71-47c1-b943-fe8721038e53 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:05.450524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2fe7db8-ab71-47c1-b943-fe8721038e53 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:05.451036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2fe7db8-ab71-47c1-b943-fe8721038e53 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:05.451528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2fe7db8-ab71-47c1-b943-fe8721038e53 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:05.452313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2fe7db8-ab71-47c1-b943-fe8721038e53 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:05.452791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2fe7db8-ab71-47c1-b943-fe8721038e53 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:05.453229 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2fe7db8-ab71-47c1-b943-fe8721038e53 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:05.468225 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-e2fe7db8-ab71-47c1-b943-fe8721038e53 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] HTTP exception thrown: Instance 824957b8-3a81-4a12-ac73-f3506ba5c415 could not be found. Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e2fe7db8-ab71-47c1-b943-fe8721038e53 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Request method failure captured: Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 HTTP/1.1 Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJ6Qa8Wgx3edQ7CXPA7GMXkRXsD6n0ODz0fJ4U_HSdO27cMoqedxiUWhG-0C6635gytRmbSHGz9fwKnUkfS2q0gSeQ7nm1CzWfB0bTkZfTtk2qgxY2gxQer8R0l1g7MVKHxAmv0Z5uiEW3b338LhbLsy-_HbtXv9ZiSJd_u4NfmTSZM Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_396666be58fa42568bdfa2652d635a41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/396666be58fa42568bdfa2652d635a41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: bb0e9196784341cbb170c1c055e8966f Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 824957b8-3a81-4a12-ac73-f3506ba5c415 could not be found. Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '824957b8-3a81-4a12-ac73-f3506ba5c415'} Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 824957b8-3a81-4a12-ac73-f3506ba5c415 could not be found. Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 824957b8-3a81-4a12-ac73-f3506ba5c415 could not be found. Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:40:05.469956 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:40:05.474508 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:40:05.474508 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:40:05.474508 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:40:05.474508 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:40:05.474508 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:40:05.474508 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 824957b8-3a81-4a12-ac73-f3506ba5c415 could not be found. Sep 07 13:40:05.474508 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:40:05.474508 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e2fe7db8-ab71-47c1-b943-fe8721038e53 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Returning 404 to user: Instance 824957b8-3a81-4a12-ac73-f3506ba5c415 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:40:05.474508 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e2fe7db8-ab71-47c1-b943-fe8721038e53 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 404 len: 111 microversion: 2.1 time: 0.032820 Sep 07 13:40:05.474508 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3545/7061] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:05 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:40:05.524499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-69196fc7-b50d-40c8-85bf-7eef46da78d8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-7522377", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "c0ae2db3-d205-4102-b4b3-830cdd7a4274"}], "security_groups": [{"name": "tempest-securitygroup--971767124"}], "key_name": "tempest-keypair-1624528547", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:40:05.643156 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-69196fc7-b50d-40c8-85bf-7eef46da78d8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] validate_networks() for [('c0ae2db3-d205-4102-b4b3-830cdd7a4274', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:40:06.098892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-69196fc7-b50d-40c8-85bf-7eef46da78d8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:40:06.099521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-69196fc7-b50d-40c8-85bf-7eef46da78d8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:40:06.100287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-69196fc7-b50d-40c8-85bf-7eef46da78d8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:40:06.100980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-69196fc7-b50d-40c8-85bf-7eef46da78d8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:40:06.101541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-69196fc7-b50d-40c8-85bf-7eef46da78d8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:40:06.114447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69196fc7-b50d-40c8-85bf-7eef46da78d8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:06.114932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69196fc7-b50d-40c8-85bf-7eef46da78d8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:06.115372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69196fc7-b50d-40c8-85bf-7eef46da78d8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:06.116101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69196fc7-b50d-40c8-85bf-7eef46da78d8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:06.116546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69196fc7-b50d-40c8-85bf-7eef46da78d8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:06.117008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69196fc7-b50d-40c8-85bf-7eef46da78d8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:06.134037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-69196fc7-b50d-40c8-85bf-7eef46da78d8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Getting quotas for project 396666be58fa42568bdfa2652d635a41. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:40:06.140036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-69196fc7-b50d-40c8-85bf-7eef46da78d8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Getting quotas for user bb0e9196784341cbb170c1c055e8966f and project 396666be58fa42568bdfa2652d635a41. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:40:06.153650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-69196fc7-b50d-40c8-85bf-7eef46da78d8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:40:06.156591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-69196fc7-b50d-40c8-85bf-7eef46da78d8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:40:06.206736 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-69196fc7-b50d-40c8-85bf-7eef46da78d8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.686162 Sep 07 13:40:06.207407 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3517/7062] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:40:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:40:06.219851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bd6e9676-af03-4de5-84cf-86583bcbb094 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:06.220571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bd6e9676-af03-4de5-84cf-86583bcbb094 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:06.275704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bd6e9676-af03-4de5-84cf-86583bcbb094 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:06.282996 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bd6e9676-af03-4de5-84cf-86583bcbb094 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1236 microversion: 2.1 time: 0.067363 Sep 07 13:40:06.283569 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3546/7063] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:06 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1236 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:07.307861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ca122740-8041-4959-9da9-50256c1749d7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:07.308647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ca122740-8041-4959-9da9-50256c1749d7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:07.316487 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca122740-8041-4959-9da9-50256c1749d7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:07.317125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca122740-8041-4959-9da9-50256c1749d7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:07.317602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca122740-8041-4959-9da9-50256c1749d7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:07.318449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca122740-8041-4959-9da9-50256c1749d7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:07.318921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca122740-8041-4959-9da9-50256c1749d7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:07.319350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ca122740-8041-4959-9da9-50256c1749d7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:07.389916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ca122740-8041-4959-9da9-50256c1749d7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:07.398407 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ca122740-8041-4959-9da9-50256c1749d7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1288 microversion: 2.1 time: 0.095324 Sep 07 13:40:07.399079 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3518/7064] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:07 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1288 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:08.425032 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a13d3941-99dd-4afb-9f6a-6b2a0a0b4300 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:08.425651 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a13d3941-99dd-4afb-9f6a-6b2a0a0b4300 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:08.433706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a13d3941-99dd-4afb-9f6a-6b2a0a0b4300 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:08.434366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a13d3941-99dd-4afb-9f6a-6b2a0a0b4300 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:08.434923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a13d3941-99dd-4afb-9f6a-6b2a0a0b4300 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:08.435746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a13d3941-99dd-4afb-9f6a-6b2a0a0b4300 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:08.436324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a13d3941-99dd-4afb-9f6a-6b2a0a0b4300 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:08.436894 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a13d3941-99dd-4afb-9f6a-6b2a0a0b4300 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:08.570657 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a13d3941-99dd-4afb-9f6a-6b2a0a0b4300 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:08.578635 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a13d3941-99dd-4afb-9f6a-6b2a0a0b4300 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1361 microversion: 2.1 time: 0.158381 Sep 07 13:40:08.579279 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3547/7065] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:08 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:09.006581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-7818e294-557d-479c-92d9-1ece8e8ae56d req-01cd0ada-baf8-48b5-85fb-d359647fe124 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ed905d1-0713-49f5-aa66-1574b0734a2c", "tag": "64c2bb70-792f-4add-be02-5a910ffe0922"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:40:09.020497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7818e294-557d-479c-92d9-1ece8e8ae56d req-01cd0ada-baf8-48b5-85fb-d359647fe124 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:09.021001 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7818e294-557d-479c-92d9-1ece8e8ae56d req-01cd0ada-baf8-48b5-85fb-d359647fe124 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:09.021530 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7818e294-557d-479c-92d9-1ece8e8ae56d req-01cd0ada-baf8-48b5-85fb-d359647fe124 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:09.035146 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7818e294-557d-479c-92d9-1ece8e8ae56d req-01cd0ada-baf8-48b5-85fb-d359647fe124 service nova] Creating event network-changed:64c2bb70-792f-4add-be02-5a910ffe0922 for instance 4ed905d1-0713-49f5-aa66-1574b0734a2c on n-h2-852087-9 Sep 07 13:40:09.041823 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-7818e294-557d-479c-92d9-1ece8e8ae56d req-01cd0ada-baf8-48b5-85fb-d359647fe124 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039053 Sep 07 13:40:09.043150 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3519/7066] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:40:09.603757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-394ec163-4591-49cb-b066-bd714b20b1ad tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:09.604658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-394ec163-4591-49cb-b066-bd714b20b1ad tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:09.612213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-394ec163-4591-49cb-b066-bd714b20b1ad tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:09.612734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-394ec163-4591-49cb-b066-bd714b20b1ad tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:09.613194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-394ec163-4591-49cb-b066-bd714b20b1ad tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:09.613959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-394ec163-4591-49cb-b066-bd714b20b1ad tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:09.614436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-394ec163-4591-49cb-b066-bd714b20b1ad tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:09.614878 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-394ec163-4591-49cb-b066-bd714b20b1ad tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:09.758920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-394ec163-4591-49cb-b066-bd714b20b1ad tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:09.767497 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-394ec163-4591-49cb-b066-bd714b20b1ad tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1361 microversion: 2.1 time: 0.167880 Sep 07 13:40:09.768096 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3548/7067] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:09 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:10.793212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-573981ba-5247-4ecd-9e34-41d3ed84b898 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:10.793945 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-573981ba-5247-4ecd-9e34-41d3ed84b898 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:10.801702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-573981ba-5247-4ecd-9e34-41d3ed84b898 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:10.802199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-573981ba-5247-4ecd-9e34-41d3ed84b898 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:10.802638 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-573981ba-5247-4ecd-9e34-41d3ed84b898 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:10.803341 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-573981ba-5247-4ecd-9e34-41d3ed84b898 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:10.803849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-573981ba-5247-4ecd-9e34-41d3ed84b898 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:10.804344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-573981ba-5247-4ecd-9e34-41d3ed84b898 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:10.946606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-573981ba-5247-4ecd-9e34-41d3ed84b898 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:10.957048 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-573981ba-5247-4ecd-9e34-41d3ed84b898 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1361 microversion: 2.1 time: 0.168887 Sep 07 13:40:10.957667 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3520/7068] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:10 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:11.982122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f5da4b59-d7e5-401a-8ac9-2252eb8836bc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:11.983837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f5da4b59-d7e5-401a-8ac9-2252eb8836bc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:11.990523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5da4b59-d7e5-401a-8ac9-2252eb8836bc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:11.991045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5da4b59-d7e5-401a-8ac9-2252eb8836bc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:11.991543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5da4b59-d7e5-401a-8ac9-2252eb8836bc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:11.992342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5da4b59-d7e5-401a-8ac9-2252eb8836bc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:11.992872 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5da4b59-d7e5-401a-8ac9-2252eb8836bc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:11.993354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5da4b59-d7e5-401a-8ac9-2252eb8836bc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:12.142828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f5da4b59-d7e5-401a-8ac9-2252eb8836bc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:12.150749 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f5da4b59-d7e5-401a-8ac9-2252eb8836bc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1361 microversion: 2.1 time: 0.173080 Sep 07 13:40:12.151320 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3549/7069] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:11 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:13.175153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-074c2a91-ec6c-4145-8e23-24e6ee356dc9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:13.175797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-074c2a91-ec6c-4145-8e23-24e6ee356dc9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:13.184164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-074c2a91-ec6c-4145-8e23-24e6ee356dc9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:13.184534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-074c2a91-ec6c-4145-8e23-24e6ee356dc9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:13.184996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-074c2a91-ec6c-4145-8e23-24e6ee356dc9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:13.185740 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-074c2a91-ec6c-4145-8e23-24e6ee356dc9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:13.186220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-074c2a91-ec6c-4145-8e23-24e6ee356dc9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:13.186645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-074c2a91-ec6c-4145-8e23-24e6ee356dc9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:13.341514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-074c2a91-ec6c-4145-8e23-24e6ee356dc9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:13.353751 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-074c2a91-ec6c-4145-8e23-24e6ee356dc9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1361 microversion: 2.1 time: 0.182469 Sep 07 13:40:13.354541 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3521/7070] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:13 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:13.899723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-d43f609f-594e-47fe-ab8a-a5ac90ee944a req-32e6a4bc-6043-4e9f-9995-a63b7b228429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed905d1-0713-49f5-aa66-1574b0734a2c", "name": "network-vif-plugged", "status": "completed", "tag": "64c2bb70-792f-4add-be02-5a910ffe0922"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:40:13.913438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d43f609f-594e-47fe-ab8a-a5ac90ee944a req-32e6a4bc-6043-4e9f-9995-a63b7b228429 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:13.913983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d43f609f-594e-47fe-ab8a-a5ac90ee944a req-32e6a4bc-6043-4e9f-9995-a63b7b228429 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:13.914439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-d43f609f-594e-47fe-ab8a-a5ac90ee944a req-32e6a4bc-6043-4e9f-9995-a63b7b228429 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:13.926317 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-d43f609f-594e-47fe-ab8a-a5ac90ee944a req-32e6a4bc-6043-4e9f-9995-a63b7b228429 service nova] Creating event network-vif-plugged:64c2bb70-792f-4add-be02-5a910ffe0922 for instance 4ed905d1-0713-49f5-aa66-1574b0734a2c on n-h2-852087-9 Sep 07 13:40:13.931665 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-d43f609f-594e-47fe-ab8a-a5ac90ee944a req-32e6a4bc-6043-4e9f-9995-a63b7b228429 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035962 Sep 07 13:40:13.932268 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3550/7071] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:40:14.380778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bb50d659-4da6-40df-9bb2-6da23fab3d6a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:14.381434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bb50d659-4da6-40df-9bb2-6da23fab3d6a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:14.388800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb50d659-4da6-40df-9bb2-6da23fab3d6a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:14.389304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb50d659-4da6-40df-9bb2-6da23fab3d6a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:14.389781 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb50d659-4da6-40df-9bb2-6da23fab3d6a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:14.390489 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb50d659-4da6-40df-9bb2-6da23fab3d6a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:14.390943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb50d659-4da6-40df-9bb2-6da23fab3d6a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:14.391368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb50d659-4da6-40df-9bb2-6da23fab3d6a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:14.546012 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bb50d659-4da6-40df-9bb2-6da23fab3d6a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:14.555565 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bb50d659-4da6-40df-9bb2-6da23fab3d6a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1361 microversion: 2.1 time: 0.179001 Sep 07 13:40:14.556139 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3522/7072] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:14 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:15.580423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cd4f407f-3707-4429-a9ee-7e570f40bdb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:15.581461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cd4f407f-3707-4429-a9ee-7e570f40bdb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:15.589966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd4f407f-3707-4429-a9ee-7e570f40bdb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:15.590474 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd4f407f-3707-4429-a9ee-7e570f40bdb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:15.590932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd4f407f-3707-4429-a9ee-7e570f40bdb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:15.591710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd4f407f-3707-4429-a9ee-7e570f40bdb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:15.592185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd4f407f-3707-4429-a9ee-7e570f40bdb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:15.592631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd4f407f-3707-4429-a9ee-7e570f40bdb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:15.741927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cd4f407f-3707-4429-a9ee-7e570f40bdb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:15.751750 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cd4f407f-3707-4429-a9ee-7e570f40bdb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1547 microversion: 2.1 time: 0.175796 Sep 07 13:40:15.752311 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3551/7073] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:15 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1547 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:15.775547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-21f438b0-8768-4fa4-b446-90a08b2aad47 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:15.776071 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-21f438b0-8768-4fa4-b446-90a08b2aad47 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:15.783500 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21f438b0-8768-4fa4-b446-90a08b2aad47 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:15.784136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21f438b0-8768-4fa4-b446-90a08b2aad47 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:15.784578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21f438b0-8768-4fa4-b446-90a08b2aad47 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:15.785257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21f438b0-8768-4fa4-b446-90a08b2aad47 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:15.785780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21f438b0-8768-4fa4-b446-90a08b2aad47 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:15.786210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21f438b0-8768-4fa4-b446-90a08b2aad47 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:15.868258 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-21f438b0-8768-4fa4-b446-90a08b2aad47 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096237 Sep 07 13:40:15.869166 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3523/7074] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Sep 7 13:40:15 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:40:16.895956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-b420bda7-e191-41cb-8198-30e03ef30d60 req-00fc14ae-15f5-4dcc-af5d-0954198a27d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ed905d1-0713-49f5-aa66-1574b0734a2c", "tag": "64c2bb70-792f-4add-be02-5a910ffe0922"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:40:16.906962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:40:16.911040 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b420bda7-e191-41cb-8198-30e03ef30d60 req-00fc14ae-15f5-4dcc-af5d-0954198a27d6 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:16.911591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b420bda7-e191-41cb-8198-30e03ef30d60 req-00fc14ae-15f5-4dcc-af5d-0954198a27d6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:16.912109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b420bda7-e191-41cb-8198-30e03ef30d60 req-00fc14ae-15f5-4dcc-af5d-0954198a27d6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:16.924222 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-b420bda7-e191-41cb-8198-30e03ef30d60 req-00fc14ae-15f5-4dcc-af5d-0954198a27d6 service nova] Creating event network-changed:64c2bb70-792f-4add-be02-5a910ffe0922 for instance 4ed905d1-0713-49f5-aa66-1574b0734a2c on n-h2-852087-9 Sep 07 13:40:16.929365 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-b420bda7-e191-41cb-8198-30e03ef30d60 req-00fc14ae-15f5-4dcc-af5d-0954198a27d6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037274 Sep 07 13:40:16.930027 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3552/7075] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:40:49.869329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:40:49.870152 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:40:49.872034 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:40:49.872833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:40:49.877334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eaeec7ac-fb0b-465c-a3a4-fe8e652fc039 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:40:49.879889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eaeec7ac-fb0b-465c-a3a4-fe8e652fc039 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:49.888735 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaeec7ac-fb0b-465c-a3a4-fe8e652fc039 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:49.889249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaeec7ac-fb0b-465c-a3a4-fe8e652fc039 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:49.889730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaeec7ac-fb0b-465c-a3a4-fe8e652fc039 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:49.890439 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaeec7ac-fb0b-465c-a3a4-fe8e652fc039 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:49.890898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaeec7ac-fb0b-465c-a3a4-fe8e652fc039 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:49.891326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eaeec7ac-fb0b-465c-a3a4-fe8e652fc039 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:49.922648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eaeec7ac-fb0b-465c-a3a4-fe8e652fc039 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:49.928934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eaeec7ac-fb0b-465c-a3a4-fe8e652fc039 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Old instance type m1.heat2, new instance type m1.heat {{(pid=122432) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 13:40:49.935704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-eaeec7ac-fb0b-465c-a3a4-fe8e652fc039 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:40:49.936125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-eaeec7ac-fb0b-465c-a3a4-fe8e652fc039 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:40:49.936593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-eaeec7ac-fb0b-465c-a3a4-fe8e652fc039 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:40:49.937063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-eaeec7ac-fb0b-465c-a3a4-fe8e652fc039 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:40:49.937411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-eaeec7ac-fb0b-465c-a3a4-fe8e652fc039 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:40:50.009607 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eaeec7ac-fb0b-465c-a3a4-fe8e652fc039 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "POST /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c/action" status: 202 len: 0 microversion: 2.1 time: 0.141036 Sep 07 13:40:50.010534 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3524/7076] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:40:49 2022] POST /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:40:50.017050 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:40:50.017953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:40:50.023311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2ccf77bf-89f6-4652-8b22-2a4d0dbfca3a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:50.023491 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2ccf77bf-89f6-4652-8b22-2a4d0dbfca3a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:50.033282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ccf77bf-89f6-4652-8b22-2a4d0dbfca3a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:50.033833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ccf77bf-89f6-4652-8b22-2a4d0dbfca3a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:50.034272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ccf77bf-89f6-4652-8b22-2a4d0dbfca3a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:50.035062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ccf77bf-89f6-4652-8b22-2a4d0dbfca3a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:50.035529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ccf77bf-89f6-4652-8b22-2a4d0dbfca3a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:50.035969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2ccf77bf-89f6-4652-8b22-2a4d0dbfca3a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:50.189747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2ccf77bf-89f6-4652-8b22-2a4d0dbfca3a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:50.198613 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2ccf77bf-89f6-4652-8b22-2a4d0dbfca3a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1675 microversion: 2.1 time: 0.183723 Sep 07 13:40:50.199176 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3553/7077] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:50 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1675 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:51.228382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e426a21-0682-4454-942e-0dd2245669e3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:51.229050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6e426a21-0682-4454-942e-0dd2245669e3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:51.237597 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e426a21-0682-4454-942e-0dd2245669e3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:51.238074 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e426a21-0682-4454-942e-0dd2245669e3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:51.238518 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e426a21-0682-4454-942e-0dd2245669e3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:51.239229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e426a21-0682-4454-942e-0dd2245669e3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:51.239710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e426a21-0682-4454-942e-0dd2245669e3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:51.240136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e426a21-0682-4454-942e-0dd2245669e3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:51.394771 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6e426a21-0682-4454-942e-0dd2245669e3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:51.403015 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6e426a21-0682-4454-942e-0dd2245669e3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1675 microversion: 2.1 time: 0.183571 Sep 07 13:40:51.403611 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3525/7078] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:51 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1675 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:52.427187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1c18fb52-30e9-4156-8025-634d772341c2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:52.427927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1c18fb52-30e9-4156-8025-634d772341c2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:52.435126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c18fb52-30e9-4156-8025-634d772341c2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:52.435722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c18fb52-30e9-4156-8025-634d772341c2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:52.436293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c18fb52-30e9-4156-8025-634d772341c2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:52.437007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c18fb52-30e9-4156-8025-634d772341c2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:52.437639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c18fb52-30e9-4156-8025-634d772341c2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:52.438105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1c18fb52-30e9-4156-8025-634d772341c2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:52.575520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1c18fb52-30e9-4156-8025-634d772341c2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:52.583837 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1c18fb52-30e9-4156-8025-634d772341c2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1680 microversion: 2.1 time: 0.160693 Sep 07 13:40:52.584399 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3554/7079] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:52 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:53.611399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-411f58e1-58fb-42a4-b4ae-34bea24182a0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:53.612232 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-411f58e1-58fb-42a4-b4ae-34bea24182a0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:53.622225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-411f58e1-58fb-42a4-b4ae-34bea24182a0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:53.623005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-411f58e1-58fb-42a4-b4ae-34bea24182a0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:53.623722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-411f58e1-58fb-42a4-b4ae-34bea24182a0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:53.624794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-411f58e1-58fb-42a4-b4ae-34bea24182a0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:53.625545 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-411f58e1-58fb-42a4-b4ae-34bea24182a0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:53.626199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-411f58e1-58fb-42a4-b4ae-34bea24182a0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:53.784777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-411f58e1-58fb-42a4-b4ae-34bea24182a0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:53.797962 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-411f58e1-58fb-42a4-b4ae-34bea24182a0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1680 microversion: 2.1 time: 0.192225 Sep 07 13:40:53.799048 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3526/7080] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:53 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1680 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:54.826494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ec2668a-3667-4224-88bb-013f3a7550e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:54.827126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8ec2668a-3667-4224-88bb-013f3a7550e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:54.836723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ec2668a-3667-4224-88bb-013f3a7550e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:54.837234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ec2668a-3667-4224-88bb-013f3a7550e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:54.837742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ec2668a-3667-4224-88bb-013f3a7550e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:54.838437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ec2668a-3667-4224-88bb-013f3a7550e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:54.839248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ec2668a-3667-4224-88bb-013f3a7550e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:54.839688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ec2668a-3667-4224-88bb-013f3a7550e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:54.987480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8ec2668a-3667-4224-88bb-013f3a7550e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:54.996036 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8ec2668a-3667-4224-88bb-013f3a7550e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1680 microversion: 2.1 time: 0.175471 Sep 07 13:40:54.996606 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3555/7081] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:54 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:56.021658 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b4df6aee-3b3e-414c-9d76-7c8ad99f27b1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:56.022291 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b4df6aee-3b3e-414c-9d76-7c8ad99f27b1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:56.029616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4df6aee-3b3e-414c-9d76-7c8ad99f27b1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:56.030166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4df6aee-3b3e-414c-9d76-7c8ad99f27b1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:56.030605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4df6aee-3b3e-414c-9d76-7c8ad99f27b1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:56.031302 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4df6aee-3b3e-414c-9d76-7c8ad99f27b1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:56.031758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4df6aee-3b3e-414c-9d76-7c8ad99f27b1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:56.032180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b4df6aee-3b3e-414c-9d76-7c8ad99f27b1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:56.188646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b4df6aee-3b3e-414c-9d76-7c8ad99f27b1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:56.196618 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b4df6aee-3b3e-414c-9d76-7c8ad99f27b1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1680 microversion: 2.1 time: 0.180014 Sep 07 13:40:56.197226 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3527/7082] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:56 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:57.221049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7701de36-f536-46d0-b6a8-267538300107 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:57.221867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7701de36-f536-46d0-b6a8-267538300107 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:57.229417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7701de36-f536-46d0-b6a8-267538300107 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:57.229968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7701de36-f536-46d0-b6a8-267538300107 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:57.230430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7701de36-f536-46d0-b6a8-267538300107 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:57.231145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7701de36-f536-46d0-b6a8-267538300107 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:57.231897 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7701de36-f536-46d0-b6a8-267538300107 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:57.232355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7701de36-f536-46d0-b6a8-267538300107 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:57.384319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7701de36-f536-46d0-b6a8-267538300107 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:57.396012 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7701de36-f536-46d0-b6a8-267538300107 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1680 microversion: 2.1 time: 0.179190 Sep 07 13:40:57.396604 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3556/7083] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:57 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:58.420886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-be4c4085-151a-440a-8cbd-d144480198fa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:58.421566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-be4c4085-151a-440a-8cbd-d144480198fa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:58.430273 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be4c4085-151a-440a-8cbd-d144480198fa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:58.430767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be4c4085-151a-440a-8cbd-d144480198fa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:58.431334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be4c4085-151a-440a-8cbd-d144480198fa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:58.432063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be4c4085-151a-440a-8cbd-d144480198fa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:58.432522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be4c4085-151a-440a-8cbd-d144480198fa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:58.432950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-be4c4085-151a-440a-8cbd-d144480198fa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:58.575191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-be4c4085-151a-440a-8cbd-d144480198fa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:58.583651 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-be4c4085-151a-440a-8cbd-d144480198fa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1680 microversion: 2.1 time: 0.167455 Sep 07 13:40:58.584122 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3528/7084] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:58 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:40:59.611046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8eef54cc-84c6-44e6-bff7-902e330b11cb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:40:59.611832 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8eef54cc-84c6-44e6-bff7-902e330b11cb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:40:59.619921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8eef54cc-84c6-44e6-bff7-902e330b11cb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:59.620429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8eef54cc-84c6-44e6-bff7-902e330b11cb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:59.620888 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8eef54cc-84c6-44e6-bff7-902e330b11cb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:59.621627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8eef54cc-84c6-44e6-bff7-902e330b11cb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:40:59.622139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8eef54cc-84c6-44e6-bff7-902e330b11cb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:40:59.622594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8eef54cc-84c6-44e6-bff7-902e330b11cb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:40:59.767023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8eef54cc-84c6-44e6-bff7-902e330b11cb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:40:59.778995 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8eef54cc-84c6-44e6-bff7-902e330b11cb tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1680 microversion: 2.1 time: 0.173694 Sep 07 13:40:59.779737 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3557/7085] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:40:59 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:00.808331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b55ff510-e695-4542-a1be-339bc74ca070 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:00.808947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b55ff510-e695-4542-a1be-339bc74ca070 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:00.816438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b55ff510-e695-4542-a1be-339bc74ca070 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:00.816920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b55ff510-e695-4542-a1be-339bc74ca070 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:00.817552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b55ff510-e695-4542-a1be-339bc74ca070 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:00.818252 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b55ff510-e695-4542-a1be-339bc74ca070 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:00.818702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b55ff510-e695-4542-a1be-339bc74ca070 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:00.819126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b55ff510-e695-4542-a1be-339bc74ca070 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:00.955155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b55ff510-e695-4542-a1be-339bc74ca070 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:00.963385 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b55ff510-e695-4542-a1be-339bc74ca070 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1680 microversion: 2.1 time: 0.159060 Sep 07 13:41:00.964278 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3529/7086] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:00 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:01.987240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c2ffa6f9-baac-4aaf-b49e-2fd6c0299965 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:01.987853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c2ffa6f9-baac-4aaf-b49e-2fd6c0299965 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:01.995524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2ffa6f9-baac-4aaf-b49e-2fd6c0299965 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:01.996029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2ffa6f9-baac-4aaf-b49e-2fd6c0299965 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:01.996490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2ffa6f9-baac-4aaf-b49e-2fd6c0299965 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:01.997221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2ffa6f9-baac-4aaf-b49e-2fd6c0299965 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:01.997737 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2ffa6f9-baac-4aaf-b49e-2fd6c0299965 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:01.998188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c2ffa6f9-baac-4aaf-b49e-2fd6c0299965 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:02.141340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c2ffa6f9-baac-4aaf-b49e-2fd6c0299965 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:02.149596 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c2ffa6f9-baac-4aaf-b49e-2fd6c0299965 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1680 microversion: 2.1 time: 0.166323 Sep 07 13:41:02.150183 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3558/7087] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:01 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:03.173929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4baa9fd6-6fe8-4c28-896a-a8f3027ad966 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:03.174491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4baa9fd6-6fe8-4c28-896a-a8f3027ad966 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:03.181873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4baa9fd6-6fe8-4c28-896a-a8f3027ad966 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:03.182360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4baa9fd6-6fe8-4c28-896a-a8f3027ad966 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:03.182792 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4baa9fd6-6fe8-4c28-896a-a8f3027ad966 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:03.183475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4baa9fd6-6fe8-4c28-896a-a8f3027ad966 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:03.183928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4baa9fd6-6fe8-4c28-896a-a8f3027ad966 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:03.184349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4baa9fd6-6fe8-4c28-896a-a8f3027ad966 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:03.328018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4baa9fd6-6fe8-4c28-896a-a8f3027ad966 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:03.336328 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4baa9fd6-6fe8-4c28-896a-a8f3027ad966 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1680 microversion: 2.1 time: 0.166508 Sep 07 13:41:03.336942 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3530/7088] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:03 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:04.364790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2fbeea7b-9dfd-42af-88b7-95618faf43ce tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:04.365567 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2fbeea7b-9dfd-42af-88b7-95618faf43ce tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:04.372950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fbeea7b-9dfd-42af-88b7-95618faf43ce tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:04.373463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fbeea7b-9dfd-42af-88b7-95618faf43ce tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:04.373933 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fbeea7b-9dfd-42af-88b7-95618faf43ce tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:04.374655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fbeea7b-9dfd-42af-88b7-95618faf43ce tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:04.375119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fbeea7b-9dfd-42af-88b7-95618faf43ce tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:04.375564 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fbeea7b-9dfd-42af-88b7-95618faf43ce tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:04.513624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2fbeea7b-9dfd-42af-88b7-95618faf43ce tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:04.521718 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2fbeea7b-9dfd-42af-88b7-95618faf43ce tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1680 microversion: 2.1 time: 0.161139 Sep 07 13:41:04.522363 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3559/7089] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:04 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:05.548177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fb16da76-f1a1-46d5-b3c6-fa1ebbda7ffa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:05.548898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fb16da76-f1a1-46d5-b3c6-fa1ebbda7ffa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:05.558398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb16da76-f1a1-46d5-b3c6-fa1ebbda7ffa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:05.558929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb16da76-f1a1-46d5-b3c6-fa1ebbda7ffa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:05.559371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb16da76-f1a1-46d5-b3c6-fa1ebbda7ffa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:05.560080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb16da76-f1a1-46d5-b3c6-fa1ebbda7ffa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:05.560541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb16da76-f1a1-46d5-b3c6-fa1ebbda7ffa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:05.560975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb16da76-f1a1-46d5-b3c6-fa1ebbda7ffa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:05.706992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fb16da76-f1a1-46d5-b3c6-fa1ebbda7ffa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:05.721310 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fb16da76-f1a1-46d5-b3c6-fa1ebbda7ffa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1680 microversion: 2.1 time: 0.178489 Sep 07 13:41:05.722282 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3531/7090] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:05 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:06.750976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-78e7107c-4713-44e4-b6ae-942716566c8d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:06.750976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-78e7107c-4713-44e4-b6ae-942716566c8d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:06.757184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78e7107c-4713-44e4-b6ae-942716566c8d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:06.757739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78e7107c-4713-44e4-b6ae-942716566c8d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:06.758215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78e7107c-4713-44e4-b6ae-942716566c8d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:06.758955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78e7107c-4713-44e4-b6ae-942716566c8d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:06.759482 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78e7107c-4713-44e4-b6ae-942716566c8d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:06.759932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-78e7107c-4713-44e4-b6ae-942716566c8d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:06.911084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-78e7107c-4713-44e4-b6ae-942716566c8d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:06.919769 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-78e7107c-4713-44e4-b6ae-942716566c8d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1680 microversion: 2.1 time: 0.175477 Sep 07 13:41:06.920344 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3560/7091] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:06 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:07.944782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4852e924-9bdd-44d8-8f73-ce360a4af003 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:07.945356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4852e924-9bdd-44d8-8f73-ce360a4af003 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:07.952877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4852e924-9bdd-44d8-8f73-ce360a4af003 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:07.953340 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4852e924-9bdd-44d8-8f73-ce360a4af003 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:07.953833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4852e924-9bdd-44d8-8f73-ce360a4af003 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:07.954524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4852e924-9bdd-44d8-8f73-ce360a4af003 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:07.954975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4852e924-9bdd-44d8-8f73-ce360a4af003 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:07.955378 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4852e924-9bdd-44d8-8f73-ce360a4af003 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:08.109994 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4852e924-9bdd-44d8-8f73-ce360a4af003 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:08.121154 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4852e924-9bdd-44d8-8f73-ce360a4af003 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1680 microversion: 2.1 time: 0.180299 Sep 07 13:41:08.121940 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3532/7092] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:07 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:09.144840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-28d694d2-e33a-4676-87c2-2fc875fdb10c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:09.145444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-28d694d2-e33a-4676-87c2-2fc875fdb10c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:09.152989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28d694d2-e33a-4676-87c2-2fc875fdb10c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:09.153434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28d694d2-e33a-4676-87c2-2fc875fdb10c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:09.153939 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28d694d2-e33a-4676-87c2-2fc875fdb10c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:09.154665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28d694d2-e33a-4676-87c2-2fc875fdb10c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:09.155142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28d694d2-e33a-4676-87c2-2fc875fdb10c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:09.155571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-28d694d2-e33a-4676-87c2-2fc875fdb10c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:09.315166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-28d694d2-e33a-4676-87c2-2fc875fdb10c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:09.326593 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-28d694d2-e33a-4676-87c2-2fc875fdb10c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1680 microversion: 2.1 time: 0.186092 Sep 07 13:41:09.327180 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3561/7093] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:09 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1680 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:10.350968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-28d60e10-b2f9-4d63-8950-327b33407d6d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:10.351864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-28d60e10-b2f9-4d63-8950-327b33407d6d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:10.358928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28d60e10-b2f9-4d63-8950-327b33407d6d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:10.359423 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28d60e10-b2f9-4d63-8950-327b33407d6d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:10.359857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28d60e10-b2f9-4d63-8950-327b33407d6d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:10.360544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28d60e10-b2f9-4d63-8950-327b33407d6d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:10.361001 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28d60e10-b2f9-4d63-8950-327b33407d6d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:10.361425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28d60e10-b2f9-4d63-8950-327b33407d6d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:10.385857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-8a4d99c6-7319-45bf-8393-277b314b4567 req-20f0b1e8-ff1b-4632-a0d2-8de8ae679c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed905d1-0713-49f5-aa66-1574b0734a2c", "name": "network-vif-unplugged", "status": "completed", "tag": "64c2bb70-792f-4add-be02-5a910ffe0922"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:41:10.397669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8a4d99c6-7319-45bf-8393-277b314b4567 req-20f0b1e8-ff1b-4632-a0d2-8de8ae679c30 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:10.398510 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8a4d99c6-7319-45bf-8393-277b314b4567 req-20f0b1e8-ff1b-4632-a0d2-8de8ae679c30 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:10.399168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-8a4d99c6-7319-45bf-8393-277b314b4567 req-20f0b1e8-ff1b-4632-a0d2-8de8ae679c30 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:10.411950 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-8a4d99c6-7319-45bf-8393-277b314b4567 req-20f0b1e8-ff1b-4632-a0d2-8de8ae679c30 service nova] Creating event network-vif-unplugged:64c2bb70-792f-4add-be02-5a910ffe0922 for instance 4ed905d1-0713-49f5-aa66-1574b0734a2c on n-h1-852087-9 Sep 07 13:41:10.417890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-8a4d99c6-7319-45bf-8393-277b314b4567 req-20f0b1e8-ff1b-4632-a0d2-8de8ae679c30 service nova] Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:41:10.432538 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-8a4d99c6-7319-45bf-8393-277b314b4567 req-20f0b1e8-ff1b-4632-a0d2-8de8ae679c30 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050938 Sep 07 13:41:10.433589 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3562/7094] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:41:10.502797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-28d60e10-b2f9-4d63-8950-327b33407d6d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:10.511608 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-28d60e10-b2f9-4d63-8950-327b33407d6d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1679 microversion: 2.1 time: 0.164611 Sep 07 13:41:10.526032 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3533/7095] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:10 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:11.538479 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c4f1f30e-4e92-4d8f-83f9-7cf4a9d47423 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:11.539186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c4f1f30e-4e92-4d8f-83f9-7cf4a9d47423 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:11.546237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4f1f30e-4e92-4d8f-83f9-7cf4a9d47423 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:11.546995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4f1f30e-4e92-4d8f-83f9-7cf4a9d47423 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:11.547687 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4f1f30e-4e92-4d8f-83f9-7cf4a9d47423 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:11.548712 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4f1f30e-4e92-4d8f-83f9-7cf4a9d47423 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:11.549444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4f1f30e-4e92-4d8f-83f9-7cf4a9d47423 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:11.550329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4f1f30e-4e92-4d8f-83f9-7cf4a9d47423 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:11.689774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c4f1f30e-4e92-4d8f-83f9-7cf4a9d47423 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:11.697940 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c4f1f30e-4e92-4d8f-83f9-7cf4a9d47423 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1679 microversion: 2.1 time: 0.165132 Sep 07 13:41:11.698564 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3563/7096] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:11 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:12.471554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-cc872477-ff1b-4ab7-bbac-b2197c7e2b38 req-424fe867-9796-4ded-bc43-cc5ac5fc1b48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ed905d1-0713-49f5-aa66-1574b0734a2c", "tag": "64c2bb70-792f-4add-be02-5a910ffe0922"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:41:12.482856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cc872477-ff1b-4ab7-bbac-b2197c7e2b38 req-424fe867-9796-4ded-bc43-cc5ac5fc1b48 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:12.483338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cc872477-ff1b-4ab7-bbac-b2197c7e2b38 req-424fe867-9796-4ded-bc43-cc5ac5fc1b48 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:12.483773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cc872477-ff1b-4ab7-bbac-b2197c7e2b38 req-424fe867-9796-4ded-bc43-cc5ac5fc1b48 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:12.496243 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-cc872477-ff1b-4ab7-bbac-b2197c7e2b38 req-424fe867-9796-4ded-bc43-cc5ac5fc1b48 service nova] Creating event network-changed:64c2bb70-792f-4add-be02-5a910ffe0922 for instance 4ed905d1-0713-49f5-aa66-1574b0734a2c on n-h1-852087-9 Sep 07 13:41:12.501791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-cc872477-ff1b-4ab7-bbac-b2197c7e2b38 req-424fe867-9796-4ded-bc43-cc5ac5fc1b48 service nova] Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:41:12.513473 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-cc872477-ff1b-4ab7-bbac-b2197c7e2b38 req-424fe867-9796-4ded-bc43-cc5ac5fc1b48 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045694 Sep 07 13:41:12.514559 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3534/7097] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:41:12.722491 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4430d1be-e42d-485a-8b20-cde6b427cc27 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:12.723319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4430d1be-e42d-485a-8b20-cde6b427cc27 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:12.731404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4430d1be-e42d-485a-8b20-cde6b427cc27 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:12.731950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4430d1be-e42d-485a-8b20-cde6b427cc27 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:12.732410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4430d1be-e42d-485a-8b20-cde6b427cc27 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:12.733145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4430d1be-e42d-485a-8b20-cde6b427cc27 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:12.733665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4430d1be-e42d-485a-8b20-cde6b427cc27 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:12.734118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4430d1be-e42d-485a-8b20-cde6b427cc27 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:12.872354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4430d1be-e42d-485a-8b20-cde6b427cc27 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:12.880604 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4430d1be-e42d-485a-8b20-cde6b427cc27 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1677 microversion: 2.1 time: 0.162177 Sep 07 13:41:12.881229 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3564/7098] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:12 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:13.907637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f48fe305-4584-4059-8793-7e0cd5ff9abc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:13.908348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f48fe305-4584-4059-8793-7e0cd5ff9abc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:13.916131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f48fe305-4584-4059-8793-7e0cd5ff9abc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:13.916131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f48fe305-4584-4059-8793-7e0cd5ff9abc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:13.916131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f48fe305-4584-4059-8793-7e0cd5ff9abc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:13.916690 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f48fe305-4584-4059-8793-7e0cd5ff9abc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:13.917144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f48fe305-4584-4059-8793-7e0cd5ff9abc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:13.917610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f48fe305-4584-4059-8793-7e0cd5ff9abc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:14.068323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f48fe305-4584-4059-8793-7e0cd5ff9abc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:14.076439 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f48fe305-4584-4059-8793-7e0cd5ff9abc tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1677 microversion: 2.1 time: 0.174210 Sep 07 13:41:14.077455 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3535/7099] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:13 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:15.100856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-49b156d6-e471-4657-920d-26013211326e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:15.101470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-49b156d6-e471-4657-920d-26013211326e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:15.108867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49b156d6-e471-4657-920d-26013211326e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:15.109379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49b156d6-e471-4657-920d-26013211326e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:15.109839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49b156d6-e471-4657-920d-26013211326e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:15.110565 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49b156d6-e471-4657-920d-26013211326e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:15.111067 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49b156d6-e471-4657-920d-26013211326e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:15.111678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-49b156d6-e471-4657-920d-26013211326e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:15.254875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-49b156d6-e471-4657-920d-26013211326e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:15.263034 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-49b156d6-e471-4657-920d-26013211326e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1674 microversion: 2.1 time: 0.166236 Sep 07 13:41:15.263734 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3565/7100] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:15 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:15.286832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-37358186-c8b3-4d48-9a90-d8d3326e0247 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:41:15.287408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-37358186-c8b3-4d48-9a90-d8d3326e0247 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:15.294871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37358186-c8b3-4d48-9a90-d8d3326e0247 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:15.295413 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37358186-c8b3-4d48-9a90-d8d3326e0247 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:15.295855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37358186-c8b3-4d48-9a90-d8d3326e0247 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:15.296564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37358186-c8b3-4d48-9a90-d8d3326e0247 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:15.297029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37358186-c8b3-4d48-9a90-d8d3326e0247 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:15.297461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37358186-c8b3-4d48-9a90-d8d3326e0247 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:15.337814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37358186-c8b3-4d48-9a90-d8d3326e0247 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:15.338301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37358186-c8b3-4d48-9a90-d8d3326e0247 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:15.338743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37358186-c8b3-4d48-9a90-d8d3326e0247 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:15.339819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37358186-c8b3-4d48-9a90-d8d3326e0247 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:15.340278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37358186-c8b3-4d48-9a90-d8d3326e0247 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:15.340704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-37358186-c8b3-4d48-9a90-d8d3326e0247 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:15.362312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-37358186-c8b3-4d48-9a90-d8d3326e0247 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Getting quotas for project 396666be58fa42568bdfa2652d635a41. Resources: {'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:41:15.369369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-37358186-c8b3-4d48-9a90-d8d3326e0247 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Getting quotas for user bb0e9196784341cbb170c1c055e8966f and project 396666be58fa42568bdfa2652d635a41. Resources: {'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:41:15.458474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:41:15.486166 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-37358186-c8b3-4d48-9a90-d8d3326e0247 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "POST /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c/action" status: 202 len: 0 microversion: 2.1 time: 0.203149 Sep 07 13:41:15.486798 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3536/7101] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:41:15 2022] POST /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:41:15.496317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ed9407c6-c949-429b-8099-11bc273c3689 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:15.497265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ed9407c6-c949-429b-8099-11bc273c3689 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:15.504270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed9407c6-c949-429b-8099-11bc273c3689 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:15.505290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed9407c6-c949-429b-8099-11bc273c3689 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:15.505576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed9407c6-c949-429b-8099-11bc273c3689 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:15.506449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed9407c6-c949-429b-8099-11bc273c3689 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:15.507046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed9407c6-c949-429b-8099-11bc273c3689 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:15.507490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ed9407c6-c949-429b-8099-11bc273c3689 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:15.650740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ed9407c6-c949-429b-8099-11bc273c3689 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:15.661165 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ed9407c6-c949-429b-8099-11bc273c3689 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1673 microversion: 2.1 time: 0.169533 Sep 07 13:41:15.661769 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3566/7102] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:15 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:41:16.686233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f60f9c70-b436-40ae-8cfd-e420f8c9e809 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:16.686983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f60f9c70-b436-40ae-8cfd-e420f8c9e809 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:16.695014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f60f9c70-b436-40ae-8cfd-e420f8c9e809 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:16.695510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f60f9c70-b436-40ae-8cfd-e420f8c9e809 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:16.695972 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f60f9c70-b436-40ae-8cfd-e420f8c9e809 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:16.696733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f60f9c70-b436-40ae-8cfd-e420f8c9e809 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:16.697180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f60f9c70-b436-40ae-8cfd-e420f8c9e809 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:16.697643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f60f9c70-b436-40ae-8cfd-e420f8c9e809 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:16.849550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f60f9c70-b436-40ae-8cfd-e420f8c9e809 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:16.857863 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f60f9c70-b436-40ae-8cfd-e420f8c9e809 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1673 microversion: 2.1 time: 0.176069 Sep 07 13:41:16.858486 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3537/7103] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:16 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1673 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:17.552521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-96216213-5b8d-4f19-8cac-6f6046709391 req-9f8399ab-905b-41db-8bb4-6723f9b0712d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed905d1-0713-49f5-aa66-1574b0734a2c", "name": "network-vif-plugged", "status": "completed", "tag": "64c2bb70-792f-4add-be02-5a910ffe0922"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:41:17.565152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-96216213-5b8d-4f19-8cac-6f6046709391 req-9f8399ab-905b-41db-8bb4-6723f9b0712d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:17.565942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-96216213-5b8d-4f19-8cac-6f6046709391 req-9f8399ab-905b-41db-8bb4-6723f9b0712d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:17.566381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-96216213-5b8d-4f19-8cac-6f6046709391 req-9f8399ab-905b-41db-8bb4-6723f9b0712d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:17.582091 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-96216213-5b8d-4f19-8cac-6f6046709391 req-9f8399ab-905b-41db-8bb4-6723f9b0712d service nova] Creating event network-vif-plugged:64c2bb70-792f-4add-be02-5a910ffe0922 for instance 4ed905d1-0713-49f5-aa66-1574b0734a2c on n-h1-852087-9 Sep 07 13:41:17.588256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-96216213-5b8d-4f19-8cac-6f6046709391 req-9f8399ab-905b-41db-8bb4-6723f9b0712d service nova] Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:41:17.600426 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-96216213-5b8d-4f19-8cac-6f6046709391 req-9f8399ab-905b-41db-8bb4-6723f9b0712d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052039 Sep 07 13:41:17.601500 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3567/7104] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:41:17.883829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1d2a0653-de82-4ff5-b312-add24126ca87 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:17.885248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1d2a0653-de82-4ff5-b312-add24126ca87 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:17.894526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d2a0653-de82-4ff5-b312-add24126ca87 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:17.895450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d2a0653-de82-4ff5-b312-add24126ca87 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:17.896081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d2a0653-de82-4ff5-b312-add24126ca87 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:17.897312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d2a0653-de82-4ff5-b312-add24126ca87 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:17.897896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d2a0653-de82-4ff5-b312-add24126ca87 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:17.898350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1d2a0653-de82-4ff5-b312-add24126ca87 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:18.071714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1d2a0653-de82-4ff5-b312-add24126ca87 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:18.081004 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1d2a0653-de82-4ff5-b312-add24126ca87 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1673 microversion: 2.1 time: 0.202124 Sep 07 13:41:18.081659 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3538/7105] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:17 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1673 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:19.109660 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ead88836-0d6d-44d5-9f46-4479f00dc7e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:19.110423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ead88836-0d6d-44d5-9f46-4479f00dc7e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:19.117302 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ead88836-0d6d-44d5-9f46-4479f00dc7e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:19.118086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ead88836-0d6d-44d5-9f46-4479f00dc7e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:19.118594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ead88836-0d6d-44d5-9f46-4479f00dc7e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:19.119406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ead88836-0d6d-44d5-9f46-4479f00dc7e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:19.119910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ead88836-0d6d-44d5-9f46-4479f00dc7e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:19.120422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ead88836-0d6d-44d5-9f46-4479f00dc7e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:19.139263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-846f6308-ad67-4d74-b7d3-df440fa754ac req-f2d6299d-61b0-4fbb-98fc-b400967a6ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed905d1-0713-49f5-aa66-1574b0734a2c", "name": "network-vif-unplugged", "status": "completed", "tag": "64c2bb70-792f-4add-be02-5a910ffe0922"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:41:19.153669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-846f6308-ad67-4d74-b7d3-df440fa754ac req-f2d6299d-61b0-4fbb-98fc-b400967a6ab2 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:19.154605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-846f6308-ad67-4d74-b7d3-df440fa754ac req-f2d6299d-61b0-4fbb-98fc-b400967a6ab2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:19.155316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-846f6308-ad67-4d74-b7d3-df440fa754ac req-f2d6299d-61b0-4fbb-98fc-b400967a6ab2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:19.175667 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-846f6308-ad67-4d74-b7d3-df440fa754ac req-f2d6299d-61b0-4fbb-98fc-b400967a6ab2 service nova] Creating event network-vif-unplugged:64c2bb70-792f-4add-be02-5a910ffe0922 for instance 4ed905d1-0713-49f5-aa66-1574b0734a2c on n-h2-852087-9 Sep 07 13:41:19.182778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-846f6308-ad67-4d74-b7d3-df440fa754ac req-f2d6299d-61b0-4fbb-98fc-b400967a6ab2 service nova] Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:41:19.197727 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-846f6308-ad67-4d74-b7d3-df440fa754ac req-f2d6299d-61b0-4fbb-98fc-b400967a6ab2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062984 Sep 07 13:41:19.199003 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3539/7106] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:41:19.267003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ead88836-0d6d-44d5-9f46-4479f00dc7e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:19.275601 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ead88836-0d6d-44d5-9f46-4479f00dc7e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1673 microversion: 2.1 time: 0.171343 Sep 07 13:41:19.276208 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3568/7107] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:19 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:20.302466 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-18c008a2-71e0-4d31-b200-32ccc06eedb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:20.303172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-18c008a2-71e0-4d31-b200-32ccc06eedb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:20.305190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:41:20.311716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18c008a2-71e0-4d31-b200-32ccc06eedb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:20.312187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18c008a2-71e0-4d31-b200-32ccc06eedb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:20.312643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18c008a2-71e0-4d31-b200-32ccc06eedb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:20.313385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18c008a2-71e0-4d31-b200-32ccc06eedb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:20.313869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18c008a2-71e0-4d31-b200-32ccc06eedb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:20.314295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-18c008a2-71e0-4d31-b200-32ccc06eedb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:20.460623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-18c008a2-71e0-4d31-b200-32ccc06eedb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:20.474182 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-18c008a2-71e0-4d31-b200-32ccc06eedb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1673 microversion: 2.1 time: 0.176567 Sep 07 13:41:20.474893 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3540/7108] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:20 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1673 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:21.231617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-6c0e5333-ce19-41a4-8122-aa6b9683de91 req-fb1d8e58-c313-45d6-a19d-0c54a5f26904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ed905d1-0713-49f5-aa66-1574b0734a2c", "tag": "64c2bb70-792f-4add-be02-5a910ffe0922"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:41:21.238184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=33 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:41:21.244816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6c0e5333-ce19-41a4-8122-aa6b9683de91 req-fb1d8e58-c313-45d6-a19d-0c54a5f26904 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:21.245332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6c0e5333-ce19-41a4-8122-aa6b9683de91 req-fb1d8e58-c313-45d6-a19d-0c54a5f26904 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:21.245810 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6c0e5333-ce19-41a4-8122-aa6b9683de91 req-fb1d8e58-c313-45d6-a19d-0c54a5f26904 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:21.249084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=93 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:41:21.260740 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-6c0e5333-ce19-41a4-8122-aa6b9683de91 req-fb1d8e58-c313-45d6-a19d-0c54a5f26904 service nova] Creating event network-changed:64c2bb70-792f-4add-be02-5a910ffe0922 for instance 4ed905d1-0713-49f5-aa66-1574b0734a2c on n-h2-852087-9 Sep 07 13:41:21.267387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-6c0e5333-ce19-41a4-8122-aa6b9683de91 req-fb1d8e58-c313-45d6-a19d-0c54a5f26904 service nova] Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:41:21.279136 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-6c0e5333-ce19-41a4-8122-aa6b9683de91 req-fb1d8e58-c313-45d6-a19d-0c54a5f26904 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053635 Sep 07 13:41:21.279752 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3569/7109] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:41:21.506441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-daed1da5-749f-4aa8-8bbb-f424b8bf46c6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:21.507242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-daed1da5-749f-4aa8-8bbb-f424b8bf46c6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:21.518509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-daed1da5-749f-4aa8-8bbb-f424b8bf46c6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:21.519011 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-daed1da5-749f-4aa8-8bbb-f424b8bf46c6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:21.519451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-daed1da5-749f-4aa8-8bbb-f424b8bf46c6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:21.520141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-daed1da5-749f-4aa8-8bbb-f424b8bf46c6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:21.520597 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-daed1da5-749f-4aa8-8bbb-f424b8bf46c6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:21.521015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-daed1da5-749f-4aa8-8bbb-f424b8bf46c6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:21.659892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-daed1da5-749f-4aa8-8bbb-f424b8bf46c6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:21.668268 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-daed1da5-749f-4aa8-8bbb-f424b8bf46c6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1673 microversion: 2.1 time: 0.165901 Sep 07 13:41:21.668856 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3541/7110] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:21 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:22.694601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b41782b4-cd06-4a61-ac42-52708f349f26 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:22.695363 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b41782b4-cd06-4a61-ac42-52708f349f26 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:22.702018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b41782b4-cd06-4a61-ac42-52708f349f26 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:22.702556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b41782b4-cd06-4a61-ac42-52708f349f26 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:22.703000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b41782b4-cd06-4a61-ac42-52708f349f26 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:22.703722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b41782b4-cd06-4a61-ac42-52708f349f26 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:22.704199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b41782b4-cd06-4a61-ac42-52708f349f26 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:22.704645 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b41782b4-cd06-4a61-ac42-52708f349f26 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:22.923635 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b41782b4-cd06-4a61-ac42-52708f349f26 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:22.931903 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b41782b4-cd06-4a61-ac42-52708f349f26 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1666 microversion: 2.1 time: 0.242628 Sep 07 13:41:22.932492 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3570/7111] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:22 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1666 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:22.960423 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-62bbf75a-86a4-4885-9a70-09b2bf0077af tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:22.961077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-62bbf75a-86a4-4885-9a70-09b2bf0077af tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:22.968289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62bbf75a-86a4-4885-9a70-09b2bf0077af tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:22.968779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62bbf75a-86a4-4885-9a70-09b2bf0077af tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:22.969216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62bbf75a-86a4-4885-9a70-09b2bf0077af tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:22.969942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62bbf75a-86a4-4885-9a70-09b2bf0077af tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:22.970399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62bbf75a-86a4-4885-9a70-09b2bf0077af tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:22.970825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62bbf75a-86a4-4885-9a70-09b2bf0077af tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:23.106698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-62bbf75a-86a4-4885-9a70-09b2bf0077af tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:23.115364 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-62bbf75a-86a4-4885-9a70-09b2bf0077af tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1666 microversion: 2.1 time: 0.159005 Sep 07 13:41:23.115873 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3542/7112] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:22 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1666 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:23.138396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-86b4dc01-d881-4710-8e75-d6e46ead6def tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:23.139062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-86b4dc01-d881-4710-8e75-d6e46ead6def tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:23.145359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86b4dc01-d881-4710-8e75-d6e46ead6def tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:23.145915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86b4dc01-d881-4710-8e75-d6e46ead6def tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:23.146377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86b4dc01-d881-4710-8e75-d6e46ead6def tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:23.147100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86b4dc01-d881-4710-8e75-d6e46ead6def tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:23.147581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86b4dc01-d881-4710-8e75-d6e46ead6def tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:23.148033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86b4dc01-d881-4710-8e75-d6e46ead6def tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:23.286551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-86b4dc01-d881-4710-8e75-d6e46ead6def tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:23.295101 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-86b4dc01-d881-4710-8e75-d6e46ead6def tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1666 microversion: 2.1 time: 0.160651 Sep 07 13:41:23.295767 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3571/7113] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:23 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1666 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:23.318312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-02523e04-6a0d-4c8d-9767-dddbb5103834 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:23.318910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-02523e04-6a0d-4c8d-9767-dddbb5103834 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:23.325512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02523e04-6a0d-4c8d-9767-dddbb5103834 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:23.326044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02523e04-6a0d-4c8d-9767-dddbb5103834 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:23.326482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02523e04-6a0d-4c8d-9767-dddbb5103834 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:23.327175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02523e04-6a0d-4c8d-9767-dddbb5103834 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:23.327627 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02523e04-6a0d-4c8d-9767-dddbb5103834 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:23.328053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-02523e04-6a0d-4c8d-9767-dddbb5103834 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:23.354537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-02523e04-6a0d-4c8d-9767-dddbb5103834 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:41:23.441860 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-02523e04-6a0d-4c8d-9767-dddbb5103834 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 204 len: 0 microversion: 2.1 time: 0.127178 Sep 07 13:41:23.442605 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3543/7114] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:41:23 2022] DELETE /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:41:23.450983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6703781a-f3cb-4105-868f-6420097d5ad3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:23.451640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6703781a-f3cb-4105-868f-6420097d5ad3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:23.457959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6703781a-f3cb-4105-868f-6420097d5ad3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:23.458487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6703781a-f3cb-4105-868f-6420097d5ad3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:23.458945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6703781a-f3cb-4105-868f-6420097d5ad3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:23.459660 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6703781a-f3cb-4105-868f-6420097d5ad3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:23.460132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6703781a-f3cb-4105-868f-6420097d5ad3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:23.460572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6703781a-f3cb-4105-868f-6420097d5ad3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:23.607463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6703781a-f3cb-4105-868f-6420097d5ad3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:23.615987 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6703781a-f3cb-4105-868f-6420097d5ad3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1672 microversion: 2.1 time: 0.169015 Sep 07 13:41:23.616582 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3572/7115] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:23 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1672 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:24.254769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-669173ef-6a96-459e-90ef-094ee3e58ddc req-a01519c7-df2e-4e50-bb15-22f615bfaacd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed905d1-0713-49f5-aa66-1574b0734a2c", "name": "network-vif-plugged", "status": "completed", "tag": "64c2bb70-792f-4add-be02-5a910ffe0922"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:41:24.268055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-669173ef-6a96-459e-90ef-094ee3e58ddc req-a01519c7-df2e-4e50-bb15-22f615bfaacd service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:24.268539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-669173ef-6a96-459e-90ef-094ee3e58ddc req-a01519c7-df2e-4e50-bb15-22f615bfaacd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:24.268944 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-669173ef-6a96-459e-90ef-094ee3e58ddc req-a01519c7-df2e-4e50-bb15-22f615bfaacd service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:24.281333 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-669173ef-6a96-459e-90ef-094ee3e58ddc req-a01519c7-df2e-4e50-bb15-22f615bfaacd service nova] Creating event network-vif-plugged:64c2bb70-792f-4add-be02-5a910ffe0922 for instance 4ed905d1-0713-49f5-aa66-1574b0734a2c on n-h2-852087-9 Sep 07 13:41:24.286707 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-669173ef-6a96-459e-90ef-094ee3e58ddc req-a01519c7-df2e-4e50-bb15-22f615bfaacd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036238 Sep 07 13:41:24.287314 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3544/7116] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:41:24.644221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a813de12-34d2-4eab-b4e0-2582ea4bfa38 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:24.644946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a813de12-34d2-4eab-b4e0-2582ea4bfa38 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:24.654866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a813de12-34d2-4eab-b4e0-2582ea4bfa38 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:24.655401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a813de12-34d2-4eab-b4e0-2582ea4bfa38 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:24.655872 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a813de12-34d2-4eab-b4e0-2582ea4bfa38 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:24.656596 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a813de12-34d2-4eab-b4e0-2582ea4bfa38 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:24.657071 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a813de12-34d2-4eab-b4e0-2582ea4bfa38 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:24.657529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a813de12-34d2-4eab-b4e0-2582ea4bfa38 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:24.817841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a813de12-34d2-4eab-b4e0-2582ea4bfa38 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:24.826049 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a813de12-34d2-4eab-b4e0-2582ea4bfa38 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1672 microversion: 2.1 time: 0.188773 Sep 07 13:41:24.826657 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3573/7117] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:24 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1672 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:25.848625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:41:25.853680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cdc98894-beec-4214-98f5-de4dbd1edfa3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:25.854425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cdc98894-beec-4214-98f5-de4dbd1edfa3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:25.862010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdc98894-beec-4214-98f5-de4dbd1edfa3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:25.862257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdc98894-beec-4214-98f5-de4dbd1edfa3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:25.862668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdc98894-beec-4214-98f5-de4dbd1edfa3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:25.863409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdc98894-beec-4214-98f5-de4dbd1edfa3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:25.863866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdc98894-beec-4214-98f5-de4dbd1edfa3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:25.864312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdc98894-beec-4214-98f5-de4dbd1edfa3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:26.064894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cdc98894-beec-4214-98f5-de4dbd1edfa3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:26.073208 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cdc98894-beec-4214-98f5-de4dbd1edfa3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 200 len: 1672 microversion: 2.1 time: 0.226360 Sep 07 13:41:26.074711 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3545/7118] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:25 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 1672 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:26.379222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-e5cf7808-9bc8-44d2-b27d-296a6ea700d7 req-2f3c2bb4-47c4-4972-b99f-e3e9c02e4e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed905d1-0713-49f5-aa66-1574b0734a2c", "name": "network-vif-deleted", "tag": "64c2bb70-792f-4add-be02-5a910ffe0922"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:41:26.392935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e5cf7808-9bc8-44d2-b27d-296a6ea700d7 req-2f3c2bb4-47c4-4972-b99f-e3e9c02e4e9c service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:26.393467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e5cf7808-9bc8-44d2-b27d-296a6ea700d7 req-2f3c2bb4-47c4-4972-b99f-e3e9c02e4e9c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:26.394118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e5cf7808-9bc8-44d2-b27d-296a6ea700d7 req-2f3c2bb4-47c4-4972-b99f-e3e9c02e4e9c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:26.410277 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-e5cf7808-9bc8-44d2-b27d-296a6ea700d7 req-2f3c2bb4-47c4-4972-b99f-e3e9c02e4e9c service nova] Creating event network-vif-deleted:64c2bb70-792f-4add-be02-5a910ffe0922 for instance 4ed905d1-0713-49f5-aa66-1574b0734a2c on n-h2-852087-9 Sep 07 13:41:26.420796 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-e5cf7808-9bc8-44d2-b27d-296a6ea700d7 req-2f3c2bb4-47c4-4972-b99f-e3e9c02e4e9c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040359 Sep 07 13:41:26.420796 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3574/7119] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:41:27.098306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a7f161f9-7e0f-43c5-b5cb-40984916c41f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:27.098922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a7f161f9-7e0f-43c5-b5cb-40984916c41f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:27.106276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7f161f9-7e0f-43c5-b5cb-40984916c41f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:27.106803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7f161f9-7e0f-43c5-b5cb-40984916c41f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:27.107243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7f161f9-7e0f-43c5-b5cb-40984916c41f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:27.107946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7f161f9-7e0f-43c5-b5cb-40984916c41f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:27.108404 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7f161f9-7e0f-43c5-b5cb-40984916c41f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:27.108831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a7f161f9-7e0f-43c5-b5cb-40984916c41f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:27.126312 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-a7f161f9-7e0f-43c5-b5cb-40984916c41f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] HTTP exception thrown: Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c could not be found. Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a7f161f9-7e0f-43c5-b5cb-40984916c41f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Request method failure captured: Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c HTTP/1.1 Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJ6Qa8Wgx3edQ7CXPA7GMXkRXsD6n0ODz0fJ4U_HSdO27cMoqedxiUWhG-0C6635gytRmbSHGz9fwKnUkfS2q0gSeQ7nm1CzWfB0bTkZfTtk2qgxY2gxQer8R0l1g7MVKHxAmv0Z5uiEW3b338LhbLsy-_HbtXv9ZiSJd_u4NfmTSZM Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_396666be58fa42568bdfa2652d635a41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/396666be58fa42568bdfa2652d635a41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: bb0e9196784341cbb170c1c055e8966f Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c could not be found. Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '4ed905d1-0713-49f5-aa66-1574b0734a2c'} Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c could not be found. Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c could not be found. Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:27.128000 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:41:27.132705 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:27.132705 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:27.132705 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:27.132705 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:41:27.132705 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:41:27.132705 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c could not be found. Sep 07 13:41:27.132705 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:41:27.132705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a7f161f9-7e0f-43c5-b5cb-40984916c41f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Returning 404 to user: Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:41:27.132705 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a7f161f9-7e0f-43c5-b5cb-40984916c41f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 404 len: 111 microversion: 2.1 time: 0.035165 Sep 07 13:41:27.132705 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3546/7120] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:27 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:41:27.148383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6d1c71c9-0cc5-4b7d-9a07-dcde122a05f5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:27.149036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6d1c71c9-0cc5-4b7d-9a07-dcde122a05f5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:27.156057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d1c71c9-0cc5-4b7d-9a07-dcde122a05f5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:27.156563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d1c71c9-0cc5-4b7d-9a07-dcde122a05f5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:27.157019 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d1c71c9-0cc5-4b7d-9a07-dcde122a05f5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:27.157757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d1c71c9-0cc5-4b7d-9a07-dcde122a05f5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:27.158255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d1c71c9-0cc5-4b7d-9a07-dcde122a05f5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:27.158879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6d1c71c9-0cc5-4b7d-9a07-dcde122a05f5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:27.173088 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-6d1c71c9-0cc5-4b7d-9a07-dcde122a05f5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] HTTP exception thrown: Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c could not be found. Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6d1c71c9-0cc5-4b7d-9a07-dcde122a05f5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Request method failure captured: Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c HTTP/1.1 Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJ6Qa8Wgx3edQ7CXPA7GMXkRXsD6n0ODz0fJ4U_HSdO27cMoqedxiUWhG-0C6635gytRmbSHGz9fwKnUkfS2q0gSeQ7nm1CzWfB0bTkZfTtk2qgxY2gxQer8R0l1g7MVKHxAmv0Z5uiEW3b338LhbLsy-_HbtXv9ZiSJd_u4NfmTSZM Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_396666be58fa42568bdfa2652d635a41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/396666be58fa42568bdfa2652d635a41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: bb0e9196784341cbb170c1c055e8966f Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c could not be found. Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '4ed905d1-0713-49f5-aa66-1574b0734a2c'} Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c could not be found. Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c could not be found. Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:41:27.174817 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:41:27.179616 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:41:27.179616 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:41:27.179616 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:41:27.179616 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:41:27.179616 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:41:27.179616 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c could not be found. Sep 07 13:41:27.179616 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:41:27.179616 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6d1c71c9-0cc5-4b7d-9a07-dcde122a05f5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Returning 404 to user: Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:41:27.179616 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6d1c71c9-0cc5-4b7d-9a07-dcde122a05f5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 404 len: 111 microversion: 2.1 time: 0.032314 Sep 07 13:41:27.180727 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3575/7121] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:27 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:41:27.227058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-31a49591-d972-4962-86ae-adda83cbd397 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1477911112", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "c0ae2db3-d205-4102-b4b3-830cdd7a4274"}], "security_groups": [{"name": "tempest-securitygroup--971767124"}], "key_name": "tempest-keypair-1624528547", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:41:27.345270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-31a49591-d972-4962-86ae-adda83cbd397 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] validate_networks() for [('c0ae2db3-d205-4102-b4b3-830cdd7a4274', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:41:27.777434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-31a49591-d972-4962-86ae-adda83cbd397 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:41:27.778076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-31a49591-d972-4962-86ae-adda83cbd397 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:41:27.778941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-31a49591-d972-4962-86ae-adda83cbd397 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:41:27.779348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-31a49591-d972-4962-86ae-adda83cbd397 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:41:27.779762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-31a49591-d972-4962-86ae-adda83cbd397 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:41:27.792456 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31a49591-d972-4962-86ae-adda83cbd397 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:27.793031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31a49591-d972-4962-86ae-adda83cbd397 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:27.793652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31a49591-d972-4962-86ae-adda83cbd397 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:27.794756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31a49591-d972-4962-86ae-adda83cbd397 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:27.795425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31a49591-d972-4962-86ae-adda83cbd397 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:27.796143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-31a49591-d972-4962-86ae-adda83cbd397 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:27.818050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-31a49591-d972-4962-86ae-adda83cbd397 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Getting quotas for project 396666be58fa42568bdfa2652d635a41. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:41:27.823651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-31a49591-d972-4962-86ae-adda83cbd397 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Getting quotas for user bb0e9196784341cbb170c1c055e8966f and project 396666be58fa42568bdfa2652d635a41. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:41:27.836660 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-31a49591-d972-4962-86ae-adda83cbd397 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:41:27.839362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-31a49591-d972-4962-86ae-adda83cbd397 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:41:27.892964 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-31a49591-d972-4962-86ae-adda83cbd397 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.669751 Sep 07 13:41:27.894009 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3547/7122] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:41:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:41:27.905367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4ababa62-bd9c-4e1f-8335-436124cd65cf tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:27.906011 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4ababa62-bd9c-4e1f-8335-436124cd65cf tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:27.971302 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4ababa62-bd9c-4e1f-8335-436124cd65cf tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:27.980214 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4ababa62-bd9c-4e1f-8335-436124cd65cf tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1239 microversion: 2.1 time: 0.078924 Sep 07 13:41:27.980806 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3576/7123] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:27 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1239 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:29.006088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-49c70c39-da33-4ba0-8ac5-290fca3b56e7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:29.006742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-49c70c39-da33-4ba0-8ac5-290fca3b56e7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:29.013342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49c70c39-da33-4ba0-8ac5-290fca3b56e7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:29.013860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49c70c39-da33-4ba0-8ac5-290fca3b56e7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:29.014301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49c70c39-da33-4ba0-8ac5-290fca3b56e7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:29.014996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49c70c39-da33-4ba0-8ac5-290fca3b56e7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:29.015462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49c70c39-da33-4ba0-8ac5-290fca3b56e7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:29.015889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49c70c39-da33-4ba0-8ac5-290fca3b56e7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:29.086190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-49c70c39-da33-4ba0-8ac5-290fca3b56e7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:29.095037 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-49c70c39-da33-4ba0-8ac5-290fca3b56e7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1291 microversion: 2.1 time: 0.094192 Sep 07 13:41:29.095768 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3548/7124] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:28 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1291 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:30.123804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-01135e37-12ae-45fd-9708-a3b06073066a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:30.125873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-01135e37-12ae-45fd-9708-a3b06073066a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:30.137981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01135e37-12ae-45fd-9708-a3b06073066a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:30.138892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01135e37-12ae-45fd-9708-a3b06073066a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:30.139709 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01135e37-12ae-45fd-9708-a3b06073066a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:30.141704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01135e37-12ae-45fd-9708-a3b06073066a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:30.141944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01135e37-12ae-45fd-9708-a3b06073066a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:30.142730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01135e37-12ae-45fd-9708-a3b06073066a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:30.330965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-01135e37-12ae-45fd-9708-a3b06073066a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:30.339693 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-01135e37-12ae-45fd-9708-a3b06073066a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1364 microversion: 2.1 time: 0.223405 Sep 07 13:41:30.340274 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3577/7125] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:30 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:30.755435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-ffaf77b2-3819-4d19-969e-d7de53e13bd0 req-3aa18511-a602-4342-91a5-e6f3eeabeb2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b", "tag": "bdc6a934-50a8-4a40-8b33-707c2b450386"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:41:30.767110 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ffaf77b2-3819-4d19-969e-d7de53e13bd0 req-3aa18511-a602-4342-91a5-e6f3eeabeb2f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:30.767612 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ffaf77b2-3819-4d19-969e-d7de53e13bd0 req-3aa18511-a602-4342-91a5-e6f3eeabeb2f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:30.768393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-ffaf77b2-3819-4d19-969e-d7de53e13bd0 req-3aa18511-a602-4342-91a5-e6f3eeabeb2f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:30.785063 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-ffaf77b2-3819-4d19-969e-d7de53e13bd0 req-3aa18511-a602-4342-91a5-e6f3eeabeb2f service nova] Creating event network-changed:bdc6a934-50a8-4a40-8b33-707c2b450386 for instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b on n-h2-852087-9 Sep 07 13:41:30.790465 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-ffaf77b2-3819-4d19-969e-d7de53e13bd0 req-3aa18511-a602-4342-91a5-e6f3eeabeb2f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040021 Sep 07 13:41:30.791492 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3549/7126] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:41:31.366745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bec9b545-028e-4e00-80b6-72a0f816c473 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:31.367667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bec9b545-028e-4e00-80b6-72a0f816c473 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:31.375629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bec9b545-028e-4e00-80b6-72a0f816c473 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:31.376140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bec9b545-028e-4e00-80b6-72a0f816c473 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:31.376602 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bec9b545-028e-4e00-80b6-72a0f816c473 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:31.377326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bec9b545-028e-4e00-80b6-72a0f816c473 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:31.377836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bec9b545-028e-4e00-80b6-72a0f816c473 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:31.378302 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bec9b545-028e-4e00-80b6-72a0f816c473 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:31.513059 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bec9b545-028e-4e00-80b6-72a0f816c473 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:31.526171 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bec9b545-028e-4e00-80b6-72a0f816c473 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1364 microversion: 2.1 time: 0.165059 Sep 07 13:41:31.527014 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3578/7127] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:31 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:32.552466 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2dded792-c7c3-4543-8d7f-cb99da59f76c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:32.553180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2dded792-c7c3-4543-8d7f-cb99da59f76c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:32.559615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dded792-c7c3-4543-8d7f-cb99da59f76c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:32.560095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dded792-c7c3-4543-8d7f-cb99da59f76c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:32.560555 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dded792-c7c3-4543-8d7f-cb99da59f76c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:32.561345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dded792-c7c3-4543-8d7f-cb99da59f76c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:32.561849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dded792-c7c3-4543-8d7f-cb99da59f76c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:32.562406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dded792-c7c3-4543-8d7f-cb99da59f76c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:32.708989 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2dded792-c7c3-4543-8d7f-cb99da59f76c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:32.717873 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2dded792-c7c3-4543-8d7f-cb99da59f76c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1364 microversion: 2.1 time: 0.170605 Sep 07 13:41:32.718458 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3550/7128] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:32 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:33.744241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1f7efc9a-661d-461a-abbe-d8259dbb680c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:33.744864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1f7efc9a-661d-461a-abbe-d8259dbb680c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:33.753846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f7efc9a-661d-461a-abbe-d8259dbb680c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:33.754360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f7efc9a-661d-461a-abbe-d8259dbb680c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:33.754819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f7efc9a-661d-461a-abbe-d8259dbb680c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:33.755538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f7efc9a-661d-461a-abbe-d8259dbb680c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:33.756015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f7efc9a-661d-461a-abbe-d8259dbb680c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:33.756454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f7efc9a-661d-461a-abbe-d8259dbb680c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:33.897600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1f7efc9a-661d-461a-abbe-d8259dbb680c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:33.906360 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1f7efc9a-661d-461a-abbe-d8259dbb680c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1364 microversion: 2.1 time: 0.167915 Sep 07 13:41:33.906940 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3579/7129] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:33 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:34.935010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-87031ae7-2bae-424c-a628-33adfe02e832 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:34.935655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-87031ae7-2bae-424c-a628-33adfe02e832 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:34.943124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87031ae7-2bae-424c-a628-33adfe02e832 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:34.943616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87031ae7-2bae-424c-a628-33adfe02e832 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:34.944057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87031ae7-2bae-424c-a628-33adfe02e832 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:34.944752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87031ae7-2bae-424c-a628-33adfe02e832 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:34.945212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87031ae7-2bae-424c-a628-33adfe02e832 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:34.945666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-87031ae7-2bae-424c-a628-33adfe02e832 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:35.422295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-87031ae7-2bae-424c-a628-33adfe02e832 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:35.430580 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-87031ae7-2bae-424c-a628-33adfe02e832 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1364 microversion: 2.1 time: 0.499729 Sep 07 13:41:35.431128 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3551/7130] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:34 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1364 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:36.323924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-04ccd674-4a58-467b-8e09-592a2fb6d802 req-8552fc93-1cce-4426-8daa-970484159178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b", "name": "network-vif-plugged", "status": "completed", "tag": "bdc6a934-50a8-4a40-8b33-707c2b450386"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:41:36.335185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-04ccd674-4a58-467b-8e09-592a2fb6d802 req-8552fc93-1cce-4426-8daa-970484159178 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:36.335669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-04ccd674-4a58-467b-8e09-592a2fb6d802 req-8552fc93-1cce-4426-8daa-970484159178 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:36.336112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-04ccd674-4a58-467b-8e09-592a2fb6d802 req-8552fc93-1cce-4426-8daa-970484159178 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:36.348355 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-04ccd674-4a58-467b-8e09-592a2fb6d802 req-8552fc93-1cce-4426-8daa-970484159178 service nova] Creating event network-vif-plugged:bdc6a934-50a8-4a40-8b33-707c2b450386 for instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b on n-h2-852087-9 Sep 07 13:41:36.353518 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-04ccd674-4a58-467b-8e09-592a2fb6d802 req-8552fc93-1cce-4426-8daa-970484159178 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033397 Sep 07 13:41:36.354302 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3580/7131] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:41:36.454472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5f182574-d4fd-4e84-bb9f-6a8b7fe212d9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:36.455044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5f182574-d4fd-4e84-bb9f-6a8b7fe212d9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:36.462133 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f182574-d4fd-4e84-bb9f-6a8b7fe212d9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:36.462626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f182574-d4fd-4e84-bb9f-6a8b7fe212d9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:36.463054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f182574-d4fd-4e84-bb9f-6a8b7fe212d9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:36.463766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f182574-d4fd-4e84-bb9f-6a8b7fe212d9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:36.464563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f182574-d4fd-4e84-bb9f-6a8b7fe212d9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:36.464987 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5f182574-d4fd-4e84-bb9f-6a8b7fe212d9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:36.604348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5f182574-d4fd-4e84-bb9f-6a8b7fe212d9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:36.617167 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5f182574-d4fd-4e84-bb9f-6a8b7fe212d9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1364 microversion: 2.1 time: 0.166613 Sep 07 13:41:36.618025 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3552/7132] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:36 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:37.645407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b41a7c38-6002-4a46-82ae-044bfb4de3e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:37.646176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b41a7c38-6002-4a46-82ae-044bfb4de3e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:37.653178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b41a7c38-6002-4a46-82ae-044bfb4de3e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:37.653798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b41a7c38-6002-4a46-82ae-044bfb4de3e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:37.654255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b41a7c38-6002-4a46-82ae-044bfb4de3e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:37.654967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b41a7c38-6002-4a46-82ae-044bfb4de3e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:37.655704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b41a7c38-6002-4a46-82ae-044bfb4de3e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:37.656093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b41a7c38-6002-4a46-82ae-044bfb4de3e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:37.799400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b41a7c38-6002-4a46-82ae-044bfb4de3e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:37.807525 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b41a7c38-6002-4a46-82ae-044bfb4de3e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1364 microversion: 2.1 time: 0.167959 Sep 07 13:41:37.808122 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3581/7133] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:37 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:38.832949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7a6638e6-631c-4e7c-b2c8-0fc29f582eb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:38.833683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7a6638e6-631c-4e7c-b2c8-0fc29f582eb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:38.836923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:41:38.837986 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:41:38.845060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a6638e6-631c-4e7c-b2c8-0fc29f582eb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:38.845599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a6638e6-631c-4e7c-b2c8-0fc29f582eb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:38.846035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a6638e6-631c-4e7c-b2c8-0fc29f582eb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:38.846761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a6638e6-631c-4e7c-b2c8-0fc29f582eb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:38.847217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a6638e6-631c-4e7c-b2c8-0fc29f582eb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:38.847635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a6638e6-631c-4e7c-b2c8-0fc29f582eb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:38.987019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7a6638e6-631c-4e7c-b2c8-0fc29f582eb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:41:38.995047 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7a6638e6-631c-4e7c-b2c8-0fc29f582eb6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1550 microversion: 2.1 time: 0.166748 Sep 07 13:41:38.995647 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3553/7134] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:41:38 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1550 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:41:39.018871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8e228617-e004-4798-96dc-765024613a72 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:41:39.019429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8e228617-e004-4798-96dc-765024613a72 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:41:39.021322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:41:39.027914 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e228617-e004-4798-96dc-765024613a72 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:39.028422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e228617-e004-4798-96dc-765024613a72 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:39.028867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e228617-e004-4798-96dc-765024613a72 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:39.029613 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e228617-e004-4798-96dc-765024613a72 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:39.030084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e228617-e004-4798-96dc-765024613a72 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:39.030593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8e228617-e004-4798-96dc-765024613a72 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:39.115225 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8e228617-e004-4798-96dc-765024613a72 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100482 Sep 07 13:41:39.115868 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3582/7135] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Sep 7 13:41:39 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:41:40.114931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-618de546-e601-4a0b-a2f4-4ffc54a06817 req-5c6c78bb-cedf-4f2c-9aa2-d8c7cd308747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b", "tag": "bdc6a934-50a8-4a40-8b33-707c2b450386"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:41:40.125222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-618de546-e601-4a0b-a2f4-4ffc54a06817 req-5c6c78bb-cedf-4f2c-9aa2-d8c7cd308747 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:41:40.125857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-618de546-e601-4a0b-a2f4-4ffc54a06817 req-5c6c78bb-cedf-4f2c-9aa2-d8c7cd308747 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:41:40.126453 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-618de546-e601-4a0b-a2f4-4ffc54a06817 req-5c6c78bb-cedf-4f2c-9aa2-d8c7cd308747 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:41:40.138481 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-618de546-e601-4a0b-a2f4-4ffc54a06817 req-5c6c78bb-cedf-4f2c-9aa2-d8c7cd308747 service nova] Creating event network-changed:bdc6a934-50a8-4a40-8b33-707c2b450386 for instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b on n-h2-852087-9 Sep 07 13:41:40.145376 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-618de546-e601-4a0b-a2f4-4ffc54a06817 req-5c6c78bb-cedf-4f2c-9aa2-d8c7cd308747 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035113 Sep 07 13:41:40.146053 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3554/7136] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:42:13.007640 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 07 13:42:13.010949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=29 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:42:13.012064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=61 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:42:13.017069 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-11c69e97-c0bd-4d9c-845f-dcde4e47c019 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:13.018035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-11c69e97-c0bd-4d9c-845f-dcde4e47c019 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:13.029972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11c69e97-c0bd-4d9c-845f-dcde4e47c019 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:13.030593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11c69e97-c0bd-4d9c-845f-dcde4e47c019 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:13.031326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11c69e97-c0bd-4d9c-845f-dcde4e47c019 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:13.032496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11c69e97-c0bd-4d9c-845f-dcde4e47c019 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:13.033198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11c69e97-c0bd-4d9c-845f-dcde4e47c019 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:13.033801 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11c69e97-c0bd-4d9c-845f-dcde4e47c019 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:13.181325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-11c69e97-c0bd-4d9c-845f-dcde4e47c019 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:13.189874 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-11c69e97-c0bd-4d9c-845f-dcde4e47c019 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1669 microversion: 2.1 time: 0.185119 Sep 07 13:42:13.190468 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3583/7137] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:13 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1669 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:13.213232 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:42:13.214358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:42:13.218974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8d216d7e-5e25-4040-874b-f701a7fafeb2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46f4301c-8071-4d24-89ab-85c7487ec708"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:42:13.221473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8d216d7e-5e25-4040-874b-f701a7fafeb2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:13.229461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d216d7e-5e25-4040-874b-f701a7fafeb2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:13.230260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d216d7e-5e25-4040-874b-f701a7fafeb2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:13.230494 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d216d7e-5e25-4040-874b-f701a7fafeb2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:13.231227 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d216d7e-5e25-4040-874b-f701a7fafeb2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:13.231668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d216d7e-5e25-4040-874b-f701a7fafeb2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:13.232104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8d216d7e-5e25-4040-874b-f701a7fafeb2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:13.543669 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8d216d7e-5e25-4040-874b-f701a7fafeb2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "POST /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332933 Sep 07 13:42:13.544412 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3555/7138] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Sep 7 13:42:13 2022] POST /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:42:24.512027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d5bb5f16-8aa0-48bf-8a0a-af6257d4ccc8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:42:24.514601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d5bb5f16-8aa0-48bf-8a0a-af6257d4ccc8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:24.517760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:42:24.518624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:42:24.525812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5bb5f16-8aa0-48bf-8a0a-af6257d4ccc8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:24.526366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5bb5f16-8aa0-48bf-8a0a-af6257d4ccc8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:24.526815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5bb5f16-8aa0-48bf-8a0a-af6257d4ccc8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:24.527554 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5bb5f16-8aa0-48bf-8a0a-af6257d4ccc8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:24.528030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5bb5f16-8aa0-48bf-8a0a-af6257d4ccc8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:24.528470 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5bb5f16-8aa0-48bf-8a0a-af6257d4ccc8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:24.562951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d5bb5f16-8aa0-48bf-8a0a-af6257d4ccc8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:24.570890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d5bb5f16-8aa0-48bf-8a0a-af6257d4ccc8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Old instance type m1.heat2, new instance type m1.heat {{(pid=122433) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 13:42:24.581448 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d5bb5f16-8aa0-48bf-8a0a-af6257d4ccc8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:42:24.582232 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d5bb5f16-8aa0-48bf-8a0a-af6257d4ccc8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:42:24.583017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d5bb5f16-8aa0-48bf-8a0a-af6257d4ccc8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:42:24.583676 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d5bb5f16-8aa0-48bf-8a0a-af6257d4ccc8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:42:24.584265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-d5bb5f16-8aa0-48bf-8a0a-af6257d4ccc8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:42:24.657507 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d5bb5f16-8aa0-48bf-8a0a-af6257d4ccc8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "POST /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b/action" status: 202 len: 0 microversion: 2.1 time: 0.149914 Sep 07 13:42:24.658178 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3584/7139] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:42:24 2022] POST /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:42:24.667166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9022f3a7-2c29-405c-bde4-1bf9413ccc52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:24.667781 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9022f3a7-2c29-405c-bde4-1bf9413ccc52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:24.671077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:42:24.671779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:42:24.677929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9022f3a7-2c29-405c-bde4-1bf9413ccc52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:24.678432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9022f3a7-2c29-405c-bde4-1bf9413ccc52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:24.678913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9022f3a7-2c29-405c-bde4-1bf9413ccc52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:24.679667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9022f3a7-2c29-405c-bde4-1bf9413ccc52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:24.680179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9022f3a7-2c29-405c-bde4-1bf9413ccc52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:24.680621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9022f3a7-2c29-405c-bde4-1bf9413ccc52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:24.815254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9022f3a7-2c29-405c-bde4-1bf9413ccc52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:24.824213 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9022f3a7-2c29-405c-bde4-1bf9413ccc52 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1724 microversion: 2.1 time: 0.161403 Sep 07 13:42:24.824794 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3556/7140] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:24 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:25.849634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1a878a12-ee55-4f64-a6a7-66ee109bad84 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:25.850286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1a878a12-ee55-4f64-a6a7-66ee109bad84 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:25.857218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a878a12-ee55-4f64-a6a7-66ee109bad84 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:25.857789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a878a12-ee55-4f64-a6a7-66ee109bad84 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:25.858247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a878a12-ee55-4f64-a6a7-66ee109bad84 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:25.858970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a878a12-ee55-4f64-a6a7-66ee109bad84 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:25.859449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a878a12-ee55-4f64-a6a7-66ee109bad84 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:25.859891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a878a12-ee55-4f64-a6a7-66ee109bad84 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:26.011608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1a878a12-ee55-4f64-a6a7-66ee109bad84 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:26.020764 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1a878a12-ee55-4f64-a6a7-66ee109bad84 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1724 microversion: 2.1 time: 0.175987 Sep 07 13:42:26.021385 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3585/7141] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:25 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:27.044778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-64a113ba-9edf-4ce2-87aa-4e7dc1bd719c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:27.045451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-64a113ba-9edf-4ce2-87aa-4e7dc1bd719c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:27.053239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64a113ba-9edf-4ce2-87aa-4e7dc1bd719c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:27.053791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64a113ba-9edf-4ce2-87aa-4e7dc1bd719c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:27.054209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64a113ba-9edf-4ce2-87aa-4e7dc1bd719c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:27.054922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64a113ba-9edf-4ce2-87aa-4e7dc1bd719c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:27.055377 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64a113ba-9edf-4ce2-87aa-4e7dc1bd719c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:27.055797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-64a113ba-9edf-4ce2-87aa-4e7dc1bd719c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:27.192256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-64a113ba-9edf-4ce2-87aa-4e7dc1bd719c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:27.201539 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-64a113ba-9edf-4ce2-87aa-4e7dc1bd719c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1729 microversion: 2.1 time: 0.160747 Sep 07 13:42:27.202132 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3557/7142] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:27 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:28.226179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-debf4b3a-f421-4bf7-93e7-9f87e7082da6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:28.226923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-debf4b3a-f421-4bf7-93e7-9f87e7082da6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:28.235360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-debf4b3a-f421-4bf7-93e7-9f87e7082da6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:28.235875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-debf4b3a-f421-4bf7-93e7-9f87e7082da6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:28.236333 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-debf4b3a-f421-4bf7-93e7-9f87e7082da6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:28.237064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-debf4b3a-f421-4bf7-93e7-9f87e7082da6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:28.237580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-debf4b3a-f421-4bf7-93e7-9f87e7082da6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:28.238025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-debf4b3a-f421-4bf7-93e7-9f87e7082da6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:28.391326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-debf4b3a-f421-4bf7-93e7-9f87e7082da6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:28.400626 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-debf4b3a-f421-4bf7-93e7-9f87e7082da6 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1729 microversion: 2.1 time: 0.178718 Sep 07 13:42:28.401224 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3586/7143] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:28 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:29.424267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ae94f5cd-9d2b-445c-ae6f-159071dbba9d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:29.424898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ae94f5cd-9d2b-445c-ae6f-159071dbba9d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:29.433226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae94f5cd-9d2b-445c-ae6f-159071dbba9d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:29.433740 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae94f5cd-9d2b-445c-ae6f-159071dbba9d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:29.434181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae94f5cd-9d2b-445c-ae6f-159071dbba9d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:29.434941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae94f5cd-9d2b-445c-ae6f-159071dbba9d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:29.435399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae94f5cd-9d2b-445c-ae6f-159071dbba9d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:29.435825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae94f5cd-9d2b-445c-ae6f-159071dbba9d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:29.586728 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ae94f5cd-9d2b-445c-ae6f-159071dbba9d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:29.599372 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ae94f5cd-9d2b-445c-ae6f-159071dbba9d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1729 microversion: 2.1 time: 0.178948 Sep 07 13:42:29.599998 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3558/7144] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:29 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:30.623514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d8b93889-4672-415c-977e-76c421336b01 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:30.624236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d8b93889-4672-415c-977e-76c421336b01 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:30.632048 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8b93889-4672-415c-977e-76c421336b01 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:30.632570 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8b93889-4672-415c-977e-76c421336b01 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:30.633051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8b93889-4672-415c-977e-76c421336b01 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:30.633866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8b93889-4672-415c-977e-76c421336b01 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:30.634505 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8b93889-4672-415c-977e-76c421336b01 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:30.634960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d8b93889-4672-415c-977e-76c421336b01 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:30.781097 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d8b93889-4672-415c-977e-76c421336b01 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:30.790335 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d8b93889-4672-415c-977e-76c421336b01 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1729 microversion: 2.1 time: 0.170923 Sep 07 13:42:30.790930 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3587/7145] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:30 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:31.813561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-95a463c8-1dc9-4225-9dc3-3aab1c640548 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:31.814203 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-95a463c8-1dc9-4225-9dc3-3aab1c640548 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:31.821708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95a463c8-1dc9-4225-9dc3-3aab1c640548 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:31.822198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95a463c8-1dc9-4225-9dc3-3aab1c640548 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:31.822627 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95a463c8-1dc9-4225-9dc3-3aab1c640548 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:31.823331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95a463c8-1dc9-4225-9dc3-3aab1c640548 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:31.823762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95a463c8-1dc9-4225-9dc3-3aab1c640548 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:31.824184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-95a463c8-1dc9-4225-9dc3-3aab1c640548 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:31.966858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-95a463c8-1dc9-4225-9dc3-3aab1c640548 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:31.975832 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-95a463c8-1dc9-4225-9dc3-3aab1c640548 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1729 microversion: 2.1 time: 0.166317 Sep 07 13:42:31.976417 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3559/7146] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:31 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:32.998972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-797011f3-b646-4153-97d3-a49f824e0315 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:32.999631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-797011f3-b646-4153-97d3-a49f824e0315 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:33.007265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-797011f3-b646-4153-97d3-a49f824e0315 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:33.008044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-797011f3-b646-4153-97d3-a49f824e0315 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:33.008516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-797011f3-b646-4153-97d3-a49f824e0315 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:33.009380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-797011f3-b646-4153-97d3-a49f824e0315 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:33.010009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-797011f3-b646-4153-97d3-a49f824e0315 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:33.010566 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-797011f3-b646-4153-97d3-a49f824e0315 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:33.163020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-797011f3-b646-4153-97d3-a49f824e0315 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:33.171713 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-797011f3-b646-4153-97d3-a49f824e0315 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1729 microversion: 2.1 time: 0.176680 Sep 07 13:42:33.172321 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3588/7147] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:32 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:34.204948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0f9f6fc4-47ca-41ed-bb61-c52fa7d0162c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:34.205663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0f9f6fc4-47ca-41ed-bb61-c52fa7d0162c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:34.213126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f9f6fc4-47ca-41ed-bb61-c52fa7d0162c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:34.213988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f9f6fc4-47ca-41ed-bb61-c52fa7d0162c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:34.214403 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f9f6fc4-47ca-41ed-bb61-c52fa7d0162c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:34.215114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f9f6fc4-47ca-41ed-bb61-c52fa7d0162c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:34.215571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f9f6fc4-47ca-41ed-bb61-c52fa7d0162c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:34.215993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0f9f6fc4-47ca-41ed-bb61-c52fa7d0162c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:34.358932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0f9f6fc4-47ca-41ed-bb61-c52fa7d0162c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:34.367899 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0f9f6fc4-47ca-41ed-bb61-c52fa7d0162c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1729 microversion: 2.1 time: 0.168631 Sep 07 13:42:34.368493 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3560/7148] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:34 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:35.392795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9ff707a5-174d-4d95-aeee-283c742c60c0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:35.393422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9ff707a5-174d-4d95-aeee-283c742c60c0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:35.401231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ff707a5-174d-4d95-aeee-283c742c60c0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:35.401758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ff707a5-174d-4d95-aeee-283c742c60c0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:35.402208 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ff707a5-174d-4d95-aeee-283c742c60c0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:35.402926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ff707a5-174d-4d95-aeee-283c742c60c0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:35.403383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ff707a5-174d-4d95-aeee-283c742c60c0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:35.403844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ff707a5-174d-4d95-aeee-283c742c60c0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:35.544424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9ff707a5-174d-4d95-aeee-283c742c60c0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:35.553299 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9ff707a5-174d-4d95-aeee-283c742c60c0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1729 microversion: 2.1 time: 0.164760 Sep 07 13:42:35.553977 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3589/7149] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:35 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:36.581373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d9d8ac52-3c01-4b12-92c8-e1d0e81e1aaf tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:36.582058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d9d8ac52-3c01-4b12-92c8-e1d0e81e1aaf tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:36.591496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9d8ac52-3c01-4b12-92c8-e1d0e81e1aaf tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:36.592017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9d8ac52-3c01-4b12-92c8-e1d0e81e1aaf tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:36.592452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9d8ac52-3c01-4b12-92c8-e1d0e81e1aaf tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:36.593191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9d8ac52-3c01-4b12-92c8-e1d0e81e1aaf tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:36.593702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9d8ac52-3c01-4b12-92c8-e1d0e81e1aaf tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:36.594200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d9d8ac52-3c01-4b12-92c8-e1d0e81e1aaf tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:36.750192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d9d8ac52-3c01-4b12-92c8-e1d0e81e1aaf tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:36.759091 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d9d8ac52-3c01-4b12-92c8-e1d0e81e1aaf tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1729 microversion: 2.1 time: 0.183957 Sep 07 13:42:36.760059 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3561/7150] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:36 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:37.783572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8373401d-6dc2-4bfc-9552-520ede85255f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:37.784235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8373401d-6dc2-4bfc-9552-520ede85255f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:37.792569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8373401d-6dc2-4bfc-9552-520ede85255f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:37.793092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8373401d-6dc2-4bfc-9552-520ede85255f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:37.793581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8373401d-6dc2-4bfc-9552-520ede85255f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:37.794321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8373401d-6dc2-4bfc-9552-520ede85255f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:37.794794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8373401d-6dc2-4bfc-9552-520ede85255f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:37.795226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8373401d-6dc2-4bfc-9552-520ede85255f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:37.946566 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8373401d-6dc2-4bfc-9552-520ede85255f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:37.956262 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8373401d-6dc2-4bfc-9552-520ede85255f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1729 microversion: 2.1 time: 0.176706 Sep 07 13:42:37.956925 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3590/7151] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:37 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:38.982168 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6ac6d578-8fa2-45c7-8a91-19430ab2086b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:38.982917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6ac6d578-8fa2-45c7-8a91-19430ab2086b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:38.990422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ac6d578-8fa2-45c7-8a91-19430ab2086b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:38.990914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ac6d578-8fa2-45c7-8a91-19430ab2086b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:38.991341 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ac6d578-8fa2-45c7-8a91-19430ab2086b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:38.992040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ac6d578-8fa2-45c7-8a91-19430ab2086b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:38.992503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ac6d578-8fa2-45c7-8a91-19430ab2086b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:38.992915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6ac6d578-8fa2-45c7-8a91-19430ab2086b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:39.138583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6ac6d578-8fa2-45c7-8a91-19430ab2086b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:39.148020 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6ac6d578-8fa2-45c7-8a91-19430ab2086b tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1729 microversion: 2.1 time: 0.169853 Sep 07 13:42:39.148970 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3562/7152] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:38 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:40.172822 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-01753150-866c-4a34-805d-2b0ad2d2e234 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:40.173583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-01753150-866c-4a34-805d-2b0ad2d2e234 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:40.180990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01753150-866c-4a34-805d-2b0ad2d2e234 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:40.181738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01753150-866c-4a34-805d-2b0ad2d2e234 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:40.182235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01753150-866c-4a34-805d-2b0ad2d2e234 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:40.182964 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01753150-866c-4a34-805d-2b0ad2d2e234 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:40.183803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01753150-866c-4a34-805d-2b0ad2d2e234 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:40.184415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01753150-866c-4a34-805d-2b0ad2d2e234 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:40.329185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-01753150-866c-4a34-805d-2b0ad2d2e234 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:40.339419 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-01753150-866c-4a34-805d-2b0ad2d2e234 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1729 microversion: 2.1 time: 0.170522 Sep 07 13:42:40.340069 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3591/7153] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:40 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:41.363828 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-939cdecb-799e-466f-b6a1-f95765a69140 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:41.364512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-939cdecb-799e-466f-b6a1-f95765a69140 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:41.377272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-939cdecb-799e-466f-b6a1-f95765a69140 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:41.378579 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-939cdecb-799e-466f-b6a1-f95765a69140 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:41.379826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-939cdecb-799e-466f-b6a1-f95765a69140 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:41.381467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-939cdecb-799e-466f-b6a1-f95765a69140 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:41.382584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-939cdecb-799e-466f-b6a1-f95765a69140 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:41.383507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-939cdecb-799e-466f-b6a1-f95765a69140 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:41.524901 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-939cdecb-799e-466f-b6a1-f95765a69140 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:41.533956 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-939cdecb-799e-466f-b6a1-f95765a69140 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1729 microversion: 2.1 time: 0.174505 Sep 07 13:42:41.534884 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3563/7154] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:41 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:42.565338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3116b8f-43b1-42df-8344-5bb1c5647bed tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:42.565982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d3116b8f-43b1-42df-8344-5bb1c5647bed tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:42.573304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3116b8f-43b1-42df-8344-5bb1c5647bed tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:42.573853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3116b8f-43b1-42df-8344-5bb1c5647bed tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:42.574304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3116b8f-43b1-42df-8344-5bb1c5647bed tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:42.575020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3116b8f-43b1-42df-8344-5bb1c5647bed tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:42.575490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3116b8f-43b1-42df-8344-5bb1c5647bed tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:42.575930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3116b8f-43b1-42df-8344-5bb1c5647bed tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:42.733748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d3116b8f-43b1-42df-8344-5bb1c5647bed tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:42.743997 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d3116b8f-43b1-42df-8344-5bb1c5647bed tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1729 microversion: 2.1 time: 0.182572 Sep 07 13:42:42.744651 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3592/7155] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:42 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:43.768002 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-247c4e3a-b8ea-452a-b451-e71197e55d2c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:43.768625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-247c4e3a-b8ea-452a-b451-e71197e55d2c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:43.777270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-247c4e3a-b8ea-452a-b451-e71197e55d2c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:43.777810 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-247c4e3a-b8ea-452a-b451-e71197e55d2c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:43.778256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-247c4e3a-b8ea-452a-b451-e71197e55d2c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:43.778982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-247c4e3a-b8ea-452a-b451-e71197e55d2c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:43.779449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-247c4e3a-b8ea-452a-b451-e71197e55d2c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:43.779884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-247c4e3a-b8ea-452a-b451-e71197e55d2c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:43.930260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-247c4e3a-b8ea-452a-b451-e71197e55d2c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:43.939975 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-247c4e3a-b8ea-452a-b451-e71197e55d2c tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1729 microversion: 2.1 time: 0.175995 Sep 07 13:42:43.940561 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3564/7156] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:43 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:44.965304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5dbcdb49-76b9-4116-a7b2-b18e35f2add1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:44.965889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5dbcdb49-76b9-4116-a7b2-b18e35f2add1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:44.973110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dbcdb49-76b9-4116-a7b2-b18e35f2add1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:44.973686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dbcdb49-76b9-4116-a7b2-b18e35f2add1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:44.974175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dbcdb49-76b9-4116-a7b2-b18e35f2add1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:44.975001 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dbcdb49-76b9-4116-a7b2-b18e35f2add1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:44.975487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dbcdb49-76b9-4116-a7b2-b18e35f2add1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:44.975913 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5dbcdb49-76b9-4116-a7b2-b18e35f2add1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:45.127379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5dbcdb49-76b9-4116-a7b2-b18e35f2add1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:45.137361 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5dbcdb49-76b9-4116-a7b2-b18e35f2add1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1729 microversion: 2.1 time: 0.176493 Sep 07 13:42:45.138009 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3593/7157] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:44 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:46.181795 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5050331e-b9c1-42e0-b052-6f33948ab505 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:46.182418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5050331e-b9c1-42e0-b052-6f33948ab505 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:46.190803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5050331e-b9c1-42e0-b052-6f33948ab505 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:46.191310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5050331e-b9c1-42e0-b052-6f33948ab505 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:46.191758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5050331e-b9c1-42e0-b052-6f33948ab505 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:46.192489 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5050331e-b9c1-42e0-b052-6f33948ab505 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:46.192925 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5050331e-b9c1-42e0-b052-6f33948ab505 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:46.193355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5050331e-b9c1-42e0-b052-6f33948ab505 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:46.358178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5050331e-b9c1-42e0-b052-6f33948ab505 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:46.367805 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5050331e-b9c1-42e0-b052-6f33948ab505 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1729 microversion: 2.1 time: 0.190069 Sep 07 13:42:46.368426 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3565/7158] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:46 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:47.375209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-7708bada-9cfc-4c32-b5f1-2eea44ee2d8a req-a5627281-70cf-4a4e-bdcb-de7f5977a4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b", "name": "network-vif-unplugged", "status": "completed", "tag": "bdc6a934-50a8-4a40-8b33-707c2b450386"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:42:47.393497 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7708bada-9cfc-4c32-b5f1-2eea44ee2d8a req-a5627281-70cf-4a4e-bdcb-de7f5977a4d9 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:47.394149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7708bada-9cfc-4c32-b5f1-2eea44ee2d8a req-a5627281-70cf-4a4e-bdcb-de7f5977a4d9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:47.395124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-7708bada-9cfc-4c32-b5f1-2eea44ee2d8a req-a5627281-70cf-4a4e-bdcb-de7f5977a4d9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:47.400634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-942263eb-96ef-40c9-ae6c-5594afdcf707 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:47.402204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-942263eb-96ef-40c9-ae6c-5594afdcf707 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:47.409711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-942263eb-96ef-40c9-ae6c-5594afdcf707 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:47.410026 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-7708bada-9cfc-4c32-b5f1-2eea44ee2d8a req-a5627281-70cf-4a4e-bdcb-de7f5977a4d9 service nova] Creating event network-vif-unplugged:bdc6a934-50a8-4a40-8b33-707c2b450386 for instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b on n-h1-852087-9 Sep 07 13:42:47.410467 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-942263eb-96ef-40c9-ae6c-5594afdcf707 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:47.410989 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-942263eb-96ef-40c9-ae6c-5594afdcf707 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:47.412001 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-942263eb-96ef-40c9-ae6c-5594afdcf707 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:47.412578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-942263eb-96ef-40c9-ae6c-5594afdcf707 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:47.413111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-942263eb-96ef-40c9-ae6c-5594afdcf707 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:47.416612 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-7708bada-9cfc-4c32-b5f1-2eea44ee2d8a req-a5627281-70cf-4a4e-bdcb-de7f5977a4d9 service nova] Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:42:47.428856 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-7708bada-9cfc-4c32-b5f1-2eea44ee2d8a req-a5627281-70cf-4a4e-bdcb-de7f5977a4d9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061275 Sep 07 13:42:47.429940 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3594/7159] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:42:47.578316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-942263eb-96ef-40c9-ae6c-5594afdcf707 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:47.591322 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-942263eb-96ef-40c9-ae6c-5594afdcf707 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1728 microversion: 2.1 time: 0.194662 Sep 07 13:42:47.591918 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3566/7160] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:47 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1728 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:48.624339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c24c4f0a-224e-49cf-a0e8-e49e55bb7431 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:48.625064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c24c4f0a-224e-49cf-a0e8-e49e55bb7431 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:48.632645 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c24c4f0a-224e-49cf-a0e8-e49e55bb7431 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:48.633254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c24c4f0a-224e-49cf-a0e8-e49e55bb7431 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:48.633754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c24c4f0a-224e-49cf-a0e8-e49e55bb7431 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:48.634606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c24c4f0a-224e-49cf-a0e8-e49e55bb7431 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:48.634971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c24c4f0a-224e-49cf-a0e8-e49e55bb7431 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:48.635412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c24c4f0a-224e-49cf-a0e8-e49e55bb7431 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:48.806871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c24c4f0a-224e-49cf-a0e8-e49e55bb7431 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:48.816386 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c24c4f0a-224e-49cf-a0e8-e49e55bb7431 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1726 microversion: 2.1 time: 0.197485 Sep 07 13:42:48.816998 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3595/7161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:48 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1726 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:49.471388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d8935c79-21de-490e-9ed6-702315c0a952 req-f39e4392-b676-4ad4-8b67-ace9e88ea836 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b", "tag": "bdc6a934-50a8-4a40-8b33-707c2b450386"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:42:49.483325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d8935c79-21de-490e-9ed6-702315c0a952 req-f39e4392-b676-4ad4-8b67-ace9e88ea836 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:49.483948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d8935c79-21de-490e-9ed6-702315c0a952 req-f39e4392-b676-4ad4-8b67-ace9e88ea836 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:49.484662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d8935c79-21de-490e-9ed6-702315c0a952 req-f39e4392-b676-4ad4-8b67-ace9e88ea836 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:49.499085 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d8935c79-21de-490e-9ed6-702315c0a952 req-f39e4392-b676-4ad4-8b67-ace9e88ea836 service nova] Creating event network-changed:bdc6a934-50a8-4a40-8b33-707c2b450386 for instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b on n-h1-852087-9 Sep 07 13:42:49.505774 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-d8935c79-21de-490e-9ed6-702315c0a952 req-f39e4392-b676-4ad4-8b67-ace9e88ea836 service nova] Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:42:49.518465 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d8935c79-21de-490e-9ed6-702315c0a952 req-f39e4392-b676-4ad4-8b67-ace9e88ea836 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051516 Sep 07 13:42:49.519294 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3567/7162] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:42:49.841804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7d6ca4ff-cf90-4a4f-84b7-ab43d1b0305a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:49.842623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7d6ca4ff-cf90-4a4f-84b7-ab43d1b0305a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:49.851924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d6ca4ff-cf90-4a4f-84b7-ab43d1b0305a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:49.852576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d6ca4ff-cf90-4a4f-84b7-ab43d1b0305a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:49.853107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d6ca4ff-cf90-4a4f-84b7-ab43d1b0305a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:49.854013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d6ca4ff-cf90-4a4f-84b7-ab43d1b0305a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:49.854594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d6ca4ff-cf90-4a4f-84b7-ab43d1b0305a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:49.855108 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7d6ca4ff-cf90-4a4f-84b7-ab43d1b0305a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:50.044712 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7d6ca4ff-cf90-4a4f-84b7-ab43d1b0305a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:50.059858 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7d6ca4ff-cf90-4a4f-84b7-ab43d1b0305a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1726 microversion: 2.1 time: 0.222802 Sep 07 13:42:50.061781 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3596/7163] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:49 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1726 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:42:51.089704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dffdb7df-0f23-47de-abee-42f7b1192312 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:51.090388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dffdb7df-0f23-47de-abee-42f7b1192312 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:51.097562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dffdb7df-0f23-47de-abee-42f7b1192312 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:51.098055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dffdb7df-0f23-47de-abee-42f7b1192312 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:51.098492 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dffdb7df-0f23-47de-abee-42f7b1192312 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:51.099197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dffdb7df-0f23-47de-abee-42f7b1192312 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:51.099646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dffdb7df-0f23-47de-abee-42f7b1192312 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:51.100063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dffdb7df-0f23-47de-abee-42f7b1192312 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:51.255212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dffdb7df-0f23-47de-abee-42f7b1192312 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:51.264458 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dffdb7df-0f23-47de-abee-42f7b1192312 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1726 microversion: 2.1 time: 0.180471 Sep 07 13:42:51.265083 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3568/7164] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:51 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1726 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:42:52.292018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-30a7dd73-0c4e-4fe3-9aad-731c015925c7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:52.292625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-30a7dd73-0c4e-4fe3-9aad-731c015925c7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:52.299952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30a7dd73-0c4e-4fe3-9aad-731c015925c7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:52.300496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30a7dd73-0c4e-4fe3-9aad-731c015925c7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:52.300962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30a7dd73-0c4e-4fe3-9aad-731c015925c7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:52.301734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30a7dd73-0c4e-4fe3-9aad-731c015925c7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:52.302250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30a7dd73-0c4e-4fe3-9aad-731c015925c7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:52.302729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30a7dd73-0c4e-4fe3-9aad-731c015925c7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:52.455150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-30a7dd73-0c4e-4fe3-9aad-731c015925c7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:52.464520 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-30a7dd73-0c4e-4fe3-9aad-731c015925c7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1726 microversion: 2.1 time: 0.176613 Sep 07 13:42:52.465049 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3597/7165] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:52 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:53.490459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-539823ac-2e18-40d5-8bac-0c31355ddfcd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:53.491102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-539823ac-2e18-40d5-8bac-0c31355ddfcd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:53.498691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-539823ac-2e18-40d5-8bac-0c31355ddfcd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:53.499221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-539823ac-2e18-40d5-8bac-0c31355ddfcd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:53.499692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-539823ac-2e18-40d5-8bac-0c31355ddfcd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:53.500401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-539823ac-2e18-40d5-8bac-0c31355ddfcd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:53.500939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-539823ac-2e18-40d5-8bac-0c31355ddfcd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:53.501375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-539823ac-2e18-40d5-8bac-0c31355ddfcd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:53.648885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-539823ac-2e18-40d5-8bac-0c31355ddfcd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:53.659556 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-539823ac-2e18-40d5-8bac-0c31355ddfcd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1726 microversion: 2.1 time: 0.173215 Sep 07 13:42:53.659556 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3569/7166] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:53 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:54.685596 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9ef7b75e-7ce1-4662-84ea-89012546d1a7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:54.686218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9ef7b75e-7ce1-4662-84ea-89012546d1a7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:54.689823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=33 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:42:54.696994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ef7b75e-7ce1-4662-84ea-89012546d1a7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:54.697554 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ef7b75e-7ce1-4662-84ea-89012546d1a7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:54.698036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ef7b75e-7ce1-4662-84ea-89012546d1a7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:54.698781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ef7b75e-7ce1-4662-84ea-89012546d1a7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:54.699261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ef7b75e-7ce1-4662-84ea-89012546d1a7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:54.699736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9ef7b75e-7ce1-4662-84ea-89012546d1a7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:54.702551 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:42:54.845515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9ef7b75e-7ce1-4662-84ea-89012546d1a7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:54.856740 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9ef7b75e-7ce1-4662-84ea-89012546d1a7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1726 microversion: 2.1 time: 0.177642 Sep 07 13:42:54.857325 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3598/7167] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:54 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:55.880711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cc5bb235-5c74-488a-b5ab-31205104b162 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:55.881330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cc5bb235-5c74-488a-b5ab-31205104b162 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:55.884220 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=29 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:42:55.890166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc5bb235-5c74-488a-b5ab-31205104b162 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:55.890661 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc5bb235-5c74-488a-b5ab-31205104b162 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:55.891092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc5bb235-5c74-488a-b5ab-31205104b162 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:55.891787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc5bb235-5c74-488a-b5ab-31205104b162 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:55.892238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc5bb235-5c74-488a-b5ab-31205104b162 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:55.892656 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cc5bb235-5c74-488a-b5ab-31205104b162 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:55.895654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=83 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:42:56.046604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-cc5bb235-5c74-488a-b5ab-31205104b162 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:56.055841 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cc5bb235-5c74-488a-b5ab-31205104b162 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1726 microversion: 2.1 time: 0.179194 Sep 07 13:42:56.056425 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3570/7168] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:55 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:57.082398 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-86625adf-53dd-45fc-bfd9-9ce56d3f7213 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:57.083034 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-86625adf-53dd-45fc-bfd9-9ce56d3f7213 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:57.093906 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86625adf-53dd-45fc-bfd9-9ce56d3f7213 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:57.094606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86625adf-53dd-45fc-bfd9-9ce56d3f7213 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:57.095062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86625adf-53dd-45fc-bfd9-9ce56d3f7213 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:57.096159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86625adf-53dd-45fc-bfd9-9ce56d3f7213 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:57.096812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86625adf-53dd-45fc-bfd9-9ce56d3f7213 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:57.097536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86625adf-53dd-45fc-bfd9-9ce56d3f7213 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:57.252736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-86625adf-53dd-45fc-bfd9-9ce56d3f7213 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:57.265563 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-86625adf-53dd-45fc-bfd9-9ce56d3f7213 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1726 microversion: 2.1 time: 0.189269 Sep 07 13:42:57.266302 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3599/7169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:57 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1726 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:58.293029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-70963caf-4085-41ca-bcdc-16a45f75cf4e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:58.293624 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-70963caf-4085-41ca-bcdc-16a45f75cf4e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:58.301110 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70963caf-4085-41ca-bcdc-16a45f75cf4e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:58.301626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70963caf-4085-41ca-bcdc-16a45f75cf4e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:58.302062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70963caf-4085-41ca-bcdc-16a45f75cf4e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:58.302759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70963caf-4085-41ca-bcdc-16a45f75cf4e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:58.303203 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70963caf-4085-41ca-bcdc-16a45f75cf4e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:58.303612 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-70963caf-4085-41ca-bcdc-16a45f75cf4e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:58.446869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-70963caf-4085-41ca-bcdc-16a45f75cf4e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:58.456643 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-70963caf-4085-41ca-bcdc-16a45f75cf4e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1726 microversion: 2.1 time: 0.167627 Sep 07 13:42:58.457234 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3571/7170] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:58 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:42:59.484790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-69dcbbec-b463-4f1d-9920-bde849225ddd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:42:59.485442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-69dcbbec-b463-4f1d-9920-bde849225ddd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:42:59.494369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69dcbbec-b463-4f1d-9920-bde849225ddd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:59.494971 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69dcbbec-b463-4f1d-9920-bde849225ddd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:59.495430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69dcbbec-b463-4f1d-9920-bde849225ddd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:59.496151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69dcbbec-b463-4f1d-9920-bde849225ddd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:42:59.496623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69dcbbec-b463-4f1d-9920-bde849225ddd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:42:59.497070 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69dcbbec-b463-4f1d-9920-bde849225ddd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:42:59.636784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-69dcbbec-b463-4f1d-9920-bde849225ddd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:42:59.649558 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-69dcbbec-b463-4f1d-9920-bde849225ddd tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1726 microversion: 2.1 time: 0.169249 Sep 07 13:42:59.650331 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3600/7171] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:42:59 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:00.674909 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-60165d94-4d6f-48ee-b8a0-11911d623af8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:00.675559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-60165d94-4d6f-48ee-b8a0-11911d623af8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:00.682725 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60165d94-4d6f-48ee-b8a0-11911d623af8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:00.683218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60165d94-4d6f-48ee-b8a0-11911d623af8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:00.683654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60165d94-4d6f-48ee-b8a0-11911d623af8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:00.684360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60165d94-4d6f-48ee-b8a0-11911d623af8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:00.684815 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60165d94-4d6f-48ee-b8a0-11911d623af8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:00.685276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60165d94-4d6f-48ee-b8a0-11911d623af8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:00.829928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-60165d94-4d6f-48ee-b8a0-11911d623af8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:00.839093 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-60165d94-4d6f-48ee-b8a0-11911d623af8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1726 microversion: 2.1 time: 0.167859 Sep 07 13:43:00.839684 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3572/7172] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:00 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:01.862542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f13ef070-a9cb-49b7-8acb-4a5661387542 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:01.863181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f13ef070-a9cb-49b7-8acb-4a5661387542 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:01.870623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f13ef070-a9cb-49b7-8acb-4a5661387542 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:01.871150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f13ef070-a9cb-49b7-8acb-4a5661387542 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:01.871609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f13ef070-a9cb-49b7-8acb-4a5661387542 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:01.872323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f13ef070-a9cb-49b7-8acb-4a5661387542 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:01.872790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f13ef070-a9cb-49b7-8acb-4a5661387542 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:01.873338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f13ef070-a9cb-49b7-8acb-4a5661387542 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:02.024181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f13ef070-a9cb-49b7-8acb-4a5661387542 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:02.035413 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f13ef070-a9cb-49b7-8acb-4a5661387542 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1726 microversion: 2.1 time: 0.176789 Sep 07 13:43:02.036145 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3601/7173] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:01 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:03.060765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8ee9454b-4dce-465d-bd7e-abc54f0c4ec7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:03.061716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8ee9454b-4dce-465d-bd7e-abc54f0c4ec7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:03.072354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ee9454b-4dce-465d-bd7e-abc54f0c4ec7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:03.073026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ee9454b-4dce-465d-bd7e-abc54f0c4ec7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:03.073727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ee9454b-4dce-465d-bd7e-abc54f0c4ec7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:03.074856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ee9454b-4dce-465d-bd7e-abc54f0c4ec7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:03.075601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ee9454b-4dce-465d-bd7e-abc54f0c4ec7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:03.076256 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ee9454b-4dce-465d-bd7e-abc54f0c4ec7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:03.223601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8ee9454b-4dce-465d-bd7e-abc54f0c4ec7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:03.232370 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8ee9454b-4dce-465d-bd7e-abc54f0c4ec7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1723 microversion: 2.1 time: 0.176236 Sep 07 13:43:03.232960 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3573/7174] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:03 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:03.256314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b693d75e-e68f-4181-9b99-6d8691581aab tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:43:03.256950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b693d75e-e68f-4181-9b99-6d8691581aab tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:03.264526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b693d75e-e68f-4181-9b99-6d8691581aab tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:03.265033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b693d75e-e68f-4181-9b99-6d8691581aab tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:03.265516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b693d75e-e68f-4181-9b99-6d8691581aab tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:03.266251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b693d75e-e68f-4181-9b99-6d8691581aab tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:03.266724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b693d75e-e68f-4181-9b99-6d8691581aab tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:03.267193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b693d75e-e68f-4181-9b99-6d8691581aab tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:03.307588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b693d75e-e68f-4181-9b99-6d8691581aab tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:03.308089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b693d75e-e68f-4181-9b99-6d8691581aab tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:03.308555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b693d75e-e68f-4181-9b99-6d8691581aab tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:03.309312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b693d75e-e68f-4181-9b99-6d8691581aab tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:03.309899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b693d75e-e68f-4181-9b99-6d8691581aab tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:03.310346 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b693d75e-e68f-4181-9b99-6d8691581aab tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:03.331737 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b693d75e-e68f-4181-9b99-6d8691581aab tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Getting quotas for project 396666be58fa42568bdfa2652d635a41. Resources: {'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:43:03.346561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-b693d75e-e68f-4181-9b99-6d8691581aab tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Getting quotas for user bb0e9196784341cbb170c1c055e8966f and project 396666be58fa42568bdfa2652d635a41. Resources: {'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:43:03.460087 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b693d75e-e68f-4181-9b99-6d8691581aab tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "POST /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b/action" status: 202 len: 0 microversion: 2.1 time: 0.207558 Sep 07 13:43:03.464298 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3602/7175] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:43:03 2022] POST /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:43:03.470930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c9123860-6125-488f-9dc9-ad92a7c57050 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:03.471616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c9123860-6125-488f-9dc9-ad92a7c57050 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:03.478806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9123860-6125-488f-9dc9-ad92a7c57050 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:03.479326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9123860-6125-488f-9dc9-ad92a7c57050 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:03.479788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9123860-6125-488f-9dc9-ad92a7c57050 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:03.480583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9123860-6125-488f-9dc9-ad92a7c57050 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:03.481055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9123860-6125-488f-9dc9-ad92a7c57050 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:03.481699 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9123860-6125-488f-9dc9-ad92a7c57050 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:03.620733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c9123860-6125-488f-9dc9-ad92a7c57050 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:03.629532 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c9123860-6125-488f-9dc9-ad92a7c57050 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1722 microversion: 2.1 time: 0.163351 Sep 07 13:43:03.630104 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3574/7176] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:03 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:04.656571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8237aebf-82ac-4214-8d58-f1c875314b67 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:04.657295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8237aebf-82ac-4214-8d58-f1c875314b67 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:04.664792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8237aebf-82ac-4214-8d58-f1c875314b67 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:04.665310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8237aebf-82ac-4214-8d58-f1c875314b67 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:04.665803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8237aebf-82ac-4214-8d58-f1c875314b67 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:04.666529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8237aebf-82ac-4214-8d58-f1c875314b67 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:04.667006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8237aebf-82ac-4214-8d58-f1c875314b67 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:04.667455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8237aebf-82ac-4214-8d58-f1c875314b67 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:04.807189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8237aebf-82ac-4214-8d58-f1c875314b67 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:04.816542 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8237aebf-82ac-4214-8d58-f1c875314b67 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1722 microversion: 2.1 time: 0.165363 Sep 07 13:43:04.817124 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3603/7177] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:04 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:05.842043 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f6b3383a-bb06-4acf-9f80-1bca6cd8b45e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:05.842800 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f6b3383a-bb06-4acf-9f80-1bca6cd8b45e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:05.849874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6b3383a-bb06-4acf-9f80-1bca6cd8b45e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:05.850359 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6b3383a-bb06-4acf-9f80-1bca6cd8b45e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:05.850825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6b3383a-bb06-4acf-9f80-1bca6cd8b45e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:05.851519 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6b3383a-bb06-4acf-9f80-1bca6cd8b45e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:05.851974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6b3383a-bb06-4acf-9f80-1bca6cd8b45e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:05.852429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f6b3383a-bb06-4acf-9f80-1bca6cd8b45e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:06.017567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f6b3383a-bb06-4acf-9f80-1bca6cd8b45e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:06.028631 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f6b3383a-bb06-4acf-9f80-1bca6cd8b45e tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1722 microversion: 2.1 time: 0.191427 Sep 07 13:43:06.029199 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3575/7178] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:05 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:06.210074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-162eacec-b1e6-44a8-a018-7bda23c6ac89 req-f87344d4-db33-48e7-96e8-2167f2f3e973 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b", "name": "network-vif-plugged", "status": "completed", "tag": "bdc6a934-50a8-4a40-8b33-707c2b450386"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:43:06.223817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-162eacec-b1e6-44a8-a018-7bda23c6ac89 req-f87344d4-db33-48e7-96e8-2167f2f3e973 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:06.224552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-162eacec-b1e6-44a8-a018-7bda23c6ac89 req-f87344d4-db33-48e7-96e8-2167f2f3e973 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:06.225060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-162eacec-b1e6-44a8-a018-7bda23c6ac89 req-f87344d4-db33-48e7-96e8-2167f2f3e973 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:06.239202 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-162eacec-b1e6-44a8-a018-7bda23c6ac89 req-f87344d4-db33-48e7-96e8-2167f2f3e973 service nova] Creating event network-vif-plugged:bdc6a934-50a8-4a40-8b33-707c2b450386 for instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b on n-h1-852087-9 Sep 07 13:43:06.245153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-162eacec-b1e6-44a8-a018-7bda23c6ac89 req-f87344d4-db33-48e7-96e8-2167f2f3e973 service nova] Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:43:06.257585 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-162eacec-b1e6-44a8-a018-7bda23c6ac89 req-f87344d4-db33-48e7-96e8-2167f2f3e973 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052430 Sep 07 13:43:06.258899 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3604/7179] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:43:07.054241 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-75e57f5d-4603-4966-9ab0-8b7e18d31ba4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:07.055695 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-75e57f5d-4603-4966-9ab0-8b7e18d31ba4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:07.063734 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75e57f5d-4603-4966-9ab0-8b7e18d31ba4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:07.064330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75e57f5d-4603-4966-9ab0-8b7e18d31ba4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:07.064779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75e57f5d-4603-4966-9ab0-8b7e18d31ba4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:07.065577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75e57f5d-4603-4966-9ab0-8b7e18d31ba4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:07.066047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75e57f5d-4603-4966-9ab0-8b7e18d31ba4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:07.066482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-75e57f5d-4603-4966-9ab0-8b7e18d31ba4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:07.215465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-75e57f5d-4603-4966-9ab0-8b7e18d31ba4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:07.231178 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-75e57f5d-4603-4966-9ab0-8b7e18d31ba4 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1722 microversion: 2.1 time: 0.181689 Sep 07 13:43:07.231803 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3576/7180] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:07 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:08.257805 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-45259545-0fb6-4c15-a2a3-2280022cfd0a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:08.258476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-45259545-0fb6-4c15-a2a3-2280022cfd0a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:08.267168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45259545-0fb6-4c15-a2a3-2280022cfd0a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:08.267664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45259545-0fb6-4c15-a2a3-2280022cfd0a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:08.268134 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45259545-0fb6-4c15-a2a3-2280022cfd0a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:08.268838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45259545-0fb6-4c15-a2a3-2280022cfd0a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:08.269290 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45259545-0fb6-4c15-a2a3-2280022cfd0a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:08.269757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-45259545-0fb6-4c15-a2a3-2280022cfd0a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:08.427488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-45259545-0fb6-4c15-a2a3-2280022cfd0a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:08.436469 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-45259545-0fb6-4c15-a2a3-2280022cfd0a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1722 microversion: 2.1 time: 0.183438 Sep 07 13:43:08.437208 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3605/7181] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:08 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:09.250737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-14aa4567-98b9-411c-9bb5-7f98f71aa2b1 req-35fec6a4-aba8-421d-a047-8640a82dc504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b", "name": "network-vif-unplugged", "status": "completed", "tag": "bdc6a934-50a8-4a40-8b33-707c2b450386"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:43:09.271520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-14aa4567-98b9-411c-9bb5-7f98f71aa2b1 req-35fec6a4-aba8-421d-a047-8640a82dc504 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:09.272366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-14aa4567-98b9-411c-9bb5-7f98f71aa2b1 req-35fec6a4-aba8-421d-a047-8640a82dc504 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:09.273129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-14aa4567-98b9-411c-9bb5-7f98f71aa2b1 req-35fec6a4-aba8-421d-a047-8640a82dc504 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:09.295201 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-14aa4567-98b9-411c-9bb5-7f98f71aa2b1 req-35fec6a4-aba8-421d-a047-8640a82dc504 service nova] Creating event network-vif-unplugged:bdc6a934-50a8-4a40-8b33-707c2b450386 for instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b on n-h2-852087-9 Sep 07 13:43:09.303056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-14aa4567-98b9-411c-9bb5-7f98f71aa2b1 req-35fec6a4-aba8-421d-a047-8640a82dc504 service nova] Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:43:09.317149 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-14aa4567-98b9-411c-9bb5-7f98f71aa2b1 req-35fec6a4-aba8-421d-a047-8640a82dc504 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073924 Sep 07 13:43:09.318212 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3577/7182] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:43:09.461270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-948c2fe4-7e2b-459c-82a1-c04287024cf8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:09.462234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-948c2fe4-7e2b-459c-82a1-c04287024cf8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:09.470550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-948c2fe4-7e2b-459c-82a1-c04287024cf8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:09.470996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-948c2fe4-7e2b-459c-82a1-c04287024cf8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:09.471459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-948c2fe4-7e2b-459c-82a1-c04287024cf8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:09.472293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-948c2fe4-7e2b-459c-82a1-c04287024cf8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:09.472706 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-948c2fe4-7e2b-459c-82a1-c04287024cf8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:09.473157 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-948c2fe4-7e2b-459c-82a1-c04287024cf8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:09.624499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-948c2fe4-7e2b-459c-82a1-c04287024cf8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:09.634095 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-948c2fe4-7e2b-459c-82a1-c04287024cf8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1722 microversion: 2.1 time: 0.176900 Sep 07 13:43:09.634704 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3606/7183] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:09 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:10.676179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-63147664-4c2a-4622-b642-785abf01fdf0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:10.676887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-63147664-4c2a-4622-b642-785abf01fdf0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:10.683677 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63147664-4c2a-4622-b642-785abf01fdf0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:10.684162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63147664-4c2a-4622-b642-785abf01fdf0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:10.684596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63147664-4c2a-4622-b642-785abf01fdf0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:10.685279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63147664-4c2a-4622-b642-785abf01fdf0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:10.685763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63147664-4c2a-4622-b642-785abf01fdf0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:10.686184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-63147664-4c2a-4622-b642-785abf01fdf0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:10.843183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-63147664-4c2a-4622-b642-785abf01fdf0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:10.852146 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-63147664-4c2a-4622-b642-785abf01fdf0 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1722 microversion: 2.1 time: 0.181322 Sep 07 13:43:10.852731 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3578/7184] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:10 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:43:11.334490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-33854c62-e999-4c22-b079-922a680eee7e req-500ee260-5c8b-475b-aae1-f91d7f9c363d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b", "tag": "bdc6a934-50a8-4a40-8b33-707c2b450386"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:43:11.345803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-33854c62-e999-4c22-b079-922a680eee7e req-500ee260-5c8b-475b-aae1-f91d7f9c363d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:11.346405 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-33854c62-e999-4c22-b079-922a680eee7e req-500ee260-5c8b-475b-aae1-f91d7f9c363d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:11.346791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-33854c62-e999-4c22-b079-922a680eee7e req-500ee260-5c8b-475b-aae1-f91d7f9c363d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:11.360424 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-33854c62-e999-4c22-b079-922a680eee7e req-500ee260-5c8b-475b-aae1-f91d7f9c363d service nova] Creating event network-changed:bdc6a934-50a8-4a40-8b33-707c2b450386 for instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b on n-h2-852087-9 Sep 07 13:43:11.367336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-33854c62-e999-4c22-b079-922a680eee7e req-500ee260-5c8b-475b-aae1-f91d7f9c363d service nova] Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:43:11.379870 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-33854c62-e999-4c22-b079-922a680eee7e req-500ee260-5c8b-475b-aae1-f91d7f9c363d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049210 Sep 07 13:43:11.380937 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3607/7185] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:43:11.876360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-079e2720-f93e-4884-b536-974400140af9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:11.877827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-079e2720-f93e-4884-b536-974400140af9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:11.885283 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-079e2720-f93e-4884-b536-974400140af9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:11.886124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-079e2720-f93e-4884-b536-974400140af9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:11.886797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-079e2720-f93e-4884-b536-974400140af9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:11.888361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-079e2720-f93e-4884-b536-974400140af9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:11.889048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-079e2720-f93e-4884-b536-974400140af9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:11.890289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-079e2720-f93e-4884-b536-974400140af9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:12.048669 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-079e2720-f93e-4884-b536-974400140af9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:12.057915 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-079e2720-f93e-4884-b536-974400140af9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1722 microversion: 2.1 time: 0.185819 Sep 07 13:43:12.058811 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3579/7186] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:11 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:13.084167 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-471b9af4-ae3b-4bcb-a434-ae4c3290f7d2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:13.084929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-471b9af4-ae3b-4bcb-a434-ae4c3290f7d2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:13.092375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-471b9af4-ae3b-4bcb-a434-ae4c3290f7d2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:13.093209 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-471b9af4-ae3b-4bcb-a434-ae4c3290f7d2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:13.093703 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-471b9af4-ae3b-4bcb-a434-ae4c3290f7d2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:13.094435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-471b9af4-ae3b-4bcb-a434-ae4c3290f7d2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:13.094911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-471b9af4-ae3b-4bcb-a434-ae4c3290f7d2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:13.095351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-471b9af4-ae3b-4bcb-a434-ae4c3290f7d2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:13.245035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-471b9af4-ae3b-4bcb-a434-ae4c3290f7d2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:13.254419 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-471b9af4-ae3b-4bcb-a434-ae4c3290f7d2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1722 microversion: 2.1 time: 0.175691 Sep 07 13:43:13.254979 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3608/7187] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:13 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:14.339678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-05d45acd-e206-4869-8d4a-f2dce1d59c96 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:14.340282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-05d45acd-e206-4869-8d4a-f2dce1d59c96 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:14.347744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05d45acd-e206-4869-8d4a-f2dce1d59c96 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:14.348240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05d45acd-e206-4869-8d4a-f2dce1d59c96 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:14.348680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05d45acd-e206-4869-8d4a-f2dce1d59c96 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:14.349392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05d45acd-e206-4869-8d4a-f2dce1d59c96 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:14.349882 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05d45acd-e206-4869-8d4a-f2dce1d59c96 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:14.350306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-05d45acd-e206-4869-8d4a-f2dce1d59c96 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:14.495369 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-05d45acd-e206-4869-8d4a-f2dce1d59c96 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:14.504608 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-05d45acd-e206-4869-8d4a-f2dce1d59c96 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1722 microversion: 2.1 time: 0.169317 Sep 07 13:43:14.505226 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3580/7188] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:14 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:15.528616 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f8372dc0-1c53-4ae1-8623-40c6d1bd3c1d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:15.529242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f8372dc0-1c53-4ae1-8623-40c6d1bd3c1d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:15.531495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:43:15.538652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8372dc0-1c53-4ae1-8623-40c6d1bd3c1d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:15.539221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8372dc0-1c53-4ae1-8623-40c6d1bd3c1d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:15.539647 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8372dc0-1c53-4ae1-8623-40c6d1bd3c1d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:15.540446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8372dc0-1c53-4ae1-8623-40c6d1bd3c1d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:15.540938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8372dc0-1c53-4ae1-8623-40c6d1bd3c1d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:15.541396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8372dc0-1c53-4ae1-8623-40c6d1bd3c1d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:15.677873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f8372dc0-1c53-4ae1-8623-40c6d1bd3c1d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:15.686901 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f8372dc0-1c53-4ae1-8623-40c6d1bd3c1d tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1722 microversion: 2.1 time: 0.162133 Sep 07 13:43:15.687384 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3609/7189] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:15 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:16.720770 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-68502ba9-97a2-416c-89ba-e6df276c44ea tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:16.721397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-68502ba9-97a2-416c-89ba-e6df276c44ea tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:16.728910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68502ba9-97a2-416c-89ba-e6df276c44ea tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:16.729400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68502ba9-97a2-416c-89ba-e6df276c44ea tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:16.729878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68502ba9-97a2-416c-89ba-e6df276c44ea tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:16.730568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68502ba9-97a2-416c-89ba-e6df276c44ea tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:16.731029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68502ba9-97a2-416c-89ba-e6df276c44ea tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:16.731456 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68502ba9-97a2-416c-89ba-e6df276c44ea tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:16.881833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-68502ba9-97a2-416c-89ba-e6df276c44ea tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:16.893024 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-68502ba9-97a2-416c-89ba-e6df276c44ea tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1722 microversion: 2.1 time: 0.176265 Sep 07 13:43:16.893702 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3581/7190] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:16 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:17.919798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-44459cbf-362e-49ef-b702-c01d8fc7b6d3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:17.920803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-44459cbf-362e-49ef-b702-c01d8fc7b6d3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:17.931615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44459cbf-362e-49ef-b702-c01d8fc7b6d3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:17.932330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44459cbf-362e-49ef-b702-c01d8fc7b6d3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:17.933007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44459cbf-362e-49ef-b702-c01d8fc7b6d3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:17.934135 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44459cbf-362e-49ef-b702-c01d8fc7b6d3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:17.934790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44459cbf-362e-49ef-b702-c01d8fc7b6d3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:17.935436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44459cbf-362e-49ef-b702-c01d8fc7b6d3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:18.078347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-44459cbf-362e-49ef-b702-c01d8fc7b6d3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:18.087597 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-44459cbf-362e-49ef-b702-c01d8fc7b6d3 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1722 microversion: 2.1 time: 0.173951 Sep 07 13:43:18.088180 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3610/7191] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:17 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:19.113725 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-33d901e5-bb46-4d91-898c-d869713a6d8f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:19.114347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-33d901e5-bb46-4d91-898c-d869713a6d8f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:19.123782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33d901e5-bb46-4d91-898c-d869713a6d8f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:19.124303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33d901e5-bb46-4d91-898c-d869713a6d8f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:19.124936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33d901e5-bb46-4d91-898c-d869713a6d8f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:19.125518 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33d901e5-bb46-4d91-898c-d869713a6d8f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:19.125942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33d901e5-bb46-4d91-898c-d869713a6d8f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:19.126400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-33d901e5-bb46-4d91-898c-d869713a6d8f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:19.293591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-33d901e5-bb46-4d91-898c-d869713a6d8f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:19.302810 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-33d901e5-bb46-4d91-898c-d869713a6d8f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1722 microversion: 2.1 time: 0.195269 Sep 07 13:43:19.303416 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3582/7192] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:19 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:20.327978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b061ed18-9ec2-4470-ac3f-d8f4b7c1df8f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:20.328604 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b061ed18-9ec2-4470-ac3f-d8f4b7c1df8f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:20.336409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b061ed18-9ec2-4470-ac3f-d8f4b7c1df8f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:20.336927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b061ed18-9ec2-4470-ac3f-d8f4b7c1df8f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:20.337386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b061ed18-9ec2-4470-ac3f-d8f4b7c1df8f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:20.338190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b061ed18-9ec2-4470-ac3f-d8f4b7c1df8f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:20.339025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b061ed18-9ec2-4470-ac3f-d8f4b7c1df8f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:20.339514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b061ed18-9ec2-4470-ac3f-d8f4b7c1df8f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:20.485194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b061ed18-9ec2-4470-ac3f-d8f4b7c1df8f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:20.495083 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b061ed18-9ec2-4470-ac3f-d8f4b7c1df8f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1722 microversion: 2.1 time: 0.171069 Sep 07 13:43:20.495725 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3611/7193] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:20 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:21.524640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aaddea9e-a8db-4dde-baf9-3d398a8fda8a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:21.525282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aaddea9e-a8db-4dde-baf9-3d398a8fda8a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:21.532907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaddea9e-a8db-4dde-baf9-3d398a8fda8a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:21.533385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaddea9e-a8db-4dde-baf9-3d398a8fda8a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:21.533856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaddea9e-a8db-4dde-baf9-3d398a8fda8a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:21.534577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaddea9e-a8db-4dde-baf9-3d398a8fda8a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:21.535040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaddea9e-a8db-4dde-baf9-3d398a8fda8a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:21.535459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaddea9e-a8db-4dde-baf9-3d398a8fda8a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:21.690281 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aaddea9e-a8db-4dde-baf9-3d398a8fda8a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:21.699517 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aaddea9e-a8db-4dde-baf9-3d398a8fda8a tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1722 microversion: 2.1 time: 0.179185 Sep 07 13:43:21.700246 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3583/7194] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:21 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:22.724486 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ac3566be-e243-4a02-b835-d90eeba8b116 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:22.726253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ac3566be-e243-4a02-b835-d90eeba8b116 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:22.733334 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac3566be-e243-4a02-b835-d90eeba8b116 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:22.733907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac3566be-e243-4a02-b835-d90eeba8b116 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:22.734372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac3566be-e243-4a02-b835-d90eeba8b116 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:22.735163 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac3566be-e243-4a02-b835-d90eeba8b116 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:22.735640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac3566be-e243-4a02-b835-d90eeba8b116 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:22.736090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ac3566be-e243-4a02-b835-d90eeba8b116 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:22.755144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:43:22.912485 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ac3566be-e243-4a02-b835-d90eeba8b116 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:22.924134 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ac3566be-e243-4a02-b835-d90eeba8b116 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1722 microversion: 2.1 time: 0.203793 Sep 07 13:43:22.925531 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3612/7195] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:22 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:23.949827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-470e014b-73d3-4176-850b-e60d384287e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:23.950598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-470e014b-73d3-4176-850b-e60d384287e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:23.958191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-470e014b-73d3-4176-850b-e60d384287e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:23.958700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-470e014b-73d3-4176-850b-e60d384287e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:23.959148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-470e014b-73d3-4176-850b-e60d384287e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:23.959862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-470e014b-73d3-4176-850b-e60d384287e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:23.960329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-470e014b-73d3-4176-850b-e60d384287e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:23.960763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-470e014b-73d3-4176-850b-e60d384287e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:24.103866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-470e014b-73d3-4176-850b-e60d384287e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:24.113084 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-470e014b-73d3-4176-850b-e60d384287e1 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1715 microversion: 2.1 time: 0.167687 Sep 07 13:43:24.113670 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3584/7196] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:23 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1715 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:24.136274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-234cabe7-b90e-477e-8b7b-f9e83f071ff8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:24.136933 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-234cabe7-b90e-477e-8b7b-f9e83f071ff8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:24.144925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-234cabe7-b90e-477e-8b7b-f9e83f071ff8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:24.145435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-234cabe7-b90e-477e-8b7b-f9e83f071ff8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:24.145951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-234cabe7-b90e-477e-8b7b-f9e83f071ff8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:24.146708 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-234cabe7-b90e-477e-8b7b-f9e83f071ff8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:24.147180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-234cabe7-b90e-477e-8b7b-f9e83f071ff8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:24.147627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-234cabe7-b90e-477e-8b7b-f9e83f071ff8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:24.292499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-234cabe7-b90e-477e-8b7b-f9e83f071ff8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:24.301257 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-234cabe7-b90e-477e-8b7b-f9e83f071ff8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1715 microversion: 2.1 time: 0.168935 Sep 07 13:43:24.301909 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3613/7197] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:24 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1715 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:24.324397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-57965cd2-e602-4e90-ac45-97f329321596 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:24.325010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-57965cd2-e602-4e90-ac45-97f329321596 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:24.331946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57965cd2-e602-4e90-ac45-97f329321596 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:24.332448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57965cd2-e602-4e90-ac45-97f329321596 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:24.332893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57965cd2-e602-4e90-ac45-97f329321596 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:24.333631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57965cd2-e602-4e90-ac45-97f329321596 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:24.334095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57965cd2-e602-4e90-ac45-97f329321596 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:24.334561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57965cd2-e602-4e90-ac45-97f329321596 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:24.474572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-57965cd2-e602-4e90-ac45-97f329321596 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:24.484632 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-57965cd2-e602-4e90-ac45-97f329321596 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1715 microversion: 2.1 time: 0.163712 Sep 07 13:43:24.485136 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3585/7198] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:24 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1715 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:24.508142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c0bdb69e-ef18-4502-b7c5-a6af058d8059 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:24.508691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c0bdb69e-ef18-4502-b7c5-a6af058d8059 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:24.515127 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0bdb69e-ef18-4502-b7c5-a6af058d8059 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:24.515638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0bdb69e-ef18-4502-b7c5-a6af058d8059 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:24.516100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0bdb69e-ef18-4502-b7c5-a6af058d8059 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:24.516826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0bdb69e-ef18-4502-b7c5-a6af058d8059 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:24.517305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0bdb69e-ef18-4502-b7c5-a6af058d8059 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:24.517788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c0bdb69e-ef18-4502-b7c5-a6af058d8059 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:24.544254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c0bdb69e-ef18-4502-b7c5-a6af058d8059 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:43:24.628948 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c0bdb69e-ef18-4502-b7c5-a6af058d8059 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "DELETE /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 204 len: 0 microversion: 2.1 time: 0.124485 Sep 07 13:43:24.629739 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3614/7199] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:43:24 2022] DELETE /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:43:24.638897 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d209a200-cbf4-458f-8ebd-a0b3e6402cde tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:24.639562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d209a200-cbf4-458f-8ebd-a0b3e6402cde tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:24.645840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d209a200-cbf4-458f-8ebd-a0b3e6402cde tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:24.646327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d209a200-cbf4-458f-8ebd-a0b3e6402cde tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:24.646761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d209a200-cbf4-458f-8ebd-a0b3e6402cde tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:24.647448 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d209a200-cbf4-458f-8ebd-a0b3e6402cde tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:24.647900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d209a200-cbf4-458f-8ebd-a0b3e6402cde tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:24.648319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d209a200-cbf4-458f-8ebd-a0b3e6402cde tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:24.784750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d209a200-cbf4-458f-8ebd-a0b3e6402cde tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:24.793574 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d209a200-cbf4-458f-8ebd-a0b3e6402cde tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1721 microversion: 2.1 time: 0.158643 Sep 07 13:43:24.794162 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3586/7200] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:24 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:24.872596 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-9c63cfa0-27e0-4008-a15b-1913c39ea2f2 req-138a8a78-e331-4db4-a479-6dc94f428ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b", "name": "network-vif-plugged", "status": "completed", "tag": "bdc6a934-50a8-4a40-8b33-707c2b450386"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:43:24.877954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:43:24.883494 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9c63cfa0-27e0-4008-a15b-1913c39ea2f2 req-138a8a78-e331-4db4-a479-6dc94f428ca8 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:24.884028 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9c63cfa0-27e0-4008-a15b-1913c39ea2f2 req-138a8a78-e331-4db4-a479-6dc94f428ca8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:24.884473 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9c63cfa0-27e0-4008-a15b-1913c39ea2f2 req-138a8a78-e331-4db4-a479-6dc94f428ca8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:24.899937 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-9c63cfa0-27e0-4008-a15b-1913c39ea2f2 req-138a8a78-e331-4db4-a479-6dc94f428ca8 service nova] Creating event network-vif-plugged:bdc6a934-50a8-4a40-8b33-707c2b450386 for instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b on n-h2-852087-9 Sep 07 13:43:24.904992 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-9c63cfa0-27e0-4008-a15b-1913c39ea2f2 req-138a8a78-e331-4db4-a479-6dc94f428ca8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036685 Sep 07 13:43:24.905628 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3615/7201] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:43:25.818733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f0fe7b58-171c-46b7-8e9e-c8427bb81770 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:25.819359 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f0fe7b58-171c-46b7-8e9e-c8427bb81770 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:25.826760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0fe7b58-171c-46b7-8e9e-c8427bb81770 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:25.827472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0fe7b58-171c-46b7-8e9e-c8427bb81770 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:25.827903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0fe7b58-171c-46b7-8e9e-c8427bb81770 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:25.828600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0fe7b58-171c-46b7-8e9e-c8427bb81770 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:25.829060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0fe7b58-171c-46b7-8e9e-c8427bb81770 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:25.829505 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f0fe7b58-171c-46b7-8e9e-c8427bb81770 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:25.832228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=100 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:43:25.967793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f0fe7b58-171c-46b7-8e9e-c8427bb81770 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:25.977198 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f0fe7b58-171c-46b7-8e9e-c8427bb81770 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1721 microversion: 2.1 time: 0.162368 Sep 07 13:43:25.977886 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3587/7202] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:25 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:27.002917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1ab93f67-4a32-4947-8e6d-7f6216b8cdd9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:27.003659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1ab93f67-4a32-4947-8e6d-7f6216b8cdd9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:27.011173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ab93f67-4a32-4947-8e6d-7f6216b8cdd9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:27.011698 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ab93f67-4a32-4947-8e6d-7f6216b8cdd9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:27.012147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ab93f67-4a32-4947-8e6d-7f6216b8cdd9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:27.013035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ab93f67-4a32-4947-8e6d-7f6216b8cdd9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:27.013539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ab93f67-4a32-4947-8e6d-7f6216b8cdd9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:27.013986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ab93f67-4a32-4947-8e6d-7f6216b8cdd9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:27.094932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1ab93f67-4a32-4947-8e6d-7f6216b8cdd9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:27.104652 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1ab93f67-4a32-4947-8e6d-7f6216b8cdd9 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1654 microversion: 2.1 time: 0.107659 Sep 07 13:43:27.105263 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3616/7203] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:26 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1654 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:27.384138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-f8b1aa7c-fcfd-418e-9b3f-67456d60db06 req-c5139fe0-0c65-48fb-9057-b46e88c21acc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b", "name": "network-vif-deleted", "tag": "bdc6a934-50a8-4a40-8b33-707c2b450386"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:43:27.392405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=36 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:43:27.397145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f8b1aa7c-fcfd-418e-9b3f-67456d60db06 req-c5139fe0-0c65-48fb-9057-b46e88c21acc service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:27.397695 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f8b1aa7c-fcfd-418e-9b3f-67456d60db06 req-c5139fe0-0c65-48fb-9057-b46e88c21acc service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:27.398907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f8b1aa7c-fcfd-418e-9b3f-67456d60db06 req-c5139fe0-0c65-48fb-9057-b46e88c21acc service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:27.412780 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-f8b1aa7c-fcfd-418e-9b3f-67456d60db06 req-c5139fe0-0c65-48fb-9057-b46e88c21acc service nova] Creating event network-vif-deleted:bdc6a934-50a8-4a40-8b33-707c2b450386 for instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b on n-h2-852087-9 Sep 07 13:43:27.419063 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-f8b1aa7c-fcfd-418e-9b3f-67456d60db06 req-c5139fe0-0c65-48fb-9057-b46e88c21acc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038914 Sep 07 13:43:27.420413 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3588/7204] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:43:28.134766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b8d1ca27-27a9-43b0-a680-5b6b5debc114 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:28.135977 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b8d1ca27-27a9-43b0-a680-5b6b5debc114 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:28.143986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8d1ca27-27a9-43b0-a680-5b6b5debc114 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:28.144666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8d1ca27-27a9-43b0-a680-5b6b5debc114 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:28.145220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8d1ca27-27a9-43b0-a680-5b6b5debc114 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:28.146111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8d1ca27-27a9-43b0-a680-5b6b5debc114 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:28.146694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8d1ca27-27a9-43b0-a680-5b6b5debc114 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:28.147242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b8d1ca27-27a9-43b0-a680-5b6b5debc114 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:28.218877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b8d1ca27-27a9-43b0-a680-5b6b5debc114 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:28.229075 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b8d1ca27-27a9-43b0-a680-5b6b5debc114 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1370 microversion: 2.1 time: 0.100506 Sep 07 13:43:28.230301 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3617/7205] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:28 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1370 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:29.255645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aa506aa1-44b2-4891-9972-1680ddc5f4ec tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:29.256548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aa506aa1-44b2-4891-9972-1680ddc5f4ec tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:29.264380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa506aa1-44b2-4891-9972-1680ddc5f4ec tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:29.264996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa506aa1-44b2-4891-9972-1680ddc5f4ec tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:29.265565 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa506aa1-44b2-4891-9972-1680ddc5f4ec tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:29.266384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa506aa1-44b2-4891-9972-1680ddc5f4ec tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:29.266957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa506aa1-44b2-4891-9972-1680ddc5f4ec tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:29.267589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aa506aa1-44b2-4891-9972-1680ddc5f4ec tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:29.346988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aa506aa1-44b2-4891-9972-1680ddc5f4ec tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:29.356088 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aa506aa1-44b2-4891-9972-1680ddc5f4ec tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1370 microversion: 2.1 time: 0.106060 Sep 07 13:43:29.356703 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3589/7206] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:29 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1370 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:43:30.381522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-535b0a78-bbe4-45f2-85b2-7992f8c6b3c2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:30.382353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-535b0a78-bbe4-45f2-85b2-7992f8c6b3c2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:30.391472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-535b0a78-bbe4-45f2-85b2-7992f8c6b3c2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:30.391990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-535b0a78-bbe4-45f2-85b2-7992f8c6b3c2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:30.392449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-535b0a78-bbe4-45f2-85b2-7992f8c6b3c2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:30.393196 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-535b0a78-bbe4-45f2-85b2-7992f8c6b3c2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:30.393745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-535b0a78-bbe4-45f2-85b2-7992f8c6b3c2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:30.394200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-535b0a78-bbe4-45f2-85b2-7992f8c6b3c2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:30.483254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-535b0a78-bbe4-45f2-85b2-7992f8c6b3c2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:30.500014 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-535b0a78-bbe4-45f2-85b2-7992f8c6b3c2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1370 microversion: 2.1 time: 0.122352 Sep 07 13:43:30.501322 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3618/7207] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:30 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1370 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:31.538296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1fe1ecae-c4ee-4779-9dae-2193230e2282 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:31.539245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1fe1ecae-c4ee-4779-9dae-2193230e2282 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:31.547637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fe1ecae-c4ee-4779-9dae-2193230e2282 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:31.548145 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fe1ecae-c4ee-4779-9dae-2193230e2282 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:31.548589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fe1ecae-c4ee-4779-9dae-2193230e2282 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:31.549308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fe1ecae-c4ee-4779-9dae-2193230e2282 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:31.549814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fe1ecae-c4ee-4779-9dae-2193230e2282 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:31.550270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fe1ecae-c4ee-4779-9dae-2193230e2282 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:31.618199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1fe1ecae-c4ee-4779-9dae-2193230e2282 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb0e9196784341cbb170c1c055e8966f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396666be58fa42568bdfa2652d635a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:31.627075 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1fe1ecae-c4ee-4779-9dae-2193230e2282 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 200 len: 1370 microversion: 2.1 time: 0.092916 Sep 07 13:43:31.641576 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3590/7208] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:31 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 1370 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:32.654752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3776273-104c-4cb3-90dd-0d1365e75658 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:32.655924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d3776273-104c-4cb3-90dd-0d1365e75658 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:32.668387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3776273-104c-4cb3-90dd-0d1365e75658 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:32.669227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3776273-104c-4cb3-90dd-0d1365e75658 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:32.670593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3776273-104c-4cb3-90dd-0d1365e75658 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:32.671841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3776273-104c-4cb3-90dd-0d1365e75658 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:32.672705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3776273-104c-4cb3-90dd-0d1365e75658 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:32.673550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3776273-104c-4cb3-90dd-0d1365e75658 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:32.699768 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-d3776273-104c-4cb3-90dd-0d1365e75658 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] HTTP exception thrown: Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b could not be found. Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3776273-104c-4cb3-90dd-0d1365e75658 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Request method failure captured: Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b HTTP/1.1 Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJ6Qa8Wgx3edQ7CXPA7GMXkRXsD6n0ODz0fJ4U_HSdO27cMoqedxiUWhG-0C6635gytRmbSHGz9fwKnUkfS2q0gSeQ7nm1CzWfB0bTkZfTtk2qgxY2gxQer8R0l1g7MVKHxAmv0Z5uiEW3b338LhbLsy-_HbtXv9ZiSJd_u4NfmTSZM Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_396666be58fa42568bdfa2652d635a41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/396666be58fa42568bdfa2652d635a41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: bb0e9196784341cbb170c1c055e8966f Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b could not be found. Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b'} Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b could not be found. Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b could not be found. Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:43:32.703287 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:43:32.708211 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:32.708211 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:43:32.708211 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:43:32.708211 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:43:32.708211 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:43:32.708211 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b could not be found. Sep 07 13:43:32.708211 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:43:32.708211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3776273-104c-4cb3-90dd-0d1365e75658 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Returning 404 to user: Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:43:32.708211 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d3776273-104c-4cb3-90dd-0d1365e75658 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 404 len: 111 microversion: 2.1 time: 0.057679 Sep 07 13:43:32.708211 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3619/7209] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:32 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:43:32.776610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2278d1bf-d299-4ee2-9342-730498cc84c5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:32.778876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2278d1bf-d299-4ee2-9342-730498cc84c5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:32.786612 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2278d1bf-d299-4ee2-9342-730498cc84c5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:32.787143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2278d1bf-d299-4ee2-9342-730498cc84c5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:32.787579 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2278d1bf-d299-4ee2-9342-730498cc84c5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:32.788303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2278d1bf-d299-4ee2-9342-730498cc84c5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:32.788758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2278d1bf-d299-4ee2-9342-730498cc84c5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:32.789189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2278d1bf-d299-4ee2-9342-730498cc84c5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:32.803622 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-2278d1bf-d299-4ee2-9342-730498cc84c5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] HTTP exception thrown: Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b could not be found. Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2278d1bf-d299-4ee2-9342-730498cc84c5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Request method failure captured: Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b/os-volume_attachments HTTP/1.1 Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJ6Qa8Wgx3edQ7CXPA7GMXkRXsD6n0ODz0fJ4U_HSdO27cMoqedxiUWhG-0C6635gytRmbSHGz9fwKnUkfS2q0gSeQ7nm1CzWfB0bTkZfTtk2qgxY2gxQer8R0l1g7MVKHxAmv0Z5uiEW3b338LhbLsy-_HbtXv9ZiSJd_u4NfmTSZM Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_396666be58fa42568bdfa2652d635a41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/396666be58fa42568bdfa2652d635a41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: bb0e9196784341cbb170c1c055e8966f Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b could not be found. Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'server_id': '11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b'} Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b could not be found. Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:43:32.805451 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:43:32.809589 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b could not be found. Sep 07 13:43:32.809589 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:43:32.809589 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:43:32.809589 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:43:32.809589 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:32.809589 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:43:32.809589 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:43:32.809589 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:43:32.809589 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:43:32.809589 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b could not be found. Sep 07 13:43:32.809589 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:43:32.809589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2278d1bf-d299-4ee2-9342-730498cc84c5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Returning 404 to user: Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:43:32.809589 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2278d1bf-d299-4ee2-9342-730498cc84c5 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034397 Sep 07 13:43:32.809589 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3591/7210] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:43:32 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:43:36.185147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-53e86840-5c5e-4988-93d0-f1b0c9475fc2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:36.185805 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-53e86840-5c5e-4988-93d0-f1b0c9475fc2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:36.193093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53e86840-5c5e-4988-93d0-f1b0c9475fc2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:36.193635 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53e86840-5c5e-4988-93d0-f1b0c9475fc2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:36.194092 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53e86840-5c5e-4988-93d0-f1b0c9475fc2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:36.194810 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53e86840-5c5e-4988-93d0-f1b0c9475fc2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:36.195281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53e86840-5c5e-4988-93d0-f1b0c9475fc2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:36.195723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-53e86840-5c5e-4988-93d0-f1b0c9475fc2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:36.211738 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-53e86840-5c5e-4988-93d0-f1b0c9475fc2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] HTTP exception thrown: Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b could not be found. Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-53e86840-5c5e-4988-93d0-f1b0c9475fc2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Request method failure captured: Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b HTTP/1.1 Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJ6Qa8Wgx3edQ7CXPA7GMXkRXsD6n0ODz0fJ4U_HSdO27cMoqedxiUWhG-0C6635gytRmbSHGz9fwKnUkfS2q0gSeQ7nm1CzWfB0bTkZfTtk2qgxY2gxQer8R0l1g7MVKHxAmv0Z5uiEW3b338LhbLsy-_HbtXv9ZiSJd_u4NfmTSZM Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_396666be58fa42568bdfa2652d635a41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/396666be58fa42568bdfa2652d635a41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: bb0e9196784341cbb170c1c055e8966f Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b could not be found. Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b'} Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b could not be found. Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:43:36.214920 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:43:36.220543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b could not be found. Sep 07 13:43:36.220543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.220543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:43:36.220543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.220543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:36.220543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:43:36.220543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:43:36.220543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:43:36.220543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:43:36.220543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b could not be found. Sep 07 13:43:36.220543 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.220543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-53e86840-5c5e-4988-93d0-f1b0c9475fc2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Returning 404 to user: Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:43:36.220543 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-53e86840-5c5e-4988-93d0-f1b0c9475fc2 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "DELETE /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 404 len: 111 microversion: 2.1 time: 0.035398 Sep 07 13:43:36.220543 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3620/7211] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:43:36 2022] DELETE /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:43:36.225978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-81c92445-ddba-4460-9433-d8b9f760adfa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:36.226806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-81c92445-ddba-4460-9433-d8b9f760adfa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:36.235054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81c92445-ddba-4460-9433-d8b9f760adfa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:36.235548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81c92445-ddba-4460-9433-d8b9f760adfa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:36.237766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81c92445-ddba-4460-9433-d8b9f760adfa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:36.237766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81c92445-ddba-4460-9433-d8b9f760adfa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:36.237766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81c92445-ddba-4460-9433-d8b9f760adfa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:36.238275 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81c92445-ddba-4460-9433-d8b9f760adfa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:36.254749 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-81c92445-ddba-4460-9433-d8b9f760adfa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] HTTP exception thrown: Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b could not be found. Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-81c92445-ddba-4460-9433-d8b9f760adfa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Request method failure captured: Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b HTTP/1.1 Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJ6Qa8Wgx3edQ7CXPA7GMXkRXsD6n0ODz0fJ4U_HSdO27cMoqedxiUWhG-0C6635gytRmbSHGz9fwKnUkfS2q0gSeQ7nm1CzWfB0bTkZfTtk2qgxY2gxQer8R0l1g7MVKHxAmv0Z5uiEW3b338LhbLsy-_HbtXv9ZiSJd_u4NfmTSZM Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_396666be58fa42568bdfa2652d635a41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/396666be58fa42568bdfa2652d635a41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: bb0e9196784341cbb170c1c055e8966f Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b could not be found. Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b'} Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b could not be found. Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b could not be found. Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:43:36.256315 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.260215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:36.260215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:43:36.260215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:43:36.260215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:43:36.260215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:43:36.260215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b could not be found. Sep 07 13:43:36.260215 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.260215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-81c92445-ddba-4460-9433-d8b9f760adfa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Returning 404 to user: Instance 11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:43:36.260215 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-81c92445-ddba-4460-9433-d8b9f760adfa tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b" status: 404 len: 111 microversion: 2.1 time: 0.036204 Sep 07 13:43:36.260215 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3592/7212] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:36 2022] GET /compute/v2.1/servers/11d70069-ecfd-45f9-9a2b-0ecedfbdcd2b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:43:36.268690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-76287c78-dcdc-40e3-80ae-c15678b109e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:36.269236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-76287c78-dcdc-40e3-80ae-c15678b109e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:36.276363 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76287c78-dcdc-40e3-80ae-c15678b109e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:36.276884 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76287c78-dcdc-40e3-80ae-c15678b109e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:36.277597 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76287c78-dcdc-40e3-80ae-c15678b109e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:36.278353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76287c78-dcdc-40e3-80ae-c15678b109e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:36.278834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76287c78-dcdc-40e3-80ae-c15678b109e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:36.279281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-76287c78-dcdc-40e3-80ae-c15678b109e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:36.295296 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-76287c78-dcdc-40e3-80ae-c15678b109e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] HTTP exception thrown: Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c could not be found. Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-76287c78-dcdc-40e3-80ae-c15678b109e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Request method failure captured: Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c HTTP/1.1 Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJ6Qa8Wgx3edQ7CXPA7GMXkRXsD6n0ODz0fJ4U_HSdO27cMoqedxiUWhG-0C6635gytRmbSHGz9fwKnUkfS2q0gSeQ7nm1CzWfB0bTkZfTtk2qgxY2gxQer8R0l1g7MVKHxAmv0Z5uiEW3b338LhbLsy-_HbtXv9ZiSJd_u4NfmTSZM Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_396666be58fa42568bdfa2652d635a41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/396666be58fa42568bdfa2652d635a41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: bb0e9196784341cbb170c1c055e8966f Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c could not be found. Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '4ed905d1-0713-49f5-aa66-1574b0734a2c'} Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c could not be found. Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:43:36.298072 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:43:36.304804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c could not be found. Sep 07 13:43:36.304804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.304804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:43:36.304804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.304804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:36.304804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:43:36.304804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:43:36.304804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:43:36.304804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:43:36.304804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c could not be found. Sep 07 13:43:36.304804 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.304804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-76287c78-dcdc-40e3-80ae-c15678b109e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Returning 404 to user: Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:43:36.304804 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-76287c78-dcdc-40e3-80ae-c15678b109e8 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 404 len: 111 microversion: 2.1 time: 0.036560 Sep 07 13:43:36.304804 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3621/7213] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:43:36 2022] DELETE /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:43:36.309403 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6561c65c-523f-4840-b787-f27a60843c66 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:36.310400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6561c65c-523f-4840-b787-f27a60843c66 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 4ed905d1-0713-49f5-aa66-1574b0734a2c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:36.316657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6561c65c-523f-4840-b787-f27a60843c66 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:36.317139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6561c65c-523f-4840-b787-f27a60843c66 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:36.317574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6561c65c-523f-4840-b787-f27a60843c66 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:36.318259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6561c65c-523f-4840-b787-f27a60843c66 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:36.318714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6561c65c-523f-4840-b787-f27a60843c66 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:36.319134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6561c65c-523f-4840-b787-f27a60843c66 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:36.333776 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-6561c65c-523f-4840-b787-f27a60843c66 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] HTTP exception thrown: Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c could not be found. Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6561c65c-523f-4840-b787-f27a60843c66 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Request method failure captured: Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c HTTP/1.1 Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJ6Qa8Wgx3edQ7CXPA7GMXkRXsD6n0ODz0fJ4U_HSdO27cMoqedxiUWhG-0C6635gytRmbSHGz9fwKnUkfS2q0gSeQ7nm1CzWfB0bTkZfTtk2qgxY2gxQer8R0l1g7MVKHxAmv0Z5uiEW3b338LhbLsy-_HbtXv9ZiSJd_u4NfmTSZM Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_396666be58fa42568bdfa2652d635a41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/396666be58fa42568bdfa2652d635a41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: bb0e9196784341cbb170c1c055e8966f Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c could not be found. Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '4ed905d1-0713-49f5-aa66-1574b0734a2c'} Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c could not be found. Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c could not be found. Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:43:36.335328 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.340403 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:36.340403 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:43:36.340403 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:43:36.340403 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:43:36.340403 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:43:36.340403 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c could not be found. Sep 07 13:43:36.340403 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.340403 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6561c65c-523f-4840-b787-f27a60843c66 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Returning 404 to user: Instance 4ed905d1-0713-49f5-aa66-1574b0734a2c could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:43:36.340403 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6561c65c-523f-4840-b787-f27a60843c66 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c" status: 404 len: 111 microversion: 2.1 time: 0.031522 Sep 07 13:43:36.340403 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3593/7214] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:36 2022] GET /compute/v2.1/servers/4ed905d1-0713-49f5-aa66-1574b0734a2c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:43:36.346487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3dbd9956-49a5-4ae5-86fd-8e8dc17b6f89 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:36.347000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3dbd9956-49a5-4ae5-86fd-8e8dc17b6f89 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:36.353378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3dbd9956-49a5-4ae5-86fd-8e8dc17b6f89 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:36.353918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3dbd9956-49a5-4ae5-86fd-8e8dc17b6f89 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:36.354369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3dbd9956-49a5-4ae5-86fd-8e8dc17b6f89 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:36.355086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3dbd9956-49a5-4ae5-86fd-8e8dc17b6f89 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:36.355553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3dbd9956-49a5-4ae5-86fd-8e8dc17b6f89 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:36.355989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3dbd9956-49a5-4ae5-86fd-8e8dc17b6f89 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:36.375071 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-3dbd9956-49a5-4ae5-86fd-8e8dc17b6f89 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] HTTP exception thrown: Instance 824957b8-3a81-4a12-ac73-f3506ba5c415 could not be found. Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3dbd9956-49a5-4ae5-86fd-8e8dc17b6f89 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Request method failure captured: Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 HTTP/1.1 Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJ6Qa8Wgx3edQ7CXPA7GMXkRXsD6n0ODz0fJ4U_HSdO27cMoqedxiUWhG-0C6635gytRmbSHGz9fwKnUkfS2q0gSeQ7nm1CzWfB0bTkZfTtk2qgxY2gxQer8R0l1g7MVKHxAmv0Z5uiEW3b338LhbLsy-_HbtXv9ZiSJd_u4NfmTSZM Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_396666be58fa42568bdfa2652d635a41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/396666be58fa42568bdfa2652d635a41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: bb0e9196784341cbb170c1c055e8966f Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 824957b8-3a81-4a12-ac73-f3506ba5c415 could not be found. Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '824957b8-3a81-4a12-ac73-f3506ba5c415'} Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 824957b8-3a81-4a12-ac73-f3506ba5c415 could not be found. Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:43:36.376455 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:43:36.381036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 824957b8-3a81-4a12-ac73-f3506ba5c415 could not be found. Sep 07 13:43:36.381036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.381036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:43:36.381036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.381036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:36.381036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:43:36.381036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:43:36.381036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:43:36.381036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:43:36.381036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 824957b8-3a81-4a12-ac73-f3506ba5c415 could not be found. Sep 07 13:43:36.381036 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.381036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3dbd9956-49a5-4ae5-86fd-8e8dc17b6f89 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Returning 404 to user: Instance 824957b8-3a81-4a12-ac73-f3506ba5c415 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:43:36.381036 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3dbd9956-49a5-4ae5-86fd-8e8dc17b6f89 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "DELETE /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 404 len: 111 microversion: 2.1 time: 0.035579 Sep 07 13:43:36.381036 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3622/7215] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:43:36 2022] DELETE /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:43:36.389379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f819c7de-01fe-44fb-b009-f6143b7ad790 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:36.390443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f819c7de-01fe-44fb-b009-f6143b7ad790 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 824957b8-3a81-4a12-ac73-f3506ba5c415] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:36.399650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f819c7de-01fe-44fb-b009-f6143b7ad790 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:36.400457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f819c7de-01fe-44fb-b009-f6143b7ad790 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:36.400887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f819c7de-01fe-44fb-b009-f6143b7ad790 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:36.401651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f819c7de-01fe-44fb-b009-f6143b7ad790 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:36.402129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f819c7de-01fe-44fb-b009-f6143b7ad790 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:36.402742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f819c7de-01fe-44fb-b009-f6143b7ad790 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:36.420276 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-f819c7de-01fe-44fb-b009-f6143b7ad790 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] HTTP exception thrown: Instance 824957b8-3a81-4a12-ac73-f3506ba5c415 could not be found. Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f819c7de-01fe-44fb-b009-f6143b7ad790 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Request method failure captured: Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 HTTP/1.1 Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJ6Qa8Wgx3edQ7CXPA7GMXkRXsD6n0ODz0fJ4U_HSdO27cMoqedxiUWhG-0C6635gytRmbSHGz9fwKnUkfS2q0gSeQ7nm1CzWfB0bTkZfTtk2qgxY2gxQer8R0l1g7MVKHxAmv0Z5uiEW3b338LhbLsy-_HbtXv9ZiSJd_u4NfmTSZM Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_396666be58fa42568bdfa2652d635a41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/396666be58fa42568bdfa2652d635a41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: bb0e9196784341cbb170c1c055e8966f Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 824957b8-3a81-4a12-ac73-f3506ba5c415 could not be found. Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '824957b8-3a81-4a12-ac73-f3506ba5c415'} Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 824957b8-3a81-4a12-ac73-f3506ba5c415 could not be found. Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 824957b8-3a81-4a12-ac73-f3506ba5c415 could not be found. Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:43:36.422026 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.427038 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:36.427038 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:43:36.427038 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:43:36.427038 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:43:36.427038 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:43:36.427038 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 824957b8-3a81-4a12-ac73-f3506ba5c415 could not be found. Sep 07 13:43:36.427038 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.427038 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f819c7de-01fe-44fb-b009-f6143b7ad790 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Returning 404 to user: Instance 824957b8-3a81-4a12-ac73-f3506ba5c415 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:43:36.427038 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f819c7de-01fe-44fb-b009-f6143b7ad790 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415" status: 404 len: 111 microversion: 2.1 time: 0.038902 Sep 07 13:43:36.427038 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3594/7216] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:36 2022] GET /compute/v2.1/servers/824957b8-3a81-4a12-ac73-f3506ba5c415 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:43:36.432027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e8adb9b0-7579-42e0-b900-0fe93a9fedb7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:36.432574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e8adb9b0-7579-42e0-b900-0fe93a9fedb7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:36.439178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8adb9b0-7579-42e0-b900-0fe93a9fedb7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:36.439714 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8adb9b0-7579-42e0-b900-0fe93a9fedb7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:36.440195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8adb9b0-7579-42e0-b900-0fe93a9fedb7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:36.440918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8adb9b0-7579-42e0-b900-0fe93a9fedb7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:36.441400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8adb9b0-7579-42e0-b900-0fe93a9fedb7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:36.441876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8adb9b0-7579-42e0-b900-0fe93a9fedb7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:36.456958 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-e8adb9b0-7579-42e0-b900-0fe93a9fedb7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] HTTP exception thrown: Instance 09d82c40-2803-474d-ad84-666897e7bbf9 could not be found. Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e8adb9b0-7579-42e0-b900-0fe93a9fedb7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Request method failure captured: Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 HTTP/1.1 Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGJ6Qa8Wgx3edQ7CXPA7GMXkRXsD6n0ODz0fJ4U_HSdO27cMoqedxiUWhG-0C6635gytRmbSHGz9fwKnUkfS2q0gSeQ7nm1CzWfB0bTkZfTtk2qgxY2gxQer8R0l1g7MVKHxAmv0Z5uiEW3b338LhbLsy-_HbtXv9ZiSJd_u4NfmTSZM Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_396666be58fa42568bdfa2652d635a41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/396666be58fa42568bdfa2652d635a41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: bb0e9196784341cbb170c1c055e8966f Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 09d82c40-2803-474d-ad84-666897e7bbf9 could not be found. Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '09d82c40-2803-474d-ad84-666897e7bbf9'} Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09d82c40-2803-474d-ad84-666897e7bbf9 could not be found. Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:43:36.458736 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:43:36.464547 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09d82c40-2803-474d-ad84-666897e7bbf9 could not be found. Sep 07 13:43:36.464547 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.464547 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:43:36.464547 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.464547 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:36.464547 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:43:36.464547 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:43:36.464547 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:43:36.464547 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:43:36.464547 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09d82c40-2803-474d-ad84-666897e7bbf9 could not be found. Sep 07 13:43:36.464547 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.464547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e8adb9b0-7579-42e0-b900-0fe93a9fedb7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Returning 404 to user: Instance 09d82c40-2803-474d-ad84-666897e7bbf9 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:43:36.464547 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e8adb9b0-7579-42e0-b900-0fe93a9fedb7 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "DELETE /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 404 len: 111 microversion: 2.1 time: 0.032119 Sep 07 13:43:36.464547 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3623/7217] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:43:36 2022] DELETE /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:43:36.469635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e04c3b1a-66aa-4cb6-b487-9c7dd9a89f3f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:36.470572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e04c3b1a-66aa-4cb6-b487-9c7dd9a89f3f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [instance: 09d82c40-2803-474d-ad84-666897e7bbf9] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:36.481237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e04c3b1a-66aa-4cb6-b487-9c7dd9a89f3f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:36.481778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e04c3b1a-66aa-4cb6-b487-9c7dd9a89f3f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:36.482227 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e04c3b1a-66aa-4cb6-b487-9c7dd9a89f3f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:36.482969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e04c3b1a-66aa-4cb6-b487-9c7dd9a89f3f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:36.483485 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e04c3b1a-66aa-4cb6-b487-9c7dd9a89f3f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:36.484036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e04c3b1a-66aa-4cb6-b487-9c7dd9a89f3f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:36.787520 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-e04c3b1a-66aa-4cb6-b487-9c7dd9a89f3f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] HTTP exception thrown: Instance 09d82c40-2803-474d-ad84-666897e7bbf9 could not be found. Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e04c3b1a-66aa-4cb6-b487-9c7dd9a89f3f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Request method failure captured: Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 HTTP/1.1 Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGJ6Qa8Wgx3edQ7CXPA7GMXkRXsD6n0ODz0fJ4U_HSdO27cMoqedxiUWhG-0C6635gytRmbSHGz9fwKnUkfS2q0gSeQ7nm1CzWfB0bTkZfTtk2qgxY2gxQer8R0l1g7MVKHxAmv0Z5uiEW3b338LhbLsy-_HbtXv9ZiSJd_u4NfmTSZM Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_396666be58fa42568bdfa2652d635a41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/396666be58fa42568bdfa2652d635a41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/396666be58fa42568bdfa2652d635a41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 396666be58fa42568bdfa2652d635a41 Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServerActionsTestJSON-1776104750 Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: bb0e9196784341cbb170c1c055e8966f Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServerActionsTestJSON-1776104750-project Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 09d82c40-2803-474d-ad84-666897e7bbf9 could not be found. Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '09d82c40-2803-474d-ad84-666897e7bbf9'} Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09d82c40-2803-474d-ad84-666897e7bbf9 could not be found. Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09d82c40-2803-474d-ad84-666897e7bbf9 could not be found. Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:43:36.789027 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.793757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:43:36.793757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:43:36.793757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:43:36.793757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:43:36.793757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:43:36.793757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09d82c40-2803-474d-ad84-666897e7bbf9 could not be found. Sep 07 13:43:36.793757 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:43:36.793757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e04c3b1a-66aa-4cb6-b487-9c7dd9a89f3f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Returning 404 to user: Instance 09d82c40-2803-474d-ad84-666897e7bbf9 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:43:36.793757 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e04c3b1a-66aa-4cb6-b487-9c7dd9a89f3f tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9" status: 404 len: 111 microversion: 2.1 time: 0.325172 Sep 07 13:43:36.793757 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3595/7218] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:36 2022] GET /compute/v2.1/servers/09d82c40-2803-474d-ad84-666897e7bbf9 => generated 111 bytes in 327 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:43:36.799781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-83301570-2d7a-4ba9-b3e9-8c8531c33e29 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] Calling method '.version_select at 0x7fc418847280>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:36.804361 n-d-852087-9 devstack@n-api.service[122433]: ERROR oslo.messaging._drivers.impl_rabbit [None req-83301570-2d7a-4ba9-b3e9-8c8531c33e29 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [a2673710-3fd6-4801-a9a5-17a5c6a24bd2] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 13:43:37.813390 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [None req-83301570-2d7a-4ba9-b3e9-8c8531c33e29 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] [a2673710-3fd6-4801-a9a5-17a5c6a24bd2] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38612. Sep 07 13:43:37.838011 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-83301570-2d7a-4ba9-b3e9-8c8531c33e29 tempest-ServerActionsTestJSON-1776104750 tempest-ServerActionsTestJSON-1776104750-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1624528547" status: 202 len: 0 microversion: 2.1 time: 1.042178 Sep 07 13:43:37.839539 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3624/7219] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Sep 7 13:43:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1624528547 => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:43:48.676772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=15 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:43:48.678288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=29 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:43:48.849737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fbb8d572-20d0-4d30-9b9e-f9485a71b1a1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1551985816", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "36f291f5-08e5-4aeb-a9b6-76e7d93b0382"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:43:48.921471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-fbb8d572-20d0-4d30-9b9e-f9485a71b1a1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] validate_networks() for [('36f291f5-08e5-4aeb-a9b6-76e7d93b0382', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:43:49.428996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fbb8d572-20d0-4d30-9b9e-f9485a71b1a1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:43:49.429568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fbb8d572-20d0-4d30-9b9e-f9485a71b1a1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:43:49.430311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fbb8d572-20d0-4d30-9b9e-f9485a71b1a1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:43:49.432300 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fbb8d572-20d0-4d30-9b9e-f9485a71b1a1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:43:49.432855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-fbb8d572-20d0-4d30-9b9e-f9485a71b1a1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:43:49.444727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbb8d572-20d0-4d30-9b9e-f9485a71b1a1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:49.445209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbb8d572-20d0-4d30-9b9e-f9485a71b1a1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:49.445686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbb8d572-20d0-4d30-9b9e-f9485a71b1a1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:49.446496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbb8d572-20d0-4d30-9b9e-f9485a71b1a1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:49.447076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbb8d572-20d0-4d30-9b9e-f9485a71b1a1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:49.447662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fbb8d572-20d0-4d30-9b9e-f9485a71b1a1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:49.470120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-fbb8d572-20d0-4d30-9b9e-f9485a71b1a1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Getting quotas for project da99501eff90453cacf4f3dccc3d7f30. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:43:49.476610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-fbb8d572-20d0-4d30-9b9e-f9485a71b1a1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Getting quotas for user 85b071691062474cac2372d5123821ed and project da99501eff90453cacf4f3dccc3d7f30. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:43:49.492076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fbb8d572-20d0-4d30-9b9e-f9485a71b1a1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:43:49.494610 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fbb8d572-20d0-4d30-9b9e-f9485a71b1a1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: d735a139-2335-4fa4-844a-fec9e661d274] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:43:49.556487 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fbb8d572-20d0-4d30-9b9e-f9485a71b1a1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.891299 Sep 07 13:43:49.562070 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3596/7220] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:43:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:43:49.567591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:43:49.568513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:43:49.573510 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-caf578b3-2d7e-4115-ad77-0c867e9e3c70 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:49.574173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-caf578b3-2d7e-4115-ad77-0c867e9e3c70 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: d735a139-2335-4fa4-844a-fec9e661d274] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:49.640344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-caf578b3-2d7e-4115-ad77-0c867e9e3c70 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:49.657998 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-caf578b3-2d7e-4115-ad77-0c867e9e3c70 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274" status: 200 len: 1217 microversion: 2.1 time: 0.092249 Sep 07 13:43:49.659001 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3625/7221] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:49 2022] GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274 => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:50.697659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-57205ec7-344f-40a7-9e24-1dbb72242b07 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:50.698513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-57205ec7-344f-40a7-9e24-1dbb72242b07 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: d735a139-2335-4fa4-844a-fec9e661d274] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:50.705918 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57205ec7-344f-40a7-9e24-1dbb72242b07 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:50.706430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57205ec7-344f-40a7-9e24-1dbb72242b07 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:50.706884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57205ec7-344f-40a7-9e24-1dbb72242b07 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:50.707619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57205ec7-344f-40a7-9e24-1dbb72242b07 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:50.708082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57205ec7-344f-40a7-9e24-1dbb72242b07 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:50.708512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-57205ec7-344f-40a7-9e24-1dbb72242b07 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:50.779721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-57205ec7-344f-40a7-9e24-1dbb72242b07 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:50.793624 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-57205ec7-344f-40a7-9e24-1dbb72242b07 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274" status: 200 len: 1269 microversion: 2.1 time: 0.100630 Sep 07 13:43:50.794569 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3597/7222] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:50 2022] GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274 => generated 1269 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:51.824205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-11067f8a-cf11-40ed-a1b5-28fe7f88266a tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:51.825952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-11067f8a-cf11-40ed-a1b5-28fe7f88266a tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: d735a139-2335-4fa4-844a-fec9e661d274] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:51.840359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11067f8a-cf11-40ed-a1b5-28fe7f88266a tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:51.841021 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11067f8a-cf11-40ed-a1b5-28fe7f88266a tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:51.842673 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11067f8a-cf11-40ed-a1b5-28fe7f88266a tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:51.844457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11067f8a-cf11-40ed-a1b5-28fe7f88266a tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:51.846191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11067f8a-cf11-40ed-a1b5-28fe7f88266a tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:51.847344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11067f8a-cf11-40ed-a1b5-28fe7f88266a tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:52.093566 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-11067f8a-cf11-40ed-a1b5-28fe7f88266a tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:52.104445 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-11067f8a-cf11-40ed-a1b5-28fe7f88266a tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274" status: 200 len: 1317 microversion: 2.1 time: 0.287129 Sep 07 13:43:52.105630 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3626/7223] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:51 2022] GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274 => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:53.132626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-7d9937cc-abe8-4053-ab4b-4bf80ed69ade req-0b7abed3-9175-4c34-a268-d914a33160c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d735a139-2335-4fa4-844a-fec9e661d274", "tag": "b8c72d00-ce9c-4953-963b-4c2d13f8e16d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:43:53.157856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7d9937cc-abe8-4053-ab4b-4bf80ed69ade req-0b7abed3-9175-4c34-a268-d914a33160c7 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:53.158746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6f6a09d7-9632-4619-8f12-3bdfdf7b5408 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:53.159500 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7d9937cc-abe8-4053-ab4b-4bf80ed69ade req-0b7abed3-9175-4c34-a268-d914a33160c7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:53.160000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6f6a09d7-9632-4619-8f12-3bdfdf7b5408 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: d735a139-2335-4fa4-844a-fec9e661d274] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:53.160434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7d9937cc-abe8-4053-ab4b-4bf80ed69ade req-0b7abed3-9175-4c34-a268-d914a33160c7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:53.175226 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7d9937cc-abe8-4053-ab4b-4bf80ed69ade req-0b7abed3-9175-4c34-a268-d914a33160c7 service nova] Creating event network-changed:b8c72d00-ce9c-4953-963b-4c2d13f8e16d for instance d735a139-2335-4fa4-844a-fec9e661d274 on n-h1-852087-9 Sep 07 13:43:53.181798 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-7d9937cc-abe8-4053-ab4b-4bf80ed69ade req-0b7abed3-9175-4c34-a268-d914a33160c7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146465 Sep 07 13:43:53.182955 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3598/7224] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:43:53.185763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f6a09d7-9632-4619-8f12-3bdfdf7b5408 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:53.186399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f6a09d7-9632-4619-8f12-3bdfdf7b5408 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:53.188238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f6a09d7-9632-4619-8f12-3bdfdf7b5408 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:53.189540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f6a09d7-9632-4619-8f12-3bdfdf7b5408 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:53.189989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f6a09d7-9632-4619-8f12-3bdfdf7b5408 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:53.190449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f6a09d7-9632-4619-8f12-3bdfdf7b5408 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:53.440346 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6f6a09d7-9632-4619-8f12-3bdfdf7b5408 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:53.450391 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6f6a09d7-9632-4619-8f12-3bdfdf7b5408 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274" status: 200 len: 1317 microversion: 2.1 time: 0.309135 Sep 07 13:43:53.451010 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3627/7225] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:53 2022] GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274 => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:43:54.492306 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:43:54.492926 n-d-852087-9 devstack@n-api.service[122432]: Wed Sep 7 13:43:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274 (ip 10.222.0.16) !!! Sep 07 13:43:54.501241 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f576b338-3f77-4956-bc78-f3ede4c58110 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:54.502293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f576b338-3f77-4956-bc78-f3ede4c58110 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: d735a139-2335-4fa4-844a-fec9e661d274] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:54.516767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f576b338-3f77-4956-bc78-f3ede4c58110 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:54.517751 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f576b338-3f77-4956-bc78-f3ede4c58110 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:54.518507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f576b338-3f77-4956-bc78-f3ede4c58110 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:54.519740 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f576b338-3f77-4956-bc78-f3ede4c58110 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:54.520555 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f576b338-3f77-4956-bc78-f3ede4c58110 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:54.521332 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f576b338-3f77-4956-bc78-f3ede4c58110 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:54.692603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f576b338-3f77-4956-bc78-f3ede4c58110 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:54.701181 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f576b338-3f77-4956-bc78-f3ede4c58110 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274" status: 200 len: 1317 microversion: 2.1 time: 0.210235 Sep 07 13:43:54.702037 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3599/7226] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:54 2022] GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:55.725401 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2348171a-093d-4bb9-99e2-78f5e731aa6d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:55.726104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2348171a-093d-4bb9-99e2-78f5e731aa6d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: d735a139-2335-4fa4-844a-fec9e661d274] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:55.734579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2348171a-093d-4bb9-99e2-78f5e731aa6d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:55.735141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2348171a-093d-4bb9-99e2-78f5e731aa6d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:55.735653 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2348171a-093d-4bb9-99e2-78f5e731aa6d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:55.736394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2348171a-093d-4bb9-99e2-78f5e731aa6d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:55.736876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2348171a-093d-4bb9-99e2-78f5e731aa6d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:55.737326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2348171a-093d-4bb9-99e2-78f5e731aa6d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:55.890015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2348171a-093d-4bb9-99e2-78f5e731aa6d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:55.899705 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2348171a-093d-4bb9-99e2-78f5e731aa6d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274" status: 200 len: 1317 microversion: 2.1 time: 0.178135 Sep 07 13:43:55.900446 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3628/7227] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:55 2022] GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:56.925182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e5be4d5c-eb88-4cb0-80c4-4da0563959b7 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:56.925979 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e5be4d5c-eb88-4cb0-80c4-4da0563959b7 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: d735a139-2335-4fa4-844a-fec9e661d274] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:56.934763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5be4d5c-eb88-4cb0-80c4-4da0563959b7 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:56.935165 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5be4d5c-eb88-4cb0-80c4-4da0563959b7 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:56.935596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5be4d5c-eb88-4cb0-80c4-4da0563959b7 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:56.936437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5be4d5c-eb88-4cb0-80c4-4da0563959b7 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:56.936831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5be4d5c-eb88-4cb0-80c4-4da0563959b7 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:56.937755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e5be4d5c-eb88-4cb0-80c4-4da0563959b7 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:57.091272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e5be4d5c-eb88-4cb0-80c4-4da0563959b7 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:57.099749 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e5be4d5c-eb88-4cb0-80c4-4da0563959b7 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274" status: 200 len: 1317 microversion: 2.1 time: 0.179350 Sep 07 13:43:57.100367 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3600/7228] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:56 2022] GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:58.124647 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-257bed79-7cfd-4d2d-97b8-0d446e9ea42f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:58.125273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-257bed79-7cfd-4d2d-97b8-0d446e9ea42f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: d735a139-2335-4fa4-844a-fec9e661d274] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:58.133089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-257bed79-7cfd-4d2d-97b8-0d446e9ea42f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:58.133610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-257bed79-7cfd-4d2d-97b8-0d446e9ea42f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:58.134093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-257bed79-7cfd-4d2d-97b8-0d446e9ea42f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:58.134847 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-257bed79-7cfd-4d2d-97b8-0d446e9ea42f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:58.135318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-257bed79-7cfd-4d2d-97b8-0d446e9ea42f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:58.135753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-257bed79-7cfd-4d2d-97b8-0d446e9ea42f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:58.295052 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-257bed79-7cfd-4d2d-97b8-0d446e9ea42f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:58.304086 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-257bed79-7cfd-4d2d-97b8-0d446e9ea42f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274" status: 200 len: 1317 microversion: 2.1 time: 0.183260 Sep 07 13:43:58.304689 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3629/7229] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:58 2022] GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:43:59.328391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b874468c-f231-4df6-9eca-3d806e53b68d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:43:59.329009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b874468c-f231-4df6-9eca-3d806e53b68d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: d735a139-2335-4fa4-844a-fec9e661d274] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:43:59.337171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b874468c-f231-4df6-9eca-3d806e53b68d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:59.337741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b874468c-f231-4df6-9eca-3d806e53b68d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:59.338219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b874468c-f231-4df6-9eca-3d806e53b68d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:59.338984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b874468c-f231-4df6-9eca-3d806e53b68d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:43:59.339807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b874468c-f231-4df6-9eca-3d806e53b68d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:43:59.340240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b874468c-f231-4df6-9eca-3d806e53b68d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:43:59.454806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:43:59.478147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b874468c-f231-4df6-9eca-3d806e53b68d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:43:59.484688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:43:59.488068 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b874468c-f231-4df6-9eca-3d806e53b68d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274" status: 200 len: 1317 microversion: 2.1 time: 0.163653 Sep 07 13:43:59.488663 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3601/7230] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:43:59 2022] GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:00.517766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d4489236-d479-40e3-82a9-37dbcad0482d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:00.518646 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d4489236-d479-40e3-82a9-37dbcad0482d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: d735a139-2335-4fa4-844a-fec9e661d274] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:00.521583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:44:00.527372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4489236-d479-40e3-82a9-37dbcad0482d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:00.527891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4489236-d479-40e3-82a9-37dbcad0482d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:00.528351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4489236-d479-40e3-82a9-37dbcad0482d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:00.529084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4489236-d479-40e3-82a9-37dbcad0482d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:00.529582 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4489236-d479-40e3-82a9-37dbcad0482d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:00.530189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4489236-d479-40e3-82a9-37dbcad0482d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:00.594785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-692a1725-7cc4-40fd-be5d-d598c11a0ee2 req-886c7316-a545-48ed-a2a8-02c9b77074c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d735a139-2335-4fa4-844a-fec9e661d274", "name": "network-vif-plugged", "status": "completed", "tag": "b8c72d00-ce9c-4953-963b-4c2d13f8e16d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:44:00.607171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-692a1725-7cc4-40fd-be5d-d598c11a0ee2 req-886c7316-a545-48ed-a2a8-02c9b77074c6 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:00.607758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-692a1725-7cc4-40fd-be5d-d598c11a0ee2 req-886c7316-a545-48ed-a2a8-02c9b77074c6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:00.608388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-692a1725-7cc4-40fd-be5d-d598c11a0ee2 req-886c7316-a545-48ed-a2a8-02c9b77074c6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:00.624091 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-692a1725-7cc4-40fd-be5d-d598c11a0ee2 req-886c7316-a545-48ed-a2a8-02c9b77074c6 service nova] Creating event network-vif-plugged:b8c72d00-ce9c-4953-963b-4c2d13f8e16d for instance d735a139-2335-4fa4-844a-fec9e661d274 on n-h1-852087-9 Sep 07 13:44:00.629671 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-692a1725-7cc4-40fd-be5d-d598c11a0ee2 req-886c7316-a545-48ed-a2a8-02c9b77074c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039652 Sep 07 13:44:00.630919 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3602/7231] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:44:00.710136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d4489236-d479-40e3-82a9-37dbcad0482d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:00.719097 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d4489236-d479-40e3-82a9-37dbcad0482d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274" status: 200 len: 1317 microversion: 2.1 time: 0.208141 Sep 07 13:44:00.719697 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3630/7232] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:00 2022] GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:01.748090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0bc29df0-94e1-4886-89de-4b96d461bd2c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:01.748898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0bc29df0-94e1-4886-89de-4b96d461bd2c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: d735a139-2335-4fa4-844a-fec9e661d274] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:01.757928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0bc29df0-94e1-4886-89de-4b96d461bd2c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:01.758559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0bc29df0-94e1-4886-89de-4b96d461bd2c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:01.759128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0bc29df0-94e1-4886-89de-4b96d461bd2c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:01.759913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0bc29df0-94e1-4886-89de-4b96d461bd2c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:01.760390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0bc29df0-94e1-4886-89de-4b96d461bd2c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:01.761019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0bc29df0-94e1-4886-89de-4b96d461bd2c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:01.909971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0bc29df0-94e1-4886-89de-4b96d461bd2c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:01.918351 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0bc29df0-94e1-4886-89de-4b96d461bd2c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274" status: 200 len: 1317 microversion: 2.1 time: 0.178051 Sep 07 13:44:01.918919 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3603/7233] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:01 2022] GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:02.943017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-22b3eec6-dd2a-4955-81d9-110793152e4f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:02.943623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-22b3eec6-dd2a-4955-81d9-110793152e4f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: d735a139-2335-4fa4-844a-fec9e661d274] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:02.950853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22b3eec6-dd2a-4955-81d9-110793152e4f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:02.951357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22b3eec6-dd2a-4955-81d9-110793152e4f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:02.951818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22b3eec6-dd2a-4955-81d9-110793152e4f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:02.952501 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22b3eec6-dd2a-4955-81d9-110793152e4f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:02.952973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22b3eec6-dd2a-4955-81d9-110793152e4f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:02.953403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22b3eec6-dd2a-4955-81d9-110793152e4f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:03.091609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-22b3eec6-dd2a-4955-81d9-110793152e4f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:03.099996 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-22b3eec6-dd2a-4955-81d9-110793152e4f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274" status: 200 len: 1507 microversion: 2.1 time: 0.160976 Sep 07 13:44:03.100565 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3631/7234] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:02 2022] GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:03.163628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-47a5e528-76c1-4926-82e8-96f59a0737a6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1876253160", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "36f291f5-08e5-4aeb-a9b6-76e7d93b0382"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:44:03.222392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-47a5e528-76c1-4926-82e8-96f59a0737a6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] validate_networks() for [('36f291f5-08e5-4aeb-a9b6-76e7d93b0382', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:44:03.622087 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-47a5e528-76c1-4926-82e8-96f59a0737a6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:44:03.622537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-47a5e528-76c1-4926-82e8-96f59a0737a6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:44:03.623013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-47a5e528-76c1-4926-82e8-96f59a0737a6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:44:03.623420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-47a5e528-76c1-4926-82e8-96f59a0737a6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:44:03.624058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-47a5e528-76c1-4926-82e8-96f59a0737a6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:44:03.634016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47a5e528-76c1-4926-82e8-96f59a0737a6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:03.634504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47a5e528-76c1-4926-82e8-96f59a0737a6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:03.634937 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47a5e528-76c1-4926-82e8-96f59a0737a6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:03.635666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47a5e528-76c1-4926-82e8-96f59a0737a6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:03.636118 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47a5e528-76c1-4926-82e8-96f59a0737a6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:03.636532 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-47a5e528-76c1-4926-82e8-96f59a0737a6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:03.654023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-47a5e528-76c1-4926-82e8-96f59a0737a6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Getting quotas for project da99501eff90453cacf4f3dccc3d7f30. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:44:03.662460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-47a5e528-76c1-4926-82e8-96f59a0737a6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Getting quotas for user 85b071691062474cac2372d5123821ed and project da99501eff90453cacf4f3dccc3d7f30. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:44:03.683044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-47a5e528-76c1-4926-82e8-96f59a0737a6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:44:03.686427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-47a5e528-76c1-4926-82e8-96f59a0737a6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: aaad7d1f-3566-45a0-afd7-7942188143f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:44:03.734369 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-47a5e528-76c1-4926-82e8-96f59a0737a6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574722 Sep 07 13:44:03.735065 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3604/7235] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:44:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:44:03.747144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4548dbf1-184e-40e3-a400-191f174778b8 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:03.747893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4548dbf1-184e-40e3-a400-191f174778b8 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: aaad7d1f-3566-45a0-afd7-7942188143f3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:03.805840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4548dbf1-184e-40e3-a400-191f174778b8 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:03.813543 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4548dbf1-184e-40e3-a400-191f174778b8 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3" status: 200 len: 1217 microversion: 2.1 time: 0.070496 Sep 07 13:44:03.814230 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3632/7236] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:03 2022] GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:04.840384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3d428939-0f1c-4dee-8a5e-0aa6cec99d33 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:04.840934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3d428939-0f1c-4dee-8a5e-0aa6cec99d33 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: aaad7d1f-3566-45a0-afd7-7942188143f3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:04.854715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d428939-0f1c-4dee-8a5e-0aa6cec99d33 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:04.855401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d428939-0f1c-4dee-8a5e-0aa6cec99d33 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:04.856029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d428939-0f1c-4dee-8a5e-0aa6cec99d33 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:04.856945 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d428939-0f1c-4dee-8a5e-0aa6cec99d33 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:04.857904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d428939-0f1c-4dee-8a5e-0aa6cec99d33 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:04.858362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d428939-0f1c-4dee-8a5e-0aa6cec99d33 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:04.925146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3d428939-0f1c-4dee-8a5e-0aa6cec99d33 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:04.936626 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3d428939-0f1c-4dee-8a5e-0aa6cec99d33 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3" status: 200 len: 1269 microversion: 2.1 time: 0.102785 Sep 07 13:44:04.937416 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3605/7237] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:04 2022] GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3 => generated 1269 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:05.967517 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ee8d9aaf-482e-4121-b538-b8ba3ac05573 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:05.970659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ee8d9aaf-482e-4121-b538-b8ba3ac05573 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: aaad7d1f-3566-45a0-afd7-7942188143f3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:05.986103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee8d9aaf-482e-4121-b538-b8ba3ac05573 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:05.987498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee8d9aaf-482e-4121-b538-b8ba3ac05573 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:05.988452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee8d9aaf-482e-4121-b538-b8ba3ac05573 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:05.989558 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee8d9aaf-482e-4121-b538-b8ba3ac05573 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:05.990313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee8d9aaf-482e-4121-b538-b8ba3ac05573 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:05.991137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee8d9aaf-482e-4121-b538-b8ba3ac05573 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:06.148568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ee8d9aaf-482e-4121-b538-b8ba3ac05573 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:06.160936 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ee8d9aaf-482e-4121-b538-b8ba3ac05573 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3" status: 200 len: 1317 microversion: 2.1 time: 0.203394 Sep 07 13:44:06.161874 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3633/7238] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:05 2022] GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3 => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:06.686060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-07195a36-82b9-41ef-a92f-4bb4b4318e93 req-2afb0bbb-e390-4673-a5a7-bfa2a8ad5dba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaad7d1f-3566-45a0-afd7-7942188143f3", "tag": "e8f04c96-bb47-476c-a1d3-05158796d3eb"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:44:06.697349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-07195a36-82b9-41ef-a92f-4bb4b4318e93 req-2afb0bbb-e390-4673-a5a7-bfa2a8ad5dba service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:06.697872 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-07195a36-82b9-41ef-a92f-4bb4b4318e93 req-2afb0bbb-e390-4673-a5a7-bfa2a8ad5dba service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:06.698314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-07195a36-82b9-41ef-a92f-4bb4b4318e93 req-2afb0bbb-e390-4673-a5a7-bfa2a8ad5dba service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:06.712085 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-07195a36-82b9-41ef-a92f-4bb4b4318e93 req-2afb0bbb-e390-4673-a5a7-bfa2a8ad5dba service nova] Creating event network-changed:e8f04c96-bb47-476c-a1d3-05158796d3eb for instance aaad7d1f-3566-45a0-afd7-7942188143f3 on n-h2-852087-9 Sep 07 13:44:06.718646 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-07195a36-82b9-41ef-a92f-4bb4b4318e93 req-2afb0bbb-e390-4673-a5a7-bfa2a8ad5dba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037151 Sep 07 13:44:06.719252 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3606/7239] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:44:07.184879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8169cfab-9c61-4361-88f1-cdad78bae1e6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:07.185477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8169cfab-9c61-4361-88f1-cdad78bae1e6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: aaad7d1f-3566-45a0-afd7-7942188143f3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:07.193414 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8169cfab-9c61-4361-88f1-cdad78bae1e6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:07.193990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8169cfab-9c61-4361-88f1-cdad78bae1e6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:07.194460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8169cfab-9c61-4361-88f1-cdad78bae1e6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:07.195223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8169cfab-9c61-4361-88f1-cdad78bae1e6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:07.195712 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8169cfab-9c61-4361-88f1-cdad78bae1e6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:07.196193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8169cfab-9c61-4361-88f1-cdad78bae1e6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:07.350156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8169cfab-9c61-4361-88f1-cdad78bae1e6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:07.359425 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8169cfab-9c61-4361-88f1-cdad78bae1e6 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3" status: 200 len: 1317 microversion: 2.1 time: 0.178808 Sep 07 13:44:07.360024 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3634/7240] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:07 2022] GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:08.384284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d7d84634-efed-46ce-8b83-b0cf4f852f7e tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:08.385092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d7d84634-efed-46ce-8b83-b0cf4f852f7e tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: aaad7d1f-3566-45a0-afd7-7942188143f3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:08.392452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7d84634-efed-46ce-8b83-b0cf4f852f7e tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:08.392948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7d84634-efed-46ce-8b83-b0cf4f852f7e tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:08.393392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7d84634-efed-46ce-8b83-b0cf4f852f7e tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:08.394167 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7d84634-efed-46ce-8b83-b0cf4f852f7e tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:08.394630 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7d84634-efed-46ce-8b83-b0cf4f852f7e tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:08.395062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d7d84634-efed-46ce-8b83-b0cf4f852f7e tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:08.538539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d7d84634-efed-46ce-8b83-b0cf4f852f7e tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:08.546711 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d7d84634-efed-46ce-8b83-b0cf4f852f7e tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3" status: 200 len: 1317 microversion: 2.1 time: 0.167640 Sep 07 13:44:08.547304 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3607/7241] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:08 2022] GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:09.570020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d9956d3f-faf4-4585-ac01-ae5fa4cd47a0 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:09.570666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d9956d3f-faf4-4585-ac01-ae5fa4cd47a0 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: aaad7d1f-3566-45a0-afd7-7942188143f3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:09.578107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9956d3f-faf4-4585-ac01-ae5fa4cd47a0 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:09.578658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9956d3f-faf4-4585-ac01-ae5fa4cd47a0 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:09.579119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9956d3f-faf4-4585-ac01-ae5fa4cd47a0 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:09.580049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9956d3f-faf4-4585-ac01-ae5fa4cd47a0 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:09.580390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9956d3f-faf4-4585-ac01-ae5fa4cd47a0 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:09.580841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d9956d3f-faf4-4585-ac01-ae5fa4cd47a0 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:09.724410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d9956d3f-faf4-4585-ac01-ae5fa4cd47a0 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:09.732685 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d9956d3f-faf4-4585-ac01-ae5fa4cd47a0 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3" status: 200 len: 1317 microversion: 2.1 time: 0.166581 Sep 07 13:44:09.733283 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3635/7242] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:09 2022] GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:10.756818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6f014ddf-b4fe-4347-8369-d2859b3e0a35 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:10.757670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6f014ddf-b4fe-4347-8369-d2859b3e0a35 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: aaad7d1f-3566-45a0-afd7-7942188143f3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:10.767543 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f014ddf-b4fe-4347-8369-d2859b3e0a35 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:10.768042 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f014ddf-b4fe-4347-8369-d2859b3e0a35 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:10.768483 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f014ddf-b4fe-4347-8369-d2859b3e0a35 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:10.769192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f014ddf-b4fe-4347-8369-d2859b3e0a35 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:10.769691 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f014ddf-b4fe-4347-8369-d2859b3e0a35 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:10.770105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6f014ddf-b4fe-4347-8369-d2859b3e0a35 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:10.912176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6f014ddf-b4fe-4347-8369-d2859b3e0a35 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:10.920852 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6f014ddf-b4fe-4347-8369-d2859b3e0a35 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3" status: 200 len: 1317 microversion: 2.1 time: 0.168178 Sep 07 13:44:10.921542 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3608/7243] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:10 2022] GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:11.070294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-68bb5415-ca5c-46e7-b6cf-2d4f2bcc3f23 req-0c96092f-e8a3-426c-a5f8-a9d2cdd669a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaad7d1f-3566-45a0-afd7-7942188143f3", "name": "network-vif-plugged", "status": "completed", "tag": "e8f04c96-bb47-476c-a1d3-05158796d3eb"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:44:11.083082 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-68bb5415-ca5c-46e7-b6cf-2d4f2bcc3f23 req-0c96092f-e8a3-426c-a5f8-a9d2cdd669a9 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:11.083517 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-68bb5415-ca5c-46e7-b6cf-2d4f2bcc3f23 req-0c96092f-e8a3-426c-a5f8-a9d2cdd669a9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:11.084164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-68bb5415-ca5c-46e7-b6cf-2d4f2bcc3f23 req-0c96092f-e8a3-426c-a5f8-a9d2cdd669a9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:11.099100 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-68bb5415-ca5c-46e7-b6cf-2d4f2bcc3f23 req-0c96092f-e8a3-426c-a5f8-a9d2cdd669a9 service nova] Creating event network-vif-plugged:e8f04c96-bb47-476c-a1d3-05158796d3eb for instance aaad7d1f-3566-45a0-afd7-7942188143f3 on n-h2-852087-9 Sep 07 13:44:11.104788 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-68bb5415-ca5c-46e7-b6cf-2d4f2bcc3f23 req-0c96092f-e8a3-426c-a5f8-a9d2cdd669a9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038694 Sep 07 13:44:11.105409 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3636/7244] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:44:11.944904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2dca61a8-c55f-4caa-a1c0-0d102875d019 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:11.945656 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2dca61a8-c55f-4caa-a1c0-0d102875d019 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: aaad7d1f-3566-45a0-afd7-7942188143f3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:11.953390 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dca61a8-c55f-4caa-a1c0-0d102875d019 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:11.954139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dca61a8-c55f-4caa-a1c0-0d102875d019 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:11.954652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dca61a8-c55f-4caa-a1c0-0d102875d019 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:11.955530 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dca61a8-c55f-4caa-a1c0-0d102875d019 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:11.956077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dca61a8-c55f-4caa-a1c0-0d102875d019 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:11.956706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2dca61a8-c55f-4caa-a1c0-0d102875d019 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:12.105951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2dca61a8-c55f-4caa-a1c0-0d102875d019 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:12.114181 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2dca61a8-c55f-4caa-a1c0-0d102875d019 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3" status: 200 len: 1317 microversion: 2.1 time: 0.173452 Sep 07 13:44:12.114997 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3609/7245] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:11 2022] GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:13.138623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-22f1bbb6-b18b-4034-9e75-299a86e00bc0 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:13.139517 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-22f1bbb6-b18b-4034-9e75-299a86e00bc0 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: aaad7d1f-3566-45a0-afd7-7942188143f3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:13.146503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22f1bbb6-b18b-4034-9e75-299a86e00bc0 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:13.147041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22f1bbb6-b18b-4034-9e75-299a86e00bc0 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:13.147499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22f1bbb6-b18b-4034-9e75-299a86e00bc0 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:13.148222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22f1bbb6-b18b-4034-9e75-299a86e00bc0 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:13.148695 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22f1bbb6-b18b-4034-9e75-299a86e00bc0 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:13.149136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-22f1bbb6-b18b-4034-9e75-299a86e00bc0 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:13.309132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-22f1bbb6-b18b-4034-9e75-299a86e00bc0 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:13.319718 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-22f1bbb6-b18b-4034-9e75-299a86e00bc0 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3" status: 200 len: 1506 microversion: 2.1 time: 0.186326 Sep 07 13:44:13.320316 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3637/7246] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:13 2022] GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3 => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:13.344059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6bfb6e7a-8802-4eb7-966a-64b77726636f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:13.344618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6bfb6e7a-8802-4eb7-966a-64b77726636f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: aaad7d1f-3566-45a0-afd7-7942188143f3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:13.351886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bfb6e7a-8802-4eb7-966a-64b77726636f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:13.352381 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bfb6e7a-8802-4eb7-966a-64b77726636f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:13.352822 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bfb6e7a-8802-4eb7-966a-64b77726636f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:13.353553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bfb6e7a-8802-4eb7-966a-64b77726636f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:13.354021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bfb6e7a-8802-4eb7-966a-64b77726636f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:13.354449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bfb6e7a-8802-4eb7-966a-64b77726636f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:13.381419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6bfb6e7a-8802-4eb7-966a-64b77726636f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: aaad7d1f-3566-45a0-afd7-7942188143f3] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:44:13.461890 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6bfb6e7a-8802-4eb7-966a-64b77726636f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3" status: 204 len: 0 microversion: 2.1 time: 0.121820 Sep 07 13:44:13.462631 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3610/7247] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:44:13 2022] DELETE /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:44:13.471950 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-87f9fb09-2d5e-4c71-80a8-18de3fa55b8f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:13.472739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-87f9fb09-2d5e-4c71-80a8-18de3fa55b8f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: aaad7d1f-3566-45a0-afd7-7942188143f3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:13.479076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87f9fb09-2d5e-4c71-80a8-18de3fa55b8f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:13.479585 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87f9fb09-2d5e-4c71-80a8-18de3fa55b8f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:13.480043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87f9fb09-2d5e-4c71-80a8-18de3fa55b8f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:13.480769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87f9fb09-2d5e-4c71-80a8-18de3fa55b8f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:13.481245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87f9fb09-2d5e-4c71-80a8-18de3fa55b8f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:13.481727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-87f9fb09-2d5e-4c71-80a8-18de3fa55b8f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:13.634757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-87f9fb09-2d5e-4c71-80a8-18de3fa55b8f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:13.645280 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-87f9fb09-2d5e-4c71-80a8-18de3fa55b8f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3" status: 200 len: 1512 microversion: 2.1 time: 0.177395 Sep 07 13:44:13.646233 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3638/7248] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:13 2022] GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3 => generated 1512 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:44:14.677723 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-34ff9533-720a-4db2-899b-5488e254f2de tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:14.678430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-34ff9533-720a-4db2-899b-5488e254f2de tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: aaad7d1f-3566-45a0-afd7-7942188143f3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:14.680543 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:44:14.681348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:44:14.691347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34ff9533-720a-4db2-899b-5488e254f2de tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:14.691848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34ff9533-720a-4db2-899b-5488e254f2de tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:14.692289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34ff9533-720a-4db2-899b-5488e254f2de tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:14.692999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34ff9533-720a-4db2-899b-5488e254f2de tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:14.693457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34ff9533-720a-4db2-899b-5488e254f2de tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:14.693911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34ff9533-720a-4db2-899b-5488e254f2de tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:14.836497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-34ff9533-720a-4db2-899b-5488e254f2de tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:14.845467 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-34ff9533-720a-4db2-899b-5488e254f2de tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3" status: 200 len: 1512 microversion: 2.1 time: 0.172421 Sep 07 13:44:14.846071 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3611/7249] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:14 2022] GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3 => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:15.856233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:44:15.875434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-39b7960f-fb39-4f4a-a4c4-930e2af0c04b tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:15.876148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-39b7960f-fb39-4f4a-a4c4-930e2af0c04b tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: aaad7d1f-3566-45a0-afd7-7942188143f3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:15.879458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-5fc39e20-07b5-4116-940c-e8e0452f53c9 req-5ca8141e-5356-4a1a-bdee-36f66853c6d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaad7d1f-3566-45a0-afd7-7942188143f3", "name": "network-vif-deleted", "tag": "e8f04c96-bb47-476c-a1d3-05158796d3eb"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:44:15.882169 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39b7960f-fb39-4f4a-a4c4-930e2af0c04b tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:15.882712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39b7960f-fb39-4f4a-a4c4-930e2af0c04b tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:15.883104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39b7960f-fb39-4f4a-a4c4-930e2af0c04b tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:15.890158 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39b7960f-fb39-4f4a-a4c4-930e2af0c04b tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:15.891080 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39b7960f-fb39-4f4a-a4c4-930e2af0c04b tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:15.893134 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5fc39e20-07b5-4116-940c-e8e0452f53c9 req-5ca8141e-5356-4a1a-bdee-36f66853c6d1 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:15.893572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5fc39e20-07b5-4116-940c-e8e0452f53c9 req-5ca8141e-5356-4a1a-bdee-36f66853c6d1 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:15.894288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5fc39e20-07b5-4116-940c-e8e0452f53c9 req-5ca8141e-5356-4a1a-bdee-36f66853c6d1 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:15.901913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-39b7960f-fb39-4f4a-a4c4-930e2af0c04b tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:15.922570 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-5fc39e20-07b5-4116-940c-e8e0452f53c9 req-5ca8141e-5356-4a1a-bdee-36f66853c6d1 service nova] Creating event network-vif-deleted:e8f04c96-bb47-476c-a1d3-05158796d3eb for instance aaad7d1f-3566-45a0-afd7-7942188143f3 on n-h2-852087-9 Sep 07 13:44:15.929722 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-5fc39e20-07b5-4116-940c-e8e0452f53c9 req-5ca8141e-5356-4a1a-bdee-36f66853c6d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073835 Sep 07 13:44:15.930329 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3639/7250] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:44:15.980619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-39b7960f-fb39-4f4a-a4c4-930e2af0c04b tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:15.995482 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-39b7960f-fb39-4f4a-a4c4-930e2af0c04b tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3" status: 200 len: 1470 microversion: 2.1 time: 0.125121 Sep 07 13:44:15.996800 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3612/7251] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:15 2022] GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3 => generated 1470 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:44:17.022245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-98eadb6e-4b68-4661-aacd-4fd7daae5545 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:17.022979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-98eadb6e-4b68-4661-aacd-4fd7daae5545 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: aaad7d1f-3566-45a0-afd7-7942188143f3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:17.029446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98eadb6e-4b68-4661-aacd-4fd7daae5545 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:17.030075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98eadb6e-4b68-4661-aacd-4fd7daae5545 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:17.030527 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98eadb6e-4b68-4661-aacd-4fd7daae5545 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:17.031228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98eadb6e-4b68-4661-aacd-4fd7daae5545 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:17.031693 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98eadb6e-4b68-4661-aacd-4fd7daae5545 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:17.032132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98eadb6e-4b68-4661-aacd-4fd7daae5545 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:17.046450 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-98eadb6e-4b68-4661-aacd-4fd7daae5545 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] HTTP exception thrown: Instance aaad7d1f-3566-45a0-afd7-7942188143f3 could not be found. Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-98eadb6e-4b68-4661-aacd-4fd7daae5545 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Request method failure captured: Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3 HTTP/1.1 Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGKAUdGs-hxkPP1dwHSd-0iWfJEyVVrZc5nhENFMGAgw5OC7iBbDozErdc4X3Lck4ENAyK95-hWFEbwbcIUKa-daJw4sYExuaCHLRHfmgkVrg58yfU-VntZ757zx6oYMomHMSm23FO9Bjby7rFjxnxhr98vvyAu4RkKd4RPSEf25VeSU Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: da99501eff90453cacf4f3dccc3d7f30 Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-230176667 Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-230176667 Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: da99501eff90453cacf4f3dccc3d7f30 Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-230176667 Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-230176667-project Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 85b071691062474cac2372d5123821ed Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-230176667-project Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance aaad7d1f-3566-45a0-afd7-7942188143f3 could not be found. Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'aaad7d1f-3566-45a0-afd7-7942188143f3'} Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaad7d1f-3566-45a0-afd7-7942188143f3 could not be found. Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaad7d1f-3566-45a0-afd7-7942188143f3 could not be found. Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:44:17.048150 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:44:17.052909 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:44:17.052909 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:44:17.052909 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:44:17.052909 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:44:17.052909 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:44:17.052909 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaad7d1f-3566-45a0-afd7-7942188143f3 could not be found. Sep 07 13:44:17.052909 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:44:17.052909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-98eadb6e-4b68-4661-aacd-4fd7daae5545 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Returning 404 to user: Instance aaad7d1f-3566-45a0-afd7-7942188143f3 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:44:17.052909 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-98eadb6e-4b68-4661-aacd-4fd7daae5545 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3" status: 404 len: 111 microversion: 2.1 time: 0.032608 Sep 07 13:44:17.052909 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3640/7252] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:17 2022] GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:44:17.062314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a5df7086-a184-4bd5-9fff-a479f58bf99f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:17.062939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a5df7086-a184-4bd5-9fff-a479f58bf99f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: d735a139-2335-4fa4-844a-fec9e661d274] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:17.070287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5df7086-a184-4bd5-9fff-a479f58bf99f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:17.070756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5df7086-a184-4bd5-9fff-a479f58bf99f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:17.071222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5df7086-a184-4bd5-9fff-a479f58bf99f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:17.071917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5df7086-a184-4bd5-9fff-a479f58bf99f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:17.072377 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5df7086-a184-4bd5-9fff-a479f58bf99f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:17.072807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a5df7086-a184-4bd5-9fff-a479f58bf99f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:17.225968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a5df7086-a184-4bd5-9fff-a479f58bf99f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:17.237149 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a5df7086-a184-4bd5-9fff-a479f58bf99f tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274" status: 200 len: 1507 microversion: 2.1 time: 0.180509 Sep 07 13:44:17.237825 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3613/7253] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:17 2022] GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274 => generated 1507 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:17.266535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7f7354f2-f7df-40cf-97f1-76099f2cbf1c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:44:17.269948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7f7354f2-f7df-40cf-97f1-76099f2cbf1c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: 2e049137-df5c-4b4f-8965-1143c6b1a7f8] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:17.277535 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-7f7354f2-f7df-40cf-97f1-76099f2cbf1c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] HTTP exception thrown: Instance 2e049137-df5c-4b4f-8965-1143c6b1a7f8 could not be found. Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7f7354f2-f7df-40cf-97f1-76099f2cbf1c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Request method failure captured: Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/2e049137-df5c-4b4f-8965-1143c6b1a7f8/action HTTP/1.1 Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 32 Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGKAUdGs-hxkPP1dwHSd-0iWfJEyVVrZc5nhENFMGAgw5OC7iBbDozErdc4X3Lck4ENAyK95-hWFEbwbcIUKa-daJw4sYExuaCHLRHfmgkVrg58yfU-VntZ757zx6oYMomHMSm23FO9Bjby7rFjxnxhr98vvyAu4RkKd4RPSEf25VeSU Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: da99501eff90453cacf4f3dccc3d7f30 Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-230176667 Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-230176667 Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: da99501eff90453cacf4f3dccc3d7f30 Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-230176667 Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-230176667-project Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 85b071691062474cac2372d5123821ed Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-230176667-project Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: {"resize": {"flavorRef": "452"}} Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 2e049137-df5c-4b4f-8965-1143c6b1a7f8 could not be found. Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '2e049137-df5c-4b4f-8965-1143c6b1a7f8', 'body': {'resize': {'flavorRef': '452'}}} Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e049137-df5c-4b4f-8965-1143c6b1a7f8 could not be found. Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:44:17.279125 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:44:17.283389 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e049137-df5c-4b4f-8965-1143c6b1a7f8 could not be found. Sep 07 13:44:17.283389 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:44:17.283389 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:44:17.283389 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:44:17.283389 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:44:17.283389 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:44:17.283389 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:44:17.283389 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:44:17.283389 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:44:17.283389 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e049137-df5c-4b4f-8965-1143c6b1a7f8 could not be found. Sep 07 13:44:17.283389 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:44:17.283389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7f7354f2-f7df-40cf-97f1-76099f2cbf1c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Returning 404 to user: Instance 2e049137-df5c-4b4f-8965-1143c6b1a7f8 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:44:17.283389 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7f7354f2-f7df-40cf-97f1-76099f2cbf1c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "POST /compute/v2.1/servers/2e049137-df5c-4b4f-8965-1143c6b1a7f8/action" status: 404 len: 111 microversion: 2.1 time: 0.020629 Sep 07 13:44:17.283389 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3641/7254] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:44:17 2022] POST /compute/v2.1/servers/2e049137-df5c-4b4f-8965-1143c6b1a7f8/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:44:17.289517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ed7a1e12-5802-4c3a-af6a-1566eac8eeca tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:17.290164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ed7a1e12-5802-4c3a-af6a-1566eac8eeca tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: d735a139-2335-4fa4-844a-fec9e661d274] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:17.296414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed7a1e12-5802-4c3a-af6a-1566eac8eeca tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:17.296903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed7a1e12-5802-4c3a-af6a-1566eac8eeca tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:17.297347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed7a1e12-5802-4c3a-af6a-1566eac8eeca tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:17.298091 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed7a1e12-5802-4c3a-af6a-1566eac8eeca tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:17.298553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed7a1e12-5802-4c3a-af6a-1566eac8eeca tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:17.298980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ed7a1e12-5802-4c3a-af6a-1566eac8eeca tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:17.303101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:44:17.445954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ed7a1e12-5802-4c3a-af6a-1566eac8eeca tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:17.454391 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ed7a1e12-5802-4c3a-af6a-1566eac8eeca tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274" status: 200 len: 1507 microversion: 2.1 time: 0.168832 Sep 07 13:44:17.454982 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3614/7255] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:17 2022] GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:17.477957 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-01684825-2ebc-4623-b604-02f7efab8088 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:17.478590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-01684825-2ebc-4623-b604-02f7efab8088 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: d735a139-2335-4fa4-844a-fec9e661d274] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:17.485886 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01684825-2ebc-4623-b604-02f7efab8088 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:17.486403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01684825-2ebc-4623-b604-02f7efab8088 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:17.486859 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01684825-2ebc-4623-b604-02f7efab8088 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:17.487582 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01684825-2ebc-4623-b604-02f7efab8088 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:17.488063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01684825-2ebc-4623-b604-02f7efab8088 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:17.488509 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-01684825-2ebc-4623-b604-02f7efab8088 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:17.630865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-01684825-2ebc-4623-b604-02f7efab8088 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:17.638883 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-01684825-2ebc-4623-b604-02f7efab8088 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274" status: 200 len: 1507 microversion: 2.1 time: 0.164827 Sep 07 13:44:17.639495 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3642/7256] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:17 2022] GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:17.661639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-79103bb1-f067-4ea7-bda5-f0c29c53b2d1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "ad09d7b6-465e-4c56-8091-421bfe6e66b7"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:44:17.664029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-79103bb1-f067-4ea7-bda5-f0c29c53b2d1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: d735a139-2335-4fa4-844a-fec9e661d274] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:17.670302 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79103bb1-f067-4ea7-bda5-f0c29c53b2d1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:17.670852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79103bb1-f067-4ea7-bda5-f0c29c53b2d1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:17.671316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79103bb1-f067-4ea7-bda5-f0c29c53b2d1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:17.672028 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79103bb1-f067-4ea7-bda5-f0c29c53b2d1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:17.672520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79103bb1-f067-4ea7-bda5-f0c29c53b2d1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:17.672955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79103bb1-f067-4ea7-bda5-f0c29c53b2d1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:17.720296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-79103bb1-f067-4ea7-bda5-f0c29c53b2d1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:17.726411 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-79103bb1-f067-4ea7-bda5-f0c29c53b2d1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] HTTP exception thrown: Flavor ad09d7b6-465e-4c56-8091-421bfe6e66b7 could not be found. Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-79103bb1-f067-4ea7-bda5-f0c29c53b2d1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Request method failure captured: Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: request: POST /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274/action HTTP/1.1 Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 65 Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGKAUdGs-hxkPP1dwHSd-0iWfJEyVVrZc5nhENFMGAgw5OC7iBbDozErdc4X3Lck4ENAyK95-hWFEbwbcIUKa-daJw4sYExuaCHLRHfmgkVrg58yfU-VntZ757zx6oYMomHMSm23FO9Bjby7rFjxnxhr98vvyAu4RkKd4RPSEf25VeSU Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: da99501eff90453cacf4f3dccc3d7f30 Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-230176667 Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-230176667 Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: da99501eff90453cacf4f3dccc3d7f30 Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-230176667 Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-230176667-project Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 85b071691062474cac2372d5123821ed Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-230176667-project Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: {"resize": {"flavorRef": "ad09d7b6-465e-4c56-8091-421bfe6e66b7"}} Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: exception: Flavor ad09d7b6-465e-4c56-8091-421bfe6e66b7 could not be found. Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'd735a139-2335-4fa4-844a-fec9e661d274', 'body': {'resize': {'flavorRef': 'ad09d7b6-465e-4c56-8091-421bfe6e66b7'}}} Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:44:17.744563 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor ad09d7b6-465e-4c56-8091-421bfe6e66b7 could not be found. Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor ad09d7b6-465e-4c56-8091-421bfe6e66b7 could not be found. Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor ad09d7b6-465e-4c56-8091-421bfe6e66b7 could not be found. Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-79103bb1-f067-4ea7-bda5-f0c29c53b2d1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Returning 400 to user: Flavor ad09d7b6-465e-4c56-8091-421bfe6e66b7 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-79103bb1-f067-4ea7-bda5-f0c29c53b2d1 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "POST /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274/action" status: 400 len: 107 microversion: 2.1 time: 0.088590 Sep 07 13:44:17.749176 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3615/7257] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:44:17 2022] POST /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274/action => generated 107 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:44:17.756758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4c967a48-51af-4019-95ce-e7a081f8c844 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:17.757434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4c967a48-51af-4019-95ce-e7a081f8c844 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: d735a139-2335-4fa4-844a-fec9e661d274] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:17.765757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c967a48-51af-4019-95ce-e7a081f8c844 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:17.766245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c967a48-51af-4019-95ce-e7a081f8c844 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:17.766728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c967a48-51af-4019-95ce-e7a081f8c844 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:17.767457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c967a48-51af-4019-95ce-e7a081f8c844 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:17.767903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c967a48-51af-4019-95ce-e7a081f8c844 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:17.768351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4c967a48-51af-4019-95ce-e7a081f8c844 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:17.927000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4c967a48-51af-4019-95ce-e7a081f8c844 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:17.938148 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4c967a48-51af-4019-95ce-e7a081f8c844 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274" status: 200 len: 1507 microversion: 2.1 time: 0.184910 Sep 07 13:44:17.938345 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3643/7258] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:17 2022] GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274 => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:17.961714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fed87a42-a47e-40f1-848f-f4526447a385 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:17.962337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fed87a42-a47e-40f1-848f-f4526447a385 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: d735a139-2335-4fa4-844a-fec9e661d274] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:17.969029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fed87a42-a47e-40f1-848f-f4526447a385 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:17.969451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fed87a42-a47e-40f1-848f-f4526447a385 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:17.969923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fed87a42-a47e-40f1-848f-f4526447a385 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:17.970618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fed87a42-a47e-40f1-848f-f4526447a385 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:17.971089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fed87a42-a47e-40f1-848f-f4526447a385 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:17.971516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fed87a42-a47e-40f1-848f-f4526447a385 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:18.111875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fed87a42-a47e-40f1-848f-f4526447a385 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:18.124416 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fed87a42-a47e-40f1-848f-f4526447a385 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274" status: 200 len: 1507 microversion: 2.1 time: 0.166461 Sep 07 13:44:18.125233 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3616/7259] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:17 2022] GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:18.151927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-23b465b7-2f95-4dd4-a5e6-1e5536d041c5 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-23b465b7-2f95-4dd4-a5e6-1e5536d041c5 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Request method failure captured: Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: request: POST /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274/action HTTP/1.1 Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 29 Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGKAUdGs-hxkPP1dwHSd-0iWfJEyVVrZc5nhENFMGAgw5OC7iBbDozErdc4X3Lck4ENAyK95-hWFEbwbcIUKa-daJw4sYExuaCHLRHfmgkVrg58yfU-VntZ757zx6oYMomHMSm23FO9Bjby7rFjxnxhr98vvyAu4RkKd4RPSEf25VeSU Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: da99501eff90453cacf4f3dccc3d7f30 Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-230176667 Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-230176667 Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: da99501eff90453cacf4f3dccc3d7f30 Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-230176667 Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-230176667-project Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 85b071691062474cac2372d5123821ed Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-230176667-project Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: {"resize": {"flavorRef": ""}} Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'd735a139-2335-4fa4-844a-fec9e661d274', 'body': {'resize': {'flavorRef': ''}}} Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise error Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi On instance['resize']: Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi '' Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:44:18.156373 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:44:18.165751 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:44:18.165751 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:44:18.165751 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:44:18.165751 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:44:18.165751 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 13:44:18.165751 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 13:44:18.165751 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 07 13:44:18.165751 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:44:18.165751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-23b465b7-2f95-4dd4-a5e6-1e5536d041c5 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:44:18.165751 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-23b465b7-2f95-4dd4-a5e6-1e5536d041c5 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "POST /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274/action" status: 400 len: 113 microversion: 2.1 time: 0.009297 Sep 07 13:44:18.165751 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3644/7260] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:44:18 2022] POST /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 13:44:18.166529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bdedf810-fd24-403e-9f29-6e12e046903d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:18.166928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bdedf810-fd24-403e-9f29-6e12e046903d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: d735a139-2335-4fa4-844a-fec9e661d274] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:18.173319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdedf810-fd24-403e-9f29-6e12e046903d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:18.173848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdedf810-fd24-403e-9f29-6e12e046903d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:18.174298 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdedf810-fd24-403e-9f29-6e12e046903d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:18.174994 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdedf810-fd24-403e-9f29-6e12e046903d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:18.175454 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdedf810-fd24-403e-9f29-6e12e046903d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:18.175880 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdedf810-fd24-403e-9f29-6e12e046903d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:18.312405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bdedf810-fd24-403e-9f29-6e12e046903d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:18.324271 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bdedf810-fd24-403e-9f29-6e12e046903d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274" status: 200 len: 1507 microversion: 2.1 time: 0.161716 Sep 07 13:44:18.325110 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3617/7261] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:18 2022] GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:18.357620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f5e8688d-37c9-43c3-a36c-bb0ef6e3547c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:18.358355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f5e8688d-37c9-43c3-a36c-bb0ef6e3547c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: aaad7d1f-3566-45a0-afd7-7942188143f3] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:18.368269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5e8688d-37c9-43c3-a36c-bb0ef6e3547c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:18.368776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5e8688d-37c9-43c3-a36c-bb0ef6e3547c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:18.369226 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5e8688d-37c9-43c3-a36c-bb0ef6e3547c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:18.370012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5e8688d-37c9-43c3-a36c-bb0ef6e3547c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:18.370460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5e8688d-37c9-43c3-a36c-bb0ef6e3547c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:18.370905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f5e8688d-37c9-43c3-a36c-bb0ef6e3547c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:18.385840 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-f5e8688d-37c9-43c3-a36c-bb0ef6e3547c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] HTTP exception thrown: Instance aaad7d1f-3566-45a0-afd7-7942188143f3 could not be found. Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f5e8688d-37c9-43c3-a36c-bb0ef6e3547c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Request method failure captured: Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3 HTTP/1.1 Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGKAUdGs-hxkPP1dwHSd-0iWfJEyVVrZc5nhENFMGAgw5OC7iBbDozErdc4X3Lck4ENAyK95-hWFEbwbcIUKa-daJw4sYExuaCHLRHfmgkVrg58yfU-VntZ757zx6oYMomHMSm23FO9Bjby7rFjxnxhr98vvyAu4RkKd4RPSEf25VeSU Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: da99501eff90453cacf4f3dccc3d7f30 Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-ServersNegativeTestJSON-230176667 Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-ServersNegativeTestJSON-230176667 Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: da99501eff90453cacf4f3dccc3d7f30 Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-230176667 Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-ServersNegativeTestJSON-230176667-project Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 85b071691062474cac2372d5123821ed Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-ServersNegativeTestJSON-230176667-project Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance aaad7d1f-3566-45a0-afd7-7942188143f3 could not be found. Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'aaad7d1f-3566-45a0-afd7-7942188143f3'} Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaad7d1f-3566-45a0-afd7-7942188143f3 could not be found. Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:44:18.387467 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:44:18.392738 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaad7d1f-3566-45a0-afd7-7942188143f3 could not be found. Sep 07 13:44:18.392738 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:44:18.392738 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:44:18.392738 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:44:18.392738 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:44:18.392738 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:44:18.392738 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:44:18.392738 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:44:18.392738 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:44:18.392738 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaad7d1f-3566-45a0-afd7-7942188143f3 could not be found. Sep 07 13:44:18.392738 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:44:18.392738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f5e8688d-37c9-43c3-a36c-bb0ef6e3547c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Returning 404 to user: Instance aaad7d1f-3566-45a0-afd7-7942188143f3 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:44:18.392738 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f5e8688d-37c9-43c3-a36c-bb0ef6e3547c tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3" status: 404 len: 111 microversion: 2.1 time: 0.036889 Sep 07 13:44:18.392738 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3645/7262] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:44:18 2022] DELETE /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:44:18.401325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-24ec46bb-eacf-498b-a65f-cd457d638781 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:18.402066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-24ec46bb-eacf-498b-a65f-cd457d638781 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: aaad7d1f-3566-45a0-afd7-7942188143f3] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:18.408796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24ec46bb-eacf-498b-a65f-cd457d638781 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:18.409292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24ec46bb-eacf-498b-a65f-cd457d638781 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:18.409792 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24ec46bb-eacf-498b-a65f-cd457d638781 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:18.410504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24ec46bb-eacf-498b-a65f-cd457d638781 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:18.410957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24ec46bb-eacf-498b-a65f-cd457d638781 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:18.411386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-24ec46bb-eacf-498b-a65f-cd457d638781 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:18.425907 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-24ec46bb-eacf-498b-a65f-cd457d638781 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] HTTP exception thrown: Instance aaad7d1f-3566-45a0-afd7-7942188143f3 could not be found. Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-24ec46bb-eacf-498b-a65f-cd457d638781 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Request method failure captured: Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3 HTTP/1.1 Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGKAUdGs-hxkPP1dwHSd-0iWfJEyVVrZc5nhENFMGAgw5OC7iBbDozErdc4X3Lck4ENAyK95-hWFEbwbcIUKa-daJw4sYExuaCHLRHfmgkVrg58yfU-VntZ757zx6oYMomHMSm23FO9Bjby7rFjxnxhr98vvyAu4RkKd4RPSEf25VeSU Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: da99501eff90453cacf4f3dccc3d7f30 Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-230176667 Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-230176667 Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: da99501eff90453cacf4f3dccc3d7f30 Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-230176667 Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-230176667-project Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 85b071691062474cac2372d5123821ed Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-230176667-project Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance aaad7d1f-3566-45a0-afd7-7942188143f3 could not be found. Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'aaad7d1f-3566-45a0-afd7-7942188143f3'} Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaad7d1f-3566-45a0-afd7-7942188143f3 could not be found. Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaad7d1f-3566-45a0-afd7-7942188143f3 could not be found. Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:44:18.427474 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:44:18.432113 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:44:18.432113 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:44:18.432113 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:44:18.432113 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:44:18.432113 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:44:18.432113 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaad7d1f-3566-45a0-afd7-7942188143f3 could not be found. Sep 07 13:44:18.432113 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:44:18.432113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-24ec46bb-eacf-498b-a65f-cd457d638781 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Returning 404 to user: Instance aaad7d1f-3566-45a0-afd7-7942188143f3 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:44:18.432113 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-24ec46bb-eacf-498b-a65f-cd457d638781 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3" status: 404 len: 111 microversion: 2.1 time: 0.033662 Sep 07 13:44:18.432113 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3618/7263] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:18 2022] GET /compute/v2.1/servers/aaad7d1f-3566-45a0-afd7-7942188143f3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:44:18.437961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5a0d3882-d6f6-4b82-b184-01f282c4bb81 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:18.438530 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5a0d3882-d6f6-4b82-b184-01f282c4bb81 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: d735a139-2335-4fa4-844a-fec9e661d274] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:18.445105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a0d3882-d6f6-4b82-b184-01f282c4bb81 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:18.445649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a0d3882-d6f6-4b82-b184-01f282c4bb81 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:18.446149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a0d3882-d6f6-4b82-b184-01f282c4bb81 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:18.446871 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a0d3882-d6f6-4b82-b184-01f282c4bb81 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:18.447785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a0d3882-d6f6-4b82-b184-01f282c4bb81 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:18.447785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5a0d3882-d6f6-4b82-b184-01f282c4bb81 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:18.475833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5a0d3882-d6f6-4b82-b184-01f282c4bb81 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: d735a139-2335-4fa4-844a-fec9e661d274] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:44:18.531341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:44:18.568686 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5a0d3882-d6f6-4b82-b184-01f282c4bb81 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274" status: 204 len: 0 microversion: 2.1 time: 0.134499 Sep 07 13:44:18.570181 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3646/7264] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:44:18 2022] DELETE /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:44:18.578139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ecd1e484-c233-4eba-bc8c-ed0d0ee8d2d5 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:18.578757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ecd1e484-c233-4eba-bc8c-ed0d0ee8d2d5 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: d735a139-2335-4fa4-844a-fec9e661d274] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:18.585063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecd1e484-c233-4eba-bc8c-ed0d0ee8d2d5 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:18.585574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecd1e484-c233-4eba-bc8c-ed0d0ee8d2d5 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:18.586010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecd1e484-c233-4eba-bc8c-ed0d0ee8d2d5 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:18.586708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecd1e484-c233-4eba-bc8c-ed0d0ee8d2d5 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:18.587161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecd1e484-c233-4eba-bc8c-ed0d0ee8d2d5 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:18.587580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ecd1e484-c233-4eba-bc8c-ed0d0ee8d2d5 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:18.733683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ecd1e484-c233-4eba-bc8c-ed0d0ee8d2d5 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:18.742203 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ecd1e484-c233-4eba-bc8c-ed0d0ee8d2d5 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274" status: 200 len: 1513 microversion: 2.1 time: 0.167928 Sep 07 13:44:18.742766 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3619/7265] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:18 2022] GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:19.766982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1a07a609-0b8e-483f-af9f-3c979c4ea14d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:19.767757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1a07a609-0b8e-483f-af9f-3c979c4ea14d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: d735a139-2335-4fa4-844a-fec9e661d274] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:19.770698 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:44:19.776396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a07a609-0b8e-483f-af9f-3c979c4ea14d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:19.776911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a07a609-0b8e-483f-af9f-3c979c4ea14d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:19.777371 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a07a609-0b8e-483f-af9f-3c979c4ea14d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:19.778119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a07a609-0b8e-483f-af9f-3c979c4ea14d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:19.778586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a07a609-0b8e-483f-af9f-3c979c4ea14d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:19.779047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a07a609-0b8e-483f-af9f-3c979c4ea14d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:19.921875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1a07a609-0b8e-483f-af9f-3c979c4ea14d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:19.930164 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1a07a609-0b8e-483f-af9f-3c979c4ea14d tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274" status: 200 len: 1513 microversion: 2.1 time: 0.167587 Sep 07 13:44:19.930769 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3647/7266] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:19 2022] GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:20.640420 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-b075daff-c936-469e-b8da-00f7baa51143 req-71e46514-172b-42dd-8e98-feeb785087b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d735a139-2335-4fa4-844a-fec9e661d274", "name": "network-vif-deleted", "tag": "b8c72d00-ce9c-4953-963b-4c2d13f8e16d"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:44:20.649990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:44:20.654905 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b075daff-c936-469e-b8da-00f7baa51143 req-71e46514-172b-42dd-8e98-feeb785087b7 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:20.655584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b075daff-c936-469e-b8da-00f7baa51143 req-71e46514-172b-42dd-8e98-feeb785087b7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:20.656010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-b075daff-c936-469e-b8da-00f7baa51143 req-71e46514-172b-42dd-8e98-feeb785087b7 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:20.669851 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-b075daff-c936-469e-b8da-00f7baa51143 req-71e46514-172b-42dd-8e98-feeb785087b7 service nova] Creating event network-vif-deleted:b8c72d00-ce9c-4953-963b-4c2d13f8e16d for instance d735a139-2335-4fa4-844a-fec9e661d274 on n-h1-852087-9 Sep 07 13:44:20.675991 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-b075daff-c936-469e-b8da-00f7baa51143 req-71e46514-172b-42dd-8e98-feeb785087b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039569 Sep 07 13:44:20.677526 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3620/7267] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:44:20.953925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a9c65b0b-6a54-433e-9077-053e56aa4799 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:20.954547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a9c65b0b-6a54-433e-9077-053e56aa4799 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: d735a139-2335-4fa4-844a-fec9e661d274] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:20.961940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9c65b0b-6a54-433e-9077-053e56aa4799 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:20.962377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9c65b0b-6a54-433e-9077-053e56aa4799 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:20.962833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9c65b0b-6a54-433e-9077-053e56aa4799 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:20.963552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9c65b0b-6a54-433e-9077-053e56aa4799 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:20.964027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9c65b0b-6a54-433e-9077-053e56aa4799 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:20.964467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9c65b0b-6a54-433e-9077-053e56aa4799 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:20.999010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9c65b0b-6a54-433e-9077-053e56aa4799 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:20.999522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9c65b0b-6a54-433e-9077-053e56aa4799 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:20.999980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9c65b0b-6a54-433e-9077-053e56aa4799 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:21.000446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-a9c65b0b-6a54-433e-9077-053e56aa4799 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lazy-loading 'fault' on Instance uuid d735a139-2335-4fa4-844a-fec9e661d274 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:44:21.052173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a9c65b0b-6a54-433e-9077-053e56aa4799 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b071691062474cac2372d5123821ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da99501eff90453cacf4f3dccc3d7f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:21.061302 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a9c65b0b-6a54-433e-9077-053e56aa4799 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274" status: 200 len: 1307 microversion: 2.1 time: 0.111372 Sep 07 13:44:21.061961 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3648/7268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:20 2022] GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274 => generated 1307 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:22.090228 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd537365-dd64-4e1a-ab23-7a21f3d27fc5 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:22.090927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dd537365-dd64-4e1a-ab23-7a21f3d27fc5 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] [instance: d735a139-2335-4fa4-844a-fec9e661d274] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:22.099675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd537365-dd64-4e1a-ab23-7a21f3d27fc5 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:22.100165 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd537365-dd64-4e1a-ab23-7a21f3d27fc5 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:22.100605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd537365-dd64-4e1a-ab23-7a21f3d27fc5 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:22.101306 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd537365-dd64-4e1a-ab23-7a21f3d27fc5 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:22.101785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd537365-dd64-4e1a-ab23-7a21f3d27fc5 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:22.102249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dd537365-dd64-4e1a-ab23-7a21f3d27fc5 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:22.117181 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-dd537365-dd64-4e1a-ab23-7a21f3d27fc5 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] HTTP exception thrown: Instance d735a139-2335-4fa4-844a-fec9e661d274 could not be found. Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd537365-dd64-4e1a-ab23-7a21f3d27fc5 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Request method failure captured: Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274 HTTP/1.1 Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGKAUdGs-hxkPP1dwHSd-0iWfJEyVVrZc5nhENFMGAgw5OC7iBbDozErdc4X3Lck4ENAyK95-hWFEbwbcIUKa-daJw4sYExuaCHLRHfmgkVrg58yfU-VntZ757zx6oYMomHMSm23FO9Bjby7rFjxnxhr98vvyAu4RkKd4RPSEf25VeSU Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: da99501eff90453cacf4f3dccc3d7f30 Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-ServersNegativeTestJSON-230176667 Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da99501eff90453cacf4f3dccc3d7f30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-ServersNegativeTestJSON-230176667 Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: da99501eff90453cacf4f3dccc3d7f30 Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-230176667 Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-ServersNegativeTestJSON-230176667-project Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 85b071691062474cac2372d5123821ed Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-ServersNegativeTestJSON-230176667-project Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance d735a139-2335-4fa4-844a-fec9e661d274 could not be found. Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'd735a139-2335-4fa4-844a-fec9e661d274'} Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d735a139-2335-4fa4-844a-fec9e661d274 could not be found. Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d735a139-2335-4fa4-844a-fec9e661d274 could not be found. Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:44:22.118903 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:44:22.123289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:44:22.123289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:44:22.123289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:44:22.123289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:44:22.123289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:44:22.123289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d735a139-2335-4fa4-844a-fec9e661d274 could not be found. Sep 07 13:44:22.123289 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:44:22.123289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dd537365-dd64-4e1a-ab23-7a21f3d27fc5 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] Returning 404 to user: Instance d735a139-2335-4fa4-844a-fec9e661d274 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:44:22.123289 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dd537365-dd64-4e1a-ab23-7a21f3d27fc5 tempest-ServersNegativeTestJSON-230176667 tempest-ServersNegativeTestJSON-230176667-project] 10.222.0.16 "GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274" status: 404 len: 111 microversion: 2.1 time: 0.034883 Sep 07 13:44:22.123289 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3621/7269] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:22 2022] GET /compute/v2.1/servers/d735a139-2335-4fa4-844a-fec9e661d274 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:44:55.675015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=5 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:44:55.676182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:44:55.860748 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a2737269-413c-469b-b33c-f6a30ce865e0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Action: 'create', calling method: .version_select at 0x7fc418364f70>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-469036485", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKCkGCSxGGZZs8JsVQiZsh0S0H0Jbs8SaNcFW6Yy+h4LhaQhqaNrjRdFbRmNB0FtQiAYQbdBANXDT+roOpn6zhvREYgKlTkP1o5VH9imSqH+QpB0xWVoEtzZ2nnVGNEDQ=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:44:55.877170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-a2737269-413c-469b-b33c-f6a30ce865e0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Getting quotas for project 3b7b7de7cf224f9b8559751e8a6c6555. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:44:55.883442 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-a2737269-413c-469b-b33c-f6a30ce865e0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Getting quotas for user 4ccc18c9647148fdb48f35a6dc9c5fe5 and project 3b7b7de7cf224f9b8559751e8a6c6555. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:44:55.916311 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a2737269-413c-469b-b33c-f6a30ce865e0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.246329 Sep 07 13:44:55.917287 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3649/7270] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 13:44:55 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:44:55.994388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bb560ae2-dfe6-4922-8e5f-934cafefe7b6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-190269351", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-469036485", "networks": [{"uuid": "321cbe88-4fb4-4feb-b2e2-1b7f8ed3dfdd"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:44:56.010964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=32 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:44:56.011604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:44:56.061541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-bb560ae2-dfe6-4922-8e5f-934cafefe7b6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] validate_networks() for [('321cbe88-4fb4-4feb-b2e2-1b7f8ed3dfdd', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:44:56.527208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bb560ae2-dfe6-4922-8e5f-934cafefe7b6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:44:56.527980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bb560ae2-dfe6-4922-8e5f-934cafefe7b6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:44:56.528742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bb560ae2-dfe6-4922-8e5f-934cafefe7b6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:44:56.529303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bb560ae2-dfe6-4922-8e5f-934cafefe7b6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:44:56.529886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bb560ae2-dfe6-4922-8e5f-934cafefe7b6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:44:56.546104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb560ae2-dfe6-4922-8e5f-934cafefe7b6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:56.546681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb560ae2-dfe6-4922-8e5f-934cafefe7b6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:56.547316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb560ae2-dfe6-4922-8e5f-934cafefe7b6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:56.548110 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb560ae2-dfe6-4922-8e5f-934cafefe7b6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:56.548674 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb560ae2-dfe6-4922-8e5f-934cafefe7b6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:56.549171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bb560ae2-dfe6-4922-8e5f-934cafefe7b6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:56.586471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-bb560ae2-dfe6-4922-8e5f-934cafefe7b6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Getting quotas for project 3b7b7de7cf224f9b8559751e8a6c6555. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:44:56.593350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-bb560ae2-dfe6-4922-8e5f-934cafefe7b6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Getting quotas for user 4ccc18c9647148fdb48f35a6dc9c5fe5 and project 3b7b7de7cf224f9b8559751e8a6c6555. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:44:56.609337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bb560ae2-dfe6-4922-8e5f-934cafefe7b6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:44:56.611963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bb560ae2-dfe6-4922-8e5f-934cafefe7b6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: aab41a27-1504-4d5d-a2a1-18e34b7c2e34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:44:56.665792 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bb560ae2-dfe6-4922-8e5f-934cafefe7b6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.678331 Sep 07 13:44:56.666798 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3622/7271] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:44:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:44:56.678475 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e5a7ce19-c0b0-4c17-98af-30b7cd53627f tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:56.679227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e5a7ce19-c0b0-4c17-98af-30b7cd53627f tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: aab41a27-1504-4d5d-a2a1-18e34b7c2e34] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:56.751248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e5a7ce19-c0b0-4c17-98af-30b7cd53627f tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:56.761422 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e5a7ce19-c0b0-4c17-98af-30b7cd53627f tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34" status: 200 len: 1261 microversion: 2.1 time: 0.087106 Sep 07 13:44:56.762665 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3650/7272] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:56 2022] GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34 => generated 1261 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:44:57.785782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2df3f7ef-d8e9-4b62-a94b-fcea487cd497 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:57.786438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2df3f7ef-d8e9-4b62-a94b-fcea487cd497 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: aab41a27-1504-4d5d-a2a1-18e34b7c2e34] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:57.797924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2df3f7ef-d8e9-4b62-a94b-fcea487cd497 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:57.798424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2df3f7ef-d8e9-4b62-a94b-fcea487cd497 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:57.798871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2df3f7ef-d8e9-4b62-a94b-fcea487cd497 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:57.799595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2df3f7ef-d8e9-4b62-a94b-fcea487cd497 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:57.800070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2df3f7ef-d8e9-4b62-a94b-fcea487cd497 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:57.800506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2df3f7ef-d8e9-4b62-a94b-fcea487cd497 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:57.870794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2df3f7ef-d8e9-4b62-a94b-fcea487cd497 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:57.879920 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2df3f7ef-d8e9-4b62-a94b-fcea487cd497 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34" status: 200 len: 1313 microversion: 2.1 time: 0.098186 Sep 07 13:44:57.880503 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3623/7273] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:57 2022] GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34 => generated 1313 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:58.904272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7679685e-66b5-4029-9324-311339fcf8b8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:44:58.905606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7679685e-66b5-4029-9324-311339fcf8b8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: aab41a27-1504-4d5d-a2a1-18e34b7c2e34] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:44:58.916145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7679685e-66b5-4029-9324-311339fcf8b8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:58.917761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7679685e-66b5-4029-9324-311339fcf8b8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:58.918702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7679685e-66b5-4029-9324-311339fcf8b8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:58.920438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7679685e-66b5-4029-9324-311339fcf8b8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:58.921122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7679685e-66b5-4029-9324-311339fcf8b8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:58.921757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7679685e-66b5-4029-9324-311339fcf8b8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:59.085678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7679685e-66b5-4029-9324-311339fcf8b8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:44:59.097450 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7679685e-66b5-4029-9324-311339fcf8b8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34" status: 200 len: 1361 microversion: 2.1 time: 0.196963 Sep 07 13:44:59.100190 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3651/7274] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:44:58 2022] GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34 => generated 1361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:44:59.664760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-285feca6-d6a6-4c02-a440-ee7e68d2a6af req-12fdd1c9-6f35-4f7b-a577-c50432de6c39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab41a27-1504-4d5d-a2a1-18e34b7c2e34", "tag": "9f5dd993-7592-4464-bcea-35ec15efbb5a"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:44:59.681125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-285feca6-d6a6-4c02-a440-ee7e68d2a6af req-12fdd1c9-6f35-4f7b-a577-c50432de6c39 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:44:59.681869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-285feca6-d6a6-4c02-a440-ee7e68d2a6af req-12fdd1c9-6f35-4f7b-a577-c50432de6c39 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:44:59.682303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-285feca6-d6a6-4c02-a440-ee7e68d2a6af req-12fdd1c9-6f35-4f7b-a577-c50432de6c39 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:44:59.696508 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-285feca6-d6a6-4c02-a440-ee7e68d2a6af req-12fdd1c9-6f35-4f7b-a577-c50432de6c39 service nova] Creating event network-changed:9f5dd993-7592-4464-bcea-35ec15efbb5a for instance aab41a27-1504-4d5d-a2a1-18e34b7c2e34 on n-h2-852087-9 Sep 07 13:44:59.701614 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-285feca6-d6a6-4c02-a440-ee7e68d2a6af req-12fdd1c9-6f35-4f7b-a577-c50432de6c39 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045048 Sep 07 13:44:59.703171 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3624/7275] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:45:00.126282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a1e87f49-043f-4968-887e-23795646a11e tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:00.126923 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a1e87f49-043f-4968-887e-23795646a11e tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: aab41a27-1504-4d5d-a2a1-18e34b7c2e34] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:00.135347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1e87f49-043f-4968-887e-23795646a11e tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:00.136696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1e87f49-043f-4968-887e-23795646a11e tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:00.137216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1e87f49-043f-4968-887e-23795646a11e tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:00.138142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1e87f49-043f-4968-887e-23795646a11e tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:00.138605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1e87f49-043f-4968-887e-23795646a11e tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:00.139440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1e87f49-043f-4968-887e-23795646a11e tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:00.289192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a1e87f49-043f-4968-887e-23795646a11e tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:00.299969 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a1e87f49-043f-4968-887e-23795646a11e tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34" status: 200 len: 1361 microversion: 2.1 time: 0.178046 Sep 07 13:45:00.300569 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3652/7276] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:00 2022] GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:01.326069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eb749528-5c9c-4ef0-98e5-8b3c7d27a541 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:01.327397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eb749528-5c9c-4ef0-98e5-8b3c7d27a541 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: aab41a27-1504-4d5d-a2a1-18e34b7c2e34] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:01.335190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb749528-5c9c-4ef0-98e5-8b3c7d27a541 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:01.335984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb749528-5c9c-4ef0-98e5-8b3c7d27a541 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:01.336591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb749528-5c9c-4ef0-98e5-8b3c7d27a541 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:01.337451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb749528-5c9c-4ef0-98e5-8b3c7d27a541 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:01.338087 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb749528-5c9c-4ef0-98e5-8b3c7d27a541 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:01.338670 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb749528-5c9c-4ef0-98e5-8b3c7d27a541 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:01.517213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eb749528-5c9c-4ef0-98e5-8b3c7d27a541 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:01.525728 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eb749528-5c9c-4ef0-98e5-8b3c7d27a541 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34" status: 200 len: 1361 microversion: 2.1 time: 0.205762 Sep 07 13:45:01.526367 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3625/7277] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:01 2022] GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34 => generated 1361 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:02.548959 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-86c0eaab-8a99-4276-a613-dacabeb8c2a7 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:02.549611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-86c0eaab-8a99-4276-a613-dacabeb8c2a7 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: aab41a27-1504-4d5d-a2a1-18e34b7c2e34] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:02.556742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86c0eaab-8a99-4276-a613-dacabeb8c2a7 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:02.557237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86c0eaab-8a99-4276-a613-dacabeb8c2a7 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:02.557739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86c0eaab-8a99-4276-a613-dacabeb8c2a7 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:02.558465 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86c0eaab-8a99-4276-a613-dacabeb8c2a7 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:02.558920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86c0eaab-8a99-4276-a613-dacabeb8c2a7 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:02.559360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-86c0eaab-8a99-4276-a613-dacabeb8c2a7 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:02.696029 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-86c0eaab-8a99-4276-a613-dacabeb8c2a7 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:02.708694 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-86c0eaab-8a99-4276-a613-dacabeb8c2a7 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34" status: 200 len: 1361 microversion: 2.1 time: 0.163776 Sep 07 13:45:02.709312 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3653/7278] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:02 2022] GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:03.473660 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-83b6844a-393c-4779-8aa8-ff952df0bcb3 req-a713517a-6e6d-431a-98fc-687de13fe53b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab41a27-1504-4d5d-a2a1-18e34b7c2e34", "name": "network-vif-plugged", "status": "completed", "tag": "9f5dd993-7592-4464-bcea-35ec15efbb5a"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:45:03.484085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-83b6844a-393c-4779-8aa8-ff952df0bcb3 req-a713517a-6e6d-431a-98fc-687de13fe53b service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:03.485031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-83b6844a-393c-4779-8aa8-ff952df0bcb3 req-a713517a-6e6d-431a-98fc-687de13fe53b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:03.485031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-83b6844a-393c-4779-8aa8-ff952df0bcb3 req-a713517a-6e6d-431a-98fc-687de13fe53b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:03.497888 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-83b6844a-393c-4779-8aa8-ff952df0bcb3 req-a713517a-6e6d-431a-98fc-687de13fe53b service nova] Creating event network-vif-plugged:9f5dd993-7592-4464-bcea-35ec15efbb5a for instance aab41a27-1504-4d5d-a2a1-18e34b7c2e34 on n-h2-852087-9 Sep 07 13:45:03.503256 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-83b6844a-393c-4779-8aa8-ff952df0bcb3 req-a713517a-6e6d-431a-98fc-687de13fe53b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104655 Sep 07 13:45:03.504373 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3626/7279] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:45:03.735535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b0e5b5d7-0a3c-4f74-9153-a759f68dc006 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:03.736144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b0e5b5d7-0a3c-4f74-9153-a759f68dc006 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: aab41a27-1504-4d5d-a2a1-18e34b7c2e34] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:03.744491 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0e5b5d7-0a3c-4f74-9153-a759f68dc006 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:03.745000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0e5b5d7-0a3c-4f74-9153-a759f68dc006 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:03.745438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0e5b5d7-0a3c-4f74-9153-a759f68dc006 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:03.746214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0e5b5d7-0a3c-4f74-9153-a759f68dc006 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:03.746682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0e5b5d7-0a3c-4f74-9153-a759f68dc006 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:03.747123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b0e5b5d7-0a3c-4f74-9153-a759f68dc006 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:03.888995 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b0e5b5d7-0a3c-4f74-9153-a759f68dc006 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:03.897594 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b0e5b5d7-0a3c-4f74-9153-a759f68dc006 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34" status: 200 len: 1361 microversion: 2.1 time: 0.166498 Sep 07 13:45:03.898248 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3654/7280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:03 2022] GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:04.923618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a15c52b9-4ce9-422a-94f1-f2366b4a2d02 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:04.924321 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a15c52b9-4ce9-422a-94f1-f2366b4a2d02 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: aab41a27-1504-4d5d-a2a1-18e34b7c2e34] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:04.931025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a15c52b9-4ce9-422a-94f1-f2366b4a2d02 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:04.931515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a15c52b9-4ce9-422a-94f1-f2366b4a2d02 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:04.931957 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a15c52b9-4ce9-422a-94f1-f2366b4a2d02 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:04.932655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a15c52b9-4ce9-422a-94f1-f2366b4a2d02 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:04.933116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a15c52b9-4ce9-422a-94f1-f2366b4a2d02 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:04.933581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a15c52b9-4ce9-422a-94f1-f2366b4a2d02 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:05.068070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a15c52b9-4ce9-422a-94f1-f2366b4a2d02 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:05.079310 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a15c52b9-4ce9-422a-94f1-f2366b4a2d02 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34" status: 200 len: 1553 microversion: 2.1 time: 0.160887 Sep 07 13:45:05.079981 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3627/7281] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:04 2022] GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:05.106661 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-97fe4e16-763c-4ad8-9837-c464a1a7baf4 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:05.107291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-97fe4e16-763c-4ad8-9837-c464a1a7baf4 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: aab41a27-1504-4d5d-a2a1-18e34b7c2e34] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:05.114781 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97fe4e16-763c-4ad8-9837-c464a1a7baf4 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:05.115286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97fe4e16-763c-4ad8-9837-c464a1a7baf4 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:05.115737 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97fe4e16-763c-4ad8-9837-c464a1a7baf4 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:05.116449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97fe4e16-763c-4ad8-9837-c464a1a7baf4 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:05.116917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97fe4e16-763c-4ad8-9837-c464a1a7baf4 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:05.117357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-97fe4e16-763c-4ad8-9837-c464a1a7baf4 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:05.274316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-97fe4e16-763c-4ad8-9837-c464a1a7baf4 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:05.282480 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-97fe4e16-763c-4ad8-9837-c464a1a7baf4 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34" status: 200 len: 1553 microversion: 2.1 time: 0.179806 Sep 07 13:45:05.283061 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3655/7282] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:05 2022] GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34 => generated 1553 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:06.985426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-43948325-f7a0-490e-8e81-59026eb81dd3 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c059d687-8bcb-4074-80a8-99c56c1698b6"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:45:06.988671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-43948325-f7a0-490e-8e81-59026eb81dd3 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: aab41a27-1504-4d5d-a2a1-18e34b7c2e34] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:06.990926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:45:06.991720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:45:06.997871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43948325-f7a0-490e-8e81-59026eb81dd3 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:06.998362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43948325-f7a0-490e-8e81-59026eb81dd3 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:06.998804 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43948325-f7a0-490e-8e81-59026eb81dd3 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:06.999511 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43948325-f7a0-490e-8e81-59026eb81dd3 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:06.999967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43948325-f7a0-490e-8e81-59026eb81dd3 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:07.000393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43948325-f7a0-490e-8e81-59026eb81dd3 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:07.300503 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-43948325-f7a0-490e-8e81-59026eb81dd3 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "POST /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319291 Sep 07 13:45:07.301145 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3628/7283] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Sep 7 13:45:06 2022] POST /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:45:19.154694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2b24cb98-4f2f-4d2f-a5d3-aa35f49afc01 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:19.155322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2b24cb98-4f2f-4d2f-a5d3-aa35f49afc01 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: aab41a27-1504-4d5d-a2a1-18e34b7c2e34] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:19.157996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:45:19.158763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:45:19.159444 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=30 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:45:19.166191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b24cb98-4f2f-4d2f-a5d3-aa35f49afc01 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:19.166710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b24cb98-4f2f-4d2f-a5d3-aa35f49afc01 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:19.167166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b24cb98-4f2f-4d2f-a5d3-aa35f49afc01 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:19.167885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b24cb98-4f2f-4d2f-a5d3-aa35f49afc01 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:19.168353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b24cb98-4f2f-4d2f-a5d3-aa35f49afc01 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:19.168777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2b24cb98-4f2f-4d2f-a5d3-aa35f49afc01 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:19.260547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-2b24cb98-4f2f-4d2f-a5d3-aa35f49afc01 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lazy-loading 'services' on Instance uuid aab41a27-1504-4d5d-a2a1-18e34b7c2e34 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:45:19.340447 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2b24cb98-4f2f-4d2f-a5d3-aa35f49afc01 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34/os-volume_attachments/c059d687-8bcb-4074-80a8-99c56c1698b6" status: 202 len: 0 microversion: 2.1 time: 0.189767 Sep 07 13:45:19.341378 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3656/7284] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Sep 7 13:45:19 2022] DELETE /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34/os-volume_attachments/c059d687-8bcb-4074-80a8-99c56c1698b6 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:45:19.348212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:45:19.349114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:45:19.353760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d151661e-dc09-4938-9498-1d3d0be21fbc tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:19.356167 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d151661e-dc09-4938-9498-1d3d0be21fbc tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: aab41a27-1504-4d5d-a2a1-18e34b7c2e34] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:19.364095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d151661e-dc09-4938-9498-1d3d0be21fbc tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:19.364594 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d151661e-dc09-4938-9498-1d3d0be21fbc tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:19.365031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d151661e-dc09-4938-9498-1d3d0be21fbc tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:19.365766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d151661e-dc09-4938-9498-1d3d0be21fbc tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:19.366218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d151661e-dc09-4938-9498-1d3d0be21fbc tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:19.366651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d151661e-dc09-4938-9498-1d3d0be21fbc tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:19.405377 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d151661e-dc09-4938-9498-1d3d0be21fbc tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058901 Sep 07 13:45:19.406087 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3629/7285] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:45:19 2022] GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:45:20.421504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-062b9640-b105-41d5-8190-c9fad699ea06 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:20.424255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-062b9640-b105-41d5-8190-c9fad699ea06 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: aab41a27-1504-4d5d-a2a1-18e34b7c2e34] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:20.431803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062b9640-b105-41d5-8190-c9fad699ea06 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:20.432642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062b9640-b105-41d5-8190-c9fad699ea06 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:20.433083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062b9640-b105-41d5-8190-c9fad699ea06 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:20.433866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062b9640-b105-41d5-8190-c9fad699ea06 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:20.434338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062b9640-b105-41d5-8190-c9fad699ea06 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:20.434849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-062b9640-b105-41d5-8190-c9fad699ea06 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:20.468056 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-062b9640-b105-41d5-8190-c9fad699ea06 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053065 Sep 07 13:45:20.468647 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3657/7286] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:45:20 2022] GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:45:21.481806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2288192d-5f9d-42c6-ae5b-91821a38feca tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:21.484541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2288192d-5f9d-42c6-ae5b-91821a38feca tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: aab41a27-1504-4d5d-a2a1-18e34b7c2e34] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:21.492350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2288192d-5f9d-42c6-ae5b-91821a38feca tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:21.492844 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2288192d-5f9d-42c6-ae5b-91821a38feca tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:21.493251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2288192d-5f9d-42c6-ae5b-91821a38feca tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:21.494019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2288192d-5f9d-42c6-ae5b-91821a38feca tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:21.494450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2288192d-5f9d-42c6-ae5b-91821a38feca tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:21.494891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2288192d-5f9d-42c6-ae5b-91821a38feca tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:21.532403 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2288192d-5f9d-42c6-ae5b-91821a38feca tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054997 Sep 07 13:45:21.533049 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3630/7287] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:45:21 2022] GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:45:22.545804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-23cf6e68-8c6e-4395-a1a2-14d4faba26e0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:22.548270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-23cf6e68-8c6e-4395-a1a2-14d4faba26e0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: aab41a27-1504-4d5d-a2a1-18e34b7c2e34] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:22.555543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23cf6e68-8c6e-4395-a1a2-14d4faba26e0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:22.556072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23cf6e68-8c6e-4395-a1a2-14d4faba26e0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:22.556525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23cf6e68-8c6e-4395-a1a2-14d4faba26e0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:22.557304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23cf6e68-8c6e-4395-a1a2-14d4faba26e0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:22.557814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23cf6e68-8c6e-4395-a1a2-14d4faba26e0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:22.558265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-23cf6e68-8c6e-4395-a1a2-14d4faba26e0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:22.605422 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-23cf6e68-8c6e-4395-a1a2-14d4faba26e0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063851 Sep 07 13:45:22.606113 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3658/7288] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:45:22 2022] GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:45:23.619147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92e218a8-dee0-4499-bee2-7256b4518481 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:23.621583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-92e218a8-dee0-4499-bee2-7256b4518481 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: aab41a27-1504-4d5d-a2a1-18e34b7c2e34] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:23.629707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92e218a8-dee0-4499-bee2-7256b4518481 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:23.630214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92e218a8-dee0-4499-bee2-7256b4518481 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:23.630659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92e218a8-dee0-4499-bee2-7256b4518481 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:23.631414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92e218a8-dee0-4499-bee2-7256b4518481 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:23.631870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92e218a8-dee0-4499-bee2-7256b4518481 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:23.632297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92e218a8-dee0-4499-bee2-7256b4518481 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:23.670035 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-92e218a8-dee0-4499-bee2-7256b4518481 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055358 Sep 07 13:45:23.670686 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3631/7289] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:45:23 2022] GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:45:24.683178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8c7f0d65-9107-4ac5-a625-8145132e133a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:24.685459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8c7f0d65-9107-4ac5-a625-8145132e133a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: aab41a27-1504-4d5d-a2a1-18e34b7c2e34] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:24.693581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c7f0d65-9107-4ac5-a625-8145132e133a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:24.694267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c7f0d65-9107-4ac5-a625-8145132e133a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:24.694582 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c7f0d65-9107-4ac5-a625-8145132e133a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:24.695325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c7f0d65-9107-4ac5-a625-8145132e133a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:24.695794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c7f0d65-9107-4ac5-a625-8145132e133a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:24.696268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8c7f0d65-9107-4ac5-a625-8145132e133a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:24.729611 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8c7f0d65-9107-4ac5-a625-8145132e133a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050501 Sep 07 13:45:24.730217 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3659/7290] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:45:24 2022] GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:45:24.750128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5265c8d2-81e1-4a74-b9d5-e55ac21bebda tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:24.750918 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5265c8d2-81e1-4a74-b9d5-e55ac21bebda tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: aab41a27-1504-4d5d-a2a1-18e34b7c2e34] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:24.761643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5265c8d2-81e1-4a74-b9d5-e55ac21bebda tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:24.762141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5265c8d2-81e1-4a74-b9d5-e55ac21bebda tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:24.762583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5265c8d2-81e1-4a74-b9d5-e55ac21bebda tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:24.763296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5265c8d2-81e1-4a74-b9d5-e55ac21bebda tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:24.763745 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5265c8d2-81e1-4a74-b9d5-e55ac21bebda tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:24.764400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5265c8d2-81e1-4a74-b9d5-e55ac21bebda tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:24.840576 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-5265c8d2-81e1-4a74-b9d5-e55ac21bebda tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] HTTP exception thrown: Instance aab41a27-1504-4d5d-a2a1-18e34b7c2e34 is not attached to volume c059d687-8bcb-4074-80a8-99c56c1698b6 Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5265c8d2-81e1-4a74-b9d5-e55ac21bebda tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Request method failure captured: Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34/os-volume_attachments/c059d687-8bcb-4074-80a8-99c56c1698b6 HTTP/1.1 Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGKBSFJmMS5t4m5A1zpEXatjN-8sqdkAX0BvwBV9rjMCmd5ZlAL-kQHEsOKxznNZUjwOhR5X-XPWVjonNdNP5T8Bc9DXvkRlgxW51haEchMpTQZiwnOW3GpAoVuA0WBy16jDS5MK-XdXCN9nDVgwQ35cFrenHao1daiMQggsz4FbhgAM Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 3b7b7de7cf224f9b8559751e8a6c6555 Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TestEncryptedCinderVolumes-950169269 Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b7b7de7cf224f9b8559751e8a6c6555"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3b7b7de7cf224f9b8559751e8a6c6555"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3b7b7de7cf224f9b8559751e8a6c6555"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b7b7de7cf224f9b8559751e8a6c6555"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TestEncryptedCinderVolumes-950169269 Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 3b7b7de7cf224f9b8559751e8a6c6555 Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-950169269 Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TestEncryptedCinderVolumes-950169269-project Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 4ccc18c9647148fdb48f35a6dc9c5fe5 Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TestEncryptedCinderVolumes-950169269-project Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance aab41a27-1504-4d5d-a2a1-18e34b7c2e34 is not attached to volume c059d687-8bcb-4074-80a8-99c56c1698b6 Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'server_id': 'aab41a27-1504-4d5d-a2a1-18e34b7c2e34', 'id': 'c059d687-8bcb-4074-80a8-99c56c1698b6'} Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c059d687-8bcb-4074-80a8-99c56c1698b6. Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab41a27-1504-4d5d-a2a1-18e34b7c2e34 is not attached to volume c059d687-8bcb-4074-80a8-99c56c1698b6 Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:45:24.863433 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:45:24.867803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:45:24.867803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:45:24.867803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab41a27-1504-4d5d-a2a1-18e34b7c2e34 is not attached to volume c059d687-8bcb-4074-80a8-99c56c1698b6 Sep 07 13:45:24.867803 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:45:24.867803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5265c8d2-81e1-4a74-b9d5-e55ac21bebda tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Returning 404 to user: Instance aab41a27-1504-4d5d-a2a1-18e34b7c2e34 is not attached to volume c059d687-8bcb-4074-80a8-99c56c1698b6 {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:45:24.867803 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5265c8d2-81e1-4a74-b9d5-e55ac21bebda tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34/os-volume_attachments/c059d687-8bcb-4074-80a8-99c56c1698b6" status: 404 len: 154 microversion: 2.1 time: 0.122953 Sep 07 13:45:24.867803 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3632/7291] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Sep 7 13:45:24 2022] DELETE /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34/os-volume_attachments/c059d687-8bcb-4074-80a8-99c56c1698b6 => generated 154 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:45:28.233801 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b7f757df-b7a8-485e-b950-809cfc81af05 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:28.234500 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b7f757df-b7a8-485e-b950-809cfc81af05 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: aab41a27-1504-4d5d-a2a1-18e34b7c2e34] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:28.242695 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7f757df-b7a8-485e-b950-809cfc81af05 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:28.243205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7f757df-b7a8-485e-b950-809cfc81af05 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:28.243664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7f757df-b7a8-485e-b950-809cfc81af05 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:28.244381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7f757df-b7a8-485e-b950-809cfc81af05 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:28.244860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7f757df-b7a8-485e-b950-809cfc81af05 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:28.245306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7f757df-b7a8-485e-b950-809cfc81af05 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:28.272819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b7f757df-b7a8-485e-b950-809cfc81af05 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: aab41a27-1504-4d5d-a2a1-18e34b7c2e34] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:45:28.362419 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b7f757df-b7a8-485e-b950-809cfc81af05 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34" status: 204 len: 0 microversion: 2.1 time: 0.134389 Sep 07 13:45:28.363872 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3660/7292] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:45:28 2022] DELETE /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:45:28.372643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2865b429-da75-4e06-934a-8756c3bd5a11 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:28.373472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2865b429-da75-4e06-934a-8756c3bd5a11 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: aab41a27-1504-4d5d-a2a1-18e34b7c2e34] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:28.381122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2865b429-da75-4e06-934a-8756c3bd5a11 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:28.381681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2865b429-da75-4e06-934a-8756c3bd5a11 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:28.382147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2865b429-da75-4e06-934a-8756c3bd5a11 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:28.382852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2865b429-da75-4e06-934a-8756c3bd5a11 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:28.383300 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2865b429-da75-4e06-934a-8756c3bd5a11 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:28.383723 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2865b429-da75-4e06-934a-8756c3bd5a11 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:28.528859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2865b429-da75-4e06-934a-8756c3bd5a11 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:28.537260 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2865b429-da75-4e06-934a-8756c3bd5a11 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34" status: 200 len: 1559 microversion: 2.1 time: 0.168561 Sep 07 13:45:28.538192 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3633/7293] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:28 2022] GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:29.566328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6956c6a5-b979-4564-a1a4-24e24c895721 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:29.567042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6956c6a5-b979-4564-a1a4-24e24c895721 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: aab41a27-1504-4d5d-a2a1-18e34b7c2e34] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:29.574603 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6956c6a5-b979-4564-a1a4-24e24c895721 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:29.575112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6956c6a5-b979-4564-a1a4-24e24c895721 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:29.575568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6956c6a5-b979-4564-a1a4-24e24c895721 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:29.576259 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6956c6a5-b979-4564-a1a4-24e24c895721 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:29.576753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6956c6a5-b979-4564-a1a4-24e24c895721 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:29.577224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6956c6a5-b979-4564-a1a4-24e24c895721 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:29.721242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6956c6a5-b979-4564-a1a4-24e24c895721 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:29.733624 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6956c6a5-b979-4564-a1a4-24e24c895721 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34" status: 200 len: 1559 microversion: 2.1 time: 0.174473 Sep 07 13:45:29.734217 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3661/7294] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:29 2022] GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:30.715280 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-aa1c2d42-9545-440e-b0ea-4b3032f68719 req-bf30c081-1720-445d-b221-2ff7c8ea56ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab41a27-1504-4d5d-a2a1-18e34b7c2e34", "name": "network-vif-deleted", "tag": "9f5dd993-7592-4464-bcea-35ec15efbb5a"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:45:30.727547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-aa1c2d42-9545-440e-b0ea-4b3032f68719 req-bf30c081-1720-445d-b221-2ff7c8ea56ce service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:30.728077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-aa1c2d42-9545-440e-b0ea-4b3032f68719 req-bf30c081-1720-445d-b221-2ff7c8ea56ce service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:30.728515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-aa1c2d42-9545-440e-b0ea-4b3032f68719 req-bf30c081-1720-445d-b221-2ff7c8ea56ce service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:30.741374 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-aa1c2d42-9545-440e-b0ea-4b3032f68719 req-bf30c081-1720-445d-b221-2ff7c8ea56ce service nova] Creating event network-vif-deleted:9f5dd993-7592-4464-bcea-35ec15efbb5a for instance aab41a27-1504-4d5d-a2a1-18e34b7c2e34 on n-h2-852087-9 Sep 07 13:45:30.746900 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-aa1c2d42-9545-440e-b0ea-4b3032f68719 req-bf30c081-1720-445d-b221-2ff7c8ea56ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035799 Sep 07 13:45:30.748140 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3634/7295] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:45:30.758895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bd52bcac-6bbe-4189-b080-dcbea6a251e0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:30.759538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bd52bcac-6bbe-4189-b080-dcbea6a251e0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: aab41a27-1504-4d5d-a2a1-18e34b7c2e34] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:30.767568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd52bcac-6bbe-4189-b080-dcbea6a251e0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:30.768111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd52bcac-6bbe-4189-b080-dcbea6a251e0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:30.768546 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd52bcac-6bbe-4189-b080-dcbea6a251e0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:30.769285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd52bcac-6bbe-4189-b080-dcbea6a251e0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:30.769793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd52bcac-6bbe-4189-b080-dcbea6a251e0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:30.770344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd52bcac-6bbe-4189-b080-dcbea6a251e0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:30.854688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bd52bcac-6bbe-4189-b080-dcbea6a251e0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:30.863693 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bd52bcac-6bbe-4189-b080-dcbea6a251e0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34" status: 200 len: 1346 microversion: 2.1 time: 0.110351 Sep 07 13:45:30.864297 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3662/7296] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:30 2022] GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34 => generated 1346 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:31.888719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fd5ae3f9-c01b-4cd9-a34d-969c56e8e76c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:31.889401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fd5ae3f9-c01b-4cd9-a34d-969c56e8e76c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: aab41a27-1504-4d5d-a2a1-18e34b7c2e34] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:31.898085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd5ae3f9-c01b-4cd9-a34d-969c56e8e76c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:31.898578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd5ae3f9-c01b-4cd9-a34d-969c56e8e76c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:31.899019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd5ae3f9-c01b-4cd9-a34d-969c56e8e76c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:31.899731 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd5ae3f9-c01b-4cd9-a34d-969c56e8e76c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:31.900187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd5ae3f9-c01b-4cd9-a34d-969c56e8e76c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:31.900615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fd5ae3f9-c01b-4cd9-a34d-969c56e8e76c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:31.915209 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-fd5ae3f9-c01b-4cd9-a34d-969c56e8e76c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] HTTP exception thrown: Instance aab41a27-1504-4d5d-a2a1-18e34b7c2e34 could not be found. Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fd5ae3f9-c01b-4cd9-a34d-969c56e8e76c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Request method failure captured: Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34 HTTP/1.1 Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGKBSFJmMS5t4m5A1zpEXatjN-8sqdkAX0BvwBV9rjMCmd5ZlAL-kQHEsOKxznNZUjwOhR5X-XPWVjonNdNP5T8Bc9DXvkRlgxW51haEchMpTQZiwnOW3GpAoVuA0WBy16jDS5MK-XdXCN9nDVgwQ35cFrenHao1daiMQggsz4FbhgAM Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 3b7b7de7cf224f9b8559751e8a6c6555 Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TestEncryptedCinderVolumes-950169269 Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b7b7de7cf224f9b8559751e8a6c6555"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3b7b7de7cf224f9b8559751e8a6c6555"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3b7b7de7cf224f9b8559751e8a6c6555"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b7b7de7cf224f9b8559751e8a6c6555"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TestEncryptedCinderVolumes-950169269 Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 3b7b7de7cf224f9b8559751e8a6c6555 Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-950169269 Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TestEncryptedCinderVolumes-950169269-project Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 4ccc18c9647148fdb48f35a6dc9c5fe5 Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TestEncryptedCinderVolumes-950169269-project Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance aab41a27-1504-4d5d-a2a1-18e34b7c2e34 could not be found. Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'aab41a27-1504-4d5d-a2a1-18e34b7c2e34'} Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab41a27-1504-4d5d-a2a1-18e34b7c2e34 could not be found. Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab41a27-1504-4d5d-a2a1-18e34b7c2e34 could not be found. Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:45:31.916941 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:45:31.921268 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:45:31.921268 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:45:31.921268 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:45:31.921268 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:45:31.921268 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:45:31.921268 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab41a27-1504-4d5d-a2a1-18e34b7c2e34 could not be found. Sep 07 13:45:31.921268 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:45:31.921268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fd5ae3f9-c01b-4cd9-a34d-969c56e8e76c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Returning 404 to user: Instance aab41a27-1504-4d5d-a2a1-18e34b7c2e34 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:45:31.921268 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fd5ae3f9-c01b-4cd9-a34d-969c56e8e76c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34" status: 404 len: 111 microversion: 2.1 time: 0.034050 Sep 07 13:45:31.921268 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3635/7297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:31 2022] GET /compute/v2.1/servers/aab41a27-1504-4d5d-a2a1-18e34b7c2e34 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:45:31.928464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-22eae871-f51a-453a-bd7f-a3c2469a7b1a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '.version_select at 0x7fc419f19310>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:31.952077 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-22eae871-f51a-453a-bd7f-a3c2469a7b1a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-469036485" status: 202 len: 0 microversion: 2.1 time: 0.027904 Sep 07 13:45:31.952676 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3663/7298] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Sep 7 13:45:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-469036485 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:45:31.974680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-49f38c8b-7792-403c-a140-605ef5c3cac8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Action: 'create', calling method: .version_select at 0x7fc413792550>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1925225713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTboOQ4FTVFWzmU+6yOY1gghT2dabZ5RCwmobtbVK/qaeEWc1DS4YOoKyVEn0lUa7tAwlAyHXnNeOiGLwz6K6gZsSK8NVzwd2rHp+Uj0IhOJsTh4cCGatPNBxulaAnroQ=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:45:31.991919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-49f38c8b-7792-403c-a140-605ef5c3cac8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Getting quotas for project 3b7b7de7cf224f9b8559751e8a6c6555. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:45:31.998394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-49f38c8b-7792-403c-a140-605ef5c3cac8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Getting quotas for user 4ccc18c9647148fdb48f35a6dc9c5fe5 and project 3b7b7de7cf224f9b8559751e8a6c6555. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:45:32.028628 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-49f38c8b-7792-403c-a140-605ef5c3cac8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.057939 Sep 07 13:45:32.029248 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3636/7299] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 13:45:31 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:45:32.083697 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-104e4a92-34a9-468b-83cb-49318c427a8b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1283919476", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1925225713", "networks": [{"uuid": "321cbe88-4fb4-4feb-b2e2-1b7f8ed3dfdd"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:45:32.138967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-104e4a92-34a9-468b-83cb-49318c427a8b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] validate_networks() for [('321cbe88-4fb4-4feb-b2e2-1b7f8ed3dfdd', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:45:32.661267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-104e4a92-34a9-468b-83cb-49318c427a8b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:45:32.661824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-104e4a92-34a9-468b-83cb-49318c427a8b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:45:32.662383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-104e4a92-34a9-468b-83cb-49318c427a8b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:45:32.662761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-104e4a92-34a9-468b-83cb-49318c427a8b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:45:32.663201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-104e4a92-34a9-468b-83cb-49318c427a8b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:45:32.672828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-104e4a92-34a9-468b-83cb-49318c427a8b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:32.673337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-104e4a92-34a9-468b-83cb-49318c427a8b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:32.673836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-104e4a92-34a9-468b-83cb-49318c427a8b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:32.674595 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-104e4a92-34a9-468b-83cb-49318c427a8b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:32.675183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-104e4a92-34a9-468b-83cb-49318c427a8b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:32.675639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-104e4a92-34a9-468b-83cb-49318c427a8b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:32.694768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-104e4a92-34a9-468b-83cb-49318c427a8b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Getting quotas for project 3b7b7de7cf224f9b8559751e8a6c6555. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:45:32.701194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-104e4a92-34a9-468b-83cb-49318c427a8b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Getting quotas for user 4ccc18c9647148fdb48f35a6dc9c5fe5 and project 3b7b7de7cf224f9b8559751e8a6c6555. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:45:32.715379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-104e4a92-34a9-468b-83cb-49318c427a8b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:45:32.718230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-104e4a92-34a9-468b-83cb-49318c427a8b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: b4d6fb0e-e587-4d32-ab12-9e4b4363a91c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:45:32.771159 n-d-852087-9 devstack@n-api.service[122433]: ERROR oslo.messaging._drivers.impl_rabbit [None req-104e4a92-34a9-468b-83cb-49318c427a8b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [e88fe80c-dc6b-40c6-9a21-fec9c36ec4df] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 13:45:33.781286 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [None req-104e4a92-34a9-468b-83cb-49318c427a8b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [e88fe80c-dc6b-40c6-9a21-fec9c36ec4df] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 39240. Sep 07 13:45:33.790756 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-104e4a92-34a9-468b-83cb-49318c427a8b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.711050 Sep 07 13:45:33.791449 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3664/7300] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:45:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:45:33.803137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-505991ad-34a5-4c54-a132-40f1c488665d tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:33.803770 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-505991ad-34a5-4c54-a132-40f1c488665d tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: b4d6fb0e-e587-4d32-ab12-9e4b4363a91c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:33.862132 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-505991ad-34a5-4c54-a132-40f1c488665d tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:33.869689 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-505991ad-34a5-4c54-a132-40f1c488665d tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c" status: 200 len: 1263 microversion: 2.1 time: 0.070444 Sep 07 13:45:33.870250 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3637/7301] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:33 2022] GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c => generated 1263 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:34.894828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bec6ee03-acf7-4a5e-9371-cc279189bfc6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:34.896227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bec6ee03-acf7-4a5e-9371-cc279189bfc6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: b4d6fb0e-e587-4d32-ab12-9e4b4363a91c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:34.904151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bec6ee03-acf7-4a5e-9371-cc279189bfc6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:34.904667 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bec6ee03-acf7-4a5e-9371-cc279189bfc6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:34.905158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bec6ee03-acf7-4a5e-9371-cc279189bfc6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:34.906043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bec6ee03-acf7-4a5e-9371-cc279189bfc6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:34.906520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bec6ee03-acf7-4a5e-9371-cc279189bfc6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:34.906965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bec6ee03-acf7-4a5e-9371-cc279189bfc6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:34.978027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bec6ee03-acf7-4a5e-9371-cc279189bfc6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:34.991447 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bec6ee03-acf7-4a5e-9371-cc279189bfc6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c" status: 200 len: 1315 microversion: 2.1 time: 0.102045 Sep 07 13:45:34.993305 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3665/7302] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:34 2022] GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c => generated 1315 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:36.015508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7b23fae5-568c-400f-a14a-5b8c7db5ffa0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:36.016103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7b23fae5-568c-400f-a14a-5b8c7db5ffa0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: b4d6fb0e-e587-4d32-ab12-9e4b4363a91c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:36.025797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b23fae5-568c-400f-a14a-5b8c7db5ffa0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:36.026216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b23fae5-568c-400f-a14a-5b8c7db5ffa0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:36.026662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b23fae5-568c-400f-a14a-5b8c7db5ffa0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:36.027378 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b23fae5-568c-400f-a14a-5b8c7db5ffa0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:36.027842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b23fae5-568c-400f-a14a-5b8c7db5ffa0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:36.028276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b23fae5-568c-400f-a14a-5b8c7db5ffa0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:36.183171 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7b23fae5-568c-400f-a14a-5b8c7db5ffa0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:36.194278 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7b23fae5-568c-400f-a14a-5b8c7db5ffa0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c" status: 200 len: 1363 microversion: 2.1 time: 0.182097 Sep 07 13:45:36.194900 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3638/7303] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:36 2022] GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:36.431976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-5b2823dd-9db9-42d7-beb1-c10def450826 req-f6f661cb-5304-4f6d-a2fd-42ec5207a7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4d6fb0e-e587-4d32-ab12-9e4b4363a91c", "tag": "2598265d-cccd-4948-beb7-2f7169500e6b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:45:36.443552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5b2823dd-9db9-42d7-beb1-c10def450826 req-f6f661cb-5304-4f6d-a2fd-42ec5207a7d2 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:36.444062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5b2823dd-9db9-42d7-beb1-c10def450826 req-f6f661cb-5304-4f6d-a2fd-42ec5207a7d2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:36.444523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-5b2823dd-9db9-42d7-beb1-c10def450826 req-f6f661cb-5304-4f6d-a2fd-42ec5207a7d2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:36.456559 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-5b2823dd-9db9-42d7-beb1-c10def450826 req-f6f661cb-5304-4f6d-a2fd-42ec5207a7d2 service nova] Creating event network-changed:2598265d-cccd-4948-beb7-2f7169500e6b for instance b4d6fb0e-e587-4d32-ab12-9e4b4363a91c on n-h2-852087-9 Sep 07 13:45:36.461775 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-5b2823dd-9db9-42d7-beb1-c10def450826 req-f6f661cb-5304-4f6d-a2fd-42ec5207a7d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033762 Sep 07 13:45:36.462388 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3666/7304] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:45:37.220277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e011267c-af7e-4027-84fc-eb2c14a8deb1 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:37.220918 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e011267c-af7e-4027-84fc-eb2c14a8deb1 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: b4d6fb0e-e587-4d32-ab12-9e4b4363a91c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:37.230056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e011267c-af7e-4027-84fc-eb2c14a8deb1 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:37.230561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e011267c-af7e-4027-84fc-eb2c14a8deb1 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:37.231030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e011267c-af7e-4027-84fc-eb2c14a8deb1 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:37.231746 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e011267c-af7e-4027-84fc-eb2c14a8deb1 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:37.232201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e011267c-af7e-4027-84fc-eb2c14a8deb1 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:37.232621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e011267c-af7e-4027-84fc-eb2c14a8deb1 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:37.376595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e011267c-af7e-4027-84fc-eb2c14a8deb1 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:37.384701 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e011267c-af7e-4027-84fc-eb2c14a8deb1 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c" status: 200 len: 1363 microversion: 2.1 time: 0.169850 Sep 07 13:45:37.385268 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3639/7305] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:37 2022] GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:38.410096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1fe3a8c1-568e-462c-9e7f-2f7eea861b25 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:38.410863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1fe3a8c1-568e-462c-9e7f-2f7eea861b25 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: b4d6fb0e-e587-4d32-ab12-9e4b4363a91c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:38.417863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fe3a8c1-568e-462c-9e7f-2f7eea861b25 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:38.418376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fe3a8c1-568e-462c-9e7f-2f7eea861b25 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:38.418831 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fe3a8c1-568e-462c-9e7f-2f7eea861b25 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:38.419569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fe3a8c1-568e-462c-9e7f-2f7eea861b25 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:38.420042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fe3a8c1-568e-462c-9e7f-2f7eea861b25 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:38.420486 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fe3a8c1-568e-462c-9e7f-2f7eea861b25 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:38.574013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1fe3a8c1-568e-462c-9e7f-2f7eea861b25 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:38.582359 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1fe3a8c1-568e-462c-9e7f-2f7eea861b25 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c" status: 200 len: 1363 microversion: 2.1 time: 0.177721 Sep 07 13:45:38.582941 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3667/7306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:38 2022] GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:39.607278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fba8f8f2-d0cc-4dca-927c-d55018cc51a5 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:39.607961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fba8f8f2-d0cc-4dca-927c-d55018cc51a5 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: b4d6fb0e-e587-4d32-ab12-9e4b4363a91c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:39.617198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fba8f8f2-d0cc-4dca-927c-d55018cc51a5 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:39.617787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fba8f8f2-d0cc-4dca-927c-d55018cc51a5 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:39.618164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fba8f8f2-d0cc-4dca-927c-d55018cc51a5 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:39.618930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fba8f8f2-d0cc-4dca-927c-d55018cc51a5 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:39.619375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fba8f8f2-d0cc-4dca-927c-d55018cc51a5 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:39.619807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fba8f8f2-d0cc-4dca-927c-d55018cc51a5 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:39.792012 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fba8f8f2-d0cc-4dca-927c-d55018cc51a5 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:39.801108 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fba8f8f2-d0cc-4dca-927c-d55018cc51a5 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c" status: 200 len: 1363 microversion: 2.1 time: 0.198626 Sep 07 13:45:39.801749 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3640/7307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:39 2022] GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:40.824652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-afebdefc-24d6-4450-be9d-92d21b6728c0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:40.825277 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-afebdefc-24d6-4450-be9d-92d21b6728c0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: b4d6fb0e-e587-4d32-ab12-9e4b4363a91c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:40.832322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-afebdefc-24d6-4450-be9d-92d21b6728c0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:40.832830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-afebdefc-24d6-4450-be9d-92d21b6728c0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:40.833340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-afebdefc-24d6-4450-be9d-92d21b6728c0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:40.834094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-afebdefc-24d6-4450-be9d-92d21b6728c0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:40.834572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-afebdefc-24d6-4450-be9d-92d21b6728c0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:40.835024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-afebdefc-24d6-4450-be9d-92d21b6728c0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:40.983070 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-afebdefc-24d6-4450-be9d-92d21b6728c0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:40.991483 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-afebdefc-24d6-4450-be9d-92d21b6728c0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c" status: 200 len: 1363 microversion: 2.1 time: 0.170822 Sep 07 13:45:40.992076 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3668/7308] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:40 2022] GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:41.653285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-712170d1-d615-44af-9dc1-6cf818b8b19f req-9b9bb0ab-d0ad-4dbb-880a-31a6a2f9090f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4d6fb0e-e587-4d32-ab12-9e4b4363a91c", "name": "network-vif-plugged", "status": "completed", "tag": "2598265d-cccd-4948-beb7-2f7169500e6b"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:45:41.665315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-712170d1-d615-44af-9dc1-6cf818b8b19f req-9b9bb0ab-d0ad-4dbb-880a-31a6a2f9090f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:41.666108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-712170d1-d615-44af-9dc1-6cf818b8b19f req-9b9bb0ab-d0ad-4dbb-880a-31a6a2f9090f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:41.666569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-712170d1-d615-44af-9dc1-6cf818b8b19f req-9b9bb0ab-d0ad-4dbb-880a-31a6a2f9090f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:41.679739 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-712170d1-d615-44af-9dc1-6cf818b8b19f req-9b9bb0ab-d0ad-4dbb-880a-31a6a2f9090f service nova] Creating event network-vif-plugged:2598265d-cccd-4948-beb7-2f7169500e6b for instance b4d6fb0e-e587-4d32-ab12-9e4b4363a91c on n-h2-852087-9 Sep 07 13:45:41.686627 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-712170d1-d615-44af-9dc1-6cf818b8b19f req-9b9bb0ab-d0ad-4dbb-880a-31a6a2f9090f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037233 Sep 07 13:45:41.687441 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3641/7309] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:45:42.015691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-66e4ecea-16b7-4b00-a06e-7df468c65edc tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:42.016395 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-66e4ecea-16b7-4b00-a06e-7df468c65edc tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: b4d6fb0e-e587-4d32-ab12-9e4b4363a91c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:42.023776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66e4ecea-16b7-4b00-a06e-7df468c65edc tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:42.024299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66e4ecea-16b7-4b00-a06e-7df468c65edc tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:42.024761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66e4ecea-16b7-4b00-a06e-7df468c65edc tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:42.025525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66e4ecea-16b7-4b00-a06e-7df468c65edc tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:42.025983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66e4ecea-16b7-4b00-a06e-7df468c65edc tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:42.026435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-66e4ecea-16b7-4b00-a06e-7df468c65edc tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:42.173593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-66e4ecea-16b7-4b00-a06e-7df468c65edc tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:42.181828 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-66e4ecea-16b7-4b00-a06e-7df468c65edc tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c" status: 200 len: 1363 microversion: 2.1 time: 0.170109 Sep 07 13:45:42.182455 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3669/7310] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:42 2022] GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:43.209041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-16e6470e-e401-4ad0-9732-b214644815b3 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:43.209668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-16e6470e-e401-4ad0-9732-b214644815b3 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: b4d6fb0e-e587-4d32-ab12-9e4b4363a91c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:43.216522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16e6470e-e401-4ad0-9732-b214644815b3 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:43.217076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16e6470e-e401-4ad0-9732-b214644815b3 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:43.217576 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16e6470e-e401-4ad0-9732-b214644815b3 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:43.218345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16e6470e-e401-4ad0-9732-b214644815b3 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:43.218802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16e6470e-e401-4ad0-9732-b214644815b3 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:43.219272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16e6470e-e401-4ad0-9732-b214644815b3 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:43.364916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-16e6470e-e401-4ad0-9732-b214644815b3 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:43.373161 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-16e6470e-e401-4ad0-9732-b214644815b3 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c" status: 200 len: 1554 microversion: 2.1 time: 0.171591 Sep 07 13:45:43.373779 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3642/7311] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:43 2022] GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:45:43.396544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3cb25aa0-4fd6-4d5e-b3a3-f8eb2a42a81e tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:43.397200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3cb25aa0-4fd6-4d5e-b3a3-f8eb2a42a81e tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: b4d6fb0e-e587-4d32-ab12-9e4b4363a91c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:43.399244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:45:43.399977 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:45:43.406856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cb25aa0-4fd6-4d5e-b3a3-f8eb2a42a81e tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:43.407386 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cb25aa0-4fd6-4d5e-b3a3-f8eb2a42a81e tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:43.407865 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cb25aa0-4fd6-4d5e-b3a3-f8eb2a42a81e tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:43.408623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cb25aa0-4fd6-4d5e-b3a3-f8eb2a42a81e tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:43.409094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cb25aa0-4fd6-4d5e-b3a3-f8eb2a42a81e tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:43.409586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3cb25aa0-4fd6-4d5e-b3a3-f8eb2a42a81e tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:43.556422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3cb25aa0-4fd6-4d5e-b3a3-f8eb2a42a81e tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:45:43.567781 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3cb25aa0-4fd6-4d5e-b3a3-f8eb2a42a81e tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c" status: 200 len: 1554 microversion: 2.1 time: 0.175511 Sep 07 13:45:43.568361 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3670/7312] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:45:43 2022] GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:45:45.136371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0ded4b20-371e-42fa-ac65-2c41b366542d tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02d65bde-e450-4953-8b0c-3834f3c2efdd"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:45:45.138940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0ded4b20-371e-42fa-ac65-2c41b366542d tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: b4d6fb0e-e587-4d32-ab12-9e4b4363a91c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:45.141048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:45:45.147788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ded4b20-371e-42fa-ac65-2c41b366542d tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:45.148288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ded4b20-371e-42fa-ac65-2c41b366542d tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:45.148732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ded4b20-371e-42fa-ac65-2c41b366542d tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:45.149452 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ded4b20-371e-42fa-ac65-2c41b366542d tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:45.149946 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ded4b20-371e-42fa-ac65-2c41b366542d tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:45.150382 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ded4b20-371e-42fa-ac65-2c41b366542d tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:45.479570 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0ded4b20-371e-42fa-ac65-2c41b366542d tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "POST /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.347401 Sep 07 13:45:45.480249 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3643/7313] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Sep 7 13:45:45 2022] POST /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c/os-volume_attachments => generated 194 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:45:57.349972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2960d164-4f97-48b3-80ba-e1935254d2cd tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:57.350547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2960d164-4f97-48b3-80ba-e1935254d2cd tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: b4d6fb0e-e587-4d32-ab12-9e4b4363a91c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:57.353237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:45:57.354214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:45:57.361185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2960d164-4f97-48b3-80ba-e1935254d2cd tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:57.361730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2960d164-4f97-48b3-80ba-e1935254d2cd tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:57.362181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2960d164-4f97-48b3-80ba-e1935254d2cd tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:57.363199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2960d164-4f97-48b3-80ba-e1935254d2cd tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:57.363541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2960d164-4f97-48b3-80ba-e1935254d2cd tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:57.363990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2960d164-4f97-48b3-80ba-e1935254d2cd tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:57.459137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-2960d164-4f97-48b3-80ba-e1935254d2cd tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lazy-loading 'services' on Instance uuid b4d6fb0e-e587-4d32-ab12-9e4b4363a91c {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:45:57.544463 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2960d164-4f97-48b3-80ba-e1935254d2cd tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c/os-volume_attachments/02d65bde-e450-4953-8b0c-3834f3c2efdd" status: 202 len: 0 microversion: 2.1 time: 0.198395 Sep 07 13:45:57.545109 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3671/7314] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Sep 7 13:45:57 2022] DELETE /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c/os-volume_attachments/02d65bde-e450-4953-8b0c-3834f3c2efdd => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:45:57.553993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:45:57.555783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:45:57.575920 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7b672b68-b935-4c57-95a2-42c07ac05d89 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:57.579815 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7b672b68-b935-4c57-95a2-42c07ac05d89 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: b4d6fb0e-e587-4d32-ab12-9e4b4363a91c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:57.593520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b672b68-b935-4c57-95a2-42c07ac05d89 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:57.594107 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b672b68-b935-4c57-95a2-42c07ac05d89 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:57.594685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b672b68-b935-4c57-95a2-42c07ac05d89 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:57.595743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b672b68-b935-4c57-95a2-42c07ac05d89 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:57.596493 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b672b68-b935-4c57-95a2-42c07ac05d89 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:57.597016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b672b68-b935-4c57-95a2-42c07ac05d89 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:57.638507 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7b672b68-b935-4c57-95a2-42c07ac05d89 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087723 Sep 07 13:45:57.639489 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3644/7315] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:45:57 2022] GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:45:58.661521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2f6df041-ac36-4bd8-af53-7486c1b3fbce tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:58.665124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2f6df041-ac36-4bd8-af53-7486c1b3fbce tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: b4d6fb0e-e587-4d32-ab12-9e4b4363a91c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:58.676556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f6df041-ac36-4bd8-af53-7486c1b3fbce tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:58.677467 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f6df041-ac36-4bd8-af53-7486c1b3fbce tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:58.678282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f6df041-ac36-4bd8-af53-7486c1b3fbce tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:58.679559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f6df041-ac36-4bd8-af53-7486c1b3fbce tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:58.680339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f6df041-ac36-4bd8-af53-7486c1b3fbce tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:58.681129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2f6df041-ac36-4bd8-af53-7486c1b3fbce tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:58.738416 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2f6df041-ac36-4bd8-af53-7486c1b3fbce tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085849 Sep 07 13:45:58.739075 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3672/7316] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:45:58 2022] GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:45:59.752644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b42dd466-8de8-4832-ba04-36c2910f527a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:45:59.755090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b42dd466-8de8-4832-ba04-36c2910f527a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: b4d6fb0e-e587-4d32-ab12-9e4b4363a91c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:45:59.763455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b42dd466-8de8-4832-ba04-36c2910f527a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:59.763967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b42dd466-8de8-4832-ba04-36c2910f527a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:59.764415 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b42dd466-8de8-4832-ba04-36c2910f527a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:59.765174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b42dd466-8de8-4832-ba04-36c2910f527a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:45:59.765693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b42dd466-8de8-4832-ba04-36c2910f527a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:45:59.766137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b42dd466-8de8-4832-ba04-36c2910f527a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:45:59.806254 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b42dd466-8de8-4832-ba04-36c2910f527a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058160 Sep 07 13:45:59.806887 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3645/7317] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:45:59 2022] GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:46:00.822416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-93447783-4454-46de-af89-c709a5653df6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:00.825232 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-93447783-4454-46de-af89-c709a5653df6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: b4d6fb0e-e587-4d32-ab12-9e4b4363a91c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:00.834672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93447783-4454-46de-af89-c709a5653df6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:00.835428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93447783-4454-46de-af89-c709a5653df6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:00.836012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93447783-4454-46de-af89-c709a5653df6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:00.836892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93447783-4454-46de-af89-c709a5653df6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:00.837539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93447783-4454-46de-af89-c709a5653df6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:00.838101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93447783-4454-46de-af89-c709a5653df6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:00.876719 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-93447783-4454-46de-af89-c709a5653df6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059451 Sep 07 13:46:00.877388 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3673/7318] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:46:00 2022] GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:46:01.901595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cba65c08-d9e3-4874-9261-20f0ce7564ba tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:01.907271 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cba65c08-d9e3-4874-9261-20f0ce7564ba tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: b4d6fb0e-e587-4d32-ab12-9e4b4363a91c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:01.918890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cba65c08-d9e3-4874-9261-20f0ce7564ba tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:01.919722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cba65c08-d9e3-4874-9261-20f0ce7564ba tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:01.920481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cba65c08-d9e3-4874-9261-20f0ce7564ba tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:01.921707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cba65c08-d9e3-4874-9261-20f0ce7564ba tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:01.922501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cba65c08-d9e3-4874-9261-20f0ce7564ba tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:01.923127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cba65c08-d9e3-4874-9261-20f0ce7564ba tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:01.960076 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cba65c08-d9e3-4874-9261-20f0ce7564ba tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066424 Sep 07 13:46:01.960711 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3646/7319] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:46:01 2022] GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:46:02.973955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3709d6e2-f702-40bc-8c21-d283b2615e84 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:02.976536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3709d6e2-f702-40bc-8c21-d283b2615e84 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: b4d6fb0e-e587-4d32-ab12-9e4b4363a91c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:02.984727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3709d6e2-f702-40bc-8c21-d283b2615e84 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:02.985246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3709d6e2-f702-40bc-8c21-d283b2615e84 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:02.985826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3709d6e2-f702-40bc-8c21-d283b2615e84 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:02.986580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3709d6e2-f702-40bc-8c21-d283b2615e84 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:02.987061 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3709d6e2-f702-40bc-8c21-d283b2615e84 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:02.987637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3709d6e2-f702-40bc-8c21-d283b2615e84 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:03.023526 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3709d6e2-f702-40bc-8c21-d283b2615e84 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053768 Sep 07 13:46:03.024116 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3674/7320] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:46:02 2022] GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:46:03.035572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-860ad346-6c93-40ad-9d9c-5ac4b1703f37 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:03.036182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-860ad346-6c93-40ad-9d9c-5ac4b1703f37 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: b4d6fb0e-e587-4d32-ab12-9e4b4363a91c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:03.043786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-860ad346-6c93-40ad-9d9c-5ac4b1703f37 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:03.044292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-860ad346-6c93-40ad-9d9c-5ac4b1703f37 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:03.044740 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-860ad346-6c93-40ad-9d9c-5ac4b1703f37 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:03.045466 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-860ad346-6c93-40ad-9d9c-5ac4b1703f37 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:03.046009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-860ad346-6c93-40ad-9d9c-5ac4b1703f37 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:03.046442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-860ad346-6c93-40ad-9d9c-5ac4b1703f37 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:03.129878 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-860ad346-6c93-40ad-9d9c-5ac4b1703f37 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] HTTP exception thrown: Instance b4d6fb0e-e587-4d32-ab12-9e4b4363a91c is not attached to volume 02d65bde-e450-4953-8b0c-3834f3c2efdd Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-860ad346-6c93-40ad-9d9c-5ac4b1703f37 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Request method failure captured: Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c/os-volume_attachments/02d65bde-e450-4953-8b0c-3834f3c2efdd HTTP/1.1 Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGKBSFJmMS5t4m5A1zpEXatjN-8sqdkAX0BvwBV9rjMCmd5ZlAL-kQHEsOKxznNZUjwOhR5X-XPWVjonNdNP5T8Bc9DXvkRlgxW51haEchMpTQZiwnOW3GpAoVuA0WBy16jDS5MK-XdXCN9nDVgwQ35cFrenHao1daiMQggsz4FbhgAM Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 3b7b7de7cf224f9b8559751e8a6c6555 Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TestEncryptedCinderVolumes-950169269 Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b7b7de7cf224f9b8559751e8a6c6555"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3b7b7de7cf224f9b8559751e8a6c6555"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3b7b7de7cf224f9b8559751e8a6c6555"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b7b7de7cf224f9b8559751e8a6c6555"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TestEncryptedCinderVolumes-950169269 Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 3b7b7de7cf224f9b8559751e8a6c6555 Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-950169269 Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TestEncryptedCinderVolumes-950169269-project Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 4ccc18c9647148fdb48f35a6dc9c5fe5 Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TestEncryptedCinderVolumes-950169269-project Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance b4d6fb0e-e587-4d32-ab12-9e4b4363a91c is not attached to volume 02d65bde-e450-4953-8b0c-3834f3c2efdd Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'server_id': 'b4d6fb0e-e587-4d32-ab12-9e4b4363a91c', 'id': '02d65bde-e450-4953-8b0c-3834f3c2efdd'} Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 02d65bde-e450-4953-8b0c-3834f3c2efdd. Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4d6fb0e-e587-4d32-ab12-9e4b4363a91c is not attached to volume 02d65bde-e450-4953-8b0c-3834f3c2efdd Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:46:03.132320 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:46:03.137909 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:46:03.137909 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:46:03.137909 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4d6fb0e-e587-4d32-ab12-9e4b4363a91c is not attached to volume 02d65bde-e450-4953-8b0c-3834f3c2efdd Sep 07 13:46:03.137909 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:46:03.137909 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-860ad346-6c93-40ad-9d9c-5ac4b1703f37 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Returning 404 to user: Instance b4d6fb0e-e587-4d32-ab12-9e4b4363a91c is not attached to volume 02d65bde-e450-4953-8b0c-3834f3c2efdd {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:46:03.137909 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-860ad346-6c93-40ad-9d9c-5ac4b1703f37 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c/os-volume_attachments/02d65bde-e450-4953-8b0c-3834f3c2efdd" status: 404 len: 154 microversion: 2.1 time: 0.102808 Sep 07 13:46:03.137909 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3647/7321] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Sep 7 13:46:03 2022] DELETE /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c/os-volume_attachments/02d65bde-e450-4953-8b0c-3834f3c2efdd => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:46:06.605560 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1b3ccb70-43e8-4530-a303-d55424bcb550 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:06.606188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1b3ccb70-43e8-4530-a303-d55424bcb550 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: b4d6fb0e-e587-4d32-ab12-9e4b4363a91c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:06.613372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b3ccb70-43e8-4530-a303-d55424bcb550 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:06.613918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b3ccb70-43e8-4530-a303-d55424bcb550 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:06.614369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b3ccb70-43e8-4530-a303-d55424bcb550 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:06.615095 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b3ccb70-43e8-4530-a303-d55424bcb550 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:06.615568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b3ccb70-43e8-4530-a303-d55424bcb550 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:06.616010 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b3ccb70-43e8-4530-a303-d55424bcb550 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:06.645947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1b3ccb70-43e8-4530-a303-d55424bcb550 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: b4d6fb0e-e587-4d32-ab12-9e4b4363a91c] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:46:06.751699 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1b3ccb70-43e8-4530-a303-d55424bcb550 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c" status: 204 len: 0 microversion: 2.1 time: 0.149178 Sep 07 13:46:06.752784 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3675/7322] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:46:06 2022] DELETE /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:46:06.766047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-76062a88-94a9-4e19-ae2c-c0f5e9bec01c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:06.767574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-76062a88-94a9-4e19-ae2c-c0f5e9bec01c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: b4d6fb0e-e587-4d32-ab12-9e4b4363a91c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:06.782013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76062a88-94a9-4e19-ae2c-c0f5e9bec01c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:06.782694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76062a88-94a9-4e19-ae2c-c0f5e9bec01c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:06.783240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76062a88-94a9-4e19-ae2c-c0f5e9bec01c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:06.784445 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76062a88-94a9-4e19-ae2c-c0f5e9bec01c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:06.785272 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76062a88-94a9-4e19-ae2c-c0f5e9bec01c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:06.785988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-76062a88-94a9-4e19-ae2c-c0f5e9bec01c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:06.970847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-76062a88-94a9-4e19-ae2c-c0f5e9bec01c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:46:06.981687 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-76062a88-94a9-4e19-ae2c-c0f5e9bec01c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c" status: 200 len: 1560 microversion: 2.1 time: 0.222847 Sep 07 13:46:06.983191 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3648/7323] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:46:06 2022] GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c => generated 1560 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:46:08.006980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f0d9b236-f983-4980-b47d-62e2298b7269 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:08.007758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f0d9b236-f983-4980-b47d-62e2298b7269 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: b4d6fb0e-e587-4d32-ab12-9e4b4363a91c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:08.015388 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0d9b236-f983-4980-b47d-62e2298b7269 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:08.015909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0d9b236-f983-4980-b47d-62e2298b7269 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:08.016362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0d9b236-f983-4980-b47d-62e2298b7269 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:08.017091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0d9b236-f983-4980-b47d-62e2298b7269 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:08.017594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0d9b236-f983-4980-b47d-62e2298b7269 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:08.018038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f0d9b236-f983-4980-b47d-62e2298b7269 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:08.169206 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f0d9b236-f983-4980-b47d-62e2298b7269 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:46:08.177359 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f0d9b236-f983-4980-b47d-62e2298b7269 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c" status: 200 len: 1560 microversion: 2.1 time: 0.174827 Sep 07 13:46:08.177978 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3676/7324] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:46:08 2022] GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:46:09.205981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-23a25406-e95b-4ac6-a645-33e7c06063b2 req-879398c1-563b-4435-950e-39d6b8245e24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4d6fb0e-e587-4d32-ab12-9e4b4363a91c", "name": "network-vif-deleted", "tag": "2598265d-cccd-4948-beb7-2f7169500e6b"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:46:09.213817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6057a065-d4cc-42cd-9cf9-3b1f8b607d89 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:09.222475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6057a065-d4cc-42cd-9cf9-3b1f8b607d89 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: b4d6fb0e-e587-4d32-ab12-9e4b4363a91c] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:09.223480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-23a25406-e95b-4ac6-a645-33e7c06063b2 req-879398c1-563b-4435-950e-39d6b8245e24 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:09.223981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-23a25406-e95b-4ac6-a645-33e7c06063b2 req-879398c1-563b-4435-950e-39d6b8245e24 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:09.224429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-23a25406-e95b-4ac6-a645-33e7c06063b2 req-879398c1-563b-4435-950e-39d6b8245e24 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:09.234249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6057a065-d4cc-42cd-9cf9-3b1f8b607d89 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:09.235058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6057a065-d4cc-42cd-9cf9-3b1f8b607d89 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:09.236025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6057a065-d4cc-42cd-9cf9-3b1f8b607d89 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:09.237543 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6057a065-d4cc-42cd-9cf9-3b1f8b607d89 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:09.238585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6057a065-d4cc-42cd-9cf9-3b1f8b607d89 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:09.239518 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6057a065-d4cc-42cd-9cf9-3b1f8b607d89 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:09.258727 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-23a25406-e95b-4ac6-a645-33e7c06063b2 req-879398c1-563b-4435-950e-39d6b8245e24 service nova] Creating event network-vif-deleted:2598265d-cccd-4948-beb7-2f7169500e6b for instance b4d6fb0e-e587-4d32-ab12-9e4b4363a91c on n-h2-852087-9 Sep 07 13:46:09.264322 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-23a25406-e95b-4ac6-a645-33e7c06063b2 req-879398c1-563b-4435-950e-39d6b8245e24 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062001 Sep 07 13:46:09.265467 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3677/7325] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:46:09.332686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6057a065-d4cc-42cd-9cf9-3b1f8b607d89 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:46:09.341678 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6057a065-d4cc-42cd-9cf9-3b1f8b607d89 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c" status: 200 len: 1348 microversion: 2.1 time: 0.142437 Sep 07 13:46:09.343697 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3649/7326] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:46:09 2022] GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c => generated 1348 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:46:10.370018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-61032b5c-45d6-4bcc-8eb1-ab7f5aeda40d tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:10.371464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-61032b5c-45d6-4bcc-8eb1-ab7f5aeda40d tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: b4d6fb0e-e587-4d32-ab12-9e4b4363a91c] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:10.379122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61032b5c-45d6-4bcc-8eb1-ab7f5aeda40d tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:10.380069 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61032b5c-45d6-4bcc-8eb1-ab7f5aeda40d tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:10.380780 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61032b5c-45d6-4bcc-8eb1-ab7f5aeda40d tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:10.381663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61032b5c-45d6-4bcc-8eb1-ab7f5aeda40d tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:10.382312 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61032b5c-45d6-4bcc-8eb1-ab7f5aeda40d tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:10.382938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-61032b5c-45d6-4bcc-8eb1-ab7f5aeda40d tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:10.398740 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-61032b5c-45d6-4bcc-8eb1-ab7f5aeda40d tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] HTTP exception thrown: Instance b4d6fb0e-e587-4d32-ab12-9e4b4363a91c could not be found. Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-61032b5c-45d6-4bcc-8eb1-ab7f5aeda40d tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Request method failure captured: Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c HTTP/1.1 Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGKBSFJmMS5t4m5A1zpEXatjN-8sqdkAX0BvwBV9rjMCmd5ZlAL-kQHEsOKxznNZUjwOhR5X-XPWVjonNdNP5T8Bc9DXvkRlgxW51haEchMpTQZiwnOW3GpAoVuA0WBy16jDS5MK-XdXCN9nDVgwQ35cFrenHao1daiMQggsz4FbhgAM Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 3b7b7de7cf224f9b8559751e8a6c6555 Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TestEncryptedCinderVolumes-950169269 Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b7b7de7cf224f9b8559751e8a6c6555"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3b7b7de7cf224f9b8559751e8a6c6555"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3b7b7de7cf224f9b8559751e8a6c6555"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b7b7de7cf224f9b8559751e8a6c6555"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TestEncryptedCinderVolumes-950169269 Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 3b7b7de7cf224f9b8559751e8a6c6555 Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-950169269 Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TestEncryptedCinderVolumes-950169269-project Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 4ccc18c9647148fdb48f35a6dc9c5fe5 Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TestEncryptedCinderVolumes-950169269-project Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance b4d6fb0e-e587-4d32-ab12-9e4b4363a91c could not be found. Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'b4d6fb0e-e587-4d32-ab12-9e4b4363a91c'} Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4d6fb0e-e587-4d32-ab12-9e4b4363a91c could not be found. Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4d6fb0e-e587-4d32-ab12-9e4b4363a91c could not be found. Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:46:10.400464 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:46:10.404760 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:46:10.404760 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:46:10.404760 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:46:10.404760 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:46:10.404760 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:46:10.404760 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4d6fb0e-e587-4d32-ab12-9e4b4363a91c could not be found. Sep 07 13:46:10.404760 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:46:10.404760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-61032b5c-45d6-4bcc-8eb1-ab7f5aeda40d tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Returning 404 to user: Instance b4d6fb0e-e587-4d32-ab12-9e4b4363a91c could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:46:10.404760 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-61032b5c-45d6-4bcc-8eb1-ab7f5aeda40d tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c" status: 404 len: 111 microversion: 2.1 time: 0.038863 Sep 07 13:46:10.404760 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3678/7327] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:46:10 2022] GET /compute/v2.1/servers/b4d6fb0e-e587-4d32-ab12-9e4b4363a91c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:46:10.412170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ebcd4520-b9ca-4816-a99a-6d297e95d340 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '.version_select at 0x7fc418873670>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:10.439409 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ebcd4520-b9ca-4816-a99a-6d297e95d340 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1925225713" status: 202 len: 0 microversion: 2.1 time: 0.031237 Sep 07 13:46:10.440037 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3650/7328] 10.222.0.16 () {58 vars in 1278 bytes} [Wed Sep 7 13:46:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1925225713 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:46:10.459310 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-fd21232e-4dfc-4164-b252-27b82051ec98 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Action: 'create', calling method: .version_select at 0x7fc413f6ed30>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-964501342", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbLzXHzS8+EO5GNorvqf6m2YAu/X2Qbp6vpVOtsaiV+jXQ5gANuyspBBK+WvCqV0YFxtOplxaOXQR8ei6/ajItbmCw88UzBdGLbKu6BUgfJCpb52CZES8tBizeJtekLyg=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:46:10.477000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-fd21232e-4dfc-4164-b252-27b82051ec98 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Getting quotas for project 3b7b7de7cf224f9b8559751e8a6c6555. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:46:10.483994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-fd21232e-4dfc-4164-b252-27b82051ec98 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Getting quotas for user 4ccc18c9647148fdb48f35a6dc9c5fe5 and project 3b7b7de7cf224f9b8559751e8a6c6555. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:46:10.510657 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-fd21232e-4dfc-4164-b252-27b82051ec98 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.055856 Sep 07 13:46:10.511269 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3679/7329] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 13:46:10 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:46:10.577343 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c6352cab-ef6c-44c7-b9bf-81536e5a0ab8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1444077251", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-964501342", "networks": [{"uuid": "321cbe88-4fb4-4feb-b2e2-1b7f8ed3dfdd"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:46:10.637590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-c6352cab-ef6c-44c7-b9bf-81536e5a0ab8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] validate_networks() for [('321cbe88-4fb4-4feb-b2e2-1b7f8ed3dfdd', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:46:11.107437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c6352cab-ef6c-44c7-b9bf-81536e5a0ab8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:46:11.107919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c6352cab-ef6c-44c7-b9bf-81536e5a0ab8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:46:11.108464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c6352cab-ef6c-44c7-b9bf-81536e5a0ab8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:46:11.108917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c6352cab-ef6c-44c7-b9bf-81536e5a0ab8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:46:11.109344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-c6352cab-ef6c-44c7-b9bf-81536e5a0ab8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:46:11.118970 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6352cab-ef6c-44c7-b9bf-81536e5a0ab8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:11.119434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6352cab-ef6c-44c7-b9bf-81536e5a0ab8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:11.119869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6352cab-ef6c-44c7-b9bf-81536e5a0ab8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:11.120591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6352cab-ef6c-44c7-b9bf-81536e5a0ab8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:11.121040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6352cab-ef6c-44c7-b9bf-81536e5a0ab8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:11.121563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6352cab-ef6c-44c7-b9bf-81536e5a0ab8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:11.139070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-c6352cab-ef6c-44c7-b9bf-81536e5a0ab8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Getting quotas for project 3b7b7de7cf224f9b8559751e8a6c6555. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:46:11.144553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-c6352cab-ef6c-44c7-b9bf-81536e5a0ab8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Getting quotas for user 4ccc18c9647148fdb48f35a6dc9c5fe5 and project 3b7b7de7cf224f9b8559751e8a6c6555. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:46:11.158380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c6352cab-ef6c-44c7-b9bf-81536e5a0ab8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:46:11.160766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c6352cab-ef6c-44c7-b9bf-81536e5a0ab8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: f05fddc9-d0ba-4df5-b75b-0a3ce984532a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:46:11.214526 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c6352cab-ef6c-44c7-b9bf-81536e5a0ab8 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641507 Sep 07 13:46:11.215299 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3651/7330] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:46:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:46:11.231175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ce585739-fae0-4ce1-8b34-5e57c93212cc tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:11.232030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ce585739-fae0-4ce1-8b34-5e57c93212cc tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: f05fddc9-d0ba-4df5-b75b-0a3ce984532a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:11.291634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ce585739-fae0-4ce1-8b34-5e57c93212cc tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:46:11.300107 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ce585739-fae0-4ce1-8b34-5e57c93212cc tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a" status: 200 len: 1262 microversion: 2.1 time: 0.072839 Sep 07 13:46:11.300699 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3680/7331] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:46:11 2022] GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a => generated 1262 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:46:12.324440 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fb4d9b7a-cfc0-4b82-bd47-e83be09009fa tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:12.325044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fb4d9b7a-cfc0-4b82-bd47-e83be09009fa tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: f05fddc9-d0ba-4df5-b75b-0a3ce984532a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:12.331789 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb4d9b7a-cfc0-4b82-bd47-e83be09009fa tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:12.332286 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb4d9b7a-cfc0-4b82-bd47-e83be09009fa tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:12.332720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb4d9b7a-cfc0-4b82-bd47-e83be09009fa tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:12.333430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb4d9b7a-cfc0-4b82-bd47-e83be09009fa tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:12.333926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb4d9b7a-cfc0-4b82-bd47-e83be09009fa tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:12.334355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fb4d9b7a-cfc0-4b82-bd47-e83be09009fa tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:12.413031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fb4d9b7a-cfc0-4b82-bd47-e83be09009fa tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:46:12.424484 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fb4d9b7a-cfc0-4b82-bd47-e83be09009fa tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a" status: 200 len: 1314 microversion: 2.1 time: 0.104963 Sep 07 13:46:12.442516 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3652/7332] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:46:12 2022] GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a => generated 1314 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:46:13.451461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ad728957-7ee9-492e-bee7-2e062bd4552a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:13.452030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ad728957-7ee9-492e-bee7-2e062bd4552a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: f05fddc9-d0ba-4df5-b75b-0a3ce984532a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:13.460436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad728957-7ee9-492e-bee7-2e062bd4552a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:13.460980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad728957-7ee9-492e-bee7-2e062bd4552a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:13.461682 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad728957-7ee9-492e-bee7-2e062bd4552a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:13.462439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad728957-7ee9-492e-bee7-2e062bd4552a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:13.462921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad728957-7ee9-492e-bee7-2e062bd4552a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:13.463371 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ad728957-7ee9-492e-bee7-2e062bd4552a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:13.628986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ad728957-7ee9-492e-bee7-2e062bd4552a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:46:13.639927 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ad728957-7ee9-492e-bee7-2e062bd4552a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a" status: 200 len: 1362 microversion: 2.1 time: 0.194028 Sep 07 13:46:13.640746 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3681/7333] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:46:13 2022] GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:46:14.240402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-17130753-8bcd-42af-923a-0f9ca81b2ee3 req-ca5d92f9-daa5-4985-a103-5c75798b1bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f05fddc9-d0ba-4df5-b75b-0a3ce984532a", "tag": "8da07a1e-c08c-4ce8-a9fc-6e6cedb2cfc7"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:46:14.262851 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-17130753-8bcd-42af-923a-0f9ca81b2ee3 req-ca5d92f9-daa5-4985-a103-5c75798b1bb9 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:14.263942 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-17130753-8bcd-42af-923a-0f9ca81b2ee3 req-ca5d92f9-daa5-4985-a103-5c75798b1bb9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:14.264371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-17130753-8bcd-42af-923a-0f9ca81b2ee3 req-ca5d92f9-daa5-4985-a103-5c75798b1bb9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:14.277962 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-17130753-8bcd-42af-923a-0f9ca81b2ee3 req-ca5d92f9-daa5-4985-a103-5c75798b1bb9 service nova] Creating event network-changed:8da07a1e-c08c-4ce8-a9fc-6e6cedb2cfc7 for instance f05fddc9-d0ba-4df5-b75b-0a3ce984532a on n-h2-852087-9 Sep 07 13:46:14.284384 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-17130753-8bcd-42af-923a-0f9ca81b2ee3 req-ca5d92f9-daa5-4985-a103-5c75798b1bb9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047789 Sep 07 13:46:14.285026 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3653/7334] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:46:14.664232 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-88acdf94-a4ab-45c1-bc9c-ce231d69d2c6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:14.665141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-88acdf94-a4ab-45c1-bc9c-ce231d69d2c6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: f05fddc9-d0ba-4df5-b75b-0a3ce984532a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:14.672852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88acdf94-a4ab-45c1-bc9c-ce231d69d2c6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:14.673375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88acdf94-a4ab-45c1-bc9c-ce231d69d2c6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:14.673874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88acdf94-a4ab-45c1-bc9c-ce231d69d2c6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:14.674633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88acdf94-a4ab-45c1-bc9c-ce231d69d2c6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:14.675168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88acdf94-a4ab-45c1-bc9c-ce231d69d2c6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:14.675623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-88acdf94-a4ab-45c1-bc9c-ce231d69d2c6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:15.191866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-88acdf94-a4ab-45c1-bc9c-ce231d69d2c6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:46:15.200461 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-88acdf94-a4ab-45c1-bc9c-ce231d69d2c6 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a" status: 200 len: 1362 microversion: 2.1 time: 0.540232 Sep 07 13:46:15.201060 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3682/7335] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:46:14 2022] GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a => generated 1362 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:46:16.224786 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7c71b870-837e-42de-ae93-ea02537475ad tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:16.225720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7c71b870-837e-42de-ae93-ea02537475ad tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: f05fddc9-d0ba-4df5-b75b-0a3ce984532a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:16.235325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c71b870-837e-42de-ae93-ea02537475ad tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:16.236170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c71b870-837e-42de-ae93-ea02537475ad tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:16.237035 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c71b870-837e-42de-ae93-ea02537475ad tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:16.238526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c71b870-837e-42de-ae93-ea02537475ad tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:16.239254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c71b870-837e-42de-ae93-ea02537475ad tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:16.239887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c71b870-837e-42de-ae93-ea02537475ad tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:16.391769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7c71b870-837e-42de-ae93-ea02537475ad tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:46:16.400235 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7c71b870-837e-42de-ae93-ea02537475ad tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a" status: 200 len: 1362 microversion: 2.1 time: 0.179874 Sep 07 13:46:16.400866 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3654/7336] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:46:16 2022] GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:46:17.425501 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d237ce2a-a179-44ac-bd5b-15cceac68cea tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:17.426174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d237ce2a-a179-44ac-bd5b-15cceac68cea tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: f05fddc9-d0ba-4df5-b75b-0a3ce984532a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:17.433597 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d237ce2a-a179-44ac-bd5b-15cceac68cea tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:17.434111 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d237ce2a-a179-44ac-bd5b-15cceac68cea tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:17.434552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d237ce2a-a179-44ac-bd5b-15cceac68cea tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:17.435276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d237ce2a-a179-44ac-bd5b-15cceac68cea tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:17.435743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d237ce2a-a179-44ac-bd5b-15cceac68cea tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:17.436182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d237ce2a-a179-44ac-bd5b-15cceac68cea tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:17.594659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d237ce2a-a179-44ac-bd5b-15cceac68cea tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:46:17.603806 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d237ce2a-a179-44ac-bd5b-15cceac68cea tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a" status: 200 len: 1362 microversion: 2.1 time: 0.183748 Sep 07 13:46:17.604407 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3683/7337] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:46:17 2022] GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:46:17.842982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-4fa0c4d9-b9eb-4491-a7d2-1fb6dceba407 req-f1076748-12f8-4b6a-8172-423aba76c5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f05fddc9-d0ba-4df5-b75b-0a3ce984532a", "name": "network-vif-plugged", "status": "completed", "tag": "8da07a1e-c08c-4ce8-a9fc-6e6cedb2cfc7"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:46:17.854657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4fa0c4d9-b9eb-4491-a7d2-1fb6dceba407 req-f1076748-12f8-4b6a-8172-423aba76c5a8 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:17.855487 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4fa0c4d9-b9eb-4491-a7d2-1fb6dceba407 req-f1076748-12f8-4b6a-8172-423aba76c5a8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:17.856058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4fa0c4d9-b9eb-4491-a7d2-1fb6dceba407 req-f1076748-12f8-4b6a-8172-423aba76c5a8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:17.871206 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-4fa0c4d9-b9eb-4491-a7d2-1fb6dceba407 req-f1076748-12f8-4b6a-8172-423aba76c5a8 service nova] Creating event network-vif-plugged:8da07a1e-c08c-4ce8-a9fc-6e6cedb2cfc7 for instance f05fddc9-d0ba-4df5-b75b-0a3ce984532a on n-h2-852087-9 Sep 07 13:46:17.877707 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-4fa0c4d9-b9eb-4491-a7d2-1fb6dceba407 req-f1076748-12f8-4b6a-8172-423aba76c5a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038286 Sep 07 13:46:17.878018 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3655/7338] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:46:18.632406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-807f3af4-b632-4b9a-91e8-3b10d4737033 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:18.633639 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-807f3af4-b632-4b9a-91e8-3b10d4737033 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: f05fddc9-d0ba-4df5-b75b-0a3ce984532a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:18.642875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-807f3af4-b632-4b9a-91e8-3b10d4737033 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:18.643389 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-807f3af4-b632-4b9a-91e8-3b10d4737033 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:18.643924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-807f3af4-b632-4b9a-91e8-3b10d4737033 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:18.644617 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-807f3af4-b632-4b9a-91e8-3b10d4737033 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:18.645121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-807f3af4-b632-4b9a-91e8-3b10d4737033 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:18.645591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-807f3af4-b632-4b9a-91e8-3b10d4737033 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:18.784399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-807f3af4-b632-4b9a-91e8-3b10d4737033 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:46:18.792991 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-807f3af4-b632-4b9a-91e8-3b10d4737033 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a" status: 200 len: 1362 microversion: 2.1 time: 0.168425 Sep 07 13:46:18.793632 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3684/7339] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:46:18 2022] GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:46:19.818073 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2b054c2d-1762-4369-9b07-db29f1a0dabb tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:19.818753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2b054c2d-1762-4369-9b07-db29f1a0dabb tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: f05fddc9-d0ba-4df5-b75b-0a3ce984532a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:19.825747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b054c2d-1762-4369-9b07-db29f1a0dabb tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:19.826235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b054c2d-1762-4369-9b07-db29f1a0dabb tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:19.826672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b054c2d-1762-4369-9b07-db29f1a0dabb tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:19.827375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b054c2d-1762-4369-9b07-db29f1a0dabb tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:19.827856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b054c2d-1762-4369-9b07-db29f1a0dabb tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:19.828288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2b054c2d-1762-4369-9b07-db29f1a0dabb tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:19.976327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2b054c2d-1762-4369-9b07-db29f1a0dabb tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:46:19.984929 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2b054c2d-1762-4369-9b07-db29f1a0dabb tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a" status: 200 len: 1554 microversion: 2.1 time: 0.172236 Sep 07 13:46:19.986285 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3656/7340] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:46:19 2022] GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:46:20.008802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8f9cc2ae-cfad-4412-81ab-a1e8c85567d0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:20.009429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8f9cc2ae-cfad-4412-81ab-a1e8c85567d0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: f05fddc9-d0ba-4df5-b75b-0a3ce984532a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:20.017168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f9cc2ae-cfad-4412-81ab-a1e8c85567d0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:20.017766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f9cc2ae-cfad-4412-81ab-a1e8c85567d0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:20.018253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f9cc2ae-cfad-4412-81ab-a1e8c85567d0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:20.019104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f9cc2ae-cfad-4412-81ab-a1e8c85567d0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:20.019647 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f9cc2ae-cfad-4412-81ab-a1e8c85567d0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:20.020109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f9cc2ae-cfad-4412-81ab-a1e8c85567d0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:20.176931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8f9cc2ae-cfad-4412-81ab-a1e8c85567d0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:46:20.185609 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8f9cc2ae-cfad-4412-81ab-a1e8c85567d0 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a" status: 200 len: 1554 microversion: 2.1 time: 0.180821 Sep 07 13:46:20.186226 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3685/7341] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:46:20 2022] GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:46:21.815104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-34268ed6-e847-4537-b1c5-ed9eddb7d99b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8ed25e2-8cff-403c-bd92-4bee55d195ea"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:46:21.818174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-34268ed6-e847-4537-b1c5-ed9eddb7d99b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: f05fddc9-d0ba-4df5-b75b-0a3ce984532a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:21.821593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:46:21.822280 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:46:21.828715 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34268ed6-e847-4537-b1c5-ed9eddb7d99b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:21.829213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34268ed6-e847-4537-b1c5-ed9eddb7d99b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:21.829684 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34268ed6-e847-4537-b1c5-ed9eddb7d99b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:21.830398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34268ed6-e847-4537-b1c5-ed9eddb7d99b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:21.831008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34268ed6-e847-4537-b1c5-ed9eddb7d99b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:21.831522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-34268ed6-e847-4537-b1c5-ed9eddb7d99b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:22.117798 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-34268ed6-e847-4537-b1c5-ed9eddb7d99b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "POST /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306444 Sep 07 13:46:22.118342 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3657/7342] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Sep 7 13:46:21 2022] POST /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:46:32.894587 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dc348c5d-3679-44d5-be4b-a629d15865f7 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:32.895139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dc348c5d-3679-44d5-be4b-a629d15865f7 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: f05fddc9-d0ba-4df5-b75b-0a3ce984532a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:32.897878 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:46:32.898740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:46:32.900558 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:46:32.907431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc348c5d-3679-44d5-be4b-a629d15865f7 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:32.907953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc348c5d-3679-44d5-be4b-a629d15865f7 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:32.908406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc348c5d-3679-44d5-be4b-a629d15865f7 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:32.909230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc348c5d-3679-44d5-be4b-a629d15865f7 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:32.909725 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc348c5d-3679-44d5-be4b-a629d15865f7 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:32.910171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dc348c5d-3679-44d5-be4b-a629d15865f7 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:33.110802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-dc348c5d-3679-44d5-be4b-a629d15865f7 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lazy-loading 'services' on Instance uuid f05fddc9-d0ba-4df5-b75b-0a3ce984532a {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:46:33.189568 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dc348c5d-3679-44d5-be4b-a629d15865f7 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a/os-volume_attachments/a8ed25e2-8cff-403c-bd92-4bee55d195ea" status: 202 len: 0 microversion: 2.1 time: 0.299045 Sep 07 13:46:33.190819 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3686/7343] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Sep 7 13:46:32 2022] DELETE /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a/os-volume_attachments/a8ed25e2-8cff-403c-bd92-4bee55d195ea => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:46:33.199967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-03903785-e71b-4ef1-a715-4bac03594b33 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:33.202611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-03903785-e71b-4ef1-a715-4bac03594b33 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: f05fddc9-d0ba-4df5-b75b-0a3ce984532a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:33.207210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:46:33.207944 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:46:33.211794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03903785-e71b-4ef1-a715-4bac03594b33 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:33.212559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03903785-e71b-4ef1-a715-4bac03594b33 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:33.212936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03903785-e71b-4ef1-a715-4bac03594b33 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:33.213823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03903785-e71b-4ef1-a715-4bac03594b33 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:33.214282 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03903785-e71b-4ef1-a715-4bac03594b33 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:33.214870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-03903785-e71b-4ef1-a715-4bac03594b33 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:33.254260 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-03903785-e71b-4ef1-a715-4bac03594b33 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058820 Sep 07 13:46:33.259310 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3658/7344] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:46:33 2022] GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:46:34.269109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ebb484b7-9c53-466b-babb-96050cd3233b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:34.271462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ebb484b7-9c53-466b-babb-96050cd3233b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: f05fddc9-d0ba-4df5-b75b-0a3ce984532a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:34.279472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebb484b7-9c53-466b-babb-96050cd3233b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:34.279991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebb484b7-9c53-466b-babb-96050cd3233b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:34.280462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebb484b7-9c53-466b-babb-96050cd3233b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:34.281420 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebb484b7-9c53-466b-babb-96050cd3233b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:34.281969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebb484b7-9c53-466b-babb-96050cd3233b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:34.282371 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ebb484b7-9c53-466b-babb-96050cd3233b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:34.316051 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ebb484b7-9c53-466b-babb-96050cd3233b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051516 Sep 07 13:46:34.323277 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3687/7345] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:46:34 2022] GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:46:35.332778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7b37262f-4948-4213-adf4-f743866afa6c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:35.335161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7b37262f-4948-4213-adf4-f743866afa6c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: f05fddc9-d0ba-4df5-b75b-0a3ce984532a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:35.341473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b37262f-4948-4213-adf4-f743866afa6c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:35.342318 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b37262f-4948-4213-adf4-f743866afa6c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:35.342760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b37262f-4948-4213-adf4-f743866afa6c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:35.343464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b37262f-4948-4213-adf4-f743866afa6c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:35.343917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b37262f-4948-4213-adf4-f743866afa6c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:35.344341 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7b37262f-4948-4213-adf4-f743866afa6c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:35.380905 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7b37262f-4948-4213-adf4-f743866afa6c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053092 Sep 07 13:46:35.381541 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3659/7346] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:46:35 2022] GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:46:36.394146 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ee6e1d4b-893e-4cce-bb77-3a6f40e5d1da tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:36.397391 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ee6e1d4b-893e-4cce-bb77-3a6f40e5d1da tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: f05fddc9-d0ba-4df5-b75b-0a3ce984532a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:36.405539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee6e1d4b-893e-4cce-bb77-3a6f40e5d1da tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:36.406114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee6e1d4b-893e-4cce-bb77-3a6f40e5d1da tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:36.406577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee6e1d4b-893e-4cce-bb77-3a6f40e5d1da tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:36.407298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee6e1d4b-893e-4cce-bb77-3a6f40e5d1da tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:36.407775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee6e1d4b-893e-4cce-bb77-3a6f40e5d1da tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:36.408273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee6e1d4b-893e-4cce-bb77-3a6f40e5d1da tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:36.440790 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ee6e1d4b-893e-4cce-bb77-3a6f40e5d1da tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050933 Sep 07 13:46:36.441377 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3688/7347] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:46:36 2022] GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:46:37.453693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e976dc40-1ad9-4014-b640-fbfc4bdf537a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:37.455948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e976dc40-1ad9-4014-b640-fbfc4bdf537a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: f05fddc9-d0ba-4df5-b75b-0a3ce984532a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:37.463668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e976dc40-1ad9-4014-b640-fbfc4bdf537a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:37.464164 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e976dc40-1ad9-4014-b640-fbfc4bdf537a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:37.464606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e976dc40-1ad9-4014-b640-fbfc4bdf537a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:37.465321 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e976dc40-1ad9-4014-b640-fbfc4bdf537a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:37.465832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e976dc40-1ad9-4014-b640-fbfc4bdf537a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:37.466286 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e976dc40-1ad9-4014-b640-fbfc4bdf537a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:37.499698 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e976dc40-1ad9-4014-b640-fbfc4bdf537a tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050122 Sep 07 13:46:37.500315 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3660/7348] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:46:37 2022] GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:46:38.512775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a9ef1466-9fe4-4180-88c9-f97bd831b0c1 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:38.515128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a9ef1466-9fe4-4180-88c9-f97bd831b0c1 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: f05fddc9-d0ba-4df5-b75b-0a3ce984532a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:38.522739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9ef1466-9fe4-4180-88c9-f97bd831b0c1 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:38.523236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9ef1466-9fe4-4180-88c9-f97bd831b0c1 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:38.523704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9ef1466-9fe4-4180-88c9-f97bd831b0c1 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:38.524428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9ef1466-9fe4-4180-88c9-f97bd831b0c1 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:38.524910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9ef1466-9fe4-4180-88c9-f97bd831b0c1 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:38.525356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a9ef1466-9fe4-4180-88c9-f97bd831b0c1 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:38.556496 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a9ef1466-9fe4-4180-88c9-f97bd831b0c1 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047801 Sep 07 13:46:38.557071 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3689/7349] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:46:38 2022] GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:46:38.568047 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0e8718cc-b834-47c7-9273-56478489865c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:38.568649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0e8718cc-b834-47c7-9273-56478489865c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: f05fddc9-d0ba-4df5-b75b-0a3ce984532a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:38.575969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e8718cc-b834-47c7-9273-56478489865c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:38.576515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e8718cc-b834-47c7-9273-56478489865c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:38.576956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e8718cc-b834-47c7-9273-56478489865c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:38.577698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e8718cc-b834-47c7-9273-56478489865c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:38.578156 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e8718cc-b834-47c7-9273-56478489865c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:38.578582 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0e8718cc-b834-47c7-9273-56478489865c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:38.718795 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-0e8718cc-b834-47c7-9273-56478489865c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] HTTP exception thrown: Instance f05fddc9-d0ba-4df5-b75b-0a3ce984532a is not attached to volume a8ed25e2-8cff-403c-bd92-4bee55d195ea Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0e8718cc-b834-47c7-9273-56478489865c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Request method failure captured: Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a/os-volume_attachments/a8ed25e2-8cff-403c-bd92-4bee55d195ea HTTP/1.1 Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGKBSFJmMS5t4m5A1zpEXatjN-8sqdkAX0BvwBV9rjMCmd5ZlAL-kQHEsOKxznNZUjwOhR5X-XPWVjonNdNP5T8Bc9DXvkRlgxW51haEchMpTQZiwnOW3GpAoVuA0WBy16jDS5MK-XdXCN9nDVgwQ35cFrenHao1daiMQggsz4FbhgAM Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 3b7b7de7cf224f9b8559751e8a6c6555 Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TestEncryptedCinderVolumes-950169269 Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b7b7de7cf224f9b8559751e8a6c6555"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3b7b7de7cf224f9b8559751e8a6c6555"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3b7b7de7cf224f9b8559751e8a6c6555"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b7b7de7cf224f9b8559751e8a6c6555"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TestEncryptedCinderVolumes-950169269 Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 3b7b7de7cf224f9b8559751e8a6c6555 Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-950169269 Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TestEncryptedCinderVolumes-950169269-project Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 4ccc18c9647148fdb48f35a6dc9c5fe5 Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TestEncryptedCinderVolumes-950169269-project Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance f05fddc9-d0ba-4df5-b75b-0a3ce984532a is not attached to volume a8ed25e2-8cff-403c-bd92-4bee55d195ea Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'server_id': 'f05fddc9-d0ba-4df5-b75b-0a3ce984532a', 'id': 'a8ed25e2-8cff-403c-bd92-4bee55d195ea'} Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a8ed25e2-8cff-403c-bd92-4bee55d195ea. Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f05fddc9-d0ba-4df5-b75b-0a3ce984532a is not attached to volume a8ed25e2-8cff-403c-bd92-4bee55d195ea Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:46:38.720477 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:46:38.728172 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:46:38.728172 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:46:38.728172 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f05fddc9-d0ba-4df5-b75b-0a3ce984532a is not attached to volume a8ed25e2-8cff-403c-bd92-4bee55d195ea Sep 07 13:46:38.728172 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:46:38.728172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0e8718cc-b834-47c7-9273-56478489865c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Returning 404 to user: Instance f05fddc9-d0ba-4df5-b75b-0a3ce984532a is not attached to volume a8ed25e2-8cff-403c-bd92-4bee55d195ea {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:46:38.728172 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0e8718cc-b834-47c7-9273-56478489865c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a/os-volume_attachments/a8ed25e2-8cff-403c-bd92-4bee55d195ea" status: 404 len: 154 microversion: 2.1 time: 0.158174 Sep 07 13:46:38.728172 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3661/7350] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Sep 7 13:46:38 2022] DELETE /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a/os-volume_attachments/a8ed25e2-8cff-403c-bd92-4bee55d195ea => generated 154 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:46:42.092904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5e1335df-dd6e-4657-ae56-d6b2b0ffa60c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:42.093506 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5e1335df-dd6e-4657-ae56-d6b2b0ffa60c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: f05fddc9-d0ba-4df5-b75b-0a3ce984532a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:42.100597 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e1335df-dd6e-4657-ae56-d6b2b0ffa60c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:42.101113 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e1335df-dd6e-4657-ae56-d6b2b0ffa60c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:42.101600 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e1335df-dd6e-4657-ae56-d6b2b0ffa60c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:42.102342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e1335df-dd6e-4657-ae56-d6b2b0ffa60c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:42.102819 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e1335df-dd6e-4657-ae56-d6b2b0ffa60c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:42.103265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e1335df-dd6e-4657-ae56-d6b2b0ffa60c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:42.131581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5e1335df-dd6e-4657-ae56-d6b2b0ffa60c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: f05fddc9-d0ba-4df5-b75b-0a3ce984532a] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:46:42.215702 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5e1335df-dd6e-4657-ae56-d6b2b0ffa60c tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a" status: 204 len: 0 microversion: 2.1 time: 0.126782 Sep 07 13:46:42.216339 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3690/7351] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:46:42 2022] DELETE /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 13:46:42.225051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8712282d-1ab5-4e46-bf85-b3d1d7f9ede9 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:42.225911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8712282d-1ab5-4e46-bf85-b3d1d7f9ede9 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: f05fddc9-d0ba-4df5-b75b-0a3ce984532a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:42.233865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8712282d-1ab5-4e46-bf85-b3d1d7f9ede9 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:42.234434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8712282d-1ab5-4e46-bf85-b3d1d7f9ede9 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:42.234939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8712282d-1ab5-4e46-bf85-b3d1d7f9ede9 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:42.235700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8712282d-1ab5-4e46-bf85-b3d1d7f9ede9 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:42.236334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8712282d-1ab5-4e46-bf85-b3d1d7f9ede9 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:42.236850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8712282d-1ab5-4e46-bf85-b3d1d7f9ede9 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:42.375911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8712282d-1ab5-4e46-bf85-b3d1d7f9ede9 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:46:42.384587 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8712282d-1ab5-4e46-bf85-b3d1d7f9ede9 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a" status: 200 len: 1560 microversion: 2.1 time: 0.163584 Sep 07 13:46:42.385269 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3662/7352] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:46:42 2022] GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:46:43.410145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ba2f5364-36ab-4765-961c-a1d508870061 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:43.410870 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ba2f5364-36ab-4765-961c-a1d508870061 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: f05fddc9-d0ba-4df5-b75b-0a3ce984532a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:43.418281 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba2f5364-36ab-4765-961c-a1d508870061 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:43.418793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba2f5364-36ab-4765-961c-a1d508870061 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:43.419253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba2f5364-36ab-4765-961c-a1d508870061 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:43.419967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba2f5364-36ab-4765-961c-a1d508870061 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:43.420459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba2f5364-36ab-4765-961c-a1d508870061 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:43.420902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ba2f5364-36ab-4765-961c-a1d508870061 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:43.573198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ba2f5364-36ab-4765-961c-a1d508870061 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:46:43.584056 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ba2f5364-36ab-4765-961c-a1d508870061 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a" status: 200 len: 1560 microversion: 2.1 time: 0.178486 Sep 07 13:46:43.584645 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3691/7353] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:46:43 2022] GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:46:44.613736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-78a65a03-53b9-4d8c-b577-6ca11f231944 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:44.614356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-78a65a03-53b9-4d8c-b577-6ca11f231944 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: f05fddc9-d0ba-4df5-b75b-0a3ce984532a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:44.621568 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78a65a03-53b9-4d8c-b577-6ca11f231944 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:44.622056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78a65a03-53b9-4d8c-b577-6ca11f231944 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:44.622504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78a65a03-53b9-4d8c-b577-6ca11f231944 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:44.623215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78a65a03-53b9-4d8c-b577-6ca11f231944 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:44.623672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78a65a03-53b9-4d8c-b577-6ca11f231944 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:44.624099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78a65a03-53b9-4d8c-b577-6ca11f231944 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:44.690083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-78a65a03-53b9-4d8c-b577-6ca11f231944 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc18c9647148fdb48f35a6dc9c5fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7b7de7cf224f9b8559751e8a6c6555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:46:44.704474 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-78a65a03-53b9-4d8c-b577-6ca11f231944 tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a" status: 200 len: 1518 microversion: 2.1 time: 0.096157 Sep 07 13:46:44.705584 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3663/7354] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:46:44 2022] GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a => generated 1518 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:46:44.718670 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0b37bbd8-7c0e-43d1-82a8-9e3a844f1205 req-efea28e1-4d07-4bdf-a53e-c9ae2c56c5bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f05fddc9-d0ba-4df5-b75b-0a3ce984532a", "name": "network-vif-deleted", "tag": "8da07a1e-c08c-4ce8-a9fc-6e6cedb2cfc7"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:46:44.744235 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0b37bbd8-7c0e-43d1-82a8-9e3a844f1205 req-efea28e1-4d07-4bdf-a53e-c9ae2c56c5bb service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:44.744736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0b37bbd8-7c0e-43d1-82a8-9e3a844f1205 req-efea28e1-4d07-4bdf-a53e-c9ae2c56c5bb service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:44.745174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0b37bbd8-7c0e-43d1-82a8-9e3a844f1205 req-efea28e1-4d07-4bdf-a53e-c9ae2c56c5bb service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:44.760364 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0b37bbd8-7c0e-43d1-82a8-9e3a844f1205 req-efea28e1-4d07-4bdf-a53e-c9ae2c56c5bb service nova] Creating event network-vif-deleted:8da07a1e-c08c-4ce8-a9fc-6e6cedb2cfc7 for instance f05fddc9-d0ba-4df5-b75b-0a3ce984532a on n-h2-852087-9 Sep 07 13:46:44.767561 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0b37bbd8-7c0e-43d1-82a8-9e3a844f1205 req-efea28e1-4d07-4bdf-a53e-c9ae2c56c5bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052733 Sep 07 13:46:44.768480 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3692/7355] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:46:45.728577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5962326d-cf23-4a82-872a-0f4613ae136b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:45.729180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5962326d-cf23-4a82-872a-0f4613ae136b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] [instance: f05fddc9-d0ba-4df5-b75b-0a3ce984532a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:46:45.737182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5962326d-cf23-4a82-872a-0f4613ae136b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:45.737825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5962326d-cf23-4a82-872a-0f4613ae136b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:45.738401 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5962326d-cf23-4a82-872a-0f4613ae136b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:45.739455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5962326d-cf23-4a82-872a-0f4613ae136b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:46:45.740009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5962326d-cf23-4a82-872a-0f4613ae136b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:46:45.740589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5962326d-cf23-4a82-872a-0f4613ae136b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:46:45.759063 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-5962326d-cf23-4a82-872a-0f4613ae136b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] HTTP exception thrown: Instance f05fddc9-d0ba-4df5-b75b-0a3ce984532a could not be found. Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5962326d-cf23-4a82-872a-0f4613ae136b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Request method failure captured: Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a HTTP/1.1 Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGKBSFJmMS5t4m5A1zpEXatjN-8sqdkAX0BvwBV9rjMCmd5ZlAL-kQHEsOKxznNZUjwOhR5X-XPWVjonNdNP5T8Bc9DXvkRlgxW51haEchMpTQZiwnOW3GpAoVuA0WBy16jDS5MK-XdXCN9nDVgwQ35cFrenHao1daiMQggsz4FbhgAM Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 3b7b7de7cf224f9b8559751e8a6c6555 Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TestEncryptedCinderVolumes-950169269 Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b7b7de7cf224f9b8559751e8a6c6555"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3b7b7de7cf224f9b8559751e8a6c6555"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3b7b7de7cf224f9b8559751e8a6c6555"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b7b7de7cf224f9b8559751e8a6c6555"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TestEncryptedCinderVolumes-950169269 Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 3b7b7de7cf224f9b8559751e8a6c6555 Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-950169269 Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TestEncryptedCinderVolumes-950169269-project Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 4ccc18c9647148fdb48f35a6dc9c5fe5 Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TestEncryptedCinderVolumes-950169269-project Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance f05fddc9-d0ba-4df5-b75b-0a3ce984532a could not be found. Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'f05fddc9-d0ba-4df5-b75b-0a3ce984532a'} Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f05fddc9-d0ba-4df5-b75b-0a3ce984532a could not be found. Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f05fddc9-d0ba-4df5-b75b-0a3ce984532a could not be found. Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:46:45.760631 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:46:45.765258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:46:45.765258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:46:45.765258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:46:45.765258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:46:45.765258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:46:45.765258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f05fddc9-d0ba-4df5-b75b-0a3ce984532a could not be found. Sep 07 13:46:45.765258 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:46:45.765258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5962326d-cf23-4a82-872a-0f4613ae136b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Returning 404 to user: Instance f05fddc9-d0ba-4df5-b75b-0a3ce984532a could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:46:45.765258 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5962326d-cf23-4a82-872a-0f4613ae136b tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a" status: 404 len: 111 microversion: 2.1 time: 0.037623 Sep 07 13:46:45.765258 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3664/7356] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:46:45 2022] GET /compute/v2.1/servers/f05fddc9-d0ba-4df5-b75b-0a3ce984532a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:46:45.772032 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3c8bcac8-43f4-4170-af7f-3a40c306733e tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] Calling method '.version_select at 0x7fc413e46310>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:46:45.798485 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3c8bcac8-43f4-4170-af7f-3a40c306733e tempest-TestEncryptedCinderVolumes-950169269 tempest-TestEncryptedCinderVolumes-950169269-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-964501342" status: 202 len: 0 microversion: 2.1 time: 0.030289 Sep 07 13:46:45.800095 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3693/7357] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Sep 7 13:46:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-964501342 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:47:13.928221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d5575240-8199-4180-b258-addf80836dee tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Action: 'create', calling method: .version_select at 0x7fc4139e9550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1585450341", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhNEof9j9l46EMuO61fD/FIvOabVtYWA00YXGS+Xig36ghDlS7MvXlnGl1aNR+DlAkPKzo+zD3WWUom9j25oQ4gnjJpDXkM7VywNXt2BBtd/DgHLd3hR4vyvsfVYr9AhQ=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:47:13.933941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=14 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:47:13.934570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=38 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:47:13.948201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-d5575240-8199-4180-b258-addf80836dee tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Getting quotas for project 5ddc25bba099486cabbc8456ba351729. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:47:13.953729 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-d5575240-8199-4180-b258-addf80836dee tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Getting quotas for user 9288bb00c59f4be383f74dccddc6ce40 and project 5ddc25bba099486cabbc8456ba351729. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:47:13.984268 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d5575240-8199-4180-b258-addf80836dee tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.060322 Sep 07 13:47:13.984871 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3665/7358] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 13:47:13 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:47:14.037342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:47:14.038278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:47:14.042986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-839b2b3b-4ced-4fd6-a279-3c3a386c0652 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-730348753", "imageRef": "d954f8cf-3d12-4066-a663-8ebff1600aa7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1585450341", "networks": [{"uuid": "6dca1f6e-dff1-4ed9-b00d-13a98e71f544"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:47:14.097615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-839b2b3b-4ced-4fd6-a279-3c3a386c0652 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] validate_networks() for [('6dca1f6e-dff1-4ed9-b00d-13a98e71f544', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:47:14.529417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-839b2b3b-4ced-4fd6-a279-3c3a386c0652 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:47:14.529896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-839b2b3b-4ced-4fd6-a279-3c3a386c0652 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:47:14.530399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-839b2b3b-4ced-4fd6-a279-3c3a386c0652 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:47:14.530825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-839b2b3b-4ced-4fd6-a279-3c3a386c0652 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:47:14.531260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-839b2b3b-4ced-4fd6-a279-3c3a386c0652 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:47:14.541062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-839b2b3b-4ced-4fd6-a279-3c3a386c0652 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:14.541602 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-839b2b3b-4ced-4fd6-a279-3c3a386c0652 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:14.542062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-839b2b3b-4ced-4fd6-a279-3c3a386c0652 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:14.542811 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-839b2b3b-4ced-4fd6-a279-3c3a386c0652 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:14.543322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-839b2b3b-4ced-4fd6-a279-3c3a386c0652 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:14.543729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-839b2b3b-4ced-4fd6-a279-3c3a386c0652 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:14.562417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-839b2b3b-4ced-4fd6-a279-3c3a386c0652 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Getting quotas for project 5ddc25bba099486cabbc8456ba351729. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:47:14.568166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-839b2b3b-4ced-4fd6-a279-3c3a386c0652 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Getting quotas for user 9288bb00c59f4be383f74dccddc6ce40 and project 5ddc25bba099486cabbc8456ba351729. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:47:14.581924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-839b2b3b-4ced-4fd6-a279-3c3a386c0652 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:47:14.584340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-839b2b3b-4ced-4fd6-a279-3c3a386c0652 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d954f8cf-3d12-4066-a663-8ebff1600aa7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:47:14.638890 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-839b2b3b-4ced-4fd6-a279-3c3a386c0652 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603888 Sep 07 13:47:14.639545 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3694/7359] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:47:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:47:14.650890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5c2acac0-a6c8-462a-90ef-5dcda6cbfcfa tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:14.651676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5c2acac0-a6c8-462a-90ef-5dcda6cbfcfa tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:14.716520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5c2acac0-a6c8-462a-90ef-5dcda6cbfcfa tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:14.725114 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5c2acac0-a6c8-462a-90ef-5dcda6cbfcfa tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 200 len: 1258 microversion: 2.1 time: 0.078296 Sep 07 13:47:14.725756 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3666/7360] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:14 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 1258 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:15.750155 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bf03a498-9401-4bb6-9d2c-45505a8e4827 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:15.751032 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bf03a498-9401-4bb6-9d2c-45505a8e4827 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:15.757740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf03a498-9401-4bb6-9d2c-45505a8e4827 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:15.758255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf03a498-9401-4bb6-9d2c-45505a8e4827 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:15.758710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf03a498-9401-4bb6-9d2c-45505a8e4827 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:15.759428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf03a498-9401-4bb6-9d2c-45505a8e4827 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:15.759922 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf03a498-9401-4bb6-9d2c-45505a8e4827 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:15.760370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf03a498-9401-4bb6-9d2c-45505a8e4827 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:15.833631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bf03a498-9401-4bb6-9d2c-45505a8e4827 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:15.843950 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bf03a498-9401-4bb6-9d2c-45505a8e4827 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 200 len: 1310 microversion: 2.1 time: 0.098410 Sep 07 13:47:15.844543 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3695/7361] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:15 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 1310 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:16.869090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fff35e85-1987-44b5-b4c6-014f5143bfc8 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:16.875647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fff35e85-1987-44b5-b4c6-014f5143bfc8 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:16.887104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fff35e85-1987-44b5-b4c6-014f5143bfc8 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:16.893216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fff35e85-1987-44b5-b4c6-014f5143bfc8 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:16.893730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fff35e85-1987-44b5-b4c6-014f5143bfc8 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:16.894488 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fff35e85-1987-44b5-b4c6-014f5143bfc8 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:16.896484 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fff35e85-1987-44b5-b4c6-014f5143bfc8 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:16.897180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fff35e85-1987-44b5-b4c6-014f5143bfc8 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:17.065992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fff35e85-1987-44b5-b4c6-014f5143bfc8 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:17.075763 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fff35e85-1987-44b5-b4c6-014f5143bfc8 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 200 len: 1358 microversion: 2.1 time: 0.211823 Sep 07 13:47:17.076690 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3667/7362] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:16 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:18.100721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4e324b7e-44c5-4715-ae96-43413cba91a6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:18.101587 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4e324b7e-44c5-4715-ae96-43413cba91a6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:18.109264 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e324b7e-44c5-4715-ae96-43413cba91a6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:18.109795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e324b7e-44c5-4715-ae96-43413cba91a6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:18.110260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e324b7e-44c5-4715-ae96-43413cba91a6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:18.110992 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e324b7e-44c5-4715-ae96-43413cba91a6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:18.111592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e324b7e-44c5-4715-ae96-43413cba91a6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:18.112060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4e324b7e-44c5-4715-ae96-43413cba91a6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:18.268640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4e324b7e-44c5-4715-ae96-43413cba91a6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:18.278058 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4e324b7e-44c5-4715-ae96-43413cba91a6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 200 len: 1358 microversion: 2.1 time: 0.181875 Sep 07 13:47:18.279028 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3696/7363] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:18 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:19.302718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-159621d3-0106-48a8-9c20-18e7f2a66221 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:19.303326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-159621d3-0106-48a8-9c20-18e7f2a66221 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:19.311584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-159621d3-0106-48a8-9c20-18e7f2a66221 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:19.312084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-159621d3-0106-48a8-9c20-18e7f2a66221 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:19.312526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-159621d3-0106-48a8-9c20-18e7f2a66221 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:19.313210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-159621d3-0106-48a8-9c20-18e7f2a66221 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:19.313992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-159621d3-0106-48a8-9c20-18e7f2a66221 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:19.314427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-159621d3-0106-48a8-9c20-18e7f2a66221 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:19.457594 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-159621d3-0106-48a8-9c20-18e7f2a66221 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:19.466470 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-159621d3-0106-48a8-9c20-18e7f2a66221 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 200 len: 1358 microversion: 2.1 time: 0.168549 Sep 07 13:47:19.467599 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3668/7364] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:19 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:20.492480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7034867c-0c5c-4020-aaf3-bca8931a79d3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:20.493245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7034867c-0c5c-4020-aaf3-bca8931a79d3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:20.500576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7034867c-0c5c-4020-aaf3-bca8931a79d3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:20.501169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7034867c-0c5c-4020-aaf3-bca8931a79d3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:20.501728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7034867c-0c5c-4020-aaf3-bca8931a79d3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:20.502591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7034867c-0c5c-4020-aaf3-bca8931a79d3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:20.503132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7034867c-0c5c-4020-aaf3-bca8931a79d3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:20.503647 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7034867c-0c5c-4020-aaf3-bca8931a79d3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:20.664282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7034867c-0c5c-4020-aaf3-bca8931a79d3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:20.673035 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7034867c-0c5c-4020-aaf3-bca8931a79d3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 200 len: 1358 microversion: 2.1 time: 0.184525 Sep 07 13:47:20.673720 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3697/7365] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:20 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:47:21.697841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-16ec9aab-8036-4432-8328-71eae59a776a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:21.699373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-16ec9aab-8036-4432-8328-71eae59a776a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:21.708167 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16ec9aab-8036-4432-8328-71eae59a776a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:21.708760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16ec9aab-8036-4432-8328-71eae59a776a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:21.709550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16ec9aab-8036-4432-8328-71eae59a776a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:21.710359 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16ec9aab-8036-4432-8328-71eae59a776a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:21.710886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16ec9aab-8036-4432-8328-71eae59a776a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:21.711389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-16ec9aab-8036-4432-8328-71eae59a776a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:21.859438 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-16ec9aab-8036-4432-8328-71eae59a776a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:21.868378 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-16ec9aab-8036-4432-8328-71eae59a776a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 200 len: 1358 microversion: 2.1 time: 0.174627 Sep 07 13:47:21.868985 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3669/7366] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:21 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:22.895930 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e2bf6840-d65c-4e15-a2c8-e5dba2bd436b tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:22.896598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e2bf6840-d65c-4e15-a2c8-e5dba2bd436b tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:22.905978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2bf6840-d65c-4e15-a2c8-e5dba2bd436b tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:22.906515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2bf6840-d65c-4e15-a2c8-e5dba2bd436b tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:22.906954 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2bf6840-d65c-4e15-a2c8-e5dba2bd436b tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:22.907685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2bf6840-d65c-4e15-a2c8-e5dba2bd436b tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:22.908231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2bf6840-d65c-4e15-a2c8-e5dba2bd436b tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:22.908704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e2bf6840-d65c-4e15-a2c8-e5dba2bd436b tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:23.062581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e2bf6840-d65c-4e15-a2c8-e5dba2bd436b tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:23.072954 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e2bf6840-d65c-4e15-a2c8-e5dba2bd436b tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 200 len: 1358 microversion: 2.1 time: 0.181191 Sep 07 13:47:23.073762 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3698/7367] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:22 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:24.096910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-66559c8b-06ca-43ba-b13c-8768559bb88e tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:24.097556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-66559c8b-06ca-43ba-b13c-8768559bb88e tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:24.104978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66559c8b-06ca-43ba-b13c-8768559bb88e tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:24.105464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66559c8b-06ca-43ba-b13c-8768559bb88e tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:24.105929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66559c8b-06ca-43ba-b13c-8768559bb88e tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:24.106710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66559c8b-06ca-43ba-b13c-8768559bb88e tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:24.107235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66559c8b-06ca-43ba-b13c-8768559bb88e tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:24.107690 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-66559c8b-06ca-43ba-b13c-8768559bb88e tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:24.250122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-66559c8b-06ca-43ba-b13c-8768559bb88e tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:24.260884 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-66559c8b-06ca-43ba-b13c-8768559bb88e tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 200 len: 1358 microversion: 2.1 time: 0.167894 Sep 07 13:47:24.261588 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3670/7368] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:24 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:25.286784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-17255d8e-509b-440c-9937-df36baf55ec4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:25.287561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-17255d8e-509b-440c-9937-df36baf55ec4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:25.290452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:47:25.291498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:47:25.297243 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17255d8e-509b-440c-9937-df36baf55ec4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:25.297785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17255d8e-509b-440c-9937-df36baf55ec4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:25.298245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17255d8e-509b-440c-9937-df36baf55ec4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:25.298977 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17255d8e-509b-440c-9937-df36baf55ec4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:25.299586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17255d8e-509b-440c-9937-df36baf55ec4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:25.300045 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17255d8e-509b-440c-9937-df36baf55ec4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:25.358025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-6a6c4f1e-57e2-4b69-80ef-1dffdc2383b9 req-897c698c-048a-4ebd-ad25-78ce36378ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e42f8895-e5fb-49c8-a2e3-3f93c18480b1", "tag": "e76e3852-90f9-4296-bb8f-15772b16f09c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:47:25.363315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:47:25.380054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6a6c4f1e-57e2-4b69-80ef-1dffdc2383b9 req-897c698c-048a-4ebd-ad25-78ce36378ec3 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:25.380546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6a6c4f1e-57e2-4b69-80ef-1dffdc2383b9 req-897c698c-048a-4ebd-ad25-78ce36378ec3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:25.380997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6a6c4f1e-57e2-4b69-80ef-1dffdc2383b9 req-897c698c-048a-4ebd-ad25-78ce36378ec3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:25.395316 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-6a6c4f1e-57e2-4b69-80ef-1dffdc2383b9 req-897c698c-048a-4ebd-ad25-78ce36378ec3 service nova] Creating event network-changed:e76e3852-90f9-4296-bb8f-15772b16f09c for instance e42f8895-e5fb-49c8-a2e3-3f93c18480b1 on n-h2-852087-9 Sep 07 13:47:25.406836 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-6a6c4f1e-57e2-4b69-80ef-1dffdc2383b9 req-897c698c-048a-4ebd-ad25-78ce36378ec3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052512 Sep 07 13:47:25.407919 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3671/7369] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:47:25.468263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-17255d8e-509b-440c-9937-df36baf55ec4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:25.476952 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-17255d8e-509b-440c-9937-df36baf55ec4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 200 len: 1358 microversion: 2.1 time: 0.194294 Sep 07 13:47:25.477561 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3699/7370] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:25 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:26.502140 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-43754940-d8cf-47e2-9d7b-d18ddee2465c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:26.502717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-43754940-d8cf-47e2-9d7b-d18ddee2465c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:26.509578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43754940-d8cf-47e2-9d7b-d18ddee2465c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:26.510071 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43754940-d8cf-47e2-9d7b-d18ddee2465c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:26.510507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43754940-d8cf-47e2-9d7b-d18ddee2465c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:26.511197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43754940-d8cf-47e2-9d7b-d18ddee2465c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:26.511636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43754940-d8cf-47e2-9d7b-d18ddee2465c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:26.512060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43754940-d8cf-47e2-9d7b-d18ddee2465c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:26.658630 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-43754940-d8cf-47e2-9d7b-d18ddee2465c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:26.666953 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-43754940-d8cf-47e2-9d7b-d18ddee2465c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 200 len: 1358 microversion: 2.1 time: 0.170203 Sep 07 13:47:26.667536 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3672/7371] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:26 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:27.691704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0a46ab85-d0b2-4438-8ebb-0c580c8d52af tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:27.693558 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0a46ab85-d0b2-4438-8ebb-0c580c8d52af tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:27.701539 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a46ab85-d0b2-4438-8ebb-0c580c8d52af tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:27.702217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a46ab85-d0b2-4438-8ebb-0c580c8d52af tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:27.702738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a46ab85-d0b2-4438-8ebb-0c580c8d52af tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:27.703605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a46ab85-d0b2-4438-8ebb-0c580c8d52af tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:27.704134 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a46ab85-d0b2-4438-8ebb-0c580c8d52af tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:27.704719 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a46ab85-d0b2-4438-8ebb-0c580c8d52af tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:27.866393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0a46ab85-d0b2-4438-8ebb-0c580c8d52af tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:27.878878 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0a46ab85-d0b2-4438-8ebb-0c580c8d52af tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 200 len: 1358 microversion: 2.1 time: 0.192659 Sep 07 13:47:27.879662 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3700/7372] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:27 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:28.902712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-af58f52a-e90d-474c-94a4-4086b02ec319 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:28.903101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-af58f52a-e90d-474c-94a4-4086b02ec319 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:28.910416 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af58f52a-e90d-474c-94a4-4086b02ec319 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:28.910912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af58f52a-e90d-474c-94a4-4086b02ec319 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:28.911351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af58f52a-e90d-474c-94a4-4086b02ec319 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:28.912057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af58f52a-e90d-474c-94a4-4086b02ec319 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:28.912513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af58f52a-e90d-474c-94a4-4086b02ec319 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:28.912941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-af58f52a-e90d-474c-94a4-4086b02ec319 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:29.057996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-af58f52a-e90d-474c-94a4-4086b02ec319 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:29.074678 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-af58f52a-e90d-474c-94a4-4086b02ec319 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 200 len: 1358 microversion: 2.1 time: 0.176298 Sep 07 13:47:29.077173 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3673/7373] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:28 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:30.100560 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6fdac62e-bf0e-4fe8-83b7-46e2ffde0610 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:30.101343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6fdac62e-bf0e-4fe8-83b7-46e2ffde0610 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:30.108761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fdac62e-bf0e-4fe8-83b7-46e2ffde0610 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:30.109272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fdac62e-bf0e-4fe8-83b7-46e2ffde0610 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:30.109798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fdac62e-bf0e-4fe8-83b7-46e2ffde0610 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:30.110550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fdac62e-bf0e-4fe8-83b7-46e2ffde0610 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:30.111168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fdac62e-bf0e-4fe8-83b7-46e2ffde0610 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:30.111484 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6fdac62e-bf0e-4fe8-83b7-46e2ffde0610 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:30.249750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6fdac62e-bf0e-4fe8-83b7-46e2ffde0610 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:30.258360 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6fdac62e-bf0e-4fe8-83b7-46e2ffde0610 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 200 len: 1358 microversion: 2.1 time: 0.161726 Sep 07 13:47:30.258955 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3701/7374] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:30 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:31.282788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-32210b05-ed0f-4efc-9c92-d9c21380674f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:31.283380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-32210b05-ed0f-4efc-9c92-d9c21380674f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:31.290614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32210b05-ed0f-4efc-9c92-d9c21380674f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:31.291153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32210b05-ed0f-4efc-9c92-d9c21380674f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:31.291645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32210b05-ed0f-4efc-9c92-d9c21380674f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:31.292444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32210b05-ed0f-4efc-9c92-d9c21380674f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:31.293066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32210b05-ed0f-4efc-9c92-d9c21380674f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:31.293459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-32210b05-ed0f-4efc-9c92-d9c21380674f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:31.429152 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-32210b05-ed0f-4efc-9c92-d9c21380674f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:31.437210 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-32210b05-ed0f-4efc-9c92-d9c21380674f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 200 len: 1358 microversion: 2.1 time: 0.158529 Sep 07 13:47:31.437848 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3674/7375] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:31 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:32.256948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0cb6830b-5bb8-49fe-9fda-93ecd6378088 req-af314c8e-82ae-44cc-8209-a8b0a8dc9e50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e42f8895-e5fb-49c8-a2e3-3f93c18480b1", "name": "network-vif-plugged", "status": "completed", "tag": "e76e3852-90f9-4296-bb8f-15772b16f09c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:47:32.267649 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0cb6830b-5bb8-49fe-9fda-93ecd6378088 req-af314c8e-82ae-44cc-8209-a8b0a8dc9e50 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:32.268161 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0cb6830b-5bb8-49fe-9fda-93ecd6378088 req-af314c8e-82ae-44cc-8209-a8b0a8dc9e50 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:32.268608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0cb6830b-5bb8-49fe-9fda-93ecd6378088 req-af314c8e-82ae-44cc-8209-a8b0a8dc9e50 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:32.281573 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0cb6830b-5bb8-49fe-9fda-93ecd6378088 req-af314c8e-82ae-44cc-8209-a8b0a8dc9e50 service nova] Creating event network-vif-plugged:e76e3852-90f9-4296-bb8f-15772b16f09c for instance e42f8895-e5fb-49c8-a2e3-3f93c18480b1 on n-h2-852087-9 Sep 07 13:47:32.286905 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0cb6830b-5bb8-49fe-9fda-93ecd6378088 req-af314c8e-82ae-44cc-8209-a8b0a8dc9e50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034039 Sep 07 13:47:32.287718 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3702/7376] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:47:32.460383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c99f89d9-5f82-4b7c-a14b-ce154b18f8e4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:32.461646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c99f89d9-5f82-4b7c-a14b-ce154b18f8e4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:32.469136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c99f89d9-5f82-4b7c-a14b-ce154b18f8e4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:32.469874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c99f89d9-5f82-4b7c-a14b-ce154b18f8e4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:32.470493 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c99f89d9-5f82-4b7c-a14b-ce154b18f8e4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:32.471447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c99f89d9-5f82-4b7c-a14b-ce154b18f8e4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:32.471845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c99f89d9-5f82-4b7c-a14b-ce154b18f8e4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:32.472490 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c99f89d9-5f82-4b7c-a14b-ce154b18f8e4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:32.632185 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c99f89d9-5f82-4b7c-a14b-ce154b18f8e4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:32.640387 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c99f89d9-5f82-4b7c-a14b-ce154b18f8e4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 200 len: 1358 microversion: 2.1 time: 0.184036 Sep 07 13:47:32.641199 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3675/7377] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:32 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:47:33.673956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-85ac6d40-ce06-4882-903d-7c1e07b4c462 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:33.674686 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-85ac6d40-ce06-4882-903d-7c1e07b4c462 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:33.681275 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85ac6d40-ce06-4882-903d-7c1e07b4c462 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:33.681813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85ac6d40-ce06-4882-903d-7c1e07b4c462 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:33.682273 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85ac6d40-ce06-4882-903d-7c1e07b4c462 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:33.682991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85ac6d40-ce06-4882-903d-7c1e07b4c462 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:33.683465 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85ac6d40-ce06-4882-903d-7c1e07b4c462 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:33.683911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-85ac6d40-ce06-4882-903d-7c1e07b4c462 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:33.820416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-85ac6d40-ce06-4882-903d-7c1e07b4c462 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:33.828492 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-85ac6d40-ce06-4882-903d-7c1e07b4c462 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 200 len: 1548 microversion: 2.1 time: 0.161736 Sep 07 13:47:33.829105 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3703/7378] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:33 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:33.851649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1580fa78-8de9-418a-ab70-e74a5b92ba50 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:33.852262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1580fa78-8de9-418a-ab70-e74a5b92ba50 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:33.859926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1580fa78-8de9-418a-ab70-e74a5b92ba50 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:33.860460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1580fa78-8de9-418a-ab70-e74a5b92ba50 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:33.861033 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1580fa78-8de9-418a-ab70-e74a5b92ba50 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:33.861777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1580fa78-8de9-418a-ab70-e74a5b92ba50 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:33.862240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1580fa78-8de9-418a-ab70-e74a5b92ba50 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:33.862653 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1580fa78-8de9-418a-ab70-e74a5b92ba50 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:34.003637 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1580fa78-8de9-418a-ab70-e74a5b92ba50 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:34.018579 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1580fa78-8de9-418a-ab70-e74a5b92ba50 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 200 len: 1548 microversion: 2.1 time: 0.170656 Sep 07 13:47:34.019396 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3676/7379] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:33 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:34.043694 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a1ede32f-5303-4c73-b711-58d356ed01cd tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:34.050952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a1ede32f-5303-4c73-b711-58d356ed01cd tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:34.051770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a1ede32f-5303-4c73-b711-58d356ed01cd tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Searching by: {'deleted': False, 'project_id': '5ddc25bba099486cabbc8456ba351729'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 13:47:34.057550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1ede32f-5303-4c73-b711-58d356ed01cd tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:34.058077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1ede32f-5303-4c73-b711-58d356ed01cd tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:34.058525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1ede32f-5303-4c73-b711-58d356ed01cd tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:34.059258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1ede32f-5303-4c73-b711-58d356ed01cd tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:34.059699 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1ede32f-5303-4c73-b711-58d356ed01cd tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:34.060134 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a1ede32f-5303-4c73-b711-58d356ed01cd tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:34.086783 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-a1ede32f-5303-4c73-b711-58d356ed01cd tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 13:47:34.115748 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a1ede32f-5303-4c73-b711-58d356ed01cd tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.078413 Sep 07 13:47:34.116336 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3704/7380] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Sep 7 13:47:34 2022] GET /compute/v2.1/servers => generated 342 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:47:34.128063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-aaee08dd-0463-4288-a3a8-bb18ae7cb9fc tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:34.128833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-aaee08dd-0463-4288-a3a8-bb18ae7cb9fc tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:34.135311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaee08dd-0463-4288-a3a8-bb18ae7cb9fc tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:34.135802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaee08dd-0463-4288-a3a8-bb18ae7cb9fc tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:34.136229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaee08dd-0463-4288-a3a8-bb18ae7cb9fc tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:34.136927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaee08dd-0463-4288-a3a8-bb18ae7cb9fc tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:34.137376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaee08dd-0463-4288-a3a8-bb18ae7cb9fc tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:34.137842 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-aaee08dd-0463-4288-a3a8-bb18ae7cb9fc tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:34.285020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-aaee08dd-0463-4288-a3a8-bb18ae7cb9fc tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:34.293591 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-aaee08dd-0463-4288-a3a8-bb18ae7cb9fc tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 200 len: 1548 microversion: 2.1 time: 0.169370 Sep 07 13:47:34.294209 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3677/7381] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:34 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 1548 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:35.894277 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3251a9fc-65cd-452a-abc6-ca745c712753 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e899265-6fc7-4b57-9479-df99f1376901"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:47:35.897889 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3251a9fc-65cd-452a-abc6-ca745c712753 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:35.908144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3251a9fc-65cd-452a-abc6-ca745c712753 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:35.908732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3251a9fc-65cd-452a-abc6-ca745c712753 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:35.909362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3251a9fc-65cd-452a-abc6-ca745c712753 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:35.910435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3251a9fc-65cd-452a-abc6-ca745c712753 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:35.911085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3251a9fc-65cd-452a-abc6-ca745c712753 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:35.911750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3251a9fc-65cd-452a-abc6-ca745c712753 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:36.223014 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3251a9fc-65cd-452a-abc6-ca745c712753 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "POST /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332790 Sep 07 13:47:36.223720 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3705/7382] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Sep 7 13:47:35 2022] POST /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:47:49.341809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6e88eb1d-9dae-441b-bcab-64ed1c989748 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:49.342460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6e88eb1d-9dae-441b-bcab-64ed1c989748 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:49.345615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:47:49.346192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=62 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:47:49.353279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e88eb1d-9dae-441b-bcab-64ed1c989748 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:49.353824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e88eb1d-9dae-441b-bcab-64ed1c989748 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:49.354261 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e88eb1d-9dae-441b-bcab-64ed1c989748 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:49.354958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e88eb1d-9dae-441b-bcab-64ed1c989748 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:49.355412 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e88eb1d-9dae-441b-bcab-64ed1c989748 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:49.355866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6e88eb1d-9dae-441b-bcab-64ed1c989748 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:49.489980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6e88eb1d-9dae-441b-bcab-64ed1c989748 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:49.499271 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6e88eb1d-9dae-441b-bcab-64ed1c989748 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 200 len: 1594 microversion: 2.1 time: 0.161397 Sep 07 13:47:49.499957 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3678/7383] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:49 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 1594 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:47:51.643180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-70d0195e-9b3b-455c-9611-374bedf8864a req-f8158b7e-1334-423d-bddf-2edd2a55b395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e42f8895-e5fb-49c8-a2e3-3f93c18480b1", "tag": "e76e3852-90f9-4296-bb8f-15772b16f09c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:47:51.649251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:47:51.650457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:47:51.651607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:47:51.659807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-70d0195e-9b3b-455c-9611-374bedf8864a req-f8158b7e-1334-423d-bddf-2edd2a55b395 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:51.660409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-70d0195e-9b3b-455c-9611-374bedf8864a req-f8158b7e-1334-423d-bddf-2edd2a55b395 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:51.660904 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-70d0195e-9b3b-455c-9611-374bedf8864a req-f8158b7e-1334-423d-bddf-2edd2a55b395 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:51.677405 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-70d0195e-9b3b-455c-9611-374bedf8864a req-f8158b7e-1334-423d-bddf-2edd2a55b395 service nova] Creating event network-changed:e76e3852-90f9-4296-bb8f-15772b16f09c for instance e42f8895-e5fb-49c8-a2e3-3f93c18480b1 on n-h2-852087-9 Sep 07 13:47:51.683731 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-70d0195e-9b3b-455c-9611-374bedf8864a req-f8158b7e-1334-423d-bddf-2edd2a55b395 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044775 Sep 07 13:47:51.684363 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3706/7384] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:47:52.703507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e6ec2ed9-897f-4199-b92b-3a7367f83f22 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-132553281"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:47:52.704072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e6ec2ed9-897f-4199-b92b-3a7367f83f22 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:52.711022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6ec2ed9-897f-4199-b92b-3a7367f83f22 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:52.711537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6ec2ed9-897f-4199-b92b-3a7367f83f22 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:52.711960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6ec2ed9-897f-4199-b92b-3a7367f83f22 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:52.712672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6ec2ed9-897f-4199-b92b-3a7367f83f22 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:52.713120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6ec2ed9-897f-4199-b92b-3a7367f83f22 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:52.713578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e6ec2ed9-897f-4199-b92b-3a7367f83f22 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:52.853533 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.network.security_group_api [None req-e6ec2ed9-897f-4199-b92b-3a7367f83f22 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Adding security group 10f5ce69-4e77-4e20-b36a-91e677438025 to port e76e3852-90f9-4296-bb8f-15772b16f09c Sep 07 13:47:53.189020 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e6ec2ed9-897f-4199-b92b-3a7367f83f22 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "POST /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1/action" status: 202 len: 0 microversion: 2.1 time: 0.489699 Sep 07 13:47:53.189882 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3679/7385] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:47:52 2022] POST /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:47:53.199523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b6c07b95-756c-4362-876e-d9169eb80b83 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:47:53.200455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b6c07b95-756c-4362-876e-d9169eb80b83 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:47:53.209107 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6c07b95-756c-4362-876e-d9169eb80b83 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:53.210076 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6c07b95-756c-4362-876e-d9169eb80b83 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:53.210708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6c07b95-756c-4362-876e-d9169eb80b83 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:53.211755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6c07b95-756c-4362-876e-d9169eb80b83 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:53.212424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6c07b95-756c-4362-876e-d9169eb80b83 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:53.212825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b6c07b95-756c-4362-876e-d9169eb80b83 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:53.361234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c3b9951c-bd43-4d1c-a973-7414bf869d2e req-09522d4a-e9b0-441c-a3f6-8e2ae37ed56a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e42f8895-e5fb-49c8-a2e3-3f93c18480b1", "tag": "e76e3852-90f9-4296-bb8f-15772b16f09c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:47:53.372385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c3b9951c-bd43-4d1c-a973-7414bf869d2e req-09522d4a-e9b0-441c-a3f6-8e2ae37ed56a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:47:53.373261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c3b9951c-bd43-4d1c-a973-7414bf869d2e req-09522d4a-e9b0-441c-a3f6-8e2ae37ed56a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:47:53.373843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c3b9951c-bd43-4d1c-a973-7414bf869d2e req-09522d4a-e9b0-441c-a3f6-8e2ae37ed56a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:47:53.385520 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c3b9951c-bd43-4d1c-a973-7414bf869d2e req-09522d4a-e9b0-441c-a3f6-8e2ae37ed56a service nova] Creating event network-changed:e76e3852-90f9-4296-bb8f-15772b16f09c for instance e42f8895-e5fb-49c8-a2e3-3f93c18480b1 on n-h2-852087-9 Sep 07 13:47:53.390388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b6c07b95-756c-4362-876e-d9169eb80b83 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:47:53.391103 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c3b9951c-bd43-4d1c-a973-7414bf869d2e req-09522d4a-e9b0-441c-a3f6-8e2ae37ed56a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196004 Sep 07 13:47:53.392180 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3707/7386] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:47:53.400166 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b6c07b95-756c-4362-876e-d9169eb80b83 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 200 len: 1758 microversion: 2.1 time: 0.205168 Sep 07 13:47:53.400751 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3680/7387] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:47:53 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 1758 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:49:31.533186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:49:31.534447 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:49:31.535765 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 07 13:49:31.537585 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 07 13:49:31.545674 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d61e1f15-1a39-4c0a-b874-b02c16ea4f14 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:49:31.547204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d61e1f15-1a39-4c0a-b874-b02c16ea4f14 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:49:31.554234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d61e1f15-1a39-4c0a-b874-b02c16ea4f14 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:49:31.554732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d61e1f15-1a39-4c0a-b874-b02c16ea4f14 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:49:31.555180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d61e1f15-1a39-4c0a-b874-b02c16ea4f14 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:49:31.555887 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d61e1f15-1a39-4c0a-b874-b02c16ea4f14 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:49:31.556354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d61e1f15-1a39-4c0a-b874-b02c16ea4f14 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:49:31.556820 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d61e1f15-1a39-4c0a-b874-b02c16ea4f14 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:49:31.634474 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d61e1f15-1a39-4c0a-b874-b02c16ea4f14 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "POST /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1/action" status: 202 len: 0 microversion: 2.1 time: 0.104140 Sep 07 13:49:31.635118 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3708/7388] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:49:31 2022] POST /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:49:31.642816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:49:31.643635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=16 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:49:31.645046 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:49:31.645265 n-d-852087-9 devstack@n-api.service[122432]: Wed Sep 7 13:49:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 (ip 10.222.0.16) !!! Sep 07 13:49:31.647292 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 07 13:49:31.653729 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0ce1d57c-bbbc-45f1-b6ed-88ca81a3264c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:49:31.654433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0ce1d57c-bbbc-45f1-b6ed-88ca81a3264c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:49:31.663824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ce1d57c-bbbc-45f1-b6ed-88ca81a3264c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:49:31.664312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ce1d57c-bbbc-45f1-b6ed-88ca81a3264c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:49:31.664747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ce1d57c-bbbc-45f1-b6ed-88ca81a3264c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:49:31.665444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ce1d57c-bbbc-45f1-b6ed-88ca81a3264c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:49:31.665938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ce1d57c-bbbc-45f1-b6ed-88ca81a3264c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:49:31.666362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ce1d57c-bbbc-45f1-b6ed-88ca81a3264c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:49:31.829902 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0ce1d57c-bbbc-45f1-b6ed-88ca81a3264c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:49:31.838671 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0ce1d57c-bbbc-45f1-b6ed-88ca81a3264c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 200 len: 1760 microversion: 2.1 time: 0.197711 Sep 07 13:49:31.839256 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3681/7389] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:49:31 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 1760 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:49:32.866448 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-211d66ef-eec7-43fa-88d4-9cd240e6089d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:49:32.867523 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-211d66ef-eec7-43fa-88d4-9cd240e6089d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:49:32.874976 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-211d66ef-eec7-43fa-88d4-9cd240e6089d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:49:32.875395 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-211d66ef-eec7-43fa-88d4-9cd240e6089d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:49:32.875970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-211d66ef-eec7-43fa-88d4-9cd240e6089d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:49:32.876665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-211d66ef-eec7-43fa-88d4-9cd240e6089d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:49:32.877154 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-211d66ef-eec7-43fa-88d4-9cd240e6089d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:49:32.877899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-211d66ef-eec7-43fa-88d4-9cd240e6089d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:49:33.030204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-211d66ef-eec7-43fa-88d4-9cd240e6089d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:49:33.038581 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-211d66ef-eec7-43fa-88d4-9cd240e6089d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 200 len: 1758 microversion: 2.1 time: 0.179702 Sep 07 13:49:33.039142 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3709/7390] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:49:32 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:50:47.085972 n-d-852087-9 devstack@n-api.service[122432]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78519242-4876-4a94-89c0-8fbbf97741d7] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 07 13:50:47.086756 n-d-852087-9 devstack@n-api.service[122432]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72b3548f-b60d-4e5d-9d07-5303e0946fc3] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 07 13:50:47.087733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:50:47.088481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:50:47.093192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d3ab8ef9-1eeb-4ea0-a0d2-4c9aeaddfe39 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-132553281"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:50:47.093769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d3ab8ef9-1eeb-4ea0-a0d2-4c9aeaddfe39 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:50:47.102062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3ab8ef9-1eeb-4ea0-a0d2-4c9aeaddfe39 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:50:47.102758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3ab8ef9-1eeb-4ea0-a0d2-4c9aeaddfe39 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:50:47.103348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3ab8ef9-1eeb-4ea0-a0d2-4c9aeaddfe39 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:50:47.104211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3ab8ef9-1eeb-4ea0-a0d2-4c9aeaddfe39 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:50:47.104917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3ab8ef9-1eeb-4ea0-a0d2-4c9aeaddfe39 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:50:47.105497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d3ab8ef9-1eeb-4ea0-a0d2-4c9aeaddfe39 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:50:47.251073 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.network.security_group_api [None req-d3ab8ef9-1eeb-4ea0-a0d2-4c9aeaddfe39 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Removing security group 10f5ce69-4e77-4e20-b36a-91e677438025 from port e76e3852-90f9-4296-bb8f-15772b16f09c Sep 07 13:50:47.585645 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d3ab8ef9-1eeb-4ea0-a0d2-4c9aeaddfe39 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "POST /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1/action" status: 202 len: 0 microversion: 2.1 time: 0.502579 Sep 07 13:50:47.589768 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3682/7391] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:50:47 2022] POST /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:50:47.592488 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:50:47.593498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:50:47.598433 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-6590db48-8902-408e-b59e-c548aa5c4c91 req-67138fd4-c6e3-49b1-b67b-3431d0647cbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e42f8895-e5fb-49c8-a2e3-3f93c18480b1", "tag": "e76e3852-90f9-4296-bb8f-15772b16f09c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:50:47.636332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6590db48-8902-408e-b59e-c548aa5c4c91 req-67138fd4-c6e3-49b1-b67b-3431d0647cbe service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:50:47.636966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6590db48-8902-408e-b59e-c548aa5c4c91 req-67138fd4-c6e3-49b1-b67b-3431d0647cbe service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:50:47.637435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-6590db48-8902-408e-b59e-c548aa5c4c91 req-67138fd4-c6e3-49b1-b67b-3431d0647cbe service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:50:47.668710 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-6590db48-8902-408e-b59e-c548aa5c4c91 req-67138fd4-c6e3-49b1-b67b-3431d0647cbe service nova] Creating event network-changed:e76e3852-90f9-4296-bb8f-15772b16f09c for instance e42f8895-e5fb-49c8-a2e3-3f93c18480b1 on n-h2-852087-9 Sep 07 13:50:47.675410 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-6590db48-8902-408e-b59e-c548aa5c4c91 req-67138fd4-c6e3-49b1-b67b-3431d0647cbe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084953 Sep 07 13:50:47.676283 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3710/7392] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:50:48.737250 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] [78519242-4876-4a94-89c0-8fbbf97741d7] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 39932. Sep 07 13:50:48.742388 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c371c180-f972-4d95-a7b3-45bfd944f99a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:50:48.742880 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c371c180-f972-4d95-a7b3-45bfd944f99a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:50:48.751151 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] [72b3548f-b60d-4e5d-9d07-5303e0946fc3] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 39934. Sep 07 13:50:48.756521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c371c180-f972-4d95-a7b3-45bfd944f99a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:50:48.756997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c371c180-f972-4d95-a7b3-45bfd944f99a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:50:48.757428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c371c180-f972-4d95-a7b3-45bfd944f99a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:50:48.758455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c371c180-f972-4d95-a7b3-45bfd944f99a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:50:48.758911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c371c180-f972-4d95-a7b3-45bfd944f99a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:50:48.759333 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c371c180-f972-4d95-a7b3-45bfd944f99a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:50:48.841213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-c371c180-f972-4d95-a7b3-45bfd944f99a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lazy-loading 'services' on Instance uuid e42f8895-e5fb-49c8-a2e3-3f93c18480b1 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:50:48.915934 n-d-852087-9 devstack@n-api.service[122432]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c371c180-f972-4d95-a7b3-45bfd944f99a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [f6e54446-1906-413c-8c03-8be70b54cf08] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 13:50:49.693423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-41f4ec82-364d-4f4d-81b1-0844c454e03c req-3eff3260-61a8-47bd-bfa6-d2d610b2801e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e42f8895-e5fb-49c8-a2e3-3f93c18480b1", "tag": "e76e3852-90f9-4296-bb8f-15772b16f09c"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:50:49.705542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-41f4ec82-364d-4f4d-81b1-0844c454e03c req-3eff3260-61a8-47bd-bfa6-d2d610b2801e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:50:49.706033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-41f4ec82-364d-4f4d-81b1-0844c454e03c req-3eff3260-61a8-47bd-bfa6-d2d610b2801e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:50:49.706475 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-41f4ec82-364d-4f4d-81b1-0844c454e03c req-3eff3260-61a8-47bd-bfa6-d2d610b2801e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:50:49.718306 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-41f4ec82-364d-4f4d-81b1-0844c454e03c req-3eff3260-61a8-47bd-bfa6-d2d610b2801e service nova] Creating event network-changed:e76e3852-90f9-4296-bb8f-15772b16f09c for instance e42f8895-e5fb-49c8-a2e3-3f93c18480b1 on n-h2-852087-9 Sep 07 13:50:49.724037 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-41f4ec82-364d-4f4d-81b1-0844c454e03c req-3eff3260-61a8-47bd-bfa6-d2d610b2801e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036671 Sep 07 13:50:49.724648 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3711/7393] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:50:49.923931 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [None req-c371c180-f972-4d95-a7b3-45bfd944f99a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [f6e54446-1906-413c-8c03-8be70b54cf08] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 39942. Sep 07 13:50:49.928330 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c371c180-f972-4d95-a7b3-45bfd944f99a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1/os-volume_attachments/2e899265-6fc7-4b57-9479-df99f1376901" status: 202 len: 0 microversion: 2.1 time: 1.200253 Sep 07 13:50:49.928951 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3683/7394] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Sep 7 13:50:48 2022] DELETE /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1/os-volume_attachments/2e899265-6fc7-4b57-9479-df99f1376901 => generated 0 bytes in 1201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:50:49.939443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-753d993c-f390-4cba-a73e-74c5f18977e1 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:50:49.943316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-753d993c-f390-4cba-a73e-74c5f18977e1 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:50:49.950133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-753d993c-f390-4cba-a73e-74c5f18977e1 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:50:49.950664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-753d993c-f390-4cba-a73e-74c5f18977e1 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:50:49.951157 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-753d993c-f390-4cba-a73e-74c5f18977e1 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:50:49.951881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-753d993c-f390-4cba-a73e-74c5f18977e1 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:50:49.952344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-753d993c-f390-4cba-a73e-74c5f18977e1 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:50:49.952787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-753d993c-f390-4cba-a73e-74c5f18977e1 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:50:49.984369 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-753d993c-f390-4cba-a73e-74c5f18977e1 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050487 Sep 07 13:50:49.985328 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3712/7395] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:50:49 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:50:50.999596 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-020492a1-ae4c-4f16-b3b8-cf025653ddc9 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:50:51.002096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-020492a1-ae4c-4f16-b3b8-cf025653ddc9 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:50:51.010828 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-020492a1-ae4c-4f16-b3b8-cf025653ddc9 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:50:51.011444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-020492a1-ae4c-4f16-b3b8-cf025653ddc9 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:50:51.012082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-020492a1-ae4c-4f16-b3b8-cf025653ddc9 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:50:51.013236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-020492a1-ae4c-4f16-b3b8-cf025653ddc9 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:50:51.014132 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-020492a1-ae4c-4f16-b3b8-cf025653ddc9 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:50:51.014811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-020492a1-ae4c-4f16-b3b8-cf025653ddc9 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:50:51.052276 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-020492a1-ae4c-4f16-b3b8-cf025653ddc9 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058404 Sep 07 13:50:51.052845 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3684/7396] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:50:50 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:50:52.069937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9c932804-cd1c-4c0b-8f20-283030aa0510 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:50:52.073216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9c932804-cd1c-4c0b-8f20-283030aa0510 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:50:52.081815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c932804-cd1c-4c0b-8f20-283030aa0510 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:50:52.082314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c932804-cd1c-4c0b-8f20-283030aa0510 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:50:52.082769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c932804-cd1c-4c0b-8f20-283030aa0510 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:50:52.083489 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c932804-cd1c-4c0b-8f20-283030aa0510 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:50:52.083961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c932804-cd1c-4c0b-8f20-283030aa0510 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:50:52.084395 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c932804-cd1c-4c0b-8f20-283030aa0510 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:50:52.123715 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9c932804-cd1c-4c0b-8f20-283030aa0510 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060177 Sep 07 13:50:52.124311 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3713/7397] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:50:52 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:50:53.139998 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-79db60f1-5e66-47e7-a2c2-e86181eeb229 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:50:53.142725 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-79db60f1-5e66-47e7-a2c2-e86181eeb229 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:50:53.150321 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79db60f1-5e66-47e7-a2c2-e86181eeb229 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:50:53.150761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79db60f1-5e66-47e7-a2c2-e86181eeb229 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:50:53.151214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79db60f1-5e66-47e7-a2c2-e86181eeb229 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:50:53.151955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79db60f1-5e66-47e7-a2c2-e86181eeb229 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:50:53.152409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79db60f1-5e66-47e7-a2c2-e86181eeb229 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:50:53.152843 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-79db60f1-5e66-47e7-a2c2-e86181eeb229 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:50:53.189975 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-79db60f1-5e66-47e7-a2c2-e86181eeb229 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054413 Sep 07 13:50:53.191152 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3685/7398] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:50:53 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:50:54.204174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-183f5579-fb85-4bb6-a123-443875d5522a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:50:54.206662 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-183f5579-fb85-4bb6-a123-443875d5522a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:50:54.220176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-183f5579-fb85-4bb6-a123-443875d5522a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:50:54.220786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-183f5579-fb85-4bb6-a123-443875d5522a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:50:54.221295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-183f5579-fb85-4bb6-a123-443875d5522a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:50:54.222121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-183f5579-fb85-4bb6-a123-443875d5522a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:50:54.222660 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-183f5579-fb85-4bb6-a123-443875d5522a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:50:54.223128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-183f5579-fb85-4bb6-a123-443875d5522a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:50:54.255498 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-183f5579-fb85-4bb6-a123-443875d5522a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055794 Sep 07 13:50:54.256072 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3714/7399] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:50:54 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:50:55.273114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a686ca43-f073-401b-b5cc-95ee130bab89 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:50:55.277025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a686ca43-f073-401b-b5cc-95ee130bab89 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:50:55.289718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a686ca43-f073-401b-b5cc-95ee130bab89 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:50:55.290960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a686ca43-f073-401b-b5cc-95ee130bab89 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:50:55.291739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a686ca43-f073-401b-b5cc-95ee130bab89 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:50:55.293049 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a686ca43-f073-401b-b5cc-95ee130bab89 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:50:55.293930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a686ca43-f073-401b-b5cc-95ee130bab89 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:50:55.296928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a686ca43-f073-401b-b5cc-95ee130bab89 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:50:55.356495 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a686ca43-f073-401b-b5cc-95ee130bab89 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090753 Sep 07 13:50:55.357661 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3686/7400] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:50:55 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:50:55.368888 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d4a9bbca-8eb5-4c87-95e9-f5243b4fd774 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:50:55.369626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d4a9bbca-8eb5-4c87-95e9-f5243b4fd774 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:50:55.377673 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4a9bbca-8eb5-4c87-95e9-f5243b4fd774 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:50:55.378193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4a9bbca-8eb5-4c87-95e9-f5243b4fd774 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:50:55.378656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4a9bbca-8eb5-4c87-95e9-f5243b4fd774 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:50:55.379425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4a9bbca-8eb5-4c87-95e9-f5243b4fd774 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:50:55.379903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4a9bbca-8eb5-4c87-95e9-f5243b4fd774 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:50:55.380341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d4a9bbca-8eb5-4c87-95e9-f5243b4fd774 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:50:55.470283 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-d4a9bbca-8eb5-4c87-95e9-f5243b4fd774 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] HTTP exception thrown: Instance e42f8895-e5fb-49c8-a2e3-3f93c18480b1 is not attached to volume 2e899265-6fc7-4b57-9479-df99f1376901 Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d4a9bbca-8eb5-4c87-95e9-f5243b4fd774 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Request method failure captured: Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: request: DELETE /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1/os-volume_attachments/2e899265-6fc7-4b57-9479-df99f1376901 HTTP/1.1 Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGKDSraTmkQiZCfE1vJ7DUnEZi8JGe4hTpAN7lZwblZ0hRnciVzOk2f4lgx3kLxQvTquYhapuG9hqGmdC5RvV4taEaHJ4OafpveyKJbtz4HhKXxJBMlOTyodlSORK4jMBLig0hJfcoutbX1b7-SimiezHJxelMh_G-Do7tgY5K5dx1eA Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 5ddc25bba099486cabbc8456ba351729 Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TestMinimumBasicScenario-1377569300 Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5ddc25bba099486cabbc8456ba351729"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5ddc25bba099486cabbc8456ba351729"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5ddc25bba099486cabbc8456ba351729"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5ddc25bba099486cabbc8456ba351729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TestMinimumBasicScenario-1377569300 Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 5ddc25bba099486cabbc8456ba351729 Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1377569300 Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TestMinimumBasicScenario-1377569300-project Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 9288bb00c59f4be383f74dccddc6ce40 Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TestMinimumBasicScenario-1377569300-project Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance e42f8895-e5fb-49c8-a2e3-3f93c18480b1 is not attached to volume 2e899265-6fc7-4b57-9479-df99f1376901 Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'server_id': 'e42f8895-e5fb-49c8-a2e3-3f93c18480b1', 'id': '2e899265-6fc7-4b57-9479-df99f1376901'} Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2e899265-6fc7-4b57-9479-df99f1376901. Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e42f8895-e5fb-49c8-a2e3-3f93c18480b1 is not attached to volume 2e899265-6fc7-4b57-9479-df99f1376901 Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:50:55.472369 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:50:55.477413 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:50:55.477413 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:50:55.477413 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e42f8895-e5fb-49c8-a2e3-3f93c18480b1 is not attached to volume 2e899265-6fc7-4b57-9479-df99f1376901 Sep 07 13:50:55.477413 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:50:55.477413 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d4a9bbca-8eb5-4c87-95e9-f5243b4fd774 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Returning 404 to user: Instance e42f8895-e5fb-49c8-a2e3-3f93c18480b1 is not attached to volume 2e899265-6fc7-4b57-9479-df99f1376901 {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:50:55.477413 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d4a9bbca-8eb5-4c87-95e9-f5243b4fd774 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1/os-volume_attachments/2e899265-6fc7-4b57-9479-df99f1376901" status: 404 len: 154 microversion: 2.1 time: 0.109278 Sep 07 13:50:55.477413 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3715/7401] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Sep 7 13:50:55 2022] DELETE /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1/os-volume_attachments/2e899265-6fc7-4b57-9479-df99f1376901 => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:50:58.774112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1dd8645e-e093-4a9f-bb70-4b8e1237ea5f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:50:58.774700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1dd8645e-e093-4a9f-bb70-4b8e1237ea5f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:50:58.781997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1dd8645e-e093-4a9f-bb70-4b8e1237ea5f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:50:58.782419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1dd8645e-e093-4a9f-bb70-4b8e1237ea5f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:50:58.782856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1dd8645e-e093-4a9f-bb70-4b8e1237ea5f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:50:58.783556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1dd8645e-e093-4a9f-bb70-4b8e1237ea5f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:50:58.784010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1dd8645e-e093-4a9f-bb70-4b8e1237ea5f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:50:58.784431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1dd8645e-e093-4a9f-bb70-4b8e1237ea5f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:50:58.810057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1dd8645e-e093-4a9f-bb70-4b8e1237ea5f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:50:58.910685 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1dd8645e-e093-4a9f-bb70-4b8e1237ea5f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 204 len: 0 microversion: 2.1 time: 0.140355 Sep 07 13:50:58.911321 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3687/7402] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:50:58 2022] DELETE /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:50:58.920018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9bb7f2f1-63af-46c8-a345-4536be0734f9 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:50:58.920652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9bb7f2f1-63af-46c8-a345-4536be0734f9 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:50:58.928457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bb7f2f1-63af-46c8-a345-4536be0734f9 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:50:58.928972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bb7f2f1-63af-46c8-a345-4536be0734f9 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:50:58.929427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bb7f2f1-63af-46c8-a345-4536be0734f9 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:50:58.930181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bb7f2f1-63af-46c8-a345-4536be0734f9 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:50:58.930685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bb7f2f1-63af-46c8-a345-4536be0734f9 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:50:58.931112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bb7f2f1-63af-46c8-a345-4536be0734f9 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:50:59.083175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9bb7f2f1-63af-46c8-a345-4536be0734f9 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:50:59.091776 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9bb7f2f1-63af-46c8-a345-4536be0734f9 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 200 len: 1554 microversion: 2.1 time: 0.175713 Sep 07 13:50:59.092339 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3716/7403] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:50:58 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:51:00.116489 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b3518db6-6150-455a-91ef-cb9ebe2d57e0 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:51:00.117186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b3518db6-6150-455a-91ef-cb9ebe2d57e0 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:51:00.124601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3518db6-6150-455a-91ef-cb9ebe2d57e0 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:00.125096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3518db6-6150-455a-91ef-cb9ebe2d57e0 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:00.125541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3518db6-6150-455a-91ef-cb9ebe2d57e0 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:00.126263 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3518db6-6150-455a-91ef-cb9ebe2d57e0 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:00.126717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3518db6-6150-455a-91ef-cb9ebe2d57e0 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:00.127144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3518db6-6150-455a-91ef-cb9ebe2d57e0 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:00.266338 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b3518db6-6150-455a-91ef-cb9ebe2d57e0 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:51:00.274914 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b3518db6-6150-455a-91ef-cb9ebe2d57e0 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 200 len: 1554 microversion: 2.1 time: 0.162880 Sep 07 13:51:00.275497 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3688/7404] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:51:00 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:51:01.299120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f8d513e5-2e47-4f5c-a72a-a9a93050021c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:51:01.299948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f8d513e5-2e47-4f5c-a72a-a9a93050021c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:51:01.307531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8d513e5-2e47-4f5c-a72a-a9a93050021c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:01.308064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8d513e5-2e47-4f5c-a72a-a9a93050021c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:01.308606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8d513e5-2e47-4f5c-a72a-a9a93050021c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:01.309262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8d513e5-2e47-4f5c-a72a-a9a93050021c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:01.309788 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8d513e5-2e47-4f5c-a72a-a9a93050021c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:01.310270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f8d513e5-2e47-4f5c-a72a-a9a93050021c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:01.385757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-984dbbfc-9386-45d3-960d-d82ea80185bf req-9c1fcbc8-3b50-419c-b448-bcdefae825d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e42f8895-e5fb-49c8-a2e3-3f93c18480b1", "name": "network-vif-deleted", "tag": "e76e3852-90f9-4296-bb8f-15772b16f09c"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:51:01.387472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f8d513e5-2e47-4f5c-a72a-a9a93050021c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:51:01.396923 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f8d513e5-2e47-4f5c-a72a-a9a93050021c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 200 len: 1512 microversion: 2.1 time: 0.101699 Sep 07 13:51:01.397536 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3717/7405] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:51:01 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 1512 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:51:01.398877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-984dbbfc-9386-45d3-960d-d82ea80185bf req-9c1fcbc8-3b50-419c-b448-bcdefae825d3 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:01.399435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-984dbbfc-9386-45d3-960d-d82ea80185bf req-9c1fcbc8-3b50-419c-b448-bcdefae825d3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:01.399963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-984dbbfc-9386-45d3-960d-d82ea80185bf req-9c1fcbc8-3b50-419c-b448-bcdefae825d3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:01.412475 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-984dbbfc-9386-45d3-960d-d82ea80185bf req-9c1fcbc8-3b50-419c-b448-bcdefae825d3 service nova] Creating event network-vif-deleted:e76e3852-90f9-4296-bb8f-15772b16f09c for instance e42f8895-e5fb-49c8-a2e3-3f93c18480b1 on n-h2-852087-9 Sep 07 13:51:01.418733 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-984dbbfc-9386-45d3-960d-d82ea80185bf req-9c1fcbc8-3b50-419c-b448-bcdefae825d3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122886 Sep 07 13:51:01.419845 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3689/7406] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:51:02.422155 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-237dcb1a-bb4a-44a2-880a-4e9e6f459888 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:51:02.422771 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-237dcb1a-bb4a-44a2-880a-4e9e6f459888 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: e42f8895-e5fb-49c8-a2e3-3f93c18480b1] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:51:02.430332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-237dcb1a-bb4a-44a2-880a-4e9e6f459888 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:02.430929 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-237dcb1a-bb4a-44a2-880a-4e9e6f459888 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:02.431395 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-237dcb1a-bb4a-44a2-880a-4e9e6f459888 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:02.432121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-237dcb1a-bb4a-44a2-880a-4e9e6f459888 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:02.432627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-237dcb1a-bb4a-44a2-880a-4e9e6f459888 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:02.433076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-237dcb1a-bb4a-44a2-880a-4e9e6f459888 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:02.448166 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-237dcb1a-bb4a-44a2-880a-4e9e6f459888 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] HTTP exception thrown: Instance e42f8895-e5fb-49c8-a2e3-3f93c18480b1 could not be found. Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-237dcb1a-bb4a-44a2-880a-4e9e6f459888 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Request method failure captured: Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 HTTP/1.1 Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGKDSraTmkQiZCfE1vJ7DUnEZi8JGe4hTpAN7lZwblZ0hRnciVzOk2f4lgx3kLxQvTquYhapuG9hqGmdC5RvV4taEaHJ4OafpveyKJbtz4HhKXxJBMlOTyodlSORK4jMBLig0hJfcoutbX1b7-SimiezHJxelMh_G-Do7tgY5K5dx1eA Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 5ddc25bba099486cabbc8456ba351729 Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TestMinimumBasicScenario-1377569300 Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5ddc25bba099486cabbc8456ba351729"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5ddc25bba099486cabbc8456ba351729"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5ddc25bba099486cabbc8456ba351729"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5ddc25bba099486cabbc8456ba351729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TestMinimumBasicScenario-1377569300 Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 5ddc25bba099486cabbc8456ba351729 Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1377569300 Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TestMinimumBasicScenario-1377569300-project Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 9288bb00c59f4be383f74dccddc6ce40 Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TestMinimumBasicScenario-1377569300-project Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance e42f8895-e5fb-49c8-a2e3-3f93c18480b1 could not be found. Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'e42f8895-e5fb-49c8-a2e3-3f93c18480b1'} Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e42f8895-e5fb-49c8-a2e3-3f93c18480b1 could not be found. Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e42f8895-e5fb-49c8-a2e3-3f93c18480b1 could not be found. Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:51:02.449808 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:51:02.454621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:51:02.454621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:51:02.454621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:51:02.454621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:51:02.454621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:51:02.454621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e42f8895-e5fb-49c8-a2e3-3f93c18480b1 could not be found. Sep 07 13:51:02.454621 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:51:02.454621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-237dcb1a-bb4a-44a2-880a-4e9e6f459888 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Returning 404 to user: Instance e42f8895-e5fb-49c8-a2e3-3f93c18480b1 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:51:02.454621 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-237dcb1a-bb4a-44a2-880a-4e9e6f459888 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1" status: 404 len: 111 microversion: 2.1 time: 0.034573 Sep 07 13:51:02.454621 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3718/7407] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:51:02 2022] GET /compute/v2.1/servers/e42f8895-e5fb-49c8-a2e3-3f93c18480b1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:51:02.462422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-af1dfb96-5891-4731-97aa-f58a450ee7ff tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '.version_select at 0x7fc413fe9790>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:51:02.491679 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-af1dfb96-5891-4731-97aa-f58a450ee7ff tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1585450341" status: 202 len: 0 microversion: 2.1 time: 0.034346 Sep 07 13:51:02.492276 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3690/7408] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 13:51:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1585450341 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:51:11.670013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f71bf8ff-a4ae-4ab7-97d8-731c6033bc55 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Action: 'create', calling method: .version_select at 0x7fc413f6e820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1347204877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCH+dymRKhRRY9hr5Cs9Xz0JMZyvi4e1dfp4jvZczYTMihnpxlaKt/mubQ9nJbV6EPeMtiFok2PMtB+kxoeCgHEvH7KMKal0zlkOTBXbzwuEtTT7Y63SXk+7LlclfsdqHA=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:51:11.689723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f71bf8ff-a4ae-4ab7-97d8-731c6033bc55 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Getting quotas for project 5ddc25bba099486cabbc8456ba351729. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:51:11.695560 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-f71bf8ff-a4ae-4ab7-97d8-731c6033bc55 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Getting quotas for user 9288bb00c59f4be383f74dccddc6ce40 and project 5ddc25bba099486cabbc8456ba351729. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:51:11.726849 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f71bf8ff-a4ae-4ab7-97d8-731c6033bc55 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.061204 Sep 07 13:51:11.727464 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3719/7409] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 13:51:11 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:51:11.780605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:51:11.785469 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8042c5e9-3cf1-4ec5-8579-252415f6f109 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1734881436", "imageRef": "e605e020-58fd-4a76-b6e9-8eb1f345a025", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1347204877", "networks": [{"uuid": "6dca1f6e-dff1-4ed9-b00d-13a98e71f544"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:51:11.842464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-8042c5e9-3cf1-4ec5-8579-252415f6f109 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] validate_networks() for [('6dca1f6e-dff1-4ed9-b00d-13a98e71f544', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:51:12.324590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8042c5e9-3cf1-4ec5-8579-252415f6f109 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:51:12.325190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8042c5e9-3cf1-4ec5-8579-252415f6f109 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:51:12.325788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8042c5e9-3cf1-4ec5-8579-252415f6f109 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:51:12.326209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8042c5e9-3cf1-4ec5-8579-252415f6f109 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:51:12.326629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-8042c5e9-3cf1-4ec5-8579-252415f6f109 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:51:12.336335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8042c5e9-3cf1-4ec5-8579-252415f6f109 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:12.336835 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8042c5e9-3cf1-4ec5-8579-252415f6f109 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:12.337295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8042c5e9-3cf1-4ec5-8579-252415f6f109 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:12.338082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8042c5e9-3cf1-4ec5-8579-252415f6f109 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:12.338560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8042c5e9-3cf1-4ec5-8579-252415f6f109 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:12.338990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8042c5e9-3cf1-4ec5-8579-252415f6f109 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:12.358756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-8042c5e9-3cf1-4ec5-8579-252415f6f109 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Getting quotas for project 5ddc25bba099486cabbc8456ba351729. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:51:12.364301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-8042c5e9-3cf1-4ec5-8579-252415f6f109 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Getting quotas for user 9288bb00c59f4be383f74dccddc6ce40 and project 5ddc25bba099486cabbc8456ba351729. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:51:12.377732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8042c5e9-3cf1-4ec5-8579-252415f6f109 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:51:12.380209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8042c5e9-3cf1-4ec5-8579-252415f6f109 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e605e020-58fd-4a76-b6e9-8eb1f345a025',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:51:12.431774 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8042c5e9-3cf1-4ec5-8579-252415f6f109 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653083 Sep 07 13:51:12.432530 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3691/7410] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:51:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:51:12.444621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a942da99-7aa5-4c03-9494-ef74303c41e7 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:51:12.445543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a942da99-7aa5-4c03-9494-ef74303c41e7 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:51:12.449917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=42 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:51:12.512206 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a942da99-7aa5-4c03-9494-ef74303c41e7 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:51:12.522063 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a942da99-7aa5-4c03-9494-ef74303c41e7 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1259 microversion: 2.1 time: 0.081217 Sep 07 13:51:12.523098 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3720/7411] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:51:12 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1259 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:51:13.547709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7a43ada9-2375-4424-a287-8139a8b17c1f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:51:13.548307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7a43ada9-2375-4424-a287-8139a8b17c1f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:51:13.556648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a43ada9-2375-4424-a287-8139a8b17c1f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:13.557137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a43ada9-2375-4424-a287-8139a8b17c1f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:13.557624 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a43ada9-2375-4424-a287-8139a8b17c1f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:13.558320 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a43ada9-2375-4424-a287-8139a8b17c1f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:13.558780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a43ada9-2375-4424-a287-8139a8b17c1f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:13.559295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a43ada9-2375-4424-a287-8139a8b17c1f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:13.626323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7a43ada9-2375-4424-a287-8139a8b17c1f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:51:13.637255 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7a43ada9-2375-4424-a287-8139a8b17c1f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1255 microversion: 2.1 time: 0.093505 Sep 07 13:51:13.638174 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3692/7412] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:51:13 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1255 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:51:14.668253 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-47b4c586-6b04-4c0c-b4ac-2e7219cf4008 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:51:14.669175 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-47b4c586-6b04-4c0c-b4ac-2e7219cf4008 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:51:14.680605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47b4c586-6b04-4c0c-b4ac-2e7219cf4008 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:14.681119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47b4c586-6b04-4c0c-b4ac-2e7219cf4008 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:14.681651 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47b4c586-6b04-4c0c-b4ac-2e7219cf4008 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:14.682517 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47b4c586-6b04-4c0c-b4ac-2e7219cf4008 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:14.682825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47b4c586-6b04-4c0c-b4ac-2e7219cf4008 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:14.683265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-47b4c586-6b04-4c0c-b4ac-2e7219cf4008 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:14.760777 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-47b4c586-6b04-4c0c-b4ac-2e7219cf4008 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:51:14.770238 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-47b4c586-6b04-4c0c-b4ac-2e7219cf4008 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1317 microversion: 2.1 time: 0.105946 Sep 07 13:51:14.771223 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3721/7413] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:51:14 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1317 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:51:15.794801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-69348007-44b3-40a3-afee-def98c3a1312 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:51:15.795718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-69348007-44b3-40a3-afee-def98c3a1312 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:51:15.803412 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69348007-44b3-40a3-afee-def98c3a1312 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:15.813066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69348007-44b3-40a3-afee-def98c3a1312 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:15.813809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69348007-44b3-40a3-afee-def98c3a1312 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:15.814702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69348007-44b3-40a3-afee-def98c3a1312 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:15.815290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69348007-44b3-40a3-afee-def98c3a1312 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:15.815835 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69348007-44b3-40a3-afee-def98c3a1312 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:15.970679 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-69348007-44b3-40a3-afee-def98c3a1312 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:51:15.980704 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-69348007-44b3-40a3-afee-def98c3a1312 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1359 microversion: 2.1 time: 0.189854 Sep 07 13:51:15.982282 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3693/7414] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:51:15 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:51:17.005814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b014388e-d15a-4130-ade1-895c09041a8e tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:51:17.006431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b014388e-d15a-4130-ade1-895c09041a8e tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:51:17.016592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b014388e-d15a-4130-ade1-895c09041a8e tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:17.017100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b014388e-d15a-4130-ade1-895c09041a8e tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:17.017754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b014388e-d15a-4130-ade1-895c09041a8e tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:17.018561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b014388e-d15a-4130-ade1-895c09041a8e tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:17.019033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b014388e-d15a-4130-ade1-895c09041a8e tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:17.019475 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b014388e-d15a-4130-ade1-895c09041a8e tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:17.185156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b014388e-d15a-4130-ade1-895c09041a8e tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:51:17.194628 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b014388e-d15a-4130-ade1-895c09041a8e tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1359 microversion: 2.1 time: 0.193681 Sep 07 13:51:17.195242 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3722/7415] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:51:16 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:51:18.218725 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-85387f56-7e4f-4e9e-b231-8b5e395cc17a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:51:18.220484 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-85387f56-7e4f-4e9e-b231-8b5e395cc17a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:51:18.224199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:51:18.236184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85387f56-7e4f-4e9e-b231-8b5e395cc17a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:18.236791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85387f56-7e4f-4e9e-b231-8b5e395cc17a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:18.237214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85387f56-7e4f-4e9e-b231-8b5e395cc17a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:18.238021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85387f56-7e4f-4e9e-b231-8b5e395cc17a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:18.238538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85387f56-7e4f-4e9e-b231-8b5e395cc17a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:18.239022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-85387f56-7e4f-4e9e-b231-8b5e395cc17a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:18.381628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-85387f56-7e4f-4e9e-b231-8b5e395cc17a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:51:18.391330 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-85387f56-7e4f-4e9e-b231-8b5e395cc17a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1359 microversion: 2.1 time: 0.176784 Sep 07 13:51:18.392376 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3694/7416] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:51:18 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:51:19.416318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2a6eae65-5baa-4386-b20d-4659e1d3d25a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:51:19.417830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2a6eae65-5baa-4386-b20d-4659e1d3d25a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:51:19.419862 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:51:19.425189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a6eae65-5baa-4386-b20d-4659e1d3d25a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:19.425756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a6eae65-5baa-4386-b20d-4659e1d3d25a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:19.426221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a6eae65-5baa-4386-b20d-4659e1d3d25a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:19.426996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a6eae65-5baa-4386-b20d-4659e1d3d25a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:19.427468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a6eae65-5baa-4386-b20d-4659e1d3d25a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:19.427911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2a6eae65-5baa-4386-b20d-4659e1d3d25a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:19.601424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2a6eae65-5baa-4386-b20d-4659e1d3d25a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:51:19.609916 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2a6eae65-5baa-4386-b20d-4659e1d3d25a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1359 microversion: 2.1 time: 0.198578 Sep 07 13:51:19.610506 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3723/7417] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:51:19 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:51:20.635742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3d682ea4-c515-4f45-8103-1ece933a2042 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:51:20.636728 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3d682ea4-c515-4f45-8103-1ece933a2042 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:51:20.644105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d682ea4-c515-4f45-8103-1ece933a2042 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:20.645075 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d682ea4-c515-4f45-8103-1ece933a2042 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:20.645742 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d682ea4-c515-4f45-8103-1ece933a2042 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:20.646660 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d682ea4-c515-4f45-8103-1ece933a2042 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:20.647307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d682ea4-c515-4f45-8103-1ece933a2042 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:20.647948 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d682ea4-c515-4f45-8103-1ece933a2042 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:20.847175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3d682ea4-c515-4f45-8103-1ece933a2042 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:51:20.860411 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3d682ea4-c515-4f45-8103-1ece933a2042 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1359 microversion: 2.1 time: 0.230336 Sep 07 13:51:20.860760 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3695/7418] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:51:20 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:51:21.885321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-64900bf4-d4af-4ec0-9578-4668d50c726c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:51:21.886244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-64900bf4-d4af-4ec0-9578-4668d50c726c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:51:21.894394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64900bf4-d4af-4ec0-9578-4668d50c726c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:21.894914 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64900bf4-d4af-4ec0-9578-4668d50c726c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:21.895372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64900bf4-d4af-4ec0-9578-4668d50c726c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:21.896118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64900bf4-d4af-4ec0-9578-4668d50c726c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:21.896597 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64900bf4-d4af-4ec0-9578-4668d50c726c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:21.897042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-64900bf4-d4af-4ec0-9578-4668d50c726c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:22.044772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-64900bf4-d4af-4ec0-9578-4668d50c726c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:51:22.054595 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-64900bf4-d4af-4ec0-9578-4668d50c726c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1359 microversion: 2.1 time: 0.173302 Sep 07 13:51:22.055415 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3724/7419] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:51:21 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:51:23.078248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-de179716-4be7-4970-b23e-316c335f3141 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:51:23.078910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-de179716-4be7-4970-b23e-316c335f3141 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:51:23.081763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:51:23.082427 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:51:23.088443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de179716-4be7-4970-b23e-316c335f3141 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:23.088932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de179716-4be7-4970-b23e-316c335f3141 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:23.089377 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de179716-4be7-4970-b23e-316c335f3141 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:23.090287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de179716-4be7-4970-b23e-316c335f3141 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:23.090764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de179716-4be7-4970-b23e-316c335f3141 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:23.091254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-de179716-4be7-4970-b23e-316c335f3141 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:23.245779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-de179716-4be7-4970-b23e-316c335f3141 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:51:23.255850 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-de179716-4be7-4970-b23e-316c335f3141 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1359 microversion: 2.1 time: 0.181616 Sep 07 13:51:23.256559 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3696/7420] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:51:23 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:51:23.324730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-66c06cec-e674-458a-ab59-bd4b9111002b req-4ac9739e-c7fa-4da1-8703-83f5dbec8b50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a59d82bc-27b2-4263-917f-fcc56b688f2a", "tag": "9b4e130c-7922-428e-8d77-bc8dcd40b6d1"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:51:23.330319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:51:23.337744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-66c06cec-e674-458a-ab59-bd4b9111002b req-4ac9739e-c7fa-4da1-8703-83f5dbec8b50 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:23.338380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-66c06cec-e674-458a-ab59-bd4b9111002b req-4ac9739e-c7fa-4da1-8703-83f5dbec8b50 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:23.339129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-66c06cec-e674-458a-ab59-bd4b9111002b req-4ac9739e-c7fa-4da1-8703-83f5dbec8b50 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:23.352162 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-66c06cec-e674-458a-ab59-bd4b9111002b req-4ac9739e-c7fa-4da1-8703-83f5dbec8b50 service nova] Creating event network-changed:9b4e130c-7922-428e-8d77-bc8dcd40b6d1 for instance a59d82bc-27b2-4263-917f-fcc56b688f2a on n-h2-852087-9 Sep 07 13:51:23.357629 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-66c06cec-e674-458a-ab59-bd4b9111002b req-4ac9739e-c7fa-4da1-8703-83f5dbec8b50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038196 Sep 07 13:51:23.358310 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3725/7421] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:51:24.280143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-016606f4-70e4-4546-8074-289bf9830b87 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:51:24.280771 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-016606f4-70e4-4546-8074-289bf9830b87 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:51:24.288430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-016606f4-70e4-4546-8074-289bf9830b87 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:24.288924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-016606f4-70e4-4546-8074-289bf9830b87 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:24.289376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-016606f4-70e4-4546-8074-289bf9830b87 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:24.290120 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-016606f4-70e4-4546-8074-289bf9830b87 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:24.290580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-016606f4-70e4-4546-8074-289bf9830b87 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:24.291015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-016606f4-70e4-4546-8074-289bf9830b87 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:24.437459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-016606f4-70e4-4546-8074-289bf9830b87 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:51:24.445827 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-016606f4-70e4-4546-8074-289bf9830b87 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1359 microversion: 2.1 time: 0.169702 Sep 07 13:51:24.446427 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3697/7422] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:51:24 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:51:25.476675 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-51fc8d1e-7570-4f47-91f6-b7e4639a791f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:51:25.477261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-51fc8d1e-7570-4f47-91f6-b7e4639a791f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:51:25.485170 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51fc8d1e-7570-4f47-91f6-b7e4639a791f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:25.485818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51fc8d1e-7570-4f47-91f6-b7e4639a791f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:25.486465 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51fc8d1e-7570-4f47-91f6-b7e4639a791f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:25.487620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51fc8d1e-7570-4f47-91f6-b7e4639a791f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:25.488373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51fc8d1e-7570-4f47-91f6-b7e4639a791f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:25.489165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51fc8d1e-7570-4f47-91f6-b7e4639a791f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:25.638558 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-51fc8d1e-7570-4f47-91f6-b7e4639a791f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:51:25.647389 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-51fc8d1e-7570-4f47-91f6-b7e4639a791f tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1359 microversion: 2.1 time: 0.179177 Sep 07 13:51:25.647979 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3726/7423] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:51:25 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:51:26.678833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b61c1e15-728f-4be4-a442-92d374c5d1b3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:51:26.679446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b61c1e15-728f-4be4-a442-92d374c5d1b3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:51:26.688914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b61c1e15-728f-4be4-a442-92d374c5d1b3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:26.689739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b61c1e15-728f-4be4-a442-92d374c5d1b3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:26.690469 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b61c1e15-728f-4be4-a442-92d374c5d1b3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:26.691331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b61c1e15-728f-4be4-a442-92d374c5d1b3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:26.691767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b61c1e15-728f-4be4-a442-92d374c5d1b3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:26.692233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b61c1e15-728f-4be4-a442-92d374c5d1b3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:26.835619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b61c1e15-728f-4be4-a442-92d374c5d1b3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:51:26.845094 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b61c1e15-728f-4be4-a442-92d374c5d1b3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1359 microversion: 2.1 time: 0.169905 Sep 07 13:51:26.845733 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3698/7424] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:51:26 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:51:27.869598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-aad241c0-da7c-42ef-915d-cf02e1aa9473 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:51:27.869598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-aad241c0-da7c-42ef-915d-cf02e1aa9473 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:51:27.876789 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aad241c0-da7c-42ef-915d-cf02e1aa9473 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:27.877299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aad241c0-da7c-42ef-915d-cf02e1aa9473 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:27.877783 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aad241c0-da7c-42ef-915d-cf02e1aa9473 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:27.878696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aad241c0-da7c-42ef-915d-cf02e1aa9473 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:27.879174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aad241c0-da7c-42ef-915d-cf02e1aa9473 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:27.879608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-aad241c0-da7c-42ef-915d-cf02e1aa9473 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:28.026451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-aad241c0-da7c-42ef-915d-cf02e1aa9473 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:51:28.039754 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-aad241c0-da7c-42ef-915d-cf02e1aa9473 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1359 microversion: 2.1 time: 0.174593 Sep 07 13:51:28.040545 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3727/7425] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:51:27 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:51:29.068166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2f1ab813-cdbf-4a37-89a2-09abd39dd429 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:51:29.068811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2f1ab813-cdbf-4a37-89a2-09abd39dd429 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:51:29.076278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f1ab813-cdbf-4a37-89a2-09abd39dd429 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:29.076778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f1ab813-cdbf-4a37-89a2-09abd39dd429 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:29.077211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f1ab813-cdbf-4a37-89a2-09abd39dd429 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:29.077955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f1ab813-cdbf-4a37-89a2-09abd39dd429 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:29.078413 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f1ab813-cdbf-4a37-89a2-09abd39dd429 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:29.078849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2f1ab813-cdbf-4a37-89a2-09abd39dd429 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:29.222372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2f1ab813-cdbf-4a37-89a2-09abd39dd429 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:51:29.235007 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2f1ab813-cdbf-4a37-89a2-09abd39dd429 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1359 microversion: 2.1 time: 0.171492 Sep 07 13:51:29.235835 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3699/7426] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:51:29 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:51:29.517563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-9c963833-eba7-4592-81b4-322e5c96e56e req-de67f61c-edc2-4938-a243-b4bfcbf850b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a59d82bc-27b2-4263-917f-fcc56b688f2a", "name": "network-vif-plugged", "status": "completed", "tag": "9b4e130c-7922-428e-8d77-bc8dcd40b6d1"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:51:29.528038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9c963833-eba7-4592-81b4-322e5c96e56e req-de67f61c-edc2-4938-a243-b4bfcbf850b4 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:29.528537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9c963833-eba7-4592-81b4-322e5c96e56e req-de67f61c-edc2-4938-a243-b4bfcbf850b4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:29.528985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-9c963833-eba7-4592-81b4-322e5c96e56e req-de67f61c-edc2-4938-a243-b4bfcbf850b4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:29.540450 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-9c963833-eba7-4592-81b4-322e5c96e56e req-de67f61c-edc2-4938-a243-b4bfcbf850b4 service nova] Creating event network-vif-plugged:9b4e130c-7922-428e-8d77-bc8dcd40b6d1 for instance a59d82bc-27b2-4263-917f-fcc56b688f2a on n-h2-852087-9 Sep 07 13:51:29.545915 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-9c963833-eba7-4592-81b4-322e5c96e56e req-de67f61c-edc2-4938-a243-b4bfcbf850b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106053 Sep 07 13:51:29.546499 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3728/7427] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:51:30.259766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5cdc72ca-86a0-4e44-9cbe-05498f123ede tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:51:30.260330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5cdc72ca-86a0-4e44-9cbe-05498f123ede tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:51:30.267621 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cdc72ca-86a0-4e44-9cbe-05498f123ede tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:30.268111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cdc72ca-86a0-4e44-9cbe-05498f123ede tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:30.268648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cdc72ca-86a0-4e44-9cbe-05498f123ede tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:30.269348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cdc72ca-86a0-4e44-9cbe-05498f123ede tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:30.269841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cdc72ca-86a0-4e44-9cbe-05498f123ede tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:30.270268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cdc72ca-86a0-4e44-9cbe-05498f123ede tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:30.417577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5cdc72ca-86a0-4e44-9cbe-05498f123ede tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:51:30.430597 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5cdc72ca-86a0-4e44-9cbe-05498f123ede tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1359 microversion: 2.1 time: 0.174583 Sep 07 13:51:30.431337 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3700/7428] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:51:30 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:51:31.458397 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-657dcbc9-ad2b-4766-9217-9563537b0e79 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:51:31.459142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-657dcbc9-ad2b-4766-9217-9563537b0e79 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:51:31.465928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-657dcbc9-ad2b-4766-9217-9563537b0e79 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:31.466436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-657dcbc9-ad2b-4766-9217-9563537b0e79 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:31.466881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-657dcbc9-ad2b-4766-9217-9563537b0e79 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:31.467611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-657dcbc9-ad2b-4766-9217-9563537b0e79 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:31.468052 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-657dcbc9-ad2b-4766-9217-9563537b0e79 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:31.468491 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-657dcbc9-ad2b-4766-9217-9563537b0e79 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:31.619174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-657dcbc9-ad2b-4766-9217-9563537b0e79 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:51:31.627354 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-657dcbc9-ad2b-4766-9217-9563537b0e79 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1549 microversion: 2.1 time: 0.174242 Sep 07 13:51:31.627916 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3729/7429] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:51:31 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1549 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:51:31.649899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-286c50fc-bf69-43d7-b49a-efde85d1e385 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:51:31.650476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-286c50fc-bf69-43d7-b49a-efde85d1e385 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:51:31.658061 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-286c50fc-bf69-43d7-b49a-efde85d1e385 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:31.658558 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-286c50fc-bf69-43d7-b49a-efde85d1e385 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:31.658998 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-286c50fc-bf69-43d7-b49a-efde85d1e385 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:31.659705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-286c50fc-bf69-43d7-b49a-efde85d1e385 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:31.660128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-286c50fc-bf69-43d7-b49a-efde85d1e385 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:31.660585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-286c50fc-bf69-43d7-b49a-efde85d1e385 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:31.810048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-286c50fc-bf69-43d7-b49a-efde85d1e385 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:51:31.818491 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-286c50fc-bf69-43d7-b49a-efde85d1e385 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1549 microversion: 2.1 time: 0.172621 Sep 07 13:51:31.819113 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3701/7430] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:51:31 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1549 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:51:31.841054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c18c0057-036d-43c0-9b8b-4c1b52261729 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:51:31.846245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c18c0057-036d-43c0-9b8b-4c1b52261729 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:51:31.847133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c18c0057-036d-43c0-9b8b-4c1b52261729 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Searching by: {'deleted': False, 'project_id': '5ddc25bba099486cabbc8456ba351729'} {{(pid=122433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 13:51:31.852814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c18c0057-036d-43c0-9b8b-4c1b52261729 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:31.853341 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c18c0057-036d-43c0-9b8b-4c1b52261729 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:31.853993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c18c0057-036d-43c0-9b8b-4c1b52261729 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:31.854572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c18c0057-036d-43c0-9b8b-4c1b52261729 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:31.855102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c18c0057-036d-43c0-9b8b-4c1b52261729 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:31.855580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c18c0057-036d-43c0-9b8b-4c1b52261729 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:31.881138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.multi_cell_list [None req-c18c0057-036d-43c0-9b8b-4c1b52261729 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 13:51:31.910534 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c18c0057-036d-43c0-9b8b-4c1b52261729 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.073289 Sep 07 13:51:31.911142 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3730/7431] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Sep 7 13:51:31 2022] GET /compute/v2.1/servers => generated 343 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:51:31.922997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-06b1a672-bce6-4085-b2d3-9b01978e5886 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:51:31.923622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-06b1a672-bce6-4085-b2d3-9b01978e5886 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:51:31.930204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06b1a672-bce6-4085-b2d3-9b01978e5886 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:31.930701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06b1a672-bce6-4085-b2d3-9b01978e5886 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:31.931342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06b1a672-bce6-4085-b2d3-9b01978e5886 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:31.931844 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06b1a672-bce6-4085-b2d3-9b01978e5886 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:31.932305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06b1a672-bce6-4085-b2d3-9b01978e5886 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:31.932737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06b1a672-bce6-4085-b2d3-9b01978e5886 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:32.085183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-06b1a672-bce6-4085-b2d3-9b01978e5886 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:51:32.093314 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-06b1a672-bce6-4085-b2d3-9b01978e5886 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1549 microversion: 2.1 time: 0.174258 Sep 07 13:51:32.093984 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3702/7432] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:51:31 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:51:33.648966 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-54c4bea5-593f-4eeb-80c9-dedc7022ba60 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6967f0d9-9a68-4c4b-8155-1aee3f6edd1a"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:51:33.651453 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-54c4bea5-593f-4eeb-80c9-dedc7022ba60 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:51:33.658439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54c4bea5-593f-4eeb-80c9-dedc7022ba60 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:33.658963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54c4bea5-593f-4eeb-80c9-dedc7022ba60 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:33.659504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54c4bea5-593f-4eeb-80c9-dedc7022ba60 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:33.660185 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54c4bea5-593f-4eeb-80c9-dedc7022ba60 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:33.660681 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54c4bea5-593f-4eeb-80c9-dedc7022ba60 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:33.661107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-54c4bea5-593f-4eeb-80c9-dedc7022ba60 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:34.089569 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-54c4bea5-593f-4eeb-80c9-dedc7022ba60 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "POST /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.444370 Sep 07 13:51:34.090296 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3731/7433] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Sep 7 13:51:33 2022] POST /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a/os-volume_attachments => generated 194 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:51:44.935525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-324738dc-0165-4e24-ad04-baf645665be6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:51:44.936116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-324738dc-0165-4e24-ad04-baf645665be6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:51:44.939319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=17 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:51:44.939976 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=68 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:51:44.946652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-324738dc-0165-4e24-ad04-baf645665be6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:44.947131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-324738dc-0165-4e24-ad04-baf645665be6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:44.947580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-324738dc-0165-4e24-ad04-baf645665be6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:44.948301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-324738dc-0165-4e24-ad04-baf645665be6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:44.948758 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-324738dc-0165-4e24-ad04-baf645665be6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:44.949188 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-324738dc-0165-4e24-ad04-baf645665be6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:45.151397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-324738dc-0165-4e24-ad04-baf645665be6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:51:45.160887 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-324738dc-0165-4e24-ad04-baf645665be6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1595 microversion: 2.1 time: 0.229442 Sep 07 13:51:45.161521 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3703/7434] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:51:44 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1595 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:51:46.867329 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-47d8e797-f2f2-434b-a47d-88b5c4d665cd req-e3f15d13-727a-4f41-9deb-43a29a26015d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a59d82bc-27b2-4263-917f-fcc56b688f2a", "tag": "9b4e130c-7922-428e-8d77-bc8dcd40b6d1"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:51:46.882856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:51:46.888078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=17 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:51:46.896024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:51:46.907150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-47d8e797-f2f2-434b-a47d-88b5c4d665cd req-e3f15d13-727a-4f41-9deb-43a29a26015d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:46.907150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-47d8e797-f2f2-434b-a47d-88b5c4d665cd req-e3f15d13-727a-4f41-9deb-43a29a26015d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:46.907880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-47d8e797-f2f2-434b-a47d-88b5c4d665cd req-e3f15d13-727a-4f41-9deb-43a29a26015d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:46.922990 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-47d8e797-f2f2-434b-a47d-88b5c4d665cd req-e3f15d13-727a-4f41-9deb-43a29a26015d service nova] Creating event network-changed:9b4e130c-7922-428e-8d77-bc8dcd40b6d1 for instance a59d82bc-27b2-4263-917f-fcc56b688f2a on n-h2-852087-9 Sep 07 13:51:46.935877 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-47d8e797-f2f2-434b-a47d-88b5c4d665cd req-e3f15d13-727a-4f41-9deb-43a29a26015d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072931 Sep 07 13:51:46.936586 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3732/7435] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:51:48.415507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9059d96e-b60e-4528-924d-e3105525a277 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-793729841"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:51:48.416124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9059d96e-b60e-4528-924d-e3105525a277 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:51:48.423322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9059d96e-b60e-4528-924d-e3105525a277 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:48.423816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9059d96e-b60e-4528-924d-e3105525a277 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:48.424264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9059d96e-b60e-4528-924d-e3105525a277 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:48.425020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9059d96e-b60e-4528-924d-e3105525a277 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:48.425504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9059d96e-b60e-4528-924d-e3105525a277 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:48.425940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9059d96e-b60e-4528-924d-e3105525a277 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:48.565571 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.network.security_group_api [None req-9059d96e-b60e-4528-924d-e3105525a277 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Adding security group 77026132-c50d-445e-8f20-3ff45e4b7eb2 to port 9b4e130c-7922-428e-8d77-bc8dcd40b6d1 Sep 07 13:51:48.903075 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9059d96e-b60e-4528-924d-e3105525a277 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "POST /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a/action" status: 202 len: 0 microversion: 2.1 time: 0.491575 Sep 07 13:51:48.903865 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3704/7436] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:51:48 2022] POST /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:51:48.913379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-855ca4c0-87dc-4716-8d16-793d890ed92f req-83090edc-a1da-4a0e-b426-b268da2d6762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a59d82bc-27b2-4263-917f-fcc56b688f2a", "tag": "9b4e130c-7922-428e-8d77-bc8dcd40b6d1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:51:48.914814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1e064e0a-8e11-4ee5-a7fa-017b70965cfe tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:51:48.915681 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1e064e0a-8e11-4ee5-a7fa-017b70965cfe tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:51:48.922665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e064e0a-8e11-4ee5-a7fa-017b70965cfe tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:48.923181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e064e0a-8e11-4ee5-a7fa-017b70965cfe tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:48.923637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e064e0a-8e11-4ee5-a7fa-017b70965cfe tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:48.924372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e064e0a-8e11-4ee5-a7fa-017b70965cfe tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:48.925096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e064e0a-8e11-4ee5-a7fa-017b70965cfe tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:48.925634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e064e0a-8e11-4ee5-a7fa-017b70965cfe tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:48.926783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-855ca4c0-87dc-4716-8d16-793d890ed92f req-83090edc-a1da-4a0e-b426-b268da2d6762 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:51:48.927267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-855ca4c0-87dc-4716-8d16-793d890ed92f req-83090edc-a1da-4a0e-b426-b268da2d6762 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:51:48.927700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-855ca4c0-87dc-4716-8d16-793d890ed92f req-83090edc-a1da-4a0e-b426-b268da2d6762 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:51:48.942277 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-855ca4c0-87dc-4716-8d16-793d890ed92f req-83090edc-a1da-4a0e-b426-b268da2d6762 service nova] Creating event network-changed:9b4e130c-7922-428e-8d77-bc8dcd40b6d1 for instance a59d82bc-27b2-4263-917f-fcc56b688f2a on n-h2-852087-9 Sep 07 13:51:48.948680 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-855ca4c0-87dc-4716-8d16-793d890ed92f req-83090edc-a1da-4a0e-b426-b268da2d6762 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038687 Sep 07 13:51:48.949665 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3705/7437] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:51:49.456033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1e064e0a-8e11-4ee5-a7fa-017b70965cfe tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:51:49.465322 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1e064e0a-8e11-4ee5-a7fa-017b70965cfe tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1760 microversion: 2.1 time: 0.556350 Sep 07 13:51:49.466044 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3733/7438] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:51:48 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1760 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:52:04.466480 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:52:04.467241 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=12 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:52:04.522640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-21c8d5a5-3f00-4847-853f-eedab4ac26e2 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:52:04.525187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-21c8d5a5-3f00-4847-853f-eedab4ac26e2 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:52:04.532105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21c8d5a5-3f00-4847-853f-eedab4ac26e2 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:04.532618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21c8d5a5-3f00-4847-853f-eedab4ac26e2 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:04.533062 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21c8d5a5-3f00-4847-853f-eedab4ac26e2 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:04.533858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21c8d5a5-3f00-4847-853f-eedab4ac26e2 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:04.534325 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21c8d5a5-3f00-4847-853f-eedab4ac26e2 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:04.534755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21c8d5a5-3f00-4847-853f-eedab4ac26e2 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:04.619806 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-21c8d5a5-3f00-4847-853f-eedab4ac26e2 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "POST /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a/action" status: 202 len: 0 microversion: 2.1 time: 0.159426 Sep 07 13:52:04.620647 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3706/7439] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:52:04 2022] POST /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:52:04.630303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5d47f101-8d81-4303-a532-9616ed9e9df7 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:52:04.630936 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5d47f101-8d81-4303-a532-9616ed9e9df7 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:52:04.634668 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:52:04.635574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:52:04.642014 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d47f101-8d81-4303-a532-9616ed9e9df7 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:04.642554 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d47f101-8d81-4303-a532-9616ed9e9df7 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:04.643057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d47f101-8d81-4303-a532-9616ed9e9df7 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:04.644006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d47f101-8d81-4303-a532-9616ed9e9df7 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:04.644313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d47f101-8d81-4303-a532-9616ed9e9df7 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:04.648415 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5d47f101-8d81-4303-a532-9616ed9e9df7 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:04.802363 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5d47f101-8d81-4303-a532-9616ed9e9df7 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:52:04.810944 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5d47f101-8d81-4303-a532-9616ed9e9df7 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1752 microversion: 2.1 time: 0.186043 Sep 07 13:52:04.811537 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3734/7440] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:52:04 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1752 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:52:05.838496 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-43d0fedf-0cf9-426b-b2c0-7680de34b0bc tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:52:05.839323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-43d0fedf-0cf9-426b-b2c0-7680de34b0bc tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:52:05.846600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43d0fedf-0cf9-426b-b2c0-7680de34b0bc tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:05.847092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43d0fedf-0cf9-426b-b2c0-7680de34b0bc tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:05.847536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43d0fedf-0cf9-426b-b2c0-7680de34b0bc tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:05.848249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43d0fedf-0cf9-426b-b2c0-7680de34b0bc tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:05.848704 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43d0fedf-0cf9-426b-b2c0-7680de34b0bc tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:05.849134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-43d0fedf-0cf9-426b-b2c0-7680de34b0bc tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:05.999079 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-43d0fedf-0cf9-426b-b2c0-7680de34b0bc tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:52:06.008020 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-43d0fedf-0cf9-426b-b2c0-7680de34b0bc tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1757 microversion: 2.1 time: 0.175881 Sep 07 13:52:06.008644 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3707/7441] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:52:05 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:52:07.032751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ce0d3cef-b0a5-44fb-bd6d-39321269e6e6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:52:07.033632 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ce0d3cef-b0a5-44fb-bd6d-39321269e6e6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:52:07.041123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce0d3cef-b0a5-44fb-bd6d-39321269e6e6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:07.041770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce0d3cef-b0a5-44fb-bd6d-39321269e6e6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:07.042196 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce0d3cef-b0a5-44fb-bd6d-39321269e6e6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:07.042941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce0d3cef-b0a5-44fb-bd6d-39321269e6e6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:07.043424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce0d3cef-b0a5-44fb-bd6d-39321269e6e6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:07.043921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ce0d3cef-b0a5-44fb-bd6d-39321269e6e6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:07.227951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ce0d3cef-b0a5-44fb-bd6d-39321269e6e6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:52:07.238882 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ce0d3cef-b0a5-44fb-bd6d-39321269e6e6 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1757 microversion: 2.1 time: 0.209256 Sep 07 13:52:07.239486 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3735/7442] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:52:07 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1757 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:52:08.268005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7e75d51e-5e67-4fba-bbac-94a3f9ee5c2a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:52:08.268564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7e75d51e-5e67-4fba-bbac-94a3f9ee5c2a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:52:08.276143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e75d51e-5e67-4fba-bbac-94a3f9ee5c2a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:08.276653 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e75d51e-5e67-4fba-bbac-94a3f9ee5c2a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:08.277088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e75d51e-5e67-4fba-bbac-94a3f9ee5c2a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:08.277814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e75d51e-5e67-4fba-bbac-94a3f9ee5c2a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:08.278267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e75d51e-5e67-4fba-bbac-94a3f9ee5c2a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:08.278700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7e75d51e-5e67-4fba-bbac-94a3f9ee5c2a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:08.436819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7e75d51e-5e67-4fba-bbac-94a3f9ee5c2a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:52:08.446089 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7e75d51e-5e67-4fba-bbac-94a3f9ee5c2a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1757 microversion: 2.1 time: 0.182230 Sep 07 13:52:08.446687 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3708/7443] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:52:08 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:52:09.470681 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-26478c5f-083c-46bb-bb42-9969e62ff0ea tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:52:09.471318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-26478c5f-083c-46bb-bb42-9969e62ff0ea tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:52:09.478838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26478c5f-083c-46bb-bb42-9969e62ff0ea tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:09.479354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26478c5f-083c-46bb-bb42-9969e62ff0ea tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:09.479790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26478c5f-083c-46bb-bb42-9969e62ff0ea tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:09.480515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26478c5f-083c-46bb-bb42-9969e62ff0ea tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:09.480986 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26478c5f-083c-46bb-bb42-9969e62ff0ea tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:09.481427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26478c5f-083c-46bb-bb42-9969e62ff0ea tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:09.647940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-26478c5f-083c-46bb-bb42-9969e62ff0ea tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:52:09.656922 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-26478c5f-083c-46bb-bb42-9969e62ff0ea tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1757 microversion: 2.1 time: 0.190927 Sep 07 13:52:09.657534 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3736/7444] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:52:09 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:52:10.682933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-499405d2-8b21-4027-b140-90e357ba827a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:52:10.683701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-499405d2-8b21-4027-b140-90e357ba827a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:52:10.691339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-499405d2-8b21-4027-b140-90e357ba827a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:10.691827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-499405d2-8b21-4027-b140-90e357ba827a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:10.692270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-499405d2-8b21-4027-b140-90e357ba827a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:10.692968 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-499405d2-8b21-4027-b140-90e357ba827a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:10.693424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-499405d2-8b21-4027-b140-90e357ba827a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:10.693975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-499405d2-8b21-4027-b140-90e357ba827a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:10.863166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-499405d2-8b21-4027-b140-90e357ba827a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:52:10.873375 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-499405d2-8b21-4027-b140-90e357ba827a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1757 microversion: 2.1 time: 0.194953 Sep 07 13:52:10.874023 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3709/7445] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:52:10 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1757 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:52:11.897296 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c3134734-f2e0-4a6b-8599-19d098717ba4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:52:11.898066 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c3134734-f2e0-4a6b-8599-19d098717ba4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:52:11.905161 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3134734-f2e0-4a6b-8599-19d098717ba4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:11.905724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3134734-f2e0-4a6b-8599-19d098717ba4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:11.906201 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3134734-f2e0-4a6b-8599-19d098717ba4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:11.906951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3134734-f2e0-4a6b-8599-19d098717ba4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:11.907428 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3134734-f2e0-4a6b-8599-19d098717ba4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:11.907876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c3134734-f2e0-4a6b-8599-19d098717ba4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:12.067713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c3134734-f2e0-4a6b-8599-19d098717ba4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:52:12.076973 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c3134734-f2e0-4a6b-8599-19d098717ba4 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1757 microversion: 2.1 time: 0.183789 Sep 07 13:52:12.077836 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3737/7446] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:52:11 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:52:13.108724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-62864d9b-064e-417e-b6e7-5389f8577491 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:52:13.109578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-62864d9b-064e-417e-b6e7-5389f8577491 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:52:13.116984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62864d9b-064e-417e-b6e7-5389f8577491 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:13.117614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62864d9b-064e-417e-b6e7-5389f8577491 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:13.118086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62864d9b-064e-417e-b6e7-5389f8577491 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:13.118791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62864d9b-064e-417e-b6e7-5389f8577491 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:13.119250 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62864d9b-064e-417e-b6e7-5389f8577491 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:13.119681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-62864d9b-064e-417e-b6e7-5389f8577491 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:13.274991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-62864d9b-064e-417e-b6e7-5389f8577491 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:52:13.285511 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-62864d9b-064e-417e-b6e7-5389f8577491 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1757 microversion: 2.1 time: 0.180789 Sep 07 13:52:13.286163 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3710/7447] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:52:13 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:52:14.309109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a37f9469-ed16-488e-b077-0e8c09be5bdf tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:52:14.310093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a37f9469-ed16-488e-b077-0e8c09be5bdf tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:52:14.317009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a37f9469-ed16-488e-b077-0e8c09be5bdf tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:14.317518 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a37f9469-ed16-488e-b077-0e8c09be5bdf tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:14.317980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a37f9469-ed16-488e-b077-0e8c09be5bdf tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:14.318703 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a37f9469-ed16-488e-b077-0e8c09be5bdf tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:14.319174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a37f9469-ed16-488e-b077-0e8c09be5bdf tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:14.319618 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a37f9469-ed16-488e-b077-0e8c09be5bdf tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:14.493144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a37f9469-ed16-488e-b077-0e8c09be5bdf tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:52:14.502452 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a37f9469-ed16-488e-b077-0e8c09be5bdf tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1757 microversion: 2.1 time: 0.197576 Sep 07 13:52:14.503057 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3738/7448] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:52:14 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1757 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:52:15.526575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-299e8931-5591-4914-b592-75cc696c0b50 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:52:15.527258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-299e8931-5591-4914-b592-75cc696c0b50 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:52:15.534520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-299e8931-5591-4914-b592-75cc696c0b50 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:15.535005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-299e8931-5591-4914-b592-75cc696c0b50 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:15.535441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-299e8931-5591-4914-b592-75cc696c0b50 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:15.536137 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-299e8931-5591-4914-b592-75cc696c0b50 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:15.536589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-299e8931-5591-4914-b592-75cc696c0b50 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:15.537007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-299e8931-5591-4914-b592-75cc696c0b50 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:15.696530 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-299e8931-5591-4914-b592-75cc696c0b50 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:52:15.705608 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-299e8931-5591-4914-b592-75cc696c0b50 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1757 microversion: 2.1 time: 0.183032 Sep 07 13:52:15.706199 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3711/7449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:52:15 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:52:16.729315 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6f254ad5-d3b9-47a4-84a2-b4819bec0d9d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:52:16.729961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6f254ad5-d3b9-47a4-84a2-b4819bec0d9d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:52:16.738550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f254ad5-d3b9-47a4-84a2-b4819bec0d9d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:16.739113 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f254ad5-d3b9-47a4-84a2-b4819bec0d9d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:16.739606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f254ad5-d3b9-47a4-84a2-b4819bec0d9d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:16.740623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f254ad5-d3b9-47a4-84a2-b4819bec0d9d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:16.740855 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f254ad5-d3b9-47a4-84a2-b4819bec0d9d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:16.741363 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6f254ad5-d3b9-47a4-84a2-b4819bec0d9d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:16.906495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6f254ad5-d3b9-47a4-84a2-b4819bec0d9d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:52:16.915307 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6f254ad5-d3b9-47a4-84a2-b4819bec0d9d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1760 microversion: 2.1 time: 0.190233 Sep 07 13:52:16.915900 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3739/7450] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:52:16 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1760 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:52:49.402050 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-12c95b42-82d0-40e7-960c-035837d2638c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-793729841"}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:52:49.402700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-12c95b42-82d0-40e7-960c-035837d2638c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:52:49.404821 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=12 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:52:49.405460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:52:49.412057 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12c95b42-82d0-40e7-960c-035837d2638c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:49.412556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12c95b42-82d0-40e7-960c-035837d2638c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:49.413001 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12c95b42-82d0-40e7-960c-035837d2638c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:49.413745 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12c95b42-82d0-40e7-960c-035837d2638c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:49.414194 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12c95b42-82d0-40e7-960c-035837d2638c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:49.414623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-12c95b42-82d0-40e7-960c-035837d2638c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:49.554052 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.network.security_group_api [None req-12c95b42-82d0-40e7-960c-035837d2638c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Removing security group 77026132-c50d-445e-8f20-3ff45e4b7eb2 from port 9b4e130c-7922-428e-8d77-bc8dcd40b6d1 Sep 07 13:52:49.908268 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-12c95b42-82d0-40e7-960c-035837d2638c tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "POST /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a/action" status: 202 len: 0 microversion: 2.1 time: 0.510851 Sep 07 13:52:49.908883 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3712/7451] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:52:49 2022] POST /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:52:49.919434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-2f19df49-17f9-4f1f-8b99-af8f96a79688 req-abe1187f-1192-4af4-ab47-61961c44d7ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a59d82bc-27b2-4263-917f-fcc56b688f2a", "tag": "9b4e130c-7922-428e-8d77-bc8dcd40b6d1"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:52:49.932001 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=12 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:52:49.940440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=36 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:52:49.949839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2f19df49-17f9-4f1f-8b99-af8f96a79688 req-abe1187f-1192-4af4-ab47-61961c44d7ed service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:49.954018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2f19df49-17f9-4f1f-8b99-af8f96a79688 req-abe1187f-1192-4af4-ab47-61961c44d7ed service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:49.959124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2f19df49-17f9-4f1f-8b99-af8f96a79688 req-abe1187f-1192-4af4-ab47-61961c44d7ed service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:49.983071 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-2f19df49-17f9-4f1f-8b99-af8f96a79688 req-abe1187f-1192-4af4-ab47-61961c44d7ed service nova] Creating event network-changed:9b4e130c-7922-428e-8d77-bc8dcd40b6d1 for instance a59d82bc-27b2-4263-917f-fcc56b688f2a on n-h2-852087-9 Sep 07 13:52:49.989453 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-2f19df49-17f9-4f1f-8b99-af8f96a79688 req-abe1187f-1192-4af4-ab47-61961c44d7ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074045 Sep 07 13:52:49.990619 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3740/7452] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:52:51.157251 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2c88fd1d-526a-4a96-a0a6-3972f117729d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:52:51.157832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2c88fd1d-526a-4a96-a0a6-3972f117729d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:52:51.166025 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c88fd1d-526a-4a96-a0a6-3972f117729d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:51.166529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c88fd1d-526a-4a96-a0a6-3972f117729d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:51.166956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c88fd1d-526a-4a96-a0a6-3972f117729d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:51.168052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c88fd1d-526a-4a96-a0a6-3972f117729d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:51.168180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c88fd1d-526a-4a96-a0a6-3972f117729d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:51.168519 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c88fd1d-526a-4a96-a0a6-3972f117729d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:51.255557 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-2c88fd1d-526a-4a96-a0a6-3972f117729d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lazy-loading 'services' on Instance uuid a59d82bc-27b2-4263-917f-fcc56b688f2a {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 13:52:51.330670 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2c88fd1d-526a-4a96-a0a6-3972f117729d tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a/os-volume_attachments/6967f0d9-9a68-4c4b-8155-1aee3f6edd1a" status: 202 len: 0 microversion: 2.1 time: 0.180777 Sep 07 13:52:51.334662 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3713/7453] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Sep 7 13:52:51 2022] DELETE /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a/os-volume_attachments/6967f0d9-9a68-4c4b-8155-1aee3f6edd1a => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:52:51.342913 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-69249057-e80a-4ab3-aabc-d7ddf5e47f81 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:52:51.345619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-69249057-e80a-4ab3-aabc-d7ddf5e47f81 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:52:51.353451 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69249057-e80a-4ab3-aabc-d7ddf5e47f81 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:51.354286 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69249057-e80a-4ab3-aabc-d7ddf5e47f81 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:51.354747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69249057-e80a-4ab3-aabc-d7ddf5e47f81 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:51.355520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69249057-e80a-4ab3-aabc-d7ddf5e47f81 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:51.356002 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69249057-e80a-4ab3-aabc-d7ddf5e47f81 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:51.356449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-69249057-e80a-4ab3-aabc-d7ddf5e47f81 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:51.395527 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-69249057-e80a-4ab3-aabc-d7ddf5e47f81 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059197 Sep 07 13:52:51.396081 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3741/7454] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:52:51 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:52:52.006174 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-82fd7df8-f798-4574-b176-6288a22a8524 req-1a855b44-02d0-4c70-9e21-eaaa265019e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a59d82bc-27b2-4263-917f-fcc56b688f2a", "tag": "9b4e130c-7922-428e-8d77-bc8dcd40b6d1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:52:52.021526 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-82fd7df8-f798-4574-b176-6288a22a8524 req-1a855b44-02d0-4c70-9e21-eaaa265019e1 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:52.022477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-82fd7df8-f798-4574-b176-6288a22a8524 req-1a855b44-02d0-4c70-9e21-eaaa265019e1 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:52.022899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-82fd7df8-f798-4574-b176-6288a22a8524 req-1a855b44-02d0-4c70-9e21-eaaa265019e1 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:52.037441 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-82fd7df8-f798-4574-b176-6288a22a8524 req-1a855b44-02d0-4c70-9e21-eaaa265019e1 service nova] Creating event network-changed:9b4e130c-7922-428e-8d77-bc8dcd40b6d1 for instance a59d82bc-27b2-4263-917f-fcc56b688f2a on n-h2-852087-9 Sep 07 13:52:52.053625 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-82fd7df8-f798-4574-b176-6288a22a8524 req-1a855b44-02d0-4c70-9e21-eaaa265019e1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051851 Sep 07 13:52:52.054153 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3714/7455] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:52:52.411492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a15a78e3-a0aa-41c5-ab8b-7437037df891 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:52:52.413179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a15a78e3-a0aa-41c5-ab8b-7437037df891 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:52:52.419429 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 13:52:52.419650 n-d-852087-9 devstack@n-api.service[122433]: Wed Sep 7 13:52:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a/os-volume_attachments (ip 10.222.0.16) !!! Sep 07 13:52:52.423093 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a15a78e3-a0aa-41c5-ab8b-7437037df891 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:52.423896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a15a78e3-a0aa-41c5-ab8b-7437037df891 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:52.424437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a15a78e3-a0aa-41c5-ab8b-7437037df891 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:52.425299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a15a78e3-a0aa-41c5-ab8b-7437037df891 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:52.426038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a15a78e3-a0aa-41c5-ab8b-7437037df891 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:52.426526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a15a78e3-a0aa-41c5-ab8b-7437037df891 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:52.462094 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a15a78e3-a0aa-41c5-ab8b-7437037df891 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057100 Sep 07 13:52:52.462836 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3742/7456] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:52:52 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:52:53.478111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c7b8558c-03a4-481a-9ada-7c04194d06e1 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:52:53.480693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c7b8558c-03a4-481a-9ada-7c04194d06e1 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:52:53.487662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7b8558c-03a4-481a-9ada-7c04194d06e1 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:53.488181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7b8558c-03a4-481a-9ada-7c04194d06e1 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:53.488622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7b8558c-03a4-481a-9ada-7c04194d06e1 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:53.489311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7b8558c-03a4-481a-9ada-7c04194d06e1 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:53.489829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7b8558c-03a4-481a-9ada-7c04194d06e1 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:53.490257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c7b8558c-03a4-481a-9ada-7c04194d06e1 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:53.526550 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c7b8558c-03a4-481a-9ada-7c04194d06e1 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053818 Sep 07 13:52:53.527142 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3715/7457] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:52:53 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:52:54.540775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d5102f6c-b374-4864-8e2d-3076bdd47cb3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:52:54.543112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d5102f6c-b374-4864-8e2d-3076bdd47cb3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:52:54.549602 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5102f6c-b374-4864-8e2d-3076bdd47cb3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:54.550110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5102f6c-b374-4864-8e2d-3076bdd47cb3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:54.550572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5102f6c-b374-4864-8e2d-3076bdd47cb3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:54.551297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5102f6c-b374-4864-8e2d-3076bdd47cb3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:54.551774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5102f6c-b374-4864-8e2d-3076bdd47cb3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:54.552219 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d5102f6c-b374-4864-8e2d-3076bdd47cb3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:54.583751 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d5102f6c-b374-4864-8e2d-3076bdd47cb3 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048058 Sep 07 13:52:54.584449 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3743/7458] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:52:54 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:52:55.597134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7377e92b-21b2-484a-a74f-4ad67af4c276 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:52:55.599308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7377e92b-21b2-484a-a74f-4ad67af4c276 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:52:55.609380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7377e92b-21b2-484a-a74f-4ad67af4c276 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:55.610195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7377e92b-21b2-484a-a74f-4ad67af4c276 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:55.610859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7377e92b-21b2-484a-a74f-4ad67af4c276 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:55.612162 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7377e92b-21b2-484a-a74f-4ad67af4c276 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:55.612857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7377e92b-21b2-484a-a74f-4ad67af4c276 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:55.613575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7377e92b-21b2-484a-a74f-4ad67af4c276 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:55.646983 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7377e92b-21b2-484a-a74f-4ad67af4c276 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054295 Sep 07 13:52:55.647564 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3716/7459] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:52:55 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:52:56.664495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4dab82fb-1e56-40ae-bcb5-1f7d09db2791 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:52:56.667241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4dab82fb-1e56-40ae-bcb5-1f7d09db2791 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:52:56.674822 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4dab82fb-1e56-40ae-bcb5-1f7d09db2791 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:56.675328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4dab82fb-1e56-40ae-bcb5-1f7d09db2791 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:56.675785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4dab82fb-1e56-40ae-bcb5-1f7d09db2791 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:56.676495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4dab82fb-1e56-40ae-bcb5-1f7d09db2791 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:56.676968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4dab82fb-1e56-40ae-bcb5-1f7d09db2791 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:56.677416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4dab82fb-1e56-40ae-bcb5-1f7d09db2791 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:56.712719 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4dab82fb-1e56-40ae-bcb5-1f7d09db2791 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055227 Sep 07 13:52:56.713287 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3744/7460] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Sep 7 13:52:56 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 13:52:56.727255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-81f50b52-5d91-4e92-a930-f717247adcdb tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:52:56.727858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-81f50b52-5d91-4e92-a930-f717247adcdb tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:52:56.735045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81f50b52-5d91-4e92-a930-f717247adcdb tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:56.735527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81f50b52-5d91-4e92-a930-f717247adcdb tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:56.735967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81f50b52-5d91-4e92-a930-f717247adcdb tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:56.736651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81f50b52-5d91-4e92-a930-f717247adcdb tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:52:56.737095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81f50b52-5d91-4e92-a930-f717247adcdb tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:52:56.737585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81f50b52-5d91-4e92-a930-f717247adcdb tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:52:56.818367 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-81f50b52-5d91-4e92-a930-f717247adcdb tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] HTTP exception thrown: Instance a59d82bc-27b2-4263-917f-fcc56b688f2a is not attached to volume 6967f0d9-9a68-4c4b-8155-1aee3f6edd1a Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-81f50b52-5d91-4e92-a930-f717247adcdb tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Request method failure captured: Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: request: DELETE /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a/os-volume_attachments/6967f0d9-9a68-4c4b-8155-1aee3f6edd1a HTTP/1.1 Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGKDSraTmkQiZCfE1vJ7DUnEZi8JGe4hTpAN7lZwblZ0hRnciVzOk2f4lgx3kLxQvTquYhapuG9hqGmdC5RvV4taEaHJ4OafpveyKJbtz4HhKXxJBMlOTyodlSORK4jMBLig0hJfcoutbX1b7-SimiezHJxelMh_G-Do7tgY5K5dx1eA Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 5ddc25bba099486cabbc8456ba351729 Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TestMinimumBasicScenario-1377569300 Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5ddc25bba099486cabbc8456ba351729"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5ddc25bba099486cabbc8456ba351729"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5ddc25bba099486cabbc8456ba351729"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5ddc25bba099486cabbc8456ba351729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TestMinimumBasicScenario-1377569300 Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 5ddc25bba099486cabbc8456ba351729 Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1377569300 Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TestMinimumBasicScenario-1377569300-project Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 9288bb00c59f4be383f74dccddc6ce40 Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TestMinimumBasicScenario-1377569300-project Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance a59d82bc-27b2-4263-917f-fcc56b688f2a is not attached to volume 6967f0d9-9a68-4c4b-8155-1aee3f6edd1a Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'server_id': 'a59d82bc-27b2-4263-917f-fcc56b688f2a', 'id': '6967f0d9-9a68-4c4b-8155-1aee3f6edd1a'} Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6967f0d9-9a68-4c4b-8155-1aee3f6edd1a. Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a59d82bc-27b2-4263-917f-fcc56b688f2a is not attached to volume 6967f0d9-9a68-4c4b-8155-1aee3f6edd1a Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:52:56.820099 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:52:56.824310 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:52:56.824310 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:52:56.824310 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a59d82bc-27b2-4263-917f-fcc56b688f2a is not attached to volume 6967f0d9-9a68-4c4b-8155-1aee3f6edd1a Sep 07 13:52:56.824310 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:52:56.824310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-81f50b52-5d91-4e92-a930-f717247adcdb tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Returning 404 to user: Instance a59d82bc-27b2-4263-917f-fcc56b688f2a is not attached to volume 6967f0d9-9a68-4c4b-8155-1aee3f6edd1a {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:52:56.824310 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-81f50b52-5d91-4e92-a930-f717247adcdb tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a/os-volume_attachments/6967f0d9-9a68-4c4b-8155-1aee3f6edd1a" status: 404 len: 154 microversion: 2.1 time: 0.098657 Sep 07 13:52:56.824310 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3717/7461] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Sep 7 13:52:56 2022] DELETE /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a/os-volume_attachments/6967f0d9-9a68-4c4b-8155-1aee3f6edd1a => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:53:00.094327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c4bd9032-b9ed-44c2-afe7-7b631bb0f320 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:53:00.095277 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c4bd9032-b9ed-44c2-afe7-7b631bb0f320 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:53:00.102517 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4bd9032-b9ed-44c2-afe7-7b631bb0f320 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:00.103033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4bd9032-b9ed-44c2-afe7-7b631bb0f320 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:00.103495 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4bd9032-b9ed-44c2-afe7-7b631bb0f320 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:00.104261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4bd9032-b9ed-44c2-afe7-7b631bb0f320 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:00.104732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4bd9032-b9ed-44c2-afe7-7b631bb0f320 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:00.105180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c4bd9032-b9ed-44c2-afe7-7b631bb0f320 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:00.131731 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c4bd9032-b9ed-44c2-afe7-7b631bb0f320 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:53:00.212790 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c4bd9032-b9ed-44c2-afe7-7b631bb0f320 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 204 len: 0 microversion: 2.1 time: 0.122187 Sep 07 13:53:00.213444 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3745/7462] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:53:00 2022] DELETE /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:53:00.223501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b50b28fc-9eca-48a8-ba20-d33f15a558b7 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:53:00.224881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b50b28fc-9eca-48a8-ba20-d33f15a558b7 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:53:00.233323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b50b28fc-9eca-48a8-ba20-d33f15a558b7 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:00.233867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b50b28fc-9eca-48a8-ba20-d33f15a558b7 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:00.234315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b50b28fc-9eca-48a8-ba20-d33f15a558b7 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:00.235048 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b50b28fc-9eca-48a8-ba20-d33f15a558b7 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:00.235520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b50b28fc-9eca-48a8-ba20-d33f15a558b7 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:00.236022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b50b28fc-9eca-48a8-ba20-d33f15a558b7 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:00.381537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b50b28fc-9eca-48a8-ba20-d33f15a558b7 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:53:00.389880 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b50b28fc-9eca-48a8-ba20-d33f15a558b7 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1555 microversion: 2.1 time: 0.171569 Sep 07 13:53:00.390466 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3718/7463] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:53:00 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:53:01.414538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bed89ba0-c3d0-4712-81d2-b10010634f5a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:53:01.415322 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bed89ba0-c3d0-4712-81d2-b10010634f5a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:53:01.423612 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bed89ba0-c3d0-4712-81d2-b10010634f5a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:01.424119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bed89ba0-c3d0-4712-81d2-b10010634f5a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:01.424575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bed89ba0-c3d0-4712-81d2-b10010634f5a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:01.425321 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bed89ba0-c3d0-4712-81d2-b10010634f5a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:01.425833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bed89ba0-c3d0-4712-81d2-b10010634f5a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:01.426278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bed89ba0-c3d0-4712-81d2-b10010634f5a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:01.564931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bed89ba0-c3d0-4712-81d2-b10010634f5a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:53:01.573972 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bed89ba0-c3d0-4712-81d2-b10010634f5a tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1555 microversion: 2.1 time: 0.163687 Sep 07 13:53:01.574652 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3746/7464] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:53:01 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:53:02.600028 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-49df4d4d-ef80-4f7e-a37b-f47a2379e319 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:53:02.600654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-49df4d4d-ef80-4f7e-a37b-f47a2379e319 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:53:02.613577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49df4d4d-ef80-4f7e-a37b-f47a2379e319 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:02.614444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49df4d4d-ef80-4f7e-a37b-f47a2379e319 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:02.614921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49df4d4d-ef80-4f7e-a37b-f47a2379e319 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:02.615640 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49df4d4d-ef80-4f7e-a37b-f47a2379e319 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:02.616096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49df4d4d-ef80-4f7e-a37b-f47a2379e319 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:02.616723 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49df4d4d-ef80-4f7e-a37b-f47a2379e319 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:02.634472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-347e6a91-daea-4cf7-8538-bb0f01de1437 req-283a052c-bca1-4642-a3c2-cc445961a289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a59d82bc-27b2-4263-917f-fcc56b688f2a", "name": "network-vif-deleted", "tag": "9b4e130c-7922-428e-8d77-bc8dcd40b6d1"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:53:02.648047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-347e6a91-daea-4cf7-8538-bb0f01de1437 req-283a052c-bca1-4642-a3c2-cc445961a289 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:02.648731 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-347e6a91-daea-4cf7-8538-bb0f01de1437 req-283a052c-bca1-4642-a3c2-cc445961a289 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:02.649616 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-347e6a91-daea-4cf7-8538-bb0f01de1437 req-283a052c-bca1-4642-a3c2-cc445961a289 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:02.663146 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-347e6a91-daea-4cf7-8538-bb0f01de1437 req-283a052c-bca1-4642-a3c2-cc445961a289 service nova] Creating event network-vif-deleted:9b4e130c-7922-428e-8d77-bc8dcd40b6d1 for instance a59d82bc-27b2-4263-917f-fcc56b688f2a on n-h2-852087-9 Sep 07 13:53:02.669968 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-347e6a91-daea-4cf7-8538-bb0f01de1437 req-283a052c-bca1-4642-a3c2-cc445961a289 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040071 Sep 07 13:53:02.670689 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3747/7465] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:53:02.701247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-49df4d4d-ef80-4f7e-a37b-f47a2379e319 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9288bb00c59f4be383f74dccddc6ce40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ddc25bba099486cabbc8456ba351729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:53:02.710470 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-49df4d4d-ef80-4f7e-a37b-f47a2379e319 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 200 len: 1513 microversion: 2.1 time: 0.114386 Sep 07 13:53:02.711054 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3719/7466] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:53:02 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 1513 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:53:03.739177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dfcb5252-36fb-4182-9d6b-45489af61864 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:53:03.739899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dfcb5252-36fb-4182-9d6b-45489af61864 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] [instance: a59d82bc-27b2-4263-917f-fcc56b688f2a] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:53:03.750152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfcb5252-36fb-4182-9d6b-45489af61864 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:03.750666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfcb5252-36fb-4182-9d6b-45489af61864 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:03.751103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfcb5252-36fb-4182-9d6b-45489af61864 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:03.751841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfcb5252-36fb-4182-9d6b-45489af61864 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:03.752427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfcb5252-36fb-4182-9d6b-45489af61864 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:03.752953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dfcb5252-36fb-4182-9d6b-45489af61864 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:03.767160 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-dfcb5252-36fb-4182-9d6b-45489af61864 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] HTTP exception thrown: Instance a59d82bc-27b2-4263-917f-fcc56b688f2a could not be found. Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dfcb5252-36fb-4182-9d6b-45489af61864 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Request method failure captured: Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a HTTP/1.1 Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGKDSraTmkQiZCfE1vJ7DUnEZi8JGe4hTpAN7lZwblZ0hRnciVzOk2f4lgx3kLxQvTquYhapuG9hqGmdC5RvV4taEaHJ4OafpveyKJbtz4HhKXxJBMlOTyodlSORK4jMBLig0hJfcoutbX1b7-SimiezHJxelMh_G-Do7tgY5K5dx1eA Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 5ddc25bba099486cabbc8456ba351729 Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TestMinimumBasicScenario-1377569300 Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5ddc25bba099486cabbc8456ba351729"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5ddc25bba099486cabbc8456ba351729"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5ddc25bba099486cabbc8456ba351729"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5ddc25bba099486cabbc8456ba351729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TestMinimumBasicScenario-1377569300 Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 5ddc25bba099486cabbc8456ba351729 Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1377569300 Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TestMinimumBasicScenario-1377569300-project Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 9288bb00c59f4be383f74dccddc6ce40 Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TestMinimumBasicScenario-1377569300-project Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance a59d82bc-27b2-4263-917f-fcc56b688f2a could not be found. Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'a59d82bc-27b2-4263-917f-fcc56b688f2a'} Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a59d82bc-27b2-4263-917f-fcc56b688f2a could not be found. Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a59d82bc-27b2-4263-917f-fcc56b688f2a could not be found. Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:53:03.768802 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:53:03.773140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:53:03.773140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:53:03.773140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:53:03.773140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:53:03.773140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:53:03.773140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a59d82bc-27b2-4263-917f-fcc56b688f2a could not be found. Sep 07 13:53:03.773140 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:53:03.773140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dfcb5252-36fb-4182-9d6b-45489af61864 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Returning 404 to user: Instance a59d82bc-27b2-4263-917f-fcc56b688f2a could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:53:03.773140 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dfcb5252-36fb-4182-9d6b-45489af61864 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a" status: 404 len: 111 microversion: 2.1 time: 0.037873 Sep 07 13:53:03.773140 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3748/7467] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:53:03 2022] GET /compute/v2.1/servers/a59d82bc-27b2-4263-917f-fcc56b688f2a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:53:03.781656 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-51cf0cb7-a5fa-43f4-a748-44d115372491 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] Calling method '.version_select at 0x7fc41390df70>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:53:03.811454 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-51cf0cb7-a5fa-43f4-a748-44d115372491 tempest-TestMinimumBasicScenario-1377569300 tempest-TestMinimumBasicScenario-1377569300-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1347204877" status: 202 len: 0 microversion: 2.1 time: 0.035403 Sep 07 13:53:03.812065 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3720/7468] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Sep 7 13:53:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1347204877 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:53:13.506559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-69d7b4d5-6712-43de-ab98-62b80ea75b7f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'create', calling method: .version_select at 0x7fc413e781f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2130480661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNkqUMcOru5SLM7DavexJ/fpE/OGwFusCMrtEH7ERunPxbnF4F2icIWLMuMnsqVhFzf6Q2diNVBGcvuAtiXL6KJ2A17jgTL+Md/0bmNXCa8gglFi0eCC7Eq+h3170N8qg=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:53:13.528184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-69d7b4d5-6712-43de-ab98-62b80ea75b7f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Getting quotas for project 8f56cfdac7bd4768b54690ce5afe8854. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:53:13.534666 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-69d7b4d5-6712-43de-ab98-62b80ea75b7f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Getting quotas for user 9dce2997e6c6461db3bae9e9c3315d8b and project 8f56cfdac7bd4768b54690ce5afe8854. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:53:13.562292 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-69d7b4d5-6712-43de-ab98-62b80ea75b7f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.263836 Sep 07 13:53:13.562908 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3749/7469] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 13:53:13 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:53:19.929124 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9ffb5a7a-cda3-4d40-a2df-7468fdc4cb52 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1496820844", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "a8ce1ffc-1b52-4c9d-9be6-adfc5fdf25dd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2130480661", "security_groups": [{"name": "tempest-secgroup-smoke-1498080437"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:53:19.940550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:53:19.941340 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:53:20.051578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-9ffb5a7a-cda3-4d40-a2df-7468fdc4cb52 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] validate_networks() for [('a8ce1ffc-1b52-4c9d-9be6-adfc5fdf25dd', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:53:20.529598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9ffb5a7a-cda3-4d40-a2df-7468fdc4cb52 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:53:20.530301 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9ffb5a7a-cda3-4d40-a2df-7468fdc4cb52 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:53:20.530836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9ffb5a7a-cda3-4d40-a2df-7468fdc4cb52 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:53:20.531460 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9ffb5a7a-cda3-4d40-a2df-7468fdc4cb52 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:53:20.532092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-9ffb5a7a-cda3-4d40-a2df-7468fdc4cb52 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:53:20.542687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ffb5a7a-cda3-4d40-a2df-7468fdc4cb52 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:20.543552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ffb5a7a-cda3-4d40-a2df-7468fdc4cb52 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:20.543996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ffb5a7a-cda3-4d40-a2df-7468fdc4cb52 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:20.544732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ffb5a7a-cda3-4d40-a2df-7468fdc4cb52 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:20.545190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ffb5a7a-cda3-4d40-a2df-7468fdc4cb52 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:20.545657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9ffb5a7a-cda3-4d40-a2df-7468fdc4cb52 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:20.566919 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-9ffb5a7a-cda3-4d40-a2df-7468fdc4cb52 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Getting quotas for project 8f56cfdac7bd4768b54690ce5afe8854. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:53:20.574858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-9ffb5a7a-cda3-4d40-a2df-7468fdc4cb52 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Getting quotas for user 9dce2997e6c6461db3bae9e9c3315d8b and project 8f56cfdac7bd4768b54690ce5afe8854. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:53:20.592411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9ffb5a7a-cda3-4d40-a2df-7468fdc4cb52 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:53:20.595316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9ffb5a7a-cda3-4d40-a2df-7468fdc4cb52 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:53:20.645988 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9ffb5a7a-cda3-4d40-a2df-7468fdc4cb52 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.720858 Sep 07 13:53:20.646547 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3721/7470] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:53:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 13:53:20.658132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a04978ab-e539-4f40-a7c7-7180d7e304be tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:53:20.658761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a04978ab-e539-4f40-a7c7-7180d7e304be tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:53:20.661047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:53:20.662806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:53:20.751062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a04978ab-e539-4f40-a7c7-7180d7e304be tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:53:20.758977 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a04978ab-e539-4f40-a7c7-7180d7e304be tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc" status: 200 len: 1267 microversion: 2.1 time: 0.104453 Sep 07 13:53:20.759927 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3750/7471] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:53:20 2022] GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc => generated 1267 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:53:21.785127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d4b4658-7c4d-43c4-ab17-050ab95950d0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:53:21.786399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9d4b4658-7c4d-43c4-ab17-050ab95950d0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:53:21.795674 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d4b4658-7c4d-43c4-ab17-050ab95950d0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:21.796262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d4b4658-7c4d-43c4-ab17-050ab95950d0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:21.796781 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d4b4658-7c4d-43c4-ab17-050ab95950d0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:21.797636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d4b4658-7c4d-43c4-ab17-050ab95950d0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:21.798103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d4b4658-7c4d-43c4-ab17-050ab95950d0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:21.798536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d4b4658-7c4d-43c4-ab17-050ab95950d0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:21.877188 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9d4b4658-7c4d-43c4-ab17-050ab95950d0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:53:21.886179 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9d4b4658-7c4d-43c4-ab17-050ab95950d0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc" status: 200 len: 1319 microversion: 2.1 time: 0.106007 Sep 07 13:53:21.886787 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3722/7472] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:53:21 2022] GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc => generated 1319 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:53:22.912367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f2de530e-8f85-4c6c-8a02-c6e2ecb09c0e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:53:22.913983 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f2de530e-8f85-4c6c-8a02-c6e2ecb09c0e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:53:22.944663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2de530e-8f85-4c6c-8a02-c6e2ecb09c0e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:22.945258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2de530e-8f85-4c6c-8a02-c6e2ecb09c0e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:22.946282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2de530e-8f85-4c6c-8a02-c6e2ecb09c0e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:22.947378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2de530e-8f85-4c6c-8a02-c6e2ecb09c0e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:22.948044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2de530e-8f85-4c6c-8a02-c6e2ecb09c0e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:22.948910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2de530e-8f85-4c6c-8a02-c6e2ecb09c0e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:23.139640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f2de530e-8f85-4c6c-8a02-c6e2ecb09c0e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:53:23.152508 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f2de530e-8f85-4c6c-8a02-c6e2ecb09c0e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc" status: 200 len: 1393 microversion: 2.1 time: 0.245838 Sep 07 13:53:23.153766 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3751/7473] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:53:22 2022] GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc => generated 1393 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:53:23.742950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-664f47f0-873b-4047-b684-a3fd17d08de8 req-ffc9b725-10df-402f-908f-d8c91422ee10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa2f569c-8f5e-462d-8b61-bd665c8757cc", "tag": "6fde890d-1e7d-41e7-8ff3-464d8f27afa9"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:53:23.756004 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-664f47f0-873b-4047-b684-a3fd17d08de8 req-ffc9b725-10df-402f-908f-d8c91422ee10 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:23.756491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-664f47f0-873b-4047-b684-a3fd17d08de8 req-ffc9b725-10df-402f-908f-d8c91422ee10 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:23.757269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-664f47f0-873b-4047-b684-a3fd17d08de8 req-ffc9b725-10df-402f-908f-d8c91422ee10 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:23.774993 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-664f47f0-873b-4047-b684-a3fd17d08de8 req-ffc9b725-10df-402f-908f-d8c91422ee10 service nova] Creating event network-changed:6fde890d-1e7d-41e7-8ff3-464d8f27afa9 for instance aa2f569c-8f5e-462d-8b61-bd665c8757cc on n-h2-852087-9 Sep 07 13:53:23.780363 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-664f47f0-873b-4047-b684-a3fd17d08de8 req-ffc9b725-10df-402f-908f-d8c91422ee10 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041317 Sep 07 13:53:23.781020 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3723/7474] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:53:24.179304 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1cbcc504-6cd7-4bf8-ab32-8ded496cb269 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:53:24.179890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1cbcc504-6cd7-4bf8-ab32-8ded496cb269 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:53:24.188145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cbcc504-6cd7-4bf8-ab32-8ded496cb269 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:24.188657 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cbcc504-6cd7-4bf8-ab32-8ded496cb269 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:24.189114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cbcc504-6cd7-4bf8-ab32-8ded496cb269 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:24.189880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cbcc504-6cd7-4bf8-ab32-8ded496cb269 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:24.190360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cbcc504-6cd7-4bf8-ab32-8ded496cb269 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:24.190801 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1cbcc504-6cd7-4bf8-ab32-8ded496cb269 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:24.342685 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1cbcc504-6cd7-4bf8-ab32-8ded496cb269 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:53:24.353881 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1cbcc504-6cd7-4bf8-ab32-8ded496cb269 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc" status: 200 len: 1393 microversion: 2.1 time: 0.178428 Sep 07 13:53:24.354647 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3752/7475] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:53:24 2022] GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc => generated 1393 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:53:25.378501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-97dda5b6-f2f7-4857-8dc3-f6f9c81fd7e7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:53:25.379231 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-97dda5b6-f2f7-4857-8dc3-f6f9c81fd7e7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:53:25.386941 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97dda5b6-f2f7-4857-8dc3-f6f9c81fd7e7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:25.387433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97dda5b6-f2f7-4857-8dc3-f6f9c81fd7e7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:25.387886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97dda5b6-f2f7-4857-8dc3-f6f9c81fd7e7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:25.388585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97dda5b6-f2f7-4857-8dc3-f6f9c81fd7e7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:25.389041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97dda5b6-f2f7-4857-8dc3-f6f9c81fd7e7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:25.389462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-97dda5b6-f2f7-4857-8dc3-f6f9c81fd7e7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:25.524910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-97dda5b6-f2f7-4857-8dc3-f6f9c81fd7e7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:53:25.533328 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-97dda5b6-f2f7-4857-8dc3-f6f9c81fd7e7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc" status: 200 len: 1393 microversion: 2.1 time: 0.159120 Sep 07 13:53:25.533961 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3724/7476] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:53:25 2022] GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:53:26.557036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2346effe-2114-4f97-b37f-c54e32e999ef tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:53:26.557746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2346effe-2114-4f97-b37f-c54e32e999ef tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:53:26.565036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2346effe-2114-4f97-b37f-c54e32e999ef tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:26.565588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2346effe-2114-4f97-b37f-c54e32e999ef tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:26.566042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2346effe-2114-4f97-b37f-c54e32e999ef tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:26.566795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2346effe-2114-4f97-b37f-c54e32e999ef tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:26.567275 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2346effe-2114-4f97-b37f-c54e32e999ef tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:26.567752 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2346effe-2114-4f97-b37f-c54e32e999ef tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:26.715880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2346effe-2114-4f97-b37f-c54e32e999ef tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:53:26.724869 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2346effe-2114-4f97-b37f-c54e32e999ef tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc" status: 200 len: 1393 microversion: 2.1 time: 0.171800 Sep 07 13:53:26.725664 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3753/7477] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:53:26 2022] GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc => generated 1393 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:53:27.748673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-78ca69b1-95d1-4f63-950b-a9ddc0327c0f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:53:27.749278 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-78ca69b1-95d1-4f63-950b-a9ddc0327c0f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:53:27.757236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78ca69b1-95d1-4f63-950b-a9ddc0327c0f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:27.757806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78ca69b1-95d1-4f63-950b-a9ddc0327c0f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:27.758243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78ca69b1-95d1-4f63-950b-a9ddc0327c0f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:27.758955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78ca69b1-95d1-4f63-950b-a9ddc0327c0f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:27.759411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78ca69b1-95d1-4f63-950b-a9ddc0327c0f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:27.759841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-78ca69b1-95d1-4f63-950b-a9ddc0327c0f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:27.904044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-78ca69b1-95d1-4f63-950b-a9ddc0327c0f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:53:27.912003 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-78ca69b1-95d1-4f63-950b-a9ddc0327c0f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc" status: 200 len: 1393 microversion: 2.1 time: 0.167411 Sep 07 13:53:27.912598 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3725/7478] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:53:27 2022] GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:53:28.936098 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-59f38ca1-2dd5-40f9-aa58-34db7435191d tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:53:28.936837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-59f38ca1-2dd5-40f9-aa58-34db7435191d tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:53:28.944319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59f38ca1-2dd5-40f9-aa58-34db7435191d tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:28.944953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59f38ca1-2dd5-40f9-aa58-34db7435191d tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:28.945408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59f38ca1-2dd5-40f9-aa58-34db7435191d tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:28.946148 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59f38ca1-2dd5-40f9-aa58-34db7435191d tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:28.946821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59f38ca1-2dd5-40f9-aa58-34db7435191d tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:28.947452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-59f38ca1-2dd5-40f9-aa58-34db7435191d tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:29.095441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-59f38ca1-2dd5-40f9-aa58-34db7435191d tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:53:29.103841 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-59f38ca1-2dd5-40f9-aa58-34db7435191d tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc" status: 200 len: 1393 microversion: 2.1 time: 0.172058 Sep 07 13:53:29.104475 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3754/7479] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:53:28 2022] GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:53:30.062324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-92d98303-042c-4c88-aaf1-c7e73259323e req-973a9afe-53a2-42b8-81de-7dffa70b4418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2f569c-8f5e-462d-8b61-bd665c8757cc", "name": "network-vif-plugged", "status": "completed", "tag": "6fde890d-1e7d-41e7-8ff3-464d8f27afa9"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:53:30.074757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-92d98303-042c-4c88-aaf1-c7e73259323e req-973a9afe-53a2-42b8-81de-7dffa70b4418 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:30.075326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-92d98303-042c-4c88-aaf1-c7e73259323e req-973a9afe-53a2-42b8-81de-7dffa70b4418 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:30.075807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-92d98303-042c-4c88-aaf1-c7e73259323e req-973a9afe-53a2-42b8-81de-7dffa70b4418 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:30.089075 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-92d98303-042c-4c88-aaf1-c7e73259323e req-973a9afe-53a2-42b8-81de-7dffa70b4418 service nova] Creating event network-vif-plugged:6fde890d-1e7d-41e7-8ff3-464d8f27afa9 for instance aa2f569c-8f5e-462d-8b61-bd665c8757cc on n-h2-852087-9 Sep 07 13:53:30.094722 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-92d98303-042c-4c88-aaf1-c7e73259323e req-973a9afe-53a2-42b8-81de-7dffa70b4418 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036148 Sep 07 13:53:30.095671 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3726/7480] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:53:30.132101 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-473fa00e-5350-478e-bae2-2b7ea95f2e1a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:53:30.133161 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-473fa00e-5350-478e-bae2-2b7ea95f2e1a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:53:30.147247 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-473fa00e-5350-478e-bae2-2b7ea95f2e1a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:30.148066 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-473fa00e-5350-478e-bae2-2b7ea95f2e1a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:30.148882 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-473fa00e-5350-478e-bae2-2b7ea95f2e1a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:30.150071 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-473fa00e-5350-478e-bae2-2b7ea95f2e1a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:30.151359 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-473fa00e-5350-478e-bae2-2b7ea95f2e1a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:30.151899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-473fa00e-5350-478e-bae2-2b7ea95f2e1a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:30.315763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-473fa00e-5350-478e-bae2-2b7ea95f2e1a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:53:30.324509 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-473fa00e-5350-478e-bae2-2b7ea95f2e1a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc" status: 200 len: 1393 microversion: 2.1 time: 0.199761 Sep 07 13:53:30.325110 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3755/7481] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:53:30 2022] GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc => generated 1393 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:53:31.345890 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:53:31.347193 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:53:31.353767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b49099b4-c442-48f6-8657-90d9f76a062f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:53:31.354499 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b49099b4-c442-48f6-8657-90d9f76a062f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:53:31.362397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b49099b4-c442-48f6-8657-90d9f76a062f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:31.363190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b49099b4-c442-48f6-8657-90d9f76a062f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:31.363639 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b49099b4-c442-48f6-8657-90d9f76a062f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:31.364368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b49099b4-c442-48f6-8657-90d9f76a062f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:31.364829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b49099b4-c442-48f6-8657-90d9f76a062f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:31.365262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b49099b4-c442-48f6-8657-90d9f76a062f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:31.547490 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b49099b4-c442-48f6-8657-90d9f76a062f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:53:31.559781 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b49099b4-c442-48f6-8657-90d9f76a062f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc" status: 200 len: 1393 microversion: 2.1 time: 0.215204 Sep 07 13:53:31.560384 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3727/7482] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:53:31 2022] GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc => generated 1393 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:53:32.584834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b91c7cea-478e-4a16-83ec-8c0458c46553 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:53:32.585446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b91c7cea-478e-4a16-83ec-8c0458c46553 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:53:32.587522 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:53:32.598739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b91c7cea-478e-4a16-83ec-8c0458c46553 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:32.599394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b91c7cea-478e-4a16-83ec-8c0458c46553 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:32.599915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b91c7cea-478e-4a16-83ec-8c0458c46553 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:32.600844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b91c7cea-478e-4a16-83ec-8c0458c46553 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:32.601330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b91c7cea-478e-4a16-83ec-8c0458c46553 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:32.601848 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b91c7cea-478e-4a16-83ec-8c0458c46553 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:32.755356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b91c7cea-478e-4a16-83ec-8c0458c46553 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:53:32.763853 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b91c7cea-478e-4a16-83ec-8c0458c46553 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc" status: 200 len: 1563 microversion: 2.1 time: 0.182982 Sep 07 13:53:32.764438 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3756/7483] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:53:32 2022] GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc => generated 1563 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:53:32.787396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3f2ff883-fff2-49fd-9bca-9fb7bbd2bfa7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:53:32.788010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3f2ff883-fff2-49fd-9bca-9fb7bbd2bfa7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:53:32.796353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f2ff883-fff2-49fd-9bca-9fb7bbd2bfa7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:32.796873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f2ff883-fff2-49fd-9bca-9fb7bbd2bfa7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:32.797322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f2ff883-fff2-49fd-9bca-9fb7bbd2bfa7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:32.798259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f2ff883-fff2-49fd-9bca-9fb7bbd2bfa7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:32.798690 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f2ff883-fff2-49fd-9bca-9fb7bbd2bfa7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:32.799166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3f2ff883-fff2-49fd-9bca-9fb7bbd2bfa7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:32.937805 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3f2ff883-fff2-49fd-9bca-9fb7bbd2bfa7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:53:32.946328 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3f2ff883-fff2-49fd-9bca-9fb7bbd2bfa7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc" status: 200 len: 1563 microversion: 2.1 time: 0.163475 Sep 07 13:53:32.946943 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3728/7484] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:53:32 2022] GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:53:34.994665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-694503e2-b288-4283-a048-9f8ec710741a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:53:34.995416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-694503e2-b288-4283-a048-9f8ec710741a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:53:34.997667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-6df5e882-31e7-46a2-a0d3-f624fd76fce9 req-1096c25a-4196-426d-8d3e-3c5a1cc7c7e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa2f569c-8f5e-462d-8b61-bd665c8757cc", "tag": "6fde890d-1e7d-41e7-8ff3-464d8f27afa9"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:53:35.006363 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-694503e2-b288-4283-a048-9f8ec710741a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:35.007383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-694503e2-b288-4283-a048-9f8ec710741a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:35.008480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-694503e2-b288-4283-a048-9f8ec710741a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:35.009155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6df5e882-31e7-46a2-a0d3-f624fd76fce9 req-1096c25a-4196-426d-8d3e-3c5a1cc7c7e9 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:35.009695 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6df5e882-31e7-46a2-a0d3-f624fd76fce9 req-1096c25a-4196-426d-8d3e-3c5a1cc7c7e9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:35.010134 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-6df5e882-31e7-46a2-a0d3-f624fd76fce9 req-1096c25a-4196-426d-8d3e-3c5a1cc7c7e9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:35.010377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-694503e2-b288-4283-a048-9f8ec710741a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:35.011316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-694503e2-b288-4283-a048-9f8ec710741a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:35.011839 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-694503e2-b288-4283-a048-9f8ec710741a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:35.025002 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-6df5e882-31e7-46a2-a0d3-f624fd76fce9 req-1096c25a-4196-426d-8d3e-3c5a1cc7c7e9 service nova] Creating event network-changed:6fde890d-1e7d-41e7-8ff3-464d8f27afa9 for instance aa2f569c-8f5e-462d-8b61-bd665c8757cc on n-h2-852087-9 Sep 07 13:53:35.030342 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-6df5e882-31e7-46a2-a0d3-f624fd76fce9 req-1096c25a-4196-426d-8d3e-3c5a1cc7c7e9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036201 Sep 07 13:53:35.030983 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3729/7485] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:53:35.202872 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-694503e2-b288-4283-a048-9f8ec710741a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:53:35.216873 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-694503e2-b288-4283-a048-9f8ec710741a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc" status: 200 len: 1563 microversion: 2.1 time: 0.225745 Sep 07 13:53:35.218214 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3757/7486] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:53:34 2022] GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc => generated 1563 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:53:58.509175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-60cda445-6032-4bdc-b6ad-4c9d4fc03010 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:53:58.511598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-60cda445-6032-4bdc-b6ad-4c9d4fc03010 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:53:58.514113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:53:58.514798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=38 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:53:58.522270 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60cda445-6032-4bdc-b6ad-4c9d4fc03010 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:58.522997 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60cda445-6032-4bdc-b6ad-4c9d4fc03010 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:58.523443 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60cda445-6032-4bdc-b6ad-4c9d4fc03010 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:58.524196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60cda445-6032-4bdc-b6ad-4c9d4fc03010 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:53:58.524659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60cda445-6032-4bdc-b6ad-4c9d4fc03010 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:53:58.525118 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-60cda445-6032-4bdc-b6ad-4c9d4fc03010 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:53:58.603880 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-60cda445-6032-4bdc-b6ad-4c9d4fc03010 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc/action" status: 200 len: 24562 microversion: 2.1 time: 0.098835 Sep 07 13:53:58.604743 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3730/7487] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:53:58 2022] POST /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc/action => generated 24562 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:54:04.944350 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4f2bfe10-a477-4c44-95fd-edf3dadbeb3f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:54:04.945039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4f2bfe10-a477-4c44-95fd-edf3dadbeb3f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:54:04.948244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=17 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:54:04.949020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=42 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:54:04.955863 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f2bfe10-a477-4c44-95fd-edf3dadbeb3f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:04.956381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f2bfe10-a477-4c44-95fd-edf3dadbeb3f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:04.956844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f2bfe10-a477-4c44-95fd-edf3dadbeb3f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:04.957598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f2bfe10-a477-4c44-95fd-edf3dadbeb3f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:04.958104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f2bfe10-a477-4c44-95fd-edf3dadbeb3f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:04.958569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4f2bfe10-a477-4c44-95fd-edf3dadbeb3f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:05.035014 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4f2bfe10-a477-4c44-95fd-edf3dadbeb3f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc/action" status: 202 len: 0 microversion: 2.1 time: 0.096573 Sep 07 13:54:05.035654 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3758/7488] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:54:04 2022] POST /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:54:05.045379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8be67271-68df-4fa2-afe6-9123a7940d1c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:54:05.045825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8be67271-68df-4fa2-afe6-9123a7940d1c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:54:05.055512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8be67271-68df-4fa2-afe6-9123a7940d1c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:05.056020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8be67271-68df-4fa2-afe6-9123a7940d1c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:05.056469 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8be67271-68df-4fa2-afe6-9123a7940d1c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:05.057223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8be67271-68df-4fa2-afe6-9123a7940d1c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:05.057865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8be67271-68df-4fa2-afe6-9123a7940d1c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:05.058389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8be67271-68df-4fa2-afe6-9123a7940d1c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:05.206687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8be67271-68df-4fa2-afe6-9123a7940d1c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:54:05.218812 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8be67271-68df-4fa2-afe6-9123a7940d1c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc" status: 200 len: 1686 microversion: 2.1 time: 0.178073 Sep 07 13:54:05.219363 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3731/7489] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:54:05 2022] GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc => generated 1686 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:54:06.246194 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-12ce2b23-bab9-4226-bf04-10122e87c260 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:54:06.246792 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-12ce2b23-bab9-4226-bf04-10122e87c260 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:54:06.253581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12ce2b23-bab9-4226-bf04-10122e87c260 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:06.254090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12ce2b23-bab9-4226-bf04-10122e87c260 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:06.254555 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12ce2b23-bab9-4226-bf04-10122e87c260 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:06.255276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12ce2b23-bab9-4226-bf04-10122e87c260 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:06.255756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12ce2b23-bab9-4226-bf04-10122e87c260 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:06.256254 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-12ce2b23-bab9-4226-bf04-10122e87c260 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:06.411846 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-12ce2b23-bab9-4226-bf04-10122e87c260 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:54:06.422822 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-12ce2b23-bab9-4226-bf04-10122e87c260 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc" status: 200 len: 1666 microversion: 2.1 time: 0.182100 Sep 07 13:54:06.423398 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3759/7490] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:54:06 2022] GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc => generated 1666 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:54:07.536547 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cb69ebcc-f032-4656-aeaf-991252cced97 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:54:07.538839 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cb69ebcc-f032-4656-aeaf-991252cced97 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:54:07.546257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb69ebcc-f032-4656-aeaf-991252cced97 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:07.546762 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb69ebcc-f032-4656-aeaf-991252cced97 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:07.547209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb69ebcc-f032-4656-aeaf-991252cced97 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:07.547921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb69ebcc-f032-4656-aeaf-991252cced97 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:07.548385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb69ebcc-f032-4656-aeaf-991252cced97 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:07.548824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cb69ebcc-f032-4656-aeaf-991252cced97 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:07.623162 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cb69ebcc-f032-4656-aeaf-991252cced97 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc/action" status: 200 len: 32634 microversion: 2.1 time: 0.090230 Sep 07 13:54:07.624374 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3732/7491] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:54:07 2022] POST /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc/action => generated 32634 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:54:07.638982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-629e6911-52f3-4313-a847-860fc35717bd tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:54:07.639504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-629e6911-52f3-4313-a847-860fc35717bd tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:54:07.648484 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-629e6911-52f3-4313-a847-860fc35717bd tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:07.649015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-629e6911-52f3-4313-a847-860fc35717bd tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:07.649477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-629e6911-52f3-4313-a847-860fc35717bd tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:07.650225 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-629e6911-52f3-4313-a847-860fc35717bd tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:07.650701 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-629e6911-52f3-4313-a847-860fc35717bd tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:07.651149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-629e6911-52f3-4313-a847-860fc35717bd tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:07.719616 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-629e6911-52f3-4313-a847-860fc35717bd tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc/action" status: 202 len: 0 microversion: 2.1 time: 0.084506 Sep 07 13:54:07.720709 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3760/7492] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:54:07 2022] POST /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:54:07.729717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-084dd829-76ea-4f8a-a516-fa34c705a954 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:54:07.730560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-084dd829-76ea-4f8a-a516-fa34c705a954 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:54:07.737918 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-084dd829-76ea-4f8a-a516-fa34c705a954 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:07.738376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-084dd829-76ea-4f8a-a516-fa34c705a954 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:07.738816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-084dd829-76ea-4f8a-a516-fa34c705a954 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:07.739515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-084dd829-76ea-4f8a-a516-fa34c705a954 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:07.739972 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-084dd829-76ea-4f8a-a516-fa34c705a954 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:07.740402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-084dd829-76ea-4f8a-a516-fa34c705a954 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:07.881787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-084dd829-76ea-4f8a-a516-fa34c705a954 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:54:07.892457 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-084dd829-76ea-4f8a-a516-fa34c705a954 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc" status: 200 len: 1673 microversion: 2.1 time: 0.167024 Sep 07 13:54:07.893038 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3733/7493] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:54:07 2022] GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:54:08.921894 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9bca3c54-a84a-43e2-bed6-8a7e2a0170c6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:54:08.922621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9bca3c54-a84a-43e2-bed6-8a7e2a0170c6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:54:08.929504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bca3c54-a84a-43e2-bed6-8a7e2a0170c6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:08.930025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bca3c54-a84a-43e2-bed6-8a7e2a0170c6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:08.930487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bca3c54-a84a-43e2-bed6-8a7e2a0170c6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:08.931233 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bca3c54-a84a-43e2-bed6-8a7e2a0170c6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:08.931712 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bca3c54-a84a-43e2-bed6-8a7e2a0170c6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:08.932159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9bca3c54-a84a-43e2-bed6-8a7e2a0170c6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:09.073949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9bca3c54-a84a-43e2-bed6-8a7e2a0170c6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:54:09.082504 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9bca3c54-a84a-43e2-bed6-8a7e2a0170c6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc" status: 200 len: 1681 microversion: 2.1 time: 0.168440 Sep 07 13:54:09.083151 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3761/7494] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:54:08 2022] GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:54:09.188584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4bd5a07a-2e28-40a9-9fc0-0e4116d20dc4 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:54:09.190899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4bd5a07a-2e28-40a9-9fc0-0e4116d20dc4 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:54:09.199015 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4bd5a07a-2e28-40a9-9fc0-0e4116d20dc4 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:09.199497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4bd5a07a-2e28-40a9-9fc0-0e4116d20dc4 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:09.199935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4bd5a07a-2e28-40a9-9fc0-0e4116d20dc4 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:09.200622 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4bd5a07a-2e28-40a9-9fc0-0e4116d20dc4 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:09.201099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4bd5a07a-2e28-40a9-9fc0-0e4116d20dc4 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:09.201550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4bd5a07a-2e28-40a9-9fc0-0e4116d20dc4 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:09.275327 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4bd5a07a-2e28-40a9-9fc0-0e4116d20dc4 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc/action" status: 200 len: 35301 microversion: 2.1 time: 0.092120 Sep 07 13:54:09.276098 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3734/7495] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:54:09 2022] POST /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc/action => generated 35301 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:54:10.400371 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cd229ef2-84d0-48ad-b14f-0c6e125cf3ef tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:54:10.400962 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cd229ef2-84d0-48ad-b14f-0c6e125cf3ef tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:54:10.408153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd229ef2-84d0-48ad-b14f-0c6e125cf3ef tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:10.408680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd229ef2-84d0-48ad-b14f-0c6e125cf3ef tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:10.409141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd229ef2-84d0-48ad-b14f-0c6e125cf3ef tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:10.409896 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd229ef2-84d0-48ad-b14f-0c6e125cf3ef tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:10.410587 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd229ef2-84d0-48ad-b14f-0c6e125cf3ef tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:10.411018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cd229ef2-84d0-48ad-b14f-0c6e125cf3ef tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:10.442394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cd229ef2-84d0-48ad-b14f-0c6e125cf3ef tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:54:10.469411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3b4a9a11-f7bb-464c-801a-301968b8009e req-cbe8b30e-21db-492d-8328-86d5bd497b5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa2f569c-8f5e-462d-8b61-bd665c8757cc", "tag": "6fde890d-1e7d-41e7-8ff3-464d8f27afa9"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:54:10.481804 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3b4a9a11-f7bb-464c-801a-301968b8009e req-cbe8b30e-21db-492d-8328-86d5bd497b5b service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:10.482461 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3b4a9a11-f7bb-464c-801a-301968b8009e req-cbe8b30e-21db-492d-8328-86d5bd497b5b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:10.482995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3b4a9a11-f7bb-464c-801a-301968b8009e req-cbe8b30e-21db-492d-8328-86d5bd497b5b service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:10.499757 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3b4a9a11-f7bb-464c-801a-301968b8009e req-cbe8b30e-21db-492d-8328-86d5bd497b5b service nova] Creating event network-changed:6fde890d-1e7d-41e7-8ff3-464d8f27afa9 for instance aa2f569c-8f5e-462d-8b61-bd665c8757cc on n-h2-852087-9 Sep 07 13:54:10.505450 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3b4a9a11-f7bb-464c-801a-301968b8009e req-cbe8b30e-21db-492d-8328-86d5bd497b5b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106081 Sep 07 13:54:10.506788 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3735/7496] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:54:10.538206 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cd229ef2-84d0-48ad-b14f-0c6e125cf3ef tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc" status: 204 len: 0 microversion: 2.1 time: 0.141684 Sep 07 13:54:10.538801 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3762/7497] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:54:10 2022] DELETE /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:54:10.550327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b0877f89-d063-4ed0-9ae8-7ebfd3e8fce5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:54:10.551396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b0877f89-d063-4ed0-9ae8-7ebfd3e8fce5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:54:10.560344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0877f89-d063-4ed0-9ae8-7ebfd3e8fce5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:10.561354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0877f89-d063-4ed0-9ae8-7ebfd3e8fce5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:10.562111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0877f89-d063-4ed0-9ae8-7ebfd3e8fce5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:10.563517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0877f89-d063-4ed0-9ae8-7ebfd3e8fce5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:10.565026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0877f89-d063-4ed0-9ae8-7ebfd3e8fce5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:10.565643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b0877f89-d063-4ed0-9ae8-7ebfd3e8fce5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:10.711653 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b0877f89-d063-4ed0-9ae8-7ebfd3e8fce5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:54:10.719888 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b0877f89-d063-4ed0-9ae8-7ebfd3e8fce5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc" status: 200 len: 1687 microversion: 2.1 time: 0.175498 Sep 07 13:54:10.720802 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3736/7498] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:54:10 2022] GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc => generated 1687 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:54:11.745834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-72141dc1-6890-4ed8-a94f-ac68a583e53d tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:54:11.746429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-72141dc1-6890-4ed8-a94f-ac68a583e53d tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:54:11.753804 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72141dc1-6890-4ed8-a94f-ac68a583e53d tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:11.754308 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72141dc1-6890-4ed8-a94f-ac68a583e53d tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:11.754763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72141dc1-6890-4ed8-a94f-ac68a583e53d tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:11.755462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72141dc1-6890-4ed8-a94f-ac68a583e53d tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:11.755938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72141dc1-6890-4ed8-a94f-ac68a583e53d tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:11.756379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72141dc1-6890-4ed8-a94f-ac68a583e53d tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:11.901542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-72141dc1-6890-4ed8-a94f-ac68a583e53d tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:54:11.910211 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-72141dc1-6890-4ed8-a94f-ac68a583e53d tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc" status: 200 len: 1687 microversion: 2.1 time: 0.168832 Sep 07 13:54:11.910785 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3763/7499] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:54:11 2022] GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:54:12.934395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-07f5344e-ab52-4f65-803b-4f9a048df83c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:54:12.935013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-07f5344e-ab52-4f65-803b-4f9a048df83c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:54:12.942450 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07f5344e-ab52-4f65-803b-4f9a048df83c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:12.942938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07f5344e-ab52-4f65-803b-4f9a048df83c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:12.943407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07f5344e-ab52-4f65-803b-4f9a048df83c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:12.944117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07f5344e-ab52-4f65-803b-4f9a048df83c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:12.944573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07f5344e-ab52-4f65-803b-4f9a048df83c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:12.945037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07f5344e-ab52-4f65-803b-4f9a048df83c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:12.976960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-005c7479-b7a3-4803-b8db-9dd6586e39f3 req-3881cfbb-5a92-4a20-b375-57046f34c22e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2f569c-8f5e-462d-8b61-bd665c8757cc", "name": "network-vif-deleted", "tag": "6fde890d-1e7d-41e7-8ff3-464d8f27afa9"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:54:12.988133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-005c7479-b7a3-4803-b8db-9dd6586e39f3 req-3881cfbb-5a92-4a20-b375-57046f34c22e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:12.988635 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-005c7479-b7a3-4803-b8db-9dd6586e39f3 req-3881cfbb-5a92-4a20-b375-57046f34c22e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:12.989083 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-005c7479-b7a3-4803-b8db-9dd6586e39f3 req-3881cfbb-5a92-4a20-b375-57046f34c22e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:13.001268 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-005c7479-b7a3-4803-b8db-9dd6586e39f3 req-3881cfbb-5a92-4a20-b375-57046f34c22e service nova] Creating event network-vif-deleted:6fde890d-1e7d-41e7-8ff3-464d8f27afa9 for instance aa2f569c-8f5e-462d-8b61-bd665c8757cc on n-h2-852087-9 Sep 07 13:54:13.006502 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-005c7479-b7a3-4803-b8db-9dd6586e39f3 req-3881cfbb-5a92-4a20-b375-57046f34c22e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033401 Sep 07 13:54:13.007303 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3764/7500] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:54:13.019602 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-07f5344e-ab52-4f65-803b-4f9a048df83c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:54:13.027579 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-07f5344e-ab52-4f65-803b-4f9a048df83c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc" status: 200 len: 1501 microversion: 2.1 time: 0.097206 Sep 07 13:54:13.028167 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3737/7501] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:54:12 2022] GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc => generated 1501 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:54:14.053098 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6bf4e98a-c2b0-469b-8eba-5fb9f9764ef3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:54:14.053868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6bf4e98a-c2b0-469b-8eba-5fb9f9764ef3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: aa2f569c-8f5e-462d-8b61-bd665c8757cc] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:54:14.060759 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bf4e98a-c2b0-469b-8eba-5fb9f9764ef3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:14.061267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bf4e98a-c2b0-469b-8eba-5fb9f9764ef3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:14.061749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bf4e98a-c2b0-469b-8eba-5fb9f9764ef3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:14.062485 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bf4e98a-c2b0-469b-8eba-5fb9f9764ef3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:14.062968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bf4e98a-c2b0-469b-8eba-5fb9f9764ef3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:14.063417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6bf4e98a-c2b0-469b-8eba-5fb9f9764ef3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:14.078396 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-6bf4e98a-c2b0-469b-8eba-5fb9f9764ef3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] HTTP exception thrown: Instance aa2f569c-8f5e-462d-8b61-bd665c8757cc could not be found. Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6bf4e98a-c2b0-469b-8eba-5fb9f9764ef3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Request method failure captured: Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc HTTP/1.1 Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGKJIpRj4dUoVYAzI48MspU8ZelpD30GGZSMNBLAcJjfPqrRwz5SflK5ZGsGmdXzaRhezwINOX9bACqNviUzYHhK5j_TepIiCI-ydksrX2YrwyvVjX0oRIdw2hFrTIsMr6gjr_5dekqg_MtjlByIh9B6o0NyhZw8LTWA2pkGzjxBAu_s Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8f56cfdac7bd4768b54690ce5afe8854 Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-901687866 Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f56cfdac7bd4768b54690ce5afe8854"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f56cfdac7bd4768b54690ce5afe8854"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f56cfdac7bd4768b54690ce5afe8854"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f56cfdac7bd4768b54690ce5afe8854"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TestNetworkAdvancedServerOps-901687866 Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8f56cfdac7bd4768b54690ce5afe8854 Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-901687866 Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TestNetworkAdvancedServerOps-901687866-project Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 9dce2997e6c6461db3bae9e9c3315d8b Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TestNetworkAdvancedServerOps-901687866-project Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance aa2f569c-8f5e-462d-8b61-bd665c8757cc could not be found. Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'aa2f569c-8f5e-462d-8b61-bd665c8757cc'} Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa2f569c-8f5e-462d-8b61-bd665c8757cc could not be found. Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa2f569c-8f5e-462d-8b61-bd665c8757cc could not be found. Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:54:14.080091 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:54:14.085070 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:54:14.085070 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:54:14.085070 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:54:14.085070 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:54:14.085070 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:54:14.085070 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:54:14.085070 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa2f569c-8f5e-462d-8b61-bd665c8757cc could not be found. Sep 07 13:54:14.085070 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 13:54:14.085070 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6bf4e98a-c2b0-469b-8eba-5fb9f9764ef3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Returning 404 to user: Instance aa2f569c-8f5e-462d-8b61-bd665c8757cc could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:54:14.085070 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6bf4e98a-c2b0-469b-8eba-5fb9f9764ef3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc" status: 404 len: 111 microversion: 2.1 time: 0.033844 Sep 07 13:54:14.085070 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3765/7502] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:54:14 2022] GET /compute/v2.1/servers/aa2f569c-8f5e-462d-8b61-bd665c8757cc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:54:17.574546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bff06536-f1ef-4045-865a-c942d36d923b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '.version_select at 0x7fc41a7f6280>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:54:17.597740 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bff06536-f1ef-4045-865a-c942d36d923b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2130480661" status: 202 len: 0 microversion: 2.1 time: 0.027287 Sep 07 13:54:17.598351 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3738/7503] 10.222.0.16 () {58 vars in 1284 bytes} [Wed Sep 7 13:54:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2130480661 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 13:54:17.627900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bde82743-c6fb-40e7-afcd-eaa1a77bf09b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'create', calling method: .version_select at 0x7fc413e78160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1522913772", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7LlH7rBw3TLjSQwjBoDmzLQh8mA+YSUTBWjxWXkD6bCY8SzIXSx4KQxOfK1dMPsYEt4OerpS+BlO5Y/5UOvkGt4+yZ2v9j+2k0+WMWuZYzjclKUxe8Mi34gzqb4P7FlA=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:54:17.645145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-bde82743-c6fb-40e7-afcd-eaa1a77bf09b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Getting quotas for project 8f56cfdac7bd4768b54690ce5afe8854. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:54:17.651437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-bde82743-c6fb-40e7-afcd-eaa1a77bf09b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Getting quotas for user 9dce2997e6c6461db3bae9e9c3315d8b and project 8f56cfdac7bd4768b54690ce5afe8854. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:54:17.678033 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bde82743-c6fb-40e7-afcd-eaa1a77bf09b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054273 Sep 07 13:54:17.678782 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3766/7504] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 13:54:17 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:54:23.602797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-22f08d71-e476-4c37-91cc-324851765f5c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-128452012", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "a0481aa2-a26d-44e4-99bb-9e8b693699f9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1522913772", "security_groups": [{"name": "tempest-secgroup-smoke-892865413"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:54:23.614848 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=38 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:54:23.745017 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-22f08d71-e476-4c37-91cc-324851765f5c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] validate_networks() for [('a0481aa2-a26d-44e4-99bb-9e8b693699f9', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:54:24.186935 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-22f08d71-e476-4c37-91cc-324851765f5c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:54:24.187594 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-22f08d71-e476-4c37-91cc-324851765f5c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:54:24.188196 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-22f08d71-e476-4c37-91cc-324851765f5c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:54:24.188706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-22f08d71-e476-4c37-91cc-324851765f5c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:54:24.189212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-22f08d71-e476-4c37-91cc-324851765f5c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:54:24.203773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22f08d71-e476-4c37-91cc-324851765f5c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:24.204242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22f08d71-e476-4c37-91cc-324851765f5c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:24.204730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22f08d71-e476-4c37-91cc-324851765f5c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:24.205465 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22f08d71-e476-4c37-91cc-324851765f5c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:24.205953 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22f08d71-e476-4c37-91cc-324851765f5c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:24.206380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-22f08d71-e476-4c37-91cc-324851765f5c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:24.226616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-22f08d71-e476-4c37-91cc-324851765f5c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Getting quotas for project 8f56cfdac7bd4768b54690ce5afe8854. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:54:24.232636 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-22f08d71-e476-4c37-91cc-324851765f5c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Getting quotas for user 9dce2997e6c6461db3bae9e9c3315d8b and project 8f56cfdac7bd4768b54690ce5afe8854. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:54:24.247517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-22f08d71-e476-4c37-91cc-324851765f5c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:54:24.250081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-22f08d71-e476-4c37-91cc-324851765f5c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:54:24.301704 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-22f08d71-e476-4c37-91cc-324851765f5c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.703047 Sep 07 13:54:24.302558 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3739/7505] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:54:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 13:54:24.314267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-13995dc0-cd8f-49a7-ac1e-416ca3ed90f2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:54:24.314903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-13995dc0-cd8f-49a7-ac1e-416ca3ed90f2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:54:24.317829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:54:24.378352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-13995dc0-cd8f-49a7-ac1e-416ca3ed90f2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:54:24.387482 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-13995dc0-cd8f-49a7-ac1e-416ca3ed90f2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e" status: 200 len: 1266 microversion: 2.1 time: 0.077175 Sep 07 13:54:24.398033 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3767/7506] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:54:24 2022] GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:54:25.412940 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-053a90ed-f2f5-4f6a-8944-50c6a621a1c5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:54:25.413785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-053a90ed-f2f5-4f6a-8944-50c6a621a1c5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:54:25.422232 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-053a90ed-f2f5-4f6a-8944-50c6a621a1c5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:25.422769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-053a90ed-f2f5-4f6a-8944-50c6a621a1c5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:25.423241 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-053a90ed-f2f5-4f6a-8944-50c6a621a1c5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:25.426209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-053a90ed-f2f5-4f6a-8944-50c6a621a1c5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:25.426209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-053a90ed-f2f5-4f6a-8944-50c6a621a1c5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:25.426475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-053a90ed-f2f5-4f6a-8944-50c6a621a1c5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:25.505292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-053a90ed-f2f5-4f6a-8944-50c6a621a1c5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:54:25.515553 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-053a90ed-f2f5-4f6a-8944-50c6a621a1c5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e" status: 200 len: 1318 microversion: 2.1 time: 0.108314 Sep 07 13:54:25.516892 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3740/7507] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:54:25 2022] GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e => generated 1318 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:54:26.540629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a4e85e52-40d0-4204-9143-2eda1ce43573 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:54:26.541357 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a4e85e52-40d0-4204-9143-2eda1ce43573 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:54:26.549723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4e85e52-40d0-4204-9143-2eda1ce43573 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:26.550339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4e85e52-40d0-4204-9143-2eda1ce43573 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:26.550901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4e85e52-40d0-4204-9143-2eda1ce43573 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:26.551727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4e85e52-40d0-4204-9143-2eda1ce43573 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:26.552454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4e85e52-40d0-4204-9143-2eda1ce43573 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:26.553461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a4e85e52-40d0-4204-9143-2eda1ce43573 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:26.788834 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a4e85e52-40d0-4204-9143-2eda1ce43573 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:54:26.797989 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a4e85e52-40d0-4204-9143-2eda1ce43573 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e" status: 200 len: 1391 microversion: 2.1 time: 0.261408 Sep 07 13:54:26.798581 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3768/7508] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:54:26 2022] GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e => generated 1391 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:54:27.209924 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-85ebd713-bae2-45b9-b364-194d44134cef req-ef0ddb10-3d65-4864-a828-e65c3431dd1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "119d54bc-e4e1-4f4c-baf8-4513abb6165e", "tag": "66744c64-a376-418b-aa38-59f73425a93f"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:54:27.221406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-85ebd713-bae2-45b9-b364-194d44134cef req-ef0ddb10-3d65-4864-a828-e65c3431dd1f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:27.222414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-85ebd713-bae2-45b9-b364-194d44134cef req-ef0ddb10-3d65-4864-a828-e65c3431dd1f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:27.222414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-85ebd713-bae2-45b9-b364-194d44134cef req-ef0ddb10-3d65-4864-a828-e65c3431dd1f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:27.235026 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-85ebd713-bae2-45b9-b364-194d44134cef req-ef0ddb10-3d65-4864-a828-e65c3431dd1f service nova] Creating event network-changed:66744c64-a376-418b-aa38-59f73425a93f for instance 119d54bc-e4e1-4f4c-baf8-4513abb6165e on n-h2-852087-9 Sep 07 13:54:27.240841 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-85ebd713-bae2-45b9-b364-194d44134cef req-ef0ddb10-3d65-4864-a828-e65c3431dd1f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035010 Sep 07 13:54:27.241601 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3741/7509] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:54:27.825989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b67d007b-d266-4a53-8145-dfae99d107f5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:54:27.826654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b67d007b-d266-4a53-8145-dfae99d107f5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:54:27.834733 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b67d007b-d266-4a53-8145-dfae99d107f5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:27.835441 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b67d007b-d266-4a53-8145-dfae99d107f5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:27.836060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b67d007b-d266-4a53-8145-dfae99d107f5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:27.837054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b67d007b-d266-4a53-8145-dfae99d107f5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:27.837672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b67d007b-d266-4a53-8145-dfae99d107f5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:27.838223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b67d007b-d266-4a53-8145-dfae99d107f5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:28.050078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b67d007b-d266-4a53-8145-dfae99d107f5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:54:28.058614 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b67d007b-d266-4a53-8145-dfae99d107f5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e" status: 200 len: 1391 microversion: 2.1 time: 0.236671 Sep 07 13:54:28.059174 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3769/7510] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:54:27 2022] GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e => generated 1391 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:54:29.082977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3379c767-59af-4c54-89b4-e604c6fe6e2b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:54:29.083580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3379c767-59af-4c54-89b4-e604c6fe6e2b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:54:29.086738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:54:29.092697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3379c767-59af-4c54-89b4-e604c6fe6e2b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:29.093197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3379c767-59af-4c54-89b4-e604c6fe6e2b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:29.093675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3379c767-59af-4c54-89b4-e604c6fe6e2b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:29.094408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3379c767-59af-4c54-89b4-e604c6fe6e2b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:29.094896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3379c767-59af-4c54-89b4-e604c6fe6e2b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:29.095648 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3379c767-59af-4c54-89b4-e604c6fe6e2b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:29.319011 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3379c767-59af-4c54-89b4-e604c6fe6e2b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:54:29.327477 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3379c767-59af-4c54-89b4-e604c6fe6e2b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e" status: 200 len: 1391 microversion: 2.1 time: 0.248891 Sep 07 13:54:29.328087 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3742/7511] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:54:29 2022] GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e => generated 1391 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:54:30.351337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-770eb97e-4411-4b69-b6e5-61ee9d6898a0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:54:30.351958 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-770eb97e-4411-4b69-b6e5-61ee9d6898a0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:54:30.359514 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-770eb97e-4411-4b69-b6e5-61ee9d6898a0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:30.360028 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-770eb97e-4411-4b69-b6e5-61ee9d6898a0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:30.360486 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-770eb97e-4411-4b69-b6e5-61ee9d6898a0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:30.361199 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-770eb97e-4411-4b69-b6e5-61ee9d6898a0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:30.361725 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-770eb97e-4411-4b69-b6e5-61ee9d6898a0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:30.362157 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-770eb97e-4411-4b69-b6e5-61ee9d6898a0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:30.524181 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-770eb97e-4411-4b69-b6e5-61ee9d6898a0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:54:30.532486 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-770eb97e-4411-4b69-b6e5-61ee9d6898a0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e" status: 200 len: 1391 microversion: 2.1 time: 0.185150 Sep 07 13:54:30.533096 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3770/7512] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:54:30 2022] GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e => generated 1391 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:54:31.557375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-08ff71c0-2349-415d-a225-77d0e6850472 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:54:31.558079 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-08ff71c0-2349-415d-a225-77d0e6850472 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:54:31.565533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08ff71c0-2349-415d-a225-77d0e6850472 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:31.566063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08ff71c0-2349-415d-a225-77d0e6850472 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:31.566507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08ff71c0-2349-415d-a225-77d0e6850472 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:31.567212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08ff71c0-2349-415d-a225-77d0e6850472 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:31.567772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08ff71c0-2349-415d-a225-77d0e6850472 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:31.568329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-08ff71c0-2349-415d-a225-77d0e6850472 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:31.725413 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-08ff71c0-2349-415d-a225-77d0e6850472 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:54:31.733549 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-08ff71c0-2349-415d-a225-77d0e6850472 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e" status: 200 len: 1391 microversion: 2.1 time: 0.181664 Sep 07 13:54:31.734168 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3743/7513] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:54:31 2022] GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e => generated 1391 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:54:32.369295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-2537713d-373c-4f5a-b411-dcfe5e7a8212 req-b09209d2-6127-44df-82bf-7d59e93ee9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "119d54bc-e4e1-4f4c-baf8-4513abb6165e", "name": "network-vif-plugged", "status": "completed", "tag": "66744c64-a376-418b-aa38-59f73425a93f"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:54:32.381296 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2537713d-373c-4f5a-b411-dcfe5e7a8212 req-b09209d2-6127-44df-82bf-7d59e93ee9e1 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:32.381853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2537713d-373c-4f5a-b411-dcfe5e7a8212 req-b09209d2-6127-44df-82bf-7d59e93ee9e1 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:32.382356 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-2537713d-373c-4f5a-b411-dcfe5e7a8212 req-b09209d2-6127-44df-82bf-7d59e93ee9e1 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:32.397162 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-2537713d-373c-4f5a-b411-dcfe5e7a8212 req-b09209d2-6127-44df-82bf-7d59e93ee9e1 service nova] Creating event network-vif-plugged:66744c64-a376-418b-aa38-59f73425a93f for instance 119d54bc-e4e1-4f4c-baf8-4513abb6165e on n-h2-852087-9 Sep 07 13:54:32.402928 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-2537713d-373c-4f5a-b411-dcfe5e7a8212 req-b09209d2-6127-44df-82bf-7d59e93ee9e1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037347 Sep 07 13:54:32.403589 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3771/7514] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:54:32.759284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0ac669fe-6a7b-40bb-9d74-ec03f8334326 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:54:32.759888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0ac669fe-6a7b-40bb-9d74-ec03f8334326 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:54:32.769232 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ac669fe-6a7b-40bb-9d74-ec03f8334326 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:32.769750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ac669fe-6a7b-40bb-9d74-ec03f8334326 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:32.770213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ac669fe-6a7b-40bb-9d74-ec03f8334326 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:32.770918 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ac669fe-6a7b-40bb-9d74-ec03f8334326 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:32.771379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ac669fe-6a7b-40bb-9d74-ec03f8334326 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:32.771918 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0ac669fe-6a7b-40bb-9d74-ec03f8334326 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:32.933128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0ac669fe-6a7b-40bb-9d74-ec03f8334326 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:54:32.942776 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0ac669fe-6a7b-40bb-9d74-ec03f8334326 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e" status: 200 len: 1391 microversion: 2.1 time: 0.189615 Sep 07 13:54:32.943455 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3744/7515] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:54:32 2022] GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e => generated 1391 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:54:33.967638 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-35d19cf1-0acb-4aab-9dd3-13dbf9791e08 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:54:33.968513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-35d19cf1-0acb-4aab-9dd3-13dbf9791e08 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:54:33.975741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35d19cf1-0acb-4aab-9dd3-13dbf9791e08 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:33.976251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35d19cf1-0acb-4aab-9dd3-13dbf9791e08 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:33.976708 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35d19cf1-0acb-4aab-9dd3-13dbf9791e08 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:33.977405 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35d19cf1-0acb-4aab-9dd3-13dbf9791e08 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:33.977909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35d19cf1-0acb-4aab-9dd3-13dbf9791e08 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:33.978379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-35d19cf1-0acb-4aab-9dd3-13dbf9791e08 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:34.377117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-35d19cf1-0acb-4aab-9dd3-13dbf9791e08 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:54:34.386244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:54:34.390045 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-35d19cf1-0acb-4aab-9dd3-13dbf9791e08 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e" status: 200 len: 1563 microversion: 2.1 time: 0.428427 Sep 07 13:54:34.390626 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3772/7516] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:54:33 2022] GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e => generated 1563 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:54:34.415975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-0b78dcf3-7c42-4e23-8983-043c22d419ec tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:54:34.416706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-0b78dcf3-7c42-4e23-8983-043c22d419ec tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:54:34.420718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:54:34.421360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:54:34.427698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b78dcf3-7c42-4e23-8983-043c22d419ec tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:34.428193 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b78dcf3-7c42-4e23-8983-043c22d419ec tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:34.428643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b78dcf3-7c42-4e23-8983-043c22d419ec tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:34.429347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b78dcf3-7c42-4e23-8983-043c22d419ec tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:34.429841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b78dcf3-7c42-4e23-8983-043c22d419ec tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:34.430280 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-0b78dcf3-7c42-4e23-8983-043c22d419ec tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:34.593165 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-0b78dcf3-7c42-4e23-8983-043c22d419ec tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:54:34.602608 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-0b78dcf3-7c42-4e23-8983-043c22d419ec tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e" status: 200 len: 1563 microversion: 2.1 time: 0.192199 Sep 07 13:54:34.603271 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3745/7517] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:54:34 2022] GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e => generated 1563 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:54:36.330317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-04a2c9a3-ca6b-4447-beaa-b276cef92079 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:54:36.336462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-45c1e22b-4f53-4e20-a83b-998fdfc816f4 req-16c497c0-4b25-4921-8966-a2bcc24638c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "119d54bc-e4e1-4f4c-baf8-4513abb6165e", "tag": "66744c64-a376-418b-aa38-59f73425a93f"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:54:36.340881 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-04a2c9a3-ca6b-4447-beaa-b276cef92079 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:54:36.346240 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:54:36.348915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-45c1e22b-4f53-4e20-a83b-998fdfc816f4 req-16c497c0-4b25-4921-8966-a2bcc24638c8 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:36.349732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-45c1e22b-4f53-4e20-a83b-998fdfc816f4 req-16c497c0-4b25-4921-8966-a2bcc24638c8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:36.350242 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-45c1e22b-4f53-4e20-a83b-998fdfc816f4 req-16c497c0-4b25-4921-8966-a2bcc24638c8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:36.350713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04a2c9a3-ca6b-4447-beaa-b276cef92079 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:36.351244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04a2c9a3-ca6b-4447-beaa-b276cef92079 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:36.351711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04a2c9a3-ca6b-4447-beaa-b276cef92079 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:36.352445 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04a2c9a3-ca6b-4447-beaa-b276cef92079 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:36.353063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04a2c9a3-ca6b-4447-beaa-b276cef92079 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:36.353430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-04a2c9a3-ca6b-4447-beaa-b276cef92079 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:36.365903 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-45c1e22b-4f53-4e20-a83b-998fdfc816f4 req-16c497c0-4b25-4921-8966-a2bcc24638c8 service nova] Creating event network-changed:66744c64-a376-418b-aa38-59f73425a93f for instance 119d54bc-e4e1-4f4c-baf8-4513abb6165e on n-h2-852087-9 Sep 07 13:54:36.375283 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-45c1e22b-4f53-4e20-a83b-998fdfc816f4 req-16c497c0-4b25-4921-8966-a2bcc24638c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042438 Sep 07 13:54:36.376695 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3746/7518] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:54:36.579096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-04a2c9a3-ca6b-4447-beaa-b276cef92079 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:54:36.590221 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-04a2c9a3-ca6b-4447-beaa-b276cef92079 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e" status: 200 len: 1563 microversion: 2.1 time: 0.263632 Sep 07 13:54:36.590827 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3773/7519] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:54:36 2022] GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e => generated 1563 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:54:59.851497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=9 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:54:59.852315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=36 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:54:59.856799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-751e4cf2-5a2f-41a0-9181-be4bc83152f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:54:59.859264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-751e4cf2-5a2f-41a0-9181-be4bc83152f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:54:59.866702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-751e4cf2-5a2f-41a0-9181-be4bc83152f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:59.867204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-751e4cf2-5a2f-41a0-9181-be4bc83152f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:59.867650 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-751e4cf2-5a2f-41a0-9181-be4bc83152f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:59.868353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-751e4cf2-5a2f-41a0-9181-be4bc83152f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:54:59.868817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-751e4cf2-5a2f-41a0-9181-be4bc83152f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:54:59.869253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-751e4cf2-5a2f-41a0-9181-be4bc83152f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:54:59.943273 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-751e4cf2-5a2f-41a0-9181-be4bc83152f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e/action" status: 200 len: 24568 microversion: 2.1 time: 0.093465 Sep 07 13:54:59.944015 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3747/7520] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:54:59 2022] POST /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e/action => generated 24568 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:55:06.357299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1e6ae9db-5a9b-4cad-a1aa-6b13d9dbf92c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:55:06.359705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1e6ae9db-5a9b-4cad-a1aa-6b13d9dbf92c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:55:06.362275 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:55:06.362945 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=32 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:55:06.369394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e6ae9db-5a9b-4cad-a1aa-6b13d9dbf92c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:06.369925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e6ae9db-5a9b-4cad-a1aa-6b13d9dbf92c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:06.370404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e6ae9db-5a9b-4cad-a1aa-6b13d9dbf92c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:06.371134 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e6ae9db-5a9b-4cad-a1aa-6b13d9dbf92c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:06.371623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e6ae9db-5a9b-4cad-a1aa-6b13d9dbf92c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:06.372071 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e6ae9db-5a9b-4cad-a1aa-6b13d9dbf92c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:06.455316 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1e6ae9db-5a9b-4cad-a1aa-6b13d9dbf92c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e/action" status: 202 len: 0 microversion: 2.1 time: 0.103751 Sep 07 13:55:06.456054 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3774/7521] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:55:06 2022] POST /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:55:06.468331 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-82e06732-2309-4995-a1c1-e1a46f788a24 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:55:06.469446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-82e06732-2309-4995-a1c1-e1a46f788a24 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:55:06.478967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82e06732-2309-4995-a1c1-e1a46f788a24 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:06.479525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82e06732-2309-4995-a1c1-e1a46f788a24 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:06.480019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82e06732-2309-4995-a1c1-e1a46f788a24 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:06.480729 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82e06732-2309-4995-a1c1-e1a46f788a24 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:06.481184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82e06732-2309-4995-a1c1-e1a46f788a24 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:06.481645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82e06732-2309-4995-a1c1-e1a46f788a24 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:06.713894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-82e06732-2309-4995-a1c1-e1a46f788a24 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:55:06.722980 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-82e06732-2309-4995-a1c1-e1a46f788a24 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e" status: 200 len: 1674 microversion: 2.1 time: 0.260119 Sep 07 13:55:06.723543 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3748/7522] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:55:06 2022] GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e => generated 1674 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:55:07.749776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-746da540-2a13-4dcd-b0de-b3b3e4be5bd5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:55:07.750598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-746da540-2a13-4dcd-b0de-b3b3e4be5bd5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:55:07.758463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-746da540-2a13-4dcd-b0de-b3b3e4be5bd5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:07.758972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-746da540-2a13-4dcd-b0de-b3b3e4be5bd5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:07.759601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-746da540-2a13-4dcd-b0de-b3b3e4be5bd5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:07.760324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-746da540-2a13-4dcd-b0de-b3b3e4be5bd5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:07.760799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-746da540-2a13-4dcd-b0de-b3b3e4be5bd5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:07.761215 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-746da540-2a13-4dcd-b0de-b3b3e4be5bd5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:07.922202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-746da540-2a13-4dcd-b0de-b3b3e4be5bd5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:55:07.930511 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-746da540-2a13-4dcd-b0de-b3b3e4be5bd5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e" status: 200 len: 1679 microversion: 2.1 time: 0.186636 Sep 07 13:55:07.931090 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3775/7523] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:55:07 2022] GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e => generated 1679 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:55:08.955839 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6d7884a3-6c6d-49ca-9e6e-f76840020ae9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:55:08.956469 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6d7884a3-6c6d-49ca-9e6e-f76840020ae9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:55:08.963969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d7884a3-6c6d-49ca-9e6e-f76840020ae9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:08.964472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d7884a3-6c6d-49ca-9e6e-f76840020ae9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:08.964913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d7884a3-6c6d-49ca-9e6e-f76840020ae9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:08.965662 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d7884a3-6c6d-49ca-9e6e-f76840020ae9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:08.966129 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d7884a3-6c6d-49ca-9e6e-f76840020ae9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:08.966554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d7884a3-6c6d-49ca-9e6e-f76840020ae9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:09.109908 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6d7884a3-6c6d-49ca-9e6e-f76840020ae9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:55:09.118863 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6d7884a3-6c6d-49ca-9e6e-f76840020ae9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e" status: 200 len: 1679 microversion: 2.1 time: 0.167086 Sep 07 13:55:09.119477 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3749/7524] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:55:08 2022] GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:55:10.145107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-56bf297b-59ae-4a88-b6bf-cdddf331b7d2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:55:10.145741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-56bf297b-59ae-4a88-b6bf-cdddf331b7d2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:55:10.152883 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56bf297b-59ae-4a88-b6bf-cdddf331b7d2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:10.153324 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56bf297b-59ae-4a88-b6bf-cdddf331b7d2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:10.153809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56bf297b-59ae-4a88-b6bf-cdddf331b7d2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:10.154528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56bf297b-59ae-4a88-b6bf-cdddf331b7d2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:10.154996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56bf297b-59ae-4a88-b6bf-cdddf331b7d2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:10.155434 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-56bf297b-59ae-4a88-b6bf-cdddf331b7d2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:10.306107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-56bf297b-59ae-4a88-b6bf-cdddf331b7d2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:55:10.314086 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-56bf297b-59ae-4a88-b6bf-cdddf331b7d2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e" status: 200 len: 1679 microversion: 2.1 time: 0.173785 Sep 07 13:55:10.314659 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3776/7525] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:55:10 2022] GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:55:11.338495 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-06e93c2c-f51a-4b23-b0fc-a5d38ee1f8f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:55:11.339234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-06e93c2c-f51a-4b23-b0fc-a5d38ee1f8f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:55:11.347380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06e93c2c-f51a-4b23-b0fc-a5d38ee1f8f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:11.347863 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06e93c2c-f51a-4b23-b0fc-a5d38ee1f8f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:11.348585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06e93c2c-f51a-4b23-b0fc-a5d38ee1f8f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:11.350014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06e93c2c-f51a-4b23-b0fc-a5d38ee1f8f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:11.350828 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06e93c2c-f51a-4b23-b0fc-a5d38ee1f8f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:11.351305 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-06e93c2c-f51a-4b23-b0fc-a5d38ee1f8f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:11.506913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-06e93c2c-f51a-4b23-b0fc-a5d38ee1f8f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:55:11.515975 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-06e93c2c-f51a-4b23-b0fc-a5d38ee1f8f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e" status: 200 len: 1679 microversion: 2.1 time: 0.181401 Sep 07 13:55:11.516592 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3750/7526] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:55:11 2022] GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:55:12.545138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1af80932-3648-4b0b-ac8d-4c18ac13a0a8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:55:12.546039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1af80932-3648-4b0b-ac8d-4c18ac13a0a8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:55:12.554165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1af80932-3648-4b0b-ac8d-4c18ac13a0a8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:12.554678 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1af80932-3648-4b0b-ac8d-4c18ac13a0a8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:12.555128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1af80932-3648-4b0b-ac8d-4c18ac13a0a8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:12.555840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1af80932-3648-4b0b-ac8d-4c18ac13a0a8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:12.556314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1af80932-3648-4b0b-ac8d-4c18ac13a0a8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:12.556758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1af80932-3648-4b0b-ac8d-4c18ac13a0a8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:12.704487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1af80932-3648-4b0b-ac8d-4c18ac13a0a8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:55:12.713752 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1af80932-3648-4b0b-ac8d-4c18ac13a0a8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e" status: 200 len: 1679 microversion: 2.1 time: 0.174426 Sep 07 13:55:12.714347 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3777/7527] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:55:12 2022] GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:55:13.738982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e68e77eb-07ef-498c-965d-dcb2fd53be71 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:55:13.739668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e68e77eb-07ef-498c-965d-dcb2fd53be71 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:55:13.747574 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e68e77eb-07ef-498c-965d-dcb2fd53be71 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:13.748081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e68e77eb-07ef-498c-965d-dcb2fd53be71 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:13.748525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e68e77eb-07ef-498c-965d-dcb2fd53be71 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:13.749260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e68e77eb-07ef-498c-965d-dcb2fd53be71 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:13.749760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e68e77eb-07ef-498c-965d-dcb2fd53be71 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:13.750198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e68e77eb-07ef-498c-965d-dcb2fd53be71 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:13.908829 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e68e77eb-07ef-498c-965d-dcb2fd53be71 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:55:13.920726 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e68e77eb-07ef-498c-965d-dcb2fd53be71 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e" status: 200 len: 1679 microversion: 2.1 time: 0.185502 Sep 07 13:55:13.921461 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3751/7528] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:55:13 2022] GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e => generated 1679 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:55:14.946218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-af3634dd-f303-449b-9dc1-bf2081d15b0c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:55:14.946853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-af3634dd-f303-449b-9dc1-bf2081d15b0c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:55:14.954854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af3634dd-f303-449b-9dc1-bf2081d15b0c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:14.955381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af3634dd-f303-449b-9dc1-bf2081d15b0c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:14.955832 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af3634dd-f303-449b-9dc1-bf2081d15b0c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:14.956575 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af3634dd-f303-449b-9dc1-bf2081d15b0c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:14.957058 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af3634dd-f303-449b-9dc1-bf2081d15b0c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:14.957529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-af3634dd-f303-449b-9dc1-bf2081d15b0c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:15.107257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-af3634dd-f303-449b-9dc1-bf2081d15b0c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:55:15.116371 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-af3634dd-f303-449b-9dc1-bf2081d15b0c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e" status: 200 len: 1679 microversion: 2.1 time: 0.174647 Sep 07 13:55:15.116994 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3778/7529] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:55:14 2022] GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:55:16.141503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5044eb83-4382-4f3c-9cf3-0127996d7938 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:55:16.142195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5044eb83-4382-4f3c-9cf3-0127996d7938 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:55:16.148616 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5044eb83-4382-4f3c-9cf3-0127996d7938 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:16.149107 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5044eb83-4382-4f3c-9cf3-0127996d7938 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:16.149580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5044eb83-4382-4f3c-9cf3-0127996d7938 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:16.150303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5044eb83-4382-4f3c-9cf3-0127996d7938 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:16.150754 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5044eb83-4382-4f3c-9cf3-0127996d7938 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:16.151187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5044eb83-4382-4f3c-9cf3-0127996d7938 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:16.300797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5044eb83-4382-4f3c-9cf3-0127996d7938 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:55:16.310153 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5044eb83-4382-4f3c-9cf3-0127996d7938 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e" status: 200 len: 1679 microversion: 2.1 time: 0.173341 Sep 07 13:55:16.310854 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3752/7530] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:55:16 2022] GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:55:17.334700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bd554168-bf61-44da-b935-294078809d59 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:55:17.335347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bd554168-bf61-44da-b935-294078809d59 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:55:17.344303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd554168-bf61-44da-b935-294078809d59 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:17.344979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd554168-bf61-44da-b935-294078809d59 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:17.345926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd554168-bf61-44da-b935-294078809d59 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:17.346961 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd554168-bf61-44da-b935-294078809d59 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:17.347627 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd554168-bf61-44da-b935-294078809d59 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:17.348241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bd554168-bf61-44da-b935-294078809d59 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:17.498409 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bd554168-bf61-44da-b935-294078809d59 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:55:17.507583 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bd554168-bf61-44da-b935-294078809d59 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e" status: 200 len: 1679 microversion: 2.1 time: 0.176950 Sep 07 13:55:17.508400 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3779/7531] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:55:17 2022] GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:55:18.531560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c6a6a7c3-edac-46ed-a289-e0dad4c0c184 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:55:18.532221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c6a6a7c3-edac-46ed-a289-e0dad4c0c184 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:55:18.543985 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6a6a7c3-edac-46ed-a289-e0dad4c0c184 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:18.544485 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6a6a7c3-edac-46ed-a289-e0dad4c0c184 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:18.544921 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6a6a7c3-edac-46ed-a289-e0dad4c0c184 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:18.545678 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6a6a7c3-edac-46ed-a289-e0dad4c0c184 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:18.546143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6a6a7c3-edac-46ed-a289-e0dad4c0c184 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:18.546567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c6a6a7c3-edac-46ed-a289-e0dad4c0c184 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:18.691868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c6a6a7c3-edac-46ed-a289-e0dad4c0c184 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:55:18.700102 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c6a6a7c3-edac-46ed-a289-e0dad4c0c184 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e" status: 200 len: 1682 microversion: 2.1 time: 0.172700 Sep 07 13:55:18.700692 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3753/7532] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:55:18 2022] GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:55:42.951973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-07681b7f-caf5-403f-a0ea-307903943f4e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:55:42.954379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-07681b7f-caf5-403f-a0ea-307903943f4e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:55:42.957077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=12 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:55:42.957818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:55:42.964525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07681b7f-caf5-403f-a0ea-307903943f4e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:42.965076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07681b7f-caf5-403f-a0ea-307903943f4e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:42.965547 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07681b7f-caf5-403f-a0ea-307903943f4e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:42.966301 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07681b7f-caf5-403f-a0ea-307903943f4e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:42.966867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07681b7f-caf5-403f-a0ea-307903943f4e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:42.967345 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-07681b7f-caf5-403f-a0ea-307903943f4e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:43.056519 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-07681b7f-caf5-403f-a0ea-307903943f4e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e/action" status: 200 len: 68900 microversion: 2.1 time: 0.107838 Sep 07 13:55:43.057372 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3780/7533] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:55:42 2022] POST /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e/action => generated 68900 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:55:50.309722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fa242dfd-7178-4cfa-9715-b3f9dad27601 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:55:50.310354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fa242dfd-7178-4cfa-9715-b3f9dad27601 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:55:50.311411 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c9712864-70bc-4732-8c57-49ca5d986648 req-63fcf7bc-788b-4864-b96c-bb5298506eaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "119d54bc-e4e1-4f4c-baf8-4513abb6165e", "tag": "66744c64-a376-418b-aa38-59f73425a93f"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:55:50.313999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=14 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:55:50.314836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=40 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:55:50.320601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa242dfd-7178-4cfa-9715-b3f9dad27601 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:50.321088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa242dfd-7178-4cfa-9715-b3f9dad27601 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:50.321831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa242dfd-7178-4cfa-9715-b3f9dad27601 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:50.322554 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa242dfd-7178-4cfa-9715-b3f9dad27601 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:50.323233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa242dfd-7178-4cfa-9715-b3f9dad27601 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:50.323666 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa242dfd-7178-4cfa-9715-b3f9dad27601 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:50.325074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c9712864-70bc-4732-8c57-49ca5d986648 req-63fcf7bc-788b-4864-b96c-bb5298506eaa service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:50.325616 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c9712864-70bc-4732-8c57-49ca5d986648 req-63fcf7bc-788b-4864-b96c-bb5298506eaa service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:50.326077 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c9712864-70bc-4732-8c57-49ca5d986648 req-63fcf7bc-788b-4864-b96c-bb5298506eaa service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:50.339014 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c9712864-70bc-4732-8c57-49ca5d986648 req-63fcf7bc-788b-4864-b96c-bb5298506eaa service nova] Creating event network-changed:66744c64-a376-418b-aa38-59f73425a93f for instance 119d54bc-e4e1-4f4c-baf8-4513abb6165e on n-h2-852087-9 Sep 07 13:55:50.345735 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c9712864-70bc-4732-8c57-49ca5d986648 req-63fcf7bc-788b-4864-b96c-bb5298506eaa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038126 Sep 07 13:55:50.346728 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3781/7534] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:55:50.352928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fa242dfd-7178-4cfa-9715-b3f9dad27601 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:55:50.453308 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fa242dfd-7178-4cfa-9715-b3f9dad27601 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "DELETE /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e" status: 204 len: 0 microversion: 2.1 time: 0.147422 Sep 07 13:55:50.457594 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3754/7535] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:55:50 2022] DELETE /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:55:50.467480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d6645115-97aa-4eed-8acd-5af7d88b7c64 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:55:50.468419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d6645115-97aa-4eed-8acd-5af7d88b7c64 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:55:50.476520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6645115-97aa-4eed-8acd-5af7d88b7c64 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:50.477039 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6645115-97aa-4eed-8acd-5af7d88b7c64 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:50.477529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6645115-97aa-4eed-8acd-5af7d88b7c64 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:50.478263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6645115-97aa-4eed-8acd-5af7d88b7c64 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:50.478919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6645115-97aa-4eed-8acd-5af7d88b7c64 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:50.479372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d6645115-97aa-4eed-8acd-5af7d88b7c64 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:50.632598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d6645115-97aa-4eed-8acd-5af7d88b7c64 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:55:50.640820 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d6645115-97aa-4eed-8acd-5af7d88b7c64 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e" status: 200 len: 1688 microversion: 2.1 time: 0.179793 Sep 07 13:55:50.641413 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3782/7536] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:55:50 2022] GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:55:51.666077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df83aace-aa69-4bf3-8506-7cce7628af6b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:55:51.666693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-df83aace-aa69-4bf3-8506-7cce7628af6b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:55:51.674651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df83aace-aa69-4bf3-8506-7cce7628af6b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:51.675126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df83aace-aa69-4bf3-8506-7cce7628af6b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:51.675603 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df83aace-aa69-4bf3-8506-7cce7628af6b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:51.676312 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df83aace-aa69-4bf3-8506-7cce7628af6b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:51.676779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df83aace-aa69-4bf3-8506-7cce7628af6b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:51.677214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df83aace-aa69-4bf3-8506-7cce7628af6b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:51.827740 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-df83aace-aa69-4bf3-8506-7cce7628af6b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:55:51.836138 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-df83aace-aa69-4bf3-8506-7cce7628af6b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e" status: 200 len: 1688 microversion: 2.1 time: 0.174604 Sep 07 13:55:51.836719 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3755/7537] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:55:51 2022] GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:55:52.860256 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3d64648d-e842-4d14-84ea-d8f50840fccf tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:55:52.861003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3d64648d-e842-4d14-84ea-d8f50840fccf tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:55:52.868022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d64648d-e842-4d14-84ea-d8f50840fccf tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:52.868544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d64648d-e842-4d14-84ea-d8f50840fccf tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:52.869003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d64648d-e842-4d14-84ea-d8f50840fccf tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:52.869807 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d64648d-e842-4d14-84ea-d8f50840fccf tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:52.870284 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d64648d-e842-4d14-84ea-d8f50840fccf tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:52.870784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3d64648d-e842-4d14-84ea-d8f50840fccf tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:52.894588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-95fe7637-80fb-4e24-b785-748b0f4f75dd req-caa145c3-3871-4a39-8c7a-62662d0d170e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "119d54bc-e4e1-4f4c-baf8-4513abb6165e", "name": "network-vif-deleted", "tag": "66744c64-a376-418b-aa38-59f73425a93f"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:55:52.908811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-95fe7637-80fb-4e24-b785-748b0f4f75dd req-caa145c3-3871-4a39-8c7a-62662d0d170e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:52.909372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-95fe7637-80fb-4e24-b785-748b0f4f75dd req-caa145c3-3871-4a39-8c7a-62662d0d170e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:52.910033 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-95fe7637-80fb-4e24-b785-748b0f4f75dd req-caa145c3-3871-4a39-8c7a-62662d0d170e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:52.922507 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-95fe7637-80fb-4e24-b785-748b0f4f75dd req-caa145c3-3871-4a39-8c7a-62662d0d170e service nova] Creating event network-vif-deleted:66744c64-a376-418b-aa38-59f73425a93f for instance 119d54bc-e4e1-4f4c-baf8-4513abb6165e on n-h2-852087-9 Sep 07 13:55:52.928714 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-95fe7637-80fb-4e24-b785-748b0f4f75dd req-caa145c3-3871-4a39-8c7a-62662d0d170e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037947 Sep 07 13:55:52.929522 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3756/7538] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:55:52.946577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3d64648d-e842-4d14-84ea-d8f50840fccf tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:55:52.954953 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3d64648d-e842-4d14-84ea-d8f50840fccf tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e" status: 200 len: 1502 microversion: 2.1 time: 0.098629 Sep 07 13:55:52.955543 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3783/7539] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:55:52 2022] GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e => generated 1502 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:55:53.982131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cdb70780-4397-40ac-8f23-8f4c89c8eb91 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:55:53.982838 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-cdb70780-4397-40ac-8f23-8f4c89c8eb91 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 119d54bc-e4e1-4f4c-baf8-4513abb6165e] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:55:53.989913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdb70780-4397-40ac-8f23-8f4c89c8eb91 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:53.990529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdb70780-4397-40ac-8f23-8f4c89c8eb91 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:53.990991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdb70780-4397-40ac-8f23-8f4c89c8eb91 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:53.991696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdb70780-4397-40ac-8f23-8f4c89c8eb91 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:55:53.992238 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdb70780-4397-40ac-8f23-8f4c89c8eb91 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:55:53.992676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-cdb70780-4397-40ac-8f23-8f4c89c8eb91 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:55:54.007443 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-cdb70780-4397-40ac-8f23-8f4c89c8eb91 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] HTTP exception thrown: Instance 119d54bc-e4e1-4f4c-baf8-4513abb6165e could not be found. Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cdb70780-4397-40ac-8f23-8f4c89c8eb91 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Request method failure captured: Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e HTTP/1.1 Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGKJIpRj4dUoVYAzI48MspU8ZelpD30GGZSMNBLAcJjfPqrRwz5SflK5ZGsGmdXzaRhezwINOX9bACqNviUzYHhK5j_TepIiCI-ydksrX2YrwyvVjX0oRIdw2hFrTIsMr6gjr_5dekqg_MtjlByIh9B6o0NyhZw8LTWA2pkGzjxBAu_s Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8f56cfdac7bd4768b54690ce5afe8854 Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-901687866 Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f56cfdac7bd4768b54690ce5afe8854"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f56cfdac7bd4768b54690ce5afe8854"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f56cfdac7bd4768b54690ce5afe8854"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f56cfdac7bd4768b54690ce5afe8854"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TestNetworkAdvancedServerOps-901687866 Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8f56cfdac7bd4768b54690ce5afe8854 Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-901687866 Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TestNetworkAdvancedServerOps-901687866-project Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 9dce2997e6c6461db3bae9e9c3315d8b Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TestNetworkAdvancedServerOps-901687866-project Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 119d54bc-e4e1-4f4c-baf8-4513abb6165e could not be found. Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '119d54bc-e4e1-4f4c-baf8-4513abb6165e'} Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 119d54bc-e4e1-4f4c-baf8-4513abb6165e could not be found. Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 119d54bc-e4e1-4f4c-baf8-4513abb6165e could not be found. Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:55:54.009138 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:55:54.017606 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:55:54.017606 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:55:54.017606 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:55:54.017606 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:55:54.017606 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:55:54.017606 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:55:54.017606 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 119d54bc-e4e1-4f4c-baf8-4513abb6165e could not be found. Sep 07 13:55:54.017606 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:55:54.017606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-cdb70780-4397-40ac-8f23-8f4c89c8eb91 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Returning 404 to user: Instance 119d54bc-e4e1-4f4c-baf8-4513abb6165e could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:55:54.017606 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-cdb70780-4397-40ac-8f23-8f4c89c8eb91 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e" status: 404 len: 111 microversion: 2.1 time: 0.033854 Sep 07 13:55:54.017606 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3757/7540] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:55:53 2022] GET /compute/v2.1/servers/119d54bc-e4e1-4f4c-baf8-4513abb6165e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:55:57.192099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5b8780e4-55be-44f2-9f68-2804f05403b8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '.version_select at 0x7fc418c67430>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:55:57.223111 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5b8780e4-55be-44f2-9f68-2804f05403b8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1522913772" status: 202 len: 0 microversion: 2.1 time: 0.035676 Sep 07 13:55:57.223684 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3784/7541] 10.222.0.16 () {58 vars in 1284 bytes} [Wed Sep 7 13:55:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1522913772 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:55:57.250939 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-176cee7d-8e11-49f7-8dfd-d201181d92cb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'create', calling method: .version_select at 0x7fc4193368b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-524305677", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4FaTxOP4ARlNpVKdWAxjn4WwgNt4ahLdM5x7lcro5QTQuyaADVQmWCTYiYPqkZ7kmeRdD5BWWsGuJ+LiqlUhVwyKVNg5OYp9AbaJpXHYt+IL0qfxbNP75tAgrPL/d6Ww=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:55:57.268503 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-176cee7d-8e11-49f7-8dfd-d201181d92cb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Getting quotas for project 8f56cfdac7bd4768b54690ce5afe8854. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:55:57.274052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-176cee7d-8e11-49f7-8dfd-d201181d92cb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Getting quotas for user 9dce2997e6c6461db3bae9e9c3315d8b and project 8f56cfdac7bd4768b54690ce5afe8854. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:55:57.299871 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-176cee7d-8e11-49f7-8dfd-d201181d92cb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052962 Sep 07 13:55:57.300686 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3758/7542] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 13:55:57 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 13:56:03.364916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=18 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:56:03.371046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2608588e-1044-420c-b35a-b68af7c070b0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1950163304", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "b47dc87d-5b9b-44d7-8d4b-404175d89740"}], "key_name": "tempest-TestNetworkAdvancedServerOps-524305677", "security_groups": [{"name": "tempest-secgroup-smoke-1150058428"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:56:03.492821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-2608588e-1044-420c-b35a-b68af7c070b0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] validate_networks() for [('b47dc87d-5b9b-44d7-8d4b-404175d89740', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:56:04.020853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-2608588e-1044-420c-b35a-b68af7c070b0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:56:04.021302 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-2608588e-1044-420c-b35a-b68af7c070b0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:56:04.021831 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-2608588e-1044-420c-b35a-b68af7c070b0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:56:04.022388 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-2608588e-1044-420c-b35a-b68af7c070b0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:56:04.022955 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-2608588e-1044-420c-b35a-b68af7c070b0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:56:04.035143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2608588e-1044-420c-b35a-b68af7c070b0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:04.035707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2608588e-1044-420c-b35a-b68af7c070b0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:04.036173 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2608588e-1044-420c-b35a-b68af7c070b0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:04.037073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2608588e-1044-420c-b35a-b68af7c070b0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:04.037596 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2608588e-1044-420c-b35a-b68af7c070b0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:04.038132 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2608588e-1044-420c-b35a-b68af7c070b0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:04.066032 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-2608588e-1044-420c-b35a-b68af7c070b0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Getting quotas for project 8f56cfdac7bd4768b54690ce5afe8854. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:56:04.074924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-2608588e-1044-420c-b35a-b68af7c070b0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Getting quotas for user 9dce2997e6c6461db3bae9e9c3315d8b and project 8f56cfdac7bd4768b54690ce5afe8854. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:56:04.093115 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2608588e-1044-420c-b35a-b68af7c070b0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:56:04.097387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2608588e-1044-420c-b35a-b68af7c070b0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:56:04.168060 n-d-852087-9 devstack@n-api.service[122433]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2608588e-1044-420c-b35a-b68af7c070b0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [e88fe80c-dc6b-40c6-9a21-fec9c36ec4df] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 13:56:05.178541 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [None req-2608588e-1044-420c-b35a-b68af7c070b0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [e88fe80c-dc6b-40c6-9a21-fec9c36ec4df] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 40866. Sep 07 13:56:05.184058 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2608588e-1044-420c-b35a-b68af7c070b0 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.821920 Sep 07 13:56:05.184935 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3785/7543] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:56:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:56:05.194804 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:56:05.205186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3d259c41-cb3a-41c8-a162-8ab7a4dd8420 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:56:05.206128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3d259c41-cb3a-41c8-a162-8ab7a4dd8420 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:56:05.268326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3d259c41-cb3a-41c8-a162-8ab7a4dd8420 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:56:05.276866 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3d259c41-cb3a-41c8-a162-8ab7a4dd8420 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1266 microversion: 2.1 time: 0.084283 Sep 07 13:56:05.277466 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3759/7544] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:56:05 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:56:06.301895 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e25b0e88-712e-42e4-96c3-1be9e329b1e7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:56:06.302526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e25b0e88-712e-42e4-96c3-1be9e329b1e7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:56:06.310267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e25b0e88-712e-42e4-96c3-1be9e329b1e7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:06.310632 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e25b0e88-712e-42e4-96c3-1be9e329b1e7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:06.311107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e25b0e88-712e-42e4-96c3-1be9e329b1e7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:06.312004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e25b0e88-712e-42e4-96c3-1be9e329b1e7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:06.312622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e25b0e88-712e-42e4-96c3-1be9e329b1e7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:06.313433 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e25b0e88-712e-42e4-96c3-1be9e329b1e7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:06.390902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e25b0e88-712e-42e4-96c3-1be9e329b1e7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:56:06.407607 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e25b0e88-712e-42e4-96c3-1be9e329b1e7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1326 microversion: 2.1 time: 0.111097 Sep 07 13:56:06.426059 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3786/7545] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:56:06 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1326 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:56:07.435114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5cd3edef-49ad-4ee7-bdde-d2cf010e87eb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:56:07.436389 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5cd3edef-49ad-4ee7-bdde-d2cf010e87eb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:56:07.447053 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cd3edef-49ad-4ee7-bdde-d2cf010e87eb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:07.447697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cd3edef-49ad-4ee7-bdde-d2cf010e87eb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:07.448008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cd3edef-49ad-4ee7-bdde-d2cf010e87eb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:07.449013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cd3edef-49ad-4ee7-bdde-d2cf010e87eb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:07.449495 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cd3edef-49ad-4ee7-bdde-d2cf010e87eb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:07.449950 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5cd3edef-49ad-4ee7-bdde-d2cf010e87eb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:07.586140 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5cd3edef-49ad-4ee7-bdde-d2cf010e87eb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:56:07.594274 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5cd3edef-49ad-4ee7-bdde-d2cf010e87eb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1392 microversion: 2.1 time: 0.163170 Sep 07 13:56:07.594855 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3760/7546] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:56:07 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:56:08.048316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c9d46cda-9034-4182-8a4d-abbe46b1e4e8 req-8738794d-b6e2-4fda-b87b-ed3d5263441e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a77b35e7-b81b-4e35-b383-ceada0c89cab", "tag": "4393c786-ab54-4697-8577-63570508c2d1"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:56:08.058023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c9d46cda-9034-4182-8a4d-abbe46b1e4e8 req-8738794d-b6e2-4fda-b87b-ed3d5263441e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:08.058524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c9d46cda-9034-4182-8a4d-abbe46b1e4e8 req-8738794d-b6e2-4fda-b87b-ed3d5263441e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:08.058985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c9d46cda-9034-4182-8a4d-abbe46b1e4e8 req-8738794d-b6e2-4fda-b87b-ed3d5263441e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:08.070258 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c9d46cda-9034-4182-8a4d-abbe46b1e4e8 req-8738794d-b6e2-4fda-b87b-ed3d5263441e service nova] Creating event network-changed:4393c786-ab54-4697-8577-63570508c2d1 for instance a77b35e7-b81b-4e35-b383-ceada0c89cab on n-h1-852087-9 Sep 07 13:56:08.075365 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c9d46cda-9034-4182-8a4d-abbe46b1e4e8 req-8738794d-b6e2-4fda-b87b-ed3d5263441e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099353 Sep 07 13:56:08.076437 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3787/7547] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:56:08.620200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e618726b-e252-4580-9fc7-60f1603ab179 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:56:08.621078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e618726b-e252-4580-9fc7-60f1603ab179 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:56:08.631757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e618726b-e252-4580-9fc7-60f1603ab179 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:08.632519 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e618726b-e252-4580-9fc7-60f1603ab179 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:08.633240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e618726b-e252-4580-9fc7-60f1603ab179 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:08.634444 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e618726b-e252-4580-9fc7-60f1603ab179 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:08.635112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e618726b-e252-4580-9fc7-60f1603ab179 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:08.635798 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e618726b-e252-4580-9fc7-60f1603ab179 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:08.784707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e618726b-e252-4580-9fc7-60f1603ab179 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:56:08.793154 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e618726b-e252-4580-9fc7-60f1603ab179 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1392 microversion: 2.1 time: 0.178842 Sep 07 13:56:08.793793 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3761/7548] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:56:08 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:56:09.818951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ef213a76-8f89-4517-989f-b74cafab541f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:56:09.819680 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ef213a76-8f89-4517-989f-b74cafab541f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:56:09.826316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef213a76-8f89-4517-989f-b74cafab541f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:09.826831 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef213a76-8f89-4517-989f-b74cafab541f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:09.827297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef213a76-8f89-4517-989f-b74cafab541f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:09.828016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef213a76-8f89-4517-989f-b74cafab541f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:09.828498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef213a76-8f89-4517-989f-b74cafab541f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:09.828948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef213a76-8f89-4517-989f-b74cafab541f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:09.974462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ef213a76-8f89-4517-989f-b74cafab541f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:56:09.986660 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ef213a76-8f89-4517-989f-b74cafab541f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1392 microversion: 2.1 time: 0.173130 Sep 07 13:56:09.987383 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3788/7549] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:56:09 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:56:11.015236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-82ddd5ce-6ac7-4b84-a869-122ee4eb9a4b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:56:11.015830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-82ddd5ce-6ac7-4b84-a869-122ee4eb9a4b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:56:11.023510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82ddd5ce-6ac7-4b84-a869-122ee4eb9a4b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:11.023938 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82ddd5ce-6ac7-4b84-a869-122ee4eb9a4b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:11.024405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82ddd5ce-6ac7-4b84-a869-122ee4eb9a4b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:11.025107 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82ddd5ce-6ac7-4b84-a869-122ee4eb9a4b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:11.025601 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82ddd5ce-6ac7-4b84-a869-122ee4eb9a4b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:11.026031 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82ddd5ce-6ac7-4b84-a869-122ee4eb9a4b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:11.177374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-82ddd5ce-6ac7-4b84-a869-122ee4eb9a4b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:56:11.189177 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-82ddd5ce-6ac7-4b84-a869-122ee4eb9a4b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1392 microversion: 2.1 time: 0.177634 Sep 07 13:56:11.189929 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3762/7550] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:56:11 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:56:12.213118 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b73828bb-7172-4146-bfc8-1a943929c12e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:56:12.213991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b73828bb-7172-4146-bfc8-1a943929c12e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:56:12.224769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b73828bb-7172-4146-bfc8-1a943929c12e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:12.225532 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b73828bb-7172-4146-bfc8-1a943929c12e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:12.226403 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b73828bb-7172-4146-bfc8-1a943929c12e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:12.227609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b73828bb-7172-4146-bfc8-1a943929c12e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:12.228398 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b73828bb-7172-4146-bfc8-1a943929c12e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:12.229074 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b73828bb-7172-4146-bfc8-1a943929c12e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:12.377908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b73828bb-7172-4146-bfc8-1a943929c12e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:56:12.385782 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b73828bb-7172-4146-bfc8-1a943929c12e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1392 microversion: 2.1 time: 0.177020 Sep 07 13:56:12.386343 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3789/7551] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:56:12 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:56:13.409147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8590957d-9349-42bb-8dd6-73010c0ad8a5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:56:13.409827 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8590957d-9349-42bb-8dd6-73010c0ad8a5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:56:13.418546 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8590957d-9349-42bb-8dd6-73010c0ad8a5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:13.419049 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8590957d-9349-42bb-8dd6-73010c0ad8a5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:13.419492 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8590957d-9349-42bb-8dd6-73010c0ad8a5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:13.420231 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8590957d-9349-42bb-8dd6-73010c0ad8a5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:13.420710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8590957d-9349-42bb-8dd6-73010c0ad8a5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:13.421177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8590957d-9349-42bb-8dd6-73010c0ad8a5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:13.581527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8590957d-9349-42bb-8dd6-73010c0ad8a5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:56:13.589443 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8590957d-9349-42bb-8dd6-73010c0ad8a5 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1392 microversion: 2.1 time: 0.184487 Sep 07 13:56:13.590132 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3763/7552] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:56:13 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:56:14.615654 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1b6b164e-3419-42da-b161-18b00dcc6d91 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:56:14.616260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1b6b164e-3419-42da-b161-18b00dcc6d91 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:56:14.620459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:56:14.621152 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:56:14.621928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:56:14.632438 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b6b164e-3419-42da-b161-18b00dcc6d91 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:14.632947 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b6b164e-3419-42da-b161-18b00dcc6d91 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:14.633420 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b6b164e-3419-42da-b161-18b00dcc6d91 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:14.634177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b6b164e-3419-42da-b161-18b00dcc6d91 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:14.634673 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b6b164e-3419-42da-b161-18b00dcc6d91 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:14.635120 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1b6b164e-3419-42da-b161-18b00dcc6d91 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:14.785035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1b6b164e-3419-42da-b161-18b00dcc6d91 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:56:14.796919 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1b6b164e-3419-42da-b161-18b00dcc6d91 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1392 microversion: 2.1 time: 0.187563 Sep 07 13:56:14.797697 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3790/7553] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:56:14 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1392 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:56:15.605386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d6d74dec-c46a-4187-a85d-285dae1ed04e req-f29a3fcf-ddb9-4360-bf58-f0cf725f5f9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a77b35e7-b81b-4e35-b383-ceada0c89cab", "name": "network-vif-plugged", "status": "completed", "tag": "4393c786-ab54-4697-8577-63570508c2d1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:56:15.611886 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:56:15.619517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d6d74dec-c46a-4187-a85d-285dae1ed04e req-f29a3fcf-ddb9-4360-bf58-f0cf725f5f9d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:15.619998 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d6d74dec-c46a-4187-a85d-285dae1ed04e req-f29a3fcf-ddb9-4360-bf58-f0cf725f5f9d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:15.620446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d6d74dec-c46a-4187-a85d-285dae1ed04e req-f29a3fcf-ddb9-4360-bf58-f0cf725f5f9d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:15.633089 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d6d74dec-c46a-4187-a85d-285dae1ed04e req-f29a3fcf-ddb9-4360-bf58-f0cf725f5f9d service nova] Creating event network-vif-plugged:4393c786-ab54-4697-8577-63570508c2d1 for instance a77b35e7-b81b-4e35-b383-ceada0c89cab on n-h1-852087-9 Sep 07 13:56:15.638751 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d6d74dec-c46a-4187-a85d-285dae1ed04e req-f29a3fcf-ddb9-4360-bf58-f0cf725f5f9d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037681 Sep 07 13:56:15.639379 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3764/7554] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:56:15.826843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bff7f266-482e-4149-978e-9cd21d52828a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:56:15.827580 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bff7f266-482e-4149-978e-9cd21d52828a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:56:15.834982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bff7f266-482e-4149-978e-9cd21d52828a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:15.835490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bff7f266-482e-4149-978e-9cd21d52828a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:15.835943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bff7f266-482e-4149-978e-9cd21d52828a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:15.836659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bff7f266-482e-4149-978e-9cd21d52828a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:15.837127 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bff7f266-482e-4149-978e-9cd21d52828a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:15.837606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bff7f266-482e-4149-978e-9cd21d52828a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:15.995361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bff7f266-482e-4149-978e-9cd21d52828a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:56:16.007202 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bff7f266-482e-4149-978e-9cd21d52828a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1392 microversion: 2.1 time: 0.184035 Sep 07 13:56:16.008110 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3791/7555] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:56:15 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:56:17.038984 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-849ca90c-6435-4a43-81c9-99caec7b9605 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:56:17.039663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-849ca90c-6435-4a43-81c9-99caec7b9605 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:56:17.046615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-849ca90c-6435-4a43-81c9-99caec7b9605 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:17.047108 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-849ca90c-6435-4a43-81c9-99caec7b9605 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:17.047550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-849ca90c-6435-4a43-81c9-99caec7b9605 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:17.048254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-849ca90c-6435-4a43-81c9-99caec7b9605 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:17.048748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-849ca90c-6435-4a43-81c9-99caec7b9605 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:17.049182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-849ca90c-6435-4a43-81c9-99caec7b9605 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:17.197528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-849ca90c-6435-4a43-81c9-99caec7b9605 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:56:17.210928 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-849ca90c-6435-4a43-81c9-99caec7b9605 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1392 microversion: 2.1 time: 0.177546 Sep 07 13:56:17.211773 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3765/7556] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:56:17 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:56:18.242363 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d09fe806-a4cc-47e4-968b-924dd3f7c248 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:56:18.242931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d09fe806-a4cc-47e4-968b-924dd3f7c248 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:56:18.250364 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d09fe806-a4cc-47e4-968b-924dd3f7c248 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:18.250878 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d09fe806-a4cc-47e4-968b-924dd3f7c248 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:18.251331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d09fe806-a4cc-47e4-968b-924dd3f7c248 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:18.252106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d09fe806-a4cc-47e4-968b-924dd3f7c248 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:18.252615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d09fe806-a4cc-47e4-968b-924dd3f7c248 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:18.253059 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d09fe806-a4cc-47e4-968b-924dd3f7c248 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:18.407877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d09fe806-a4cc-47e4-968b-924dd3f7c248 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:56:18.416729 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d09fe806-a4cc-47e4-968b-924dd3f7c248 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1565 microversion: 2.1 time: 0.178504 Sep 07 13:56:18.417304 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3792/7557] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:56:18 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:56:18.439578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-abd87543-375d-4c28-87c1-fb40697e5bd3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:56:18.440210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-abd87543-375d-4c28-87c1-fb40697e5bd3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:56:18.447811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abd87543-375d-4c28-87c1-fb40697e5bd3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:18.448344 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abd87543-375d-4c28-87c1-fb40697e5bd3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:18.448789 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abd87543-375d-4c28-87c1-fb40697e5bd3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:18.449509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abd87543-375d-4c28-87c1-fb40697e5bd3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:18.449965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abd87543-375d-4c28-87c1-fb40697e5bd3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:18.450430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-abd87543-375d-4c28-87c1-fb40697e5bd3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:18.604349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-abd87543-375d-4c28-87c1-fb40697e5bd3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:56:18.612448 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-abd87543-375d-4c28-87c1-fb40697e5bd3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1565 microversion: 2.1 time: 0.176835 Sep 07 13:56:18.612988 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3766/7558] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:56:18 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:56:20.639786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-366562f5-54f1-4a37-8637-4d6cb1309e60 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:56:20.640440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-366562f5-54f1-4a37-8637-4d6cb1309e60 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:56:20.649036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-4688ca6b-f147-4ea2-a1fe-2cdfde2fc315 req-365b34fe-39c9-4040-92a6-ce66518e7c3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a77b35e7-b81b-4e35-b383-ceada0c89cab", "tag": "4393c786-ab54-4697-8577-63570508c2d1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:56:20.654534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:56:20.659798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-366562f5-54f1-4a37-8637-4d6cb1309e60 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:20.660432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-366562f5-54f1-4a37-8637-4d6cb1309e60 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:20.660899 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-366562f5-54f1-4a37-8637-4d6cb1309e60 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:20.661659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-366562f5-54f1-4a37-8637-4d6cb1309e60 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:20.662137 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-366562f5-54f1-4a37-8637-4d6cb1309e60 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:20.662250 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4688ca6b-f147-4ea2-a1fe-2cdfde2fc315 req-365b34fe-39c9-4040-92a6-ce66518e7c3a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:20.662577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-366562f5-54f1-4a37-8637-4d6cb1309e60 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:20.662727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4688ca6b-f147-4ea2-a1fe-2cdfde2fc315 req-365b34fe-39c9-4040-92a6-ce66518e7c3a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:20.663113 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-4688ca6b-f147-4ea2-a1fe-2cdfde2fc315 req-365b34fe-39c9-4040-92a6-ce66518e7c3a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:20.676418 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-4688ca6b-f147-4ea2-a1fe-2cdfde2fc315 req-365b34fe-39c9-4040-92a6-ce66518e7c3a service nova] Creating event network-changed:4393c786-ab54-4697-8577-63570508c2d1 for instance a77b35e7-b81b-4e35-b383-ceada0c89cab on n-h1-852087-9 Sep 07 13:56:20.681736 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-4688ca6b-f147-4ea2-a1fe-2cdfde2fc315 req-365b34fe-39c9-4040-92a6-ce66518e7c3a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036252 Sep 07 13:56:20.682360 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3767/7559] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:56:20.822840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-366562f5-54f1-4a37-8637-4d6cb1309e60 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:56:20.830865 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-366562f5-54f1-4a37-8637-4d6cb1309e60 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1565 microversion: 2.1 time: 0.195313 Sep 07 13:56:20.831741 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3793/7560] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:56:20 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1565 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:56:54.152235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=40 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:56:54.152949 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:56:54.158407 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8a43778c-89e2-499f-b411-dddb33751159 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:56:54.160840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8a43778c-89e2-499f-b411-dddb33751159 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:56:54.170870 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a43778c-89e2-499f-b411-dddb33751159 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:54.171399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a43778c-89e2-499f-b411-dddb33751159 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:54.171808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a43778c-89e2-499f-b411-dddb33751159 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:54.173253 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a43778c-89e2-499f-b411-dddb33751159 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:56:54.174026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a43778c-89e2-499f-b411-dddb33751159 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:56:54.174696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a43778c-89e2-499f-b411-dddb33751159 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:56:54.252717 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8a43778c-89e2-499f-b411-dddb33751159 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab/action" status: 200 len: 24558 microversion: 2.1 time: 0.103138 Sep 07 13:56:54.253435 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3768/7561] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:56:54 2022] POST /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab/action => generated 24558 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:57:24.660348 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=7 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:57:24.661422 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=46 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:57:24.668734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2076e306-7ec4-49ba-a106-b22a79414313 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:57:24.673390 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2076e306-7ec4-49ba-a106-b22a79414313 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:57:24.682078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2076e306-7ec4-49ba-a106-b22a79414313 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:24.682599 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2076e306-7ec4-49ba-a106-b22a79414313 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:24.683057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2076e306-7ec4-49ba-a106-b22a79414313 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:24.683802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2076e306-7ec4-49ba-a106-b22a79414313 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:24.684284 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2076e306-7ec4-49ba-a106-b22a79414313 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:24.684738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2076e306-7ec4-49ba-a106-b22a79414313 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:24.733883 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2076e306-7ec4-49ba-a106-b22a79414313 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:57:24.745645 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2076e306-7ec4-49ba-a106-b22a79414313 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Old instance type m1.heat2, new instance type m1.heat {{(pid=122433) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 07 13:57:24.756000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-2076e306-7ec4-49ba-a106-b22a79414313 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:57:24.756440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-2076e306-7ec4-49ba-a106-b22a79414313 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:57:24.756933 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-2076e306-7ec4-49ba-a106-b22a79414313 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:57:24.757354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-2076e306-7ec4-49ba-a106-b22a79414313 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:57:24.757892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-2076e306-7ec4-49ba-a106-b22a79414313 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:57:24.832386 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2076e306-7ec4-49ba-a106-b22a79414313 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab/action" status: 202 len: 0 microversion: 2.1 time: 0.174949 Sep 07 13:57:24.833347 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3794/7562] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:57:24 2022] POST /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:57:24.842488 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e950bff8-bbda-4dca-b377-11ccdbe6a93a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:57:24.843322 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e950bff8-bbda-4dca-b377-11ccdbe6a93a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:57:24.846638 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:57:24.847532 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:57:24.859631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e950bff8-bbda-4dca-b377-11ccdbe6a93a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:24.860474 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e950bff8-bbda-4dca-b377-11ccdbe6a93a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:24.861394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e950bff8-bbda-4dca-b377-11ccdbe6a93a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:24.863098 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e950bff8-bbda-4dca-b377-11ccdbe6a93a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:24.863757 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e950bff8-bbda-4dca-b377-11ccdbe6a93a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:24.864330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e950bff8-bbda-4dca-b377-11ccdbe6a93a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:25.227370 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-e950bff8-bbda-4dca-b377-11ccdbe6a93a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:57:25.239210 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e950bff8-bbda-4dca-b377-11ccdbe6a93a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1692 microversion: 2.1 time: 0.401183 Sep 07 13:57:25.240058 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3769/7563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:57:24 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1692 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:57:26.273713 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6c23a4e4-43e9-4119-876e-d90fe709187f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:57:26.274388 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6c23a4e4-43e9-4119-876e-d90fe709187f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:57:26.282002 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c23a4e4-43e9-4119-876e-d90fe709187f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:26.282521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c23a4e4-43e9-4119-876e-d90fe709187f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:26.282982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c23a4e4-43e9-4119-876e-d90fe709187f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:26.283717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c23a4e4-43e9-4119-876e-d90fe709187f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:26.284183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c23a4e4-43e9-4119-876e-d90fe709187f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:26.284630 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6c23a4e4-43e9-4119-876e-d90fe709187f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:26.496503 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6c23a4e4-43e9-4119-876e-d90fe709187f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:57:26.504937 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6c23a4e4-43e9-4119-876e-d90fe709187f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1692 microversion: 2.1 time: 0.235340 Sep 07 13:57:26.505561 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3795/7564] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:57:26 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1692 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:57:27.529189 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-20f80aa2-a2d9-4d00-9f72-d0d168a66f84 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:57:27.529857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-20f80aa2-a2d9-4d00-9f72-d0d168a66f84 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:57:27.537234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20f80aa2-a2d9-4d00-9f72-d0d168a66f84 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:27.537777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20f80aa2-a2d9-4d00-9f72-d0d168a66f84 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:27.538224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20f80aa2-a2d9-4d00-9f72-d0d168a66f84 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:27.538931 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20f80aa2-a2d9-4d00-9f72-d0d168a66f84 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:27.539385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20f80aa2-a2d9-4d00-9f72-d0d168a66f84 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:27.539813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-20f80aa2-a2d9-4d00-9f72-d0d168a66f84 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:27.695962 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-20f80aa2-a2d9-4d00-9f72-d0d168a66f84 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:57:27.704953 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-20f80aa2-a2d9-4d00-9f72-d0d168a66f84 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1697 microversion: 2.1 time: 0.179700 Sep 07 13:57:27.705568 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3770/7565] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:57:27 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1697 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:57:28.730288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-780f3a28-91dd-44e0-9552-279d43d11bdb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:57:28.730953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-780f3a28-91dd-44e0-9552-279d43d11bdb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:57:28.739243 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-780f3a28-91dd-44e0-9552-279d43d11bdb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:28.739842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-780f3a28-91dd-44e0-9552-279d43d11bdb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:28.740404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-780f3a28-91dd-44e0-9552-279d43d11bdb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:28.741275 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-780f3a28-91dd-44e0-9552-279d43d11bdb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:28.741857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-780f3a28-91dd-44e0-9552-279d43d11bdb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:28.742376 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-780f3a28-91dd-44e0-9552-279d43d11bdb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:28.902224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-780f3a28-91dd-44e0-9552-279d43d11bdb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:57:28.916545 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-780f3a28-91dd-44e0-9552-279d43d11bdb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1697 microversion: 2.1 time: 0.190063 Sep 07 13:57:28.917626 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3796/7566] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:57:28 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1697 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:57:29.941362 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5826b32e-fdea-4c73-9467-9810cb6cdc58 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:57:29.942105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5826b32e-fdea-4c73-9467-9810cb6cdc58 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:57:29.949583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5826b32e-fdea-4c73-9467-9810cb6cdc58 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:29.950081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5826b32e-fdea-4c73-9467-9810cb6cdc58 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:29.950517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5826b32e-fdea-4c73-9467-9810cb6cdc58 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:29.951297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5826b32e-fdea-4c73-9467-9810cb6cdc58 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:29.951832 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5826b32e-fdea-4c73-9467-9810cb6cdc58 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:29.952183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5826b32e-fdea-4c73-9467-9810cb6cdc58 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:30.101414 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5826b32e-fdea-4c73-9467-9810cb6cdc58 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:57:30.109772 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5826b32e-fdea-4c73-9467-9810cb6cdc58 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1697 microversion: 2.1 time: 0.172289 Sep 07 13:57:30.110458 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3771/7567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:57:29 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:57:31.133716 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-70fef8dd-939a-4ad2-8053-8c805de48134 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:57:31.134408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-70fef8dd-939a-4ad2-8053-8c805de48134 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:57:31.141878 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70fef8dd-939a-4ad2-8053-8c805de48134 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:31.142405 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70fef8dd-939a-4ad2-8053-8c805de48134 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:31.143012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70fef8dd-939a-4ad2-8053-8c805de48134 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:31.143736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70fef8dd-939a-4ad2-8053-8c805de48134 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:31.144426 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70fef8dd-939a-4ad2-8053-8c805de48134 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:31.144987 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-70fef8dd-939a-4ad2-8053-8c805de48134 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:31.299655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-70fef8dd-939a-4ad2-8053-8c805de48134 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:57:31.308536 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-70fef8dd-939a-4ad2-8053-8c805de48134 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1697 microversion: 2.1 time: 0.178946 Sep 07 13:57:31.309144 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3797/7568] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:57:31 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1697 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:57:32.333396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5d92e2c6-9da5-4e15-9a12-ab8612d6f8e3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:57:32.334262 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5d92e2c6-9da5-4e15-9a12-ab8612d6f8e3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:57:32.341846 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d92e2c6-9da5-4e15-9a12-ab8612d6f8e3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:32.342345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d92e2c6-9da5-4e15-9a12-ab8612d6f8e3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:32.342819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d92e2c6-9da5-4e15-9a12-ab8612d6f8e3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:32.343523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d92e2c6-9da5-4e15-9a12-ab8612d6f8e3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:32.343980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d92e2c6-9da5-4e15-9a12-ab8612d6f8e3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:32.344411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5d92e2c6-9da5-4e15-9a12-ab8612d6f8e3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:32.491148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5d92e2c6-9da5-4e15-9a12-ab8612d6f8e3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:57:32.501111 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5d92e2c6-9da5-4e15-9a12-ab8612d6f8e3 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1697 microversion: 2.1 time: 0.172052 Sep 07 13:57:32.502235 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3772/7569] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:57:32 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:57:33.529812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-973bade6-28f5-46b1-a889-b0ff02cf8c5f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:57:33.530443 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-973bade6-28f5-46b1-a889-b0ff02cf8c5f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:57:33.540741 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-973bade6-28f5-46b1-a889-b0ff02cf8c5f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:33.541424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-973bade6-28f5-46b1-a889-b0ff02cf8c5f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:33.542121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-973bade6-28f5-46b1-a889-b0ff02cf8c5f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:33.543114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-973bade6-28f5-46b1-a889-b0ff02cf8c5f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:33.543601 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-973bade6-28f5-46b1-a889-b0ff02cf8c5f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:33.544100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-973bade6-28f5-46b1-a889-b0ff02cf8c5f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:33.693558 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-973bade6-28f5-46b1-a889-b0ff02cf8c5f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:57:33.708025 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-973bade6-28f5-46b1-a889-b0ff02cf8c5f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1697 microversion: 2.1 time: 0.179882 Sep 07 13:57:33.708025 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3798/7570] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:57:33 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1697 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:57:34.736177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8c99061b-6d47-410c-becb-b939be8c1cb9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:57:34.736852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8c99061b-6d47-410c-becb-b939be8c1cb9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:57:34.747202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c99061b-6d47-410c-becb-b939be8c1cb9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:34.747904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c99061b-6d47-410c-becb-b939be8c1cb9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:34.748342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c99061b-6d47-410c-becb-b939be8c1cb9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:34.749094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c99061b-6d47-410c-becb-b939be8c1cb9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:34.749589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c99061b-6d47-410c-becb-b939be8c1cb9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:34.750021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8c99061b-6d47-410c-becb-b939be8c1cb9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:34.892585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8c99061b-6d47-410c-becb-b939be8c1cb9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:57:34.902047 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8c99061b-6d47-410c-becb-b939be8c1cb9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1697 microversion: 2.1 time: 0.171806 Sep 07 13:57:34.902686 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3773/7571] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:57:34 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:57:35.926783 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-654e7daa-70e1-40ee-8279-946462702160 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:57:35.927375 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-654e7daa-70e1-40ee-8279-946462702160 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:57:35.935025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-654e7daa-70e1-40ee-8279-946462702160 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:35.935538 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-654e7daa-70e1-40ee-8279-946462702160 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:35.935996 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-654e7daa-70e1-40ee-8279-946462702160 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:35.936723 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-654e7daa-70e1-40ee-8279-946462702160 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:35.937200 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-654e7daa-70e1-40ee-8279-946462702160 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:35.937691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-654e7daa-70e1-40ee-8279-946462702160 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:36.083910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-654e7daa-70e1-40ee-8279-946462702160 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:57:36.092139 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-654e7daa-70e1-40ee-8279-946462702160 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1697 microversion: 2.1 time: 0.169451 Sep 07 13:57:36.092731 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3799/7572] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:57:35 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:57:37.118548 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1efafb36-2d5d-4e1d-b72d-fcc4e7adb0fb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:57:37.119224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1efafb36-2d5d-4e1d-b72d-fcc4e7adb0fb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:57:37.127039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1efafb36-2d5d-4e1d-b72d-fcc4e7adb0fb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:37.127587 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1efafb36-2d5d-4e1d-b72d-fcc4e7adb0fb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:37.128135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1efafb36-2d5d-4e1d-b72d-fcc4e7adb0fb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:37.128837 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1efafb36-2d5d-4e1d-b72d-fcc4e7adb0fb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:37.129292 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1efafb36-2d5d-4e1d-b72d-fcc4e7adb0fb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:37.129760 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1efafb36-2d5d-4e1d-b72d-fcc4e7adb0fb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:37.304615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1efafb36-2d5d-4e1d-b72d-fcc4e7adb0fb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:57:37.313298 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1efafb36-2d5d-4e1d-b72d-fcc4e7adb0fb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1697 microversion: 2.1 time: 0.200569 Sep 07 13:57:37.313980 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3774/7573] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:57:37 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1697 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:57:38.338210 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-58b61b0b-20f4-406d-aac8-7655f2c2d259 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:57:38.338784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-58b61b0b-20f4-406d-aac8-7655f2c2d259 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:57:38.347700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58b61b0b-20f4-406d-aac8-7655f2c2d259 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:38.348222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58b61b0b-20f4-406d-aac8-7655f2c2d259 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:38.348708 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58b61b0b-20f4-406d-aac8-7655f2c2d259 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:38.349435 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58b61b0b-20f4-406d-aac8-7655f2c2d259 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:38.349949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58b61b0b-20f4-406d-aac8-7655f2c2d259 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:38.350396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-58b61b0b-20f4-406d-aac8-7655f2c2d259 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:38.497316 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-58b61b0b-20f4-406d-aac8-7655f2c2d259 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:57:38.506017 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-58b61b0b-20f4-406d-aac8-7655f2c2d259 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1697 microversion: 2.1 time: 0.171896 Sep 07 13:57:38.506614 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3800/7574] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:57:38 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:57:39.532004 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f5aeedde-9525-43bd-af25-222b7f6ce5dd tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:57:39.533724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f5aeedde-9525-43bd-af25-222b7f6ce5dd tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:57:39.541055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5aeedde-9525-43bd-af25-222b7f6ce5dd tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:39.541591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5aeedde-9525-43bd-af25-222b7f6ce5dd tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:39.542045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5aeedde-9525-43bd-af25-222b7f6ce5dd tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:39.542769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5aeedde-9525-43bd-af25-222b7f6ce5dd tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:39.543232 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5aeedde-9525-43bd-af25-222b7f6ce5dd tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:39.543664 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f5aeedde-9525-43bd-af25-222b7f6ce5dd tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:39.694507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f5aeedde-9525-43bd-af25-222b7f6ce5dd tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:57:39.703103 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f5aeedde-9525-43bd-af25-222b7f6ce5dd tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1696 microversion: 2.1 time: 0.176054 Sep 07 13:57:39.703691 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3775/7575] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:57:39 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1696 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:57:40.087255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-c5ad5e00-8fbc-48b1-98fe-d47115f7aa36 req-d2514536-6b1b-424f-9c6e-b54d01909944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a77b35e7-b81b-4e35-b383-ceada0c89cab", "name": "network-vif-unplugged", "status": "completed", "tag": "4393c786-ab54-4697-8577-63570508c2d1"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:57:40.100439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c5ad5e00-8fbc-48b1-98fe-d47115f7aa36 req-d2514536-6b1b-424f-9c6e-b54d01909944 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:40.101049 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c5ad5e00-8fbc-48b1-98fe-d47115f7aa36 req-d2514536-6b1b-424f-9c6e-b54d01909944 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:40.101581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-c5ad5e00-8fbc-48b1-98fe-d47115f7aa36 req-d2514536-6b1b-424f-9c6e-b54d01909944 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:40.115699 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-c5ad5e00-8fbc-48b1-98fe-d47115f7aa36 req-d2514536-6b1b-424f-9c6e-b54d01909944 service nova] Creating event network-vif-unplugged:4393c786-ab54-4697-8577-63570508c2d1 for instance a77b35e7-b81b-4e35-b383-ceada0c89cab on n-h2-852087-9 Sep 07 13:57:40.122223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [req-c5ad5e00-8fbc-48b1-98fe-d47115f7aa36 req-d2514536-6b1b-424f-9c6e-b54d01909944 service nova] Instance a77b35e7-b81b-4e35-b383-ceada0c89cab is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:57:40.135509 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-c5ad5e00-8fbc-48b1-98fe-d47115f7aa36 req-d2514536-6b1b-424f-9c6e-b54d01909944 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052929 Sep 07 13:57:40.136122 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3801/7576] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:57:40.727732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-51538342-edc3-4262-8035-f70cdfd00b43 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:57:40.728317 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-51538342-edc3-4262-8035-f70cdfd00b43 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:57:40.736193 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51538342-edc3-4262-8035-f70cdfd00b43 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:40.736728 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51538342-edc3-4262-8035-f70cdfd00b43 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:40.737175 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51538342-edc3-4262-8035-f70cdfd00b43 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:40.738099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51538342-edc3-4262-8035-f70cdfd00b43 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:40.738421 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51538342-edc3-4262-8035-f70cdfd00b43 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:40.739089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-51538342-edc3-4262-8035-f70cdfd00b43 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:40.878925 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-51538342-edc3-4262-8035-f70cdfd00b43 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:57:40.887499 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-51538342-edc3-4262-8035-f70cdfd00b43 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1696 microversion: 2.1 time: 0.163892 Sep 07 13:57:40.888349 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3776/7577] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:57:40 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:57:41.912086 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-93521e37-6928-4a7f-a9be-478c6ffd877e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:57:41.912822 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-93521e37-6928-4a7f-a9be-478c6ffd877e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:57:41.920511 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93521e37-6928-4a7f-a9be-478c6ffd877e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:41.921015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93521e37-6928-4a7f-a9be-478c6ffd877e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:41.921472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93521e37-6928-4a7f-a9be-478c6ffd877e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:41.922249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93521e37-6928-4a7f-a9be-478c6ffd877e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:41.922727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93521e37-6928-4a7f-a9be-478c6ffd877e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:41.923184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-93521e37-6928-4a7f-a9be-478c6ffd877e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:42.083585 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-93521e37-6928-4a7f-a9be-478c6ffd877e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:57:42.094094 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-93521e37-6928-4a7f-a9be-478c6ffd877e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1694 microversion: 2.1 time: 0.186441 Sep 07 13:57:42.094656 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3802/7578] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:57:41 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1694 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:57:42.194437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9bebebff-1d61-4021-8166-d56b49419cd6 req-ff7d0d93-15bf-4503-a0c6-86f7dcb762ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a77b35e7-b81b-4e35-b383-ceada0c89cab", "tag": "4393c786-ab54-4697-8577-63570508c2d1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:57:42.204190 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9bebebff-1d61-4021-8166-d56b49419cd6 req-ff7d0d93-15bf-4503-a0c6-86f7dcb762ea service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:42.204654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9bebebff-1d61-4021-8166-d56b49419cd6 req-ff7d0d93-15bf-4503-a0c6-86f7dcb762ea service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:42.205114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9bebebff-1d61-4021-8166-d56b49419cd6 req-ff7d0d93-15bf-4503-a0c6-86f7dcb762ea service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:42.217541 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9bebebff-1d61-4021-8166-d56b49419cd6 req-ff7d0d93-15bf-4503-a0c6-86f7dcb762ea service nova] Creating event network-changed:4393c786-ab54-4697-8577-63570508c2d1 for instance a77b35e7-b81b-4e35-b383-ceada0c89cab on n-h2-852087-9 Sep 07 13:57:42.223892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [req-9bebebff-1d61-4021-8166-d56b49419cd6 req-ff7d0d93-15bf-4503-a0c6-86f7dcb762ea service nova] Instance a77b35e7-b81b-4e35-b383-ceada0c89cab is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852087-9', 'n-h2-852087-9'} {{(pid=122432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 07 13:57:42.235751 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9bebebff-1d61-4021-8166-d56b49419cd6 req-ff7d0d93-15bf-4503-a0c6-86f7dcb762ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046032 Sep 07 13:57:42.236782 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3777/7579] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:57:43.118382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d506079c-7d9c-4ffd-969c-c1ab9aa6e73c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:57:43.119994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d506079c-7d9c-4ffd-969c-c1ab9aa6e73c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:57:43.127835 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d506079c-7d9c-4ffd-969c-c1ab9aa6e73c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:43.129669 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d506079c-7d9c-4ffd-969c-c1ab9aa6e73c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:43.130670 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d506079c-7d9c-4ffd-969c-c1ab9aa6e73c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:43.131042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d506079c-7d9c-4ffd-969c-c1ab9aa6e73c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:43.131770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d506079c-7d9c-4ffd-969c-c1ab9aa6e73c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:43.132721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d506079c-7d9c-4ffd-969c-c1ab9aa6e73c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:43.283360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d506079c-7d9c-4ffd-969c-c1ab9aa6e73c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:57:43.290680 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d506079c-7d9c-4ffd-969c-c1ab9aa6e73c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1691 microversion: 2.1 time: 0.176315 Sep 07 13:57:43.293517 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3803/7580] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:57:43 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:57:43.315056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fa3aa818-cfd5-4385-8c6a-f2f2a71aabad tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:57:43.315683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fa3aa818-cfd5-4385-8c6a-f2f2a71aabad tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:57:43.322428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa3aa818-cfd5-4385-8c6a-f2f2a71aabad tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:43.323386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa3aa818-cfd5-4385-8c6a-f2f2a71aabad tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:43.323386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa3aa818-cfd5-4385-8c6a-f2f2a71aabad tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:43.324039 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa3aa818-cfd5-4385-8c6a-f2f2a71aabad tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:43.324509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa3aa818-cfd5-4385-8c6a-f2f2a71aabad tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:43.324912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa3aa818-cfd5-4385-8c6a-f2f2a71aabad tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:43.388368 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fa3aa818-cfd5-4385-8c6a-f2f2a71aabad tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab/action" status: 204 len: 0 microversion: 2.1 time: 0.078375 Sep 07 13:57:43.389205 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3778/7581] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:57:43 2022] POST /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:57:43.402847 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-51d1052d-f7c6-4d2c-8ea2-2666b9266240 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:57:43.403571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-51d1052d-f7c6-4d2c-8ea2-2666b9266240 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:57:43.411299 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51d1052d-f7c6-4d2c-8ea2-2666b9266240 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:43.411791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51d1052d-f7c6-4d2c-8ea2-2666b9266240 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:43.412262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51d1052d-f7c6-4d2c-8ea2-2666b9266240 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:43.413002 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51d1052d-f7c6-4d2c-8ea2-2666b9266240 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:43.413464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51d1052d-f7c6-4d2c-8ea2-2666b9266240 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:43.413926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-51d1052d-f7c6-4d2c-8ea2-2666b9266240 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:43.558907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-51d1052d-f7c6-4d2c-8ea2-2666b9266240 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:57:43.568105 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-51d1052d-f7c6-4d2c-8ea2-2666b9266240 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1691 microversion: 2.1 time: 0.173669 Sep 07 13:57:43.568756 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3804/7582] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:57:43 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1691 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:57:43.592335 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4ea7184a-342a-46d5-8def-200c9389d405 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:57:43.593408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4ea7184a-342a-46d5-8def-200c9389d405 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:57:43.600469 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ea7184a-342a-46d5-8def-200c9389d405 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:43.601060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ea7184a-342a-46d5-8def-200c9389d405 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:43.601698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ea7184a-342a-46d5-8def-200c9389d405 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:43.602472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ea7184a-342a-46d5-8def-200c9389d405 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:43.602995 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ea7184a-342a-46d5-8def-200c9389d405 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:43.603705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4ea7184a-342a-46d5-8def-200c9389d405 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:43.760148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4ea7184a-342a-46d5-8def-200c9389d405 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:57:43.769065 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4ea7184a-342a-46d5-8def-200c9389d405 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1691 microversion: 2.1 time: 0.180961 Sep 07 13:57:43.770668 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3779/7583] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:57:43 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1691 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:57:44.796033 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-511afafb-58b3-4e46-a862-3133769aa235 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:57:44.796708 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-511afafb-58b3-4e46-a862-3133769aa235 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:57:44.803925 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-511afafb-58b3-4e46-a862-3133769aa235 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:44.804437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-511afafb-58b3-4e46-a862-3133769aa235 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:44.804894 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-511afafb-58b3-4e46-a862-3133769aa235 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:44.805650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-511afafb-58b3-4e46-a862-3133769aa235 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:44.806123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-511afafb-58b3-4e46-a862-3133769aa235 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:44.806563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-511afafb-58b3-4e46-a862-3133769aa235 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:44.960418 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-511afafb-58b3-4e46-a862-3133769aa235 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:57:44.968577 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-511afafb-58b3-4e46-a862-3133769aa235 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1683 microversion: 2.1 time: 0.176889 Sep 07 13:57:44.969298 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3805/7584] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:57:44 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:57:45.266367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-99c8ef8f-015c-457b-879f-b27115594510 req-18f198ea-1bc2-498a-839b-382dacdda5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a77b35e7-b81b-4e35-b383-ceada0c89cab", "name": "network-vif-plugged", "status": "completed", "tag": "4393c786-ab54-4697-8577-63570508c2d1"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:57:45.277045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-99c8ef8f-015c-457b-879f-b27115594510 req-18f198ea-1bc2-498a-839b-382dacdda5f8 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:57:45.277570 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-99c8ef8f-015c-457b-879f-b27115594510 req-18f198ea-1bc2-498a-839b-382dacdda5f8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:57:45.278018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-99c8ef8f-015c-457b-879f-b27115594510 req-18f198ea-1bc2-498a-839b-382dacdda5f8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:57:45.291298 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-99c8ef8f-015c-457b-879f-b27115594510 req-18f198ea-1bc2-498a-839b-382dacdda5f8 service nova] Creating event network-vif-plugged:4393c786-ab54-4697-8577-63570508c2d1 for instance a77b35e7-b81b-4e35-b383-ceada0c89cab on n-h2-852087-9 Sep 07 13:57:45.297053 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-99c8ef8f-015c-457b-879f-b27115594510 req-18f198ea-1bc2-498a-839b-382dacdda5f8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092768 Sep 07 13:57:45.297911 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3780/7585] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:58:09.178604 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c05361da-4ff0-4b1d-9e28-c2fca57531ea tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:58:09.180797 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c05361da-4ff0-4b1d-9e28-c2fca57531ea tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:58:09.184431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=28 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:58:09.185106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:58:09.191406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c05361da-4ff0-4b1d-9e28-c2fca57531ea tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:09.191900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c05361da-4ff0-4b1d-9e28-c2fca57531ea tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:09.192353 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c05361da-4ff0-4b1d-9e28-c2fca57531ea tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:09.193090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c05361da-4ff0-4b1d-9e28-c2fca57531ea tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:09.193594 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c05361da-4ff0-4b1d-9e28-c2fca57531ea tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:09.194036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c05361da-4ff0-4b1d-9e28-c2fca57531ea tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:09.264957 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c05361da-4ff0-4b1d-9e28-c2fca57531ea tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab/action" status: 200 len: 24567 microversion: 2.1 time: 0.090348 Sep 07 13:58:09.265644 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3806/7586] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:58:09 2022] POST /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab/action => generated 24567 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:58:16.378993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ac108f53-02f2-4360-a036-26a21cac13e8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:58:16.379564 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ac108f53-02f2-4360-a036-26a21cac13e8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:58:16.383104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-eb66f009-5680-423c-9f99-3f78b5547d76 req-016152ca-f2c3-476d-b063-89b2cfc94213 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a77b35e7-b81b-4e35-b383-ceada0c89cab", "tag": "4393c786-ab54-4697-8577-63570508c2d1"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:58:16.383941 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 07 13:58:16.385471 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=24 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:58:16.386483 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:58:16.394219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac108f53-02f2-4360-a036-26a21cac13e8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:16.394721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac108f53-02f2-4360-a036-26a21cac13e8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:16.395226 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac108f53-02f2-4360-a036-26a21cac13e8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:16.395900 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac108f53-02f2-4360-a036-26a21cac13e8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:16.396367 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac108f53-02f2-4360-a036-26a21cac13e8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:16.396843 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ac108f53-02f2-4360-a036-26a21cac13e8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:16.398214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-eb66f009-5680-423c-9f99-3f78b5547d76 req-016152ca-f2c3-476d-b063-89b2cfc94213 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:16.398732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-eb66f009-5680-423c-9f99-3f78b5547d76 req-016152ca-f2c3-476d-b063-89b2cfc94213 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:16.399300 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-eb66f009-5680-423c-9f99-3f78b5547d76 req-016152ca-f2c3-476d-b063-89b2cfc94213 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:16.412498 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-eb66f009-5680-423c-9f99-3f78b5547d76 req-016152ca-f2c3-476d-b063-89b2cfc94213 service nova] Creating event network-changed:4393c786-ab54-4697-8577-63570508c2d1 for instance a77b35e7-b81b-4e35-b383-ceada0c89cab on n-h2-852087-9 Sep 07 13:58:16.417892 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-eb66f009-5680-423c-9f99-3f78b5547d76 req-016152ca-f2c3-476d-b063-89b2cfc94213 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039215 Sep 07 13:58:16.418798 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3807/7587] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:58:16.429816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ac108f53-02f2-4360-a036-26a21cac13e8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 13:58:16.532268 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ac108f53-02f2-4360-a036-26a21cac13e8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 204 len: 0 microversion: 2.1 time: 0.157941 Sep 07 13:58:16.533725 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3781/7588] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 13:58:16 2022] DELETE /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 13:58:16.544234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-bf2141b0-2ce8-446e-9cc5-0efe3269b374 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:58:16.544973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-bf2141b0-2ce8-446e-9cc5-0efe3269b374 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:58:16.552289 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf2141b0-2ce8-446e-9cc5-0efe3269b374 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:16.552803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf2141b0-2ce8-446e-9cc5-0efe3269b374 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:16.553330 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf2141b0-2ce8-446e-9cc5-0efe3269b374 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:16.554588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf2141b0-2ce8-446e-9cc5-0efe3269b374 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:16.555190 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf2141b0-2ce8-446e-9cc5-0efe3269b374 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:16.555531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-bf2141b0-2ce8-446e-9cc5-0efe3269b374 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:16.696258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-bf2141b0-2ce8-446e-9cc5-0efe3269b374 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:58:16.704710 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-bf2141b0-2ce8-446e-9cc5-0efe3269b374 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1689 microversion: 2.1 time: 0.166108 Sep 07 13:58:16.705517 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3808/7589] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:58:16 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:58:17.730250 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2c6f2e0c-d6ec-44fe-bc11-0329e247210c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:58:17.730961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2c6f2e0c-d6ec-44fe-bc11-0329e247210c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:58:17.737347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c6f2e0c-d6ec-44fe-bc11-0329e247210c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:17.737885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c6f2e0c-d6ec-44fe-bc11-0329e247210c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:17.738337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c6f2e0c-d6ec-44fe-bc11-0329e247210c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:17.739030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c6f2e0c-d6ec-44fe-bc11-0329e247210c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:17.739479 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c6f2e0c-d6ec-44fe-bc11-0329e247210c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:17.739922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2c6f2e0c-d6ec-44fe-bc11-0329e247210c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:17.877620 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2c6f2e0c-d6ec-44fe-bc11-0329e247210c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:58:17.886641 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2c6f2e0c-d6ec-44fe-bc11-0329e247210c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 200 len: 1689 microversion: 2.1 time: 0.161835 Sep 07 13:58:17.887387 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3782/7590] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:58:17 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:58:18.584492 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-4546dc87-129e-41e4-bc54-3e5f052e6a51 req-338ff360-2de6-4988-b93d-d16c0be780ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a77b35e7-b81b-4e35-b383-ceada0c89cab", "name": "network-vif-deleted", "tag": "4393c786-ab54-4697-8577-63570508c2d1"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:58:18.596767 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4546dc87-129e-41e4-bc54-3e5f052e6a51 req-338ff360-2de6-4988-b93d-d16c0be780ec service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:18.597263 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4546dc87-129e-41e4-bc54-3e5f052e6a51 req-338ff360-2de6-4988-b93d-d16c0be780ec service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:18.597782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-4546dc87-129e-41e4-bc54-3e5f052e6a51 req-338ff360-2de6-4988-b93d-d16c0be780ec service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:18.610677 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-4546dc87-129e-41e4-bc54-3e5f052e6a51 req-338ff360-2de6-4988-b93d-d16c0be780ec service nova] Creating event network-vif-deleted:4393c786-ab54-4697-8577-63570508c2d1 for instance a77b35e7-b81b-4e35-b383-ceada0c89cab on n-h2-852087-9 Sep 07 13:58:18.615527 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-4546dc87-129e-41e4-bc54-3e5f052e6a51 req-338ff360-2de6-4988-b93d-d16c0be780ec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034801 Sep 07 13:58:18.616349 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3809/7591] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:58:18.913524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df97d540-1bfa-4ea4-aac5-94e5bef2fcca tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:58:18.914132 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-df97d540-1bfa-4ea4-aac5-94e5bef2fcca tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: a77b35e7-b81b-4e35-b383-ceada0c89cab] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:58:18.921609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df97d540-1bfa-4ea4-aac5-94e5bef2fcca tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:18.922176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df97d540-1bfa-4ea4-aac5-94e5bef2fcca tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:18.922631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df97d540-1bfa-4ea4-aac5-94e5bef2fcca tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:18.923345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df97d540-1bfa-4ea4-aac5-94e5bef2fcca tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:18.923850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df97d540-1bfa-4ea4-aac5-94e5bef2fcca tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:18.924219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-df97d540-1bfa-4ea4-aac5-94e5bef2fcca tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:18.939274 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-df97d540-1bfa-4ea4-aac5-94e5bef2fcca tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] HTTP exception thrown: Instance a77b35e7-b81b-4e35-b383-ceada0c89cab could not be found. Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df97d540-1bfa-4ea4-aac5-94e5bef2fcca tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Request method failure captured: Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab HTTP/1.1 Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGKJIpRj4dUoVYAzI48MspU8ZelpD30GGZSMNBLAcJjfPqrRwz5SflK5ZGsGmdXzaRhezwINOX9bACqNviUzYHhK5j_TepIiCI-ydksrX2YrwyvVjX0oRIdw2hFrTIsMr6gjr_5dekqg_MtjlByIh9B6o0NyhZw8LTWA2pkGzjxBAu_s Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8f56cfdac7bd4768b54690ce5afe8854 Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-901687866 Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f56cfdac7bd4768b54690ce5afe8854"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f56cfdac7bd4768b54690ce5afe8854"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f56cfdac7bd4768b54690ce5afe8854"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f56cfdac7bd4768b54690ce5afe8854"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TestNetworkAdvancedServerOps-901687866 Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8f56cfdac7bd4768b54690ce5afe8854 Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-901687866 Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TestNetworkAdvancedServerOps-901687866-project Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 9dce2997e6c6461db3bae9e9c3315d8b Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TestNetworkAdvancedServerOps-901687866-project Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance a77b35e7-b81b-4e35-b383-ceada0c89cab could not be found. Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': 'a77b35e7-b81b-4e35-b383-ceada0c89cab'} Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a77b35e7-b81b-4e35-b383-ceada0c89cab could not be found. Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a77b35e7-b81b-4e35-b383-ceada0c89cab could not be found. Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:58:18.940956 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 13:58:18.946161 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:58:18.946161 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 13:58:18.946161 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 13:58:18.946161 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 13:58:18.946161 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 13:58:18.946161 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 13:58:18.946161 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a77b35e7-b81b-4e35-b383-ceada0c89cab could not be found. Sep 07 13:58:18.946161 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 13:58:18.946161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-df97d540-1bfa-4ea4-aac5-94e5bef2fcca tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Returning 404 to user: Instance a77b35e7-b81b-4e35-b383-ceada0c89cab could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 13:58:18.946161 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-df97d540-1bfa-4ea4-aac5-94e5bef2fcca tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab" status: 404 len: 111 microversion: 2.1 time: 0.033072 Sep 07 13:58:18.946161 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3783/7592] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:58:18 2022] GET /compute/v2.1/servers/a77b35e7-b81b-4e35-b383-ceada0c89cab => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 13:58:22.452861 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e7b4687e-1b54-4590-9b6e-e49c87c45551 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '.version_select at 0x7fc413e69820>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:58:22.488399 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e7b4687e-1b54-4590-9b6e-e49c87c45551 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-524305677" status: 202 len: 0 microversion: 2.1 time: 0.039776 Sep 07 13:58:22.493267 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3810/7593] 10.222.0.16 () {58 vars in 1281 bytes} [Wed Sep 7 13:58:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-524305677 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:58:22.520492 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-38d8ad50-577d-43b1-a2c1-91fc72c0d35c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'create', calling method: .version_select at 0x7fc41982f1f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2057132818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOergVNFTsR6gkfPJfKSpMjw6hSeOCd74usnmVMUrQPfsQRmjM6SLLfoPHh6Op7P/6Uh47ORqP3R3D7B9Lp07r2zbtuJQZl6ehuPsjAFHo/NGTopee51BX/B5A2uXyGxhQ=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:58:22.541319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-38d8ad50-577d-43b1-a2c1-91fc72c0d35c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Getting quotas for project 8f56cfdac7bd4768b54690ce5afe8854. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:58:22.547527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-38d8ad50-577d-43b1-a2c1-91fc72c0d35c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Getting quotas for user 9dce2997e6c6461db3bae9e9c3315d8b and project 8f56cfdac7bd4768b54690ce5afe8854. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:58:22.576658 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-38d8ad50-577d-43b1-a2c1-91fc72c0d35c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.061771 Sep 07 13:58:22.577274 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3784/7594] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 13:58:22 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:58:28.150261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-db3ea26e-1fd6-457a-8513-3c868e89c07e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-703599833", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "b9423127-6ab7-481c-ac54-678afb436df2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2057132818", "security_groups": [{"name": "tempest-secgroup-smoke-353488766"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:58:28.272326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-db3ea26e-1fd6-457a-8513-3c868e89c07e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] validate_networks() for [('b9423127-6ab7-481c-ac54-678afb436df2', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 13:58:28.604412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=14 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:58:29.052545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-db3ea26e-1fd6-457a-8513-3c868e89c07e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 13:58:29.053347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-db3ea26e-1fd6-457a-8513-3c868e89c07e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 13:58:29.054044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-db3ea26e-1fd6-457a-8513-3c868e89c07e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 13:58:29.054631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-db3ea26e-1fd6-457a-8513-3c868e89c07e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 13:58:29.055244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-db3ea26e-1fd6-457a-8513-3c868e89c07e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 13:58:29.075588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db3ea26e-1fd6-457a-8513-3c868e89c07e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:29.076184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db3ea26e-1fd6-457a-8513-3c868e89c07e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:29.077150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db3ea26e-1fd6-457a-8513-3c868e89c07e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:29.078224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db3ea26e-1fd6-457a-8513-3c868e89c07e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:29.079318 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db3ea26e-1fd6-457a-8513-3c868e89c07e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:29.080012 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-db3ea26e-1fd6-457a-8513-3c868e89c07e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:29.108770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-db3ea26e-1fd6-457a-8513-3c868e89c07e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Getting quotas for project 8f56cfdac7bd4768b54690ce5afe8854. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 13:58:29.115440 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-db3ea26e-1fd6-457a-8513-3c868e89c07e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Getting quotas for user 9dce2997e6c6461db3bae9e9c3315d8b and project 8f56cfdac7bd4768b54690ce5afe8854. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 13:58:29.128636 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-db3ea26e-1fd6-457a-8513-3c868e89c07e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 13:58:29.131296 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-db3ea26e-1fd6-457a-8513-3c868e89c07e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 13:58:29.182219 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-db3ea26e-1fd6-457a-8513-3c868e89c07e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.035730 Sep 07 13:58:29.190853 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3811/7595] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 13:58:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 13:58:29.194555 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-18057c94-8aeb-4751-a1bd-4c0fcc6dbd29 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:58:29.195173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-18057c94-8aeb-4751-a1bd-4c0fcc6dbd29 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:58:29.198285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:58:29.259116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-18057c94-8aeb-4751-a1bd-4c0fcc6dbd29 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:58:29.266189 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-18057c94-8aeb-4751-a1bd-4c0fcc6dbd29 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1266 microversion: 2.1 time: 0.075367 Sep 07 13:58:29.266858 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3785/7596] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:58:29 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1266 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:58:30.288769 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d723bbc3-6362-4eed-b690-3cfa0a74840f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:58:30.289385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d723bbc3-6362-4eed-b690-3cfa0a74840f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:58:30.299136 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d723bbc3-6362-4eed-b690-3cfa0a74840f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:30.299757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d723bbc3-6362-4eed-b690-3cfa0a74840f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:30.300131 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d723bbc3-6362-4eed-b690-3cfa0a74840f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:30.300874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d723bbc3-6362-4eed-b690-3cfa0a74840f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:30.301885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d723bbc3-6362-4eed-b690-3cfa0a74840f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:30.302325 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d723bbc3-6362-4eed-b690-3cfa0a74840f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:30.386757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d723bbc3-6362-4eed-b690-3cfa0a74840f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:58:30.411449 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d723bbc3-6362-4eed-b690-3cfa0a74840f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1318 microversion: 2.1 time: 0.125433 Sep 07 13:58:30.413730 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3812/7597] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:58:30 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1318 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:58:31.437405 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3255fa43-67ce-4902-a51d-7f1a2844e335 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:58:31.438146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3255fa43-67ce-4902-a51d-7f1a2844e335 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:58:31.456889 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3255fa43-67ce-4902-a51d-7f1a2844e335 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:31.457929 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3255fa43-67ce-4902-a51d-7f1a2844e335 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:31.458563 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3255fa43-67ce-4902-a51d-7f1a2844e335 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:31.459486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3255fa43-67ce-4902-a51d-7f1a2844e335 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:31.460264 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3255fa43-67ce-4902-a51d-7f1a2844e335 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:31.460861 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3255fa43-67ce-4902-a51d-7f1a2844e335 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:31.739201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3255fa43-67ce-4902-a51d-7f1a2844e335 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:58:31.748793 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3255fa43-67ce-4902-a51d-7f1a2844e335 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1391 microversion: 2.1 time: 0.316173 Sep 07 13:58:31.767215 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3786/7598] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:58:31 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1391 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:58:32.174105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-3d0f9a35-c05a-4a5c-a5f3-af313493f985 req-7e039a29-1d4f-4d2e-8a4b-04c8212c77c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e68ff602-190d-4cca-8a83-e90614a2e064", "tag": "941f2532-42f1-4222-bb72-3c7e26fb92ff"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:58:32.185508 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3d0f9a35-c05a-4a5c-a5f3-af313493f985 req-7e039a29-1d4f-4d2e-8a4b-04c8212c77c4 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:32.186145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3d0f9a35-c05a-4a5c-a5f3-af313493f985 req-7e039a29-1d4f-4d2e-8a4b-04c8212c77c4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:32.186698 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-3d0f9a35-c05a-4a5c-a5f3-af313493f985 req-7e039a29-1d4f-4d2e-8a4b-04c8212c77c4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:32.199619 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-3d0f9a35-c05a-4a5c-a5f3-af313493f985 req-7e039a29-1d4f-4d2e-8a4b-04c8212c77c4 service nova] Creating event network-changed:941f2532-42f1-4222-bb72-3c7e26fb92ff for instance e68ff602-190d-4cca-8a83-e90614a2e064 on n-h2-852087-9 Sep 07 13:58:32.205698 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-3d0f9a35-c05a-4a5c-a5f3-af313493f985 req-7e039a29-1d4f-4d2e-8a4b-04c8212c77c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035468 Sep 07 13:58:32.206686 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3813/7599] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:58:32.775287 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-749eac0f-80bb-4b03-99d6-134c7e848137 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:58:32.775977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-749eac0f-80bb-4b03-99d6-134c7e848137 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:58:32.783883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-749eac0f-80bb-4b03-99d6-134c7e848137 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:32.784394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-749eac0f-80bb-4b03-99d6-134c7e848137 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:32.784855 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-749eac0f-80bb-4b03-99d6-134c7e848137 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:32.785585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-749eac0f-80bb-4b03-99d6-134c7e848137 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:32.786041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-749eac0f-80bb-4b03-99d6-134c7e848137 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:32.786468 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-749eac0f-80bb-4b03-99d6-134c7e848137 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:32.938790 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-749eac0f-80bb-4b03-99d6-134c7e848137 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:58:32.946917 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-749eac0f-80bb-4b03-99d6-134c7e848137 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1391 microversion: 2.1 time: 0.175606 Sep 07 13:58:32.947865 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3787/7600] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:58:32 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:58:33.986885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-edf676e7-f01c-4509-88a6-3dcb0ef54d47 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:58:33.986885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-edf676e7-f01c-4509-88a6-3dcb0ef54d47 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:58:34.003243 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edf676e7-f01c-4509-88a6-3dcb0ef54d47 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:34.003743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edf676e7-f01c-4509-88a6-3dcb0ef54d47 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:34.004267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edf676e7-f01c-4509-88a6-3dcb0ef54d47 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:34.004939 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edf676e7-f01c-4509-88a6-3dcb0ef54d47 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:34.005404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edf676e7-f01c-4509-88a6-3dcb0ef54d47 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:34.006043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edf676e7-f01c-4509-88a6-3dcb0ef54d47 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:34.199528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-edf676e7-f01c-4509-88a6-3dcb0ef54d47 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:58:34.207598 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-edf676e7-f01c-4509-88a6-3dcb0ef54d47 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1391 microversion: 2.1 time: 0.239501 Sep 07 13:58:34.208187 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3814/7601] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:58:33 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1391 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:58:35.231738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4676d277-f2eb-464b-9cda-a126d78c2718 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:58:35.232289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4676d277-f2eb-464b-9cda-a126d78c2718 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:58:35.239831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4676d277-f2eb-464b-9cda-a126d78c2718 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:35.240358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4676d277-f2eb-464b-9cda-a126d78c2718 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:35.240803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4676d277-f2eb-464b-9cda-a126d78c2718 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:35.241523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4676d277-f2eb-464b-9cda-a126d78c2718 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:35.242019 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4676d277-f2eb-464b-9cda-a126d78c2718 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:35.242449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4676d277-f2eb-464b-9cda-a126d78c2718 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:35.387122 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4676d277-f2eb-464b-9cda-a126d78c2718 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:58:35.395295 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4676d277-f2eb-464b-9cda-a126d78c2718 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1391 microversion: 2.1 time: 0.167747 Sep 07 13:58:35.395890 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3788/7602] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:58:35 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:58:36.420730 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ef932829-5d23-4b30-8756-6ea957427ffe tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:58:36.421379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ef932829-5d23-4b30-8756-6ea957427ffe tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:58:36.430973 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef932829-5d23-4b30-8756-6ea957427ffe tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:36.431757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef932829-5d23-4b30-8756-6ea957427ffe tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:36.432377 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef932829-5d23-4b30-8756-6ea957427ffe tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:36.433317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef932829-5d23-4b30-8756-6ea957427ffe tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:36.434035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef932829-5d23-4b30-8756-6ea957427ffe tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:36.434449 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef932829-5d23-4b30-8756-6ea957427ffe tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:36.579628 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ef932829-5d23-4b30-8756-6ea957427ffe tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:58:36.587779 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ef932829-5d23-4b30-8756-6ea957427ffe tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1391 microversion: 2.1 time: 0.173018 Sep 07 13:58:36.588359 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3815/7603] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:58:36 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:58:37.440584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-426dc389-c9db-43d7-87d1-b0b16bda22ec req-211c3c0e-d4f4-4d3c-894a-84f75f4c62c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e68ff602-190d-4cca-8a83-e90614a2e064", "name": "network-vif-plugged", "status": "completed", "tag": "941f2532-42f1-4222-bb72-3c7e26fb92ff"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:58:37.454751 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-426dc389-c9db-43d7-87d1-b0b16bda22ec req-211c3c0e-d4f4-4d3c-894a-84f75f4c62c5 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:37.455246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-426dc389-c9db-43d7-87d1-b0b16bda22ec req-211c3c0e-d4f4-4d3c-894a-84f75f4c62c5 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:37.455681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-426dc389-c9db-43d7-87d1-b0b16bda22ec req-211c3c0e-d4f4-4d3c-894a-84f75f4c62c5 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:37.470401 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-426dc389-c9db-43d7-87d1-b0b16bda22ec req-211c3c0e-d4f4-4d3c-894a-84f75f4c62c5 service nova] Creating event network-vif-plugged:941f2532-42f1-4222-bb72-3c7e26fb92ff for instance e68ff602-190d-4cca-8a83-e90614a2e064 on n-h2-852087-9 Sep 07 13:58:37.476136 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-426dc389-c9db-43d7-87d1-b0b16bda22ec req-211c3c0e-d4f4-4d3c-894a-84f75f4c62c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039351 Sep 07 13:58:37.476763 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3789/7604] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:58:37.611400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f171ce3f-3ee5-469f-bcb8-4c01e670a98c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:58:37.612007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f171ce3f-3ee5-469f-bcb8-4c01e670a98c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:58:37.619542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f171ce3f-3ee5-469f-bcb8-4c01e670a98c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:37.619970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f171ce3f-3ee5-469f-bcb8-4c01e670a98c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:37.620659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f171ce3f-3ee5-469f-bcb8-4c01e670a98c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:37.621371 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f171ce3f-3ee5-469f-bcb8-4c01e670a98c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:37.621875 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f171ce3f-3ee5-469f-bcb8-4c01e670a98c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:37.622454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f171ce3f-3ee5-469f-bcb8-4c01e670a98c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:37.778193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f171ce3f-3ee5-469f-bcb8-4c01e670a98c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:58:37.789968 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f171ce3f-3ee5-469f-bcb8-4c01e670a98c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1391 microversion: 2.1 time: 0.182559 Sep 07 13:58:37.790743 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3816/7605] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:58:37 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1391 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:58:38.816398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5a3f6f74-774a-44d3-8244-af6cf8838b8c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:58:38.817051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5a3f6f74-774a-44d3-8244-af6cf8838b8c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:58:38.824625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a3f6f74-774a-44d3-8244-af6cf8838b8c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:38.825140 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a3f6f74-774a-44d3-8244-af6cf8838b8c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:38.825615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a3f6f74-774a-44d3-8244-af6cf8838b8c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:38.826308 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a3f6f74-774a-44d3-8244-af6cf8838b8c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:38.826763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a3f6f74-774a-44d3-8244-af6cf8838b8c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:38.827218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5a3f6f74-774a-44d3-8244-af6cf8838b8c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:38.970326 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5a3f6f74-774a-44d3-8244-af6cf8838b8c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:58:38.978879 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5a3f6f74-774a-44d3-8244-af6cf8838b8c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1391 microversion: 2.1 time: 0.167251 Sep 07 13:58:38.979454 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3790/7606] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:58:38 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:58:40.003023 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-84f81be3-73b1-4848-b8aa-e773da76dcb9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:58:40.003721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-84f81be3-73b1-4848-b8aa-e773da76dcb9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:58:40.006873 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:58:40.007919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:58:40.008647 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:58:40.015106 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84f81be3-73b1-4848-b8aa-e773da76dcb9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:40.015688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84f81be3-73b1-4848-b8aa-e773da76dcb9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:40.016151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84f81be3-73b1-4848-b8aa-e773da76dcb9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:40.016879 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84f81be3-73b1-4848-b8aa-e773da76dcb9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:40.017379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84f81be3-73b1-4848-b8aa-e773da76dcb9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:40.017868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-84f81be3-73b1-4848-b8aa-e773da76dcb9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:40.177085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-84f81be3-73b1-4848-b8aa-e773da76dcb9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:58:40.188732 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-84f81be3-73b1-4848-b8aa-e773da76dcb9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1563 microversion: 2.1 time: 0.189821 Sep 07 13:58:40.189335 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3817/7607] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:58:39 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1563 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:58:40.215734 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-faeea725-7e0a-404d-a8c5-2da674734438 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:58:40.216313 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-faeea725-7e0a-404d-a8c5-2da674734438 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:58:40.218514 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:58:40.225701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-faeea725-7e0a-404d-a8c5-2da674734438 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:40.226207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-faeea725-7e0a-404d-a8c5-2da674734438 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:40.226655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-faeea725-7e0a-404d-a8c5-2da674734438 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:40.227372 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-faeea725-7e0a-404d-a8c5-2da674734438 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:40.227860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-faeea725-7e0a-404d-a8c5-2da674734438 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:40.228294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-faeea725-7e0a-404d-a8c5-2da674734438 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:40.380852 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-faeea725-7e0a-404d-a8c5-2da674734438 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:58:40.389262 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-faeea725-7e0a-404d-a8c5-2da674734438 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1563 microversion: 2.1 time: 0.177705 Sep 07 13:58:40.389802 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3791/7608] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:58:40 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1563 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:58:42.414556 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b6de3414-0929-4515-ad61-8b0f1647e368 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:58:42.415193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b6de3414-0929-4515-ad61-8b0f1647e368 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:58:42.418111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-86f1db96-f4a2-4c3c-8fab-a130e4e16614 req-51d352c2-e3ed-4ae9-87e4-155b132fbaaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e68ff602-190d-4cca-8a83-e90614a2e064", "tag": "941f2532-42f1-4222-bb72-3c7e26fb92ff"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:58:42.423776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6de3414-0929-4515-ad61-8b0f1647e368 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:42.424282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6de3414-0929-4515-ad61-8b0f1647e368 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:42.424725 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6de3414-0929-4515-ad61-8b0f1647e368 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:42.426036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6de3414-0929-4515-ad61-8b0f1647e368 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:42.426582 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6de3414-0929-4515-ad61-8b0f1647e368 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:42.427038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b6de3414-0929-4515-ad61-8b0f1647e368 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:42.430991 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-86f1db96-f4a2-4c3c-8fab-a130e4e16614 req-51d352c2-e3ed-4ae9-87e4-155b132fbaaf service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:58:42.431668 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-86f1db96-f4a2-4c3c-8fab-a130e4e16614 req-51d352c2-e3ed-4ae9-87e4-155b132fbaaf service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:58:42.432213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-86f1db96-f4a2-4c3c-8fab-a130e4e16614 req-51d352c2-e3ed-4ae9-87e4-155b132fbaaf service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:58:42.444824 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-86f1db96-f4a2-4c3c-8fab-a130e4e16614 req-51d352c2-e3ed-4ae9-87e4-155b132fbaaf service nova] Creating event network-changed:941f2532-42f1-4222-bb72-3c7e26fb92ff for instance e68ff602-190d-4cca-8a83-e90614a2e064 on n-h2-852087-9 Sep 07 13:58:42.450405 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-86f1db96-f4a2-4c3c-8fab-a130e4e16614 req-51d352c2-e3ed-4ae9-87e4-155b132fbaaf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036874 Sep 07 13:58:42.451735 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3792/7609] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 13:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 13:58:42.657000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b6de3414-0929-4515-ad61-8b0f1647e368 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:58:42.667321 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b6de3414-0929-4515-ad61-8b0f1647e368 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1563 microversion: 2.1 time: 0.256809 Sep 07 13:58:42.668064 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3818/7610] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:58:42 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1563 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:59:03.926839 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:59:03.927785 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=34 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:59:03.932868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-486f7a67-6174-426e-bc6a-b36460597152 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:59:03.935245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-486f7a67-6174-426e-bc6a-b36460597152 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:59:03.943434 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-486f7a67-6174-426e-bc6a-b36460597152 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:03.944086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-486f7a67-6174-426e-bc6a-b36460597152 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:03.944567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-486f7a67-6174-426e-bc6a-b36460597152 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:03.945295 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-486f7a67-6174-426e-bc6a-b36460597152 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:03.945808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-486f7a67-6174-426e-bc6a-b36460597152 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:03.946247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-486f7a67-6174-426e-bc6a-b36460597152 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:04.018895 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-486f7a67-6174-426e-bc6a-b36460597152 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064/action" status: 200 len: 24562 microversion: 2.1 time: 0.094166 Sep 07 13:59:04.019661 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3793/7611] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:59:03 2022] POST /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064/action => generated 24562 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:59:14.978935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de5af996-a923-4fdb-b85c-5ddee5fa6657 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:59:14.981751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:59:14.982571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=40 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:59:14.988885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de5af996-a923-4fdb-b85c-5ddee5fa6657 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:14.989436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de5af996-a923-4fdb-b85c-5ddee5fa6657 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:14.989924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de5af996-a923-4fdb-b85c-5ddee5fa6657 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:15.019367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-de5af996-a923-4fdb-b85c-5ddee5fa6657 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Going to try to stop instance {{(pid=122433) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 13:59:15.067125 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-de5af996-a923-4fdb-b85c-5ddee5fa6657 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064/action" status: 202 len: 0 microversion: 2.1 time: 0.092241 Sep 07 13:59:15.067812 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3819/7612] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:59:14 2022] POST /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:59:15.077221 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-fa43badd-3b6f-4d78-b0c4-c5a7ca2bcd61 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:59:15.078128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-fa43badd-3b6f-4d78-b0c4-c5a7ca2bcd61 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:59:15.081585 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:59:15.082391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:59:15.090299 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa43badd-3b6f-4d78-b0c4-c5a7ca2bcd61 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:15.090803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa43badd-3b6f-4d78-b0c4-c5a7ca2bcd61 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:15.091249 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa43badd-3b6f-4d78-b0c4-c5a7ca2bcd61 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:15.091993 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa43badd-3b6f-4d78-b0c4-c5a7ca2bcd61 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:15.092459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa43badd-3b6f-4d78-b0c4-c5a7ca2bcd61 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:15.092910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-fa43badd-3b6f-4d78-b0c4-c5a7ca2bcd61 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:15.253964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-fa43badd-3b6f-4d78-b0c4-c5a7ca2bcd61 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:59:15.264228 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-fa43badd-3b6f-4d78-b0c4-c5a7ca2bcd61 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1692 microversion: 2.1 time: 0.191584 Sep 07 13:59:15.264922 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3794/7613] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:59:15 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1692 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:59:16.293974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8ec29c57-0afd-4051-af18-82a46a4450aa tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:59:16.294714 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8ec29c57-0afd-4051-af18-82a46a4450aa tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:59:16.301854 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ec29c57-0afd-4051-af18-82a46a4450aa tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:16.302373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ec29c57-0afd-4051-af18-82a46a4450aa tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:16.302825 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ec29c57-0afd-4051-af18-82a46a4450aa tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:16.303568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ec29c57-0afd-4051-af18-82a46a4450aa tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:16.304070 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ec29c57-0afd-4051-af18-82a46a4450aa tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:16.304517 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8ec29c57-0afd-4051-af18-82a46a4450aa tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:16.461598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8ec29c57-0afd-4051-af18-82a46a4450aa tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:59:16.470374 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8ec29c57-0afd-4051-af18-82a46a4450aa tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1692 microversion: 2.1 time: 0.182105 Sep 07 13:59:16.471383 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3820/7614] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:59:16 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1692 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 13:59:17.495131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-15d670b1-365e-4ed4-b98b-e2059fce51db tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:59:17.495765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-15d670b1-365e-4ed4-b98b-e2059fce51db tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:59:17.505911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15d670b1-365e-4ed4-b98b-e2059fce51db tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:17.506799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15d670b1-365e-4ed4-b98b-e2059fce51db tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:17.507324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15d670b1-365e-4ed4-b98b-e2059fce51db tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:17.508297 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15d670b1-365e-4ed4-b98b-e2059fce51db tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:17.508799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15d670b1-365e-4ed4-b98b-e2059fce51db tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:17.509255 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-15d670b1-365e-4ed4-b98b-e2059fce51db tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:17.652351 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-15d670b1-365e-4ed4-b98b-e2059fce51db tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:59:17.663981 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-15d670b1-365e-4ed4-b98b-e2059fce51db tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1692 microversion: 2.1 time: 0.172859 Sep 07 13:59:17.664929 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3795/7615] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:59:17 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1692 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:59:18.690549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-482eedb9-4835-4855-8172-d77f5ceeeef2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:59:18.691207 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-482eedb9-4835-4855-8172-d77f5ceeeef2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:59:18.699574 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-482eedb9-4835-4855-8172-d77f5ceeeef2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:18.700094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-482eedb9-4835-4855-8172-d77f5ceeeef2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:18.700550 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-482eedb9-4835-4855-8172-d77f5ceeeef2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:18.701562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-482eedb9-4835-4855-8172-d77f5ceeeef2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:18.702176 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-482eedb9-4835-4855-8172-d77f5ceeeef2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:18.702626 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-482eedb9-4835-4855-8172-d77f5ceeeef2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:18.872507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-482eedb9-4835-4855-8172-d77f5ceeeef2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:59:18.882556 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-482eedb9-4835-4855-8172-d77f5ceeeef2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1692 microversion: 2.1 time: 0.196258 Sep 07 13:59:18.883306 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3821/7616] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:59:18 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1692 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:59:19.907604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b8a4340d-d05f-4ffe-87b5-17a879403750 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:59:19.908254 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b8a4340d-d05f-4ffe-87b5-17a879403750 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:59:19.915839 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8a4340d-d05f-4ffe-87b5-17a879403750 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:19.916375 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8a4340d-d05f-4ffe-87b5-17a879403750 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:19.916831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8a4340d-d05f-4ffe-87b5-17a879403750 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:19.917590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8a4340d-d05f-4ffe-87b5-17a879403750 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:19.918059 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8a4340d-d05f-4ffe-87b5-17a879403750 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:19.918495 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8a4340d-d05f-4ffe-87b5-17a879403750 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:20.064966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b8a4340d-d05f-4ffe-87b5-17a879403750 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:59:20.073873 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b8a4340d-d05f-4ffe-87b5-17a879403750 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1692 microversion: 2.1 time: 0.170429 Sep 07 13:59:20.074464 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3796/7617] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:59:19 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:59:21.099965 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f49064ea-1845-4bc6-9d87-b169aa399dc2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:59:21.100554 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f49064ea-1845-4bc6-9d87-b169aa399dc2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:59:21.108529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f49064ea-1845-4bc6-9d87-b169aa399dc2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:21.109202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f49064ea-1845-4bc6-9d87-b169aa399dc2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:21.109779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f49064ea-1845-4bc6-9d87-b169aa399dc2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:21.110520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f49064ea-1845-4bc6-9d87-b169aa399dc2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:21.111002 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f49064ea-1845-4bc6-9d87-b169aa399dc2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:21.111454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f49064ea-1845-4bc6-9d87-b169aa399dc2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:21.257180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f49064ea-1845-4bc6-9d87-b169aa399dc2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:59:21.265871 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f49064ea-1845-4bc6-9d87-b169aa399dc2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1692 microversion: 2.1 time: 0.170132 Sep 07 13:59:21.266441 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3822/7618] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:59:21 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:59:22.293955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6bc996d4-389f-4df4-89d9-efe209cb7e50 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:59:22.294542 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6bc996d4-389f-4df4-89d9-efe209cb7e50 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:59:22.303589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bc996d4-389f-4df4-89d9-efe209cb7e50 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:22.304102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bc996d4-389f-4df4-89d9-efe209cb7e50 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:22.304540 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bc996d4-389f-4df4-89d9-efe209cb7e50 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:22.305239 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bc996d4-389f-4df4-89d9-efe209cb7e50 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:22.305718 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bc996d4-389f-4df4-89d9-efe209cb7e50 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:22.306146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6bc996d4-389f-4df4-89d9-efe209cb7e50 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:22.454173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6bc996d4-389f-4df4-89d9-efe209cb7e50 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:59:22.463330 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6bc996d4-389f-4df4-89d9-efe209cb7e50 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1692 microversion: 2.1 time: 0.176083 Sep 07 13:59:22.463908 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3797/7619] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:59:22 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:59:23.490145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a7d1d2f5-31cb-4a6c-8aeb-df1bc9dc9a9b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:59:23.490785 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a7d1d2f5-31cb-4a6c-8aeb-df1bc9dc9a9b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:59:23.498122 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7d1d2f5-31cb-4a6c-8aeb-df1bc9dc9a9b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:23.498645 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7d1d2f5-31cb-4a6c-8aeb-df1bc9dc9a9b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:23.499102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7d1d2f5-31cb-4a6c-8aeb-df1bc9dc9a9b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:23.499823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7d1d2f5-31cb-4a6c-8aeb-df1bc9dc9a9b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:23.500327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7d1d2f5-31cb-4a6c-8aeb-df1bc9dc9a9b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:23.500770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a7d1d2f5-31cb-4a6c-8aeb-df1bc9dc9a9b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:23.651028 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a7d1d2f5-31cb-4a6c-8aeb-df1bc9dc9a9b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:59:23.659411 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a7d1d2f5-31cb-4a6c-8aeb-df1bc9dc9a9b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1692 microversion: 2.1 time: 0.173861 Sep 07 13:59:23.660276 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3823/7620] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:59:23 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1692 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:59:24.687808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6cd68fa3-21a5-42b0-9cb3-587c75596ad6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:59:24.688521 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6cd68fa3-21a5-42b0-9cb3-587c75596ad6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:59:24.695804 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cd68fa3-21a5-42b0-9cb3-587c75596ad6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:24.696321 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cd68fa3-21a5-42b0-9cb3-587c75596ad6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:24.696764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cd68fa3-21a5-42b0-9cb3-587c75596ad6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:24.697498 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cd68fa3-21a5-42b0-9cb3-587c75596ad6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:24.697972 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cd68fa3-21a5-42b0-9cb3-587c75596ad6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:24.698400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cd68fa3-21a5-42b0-9cb3-587c75596ad6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:24.852034 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6cd68fa3-21a5-42b0-9cb3-587c75596ad6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:59:24.861955 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6cd68fa3-21a5-42b0-9cb3-587c75596ad6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1692 microversion: 2.1 time: 0.178411 Sep 07 13:59:24.862553 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3798/7621] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:59:24 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1692 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:59:25.886784 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5e8ec592-5b6b-4198-9106-9770b4df1257 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:59:25.887419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5e8ec592-5b6b-4198-9106-9770b4df1257 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:59:25.895372 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e8ec592-5b6b-4198-9106-9770b4df1257 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:25.895894 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e8ec592-5b6b-4198-9106-9770b4df1257 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:25.896365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e8ec592-5b6b-4198-9106-9770b4df1257 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:25.897099 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e8ec592-5b6b-4198-9106-9770b4df1257 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:25.897605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e8ec592-5b6b-4198-9106-9770b4df1257 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:25.898057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e8ec592-5b6b-4198-9106-9770b4df1257 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:26.039529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5e8ec592-5b6b-4198-9106-9770b4df1257 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:59:26.052006 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5e8ec592-5b6b-4198-9106-9770b4df1257 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1669 microversion: 2.1 time: 0.169314 Sep 07 13:59:26.052614 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3824/7622] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:59:25 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1669 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:59:27.160955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-48c1cc39-55e3-467a-91d3-e97c4e8aeba2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:59:27.163223 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-48c1cc39-55e3-467a-91d3-e97c4e8aeba2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:59:27.170623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48c1cc39-55e3-467a-91d3-e97c4e8aeba2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:27.171123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48c1cc39-55e3-467a-91d3-e97c4e8aeba2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:27.171609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48c1cc39-55e3-467a-91d3-e97c4e8aeba2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:27.172286 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48c1cc39-55e3-467a-91d3-e97c4e8aeba2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:27.172749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48c1cc39-55e3-467a-91d3-e97c4e8aeba2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:27.173184 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-48c1cc39-55e3-467a-91d3-e97c4e8aeba2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:27.238265 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-48c1cc39-55e3-467a-91d3-e97c4e8aeba2 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064/action" status: 200 len: 38412 microversion: 2.1 time: 0.081291 Sep 07 13:59:27.238989 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3799/7623] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:59:27 2022] POST /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064/action => generated 38412 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 13:59:27.255307 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d060a930-a487-45b1-b736-5bb47a8a56b8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:59:27.262841 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d060a930-a487-45b1-b736-5bb47a8a56b8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:27.263362 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d060a930-a487-45b1-b736-5bb47a8a56b8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:27.263828 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d060a930-a487-45b1-b736-5bb47a8a56b8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:27.291038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d060a930-a487-45b1-b736-5bb47a8a56b8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Going to try to start instance {{(pid=122433) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 13:59:27.338287 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d060a930-a487-45b1-b736-5bb47a8a56b8 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064/action" status: 202 len: 0 microversion: 2.1 time: 0.086931 Sep 07 13:59:27.338972 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3825/7624] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:59:27 2022] POST /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 13:59:27.348592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f8dd2312-665f-4713-89c9-2d487e94a305 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:59:27.349324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f8dd2312-665f-4713-89c9-2d487e94a305 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:59:27.359656 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8dd2312-665f-4713-89c9-2d487e94a305 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:27.360268 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8dd2312-665f-4713-89c9-2d487e94a305 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:27.360736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8dd2312-665f-4713-89c9-2d487e94a305 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:27.361463 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8dd2312-665f-4713-89c9-2d487e94a305 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:27.361961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8dd2312-665f-4713-89c9-2d487e94a305 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:27.362406 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8dd2312-665f-4713-89c9-2d487e94a305 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:27.563620 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f8dd2312-665f-4713-89c9-2d487e94a305 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:59:27.573172 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f8dd2312-665f-4713-89c9-2d487e94a305 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1678 microversion: 2.1 time: 0.229189 Sep 07 13:59:27.573798 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3800/7625] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:59:27 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1678 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:59:28.600069 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-edf19f82-ee89-4bfa-bfc1-6f1f623ac58f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:59:28.600824 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-edf19f82-ee89-4bfa-bfc1-6f1f623ac58f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:59:28.609374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edf19f82-ee89-4bfa-bfc1-6f1f623ac58f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:28.610405 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edf19f82-ee89-4bfa-bfc1-6f1f623ac58f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:28.611072 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edf19f82-ee89-4bfa-bfc1-6f1f623ac58f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:28.612298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edf19f82-ee89-4bfa-bfc1-6f1f623ac58f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:28.612833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edf19f82-ee89-4bfa-bfc1-6f1f623ac58f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:28.613392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-edf19f82-ee89-4bfa-bfc1-6f1f623ac58f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:28.769760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-edf19f82-ee89-4bfa-bfc1-6f1f623ac58f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:59:28.778965 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-edf19f82-ee89-4bfa-bfc1-6f1f623ac58f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1678 microversion: 2.1 time: 0.184578 Sep 07 13:59:28.779558 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3826/7626] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:59:28 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:59:29.802625 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bcf9dd90-2496-4286-998f-87a0955e9a4b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 13:59:29.803334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bcf9dd90-2496-4286-998f-87a0955e9a4b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:59:29.811577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcf9dd90-2496-4286-998f-87a0955e9a4b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:29.812086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcf9dd90-2496-4286-998f-87a0955e9a4b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:29.812529 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcf9dd90-2496-4286-998f-87a0955e9a4b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:29.813247 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcf9dd90-2496-4286-998f-87a0955e9a4b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:29.813741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcf9dd90-2496-4286-998f-87a0955e9a4b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:29.814172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bcf9dd90-2496-4286-998f-87a0955e9a4b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:29.956386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bcf9dd90-2496-4286-998f-87a0955e9a4b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 13:59:29.965470 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bcf9dd90-2496-4286-998f-87a0955e9a4b tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1682 microversion: 2.1 time: 0.166795 Sep 07 13:59:29.966513 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3801/7627] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 13:59:29 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 13:59:54.171542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cdf231ce-a141-4176-8b23-2fa4cea2c777 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 13:59:54.174742 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cdf231ce-a141-4176-8b23-2fa4cea2c777 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 13:59:54.178762 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=16 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:59:54.179691 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:59:54.189926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdf231ce-a141-4176-8b23-2fa4cea2c777 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:54.190521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdf231ce-a141-4176-8b23-2fa4cea2c777 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:54.191144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdf231ce-a141-4176-8b23-2fa4cea2c777 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:54.192069 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdf231ce-a141-4176-8b23-2fa4cea2c777 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 13:59:54.192541 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdf231ce-a141-4176-8b23-2fa4cea2c777 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 13:59:54.192985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cdf231ce-a141-4176-8b23-2fa4cea2c777 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 13:59:54.271226 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cdf231ce-a141-4176-8b23-2fa4cea2c777 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064/action" status: 200 len: 62972 microversion: 2.1 time: 0.103686 Sep 07 13:59:54.271928 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3827/7628] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 13:59:54 2022] POST /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064/action => generated 62972 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 14:00:01.359713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-e7458c5f-fdb6-4a10-a28f-388c59a31c22 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:00:01.360269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e7458c5f-fdb6-4a10-a28f-388c59a31c22 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:00:01.362937 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-b706a2c8-9c38-463f-ba1e-bd866d50a8ce req-b13919bb-7b2f-48b4-86ae-bb89f3a32d70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e68ff602-190d-4cca-8a83-e90614a2e064", "tag": "941f2532-42f1-4222-bb72-3c7e26fb92ff"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:00:01.363470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=16 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:00:01.363657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=46 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:00:01.365276 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 14:00:01.365453 n-d-852087-9 devstack@n-api.service[122432]: Wed Sep 7 14:00:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 (ip 10.222.0.16) !!! Sep 07 14:00:01.376533 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b706a2c8-9c38-463f-ba1e-bd866d50a8ce req-b13919bb-7b2f-48b4-86ae-bb89f3a32d70 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:01.377135 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b706a2c8-9c38-463f-ba1e-bd866d50a8ce req-b13919bb-7b2f-48b4-86ae-bb89f3a32d70 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:01.377689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-b706a2c8-9c38-463f-ba1e-bd866d50a8ce req-b13919bb-7b2f-48b4-86ae-bb89f3a32d70 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:01.380887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7458c5f-fdb6-4a10-a28f-388c59a31c22 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:01.381412 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7458c5f-fdb6-4a10-a28f-388c59a31c22 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:01.382826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7458c5f-fdb6-4a10-a28f-388c59a31c22 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:01.383182 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7458c5f-fdb6-4a10-a28f-388c59a31c22 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:01.383651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7458c5f-fdb6-4a10-a28f-388c59a31c22 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:01.385468 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-e7458c5f-fdb6-4a10-a28f-388c59a31c22 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:01.392918 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-b706a2c8-9c38-463f-ba1e-bd866d50a8ce req-b13919bb-7b2f-48b4-86ae-bb89f3a32d70 service nova] Creating event network-changed:941f2532-42f1-4222-bb72-3c7e26fb92ff for instance e68ff602-190d-4cca-8a83-e90614a2e064 on n-h2-852087-9 Sep 07 14:00:01.399318 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-b706a2c8-9c38-463f-ba1e-bd866d50a8ce req-b13919bb-7b2f-48b4-86ae-bb89f3a32d70 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041068 Sep 07 14:00:01.400430 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3828/7629] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:00:01.416910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-e7458c5f-fdb6-4a10-a28f-388c59a31c22 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:00:01.514834 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-e7458c5f-fdb6-4a10-a28f-388c59a31c22 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 204 len: 0 microversion: 2.1 time: 0.158115 Sep 07 14:00:01.515480 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3802/7630] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 14:00:01 2022] DELETE /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 14:00:01.525116 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8563278e-3a28-40b5-ac13-a5af8717a784 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:00:01.526008 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8563278e-3a28-40b5-ac13-a5af8717a784 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:00:01.533257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8563278e-3a28-40b5-ac13-a5af8717a784 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:01.533772 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8563278e-3a28-40b5-ac13-a5af8717a784 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:01.534258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8563278e-3a28-40b5-ac13-a5af8717a784 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:01.535140 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8563278e-3a28-40b5-ac13-a5af8717a784 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:01.535644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8563278e-3a28-40b5-ac13-a5af8717a784 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:01.536142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8563278e-3a28-40b5-ac13-a5af8717a784 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:01.683799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8563278e-3a28-40b5-ac13-a5af8717a784 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:00:01.693024 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8563278e-3a28-40b5-ac13-a5af8717a784 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1688 microversion: 2.1 time: 0.172755 Sep 07 14:00:01.693628 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3829/7631] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:00:01 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:00:02.720528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ff26d8e8-7498-4609-ba68-554d3e66d604 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:00:02.721509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ff26d8e8-7498-4609-ba68-554d3e66d604 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:00:02.728681 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff26d8e8-7498-4609-ba68-554d3e66d604 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:02.729169 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff26d8e8-7498-4609-ba68-554d3e66d604 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:02.729644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff26d8e8-7498-4609-ba68-554d3e66d604 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:02.730311 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff26d8e8-7498-4609-ba68-554d3e66d604 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:02.730787 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff26d8e8-7498-4609-ba68-554d3e66d604 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:02.731212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ff26d8e8-7498-4609-ba68-554d3e66d604 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:02.936665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ff26d8e8-7498-4609-ba68-554d3e66d604 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:00:02.947312 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ff26d8e8-7498-4609-ba68-554d3e66d604 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1688 microversion: 2.1 time: 0.230980 Sep 07 14:00:02.948343 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3803/7632] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:00:02 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1688 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:00:03.674214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-e69de798-b873-455c-861f-64e947b4e9b7 req-be6b107d-641d-4c69-9a77-c74da75224f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e68ff602-190d-4cca-8a83-e90614a2e064", "name": "network-vif-deleted", "tag": "941f2532-42f1-4222-bb72-3c7e26fb92ff"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:00:03.688806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e69de798-b873-455c-861f-64e947b4e9b7 req-be6b107d-641d-4c69-9a77-c74da75224f3 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:03.689402 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e69de798-b873-455c-861f-64e947b4e9b7 req-be6b107d-641d-4c69-9a77-c74da75224f3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:03.689942 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e69de798-b873-455c-861f-64e947b4e9b7 req-be6b107d-641d-4c69-9a77-c74da75224f3 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:03.702815 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-e69de798-b873-455c-861f-64e947b4e9b7 req-be6b107d-641d-4c69-9a77-c74da75224f3 service nova] Creating event network-vif-deleted:941f2532-42f1-4222-bb72-3c7e26fb92ff for instance e68ff602-190d-4cca-8a83-e90614a2e064 on n-h2-852087-9 Sep 07 14:00:03.708572 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-e69de798-b873-455c-861f-64e947b4e9b7 req-be6b107d-641d-4c69-9a77-c74da75224f3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039303 Sep 07 14:00:03.709193 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3830/7633] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:00:03.985000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6cbb0f6d-75d2-413f-9454-8525f6e92e3f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:00:03.985767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6cbb0f6d-75d2-413f-9454-8525f6e92e3f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:00:03.993651 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cbb0f6d-75d2-413f-9454-8525f6e92e3f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:03.994237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cbb0f6d-75d2-413f-9454-8525f6e92e3f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:03.994807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cbb0f6d-75d2-413f-9454-8525f6e92e3f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:03.995573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cbb0f6d-75d2-413f-9454-8525f6e92e3f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:03.996180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cbb0f6d-75d2-413f-9454-8525f6e92e3f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:03.996683 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cbb0f6d-75d2-413f-9454-8525f6e92e3f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:04.031964 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cbb0f6d-75d2-413f-9454-8525f6e92e3f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:04.032455 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cbb0f6d-75d2-413f-9454-8525f6e92e3f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:04.032918 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6cbb0f6d-75d2-413f-9454-8525f6e92e3f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:04.033398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-6cbb0f6d-75d2-413f-9454-8525f6e92e3f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lazy-loading 'fault' on Instance uuid e68ff602-190d-4cca-8a83-e90614a2e064 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:00:04.081652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6cbb0f6d-75d2-413f-9454-8525f6e92e3f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:00:04.090156 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6cbb0f6d-75d2-413f-9454-8525f6e92e3f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 200 len: 1356 microversion: 2.1 time: 0.109344 Sep 07 14:00:04.090776 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3804/7634] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:00:03 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 1356 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:00:05.116454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-290a02c7-b15c-4c36-be8a-993a7aae244f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:00:05.117145 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-290a02c7-b15c-4c36-be8a-993a7aae244f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: e68ff602-190d-4cca-8a83-e90614a2e064] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:00:05.124437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-290a02c7-b15c-4c36-be8a-993a7aae244f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:05.124982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-290a02c7-b15c-4c36-be8a-993a7aae244f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:05.125423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-290a02c7-b15c-4c36-be8a-993a7aae244f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:05.126206 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-290a02c7-b15c-4c36-be8a-993a7aae244f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:05.126747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-290a02c7-b15c-4c36-be8a-993a7aae244f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:05.127205 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-290a02c7-b15c-4c36-be8a-993a7aae244f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:05.141589 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-290a02c7-b15c-4c36-be8a-993a7aae244f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] HTTP exception thrown: Instance e68ff602-190d-4cca-8a83-e90614a2e064 could not be found. Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-290a02c7-b15c-4c36-be8a-993a7aae244f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Request method failure captured: Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 HTTP/1.1 Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGKJIpRj4dUoVYAzI48MspU8ZelpD30GGZSMNBLAcJjfPqrRwz5SflK5ZGsGmdXzaRhezwINOX9bACqNviUzYHhK5j_TepIiCI-ydksrX2YrwyvVjX0oRIdw2hFrTIsMr6gjr_5dekqg_MtjlByIh9B6o0NyhZw8LTWA2pkGzjxBAu_s Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 8f56cfdac7bd4768b54690ce5afe8854 Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-901687866 Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f56cfdac7bd4768b54690ce5afe8854"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f56cfdac7bd4768b54690ce5afe8854"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f56cfdac7bd4768b54690ce5afe8854"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f56cfdac7bd4768b54690ce5afe8854"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TestNetworkAdvancedServerOps-901687866 Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 8f56cfdac7bd4768b54690ce5afe8854 Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-901687866 Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TestNetworkAdvancedServerOps-901687866-project Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 9dce2997e6c6461db3bae9e9c3315d8b Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TestNetworkAdvancedServerOps-901687866-project Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance e68ff602-190d-4cca-8a83-e90614a2e064 could not be found. Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'e68ff602-190d-4cca-8a83-e90614a2e064'} Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e68ff602-190d-4cca-8a83-e90614a2e064 could not be found. Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e68ff602-190d-4cca-8a83-e90614a2e064 could not be found. Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 14:00:05.143340 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:00:05.148272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 14:00:05.148272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:00:05.148272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:00:05.148272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:00:05.148272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:00:05.148272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:00:05.148272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e68ff602-190d-4cca-8a83-e90614a2e064 could not be found. Sep 07 14:00:05.148272 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 14:00:05.148272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-290a02c7-b15c-4c36-be8a-993a7aae244f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Returning 404 to user: Instance e68ff602-190d-4cca-8a83-e90614a2e064 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:00:05.148272 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-290a02c7-b15c-4c36-be8a-993a7aae244f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064" status: 404 len: 111 microversion: 2.1 time: 0.033743 Sep 07 14:00:05.148272 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3831/7635] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:00:05 2022] GET /compute/v2.1/servers/e68ff602-190d-4cca-8a83-e90614a2e064 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:00:08.576495 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-91f207fe-3425-44d9-afc0-ef95d06de883 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '.version_select at 0x7fc41d252f70>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:00:08.607469 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-91f207fe-3425-44d9-afc0-ef95d06de883 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2057132818" status: 202 len: 0 microversion: 2.1 time: 0.034921 Sep 07 14:00:08.611033 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3805/7636] 10.222.0.16 () {58 vars in 1284 bytes} [Wed Sep 7 14:00:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2057132818 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:00:08.641791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c72ccebe-5489-4c4f-a274-e9c06eb3696d tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'create', calling method: .version_select at 0x7fc418243f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1629777685", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5jZCplB75+OLzjuoO6rDUnqsc9H7mYNuKMeF4GNbF93ku+I9dQXq9LamGO9NydTuVth9sZnMEwpW9hIhBLZRM8vfIFY5e+A3wZUSNPpcLFLbXJjggtKasLzkDTSRCB5g=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:00:08.660760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-c72ccebe-5489-4c4f-a274-e9c06eb3696d tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Getting quotas for project 8f56cfdac7bd4768b54690ce5afe8854. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:00:08.666681 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-c72ccebe-5489-4c4f-a274-e9c06eb3696d tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Getting quotas for user 9dce2997e6c6461db3bae9e9c3315d8b and project 8f56cfdac7bd4768b54690ce5afe8854. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:00:08.695478 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c72ccebe-5489-4c4f-a274-e9c06eb3696d tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.057744 Sep 07 14:00:08.696090 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3832/7637] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 14:00:08 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:00:14.987524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:00:14.993277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1b192613-2405-48c6-8a74-c59d5f4f74d9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-532005393", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "networks": [{"uuid": "4caa0cea-8f3b-43ae-bb08-de892b49ee7e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1629777685", "security_groups": [{"name": "tempest-secgroup-smoke-610515667"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:00:15.161477 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-1b192613-2405-48c6-8a74-c59d5f4f74d9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] validate_networks() for [('4caa0cea-8f3b-43ae-bb08-de892b49ee7e', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 14:00:15.748178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-1b192613-2405-48c6-8a74-c59d5f4f74d9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 14:00:15.748695 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-1b192613-2405-48c6-8a74-c59d5f4f74d9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 14:00:15.749571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-1b192613-2405-48c6-8a74-c59d5f4f74d9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 14:00:15.750144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-1b192613-2405-48c6-8a74-c59d5f4f74d9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 14:00:15.750591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-1b192613-2405-48c6-8a74-c59d5f4f74d9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 14:00:15.765007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b192613-2405-48c6-8a74-c59d5f4f74d9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:15.765432 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b192613-2405-48c6-8a74-c59d5f4f74d9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:15.766186 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b192613-2405-48c6-8a74-c59d5f4f74d9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:15.767022 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b192613-2405-48c6-8a74-c59d5f4f74d9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:15.768743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b192613-2405-48c6-8a74-c59d5f4f74d9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:15.770006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1b192613-2405-48c6-8a74-c59d5f4f74d9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:15.800770 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-1b192613-2405-48c6-8a74-c59d5f4f74d9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Getting quotas for project 8f56cfdac7bd4768b54690ce5afe8854. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:00:15.807118 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-1b192613-2405-48c6-8a74-c59d5f4f74d9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Getting quotas for user 9dce2997e6c6461db3bae9e9c3315d8b and project 8f56cfdac7bd4768b54690ce5afe8854. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:00:15.822056 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1b192613-2405-48c6-8a74-c59d5f4f74d9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 14:00:15.824544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1b192613-2405-48c6-8a74-c59d5f4f74d9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 14:00:15.880254 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1b192613-2405-48c6-8a74-c59d5f4f74d9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.894663 Sep 07 14:00:15.881595 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3806/7638] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 14:00:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 14:00:15.893296 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=16 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:00:15.903480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-909a20ae-43c5-4761-8e5c-cf2ad684dd35 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:00:15.904718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-909a20ae-43c5-4761-8e5c-cf2ad684dd35 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:00:15.973022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-909a20ae-43c5-4761-8e5c-cf2ad684dd35 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:00:15.981432 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-909a20ae-43c5-4761-8e5c-cf2ad684dd35 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6" status: 200 len: 1266 microversion: 2.1 time: 0.089993 Sep 07 14:00:15.982072 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3833/7639] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:00:15 2022] GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:00:17.005882 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-566fe4a8-662c-4899-93d8-8e440f4fa40a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:00:17.006531 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-566fe4a8-662c-4899-93d8-8e440f4fa40a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:00:17.069634 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-566fe4a8-662c-4899-93d8-8e440f4fa40a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:00:17.079568 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-566fe4a8-662c-4899-93d8-8e440f4fa40a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6" status: 200 len: 1266 microversion: 2.1 time: 0.078150 Sep 07 14:00:17.080232 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3807/7640] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:00:16 2022] GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 => generated 1266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:00:18.103622 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-78aff6b0-f8b1-4fb8-a1e7-9e0d1290489e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:00:18.104382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-78aff6b0-f8b1-4fb8-a1e7-9e0d1290489e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:00:18.182526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-78aff6b0-f8b1-4fb8-a1e7-9e0d1290489e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:00:18.190351 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-78aff6b0-f8b1-4fb8-a1e7-9e0d1290489e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6" status: 200 len: 1266 microversion: 2.1 time: 0.090650 Sep 07 14:00:18.197006 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3834/7641] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:00:18 2022] GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:00:19.213937 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4b354d7c-d7dc-42c9-bb8e-b942122b6923 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:00:19.214667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4b354d7c-d7dc-42c9-bb8e-b942122b6923 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:00:19.288358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4b354d7c-d7dc-42c9-bb8e-b942122b6923 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:00:19.298726 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4b354d7c-d7dc-42c9-bb8e-b942122b6923 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6" status: 200 len: 1266 microversion: 2.1 time: 0.088901 Sep 07 14:00:19.309928 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3808/7642] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:00:19 2022] GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:00:20.328928 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-282da29e-2f8b-4079-9a2c-ecd2cbea3825 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:00:20.331906 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-282da29e-2f8b-4079-9a2c-ecd2cbea3825 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:00:20.343572 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-282da29e-2f8b-4079-9a2c-ecd2cbea3825 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:20.344178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-282da29e-2f8b-4079-9a2c-ecd2cbea3825 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:20.345098 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-282da29e-2f8b-4079-9a2c-ecd2cbea3825 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:20.346477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-282da29e-2f8b-4079-9a2c-ecd2cbea3825 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:20.347053 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-282da29e-2f8b-4079-9a2c-ecd2cbea3825 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:20.347795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-282da29e-2f8b-4079-9a2c-ecd2cbea3825 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:20.426306 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-282da29e-2f8b-4079-9a2c-ecd2cbea3825 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:00:20.435672 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-282da29e-2f8b-4079-9a2c-ecd2cbea3825 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6" status: 200 len: 1336 microversion: 2.1 time: 0.114728 Sep 07 14:00:20.437526 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3835/7643] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:00:20 2022] GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 => generated 1336 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:00:21.460259 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a92d4fbf-f1c6-4b08-9495-6e158eb75246 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:00:21.460876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a92d4fbf-f1c6-4b08-9495-6e158eb75246 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:00:21.468974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a92d4fbf-f1c6-4b08-9495-6e158eb75246 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:21.469507 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a92d4fbf-f1c6-4b08-9495-6e158eb75246 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:21.469954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a92d4fbf-f1c6-4b08-9495-6e158eb75246 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:21.470973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a92d4fbf-f1c6-4b08-9495-6e158eb75246 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:21.471435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a92d4fbf-f1c6-4b08-9495-6e158eb75246 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:21.471866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a92d4fbf-f1c6-4b08-9495-6e158eb75246 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:21.624567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a92d4fbf-f1c6-4b08-9495-6e158eb75246 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:00:21.633650 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a92d4fbf-f1c6-4b08-9495-6e158eb75246 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6" status: 200 len: 1391 microversion: 2.1 time: 0.177572 Sep 07 14:00:21.634355 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3809/7644] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:00:21 2022] GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:00:21.854924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-aa884233-8587-4a51-ab24-2fcdd6a3a746 req-b4eecf92-2f1a-4a4a-be62-b8a010af4b0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fb79c3d-520a-48cc-9a1c-eaa96467b0a6", "tag": "da1bb9f5-cb9f-4423-b416-ee6c4d428a9f"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:00:21.872066 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-aa884233-8587-4a51-ab24-2fcdd6a3a746 req-b4eecf92-2f1a-4a4a-be62-b8a010af4b0e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:21.872900 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-aa884233-8587-4a51-ab24-2fcdd6a3a746 req-b4eecf92-2f1a-4a4a-be62-b8a010af4b0e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:21.873642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-aa884233-8587-4a51-ab24-2fcdd6a3a746 req-b4eecf92-2f1a-4a4a-be62-b8a010af4b0e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:21.887804 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-aa884233-8587-4a51-ab24-2fcdd6a3a746 req-b4eecf92-2f1a-4a4a-be62-b8a010af4b0e service nova] Creating event network-changed:da1bb9f5-cb9f-4423-b416-ee6c4d428a9f for instance 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 on n-h1-852087-9 Sep 07 14:00:21.899730 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-aa884233-8587-4a51-ab24-2fcdd6a3a746 req-b4eecf92-2f1a-4a4a-be62-b8a010af4b0e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050319 Sep 07 14:00:21.900673 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3836/7645] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:00:22.658349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5e2b658d-9654-4d49-8058-15c850e4f119 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:00:22.658971 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5e2b658d-9654-4d49-8058-15c850e4f119 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:00:22.667073 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e2b658d-9654-4d49-8058-15c850e4f119 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:22.667575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e2b658d-9654-4d49-8058-15c850e4f119 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:22.668159 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e2b658d-9654-4d49-8058-15c850e4f119 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:22.668906 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e2b658d-9654-4d49-8058-15c850e4f119 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:22.669512 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e2b658d-9654-4d49-8058-15c850e4f119 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:22.669958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e2b658d-9654-4d49-8058-15c850e4f119 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:22.836619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5e2b658d-9654-4d49-8058-15c850e4f119 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:00:22.845221 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5e2b658d-9654-4d49-8058-15c850e4f119 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6" status: 200 len: 1391 microversion: 2.1 time: 0.191077 Sep 07 14:00:22.846181 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3810/7646] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:00:22 2022] GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 => generated 1391 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:00:23.870207 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-96e61a15-f141-497b-a9db-82d91396a319 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:00:23.870969 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-96e61a15-f141-497b-a9db-82d91396a319 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:00:23.877621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96e61a15-f141-497b-a9db-82d91396a319 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:23.878149 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96e61a15-f141-497b-a9db-82d91396a319 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:23.878610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96e61a15-f141-497b-a9db-82d91396a319 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:23.879337 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96e61a15-f141-497b-a9db-82d91396a319 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:23.879818 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96e61a15-f141-497b-a9db-82d91396a319 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:23.880267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96e61a15-f141-497b-a9db-82d91396a319 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:24.030882 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-96e61a15-f141-497b-a9db-82d91396a319 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:00:24.039315 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-96e61a15-f141-497b-a9db-82d91396a319 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6" status: 200 len: 1391 microversion: 2.1 time: 0.174340 Sep 07 14:00:24.039912 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3837/7647] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:00:23 2022] GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:00:25.063348 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8eab161d-f7f4-41cf-9c6a-11517033ad0e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:00:25.064000 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8eab161d-f7f4-41cf-9c6a-11517033ad0e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:00:25.071605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8eab161d-f7f4-41cf-9c6a-11517033ad0e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:25.072096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8eab161d-f7f4-41cf-9c6a-11517033ad0e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:25.072535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8eab161d-f7f4-41cf-9c6a-11517033ad0e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:25.073244 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8eab161d-f7f4-41cf-9c6a-11517033ad0e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:25.073748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8eab161d-f7f4-41cf-9c6a-11517033ad0e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:25.074180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8eab161d-f7f4-41cf-9c6a-11517033ad0e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:25.219352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8eab161d-f7f4-41cf-9c6a-11517033ad0e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:00:25.228787 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8eab161d-f7f4-41cf-9c6a-11517033ad0e tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6" status: 200 len: 1391 microversion: 2.1 time: 0.169692 Sep 07 14:00:25.229379 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3811/7648] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:00:25 2022] GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:00:26.384852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-31682793-6e00-450e-b793-aee4e7937e38 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:00:26.385506 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-31682793-6e00-450e-b793-aee4e7937e38 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:00:26.388644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:00:26.394908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31682793-6e00-450e-b793-aee4e7937e38 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:26.395432 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31682793-6e00-450e-b793-aee4e7937e38 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:26.395868 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31682793-6e00-450e-b793-aee4e7937e38 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:26.396606 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31682793-6e00-450e-b793-aee4e7937e38 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:26.397103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31682793-6e00-450e-b793-aee4e7937e38 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:26.397581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-31682793-6e00-450e-b793-aee4e7937e38 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:26.582566 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-31682793-6e00-450e-b793-aee4e7937e38 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:00:26.593708 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-31682793-6e00-450e-b793-aee4e7937e38 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6" status: 200 len: 1391 microversion: 2.1 time: 0.212343 Sep 07 14:00:26.594833 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3838/7649] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:00:26 2022] GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 => generated 1391 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:00:27.628576 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-13214795-6137-4429-95a4-49bdc32e6c56 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:00:27.629398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-13214795-6137-4429-95a4-49bdc32e6c56 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:00:27.631955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:00:27.640207 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13214795-6137-4429-95a4-49bdc32e6c56 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:27.640705 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13214795-6137-4429-95a4-49bdc32e6c56 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:27.641155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13214795-6137-4429-95a4-49bdc32e6c56 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:27.641933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13214795-6137-4429-95a4-49bdc32e6c56 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:27.642384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13214795-6137-4429-95a4-49bdc32e6c56 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:27.642849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-13214795-6137-4429-95a4-49bdc32e6c56 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:27.804211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-13214795-6137-4429-95a4-49bdc32e6c56 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:00:27.816843 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-13214795-6137-4429-95a4-49bdc32e6c56 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6" status: 200 len: 1391 microversion: 2.1 time: 0.193873 Sep 07 14:00:27.817977 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3812/7650] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:00:27 2022] GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 => generated 1391 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:00:28.841859 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e055c3aa-7d33-4f91-a98e-104fc1cbe57a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:00:28.842720 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e055c3aa-7d33-4f91-a98e-104fc1cbe57a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:00:28.846004 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=8 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:00:28.853064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e055c3aa-7d33-4f91-a98e-104fc1cbe57a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:28.853778 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e055c3aa-7d33-4f91-a98e-104fc1cbe57a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:28.854525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e055c3aa-7d33-4f91-a98e-104fc1cbe57a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:28.855836 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e055c3aa-7d33-4f91-a98e-104fc1cbe57a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:28.856343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e055c3aa-7d33-4f91-a98e-104fc1cbe57a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:28.856817 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e055c3aa-7d33-4f91-a98e-104fc1cbe57a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:28.896733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-f10cdbc4-f855-47eb-869c-51f9fc9ea102 req-9ecd21b9-410f-4a34-aa9a-a3b75f67a972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb79c3d-520a-48cc-9a1c-eaa96467b0a6", "name": "network-vif-plugged", "status": "completed", "tag": "da1bb9f5-cb9f-4423-b416-ee6c4d428a9f"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:00:28.912581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f10cdbc4-f855-47eb-869c-51f9fc9ea102 req-9ecd21b9-410f-4a34-aa9a-a3b75f67a972 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:28.913181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f10cdbc4-f855-47eb-869c-51f9fc9ea102 req-9ecd21b9-410f-4a34-aa9a-a3b75f67a972 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:28.913727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f10cdbc4-f855-47eb-869c-51f9fc9ea102 req-9ecd21b9-410f-4a34-aa9a-a3b75f67a972 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:28.927473 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-f10cdbc4-f855-47eb-869c-51f9fc9ea102 req-9ecd21b9-410f-4a34-aa9a-a3b75f67a972 service nova] Creating event network-vif-plugged:da1bb9f5-cb9f-4423-b416-ee6c4d428a9f for instance 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 on n-h1-852087-9 Sep 07 14:00:28.935895 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-f10cdbc4-f855-47eb-869c-51f9fc9ea102 req-9ecd21b9-410f-4a34-aa9a-a3b75f67a972 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047482 Sep 07 14:00:28.936871 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3813/7651] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:00:29.033756 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e055c3aa-7d33-4f91-a98e-104fc1cbe57a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:00:29.042311 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e055c3aa-7d33-4f91-a98e-104fc1cbe57a tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6" status: 200 len: 1391 microversion: 2.1 time: 0.204594 Sep 07 14:00:29.042887 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3839/7652] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:00:28 2022] GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 => generated 1391 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:00:30.063793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=10 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:00:30.069932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-28efc258-d601-4734-8c07-8aaaf10e98bf tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:00:30.070983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-28efc258-d601-4734-8c07-8aaaf10e98bf tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:00:30.079205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28efc258-d601-4734-8c07-8aaaf10e98bf tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:30.079708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28efc258-d601-4734-8c07-8aaaf10e98bf tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:30.080141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28efc258-d601-4734-8c07-8aaaf10e98bf tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:30.080881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28efc258-d601-4734-8c07-8aaaf10e98bf tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:30.081339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28efc258-d601-4734-8c07-8aaaf10e98bf tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:30.081783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-28efc258-d601-4734-8c07-8aaaf10e98bf tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:30.258072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-28efc258-d601-4734-8c07-8aaaf10e98bf tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:00:30.267963 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-28efc258-d601-4734-8c07-8aaaf10e98bf tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6" status: 200 len: 1391 microversion: 2.1 time: 0.205027 Sep 07 14:00:30.268894 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3814/7653] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:00:30 2022] GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 => generated 1391 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:00:31.308234 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2cbf9f0a-fa1f-4bed-9916-3a846e86daf6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:00:31.309368 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2cbf9f0a-fa1f-4bed-9916-3a846e86daf6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:00:31.319138 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cbf9f0a-fa1f-4bed-9916-3a846e86daf6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:31.319998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cbf9f0a-fa1f-4bed-9916-3a846e86daf6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:31.320695 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cbf9f0a-fa1f-4bed-9916-3a846e86daf6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:31.321652 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cbf9f0a-fa1f-4bed-9916-3a846e86daf6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:31.322421 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cbf9f0a-fa1f-4bed-9916-3a846e86daf6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:31.323020 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2cbf9f0a-fa1f-4bed-9916-3a846e86daf6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:31.507852 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2cbf9f0a-fa1f-4bed-9916-3a846e86daf6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:00:31.522295 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2cbf9f0a-fa1f-4bed-9916-3a846e86daf6 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6" status: 200 len: 1563 microversion: 2.1 time: 0.218993 Sep 07 14:00:31.523388 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3840/7654] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:00:31 2022] GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 => generated 1563 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:00:31.551828 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-59a45592-0653-4a21-9272-c83fc99c3b76 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:00:31.552879 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-59a45592-0653-4a21-9272-c83fc99c3b76 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:00:31.557598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:00:31.567525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59a45592-0653-4a21-9272-c83fc99c3b76 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:31.568358 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59a45592-0653-4a21-9272-c83fc99c3b76 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:31.569096 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59a45592-0653-4a21-9272-c83fc99c3b76 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:31.570353 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59a45592-0653-4a21-9272-c83fc99c3b76 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:31.571178 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59a45592-0653-4a21-9272-c83fc99c3b76 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:31.571916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-59a45592-0653-4a21-9272-c83fc99c3b76 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:31.735058 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-59a45592-0653-4a21-9272-c83fc99c3b76 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:00:31.744250 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-59a45592-0653-4a21-9272-c83fc99c3b76 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6" status: 200 len: 1563 microversion: 2.1 time: 0.199846 Sep 07 14:00:31.744935 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3815/7655] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:00:31 2022] GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 => generated 1563 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:00:33.664812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-44a5e6a0-67db-4720-9038-c9a6747cf07c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:00:33.666596 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-44a5e6a0-67db-4720-9038-c9a6747cf07c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:00:33.675555 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-cdd957dc-3062-4c05-81e1-d70986668d9e req-c9569d83-fe2b-4c98-b6e4-c2f6ca859adf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fb79c3d-520a-48cc-9a1c-eaa96467b0a6", "tag": "da1bb9f5-cb9f-4423-b416-ee6c4d428a9f"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:00:33.676856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44a5e6a0-67db-4720-9038-c9a6747cf07c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:33.677757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44a5e6a0-67db-4720-9038-c9a6747cf07c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:33.678487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44a5e6a0-67db-4720-9038-c9a6747cf07c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:33.679822 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44a5e6a0-67db-4720-9038-c9a6747cf07c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:33.680577 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44a5e6a0-67db-4720-9038-c9a6747cf07c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:33.681323 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-44a5e6a0-67db-4720-9038-c9a6747cf07c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:33.691868 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cdd957dc-3062-4c05-81e1-d70986668d9e req-c9569d83-fe2b-4c98-b6e4-c2f6ca859adf service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:00:33.692777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cdd957dc-3062-4c05-81e1-d70986668d9e req-c9569d83-fe2b-4c98-b6e4-c2f6ca859adf service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:00:33.693293 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-cdd957dc-3062-4c05-81e1-d70986668d9e req-c9569d83-fe2b-4c98-b6e4-c2f6ca859adf service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:00:33.709098 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-cdd957dc-3062-4c05-81e1-d70986668d9e req-c9569d83-fe2b-4c98-b6e4-c2f6ca859adf service nova] Creating event network-changed:da1bb9f5-cb9f-4423-b416-ee6c4d428a9f for instance 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 on n-h1-852087-9 Sep 07 14:00:33.715431 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-cdd957dc-3062-4c05-81e1-d70986668d9e req-c9569d83-fe2b-4c98-b6e4-c2f6ca859adf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047261 Sep 07 14:00:33.716414 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3816/7656] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:00:33.887090 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-44a5e6a0-67db-4720-9038-c9a6747cf07c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:00:33.899098 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-44a5e6a0-67db-4720-9038-c9a6747cf07c tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6" status: 200 len: 1563 microversion: 2.1 time: 0.238826 Sep 07 14:00:33.914381 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3841/7657] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:00:33 2022] GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 => generated 1563 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:01:07.227894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8971a760-edb6-4860-ac86-c578a15099d1 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:01:07.230225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8971a760-edb6-4860-ac86-c578a15099d1 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:01:07.232411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:01:07.233054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=42 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:01:07.239992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8971a760-edb6-4860-ac86-c578a15099d1 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:07.240490 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8971a760-edb6-4860-ac86-c578a15099d1 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:07.240936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8971a760-edb6-4860-ac86-c578a15099d1 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:07.241952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8971a760-edb6-4860-ac86-c578a15099d1 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:07.242430 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8971a760-edb6-4860-ac86-c578a15099d1 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:07.242867 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8971a760-edb6-4860-ac86-c578a15099d1 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:07.313056 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8971a760-edb6-4860-ac86-c578a15099d1 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6/action" status: 200 len: 24570 microversion: 2.1 time: 0.089713 Sep 07 14:01:07.313805 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3817/7658] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 14:01:07 2022] POST /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6/action => generated 24570 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 14:01:37.766915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=7 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:01:37.767646 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=38 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:01:37.769031 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 14:01:37.769255 n-d-852087-9 devstack@n-api.service[122433]: Wed Sep 7 14:01:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6/action (ip 10.222.0.16) !!! Sep 07 14:01:37.774709 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6b4b0c09-6ca6-4492-91fe-54c52ded85bb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:01:37.775267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6b4b0c09-6ca6-4492-91fe-54c52ded85bb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:01:37.785022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b4b0c09-6ca6-4492-91fe-54c52ded85bb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:37.785562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b4b0c09-6ca6-4492-91fe-54c52ded85bb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:37.786028 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b4b0c09-6ca6-4492-91fe-54c52ded85bb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:37.786749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b4b0c09-6ca6-4492-91fe-54c52ded85bb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:37.787228 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b4b0c09-6ca6-4492-91fe-54c52ded85bb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:37.787677 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6b4b0c09-6ca6-4492-91fe-54c52ded85bb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:37.812827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-6b4b0c09-6ca6-4492-91fe-54c52ded85bb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lazy-loading 'flavor' on Instance uuid 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:01:37.901910 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6b4b0c09-6ca6-4492-91fe-54c52ded85bb tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6/action" status: 202 len: 0 microversion: 2.1 time: 0.136638 Sep 07 14:01:37.902776 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3842/7659] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 14:01:37 2022] POST /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:01:37.912284 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a6a67b1d-3533-411b-8cc5-a0215f5ee678 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:01:37.913051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a6a67b1d-3533-411b-8cc5-a0215f5ee678 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:01:37.915819 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:01:37.916885 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=4 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:01:37.923112 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6a67b1d-3533-411b-8cc5-a0215f5ee678 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:37.923741 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6a67b1d-3533-411b-8cc5-a0215f5ee678 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:37.924206 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6a67b1d-3533-411b-8cc5-a0215f5ee678 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:37.925052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6a67b1d-3533-411b-8cc5-a0215f5ee678 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:37.925572 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6a67b1d-3533-411b-8cc5-a0215f5ee678 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:37.925990 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a6a67b1d-3533-411b-8cc5-a0215f5ee678 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:38.067983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a6a67b1d-3533-411b-8cc5-a0215f5ee678 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:01:38.076244 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a6a67b1d-3533-411b-8cc5-a0215f5ee678 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6" status: 200 len: 1690 microversion: 2.1 time: 0.168700 Sep 07 14:01:38.076816 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3818/7660] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:01:37 2022] GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:01:39.103268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-17ba3be3-f97c-4a5e-9c7e-d5a1e2b635af tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:01:39.104046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-17ba3be3-f97c-4a5e-9c7e-d5a1e2b635af tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:01:39.112088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17ba3be3-f97c-4a5e-9c7e-d5a1e2b635af tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:39.112610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17ba3be3-f97c-4a5e-9c7e-d5a1e2b635af tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:39.113095 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17ba3be3-f97c-4a5e-9c7e-d5a1e2b635af tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:39.113878 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17ba3be3-f97c-4a5e-9c7e-d5a1e2b635af tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:39.114364 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17ba3be3-f97c-4a5e-9c7e-d5a1e2b635af tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:39.114893 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-17ba3be3-f97c-4a5e-9c7e-d5a1e2b635af tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:39.254007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-17ba3be3-f97c-4a5e-9c7e-d5a1e2b635af tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:01:39.262697 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-17ba3be3-f97c-4a5e-9c7e-d5a1e2b635af tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6" status: 200 len: 1690 microversion: 2.1 time: 0.165475 Sep 07 14:01:39.263255 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3843/7661] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:01:39 2022] GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:01:40.286349 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-50b41c43-013b-4c87-a972-50900646f4ab tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:01:40.286961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-50b41c43-013b-4c87-a972-50900646f4ab tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:01:40.294607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50b41c43-013b-4c87-a972-50900646f4ab tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:40.295103 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50b41c43-013b-4c87-a972-50900646f4ab tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:40.295539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50b41c43-013b-4c87-a972-50900646f4ab tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:40.296290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50b41c43-013b-4c87-a972-50900646f4ab tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:40.296756 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50b41c43-013b-4c87-a972-50900646f4ab tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:40.297181 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-50b41c43-013b-4c87-a972-50900646f4ab tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:40.436319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-50b41c43-013b-4c87-a972-50900646f4ab tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:01:40.446008 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-50b41c43-013b-4c87-a972-50900646f4ab tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6" status: 200 len: 1673 microversion: 2.1 time: 0.163841 Sep 07 14:01:40.446643 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3819/7662] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:01:40 2022] GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:01:41.555327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0a18daf4-0370-4e69-8ef0-2b962dec8f18 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:01:41.557704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0a18daf4-0370-4e69-8ef0-2b962dec8f18 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:01:41.565213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a18daf4-0370-4e69-8ef0-2b962dec8f18 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:41.565803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a18daf4-0370-4e69-8ef0-2b962dec8f18 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:41.566293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a18daf4-0370-4e69-8ef0-2b962dec8f18 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:41.567082 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a18daf4-0370-4e69-8ef0-2b962dec8f18 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:41.567593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a18daf4-0370-4e69-8ef0-2b962dec8f18 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:41.568094 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0a18daf4-0370-4e69-8ef0-2b962dec8f18 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:41.636219 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0a18daf4-0370-4e69-8ef0-2b962dec8f18 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6/action" status: 200 len: 35989 microversion: 2.1 time: 0.085116 Sep 07 14:01:41.637298 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3844/7663] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 14:01:41 2022] POST /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6/action => generated 35989 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 14:01:41.649537 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-04e93d85-8c7c-4994-8101-db4123cb861f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:01:41.650114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-04e93d85-8c7c-4994-8101-db4123cb861f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:01:41.658083 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04e93d85-8c7c-4994-8101-db4123cb861f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:41.658575 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04e93d85-8c7c-4994-8101-db4123cb861f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:41.659007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04e93d85-8c7c-4994-8101-db4123cb861f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:41.659698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04e93d85-8c7c-4994-8101-db4123cb861f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:41.660154 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04e93d85-8c7c-4994-8101-db4123cb861f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:41.660573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-04e93d85-8c7c-4994-8101-db4123cb861f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:41.739423 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-04e93d85-8c7c-4994-8101-db4123cb861f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6/action" status: 202 len: 0 microversion: 2.1 time: 0.093236 Sep 07 14:01:41.740074 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3820/7664] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 14:01:41 2022] POST /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:01:41.751753 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-dd75d469-0100-4c61-b672-1e7688e89407 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:01:41.752832 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-dd75d469-0100-4c61-b672-1e7688e89407 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:01:41.763619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd75d469-0100-4c61-b672-1e7688e89407 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:41.764446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd75d469-0100-4c61-b672-1e7688e89407 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:41.765452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd75d469-0100-4c61-b672-1e7688e89407 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:41.766704 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd75d469-0100-4c61-b672-1e7688e89407 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:41.767586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd75d469-0100-4c61-b672-1e7688e89407 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:41.768275 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-dd75d469-0100-4c61-b672-1e7688e89407 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:41.916183 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-dd75d469-0100-4c61-b672-1e7688e89407 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:01:41.924849 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-dd75d469-0100-4c61-b672-1e7688e89407 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6" status: 200 len: 1679 microversion: 2.1 time: 0.178200 Sep 07 14:01:41.925432 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3845/7665] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:01:41 2022] GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:01:42.953672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-69e802a7-bddf-4821-8340-85a2de3b0604 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:01:42.954391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-69e802a7-bddf-4821-8340-85a2de3b0604 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:01:42.963437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69e802a7-bddf-4821-8340-85a2de3b0604 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:42.964361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69e802a7-bddf-4821-8340-85a2de3b0604 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:42.965126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69e802a7-bddf-4821-8340-85a2de3b0604 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:42.966063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69e802a7-bddf-4821-8340-85a2de3b0604 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:42.966657 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69e802a7-bddf-4821-8340-85a2de3b0604 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:42.967111 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-69e802a7-bddf-4821-8340-85a2de3b0604 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:43.118773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-69e802a7-bddf-4821-8340-85a2de3b0604 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:01:43.130571 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-69e802a7-bddf-4821-8340-85a2de3b0604 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6" status: 200 len: 1679 microversion: 2.1 time: 0.182091 Sep 07 14:01:43.131199 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3821/7666] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:01:42 2022] GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 => generated 1679 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:01:44.159288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6e73eb11-e8f8-496d-a4dc-8a68bcae2f8f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:01:44.159838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6e73eb11-e8f8-496d-a4dc-8a68bcae2f8f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:01:44.167242 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e73eb11-e8f8-496d-a4dc-8a68bcae2f8f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:44.167758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e73eb11-e8f8-496d-a4dc-8a68bcae2f8f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:44.168216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e73eb11-e8f8-496d-a4dc-8a68bcae2f8f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:44.168953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e73eb11-e8f8-496d-a4dc-8a68bcae2f8f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:44.169433 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e73eb11-e8f8-496d-a4dc-8a68bcae2f8f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:44.169921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6e73eb11-e8f8-496d-a4dc-8a68bcae2f8f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:44.314009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-6e73eb11-e8f8-496d-a4dc-8a68bcae2f8f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:01:44.323065 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6e73eb11-e8f8-496d-a4dc-8a68bcae2f8f tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6" status: 200 len: 1682 microversion: 2.1 time: 0.167888 Sep 07 14:01:44.323652 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3846/7667] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:01:44 2022] GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:01:44.429066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7cbc99ca-9680-40cd-80d3-9037ccae44f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:01:44.431330 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7cbc99ca-9680-40cd-80d3-9037ccae44f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:01:44.438743 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cbc99ca-9680-40cd-80d3-9037ccae44f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:44.439243 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cbc99ca-9680-40cd-80d3-9037ccae44f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:44.439686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cbc99ca-9680-40cd-80d3-9037ccae44f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:44.440395 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cbc99ca-9680-40cd-80d3-9037ccae44f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:44.440860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cbc99ca-9680-40cd-80d3-9037ccae44f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:44.441294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7cbc99ca-9680-40cd-80d3-9037ccae44f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:44.516507 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7cbc99ca-9680-40cd-80d3-9037ccae44f9 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "POST /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6/action" status: 200 len: 35989 microversion: 2.1 time: 0.090474 Sep 07 14:01:44.517298 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3822/7668] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 14:01:44 2022] POST /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6/action => generated 35989 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 14:01:45.548168 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-50aa32e7-cd3d-4283-8934-c8ada1a32351 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:01:45.548705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-50aa32e7-cd3d-4283-8934-c8ada1a32351 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:01:45.556571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50aa32e7-cd3d-4283-8934-c8ada1a32351 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:45.557156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50aa32e7-cd3d-4283-8934-c8ada1a32351 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:45.557647 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50aa32e7-cd3d-4283-8934-c8ada1a32351 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:45.558366 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50aa32e7-cd3d-4283-8934-c8ada1a32351 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:45.559059 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50aa32e7-cd3d-4283-8934-c8ada1a32351 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:45.559504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-50aa32e7-cd3d-4283-8934-c8ada1a32351 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:45.587717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-50aa32e7-cd3d-4283-8934-c8ada1a32351 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:01:45.615836 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-13b3afdc-7704-4e7d-ae7e-c9693d88e3e5 req-68f6b383-20b7-47d7-a83c-600956ed6648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fb79c3d-520a-48cc-9a1c-eaa96467b0a6", "tag": "da1bb9f5-cb9f-4423-b416-ee6c4d428a9f"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:01:45.628476 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-13b3afdc-7704-4e7d-ae7e-c9693d88e3e5 req-68f6b383-20b7-47d7-a83c-600956ed6648 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:45.629007 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-13b3afdc-7704-4e7d-ae7e-c9693d88e3e5 req-68f6b383-20b7-47d7-a83c-600956ed6648 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:45.629446 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-13b3afdc-7704-4e7d-ae7e-c9693d88e3e5 req-68f6b383-20b7-47d7-a83c-600956ed6648 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:45.641163 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-13b3afdc-7704-4e7d-ae7e-c9693d88e3e5 req-68f6b383-20b7-47d7-a83c-600956ed6648 service nova] Creating event network-changed:da1bb9f5-cb9f-4423-b416-ee6c4d428a9f for instance 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 on n-h1-852087-9 Sep 07 14:01:45.646446 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-13b3afdc-7704-4e7d-ae7e-c9693d88e3e5 req-68f6b383-20b7-47d7-a83c-600956ed6648 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099197 Sep 07 14:01:45.647086 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3823/7669] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:01:45.686379 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-50aa32e7-cd3d-4283-8934-c8ada1a32351 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6" status: 204 len: 0 microversion: 2.1 time: 0.142089 Sep 07 14:01:45.687421 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3847/7670] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 14:01:45 2022] DELETE /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 14:01:45.696825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-707f345a-dd92-43c2-9a9a-3a7ab9df3411 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:01:45.697393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-707f345a-dd92-43c2-9a9a-3a7ab9df3411 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:01:45.705146 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-707f345a-dd92-43c2-9a9a-3a7ab9df3411 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:45.705797 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-707f345a-dd92-43c2-9a9a-3a7ab9df3411 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:45.706498 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-707f345a-dd92-43c2-9a9a-3a7ab9df3411 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:45.707497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-707f345a-dd92-43c2-9a9a-3a7ab9df3411 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:45.708202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-707f345a-dd92-43c2-9a9a-3a7ab9df3411 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:45.708788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-707f345a-dd92-43c2-9a9a-3a7ab9df3411 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:45.846219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-707f345a-dd92-43c2-9a9a-3a7ab9df3411 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:01:45.854522 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-707f345a-dd92-43c2-9a9a-3a7ab9df3411 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6" status: 200 len: 1688 microversion: 2.1 time: 0.162433 Sep 07 14:01:45.855114 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3824/7671] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:01:45 2022] GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:01:46.879542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-43d97aba-40a2-46b7-bad8-5957bf36c8f7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:01:46.880262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-43d97aba-40a2-46b7-bad8-5957bf36c8f7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:01:46.888583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43d97aba-40a2-46b7-bad8-5957bf36c8f7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:46.889262 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43d97aba-40a2-46b7-bad8-5957bf36c8f7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:46.889901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43d97aba-40a2-46b7-bad8-5957bf36c8f7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:46.890642 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43d97aba-40a2-46b7-bad8-5957bf36c8f7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:46.891129 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43d97aba-40a2-46b7-bad8-5957bf36c8f7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:46.891586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43d97aba-40a2-46b7-bad8-5957bf36c8f7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:47.035858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-43d97aba-40a2-46b7-bad8-5957bf36c8f7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:01:47.047305 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-43d97aba-40a2-46b7-bad8-5957bf36c8f7 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6" status: 200 len: 1688 microversion: 2.1 time: 0.171962 Sep 07 14:01:47.048064 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3848/7672] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:01:46 2022] GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:01:48.073459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-da9739cc-483f-4ed6-a022-cb9253837b05 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:01:48.074205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-da9739cc-483f-4ed6-a022-cb9253837b05 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:01:48.081592 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da9739cc-483f-4ed6-a022-cb9253837b05 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:48.082078 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da9739cc-483f-4ed6-a022-cb9253837b05 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:48.082518 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da9739cc-483f-4ed6-a022-cb9253837b05 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:48.083342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da9739cc-483f-4ed6-a022-cb9253837b05 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:48.083801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da9739cc-483f-4ed6-a022-cb9253837b05 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:48.084217 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-da9739cc-483f-4ed6-a022-cb9253837b05 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:48.351660 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-da9739cc-483f-4ed6-a022-cb9253837b05 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dce2997e6c6461db3bae9e9c3315d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cfdac7bd4768b54690ce5afe8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:01:48.360302 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-da9739cc-483f-4ed6-a022-cb9253837b05 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6" status: 200 len: 1569 microversion: 2.1 time: 0.290879 Sep 07 14:01:48.361788 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3825/7673] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:01:48 2022] GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 => generated 1569 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:01:48.395078 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-ad97d77a-b1e6-46f8-b730-9cdef11dff48 req-c1a74ced-9af9-4f80-90a1-7cf6967bc9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb79c3d-520a-48cc-9a1c-eaa96467b0a6", "name": "network-vif-deleted", "tag": "da1bb9f5-cb9f-4423-b416-ee6c4d428a9f"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:01:48.405198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ad97d77a-b1e6-46f8-b730-9cdef11dff48 req-c1a74ced-9af9-4f80-90a1-7cf6967bc9c0 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:48.406007 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ad97d77a-b1e6-46f8-b730-9cdef11dff48 req-c1a74ced-9af9-4f80-90a1-7cf6967bc9c0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:48.406537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-ad97d77a-b1e6-46f8-b730-9cdef11dff48 req-c1a74ced-9af9-4f80-90a1-7cf6967bc9c0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:48.418456 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-ad97d77a-b1e6-46f8-b730-9cdef11dff48 req-c1a74ced-9af9-4f80-90a1-7cf6967bc9c0 service nova] Creating event network-vif-deleted:da1bb9f5-cb9f-4423-b416-ee6c4d428a9f for instance 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 on n-h1-852087-9 Sep 07 14:01:48.423365 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-ad97d77a-b1e6-46f8-b730-9cdef11dff48 req-c1a74ced-9af9-4f80-90a1-7cf6967bc9c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095969 Sep 07 14:01:48.423974 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3849/7674] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:01:49.385269 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-011ef898-1001-44e7-83db-c4812159ac22 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:01:49.385875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-011ef898-1001-44e7-83db-c4812159ac22 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] [instance: 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:01:49.393158 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-011ef898-1001-44e7-83db-c4812159ac22 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:49.393690 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-011ef898-1001-44e7-83db-c4812159ac22 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:49.394123 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-011ef898-1001-44e7-83db-c4812159ac22 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:49.394830 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-011ef898-1001-44e7-83db-c4812159ac22 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:01:49.395424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-011ef898-1001-44e7-83db-c4812159ac22 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:01:49.395841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-011ef898-1001-44e7-83db-c4812159ac22 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:01:49.410495 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-011ef898-1001-44e7-83db-c4812159ac22 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] HTTP exception thrown: Instance 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 could not be found. Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-011ef898-1001-44e7-83db-c4812159ac22 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Request method failure captured: Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 HTTP/1.1 Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGKJIpRj4dUoVYAzI48MspU8ZelpD30GGZSMNBLAcJjfPqrRwz5SflK5ZGsGmdXzaRhezwINOX9bACqNviUzYHhK5j_TepIiCI-ydksrX2YrwyvVjX0oRIdw2hFrTIsMr6gjr_5dekqg_MtjlByIh9B6o0NyhZw8LTWA2pkGzjxBAu_s Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 8f56cfdac7bd4768b54690ce5afe8854 Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-901687866 Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f56cfdac7bd4768b54690ce5afe8854"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f56cfdac7bd4768b54690ce5afe8854"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f56cfdac7bd4768b54690ce5afe8854"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f56cfdac7bd4768b54690ce5afe8854"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TestNetworkAdvancedServerOps-901687866 Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 8f56cfdac7bd4768b54690ce5afe8854 Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-901687866 Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TestNetworkAdvancedServerOps-901687866-project Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: 9dce2997e6c6461db3bae9e9c3315d8b Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TestNetworkAdvancedServerOps-901687866-project Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 could not be found. Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '4fb79c3d-520a-48cc-9a1c-eaa96467b0a6'} Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 could not be found. Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 could not be found. Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 14:01:49.412200 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:01:49.417508 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 14:01:49.417508 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:01:49.417508 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:01:49.417508 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:01:49.417508 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:01:49.417508 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:01:49.417508 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 could not be found. Sep 07 14:01:49.417508 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 14:01:49.417508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-011ef898-1001-44e7-83db-c4812159ac22 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Returning 404 to user: Instance 4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:01:49.417508 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-011ef898-1001-44e7-83db-c4812159ac22 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6" status: 404 len: 111 microversion: 2.1 time: 0.032836 Sep 07 14:01:49.418183 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3826/7675] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:01:49 2022] GET /compute/v2.1/servers/4fb79c3d-520a-48cc-9a1c-eaa96467b0a6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:01:52.858158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1cf51384-e281-4b98-8eba-1f404aca6c12 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] Calling method '.version_select at 0x7fc4193fcf70>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:01:52.883495 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1cf51384-e281-4b98-8eba-1f404aca6c12 tempest-TestNetworkAdvancedServerOps-901687866 tempest-TestNetworkAdvancedServerOps-901687866-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1629777685" status: 202 len: 0 microversion: 2.1 time: 0.030614 Sep 07 14:01:52.884063 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3850/7676] 10.222.0.16 () {58 vars in 1284 bytes} [Wed Sep 7 14:01:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1629777685 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:02:04.716466 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=18 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:02:04.717398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:02:04.903816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-05f616db-90b0-4561-9c92-156269bad13f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Action: 'create', calling method: .version_select at 0x7fc419cad9d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-826383775", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7PMcMW8d9mVWfl9CUB/HJBgwyNaCXvlztGKlIgvpVV1EiQ9/WYa6baGxTRlHP5gS3295IfrwBgr7g9TXDT/cQD4torxZvOe4FA6x80jNcs9/JcS5ej2ECtYjIdR7Tymg=="}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:02:04.927954 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-05f616db-90b0-4561-9c92-156269bad13f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Getting quotas for project ba713b04eba14c9d93feaa41938527b8. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:02:04.933652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-05f616db-90b0-4561-9c92-156269bad13f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Getting quotas for user 84652ff0847947a89cca9bf0a81cf6ab and project ba713b04eba14c9d93feaa41938527b8. Resources: {'key_pairs'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:02:04.963444 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-05f616db-90b0-4561-9c92-156269bad13f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.252937 Sep 07 14:02:04.963981 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3827/7677] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 14:02:04 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:02:05.987513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-06428df9-5f3c-4bec-aec1-aaaba8541f97 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1994789372", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-826383775", "security_groups": [{"name": "tempest-secgroup-smoke-119578368"}], "networks": [{"uuid": "10b218c5-5ae6-4498-9a5d-36154531c267"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:02:05.998926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:02:05.999864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:02:06.105338 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-06428df9-5f3c-4bec-aec1-aaaba8541f97 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] validate_networks() for [('10b218c5-5ae6-4498-9a5d-36154531c267', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 14:02:06.594798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-06428df9-5f3c-4bec-aec1-aaaba8541f97 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 14:02:06.595246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-06428df9-5f3c-4bec-aec1-aaaba8541f97 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 14:02:06.596056 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-06428df9-5f3c-4bec-aec1-aaaba8541f97 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 14:02:06.596658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-06428df9-5f3c-4bec-aec1-aaaba8541f97 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 14:02:06.597103 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-06428df9-5f3c-4bec-aec1-aaaba8541f97 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 14:02:06.606446 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06428df9-5f3c-4bec-aec1-aaaba8541f97 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:02:06.606989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06428df9-5f3c-4bec-aec1-aaaba8541f97 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:02:06.607450 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06428df9-5f3c-4bec-aec1-aaaba8541f97 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:02:06.608239 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06428df9-5f3c-4bec-aec1-aaaba8541f97 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:02:06.608732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06428df9-5f3c-4bec-aec1-aaaba8541f97 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:02:06.609182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-06428df9-5f3c-4bec-aec1-aaaba8541f97 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:02:06.628230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-06428df9-5f3c-4bec-aec1-aaaba8541f97 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Getting quotas for project ba713b04eba14c9d93feaa41938527b8. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:02:06.635313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-06428df9-5f3c-4bec-aec1-aaaba8541f97 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Getting quotas for user 84652ff0847947a89cca9bf0a81cf6ab and project ba713b04eba14c9d93feaa41938527b8. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:02:06.654524 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-06428df9-5f3c-4bec-aec1-aaaba8541f97 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 14:02:06.657812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-06428df9-5f3c-4bec-aec1-aaaba8541f97 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 14:02:06.709310 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-06428df9-5f3c-4bec-aec1-aaaba8541f97 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.724743 Sep 07 14:02:06.714074 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3851/7678] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 14:02:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 14:02:06.728524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ff7a4890-3d4d-40f0-b318-b197caf742de tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:02:06.729814 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ff7a4890-3d4d-40f0-b318-b197caf742de tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:02:06.806180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ff7a4890-3d4d-40f0-b318-b197caf742de tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:02:06.821189 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ff7a4890-3d4d-40f0-b318-b197caf742de tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1246 microversion: 2.1 time: 0.096630 Sep 07 14:02:06.822006 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3828/7679] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:02:06 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1246 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:02:07.847809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c912b6ac-107f-488c-9575-9504ea1d1013 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:02:07.848456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c912b6ac-107f-488c-9575-9504ea1d1013 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:02:07.856013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c912b6ac-107f-488c-9575-9504ea1d1013 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:02:07.856620 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c912b6ac-107f-488c-9575-9504ea1d1013 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:02:07.857146 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c912b6ac-107f-488c-9575-9504ea1d1013 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:02:07.857935 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c912b6ac-107f-488c-9575-9504ea1d1013 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:02:07.858423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c912b6ac-107f-488c-9575-9504ea1d1013 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:02:07.858874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c912b6ac-107f-488c-9575-9504ea1d1013 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:02:07.970116 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c912b6ac-107f-488c-9575-9504ea1d1013 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:02:07.983634 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c912b6ac-107f-488c-9575-9504ea1d1013 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1306 microversion: 2.1 time: 0.141446 Sep 07 14:02:07.984240 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3852/7680] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:02:07 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1306 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:02:09.010323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3d9d4c8f-6b72-4c58-be29-c2f3940eb03d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:02:09.010959 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3d9d4c8f-6b72-4c58-be29-c2f3940eb03d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:02:09.021277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d9d4c8f-6b72-4c58-be29-c2f3940eb03d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:02:09.021915 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d9d4c8f-6b72-4c58-be29-c2f3940eb03d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:02:09.022538 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d9d4c8f-6b72-4c58-be29-c2f3940eb03d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:02:09.023591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d9d4c8f-6b72-4c58-be29-c2f3940eb03d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:02:09.024224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d9d4c8f-6b72-4c58-be29-c2f3940eb03d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:02:09.024859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3d9d4c8f-6b72-4c58-be29-c2f3940eb03d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:02:09.194887 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3d9d4c8f-6b72-4c58-be29-c2f3940eb03d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:02:09.204069 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3d9d4c8f-6b72-4c58-be29-c2f3940eb03d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1371 microversion: 2.1 time: 0.197950 Sep 07 14:02:09.204669 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3829/7681] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:02:09 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:02:09.492038 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-e34ed7b3-011a-4afc-a382-a04e396e1a2e req-73e3ff57-c10d-44a8-8ce4-8ac660e8dea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6347998-4392-4004-9d2a-e7e710d552fa", "tag": "6acd9a55-cdf2-437f-8856-4b7936d4e49a"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:02:09.503731 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e34ed7b3-011a-4afc-a382-a04e396e1a2e req-73e3ff57-c10d-44a8-8ce4-8ac660e8dea2 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:02:09.505121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e34ed7b3-011a-4afc-a382-a04e396e1a2e req-73e3ff57-c10d-44a8-8ce4-8ac660e8dea2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:02:09.505624 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-e34ed7b3-011a-4afc-a382-a04e396e1a2e req-73e3ff57-c10d-44a8-8ce4-8ac660e8dea2 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:02:09.518675 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-e34ed7b3-011a-4afc-a382-a04e396e1a2e req-73e3ff57-c10d-44a8-8ce4-8ac660e8dea2 service nova] Creating event network-changed:6acd9a55-cdf2-437f-8856-4b7936d4e49a for instance c6347998-4392-4004-9d2a-e7e710d552fa on n-h2-852087-9 Sep 07 14:02:09.531764 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-e34ed7b3-011a-4afc-a382-a04e396e1a2e req-73e3ff57-c10d-44a8-8ce4-8ac660e8dea2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043943 Sep 07 14:02:09.532953 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3853/7682] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:02:10.227392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-558f0058-da5e-4380-9bac-8275dde2f31b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:02:10.227983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-558f0058-da5e-4380-9bac-8275dde2f31b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:02:10.235504 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-558f0058-da5e-4380-9bac-8275dde2f31b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:02:10.236003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-558f0058-da5e-4380-9bac-8275dde2f31b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:02:10.236472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-558f0058-da5e-4380-9bac-8275dde2f31b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:02:10.237179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-558f0058-da5e-4380-9bac-8275dde2f31b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:02:10.237714 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-558f0058-da5e-4380-9bac-8275dde2f31b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:02:10.238101 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-558f0058-da5e-4380-9bac-8275dde2f31b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:02:10.395410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-558f0058-da5e-4380-9bac-8275dde2f31b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:02:10.408043 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-558f0058-da5e-4380-9bac-8275dde2f31b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1371 microversion: 2.1 time: 0.184689 Sep 07 14:02:10.408660 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3830/7683] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:02:10 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:02:11.434198 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-305b2d98-0e3d-49f8-829c-32fd529f797b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:02:11.434867 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-305b2d98-0e3d-49f8-829c-32fd529f797b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:02:11.442013 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-305b2d98-0e3d-49f8-829c-32fd529f797b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:02:11.442537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-305b2d98-0e3d-49f8-829c-32fd529f797b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:02:11.443001 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-305b2d98-0e3d-49f8-829c-32fd529f797b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:02:11.443721 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-305b2d98-0e3d-49f8-829c-32fd529f797b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:02:11.444204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-305b2d98-0e3d-49f8-829c-32fd529f797b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:02:11.444657 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-305b2d98-0e3d-49f8-829c-32fd529f797b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:02:11.599153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-305b2d98-0e3d-49f8-829c-32fd529f797b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:02:11.608302 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-305b2d98-0e3d-49f8-829c-32fd529f797b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1371 microversion: 2.1 time: 0.179484 Sep 07 14:02:11.608923 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3854/7684] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:02:11 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:02:12.632183 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-051eca2e-3770-455e-9399-df9cd1a1a43f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:02:12.632825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-051eca2e-3770-455e-9399-df9cd1a1a43f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:02:12.639909 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-051eca2e-3770-455e-9399-df9cd1a1a43f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:02:12.640394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-051eca2e-3770-455e-9399-df9cd1a1a43f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:02:12.640838 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-051eca2e-3770-455e-9399-df9cd1a1a43f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:02:12.641560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-051eca2e-3770-455e-9399-df9cd1a1a43f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:02:12.642018 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-051eca2e-3770-455e-9399-df9cd1a1a43f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:02:12.642435 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-051eca2e-3770-455e-9399-df9cd1a1a43f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:02:12.780686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-051eca2e-3770-455e-9399-df9cd1a1a43f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:02:12.790446 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-051eca2e-3770-455e-9399-df9cd1a1a43f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1371 microversion: 2.1 time: 0.162471 Sep 07 14:02:12.791002 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3831/7685] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:02:12 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:02:13.814775 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-270edf9c-6602-4291-8b12-a908309dddca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:02:13.815383 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-270edf9c-6602-4291-8b12-a908309dddca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:02:13.822974 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-270edf9c-6602-4291-8b12-a908309dddca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:02:13.823496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-270edf9c-6602-4291-8b12-a908309dddca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:02:13.824000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-270edf9c-6602-4291-8b12-a908309dddca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:02:13.824663 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-270edf9c-6602-4291-8b12-a908309dddca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:02:13.825174 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-270edf9c-6602-4291-8b12-a908309dddca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:02:13.825671 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-270edf9c-6602-4291-8b12-a908309dddca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:02:13.978911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-270edf9c-6602-4291-8b12-a908309dddca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:02:13.988934 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-270edf9c-6602-4291-8b12-a908309dddca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1371 microversion: 2.1 time: 0.177969 Sep 07 14:02:13.989789 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3855/7686] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:02:13 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:02:14.597506 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-d9a953a7-62c4-4b33-8f34-3a17b2ab212f req-959aa905-591b-4f98-872a-9f8725acddc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6347998-4392-4004-9d2a-e7e710d552fa", "name": "network-vif-plugged", "status": "completed", "tag": "6acd9a55-cdf2-437f-8856-4b7936d4e49a"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:02:14.611698 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d9a953a7-62c4-4b33-8f34-3a17b2ab212f req-959aa905-591b-4f98-872a-9f8725acddc8 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:02:14.612339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d9a953a7-62c4-4b33-8f34-3a17b2ab212f req-959aa905-591b-4f98-872a-9f8725acddc8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:02:14.613013 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-d9a953a7-62c4-4b33-8f34-3a17b2ab212f req-959aa905-591b-4f98-872a-9f8725acddc8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:02:14.628871 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-d9a953a7-62c4-4b33-8f34-3a17b2ab212f req-959aa905-591b-4f98-872a-9f8725acddc8 service nova] Creating event network-vif-plugged:6acd9a55-cdf2-437f-8856-4b7936d4e49a for instance c6347998-4392-4004-9d2a-e7e710d552fa on n-h2-852087-9 Sep 07 14:02:14.634730 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-d9a953a7-62c4-4b33-8f34-3a17b2ab212f req-959aa905-591b-4f98-872a-9f8725acddc8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041384 Sep 07 14:02:14.635384 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3832/7687] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:02:15.013394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8bf58c38-501d-4540-ad55-87dcb2c30c82 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:02:15.014031 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8bf58c38-501d-4540-ad55-87dcb2c30c82 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:02:15.021664 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bf58c38-501d-4540-ad55-87dcb2c30c82 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:02:15.022203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bf58c38-501d-4540-ad55-87dcb2c30c82 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:02:15.022644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bf58c38-501d-4540-ad55-87dcb2c30c82 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:02:15.023369 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bf58c38-501d-4540-ad55-87dcb2c30c82 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:02:15.023849 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bf58c38-501d-4540-ad55-87dcb2c30c82 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:02:15.024298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8bf58c38-501d-4540-ad55-87dcb2c30c82 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:02:15.164115 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8bf58c38-501d-4540-ad55-87dcb2c30c82 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:02:15.172382 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8bf58c38-501d-4540-ad55-87dcb2c30c82 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1371 microversion: 2.1 time: 0.162983 Sep 07 14:02:15.172968 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3856/7688] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:02:15 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:02:16.196644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4587c226-8b64-46e3-affd-e5244d3fb1bd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:02:16.197288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4587c226-8b64-46e3-affd-e5244d3fb1bd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:02:16.205038 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4587c226-8b64-46e3-affd-e5244d3fb1bd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:02:16.205536 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4587c226-8b64-46e3-affd-e5244d3fb1bd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:02:16.206014 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4587c226-8b64-46e3-affd-e5244d3fb1bd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:02:16.206686 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4587c226-8b64-46e3-affd-e5244d3fb1bd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:02:16.207138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4587c226-8b64-46e3-affd-e5244d3fb1bd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:02:16.207559 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4587c226-8b64-46e3-affd-e5244d3fb1bd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:02:16.352502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4587c226-8b64-46e3-affd-e5244d3fb1bd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:02:16.364192 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4587c226-8b64-46e3-affd-e5244d3fb1bd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1555 microversion: 2.1 time: 0.171743 Sep 07 14:02:16.364867 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3833/7689] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:02:16 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:02:16.390119 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-abc6902b-e7d3-4ba3-ae94-b43b3c6f2343 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:02:16.390815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-abc6902b-e7d3-4ba3-ae94-b43b3c6f2343 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:02:16.400082 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abc6902b-e7d3-4ba3-ae94-b43b3c6f2343 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:02:16.400586 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abc6902b-e7d3-4ba3-ae94-b43b3c6f2343 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:02:16.401048 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abc6902b-e7d3-4ba3-ae94-b43b3c6f2343 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:02:16.401800 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abc6902b-e7d3-4ba3-ae94-b43b3c6f2343 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:02:16.402282 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abc6902b-e7d3-4ba3-ae94-b43b3c6f2343 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:02:16.402768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-abc6902b-e7d3-4ba3-ae94-b43b3c6f2343 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:02:16.551423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-abc6902b-e7d3-4ba3-ae94-b43b3c6f2343 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:02:16.562947 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-abc6902b-e7d3-4ba3-ae94-b43b3c6f2343 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1555 microversion: 2.1 time: 0.178798 Sep 07 14:02:16.563762 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3857/7690] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:02:16 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1555 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:02:18.322480 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3d505f71-5fb6-4f43-b0fd-9bd79057d96f req-d0694ed7-c807-4711-9ed5-37b8d2f3b730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6347998-4392-4004-9d2a-e7e710d552fa", "tag": "6acd9a55-cdf2-437f-8856-4b7936d4e49a"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:02:18.327509 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:02:18.334236 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3d505f71-5fb6-4f43-b0fd-9bd79057d96f req-d0694ed7-c807-4711-9ed5-37b8d2f3b730 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:02:18.334707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3d505f71-5fb6-4f43-b0fd-9bd79057d96f req-d0694ed7-c807-4711-9ed5-37b8d2f3b730 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:02:18.335135 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3d505f71-5fb6-4f43-b0fd-9bd79057d96f req-d0694ed7-c807-4711-9ed5-37b8d2f3b730 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:02:18.347073 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3d505f71-5fb6-4f43-b0fd-9bd79057d96f req-d0694ed7-c807-4711-9ed5-37b8d2f3b730 service nova] Creating event network-changed:6acd9a55-cdf2-437f-8856-4b7936d4e49a for instance c6347998-4392-4004-9d2a-e7e710d552fa on n-h2-852087-9 Sep 07 14:02:18.352236 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3d505f71-5fb6-4f43-b0fd-9bd79057d96f req-d0694ed7-c807-4711-9ed5-37b8d2f3b730 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033504 Sep 07 14:02:18.352837 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3834/7691] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:04:15.772108 n-d-852087-9 devstack@n-api.service[122433]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e81ee00-bfe8-4eb4-a476-35156d4bea97] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 07 14:04:15.773347 n-d-852087-9 devstack@n-api.service[122433]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8d32b56c-9735-4691-a763-667a0c833c21] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 07 14:04:15.773758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:04:15.774553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:04:15.775358 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:04:15.776068 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=34 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:04:15.777073 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 07 14:04:15.777269 n-d-852087-9 devstack@n-api.service[122433]: Wed Sep 7 14:04:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa/action (ip 10.222.0.16) !!! Sep 07 14:04:15.782595 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b7fac614-8370-465a-b3b9-56c3c349806d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:04:15.783320 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b7fac614-8370-465a-b3b9-56c3c349806d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:15.793838 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7fac614-8370-465a-b3b9-56c3c349806d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:15.794352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7fac614-8370-465a-b3b9-56c3c349806d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:15.794816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7fac614-8370-465a-b3b9-56c3c349806d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:15.795542 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7fac614-8370-465a-b3b9-56c3c349806d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:15.796026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7fac614-8370-465a-b3b9-56c3c349806d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:15.796469 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b7fac614-8370-465a-b3b9-56c3c349806d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:15.821763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.objects.instance [None req-b7fac614-8370-465a-b3b9-56c3c349806d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lazy-loading 'flavor' on Instance uuid c6347998-4392-4004-9d2a-e7e710d552fa {{(pid=122433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:04:16.161940 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b7fac614-8370-465a-b3b9-56c3c349806d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "POST /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa/action" status: 202 len: 0 microversion: 2.1 time: 0.391781 Sep 07 14:04:16.162543 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3858/7692] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 14:04:15 2022] POST /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 14:04:16.169328 n-d-852087-9 devstack@n-api.service[122432]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72b3548f-b60d-4e5d-9d07-5303e0946fc3] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 14:04:16.170215 n-d-852087-9 devstack@n-api.service[122432]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78519242-4876-4a94-89c0-8fbbf97741d7] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 14:04:16.170765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:04:16.171709 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=28 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:04:16.172387 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 14:04:16.172556 n-d-852087-9 devstack@n-api.service[122432]: Wed Sep 7 14:04:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa (ip 10.222.0.16) !!! Sep 07 14:04:16.179747 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-82a6119b-a904-445e-9671-50b21711086f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:16.180458 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-82a6119b-a904-445e-9671-50b21711086f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:16.192296 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a6119b-a904-445e-9671-50b21711086f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:16.192777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a6119b-a904-445e-9671-50b21711086f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:16.193215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a6119b-a904-445e-9671-50b21711086f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:16.193944 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a6119b-a904-445e-9671-50b21711086f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:16.194398 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a6119b-a904-445e-9671-50b21711086f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:16.194825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-82a6119b-a904-445e-9671-50b21711086f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:16.402808 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-82a6119b-a904-445e-9671-50b21711086f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:16.414929 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-82a6119b-a904-445e-9671-50b21711086f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1680 microversion: 2.1 time: 0.247228 Sep 07 14:04:16.415746 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3835/7693] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:16 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1680 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:17.444009 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1a1ab28a-7f83-44fd-b343-6943d4a5b8d8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:17.444718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1a1ab28a-7f83-44fd-b343-6943d4a5b8d8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:17.454963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a1ab28a-7f83-44fd-b343-6943d4a5b8d8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:17.455480 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a1ab28a-7f83-44fd-b343-6943d4a5b8d8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:17.455948 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a1ab28a-7f83-44fd-b343-6943d4a5b8d8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:17.456677 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a1ab28a-7f83-44fd-b343-6943d4a5b8d8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:17.457158 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a1ab28a-7f83-44fd-b343-6943d4a5b8d8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:17.457640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1a1ab28a-7f83-44fd-b343-6943d4a5b8d8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:17.462108 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] [8d32b56c-9735-4691-a763-667a0c833c21] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 41698. Sep 07 14:04:17.462932 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e81ee00-bfe8-4eb4-a476-35156d4bea97] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 41696. Sep 07 14:04:17.602812 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1a1ab28a-7f83-44fd-b343-6943d4a5b8d8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:17.610775 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1a1ab28a-7f83-44fd-b343-6943d4a5b8d8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1680 microversion: 2.1 time: 0.172478 Sep 07 14:04:17.611599 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3859/7694] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:17 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:18.643216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-3319b007-e958-404a-b4e2-c38c57de24e4 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:18.644128 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-3319b007-e958-404a-b4e2-c38c57de24e4 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:18.657722 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3319b007-e958-404a-b4e2-c38c57de24e4 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:18.658201 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3319b007-e958-404a-b4e2-c38c57de24e4 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:18.658664 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3319b007-e958-404a-b4e2-c38c57de24e4 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:18.659451 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3319b007-e958-404a-b4e2-c38c57de24e4 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:18.659904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3319b007-e958-404a-b4e2-c38c57de24e4 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:18.660329 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-3319b007-e958-404a-b4e2-c38c57de24e4 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:18.664680 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] [78519242-4876-4a94-89c0-8fbbf97741d7] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 41704. Sep 07 14:04:18.665466 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] [72b3548f-b60d-4e5d-9d07-5303e0946fc3] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 41702. Sep 07 14:04:18.810412 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-3319b007-e958-404a-b4e2-c38c57de24e4 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:18.818940 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-3319b007-e958-404a-b4e2-c38c57de24e4 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1680 microversion: 2.1 time: 0.181917 Sep 07 14:04:18.819533 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3836/7695] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:18 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:19.842536 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0d3e9cca-8e43-4766-bb83-6b4b4fcd0458 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:19.843123 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0d3e9cca-8e43-4766-bb83-6b4b4fcd0458 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:19.850892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d3e9cca-8e43-4766-bb83-6b4b4fcd0458 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:19.851405 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d3e9cca-8e43-4766-bb83-6b4b4fcd0458 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:19.851853 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d3e9cca-8e43-4766-bb83-6b4b4fcd0458 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:19.852607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d3e9cca-8e43-4766-bb83-6b4b4fcd0458 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:19.853089 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d3e9cca-8e43-4766-bb83-6b4b4fcd0458 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:19.853548 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0d3e9cca-8e43-4766-bb83-6b4b4fcd0458 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:19.994042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0d3e9cca-8e43-4766-bb83-6b4b4fcd0458 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:20.004581 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0d3e9cca-8e43-4766-bb83-6b4b4fcd0458 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1680 microversion: 2.1 time: 0.166023 Sep 07 14:04:20.005494 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3860/7696] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:19 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:21.028839 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b00c65c0-c986-4576-926b-cc1d634984e5 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:21.029424 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b00c65c0-c986-4576-926b-cc1d634984e5 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:21.037153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b00c65c0-c986-4576-926b-cc1d634984e5 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:21.037693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b00c65c0-c986-4576-926b-cc1d634984e5 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:21.038117 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b00c65c0-c986-4576-926b-cc1d634984e5 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:21.038856 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b00c65c0-c986-4576-926b-cc1d634984e5 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:21.039321 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b00c65c0-c986-4576-926b-cc1d634984e5 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:21.039752 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b00c65c0-c986-4576-926b-cc1d634984e5 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:21.181374 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b00c65c0-c986-4576-926b-cc1d634984e5 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:21.192270 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b00c65c0-c986-4576-926b-cc1d634984e5 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1680 microversion: 2.1 time: 0.166566 Sep 07 14:04:21.192270 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3837/7697] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:21 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:22.216065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-11b4013a-de7b-4993-b89b-c5dbd8252453 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:22.216651 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-11b4013a-de7b-4993-b89b-c5dbd8252453 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:22.224317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11b4013a-de7b-4993-b89b-c5dbd8252453 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:22.224826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11b4013a-de7b-4993-b89b-c5dbd8252453 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:22.225294 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11b4013a-de7b-4993-b89b-c5dbd8252453 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:22.226057 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11b4013a-de7b-4993-b89b-c5dbd8252453 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:22.226978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11b4013a-de7b-4993-b89b-c5dbd8252453 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:22.227436 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-11b4013a-de7b-4993-b89b-c5dbd8252453 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:22.370645 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-11b4013a-de7b-4993-b89b-c5dbd8252453 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:22.379433 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-11b4013a-de7b-4993-b89b-c5dbd8252453 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1680 microversion: 2.1 time: 0.167430 Sep 07 14:04:22.380197 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3861/7698] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:22 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:23.406944 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-faa3fc3e-dbfd-4db7-afb0-4d97199bbb4f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:23.407659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-faa3fc3e-dbfd-4db7-afb0-4d97199bbb4f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:23.415006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-faa3fc3e-dbfd-4db7-afb0-4d97199bbb4f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:23.415493 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-faa3fc3e-dbfd-4db7-afb0-4d97199bbb4f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:23.415928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-faa3fc3e-dbfd-4db7-afb0-4d97199bbb4f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:23.416632 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-faa3fc3e-dbfd-4db7-afb0-4d97199bbb4f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:23.417082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-faa3fc3e-dbfd-4db7-afb0-4d97199bbb4f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:23.417510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-faa3fc3e-dbfd-4db7-afb0-4d97199bbb4f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:23.560605 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-faa3fc3e-dbfd-4db7-afb0-4d97199bbb4f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:23.571094 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-faa3fc3e-dbfd-4db7-afb0-4d97199bbb4f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1680 microversion: 2.1 time: 0.168135 Sep 07 14:04:23.571675 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3838/7699] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:23 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:24.599154 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-eaba8d73-a7c0-462b-a636-5dacfab4c7ca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:24.599944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-eaba8d73-a7c0-462b-a636-5dacfab4c7ca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:24.608990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eaba8d73-a7c0-462b-a636-5dacfab4c7ca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:24.609773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eaba8d73-a7c0-462b-a636-5dacfab4c7ca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:24.610540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eaba8d73-a7c0-462b-a636-5dacfab4c7ca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:24.611400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eaba8d73-a7c0-462b-a636-5dacfab4c7ca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:24.611860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eaba8d73-a7c0-462b-a636-5dacfab4c7ca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:24.612336 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-eaba8d73-a7c0-462b-a636-5dacfab4c7ca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:24.767154 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-eaba8d73-a7c0-462b-a636-5dacfab4c7ca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:24.775813 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-eaba8d73-a7c0-462b-a636-5dacfab4c7ca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1680 microversion: 2.1 time: 0.182474 Sep 07 14:04:24.776407 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3862/7700] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:24 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:25.799011 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9114b47c-a35f-4fec-8df8-90fe1feef964 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:25.799711 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9114b47c-a35f-4fec-8df8-90fe1feef964 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:25.807172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9114b47c-a35f-4fec-8df8-90fe1feef964 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:25.807671 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9114b47c-a35f-4fec-8df8-90fe1feef964 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:25.808116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9114b47c-a35f-4fec-8df8-90fe1feef964 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:25.808828 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9114b47c-a35f-4fec-8df8-90fe1feef964 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:25.809294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9114b47c-a35f-4fec-8df8-90fe1feef964 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:25.809761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9114b47c-a35f-4fec-8df8-90fe1feef964 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:25.955360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9114b47c-a35f-4fec-8df8-90fe1feef964 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:25.963938 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9114b47c-a35f-4fec-8df8-90fe1feef964 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1680 microversion: 2.1 time: 0.168933 Sep 07 14:04:25.964463 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3839/7701] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:25 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:26.990953 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1ba2b8e2-0362-437d-ab04-57c9606aea67 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:26.991605 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1ba2b8e2-0362-437d-ab04-57c9606aea67 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:26.999139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ba2b8e2-0362-437d-ab04-57c9606aea67 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:26.999650 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ba2b8e2-0362-437d-ab04-57c9606aea67 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:27.000696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ba2b8e2-0362-437d-ab04-57c9606aea67 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:27.000866 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ba2b8e2-0362-437d-ab04-57c9606aea67 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:27.001457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ba2b8e2-0362-437d-ab04-57c9606aea67 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:27.001946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1ba2b8e2-0362-437d-ab04-57c9606aea67 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:27.152179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1ba2b8e2-0362-437d-ab04-57c9606aea67 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:27.160644 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1ba2b8e2-0362-437d-ab04-57c9606aea67 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1701 microversion: 2.1 time: 0.173728 Sep 07 14:04:27.161277 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3863/7702] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:26 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1701 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:28.184873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f90b1ffc-aa05-4118-86eb-e64bda548e38 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:28.185611 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f90b1ffc-aa05-4118-86eb-e64bda548e38 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:28.193250 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f90b1ffc-aa05-4118-86eb-e64bda548e38 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:28.193780 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f90b1ffc-aa05-4118-86eb-e64bda548e38 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:28.194225 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f90b1ffc-aa05-4118-86eb-e64bda548e38 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:28.194967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f90b1ffc-aa05-4118-86eb-e64bda548e38 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:28.195408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f90b1ffc-aa05-4118-86eb-e64bda548e38 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:28.195816 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f90b1ffc-aa05-4118-86eb-e64bda548e38 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:28.338234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f90b1ffc-aa05-4118-86eb-e64bda548e38 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:28.347111 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f90b1ffc-aa05-4118-86eb-e64bda548e38 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1701 microversion: 2.1 time: 0.166348 Sep 07 14:04:28.347731 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3840/7703] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:28 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1701 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:29.293343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a58f2d56-7e36-4c19-9c46-34e51a74239e req-f50a85cc-075a-497f-a3a7-b7d8830f1461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6347998-4392-4004-9d2a-e7e710d552fa", "name": "network-vif-plugged", "status": "completed", "tag": "6acd9a55-cdf2-437f-8856-4b7936d4e49a"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:04:29.305332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a58f2d56-7e36-4c19-9c46-34e51a74239e req-f50a85cc-075a-497f-a3a7-b7d8830f1461 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:29.305960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a58f2d56-7e36-4c19-9c46-34e51a74239e req-f50a85cc-075a-497f-a3a7-b7d8830f1461 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:29.306496 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a58f2d56-7e36-4c19-9c46-34e51a74239e req-f50a85cc-075a-497f-a3a7-b7d8830f1461 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:29.321272 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a58f2d56-7e36-4c19-9c46-34e51a74239e req-f50a85cc-075a-497f-a3a7-b7d8830f1461 service nova] Creating event network-vif-plugged:6acd9a55-cdf2-437f-8856-4b7936d4e49a for instance c6347998-4392-4004-9d2a-e7e710d552fa on n-h2-852087-9 Sep 07 14:04:29.329168 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a58f2d56-7e36-4c19-9c46-34e51a74239e req-f50a85cc-075a-497f-a3a7-b7d8830f1461 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114018 Sep 07 14:04:29.330561 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3864/7704] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:04:29.371799 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6d5c1d7e-c152-4548-8b7b-5ea23e211d6d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:29.372943 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6d5c1d7e-c152-4548-8b7b-5ea23e211d6d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:29.382643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d5c1d7e-c152-4548-8b7b-5ea23e211d6d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:29.383699 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d5c1d7e-c152-4548-8b7b-5ea23e211d6d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:29.384071 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d5c1d7e-c152-4548-8b7b-5ea23e211d6d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:29.384878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d5c1d7e-c152-4548-8b7b-5ea23e211d6d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:29.385345 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d5c1d7e-c152-4548-8b7b-5ea23e211d6d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:29.385789 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6d5c1d7e-c152-4548-8b7b-5ea23e211d6d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:29.545905 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6d5c1d7e-c152-4548-8b7b-5ea23e211d6d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:29.553862 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6d5c1d7e-c152-4548-8b7b-5ea23e211d6d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1696 microversion: 2.1 time: 0.186732 Sep 07 14:04:29.554452 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3841/7705] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:29 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1696 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:30.578830 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-43ce4f00-c896-47d6-a276-306629e47f5e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:30.580367 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-43ce4f00-c896-47d6-a276-306629e47f5e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:30.590944 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43ce4f00-c896-47d6-a276-306629e47f5e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:30.592000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43ce4f00-c896-47d6-a276-306629e47f5e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:30.592815 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43ce4f00-c896-47d6-a276-306629e47f5e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:30.593665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43ce4f00-c896-47d6-a276-306629e47f5e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:30.594350 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43ce4f00-c896-47d6-a276-306629e47f5e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:30.594993 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43ce4f00-c896-47d6-a276-306629e47f5e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:30.754459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-43ce4f00-c896-47d6-a276-306629e47f5e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:30.764974 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-43ce4f00-c896-47d6-a276-306629e47f5e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1696 microversion: 2.1 time: 0.190426 Sep 07 14:04:30.765618 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3865/7706] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:30 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1696 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:31.791934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f651eee5-68cd-4098-834f-2dc70c012e4b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:31.793203 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f651eee5-68cd-4098-834f-2dc70c012e4b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:31.800679 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f651eee5-68cd-4098-834f-2dc70c012e4b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:31.801173 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f651eee5-68cd-4098-834f-2dc70c012e4b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:31.801696 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f651eee5-68cd-4098-834f-2dc70c012e4b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:31.802654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f651eee5-68cd-4098-834f-2dc70c012e4b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:31.803116 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f651eee5-68cd-4098-834f-2dc70c012e4b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:31.803578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f651eee5-68cd-4098-834f-2dc70c012e4b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:31.951911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f651eee5-68cd-4098-834f-2dc70c012e4b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:31.963538 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f651eee5-68cd-4098-834f-2dc70c012e4b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1696 microversion: 2.1 time: 0.176735 Sep 07 14:04:31.964138 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3842/7707] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:31 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:32.991283 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-16febc4a-3f26-4fd2-a54e-2db524796d36 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:32.992858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-16febc4a-3f26-4fd2-a54e-2db524796d36 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:32.999207 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16febc4a-3f26-4fd2-a54e-2db524796d36 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:32.999751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16febc4a-3f26-4fd2-a54e-2db524796d36 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:33.000437 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16febc4a-3f26-4fd2-a54e-2db524796d36 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:33.001392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16febc4a-3f26-4fd2-a54e-2db524796d36 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:33.002121 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16febc4a-3f26-4fd2-a54e-2db524796d36 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:33.002821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-16febc4a-3f26-4fd2-a54e-2db524796d36 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:33.162975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-16febc4a-3f26-4fd2-a54e-2db524796d36 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:33.171838 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-16febc4a-3f26-4fd2-a54e-2db524796d36 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1696 microversion: 2.1 time: 0.185699 Sep 07 14:04:33.172450 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3866/7708] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:32 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1696 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:34.199481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7c6f2587-10af-47f7-aa97-cfc34fd31355 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:34.199481 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7c6f2587-10af-47f7-aa97-cfc34fd31355 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:34.206580 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c6f2587-10af-47f7-aa97-cfc34fd31355 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:34.207077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c6f2587-10af-47f7-aa97-cfc34fd31355 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:34.207523 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c6f2587-10af-47f7-aa97-cfc34fd31355 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:34.208237 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c6f2587-10af-47f7-aa97-cfc34fd31355 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:34.208700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c6f2587-10af-47f7-aa97-cfc34fd31355 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:34.209169 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7c6f2587-10af-47f7-aa97-cfc34fd31355 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:34.366464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7c6f2587-10af-47f7-aa97-cfc34fd31355 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:34.375226 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7c6f2587-10af-47f7-aa97-cfc34fd31355 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1696 microversion: 2.1 time: 0.181073 Sep 07 14:04:34.376388 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3843/7709] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:34 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1696 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:35.400060 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-495fd627-e10e-41a5-af46-4e16e1d27885 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:35.400761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-495fd627-e10e-41a5-af46-4e16e1d27885 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:35.408486 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-495fd627-e10e-41a5-af46-4e16e1d27885 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:35.409400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-495fd627-e10e-41a5-af46-4e16e1d27885 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:35.409927 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-495fd627-e10e-41a5-af46-4e16e1d27885 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:35.410665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-495fd627-e10e-41a5-af46-4e16e1d27885 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:35.411343 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-495fd627-e10e-41a5-af46-4e16e1d27885 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:35.411787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-495fd627-e10e-41a5-af46-4e16e1d27885 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:35.965700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-495fd627-e10e-41a5-af46-4e16e1d27885 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:35.975560 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-495fd627-e10e-41a5-af46-4e16e1d27885 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1696 microversion: 2.1 time: 0.579729 Sep 07 14:04:35.977535 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3867/7710] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:35 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1696 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:37.003400 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4e99dc8e-88a1-4259-b6ab-f3ed6e3041ef tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:37.004860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4e99dc8e-88a1-4259-b6ab-f3ed6e3041ef tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:37.012088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e99dc8e-88a1-4259-b6ab-f3ed6e3041ef tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:37.012796 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e99dc8e-88a1-4259-b6ab-f3ed6e3041ef tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:37.013410 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e99dc8e-88a1-4259-b6ab-f3ed6e3041ef tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:37.014172 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e99dc8e-88a1-4259-b6ab-f3ed6e3041ef tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:37.014773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e99dc8e-88a1-4259-b6ab-f3ed6e3041ef tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:37.015204 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4e99dc8e-88a1-4259-b6ab-f3ed6e3041ef tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:37.173289 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4e99dc8e-88a1-4259-b6ab-f3ed6e3041ef tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:37.182134 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4e99dc8e-88a1-4259-b6ab-f3ed6e3041ef tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1696 microversion: 2.1 time: 0.182686 Sep 07 14:04:37.197516 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3844/7711] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:36 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1696 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:38.210047 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cc361bf6-f16e-440b-b0f1-b95dfef0415a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:38.210765 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cc361bf6-f16e-440b-b0f1-b95dfef0415a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:38.218568 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc361bf6-f16e-440b-b0f1-b95dfef0415a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:38.219084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc361bf6-f16e-440b-b0f1-b95dfef0415a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:38.219621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc361bf6-f16e-440b-b0f1-b95dfef0415a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:38.220384 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc361bf6-f16e-440b-b0f1-b95dfef0415a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:38.221179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc361bf6-f16e-440b-b0f1-b95dfef0415a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:38.221660 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cc361bf6-f16e-440b-b0f1-b95dfef0415a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:38.366589 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cc361bf6-f16e-440b-b0f1-b95dfef0415a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:38.374745 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cc361bf6-f16e-440b-b0f1-b95dfef0415a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1696 microversion: 2.1 time: 0.168894 Sep 07 14:04:38.375347 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3868/7712] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:38 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:39.401907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-83ef1099-4ae8-4094-89ea-a4a1a4cd04d0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:39.402928 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-83ef1099-4ae8-4094-89ea-a4a1a4cd04d0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:39.412595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83ef1099-4ae8-4094-89ea-a4a1a4cd04d0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:39.413094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83ef1099-4ae8-4094-89ea-a4a1a4cd04d0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:39.413543 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83ef1099-4ae8-4094-89ea-a4a1a4cd04d0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:39.414276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83ef1099-4ae8-4094-89ea-a4a1a4cd04d0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:39.414733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83ef1099-4ae8-4094-89ea-a4a1a4cd04d0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:39.415160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-83ef1099-4ae8-4094-89ea-a4a1a4cd04d0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:39.562393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-83ef1099-4ae8-4094-89ea-a4a1a4cd04d0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:39.570522 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-83ef1099-4ae8-4094-89ea-a4a1a4cd04d0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1678 microversion: 2.1 time: 0.175380 Sep 07 14:04:39.571123 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3845/7713] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:39 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:40.597902 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-30f6cd0a-ab06-4347-8421-460bc07283f7 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:40.598579 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-30f6cd0a-ab06-4347-8421-460bc07283f7 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:40.606186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30f6cd0a-ab06-4347-8421-460bc07283f7 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:40.606736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30f6cd0a-ab06-4347-8421-460bc07283f7 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:40.607214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30f6cd0a-ab06-4347-8421-460bc07283f7 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:40.608126 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30f6cd0a-ab06-4347-8421-460bc07283f7 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:40.608844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30f6cd0a-ab06-4347-8421-460bc07283f7 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:40.609540 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-30f6cd0a-ab06-4347-8421-460bc07283f7 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:40.761036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-30f6cd0a-ab06-4347-8421-460bc07283f7 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:40.770594 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-30f6cd0a-ab06-4347-8421-460bc07283f7 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1678 microversion: 2.1 time: 0.178171 Sep 07 14:04:40.771803 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3869/7714] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:40 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:41.212199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3faca774-042d-42c0-a15c-c4a3f366916f req-ac80c93f-9f0f-48ff-bd1d-c4d4e0208568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6347998-4392-4004-9d2a-e7e710d552fa", "name": "network-vif-unplugged", "status": "completed", "tag": "6acd9a55-cdf2-437f-8856-4b7936d4e49a"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:04:41.224210 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3faca774-042d-42c0-a15c-c4a3f366916f req-ac80c93f-9f0f-48ff-bd1d-c4d4e0208568 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:41.224734 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3faca774-042d-42c0-a15c-c4a3f366916f req-ac80c93f-9f0f-48ff-bd1d-c4d4e0208568 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:41.225288 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3faca774-042d-42c0-a15c-c4a3f366916f req-ac80c93f-9f0f-48ff-bd1d-c4d4e0208568 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:41.238135 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3faca774-042d-42c0-a15c-c4a3f366916f req-ac80c93f-9f0f-48ff-bd1d-c4d4e0208568 service nova] Creating event network-vif-unplugged:6acd9a55-cdf2-437f-8856-4b7936d4e49a for instance c6347998-4392-4004-9d2a-e7e710d552fa on n-h2-852087-9 Sep 07 14:04:41.243172 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3faca774-042d-42c0-a15c-c4a3f366916f req-ac80c93f-9f0f-48ff-bd1d-c4d4e0208568 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036244 Sep 07 14:04:41.243913 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3846/7715] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:04:41.798763 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9c267f6a-5341-449a-af09-6712a22e42c0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:41.799475 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9c267f6a-5341-449a-af09-6712a22e42c0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:41.806795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c267f6a-5341-449a-af09-6712a22e42c0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:41.807298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c267f6a-5341-449a-af09-6712a22e42c0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:41.807749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c267f6a-5341-449a-af09-6712a22e42c0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:41.808439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c267f6a-5341-449a-af09-6712a22e42c0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:41.808940 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c267f6a-5341-449a-af09-6712a22e42c0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:41.809379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c267f6a-5341-449a-af09-6712a22e42c0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:41.947466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9c267f6a-5341-449a-af09-6712a22e42c0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:41.955779 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9c267f6a-5341-449a-af09-6712a22e42c0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1621 microversion: 2.1 time: 0.161025 Sep 07 14:04:41.956354 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3870/7716] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:41 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1621 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:41.982097 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b60ef7a0-329a-49c4-9a42-8b19964d138f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:04:41.983131 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b60ef7a0-329a-49c4-9a42-8b19964d138f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:41.991300 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b60ef7a0-329a-49c4-9a42-8b19964d138f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:41.991794 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b60ef7a0-329a-49c4-9a42-8b19964d138f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:41.992371 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b60ef7a0-329a-49c4-9a42-8b19964d138f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:41.993081 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b60ef7a0-329a-49c4-9a42-8b19964d138f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:41.993577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b60ef7a0-329a-49c4-9a42-8b19964d138f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:41.994016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b60ef7a0-329a-49c4-9a42-8b19964d138f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:42.039118 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b60ef7a0-329a-49c4-9a42-8b19964d138f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122432) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 14:04:42.115409 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b60ef7a0-329a-49c4-9a42-8b19964d138f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "POST /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa/action" status: 202 len: 0 microversion: 2.1 time: 0.140223 Sep 07 14:04:42.116013 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3847/7717] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 14:04:41 2022] POST /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:04:42.124581 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-77780387-fc89-4379-9c0a-12231806867e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:42.125231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-77780387-fc89-4379-9c0a-12231806867e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:42.131611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77780387-fc89-4379-9c0a-12231806867e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:42.132133 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77780387-fc89-4379-9c0a-12231806867e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:42.132598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77780387-fc89-4379-9c0a-12231806867e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:42.133327 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77780387-fc89-4379-9c0a-12231806867e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:42.133843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77780387-fc89-4379-9c0a-12231806867e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:42.134302 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-77780387-fc89-4379-9c0a-12231806867e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:42.281153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-77780387-fc89-4379-9c0a-12231806867e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:42.289780 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-77780387-fc89-4379-9c0a-12231806867e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1629 microversion: 2.1 time: 0.169120 Sep 07 14:04:42.290375 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3871/7718] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:42 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1629 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:43.315531 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f9f51743-f425-4b8b-a21d-e4632adc088e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:43.316130 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f9f51743-f425-4b8b-a21d-e4632adc088e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:43.322737 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9f51743-f425-4b8b-a21d-e4632adc088e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:43.323212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9f51743-f425-4b8b-a21d-e4632adc088e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:43.323673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9f51743-f425-4b8b-a21d-e4632adc088e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:43.324386 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9f51743-f425-4b8b-a21d-e4632adc088e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:43.324817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9f51743-f425-4b8b-a21d-e4632adc088e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:43.325271 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f9f51743-f425-4b8b-a21d-e4632adc088e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:43.490792 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f9f51743-f425-4b8b-a21d-e4632adc088e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:43.499378 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f9f51743-f425-4b8b-a21d-e4632adc088e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1629 microversion: 2.1 time: 0.188732 Sep 07 14:04:43.499967 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3848/7719] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:43 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1629 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:44.523717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8889b178-8dc1-4db8-9ccc-3bd022b4beeb tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:44.524360 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8889b178-8dc1-4db8-9ccc-3bd022b4beeb tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:44.532498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8889b178-8dc1-4db8-9ccc-3bd022b4beeb tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:44.533212 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8889b178-8dc1-4db8-9ccc-3bd022b4beeb tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:44.533806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8889b178-8dc1-4db8-9ccc-3bd022b4beeb tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:44.534537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8889b178-8dc1-4db8-9ccc-3bd022b4beeb tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:44.535044 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8889b178-8dc1-4db8-9ccc-3bd022b4beeb tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:44.535499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8889b178-8dc1-4db8-9ccc-3bd022b4beeb tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:44.676874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8889b178-8dc1-4db8-9ccc-3bd022b4beeb tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:44.688415 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8889b178-8dc1-4db8-9ccc-3bd022b4beeb tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1629 microversion: 2.1 time: 0.168718 Sep 07 14:04:44.689027 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3872/7720] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:44 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1629 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:45.714319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-81a66653-abbd-4675-8fb3-6b1bde5cc14d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:45.714966 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-81a66653-abbd-4675-8fb3-6b1bde5cc14d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:45.723092 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81a66653-abbd-4675-8fb3-6b1bde5cc14d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:45.723593 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81a66653-abbd-4675-8fb3-6b1bde5cc14d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:45.724030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81a66653-abbd-4675-8fb3-6b1bde5cc14d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:45.724781 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81a66653-abbd-4675-8fb3-6b1bde5cc14d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:45.725245 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81a66653-abbd-4675-8fb3-6b1bde5cc14d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:45.725710 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-81a66653-abbd-4675-8fb3-6b1bde5cc14d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:45.870373 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-81a66653-abbd-4675-8fb3-6b1bde5cc14d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:45.879374 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-81a66653-abbd-4675-8fb3-6b1bde5cc14d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1687 microversion: 2.1 time: 0.169757 Sep 07 14:04:45.880074 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3849/7721] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:45 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:46.907625 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d7c141a0-464b-416c-98c9-b083e6235e55 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:46.908766 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d7c141a0-464b-416c-98c9-b083e6235e55 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:46.912150 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=31 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:04:46.918210 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7c141a0-464b-416c-98c9-b083e6235e55 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:46.918724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7c141a0-464b-416c-98c9-b083e6235e55 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:46.919452 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7c141a0-464b-416c-98c9-b083e6235e55 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:46.920498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7c141a0-464b-416c-98c9-b083e6235e55 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:46.920980 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7c141a0-464b-416c-98c9-b083e6235e55 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:46.921425 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7c141a0-464b-416c-98c9-b083e6235e55 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:46.925213 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:04:47.079420 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d7c141a0-464b-416c-98c9-b083e6235e55 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:47.087793 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d7c141a0-464b-416c-98c9-b083e6235e55 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1687 microversion: 2.1 time: 0.186829 Sep 07 14:04:47.088608 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3873/7722] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:46 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1687 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:48.114649 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-744a03e6-242b-46bd-9e65-ca0dfb3e810e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:48.115391 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-744a03e6-242b-46bd-9e65-ca0dfb3e810e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:48.118824 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:04:48.125462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-744a03e6-242b-46bd-9e65-ca0dfb3e810e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:48.126036 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-744a03e6-242b-46bd-9e65-ca0dfb3e810e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:48.126779 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-744a03e6-242b-46bd-9e65-ca0dfb3e810e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:48.127571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-744a03e6-242b-46bd-9e65-ca0dfb3e810e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:48.128034 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-744a03e6-242b-46bd-9e65-ca0dfb3e810e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:48.132180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-744a03e6-242b-46bd-9e65-ca0dfb3e810e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:48.132687 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:04:48.295874 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-744a03e6-242b-46bd-9e65-ca0dfb3e810e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:48.305226 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-744a03e6-242b-46bd-9e65-ca0dfb3e810e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1687 microversion: 2.1 time: 0.195822 Sep 07 14:04:48.306790 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3850/7723] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:48 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1687 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:49.328747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5e0e9df6-ab12-4c6e-aaec-23d1012b9b7f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:49.329340 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5e0e9df6-ab12-4c6e-aaec-23d1012b9b7f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:49.335832 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e0e9df6-ab12-4c6e-aaec-23d1012b9b7f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:49.336331 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e0e9df6-ab12-4c6e-aaec-23d1012b9b7f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:49.336794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e0e9df6-ab12-4c6e-aaec-23d1012b9b7f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:49.337535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e0e9df6-ab12-4c6e-aaec-23d1012b9b7f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:49.338027 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e0e9df6-ab12-4c6e-aaec-23d1012b9b7f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:49.338472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5e0e9df6-ab12-4c6e-aaec-23d1012b9b7f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:49.489665 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5e0e9df6-ab12-4c6e-aaec-23d1012b9b7f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:49.499546 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5e0e9df6-ab12-4c6e-aaec-23d1012b9b7f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1687 microversion: 2.1 time: 0.174985 Sep 07 14:04:49.500152 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3874/7724] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:49 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1687 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:50.528620 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d2fcaf53-340d-4826-bed6-5d82f648f683 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:50.530738 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d2fcaf53-340d-4826-bed6-5d82f648f683 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:50.540524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2fcaf53-340d-4826-bed6-5d82f648f683 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:50.541208 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2fcaf53-340d-4826-bed6-5d82f648f683 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:50.542749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2fcaf53-340d-4826-bed6-5d82f648f683 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:50.543598 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2fcaf53-340d-4826-bed6-5d82f648f683 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:50.545163 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2fcaf53-340d-4826-bed6-5d82f648f683 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:50.545724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2fcaf53-340d-4826-bed6-5d82f648f683 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:50.711898 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d2fcaf53-340d-4826-bed6-5d82f648f683 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:50.721421 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d2fcaf53-340d-4826-bed6-5d82f648f683 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1687 microversion: 2.1 time: 0.197577 Sep 07 14:04:50.722321 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3851/7725] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:50 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1687 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:04:51.747399 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-4a8f6dd3-c5f4-4d3b-bad7-42c215f26b2b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:51.748466 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-4a8f6dd3-c5f4-4d3b-bad7-42c215f26b2b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:51.755855 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a8f6dd3-c5f4-4d3b-bad7-42c215f26b2b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:51.756552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a8f6dd3-c5f4-4d3b-bad7-42c215f26b2b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:51.757130 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a8f6dd3-c5f4-4d3b-bad7-42c215f26b2b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:51.758073 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a8f6dd3-c5f4-4d3b-bad7-42c215f26b2b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:51.758750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a8f6dd3-c5f4-4d3b-bad7-42c215f26b2b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:51.759249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-4a8f6dd3-c5f4-4d3b-bad7-42c215f26b2b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:51.920968 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-4a8f6dd3-c5f4-4d3b-bad7-42c215f26b2b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:51.929989 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-4a8f6dd3-c5f4-4d3b-bad7-42c215f26b2b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1687 microversion: 2.1 time: 0.187053 Sep 07 14:04:51.930591 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3875/7726] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:51 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1687 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:52.953947 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ef6f7807-16d2-413f-983a-d01c27c374b9 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:52.954576 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ef6f7807-16d2-413f-983a-d01c27c374b9 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:52.962161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef6f7807-16d2-413f-983a-d01c27c374b9 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:52.962654 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef6f7807-16d2-413f-983a-d01c27c374b9 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:52.963090 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef6f7807-16d2-413f-983a-d01c27c374b9 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:52.963974 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef6f7807-16d2-413f-983a-d01c27c374b9 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:52.964433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef6f7807-16d2-413f-983a-d01c27c374b9 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:52.964914 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef6f7807-16d2-413f-983a-d01c27c374b9 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:53.142219 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ef6f7807-16d2-413f-983a-d01c27c374b9 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:53.151217 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ef6f7807-16d2-413f-983a-d01c27c374b9 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1687 microversion: 2.1 time: 0.201314 Sep 07 14:04:53.151827 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3852/7727] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:52 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1687 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:54.177749 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e104f442-b0d3-4640-9aab-f4cc5e0bb1d0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:54.178391 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e104f442-b0d3-4640-9aab-f4cc5e0bb1d0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:54.185938 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e104f442-b0d3-4640-9aab-f4cc5e0bb1d0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:54.186573 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e104f442-b0d3-4640-9aab-f4cc5e0bb1d0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:54.187107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e104f442-b0d3-4640-9aab-f4cc5e0bb1d0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:54.187921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e104f442-b0d3-4640-9aab-f4cc5e0bb1d0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:54.188477 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e104f442-b0d3-4640-9aab-f4cc5e0bb1d0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:54.189017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e104f442-b0d3-4640-9aab-f4cc5e0bb1d0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:54.341370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e104f442-b0d3-4640-9aab-f4cc5e0bb1d0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:54.351577 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e104f442-b0d3-4640-9aab-f4cc5e0bb1d0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1687 microversion: 2.1 time: 0.177974 Sep 07 14:04:54.352269 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3876/7728] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:54 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:55.377180 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7a833af7-ea33-4f38-ab91-7782dd4a424b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:55.377826 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7a833af7-ea33-4f38-ab91-7782dd4a424b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:55.386955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a833af7-ea33-4f38-ab91-7782dd4a424b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:55.387619 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a833af7-ea33-4f38-ab91-7782dd4a424b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:55.388191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a833af7-ea33-4f38-ab91-7782dd4a424b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:55.389138 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a833af7-ea33-4f38-ab91-7782dd4a424b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:55.389772 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a833af7-ea33-4f38-ab91-7782dd4a424b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:55.390323 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7a833af7-ea33-4f38-ab91-7782dd4a424b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:55.544673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7a833af7-ea33-4f38-ab91-7782dd4a424b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:55.553675 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7a833af7-ea33-4f38-ab91-7782dd4a424b tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1687 microversion: 2.1 time: 0.180938 Sep 07 14:04:55.554278 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3853/7729] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:55 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1687 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:56.577222 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e1196b7b-9aba-49c4-a518-62dc8ca2d33e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:56.577972 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e1196b7b-9aba-49c4-a518-62dc8ca2d33e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:56.587708 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1196b7b-9aba-49c4-a518-62dc8ca2d33e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:56.588202 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1196b7b-9aba-49c4-a518-62dc8ca2d33e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:56.588960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1196b7b-9aba-49c4-a518-62dc8ca2d33e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:56.590171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1196b7b-9aba-49c4-a518-62dc8ca2d33e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:56.590877 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1196b7b-9aba-49c4-a518-62dc8ca2d33e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:56.591548 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e1196b7b-9aba-49c4-a518-62dc8ca2d33e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:56.733031 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e1196b7b-9aba-49c4-a518-62dc8ca2d33e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:56.741786 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e1196b7b-9aba-49c4-a518-62dc8ca2d33e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1687 microversion: 2.1 time: 0.168556 Sep 07 14:04:56.742366 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3877/7730] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:56 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:57.765724 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-9d2fdd8e-07bd-4420-b200-77d77b34af54 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:57.766356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-9d2fdd8e-07bd-4420-b200-77d77b34af54 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:57.773963 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d2fdd8e-07bd-4420-b200-77d77b34af54 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:57.774486 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d2fdd8e-07bd-4420-b200-77d77b34af54 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:57.774912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d2fdd8e-07bd-4420-b200-77d77b34af54 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:57.775644 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d2fdd8e-07bd-4420-b200-77d77b34af54 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:57.776110 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d2fdd8e-07bd-4420-b200-77d77b34af54 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:57.776541 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-9d2fdd8e-07bd-4420-b200-77d77b34af54 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:57.933773 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-9d2fdd8e-07bd-4420-b200-77d77b34af54 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:57.942005 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-9d2fdd8e-07bd-4420-b200-77d77b34af54 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1687 microversion: 2.1 time: 0.180233 Sep 07 14:04:57.942616 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3854/7731] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:57 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1687 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:58.965117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-3acff4bb-8562-450c-8e7f-4713b42d1980 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:04:58.965907 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-3acff4bb-8562-450c-8e7f-4713b42d1980 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:04:58.973332 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3acff4bb-8562-450c-8e7f-4713b42d1980 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:58.973883 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3acff4bb-8562-450c-8e7f-4713b42d1980 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:58.974344 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3acff4bb-8562-450c-8e7f-4713b42d1980 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:58.975075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3acff4bb-8562-450c-8e7f-4713b42d1980 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:58.975553 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3acff4bb-8562-450c-8e7f-4713b42d1980 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:58.976000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-3acff4bb-8562-450c-8e7f-4713b42d1980 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:59.137380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-3acff4bb-8562-450c-8e7f-4713b42d1980 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:04:59.149057 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-3acff4bb-8562-450c-8e7f-4713b42d1980 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1687 microversion: 2.1 time: 0.188102 Sep 07 14:04:59.169783 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3878/7732] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:04:58 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1687 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:04:59.346823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-0fbbaf9c-08a5-42d9-9c00-5ea3fb29b4de req-6b3b4cf9-6108-478c-9446-9a613e6df621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6347998-4392-4004-9d2a-e7e710d552fa", "name": "network-vif-plugged", "status": "completed", "tag": "6acd9a55-cdf2-437f-8856-4b7936d4e49a"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:04:59.359789 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0fbbaf9c-08a5-42d9-9c00-5ea3fb29b4de req-6b3b4cf9-6108-478c-9446-9a613e6df621 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:04:59.360304 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0fbbaf9c-08a5-42d9-9c00-5ea3fb29b4de req-6b3b4cf9-6108-478c-9446-9a613e6df621 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:04:59.361155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-0fbbaf9c-08a5-42d9-9c00-5ea3fb29b4de req-6b3b4cf9-6108-478c-9446-9a613e6df621 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:04:59.376855 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-0fbbaf9c-08a5-42d9-9c00-5ea3fb29b4de req-6b3b4cf9-6108-478c-9446-9a613e6df621 service nova] Creating event network-vif-plugged:6acd9a55-cdf2-437f-8856-4b7936d4e49a for instance c6347998-4392-4004-9d2a-e7e710d552fa on n-h2-852087-9 Sep 07 14:04:59.382387 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-0fbbaf9c-08a5-42d9-9c00-5ea3fb29b4de req-6b3b4cf9-6108-478c-9446-9a613e6df621 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039659 Sep 07 14:04:59.383192 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3855/7733] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:05:00.182065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1e9d7223-6f78-4597-b3f4-0c8f13fcbcba tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:05:00.182656 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1e9d7223-6f78-4597-b3f4-0c8f13fcbcba tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:05:00.190193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e9d7223-6f78-4597-b3f4-0c8f13fcbcba tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:05:00.190747 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e9d7223-6f78-4597-b3f4-0c8f13fcbcba tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:05:00.191218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e9d7223-6f78-4597-b3f4-0c8f13fcbcba tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:05:00.191956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e9d7223-6f78-4597-b3f4-0c8f13fcbcba tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:05:00.192439 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e9d7223-6f78-4597-b3f4-0c8f13fcbcba tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:05:00.192890 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e9d7223-6f78-4597-b3f4-0c8f13fcbcba tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:05:00.342711 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1e9d7223-6f78-4597-b3f4-0c8f13fcbcba tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:05:00.351413 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1e9d7223-6f78-4597-b3f4-0c8f13fcbcba tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1687 microversion: 2.1 time: 0.173501 Sep 07 14:05:00.352010 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3879/7734] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:05:00 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:05:01.376631 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2e8516e6-be9c-4ea5-8586-1c14bc14fafe tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:05:01.377688 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2e8516e6-be9c-4ea5-8586-1c14bc14fafe tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:05:01.383944 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e8516e6-be9c-4ea5-8586-1c14bc14fafe tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:05:01.384431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e8516e6-be9c-4ea5-8586-1c14bc14fafe tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:05:01.384865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e8516e6-be9c-4ea5-8586-1c14bc14fafe tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:05:01.385604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e8516e6-be9c-4ea5-8586-1c14bc14fafe tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:05:01.386063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e8516e6-be9c-4ea5-8586-1c14bc14fafe tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:05:01.386482 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2e8516e6-be9c-4ea5-8586-1c14bc14fafe tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:05:01.531303 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2e8516e6-be9c-4ea5-8586-1c14bc14fafe tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:05:01.540571 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2e8516e6-be9c-4ea5-8586-1c14bc14fafe tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1687 microversion: 2.1 time: 0.169214 Sep 07 14:05:01.557510 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3856/7735] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:05:01 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:05:02.567059 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d0575d6f-0145-4c39-b31e-15a3a16d2ccc tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:05:02.567754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d0575d6f-0145-4c39-b31e-15a3a16d2ccc tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:05:02.575298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0575d6f-0145-4c39-b31e-15a3a16d2ccc tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:05:02.575850 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0575d6f-0145-4c39-b31e-15a3a16d2ccc tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:05:02.576298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0575d6f-0145-4c39-b31e-15a3a16d2ccc tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:05:02.577076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0575d6f-0145-4c39-b31e-15a3a16d2ccc tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:05:02.577561 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0575d6f-0145-4c39-b31e-15a3a16d2ccc tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:05:02.578017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d0575d6f-0145-4c39-b31e-15a3a16d2ccc tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:05:02.718028 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d0575d6f-0145-4c39-b31e-15a3a16d2ccc tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:05:02.726735 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d0575d6f-0145-4c39-b31e-15a3a16d2ccc tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1674 microversion: 2.1 time: 0.163814 Sep 07 14:05:02.727303 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3880/7736] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:05:02 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:06:16.571136 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=13 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:06:16.571858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=37 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:06:16.573189 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 14:06:16.573548 n-d-852087-9 devstack@n-api.service[122432]: Wed Sep 7 14:06:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa (ip 10.222.0.16) !!! Sep 07 14:06:16.576967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-a93059de-f002-4652-a72f-9a7c91098985 req-211441ba-ec9a-431e-b7ca-c565b52cd2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6347998-4392-4004-9d2a-e7e710d552fa", "tag": "6acd9a55-cdf2-437f-8856-4b7936d4e49a"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:06:16.579721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-42a23d58-21a0-4e77-949b-4410c162f59e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:06:16.580229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-42a23d58-21a0-4e77-949b-4410c162f59e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:06:16.587296 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=15 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:06:16.588851 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=47 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:06:16.590176 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42a23d58-21a0-4e77-949b-4410c162f59e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:16.590362 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 14:06:16.590468 n-d-852087-9 devstack@n-api.service[122433]: Wed Sep 7 14:06:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Sep 07 14:06:16.591130 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42a23d58-21a0-4e77-949b-4410c162f59e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:16.591550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42a23d58-21a0-4e77-949b-4410c162f59e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:16.591820 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 14:06:16.592447 n-d-852087-9 devstack@n-api.service[122433]: Wed Sep 7 14:06:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Sep 07 14:06:16.592692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42a23d58-21a0-4e77-949b-4410c162f59e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:16.592926 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42a23d58-21a0-4e77-949b-4410c162f59e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:16.593665 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-42a23d58-21a0-4e77-949b-4410c162f59e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:16.595036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a93059de-f002-4652-a72f-9a7c91098985 req-211441ba-ec9a-431e-b7ca-c565b52cd2b9 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:16.595850 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a93059de-f002-4652-a72f-9a7c91098985 req-211441ba-ec9a-431e-b7ca-c565b52cd2b9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:16.596297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-a93059de-f002-4652-a72f-9a7c91098985 req-211441ba-ec9a-431e-b7ca-c565b52cd2b9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:16.613323 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-a93059de-f002-4652-a72f-9a7c91098985 req-211441ba-ec9a-431e-b7ca-c565b52cd2b9 service nova] Creating event network-changed:6acd9a55-cdf2-437f-8856-4b7936d4e49a for instance c6347998-4392-4004-9d2a-e7e710d552fa on n-h2-852087-9 Sep 07 14:06:16.622412 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-a93059de-f002-4652-a72f-9a7c91098985 req-211441ba-ec9a-431e-b7ca-c565b52cd2b9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050913 Sep 07 14:06:16.628646 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3881/7737] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:06:16.631347 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-42a23d58-21a0-4e77-949b-4410c162f59e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:06:16.729807 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-42a23d58-21a0-4e77-949b-4410c162f59e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 204 len: 0 microversion: 2.1 time: 0.160459 Sep 07 14:06:16.731118 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3857/7738] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 14:06:16 2022] DELETE /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 14:06:16.740963 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-89b1cbda-be53-4449-90ce-09026540bd19 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:06:16.741734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-89b1cbda-be53-4449-90ce-09026540bd19 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:06:16.750593 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89b1cbda-be53-4449-90ce-09026540bd19 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:16.751109 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89b1cbda-be53-4449-90ce-09026540bd19 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:16.751569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89b1cbda-be53-4449-90ce-09026540bd19 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:16.752303 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89b1cbda-be53-4449-90ce-09026540bd19 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:16.752782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89b1cbda-be53-4449-90ce-09026540bd19 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:16.753236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89b1cbda-be53-4449-90ce-09026540bd19 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:16.900265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-89b1cbda-be53-4449-90ce-09026540bd19 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:06:16.910126 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-89b1cbda-be53-4449-90ce-09026540bd19 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1680 microversion: 2.1 time: 0.174192 Sep 07 14:06:16.910758 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3882/7739] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:06:16 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:06:17.935629 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eefb93f1-6603-44d7-9f00-073bc9a31860 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:06:17.936315 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eefb93f1-6603-44d7-9f00-073bc9a31860 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:06:17.945021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eefb93f1-6603-44d7-9f00-073bc9a31860 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:17.945771 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eefb93f1-6603-44d7-9f00-073bc9a31860 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:17.946533 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eefb93f1-6603-44d7-9f00-073bc9a31860 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:17.947522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eefb93f1-6603-44d7-9f00-073bc9a31860 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:17.948088 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eefb93f1-6603-44d7-9f00-073bc9a31860 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:17.948689 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eefb93f1-6603-44d7-9f00-073bc9a31860 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:18.096408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eefb93f1-6603-44d7-9f00-073bc9a31860 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:06:18.109158 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eefb93f1-6603-44d7-9f00-073bc9a31860 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1680 microversion: 2.1 time: 0.177689 Sep 07 14:06:18.109942 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3858/7740] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:06:17 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:06:18.839293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-df6eff99-6ab3-4f6f-ba9d-358f4a7078ca req-1e853385-42bb-464e-9f0f-be70a594506e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6347998-4392-4004-9d2a-e7e710d552fa", "name": "network-vif-deleted", "tag": "6acd9a55-cdf2-437f-8856-4b7936d4e49a"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:06:18.850189 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-df6eff99-6ab3-4f6f-ba9d-358f4a7078ca req-1e853385-42bb-464e-9f0f-be70a594506e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:18.850729 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-df6eff99-6ab3-4f6f-ba9d-358f4a7078ca req-1e853385-42bb-464e-9f0f-be70a594506e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:18.851188 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-df6eff99-6ab3-4f6f-ba9d-358f4a7078ca req-1e853385-42bb-464e-9f0f-be70a594506e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:18.862797 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-df6eff99-6ab3-4f6f-ba9d-358f4a7078ca req-1e853385-42bb-464e-9f0f-be70a594506e service nova] Creating event network-vif-deleted:6acd9a55-cdf2-437f-8856-4b7936d4e49a for instance c6347998-4392-4004-9d2a-e7e710d552fa on n-h2-852087-9 Sep 07 14:06:18.869100 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-df6eff99-6ab3-4f6f-ba9d-358f4a7078ca req-1e853385-42bb-464e-9f0f-be70a594506e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033717 Sep 07 14:06:18.869633 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3883/7741] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:06:19.137933 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-74549839-c612-415b-abeb-d1c56657988f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:06:19.139240 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-74549839-c612-415b-abeb-d1c56657988f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:06:19.146215 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74549839-c612-415b-abeb-d1c56657988f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:19.146719 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74549839-c612-415b-abeb-d1c56657988f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:19.147218 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74549839-c612-415b-abeb-d1c56657988f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:19.147872 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74549839-c612-415b-abeb-d1c56657988f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:19.148334 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74549839-c612-415b-abeb-d1c56657988f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:19.148765 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74549839-c612-415b-abeb-d1c56657988f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:19.185045 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74549839-c612-415b-abeb-d1c56657988f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:19.185569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74549839-c612-415b-abeb-d1c56657988f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:19.186010 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-74549839-c612-415b-abeb-d1c56657988f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:19.186464 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-74549839-c612-415b-abeb-d1c56657988f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lazy-loading 'fault' on Instance uuid c6347998-4392-4004-9d2a-e7e710d552fa {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:06:19.230384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-74549839-c612-415b-abeb-d1c56657988f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:06:19.238843 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-74549839-c612-415b-abeb-d1c56657988f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 200 len: 1336 microversion: 2.1 time: 0.105058 Sep 07 14:06:19.239460 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3859/7742] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:06:19 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 1336 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:06:20.266156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ef826328-4066-4543-b355-ebef037f1220 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:06:20.266156 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ef826328-4066-4543-b355-ebef037f1220 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: c6347998-4392-4004-9d2a-e7e710d552fa] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:06:20.272644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef826328-4066-4543-b355-ebef037f1220 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:20.273159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef826328-4066-4543-b355-ebef037f1220 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:20.273661 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef826328-4066-4543-b355-ebef037f1220 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:20.274387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef826328-4066-4543-b355-ebef037f1220 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:20.274864 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef826328-4066-4543-b355-ebef037f1220 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:20.275313 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ef826328-4066-4543-b355-ebef037f1220 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:20.289151 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-ef826328-4066-4543-b355-ebef037f1220 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] HTTP exception thrown: Instance c6347998-4392-4004-9d2a-e7e710d552fa could not be found. Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ef826328-4066-4543-b355-ebef037f1220 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Request method failure captured: Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa HTTP/1.1 Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGKRXqvl9BZVOfCmHOAmMpNwEQHEHBCKKop1RhFoRLl6NOHAFSq8rMH4chcdNfxOkDaIZuLMok34o9f4wZoQy9WRboq9Tl2WXuqCoy5wYrMQ9Lu3oNTyWtu2S_ZXMeDSw4sG9T4ihKhjAJbkz0ZCjF0MSmFT3h1CpRpRnv9Kvy0gexek Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: ba713b04eba14c9d93feaa41938527b8 Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TestShelveInstance-1852937033 Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba713b04eba14c9d93feaa41938527b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba713b04eba14c9d93feaa41938527b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba713b04eba14c9d93feaa41938527b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba713b04eba14c9d93feaa41938527b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TestShelveInstance-1852937033 Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: ba713b04eba14c9d93feaa41938527b8 Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestShelveInstance-1852937033 Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TestShelveInstance-1852937033-project Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 84652ff0847947a89cca9bf0a81cf6ab Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TestShelveInstance-1852937033-project Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance c6347998-4392-4004-9d2a-e7e710d552fa could not be found. Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': 'c6347998-4392-4004-9d2a-e7e710d552fa'} Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6347998-4392-4004-9d2a-e7e710d552fa could not be found. Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6347998-4392-4004-9d2a-e7e710d552fa could not be found. Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:06:20.290869 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 14:06:20.295702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:06:20.295702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:06:20.295702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:06:20.295702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:06:20.295702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:06:20.295702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6347998-4392-4004-9d2a-e7e710d552fa could not be found. Sep 07 14:06:20.295702 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 14:06:20.295702 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ef826328-4066-4543-b355-ebef037f1220 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Returning 404 to user: Instance c6347998-4392-4004-9d2a-e7e710d552fa could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:06:20.295702 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ef826328-4066-4543-b355-ebef037f1220 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa" status: 404 len: 111 microversion: 2.1 time: 0.033345 Sep 07 14:06:20.295702 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3884/7743] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:06:20 2022] GET /compute/v2.1/servers/c6347998-4392-4004-9d2a-e7e710d552fa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:06:20.469069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a5cbe763-aa51-40e5-a888-5107ac715be4 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '.version_select at 0x7fc419487820>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:06:20.504562 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a5cbe763-aa51-40e5-a888-5107ac715be4 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-826383775" status: 202 len: 0 microversion: 2.1 time: 0.039361 Sep 07 14:06:20.505143 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3860/7744] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Sep 7 14:06:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-826383775 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:06:20.532736 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d8623d17-e365-465c-84fc-adbed14f2712 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Action: 'create', calling method: .version_select at 0x7fc413fa5c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-928209985", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCs2rXVRqKJqXufsPFenT6RXySiFFoAkodbHDd/TJ0obYCQCRGWlKEuzaL38X+2Pl3I/wTpesZCHJey3RzYsti4SRJOzWHXq9odGNvfAvoGPCdmuNHuwZEQYykYQXJZhWQ=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:06:20.548311 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-d8623d17-e365-465c-84fc-adbed14f2712 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Getting quotas for project ba713b04eba14c9d93feaa41938527b8. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:06:20.553717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-d8623d17-e365-465c-84fc-adbed14f2712 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Getting quotas for user 84652ff0847947a89cca9bf0a81cf6ab and project ba713b04eba14c9d93feaa41938527b8. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:06:20.590419 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d8623d17-e365-465c-84fc-adbed14f2712 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.061081 Sep 07 14:06:20.591200 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3885/7745] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 14:06:20 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:06:37.998139 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:06:37.998888 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:06:38.002904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bdf82877-4ec6-4b1b-aa5a-e0fa241cb5ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-935447933", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-928209985", "security_groups": [{"name": "tempest-secgroup-smoke-1859692029"}], "networks": [{"uuid": "10b218c5-5ae6-4498-9a5d-36154531c267"}], "block_device_mapping_v2": [{"uuid": "77c1079a-0bdf-4ccb-a8e1-02c74ee5b09e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:06:38.124411 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-bdf82877-4ec6-4b1b-aa5a-e0fa241cb5ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] validate_networks() for [('10b218c5-5ae6-4498-9a5d-36154531c267', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 14:06:38.593996 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bdf82877-4ec6-4b1b-aa5a-e0fa241cb5ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 14:06:38.594428 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bdf82877-4ec6-4b1b-aa5a-e0fa241cb5ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 14:06:38.595037 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bdf82877-4ec6-4b1b-aa5a-e0fa241cb5ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 14:06:38.595777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bdf82877-4ec6-4b1b-aa5a-e0fa241cb5ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 14:06:38.596198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-bdf82877-4ec6-4b1b-aa5a-e0fa241cb5ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 14:06:38.605777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdf82877-4ec6-4b1b-aa5a-e0fa241cb5ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:38.606266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdf82877-4ec6-4b1b-aa5a-e0fa241cb5ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:38.606712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdf82877-4ec6-4b1b-aa5a-e0fa241cb5ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:38.607442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdf82877-4ec6-4b1b-aa5a-e0fa241cb5ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:38.607899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdf82877-4ec6-4b1b-aa5a-e0fa241cb5ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:38.608324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bdf82877-4ec6-4b1b-aa5a-e0fa241cb5ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:38.626396 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-bdf82877-4ec6-4b1b-aa5a-e0fa241cb5ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Getting quotas for project ba713b04eba14c9d93feaa41938527b8. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:06:38.631981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-bdf82877-4ec6-4b1b-aa5a-e0fa241cb5ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Getting quotas for user 84652ff0847947a89cca9bf0a81cf6ab and project ba713b04eba14c9d93feaa41938527b8. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:06:38.698871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bdf82877-4ec6-4b1b-aa5a-e0fa241cb5ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 14:06:38.701082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bdf82877-4ec6-4b1b-aa5a-e0fa241cb5ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='77c1079a-0bdf-4ccb-a8e1-02c74ee5b09e',volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 14:06:38.845143 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bdf82877-4ec6-4b1b-aa5a-e0fa241cb5ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.848788 Sep 07 14:06:38.846241 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3861/7746] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 14:06:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 14:06:38.855382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=12 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:06:38.856621 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=4 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:06:38.857370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:06:38.864051 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-63b19b8c-f8c1-4dca-9f51-95177d268ef7 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:06:38.866128 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-63b19b8c-f8c1-4dca-9f51-95177d268ef7 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:06:38.931144 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-63b19b8c-f8c1-4dca-9f51-95177d268ef7 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:06:38.939005 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-63b19b8c-f8c1-4dca-9f51-95177d268ef7 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1087 microversion: 2.1 time: 0.085480 Sep 07 14:06:38.939572 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3886/7747] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:06:38 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1087 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:06:39.966825 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-482ff9f0-407a-4fac-936a-0abaa802e3c8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:06:39.967485 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-482ff9f0-407a-4fac-936a-0abaa802e3c8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:06:39.976051 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-482ff9f0-407a-4fac-936a-0abaa802e3c8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:39.976556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-482ff9f0-407a-4fac-936a-0abaa802e3c8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:39.977004 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-482ff9f0-407a-4fac-936a-0abaa802e3c8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:39.977767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-482ff9f0-407a-4fac-936a-0abaa802e3c8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:39.978232 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-482ff9f0-407a-4fac-936a-0abaa802e3c8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:39.978892 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-482ff9f0-407a-4fac-936a-0abaa802e3c8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:40.052199 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-482ff9f0-407a-4fac-936a-0abaa802e3c8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:06:40.063884 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-482ff9f0-407a-4fac-936a-0abaa802e3c8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1185 microversion: 2.1 time: 0.101210 Sep 07 14:06:40.064490 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3862/7748] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:06:39 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:06:41.095933 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c6d5726a-eb9f-420c-82e3-ff7db2abba96 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:06:41.100498 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c6d5726a-eb9f-420c-82e3-ff7db2abba96 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:06:41.115855 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6d5726a-eb9f-420c-82e3-ff7db2abba96 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:41.116813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6d5726a-eb9f-420c-82e3-ff7db2abba96 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:41.117608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6d5726a-eb9f-420c-82e3-ff7db2abba96 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:41.120640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6d5726a-eb9f-420c-82e3-ff7db2abba96 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:41.121529 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6d5726a-eb9f-420c-82e3-ff7db2abba96 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:41.134583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c6d5726a-eb9f-420c-82e3-ff7db2abba96 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:41.370166 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-c6d5726a-eb9f-420c-82e3-ff7db2abba96 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:06:41.379030 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c6d5726a-eb9f-420c-82e3-ff7db2abba96 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1271 microversion: 2.1 time: 0.287391 Sep 07 14:06:41.379952 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3887/7749] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:06:41 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1271 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:06:41.640755 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-9e309f9f-e296-4bb0-84c7-aac0278be88c req-3153af83-c228-4c1a-92ea-fa4dfbcaa683 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "357c12a2-17d7-4054-86c9-9e41869f0c64", "tag": "d0fe1bc5-206f-4a77-a681-82f2d36381f4"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:06:41.653860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9e309f9f-e296-4bb0-84c7-aac0278be88c req-3153af83-c228-4c1a-92ea-fa4dfbcaa683 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:41.654732 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9e309f9f-e296-4bb0-84c7-aac0278be88c req-3153af83-c228-4c1a-92ea-fa4dfbcaa683 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:41.655433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-9e309f9f-e296-4bb0-84c7-aac0278be88c req-3153af83-c228-4c1a-92ea-fa4dfbcaa683 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:41.670981 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-9e309f9f-e296-4bb0-84c7-aac0278be88c req-3153af83-c228-4c1a-92ea-fa4dfbcaa683 service nova] Creating event network-changed:d0fe1bc5-206f-4a77-a681-82f2d36381f4 for instance 357c12a2-17d7-4054-86c9-9e41869f0c64 on n-h2-852087-9 Sep 07 14:06:41.677593 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-9e309f9f-e296-4bb0-84c7-aac0278be88c req-3153af83-c228-4c1a-92ea-fa4dfbcaa683 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041142 Sep 07 14:06:41.690435 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3863/7750] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:06:42.403571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-72ad7bae-daf0-4d56-ab77-8c8fa901739a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:06:42.404843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-72ad7bae-daf0-4d56-ab77-8c8fa901739a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:06:42.412026 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72ad7bae-daf0-4d56-ab77-8c8fa901739a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:42.412545 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72ad7bae-daf0-4d56-ab77-8c8fa901739a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:42.413006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72ad7bae-daf0-4d56-ab77-8c8fa901739a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:42.413911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72ad7bae-daf0-4d56-ab77-8c8fa901739a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:42.414611 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72ad7bae-daf0-4d56-ab77-8c8fa901739a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:42.415062 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-72ad7bae-daf0-4d56-ab77-8c8fa901739a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:42.670885 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-72ad7bae-daf0-4d56-ab77-8c8fa901739a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:06:42.679645 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-72ad7bae-daf0-4d56-ab77-8c8fa901739a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1271 microversion: 2.1 time: 0.279993 Sep 07 14:06:42.680234 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3888/7751] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:06:42 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1271 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:06:43.705161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-993c25e3-8204-421c-9355-a0392cab6e87 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:06:43.705904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-993c25e3-8204-421c-9355-a0392cab6e87 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:06:43.712552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-993c25e3-8204-421c-9355-a0392cab6e87 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:43.713336 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-993c25e3-8204-421c-9355-a0392cab6e87 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:43.713811 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-993c25e3-8204-421c-9355-a0392cab6e87 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:43.714501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-993c25e3-8204-421c-9355-a0392cab6e87 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:43.714955 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-993c25e3-8204-421c-9355-a0392cab6e87 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:43.715385 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-993c25e3-8204-421c-9355-a0392cab6e87 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:43.855749 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-993c25e3-8204-421c-9355-a0392cab6e87 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:06:43.865879 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-993c25e3-8204-421c-9355-a0392cab6e87 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1271 microversion: 2.1 time: 0.165856 Sep 07 14:06:43.866531 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3864/7752] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:06:43 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:06:44.890790 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-cda6acaa-4e7f-4db2-b273-b06e60fd4ebd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:06:44.891705 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-cda6acaa-4e7f-4db2-b273-b06e60fd4ebd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:06:44.899417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cda6acaa-4e7f-4db2-b273-b06e60fd4ebd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:44.899941 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cda6acaa-4e7f-4db2-b273-b06e60fd4ebd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:44.900655 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cda6acaa-4e7f-4db2-b273-b06e60fd4ebd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:44.901917 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cda6acaa-4e7f-4db2-b273-b06e60fd4ebd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:44.902629 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cda6acaa-4e7f-4db2-b273-b06e60fd4ebd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:44.903276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-cda6acaa-4e7f-4db2-b273-b06e60fd4ebd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:45.054493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-cda6acaa-4e7f-4db2-b273-b06e60fd4ebd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:06:45.062844 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-cda6acaa-4e7f-4db2-b273-b06e60fd4ebd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1271 microversion: 2.1 time: 0.176220 Sep 07 14:06:45.063737 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3889/7753] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:06:44 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1271 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:06:46.087750 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-704474af-7861-40a9-a9c7-6a7e6f0357db tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:06:46.088442 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-704474af-7861-40a9-a9c7-6a7e6f0357db tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:06:46.096577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-704474af-7861-40a9-a9c7-6a7e6f0357db tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:46.097063 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-704474af-7861-40a9-a9c7-6a7e6f0357db tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:46.097513 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-704474af-7861-40a9-a9c7-6a7e6f0357db tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:46.098235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-704474af-7861-40a9-a9c7-6a7e6f0357db tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:46.098720 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-704474af-7861-40a9-a9c7-6a7e6f0357db tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:46.099143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-704474af-7861-40a9-a9c7-6a7e6f0357db tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:46.245073 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-704474af-7861-40a9-a9c7-6a7e6f0357db tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:06:46.257023 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-704474af-7861-40a9-a9c7-6a7e6f0357db tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1259 microversion: 2.1 time: 0.173441 Sep 07 14:06:46.257926 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3865/7754] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:06:46 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:06:47.284214 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0b099278-0eaf-4389-ab38-be5bba826871 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:06:47.284845 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0b099278-0eaf-4389-ab38-be5bba826871 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:06:47.293347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b099278-0eaf-4389-ab38-be5bba826871 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:47.293916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b099278-0eaf-4389-ab38-be5bba826871 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:47.294417 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b099278-0eaf-4389-ab38-be5bba826871 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:47.295309 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b099278-0eaf-4389-ab38-be5bba826871 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:47.295787 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b099278-0eaf-4389-ab38-be5bba826871 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:47.296237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b099278-0eaf-4389-ab38-be5bba826871 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:47.436075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0b099278-0eaf-4389-ab38-be5bba826871 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:06:47.444777 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0b099278-0eaf-4389-ab38-be5bba826871 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1259 microversion: 2.1 time: 0.164865 Sep 07 14:06:47.445337 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3890/7755] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:06:47 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:06:48.470209 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ae71bfd7-2379-4798-9ced-a7c5e7da9ba1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:06:48.471125 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ae71bfd7-2379-4798-9ced-a7c5e7da9ba1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:06:48.478647 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae71bfd7-2379-4798-9ced-a7c5e7da9ba1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:48.479141 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae71bfd7-2379-4798-9ced-a7c5e7da9ba1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:48.479606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae71bfd7-2379-4798-9ced-a7c5e7da9ba1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:48.480280 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae71bfd7-2379-4798-9ced-a7c5e7da9ba1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:48.485566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae71bfd7-2379-4798-9ced-a7c5e7da9ba1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:48.485566 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ae71bfd7-2379-4798-9ced-a7c5e7da9ba1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:48.616005 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:06:48.632021 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ae71bfd7-2379-4798-9ced-a7c5e7da9ba1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:06:48.640058 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ae71bfd7-2379-4798-9ced-a7c5e7da9ba1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1259 microversion: 2.1 time: 0.175244 Sep 07 14:06:48.640744 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3866/7756] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:06:48 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:06:49.670816 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-df2cc6fe-c4f8-4666-987a-92781417163d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:06:49.671404 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-df2cc6fe-c4f8-4666-987a-92781417163d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:06:49.673760 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:06:49.679224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df2cc6fe-c4f8-4666-987a-92781417163d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:49.679724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df2cc6fe-c4f8-4666-987a-92781417163d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:49.680169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df2cc6fe-c4f8-4666-987a-92781417163d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:49.680884 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df2cc6fe-c4f8-4666-987a-92781417163d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:49.681355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df2cc6fe-c4f8-4666-987a-92781417163d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:49.681827 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-df2cc6fe-c4f8-4666-987a-92781417163d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:49.833478 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-df2cc6fe-c4f8-4666-987a-92781417163d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:06:49.841495 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-df2cc6fe-c4f8-4666-987a-92781417163d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1259 microversion: 2.1 time: 0.174839 Sep 07 14:06:49.842177 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3891/7757] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:06:49 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:06:50.864881 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7649e038-118e-4f12-99ba-0c658c22b958 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:06:50.866527 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7649e038-118e-4f12-99ba-0c658c22b958 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:06:50.868437 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:06:50.874127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7649e038-118e-4f12-99ba-0c658c22b958 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:50.874626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7649e038-118e-4f12-99ba-0c658c22b958 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:50.875068 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7649e038-118e-4f12-99ba-0c658c22b958 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:50.875753 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7649e038-118e-4f12-99ba-0c658c22b958 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:50.876212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7649e038-118e-4f12-99ba-0c658c22b958 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:50.876716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7649e038-118e-4f12-99ba-0c658c22b958 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:51.018807 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7649e038-118e-4f12-99ba-0c658c22b958 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:06:51.032068 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7649e038-118e-4f12-99ba-0c658c22b958 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1259 microversion: 2.1 time: 0.171340 Sep 07 14:06:51.033012 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3867/7758] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:06:50 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:06:52.061024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1f878cb7-58f5-485e-8527-db1de546cbc0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:06:52.061673 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1f878cb7-58f5-485e-8527-db1de546cbc0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:06:52.069645 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f878cb7-58f5-485e-8527-db1de546cbc0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:52.070153 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f878cb7-58f5-485e-8527-db1de546cbc0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:52.070634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f878cb7-58f5-485e-8527-db1de546cbc0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:52.071328 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f878cb7-58f5-485e-8527-db1de546cbc0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:52.071806 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f878cb7-58f5-485e-8527-db1de546cbc0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:52.072248 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1f878cb7-58f5-485e-8527-db1de546cbc0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:52.218169 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1f878cb7-58f5-485e-8527-db1de546cbc0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:06:52.227171 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1f878cb7-58f5-485e-8527-db1de546cbc0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1259 microversion: 2.1 time: 0.170263 Sep 07 14:06:52.227763 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3892/7759] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:06:52 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:06:53.252766 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-68adc7a8-5309-452c-a32e-970c80928aa1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:06:53.253341 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-68adc7a8-5309-452c-a32e-970c80928aa1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:06:53.260871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68adc7a8-5309-452c-a32e-970c80928aa1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:53.261356 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68adc7a8-5309-452c-a32e-970c80928aa1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:53.261831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68adc7a8-5309-452c-a32e-970c80928aa1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:53.262515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68adc7a8-5309-452c-a32e-970c80928aa1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:53.262978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68adc7a8-5309-452c-a32e-970c80928aa1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:53.263397 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-68adc7a8-5309-452c-a32e-970c80928aa1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:53.407457 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-68adc7a8-5309-452c-a32e-970c80928aa1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:06:53.416124 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-68adc7a8-5309-452c-a32e-970c80928aa1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1259 microversion: 2.1 time: 0.167382 Sep 07 14:06:53.416705 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3868/7760] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:06:53 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:06:54.440042 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b2b9aea4-72f0-4fe7-9472-820e5ebb84ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:06:54.440684 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b2b9aea4-72f0-4fe7-9472-820e5ebb84ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:06:54.448025 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2b9aea4-72f0-4fe7-9472-820e5ebb84ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:54.448520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2b9aea4-72f0-4fe7-9472-820e5ebb84ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:54.449002 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2b9aea4-72f0-4fe7-9472-820e5ebb84ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:54.449768 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2b9aea4-72f0-4fe7-9472-820e5ebb84ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:54.450249 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2b9aea4-72f0-4fe7-9472-820e5ebb84ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:54.450700 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b2b9aea4-72f0-4fe7-9472-820e5ebb84ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:54.590433 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b2b9aea4-72f0-4fe7-9472-820e5ebb84ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:06:54.601196 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b2b9aea4-72f0-4fe7-9472-820e5ebb84ff tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1259 microversion: 2.1 time: 0.165092 Sep 07 14:06:54.601863 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3893/7761] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:06:54 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:06:55.627783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-eb99c829-cdaa-4d1a-b288-733b98dea39d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:06:55.628630 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-eb99c829-cdaa-4d1a-b288-733b98dea39d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:06:55.636873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb99c829-cdaa-4d1a-b288-733b98dea39d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:55.637360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb99c829-cdaa-4d1a-b288-733b98dea39d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:55.637841 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb99c829-cdaa-4d1a-b288-733b98dea39d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:55.638550 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb99c829-cdaa-4d1a-b288-733b98dea39d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:55.638981 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb99c829-cdaa-4d1a-b288-733b98dea39d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:55.639577 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-eb99c829-cdaa-4d1a-b288-733b98dea39d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:55.787535 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-eb99c829-cdaa-4d1a-b288-733b98dea39d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:06:55.799034 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-eb99c829-cdaa-4d1a-b288-733b98dea39d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1259 microversion: 2.1 time: 0.175946 Sep 07 14:06:55.799616 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3869/7762] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:06:55 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:06:56.034814 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-1473629a-92e4-4665-9015-b94daa75f18c req-a35a42ee-d2f4-4c1d-bfae-f77c0638af9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "357c12a2-17d7-4054-86c9-9e41869f0c64", "name": "network-vif-plugged", "status": "completed", "tag": "d0fe1bc5-206f-4a77-a681-82f2d36381f4"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:06:56.049193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1473629a-92e4-4665-9015-b94daa75f18c req-a35a42ee-d2f4-4c1d-bfae-f77c0638af9f service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:56.049967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1473629a-92e4-4665-9015-b94daa75f18c req-a35a42ee-d2f4-4c1d-bfae-f77c0638af9f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:56.050427 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-1473629a-92e4-4665-9015-b94daa75f18c req-a35a42ee-d2f4-4c1d-bfae-f77c0638af9f service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:56.062063 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-1473629a-92e4-4665-9015-b94daa75f18c req-a35a42ee-d2f4-4c1d-bfae-f77c0638af9f service nova] Creating event network-vif-plugged:d0fe1bc5-206f-4a77-a681-82f2d36381f4 for instance 357c12a2-17d7-4054-86c9-9e41869f0c64 on n-h2-852087-9 Sep 07 14:06:56.067765 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-1473629a-92e4-4665-9015-b94daa75f18c req-a35a42ee-d2f4-4c1d-bfae-f77c0638af9f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036973 Sep 07 14:06:56.068383 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3894/7763] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:06:56.823522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d2ad0ada-9a28-415f-ae72-17d25f63eb28 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:06:56.824147 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d2ad0ada-9a28-415f-ae72-17d25f63eb28 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:06:56.831231 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2ad0ada-9a28-415f-ae72-17d25f63eb28 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:56.831716 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2ad0ada-9a28-415f-ae72-17d25f63eb28 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:56.832161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2ad0ada-9a28-415f-ae72-17d25f63eb28 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:56.832857 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2ad0ada-9a28-415f-ae72-17d25f63eb28 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:56.833316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2ad0ada-9a28-415f-ae72-17d25f63eb28 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:56.833770 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d2ad0ada-9a28-415f-ae72-17d25f63eb28 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:56.979680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d2ad0ada-9a28-415f-ae72-17d25f63eb28 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:06:56.991847 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d2ad0ada-9a28-415f-ae72-17d25f63eb28 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1259 microversion: 2.1 time: 0.172309 Sep 07 14:06:56.992470 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3870/7764] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:06:56 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:06:58.019046 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-38bb09f7-c5d8-4081-b0ca-17d2dc646dfd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:06:58.019905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-38bb09f7-c5d8-4081-b0ca-17d2dc646dfd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:06:58.027355 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38bb09f7-c5d8-4081-b0ca-17d2dc646dfd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:58.027911 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38bb09f7-c5d8-4081-b0ca-17d2dc646dfd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:58.028400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38bb09f7-c5d8-4081-b0ca-17d2dc646dfd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:58.029110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38bb09f7-c5d8-4081-b0ca-17d2dc646dfd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:58.029615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38bb09f7-c5d8-4081-b0ca-17d2dc646dfd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:58.030064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-38bb09f7-c5d8-4081-b0ca-17d2dc646dfd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:58.168952 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-38bb09f7-c5d8-4081-b0ca-17d2dc646dfd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:06:58.182891 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-38bb09f7-c5d8-4081-b0ca-17d2dc646dfd tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1442 microversion: 2.1 time: 0.167963 Sep 07 14:06:58.183758 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3895/7765] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:06:58 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1442 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:06:58.206854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5aeb4082-9e00-4f56-aade-8632cbdccca3 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:06:58.207516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5aeb4082-9e00-4f56-aade-8632cbdccca3 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:06:58.215084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5aeb4082-9e00-4f56-aade-8632cbdccca3 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:58.215583 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5aeb4082-9e00-4f56-aade-8632cbdccca3 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:58.216029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5aeb4082-9e00-4f56-aade-8632cbdccca3 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:58.216744 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5aeb4082-9e00-4f56-aade-8632cbdccca3 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:06:58.217205 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5aeb4082-9e00-4f56-aade-8632cbdccca3 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:06:58.217685 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5aeb4082-9e00-4f56-aade-8632cbdccca3 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:06:58.359694 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5aeb4082-9e00-4f56-aade-8632cbdccca3 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:06:58.370125 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5aeb4082-9e00-4f56-aade-8632cbdccca3 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1442 microversion: 2.1 time: 0.167185 Sep 07 14:06:58.370712 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3871/7766] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:06:58 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1442 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:07:00.099661 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-83ff966f-3da2-4f68-b428-ef0ddb10513f req-8049e447-c53a-43f4-b4aa-eed4007c2b73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "357c12a2-17d7-4054-86c9-9e41869f0c64", "tag": "d0fe1bc5-206f-4a77-a681-82f2d36381f4"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:07:00.109521 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-83ff966f-3da2-4f68-b428-ef0ddb10513f req-8049e447-c53a-43f4-b4aa-eed4007c2b73 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:07:00.110035 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-83ff966f-3da2-4f68-b428-ef0ddb10513f req-8049e447-c53a-43f4-b4aa-eed4007c2b73 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:07:00.110490 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-83ff966f-3da2-4f68-b428-ef0ddb10513f req-8049e447-c53a-43f4-b4aa-eed4007c2b73 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:07:00.122405 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-83ff966f-3da2-4f68-b428-ef0ddb10513f req-8049e447-c53a-43f4-b4aa-eed4007c2b73 service nova] Creating event network-changed:d0fe1bc5-206f-4a77-a681-82f2d36381f4 for instance 357c12a2-17d7-4054-86c9-9e41869f0c64 on n-h2-852087-9 Sep 07 14:07:00.128004 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-83ff966f-3da2-4f68-b428-ef0ddb10513f req-8049e447-c53a-43f4-b4aa-eed4007c2b73 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089189 Sep 07 14:07:00.128583 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3896/7767] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:08:56.344599 n-d-852087-9 devstack@n-api.service[122432]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72b3548f-b60d-4e5d-9d07-5303e0946fc3] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 07 14:08:56.345720 n-d-852087-9 devstack@n-api.service[122432]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78519242-4876-4a94-89c0-8fbbf97741d7] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 07 14:08:56.346561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:08:56.347280 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=58 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:08:56.348177 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 07 14:08:56.348398 n-d-852087-9 devstack@n-api.service[122432]: Wed Sep 7 14:08:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64/action (ip 10.222.0.16) !!! Sep 07 14:08:56.463802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-21e19038-8f05-4024-8a11-aeb714cc6664 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:08:56.464363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-21e19038-8f05-4024-8a11-aeb714cc6664 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:08:56.471235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21e19038-8f05-4024-8a11-aeb714cc6664 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:08:56.471713 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21e19038-8f05-4024-8a11-aeb714cc6664 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:08:56.472143 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21e19038-8f05-4024-8a11-aeb714cc6664 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:08:56.472831 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21e19038-8f05-4024-8a11-aeb714cc6664 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:08:56.473321 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21e19038-8f05-4024-8a11-aeb714cc6664 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:08:56.473759 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-21e19038-8f05-4024-8a11-aeb714cc6664 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:08:56.499911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-21e19038-8f05-4024-8a11-aeb714cc6664 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lazy-loading 'flavor' on Instance uuid 357c12a2-17d7-4054-86c9-9e41869f0c64 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:08:56.577818 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-21e19038-8f05-4024-8a11-aeb714cc6664 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "POST /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64/action" status: 202 len: 0 microversion: 2.1 time: 0.236031 Sep 07 14:08:56.578435 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3872/7768] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 14:08:56 2022] POST /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:08:56.587256 n-d-852087-9 devstack@n-api.service[122433]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e81ee00-bfe8-4eb4-a476-35156d4bea97] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 07 14:08:56.588889 n-d-852087-9 devstack@n-api.service[122433]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8d32b56c-9735-4691-a763-667a0c833c21] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 07 14:08:56.589526 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=24 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:08:56.590472 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=52 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:08:56.596352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-934887e1-d06f-40bd-ab33-039fa8c04b5f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:08:56.597016 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-934887e1-d06f-40bd-ab33-039fa8c04b5f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:08:56.607891 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-934887e1-d06f-40bd-ab33-039fa8c04b5f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:08:56.608400 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-934887e1-d06f-40bd-ab33-039fa8c04b5f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:08:56.608850 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-934887e1-d06f-40bd-ab33-039fa8c04b5f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:08:56.609590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-934887e1-d06f-40bd-ab33-039fa8c04b5f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:08:56.610063 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-934887e1-d06f-40bd-ab33-039fa8c04b5f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:08:56.610507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-934887e1-d06f-40bd-ab33-039fa8c04b5f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:08:56.750743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-934887e1-d06f-40bd-ab33-039fa8c04b5f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:08:56.759169 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-934887e1-d06f-40bd-ab33-039fa8c04b5f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1567 microversion: 2.1 time: 0.174904 Sep 07 14:08:56.759775 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3897/7769] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:08:56 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:08:57.786082 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-84c73707-843a-4128-8ffd-2d83a20c2ed0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:08:57.786767 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-84c73707-843a-4128-8ffd-2d83a20c2ed0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:08:57.795977 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84c73707-843a-4128-8ffd-2d83a20c2ed0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:08:57.796475 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84c73707-843a-4128-8ffd-2d83a20c2ed0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:08:57.796913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84c73707-843a-4128-8ffd-2d83a20c2ed0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:08:57.797655 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84c73707-843a-4128-8ffd-2d83a20c2ed0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:08:57.798114 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84c73707-843a-4128-8ffd-2d83a20c2ed0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:08:57.798543 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-84c73707-843a-4128-8ffd-2d83a20c2ed0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:08:57.803081 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] [78519242-4876-4a94-89c0-8fbbf97741d7] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 42240. Sep 07 14:08:57.803881 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] [72b3548f-b60d-4e5d-9d07-5303e0946fc3] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 42238. Sep 07 14:08:57.944693 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-84c73707-843a-4128-8ffd-2d83a20c2ed0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:08:57.953034 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-84c73707-843a-4128-8ffd-2d83a20c2ed0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1567 microversion: 2.1 time: 0.172626 Sep 07 14:08:57.953640 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3873/7770] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:08:57 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:08:58.977246 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0df177df-6a1e-4168-8d11-0d9313b450df tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:08:58.977943 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0df177df-6a1e-4168-8d11-0d9313b450df tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:08:58.988837 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0df177df-6a1e-4168-8d11-0d9313b450df tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:08:58.989347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0df177df-6a1e-4168-8d11-0d9313b450df tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:08:58.989843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0df177df-6a1e-4168-8d11-0d9313b450df tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:08:58.990571 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0df177df-6a1e-4168-8d11-0d9313b450df tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:08:58.991043 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0df177df-6a1e-4168-8d11-0d9313b450df tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:08:58.991513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0df177df-6a1e-4168-8d11-0d9313b450df tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:08:58.995584 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] [8d32b56c-9735-4691-a763-667a0c833c21] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 42246. Sep 07 14:08:58.996307 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e81ee00-bfe8-4eb4-a476-35156d4bea97] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 42244. Sep 07 14:08:59.145204 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0df177df-6a1e-4168-8d11-0d9313b450df tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:08:59.153669 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0df177df-6a1e-4168-8d11-0d9313b450df tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1567 microversion: 2.1 time: 0.180466 Sep 07 14:08:59.154271 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3898/7771] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:08:58 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:00.177775 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-49f47d82-1a6c-43fa-b97a-5bb8c02a16aa tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:00.178355 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-49f47d82-1a6c-43fa-b97a-5bb8c02a16aa tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:00.185588 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49f47d82-1a6c-43fa-b97a-5bb8c02a16aa tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:00.186077 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49f47d82-1a6c-43fa-b97a-5bb8c02a16aa tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:00.186515 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49f47d82-1a6c-43fa-b97a-5bb8c02a16aa tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:00.187211 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49f47d82-1a6c-43fa-b97a-5bb8c02a16aa tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:00.187664 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49f47d82-1a6c-43fa-b97a-5bb8c02a16aa tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:00.188084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-49f47d82-1a6c-43fa-b97a-5bb8c02a16aa tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:00.336845 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-49f47d82-1a6c-43fa-b97a-5bb8c02a16aa tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:00.347217 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-49f47d82-1a6c-43fa-b97a-5bb8c02a16aa tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1567 microversion: 2.1 time: 0.173581 Sep 07 14:09:00.347844 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3874/7772] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:00 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:01.371164 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f9ebb23-3f03-4d70-a935-c1d8a816af7d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:01.371793 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0f9ebb23-3f03-4d70-a935-c1d8a816af7d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:01.379388 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f9ebb23-3f03-4d70-a935-c1d8a816af7d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:01.379909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f9ebb23-3f03-4d70-a935-c1d8a816af7d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:01.380373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f9ebb23-3f03-4d70-a935-c1d8a816af7d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:01.381105 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f9ebb23-3f03-4d70-a935-c1d8a816af7d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:01.381631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f9ebb23-3f03-4d70-a935-c1d8a816af7d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:01.382075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f9ebb23-3f03-4d70-a935-c1d8a816af7d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:01.517143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0f9ebb23-3f03-4d70-a935-c1d8a816af7d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:01.525848 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0f9ebb23-3f03-4d70-a935-c1d8a816af7d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1567 microversion: 2.1 time: 0.158736 Sep 07 14:09:01.526561 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3899/7773] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:01 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:02.551441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-07919bea-20f1-453b-bb85-f50d7c395d15 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:02.552148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-07919bea-20f1-453b-bb85-f50d7c395d15 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:02.559623 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07919bea-20f1-453b-bb85-f50d7c395d15 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:02.560364 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07919bea-20f1-453b-bb85-f50d7c395d15 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:02.560672 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07919bea-20f1-453b-bb85-f50d7c395d15 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:02.561378 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07919bea-20f1-453b-bb85-f50d7c395d15 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:02.561864 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07919bea-20f1-453b-bb85-f50d7c395d15 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:02.562285 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-07919bea-20f1-453b-bb85-f50d7c395d15 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:02.721707 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-07919bea-20f1-453b-bb85-f50d7c395d15 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:02.730180 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-07919bea-20f1-453b-bb85-f50d7c395d15 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1567 microversion: 2.1 time: 0.184255 Sep 07 14:09:02.730768 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3875/7774] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:02 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:03.756975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d7e5e2f4-28db-4c45-bb08-35b0ac713ce0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:03.757648 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d7e5e2f4-28db-4c45-bb08-35b0ac713ce0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:03.766813 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7e5e2f4-28db-4c45-bb08-35b0ac713ce0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:03.767519 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7e5e2f4-28db-4c45-bb08-35b0ac713ce0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:03.768255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7e5e2f4-28db-4c45-bb08-35b0ac713ce0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:03.768984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7e5e2f4-28db-4c45-bb08-35b0ac713ce0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:03.769459 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7e5e2f4-28db-4c45-bb08-35b0ac713ce0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:03.769931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d7e5e2f4-28db-4c45-bb08-35b0ac713ce0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:03.920003 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d7e5e2f4-28db-4c45-bb08-35b0ac713ce0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:03.931594 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d7e5e2f4-28db-4c45-bb08-35b0ac713ce0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1567 microversion: 2.1 time: 0.180182 Sep 07 14:09:03.932422 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3900/7775] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:03 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:04.956553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ef37aa12-f2ec-4399-9879-6783a94973ca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:04.957197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ef37aa12-f2ec-4399-9879-6783a94973ca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:04.964423 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef37aa12-f2ec-4399-9879-6783a94973ca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:04.964917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef37aa12-f2ec-4399-9879-6783a94973ca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:04.965350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef37aa12-f2ec-4399-9879-6783a94973ca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:04.966099 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef37aa12-f2ec-4399-9879-6783a94973ca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:04.966553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef37aa12-f2ec-4399-9879-6783a94973ca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:04.966978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ef37aa12-f2ec-4399-9879-6783a94973ca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:05.127643 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ef37aa12-f2ec-4399-9879-6783a94973ca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:05.139530 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ef37aa12-f2ec-4399-9879-6783a94973ca tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1567 microversion: 2.1 time: 0.186991 Sep 07 14:09:05.140105 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3876/7776] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:04 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:06.163829 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b622a69b-7fa7-4048-a36c-26ab1a675ca9 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:06.164408 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b622a69b-7fa7-4048-a36c-26ab1a675ca9 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:06.171857 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b622a69b-7fa7-4048-a36c-26ab1a675ca9 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:06.172373 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b622a69b-7fa7-4048-a36c-26ab1a675ca9 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:06.172843 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b622a69b-7fa7-4048-a36c-26ab1a675ca9 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:06.173604 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b622a69b-7fa7-4048-a36c-26ab1a675ca9 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:06.174088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b622a69b-7fa7-4048-a36c-26ab1a675ca9 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:06.174543 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b622a69b-7fa7-4048-a36c-26ab1a675ca9 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:06.316689 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b622a69b-7fa7-4048-a36c-26ab1a675ca9 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:06.329934 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b622a69b-7fa7-4048-a36c-26ab1a675ca9 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1567 microversion: 2.1 time: 0.169986 Sep 07 14:09:06.330873 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3901/7777] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:06 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:07.353883 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f21af139-5488-479c-bb64-7e2fccf1f18a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:07.354510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f21af139-5488-479c-bb64-7e2fccf1f18a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:07.362105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f21af139-5488-479c-bb64-7e2fccf1f18a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:07.362607 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f21af139-5488-479c-bb64-7e2fccf1f18a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:07.363070 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f21af139-5488-479c-bb64-7e2fccf1f18a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:07.363768 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f21af139-5488-479c-bb64-7e2fccf1f18a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:07.364233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f21af139-5488-479c-bb64-7e2fccf1f18a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:07.364667 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f21af139-5488-479c-bb64-7e2fccf1f18a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:07.511192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-f21af139-5488-479c-bb64-7e2fccf1f18a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:07.519795 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f21af139-5488-479c-bb64-7e2fccf1f18a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1567 microversion: 2.1 time: 0.169915 Sep 07 14:09:07.520386 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3877/7778] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:07 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:08.552461 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-de7cb8c2-f202-45f3-a686-0e2dbcfef4a8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:08.553107 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-de7cb8c2-f202-45f3-a686-0e2dbcfef4a8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:08.562516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de7cb8c2-f202-45f3-a686-0e2dbcfef4a8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:08.563000 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de7cb8c2-f202-45f3-a686-0e2dbcfef4a8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:08.563516 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de7cb8c2-f202-45f3-a686-0e2dbcfef4a8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:08.564171 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de7cb8c2-f202-45f3-a686-0e2dbcfef4a8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:08.564637 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de7cb8c2-f202-45f3-a686-0e2dbcfef4a8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:08.565079 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-de7cb8c2-f202-45f3-a686-0e2dbcfef4a8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:08.706084 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-de7cb8c2-f202-45f3-a686-0e2dbcfef4a8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:08.719716 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-de7cb8c2-f202-45f3-a686-0e2dbcfef4a8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1567 microversion: 2.1 time: 0.172208 Sep 07 14:09:08.721017 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3902/7779] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:08 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:09.748581 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-4753feb5-bc58-4312-9811-589c80aea2f5 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:09.749179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-4753feb5-bc58-4312-9811-589c80aea2f5 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:09.756501 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4753feb5-bc58-4312-9811-589c80aea2f5 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:09.757003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4753feb5-bc58-4312-9811-589c80aea2f5 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:09.757441 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4753feb5-bc58-4312-9811-589c80aea2f5 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:09.758153 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4753feb5-bc58-4312-9811-589c80aea2f5 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:09.758652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4753feb5-bc58-4312-9811-589c80aea2f5 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:09.759060 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-4753feb5-bc58-4312-9811-589c80aea2f5 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:09.912433 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-4753feb5-bc58-4312-9811-589c80aea2f5 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:09.920240 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-4753feb5-bc58-4312-9811-589c80aea2f5 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1567 microversion: 2.1 time: 0.175765 Sep 07 14:09:09.920866 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3878/7780] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:09 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:10.944588 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1d1c2fa5-5651-4dc8-8d67-1adba3e2d153 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:10.945223 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1d1c2fa5-5651-4dc8-8d67-1adba3e2d153 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:10.952634 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d1c2fa5-5651-4dc8-8d67-1adba3e2d153 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:10.953143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d1c2fa5-5651-4dc8-8d67-1adba3e2d153 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:10.953619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d1c2fa5-5651-4dc8-8d67-1adba3e2d153 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:10.955001 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d1c2fa5-5651-4dc8-8d67-1adba3e2d153 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:10.955479 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d1c2fa5-5651-4dc8-8d67-1adba3e2d153 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:10.955936 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1d1c2fa5-5651-4dc8-8d67-1adba3e2d153 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:11.105295 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1d1c2fa5-5651-4dc8-8d67-1adba3e2d153 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:11.113698 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1d1c2fa5-5651-4dc8-8d67-1adba3e2d153 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1568 microversion: 2.1 time: 0.173219 Sep 07 14:09:11.114289 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3903/7781] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:10 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:11.144500 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6eb8380d-26ab-4a8c-b3c5-60dae85f2df2 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:09:11.145133 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6eb8380d-26ab-4a8c-b3c5-60dae85f2df2 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:11.152590 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6eb8380d-26ab-4a8c-b3c5-60dae85f2df2 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:11.153121 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6eb8380d-26ab-4a8c-b3c5-60dae85f2df2 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:11.153998 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6eb8380d-26ab-4a8c-b3c5-60dae85f2df2 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:11.155012 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6eb8380d-26ab-4a8c-b3c5-60dae85f2df2 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:11.155155 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6eb8380d-26ab-4a8c-b3c5-60dae85f2df2 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:11.155599 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6eb8380d-26ab-4a8c-b3c5-60dae85f2df2 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:11.187875 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6eb8380d-26ab-4a8c-b3c5-60dae85f2df2 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122432) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 14:09:11.259399 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6eb8380d-26ab-4a8c-b3c5-60dae85f2df2 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "POST /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64/action" status: 202 len: 0 microversion: 2.1 time: 0.119231 Sep 07 14:09:11.260388 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3879/7782] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 14:09:11 2022] POST /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:09:11.269696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ab5bdcda-ee86-4aa0-ae00-4ef936571ecb tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:11.270646 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ab5bdcda-ee86-4aa0-ae00-4ef936571ecb tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:11.276842 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab5bdcda-ee86-4aa0-ae00-4ef936571ecb tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:11.277354 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab5bdcda-ee86-4aa0-ae00-4ef936571ecb tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:11.277835 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab5bdcda-ee86-4aa0-ae00-4ef936571ecb tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:11.278596 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab5bdcda-ee86-4aa0-ae00-4ef936571ecb tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:11.279237 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab5bdcda-ee86-4aa0-ae00-4ef936571ecb tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:11.279835 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ab5bdcda-ee86-4aa0-ae00-4ef936571ecb tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:11.426754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ab5bdcda-ee86-4aa0-ae00-4ef936571ecb tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:11.435192 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ab5bdcda-ee86-4aa0-ae00-4ef936571ecb tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1516 microversion: 2.1 time: 0.170632 Sep 07 14:09:11.435891 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3904/7783] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:11 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:12.461645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8a91d810-64a6-4f00-8a63-5e7a4ef499e0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:12.461645 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8a91d810-64a6-4f00-8a63-5e7a4ef499e0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:12.467409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a91d810-64a6-4f00-8a63-5e7a4ef499e0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:12.467912 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a91d810-64a6-4f00-8a63-5e7a4ef499e0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:12.468352 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a91d810-64a6-4f00-8a63-5e7a4ef499e0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:12.469086 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a91d810-64a6-4f00-8a63-5e7a4ef499e0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:12.469618 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a91d810-64a6-4f00-8a63-5e7a4ef499e0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:12.470354 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8a91d810-64a6-4f00-8a63-5e7a4ef499e0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:12.619064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8a91d810-64a6-4f00-8a63-5e7a4ef499e0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:12.627578 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8a91d810-64a6-4f00-8a63-5e7a4ef499e0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1518 microversion: 2.1 time: 0.172766 Sep 07 14:09:12.628248 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3880/7784] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:12 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1518 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:13.652591 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-89b9a94d-0823-41dc-9478-68893c81e0ee tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:13.653370 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-89b9a94d-0823-41dc-9478-68893c81e0ee tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:13.660703 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89b9a94d-0823-41dc-9478-68893c81e0ee tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:13.661221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89b9a94d-0823-41dc-9478-68893c81e0ee tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:13.661724 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89b9a94d-0823-41dc-9478-68893c81e0ee tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:13.662454 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89b9a94d-0823-41dc-9478-68893c81e0ee tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:13.662933 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89b9a94d-0823-41dc-9478-68893c81e0ee tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:13.663385 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-89b9a94d-0823-41dc-9478-68893c81e0ee tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:13.803352 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-89b9a94d-0823-41dc-9478-68893c81e0ee tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:13.812663 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-89b9a94d-0823-41dc-9478-68893c81e0ee tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1518 microversion: 2.1 time: 0.164019 Sep 07 14:09:13.813271 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3905/7785] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:13 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:14.648144 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-c87ce4aa-0fea-4b6b-a972-bdf68d5ebed4 req-0e9f9acb-446c-4e78-88ac-4ccbe89b9cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "357c12a2-17d7-4054-86c9-9e41869f0c64", "name": "network-vif-unplugged", "status": "completed", "tag": "d0fe1bc5-206f-4a77-a681-82f2d36381f4"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:09:14.663227 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c87ce4aa-0fea-4b6b-a972-bdf68d5ebed4 req-0e9f9acb-446c-4e78-88ac-4ccbe89b9cd9 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:14.663970 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c87ce4aa-0fea-4b6b-a972-bdf68d5ebed4 req-0e9f9acb-446c-4e78-88ac-4ccbe89b9cd9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:14.664833 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-c87ce4aa-0fea-4b6b-a972-bdf68d5ebed4 req-0e9f9acb-446c-4e78-88ac-4ccbe89b9cd9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:14.676801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.compute.server_external_events [req-c87ce4aa-0fea-4b6b-a972-bdf68d5ebed4 req-0e9f9acb-446c-4e78-88ac-4ccbe89b9cd9 service nova] Unable to find a host for instance 357c12a2-17d7-4054-86c9-9e41869f0c64. Dropping event network-vif-unplugged {{(pid=122432) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 07 14:09:14.678098 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-c87ce4aa-0fea-4b6b-a972-bdf68d5ebed4 req-0e9f9acb-446c-4e78-88ac-4ccbe89b9cd9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034184 Sep 07 14:09:14.679149 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3881/7786] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 07 14:09:14.840546 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-98ed9700-7488-49fc-ae3a-c1bf93daa74e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:14.840546 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-98ed9700-7488-49fc-ae3a-c1bf93daa74e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:14.847231 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98ed9700-7488-49fc-ae3a-c1bf93daa74e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:14.847786 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98ed9700-7488-49fc-ae3a-c1bf93daa74e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:14.848245 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98ed9700-7488-49fc-ae3a-c1bf93daa74e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:14.848991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98ed9700-7488-49fc-ae3a-c1bf93daa74e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:14.849471 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98ed9700-7488-49fc-ae3a-c1bf93daa74e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:14.849967 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-98ed9700-7488-49fc-ae3a-c1bf93daa74e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:15.000750 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-98ed9700-7488-49fc-ae3a-c1bf93daa74e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:15.009683 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-98ed9700-7488-49fc-ae3a-c1bf93daa74e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1518 microversion: 2.1 time: 0.176472 Sep 07 14:09:15.010367 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3906/7787] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:14 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1518 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:16.036324 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-388940c5-8945-4275-81b8-8f105fc1505e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:16.037095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-388940c5-8945-4275-81b8-8f105fc1505e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:16.044426 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-388940c5-8945-4275-81b8-8f105fc1505e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:16.044922 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-388940c5-8945-4275-81b8-8f105fc1505e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:16.045361 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-388940c5-8945-4275-81b8-8f105fc1505e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:16.046177 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-388940c5-8945-4275-81b8-8f105fc1505e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:16.046628 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-388940c5-8945-4275-81b8-8f105fc1505e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:16.047089 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-388940c5-8945-4275-81b8-8f105fc1505e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:16.234910 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-388940c5-8945-4275-81b8-8f105fc1505e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:16.242945 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-388940c5-8945-4275-81b8-8f105fc1505e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1518 microversion: 2.1 time: 0.212528 Sep 07 14:09:16.243535 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3882/7788] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:16 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1518 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:17.265847 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2c3757e4-185a-48f3-8b17-91b4f8cf8090 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:17.266487 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2c3757e4-185a-48f3-8b17-91b4f8cf8090 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:17.273717 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c3757e4-185a-48f3-8b17-91b4f8cf8090 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:17.274236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c3757e4-185a-48f3-8b17-91b4f8cf8090 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:17.274696 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c3757e4-185a-48f3-8b17-91b4f8cf8090 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:17.275423 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c3757e4-185a-48f3-8b17-91b4f8cf8090 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:17.275901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c3757e4-185a-48f3-8b17-91b4f8cf8090 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:17.276349 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2c3757e4-185a-48f3-8b17-91b4f8cf8090 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:17.539771 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2c3757e4-185a-48f3-8b17-91b4f8cf8090 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:17.548708 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2c3757e4-185a-48f3-8b17-91b4f8cf8090 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1574 microversion: 2.1 time: 0.286989 Sep 07 14:09:17.549557 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3907/7789] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:17 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1574 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:18.383449 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-7abcefd7-27ac-4f8c-909a-2a30ee31bf6f req-63de0f1b-1d60-48dc-bb3d-3c07bf48f4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "357c12a2-17d7-4054-86c9-9e41869f0c64", "tag": "d0fe1bc5-206f-4a77-a681-82f2d36381f4"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:09:18.393314 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7abcefd7-27ac-4f8c-909a-2a30ee31bf6f req-63de0f1b-1d60-48dc-bb3d-3c07bf48f4f5 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:18.393553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7abcefd7-27ac-4f8c-909a-2a30ee31bf6f req-63de0f1b-1d60-48dc-bb3d-3c07bf48f4f5 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:18.394016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7abcefd7-27ac-4f8c-909a-2a30ee31bf6f req-63de0f1b-1d60-48dc-bb3d-3c07bf48f4f5 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:18.407799 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7abcefd7-27ac-4f8c-909a-2a30ee31bf6f req-63de0f1b-1d60-48dc-bb3d-3c07bf48f4f5 service nova] Creating event network-changed:d0fe1bc5-206f-4a77-a681-82f2d36381f4 for instance 357c12a2-17d7-4054-86c9-9e41869f0c64 on n-h1-852087-9 Sep 07 14:09:18.413406 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-7abcefd7-27ac-4f8c-909a-2a30ee31bf6f req-63de0f1b-1d60-48dc-bb3d-3c07bf48f4f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092839 Sep 07 14:09:18.414064 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3883/7790] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:09:18.573463 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-94be2ab0-8df2-4d07-92f8-885229b19d28 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:18.574104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-94be2ab0-8df2-4d07-92f8-885229b19d28 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:18.582064 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94be2ab0-8df2-4d07-92f8-885229b19d28 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:18.582615 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94be2ab0-8df2-4d07-92f8-885229b19d28 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:18.583076 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94be2ab0-8df2-4d07-92f8-885229b19d28 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:18.583803 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94be2ab0-8df2-4d07-92f8-885229b19d28 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:18.584280 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94be2ab0-8df2-4d07-92f8-885229b19d28 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:18.584734 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-94be2ab0-8df2-4d07-92f8-885229b19d28 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:18.798799 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-94be2ab0-8df2-4d07-92f8-885229b19d28 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:18.807158 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-94be2ab0-8df2-4d07-92f8-885229b19d28 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1574 microversion: 2.1 time: 0.237765 Sep 07 14:09:18.807902 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3908/7791] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:18 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1574 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:19.832871 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-6c325663-b469-43db-b5c8-a476fe0b01cf tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:19.833646 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-6c325663-b469-43db-b5c8-a476fe0b01cf tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:19.842105 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c325663-b469-43db-b5c8-a476fe0b01cf tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:19.842591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c325663-b469-43db-b5c8-a476fe0b01cf tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:19.843023 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c325663-b469-43db-b5c8-a476fe0b01cf tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:19.843717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c325663-b469-43db-b5c8-a476fe0b01cf tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:19.844170 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c325663-b469-43db-b5c8-a476fe0b01cf tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:19.844591 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-6c325663-b469-43db-b5c8-a476fe0b01cf tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:20.001897 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-6c325663-b469-43db-b5c8-a476fe0b01cf tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:20.014000 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-6c325663-b469-43db-b5c8-a476fe0b01cf tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1574 microversion: 2.1 time: 0.186030 Sep 07 14:09:20.014614 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3884/7792] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:19 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1574 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:21.038110 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-b884a862-83b6-4ebd-b3c2-df40fe407960 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:21.038743 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-b884a862-83b6-4ebd-b3c2-df40fe407960 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:21.046429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b884a862-83b6-4ebd-b3c2-df40fe407960 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:21.046956 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b884a862-83b6-4ebd-b3c2-df40fe407960 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:21.047416 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b884a862-83b6-4ebd-b3c2-df40fe407960 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:21.048151 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b884a862-83b6-4ebd-b3c2-df40fe407960 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:21.048633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b884a862-83b6-4ebd-b3c2-df40fe407960 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:21.049085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-b884a862-83b6-4ebd-b3c2-df40fe407960 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:21.198511 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-b884a862-83b6-4ebd-b3c2-df40fe407960 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:21.207331 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-b884a862-83b6-4ebd-b3c2-df40fe407960 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1574 microversion: 2.1 time: 0.173128 Sep 07 14:09:21.207907 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3909/7793] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:21 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:22.233916 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-d28f9961-148e-4642-8ba7-5215f8539bac tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:22.234497 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-d28f9961-148e-4642-8ba7-5215f8539bac tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:22.241891 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d28f9961-148e-4642-8ba7-5215f8539bac tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:22.242376 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d28f9961-148e-4642-8ba7-5215f8539bac tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:22.242818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d28f9961-148e-4642-8ba7-5215f8539bac tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:22.243528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d28f9961-148e-4642-8ba7-5215f8539bac tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:22.243980 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d28f9961-148e-4642-8ba7-5215f8539bac tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:22.244408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-d28f9961-148e-4642-8ba7-5215f8539bac tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:22.398492 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-d28f9961-148e-4642-8ba7-5215f8539bac tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:22.406928 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-d28f9961-148e-4642-8ba7-5215f8539bac tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1574 microversion: 2.1 time: 0.177647 Sep 07 14:09:22.407519 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3885/7794] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:22 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1574 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:23.435726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d38edb4d-49c7-431c-9ce1-ba98c94c4116 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:23.436364 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d38edb4d-49c7-431c-9ce1-ba98c94c4116 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:23.443960 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d38edb4d-49c7-431c-9ce1-ba98c94c4116 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:23.444478 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d38edb4d-49c7-431c-9ce1-ba98c94c4116 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:23.445224 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d38edb4d-49c7-431c-9ce1-ba98c94c4116 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:23.445979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d38edb4d-49c7-431c-9ce1-ba98c94c4116 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:23.446485 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d38edb4d-49c7-431c-9ce1-ba98c94c4116 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:23.446931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d38edb4d-49c7-431c-9ce1-ba98c94c4116 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:23.592918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d38edb4d-49c7-431c-9ce1-ba98c94c4116 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:23.602407 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d38edb4d-49c7-431c-9ce1-ba98c94c4116 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1574 microversion: 2.1 time: 0.171328 Sep 07 14:09:23.602979 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3910/7795] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:23 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:24.630813 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-8ee06f44-f34b-4682-8412-2c062382d319 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:24.631992 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-8ee06f44-f34b-4682-8412-2c062382d319 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:24.640904 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ee06f44-f34b-4682-8412-2c062382d319 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:24.641579 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ee06f44-f34b-4682-8412-2c062382d319 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:24.642026 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ee06f44-f34b-4682-8412-2c062382d319 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:24.642736 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ee06f44-f34b-4682-8412-2c062382d319 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:24.643193 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ee06f44-f34b-4682-8412-2c062382d319 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:24.643620 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-8ee06f44-f34b-4682-8412-2c062382d319 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:24.784763 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-8ee06f44-f34b-4682-8412-2c062382d319 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:24.788595 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:09:24.794102 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-8ee06f44-f34b-4682-8412-2c062382d319 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1574 microversion: 2.1 time: 0.169534 Sep 07 14:09:24.794697 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3886/7796] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:24 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:25.818722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-e8f37ab8-d08d-44cf-b653-eb573b222ce0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:25.819361 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-e8f37ab8-d08d-44cf-b653-eb573b222ce0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:25.832255 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8f37ab8-d08d-44cf-b653-eb573b222ce0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:25.833216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8f37ab8-d08d-44cf-b653-eb573b222ce0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:25.834082 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8f37ab8-d08d-44cf-b653-eb573b222ce0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:25.835491 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8f37ab8-d08d-44cf-b653-eb573b222ce0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:25.836430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8f37ab8-d08d-44cf-b653-eb573b222ce0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:25.837192 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-e8f37ab8-d08d-44cf-b653-eb573b222ce0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:25.983379 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-e8f37ab8-d08d-44cf-b653-eb573b222ce0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:25.991864 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-e8f37ab8-d08d-44cf-b653-eb573b222ce0 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1574 microversion: 2.1 time: 0.177100 Sep 07 14:09:25.992460 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3911/7797] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:25 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:27.017161 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dbe902af-5035-49e1-ac47-ad2605b0d40d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:27.017930 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dbe902af-5035-49e1-ac47-ad2605b0d40d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:27.022248 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:09:27.026911 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbe902af-5035-49e1-ac47-ad2605b0d40d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:27.027413 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbe902af-5035-49e1-ac47-ad2605b0d40d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:27.027862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbe902af-5035-49e1-ac47-ad2605b0d40d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:27.028573 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbe902af-5035-49e1-ac47-ad2605b0d40d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:27.029041 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbe902af-5035-49e1-ac47-ad2605b0d40d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:27.029473 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbe902af-5035-49e1-ac47-ad2605b0d40d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:27.176133 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dbe902af-5035-49e1-ac47-ad2605b0d40d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:27.184697 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dbe902af-5035-49e1-ac47-ad2605b0d40d tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1574 microversion: 2.1 time: 0.171488 Sep 07 14:09:27.185306 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3887/7798] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:27 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:28.208794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a531ea42-a6e5-468b-8001-6229e99852fa tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:28.209392 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-a531ea42-a6e5-468b-8001-6229e99852fa tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:28.212260 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=31 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:09:28.218088 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a531ea42-a6e5-468b-8001-6229e99852fa tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:28.218609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a531ea42-a6e5-468b-8001-6229e99852fa tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:28.219065 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a531ea42-a6e5-468b-8001-6229e99852fa tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:28.219795 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a531ea42-a6e5-468b-8001-6229e99852fa tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:28.220604 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a531ea42-a6e5-468b-8001-6229e99852fa tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:28.221054 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-a531ea42-a6e5-468b-8001-6229e99852fa tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:28.223874 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=91 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:09:28.364104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-a531ea42-a6e5-468b-8001-6229e99852fa tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:28.372925 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a531ea42-a6e5-468b-8001-6229e99852fa tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1574 microversion: 2.1 time: 0.168072 Sep 07 14:09:28.373999 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3912/7799] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:28 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:29.334847 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-287a0f4b-1a9e-4f03-bbb5-66f2ed8e8ef0 req-f5604865-6fc9-4546-8e8c-adb5443f4397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "357c12a2-17d7-4054-86c9-9e41869f0c64", "name": "network-vif-plugged", "status": "completed", "tag": "d0fe1bc5-206f-4a77-a681-82f2d36381f4"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:09:29.344913 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-287a0f4b-1a9e-4f03-bbb5-66f2ed8e8ef0 req-f5604865-6fc9-4546-8e8c-adb5443f4397 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:29.345761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-287a0f4b-1a9e-4f03-bbb5-66f2ed8e8ef0 req-f5604865-6fc9-4546-8e8c-adb5443f4397 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:29.346234 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-287a0f4b-1a9e-4f03-bbb5-66f2ed8e8ef0 req-f5604865-6fc9-4546-8e8c-adb5443f4397 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:29.362717 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-287a0f4b-1a9e-4f03-bbb5-66f2ed8e8ef0 req-f5604865-6fc9-4546-8e8c-adb5443f4397 service nova] Creating event network-vif-plugged:d0fe1bc5-206f-4a77-a681-82f2d36381f4 for instance 357c12a2-17d7-4054-86c9-9e41869f0c64 on n-h1-852087-9 Sep 07 14:09:29.368933 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-287a0f4b-1a9e-4f03-bbb5-66f2ed8e8ef0 req-f5604865-6fc9-4546-8e8c-adb5443f4397 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091017 Sep 07 14:09:29.370008 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3888/7800] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:09:29.396949 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d3957ea7-b0d9-4138-9f26-30b96a088f67 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:29.397630 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d3957ea7-b0d9-4138-9f26-30b96a088f67 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:29.404456 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3957ea7-b0d9-4138-9f26-30b96a088f67 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:29.404982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3957ea7-b0d9-4138-9f26-30b96a088f67 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:29.405448 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3957ea7-b0d9-4138-9f26-30b96a088f67 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:29.406267 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3957ea7-b0d9-4138-9f26-30b96a088f67 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:29.406757 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3957ea7-b0d9-4138-9f26-30b96a088f67 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:29.407220 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d3957ea7-b0d9-4138-9f26-30b96a088f67 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:29.546569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d3957ea7-b0d9-4138-9f26-30b96a088f67 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:29.555734 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d3957ea7-b0d9-4138-9f26-30b96a088f67 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1574 microversion: 2.1 time: 0.163040 Sep 07 14:09:29.556337 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3913/7801] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:29 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:30.583054 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b9a695b4-3fd9-47ba-820b-d07f63da38df tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:30.584055 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b9a695b4-3fd9-47ba-820b-d07f63da38df tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:30.595793 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9a695b4-3fd9-47ba-820b-d07f63da38df tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:30.596656 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9a695b4-3fd9-47ba-820b-d07f63da38df tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:30.597216 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9a695b4-3fd9-47ba-820b-d07f63da38df tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:30.598532 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9a695b4-3fd9-47ba-820b-d07f63da38df tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:30.599418 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9a695b4-3fd9-47ba-820b-d07f63da38df tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:30.600213 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b9a695b4-3fd9-47ba-820b-d07f63da38df tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:30.752508 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b9a695b4-3fd9-47ba-820b-d07f63da38df tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:30.760864 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b9a695b4-3fd9-47ba-820b-d07f63da38df tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1574 microversion: 2.1 time: 0.185538 Sep 07 14:09:30.761467 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3889/7802] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:30 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1574 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:09:31.784770 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-020deeea-9250-47f4-85ed-8ecd54c56047 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:09:31.785410 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-020deeea-9250-47f4-85ed-8ecd54c56047 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:09:31.793024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-020deeea-9250-47f4-85ed-8ecd54c56047 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:31.793592 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-020deeea-9250-47f4-85ed-8ecd54c56047 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:31.794030 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-020deeea-9250-47f4-85ed-8ecd54c56047 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:31.794798 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-020deeea-9250-47f4-85ed-8ecd54c56047 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:09:31.795251 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-020deeea-9250-47f4-85ed-8ecd54c56047 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:09:31.795726 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-020deeea-9250-47f4-85ed-8ecd54c56047 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:09:31.939159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-020deeea-9250-47f4-85ed-8ecd54c56047 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:09:31.947353 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-020deeea-9250-47f4-85ed-8ecd54c56047 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1561 microversion: 2.1 time: 0.166652 Sep 07 14:09:31.947962 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3914/7803] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:09:31 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:10:48.761876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=5 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:10:48.762850 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5304f3c6-56df-490d-bcea-db95ec4bf776 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:10:48.763317 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=17 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:10:48.764040 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5304f3c6-56df-490d-bcea-db95ec4bf776 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:10:48.764382 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 14:10:48.764510 n-d-852087-9 devstack@n-api.service[122433]: Wed Sep 7 14:10:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Sep 07 14:10:48.766300 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=5 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:10:48.766958 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=14 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:10:48.767185 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 14:10:48.767298 n-d-852087-9 devstack@n-api.service[122433]: Wed Sep 7 14:10:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Sep 07 14:10:48.768196 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 14:10:48.768376 n-d-852087-9 devstack@n-api.service[122432]: Wed Sep 7 14:10:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 (ip 10.222.0.16) !!! Sep 07 14:10:48.769845 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 14:10:48.770047 n-d-852087-9 devstack@n-api.service[122433]: Wed Sep 7 14:10:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Sep 07 14:10:48.775849 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5304f3c6-56df-490d-bcea-db95ec4bf776 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:10:48.776350 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5304f3c6-56df-490d-bcea-db95ec4bf776 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:10:48.776788 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5304f3c6-56df-490d-bcea-db95ec4bf776 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:10:48.777522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5304f3c6-56df-490d-bcea-db95ec4bf776 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:10:48.777972 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5304f3c6-56df-490d-bcea-db95ec4bf776 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:10:48.778393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5304f3c6-56df-490d-bcea-db95ec4bf776 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:10:48.789265 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-0a155d19-cb69-4d81-a88b-88325093c0f3 req-e7c14340-9ead-489a-b2e9-d996573e8f4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "357c12a2-17d7-4054-86c9-9e41869f0c64", "tag": "d0fe1bc5-206f-4a77-a681-82f2d36381f4"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:10:48.806721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5304f3c6-56df-490d-bcea-db95ec4bf776 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:10:48.807468 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0a155d19-cb69-4d81-a88b-88325093c0f3 req-e7c14340-9ead-489a-b2e9-d996573e8f4e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:10:48.807984 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0a155d19-cb69-4d81-a88b-88325093c0f3 req-e7c14340-9ead-489a-b2e9-d996573e8f4e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:10:48.808510 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-0a155d19-cb69-4d81-a88b-88325093c0f3 req-e7c14340-9ead-489a-b2e9-d996573e8f4e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:10:48.819418 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-0a155d19-cb69-4d81-a88b-88325093c0f3 req-e7c14340-9ead-489a-b2e9-d996573e8f4e service nova] Creating event network-changed:d0fe1bc5-206f-4a77-a681-82f2d36381f4 for instance 357c12a2-17d7-4054-86c9-9e41869f0c64 on n-h1-852087-9 Sep 07 14:10:48.825984 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-0a155d19-cb69-4d81-a88b-88325093c0f3 req-e7c14340-9ead-489a-b2e9-d996573e8f4e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065902 Sep 07 14:10:48.826818 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3915/7804] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:10:48.891813 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5304f3c6-56df-490d-bcea-db95ec4bf776 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "DELETE /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 204 len: 0 microversion: 2.1 time: 0.133942 Sep 07 14:10:48.896880 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3890/7805] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 14:10:48 2022] DELETE /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 14:10:48.904124 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2fa2e440-b565-4db9-ab64-a4bee1e1f19a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:10:48.904905 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-2fa2e440-b565-4db9-ab64-a4bee1e1f19a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:10:48.912746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fa2e440-b565-4db9-ab64-a4bee1e1f19a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:10:48.913419 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fa2e440-b565-4db9-ab64-a4bee1e1f19a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:10:48.913906 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fa2e440-b565-4db9-ab64-a4bee1e1f19a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:10:48.915858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fa2e440-b565-4db9-ab64-a4bee1e1f19a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:10:48.916342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fa2e440-b565-4db9-ab64-a4bee1e1f19a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:10:48.916821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-2fa2e440-b565-4db9-ab64-a4bee1e1f19a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:10:49.059880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-2fa2e440-b565-4db9-ab64-a4bee1e1f19a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:10:49.068107 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2fa2e440-b565-4db9-ab64-a4bee1e1f19a tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1567 microversion: 2.1 time: 0.169046 Sep 07 14:10:49.068736 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3916/7806] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:10:48 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:10:50.092700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ccc28b89-e20c-414b-8e7d-09ad749df1d4 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:10:50.093409 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ccc28b89-e20c-414b-8e7d-09ad749df1d4 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:10:50.100934 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccc28b89-e20c-414b-8e7d-09ad749df1d4 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:10:50.101394 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccc28b89-e20c-414b-8e7d-09ad749df1d4 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:10:50.101865 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccc28b89-e20c-414b-8e7d-09ad749df1d4 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:10:50.102560 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccc28b89-e20c-414b-8e7d-09ad749df1d4 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:10:50.103016 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccc28b89-e20c-414b-8e7d-09ad749df1d4 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:10:50.103422 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ccc28b89-e20c-414b-8e7d-09ad749df1d4 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:10:50.274552 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ccc28b89-e20c-414b-8e7d-09ad749df1d4 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:10:50.286164 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ccc28b89-e20c-414b-8e7d-09ad749df1d4 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1567 microversion: 2.1 time: 0.197765 Sep 07 14:10:50.287065 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3891/7807] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:10:50 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:10:51.213513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-85f85a87-f72d-49d7-ad06-494a6c1c9de3 req-4017d09c-6f28-4877-abbe-59ee9ab8a51e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "357c12a2-17d7-4054-86c9-9e41869f0c64", "name": "network-vif-deleted", "tag": "d0fe1bc5-206f-4a77-a681-82f2d36381f4"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:10:51.225217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-85f85a87-f72d-49d7-ad06-494a6c1c9de3 req-4017d09c-6f28-4877-abbe-59ee9ab8a51e service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:10:51.225776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-85f85a87-f72d-49d7-ad06-494a6c1c9de3 req-4017d09c-6f28-4877-abbe-59ee9ab8a51e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:10:51.226270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-85f85a87-f72d-49d7-ad06-494a6c1c9de3 req-4017d09c-6f28-4877-abbe-59ee9ab8a51e service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:10:51.239003 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-85f85a87-f72d-49d7-ad06-494a6c1c9de3 req-4017d09c-6f28-4877-abbe-59ee9ab8a51e service nova] Creating event network-vif-deleted:d0fe1bc5-206f-4a77-a681-82f2d36381f4 for instance 357c12a2-17d7-4054-86c9-9e41869f0c64 on n-h1-852087-9 Sep 07 14:10:51.244955 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-85f85a87-f72d-49d7-ad06-494a6c1c9de3 req-4017d09c-6f28-4877-abbe-59ee9ab8a51e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035100 Sep 07 14:10:51.246245 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3917/7808] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:10:51.313049 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-1fdfca65-9828-4d45-9727-34a6070631e8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:10:51.314491 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-1fdfca65-9828-4d45-9727-34a6070631e8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:10:51.321469 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fdfca65-9828-4d45-9727-34a6070631e8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:10:51.322072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fdfca65-9828-4d45-9727-34a6070631e8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:10:51.322517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fdfca65-9828-4d45-9727-34a6070631e8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:10:51.323222 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fdfca65-9828-4d45-9727-34a6070631e8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:10:51.323802 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fdfca65-9828-4d45-9727-34a6070631e8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:10:51.324229 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-1fdfca65-9828-4d45-9727-34a6070631e8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:10:51.389606 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-1fdfca65-9828-4d45-9727-34a6070631e8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:10:51.397910 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-1fdfca65-9828-4d45-9727-34a6070631e8 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1218 microversion: 2.1 time: 0.089195 Sep 07 14:10:51.398559 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3892/7809] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:10:51 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:10:52.422619 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-ee123060-a801-47ea-91e6-a392111eab90 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:10:52.423358 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-ee123060-a801-47ea-91e6-a392111eab90 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:10:52.430761 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee123060-a801-47ea-91e6-a392111eab90 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:10:52.431274 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee123060-a801-47ea-91e6-a392111eab90 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:10:52.431732 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee123060-a801-47ea-91e6-a392111eab90 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:10:52.432448 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee123060-a801-47ea-91e6-a392111eab90 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:10:52.432926 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee123060-a801-47ea-91e6-a392111eab90 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:10:52.433374 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-ee123060-a801-47ea-91e6-a392111eab90 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:10:52.499239 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-ee123060-a801-47ea-91e6-a392111eab90 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:10:52.507491 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-ee123060-a801-47ea-91e6-a392111eab90 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1218 microversion: 2.1 time: 0.089476 Sep 07 14:10:52.508118 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3918/7810] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:10:52 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:10:53.533520 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-457b0a63-1592-42d1-a4c4-96144a59921f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:10:53.534600 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-457b0a63-1592-42d1-a4c4-96144a59921f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:10:53.542608 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-457b0a63-1592-42d1-a4c4-96144a59921f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:10:53.542809 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-457b0a63-1592-42d1-a4c4-96144a59921f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:10:53.543260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-457b0a63-1592-42d1-a4c4-96144a59921f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:10:53.543969 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-457b0a63-1592-42d1-a4c4-96144a59921f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:10:53.544429 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-457b0a63-1592-42d1-a4c4-96144a59921f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:10:53.544858 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-457b0a63-1592-42d1-a4c4-96144a59921f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:10:53.610328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-457b0a63-1592-42d1-a4c4-96144a59921f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:10:53.618572 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-457b0a63-1592-42d1-a4c4-96144a59921f tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1218 microversion: 2.1 time: 0.090669 Sep 07 14:10:53.619168 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3893/7811] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:10:53 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:10:54.641779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-9c36f42f-628f-44f7-8f91-83b24435d5a7 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:10:54.642531 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-9c36f42f-628f-44f7-8f91-83b24435d5a7 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:10:54.650014 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c36f42f-628f-44f7-8f91-83b24435d5a7 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:10:54.650631 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c36f42f-628f-44f7-8f91-83b24435d5a7 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:10:54.651091 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c36f42f-628f-44f7-8f91-83b24435d5a7 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:10:54.651822 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c36f42f-628f-44f7-8f91-83b24435d5a7 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:10:54.652300 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c36f42f-628f-44f7-8f91-83b24435d5a7 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:10:54.652745 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-9c36f42f-628f-44f7-8f91-83b24435d5a7 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:10:54.718728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-9c36f42f-628f-44f7-8f91-83b24435d5a7 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:10:54.727462 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-9c36f42f-628f-44f7-8f91-83b24435d5a7 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1218 microversion: 2.1 time: 0.089720 Sep 07 14:10:54.728031 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3919/7812] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:10:54 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:10:55.750967 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-73ff5d8a-bf72-4712-8d71-ba9628d2d9e1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:10:55.751571 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-73ff5d8a-bf72-4712-8d71-ba9628d2d9e1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:10:55.759235 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73ff5d8a-bf72-4712-8d71-ba9628d2d9e1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:10:55.759727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73ff5d8a-bf72-4712-8d71-ba9628d2d9e1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:10:55.760166 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73ff5d8a-bf72-4712-8d71-ba9628d2d9e1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:10:55.760866 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73ff5d8a-bf72-4712-8d71-ba9628d2d9e1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:10:55.761328 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73ff5d8a-bf72-4712-8d71-ba9628d2d9e1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:10:55.761823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73ff5d8a-bf72-4712-8d71-ba9628d2d9e1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:10:55.796310 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73ff5d8a-bf72-4712-8d71-ba9628d2d9e1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:10:55.796801 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73ff5d8a-bf72-4712-8d71-ba9628d2d9e1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:10:55.797294 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-73ff5d8a-bf72-4712-8d71-ba9628d2d9e1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:10:55.797727 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.objects.instance [None req-73ff5d8a-bf72-4712-8d71-ba9628d2d9e1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lazy-loading 'fault' on Instance uuid 357c12a2-17d7-4054-86c9-9e41869f0c64 {{(pid=122432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:10:55.840277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-73ff5d8a-bf72-4712-8d71-ba9628d2d9e1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84652ff0847947a89cca9bf0a81cf6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba713b04eba14c9d93feaa41938527b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:10:55.850298 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-73ff5d8a-bf72-4712-8d71-ba9628d2d9e1 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 200 len: 1223 microversion: 2.1 time: 0.103248 Sep 07 14:10:55.850861 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3894/7813] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:10:55 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 1223 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:10:56.875901 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-efc3bf75-7478-4827-bc73-f22d05505233 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:10:56.876513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-efc3bf75-7478-4827-bc73-f22d05505233 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] [instance: 357c12a2-17d7-4054-86c9-9e41869f0c64] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:10:56.884096 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efc3bf75-7478-4827-bc73-f22d05505233 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:10:56.884644 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efc3bf75-7478-4827-bc73-f22d05505233 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:10:56.885113 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efc3bf75-7478-4827-bc73-f22d05505233 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:10:56.885909 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efc3bf75-7478-4827-bc73-f22d05505233 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:10:56.886396 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efc3bf75-7478-4827-bc73-f22d05505233 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:10:56.886920 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efc3bf75-7478-4827-bc73-f22d05505233 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:10:56.901810 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-efc3bf75-7478-4827-bc73-f22d05505233 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] HTTP exception thrown: Instance 357c12a2-17d7-4054-86c9-9e41869f0c64 could not be found. Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-efc3bf75-7478-4827-bc73-f22d05505233 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Request method failure captured: Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 HTTP/1.1 Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGKRXqvl9BZVOfCmHOAmMpNwEQHEHBCKKop1RhFoRLl6NOHAFSq8rMH4chcdNfxOkDaIZuLMok34o9f4wZoQy9WRboq9Tl2WXuqCoy5wYrMQ9Lu3oNTyWtu2S_ZXMeDSw4sG9T4ihKhjAJbkz0ZCjF0MSmFT3h1CpRpRnv9Kvy0gexek Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: ba713b04eba14c9d93feaa41938527b8 Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TestShelveInstance-1852937033 Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba713b04eba14c9d93feaa41938527b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba713b04eba14c9d93feaa41938527b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba713b04eba14c9d93feaa41938527b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba713b04eba14c9d93feaa41938527b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TestShelveInstance-1852937033 Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: ba713b04eba14c9d93feaa41938527b8 Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestShelveInstance-1852937033 Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TestShelveInstance-1852937033-project Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: 84652ff0847947a89cca9bf0a81cf6ab Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TestShelveInstance-1852937033-project Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 357c12a2-17d7-4054-86c9-9e41869f0c64 could not be found. Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '357c12a2-17d7-4054-86c9-9e41869f0c64'} Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 357c12a2-17d7-4054-86c9-9e41869f0c64 could not be found. Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 357c12a2-17d7-4054-86c9-9e41869f0c64 could not be found. Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:10:56.903597 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 14:10:56.909230 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:10:56.909230 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:10:56.909230 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:10:56.909230 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:10:56.909230 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:10:56.909230 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 357c12a2-17d7-4054-86c9-9e41869f0c64 could not be found. Sep 07 14:10:56.909230 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 14:10:56.909230 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-efc3bf75-7478-4827-bc73-f22d05505233 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Returning 404 to user: Instance 357c12a2-17d7-4054-86c9-9e41869f0c64 could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:10:56.909230 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-efc3bf75-7478-4827-bc73-f22d05505233 tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64" status: 404 len: 111 microversion: 2.1 time: 0.033336 Sep 07 14:10:56.909230 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3920/7814] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:10:56 2022] GET /compute/v2.1/servers/357c12a2-17d7-4054-86c9-9e41869f0c64 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:10:57.071927 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b7ce34e5-1d3f-4315-92a8-a9dc2a5d003e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] Calling method '.version_select at 0x7fc4181e70d0>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:10:57.105710 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b7ce34e5-1d3f-4315-92a8-a9dc2a5d003e tempest-TestShelveInstance-1852937033 tempest-TestShelveInstance-1852937033-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-928209985" status: 202 len: 0 microversion: 2.1 time: 0.037826 Sep 07 14:10:57.106314 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3895/7815] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Sep 7 14:10:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-928209985 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:11:14.510182 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=12 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:11:14.512160 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=24 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:11:14.749032 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-a52457df-6ece-491f-88d4-d8789964cd12 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Action: 'create', calling method: .version_select at 0x7fc4192a4160>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-625149994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAfoi+62iLTphXLLl4QwYzPcxq/NOOztgkd2Bc5zzvlKJDETgruLnN/8QFT7i7XN758qLCELD+USwoJtVrqbv0duo/KKwvbDDrBHNIpWVbbHNozWUKAkfJb/D3epVK7oA=="}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:11:14.765583 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-a52457df-6ece-491f-88d4-d8789964cd12 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Getting quotas for project 94cd8d27b73146acaac2a4dc397511fd. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:11:14.771535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-a52457df-6ece-491f-88d4-d8789964cd12 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Getting quotas for user fe9417fc0a9f4c5dae91f2cdf4eecf46 and project 94cd8d27b73146acaac2a4dc397511fd. Resources: {'key_pairs'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:11:14.802859 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-a52457df-6ece-491f-88d4-d8789964cd12 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.298173 Sep 07 14:11:14.803747 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3921/7816] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Sep 7 14:11:14 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:11:15.864258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:11:15.865700 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:11:15.869896 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7aa874fc-834b-454d-8733-9b4703af340b tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-142687967", "imageRef": "a5dd2b4d-ee9d-44eb-b267-89e80edd276f", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-625149994", "security_groups": [{"name": "tempest-secgroup-smoke-2125886449"}], "networks": [{"uuid": "f3547db6-1876-40f6-ab7b-abdcd1106760"}]}} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:11:15.995932 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.network.neutron [None req-7aa874fc-834b-454d-8733-9b4703af340b tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] validate_networks() for [('f3547db6-1876-40f6-ab7b-abdcd1106760', None, None, None, None, None)] {{(pid=122432) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 14:11:16.404961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7aa874fc-834b-454d-8733-9b4703af340b tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Flavor limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 14:11:16.405392 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7aa874fc-834b-454d-8733-9b4703af340b tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Image limits 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 14:11:16.405978 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7aa874fc-834b-454d-8733-9b4703af340b tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Flavor pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 14:11:16.406408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7aa874fc-834b-454d-8733-9b4703af340b tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Image pref 0:0:0 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 14:11:16.406823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.virt.hardware [None req-7aa874fc-834b-454d-8733-9b4703af340b tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 14:11:16.416516 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7aa874fc-834b-454d-8733-9b4703af340b tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:11:16.416999 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7aa874fc-834b-454d-8733-9b4703af340b tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:11:16.417604 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7aa874fc-834b-454d-8733-9b4703af340b tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:11:16.418319 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7aa874fc-834b-454d-8733-9b4703af340b tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:11:16.418777 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7aa874fc-834b-454d-8733-9b4703af340b tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:11:16.419202 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7aa874fc-834b-454d-8733-9b4703af340b tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:11:16.437663 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-7aa874fc-834b-454d-8733-9b4703af340b tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Getting quotas for project 94cd8d27b73146acaac2a4dc397511fd. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:11:16.443307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.quota [None req-7aa874fc-834b-454d-8733-9b4703af340b tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Getting quotas for user fe9417fc0a9f4c5dae91f2cdf4eecf46 and project 94cd8d27b73146acaac2a4dc397511fd. Resources: {'instances', 'cores', 'ram'} {{(pid=122432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:11:16.456706 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7aa874fc-834b-454d-8733-9b4703af340b tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Going to run 1 instances... {{(pid=122432) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 14:11:16.459087 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7aa874fc-834b-454d-8733-9b4703af340b tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 3cd8357c-48b1-4a73-b937-08edabbf83fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a5dd2b4d-ee9d-44eb-b267-89e80edd276f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 14:11:16.512250 n-d-852087-9 devstack@n-api.service[122432]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7aa874fc-834b-454d-8733-9b4703af340b tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [51116dcc-d3b6-4051-b11b-8934b98898f4] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 14:11:17.521503 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [None req-7aa874fc-834b-454d-8733-9b4703af340b tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [51116dcc-d3b6-4051-b11b-8934b98898f4] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 42548. Sep 07 14:11:17.526171 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7aa874fc-834b-454d-8733-9b4703af340b tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.663845 Sep 07 14:11:17.527108 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3896/7817] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 14:11:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 14:11:17.538856 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-843fd7b2-1fdc-461c-8e95-e68a02402f71 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:11:17.539507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-843fd7b2-1fdc-461c-8e95-e68a02402f71 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 3cd8357c-48b1-4a73-b937-08edabbf83fd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:11:17.606380 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-843fd7b2-1fdc-461c-8e95-e68a02402f71 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:11:17.614545 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-843fd7b2-1fdc-461c-8e95-e68a02402f71 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd" status: 200 len: 1247 microversion: 2.1 time: 0.079629 Sep 07 14:11:17.615550 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3922/7818] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:11:17 2022] GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd => generated 1247 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:11:18.639597 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-bad8afe1-27c3-4d3c-85ec-09daa3b0d9ff tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:11:18.640893 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-bad8afe1-27c3-4d3c-85ec-09daa3b0d9ff tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 3cd8357c-48b1-4a73-b937-08edabbf83fd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:11:18.650877 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bad8afe1-27c3-4d3c-85ec-09daa3b0d9ff tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:11:18.651402 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bad8afe1-27c3-4d3c-85ec-09daa3b0d9ff tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:11:18.652126 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bad8afe1-27c3-4d3c-85ec-09daa3b0d9ff tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:11:18.652859 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bad8afe1-27c3-4d3c-85ec-09daa3b0d9ff tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:11:18.653327 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bad8afe1-27c3-4d3c-85ec-09daa3b0d9ff tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:11:18.653791 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-bad8afe1-27c3-4d3c-85ec-09daa3b0d9ff tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:11:18.737140 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-bad8afe1-27c3-4d3c-85ec-09daa3b0d9ff tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:11:18.746110 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-bad8afe1-27c3-4d3c-85ec-09daa3b0d9ff tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd" status: 200 len: 1299 microversion: 2.1 time: 0.111869 Sep 07 14:11:18.747601 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3897/7819] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:11:18 2022] GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd => generated 1299 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:11:19.771112 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d49f4c0a-1295-4ded-a56a-4411e64541a0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:11:19.772520 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d49f4c0a-1295-4ded-a56a-4411e64541a0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 3cd8357c-48b1-4a73-b937-08edabbf83fd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:11:19.780365 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d49f4c0a-1295-4ded-a56a-4411e64541a0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:11:19.780985 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d49f4c0a-1295-4ded-a56a-4411e64541a0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:11:19.781525 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d49f4c0a-1295-4ded-a56a-4411e64541a0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:11:19.782342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d49f4c0a-1295-4ded-a56a-4411e64541a0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:11:19.782880 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d49f4c0a-1295-4ded-a56a-4411e64541a0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:11:19.783394 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d49f4c0a-1295-4ded-a56a-4411e64541a0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:11:20.273989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d49f4c0a-1295-4ded-a56a-4411e64541a0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:11:20.283369 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d49f4c0a-1295-4ded-a56a-4411e64541a0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd" status: 200 len: 1373 microversion: 2.1 time: 0.516651 Sep 07 14:11:20.284281 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3923/7820] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:11:19 2022] GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd => generated 1373 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:11:20.680044 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-630fff28-5f82-4e50-9174-279ca7da6a00 req-e64d3a04-4b41-47d1-92b0-1b34154bdc4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd8357c-48b1-4a73-b937-08edabbf83fd", "tag": "7116d8a3-31fe-4edb-9bd6-3c22197742f6"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:11:20.693776 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-630fff28-5f82-4e50-9174-279ca7da6a00 req-e64d3a04-4b41-47d1-92b0-1b34154bdc4a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:11:20.695522 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-630fff28-5f82-4e50-9174-279ca7da6a00 req-e64d3a04-4b41-47d1-92b0-1b34154bdc4a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:11:20.696085 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-630fff28-5f82-4e50-9174-279ca7da6a00 req-e64d3a04-4b41-47d1-92b0-1b34154bdc4a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:11:20.712451 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-630fff28-5f82-4e50-9174-279ca7da6a00 req-e64d3a04-4b41-47d1-92b0-1b34154bdc4a service nova] Creating event network-changed:7116d8a3-31fe-4edb-9bd6-3c22197742f6 for instance 3cd8357c-48b1-4a73-b937-08edabbf83fd on n-h2-852087-9 Sep 07 14:11:20.717947 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-630fff28-5f82-4e50-9174-279ca7da6a00 req-e64d3a04-4b41-47d1-92b0-1b34154bdc4a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042496 Sep 07 14:11:20.719163 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3898/7821] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:11:21.307211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-5b453c09-eff1-4107-b18e-aeb9af3f00f1 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:11:21.307991 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-5b453c09-eff1-4107-b18e-aeb9af3f00f1 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 3cd8357c-48b1-4a73-b937-08edabbf83fd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:11:21.315486 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b453c09-eff1-4107-b18e-aeb9af3f00f1 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:11:21.315999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b453c09-eff1-4107-b18e-aeb9af3f00f1 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:11:21.316486 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b453c09-eff1-4107-b18e-aeb9af3f00f1 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:11:21.317195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b453c09-eff1-4107-b18e-aeb9af3f00f1 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:11:21.317707 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b453c09-eff1-4107-b18e-aeb9af3f00f1 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:11:21.318148 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-5b453c09-eff1-4107-b18e-aeb9af3f00f1 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:11:21.467946 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-5b453c09-eff1-4107-b18e-aeb9af3f00f1 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:11:21.476500 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-5b453c09-eff1-4107-b18e-aeb9af3f00f1 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd" status: 200 len: 1373 microversion: 2.1 time: 0.173607 Sep 07 14:11:21.477094 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3924/7822] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:11:21 2022] GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:11:22.501917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-7deb5b68-6f02-4019-b22c-1eea8debe057 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:11:22.502702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-7deb5b68-6f02-4019-b22c-1eea8debe057 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 3cd8357c-48b1-4a73-b937-08edabbf83fd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:11:22.512307 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7deb5b68-6f02-4019-b22c-1eea8debe057 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:11:22.512817 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7deb5b68-6f02-4019-b22c-1eea8debe057 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:11:22.513806 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7deb5b68-6f02-4019-b22c-1eea8debe057 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:11:22.513988 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7deb5b68-6f02-4019-b22c-1eea8debe057 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:11:22.514472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7deb5b68-6f02-4019-b22c-1eea8debe057 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:11:22.514899 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-7deb5b68-6f02-4019-b22c-1eea8debe057 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:11:22.652770 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-7deb5b68-6f02-4019-b22c-1eea8debe057 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:11:22.664758 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-7deb5b68-6f02-4019-b22c-1eea8debe057 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd" status: 200 len: 1373 microversion: 2.1 time: 0.168584 Sep 07 14:11:22.665627 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3899/7823] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:11:22 2022] GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:11:23.698515 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-7609a141-47a0-4971-9c89-539381392ddb tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:11:23.699261 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-7609a141-47a0-4971-9c89-539381392ddb tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 3cd8357c-48b1-4a73-b937-08edabbf83fd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:11:23.707478 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7609a141-47a0-4971-9c89-539381392ddb tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:11:23.707994 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7609a141-47a0-4971-9c89-539381392ddb tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:11:23.708458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7609a141-47a0-4971-9c89-539381392ddb tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:11:23.709193 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7609a141-47a0-4971-9c89-539381392ddb tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:11:23.709727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7609a141-47a0-4971-9c89-539381392ddb tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:11:23.710184 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-7609a141-47a0-4971-9c89-539381392ddb tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:11:23.850006 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-7609a141-47a0-4971-9c89-539381392ddb tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:11:23.858877 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-7609a141-47a0-4971-9c89-539381392ddb tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd" status: 200 len: 1373 microversion: 2.1 time: 0.168265 Sep 07 14:11:23.859499 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3925/7824] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:11:23 2022] GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:11:24.882094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-14a42433-4760-4c85-bb00-37bec713bc21 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:11:24.882676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-14a42433-4760-4c85-bb00-37bec713bc21 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 3cd8357c-48b1-4a73-b937-08edabbf83fd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:11:24.890066 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14a42433-4760-4c85-bb00-37bec713bc21 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:11:24.890567 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14a42433-4760-4c85-bb00-37bec713bc21 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:11:24.891006 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14a42433-4760-4c85-bb00-37bec713bc21 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:11:24.891717 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14a42433-4760-4c85-bb00-37bec713bc21 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:11:24.892187 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14a42433-4760-4c85-bb00-37bec713bc21 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:11:24.892612 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14a42433-4760-4c85-bb00-37bec713bc21 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:11:25.034701 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-14a42433-4760-4c85-bb00-37bec713bc21 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:11:25.046035 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-14a42433-4760-4c85-bb00-37bec713bc21 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd" status: 200 len: 1373 microversion: 2.1 time: 0.167679 Sep 07 14:11:25.046876 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3900/7825] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:11:24 2022] GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:11:26.069659 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-26e3a0d6-8850-4dde-94a5-b6a28bf29ae6 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:11:26.070278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-26e3a0d6-8850-4dde-94a5-b6a28bf29ae6 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 3cd8357c-48b1-4a73-b937-08edabbf83fd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:11:26.077892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26e3a0d6-8850-4dde-94a5-b6a28bf29ae6 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:11:26.078412 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26e3a0d6-8850-4dde-94a5-b6a28bf29ae6 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:11:26.078869 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26e3a0d6-8850-4dde-94a5-b6a28bf29ae6 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:11:26.079598 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26e3a0d6-8850-4dde-94a5-b6a28bf29ae6 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:11:26.080075 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26e3a0d6-8850-4dde-94a5-b6a28bf29ae6 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:11:26.080549 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-26e3a0d6-8850-4dde-94a5-b6a28bf29ae6 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:11:26.229658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-26e3a0d6-8850-4dde-94a5-b6a28bf29ae6 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:11:26.237884 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-26e3a0d6-8850-4dde-94a5-b6a28bf29ae6 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd" status: 200 len: 1373 microversion: 2.1 time: 0.172355 Sep 07 14:11:26.238457 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3926/7826] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:11:26 2022] GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:11:27.261823 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-14d6583c-c328-4303-b67d-663642d08557 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:11:27.263094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-14d6583c-c328-4303-b67d-663642d08557 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 3cd8357c-48b1-4a73-b937-08edabbf83fd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:11:27.266029 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:11:27.266854 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=6 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:11:27.272965 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14d6583c-c328-4303-b67d-663642d08557 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:11:27.273459 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14d6583c-c328-4303-b67d-663642d08557 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:11:27.273923 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14d6583c-c328-4303-b67d-663642d08557 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:11:27.274652 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14d6583c-c328-4303-b67d-663642d08557 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:11:27.275106 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14d6583c-c328-4303-b67d-663642d08557 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:11:27.275525 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-14d6583c-c328-4303-b67d-663642d08557 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:11:27.315688 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-752d6acc-452b-4256-b398-ec8a9b50e763 req-961553ea-87a6-4c0f-afcc-b4da43fad46a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd8357c-48b1-4a73-b937-08edabbf83fd", "name": "network-vif-plugged", "status": "completed", "tag": "7116d8a3-31fe-4edb-9bd6-3c22197742f6"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:11:27.327710 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-752d6acc-452b-4256-b398-ec8a9b50e763 req-961553ea-87a6-4c0f-afcc-b4da43fad46a service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:11:27.328429 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-752d6acc-452b-4256-b398-ec8a9b50e763 req-961553ea-87a6-4c0f-afcc-b4da43fad46a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:11:27.328975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-752d6acc-452b-4256-b398-ec8a9b50e763 req-961553ea-87a6-4c0f-afcc-b4da43fad46a service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:11:27.341411 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-752d6acc-452b-4256-b398-ec8a9b50e763 req-961553ea-87a6-4c0f-afcc-b4da43fad46a service nova] Creating event network-vif-plugged:7116d8a3-31fe-4edb-9bd6-3c22197742f6 for instance 3cd8357c-48b1-4a73-b937-08edabbf83fd on n-h2-852087-9 Sep 07 14:11:27.347371 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-752d6acc-452b-4256-b398-ec8a9b50e763 req-961553ea-87a6-4c0f-afcc-b4da43fad46a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035560 Sep 07 14:11:27.348261 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3927/7827] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:11:27.430578 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-14d6583c-c328-4303-b67d-663642d08557 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:11:27.439375 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-14d6583c-c328-4303-b67d-663642d08557 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd" status: 200 len: 1373 microversion: 2.1 time: 0.181482 Sep 07 14:11:27.440005 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3901/7828] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:11:27 2022] GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd => generated 1373 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:11:28.461537 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:11:28.469430 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0f2c9f87-38e4-48dc-a2db-ab591e6652b2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:11:28.470892 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0f2c9f87-38e4-48dc-a2db-ab591e6652b2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 3cd8357c-48b1-4a73-b937-08edabbf83fd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:11:28.480276 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f2c9f87-38e4-48dc-a2db-ab591e6652b2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:11:28.480782 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f2c9f87-38e4-48dc-a2db-ab591e6652b2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:11:28.481238 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f2c9f87-38e4-48dc-a2db-ab591e6652b2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:11:28.481999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f2c9f87-38e4-48dc-a2db-ab591e6652b2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:11:28.482476 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f2c9f87-38e4-48dc-a2db-ab591e6652b2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:11:28.482916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0f2c9f87-38e4-48dc-a2db-ab591e6652b2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:11:28.631203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0f2c9f87-38e4-48dc-a2db-ab591e6652b2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:11:28.638955 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0f2c9f87-38e4-48dc-a2db-ab591e6652b2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd" status: 200 len: 1373 microversion: 2.1 time: 0.179031 Sep 07 14:11:28.639527 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3928/7829] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:11:28 2022] GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd => generated 1373 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:11:29.662633 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-270e2eb8-7d72-40f5-ab05-aad857abbf34 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:11:29.663257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-270e2eb8-7d72-40f5-ab05-aad857abbf34 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 3cd8357c-48b1-4a73-b937-08edabbf83fd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:11:29.670212 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-270e2eb8-7d72-40f5-ab05-aad857abbf34 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:11:29.670697 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-270e2eb8-7d72-40f5-ab05-aad857abbf34 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:11:29.671110 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-270e2eb8-7d72-40f5-ab05-aad857abbf34 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:11:29.671803 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-270e2eb8-7d72-40f5-ab05-aad857abbf34 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:11:29.672280 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-270e2eb8-7d72-40f5-ab05-aad857abbf34 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:11:29.672692 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-270e2eb8-7d72-40f5-ab05-aad857abbf34 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:11:29.809279 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-270e2eb8-7d72-40f5-ab05-aad857abbf34 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:11:29.817324 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-270e2eb8-7d72-40f5-ab05-aad857abbf34 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd" status: 200 len: 1558 microversion: 2.1 time: 0.158694 Sep 07 14:11:29.817917 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3902/7830] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:11:29 2022] GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:11:29.841278 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-71c38df4-ac50-4365-8aaa-634ea3047f18 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:11:29.841989 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-71c38df4-ac50-4365-8aaa-634ea3047f18 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 3cd8357c-48b1-4a73-b937-08edabbf83fd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:11:29.850244 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71c38df4-ac50-4365-8aaa-634ea3047f18 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:11:29.850751 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71c38df4-ac50-4365-8aaa-634ea3047f18 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:11:29.851179 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71c38df4-ac50-4365-8aaa-634ea3047f18 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:11:29.851919 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71c38df4-ac50-4365-8aaa-634ea3047f18 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:11:29.852393 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71c38df4-ac50-4365-8aaa-634ea3047f18 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:11:29.852833 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-71c38df4-ac50-4365-8aaa-634ea3047f18 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:11:29.990036 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-71c38df4-ac50-4365-8aaa-634ea3047f18 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:11:29.998171 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-71c38df4-ac50-4365-8aaa-634ea3047f18 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd" status: 200 len: 1558 microversion: 2.1 time: 0.161889 Sep 07 14:11:29.998766 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3929/7831] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:11:29 2022] GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:11:31.787876 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-1e7fbb4f-afd3-4e34-9c5d-7e90392c93df req-14cc0427-2b9d-4e89-9a1d-47605a41a770 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd8357c-48b1-4a73-b937-08edabbf83fd", "tag": "7116d8a3-31fe-4edb-9bd6-3c22197742f6"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:11:31.798769 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1e7fbb4f-afd3-4e34-9c5d-7e90392c93df req-14cc0427-2b9d-4e89-9a1d-47605a41a770 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:11:31.799257 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1e7fbb4f-afd3-4e34-9c5d-7e90392c93df req-14cc0427-2b9d-4e89-9a1d-47605a41a770 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:11:31.799712 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-1e7fbb4f-afd3-4e34-9c5d-7e90392c93df req-14cc0427-2b9d-4e89-9a1d-47605a41a770 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:11:31.812141 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-1e7fbb4f-afd3-4e34-9c5d-7e90392c93df req-14cc0427-2b9d-4e89-9a1d-47605a41a770 service nova] Creating event network-changed:7116d8a3-31fe-4edb-9bd6-3c22197742f6 for instance 3cd8357c-48b1-4a73-b937-08edabbf83fd on n-h2-852087-9 Sep 07 14:11:31.817509 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-1e7fbb4f-afd3-4e34-9c5d-7e90392c93df req-14cc0427-2b9d-4e89-9a1d-47605a41a770 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033423 Sep 07 14:11:31.818562 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3903/7832] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:13:27.282935 n-d-852087-9 devstack@n-api.service[122433]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e81ee00-bfe8-4eb4-a476-35156d4bea97] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 07 14:13:27.283851 n-d-852087-9 devstack@n-api.service[122433]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8d32b56c-9735-4691-a763-667a0c833c21] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 07 14:13:27.284690 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:13:27.285458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=38 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:13:27.290728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-c1ec033e-a55e-4d52-b576-c7d3ec690ced tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-61031782"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:13:27.293082 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-c1ec033e-a55e-4d52-b576-c7d3ec690ced tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 3cd8357c-48b1-4a73-b937-08edabbf83fd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:13:27.300648 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1ec033e-a55e-4d52-b576-c7d3ec690ced tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:27.301266 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1ec033e-a55e-4d52-b576-c7d3ec690ced tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:27.301774 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1ec033e-a55e-4d52-b576-c7d3ec690ced tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:27.302493 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1ec033e-a55e-4d52-b576-c7d3ec690ced tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:27.302978 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1ec033e-a55e-4d52-b576-c7d3ec690ced tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:27.303424 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-c1ec033e-a55e-4d52-b576-c7d3ec690ced tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:27.515107 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-c1ec033e-a55e-4d52-b576-c7d3ec690ced tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "POST /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd/action" status: 202 len: 0 microversion: 2.1 time: 0.233804 Sep 07 14:13:27.515793 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3930/7833] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 14:13:27 2022] POST /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 07 14:13:33.928105 n-d-852087-9 devstack@n-api.service[122432]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72b3548f-b60d-4e5d-9d07-5303e0946fc3] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 14:13:33.929289 n-d-852087-9 devstack@n-api.service[122432]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78519242-4876-4a94-89c0-8fbbf97741d7] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 14:13:33.930069 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:13:33.931142 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=36 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:13:33.943148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3169ef21-1f64-4475-b8a4-91592cb8615b req-79afd6cc-c3f2-48e6-bbdb-b803fbb84cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd8357c-48b1-4a73-b937-08edabbf83fd", "name": "network-vif-plugged", "status": "completed", "tag": "7116d8a3-31fe-4edb-9bd6-3c22197742f6"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:13:33.956973 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3169ef21-1f64-4475-b8a4-91592cb8615b req-79afd6cc-c3f2-48e6-bbdb-b803fbb84cb4 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:33.957539 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3169ef21-1f64-4475-b8a4-91592cb8615b req-79afd6cc-c3f2-48e6-bbdb-b803fbb84cb4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:33.957960 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3169ef21-1f64-4475-b8a4-91592cb8615b req-79afd6cc-c3f2-48e6-bbdb-b803fbb84cb4 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:33.972495 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3169ef21-1f64-4475-b8a4-91592cb8615b req-79afd6cc-c3f2-48e6-bbdb-b803fbb84cb4 service nova] Creating event network-vif-plugged:7116d8a3-31fe-4edb-9bd6-3c22197742f6 for instance 3cd8357c-48b1-4a73-b937-08edabbf83fd on n-h2-852087-9 Sep 07 14:13:33.979559 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3169ef21-1f64-4475-b8a4-91592cb8615b req-79afd6cc-c3f2-48e6-bbdb-b803fbb84cb4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054124 Sep 07 14:13:33.981161 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3904/7834] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:13:41.118177 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:13:41.118910 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:13:41.124017 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-09fa9ee3-2280-4396-90d9-2be9aed70a88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-567985233", "imageRef": "2a3d5e0b-3609-462d-b022-cccdfbde2afc", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-625149994", "security_groups": [{"name": "tempest-secgroup-smoke-2125886449"}], "networks": [{"uuid": "f3547db6-1876-40f6-ab7b-abdcd1106760"}]}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:13:41.148588 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] [8d32b56c-9735-4691-a763-667a0c833c21] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 42762. Sep 07 14:13:41.149717 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e81ee00-bfe8-4eb4-a476-35156d4bea97] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 42760. Sep 07 14:13:41.239406 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.network.neutron [None req-09fa9ee3-2280-4396-90d9-2be9aed70a88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] validate_networks() for [('f3547db6-1876-40f6-ab7b-abdcd1106760', None, None, None, None, None)] {{(pid=122433) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 14:13:41.765640 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-09fa9ee3-2280-4396-90d9-2be9aed70a88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Flavor limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 14:13:41.766279 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-09fa9ee3-2280-4396-90d9-2be9aed70a88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Image limits 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 14:13:41.766916 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-09fa9ee3-2280-4396-90d9-2be9aed70a88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Flavor pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 14:13:41.767535 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-09fa9ee3-2280-4396-90d9-2be9aed70a88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Image pref 0:0:0 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 14:13:41.768241 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.virt.hardware [None req-09fa9ee3-2280-4396-90d9-2be9aed70a88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 14:13:41.783305 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09fa9ee3-2280-4396-90d9-2be9aed70a88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:41.784165 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09fa9ee3-2280-4396-90d9-2be9aed70a88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:41.785186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09fa9ee3-2280-4396-90d9-2be9aed70a88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:41.786544 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09fa9ee3-2280-4396-90d9-2be9aed70a88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:41.787347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09fa9ee3-2280-4396-90d9-2be9aed70a88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:41.788015 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-09fa9ee3-2280-4396-90d9-2be9aed70a88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:41.807826 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-09fa9ee3-2280-4396-90d9-2be9aed70a88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Getting quotas for project 94cd8d27b73146acaac2a4dc397511fd. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:13:41.814268 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.quota [None req-09fa9ee3-2280-4396-90d9-2be9aed70a88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Getting quotas for user fe9417fc0a9f4c5dae91f2cdf4eecf46 and project 94cd8d27b73146acaac2a4dc397511fd. Resources: {'instances', 'cores', 'ram'} {{(pid=122433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:13:41.828258 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-09fa9ee3-2280-4396-90d9-2be9aed70a88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Going to run 1 instances... {{(pid=122433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 14:13:41.830858 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-09fa9ee3-2280-4396-90d9-2be9aed70a88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 58c78fce-6a62-4269-bc9a-4a204ade843b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2a3d5e0b-3609-462d-b022-cccdfbde2afc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 14:13:41.890292 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-09fa9ee3-2280-4396-90d9-2be9aed70a88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.774200 Sep 07 14:13:41.891246 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3931/7835] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Sep 7 14:13:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 14:13:41.905127 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-923047fe-404c-49d4-bee0-49449bd9e3d6 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:13:41.905917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-923047fe-404c-49d4-bee0-49449bd9e3d6 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 58c78fce-6a62-4269-bc9a-4a204ade843b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:13:41.918469 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] [72b3548f-b60d-4e5d-9d07-5303e0946fc3] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 42778. Sep 07 14:13:41.920267 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] [78519242-4876-4a94-89c0-8fbbf97741d7] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 42780. Sep 07 14:13:41.966862 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-923047fe-404c-49d4-bee0-49449bd9e3d6 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:13:41.974956 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-923047fe-404c-49d4-bee0-49449bd9e3d6 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b" status: 200 len: 1247 microversion: 2.1 time: 0.075984 Sep 07 14:13:41.975534 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3905/7836] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:13:41 2022] GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b => generated 1247 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:13:43.003114 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1fae87d6-9d47-4ddc-b120-c68048d50c26 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:13:43.003728 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1fae87d6-9d47-4ddc-b120-c68048d50c26 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 58c78fce-6a62-4269-bc9a-4a204ade843b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:13:43.010610 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fae87d6-9d47-4ddc-b120-c68048d50c26 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:43.011104 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fae87d6-9d47-4ddc-b120-c68048d50c26 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:43.011552 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fae87d6-9d47-4ddc-b120-c68048d50c26 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:43.012269 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fae87d6-9d47-4ddc-b120-c68048d50c26 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:43.012737 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fae87d6-9d47-4ddc-b120-c68048d50c26 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:43.013178 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1fae87d6-9d47-4ddc-b120-c68048d50c26 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:43.077718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1fae87d6-9d47-4ddc-b120-c68048d50c26 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:13:43.085815 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1fae87d6-9d47-4ddc-b120-c68048d50c26 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b" status: 200 len: 1299 microversion: 2.1 time: 0.091913 Sep 07 14:13:43.086371 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3932/7837] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:13:42 2022] GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b => generated 1299 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:13:44.111003 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b8de99cd-bb9a-412c-8b60-f26ec768e5c2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:13:44.112379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b8de99cd-bb9a-412c-8b60-f26ec768e5c2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 58c78fce-6a62-4269-bc9a-4a204ade843b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:13:44.119936 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:13:44.122195 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8de99cd-bb9a-412c-8b60-f26ec768e5c2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:44.122917 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8de99cd-bb9a-412c-8b60-f26ec768e5c2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:44.123569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8de99cd-bb9a-412c-8b60-f26ec768e5c2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:44.124510 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8de99cd-bb9a-412c-8b60-f26ec768e5c2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:44.125339 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8de99cd-bb9a-412c-8b60-f26ec768e5c2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:44.125961 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b8de99cd-bb9a-412c-8b60-f26ec768e5c2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:44.369160 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b8de99cd-bb9a-412c-8b60-f26ec768e5c2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:13:44.392042 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b8de99cd-bb9a-412c-8b60-f26ec768e5c2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b" status: 200 len: 1373 microversion: 2.1 time: 0.286920 Sep 07 14:13:44.395025 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3906/7838] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:13:44 2022] GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b => generated 1373 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:13:45.418840 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-098c9e29-64dd-4d9c-a0d3-f4efbb7e9ac0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:13:45.419460 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-098c9e29-64dd-4d9c-a0d3-f4efbb7e9ac0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 58c78fce-6a62-4269-bc9a-4a204ade843b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:13:45.426285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-098c9e29-64dd-4d9c-a0d3-f4efbb7e9ac0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:45.426794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-098c9e29-64dd-4d9c-a0d3-f4efbb7e9ac0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:45.427250 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-098c9e29-64dd-4d9c-a0d3-f4efbb7e9ac0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:45.427970 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-098c9e29-64dd-4d9c-a0d3-f4efbb7e9ac0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:45.428464 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-098c9e29-64dd-4d9c-a0d3-f4efbb7e9ac0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:45.429116 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-098c9e29-64dd-4d9c-a0d3-f4efbb7e9ac0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:45.576407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-098c9e29-64dd-4d9c-a0d3-f4efbb7e9ac0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:13:45.585427 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-098c9e29-64dd-4d9c-a0d3-f4efbb7e9ac0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b" status: 200 len: 1373 microversion: 2.1 time: 0.170687 Sep 07 14:13:45.586078 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3933/7839] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:13:45 2022] GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:13:45.980360 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-584f1f48-680e-4724-862a-74fabf677dd3 req-ff1b8079-901e-4934-8691-5441c5ffeeb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd8357c-48b1-4a73-b937-08edabbf83fd", "name": "network-vif-unplugged", "status": "completed", "tag": "7116d8a3-31fe-4edb-9bd6-3c22197742f6"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:13:45.993979 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-584f1f48-680e-4724-862a-74fabf677dd3 req-ff1b8079-901e-4934-8691-5441c5ffeeb9 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:45.994469 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-584f1f48-680e-4724-862a-74fabf677dd3 req-ff1b8079-901e-4934-8691-5441c5ffeeb9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:45.994975 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-584f1f48-680e-4724-862a-74fabf677dd3 req-ff1b8079-901e-4934-8691-5441c5ffeeb9 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:46.015856 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-584f1f48-680e-4724-862a-74fabf677dd3 req-ff1b8079-901e-4934-8691-5441c5ffeeb9 service nova] Creating event network-vif-unplugged:7116d8a3-31fe-4edb-9bd6-3c22197742f6 for instance 3cd8357c-48b1-4a73-b937-08edabbf83fd on n-h2-852087-9 Sep 07 14:13:46.024307 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-584f1f48-680e-4724-862a-74fabf677dd3 req-ff1b8079-901e-4934-8691-5441c5ffeeb9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047993 Sep 07 14:13:46.027321 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3907/7840] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:13:46.608658 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-d71bc2f3-6972-4212-823a-893bba50b3f4 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:13:46.610141 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-d71bc2f3-6972-4212-823a-893bba50b3f4 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 58c78fce-6a62-4269-bc9a-4a204ade843b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:13:46.617382 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d71bc2f3-6972-4212-823a-893bba50b3f4 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:46.617924 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d71bc2f3-6972-4212-823a-893bba50b3f4 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:46.618381 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d71bc2f3-6972-4212-823a-893bba50b3f4 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:46.619117 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d71bc2f3-6972-4212-823a-893bba50b3f4 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:46.619608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d71bc2f3-6972-4212-823a-893bba50b3f4 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:46.620147 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-d71bc2f3-6972-4212-823a-893bba50b3f4 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:46.779608 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-d71bc2f3-6972-4212-823a-893bba50b3f4 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:13:46.787580 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-d71bc2f3-6972-4212-823a-893bba50b3f4 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b" status: 200 len: 1373 microversion: 2.1 time: 0.183039 Sep 07 14:13:46.788152 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3934/7841] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:13:46 2022] GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:13:47.811052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-30eb361e-6ac3-4d40-a593-6ca33aec7eb2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:13:47.811659 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-30eb361e-6ac3-4d40-a593-6ca33aec7eb2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 58c78fce-6a62-4269-bc9a-4a204ade843b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:13:47.819393 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30eb361e-6ac3-4d40-a593-6ca33aec7eb2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:47.820179 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30eb361e-6ac3-4d40-a593-6ca33aec7eb2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:47.820818 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30eb361e-6ac3-4d40-a593-6ca33aec7eb2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:47.821751 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30eb361e-6ac3-4d40-a593-6ca33aec7eb2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:47.822383 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30eb361e-6ac3-4d40-a593-6ca33aec7eb2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:47.823030 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-30eb361e-6ac3-4d40-a593-6ca33aec7eb2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:47.972192 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-30eb361e-6ac3-4d40-a593-6ca33aec7eb2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:13:47.986875 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-30eb361e-6ac3-4d40-a593-6ca33aec7eb2 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b" status: 200 len: 1373 microversion: 2.1 time: 0.180123 Sep 07 14:13:47.988052 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3908/7842] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:13:47 2022] GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b => generated 1373 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:13:49.012507 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-efb04b16-60a7-4dfe-83dd-de5c515c5062 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:13:49.013143 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-efb04b16-60a7-4dfe-83dd-de5c515c5062 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 58c78fce-6a62-4269-bc9a-4a204ade843b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:13:49.020584 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efb04b16-60a7-4dfe-83dd-de5c515c5062 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:49.021347 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efb04b16-60a7-4dfe-83dd-de5c515c5062 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:49.021559 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efb04b16-60a7-4dfe-83dd-de5c515c5062 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:49.022297 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efb04b16-60a7-4dfe-83dd-de5c515c5062 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:49.022776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efb04b16-60a7-4dfe-83dd-de5c515c5062 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:49.023221 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-efb04b16-60a7-4dfe-83dd-de5c515c5062 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:49.167921 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-efb04b16-60a7-4dfe-83dd-de5c515c5062 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:13:49.176471 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-efb04b16-60a7-4dfe-83dd-de5c515c5062 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b" status: 200 len: 1373 microversion: 2.1 time: 0.168003 Sep 07 14:13:49.177566 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3935/7843] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:13:49 2022] GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:13:50.208528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5bd9587e-59e3-4aa8-8b93-b3d23f366014 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:13:50.208528 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5bd9587e-59e3-4aa8-8b93-b3d23f366014 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 58c78fce-6a62-4269-bc9a-4a204ade843b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:13:50.216008 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bd9587e-59e3-4aa8-8b93-b3d23f366014 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:50.216982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bd9587e-59e3-4aa8-8b93-b3d23f366014 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:50.218680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bd9587e-59e3-4aa8-8b93-b3d23f366014 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:50.218680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bd9587e-59e3-4aa8-8b93-b3d23f366014 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:50.218680 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bd9587e-59e3-4aa8-8b93-b3d23f366014 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:50.219431 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5bd9587e-59e3-4aa8-8b93-b3d23f366014 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:50.394130 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5bd9587e-59e3-4aa8-8b93-b3d23f366014 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:13:50.403919 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5bd9587e-59e3-4aa8-8b93-b3d23f366014 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b" status: 200 len: 1373 microversion: 2.1 time: 0.207286 Sep 07 14:13:50.404524 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3909/7844] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:13:50 2022] GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b => generated 1373 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:13:51.426822 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8f259e80-86fd-40e4-9592-cc180a6a0553 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:13:51.427462 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8f259e80-86fd-40e4-9592-cc180a6a0553 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 58c78fce-6a62-4269-bc9a-4a204ade843b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:13:51.435159 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f259e80-86fd-40e4-9592-cc180a6a0553 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:51.435651 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f259e80-86fd-40e4-9592-cc180a6a0553 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:51.436115 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f259e80-86fd-40e4-9592-cc180a6a0553 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:51.436860 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f259e80-86fd-40e4-9592-cc180a6a0553 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:51.437339 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f259e80-86fd-40e4-9592-cc180a6a0553 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:51.437823 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8f259e80-86fd-40e4-9592-cc180a6a0553 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:51.576216 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8f259e80-86fd-40e4-9592-cc180a6a0553 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:13:51.584692 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8f259e80-86fd-40e4-9592-cc180a6a0553 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b" status: 200 len: 1373 microversion: 2.1 time: 0.161814 Sep 07 14:13:51.585304 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3936/7845] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:13:51 2022] GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:13:52.608783 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-5e248f8c-ec71-4962-99ec-450d86d03120 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:13:52.609462 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-5e248f8c-ec71-4962-99ec-450d86d03120 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 58c78fce-6a62-4269-bc9a-4a204ade843b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:13:52.612276 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell0:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:13:52.618682 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e248f8c-ec71-4962-99ec-450d86d03120 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:52.619419 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e248f8c-ec71-4962-99ec-450d86d03120 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:52.619907 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e248f8c-ec71-4962-99ec-450d86d03120 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:52.620612 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e248f8c-ec71-4962-99ec-450d86d03120 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:52.621064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e248f8c-ec71-4962-99ec-450d86d03120 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:52.621472 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-5e248f8c-ec71-4962-99ec-450d86d03120 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:52.763064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-5e248f8c-ec71-4962-99ec-450d86d03120 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:13:52.771175 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-5e248f8c-ec71-4962-99ec-450d86d03120 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b" status: 200 len: 1373 microversion: 2.1 time: 0.166355 Sep 07 14:13:52.771732 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3910/7846] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:13:52 2022] GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:13:53.794085 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-738e3854-7ca9-4f60-adbf-62a56001b2c9 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:13:53.794722 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-738e3854-7ca9-4f60-adbf-62a56001b2c9 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 58c78fce-6a62-4269-bc9a-4a204ade843b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:13:53.796609 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:13:53.797291 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell0:SELECT=6 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:13:53.804022 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-738e3854-7ca9-4f60-adbf-62a56001b2c9 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:53.804528 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-738e3854-7ca9-4f60-adbf-62a56001b2c9 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:53.804982 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-738e3854-7ca9-4f60-adbf-62a56001b2c9 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:53.805725 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-738e3854-7ca9-4f60-adbf-62a56001b2c9 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:53.806195 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-738e3854-7ca9-4f60-adbf-62a56001b2c9 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:53.806633 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-738e3854-7ca9-4f60-adbf-62a56001b2c9 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:53.948844 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-738e3854-7ca9-4f60-adbf-62a56001b2c9 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:13:53.958347 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-738e3854-7ca9-4f60-adbf-62a56001b2c9 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b" status: 200 len: 1373 microversion: 2.1 time: 0.168213 Sep 07 14:13:53.959292 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3937/7847] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:13:53 2022] GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:13:54.333277 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-aebbde61-d4e3-44dd-9877-1cf0b955b8be req-bce07076-cbc8-4758-ba98-e37c32a095e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c78fce-6a62-4269-bc9a-4a204ade843b", "tag": "d3a34b3b-fd89-4690-bfa0-355f24b64ab8"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:13:54.343151 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-aebbde61-d4e3-44dd-9877-1cf0b955b8be req-bce07076-cbc8-4758-ba98-e37c32a095e8 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:54.343635 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-aebbde61-d4e3-44dd-9877-1cf0b955b8be req-bce07076-cbc8-4758-ba98-e37c32a095e8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:54.344072 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-aebbde61-d4e3-44dd-9877-1cf0b955b8be req-bce07076-cbc8-4758-ba98-e37c32a095e8 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:54.356121 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-aebbde61-d4e3-44dd-9877-1cf0b955b8be req-bce07076-cbc8-4758-ba98-e37c32a095e8 service nova] Creating event network-changed:d3a34b3b-fd89-4690-bfa0-355f24b64ab8 for instance 58c78fce-6a62-4269-bc9a-4a204ade843b on n-h1-852087-9 Sep 07 14:13:54.361265 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-aebbde61-d4e3-44dd-9877-1cf0b955b8be req-bce07076-cbc8-4758-ba98-e37c32a095e8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116329 Sep 07 14:13:54.362186 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3911/7848] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:13:54.982569 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-f2f75004-6678-4094-9843-f1d35452aec8 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:13:54.983211 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-f2f75004-6678-4094-9843-f1d35452aec8 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 58c78fce-6a62-4269-bc9a-4a204ade843b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:13:54.990647 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2f75004-6678-4094-9843-f1d35452aec8 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:54.991155 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2f75004-6678-4094-9843-f1d35452aec8 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:54.991607 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2f75004-6678-4094-9843-f1d35452aec8 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:54.992326 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2f75004-6678-4094-9843-f1d35452aec8 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:54.992794 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2f75004-6678-4094-9843-f1d35452aec8 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:54.993236 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-f2f75004-6678-4094-9843-f1d35452aec8 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:55.143623 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-f2f75004-6678-4094-9843-f1d35452aec8 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:13:55.151790 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-f2f75004-6678-4094-9843-f1d35452aec8 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b" status: 200 len: 1373 microversion: 2.1 time: 0.173285 Sep 07 14:13:55.155229 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3938/7849] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:13:54 2022] GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:13:56.179492 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-c9fd9dc6-9d1c-47ce-90e6-1f7cf8c4ca1f tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:13:56.180115 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-c9fd9dc6-9d1c-47ce-90e6-1f7cf8c4ca1f tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 58c78fce-6a62-4269-bc9a-4a204ade843b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:13:56.189233 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9fd9dc6-9d1c-47ce-90e6-1f7cf8c4ca1f tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:56.189778 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9fd9dc6-9d1c-47ce-90e6-1f7cf8c4ca1f tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:56.190227 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9fd9dc6-9d1c-47ce-90e6-1f7cf8c4ca1f tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:56.191246 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9fd9dc6-9d1c-47ce-90e6-1f7cf8c4ca1f tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:56.191721 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9fd9dc6-9d1c-47ce-90e6-1f7cf8c4ca1f tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:56.192290 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-c9fd9dc6-9d1c-47ce-90e6-1f7cf8c4ca1f tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:56.333569 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-c9fd9dc6-9d1c-47ce-90e6-1f7cf8c4ca1f tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:13:56.341782 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-c9fd9dc6-9d1c-47ce-90e6-1f7cf8c4ca1f tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b" status: 200 len: 1373 microversion: 2.1 time: 0.169785 Sep 07 14:13:56.342369 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3912/7850] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:13:56 2022] GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:13:57.364504 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-8258c4b0-1919-4c64-84e8-350aa535e620 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:13:57.365809 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-8258c4b0-1919-4c64-84e8-350aa535e620 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 58c78fce-6a62-4269-bc9a-4a204ade843b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:13:57.373319 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8258c4b0-1919-4c64-84e8-350aa535e620 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:57.373876 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8258c4b0-1919-4c64-84e8-350aa535e620 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:57.374314 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8258c4b0-1919-4c64-84e8-350aa535e620 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:57.375032 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8258c4b0-1919-4c64-84e8-350aa535e620 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:57.375499 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8258c4b0-1919-4c64-84e8-350aa535e620 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:57.375939 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-8258c4b0-1919-4c64-84e8-350aa535e620 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:57.589746 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-8258c4b0-1919-4c64-84e8-350aa535e620 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:13:57.598562 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-8258c4b0-1919-4c64-84e8-350aa535e620 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b" status: 200 len: 1373 microversion: 2.1 time: 0.238051 Sep 07 14:13:57.603029 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3939/7851] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:13:57 2022] GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b => generated 1373 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:13:58.622104 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-2af5a8cc-68ae-48d4-b0bf-e2737c0d7edc tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:13:58.622782 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-2af5a8cc-68ae-48d4-b0bf-e2737c0d7edc tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 58c78fce-6a62-4269-bc9a-4a204ade843b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:13:58.630614 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2af5a8cc-68ae-48d4-b0bf-e2737c0d7edc tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:58.631094 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2af5a8cc-68ae-48d4-b0bf-e2737c0d7edc tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:58.631524 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2af5a8cc-68ae-48d4-b0bf-e2737c0d7edc tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:58.632258 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2af5a8cc-68ae-48d4-b0bf-e2737c0d7edc tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:58.632730 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2af5a8cc-68ae-48d4-b0bf-e2737c0d7edc tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:58.633133 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-2af5a8cc-68ae-48d4-b0bf-e2737c0d7edc tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:58.779423 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-2af5a8cc-68ae-48d4-b0bf-e2737c0d7edc tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:13:58.787852 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-2af5a8cc-68ae-48d4-b0bf-e2737c0d7edc tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b" status: 200 len: 1373 microversion: 2.1 time: 0.169969 Sep 07 14:13:58.788440 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3913/7852] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:13:58 2022] GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:13:59.811740 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-1e15d9a4-d560-48f1-a31c-bba3c5afbb75 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:13:59.812371 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-1e15d9a4-d560-48f1-a31c-bba3c5afbb75 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 58c78fce-6a62-4269-bc9a-4a204ade843b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:13:59.820802 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e15d9a4-d560-48f1-a31c-bba3c5afbb75 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:59.821378 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e15d9a4-d560-48f1-a31c-bba3c5afbb75 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:59.821931 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e15d9a4-d560-48f1-a31c-bba3c5afbb75 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:59.822715 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e15d9a4-d560-48f1-a31c-bba3c5afbb75 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:13:59.823368 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e15d9a4-d560-48f1-a31c-bba3c5afbb75 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:13:59.823821 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-1e15d9a4-d560-48f1-a31c-bba3c5afbb75 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:13:59.976951 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-1e15d9a4-d560-48f1-a31c-bba3c5afbb75 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:13:59.984950 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-1e15d9a4-d560-48f1-a31c-bba3c5afbb75 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b" status: 200 len: 1373 microversion: 2.1 time: 0.177800 Sep 07 14:13:59.985529 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3940/7853] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:13:59 2022] GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:14:00.422733 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-81f8e00c-d73b-4b2c-9661-32fccc867a56 req-2e17be97-417d-4c70-baaf-551c6e53f3be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c78fce-6a62-4269-bc9a-4a204ade843b", "name": "network-vif-plugged", "status": "completed", "tag": "d3a34b3b-fd89-4690-bfa0-355f24b64ab8"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:14:00.433266 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-81f8e00c-d73b-4b2c-9661-32fccc867a56 req-2e17be97-417d-4c70-baaf-551c6e53f3be service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:14:00.433884 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-81f8e00c-d73b-4b2c-9661-32fccc867a56 req-2e17be97-417d-4c70-baaf-551c6e53f3be service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:14:00.434250 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-81f8e00c-d73b-4b2c-9661-32fccc867a56 req-2e17be97-417d-4c70-baaf-551c6e53f3be service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:14:00.445846 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-81f8e00c-d73b-4b2c-9661-32fccc867a56 req-2e17be97-417d-4c70-baaf-551c6e53f3be service nova] Creating event network-vif-plugged:d3a34b3b-fd89-4690-bfa0-355f24b64ab8 for instance 58c78fce-6a62-4269-bc9a-4a204ade843b on n-h1-852087-9 Sep 07 14:14:00.450838 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-81f8e00c-d73b-4b2c-9661-32fccc867a56 req-2e17be97-417d-4c70-baaf-551c6e53f3be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032098 Sep 07 14:14:00.451633 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3914/7854] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:14:01.009346 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-43a4194f-df85-4f16-882e-114d220358d5 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:14:01.009979 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-43a4194f-df85-4f16-882e-114d220358d5 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 58c78fce-6a62-4269-bc9a-4a204ade843b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:14:01.017501 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43a4194f-df85-4f16-882e-114d220358d5 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:14:01.018024 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43a4194f-df85-4f16-882e-114d220358d5 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:14:01.018484 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43a4194f-df85-4f16-882e-114d220358d5 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:14:01.019203 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43a4194f-df85-4f16-882e-114d220358d5 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:14:01.019714 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43a4194f-df85-4f16-882e-114d220358d5 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:14:01.020191 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-43a4194f-df85-4f16-882e-114d220358d5 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:14:01.155270 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-43a4194f-df85-4f16-882e-114d220358d5 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:14:01.163380 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-43a4194f-df85-4f16-882e-114d220358d5 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b" status: 200 len: 1373 microversion: 2.1 time: 0.158057 Sep 07 14:14:01.163945 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3941/7855] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:14:01 2022] GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:14:02.190951 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-a01124a9-7e22-463c-8890-1ff5c53de580 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:14:02.192148 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-a01124a9-7e22-463c-8890-1ff5c53de580 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 58c78fce-6a62-4269-bc9a-4a204ade843b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:14:02.200869 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a01124a9-7e22-463c-8890-1ff5c53de580 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:14:02.201365 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a01124a9-7e22-463c-8890-1ff5c53de580 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:14:02.201840 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a01124a9-7e22-463c-8890-1ff5c53de580 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:14:02.202534 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a01124a9-7e22-463c-8890-1ff5c53de580 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:14:02.203020 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a01124a9-7e22-463c-8890-1ff5c53de580 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:14:02.203470 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-a01124a9-7e22-463c-8890-1ff5c53de580 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:14:02.346493 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-a01124a9-7e22-463c-8890-1ff5c53de580 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:14:02.354732 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-a01124a9-7e22-463c-8890-1ff5c53de580 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b" status: 200 len: 1559 microversion: 2.1 time: 0.170449 Sep 07 14:14:02.355333 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3915/7856] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:14:02 2022] GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:14:02.377773 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-0b03f63d-14a5-4348-812a-79337198ba43 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:14:02.378455 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-0b03f63d-14a5-4348-812a-79337198ba43 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 58c78fce-6a62-4269-bc9a-4a204ade843b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:14:02.388835 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b03f63d-14a5-4348-812a-79337198ba43 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:14:02.389513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b03f63d-14a5-4348-812a-79337198ba43 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:14:02.390142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b03f63d-14a5-4348-812a-79337198ba43 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:14:02.390998 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b03f63d-14a5-4348-812a-79337198ba43 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:14:02.391718 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b03f63d-14a5-4348-812a-79337198ba43 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:14:02.392288 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-0b03f63d-14a5-4348-812a-79337198ba43 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:14:02.552187 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-0b03f63d-14a5-4348-812a-79337198ba43 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:14:02.560484 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-0b03f63d-14a5-4348-812a-79337198ba43 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b" status: 200 len: 1559 microversion: 2.1 time: 0.186706 Sep 07 14:14:02.561405 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3942/7857] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:14:02 2022] GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:14:04.241675 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-f2e4675a-a6a1-4d06-8539-3f2f3f58ca12 req-dbf96de0-2297-4502-9b2c-13c28b21352d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c78fce-6a62-4269-bc9a-4a204ade843b", "tag": "d3a34b3b-fd89-4690-bfa0-355f24b64ab8"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:14:04.247673 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=27 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:14:04.259132 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f2e4675a-a6a1-4d06-8539-3f2f3f58ca12 req-dbf96de0-2297-4502-9b2c-13c28b21352d service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:14:04.259615 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f2e4675a-a6a1-4d06-8539-3f2f3f58ca12 req-dbf96de0-2297-4502-9b2c-13c28b21352d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:14:04.260052 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-f2e4675a-a6a1-4d06-8539-3f2f3f58ca12 req-dbf96de0-2297-4502-9b2c-13c28b21352d service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:14:04.275954 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-f2e4675a-a6a1-4d06-8539-3f2f3f58ca12 req-dbf96de0-2297-4502-9b2c-13c28b21352d service nova] Creating event network-changed:d3a34b3b-fd89-4690-bfa0-355f24b64ab8 for instance 58c78fce-6a62-4269-bc9a-4a204ade843b on n-h1-852087-9 Sep 07 14:14:04.281311 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-f2e4675a-a6a1-4d06-8539-3f2f3f58ca12 req-dbf96de0-2297-4502-9b2c-13c28b21352d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043226 Sep 07 14:14:04.282135 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3916/7858] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:16:17.579894 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:16:17.580670 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=68 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:16:17.581514 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 14:16:17.581936 n-d-852087-9 devstack@n-api.service[122433]: Wed Sep 7 14:16:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b/action (ip 10.222.0.16) !!! Sep 07 14:16:17.584079 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 07 14:16:17.584325 n-d-852087-9 devstack@n-api.service[122433]: Wed Sep 7 14:16:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b/action (ip 10.222.0.16) !!! Sep 07 14:16:17.585333 n-d-852087-9 devstack@n-api.service[122433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 07 14:16:17.585446 n-d-852087-9 devstack@n-api.service[122433]: Wed Sep 7 14:16:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b/action (ip 10.222.0.16) !!! Sep 07 14:16:17.647672 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-96f8b01a-126f-4da9-a75b-2bf4286f17f8 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-226886103"}} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:16:17.651562 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-96f8b01a-126f-4da9-a75b-2bf4286f17f8 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 58c78fce-6a62-4269-bc9a-4a204ade843b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:16:17.662116 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96f8b01a-126f-4da9-a75b-2bf4286f17f8 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:16:17.662779 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96f8b01a-126f-4da9-a75b-2bf4286f17f8 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:16:17.663431 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96f8b01a-126f-4da9-a75b-2bf4286f17f8 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:16:17.664502 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96f8b01a-126f-4da9-a75b-2bf4286f17f8 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:16:17.665180 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96f8b01a-126f-4da9-a75b-2bf4286f17f8 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:16:17.665915 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-96f8b01a-126f-4da9-a75b-2bf4286f17f8 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:16:18.078967 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-96f8b01a-126f-4da9-a75b-2bf4286f17f8 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "POST /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b/action" status: 202 len: 0 microversion: 2.1 time: 0.500985 Sep 07 14:16:18.079583 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3943/7859] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Sep 7 14:16:17 2022] POST /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 07 14:16:25.135734 n-d-852087-9 devstack@n-api.service[122432]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72b3548f-b60d-4e5d-9d07-5303e0946fc3] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 07 14:16:25.136984 n-d-852087-9 devstack@n-api.service[122432]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78519242-4876-4a94-89c0-8fbbf97741d7] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 07 14:16:25.137617 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=1 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:16:25.138399 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=50 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:16:25.139321 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 14:16:25.139475 n-d-852087-9 devstack@n-api.service[122432]: Wed Sep 7 14:16:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Sep 07 14:16:25.141209 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 14:16:25.141209 n-d-852087-9 devstack@n-api.service[122432]: Wed Sep 7 14:16:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Sep 07 14:16:25.206626 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-2f7a3464-e43e-4b89-b3a4-345712045c8b req-616aa3f5-095f-44a4-8692-d20bf8d3b806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c78fce-6a62-4269-bc9a-4a204ade843b", "name": "network-vif-plugged", "status": "completed", "tag": "d3a34b3b-fd89-4690-bfa0-355f24b64ab8"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:16:25.217739 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2f7a3464-e43e-4b89-b3a4-345712045c8b req-616aa3f5-095f-44a4-8692-d20bf8d3b806 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:16:25.218191 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2f7a3464-e43e-4b89-b3a4-345712045c8b req-616aa3f5-095f-44a4-8692-d20bf8d3b806 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:16:25.218630 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-2f7a3464-e43e-4b89-b3a4-345712045c8b req-616aa3f5-095f-44a4-8692-d20bf8d3b806 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:16:25.229444 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-2f7a3464-e43e-4b89-b3a4-345712045c8b req-616aa3f5-095f-44a4-8692-d20bf8d3b806 service nova] Creating event network-vif-plugged:d3a34b3b-fd89-4690-bfa0-355f24b64ab8 for instance 58c78fce-6a62-4269-bc9a-4a204ade843b on n-h1-852087-9 Sep 07 14:16:25.234493 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-2f7a3464-e43e-4b89-b3a4-345712045c8b req-616aa3f5-095f-44a4-8692-d20bf8d3b806 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100983 Sep 07 14:16:25.235095 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3917/7860] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:16:37.264563 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_api:SELECT=2 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:16:37.267447 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_api:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:16:37.267932 n-d-852087-9 devstack@n-api.service[122433]: DEBUG dbcounter [-] [122433] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:16:37.268561 n-d-852087-9 devstack@n-api.service[122432]: DEBUG dbcounter [-] [122432] Writing DB stats nova_cell1:SELECT=2 {{(pid=122432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:16:37.282313 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] [78519242-4876-4a94-89c0-8fbbf97741d7] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 43126. Sep 07 14:16:37.287222 n-d-852087-9 devstack@n-api.service[122432]: INFO oslo.messaging._drivers.impl_rabbit [-] [72b3548f-b60d-4e5d-9d07-5303e0946fc3] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 43124. Sep 07 14:16:37.299100 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-6074fc10-6336-4abb-a05c-dc46981a5f10 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:16:37.299738 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6074fc10-6336-4abb-a05c-dc46981a5f10 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 58c78fce-6a62-4269-bc9a-4a204ade843b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:16:37.311727 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6074fc10-6336-4abb-a05c-dc46981a5f10 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:16:37.312284 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6074fc10-6336-4abb-a05c-dc46981a5f10 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:16:37.313142 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6074fc10-6336-4abb-a05c-dc46981a5f10 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:16:37.314458 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6074fc10-6336-4abb-a05c-dc46981a5f10 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:16:37.314570 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6074fc10-6336-4abb-a05c-dc46981a5f10 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:16:37.314975 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-6074fc10-6336-4abb-a05c-dc46981a5f10 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:16:37.351590 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-6074fc10-6336-4abb-a05c-dc46981a5f10 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 58c78fce-6a62-4269-bc9a-4a204ade843b] Going to try to terminate instance {{(pid=122433) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:16:37.351878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-7886214b-0175-4922-b334-882ffe7aaa35 req-ef715658-4975-4f51-897d-95305278a9cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c78fce-6a62-4269-bc9a-4a204ade843b", "tag": "d3a34b3b-fd89-4690-bfa0-355f24b64ab8"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:16:37.362860 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7886214b-0175-4922-b334-882ffe7aaa35 req-ef715658-4975-4f51-897d-95305278a9cc service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:16:37.363337 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7886214b-0175-4922-b334-882ffe7aaa35 req-ef715658-4975-4f51-897d-95305278a9cc service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:16:37.363972 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-7886214b-0175-4922-b334-882ffe7aaa35 req-ef715658-4975-4f51-897d-95305278a9cc service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:16:37.375038 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-7886214b-0175-4922-b334-882ffe7aaa35 req-ef715658-4975-4f51-897d-95305278a9cc service nova] Creating event network-changed:d3a34b3b-fd89-4690-bfa0-355f24b64ab8 for instance 58c78fce-6a62-4269-bc9a-4a204ade843b on n-h1-852087-9 Sep 07 14:16:37.380600 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-7886214b-0175-4922-b334-882ffe7aaa35 req-ef715658-4975-4f51-897d-95305278a9cc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116199 Sep 07 14:16:37.381216 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3918/7861] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:16:37.438220 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-6074fc10-6336-4abb-a05c-dc46981a5f10 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "DELETE /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b" status: 204 len: 0 microversion: 2.1 time: 0.174809 Sep 07 14:16:37.439397 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3944/7862] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 14:16:37 2022] DELETE /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 14:16:37.462214 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-ce286c51-b64c-480c-aec1-0a441321fc90 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:16:37.463095 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-ce286c51-b64c-480c-aec1-0a441321fc90 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 58c78fce-6a62-4269-bc9a-4a204ade843b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:16:37.470502 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce286c51-b64c-480c-aec1-0a441321fc90 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:16:37.471064 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce286c51-b64c-480c-aec1-0a441321fc90 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:16:37.471562 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce286c51-b64c-480c-aec1-0a441321fc90 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:16:37.472381 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce286c51-b64c-480c-aec1-0a441321fc90 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:16:37.472873 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce286c51-b64c-480c-aec1-0a441321fc90 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:16:37.473363 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-ce286c51-b64c-480c-aec1-0a441321fc90 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:16:37.681726 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-ce286c51-b64c-480c-aec1-0a441321fc90 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:16:37.689984 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-ce286c51-b64c-480c-aec1-0a441321fc90 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b" status: 200 len: 1683 microversion: 2.1 time: 0.241402 Sep 07 14:16:37.690570 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3919/7863] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:16:37 2022] GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b => generated 1683 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:16:38.716218 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-347ecc36-e35c-40b7-af77-6bf6a63dab22 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:16:38.716908 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-347ecc36-e35c-40b7-af77-6bf6a63dab22 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 58c78fce-6a62-4269-bc9a-4a204ade843b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:16:38.724513 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-347ecc36-e35c-40b7-af77-6bf6a63dab22 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:16:38.725041 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-347ecc36-e35c-40b7-af77-6bf6a63dab22 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:16:38.725578 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-347ecc36-e35c-40b7-af77-6bf6a63dab22 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:16:38.726298 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-347ecc36-e35c-40b7-af77-6bf6a63dab22 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:16:38.726744 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-347ecc36-e35c-40b7-af77-6bf6a63dab22 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:16:38.727227 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-347ecc36-e35c-40b7-af77-6bf6a63dab22 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:16:38.865186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-347ecc36-e35c-40b7-af77-6bf6a63dab22 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:16:38.873666 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-347ecc36-e35c-40b7-af77-6bf6a63dab22 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b" status: 200 len: 1683 microversion: 2.1 time: 0.162280 Sep 07 14:16:38.874717 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3945/7864] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:16:38 2022] GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:16:39.155342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [req-3fa756d8-7597-431b-b40d-30926b00ea6f req-f1783856-bc9f-4502-a2e9-0c4473347eaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c78fce-6a62-4269-bc9a-4a204ade843b", "name": "network-vif-unplugged", "status": "completed", "tag": "d3a34b3b-fd89-4690-bfa0-355f24b64ab8"}]} {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:16:39.169260 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3fa756d8-7597-431b-b40d-30926b00ea6f req-f1783856-bc9f-4502-a2e9-0c4473347eaf service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:16:39.169952 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3fa756d8-7597-431b-b40d-30926b00ea6f req-f1783856-bc9f-4502-a2e9-0c4473347eaf service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:16:39.170609 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [req-3fa756d8-7597-431b-b40d-30926b00ea6f req-f1783856-bc9f-4502-a2e9-0c4473347eaf service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:16:39.183395 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.compute.server_external_events [req-3fa756d8-7597-431b-b40d-30926b00ea6f req-f1783856-bc9f-4502-a2e9-0c4473347eaf service nova] Creating event network-vif-unplugged:d3a34b3b-fd89-4690-bfa0-355f24b64ab8 for instance 58c78fce-6a62-4269-bc9a-4a204ade843b on n-h1-852087-9 Sep 07 14:16:39.189474 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [req-3fa756d8-7597-431b-b40d-30926b00ea6f req-f1783856-bc9f-4502-a2e9-0c4473347eaf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038239 Sep 07 14:16:39.190293 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3920/7865] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:16:39.895139 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-30217a9d-d027-461b-b126-e9aeb3e72cfd req-1c05c033-30be-4166-9217-e8fe5e469a2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c78fce-6a62-4269-bc9a-4a204ade843b", "name": "network-vif-deleted", "tag": "d3a34b3b-fd89-4690-bfa0-355f24b64ab8"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:16:39.898589 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-b3e625ea-a666-447d-8ff1-d0568aa8362f tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:16:39.899551 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-b3e625ea-a666-447d-8ff1-d0568aa8362f tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 58c78fce-6a62-4269-bc9a-4a204ade843b] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:16:39.908754 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-30217a9d-d027-461b-b126-e9aeb3e72cfd req-1c05c033-30be-4166-9217-e8fe5e469a2c service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:16:39.909272 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-30217a9d-d027-461b-b126-e9aeb3e72cfd req-1c05c033-30be-4166-9217-e8fe5e469a2c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:16:39.909791 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-30217a9d-d027-461b-b126-e9aeb3e72cfd req-1c05c033-30be-4166-9217-e8fe5e469a2c service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:16:39.917894 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3e625ea-a666-447d-8ff1-d0568aa8362f tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:16:39.918702 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3e625ea-a666-447d-8ff1-d0568aa8362f tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:16:39.919425 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3e625ea-a666-447d-8ff1-d0568aa8362f tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:16:39.920544 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3e625ea-a666-447d-8ff1-d0568aa8362f tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:16:39.921224 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3e625ea-a666-447d-8ff1-d0568aa8362f tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:16:39.922009 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-b3e625ea-a666-447d-8ff1-d0568aa8362f tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:16:39.925428 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-30217a9d-d027-461b-b126-e9aeb3e72cfd req-1c05c033-30be-4166-9217-e8fe5e469a2c service nova] Creating event network-vif-deleted:d3a34b3b-fd89-4690-bfa0-355f24b64ab8 for instance 58c78fce-6a62-4269-bc9a-4a204ade843b on n-h1-852087-9 Sep 07 14:16:39.933720 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-30217a9d-d027-461b-b126-e9aeb3e72cfd req-1c05c033-30be-4166-9217-e8fe5e469a2c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042129 Sep 07 14:16:39.935639 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3946/7866] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:16:39.998517 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-b3e625ea-a666-447d-8ff1-d0568aa8362f tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:16:40.008820 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-b3e625ea-a666-447d-8ff1-d0568aa8362f tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b" status: 200 len: 1497 microversion: 2.1 time: 0.114902 Sep 07 14:16:40.009906 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3921/7867] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:16:39 2022] GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b => generated 1497 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:16:41.034342 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-10fd0053-2723-45c8-b4e3-b9a2df4f373d tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:16:41.035102 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-10fd0053-2723-45c8-b4e3-b9a2df4f373d tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 58c78fce-6a62-4269-bc9a-4a204ade843b] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:16:41.041739 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10fd0053-2723-45c8-b4e3-b9a2df4f373d tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:16:41.042243 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10fd0053-2723-45c8-b4e3-b9a2df4f373d tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:16:41.042692 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10fd0053-2723-45c8-b4e3-b9a2df4f373d tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:16:41.043387 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10fd0053-2723-45c8-b4e3-b9a2df4f373d tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:16:41.043855 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10fd0053-2723-45c8-b4e3-b9a2df4f373d tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:16:41.044285 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-10fd0053-2723-45c8-b4e3-b9a2df4f373d tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:16:41.060926 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.wsgi [None req-10fd0053-2723-45c8-b4e3-b9a2df4f373d tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] HTTP exception thrown: Instance 58c78fce-6a62-4269-bc9a-4a204ade843b could not be found. Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-10fd0053-2723-45c8-b4e3-b9a2df4f373d tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Request method failure captured: Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: request: GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b HTTP/1.1 Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: Accept: application/json Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: Accept-Encoding: identity Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: Connection: close Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: Content-Length: 0 Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: Content-Type: application/json Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: Host: 10.222.0.16 Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: Openstack-System-Scope: None Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: User-Agent: python-urllib3/1.26.12 Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: X-Auth-Token: gAAAAABjGKZ9TEEXyzgqibBfYHxTjThYmAT0uQ2PHfbU6LTIw-KwVnTz2-wUfWN7YH57A9wF6aLzTpgOCR3Ddsc8XiyPWnH9AQ_T1-LGGN7hrSnwd1-uQO1C33czcoyR4bh6iGz45_bD542gZmltzFdxEpxFACGJIM1SnLE1rYsZGOf5cxnAaKA Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Id: None Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: X-Domain-Name: None Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: X-Identity-Status: Confirmed Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: X-Is-Admin-Project: True Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Id: default Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Domain-Name: Default Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Id: 94cd8d27b73146acaac2a4dc397511fd Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: X-Project-Name: tempest-TestSnapshotPattern-361404360 Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: X-Role: reader,member Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: X-Roles: reader,member Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94cd8d27b73146acaac2a4dc397511fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_94cd8d27b73146acaac2a4dc397511fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/94cd8d27b73146acaac2a4dc397511fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94cd8d27b73146acaac2a4dc397511fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant: tempest-TestSnapshotPattern-361404360 Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Id: 94cd8d27b73146acaac2a4dc397511fd Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: X-Tenant-Name: tempest-TestSnapshotPattern-361404360 Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: X-User: tempest-TestSnapshotPattern-361404360-project Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Id: default Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: X-User-Domain-Name: Default Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: X-User-Id: fe9417fc0a9f4c5dae91f2cdf4eecf46 Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: X-User-Name: tempest-TestSnapshotPattern-361404360-project Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: method: > Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: exception: Instance 58c78fce-6a62-4269-bc9a-4a204ade843b could not be found. Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: action_args: {'id': '58c78fce-6a62-4269-bc9a-4a204ade843b'} Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58c78fce-6a62-4269-bc9a-4a204ade843b could not be found. Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58c78fce-6a62-4269-bc9a-4a204ade843b could not be found. Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:16:41.062653 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 14:16:41.069293 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:16:41.069293 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:16:41.069293 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:16:41.069293 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:16:41.069293 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:16:41.069293 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58c78fce-6a62-4269-bc9a-4a204ade843b could not be found. Sep 07 14:16:41.069293 n-d-852087-9 devstack@n-api.service[122433]: ERROR nova.api.openstack.wsgi Sep 07 14:16:41.069293 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-10fd0053-2723-45c8-b4e3-b9a2df4f373d tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Returning 404 to user: Instance 58c78fce-6a62-4269-bc9a-4a204ade843b could not be found. {{(pid=122433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:16:41.069293 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-10fd0053-2723-45c8-b4e3-b9a2df4f373d tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b" status: 404 len: 111 microversion: 2.1 time: 0.035115 Sep 07 14:16:41.069293 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3947/7868] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:16:41 2022] GET /compute/v2.1/servers/58c78fce-6a62-4269-bc9a-4a204ade843b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:16:42.548839 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-f8eba3db-d847-447c-9bf7-1c9fb77d25f0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:16:42.549366 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f8eba3db-d847-447c-9bf7-1c9fb77d25f0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 3cd8357c-48b1-4a73-b937-08edabbf83fd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:16:42.550918 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-34aa2ea7-76e6-49ed-a56b-595413b60377 req-6ef1a03a-d5d4-42d8-b747-f1180f390bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd8357c-48b1-4a73-b937-08edabbf83fd", "tag": "7116d8a3-31fe-4edb-9bd6-3c22197742f6"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:16:42.557384 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8eba3db-d847-447c-9bf7-1c9fb77d25f0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:16:42.557983 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8eba3db-d847-447c-9bf7-1c9fb77d25f0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:16:42.558408 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8eba3db-d847-447c-9bf7-1c9fb77d25f0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:16:42.559102 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8eba3db-d847-447c-9bf7-1c9fb77d25f0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:16:42.559553 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8eba3db-d847-447c-9bf7-1c9fb77d25f0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:16:42.560107 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-f8eba3db-d847-447c-9bf7-1c9fb77d25f0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:16:42.562186 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-34aa2ea7-76e6-49ed-a56b-595413b60377 req-6ef1a03a-d5d4-42d8-b747-f1180f390bf0 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:16:42.562758 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-34aa2ea7-76e6-49ed-a56b-595413b60377 req-6ef1a03a-d5d4-42d8-b747-f1180f390bf0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:16:42.563457 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-34aa2ea7-76e6-49ed-a56b-595413b60377 req-6ef1a03a-d5d4-42d8-b747-f1180f390bf0 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:16:42.575759 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-34aa2ea7-76e6-49ed-a56b-595413b60377 req-6ef1a03a-d5d4-42d8-b747-f1180f390bf0 service nova] Creating event network-changed:7116d8a3-31fe-4edb-9bd6-3c22197742f6 for instance 3cd8357c-48b1-4a73-b937-08edabbf83fd on n-h2-852087-9 Sep 07 14:16:42.581194 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-34aa2ea7-76e6-49ed-a56b-595413b60377 req-6ef1a03a-d5d4-42d8-b747-f1180f390bf0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034602 Sep 07 14:16:42.581926 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3948/7869] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:16:42.592198 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-f8eba3db-d847-447c-9bf7-1c9fb77d25f0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 3cd8357c-48b1-4a73-b937-08edabbf83fd] Going to try to terminate instance {{(pid=122432) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:16:42.676105 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-f8eba3db-d847-447c-9bf7-1c9fb77d25f0 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd" status: 204 len: 0 microversion: 2.1 time: 0.131692 Sep 07 14:16:42.676989 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3922/7870] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Sep 7 14:16:42 2022] DELETE /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 14:16:42.688259 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-13b52704-32ca-4ec1-9cea-63c1328e79bd tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:16:42.688981 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.compute.api [None req-13b52704-32ca-4ec1-9cea-63c1328e79bd tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 3cd8357c-48b1-4a73-b937-08edabbf83fd] Fetching instance by UUID {{(pid=122433) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:16:42.695999 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13b52704-32ca-4ec1-9cea-63c1328e79bd tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:16:42.696512 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13b52704-32ca-4ec1-9cea-63c1328e79bd tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:16:42.697018 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13b52704-32ca-4ec1-9cea-63c1328e79bd tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:16:42.697776 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13b52704-32ca-4ec1-9cea-63c1328e79bd tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:16:42.698257 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13b52704-32ca-4ec1-9cea-63c1328e79bd tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:16:42.698903 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [None req-13b52704-32ca-4ec1-9cea-63c1328e79bd tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:16:42.841576 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.policy [None req-13b52704-32ca-4ec1-9cea-63c1328e79bd tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122433) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:16:42.850015 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-13b52704-32ca-4ec1-9cea-63c1328e79bd tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd" status: 200 len: 1683 microversion: 2.1 time: 0.166622 Sep 07 14:16:42.850607 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3949/7871] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:16:42 2022] GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:16:43.873878 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-dbcd14ed-1ad5-472e-a083-86ff63c2c4ab tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:16:43.874597 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-dbcd14ed-1ad5-472e-a083-86ff63c2c4ab tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 3cd8357c-48b1-4a73-b937-08edabbf83fd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:16:43.881708 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbcd14ed-1ad5-472e-a083-86ff63c2c4ab tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:16:43.882231 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbcd14ed-1ad5-472e-a083-86ff63c2c4ab tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:16:43.882676 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbcd14ed-1ad5-472e-a083-86ff63c2c4ab tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:16:43.883368 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbcd14ed-1ad5-472e-a083-86ff63c2c4ab tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:16:43.883982 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbcd14ed-1ad5-472e-a083-86ff63c2c4ab tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:16:43.884316 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-dbcd14ed-1ad5-472e-a083-86ff63c2c4ab tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:16:44.080748 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.policy [None req-dbcd14ed-1ad5-472e-a083-86ff63c2c4ab tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9417fc0a9f4c5dae91f2cdf4eecf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd8d27b73146acaac2a4dc397511fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122432) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:16:44.092658 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-dbcd14ed-1ad5-472e-a083-86ff63c2c4ab tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd" status: 200 len: 1683 microversion: 2.1 time: 0.222950 Sep 07 14:16:44.094751 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3923/7872] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:16:43 2022] GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd => generated 1683 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:16:44.599217 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [req-be8d520a-cae7-4cee-910e-69fbce349e57 req-a2478f7e-0c13-4d59-884a-128b718018d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd8357c-48b1-4a73-b937-08edabbf83fd", "name": "network-vif-deleted", "tag": "7116d8a3-31fe-4edb-9bd6-3c22197742f6"}]} {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:16:44.611407 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-be8d520a-cae7-4cee-910e-69fbce349e57 req-a2478f7e-0c13-4d59-884a-128b718018d6 service nova] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:16:44.611990 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-be8d520a-cae7-4cee-910e-69fbce349e57 req-a2478f7e-0c13-4d59-884a-128b718018d6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:16:44.612479 n-d-852087-9 devstack@n-api.service[122433]: DEBUG oslo_concurrency.lockutils [req-be8d520a-cae7-4cee-910e-69fbce349e57 req-a2478f7e-0c13-4d59-884a-128b718018d6 service nova] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:16:44.627326 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.compute.server_external_events [req-be8d520a-cae7-4cee-910e-69fbce349e57 req-a2478f7e-0c13-4d59-884a-128b718018d6 service nova] Creating event network-vif-deleted:7116d8a3-31fe-4edb-9bd6-3c22197742f6 for instance 3cd8357c-48b1-4a73-b937-08edabbf83fd on n-h2-852087-9 Sep 07 14:16:44.632361 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [req-be8d520a-cae7-4cee-910e-69fbce349e57 req-a2478f7e-0c13-4d59-884a-128b718018d6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039634 Sep 07 14:16:44.633112 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3950/7873] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Sep 7 14:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:16:45.119764 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92249db7-5e4a-43a8-95a2-f8ca3b1f0f88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '>' {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:16:45.120380 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.compute.api [None req-92249db7-5e4a-43a8-95a2-f8ca3b1f0f88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] [instance: 3cd8357c-48b1-4a73-b937-08edabbf83fd] Fetching instance by UUID {{(pid=122432) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:16:45.127584 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92249db7-5e4a-43a8-95a2-f8ca3b1f0f88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:16:45.128084 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92249db7-5e4a-43a8-95a2-f8ca3b1f0f88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:16:45.128556 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92249db7-5e4a-43a8-95a2-f8ca3b1f0f88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:16:45.129267 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92249db7-5e4a-43a8-95a2-f8ca3b1f0f88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Acquiring lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:16:45.129761 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92249db7-5e4a-43a8-95a2-f8ca3b1f0f88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:16:45.130197 n-d-852087-9 devstack@n-api.service[122432]: DEBUG oslo_concurrency.lockutils [None req-92249db7-5e4a-43a8-95a2-f8ca3b1f0f88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Lock "9e0290a2-728a-49bc-bfb2-19275e06ed31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:16:45.144612 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.wsgi [None req-92249db7-5e4a-43a8-95a2-f8ca3b1f0f88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] HTTP exception thrown: Instance 3cd8357c-48b1-4a73-b937-08edabbf83fd could not be found. Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92249db7-5e4a-43a8-95a2-f8ca3b1f0f88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Request method failure captured: Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: request: GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd HTTP/1.1 Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: Accept: application/json Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: Accept-Encoding: identity Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: Connection: close Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: Content-Length: 0 Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: Content-Type: application/json Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: Host: 10.222.0.16 Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: Openstack-System-Scope: None Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: User-Agent: python-urllib3/1.26.12 Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: X-Auth-Token: gAAAAABjGKZ9TEEXyzgqibBfYHxTjThYmAT0uQ2PHfbU6LTIw-KwVnTz2-wUfWN7YH57A9wF6aLzTpgOCR3Ddsc8XiyPWnH9AQ_T1-LGGN7hrSnwd1-uQO1C33czcoyR4bh6iGz45_bD542gZmltzFdxEpxFACGJIM1SnLE1rYsZGOf5cxnAaKA Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Id: None Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: X-Domain-Name: None Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: X-Identity-Status: Confirmed Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: X-Is-Admin-Project: True Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Id: default Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Domain-Name: Default Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Id: 94cd8d27b73146acaac2a4dc397511fd Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: X-Project-Name: tempest-TestSnapshotPattern-361404360 Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: X-Role: reader,member Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: X-Roles: reader,member Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94cd8d27b73146acaac2a4dc397511fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_94cd8d27b73146acaac2a4dc397511fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/94cd8d27b73146acaac2a4dc397511fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94cd8d27b73146acaac2a4dc397511fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant: tempest-TestSnapshotPattern-361404360 Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Id: 94cd8d27b73146acaac2a4dc397511fd Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: X-Tenant-Name: tempest-TestSnapshotPattern-361404360 Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: X-User: tempest-TestSnapshotPattern-361404360-project Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Id: default Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: X-User-Domain-Name: Default Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: X-User-Id: fe9417fc0a9f4c5dae91f2cdf4eecf46 Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: X-User-Name: tempest-TestSnapshotPattern-361404360-project Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: method: > Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: exception: Instance 3cd8357c-48b1-4a73-b937-08edabbf83fd could not be found. Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: action_args: {'id': '3cd8357c-48b1-4a73-b937-08edabbf83fd'} Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: {{(pid=122432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cd8357c-48b1-4a73-b937-08edabbf83fd could not be found. Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cd8357c-48b1-4a73-b937-08edabbf83fd could not be found. Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:16:45.146342 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 14:16:45.151379 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:16:45.151379 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:16:45.151379 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:16:45.151379 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:16:45.151379 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:16:45.151379 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cd8357c-48b1-4a73-b937-08edabbf83fd could not be found. Sep 07 14:16:45.151379 n-d-852087-9 devstack@n-api.service[122432]: ERROR nova.api.openstack.wsgi Sep 07 14:16:45.151379 n-d-852087-9 devstack@n-api.service[122432]: DEBUG nova.api.openstack.wsgi [None req-92249db7-5e4a-43a8-95a2-f8ca3b1f0f88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Returning 404 to user: Instance 3cd8357c-48b1-4a73-b937-08edabbf83fd could not be found. {{(pid=122432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:16:45.151379 n-d-852087-9 devstack@n-api.service[122432]: INFO nova.api.openstack.requestlog [None req-92249db7-5e4a-43a8-95a2-f8ca3b1f0f88 tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd" status: 404 len: 111 microversion: 2.1 time: 0.032094 Sep 07 14:16:45.151379 n-d-852087-9 devstack@n-api.service[122432]: [pid: 122432|app: 0|req: 3924/7874] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Sep 7 14:16:45 2022] GET /compute/v2.1/servers/3cd8357c-48b1-4a73-b937-08edabbf83fd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:16:45.329351 n-d-852087-9 devstack@n-api.service[122433]: DEBUG nova.api.openstack.wsgi [None req-2b4eecc9-182a-4a58-892c-d2db49b2210c tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] Calling method '.version_select at 0x7fc418af9310>' {{(pid=122433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:16:45.360407 n-d-852087-9 devstack@n-api.service[122433]: INFO nova.api.openstack.requestlog [None req-2b4eecc9-182a-4a58-892c-d2db49b2210c tempest-TestSnapshotPattern-361404360 tempest-TestSnapshotPattern-361404360-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-625149994" status: 202 len: 0 microversion: 2.1 time: 0.034549 Sep 07 14:16:45.361060 n-d-852087-9 devstack@n-api.service[122433]: [pid: 122433|app: 0|req: 3951/7875] 10.222.0.16 () {58 vars in 1254 bytes} [Wed Sep 7 14:16:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-625149994 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)